2024-09-11T23:06:12.109 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T23:06:12.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T23:06:12.231 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901467 branch: squid description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/misc}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901467' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMBTayFxJZU+6vDT1kfUN8+feCK4LVeC7zeww7E/ZzUKicB5jfkIfF32kWPoZ1PH+c14DVy8bnWU6+8jc93Jw/U= smithi165.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDP7zOnQIXVLY4m2WGrctTE++0yXS2+PlKgre7yhc4knkJjiKAL12gPmtiExxw6TjPOzVUYiVGvvr67Malj169c= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestMisc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T23:06:12.231 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-11T23:06:12.232 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-11T23:06:12.232 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T23:06:12.234 INFO:teuthology.task.internal:Checking packages... 2024-09-11T23:06:12.256 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-11T23:06:12.256 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T23:06:12.256 INFO:teuthology.packaging:ref: None 2024-09-11T23:06:12.256 INFO:teuthology.packaging:tag: None 2024-09-11T23:06:12.256 INFO:teuthology.packaging:branch: squid 2024-09-11T23:06:12.256 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:06:12.256 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-11T23:06:12.506 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-11T23:06:12.507 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T23:06:12.514 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T23:06:12.514 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T23:06:12.539 INFO:teuthology.task.internal:Saving configuration 2024-09-11T23:06:12.556 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T23:06:12.563 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T23:06:12.597 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901467', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:00:52.414090', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMBTayFxJZU+6vDT1kfUN8+feCK4LVeC7zeww7E/ZzUKicB5jfkIfF32kWPoZ1PH+c14DVy8bnWU6+8jc93Jw/U='} 2024-09-11T23:06:12.627 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi165.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901467', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:00:52.412589', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDP7zOnQIXVLY4m2WGrctTE++0yXS2+PlKgre7yhc4knkJjiKAL12gPmtiExxw6TjPOzVUYiVGvvr67Malj169c='} 2024-09-11T23:06:12.627 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T23:06:12.633 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-11T23:06:12.634 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-11T23:06:12.634 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T23:06:12.709 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f06e81a7be0>, signals=[15]) 2024-09-11T23:06:12.709 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T23:06:12.715 INFO:teuthology.task.internal:Opening connections... 2024-09-11T23:06:12.715 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:06:12.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:06:12.824 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:06:12.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:06:12.908 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T23:06:12.914 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2024-09-11T23:06:12.933 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2024-09-11T23:06:12.934 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2024-09-11T23:06:12.991 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2024-09-11T23:06:12.991 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2024-09-11T23:06:12.991 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2024-09-11T23:06:12.991 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2024-09-11T23:06:12.991 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2024-09-11T23:06:12.991 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2024-09-11T23:06:12.991 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T23:06:12.992 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2024-09-11T23:06:12.992 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2024-09-11T23:06:12.992 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T23:06:12.992 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2024-09-11T23:06:12.992 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T23:06:12.992 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T23:06:12.992 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T23:06:12.993 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2024-09-11T23:06:13.019 DEBUG:teuthology.orchestra.run.smithi165:> uname -m 2024-09-11T23:06:13.038 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64 2024-09-11T23:06:13.038 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release 2024-09-11T23:06:13.096 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream" 2024-09-11T23:06:13.097 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="9" 2024-09-11T23:06:13.097 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos" 2024-09-11T23:06:13.097 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora" 2024-09-11T23:06:13.097 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="9" 2024-09-11T23:06:13.097 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el9" 2024-09-11T23:06:13.097 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T23:06:13.097 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2024-09-11T23:06:13.097 INFO:teuthology.orchestra.run.smithi165.stdout:LOGO="fedora-logo-icon" 2024-09-11T23:06:13.097 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T23:06:13.097 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/" 2024-09-11T23:06:13.097 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T23:06:13.097 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T23:06:13.098 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T23:06:13.098 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2024-09-11T23:06:13.127 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T23:06:13.136 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T23:06:13.142 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T23:06:13.142 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:06:13.144 DEBUG:teuthology.orchestra.run.smithi165:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:06:13.162 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T23:06:13.168 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T23:06:13.168 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:06:13.202 DEBUG:teuthology.orchestra.run.smithi165:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:06:13.346 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T23:06:13.418 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T23:06:13.432 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-11T23:06:13.433 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-11T23:06:13.433 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-11T23:06:13.433 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:06:13.434 DEBUG:teuthology.orchestra.run.smithi165:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:06:13.451 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:06:13.451 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-11T23:06:13.462 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:06:13.463 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-11T23:06:13.635 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T23:06:13.635 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-11T23:06:13.636 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2024-09-11T23:06:13.651 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T23:06:13.651 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-11T23:06:13.651 DEBUG:teuthology.orchestra.run.smithi165:> uname -r 2024-09-11T23:06:13.653 INFO:teuthology.orchestra.run.smithi144.stdout:5.14.0-503.el9.x86_64 2024-09-11T23:06:13.653 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T23:06:13.654 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-11T23:06:13.654 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum upgrade -y linux-firmware 2024-09-11T23:06:13.669 INFO:teuthology.orchestra.run.smithi165.stdout:5.14.0-503.el9.x86_64 2024-09-11T23:06:13.670 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T23:06:13.670 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-11T23:06:13.670 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum upgrade -y linux-firmware 2024-09-11T23:06:16.019 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-11T23:06:16.022 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-11T23:06:17.672 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - AppStream 37 MB/s | 20 MB 00:00 2024-09-11T23:06:23.012 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.5 MB 00:01 2024-09-11T23:06:24.456 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - AppStream 2.8 MB/s | 20 MB 00:07 2024-09-11T23:06:24.554 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - Extras packages 56 kB/s | 19 kB 00:00 2024-09-11T23:06:25.716 INFO:teuthology.orchestra.run.smithi165.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-11T23:06:29.965 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-11T23:06:31.205 INFO:teuthology.orchestra.run.smithi165.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-11T23:06:31.490 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 19 kB 00:00 2024-09-11T23:06:32.369 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-11T23:06:33.327 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-11T23:06:33.328 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-11T23:06:33.328 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-11T23:06:33.418 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-11T23:06:33.419 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T23:06:33.576 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-11T23:06:33.577 DEBUG:teuthology.orchestra.run.smithi165:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-11T23:06:33.579 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi165.front.sepia.ceph.com to complete... 2024-09-11T23:06:37.767 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-09-11T23:06:39.850 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-11T23:06:39.851 INFO:teuthology.orchestra.run.smithi144.stdout:Nothing to do. 2024-09-11T23:06:39.851 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-11T23:06:39.962 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-11T23:06:39.963 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T23:06:40.112 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-11T23:06:40.112 DEBUG:teuthology.orchestra.run.smithi144:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-11T23:06:40.114 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi144.front.sepia.ceph.com to complete... 2024-09-11T23:06:40.787 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11 23:06:40 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-11T23:06:40.787 INFO:teuthology.orchestra.run.smithi165.stderr:FINISHED --2024-09-11 23:06:40-- 2024-09-11T23:06:40.787 INFO:teuthology.orchestra.run.smithi165.stderr:Total wall clock time: 7.2s 2024-09-11T23:06:40.787 INFO:teuthology.orchestra.run.smithi165.stderr:Downloaded: 1 files, 343M in 6.9s (49.9 MB/s) 2024-09-11T23:06:40.790 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-11T23:06:40.790 DEBUG:teuthology.orchestra.run.smithi165:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-11T23:06:42.941 INFO:teuthology.orchestra.run.smithi165.stdout:Verifying... ######################################## 2024-09-11T23:06:43.097 INFO:teuthology.orchestra.run.smithi165.stdout:Preparing... ######################################## 2024-09-11T23:06:43.212 INFO:teuthology.orchestra.run.smithi165.stdout:Updating / installing... 2024-09-11T23:06:46.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11 23:06:46 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-11T23:06:46.733 INFO:teuthology.orchestra.run.smithi144.stderr:FINISHED --2024-09-11 23:06:46-- 2024-09-11T23:06:46.733 INFO:teuthology.orchestra.run.smithi144.stderr:Total wall clock time: 6.6s 2024-09-11T23:06:46.734 INFO:teuthology.orchestra.run.smithi144.stderr:Downloaded: 1 files, 343M in 6.3s (54.7 MB/s) 2024-09-11T23:06:46.737 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-11T23:06:46.737 DEBUG:teuthology.orchestra.run.smithi144:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-11T23:06:48.914 INFO:teuthology.orchestra.run.smithi144.stdout:Verifying... ######################################## 2024-09-11T23:06:49.324 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing... ######################################## 2024-09-11T23:06:49.451 INFO:teuthology.orchestra.run.smithi144.stdout:Updating / installing... 2024-09-11T23:06:51.184 INFO:teuthology.orchestra.run.smithi165.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-11T23:06:57.500 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-11T23:07:30.607 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi165.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-11T23:07:30.608 DEBUG:teuthology.orchestra.run.smithi165:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-11T23:07:30.689 INFO:teuthology.orchestra.run.smithi165.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:07:30.689 INFO:teuthology.orchestra.run.smithi165.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:07:30.689 INFO:teuthology.orchestra.run.smithi165.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:07:30.689 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:07:30.690 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-11T23:07:30.690 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-11T23:07:30.690 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-11T23:07:30.690 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-11T23:07:30.690 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-11T23:07:30.690 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-11T23:07:30.690 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-11T23:07:30.690 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-11T23:07:30.690 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-11T23:07:30.691 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-11T23:07:30.691 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-11T23:07:30.691 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-11T23:07:30.691 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-11T23:07:30.691 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-11T23:07:30.691 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-11T23:07:30.691 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-11T23:07:30.691 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-11T23:07:30.691 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-11T23:07:30.691 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-11T23:07:30.691 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-11T23:07:30.692 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-11T23:07:30.692 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-11T23:07:30.692 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-11T23:07:30.692 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-11T23:07:30.692 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-11T23:07:30.692 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-11T23:07:30.692 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-11T23:07:30.692 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-11T23:07:30.692 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-11T23:07:30.692 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-11T23:07:30.693 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-11T23:07:30.693 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-11T23:07:30.693 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-11T23:07:30.693 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-11T23:07:30.693 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-11T23:07:30.693 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-11T23:07:30.693 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-11T23:07:30.693 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-11T23:07:30.693 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-11T23:07:30.693 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-11T23:07:30.693 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-11T23:07:30.694 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-11T23:07:30.694 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-11T23:07:30.694 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-11T23:07:30.694 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-11T23:07:30.694 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-11T23:07:30.694 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-11T23:07:30.694 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-11T23:07:30.694 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-11T23:07:30.694 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-11T23:07:30.694 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-11T23:07:30.694 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-11T23:07:30.694 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-11T23:07:30.694 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-11T23:07:30.695 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-11T23:07:30.695 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-11T23:07:30.695 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-11T23:07:30.695 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-11T23:07:30.695 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-11T23:07:30.695 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-11T23:07:30.695 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-11T23:07:30.695 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-11T23:07:30.695 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-11T23:07:30.695 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-11T23:07:30.695 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-11T23:07:30.695 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-11T23:07:30.695 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-11T23:07:30.696 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-11T23:07:30.696 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-11T23:07:30.696 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-11T23:07:30.696 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-11T23:07:30.696 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-11T23:07:30.696 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-11T23:07:30.696 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-11T23:07:30.696 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-11T23:07:30.696 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-11T23:07:30.697 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-11T23:07:30.697 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-11T23:07:30.697 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-11T23:07:30.697 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-11T23:07:30.697 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-11T23:07:30.697 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-11T23:07:30.697 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-11T23:07:30.697 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-11T23:07:30.697 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-11T23:07:30.697 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-11T23:07:30.697 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-11T23:07:30.697 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-11T23:07:30.698 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-11T23:07:30.698 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-11T23:07:30.698 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-11T23:07:30.698 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-11T23:07:30.698 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-11T23:07:30.698 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-11T23:07:30.698 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-11T23:07:30.698 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-11T23:07:30.698 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-11T23:07:30.698 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-11T23:07:30.698 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-11T23:07:30.698 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-11T23:07:30.698 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-11T23:07:30.699 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-11T23:07:30.699 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-11T23:07:30.699 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-11T23:07:30.699 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-11T23:07:30.699 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-11T23:07:30.699 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-11T23:07:30.699 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-11T23:07:30.699 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-11T23:07:30.699 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-11T23:07:30.699 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-11T23:07:30.699 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-11T23:07:30.699 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-11T23:07:30.699 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-11T23:07:30.700 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-11T23:07:30.700 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-11T23:07:30.700 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-11T23:07:30.700 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-11T23:07:30.700 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-11T23:07:30.700 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-11T23:07:30.700 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-11T23:07:30.700 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-11T23:07:30.700 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-11T23:07:30.700 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-11T23:07:30.700 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-11T23:07:30.700 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-11T23:07:30.701 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-11T23:07:30.701 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-11T23:07:30.701 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-11T23:07:30.701 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-11T23:07:30.701 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-11T23:07:30.701 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-11T23:07:30.701 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-11T23:07:30.701 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-11T23:07:30.701 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-11T23:07:30.701 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-11T23:07:30.701 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-11T23:07:30.701 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-11T23:07:30.701 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-11T23:07:30.702 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-11T23:07:30.702 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-11T23:07:30.702 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-11T23:07:30.702 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-11T23:07:30.702 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-11T23:07:30.702 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-11T23:07:30.702 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-11T23:07:30.702 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-11T23:07:30.702 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-11T23:07:30.702 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-11T23:07:30.702 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-11T23:07:30.702 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-11T23:07:30.702 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-11T23:07:30.703 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-11T23:07:30.703 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-11T23:07:30.703 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-11T23:07:30.703 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-11T23:07:30.703 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-11T23:07:30.703 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-11T23:07:30.703 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-11T23:07:30.703 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-11T23:07:30.703 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-11T23:07:30.703 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-11T23:07:30.703 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-11T23:07:30.703 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-11T23:07:30.703 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-11T23:07:30.704 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-11T23:07:30.704 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-11T23:07:30.704 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-11T23:07:30.704 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-11T23:07:30.704 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-11T23:07:30.704 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-11T23:07:30.704 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-11T23:07:30.704 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-11T23:07:30.704 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-11T23:07:30.704 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-11T23:07:30.704 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-11T23:07:30.704 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-11T23:07:30.704 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-11T23:07:30.705 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-11T23:07:30.705 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-11T23:07:30.705 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-11T23:07:30.705 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-11T23:07:30.705 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-11T23:07:30.705 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-11T23:07:30.705 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-11T23:07:30.705 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-11T23:07:30.705 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-11T23:07:30.705 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-11T23:07:30.705 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-11T23:07:30.705 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-11T23:07:30.706 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-11T23:07:30.706 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-11T23:07:30.706 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-11T23:07:30.706 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-11T23:07:30.706 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-11T23:07:30.706 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-11T23:07:30.706 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-11T23:07:30.706 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-11T23:07:30.706 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-11T23:07:30.706 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-11T23:07:30.706 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-11T23:07:30.706 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-11T23:07:30.706 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-11T23:07:30.706 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-11T23:07:30.707 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-11T23:07:30.707 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-11T23:07:30.707 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-11T23:07:30.707 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-11T23:07:30.707 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-11T23:07:30.707 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-11T23:07:30.707 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-11T23:07:30.707 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-11T23:07:30.707 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-11T23:07:30.707 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-11T23:07:30.707 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-11T23:07:30.707 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-11T23:07:30.708 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-11T23:07:30.708 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-11T23:07:30.708 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-11T23:07:30.708 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-11T23:07:30.708 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-11T23:07:30.708 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-11T23:07:30.708 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-11T23:07:30.708 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-11T23:07:30.708 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-11T23:07:30.708 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-11T23:07:30.708 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-11T23:07:30.708 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-11T23:07:30.708 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-11T23:07:30.708 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-11T23:07:30.709 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-11T23:07:30.709 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-11T23:07:30.709 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-11T23:07:30.709 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-11T23:07:30.709 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-11T23:07:30.709 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-11T23:07:30.709 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-11T23:07:30.709 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-11T23:07:30.709 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-11T23:07:30.709 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-11T23:07:30.710 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-11T23:07:30.710 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-11T23:07:30.710 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-11T23:07:30.710 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-11T23:07:30.710 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-11T23:07:30.710 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-11T23:07:30.710 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-11T23:07:30.710 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-11T23:07:30.710 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-11T23:07:30.710 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-11T23:07:30.710 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-11T23:07:30.710 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-11T23:07:30.711 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-11T23:07:30.711 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-11T23:07:30.711 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-11T23:07:30.711 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-11T23:07:30.711 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-11T23:07:30.711 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-11T23:07:30.711 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-11T23:07:30.711 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-11T23:07:30.711 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-11T23:07:30.711 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-11T23:07:30.711 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-11T23:07:30.712 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-11T23:07:30.712 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-11T23:07:30.712 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-11T23:07:30.712 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-11T23:07:30.712 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-11T23:07:30.712 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-11T23:07:30.712 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-11T23:07:30.712 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-11T23:07:30.712 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-11T23:07:30.712 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-11T23:07:30.712 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-11T23:07:30.713 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-11T23:07:30.713 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-11T23:07:30.713 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-11T23:07:30.713 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-11T23:07:30.713 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-11T23:07:30.713 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-11T23:07:30.713 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-11T23:07:30.713 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-11T23:07:30.713 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-11T23:07:30.713 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-11T23:07:30.713 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-11T23:07:30.713 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-11T23:07:30.713 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-11T23:07:30.714 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-11T23:07:30.714 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-11T23:07:30.714 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-11T23:07:30.714 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-11T23:07:30.714 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-11T23:07:30.714 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-11T23:07:30.714 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-11T23:07:30.714 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-11T23:07:30.714 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-11T23:07:30.714 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-11T23:07:30.714 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-11T23:07:30.714 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-11T23:07:30.715 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-11T23:07:30.715 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-11T23:07:30.715 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-11T23:07:30.715 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-11T23:07:30.715 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-11T23:07:30.715 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-11T23:07:30.715 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-11T23:07:30.715 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-11T23:07:30.715 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-11T23:07:30.715 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-11T23:07:30.715 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-11T23:07:30.715 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-11T23:07:30.715 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-11T23:07:30.715 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-11T23:07:30.716 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-11T23:07:30.716 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-11T23:07:30.716 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-11T23:07:30.716 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-11T23:07:30.716 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-11T23:07:30.716 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-11T23:07:30.716 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-11T23:07:30.716 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-11T23:07:30.717 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-11T23:07:30.717 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-11T23:07:30.717 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-11T23:07:30.717 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-11T23:07:30.717 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-11T23:07:30.717 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-11T23:07:30.717 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-11T23:07:30.717 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-11T23:07:30.717 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-11T23:07:30.718 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-11T23:07:30.718 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-11T23:07:30.718 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-11T23:07:30.718 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-11T23:07:30.718 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-11T23:07:30.718 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-11T23:07:30.718 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-11T23:07:30.718 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-11T23:07:30.718 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-11T23:07:30.719 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-11T23:07:30.719 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-11T23:07:30.719 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-11T23:07:30.719 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-11T23:07:30.719 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-11T23:07:30.719 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-11T23:07:30.719 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-11T23:07:30.719 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-11T23:07:30.719 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-11T23:07:30.719 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-11T23:07:30.719 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-11T23:07:30.719 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-11T23:07:30.719 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-11T23:07:30.720 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-11T23:07:30.720 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-11T23:07:30.720 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-11T23:07:30.720 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-11T23:07:30.720 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-11T23:07:30.720 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-11T23:07:30.720 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-11T23:07:30.720 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-11T23:07:30.720 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-11T23:07:30.720 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-11T23:07:30.720 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-11T23:07:30.720 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-11T23:07:30.721 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-11T23:07:30.721 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-11T23:07:30.721 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-11T23:07:30.721 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-11T23:07:30.721 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-11T23:07:30.721 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-11T23:07:30.721 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-11T23:07:30.721 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-11T23:07:30.721 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-11T23:07:30.722 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-11T23:07:30.722 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-11T23:07:30.722 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-11T23:07:30.722 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-11T23:07:30.722 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-11T23:07:30.722 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-11T23:07:30.722 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-11T23:07:30.722 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-11T23:07:30.722 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-11T23:07:30.722 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-11T23:07:30.722 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-11T23:07:30.722 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-11T23:07:30.723 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-11T23:07:30.723 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-11T23:07:30.723 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-11T23:07:30.723 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-11T23:07:30.723 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-11T23:07:30.723 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-11T23:07:30.723 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-11T23:07:30.723 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-11T23:07:30.723 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-11T23:07:30.723 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-11T23:07:30.723 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-11T23:07:30.723 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-11T23:07:30.723 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-11T23:07:30.724 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-11T23:07:30.724 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-11T23:07:30.724 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-11T23:07:30.724 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-11T23:07:30.724 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-11T23:07:30.724 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-11T23:07:30.724 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-11T23:07:30.724 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-11T23:07:30.724 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-11T23:07:30.724 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-11T23:07:30.724 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-11T23:07:30.724 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-11T23:07:30.724 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-11T23:07:30.725 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-11T23:07:30.725 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-11T23:07:30.725 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-11T23:07:30.725 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-11T23:07:30.725 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-11T23:07:30.725 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-11T23:07:30.725 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-11T23:07:30.725 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-11T23:07:30.725 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-11T23:07:30.725 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-11T23:07:30.725 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-11T23:07:30.725 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-11T23:07:30.725 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-11T23:07:30.726 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-11T23:07:30.726 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-11T23:07:30.726 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-11T23:07:30.726 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-11T23:07:30.726 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-11T23:07:30.726 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-11T23:07:30.726 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-11T23:07:30.726 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-11T23:07:30.726 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-11T23:07:30.726 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-11T23:07:30.726 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-11T23:07:30.726 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-11T23:07:30.726 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-11T23:07:30.726 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-11T23:07:30.727 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-11T23:07:30.727 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-11T23:07:30.727 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-11T23:07:30.727 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-11T23:07:30.727 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-11T23:07:30.727 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-11T23:07:30.727 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-11T23:07:30.727 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-11T23:07:30.727 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-11T23:07:30.727 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-11T23:07:30.727 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-11T23:07:30.727 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-11T23:07:30.727 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-11T23:07:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-11T23:07:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-11T23:07:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-11T23:07:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-11T23:07:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-11T23:07:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-11T23:07:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-11T23:07:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-11T23:07:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-11T23:07:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-11T23:07:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-11T23:07:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-11T23:07:30.728 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-11T23:07:30.729 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-11T23:07:30.729 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-11T23:07:30.729 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-11T23:07:30.729 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-11T23:07:30.729 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-11T23:07:30.729 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-11T23:07:30.729 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-11T23:07:30.729 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-11T23:07:30.729 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-11T23:07:30.729 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-11T23:07:30.729 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-11T23:07:30.729 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-11T23:07:30.730 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-11T23:07:30.730 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-11T23:07:30.730 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-11T23:07:30.730 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-11T23:07:30.730 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-11T23:07:30.730 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-11T23:07:30.730 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-11T23:07:30.730 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-11T23:07:30.730 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-11T23:07:30.730 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-11T23:07:30.730 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-11T23:07:30.730 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-11T23:07:30.730 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-11T23:07:30.731 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-11T23:07:30.731 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-11T23:07:30.731 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-11T23:07:30.731 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-11T23:07:30.731 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-11T23:07:30.731 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-11T23:07:30.731 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-11T23:07:30.731 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-11T23:07:30.731 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-11T23:07:30.731 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-11T23:07:30.731 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-11T23:07:30.731 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-11T23:07:30.731 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-11T23:07:30.731 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-11T23:07:30.731 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-11T23:07:30.732 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-11T23:07:30.732 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-11T23:07:30.732 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-11T23:07:30.732 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-11T23:07:30.732 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-11T23:07:30.732 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-11T23:07:30.732 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-11T23:07:30.732 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-11T23:07:30.732 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-11T23:07:30.732 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-11T23:07:30.732 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-11T23:07:30.732 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-11T23:07:30.732 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-11T23:07:30.732 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-11T23:07:30.733 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-11T23:07:30.733 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-11T23:07:30.733 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-11T23:07:30.733 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-11T23:07:30.733 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-11T23:07:30.733 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-11T23:07:30.733 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-11T23:07:30.733 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-11T23:07:30.733 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-11T23:07:30.733 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-11T23:07:30.733 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-11T23:07:30.733 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-11T23:07:30.733 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-11T23:07:30.734 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-11T23:07:30.734 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-11T23:07:30.734 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-11T23:07:30.734 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-11T23:07:30.734 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-11T23:07:30.734 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-11T23:07:30.734 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-11T23:07:30.734 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-11T23:07:30.734 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-11T23:07:30.734 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-11T23:07:30.734 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-11T23:07:30.734 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-11T23:07:30.734 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-11T23:07:30.735 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-11T23:07:30.735 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-11T23:07:30.735 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-11T23:07:30.735 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-11T23:07:30.735 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-11T23:07:30.735 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-11T23:07:30.735 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-11T23:07:30.735 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-11T23:07:30.735 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-11T23:07:30.735 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-11T23:07:30.735 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-11T23:07:30.735 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-11T23:07:30.735 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-11T23:07:30.736 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-11T23:07:30.736 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-11T23:07:30.736 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-11T23:07:30.736 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-11T23:07:30.736 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-11T23:07:30.736 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-11T23:07:30.736 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-11T23:07:30.736 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-11T23:07:30.736 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-11T23:07:30.736 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-11T23:07:30.736 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-11T23:07:30.736 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-11T23:07:30.736 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-11T23:07:30.737 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-11T23:07:30.737 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-11T23:07:30.737 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-11T23:07:30.737 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-11T23:07:30.737 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-11T23:07:30.737 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-11T23:07:30.737 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-11T23:07:30.737 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-11T23:07:30.737 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-11T23:07:30.737 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-11T23:07:30.737 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-11T23:07:30.737 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-11T23:07:30.737 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-11T23:07:30.738 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-11T23:07:30.738 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-11T23:07:30.738 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-11T23:07:30.738 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-11T23:07:30.738 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-11T23:07:30.738 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-11T23:07:30.738 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-11T23:07:30.738 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-11T23:07:30.738 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-11T23:07:30.738 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-11T23:07:30.738 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-11T23:07:30.738 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-11T23:07:30.738 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-11T23:07:30.739 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-11T23:07:30.739 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-11T23:07:30.739 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-11T23:07:30.739 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-11T23:07:30.739 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-11T23:07:30.739 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-11T23:07:30.739 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-11T23:07:30.739 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-11T23:07:30.739 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-11T23:07:30.739 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-11T23:07:30.739 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-11T23:07:30.739 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-11T23:07:30.739 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-11T23:07:30.740 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-11T23:07:30.740 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-11T23:07:30.740 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-11T23:07:30.740 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-11T23:07:30.740 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-11T23:07:30.740 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-11T23:07:30.740 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-11T23:07:30.740 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-11T23:07:30.740 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-11T23:07:30.740 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-11T23:07:30.740 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-11T23:07:30.740 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-11T23:07:30.740 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-11T23:07:30.741 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-11T23:07:30.741 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-11T23:07:30.741 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-11T23:07:30.741 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-11T23:07:30.741 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-11T23:07:30.741 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-11T23:07:30.741 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-11T23:07:30.741 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-11T23:07:30.741 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-11T23:07:30.741 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-11T23:07:30.741 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-11T23:07:30.741 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-11T23:07:30.742 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-11T23:07:30.742 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-11T23:07:30.742 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-11T23:07:30.742 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-11T23:07:30.742 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-11T23:07:30.742 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-11T23:07:30.742 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-11T23:07:30.742 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-11T23:07:30.742 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-11T23:07:30.742 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-11T23:07:30.742 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-11T23:07:30.742 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-11T23:07:30.743 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-11T23:07:30.743 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-11T23:07:30.743 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-11T23:07:30.743 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-11T23:07:30.743 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-11T23:07:30.743 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-11T23:07:30.743 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-11T23:07:30.743 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-11T23:07:30.743 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-11T23:07:30.743 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-11T23:07:30.743 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-11T23:07:30.743 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-11T23:07:30.743 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-11T23:07:30.744 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-11T23:07:30.744 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-11T23:07:30.744 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-11T23:07:30.744 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-11T23:07:30.744 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-11T23:07:30.744 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-11T23:07:30.744 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-11T23:07:30.744 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-11T23:07:30.744 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-11T23:07:30.744 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-11T23:07:30.744 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-11T23:07:30.744 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-11T23:07:30.744 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-11T23:07:30.745 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-11T23:07:30.745 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-11T23:07:30.745 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-11T23:07:30.745 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-11T23:07:30.745 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-11T23:07:30.745 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-11T23:07:30.745 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-11T23:07:30.745 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-11T23:07:30.745 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-11T23:07:30.745 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-11T23:07:30.745 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-11T23:07:30.745 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-11T23:07:30.746 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-11T23:07:30.746 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-11T23:07:30.746 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-11T23:07:30.746 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-11T23:07:30.746 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-11T23:07:30.746 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-11T23:07:30.746 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-11T23:07:30.746 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-11T23:07:30.746 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-11T23:07:30.746 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-11T23:07:30.746 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-11T23:07:30.746 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-11T23:07:30.746 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-11T23:07:30.747 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-11T23:07:30.747 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-11T23:07:30.747 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-11T23:07:30.747 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-11T23:07:30.747 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-11T23:07:30.747 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-11T23:07:30.747 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-11T23:07:30.747 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-11T23:07:30.747 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-11T23:07:30.747 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-11T23:07:30.747 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-11T23:07:30.747 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-11T23:07:30.747 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-11T23:07:30.747 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-11T23:07:30.747 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-11T23:07:30.747 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-11T23:07:30.748 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-11T23:07:30.748 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-11T23:07:30.748 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-11T23:07:30.748 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-11T23:07:30.748 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-11T23:07:30.748 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-11T23:07:30.748 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-11T23:07:30.748 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-11T23:07:30.748 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-11T23:07:30.748 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-11T23:07:30.748 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-11T23:07:30.748 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-11T23:07:30.748 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-11T23:07:30.749 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-11T23:07:30.749 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-11T23:07:30.749 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-11T23:07:30.749 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-11T23:07:30.749 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-11T23:07:30.749 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-11T23:07:30.749 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-11T23:07:30.749 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-11T23:07:30.749 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-11T23:07:30.749 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-11T23:07:30.749 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-11T23:07:30.749 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-11T23:07:30.750 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-11T23:07:30.750 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-11T23:07:30.750 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-11T23:07:30.750 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-11T23:07:30.750 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-11T23:07:30.750 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-11T23:07:30.750 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-11T23:07:30.750 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-11T23:07:30.750 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-11T23:07:30.750 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-11T23:07:30.750 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-11T23:07:30.750 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-11T23:07:30.750 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-11T23:07:30.750 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-11T23:07:30.751 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-11T23:07:30.751 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-11T23:07:30.751 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-11T23:07:30.751 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-11T23:07:30.751 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-11T23:07:30.751 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-11T23:07:30.751 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-11T23:07:30.751 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-11T23:07:30.751 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-11T23:07:30.751 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-11T23:07:30.751 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-11T23:07:30.751 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-11T23:07:30.751 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-11T23:07:30.751 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-11T23:07:30.751 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-11T23:07:30.752 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-11T23:07:30.752 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-11T23:07:30.752 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-11T23:07:30.752 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-11T23:07:30.752 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-11T23:07:30.752 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-11T23:07:30.752 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-11T23:07:30.752 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-11T23:07:30.752 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-11T23:07:30.752 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-11T23:07:30.752 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-11T23:07:30.753 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-11T23:07:30.753 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-11T23:07:30.753 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-11T23:07:30.753 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-11T23:07:30.753 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-11T23:07:30.753 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-11T23:07:30.753 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-11T23:07:30.753 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-11T23:07:30.753 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-11T23:07:30.753 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-11T23:07:30.753 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-11T23:07:30.753 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-11T23:07:30.754 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-11T23:07:30.754 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-11T23:07:30.754 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-11T23:07:30.754 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-11T23:07:30.754 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-11T23:07:30.754 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-11T23:07:30.754 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-11T23:07:30.754 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-11T23:07:30.754 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-11T23:07:30.754 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-11T23:07:30.754 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-11T23:07:30.755 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-11T23:07:30.755 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-11T23:07:30.755 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-11T23:07:30.755 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-11T23:07:30.755 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-11T23:07:30.755 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-11T23:07:30.755 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-11T23:07:30.755 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-11T23:07:30.755 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-11T23:07:30.755 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-11T23:07:30.755 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-11T23:07:30.755 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-11T23:07:30.755 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-11T23:07:30.756 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-11T23:07:30.756 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-11T23:07:30.756 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-11T23:07:30.756 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-11T23:07:30.756 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-11T23:07:30.756 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-11T23:07:30.756 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-11T23:07:30.756 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-11T23:07:30.756 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-11T23:07:30.756 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-11T23:07:30.756 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-11T23:07:30.756 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-11T23:07:30.756 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-11T23:07:30.757 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-11T23:07:30.757 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-11T23:07:30.757 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-11T23:07:30.757 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-11T23:07:30.757 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-11T23:07:30.757 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-11T23:07:30.757 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-11T23:07:30.757 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-11T23:07:30.757 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-11T23:07:30.757 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-11T23:07:30.757 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-11T23:07:30.757 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-11T23:07:30.758 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-11T23:07:30.758 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-11T23:07:30.758 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-11T23:07:30.758 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-11T23:07:30.758 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-11T23:07:30.758 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-11T23:07:30.758 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-11T23:07:30.758 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-11T23:07:30.758 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-11T23:07:30.758 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-11T23:07:30.758 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-11T23:07:30.758 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-11T23:07:30.758 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-11T23:07:30.759 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-11T23:07:30.759 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-11T23:07:30.759 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-11T23:07:30.759 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-11T23:07:30.759 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-11T23:07:30.759 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-11T23:07:30.759 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-11T23:07:30.759 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-11T23:07:30.759 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-11T23:07:30.759 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-11T23:07:30.759 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-11T23:07:30.759 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-11T23:07:30.760 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-11T23:07:30.760 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-11T23:07:30.760 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-11T23:07:30.760 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-11T23:07:30.760 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-11T23:07:30.760 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-11T23:07:30.760 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-11T23:07:30.760 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-11T23:07:30.760 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-11T23:07:30.760 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-11T23:07:30.760 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-11T23:07:30.760 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-11T23:07:30.760 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-11T23:07:30.760 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-11T23:07:30.761 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-11T23:07:30.761 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-11T23:07:30.761 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-11T23:07:30.761 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-11T23:07:30.761 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-11T23:07:30.761 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-11T23:07:30.761 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-11T23:07:30.761 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-11T23:07:30.761 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-11T23:07:30.761 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-11T23:07:30.761 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-11T23:07:30.761 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-11T23:07:30.761 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-11T23:07:30.762 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-11T23:07:30.762 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-11T23:07:30.762 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-11T23:07:30.762 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-11T23:07:30.762 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-11T23:07:30.762 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-11T23:07:30.762 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-11T23:07:30.762 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-11T23:07:30.762 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-11T23:07:30.762 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-11T23:07:30.762 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-11T23:07:30.762 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-11T23:07:30.762 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-11T23:07:30.762 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-11T23:07:30.763 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-11T23:07:30.763 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-11T23:07:30.763 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-11T23:07:30.763 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-11T23:07:30.763 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-11T23:07:30.763 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-11T23:07:30.763 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-11T23:07:30.763 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-11T23:07:30.763 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-11T23:07:30.763 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-11T23:07:30.763 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-11T23:07:30.763 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-11T23:07:30.763 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-11T23:07:30.763 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-11T23:07:30.764 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-11T23:07:30.764 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-11T23:07:30.764 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-11T23:07:30.764 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-11T23:07:30.764 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-11T23:07:30.764 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-11T23:07:30.764 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-11T23:07:30.764 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-11T23:07:30.764 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-11T23:07:30.764 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-11T23:07:30.764 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-11T23:07:30.764 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-11T23:07:30.764 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-11T23:07:30.764 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-11T23:07:30.764 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-11T23:07:30.765 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-11T23:07:30.765 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-11T23:07:30.765 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-11T23:07:30.765 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-11T23:07:30.765 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-11T23:07:30.765 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-11T23:07:30.765 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-11T23:07:30.765 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-11T23:07:30.765 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-11T23:07:30.765 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-11T23:07:30.765 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-11T23:07:30.765 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-11T23:07:30.765 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-11T23:07:30.765 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-11T23:07:30.766 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-11T23:07:30.766 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-11T23:07:30.766 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-11T23:07:30.766 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-11T23:07:30.766 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-11T23:07:30.766 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-11T23:07:30.766 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-11T23:07:30.766 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-11T23:07:30.766 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-11T23:07:30.766 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-11T23:07:30.766 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-11T23:07:30.766 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-11T23:07:30.766 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-11T23:07:30.767 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-11T23:07:30.767 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-11T23:07:30.767 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-11T23:07:30.767 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-11T23:07:30.767 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-11T23:07:30.767 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-11T23:07:30.767 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-11T23:07:30.767 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-11T23:07:30.767 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-11T23:07:30.767 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-11T23:07:30.767 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-11T23:07:30.767 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-11T23:07:30.767 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-11T23:07:30.768 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-11T23:07:30.768 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-11T23:07:30.768 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-11T23:07:30.768 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-11T23:07:30.768 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-11T23:07:30.768 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-11T23:07:30.768 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-11T23:07:30.768 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-11T23:07:30.768 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-11T23:07:30.768 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-11T23:07:30.768 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-11T23:07:30.768 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-11T23:07:30.769 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-11T23:07:30.769 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-11T23:07:30.769 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-11T23:07:30.769 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-11T23:07:30.769 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-11T23:07:30.769 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-11T23:07:30.769 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-11T23:07:30.769 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-11T23:07:30.769 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-11T23:07:30.769 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-11T23:07:30.769 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-11T23:07:30.769 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-11T23:07:30.769 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-11T23:07:30.772 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-11T23:07:30.772 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-11T23:07:30.772 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-11T23:07:30.772 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-11T23:07:30.772 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-11T23:07:30.773 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-11T23:07:30.773 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-11T23:07:30.773 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-11T23:07:30.773 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-11T23:07:30.773 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-11T23:07:30.773 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-11T23:07:30.773 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-11T23:07:30.773 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-11T23:07:30.773 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-11T23:07:30.773 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-11T23:07:30.773 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-11T23:07:30.773 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-11T23:07:30.773 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-11T23:07:30.773 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-11T23:07:30.774 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-11T23:07:30.774 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-11T23:07:30.774 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-11T23:07:30.774 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-11T23:07:30.774 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-11T23:07:30.774 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-11T23:07:30.774 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-11T23:07:30.774 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-11T23:07:30.774 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-11T23:07:30.774 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-11T23:07:30.774 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-11T23:07:30.774 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-11T23:07:30.774 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-11T23:07:30.775 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-11T23:07:30.775 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-11T23:07:30.775 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-11T23:07:30.775 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-11T23:07:30.775 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-11T23:07:30.775 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-11T23:07:30.775 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-11T23:07:30.775 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-11T23:07:30.775 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-11T23:07:30.775 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-11T23:07:30.775 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-11T23:07:30.775 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-11T23:07:30.775 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-11T23:07:30.775 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-11T23:07:30.775 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-11T23:07:30.776 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-11T23:07:30.776 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-11T23:07:30.776 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-11T23:07:30.776 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-11T23:07:30.776 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-11T23:07:30.776 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-11T23:07:30.776 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-11T23:07:30.776 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-11T23:07:30.776 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-11T23:07:30.776 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-11T23:07:30.776 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-11T23:07:30.776 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-11T23:07:30.776 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-11T23:07:30.776 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-11T23:07:30.777 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-11T23:07:30.777 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-11T23:07:30.777 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-11T23:07:30.777 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-11T23:07:30.777 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-11T23:07:30.777 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-11T23:07:30.777 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-11T23:07:30.777 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-11T23:07:30.777 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-11T23:07:30.777 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-11T23:07:30.777 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-11T23:07:30.777 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-11T23:07:30.778 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-11T23:07:30.778 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-11T23:07:30.778 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-11T23:07:30.778 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-11T23:07:30.778 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-11T23:07:30.778 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-11T23:07:30.778 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-11T23:07:30.778 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-11T23:07:30.778 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-11T23:07:30.778 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-11T23:07:30.778 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-11T23:07:30.778 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-11T23:07:30.778 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-11T23:07:30.778 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-11T23:07:30.779 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-11T23:07:30.779 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-11T23:07:30.779 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-11T23:07:30.779 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-11T23:07:30.779 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-11T23:07:30.779 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-11T23:07:30.779 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-11T23:07:30.779 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-11T23:07:30.779 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-11T23:07:30.779 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-11T23:07:30.779 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-11T23:07:30.779 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-11T23:07:30.779 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-11T23:07:30.779 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-11T23:07:30.780 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-11T23:07:30.780 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-11T23:07:30.780 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-11T23:07:30.780 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-11T23:07:30.780 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-11T23:07:30.780 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-11T23:07:30.780 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-11T23:07:30.780 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-11T23:07:30.780 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-11T23:07:30.780 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-11T23:07:30.780 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-11T23:07:30.780 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-11T23:07:30.780 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-11T23:07:30.780 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-11T23:07:30.781 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-11T23:07:30.781 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-11T23:07:30.781 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-11T23:07:30.781 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-11T23:07:30.781 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-11T23:07:30.781 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-11T23:07:30.781 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-11T23:07:30.781 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-11T23:07:30.782 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-11T23:07:30.782 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-11T23:07:30.782 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-11T23:07:30.782 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-11T23:07:30.782 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-11T23:07:30.782 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-11T23:07:30.782 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-11T23:07:30.782 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-11T23:07:30.783 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-11T23:07:30.783 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-11T23:07:30.783 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-11T23:07:30.783 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-11T23:07:30.783 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-11T23:07:30.783 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-11T23:07:30.783 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-11T23:07:30.783 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-11T23:07:30.783 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-11T23:07:30.783 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-11T23:07:30.783 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-11T23:07:30.783 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-11T23:07:30.783 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-11T23:07:30.783 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-11T23:07:30.783 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-11T23:07:30.784 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-11T23:07:30.784 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-11T23:07:30.784 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-11T23:07:30.784 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-11T23:07:30.784 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-11T23:07:30.784 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-11T23:07:30.784 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-11T23:07:30.784 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-11T23:07:30.784 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-11T23:07:30.784 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-11T23:07:30.784 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-11T23:07:30.784 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-11T23:07:30.784 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-11T23:07:30.784 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-11T23:07:30.784 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-11T23:07:30.785 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-11T23:07:30.785 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-11T23:07:30.785 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-11T23:07:30.785 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-11T23:07:30.785 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-11T23:07:30.785 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-11T23:07:30.785 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-11T23:07:30.785 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-11T23:07:30.785 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-11T23:07:30.785 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-11T23:07:30.785 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-11T23:07:30.785 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-11T23:07:30.785 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-11T23:07:30.785 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-11T23:07:30.785 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-11T23:07:30.786 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-11T23:07:30.786 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-11T23:07:30.786 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-11T23:07:30.786 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-11T23:07:30.786 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-11T23:07:30.786 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-11T23:07:30.786 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-11T23:07:30.786 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-11T23:07:30.786 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-11T23:07:30.786 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-11T23:07:30.786 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-11T23:07:30.786 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-11T23:07:30.786 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-11T23:07:30.786 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-11T23:07:30.786 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-11T23:07:30.787 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-11T23:07:30.787 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-11T23:07:30.787 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-11T23:07:30.787 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-11T23:07:30.787 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-11T23:07:30.787 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-11T23:07:30.787 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-11T23:07:30.787 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-11T23:07:30.787 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-11T23:07:30.787 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-11T23:07:30.787 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-11T23:07:30.787 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-11T23:07:30.787 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-11T23:07:30.787 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-11T23:07:30.788 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-11T23:07:30.788 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-11T23:07:30.788 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-11T23:07:30.788 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-11T23:07:30.788 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-11T23:07:30.788 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-11T23:07:30.788 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-11T23:07:30.788 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-11T23:07:30.788 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-11T23:07:30.788 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-11T23:07:30.788 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-11T23:07:30.788 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-11T23:07:30.788 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-11T23:07:30.788 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-11T23:07:30.788 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-11T23:07:30.789 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-11T23:07:30.789 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-11T23:07:30.789 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-11T23:07:30.789 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-11T23:07:30.789 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-11T23:07:30.789 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-11T23:07:30.789 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-11T23:07:30.789 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-11T23:07:30.789 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-11T23:07:30.789 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-11T23:07:30.789 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-11T23:07:30.789 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-11T23:07:30.789 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-11T23:07:30.789 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-11T23:07:30.790 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-11T23:07:30.790 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-11T23:07:30.790 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-11T23:07:30.790 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-11T23:07:30.790 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-11T23:07:30.790 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-11T23:07:30.790 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-11T23:07:30.790 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-11T23:07:30.790 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-11T23:07:30.790 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-11T23:07:30.790 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-11T23:07:30.790 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-11T23:07:30.790 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-11T23:07:30.790 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-11T23:07:30.790 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-11T23:07:30.790 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-11T23:07:30.790 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-11T23:07:30.791 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-11T23:07:30.791 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-11T23:07:30.791 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-11T23:07:30.791 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-11T23:07:30.791 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-11T23:07:30.791 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-11T23:07:30.791 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-11T23:07:30.791 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-11T23:07:30.791 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-11T23:07:30.791 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-11T23:07:30.791 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-11T23:07:30.791 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-11T23:07:30.791 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-11T23:07:30.791 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-11T23:07:30.792 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-11T23:07:30.792 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-11T23:07:30.792 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-11T23:07:30.792 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-11T23:07:30.792 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-11T23:07:30.792 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-11T23:07:30.792 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-11T23:07:30.792 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-11T23:07:30.792 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-11T23:07:30.792 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-11T23:07:30.792 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-11T23:07:30.792 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-11T23:07:30.793 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-11T23:07:30.793 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-11T23:07:30.793 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-11T23:07:30.793 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-11T23:07:30.793 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-11T23:07:30.793 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-11T23:07:30.793 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-11T23:07:30.793 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-11T23:07:30.793 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-11T23:07:30.793 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-11T23:07:30.793 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-11T23:07:30.793 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-11T23:07:30.793 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-11T23:07:30.793 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-11T23:07:30.794 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-11T23:07:30.794 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-11T23:07:30.794 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-11T23:07:30.794 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-11T23:07:30.794 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-11T23:07:30.794 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-11T23:07:30.794 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-11T23:07:30.794 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-11T23:07:30.794 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-11T23:07:30.794 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-11T23:07:30.794 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-11T23:07:30.794 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-11T23:07:30.794 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-11T23:07:30.794 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-11T23:07:30.795 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-11T23:07:30.795 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-11T23:07:30.795 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-11T23:07:30.795 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-11T23:07:30.795 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-11T23:07:30.795 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-11T23:07:30.795 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-11T23:07:30.795 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-11T23:07:30.795 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-11T23:07:30.795 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-11T23:07:30.795 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-11T23:07:30.795 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-11T23:07:30.795 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-11T23:07:30.795 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-11T23:07:30.796 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-11T23:07:30.796 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-11T23:07:30.796 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-11T23:07:30.796 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-11T23:07:30.796 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-11T23:07:30.796 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-11T23:07:30.796 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-11T23:07:30.796 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-11T23:07:30.796 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-11T23:07:30.796 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-11T23:07:30.796 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-11T23:07:30.796 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-11T23:07:30.796 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-11T23:07:30.796 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-11T23:07:30.797 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-11T23:07:30.797 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-11T23:07:30.797 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-11T23:07:30.797 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-11T23:07:30.797 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-11T23:07:30.797 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-11T23:07:30.797 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-11T23:07:30.797 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-11T23:07:30.797 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-11T23:07:30.797 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-11T23:07:30.797 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-11T23:07:30.797 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-11T23:07:30.797 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-11T23:07:30.797 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-11T23:07:30.798 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-11T23:07:30.798 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-11T23:07:30.798 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-11T23:07:30.798 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-11T23:07:30.798 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-11T23:07:30.798 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-11T23:07:30.798 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-11T23:07:30.798 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-11T23:07:30.798 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-11T23:07:30.798 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-11T23:07:30.798 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-11T23:07:30.798 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-11T23:07:30.798 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-11T23:07:30.798 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-11T23:07:30.799 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-11T23:07:30.799 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-11T23:07:30.799 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-11T23:07:30.799 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-11T23:07:30.799 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-11T23:07:30.799 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-11T23:07:30.799 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-11T23:07:30.799 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-11T23:07:30.799 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-11T23:07:30.799 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-11T23:07:30.799 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-11T23:07:30.799 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-11T23:07:30.799 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-11T23:07:30.799 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-11T23:07:30.799 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-11T23:07:30.800 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-11T23:07:30.800 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-11T23:07:30.800 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-11T23:07:30.800 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-11T23:07:30.800 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-11T23:07:30.800 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-11T23:07:30.800 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-11T23:07:30.800 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-11T23:07:30.800 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-11T23:07:30.800 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-11T23:07:30.800 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-11T23:07:30.800 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-11T23:07:30.800 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-11T23:07:30.800 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-11T23:07:30.800 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-11T23:07:30.801 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-11T23:07:30.801 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-11T23:07:30.801 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-11T23:07:30.801 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-11T23:07:30.801 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-11T23:07:30.801 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-11T23:07:30.801 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-11T23:07:30.801 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-11T23:07:30.801 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-11T23:07:30.801 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-11T23:07:30.801 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-11T23:07:30.801 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-11T23:07:30.801 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-11T23:07:30.801 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-11T23:07:30.802 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-11T23:07:30.802 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-11T23:07:30.802 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-11T23:07:30.802 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-11T23:07:30.802 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-11T23:07:30.802 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-11T23:07:30.802 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-11T23:07:30.802 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-11T23:07:30.802 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-11T23:07:30.802 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-11T23:07:30.802 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-11T23:07:30.802 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-11T23:07:30.802 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-11T23:07:30.802 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-11T23:07:30.802 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-11T23:07:30.802 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-11T23:07:30.803 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-11T23:07:30.803 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-11T23:07:30.803 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-11T23:07:30.803 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-11T23:07:30.803 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-11T23:07:30.803 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-11T23:07:30.803 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-11T23:07:30.803 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-11T23:07:30.803 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-11T23:07:30.803 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-11T23:07:30.803 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-11T23:07:30.803 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-11T23:07:30.803 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-11T23:07:30.803 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-11T23:07:30.804 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-11T23:07:30.804 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-11T23:07:30.804 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-11T23:07:30.804 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-11T23:07:30.804 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-11T23:07:30.804 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-11T23:07:30.804 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-11T23:07:30.804 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-11T23:07:30.804 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-11T23:07:30.804 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-11T23:07:30.804 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-11T23:07:30.804 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-11T23:07:30.804 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-11T23:07:30.804 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-11T23:07:30.804 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-11T23:07:30.804 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-11T23:07:30.805 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-11T23:07:30.805 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-11T23:07:30.805 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-11T23:07:30.805 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-11T23:07:30.805 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-11T23:07:30.805 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-11T23:07:30.805 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-11T23:07:30.805 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-11T23:07:30.805 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-11T23:07:30.805 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-11T23:07:30.805 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-11T23:07:30.805 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-11T23:07:30.805 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-11T23:07:30.805 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-11T23:07:30.805 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-11T23:07:30.806 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-11T23:07:30.806 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-11T23:07:30.806 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-11T23:07:30.806 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-11T23:07:30.806 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-11T23:07:30.806 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-11T23:07:30.806 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-11T23:07:30.806 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-11T23:07:30.806 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-11T23:07:30.806 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-11T23:07:30.806 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-11T23:07:30.806 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-11T23:07:30.806 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-11T23:07:30.806 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-11T23:07:30.806 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-11T23:07:30.807 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-11T23:07:30.807 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-11T23:07:30.807 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-11T23:07:30.807 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-11T23:07:30.807 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-11T23:07:30.807 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-11T23:07:30.807 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-11T23:07:30.807 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-11T23:07:30.807 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-11T23:07:30.807 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-11T23:07:30.807 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-11T23:07:30.807 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-11T23:07:30.807 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-11T23:07:30.807 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-11T23:07:30.808 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-11T23:07:30.808 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-11T23:07:30.808 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-11T23:07:30.808 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-11T23:07:30.808 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-11T23:07:30.808 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-11T23:07:30.808 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-11T23:07:30.808 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-11T23:07:30.808 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-11T23:07:30.808 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-11T23:07:30.808 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-11T23:07:30.808 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-11T23:07:30.808 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-11T23:07:30.808 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-11T23:07:30.809 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-11T23:07:30.809 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-11T23:07:30.809 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-11T23:07:30.809 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-11T23:07:30.809 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-11T23:07:30.809 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-11T23:07:30.809 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-11T23:07:30.809 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-11T23:07:30.809 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-11T23:07:30.809 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-11T23:07:30.809 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-11T23:07:30.809 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-11T23:07:30.809 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-11T23:07:30.809 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-11T23:07:30.810 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-11T23:07:30.810 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-11T23:07:30.810 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-11T23:07:30.810 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-11T23:07:30.810 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-11T23:07:30.810 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-11T23:07:30.810 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-11T23:07:30.810 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-11T23:07:30.810 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-11T23:07:30.810 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-11T23:07:30.810 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-11T23:07:30.810 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-11T23:07:30.810 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-11T23:07:30.811 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-11T23:07:30.811 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-11T23:07:30.811 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-11T23:07:30.811 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-11T23:07:30.811 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-11T23:07:30.811 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-11T23:07:30.811 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-11T23:07:30.811 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-11T23:07:30.811 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-11T23:07:30.811 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-11T23:07:30.811 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-11T23:07:30.811 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-11T23:07:30.811 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-11T23:07:30.811 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-11T23:07:30.812 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-11T23:07:30.812 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-11T23:07:30.812 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-11T23:07:30.812 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-11T23:07:30.812 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-11T23:07:30.812 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-11T23:07:30.812 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-11T23:07:30.812 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-11T23:07:30.812 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-11T23:07:30.812 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-11T23:07:30.812 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-11T23:07:30.812 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-11T23:07:30.812 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-11T23:07:30.812 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-11T23:07:30.813 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-11T23:07:30.813 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-11T23:07:30.813 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-11T23:07:30.813 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-11T23:07:30.813 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-11T23:07:30.813 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-11T23:07:30.813 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-11T23:07:30.813 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-11T23:07:30.813 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-11T23:07:30.813 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-11T23:07:30.813 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-11T23:07:30.813 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-11T23:07:30.813 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-11T23:07:30.813 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-11T23:07:30.814 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-11T23:07:30.814 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-11T23:07:30.814 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-11T23:07:30.814 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-11T23:07:30.814 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-11T23:07:30.814 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-11T23:07:30.814 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-11T23:07:30.814 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-11T23:07:30.814 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-11T23:07:30.814 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-11T23:07:30.814 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-11T23:07:30.814 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-11T23:07:30.814 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-11T23:07:30.814 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-11T23:07:30.814 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-11T23:07:30.815 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-11T23:07:30.815 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-11T23:07:30.815 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-11T23:07:30.815 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-11T23:07:30.815 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-11T23:07:30.815 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-11T23:07:30.815 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-11T23:07:30.815 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-11T23:07:30.815 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-11T23:07:30.815 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-11T23:07:30.815 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-11T23:07:30.815 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-11T23:07:30.815 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-11T23:07:30.815 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-11T23:07:30.816 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-11T23:07:30.816 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-11T23:07:30.816 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-11T23:07:30.816 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-11T23:07:30.816 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-11T23:07:30.816 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-11T23:07:30.816 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-11T23:07:30.816 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-11T23:07:30.816 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-11T23:07:30.816 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-11T23:07:30.816 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-11T23:07:30.816 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-11T23:07:30.816 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-11T23:07:30.816 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-11T23:07:30.816 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-11T23:07:30.817 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-11T23:07:30.817 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-11T23:07:30.817 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-11T23:07:30.817 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-11T23:07:30.817 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-11T23:07:30.817 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-11T23:07:30.817 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-11T23:07:30.817 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-11T23:07:30.817 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-11T23:07:30.817 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-11T23:07:30.817 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-11T23:07:30.817 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-11T23:07:30.817 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-11T23:07:30.817 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-11T23:07:30.817 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-11T23:07:30.818 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-11T23:07:30.818 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-11T23:07:30.818 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-11T23:07:30.818 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-11T23:07:30.818 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-11T23:07:30.818 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-11T23:07:30.818 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-11T23:07:30.818 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-11T23:07:30.818 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-11T23:07:30.818 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-11T23:07:30.818 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-11T23:07:30.818 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-11T23:07:30.818 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-11T23:07:30.819 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-11T23:07:30.819 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-11T23:07:30.819 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-11T23:07:30.819 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-11T23:07:30.819 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-11T23:07:30.819 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-11T23:07:30.819 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-11T23:07:30.819 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-11T23:07:30.819 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-11T23:07:30.819 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-11T23:07:30.819 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-11T23:07:30.819 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-11T23:07:30.819 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-11T23:07:30.819 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-11T23:07:30.819 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-11T23:07:30.820 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-11T23:07:30.820 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-11T23:07:30.820 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-11T23:07:30.820 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-11T23:07:30.820 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-11T23:07:30.820 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-11T23:07:30.820 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-11T23:07:30.820 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-11T23:07:30.820 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-11T23:07:30.820 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-11T23:07:30.820 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-11T23:07:30.820 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-11T23:07:30.820 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-11T23:07:30.820 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-11T23:07:30.820 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-11T23:07:30.821 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-11T23:07:30.821 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-11T23:07:30.821 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-11T23:07:30.821 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-11T23:07:30.821 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-11T23:07:30.821 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-11T23:07:30.821 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-11T23:07:30.821 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-11T23:07:30.821 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-11T23:07:30.821 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-11T23:07:30.821 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-11T23:07:30.821 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-11T23:07:30.821 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-11T23:07:30.821 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-11T23:07:30.821 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-11T23:07:30.822 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-11T23:07:30.822 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-11T23:07:30.822 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-11T23:07:30.822 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-11T23:07:30.822 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-11T23:07:30.822 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-11T23:07:30.822 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-11T23:07:30.822 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-11T23:07:30.822 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-11T23:07:30.822 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-11T23:07:30.822 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-11T23:07:30.822 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-11T23:07:30.822 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-11T23:07:30.822 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-11T23:07:30.823 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-11T23:07:30.823 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-11T23:07:30.823 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-11T23:07:30.823 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-11T23:07:30.823 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-11T23:07:30.823 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-11T23:07:30.823 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-11T23:07:30.823 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-11T23:07:30.823 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-11T23:07:30.823 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-11T23:07:30.823 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-11T23:07:30.823 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-11T23:07:30.823 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-11T23:07:30.823 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-11T23:07:30.824 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-11T23:07:30.824 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-11T23:07:30.824 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-11T23:07:30.824 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-11T23:07:30.824 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-11T23:07:30.824 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-11T23:07:30.824 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-11T23:07:30.824 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-11T23:07:30.824 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-11T23:07:30.824 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-11T23:07:30.824 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-11T23:07:30.824 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-11T23:07:30.824 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-11T23:07:30.824 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-11T23:07:30.825 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-11T23:07:30.825 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-11T23:07:30.825 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-11T23:07:30.825 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-11T23:07:30.825 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-11T23:07:30.825 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-11T23:07:30.825 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-11T23:07:30.825 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-11T23:07:30.825 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-11T23:07:30.825 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-11T23:07:30.825 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-11T23:07:30.825 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-11T23:07:30.825 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-11T23:07:30.825 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-11T23:07:30.825 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-11T23:07:30.826 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-11T23:07:30.826 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-11T23:07:30.826 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-11T23:07:30.826 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-11T23:07:30.826 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-11T23:07:30.826 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-11T23:07:30.826 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-11T23:07:30.826 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-11T23:07:30.826 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-11T23:07:30.826 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-11T23:07:30.826 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-11T23:07:30.826 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-11T23:07:30.826 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-11T23:07:30.826 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-11T23:07:30.826 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-11T23:07:30.827 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-11T23:07:30.827 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-11T23:07:30.827 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-11T23:07:30.827 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-11T23:07:30.827 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-11T23:07:30.827 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-11T23:07:30.827 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-11T23:07:30.827 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-11T23:07:30.827 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-11T23:07:30.827 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-11T23:07:30.827 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-11T23:07:30.827 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-11T23:07:30.827 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-11T23:07:30.827 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-11T23:07:30.828 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-11T23:07:30.828 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-11T23:07:30.828 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-11T23:07:30.828 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-11T23:07:30.828 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-11T23:07:30.828 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-11T23:07:30.828 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-11T23:07:30.828 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-11T23:07:30.828 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-11T23:07:30.828 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-11T23:07:30.828 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-11T23:07:30.828 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-11T23:07:30.828 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-11T23:07:30.828 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-11T23:07:30.829 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-11T23:07:30.829 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-11T23:07:30.829 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-11T23:07:30.829 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-11T23:07:30.829 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-11T23:07:30.829 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-11T23:07:30.829 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-11T23:07:30.829 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-11T23:07:30.829 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-11T23:07:30.829 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-11T23:07:30.829 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-11T23:07:30.829 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-11T23:07:30.829 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-11T23:07:30.829 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-11T23:07:30.829 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-11T23:07:30.830 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-11T23:07:30.830 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-11T23:07:30.830 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-11T23:07:30.830 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-11T23:07:30.830 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-11T23:07:30.830 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-11T23:07:30.830 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-11T23:07:30.830 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-11T23:07:30.830 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-11T23:07:30.830 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-11T23:07:30.830 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-11T23:07:30.830 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-11T23:07:30.830 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-11T23:07:30.831 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-11T23:07:30.831 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-11T23:07:30.831 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-11T23:07:30.831 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-11T23:07:30.831 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-11T23:07:30.831 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-11T23:07:30.831 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-11T23:07:30.831 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-11T23:07:30.831 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-11T23:07:30.831 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-11T23:07:30.831 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-11T23:07:30.831 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-11T23:07:30.831 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-11T23:07:30.831 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-11T23:07:30.832 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-11T23:07:30.832 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-11T23:07:30.832 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-11T23:07:30.832 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-11T23:07:30.832 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-11T23:07:30.832 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-11T23:07:30.832 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-11T23:07:30.832 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-11T23:07:30.832 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-11T23:07:30.832 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-11T23:07:30.832 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-11T23:07:30.832 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-11T23:07:30.832 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-11T23:07:30.832 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-11T23:07:30.833 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-11T23:07:30.833 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-11T23:07:30.833 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-11T23:07:30.833 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-11T23:07:30.833 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-11T23:07:30.833 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-11T23:07:30.833 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-11T23:07:30.833 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-11T23:07:30.833 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-11T23:07:30.833 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-11T23:07:30.833 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-11T23:07:30.833 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-11T23:07:30.833 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-11T23:07:30.833 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-11T23:07:30.834 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-11T23:07:30.834 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-11T23:07:30.834 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-11T23:07:30.834 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-11T23:07:30.834 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-11T23:07:30.834 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-11T23:07:30.834 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-11T23:07:30.834 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-11T23:07:30.834 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-11T23:07:30.834 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-11T23:07:30.834 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-11T23:07:30.834 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-11T23:07:30.834 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-11T23:07:30.834 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-11T23:07:30.834 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-11T23:07:30.835 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-11T23:07:30.835 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-11T23:07:30.835 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-11T23:07:30.835 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-11T23:07:30.835 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-11T23:07:30.835 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-11T23:07:30.835 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-11T23:07:30.835 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-11T23:07:30.835 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-11T23:07:30.835 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-11T23:07:30.835 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-11T23:07:30.835 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-11T23:07:30.835 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-11T23:07:30.835 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-11T23:07:30.835 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-11T23:07:30.836 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-11T23:07:30.836 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-11T23:07:30.836 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-11T23:07:30.836 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-11T23:07:30.836 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-11T23:07:30.836 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-11T23:07:30.836 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-11T23:07:30.836 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-11T23:07:30.836 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-11T23:07:30.836 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-11T23:07:30.836 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-11T23:07:30.836 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-11T23:07:30.836 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-11T23:07:30.836 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-11T23:07:30.837 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-11T23:07:30.837 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-11T23:07:30.837 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-11T23:07:30.837 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-11T23:07:30.837 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-11T23:07:30.837 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-11T23:07:30.837 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-11T23:07:30.837 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-11T23:07:30.837 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-11T23:07:30.837 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-11T23:07:30.837 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-11T23:07:30.837 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-11T23:07:30.837 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-11T23:07:30.837 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-11T23:07:30.838 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-11T23:07:30.838 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-11T23:07:30.838 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-11T23:07:30.838 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-11T23:07:30.838 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-11T23:07:30.838 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-11T23:07:30.838 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-11T23:07:30.838 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-11T23:07:30.838 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-11T23:07:30.838 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-11T23:07:30.838 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-11T23:07:30.838 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-11T23:07:30.838 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-11T23:07:30.839 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-11T23:07:30.839 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-11T23:07:30.839 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-11T23:07:30.839 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-11T23:07:30.839 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-11T23:07:30.839 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-11T23:07:30.839 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-11T23:07:30.839 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-11T23:07:30.839 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-11T23:07:30.839 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-11T23:07:30.839 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-11T23:07:30.839 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-11T23:07:30.839 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-11T23:07:30.839 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-11T23:07:30.840 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-11T23:07:30.840 INFO:teuthology.orchestra.run.smithi165.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-11T23:07:30.844 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:07:30.844 DEBUG:teuthology.orchestra.run.smithi165:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-11T23:07:30.867 INFO:teuthology.orchestra.run.smithi165.stdout:postinstall scriptlet (using /bin/sh): 2024-09-11T23:07:30.867 INFO:teuthology.orchestra.run.smithi165.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-11T23:07:30.867 INFO:teuthology.orchestra.run.smithi165.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-11T23:07:30.867 INFO:teuthology.orchestra.run.smithi165.stdout:fi 2024-09-11T23:07:30.867 INFO:teuthology.orchestra.run.smithi165.stdout:for file in vmlinuz System.map config; do 2024-09-11T23:07:30.867 INFO:teuthology.orchestra.run.smithi165.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-11T23:07:30.867 INFO:teuthology.orchestra.run.smithi165.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T23:07:30.867 INFO:teuthology.orchestra.run.smithi165.stdout: fi 2024-09-11T23:07:30.867 INFO:teuthology.orchestra.run.smithi165.stdout:done 2024-09-11T23:07:30.867 INFO:teuthology.orchestra.run.smithi165.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-11T23:07:30.867 INFO:teuthology.orchestra.run.smithi165.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-11T23:07:30.868 INFO:teuthology.orchestra.run.smithi165.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T23:07:30.868 INFO:teuthology.orchestra.run.smithi165.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T23:07:30.868 INFO:teuthology.orchestra.run.smithi165.stdout:fi 2024-09-11T23:07:30.868 INFO:teuthology.orchestra.run.smithi165.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-11T23:07:30.868 INFO:teuthology.orchestra.run.smithi165.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:07:30.868 INFO:teuthology.orchestra.run.smithi165.stdout:fi 2024-09-11T23:07:30.868 INFO:teuthology.orchestra.run.smithi165.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-11T23:07:30.868 INFO:teuthology.orchestra.run.smithi165.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-11T23:07:30.868 INFO:teuthology.orchestra.run.smithi165.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:07:30.868 INFO:teuthology.orchestra.run.smithi165.stdout:fi 2024-09-11T23:07:30.869 DEBUG:teuthology.orchestra.run.smithi165:> sudo rpm -qi grub2-tools 2024-09-11T23:07:30.942 INFO:teuthology.orchestra.run.smithi165.stdout:Name : grub2-tools 2024-09-11T23:07:30.942 INFO:teuthology.orchestra.run.smithi165.stdout:Epoch : 1 2024-09-11T23:07:30.942 INFO:teuthology.orchestra.run.smithi165.stdout:Version : 2.06 2024-09-11T23:07:30.942 INFO:teuthology.orchestra.run.smithi165.stdout:Release : 82.el9 2024-09-11T23:07:30.942 INFO:teuthology.orchestra.run.smithi165.stdout:Architecture: x86_64 2024-09-11T23:07:30.943 INFO:teuthology.orchestra.run.smithi165.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T23:07:30.943 INFO:teuthology.orchestra.run.smithi165.stdout:Group : Unspecified 2024-09-11T23:07:30.943 INFO:teuthology.orchestra.run.smithi165.stdout:Size : 8274670 2024-09-11T23:07:30.943 INFO:teuthology.orchestra.run.smithi165.stdout:License : GPLv3+ 2024-09-11T23:07:30.943 INFO:teuthology.orchestra.run.smithi165.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T23:07:30.943 INFO:teuthology.orchestra.run.smithi165.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T23:07:30.943 INFO:teuthology.orchestra.run.smithi165.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T23:07:30.943 INFO:teuthology.orchestra.run.smithi165.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T23:07:30.943 INFO:teuthology.orchestra.run.smithi165.stdout:Packager : builder@centos.org 2024-09-11T23:07:30.943 INFO:teuthology.orchestra.run.smithi165.stdout:Vendor : CentOS 2024-09-11T23:07:30.943 INFO:teuthology.orchestra.run.smithi165.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T23:07:30.943 INFO:teuthology.orchestra.run.smithi165.stdout:Summary : Support tools for GRUB. 2024-09-11T23:07:30.943 INFO:teuthology.orchestra.run.smithi165.stdout:Description : 2024-09-11T23:07:30.943 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:07:30.944 INFO:teuthology.orchestra.run.smithi165.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T23:07:30.944 INFO:teuthology.orchestra.run.smithi165.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T23:07:30.944 INFO:teuthology.orchestra.run.smithi165.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T23:07:30.944 INFO:teuthology.orchestra.run.smithi165.stdout:hardware devices. 2024-09-11T23:07:30.944 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:07:30.944 INFO:teuthology.orchestra.run.smithi165.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T23:07:30.945 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T23:07:30.945 INFO:teuthology.task.kernel:Updating grub on smithi165 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:07:30.945 DEBUG:teuthology.orchestra.run.smithi165:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T23:07:31.535 INFO:teuthology.orchestra.run.smithi165.stderr:Generating grub configuration file ... 2024-09-11T23:07:33.013 INFO:teuthology.orchestra.run.smithi165.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T23:07:33.034 INFO:teuthology.orchestra.run.smithi165.stderr:done 2024-09-11T23:07:33.040 DEBUG:teuthology.orchestra.run.smithi165:> mktemp 2024-09-11T23:07:33.055 INFO:teuthology.orchestra.run.smithi165.stdout:/tmp/tmp.H1BCPuqVOL 2024-09-11T23:07:33.056 DEBUG:teuthology.orchestra.run.smithi165:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.H1BCPuqVOL 2024-09-11T23:07:33.122 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0666 /tmp/tmp.H1BCPuqVOL 2024-09-11T23:07:33.256 DEBUG:teuthology.orchestra.remote:smithi165:/tmp/tmp.H1BCPuqVOL is 6KB 2024-09-11T23:07:33.307 DEBUG:teuthology.orchestra.run.smithi165:> rm -fr /tmp/tmp.H1BCPuqVOL 2024-09-11T23:07:33.322 DEBUG:teuthology.orchestra.run.smithi165:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T23:07:33.384 INFO:teuthology.orchestra.run.smithi165.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T23:07:33.385 INFO:teuthology.orchestra.run.smithi165.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T23:07:33.385 INFO:teuthology.orchestra.run.smithi165.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T23:07:33.385 INFO:teuthology.orchestra.run.smithi165.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-11T23:07:33.386 DEBUG:teuthology.orchestra.run.smithi165:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:07:33.522 DEBUG:teuthology.orchestra.run.smithi165:> sudo shutdown -r now 2024-09-11T23:07:37.921 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi144.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-11T23:07:37.922 DEBUG:teuthology.orchestra.run.smithi144:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-11T23:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-11T23:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-11T23:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-11T23:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-11T23:07:38.004 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-11T23:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-11T23:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-11T23:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-11T23:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-11T23:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-11T23:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-11T23:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-11T23:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-11T23:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-11T23:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-11T23:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-11T23:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-11T23:07:38.005 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-11T23:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-11T23:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-11T23:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-11T23:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-11T23:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-11T23:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-11T23:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-11T23:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-11T23:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-11T23:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-11T23:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-11T23:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-11T23:07:38.006 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-11T23:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-11T23:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-11T23:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-11T23:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-11T23:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-11T23:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-11T23:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-11T23:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-11T23:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-11T23:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-11T23:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-11T23:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-11T23:07:38.007 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-11T23:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-11T23:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-11T23:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-11T23:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-11T23:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-11T23:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-11T23:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-11T23:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-11T23:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-11T23:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-11T23:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-11T23:07:38.008 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-11T23:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-11T23:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-11T23:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-11T23:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-11T23:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-11T23:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-11T23:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-11T23:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-11T23:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-11T23:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-11T23:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-11T23:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-11T23:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-11T23:07:38.009 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-11T23:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-11T23:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-11T23:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-11T23:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-11T23:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-11T23:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-11T23:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-11T23:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-11T23:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-11T23:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-11T23:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-11T23:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-11T23:07:38.010 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-11T23:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-11T23:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-11T23:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-11T23:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-11T23:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-11T23:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-11T23:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-11T23:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-11T23:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-11T23:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-11T23:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-11T23:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-11T23:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-11T23:07:38.011 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-11T23:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-11T23:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-11T23:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-11T23:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-11T23:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-11T23:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-11T23:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-11T23:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-11T23:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-11T23:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-11T23:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-11T23:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-11T23:07:38.012 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-11T23:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-11T23:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-11T23:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-11T23:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-11T23:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-11T23:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-11T23:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-11T23:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-11T23:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-11T23:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-11T23:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-11T23:07:38.013 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-11T23:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-11T23:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-11T23:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-11T23:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-11T23:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-11T23:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-11T23:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-11T23:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-11T23:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-11T23:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-11T23:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-11T23:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-11T23:07:38.014 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-11T23:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-11T23:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-11T23:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-11T23:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-11T23:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-11T23:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-11T23:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-11T23:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-11T23:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-11T23:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-11T23:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-11T23:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-11T23:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-11T23:07:38.015 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-11T23:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-11T23:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-11T23:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-11T23:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-11T23:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-11T23:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-11T23:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-11T23:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-11T23:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-11T23:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-11T23:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-11T23:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-11T23:07:38.016 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-11T23:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-11T23:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-11T23:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-11T23:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-11T23:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-11T23:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-11T23:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-11T23:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-11T23:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-11T23:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-11T23:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-11T23:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-11T23:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-11T23:07:38.017 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-11T23:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-11T23:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-11T23:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-11T23:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-11T23:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-11T23:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-11T23:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-11T23:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-11T23:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-11T23:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-11T23:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-11T23:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-11T23:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-11T23:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-11T23:07:38.018 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-11T23:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-11T23:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-11T23:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-11T23:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-11T23:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-11T23:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-11T23:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-11T23:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-11T23:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-11T23:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-11T23:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-11T23:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-11T23:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-11T23:07:38.019 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-11T23:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-11T23:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-11T23:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-11T23:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-11T23:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-11T23:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-11T23:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-11T23:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-11T23:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-11T23:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-11T23:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-11T23:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-11T23:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-11T23:07:38.020 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-11T23:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-11T23:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-11T23:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-11T23:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-11T23:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-11T23:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-11T23:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-11T23:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-11T23:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-11T23:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-11T23:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-11T23:07:38.021 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-11T23:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-11T23:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-11T23:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-11T23:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-11T23:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-11T23:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-11T23:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-11T23:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-11T23:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-11T23:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-11T23:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-11T23:07:38.022 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-11T23:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-11T23:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-11T23:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-11T23:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-11T23:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-11T23:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-11T23:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-11T23:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-11T23:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-11T23:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-11T23:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-11T23:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-11T23:07:38.023 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-11T23:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-11T23:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-11T23:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-11T23:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-11T23:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-11T23:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-11T23:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-11T23:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-11T23:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-11T23:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-11T23:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-11T23:07:38.024 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-11T23:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-11T23:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-11T23:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-11T23:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-11T23:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-11T23:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-11T23:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-11T23:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-11T23:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-11T23:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-11T23:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-11T23:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-11T23:07:38.025 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-11T23:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-11T23:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-11T23:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-11T23:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-11T23:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-11T23:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-11T23:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-11T23:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-11T23:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-11T23:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-11T23:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-11T23:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-11T23:07:38.026 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-11T23:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-11T23:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-11T23:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-11T23:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-11T23:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-11T23:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-11T23:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-11T23:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-11T23:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-11T23:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-11T23:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-11T23:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-11T23:07:38.027 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-11T23:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-11T23:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-11T23:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-11T23:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-11T23:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-11T23:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-11T23:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-11T23:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-11T23:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-11T23:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-11T23:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-11T23:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-11T23:07:38.028 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-11T23:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-11T23:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-11T23:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-11T23:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-11T23:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-11T23:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-11T23:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-11T23:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-11T23:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-11T23:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-11T23:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-11T23:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-11T23:07:38.029 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-11T23:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-11T23:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-11T23:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-11T23:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-11T23:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-11T23:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-11T23:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-11T23:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-11T23:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-11T23:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-11T23:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-11T23:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-11T23:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-11T23:07:38.030 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-11T23:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-11T23:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-11T23:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-11T23:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-11T23:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-11T23:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-11T23:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-11T23:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-11T23:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-11T23:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-11T23:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-11T23:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-11T23:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-11T23:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-11T23:07:38.031 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-11T23:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-11T23:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-11T23:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-11T23:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-11T23:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-11T23:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-11T23:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-11T23:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-11T23:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-11T23:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-11T23:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-11T23:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-11T23:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-11T23:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-11T23:07:38.032 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-11T23:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-11T23:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-11T23:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-11T23:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-11T23:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-11T23:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-11T23:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-11T23:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-11T23:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-11T23:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-11T23:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-11T23:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-11T23:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-11T23:07:38.033 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-11T23:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-11T23:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-11T23:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-11T23:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-11T23:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-11T23:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-11T23:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-11T23:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-11T23:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-11T23:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-11T23:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-11T23:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-11T23:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-11T23:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-11T23:07:38.034 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-11T23:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-11T23:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-11T23:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-11T23:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-11T23:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-11T23:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-11T23:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-11T23:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-11T23:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-11T23:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-11T23:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-11T23:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-11T23:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-11T23:07:38.035 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-11T23:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-11T23:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-11T23:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-11T23:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-11T23:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-11T23:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-11T23:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-11T23:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-11T23:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-11T23:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-11T23:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-11T23:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-11T23:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-11T23:07:38.036 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-11T23:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-11T23:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-11T23:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-11T23:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-11T23:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-11T23:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-11T23:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-11T23:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-11T23:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-11T23:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-11T23:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-11T23:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-11T23:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-11T23:07:38.037 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-11T23:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-11T23:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-11T23:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-11T23:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-11T23:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-11T23:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-11T23:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-11T23:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-11T23:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-11T23:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-11T23:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-11T23:07:38.038 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-11T23:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-11T23:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-11T23:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-11T23:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-11T23:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-11T23:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-11T23:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-11T23:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-11T23:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-11T23:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-11T23:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-11T23:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-11T23:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-11T23:07:38.039 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-11T23:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-11T23:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-11T23:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-11T23:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-11T23:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-11T23:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-11T23:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-11T23:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-11T23:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-11T23:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-11T23:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-11T23:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-11T23:07:38.040 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-11T23:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-11T23:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-11T23:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-11T23:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-11T23:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-11T23:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-11T23:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-11T23:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-11T23:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-11T23:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-11T23:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-11T23:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-11T23:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-11T23:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-11T23:07:38.041 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-11T23:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-11T23:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-11T23:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-11T23:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-11T23:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-11T23:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-11T23:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-11T23:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-11T23:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-11T23:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-11T23:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-11T23:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-11T23:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-11T23:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-11T23:07:38.042 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-11T23:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-11T23:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-11T23:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-11T23:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-11T23:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-11T23:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-11T23:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-11T23:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-11T23:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-11T23:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-11T23:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-11T23:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-11T23:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-11T23:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-11T23:07:38.043 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-11T23:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-11T23:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-11T23:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-11T23:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-11T23:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-11T23:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-11T23:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-11T23:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-11T23:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-11T23:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-11T23:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-11T23:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-11T23:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-11T23:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-11T23:07:38.044 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-11T23:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-11T23:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-11T23:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-11T23:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-11T23:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-11T23:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-11T23:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-11T23:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-11T23:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-11T23:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-11T23:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-11T23:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-11T23:07:38.045 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-11T23:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-11T23:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-11T23:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-11T23:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-11T23:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-11T23:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-11T23:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-11T23:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-11T23:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-11T23:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-11T23:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-11T23:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-11T23:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-11T23:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-11T23:07:38.046 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-11T23:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-11T23:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-11T23:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-11T23:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-11T23:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-11T23:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-11T23:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-11T23:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-11T23:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-11T23:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-11T23:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-11T23:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-11T23:07:38.047 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-11T23:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-11T23:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-11T23:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-11T23:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-11T23:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-11T23:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-11T23:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-11T23:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-11T23:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-11T23:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-11T23:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-11T23:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-11T23:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-11T23:07:38.048 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-11T23:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-11T23:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-11T23:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-11T23:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-11T23:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-11T23:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-11T23:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-11T23:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-11T23:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-11T23:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-11T23:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-11T23:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-11T23:07:38.049 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-11T23:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-11T23:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-11T23:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-11T23:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-11T23:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-11T23:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-11T23:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-11T23:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-11T23:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-11T23:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-11T23:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-11T23:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-11T23:07:38.050 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-11T23:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-11T23:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-11T23:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-11T23:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-11T23:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-11T23:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-11T23:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-11T23:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-11T23:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-11T23:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-11T23:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-11T23:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-11T23:07:38.051 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-11T23:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-11T23:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-11T23:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-11T23:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-11T23:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-11T23:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-11T23:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-11T23:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-11T23:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-11T23:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-11T23:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-11T23:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-11T23:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-11T23:07:38.052 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-11T23:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-11T23:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-11T23:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-11T23:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-11T23:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-11T23:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-11T23:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-11T23:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-11T23:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-11T23:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-11T23:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-11T23:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-11T23:07:38.053 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-11T23:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-11T23:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-11T23:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-11T23:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-11T23:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-11T23:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-11T23:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-11T23:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-11T23:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-11T23:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-11T23:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-11T23:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-11T23:07:38.054 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-11T23:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-11T23:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-11T23:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-11T23:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-11T23:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-11T23:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-11T23:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-11T23:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-11T23:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-11T23:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-11T23:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-11T23:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-11T23:07:38.055 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-11T23:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-11T23:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-11T23:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-11T23:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-11T23:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-11T23:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-11T23:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-11T23:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-11T23:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-11T23:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-11T23:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-11T23:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-11T23:07:38.056 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-11T23:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-11T23:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-11T23:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-11T23:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-11T23:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-11T23:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-11T23:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-11T23:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-11T23:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-11T23:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-11T23:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-11T23:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-11T23:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-11T23:07:38.057 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-11T23:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-11T23:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-11T23:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-11T23:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-11T23:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-11T23:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-11T23:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-11T23:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-11T23:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-11T23:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-11T23:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-11T23:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-11T23:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-11T23:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-11T23:07:38.058 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-11T23:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-11T23:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-11T23:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-11T23:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-11T23:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-11T23:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-11T23:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-11T23:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-11T23:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-11T23:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-11T23:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-11T23:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-11T23:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-11T23:07:38.059 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-11T23:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-11T23:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-11T23:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-11T23:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-11T23:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-11T23:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-11T23:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-11T23:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-11T23:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-11T23:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-11T23:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-11T23:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-11T23:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-11T23:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-11T23:07:38.060 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-11T23:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-11T23:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-11T23:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-11T23:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-11T23:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-11T23:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-11T23:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-11T23:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-11T23:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-11T23:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-11T23:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-11T23:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-11T23:07:38.061 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-11T23:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-11T23:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-11T23:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-11T23:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-11T23:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-11T23:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-11T23:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-11T23:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-11T23:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-11T23:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-11T23:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-11T23:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-11T23:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-11T23:07:38.062 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-11T23:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-11T23:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-11T23:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-11T23:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-11T23:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-11T23:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-11T23:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-11T23:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-11T23:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-11T23:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-11T23:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-11T23:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-11T23:07:38.063 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-11T23:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-11T23:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-11T23:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-11T23:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-11T23:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-11T23:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-11T23:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-11T23:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-11T23:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-11T23:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-11T23:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-11T23:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-11T23:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-11T23:07:38.064 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-11T23:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-11T23:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-11T23:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-11T23:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-11T23:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-11T23:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-11T23:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-11T23:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-11T23:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-11T23:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-11T23:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-11T23:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-11T23:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-11T23:07:38.065 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-11T23:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-11T23:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-11T23:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-11T23:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-11T23:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-11T23:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-11T23:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-11T23:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-11T23:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-11T23:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-11T23:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-11T23:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-11T23:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-11T23:07:38.066 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-11T23:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-11T23:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-11T23:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-11T23:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-11T23:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-11T23:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-11T23:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-11T23:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-11T23:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-11T23:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-11T23:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-11T23:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-11T23:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-11T23:07:38.067 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-11T23:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-11T23:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-11T23:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-11T23:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-11T23:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-11T23:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-11T23:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-11T23:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-11T23:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-11T23:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-11T23:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-11T23:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-11T23:07:38.068 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-11T23:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-11T23:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-11T23:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-11T23:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-11T23:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-11T23:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-11T23:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-11T23:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-11T23:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-11T23:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-11T23:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-11T23:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-11T23:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-11T23:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-11T23:07:38.069 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-11T23:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-11T23:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-11T23:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-11T23:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-11T23:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-11T23:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-11T23:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-11T23:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-11T23:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-11T23:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-11T23:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-11T23:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-11T23:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-11T23:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-11T23:07:38.070 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-11T23:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-11T23:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-11T23:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-11T23:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-11T23:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-11T23:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-11T23:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-11T23:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-11T23:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-11T23:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-11T23:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-11T23:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-11T23:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-11T23:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-11T23:07:38.071 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-11T23:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-11T23:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-11T23:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-11T23:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-11T23:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-11T23:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-11T23:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-11T23:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-11T23:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-11T23:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-11T23:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-11T23:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-11T23:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-11T23:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-11T23:07:38.072 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-11T23:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-11T23:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-11T23:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-11T23:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-11T23:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-11T23:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-11T23:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-11T23:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-11T23:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-11T23:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-11T23:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-11T23:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-11T23:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-11T23:07:38.073 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-11T23:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-11T23:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-11T23:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-11T23:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-11T23:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-11T23:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-11T23:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-11T23:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-11T23:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-11T23:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-11T23:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-11T23:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-11T23:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-11T23:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-11T23:07:38.074 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-11T23:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-11T23:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-11T23:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-11T23:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-11T23:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-11T23:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-11T23:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-11T23:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-11T23:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-11T23:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-11T23:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-11T23:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-11T23:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-11T23:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-11T23:07:38.075 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-11T23:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-11T23:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-11T23:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-11T23:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-11T23:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-11T23:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-11T23:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-11T23:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-11T23:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-11T23:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-11T23:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-11T23:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-11T23:07:38.076 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-11T23:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-11T23:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-11T23:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-11T23:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-11T23:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-11T23:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-11T23:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-11T23:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-11T23:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-11T23:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-11T23:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-11T23:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-11T23:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-11T23:07:38.077 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-11T23:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-11T23:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-11T23:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-11T23:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-11T23:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-11T23:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-11T23:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-11T23:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-11T23:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-11T23:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-11T23:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-11T23:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-11T23:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-11T23:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-11T23:07:38.078 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-11T23:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-11T23:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-11T23:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-11T23:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-11T23:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-11T23:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-11T23:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-11T23:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-11T23:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-11T23:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-11T23:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-11T23:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-11T23:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-11T23:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-11T23:07:38.079 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-11T23:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-11T23:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-11T23:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-11T23:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-11T23:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-11T23:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-11T23:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-11T23:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-11T23:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-11T23:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-11T23:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-11T23:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-11T23:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-11T23:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-11T23:07:38.080 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-11T23:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-11T23:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-11T23:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-11T23:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-11T23:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-11T23:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-11T23:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-11T23:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-11T23:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-11T23:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-11T23:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-11T23:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-11T23:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-11T23:07:38.081 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-11T23:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-11T23:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-11T23:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-11T23:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-11T23:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-11T23:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-11T23:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-11T23:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-11T23:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-11T23:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-11T23:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-11T23:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-11T23:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-11T23:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-11T23:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-11T23:07:38.082 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-11T23:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-11T23:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-11T23:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-11T23:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-11T23:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-11T23:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-11T23:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-11T23:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-11T23:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-11T23:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-11T23:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-11T23:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-11T23:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-11T23:07:38.083 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-11T23:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-11T23:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-11T23:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-11T23:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-11T23:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-11T23:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-11T23:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-11T23:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-11T23:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-11T23:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-11T23:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-11T23:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-11T23:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-11T23:07:38.084 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-11T23:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-11T23:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-11T23:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-11T23:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-11T23:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-11T23:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-11T23:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-11T23:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-11T23:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-11T23:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-11T23:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-11T23:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-11T23:07:38.085 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-11T23:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-11T23:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-11T23:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-11T23:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-11T23:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-11T23:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-11T23:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-11T23:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-11T23:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-11T23:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-11T23:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-11T23:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-11T23:07:38.086 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-11T23:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-11T23:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-11T23:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-11T23:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-11T23:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-11T23:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-11T23:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-11T23:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-11T23:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-11T23:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-11T23:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-11T23:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-11T23:07:38.087 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-11T23:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-11T23:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-11T23:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-11T23:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-11T23:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-11T23:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-11T23:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-11T23:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-11T23:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-11T23:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-11T23:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-11T23:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-11T23:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-11T23:07:38.088 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-11T23:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-11T23:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-11T23:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-11T23:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-11T23:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-11T23:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-11T23:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-11T23:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-11T23:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-11T23:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-11T23:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-11T23:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-11T23:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-11T23:07:38.089 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-11T23:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-11T23:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-11T23:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-11T23:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-11T23:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-11T23:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-11T23:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-11T23:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-11T23:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-11T23:07:38.090 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-11T23:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-11T23:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-11T23:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-11T23:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-11T23:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-11T23:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-11T23:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-11T23:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-11T23:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-11T23:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-11T23:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-11T23:07:38.091 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-11T23:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-11T23:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-11T23:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-11T23:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-11T23:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-11T23:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-11T23:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-11T23:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-11T23:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-11T23:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-11T23:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-11T23:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-11T23:07:38.092 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-11T23:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-11T23:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-11T23:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-11T23:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-11T23:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-11T23:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-11T23:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-11T23:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-11T23:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-11T23:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-11T23:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-11T23:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-11T23:07:38.093 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-11T23:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-11T23:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-11T23:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-11T23:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-11T23:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-11T23:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-11T23:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-11T23:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-11T23:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-11T23:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-11T23:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-11T23:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-11T23:07:38.094 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-11T23:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-11T23:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-11T23:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-11T23:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-11T23:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-11T23:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-11T23:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-11T23:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-11T23:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-11T23:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-11T23:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-11T23:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-11T23:07:38.095 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-11T23:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-11T23:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-11T23:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-11T23:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-11T23:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-11T23:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-11T23:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-11T23:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-11T23:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-11T23:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-11T23:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-11T23:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-11T23:07:38.096 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-11T23:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-11T23:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-11T23:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-11T23:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-11T23:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-11T23:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-11T23:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-11T23:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-11T23:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-11T23:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-11T23:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-11T23:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-11T23:07:38.097 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-11T23:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-11T23:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-11T23:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-11T23:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-11T23:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-11T23:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-11T23:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-11T23:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-11T23:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-11T23:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-11T23:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-11T23:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-11T23:07:38.098 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-11T23:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-11T23:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-11T23:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-11T23:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-11T23:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-11T23:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-11T23:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-11T23:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-11T23:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-11T23:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-11T23:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-11T23:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-11T23:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-11T23:07:38.099 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-11T23:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-11T23:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-11T23:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-11T23:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-11T23:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-11T23:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-11T23:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-11T23:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-11T23:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-11T23:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-11T23:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-11T23:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-11T23:07:38.100 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-11T23:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-11T23:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-11T23:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-11T23:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-11T23:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-11T23:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-11T23:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-11T23:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-11T23:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-11T23:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-11T23:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-11T23:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-11T23:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-11T23:07:38.101 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-11T23:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-11T23:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-11T23:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-11T23:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-11T23:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-11T23:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-11T23:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-11T23:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-11T23:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-11T23:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-11T23:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-11T23:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-11T23:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-11T23:07:38.102 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-11T23:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-11T23:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-11T23:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-11T23:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-11T23:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-11T23:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-11T23:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-11T23:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-11T23:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-11T23:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-11T23:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-11T23:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-11T23:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-11T23:07:38.103 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-11T23:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-11T23:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-11T23:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-11T23:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-11T23:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-11T23:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-11T23:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-11T23:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-11T23:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-11T23:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-11T23:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-11T23:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-11T23:07:38.104 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-11T23:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-11T23:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-11T23:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-11T23:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-11T23:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-11T23:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-11T23:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-11T23:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-11T23:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-11T23:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-11T23:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-11T23:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-11T23:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-11T23:07:38.105 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-11T23:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-11T23:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-11T23:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-11T23:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-11T23:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-11T23:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-11T23:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-11T23:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-11T23:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-11T23:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-11T23:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-11T23:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-11T23:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-11T23:07:38.106 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-11T23:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-11T23:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-11T23:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-11T23:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-11T23:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-11T23:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-11T23:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-11T23:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-11T23:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-11T23:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-11T23:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-11T23:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-11T23:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-11T23:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-11T23:07:38.107 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-11T23:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-11T23:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-11T23:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-11T23:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-11T23:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-11T23:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-11T23:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-11T23:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-11T23:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-11T23:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-11T23:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-11T23:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-11T23:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-11T23:07:38.108 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-11T23:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-11T23:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-11T23:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-11T23:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-11T23:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-11T23:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-11T23:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-11T23:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-11T23:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-11T23:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-11T23:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-11T23:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-11T23:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-11T23:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-11T23:07:38.109 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-11T23:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-11T23:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-11T23:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-11T23:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-11T23:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-11T23:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-11T23:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-11T23:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-11T23:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-11T23:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-11T23:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-11T23:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-11T23:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-11T23:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-11T23:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-11T23:07:38.110 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-11T23:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-11T23:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-11T23:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-11T23:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-11T23:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-11T23:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-11T23:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-11T23:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-11T23:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-11T23:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-11T23:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-11T23:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-11T23:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-11T23:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-11T23:07:38.111 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-11T23:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-11T23:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-11T23:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-11T23:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-11T23:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-11T23:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-11T23:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-11T23:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-11T23:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-11T23:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-11T23:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-11T23:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-11T23:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-11T23:07:38.112 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-11T23:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-11T23:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-11T23:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-11T23:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-11T23:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-11T23:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-11T23:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-11T23:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-11T23:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-11T23:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-11T23:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-11T23:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-11T23:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-11T23:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-11T23:07:38.113 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-11T23:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-11T23:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-11T23:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-11T23:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-11T23:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-11T23:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-11T23:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-11T23:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-11T23:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-11T23:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-11T23:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-11T23:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-11T23:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-11T23:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-11T23:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-11T23:07:38.114 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-11T23:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-11T23:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-11T23:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-11T23:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-11T23:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-11T23:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-11T23:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-11T23:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-11T23:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-11T23:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-11T23:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-11T23:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-11T23:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-11T23:07:38.115 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-11T23:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-11T23:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-11T23:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-11T23:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-11T23:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-11T23:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-11T23:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-11T23:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-11T23:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-11T23:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-11T23:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-11T23:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-11T23:07:38.116 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-11T23:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-11T23:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-11T23:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-11T23:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-11T23:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-11T23:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-11T23:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-11T23:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-11T23:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-11T23:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-11T23:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-11T23:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-11T23:07:38.117 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-11T23:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-11T23:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-11T23:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-11T23:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-11T23:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-11T23:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-11T23:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-11T23:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-11T23:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-11T23:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-11T23:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-11T23:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-11T23:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-11T23:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-11T23:07:38.118 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-11T23:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-11T23:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-11T23:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-11T23:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-11T23:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-11T23:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-11T23:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-11T23:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-11T23:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-11T23:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-11T23:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-11T23:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-11T23:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-11T23:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-11T23:07:38.119 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-11T23:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-11T23:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-11T23:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-11T23:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-11T23:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-11T23:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-11T23:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-11T23:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-11T23:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-11T23:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-11T23:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-11T23:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-11T23:07:38.120 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-11T23:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-11T23:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-11T23:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-11T23:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-11T23:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-11T23:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-11T23:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-11T23:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-11T23:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-11T23:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-11T23:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-11T23:07:38.121 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-11T23:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-11T23:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-11T23:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-11T23:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-11T23:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-11T23:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-11T23:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-11T23:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-11T23:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-11T23:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-11T23:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-11T23:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-11T23:07:38.122 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-11T23:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-11T23:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-11T23:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-11T23:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-11T23:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-11T23:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-11T23:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-11T23:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-11T23:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-11T23:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-11T23:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-11T23:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-11T23:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-11T23:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-11T23:07:38.123 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-11T23:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-11T23:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-11T23:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-11T23:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-11T23:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-11T23:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-11T23:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-11T23:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-11T23:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-11T23:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-11T23:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-11T23:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-11T23:07:38.124 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-11T23:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-11T23:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-11T23:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-11T23:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-11T23:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-11T23:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-11T23:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-11T23:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-11T23:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-11T23:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-11T23:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-11T23:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-11T23:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-11T23:07:38.125 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-11T23:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-11T23:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-11T23:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-11T23:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-11T23:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-11T23:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-11T23:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-11T23:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-11T23:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-11T23:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-11T23:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-11T23:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-11T23:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-11T23:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-11T23:07:38.126 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-11T23:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-11T23:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-11T23:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-11T23:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-11T23:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-11T23:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-11T23:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-11T23:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-11T23:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-11T23:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-11T23:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-11T23:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-11T23:07:38.127 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-11T23:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-11T23:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-11T23:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-11T23:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-11T23:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-11T23:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-11T23:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-11T23:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-11T23:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-11T23:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-11T23:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-11T23:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-11T23:07:38.128 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-11T23:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-11T23:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-11T23:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-11T23:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-11T23:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-11T23:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-11T23:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-11T23:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-11T23:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-11T23:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-11T23:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-11T23:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-11T23:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-11T23:07:38.129 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-11T23:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-11T23:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-11T23:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-11T23:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-11T23:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-11T23:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-11T23:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-11T23:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-11T23:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-11T23:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-11T23:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-11T23:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-11T23:07:38.130 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-11T23:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-11T23:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-11T23:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-11T23:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-11T23:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-11T23:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-11T23:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-11T23:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-11T23:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-11T23:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-11T23:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-11T23:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-11T23:07:38.131 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-11T23:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-11T23:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-11T23:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-11T23:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-11T23:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-11T23:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-11T23:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-11T23:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-11T23:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-11T23:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-11T23:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-11T23:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-11T23:07:38.132 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-11T23:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-11T23:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-11T23:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-11T23:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-11T23:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-11T23:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-11T23:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-11T23:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-11T23:07:38.133 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-11T23:07:38.136 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-11T23:07:38.136 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-11T23:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-11T23:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-11T23:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-11T23:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-11T23:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-11T23:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-11T23:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-11T23:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-11T23:07:38.137 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-11T23:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-11T23:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-11T23:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-11T23:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-11T23:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-11T23:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-11T23:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-11T23:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-11T23:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-11T23:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-11T23:07:38.138 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-11T23:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-11T23:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-11T23:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-11T23:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-11T23:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-11T23:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-11T23:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-11T23:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-11T23:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-11T23:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-11T23:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-11T23:07:38.139 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-11T23:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-11T23:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-11T23:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-11T23:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-11T23:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-11T23:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-11T23:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-11T23:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-11T23:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-11T23:07:38.140 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-11T23:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-11T23:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-11T23:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-11T23:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-11T23:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-11T23:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-11T23:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-11T23:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-11T23:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-11T23:07:38.141 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-11T23:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-11T23:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-11T23:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-11T23:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-11T23:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-11T23:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-11T23:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-11T23:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-11T23:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-11T23:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-11T23:07:38.142 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-11T23:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-11T23:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-11T23:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-11T23:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-11T23:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-11T23:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-11T23:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-11T23:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-11T23:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-11T23:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-11T23:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-11T23:07:38.143 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-11T23:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-11T23:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-11T23:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-11T23:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-11T23:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-11T23:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-11T23:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-11T23:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-11T23:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-11T23:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-11T23:07:38.144 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-11T23:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-11T23:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-11T23:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-11T23:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-11T23:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-11T23:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-11T23:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-11T23:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-11T23:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-11T23:07:38.145 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-11T23:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-11T23:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-11T23:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-11T23:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-11T23:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-11T23:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-11T23:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-11T23:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-11T23:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-11T23:07:38.146 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-11T23:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-11T23:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-11T23:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-11T23:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-11T23:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-11T23:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-11T23:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-11T23:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-11T23:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-11T23:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-11T23:07:38.147 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-11T23:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-11T23:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-11T23:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-11T23:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-11T23:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-11T23:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-11T23:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-11T23:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-11T23:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-11T23:07:38.148 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-11T23:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-11T23:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-11T23:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-11T23:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-11T23:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-11T23:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-11T23:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-11T23:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-11T23:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-11T23:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-11T23:07:38.149 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-11T23:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-11T23:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-11T23:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-11T23:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-11T23:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-11T23:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-11T23:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-11T23:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-11T23:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-11T23:07:38.150 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-11T23:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-11T23:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-11T23:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-11T23:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-11T23:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-11T23:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-11T23:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-11T23:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-11T23:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-11T23:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-11T23:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-11T23:07:38.151 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-11T23:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-11T23:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-11T23:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-11T23:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-11T23:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-11T23:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-11T23:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-11T23:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-11T23:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-11T23:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-11T23:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-11T23:07:38.152 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-11T23:07:38.153 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-11T23:07:38.153 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-11T23:07:38.153 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-11T23:07:38.153 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-11T23:07:38.153 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-11T23:07:38.153 INFO:teuthology.orchestra.run.smithi144.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-11T23:07:38.157 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:07:38.157 DEBUG:teuthology.orchestra.run.smithi144:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-11T23:07:38.180 INFO:teuthology.orchestra.run.smithi144.stdout:postinstall scriptlet (using /bin/sh): 2024-09-11T23:07:38.181 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-11T23:07:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-11T23:07:38.181 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2024-09-11T23:07:38.181 INFO:teuthology.orchestra.run.smithi144.stdout:for file in vmlinuz System.map config; do 2024-09-11T23:07:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-11T23:07:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T23:07:38.181 INFO:teuthology.orchestra.run.smithi144.stdout: fi 2024-09-11T23:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout:done 2024-09-11T23:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-11T23:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-11T23:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T23:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T23:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2024-09-11T23:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-11T23:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2024-09-11T23:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-11T23:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-11T23:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:07:38.182 INFO:teuthology.orchestra.run.smithi144.stdout:fi 2024-09-11T23:07:38.183 DEBUG:teuthology.orchestra.run.smithi144:> sudo rpm -qi grub2-tools 2024-09-11T23:07:38.266 INFO:teuthology.orchestra.run.smithi144.stdout:Name : grub2-tools 2024-09-11T23:07:38.266 INFO:teuthology.orchestra.run.smithi144.stdout:Epoch : 1 2024-09-11T23:07:38.266 INFO:teuthology.orchestra.run.smithi144.stdout:Version : 2.06 2024-09-11T23:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout:Release : 82.el9 2024-09-11T23:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout:Architecture: x86_64 2024-09-11T23:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T23:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout:Group : Unspecified 2024-09-11T23:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout:Size : 8274670 2024-09-11T23:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout:License : GPLv3+ 2024-09-11T23:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T23:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T23:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T23:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T23:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout:Packager : builder@centos.org 2024-09-11T23:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout:Vendor : CentOS 2024-09-11T23:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T23:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout:Summary : Support tools for GRUB. 2024-09-11T23:07:38.267 INFO:teuthology.orchestra.run.smithi144.stdout:Description : 2024-09-11T23:07:38.268 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:07:38.268 INFO:teuthology.orchestra.run.smithi144.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T23:07:38.268 INFO:teuthology.orchestra.run.smithi144.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T23:07:38.268 INFO:teuthology.orchestra.run.smithi144.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T23:07:38.268 INFO:teuthology.orchestra.run.smithi144.stdout:hardware devices. 2024-09-11T23:07:38.268 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:07:38.268 INFO:teuthology.orchestra.run.smithi144.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T23:07:38.269 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T23:07:38.269 INFO:teuthology.task.kernel:Updating grub on smithi144 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:07:38.269 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T23:07:38.901 INFO:teuthology.orchestra.run.smithi144.stderr:Generating grub configuration file ... 2024-09-11T23:07:40.267 INFO:teuthology.orchestra.run.smithi144.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T23:07:40.295 INFO:teuthology.orchestra.run.smithi144.stderr:done 2024-09-11T23:07:40.297 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2024-09-11T23:07:40.313 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.5PPnFCxM8r 2024-09-11T23:07:40.313 DEBUG:teuthology.orchestra.run.smithi144:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.5PPnFCxM8r 2024-09-11T23:07:40.380 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.5PPnFCxM8r 2024-09-11T23:07:40.515 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.5PPnFCxM8r is 6KB 2024-09-11T23:07:40.563 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.5PPnFCxM8r 2024-09-11T23:07:40.578 DEBUG:teuthology.orchestra.run.smithi144:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T23:07:40.641 INFO:teuthology.orchestra.run.smithi144.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T23:07:40.641 INFO:teuthology.orchestra.run.smithi144.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T23:07:40.641 INFO:teuthology.orchestra.run.smithi144.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T23:07:40.641 INFO:teuthology.orchestra.run.smithi144.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-11T23:07:40.642 DEBUG:teuthology.orchestra.run.smithi144:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:07:40.822 DEBUG:teuthology.orchestra.run.smithi144:> sudo shutdown -r now 2024-09-11T23:08:03.546 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-11T23:08:03.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-11T23:08:03.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:08:10.829 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-11T23:08:10.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-11T23:08:10.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:08:38.082 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-09-11T23:08:47.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-11T23:08:47.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:09:10.864 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T23:09:19.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-11T23:09:19.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:09:23.306 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-09-11T23:09:23.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-11T23:09:23.935 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-11T23:09:23.935 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2024-09-11T23:09:23.971 INFO:teuthology.orchestra.run.smithi144.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:09:23.971 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:09:23.971 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:09:23.972 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T23:09:24.975 DEBUG:teuthology.parallel:result is None 2024-09-11T23:09:47.139 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T23:09:59.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-11T23:09:59.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:09:59.527 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-09-11T23:10:00.050 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-11T23:10:00.050 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-11T23:10:00.050 DEBUG:teuthology.orchestra.run.smithi165:> uname -r 2024-09-11T23:10:00.084 INFO:teuthology.orchestra.run.smithi165.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:10:00.084 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T23:10:00.084 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:10:00.084 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T23:10:01.086 DEBUG:teuthology.parallel:result is None 2024-09-11T23:10:01.086 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T23:10:01.093 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T23:10:01.094 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:10:01.099 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:10:01.138 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T23:10:01.145 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T23:10:01.157 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T23:10:01.158 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:10:01.181 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:10:01.235 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T23:10:01.242 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T23:10:01.242 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:10:01.246 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:10:01.357 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:10:01.375 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:10:01.387 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:10:01.402 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:10:01.405 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T23:10:01.412 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T23:10:01.412 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:10:01.417 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:10:01.473 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T23:10:01.482 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T23:10:01.483 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:10:01.486 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:10:01.521 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:10:01.631 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:10:01.705 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:10:01.777 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:10:01.838 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:10:01.838 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:10:01.892 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:10:01.963 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:10:02.030 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:10:02.102 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:10:02.163 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:10:02.163 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:10:02.217 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2024-09-11T23:10:02.221 DEBUG:teuthology.orchestra.run.smithi165:> sudo service rsyslog restart 2024-09-11T23:10:02.318 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:10:02.344 INFO:teuthology.orchestra.run.smithi165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:10:02.787 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T23:10:02.795 INFO:teuthology.task.internal:Starting timer... 2024-09-11T23:10:02.795 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T23:10:02.807 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T23:10:02.816 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-11T23:10:02.816 DEBUG:teuthology.orchestra.run.smithi144:> sudo service auditd rotate 2024-09-11T23:10:02.896 INFO:teuthology.orchestra.run.smithi144.stdout:Rotating logs: 2024-09-11T23:10:02.900 DEBUG:teuthology.orchestra.run.smithi165:> sudo service auditd rotate 2024-09-11T23:10:02.983 INFO:teuthology.orchestra.run.smithi165.stdout:Rotating logs: 2024-09-11T23:10:02.987 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T23:10:02.987 DEBUG:teuthology.orchestra.run.smithi144:> /usr/sbin/getenforce 2024-09-11T23:10:03.080 INFO:teuthology.orchestra.run.smithi144.stdout:Permissive 2024-09-11T23:10:03.081 DEBUG:teuthology.orchestra.run.smithi165:> /usr/sbin/getenforce 2024-09-11T23:10:03.120 INFO:teuthology.orchestra.run.smithi165.stdout:Permissive 2024-09-11T23:10:03.120 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi144.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi165.front.sepia.ceph.com': 'permissive'} 2024-09-11T23:10:03.120 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:10:03.177 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:10:03.178 DEBUG:teuthology.orchestra.run.smithi165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:10:03.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:10:03.234 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T23:10:03.235 DEBUG:teuthology.orchestra.run.smithi144:> sudo /usr/sbin/setenforce permissive 2024-09-11T23:10:03.306 DEBUG:teuthology.orchestra.run.smithi165:> sudo /usr/sbin/setenforce permissive 2024-09-11T23:10:03.369 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T23:10:03.377 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-11T23:10:03.380 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-11T23:10:03.536 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T23:10:03.546 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T23:10:03.547 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi144.front.sepia.ceph.com,smithi165.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T23:14:49.642 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi144.front.sepia.ceph.com'), Remote(name='ubuntu@smithi165.front.sepia.ceph.com')] 2024-09-11T23:14:49.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-11T23:14:49.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:14:49.743 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-09-11T23:14:49.846 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-11T23:14:49.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-11T23:14:49.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:14:49.949 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-09-11T23:14:50.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-11T23:14:50.062 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T23:14:50.073 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T23:14:50.074 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:14:50.074 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:14:50.079 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:14:50.079 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:14:50.135 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T23:14:50.162 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T23:14:50.165 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T23:14:50.191 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T23:14:50.216 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: ntpd: command not found 2024-09-11T23:14:50.240 INFO:teuthology.orchestra.run.smithi144.stdout:506 Cannot talk to daemon 2024-09-11T23:14:50.242 INFO:teuthology.orchestra.run.smithi165.stderr:sudo: ntpd: command not found 2024-09-11T23:14:50.266 INFO:teuthology.orchestra.run.smithi165.stdout:506 Cannot talk to daemon 2024-09-11T23:14:50.269 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T23:14:50.296 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T23:14:50.298 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T23:14:50.325 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T23:14:50.391 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:14:50.398 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:14:50.398 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2024-09-11T23:14:50.398 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:14:50.398 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:14:50.398 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:14:50.398 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:14:50.421 INFO:teuthology.orchestra.run.smithi165.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:14:50.428 INFO:teuthology.orchestra.run.smithi165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:14:50.428 INFO:teuthology.orchestra.run.smithi165.stdout:=============================================================================== 2024-09-11T23:14:50.428 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:14:50.428 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:14:50.429 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:14:50.429 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:14:50.430 INFO:teuthology.run_tasks:Running task install... 2024-09-11T23:14:50.439 DEBUG:teuthology.task.install:project ceph 2024-09-11T23:14:50.439 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-11T23:14:50.439 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-11T23:14:50.439 INFO:teuthology.task.install:Using flavor: default 2024-09-11T23:14:50.445 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T23:14:50.445 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-11T23:14:50.446 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T23:14:50.446 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:14:50.449 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T23:14:50.449 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:14:50.602 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T23:14:50.603 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T23:14:50.615 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T23:14:50.616 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T23:14:50.723 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T23:14:50.723 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:14:50.723 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T23:14:50.734 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T23:14:50.734 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:14:50.734 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T23:14:50.781 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T23:14:50.782 DEBUG:teuthology.orchestra.run.smithi144:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T23:14:50.790 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T23:14:50.791 DEBUG:teuthology.orchestra.run.smithi165:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T23:14:50.882 DEBUG:teuthology.orchestra.run.smithi144:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T23:14:50.887 DEBUG:teuthology.orchestra.run.smithi165:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T23:14:50.960 DEBUG:teuthology.orchestra.run.smithi144:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T23:14:50.966 DEBUG:teuthology.orchestra.run.smithi165:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T23:14:51.016 INFO:teuthology.orchestra.run.smithi144.stdout:check_obsoletes = 1 2024-09-11T23:14:51.019 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum clean all 2024-09-11T23:14:51.020 INFO:teuthology.orchestra.run.smithi165.stdout:check_obsoletes = 1 2024-09-11T23:14:51.024 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum clean all 2024-09-11T23:14:51.301 INFO:teuthology.orchestra.run.smithi144.stdout:45 files removed 2024-09-11T23:14:51.302 INFO:teuthology.orchestra.run.smithi165.stdout:45 files removed 2024-09-11T23:14:51.335 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T23:14:51.337 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T23:14:52.040 INFO:teuthology.orchestra.run.smithi165.stdout:ceph packages for x86_64 270 kB/s | 84 kB 00:00 2024-09-11T23:14:52.047 INFO:teuthology.orchestra.run.smithi144.stdout:ceph packages for x86_64 268 kB/s | 84 kB 00:00 2024-09-11T23:14:52.331 INFO:teuthology.orchestra.run.smithi144.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-11T23:14:52.365 INFO:teuthology.orchestra.run.smithi165.stdout:ceph noarch packages 42 kB/s | 12 kB 00:00 2024-09-11T23:14:52.623 INFO:teuthology.orchestra.run.smithi144.stdout:ceph source packages 7.4 kB/s | 1.9 kB 00:00 2024-09-11T23:14:52.649 INFO:teuthology.orchestra.run.smithi165.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-11T23:14:53.434 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-11T23:14:53.566 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - BaseOS 9.4 MB/s | 8.2 MB 00:00 2024-09-11T23:14:55.291 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-11T23:14:56.977 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 20 MB 00:02 2024-09-11T23:15:00.701 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 6.5 MB 00:01 2024-09-11T23:15:01.810 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.5 MB 00:00 2024-09-11T23:15:02.426 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-11T23:15:03.360 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-11T23:15:03.520 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-11T23:15:04.290 INFO:teuthology.orchestra.run.smithi165.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-11T23:15:09.869 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-09-11T23:15:10.629 INFO:teuthology.orchestra.run.smithi165.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2024-09-11T23:15:12.407 INFO:teuthology.orchestra.run.smithi144.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:15:12.408 INFO:teuthology.orchestra.run.smithi144.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:15:12.419 INFO:teuthology.orchestra.run.smithi144.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T23:15:12.420 INFO:teuthology.orchestra.run.smithi144.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T23:15:12.421 INFO:teuthology.orchestra.run.smithi144.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T23:15:12.421 INFO:teuthology.orchestra.run.smithi144.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T23:15:12.423 INFO:teuthology.orchestra.run.smithi144.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T23:15:12.426 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T23:15:12.426 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T23:15:12.493 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-11T23:15:12.505 INFO:teuthology.orchestra.run.smithi144.stdout:====================================================================================== 2024-09-11T23:15:12.505 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-09-11T23:15:12.505 INFO:teuthology.orchestra.run.smithi144.stdout:====================================================================================== 2024-09-11T23:15:12.505 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-11T23:15:12.505 INFO:teuthology.orchestra.run.smithi144.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T23:15:12.505 INFO:teuthology.orchestra.run.smithi144.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T23:15:12.505 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T23:15:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T23:15:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T23:15:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T23:15:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T23:15:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T23:15:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T23:15:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T23:15:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T23:15:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T23:15:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T23:15:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T23:15:12.506 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T23:15:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T23:15:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T23:15:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T23:15:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T23:15:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T23:15:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T23:15:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T23:15:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T23:15:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T23:15:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T23:15:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T23:15:12.507 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T23:15:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T23:15:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T23:15:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T23:15:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T23:15:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T23:15:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T23:15:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T23:15:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T23:15:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T23:15:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T23:15:12.508 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2024-09-11T23:15:12.508 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T23:15:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T23:15:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T23:15:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T23:15:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T23:15:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T23:15:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T23:15:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T23:15:12.509 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2024-09-11T23:15:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T23:15:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T23:15:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T23:15:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T23:15:12.509 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T23:15:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T23:15:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T23:15:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T23:15:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T23:15:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T23:15:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T23:15:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T23:15:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T23:15:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T23:15:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T23:15:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T23:15:12.510 INFO:teuthology.orchestra.run.smithi144.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T23:15:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T23:15:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T23:15:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T23:15:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T23:15:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T23:15:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T23:15:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T23:15:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T23:15:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T23:15:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T23:15:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T23:15:12.511 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T23:15:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T23:15:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T23:15:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T23:15:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T23:15:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T23:15:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T23:15:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T23:15:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T23:15:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T23:15:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T23:15:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T23:15:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T23:15:12.512 INFO:teuthology.orchestra.run.smithi144.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T23:15:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T23:15:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T23:15:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T23:15:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T23:15:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T23:15:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T23:15:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T23:15:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T23:15:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T23:15:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T23:15:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T23:15:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T23:15:12.513 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T23:15:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T23:15:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T23:15:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T23:15:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T23:15:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T23:15:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T23:15:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T23:15:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T23:15:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T23:15:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T23:15:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T23:15:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T23:15:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T23:15:12.514 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T23:15:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T23:15:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T23:15:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T23:15:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T23:15:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T23:15:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T23:15:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T23:15:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T23:15:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T23:15:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T23:15:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T23:15:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T23:15:12.515 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T23:15:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T23:15:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T23:15:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T23:15:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T23:15:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T23:15:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T23:15:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T23:15:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T23:15:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T23:15:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T23:15:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T23:15:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T23:15:12.516 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T23:15:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T23:15:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T23:15:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T23:15:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T23:15:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T23:15:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T23:15:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T23:15:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T23:15:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T23:15:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T23:15:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T23:15:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T23:15:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T23:15:12.517 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T23:15:12.518 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T23:15:12.518 INFO:teuthology.orchestra.run.smithi144.stdout:Installing weak dependencies: 2024-09-11T23:15:12.518 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T23:15:12.518 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:15:12.518 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-11T23:15:12.518 INFO:teuthology.orchestra.run.smithi144.stdout:====================================================================================== 2024-09-11T23:15:12.518 INFO:teuthology.orchestra.run.smithi144.stdout:Install 148 Packages 2024-09-11T23:15:12.518 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 8 Packages 2024-09-11T23:15:12.518 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:15:12.519 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 226 M 2024-09-11T23:15:12.519 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-11T23:15:13.116 INFO:teuthology.orchestra.run.smithi165.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:15:13.117 INFO:teuthology.orchestra.run.smithi165.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:15:13.128 INFO:teuthology.orchestra.run.smithi165.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T23:15:13.129 INFO:teuthology.orchestra.run.smithi165.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T23:15:13.130 INFO:teuthology.orchestra.run.smithi165.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T23:15:13.131 INFO:teuthology.orchestra.run.smithi165.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T23:15:13.132 INFO:teuthology.orchestra.run.smithi165.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T23:15:13.135 INFO:teuthology.orchestra.run.smithi165.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T23:15:13.136 INFO:teuthology.orchestra.run.smithi165.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T23:15:13.202 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-11T23:15:13.223 INFO:teuthology.orchestra.run.smithi165.stdout:====================================================================================== 2024-09-11T23:15:13.223 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-11T23:15:13.223 INFO:teuthology.orchestra.run.smithi165.stdout:====================================================================================== 2024-09-11T23:15:13.224 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-11T23:15:13.224 INFO:teuthology.orchestra.run.smithi165.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T23:15:13.224 INFO:teuthology.orchestra.run.smithi165.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T23:15:13.224 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T23:15:13.224 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T23:15:13.224 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T23:15:13.224 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T23:15:13.224 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T23:15:13.224 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T23:15:13.225 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T23:15:13.225 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T23:15:13.225 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T23:15:13.225 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T23:15:13.225 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T23:15:13.225 INFO:teuthology.orchestra.run.smithi165.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T23:15:13.225 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T23:15:13.225 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T23:15:13.225 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T23:15:13.225 INFO:teuthology.orchestra.run.smithi165.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T23:15:13.225 INFO:teuthology.orchestra.run.smithi165.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T23:15:13.226 INFO:teuthology.orchestra.run.smithi165.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T23:15:13.226 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T23:15:13.226 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T23:15:13.226 INFO:teuthology.orchestra.run.smithi165.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T23:15:13.226 INFO:teuthology.orchestra.run.smithi165.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T23:15:13.226 INFO:teuthology.orchestra.run.smithi165.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T23:15:13.226 INFO:teuthology.orchestra.run.smithi165.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T23:15:13.226 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T23:15:13.226 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T23:15:13.226 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T23:15:13.227 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T23:15:13.227 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T23:15:13.227 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T23:15:13.227 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T23:15:13.227 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T23:15:13.227 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T23:15:13.227 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T23:15:13.227 INFO:teuthology.orchestra.run.smithi165.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T23:15:13.227 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrading: 2024-09-11T23:15:13.227 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T23:15:13.228 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T23:15:13.228 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T23:15:13.228 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T23:15:13.228 INFO:teuthology.orchestra.run.smithi165.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T23:15:13.228 INFO:teuthology.orchestra.run.smithi165.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T23:15:13.228 INFO:teuthology.orchestra.run.smithi165.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T23:15:13.228 INFO:teuthology.orchestra.run.smithi165.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T23:15:13.228 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-11T23:15:13.228 INFO:teuthology.orchestra.run.smithi165.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T23:15:13.228 INFO:teuthology.orchestra.run.smithi165.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T23:15:13.229 INFO:teuthology.orchestra.run.smithi165.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T23:15:13.229 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T23:15:13.229 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T23:15:13.229 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T23:15:13.229 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T23:15:13.229 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T23:15:13.229 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T23:15:13.229 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T23:15:13.229 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T23:15:13.229 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T23:15:13.230 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T23:15:13.230 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T23:15:13.230 INFO:teuthology.orchestra.run.smithi165.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T23:15:13.230 INFO:teuthology.orchestra.run.smithi165.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T23:15:13.230 INFO:teuthology.orchestra.run.smithi165.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T23:15:13.230 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T23:15:13.230 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T23:15:13.230 INFO:teuthology.orchestra.run.smithi165.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T23:15:13.230 INFO:teuthology.orchestra.run.smithi165.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T23:15:13.230 INFO:teuthology.orchestra.run.smithi165.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T23:15:13.230 INFO:teuthology.orchestra.run.smithi165.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T23:15:13.230 INFO:teuthology.orchestra.run.smithi165.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T23:15:13.231 INFO:teuthology.orchestra.run.smithi165.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T23:15:13.231 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T23:15:13.231 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T23:15:13.231 INFO:teuthology.orchestra.run.smithi165.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T23:15:13.231 INFO:teuthology.orchestra.run.smithi165.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T23:15:13.231 INFO:teuthology.orchestra.run.smithi165.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T23:15:13.231 INFO:teuthology.orchestra.run.smithi165.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T23:15:13.231 INFO:teuthology.orchestra.run.smithi165.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T23:15:13.231 INFO:teuthology.orchestra.run.smithi165.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T23:15:13.231 INFO:teuthology.orchestra.run.smithi165.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T23:15:13.231 INFO:teuthology.orchestra.run.smithi165.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T23:15:13.231 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T23:15:13.232 INFO:teuthology.orchestra.run.smithi165.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T23:15:13.232 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T23:15:13.232 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T23:15:13.232 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T23:15:13.232 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T23:15:13.232 INFO:teuthology.orchestra.run.smithi165.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T23:15:13.232 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T23:15:13.232 INFO:teuthology.orchestra.run.smithi165.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T23:15:13.232 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T23:15:13.232 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T23:15:13.232 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T23:15:13.233 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T23:15:13.233 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T23:15:13.233 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T23:15:13.233 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T23:15:13.233 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T23:15:13.233 INFO:teuthology.orchestra.run.smithi165.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T23:15:13.233 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T23:15:13.233 INFO:teuthology.orchestra.run.smithi165.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T23:15:13.233 INFO:teuthology.orchestra.run.smithi165.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T23:15:13.233 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T23:15:13.233 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T23:15:13.234 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T23:15:13.234 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T23:15:13.234 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T23:15:13.234 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T23:15:13.234 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T23:15:13.234 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T23:15:13.234 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T23:15:13.234 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T23:15:13.234 INFO:teuthology.orchestra.run.smithi165.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T23:15:13.234 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T23:15:13.234 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T23:15:13.234 INFO:teuthology.orchestra.run.smithi165.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T23:15:13.235 INFO:teuthology.orchestra.run.smithi165.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T23:15:13.235 INFO:teuthology.orchestra.run.smithi165.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T23:15:13.235 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T23:15:13.235 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T23:15:13.235 INFO:teuthology.orchestra.run.smithi165.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T23:15:13.235 INFO:teuthology.orchestra.run.smithi165.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T23:15:13.235 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T23:15:13.235 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T23:15:13.235 INFO:teuthology.orchestra.run.smithi165.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T23:15:13.235 INFO:teuthology.orchestra.run.smithi165.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T23:15:13.235 INFO:teuthology.orchestra.run.smithi165.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T23:15:13.235 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T23:15:13.236 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T23:15:13.236 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T23:15:13.236 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T23:15:13.236 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T23:15:13.236 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T23:15:13.236 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T23:15:13.236 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T23:15:13.236 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T23:15:13.236 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T23:15:13.236 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T23:15:13.236 INFO:teuthology.orchestra.run.smithi165.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T23:15:13.236 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T23:15:13.237 INFO:teuthology.orchestra.run.smithi165.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T23:15:13.237 INFO:teuthology.orchestra.run.smithi165.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T23:15:13.237 INFO:teuthology.orchestra.run.smithi165.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T23:15:13.237 INFO:teuthology.orchestra.run.smithi165.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T23:15:13.237 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T23:15:13.237 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T23:15:13.237 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T23:15:13.237 INFO:teuthology.orchestra.run.smithi165.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T23:15:13.237 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T23:15:13.237 INFO:teuthology.orchestra.run.smithi165.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T23:15:13.237 INFO:teuthology.orchestra.run.smithi165.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T23:15:13.238 INFO:teuthology.orchestra.run.smithi165.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T23:15:13.238 INFO:teuthology.orchestra.run.smithi165.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T23:15:13.238 INFO:teuthology.orchestra.run.smithi165.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T23:15:13.238 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T23:15:13.238 INFO:teuthology.orchestra.run.smithi165.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T23:15:13.238 INFO:teuthology.orchestra.run.smithi165.stdout:Installing weak dependencies: 2024-09-11T23:15:13.238 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T23:15:13.238 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:15:13.238 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-11T23:15:13.238 INFO:teuthology.orchestra.run.smithi165.stdout:====================================================================================== 2024-09-11T23:15:13.238 INFO:teuthology.orchestra.run.smithi165.stdout:Install 148 Packages 2024-09-11T23:15:13.238 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrade 8 Packages 2024-09-11T23:15:13.239 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:15:13.239 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 226 M 2024-09-11T23:15:13.239 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-11T23:15:13.254 INFO:teuthology.orchestra.run.smithi144.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 55 kB/s | 6.5 kB 00:00 2024-09-11T23:15:13.438 INFO:teuthology.orchestra.run.smithi144.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.8 MB/s | 897 kB 00:00 2024-09-11T23:15:13.479 INFO:teuthology.orchestra.run.smithi144.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 3.4 MB/s | 145 kB 00:00 2024-09-11T23:15:13.630 INFO:teuthology.orchestra.run.smithi165.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 53 kB/s | 6.5 kB 00:00 2024-09-11T23:15:13.713 INFO:teuthology.orchestra.run.smithi144.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 10 MB/s | 2.4 MB 00:00 2024-09-11T23:15:13.822 INFO:teuthology.orchestra.run.smithi165.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.6 MB/s | 897 kB 00:00 2024-09-11T23:15:13.864 INFO:teuthology.orchestra.run.smithi165.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 3.4 MB/s | 145 kB 00:00 2024-09-11T23:15:13.891 INFO:teuthology.orchestra.run.smithi144.stdout:(5/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 7.2 MB/s | 5.4 MB 00:00 2024-09-11T23:15:13.972 INFO:teuthology.orchestra.run.smithi144.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 5.9 MB/s | 1.5 MB 00:00 2024-09-11T23:15:14.275 INFO:teuthology.orchestra.run.smithi165.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 5.8 MB/s | 2.4 MB 00:00 2024-09-11T23:15:14.365 INFO:teuthology.orchestra.run.smithi165.stdout:(5/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 6.3 MB/s | 5.4 MB 00:00 2024-09-11T23:15:14.372 INFO:teuthology.orchestra.run.smithi144.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 9.8 MB/s | 4.7 MB 00:00 2024-09-11T23:15:14.532 INFO:teuthology.orchestra.run.smithi165.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 5.9 MB/s | 1.5 MB 00:00 2024-09-11T23:15:14.940 INFO:teuthology.orchestra.run.smithi165.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 8.2 MB/s | 4.7 MB 00:00 2024-09-11T23:15:14.956 INFO:teuthology.orchestra.run.smithi144.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 21 MB 00:01 2024-09-11T23:15:15.048 INFO:teuthology.orchestra.run.smithi144.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 275 kB/s | 25 kB 00:00 2024-09-11T23:15:15.432 INFO:teuthology.orchestra.run.smithi144.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 10 MB/s | 11 MB 00:01 2024-09-11T23:15:15.515 INFO:teuthology.orchestra.run.smithi144.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 228 kB 00:00 2024-09-11T23:15:15.733 INFO:teuthology.orchestra.run.smithi144.stdout:(12/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 9.6 MB/s | 17 MB 00:01 2024-09-11T23:15:15.758 INFO:teuthology.orchestra.run.smithi144.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 112 kB/s | 27 kB 00:00 2024-09-11T23:15:15.783 INFO:teuthology.orchestra.run.smithi144.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 636 kB/s | 32 kB 00:00 2024-09-11T23:15:15.832 INFO:teuthology.orchestra.run.smithi165.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 9.1 MB/s | 21 MB 00:02 2024-09-11T23:15:15.833 INFO:teuthology.orchestra.run.smithi144.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 9.8 MB/s | 752 kB 00:00 2024-09-11T23:15:15.858 INFO:teuthology.orchestra.run.smithi144.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.1 MB/s | 163 kB 00:00 2024-09-11T23:15:15.900 INFO:teuthology.orchestra.run.smithi144.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.9 MB/s | 127 kB 00:00 2024-09-11T23:15:15.951 INFO:teuthology.orchestra.run.smithi144.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 5.4 MB/s | 506 kB 00:00 2024-09-11T23:15:15.982 INFO:teuthology.orchestra.run.smithi165.stdout:(9/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 10 MB/s | 11 MB 00:01 2024-09-11T23:15:16.001 INFO:teuthology.orchestra.run.smithi144.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 907 kB/s | 45 kB 00:00 2024-09-11T23:15:16.008 INFO:teuthology.orchestra.run.smithi165.stdout:(10/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9 144 kB/s | 25 kB 00:00 2024-09-11T23:15:16.068 INFO:teuthology.orchestra.run.smithi144.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.0 MB/s | 136 kB 00:00 2024-09-11T23:15:16.083 INFO:teuthology.orchestra.run.smithi165.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.0 MB/s | 228 kB 00:00 2024-09-11T23:15:16.135 INFO:teuthology.orchestra.run.smithi144.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 2.4 MB/s | 162 kB 00:00 2024-09-11T23:15:16.158 INFO:teuthology.orchestra.run.smithi165.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 362 kB/s | 27 kB 00:00 2024-09-11T23:15:16.210 INFO:teuthology.orchestra.run.smithi144.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 4.2 MB/s | 321 kB 00:00 2024-09-11T23:15:16.286 INFO:teuthology.orchestra.run.smithi144.stdout:(23/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 14 MB/s | 5.3 MB 00:00 2024-09-11T23:15:16.311 INFO:teuthology.orchestra.run.smithi144.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 2.9 MB/s | 301 kB 00:00 2024-09-11T23:15:16.336 INFO:teuthology.orchestra.run.smithi144.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-11T23:15:16.341 INFO:teuthology.orchestra.run.smithi165.stdout:(13/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 9.3 MB/s | 17 MB 00:01 2024-09-11T23:15:16.361 INFO:teuthology.orchestra.run.smithi144.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-11T23:15:16.367 INFO:teuthology.orchestra.run.smithi165.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 152 kB/s | 32 kB 00:00 2024-09-11T23:15:16.437 INFO:teuthology.orchestra.run.smithi144.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.2 MB/s | 171 kB 00:00 2024-09-11T23:15:16.442 INFO:teuthology.orchestra.run.smithi165.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.1 MB/s | 163 kB 00:00 2024-09-11T23:15:16.476 INFO:teuthology.orchestra.run.smithi165.stdout:(16/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 5.5 MB/s | 752 kB 00:00 2024-09-11T23:15:16.487 INFO:teuthology.orchestra.run.smithi144.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 639 kB/s | 32 kB 00:00 2024-09-11T23:15:16.501 INFO:teuthology.orchestra.run.smithi165.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 127 kB 00:00 2024-09-11T23:15:16.551 INFO:teuthology.orchestra.run.smithi165.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 6.6 MB/s | 506 kB 00:00 2024-09-11T23:15:16.570 INFO:teuthology.orchestra.run.smithi144.stdout:(29/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 13 MB/s | 3.1 MB 00:00 2024-09-11T23:15:16.596 INFO:teuthology.orchestra.run.smithi144.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.3 MB/s | 146 kB 00:00 2024-09-11T23:15:16.602 INFO:teuthology.orchestra.run.smithi165.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 900 kB/s | 45 kB 00:00 2024-09-11T23:15:16.685 INFO:teuthology.orchestra.run.smithi165.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.6 MB/s | 136 kB 00:00 2024-09-11T23:15:16.777 INFO:teuthology.orchestra.run.smithi165.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.7 MB/s | 162 kB 00:00 2024-09-11T23:15:16.869 INFO:teuthology.orchestra.run.smithi165.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 3.4 MB/s | 321 kB 00:00 2024-09-11T23:15:16.913 INFO:teuthology.orchestra.run.smithi144.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 10 MB/s | 3.6 MB 00:00 2024-09-11T23:15:16.945 INFO:teuthology.orchestra.run.smithi165.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.9 MB/s | 301 kB 00:00 2024-09-11T23:15:16.988 INFO:teuthology.orchestra.run.smithi144.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.3 MB/s | 249 kB 00:00 2024-09-11T23:15:17.020 INFO:teuthology.orchestra.run.smithi165.stdout:(24/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 10 MB/s | 5.3 MB 00:00 2024-09-11T23:15:17.038 INFO:teuthology.orchestra.run.smithi144.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 993 kB/s | 49 kB 00:00 2024-09-11T23:15:17.045 INFO:teuthology.orchestra.run.smithi165.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 997 kB/s | 100 kB 00:00 2024-09-11T23:15:17.079 INFO:teuthology.orchestra.run.smithi165.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-11T23:15:17.097 INFO:teuthology.orchestra.run.smithi144.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 282 kB/s | 16 kB 00:00 2024-09-11T23:15:17.146 INFO:teuthology.orchestra.run.smithi165.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-11T23:15:17.196 INFO:teuthology.orchestra.run.smithi165.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 638 kB/s | 32 kB 00:00 2024-09-11T23:15:17.214 INFO:teuthology.orchestra.run.smithi144.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-11T23:15:17.248 INFO:teuthology.orchestra.run.smithi144.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 285 kB 00:00 2024-09-11T23:15:17.254 INFO:teuthology.orchestra.run.smithi165.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.5 MB/s | 146 kB 00:00 2024-09-11T23:15:17.281 INFO:teuthology.orchestra.run.smithi144.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 11 MB/s | 765 kB 00:00 2024-09-11T23:15:17.307 INFO:teuthology.orchestra.run.smithi144.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 311 kB/s | 18 kB 00:00 2024-09-11T23:15:17.321 INFO:teuthology.orchestra.run.smithi165.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 3.1 MB 00:00 2024-09-11T23:15:17.530 INFO:teuthology.orchestra.run.smithi165.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 13 MB/s | 3.6 MB 00:00 2024-09-11T23:15:17.649 INFO:teuthology.orchestra.run.smithi165.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.2 MB/s | 249 kB 00:00 2024-09-11T23:15:17.649 INFO:teuthology.orchestra.run.smithi165.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 844 kB/s | 49 kB 00:00 2024-09-11T23:15:17.706 INFO:teuthology.orchestra.run.smithi165.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 283 kB/s | 16 kB 00:00 2024-09-11T23:15:17.773 INFO:teuthology.orchestra.run.smithi165.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.2 MB/s | 285 kB 00:00 2024-09-11T23:15:17.788 INFO:teuthology.orchestra.run.smithi144.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 158 kB/s | 80 kB 00:00 2024-09-11T23:15:17.940 INFO:teuthology.orchestra.run.smithi165.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-11T23:15:17.965 INFO:teuthology.orchestra.run.smithi165.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 3.9 MB/s | 765 kB 00:00 2024-09-11T23:15:17.991 INFO:teuthology.orchestra.run.smithi165.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 365 kB/s | 18 kB 00:00 2024-09-11T23:15:18.083 INFO:teuthology.orchestra.run.smithi144.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 650 kB/s | 191 kB 00:00 2024-09-11T23:15:18.099 INFO:teuthology.orchestra.run.smithi165.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 598 kB/s | 80 kB 00:00 2024-09-11T23:15:18.133 INFO:teuthology.orchestra.run.smithi144.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 971 kB/s | 801 kB 00:00 2024-09-11T23:15:18.179 INFO:teuthology.orchestra.run.smithi165.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 191 kB 00:00 2024-09-11T23:15:18.217 INFO:teuthology.orchestra.run.smithi165.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-11T23:15:18.242 INFO:teuthology.orchestra.run.smithi165.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 253 kB 00:00 2024-09-11T23:15:18.283 INFO:teuthology.orchestra.run.smithi144.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-11T23:15:18.292 INFO:teuthology.orchestra.run.smithi165.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-11T23:15:18.318 INFO:teuthology.orchestra.run.smithi165.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-11T23:15:18.343 INFO:teuthology.orchestra.run.smithi165.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-11T23:15:18.368 INFO:teuthology.orchestra.run.smithi165.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-11T23:15:18.394 INFO:teuthology.orchestra.run.smithi165.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-11T23:15:18.611 INFO:teuthology.orchestra.run.smithi165.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2024-09-11T23:15:18.661 INFO:teuthology.orchestra.run.smithi165.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 3.5 MB/s | 943 kB 00:00 2024-09-11T23:15:18.686 INFO:teuthology.orchestra.run.smithi165.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-11T23:15:18.703 INFO:teuthology.orchestra.run.smithi165.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 521 kB/s | 22 kB 00:00 2024-09-11T23:15:18.745 INFO:teuthology.orchestra.run.smithi165.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-11T23:15:18.762 INFO:teuthology.orchestra.run.smithi165.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 557 kB/s | 33 kB 00:00 2024-09-11T23:15:18.784 INFO:teuthology.orchestra.run.smithi144.stdout:(43/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 13 MB/s | 49 MB 00:03 2024-09-11T23:15:18.809 INFO:teuthology.orchestra.run.smithi144.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 203 kB/s | 106 kB 00:00 2024-09-11T23:15:18.842 INFO:teuthology.orchestra.run.smithi144.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 1.7 MB/s | 1.2 MB 00:00 2024-09-11T23:15:18.987 INFO:teuthology.orchestra.run.smithi144.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 702 kB/s | 125 kB 00:00 2024-09-11T23:15:19.034 INFO:teuthology.orchestra.run.smithi144.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.1 MB/s | 215 kB 00:00 2024-09-11T23:15:19.213 INFO:teuthology.orchestra.run.smithi165.stdout:(54/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 15 MB/s | 49 MB 00:03 2024-09-11T23:15:19.252 INFO:teuthology.orchestra.run.smithi144.stdout:(48/156): python3-pycparser-2.20-6.el9.noarch.r 289 kB/s | 135 kB 00:00 2024-09-11T23:15:19.263 INFO:teuthology.orchestra.run.smithi165.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-09-11T23:15:19.285 INFO:teuthology.orchestra.run.smithi144.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-11T23:15:19.330 INFO:teuthology.orchestra.run.smithi165.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.1 MB/s | 3.0 MB 00:00 2024-09-11T23:15:19.344 INFO:teuthology.orchestra.run.smithi144.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-09-11T23:15:19.355 INFO:teuthology.orchestra.run.smithi165.stdout:(57/156): libaio-devel-0.3.111-13.el9.x86_64.rp 79 kB/s | 11 kB 00:00 2024-09-11T23:15:19.380 INFO:teuthology.orchestra.run.smithi165.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-11T23:15:19.394 INFO:teuthology.orchestra.run.smithi144.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-11T23:15:19.405 INFO:teuthology.orchestra.run.smithi165.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 601 kB/s | 45 kB 00:00 2024-09-11T23:15:19.453 INFO:teuthology.orchestra.run.smithi144.stdout:(52/156): boost-program-options-1.75.0-8.el9.x8 533 kB/s | 107 kB 00:00 2024-09-11T23:15:19.464 INFO:teuthology.orchestra.run.smithi165.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-11T23:15:19.480 INFO:teuthology.orchestra.run.smithi144.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-09-11T23:15:19.489 INFO:teuthology.orchestra.run.smithi165.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 5.2 MB/s | 581 kB 00:00 2024-09-11T23:15:19.511 INFO:teuthology.orchestra.run.smithi144.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 278 kB/s | 33 kB 00:00 2024-09-11T23:15:19.523 INFO:teuthology.orchestra.run.smithi165.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 813 kB/s | 47 kB 00:00 2024-09-11T23:15:19.557 INFO:teuthology.orchestra.run.smithi165.stdout:(63/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-09-11T23:15:19.595 INFO:teuthology.orchestra.run.smithi144.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 156 kB/s | 18 kB 00:00 2024-09-11T23:15:19.601 INFO:teuthology.orchestra.run.smithi165.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-11T23:15:19.629 INFO:teuthology.orchestra.run.smithi144.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 95 kB/s | 11 kB 00:00 2024-09-11T23:15:19.632 INFO:teuthology.orchestra.run.smithi165.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-11T23:15:19.657 INFO:teuthology.orchestra.run.smithi165.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 684 kB/s | 38 kB 00:00 2024-09-11T23:15:19.712 INFO:teuthology.orchestra.run.smithi144.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-11T23:15:19.771 INFO:teuthology.orchestra.run.smithi144.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 318 kB/s | 45 kB 00:00 2024-09-11T23:15:19.791 INFO:teuthology.orchestra.run.smithi165.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-11T23:15:19.838 INFO:teuthology.orchestra.run.smithi144.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-11T23:15:19.850 INFO:teuthology.orchestra.run.smithi165.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-09-11T23:15:19.888 INFO:teuthology.orchestra.run.smithi144.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 4.9 MB/s | 581 kB 00:00 2024-09-11T23:15:19.917 INFO:teuthology.orchestra.run.smithi165.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 16 MB/s | 4.9 MB 00:00 2024-09-11T23:15:19.947 INFO:teuthology.orchestra.run.smithi144.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 225 kB/s | 24 kB 00:00 2024-09-11T23:15:19.973 INFO:teuthology.orchestra.run.smithi165.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-11T23:15:20.009 INFO:teuthology.orchestra.run.smithi165.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 4.1 MB/s | 910 kB 00:00 2024-09-11T23:15:20.022 INFO:teuthology.orchestra.run.smithi144.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 355 kB/s | 47 kB 00:00 2024-09-11T23:15:20.051 INFO:teuthology.orchestra.run.smithi165.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-11T23:15:20.076 INFO:teuthology.orchestra.run.smithi165.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-11T23:15:20.081 INFO:teuthology.orchestra.run.smithi144.stdout:(63/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.8 MB/s | 3.0 MB 00:00 2024-09-11T23:15:20.106 INFO:teuthology.orchestra.run.smithi144.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-09-11T23:15:20.135 INFO:teuthology.orchestra.run.smithi165.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-11T23:15:20.140 INFO:teuthology.orchestra.run.smithi144.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-11T23:15:20.190 INFO:teuthology.orchestra.run.smithi144.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 353 kB/s | 38 kB 00:00 2024-09-11T23:15:20.210 INFO:teuthology.orchestra.run.smithi165.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-11T23:15:20.235 INFO:teuthology.orchestra.run.smithi165.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-11T23:15:20.269 INFO:teuthology.orchestra.run.smithi165.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-11T23:15:20.294 INFO:teuthology.orchestra.run.smithi165.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 438 kB/s | 26 kB 00:00 2024-09-11T23:15:20.336 INFO:teuthology.orchestra.run.smithi165.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 286 kB/s | 19 kB 00:00 2024-09-11T23:15:20.340 INFO:teuthology.orchestra.run.smithi144.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-11T23:15:20.362 INFO:teuthology.orchestra.run.smithi165.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-11T23:15:20.412 INFO:teuthology.orchestra.run.smithi165.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 461 kB/s | 35 kB 00:00 2024-09-11T23:15:20.487 INFO:teuthology.orchestra.run.smithi165.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-11T23:15:20.491 INFO:teuthology.orchestra.run.smithi144.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 5.9 MB/s | 910 kB 00:00 2024-09-11T23:15:20.512 INFO:teuthology.orchestra.run.smithi165.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-11T23:15:20.546 INFO:teuthology.orchestra.run.smithi165.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-11T23:15:20.571 INFO:teuthology.orchestra.run.smithi165.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-11T23:15:20.588 INFO:teuthology.orchestra.run.smithi165.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-11T23:15:20.608 INFO:teuthology.orchestra.run.smithi144.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-11T23:15:20.696 INFO:teuthology.orchestra.run.smithi165.stdout:(87/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-09-11T23:15:20.731 INFO:teuthology.orchestra.run.smithi165.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 1.7 MB/s | 269 kB 00:00 2024-09-11T23:15:20.764 INFO:teuthology.orchestra.run.smithi165.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 903 kB/s | 159 kB 00:00 2024-09-11T23:15:20.790 INFO:teuthology.orchestra.run.smithi165.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 868 kB/s | 51 kB 00:00 2024-09-11T23:15:20.823 INFO:teuthology.orchestra.run.smithi165.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-11T23:15:20.849 INFO:teuthology.orchestra.run.smithi165.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 640 kB/s | 54 kB 00:00 2024-09-11T23:15:20.874 INFO:teuthology.orchestra.run.smithi165.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-09-11T23:15:20.907 INFO:teuthology.orchestra.run.smithi165.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 756 kB/s | 44 kB 00:00 2024-09-11T23:15:20.933 INFO:teuthology.orchestra.run.smithi165.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-11T23:15:20.958 INFO:teuthology.orchestra.run.smithi165.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-09-11T23:15:20.983 INFO:teuthology.orchestra.run.smithi165.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-11T23:15:21.017 INFO:teuthology.orchestra.run.smithi165.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-11T23:15:21.067 INFO:teuthology.orchestra.run.smithi165.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 692 kB/s | 58 kB 00:00 2024-09-11T23:15:21.092 INFO:teuthology.orchestra.run.smithi165.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-09-11T23:15:21.118 INFO:teuthology.orchestra.run.smithi165.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-11T23:15:21.143 INFO:teuthology.orchestra.run.smithi165.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 887 kB/s | 45 kB 00:00 2024-09-11T23:15:21.427 INFO:teuthology.orchestra.run.smithi165.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-11T23:15:21.485 INFO:teuthology.orchestra.run.smithi165.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.3 MB/s | 548 kB 00:00 2024-09-11T23:15:21.519 INFO:teuthology.orchestra.run.smithi165.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-11T23:15:21.561 INFO:teuthology.orchestra.run.smithi165.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 854 kB/s | 19 kB 00:00 2024-09-11T23:15:21.678 INFO:teuthology.orchestra.run.smithi165.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-11T23:15:21.703 INFO:teuthology.orchestra.run.smithi165.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-11T23:15:21.729 INFO:teuthology.orchestra.run.smithi165.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-11T23:15:21.779 INFO:teuthology.orchestra.run.smithi165.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-11T23:15:21.804 INFO:teuthology.orchestra.run.smithi165.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-11T23:15:21.854 INFO:teuthology.orchestra.run.smithi165.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-11T23:15:21.876 INFO:teuthology.orchestra.run.smithi165.stdout:(113/156): lua-devel-5.4.4-4.el9.x86_64.rpm 29 kB/s | 22 kB 00:00 2024-09-11T23:15:21.959 INFO:teuthology.orchestra.run.smithi165.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 5.2 MB/s | 548 kB 00:00 2024-09-11T23:15:21.985 INFO:teuthology.orchestra.run.smithi165.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-09-11T23:15:22.010 INFO:teuthology.orchestra.run.smithi165.stdout:(116/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 324 kB/s | 43 kB 00:00 2024-09-11T23:15:22.035 INFO:teuthology.orchestra.run.smithi165.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-11T23:15:22.060 INFO:teuthology.orchestra.run.smithi165.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-11T23:15:22.123 INFO:teuthology.orchestra.run.smithi165.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 4.0 MB/s | 358 kB 00:00 2024-09-11T23:15:22.153 INFO:teuthology.orchestra.run.smithi165.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-09-11T23:15:22.178 INFO:teuthology.orchestra.run.smithi165.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.0 MB/s | 220 kB 00:00 2024-09-11T23:15:22.212 INFO:teuthology.orchestra.run.smithi165.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-11T23:15:22.237 INFO:teuthology.orchestra.run.smithi165.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 425 kB/s | 11 kB 00:00 2024-09-11T23:15:22.262 INFO:teuthology.orchestra.run.smithi165.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-11T23:15:22.288 INFO:teuthology.orchestra.run.smithi165.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 934 kB/s | 23 kB 00:00 2024-09-11T23:15:22.313 INFO:teuthology.orchestra.run.smithi165.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 775 kB/s | 19 kB 00:00 2024-09-11T23:15:22.338 INFO:teuthology.orchestra.run.smithi165.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 800 kB/s | 20 kB 00:00 2024-09-11T23:15:22.397 INFO:teuthology.orchestra.run.smithi165.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-11T23:15:22.430 INFO:teuthology.orchestra.run.smithi165.stdout:(129/156): protobuf-compiler-3.14.0-13.el9.x86_ 671 kB/s | 863 kB 00:01 2024-09-11T23:15:22.476 INFO:teuthology.orchestra.run.smithi165.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 598 kB/s | 46 kB 00:00 2024-09-11T23:15:22.514 INFO:teuthology.orchestra.run.smithi165.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 1.9 MB/s | 58 kB 00:00 2024-09-11T23:15:22.548 INFO:teuthology.orchestra.run.smithi165.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2024-09-11T23:15:22.573 INFO:teuthology.orchestra.run.smithi165.stdout:(133/156): python3-more-itertools-8.12.0-2.el9. 554 kB/s | 79 kB 00:00 2024-09-11T23:15:22.598 INFO:teuthology.orchestra.run.smithi165.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-11T23:15:22.624 INFO:teuthology.orchestra.run.smithi165.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.5 MB/s | 272 kB 00:00 2024-09-11T23:15:22.625 INFO:teuthology.orchestra.run.smithi144.stdout:(70/156): postgresql-server-13.16-1.el9.x86_64. 2.9 MB/s | 5.8 MB 00:02 2024-09-11T23:15:22.649 INFO:teuthology.orchestra.run.smithi165.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 557 kB/s | 28 kB 00:00 2024-09-11T23:15:22.675 INFO:teuthology.orchestra.run.smithi165.stdout:(137/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 890 kB/s | 90 kB 00:00 2024-09-11T23:15:22.691 INFO:teuthology.orchestra.run.smithi165.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 459 kB/s | 31 kB 00:00 2024-09-11T23:15:22.717 INFO:teuthology.orchestra.run.smithi165.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-11T23:15:22.742 INFO:teuthology.orchestra.run.smithi165.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-11T23:15:22.760 INFO:teuthology.orchestra.run.smithi144.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-09-11T23:15:22.767 INFO:teuthology.orchestra.run.smithi165.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-11T23:15:22.793 INFO:teuthology.orchestra.run.smithi165.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 984 kB/s | 74 kB 00:00 2024-09-11T23:15:22.837 INFO:teuthology.orchestra.run.smithi165.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-11T23:15:22.860 INFO:teuthology.orchestra.run.smithi165.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 857 kB/s | 20 kB 00:00 2024-09-11T23:15:22.875 INFO:teuthology.orchestra.run.smithi144.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 751 kB/s | 87 kB 00:00 2024-09-11T23:15:22.885 INFO:teuthology.orchestra.run.smithi165.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-09-11T23:15:22.910 INFO:teuthology.orchestra.run.smithi165.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T23:15:22.936 INFO:teuthology.orchestra.run.smithi165.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-11T23:15:22.967 INFO:teuthology.orchestra.run.smithi144.stdout:(73/156): openblas-openmp-0.3.26-2.el9.x86_64.r 1.7 MB/s | 4.9 MB 00:02 2024-09-11T23:15:22.986 INFO:teuthology.orchestra.run.smithi165.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T23:15:23.084 INFO:teuthology.orchestra.run.smithi144.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 525 kB/s | 61 kB 00:00 2024-09-11T23:15:23.205 INFO:teuthology.orchestra.run.smithi165.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 11 MB/s | 2.3 MB 00:00 2024-09-11T23:15:23.262 INFO:teuthology.orchestra.run.smithi165.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 9.7 MB/s | 3.2 MB 00:00 2024-09-11T23:15:23.329 INFO:teuthology.orchestra.run.smithi165.stdout:(151/156): librados2-19.1.1-298.gb53b6d3e.el9.x 8.2 MB/s | 3.4 MB 00:00 2024-09-11T23:15:23.354 INFO:teuthology.orchestra.run.smithi165.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 444 kB/s | 41 kB 00:00 2024-09-11T23:15:23.359 INFO:teuthology.orchestra.run.smithi144.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-11T23:15:23.404 INFO:teuthology.orchestra.run.smithi165.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 9.1 MB/s | 1.8 MB 00:00 2024-09-11T23:15:23.476 INFO:teuthology.orchestra.run.smithi144.stdout:(76/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.3 MB/s | 4.4 MB 00:03 2024-09-11T23:15:23.479 INFO:teuthology.orchestra.run.smithi165.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-11T23:15:23.502 INFO:teuthology.orchestra.run.smithi144.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 586 kB/s | 245 kB 00:00 2024-09-11T23:15:23.521 INFO:teuthology.orchestra.run.smithi165.stdout:(155/156): NetworkManager-tui-1.49.90-1.el9.x86 1.3 MB/s | 249 kB 00:00 2024-09-11T23:15:23.527 INFO:teuthology.orchestra.run.smithi144.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-09-11T23:15:23.585 INFO:teuthology.orchestra.run.smithi144.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-09-11T23:15:23.596 INFO:teuthology.orchestra.run.smithi165.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-09-11T23:15:23.602 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:15:23.602 INFO:teuthology.orchestra.run.smithi165.stdout:Total 22 MB/s | 226 MB 00:10 2024-09-11T23:15:23.610 INFO:teuthology.orchestra.run.smithi144.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-09-11T23:15:23.644 INFO:teuthology.orchestra.run.smithi144.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-11T23:15:23.694 INFO:teuthology.orchestra.run.smithi144.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 319 kB/s | 35 kB 00:00 2024-09-11T23:15:23.778 INFO:teuthology.orchestra.run.smithi144.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.8 MB/s | 250 kB 00:00 2024-09-11T23:15:23.887 INFO:teuthology.orchestra.run.smithi144.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 712 kB/s | 77 kB 00:00 2024-09-11T23:15:24.004 INFO:teuthology.orchestra.run.smithi144.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 362 kB/s | 42 kB 00:00 2024-09-11T23:15:24.104 INFO:teuthology.orchestra.run.smithi144.stdout:(86/156): python3-oauthlib-3.1.1-5.el9.noarch.r 543 kB/s | 222 kB 00:00 2024-09-11T23:15:24.129 INFO:teuthology.orchestra.run.smithi144.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-09-11T23:15:24.246 INFO:teuthology.orchestra.run.smithi144.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-11T23:15:24.363 INFO:teuthology.orchestra.run.smithi144.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 438 kB/s | 51 kB 00:00 2024-09-11T23:15:24.388 INFO:teuthology.orchestra.run.smithi144.stdout:(90/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 559 kB/s | 159 kB 00:00 2024-09-11T23:15:24.481 INFO:teuthology.orchestra.run.smithi144.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 457 kB/s | 54 kB 00:00 2024-09-11T23:15:24.614 INFO:teuthology.orchestra.run.smithi144.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 313 kB/s | 42 kB 00:00 2024-09-11T23:15:24.716 INFO:teuthology.orchestra.run.smithi144.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 433 kB/s | 44 kB 00:00 2024-09-11T23:15:24.833 INFO:teuthology.orchestra.run.smithi144.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-11T23:15:24.950 INFO:teuthology.orchestra.run.smithi144.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 308 kB/s | 36 kB 00:00 2024-09-11T23:15:25.150 INFO:teuthology.orchestra.run.smithi144.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 238 kB/s | 47 kB 00:00 2024-09-11T23:15:25.284 INFO:teuthology.orchestra.run.smithi144.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.2 MB/s | 304 kB 00:00 2024-09-11T23:15:25.426 INFO:teuthology.orchestra.run.smithi144.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 408 kB/s | 58 kB 00:00 2024-09-11T23:15:25.543 INFO:teuthology.orchestra.run.smithi144.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 822 kB/s | 96 kB 00:00 2024-09-11T23:15:25.658 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-11T23:15:25.660 INFO:teuthology.orchestra.run.smithi144.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 548 kB/s | 64 kB 00:00 2024-09-11T23:15:25.769 INFO:teuthology.orchestra.run.smithi144.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 413 kB/s | 45 kB 00:00 2024-09-11T23:15:25.837 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-11T23:15:25.837 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-11T23:15:26.361 INFO:teuthology.orchestra.run.smithi144.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 38 kB/s | 22 kB 00:00 2024-09-11T23:15:27.144 INFO:teuthology.orchestra.run.smithi144.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.9 MB/s | 16 MB 00:02 2024-09-11T23:15:27.203 INFO:teuthology.orchestra.run.smithi144.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.3 MB/s | 548 kB 00:00 2024-09-11T23:15:27.236 INFO:teuthology.orchestra.run.smithi144.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-11T23:15:27.264 INFO:teuthology.orchestra.run.smithi144.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 790 kB/s | 19 kB 00:00 2024-09-11T23:15:27.370 INFO:teuthology.orchestra.run.smithi144.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-11T23:15:27.395 INFO:teuthology.orchestra.run.smithi144.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T23:15:27.429 INFO:teuthology.orchestra.run.smithi144.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-11T23:15:27.463 INFO:teuthology.orchestra.run.smithi144.stdout:(110/156): protobuf-compiler-3.14.0-13.el9.x86_ 784 kB/s | 863 kB 00:01 2024-09-11T23:15:27.488 INFO:teuthology.orchestra.run.smithi144.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-11T23:15:27.563 INFO:teuthology.orchestra.run.smithi144.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 13 MB/s | 839 kB 00:00 2024-09-11T23:15:27.597 INFO:teuthology.orchestra.run.smithi144.stdout:(113/156): luarocks-3.9.2-5.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-09-11T23:15:27.622 INFO:teuthology.orchestra.run.smithi144.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T23:15:27.647 INFO:teuthology.orchestra.run.smithi144.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T23:15:27.673 INFO:teuthology.orchestra.run.smithi144.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-09-11T23:15:27.698 INFO:teuthology.orchestra.run.smithi144.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 279 kB/s | 14 kB 00:00 2024-09-11T23:15:27.723 INFO:teuthology.orchestra.run.smithi144.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-11T23:15:27.749 INFO:teuthology.orchestra.run.smithi144.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.9 MB/s | 358 kB 00:00 2024-09-11T23:15:27.774 INFO:teuthology.orchestra.run.smithi144.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-11T23:15:27.800 INFO:teuthology.orchestra.run.smithi144.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-11T23:15:27.833 INFO:teuthology.orchestra.run.smithi144.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-11T23:15:27.858 INFO:teuthology.orchestra.run.smithi144.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 433 kB/s | 11 kB 00:00 2024-09-11T23:15:27.884 INFO:teuthology.orchestra.run.smithi144.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-11T23:15:27.909 INFO:teuthology.orchestra.run.smithi144.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 939 kB/s | 23 kB 00:00 2024-09-11T23:15:27.955 INFO:teuthology.orchestra.run.smithi144.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 424 kB/s | 19 kB 00:00 2024-09-11T23:15:27.985 INFO:teuthology.orchestra.run.smithi144.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 670 kB/s | 20 kB 00:00 2024-09-11T23:15:28.043 INFO:teuthology.orchestra.run.smithi144.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 7.6 MB/s | 2.0 MB 00:00 2024-09-11T23:15:28.068 INFO:teuthology.orchestra.run.smithi144.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T23:15:28.094 INFO:teuthology.orchestra.run.smithi144.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T23:15:28.111 INFO:teuthology.orchestra.run.smithi144.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-11T23:15:28.144 INFO:teuthology.orchestra.run.smithi144.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-11T23:15:28.169 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-11T23:15:28.169 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-11T23:15:28.170 INFO:teuthology.orchestra.run.smithi144.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 664 kB/s | 16 kB 00:00 2024-09-11T23:15:28.203 INFO:teuthology.orchestra.run.smithi144.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-09-11T23:15:28.228 INFO:teuthology.orchestra.run.smithi144.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-11T23:15:28.254 INFO:teuthology.orchestra.run.smithi144.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-11T23:15:28.279 INFO:teuthology.orchestra.run.smithi144.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-09-11T23:15:28.304 INFO:teuthology.orchestra.run.smithi144.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-11T23:15:28.330 INFO:teuthology.orchestra.run.smithi144.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-11T23:15:28.355 INFO:teuthology.orchestra.run.smithi144.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-11T23:15:28.409 INFO:teuthology.orchestra.run.smithi144.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 941 kB/s | 74 kB 00:00 2024-09-11T23:15:28.439 INFO:teuthology.orchestra.run.smithi144.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.0 MB/s | 90 kB 00:00 2024-09-11T23:15:28.464 INFO:teuthology.orchestra.run.smithi144.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-11T23:15:28.489 INFO:teuthology.orchestra.run.smithi144.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-09-11T23:15:28.515 INFO:teuthology.orchestra.run.smithi144.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-11T23:15:28.540 INFO:teuthology.orchestra.run.smithi144.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T23:15:28.590 INFO:teuthology.orchestra.run.smithi144.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-11T23:15:28.829 INFO:teuthology.orchestra.run.smithi144.stdout:(148/156): librados2-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-11T23:15:28.891 INFO:teuthology.orchestra.run.smithi144.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-11T23:15:29.325 INFO:teuthology.orchestra.run.smithi144.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 4.7 MB/s | 2.3 MB 00:00 2024-09-11T23:15:29.441 INFO:teuthology.orchestra.run.smithi144.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 350 kB/s | 41 kB 00:00 2024-09-11T23:15:29.567 INFO:teuthology.orchestra.run.smithi144.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 1.9 MB/s | 249 kB 00:00 2024-09-11T23:15:29.720 INFO:teuthology.orchestra.run.smithi144.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 2.2 MB/s | 1.8 MB 00:00 2024-09-11T23:15:29.759 INFO:teuthology.orchestra.run.smithi144.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 7.1 MB/s | 1.4 MB 00:00 2024-09-11T23:15:29.976 INFO:teuthology.orchestra.run.smithi144.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.3 MB/s | 2.4 MB 00:00 2024-09-11T23:15:31.710 INFO:teuthology.orchestra.run.smithi144.stdout:(156/156): python3-numpy-1.20.1-5.el9.x86_64.rp 644 kB/s | 5.1 MB 00:08 2024-09-11T23:15:31.716 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:15:31.716 INFO:teuthology.orchestra.run.smithi144.stdout:Total 12 MB/s | 226 MB 00:19 2024-09-11T23:15:33.780 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-11T23:15:33.960 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-11T23:15:33.960 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-11T23:15:34.962 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-11T23:15:35.126 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T23:15:35.222 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T23:15:35.510 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T23:15:35.554 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T23:15:35.585 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T23:15:35.675 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T23:15:36.047 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T23:15:36.170 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:15:36.315 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:15:36.317 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-11T23:15:36.317 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-11T23:15:36.375 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:15:36.492 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:15:36.526 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:15:36.732 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T23:15:36.790 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T23:15:36.817 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:15:36.935 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:15:36.985 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:15:37.042 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:15:37.086 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:15:37.133 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:15:37.371 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:15:37.540 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:15:37.746 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T23:15:37.884 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:15:37.978 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:15:38.278 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:15:38.429 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T23:15:38.547 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T23:15:38.593 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T23:15:38.638 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T23:15:38.720 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T23:15:38.783 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T23:15:38.820 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T23:15:38.901 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T23:15:38.939 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T23:15:38.972 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T23:15:39.062 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T23:15:39.125 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T23:15:39.160 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T23:15:39.234 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T23:15:39.320 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T23:15:39.355 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T23:15:39.399 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T23:15:39.435 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T23:15:39.516 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T23:15:39.589 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T23:15:39.687 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T23:15:39.845 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T23:15:39.908 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T23:15:40.563 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T23:15:40.658 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T23:15:40.703 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T23:15:40.746 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T23:15:40.785 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T23:15:40.838 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T23:15:41.026 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T23:15:41.097 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T23:15:41.156 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T23:15:41.242 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T23:15:41.281 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T23:15:41.317 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T23:15:41.389 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T23:15:41.428 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T23:15:41.474 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T23:15:41.524 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T23:15:41.696 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T23:15:41.740 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T23:15:41.784 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T23:15:41.902 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T23:15:41.958 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T23:15:42.001 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T23:15:42.052 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T23:15:42.088 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T23:15:42.202 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T23:15:42.365 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T23:15:42.430 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T23:15:42.476 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T23:15:42.513 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T23:15:42.558 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T23:15:42.597 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T23:15:42.635 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T23:15:42.661 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T23:15:42.694 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T23:15:42.738 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T23:15:42.785 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T23:15:42.883 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T23:15:42.961 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T23:15:42.997 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T23:15:43.118 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T23:15:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-11T23:15:43.185 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T23:15:43.323 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T23:15:43.587 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T23:15:43.689 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T23:15:43.733 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T23:15:43.765 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T23:15:43.823 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T23:15:44.068 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T23:15:44.129 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T23:15:44.196 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T23:15:44.198 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T23:15:44.299 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:15:44.317 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T23:15:44.387 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T23:15:44.426 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:15:44.440 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T23:15:44.483 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:15:44.539 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T23:15:44.590 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T23:15:44.596 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:15:44.631 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:15:44.828 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T23:15:44.854 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T23:15:44.883 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T23:15:44.935 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T23:15:44.962 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:15:44.993 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T23:15:45.088 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:15:45.114 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:15:45.198 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T23:15:45.223 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:15:45.268 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T23:15:45.511 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:15:45.716 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T23:15:45.806 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T23:15:45.913 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T23:15:45.941 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T23:15:46.030 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:15:46.187 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:15:46.477 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T23:15:46.615 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T23:15:46.730 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T23:15:46.779 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T23:15:46.824 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T23:15:46.905 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T23:15:46.960 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T23:15:47.002 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T23:15:47.070 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T23:15:47.117 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T23:15:47.151 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T23:15:47.240 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T23:15:47.303 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T23:15:47.347 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T23:15:47.401 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T23:15:47.493 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T23:15:47.515 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T23:15:47.550 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T23:15:47.593 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T23:15:47.601 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T23:15:47.629 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T23:15:47.631 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T23:15:47.662 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T23:15:47.721 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T23:15:47.774 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T23:15:47.865 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T23:15:48.015 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T23:15:48.032 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T23:15:48.077 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:15:48.095 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T23:15:48.202 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:15:48.534 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T23:15:48.535 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T23:15:48.720 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T23:15:48.829 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T23:15:48.839 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T23:15:48.885 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T23:15:48.886 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:15:48.928 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T23:15:48.967 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T23:15:48.977 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:15:49.004 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T23:15:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T23:15:49.198 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T23:15:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T23:15:49.362 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T23:15:49.447 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T23:15:49.487 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T23:15:49.541 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T23:15:49.599 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T23:15:49.640 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T23:15:49.685 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T23:15:49.737 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T23:15:49.905 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T23:15:49.969 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T23:15:50.011 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T23:15:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T23:15:50.170 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T23:15:50.212 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T23:15:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T23:15:50.266 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T23:15:50.398 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T23:15:50.551 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T23:15:50.593 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T23:15:50.630 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T23:15:50.674 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T23:15:50.724 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T23:15:50.785 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T23:15:50.825 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T23:15:50.860 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T23:15:50.893 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T23:15:50.937 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T23:15:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T23:15:51.067 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T23:15:51.119 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T23:15:51.156 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T23:15:51.323 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T23:15:51.402 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T23:15:51.503 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:15:51.553 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:15:52.178 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:15:52.241 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:15:52.279 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T23:15:52.338 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T23:15:52.365 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:15:52.365 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T23:15:52.365 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T23:15:52.365 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:15:52.372 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T23:15:52.414 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:15:52.484 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T23:15:52.554 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T23:15:52.607 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T23:15:52.705 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T23:15:52.740 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T23:15:52.974 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T23:15:53.013 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T23:15:53.106 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T23:15:53.895 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T23:15:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T23:15:55.608 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T23:15:55.709 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T23:15:55.746 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T23:15:55.779 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T23:15:56.148 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T23:15:56.199 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:15:56.368 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T23:15:56.405 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T23:15:56.459 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T23:15:56.995 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T23:15:57.369 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:15:57.460 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T23:15:57.487 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T23:16:00.022 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:16:00.059 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:16:00.684 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T23:16:00.737 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:16:00.901 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T23:16:00.901 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T23:16:00.901 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T23:16:00.901 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:16:05.348 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:16:05.348 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /sys 2024-09-11T23:16:05.348 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /proc 2024-09-11T23:16:05.349 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /mnt 2024-09-11T23:16:05.349 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /var/tmp 2024-09-11T23:16:05.349 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /home 2024-09-11T23:16:05.349 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /root 2024-09-11T23:16:05.349 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /tmp 2024-09-11T23:16:05.349 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:05.561 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:16:05.597 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:16:05.598 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:16:05.598 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T23:16:05.598 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:07.190 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:16:07.249 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:16:07.249 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:16:07.249 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T23:16:07.249 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:16:07.250 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:16:07.250 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:07.524 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:16:07.575 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:16:07.575 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:16:07.575 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T23:16:07.575 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:16:07.575 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:16:07.575 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:08.059 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:16:08.109 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:16:08.110 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:16:08.110 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T23:16:08.110 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:16:08.110 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:16:08.110 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:08.267 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T23:16:08.326 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T23:16:08.391 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T23:16:08.617 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T23:16:08.679 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T23:16:08.765 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T23:16:08.874 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T23:16:09.055 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T23:16:09.106 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T23:16:09.144 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T23:16:09.178 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T23:16:09.774 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:16:09.803 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:16:09.836 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T23:16:09.904 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T23:16:09.934 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:16:11.158 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:16:11.202 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:16:12.293 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:16:12.328 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:16:12.465 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:16:12.659 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T23:16:12.697 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:16:12.748 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:16:12.748 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:16:12.748 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T23:16:12.749 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:16:12.749 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:16:12.749 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:12.805 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:16:12.831 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:16:12.946 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T23:16:13.010 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T23:16:13.665 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T23:16:13.665 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /sys 2024-09-11T23:16:13.666 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /proc 2024-09-11T23:16:13.666 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /mnt 2024-09-11T23:16:13.666 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /var/tmp 2024-09-11T23:16:13.666 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /home 2024-09-11T23:16:13.666 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /root 2024-09-11T23:16:13.666 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /tmp 2024-09-11T23:16:13.666 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:13.901 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:16:13.938 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T23:16:13.938 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:16:13.938 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T23:16:13.938 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:14.005 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T23:16:14.042 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:16:14.093 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:16:14.093 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:16:14.093 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T23:16:14.093 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:16:14.093 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:16:14.093 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:14.142 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:16:14.191 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:16:14.192 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:16:14.192 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T23:16:14.192 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:14.276 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:16:14.326 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:16:14.326 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:16:14.327 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T23:16:14.327 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:16:14.327 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:16:14.327 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:14.693 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:16:14.745 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:16:14.745 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:16:14.745 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T23:16:14.745 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:16:14.745 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:16:14.745 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:15.504 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:16:15.561 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T23:16:15.561 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:16:15.561 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T23:16:15.562 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:16:15.562 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:16:15.562 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:15.804 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:16:15.855 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T23:16:15.855 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:16:15.855 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T23:16:15.856 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:16:15.856 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:16:15.856 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:16.330 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:16:16.382 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T23:16:16.382 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:16:16.382 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T23:16:16.382 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:16:16.382 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:16:16.382 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:16.504 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T23:16:16.564 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T23:16:16.629 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T23:16:16.851 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T23:16:16.909 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T23:16:16.994 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T23:16:17.112 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T23:16:17.283 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T23:16:17.335 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T23:16:17.373 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T23:16:17.400 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T23:16:17.853 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:16:17.882 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T23:16:17.915 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T23:16:17.982 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T23:16:18.043 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:16:19.251 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T23:16:19.315 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:16:19.673 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T23:16:19.715 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T23:16:19.759 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T23:16:19.787 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T23:16:19.823 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T23:16:20.053 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T23:16:20.121 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T23:16:20.158 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T23:16:20.190 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T23:16:20.267 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T23:16:20.398 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T23:16:20.432 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:16:20.571 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T23:16:20.745 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T23:16:20.775 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:16:20.827 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T23:16:20.827 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:16:20.827 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T23:16:20.828 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:16:20.828 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T23:16:20.828 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:20.893 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:16:20.920 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T23:16:20.943 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:16:21.000 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:16:21.026 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T23:16:21.041 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:16:21.099 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T23:16:22.089 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T23:16:22.129 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:16:22.180 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T23:16:22.180 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:16:22.180 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T23:16:22.180 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:16:22.181 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T23:16:22.184 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:22.263 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:16:22.313 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T23:16:22.313 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:16:22.313 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T23:16:22.313 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:22.322 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T23:16:22.372 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:16:22.423 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T23:16:22.423 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:16:22.424 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T23:16:22.424 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:16:22.424 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T23:16:22.424 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:22.439 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T23:16:22.495 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T23:16:22.604 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T23:16:22.641 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T23:16:22.667 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T23:16:22.745 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T23:16:22.745 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:16:22.764 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:16:22.816 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T23:16:22.816 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:16:22.816 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T23:16:22.816 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:16:22.816 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T23:16:22.816 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:22.894 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:16:22.895 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:16:23.045 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:16:23.110 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T23:16:23.126 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:16:23.126 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:16:23.372 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:16:23.373 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:16:23.498 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:16:23.572 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:16:23.793 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:16:23.793 INFO:teuthology.orchestra.run.smithi165.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-11T23:16:23.794 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:27.777 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T23:16:27.819 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T23:16:27.862 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T23:16:27.892 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T23:16:27.927 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T23:16:28.159 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T23:16:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T23:16:28.245 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T23:16:28.277 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T23:16:28.313 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T23:16:29.057 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:16:29.102 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:16:29.145 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T23:16:29.326 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T23:16:29.327 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T23:16:29.327 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T23:16:29.327 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T23:16:29.327 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T23:16:29.327 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T23:16:29.327 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T23:16:29.327 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:16:29.327 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:16:29.327 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:16:29.327 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T23:16:29.328 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T23:16:29.328 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:16:29.328 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T23:16:29.328 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T23:16:29.328 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T23:16:29.328 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T23:16:29.328 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T23:16:29.328 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T23:16:29.328 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T23:16:29.328 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T23:16:29.328 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T23:16:29.328 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T23:16:29.329 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T23:16:29.329 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T23:16:29.329 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T23:16:29.329 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T23:16:29.329 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T23:16:29.350 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T23:16:29.350 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T23:16:29.350 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T23:16:29.350 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T23:16:29.350 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T23:16:29.350 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T23:16:29.350 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T23:16:29.351 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T23:16:29.351 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T23:16:29.351 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T23:16:29.351 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T23:16:29.351 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T23:16:29.351 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T23:16:29.351 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T23:16:29.351 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T23:16:29.351 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T23:16:29.351 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T23:16:29.351 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T23:16:29.351 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T23:16:29.351 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T23:16:29.352 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T23:16:29.352 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T23:16:29.352 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T23:16:29.352 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T23:16:29.352 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T23:16:29.352 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T23:16:29.352 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T23:16:29.352 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T23:16:29.352 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T23:16:29.352 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T23:16:29.352 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T23:16:29.352 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T23:16:29.353 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T23:16:29.353 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T23:16:29.353 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T23:16:29.353 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T23:16:29.353 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T23:16:29.353 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T23:16:29.353 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T23:16:29.353 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T23:16:29.353 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T23:16:29.353 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T23:16:29.353 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T23:16:29.353 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T23:16:29.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T23:16:29.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T23:16:29.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T23:16:29.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T23:16:29.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T23:16:29.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T23:16:29.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T23:16:29.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T23:16:29.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T23:16:29.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T23:16:29.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T23:16:29.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T23:16:29.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T23:16:29.354 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T23:16:29.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T23:16:29.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T23:16:29.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T23:16:29.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T23:16:29.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T23:16:29.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T23:16:29.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T23:16:29.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T23:16:29.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T23:16:29.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T23:16:29.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T23:16:29.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T23:16:29.355 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T23:16:29.356 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T23:16:29.356 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T23:16:29.356 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T23:16:29.356 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T23:16:29.356 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T23:16:29.356 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T23:16:29.356 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T23:16:29.356 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T23:16:29.356 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T23:16:29.356 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T23:16:29.356 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T23:16:29.356 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T23:16:29.357 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T23:16:29.357 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T23:16:29.357 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T23:16:29.357 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T23:16:29.357 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T23:16:29.357 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T23:16:29.357 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T23:16:29.357 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T23:16:29.357 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T23:16:29.357 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T23:16:29.357 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T23:16:29.357 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T23:16:29.357 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T23:16:29.357 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T23:16:29.358 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T23:16:29.358 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T23:16:29.358 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T23:16:29.358 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T23:16:29.358 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T23:16:29.358 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T23:16:29.358 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T23:16:29.358 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T23:16:29.358 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T23:16:29.358 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T23:16:29.358 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T23:16:29.358 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T23:16:29.358 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T23:16:29.359 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T23:16:29.359 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T23:16:29.359 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T23:16:29.359 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T23:16:29.359 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T23:16:29.359 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T23:16:29.359 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T23:16:29.359 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T23:16:29.359 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T23:16:29.359 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T23:16:29.359 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T23:16:29.359 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T23:16:29.359 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T23:16:29.360 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T23:16:29.360 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T23:16:29.360 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T23:16:29.360 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T23:16:29.360 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T23:16:29.360 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T23:16:29.360 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T23:16:29.360 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T23:16:29.360 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T23:16:29.360 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T23:16:29.360 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T23:16:29.360 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T23:16:30.398 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T23:16:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T23:16:30.567 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T23:16:30.700 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T23:16:30.736 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T23:16:30.761 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T23:16:30.798 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T23:16:30.798 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:16:30.906 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T23:16:30.906 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:16:31.039 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T23:16:31.064 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T23:16:31.080 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:16:31.080 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:16:31.333 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T23:16:31.333 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:16:31.467 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T23:16:31.540 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:16:31.591 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:16:31.591 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:31.591 INFO:teuthology.orchestra.run.smithi165.stdout:Upgraded: 2024-09-11T23:16:31.591 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T23:16:31.591 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T23:16:31.591 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T23:16:31.591 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T23:16:31.591 INFO:teuthology.orchestra.run.smithi165.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.591 INFO:teuthology.orchestra.run.smithi165.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.591 INFO:teuthology.orchestra.run.smithi165.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T23:16:31.591 INFO:teuthology.orchestra.run.smithi165.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T23:16:31.592 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-11T23:16:31.592 INFO:teuthology.orchestra.run.smithi165.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T23:16:31.592 INFO:teuthology.orchestra.run.smithi165.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T23:16:31.592 INFO:teuthology.orchestra.run.smithi165.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T23:16:31.592 INFO:teuthology.orchestra.run.smithi165.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T23:16:31.592 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.592 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.592 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.592 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.592 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:16:31.592 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.592 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.592 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.593 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:16:31.593 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:16:31.593 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:16:31.593 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:16:31.593 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:16:31.593 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.593 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.593 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:16:31.593 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.593 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.593 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.593 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:16:31.593 INFO:teuthology.orchestra.run.smithi165.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:16:31.593 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.594 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.594 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:16:31.594 INFO:teuthology.orchestra.run.smithi165.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T23:16:31.594 INFO:teuthology.orchestra.run.smithi165.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T23:16:31.594 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T23:16:31.594 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T23:16:31.594 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T23:16:31.594 INFO:teuthology.orchestra.run.smithi165.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T23:16:31.594 INFO:teuthology.orchestra.run.smithi165.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T23:16:31.594 INFO:teuthology.orchestra.run.smithi165.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T23:16:31.594 INFO:teuthology.orchestra.run.smithi165.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T23:16:31.594 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T23:16:31.594 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T23:16:31.595 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.595 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.595 INFO:teuthology.orchestra.run.smithi165.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.595 INFO:teuthology.orchestra.run.smithi165.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T23:16:31.595 INFO:teuthology.orchestra.run.smithi165.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T23:16:31.595 INFO:teuthology.orchestra.run.smithi165.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T23:16:31.595 INFO:teuthology.orchestra.run.smithi165.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T23:16:31.595 INFO:teuthology.orchestra.run.smithi165.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T23:16:31.595 INFO:teuthology.orchestra.run.smithi165.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.595 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.595 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T23:16:31.595 INFO:teuthology.orchestra.run.smithi165.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.595 INFO:teuthology.orchestra.run.smithi165.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T23:16:31.595 INFO:teuthology.orchestra.run.smithi165.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T23:16:31.596 INFO:teuthology.orchestra.run.smithi165.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T23:16:31.596 INFO:teuthology.orchestra.run.smithi165.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T23:16:31.596 INFO:teuthology.orchestra.run.smithi165.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T23:16:31.596 INFO:teuthology.orchestra.run.smithi165.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T23:16:31.596 INFO:teuthology.orchestra.run.smithi165.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T23:16:31.596 INFO:teuthology.orchestra.run.smithi165.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T23:16:31.596 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T23:16:31.596 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T23:16:31.596 INFO:teuthology.orchestra.run.smithi165.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T23:16:31.596 INFO:teuthology.orchestra.run.smithi165.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T23:16:31.596 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T23:16:31.596 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T23:16:31.596 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T23:16:31.597 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T23:16:31.597 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T23:16:31.597 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T23:16:31.597 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T23:16:31.597 INFO:teuthology.orchestra.run.smithi165.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T23:16:31.597 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T23:16:31.597 INFO:teuthology.orchestra.run.smithi165.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T23:16:31.597 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T23:16:31.597 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.597 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.597 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.597 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T23:16:31.597 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T23:16:31.597 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T23:16:31.598 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T23:16:31.598 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T23:16:31.598 INFO:teuthology.orchestra.run.smithi165.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T23:16:31.598 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T23:16:31.598 INFO:teuthology.orchestra.run.smithi165.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T23:16:31.598 INFO:teuthology.orchestra.run.smithi165.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T23:16:31.598 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T23:16:31.598 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T23:16:31.598 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T23:16:31.598 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T23:16:31.598 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T23:16:31.598 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T23:16:31.598 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T23:16:31.598 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T23:16:31.599 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T23:16:31.599 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T23:16:31.599 INFO:teuthology.orchestra.run.smithi165.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T23:16:31.599 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T23:16:31.599 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T23:16:31.599 INFO:teuthology.orchestra.run.smithi165.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T23:16:31.599 INFO:teuthology.orchestra.run.smithi165.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T23:16:31.599 INFO:teuthology.orchestra.run.smithi165.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T23:16:31.599 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T23:16:31.599 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T23:16:31.599 INFO:teuthology.orchestra.run.smithi165.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T23:16:31.599 INFO:teuthology.orchestra.run.smithi165.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T23:16:31.599 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T23:16:31.599 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T23:16:31.600 INFO:teuthology.orchestra.run.smithi165.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T23:16:31.600 INFO:teuthology.orchestra.run.smithi165.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T23:16:31.600 INFO:teuthology.orchestra.run.smithi165.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T23:16:31.600 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T23:16:31.600 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T23:16:31.600 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T23:16:31.600 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T23:16:31.600 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T23:16:31.600 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T23:16:31.600 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.600 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.600 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T23:16:31.600 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T23:16:31.601 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T23:16:31.601 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.601 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T23:16:31.601 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T23:16:31.601 INFO:teuthology.orchestra.run.smithi165.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T23:16:31.601 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T23:16:31.601 INFO:teuthology.orchestra.run.smithi165.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T23:16:31.601 INFO:teuthology.orchestra.run.smithi165.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T23:16:31.601 INFO:teuthology.orchestra.run.smithi165.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T23:16:31.601 INFO:teuthology.orchestra.run.smithi165.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T23:16:31.601 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T23:16:31.601 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T23:16:31.601 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T23:16:31.601 INFO:teuthology.orchestra.run.smithi165.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T23:16:31.601 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T23:16:31.602 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T23:16:31.602 INFO:teuthology.orchestra.run.smithi165.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T23:16:31.602 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.602 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.602 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:31.602 INFO:teuthology.orchestra.run.smithi165.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T23:16:31.602 INFO:teuthology.orchestra.run.smithi165.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T23:16:31.602 INFO:teuthology.orchestra.run.smithi165.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T23:16:31.602 INFO:teuthology.orchestra.run.smithi165.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T23:16:31.602 INFO:teuthology.orchestra.run.smithi165.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T23:16:31.602 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T23:16:31.603 INFO:teuthology.orchestra.run.smithi165.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T23:16:31.603 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:31.603 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-11T23:16:31.744 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:16:31.744 INFO:teuthology.orchestra.run.smithi144.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-11T23:16:31.744 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:32.232 DEBUG:teuthology.parallel:result is None 2024-09-11T23:16:37.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T23:16:37.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T23:16:37.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T23:16:37.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T23:16:37.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T23:16:37.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T23:16:37.464 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T23:16:37.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T23:16:37.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T23:16:37.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T23:16:37.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T23:16:37.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T23:16:37.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T23:16:37.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T23:16:37.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T23:16:37.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T23:16:37.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T23:16:37.465 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T23:16:37.466 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T23:16:37.466 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T23:16:37.466 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T23:16:37.466 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T23:16:37.466 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T23:16:37.466 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T23:16:37.466 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T23:16:37.466 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T23:16:37.466 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T23:16:37.478 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T23:16:37.478 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T23:16:37.478 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T23:16:37.479 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T23:16:37.479 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T23:16:37.479 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T23:16:37.479 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T23:16:37.479 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T23:16:37.479 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T23:16:37.479 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T23:16:37.479 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T23:16:37.479 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T23:16:37.479 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T23:16:37.479 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T23:16:37.479 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T23:16:37.479 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T23:16:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T23:16:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T23:16:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T23:16:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T23:16:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T23:16:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T23:16:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T23:16:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T23:16:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T23:16:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T23:16:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T23:16:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T23:16:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T23:16:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T23:16:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T23:16:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T23:16:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T23:16:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T23:16:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T23:16:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T23:16:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T23:16:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T23:16:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T23:16:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T23:16:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T23:16:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T23:16:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T23:16:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T23:16:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T23:16:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T23:16:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T23:16:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T23:16:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T23:16:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T23:16:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T23:16:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T23:16:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T23:16:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T23:16:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T23:16:37.483 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T23:16:37.483 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T23:16:37.483 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T23:16:37.483 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T23:16:37.483 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T23:16:37.483 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T23:16:37.483 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T23:16:37.483 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T23:16:37.483 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T23:16:37.483 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T23:16:37.483 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T23:16:37.483 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T23:16:37.483 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T23:16:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T23:16:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T23:16:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T23:16:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T23:16:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T23:16:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T23:16:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T23:16:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T23:16:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T23:16:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T23:16:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T23:16:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T23:16:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T23:16:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T23:16:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T23:16:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T23:16:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T23:16:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T23:16:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T23:16:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T23:16:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T23:16:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T23:16:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T23:16:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T23:16:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T23:16:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T23:16:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T23:16:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T23:16:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T23:16:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T23:16:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T23:16:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T23:16:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T23:16:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T23:16:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T23:16:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T23:16:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T23:16:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T23:16:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T23:16:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T23:16:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T23:16:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T23:16:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T23:16:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T23:16:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T23:16:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T23:16:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T23:16:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T23:16:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T23:16:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T23:16:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T23:16:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T23:16:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T23:16:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T23:16:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T23:16:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T23:16:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T23:16:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T23:16:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T23:16:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T23:16:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T23:16:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T23:16:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T23:16:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T23:16:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T23:16:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T23:16:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T23:16:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T23:16:39.752 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T23:16:39.753 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:39.753 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2024-09-11T23:16:39.753 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T23:16:39.753 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T23:16:39.753 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T23:16:39.753 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T23:16:39.753 INFO:teuthology.orchestra.run.smithi144.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.753 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.753 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T23:16:39.753 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T23:16:39.753 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-11T23:16:39.753 INFO:teuthology.orchestra.run.smithi144.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T23:16:39.754 INFO:teuthology.orchestra.run.smithi144.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T23:16:39.754 INFO:teuthology.orchestra.run.smithi144.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T23:16:39.754 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T23:16:39.754 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.754 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.754 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.754 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.754 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:16:39.754 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.754 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.754 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.755 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:16:39.755 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:16:39.755 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:16:39.755 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:16:39.755 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:16:39.755 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.755 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.755 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:16:39.755 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.755 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.756 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.756 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:16:39.756 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:16:39.756 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.756 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.756 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T23:16:39.756 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T23:16:39.756 INFO:teuthology.orchestra.run.smithi144.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T23:16:39.756 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T23:16:39.756 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T23:16:39.756 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T23:16:39.756 INFO:teuthology.orchestra.run.smithi144.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T23:16:39.757 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T23:16:39.757 INFO:teuthology.orchestra.run.smithi144.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T23:16:39.757 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T23:16:39.757 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T23:16:39.757 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T23:16:39.757 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.757 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.757 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.757 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T23:16:39.757 INFO:teuthology.orchestra.run.smithi144.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T23:16:39.757 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T23:16:39.757 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T23:16:39.757 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T23:16:39.758 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.758 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.758 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T23:16:39.758 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.758 INFO:teuthology.orchestra.run.smithi144.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T23:16:39.758 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T23:16:39.758 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T23:16:39.758 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T23:16:39.758 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T23:16:39.758 INFO:teuthology.orchestra.run.smithi144.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T23:16:39.758 INFO:teuthology.orchestra.run.smithi144.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T23:16:39.758 INFO:teuthology.orchestra.run.smithi144.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T23:16:39.759 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T23:16:39.759 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T23:16:39.759 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T23:16:39.759 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T23:16:39.759 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T23:16:39.759 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T23:16:39.759 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T23:16:39.759 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T23:16:39.759 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T23:16:39.759 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T23:16:39.759 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T23:16:39.759 INFO:teuthology.orchestra.run.smithi144.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T23:16:39.759 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T23:16:39.760 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T23:16:39.760 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T23:16:39.760 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.760 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.760 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.760 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T23:16:39.760 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T23:16:39.760 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T23:16:39.760 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T23:16:39.760 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T23:16:39.760 INFO:teuthology.orchestra.run.smithi144.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T23:16:39.760 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T23:16:39.761 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T23:16:39.761 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T23:16:39.761 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T23:16:39.761 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T23:16:39.761 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T23:16:39.761 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T23:16:39.761 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T23:16:39.761 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T23:16:39.761 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T23:16:39.761 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T23:16:39.761 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T23:16:39.761 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T23:16:39.761 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T23:16:39.762 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T23:16:39.762 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T23:16:39.762 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T23:16:39.762 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T23:16:39.762 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T23:16:39.762 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T23:16:39.764 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T23:16:39.764 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T23:16:39.764 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T23:16:39.764 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T23:16:39.764 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T23:16:39.764 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T23:16:39.764 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T23:16:39.765 INFO:teuthology.orchestra.run.smithi144.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T23:16:39.765 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T23:16:39.765 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T23:16:39.765 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T23:16:39.765 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T23:16:39.765 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T23:16:39.765 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T23:16:39.765 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.765 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.765 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T23:16:39.765 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T23:16:39.765 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T23:16:39.765 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.766 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T23:16:39.766 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T23:16:39.766 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T23:16:39.766 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T23:16:39.766 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T23:16:39.766 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T23:16:39.766 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T23:16:39.766 INFO:teuthology.orchestra.run.smithi144.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T23:16:39.766 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T23:16:39.766 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T23:16:39.766 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T23:16:39.766 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T23:16:39.767 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T23:16:39.767 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T23:16:39.767 INFO:teuthology.orchestra.run.smithi144.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T23:16:39.767 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.767 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.767 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T23:16:39.767 INFO:teuthology.orchestra.run.smithi144.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T23:16:39.767 INFO:teuthology.orchestra.run.smithi144.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T23:16:39.767 INFO:teuthology.orchestra.run.smithi144.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T23:16:39.767 INFO:teuthology.orchestra.run.smithi144.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T23:16:39.767 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T23:16:39.767 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T23:16:39.768 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T23:16:39.768 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:39.768 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-11T23:16:40.381 DEBUG:teuthology.parallel:result is None 2024-09-11T23:16:40.382 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:16:40.532 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T23:16:40.577 INFO:teuthology.orchestra.run.smithi144.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T23:16:40.578 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T23:16:40.578 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T23:16:40.581 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T23:16:40.725 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T23:16:40.775 INFO:teuthology.orchestra.run.smithi165.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T23:16:40.776 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T23:16:40.776 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T23:16:40.778 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T23:16:40.778 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:16:40.778 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T23:16:40.838 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:16:40.838 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T23:16:40.900 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T23:16:40.900 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:16:40.900 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T23:16:40.961 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T23:16:41.063 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:16:41.064 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T23:16:41.121 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T23:16:41.220 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T23:16:41.220 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:16:41.220 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T23:16:41.276 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T23:16:41.374 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:16:41.374 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T23:16:41.430 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T23:16:41.527 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T23:16:41.527 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:16:41.527 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T23:16:41.582 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T23:16:41.679 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:16:41.680 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T23:16:41.736 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T23:16:41.834 INFO:teuthology.run_tasks:Running task ceph... 2024-09-11T23:16:41.918 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-11T23:16:41.918 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /var/log/ceph 2024-09-11T23:16:41.922 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 777 /var/log/ceph 2024-09-11T23:16:41.978 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-11T23:16:41.979 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T23:16:41.982 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T23:16:42.038 INFO:tasks.ceph:Creating extra log directories... 2024-09-11T23:16:42.038 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T23:16:42.043 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T23:16:42.106 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-11T23:16:42.106 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-11T23:16:42.107 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-11T23:16:42.107 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:16:42.107 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-11T23:16:42.143 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-11T23:16:42.324 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-11T23:16:42.381 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:16:42.381 DEBUG:teuthology.orchestra.run.smithi165:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-11T23:16:42.416 DEBUG:teuthology.orchestra.run.smithi165:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-11T23:16:42.594 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-11T23:16:42.656 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-11T23:16:42.656 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-11T23:16:42.657 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901467', 'branch': 'squid', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/misc}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7901467', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 481, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'sleep_before_teardown': 0, 'subset': '57/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi144.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMBTayFxJZU+6vDT1kfUN8+feCK4LVeC7zeww7E/ZzUKicB5jfkIfF32kWPoZ1PH+c14DVy8bnWU6+8jc93Jw/U=', 'smithi165.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDP7zOnQIXVLY4m2WGrctTE++0yXS2+PlKgre7yhc4knkJjiKAL12gPmtiExxw6TjPOzVUYiVGvvr67Malj169c='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestMisc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_21:24:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-11T23:16:42.657 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T23:16:42.661 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T23:16:42.696 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T23:16:42.738 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T23:16:42.793 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:16:42.794 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T23:16:42.829 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T23:16:42.829 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_1 2024-09-11T23:16:42.903 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T23:16:42.903 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:16:42.904 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-09-11T23:16:42.904 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:16:42.904 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:16:42.904 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-11 23:16:32.115317356 +0000 2024-09-11T23:16:42.904 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-11 23:14:23.463917404 +0000 2024-09-11T23:16:42.904 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-11 23:14:23.463917404 +0000 2024-09-11T23:16:42.904 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-11 23:14:23.463917404 +0000 2024-09-11T23:16:42.904 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T23:16:42.998 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-11T23:16:42.998 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-11T23:16:42.998 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000342438 s, 1.5 MB/s 2024-09-11T23:16:43.001 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T23:16:43.040 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_2 2024-09-11T23:16:43.117 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T23:16:43.118 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:16:43.118 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-09-11T23:16:43.118 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:16:43.118 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:16:43.118 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-11 23:16:32.116317339 +0000 2024-09-11T23:16:43.118 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-11 23:14:23.915909935 +0000 2024-09-11T23:16:43.118 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-11 23:14:23.915909935 +0000 2024-09-11T23:16:43.118 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-11 23:14:23.915909935 +0000 2024-09-11T23:16:43.118 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T23:16:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-11T23:16:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-11T23:16:43.213 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000263649 s, 1.9 MB/s 2024-09-11T23:16:43.216 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T23:16:43.253 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_3 2024-09-11T23:16:43.330 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T23:16:43.330 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:16:43.330 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-09-11T23:16:43.331 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:16:43.331 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:16:43.331 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-11 23:16:32.116317339 +0000 2024-09-11T23:16:43.331 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-11 23:14:24.391902069 +0000 2024-09-11T23:16:43.331 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-11 23:14:24.391902069 +0000 2024-09-11T23:16:43.331 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-11 23:14:24.391902069 +0000 2024-09-11T23:16:43.331 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T23:16:43.424 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-11T23:16:43.424 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-11T23:16:43.424 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000277167 s, 1.8 MB/s 2024-09-11T23:16:43.427 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T23:16:43.463 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_4 2024-09-11T23:16:43.538 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T23:16:43.539 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:16:43.539 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-09-11T23:16:43.539 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:16:43.539 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:16:43.539 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-11 23:16:32.117317323 +0000 2024-09-11T23:16:43.539 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-11 23:14:24.866894221 +0000 2024-09-11T23:16:43.539 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-11 23:14:24.866894221 +0000 2024-09-11T23:16:43.539 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-11 23:14:24.866894221 +0000 2024-09-11T23:16:43.539 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T23:16:43.631 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-11T23:16:43.632 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-11T23:16:43.632 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000452082 s, 1.1 MB/s 2024-09-11T23:16:43.634 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T23:16:43.671 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T23:16:43.672 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:16:43.672 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T23:16:43.709 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T23:16:43.709 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_1 2024-09-11T23:16:43.785 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T23:16:43.785 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:16:43.785 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-09-11T23:16:43.785 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:16:43.785 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:16:43.785 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-11 23:16:24.142301831 +0000 2024-09-11T23:16:43.785 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-11 23:14:23.749807205 +0000 2024-09-11T23:16:43.786 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-11 23:14:23.749807205 +0000 2024-09-11T23:16:43.786 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-11 23:14:23.749807205 +0000 2024-09-11T23:16:43.786 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T23:16:43.879 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-11T23:16:43.879 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-11T23:16:43.879 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.00028085 s, 1.8 MB/s 2024-09-11T23:16:43.881 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T23:16:43.918 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_2 2024-09-11T23:16:43.993 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T23:16:43.993 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:16:43.993 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-09-11T23:16:43.994 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:16:43.994 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:16:43.994 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-11 23:16:24.143301816 +0000 2024-09-11T23:16:43.994 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-11 23:14:24.209801288 +0000 2024-09-11T23:16:43.994 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-11 23:14:24.209801288 +0000 2024-09-11T23:16:43.994 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-11 23:14:24.209801288 +0000 2024-09-11T23:16:43.994 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T23:16:44.088 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-11T23:16:44.089 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-11T23:16:44.089 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000257963 s, 2.0 MB/s 2024-09-11T23:16:44.090 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T23:16:44.127 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_3 2024-09-11T23:16:44.203 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T23:16:44.203 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:16:44.203 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-09-11T23:16:44.203 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:16:44.203 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:16:44.203 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-11 23:16:24.144301802 +0000 2024-09-11T23:16:44.203 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-11 23:14:24.719794728 +0000 2024-09-11T23:16:44.203 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-11 23:14:24.719794728 +0000 2024-09-11T23:16:44.203 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-11 23:14:24.719794728 +0000 2024-09-11T23:16:44.204 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T23:16:44.295 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-11T23:16:44.295 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-11T23:16:44.295 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000263249 s, 1.9 MB/s 2024-09-11T23:16:44.298 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T23:16:44.334 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_4 2024-09-11T23:16:44.410 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T23:16:44.410 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T23:16:44.410 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-09-11T23:16:44.410 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T23:16:44.410 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T23:16:44.410 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-11 23:16:24.145301788 +0000 2024-09-11T23:16:44.411 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-11 23:14:25.173788888 +0000 2024-09-11T23:16:44.411 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-11 23:14:25.173788888 +0000 2024-09-11T23:16:44.411 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-11 23:14:25.173788888 +0000 2024-09-11T23:16:44.411 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T23:16:44.502 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-11T23:16:44.502 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-11T23:16:44.502 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000242981 s, 2.1 MB/s 2024-09-11T23:16:44.505 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T23:16:44.541 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T23:16:44.541 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi165.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T23:16:44.541 INFO:tasks.ceph:Generating config... 2024-09-11T23:16:44.543 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-11T23:16:44.543 INFO:tasks.ceph:[client] debug client = 20 2024-09-11T23:16:44.543 INFO:tasks.ceph:[client] debug ms = 1 2024-09-11T23:16:44.543 INFO:tasks.ceph:[client] pid file = 2024-09-11T23:16:44.543 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-11T23:16:44.543 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-11T23:16:44.543 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-11T23:16:44.543 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-11T23:16:44.543 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-11T23:16:44.543 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-11T23:16:44.543 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-11T23:16:44.543 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-11T23:16:44.544 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-11T23:16:44.544 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-11T23:16:44.544 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-11T23:16:44.544 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-11T23:16:44.544 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-11T23:16:44.544 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-11T23:16:44.544 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-09-11T23:16:44.544 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-11T23:16:44.544 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-11T23:16:44.544 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-11T23:16:44.544 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-11T23:16:44.544 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-11T23:16:44.544 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-11T23:16:44.544 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-11T23:16:44.544 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-11T23:16:44.545 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-11T23:16:44.545 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-11T23:16:44.545 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-11T23:16:44.545 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-11T23:16:44.545 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-11T23:16:44.545 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-11T23:16:44.545 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-11T23:16:44.545 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-11T23:16:44.545 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-11T23:16:44.545 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-11T23:16:44.545 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-11T23:16:44.545 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-11T23:16:44.545 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-11T23:16:44.545 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-11T23:16:44.546 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-11T23:16:44.546 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-11T23:16:44.546 INFO:tasks.ceph:Setting up mon.a... 2024-09-11T23:16:44.546 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-11T23:16:44.640 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.keyring 2024-09-11T23:16:44.646 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-11T23:16:44.733 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T23:16:44.788 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.144'), ('mon.b', '172.21.15.165'), ('mon.c', '[v2:172.21.15.165:3301,v1:172.21.15.165:6790]')] 2024-09-11T23:16:44.788 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.144,172.21.15.165,[v2:172.21.15.165:3301,v1:172.21.15.165:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-11T23:16:44.789 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:16:44.789 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T23:16:44.824 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.144 --add b 172.21.15.165 --addv c '[v2:172.21.15.165:3301,v1:172.21.15.165:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:16:44.940 INFO:teuthology.orchestra.run.smithi144.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:16:44.940 INFO:teuthology.orchestra.run.smithi144.stdout:monmaptool: generated fsid 4b73e4b7-12f0-4e37-94bc-45e333efe84e 2024-09-11T23:16:44.941 INFO:teuthology.orchestra.run.smithi144.stdout:setting min_mon_release = quincy 2024-09-11T23:16:44.941 INFO:teuthology.orchestra.run.smithi144.stdout:epoch 0 2024-09-11T23:16:44.941 INFO:teuthology.orchestra.run.smithi144.stdout:fsid 4b73e4b7-12f0-4e37-94bc-45e333efe84e 2024-09-11T23:16:44.941 INFO:teuthology.orchestra.run.smithi144.stdout:last_changed 2024-09-11T23:16:44.940987+0000 2024-09-11T23:16:44.941 INFO:teuthology.orchestra.run.smithi144.stdout:created 2024-09-11T23:16:44.940987+0000 2024-09-11T23:16:44.941 INFO:teuthology.orchestra.run.smithi144.stdout:min_mon_release 17 (quincy) 2024-09-11T23:16:44.941 INFO:teuthology.orchestra.run.smithi144.stdout:election_strategy: 1 2024-09-11T23:16:44.941 INFO:teuthology.orchestra.run.smithi144.stdout:0: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.a 2024-09-11T23:16:44.941 INFO:teuthology.orchestra.run.smithi144.stdout:1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.b 2024-09-11T23:16:44.941 INFO:teuthology.orchestra.run.smithi144.stdout:2: [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] mon.c 2024-09-11T23:16:44.941 INFO:teuthology.orchestra.run.smithi144.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-11T23:16:44.943 DEBUG:teuthology.orchestra.run.smithi144:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T23:16:44.977 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4b73e4b7-12f0-4e37-94bc-45e333efe84e... 2024-09-11T23:16:44.978 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T23:16:45.022 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T23:16:45.115 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2024-09-11T23:16:45.115 INFO:teuthology.orchestra.run.smithi144.stdout: chdir = "" 2024-09-11T23:16:45.115 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T23:16:45.115 INFO:teuthology.orchestra.run.smithi144.stdout: auth supported = cephx 2024-09-11T23:16:45.115 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.115 INFO:teuthology.orchestra.run.smithi144.stdout: filestore xattr use omap = true 2024-09-11T23:16:45.115 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.115 INFO:teuthology.orchestra.run.smithi144.stdout: mon clock drift allowed = 1.000 2024-09-11T23:16:45.116 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.116 INFO:teuthology.orchestra.run.smithi144.stdout: osd crush chooseleaf type = 0 2024-09-11T23:16:45.116 INFO:teuthology.orchestra.run.smithi144.stdout: auth debug = true 2024-09-11T23:16:45.116 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.116 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on old message = true 2024-09-11T23:16:45.116 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on bug = true 2024-09-11T23:16:45.116 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.116 INFO:teuthology.orchestra.run.smithi144.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T23:16:45.116 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn max object skew = 0 2024-09-11T23:16:45.116 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.116 INFO:teuthology.orchestra.run.smithi144.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T23:16:45.116 INFO:teuthology.orchestra.run.smithi144.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T23:16:45.116 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.117 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default size = 2 2024-09-11T23:16:45.117 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.117 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow primary affinity = true 2024-09-11T23:16:45.117 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow pg remap = true 2024-09-11T23:16:45.117 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on legacy crush tunables = false 2024-09-11T23:16:45.117 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on crush straw calc version zero = false 2024-09-11T23:16:45.117 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on no sortbitwise = false 2024-09-11T23:16:45.117 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on osd down out interval zero = false 2024-09-11T23:16:45.117 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on too few osds = false 2024-09-11T23:16:45.117 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T23:16:45.117 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T23:16:45.117 INFO:teuthology.orchestra.run.smithi144.stdout: mon_allow_pool_size_one = true 2024-09-11T23:16:45.118 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.118 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T23:16:45.118 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.118 INFO:teuthology.orchestra.run.smithi144.stdout: osd default data pool replay window = 5 2024-09-11T23:16:45.118 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.118 INFO:teuthology.orchestra.run.smithi144.stdout: mon allow pool delete = true 2024-09-11T23:16:45.118 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.118 INFO:teuthology.orchestra.run.smithi144.stdout: mon cluster log file level = debug 2024-09-11T23:16:45.118 INFO:teuthology.orchestra.run.smithi144.stdout: debug asserts on shutdown = true 2024-09-11T23:16:45.118 INFO:teuthology.orchestra.run.smithi144.stdout: mon health detail to clog = false 2024-09-11T23:16:45.118 INFO:teuthology.orchestra.run.smithi144.stdout: mon host = "172.21.15.144,172.21.15.165,[v2:172.21.15.165:3301,v1:172.21.15.165:6790]" 2024-09-11T23:16:45.119 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on skipped message = False 2024-09-11T23:16:45.119 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = 4b73e4b7-12f0-4e37-94bc-45e333efe84e 2024-09-11T23:16:45.119 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.119 INFO:teuthology.orchestra.run.smithi144.stdout:[osd] 2024-09-11T23:16:45.119 INFO:teuthology.orchestra.run.smithi144.stdout: osd journal size = 100 2024-09-11T23:16:45.119 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.119 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub load threshold = 5.0 2024-09-11T23:16:45.119 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub max interval = 600 2024-09-11T23:16:45.119 INFO:teuthology.orchestra.run.smithi144.stdout: osd mclock profile = high_recovery_ops 2024-09-11T23:16:45.119 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.119 INFO:teuthology.orchestra.run.smithi144.stdout: osd recover clone overlap = true 2024-09-11T23:16:45.119 INFO:teuthology.orchestra.run.smithi144.stdout: osd recovery max chunk = 1048576 2024-09-11T23:16:45.119 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.119 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug shutdown = true 2024-09-11T23:16:45.120 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug op order = true 2024-09-11T23:16:45.120 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug verify stray on activate = true 2024-09-11T23:16:45.120 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug trim objects = true 2024-09-11T23:16:45.120 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.120 INFO:teuthology.orchestra.run.smithi144.stdout: osd open classes on start = true 2024-09-11T23:16:45.120 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug pg log writeout = true 2024-09-11T23:16:45.120 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.120 INFO:teuthology.orchestra.run.smithi144.stdout: osd deep scrub update digest min age = 30 2024-09-11T23:16:45.120 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.120 INFO:teuthology.orchestra.run.smithi144.stdout: osd map max advance = 10 2024-09-11T23:16:45.120 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.120 INFO:teuthology.orchestra.run.smithi144.stdout: journal zero on create = true 2024-09-11T23:16:45.121 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.121 INFO:teuthology.orchestra.run.smithi144.stdout: filestore ondisk finisher threads = 3 2024-09-11T23:16:45.121 INFO:teuthology.orchestra.run.smithi144.stdout: filestore apply finisher threads = 3 2024-09-11T23:16:45.121 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.121 INFO:teuthology.orchestra.run.smithi144.stdout: bdev debug aio = true 2024-09-11T23:16:45.121 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug misdirected ops = true 2024-09-11T23:16:45.121 INFO:teuthology.orchestra.run.smithi144.stdout: bdev async discard = True 2024-09-11T23:16:45.121 INFO:teuthology.orchestra.run.smithi144.stdout: bdev enable discard = True 2024-09-11T23:16:45.121 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore allocator = bitmap 2024-09-11T23:16:45.121 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore block size = 96636764160 2024-09-11T23:16:45.121 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore fsck on mount = True 2024-09-11T23:16:45.121 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluefs = 1/20 2024-09-11T23:16:45.121 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluestore = 1/20 2024-09-11T23:16:45.122 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-11T23:16:45.122 INFO:teuthology.orchestra.run.smithi144.stdout: debug osd = 20 2024-09-11T23:16:45.122 INFO:teuthology.orchestra.run.smithi144.stdout: debug rocksdb = 4/10 2024-09-11T23:16:45.122 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T23:16:45.122 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.9 2024-09-11T23:16:45.122 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.8 2024-09-11T23:16:45.122 INFO:teuthology.orchestra.run.smithi144.stdout: osd failsafe full ratio = 0.95 2024-09-11T23:16:45.122 INFO:teuthology.orchestra.run.smithi144.stdout: osd objectstore = bluestore 2024-09-11T23:16:45.122 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2024-09-11T23:16:45.122 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.122 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr] 2024-09-11T23:16:45.122 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-11T23:16:45.122 INFO:teuthology.orchestra.run.smithi144.stdout: debug mgr = 20 2024-09-11T23:16:45.123 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2024-09-11T23:16:45.123 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2024-09-11T23:16:45.123 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:16:45.123 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:16:45.123 INFO:teuthology.orchestra.run.smithi144.stdout: mgr/telemetry/nag = false 2024-09-11T23:16:45.123 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2024-09-11T23:16:45.123 INFO:teuthology.orchestra.run.smithi144.stdout: debug finisher = 20 2024-09-11T23:16:45.123 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.123 INFO:teuthology.orchestra.run.smithi144.stdout:[mon] 2024-09-11T23:16:45.123 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-11T23:16:45.123 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2024-09-11T23:16:45.123 INFO:teuthology.orchestra.run.smithi144.stdout: debug paxos = 20 2024-09-11T23:16:45.123 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2024-09-11T23:16:45.124 INFO:teuthology.orchestra.run.smithi144.stdout: mon data avail warn = 5 2024-09-11T23:16:45.124 INFO:teuthology.orchestra.run.smithi144.stdout: mon mgr mkfs grace = 240 2024-09-11T23:16:45.124 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:16:45.124 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd reporter subtree level = osd 2024-09-11T23:16:45.124 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd prime pg temp = true 2024-09-11T23:16:45.124 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:16:45.124 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.124 INFO:teuthology.orchestra.run.smithi144.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T23:16:45.124 INFO:teuthology.orchestra.run.smithi144.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T23:16:45.124 INFO:teuthology.orchestra.run.smithi144.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T23:16:45.124 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.124 INFO:teuthology.orchestra.run.smithi144.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T23:16:45.124 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T23:16:45.125 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T23:16:45.125 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.125 INFO:teuthology.orchestra.run.smithi144.stdout: # 1m isn't quite enough 2024-09-11T23:16:45.125 INFO:teuthology.orchestra.run.smithi144.stdout: mon_down_mkfs_grace = 2m 2024-09-11T23:16:45.125 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.125 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_filestore_osds = false 2024-09-11T23:16:45.125 INFO:teuthology.orchestra.run.smithi144.stdout: mon down mkfs grace = 300 2024-09-11T23:16:45.125 INFO:teuthology.orchestra.run.smithi144.stdout: mon op complaint time = 120 2024-09-11T23:16:45.125 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on pool no app = False 2024-09-11T23:16:45.125 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:16:45.125 INFO:teuthology.orchestra.run.smithi144.stdout:[client] 2024-09-11T23:16:45.125 INFO:teuthology.orchestra.run.smithi144.stdout: rgw cache enabled = true 2024-09-11T23:16:45.125 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable ops log = true 2024-09-11T23:16:45.126 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable usage log = true 2024-09-11T23:16:45.126 INFO:teuthology.orchestra.run.smithi144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T23:16:45.126 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T23:16:45.126 INFO:teuthology.orchestra.run.smithi144.stdout: client mount timeout = 600 2024-09-11T23:16:45.126 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2024-09-11T23:16:45.126 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-11T23:16:45.126 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = "" 2024-09-11T23:16:45.126 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2024-09-11T23:16:45.126 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2024-09-11T23:16:45.126 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.a] 2024-09-11T23:16:45.126 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.b] 2024-09-11T23:16:45.126 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.c] 2024-09-11T23:16:45.126 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2024-09-11T23:16:45.126 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2024-09-11T23:16:45.127 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2024-09-11T23:16:45.127 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d] 2024-09-11T23:16:45.127 INFO:teuthology.orchestra.run.smithi144.stdout:[mds] 2024-09-11T23:16:45.127 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds = 20 2024-09-11T23:16:45.127 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds balancer = 20 2024-09-11T23:16:45.127 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-09-11T23:16:45.127 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug frag = True 2024-09-11T23:16:45.127 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug scatterstat = True 2024-09-11T23:16:45.127 INFO:teuthology.orchestra.run.smithi144.stdout: mds op complaint time = 180 2024-09-11T23:16:45.127 INFO:teuthology.orchestra.run.smithi144.stdout: mds verify scatter = True 2024-09-11T23:16:45.127 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2024-09-11T23:16:45.127 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2024-09-11T23:16:45.127 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2024-09-11T23:16:45.187 INFO:teuthology.orchestra.run.smithi165.stdout:[global] 2024-09-11T23:16:45.187 INFO:teuthology.orchestra.run.smithi165.stdout: chdir = "" 2024-09-11T23:16:45.187 INFO:teuthology.orchestra.run.smithi165.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T23:16:45.187 INFO:teuthology.orchestra.run.smithi165.stdout: auth supported = cephx 2024-09-11T23:16:45.187 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.187 INFO:teuthology.orchestra.run.smithi165.stdout: filestore xattr use omap = true 2024-09-11T23:16:45.188 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.188 INFO:teuthology.orchestra.run.smithi165.stdout: mon clock drift allowed = 1.000 2024-09-11T23:16:45.188 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.188 INFO:teuthology.orchestra.run.smithi165.stdout: osd crush chooseleaf type = 0 2024-09-11T23:16:45.188 INFO:teuthology.orchestra.run.smithi165.stdout: auth debug = true 2024-09-11T23:16:45.188 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.188 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on old message = true 2024-09-11T23:16:45.188 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on bug = true 2024-09-11T23:16:45.188 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.188 INFO:teuthology.orchestra.run.smithi165.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T23:16:45.188 INFO:teuthology.orchestra.run.smithi165.stdout: mon pg warn max object skew = 0 2024-09-11T23:16:45.188 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.188 INFO:teuthology.orchestra.run.smithi165.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T23:16:45.189 INFO:teuthology.orchestra.run.smithi165.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T23:16:45.189 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.189 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default size = 2 2024-09-11T23:16:45.189 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.189 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd allow primary affinity = true 2024-09-11T23:16:45.189 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd allow pg remap = true 2024-09-11T23:16:45.189 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on legacy crush tunables = false 2024-09-11T23:16:45.189 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on crush straw calc version zero = false 2024-09-11T23:16:45.189 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on no sortbitwise = false 2024-09-11T23:16:45.189 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on osd down out interval zero = false 2024-09-11T23:16:45.189 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on too few osds = false 2024-09-11T23:16:45.189 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T23:16:45.189 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T23:16:45.189 INFO:teuthology.orchestra.run.smithi165.stdout: mon_allow_pool_size_one = true 2024-09-11T23:16:45.190 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.190 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T23:16:45.190 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.190 INFO:teuthology.orchestra.run.smithi165.stdout: osd default data pool replay window = 5 2024-09-11T23:16:45.190 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.190 INFO:teuthology.orchestra.run.smithi165.stdout: mon allow pool delete = true 2024-09-11T23:16:45.190 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.190 INFO:teuthology.orchestra.run.smithi165.stdout: mon cluster log file level = debug 2024-09-11T23:16:45.190 INFO:teuthology.orchestra.run.smithi165.stdout: debug asserts on shutdown = true 2024-09-11T23:16:45.190 INFO:teuthology.orchestra.run.smithi165.stdout: mon health detail to clog = false 2024-09-11T23:16:45.190 INFO:teuthology.orchestra.run.smithi165.stdout: mon host = "172.21.15.144,172.21.15.165,[v2:172.21.15.165:3301,v1:172.21.15.165:6790]" 2024-09-11T23:16:45.190 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on skipped message = False 2024-09-11T23:16:45.190 INFO:teuthology.orchestra.run.smithi165.stdout: fsid = 4b73e4b7-12f0-4e37-94bc-45e333efe84e 2024-09-11T23:16:45.190 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.190 INFO:teuthology.orchestra.run.smithi165.stdout:[osd] 2024-09-11T23:16:45.191 INFO:teuthology.orchestra.run.smithi165.stdout: osd journal size = 100 2024-09-11T23:16:45.191 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.191 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub load threshold = 5.0 2024-09-11T23:16:45.191 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub max interval = 600 2024-09-11T23:16:45.191 INFO:teuthology.orchestra.run.smithi165.stdout: osd mclock profile = high_recovery_ops 2024-09-11T23:16:45.191 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.191 INFO:teuthology.orchestra.run.smithi165.stdout: osd recover clone overlap = true 2024-09-11T23:16:45.191 INFO:teuthology.orchestra.run.smithi165.stdout: osd recovery max chunk = 1048576 2024-09-11T23:16:45.191 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.191 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug shutdown = true 2024-09-11T23:16:45.191 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug op order = true 2024-09-11T23:16:45.191 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug verify stray on activate = true 2024-09-11T23:16:45.191 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug trim objects = true 2024-09-11T23:16:45.191 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.191 INFO:teuthology.orchestra.run.smithi165.stdout: osd open classes on start = true 2024-09-11T23:16:45.192 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug pg log writeout = true 2024-09-11T23:16:45.192 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.192 INFO:teuthology.orchestra.run.smithi165.stdout: osd deep scrub update digest min age = 30 2024-09-11T23:16:45.192 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.192 INFO:teuthology.orchestra.run.smithi165.stdout: osd map max advance = 10 2024-09-11T23:16:45.192 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.192 INFO:teuthology.orchestra.run.smithi165.stdout: journal zero on create = true 2024-09-11T23:16:45.192 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.193 INFO:teuthology.orchestra.run.smithi165.stdout: filestore ondisk finisher threads = 3 2024-09-11T23:16:45.193 INFO:teuthology.orchestra.run.smithi165.stdout: filestore apply finisher threads = 3 2024-09-11T23:16:45.193 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.193 INFO:teuthology.orchestra.run.smithi165.stdout: bdev debug aio = true 2024-09-11T23:16:45.193 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug misdirected ops = true 2024-09-11T23:16:45.193 INFO:teuthology.orchestra.run.smithi165.stdout: bdev async discard = True 2024-09-11T23:16:45.193 INFO:teuthology.orchestra.run.smithi165.stdout: bdev enable discard = True 2024-09-11T23:16:45.193 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore allocator = bitmap 2024-09-11T23:16:45.193 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore block size = 96636764160 2024-09-11T23:16:45.193 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore fsck on mount = True 2024-09-11T23:16:45.193 INFO:teuthology.orchestra.run.smithi165.stdout: debug bluefs = 1/20 2024-09-11T23:16:45.193 INFO:teuthology.orchestra.run.smithi165.stdout: debug bluestore = 1/20 2024-09-11T23:16:45.193 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-11T23:16:45.194 INFO:teuthology.orchestra.run.smithi165.stdout: debug osd = 20 2024-09-11T23:16:45.194 INFO:teuthology.orchestra.run.smithi165.stdout: debug rocksdb = 4/10 2024-09-11T23:16:45.194 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T23:16:45.194 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd full ratio = 0.9 2024-09-11T23:16:45.194 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd nearfull ratio = 0.8 2024-09-11T23:16:45.194 INFO:teuthology.orchestra.run.smithi165.stdout: osd failsafe full ratio = 0.95 2024-09-11T23:16:45.194 INFO:teuthology.orchestra.run.smithi165.stdout: osd objectstore = bluestore 2024-09-11T23:16:45.194 INFO:teuthology.orchestra.run.smithi165.stdout: osd op complaint time = 180 2024-09-11T23:16:45.194 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.194 INFO:teuthology.orchestra.run.smithi165.stdout:[mgr] 2024-09-11T23:16:45.194 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-11T23:16:45.194 INFO:teuthology.orchestra.run.smithi165.stdout: debug mgr = 20 2024-09-11T23:16:45.194 INFO:teuthology.orchestra.run.smithi165.stdout: debug mon = 20 2024-09-11T23:16:45.194 INFO:teuthology.orchestra.run.smithi165.stdout: debug auth = 20 2024-09-11T23:16:45.195 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:16:45.195 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:16:45.195 INFO:teuthology.orchestra.run.smithi165.stdout: mgr/telemetry/nag = false 2024-09-11T23:16:45.195 INFO:teuthology.orchestra.run.smithi165.stdout: debug client = 20 2024-09-11T23:16:45.195 INFO:teuthology.orchestra.run.smithi165.stdout: debug finisher = 20 2024-09-11T23:16:45.195 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.195 INFO:teuthology.orchestra.run.smithi165.stdout:[mon] 2024-09-11T23:16:45.195 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-11T23:16:45.195 INFO:teuthology.orchestra.run.smithi165.stdout: debug mon = 20 2024-09-11T23:16:45.195 INFO:teuthology.orchestra.run.smithi165.stdout: debug paxos = 20 2024-09-11T23:16:45.195 INFO:teuthology.orchestra.run.smithi165.stdout: debug auth = 20 2024-09-11T23:16:45.195 INFO:teuthology.orchestra.run.smithi165.stdout: mon data avail warn = 5 2024-09-11T23:16:45.195 INFO:teuthology.orchestra.run.smithi165.stdout: mon mgr mkfs grace = 240 2024-09-11T23:16:45.196 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min pgs per osd = 4 2024-09-11T23:16:45.196 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd reporter subtree level = osd 2024-09-11T23:16:45.196 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd prime pg temp = true 2024-09-11T23:16:45.196 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min bytes per osd = 10 2024-09-11T23:16:45.196 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.196 INFO:teuthology.orchestra.run.smithi165.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T23:16:45.197 INFO:teuthology.orchestra.run.smithi165.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T23:16:45.197 INFO:teuthology.orchestra.run.smithi165.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T23:16:45.197 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.197 INFO:teuthology.orchestra.run.smithi165.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T23:16:45.197 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T23:16:45.197 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T23:16:45.197 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.198 INFO:teuthology.orchestra.run.smithi165.stdout: # 1m isn't quite enough 2024-09-11T23:16:45.198 INFO:teuthology.orchestra.run.smithi165.stdout: mon_down_mkfs_grace = 2m 2024-09-11T23:16:45.198 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.198 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_filestore_osds = false 2024-09-11T23:16:45.198 INFO:teuthology.orchestra.run.smithi165.stdout: mon down mkfs grace = 300 2024-09-11T23:16:45.198 INFO:teuthology.orchestra.run.smithi165.stdout: mon op complaint time = 120 2024-09-11T23:16:45.198 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on pool no app = False 2024-09-11T23:16:45.198 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-11T23:16:45.198 INFO:teuthology.orchestra.run.smithi165.stdout:[client] 2024-09-11T23:16:45.198 INFO:teuthology.orchestra.run.smithi165.stdout: rgw cache enabled = true 2024-09-11T23:16:45.198 INFO:teuthology.orchestra.run.smithi165.stdout: rgw enable ops log = true 2024-09-11T23:16:45.198 INFO:teuthology.orchestra.run.smithi165.stdout: rgw enable usage log = true 2024-09-11T23:16:45.199 INFO:teuthology.orchestra.run.smithi165.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T23:16:45.199 INFO:teuthology.orchestra.run.smithi165.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T23:16:45.199 INFO:teuthology.orchestra.run.smithi165.stdout: client mount timeout = 600 2024-09-11T23:16:45.199 INFO:teuthology.orchestra.run.smithi165.stdout: debug client = 20 2024-09-11T23:16:45.199 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-11T23:16:45.199 INFO:teuthology.orchestra.run.smithi165.stdout: pid file = "" 2024-09-11T23:16:45.199 INFO:teuthology.orchestra.run.smithi165.stdout: rados mon op timeout = 900 2024-09-11T23:16:45.199 INFO:teuthology.orchestra.run.smithi165.stdout: rados osd op timeout = 900 2024-09-11T23:16:45.199 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.a] 2024-09-11T23:16:45.199 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.b] 2024-09-11T23:16:45.199 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.c] 2024-09-11T23:16:45.199 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.a] 2024-09-11T23:16:45.199 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.c] 2024-09-11T23:16:45.200 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.b] 2024-09-11T23:16:45.200 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.d] 2024-09-11T23:16:45.200 INFO:teuthology.orchestra.run.smithi165.stdout:[mds] 2024-09-11T23:16:45.200 INFO:teuthology.orchestra.run.smithi165.stdout: debug mds = 20 2024-09-11T23:16:45.200 INFO:teuthology.orchestra.run.smithi165.stdout: debug mds balancer = 20 2024-09-11T23:16:45.200 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-11T23:16:45.200 INFO:teuthology.orchestra.run.smithi165.stdout: mds debug frag = True 2024-09-11T23:16:45.200 INFO:teuthology.orchestra.run.smithi165.stdout: mds debug scatterstat = True 2024-09-11T23:16:45.200 INFO:teuthology.orchestra.run.smithi165.stdout: mds op complaint time = 180 2024-09-11T23:16:45.200 INFO:teuthology.orchestra.run.smithi165.stdout: mds verify scatter = True 2024-09-11T23:16:45.200 INFO:teuthology.orchestra.run.smithi165.stdout: osd op complaint time = 180 2024-09-11T23:16:45.201 INFO:teuthology.orchestra.run.smithi165.stdout: rados mon op timeout = 900 2024-09-11T23:16:45.201 INFO:teuthology.orchestra.run.smithi165.stdout: rados osd op timeout = 900 2024-09-11T23:16:45.212 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-11T23:16:45.212 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-11T23:16:45.310 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-11T23:16:45.310 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:16:45.310 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-11T23:16:45.345 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:16:45.345 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-11T23:16:45.419 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:16:45.419 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:16:45.419 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T23:16:45.419 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T23:16:45.540 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:16:45.540 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:16:45.614 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:16:45.615 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:16:45.615 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T23:16:45.615 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T23:16:45.693 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:16:45.693 DEBUG:teuthology.orchestra.run.smithi165:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:16:45.768 INFO:tasks.ceph:Setting up mon nodes... 2024-09-11T23:16:45.768 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-11T23:16:45.768 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T23:16:45.876 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T23:16:45.883 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T23:16:45.998 INFO:teuthology.orchestra.run.smithi165.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T23:16:46.005 INFO:tasks.ceph:Setting up mds nodes... 2024-09-11T23:16:46.005 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-11T23:16:46.110 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-11T23:16:46.115 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-11T23:16:46.173 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-11T23:16:46.277 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-11T23:16:46.282 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-11T23:16:46.339 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-11T23:16:46.444 INFO:teuthology.orchestra.run.smithi165.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-11T23:16:46.449 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-11T23:16:46.504 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-11T23:16:46.608 INFO:teuthology.orchestra.run.smithi165.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-11T23:16:46.613 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-11T23:16:46.668 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-11T23:16:46.668 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T23:16:46.750 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-11T23:16:46.778 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-11T23:16:46.859 INFO:teuthology.orchestra.run.smithi144.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-11T23:16:46.886 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-11T23:16:46.968 INFO:teuthology.orchestra.run.smithi165.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-11T23:16:46.995 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-11T23:16:47.075 INFO:teuthology.orchestra.run.smithi165.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-11T23:16:47.102 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-11T23:16:47.103 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi165.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T23:16:47.103 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-11T23:16:47.159 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T23:16:47.159 INFO:tasks.ceph:role: osd.0 2024-09-11T23:16:47.159 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:16:47.159 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T23:16:47.221 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T23:16:47.221 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T23:16:47.221 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T23:16:47.221 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T23:16:47.222 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T23:16:47.222 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-09-11T23:16:47.222 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T23:16:47.222 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T23:16:47.222 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T23:16:47.222 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T23:16:47.628 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-09-11T23:16:47.632 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-09-11T23:16:47.632 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-11T23:16:47.783 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-11T23:16:47.847 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-11T23:16:47.903 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T23:16:47.904 INFO:tasks.ceph:role: osd.1 2024-09-11T23:16:47.904 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:16:47.904 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T23:16:47.967 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T23:16:47.967 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T23:16:47.967 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T23:16:47.967 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T23:16:47.967 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T23:16:47.967 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-09-11T23:16:47.967 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T23:16:47.968 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T23:16:47.968 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T23:16:47.968 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T23:16:48.326 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-09-11T23:16:48.330 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-09-11T23:16:48.331 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-11T23:16:48.414 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-11T23:16:48.475 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-11T23:16:48.530 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T23:16:48.530 INFO:tasks.ceph:role: osd.2 2024-09-11T23:16:48.531 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:16:48.531 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T23:16:48.593 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T23:16:48.594 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T23:16:48.594 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T23:16:48.594 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T23:16:48.594 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T23:16:48.594 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-09-11T23:16:48.594 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T23:16:48.594 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T23:16:48.594 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T23:16:48.594 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T23:16:48.984 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-09-11T23:16:48.987 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-09-11T23:16:48.988 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-11T23:16:49.081 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-11T23:16:49.144 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-11T23:16:49.199 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T23:16:49.199 INFO:tasks.ceph:role: osd.3 2024-09-11T23:16:49.199 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:16:49.200 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T23:16:49.263 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T23:16:49.263 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T23:16:49.263 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T23:16:49.263 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T23:16:49.263 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T23:16:49.263 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-09-11T23:16:49.264 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T23:16:49.264 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T23:16:49.264 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T23:16:49.264 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T23:16:49.683 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2024-09-11T23:16:49.687 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-09-11T23:16:49.687 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-11T23:16:49.832 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-11T23:16:49.899 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:16:50.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:16:49.999+0000 7f319154d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-11T23:16:50.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:16:50.000+0000 7f319154d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-11T23:16:50.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:16:50.000+0000 7f319154d640 -1 bdev(0x557da826b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-11T23:16:50.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:16:50.000+0000 7f319154d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-11T23:16:53.549 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T23:16:53.608 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:16:53.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:16:53.699+0000 7f254d085640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-11T23:16:53.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:16:53.700+0000 7f254d085640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-11T23:16:53.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:16:53.700+0000 7f254d085640 -1 bdev(0x55b4ee7e3800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-11T23:16:53.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:16:53.700+0000 7f254d085640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-11T23:16:57.243 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T23:16:57.304 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:16:57.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:16:57.396+0000 7f3e9d01e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-11T23:16:57.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:16:57.396+0000 7f3e9d01e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-11T23:16:57.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:16:57.396+0000 7f3e9d01e640 -1 bdev(0x55710968d800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-11T23:16:57.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:16:57.397+0000 7f3e9d01e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-11T23:17:01.159 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T23:17:01.217 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:17:01.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:01.308+0000 7f4b7dcef640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-11T23:17:01.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:01.308+0000 7f4b7dcef640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-11T23:17:01.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:01.308+0000 7f4b7dcef640 -1 bdev(0x558ace763800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-11T23:17:01.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:01.308+0000 7f4b7dcef640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-11T23:17:05.069 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T23:17:05.131 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-11T23:17:05.193 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T23:17:05.193 INFO:tasks.ceph:role: osd.4 2024-09-11T23:17:05.193 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:17:05.193 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T23:17:05.258 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T23:17:05.258 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T23:17:05.258 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T23:17:05.258 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T23:17:05.258 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T23:17:05.258 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-09-11T23:17:05.259 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T23:17:05.259 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T23:17:05.259 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T23:17:05.259 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T23:17:05.670 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-09-11T23:17:05.674 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-09-11T23:17:05.674 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-11T23:17:05.806 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-11T23:17:05.871 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-11T23:17:05.927 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T23:17:05.927 INFO:tasks.ceph:role: osd.5 2024-09-11T23:17:05.927 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:17:05.928 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T23:17:05.989 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T23:17:05.989 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T23:17:05.989 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T23:17:05.989 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T23:17:05.989 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T23:17:05.990 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-09-11T23:17:05.990 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T23:17:05.990 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T23:17:05.990 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T23:17:05.990 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T23:17:06.347 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-09-11T23:17:06.351 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-09-11T23:17:06.351 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-11T23:17:06.437 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-11T23:17:06.499 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-11T23:17:06.554 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T23:17:06.554 INFO:tasks.ceph:role: osd.6 2024-09-11T23:17:06.554 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:17:06.554 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T23:17:06.617 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T23:17:06.617 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T23:17:06.618 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T23:17:06.618 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T23:17:06.618 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T23:17:06.618 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-09-11T23:17:06.618 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T23:17:06.618 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T23:17:06.618 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T23:17:06.618 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T23:17:07.005 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-09-11T23:17:07.009 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-09-11T23:17:07.009 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-11T23:17:07.107 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-11T23:17:07.168 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-11T23:17:07.224 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T23:17:07.224 INFO:tasks.ceph:role: osd.7 2024-09-11T23:17:07.224 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:17:07.224 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T23:17:07.286 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T23:17:07.286 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T23:17:07.287 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T23:17:07.287 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T23:17:07.287 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T23:17:07.287 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-09-11T23:17:07.287 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T23:17:07.287 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T23:17:07.287 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T23:17:07.287 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T23:17:07.712 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-09-11T23:17:07.715 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-09-11T23:17:07.716 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-11T23:17:07.848 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-11T23:17:07.914 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:17:08.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:08.037+0000 7fe5c9bcc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-11T23:17:08.038 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:08.038+0000 7fe5c9bcc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-11T23:17:08.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:08.038+0000 7fe5c9bcc640 -1 bdev(0x564eb3f17800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-11T23:17:08.039 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:08.039+0000 7fe5c9bcc640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-11T23:17:12.079 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-11T23:17:12.141 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:17:12.234 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:12.234+0000 7f9096fbb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-11T23:17:12.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:12.234+0000 7f9096fbb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-11T23:17:12.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:12.234+0000 7f9096fbb640 -1 bdev(0x55acd9773800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-11T23:17:12.235 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:12.235+0000 7f9096fbb640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-11T23:17:12.659 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:17:12.664 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:17:15.989 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-11T23:17:16.051 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:17:16.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:16.143+0000 7f82f4416640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-11T23:17:16.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:16.143+0000 7f82f4416640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-11T23:17:16.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:16.143+0000 7f82f4416640 -1 bdev(0x55674043b800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-11T23:17:16.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:16.143+0000 7f82f4416640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-11T23:17:19.896 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-11T23:17:19.956 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:17:20.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:20.048+0000 7f84d4f58640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-11T23:17:20.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:20.049+0000 7f84d4f58640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-11T23:17:20.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:20.049+0000 7f84d4f58640 -1 bdev(0x55c9de98f800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-11T23:17:20.049 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:20.049+0000 7f84d4f58640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-11T23:17:24.067 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-11T23:17:24.122 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-11T23:17:24.122 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:17:24.123 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-11T23:17:24.185 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:17:24.185 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-11T23:17:24.284 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:17:24.284 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-11T23:17:24.380 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:17:24.380 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-11T23:17:24.476 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:17:24.476 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-11T23:17:24.571 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:17:24.571 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-11T23:17:24.665 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:17:24.665 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-11T23:17:24.762 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:17:24.762 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-11T23:17:24.819 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:17:24.820 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-11T23:17:24.916 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:17:24.916 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-11T23:17:25.011 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:17:25.011 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-11T23:17:25.106 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:17:25.107 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-11T23:17:25.202 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:17:25.202 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-11T23:17:25.297 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:17:25.297 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-11T23:17:25.392 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:17:25.393 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-11T23:17:25.430 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:17:25.430 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-11T23:17:25.507 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:17:25.507 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-11T23:17:25.542 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:17:25.542 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-11T23:17:25.617 INFO:tasks.ceph:Adding keys to all mons... 2024-09-11T23:17:25.617 DEBUG:teuthology.orchestra.run.smithi144:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T23:17:25.621 DEBUG:teuthology.orchestra.run.smithi165:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T23:17:25.670 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.y] 2024-09-11T23:17:25.670 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDdJOJmWZRNNBAAwZ2GCP7mGn87ZSnsKCcDRQ== 2024-09-11T23:17:25.670 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2024-09-11T23:17:25.670 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDeJOJmQjymBhAA4BWEVNGY37RsnMGLL3Ow8A== 2024-09-11T23:17:25.670 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2024-09-11T23:17:25.670 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDeJOJmDwSZEBAAdf4eF3MrADSPzBTICzpOiA== 2024-09-11T23:17:25.670 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.0] 2024-09-11T23:17:25.670 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDiJOJmzDABABAA+Qa772+Mm69pecG0QUXlyA== 2024-09-11T23:17:25.670 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.1] 2024-09-11T23:17:25.671 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDlJOJmgVjJKRAAtl30JxJHurKdrn1vLUneww== 2024-09-11T23:17:25.671 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.2] 2024-09-11T23:17:25.671 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDpJOJmRzO6FxAAiLDOwDlXYTj6WfEhlI+uVQ== 2024-09-11T23:17:25.671 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.3] 2024-09-11T23:17:25.671 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDtJOJmVFh6EhAA7hcJn4k31nEPMcqiB7+djA== 2024-09-11T23:17:25.671 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.x] 2024-09-11T23:17:25.671 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDdJOJmxMaVOxAA62zJwlyk0qdrsemalijH4Q== 2024-09-11T23:17:25.671 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2024-09-11T23:17:25.671 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDeJOJmD0mIGhAAvug7T/kOcEmnyMyG++V+zA== 2024-09-11T23:17:25.671 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d] 2024-09-11T23:17:25.671 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDeJOJmqYtRJBAAgpzvHNUPVnxNoflhqVIJuQ== 2024-09-11T23:17:25.671 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.4] 2024-09-11T23:17:25.672 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQD0JOJmpIFTAhAAYQyoBrMjL6CcDDCNAOMGwQ== 2024-09-11T23:17:25.672 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.5] 2024-09-11T23:17:25.672 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQD4JOJmBAIIDhAA8G/usUslfQPNpFP1YZsgmg== 2024-09-11T23:17:25.672 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.6] 2024-09-11T23:17:25.672 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQD8JOJmDl2dCBAA5bL+2AIp0uWL4qjpI/mAdQ== 2024-09-11T23:17:25.672 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.7] 2024-09-11T23:17:25.672 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQAAJeJmMWX+AhAA7ABVgJPwhRZNkPNdZzmnOQ== 2024-09-11T23:17:25.672 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-11T23:17:25.672 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A== 2024-09-11T23:17:25.672 INFO:teuthology.orchestra.run.smithi144.stdout:[client.2] 2024-09-11T23:17:25.672 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDeJOJm2/dLMxAAbuKdVAbscrlF5jcBnouBOQ== 2024-09-11T23:17:25.672 INFO:teuthology.orchestra.run.smithi144.stdout:[client.1] 2024-09-11T23:17:25.672 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDeJOJmLFrBORAAT64lj0sWlVoTHVUZQf0JjA== 2024-09-11T23:17:25.672 INFO:teuthology.orchestra.run.smithi144.stdout:[client.3] 2024-09-11T23:17:25.673 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDfJOJmse6UBBAAq+3afsp+2jApe9sTFmVVOw== 2024-09-11T23:17:25.709 INFO:teuthology.orchestra.run.smithi165.stdout:[mgr.y] 2024-09-11T23:17:25.709 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQDdJOJmWZRNNBAAwZ2GCP7mGn87ZSnsKCcDRQ== 2024-09-11T23:17:25.709 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.a] 2024-09-11T23:17:25.709 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQDeJOJmQjymBhAA4BWEVNGY37RsnMGLL3Ow8A== 2024-09-11T23:17:25.709 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.c] 2024-09-11T23:17:25.709 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQDeJOJmDwSZEBAAdf4eF3MrADSPzBTICzpOiA== 2024-09-11T23:17:25.709 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.0] 2024-09-11T23:17:25.709 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQDiJOJmzDABABAA+Qa772+Mm69pecG0QUXlyA== 2024-09-11T23:17:25.710 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.1] 2024-09-11T23:17:25.710 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQDlJOJmgVjJKRAAtl30JxJHurKdrn1vLUneww== 2024-09-11T23:17:25.710 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.2] 2024-09-11T23:17:25.710 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQDpJOJmRzO6FxAAiLDOwDlXYTj6WfEhlI+uVQ== 2024-09-11T23:17:25.710 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.3] 2024-09-11T23:17:25.710 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQDtJOJmVFh6EhAA7hcJn4k31nEPMcqiB7+djA== 2024-09-11T23:17:25.710 INFO:teuthology.orchestra.run.smithi165.stdout:[mgr.x] 2024-09-11T23:17:25.710 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQDdJOJmxMaVOxAA62zJwlyk0qdrsemalijH4Q== 2024-09-11T23:17:25.710 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.b] 2024-09-11T23:17:25.710 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQDeJOJmD0mIGhAAvug7T/kOcEmnyMyG++V+zA== 2024-09-11T23:17:25.710 INFO:teuthology.orchestra.run.smithi165.stdout:[mds.d] 2024-09-11T23:17:25.710 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQDeJOJmqYtRJBAAgpzvHNUPVnxNoflhqVIJuQ== 2024-09-11T23:17:25.710 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.4] 2024-09-11T23:17:25.710 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQD0JOJmpIFTAhAAYQyoBrMjL6CcDDCNAOMGwQ== 2024-09-11T23:17:25.711 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.5] 2024-09-11T23:17:25.711 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQD4JOJmBAIIDhAA8G/usUslfQPNpFP1YZsgmg== 2024-09-11T23:17:25.711 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.6] 2024-09-11T23:17:25.711 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQD8JOJmDl2dCBAA5bL+2AIp0uWL4qjpI/mAdQ== 2024-09-11T23:17:25.711 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.7] 2024-09-11T23:17:25.711 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQAAJeJmMWX+AhAA7ABVgJPwhRZNkPNdZzmnOQ== 2024-09-11T23:17:25.711 INFO:teuthology.orchestra.run.smithi165.stdout:[client.0] 2024-09-11T23:17:25.711 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A== 2024-09-11T23:17:25.711 INFO:teuthology.orchestra.run.smithi165.stdout:[client.2] 2024-09-11T23:17:25.711 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQDeJOJm2/dLMxAAbuKdVAbscrlF5jcBnouBOQ== 2024-09-11T23:17:25.711 INFO:teuthology.orchestra.run.smithi165.stdout:[client.1] 2024-09-11T23:17:25.711 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQDeJOJmLFrBORAAT64lj0sWlVoTHVUZQf0JjA== 2024-09-11T23:17:25.711 INFO:teuthology.orchestra.run.smithi165.stdout:[client.3] 2024-09-11T23:17:25.711 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQDfJOJmse6UBBAAq+3afsp+2jApe9sTFmVVOw== 2024-09-11T23:17:25.712 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T23:17:25.718 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T23:17:25.846 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T23:17:25.850 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T23:17:25.946 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T23:17:25.950 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T23:17:26.046 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:17:26.050 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:17:26.143 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:17:26.147 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:17:26.240 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:17:26.244 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:17:26.339 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:17:26.343 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:17:26.438 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T23:17:26.442 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T23:17:26.535 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T23:17:26.539 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T23:17:26.635 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T23:17:26.639 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T23:17:26.736 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:17:26.739 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:17:26.833 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:17:26.837 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:17:26.931 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:17:26.934 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:17:27.027 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:17:27.031 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T23:17:27.126 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T23:17:27.129 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T23:17:27.226 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T23:17:27.230 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T23:17:27.327 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T23:17:27.331 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T23:17:27.428 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T23:17:27.432 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T23:17:27.528 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-11T23:17:27.528 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-11T23:17:27.583 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T23:17:27.690 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-11T23:17:27.746 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-11T23:17:27.802 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T23:17:27.910 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-11T23:17:27.966 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-11T23:17:28.021 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T23:17:28.127 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-11T23:17:28.182 DEBUG:teuthology.orchestra.run.smithi144:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:17:28.186 DEBUG:teuthology.orchestra.run.smithi165:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T23:17:28.221 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-11T23:17:28.221 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T23:17:28.221 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T23:17:28.262 INFO:tasks.ceph.mon.a:Started 2024-09-11T23:17:28.262 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-11T23:17:28.262 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-11T23:17:28.266 INFO:tasks.ceph.mon.b:Started 2024-09-11T23:17:28.266 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-11T23:17:28.266 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-11T23:17:28.269 INFO:tasks.ceph.mon.c:Started 2024-09-11T23:17:28.270 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-11T23:17:28.270 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-11T23:17:28.270 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-11T23:17:28.274 INFO:tasks.ceph.mgr.y:Started 2024-09-11T23:17:28.274 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-11T23:17:28.274 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-11T23:17:28.278 INFO:tasks.ceph.mgr.x:Started 2024-09-11T23:17:28.278 INFO:tasks.ceph:Setting crush tunables to default 2024-09-11T23:17:28.278 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd crush tunables default 2024-09-11T23:17:28.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:28.432+0000 7fb3c2400640 1 Processor -- start 2024-09-11T23:17:28.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:28.432+0000 7fb3c2400640 1 -- start start 2024-09-11T23:17:28.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:28.433+0000 7fb3c2400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 0x7fb3bc0cf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:28.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:28.433+0000 7fb3c2400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3bc0d3400 con 0x7fb3bc0cf990 2024-09-11T23:17:28.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:28.433+0000 7fb3c2400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3bc0d3670 con 0x7fb3bc0d1540 2024-09-11T23:17:28.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:28.433+0000 7fb3c2400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb3bc15ea50 con 0x7fb3bc15e670 2024-09-11T23:17:28.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:28.433+0000 7fb3bbe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb3bc0cf990 0x7fb3bc0d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57802/0 (socket says 172.21.15.144:57802) 2024-09-11T23:17:28.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:28.433+0000 7fb3bbe00640 1 -- 172.21.15.144:0/257712146 learned_addr learned my addr 172.21.15.144:0/257712146 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:17:28.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:28.433+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 0x7fb3bc0cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:28.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:28.434+0000 7fb3c1000640 1 -- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 msgr2=0x7fb3bc0cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T23:17:28.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:28.434+0000 7fb3c1000640 1 -- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 msgr2=0x7fb3bc0cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T23:17:28.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:28.434+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 0x7fb3bc0cf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:17:28.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:28.434+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 0x7fb3bc0cf450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:17:28.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:28.635+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 0x7fb3bc0cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:28.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:28.635+0000 7fb3c1000640 1 -- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 msgr2=0x7fb3bc0cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T23:17:28.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:28.635+0000 7fb3c1000640 1 -- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 msgr2=0x7fb3bc0cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T23:17:28.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:28.635+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 0x7fb3bc0cf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:17:28.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:28.635+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 0x7fb3bc0cf450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:17:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:29.036+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 0x7fb3bc0cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:29.036+0000 7fb3c1000640 1 -- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 msgr2=0x7fb3bc0cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T23:17:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:29.036+0000 7fb3c1000640 1 -- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 msgr2=0x7fb3bc0cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T23:17:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:29.036+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 0x7fb3bc0cf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:17:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:29.036+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 0x7fb3bc0cf450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T23:17:29.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:29.838+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 0x7fb3bc0cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:29.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:29.838+0000 7fb3c1000640 1 -- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 msgr2=0x7fb3bc0cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T23:17:29.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:29.838+0000 7fb3c1000640 1 -- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 msgr2=0x7fb3bc0cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T23:17:29.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:29.838+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 0x7fb3bc0cf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:17:29.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:29.838+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 0x7fb3bc0cf450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T23:17:31.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.433+0000 7fb3ba000640 1 -- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 msgr2=0x7fb3bc0cf450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T23:17:31.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.433+0000 7fb3ba000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 0x7fb3bc0cf450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:31.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.433+0000 7fb3ba000640 1 -- 172.21.15.144:0/257712146 >> v1:172.21.15.165:6789/0 conn(0x7fb3bc0d1540 legacy=0x7fb3bc0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:31.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.433+0000 7fb3ba000640 1 -- 172.21.15.144:0/257712146 >> v1:172.21.15.144:6789/0 conn(0x7fb3bc0cf990 legacy=0x7fb3bc0d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:31.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.433+0000 7fb3ba000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 0x7fb39c005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:31.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.433+0000 7fb3ba000640 1 --2- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 0x7fb39c008620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:31.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.433+0000 7fb3ba000640 1 -- 172.21.15.144:0/257712146 --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb39c008d10 con 0x7fb39c0036c0 2024-09-11T23:17:31.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.433+0000 7fb3ba000640 1 -- 172.21.15.144:0/257712146 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb39c008ec0 con 0x7fb39c006180 2024-09-11T23:17:31.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.434+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 0x7fb39c005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:31.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.434+0000 7fb3c1000640 1 -- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 msgr2=0x7fb39c005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T23:17:31.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.434+0000 7fb3c1000640 1 -- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 msgr2=0x7fb39c005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T23:17:31.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.434+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 0x7fb39c005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:17:31.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.434+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 0x7fb39c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:17:31.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.434+0000 7fb3bbe00640 1 --2- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 0x7fb39c008620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:31.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.434+0000 7fb3bbe00640 1 -- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 msgr2=0x7fb39c008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T23:17:31.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.434+0000 7fb3bbe00640 1 -- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 msgr2=0x7fb39c008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T23:17:31.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.434+0000 7fb3bbe00640 1 --2- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 0x7fb39c008620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:17:31.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.434+0000 7fb3bbe00640 1 --2- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 0x7fb39c008620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T23:17:31.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.635+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 0x7fb39c005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:31.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.635+0000 7fb3c1000640 1 -- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 msgr2=0x7fb39c005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T23:17:31.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.635+0000 7fb3c1000640 1 -- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 msgr2=0x7fb39c005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T23:17:31.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.635+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 0x7fb39c005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:17:31.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.635+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 0x7fb39c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:17:31.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.635+0000 7fb3bbe00640 1 --2- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 0x7fb39c008620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:31.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.635+0000 7fb3bbe00640 1 -- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 msgr2=0x7fb39c008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T23:17:31.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.635+0000 7fb3bbe00640 1 -- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 msgr2=0x7fb39c008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T23:17:31.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.635+0000 7fb3bbe00640 1 --2- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 0x7fb39c008620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:17:31.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:31.635+0000 7fb3bbe00640 1 --2- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 0x7fb39c008620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T23:17:32.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:32.036+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 0x7fb39c005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:32.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:32.036+0000 7fb3c1000640 1 -- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 msgr2=0x7fb39c005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T23:17:32.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:32.036+0000 7fb3c1000640 1 -- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 msgr2=0x7fb39c005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T23:17:32.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:32.036+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 0x7fb39c005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:17:32.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:32.036+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 0x7fb39c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T23:17:32.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:32.037+0000 7fb3bbe00640 1 --2- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 0x7fb39c008620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:32.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:32.037+0000 7fb3bbe00640 1 -- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 msgr2=0x7fb39c008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T23:17:32.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:32.037+0000 7fb3bbe00640 1 -- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 msgr2=0x7fb39c008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T23:17:32.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:32.037+0000 7fb3bbe00640 1 --2- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 0x7fb39c008620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:17:32.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:32.037+0000 7fb3bbe00640 1 --2- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 0x7fb39c008620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T23:17:32.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:32.838+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 0x7fb39c005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:32.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:32.838+0000 7fb3c1000640 1 -- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 msgr2=0x7fb39c005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T23:17:32.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:32.838+0000 7fb3c1000640 1 -- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 msgr2=0x7fb39c005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T23:17:32.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:32.838+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 0x7fb39c005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:17:32.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:32.838+0000 7fb3c1000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 0x7fb39c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T23:17:32.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:32.838+0000 7fb3bbe00640 1 --2- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 0x7fb39c008620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:32.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:32.838+0000 7fb3bbe00640 1 -- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 msgr2=0x7fb39c008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T23:17:32.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:32.838+0000 7fb3bbe00640 1 -- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 msgr2=0x7fb39c008620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T23:17:32.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:32.838+0000 7fb3bbe00640 1 --2- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 0x7fb39c008620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T23:17:32.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:32.838+0000 7fb3bbe00640 1 --2- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 0x7fb39c008620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T23:17:34.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.434+0000 7fb3ba000640 1 -- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 msgr2=0x7fb39c008620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T23:17:34.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.434+0000 7fb3ba000640 1 --2- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb39c006180 0x7fb39c008620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.434+0000 7fb3ba000640 1 -- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 msgr2=0x7fb39c005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T23:17:34.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.434+0000 7fb3ba000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.144:3300/0 conn(0x7fb39c0036c0 0x7fb39c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.434+0000 7fb3c1a00640 1 -- 172.21.15.144:0/257712146 reap_dead start 2024-09-11T23:17:34.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.434+0000 7fb3ba000640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 0x7fb39c00eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:34.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.434+0000 7fb3ba000640 1 -- 172.21.15.144:0/257712146 --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3bc0d3950 con 0x7fb3bc0cf990 2024-09-11T23:17:34.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.434+0000 7fb3ba000640 1 -- 172.21.15.144:0/257712146 --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb39c004b60 con 0x7fb3bc0d1540 2024-09-11T23:17:34.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.434+0000 7fb3ba000640 1 -- 172.21.15.144:0/257712146 --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb39c008d10 con 0x7fb3bc15e670 2024-09-11T23:17:34.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.434+0000 7fb3bbe00640 1 --2- 172.21.15.144:0/257712146 >> v2:172.21.15.165:3300/0 conn(0x7fb3bc15e670 0x7fb39c00eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:34.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.434+0000 7fb3bb400640 1 -- 172.21.15.144:0/257712146 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2836916421 0 0) 0x7fb3bc0d3950 con 0x7fb3bc0cf990 2024-09-11T23:17:34.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.435+0000 7fb3bb400640 1 -- 172.21.15.144:0/257712146 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3a4003520 con 0x7fb3bc0cf990 2024-09-11T23:17:34.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.435+0000 7fb3bbe00640 1 -- 172.21.15.144:0/257712146 >> v1:172.21.15.165:6789/0 conn(0x7fb3bc0d1540 legacy=0x7fb39c011030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:34.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.435+0000 7fb3bbe00640 1 -- 172.21.15.144:0/257712146 >> v1:172.21.15.144:6789/0 conn(0x7fb3bc0cf990 legacy=0x7fb39c00b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:34.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.435+0000 7fb3bbe00640 1 -- 172.21.15.144:0/257712146 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb39c005d40 con 0x7fb3bc15e670 2024-09-11T23:17:34.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.436+0000 7fb3bbe00640 1 --2- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb3bc15e670 0x7fb39c00eaa0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8007d20 tx=0x7fb3a802add0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0cb27d6101fcefd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:34.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.436+0000 7fb3bb400640 1 -- 172.21.15.144:0/257712146 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8031070 con 0x7fb3bc15e670 2024-09-11T23:17:34.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.436+0000 7fb3bb400640 1 -- 172.21.15.144:0/257712146 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a802b8f0 con 0x7fb3bc15e670 2024-09-11T23:17:34.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.436+0000 7fb3bb400640 1 -- 172.21.15.144:0/257712146 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a802bce0 con 0x7fb3bc15e670 2024-09-11T23:17:34.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.437+0000 7fb3c2400640 1 -- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb3bc15e670 msgr2=0x7fb39c00eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:34.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.437+0000 7fb3c2400640 1 --2- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb3bc15e670 0x7fb39c00eaa0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8007d20 tx=0x7fb3a802add0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.437+0000 7fb3c2400640 1 -- 172.21.15.144:0/257712146 shutdown_connections 2024-09-11T23:17:34.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.437+0000 7fb3c2400640 1 --2- 172.21.15.144:0/257712146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb3bc15e670 0x7fb39c00eaa0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.437+0000 7fb3c2400640 1 -- 172.21.15.144:0/257712146 >> 172.21.15.144:0/257712146 conn(0x7fb3bc0b6290 msgr2=0x7fb3bc0b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:34.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.437+0000 7fb3c2400640 1 -- 172.21.15.144:0/257712146 shutdown_connections 2024-09-11T23:17:34.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.437+0000 7fb3c2400640 1 -- 172.21.15.144:0/257712146 wait complete. 2024-09-11T23:17:34.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.439+0000 7fb3c2400640 1 Processor -- start 2024-09-11T23:17:34.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.440+0000 7fb3c2400640 1 -- start start 2024-09-11T23:17:34.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.441+0000 7fb3c2400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3bc0cf990 0x7fb3bc1f4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:34.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.441+0000 7fb3c2400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb3bc0d1540 0x7fb3bc0cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:34.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.441+0000 7fb3c2400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb3bc15e670 0x7fb3bc0ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:34.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.441+0000 7fb3c2400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc0cf450 con 0x7fb3bc0cf990 2024-09-11T23:17:34.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.441+0000 7fb3c2400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc0d2380 con 0x7fb3bc15e670 2024-09-11T23:17:34.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.441+0000 7fb3c2400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb3bc0cf5d0 con 0x7fb3bc0d1540 2024-09-11T23:17:34.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.441+0000 7fb3c1000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3bc0cf990 0x7fb3bc1f4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:34.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.441+0000 7fb3c1000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3bc0cf990 0x7fb3bc1f4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35012/0 (socket says 172.21.15.144:35012) 2024-09-11T23:17:34.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.441+0000 7fb3c1000640 1 -- 172.21.15.144:0/2912628050 learned_addr learned my addr 172.21.15.144:0/2912628050 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:17:34.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.441+0000 7fb3bbe00640 1 --2- 172.21.15.144:0/2912628050 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb3bc0d1540 0x7fb3bc0cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:34.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.441+0000 7fb3c1a00640 1 --2- 172.21.15.144:0/2912628050 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb3bc15e670 0x7fb3bc0ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:34.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.441+0000 7fb3c1000640 1 -- 172.21.15.144:0/2912628050 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb3bc0d1540 msgr2=0x7fb3bc0cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:34.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.441+0000 7fb3c1000640 1 --2- 172.21.15.144:0/2912628050 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb3bc0d1540 0x7fb3bc0cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.441+0000 7fb3c1000640 1 -- 172.21.15.144:0/2912628050 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb3bc15e670 msgr2=0x7fb3bc0ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:34.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.441+0000 7fb3c1000640 1 --2- 172.21.15.144:0/2912628050 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb3bc15e670 0x7fb3bc0ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.441+0000 7fb3c1000640 1 -- 172.21.15.144:0/2912628050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3bc1f4d70 con 0x7fb3bc0cf990 2024-09-11T23:17:34.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.442+0000 7fb3c1000640 1 --2- 172.21.15.144:0/2912628050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3bc0cf990 0x7fb3bc1f4830 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0017a30 tx=0x7fb3b0017ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:34.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.442+0000 7fb3b8c00640 1 -- 172.21.15.144:0/2912628050 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0028070 con 0x7fb3bc0cf990 2024-09-11T23:17:34.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.442+0000 7fb3b8c00640 1 -- 172.21.15.144:0/2912628050 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b0016c80 con 0x7fb3bc0cf990 2024-09-11T23:17:34.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.442+0000 7fb3b8c00640 1 -- 172.21.15.144:0/2912628050 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0023470 con 0x7fb3bc0cf990 2024-09-11T23:17:34.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.442+0000 7fb3c2400640 1 -- 172.21.15.144:0/2912628050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3bc161ae0 con 0x7fb3bc0cf990 2024-09-11T23:17:34.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.442+0000 7fb3c2400640 1 -- 172.21.15.144:0/2912628050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3bc160a90 con 0x7fb3bc0cf990 2024-09-11T23:17:34.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.443+0000 7fb3b8c00640 1 -- 172.21.15.144:0/2912628050 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb3b002b070 con 0x7fb3bc0cf990 2024-09-11T23:17:34.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.443+0000 7fb3b8c00640 1 -- 172.21.15.144:0/2912628050 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb3b002d960 con 0x7fb3bc0cf990 2024-09-11T23:17:34.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.444+0000 7fb3c2400640 1 -- 172.21.15.144:0/2912628050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3bc0d0e30 con 0x7fb3bc0cf990 2024-09-11T23:17:34.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.447+0000 7fb3b8c00640 1 -- 172.21.15.144:0/2912628050 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb3bc1f4d70 con 0x7fb3bc0cf990 2024-09-11T23:17:34.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.515+0000 7fb3c2400640 1 -- 172.21.15.144:0/2912628050 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fb3bc160d70 con 0x7fb3bc0cf990 2024-09-11T23:17:34.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.517+0000 7fb3b8c00640 1 -- 172.21.15.144:0/2912628050 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fb3b002db60 con 0x7fb3bc0cf990 2024-09-11T23:17:34.517 INFO:teuthology.orchestra.run.smithi144.stderr:adjusted tunables profile to default 2024-09-11T23:17:34.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.519+0000 7fb3c2400640 1 -- 172.21.15.144:0/2912628050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3bc0cf990 msgr2=0x7fb3bc1f4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:34.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.519+0000 7fb3c2400640 1 --2- 172.21.15.144:0/2912628050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3bc0cf990 0x7fb3bc1f4830 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0017a30 tx=0x7fb3b0017ef0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.519+0000 7fb3c2400640 1 -- 172.21.15.144:0/2912628050 shutdown_connections 2024-09-11T23:17:34.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.519+0000 7fb3c2400640 1 --2- 172.21.15.144:0/2912628050 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb3bc15e670 0x7fb3bc0ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.519+0000 7fb3c2400640 1 --2- 172.21.15.144:0/2912628050 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb3bc0d1540 0x7fb3bc0cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.519+0000 7fb3c2400640 1 --2- 172.21.15.144:0/2912628050 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3bc0cf990 0x7fb3bc1f4830 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:34.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.519+0000 7fb3c2400640 1 -- 172.21.15.144:0/2912628050 >> 172.21.15.144:0/2912628050 conn(0x7fb3bc0b6290 msgr2=0x7fb3bc0b8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:34.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.519+0000 7fb3c2400640 1 -- 172.21.15.144:0/2912628050 shutdown_connections 2024-09-11T23:17:34.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:34.519+0000 7fb3c2400640 1 -- 172.21.15.144:0/2912628050 wait complete. 2024-09-11T23:17:34.535 INFO:tasks.ceph:check_enable_crimson: False 2024-09-11T23:17:34.535 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-11T23:17:34.536 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:17:34.536 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-11T23:17:34.542 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:34.542+0000 7f316911e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:17:34.546 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:34.546+0000 7f9cf400d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:17:34.592 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:34.591+0000 7f316911e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:17:34.597 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:17:34.597 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-11T23:17:34.599 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:34.600+0000 7f9cf400d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:17:34.656 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:17:34.656 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-11T23:17:34.754 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:17:34.754 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-11T23:17:34.769 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:34.768+0000 7f316911e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:17:34.785 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:34.785+0000 7f9cf400d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:17:34.826 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:34.827+0000 7f316911e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:17:34.843 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:17:34.844 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-11T23:17:34.849 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:34.849+0000 7f9cf400d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:17:34.899 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:17:34.900 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-11T23:17:34.996 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:17:34.996 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-11T23:17:35.019 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:35.020+0000 7f316911e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:17:35.039 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:35.039+0000 7f9cf400d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:17:35.075 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:17:35.075 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-11T23:17:35.152 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:35.153+0000 7f316911e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:17:35.164 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:35.164+0000 7f9cf400d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:17:35.171 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 8ee6a263-c32c-4b26-ba89-8abbe15e6dfa 0 2024-09-11T23:17:35.361 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.361+0000 7f358ce00640 1 Processor -- start 2024-09-11T23:17:35.361 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.362+0000 7f358ce00640 1 -- start start 2024-09-11T23:17:35.363 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.363+0000 7f358ce00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f35880cfb60 0x7f35880d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.364+0000 7f358ce00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f35880d1370 0x7f35880b7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.364+0000 7f358ce00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35880d3400 con 0x7f358815e670 2024-09-11T23:17:35.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.364+0000 7f358ce00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f358815ea50 con 0x7f35880d1370 2024-09-11T23:17:35.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.364+0000 7f358ce00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f35880d3670 con 0x7f35880cfb60 2024-09-11T23:17:35.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.364+0000 7f3586a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f35880cfb60 0x7f35880d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.364+0000 7f3586a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f35880cfb60 0x7f35880d0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:39472/0 (socket says 172.21.15.165:39472) 2024-09-11T23:17:35.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.364+0000 7f3586a00640 1 -- 172.21.15.165:0/2470062676 learned_addr learned my addr 172.21.15.165:0/2470062676 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-11T23:17:35.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.364+0000 7f3587e00640 1 --2- 172.21.15.165:0/2470062676 >> v2:172.21.15.144:3300/0 conn(0x7f35880d1370 0x7f35880b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.364+0000 7f3586a00640 1 -- 172.21.15.165:0/2470062676 >> v2:172.21.15.144:3300/0 conn(0x7f35880d1370 msgr2=0x7f35880b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:35.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.364+0000 7f3586a00640 1 --2- 172.21.15.165:0/2470062676 >> v2:172.21.15.144:3300/0 conn(0x7f35880d1370 0x7f35880b7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.364 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.364+0000 7f3586a00640 1 -- 172.21.15.165:0/2470062676 >> v1:172.21.15.165:6789/0 conn(0x7f358815e670 legacy=0x7f35880cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.365 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.364+0000 7f3586a00640 1 -- 172.21.15.165:0/2470062676 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35880d17b0 con 0x7f35880cfb60 2024-09-11T23:17:35.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.365+0000 7f3586a00640 1 --2- 172.21.15.165:0/2470062676 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35880cfb60 0x7f35880d0e30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f35880c7eb0 tx=0x7f357402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8488767f24179133 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.365+0000 7f3586000640 1 -- 172.21.15.165:0/2470062676 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3574037070 con 0x7f35880cfb60 2024-09-11T23:17:35.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.366+0000 7f3586000640 1 -- 172.21.15.165:0/2470062676 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3574032440 con 0x7f35880cfb60 2024-09-11T23:17:35.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.366+0000 7f3586000640 1 -- 172.21.15.165:0/2470062676 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3574032810 con 0x7f35880cfb60 2024-09-11T23:17:35.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.366+0000 7f358ce00640 1 -- 172.21.15.165:0/2470062676 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35880cfb60 msgr2=0x7f35880d0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.366+0000 7f358ce00640 1 --2- 172.21.15.165:0/2470062676 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35880cfb60 0x7f35880d0e30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f35880c7eb0 tx=0x7f357402a270 comp rx=0 tx=0).stop 2024-09-11T23:17:35.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.366+0000 7f358ce00640 1 -- 172.21.15.165:0/2470062676 shutdown_connections 2024-09-11T23:17:35.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.366+0000 7f358ce00640 1 --2- 172.21.15.165:0/2470062676 >> v2:172.21.15.144:3300/0 conn(0x7f35880d1370 0x7f35880b7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.366 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.366+0000 7f358ce00640 1 --2- 172.21.15.165:0/2470062676 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35880cfb60 0x7f35880d0e30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.366+0000 7f358ce00640 1 -- 172.21.15.165:0/2470062676 >> 172.21.15.165:0/2470062676 conn(0x7f35880b6290 msgr2=0x7f35880b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:35.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.366+0000 7f358ce00640 1 -- 172.21.15.165:0/2470062676 shutdown_connections 2024-09-11T23:17:35.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.366+0000 7f358ce00640 1 -- 172.21.15.165:0/2470062676 wait complete. 2024-09-11T23:17:35.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.368+0000 7f358ce00640 1 Processor -- start 2024-09-11T23:17:35.367 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.368+0000 7f358ce00640 1 -- start start 2024-09-11T23:17:35.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.369+0000 7f358ce00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35880cfb60 0x7f35880caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.369+0000 7f358ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35880d1370 0x7f35881e6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.369+0000 7f358ce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f358815e670 0x7f3588158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.369+0000 7f358ce00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f35880d2380 con 0x7f35880d1370 2024-09-11T23:17:35.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.369+0000 7f358ce00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f35880d3c30 con 0x7f35880cfb60 2024-09-11T23:17:35.369 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.369+0000 7f358ce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f35880b7c60 con 0x7f358815e670 2024-09-11T23:17:35.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.369+0000 7f3587400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35880cfb60 0x7f35880caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.369+0000 7f3587e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f358815e670 0x7f3588158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.369+0000 7f3587400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35880cfb60 0x7f35880caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:39482/0 (socket says 172.21.15.165:39482) 2024-09-11T23:17:35.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.369+0000 7f3587400640 1 -- 172.21.15.165:0/3928278938 learned_addr learned my addr 172.21.15.165:0/3928278938 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-11T23:17:35.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.369+0000 7f3586a00640 1 --2- 172.21.15.165:0/3928278938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35880d1370 0x7f35881e6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.370+0000 7f3587400640 1 -- 172.21.15.165:0/3928278938 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f358815e670 msgr2=0x7f3588158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.370+0000 7f3587400640 1 --2- 172.21.15.165:0/3928278938 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f358815e670 0x7f3588158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.370+0000 7f3587400640 1 -- 172.21.15.165:0/3928278938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35880d1370 msgr2=0x7f35881e6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.370+0000 7f3587400640 1 --2- 172.21.15.165:0/3928278938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35880d1370 0x7f35881e6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.370+0000 7f3587400640 1 -- 172.21.15.165:0/3928278938 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35881e7780 con 0x7f35880cfb60 2024-09-11T23:17:35.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.370+0000 7f3587400640 1 --2- 172.21.15.165:0/3928278938 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35880cfb60 0x7f35880caca0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f357800c3c0 tx=0x7f357800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.370+0000 7f357f400640 1 -- 172.21.15.165:0/3928278938 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35780052d0 con 0x7f35880cfb60 2024-09-11T23:17:35.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.370+0000 7f357f400640 1 -- 172.21.15.165:0/3928278938 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3578005490 con 0x7f35880cfb60 2024-09-11T23:17:35.371 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.370+0000 7f358ce00640 1 -- 172.21.15.165:0/3928278938 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35881e7a60 con 0x7f35880cfb60 2024-09-11T23:17:35.372 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.370+0000 7f357f400640 1 -- 172.21.15.165:0/3928278938 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578007260 con 0x7f35880cfb60 2024-09-11T23:17:35.372 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.371+0000 7f358ce00640 1 -- 172.21.15.165:0/3928278938 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35881e8020 con 0x7f35880cfb60 2024-09-11T23:17:35.372 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.371+0000 7f357f400640 1 -- 172.21.15.165:0/3928278938 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3578007400 con 0x7f35880cfb60 2024-09-11T23:17:35.372 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.371+0000 7f357f400640 1 -- 172.21.15.165:0/3928278938 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f3578003a90 con 0x7f35880cfb60 2024-09-11T23:17:35.372 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.372+0000 7f358ce00640 1 -- 172.21.15.165:0/3928278938 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35880d0e30 con 0x7f35880cfb60 2024-09-11T23:17:35.374 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.374+0000 7f357f400640 1 -- 172.21.15.165:0/3928278938 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f35780035f0 con 0x7f35880cfb60 2024-09-11T23:17:35.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.446+0000 7f358ce00640 1 -- 172.21.15.165:0/3928278938 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8ee6a263-c32c-4b26-ba89-8abbe15e6dfa", "id": 0} v 0) -- 0x7f35880b5ac0 con 0x7f35880cfb60 2024-09-11T23:17:35.452 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.453+0000 7f357f400640 1 -- 172.21.15.165:0/3928278938 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8ee6a263-c32c-4b26-ba89-8abbe15e6dfa", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f3578003c90 con 0x7f35880cfb60 2024-09-11T23:17:35.452 INFO:teuthology.orchestra.run.smithi165.stdout:0 2024-09-11T23:17:35.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.454+0000 7f358ce00640 1 -- 172.21.15.165:0/3928278938 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35880cfb60 msgr2=0x7f35880caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.454+0000 7f358ce00640 1 --2- 172.21.15.165:0/3928278938 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35880cfb60 0x7f35880caca0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f357800c3c0 tx=0x7f357800c880 comp rx=0 tx=0).stop 2024-09-11T23:17:35.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.454+0000 7f358ce00640 1 -- 172.21.15.165:0/3928278938 shutdown_connections 2024-09-11T23:17:35.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.454+0000 7f358ce00640 1 --2- 172.21.15.165:0/3928278938 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f358815e670 0x7f3588158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.454+0000 7f358ce00640 1 --2- 172.21.15.165:0/3928278938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35880d1370 0x7f35881e6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.454+0000 7f358ce00640 1 --2- 172.21.15.165:0/3928278938 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35880cfb60 0x7f35880caca0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.454+0000 7f358ce00640 1 -- 172.21.15.165:0/3928278938 >> 172.21.15.165:0/3928278938 conn(0x7f35880b6290 msgr2=0x7f358815bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:35.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.454+0000 7f358ce00640 1 -- 172.21.15.165:0/3928278938 shutdown_connections 2024-09-11T23:17:35.456 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.454+0000 7f358ce00640 1 -- 172.21.15.165:0/3928278938 wait complete. 2024-09-11T23:17:35.468 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6 1 2024-09-11T23:17:35.533 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:35.533+0000 7f9cf400d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:17:35.548 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:35.548+0000 7f316911e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:17:35.595 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:35.595+0000 7f9cf400d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:17:35.613 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:35.613+0000 7f316911e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:17:35.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.620+0000 7f3618e00640 1 Processor -- start 2024-09-11T23:17:35.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.620+0000 7f3618e00640 1 -- start start 2024-09-11T23:17:35.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.621+0000 7f3618e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36140d1c20 0x7f36141628b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.621+0000 7f3618e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f361406d700 0x7f361406dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.621+0000 7f3618e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36140b5440 con 0x7f361415e510 2024-09-11T23:17:35.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.621+0000 7f3618e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f361406ccb0 con 0x7f361406d700 2024-09-11T23:17:35.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.621+0000 7f3618e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f36140b5720 con 0x7f36140d1c20 2024-09-11T23:17:35.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.621+0000 7f3612a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36140d1c20 0x7f36141628b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.621+0000 7f3612a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36140d1c20 0x7f36141628b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:53506/0 (socket says 172.21.15.165:53506) 2024-09-11T23:17:35.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.621+0000 7f3612a00640 1 -- 172.21.15.165:0/631746138 learned_addr learned my addr 172.21.15.165:0/631746138 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-11T23:17:35.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.621+0000 7f3613e00640 1 --2- 172.21.15.165:0/631746138 >> v2:172.21.15.144:3300/0 conn(0x7f361406d700 0x7f361406dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.621 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.622+0000 7f3612a00640 1 -- 172.21.15.165:0/631746138 >> v2:172.21.15.144:3300/0 conn(0x7f361406d700 msgr2=0x7f361406dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:35.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.622+0000 7f3612a00640 1 --2- 172.21.15.165:0/631746138 >> v2:172.21.15.144:3300/0 conn(0x7f361406d700 0x7f361406dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.622+0000 7f3612a00640 1 -- 172.21.15.165:0/631746138 >> v1:172.21.15.144:6789/0 conn(0x7f361415e510 legacy=0x7f36141621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.622 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.622+0000 7f3612a00640 1 -- 172.21.15.165:0/631746138 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36140b5a00 con 0x7f36140d1c20 2024-09-11T23:17:35.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.622+0000 7f3612a00640 1 --2- 172.21.15.165:0/631746138 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36140d1c20 0x7f36141628b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3600009870 tx=0x7f360002a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b648baa06888dc10 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.623+0000 7f3612000640 1 -- 172.21.15.165:0/631746138 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600037070 con 0x7f36140d1c20 2024-09-11T23:17:35.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.623+0000 7f3612000640 1 -- 172.21.15.165:0/631746138 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f360002ae50 con 0x7f36140d1c20 2024-09-11T23:17:35.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.623+0000 7f3612000640 1 -- 172.21.15.165:0/631746138 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600032860 con 0x7f36140d1c20 2024-09-11T23:17:35.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.623+0000 7f3618e00640 1 -- 172.21.15.165:0/631746138 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36140d1c20 msgr2=0x7f36141628b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.623+0000 7f3618e00640 1 --2- 172.21.15.165:0/631746138 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36140d1c20 0x7f36141628b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3600009870 tx=0x7f360002a300 comp rx=0 tx=0).stop 2024-09-11T23:17:35.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.623+0000 7f3618e00640 1 -- 172.21.15.165:0/631746138 shutdown_connections 2024-09-11T23:17:35.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.623+0000 7f3618e00640 1 --2- 172.21.15.165:0/631746138 >> v2:172.21.15.144:3300/0 conn(0x7f361406d700 0x7f361406dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.623+0000 7f3618e00640 1 --2- 172.21.15.165:0/631746138 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36140d1c20 0x7f36141628b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.623 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.623+0000 7f3618e00640 1 -- 172.21.15.165:0/631746138 >> 172.21.15.165:0/631746138 conn(0x7f361406f260 msgr2=0x7f361406f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:35.624 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.623+0000 7f3618e00640 1 -- 172.21.15.165:0/631746138 shutdown_connections 2024-09-11T23:17:35.624 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.624+0000 7f3618e00640 1 -- 172.21.15.165:0/631746138 wait complete. 2024-09-11T23:17:35.625 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.625+0000 7f3618e00640 1 Processor -- start 2024-09-11T23:17:35.625 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.625+0000 7f3618e00640 1 -- start start 2024-09-11T23:17:35.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.626+0000 7f3618e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f361406d700 0x7f36141f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.626+0000 7f3618e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36140d1c20 0x7f3614154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.626+0000 7f3618e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f361415e510 0x7f36140cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.626+0000 7f3618e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f361415e8f0 con 0x7f361415e510 2024-09-11T23:17:35.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.626+0000 7f3618e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f361406d1e0 con 0x7f36140d1c20 2024-09-11T23:17:35.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.626+0000 7f3618e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f361415ea70 con 0x7f361406d700 2024-09-11T23:17:35.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.626+0000 7f3613400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f361406d700 0x7f36141f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.626+0000 7f3612a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36140d1c20 0x7f3614154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.627 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.627+0000 7f3612a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36140d1c20 0x7f3614154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:39486/0 (socket says 172.21.15.165:39486) 2024-09-11T23:17:35.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.627+0000 7f3613400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f361406d700 0x7f36141f54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:53516/0 (socket says 172.21.15.165:53516) 2024-09-11T23:17:35.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.627+0000 7f3612a00640 1 -- 172.21.15.165:0/3350394852 learned_addr learned my addr 172.21.15.165:0/3350394852 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-11T23:17:35.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.627+0000 7f3613e00640 1 --2- 172.21.15.165:0/3350394852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f361415e510 0x7f36140cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.627+0000 7f3613400640 1 -- 172.21.15.165:0/3350394852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36140d1c20 msgr2=0x7f3614154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.627+0000 7f3613400640 1 --2- 172.21.15.165:0/3350394852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36140d1c20 0x7f3614154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.627+0000 7f3613400640 1 -- 172.21.15.165:0/3350394852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f361415e510 msgr2=0x7f36140cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.627+0000 7f3613400640 1 --2- 172.21.15.165:0/3350394852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f361415e510 0x7f36140cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.627+0000 7f3613400640 1 -- 172.21.15.165:0/3350394852 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36141f4870 con 0x7f361406d700 2024-09-11T23:17:35.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.627+0000 7f3613400640 1 --2- 172.21.15.165:0/3350394852 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f361406d700 0x7f36141f54e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f360400c3c0 tx=0x7f360400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.627+0000 7f360b400640 1 -- 172.21.15.165:0/3350394852 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36040052d0 con 0x7f361406d700 2024-09-11T23:17:35.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.627+0000 7f360b400640 1 -- 172.21.15.165:0/3350394852 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3604005490 con 0x7f361406d700 2024-09-11T23:17:35.628 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.627+0000 7f360b400640 1 -- 172.21.15.165:0/3350394852 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3604007260 con 0x7f361406d700 2024-09-11T23:17:35.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.628+0000 7f3618e00640 1 -- 172.21.15.165:0/3350394852 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36141f4b50 con 0x7f361406d700 2024-09-11T23:17:35.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.628+0000 7f3618e00640 1 -- 172.21.15.165:0/3350394852 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f36141f5110 con 0x7f361406d700 2024-09-11T23:17:35.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.628+0000 7f360b400640 1 -- 172.21.15.165:0/3350394852 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3604007400 con 0x7f361406d700 2024-09-11T23:17:35.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.628+0000 7f360b400640 1 -- 172.21.15.165:0/3350394852 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f3604003b20 con 0x7f361406d700 2024-09-11T23:17:35.629 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.629+0000 7f3618e00640 1 -- 172.21.15.165:0/3350394852 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36141586a0 con 0x7f361406d700 2024-09-11T23:17:35.631 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.631+0000 7f360b400640 1 -- 172.21.15.165:0/3350394852 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3604003d70 con 0x7f361406d700 2024-09-11T23:17:35.704 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.705+0000 7f3618e00640 1 -- 172.21.15.165:0/3350394852 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6", "id": 1} v 0) -- 0x7f36141621a0 con 0x7f361406d700 2024-09-11T23:17:35.713 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.712+0000 7f360b400640 1 -- 172.21.15.165:0/3350394852 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f36040067d0 con 0x7f361406d700 2024-09-11T23:17:35.713 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-11T23:17:35.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.713+0000 7f3618e00640 1 -- 172.21.15.165:0/3350394852 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f361406d700 msgr2=0x7f36141f54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.713+0000 7f3618e00640 1 --2- 172.21.15.165:0/3350394852 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f361406d700 0x7f36141f54e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f360400c3c0 tx=0x7f360400c880 comp rx=0 tx=0).stop 2024-09-11T23:17:35.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.713+0000 7f3618e00640 1 -- 172.21.15.165:0/3350394852 shutdown_connections 2024-09-11T23:17:35.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.713+0000 7f3618e00640 1 --2- 172.21.15.165:0/3350394852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f361415e510 0x7f36140cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.713+0000 7f3618e00640 1 --2- 172.21.15.165:0/3350394852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36140d1c20 0x7f3614154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.713+0000 7f3618e00640 1 --2- 172.21.15.165:0/3350394852 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f361406d700 0x7f36141f54e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.713+0000 7f3618e00640 1 -- 172.21.15.165:0/3350394852 >> 172.21.15.165:0/3350394852 conn(0x7f361406f260 msgr2=0x7f36140b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:35.714 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.713+0000 7f3618e00640 1 -- 172.21.15.165:0/3350394852 shutdown_connections 2024-09-11T23:17:35.715 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.713+0000 7f3618e00640 1 -- 172.21.15.165:0/3350394852 wait complete. 2024-09-11T23:17:35.728 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new da7e5e9f-a850-4798-b221-16429c61924f 2 2024-09-11T23:17:35.767 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:35.767+0000 7f9cf400d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:17:35.797 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:35.797+0000 7f316911e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:17:35.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.878+0000 7f2e34a00640 1 Processor -- start 2024-09-11T23:17:35.878 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.879+0000 7f2e34a00640 1 -- start start 2024-09-11T23:17:35.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.880+0000 7f2e34a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e300d1170 0x7f2e300b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.880+0000 7f2e34a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2e3015f030 0x7f2e300d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.880+0000 7f2e34a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e300d0500 con 0x7f2e300b3de0 2024-09-11T23:17:35.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.880+0000 7f2e34a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2e300d45a0 con 0x7f2e3015f030 2024-09-11T23:17:35.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.880+0000 7f2e34a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2e300d1a90 con 0x7f2e300d1170 2024-09-11T23:17:35.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.880+0000 7f2e2de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e300d1170 0x7f2e300b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.880+0000 7f2e2de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e300d1170 0x7f2e300b3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:53518/0 (socket says 172.21.15.165:53518) 2024-09-11T23:17:35.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.880+0000 7f2e2de00640 1 -- 172.21.15.165:0/178099051 learned_addr learned my addr 172.21.15.165:0/178099051 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-11T23:17:35.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.880+0000 7f2e27e00640 1 --2- 172.21.15.165:0/178099051 >> v2:172.21.15.165:3300/0 conn(0x7f2e3015f030 0x7f2e300d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.880+0000 7f2e2de00640 1 -- 172.21.15.165:0/178099051 >> v2:172.21.15.165:3300/0 conn(0x7f2e3015f030 msgr2=0x7f2e300d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:35.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.880+0000 7f2e2de00640 1 --2- 172.21.15.165:0/178099051 >> v2:172.21.15.165:3300/0 conn(0x7f2e3015f030 0x7f2e300d1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.880+0000 7f2e2de00640 1 -- 172.21.15.165:0/178099051 >> v1:172.21.15.165:6789/0 conn(0x7f2e300b3de0 legacy=0x7f2e300b7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.881 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.880+0000 7f2e2de00640 1 -- 172.21.15.165:0/178099051 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e300b3620 con 0x7f2e300d1170 2024-09-11T23:17:35.882 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.881+0000 7f2e27e00640 1 --2- 172.21.15.165:0/178099051 >> v2:172.21.15.165:3300/0 conn(0x7f2e3015f030 0x7f2e300d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:35.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.882+0000 7f2e2de00640 1 --2- 172.21.15.165:0/178099051 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e300d1170 0x7f2e300b3870 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009870 tx=0x7f2e2002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0efcacb9a1a2821 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.882+0000 7f2e2d400640 1 -- 172.21.15.165:0/178099051 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e20037070 con 0x7f2e300d1170 2024-09-11T23:17:35.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.882+0000 7f2e2d400640 1 -- 172.21.15.165:0/178099051 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e20032440 con 0x7f2e300d1170 2024-09-11T23:17:35.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.882+0000 7f2e2d400640 1 -- 172.21.15.165:0/178099051 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e20032810 con 0x7f2e300d1170 2024-09-11T23:17:35.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.882+0000 7f2e34a00640 1 -- 172.21.15.165:0/178099051 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e300d1170 msgr2=0x7f2e300b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.882+0000 7f2e34a00640 1 --2- 172.21.15.165:0/178099051 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e300d1170 0x7f2e300b3870 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009870 tx=0x7f2e2002a1c0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.883+0000 7f2e34a00640 1 -- 172.21.15.165:0/178099051 shutdown_connections 2024-09-11T23:17:35.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.883+0000 7f2e34a00640 1 --2- 172.21.15.165:0/178099051 >> v2:172.21.15.165:3300/0 conn(0x7f2e3015f030 0x7f2e300d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.883+0000 7f2e34a00640 1 --2- 172.21.15.165:0/178099051 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e300d1170 0x7f2e300b3870 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.883+0000 7f2e34a00640 1 -- 172.21.15.165:0/178099051 >> 172.21.15.165:0/178099051 conn(0x7f2e300b6330 msgr2=0x7f2e300b6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:35.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.883+0000 7f2e34a00640 1 -- 172.21.15.165:0/178099051 shutdown_connections 2024-09-11T23:17:35.883 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.883+0000 7f2e34a00640 1 -- 172.21.15.165:0/178099051 wait complete. 2024-09-11T23:17:35.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.884+0000 7f2e34a00640 1 Processor -- start 2024-09-11T23:17:35.884 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.884+0000 7f2e34a00640 1 -- start start 2024-09-11T23:17:35.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.885+0000 7f2e34a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e300b3de0 0x7f2e301f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.885+0000 7f2e34a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e300d1170 0x7f2e301f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.885+0000 7f2e34a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e3015f030 0x7f2e30160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:35.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.885+0000 7f2e34a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2e300d2460 con 0x7f2e300b3de0 2024-09-11T23:17:35.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.885+0000 7f2e34a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2e300d42c0 con 0x7f2e3015f030 2024-09-11T23:17:35.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.885+0000 7f2e34a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2e300d2740 con 0x7f2e300d1170 2024-09-11T23:17:35.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.886+0000 7f2e27e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e300d1170 0x7f2e301f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.886+0000 7f2e27e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e300d1170 0x7f2e301f1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:53532/0 (socket says 172.21.15.165:53532) 2024-09-11T23:17:35.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.886+0000 7f2e2de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e300b3de0 0x7f2e301f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.887 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.886+0000 7f2e27e00640 1 -- 172.21.15.165:0/76145571 learned_addr learned my addr 172.21.15.165:0/76145571 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-11T23:17:35.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.886+0000 7f2e2e800640 1 --2- 172.21.15.165:0/76145571 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e3015f030 0x7f2e30160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:35.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.886+0000 7f2e27e00640 1 -- 172.21.15.165:0/76145571 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e3015f030 msgr2=0x7f2e30160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.886+0000 7f2e27e00640 1 --2- 172.21.15.165:0/76145571 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e3015f030 0x7f2e30160ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.886+0000 7f2e27e00640 1 -- 172.21.15.165:0/76145571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e300b3de0 msgr2=0x7f2e301f52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.886+0000 7f2e27e00640 1 --2- 172.21.15.165:0/76145571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e300b3de0 0x7f2e301f52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.886+0000 7f2e27e00640 1 -- 172.21.15.165:0/76145571 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3015f5b0 con 0x7f2e300d1170 2024-09-11T23:17:35.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.886+0000 7f2e27e00640 1 --2- 172.21.15.165:0/76145571 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e300d1170 0x7f2e301f1ba0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2e1800e8a0 tx=0x7f2e1800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:35.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.887+0000 7f2e26000640 1 -- 172.21.15.165:0/76145571 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e18017070 con 0x7f2e300d1170 2024-09-11T23:17:35.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.887+0000 7f2e26000640 1 -- 172.21.15.165:0/76145571 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1800c940 con 0x7f2e300d1170 2024-09-11T23:17:35.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.887+0000 7f2e26000640 1 -- 172.21.15.165:0/76145571 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1800cd10 con 0x7f2e300d1170 2024-09-11T23:17:35.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.887+0000 7f2e34a00640 1 -- 172.21.15.165:0/76145571 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e3015f890 con 0x7f2e300d1170 2024-09-11T23:17:35.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.887+0000 7f2e34a00640 1 -- 172.21.15.165:0/76145571 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e3015fe50 con 0x7f2e300d1170 2024-09-11T23:17:35.888 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.887+0000 7f2e26000640 1 -- 172.21.15.165:0/76145571 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2e1801a070 con 0x7f2e300d1170 2024-09-11T23:17:35.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.887+0000 7f2e26000640 1 -- 172.21.15.165:0/76145571 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f2e18013890 con 0x7f2e300d1170 2024-09-11T23:17:35.889 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.888+0000 7f2e34a00640 1 -- 172.21.15.165:0/76145571 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e300d1550 con 0x7f2e300d1170 2024-09-11T23:17:35.890 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.891+0000 7f2e26000640 1 -- 172.21.15.165:0/76145571 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2e18013b20 con 0x7f2e300d1170 2024-09-11T23:17:35.962 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.962+0000 7f2e34a00640 1 -- 172.21.15.165:0/76145571 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd new", "uuid": "da7e5e9f-a850-4798-b221-16429c61924f", "id": 2} v 0) -- 0x7f2e300b54f0 con 0x7f2e300d1170 2024-09-11T23:17:35.967 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.968+0000 7f2e26000640 1 -- 172.21.15.165:0/76145571 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "da7e5e9f-a850-4798-b221-16429c61924f", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f2e18013470 con 0x7f2e300d1170 2024-09-11T23:17:35.967 INFO:teuthology.orchestra.run.smithi165.stdout:2 2024-09-11T23:17:35.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.969+0000 7f2e34a00640 1 -- 172.21.15.165:0/76145571 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e300d1170 msgr2=0x7f2e301f1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:35.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.969+0000 7f2e34a00640 1 --2- 172.21.15.165:0/76145571 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e300d1170 0x7f2e301f1ba0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2e1800e8a0 tx=0x7f2e1800ed60 comp rx=0 tx=0).stop 2024-09-11T23:17:35.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.969+0000 7f2e34a00640 1 -- 172.21.15.165:0/76145571 shutdown_connections 2024-09-11T23:17:35.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.969+0000 7f2e34a00640 1 --2- 172.21.15.165:0/76145571 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e3015f030 0x7f2e30160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.969+0000 7f2e34a00640 1 --2- 172.21.15.165:0/76145571 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e300d1170 0x7f2e301f1ba0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.969+0000 7f2e34a00640 1 --2- 172.21.15.165:0/76145571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e300b3de0 0x7f2e301f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:35.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.969+0000 7f2e34a00640 1 -- 172.21.15.165:0/76145571 >> 172.21.15.165:0/76145571 conn(0x7f2e300b6330 msgr2=0x7f2e300b5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:35.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.969+0000 7f2e34a00640 1 -- 172.21.15.165:0/76145571 shutdown_connections 2024-09-11T23:17:35.969 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:35.969+0000 7f2e34a00640 1 -- 172.21.15.165:0/76145571 wait complete. 2024-09-11T23:17:35.984 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 374b73e8-1a67-4cd5-a83f-a5a06d30802e 3 2024-09-11T23:17:36.134 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.135+0000 7f968f200640 1 Processor -- start 2024-09-11T23:17:36.135 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.135+0000 7f968f200640 1 -- start start 2024-09-11T23:17:36.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.136+0000 7f968f200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f96880cfb60 0x7f96880d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:36.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.136+0000 7f968f200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96880d3400 con 0x7f96880d1370 2024-09-11T23:17:36.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.136+0000 7f968f200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96880d17b0 con 0x7f968815e670 2024-09-11T23:17:36.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.136+0000 7f968f200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f968815ea50 con 0x7f96880cfb60 2024-09-11T23:17:36.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.136+0000 7f968d400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f96880cfb60 0x7f96880d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:36.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.136+0000 7f968d400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f96880cfb60 0x7f96880d0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:39516/0 (socket says 172.21.15.165:39516) 2024-09-11T23:17:36.136 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.136+0000 7f968d400640 1 -- 172.21.15.165:0/1109681786 learned_addr learned my addr 172.21.15.165:0/1109681786 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-11T23:17:36.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.137+0000 7f968d400640 1 -- 172.21.15.165:0/1109681786 >> v1:172.21.15.165:6789/0 conn(0x7f968815e670 legacy=0x7f96880cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.137+0000 7f968d400640 1 -- 172.21.15.165:0/1109681786 >> v1:172.21.15.144:6789/0 conn(0x7f96880d1370 legacy=0x7f96880b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.137+0000 7f968d400640 1 -- 172.21.15.165:0/1109681786 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96880d3670 con 0x7f96880cfb60 2024-09-11T23:17:36.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.138+0000 7f968d400640 1 --2- 172.21.15.165:0/1109681786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96880cfb60 0x7f96880d0e30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9678009870 tx=0x7f967802a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d6d60fefa41ed24 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:36.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.138+0000 7f968ca00640 1 -- 172.21.15.165:0/1109681786 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678037070 con 0x7f96880cfb60 2024-09-11T23:17:36.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.138+0000 7f968ca00640 1 -- 172.21.15.165:0/1109681786 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f967802ae50 con 0x7f96880cfb60 2024-09-11T23:17:36.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.138+0000 7f968ca00640 1 -- 172.21.15.165:0/1109681786 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678032860 con 0x7f96880cfb60 2024-09-11T23:17:36.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.138+0000 7f968f200640 1 -- 172.21.15.165:0/1109681786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96880cfb60 msgr2=0x7f96880d0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.138+0000 7f968f200640 1 --2- 172.21.15.165:0/1109681786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96880cfb60 0x7f96880d0e30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9678009870 tx=0x7f967802a300 comp rx=0 tx=0).stop 2024-09-11T23:17:36.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.138+0000 7f968f200640 1 -- 172.21.15.165:0/1109681786 shutdown_connections 2024-09-11T23:17:36.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.138+0000 7f968f200640 1 --2- 172.21.15.165:0/1109681786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96880cfb60 0x7f96880d0e30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.138+0000 7f968f200640 1 -- 172.21.15.165:0/1109681786 >> 172.21.15.165:0/1109681786 conn(0x7f96880b6290 msgr2=0x7f96880b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:36.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.139+0000 7f968f200640 1 -- 172.21.15.165:0/1109681786 shutdown_connections 2024-09-11T23:17:36.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.139+0000 7f968f200640 1 -- 172.21.15.165:0/1109681786 wait complete. 2024-09-11T23:17:36.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.140+0000 7f968f200640 1 Processor -- start 2024-09-11T23:17:36.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.140+0000 7f968f200640 1 -- start start 2024-09-11T23:17:36.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.141+0000 7f968f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96880cfb60 0x7f96880ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:36.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.141+0000 7f968f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96880d1370 0x7f96880cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:36.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.141+0000 7f968f200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f968815e670 0x7f968814e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:36.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.141+0000 7f968f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f96880d2380 con 0x7f96880cfb60 2024-09-11T23:17:36.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.141+0000 7f968f200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f96880d3c30 con 0x7f968815e670 2024-09-11T23:17:36.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.141+0000 7f968f200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f96880b7e30 con 0x7f96880d1370 2024-09-11T23:17:36.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.142+0000 7f968de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96880cfb60 0x7f96880ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:36.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.142+0000 7f968e800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f968815e670 0x7f968814e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:36.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.142+0000 7f968d400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96880d1370 0x7f96880cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:36.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.142+0000 7f968de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96880cfb60 0x7f96880ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.165:43628/0 (socket says 172.21.15.165:43628) 2024-09-11T23:17:36.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.142+0000 7f968de00640 1 -- 172.21.15.165:0/2432736847 learned_addr learned my addr 172.21.15.165:0/2432736847 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-11T23:17:36.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.142+0000 7f968d400640 1 -- 172.21.15.165:0/2432736847 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f968815e670 msgr2=0x7f968814e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.142+0000 7f968d400640 1 --2- 172.21.15.165:0/2432736847 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f968815e670 0x7f968814e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.142+0000 7f968d400640 1 -- 172.21.15.165:0/2432736847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96880cfb60 msgr2=0x7f96880ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.142+0000 7f968d400640 1 --2- 172.21.15.165:0/2432736847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96880cfb60 0x7f96880ca260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.142+0000 7f968d400640 1 -- 172.21.15.165:0/2432736847 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96880c91c0 con 0x7f96880d1370 2024-09-11T23:17:36.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.142+0000 7f968de00640 1 --2- 172.21.15.165:0/2432736847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96880cfb60 0x7f96880ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:36.143 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.142+0000 7f968d400640 1 --2- 172.21.15.165:0/2432736847 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96880d1370 0x7f96880cab10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9678031000 tx=0x7f96780046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:36.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.143+0000 7f9682000640 1 -- 172.21.15.165:0/2432736847 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678041070 con 0x7f96880d1370 2024-09-11T23:17:36.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.143+0000 7f9682000640 1 -- 172.21.15.165:0/2432736847 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f967803c870 con 0x7f96880d1370 2024-09-11T23:17:36.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.143+0000 7f9682000640 1 -- 172.21.15.165:0/2432736847 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678037040 con 0x7f96880d1370 2024-09-11T23:17:36.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.143+0000 7f968f200640 1 -- 172.21.15.165:0/2432736847 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96880c94a0 con 0x7f96880d1370 2024-09-11T23:17:36.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.143+0000 7f968f200640 1 -- 172.21.15.165:0/2432736847 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f96880c9a60 con 0x7f96880d1370 2024-09-11T23:17:36.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.143+0000 7f9682000640 1 -- 172.21.15.165:0/2432736847 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9678044070 con 0x7f96880d1370 2024-09-11T23:17:36.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.143+0000 7f9682000640 1 -- 172.21.15.165:0/2432736847 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f967803cc60 con 0x7f96880d1370 2024-09-11T23:17:36.144 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.144+0000 7f968f200640 1 -- 172.21.15.165:0/2432736847 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96880d0e30 con 0x7f96880d1370 2024-09-11T23:17:36.145 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.146+0000 7f9682000640 1 -- 172.21.15.165:0/2432736847 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9678046450 con 0x7f96880d1370 2024-09-11T23:17:36.219 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.220+0000 7f968f200640 1 -- 172.21.15.165:0/2432736847 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd new", "uuid": "374b73e8-1a67-4cd5-a83f-a5a06d30802e", "id": 3} v 0) -- 0x7f968815c330 con 0x7f96880d1370 2024-09-11T23:17:36.531 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.226+0000 7f9682000640 1 -- 172.21.15.165:0/2432736847 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "374b73e8-1a67-4cd5-a83f-a5a06d30802e", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f9678046ae0 con 0x7f96880d1370 2024-09-11T23:17:36.531 INFO:teuthology.orchestra.run.smithi165.stdout:3 2024-09-11T23:17:36.532 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.227+0000 7f968f200640 1 -- 172.21.15.165:0/2432736847 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96880d1370 msgr2=0x7f96880cab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.227+0000 7f968f200640 1 --2- 172.21.15.165:0/2432736847 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96880d1370 0x7f96880cab10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9678031000 tx=0x7f96780046c0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.227+0000 7f968f200640 1 -- 172.21.15.165:0/2432736847 shutdown_connections 2024-09-11T23:17:36.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.227+0000 7f968f200640 1 --2- 172.21.15.165:0/2432736847 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f968815e670 0x7f968814e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.227+0000 7f968f200640 1 --2- 172.21.15.165:0/2432736847 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96880d1370 0x7f96880cab10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.227+0000 7f968f200640 1 --2- 172.21.15.165:0/2432736847 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96880cfb60 0x7f96880ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.227+0000 7f968f200640 1 -- 172.21.15.165:0/2432736847 >> 172.21.15.165:0/2432736847 conn(0x7f96880b6290 msgr2=0x7f96880b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:36.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.227+0000 7f968f200640 1 -- 172.21.15.165:0/2432736847 shutdown_connections 2024-09-11T23:17:36.533 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.227+0000 7f968f200640 1 -- 172.21.15.165:0/2432736847 wait complete. 2024-09-11T23:17:36.533 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new e6adfbab-3889-4da6-9335-b1fc597ec34e 4 2024-09-11T23:17:36.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.686+0000 7f23ddc00640 1 Processor -- start 2024-09-11T23:17:36.685 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.686+0000 7f23ddc00640 1 -- start start 2024-09-11T23:17:36.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.687+0000 7f23ddc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f23d8161e30 0x7f23d80d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:36.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.687+0000 7f23ddc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f23d80b3d50 0x7f23d806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:36.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.687+0000 7f23ddc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23d80cf9a0 con 0x7f23d80b3290 2024-09-11T23:17:36.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.687+0000 7f23ddc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f23d80cfcf0 con 0x7f23d8161e30 2024-09-11T23:17:36.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.687+0000 7f23ddc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f23d8162210 con 0x7f23d80b3d50 2024-09-11T23:17:36.687 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.687+0000 7f23d6000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f23d80b3d50 0x7f23d806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:36.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.687+0000 7f23d6000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f23d80b3d50 0x7f23d806d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:39536/0 (socket says 172.21.15.165:39536) 2024-09-11T23:17:36.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.687+0000 7f23d6000640 1 -- 172.21.15.165:0/1723379653 learned_addr learned my addr 172.21.15.165:0/1723379653 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-11T23:17:36.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.687+0000 7f23d6a00640 1 --2- 172.21.15.165:0/1723379653 >> v2:172.21.15.144:3300/0 conn(0x7f23d8161e30 0x7f23d80d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:36.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.688+0000 7f23d6000640 1 -- 172.21.15.165:0/1723379653 >> v2:172.21.15.144:3300/0 conn(0x7f23d8161e30 msgr2=0x7f23d80d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:36.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.688+0000 7f23d6000640 1 --2- 172.21.15.165:0/1723379653 >> v2:172.21.15.144:3300/0 conn(0x7f23d8161e30 0x7f23d80d34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.688+0000 7f23d6000640 1 -- 172.21.15.165:0/1723379653 >> v1:172.21.15.144:6789/0 conn(0x7f23d80b3290 legacy=0x7f23d80b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.688 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.688+0000 7f23d6000640 1 -- 172.21.15.165:0/1723379653 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d80d5210 con 0x7f23d80b3d50 2024-09-11T23:17:36.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.689+0000 7f23d6000640 1 --2- 172.21.15.165:0/1723379653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23d80b3d50 0x7f23d806d8c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f23d80ba8f0 tx=0x7f23c402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d7d1c000b7fc024 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:36.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.689+0000 7f23d5600640 1 -- 172.21.15.165:0/1723379653 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4037070 con 0x7f23d80b3d50 2024-09-11T23:17:36.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.689+0000 7f23d5600640 1 -- 172.21.15.165:0/1723379653 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c4032440 con 0x7f23d80b3d50 2024-09-11T23:17:36.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.689+0000 7f23d5600640 1 -- 172.21.15.165:0/1723379653 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4032810 con 0x7f23d80b3d50 2024-09-11T23:17:36.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.689+0000 7f23ddc00640 1 -- 172.21.15.165:0/1723379653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23d80b3d50 msgr2=0x7f23d806d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.689+0000 7f23ddc00640 1 --2- 172.21.15.165:0/1723379653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23d80b3d50 0x7f23d806d8c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f23d80ba8f0 tx=0x7f23c402a270 comp rx=0 tx=0).stop 2024-09-11T23:17:36.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.690+0000 7f23ddc00640 1 -- 172.21.15.165:0/1723379653 shutdown_connections 2024-09-11T23:17:36.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.690+0000 7f23ddc00640 1 --2- 172.21.15.165:0/1723379653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23d80b3d50 0x7f23d806d8c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.690+0000 7f23ddc00640 1 --2- 172.21.15.165:0/1723379653 >> v2:172.21.15.144:3300/0 conn(0x7f23d8161e30 0x7f23d80d34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.690+0000 7f23ddc00640 1 -- 172.21.15.165:0/1723379653 >> 172.21.15.165:0/1723379653 conn(0x7f23d80d1870 msgr2=0x7f23d80d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:36.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.690+0000 7f23ddc00640 1 -- 172.21.15.165:0/1723379653 shutdown_connections 2024-09-11T23:17:36.690 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.690+0000 7f23ddc00640 1 -- 172.21.15.165:0/1723379653 wait complete. 2024-09-11T23:17:36.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.692+0000 7f23ddc00640 1 Processor -- start 2024-09-11T23:17:36.691 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.692+0000 7f23ddc00640 1 -- start start 2024-09-11T23:17:36.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.693+0000 7f23ddc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23d80b3290 0x7f23d814acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:36.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.693+0000 7f23ddc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23d80b3d50 0x7f23d815ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:36.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.693+0000 7f23ddc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f23d8161e30 0x7f23d8160500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:36.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.693+0000 7f23ddc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f23d80d39e0 con 0x7f23d80b3290 2024-09-11T23:17:36.694 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.693+0000 7f23ddc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f23d80b3950 con 0x7f23d80b3d50 2024-09-11T23:17:36.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.693+0000 7f23ddc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f23d80c8f60 con 0x7f23d8161e30 2024-09-11T23:17:36.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.693+0000 7f23d6000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23d80b3d50 0x7f23d815ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:36.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.693+0000 7f23d7400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f23d8161e30 0x7f23d8160500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:36.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.693+0000 7f23d6000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23d80b3d50 0x7f23d815ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:39552/0 (socket says 172.21.15.165:39552) 2024-09-11T23:17:36.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.693+0000 7f23d6000640 1 -- 172.21.15.165:0/1460701855 learned_addr learned my addr 172.21.15.165:0/1460701855 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-11T23:17:36.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.693+0000 7f23d6a00640 1 --2- 172.21.15.165:0/1460701855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23d80b3290 0x7f23d814acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:36.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.693+0000 7f23d6000640 1 -- 172.21.15.165:0/1460701855 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f23d8161e30 msgr2=0x7f23d8160500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.693+0000 7f23d6000640 1 --2- 172.21.15.165:0/1460701855 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f23d8161e30 0x7f23d8160500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.693+0000 7f23d6000640 1 -- 172.21.15.165:0/1460701855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23d80b3290 msgr2=0x7f23d814acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.695 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.693+0000 7f23d6000640 1 --2- 172.21.15.165:0/1460701855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23d80b3290 0x7f23d814acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.693+0000 7f23d6000640 1 -- 172.21.15.165:0/1460701855 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d80c8390 con 0x7f23d80b3d50 2024-09-11T23:17:36.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.693+0000 7f23d7400640 1 --2- 172.21.15.165:0/1460701855 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f23d8161e30 0x7f23d8160500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:36.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.694+0000 7f23d6000640 1 --2- 172.21.15.165:0/1460701855 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23d80b3d50 0x7f23d815ffc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f23c4000c00 tx=0x7f23c40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:36.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.694+0000 7f23cea00640 1 -- 172.21.15.165:0/1460701855 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4037040 con 0x7f23d80b3d50 2024-09-11T23:17:36.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.694+0000 7f23cea00640 1 -- 172.21.15.165:0/1460701855 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c4042070 con 0x7f23d80b3d50 2024-09-11T23:17:36.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.694+0000 7f23cea00640 1 -- 172.21.15.165:0/1460701855 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4030880 con 0x7f23d80b3d50 2024-09-11T23:17:36.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.694+0000 7f23ddc00640 1 -- 172.21.15.165:0/1460701855 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d80c8630 con 0x7f23d80b3d50 2024-09-11T23:17:36.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.694+0000 7f23ddc00640 1 -- 172.21.15.165:0/1460701855 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d80c8bf0 con 0x7f23d80b3d50 2024-09-11T23:17:36.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.694+0000 7f23cea00640 1 -- 172.21.15.165:0/1460701855 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f23c4030a20 con 0x7f23d80b3d50 2024-09-11T23:17:36.696 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.694+0000 7f23cea00640 1 -- 172.21.15.165:0/1460701855 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f23c4047b40 con 0x7f23d80b3d50 2024-09-11T23:17:36.697 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.695+0000 7f23ddc00640 1 -- 172.21.15.165:0/1460701855 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d80d34a0 con 0x7f23d80b3d50 2024-09-11T23:17:36.699 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.699+0000 7f23cea00640 1 -- 172.21.15.165:0/1460701855 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f23c4047460 con 0x7f23d80b3d50 2024-09-11T23:17:36.770 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.771+0000 7f23ddc00640 1 -- 172.21.15.165:0/1460701855 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e6adfbab-3889-4da6-9335-b1fc597ec34e", "id": 4} v 0) -- 0x7f23d80d3b60 con 0x7f23d80b3d50 2024-09-11T23:17:36.776 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.776+0000 7f23cea00640 1 -- 172.21.15.165:0/1460701855 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e6adfbab-3889-4da6-9335-b1fc597ec34e", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f23c4047640 con 0x7f23d80b3d50 2024-09-11T23:17:36.776 INFO:teuthology.orchestra.run.smithi165.stdout:4 2024-09-11T23:17:36.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.777+0000 7f23ddc00640 1 -- 172.21.15.165:0/1460701855 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23d80b3d50 msgr2=0x7f23d815ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.777+0000 7f23ddc00640 1 --2- 172.21.15.165:0/1460701855 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23d80b3d50 0x7f23d815ffc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f23c4000c00 tx=0x7f23c40046c0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.778+0000 7f23ddc00640 1 -- 172.21.15.165:0/1460701855 shutdown_connections 2024-09-11T23:17:36.777 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.778+0000 7f23ddc00640 1 --2- 172.21.15.165:0/1460701855 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f23d8161e30 0x7f23d8160500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.778+0000 7f23ddc00640 1 --2- 172.21.15.165:0/1460701855 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23d80b3d50 0x7f23d815ffc0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.778+0000 7f23ddc00640 1 --2- 172.21.15.165:0/1460701855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23d80b3290 0x7f23d814acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.778+0000 7f23ddc00640 1 -- 172.21.15.165:0/1460701855 >> 172.21.15.165:0/1460701855 conn(0x7f23d80d1870 msgr2=0x7f23d80b9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:36.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.778+0000 7f23ddc00640 1 -- 172.21.15.165:0/1460701855 shutdown_connections 2024-09-11T23:17:36.778 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.778+0000 7f23ddc00640 1 -- 172.21.15.165:0/1460701855 wait complete. 2024-09-11T23:17:36.791 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 9fa351a1-8871-457e-b9c9-337af10351b1 5 2024-09-11T23:17:36.856 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:36.856+0000 7f9cf400d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:17:36.917 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:36.917+0000 7f9cf400d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:17:36.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.942+0000 7f41e8200640 1 Processor -- start 2024-09-11T23:17:36.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.942+0000 7f41e8200640 1 -- start start 2024-09-11T23:17:36.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.943+0000 7f41e8200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f41e0161e30 0x7f41e00d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:36.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.943+0000 7f41e8200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41e00b3d50 0x7f41e006d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:36.943 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.943+0000 7f41e8200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e00cf9a0 con 0x7f41e00b3290 2024-09-11T23:17:36.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.943+0000 7f41e8200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f41e00cfcf0 con 0x7f41e0161e30 2024-09-11T23:17:36.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.943+0000 7f41e8200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f41e0162210 con 0x7f41e00b3d50 2024-09-11T23:17:36.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.943+0000 7f41e4e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41e00b3d50 0x7f41e006d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:36.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.943+0000 7f41e4e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41e00b3d50 0x7f41e006d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:53554/0 (socket says 172.21.15.165:53554) 2024-09-11T23:17:36.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.943+0000 7f41e4e00640 1 -- 172.21.15.165:0/1920986749 learned_addr learned my addr 172.21.15.165:0/1920986749 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-11T23:17:36.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.943+0000 7f41e5800640 1 --2- 172.21.15.165:0/1920986749 >> v2:172.21.15.144:3300/0 conn(0x7f41e0161e30 0x7f41e00d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:36.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.944+0000 7f41e4e00640 1 -- 172.21.15.165:0/1920986749 >> v2:172.21.15.144:3300/0 conn(0x7f41e0161e30 msgr2=0x7f41e00d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:36.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.944+0000 7f41e4e00640 1 --2- 172.21.15.165:0/1920986749 >> v2:172.21.15.144:3300/0 conn(0x7f41e0161e30 0x7f41e00d34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.944+0000 7f41e4e00640 1 -- 172.21.15.165:0/1920986749 >> v1:172.21.15.144:6789/0 conn(0x7f41e00b3290 legacy=0x7f41e00b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.944+0000 7f41e4e00640 1 -- 172.21.15.165:0/1920986749 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e00d5210 con 0x7f41e00b3d50 2024-09-11T23:17:36.944 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.944+0000 7f41dfe00640 1 -- 172.21.15.165:0/1920986749 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 103675034 0 0) 0x7f41e00cf9a0 con 0x7f41e00b3290 2024-09-11T23:17:36.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.945+0000 7f41e4e00640 1 --2- 172.21.15.165:0/1920986749 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41e00b3d50 0x7f41e006d8c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009870 tx=0x7f41cc02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9a83250dc615dc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:36.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.945+0000 7f41dfe00640 1 -- 172.21.15.165:0/1920986749 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc037070 con 0x7f41e00b3d50 2024-09-11T23:17:36.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.945+0000 7f41dfe00640 1 -- 172.21.15.165:0/1920986749 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41cc032440 con 0x7f41e00b3d50 2024-09-11T23:17:36.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.945+0000 7f41dfe00640 1 -- 172.21.15.165:0/1920986749 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc032810 con 0x7f41e00b3d50 2024-09-11T23:17:36.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.946+0000 7f41e8200640 1 -- 172.21.15.165:0/1920986749 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41e00b3d50 msgr2=0x7f41e006d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.946+0000 7f41e8200640 1 --2- 172.21.15.165:0/1920986749 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41e00b3d50 0x7f41e006d8c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f41cc009870 tx=0x7f41cc02a270 comp rx=0 tx=0).stop 2024-09-11T23:17:36.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.946+0000 7f41e8200640 1 -- 172.21.15.165:0/1920986749 shutdown_connections 2024-09-11T23:17:36.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.946+0000 7f41e8200640 1 --2- 172.21.15.165:0/1920986749 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41e00b3d50 0x7f41e006d8c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.946+0000 7f41e8200640 1 --2- 172.21.15.165:0/1920986749 >> v2:172.21.15.144:3300/0 conn(0x7f41e0161e30 0x7f41e00d34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.946+0000 7f41e8200640 1 -- 172.21.15.165:0/1920986749 >> 172.21.15.165:0/1920986749 conn(0x7f41e00d1870 msgr2=0x7f41e00d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:36.946 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.946+0000 7f41e8200640 1 -- 172.21.15.165:0/1920986749 shutdown_connections 2024-09-11T23:17:36.947 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.946+0000 7f41e8200640 1 -- 172.21.15.165:0/1920986749 wait complete. 2024-09-11T23:17:36.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.948+0000 7f41e8200640 1 Processor -- start 2024-09-11T23:17:36.948 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.949+0000 7f41e8200640 1 -- start start 2024-09-11T23:17:36.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.950+0000 7f41e8200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41e00b3290 0x7f41e00c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:36.950 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.950+0000 7f41e8200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41e00b3d50 0x7f41e00c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:36.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.950+0000 7f41e8200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41e0161e30 0x7f41e0160900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:36.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.950+0000 7f41e8200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f41e00d39e0 con 0x7f41e00b3290 2024-09-11T23:17:36.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.950+0000 7f41e8200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f41e00b3950 con 0x7f41e00b3d50 2024-09-11T23:17:36.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.950+0000 7f41e8200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f41e00cb350 con 0x7f41e0161e30 2024-09-11T23:17:36.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.950+0000 7f41e6200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41e0161e30 0x7f41e0160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:36.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.950+0000 7f41e5800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41e00b3290 0x7f41e00c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:36.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.950+0000 7f41e6200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41e0161e30 0x7f41e0160900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:53570/0 (socket says 172.21.15.165:53570) 2024-09-11T23:17:36.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.950+0000 7f41e6200640 1 -- 172.21.15.165:0/1786835062 learned_addr learned my addr 172.21.15.165:0/1786835062 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-11T23:17:36.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.950+0000 7f41e4e00640 1 --2- 172.21.15.165:0/1786835062 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41e00b3d50 0x7f41e00c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:36.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.951+0000 7f41e6200640 1 -- 172.21.15.165:0/1786835062 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41e00b3d50 msgr2=0x7f41e00c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.951+0000 7f41e6200640 1 --2- 172.21.15.165:0/1786835062 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41e00b3d50 0x7f41e00c9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.951 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.951+0000 7f41e6200640 1 -- 172.21.15.165:0/1786835062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41e00b3290 msgr2=0x7f41e00c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:36.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.951+0000 7f41e6200640 1 --2- 172.21.15.165:0/1786835062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41e00b3290 0x7f41e00c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:36.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.951+0000 7f41e6200640 1 -- 172.21.15.165:0/1786835062 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e00ca740 con 0x7f41e0161e30 2024-09-11T23:17:36.952 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.951+0000 7f41e6200640 1 --2- 172.21.15.165:0/1786835062 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41e0161e30 0x7f41e0160900 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f41d800c780 tx=0x7f41d800cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:36.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.951+0000 7f41dd600640 1 -- 172.21.15.165:0/1786835062 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d8003b70 con 0x7f41e0161e30 2024-09-11T23:17:36.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.951+0000 7f41dd600640 1 -- 172.21.15.165:0/1786835062 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d8003d10 con 0x7f41e0161e30 2024-09-11T23:17:36.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.951+0000 7f41dd600640 1 -- 172.21.15.165:0/1786835062 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d8005290 con 0x7f41e0161e30 2024-09-11T23:17:36.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.951+0000 7f41e8200640 1 -- 172.21.15.165:0/1786835062 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e00caa20 con 0x7f41e0161e30 2024-09-11T23:17:36.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.952+0000 7f41e8200640 1 -- 172.21.15.165:0/1786835062 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e00cafe0 con 0x7f41e0161e30 2024-09-11T23:17:36.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.952+0000 7f41dd600640 1 -- 172.21.15.165:0/1786835062 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f41d8005430 con 0x7f41e0161e30 2024-09-11T23:17:36.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.952+0000 7f41dd600640 1 -- 172.21.15.165:0/1786835062 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f41d8005720 con 0x7f41e0161e30 2024-09-11T23:17:36.953 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.953+0000 7f41e8200640 1 -- 172.21.15.165:0/1786835062 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e00d34a0 con 0x7f41e0161e30 2024-09-11T23:17:36.954 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:36.955+0000 7f41dd600640 1 -- 172.21.15.165:0/1786835062 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f41d800a640 con 0x7f41e0161e30 2024-09-11T23:17:36.984 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:36.984+0000 7f316911e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:17:37.026 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.027+0000 7f41e8200640 1 -- 172.21.15.165:0/1786835062 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9fa351a1-8871-457e-b9c9-337af10351b1", "id": 5} v 0) -- 0x7f41e015d7b0 con 0x7f41e0161e30 2024-09-11T23:17:37.032 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.033+0000 7f41dd600640 1 -- 172.21.15.165:0/1786835062 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9fa351a1-8871-457e-b9c9-337af10351b1", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f41d800a820 con 0x7f41e0161e30 2024-09-11T23:17:37.032 INFO:teuthology.orchestra.run.smithi165.stdout:5 2024-09-11T23:17:37.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.034+0000 7f41e8200640 1 -- 172.21.15.165:0/1786835062 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41e0161e30 msgr2=0x7f41e0160900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.034+0000 7f41e8200640 1 --2- 172.21.15.165:0/1786835062 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41e0161e30 0x7f41e0160900 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f41d800c780 tx=0x7f41d800cc40 comp rx=0 tx=0).stop 2024-09-11T23:17:37.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.034+0000 7f41e8200640 1 -- 172.21.15.165:0/1786835062 shutdown_connections 2024-09-11T23:17:37.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.034+0000 7f41e8200640 1 --2- 172.21.15.165:0/1786835062 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41e0161e30 0x7f41e0160900 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.034+0000 7f41e8200640 1 --2- 172.21.15.165:0/1786835062 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41e00b3d50 0x7f41e00c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.034+0000 7f41e8200640 1 --2- 172.21.15.165:0/1786835062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41e00b3290 0x7f41e00c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.034+0000 7f41e8200640 1 -- 172.21.15.165:0/1786835062 >> 172.21.15.165:0/1786835062 conn(0x7f41e00d1870 msgr2=0x7f41e00b8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:37.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.034+0000 7f41e8200640 1 -- 172.21.15.165:0/1786835062 shutdown_connections 2024-09-11T23:17:37.034 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.034+0000 7f41e8200640 1 -- 172.21.15.165:0/1786835062 wait complete. 2024-09-11T23:17:37.049 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new bda573ee-1d46-4077-bae2-97534d4171c7 6 2024-09-11T23:17:37.049 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:37.050+0000 7f316911e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:17:37.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.198+0000 7f91d1800640 1 Processor -- start 2024-09-11T23:17:37.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.199+0000 7f91d1800640 1 -- start start 2024-09-11T23:17:37.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.200+0000 7f91d1800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f91cc161e30 0x7f91cc0d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.200+0000 7f91d1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91cc06dfd0 0x7f91cc0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.200+0000 7f91d1800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91cc0cf9a0 con 0x7f91cc0b3d50 2024-09-11T23:17:37.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.200+0000 7f91d1800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f91cc0cfcf0 con 0x7f91cc161e30 2024-09-11T23:17:37.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.200+0000 7f91d1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f91cc162210 con 0x7f91cc06dfd0 2024-09-11T23:17:37.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.200+0000 7f91cb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91cc06dfd0 0x7f91cc0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.200+0000 7f91caa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f91cc161e30 0x7f91cc0d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.200+0000 7f91caa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f91cc161e30 0x7f91cc0d34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:39566/0 (socket says 172.21.15.165:39566) 2024-09-11T23:17:37.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.200+0000 7f91cb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91cc06dfd0 0x7f91cc0b78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.165:53572/0 (socket says 172.21.15.165:53572) 2024-09-11T23:17:37.200 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.200+0000 7f91caa00640 1 -- 172.21.15.165:0/1214086315 learned_addr learned my addr 172.21.15.165:0/1214086315 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-11T23:17:37.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.200+0000 7f91caa00640 1 -- 172.21.15.165:0/1214086315 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91cc06dfd0 msgr2=0x7f91cc0b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:37.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.201+0000 7f91caa00640 1 --2- 172.21.15.165:0/1214086315 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91cc06dfd0 0x7f91cc0b78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.201+0000 7f91caa00640 1 -- 172.21.15.165:0/1214086315 >> v1:172.21.15.165:6789/0 conn(0x7f91cc0b3d50 legacy=0x7f91cc06d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.201+0000 7f91caa00640 1 -- 172.21.15.165:0/1214086315 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91cc0d5210 con 0x7f91cc161e30 2024-09-11T23:17:37.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.201+0000 7f91cb400640 1 --2- 172.21.15.165:0/1214086315 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91cc06dfd0 0x7f91cc0b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:37.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.202+0000 7f91caa00640 1 --2- 172.21.15.165:0/1214086315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91cc161e30 0x7f91cc0d34a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009870 tx=0x7f91bc02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67889b9055195a11 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.202+0000 7f91ca000640 1 -- 172.21.15.165:0/1214086315 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc037070 con 0x7f91cc161e30 2024-09-11T23:17:37.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.202+0000 7f91ca000640 1 -- 172.21.15.165:0/1214086315 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91bc032440 con 0x7f91cc161e30 2024-09-11T23:17:37.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.202+0000 7f91ca000640 1 -- 172.21.15.165:0/1214086315 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc032810 con 0x7f91cc161e30 2024-09-11T23:17:37.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.202+0000 7f91d1800640 1 -- 172.21.15.165:0/1214086315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91cc161e30 msgr2=0x7f91cc0d34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.202+0000 7f91d1800640 1 --2- 172.21.15.165:0/1214086315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91cc161e30 0x7f91cc0d34a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009870 tx=0x7f91bc02a250 comp rx=0 tx=0).stop 2024-09-11T23:17:37.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.202+0000 7f91d1800640 1 -- 172.21.15.165:0/1214086315 shutdown_connections 2024-09-11T23:17:37.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.202+0000 7f91d1800640 1 --2- 172.21.15.165:0/1214086315 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91cc06dfd0 0x7f91cc0b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.202+0000 7f91d1800640 1 --2- 172.21.15.165:0/1214086315 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91cc161e30 0x7f91cc0d34a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.202+0000 7f91d1800640 1 -- 172.21.15.165:0/1214086315 >> 172.21.15.165:0/1214086315 conn(0x7f91cc0d1870 msgr2=0x7f91cc0d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:37.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.203+0000 7f91d1800640 1 -- 172.21.15.165:0/1214086315 shutdown_connections 2024-09-11T23:17:37.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.203+0000 7f91d1800640 1 -- 172.21.15.165:0/1214086315 wait complete. 2024-09-11T23:17:37.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.204+0000 7f91d1800640 1 Processor -- start 2024-09-11T23:17:37.204 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.204+0000 7f91d1800640 1 -- start start 2024-09-11T23:17:37.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.205+0000 7f91d1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91cc06dfd0 0x7f91cc1f8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.205+0000 7f91d1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91cc0b3d50 0x7f91cc0cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.205+0000 7f91d1800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91cc161e30 0x7f91cc0c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.205+0000 7f91d1800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc0d39e0 con 0x7f91cc06dfd0 2024-09-11T23:17:37.205 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.205+0000 7f91d1800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc0b3950 con 0x7f91cc161e30 2024-09-11T23:17:37.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.205+0000 7f91d1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f91cc0cb1f0 con 0x7f91cc0b3d50 2024-09-11T23:17:37.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.205+0000 7f91cb400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91cc161e30 0x7f91cc0c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.205+0000 7f91c3e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91cc0b3d50 0x7f91cc0cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.205+0000 7f91cb400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91cc161e30 0x7f91cc0c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:39572/0 (socket says 172.21.15.165:39572) 2024-09-11T23:17:37.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.205+0000 7f91cb400640 1 -- 172.21.15.165:0/1898538259 learned_addr learned my addr 172.21.15.165:0/1898538259 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-11T23:17:37.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.206+0000 7f91caa00640 1 --2- 172.21.15.165:0/1898538259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91cc06dfd0 0x7f91cc1f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.206+0000 7f91cb400640 1 -- 172.21.15.165:0/1898538259 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91cc0b3d50 msgr2=0x7f91cc0cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.206+0000 7f91cb400640 1 --2- 172.21.15.165:0/1898538259 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91cc0b3d50 0x7f91cc0cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.206+0000 7f91cb400640 1 -- 172.21.15.165:0/1898538259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91cc06dfd0 msgr2=0x7f91cc1f8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.206+0000 7f91cb400640 1 --2- 172.21.15.165:0/1898538259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91cc06dfd0 0x7f91cc1f8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.206+0000 7f91cb400640 1 -- 172.21.15.165:0/1898538259 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91cc0c9530 con 0x7f91cc161e30 2024-09-11T23:17:37.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.206+0000 7f91c3e00640 1 --2- 172.21.15.165:0/1898538259 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91cc0b3d50 0x7f91cc0cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:37.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.206+0000 7f91cb400640 1 --2- 172.21.15.165:0/1898538259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91cc161e30 0x7f91cc0c8d00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f91c400efb0 tx=0x7f91c400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.207 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.206+0000 7f91c2a00640 1 -- 172.21.15.165:0/1898538259 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c4018020 con 0x7f91cc161e30 2024-09-11T23:17:37.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.206+0000 7f91c2a00640 1 -- 172.21.15.165:0/1898538259 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c4014480 con 0x7f91cc161e30 2024-09-11T23:17:37.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.206+0000 7f91c2a00640 1 -- 172.21.15.165:0/1898538259 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c4014830 con 0x7f91cc161e30 2024-09-11T23:17:37.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.207+0000 7f91d1800640 1 -- 172.21.15.165:0/1898538259 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91cc0c9ef0 con 0x7f91cc161e30 2024-09-11T23:17:37.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.207+0000 7f91d1800640 1 -- 172.21.15.165:0/1898538259 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91cc0ca4b0 con 0x7f91cc161e30 2024-09-11T23:17:37.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.207+0000 7f91c2a00640 1 -- 172.21.15.165:0/1898538259 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f91c4005d10 con 0x7f91cc161e30 2024-09-11T23:17:37.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.207+0000 7f91c2a00640 1 -- 172.21.15.165:0/1898538259 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f91c4014d60 con 0x7f91cc161e30 2024-09-11T23:17:37.208 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.208+0000 7f91d1800640 1 -- 172.21.15.165:0/1898538259 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91cc0b3290 con 0x7f91cc161e30 2024-09-11T23:17:37.210 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.210+0000 7f91c2a00640 1 -- 172.21.15.165:0/1898538259 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f91c4022030 con 0x7f91cc161e30 2024-09-11T23:17:37.304 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.304+0000 7f91d1800640 1 -- 172.21.15.165:0/1898538259 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bda573ee-1d46-4077-bae2-97534d4171c7", "id": 6} v 0) -- 0x7f91cc15ea90 con 0x7f91cc161e30 2024-09-11T23:17:37.309 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.310+0000 7f91c2a00640 1 -- 172.21.15.165:0/1898538259 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bda573ee-1d46-4077-bae2-97534d4171c7", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f91c4010040 con 0x7f91cc161e30 2024-09-11T23:17:37.310 INFO:teuthology.orchestra.run.smithi165.stdout:6 2024-09-11T23:17:37.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.311+0000 7f91d1800640 1 -- 172.21.15.165:0/1898538259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91cc161e30 msgr2=0x7f91cc0c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.311+0000 7f91d1800640 1 --2- 172.21.15.165:0/1898538259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91cc161e30 0x7f91cc0c8d00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f91c400efb0 tx=0x7f91c400c490 comp rx=0 tx=0).stop 2024-09-11T23:17:37.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.311+0000 7f91d1800640 1 -- 172.21.15.165:0/1898538259 shutdown_connections 2024-09-11T23:17:37.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.311+0000 7f91d1800640 1 --2- 172.21.15.165:0/1898538259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91cc161e30 0x7f91cc0c8d00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.311+0000 7f91d1800640 1 --2- 172.21.15.165:0/1898538259 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91cc0b3d50 0x7f91cc0cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.311+0000 7f91d1800640 1 --2- 172.21.15.165:0/1898538259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91cc06dfd0 0x7f91cc1f8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.311+0000 7f91d1800640 1 -- 172.21.15.165:0/1898538259 >> 172.21.15.165:0/1898538259 conn(0x7f91cc0d1870 msgr2=0x7f91cc0b9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:37.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.311+0000 7f91d1800640 1 -- 172.21.15.165:0/1898538259 shutdown_connections 2024-09-11T23:17:37.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.311+0000 7f91d1800640 1 -- 172.21.15.165:0/1898538259 wait complete. 2024-09-11T23:17:37.326 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 47386322-40ca-4311-969e-cb6f51923511 7 2024-09-11T23:17:37.353 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:37.353+0000 7f9cf400d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:17:37.450 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:37.450+0000 7f9cf400d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:17:37.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.477+0000 7f3dd3200640 1 Processor -- start 2024-09-11T23:17:37.476 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.477+0000 7f3dd3200640 1 -- start start 2024-09-11T23:17:37.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.478+0000 7f3dd3200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3dd406faa0 0x7f3dd40cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.478+0000 7f3dd3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd40b6a30 0x7f3dd40cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.478+0000 7f3dd3200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dd40cfc20 con 0x7f3dd4145e90 2024-09-11T23:17:37.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.478+0000 7f3dd3200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3dd40b5a20 con 0x7f3dd406faa0 2024-09-11T23:17:37.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.478+0000 7f3dd3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd40b5c70 con 0x7f3dd40b6a30 2024-09-11T23:17:37.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.478+0000 7f3dd1e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f3dd4145e90 0x7f3dd406f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.165:46112/0 (socket says 172.21.15.165:46112) 2024-09-11T23:17:37.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.478+0000 7f3dd2800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd40b6a30 0x7f3dd40cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.478+0000 7f3dd1e00640 1 -- 172.21.15.165:0/3147793480 learned_addr learned my addr 172.21.15.165:0/3147793480 (peer_addr_for_me v1:172.21.15.165:0/0) 2024-09-11T23:17:37.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.478+0000 7f3dd1400640 1 --2- 172.21.15.165:0/3147793480 >> v2:172.21.15.144:3300/0 conn(0x7f3dd406faa0 0x7f3dd40cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.479+0000 7f3dd0a00640 1 -- 172.21.15.165:0/3147793480 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 833269597 0 0) 0x7f3dd40cfc20 con 0x7f3dd4145e90 2024-09-11T23:17:37.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.479+0000 7f3dd0a00640 1 -- 172.21.15.165:0/3147793480 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3db8003520 con 0x7f3dd4145e90 2024-09-11T23:17:37.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.479+0000 7f3dd2800640 1 -- 172.21.15.165:0/3147793480 >> v2:172.21.15.144:3300/0 conn(0x7f3dd406faa0 msgr2=0x7f3dd40cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:37.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.479+0000 7f3dd2800640 1 --2- 172.21.15.165:0/3147793480 >> v2:172.21.15.144:3300/0 conn(0x7f3dd406faa0 0x7f3dd40cf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.479+0000 7f3dd2800640 1 -- 172.21.15.165:0/3147793480 >> v1:172.21.15.165:6789/0 conn(0x7f3dd4145e90 legacy=0x7f3dd406f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.479+0000 7f3dd2800640 1 -- 172.21.15.165:0/3147793480 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd40b5f50 con 0x7f3dd40b6a30 2024-09-11T23:17:37.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.480+0000 7f3dd2800640 1 --2- 172.21.15.165:0/3147793480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd40b6a30 0x7f3dd40cf6e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40b5ba0 tx=0x7f3dcc02a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5be5064a426d55e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.480+0000 7f3dd0a00640 1 -- 172.21.15.165:0/3147793480 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc007740 con 0x7f3dd40b6a30 2024-09-11T23:17:37.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.480+0000 7f3dd0a00640 1 -- 172.21.15.165:0/3147793480 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dcc0078e0 con 0x7f3dd40b6a30 2024-09-11T23:17:37.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.480+0000 7f3dd0a00640 1 -- 172.21.15.165:0/3147793480 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc007c90 con 0x7f3dd40b6a30 2024-09-11T23:17:37.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.481+0000 7f3dd3200640 1 -- 172.21.15.165:0/3147793480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd40b6a30 msgr2=0x7f3dd40cf6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.481+0000 7f3dd3200640 1 --2- 172.21.15.165:0/3147793480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd40b6a30 0x7f3dd40cf6e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40b5ba0 tx=0x7f3dcc02a5b0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.481+0000 7f3dd3200640 1 -- 172.21.15.165:0/3147793480 shutdown_connections 2024-09-11T23:17:37.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.481+0000 7f3dd3200640 1 --2- 172.21.15.165:0/3147793480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd40b6a30 0x7f3dd40cf6e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.481+0000 7f3dd3200640 1 --2- 172.21.15.165:0/3147793480 >> v2:172.21.15.144:3300/0 conn(0x7f3dd406faa0 0x7f3dd40cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.481+0000 7f3dd3200640 1 -- 172.21.15.165:0/3147793480 >> 172.21.15.165:0/3147793480 conn(0x7f3dd4062630 msgr2=0x7f3dd4062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:37.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.481+0000 7f3dd3200640 1 -- 172.21.15.165:0/3147793480 shutdown_connections 2024-09-11T23:17:37.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.481+0000 7f3dd3200640 1 -- 172.21.15.165:0/3147793480 wait complete. 2024-09-11T23:17:37.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.483+0000 7f3dd3200640 1 Processor -- start 2024-09-11T23:17:37.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.483+0000 7f3dd3200640 1 -- start start 2024-09-11T23:17:37.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.484+0000 7f3dd3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd406faa0 0x7f3dd41f71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.484+0000 7f3dd3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd40b6a30 0x7f3dd41f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.484+0000 7f3dd3200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dd4145e90 0x7f3dd40b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.484+0000 7f3dd3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd415c8d0 con 0x7f3dd40b6a30 2024-09-11T23:17:37.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.484+0000 7f3dd3200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd40b6510 con 0x7f3dd4145e90 2024-09-11T23:17:37.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.484+0000 7f3dd3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3dd415ca50 con 0x7f3dd406faa0 2024-09-11T23:17:37.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.484+0000 7f3dd2800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dd4145e90 0x7f3dd40b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.484+0000 7f3dd1e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd406faa0 0x7f3dd41f71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.484+0000 7f3dd2800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dd4145e90 0x7f3dd40b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:39580/0 (socket says 172.21.15.165:39580) 2024-09-11T23:17:37.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.484+0000 7f3dd2800640 1 -- 172.21.15.165:0/2341778656 learned_addr learned my addr 172.21.15.165:0/2341778656 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-11T23:17:37.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.484+0000 7f3dd1400640 1 --2- 172.21.15.165:0/2341778656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd40b6a30 0x7f3dd41f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.485+0000 7f3dd2800640 1 -- 172.21.15.165:0/2341778656 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd406faa0 msgr2=0x7f3dd41f71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.485+0000 7f3dd2800640 1 --2- 172.21.15.165:0/2341778656 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd406faa0 0x7f3dd41f71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.485+0000 7f3dd2800640 1 -- 172.21.15.165:0/2341778656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd40b6a30 msgr2=0x7f3dd41f3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.485+0000 7f3dd2800640 1 --2- 172.21.15.165:0/2341778656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd40b6a30 0x7f3dd41f3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.485+0000 7f3dd2800640 1 -- 172.21.15.165:0/2341778656 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd406cec0 con 0x7f3dd4145e90 2024-09-11T23:17:37.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.485+0000 7f3dd1e00640 1 --2- 172.21.15.165:0/2341778656 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd406faa0 0x7f3dd41f71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:37.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.485+0000 7f3dd1400640 1 --2- 172.21.15.165:0/2341778656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd40b6a30 0x7f3dd41f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:37.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.485+0000 7f3dd2800640 1 --2- 172.21.15.165:0/2341778656 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dd4145e90 0x7f3dd40b3810 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc02aba0 tx=0x7f3dcc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.485+0000 7f3dca000640 1 -- 172.21.15.165:0/2341778656 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc009450 con 0x7f3dd4145e90 2024-09-11T23:17:37.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.485+0000 7f3dca000640 1 -- 172.21.15.165:0/2341778656 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dcc004240 con 0x7f3dd4145e90 2024-09-11T23:17:37.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.485+0000 7f3dd3200640 1 -- 172.21.15.165:0/2341778656 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd406d1a0 con 0x7f3dd4145e90 2024-09-11T23:17:37.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.485+0000 7f3dca000640 1 -- 172.21.15.165:0/2341778656 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc004630 con 0x7f3dd4145e90 2024-09-11T23:17:37.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.486+0000 7f3dd3200640 1 -- 172.21.15.165:0/2341778656 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd406d760 con 0x7f3dd4145e90 2024-09-11T23:17:37.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.486+0000 7f3dca000640 1 -- 172.21.15.165:0/2341778656 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3dcc039040 con 0x7f3dd4145e90 2024-09-11T23:17:37.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.486+0000 7f3dca000640 1 -- 172.21.15.165:0/2341778656 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f3dcc031400 con 0x7f3dd4145e90 2024-09-11T23:17:37.487 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.487+0000 7f3dd3200640 1 -- 172.21.15.165:0/2341778656 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd40cea10 con 0x7f3dd4145e90 2024-09-11T23:17:37.488 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.489+0000 7f3dca000640 1 -- 172.21.15.165:0/2341778656 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3dcc040030 con 0x7f3dd4145e90 2024-09-11T23:17:37.529 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:37.530+0000 7f316911e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:17:37.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.561+0000 7f3dd3200640 1 -- 172.21.15.165:0/2341778656 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd new", "uuid": "47386322-40ca-4311-969e-cb6f51923511", "id": 7} v 0) -- 0x7f3dd40693e0 con 0x7f3dd4145e90 2024-09-11T23:17:37.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.569+0000 7f3dca000640 1 -- 172.21.15.165:0/2341778656 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "47386322-40ca-4311-969e-cb6f51923511", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f3dcc03c7b0 con 0x7f3dd4145e90 2024-09-11T23:17:37.569 INFO:teuthology.orchestra.run.smithi165.stdout:7 2024-09-11T23:17:37.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.570+0000 7f3dd3200640 1 -- 172.21.15.165:0/2341778656 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dd4145e90 msgr2=0x7f3dd40b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.570+0000 7f3dd3200640 1 --2- 172.21.15.165:0/2341778656 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dd4145e90 0x7f3dd40b3810 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc02aba0 tx=0x7f3dcc004a40 comp rx=0 tx=0).stop 2024-09-11T23:17:37.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.570+0000 7f3dd3200640 1 -- 172.21.15.165:0/2341778656 shutdown_connections 2024-09-11T23:17:37.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.570+0000 7f3dd3200640 1 --2- 172.21.15.165:0/2341778656 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dd4145e90 0x7f3dd40b3810 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.570+0000 7f3dd3200640 1 --2- 172.21.15.165:0/2341778656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dd40b6a30 0x7f3dd41f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.570+0000 7f3dd3200640 1 --2- 172.21.15.165:0/2341778656 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dd406faa0 0x7f3dd41f71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.570+0000 7f3dd3200640 1 -- 172.21.15.165:0/2341778656 >> 172.21.15.165:0/2341778656 conn(0x7f3dd4062630 msgr2=0x7f3dd415f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:37.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.570+0000 7f3dd3200640 1 -- 172.21.15.165:0/2341778656 shutdown_connections 2024-09-11T23:17:37.571 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:17:37.571+0000 7f3dd3200640 1 -- 172.21.15.165:0/2341778656 wait complete. 2024-09-11T23:17:37.571 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:37.571+0000 7f9cf400d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:17:37.584 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-11T23:17:37.585 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-11T23:17:37.588 INFO:tasks.ceph.osd.0:Started 2024-09-11T23:17:37.589 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-11T23:17:37.589 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-11T23:17:37.592 INFO:tasks.ceph.osd.1:Started 2024-09-11T23:17:37.593 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T23:17:37.593 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-11T23:17:37.597 INFO:tasks.ceph.osd.2:Started 2024-09-11T23:17:37.598 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-11T23:17:37.599 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-11T23:17:37.605 INFO:tasks.ceph.osd.3:Started 2024-09-11T23:17:37.605 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-11T23:17:37.605 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-11T23:17:37.609 INFO:tasks.ceph.osd.4:Started 2024-09-11T23:17:37.609 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-11T23:17:37.609 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-11T23:17:37.613 INFO:tasks.ceph.osd.5:Started 2024-09-11T23:17:37.613 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-11T23:17:37.613 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-11T23:17:37.617 INFO:tasks.ceph.osd.6:Started 2024-09-11T23:17:37.617 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-11T23:17:37.617 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-11T23:17:37.622 INFO:tasks.ceph.osd.7:Started 2024-09-11T23:17:37.622 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:17:37.636 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:37.636+0000 7f9cf400d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:17:37.638 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:37.638+0000 7f316911e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:17:37.799 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:37.800+0000 7f316911e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:17:37.818 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:37.818+0000 7f9cf400d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:17:37.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.821+0000 7ff753e00640 1 Processor -- start 2024-09-11T23:17:37.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.822+0000 7ff753e00640 1 -- start start 2024-09-11T23:17:37.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.823+0000 7ff753e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff754161c70 0x7ff7540d32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.823+0000 7ff753e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff75406c780 0x7ff7540b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.823+0000 7ff753e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7540d2340 con 0x7ff7540d3820 2024-09-11T23:17:37.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.823+0000 7ff753e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff754162050 con 0x7ff754161c70 2024-09-11T23:17:37.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.823+0000 7ff753e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff7540b7d20 con 0x7ff75406c780 2024-09-11T23:17:37.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.823+0000 7ff752a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff754161c70 0x7ff7540d32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.823+0000 7ff753400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff75406c780 0x7ff7540b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.823+0000 7ff752000640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7ff7540d3820 0x7ff75406c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:54214/0 (socket says 172.21.15.144:54214) 2024-09-11T23:17:37.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.823+0000 7ff752000640 1 -- 172.21.15.144:0/1854145606 learned_addr learned my addr 172.21.15.144:0/1854145606 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:17:37.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.823+0000 7ff751600640 1 -- 172.21.15.144:0/1854145606 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 516165152 0 0) 0x7ff7540d2340 con 0x7ff7540d3820 2024-09-11T23:17:37.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.824+0000 7ff751600640 1 -- 172.21.15.144:0/1854145606 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff738003520 con 0x7ff7540d3820 2024-09-11T23:17:37.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.824+0000 7ff753400640 1 -- 172.21.15.144:0/1854145606 >> v2:172.21.15.144:3300/0 conn(0x7ff754161c70 msgr2=0x7ff7540d32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:37.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.824+0000 7ff753400640 1 --2- 172.21.15.144:0/1854145606 >> v2:172.21.15.144:3300/0 conn(0x7ff754161c70 0x7ff7540d32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.824+0000 7ff753400640 1 -- 172.21.15.144:0/1854145606 >> v1:172.21.15.165:6789/0 conn(0x7ff7540d3820 legacy=0x7ff75406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.824+0000 7ff753400640 1 -- 172.21.15.144:0/1854145606 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7540d3e50 con 0x7ff75406c780 2024-09-11T23:17:37.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.825+0000 7ff753400640 1 --2- 172.21.15.144:0/1854145606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff75406c780 0x7ff7540b81b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff7540b7ea0 tx=0x7ff74c02a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7587e7e085277cd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.825+0000 7ff751600640 1 -- 172.21.15.144:0/1854145606 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74c02ae60 con 0x7ff75406c780 2024-09-11T23:17:37.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.825+0000 7ff751600640 1 -- 172.21.15.144:0/1854145606 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff74c007740 con 0x7ff75406c780 2024-09-11T23:17:37.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.825+0000 7ff751600640 1 -- 172.21.15.144:0/1854145606 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74c007b10 con 0x7ff75406c780 2024-09-11T23:17:37.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.825+0000 7ff753e00640 1 -- 172.21.15.144:0/1854145606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff75406c780 msgr2=0x7ff7540b81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.825+0000 7ff753e00640 1 --2- 172.21.15.144:0/1854145606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff75406c780 0x7ff7540b81b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff7540b7ea0 tx=0x7ff74c02a640 comp rx=0 tx=0).stop 2024-09-11T23:17:37.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.825+0000 7ff753e00640 1 -- 172.21.15.144:0/1854145606 shutdown_connections 2024-09-11T23:17:37.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.825+0000 7ff753e00640 1 --2- 172.21.15.144:0/1854145606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff75406c780 0x7ff7540b81b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.825+0000 7ff753e00640 1 --2- 172.21.15.144:0/1854145606 >> v2:172.21.15.144:3300/0 conn(0x7ff754161c70 0x7ff7540d32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.825+0000 7ff753e00640 1 -- 172.21.15.144:0/1854145606 >> 172.21.15.144:0/1854145606 conn(0x7ff754062a20 msgr2=0x7ff754062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:37.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.826+0000 7ff753e00640 1 -- 172.21.15.144:0/1854145606 shutdown_connections 2024-09-11T23:17:37.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.826+0000 7ff753e00640 1 -- 172.21.15.144:0/1854145606 wait complete. 2024-09-11T23:17:37.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.827+0000 7ff753e00640 1 Processor -- start 2024-09-11T23:17:37.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.827+0000 7ff753e00640 1 -- start start 2024-09-11T23:17:37.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.828+0000 7ff753e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff75406c780 0x7ff7541f3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.828+0000 7ff753e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7540d3820 0x7ff7540b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.828+0000 7ff753e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff754161c70 0x7ff75415aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:37.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.828+0000 7ff753e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff7540b75f0 con 0x7ff75406c780 2024-09-11T23:17:37.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.828+0000 7ff753e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff7540b79b0 con 0x7ff754161c70 2024-09-11T23:17:37.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.828+0000 7ff753e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff7540b7770 con 0x7ff7540d3820 2024-09-11T23:17:37.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.828+0000 7ff752a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff75406c780 0x7ff7541f3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.828+0000 7ff752000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7540d3820 0x7ff7540b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.829+0000 7ff753400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff754161c70 0x7ff75415aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:37.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.829+0000 7ff752000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7540d3820 0x7ff7540b68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:57468/0 (socket says 172.21.15.144:57468) 2024-09-11T23:17:37.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.829+0000 7ff752a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff75406c780 0x7ff7541f3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35062/0 (socket says 172.21.15.144:35062) 2024-09-11T23:17:37.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.829+0000 7ff753400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff754161c70 0x7ff75415aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:60508/0 (socket says 172.21.15.144:60508) 2024-09-11T23:17:37.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.829+0000 7ff752000640 1 -- 172.21.15.144:0/1565296279 learned_addr learned my addr 172.21.15.144:0/1565296279 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:17:37.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.829+0000 7ff752000640 1 -- 172.21.15.144:0/1565296279 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff754161c70 msgr2=0x7ff75415aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.829+0000 7ff752000640 1 --2- 172.21.15.144:0/1565296279 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff754161c70 0x7ff75415aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.829+0000 7ff752000640 1 -- 172.21.15.144:0/1565296279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff75406c780 msgr2=0x7ff7541f3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.829+0000 7ff752000640 1 --2- 172.21.15.144:0/1565296279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff75406c780 0x7ff7541f3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.829+0000 7ff752000640 1 -- 172.21.15.144:0/1565296279 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7541f45c0 con 0x7ff7540d3820 2024-09-11T23:17:37.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.829+0000 7ff752000640 1 --2- 172.21.15.144:0/1565296279 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7540d3820 0x7ff7540b68d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff74000c460 tx=0x7ff74000c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:37.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.829+0000 7ff74aa00640 1 -- 172.21.15.144:0/1565296279 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff740017070 con 0x7ff7540d3820 2024-09-11T23:17:37.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.830+0000 7ff74aa00640 1 -- 172.21.15.144:0/1565296279 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff740005ce0 con 0x7ff7540d3820 2024-09-11T23:17:37.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.830+0000 7ff74aa00640 1 -- 172.21.15.144:0/1565296279 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff740007290 con 0x7ff7540d3820 2024-09-11T23:17:37.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.830+0000 7ff753e00640 1 -- 172.21.15.144:0/1565296279 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7541f48a0 con 0x7ff7540d3820 2024-09-11T23:17:37.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.830+0000 7ff753e00640 1 -- 172.21.15.144:0/1565296279 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7541f4e60 con 0x7ff7540d3820 2024-09-11T23:17:37.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.830+0000 7ff74aa00640 1 -- 172.21.15.144:0/1565296279 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff74001a070 con 0x7ff7540d3820 2024-09-11T23:17:37.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.830+0000 7ff74aa00640 1 -- 172.21.15.144:0/1565296279 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff740007430 con 0x7ff7540d3820 2024-09-11T23:17:37.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.831+0000 7ff753e00640 1 -- 172.21.15.144:0/1565296279 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7540cacb0 con 0x7ff7540d3820 2024-09-11T23:17:37.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.833+0000 7ff74aa00640 1 -- 172.21.15.144:0/1565296279 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff740021080 con 0x7ff7540d3820 2024-09-11T23:17:37.857 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:37.858+0000 7f316911e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:17:37.884 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:37.884+0000 7f9cf400d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:17:37.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.895+0000 7ff753e00640 1 -- 172.21.15.144:0/1565296279 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff754073e00 con 0x7ff7540d3820 2024-09-11T23:17:37.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.896+0000 7ff74aa00640 1 -- 172.21.15.144:0/1565296279 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff74001c440 con 0x7ff7540d3820 2024-09-11T23:17:37.896 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:17:37.896 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":10,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:17:37.562735+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:17:37.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.897+0000 7ff753e00640 1 -- 172.21.15.144:0/1565296279 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7540d3820 msgr2=0x7ff7540b68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:37.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.897+0000 7ff753e00640 1 --2- 172.21.15.144:0/1565296279 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7540d3820 0x7ff7540b68d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff74000c460 tx=0x7ff74000c920 comp rx=0 tx=0).stop 2024-09-11T23:17:37.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.897+0000 7ff753e00640 1 -- 172.21.15.144:0/1565296279 shutdown_connections 2024-09-11T23:17:37.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.897+0000 7ff753e00640 1 --2- 172.21.15.144:0/1565296279 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff754161c70 0x7ff75415aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.897+0000 7ff753e00640 1 --2- 172.21.15.144:0/1565296279 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7540d3820 0x7ff7540b68d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.897+0000 7ff753e00640 1 --2- 172.21.15.144:0/1565296279 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff75406c780 0x7ff7541f3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:37.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.897+0000 7ff753e00640 1 -- 172.21.15.144:0/1565296279 >> 172.21.15.144:0/1565296279 conn(0x7ff754062a20 msgr2=0x7ff754160450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:37.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.897+0000 7ff753e00640 1 -- 172.21.15.144:0/1565296279 shutdown_connections 2024-09-11T23:17:37.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:37.897+0000 7ff753e00640 1 -- 172.21.15.144:0/1565296279 wait complete. 2024-09-11T23:17:37.913 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-11T23:17:37.913 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-11T23:17:37.941 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:37.941+0000 7f9cf400d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:17:37.986 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:37.986+0000 7f316911e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:17:38.049 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:38.049+0000 7f316911e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:17:38.070 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:38.070+0000 7f9cf400d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:17:38.105 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:38.105+0000 7f316911e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:17:38.128 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:38.128+0000 7f9cf400d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:17:38.187 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:38.187+0000 7f9cf400d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:17:38.229 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:38.230+0000 7f316911e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:17:38.265 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:38.264+0000 7f9cf400d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:17:38.287 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:38.287+0000 7f316911e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:17:38.317 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:38.317+0000 7f9cf400d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:17:38.349 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:38.350+0000 7f316911e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:17:38.370 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:38.370+0000 7f9cf400d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:17:38.429 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:38.430+0000 7f316911e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:17:38.480 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:38.481+0000 7f316911e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:17:38.532 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:38.532+0000 7f316911e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:17:38.719 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T23:17:38.855 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.854+0000 7f6bd6a00640 1 Processor -- start 2024-09-11T23:17:38.855 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.854+0000 7f6bd6a00640 1 -- start start 2024-09-11T23:17:38.857 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.855+0000 7f6bd6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6bd015e820 0x7f6bd00b9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.858 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.855+0000 7f6bd6a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00d4110 0x7f6bd00cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.858 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.856+0000 7f6bd6a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bd00d2a70 con 0x7f6bd00d3b10 2024-09-11T23:17:38.858 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.856+0000 7f6bd6a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6bd00d2d50 con 0x7f6bd015e820 2024-09-11T23:17:38.858 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.856+0000 7f6bd6a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd00d3030 con 0x7f6bd00d4110 2024-09-11T23:17:38.858 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.856+0000 7f6bcfe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6bd015e820 0x7f6bd00b9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.859 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.856+0000 7f6bc7e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00d4110 0x7f6bd00cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.859 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.856+0000 7f6bcfe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6bd015e820 0x7f6bd00b9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:35068/0 (socket says 172.21.15.144:35068) 2024-09-11T23:17:38.859 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.856+0000 7f6bcfe00640 1 -- 172.21.15.144:0/823118513 learned_addr learned my addr 172.21.15.144:0/823118513 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:17:38.859 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.856+0000 7f6bc7e00640 1 -- 172.21.15.144:0/823118513 >> v2:172.21.15.144:3300/0 conn(0x7f6bd015e820 msgr2=0x7f6bd00b9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:38.859 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.856+0000 7f6bc7e00640 1 --2- 172.21.15.144:0/823118513 >> v2:172.21.15.144:3300/0 conn(0x7f6bd015e820 0x7f6bd00b9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.859 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.856+0000 7f6bc7e00640 1 -- 172.21.15.144:0/823118513 >> v1:172.21.15.165:6789/0 conn(0x7f6bd00d3b10 legacy=0x7f6bd00678d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.860 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.856+0000 7f6bc7e00640 1 -- 172.21.15.144:0/823118513 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd00d3310 con 0x7f6bd00d4110 2024-09-11T23:17:38.860 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.856+0000 7f6bcf400640 1 -- 172.21.15.144:0/823118513 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 601084352 0 0) 0x7f6bd00d2a70 con 0x7f6bd00d3b10 2024-09-11T23:17:38.860 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.857+0000 7f6bc7e00640 1 --2- 172.21.15.144:0/823118513 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00d4110 0x7f6bd00cf3e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80097a0 tx=0x7f6bb802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53977202291f56eb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:38.860 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.858+0000 7f6bcf400640 1 -- 172.21.15.144:0/823118513 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8037070 con 0x7f6bd00d4110 2024-09-11T23:17:38.860 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.858+0000 7f6bcf400640 1 -- 172.21.15.144:0/823118513 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb8032440 con 0x7f6bd00d4110 2024-09-11T23:17:38.860 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.858+0000 7f6bcf400640 1 -- 172.21.15.144:0/823118513 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8032810 con 0x7f6bd00d4110 2024-09-11T23:17:38.866 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.858+0000 7f6bd6a00640 1 -- 172.21.15.144:0/823118513 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00d4110 msgr2=0x7f6bd00cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.866 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.858+0000 7f6bd6a00640 1 --2- 172.21.15.144:0/823118513 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00d4110 0x7f6bd00cf3e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80097a0 tx=0x7f6bb802a210 comp rx=0 tx=0).stop 2024-09-11T23:17:38.866 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.858+0000 7f6bd6a00640 1 -- 172.21.15.144:0/823118513 shutdown_connections 2024-09-11T23:17:38.866 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.858+0000 7f6bd6a00640 1 --2- 172.21.15.144:0/823118513 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00d4110 0x7f6bd00cf3e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.866 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.858+0000 7f6bd6a00640 1 --2- 172.21.15.144:0/823118513 >> v2:172.21.15.144:3300/0 conn(0x7f6bd015e820 0x7f6bd00b9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.867 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.858+0000 7f6bd6a00640 1 -- 172.21.15.144:0/823118513 >> 172.21.15.144:0/823118513 conn(0x7f6bd0072860 msgr2=0x7f6bd00d4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:38.867 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.858+0000 7f6bd6a00640 1 -- 172.21.15.144:0/823118513 shutdown_connections 2024-09-11T23:17:38.867 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.858+0000 7f6bd6a00640 1 -- 172.21.15.144:0/823118513 wait complete. 2024-09-11T23:17:38.867 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.860+0000 7f6bd6a00640 1 Processor -- start 2024-09-11T23:17:38.867 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.860+0000 7f6bd6a00640 1 -- start start 2024-09-11T23:17:38.867 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.861+0000 7f6bd6a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00d3b10 0x7f6bd015a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.868 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.861+0000 7f6bd6a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bd00d4110 0x7f6bd01482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.868 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.861+0000 7f6bd6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bd015e820 0x7f6bd00b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:38.868 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.861+0000 7f6bd6a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd015ed80 con 0x7f6bd015e820 2024-09-11T23:17:38.868 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.861+0000 7f6bd6a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd015ec00 con 0x7f6bd00d4110 2024-09-11T23:17:38.868 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.861+0000 7f6bd6a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd00ba4d0 con 0x7f6bd00d3b10 2024-09-11T23:17:38.869 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.861+0000 7f6bcfe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00d3b10 0x7f6bd015a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.869 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.861+0000 7f6bc7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bd00d4110 0x7f6bd01482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.869 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.862+0000 7f6bcfe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00d3b10 0x7f6bd015a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:57500/0 (socket says 172.21.15.144:57500) 2024-09-11T23:17:38.869 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.861+0000 7f6bd4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bd015e820 0x7f6bd00b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:38.869 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.862+0000 7f6bcfe00640 1 -- 172.21.15.144:0/3525281540 learned_addr learned my addr 172.21.15.144:0/3525281540 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:17:38.870 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.862+0000 7f6bcfe00640 1 -- 172.21.15.144:0/3525281540 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bd00d4110 msgr2=0x7f6bd01482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.870 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.862+0000 7f6bcfe00640 1 --2- 172.21.15.144:0/3525281540 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bd00d4110 0x7f6bd01482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.870 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.862+0000 7f6bcfe00640 1 -- 172.21.15.144:0/3525281540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bd015e820 msgr2=0x7f6bd00b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.870 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.862+0000 7f6bcfe00640 1 --2- 172.21.15.144:0/3525281540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bd015e820 0x7f6bd00b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.870 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.862+0000 7f6bcfe00640 1 -- 172.21.15.144:0/3525281540 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd00cd1e0 con 0x7f6bd00d3b10 2024-09-11T23:17:38.870 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.862+0000 7f6bc7e00640 1 --2- 172.21.15.144:0/3525281540 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bd00d4110 0x7f6bd01482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:17:38.871 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.862+0000 7f6bcfe00640 1 --2- 172.21.15.144:0/3525281540 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00d3b10 0x7f6bd015a510 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000e840 tx=0x7f6bc000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:38.871 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.862+0000 7f6bccc00640 1 -- 172.21.15.144:0/3525281540 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0017070 con 0x7f6bd00d3b10 2024-09-11T23:17:38.871 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.862+0000 7f6bccc00640 1 -- 172.21.15.144:0/3525281540 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc000c8e0 con 0x7f6bd00d3b10 2024-09-11T23:17:38.871 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.863+0000 7f6bccc00640 1 -- 172.21.15.144:0/3525281540 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc000ccd0 con 0x7f6bd00d3b10 2024-09-11T23:17:38.871 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.863+0000 7f6bd6a00640 1 -- 172.21.15.144:0/3525281540 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bd01487f0 con 0x7f6bd00d3b10 2024-09-11T23:17:38.871 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.863+0000 7f6bd6a00640 1 -- 172.21.15.144:0/3525281540 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bd00cd760 con 0x7f6bd00d3b10 2024-09-11T23:17:38.872 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.863+0000 7f6bccc00640 1 -- 172.21.15.144:0/3525281540 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6bc001a070 con 0x7f6bd00d3b10 2024-09-11T23:17:38.872 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.863+0000 7f6bccc00640 1 -- 172.21.15.144:0/3525281540 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f6bc0013b40 con 0x7f6bd00d3b10 2024-09-11T23:17:38.872 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.864+0000 7f6bd6a00640 1 -- 172.21.15.144:0/3525281540 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bd00b9f90 con 0x7f6bd00d3b10 2024-09-11T23:17:38.873 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.866+0000 7f6bccc00640 1 -- 172.21.15.144:0/3525281540 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6bc0006430 con 0x7f6bd00d3b10 2024-09-11T23:17:38.946 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.947+0000 7f6bd6a00640 1 -- 172.21.15.144:0/3525281540 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6bd00d0280 con 0x7f6bd00d3b10 2024-09-11T23:17:38.947 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.947+0000 7f6bccc00640 1 -- 172.21.15.144:0/3525281540 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f6bc0006610 con 0x7f6bd00d3b10 2024-09-11T23:17:38.947 INFO:teuthology.misc.health.smithi144.stdout: 2024-09-11T23:17:38.947 INFO:teuthology.misc.health.smithi144.stdout:{"epoch":10,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:17:37.562735+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:17:38.948 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.948+0000 7f6bd6a00640 1 -- 172.21.15.144:0/3525281540 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00d3b10 msgr2=0x7f6bd015a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:38.949 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.948+0000 7f6bd6a00640 1 --2- 172.21.15.144:0/3525281540 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00d3b10 0x7f6bd015a510 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000e840 tx=0x7f6bc000ed00 comp rx=0 tx=0).stop 2024-09-11T23:17:38.949 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.949+0000 7f6bd6a00640 1 -- 172.21.15.144:0/3525281540 shutdown_connections 2024-09-11T23:17:38.949 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.949+0000 7f6bd6a00640 1 --2- 172.21.15.144:0/3525281540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bd015e820 0x7f6bd00b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.949 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.949+0000 7f6bd6a00640 1 --2- 172.21.15.144:0/3525281540 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bd00d4110 0x7f6bd01482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.949 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.949+0000 7f6bd6a00640 1 --2- 172.21.15.144:0/3525281540 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00d3b10 0x7f6bd015a510 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:38.949 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.949+0000 7f6bd6a00640 1 -- 172.21.15.144:0/3525281540 >> 172.21.15.144:0/3525281540 conn(0x7f6bd0072860 msgr2=0x7f6bd00b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:38.949 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.949+0000 7f6bd6a00640 1 -- 172.21.15.144:0/3525281540 shutdown_connections 2024-09-11T23:17:38.949 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:38.949+0000 7f6bd6a00640 1 -- 172.21.15.144:0/3525281540 wait complete. 2024-09-11T23:17:38.960 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-11T23:17:39.149 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:39.149+0000 7f9cf400d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:17:39.293 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:17:39.291+0000 7f316911e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:17:39.437 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-11T23:17:39.437+0000 7f5455812640 -1 Falling back to public interface 2024-09-11T23:17:39.656 INFO:tasks.ceph.osd.0.smithi144.stderr:2024-09-11T23:17:39.656+0000 7fd6ff00f640 -1 Falling back to public interface 2024-09-11T23:17:39.656 INFO:tasks.ceph.osd.1.smithi144.stderr:2024-09-11T23:17:39.656+0000 7fa644c1f640 -1 Falling back to public interface 2024-09-11T23:17:39.669 INFO:tasks.ceph.osd.5.smithi165.stderr:2024-09-11T23:17:39.670+0000 7f90fa02c640 -1 Falling back to public interface 2024-09-11T23:17:39.673 INFO:tasks.ceph.osd.4.smithi165.stderr:2024-09-11T23:17:39.673+0000 7f04e2a0d640 -1 Falling back to public interface 2024-09-11T23:17:39.681 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-09-11T23:17:39.682+0000 7f732dbdb640 -1 Falling back to public interface 2024-09-11T23:17:39.711 INFO:tasks.ceph.osd.7.smithi165.stderr:2024-09-11T23:17:39.712+0000 7ff62aee6640 -1 Falling back to public interface 2024-09-11T23:17:39.712 INFO:tasks.ceph.osd.6.smithi165.stderr:2024-09-11T23:17:39.712+0000 7fd56de26640 -1 Falling back to public interface 2024-09-11T23:17:40.171 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:17:40.171+0000 7f9c93600640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-11T23:17:42.822 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:17:42.827 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:17:43.935 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-09-11T23:17:43.935+0000 7f732dbdb640 -1 osd.2 0 log_to_monitors true 2024-09-11T23:17:43.936 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-11T23:17:43.937+0000 7f5455812640 -1 osd.3 0 log_to_monitors true 2024-09-11T23:17:44.070 INFO:tasks.ceph.osd.0.smithi144.stderr:2024-09-11T23:17:44.070+0000 7fd6ff00f640 -1 osd.0 0 log_to_monitors true 2024-09-11T23:17:44.100 INFO:tasks.ceph.osd.1.smithi144.stderr:2024-09-11T23:17:44.100+0000 7fa644c1f640 -1 osd.1 0 log_to_monitors true 2024-09-11T23:17:44.361 INFO:tasks.ceph.osd.5.smithi165.stderr:2024-09-11T23:17:44.362+0000 7f90fa02c640 -1 osd.5 0 log_to_monitors true 2024-09-11T23:17:44.369 INFO:tasks.ceph.osd.6.smithi165.stderr:2024-09-11T23:17:44.369+0000 7fd56de26640 -1 osd.6 0 log_to_monitors true 2024-09-11T23:17:44.610 INFO:tasks.ceph.osd.4.smithi165.stderr:2024-09-11T23:17:44.608+0000 7f04e2a0d640 -1 osd.4 0 log_to_monitors true 2024-09-11T23:17:44.659 INFO:tasks.ceph.osd.7.smithi165.stderr:2024-09-11T23:17:44.660+0000 7ff62aee6640 -1 osd.7 0 log_to_monitors true 2024-09-11T23:17:45.766 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T23:17:45.948 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.948+0000 7f13c1800640 1 Processor -- start 2024-09-11T23:17:45.948 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.948+0000 7f13c1800640 1 -- start start 2024-09-11T23:17:45.949 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.949+0000 7f13c1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13bc0d4110 0x7f13bc0cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:45.949 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.950+0000 7f13c1800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f13bc0d3b10 0x7f13bc0cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:45.949 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.950+0000 7f13c1800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13bc0d2a70 con 0x7f13bc15e820 2024-09-11T23:17:45.949 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.950+0000 7f13c1800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f13bc0d2d50 con 0x7f13bc0d3b10 2024-09-11T23:17:45.950 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.950+0000 7f13c1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f13bc0d3030 con 0x7f13bc0d4110 2024-09-11T23:17:45.950 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.950+0000 7f13bb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f13bc0d3b10 0x7f13bc0cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:45.951 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.950+0000 7f13bb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f13bc0d3b10 0x7f13bc0cf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36804/0 (socket says 172.21.15.144:36804) 2024-09-11T23:17:45.951 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.950+0000 7f13bb400640 1 -- 172.21.15.144:0/1793649221 learned_addr learned my addr 172.21.15.144:0/1793649221 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:17:45.951 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.950+0000 7f13ba000640 1 --2- 172.21.15.144:0/1793649221 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13bc0d4110 0x7f13bc0cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:45.951 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.950+0000 7f13bb400640 1 -- 172.21.15.144:0/1793649221 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13bc0d4110 msgr2=0x7f13bc0cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:45.951 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.950+0000 7f13bb400640 1 --2- 172.21.15.144:0/1793649221 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13bc0d4110 0x7f13bc0cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:45.951 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.950+0000 7f13bb400640 1 -- 172.21.15.144:0/1793649221 >> v1:172.21.15.165:6789/0 conn(0x7f13bc15e820 legacy=0x7f13bc0b9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:45.951 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.950+0000 7f13bb400640 1 -- 172.21.15.144:0/1793649221 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13bc0d3310 con 0x7f13bc0d3b10 2024-09-11T23:17:45.951 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.952+0000 7f13bb400640 1 --2- 172.21.15.144:0/1793649221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc0d3b10 0x7f13bc0cf920 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009e50 tx=0x7f13b402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e31d0a53833127 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:45.952 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.952+0000 7f13b9600640 1 -- 172.21.15.144:0/1793649221 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4036070 con 0x7f13bc0d3b10 2024-09-11T23:17:45.952 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.952+0000 7f13b9600640 1 -- 172.21.15.144:0/1793649221 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b4031600 con 0x7f13bc0d3b10 2024-09-11T23:17:45.952 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.952+0000 7f13b9600640 1 -- 172.21.15.144:0/1793649221 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b40319d0 con 0x7f13bc0d3b10 2024-09-11T23:17:45.953 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.953+0000 7f13c1800640 1 -- 172.21.15.144:0/1793649221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc0d3b10 msgr2=0x7f13bc0cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:45.953 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.953+0000 7f13c1800640 1 --2- 172.21.15.144:0/1793649221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc0d3b10 0x7f13bc0cf920 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009e50 tx=0x7f13b402a7a0 comp rx=0 tx=0).stop 2024-09-11T23:17:45.953 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.953+0000 7f13c1800640 1 -- 172.21.15.144:0/1793649221 shutdown_connections 2024-09-11T23:17:45.953 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.953+0000 7f13c1800640 1 --2- 172.21.15.144:0/1793649221 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc0d3b10 0x7f13bc0cf920 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:45.953 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.953+0000 7f13c1800640 1 --2- 172.21.15.144:0/1793649221 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13bc0d4110 0x7f13bc0cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:45.954 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.953+0000 7f13c1800640 1 -- 172.21.15.144:0/1793649221 >> 172.21.15.144:0/1793649221 conn(0x7f13bc072860 msgr2=0x7f13bc0d4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:45.954 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.953+0000 7f13c1800640 1 -- 172.21.15.144:0/1793649221 shutdown_connections 2024-09-11T23:17:45.954 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.954+0000 7f13c1800640 1 -- 172.21.15.144:0/1793649221 wait complete. 2024-09-11T23:17:45.956 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.956+0000 7f13c1800640 1 Processor -- start 2024-09-11T23:17:45.956 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.956+0000 7f13c1800640 1 -- start start 2024-09-11T23:17:45.958 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.958+0000 7f13c1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13bc0d3b10 0x7f13bc0cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:45.958 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.958+0000 7f13c1800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc0d4110 0x7f13bc161830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:45.958 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.958+0000 7f13c1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc15e820 0x7f13bc152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:45.958 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.958+0000 7f13c1800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc15ed80 con 0x7f13bc15e820 2024-09-11T23:17:45.958 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.958+0000 7f13c1800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc15ec00 con 0x7f13bc0d4110 2024-09-11T23:17:45.958 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.958+0000 7f13c1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f13bc0b77a0 con 0x7f13bc0d3b10 2024-09-11T23:17:45.958 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.958+0000 7f13bb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc15e820 0x7f13bc152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:45.959 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.958+0000 7f13bb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc15e820 0x7f13bc152530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36810/0 (socket says 172.21.15.144:36810) 2024-09-11T23:17:45.959 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.958+0000 7f13bb400640 1 -- 172.21.15.144:0/2731082506 learned_addr learned my addr 172.21.15.144:0/2731082506 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:17:45.959 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.958+0000 7f13baa00640 1 --2- 172.21.15.144:0/2731082506 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13bc0d3b10 0x7f13bc0cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:45.959 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.958+0000 7f13ba000640 1 --2- 172.21.15.144:0/2731082506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc0d4110 0x7f13bc161830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:45.960 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.959+0000 7f13bb400640 1 -- 172.21.15.144:0/2731082506 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13bc0d3b10 msgr2=0x7f13bc0cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:45.960 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.959+0000 7f13bb400640 1 --2- 172.21.15.144:0/2731082506 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13bc0d3b10 0x7f13bc0cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:45.960 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.959+0000 7f13bb400640 1 -- 172.21.15.144:0/2731082506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc0d4110 msgr2=0x7f13bc161830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:45.960 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.959+0000 7f13bb400640 1 --2- 172.21.15.144:0/2731082506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc0d4110 0x7f13bc161830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:45.960 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.959+0000 7f13bb400640 1 -- 172.21.15.144:0/2731082506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13bc0cdc30 con 0x7f13bc15e820 2024-09-11T23:17:45.960 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.959+0000 7f13ba000640 1 --2- 172.21.15.144:0/2731082506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc0d4110 0x7f13bc161830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:17:45.960 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.959+0000 7f13bb400640 1 --2- 172.21.15.144:0/2731082506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc15e820 0x7f13bc152530 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009f70 tx=0x7f13b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:45.960 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.960+0000 7f13b2a00640 1 -- 172.21.15.144:0/2731082506 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4041020 con 0x7f13bc15e820 2024-09-11T23:17:45.961 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.960+0000 7f13b2a00640 1 -- 172.21.15.144:0/2731082506 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b4008730 con 0x7f13bc15e820 2024-09-11T23:17:45.961 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.960+0000 7f13b2a00640 1 -- 172.21.15.144:0/2731082506 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4036040 con 0x7f13bc15e820 2024-09-11T23:17:45.961 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.960+0000 7f13c1800640 1 -- 172.21.15.144:0/2731082506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13bc0c8350 con 0x7f13bc15e820 2024-09-11T23:17:45.961 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.960+0000 7f13c1800640 1 -- 172.21.15.144:0/2731082506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13bc0c8910 con 0x7f13bc15e820 2024-09-11T23:17:45.961 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.961+0000 7f13c1800640 1 -- 172.21.15.144:0/2731082506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13bc0ceb40 con 0x7f13bc15e820 2024-09-11T23:17:45.962 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.962+0000 7f13b2a00640 1 -- 172.21.15.144:0/2731082506 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f13b4044020 con 0x7f13bc15e820 2024-09-11T23:17:45.963 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.964+0000 7f13b2a00640 1 --2- 172.21.15.144:0/2731082506 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f139c06bdf0 0x7f139c06e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:45.964 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.964+0000 7f13b2a00640 1 -- 172.21.15.144:0/2731082506 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2025+0+0 (secure 0 0 0) 0x7f13b40aaa40 con 0x7f13bc15e820 2024-09-11T23:17:45.964 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.964+0000 7f13baa00640 1 --2- 172.21.15.144:0/2731082506 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f139c06bdf0 0x7f139c06e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:45.964 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.965+0000 7f13baa00640 1 --2- 172.21.15.144:0/2731082506 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f139c06bdf0 0x7f139c06e2b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0016e0 tx=0x7f13ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:45.970 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:45.971+0000 7f13b2a00640 1 -- 172.21.15.144:0/2731082506 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f13bc0ceb40 con 0x7f13bc15e820 2024-09-11T23:17:46.259 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:46.259+0000 7f13c1800640 1 -- 172.21.15.144:0/2731082506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13bc0c8b10 con 0x7f13bc15e820 2024-09-11T23:17:46.260 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:46.260+0000 7f13b2a00640 1 -- 172.21.15.144:0/2731082506 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7058 (secure 0 0 0) 0x7f13bc0c8b10 con 0x7f13bc15e820 2024-09-11T23:17:46.260 INFO:teuthology.misc.health.smithi144.stdout: 2024-09-11T23:17:46.261 INFO:teuthology.misc.health.smithi144.stdout:{"epoch":13,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:17:46.002365+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:17:46.264 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:46.264+0000 7f13c1800640 1 -- 172.21.15.144:0/2731082506 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f139c06bdf0 msgr2=0x7f139c06e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:46.264 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:46.264+0000 7f13c1800640 1 --2- 172.21.15.144:0/2731082506 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f139c06bdf0 0x7f139c06e2b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0016e0 tx=0x7f13ac009040 comp rx=0 tx=0).stop 2024-09-11T23:17:46.265 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:46.264+0000 7f13c1800640 1 -- 172.21.15.144:0/2731082506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc15e820 msgr2=0x7f13bc152530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:46.265 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:46.264+0000 7f13c1800640 1 --2- 172.21.15.144:0/2731082506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc15e820 0x7f13bc152530 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009f70 tx=0x7f13b4004a40 comp rx=0 tx=0).stop 2024-09-11T23:17:46.265 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:46.264+0000 7f13c1800640 1 -- 172.21.15.144:0/2731082506 shutdown_connections 2024-09-11T23:17:46.265 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:46.264+0000 7f13c1800640 1 --2- 172.21.15.144:0/2731082506 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f139c06bdf0 0x7f139c06e2b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:46.265 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:46.264+0000 7f13c1800640 1 --2- 172.21.15.144:0/2731082506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13bc15e820 0x7f13bc152530 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:46.265 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:46.264+0000 7f13c1800640 1 --2- 172.21.15.144:0/2731082506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13bc0d4110 0x7f13bc161830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:46.265 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:46.264+0000 7f13c1800640 1 --2- 172.21.15.144:0/2731082506 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13bc0d3b10 0x7f13bc0cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:46.265 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:46.264+0000 7f13c1800640 1 -- 172.21.15.144:0/2731082506 >> 172.21.15.144:0/2731082506 conn(0x7f13bc072860 msgr2=0x7f13bc0b4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:46.265 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:46.265+0000 7f13c1800640 1 -- 172.21.15.144:0/2731082506 shutdown_connections 2024-09-11T23:17:46.265 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:46.265+0000 7f13c1800640 1 -- 172.21.15.144:0/2731082506 wait complete. 2024-09-11T23:17:46.283 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-11T23:17:46.573 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-11T23:17:46.573+0000 7f544f600640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T23:17:46.585 INFO:tasks.ceph.osd.3.smithi144.stderr:2024-09-11T23:17:46.585+0000 7f5446000640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:17:46.600 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-09-11T23:17:46.600+0000 7f7328000640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T23:17:46.610 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-09-11T23:17:46.611+0000 7f731ea00640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:17:47.472 INFO:tasks.ceph.osd.1.smithi144.stderr:2024-09-11T23:17:47.472+0000 7fa63ec00640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T23:17:47.478 INFO:tasks.ceph.osd.1.smithi144.stderr:2024-09-11T23:17:47.478+0000 7fa635600640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:17:47.486 INFO:tasks.ceph.osd.0.smithi144.stderr:2024-09-11T23:17:47.486+0000 7fd6fa200640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T23:17:47.496 INFO:tasks.ceph.osd.0.smithi144.stderr:2024-09-11T23:17:47.497+0000 7fd6ef800640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:17:48.236 INFO:tasks.ceph.osd.7.smithi165.stderr:2024-09-11T23:17:48.236+0000 7ff625400640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T23:17:48.248 INFO:tasks.ceph.osd.7.smithi165.stderr:2024-09-11T23:17:48.247+0000 7ff61be00640 -1 osd.7 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:17:48.292 INFO:tasks.ceph.osd.4.smithi165.stderr:2024-09-11T23:17:48.293+0000 7f04dca00640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T23:17:48.301 INFO:tasks.ceph.osd.4.smithi165.stderr:2024-09-11T23:17:48.302+0000 7f04d3400640 -1 osd.4 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:17:48.311 INFO:tasks.ceph.osd.6.smithi165.stderr:2024-09-11T23:17:48.312+0000 7fd568200640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T23:17:48.316 INFO:tasks.ceph.osd.6.smithi165.stderr:2024-09-11T23:17:48.316+0000 7fd55ec00640 -1 osd.6 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:17:48.346 INFO:tasks.ceph.osd.5.smithi165.stderr:2024-09-11T23:17:48.347+0000 7f90f4400640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T23:17:48.352 INFO:tasks.ceph.osd.5.smithi165.stderr:2024-09-11T23:17:48.353+0000 7f90eae00640 -1 osd.5 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T23:17:53.091 DEBUG:teuthology.orchestra.run.smithi144:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T23:17:53.236 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.235+0000 7f5968c00640 1 Processor -- start 2024-09-11T23:17:53.236 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.235+0000 7f5968c00640 1 -- start start 2024-09-11T23:17:53.238 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.236+0000 7f5968c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f59640d14b0 0x7f59640cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:53.238 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.236+0000 7f5968c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59640d4760 con 0x7f596415e670 2024-09-11T23:17:53.238 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.236+0000 7f5968c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59640d4a40 con 0x7f5964162450 2024-09-11T23:17:53.238 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.236+0000 7f5968c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f59640d4510 con 0x7f59640d14b0 2024-09-11T23:17:53.238 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.236+0000 7f5963400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f596415e670 0x7f59640d3bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52410/0 (socket says 172.21.15.144:52410) 2024-09-11T23:17:53.238 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.236+0000 7f5963400640 1 -- 172.21.15.144:0/4220564939 learned_addr learned my addr 172.21.15.144:0/4220564939 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:17:53.238 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.236+0000 7f5963e00640 1 --2- 172.21.15.144:0/4220564939 >> v2:172.21.15.165:3300/0 conn(0x7f59640d14b0 0x7f59640cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:53.238 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.237+0000 7f5962000640 1 -- 172.21.15.144:0/4220564939 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3615502882 0 0) 0x7f59640d4760 con 0x7f596415e670 2024-09-11T23:17:53.238 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.237+0000 7f5962000640 1 -- 172.21.15.144:0/4220564939 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5948003520 con 0x7f596415e670 2024-09-11T23:17:53.238 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.237+0000 7f5962000640 1 -- 172.21.15.144:0/4220564939 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1860951912 0 0) 0x7f59640d4a40 con 0x7f5964162450 2024-09-11T23:17:53.238 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.237+0000 7f5962000640 1 -- 172.21.15.144:0/4220564939 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59640d4760 con 0x7f5964162450 2024-09-11T23:17:53.238 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.237+0000 7f5963e00640 1 -- 172.21.15.144:0/4220564939 >> v1:172.21.15.165:6789/0 conn(0x7f5964162450 legacy=0x7f59640d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:53.238 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.237+0000 7f5962000640 1 -- 172.21.15.144:0/4220564939 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3729815233 0 0) 0x7f5948003520 con 0x7f596415e670 2024-09-11T23:17:53.239 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.237+0000 7f5963e00640 1 -- 172.21.15.144:0/4220564939 >> v1:172.21.15.144:6789/0 conn(0x7f596415e670 legacy=0x7f59640d3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:53.239 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.237+0000 7f5963e00640 1 -- 172.21.15.144:0/4220564939 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59640d4d20 con 0x7f59640d14b0 2024-09-11T23:17:53.240 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.238+0000 7f5963e00640 1 --2- 172.21.15.144:0/4220564939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59640d14b0 0x7f59640cf110 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f595c009d90 tx=0x7f595c02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c320c8482dfa1574 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:53.240 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.238+0000 7f5962000640 1 -- 172.21.15.144:0/4220564939 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5954001670 con 0x7f59640d14b0 2024-09-11T23:17:53.240 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.238+0000 7f5962000640 1 -- 172.21.15.144:0/4220564939 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f595c007540 con 0x7f59640d14b0 2024-09-11T23:17:53.240 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.238+0000 7f5962000640 1 -- 172.21.15.144:0/4220564939 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c007910 con 0x7f59640d14b0 2024-09-11T23:17:53.240 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.239+0000 7f5968c00640 1 -- 172.21.15.144:0/4220564939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59640d14b0 msgr2=0x7f59640cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:53.240 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.239+0000 7f5968c00640 1 --2- 172.21.15.144:0/4220564939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59640d14b0 0x7f59640cf110 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f595c009d90 tx=0x7f595c02a5f0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.240 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.239+0000 7f5968c00640 1 -- 172.21.15.144:0/4220564939 shutdown_connections 2024-09-11T23:17:53.240 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.239+0000 7f5968c00640 1 --2- 172.21.15.144:0/4220564939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59640d14b0 0x7f59640cf110 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.240 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.239+0000 7f5968c00640 1 -- 172.21.15.144:0/4220564939 >> 172.21.15.144:0/4220564939 conn(0x7f5964072230 msgr2=0x7f5964072640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:53.240 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.239+0000 7f5968c00640 1 -- 172.21.15.144:0/4220564939 shutdown_connections 2024-09-11T23:17:53.241 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.239+0000 7f5968c00640 1 -- 172.21.15.144:0/4220564939 wait complete. 2024-09-11T23:17:53.241 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.240+0000 7f5968c00640 1 Processor -- start 2024-09-11T23:17:53.241 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.241+0000 7f5968c00640 1 -- start start 2024-09-11T23:17:53.243 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.241+0000 7f5968c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59640d14b0 0x7f59640b9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:53.243 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.241+0000 7f5968c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f596415e670 0x7f59640cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:53.243 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.241+0000 7f5968c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5964162450 0x7f596414fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:53.243 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.241+0000 7f5968c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f59640d5090 con 0x7f5964162450 2024-09-11T23:17:53.243 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.241+0000 7f5968c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f59640b6ce0 con 0x7f59640d14b0 2024-09-11T23:17:53.243 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.241+0000 7f5968c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f596415fa60 con 0x7f596415e670 2024-09-11T23:17:53.243 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.242+0000 7f5963e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5964162450 0x7f596414fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:53.243 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.242+0000 7f5963e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5964162450 0x7f596414fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36864/0 (socket says 172.21.15.144:36864) 2024-09-11T23:17:53.243 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.242+0000 7f5963e00640 1 -- 172.21.15.144:0/3292764989 learned_addr learned my addr 172.21.15.144:0/3292764989 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:17:53.244 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.242+0000 7f5963400640 1 --2- 172.21.15.144:0/3292764989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59640d14b0 0x7f59640b9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:53.244 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.242+0000 7f5962a00640 1 --2- 172.21.15.144:0/3292764989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f596415e670 0x7f59640cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:53.244 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.242+0000 7f5963e00640 1 -- 172.21.15.144:0/3292764989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f596415e670 msgr2=0x7f59640cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:53.244 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.242+0000 7f5963e00640 1 --2- 172.21.15.144:0/3292764989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f596415e670 0x7f59640cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.244 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.242+0000 7f5963e00640 1 -- 172.21.15.144:0/3292764989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59640d14b0 msgr2=0x7f59640b9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:53.244 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.242+0000 7f5963e00640 1 --2- 172.21.15.144:0/3292764989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59640d14b0 0x7f59640b9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.244 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.242+0000 7f5963e00640 1 -- 172.21.15.144:0/3292764989 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59640cbb90 con 0x7f5964162450 2024-09-11T23:17:53.246 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.243+0000 7f5963e00640 1 --2- 172.21.15.144:0/3292764989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5964162450 0x7f596414fad0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f595c009d90 tx=0x7f595c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:53.246 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.243+0000 7f595b400640 1 -- 172.21.15.144:0/3292764989 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c040070 con 0x7f5964162450 2024-09-11T23:17:53.246 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.243+0000 7f595b400640 1 -- 172.21.15.144:0/3292764989 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f595c03c8f0 con 0x7f5964162450 2024-09-11T23:17:53.246 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.243+0000 7f595b400640 1 -- 172.21.15.144:0/3292764989 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c03cca0 con 0x7f5964162450 2024-09-11T23:17:53.246 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.243+0000 7f5968c00640 1 -- 172.21.15.144:0/3292764989 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59640cbe60 con 0x7f5964162450 2024-09-11T23:17:53.246 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.243+0000 7f5968c00640 1 -- 172.21.15.144:0/3292764989 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59640cc420 con 0x7f5964162450 2024-09-11T23:17:53.246 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.244+0000 7f5968c00640 1 -- 172.21.15.144:0/3292764989 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59640691a0 con 0x7f5964162450 2024-09-11T23:17:53.246 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.245+0000 7f595b400640 1 -- 172.21.15.144:0/3292764989 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f595c039040 con 0x7f5964162450 2024-09-11T23:17:53.247 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.246+0000 7f595b400640 1 --2- 172.21.15.144:0/3292764989 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f594406be30 0x7f594406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:53.247 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.246+0000 7f595b400640 1 -- 172.21.15.144:0/3292764989 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f595c0abc80 con 0x7f5964162450 2024-09-11T23:17:53.247 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.246+0000 7f5963400640 1 --2- 172.21.15.144:0/3292764989 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f594406be30 0x7f594406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:53.247 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.246+0000 7f5963400640 1 --2- 172.21.15.144:0/3292764989 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f594406be30 0x7f594406e2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f59540017e0 tx=0x7f5954001610 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:53.251 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.251+0000 7f595b400640 1 -- 172.21.15.144:0/3292764989 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f595c07a320 con 0x7f5964162450 2024-09-11T23:17:53.430 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.429+0000 7f5968c00640 1 -- 172.21.15.144:0/3292764989 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59640d3bb0 con 0x7f5964162450 2024-09-11T23:17:53.431 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.430+0000 7f595b400640 1 -- 172.21.15.144:0/3292764989 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12921 (secure 0 0 0) 0x7f595c07e620 con 0x7f5964162450 2024-09-11T23:17:53.431 INFO:teuthology.misc.health.smithi144.stdout: 2024-09-11T23:17:53.431 INFO:teuthology.misc.health.smithi144.stdout:{"epoch":18,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:17:51.187820+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:17:53.434 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.433+0000 7f5968c00640 1 -- 172.21.15.144:0/3292764989 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f594406be30 msgr2=0x7f594406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:53.434 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.433+0000 7f5968c00640 1 --2- 172.21.15.144:0/3292764989 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f594406be30 0x7f594406e2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f59540017e0 tx=0x7f5954001610 comp rx=0 tx=0).stop 2024-09-11T23:17:53.434 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.433+0000 7f5968c00640 1 -- 172.21.15.144:0/3292764989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5964162450 msgr2=0x7f596414fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:53.434 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.433+0000 7f5968c00640 1 --2- 172.21.15.144:0/3292764989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5964162450 0x7f596414fad0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f595c009d90 tx=0x7f595c004a40 comp rx=0 tx=0).stop 2024-09-11T23:17:53.434 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.433+0000 7f5968c00640 1 -- 172.21.15.144:0/3292764989 shutdown_connections 2024-09-11T23:17:53.434 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.433+0000 7f5968c00640 1 --2- 172.21.15.144:0/3292764989 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f594406be30 0x7f594406e2f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.434 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.433+0000 7f5968c00640 1 --2- 172.21.15.144:0/3292764989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5964162450 0x7f596414fad0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.434 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.433+0000 7f5968c00640 1 --2- 172.21.15.144:0/3292764989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f596415e670 0x7f59640cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.434 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.433+0000 7f5968c00640 1 --2- 172.21.15.144:0/3292764989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59640d14b0 0x7f59640b9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.435 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.433+0000 7f5968c00640 1 -- 172.21.15.144:0/3292764989 >> 172.21.15.144:0/3292764989 conn(0x7f5964072230 msgr2=0x7f596415cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:53.435 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.433+0000 7f5968c00640 1 -- 172.21.15.144:0/3292764989 shutdown_connections 2024-09-11T23:17:53.435 INFO:teuthology.misc.health.smithi144.stderr:2024-09-11T23:17:53.433+0000 7f5968c00640 1 -- 172.21.15.144:0/3292764989 wait complete. 2024-09-11T23:17:53.447 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-11T23:17:53.447 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-11T23:17:53.448 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:17:53.448 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:17:53.452 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:17:53.452 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:17:53.452 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:17:53.455 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:17:53.455 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:17:53.456 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:17:53.460 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:17:53.460 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:17:53.460 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:17:53.464 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:17:53.464 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-11T23:17:53.464 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:17:53.583 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-11T23:17:53.583 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-11T23:17:53.599 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-11T23:17:53.600 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-11T23:17:53.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.625+0000 7f822d600640 1 Processor -- start 2024-09-11T23:17:53.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.625+0000 7f822d600640 1 -- start start 2024-09-11T23:17:53.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.626+0000 7f822d600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822815c180 0x7f82280cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:53.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.626+0000 7f822d600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8228073120 0x7f82280735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:53.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.626+0000 7f822d600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82280ce740 con 0x7f82280ce230 2024-09-11T23:17:53.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.626+0000 7f822d600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8228072640 con 0x7f8228073120 2024-09-11T23:17:53.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.626+0000 7f822d600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8228072920 con 0x7f822815c180 2024-09-11T23:17:53.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.626+0000 7f8226a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822815c180 0x7f82280cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:53.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.626+0000 7f8226a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822815c180 0x7f82280cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:45768/0 (socket says 172.21.15.144:45768) 2024-09-11T23:17:53.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.626+0000 7f8226a00640 1 -- 172.21.15.144:0/962756579 learned_addr learned my addr 172.21.15.144:0/962756579 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:17:53.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.626+0000 7f8227400640 1 --2- 172.21.15.144:0/962756579 >> v2:172.21.15.165:3300/0 conn(0x7f8228073120 0x7f82280735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:53.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.627+0000 7f8226a00640 1 -- 172.21.15.144:0/962756579 >> v2:172.21.15.165:3300/0 conn(0x7f8228073120 msgr2=0x7f82280735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:53.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.627+0000 7f8226a00640 1 --2- 172.21.15.144:0/962756579 >> v2:172.21.15.165:3300/0 conn(0x7f8228073120 0x7f82280735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.627+0000 7f8226a00640 1 -- 172.21.15.144:0/962756579 >> v1:172.21.15.144:6789/0 conn(0x7f82280ce230 legacy=0x7f82280cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:53.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.627+0000 7f8226a00640 1 -- 172.21.15.144:0/962756579 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8228072c00 con 0x7f822815c180 2024-09-11T23:17:53.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.628+0000 7f8226a00640 1 --2- 172.21.15.144:0/962756579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822815c180 0x7f82280cdcf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8218009870 tx=0x7f821802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e174231799ad41a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:53.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.628+0000 7f8226000640 1 -- 172.21.15.144:0/962756579 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218037070 con 0x7f822815c180 2024-09-11T23:17:53.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.628+0000 7f8226000640 1 -- 172.21.15.144:0/962756579 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8218032440 con 0x7f822815c180 2024-09-11T23:17:53.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.628+0000 7f8226000640 1 -- 172.21.15.144:0/962756579 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218032810 con 0x7f822815c180 2024-09-11T23:17:53.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.629+0000 7f822d600640 1 -- 172.21.15.144:0/962756579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822815c180 msgr2=0x7f82280cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:53.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.629+0000 7f822d600640 1 --2- 172.21.15.144:0/962756579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822815c180 0x7f82280cdcf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8218009870 tx=0x7f821802a1c0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.629+0000 7f822d600640 1 -- 172.21.15.144:0/962756579 shutdown_connections 2024-09-11T23:17:53.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.629+0000 7f822d600640 1 --2- 172.21.15.144:0/962756579 >> v2:172.21.15.165:3300/0 conn(0x7f8228073120 0x7f82280735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.629+0000 7f822d600640 1 --2- 172.21.15.144:0/962756579 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822815c180 0x7f82280cdcf0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.629+0000 7f822d600640 1 -- 172.21.15.144:0/962756579 >> 172.21.15.144:0/962756579 conn(0x7f8228062cc0 msgr2=0x7f822806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:53.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.629+0000 7f822d600640 1 -- 172.21.15.144:0/962756579 shutdown_connections 2024-09-11T23:17:53.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.629+0000 7f822d600640 1 -- 172.21.15.144:0/962756579 wait complete. 2024-09-11T23:17:53.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.630+0000 7f822d600640 1 Processor -- start 2024-09-11T23:17:53.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.630+0000 7f822d600640 1 -- start start 2024-09-11T23:17:53.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.631+0000 7f822d600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8228073120 0x7f82281527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:53.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.631+0000 7f822d600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82280ce230 0x7f82280cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:53.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.631+0000 7f822d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822815c180 0x7f822815a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:53.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.631+0000 7f822d600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f82280cf780 con 0x7f822815c180 2024-09-11T23:17:53.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.631+0000 7f822d600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f82280722f0 con 0x7f82280ce230 2024-09-11T23:17:53.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.631+0000 7f822d600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f822815c560 con 0x7f8228073120 2024-09-11T23:17:53.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.632+0000 7f8227400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822815c180 0x7f822815a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:53.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.632+0000 7f8227400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822815c180 0x7f822815a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36918/0 (socket says 172.21.15.144:36918) 2024-09-11T23:17:53.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.632+0000 7f8227400640 1 -- 172.21.15.144:0/532176030 learned_addr learned my addr 172.21.15.144:0/532176030 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:17:53.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.632+0000 7f8226a00640 1 --2- 172.21.15.144:0/532176030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8228073120 0x7f82281527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:53.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.632+0000 7f821e000640 1 --2- 172.21.15.144:0/532176030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82280ce230 0x7f82280cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:53.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.632+0000 7f8227400640 1 -- 172.21.15.144:0/532176030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8228073120 msgr2=0x7f82281527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:53.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.632+0000 7f8227400640 1 --2- 172.21.15.144:0/532176030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8228073120 0x7f82281527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.632+0000 7f8227400640 1 -- 172.21.15.144:0/532176030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82280ce230 msgr2=0x7f82280cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:53.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.632+0000 7f8227400640 1 --2- 172.21.15.144:0/532176030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82280ce230 0x7f82280cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.632+0000 7f8227400640 1 -- 172.21.15.144:0/532176030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82280c93d0 con 0x7f822815c180 2024-09-11T23:17:53.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.632+0000 7f8227400640 1 --2- 172.21.15.144:0/532176030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822815c180 0x7f822815a630 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f822000e7f0 tx=0x7f822000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:53.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.632+0000 7f821f400640 1 -- 172.21.15.144:0/532176030 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8220017070 con 0x7f822815c180 2024-09-11T23:17:53.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.632+0000 7f821f400640 1 -- 172.21.15.144:0/532176030 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f822000ee40 con 0x7f822815c180 2024-09-11T23:17:53.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.632+0000 7f821f400640 1 -- 172.21.15.144:0/532176030 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822000cb80 con 0x7f822815c180 2024-09-11T23:17:53.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.633+0000 7f822d600640 1 -- 172.21.15.144:0/532176030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82280c96b0 con 0x7f822815c180 2024-09-11T23:17:53.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.633+0000 7f822d600640 1 -- 172.21.15.144:0/532176030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82280c9c70 con 0x7f822815c180 2024-09-11T23:17:53.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.634+0000 7f822d600640 1 -- 172.21.15.144:0/532176030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82280d0f60 con 0x7f822815c180 2024-09-11T23:17:53.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.634+0000 7f821f400640 1 -- 172.21.15.144:0/532176030 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f822001a070 con 0x7f822815c180 2024-09-11T23:17:53.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.635+0000 7f821f400640 1 --2- 172.21.15.144:0/532176030 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f820406be30 0x7f820406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:53.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.635+0000 7f821f400640 1 -- 172.21.15.144:0/532176030 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f822008ad10 con 0x7f822815c180 2024-09-11T23:17:53.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.636+0000 7f8226a00640 1 --2- 172.21.15.144:0/532176030 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f820406be30 0x7f820406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:53.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.636+0000 7f8226a00640 1 --2- 172.21.15.144:0/532176030 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f820406be30 0x7f820406e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8218034000 tx=0x7f821802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:53.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.640+0000 7f821f400640 1 -- 172.21.15.144:0/532176030 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f82280d0f60 con 0x7f822815c180 2024-09-11T23:17:53.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.848+0000 7f822d600640 1 -- 172.21.15.144:0/532176030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82280cdcf0 con 0x7f822815c180 2024-09-11T23:17:53.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.849+0000 7f821f400640 1 -- 172.21.15.144:0/532176030 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7f8220090020 con 0x7f822815c180 2024-09-11T23:17:53.850 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:17:53.850 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":2,"btime":"2024-09-11T23:17:53:590800+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1295491349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1295491349},{"type":"v1","addr":"172.21.15.144:6836","nonce":1295491349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T23:17:53.850 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 2 2024-09-11T23:17:53.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.851+0000 7f822d600640 1 -- 172.21.15.144:0/532176030 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f820406be30 msgr2=0x7f820406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:53.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.851+0000 7f822d600640 1 --2- 172.21.15.144:0/532176030 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f820406be30 0x7f820406e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8218034000 tx=0x7f821802e000 comp rx=0 tx=0).stop 2024-09-11T23:17:53.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.851+0000 7f822d600640 1 -- 172.21.15.144:0/532176030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822815c180 msgr2=0x7f822815a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:53.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.851+0000 7f822d600640 1 --2- 172.21.15.144:0/532176030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822815c180 0x7f822815a630 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f822000e7f0 tx=0x7f822000ebf0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.851+0000 7f822d600640 1 -- 172.21.15.144:0/532176030 shutdown_connections 2024-09-11T23:17:53.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.851+0000 7f822d600640 1 --2- 172.21.15.144:0/532176030 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f820406be30 0x7f820406e2f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.851+0000 7f822d600640 1 --2- 172.21.15.144:0/532176030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822815c180 0x7f822815a630 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.851+0000 7f822d600640 1 --2- 172.21.15.144:0/532176030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82280ce230 0x7f82280cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.851+0000 7f822d600640 1 --2- 172.21.15.144:0/532176030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8228073120 0x7f82281527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:53.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.851+0000 7f822d600640 1 -- 172.21.15.144:0/532176030 >> 172.21.15.144:0/532176030 conn(0x7f8228062cc0 msgr2=0x7f822806bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:53.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.851+0000 7f822d600640 1 -- 172.21.15.144:0/532176030 shutdown_connections 2024-09-11T23:17:53.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:53.851+0000 7f822d600640 1 -- 172.21.15.144:0/532176030 wait complete. 2024-09-11T23:17:55.868 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:17:56.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.031+0000 7f10f5c00640 1 Processor -- start 2024-09-11T23:17:56.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.031+0000 7f10f5c00640 1 -- start start 2024-09-11T23:17:56.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.032+0000 7f10f5c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10f015e940 0x7f10f00d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.032+0000 7f10f5c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10f00b7170 con 0x7f10f015ed20 2024-09-11T23:17:56.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.032+0000 7f10f5c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10f00b7aa0 con 0x7f10f00cef90 2024-09-11T23:17:56.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.032+0000 7f10f5c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f10f00d3660 con 0x7f10f015e940 2024-09-11T23:17:56.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.032+0000 7f10e7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f10f015ed20 0x7f10f00b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55890/0 (socket says 172.21.15.144:55890) 2024-09-11T23:17:56.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.032+0000 7f10e7e00640 1 -- 172.21.15.144:0/184120016 learned_addr learned my addr 172.21.15.144:0/184120016 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:17:56.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.033+0000 7f10eea00640 1 --2- 172.21.15.144:0/184120016 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10f015e940 0x7f10f00d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:56.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.033+0000 7f10ee000640 1 -- 172.21.15.144:0/184120016 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1694512407 0 0) 0x7f10d8001110 con 0x7f10f015ed20 2024-09-11T23:17:56.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.033+0000 7f10ee000640 1 -- 172.21.15.144:0/184120016 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10d4003520 con 0x7f10f015ed20 2024-09-11T23:17:56.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.033+0000 7f10ee000640 1 -- 172.21.15.144:0/184120016 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3404647924 0 0) 0x7f10f00b7aa0 con 0x7f10f00cef90 2024-09-11T23:17:56.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.033+0000 7f10ee000640 1 -- 172.21.15.144:0/184120016 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10d8001110 con 0x7f10f00cef90 2024-09-11T23:17:56.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.033+0000 7f10eea00640 1 -- 172.21.15.144:0/184120016 >> v1:172.21.15.165:6789/0 conn(0x7f10f00cef90 legacy=0x7f10f00b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:56.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.033+0000 7f10eea00640 1 -- 172.21.15.144:0/184120016 >> v1:172.21.15.144:6789/0 conn(0x7f10f015ed20 legacy=0x7f10f00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:56.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.033+0000 7f10eea00640 1 -- 172.21.15.144:0/184120016 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f00d3940 con 0x7f10f015e940 2024-09-11T23:17:56.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.034+0000 7f10eea00640 1 --2- 172.21.15.144:0/184120016 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10f015e940 0x7f10f00d1060 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f10e00097d0 tx=0x7f10e002a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a0539b6b20bb03e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:56.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.034+0000 7f10ee000640 1 -- 172.21.15.144:0/184120016 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e0037070 con 0x7f10f015e940 2024-09-11T23:17:56.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.034+0000 7f10ee000640 1 -- 172.21.15.144:0/184120016 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e0032440 con 0x7f10f015e940 2024-09-11T23:17:56.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.034+0000 7f10ee000640 1 -- 172.21.15.144:0/184120016 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e00327f0 con 0x7f10f015e940 2024-09-11T23:17:56.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.035+0000 7f10f5c00640 1 -- 172.21.15.144:0/184120016 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10f015e940 msgr2=0x7f10f00d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:56.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.035+0000 7f10f5c00640 1 --2- 172.21.15.144:0/184120016 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10f015e940 0x7f10f00d1060 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f10e00097d0 tx=0x7f10e002a290 comp rx=0 tx=0).stop 2024-09-11T23:17:56.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.035+0000 7f10f5c00640 1 -- 172.21.15.144:0/184120016 shutdown_connections 2024-09-11T23:17:56.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.035+0000 7f10f5c00640 1 --2- 172.21.15.144:0/184120016 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10f015e940 0x7f10f00d1060 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.035+0000 7f10f5c00640 1 -- 172.21.15.144:0/184120016 >> 172.21.15.144:0/184120016 conn(0x7f10f00b6240 msgr2=0x7f10f00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:56.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.035+0000 7f10f5c00640 1 -- 172.21.15.144:0/184120016 shutdown_connections 2024-09-11T23:17:56.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.035+0000 7f10f5c00640 1 -- 172.21.15.144:0/184120016 wait complete. 2024-09-11T23:17:56.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.037+0000 7f10f5c00640 1 Processor -- start 2024-09-11T23:17:56.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.037+0000 7f10f5c00640 1 -- start start 2024-09-11T23:17:56.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.037+0000 7f10f5c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10f00cef90 0x7f10f00cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.038+0000 7f10f5c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10f015e940 0x7f10f00c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.038+0000 7f10f5c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10f015ed20 0x7f10f00b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.038+0000 7f10f5c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10f00d3310 con 0x7f10f00cef90 2024-09-11T23:17:56.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.038+0000 7f10f5c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f10f00d3f00 con 0x7f10f015e940 2024-09-11T23:17:56.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.038+0000 7f10f5c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f10f00d1ef0 con 0x7f10f015ed20 2024-09-11T23:17:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.038+0000 7f10eea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10f00cef90 0x7f10f00cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.038+0000 7f10eea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10f00cef90 0x7f10f00cadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38268/0 (socket says 172.21.15.144:38268) 2024-09-11T23:17:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.038+0000 7f10eea00640 1 -- 172.21.15.144:0/3127125864 learned_addr learned my addr 172.21.15.144:0/3127125864 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:17:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.038+0000 7f10e7e00640 1 --2- 172.21.15.144:0/3127125864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10f015e940 0x7f10f00c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.038+0000 7f10eea00640 1 -- 172.21.15.144:0/3127125864 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10f015ed20 msgr2=0x7f10f00b56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.038+0000 7f10eea00640 1 --2- 172.21.15.144:0/3127125864 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10f015ed20 0x7f10f00b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.038+0000 7f10eea00640 1 -- 172.21.15.144:0/3127125864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10f015e940 msgr2=0x7f10f00c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.038+0000 7f10eea00640 1 --2- 172.21.15.144:0/3127125864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10f015e940 0x7f10f00c94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.038+0000 7f10eea00640 1 -- 172.21.15.144:0/3127125864 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f00cb3f0 con 0x7f10f00cef90 2024-09-11T23:17:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.038+0000 7f10eea00640 1 --2- 172.21.15.144:0/3127125864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10f00cef90 0x7f10f00cadf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f10e0035040 tx=0x7f10e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.039+0000 7f10e6a00640 1 -- 172.21.15.144:0/3127125864 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e0037040 con 0x7f10f00cef90 2024-09-11T23:17:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.039+0000 7f10e6a00640 1 -- 172.21.15.144:0/3127125864 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e00044c0 con 0x7f10f00cef90 2024-09-11T23:17:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.039+0000 7f10e6a00640 1 -- 172.21.15.144:0/3127125864 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e00325f0 con 0x7f10f00cef90 2024-09-11T23:17:56.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.039+0000 7f10f5c00640 1 -- 172.21.15.144:0/3127125864 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f01f7f70 con 0x7f10f00cef90 2024-09-11T23:17:56.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.039+0000 7f10f5c00640 1 -- 172.21.15.144:0/3127125864 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f0157dc0 con 0x7f10f00cef90 2024-09-11T23:17:56.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.040+0000 7f10f5c00640 1 -- 172.21.15.144:0/3127125864 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10f00d1060 con 0x7f10f00cef90 2024-09-11T23:17:56.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.041+0000 7f10e6a00640 1 -- 172.21.15.144:0/3127125864 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f10e0044020 con 0x7f10f00cef90 2024-09-11T23:17:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.042+0000 7f10e6a00640 1 --2- 172.21.15.144:0/3127125864 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f10cc06be30 0x7f10cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.042+0000 7f10e6a00640 1 -- 172.21.15.144:0/3127125864 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f10e00aaa70 con 0x7f10f00cef90 2024-09-11T23:17:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.042+0000 7f10e7e00640 1 --2- 172.21.15.144:0/3127125864 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f10cc06be30 0x7f10cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.043+0000 7f10e7e00640 1 --2- 172.21.15.144:0/3127125864 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f10cc06be30 0x7f10cc06e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f10d80013b0 tx=0x7f10d8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:56.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.046+0000 7f10e6a00640 1 -- 172.21.15.144:0/3127125864 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f10e004b020 con 0x7f10f00cef90 2024-09-11T23:17:56.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.254+0000 7f10f5c00640 1 -- 172.21.15.144:0/3127125864 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10f00b6020 con 0x7f10f00cef90 2024-09-11T23:17:56.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.255+0000 7f10e6a00640 1 -- 172.21.15.144:0/3127125864 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3918 (secure 0 0 0) 0x7f10e0030e20 con 0x7f10f00cef90 2024-09-11T23:17:56.256 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:17:56.257 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":3,"btime":"2024-09-11T23:17:54:592322+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1741936320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1741936320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1741936320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1295491349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1295491349},{"type":"v1","addr":"172.21.15.144:6836","nonce":1295491349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1020006630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1020006630},{"type":"v1","addr":"172.21.15.144:6837","nonce":1020006630}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2270648598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2270648598},{"type":"v1","addr":"172.21.15.165:6835","nonce":2270648598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-11T23:17:56.257 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 3 2024-09-11T23:17:56.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.257+0000 7f10f5c00640 1 -- 172.21.15.144:0/3127125864 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f10cc06be30 msgr2=0x7f10cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:56.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.257+0000 7f10f5c00640 1 --2- 172.21.15.144:0/3127125864 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f10cc06be30 0x7f10cc06e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f10d80013b0 tx=0x7f10d8009040 comp rx=0 tx=0).stop 2024-09-11T23:17:56.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.257+0000 7f10f5c00640 1 -- 172.21.15.144:0/3127125864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10f00cef90 msgr2=0x7f10f00cadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:56.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.257+0000 7f10f5c00640 1 --2- 172.21.15.144:0/3127125864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10f00cef90 0x7f10f00cadf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f10e0035040 tx=0x7f10e00046c0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.257+0000 7f10f5c00640 1 -- 172.21.15.144:0/3127125864 shutdown_connections 2024-09-11T23:17:56.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.257+0000 7f10f5c00640 1 --2- 172.21.15.144:0/3127125864 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f10cc06be30 0x7f10cc06e2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.257+0000 7f10f5c00640 1 --2- 172.21.15.144:0/3127125864 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10f015ed20 0x7f10f00b56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.257+0000 7f10f5c00640 1 --2- 172.21.15.144:0/3127125864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10f015e940 0x7f10f00c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.257+0000 7f10f5c00640 1 --2- 172.21.15.144:0/3127125864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10f00cef90 0x7f10f00cadf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.257+0000 7f10f5c00640 1 -- 172.21.15.144:0/3127125864 >> 172.21.15.144:0/3127125864 conn(0x7f10f00b6240 msgr2=0x7f10f01615f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:56.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.258+0000 7f10f5c00640 1 -- 172.21.15.144:0/3127125864 shutdown_connections 2024-09-11T23:17:56.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.258+0000 7f10f5c00640 1 -- 172.21.15.144:0/3127125864 wait complete. 2024-09-11T23:17:56.275 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:17:56.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.427+0000 7f853a200640 1 Processor -- start 2024-09-11T23:17:56.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.428+0000 7f853a200640 1 -- start start 2024-09-11T23:17:56.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.429+0000 7f853a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f853415ca40 0x7f853415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.429+0000 7f853a200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f853415ce80 0x7f85341594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.429+0000 7f853a200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f853415d390 con 0x7f85340d02a0 2024-09-11T23:17:56.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.429+0000 7f853a200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f853415d670 con 0x7f853415ce80 2024-09-11T23:17:56.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.429+0000 7f853a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f853415d950 con 0x7f853415ca40 2024-09-11T23:17:56.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.429+0000 7f8533e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f853415ce80 0x7f85341594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:56.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.429+0000 7f8533e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f853415ce80 0x7f85341594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38282/0 (socket says 172.21.15.144:38282) 2024-09-11T23:17:56.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.429+0000 7f8533e00640 1 -- 172.21.15.144:0/1113683494 learned_addr learned my addr 172.21.15.144:0/1113683494 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:17:56.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.429+0000 7f852aa00640 1 --2- 172.21.15.144:0/1113683494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f853415ca40 0x7f853415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:56.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.429+0000 7f8533e00640 1 -- 172.21.15.144:0/1113683494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f853415ca40 msgr2=0x7f853415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:56.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.429+0000 7f8533e00640 1 --2- 172.21.15.144:0/1113683494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f853415ca40 0x7f853415e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.429+0000 7f8533e00640 1 -- 172.21.15.144:0/1113683494 >> v1:172.21.15.165:6789/0 conn(0x7f85340d02a0 legacy=0x7f85340d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:56.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.429+0000 7f8533e00640 1 -- 172.21.15.144:0/1113683494 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f853415dc30 con 0x7f853415ce80 2024-09-11T23:17:56.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.429+0000 7f852aa00640 1 --2- 172.21.15.144:0/1113683494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f853415ca40 0x7f853415e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:56.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.430+0000 7f8533e00640 1 --2- 172.21.15.144:0/1113683494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f853415ce80 0x7f85341594c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f852c009870 tx=0x7f852c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8c67b123a9a406 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:56.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.431+0000 7f8532a00640 1 -- 172.21.15.144:0/1113683494 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c037070 con 0x7f853415ce80 2024-09-11T23:17:56.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.431+0000 7f8532a00640 1 -- 172.21.15.144:0/1113683494 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f852c032440 con 0x7f853415ce80 2024-09-11T23:17:56.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.431+0000 7f8532a00640 1 -- 172.21.15.144:0/1113683494 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c032810 con 0x7f853415ce80 2024-09-11T23:17:56.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.431+0000 7f853a200640 1 -- 172.21.15.144:0/1113683494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f853415ce80 msgr2=0x7f85341594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:56.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.431+0000 7f853a200640 1 --2- 172.21.15.144:0/1113683494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f853415ce80 0x7f85341594c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f852c009870 tx=0x7f852c02a180 comp rx=0 tx=0).stop 2024-09-11T23:17:56.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.431+0000 7f853a200640 1 -- 172.21.15.144:0/1113683494 shutdown_connections 2024-09-11T23:17:56.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.431+0000 7f853a200640 1 --2- 172.21.15.144:0/1113683494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f853415ce80 0x7f85341594c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.431+0000 7f853a200640 1 --2- 172.21.15.144:0/1113683494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f853415ca40 0x7f853415e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.431+0000 7f853a200640 1 -- 172.21.15.144:0/1113683494 >> 172.21.15.144:0/1113683494 conn(0x7f8534062cc0 msgr2=0x7f853406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:56.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.431+0000 7f853a200640 1 -- 172.21.15.144:0/1113683494 shutdown_connections 2024-09-11T23:17:56.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.431+0000 7f853a200640 1 -- 172.21.15.144:0/1113683494 wait complete. 2024-09-11T23:17:56.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.433+0000 7f853a200640 1 Processor -- start 2024-09-11T23:17:56.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.433+0000 7f853a200640 1 -- start start 2024-09-11T23:17:56.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.434+0000 7f853a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85340d02a0 0x7f853414c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.434+0000 7f853a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f853415ca40 0x7f853414bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.434+0000 7f853a200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f853415ce80 0x7f8534156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.434+0000 7f853a200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8534155d10 con 0x7f853415ca40 2024-09-11T23:17:56.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.434+0000 7f853a200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8534155b90 con 0x7f853415ce80 2024-09-11T23:17:56.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.434+0000 7f853a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f85340b4790 con 0x7f85340d02a0 2024-09-11T23:17:56.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.434+0000 7f852aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f853415ca40 0x7f853414bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:56.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.434+0000 7f852aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f853415ca40 0x7f853414bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38288/0 (socket says 172.21.15.144:38288) 2024-09-11T23:17:56.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.434+0000 7f852aa00640 1 -- 172.21.15.144:0/4237158160 learned_addr learned my addr 172.21.15.144:0/4237158160 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:17:56.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.434+0000 7f8533e00640 1 --2- 172.21.15.144:0/4237158160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f853415ce80 0x7f8534156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:56.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.434+0000 7f8533400640 1 --2- 172.21.15.144:0/4237158160 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85340d02a0 0x7f853414c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:56.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.435+0000 7f852aa00640 1 -- 172.21.15.144:0/4237158160 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85340d02a0 msgr2=0x7f853414c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:56.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.435+0000 7f852aa00640 1 --2- 172.21.15.144:0/4237158160 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85340d02a0 0x7f853414c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.435+0000 7f852aa00640 1 -- 172.21.15.144:0/4237158160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f853415ce80 msgr2=0x7f8534156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:56.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.435+0000 7f852aa00640 1 --2- 172.21.15.144:0/4237158160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f853415ce80 0x7f8534156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.435+0000 7f852aa00640 1 -- 172.21.15.144:0/4237158160 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f853414c690 con 0x7f853415ca40 2024-09-11T23:17:56.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.435+0000 7f8533400640 1 --2- 172.21.15.144:0/4237158160 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85340d02a0 0x7f853414c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:17:56.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.435+0000 7f852aa00640 1 --2- 172.21.15.144:0/4237158160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f853415ca40 0x7f853414bdd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f851c00c7f0 tx=0x7f851c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:56.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.435+0000 7f852be00640 1 -- 172.21.15.144:0/4237158160 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851c015070 con 0x7f853415ca40 2024-09-11T23:17:56.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.435+0000 7f852be00640 1 -- 172.21.15.144:0/4237158160 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f851c007820 con 0x7f853415ca40 2024-09-11T23:17:56.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.435+0000 7f852be00640 1 -- 172.21.15.144:0/4237158160 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851c007bd0 con 0x7f853415ca40 2024-09-11T23:17:56.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.435+0000 7f853a200640 1 -- 172.21.15.144:0/4237158160 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85340b1a10 con 0x7f853415ca40 2024-09-11T23:17:56.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.435+0000 7f853a200640 1 -- 172.21.15.144:0/4237158160 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85340b1fd0 con 0x7f853415ca40 2024-09-11T23:17:56.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.436+0000 7f853a200640 1 -- 172.21.15.144:0/4237158160 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8534152c20 con 0x7f853415ca40 2024-09-11T23:17:56.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.437+0000 7f852be00640 1 -- 172.21.15.144:0/4237158160 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f851c018070 con 0x7f853415ca40 2024-09-11T23:17:56.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.438+0000 7f852be00640 1 --2- 172.21.15.144:0/4237158160 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f851006be60 0x7f851006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.438+0000 7f852be00640 1 -- 172.21.15.144:0/4237158160 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f851c08ab70 con 0x7f853415ca40 2024-09-11T23:17:56.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.438+0000 7f8533400640 1 --2- 172.21.15.144:0/4237158160 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f851006be60 0x7f851006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:56.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.439+0000 7f8533400640 1 --2- 172.21.15.144:0/4237158160 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f851006be60 0x7f851006e320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8524009fc0 tx=0x7f8524009550 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:56.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.442+0000 7f852be00640 1 -- 172.21.15.144:0/4237158160 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f851c059210 con 0x7f853415ca40 2024-09-11T23:17:56.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.619+0000 7f853a200640 1 -- 172.21.15.144:0/4237158160 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8534159890 con 0x7f853415ca40 2024-09-11T23:17:56.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.619+0000 7f852be00640 1 -- 172.21.15.144:0/4237158160 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f851c05d510 con 0x7f853415ca40 2024-09-11T23:17:56.620 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:17:56.620 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:17:56.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:17:56.621 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-11T23:17:56.621 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-11T23:17:56.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:17:56.621 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:17:56.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.622+0000 7f853a200640 1 -- 172.21.15.144:0/4237158160 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f851006be60 msgr2=0x7f851006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:56.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.622+0000 7f853a200640 1 --2- 172.21.15.144:0/4237158160 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f851006be60 0x7f851006e320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8524009fc0 tx=0x7f8524009550 comp rx=0 tx=0).stop 2024-09-11T23:17:56.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.622+0000 7f853a200640 1 -- 172.21.15.144:0/4237158160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f853415ca40 msgr2=0x7f853414bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:56.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.622+0000 7f853a200640 1 --2- 172.21.15.144:0/4237158160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f853415ca40 0x7f853414bdd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f851c00c7f0 tx=0x7f851c00ccb0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.622+0000 7f853a200640 1 -- 172.21.15.144:0/4237158160 shutdown_connections 2024-09-11T23:17:56.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.622+0000 7f853a200640 1 --2- 172.21.15.144:0/4237158160 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f851006be60 0x7f851006e320 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.622+0000 7f853a200640 1 --2- 172.21.15.144:0/4237158160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f853415ce80 0x7f8534156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.622+0000 7f853a200640 1 --2- 172.21.15.144:0/4237158160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f853415ca40 0x7f853414bdd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.622+0000 7f853a200640 1 --2- 172.21.15.144:0/4237158160 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85340d02a0 0x7f853414c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.622+0000 7f853a200640 1 -- 172.21.15.144:0/4237158160 >> 172.21.15.144:0/4237158160 conn(0x7f8534062cc0 msgr2=0x7f853406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:56.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.622+0000 7f853a200640 1 -- 172.21.15.144:0/4237158160 shutdown_connections 2024-09-11T23:17:56.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.622+0000 7f853a200640 1 -- 172.21.15.144:0/4237158160 wait complete. 2024-09-11T23:17:56.638 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:17:56.638 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:17:56.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.792+0000 7f3292800640 1 Processor -- start 2024-09-11T23:17:56.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.792+0000 7f3292800640 1 -- start start 2024-09-11T23:17:56.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.794+0000 7f3292800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f328c15b370 0x7f328c072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.794+0000 7f3292800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f328c06f130 0x7f328c0ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.794+0000 7f3292800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f328c15c970 con 0x7f328c15f9f0 2024-09-11T23:17:56.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.794+0000 7f3292800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f328c15fef0 con 0x7f328c15b370 2024-09-11T23:17:56.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.794+0000 7f3292800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f328c15bbb0 con 0x7f328c06f130 2024-09-11T23:17:56.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.794+0000 7f328b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f328c15b370 0x7f328c072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:56.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.794+0000 7f328b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f328c15b370 0x7f328c072560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38292/0 (socket says 172.21.15.144:38292) 2024-09-11T23:17:56.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.794+0000 7f328b400640 1 -- 172.21.15.144:0/1097609014 learned_addr learned my addr 172.21.15.144:0/1097609014 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:17:56.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.794+0000 7f328be00640 1 --2- 172.21.15.144:0/1097609014 >> v2:172.21.15.165:3300/0 conn(0x7f328c06f130 0x7f328c0ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:56.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.794+0000 7f328b400640 1 -- 172.21.15.144:0/1097609014 >> v2:172.21.15.165:3300/0 conn(0x7f328c06f130 msgr2=0x7f328c0ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:56.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.794+0000 7f328b400640 1 --2- 172.21.15.144:0/1097609014 >> v2:172.21.15.165:3300/0 conn(0x7f328c06f130 0x7f328c0ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.794+0000 7f328b400640 1 -- 172.21.15.144:0/1097609014 >> v1:172.21.15.165:6789/0 conn(0x7f328c15f9f0 legacy=0x7f328c06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:56.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.794+0000 7f328b400640 1 -- 172.21.15.144:0/1097609014 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328c15be90 con 0x7f328c15b370 2024-09-11T23:17:56.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.795+0000 7f328b400640 1 --2- 172.21.15.144:0/1097609014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f328c15b370 0x7f328c072560 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f328c0cfff0 tx=0x7f327c02a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f380509d0fa555 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:56.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.796+0000 7f328aa00640 1 -- 172.21.15.144:0/1097609014 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c037070 con 0x7f328c15b370 2024-09-11T23:17:56.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.796+0000 7f328aa00640 1 -- 172.21.15.144:0/1097609014 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f327c032440 con 0x7f328c15b370 2024-09-11T23:17:56.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.796+0000 7f328aa00640 1 -- 172.21.15.144:0/1097609014 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c032810 con 0x7f328c15b370 2024-09-11T23:17:56.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.796+0000 7f3292800640 1 -- 172.21.15.144:0/1097609014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f328c15b370 msgr2=0x7f328c072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:56.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.796+0000 7f3292800640 1 --2- 172.21.15.144:0/1097609014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f328c15b370 0x7f328c072560 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f328c0cfff0 tx=0x7f327c02a1f0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.796+0000 7f3292800640 1 -- 172.21.15.144:0/1097609014 shutdown_connections 2024-09-11T23:17:56.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.796+0000 7f3292800640 1 --2- 172.21.15.144:0/1097609014 >> v2:172.21.15.165:3300/0 conn(0x7f328c06f130 0x7f328c0ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.796+0000 7f3292800640 1 --2- 172.21.15.144:0/1097609014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f328c15b370 0x7f328c072560 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.796+0000 7f3292800640 1 -- 172.21.15.144:0/1097609014 >> 172.21.15.144:0/1097609014 conn(0x7f328c06bba0 msgr2=0x7f328c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:56.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.796+0000 7f3292800640 1 -- 172.21.15.144:0/1097609014 shutdown_connections 2024-09-11T23:17:56.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.796+0000 7f3292800640 1 -- 172.21.15.144:0/1097609014 wait complete. 2024-09-11T23:17:56.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.798+0000 7f3292800640 1 Processor -- start 2024-09-11T23:17:56.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.798+0000 7f3292800640 1 -- start start 2024-09-11T23:17:56.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.799+0000 7f3292800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f328c06f130 0x7f328c149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.799+0000 7f3292800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f328c15b370 0x7f328c06d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.799+0000 7f3292800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f328c15f9f0 0x7f328c06df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.799+0000 7f3292800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f328c0731b0 con 0x7f328c15b370 2024-09-11T23:17:56.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.799+0000 7f3292800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f328c15c450 con 0x7f328c15f9f0 2024-09-11T23:17:56.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.799+0000 7f3292800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f328c15b750 con 0x7f328c06f130 2024-09-11T23:17:56.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.799+0000 7f3282a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f328c15b370 0x7f328c06d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:56.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.799+0000 7f3282a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f328c15b370 0x7f328c06d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38304/0 (socket says 172.21.15.144:38304) 2024-09-11T23:17:56.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.799+0000 7f3282a00640 1 -- 172.21.15.144:0/2483419012 learned_addr learned my addr 172.21.15.144:0/2483419012 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:17:56.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.799+0000 7f328b400640 1 --2- 172.21.15.144:0/2483419012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f328c06f130 0x7f328c149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:56.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.799+0000 7f328be00640 1 --2- 172.21.15.144:0/2483419012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f328c15f9f0 0x7f328c06df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:56.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.800+0000 7f3282a00640 1 -- 172.21.15.144:0/2483419012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f328c06f130 msgr2=0x7f328c149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:56.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.800+0000 7f3282a00640 1 --2- 172.21.15.144:0/2483419012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f328c06f130 0x7f328c149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.800+0000 7f3282a00640 1 -- 172.21.15.144:0/2483419012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f328c15f9f0 msgr2=0x7f328c06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:56.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.800+0000 7f3282a00640 1 --2- 172.21.15.144:0/2483419012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f328c15f9f0 0x7f328c06df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:56.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.800+0000 7f3282a00640 1 -- 172.21.15.144:0/2483419012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328c153200 con 0x7f328c15b370 2024-09-11T23:17:56.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.800+0000 7f3282a00640 1 --2- 172.21.15.144:0/2483419012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f328c15b370 0x7f328c06d9d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f327400c440 tx=0x7f327400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:56.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.800+0000 7f3283e00640 1 -- 172.21.15.144:0/2483419012 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32740052d0 con 0x7f328c15b370 2024-09-11T23:17:56.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.800+0000 7f3283e00640 1 -- 172.21.15.144:0/2483419012 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3274005470 con 0x7f328c15b370 2024-09-11T23:17:56.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.800+0000 7f3283e00640 1 -- 172.21.15.144:0/2483419012 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3274007260 con 0x7f328c15b370 2024-09-11T23:17:56.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.800+0000 7f3292800640 1 -- 172.21.15.144:0/2483419012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f328c152160 con 0x7f328c15b370 2024-09-11T23:17:56.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.800+0000 7f3292800640 1 -- 172.21.15.144:0/2483419012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f328c152720 con 0x7f328c15b370 2024-09-11T23:17:56.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.801+0000 7f3292800640 1 -- 172.21.15.144:0/2483419012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f328c15ef00 con 0x7f328c15b370 2024-09-11T23:17:56.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.802+0000 7f3283e00640 1 -- 172.21.15.144:0/2483419012 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3274007400 con 0x7f328c15b370 2024-09-11T23:17:56.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.803+0000 7f3283e00640 1 --2- 172.21.15.144:0/2483419012 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f326806be30 0x7f326806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:56.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.803+0000 7f3283e00640 1 -- 172.21.15.144:0/2483419012 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f3274089f60 con 0x7f328c15b370 2024-09-11T23:17:56.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.803+0000 7f328b400640 1 --2- 172.21.15.144:0/2483419012 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f326806be30 0x7f326806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:56.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.804+0000 7f328b400640 1 --2- 172.21.15.144:0/2483419012 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f326806be30 0x7f326806e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f327c034000 tx=0x7f327c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:56.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.807+0000 7f3283e00640 1 -- 172.21.15.144:0/2483419012 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f328c15ef00 con 0x7f328c15b370 2024-09-11T23:17:56.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:56.982+0000 7f3292800640 1 -- 172.21.15.144:0/2483419012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f328c072560 con 0x7f328c15b370 2024-09-11T23:17:57.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.608+0000 7f3283e00640 1 -- 172.21.15.144:0/2483419012 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7f3274058570 con 0x7f328c15b370 2024-09-11T23:17:57.610 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-11T23:17:57.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.611+0000 7f3292800640 1 -- 172.21.15.144:0/2483419012 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f326806be30 msgr2=0x7f326806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:57.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.611+0000 7f3292800640 1 --2- 172.21.15.144:0/2483419012 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f326806be30 0x7f326806e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f327c034000 tx=0x7f327c02e000 comp rx=0 tx=0).stop 2024-09-11T23:17:57.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.611+0000 7f3292800640 1 -- 172.21.15.144:0/2483419012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f328c15b370 msgr2=0x7f328c06d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:57.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.611+0000 7f3292800640 1 --2- 172.21.15.144:0/2483419012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f328c15b370 0x7f328c06d9d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f327400c440 tx=0x7f327400c900 comp rx=0 tx=0).stop 2024-09-11T23:17:57.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.612+0000 7f3292800640 1 -- 172.21.15.144:0/2483419012 shutdown_connections 2024-09-11T23:17:57.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.612+0000 7f3292800640 1 --2- 172.21.15.144:0/2483419012 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f326806be30 0x7f326806e2f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.612+0000 7f3292800640 1 --2- 172.21.15.144:0/2483419012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f328c15f9f0 0x7f328c06df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.612+0000 7f3292800640 1 --2- 172.21.15.144:0/2483419012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f328c15b370 0x7f328c06d9d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.612+0000 7f3292800640 1 --2- 172.21.15.144:0/2483419012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f328c06f130 0x7f328c149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.612+0000 7f3292800640 1 -- 172.21.15.144:0/2483419012 >> 172.21.15.144:0/2483419012 conn(0x7f328c06bba0 msgr2=0x7f328c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:57.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.612+0000 7f3292800640 1 -- 172.21.15.144:0/2483419012 shutdown_connections 2024-09-11T23:17:57.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.613+0000 7f3292800640 1 -- 172.21.15.144:0/2483419012 wait complete. 2024-09-11T23:17:57.637 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:17:57.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.797+0000 7efc7e400640 1 Processor -- start 2024-09-11T23:17:57.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.797+0000 7efc7e400640 1 -- start start 2024-09-11T23:17:57.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.798+0000 7efc7e400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7efc780d32d0 0x7efc7806d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:57.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.798+0000 7efc7e400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efc7806db50 0x7efc780b7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:57.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.798+0000 7efc7e400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc780d3890 con 0x7efc7815e650 2024-09-11T23:17:57.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.798+0000 7efc7e400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efc7815ea30 con 0x7efc7806db50 2024-09-11T23:17:57.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.798+0000 7efc7e400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7efc7806df90 con 0x7efc780d32d0 2024-09-11T23:17:57.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.798+0000 7efc7da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efc7806db50 0x7efc780b7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:57.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.799+0000 7efc7da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efc7806db50 0x7efc780b7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38318/0 (socket says 172.21.15.144:38318) 2024-09-11T23:17:57.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.799+0000 7efc7da00640 1 -- 172.21.15.144:0/1508080290 learned_addr learned my addr 172.21.15.144:0/1508080290 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:17:57.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.799+0000 7efc77e00640 1 --2- 172.21.15.144:0/1508080290 >> v2:172.21.15.165:3300/0 conn(0x7efc780d32d0 0x7efc7806d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:57.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.799+0000 7efc7da00640 1 -- 172.21.15.144:0/1508080290 >> v2:172.21.15.165:3300/0 conn(0x7efc780d32d0 msgr2=0x7efc7806d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:57.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.799+0000 7efc7da00640 1 --2- 172.21.15.144:0/1508080290 >> v2:172.21.15.165:3300/0 conn(0x7efc780d32d0 0x7efc7806d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.799+0000 7efc7da00640 1 -- 172.21.15.144:0/1508080290 >> v1:172.21.15.165:6789/0 conn(0x7efc7815e650 legacy=0x7efc780cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:57.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.799+0000 7efc7da00640 1 -- 172.21.15.144:0/1508080290 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc780d3b70 con 0x7efc7806db50 2024-09-11T23:17:57.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.800+0000 7efc7da00640 1 --2- 172.21.15.144:0/1508080290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc7806db50 0x7efc780b7cb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efc780c7e90 tx=0x7efc7002a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ff168dae488ee2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:57.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.800+0000 7efc77400640 1 -- 172.21.15.144:0/1508080290 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc70036070 con 0x7efc7806db50 2024-09-11T23:17:57.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.800+0000 7efc77400640 1 -- 172.21.15.144:0/1508080290 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc70031600 con 0x7efc7806db50 2024-09-11T23:17:57.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.800+0000 7efc77400640 1 -- 172.21.15.144:0/1508080290 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc700319f0 con 0x7efc7806db50 2024-09-11T23:17:57.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.801+0000 7efc7e400640 1 -- 172.21.15.144:0/1508080290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc7806db50 msgr2=0x7efc780b7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:57.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.801+0000 7efc7e400640 1 --2- 172.21.15.144:0/1508080290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc7806db50 0x7efc780b7cb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efc780c7e90 tx=0x7efc7002a7c0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.801+0000 7efc7e400640 1 -- 172.21.15.144:0/1508080290 shutdown_connections 2024-09-11T23:17:57.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.801+0000 7efc7e400640 1 --2- 172.21.15.144:0/1508080290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc7806db50 0x7efc780b7cb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.801+0000 7efc7e400640 1 --2- 172.21.15.144:0/1508080290 >> v2:172.21.15.165:3300/0 conn(0x7efc780d32d0 0x7efc7806d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.801+0000 7efc7e400640 1 -- 172.21.15.144:0/1508080290 >> 172.21.15.144:0/1508080290 conn(0x7efc780d4740 msgr2=0x7efc780d4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:57.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.801+0000 7efc7e400640 1 -- 172.21.15.144:0/1508080290 shutdown_connections 2024-09-11T23:17:57.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.801+0000 7efc7e400640 1 -- 172.21.15.144:0/1508080290 wait complete. 2024-09-11T23:17:57.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.802+0000 7efc7e400640 1 Processor -- start 2024-09-11T23:17:57.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.802+0000 7efc7e400640 1 -- start start 2024-09-11T23:17:57.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.803+0000 7efc7e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc7806db50 0x7efc780cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:57.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.803+0000 7efc7e400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc780d32d0 0x7efc781f8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:57.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.803+0000 7efc7e400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc7815e650 0x7efc781554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:57.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.803+0000 7efc7e400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efc780b7690 con 0x7efc7806db50 2024-09-11T23:17:57.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.803+0000 7efc7e400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efc780d4130 con 0x7efc7815e650 2024-09-11T23:17:57.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.803+0000 7efc7e400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efc780b7810 con 0x7efc780d32d0 2024-09-11T23:17:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.804+0000 7efc7d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc7806db50 0x7efc780cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.804+0000 7efc77e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc780d32d0 0x7efc781f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.804+0000 7efc7da00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc7815e650 0x7efc781554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.804+0000 7efc7d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc7806db50 0x7efc780cc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38328/0 (socket says 172.21.15.144:38328) 2024-09-11T23:17:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.804+0000 7efc7d000640 1 -- 172.21.15.144:0/945540679 learned_addr learned my addr 172.21.15.144:0/945540679 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:17:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.804+0000 7efc7d000640 1 -- 172.21.15.144:0/945540679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc780d32d0 msgr2=0x7efc781f8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.804+0000 7efc7d000640 1 --2- 172.21.15.144:0/945540679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc780d32d0 0x7efc781f8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.804+0000 7efc7d000640 1 -- 172.21.15.144:0/945540679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc7815e650 msgr2=0x7efc781554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.804+0000 7efc7d000640 1 --2- 172.21.15.144:0/945540679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc7815e650 0x7efc781554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:57.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.804+0000 7efc7d000640 1 -- 172.21.15.144:0/945540679 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc781f8ac0 con 0x7efc7806db50 2024-09-11T23:17:57.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.804+0000 7efc7d000640 1 --2- 172.21.15.144:0/945540679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc7806db50 0x7efc780cc1e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00c3c0 tx=0x7efc6c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:57.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.804+0000 7efc74c00640 1 -- 172.21.15.144:0/945540679 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c0052d0 con 0x7efc7806db50 2024-09-11T23:17:57.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.805+0000 7efc74c00640 1 -- 172.21.15.144:0/945540679 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6c005490 con 0x7efc7806db50 2024-09-11T23:17:57.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.805+0000 7efc74c00640 1 -- 172.21.15.144:0/945540679 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c007260 con 0x7efc7806db50 2024-09-11T23:17:57.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.805+0000 7efc7e400640 1 -- 172.21.15.144:0/945540679 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc780cb760 con 0x7efc7806db50 2024-09-11T23:17:57.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.805+0000 7efc7e400640 1 -- 172.21.15.144:0/945540679 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc780cbd20 con 0x7efc7806db50 2024-09-11T23:17:57.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.806+0000 7efc7e400640 1 -- 172.21.15.144:0/945540679 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc7806d610 con 0x7efc7806db50 2024-09-11T23:17:57.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.807+0000 7efc74c00640 1 -- 172.21.15.144:0/945540679 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc6c007400 con 0x7efc7806db50 2024-09-11T23:17:57.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.808+0000 7efc74c00640 1 --2- 172.21.15.144:0/945540679 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc5806be30 0x7efc5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:57.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.808+0000 7efc74c00640 1 -- 172.21.15.144:0/945540679 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7efc6c08a0e0 con 0x7efc7806db50 2024-09-11T23:17:57.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.808+0000 7efc77e00640 1 --2- 172.21.15.144:0/945540679 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc5806be30 0x7efc5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:57.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.808+0000 7efc77e00640 1 --2- 172.21.15.144:0/945540679 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc5806be30 0x7efc5806e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efc780cb420 tx=0x7efc64009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:57.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.813+0000 7efc74c00640 1 -- 172.21.15.144:0/945540679 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc781f8ac0 con 0x7efc7806db50 2024-09-11T23:17:57.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:57.987+0000 7efc7e400640 1 -- 172.21.15.144:0/945540679 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efc7815d8e0 con 0x7efc7806db50 2024-09-11T23:17:58.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.612+0000 7efc74c00640 1 -- 172.21.15.144:0/945540679 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) ==== 170+0+0 (secure 0 0 0) 0x7efc6c058610 con 0x7efc7806db50 2024-09-11T23:17:58.613 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-11T23:17:58.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.614+0000 7efc7e400640 1 -- 172.21.15.144:0/945540679 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc5806be30 msgr2=0x7efc5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:58.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.614+0000 7efc7e400640 1 --2- 172.21.15.144:0/945540679 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc5806be30 0x7efc5806e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efc780cb420 tx=0x7efc64009190 comp rx=0 tx=0).stop 2024-09-11T23:17:58.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.615+0000 7efc7e400640 1 -- 172.21.15.144:0/945540679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc7806db50 msgr2=0x7efc780cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:58.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.615+0000 7efc7e400640 1 --2- 172.21.15.144:0/945540679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc7806db50 0x7efc780cc1e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00c3c0 tx=0x7efc6c00c880 comp rx=0 tx=0).stop 2024-09-11T23:17:58.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.615+0000 7efc7e400640 1 -- 172.21.15.144:0/945540679 shutdown_connections 2024-09-11T23:17:58.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.615+0000 7efc7e400640 1 --2- 172.21.15.144:0/945540679 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc5806be30 0x7efc5806e2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.615+0000 7efc7e400640 1 --2- 172.21.15.144:0/945540679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc7815e650 0x7efc781554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.615+0000 7efc7e400640 1 --2- 172.21.15.144:0/945540679 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc780d32d0 0x7efc781f8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.615+0000 7efc7e400640 1 --2- 172.21.15.144:0/945540679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc7806db50 0x7efc780cc1e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.615+0000 7efc7e400640 1 -- 172.21.15.144:0/945540679 >> 172.21.15.144:0/945540679 conn(0x7efc780d4740 msgr2=0x7efc780d4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:58.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.615+0000 7efc7e400640 1 -- 172.21.15.144:0/945540679 shutdown_connections 2024-09-11T23:17:58.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.615+0000 7efc7e400640 1 -- 172.21.15.144:0/945540679 wait complete. 2024-09-11T23:17:58.653 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:17:58.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.808+0000 7f101aa00640 1 Processor -- start 2024-09-11T23:17:58.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.809+0000 7f101aa00640 1 -- start start 2024-09-11T23:17:58.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.810+0000 7f101aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1014158e50 0x7f10140b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:58.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.810+0000 7f101aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f101415c370 0x7f101406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:58.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.810+0000 7f101aa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f101406ef60 0x7f101415ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:58.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.810+0000 7f101aa00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f101406f3d0 con 0x7f1014158e50 2024-09-11T23:17:58.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.810+0000 7f101aa00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f101415c800 con 0x7f101406ef60 2024-09-11T23:17:58.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.810+0000 7f101aa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f10140b43f0 con 0x7f101415c370 2024-09-11T23:17:58.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.810+0000 7f1013e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1014158e50 0x7f10140b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:58.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.810+0000 7f1013e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1014158e50 0x7f10140b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38338/0 (socket says 172.21.15.144:38338) 2024-09-11T23:17:58.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.810+0000 7f1013e00640 1 -- 172.21.15.144:0/1202330477 learned_addr learned my addr 172.21.15.144:0/1202330477 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:17:58.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.810+0000 7f100b400640 1 --2- 172.21.15.144:0/1202330477 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f101415c370 0x7f101406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:58.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.810+0000 7f1018a00640 1 --2- 172.21.15.144:0/1202330477 >> v2:172.21.15.165:3300/0 conn(0x7f101406ef60 0x7f101415ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:58.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.811+0000 7f1013e00640 1 -- 172.21.15.144:0/1202330477 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f101415c370 msgr2=0x7f101406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:58.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.811+0000 7f1013e00640 1 --2- 172.21.15.144:0/1202330477 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f101415c370 0x7f101406ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.811+0000 7f1013e00640 1 -- 172.21.15.144:0/1202330477 >> v2:172.21.15.165:3300/0 conn(0x7f101406ef60 msgr2=0x7f101415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:58.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.811+0000 7f1013e00640 1 --2- 172.21.15.144:0/1202330477 >> v2:172.21.15.165:3300/0 conn(0x7f101406ef60 0x7f101415ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.811+0000 7f1013e00640 1 -- 172.21.15.144:0/1202330477 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10140b3630 con 0x7f1014158e50 2024-09-11T23:17:58.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.811+0000 7f100b400640 1 --2- 172.21.15.144:0/1202330477 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f101415c370 0x7f101406ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:17:58.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.811+0000 7f1018a00640 1 --2- 172.21.15.144:0/1202330477 >> v2:172.21.15.165:3300/0 conn(0x7f101406ef60 0x7f101415ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:17:58.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.811+0000 7f1013e00640 1 --2- 172.21.15.144:0/1202330477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1014158e50 0x7f10140b5050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f10140affb0 tx=0x7f100402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce602634db5b8e80 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:58.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.812+0000 7f1013400640 1 -- 172.21.15.144:0/1202330477 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004037070 con 0x7f1014158e50 2024-09-11T23:17:58.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.812+0000 7f1013400640 1 -- 172.21.15.144:0/1202330477 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1004032440 con 0x7f1014158e50 2024-09-11T23:17:58.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.812+0000 7f1013400640 1 -- 172.21.15.144:0/1202330477 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004032810 con 0x7f1014158e50 2024-09-11T23:17:58.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.812+0000 7f101aa00640 1 -- 172.21.15.144:0/1202330477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1014158e50 msgr2=0x7f10140b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:58.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.812+0000 7f101aa00640 1 --2- 172.21.15.144:0/1202330477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1014158e50 0x7f10140b5050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f10140affb0 tx=0x7f100402a1e0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.812+0000 7f101aa00640 1 -- 172.21.15.144:0/1202330477 shutdown_connections 2024-09-11T23:17:58.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.812+0000 7f101aa00640 1 --2- 172.21.15.144:0/1202330477 >> v2:172.21.15.165:3300/0 conn(0x7f101406ef60 0x7f101415ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.812+0000 7f101aa00640 1 --2- 172.21.15.144:0/1202330477 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f101415c370 0x7f101406ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.812+0000 7f101aa00640 1 --2- 172.21.15.144:0/1202330477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1014158e50 0x7f10140b5050 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.812+0000 7f101aa00640 1 -- 172.21.15.144:0/1202330477 >> 172.21.15.144:0/1202330477 conn(0x7f101406bba0 msgr2=0x7f101406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:58.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.813+0000 7f101aa00640 1 -- 172.21.15.144:0/1202330477 shutdown_connections 2024-09-11T23:17:58.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.813+0000 7f101aa00640 1 -- 172.21.15.144:0/1202330477 wait complete. 2024-09-11T23:17:58.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.814+0000 7f101aa00640 1 Processor -- start 2024-09-11T23:17:58.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.814+0000 7f101aa00640 1 -- start start 2024-09-11T23:17:58.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.815+0000 7f101aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f101406ef60 0x7f10140ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:58.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.815+0000 7f101aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1014158e50 0x7f101414cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:58.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.815+0000 7f101aa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f101415c370 0x7f10141e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:58.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.815+0000 7f101aa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10140b3ed0 con 0x7f101406ef60 2024-09-11T23:17:58.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.815+0000 7f101aa00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f10140b3bf0 con 0x7f101415c370 2024-09-11T23:17:58.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.815+0000 7f101aa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1014159230 con 0x7f1014158e50 2024-09-11T23:17:58.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.815+0000 7f1013e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f101406ef60 0x7f10140ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:58.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.815+0000 7f100b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1014158e50 0x7f101414cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:58.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.815+0000 7f1013e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f101406ef60 0x7f10140ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38342/0 (socket says 172.21.15.144:38342) 2024-09-11T23:17:58.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.815+0000 7f1013e00640 1 -- 172.21.15.144:0/4037308948 learned_addr learned my addr 172.21.15.144:0/4037308948 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:17:58.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.815+0000 7f1018a00640 1 --2- 172.21.15.144:0/4037308948 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f101415c370 0x7f10141e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:58.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.816+0000 7f1013e00640 1 -- 172.21.15.144:0/4037308948 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1014158e50 msgr2=0x7f101414cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:58.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.816+0000 7f1013e00640 1 --2- 172.21.15.144:0/4037308948 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1014158e50 0x7f101414cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.816+0000 7f1013e00640 1 -- 172.21.15.144:0/4037308948 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f101415c370 msgr2=0x7f10141e7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:58.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.816+0000 7f1013e00640 1 --2- 172.21.15.144:0/4037308948 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f101415c370 0x7f10141e7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:58.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.816+0000 7f1013e00640 1 -- 172.21.15.144:0/4037308948 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101415d780 con 0x7f101406ef60 2024-09-11T23:17:58.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.816+0000 7f1013e00640 1 --2- 172.21.15.144:0/4037308948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f101406ef60 0x7f10140ca470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f100402a220 tx=0x7f10040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:58.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.816+0000 7f1010c00640 1 -- 172.21.15.144:0/4037308948 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004041020 con 0x7f101406ef60 2024-09-11T23:17:58.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.816+0000 7f1010c00640 1 -- 172.21.15.144:0/4037308948 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10040306c0 con 0x7f101406ef60 2024-09-11T23:17:58.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.816+0000 7f101aa00640 1 -- 172.21.15.144:0/4037308948 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10140c9990 con 0x7f101406ef60 2024-09-11T23:17:58.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.816+0000 7f1010c00640 1 -- 172.21.15.144:0/4037308948 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004037040 con 0x7f101406ef60 2024-09-11T23:17:58.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.817+0000 7f101aa00640 1 -- 172.21.15.144:0/4037308948 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10140c9f50 con 0x7f101406ef60 2024-09-11T23:17:58.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.818+0000 7f101aa00640 1 -- 172.21.15.144:0/4037308948 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10140ca120 con 0x7f101406ef60 2024-09-11T23:17:58.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.819+0000 7f1010c00640 1 -- 172.21.15.144:0/4037308948 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1004044020 con 0x7f101406ef60 2024-09-11T23:17:58.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.819+0000 7f1010c00640 1 --2- 172.21.15.144:0/4037308948 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0ff006be30 0x7f0ff006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:58.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.820+0000 7f1010c00640 1 -- 172.21.15.144:0/4037308948 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f10040ab510 con 0x7f101406ef60 2024-09-11T23:17:58.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.820+0000 7f100b400640 1 --2- 172.21.15.144:0/4037308948 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0ff006be30 0x7f0ff006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:58.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.820+0000 7f100b400640 1 --2- 172.21.15.144:0/4037308948 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0ff006be30 0x7f0ff006e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0045f0 tx=0x7f0ffc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:58.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:58.824+0000 7f1010c00640 1 -- 172.21.15.144:0/4037308948 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f100404b030 con 0x7f101406ef60 2024-09-11T23:17:59.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.033+0000 7f101aa00640 1 -- 172.21.15.144:0/4037308948 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1014071fc0 con 0x7f101406ef60 2024-09-11T23:17:59.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.631+0000 7f1010c00640 1 -- 172.21.15.144:0/4037308948 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f10040798d0 con 0x7f101406ef60 2024-09-11T23:17:59.633 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 2 and data pool 3 2024-09-11T23:17:59.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.635+0000 7f101aa00640 1 -- 172.21.15.144:0/4037308948 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0ff006be30 msgr2=0x7f0ff006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:59.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.635+0000 7f101aa00640 1 --2- 172.21.15.144:0/4037308948 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0ff006be30 0x7f0ff006e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0045f0 tx=0x7f0ffc008040 comp rx=0 tx=0).stop 2024-09-11T23:17:59.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.635+0000 7f101aa00640 1 -- 172.21.15.144:0/4037308948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f101406ef60 msgr2=0x7f10140ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:59.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.635+0000 7f101aa00640 1 --2- 172.21.15.144:0/4037308948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f101406ef60 0x7f10140ca470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f100402a220 tx=0x7f10040046c0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.636+0000 7f101aa00640 1 -- 172.21.15.144:0/4037308948 shutdown_connections 2024-09-11T23:17:59.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.636+0000 7f101aa00640 1 --2- 172.21.15.144:0/4037308948 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0ff006be30 0x7f0ff006e2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.636+0000 7f101aa00640 1 --2- 172.21.15.144:0/4037308948 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f101415c370 0x7f10141e7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.636+0000 7f101aa00640 1 --2- 172.21.15.144:0/4037308948 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1014158e50 0x7f101414cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.636+0000 7f101aa00640 1 --2- 172.21.15.144:0/4037308948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f101406ef60 0x7f10140ca470 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.636+0000 7f101aa00640 1 -- 172.21.15.144:0/4037308948 >> 172.21.15.144:0/4037308948 conn(0x7f101406bba0 msgr2=0x7f10140cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:59.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.639+0000 7f101aa00640 1 -- 172.21.15.144:0/4037308948 shutdown_connections 2024-09-11T23:17:59.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.639+0000 7f101aa00640 1 -- 172.21.15.144:0/4037308948 wait complete. 2024-09-11T23:17:59.666 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:17:59.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.820+0000 7f9ee1e00640 1 Processor -- start 2024-09-11T23:17:59.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.820+0000 7f9ee1e00640 1 -- start start 2024-09-11T23:17:59.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.821+0000 7f9ee1e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9edc0b5fd0 0x7f9edc0b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:59.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.821+0000 7f9ee1e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9edc0b7750 0x7f9edc0b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:59.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.821+0000 7f9ee1e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9edc06bee0 con 0x7f9edc15e640 2024-09-11T23:17:59.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.821+0000 7f9ee1e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9edc15ea20 con 0x7f9edc0b7750 2024-09-11T23:17:59.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.821+0000 7f9ee1e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9edc06caf0 con 0x7f9edc0b5fd0 2024-09-11T23:17:59.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.822+0000 7f9ee1400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9edc0b7750 0x7f9edc0b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:59.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.822+0000 7f9ee1400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9edc0b7750 0x7f9edc0b7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38350/0 (socket says 172.21.15.144:38350) 2024-09-11T23:17:59.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.822+0000 7f9ee1400640 1 -- 172.21.15.144:0/3331112918 learned_addr learned my addr 172.21.15.144:0/3331112918 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:17:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.822+0000 7f9ed3e00640 1 --2- 172.21.15.144:0/3331112918 >> v2:172.21.15.165:3300/0 conn(0x7f9edc0b5fd0 0x7f9edc0b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.822+0000 7f9ee1400640 1 -- 172.21.15.144:0/3331112918 >> v2:172.21.15.165:3300/0 conn(0x7f9edc0b5fd0 msgr2=0x7f9edc0b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.822+0000 7f9ee1400640 1 --2- 172.21.15.144:0/3331112918 >> v2:172.21.15.165:3300/0 conn(0x7f9edc0b5fd0 0x7f9edc0b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.822+0000 7f9ee1400640 1 -- 172.21.15.144:0/3331112918 >> v1:172.21.15.165:6789/0 conn(0x7f9edc15e640 legacy=0x7f9edc0d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:17:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.822+0000 7f9ee1400640 1 -- 172.21.15.144:0/3331112918 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc06c1c0 con 0x7f9edc0b7750 2024-09-11T23:17:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.822+0000 7f9ed3e00640 1 --2- 172.21.15.144:0/3331112918 >> v2:172.21.15.165:3300/0 conn(0x7f9edc0b5fd0 0x7f9edc0b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:17:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.823+0000 7f9ee1400640 1 --2- 172.21.15.144:0/3331112918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc0b7750 0x7f9edc0b7be0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0d0fa0 tx=0x7f9ed402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e4bd732f135ef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.823+0000 7f9edbe00640 1 -- 172.21.15.144:0/3331112918 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4036070 con 0x7f9edc0b7750 2024-09-11T23:17:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.823+0000 7f9edbe00640 1 -- 172.21.15.144:0/3331112918 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed4031600 con 0x7f9edc0b7750 2024-09-11T23:17:59.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.823+0000 7f9edbe00640 1 -- 172.21.15.144:0/3331112918 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed40319d0 con 0x7f9edc0b7750 2024-09-11T23:17:59.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.823+0000 7f9ee1e00640 1 -- 172.21.15.144:0/3331112918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc0b7750 msgr2=0x7f9edc0b7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:59.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.823+0000 7f9ee1e00640 1 --2- 172.21.15.144:0/3331112918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc0b7750 0x7f9edc0b7be0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0d0fa0 tx=0x7f9ed402a6f0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.824+0000 7f9ee1e00640 1 -- 172.21.15.144:0/3331112918 shutdown_connections 2024-09-11T23:17:59.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.824+0000 7f9ee1e00640 1 --2- 172.21.15.144:0/3331112918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc0b7750 0x7f9edc0b7be0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.824+0000 7f9ee1e00640 1 --2- 172.21.15.144:0/3331112918 >> v2:172.21.15.165:3300/0 conn(0x7f9edc0b5fd0 0x7f9edc0b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.824+0000 7f9ee1e00640 1 -- 172.21.15.144:0/3331112918 >> 172.21.15.144:0/3331112918 conn(0x7f9edc0d0fd0 msgr2=0x7f9edc0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:17:59.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.824+0000 7f9ee1e00640 1 -- 172.21.15.144:0/3331112918 shutdown_connections 2024-09-11T23:17:59.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.824+0000 7f9ee1e00640 1 -- 172.21.15.144:0/3331112918 wait complete. 2024-09-11T23:17:59.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.825+0000 7f9ee1e00640 1 Processor -- start 2024-09-11T23:17:59.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.825+0000 7f9ee1e00640 1 -- start start 2024-09-11T23:17:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.826+0000 7f9ee1e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9edc0b5fd0 0x7f9edc0cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.826+0000 7f9ee1e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9edc0b7750 0x7f9edc152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.826+0000 7f9ee1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc15e640 0x7f9edc0b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.826+0000 7f9ee1e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc06c780 con 0x7f9edc15e640 2024-09-11T23:17:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.826+0000 7f9ee1e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc0b6950 con 0x7f9edc0b7750 2024-09-11T23:17:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.826+0000 7f9ee1e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9edc0d4130 con 0x7f9edc0b5fd0 2024-09-11T23:17:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.826+0000 7f9ee1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc15e640 0x7f9edc0b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.826+0000 7f9ee1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc15e640 0x7f9edc0b7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38358/0 (socket says 172.21.15.144:38358) 2024-09-11T23:17:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.826+0000 7f9ee1400640 1 -- 172.21.15.144:0/1398024771 learned_addr learned my addr 172.21.15.144:0/1398024771 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:17:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.826+0000 7f9ee0a00640 1 --2- 172.21.15.144:0/1398024771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9edc0b5fd0 0x7f9edc0cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.827+0000 7f9ed3e00640 1 --2- 172.21.15.144:0/1398024771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9edc0b7750 0x7f9edc152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:59.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.827+0000 7f9ee1400640 1 -- 172.21.15.144:0/1398024771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9edc0b5fd0 msgr2=0x7f9edc0cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.827+0000 7f9ee1400640 1 --2- 172.21.15.144:0/1398024771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9edc0b5fd0 0x7f9edc0cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.827+0000 7f9ee1400640 1 -- 172.21.15.144:0/1398024771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9edc0b7750 msgr2=0x7f9edc152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:17:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.827+0000 7f9ee1400640 1 --2- 172.21.15.144:0/1398024771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9edc0b7750 0x7f9edc152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:17:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.827+0000 7f9ee1400640 1 -- 172.21.15.144:0/1398024771 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc0cdba0 con 0x7f9edc15e640 2024-09-11T23:17:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.827+0000 7f9ed3e00640 1 --2- 172.21.15.144:0/1398024771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9edc0b7750 0x7f9edc152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:17:59.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.827+0000 7f9ee1400640 1 --2- 172.21.15.144:0/1398024771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc15e640 0x7f9edc0b7bc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4034040 tx=0x7f9ed4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:59.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.827+0000 7f9ed9600640 1 -- 172.21.15.144:0/1398024771 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4036050 con 0x7f9edc15e640 2024-09-11T23:17:59.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.827+0000 7f9ed9600640 1 -- 172.21.15.144:0/1398024771 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed4042070 con 0x7f9edc15e640 2024-09-11T23:17:59.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.827+0000 7f9ee1e00640 1 -- 172.21.15.144:0/1398024771 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9edc0ccb00 con 0x7f9edc15e640 2024-09-11T23:17:59.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.827+0000 7f9ed9600640 1 -- 172.21.15.144:0/1398024771 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4009510 con 0x7f9edc15e640 2024-09-11T23:17:59.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.828+0000 7f9ee1e00640 1 -- 172.21.15.144:0/1398024771 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9edc0cd0c0 con 0x7f9edc15e640 2024-09-11T23:17:59.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.829+0000 7f9ee1e00640 1 -- 172.21.15.144:0/1398024771 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9edc0cfdd0 con 0x7f9edc15e640 2024-09-11T23:17:59.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.829+0000 7f9ed9600640 1 -- 172.21.15.144:0/1398024771 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ed4007bf0 con 0x7f9edc15e640 2024-09-11T23:17:59.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.830+0000 7f9ed9600640 1 --2- 172.21.15.144:0/1398024771 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9eb806be60 0x7f9eb806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:17:59.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.830+0000 7f9ed9600640 1 -- 172.21.15.144:0/1398024771 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9ed40ab680 con 0x7f9edc15e640 2024-09-11T23:17:59.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.830+0000 7f9ee0a00640 1 --2- 172.21.15.144:0/1398024771 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9eb806be60 0x7f9eb806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:17:59.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.831+0000 7f9ee0a00640 1 --2- 172.21.15.144:0/1398024771 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9eb806be60 0x7f9eb806e320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc004f60 tx=0x7f9ecc007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:17:59.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:17:59.835+0000 7f9ed9600640 1 -- 172.21.15.144:0/1398024771 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9edc0cfdd0 con 0x7f9edc15e640 2024-09-11T23:18:00.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.009+0000 7f9ee1e00640 1 -- 172.21.15.144:0/1398024771 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9edc0b6410 con 0x7f9edc15e640 2024-09-11T23:18:00.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.011+0000 7f9ed9600640 1 -- 172.21.15.144:0/1398024771 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16702 (secure 0 0 0) 0x7f9ed404b020 con 0x7f9edc15e640 2024-09-11T23:18:00.013 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:00.013 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":21,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:17:59.035588+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:17:57.023145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:17:58.028864+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:00.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.013+0000 7f9ee1e00640 1 -- 172.21.15.144:0/1398024771 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9eb806be60 msgr2=0x7f9eb806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:00.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.013+0000 7f9ee1e00640 1 --2- 172.21.15.144:0/1398024771 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9eb806be60 0x7f9eb806e320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc004f60 tx=0x7f9ecc007e30 comp rx=0 tx=0).stop 2024-09-11T23:18:00.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.013+0000 7f9ee1e00640 1 -- 172.21.15.144:0/1398024771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc15e640 msgr2=0x7f9edc0b7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:00.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.013+0000 7f9ee1e00640 1 --2- 172.21.15.144:0/1398024771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc15e640 0x7f9edc0b7bc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4034040 tx=0x7f9ed4004a40 comp rx=0 tx=0).stop 2024-09-11T23:18:00.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.013+0000 7f9ee1e00640 1 -- 172.21.15.144:0/1398024771 shutdown_connections 2024-09-11T23:18:00.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.013+0000 7f9ee1e00640 1 --2- 172.21.15.144:0/1398024771 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9eb806be60 0x7f9eb806e320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:00.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.013+0000 7f9ee1e00640 1 --2- 172.21.15.144:0/1398024771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9edc15e640 0x7f9edc0b7bc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:00.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.013+0000 7f9ee1e00640 1 --2- 172.21.15.144:0/1398024771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9edc0b7750 0x7f9edc152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:00.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.013+0000 7f9ee1e00640 1 --2- 172.21.15.144:0/1398024771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9edc0b5fd0 0x7f9edc0cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:00.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.013+0000 7f9ee1e00640 1 -- 172.21.15.144:0/1398024771 >> 172.21.15.144:0/1398024771 conn(0x7f9edc0d0fd0 msgr2=0x7f9edc0d2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:00.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.013+0000 7f9ee1e00640 1 -- 172.21.15.144:0/1398024771 shutdown_connections 2024-09-11T23:18:00.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.013+0000 7f9ee1e00640 1 -- 172.21.15.144:0/1398024771 wait complete. 2024-09-11T23:18:00.030 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:18:00.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.181+0000 7fe8e3800640 1 Processor -- start 2024-09-11T23:18:00.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.181+0000 7fe8e3800640 1 -- start start 2024-09-11T23:18:00.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.182+0000 7fe8e3800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe8dc15c180 0x7fe8dc0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:00.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.182+0000 7fe8e3800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe8dc0ce230 0x7fe8dc0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:00.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.182+0000 7fe8e3800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8dc0ce740 con 0x7fe8dc0cf5b0 2024-09-11T23:18:00.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.182+0000 7fe8e3800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe8dc072640 con 0x7fe8dc0ce230 2024-09-11T23:18:00.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.182+0000 7fe8e3800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe8dc072920 con 0x7fe8dc15c180 2024-09-11T23:18:00.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.183+0000 7fe8dbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe8dc0ce230 0x7fe8dc0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:00.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.183+0000 7fe8dbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe8dc0ce230 0x7fe8dc0cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38372/0 (socket says 172.21.15.144:38372) 2024-09-11T23:18:00.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.183+0000 7fe8dbe00640 1 -- 172.21.15.144:0/1629153055 learned_addr learned my addr 172.21.15.144:0/1629153055 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:00.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.183+0000 7fe8e0e00640 1 --2- 172.21.15.144:0/1629153055 >> v2:172.21.15.165:3300/0 conn(0x7fe8dc15c180 0x7fe8dc0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:00.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.183+0000 7fe8dbe00640 1 -- 172.21.15.144:0/1629153055 >> v2:172.21.15.165:3300/0 conn(0x7fe8dc15c180 msgr2=0x7fe8dc0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:00.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.183+0000 7fe8dbe00640 1 --2- 172.21.15.144:0/1629153055 >> v2:172.21.15.165:3300/0 conn(0x7fe8dc15c180 0x7fe8dc0cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:00.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.183+0000 7fe8dbe00640 1 -- 172.21.15.144:0/1629153055 >> v1:172.21.15.165:6789/0 conn(0x7fe8dc0cf5b0 legacy=0x7fe8dc073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:00.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.183+0000 7fe8dbe00640 1 -- 172.21.15.144:0/1629153055 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8dc072c00 con 0x7fe8dc0ce230 2024-09-11T23:18:00.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.184+0000 7fe8dbe00640 1 --2- 172.21.15.144:0/1629153055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8dc0ce230 0x7fe8dc0cf070 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc06cc10 tx=0x7fe8c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19f01e595f546f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.184+0000 7fe8db400640 1 -- 172.21.15.144:0/1629153055 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8037070 con 0x7fe8dc0ce230 2024-09-11T23:18:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.184+0000 7fe8db400640 1 -- 172.21.15.144:0/1629153055 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c8032440 con 0x7fe8dc0ce230 2024-09-11T23:18:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.184+0000 7fe8db400640 1 -- 172.21.15.144:0/1629153055 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8032810 con 0x7fe8dc0ce230 2024-09-11T23:18:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.185+0000 7fe8e3800640 1 -- 172.21.15.144:0/1629153055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8dc0ce230 msgr2=0x7fe8dc0cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.185+0000 7fe8e3800640 1 --2- 172.21.15.144:0/1629153055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8dc0ce230 0x7fe8dc0cf070 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc06cc10 tx=0x7fe8c802a1e0 comp rx=0 tx=0).stop 2024-09-11T23:18:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.185+0000 7fe8e3800640 1 -- 172.21.15.144:0/1629153055 shutdown_connections 2024-09-11T23:18:00.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.185+0000 7fe8e3800640 1 --2- 172.21.15.144:0/1629153055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8dc0ce230 0x7fe8dc0cf070 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:00.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.185+0000 7fe8e3800640 1 --2- 172.21.15.144:0/1629153055 >> v2:172.21.15.165:3300/0 conn(0x7fe8dc15c180 0x7fe8dc0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:00.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.185+0000 7fe8e3800640 1 -- 172.21.15.144:0/1629153055 >> 172.21.15.144:0/1629153055 conn(0x7fe8dc062cc0 msgr2=0x7fe8dc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:00.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.185+0000 7fe8e3800640 1 -- 172.21.15.144:0/1629153055 shutdown_connections 2024-09-11T23:18:00.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.185+0000 7fe8e3800640 1 -- 172.21.15.144:0/1629153055 wait complete. 2024-09-11T23:18:00.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.187+0000 7fe8e3800640 1 Processor -- start 2024-09-11T23:18:00.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.187+0000 7fe8e3800640 1 -- start start 2024-09-11T23:18:00.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.188+0000 7fe8e3800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8dc0ce230 0x7fe8dc1603c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:00.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.188+0000 7fe8e3800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8dc0cf5b0 0x7fe8dc146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:00.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.188+0000 7fe8e3800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8dc15c180 0x7fe8dc0b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:00.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.188+0000 7fe8e3800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc15c560 con 0x7fe8dc0ce230 2024-09-11T23:18:00.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.188+0000 7fe8e3800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc0722f0 con 0x7fe8dc0cf5b0 2024-09-11T23:18:00.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.188+0000 7fe8e3800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8dc15c6e0 con 0x7fe8dc15c180 2024-09-11T23:18:00.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.188+0000 7fe8e0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8dc0ce230 0x7fe8dc1603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:00.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.188+0000 7fe8e0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8dc0ce230 0x7fe8dc1603c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38386/0 (socket says 172.21.15.144:38386) 2024-09-11T23:18:00.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.188+0000 7fe8e0e00640 1 -- 172.21.15.144:0/965987919 learned_addr learned my addr 172.21.15.144:0/965987919 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:00.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.188+0000 7fe8dbe00640 1 --2- 172.21.15.144:0/965987919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8dc0cf5b0 0x7fe8dc146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:00.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.188+0000 7fe8e1800640 1 --2- 172.21.15.144:0/965987919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8dc15c180 0x7fe8dc0b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:00.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.188+0000 7fe8e0e00640 1 -- 172.21.15.144:0/965987919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8dc15c180 msgr2=0x7fe8dc0b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:00.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.188+0000 7fe8e0e00640 1 --2- 172.21.15.144:0/965987919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8dc15c180 0x7fe8dc0b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:00.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.188+0000 7fe8e0e00640 1 -- 172.21.15.144:0/965987919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8dc0cf5b0 msgr2=0x7fe8dc146e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:00.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.188+0000 7fe8e0e00640 1 --2- 172.21.15.144:0/965987919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8dc0cf5b0 0x7fe8dc146e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:00.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.188+0000 7fe8e0e00640 1 -- 172.21.15.144:0/965987919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8dc0b2420 con 0x7fe8dc0ce230 2024-09-11T23:18:00.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.188+0000 7fe8e0e00640 1 --2- 172.21.15.144:0/965987919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8dc0ce230 0x7fe8dc1603c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000e9b0 tx=0x7fe8d000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:00.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.189+0000 7fe8d8c00640 1 -- 172.21.15.144:0/965987919 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0017070 con 0x7fe8dc0ce230 2024-09-11T23:18:00.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.189+0000 7fe8d8c00640 1 -- 172.21.15.144:0/965987919 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d000c9a0 con 0x7fe8dc0ce230 2024-09-11T23:18:00.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.189+0000 7fe8d8c00640 1 -- 172.21.15.144:0/965987919 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d000cd90 con 0x7fe8dc0ce230 2024-09-11T23:18:00.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.189+0000 7fe8e3800640 1 -- 172.21.15.144:0/965987919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8dc0b2700 con 0x7fe8dc0ce230 2024-09-11T23:18:00.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.189+0000 7fe8e3800640 1 -- 172.21.15.144:0/965987919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8dc1e6bb0 con 0x7fe8dc0ce230 2024-09-11T23:18:00.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.190+0000 7fe8e3800640 1 -- 172.21.15.144:0/965987919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8dc0cd720 con 0x7fe8dc0ce230 2024-09-11T23:18:00.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.191+0000 7fe8d8c00640 1 -- 172.21.15.144:0/965987919 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8d001a070 con 0x7fe8dc0ce230 2024-09-11T23:18:00.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.192+0000 7fe8d8c00640 1 --2- 172.21.15.144:0/965987919 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe8bc06be60 0x7fe8bc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:00.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.192+0000 7fe8d8c00640 1 -- 172.21.15.144:0/965987919 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe8d008b1f0 con 0x7fe8dc0ce230 2024-09-11T23:18:00.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.192+0000 7fe8dbe00640 1 --2- 172.21.15.144:0/965987919 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe8bc06be60 0x7fe8bc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:00.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.193+0000 7fe8dbe00640 1 --2- 172.21.15.144:0/965987919 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe8bc06be60 0x7fe8bc06e320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8034000 tx=0x7fe8c802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:00.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.196+0000 7fe8d8c00640 1 -- 172.21.15.144:0/965987919 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe8dc0cd720 con 0x7fe8dc0ce230 2024-09-11T23:18:00.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.370+0000 7fe8e3800640 1 -- 172.21.15.144:0/965987919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8dc0cf070 con 0x7fe8dc0ce230 2024-09-11T23:18:00.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.371+0000 7fe8d8c00640 1 -- 172.21.15.144:0/965987919 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16702 (secure 0 0 0) 0x7fe8d0059b90 con 0x7fe8dc0ce230 2024-09-11T23:18:00.373 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:00.373 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":21,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:17:59.035588+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:17:57.023145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:17:58.028864+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:00.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.373+0000 7fe8e3800640 1 -- 172.21.15.144:0/965987919 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe8bc06be60 msgr2=0x7fe8bc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:00.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.373+0000 7fe8e3800640 1 --2- 172.21.15.144:0/965987919 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe8bc06be60 0x7fe8bc06e320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8034000 tx=0x7fe8c802e000 comp rx=0 tx=0).stop 2024-09-11T23:18:00.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.373+0000 7fe8e3800640 1 -- 172.21.15.144:0/965987919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8dc0ce230 msgr2=0x7fe8dc1603c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:00.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.373+0000 7fe8e3800640 1 --2- 172.21.15.144:0/965987919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8dc0ce230 0x7fe8dc1603c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000e9b0 tx=0x7fe8d000ee70 comp rx=0 tx=0).stop 2024-09-11T23:18:00.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.373+0000 7fe8e3800640 1 -- 172.21.15.144:0/965987919 shutdown_connections 2024-09-11T23:18:00.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.373+0000 7fe8e3800640 1 --2- 172.21.15.144:0/965987919 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe8bc06be60 0x7fe8bc06e320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:00.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.374+0000 7fe8e3800640 1 --2- 172.21.15.144:0/965987919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8dc15c180 0x7fe8dc0b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:00.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.374+0000 7fe8e3800640 1 --2- 172.21.15.144:0/965987919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8dc0cf5b0 0x7fe8dc146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:00.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.374+0000 7fe8e3800640 1 --2- 172.21.15.144:0/965987919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8dc0ce230 0x7fe8dc1603c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:00.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.374+0000 7fe8e3800640 1 -- 172.21.15.144:0/965987919 >> 172.21.15.144:0/965987919 conn(0x7fe8dc062cc0 msgr2=0x7fe8dc1583e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:00.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.374+0000 7fe8e3800640 1 -- 172.21.15.144:0/965987919 shutdown_connections 2024-09-11T23:18:00.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.374+0000 7fe8e3800640 1 -- 172.21.15.144:0/965987919 wait complete. 2024-09-11T23:18:00.391 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:18:00.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.546+0000 7fbe12400640 1 Processor -- start 2024-09-11T23:18:00.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.546+0000 7fbe12400640 1 -- start start 2024-09-11T23:18:00.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.547+0000 7fbe12400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe0c06f130 0x7fbe0c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:00.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.547+0000 7fbe12400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe0c15c820 con 0x7fbe0c15c370 2024-09-11T23:18:00.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.547+0000 7fbe12400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe0c0b43f0 con 0x7fbe0c158e50 2024-09-11T23:18:00.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.547+0000 7fbe12400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0c0b3630 con 0x7fbe0c06f130 2024-09-11T23:18:00.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.547+0000 7fbe0be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbe0c15c370 0x7fbe0c0ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55894/0 (socket says 172.21.15.144:55894) 2024-09-11T23:18:00.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.547+0000 7fbe0be00640 1 -- 172.21.15.144:0/419245415 learned_addr learned my addr 172.21.15.144:0/419245415 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:00.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.547+0000 7fbe02a00640 1 --2- 172.21.15.144:0/419245415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe0c06f130 0x7fbe0c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:00.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.547+0000 7fbe0aa00640 1 -- 172.21.15.144:0/419245415 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 989512468 0 0) 0x7fbe04001490 con 0x7fbe0c15c370 2024-09-11T23:18:00.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.548+0000 7fbe0aa00640 1 -- 172.21.15.144:0/419245415 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdf0003520 con 0x7fbe0c15c370 2024-09-11T23:18:00.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.548+0000 7fbe0aa00640 1 -- 172.21.15.144:0/419245415 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 145552899 0 0) 0x7fbe0c0b43f0 con 0x7fbe0c158e50 2024-09-11T23:18:00.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.548+0000 7fbe0aa00640 1 -- 172.21.15.144:0/419245415 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe04001490 con 0x7fbe0c158e50 2024-09-11T23:18:00.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.548+0000 7fbe02a00640 1 -- 172.21.15.144:0/419245415 >> v1:172.21.15.165:6789/0 conn(0x7fbe0c158e50 legacy=0x7fbe0c06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:00.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.548+0000 7fbe02a00640 1 -- 172.21.15.144:0/419245415 >> v1:172.21.15.144:6789/0 conn(0x7fbe0c15c370 legacy=0x7fbe0c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:00.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.548+0000 7fbe02a00640 1 -- 172.21.15.144:0/419245415 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c0b3910 con 0x7fbe0c06f130 2024-09-11T23:18:00.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.549+0000 7fbe02a00640 1 --2- 172.21.15.144:0/419245415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe0c06f130 0x7fbe0c0b5050 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40097c0 tx=0x7fbdf402a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62e83c7f6e182768 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:00.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.549+0000 7fbe0aa00640 1 -- 172.21.15.144:0/419245415 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4037070 con 0x7fbe0c06f130 2024-09-11T23:18:00.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.549+0000 7fbe0aa00640 1 -- 172.21.15.144:0/419245415 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf4032440 con 0x7fbe0c06f130 2024-09-11T23:18:00.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.549+0000 7fbe0aa00640 1 -- 172.21.15.144:0/419245415 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4032810 con 0x7fbe0c06f130 2024-09-11T23:18:00.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.550+0000 7fbe12400640 1 -- 172.21.15.144:0/419245415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe0c06f130 msgr2=0x7fbe0c0b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:00.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.550+0000 7fbe12400640 1 --2- 172.21.15.144:0/419245415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe0c06f130 0x7fbe0c0b5050 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40097c0 tx=0x7fbdf402a200 comp rx=0 tx=0).stop 2024-09-11T23:18:00.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.550+0000 7fbe12400640 1 -- 172.21.15.144:0/419245415 shutdown_connections 2024-09-11T23:18:00.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.550+0000 7fbe12400640 1 --2- 172.21.15.144:0/419245415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe0c06f130 0x7fbe0c0b5050 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:00.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.550+0000 7fbe12400640 1 -- 172.21.15.144:0/419245415 >> 172.21.15.144:0/419245415 conn(0x7fbe0c06bba0 msgr2=0x7fbe0c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:00.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.550+0000 7fbe12400640 1 -- 172.21.15.144:0/419245415 shutdown_connections 2024-09-11T23:18:00.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.550+0000 7fbe12400640 1 -- 172.21.15.144:0/419245415 wait complete. 2024-09-11T23:18:00.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.551+0000 7fbe12400640 1 Processor -- start 2024-09-11T23:18:00.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.551+0000 7fbe12400640 1 -- start start 2024-09-11T23:18:00.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.552+0000 7fbe12400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe0c06f130 0x7fbe0c152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:00.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.552+0000 7fbe12400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe0c158e50 0x7fbe0c155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:00.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.552+0000 7fbe12400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe0c15c370 0x7fbe0c1f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:00.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.552+0000 7fbe12400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c159230 con 0x7fbe0c06f130 2024-09-11T23:18:00.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.552+0000 7fbe12400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c0b3ed0 con 0x7fbe0c15c370 2024-09-11T23:18:00.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.552+0000 7fbe12400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0c0ce910 con 0x7fbe0c158e50 2024-09-11T23:18:00.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.553+0000 7fbe0b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe0c06f130 0x7fbe0c152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:00.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.553+0000 7fbe0b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe0c06f130 0x7fbe0c152da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38400/0 (socket says 172.21.15.144:38400) 2024-09-11T23:18:00.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.553+0000 7fbe0b400640 1 -- 172.21.15.144:0/2269882121 learned_addr learned my addr 172.21.15.144:0/2269882121 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:00.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.553+0000 7fbe0be00640 1 --2- 172.21.15.144:0/2269882121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe0c15c370 0x7fbe0c1f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:00.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.553+0000 7fbe02a00640 1 --2- 172.21.15.144:0/2269882121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe0c158e50 0x7fbe0c155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:00.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.553+0000 7fbe0b400640 1 -- 172.21.15.144:0/2269882121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe0c158e50 msgr2=0x7fbe0c155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:00.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.553+0000 7fbe0b400640 1 --2- 172.21.15.144:0/2269882121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe0c158e50 0x7fbe0c155140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:00.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.553+0000 7fbe0b400640 1 -- 172.21.15.144:0/2269882121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe0c15c370 msgr2=0x7fbe0c1f7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:00.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.553+0000 7fbe0b400640 1 --2- 172.21.15.144:0/2269882121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe0c15c370 0x7fbe0c1f7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:00.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.553+0000 7fbe0b400640 1 -- 172.21.15.144:0/2269882121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c155990 con 0x7fbe0c06f130 2024-09-11T23:18:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.553+0000 7fbe0be00640 1 --2- 172.21.15.144:0/2269882121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe0c15c370 0x7fbe0c1f7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.553+0000 7fbe02a00640 1 --2- 172.21.15.144:0/2269882121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe0c158e50 0x7fbe0c155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.553+0000 7fbe0b400640 1 --2- 172.21.15.144:0/2269882121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe0c06f130 0x7fbe0c152da0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00c500 tx=0x7fbdfc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.553+0000 7fbe03e00640 1 -- 172.21.15.144:0/2269882121 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc0052d0 con 0x7fbe0c06f130 2024-09-11T23:18:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.553+0000 7fbe03e00640 1 -- 172.21.15.144:0/2269882121 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdfc005490 con 0x7fbe0c06f130 2024-09-11T23:18:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.554+0000 7fbe12400640 1 -- 172.21.15.144:0/2269882121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0c155c70 con 0x7fbe0c06f130 2024-09-11T23:18:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.554+0000 7fbe03e00640 1 -- 172.21.15.144:0/2269882121 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc012870 con 0x7fbe0c06f130 2024-09-11T23:18:00.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.554+0000 7fbe12400640 1 -- 172.21.15.144:0/2269882121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe0c156250 con 0x7fbe0c06f130 2024-09-11T23:18:00.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.555+0000 7fbe12400640 1 -- 172.21.15.144:0/2269882121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe0c069b00 con 0x7fbe0c06f130 2024-09-11T23:18:00.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.556+0000 7fbe03e00640 1 -- 172.21.15.144:0/2269882121 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbdfc012a10 con 0x7fbe0c06f130 2024-09-11T23:18:00.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.556+0000 7fbe03e00640 1 --2- 172.21.15.144:0/2269882121 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbde806be30 0x7fbde806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:00.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.557+0000 7fbe03e00640 1 -- 172.21.15.144:0/2269882121 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbdfc08ac20 con 0x7fbe0c06f130 2024-09-11T23:18:00.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.557+0000 7fbe02a00640 1 --2- 172.21.15.144:0/2269882121 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbde806be30 0x7fbde806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:00.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.557+0000 7fbe02a00640 1 --2- 172.21.15.144:0/2269882121 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbde806be30 0x7fbde806e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4034000 tx=0x7fbdf402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:00.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.561+0000 7fbe03e00640 1 -- 172.21.15.144:0/2269882121 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe0c069b00 con 0x7fbe0c06f130 2024-09-11T23:18:00.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:00.773+0000 7fbe12400640 1 -- 172.21.15.144:0/2269882121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbe0c072cb0 con 0x7fbe0c06f130 2024-09-11T23:18:01.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.643+0000 7fbe03e00640 1 -- 172.21.15.144:0/2269882121 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fbdfc059540 con 0x7fbe0c06f130 2024-09-11T23:18:01.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.646+0000 7fbe12400640 1 -- 172.21.15.144:0/2269882121 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbde806be30 msgr2=0x7fbde806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:01.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.646+0000 7fbe12400640 1 --2- 172.21.15.144:0/2269882121 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbde806be30 0x7fbde806e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4034000 tx=0x7fbdf402e000 comp rx=0 tx=0).stop 2024-09-11T23:18:01.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.646+0000 7fbe12400640 1 -- 172.21.15.144:0/2269882121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe0c06f130 msgr2=0x7fbe0c152da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:01.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.646+0000 7fbe12400640 1 --2- 172.21.15.144:0/2269882121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe0c06f130 0x7fbe0c152da0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00c500 tx=0x7fbdfc00c9c0 comp rx=0 tx=0).stop 2024-09-11T23:18:01.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.646+0000 7fbe12400640 1 -- 172.21.15.144:0/2269882121 shutdown_connections 2024-09-11T23:18:01.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.646+0000 7fbe12400640 1 --2- 172.21.15.144:0/2269882121 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbde806be30 0x7fbde806e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:01.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.646+0000 7fbe12400640 1 --2- 172.21.15.144:0/2269882121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe0c15c370 0x7fbe0c1f7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:01.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.646+0000 7fbe12400640 1 --2- 172.21.15.144:0/2269882121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe0c158e50 0x7fbe0c155140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:01.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.646+0000 7fbe12400640 1 --2- 172.21.15.144:0/2269882121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe0c06f130 0x7fbe0c152da0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:01.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.646+0000 7fbe12400640 1 -- 172.21.15.144:0/2269882121 >> 172.21.15.144:0/2269882121 conn(0x7fbe0c06bba0 msgr2=0x7fbe0c071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:01.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.647+0000 7fbe12400640 1 -- 172.21.15.144:0/2269882121 shutdown_connections 2024-09-11T23:18:01.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.647+0000 7fbe12400640 1 -- 172.21.15.144:0/2269882121 wait complete. 2024-09-11T23:18:01.666 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:18:01.666 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:18:01.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.824+0000 7f1ef2c00640 1 Processor -- start 2024-09-11T23:18:01.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.824+0000 7f1ef2c00640 1 -- start start 2024-09-11T23:18:01.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.825+0000 7f1ef2c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1eec0b3d50 0x7f1eec06d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:01.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.825+0000 7f1ef2c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eec0cf9a0 con 0x7f1eec0b3290 2024-09-11T23:18:01.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.825+0000 7f1ef2c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eec162210 con 0x7f1eec161e30 2024-09-11T23:18:01.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.825+0000 7f1ef2c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1eec0cfcf0 con 0x7f1eec0b3d50 2024-09-11T23:18:01.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.825+0000 7f1eeb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1eec0b3d50 0x7f1eec06d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:01.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.825+0000 7f1ef0c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1eec0b3290 0x7f1eec0b78b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55908/0 (socket says 172.21.15.144:55908) 2024-09-11T23:18:01.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.825+0000 7f1ef0c00640 1 -- 172.21.15.144:0/2664570402 learned_addr learned my addr 172.21.15.144:0/2664570402 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:01.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.826+0000 7f1eeb400640 1 -- 172.21.15.144:0/2664570402 >> v1:172.21.15.165:6789/0 conn(0x7f1eec161e30 legacy=0x7f1eec0d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:01.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.826+0000 7f1eeb400640 1 -- 172.21.15.144:0/2664570402 >> v1:172.21.15.144:6789/0 conn(0x7f1eec0b3290 legacy=0x7f1eec0b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:01.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.826+0000 7f1eeb400640 1 -- 172.21.15.144:0/2664570402 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eec0d5210 con 0x7f1eec0b3d50 2024-09-11T23:18:01.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.826+0000 7f1eeaa00640 1 -- 172.21.15.144:0/2664570402 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3467935461 0 0) 0x7f1eec0cf9a0 con 0x7f1eec0b3290 2024-09-11T23:18:01.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.827+0000 7f1eeb400640 1 --2- 172.21.15.144:0/2664570402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1eec0b3d50 0x7f1eec06d8c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80097a0 tx=0x7f1ed802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0cd69643851658 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:01.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.827+0000 7f1eeaa00640 1 -- 172.21.15.144:0/2664570402 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8037070 con 0x7f1eec0b3d50 2024-09-11T23:18:01.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.827+0000 7f1eeaa00640 1 -- 172.21.15.144:0/2664570402 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed8032440 con 0x7f1eec0b3d50 2024-09-11T23:18:01.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.827+0000 7f1eeaa00640 1 -- 172.21.15.144:0/2664570402 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8032810 con 0x7f1eec0b3d50 2024-09-11T23:18:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.828+0000 7f1ef2c00640 1 -- 172.21.15.144:0/2664570402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1eec0b3d50 msgr2=0x7f1eec06d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.828+0000 7f1ef2c00640 1 --2- 172.21.15.144:0/2664570402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1eec0b3d50 0x7f1eec06d8c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80097a0 tx=0x7f1ed802a230 comp rx=0 tx=0).stop 2024-09-11T23:18:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.828+0000 7f1ef2c00640 1 -- 172.21.15.144:0/2664570402 shutdown_connections 2024-09-11T23:18:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.828+0000 7f1ef2c00640 1 --2- 172.21.15.144:0/2664570402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1eec0b3d50 0x7f1eec06d8c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.828+0000 7f1ef2c00640 1 -- 172.21.15.144:0/2664570402 >> 172.21.15.144:0/2664570402 conn(0x7f1eec0d1870 msgr2=0x7f1eec0d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.828+0000 7f1ef2c00640 1 -- 172.21.15.144:0/2664570402 shutdown_connections 2024-09-11T23:18:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.828+0000 7f1ef2c00640 1 -- 172.21.15.144:0/2664570402 wait complete. 2024-09-11T23:18:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.829+0000 7f1ef2c00640 1 Processor -- start 2024-09-11T23:18:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.829+0000 7f1ef2c00640 1 -- start start 2024-09-11T23:18:01.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.830+0000 7f1ef2c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1eec0b3290 0x7f1eec14e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:01.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.830+0000 7f1ef2c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1eec0b3d50 0x7f1eec14dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:01.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.830+0000 7f1ef2c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eec161e30 0x7f1eec0cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:01.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.830+0000 7f1ef2c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec06de00 con 0x7f1eec0b3290 2024-09-11T23:18:01.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.830+0000 7f1ef2c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1eec0b3950 con 0x7f1eec161e30 2024-09-11T23:18:01.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.830+0000 7f1ef2c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1eec06df80 con 0x7f1eec0b3d50 2024-09-11T23:18:01.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.831+0000 7f1eebe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1eec0b3290 0x7f1eec14e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:01.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.831+0000 7f1eebe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1eec0b3290 0x7f1eec14e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38408/0 (socket says 172.21.15.144:38408) 2024-09-11T23:18:01.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.831+0000 7f1eebe00640 1 -- 172.21.15.144:0/3346866126 learned_addr learned my addr 172.21.15.144:0/3346866126 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.831+0000 7f1eeb400640 1 --2- 172.21.15.144:0/3346866126 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1eec0b3d50 0x7f1eec14dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.831+0000 7f1ef0c00640 1 --2- 172.21.15.144:0/3346866126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eec161e30 0x7f1eec0cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.831+0000 7f1eebe00640 1 -- 172.21.15.144:0/3346866126 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1eec0b3d50 msgr2=0x7f1eec14dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.831+0000 7f1eebe00640 1 --2- 172.21.15.144:0/3346866126 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1eec0b3d50 0x7f1eec14dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.831+0000 7f1eebe00640 1 -- 172.21.15.144:0/3346866126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eec161e30 msgr2=0x7f1eec0cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.831+0000 7f1eebe00640 1 --2- 172.21.15.144:0/3346866126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eec161e30 0x7f1eec0cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.831+0000 7f1eebe00640 1 -- 172.21.15.144:0/3346866126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eec1515c0 con 0x7f1eec0b3290 2024-09-11T23:18:01.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.831+0000 7f1eebe00640 1 --2- 172.21.15.144:0/3346866126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1eec0b3290 0x7f1eec14e6d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00c430 tx=0x7f1edc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:01.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.831+0000 7f1ee3e00640 1 -- 172.21.15.144:0/3346866126 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc017070 con 0x7f1eec0b3290 2024-09-11T23:18:01.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.832+0000 7f1ee3e00640 1 -- 172.21.15.144:0/3346866126 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1edc0052d0 con 0x7f1eec0b3290 2024-09-11T23:18:01.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.832+0000 7f1ee3e00640 1 -- 172.21.15.144:0/3346866126 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc003830 con 0x7f1eec0b3290 2024-09-11T23:18:01.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.832+0000 7f1ef2c00640 1 -- 172.21.15.144:0/3346866126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eec0c8670 con 0x7f1eec0b3290 2024-09-11T23:18:01.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.832+0000 7f1ef2c00640 1 -- 172.21.15.144:0/3346866126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eec0c8c30 con 0x7f1eec0b3290 2024-09-11T23:18:01.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.833+0000 7f1ef2c00640 1 -- 172.21.15.144:0/3346866126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eec06d8c0 con 0x7f1eec0b3290 2024-09-11T23:18:01.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.834+0000 7f1ee3e00640 1 -- 172.21.15.144:0/3346866126 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1edc01a070 con 0x7f1eec0b3290 2024-09-11T23:18:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.835+0000 7f1ee3e00640 1 --2- 172.21.15.144:0/3346866126 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1ecc06be30 0x7f1ecc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.835+0000 7f1ee3e00640 1 -- 172.21.15.144:0/3346866126 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1edc08a140 con 0x7f1eec0b3290 2024-09-11T23:18:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.835+0000 7f1eeb400640 1 --2- 172.21.15.144:0/3346866126 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1ecc06be30 0x7f1ecc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.836+0000 7f1eeb400640 1 --2- 172.21.15.144:0/3346866126 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1ecc06be30 0x7f1ecc06e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8034000 tx=0x7f1ed802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:01.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:01.839+0000 7f1ee3e00640 1 -- 172.21.15.144:0/3346866126 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1edc058480 con 0x7f1eec0b3290 2024-09-11T23:18:02.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.052+0000 7f1ef2c00640 1 -- 172.21.15.144:0/3346866126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f1eec0b9680 con 0x7f1eec0b3290 2024-09-11T23:18:02.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.645+0000 7f1ee3e00640 1 -- 172.21.15.144:0/3346866126 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f1edc05c780 con 0x7f1eec0b3290 2024-09-11T23:18:02.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.647+0000 7f1ef2c00640 1 -- 172.21.15.144:0/3346866126 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1ecc06be30 msgr2=0x7f1ecc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:02.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.647+0000 7f1ef2c00640 1 --2- 172.21.15.144:0/3346866126 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1ecc06be30 0x7f1ecc06e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8034000 tx=0x7f1ed802e000 comp rx=0 tx=0).stop 2024-09-11T23:18:02.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.647+0000 7f1ef2c00640 1 -- 172.21.15.144:0/3346866126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1eec0b3290 msgr2=0x7f1eec14e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:02.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.648+0000 7f1ef2c00640 1 --2- 172.21.15.144:0/3346866126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1eec0b3290 0x7f1eec14e6d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00c430 tx=0x7f1edc00c8f0 comp rx=0 tx=0).stop 2024-09-11T23:18:02.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.648+0000 7f1ef2c00640 1 -- 172.21.15.144:0/3346866126 shutdown_connections 2024-09-11T23:18:02.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.648+0000 7f1ef2c00640 1 --2- 172.21.15.144:0/3346866126 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1ecc06be30 0x7f1ecc06e2f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:02.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.648+0000 7f1ef2c00640 1 --2- 172.21.15.144:0/3346866126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eec161e30 0x7f1eec0cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:02.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.648+0000 7f1ef2c00640 1 --2- 172.21.15.144:0/3346866126 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1eec0b3d50 0x7f1eec14dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:02.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.648+0000 7f1ef2c00640 1 --2- 172.21.15.144:0/3346866126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1eec0b3290 0x7f1eec14e6d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:02.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.648+0000 7f1ef2c00640 1 -- 172.21.15.144:0/3346866126 >> 172.21.15.144:0/3346866126 conn(0x7f1eec0d1870 msgr2=0x7f1eec0b8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:02.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.648+0000 7f1ef2c00640 1 -- 172.21.15.144:0/3346866126 shutdown_connections 2024-09-11T23:18:02.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.648+0000 7f1ef2c00640 1 -- 172.21.15.144:0/3346866126 wait complete. 2024-09-11T23:18:02.666 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:18:02.666 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:02.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.821+0000 7f50a8c00640 1 Processor -- start 2024-09-11T23:18:02.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.821+0000 7f50a8c00640 1 -- start start 2024-09-11T23:18:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.822+0000 7f50a8c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f50a406f510 0x7f50a40b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.822+0000 7f50a8c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f50a406f8f0 0x7f50a4161690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.822+0000 7f50a8c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50a4162ed0 0x7f50a4161bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.822+0000 7f50a8c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f50a40b5da0 con 0x7f50a406f510 2024-09-11T23:18:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.822+0000 7f50a8c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f50a40b5590 con 0x7f50a406f8f0 2024-09-11T23:18:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.822+0000 7f50a8c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f50a406e680 con 0x7f50a4162ed0 2024-09-11T23:18:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.822+0000 7f50a3400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f50a406f510 0x7f50a40b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:02.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.822+0000 7f50a3400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f50a406f510 0x7f50a40b60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38410/0 (socket says 172.21.15.144:38410) 2024-09-11T23:18:02.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.822+0000 7f50a3400640 1 -- 172.21.15.144:0/186227089 learned_addr learned my addr 172.21.15.144:0/186227089 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:02.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.823+0000 7f50a3e00640 1 --2- 172.21.15.144:0/186227089 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50a4162ed0 0x7f50a4161bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:02.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.823+0000 7f509aa00640 1 --2- 172.21.15.144:0/186227089 >> v2:172.21.15.165:3300/0 conn(0x7f50a406f8f0 0x7f50a4161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:02.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.823+0000 7f50a3400640 1 -- 172.21.15.144:0/186227089 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50a4162ed0 msgr2=0x7f50a4161bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:02.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.823+0000 7f50a3400640 1 --2- 172.21.15.144:0/186227089 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50a4162ed0 0x7f50a4161bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:02.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.823+0000 7f50a3400640 1 -- 172.21.15.144:0/186227089 >> v2:172.21.15.165:3300/0 conn(0x7f50a406f8f0 msgr2=0x7f50a4161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:02.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.823+0000 7f50a3400640 1 --2- 172.21.15.144:0/186227089 >> v2:172.21.15.165:3300/0 conn(0x7f50a406f8f0 0x7f50a4161690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:02.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.823+0000 7f50a3400640 1 -- 172.21.15.144:0/186227089 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a40b57e0 con 0x7f50a406f510 2024-09-11T23:18:02.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.824+0000 7f50a3400640 1 --2- 172.21.15.144:0/186227089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50a406f510 0x7f50a40b60a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f50a40b7a30 tx=0x7f509402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a47e41ce2be20 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:02.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.824+0000 7f50a2a00640 1 -- 172.21.15.144:0/186227089 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5094037070 con 0x7f50a406f510 2024-09-11T23:18:02.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.824+0000 7f50a2a00640 1 -- 172.21.15.144:0/186227089 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5094032440 con 0x7f50a406f510 2024-09-11T23:18:02.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.824+0000 7f50a2a00640 1 -- 172.21.15.144:0/186227089 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5094032810 con 0x7f50a406f510 2024-09-11T23:18:02.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.824+0000 7f50a8c00640 1 -- 172.21.15.144:0/186227089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50a406f510 msgr2=0x7f50a40b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:02.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.824+0000 7f50a8c00640 1 --2- 172.21.15.144:0/186227089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50a406f510 0x7f50a40b60a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f50a40b7a30 tx=0x7f509402a140 comp rx=0 tx=0).stop 2024-09-11T23:18:02.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.825+0000 7f50a8c00640 1 -- 172.21.15.144:0/186227089 shutdown_connections 2024-09-11T23:18:02.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.825+0000 7f50a8c00640 1 --2- 172.21.15.144:0/186227089 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50a4162ed0 0x7f50a4161bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:02.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.825+0000 7f50a8c00640 1 --2- 172.21.15.144:0/186227089 >> v2:172.21.15.165:3300/0 conn(0x7f50a406f8f0 0x7f50a4161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:02.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.825+0000 7f50a8c00640 1 --2- 172.21.15.144:0/186227089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50a406f510 0x7f50a40b60a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:02.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.825+0000 7f50a8c00640 1 -- 172.21.15.144:0/186227089 >> 172.21.15.144:0/186227089 conn(0x7f50a4062630 msgr2=0x7f50a4062a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:02.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.825+0000 7f50a8c00640 1 -- 172.21.15.144:0/186227089 shutdown_connections 2024-09-11T23:18:02.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.825+0000 7f50a8c00640 1 -- 172.21.15.144:0/186227089 wait complete. 2024-09-11T23:18:02.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.826+0000 7f50a8c00640 1 Processor -- start 2024-09-11T23:18:02.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.826+0000 7f50a8c00640 1 -- start start 2024-09-11T23:18:02.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.827+0000 7f50a8c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50a406f510 0x7f50a414d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:02.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.827+0000 7f50a8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50a406f8f0 0x7f50a40d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:02.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.827+0000 7f50a8c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50a4162ed0 0x7f50a414fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:02.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.827+0000 7f50a8c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f50a406eb60 con 0x7f50a406f8f0 2024-09-11T23:18:02.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.827+0000 7f50a8c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f50a40b65e0 con 0x7f50a4162ed0 2024-09-11T23:18:02.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.827+0000 7f50a8c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f50a406ece0 con 0x7f50a406f510 2024-09-11T23:18:02.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.827+0000 7f509aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50a406f8f0 0x7f50a40d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:02.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.827+0000 7f509aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50a406f8f0 0x7f50a40d1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38420/0 (socket says 172.21.15.144:38420) 2024-09-11T23:18:02.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.827+0000 7f509aa00640 1 -- 172.21.15.144:0/14632137 learned_addr learned my addr 172.21.15.144:0/14632137 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:02.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.828+0000 7f50a3400640 1 --2- 172.21.15.144:0/14632137 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50a406f510 0x7f50a414d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:02.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.828+0000 7f50a3e00640 1 --2- 172.21.15.144:0/14632137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50a4162ed0 0x7f50a414fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:02.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.828+0000 7f509aa00640 1 -- 172.21.15.144:0/14632137 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50a406f510 msgr2=0x7f50a414d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:02.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.828+0000 7f509aa00640 1 --2- 172.21.15.144:0/14632137 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50a406f510 0x7f50a414d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:02.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.828+0000 7f509aa00640 1 -- 172.21.15.144:0/14632137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50a4162ed0 msgr2=0x7f50a414fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:02.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.828+0000 7f509aa00640 1 --2- 172.21.15.144:0/14632137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50a4162ed0 0x7f50a414fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:02.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.828+0000 7f509aa00640 1 -- 172.21.15.144:0/14632137 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a40d2290 con 0x7f50a406f8f0 2024-09-11T23:18:02.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.828+0000 7f509aa00640 1 --2- 172.21.15.144:0/14632137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50a406f8f0 0x7f50a40d1b40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f508c00d800 tx=0x7f508c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:02.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.828+0000 7f509be00640 1 -- 172.21.15.144:0/14632137 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c018020 con 0x7f50a406f8f0 2024-09-11T23:18:02.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.828+0000 7f509be00640 1 -- 172.21.15.144:0/14632137 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f508c0096a0 con 0x7f50a406f8f0 2024-09-11T23:18:02.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.828+0000 7f509be00640 1 -- 172.21.15.144:0/14632137 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c009a70 con 0x7f50a406f8f0 2024-09-11T23:18:02.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.828+0000 7f50a8c00640 1 -- 172.21.15.144:0/14632137 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50a40cfe00 con 0x7f50a406f8f0 2024-09-11T23:18:02.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.829+0000 7f50a8c00640 1 -- 172.21.15.144:0/14632137 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50a40d03c0 con 0x7f50a406f8f0 2024-09-11T23:18:02.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.830+0000 7f50a8c00640 1 -- 172.21.15.144:0/14632137 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50a40b60a0 con 0x7f50a406f8f0 2024-09-11T23:18:02.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.830+0000 7f509be00640 1 -- 172.21.15.144:0/14632137 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f508c01b020 con 0x7f50a406f8f0 2024-09-11T23:18:02.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.831+0000 7f509be00640 1 --2- 172.21.15.144:0/14632137 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f508006be30 0x7f508006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:02.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.831+0000 7f509be00640 1 -- 172.21.15.144:0/14632137 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f508c08b2d0 con 0x7f50a406f8f0 2024-09-11T23:18:02.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.832+0000 7f50a3400640 1 --2- 172.21.15.144:0/14632137 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f508006be30 0x7f508006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:02.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.832+0000 7f50a3400640 1 --2- 172.21.15.144:0/14632137 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f508006be30 0x7f508006e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5094034000 tx=0x7f509402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:02.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:02.836+0000 7f509be00640 1 -- 172.21.15.144:0/14632137 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f508c022020 con 0x7f50a406f8f0 2024-09-11T23:18:03.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.043+0000 7f50a8c00640 1 -- 172.21.15.144:0/14632137 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50a40cee10 con 0x7f50a406f8f0 2024-09-11T23:18:03.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.044+0000 7f509be00640 1 -- 172.21.15.144:0/14632137 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7f508c059590 con 0x7f50a406f8f0 2024-09-11T23:18:03.046 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:03.046 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"btime":"2024-09-11T23:18:02:645252+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1741936320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1741936320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1741936320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1295491349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1295491349},{"type":"v1","addr":"172.21.15.144:6836","nonce":1295491349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1020006630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1020006630},{"type":"v1","addr":"172.21.15.144:6837","nonce":1020006630}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:59.036096+0000","modified":"2024-09-11T23:18:02.054236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2270648598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2270648598},{"type":"v1","addr":"172.21.15.165:6835","nonce":2270648598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-09-11T23:18:03.046 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-09-11T23:18:03.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.046+0000 7f50a8c00640 1 -- 172.21.15.144:0/14632137 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f508006be30 msgr2=0x7f508006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.046+0000 7f50a8c00640 1 --2- 172.21.15.144:0/14632137 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f508006be30 0x7f508006e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5094034000 tx=0x7f509402e000 comp rx=0 tx=0).stop 2024-09-11T23:18:03.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.046+0000 7f50a8c00640 1 -- 172.21.15.144:0/14632137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50a406f8f0 msgr2=0x7f50a40d1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.046+0000 7f50a8c00640 1 --2- 172.21.15.144:0/14632137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50a406f8f0 0x7f50a40d1b40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f508c00d800 tx=0x7f508c00dcc0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.046+0000 7f50a8c00640 1 -- 172.21.15.144:0/14632137 shutdown_connections 2024-09-11T23:18:03.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.046+0000 7f50a8c00640 1 --2- 172.21.15.144:0/14632137 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f508006be30 0x7f508006e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.046+0000 7f50a8c00640 1 --2- 172.21.15.144:0/14632137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50a4162ed0 0x7f50a414fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.046+0000 7f50a8c00640 1 --2- 172.21.15.144:0/14632137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50a406f8f0 0x7f50a40d1b40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.046+0000 7f50a8c00640 1 --2- 172.21.15.144:0/14632137 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50a406f510 0x7f50a414d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.046+0000 7f50a8c00640 1 -- 172.21.15.144:0/14632137 >> 172.21.15.144:0/14632137 conn(0x7f50a4062630 msgr2=0x7f50a4162610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:03.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.046+0000 7f50a8c00640 1 -- 172.21.15.144:0/14632137 shutdown_connections 2024-09-11T23:18:03.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.046+0000 7f50a8c00640 1 -- 172.21.15.144:0/14632137 wait complete. 2024-09-11T23:18:03.063 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:18:03.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.215+0000 7fec4ee00640 1 Processor -- start 2024-09-11T23:18:03.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.215+0000 7fec4ee00640 1 -- start start 2024-09-11T23:18:03.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.217+0000 7fec4ee00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec480d02a0 0x7fec480d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.217+0000 7fec4ee00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fec4815ce80 0x7fec481594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.217+0000 7fec4ee00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec480d0bc0 con 0x7fec4815ca40 2024-09-11T23:18:03.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.217+0000 7fec4ee00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fec4815d390 con 0x7fec4815ce80 2024-09-11T23:18:03.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.217+0000 7fec4ee00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fec4815d670 con 0x7fec480d02a0 2024-09-11T23:18:03.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.217+0000 7fec47400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fec4815ca40 0x7fec4815e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55914/0 (socket says 172.21.15.144:55914) 2024-09-11T23:18:03.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.217+0000 7fec47400640 1 -- 172.21.15.144:0/3375984094 learned_addr learned my addr 172.21.15.144:0/3375984094 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:03.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.217+0000 7fec47e00640 1 --2- 172.21.15.144:0/3375984094 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec480d02a0 0x7fec480d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:03.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.217+0000 7fec46a00640 1 -- 172.21.15.144:0/3375984094 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1573386294 0 0) 0x7fec480d0bc0 con 0x7fec4815ca40 2024-09-11T23:18:03.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.217+0000 7fec4ce00640 1 --2- 172.21.15.144:0/3375984094 >> v2:172.21.15.165:3300/0 conn(0x7fec4815ce80 0x7fec481594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:03.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.217+0000 7fec46a00640 1 -- 172.21.15.144:0/3375984094 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec2c003520 con 0x7fec4815ca40 2024-09-11T23:18:03.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.217+0000 7fec46a00640 1 -- 172.21.15.144:0/3375984094 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2735556616 0 0) 0x7fec2c003520 con 0x7fec4815ca40 2024-09-11T23:18:03.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec46a00640 1 -- 172.21.15.144:0/3375984094 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec480d02a0 msgr2=0x7fec480d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:03.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec46a00640 1 --2- 172.21.15.144:0/3375984094 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec480d02a0 0x7fec480d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec46a00640 1 -- 172.21.15.144:0/3375984094 >> v2:172.21.15.165:3300/0 conn(0x7fec4815ce80 msgr2=0x7fec481594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:03.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec46a00640 1 --2- 172.21.15.144:0/3375984094 >> v2:172.21.15.165:3300/0 conn(0x7fec4815ce80 0x7fec481594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec46a00640 1 -- 172.21.15.144:0/3375984094 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4815d950 con 0x7fec4815ca40 2024-09-11T23:18:03.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec46a00640 1 -- 172.21.15.144:0/3375984094 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fec34001670 con 0x7fec4815ca40 2024-09-11T23:18:03.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec46a00640 1 -- 172.21.15.144:0/3375984094 >> v1:172.21.15.144:6789/0 conn(0x7fec4815ca40 legacy=0x7fec4815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec46a00640 1 --2- 172.21.15.144:0/3375984094 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec480d02a0 0x7fec2c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec46a00640 1 --2- 172.21.15.144:0/3375984094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2c003f60 0x7fec2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec46a00640 1 --2- 172.21.15.144:0/3375984094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec2c004d40 0x7fec2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec46a00640 1 -- 172.21.15.144:0/3375984094 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fec4815d390 con 0x7fec2c003f60 2024-09-11T23:18:03.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec46a00640 1 -- 172.21.15.144:0/3375984094 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fec4815d670 con 0x7fec2c004d40 2024-09-11T23:18:03.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec46a00640 1 -- 172.21.15.144:0/3375984094 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fec2c00fe50 con 0x7fec480d02a0 2024-09-11T23:18:03.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec47400640 1 --2- 172.21.15.144:0/3375984094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2c003f60 0x7fec2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:03.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec4ce00640 1 --2- 172.21.15.144:0/3375984094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec2c004d40 0x7fec2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:03.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec47e00640 1 --2- 172.21.15.144:0/3375984094 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec480d02a0 0x7fec2c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:03.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec47400640 1 -- 172.21.15.144:0/3375984094 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec480d02a0 msgr2=0x7fec2c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:03.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec47400640 1 --2- 172.21.15.144:0/3375984094 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec480d02a0 0x7fec2c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec47400640 1 -- 172.21.15.144:0/3375984094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec2c004d40 msgr2=0x7fec2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:03.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec47400640 1 --2- 172.21.15.144:0/3375984094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec2c004d40 0x7fec2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.218+0000 7fec47400640 1 -- 172.21.15.144:0/3375984094 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2c003520 con 0x7fec2c003f60 2024-09-11T23:18:03.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.219+0000 7fec47400640 1 --2- 172.21.15.144:0/3375984094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2c003f60 0x7fec2c004800 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fec480b5a30 tx=0x7fec2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c97acc4816e932 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:03.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.220+0000 7fec46a00640 1 -- 172.21.15.144:0/3375984094 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec34007d30 con 0x7fec2c003f60 2024-09-11T23:18:03.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.220+0000 7fec46a00640 1 -- 172.21.15.144:0/3375984094 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec340058d0 con 0x7fec2c003f60 2024-09-11T23:18:03.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.220+0000 7fec46a00640 1 -- 172.21.15.144:0/3375984094 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec34005ce0 con 0x7fec2c003f60 2024-09-11T23:18:03.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.220+0000 7fec4ee00640 1 -- 172.21.15.144:0/3375984094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2c003f60 msgr2=0x7fec2c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.220+0000 7fec4ee00640 1 --2- 172.21.15.144:0/3375984094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2c003f60 0x7fec2c004800 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fec480b5a30 tx=0x7fec2c005830 comp rx=0 tx=0).stop 2024-09-11T23:18:03.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.220+0000 7fec4ce00640 1 -- 172.21.15.144:0/3375984094 reap_dead start 2024-09-11T23:18:03.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.220+0000 7fec4ee00640 1 -- 172.21.15.144:0/3375984094 shutdown_connections 2024-09-11T23:18:03.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.220+0000 7fec4ee00640 1 -- 172.21.15.144:0/3375984094 >> 172.21.15.144:0/3375984094 conn(0x7fec48062cc0 msgr2=0x7fec4806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:03.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.220+0000 7fec4ee00640 1 -- 172.21.15.144:0/3375984094 shutdown_connections 2024-09-11T23:18:03.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.220+0000 7fec4ee00640 1 -- 172.21.15.144:0/3375984094 wait complete. 2024-09-11T23:18:03.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.222+0000 7fec4ee00640 1 Processor -- start 2024-09-11T23:18:03.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.222+0000 7fec4ee00640 1 -- start start 2024-09-11T23:18:03.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.223+0000 7fec4ee00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec2c003f60 0x7fec48147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.223+0000 7fec4ee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec481f0b50 0x7fec48071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.223+0000 7fec4ee00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec48153f00 0x7fec48154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.223+0000 7fec4ee00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fec4815eb40 con 0x7fec481f0b50 2024-09-11T23:18:03.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.223+0000 7fec4ee00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fec4815df10 con 0x7fec2c003f60 2024-09-11T23:18:03.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.223+0000 7fec4ee00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fec48155b90 con 0x7fec48153f00 2024-09-11T23:18:03.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.223+0000 7fec47400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec481f0b50 0x7fec48071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:03.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.223+0000 7fec47400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec481f0b50 0x7fec48071eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38432/0 (socket says 172.21.15.144:38432) 2024-09-11T23:18:03.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.223+0000 7fec47400640 1 -- 172.21.15.144:0/2206184607 learned_addr learned my addr 172.21.15.144:0/2206184607 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:03.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.223+0000 7fec4ce00640 1 --2- 172.21.15.144:0/2206184607 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec48153f00 0x7fec48154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:03.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.223+0000 7fec47e00640 1 --2- 172.21.15.144:0/2206184607 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec2c003f60 0x7fec48147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:03.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.223+0000 7fec47400640 1 -- 172.21.15.144:0/2206184607 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec48153f00 msgr2=0x7fec48154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.223+0000 7fec47400640 1 --2- 172.21.15.144:0/2206184607 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec48153f00 0x7fec48154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.224+0000 7fec47400640 1 -- 172.21.15.144:0/2206184607 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec2c003f60 msgr2=0x7fec48147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.224+0000 7fec47400640 1 --2- 172.21.15.144:0/2206184607 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec2c003f60 0x7fec48147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.224+0000 7fec47400640 1 -- 172.21.15.144:0/2206184607 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec48073e60 con 0x7fec481f0b50 2024-09-11T23:18:03.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.224+0000 7fec47e00640 1 --2- 172.21.15.144:0/2206184607 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec2c003f60 0x7fec48147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:03.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.224+0000 7fec47400640 1 --2- 172.21.15.144:0/2206184607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec481f0b50 0x7fec48071eb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fec3400c2d0 tx=0x7fec34001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:03.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.224+0000 7fec3fe00640 1 -- 172.21.15.144:0/2206184607 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec34007480 con 0x7fec481f0b50 2024-09-11T23:18:03.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.224+0000 7fec3fe00640 1 -- 172.21.15.144:0/2206184607 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec34043070 con 0x7fec481f0b50 2024-09-11T23:18:03.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.224+0000 7fec4ee00640 1 -- 172.21.15.144:0/2206184607 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec480b1730 con 0x7fec481f0b50 2024-09-11T23:18:03.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.224+0000 7fec3fe00640 1 -- 172.21.15.144:0/2206184607 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec34007d10 con 0x7fec481f0b50 2024-09-11T23:18:03.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.224+0000 7fec4ee00640 1 -- 172.21.15.144:0/2206184607 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec481f0070 con 0x7fec481f0b50 2024-09-11T23:18:03.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.225+0000 7fec4ee00640 1 -- 172.21.15.144:0/2206184607 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec480b4790 con 0x7fec481f0b50 2024-09-11T23:18:03.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.226+0000 7fec3fe00640 1 -- 172.21.15.144:0/2206184607 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec34048460 con 0x7fec481f0b50 2024-09-11T23:18:03.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.227+0000 7fec3fe00640 1 --2- 172.21.15.144:0/2206184607 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fec2806be60 0x7fec2806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.227+0000 7fec3fe00640 1 -- 172.21.15.144:0/2206184607 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fec340ab330 con 0x7fec481f0b50 2024-09-11T23:18:03.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.227+0000 7fec47e00640 1 --2- 172.21.15.144:0/2206184607 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fec2806be60 0x7fec2806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:03.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.228+0000 7fec47e00640 1 --2- 172.21.15.144:0/2206184607 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fec2806be60 0x7fec2806e320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fec48151fb0 tx=0x7fec38008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:03.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.231+0000 7fec3fe00640 1 -- 172.21.15.144:0/2206184607 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec3404d020 con 0x7fec481f0b50 2024-09-11T23:18:03.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.407+0000 7fec4ee00640 1 -- 172.21.15.144:0/2206184607 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec480cffc0 con 0x7fec481f0b50 2024-09-11T23:18:03.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.408+0000 7fec3fe00640 1 -- 172.21.15.144:0/2206184607 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16689 (secure 0 0 0) 0x7fec340a8150 con 0x7fec481f0b50 2024-09-11T23:18:03.409 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:03.410 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":22,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:18:00.633839+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:17:57.023145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:17:58.028864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:03.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.410+0000 7fec4ee00640 1 -- 172.21.15.144:0/2206184607 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fec2806be60 msgr2=0x7fec2806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.410+0000 7fec4ee00640 1 --2- 172.21.15.144:0/2206184607 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fec2806be60 0x7fec2806e320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fec48151fb0 tx=0x7fec38008040 comp rx=0 tx=0).stop 2024-09-11T23:18:03.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.411+0000 7fec4ee00640 1 -- 172.21.15.144:0/2206184607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec481f0b50 msgr2=0x7fec48071eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.411+0000 7fec4ee00640 1 --2- 172.21.15.144:0/2206184607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec481f0b50 0x7fec48071eb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fec3400c2d0 tx=0x7fec34001a40 comp rx=0 tx=0).stop 2024-09-11T23:18:03.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.411+0000 7fec4ee00640 1 -- 172.21.15.144:0/2206184607 shutdown_connections 2024-09-11T23:18:03.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.411+0000 7fec4ee00640 1 --2- 172.21.15.144:0/2206184607 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fec2806be60 0x7fec2806e320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.411+0000 7fec4ee00640 1 --2- 172.21.15.144:0/2206184607 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec48153f00 0x7fec48154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.411+0000 7fec4ee00640 1 --2- 172.21.15.144:0/2206184607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec481f0b50 0x7fec48071eb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.411+0000 7fec4ee00640 1 --2- 172.21.15.144:0/2206184607 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec2c003f60 0x7fec48147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.411+0000 7fec4ee00640 1 -- 172.21.15.144:0/2206184607 >> 172.21.15.144:0/2206184607 conn(0x7fec48062cc0 msgr2=0x7fec48151830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:03.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.411+0000 7fec4ee00640 1 -- 172.21.15.144:0/2206184607 shutdown_connections 2024-09-11T23:18:03.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.411+0000 7fec4ee00640 1 -- 172.21.15.144:0/2206184607 wait complete. 2024-09-11T23:18:03.428 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:18:03.428 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:18:03.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.580+0000 7fb9ae800640 1 Processor -- start 2024-09-11T23:18:03.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.581+0000 7fb9ae800640 1 -- start start 2024-09-11T23:18:03.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.582+0000 7fb9ae800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb9a80d02a0 0x7fb9a80d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.582+0000 7fb9ae800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9a815ceb0 0x7fb9a81594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.582+0000 7fb9ae800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9a80d0bc0 con 0x7fb9a815ca40 2024-09-11T23:18:03.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.582+0000 7fb9ae800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb9a815d390 con 0x7fb9a80d02a0 2024-09-11T23:18:03.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.582+0000 7fb9ae800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a815d670 con 0x7fb9a815ceb0 2024-09-11T23:18:03.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.582+0000 7fb99ea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb9a815ca40 0x7fb9a815e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55916/0 (socket says 172.21.15.144:55916) 2024-09-11T23:18:03.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.582+0000 7fb99ea00640 1 -- 172.21.15.144:0/1544293280 learned_addr learned my addr 172.21.15.144:0/1544293280 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:03.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.582+0000 7fb9a7e00640 1 --2- 172.21.15.144:0/1544293280 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9a815ceb0 0x7fb9a81594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:03.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.582+0000 7fb9a7400640 1 --2- 172.21.15.144:0/1544293280 >> v2:172.21.15.165:3300/0 conn(0x7fb9a80d02a0 0x7fb9a80d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:03.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.583+0000 7fb9a6a00640 1 -- 172.21.15.144:0/1544293280 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2904190705 0 0) 0x7fb9a80d0bc0 con 0x7fb9a815ca40 2024-09-11T23:18:03.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.583+0000 7fb9a6a00640 1 -- 172.21.15.144:0/1544293280 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb98c003520 con 0x7fb9a815ca40 2024-09-11T23:18:03.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.583+0000 7fb9a7400640 1 -- 172.21.15.144:0/1544293280 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9a815ceb0 msgr2=0x7fb9a81594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:03.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.583+0000 7fb9a7400640 1 --2- 172.21.15.144:0/1544293280 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9a815ceb0 0x7fb9a81594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.583+0000 7fb9a6a00640 1 -- 172.21.15.144:0/1544293280 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2436028232 0 0) 0x7fb98c003520 con 0x7fb9a815ca40 2024-09-11T23:18:03.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.583+0000 7fb9a7400640 1 -- 172.21.15.144:0/1544293280 >> v1:172.21.15.144:6789/0 conn(0x7fb9a815ca40 legacy=0x7fb9a815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.583+0000 7fb9a7400640 1 -- 172.21.15.144:0/1544293280 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a815d950 con 0x7fb9a80d02a0 2024-09-11T23:18:03.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.584+0000 7fb9a7400640 1 --2- 172.21.15.144:0/1544293280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9a80d02a0 0x7fb9a80d0680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9980097a0 tx=0x7fb99802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32c4b1d0d3da10ca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:03.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.584+0000 7fb9a6a00640 1 -- 172.21.15.144:0/1544293280 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb998037070 con 0x7fb9a80d02a0 2024-09-11T23:18:03.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.584+0000 7fb9a6a00640 1 -- 172.21.15.144:0/1544293280 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99802ae50 con 0x7fb9a80d02a0 2024-09-11T23:18:03.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.584+0000 7fb9a6a00640 1 -- 172.21.15.144:0/1544293280 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb998032660 con 0x7fb9a80d02a0 2024-09-11T23:18:03.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.585+0000 7fb9ae800640 1 -- 172.21.15.144:0/1544293280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9a80d02a0 msgr2=0x7fb9a80d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.585+0000 7fb9ae800640 1 --2- 172.21.15.144:0/1544293280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9a80d02a0 0x7fb9a80d0680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9980097a0 tx=0x7fb99802a100 comp rx=0 tx=0).stop 2024-09-11T23:18:03.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.585+0000 7fb9ae800640 1 -- 172.21.15.144:0/1544293280 shutdown_connections 2024-09-11T23:18:03.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.585+0000 7fb9ae800640 1 --2- 172.21.15.144:0/1544293280 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9a815ceb0 0x7fb9a81594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.585+0000 7fb9ae800640 1 --2- 172.21.15.144:0/1544293280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9a80d02a0 0x7fb9a80d0680 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.585+0000 7fb9ae800640 1 -- 172.21.15.144:0/1544293280 >> 172.21.15.144:0/1544293280 conn(0x7fb9a8062cc0 msgr2=0x7fb9a806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:03.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.585+0000 7fb9ae800640 1 -- 172.21.15.144:0/1544293280 shutdown_connections 2024-09-11T23:18:03.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.585+0000 7fb9ae800640 1 -- 172.21.15.144:0/1544293280 wait complete. 2024-09-11T23:18:03.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.587+0000 7fb9ae800640 1 Processor -- start 2024-09-11T23:18:03.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.587+0000 7fb9ae800640 1 -- start start 2024-09-11T23:18:03.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.588+0000 7fb9ae800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9a80d02a0 0x7fb9a8071a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.588+0000 7fb9ae800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9a815ca40 0x7fb9a8157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.588+0000 7fb9ae800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9a815ceb0 0x7fb9a81545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.588+0000 7fb9ae800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a815eb40 con 0x7fb9a815ceb0 2024-09-11T23:18:03.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.588+0000 7fb9ae800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a815df10 con 0x7fb9a80d02a0 2024-09-11T23:18:03.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.588+0000 7fb9ae800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a8155b90 con 0x7fb9a815ca40 2024-09-11T23:18:03.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.588+0000 7fb9a7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9a815ceb0 0x7fb9a81545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:03.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.588+0000 7fb9a7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9a815ceb0 0x7fb9a81545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38444/0 (socket says 172.21.15.144:38444) 2024-09-11T23:18:03.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.588+0000 7fb9a7e00640 1 -- 172.21.15.144:0/1018429189 learned_addr learned my addr 172.21.15.144:0/1018429189 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:03.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.588+0000 7fb9a7e00640 1 -- 172.21.15.144:0/1018429189 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9a815ca40 msgr2=0x7fb9a8157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.588+0000 7fb9a7e00640 1 --2- 172.21.15.144:0/1018429189 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9a815ca40 0x7fb9a8157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.588+0000 7fb9a7e00640 1 -- 172.21.15.144:0/1018429189 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9a80d02a0 msgr2=0x7fb9a8071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.588+0000 7fb9a7e00640 1 --2- 172.21.15.144:0/1018429189 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9a80d02a0 0x7fb9a8071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.588+0000 7fb9a7e00640 1 -- 172.21.15.144:0/1018429189 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a80723c0 con 0x7fb9a815ceb0 2024-09-11T23:18:03.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.588+0000 7fb9a7e00640 1 --2- 172.21.15.144:0/1018429189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9a815ceb0 0x7fb9a81545a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000ef90 tx=0x7fb9a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:03.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.589+0000 7fb99fe00640 1 -- 172.21.15.144:0/1018429189 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0018020 con 0x7fb9a815ceb0 2024-09-11T23:18:03.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.589+0000 7fb99fe00640 1 -- 172.21.15.144:0/1018429189 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a0014480 con 0x7fb9a815ceb0 2024-09-11T23:18:03.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.589+0000 7fb99fe00640 1 -- 172.21.15.144:0/1018429189 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0014870 con 0x7fb9a815ceb0 2024-09-11T23:18:03.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.589+0000 7fb9ae800640 1 -- 172.21.15.144:0/1018429189 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a80726a0 con 0x7fb9a815ceb0 2024-09-11T23:18:03.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.589+0000 7fb9ae800640 1 -- 172.21.15.144:0/1018429189 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a8072c60 con 0x7fb9a815ceb0 2024-09-11T23:18:03.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.590+0000 7fb9ae800640 1 -- 172.21.15.144:0/1018429189 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9a80b4790 con 0x7fb9a815ceb0 2024-09-11T23:18:03.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.591+0000 7fb99fe00640 1 -- 172.21.15.144:0/1018429189 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb9a0005d10 con 0x7fb9a815ceb0 2024-09-11T23:18:03.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.592+0000 7fb99fe00640 1 --2- 172.21.15.144:0/1018429189 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb98406be30 0x7fb98406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.592+0000 7fb99fe00640 1 -- 172.21.15.144:0/1018429189 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb9a008be80 con 0x7fb9a815ceb0 2024-09-11T23:18:03.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.592+0000 7fb9a7400640 1 --2- 172.21.15.144:0/1018429189 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb98406be30 0x7fb98406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:03.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.592+0000 7fb9a7400640 1 --2- 172.21.15.144:0/1018429189 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb98406be30 0x7fb98406e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb998034000 tx=0x7fb99802c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:03.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.596+0000 7fb99fe00640 1 -- 172.21.15.144:0/1018429189 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb9a0022030 con 0x7fb9a815ceb0 2024-09-11T23:18:03.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.771+0000 7fb9ae800640 1 -- 172.21.15.144:0/1018429189 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb9a8073060 con 0x7fb98406be30 2024-09-11T23:18:03.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.778+0000 7fb99fe00640 1 -- 172.21.15.144:0/1018429189 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250578 (secure 0 0 0) 0x7fb998032590 con 0x7fb98406be30 2024-09-11T23:18:03.782 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:03.784 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:18:03.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.782+0000 7fb9ae800640 1 -- 172.21.15.144:0/1018429189 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb98406be30 msgr2=0x7fb98406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.782+0000 7fb9ae800640 1 --2- 172.21.15.144:0/1018429189 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb98406be30 0x7fb98406e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb998034000 tx=0x7fb99802c000 comp rx=0 tx=0).stop 2024-09-11T23:18:03.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.783+0000 7fb9ae800640 1 -- 172.21.15.144:0/1018429189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9a815ceb0 msgr2=0x7fb9a81545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.783+0000 7fb9ae800640 1 --2- 172.21.15.144:0/1018429189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9a815ceb0 0x7fb9a81545a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000ef90 tx=0x7fb9a000c490 comp rx=0 tx=0).stop 2024-09-11T23:18:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.783+0000 7fb9ae800640 1 -- 172.21.15.144:0/1018429189 shutdown_connections 2024-09-11T23:18:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.783+0000 7fb9ae800640 1 --2- 172.21.15.144:0/1018429189 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb98406be30 0x7fb98406e2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.783+0000 7fb9ae800640 1 --2- 172.21.15.144:0/1018429189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9a815ceb0 0x7fb9a81545a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.783+0000 7fb9ae800640 1 --2- 172.21.15.144:0/1018429189 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9a815ca40 0x7fb9a8157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.783+0000 7fb9ae800640 1 --2- 172.21.15.144:0/1018429189 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9a80d02a0 0x7fb9a8071a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.783+0000 7fb9ae800640 1 -- 172.21.15.144:0/1018429189 >> 172.21.15.144:0/1018429189 conn(0x7fb9a8062cc0 msgr2=0x7fb9a80b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.783+0000 7fb9ae800640 1 -- 172.21.15.144:0/1018429189 shutdown_connections 2024-09-11T23:18:03.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.783+0000 7fb9ae800640 1 -- 172.21.15.144:0/1018429189 wait complete. 2024-09-11T23:18:03.799 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-11T23:18:03.162658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218944,"kb_used_data":2700,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755776,"statfs":{"total":773094113280,"available":772869914624,"internally_reserved":0,"allocated":2764800,"data_stored":1698644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.551102"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.658019+0000","last_change":"2024-09-11T23:17:59.655120+0000","last_active":"2024-09-11T23:17:59.658019+0000","last_peered":"2024-09-11T23:17:59.658019+0000","last_clean":"2024-09-11T23:17:59.658019+0000","last_became_active":"2024-09-11T23:17:59.654860+0000","last_became_peered":"2024-09-11T23:17:59.654860+0000","last_unstale":"2024-09-11T23:17:59.658019+0000","last_undegraded":"2024-09-11T23:17:59.658019+0000","last_fullsized":"2024-09-11T23:17:59.658019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:36.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.622794+0000","last_change":"2024-09-11T23:17:58.622794+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.622794+0000","last_undegraded":"2024-09-11T23:17:58.622794+0000","last_fullsized":"2024-09-11T23:17:58.622794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.629373+0000","last_change":"2024-09-11T23:17:58.629373+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.629373+0000","last_undegraded":"2024-09-11T23:17:58.629373+0000","last_fullsized":"2024-09-11T23:17:58.629373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.652162+0000","last_change":"2024-09-11T23:17:59.644202+0000","last_active":"2024-09-11T23:17:59.652162+0000","last_peered":"2024-09-11T23:17:59.652162+0000","last_clean":"2024-09-11T23:17:59.652162+0000","last_became_active":"2024-09-11T23:17:59.643634+0000","last_became_peered":"2024-09-11T23:17:59.643634+0000","last_unstale":"2024-09-11T23:17:59.652162+0000","last_undegraded":"2024-09-11T23:17:59.652162+0000","last_fullsized":"2024-09-11T23:17:59.652162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:58.423622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.656950+0000","last_change":"2024-09-11T23:17:59.652783+0000","last_active":"2024-09-11T23:17:59.656950+0000","last_peered":"2024-09-11T23:17:59.656950+0000","last_clean":"2024-09-11T23:17:59.656950+0000","last_became_active":"2024-09-11T23:17:59.652508+0000","last_became_peered":"2024-09-11T23:17:59.652508+0000","last_unstale":"2024-09-11T23:17:59.656950+0000","last_undegraded":"2024-09-11T23:17:59.656950+0000","last_fullsized":"2024-09-11T23:17:59.656950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:15.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.668756+0000","last_change":"2024-09-11T23:17:59.659401+0000","last_active":"2024-09-11T23:17:59.668756+0000","last_peered":"2024-09-11T23:17:59.668756+0000","last_clean":"2024-09-11T23:17:59.668756+0000","last_became_active":"2024-09-11T23:17:59.655926+0000","last_became_peered":"2024-09-11T23:17:59.655926+0000","last_unstale":"2024-09-11T23:17:59.668756+0000","last_undegraded":"2024-09-11T23:17:59.668756+0000","last_fullsized":"2024-09-11T23:17:59.668756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:15.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.663103+0000","last_change":"2024-09-11T23:17:59.657900+0000","last_active":"2024-09-11T23:17:59.663103+0000","last_peered":"2024-09-11T23:17:59.663103+0000","last_clean":"2024-09-11T23:17:59.663103+0000","last_became_active":"2024-09-11T23:17:59.657621+0000","last_became_peered":"2024-09-11T23:17:59.657621+0000","last_unstale":"2024-09-11T23:17:59.663103+0000","last_undegraded":"2024-09-11T23:17:59.663103+0000","last_fullsized":"2024-09-11T23:17:59.663103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:05.705455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669094+0000","last_change":"2024-09-11T23:17:59.643006+0000","last_active":"2024-09-11T23:18:00.669094+0000","last_peered":"2024-09-11T23:18:00.669094+0000","last_clean":"2024-09-11T23:18:00.669094+0000","last_became_active":"2024-09-11T23:17:59.642338+0000","last_became_peered":"2024-09-11T23:17:59.642338+0000","last_unstale":"2024-09-11T23:18:00.669094+0000","last_undegraded":"2024-09-11T23:18:00.669094+0000","last_fullsized":"2024-09-11T23:18:00.669094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:29.873658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.676196+0000","last_change":"2024-09-11T23:17:59.671758+0000","last_active":"2024-09-11T23:17:59.676196+0000","last_peered":"2024-09-11T23:17:59.676196+0000","last_clean":"2024-09-11T23:17:59.676196+0000","last_became_active":"2024-09-11T23:17:59.671418+0000","last_became_peered":"2024-09-11T23:17:59.671418+0000","last_unstale":"2024-09-11T23:17:59.676196+0000","last_undegraded":"2024-09-11T23:17:59.676196+0000","last_fullsized":"2024-09-11T23:17:59.676196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:38.039621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.660447+0000","last_change":"2024-09-11T23:17:59.656199+0000","last_active":"2024-09-11T23:17:59.660447+0000","last_peered":"2024-09-11T23:17:59.660447+0000","last_clean":"2024-09-11T23:17:59.660447+0000","last_became_active":"2024-09-11T23:17:59.655919+0000","last_became_peered":"2024-09-11T23:17:59.655919+0000","last_unstale":"2024-09-11T23:17:59.660447+0000","last_undegraded":"2024-09-11T23:17:59.660447+0000","last_fullsized":"2024-09-11T23:17:59.660447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:31.650891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.654496+0000","last_change":"2024-09-11T23:17:59.646129+0000","last_active":"2024-09-11T23:17:59.654496+0000","last_peered":"2024-09-11T23:17:59.654496+0000","last_clean":"2024-09-11T23:17:59.654496+0000","last_became_active":"2024-09-11T23:17:59.645346+0000","last_became_peered":"2024-09-11T23:17:59.645346+0000","last_unstale":"2024-09-11T23:17:59.654496+0000","last_undegraded":"2024-09-11T23:17:59.654496+0000","last_fullsized":"2024-09-11T23:17:59.654496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:05.573887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.651766+0000","last_change":"2024-09-11T23:17:59.642874+0000","last_active":"2024-09-11T23:17:59.651766+0000","last_peered":"2024-09-11T23:17:59.651766+0000","last_clean":"2024-09-11T23:17:59.651766+0000","last_became_active":"2024-09-11T23:17:59.642586+0000","last_became_peered":"2024-09-11T23:17:59.642586+0000","last_unstale":"2024-09-11T23:17:59.651766+0000","last_undegraded":"2024-09-11T23:17:59.651766+0000","last_fullsized":"2024-09-11T23:17:59.651766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:24.114060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670655+0000","last_change":"2024-09-11T23:17:59.644814+0000","last_active":"2024-09-11T23:18:00.670655+0000","last_peered":"2024-09-11T23:18:00.670655+0000","last_clean":"2024-09-11T23:18:00.670655+0000","last_became_active":"2024-09-11T23:17:59.643305+0000","last_became_peered":"2024-09-11T23:17:59.643305+0000","last_unstale":"2024-09-11T23:18:00.670655+0000","last_undegraded":"2024-09-11T23:18:00.670655+0000","last_fullsized":"2024-09-11T23:18:00.670655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:29.321395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.630283+0000","last_change":"2024-09-11T23:17:58.630283+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.630283+0000","last_undegraded":"2024-09-11T23:17:58.630283+0000","last_fullsized":"2024-09-11T23:17:58.630283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.620642+0000","last_change":"2024-09-11T23:17:58.620642+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.620642+0000","last_undegraded":"2024-09-11T23:17:58.620642+0000","last_fullsized":"2024-09-11T23:17:58.620642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.656386+0000","last_change":"2024-09-11T23:17:59.653627+0000","last_active":"2024-09-11T23:17:59.656386+0000","last_peered":"2024-09-11T23:17:59.656386+0000","last_clean":"2024-09-11T23:17:59.656386+0000","last_became_active":"2024-09-11T23:17:59.653088+0000","last_became_peered":"2024-09-11T23:17:59.653088+0000","last_unstale":"2024-09-11T23:17:59.656386+0000","last_undegraded":"2024-09-11T23:17:59.656386+0000","last_fullsized":"2024-09-11T23:17:59.656386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:24.269862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.668387+0000","last_change":"2024-09-11T23:17:59.660074+0000","last_active":"2024-09-11T23:17:59.668387+0000","last_peered":"2024-09-11T23:17:59.668387+0000","last_clean":"2024-09-11T23:17:59.668387+0000","last_became_active":"2024-09-11T23:17:59.659174+0000","last_became_peered":"2024-09-11T23:17:59.659174+0000","last_unstale":"2024-09-11T23:17:59.668387+0000","last_undegraded":"2024-09-11T23:17:59.668387+0000","last_fullsized":"2024-09-11T23:17:59.668387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:36.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669448+0000","last_change":"2024-09-11T23:17:59.641202+0000","last_active":"2024-09-11T23:18:00.669448+0000","last_peered":"2024-09-11T23:18:00.669448+0000","last_clean":"2024-09-11T23:18:00.669448+0000","last_became_active":"2024-09-11T23:17:59.640609+0000","last_became_peered":"2024-09-11T23:17:59.640609+0000","last_unstale":"2024-09-11T23:18:00.669448+0000","last_undegraded":"2024-09-11T23:18:00.669448+0000","last_fullsized":"2024-09-11T23:18:00.669448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:34.428505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.657378+0000","last_change":"2024-09-11T23:17:59.654884+0000","last_active":"2024-09-11T23:17:59.657378+0000","last_peered":"2024-09-11T23:17:59.657378+0000","last_clean":"2024-09-11T23:17:59.657378+0000","last_became_active":"2024-09-11T23:17:59.654578+0000","last_became_peered":"2024-09-11T23:17:59.654578+0000","last_unstale":"2024-09-11T23:17:59.657378+0000","last_undegraded":"2024-09-11T23:17:59.657378+0000","last_fullsized":"2024-09-11T23:17:59.657378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.193032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.654318+0000","last_change":"2024-09-11T23:17:59.643411+0000","last_active":"2024-09-11T23:17:59.654318+0000","last_peered":"2024-09-11T23:17:59.654318+0000","last_clean":"2024-09-11T23:17:59.654318+0000","last_became_active":"2024-09-11T23:17:59.643076+0000","last_became_peered":"2024-09-11T23:17:59.643076+0000","last_unstale":"2024-09-11T23:17:59.654318+0000","last_undegraded":"2024-09-11T23:17:59.654318+0000","last_fullsized":"2024-09-11T23:17:59.654318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:30.915550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.628788+0000","last_change":"2024-09-11T23:17:58.628788+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.628788+0000","last_undegraded":"2024-09-11T23:17:58.628788+0000","last_fullsized":"2024-09-11T23:17:58.628788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.672101+0000","last_change":"2024-09-11T23:17:59.666448+0000","last_active":"2024-09-11T23:17:59.672101+0000","last_peered":"2024-09-11T23:17:59.672101+0000","last_clean":"2024-09-11T23:17:59.672101+0000","last_became_active":"2024-09-11T23:17:59.664741+0000","last_became_peered":"2024-09-11T23:17:59.664741+0000","last_unstale":"2024-09-11T23:17:59.672101+0000","last_undegraded":"2024-09-11T23:17:59.672101+0000","last_fullsized":"2024-09-11T23:17:59.672101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:05.705455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670229+0000","last_change":"2024-09-11T23:17:59.645036+0000","last_active":"2024-09-11T23:18:00.670229+0000","last_peered":"2024-09-11T23:18:00.670229+0000","last_clean":"2024-09-11T23:18:00.670229+0000","last_became_active":"2024-09-11T23:17:59.644706+0000","last_became_peered":"2024-09-11T23:17:59.644706+0000","last_unstale":"2024-09-11T23:18:00.670229+0000","last_undegraded":"2024-09-11T23:18:00.670229+0000","last_fullsized":"2024-09-11T23:18:00.670229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:04.266917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.656360+0000","last_change":"2024-09-11T23:17:59.653352+0000","last_active":"2024-09-11T23:17:59.656360+0000","last_peered":"2024-09-11T23:17:59.656360+0000","last_clean":"2024-09-11T23:17:59.656360+0000","last_became_active":"2024-09-11T23:17:59.652470+0000","last_became_peered":"2024-09-11T23:17:59.652470+0000","last_unstale":"2024-09-11T23:17:59.656360+0000","last_undegraded":"2024-09-11T23:17:59.656360+0000","last_fullsized":"2024-09-11T23:17:59.656360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:50.598149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671014+0000","last_change":"2024-09-11T23:17:59.662259+0000","last_active":"2024-09-11T23:18:00.671014+0000","last_peered":"2024-09-11T23:18:00.671014+0000","last_clean":"2024-09-11T23:18:00.671014+0000","last_became_active":"2024-09-11T23:17:59.662031+0000","last_became_peered":"2024-09-11T23:17:59.662031+0000","last_unstale":"2024-09-11T23:18:00.671014+0000","last_undegraded":"2024-09-11T23:18:00.671014+0000","last_fullsized":"2024-09-11T23:18:00.671014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:34.160365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.654388+0000","last_change":"2024-09-11T23:17:59.650797+0000","last_active":"2024-09-11T23:17:59.654388+0000","last_peered":"2024-09-11T23:17:59.654388+0000","last_clean":"2024-09-11T23:17:59.654388+0000","last_became_active":"2024-09-11T23:17:59.650548+0000","last_became_peered":"2024-09-11T23:17:59.650548+0000","last_unstale":"2024-09-11T23:17:59.654388+0000","last_undegraded":"2024-09-11T23:17:59.654388+0000","last_fullsized":"2024-09-11T23:17:59.654388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:24.269862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.621631+0000","last_change":"2024-09-11T23:17:58.621631+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.621631+0000","last_undegraded":"2024-09-11T23:17:58.621631+0000","last_fullsized":"2024-09-11T23:17:58.621631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670965+0000","last_change":"2024-09-11T23:17:59.644063+0000","last_active":"2024-09-11T23:18:00.670965+0000","last_peered":"2024-09-11T23:18:00.670965+0000","last_clean":"2024-09-11T23:18:00.670965+0000","last_became_active":"2024-09-11T23:17:59.643760+0000","last_became_peered":"2024-09-11T23:17:59.643760+0000","last_unstale":"2024-09-11T23:18:00.670965+0000","last_undegraded":"2024-09-11T23:18:00.670965+0000","last_fullsized":"2024-09-11T23:18:00.670965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:31.141907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.628159+0000","last_change":"2024-09-11T23:17:58.628159+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.628159+0000","last_undegraded":"2024-09-11T23:17:58.628159+0000","last_fullsized":"2024-09-11T23:17:58.628159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.668741+0000","last_change":"2024-09-11T23:17:59.657821+0000","last_active":"2024-09-11T23:17:59.668741+0000","last_peered":"2024-09-11T23:17:59.668741+0000","last_clean":"2024-09-11T23:17:59.668741+0000","last_became_active":"2024-09-11T23:17:59.645334+0000","last_became_peered":"2024-09-11T23:17:59.645334+0000","last_unstale":"2024-09-11T23:17:59.668741+0000","last_undegraded":"2024-09-11T23:17:59.668741+0000","last_fullsized":"2024-09-11T23:17:59.668741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:31.650891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669574+0000","last_change":"2024-09-11T23:17:59.636987+0000","last_active":"2024-09-11T23:18:00.669574+0000","last_peered":"2024-09-11T23:18:00.669574+0000","last_clean":"2024-09-11T23:18:00.669574+0000","last_became_active":"2024-09-11T23:17:59.636762+0000","last_became_peered":"2024-09-11T23:17:59.636762+0000","last_unstale":"2024-09-11T23:18:00.669574+0000","last_undegraded":"2024-09-11T23:18:00.669574+0000","last_fullsized":"2024-09-11T23:18:00.669574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:10.353893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.654188+0000","last_change":"2024-09-11T23:17:59.648354+0000","last_active":"2024-09-11T23:17:59.654188+0000","last_peered":"2024-09-11T23:17:59.654188+0000","last_clean":"2024-09-11T23:17:59.654188+0000","last_became_active":"2024-09-11T23:17:59.646693+0000","last_became_peered":"2024-09-11T23:17:59.646693+0000","last_unstale":"2024-09-11T23:17:59.654188+0000","last_undegraded":"2024-09-11T23:17:59.654188+0000","last_fullsized":"2024-09-11T23:17:59.654188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:58.423622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.642173+0000","last_change":"2024-09-11T23:17:59.637101+0000","last_active":"2024-09-11T23:17:59.642173+0000","last_peered":"2024-09-11T23:17:59.642173+0000","last_clean":"2024-09-11T23:17:59.642173+0000","last_became_active":"2024-09-11T23:17:59.635407+0000","last_became_peered":"2024-09-11T23:17:59.635407+0000","last_unstale":"2024-09-11T23:17:59.642173+0000","last_undegraded":"2024-09-11T23:17:59.642173+0000","last_fullsized":"2024-09-11T23:17:59.642173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:10.483262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670769+0000","last_change":"2024-09-11T23:17:58.642664+0000","last_active":"2024-09-11T23:18:00.670769+0000","last_peered":"2024-09-11T23:18:00.670769+0000","last_clean":"2024-09-11T23:18:00.670769+0000","last_became_active":"2024-09-11T23:17:58.642371+0000","last_became_peered":"2024-09-11T23:17:58.642371+0000","last_unstale":"2024-09-11T23:18:00.670769+0000","last_undegraded":"2024-09-11T23:18:00.670769+0000","last_fullsized":"2024-09-11T23:18:00.670769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:31.214611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.620315+0000","last_change":"2024-09-11T23:17:58.620315+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.620315+0000","last_undegraded":"2024-09-11T23:17:58.620315+0000","last_fullsized":"2024-09-11T23:17:58.620315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.669118+0000","last_change":"2024-09-11T23:17:58.640442+0000","last_active":"2024-09-11T23:17:59.669118+0000","last_peered":"2024-09-11T23:17:59.669118+0000","last_clean":"2024-09-11T23:17:59.669118+0000","last_became_active":"2024-09-11T23:17:58.640148+0000","last_became_peered":"2024-09-11T23:17:58.640148+0000","last_unstale":"2024-09-11T23:17:59.669118+0000","last_undegraded":"2024-09-11T23:17:59.669118+0000","last_fullsized":"2024-09-11T23:17:59.669118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:02.505670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670322+0000","last_change":"2024-09-11T23:17:58.640181+0000","last_active":"2024-09-11T23:18:00.670322+0000","last_peered":"2024-09-11T23:18:00.670322+0000","last_clean":"2024-09-11T23:18:00.670322+0000","last_became_active":"2024-09-11T23:17:58.639944+0000","last_became_peered":"2024-09-11T23:17:58.639944+0000","last_unstale":"2024-09-11T23:18:00.670322+0000","last_undegraded":"2024-09-11T23:18:00.670322+0000","last_fullsized":"2024-09-11T23:18:00.670322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:02.827617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669793+0000","last_change":"2024-09-11T23:17:59.643922+0000","last_active":"2024-09-11T23:18:00.669793+0000","last_peered":"2024-09-11T23:18:00.669793+0000","last_clean":"2024-09-11T23:18:00.669793+0000","last_became_active":"2024-09-11T23:17:59.643613+0000","last_became_peered":"2024-09-11T23:17:59.643613+0000","last_unstale":"2024-09-11T23:18:00.669793+0000","last_undegraded":"2024-09-11T23:18:00.669793+0000","last_fullsized":"2024-09-11T23:18:00.669793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:31.792631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.627116+0000","last_change":"2024-09-11T23:17:58.640428+0000","last_active":"2024-09-11T23:17:59.627116+0000","last_peered":"2024-09-11T23:17:59.627116+0000","last_clean":"2024-09-11T23:17:59.627116+0000","last_became_active":"2024-09-11T23:17:58.639860+0000","last_became_peered":"2024-09-11T23:17:58.639860+0000","last_unstale":"2024-09-11T23:17:59.627116+0000","last_undegraded":"2024-09-11T23:17:59.627116+0000","last_fullsized":"2024-09-11T23:17:59.627116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.621139+0000","last_change":"2024-09-11T23:17:58.621139+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.621139+0000","last_undegraded":"2024-09-11T23:17:58.621139+0000","last_fullsized":"2024-09-11T23:17:58.621139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.636665+0000","last_change":"2024-09-11T23:17:58.645977+0000","last_active":"2024-09-11T23:17:59.636665+0000","last_peered":"2024-09-11T23:17:59.636665+0000","last_clean":"2024-09-11T23:17:59.636665+0000","last_became_active":"2024-09-11T23:17:58.645482+0000","last_became_peered":"2024-09-11T23:17:58.645482+0000","last_unstale":"2024-09-11T23:17:59.636665+0000","last_undegraded":"2024-09-11T23:17:59.636665+0000","last_fullsized":"2024-09-11T23:17:59.636665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:31.277023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.668608+0000","last_change":"2024-09-11T23:17:59.658501+0000","last_active":"2024-09-11T23:17:59.668608+0000","last_peered":"2024-09-11T23:17:59.668608+0000","last_clean":"2024-09-11T23:17:59.668608+0000","last_became_active":"2024-09-11T23:17:59.658268+0000","last_became_peered":"2024-09-11T23:17:59.658268+0000","last_unstale":"2024-09-11T23:17:59.668608+0000","last_undegraded":"2024-09-11T23:17:59.668608+0000","last_fullsized":"2024-09-11T23:17:59.668608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:49.647417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.629883+0000","last_change":"2024-09-11T23:17:58.640356+0000","last_active":"2024-09-11T23:17:59.629883+0000","last_peered":"2024-09-11T23:17:59.629883+0000","last_clean":"2024-09-11T23:17:59.629883+0000","last_became_active":"2024-09-11T23:17:58.640060+0000","last_became_peered":"2024-09-11T23:17:58.640060+0000","last_unstale":"2024-09-11T23:17:59.629883+0000","last_undegraded":"2024-09-11T23:17:59.629883+0000","last_fullsized":"2024-09-11T23:17:59.629883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:31.277023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.619425+0000","last_change":"2024-09-11T23:17:58.619425+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.619425+0000","last_undegraded":"2024-09-11T23:17:58.619425+0000","last_fullsized":"2024-09-11T23:17:58.619425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.647001+0000","last_change":"2024-09-11T23:17:58.646012+0000","last_active":"2024-09-11T23:17:58.647001+0000","last_peered":"2024-09-11T23:17:58.647001+0000","last_clean":"2024-09-11T23:17:58.647001+0000","last_became_active":"2024-09-11T23:17:58.645093+0000","last_became_peered":"2024-09-11T23:17:58.645093+0000","last_unstale":"2024-09-11T23:17:58.647001+0000","last_undegraded":"2024-09-11T23:17:58.647001+0000","last_fullsized":"2024-09-11T23:17:58.647001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.660595+0000","last_change":"2024-09-11T23:17:59.653386+0000","last_active":"2024-09-11T23:17:59.660595+0000","last_peered":"2024-09-11T23:17:59.660595+0000","last_clean":"2024-09-11T23:17:59.660595+0000","last_became_active":"2024-09-11T23:17:59.653112+0000","last_became_peered":"2024-09-11T23:17:59.653112+0000","last_unstale":"2024-09-11T23:17:59.660595+0000","last_undegraded":"2024-09-11T23:17:59.660595+0000","last_fullsized":"2024-09-11T23:17:59.660595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:22.092955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.676373+0000","last_change":"2024-09-11T23:17:58.642732+0000","last_active":"2024-09-11T23:17:59.676373+0000","last_peered":"2024-09-11T23:17:59.676373+0000","last_clean":"2024-09-11T23:17:59.676373+0000","last_became_active":"2024-09-11T23:17:58.642411+0000","last_became_peered":"2024-09-11T23:17:58.642411+0000","last_unstale":"2024-09-11T23:17:59.676373+0000","last_undegraded":"2024-09-11T23:17:59.676373+0000","last_fullsized":"2024-09-11T23:17:59.676373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:21.084931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.656734+0000","last_change":"2024-09-11T23:17:59.652260+0000","last_active":"2024-09-11T23:17:59.656734+0000","last_peered":"2024-09-11T23:17:59.656734+0000","last_clean":"2024-09-11T23:17:59.656734+0000","last_became_active":"2024-09-11T23:17:59.651842+0000","last_became_peered":"2024-09-11T23:17:59.651842+0000","last_unstale":"2024-09-11T23:17:59.656734+0000","last_undegraded":"2024-09-11T23:17:59.656734+0000","last_fullsized":"2024-09-11T23:17:59.656734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:49.647417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.633101+0000","last_change":"2024-09-11T23:17:58.629743+0000","last_active":"2024-09-11T23:17:58.633101+0000","last_peered":"2024-09-11T23:17:58.633101+0000","last_clean":"2024-09-11T23:17:58.633101+0000","last_became_active":"2024-09-11T23:17:58.629379+0000","last_became_peered":"2024-09-11T23:17:58.629379+0000","last_unstale":"2024-09-11T23:17:58.633101+0000","last_undegraded":"2024-09-11T23:17:58.633101+0000","last_fullsized":"2024-09-11T23:17:58.633101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:28.903861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.619462+0000","last_change":"2024-09-11T23:17:58.619462+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.619462+0000","last_undegraded":"2024-09-11T23:17:58.619462+0000","last_fullsized":"2024-09-11T23:17:58.619462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.628052+0000","last_change":"2024-09-11T23:17:58.641139+0000","last_active":"2024-09-11T23:17:59.628052+0000","last_peered":"2024-09-11T23:17:59.628052+0000","last_clean":"2024-09-11T23:17:59.628052+0000","last_became_active":"2024-09-11T23:17:58.640813+0000","last_became_peered":"2024-09-11T23:17:58.640813+0000","last_unstale":"2024-09-11T23:17:59.628052+0000","last_undegraded":"2024-09-11T23:17:59.628052+0000","last_fullsized":"2024-09-11T23:17:59.628052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:02.505670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.668277+0000","last_change":"2024-09-11T23:17:59.661121+0000","last_active":"2024-09-11T23:17:59.668277+0000","last_peered":"2024-09-11T23:17:59.668277+0000","last_clean":"2024-09-11T23:17:59.668277+0000","last_became_active":"2024-09-11T23:17:59.660078+0000","last_became_peered":"2024-09-11T23:17:59.660078+0000","last_unstale":"2024-09-11T23:17:59.668277+0000","last_undegraded":"2024-09-11T23:17:59.668277+0000","last_fullsized":"2024-09-11T23:17:59.668277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.341838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.632833+0000","last_change":"2024-09-11T23:17:58.636194+0000","last_active":"2024-09-11T23:17:59.632833+0000","last_peered":"2024-09-11T23:17:59.632833+0000","last_clean":"2024-09-11T23:17:59.632833+0000","last_became_active":"2024-09-11T23:17:58.635885+0000","last_became_peered":"2024-09-11T23:17:58.635885+0000","last_unstale":"2024-09-11T23:17:59.632833+0000","last_undegraded":"2024-09-11T23:17:59.632833+0000","last_fullsized":"2024-09-11T23:17:59.632833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.654238+0000","last_change":"2024-09-11T23:17:59.648931+0000","last_active":"2024-09-11T23:17:59.654238+0000","last_peered":"2024-09-11T23:17:59.654238+0000","last_clean":"2024-09-11T23:17:59.654238+0000","last_became_active":"2024-09-11T23:17:59.646149+0000","last_became_peered":"2024-09-11T23:17:59.646149+0000","last_unstale":"2024-09-11T23:17:59.654238+0000","last_undegraded":"2024-09-11T23:17:59.654238+0000","last_fullsized":"2024-09-11T23:17:59.654238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:50.598149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669254+0000","last_change":"2024-09-11T23:17:58.631291+0000","last_active":"2024-09-11T23:18:00.669254+0000","last_peered":"2024-09-11T23:18:00.669254+0000","last_clean":"2024-09-11T23:18:00.669254+0000","last_became_active":"2024-09-11T23:17:58.630939+0000","last_became_peered":"2024-09-11T23:17:58.630939+0000","last_unstale":"2024-09-11T23:18:00.669254+0000","last_undegraded":"2024-09-11T23:18:00.669254+0000","last_fullsized":"2024-09-11T23:18:00.669254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:53:26.952229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.666524+0000","last_change":"2024-09-11T23:17:59.660874+0000","last_active":"2024-09-11T23:17:59.666524+0000","last_peered":"2024-09-11T23:17:59.666524+0000","last_clean":"2024-09-11T23:17:59.666524+0000","last_became_active":"2024-09-11T23:17:59.660613+0000","last_became_peered":"2024-09-11T23:17:59.660613+0000","last_unstale":"2024-09-11T23:17:59.666524+0000","last_undegraded":"2024-09-11T23:17:59.666524+0000","last_fullsized":"2024-09-11T23:17:59.666524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:50.844310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.673027+0000","last_change":"2024-09-11T23:17:58.635774+0000","last_active":"2024-09-11T23:17:59.673027+0000","last_peered":"2024-09-11T23:17:59.673027+0000","last_clean":"2024-09-11T23:17:59.673027+0000","last_became_active":"2024-09-11T23:17:58.634748+0000","last_became_peered":"2024-09-11T23:17:58.634748+0000","last_unstale":"2024-09-11T23:17:59.673027+0000","last_undegraded":"2024-09-11T23:17:59.673027+0000","last_fullsized":"2024-09-11T23:17:59.673027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:44.209956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.666227+0000","last_change":"2024-09-11T23:17:59.662246+0000","last_active":"2024-09-11T23:17:59.666227+0000","last_peered":"2024-09-11T23:17:59.666227+0000","last_clean":"2024-09-11T23:17:59.666227+0000","last_became_active":"2024-09-11T23:17:59.661866+0000","last_became_peered":"2024-09-11T23:17:59.661866+0000","last_unstale":"2024-09-11T23:17:59.666227+0000","last_undegraded":"2024-09-11T23:17:59.666227+0000","last_fullsized":"2024-09-11T23:17:59.666227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:09.804490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669504+0000","last_change":"2024-09-11T23:17:58.634201+0000","last_active":"2024-09-11T23:18:00.669504+0000","last_peered":"2024-09-11T23:18:00.669504+0000","last_clean":"2024-09-11T23:18:00.669504+0000","last_became_active":"2024-09-11T23:17:58.633865+0000","last_became_peered":"2024-09-11T23:17:58.633865+0000","last_unstale":"2024-09-11T23:18:00.669504+0000","last_undegraded":"2024-09-11T23:18:00.669504+0000","last_fullsized":"2024-09-11T23:18:00.669504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:12.634428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.672372+0000","last_change":"2024-09-11T23:17:59.668175+0000","last_active":"2024-09-11T23:17:59.672372+0000","last_peered":"2024-09-11T23:17:59.672372+0000","last_clean":"2024-09-11T23:17:59.672372+0000","last_became_active":"2024-09-11T23:17:59.665569+0000","last_became_peered":"2024-09-11T23:17:59.665569+0000","last_unstale":"2024-09-11T23:17:59.672372+0000","last_undegraded":"2024-09-11T23:17:59.672372+0000","last_fullsized":"2024-09-11T23:17:59.672372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:28.813283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.632336+0000","last_change":"2024-09-11T23:17:58.630807+0000","last_active":"2024-09-11T23:17:58.632336+0000","last_peered":"2024-09-11T23:17:58.632336+0000","last_clean":"2024-09-11T23:17:58.632336+0000","last_became_active":"2024-09-11T23:17:58.630491+0000","last_became_peered":"2024-09-11T23:17:58.630491+0000","last_unstale":"2024-09-11T23:17:58.632336+0000","last_undegraded":"2024-09-11T23:17:58.632336+0000","last_fullsized":"2024-09-11T23:17:58.632336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:28.903861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.652143+0000","last_change":"2024-09-11T23:17:59.643945+0000","last_active":"2024-09-11T23:17:59.652143+0000","last_peered":"2024-09-11T23:17:59.652143+0000","last_clean":"2024-09-11T23:17:59.652143+0000","last_became_active":"2024-09-11T23:17:59.643358+0000","last_became_peered":"2024-09-11T23:17:59.643358+0000","last_unstale":"2024-09-11T23:17:59.652143+0000","last_undegraded":"2024-09-11T23:17:59.652143+0000","last_fullsized":"2024-09-11T23:17:59.652143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:05.573887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670008+0000","last_change":"2024-09-11T23:17:58.645520+0000","last_active":"2024-09-11T23:18:00.670008+0000","last_peered":"2024-09-11T23:18:00.670008+0000","last_clean":"2024-09-11T23:18:00.670008+0000","last_became_active":"2024-09-11T23:17:58.645211+0000","last_became_peered":"2024-09-11T23:17:58.645211+0000","last_unstale":"2024-09-11T23:18:00.670008+0000","last_undegraded":"2024-09-11T23:18:00.670008+0000","last_fullsized":"2024-09-11T23:18:00.670008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:02.827617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.673641+0000","last_change":"2024-09-11T23:17:59.669515+0000","last_active":"2024-09-11T23:17:59.673641+0000","last_peered":"2024-09-11T23:17:59.673641+0000","last_clean":"2024-09-11T23:17:59.673641+0000","last_became_active":"2024-09-11T23:17:59.669182+0000","last_became_peered":"2024-09-11T23:17:59.669182+0000","last_unstale":"2024-09-11T23:17:59.673641+0000","last_undegraded":"2024-09-11T23:17:59.673641+0000","last_fullsized":"2024-09-11T23:17:59.673641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:15.213721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.644313+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:17:59.644313+0000","last_peered":"2024-09-11T23:17:59.644313+0000","last_clean":"2024-09-11T23:17:59.644313+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:17:59.644313+0000","last_undegraded":"2024-09-11T23:17:59.644313+0000","last_fullsized":"2024-09-11T23:17:59.644313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.627661+0000","last_change":"2024-09-11T23:17:58.634769+0000","last_active":"2024-09-11T23:17:59.627661+0000","last_peered":"2024-09-11T23:17:59.627661+0000","last_clean":"2024-09-11T23:17:59.627661+0000","last_became_active":"2024-09-11T23:17:58.634321+0000","last_became_peered":"2024-09-11T23:17:58.634321+0000","last_unstale":"2024-09-11T23:17:59.627661+0000","last_undegraded":"2024-09-11T23:17:59.627661+0000","last_fullsized":"2024-09-11T23:17:59.627661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:21.084931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669925+0000","last_change":"2024-09-11T23:17:59.659482+0000","last_active":"2024-09-11T23:18:00.669925+0000","last_peered":"2024-09-11T23:18:00.669925+0000","last_clean":"2024-09-11T23:18:00.669925+0000","last_became_active":"2024-09-11T23:17:59.659148+0000","last_became_peered":"2024-09-11T23:17:59.659148+0000","last_unstale":"2024-09-11T23:18:00.669925+0000","last_undegraded":"2024-09-11T23:18:00.669925+0000","last_fullsized":"2024-09-11T23:18:00.669925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:22.419970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.644252+0000","last_change":"2024-09-11T23:17:58.636656+0000","last_active":"2024-09-11T23:17:59.644252+0000","last_peered":"2024-09-11T23:17:59.644252+0000","last_clean":"2024-09-11T23:17:59.644252+0000","last_became_active":"2024-09-11T23:17:58.636363+0000","last_became_peered":"2024-09-11T23:17:58.636363+0000","last_unstale":"2024-09-11T23:17:59.644252+0000","last_undegraded":"2024-09-11T23:17:59.644252+0000","last_fullsized":"2024-09-11T23:17:59.644252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:04.565864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.621230+0000","last_change":"2024-09-11T23:17:58.621230+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.621230+0000","last_undegraded":"2024-09-11T23:17:58.621230+0000","last_fullsized":"2024-09-11T23:17:58.621230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669359+0000","last_change":"2024-09-11T23:17:58.642240+0000","last_active":"2024-09-11T23:18:00.669359+0000","last_peered":"2024-09-11T23:18:00.669359+0000","last_clean":"2024-09-11T23:18:00.669359+0000","last_became_active":"2024-09-11T23:17:58.641996+0000","last_became_peered":"2024-09-11T23:17:58.641996+0000","last_unstale":"2024-09-11T23:18:00.669359+0000","last_undegraded":"2024-09-11T23:18:00.669359+0000","last_fullsized":"2024-09-11T23:18:00.669359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:29:09.781577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.622052+0000","last_change":"2024-09-11T23:17:58.622052+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.622052+0000","last_undegraded":"2024-09-11T23:17:58.622052+0000","last_fullsized":"2024-09-11T23:17:58.622052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.628495+0000","last_change":"2024-09-11T23:17:58.641231+0000","last_active":"2024-09-11T23:17:59.628495+0000","last_peered":"2024-09-11T23:17:59.628495+0000","last_clean":"2024-09-11T23:17:59.628495+0000","last_became_active":"2024-09-11T23:17:58.640860+0000","last_became_peered":"2024-09-11T23:17:58.640860+0000","last_unstale":"2024-09-11T23:17:59.628495+0000","last_undegraded":"2024-09-11T23:17:59.628495+0000","last_fullsized":"2024-09-11T23:17:59.628495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.648713+0000","last_change":"2024-09-11T23:17:59.643898+0000","last_active":"2024-09-11T23:17:59.648713+0000","last_peered":"2024-09-11T23:17:59.648713+0000","last_clean":"2024-09-11T23:17:59.648713+0000","last_became_active":"2024-09-11T23:17:59.643471+0000","last_became_peered":"2024-09-11T23:17:59.643471+0000","last_unstale":"2024-09-11T23:17:59.648713+0000","last_undegraded":"2024-09-11T23:17:59.648713+0000","last_fullsized":"2024-09-11T23:17:59.648713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:36.096761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.643940+0000","last_change":"2024-09-11T23:17:58.640659+0000","last_active":"2024-09-11T23:17:58.643940+0000","last_peered":"2024-09-11T23:17:58.643940+0000","last_clean":"2024-09-11T23:17:58.643940+0000","last_became_active":"2024-09-11T23:17:58.640358+0000","last_became_peered":"2024-09-11T23:17:58.640358+0000","last_unstale":"2024-09-11T23:17:58.643940+0000","last_undegraded":"2024-09-11T23:17:58.643940+0000","last_fullsized":"2024-09-11T23:17:58.643940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:23.106037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.668652+0000","last_change":"2024-09-11T23:17:59.659233+0000","last_active":"2024-09-11T23:17:59.668652+0000","last_peered":"2024-09-11T23:17:59.668652+0000","last_clean":"2024-09-11T23:17:59.668652+0000","last_became_active":"2024-09-11T23:17:59.655952+0000","last_became_peered":"2024-09-11T23:17:59.655952+0000","last_unstale":"2024-09-11T23:17:59.668652+0000","last_undegraded":"2024-09-11T23:17:59.668652+0000","last_fullsized":"2024-09-11T23:17:59.668652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.193032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.648948+0000","last_change":"2024-09-11T23:17:58.642080+0000","last_active":"2024-09-11T23:17:59.648948+0000","last_peered":"2024-09-11T23:17:59.648948+0000","last_clean":"2024-09-11T23:17:59.648948+0000","last_became_active":"2024-09-11T23:17:58.641752+0000","last_became_peered":"2024-09-11T23:17:58.641752+0000","last_unstale":"2024-09-11T23:17:59.648948+0000","last_undegraded":"2024-09-11T23:17:59.648948+0000","last_fullsized":"2024-09-11T23:17:59.648948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:30.642868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.620511+0000","last_change":"2024-09-11T23:17:58.620511+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.620511+0000","last_undegraded":"2024-09-11T23:17:58.620511+0000","last_fullsized":"2024-09-11T23:17:58.620511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.635264+0000","last_change":"2024-09-11T23:17:58.633818+0000","last_active":"2024-09-11T23:17:58.635264+0000","last_peered":"2024-09-11T23:17:58.635264+0000","last_clean":"2024-09-11T23:17:58.635264+0000","last_became_active":"2024-09-11T23:17:58.633550+0000","last_became_peered":"2024-09-11T23:17:58.633550+0000","last_unstale":"2024-09-11T23:17:58.635264+0000","last_undegraded":"2024-09-11T23:17:58.635264+0000","last_fullsized":"2024-09-11T23:17:58.635264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:44.209956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671118+0000","last_change":"2024-09-11T23:17:59.650990+0000","last_active":"2024-09-11T23:18:00.671118+0000","last_peered":"2024-09-11T23:18:00.671118+0000","last_clean":"2024-09-11T23:18:00.671118+0000","last_became_active":"2024-09-11T23:17:59.650684+0000","last_became_peered":"2024-09-11T23:17:59.650684+0000","last_unstale":"2024-09-11T23:18:00.671118+0000","last_undegraded":"2024-09-11T23:18:00.671118+0000","last_fullsized":"2024-09-11T23:18:00.671118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:17.470426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.671564+0000","last_change":"2024-09-11T23:17:58.639477+0000","last_active":"2024-09-11T23:17:59.671564+0000","last_peered":"2024-09-11T23:17:59.671564+0000","last_clean":"2024-09-11T23:17:59.671564+0000","last_became_active":"2024-09-11T23:17:58.639168+0000","last_became_peered":"2024-09-11T23:17:58.639168+0000","last_unstale":"2024-09-11T23:17:59.671564+0000","last_undegraded":"2024-09-11T23:17:59.671564+0000","last_fullsized":"2024-09-11T23:17:59.671564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.630832+0000","last_change":"2024-09-11T23:17:58.630832+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.630832+0000","last_undegraded":"2024-09-11T23:17:58.630832+0000","last_fullsized":"2024-09-11T23:17:58.630832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.644090+0000","last_change":"2024-09-11T23:17:58.640620+0000","last_active":"2024-09-11T23:17:59.644090+0000","last_peered":"2024-09-11T23:17:59.644090+0000","last_clean":"2024-09-11T23:17:59.644090+0000","last_became_active":"2024-09-11T23:17:58.640367+0000","last_became_peered":"2024-09-11T23:17:58.640367+0000","last_unstale":"2024-09-11T23:17:59.644090+0000","last_undegraded":"2024-09-11T23:17:59.644090+0000","last_fullsized":"2024-09-11T23:17:59.644090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.907527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.639105+0000","last_change":"2024-09-11T23:17:59.635712+0000","last_active":"2024-09-11T23:17:59.639105+0000","last_peered":"2024-09-11T23:17:59.639105+0000","last_clean":"2024-09-11T23:17:59.639105+0000","last_became_active":"2024-09-11T23:17:59.635303+0000","last_became_peered":"2024-09-11T23:17:59.635303+0000","last_unstale":"2024-09-11T23:17:59.639105+0000","last_undegraded":"2024-09-11T23:17:59.639105+0000","last_fullsized":"2024-09-11T23:17:59.639105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:49.396092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.643771+0000","last_change":"2024-09-11T23:17:58.639596+0000","last_active":"2024-09-11T23:17:58.643771+0000","last_peered":"2024-09-11T23:17:58.643771+0000","last_clean":"2024-09-11T23:17:58.643771+0000","last_became_active":"2024-09-11T23:17:58.639333+0000","last_became_peered":"2024-09-11T23:17:58.639333+0000","last_unstale":"2024-09-11T23:17:58.643771+0000","last_undegraded":"2024-09-11T23:17:58.643771+0000","last_fullsized":"2024-09-11T23:17:58.643771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:09.475238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669868+0000","last_change":"2024-09-11T23:17:59.643630+0000","last_active":"2024-09-11T23:18:00.669868+0000","last_peered":"2024-09-11T23:18:00.669868+0000","last_clean":"2024-09-11T23:18:00.669868+0000","last_became_active":"2024-09-11T23:17:59.643080+0000","last_became_peered":"2024-09-11T23:17:59.643080+0000","last_unstale":"2024-09-11T23:18:00.669868+0000","last_undegraded":"2024-09-11T23:18:00.669868+0000","last_fullsized":"2024-09-11T23:18:00.669868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:59.272347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.635394+0000","last_change":"2024-09-11T23:17:58.634155+0000","last_active":"2024-09-11T23:17:58.635394+0000","last_peered":"2024-09-11T23:17:58.635394+0000","last_clean":"2024-09-11T23:17:58.635394+0000","last_became_active":"2024-09-11T23:17:58.633898+0000","last_became_peered":"2024-09-11T23:17:58.633898+0000","last_unstale":"2024-09-11T23:17:58.635394+0000","last_undegraded":"2024-09-11T23:17:58.635394+0000","last_fullsized":"2024-09-11T23:17:58.635394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:48.388069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670728+0000","last_change":"2024-09-11T23:17:59.648274+0000","last_active":"2024-09-11T23:18:00.670728+0000","last_peered":"2024-09-11T23:18:00.670728+0000","last_clean":"2024-09-11T23:18:00.670728+0000","last_became_active":"2024-09-11T23:17:59.646482+0000","last_became_peered":"2024-09-11T23:17:59.646482+0000","last_unstale":"2024-09-11T23:18:00.670728+0000","last_undegraded":"2024-09-11T23:18:00.670728+0000","last_fullsized":"2024-09-11T23:18:00.670728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:06.041413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.672611+0000","last_change":"2024-09-11T23:17:58.644868+0000","last_active":"2024-09-11T23:17:59.672611+0000","last_peered":"2024-09-11T23:17:59.672611+0000","last_clean":"2024-09-11T23:17:59.672611+0000","last_became_active":"2024-09-11T23:17:58.644006+0000","last_became_peered":"2024-09-11T23:17:58.644006+0000","last_unstale":"2024-09-11T23:17:59.672611+0000","last_undegraded":"2024-09-11T23:17:59.672611+0000","last_fullsized":"2024-09-11T23:17:59.672611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:23.261838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.653889+0000","last_change":"2024-09-11T23:17:59.642489+0000","last_active":"2024-09-11T23:17:59.653889+0000","last_peered":"2024-09-11T23:17:59.653889+0000","last_clean":"2024-09-11T23:17:59.653889+0000","last_became_active":"2024-09-11T23:17:59.642155+0000","last_became_peered":"2024-09-11T23:17:59.642155+0000","last_unstale":"2024-09-11T23:17:59.653889+0000","last_undegraded":"2024-09-11T23:17:59.653889+0000","last_fullsized":"2024-09-11T23:17:59.653889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:57.703691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.644464+0000","last_change":"2024-09-11T23:17:59.636661+0000","last_active":"2024-09-11T23:17:59.644464+0000","last_peered":"2024-09-11T23:17:59.644464+0000","last_clean":"2024-09-11T23:17:59.644464+0000","last_became_active":"2024-09-11T23:17:59.635613+0000","last_became_peered":"2024-09-11T23:17:59.635613+0000","last_unstale":"2024-09-11T23:17:59.644464+0000","last_undegraded":"2024-09-11T23:17:59.644464+0000","last_fullsized":"2024-09-11T23:17:59.644464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:57.703691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.672563+0000","last_change":"2024-09-11T23:17:58.646998+0000","last_active":"2024-09-11T23:17:59.672563+0000","last_peered":"2024-09-11T23:17:59.672563+0000","last_clean":"2024-09-11T23:17:59.672563+0000","last_became_active":"2024-09-11T23:17:58.646666+0000","last_became_peered":"2024-09-11T23:17:58.646666+0000","last_unstale":"2024-09-11T23:17:59.672563+0000","last_undegraded":"2024-09-11T23:17:59.672563+0000","last_fullsized":"2024-09-11T23:17:59.672563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:57.415598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.652120+0000","last_change":"2024-09-11T23:17:59.637292+0000","last_active":"2024-09-11T23:17:59.652120+0000","last_peered":"2024-09-11T23:17:59.652120+0000","last_clean":"2024-09-11T23:17:59.652120+0000","last_became_active":"2024-09-11T23:17:59.637028+0000","last_became_peered":"2024-09-11T23:17:59.637028+0000","last_unstale":"2024-09-11T23:17:59.652120+0000","last_undegraded":"2024-09-11T23:17:59.652120+0000","last_fullsized":"2024-09-11T23:17:59.652120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:30.915550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.673779+0000","last_change":"2024-09-11T23:17:58.641586+0000","last_active":"2024-09-11T23:17:59.673779+0000","last_peered":"2024-09-11T23:17:59.673779+0000","last_clean":"2024-09-11T23:17:59.673779+0000","last_became_active":"2024-09-11T23:17:58.636670+0000","last_became_peered":"2024-09-11T23:17:58.636670+0000","last_unstale":"2024-09-11T23:17:59.673779+0000","last_undegraded":"2024-09-11T23:17:59.673779+0000","last_fullsized":"2024-09-11T23:17:59.673779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:49.590126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.624249+0000","last_change":"2024-09-11T23:17:58.624249+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.624249+0000","last_undegraded":"2024-09-11T23:17:58.624249+0000","last_fullsized":"2024-09-11T23:17:58.624249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671062+0000","last_change":"2024-09-11T23:17:58.646365+0000","last_active":"2024-09-11T23:18:00.671062+0000","last_peered":"2024-09-11T23:18:00.671062+0000","last_clean":"2024-09-11T23:18:00.671062+0000","last_became_active":"2024-09-11T23:17:58.646119+0000","last_became_peered":"2024-09-11T23:17:58.646119+0000","last_unstale":"2024-09-11T23:18:00.671062+0000","last_undegraded":"2024-09-11T23:18:00.671062+0000","last_fullsized":"2024-09-11T23:18:00.671062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:12.634428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670990+0000","last_change":"2024-09-11T23:17:59.654946+0000","last_active":"2024-09-11T23:18:00.670990+0000","last_peered":"2024-09-11T23:18:00.670990+0000","last_clean":"2024-09-11T23:18:00.670990+0000","last_became_active":"2024-09-11T23:17:59.654732+0000","last_became_peered":"2024-09-11T23:17:59.654732+0000","last_unstale":"2024-09-11T23:18:00.670990+0000","last_undegraded":"2024-09-11T23:18:00.670990+0000","last_fullsized":"2024-09-11T23:18:00.670990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:28.095341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.645310+0000","last_change":"2024-09-11T23:17:58.638337+0000","last_active":"2024-09-11T23:17:58.645310+0000","last_peered":"2024-09-11T23:17:58.645310+0000","last_clean":"2024-09-11T23:17:58.645310+0000","last_became_active":"2024-09-11T23:17:58.638071+0000","last_became_peered":"2024-09-11T23:17:58.638071+0000","last_unstale":"2024-09-11T23:17:58.645310+0000","last_undegraded":"2024-09-11T23:17:58.645310+0000","last_fullsized":"2024-09-11T23:17:58.645310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:44.209956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476742,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":653205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476741,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":62837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":62837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":62837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":180224,"data_stored":56562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":646930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":77524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":75912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:18:03.804 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:18:03.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.992+0000 7f9a0b200640 1 Processor -- start 2024-09-11T23:18:03.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.993+0000 7f9a0b200640 1 -- start start 2024-09-11T23:18:03.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.994+0000 7f9a0b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9a0c15e640 0x7f9a0c0d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.994+0000 7f9a0b200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9a0c0b66e0 0x7f9a0c0b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:03.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.994+0000 7f9a0b200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a0c06bee0 con 0x7f9a0c0d3f60 2024-09-11T23:18:03.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.994+0000 7f9a0b200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9a0c15ea20 con 0x7f9a0c0b66e0 2024-09-11T23:18:03.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.994+0000 7f9a0b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9a0c06caf0 con 0x7f9a0c15e640 2024-09-11T23:18:03.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.994+0000 7f9a09400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9a0c0d3f60 0x7f9a0c0b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55930/0 (socket says 172.21.15.144:55930) 2024-09-11T23:18:03.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.994+0000 7f9a09400640 1 -- 172.21.15.144:0/433093119 learned_addr learned my addr 172.21.15.144:0/433093119 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:03.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.994+0000 7f9a0a800640 1 --2- 172.21.15.144:0/433093119 >> v2:172.21.15.144:3300/0 conn(0x7f9a0c0b66e0 0x7f9a0c0b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:03.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.994+0000 7f9a09e00640 1 --2- 172.21.15.144:0/433093119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9a0c15e640 0x7f9a0c0d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:03.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.994+0000 7f9a08a00640 1 -- 172.21.15.144:0/433093119 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2211441073 0 0) 0x7f9a0c06bee0 con 0x7f9a0c0d3f60 2024-09-11T23:18:03.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.995+0000 7f9a08a00640 1 -- 172.21.15.144:0/433093119 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99f0003520 con 0x7f9a0c0d3f60 2024-09-11T23:18:03.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.995+0000 7f9a0a800640 1 -- 172.21.15.144:0/433093119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9a0c15e640 msgr2=0x7f9a0c0d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:03.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.995+0000 7f9a0a800640 1 --2- 172.21.15.144:0/433093119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9a0c15e640 0x7f9a0c0d3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.995+0000 7f9a0a800640 1 -- 172.21.15.144:0/433093119 >> v1:172.21.15.144:6789/0 conn(0x7f9a0c0d3f60 legacy=0x7f9a0c0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.995+0000 7f9a0a800640 1 -- 172.21.15.144:0/433093119 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a0c06c1c0 con 0x7f9a0c0b66e0 2024-09-11T23:18:03.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.996+0000 7f9a0a800640 1 --2- 172.21.15.144:0/433093119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a0c0b66e0 0x7f9a0c0b7750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009d90 tx=0x7f9a0402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9416ee5e8a9da643 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:03.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.996+0000 7f9a08a00640 1 -- 172.21.15.144:0/433093119 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a04007740 con 0x7f9a0c0b66e0 2024-09-11T23:18:03.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.996+0000 7f9a08a00640 1 -- 172.21.15.144:0/433093119 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a040078e0 con 0x7f9a0c0b66e0 2024-09-11T23:18:03.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.996+0000 7f9a08a00640 1 -- 172.21.15.144:0/433093119 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a04007cb0 con 0x7f9a0c0b66e0 2024-09-11T23:18:03.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.996+0000 7f9a0b200640 1 -- 172.21.15.144:0/433093119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a0c0b66e0 msgr2=0x7f9a0c0b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:03.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.996+0000 7f9a0b200640 1 --2- 172.21.15.144:0/433093119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a0c0b66e0 0x7f9a0c0b7750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009d90 tx=0x7f9a0402a660 comp rx=0 tx=0).stop 2024-09-11T23:18:03.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.997+0000 7f9a0b200640 1 -- 172.21.15.144:0/433093119 shutdown_connections 2024-09-11T23:18:03.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.997+0000 7f9a0b200640 1 --2- 172.21.15.144:0/433093119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a0c0b66e0 0x7f9a0c0b7750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.997+0000 7f9a0b200640 1 --2- 172.21.15.144:0/433093119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9a0c15e640 0x7f9a0c0d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:03.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.997+0000 7f9a0b200640 1 -- 172.21.15.144:0/433093119 >> 172.21.15.144:0/433093119 conn(0x7f9a0c0d0fd0 msgr2=0x7f9a0c0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:03.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.997+0000 7f9a0b200640 1 -- 172.21.15.144:0/433093119 shutdown_connections 2024-09-11T23:18:03.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.997+0000 7f9a0b200640 1 -- 172.21.15.144:0/433093119 wait complete. 2024-09-11T23:18:03.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.998+0000 7f9a0b200640 1 Processor -- start 2024-09-11T23:18:03.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.998+0000 7f9a0b200640 1 -- start start 2024-09-11T23:18:04.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.999+0000 7f9a0b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a0c0b66e0 0x7f9a0c15c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.999+0000 7f9a0b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a0c0d3f60 0x7f9a0c0aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.999+0000 7f9a0b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9a0c15e640 0x7f9a0c0b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.999+0000 7f9a0b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c0b7c90 con 0x7f9a0c0d3f60 2024-09-11T23:18:04.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.999+0000 7f9a0b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c06c780 con 0x7f9a0c0b66e0 2024-09-11T23:18:04.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.999+0000 7f9a0b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9a0c0b7e10 con 0x7f9a0c15e640 2024-09-11T23:18:04.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:03.999+0000 7f9a09400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a0c0d3f60 0x7f9a0c0aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.000+0000 7f9a09400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a0c0d3f60 0x7f9a0c0aafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38452/0 (socket says 172.21.15.144:38452) 2024-09-11T23:18:04.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.000+0000 7f9a09400640 1 -- 172.21.15.144:0/1766260634 learned_addr learned my addr 172.21.15.144:0/1766260634 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:04.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.000+0000 7f9a0a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9a0c15e640 0x7f9a0c0b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.000+0000 7f9a09e00640 1 --2- 172.21.15.144:0/1766260634 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a0c0b66e0 0x7f9a0c15c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.000+0000 7f9a09400640 1 -- 172.21.15.144:0/1766260634 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9a0c15e640 msgr2=0x7f9a0c0b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.000+0000 7f9a09400640 1 --2- 172.21.15.144:0/1766260634 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9a0c15e640 0x7f9a0c0b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.000+0000 7f9a09400640 1 -- 172.21.15.144:0/1766260634 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a0c0b66e0 msgr2=0x7f9a0c15c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.000+0000 7f9a09400640 1 --2- 172.21.15.144:0/1766260634 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a0c0b66e0 0x7f9a0c15c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.000+0000 7f9a09400640 1 -- 172.21.15.144:0/1766260634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a0c1f4320 con 0x7f9a0c0d3f60 2024-09-11T23:18:04.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.000+0000 7f9a09400640 1 --2- 172.21.15.144:0/1766260634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a0c0d3f60 0x7f9a0c0aafb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f99f800c430 tx=0x7f99f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:04.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.000+0000 7f9a02000640 1 -- 172.21.15.144:0/1766260634 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f8017070 con 0x7f9a0c0d3f60 2024-09-11T23:18:04.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.000+0000 7f9a02000640 1 -- 172.21.15.144:0/1766260634 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99f8005d00 con 0x7f9a0c0d3f60 2024-09-11T23:18:04.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.000+0000 7f9a0b200640 1 -- 172.21.15.144:0/1766260634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a0c1f45c0 con 0x7f9a0c0d3f60 2024-09-11T23:18:04.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.000+0000 7f9a02000640 1 -- 172.21.15.144:0/1766260634 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f8007310 con 0x7f9a0c0d3f60 2024-09-11T23:18:04.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.001+0000 7f9a0b200640 1 -- 172.21.15.144:0/1766260634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a0c1f4e60 con 0x7f9a0c0d3f60 2024-09-11T23:18:04.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.002+0000 7f9a0b200640 1 -- 172.21.15.144:0/1766260634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a0c1f4790 con 0x7f9a0c0d3f60 2024-09-11T23:18:04.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.002+0000 7f9a02000640 1 -- 172.21.15.144:0/1766260634 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f99f801a070 con 0x7f9a0c0d3f60 2024-09-11T23:18:04.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.003+0000 7f9a02000640 1 --2- 172.21.15.144:0/1766260634 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f99ec06be30 0x7f99ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.004+0000 7f9a02000640 1 -- 172.21.15.144:0/1766260634 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f99f808a2b0 con 0x7f9a0c0d3f60 2024-09-11T23:18:04.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.004+0000 7f9a09e00640 1 --2- 172.21.15.144:0/1766260634 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f99ec06be30 0x7f99ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.004+0000 7f9a09e00640 1 --2- 172.21.15.144:0/1766260634 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f99ec06be30 0x7f99ec06e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009aa0 tx=0x7f99fc009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:04.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.008+0000 7f9a02000640 1 -- 172.21.15.144:0/1766260634 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f99f8058570 con 0x7f9a0c0d3f60 2024-09-11T23:18:04.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.180+0000 7f9a0b200640 1 -- 172.21.15.144:0/1766260634 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9a0c0b7750 con 0x7f99ec06be30 2024-09-11T23:18:04.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.186+0000 7f9a02000640 1 -- 172.21.15.144:0/1766260634 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250578 (secure 0 0 0) 0x7f9a0c0b7750 con 0x7f99ec06be30 2024-09-11T23:18:04.190 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:04.191 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:18:04.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.190+0000 7f9a0b200640 1 -- 172.21.15.144:0/1766260634 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f99ec06be30 msgr2=0x7f99ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.190+0000 7f9a0b200640 1 --2- 172.21.15.144:0/1766260634 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f99ec06be30 0x7f99ec06e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009aa0 tx=0x7f99fc009190 comp rx=0 tx=0).stop 2024-09-11T23:18:04.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.190+0000 7f9a0b200640 1 -- 172.21.15.144:0/1766260634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a0c0d3f60 msgr2=0x7f9a0c0aafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.190+0000 7f9a0b200640 1 --2- 172.21.15.144:0/1766260634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a0c0d3f60 0x7f9a0c0aafb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f99f800c430 tx=0x7f99f800c8f0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.190+0000 7f9a0b200640 1 -- 172.21.15.144:0/1766260634 shutdown_connections 2024-09-11T23:18:04.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.190+0000 7f9a0b200640 1 --2- 172.21.15.144:0/1766260634 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f99ec06be30 0x7f99ec06e2f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.190+0000 7f9a0b200640 1 --2- 172.21.15.144:0/1766260634 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9a0c15e640 0x7f9a0c0b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.190+0000 7f9a0b200640 1 --2- 172.21.15.144:0/1766260634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a0c0d3f60 0x7f9a0c0aafb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.190+0000 7f9a0b200640 1 --2- 172.21.15.144:0/1766260634 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a0c0b66e0 0x7f9a0c15c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.190+0000 7f9a0b200640 1 -- 172.21.15.144:0/1766260634 >> 172.21.15.144:0/1766260634 conn(0x7f9a0c0d0fd0 msgr2=0x7f9a0c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:04.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.190+0000 7f9a0b200640 1 -- 172.21.15.144:0/1766260634 shutdown_connections 2024-09-11T23:18:04.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.190+0000 7f9a0b200640 1 -- 172.21.15.144:0/1766260634 wait complete. 2024-09-11T23:18:04.207 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-11T23:18:03.162658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218944,"kb_used_data":2700,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755776,"statfs":{"total":773094113280,"available":772869914624,"internally_reserved":0,"allocated":2764800,"data_stored":1698644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.551102"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.658019+0000","last_change":"2024-09-11T23:17:59.655120+0000","last_active":"2024-09-11T23:17:59.658019+0000","last_peered":"2024-09-11T23:17:59.658019+0000","last_clean":"2024-09-11T23:17:59.658019+0000","last_became_active":"2024-09-11T23:17:59.654860+0000","last_became_peered":"2024-09-11T23:17:59.654860+0000","last_unstale":"2024-09-11T23:17:59.658019+0000","last_undegraded":"2024-09-11T23:17:59.658019+0000","last_fullsized":"2024-09-11T23:17:59.658019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:36.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.622794+0000","last_change":"2024-09-11T23:17:58.622794+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.622794+0000","last_undegraded":"2024-09-11T23:17:58.622794+0000","last_fullsized":"2024-09-11T23:17:58.622794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.629373+0000","last_change":"2024-09-11T23:17:58.629373+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.629373+0000","last_undegraded":"2024-09-11T23:17:58.629373+0000","last_fullsized":"2024-09-11T23:17:58.629373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.652162+0000","last_change":"2024-09-11T23:17:59.644202+0000","last_active":"2024-09-11T23:17:59.652162+0000","last_peered":"2024-09-11T23:17:59.652162+0000","last_clean":"2024-09-11T23:17:59.652162+0000","last_became_active":"2024-09-11T23:17:59.643634+0000","last_became_peered":"2024-09-11T23:17:59.643634+0000","last_unstale":"2024-09-11T23:17:59.652162+0000","last_undegraded":"2024-09-11T23:17:59.652162+0000","last_fullsized":"2024-09-11T23:17:59.652162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:58.423622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.656950+0000","last_change":"2024-09-11T23:17:59.652783+0000","last_active":"2024-09-11T23:17:59.656950+0000","last_peered":"2024-09-11T23:17:59.656950+0000","last_clean":"2024-09-11T23:17:59.656950+0000","last_became_active":"2024-09-11T23:17:59.652508+0000","last_became_peered":"2024-09-11T23:17:59.652508+0000","last_unstale":"2024-09-11T23:17:59.656950+0000","last_undegraded":"2024-09-11T23:17:59.656950+0000","last_fullsized":"2024-09-11T23:17:59.656950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:15.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.668756+0000","last_change":"2024-09-11T23:17:59.659401+0000","last_active":"2024-09-11T23:17:59.668756+0000","last_peered":"2024-09-11T23:17:59.668756+0000","last_clean":"2024-09-11T23:17:59.668756+0000","last_became_active":"2024-09-11T23:17:59.655926+0000","last_became_peered":"2024-09-11T23:17:59.655926+0000","last_unstale":"2024-09-11T23:17:59.668756+0000","last_undegraded":"2024-09-11T23:17:59.668756+0000","last_fullsized":"2024-09-11T23:17:59.668756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:15.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.663103+0000","last_change":"2024-09-11T23:17:59.657900+0000","last_active":"2024-09-11T23:17:59.663103+0000","last_peered":"2024-09-11T23:17:59.663103+0000","last_clean":"2024-09-11T23:17:59.663103+0000","last_became_active":"2024-09-11T23:17:59.657621+0000","last_became_peered":"2024-09-11T23:17:59.657621+0000","last_unstale":"2024-09-11T23:17:59.663103+0000","last_undegraded":"2024-09-11T23:17:59.663103+0000","last_fullsized":"2024-09-11T23:17:59.663103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:05.705455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669094+0000","last_change":"2024-09-11T23:17:59.643006+0000","last_active":"2024-09-11T23:18:00.669094+0000","last_peered":"2024-09-11T23:18:00.669094+0000","last_clean":"2024-09-11T23:18:00.669094+0000","last_became_active":"2024-09-11T23:17:59.642338+0000","last_became_peered":"2024-09-11T23:17:59.642338+0000","last_unstale":"2024-09-11T23:18:00.669094+0000","last_undegraded":"2024-09-11T23:18:00.669094+0000","last_fullsized":"2024-09-11T23:18:00.669094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:29.873658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.676196+0000","last_change":"2024-09-11T23:17:59.671758+0000","last_active":"2024-09-11T23:17:59.676196+0000","last_peered":"2024-09-11T23:17:59.676196+0000","last_clean":"2024-09-11T23:17:59.676196+0000","last_became_active":"2024-09-11T23:17:59.671418+0000","last_became_peered":"2024-09-11T23:17:59.671418+0000","last_unstale":"2024-09-11T23:17:59.676196+0000","last_undegraded":"2024-09-11T23:17:59.676196+0000","last_fullsized":"2024-09-11T23:17:59.676196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:38.039621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.660447+0000","last_change":"2024-09-11T23:17:59.656199+0000","last_active":"2024-09-11T23:17:59.660447+0000","last_peered":"2024-09-11T23:17:59.660447+0000","last_clean":"2024-09-11T23:17:59.660447+0000","last_became_active":"2024-09-11T23:17:59.655919+0000","last_became_peered":"2024-09-11T23:17:59.655919+0000","last_unstale":"2024-09-11T23:17:59.660447+0000","last_undegraded":"2024-09-11T23:17:59.660447+0000","last_fullsized":"2024-09-11T23:17:59.660447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:31.650891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.654496+0000","last_change":"2024-09-11T23:17:59.646129+0000","last_active":"2024-09-11T23:17:59.654496+0000","last_peered":"2024-09-11T23:17:59.654496+0000","last_clean":"2024-09-11T23:17:59.654496+0000","last_became_active":"2024-09-11T23:17:59.645346+0000","last_became_peered":"2024-09-11T23:17:59.645346+0000","last_unstale":"2024-09-11T23:17:59.654496+0000","last_undegraded":"2024-09-11T23:17:59.654496+0000","last_fullsized":"2024-09-11T23:17:59.654496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:05.573887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.651766+0000","last_change":"2024-09-11T23:17:59.642874+0000","last_active":"2024-09-11T23:17:59.651766+0000","last_peered":"2024-09-11T23:17:59.651766+0000","last_clean":"2024-09-11T23:17:59.651766+0000","last_became_active":"2024-09-11T23:17:59.642586+0000","last_became_peered":"2024-09-11T23:17:59.642586+0000","last_unstale":"2024-09-11T23:17:59.651766+0000","last_undegraded":"2024-09-11T23:17:59.651766+0000","last_fullsized":"2024-09-11T23:17:59.651766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:24.114060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670655+0000","last_change":"2024-09-11T23:17:59.644814+0000","last_active":"2024-09-11T23:18:00.670655+0000","last_peered":"2024-09-11T23:18:00.670655+0000","last_clean":"2024-09-11T23:18:00.670655+0000","last_became_active":"2024-09-11T23:17:59.643305+0000","last_became_peered":"2024-09-11T23:17:59.643305+0000","last_unstale":"2024-09-11T23:18:00.670655+0000","last_undegraded":"2024-09-11T23:18:00.670655+0000","last_fullsized":"2024-09-11T23:18:00.670655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:29.321395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.630283+0000","last_change":"2024-09-11T23:17:58.630283+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.630283+0000","last_undegraded":"2024-09-11T23:17:58.630283+0000","last_fullsized":"2024-09-11T23:17:58.630283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.620642+0000","last_change":"2024-09-11T23:17:58.620642+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.620642+0000","last_undegraded":"2024-09-11T23:17:58.620642+0000","last_fullsized":"2024-09-11T23:17:58.620642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.656386+0000","last_change":"2024-09-11T23:17:59.653627+0000","last_active":"2024-09-11T23:17:59.656386+0000","last_peered":"2024-09-11T23:17:59.656386+0000","last_clean":"2024-09-11T23:17:59.656386+0000","last_became_active":"2024-09-11T23:17:59.653088+0000","last_became_peered":"2024-09-11T23:17:59.653088+0000","last_unstale":"2024-09-11T23:17:59.656386+0000","last_undegraded":"2024-09-11T23:17:59.656386+0000","last_fullsized":"2024-09-11T23:17:59.656386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:24.269862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.668387+0000","last_change":"2024-09-11T23:17:59.660074+0000","last_active":"2024-09-11T23:17:59.668387+0000","last_peered":"2024-09-11T23:17:59.668387+0000","last_clean":"2024-09-11T23:17:59.668387+0000","last_became_active":"2024-09-11T23:17:59.659174+0000","last_became_peered":"2024-09-11T23:17:59.659174+0000","last_unstale":"2024-09-11T23:17:59.668387+0000","last_undegraded":"2024-09-11T23:17:59.668387+0000","last_fullsized":"2024-09-11T23:17:59.668387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:36.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669448+0000","last_change":"2024-09-11T23:17:59.641202+0000","last_active":"2024-09-11T23:18:00.669448+0000","last_peered":"2024-09-11T23:18:00.669448+0000","last_clean":"2024-09-11T23:18:00.669448+0000","last_became_active":"2024-09-11T23:17:59.640609+0000","last_became_peered":"2024-09-11T23:17:59.640609+0000","last_unstale":"2024-09-11T23:18:00.669448+0000","last_undegraded":"2024-09-11T23:18:00.669448+0000","last_fullsized":"2024-09-11T23:18:00.669448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:34.428505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.657378+0000","last_change":"2024-09-11T23:17:59.654884+0000","last_active":"2024-09-11T23:17:59.657378+0000","last_peered":"2024-09-11T23:17:59.657378+0000","last_clean":"2024-09-11T23:17:59.657378+0000","last_became_active":"2024-09-11T23:17:59.654578+0000","last_became_peered":"2024-09-11T23:17:59.654578+0000","last_unstale":"2024-09-11T23:17:59.657378+0000","last_undegraded":"2024-09-11T23:17:59.657378+0000","last_fullsized":"2024-09-11T23:17:59.657378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.193032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.654318+0000","last_change":"2024-09-11T23:17:59.643411+0000","last_active":"2024-09-11T23:17:59.654318+0000","last_peered":"2024-09-11T23:17:59.654318+0000","last_clean":"2024-09-11T23:17:59.654318+0000","last_became_active":"2024-09-11T23:17:59.643076+0000","last_became_peered":"2024-09-11T23:17:59.643076+0000","last_unstale":"2024-09-11T23:17:59.654318+0000","last_undegraded":"2024-09-11T23:17:59.654318+0000","last_fullsized":"2024-09-11T23:17:59.654318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:30.915550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.628788+0000","last_change":"2024-09-11T23:17:58.628788+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.628788+0000","last_undegraded":"2024-09-11T23:17:58.628788+0000","last_fullsized":"2024-09-11T23:17:58.628788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.672101+0000","last_change":"2024-09-11T23:17:59.666448+0000","last_active":"2024-09-11T23:17:59.672101+0000","last_peered":"2024-09-11T23:17:59.672101+0000","last_clean":"2024-09-11T23:17:59.672101+0000","last_became_active":"2024-09-11T23:17:59.664741+0000","last_became_peered":"2024-09-11T23:17:59.664741+0000","last_unstale":"2024-09-11T23:17:59.672101+0000","last_undegraded":"2024-09-11T23:17:59.672101+0000","last_fullsized":"2024-09-11T23:17:59.672101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:05.705455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670229+0000","last_change":"2024-09-11T23:17:59.645036+0000","last_active":"2024-09-11T23:18:00.670229+0000","last_peered":"2024-09-11T23:18:00.670229+0000","last_clean":"2024-09-11T23:18:00.670229+0000","last_became_active":"2024-09-11T23:17:59.644706+0000","last_became_peered":"2024-09-11T23:17:59.644706+0000","last_unstale":"2024-09-11T23:18:00.670229+0000","last_undegraded":"2024-09-11T23:18:00.670229+0000","last_fullsized":"2024-09-11T23:18:00.670229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:04.266917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.656360+0000","last_change":"2024-09-11T23:17:59.653352+0000","last_active":"2024-09-11T23:17:59.656360+0000","last_peered":"2024-09-11T23:17:59.656360+0000","last_clean":"2024-09-11T23:17:59.656360+0000","last_became_active":"2024-09-11T23:17:59.652470+0000","last_became_peered":"2024-09-11T23:17:59.652470+0000","last_unstale":"2024-09-11T23:17:59.656360+0000","last_undegraded":"2024-09-11T23:17:59.656360+0000","last_fullsized":"2024-09-11T23:17:59.656360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:50.598149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671014+0000","last_change":"2024-09-11T23:17:59.662259+0000","last_active":"2024-09-11T23:18:00.671014+0000","last_peered":"2024-09-11T23:18:00.671014+0000","last_clean":"2024-09-11T23:18:00.671014+0000","last_became_active":"2024-09-11T23:17:59.662031+0000","last_became_peered":"2024-09-11T23:17:59.662031+0000","last_unstale":"2024-09-11T23:18:00.671014+0000","last_undegraded":"2024-09-11T23:18:00.671014+0000","last_fullsized":"2024-09-11T23:18:00.671014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:34.160365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.654388+0000","last_change":"2024-09-11T23:17:59.650797+0000","last_active":"2024-09-11T23:17:59.654388+0000","last_peered":"2024-09-11T23:17:59.654388+0000","last_clean":"2024-09-11T23:17:59.654388+0000","last_became_active":"2024-09-11T23:17:59.650548+0000","last_became_peered":"2024-09-11T23:17:59.650548+0000","last_unstale":"2024-09-11T23:17:59.654388+0000","last_undegraded":"2024-09-11T23:17:59.654388+0000","last_fullsized":"2024-09-11T23:17:59.654388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:24.269862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.621631+0000","last_change":"2024-09-11T23:17:58.621631+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.621631+0000","last_undegraded":"2024-09-11T23:17:58.621631+0000","last_fullsized":"2024-09-11T23:17:58.621631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670965+0000","last_change":"2024-09-11T23:17:59.644063+0000","last_active":"2024-09-11T23:18:00.670965+0000","last_peered":"2024-09-11T23:18:00.670965+0000","last_clean":"2024-09-11T23:18:00.670965+0000","last_became_active":"2024-09-11T23:17:59.643760+0000","last_became_peered":"2024-09-11T23:17:59.643760+0000","last_unstale":"2024-09-11T23:18:00.670965+0000","last_undegraded":"2024-09-11T23:18:00.670965+0000","last_fullsized":"2024-09-11T23:18:00.670965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:31.141907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.628159+0000","last_change":"2024-09-11T23:17:58.628159+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.628159+0000","last_undegraded":"2024-09-11T23:17:58.628159+0000","last_fullsized":"2024-09-11T23:17:58.628159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.668741+0000","last_change":"2024-09-11T23:17:59.657821+0000","last_active":"2024-09-11T23:17:59.668741+0000","last_peered":"2024-09-11T23:17:59.668741+0000","last_clean":"2024-09-11T23:17:59.668741+0000","last_became_active":"2024-09-11T23:17:59.645334+0000","last_became_peered":"2024-09-11T23:17:59.645334+0000","last_unstale":"2024-09-11T23:17:59.668741+0000","last_undegraded":"2024-09-11T23:17:59.668741+0000","last_fullsized":"2024-09-11T23:17:59.668741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:31.650891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669574+0000","last_change":"2024-09-11T23:17:59.636987+0000","last_active":"2024-09-11T23:18:00.669574+0000","last_peered":"2024-09-11T23:18:00.669574+0000","last_clean":"2024-09-11T23:18:00.669574+0000","last_became_active":"2024-09-11T23:17:59.636762+0000","last_became_peered":"2024-09-11T23:17:59.636762+0000","last_unstale":"2024-09-11T23:18:00.669574+0000","last_undegraded":"2024-09-11T23:18:00.669574+0000","last_fullsized":"2024-09-11T23:18:00.669574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:10.353893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.654188+0000","last_change":"2024-09-11T23:17:59.648354+0000","last_active":"2024-09-11T23:17:59.654188+0000","last_peered":"2024-09-11T23:17:59.654188+0000","last_clean":"2024-09-11T23:17:59.654188+0000","last_became_active":"2024-09-11T23:17:59.646693+0000","last_became_peered":"2024-09-11T23:17:59.646693+0000","last_unstale":"2024-09-11T23:17:59.654188+0000","last_undegraded":"2024-09-11T23:17:59.654188+0000","last_fullsized":"2024-09-11T23:17:59.654188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:58.423622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.642173+0000","last_change":"2024-09-11T23:17:59.637101+0000","last_active":"2024-09-11T23:17:59.642173+0000","last_peered":"2024-09-11T23:17:59.642173+0000","last_clean":"2024-09-11T23:17:59.642173+0000","last_became_active":"2024-09-11T23:17:59.635407+0000","last_became_peered":"2024-09-11T23:17:59.635407+0000","last_unstale":"2024-09-11T23:17:59.642173+0000","last_undegraded":"2024-09-11T23:17:59.642173+0000","last_fullsized":"2024-09-11T23:17:59.642173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:10.483262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670769+0000","last_change":"2024-09-11T23:17:58.642664+0000","last_active":"2024-09-11T23:18:00.670769+0000","last_peered":"2024-09-11T23:18:00.670769+0000","last_clean":"2024-09-11T23:18:00.670769+0000","last_became_active":"2024-09-11T23:17:58.642371+0000","last_became_peered":"2024-09-11T23:17:58.642371+0000","last_unstale":"2024-09-11T23:18:00.670769+0000","last_undegraded":"2024-09-11T23:18:00.670769+0000","last_fullsized":"2024-09-11T23:18:00.670769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:31.214611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.620315+0000","last_change":"2024-09-11T23:17:58.620315+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.620315+0000","last_undegraded":"2024-09-11T23:17:58.620315+0000","last_fullsized":"2024-09-11T23:17:58.620315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.669118+0000","last_change":"2024-09-11T23:17:58.640442+0000","last_active":"2024-09-11T23:17:59.669118+0000","last_peered":"2024-09-11T23:17:59.669118+0000","last_clean":"2024-09-11T23:17:59.669118+0000","last_became_active":"2024-09-11T23:17:58.640148+0000","last_became_peered":"2024-09-11T23:17:58.640148+0000","last_unstale":"2024-09-11T23:17:59.669118+0000","last_undegraded":"2024-09-11T23:17:59.669118+0000","last_fullsized":"2024-09-11T23:17:59.669118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:02.505670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670322+0000","last_change":"2024-09-11T23:17:58.640181+0000","last_active":"2024-09-11T23:18:00.670322+0000","last_peered":"2024-09-11T23:18:00.670322+0000","last_clean":"2024-09-11T23:18:00.670322+0000","last_became_active":"2024-09-11T23:17:58.639944+0000","last_became_peered":"2024-09-11T23:17:58.639944+0000","last_unstale":"2024-09-11T23:18:00.670322+0000","last_undegraded":"2024-09-11T23:18:00.670322+0000","last_fullsized":"2024-09-11T23:18:00.670322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:02.827617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669793+0000","last_change":"2024-09-11T23:17:59.643922+0000","last_active":"2024-09-11T23:18:00.669793+0000","last_peered":"2024-09-11T23:18:00.669793+0000","last_clean":"2024-09-11T23:18:00.669793+0000","last_became_active":"2024-09-11T23:17:59.643613+0000","last_became_peered":"2024-09-11T23:17:59.643613+0000","last_unstale":"2024-09-11T23:18:00.669793+0000","last_undegraded":"2024-09-11T23:18:00.669793+0000","last_fullsized":"2024-09-11T23:18:00.669793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:31.792631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.627116+0000","last_change":"2024-09-11T23:17:58.640428+0000","last_active":"2024-09-11T23:17:59.627116+0000","last_peered":"2024-09-11T23:17:59.627116+0000","last_clean":"2024-09-11T23:17:59.627116+0000","last_became_active":"2024-09-11T23:17:58.639860+0000","last_became_peered":"2024-09-11T23:17:58.639860+0000","last_unstale":"2024-09-11T23:17:59.627116+0000","last_undegraded":"2024-09-11T23:17:59.627116+0000","last_fullsized":"2024-09-11T23:17:59.627116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.621139+0000","last_change":"2024-09-11T23:17:58.621139+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.621139+0000","last_undegraded":"2024-09-11T23:17:58.621139+0000","last_fullsized":"2024-09-11T23:17:58.621139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.636665+0000","last_change":"2024-09-11T23:17:58.645977+0000","last_active":"2024-09-11T23:17:59.636665+0000","last_peered":"2024-09-11T23:17:59.636665+0000","last_clean":"2024-09-11T23:17:59.636665+0000","last_became_active":"2024-09-11T23:17:58.645482+0000","last_became_peered":"2024-09-11T23:17:58.645482+0000","last_unstale":"2024-09-11T23:17:59.636665+0000","last_undegraded":"2024-09-11T23:17:59.636665+0000","last_fullsized":"2024-09-11T23:17:59.636665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:31.277023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.668608+0000","last_change":"2024-09-11T23:17:59.658501+0000","last_active":"2024-09-11T23:17:59.668608+0000","last_peered":"2024-09-11T23:17:59.668608+0000","last_clean":"2024-09-11T23:17:59.668608+0000","last_became_active":"2024-09-11T23:17:59.658268+0000","last_became_peered":"2024-09-11T23:17:59.658268+0000","last_unstale":"2024-09-11T23:17:59.668608+0000","last_undegraded":"2024-09-11T23:17:59.668608+0000","last_fullsized":"2024-09-11T23:17:59.668608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:49.647417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.629883+0000","last_change":"2024-09-11T23:17:58.640356+0000","last_active":"2024-09-11T23:17:59.629883+0000","last_peered":"2024-09-11T23:17:59.629883+0000","last_clean":"2024-09-11T23:17:59.629883+0000","last_became_active":"2024-09-11T23:17:58.640060+0000","last_became_peered":"2024-09-11T23:17:58.640060+0000","last_unstale":"2024-09-11T23:17:59.629883+0000","last_undegraded":"2024-09-11T23:17:59.629883+0000","last_fullsized":"2024-09-11T23:17:59.629883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:31.277023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.619425+0000","last_change":"2024-09-11T23:17:58.619425+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.619425+0000","last_undegraded":"2024-09-11T23:17:58.619425+0000","last_fullsized":"2024-09-11T23:17:58.619425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.647001+0000","last_change":"2024-09-11T23:17:58.646012+0000","last_active":"2024-09-11T23:17:58.647001+0000","last_peered":"2024-09-11T23:17:58.647001+0000","last_clean":"2024-09-11T23:17:58.647001+0000","last_became_active":"2024-09-11T23:17:58.645093+0000","last_became_peered":"2024-09-11T23:17:58.645093+0000","last_unstale":"2024-09-11T23:17:58.647001+0000","last_undegraded":"2024-09-11T23:17:58.647001+0000","last_fullsized":"2024-09-11T23:17:58.647001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.660595+0000","last_change":"2024-09-11T23:17:59.653386+0000","last_active":"2024-09-11T23:17:59.660595+0000","last_peered":"2024-09-11T23:17:59.660595+0000","last_clean":"2024-09-11T23:17:59.660595+0000","last_became_active":"2024-09-11T23:17:59.653112+0000","last_became_peered":"2024-09-11T23:17:59.653112+0000","last_unstale":"2024-09-11T23:17:59.660595+0000","last_undegraded":"2024-09-11T23:17:59.660595+0000","last_fullsized":"2024-09-11T23:17:59.660595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:22.092955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.676373+0000","last_change":"2024-09-11T23:17:58.642732+0000","last_active":"2024-09-11T23:17:59.676373+0000","last_peered":"2024-09-11T23:17:59.676373+0000","last_clean":"2024-09-11T23:17:59.676373+0000","last_became_active":"2024-09-11T23:17:58.642411+0000","last_became_peered":"2024-09-11T23:17:58.642411+0000","last_unstale":"2024-09-11T23:17:59.676373+0000","last_undegraded":"2024-09-11T23:17:59.676373+0000","last_fullsized":"2024-09-11T23:17:59.676373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:21.084931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.656734+0000","last_change":"2024-09-11T23:17:59.652260+0000","last_active":"2024-09-11T23:17:59.656734+0000","last_peered":"2024-09-11T23:17:59.656734+0000","last_clean":"2024-09-11T23:17:59.656734+0000","last_became_active":"2024-09-11T23:17:59.651842+0000","last_became_peered":"2024-09-11T23:17:59.651842+0000","last_unstale":"2024-09-11T23:17:59.656734+0000","last_undegraded":"2024-09-11T23:17:59.656734+0000","last_fullsized":"2024-09-11T23:17:59.656734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:49.647417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.633101+0000","last_change":"2024-09-11T23:17:58.629743+0000","last_active":"2024-09-11T23:17:58.633101+0000","last_peered":"2024-09-11T23:17:58.633101+0000","last_clean":"2024-09-11T23:17:58.633101+0000","last_became_active":"2024-09-11T23:17:58.629379+0000","last_became_peered":"2024-09-11T23:17:58.629379+0000","last_unstale":"2024-09-11T23:17:58.633101+0000","last_undegraded":"2024-09-11T23:17:58.633101+0000","last_fullsized":"2024-09-11T23:17:58.633101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:28.903861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.619462+0000","last_change":"2024-09-11T23:17:58.619462+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.619462+0000","last_undegraded":"2024-09-11T23:17:58.619462+0000","last_fullsized":"2024-09-11T23:17:58.619462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.628052+0000","last_change":"2024-09-11T23:17:58.641139+0000","last_active":"2024-09-11T23:17:59.628052+0000","last_peered":"2024-09-11T23:17:59.628052+0000","last_clean":"2024-09-11T23:17:59.628052+0000","last_became_active":"2024-09-11T23:17:58.640813+0000","last_became_peered":"2024-09-11T23:17:58.640813+0000","last_unstale":"2024-09-11T23:17:59.628052+0000","last_undegraded":"2024-09-11T23:17:59.628052+0000","last_fullsized":"2024-09-11T23:17:59.628052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:02.505670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.668277+0000","last_change":"2024-09-11T23:17:59.661121+0000","last_active":"2024-09-11T23:17:59.668277+0000","last_peered":"2024-09-11T23:17:59.668277+0000","last_clean":"2024-09-11T23:17:59.668277+0000","last_became_active":"2024-09-11T23:17:59.660078+0000","last_became_peered":"2024-09-11T23:17:59.660078+0000","last_unstale":"2024-09-11T23:17:59.668277+0000","last_undegraded":"2024-09-11T23:17:59.668277+0000","last_fullsized":"2024-09-11T23:17:59.668277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.341838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.632833+0000","last_change":"2024-09-11T23:17:58.636194+0000","last_active":"2024-09-11T23:17:59.632833+0000","last_peered":"2024-09-11T23:17:59.632833+0000","last_clean":"2024-09-11T23:17:59.632833+0000","last_became_active":"2024-09-11T23:17:58.635885+0000","last_became_peered":"2024-09-11T23:17:58.635885+0000","last_unstale":"2024-09-11T23:17:59.632833+0000","last_undegraded":"2024-09-11T23:17:59.632833+0000","last_fullsized":"2024-09-11T23:17:59.632833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.654238+0000","last_change":"2024-09-11T23:17:59.648931+0000","last_active":"2024-09-11T23:17:59.654238+0000","last_peered":"2024-09-11T23:17:59.654238+0000","last_clean":"2024-09-11T23:17:59.654238+0000","last_became_active":"2024-09-11T23:17:59.646149+0000","last_became_peered":"2024-09-11T23:17:59.646149+0000","last_unstale":"2024-09-11T23:17:59.654238+0000","last_undegraded":"2024-09-11T23:17:59.654238+0000","last_fullsized":"2024-09-11T23:17:59.654238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:50.598149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669254+0000","last_change":"2024-09-11T23:17:58.631291+0000","last_active":"2024-09-11T23:18:00.669254+0000","last_peered":"2024-09-11T23:18:00.669254+0000","last_clean":"2024-09-11T23:18:00.669254+0000","last_became_active":"2024-09-11T23:17:58.630939+0000","last_became_peered":"2024-09-11T23:17:58.630939+0000","last_unstale":"2024-09-11T23:18:00.669254+0000","last_undegraded":"2024-09-11T23:18:00.669254+0000","last_fullsized":"2024-09-11T23:18:00.669254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:53:26.952229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.666524+0000","last_change":"2024-09-11T23:17:59.660874+0000","last_active":"2024-09-11T23:17:59.666524+0000","last_peered":"2024-09-11T23:17:59.666524+0000","last_clean":"2024-09-11T23:17:59.666524+0000","last_became_active":"2024-09-11T23:17:59.660613+0000","last_became_peered":"2024-09-11T23:17:59.660613+0000","last_unstale":"2024-09-11T23:17:59.666524+0000","last_undegraded":"2024-09-11T23:17:59.666524+0000","last_fullsized":"2024-09-11T23:17:59.666524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:50.844310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.673027+0000","last_change":"2024-09-11T23:17:58.635774+0000","last_active":"2024-09-11T23:17:59.673027+0000","last_peered":"2024-09-11T23:17:59.673027+0000","last_clean":"2024-09-11T23:17:59.673027+0000","last_became_active":"2024-09-11T23:17:58.634748+0000","last_became_peered":"2024-09-11T23:17:58.634748+0000","last_unstale":"2024-09-11T23:17:59.673027+0000","last_undegraded":"2024-09-11T23:17:59.673027+0000","last_fullsized":"2024-09-11T23:17:59.673027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:44.209956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.666227+0000","last_change":"2024-09-11T23:17:59.662246+0000","last_active":"2024-09-11T23:17:59.666227+0000","last_peered":"2024-09-11T23:17:59.666227+0000","last_clean":"2024-09-11T23:17:59.666227+0000","last_became_active":"2024-09-11T23:17:59.661866+0000","last_became_peered":"2024-09-11T23:17:59.661866+0000","last_unstale":"2024-09-11T23:17:59.666227+0000","last_undegraded":"2024-09-11T23:17:59.666227+0000","last_fullsized":"2024-09-11T23:17:59.666227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:09.804490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669504+0000","last_change":"2024-09-11T23:17:58.634201+0000","last_active":"2024-09-11T23:18:00.669504+0000","last_peered":"2024-09-11T23:18:00.669504+0000","last_clean":"2024-09-11T23:18:00.669504+0000","last_became_active":"2024-09-11T23:17:58.633865+0000","last_became_peered":"2024-09-11T23:17:58.633865+0000","last_unstale":"2024-09-11T23:18:00.669504+0000","last_undegraded":"2024-09-11T23:18:00.669504+0000","last_fullsized":"2024-09-11T23:18:00.669504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:12.634428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.672372+0000","last_change":"2024-09-11T23:17:59.668175+0000","last_active":"2024-09-11T23:17:59.672372+0000","last_peered":"2024-09-11T23:17:59.672372+0000","last_clean":"2024-09-11T23:17:59.672372+0000","last_became_active":"2024-09-11T23:17:59.665569+0000","last_became_peered":"2024-09-11T23:17:59.665569+0000","last_unstale":"2024-09-11T23:17:59.672372+0000","last_undegraded":"2024-09-11T23:17:59.672372+0000","last_fullsized":"2024-09-11T23:17:59.672372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:28.813283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.632336+0000","last_change":"2024-09-11T23:17:58.630807+0000","last_active":"2024-09-11T23:17:58.632336+0000","last_peered":"2024-09-11T23:17:58.632336+0000","last_clean":"2024-09-11T23:17:58.632336+0000","last_became_active":"2024-09-11T23:17:58.630491+0000","last_became_peered":"2024-09-11T23:17:58.630491+0000","last_unstale":"2024-09-11T23:17:58.632336+0000","last_undegraded":"2024-09-11T23:17:58.632336+0000","last_fullsized":"2024-09-11T23:17:58.632336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:28.903861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.652143+0000","last_change":"2024-09-11T23:17:59.643945+0000","last_active":"2024-09-11T23:17:59.652143+0000","last_peered":"2024-09-11T23:17:59.652143+0000","last_clean":"2024-09-11T23:17:59.652143+0000","last_became_active":"2024-09-11T23:17:59.643358+0000","last_became_peered":"2024-09-11T23:17:59.643358+0000","last_unstale":"2024-09-11T23:17:59.652143+0000","last_undegraded":"2024-09-11T23:17:59.652143+0000","last_fullsized":"2024-09-11T23:17:59.652143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:05.573887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670008+0000","last_change":"2024-09-11T23:17:58.645520+0000","last_active":"2024-09-11T23:18:00.670008+0000","last_peered":"2024-09-11T23:18:00.670008+0000","last_clean":"2024-09-11T23:18:00.670008+0000","last_became_active":"2024-09-11T23:17:58.645211+0000","last_became_peered":"2024-09-11T23:17:58.645211+0000","last_unstale":"2024-09-11T23:18:00.670008+0000","last_undegraded":"2024-09-11T23:18:00.670008+0000","last_fullsized":"2024-09-11T23:18:00.670008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:02.827617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.673641+0000","last_change":"2024-09-11T23:17:59.669515+0000","last_active":"2024-09-11T23:17:59.673641+0000","last_peered":"2024-09-11T23:17:59.673641+0000","last_clean":"2024-09-11T23:17:59.673641+0000","last_became_active":"2024-09-11T23:17:59.669182+0000","last_became_peered":"2024-09-11T23:17:59.669182+0000","last_unstale":"2024-09-11T23:17:59.673641+0000","last_undegraded":"2024-09-11T23:17:59.673641+0000","last_fullsized":"2024-09-11T23:17:59.673641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:15.213721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.644313+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:17:59.644313+0000","last_peered":"2024-09-11T23:17:59.644313+0000","last_clean":"2024-09-11T23:17:59.644313+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:17:59.644313+0000","last_undegraded":"2024-09-11T23:17:59.644313+0000","last_fullsized":"2024-09-11T23:17:59.644313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.627661+0000","last_change":"2024-09-11T23:17:58.634769+0000","last_active":"2024-09-11T23:17:59.627661+0000","last_peered":"2024-09-11T23:17:59.627661+0000","last_clean":"2024-09-11T23:17:59.627661+0000","last_became_active":"2024-09-11T23:17:58.634321+0000","last_became_peered":"2024-09-11T23:17:58.634321+0000","last_unstale":"2024-09-11T23:17:59.627661+0000","last_undegraded":"2024-09-11T23:17:59.627661+0000","last_fullsized":"2024-09-11T23:17:59.627661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:21.084931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669925+0000","last_change":"2024-09-11T23:17:59.659482+0000","last_active":"2024-09-11T23:18:00.669925+0000","last_peered":"2024-09-11T23:18:00.669925+0000","last_clean":"2024-09-11T23:18:00.669925+0000","last_became_active":"2024-09-11T23:17:59.659148+0000","last_became_peered":"2024-09-11T23:17:59.659148+0000","last_unstale":"2024-09-11T23:18:00.669925+0000","last_undegraded":"2024-09-11T23:18:00.669925+0000","last_fullsized":"2024-09-11T23:18:00.669925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:22.419970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.644252+0000","last_change":"2024-09-11T23:17:58.636656+0000","last_active":"2024-09-11T23:17:59.644252+0000","last_peered":"2024-09-11T23:17:59.644252+0000","last_clean":"2024-09-11T23:17:59.644252+0000","last_became_active":"2024-09-11T23:17:58.636363+0000","last_became_peered":"2024-09-11T23:17:58.636363+0000","last_unstale":"2024-09-11T23:17:59.644252+0000","last_undegraded":"2024-09-11T23:17:59.644252+0000","last_fullsized":"2024-09-11T23:17:59.644252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:04.565864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.621230+0000","last_change":"2024-09-11T23:17:58.621230+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.621230+0000","last_undegraded":"2024-09-11T23:17:58.621230+0000","last_fullsized":"2024-09-11T23:17:58.621230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669359+0000","last_change":"2024-09-11T23:17:58.642240+0000","last_active":"2024-09-11T23:18:00.669359+0000","last_peered":"2024-09-11T23:18:00.669359+0000","last_clean":"2024-09-11T23:18:00.669359+0000","last_became_active":"2024-09-11T23:17:58.641996+0000","last_became_peered":"2024-09-11T23:17:58.641996+0000","last_unstale":"2024-09-11T23:18:00.669359+0000","last_undegraded":"2024-09-11T23:18:00.669359+0000","last_fullsized":"2024-09-11T23:18:00.669359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:29:09.781577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.622052+0000","last_change":"2024-09-11T23:17:58.622052+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.622052+0000","last_undegraded":"2024-09-11T23:17:58.622052+0000","last_fullsized":"2024-09-11T23:17:58.622052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.628495+0000","last_change":"2024-09-11T23:17:58.641231+0000","last_active":"2024-09-11T23:17:59.628495+0000","last_peered":"2024-09-11T23:17:59.628495+0000","last_clean":"2024-09-11T23:17:59.628495+0000","last_became_active":"2024-09-11T23:17:58.640860+0000","last_became_peered":"2024-09-11T23:17:58.640860+0000","last_unstale":"2024-09-11T23:17:59.628495+0000","last_undegraded":"2024-09-11T23:17:59.628495+0000","last_fullsized":"2024-09-11T23:17:59.628495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.648713+0000","last_change":"2024-09-11T23:17:59.643898+0000","last_active":"2024-09-11T23:17:59.648713+0000","last_peered":"2024-09-11T23:17:59.648713+0000","last_clean":"2024-09-11T23:17:59.648713+0000","last_became_active":"2024-09-11T23:17:59.643471+0000","last_became_peered":"2024-09-11T23:17:59.643471+0000","last_unstale":"2024-09-11T23:17:59.648713+0000","last_undegraded":"2024-09-11T23:17:59.648713+0000","last_fullsized":"2024-09-11T23:17:59.648713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:36.096761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.643940+0000","last_change":"2024-09-11T23:17:58.640659+0000","last_active":"2024-09-11T23:17:58.643940+0000","last_peered":"2024-09-11T23:17:58.643940+0000","last_clean":"2024-09-11T23:17:58.643940+0000","last_became_active":"2024-09-11T23:17:58.640358+0000","last_became_peered":"2024-09-11T23:17:58.640358+0000","last_unstale":"2024-09-11T23:17:58.643940+0000","last_undegraded":"2024-09-11T23:17:58.643940+0000","last_fullsized":"2024-09-11T23:17:58.643940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:23.106037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.668652+0000","last_change":"2024-09-11T23:17:59.659233+0000","last_active":"2024-09-11T23:17:59.668652+0000","last_peered":"2024-09-11T23:17:59.668652+0000","last_clean":"2024-09-11T23:17:59.668652+0000","last_became_active":"2024-09-11T23:17:59.655952+0000","last_became_peered":"2024-09-11T23:17:59.655952+0000","last_unstale":"2024-09-11T23:17:59.668652+0000","last_undegraded":"2024-09-11T23:17:59.668652+0000","last_fullsized":"2024-09-11T23:17:59.668652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.193032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.648948+0000","last_change":"2024-09-11T23:17:58.642080+0000","last_active":"2024-09-11T23:17:59.648948+0000","last_peered":"2024-09-11T23:17:59.648948+0000","last_clean":"2024-09-11T23:17:59.648948+0000","last_became_active":"2024-09-11T23:17:58.641752+0000","last_became_peered":"2024-09-11T23:17:58.641752+0000","last_unstale":"2024-09-11T23:17:59.648948+0000","last_undegraded":"2024-09-11T23:17:59.648948+0000","last_fullsized":"2024-09-11T23:17:59.648948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:30.642868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.620511+0000","last_change":"2024-09-11T23:17:58.620511+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.620511+0000","last_undegraded":"2024-09-11T23:17:58.620511+0000","last_fullsized":"2024-09-11T23:17:58.620511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.635264+0000","last_change":"2024-09-11T23:17:58.633818+0000","last_active":"2024-09-11T23:17:58.635264+0000","last_peered":"2024-09-11T23:17:58.635264+0000","last_clean":"2024-09-11T23:17:58.635264+0000","last_became_active":"2024-09-11T23:17:58.633550+0000","last_became_peered":"2024-09-11T23:17:58.633550+0000","last_unstale":"2024-09-11T23:17:58.635264+0000","last_undegraded":"2024-09-11T23:17:58.635264+0000","last_fullsized":"2024-09-11T23:17:58.635264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:44.209956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671118+0000","last_change":"2024-09-11T23:17:59.650990+0000","last_active":"2024-09-11T23:18:00.671118+0000","last_peered":"2024-09-11T23:18:00.671118+0000","last_clean":"2024-09-11T23:18:00.671118+0000","last_became_active":"2024-09-11T23:17:59.650684+0000","last_became_peered":"2024-09-11T23:17:59.650684+0000","last_unstale":"2024-09-11T23:18:00.671118+0000","last_undegraded":"2024-09-11T23:18:00.671118+0000","last_fullsized":"2024-09-11T23:18:00.671118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:17.470426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.671564+0000","last_change":"2024-09-11T23:17:58.639477+0000","last_active":"2024-09-11T23:17:59.671564+0000","last_peered":"2024-09-11T23:17:59.671564+0000","last_clean":"2024-09-11T23:17:59.671564+0000","last_became_active":"2024-09-11T23:17:58.639168+0000","last_became_peered":"2024-09-11T23:17:58.639168+0000","last_unstale":"2024-09-11T23:17:59.671564+0000","last_undegraded":"2024-09-11T23:17:59.671564+0000","last_fullsized":"2024-09-11T23:17:59.671564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.630832+0000","last_change":"2024-09-11T23:17:58.630832+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.630832+0000","last_undegraded":"2024-09-11T23:17:58.630832+0000","last_fullsized":"2024-09-11T23:17:58.630832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.644090+0000","last_change":"2024-09-11T23:17:58.640620+0000","last_active":"2024-09-11T23:17:59.644090+0000","last_peered":"2024-09-11T23:17:59.644090+0000","last_clean":"2024-09-11T23:17:59.644090+0000","last_became_active":"2024-09-11T23:17:58.640367+0000","last_became_peered":"2024-09-11T23:17:58.640367+0000","last_unstale":"2024-09-11T23:17:59.644090+0000","last_undegraded":"2024-09-11T23:17:59.644090+0000","last_fullsized":"2024-09-11T23:17:59.644090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.907527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.639105+0000","last_change":"2024-09-11T23:17:59.635712+0000","last_active":"2024-09-11T23:17:59.639105+0000","last_peered":"2024-09-11T23:17:59.639105+0000","last_clean":"2024-09-11T23:17:59.639105+0000","last_became_active":"2024-09-11T23:17:59.635303+0000","last_became_peered":"2024-09-11T23:17:59.635303+0000","last_unstale":"2024-09-11T23:17:59.639105+0000","last_undegraded":"2024-09-11T23:17:59.639105+0000","last_fullsized":"2024-09-11T23:17:59.639105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:49.396092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.643771+0000","last_change":"2024-09-11T23:17:58.639596+0000","last_active":"2024-09-11T23:17:58.643771+0000","last_peered":"2024-09-11T23:17:58.643771+0000","last_clean":"2024-09-11T23:17:58.643771+0000","last_became_active":"2024-09-11T23:17:58.639333+0000","last_became_peered":"2024-09-11T23:17:58.639333+0000","last_unstale":"2024-09-11T23:17:58.643771+0000","last_undegraded":"2024-09-11T23:17:58.643771+0000","last_fullsized":"2024-09-11T23:17:58.643771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:09.475238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669868+0000","last_change":"2024-09-11T23:17:59.643630+0000","last_active":"2024-09-11T23:18:00.669868+0000","last_peered":"2024-09-11T23:18:00.669868+0000","last_clean":"2024-09-11T23:18:00.669868+0000","last_became_active":"2024-09-11T23:17:59.643080+0000","last_became_peered":"2024-09-11T23:17:59.643080+0000","last_unstale":"2024-09-11T23:18:00.669868+0000","last_undegraded":"2024-09-11T23:18:00.669868+0000","last_fullsized":"2024-09-11T23:18:00.669868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:59.272347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.635394+0000","last_change":"2024-09-11T23:17:58.634155+0000","last_active":"2024-09-11T23:17:58.635394+0000","last_peered":"2024-09-11T23:17:58.635394+0000","last_clean":"2024-09-11T23:17:58.635394+0000","last_became_active":"2024-09-11T23:17:58.633898+0000","last_became_peered":"2024-09-11T23:17:58.633898+0000","last_unstale":"2024-09-11T23:17:58.635394+0000","last_undegraded":"2024-09-11T23:17:58.635394+0000","last_fullsized":"2024-09-11T23:17:58.635394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:48.388069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670728+0000","last_change":"2024-09-11T23:17:59.648274+0000","last_active":"2024-09-11T23:18:00.670728+0000","last_peered":"2024-09-11T23:18:00.670728+0000","last_clean":"2024-09-11T23:18:00.670728+0000","last_became_active":"2024-09-11T23:17:59.646482+0000","last_became_peered":"2024-09-11T23:17:59.646482+0000","last_unstale":"2024-09-11T23:18:00.670728+0000","last_undegraded":"2024-09-11T23:18:00.670728+0000","last_fullsized":"2024-09-11T23:18:00.670728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:06.041413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.672611+0000","last_change":"2024-09-11T23:17:58.644868+0000","last_active":"2024-09-11T23:17:59.672611+0000","last_peered":"2024-09-11T23:17:59.672611+0000","last_clean":"2024-09-11T23:17:59.672611+0000","last_became_active":"2024-09-11T23:17:58.644006+0000","last_became_peered":"2024-09-11T23:17:58.644006+0000","last_unstale":"2024-09-11T23:17:59.672611+0000","last_undegraded":"2024-09-11T23:17:59.672611+0000","last_fullsized":"2024-09-11T23:17:59.672611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:23.261838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.653889+0000","last_change":"2024-09-11T23:17:59.642489+0000","last_active":"2024-09-11T23:17:59.653889+0000","last_peered":"2024-09-11T23:17:59.653889+0000","last_clean":"2024-09-11T23:17:59.653889+0000","last_became_active":"2024-09-11T23:17:59.642155+0000","last_became_peered":"2024-09-11T23:17:59.642155+0000","last_unstale":"2024-09-11T23:17:59.653889+0000","last_undegraded":"2024-09-11T23:17:59.653889+0000","last_fullsized":"2024-09-11T23:17:59.653889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:57.703691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.644464+0000","last_change":"2024-09-11T23:17:59.636661+0000","last_active":"2024-09-11T23:17:59.644464+0000","last_peered":"2024-09-11T23:17:59.644464+0000","last_clean":"2024-09-11T23:17:59.644464+0000","last_became_active":"2024-09-11T23:17:59.635613+0000","last_became_peered":"2024-09-11T23:17:59.635613+0000","last_unstale":"2024-09-11T23:17:59.644464+0000","last_undegraded":"2024-09-11T23:17:59.644464+0000","last_fullsized":"2024-09-11T23:17:59.644464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:57.703691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.672563+0000","last_change":"2024-09-11T23:17:58.646998+0000","last_active":"2024-09-11T23:17:59.672563+0000","last_peered":"2024-09-11T23:17:59.672563+0000","last_clean":"2024-09-11T23:17:59.672563+0000","last_became_active":"2024-09-11T23:17:58.646666+0000","last_became_peered":"2024-09-11T23:17:58.646666+0000","last_unstale":"2024-09-11T23:17:59.672563+0000","last_undegraded":"2024-09-11T23:17:59.672563+0000","last_fullsized":"2024-09-11T23:17:59.672563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:57.415598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.652120+0000","last_change":"2024-09-11T23:17:59.637292+0000","last_active":"2024-09-11T23:17:59.652120+0000","last_peered":"2024-09-11T23:17:59.652120+0000","last_clean":"2024-09-11T23:17:59.652120+0000","last_became_active":"2024-09-11T23:17:59.637028+0000","last_became_peered":"2024-09-11T23:17:59.637028+0000","last_unstale":"2024-09-11T23:17:59.652120+0000","last_undegraded":"2024-09-11T23:17:59.652120+0000","last_fullsized":"2024-09-11T23:17:59.652120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:30.915550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.673779+0000","last_change":"2024-09-11T23:17:58.641586+0000","last_active":"2024-09-11T23:17:59.673779+0000","last_peered":"2024-09-11T23:17:59.673779+0000","last_clean":"2024-09-11T23:17:59.673779+0000","last_became_active":"2024-09-11T23:17:58.636670+0000","last_became_peered":"2024-09-11T23:17:58.636670+0000","last_unstale":"2024-09-11T23:17:59.673779+0000","last_undegraded":"2024-09-11T23:17:59.673779+0000","last_fullsized":"2024-09-11T23:17:59.673779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:49.590126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.624249+0000","last_change":"2024-09-11T23:17:58.624249+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.624249+0000","last_undegraded":"2024-09-11T23:17:58.624249+0000","last_fullsized":"2024-09-11T23:17:58.624249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671062+0000","last_change":"2024-09-11T23:17:58.646365+0000","last_active":"2024-09-11T23:18:00.671062+0000","last_peered":"2024-09-11T23:18:00.671062+0000","last_clean":"2024-09-11T23:18:00.671062+0000","last_became_active":"2024-09-11T23:17:58.646119+0000","last_became_peered":"2024-09-11T23:17:58.646119+0000","last_unstale":"2024-09-11T23:18:00.671062+0000","last_undegraded":"2024-09-11T23:18:00.671062+0000","last_fullsized":"2024-09-11T23:18:00.671062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:12.634428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670990+0000","last_change":"2024-09-11T23:17:59.654946+0000","last_active":"2024-09-11T23:18:00.670990+0000","last_peered":"2024-09-11T23:18:00.670990+0000","last_clean":"2024-09-11T23:18:00.670990+0000","last_became_active":"2024-09-11T23:17:59.654732+0000","last_became_peered":"2024-09-11T23:17:59.654732+0000","last_unstale":"2024-09-11T23:18:00.670990+0000","last_undegraded":"2024-09-11T23:18:00.670990+0000","last_fullsized":"2024-09-11T23:18:00.670990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:28.095341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.645310+0000","last_change":"2024-09-11T23:17:58.638337+0000","last_active":"2024-09-11T23:17:58.645310+0000","last_peered":"2024-09-11T23:17:58.645310+0000","last_clean":"2024-09-11T23:17:58.645310+0000","last_became_active":"2024-09-11T23:17:58.638071+0000","last_became_peered":"2024-09-11T23:17:58.638071+0000","last_unstale":"2024-09-11T23:17:58.645310+0000","last_undegraded":"2024-09-11T23:17:58.645310+0000","last_fullsized":"2024-09-11T23:17:58.645310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:44.209956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476742,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":653205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476741,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":62837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":62837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":62837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":180224,"data_stored":56562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":646930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":77524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":75912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:18:04.211 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:18:04.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.399+0000 7fe8fe800640 1 Processor -- start 2024-09-11T23:18:04.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.399+0000 7fe8fe800640 1 -- start start 2024-09-11T23:18:04.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.400+0000 7fe8fe800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe8f815c300 0x7fe8f80affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.400+0000 7fe8fe800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8f815ecf0 con 0x7fe8f80cd300 2024-09-11T23:18:04.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.400+0000 7fe8fe800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8f815c6e0 con 0x7fe8f806f1e0 2024-09-11T23:18:04.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.400+0000 7fe8fe800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe8f815efb0 con 0x7fe8f815c300 2024-09-11T23:18:04.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.400+0000 7fe8f7400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe8f815c300 0x7fe8f80affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.400+0000 7fe8f6a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe8f80cd300 0x7fe8f806ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46776/0 (socket says 172.21.15.144:46776) 2024-09-11T23:18:04.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.400+0000 7fe8f6a00640 1 -- 172.21.15.144:0/1057751408 learned_addr learned my addr 172.21.15.144:0/1057751408 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:04.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.401+0000 7fe8f7400640 1 -- 172.21.15.144:0/1057751408 >> v1:172.21.15.165:6789/0 conn(0x7fe8f806f1e0 legacy=0x7fe8f80ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:04.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.401+0000 7fe8f7400640 1 -- 172.21.15.144:0/1057751408 >> v1:172.21.15.144:6789/0 conn(0x7fe8f80cd300 legacy=0x7fe8f806ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.401+0000 7fe8f7400640 1 -- 172.21.15.144:0/1057751408 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f815f290 con 0x7fe8f815c300 2024-09-11T23:18:04.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.401+0000 7fe8f6000640 1 -- 172.21.15.144:0/1057751408 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3174326147 0 0) 0x7fe8f815ecf0 con 0x7fe8f80cd300 2024-09-11T23:18:04.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.402+0000 7fe8f7400640 1 --2- 172.21.15.144:0/1057751408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8f815c300 0x7fe8f80affc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80097a0 tx=0x7fe8e802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7657afed149888e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:04.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.402+0000 7fe8f6000640 1 -- 172.21.15.144:0/1057751408 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8037070 con 0x7fe8f815c300 2024-09-11T23:18:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.402+0000 7fe8f6000640 1 -- 172.21.15.144:0/1057751408 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e802ae50 con 0x7fe8f815c300 2024-09-11T23:18:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.402+0000 7fe8f6000640 1 -- 172.21.15.144:0/1057751408 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8032660 con 0x7fe8f815c300 2024-09-11T23:18:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.403+0000 7fe8fe800640 1 -- 172.21.15.144:0/1057751408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8f815c300 msgr2=0x7fe8f80affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.403+0000 7fe8fe800640 1 --2- 172.21.15.144:0/1057751408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8f815c300 0x7fe8f80affc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80097a0 tx=0x7fe8e802a140 comp rx=0 tx=0).stop 2024-09-11T23:18:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.403+0000 7fe8fe800640 1 -- 172.21.15.144:0/1057751408 shutdown_connections 2024-09-11T23:18:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.403+0000 7fe8fe800640 1 --2- 172.21.15.144:0/1057751408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8f815c300 0x7fe8f80affc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.403+0000 7fe8fe800640 1 -- 172.21.15.144:0/1057751408 >> 172.21.15.144:0/1057751408 conn(0x7fe8f806cae0 msgr2=0x7fe8f806cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.403+0000 7fe8fe800640 1 -- 172.21.15.144:0/1057751408 shutdown_connections 2024-09-11T23:18:04.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.403+0000 7fe8fe800640 1 -- 172.21.15.144:0/1057751408 wait complete. 2024-09-11T23:18:04.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.404+0000 7fe8fe800640 1 Processor -- start 2024-09-11T23:18:04.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.404+0000 7fe8fe800640 1 -- start start 2024-09-11T23:18:04.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.405+0000 7fe8fe800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8f806f1e0 0x7fe8f81f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.405+0000 7fe8fe800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8f80cd300 0x7fe8f814e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.405+0000 7fe8fe800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8f815c300 0x7fe8f8157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.405+0000 7fe8fe800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f8071880 con 0x7fe8f80cd300 2024-09-11T23:18:04.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.405+0000 7fe8fe800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f815f850 con 0x7fe8f815c300 2024-09-11T23:18:04.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.405+0000 7fe8fe800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f80b0500 con 0x7fe8f806f1e0 2024-09-11T23:18:04.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.406+0000 7fe8f6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8f80cd300 0x7fe8f814e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.406+0000 7fe8f6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8f80cd300 0x7fe8f814e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49084/0 (socket says 172.21.15.144:49084) 2024-09-11T23:18:04.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.406+0000 7fe8f6a00640 1 -- 172.21.15.144:0/4150826912 learned_addr learned my addr 172.21.15.144:0/4150826912 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:04.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.406+0000 7fe8f7400640 1 --2- 172.21.15.144:0/4150826912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8f806f1e0 0x7fe8f81f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.406+0000 7fe8f7e00640 1 --2- 172.21.15.144:0/4150826912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8f815c300 0x7fe8f8157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.406+0000 7fe8f6a00640 1 -- 172.21.15.144:0/4150826912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8f806f1e0 msgr2=0x7fe8f81f51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.406+0000 7fe8f6a00640 1 --2- 172.21.15.144:0/4150826912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8f806f1e0 0x7fe8f81f51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.406+0000 7fe8f6a00640 1 -- 172.21.15.144:0/4150826912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8f815c300 msgr2=0x7fe8f8157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.406+0000 7fe8f6a00640 1 --2- 172.21.15.144:0/4150826912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8f815c300 0x7fe8f8157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.406+0000 7fe8f6a00640 1 -- 172.21.15.144:0/4150826912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f815e130 con 0x7fe8f80cd300 2024-09-11T23:18:04.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.406+0000 7fe8f7e00640 1 --2- 172.21.15.144:0/4150826912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8f815c300 0x7fe8f8157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:04.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.406+0000 7fe8f7400640 1 --2- 172.21.15.144:0/4150826912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8f806f1e0 0x7fe8f81f51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:04.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.406+0000 7fe8f6a00640 1 --2- 172.21.15.144:0/4150826912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8f80cd300 0x7fe8f814e340 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400c4d0 tx=0x7fe8e400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:04.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.406+0000 7fe8ef400640 1 -- 172.21.15.144:0/4150826912 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4018070 con 0x7fe8f80cd300 2024-09-11T23:18:04.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.407+0000 7fe8ef400640 1 -- 172.21.15.144:0/4150826912 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e4007500 con 0x7fe8f80cd300 2024-09-11T23:18:04.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.407+0000 7fe8ef400640 1 -- 172.21.15.144:0/4150826912 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4004a20 con 0x7fe8f80cd300 2024-09-11T23:18:04.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.407+0000 7fe8fe800640 1 -- 172.21.15.144:0/4150826912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f815e410 con 0x7fe8f80cd300 2024-09-11T23:18:04.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.407+0000 7fe8fe800640 1 -- 172.21.15.144:0/4150826912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f815e9d0 con 0x7fe8f80cd300 2024-09-11T23:18:04.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.408+0000 7fe8fe800640 1 -- 172.21.15.144:0/4150826912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8f80affc0 con 0x7fe8f80cd300 2024-09-11T23:18:04.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.409+0000 7fe8ef400640 1 -- 172.21.15.144:0/4150826912 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8e401b070 con 0x7fe8f80cd300 2024-09-11T23:18:04.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.409+0000 7fe8ef400640 1 --2- 172.21.15.144:0/4150826912 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe8d806be30 0x7fe8d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.410+0000 7fe8ef400640 1 -- 172.21.15.144:0/4150826912 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe8e408a1f0 con 0x7fe8f80cd300 2024-09-11T23:18:04.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.410+0000 7fe8f7400640 1 --2- 172.21.15.144:0/4150826912 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe8d806be30 0x7fe8d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.410+0000 7fe8f7400640 1 --2- 172.21.15.144:0/4150826912 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe8d806be30 0x7fe8d806e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8034000 tx=0x7fe8e802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:04.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.414+0000 7fe8ef400640 1 -- 172.21.15.144:0/4150826912 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe8e4058b90 con 0x7fe8f80cd300 2024-09-11T23:18:04.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.582+0000 7fe8fe800640 1 -- 172.21.15.144:0/4150826912 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe8f80b6880 con 0x7fe8d806be30 2024-09-11T23:18:04.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.588+0000 7fe8ef400640 1 -- 172.21.15.144:0/4150826912 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250578 (secure 0 0 0) 0x7fe8f80b6880 con 0x7fe8d806be30 2024-09-11T23:18:04.592 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:04.594 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:18:04.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.593+0000 7fe8fe800640 1 -- 172.21.15.144:0/4150826912 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe8d806be30 msgr2=0x7fe8d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.593+0000 7fe8fe800640 1 --2- 172.21.15.144:0/4150826912 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe8d806be30 0x7fe8d806e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8034000 tx=0x7fe8e802e000 comp rx=0 tx=0).stop 2024-09-11T23:18:04.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.593+0000 7fe8fe800640 1 -- 172.21.15.144:0/4150826912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8f80cd300 msgr2=0x7fe8f814e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.593+0000 7fe8fe800640 1 --2- 172.21.15.144:0/4150826912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8f80cd300 0x7fe8f814e340 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400c4d0 tx=0x7fe8e400c990 comp rx=0 tx=0).stop 2024-09-11T23:18:04.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.593+0000 7fe8fe800640 1 -- 172.21.15.144:0/4150826912 shutdown_connections 2024-09-11T23:18:04.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.593+0000 7fe8fe800640 1 --2- 172.21.15.144:0/4150826912 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe8d806be30 0x7fe8d806e2f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.593+0000 7fe8fe800640 1 --2- 172.21.15.144:0/4150826912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8f815c300 0x7fe8f8157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.593+0000 7fe8fe800640 1 --2- 172.21.15.144:0/4150826912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8f80cd300 0x7fe8f814e340 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.593+0000 7fe8fe800640 1 --2- 172.21.15.144:0/4150826912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8f806f1e0 0x7fe8f81f51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.593+0000 7fe8fe800640 1 -- 172.21.15.144:0/4150826912 >> 172.21.15.144:0/4150826912 conn(0x7fe8f806cae0 msgr2=0x7fe8f806ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:04.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.593+0000 7fe8fe800640 1 -- 172.21.15.144:0/4150826912 shutdown_connections 2024-09-11T23:18:04.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.593+0000 7fe8fe800640 1 -- 172.21.15.144:0/4150826912 wait complete. 2024-09-11T23:18:04.602 INFO:tasks.ceph.mds.d.smithi165.stderr:2024-09-11T23:18:04.602+0000 7f6e15c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:18:04.610 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-11T23:18:03.162658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218944,"kb_used_data":2700,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755776,"statfs":{"total":773094113280,"available":772869914624,"internally_reserved":0,"allocated":2764800,"data_stored":1698644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.551102"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.658019+0000","last_change":"2024-09-11T23:17:59.655120+0000","last_active":"2024-09-11T23:17:59.658019+0000","last_peered":"2024-09-11T23:17:59.658019+0000","last_clean":"2024-09-11T23:17:59.658019+0000","last_became_active":"2024-09-11T23:17:59.654860+0000","last_became_peered":"2024-09-11T23:17:59.654860+0000","last_unstale":"2024-09-11T23:17:59.658019+0000","last_undegraded":"2024-09-11T23:17:59.658019+0000","last_fullsized":"2024-09-11T23:17:59.658019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:36.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.622794+0000","last_change":"2024-09-11T23:17:58.622794+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.622794+0000","last_undegraded":"2024-09-11T23:17:58.622794+0000","last_fullsized":"2024-09-11T23:17:58.622794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.629373+0000","last_change":"2024-09-11T23:17:58.629373+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.629373+0000","last_undegraded":"2024-09-11T23:17:58.629373+0000","last_fullsized":"2024-09-11T23:17:58.629373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.652162+0000","last_change":"2024-09-11T23:17:59.644202+0000","last_active":"2024-09-11T23:17:59.652162+0000","last_peered":"2024-09-11T23:17:59.652162+0000","last_clean":"2024-09-11T23:17:59.652162+0000","last_became_active":"2024-09-11T23:17:59.643634+0000","last_became_peered":"2024-09-11T23:17:59.643634+0000","last_unstale":"2024-09-11T23:17:59.652162+0000","last_undegraded":"2024-09-11T23:17:59.652162+0000","last_fullsized":"2024-09-11T23:17:59.652162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:58.423622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.656950+0000","last_change":"2024-09-11T23:17:59.652783+0000","last_active":"2024-09-11T23:17:59.656950+0000","last_peered":"2024-09-11T23:17:59.656950+0000","last_clean":"2024-09-11T23:17:59.656950+0000","last_became_active":"2024-09-11T23:17:59.652508+0000","last_became_peered":"2024-09-11T23:17:59.652508+0000","last_unstale":"2024-09-11T23:17:59.656950+0000","last_undegraded":"2024-09-11T23:17:59.656950+0000","last_fullsized":"2024-09-11T23:17:59.656950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:15.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.668756+0000","last_change":"2024-09-11T23:17:59.659401+0000","last_active":"2024-09-11T23:17:59.668756+0000","last_peered":"2024-09-11T23:17:59.668756+0000","last_clean":"2024-09-11T23:17:59.668756+0000","last_became_active":"2024-09-11T23:17:59.655926+0000","last_became_peered":"2024-09-11T23:17:59.655926+0000","last_unstale":"2024-09-11T23:17:59.668756+0000","last_undegraded":"2024-09-11T23:17:59.668756+0000","last_fullsized":"2024-09-11T23:17:59.668756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:15.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.663103+0000","last_change":"2024-09-11T23:17:59.657900+0000","last_active":"2024-09-11T23:17:59.663103+0000","last_peered":"2024-09-11T23:17:59.663103+0000","last_clean":"2024-09-11T23:17:59.663103+0000","last_became_active":"2024-09-11T23:17:59.657621+0000","last_became_peered":"2024-09-11T23:17:59.657621+0000","last_unstale":"2024-09-11T23:17:59.663103+0000","last_undegraded":"2024-09-11T23:17:59.663103+0000","last_fullsized":"2024-09-11T23:17:59.663103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:05.705455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669094+0000","last_change":"2024-09-11T23:17:59.643006+0000","last_active":"2024-09-11T23:18:00.669094+0000","last_peered":"2024-09-11T23:18:00.669094+0000","last_clean":"2024-09-11T23:18:00.669094+0000","last_became_active":"2024-09-11T23:17:59.642338+0000","last_became_peered":"2024-09-11T23:17:59.642338+0000","last_unstale":"2024-09-11T23:18:00.669094+0000","last_undegraded":"2024-09-11T23:18:00.669094+0000","last_fullsized":"2024-09-11T23:18:00.669094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:29.873658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.676196+0000","last_change":"2024-09-11T23:17:59.671758+0000","last_active":"2024-09-11T23:17:59.676196+0000","last_peered":"2024-09-11T23:17:59.676196+0000","last_clean":"2024-09-11T23:17:59.676196+0000","last_became_active":"2024-09-11T23:17:59.671418+0000","last_became_peered":"2024-09-11T23:17:59.671418+0000","last_unstale":"2024-09-11T23:17:59.676196+0000","last_undegraded":"2024-09-11T23:17:59.676196+0000","last_fullsized":"2024-09-11T23:17:59.676196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:38.039621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.660447+0000","last_change":"2024-09-11T23:17:59.656199+0000","last_active":"2024-09-11T23:17:59.660447+0000","last_peered":"2024-09-11T23:17:59.660447+0000","last_clean":"2024-09-11T23:17:59.660447+0000","last_became_active":"2024-09-11T23:17:59.655919+0000","last_became_peered":"2024-09-11T23:17:59.655919+0000","last_unstale":"2024-09-11T23:17:59.660447+0000","last_undegraded":"2024-09-11T23:17:59.660447+0000","last_fullsized":"2024-09-11T23:17:59.660447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:31.650891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.654496+0000","last_change":"2024-09-11T23:17:59.646129+0000","last_active":"2024-09-11T23:17:59.654496+0000","last_peered":"2024-09-11T23:17:59.654496+0000","last_clean":"2024-09-11T23:17:59.654496+0000","last_became_active":"2024-09-11T23:17:59.645346+0000","last_became_peered":"2024-09-11T23:17:59.645346+0000","last_unstale":"2024-09-11T23:17:59.654496+0000","last_undegraded":"2024-09-11T23:17:59.654496+0000","last_fullsized":"2024-09-11T23:17:59.654496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:05.573887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.651766+0000","last_change":"2024-09-11T23:17:59.642874+0000","last_active":"2024-09-11T23:17:59.651766+0000","last_peered":"2024-09-11T23:17:59.651766+0000","last_clean":"2024-09-11T23:17:59.651766+0000","last_became_active":"2024-09-11T23:17:59.642586+0000","last_became_peered":"2024-09-11T23:17:59.642586+0000","last_unstale":"2024-09-11T23:17:59.651766+0000","last_undegraded":"2024-09-11T23:17:59.651766+0000","last_fullsized":"2024-09-11T23:17:59.651766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:24.114060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670655+0000","last_change":"2024-09-11T23:17:59.644814+0000","last_active":"2024-09-11T23:18:00.670655+0000","last_peered":"2024-09-11T23:18:00.670655+0000","last_clean":"2024-09-11T23:18:00.670655+0000","last_became_active":"2024-09-11T23:17:59.643305+0000","last_became_peered":"2024-09-11T23:17:59.643305+0000","last_unstale":"2024-09-11T23:18:00.670655+0000","last_undegraded":"2024-09-11T23:18:00.670655+0000","last_fullsized":"2024-09-11T23:18:00.670655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:29.321395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.630283+0000","last_change":"2024-09-11T23:17:58.630283+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.630283+0000","last_undegraded":"2024-09-11T23:17:58.630283+0000","last_fullsized":"2024-09-11T23:17:58.630283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.620642+0000","last_change":"2024-09-11T23:17:58.620642+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.620642+0000","last_undegraded":"2024-09-11T23:17:58.620642+0000","last_fullsized":"2024-09-11T23:17:58.620642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.656386+0000","last_change":"2024-09-11T23:17:59.653627+0000","last_active":"2024-09-11T23:17:59.656386+0000","last_peered":"2024-09-11T23:17:59.656386+0000","last_clean":"2024-09-11T23:17:59.656386+0000","last_became_active":"2024-09-11T23:17:59.653088+0000","last_became_peered":"2024-09-11T23:17:59.653088+0000","last_unstale":"2024-09-11T23:17:59.656386+0000","last_undegraded":"2024-09-11T23:17:59.656386+0000","last_fullsized":"2024-09-11T23:17:59.656386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:24.269862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.668387+0000","last_change":"2024-09-11T23:17:59.660074+0000","last_active":"2024-09-11T23:17:59.668387+0000","last_peered":"2024-09-11T23:17:59.668387+0000","last_clean":"2024-09-11T23:17:59.668387+0000","last_became_active":"2024-09-11T23:17:59.659174+0000","last_became_peered":"2024-09-11T23:17:59.659174+0000","last_unstale":"2024-09-11T23:17:59.668387+0000","last_undegraded":"2024-09-11T23:17:59.668387+0000","last_fullsized":"2024-09-11T23:17:59.668387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:36.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669448+0000","last_change":"2024-09-11T23:17:59.641202+0000","last_active":"2024-09-11T23:18:00.669448+0000","last_peered":"2024-09-11T23:18:00.669448+0000","last_clean":"2024-09-11T23:18:00.669448+0000","last_became_active":"2024-09-11T23:17:59.640609+0000","last_became_peered":"2024-09-11T23:17:59.640609+0000","last_unstale":"2024-09-11T23:18:00.669448+0000","last_undegraded":"2024-09-11T23:18:00.669448+0000","last_fullsized":"2024-09-11T23:18:00.669448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:34.428505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.657378+0000","last_change":"2024-09-11T23:17:59.654884+0000","last_active":"2024-09-11T23:17:59.657378+0000","last_peered":"2024-09-11T23:17:59.657378+0000","last_clean":"2024-09-11T23:17:59.657378+0000","last_became_active":"2024-09-11T23:17:59.654578+0000","last_became_peered":"2024-09-11T23:17:59.654578+0000","last_unstale":"2024-09-11T23:17:59.657378+0000","last_undegraded":"2024-09-11T23:17:59.657378+0000","last_fullsized":"2024-09-11T23:17:59.657378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.193032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.654318+0000","last_change":"2024-09-11T23:17:59.643411+0000","last_active":"2024-09-11T23:17:59.654318+0000","last_peered":"2024-09-11T23:17:59.654318+0000","last_clean":"2024-09-11T23:17:59.654318+0000","last_became_active":"2024-09-11T23:17:59.643076+0000","last_became_peered":"2024-09-11T23:17:59.643076+0000","last_unstale":"2024-09-11T23:17:59.654318+0000","last_undegraded":"2024-09-11T23:17:59.654318+0000","last_fullsized":"2024-09-11T23:17:59.654318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:30.915550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.628788+0000","last_change":"2024-09-11T23:17:58.628788+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.628788+0000","last_undegraded":"2024-09-11T23:17:58.628788+0000","last_fullsized":"2024-09-11T23:17:58.628788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.672101+0000","last_change":"2024-09-11T23:17:59.666448+0000","last_active":"2024-09-11T23:17:59.672101+0000","last_peered":"2024-09-11T23:17:59.672101+0000","last_clean":"2024-09-11T23:17:59.672101+0000","last_became_active":"2024-09-11T23:17:59.664741+0000","last_became_peered":"2024-09-11T23:17:59.664741+0000","last_unstale":"2024-09-11T23:17:59.672101+0000","last_undegraded":"2024-09-11T23:17:59.672101+0000","last_fullsized":"2024-09-11T23:17:59.672101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:05.705455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670229+0000","last_change":"2024-09-11T23:17:59.645036+0000","last_active":"2024-09-11T23:18:00.670229+0000","last_peered":"2024-09-11T23:18:00.670229+0000","last_clean":"2024-09-11T23:18:00.670229+0000","last_became_active":"2024-09-11T23:17:59.644706+0000","last_became_peered":"2024-09-11T23:17:59.644706+0000","last_unstale":"2024-09-11T23:18:00.670229+0000","last_undegraded":"2024-09-11T23:18:00.670229+0000","last_fullsized":"2024-09-11T23:18:00.670229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:04.266917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.656360+0000","last_change":"2024-09-11T23:17:59.653352+0000","last_active":"2024-09-11T23:17:59.656360+0000","last_peered":"2024-09-11T23:17:59.656360+0000","last_clean":"2024-09-11T23:17:59.656360+0000","last_became_active":"2024-09-11T23:17:59.652470+0000","last_became_peered":"2024-09-11T23:17:59.652470+0000","last_unstale":"2024-09-11T23:17:59.656360+0000","last_undegraded":"2024-09-11T23:17:59.656360+0000","last_fullsized":"2024-09-11T23:17:59.656360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:50.598149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671014+0000","last_change":"2024-09-11T23:17:59.662259+0000","last_active":"2024-09-11T23:18:00.671014+0000","last_peered":"2024-09-11T23:18:00.671014+0000","last_clean":"2024-09-11T23:18:00.671014+0000","last_became_active":"2024-09-11T23:17:59.662031+0000","last_became_peered":"2024-09-11T23:17:59.662031+0000","last_unstale":"2024-09-11T23:18:00.671014+0000","last_undegraded":"2024-09-11T23:18:00.671014+0000","last_fullsized":"2024-09-11T23:18:00.671014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:34.160365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.654388+0000","last_change":"2024-09-11T23:17:59.650797+0000","last_active":"2024-09-11T23:17:59.654388+0000","last_peered":"2024-09-11T23:17:59.654388+0000","last_clean":"2024-09-11T23:17:59.654388+0000","last_became_active":"2024-09-11T23:17:59.650548+0000","last_became_peered":"2024-09-11T23:17:59.650548+0000","last_unstale":"2024-09-11T23:17:59.654388+0000","last_undegraded":"2024-09-11T23:17:59.654388+0000","last_fullsized":"2024-09-11T23:17:59.654388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:24.269862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.621631+0000","last_change":"2024-09-11T23:17:58.621631+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.621631+0000","last_undegraded":"2024-09-11T23:17:58.621631+0000","last_fullsized":"2024-09-11T23:17:58.621631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670965+0000","last_change":"2024-09-11T23:17:59.644063+0000","last_active":"2024-09-11T23:18:00.670965+0000","last_peered":"2024-09-11T23:18:00.670965+0000","last_clean":"2024-09-11T23:18:00.670965+0000","last_became_active":"2024-09-11T23:17:59.643760+0000","last_became_peered":"2024-09-11T23:17:59.643760+0000","last_unstale":"2024-09-11T23:18:00.670965+0000","last_undegraded":"2024-09-11T23:18:00.670965+0000","last_fullsized":"2024-09-11T23:18:00.670965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:31.141907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.628159+0000","last_change":"2024-09-11T23:17:58.628159+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.628159+0000","last_undegraded":"2024-09-11T23:17:58.628159+0000","last_fullsized":"2024-09-11T23:17:58.628159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.668741+0000","last_change":"2024-09-11T23:17:59.657821+0000","last_active":"2024-09-11T23:17:59.668741+0000","last_peered":"2024-09-11T23:17:59.668741+0000","last_clean":"2024-09-11T23:17:59.668741+0000","last_became_active":"2024-09-11T23:17:59.645334+0000","last_became_peered":"2024-09-11T23:17:59.645334+0000","last_unstale":"2024-09-11T23:17:59.668741+0000","last_undegraded":"2024-09-11T23:17:59.668741+0000","last_fullsized":"2024-09-11T23:17:59.668741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:31.650891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669574+0000","last_change":"2024-09-11T23:17:59.636987+0000","last_active":"2024-09-11T23:18:00.669574+0000","last_peered":"2024-09-11T23:18:00.669574+0000","last_clean":"2024-09-11T23:18:00.669574+0000","last_became_active":"2024-09-11T23:17:59.636762+0000","last_became_peered":"2024-09-11T23:17:59.636762+0000","last_unstale":"2024-09-11T23:18:00.669574+0000","last_undegraded":"2024-09-11T23:18:00.669574+0000","last_fullsized":"2024-09-11T23:18:00.669574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:10.353893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.654188+0000","last_change":"2024-09-11T23:17:59.648354+0000","last_active":"2024-09-11T23:17:59.654188+0000","last_peered":"2024-09-11T23:17:59.654188+0000","last_clean":"2024-09-11T23:17:59.654188+0000","last_became_active":"2024-09-11T23:17:59.646693+0000","last_became_peered":"2024-09-11T23:17:59.646693+0000","last_unstale":"2024-09-11T23:17:59.654188+0000","last_undegraded":"2024-09-11T23:17:59.654188+0000","last_fullsized":"2024-09-11T23:17:59.654188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:58.423622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.642173+0000","last_change":"2024-09-11T23:17:59.637101+0000","last_active":"2024-09-11T23:17:59.642173+0000","last_peered":"2024-09-11T23:17:59.642173+0000","last_clean":"2024-09-11T23:17:59.642173+0000","last_became_active":"2024-09-11T23:17:59.635407+0000","last_became_peered":"2024-09-11T23:17:59.635407+0000","last_unstale":"2024-09-11T23:17:59.642173+0000","last_undegraded":"2024-09-11T23:17:59.642173+0000","last_fullsized":"2024-09-11T23:17:59.642173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:10.483262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670769+0000","last_change":"2024-09-11T23:17:58.642664+0000","last_active":"2024-09-11T23:18:00.670769+0000","last_peered":"2024-09-11T23:18:00.670769+0000","last_clean":"2024-09-11T23:18:00.670769+0000","last_became_active":"2024-09-11T23:17:58.642371+0000","last_became_peered":"2024-09-11T23:17:58.642371+0000","last_unstale":"2024-09-11T23:18:00.670769+0000","last_undegraded":"2024-09-11T23:18:00.670769+0000","last_fullsized":"2024-09-11T23:18:00.670769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:31.214611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.620315+0000","last_change":"2024-09-11T23:17:58.620315+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.620315+0000","last_undegraded":"2024-09-11T23:17:58.620315+0000","last_fullsized":"2024-09-11T23:17:58.620315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.669118+0000","last_change":"2024-09-11T23:17:58.640442+0000","last_active":"2024-09-11T23:17:59.669118+0000","last_peered":"2024-09-11T23:17:59.669118+0000","last_clean":"2024-09-11T23:17:59.669118+0000","last_became_active":"2024-09-11T23:17:58.640148+0000","last_became_peered":"2024-09-11T23:17:58.640148+0000","last_unstale":"2024-09-11T23:17:59.669118+0000","last_undegraded":"2024-09-11T23:17:59.669118+0000","last_fullsized":"2024-09-11T23:17:59.669118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:02.505670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670322+0000","last_change":"2024-09-11T23:17:58.640181+0000","last_active":"2024-09-11T23:18:00.670322+0000","last_peered":"2024-09-11T23:18:00.670322+0000","last_clean":"2024-09-11T23:18:00.670322+0000","last_became_active":"2024-09-11T23:17:58.639944+0000","last_became_peered":"2024-09-11T23:17:58.639944+0000","last_unstale":"2024-09-11T23:18:00.670322+0000","last_undegraded":"2024-09-11T23:18:00.670322+0000","last_fullsized":"2024-09-11T23:18:00.670322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:02.827617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669793+0000","last_change":"2024-09-11T23:17:59.643922+0000","last_active":"2024-09-11T23:18:00.669793+0000","last_peered":"2024-09-11T23:18:00.669793+0000","last_clean":"2024-09-11T23:18:00.669793+0000","last_became_active":"2024-09-11T23:17:59.643613+0000","last_became_peered":"2024-09-11T23:17:59.643613+0000","last_unstale":"2024-09-11T23:18:00.669793+0000","last_undegraded":"2024-09-11T23:18:00.669793+0000","last_fullsized":"2024-09-11T23:18:00.669793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:31.792631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.627116+0000","last_change":"2024-09-11T23:17:58.640428+0000","last_active":"2024-09-11T23:17:59.627116+0000","last_peered":"2024-09-11T23:17:59.627116+0000","last_clean":"2024-09-11T23:17:59.627116+0000","last_became_active":"2024-09-11T23:17:58.639860+0000","last_became_peered":"2024-09-11T23:17:58.639860+0000","last_unstale":"2024-09-11T23:17:59.627116+0000","last_undegraded":"2024-09-11T23:17:59.627116+0000","last_fullsized":"2024-09-11T23:17:59.627116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.621139+0000","last_change":"2024-09-11T23:17:58.621139+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.621139+0000","last_undegraded":"2024-09-11T23:17:58.621139+0000","last_fullsized":"2024-09-11T23:17:58.621139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.636665+0000","last_change":"2024-09-11T23:17:58.645977+0000","last_active":"2024-09-11T23:17:59.636665+0000","last_peered":"2024-09-11T23:17:59.636665+0000","last_clean":"2024-09-11T23:17:59.636665+0000","last_became_active":"2024-09-11T23:17:58.645482+0000","last_became_peered":"2024-09-11T23:17:58.645482+0000","last_unstale":"2024-09-11T23:17:59.636665+0000","last_undegraded":"2024-09-11T23:17:59.636665+0000","last_fullsized":"2024-09-11T23:17:59.636665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:31.277023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.668608+0000","last_change":"2024-09-11T23:17:59.658501+0000","last_active":"2024-09-11T23:17:59.668608+0000","last_peered":"2024-09-11T23:17:59.668608+0000","last_clean":"2024-09-11T23:17:59.668608+0000","last_became_active":"2024-09-11T23:17:59.658268+0000","last_became_peered":"2024-09-11T23:17:59.658268+0000","last_unstale":"2024-09-11T23:17:59.668608+0000","last_undegraded":"2024-09-11T23:17:59.668608+0000","last_fullsized":"2024-09-11T23:17:59.668608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:49.647417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.629883+0000","last_change":"2024-09-11T23:17:58.640356+0000","last_active":"2024-09-11T23:17:59.629883+0000","last_peered":"2024-09-11T23:17:59.629883+0000","last_clean":"2024-09-11T23:17:59.629883+0000","last_became_active":"2024-09-11T23:17:58.640060+0000","last_became_peered":"2024-09-11T23:17:58.640060+0000","last_unstale":"2024-09-11T23:17:59.629883+0000","last_undegraded":"2024-09-11T23:17:59.629883+0000","last_fullsized":"2024-09-11T23:17:59.629883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:31.277023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.619425+0000","last_change":"2024-09-11T23:17:58.619425+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.619425+0000","last_undegraded":"2024-09-11T23:17:58.619425+0000","last_fullsized":"2024-09-11T23:17:58.619425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.647001+0000","last_change":"2024-09-11T23:17:58.646012+0000","last_active":"2024-09-11T23:17:58.647001+0000","last_peered":"2024-09-11T23:17:58.647001+0000","last_clean":"2024-09-11T23:17:58.647001+0000","last_became_active":"2024-09-11T23:17:58.645093+0000","last_became_peered":"2024-09-11T23:17:58.645093+0000","last_unstale":"2024-09-11T23:17:58.647001+0000","last_undegraded":"2024-09-11T23:17:58.647001+0000","last_fullsized":"2024-09-11T23:17:58.647001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.660595+0000","last_change":"2024-09-11T23:17:59.653386+0000","last_active":"2024-09-11T23:17:59.660595+0000","last_peered":"2024-09-11T23:17:59.660595+0000","last_clean":"2024-09-11T23:17:59.660595+0000","last_became_active":"2024-09-11T23:17:59.653112+0000","last_became_peered":"2024-09-11T23:17:59.653112+0000","last_unstale":"2024-09-11T23:17:59.660595+0000","last_undegraded":"2024-09-11T23:17:59.660595+0000","last_fullsized":"2024-09-11T23:17:59.660595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:22.092955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.676373+0000","last_change":"2024-09-11T23:17:58.642732+0000","last_active":"2024-09-11T23:17:59.676373+0000","last_peered":"2024-09-11T23:17:59.676373+0000","last_clean":"2024-09-11T23:17:59.676373+0000","last_became_active":"2024-09-11T23:17:58.642411+0000","last_became_peered":"2024-09-11T23:17:58.642411+0000","last_unstale":"2024-09-11T23:17:59.676373+0000","last_undegraded":"2024-09-11T23:17:59.676373+0000","last_fullsized":"2024-09-11T23:17:59.676373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:21.084931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.656734+0000","last_change":"2024-09-11T23:17:59.652260+0000","last_active":"2024-09-11T23:17:59.656734+0000","last_peered":"2024-09-11T23:17:59.656734+0000","last_clean":"2024-09-11T23:17:59.656734+0000","last_became_active":"2024-09-11T23:17:59.651842+0000","last_became_peered":"2024-09-11T23:17:59.651842+0000","last_unstale":"2024-09-11T23:17:59.656734+0000","last_undegraded":"2024-09-11T23:17:59.656734+0000","last_fullsized":"2024-09-11T23:17:59.656734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:49.647417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.633101+0000","last_change":"2024-09-11T23:17:58.629743+0000","last_active":"2024-09-11T23:17:58.633101+0000","last_peered":"2024-09-11T23:17:58.633101+0000","last_clean":"2024-09-11T23:17:58.633101+0000","last_became_active":"2024-09-11T23:17:58.629379+0000","last_became_peered":"2024-09-11T23:17:58.629379+0000","last_unstale":"2024-09-11T23:17:58.633101+0000","last_undegraded":"2024-09-11T23:17:58.633101+0000","last_fullsized":"2024-09-11T23:17:58.633101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:28.903861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.619462+0000","last_change":"2024-09-11T23:17:58.619462+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.619462+0000","last_undegraded":"2024-09-11T23:17:58.619462+0000","last_fullsized":"2024-09-11T23:17:58.619462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.628052+0000","last_change":"2024-09-11T23:17:58.641139+0000","last_active":"2024-09-11T23:17:59.628052+0000","last_peered":"2024-09-11T23:17:59.628052+0000","last_clean":"2024-09-11T23:17:59.628052+0000","last_became_active":"2024-09-11T23:17:58.640813+0000","last_became_peered":"2024-09-11T23:17:58.640813+0000","last_unstale":"2024-09-11T23:17:59.628052+0000","last_undegraded":"2024-09-11T23:17:59.628052+0000","last_fullsized":"2024-09-11T23:17:59.628052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:02.505670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.668277+0000","last_change":"2024-09-11T23:17:59.661121+0000","last_active":"2024-09-11T23:17:59.668277+0000","last_peered":"2024-09-11T23:17:59.668277+0000","last_clean":"2024-09-11T23:17:59.668277+0000","last_became_active":"2024-09-11T23:17:59.660078+0000","last_became_peered":"2024-09-11T23:17:59.660078+0000","last_unstale":"2024-09-11T23:17:59.668277+0000","last_undegraded":"2024-09-11T23:17:59.668277+0000","last_fullsized":"2024-09-11T23:17:59.668277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.341838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.632833+0000","last_change":"2024-09-11T23:17:58.636194+0000","last_active":"2024-09-11T23:17:59.632833+0000","last_peered":"2024-09-11T23:17:59.632833+0000","last_clean":"2024-09-11T23:17:59.632833+0000","last_became_active":"2024-09-11T23:17:58.635885+0000","last_became_peered":"2024-09-11T23:17:58.635885+0000","last_unstale":"2024-09-11T23:17:59.632833+0000","last_undegraded":"2024-09-11T23:17:59.632833+0000","last_fullsized":"2024-09-11T23:17:59.632833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.654238+0000","last_change":"2024-09-11T23:17:59.648931+0000","last_active":"2024-09-11T23:17:59.654238+0000","last_peered":"2024-09-11T23:17:59.654238+0000","last_clean":"2024-09-11T23:17:59.654238+0000","last_became_active":"2024-09-11T23:17:59.646149+0000","last_became_peered":"2024-09-11T23:17:59.646149+0000","last_unstale":"2024-09-11T23:17:59.654238+0000","last_undegraded":"2024-09-11T23:17:59.654238+0000","last_fullsized":"2024-09-11T23:17:59.654238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:50.598149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669254+0000","last_change":"2024-09-11T23:17:58.631291+0000","last_active":"2024-09-11T23:18:00.669254+0000","last_peered":"2024-09-11T23:18:00.669254+0000","last_clean":"2024-09-11T23:18:00.669254+0000","last_became_active":"2024-09-11T23:17:58.630939+0000","last_became_peered":"2024-09-11T23:17:58.630939+0000","last_unstale":"2024-09-11T23:18:00.669254+0000","last_undegraded":"2024-09-11T23:18:00.669254+0000","last_fullsized":"2024-09-11T23:18:00.669254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:53:26.952229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.666524+0000","last_change":"2024-09-11T23:17:59.660874+0000","last_active":"2024-09-11T23:17:59.666524+0000","last_peered":"2024-09-11T23:17:59.666524+0000","last_clean":"2024-09-11T23:17:59.666524+0000","last_became_active":"2024-09-11T23:17:59.660613+0000","last_became_peered":"2024-09-11T23:17:59.660613+0000","last_unstale":"2024-09-11T23:17:59.666524+0000","last_undegraded":"2024-09-11T23:17:59.666524+0000","last_fullsized":"2024-09-11T23:17:59.666524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:50.844310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.673027+0000","last_change":"2024-09-11T23:17:58.635774+0000","last_active":"2024-09-11T23:17:59.673027+0000","last_peered":"2024-09-11T23:17:59.673027+0000","last_clean":"2024-09-11T23:17:59.673027+0000","last_became_active":"2024-09-11T23:17:58.634748+0000","last_became_peered":"2024-09-11T23:17:58.634748+0000","last_unstale":"2024-09-11T23:17:59.673027+0000","last_undegraded":"2024-09-11T23:17:59.673027+0000","last_fullsized":"2024-09-11T23:17:59.673027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:44.209956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.666227+0000","last_change":"2024-09-11T23:17:59.662246+0000","last_active":"2024-09-11T23:17:59.666227+0000","last_peered":"2024-09-11T23:17:59.666227+0000","last_clean":"2024-09-11T23:17:59.666227+0000","last_became_active":"2024-09-11T23:17:59.661866+0000","last_became_peered":"2024-09-11T23:17:59.661866+0000","last_unstale":"2024-09-11T23:17:59.666227+0000","last_undegraded":"2024-09-11T23:17:59.666227+0000","last_fullsized":"2024-09-11T23:17:59.666227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:09.804490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669504+0000","last_change":"2024-09-11T23:17:58.634201+0000","last_active":"2024-09-11T23:18:00.669504+0000","last_peered":"2024-09-11T23:18:00.669504+0000","last_clean":"2024-09-11T23:18:00.669504+0000","last_became_active":"2024-09-11T23:17:58.633865+0000","last_became_peered":"2024-09-11T23:17:58.633865+0000","last_unstale":"2024-09-11T23:18:00.669504+0000","last_undegraded":"2024-09-11T23:18:00.669504+0000","last_fullsized":"2024-09-11T23:18:00.669504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:12.634428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.672372+0000","last_change":"2024-09-11T23:17:59.668175+0000","last_active":"2024-09-11T23:17:59.672372+0000","last_peered":"2024-09-11T23:17:59.672372+0000","last_clean":"2024-09-11T23:17:59.672372+0000","last_became_active":"2024-09-11T23:17:59.665569+0000","last_became_peered":"2024-09-11T23:17:59.665569+0000","last_unstale":"2024-09-11T23:17:59.672372+0000","last_undegraded":"2024-09-11T23:17:59.672372+0000","last_fullsized":"2024-09-11T23:17:59.672372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:28.813283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.632336+0000","last_change":"2024-09-11T23:17:58.630807+0000","last_active":"2024-09-11T23:17:58.632336+0000","last_peered":"2024-09-11T23:17:58.632336+0000","last_clean":"2024-09-11T23:17:58.632336+0000","last_became_active":"2024-09-11T23:17:58.630491+0000","last_became_peered":"2024-09-11T23:17:58.630491+0000","last_unstale":"2024-09-11T23:17:58.632336+0000","last_undegraded":"2024-09-11T23:17:58.632336+0000","last_fullsized":"2024-09-11T23:17:58.632336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:28.903861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.652143+0000","last_change":"2024-09-11T23:17:59.643945+0000","last_active":"2024-09-11T23:17:59.652143+0000","last_peered":"2024-09-11T23:17:59.652143+0000","last_clean":"2024-09-11T23:17:59.652143+0000","last_became_active":"2024-09-11T23:17:59.643358+0000","last_became_peered":"2024-09-11T23:17:59.643358+0000","last_unstale":"2024-09-11T23:17:59.652143+0000","last_undegraded":"2024-09-11T23:17:59.652143+0000","last_fullsized":"2024-09-11T23:17:59.652143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:05.573887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670008+0000","last_change":"2024-09-11T23:17:58.645520+0000","last_active":"2024-09-11T23:18:00.670008+0000","last_peered":"2024-09-11T23:18:00.670008+0000","last_clean":"2024-09-11T23:18:00.670008+0000","last_became_active":"2024-09-11T23:17:58.645211+0000","last_became_peered":"2024-09-11T23:17:58.645211+0000","last_unstale":"2024-09-11T23:18:00.670008+0000","last_undegraded":"2024-09-11T23:18:00.670008+0000","last_fullsized":"2024-09-11T23:18:00.670008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:02.827617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.673641+0000","last_change":"2024-09-11T23:17:59.669515+0000","last_active":"2024-09-11T23:17:59.673641+0000","last_peered":"2024-09-11T23:17:59.673641+0000","last_clean":"2024-09-11T23:17:59.673641+0000","last_became_active":"2024-09-11T23:17:59.669182+0000","last_became_peered":"2024-09-11T23:17:59.669182+0000","last_unstale":"2024-09-11T23:17:59.673641+0000","last_undegraded":"2024-09-11T23:17:59.673641+0000","last_fullsized":"2024-09-11T23:17:59.673641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:15.213721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.644313+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:17:59.644313+0000","last_peered":"2024-09-11T23:17:59.644313+0000","last_clean":"2024-09-11T23:17:59.644313+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:17:59.644313+0000","last_undegraded":"2024-09-11T23:17:59.644313+0000","last_fullsized":"2024-09-11T23:17:59.644313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.627661+0000","last_change":"2024-09-11T23:17:58.634769+0000","last_active":"2024-09-11T23:17:59.627661+0000","last_peered":"2024-09-11T23:17:59.627661+0000","last_clean":"2024-09-11T23:17:59.627661+0000","last_became_active":"2024-09-11T23:17:58.634321+0000","last_became_peered":"2024-09-11T23:17:58.634321+0000","last_unstale":"2024-09-11T23:17:59.627661+0000","last_undegraded":"2024-09-11T23:17:59.627661+0000","last_fullsized":"2024-09-11T23:17:59.627661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:21.084931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669925+0000","last_change":"2024-09-11T23:17:59.659482+0000","last_active":"2024-09-11T23:18:00.669925+0000","last_peered":"2024-09-11T23:18:00.669925+0000","last_clean":"2024-09-11T23:18:00.669925+0000","last_became_active":"2024-09-11T23:17:59.659148+0000","last_became_peered":"2024-09-11T23:17:59.659148+0000","last_unstale":"2024-09-11T23:18:00.669925+0000","last_undegraded":"2024-09-11T23:18:00.669925+0000","last_fullsized":"2024-09-11T23:18:00.669925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:22.419970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.644252+0000","last_change":"2024-09-11T23:17:58.636656+0000","last_active":"2024-09-11T23:17:59.644252+0000","last_peered":"2024-09-11T23:17:59.644252+0000","last_clean":"2024-09-11T23:17:59.644252+0000","last_became_active":"2024-09-11T23:17:58.636363+0000","last_became_peered":"2024-09-11T23:17:58.636363+0000","last_unstale":"2024-09-11T23:17:59.644252+0000","last_undegraded":"2024-09-11T23:17:59.644252+0000","last_fullsized":"2024-09-11T23:17:59.644252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:04.565864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.621230+0000","last_change":"2024-09-11T23:17:58.621230+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.621230+0000","last_undegraded":"2024-09-11T23:17:58.621230+0000","last_fullsized":"2024-09-11T23:17:58.621230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669359+0000","last_change":"2024-09-11T23:17:58.642240+0000","last_active":"2024-09-11T23:18:00.669359+0000","last_peered":"2024-09-11T23:18:00.669359+0000","last_clean":"2024-09-11T23:18:00.669359+0000","last_became_active":"2024-09-11T23:17:58.641996+0000","last_became_peered":"2024-09-11T23:17:58.641996+0000","last_unstale":"2024-09-11T23:18:00.669359+0000","last_undegraded":"2024-09-11T23:18:00.669359+0000","last_fullsized":"2024-09-11T23:18:00.669359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:29:09.781577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.622052+0000","last_change":"2024-09-11T23:17:58.622052+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.622052+0000","last_undegraded":"2024-09-11T23:17:58.622052+0000","last_fullsized":"2024-09-11T23:17:58.622052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.628495+0000","last_change":"2024-09-11T23:17:58.641231+0000","last_active":"2024-09-11T23:17:59.628495+0000","last_peered":"2024-09-11T23:17:59.628495+0000","last_clean":"2024-09-11T23:17:59.628495+0000","last_became_active":"2024-09-11T23:17:58.640860+0000","last_became_peered":"2024-09-11T23:17:58.640860+0000","last_unstale":"2024-09-11T23:17:59.628495+0000","last_undegraded":"2024-09-11T23:17:59.628495+0000","last_fullsized":"2024-09-11T23:17:59.628495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.648713+0000","last_change":"2024-09-11T23:17:59.643898+0000","last_active":"2024-09-11T23:17:59.648713+0000","last_peered":"2024-09-11T23:17:59.648713+0000","last_clean":"2024-09-11T23:17:59.648713+0000","last_became_active":"2024-09-11T23:17:59.643471+0000","last_became_peered":"2024-09-11T23:17:59.643471+0000","last_unstale":"2024-09-11T23:17:59.648713+0000","last_undegraded":"2024-09-11T23:17:59.648713+0000","last_fullsized":"2024-09-11T23:17:59.648713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:36.096761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.643940+0000","last_change":"2024-09-11T23:17:58.640659+0000","last_active":"2024-09-11T23:17:58.643940+0000","last_peered":"2024-09-11T23:17:58.643940+0000","last_clean":"2024-09-11T23:17:58.643940+0000","last_became_active":"2024-09-11T23:17:58.640358+0000","last_became_peered":"2024-09-11T23:17:58.640358+0000","last_unstale":"2024-09-11T23:17:58.643940+0000","last_undegraded":"2024-09-11T23:17:58.643940+0000","last_fullsized":"2024-09-11T23:17:58.643940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:23.106037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.668652+0000","last_change":"2024-09-11T23:17:59.659233+0000","last_active":"2024-09-11T23:17:59.668652+0000","last_peered":"2024-09-11T23:17:59.668652+0000","last_clean":"2024-09-11T23:17:59.668652+0000","last_became_active":"2024-09-11T23:17:59.655952+0000","last_became_peered":"2024-09-11T23:17:59.655952+0000","last_unstale":"2024-09-11T23:17:59.668652+0000","last_undegraded":"2024-09-11T23:17:59.668652+0000","last_fullsized":"2024-09-11T23:17:59.668652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.193032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.648948+0000","last_change":"2024-09-11T23:17:58.642080+0000","last_active":"2024-09-11T23:17:59.648948+0000","last_peered":"2024-09-11T23:17:59.648948+0000","last_clean":"2024-09-11T23:17:59.648948+0000","last_became_active":"2024-09-11T23:17:58.641752+0000","last_became_peered":"2024-09-11T23:17:58.641752+0000","last_unstale":"2024-09-11T23:17:59.648948+0000","last_undegraded":"2024-09-11T23:17:59.648948+0000","last_fullsized":"2024-09-11T23:17:59.648948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:30.642868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.620511+0000","last_change":"2024-09-11T23:17:58.620511+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.620511+0000","last_undegraded":"2024-09-11T23:17:58.620511+0000","last_fullsized":"2024-09-11T23:17:58.620511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.635264+0000","last_change":"2024-09-11T23:17:58.633818+0000","last_active":"2024-09-11T23:17:58.635264+0000","last_peered":"2024-09-11T23:17:58.635264+0000","last_clean":"2024-09-11T23:17:58.635264+0000","last_became_active":"2024-09-11T23:17:58.633550+0000","last_became_peered":"2024-09-11T23:17:58.633550+0000","last_unstale":"2024-09-11T23:17:58.635264+0000","last_undegraded":"2024-09-11T23:17:58.635264+0000","last_fullsized":"2024-09-11T23:17:58.635264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:44.209956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671118+0000","last_change":"2024-09-11T23:17:59.650990+0000","last_active":"2024-09-11T23:18:00.671118+0000","last_peered":"2024-09-11T23:18:00.671118+0000","last_clean":"2024-09-11T23:18:00.671118+0000","last_became_active":"2024-09-11T23:17:59.650684+0000","last_became_peered":"2024-09-11T23:17:59.650684+0000","last_unstale":"2024-09-11T23:18:00.671118+0000","last_undegraded":"2024-09-11T23:18:00.671118+0000","last_fullsized":"2024-09-11T23:18:00.671118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:17.470426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.671564+0000","last_change":"2024-09-11T23:17:58.639477+0000","last_active":"2024-09-11T23:17:59.671564+0000","last_peered":"2024-09-11T23:17:59.671564+0000","last_clean":"2024-09-11T23:17:59.671564+0000","last_became_active":"2024-09-11T23:17:58.639168+0000","last_became_peered":"2024-09-11T23:17:58.639168+0000","last_unstale":"2024-09-11T23:17:59.671564+0000","last_undegraded":"2024-09-11T23:17:59.671564+0000","last_fullsized":"2024-09-11T23:17:59.671564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.630832+0000","last_change":"2024-09-11T23:17:58.630832+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.630832+0000","last_undegraded":"2024-09-11T23:17:58.630832+0000","last_fullsized":"2024-09-11T23:17:58.630832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.644090+0000","last_change":"2024-09-11T23:17:58.640620+0000","last_active":"2024-09-11T23:17:59.644090+0000","last_peered":"2024-09-11T23:17:59.644090+0000","last_clean":"2024-09-11T23:17:59.644090+0000","last_became_active":"2024-09-11T23:17:58.640367+0000","last_became_peered":"2024-09-11T23:17:58.640367+0000","last_unstale":"2024-09-11T23:17:59.644090+0000","last_undegraded":"2024-09-11T23:17:59.644090+0000","last_fullsized":"2024-09-11T23:17:59.644090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.907527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.639105+0000","last_change":"2024-09-11T23:17:59.635712+0000","last_active":"2024-09-11T23:17:59.639105+0000","last_peered":"2024-09-11T23:17:59.639105+0000","last_clean":"2024-09-11T23:17:59.639105+0000","last_became_active":"2024-09-11T23:17:59.635303+0000","last_became_peered":"2024-09-11T23:17:59.635303+0000","last_unstale":"2024-09-11T23:17:59.639105+0000","last_undegraded":"2024-09-11T23:17:59.639105+0000","last_fullsized":"2024-09-11T23:17:59.639105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:49.396092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.643771+0000","last_change":"2024-09-11T23:17:58.639596+0000","last_active":"2024-09-11T23:17:58.643771+0000","last_peered":"2024-09-11T23:17:58.643771+0000","last_clean":"2024-09-11T23:17:58.643771+0000","last_became_active":"2024-09-11T23:17:58.639333+0000","last_became_peered":"2024-09-11T23:17:58.639333+0000","last_unstale":"2024-09-11T23:17:58.643771+0000","last_undegraded":"2024-09-11T23:17:58.643771+0000","last_fullsized":"2024-09-11T23:17:58.643771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:09.475238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669868+0000","last_change":"2024-09-11T23:17:59.643630+0000","last_active":"2024-09-11T23:18:00.669868+0000","last_peered":"2024-09-11T23:18:00.669868+0000","last_clean":"2024-09-11T23:18:00.669868+0000","last_became_active":"2024-09-11T23:17:59.643080+0000","last_became_peered":"2024-09-11T23:17:59.643080+0000","last_unstale":"2024-09-11T23:18:00.669868+0000","last_undegraded":"2024-09-11T23:18:00.669868+0000","last_fullsized":"2024-09-11T23:18:00.669868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:59.272347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.635394+0000","last_change":"2024-09-11T23:17:58.634155+0000","last_active":"2024-09-11T23:17:58.635394+0000","last_peered":"2024-09-11T23:17:58.635394+0000","last_clean":"2024-09-11T23:17:58.635394+0000","last_became_active":"2024-09-11T23:17:58.633898+0000","last_became_peered":"2024-09-11T23:17:58.633898+0000","last_unstale":"2024-09-11T23:17:58.635394+0000","last_undegraded":"2024-09-11T23:17:58.635394+0000","last_fullsized":"2024-09-11T23:17:58.635394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:48.388069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670728+0000","last_change":"2024-09-11T23:17:59.648274+0000","last_active":"2024-09-11T23:18:00.670728+0000","last_peered":"2024-09-11T23:18:00.670728+0000","last_clean":"2024-09-11T23:18:00.670728+0000","last_became_active":"2024-09-11T23:17:59.646482+0000","last_became_peered":"2024-09-11T23:17:59.646482+0000","last_unstale":"2024-09-11T23:18:00.670728+0000","last_undegraded":"2024-09-11T23:18:00.670728+0000","last_fullsized":"2024-09-11T23:18:00.670728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:06.041413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.672611+0000","last_change":"2024-09-11T23:17:58.644868+0000","last_active":"2024-09-11T23:17:59.672611+0000","last_peered":"2024-09-11T23:17:59.672611+0000","last_clean":"2024-09-11T23:17:59.672611+0000","last_became_active":"2024-09-11T23:17:58.644006+0000","last_became_peered":"2024-09-11T23:17:58.644006+0000","last_unstale":"2024-09-11T23:17:59.672611+0000","last_undegraded":"2024-09-11T23:17:59.672611+0000","last_fullsized":"2024-09-11T23:17:59.672611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:23.261838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.653889+0000","last_change":"2024-09-11T23:17:59.642489+0000","last_active":"2024-09-11T23:17:59.653889+0000","last_peered":"2024-09-11T23:17:59.653889+0000","last_clean":"2024-09-11T23:17:59.653889+0000","last_became_active":"2024-09-11T23:17:59.642155+0000","last_became_peered":"2024-09-11T23:17:59.642155+0000","last_unstale":"2024-09-11T23:17:59.653889+0000","last_undegraded":"2024-09-11T23:17:59.653889+0000","last_fullsized":"2024-09-11T23:17:59.653889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:57.703691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.644464+0000","last_change":"2024-09-11T23:17:59.636661+0000","last_active":"2024-09-11T23:17:59.644464+0000","last_peered":"2024-09-11T23:17:59.644464+0000","last_clean":"2024-09-11T23:17:59.644464+0000","last_became_active":"2024-09-11T23:17:59.635613+0000","last_became_peered":"2024-09-11T23:17:59.635613+0000","last_unstale":"2024-09-11T23:17:59.644464+0000","last_undegraded":"2024-09-11T23:17:59.644464+0000","last_fullsized":"2024-09-11T23:17:59.644464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:57.703691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.672563+0000","last_change":"2024-09-11T23:17:58.646998+0000","last_active":"2024-09-11T23:17:59.672563+0000","last_peered":"2024-09-11T23:17:59.672563+0000","last_clean":"2024-09-11T23:17:59.672563+0000","last_became_active":"2024-09-11T23:17:58.646666+0000","last_became_peered":"2024-09-11T23:17:58.646666+0000","last_unstale":"2024-09-11T23:17:59.672563+0000","last_undegraded":"2024-09-11T23:17:59.672563+0000","last_fullsized":"2024-09-11T23:17:59.672563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:57.415598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.652120+0000","last_change":"2024-09-11T23:17:59.637292+0000","last_active":"2024-09-11T23:17:59.652120+0000","last_peered":"2024-09-11T23:17:59.652120+0000","last_clean":"2024-09-11T23:17:59.652120+0000","last_became_active":"2024-09-11T23:17:59.637028+0000","last_became_peered":"2024-09-11T23:17:59.637028+0000","last_unstale":"2024-09-11T23:17:59.652120+0000","last_undegraded":"2024-09-11T23:17:59.652120+0000","last_fullsized":"2024-09-11T23:17:59.652120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:30.915550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-11T23:17:59.673779+0000","last_change":"2024-09-11T23:17:58.641586+0000","last_active":"2024-09-11T23:17:59.673779+0000","last_peered":"2024-09-11T23:17:59.673779+0000","last_clean":"2024-09-11T23:17:59.673779+0000","last_became_active":"2024-09-11T23:17:58.636670+0000","last_became_peered":"2024-09-11T23:17:58.636670+0000","last_unstale":"2024-09-11T23:17:59.673779+0000","last_undegraded":"2024-09-11T23:17:59.673779+0000","last_fullsized":"2024-09-11T23:17:59.673779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:49.590126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-11T23:17:58.624249+0000","last_change":"2024-09-11T23:17:58.624249+0000","last_active":"2024-09-11T23:17:58.610546+0000","last_peered":"2024-09-11T23:17:58.610546+0000","last_clean":"2024-09-11T23:17:58.610546+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:17:58.624249+0000","last_undegraded":"2024-09-11T23:17:58.624249+0000","last_fullsized":"2024-09-11T23:17:58.624249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671062+0000","last_change":"2024-09-11T23:17:58.646365+0000","last_active":"2024-09-11T23:18:00.671062+0000","last_peered":"2024-09-11T23:18:00.671062+0000","last_clean":"2024-09-11T23:18:00.671062+0000","last_became_active":"2024-09-11T23:17:58.646119+0000","last_became_peered":"2024-09-11T23:17:58.646119+0000","last_unstale":"2024-09-11T23:18:00.671062+0000","last_undegraded":"2024-09-11T23:18:00.671062+0000","last_fullsized":"2024-09-11T23:18:00.671062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:12.634428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670990+0000","last_change":"2024-09-11T23:17:59.654946+0000","last_active":"2024-09-11T23:18:00.670990+0000","last_peered":"2024-09-11T23:18:00.670990+0000","last_clean":"2024-09-11T23:18:00.670990+0000","last_became_active":"2024-09-11T23:17:59.654732+0000","last_became_peered":"2024-09-11T23:17:59.654732+0000","last_unstale":"2024-09-11T23:18:00.670990+0000","last_undegraded":"2024-09-11T23:18:00.670990+0000","last_fullsized":"2024-09-11T23:18:00.670990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:28.095341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T23:17:58.645310+0000","last_change":"2024-09-11T23:17:58.638337+0000","last_active":"2024-09-11T23:17:58.645310+0000","last_peered":"2024-09-11T23:17:58.645310+0000","last_clean":"2024-09-11T23:17:58.645310+0000","last_became_active":"2024-09-11T23:17:58.638071+0000","last_became_peered":"2024-09-11T23:17:58.638071+0000","last_unstale":"2024-09-11T23:17:58.645310+0000","last_undegraded":"2024-09-11T23:17:58.645310+0000","last_fullsized":"2024-09-11T23:17:58.645310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:44.209956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476742,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":653205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476741,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":62837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":62837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476740,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":62837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":180224,"data_stored":56562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":646930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":77524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":75912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:18:04.616 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-11T23:18:04.616 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:17:58.622794+0000', 'last_change': '2024-09-11T23:17:58.622794+0000', 'last_active': '2024-09-11T23:17:58.610546+0000', 'last_peered': '2024-09-11T23:17:58.610546+0000', 'last_clean': '2024-09-11T23:17:58.610546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:17:58.622794+0000', 'last_undegraded': '2024-09-11T23:17:58.622794+0000', 'last_fullsized': '2024-09-11T23:17:58.622794+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_clean_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:18:04.616 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-09-11T23:18:04.616 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:17:58.629373+0000', 'last_change': '2024-09-11T23:17:58.629373+0000', 'last_active': '2024-09-11T23:17:58.610546+0000', 'last_peered': '2024-09-11T23:17:58.610546+0000', 'last_clean': '2024-09-11T23:17:58.610546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:17:58.629373+0000', 'last_undegraded': '2024-09-11T23:17:58.629373+0000', 'last_fullsized': '2024-09-11T23:17:58.629373+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_clean_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:04.616 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-09-11T23:18:04.616 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:17:58.630283+0000', 'last_change': '2024-09-11T23:17:58.630283+0000', 'last_active': '2024-09-11T23:17:58.610546+0000', 'last_peered': '2024-09-11T23:17:58.610546+0000', 'last_clean': '2024-09-11T23:17:58.610546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:17:58.630283+0000', 'last_undegraded': '2024-09-11T23:17:58.630283+0000', 'last_fullsized': '2024-09-11T23:17:58.630283+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_clean_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:04.616 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-11T23:18:04.616 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:17:58.620642+0000', 'last_change': '2024-09-11T23:17:58.620642+0000', 'last_active': '2024-09-11T23:17:58.610546+0000', 'last_peered': '2024-09-11T23:17:58.610546+0000', 'last_clean': '2024-09-11T23:17:58.610546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:17:58.620642+0000', 'last_undegraded': '2024-09-11T23:17:58.620642+0000', 'last_fullsized': '2024-09-11T23:17:58.620642+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_clean_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:18:04.616 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-09-11T23:18:04.617 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:17:58.628788+0000', 'last_change': '2024-09-11T23:17:58.628788+0000', 'last_active': '2024-09-11T23:17:58.610546+0000', 'last_peered': '2024-09-11T23:17:58.610546+0000', 'last_clean': '2024-09-11T23:17:58.610546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:17:58.628788+0000', 'last_undegraded': '2024-09-11T23:17:58.628788+0000', 'last_fullsized': '2024-09-11T23:17:58.628788+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_clean_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:04.617 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-09-11T23:18:04.617 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:17:58.621631+0000', 'last_change': '2024-09-11T23:17:58.621631+0000', 'last_active': '2024-09-11T23:17:58.610546+0000', 'last_peered': '2024-09-11T23:17:58.610546+0000', 'last_clean': '2024-09-11T23:17:58.610546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:17:58.621631+0000', 'last_undegraded': '2024-09-11T23:17:58.621631+0000', 'last_fullsized': '2024-09-11T23:17:58.621631+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_clean_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:18:04.617 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-09-11T23:18:04.617 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:17:58.628159+0000', 'last_change': '2024-09-11T23:17:58.628159+0000', 'last_active': '2024-09-11T23:17:58.610546+0000', 'last_peered': '2024-09-11T23:17:58.610546+0000', 'last_clean': '2024-09-11T23:17:58.610546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:17:58.628159+0000', 'last_undegraded': '2024-09-11T23:17:58.628159+0000', 'last_fullsized': '2024-09-11T23:17:58.628159+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_clean_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:04.617 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-11T23:18:04.617 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:17:58.620315+0000', 'last_change': '2024-09-11T23:17:58.620315+0000', 'last_active': '2024-09-11T23:17:58.610546+0000', 'last_peered': '2024-09-11T23:17:58.610546+0000', 'last_clean': '2024-09-11T23:17:58.610546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:17:58.620315+0000', 'last_undegraded': '2024-09-11T23:17:58.620315+0000', 'last_fullsized': '2024-09-11T23:17:58.620315+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_clean_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:04.617 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-11T23:18:04.617 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:17:58.621139+0000', 'last_change': '2024-09-11T23:17:58.621139+0000', 'last_active': '2024-09-11T23:17:58.610546+0000', 'last_peered': '2024-09-11T23:17:58.610546+0000', 'last_clean': '2024-09-11T23:17:58.610546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:17:58.621139+0000', 'last_undegraded': '2024-09-11T23:17:58.621139+0000', 'last_fullsized': '2024-09-11T23:17:58.621139+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_clean_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:18:04.617 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-11T23:18:04.617 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:17:58.619425+0000', 'last_change': '2024-09-11T23:17:58.619425+0000', 'last_active': '2024-09-11T23:17:58.610546+0000', 'last_peered': '2024-09-11T23:17:58.610546+0000', 'last_clean': '2024-09-11T23:17:58.610546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:17:58.619425+0000', 'last_undegraded': '2024-09-11T23:17:58.619425+0000', 'last_fullsized': '2024-09-11T23:17:58.619425+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_clean_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:04.618 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-11T23:18:04.618 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:17:58.619462+0000', 'last_change': '2024-09-11T23:17:58.619462+0000', 'last_active': '2024-09-11T23:17:58.610546+0000', 'last_peered': '2024-09-11T23:17:58.610546+0000', 'last_clean': '2024-09-11T23:17:58.610546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:17:58.619462+0000', 'last_undegraded': '2024-09-11T23:17:58.619462+0000', 'last_fullsized': '2024-09-11T23:17:58.619462+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_clean_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:04.618 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-11T23:18:04.618 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:17:58.621230+0000', 'last_change': '2024-09-11T23:17:58.621230+0000', 'last_active': '2024-09-11T23:17:58.610546+0000', 'last_peered': '2024-09-11T23:17:58.610546+0000', 'last_clean': '2024-09-11T23:17:58.610546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:17:58.621230+0000', 'last_undegraded': '2024-09-11T23:17:58.621230+0000', 'last_fullsized': '2024-09-11T23:17:58.621230+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_clean_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:04.618 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-11T23:18:04.618 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:17:58.622052+0000', 'last_change': '2024-09-11T23:17:58.622052+0000', 'last_active': '2024-09-11T23:17:58.610546+0000', 'last_peered': '2024-09-11T23:17:58.610546+0000', 'last_clean': '2024-09-11T23:17:58.610546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:17:58.622052+0000', 'last_undegraded': '2024-09-11T23:17:58.622052+0000', 'last_fullsized': '2024-09-11T23:17:58.622052+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_clean_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:18:04.618 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-11T23:18:04.618 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:17:58.620511+0000', 'last_change': '2024-09-11T23:17:58.620511+0000', 'last_active': '2024-09-11T23:17:58.610546+0000', 'last_peered': '2024-09-11T23:17:58.610546+0000', 'last_clean': '2024-09-11T23:17:58.610546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:17:58.620511+0000', 'last_undegraded': '2024-09-11T23:17:58.620511+0000', 'last_fullsized': '2024-09-11T23:17:58.620511+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_clean_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:18:04.619 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-11T23:18:04.619 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:17:58.630832+0000', 'last_change': '2024-09-11T23:17:58.630832+0000', 'last_active': '2024-09-11T23:17:58.610546+0000', 'last_peered': '2024-09-11T23:17:58.610546+0000', 'last_clean': '2024-09-11T23:17:58.610546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:17:58.630832+0000', 'last_undegraded': '2024-09-11T23:17:58.630832+0000', 'last_fullsized': '2024-09-11T23:17:58.630832+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_clean_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:04.619 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-11T23:18:04.619 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:17:58.624249+0000', 'last_change': '2024-09-11T23:17:58.624249+0000', 'last_active': '2024-09-11T23:17:58.610546+0000', 'last_peered': '2024-09-11T23:17:58.610546+0000', 'last_clean': '2024-09-11T23:17:58.610546+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:17:58.624249+0000', 'last_undegraded': '2024-09-11T23:17:58.624249+0000', 'last_fullsized': '2024-09-11T23:17:58.624249+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'last_clean_scrub_stamp': '2024-09-11T23:17:58.610546+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:18:04.619 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T23:18:04.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.803+0000 7f4c85e00640 1 Processor -- start 2024-09-11T23:18:04.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.803+0000 7f4c85e00640 1 -- start start 2024-09-11T23:18:04.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.804+0000 7f4c85e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4c8015e940 0x7f4c800d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.804+0000 7f4c85e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c8015ed20 0x7f4c800d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.804+0000 7f4c85e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c800b7170 con 0x7f4c800cef90 2024-09-11T23:18:04.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.804+0000 7f4c85e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4c800d1ae0 con 0x7f4c8015e940 2024-09-11T23:18:04.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.804+0000 7f4c85e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4c800b7aa0 con 0x7f4c8015ed20 2024-09-11T23:18:04.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4c800cef90 0x7f4c800b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46782/0 (socket says 172.21.15.144:46782) 2024-09-11T23:18:04.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7f400640 1 -- 172.21.15.144:0/4212596478 learned_addr learned my addr 172.21.15.144:0/4212596478 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:04.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7ea00640 1 --2- 172.21.15.144:0/4212596478 >> v2:172.21.15.165:3300/0 conn(0x7f4c8015e940 0x7f4c800d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7e000640 1 --2- 172.21.15.144:0/4212596478 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c8015ed20 0x7f4c800d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7d600640 1 -- 172.21.15.144:0/4212596478 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 834538544 0 0) 0x7f4c78001490 con 0x7f4c800cef90 2024-09-11T23:18:04.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7d600640 1 -- 172.21.15.144:0/4212596478 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c64003520 con 0x7f4c800cef90 2024-09-11T23:18:04.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7d600640 1 -- 172.21.15.144:0/4212596478 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2311584818 0 0) 0x7f4c64003520 con 0x7f4c800cef90 2024-09-11T23:18:04.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7d600640 1 -- 172.21.15.144:0/4212596478 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c8015ed20 msgr2=0x7f4c800d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:04.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7d600640 1 --2- 172.21.15.144:0/4212596478 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c8015ed20 0x7f4c800d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7d600640 1 -- 172.21.15.144:0/4212596478 >> v2:172.21.15.165:3300/0 conn(0x7f4c8015e940 msgr2=0x7f4c800d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:04.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7d600640 1 --2- 172.21.15.144:0/4212596478 >> v2:172.21.15.165:3300/0 conn(0x7f4c8015e940 0x7f4c800d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7d600640 1 -- 172.21.15.144:0/4212596478 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c800d3660 con 0x7f4c800cef90 2024-09-11T23:18:04.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7d600640 1 -- 172.21.15.144:0/4212596478 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f4c78001bc0 con 0x7f4c800cef90 2024-09-11T23:18:04.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7e000640 1 --2- 172.21.15.144:0/4212596478 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c8015ed20 0x7f4c800d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:04.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7ea00640 1 --2- 172.21.15.144:0/4212596478 >> v2:172.21.15.165:3300/0 conn(0x7f4c8015e940 0x7f4c800d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:04.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7d600640 1 -- 172.21.15.144:0/4212596478 >> v1:172.21.15.144:6789/0 conn(0x7f4c800cef90 legacy=0x7f4c800b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7d600640 1 --2- 172.21.15.144:0/4212596478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c640039b0 0x7f4c64003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7d600640 1 --2- 172.21.15.144:0/4212596478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c64004800 0x7f4c64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7d600640 1 --2- 172.21.15.144:0/4212596478 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c8015ed20 0x7f4c640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7d600640 1 -- 172.21.15.144:0/4212596478 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4c800b7aa0 con 0x7f4c640039b0 2024-09-11T23:18:04.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7d600640 1 -- 172.21.15.144:0/4212596478 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6400b9c0 con 0x7f4c64004800 2024-09-11T23:18:04.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.805+0000 7f4c7d600640 1 -- 172.21.15.144:0/4212596478 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4c6400bb40 con 0x7f4c8015ed20 2024-09-11T23:18:04.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.806+0000 7f4c7ea00640 1 --2- 172.21.15.144:0/4212596478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c640039b0 0x7f4c64003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.806+0000 7f4c7f400640 1 --2- 172.21.15.144:0/4212596478 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c8015ed20 0x7f4c640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.806+0000 7f4c7e000640 1 --2- 172.21.15.144:0/4212596478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c64004800 0x7f4c64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.806+0000 7f4c7ea00640 1 -- 172.21.15.144:0/4212596478 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c8015ed20 msgr2=0x7f4c640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:04.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.806+0000 7f4c7ea00640 1 --2- 172.21.15.144:0/4212596478 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c8015ed20 0x7f4c640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.806+0000 7f4c7ea00640 1 -- 172.21.15.144:0/4212596478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c64004800 msgr2=0x7f4c64004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:04.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.806+0000 7f4c7ea00640 1 --2- 172.21.15.144:0/4212596478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c64004800 0x7f4c64004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.806+0000 7f4c7ea00640 1 -- 172.21.15.144:0/4212596478 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c64003520 con 0x7f4c640039b0 2024-09-11T23:18:04.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.806+0000 7f4c7e000640 1 --2- 172.21.15.144:0/4212596478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c64004800 0x7f4c64004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:04.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.807+0000 7f4c7ea00640 1 --2- 172.21.15.144:0/4212596478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c640039b0 0x7f4c64003dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009c90 tx=0x7f4c64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e3a437f2da4e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:04.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.807+0000 7f4c7d600640 1 -- 172.21.15.144:0/4212596478 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70036070 con 0x7f4c640039b0 2024-09-11T23:18:04.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.807+0000 7f4c7d600640 1 -- 172.21.15.144:0/4212596478 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c70031400 con 0x7f4c640039b0 2024-09-11T23:18:04.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.807+0000 7f4c7d600640 1 -- 172.21.15.144:0/4212596478 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70009860 con 0x7f4c640039b0 2024-09-11T23:18:04.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.808+0000 7f4c85e00640 1 -- 172.21.15.144:0/4212596478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c640039b0 msgr2=0x7f4c64003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.808+0000 7f4c85e00640 1 --2- 172.21.15.144:0/4212596478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c640039b0 0x7f4c64003dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009c90 tx=0x7f4c64005830 comp rx=0 tx=0).stop 2024-09-11T23:18:04.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.808+0000 7f4c7f400640 1 -- 172.21.15.144:0/4212596478 reap_dead start 2024-09-11T23:18:04.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.808+0000 7f4c85e00640 1 -- 172.21.15.144:0/4212596478 shutdown_connections 2024-09-11T23:18:04.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.808+0000 7f4c85e00640 1 -- 172.21.15.144:0/4212596478 >> 172.21.15.144:0/4212596478 conn(0x7f4c800b6240 msgr2=0x7f4c800b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:04.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.808+0000 7f4c85e00640 1 -- 172.21.15.144:0/4212596478 shutdown_connections 2024-09-11T23:18:04.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.808+0000 7f4c85e00640 1 -- 172.21.15.144:0/4212596478 wait complete. 2024-09-11T23:18:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.809+0000 7f4c85e00640 1 Processor -- start 2024-09-11T23:18:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.810+0000 7f4c85e00640 1 -- start start 2024-09-11T23:18:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.810+0000 7f4c85e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c640039b0 0x7f4c8015b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.810+0000 7f4c85e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c80157f20 0x7f4c801577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.810+0000 7f4c85e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c80159520 0x7f4c800b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.810+0000 7f4c85e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4c800d3f00 con 0x7f4c80159520 2024-09-11T23:18:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.810+0000 7f4c85e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4c800d3c20 con 0x7f4c640039b0 2024-09-11T23:18:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.810+0000 7f4c85e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4c800d3310 con 0x7f4c80157f20 2024-09-11T23:18:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.811+0000 7f4c7f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c80159520 0x7f4c800b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.811+0000 7f4c7f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c80159520 0x7f4c800b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49104/0 (socket says 172.21.15.144:49104) 2024-09-11T23:18:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.811+0000 7f4c7f400640 1 -- 172.21.15.144:0/4229658745 learned_addr learned my addr 172.21.15.144:0/4229658745 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.811+0000 7f4c7e000640 1 --2- 172.21.15.144:0/4229658745 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c80157f20 0x7f4c801577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.811+0000 7f4c7ea00640 1 --2- 172.21.15.144:0/4229658745 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c640039b0 0x7f4c8015b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.811+0000 7f4c7f400640 1 -- 172.21.15.144:0/4229658745 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c80157f20 msgr2=0x7f4c801577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.811+0000 7f4c7f400640 1 --2- 172.21.15.144:0/4229658745 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c80157f20 0x7f4c801577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.811+0000 7f4c7f400640 1 -- 172.21.15.144:0/4229658745 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c640039b0 msgr2=0x7f4c8015b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:04.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.811+0000 7f4c7f400640 1 --2- 172.21.15.144:0/4229658745 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c640039b0 0x7f4c8015b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:04.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.811+0000 7f4c7f400640 1 -- 172.21.15.144:0/4229658745 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c800c9000 con 0x7f4c80159520 2024-09-11T23:18:04.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.811+0000 7f4c7f400640 1 --2- 172.21.15.144:0/4229658745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c80159520 0x7f4c800b5220 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4c80069f60 tx=0x7f4c7800aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:04.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.812+0000 7f4c77400640 1 -- 172.21.15.144:0/4229658745 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c009860 con 0x7f4c80159520 2024-09-11T23:18:04.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.812+0000 7f4c77400640 1 -- 172.21.15.144:0/4229658745 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c78018070 con 0x7f4c80159520 2024-09-11T23:18:04.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.812+0000 7f4c77400640 1 -- 172.21.15.144:0/4229658745 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78007980 con 0x7f4c80159520 2024-09-11T23:18:04.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.812+0000 7f4c85e00640 1 -- 172.21.15.144:0/4229658745 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c801f8510 con 0x7f4c80159520 2024-09-11T23:18:04.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.812+0000 7f4c85e00640 1 -- 172.21.15.144:0/4229658745 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c801f8ad0 con 0x7f4c80159520 2024-09-11T23:18:04.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.813+0000 7f4c85e00640 1 -- 172.21.15.144:0/4229658745 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c8015dd00 con 0x7f4c80159520 2024-09-11T23:18:04.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.814+0000 7f4c77400640 1 -- 172.21.15.144:0/4229658745 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c7801c410 con 0x7f4c80159520 2024-09-11T23:18:04.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.814+0000 7f4c77400640 1 --2- 172.21.15.144:0/4229658745 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4c6006be60 0x7f4c6006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:04.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.815+0000 7f4c77400640 1 -- 172.21.15.144:0/4229658745 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4c7808ac10 con 0x7f4c80159520 2024-09-11T23:18:04.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.815+0000 7f4c7ea00640 1 --2- 172.21.15.144:0/4229658745 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4c6006be60 0x7f4c6006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:04.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.815+0000 7f4c7ea00640 1 --2- 172.21.15.144:0/4229658745 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4c6006be60 0x7f4c6006e320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4c70033000 tx=0x7f4c70008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:04.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:04.819+0000 7f4c77400640 1 -- 172.21.15.144:0/4229658745 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c8015dd00 con 0x7f4c80159520 2024-09-11T23:18:05.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.057+0000 7f4c85e00640 1 -- 172.21.15.144:0/4229658745 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f4c800d1f80 con 0x7f4c80159520 2024-09-11T23:18:05.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.057+0000 7f4c77400640 1 -- 172.21.15.144:0/4229658745 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1139 (secure 0 0 0) 0x7f4c800b7170 con 0x7f4c80159520 2024-09-11T23:18:05.058 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:05.058 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":31,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":22,"num_osds":8,"num_up_osds":8,"osd_up_since":1726096669,"num_in_osds":8,"osd_in_since":1726096657,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":81},{"state_name":"creating+peering","count":16}],"num_pgs":97,"num_pools":3,"num_objects":16,"data_bytes":592002,"bytes_used":224198656,"bytes_avail":772869914624,"bytes_total":773094113280,"inactive_pgs_ratio":0.16494844853878021,"write_bytes_sec":737,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":8,"btime":"2024-09-11T23:18:02:645252+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4297}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-11T23:17:33.655022+0000","services":{}},"progress_events":{}} 2024-09-11T23:18:05.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.059+0000 7f4c85e00640 1 -- 172.21.15.144:0/4229658745 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4c6006be60 msgr2=0x7f4c6006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.059+0000 7f4c85e00640 1 --2- 172.21.15.144:0/4229658745 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4c6006be60 0x7f4c6006e320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4c70033000 tx=0x7f4c70008030 comp rx=0 tx=0).stop 2024-09-11T23:18:05.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.059+0000 7f4c85e00640 1 -- 172.21.15.144:0/4229658745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c80159520 msgr2=0x7f4c800b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.059+0000 7f4c85e00640 1 --2- 172.21.15.144:0/4229658745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c80159520 0x7f4c800b5220 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4c80069f60 tx=0x7f4c7800aea0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.060+0000 7f4c85e00640 1 -- 172.21.15.144:0/4229658745 shutdown_connections 2024-09-11T23:18:05.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.060+0000 7f4c85e00640 1 --2- 172.21.15.144:0/4229658745 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4c6006be60 0x7f4c6006e320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.060+0000 7f4c85e00640 1 --2- 172.21.15.144:0/4229658745 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c80159520 0x7f4c800b5220 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.060+0000 7f4c85e00640 1 --2- 172.21.15.144:0/4229658745 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c80157f20 0x7f4c801577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.060+0000 7f4c85e00640 1 --2- 172.21.15.144:0/4229658745 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c640039b0 0x7f4c8015b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.060+0000 7f4c85e00640 1 -- 172.21.15.144:0/4229658745 >> 172.21.15.144:0/4229658745 conn(0x7f4c800b6240 msgr2=0x7f4c80160260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:05.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.060+0000 7f4c85e00640 1 -- 172.21.15.144:0/4229658745 shutdown_connections 2024-09-11T23:18:05.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.060+0000 7f4c85e00640 1 -- 172.21.15.144:0/4229658745 wait complete. 2024-09-11T23:18:05.077 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T23:18:05.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:18:05.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.229+0000 7f63e8400640 1 Processor -- start 2024-09-11T23:18:05.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.229+0000 7f63e8400640 1 -- start start 2024-09-11T23:18:05.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.231+0000 7f63e8400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f63e00cd300 0x7f63e006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:05.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.231+0000 7f63e8400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f63e006f010 0x7f63e00ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:05.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.231+0000 7f63e8400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e015ecf0 con 0x7f63e015c300 2024-09-11T23:18:05.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.231+0000 7f63e8400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f63e006f480 con 0x7f63e00cd300 2024-09-11T23:18:05.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.231+0000 7f63e8400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f63e015c6e0 con 0x7f63e006f010 2024-09-11T23:18:05.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.231+0000 7f63e5000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f63e00cd300 0x7f63e006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:05.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.231+0000 7f63e5000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f63e00cd300 0x7f63e006ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49112/0 (socket says 172.21.15.144:49112) 2024-09-11T23:18:05.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.231+0000 7f63e5000640 1 -- 172.21.15.144:0/1628095179 learned_addr learned my addr 172.21.15.144:0/1628095179 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:05.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.231+0000 7f63e6400640 1 --2- 172.21.15.144:0/1628095179 >> v2:172.21.15.165:3300/0 conn(0x7f63e006f010 0x7f63e00ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:05.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.231+0000 7f63e5000640 1 -- 172.21.15.144:0/1628095179 >> v2:172.21.15.165:3300/0 conn(0x7f63e006f010 msgr2=0x7f63e00ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:05.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.231+0000 7f63e5000640 1 --2- 172.21.15.144:0/1628095179 >> v2:172.21.15.165:3300/0 conn(0x7f63e006f010 0x7f63e00ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.231+0000 7f63e5000640 1 -- 172.21.15.144:0/1628095179 >> v1:172.21.15.165:6789/0 conn(0x7f63e015c300 legacy=0x7f63e00affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.231+0000 7f63e5000640 1 -- 172.21.15.144:0/1628095179 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e015efb0 con 0x7f63e00cd300 2024-09-11T23:18:05.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.232+0000 7f63e5000640 1 --2- 172.21.15.144:0/1628095179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63e00cd300 0x7f63e006ead0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f63e00cd030 tx=0x7f63cc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2fcedcc8b0b5a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:05.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.233+0000 7f63dfe00640 1 -- 172.21.15.144:0/1628095179 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc037070 con 0x7f63e00cd300 2024-09-11T23:18:05.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.233+0000 7f63dfe00640 1 -- 172.21.15.144:0/1628095179 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63cc032440 con 0x7f63e00cd300 2024-09-11T23:18:05.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.233+0000 7f63dfe00640 1 -- 172.21.15.144:0/1628095179 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc032810 con 0x7f63e00cd300 2024-09-11T23:18:05.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.233+0000 7f63e8400640 1 -- 172.21.15.144:0/1628095179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63e00cd300 msgr2=0x7f63e006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.233+0000 7f63e8400640 1 --2- 172.21.15.144:0/1628095179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63e00cd300 0x7f63e006ead0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f63e00cd030 tx=0x7f63cc02a1e0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.233+0000 7f63e8400640 1 -- 172.21.15.144:0/1628095179 shutdown_connections 2024-09-11T23:18:05.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.233+0000 7f63e8400640 1 --2- 172.21.15.144:0/1628095179 >> v2:172.21.15.165:3300/0 conn(0x7f63e006f010 0x7f63e00ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.233+0000 7f63e8400640 1 --2- 172.21.15.144:0/1628095179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63e00cd300 0x7f63e006ead0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.233+0000 7f63e8400640 1 -- 172.21.15.144:0/1628095179 >> 172.21.15.144:0/1628095179 conn(0x7f63e006cae0 msgr2=0x7f63e006cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:05.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.233+0000 7f63e8400640 1 -- 172.21.15.144:0/1628095179 shutdown_connections 2024-09-11T23:18:05.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.233+0000 7f63e8400640 1 -- 172.21.15.144:0/1628095179 wait complete. 2024-09-11T23:18:05.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.235+0000 7f63e8400640 1 Processor -- start 2024-09-11T23:18:05.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.235+0000 7f63e8400640 1 -- start start 2024-09-11T23:18:05.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.236+0000 7f63e8400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63e006f010 0x7f63e014a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:05.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.236+0000 7f63e8400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63e00cd300 0x7f63e00b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:05.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.236+0000 7f63e8400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f63e015c300 0x7f63e0156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:05.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.236+0000 7f63e8400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f63e015f850 con 0x7f63e006f010 2024-09-11T23:18:05.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.236+0000 7f63e8400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f63e015f570 con 0x7f63e00cd300 2024-09-11T23:18:05.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.236+0000 7f63e8400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f63e0071880 con 0x7f63e015c300 2024-09-11T23:18:05.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.236+0000 7f63e5a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63e006f010 0x7f63e014a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:05.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.236+0000 7f63e5a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63e006f010 0x7f63e014a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49124/0 (socket says 172.21.15.144:49124) 2024-09-11T23:18:05.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.236+0000 7f63e5a00640 1 -- 172.21.15.144:0/3728938013 learned_addr learned my addr 172.21.15.144:0/3728938013 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:05.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.236+0000 7f63e5000640 1 --2- 172.21.15.144:0/3728938013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63e00cd300 0x7f63e00b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:05.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.236+0000 7f63e6400640 1 --2- 172.21.15.144:0/3728938013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f63e015c300 0x7f63e0156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:05.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.237+0000 7f63e5a00640 1 -- 172.21.15.144:0/3728938013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f63e015c300 msgr2=0x7f63e0156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.237+0000 7f63e5a00640 1 --2- 172.21.15.144:0/3728938013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f63e015c300 0x7f63e0156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.237+0000 7f63e5a00640 1 -- 172.21.15.144:0/3728938013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63e00cd300 msgr2=0x7f63e00b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.237+0000 7f63e5a00640 1 --2- 172.21.15.144:0/3728938013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63e00cd300 0x7f63e00b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.237+0000 7f63e5a00640 1 -- 172.21.15.144:0/3728938013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e01572c0 con 0x7f63e006f010 2024-09-11T23:18:05.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.237+0000 7f63e6400640 1 --2- 172.21.15.144:0/3728938013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f63e015c300 0x7f63e0156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:05.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.237+0000 7f63e5a00640 1 --2- 172.21.15.144:0/3728938013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63e006f010 0x7f63e014a950 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f63d400c400 tx=0x7f63d400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:05.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.237+0000 7f63dd600640 1 -- 172.21.15.144:0/3728938013 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d40052d0 con 0x7f63e006f010 2024-09-11T23:18:05.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.237+0000 7f63dd600640 1 -- 172.21.15.144:0/3728938013 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d4005490 con 0x7f63e006f010 2024-09-11T23:18:05.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.237+0000 7f63dd600640 1 -- 172.21.15.144:0/3728938013 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4007260 con 0x7f63e006f010 2024-09-11T23:18:05.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.237+0000 7f63e8400640 1 -- 172.21.15.144:0/3728938013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e0157560 con 0x7f63e006f010 2024-09-11T23:18:05.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.237+0000 7f63e8400640 1 -- 172.21.15.144:0/3728938013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e0157b20 con 0x7f63e006f010 2024-09-11T23:18:05.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.238+0000 7f63e8400640 1 -- 172.21.15.144:0/3728938013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63e006ead0 con 0x7f63e006f010 2024-09-11T23:18:05.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.239+0000 7f63dd600640 1 -- 172.21.15.144:0/3728938013 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f63d4007400 con 0x7f63e006f010 2024-09-11T23:18:05.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.240+0000 7f63dd600640 1 --2- 172.21.15.144:0/3728938013 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f63c006be30 0x7f63c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:05.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.240+0000 7f63dd600640 1 -- 172.21.15.144:0/3728938013 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f63d408a390 con 0x7f63e006f010 2024-09-11T23:18:05.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.240+0000 7f63e5000640 1 --2- 172.21.15.144:0/3728938013 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f63c006be30 0x7f63c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:05.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.241+0000 7f63e5000640 1 --2- 172.21.15.144:0/3728938013 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f63c006be30 0x7f63c006e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f63cc034000 tx=0x7f63cc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:05.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.244+0000 7f63dd600640 1 -- 172.21.15.144:0/3728938013 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f63d4058650 con 0x7f63e006f010 2024-09-11T23:18:05.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.416+0000 7f63e8400640 1 -- 172.21.15.144:0/3728938013 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f63e0076000 con 0x7f63c006be30 2024-09-11T23:18:05.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.423+0000 7f63dd600640 1 -- 172.21.15.144:0/3728938013 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7f63e0076000 con 0x7f63c006be30 2024-09-11T23:18:05.429 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:05.431 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:18:05.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.426+0000 7f63e8400640 1 -- 172.21.15.144:0/3728938013 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f63c006be30 msgr2=0x7f63c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.426+0000 7f63e8400640 1 --2- 172.21.15.144:0/3728938013 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f63c006be30 0x7f63c006e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f63cc034000 tx=0x7f63cc02e000 comp rx=0 tx=0).stop 2024-09-11T23:18:05.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.426+0000 7f63e8400640 1 -- 172.21.15.144:0/3728938013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63e006f010 msgr2=0x7f63e014a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:05.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.427+0000 7f63e8400640 1 --2- 172.21.15.144:0/3728938013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63e006f010 0x7f63e014a950 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f63d400c400 tx=0x7f63d400c8c0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.427+0000 7f63e8400640 1 -- 172.21.15.144:0/3728938013 shutdown_connections 2024-09-11T23:18:05.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.427+0000 7f63e8400640 1 --2- 172.21.15.144:0/3728938013 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f63c006be30 0x7f63c006e2f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.427+0000 7f63e8400640 1 --2- 172.21.15.144:0/3728938013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f63e015c300 0x7f63e0156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.427+0000 7f63e8400640 1 --2- 172.21.15.144:0/3728938013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63e00cd300 0x7f63e00b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.427+0000 7f63e8400640 1 --2- 172.21.15.144:0/3728938013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63e006f010 0x7f63e014a950 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:05.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.427+0000 7f63e8400640 1 -- 172.21.15.144:0/3728938013 >> 172.21.15.144:0/3728938013 conn(0x7f63e006cae0 msgr2=0x7f63e015e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:05.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.427+0000 7f63e8400640 1 -- 172.21.15.144:0/3728938013 shutdown_connections 2024-09-11T23:18:05.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:05.427+0000 7f63e8400640 1 -- 172.21.15.144:0/3728938013 wait complete. 2024-09-11T23:18:05.443 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-11T23:18:05.163013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219188,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755532,"statfs":{"total":773094113280,"available":772869664768,"internally_reserved":0,"allocated":2990080,"data_stored":1792852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.547491"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643816+0000","last_change":"2024-09-11T23:17:59.655120+0000","last_active":"2024-09-11T23:18:00.643816+0000","last_peered":"2024-09-11T23:18:00.643816+0000","last_clean":"2024-09-11T23:18:00.643816+0000","last_became_active":"2024-09-11T23:17:59.654860+0000","last_became_peered":"2024-09-11T23:17:59.654860+0000","last_unstale":"2024-09-11T23:18:00.643816+0000","last_undegraded":"2024-09-11T23:18:00.643816+0000","last_fullsized":"2024-09-11T23:18:00.643816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:25.734147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642029+0000","last_change":"2024-09-11T23:17:59.641566+0000","last_active":"2024-09-11T23:18:00.642029+0000","last_peered":"2024-09-11T23:18:00.642029+0000","last_clean":"2024-09-11T23:18:00.642029+0000","last_became_active":"2024-09-11T23:17:59.641276+0000","last_became_peered":"2024-09-11T23:17:59.641276+0000","last_unstale":"2024-09-11T23:18:00.642029+0000","last_undegraded":"2024-09-11T23:18:00.642029+0000","last_fullsized":"2024-09-11T23:18:00.642029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.341838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669562+0000","last_change":"2024-09-11T23:17:59.635790+0000","last_active":"2024-09-11T23:18:00.669562+0000","last_peered":"2024-09-11T23:18:00.669562+0000","last_clean":"2024-09-11T23:18:00.669562+0000","last_became_active":"2024-09-11T23:17:59.635509+0000","last_became_peered":"2024-09-11T23:17:59.635509+0000","last_unstale":"2024-09-11T23:18:00.669562+0000","last_undegraded":"2024-09-11T23:18:00.669562+0000","last_fullsized":"2024-09-11T23:18:00.669562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.193032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644696+0000","last_change":"2024-09-11T23:17:59.644202+0000","last_active":"2024-09-11T23:18:00.644696+0000","last_peered":"2024-09-11T23:18:00.644696+0000","last_clean":"2024-09-11T23:18:00.644696+0000","last_became_active":"2024-09-11T23:17:59.643634+0000","last_became_peered":"2024-09-11T23:17:59.643634+0000","last_unstale":"2024-09-11T23:18:00.644696+0000","last_undegraded":"2024-09-11T23:18:00.644696+0000","last_fullsized":"2024-09-11T23:18:00.644696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:38.039621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643545+0000","last_change":"2024-09-11T23:17:59.652783+0000","last_active":"2024-09-11T23:18:00.643545+0000","last_peered":"2024-09-11T23:18:00.643545+0000","last_clean":"2024-09-11T23:18:00.643545+0000","last_became_active":"2024-09-11T23:17:59.652508+0000","last_became_peered":"2024-09-11T23:17:59.652508+0000","last_unstale":"2024-09-11T23:18:00.643545+0000","last_undegraded":"2024-09-11T23:18:00.643545+0000","last_fullsized":"2024-09-11T23:18:00.643545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:04.566161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642782+0000","last_change":"2024-09-11T23:17:59.659401+0000","last_active":"2024-09-11T23:18:00.642782+0000","last_peered":"2024-09-11T23:18:00.642782+0000","last_clean":"2024-09-11T23:18:00.642782+0000","last_became_active":"2024-09-11T23:17:59.655926+0000","last_became_peered":"2024-09-11T23:17:59.655926+0000","last_unstale":"2024-09-11T23:18:00.642782+0000","last_undegraded":"2024-09-11T23:18:00.642782+0000","last_fullsized":"2024-09-11T23:18:00.642782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:09.804490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643447+0000","last_change":"2024-09-11T23:17:59.657900+0000","last_active":"2024-09-11T23:18:00.643447+0000","last_peered":"2024-09-11T23:18:00.643447+0000","last_clean":"2024-09-11T23:18:00.643447+0000","last_became_active":"2024-09-11T23:17:59.657621+0000","last_became_peered":"2024-09-11T23:17:59.657621+0000","last_unstale":"2024-09-11T23:18:00.643447+0000","last_undegraded":"2024-09-11T23:18:00.643447+0000","last_fullsized":"2024-09-11T23:18:00.643447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:14.020762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669094+0000","last_change":"2024-09-11T23:17:59.643006+0000","last_active":"2024-09-11T23:18:00.669094+0000","last_peered":"2024-09-11T23:18:00.669094+0000","last_clean":"2024-09-11T23:18:00.669094+0000","last_became_active":"2024-09-11T23:17:59.642338+0000","last_became_peered":"2024-09-11T23:17:59.642338+0000","last_unstale":"2024-09-11T23:18:00.669094+0000","last_undegraded":"2024-09-11T23:18:00.669094+0000","last_fullsized":"2024-09-11T23:18:00.669094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:29.873658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644073+0000","last_change":"2024-09-11T23:17:59.671758+0000","last_active":"2024-09-11T23:18:00.644073+0000","last_peered":"2024-09-11T23:18:00.644073+0000","last_clean":"2024-09-11T23:18:00.644073+0000","last_became_active":"2024-09-11T23:17:59.671418+0000","last_became_peered":"2024-09-11T23:17:59.671418+0000","last_unstale":"2024-09-11T23:18:00.644073+0000","last_undegraded":"2024-09-11T23:18:00.644073+0000","last_fullsized":"2024-09-11T23:18:00.644073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:31.034856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661864+0000","last_change":"2024-09-11T23:17:59.656199+0000","last_active":"2024-09-11T23:18:00.661864+0000","last_peered":"2024-09-11T23:18:00.661864+0000","last_clean":"2024-09-11T23:18:00.661864+0000","last_became_active":"2024-09-11T23:17:59.655919+0000","last_became_peered":"2024-09-11T23:17:59.655919+0000","last_unstale":"2024-09-11T23:18:00.661864+0000","last_undegraded":"2024-09-11T23:18:00.661864+0000","last_fullsized":"2024-09-11T23:18:00.661864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:50.844310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661743+0000","last_change":"2024-09-11T23:17:59.646129+0000","last_active":"2024-09-11T23:18:00.661743+0000","last_peered":"2024-09-11T23:18:00.661743+0000","last_clean":"2024-09-11T23:18:00.661743+0000","last_became_active":"2024-09-11T23:17:59.645346+0000","last_became_peered":"2024-09-11T23:17:59.645346+0000","last_unstale":"2024-09-11T23:18:00.661743+0000","last_undegraded":"2024-09-11T23:18:00.661743+0000","last_fullsized":"2024-09-11T23:18:00.661743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:05.705455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669760+0000","last_change":"2024-09-11T23:17:59.642874+0000","last_active":"2024-09-11T23:18:00.669760+0000","last_peered":"2024-09-11T23:18:00.669760+0000","last_clean":"2024-09-11T23:18:00.669760+0000","last_became_active":"2024-09-11T23:17:59.642586+0000","last_became_peered":"2024-09-11T23:17:59.642586+0000","last_unstale":"2024-09-11T23:18:00.669760+0000","last_undegraded":"2024-09-11T23:18:00.669760+0000","last_fullsized":"2024-09-11T23:18:00.669760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:57.703691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670655+0000","last_change":"2024-09-11T23:17:59.644814+0000","last_active":"2024-09-11T23:18:00.670655+0000","last_peered":"2024-09-11T23:18:00.670655+0000","last_clean":"2024-09-11T23:18:00.670655+0000","last_became_active":"2024-09-11T23:17:59.643305+0000","last_became_peered":"2024-09-11T23:17:59.643305+0000","last_unstale":"2024-09-11T23:18:00.670655+0000","last_undegraded":"2024-09-11T23:18:00.670655+0000","last_fullsized":"2024-09-11T23:18:00.670655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:29.321395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669106+0000","last_change":"2024-09-11T23:17:59.645525+0000","last_active":"2024-09-11T23:18:00.669106+0000","last_peered":"2024-09-11T23:18:00.669106+0000","last_clean":"2024-09-11T23:18:00.669106+0000","last_became_active":"2024-09-11T23:17:59.642799+0000","last_became_peered":"2024-09-11T23:17:59.642799+0000","last_unstale":"2024-09-11T23:18:00.669106+0000","last_undegraded":"2024-09-11T23:18:00.669106+0000","last_fullsized":"2024-09-11T23:18:00.669106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:24.269862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641613+0000","last_change":"2024-09-11T23:17:59.634022+0000","last_active":"2024-09-11T23:18:00.641613+0000","last_peered":"2024-09-11T23:18:00.641613+0000","last_clean":"2024-09-11T23:18:00.641613+0000","last_became_active":"2024-09-11T23:17:59.632934+0000","last_became_peered":"2024-09-11T23:17:59.632934+0000","last_unstale":"2024-09-11T23:18:00.641613+0000","last_undegraded":"2024-09-11T23:18:00.641613+0000","last_fullsized":"2024-09-11T23:18:00.641613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:36.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642779+0000","last_change":"2024-09-11T23:17:59.653627+0000","last_active":"2024-09-11T23:18:00.642779+0000","last_peered":"2024-09-11T23:18:00.642779+0000","last_clean":"2024-09-11T23:18:00.642779+0000","last_became_active":"2024-09-11T23:17:59.653088+0000","last_became_peered":"2024-09-11T23:17:59.653088+0000","last_unstale":"2024-09-11T23:18:00.642779+0000","last_undegraded":"2024-09-11T23:18:00.642779+0000","last_fullsized":"2024-09-11T23:18:00.642779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.341838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.645123+0000","last_change":"2024-09-11T23:17:59.660074+0000","last_active":"2024-09-11T23:18:00.645123+0000","last_peered":"2024-09-11T23:18:00.645123+0000","last_clean":"2024-09-11T23:18:00.645123+0000","last_became_active":"2024-09-11T23:17:59.659174+0000","last_became_peered":"2024-09-11T23:17:59.659174+0000","last_unstale":"2024-09-11T23:18:00.645123+0000","last_undegraded":"2024-09-11T23:18:00.645123+0000","last_fullsized":"2024-09-11T23:18:00.645123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:55.351687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669448+0000","last_change":"2024-09-11T23:17:59.641202+0000","last_active":"2024-09-11T23:18:00.669448+0000","last_peered":"2024-09-11T23:18:00.669448+0000","last_clean":"2024-09-11T23:18:00.669448+0000","last_became_active":"2024-09-11T23:17:59.640609+0000","last_became_peered":"2024-09-11T23:17:59.640609+0000","last_unstale":"2024-09-11T23:18:00.669448+0000","last_undegraded":"2024-09-11T23:18:00.669448+0000","last_fullsized":"2024-09-11T23:18:00.669448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:34.428505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643995+0000","last_change":"2024-09-11T23:17:59.654884+0000","last_active":"2024-09-11T23:18:00.643995+0000","last_peered":"2024-09-11T23:18:00.643995+0000","last_clean":"2024-09-11T23:18:00.643995+0000","last_became_active":"2024-09-11T23:17:59.654578+0000","last_became_peered":"2024-09-11T23:17:59.654578+0000","last_unstale":"2024-09-11T23:18:00.643995+0000","last_undegraded":"2024-09-11T23:18:00.643995+0000","last_fullsized":"2024-09-11T23:18:00.643995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:32.837922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661704+0000","last_change":"2024-09-11T23:17:59.643411+0000","last_active":"2024-09-11T23:18:00.661704+0000","last_peered":"2024-09-11T23:18:00.661704+0000","last_clean":"2024-09-11T23:18:00.661704+0000","last_became_active":"2024-09-11T23:17:59.643076+0000","last_became_peered":"2024-09-11T23:17:59.643076+0000","last_unstale":"2024-09-11T23:18:00.661704+0000","last_undegraded":"2024-09-11T23:18:00.661704+0000","last_fullsized":"2024-09-11T23:18:00.661704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:36.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669545+0000","last_change":"2024-09-11T23:17:59.650880+0000","last_active":"2024-09-11T23:18:00.669545+0000","last_peered":"2024-09-11T23:18:00.669545+0000","last_clean":"2024-09-11T23:18:00.669545+0000","last_became_active":"2024-09-11T23:17:59.650568+0000","last_became_peered":"2024-09-11T23:17:59.650568+0000","last_unstale":"2024-09-11T23:18:00.669545+0000","last_undegraded":"2024-09-11T23:18:00.669545+0000","last_fullsized":"2024-09-11T23:18:00.669545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:15.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642771+0000","last_change":"2024-09-11T23:17:59.666448+0000","last_active":"2024-09-11T23:18:00.642771+0000","last_peered":"2024-09-11T23:18:00.642771+0000","last_clean":"2024-09-11T23:18:00.642771+0000","last_became_active":"2024-09-11T23:17:59.664741+0000","last_became_peered":"2024-09-11T23:17:59.664741+0000","last_unstale":"2024-09-11T23:18:00.642771+0000","last_undegraded":"2024-09-11T23:18:00.642771+0000","last_fullsized":"2024-09-11T23:18:00.642771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:50.844310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670229+0000","last_change":"2024-09-11T23:17:59.645036+0000","last_active":"2024-09-11T23:18:00.670229+0000","last_peered":"2024-09-11T23:18:00.670229+0000","last_clean":"2024-09-11T23:18:00.670229+0000","last_became_active":"2024-09-11T23:17:59.644706+0000","last_became_peered":"2024-09-11T23:17:59.644706+0000","last_unstale":"2024-09-11T23:18:00.670229+0000","last_undegraded":"2024-09-11T23:18:00.670229+0000","last_fullsized":"2024-09-11T23:18:00.670229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:04.266917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642955+0000","last_change":"2024-09-11T23:17:59.653352+0000","last_active":"2024-09-11T23:18:00.642955+0000","last_peered":"2024-09-11T23:18:00.642955+0000","last_clean":"2024-09-11T23:18:00.642955+0000","last_became_active":"2024-09-11T23:17:59.652470+0000","last_became_peered":"2024-09-11T23:17:59.652470+0000","last_unstale":"2024-09-11T23:18:00.642955+0000","last_undegraded":"2024-09-11T23:18:00.642955+0000","last_fullsized":"2024-09-11T23:18:00.642955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:15.213721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671014+0000","last_change":"2024-09-11T23:17:59.662259+0000","last_active":"2024-09-11T23:18:00.671014+0000","last_peered":"2024-09-11T23:18:00.671014+0000","last_clean":"2024-09-11T23:18:00.671014+0000","last_became_active":"2024-09-11T23:17:59.662031+0000","last_became_peered":"2024-09-11T23:17:59.662031+0000","last_unstale":"2024-09-11T23:18:00.671014+0000","last_undegraded":"2024-09-11T23:18:00.671014+0000","last_fullsized":"2024-09-11T23:18:00.671014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:34.160365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661875+0000","last_change":"2024-09-11T23:17:59.650797+0000","last_active":"2024-09-11T23:18:00.661875+0000","last_peered":"2024-09-11T23:18:00.661875+0000","last_clean":"2024-09-11T23:18:00.661875+0000","last_became_active":"2024-09-11T23:17:59.650548+0000","last_became_peered":"2024-09-11T23:17:59.650548+0000","last_unstale":"2024-09-11T23:18:00.661875+0000","last_undegraded":"2024-09-11T23:18:00.661875+0000","last_fullsized":"2024-09-11T23:18:00.661875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.341838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641767+0000","last_change":"2024-09-11T23:17:59.646422+0000","last_active":"2024-09-11T23:18:00.641767+0000","last_peered":"2024-09-11T23:18:00.641767+0000","last_clean":"2024-09-11T23:18:00.641767+0000","last_became_active":"2024-09-11T23:17:59.646112+0000","last_became_peered":"2024-09-11T23:17:59.646112+0000","last_unstale":"2024-09-11T23:18:00.641767+0000","last_undegraded":"2024-09-11T23:18:00.641767+0000","last_fullsized":"2024-09-11T23:18:00.641767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:50.844310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670965+0000","last_change":"2024-09-11T23:17:59.644063+0000","last_active":"2024-09-11T23:18:00.670965+0000","last_peered":"2024-09-11T23:18:00.670965+0000","last_clean":"2024-09-11T23:18:00.670965+0000","last_became_active":"2024-09-11T23:17:59.643760+0000","last_became_peered":"2024-09-11T23:17:59.643760+0000","last_unstale":"2024-09-11T23:18:00.670965+0000","last_undegraded":"2024-09-11T23:18:00.670965+0000","last_fullsized":"2024-09-11T23:18:00.670965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:31.141907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669864+0000","last_change":"2024-09-11T23:17:59.645858+0000","last_active":"2024-09-11T23:18:00.669864+0000","last_peered":"2024-09-11T23:18:00.669864+0000","last_clean":"2024-09-11T23:18:00.669864+0000","last_became_active":"2024-09-11T23:17:59.645602+0000","last_became_peered":"2024-09-11T23:17:59.645602+0000","last_unstale":"2024-09-11T23:18:00.669864+0000","last_undegraded":"2024-09-11T23:18:00.669864+0000","last_fullsized":"2024-09-11T23:18:00.669864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:09.804490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642891+0000","last_change":"2024-09-11T23:17:59.657821+0000","last_active":"2024-09-11T23:18:00.642891+0000","last_peered":"2024-09-11T23:18:00.642891+0000","last_clean":"2024-09-11T23:18:00.642891+0000","last_became_active":"2024-09-11T23:17:59.645334+0000","last_became_peered":"2024-09-11T23:17:59.645334+0000","last_unstale":"2024-09-11T23:18:00.642891+0000","last_undegraded":"2024-09-11T23:18:00.642891+0000","last_fullsized":"2024-09-11T23:18:00.642891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:28.813283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669574+0000","last_change":"2024-09-11T23:17:59.636987+0000","last_active":"2024-09-11T23:18:00.669574+0000","last_peered":"2024-09-11T23:18:00.669574+0000","last_clean":"2024-09-11T23:18:00.669574+0000","last_became_active":"2024-09-11T23:17:59.636762+0000","last_became_peered":"2024-09-11T23:17:59.636762+0000","last_unstale":"2024-09-11T23:18:00.669574+0000","last_undegraded":"2024-09-11T23:18:00.669574+0000","last_fullsized":"2024-09-11T23:18:00.669574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:10.353893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661493+0000","last_change":"2024-09-11T23:17:59.648354+0000","last_active":"2024-09-11T23:18:00.661493+0000","last_peered":"2024-09-11T23:18:00.661493+0000","last_clean":"2024-09-11T23:18:00.661493+0000","last_became_active":"2024-09-11T23:17:59.646693+0000","last_became_peered":"2024-09-11T23:17:59.646693+0000","last_unstale":"2024-09-11T23:18:00.661493+0000","last_undegraded":"2024-09-11T23:18:00.661493+0000","last_fullsized":"2024-09-11T23:18:00.661493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:15.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669206+0000","last_change":"2024-09-11T23:17:59.637101+0000","last_active":"2024-09-11T23:18:00.669206+0000","last_peered":"2024-09-11T23:18:00.669206+0000","last_clean":"2024-09-11T23:18:00.669206+0000","last_became_active":"2024-09-11T23:17:59.635407+0000","last_became_peered":"2024-09-11T23:17:59.635407+0000","last_unstale":"2024-09-11T23:18:00.669206+0000","last_undegraded":"2024-09-11T23:18:00.669206+0000","last_fullsized":"2024-09-11T23:18:00.669206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:35.519961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670769+0000","last_change":"2024-09-11T23:17:58.642664+0000","last_active":"2024-09-11T23:18:00.670769+0000","last_peered":"2024-09-11T23:18:00.670769+0000","last_clean":"2024-09-11T23:18:00.670769+0000","last_became_active":"2024-09-11T23:17:58.642371+0000","last_became_peered":"2024-09-11T23:17:58.642371+0000","last_unstale":"2024-09-11T23:18:00.670769+0000","last_undegraded":"2024-09-11T23:18:00.670769+0000","last_fullsized":"2024-09-11T23:18:00.670769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:31.214611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669649+0000","last_change":"2024-09-11T23:17:59.641906+0000","last_active":"2024-09-11T23:18:00.669649+0000","last_peered":"2024-09-11T23:18:00.669649+0000","last_clean":"2024-09-11T23:18:00.669649+0000","last_became_active":"2024-09-11T23:17:59.641634+0000","last_became_peered":"2024-09-11T23:17:59.641634+0000","last_unstale":"2024-09-11T23:18:00.669649+0000","last_undegraded":"2024-09-11T23:18:00.669649+0000","last_fullsized":"2024-09-11T23:18:00.669649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:36.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661629+0000","last_change":"2024-09-11T23:17:58.640442+0000","last_active":"2024-09-11T23:18:00.661629+0000","last_peered":"2024-09-11T23:18:00.661629+0000","last_clean":"2024-09-11T23:18:00.661629+0000","last_became_active":"2024-09-11T23:17:58.640148+0000","last_became_peered":"2024-09-11T23:17:58.640148+0000","last_unstale":"2024-09-11T23:18:00.661629+0000","last_undegraded":"2024-09-11T23:18:00.661629+0000","last_fullsized":"2024-09-11T23:18:00.661629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:02.505670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670322+0000","last_change":"2024-09-11T23:17:58.640181+0000","last_active":"2024-09-11T23:18:00.670322+0000","last_peered":"2024-09-11T23:18:00.670322+0000","last_clean":"2024-09-11T23:18:00.670322+0000","last_became_active":"2024-09-11T23:17:58.639944+0000","last_became_peered":"2024-09-11T23:17:58.639944+0000","last_unstale":"2024-09-11T23:18:00.670322+0000","last_undegraded":"2024-09-11T23:18:00.670322+0000","last_fullsized":"2024-09-11T23:18:00.670322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:02.827617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669793+0000","last_change":"2024-09-11T23:17:59.643922+0000","last_active":"2024-09-11T23:18:00.669793+0000","last_peered":"2024-09-11T23:18:00.669793+0000","last_clean":"2024-09-11T23:18:00.669793+0000","last_became_active":"2024-09-11T23:17:59.643613+0000","last_became_peered":"2024-09-11T23:17:59.643613+0000","last_unstale":"2024-09-11T23:18:00.669793+0000","last_undegraded":"2024-09-11T23:18:00.669793+0000","last_fullsized":"2024-09-11T23:18:00.669793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:31.792631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643050+0000","last_change":"2024-09-11T23:17:58.640428+0000","last_active":"2024-09-11T23:18:00.643050+0000","last_peered":"2024-09-11T23:18:00.643050+0000","last_clean":"2024-09-11T23:18:00.643050+0000","last_became_active":"2024-09-11T23:17:58.639860+0000","last_became_peered":"2024-09-11T23:17:58.639860+0000","last_unstale":"2024-09-11T23:18:00.643050+0000","last_undegraded":"2024-09-11T23:18:00.643050+0000","last_fullsized":"2024-09-11T23:18:00.643050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641494+0000","last_change":"2024-09-11T23:17:59.638046+0000","last_active":"2024-09-11T23:18:00.641494+0000","last_peered":"2024-09-11T23:18:00.641494+0000","last_clean":"2024-09-11T23:18:00.641494+0000","last_became_active":"2024-09-11T23:17:59.637621+0000","last_became_peered":"2024-09-11T23:17:59.637621+0000","last_unstale":"2024-09-11T23:18:00.641494+0000","last_undegraded":"2024-09-11T23:18:00.641494+0000","last_fullsized":"2024-09-11T23:18:00.641494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:15.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661844+0000","last_change":"2024-09-11T23:17:58.645977+0000","last_active":"2024-09-11T23:18:00.661844+0000","last_peered":"2024-09-11T23:18:00.661844+0000","last_clean":"2024-09-11T23:18:00.661844+0000","last_became_active":"2024-09-11T23:17:58.645482+0000","last_became_peered":"2024-09-11T23:17:58.645482+0000","last_unstale":"2024-09-11T23:18:00.661844+0000","last_undegraded":"2024-09-11T23:18:00.661844+0000","last_fullsized":"2024-09-11T23:18:00.661844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:31.277023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644953+0000","last_change":"2024-09-11T23:17:59.658501+0000","last_active":"2024-09-11T23:18:00.644953+0000","last_peered":"2024-09-11T23:18:00.644953+0000","last_clean":"2024-09-11T23:18:00.644953+0000","last_became_active":"2024-09-11T23:17:59.658268+0000","last_became_peered":"2024-09-11T23:17:59.658268+0000","last_unstale":"2024-09-11T23:18:00.644953+0000","last_undegraded":"2024-09-11T23:18:00.644953+0000","last_fullsized":"2024-09-11T23:18:00.644953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:13.861431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.645078+0000","last_change":"2024-09-11T23:17:58.640356+0000","last_active":"2024-09-11T23:18:00.645078+0000","last_peered":"2024-09-11T23:18:00.645078+0000","last_clean":"2024-09-11T23:18:00.645078+0000","last_became_active":"2024-09-11T23:17:58.640060+0000","last_became_peered":"2024-09-11T23:17:58.640060+0000","last_unstale":"2024-09-11T23:18:00.645078+0000","last_undegraded":"2024-09-11T23:18:00.645078+0000","last_fullsized":"2024-09-11T23:18:00.645078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:31.277023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669890+0000","last_change":"2024-09-11T23:17:59.669290+0000","last_active":"2024-09-11T23:18:00.669890+0000","last_peered":"2024-09-11T23:18:00.669890+0000","last_clean":"2024-09-11T23:18:00.669890+0000","last_became_active":"2024-09-11T23:17:59.668837+0000","last_became_peered":"2024-09-11T23:17:59.668837+0000","last_unstale":"2024-09-11T23:18:00.669890+0000","last_undegraded":"2024-09-11T23:18:00.669890+0000","last_fullsized":"2024-09-11T23:18:00.669890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:50.844310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641822+0000","last_change":"2024-09-11T23:17:58.646012+0000","last_active":"2024-09-11T23:18:00.641822+0000","last_peered":"2024-09-11T23:18:00.641822+0000","last_clean":"2024-09-11T23:18:00.641822+0000","last_became_active":"2024-09-11T23:17:58.645093+0000","last_became_peered":"2024-09-11T23:17:58.645093+0000","last_unstale":"2024-09-11T23:18:00.641822+0000","last_undegraded":"2024-09-11T23:18:00.641822+0000","last_fullsized":"2024-09-11T23:18:00.641822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:31.277023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669811+0000","last_change":"2024-09-11T23:17:59.653386+0000","last_active":"2024-09-11T23:18:00.669811+0000","last_peered":"2024-09-11T23:18:00.669811+0000","last_clean":"2024-09-11T23:18:00.669811+0000","last_became_active":"2024-09-11T23:17:59.653112+0000","last_became_peered":"2024-09-11T23:17:59.653112+0000","last_unstale":"2024-09-11T23:18:00.669811+0000","last_undegraded":"2024-09-11T23:18:00.669811+0000","last_fullsized":"2024-09-11T23:18:00.669811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:30.915550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661618+0000","last_change":"2024-09-11T23:17:58.642732+0000","last_active":"2024-09-11T23:18:00.661618+0000","last_peered":"2024-09-11T23:18:00.661618+0000","last_clean":"2024-09-11T23:18:00.661618+0000","last_became_active":"2024-09-11T23:17:58.642411+0000","last_became_peered":"2024-09-11T23:17:58.642411+0000","last_unstale":"2024-09-11T23:18:00.661618+0000","last_undegraded":"2024-09-11T23:18:00.661618+0000","last_fullsized":"2024-09-11T23:18:00.661618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:21.084931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643652+0000","last_change":"2024-09-11T23:17:59.652260+0000","last_active":"2024-09-11T23:18:00.643652+0000","last_peered":"2024-09-11T23:18:00.643652+0000","last_clean":"2024-09-11T23:18:00.643652+0000","last_became_active":"2024-09-11T23:17:59.651842+0000","last_became_peered":"2024-09-11T23:17:59.651842+0000","last_unstale":"2024-09-11T23:18:00.643652+0000","last_undegraded":"2024-09-11T23:18:00.643652+0000","last_fullsized":"2024-09-11T23:18:00.643652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:13.861431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669696+0000","last_change":"2024-09-11T23:17:58.629743+0000","last_active":"2024-09-11T23:18:00.669696+0000","last_peered":"2024-09-11T23:18:00.669696+0000","last_clean":"2024-09-11T23:18:00.669696+0000","last_became_active":"2024-09-11T23:17:58.629379+0000","last_became_peered":"2024-09-11T23:17:58.629379+0000","last_unstale":"2024-09-11T23:18:00.669696+0000","last_undegraded":"2024-09-11T23:18:00.669696+0000","last_fullsized":"2024-09-11T23:18:00.669696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:09.475238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669255+0000","last_change":"2024-09-11T23:17:59.647539+0000","last_active":"2024-09-11T23:18:00.669255+0000","last_peered":"2024-09-11T23:18:00.669255+0000","last_clean":"2024-09-11T23:18:00.669255+0000","last_became_active":"2024-09-11T23:17:59.647293+0000","last_became_peered":"2024-09-11T23:17:59.647293+0000","last_unstale":"2024-09-11T23:18:00.669255+0000","last_undegraded":"2024-09-11T23:18:00.669255+0000","last_fullsized":"2024-09-11T23:18:00.669255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:49.647417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642905+0000","last_change":"2024-09-11T23:17:58.641139+0000","last_active":"2024-09-11T23:18:00.642905+0000","last_peered":"2024-09-11T23:18:00.642905+0000","last_clean":"2024-09-11T23:18:00.642905+0000","last_became_active":"2024-09-11T23:17:58.640813+0000","last_became_peered":"2024-09-11T23:17:58.640813+0000","last_unstale":"2024-09-11T23:18:00.642905+0000","last_undegraded":"2024-09-11T23:18:00.642905+0000","last_fullsized":"2024-09-11T23:18:00.642905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:02.505670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643757+0000","last_change":"2024-09-11T23:17:59.661121+0000","last_active":"2024-09-11T23:18:00.643757+0000","last_peered":"2024-09-11T23:18:00.643757+0000","last_clean":"2024-09-11T23:18:00.643757+0000","last_became_active":"2024-09-11T23:17:59.660078+0000","last_became_peered":"2024-09-11T23:17:59.660078+0000","last_unstale":"2024-09-11T23:18:00.643757+0000","last_undegraded":"2024-09-11T23:18:00.643757+0000","last_fullsized":"2024-09-11T23:18:00.643757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:55.351687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661430+0000","last_change":"2024-09-11T23:17:58.636194+0000","last_active":"2024-09-11T23:18:00.661430+0000","last_peered":"2024-09-11T23:18:00.661430+0000","last_clean":"2024-09-11T23:18:00.661430+0000","last_became_active":"2024-09-11T23:17:58.635885+0000","last_became_peered":"2024-09-11T23:17:58.635885+0000","last_unstale":"2024-09-11T23:18:00.661430+0000","last_undegraded":"2024-09-11T23:18:00.661430+0000","last_fullsized":"2024-09-11T23:18:00.661430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661491+0000","last_change":"2024-09-11T23:17:59.648931+0000","last_active":"2024-09-11T23:18:00.661491+0000","last_peered":"2024-09-11T23:18:00.661491+0000","last_clean":"2024-09-11T23:18:00.661491+0000","last_became_active":"2024-09-11T23:17:59.646149+0000","last_became_peered":"2024-09-11T23:17:59.646149+0000","last_unstale":"2024-09-11T23:18:00.661491+0000","last_undegraded":"2024-09-11T23:18:00.661491+0000","last_fullsized":"2024-09-11T23:18:00.661491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.193032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669254+0000","last_change":"2024-09-11T23:17:58.631291+0000","last_active":"2024-09-11T23:18:00.669254+0000","last_peered":"2024-09-11T23:18:00.669254+0000","last_clean":"2024-09-11T23:18:00.669254+0000","last_became_active":"2024-09-11T23:17:58.630939+0000","last_became_peered":"2024-09-11T23:17:58.630939+0000","last_unstale":"2024-09-11T23:18:00.669254+0000","last_undegraded":"2024-09-11T23:18:00.669254+0000","last_fullsized":"2024-09-11T23:18:00.669254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:53:26.952229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643224+0000","last_change":"2024-09-11T23:17:59.660874+0000","last_active":"2024-09-11T23:18:00.643224+0000","last_peered":"2024-09-11T23:18:00.643224+0000","last_clean":"2024-09-11T23:18:00.643224+0000","last_became_active":"2024-09-11T23:17:59.660613+0000","last_became_peered":"2024-09-11T23:17:59.660613+0000","last_unstale":"2024-09-11T23:18:00.643224+0000","last_undegraded":"2024-09-11T23:18:00.643224+0000","last_fullsized":"2024-09-11T23:18:00.643224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:42.560113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670003+0000","last_change":"2024-09-11T23:17:58.635774+0000","last_active":"2024-09-11T23:18:00.670003+0000","last_peered":"2024-09-11T23:18:00.670003+0000","last_clean":"2024-09-11T23:18:00.670003+0000","last_became_active":"2024-09-11T23:17:58.634748+0000","last_became_peered":"2024-09-11T23:17:58.634748+0000","last_unstale":"2024-09-11T23:18:00.670003+0000","last_undegraded":"2024-09-11T23:18:00.670003+0000","last_fullsized":"2024-09-11T23:18:00.670003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:44.209956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643691+0000","last_change":"2024-09-11T23:17:59.662246+0000","last_active":"2024-09-11T23:18:00.643691+0000","last_peered":"2024-09-11T23:18:00.643691+0000","last_clean":"2024-09-11T23:18:00.643691+0000","last_became_active":"2024-09-11T23:17:59.661866+0000","last_became_peered":"2024-09-11T23:17:59.661866+0000","last_unstale":"2024-09-11T23:18:00.643691+0000","last_undegraded":"2024-09-11T23:18:00.643691+0000","last_fullsized":"2024-09-11T23:18:00.643691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:00.628195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669504+0000","last_change":"2024-09-11T23:17:58.634201+0000","last_active":"2024-09-11T23:18:00.669504+0000","last_peered":"2024-09-11T23:18:00.669504+0000","last_clean":"2024-09-11T23:18:00.669504+0000","last_became_active":"2024-09-11T23:17:58.633865+0000","last_became_peered":"2024-09-11T23:17:58.633865+0000","last_unstale":"2024-09-11T23:18:00.669504+0000","last_undegraded":"2024-09-11T23:18:00.669504+0000","last_fullsized":"2024-09-11T23:18:00.669504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:12.634428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644038+0000","last_change":"2024-09-11T23:17:59.668175+0000","last_active":"2024-09-11T23:18:00.644038+0000","last_peered":"2024-09-11T23:18:00.644038+0000","last_clean":"2024-09-11T23:18:00.644038+0000","last_became_active":"2024-09-11T23:17:59.665569+0000","last_became_peered":"2024-09-11T23:17:59.665569+0000","last_unstale":"2024-09-11T23:18:00.644038+0000","last_undegraded":"2024-09-11T23:18:00.644038+0000","last_fullsized":"2024-09-11T23:18:00.644038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:49.216535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641877+0000","last_change":"2024-09-11T23:17:58.630807+0000","last_active":"2024-09-11T23:18:00.641877+0000","last_peered":"2024-09-11T23:18:00.641877+0000","last_clean":"2024-09-11T23:18:00.641877+0000","last_became_active":"2024-09-11T23:17:58.630491+0000","last_became_peered":"2024-09-11T23:17:58.630491+0000","last_unstale":"2024-09-11T23:18:00.641877+0000","last_undegraded":"2024-09-11T23:18:00.641877+0000","last_fullsized":"2024-09-11T23:18:00.641877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.907527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644892+0000","last_change":"2024-09-11T23:17:59.643945+0000","last_active":"2024-09-11T23:18:00.644892+0000","last_peered":"2024-09-11T23:18:00.644892+0000","last_clean":"2024-09-11T23:18:00.644892+0000","last_became_active":"2024-09-11T23:17:59.643358+0000","last_became_peered":"2024-09-11T23:17:59.643358+0000","last_unstale":"2024-09-11T23:18:00.644892+0000","last_undegraded":"2024-09-11T23:18:00.644892+0000","last_fullsized":"2024-09-11T23:18:00.644892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:14.020762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670008+0000","last_change":"2024-09-11T23:17:58.645520+0000","last_active":"2024-09-11T23:18:00.670008+0000","last_peered":"2024-09-11T23:18:00.670008+0000","last_clean":"2024-09-11T23:18:00.670008+0000","last_became_active":"2024-09-11T23:17:58.645211+0000","last_became_peered":"2024-09-11T23:17:58.645211+0000","last_unstale":"2024-09-11T23:18:00.670008+0000","last_undegraded":"2024-09-11T23:18:00.670008+0000","last_fullsized":"2024-09-11T23:18:00.670008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:02.827617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643867+0000","last_change":"2024-09-11T23:17:59.669515+0000","last_active":"2024-09-11T23:18:00.643867+0000","last_peered":"2024-09-11T23:18:00.643867+0000","last_clean":"2024-09-11T23:18:00.643867+0000","last_became_active":"2024-09-11T23:17:59.669182+0000","last_became_peered":"2024-09-11T23:17:59.669182+0000","last_unstale":"2024-09-11T23:18:00.643867+0000","last_undegraded":"2024-09-11T23:18:00.643867+0000","last_fullsized":"2024-09-11T23:18:00.643867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:26.131689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642556+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:18:00.642556+0000","last_peered":"2024-09-11T23:18:00.642556+0000","last_clean":"2024-09-11T23:18:00.642556+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:18:00.642556+0000","last_undegraded":"2024-09-11T23:18:00.642556+0000","last_fullsized":"2024-09-11T23:18:00.642556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644109+0000","last_change":"2024-09-11T23:17:58.634769+0000","last_active":"2024-09-11T23:18:00.644109+0000","last_peered":"2024-09-11T23:18:00.644109+0000","last_clean":"2024-09-11T23:18:00.644109+0000","last_became_active":"2024-09-11T23:17:58.634321+0000","last_became_peered":"2024-09-11T23:17:58.634321+0000","last_unstale":"2024-09-11T23:18:00.644109+0000","last_undegraded":"2024-09-11T23:18:00.644109+0000","last_fullsized":"2024-09-11T23:18:00.644109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:21.084931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669925+0000","last_change":"2024-09-11T23:17:59.659482+0000","last_active":"2024-09-11T23:18:00.669925+0000","last_peered":"2024-09-11T23:18:00.669925+0000","last_clean":"2024-09-11T23:18:00.669925+0000","last_became_active":"2024-09-11T23:17:59.659148+0000","last_became_peered":"2024-09-11T23:17:59.659148+0000","last_unstale":"2024-09-11T23:18:00.669925+0000","last_undegraded":"2024-09-11T23:18:00.669925+0000","last_fullsized":"2024-09-11T23:18:00.669925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:22.419970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642401+0000","last_change":"2024-09-11T23:17:58.636656+0000","last_active":"2024-09-11T23:18:00.642401+0000","last_peered":"2024-09-11T23:18:00.642401+0000","last_clean":"2024-09-11T23:18:00.642401+0000","last_became_active":"2024-09-11T23:17:58.636363+0000","last_became_peered":"2024-09-11T23:17:58.636363+0000","last_unstale":"2024-09-11T23:18:00.642401+0000","last_undegraded":"2024-09-11T23:18:00.642401+0000","last_fullsized":"2024-09-11T23:18:00.642401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:04.565864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669116+0000","last_change":"2024-09-11T23:17:59.640328+0000","last_active":"2024-09-11T23:18:00.669116+0000","last_peered":"2024-09-11T23:18:00.669116+0000","last_clean":"2024-09-11T23:18:00.669116+0000","last_became_active":"2024-09-11T23:17:59.640058+0000","last_became_peered":"2024-09-11T23:17:59.640058+0000","last_unstale":"2024-09-11T23:18:00.669116+0000","last_undegraded":"2024-09-11T23:18:00.669116+0000","last_fullsized":"2024-09-11T23:18:00.669116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:31.650891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669359+0000","last_change":"2024-09-11T23:17:58.642240+0000","last_active":"2024-09-11T23:18:00.669359+0000","last_peered":"2024-09-11T23:18:00.669359+0000","last_clean":"2024-09-11T23:18:00.669359+0000","last_became_active":"2024-09-11T23:17:58.641996+0000","last_became_peered":"2024-09-11T23:17:58.641996+0000","last_unstale":"2024-09-11T23:18:00.669359+0000","last_undegraded":"2024-09-11T23:18:00.669359+0000","last_fullsized":"2024-09-11T23:18:00.669359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:29:09.781577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641685+0000","last_change":"2024-09-11T23:17:59.638548+0000","last_active":"2024-09-11T23:18:00.641685+0000","last_peered":"2024-09-11T23:18:00.641685+0000","last_clean":"2024-09-11T23:18:00.641685+0000","last_became_active":"2024-09-11T23:17:59.638044+0000","last_became_peered":"2024-09-11T23:17:59.638044+0000","last_unstale":"2024-09-11T23:18:00.641685+0000","last_undegraded":"2024-09-11T23:18:00.641685+0000","last_fullsized":"2024-09-11T23:18:00.641685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:05.705455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642958+0000","last_change":"2024-09-11T23:17:58.641231+0000","last_active":"2024-09-11T23:18:00.642958+0000","last_peered":"2024-09-11T23:18:00.642958+0000","last_clean":"2024-09-11T23:18:00.642958+0000","last_became_active":"2024-09-11T23:17:58.640860+0000","last_became_peered":"2024-09-11T23:17:58.640860+0000","last_unstale":"2024-09-11T23:18:00.642958+0000","last_undegraded":"2024-09-11T23:18:00.642958+0000","last_fullsized":"2024-09-11T23:18:00.642958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669466+0000","last_change":"2024-09-11T23:17:59.643898+0000","last_active":"2024-09-11T23:18:00.669466+0000","last_peered":"2024-09-11T23:18:00.669466+0000","last_clean":"2024-09-11T23:18:00.669466+0000","last_became_active":"2024-09-11T23:17:59.643471+0000","last_became_peered":"2024-09-11T23:17:59.643471+0000","last_unstale":"2024-09-11T23:18:00.669466+0000","last_undegraded":"2024-09-11T23:18:00.669466+0000","last_fullsized":"2024-09-11T23:18:00.669466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:32.285047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641618+0000","last_change":"2024-09-11T23:17:58.640659+0000","last_active":"2024-09-11T23:18:00.641618+0000","last_peered":"2024-09-11T23:18:00.641618+0000","last_clean":"2024-09-11T23:18:00.641618+0000","last_became_active":"2024-09-11T23:17:58.640358+0000","last_became_peered":"2024-09-11T23:17:58.640358+0000","last_unstale":"2024-09-11T23:18:00.641618+0000","last_undegraded":"2024-09-11T23:18:00.641618+0000","last_fullsized":"2024-09-11T23:18:00.641618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.645047+0000","last_change":"2024-09-11T23:17:59.659233+0000","last_active":"2024-09-11T23:18:00.645047+0000","last_peered":"2024-09-11T23:18:00.645047+0000","last_clean":"2024-09-11T23:18:00.645047+0000","last_became_active":"2024-09-11T23:17:59.655952+0000","last_became_peered":"2024-09-11T23:17:59.655952+0000","last_unstale":"2024-09-11T23:18:00.645047+0000","last_undegraded":"2024-09-11T23:18:00.645047+0000","last_fullsized":"2024-09-11T23:18:00.645047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:00.628195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644053+0000","last_change":"2024-09-11T23:17:58.642080+0000","last_active":"2024-09-11T23:18:00.644053+0000","last_peered":"2024-09-11T23:18:00.644053+0000","last_clean":"2024-09-11T23:18:00.644053+0000","last_became_active":"2024-09-11T23:17:58.641752+0000","last_became_peered":"2024-09-11T23:17:58.641752+0000","last_unstale":"2024-09-11T23:18:00.644053+0000","last_undegraded":"2024-09-11T23:18:00.644053+0000","last_fullsized":"2024-09-11T23:18:00.644053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:30.642868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641527+0000","last_change":"2024-09-11T23:17:59.634847+0000","last_active":"2024-09-11T23:18:00.641527+0000","last_peered":"2024-09-11T23:18:00.641527+0000","last_clean":"2024-09-11T23:18:00.641527+0000","last_became_active":"2024-09-11T23:17:59.634547+0000","last_became_peered":"2024-09-11T23:17:59.634547+0000","last_unstale":"2024-09-11T23:18:00.641527+0000","last_undegraded":"2024-09-11T23:18:00.641527+0000","last_fullsized":"2024-09-11T23:18:00.641527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.193032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642072+0000","last_change":"2024-09-11T23:17:58.633818+0000","last_active":"2024-09-11T23:18:00.642072+0000","last_peered":"2024-09-11T23:18:00.642072+0000","last_clean":"2024-09-11T23:18:00.642072+0000","last_became_active":"2024-09-11T23:17:58.633550+0000","last_became_peered":"2024-09-11T23:17:58.633550+0000","last_unstale":"2024-09-11T23:18:00.642072+0000","last_undegraded":"2024-09-11T23:18:00.642072+0000","last_fullsized":"2024-09-11T23:18:00.642072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:56.695668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671118+0000","last_change":"2024-09-11T23:17:59.650990+0000","last_active":"2024-09-11T23:18:00.671118+0000","last_peered":"2024-09-11T23:18:00.671118+0000","last_clean":"2024-09-11T23:18:00.671118+0000","last_became_active":"2024-09-11T23:17:59.650684+0000","last_became_peered":"2024-09-11T23:17:59.650684+0000","last_unstale":"2024-09-11T23:18:00.671118+0000","last_undegraded":"2024-09-11T23:18:00.671118+0000","last_fullsized":"2024-09-11T23:18:00.671118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:17.470426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661904+0000","last_change":"2024-09-11T23:17:58.639477+0000","last_active":"2024-09-11T23:18:00.661904+0000","last_peered":"2024-09-11T23:18:00.661904+0000","last_clean":"2024-09-11T23:18:00.661904+0000","last_became_active":"2024-09-11T23:17:58.639168+0000","last_became_peered":"2024-09-11T23:17:58.639168+0000","last_unstale":"2024-09-11T23:18:00.661904+0000","last_undegraded":"2024-09-11T23:18:00.661904+0000","last_fullsized":"2024-09-11T23:18:00.661904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669908+0000","last_change":"2024-09-11T23:17:59.650474+0000","last_active":"2024-09-11T23:18:00.669908+0000","last_peered":"2024-09-11T23:18:00.669908+0000","last_clean":"2024-09-11T23:18:00.669908+0000","last_became_active":"2024-09-11T23:17:59.650168+0000","last_became_peered":"2024-09-11T23:17:59.650168+0000","last_unstale":"2024-09-11T23:18:00.669908+0000","last_undegraded":"2024-09-11T23:18:00.669908+0000","last_fullsized":"2024-09-11T23:18:00.669908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.341838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642401+0000","last_change":"2024-09-11T23:17:58.640620+0000","last_active":"2024-09-11T23:18:00.642401+0000","last_peered":"2024-09-11T23:18:00.642401+0000","last_clean":"2024-09-11T23:18:00.642401+0000","last_became_active":"2024-09-11T23:17:58.640367+0000","last_became_peered":"2024-09-11T23:17:58.640367+0000","last_unstale":"2024-09-11T23:18:00.642401+0000","last_undegraded":"2024-09-11T23:18:00.642401+0000","last_fullsized":"2024-09-11T23:18:00.642401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.907527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669188+0000","last_change":"2024-09-11T23:17:59.635712+0000","last_active":"2024-09-11T23:18:00.669188+0000","last_peered":"2024-09-11T23:18:00.669188+0000","last_clean":"2024-09-11T23:18:00.669188+0000","last_became_active":"2024-09-11T23:17:59.635303+0000","last_became_peered":"2024-09-11T23:17:59.635303+0000","last_unstale":"2024-09-11T23:18:00.669188+0000","last_undegraded":"2024-09-11T23:18:00.669188+0000","last_fullsized":"2024-09-11T23:18:00.669188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:03.513693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641602+0000","last_change":"2024-09-11T23:17:58.639596+0000","last_active":"2024-09-11T23:18:00.641602+0000","last_peered":"2024-09-11T23:18:00.641602+0000","last_clean":"2024-09-11T23:18:00.641602+0000","last_became_active":"2024-09-11T23:17:58.639333+0000","last_became_peered":"2024-09-11T23:17:58.639333+0000","last_unstale":"2024-09-11T23:18:00.641602+0000","last_undegraded":"2024-09-11T23:18:00.641602+0000","last_fullsized":"2024-09-11T23:18:00.641602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:02.505670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669868+0000","last_change":"2024-09-11T23:17:59.643630+0000","last_active":"2024-09-11T23:18:00.669868+0000","last_peered":"2024-09-11T23:18:00.669868+0000","last_clean":"2024-09-11T23:18:00.669868+0000","last_became_active":"2024-09-11T23:17:59.643080+0000","last_became_peered":"2024-09-11T23:17:59.643080+0000","last_unstale":"2024-09-11T23:18:00.669868+0000","last_undegraded":"2024-09-11T23:18:00.669868+0000","last_fullsized":"2024-09-11T23:18:00.669868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:59.272347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641919+0000","last_change":"2024-09-11T23:17:58.634155+0000","last_active":"2024-09-11T23:18:00.641919+0000","last_peered":"2024-09-11T23:18:00.641919+0000","last_clean":"2024-09-11T23:18:00.641919+0000","last_became_active":"2024-09-11T23:17:58.633898+0000","last_became_peered":"2024-09-11T23:17:58.633898+0000","last_unstale":"2024-09-11T23:18:00.641919+0000","last_undegraded":"2024-09-11T23:18:00.641919+0000","last_fullsized":"2024-09-11T23:18:00.641919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:21.084931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670728+0000","last_change":"2024-09-11T23:17:59.648274+0000","last_active":"2024-09-11T23:18:00.670728+0000","last_peered":"2024-09-11T23:18:00.670728+0000","last_clean":"2024-09-11T23:18:00.670728+0000","last_became_active":"2024-09-11T23:17:59.646482+0000","last_became_peered":"2024-09-11T23:17:59.646482+0000","last_unstale":"2024-09-11T23:18:00.670728+0000","last_undegraded":"2024-09-11T23:18:00.670728+0000","last_fullsized":"2024-09-11T23:18:00.670728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:06.041413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643987+0000","last_change":"2024-09-11T23:17:58.644868+0000","last_active":"2024-09-11T23:18:00.643987+0000","last_peered":"2024-09-11T23:18:00.643987+0000","last_clean":"2024-09-11T23:18:00.643987+0000","last_became_active":"2024-09-11T23:17:58.644006+0000","last_became_peered":"2024-09-11T23:17:58.644006+0000","last_unstale":"2024-09-11T23:18:00.643987+0000","last_undegraded":"2024-09-11T23:18:00.643987+0000","last_fullsized":"2024-09-11T23:18:00.643987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:23.261838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661493+0000","last_change":"2024-09-11T23:17:59.642489+0000","last_active":"2024-09-11T23:18:00.661493+0000","last_peered":"2024-09-11T23:18:00.661493+0000","last_clean":"2024-09-11T23:18:00.661493+0000","last_became_active":"2024-09-11T23:17:59.642155+0000","last_became_peered":"2024-09-11T23:17:59.642155+0000","last_unstale":"2024-09-11T23:18:00.661493+0000","last_undegraded":"2024-09-11T23:18:00.661493+0000","last_fullsized":"2024-09-11T23:18:00.661493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:49.647417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644943+0000","last_change":"2024-09-11T23:17:59.636661+0000","last_active":"2024-09-11T23:18:00.644943+0000","last_peered":"2024-09-11T23:18:00.644943+0000","last_clean":"2024-09-11T23:18:00.644943+0000","last_became_active":"2024-09-11T23:17:59.635613+0000","last_became_peered":"2024-09-11T23:17:59.635613+0000","last_unstale":"2024-09-11T23:18:00.644943+0000","last_undegraded":"2024-09-11T23:18:00.644943+0000","last_fullsized":"2024-09-11T23:18:00.644943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:04.566161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643521+0000","last_change":"2024-09-11T23:17:58.646998+0000","last_active":"2024-09-11T23:18:00.643521+0000","last_peered":"2024-09-11T23:18:00.643521+0000","last_clean":"2024-09-11T23:18:00.643521+0000","last_became_active":"2024-09-11T23:17:58.646666+0000","last_became_peered":"2024-09-11T23:17:58.646666+0000","last_unstale":"2024-09-11T23:18:00.643521+0000","last_undegraded":"2024-09-11T23:18:00.643521+0000","last_fullsized":"2024-09-11T23:18:00.643521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:57.415598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644743+0000","last_change":"2024-09-11T23:17:59.637292+0000","last_active":"2024-09-11T23:18:00.644743+0000","last_peered":"2024-09-11T23:18:00.644743+0000","last_clean":"2024-09-11T23:18:00.644743+0000","last_became_active":"2024-09-11T23:17:59.637028+0000","last_became_peered":"2024-09-11T23:17:59.637028+0000","last_unstale":"2024-09-11T23:18:00.644743+0000","last_undegraded":"2024-09-11T23:18:00.644743+0000","last_fullsized":"2024-09-11T23:18:00.644743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:42.560113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643829+0000","last_change":"2024-09-11T23:17:58.641586+0000","last_active":"2024-09-11T23:18:00.643829+0000","last_peered":"2024-09-11T23:18:00.643829+0000","last_clean":"2024-09-11T23:18:00.643829+0000","last_became_active":"2024-09-11T23:17:58.636670+0000","last_became_peered":"2024-09-11T23:17:58.636670+0000","last_unstale":"2024-09-11T23:18:00.643829+0000","last_undegraded":"2024-09-11T23:18:00.643829+0000","last_fullsized":"2024-09-11T23:18:00.643829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:49.590126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669867+0000","last_change":"2024-09-11T23:17:59.669621+0000","last_active":"2024-09-11T23:18:00.669867+0000","last_peered":"2024-09-11T23:18:00.669867+0000","last_clean":"2024-09-11T23:18:00.669867+0000","last_became_active":"2024-09-11T23:17:59.669362+0000","last_became_peered":"2024-09-11T23:17:59.669362+0000","last_unstale":"2024-09-11T23:18:00.669867+0000","last_undegraded":"2024-09-11T23:18:00.669867+0000","last_fullsized":"2024-09-11T23:18:00.669867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:05.705455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671062+0000","last_change":"2024-09-11T23:17:58.646365+0000","last_active":"2024-09-11T23:18:00.671062+0000","last_peered":"2024-09-11T23:18:00.671062+0000","last_clean":"2024-09-11T23:18:00.671062+0000","last_became_active":"2024-09-11T23:17:58.646119+0000","last_became_peered":"2024-09-11T23:17:58.646119+0000","last_unstale":"2024-09-11T23:18:00.671062+0000","last_undegraded":"2024-09-11T23:18:00.671062+0000","last_fullsized":"2024-09-11T23:18:00.671062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:12.634428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670990+0000","last_change":"2024-09-11T23:17:59.654946+0000","last_active":"2024-09-11T23:18:00.670990+0000","last_peered":"2024-09-11T23:18:00.670990+0000","last_clean":"2024-09-11T23:18:00.670990+0000","last_became_active":"2024-09-11T23:17:59.654732+0000","last_became_peered":"2024-09-11T23:17:59.654732+0000","last_unstale":"2024-09-11T23:18:00.670990+0000","last_undegraded":"2024-09-11T23:18:00.670990+0000","last_fullsized":"2024-09-11T23:18:00.670990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:28.095341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669978+0000","last_change":"2024-09-11T23:17:58.638337+0000","last_active":"2024-09-11T23:18:00.669978+0000","last_peered":"2024-09-11T23:18:00.669978+0000","last_clean":"2024-09-11T23:18:00.669978+0000","last_became_active":"2024-09-11T23:17:58.638071+0000","last_became_peered":"2024-09-11T23:17:58.638071+0000","last_unstale":"2024-09-11T23:18:00.669978+0000","last_undegraded":"2024-09-11T23:18:00.669978+0000","last_fullsized":"2024-09-11T23:18:00.669978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:23.106037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476743,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":666862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476742,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":77524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476741,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":76002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476741,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":76038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":823296,"data_stored":666918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":77524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":75912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:18:08.452 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:18:08.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.614+0000 7f8d06000640 1 Processor -- start 2024-09-11T23:18:08.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.614+0000 7f8d06000640 1 -- start start 2024-09-11T23:18:08.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.615+0000 7f8d06000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8d000d02a0 0x7f8d000d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.615+0000 7f8d06000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d0015ca40 0x7f8d0015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.615+0000 7f8d06000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8d0015ce80 0x7f8d001594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.615+0000 7f8d06000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8d000d0bc0 con 0x7f8d000d02a0 2024-09-11T23:18:08.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.615+0000 7f8d06000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8d0015d390 con 0x7f8d0015ce80 2024-09-11T23:18:08.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.615+0000 7f8d06000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8d0015d670 con 0x7f8d0015ca40 2024-09-11T23:18:08.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.615+0000 7f8cff400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8d000d02a0 0x7f8d000d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.616+0000 7f8cff400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8d000d02a0 0x7f8d000d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49130/0 (socket says 172.21.15.144:49130) 2024-09-11T23:18:08.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.616+0000 7f8cff400640 1 -- 172.21.15.144:0/2643484853 learned_addr learned my addr 172.21.15.144:0/2643484853 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:08.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.616+0000 7f8cffe00640 1 --2- 172.21.15.144:0/2643484853 >> v2:172.21.15.165:3300/0 conn(0x7f8d0015ce80 0x7f8d001594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.616+0000 7f8cfea00640 1 --2- 172.21.15.144:0/2643484853 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d0015ca40 0x7f8d0015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.616+0000 7f8cff400640 1 -- 172.21.15.144:0/2643484853 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d0015ca40 msgr2=0x7f8d0015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:08.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.616+0000 7f8cff400640 1 --2- 172.21.15.144:0/2643484853 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d0015ca40 0x7f8d0015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.616+0000 7f8cff400640 1 -- 172.21.15.144:0/2643484853 >> v2:172.21.15.165:3300/0 conn(0x7f8d0015ce80 msgr2=0x7f8d001594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:08.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.616+0000 7f8cff400640 1 --2- 172.21.15.144:0/2643484853 >> v2:172.21.15.165:3300/0 conn(0x7f8d0015ce80 0x7f8d001594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.616+0000 7f8cff400640 1 -- 172.21.15.144:0/2643484853 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d0015d950 con 0x7f8d000d02a0 2024-09-11T23:18:08.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.616+0000 7f8cfea00640 1 --2- 172.21.15.144:0/2643484853 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d0015ca40 0x7f8d0015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:08.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.617+0000 7f8cff400640 1 --2- 172.21.15.144:0/2643484853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d000d02a0 0x7f8d000d0680 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8d0006cd20 tx=0x7f8cf002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6be6dd86544e66f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:08.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.617+0000 7f8cfe000640 1 -- 172.21.15.144:0/2643484853 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0037070 con 0x7f8d000d02a0 2024-09-11T23:18:08.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.617+0000 7f8cfe000640 1 -- 172.21.15.144:0/2643484853 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf0032440 con 0x7f8d000d02a0 2024-09-11T23:18:08.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.617+0000 7f8cfe000640 1 -- 172.21.15.144:0/2643484853 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0032810 con 0x7f8d000d02a0 2024-09-11T23:18:08.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.618+0000 7f8d06000640 1 -- 172.21.15.144:0/2643484853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d000d02a0 msgr2=0x7f8d000d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.618+0000 7f8d06000640 1 --2- 172.21.15.144:0/2643484853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d000d02a0 0x7f8d000d0680 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8d0006cd20 tx=0x7f8cf002a140 comp rx=0 tx=0).stop 2024-09-11T23:18:08.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.618+0000 7f8d06000640 1 -- 172.21.15.144:0/2643484853 shutdown_connections 2024-09-11T23:18:08.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.618+0000 7f8d06000640 1 --2- 172.21.15.144:0/2643484853 >> v2:172.21.15.165:3300/0 conn(0x7f8d0015ce80 0x7f8d001594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.618+0000 7f8d06000640 1 --2- 172.21.15.144:0/2643484853 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d0015ca40 0x7f8d0015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.618+0000 7f8d06000640 1 --2- 172.21.15.144:0/2643484853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d000d02a0 0x7f8d000d0680 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.618+0000 7f8d06000640 1 -- 172.21.15.144:0/2643484853 >> 172.21.15.144:0/2643484853 conn(0x7f8d00062cc0 msgr2=0x7f8d0006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:08.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.618+0000 7f8d06000640 1 -- 172.21.15.144:0/2643484853 shutdown_connections 2024-09-11T23:18:08.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.618+0000 7f8d06000640 1 -- 172.21.15.144:0/2643484853 wait complete. 2024-09-11T23:18:08.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.619+0000 7f8d06000640 1 Processor -- start 2024-09-11T23:18:08.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.620+0000 7f8d06000640 1 -- start start 2024-09-11T23:18:08.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.620+0000 7f8d06000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d000d02a0 0x7f8d000712e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.620+0000 7f8d06000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d0015ca40 0x7f8d00158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.620+0000 7f8d06000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d0015ce80 0x7f8d0014c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.620+0000 7f8d06000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8d00155b90 con 0x7f8d0015ca40 2024-09-11T23:18:08.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.620+0000 7f8d06000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0015df10 con 0x7f8d0015ce80 2024-09-11T23:18:08.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.620+0000 7f8d06000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8d00155d10 con 0x7f8d000d02a0 2024-09-11T23:18:08.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.621+0000 7f8cfea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d0015ca40 0x7f8d00158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.621+0000 7f8cfea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d0015ca40 0x7f8d00158550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49138/0 (socket says 172.21.15.144:49138) 2024-09-11T23:18:08.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.621+0000 7f8cfea00640 1 -- 172.21.15.144:0/3248502449 learned_addr learned my addr 172.21.15.144:0/3248502449 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:08.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.621+0000 7f8cff400640 1 --2- 172.21.15.144:0/3248502449 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d000d02a0 0x7f8d000712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.621+0000 7f8cffe00640 1 --2- 172.21.15.144:0/3248502449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d0015ce80 0x7f8d0014c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.621+0000 7f8cfea00640 1 -- 172.21.15.144:0/3248502449 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d000d02a0 msgr2=0x7f8d000712e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.621+0000 7f8cfea00640 1 --2- 172.21.15.144:0/3248502449 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d000d02a0 0x7f8d000712e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.621+0000 7f8cfea00640 1 -- 172.21.15.144:0/3248502449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d0015ce80 msgr2=0x7f8d0014c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.621+0000 7f8cfea00640 1 --2- 172.21.15.144:0/3248502449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d0015ce80 0x7f8d0014c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.621+0000 7f8cfea00640 1 -- 172.21.15.144:0/3248502449 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d00072990 con 0x7f8d0015ca40 2024-09-11T23:18:08.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.621+0000 7f8cfea00640 1 --2- 172.21.15.144:0/3248502449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d0015ca40 0x7f8d00158550 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8cec00c820 tx=0x7f8cec00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:08.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.622+0000 7f8cf7400640 1 -- 172.21.15.144:0/3248502449 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec015070 con 0x7f8d0015ca40 2024-09-11T23:18:08.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.622+0000 7f8cf7400640 1 -- 172.21.15.144:0/3248502449 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cec0079d0 con 0x7f8d0015ca40 2024-09-11T23:18:08.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.622+0000 7f8cf7400640 1 -- 172.21.15.144:0/3248502449 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec007dc0 con 0x7f8d0015ca40 2024-09-11T23:18:08.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.622+0000 7f8d06000640 1 -- 172.21.15.144:0/3248502449 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d00072c70 con 0x7f8d0015ca40 2024-09-11T23:18:08.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.622+0000 7f8d06000640 1 -- 172.21.15.144:0/3248502449 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d00073510 con 0x7f8d0015ca40 2024-09-11T23:18:08.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.623+0000 7f8d06000640 1 -- 172.21.15.144:0/3248502449 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d00073710 con 0x7f8d0015ca40 2024-09-11T23:18:08.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.624+0000 7f8cf7400640 1 -- 172.21.15.144:0/3248502449 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8cec018070 con 0x7f8d0015ca40 2024-09-11T23:18:08.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.625+0000 7f8cf7400640 1 --2- 172.21.15.144:0/3248502449 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8ce006be30 0x7f8ce006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:08.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.625+0000 7f8cf7400640 1 -- 172.21.15.144:0/3248502449 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8cec08acd0 con 0x7f8d0015ca40 2024-09-11T23:18:08.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.625+0000 7f8cff400640 1 --2- 172.21.15.144:0/3248502449 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8ce006be30 0x7f8ce006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:08.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.626+0000 7f8cff400640 1 --2- 172.21.15.144:0/3248502449 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8ce006be30 0x7f8ce006e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0034000 tx=0x7f8cf002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:08.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.630+0000 7f8cf7400640 1 -- 172.21.15.144:0/3248502449 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d00073710 con 0x7f8d0015ca40 2024-09-11T23:18:08.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.802+0000 7f8d06000640 1 -- 172.21.15.144:0/3248502449 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8d00072e40 con 0x7f8ce006be30 2024-09-11T23:18:08.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.808+0000 7f8cf7400640 1 -- 172.21.15.144:0/3248502449 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7f8d00072e40 con 0x7f8ce006be30 2024-09-11T23:18:08.811 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:08.813 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:18:08.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.813+0000 7f8d06000640 1 -- 172.21.15.144:0/3248502449 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8ce006be30 msgr2=0x7f8ce006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.813+0000 7f8d06000640 1 --2- 172.21.15.144:0/3248502449 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8ce006be30 0x7f8ce006e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0034000 tx=0x7f8cf002e000 comp rx=0 tx=0).stop 2024-09-11T23:18:08.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.813+0000 7f8d06000640 1 -- 172.21.15.144:0/3248502449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d0015ca40 msgr2=0x7f8d00158550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:08.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.813+0000 7f8d06000640 1 --2- 172.21.15.144:0/3248502449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d0015ca40 0x7f8d00158550 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8cec00c820 tx=0x7f8cec00cce0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.813+0000 7f8d06000640 1 -- 172.21.15.144:0/3248502449 shutdown_connections 2024-09-11T23:18:08.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.813+0000 7f8d06000640 1 --2- 172.21.15.144:0/3248502449 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8ce006be30 0x7f8ce006e2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.813+0000 7f8d06000640 1 --2- 172.21.15.144:0/3248502449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d0015ce80 0x7f8d0014c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.813+0000 7f8d06000640 1 --2- 172.21.15.144:0/3248502449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d0015ca40 0x7f8d00158550 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.813+0000 7f8d06000640 1 --2- 172.21.15.144:0/3248502449 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8d000d02a0 0x7f8d000712e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:08.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.813+0000 7f8d06000640 1 -- 172.21.15.144:0/3248502449 >> 172.21.15.144:0/3248502449 conn(0x7f8d00062cc0 msgr2=0x7f8d000b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:08.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.813+0000 7f8d06000640 1 -- 172.21.15.144:0/3248502449 shutdown_connections 2024-09-11T23:18:08.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:08.813+0000 7f8d06000640 1 -- 172.21.15.144:0/3248502449 wait complete. 2024-09-11T23:18:08.829 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-11T23:18:07.163522+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219188,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755532,"statfs":{"total":773094113280,"available":772869664768,"internally_reserved":0,"allocated":2990080,"data_stored":1792852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001676"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643816+0000","last_change":"2024-09-11T23:17:59.655120+0000","last_active":"2024-09-11T23:18:00.643816+0000","last_peered":"2024-09-11T23:18:00.643816+0000","last_clean":"2024-09-11T23:18:00.643816+0000","last_became_active":"2024-09-11T23:17:59.654860+0000","last_became_peered":"2024-09-11T23:17:59.654860+0000","last_unstale":"2024-09-11T23:18:00.643816+0000","last_undegraded":"2024-09-11T23:18:00.643816+0000","last_fullsized":"2024-09-11T23:18:00.643816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:25.734147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642029+0000","last_change":"2024-09-11T23:17:59.641566+0000","last_active":"2024-09-11T23:18:00.642029+0000","last_peered":"2024-09-11T23:18:00.642029+0000","last_clean":"2024-09-11T23:18:00.642029+0000","last_became_active":"2024-09-11T23:17:59.641276+0000","last_became_peered":"2024-09-11T23:17:59.641276+0000","last_unstale":"2024-09-11T23:18:00.642029+0000","last_undegraded":"2024-09-11T23:18:00.642029+0000","last_fullsized":"2024-09-11T23:18:00.642029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.341838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669562+0000","last_change":"2024-09-11T23:17:59.635790+0000","last_active":"2024-09-11T23:18:00.669562+0000","last_peered":"2024-09-11T23:18:00.669562+0000","last_clean":"2024-09-11T23:18:00.669562+0000","last_became_active":"2024-09-11T23:17:59.635509+0000","last_became_peered":"2024-09-11T23:17:59.635509+0000","last_unstale":"2024-09-11T23:18:00.669562+0000","last_undegraded":"2024-09-11T23:18:00.669562+0000","last_fullsized":"2024-09-11T23:18:00.669562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.193032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644696+0000","last_change":"2024-09-11T23:17:59.644202+0000","last_active":"2024-09-11T23:18:00.644696+0000","last_peered":"2024-09-11T23:18:00.644696+0000","last_clean":"2024-09-11T23:18:00.644696+0000","last_became_active":"2024-09-11T23:17:59.643634+0000","last_became_peered":"2024-09-11T23:17:59.643634+0000","last_unstale":"2024-09-11T23:18:00.644696+0000","last_undegraded":"2024-09-11T23:18:00.644696+0000","last_fullsized":"2024-09-11T23:18:00.644696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:38.039621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643545+0000","last_change":"2024-09-11T23:17:59.652783+0000","last_active":"2024-09-11T23:18:00.643545+0000","last_peered":"2024-09-11T23:18:00.643545+0000","last_clean":"2024-09-11T23:18:00.643545+0000","last_became_active":"2024-09-11T23:17:59.652508+0000","last_became_peered":"2024-09-11T23:17:59.652508+0000","last_unstale":"2024-09-11T23:18:00.643545+0000","last_undegraded":"2024-09-11T23:18:00.643545+0000","last_fullsized":"2024-09-11T23:18:00.643545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:04.566161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642782+0000","last_change":"2024-09-11T23:17:59.659401+0000","last_active":"2024-09-11T23:18:00.642782+0000","last_peered":"2024-09-11T23:18:00.642782+0000","last_clean":"2024-09-11T23:18:00.642782+0000","last_became_active":"2024-09-11T23:17:59.655926+0000","last_became_peered":"2024-09-11T23:17:59.655926+0000","last_unstale":"2024-09-11T23:18:00.642782+0000","last_undegraded":"2024-09-11T23:18:00.642782+0000","last_fullsized":"2024-09-11T23:18:00.642782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:09.804490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643447+0000","last_change":"2024-09-11T23:17:59.657900+0000","last_active":"2024-09-11T23:18:00.643447+0000","last_peered":"2024-09-11T23:18:00.643447+0000","last_clean":"2024-09-11T23:18:00.643447+0000","last_became_active":"2024-09-11T23:17:59.657621+0000","last_became_peered":"2024-09-11T23:17:59.657621+0000","last_unstale":"2024-09-11T23:18:00.643447+0000","last_undegraded":"2024-09-11T23:18:00.643447+0000","last_fullsized":"2024-09-11T23:18:00.643447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:14.020762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669094+0000","last_change":"2024-09-11T23:17:59.643006+0000","last_active":"2024-09-11T23:18:00.669094+0000","last_peered":"2024-09-11T23:18:00.669094+0000","last_clean":"2024-09-11T23:18:00.669094+0000","last_became_active":"2024-09-11T23:17:59.642338+0000","last_became_peered":"2024-09-11T23:17:59.642338+0000","last_unstale":"2024-09-11T23:18:00.669094+0000","last_undegraded":"2024-09-11T23:18:00.669094+0000","last_fullsized":"2024-09-11T23:18:00.669094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:29.873658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644073+0000","last_change":"2024-09-11T23:17:59.671758+0000","last_active":"2024-09-11T23:18:00.644073+0000","last_peered":"2024-09-11T23:18:00.644073+0000","last_clean":"2024-09-11T23:18:00.644073+0000","last_became_active":"2024-09-11T23:17:59.671418+0000","last_became_peered":"2024-09-11T23:17:59.671418+0000","last_unstale":"2024-09-11T23:18:00.644073+0000","last_undegraded":"2024-09-11T23:18:00.644073+0000","last_fullsized":"2024-09-11T23:18:00.644073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:31.034856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661864+0000","last_change":"2024-09-11T23:17:59.656199+0000","last_active":"2024-09-11T23:18:00.661864+0000","last_peered":"2024-09-11T23:18:00.661864+0000","last_clean":"2024-09-11T23:18:00.661864+0000","last_became_active":"2024-09-11T23:17:59.655919+0000","last_became_peered":"2024-09-11T23:17:59.655919+0000","last_unstale":"2024-09-11T23:18:00.661864+0000","last_undegraded":"2024-09-11T23:18:00.661864+0000","last_fullsized":"2024-09-11T23:18:00.661864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:50.844310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661743+0000","last_change":"2024-09-11T23:17:59.646129+0000","last_active":"2024-09-11T23:18:00.661743+0000","last_peered":"2024-09-11T23:18:00.661743+0000","last_clean":"2024-09-11T23:18:00.661743+0000","last_became_active":"2024-09-11T23:17:59.645346+0000","last_became_peered":"2024-09-11T23:17:59.645346+0000","last_unstale":"2024-09-11T23:18:00.661743+0000","last_undegraded":"2024-09-11T23:18:00.661743+0000","last_fullsized":"2024-09-11T23:18:00.661743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:05.705455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669760+0000","last_change":"2024-09-11T23:17:59.642874+0000","last_active":"2024-09-11T23:18:00.669760+0000","last_peered":"2024-09-11T23:18:00.669760+0000","last_clean":"2024-09-11T23:18:00.669760+0000","last_became_active":"2024-09-11T23:17:59.642586+0000","last_became_peered":"2024-09-11T23:17:59.642586+0000","last_unstale":"2024-09-11T23:18:00.669760+0000","last_undegraded":"2024-09-11T23:18:00.669760+0000","last_fullsized":"2024-09-11T23:18:00.669760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:57.703691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670655+0000","last_change":"2024-09-11T23:17:59.644814+0000","last_active":"2024-09-11T23:18:00.670655+0000","last_peered":"2024-09-11T23:18:00.670655+0000","last_clean":"2024-09-11T23:18:00.670655+0000","last_became_active":"2024-09-11T23:17:59.643305+0000","last_became_peered":"2024-09-11T23:17:59.643305+0000","last_unstale":"2024-09-11T23:18:00.670655+0000","last_undegraded":"2024-09-11T23:18:00.670655+0000","last_fullsized":"2024-09-11T23:18:00.670655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:29.321395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669106+0000","last_change":"2024-09-11T23:17:59.645525+0000","last_active":"2024-09-11T23:18:00.669106+0000","last_peered":"2024-09-11T23:18:00.669106+0000","last_clean":"2024-09-11T23:18:00.669106+0000","last_became_active":"2024-09-11T23:17:59.642799+0000","last_became_peered":"2024-09-11T23:17:59.642799+0000","last_unstale":"2024-09-11T23:18:00.669106+0000","last_undegraded":"2024-09-11T23:18:00.669106+0000","last_fullsized":"2024-09-11T23:18:00.669106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:24.269862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641613+0000","last_change":"2024-09-11T23:17:59.634022+0000","last_active":"2024-09-11T23:18:00.641613+0000","last_peered":"2024-09-11T23:18:00.641613+0000","last_clean":"2024-09-11T23:18:00.641613+0000","last_became_active":"2024-09-11T23:17:59.632934+0000","last_became_peered":"2024-09-11T23:17:59.632934+0000","last_unstale":"2024-09-11T23:18:00.641613+0000","last_undegraded":"2024-09-11T23:18:00.641613+0000","last_fullsized":"2024-09-11T23:18:00.641613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:36.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642779+0000","last_change":"2024-09-11T23:17:59.653627+0000","last_active":"2024-09-11T23:18:00.642779+0000","last_peered":"2024-09-11T23:18:00.642779+0000","last_clean":"2024-09-11T23:18:00.642779+0000","last_became_active":"2024-09-11T23:17:59.653088+0000","last_became_peered":"2024-09-11T23:17:59.653088+0000","last_unstale":"2024-09-11T23:18:00.642779+0000","last_undegraded":"2024-09-11T23:18:00.642779+0000","last_fullsized":"2024-09-11T23:18:00.642779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.341838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.645123+0000","last_change":"2024-09-11T23:17:59.660074+0000","last_active":"2024-09-11T23:18:00.645123+0000","last_peered":"2024-09-11T23:18:00.645123+0000","last_clean":"2024-09-11T23:18:00.645123+0000","last_became_active":"2024-09-11T23:17:59.659174+0000","last_became_peered":"2024-09-11T23:17:59.659174+0000","last_unstale":"2024-09-11T23:18:00.645123+0000","last_undegraded":"2024-09-11T23:18:00.645123+0000","last_fullsized":"2024-09-11T23:18:00.645123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:55.351687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669448+0000","last_change":"2024-09-11T23:17:59.641202+0000","last_active":"2024-09-11T23:18:00.669448+0000","last_peered":"2024-09-11T23:18:00.669448+0000","last_clean":"2024-09-11T23:18:00.669448+0000","last_became_active":"2024-09-11T23:17:59.640609+0000","last_became_peered":"2024-09-11T23:17:59.640609+0000","last_unstale":"2024-09-11T23:18:00.669448+0000","last_undegraded":"2024-09-11T23:18:00.669448+0000","last_fullsized":"2024-09-11T23:18:00.669448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:34.428505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643995+0000","last_change":"2024-09-11T23:17:59.654884+0000","last_active":"2024-09-11T23:18:00.643995+0000","last_peered":"2024-09-11T23:18:00.643995+0000","last_clean":"2024-09-11T23:18:00.643995+0000","last_became_active":"2024-09-11T23:17:59.654578+0000","last_became_peered":"2024-09-11T23:17:59.654578+0000","last_unstale":"2024-09-11T23:18:00.643995+0000","last_undegraded":"2024-09-11T23:18:00.643995+0000","last_fullsized":"2024-09-11T23:18:00.643995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:32.837922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661704+0000","last_change":"2024-09-11T23:17:59.643411+0000","last_active":"2024-09-11T23:18:00.661704+0000","last_peered":"2024-09-11T23:18:00.661704+0000","last_clean":"2024-09-11T23:18:00.661704+0000","last_became_active":"2024-09-11T23:17:59.643076+0000","last_became_peered":"2024-09-11T23:17:59.643076+0000","last_unstale":"2024-09-11T23:18:00.661704+0000","last_undegraded":"2024-09-11T23:18:00.661704+0000","last_fullsized":"2024-09-11T23:18:00.661704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:36.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669545+0000","last_change":"2024-09-11T23:17:59.650880+0000","last_active":"2024-09-11T23:18:00.669545+0000","last_peered":"2024-09-11T23:18:00.669545+0000","last_clean":"2024-09-11T23:18:00.669545+0000","last_became_active":"2024-09-11T23:17:59.650568+0000","last_became_peered":"2024-09-11T23:17:59.650568+0000","last_unstale":"2024-09-11T23:18:00.669545+0000","last_undegraded":"2024-09-11T23:18:00.669545+0000","last_fullsized":"2024-09-11T23:18:00.669545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:15.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642771+0000","last_change":"2024-09-11T23:17:59.666448+0000","last_active":"2024-09-11T23:18:00.642771+0000","last_peered":"2024-09-11T23:18:00.642771+0000","last_clean":"2024-09-11T23:18:00.642771+0000","last_became_active":"2024-09-11T23:17:59.664741+0000","last_became_peered":"2024-09-11T23:17:59.664741+0000","last_unstale":"2024-09-11T23:18:00.642771+0000","last_undegraded":"2024-09-11T23:18:00.642771+0000","last_fullsized":"2024-09-11T23:18:00.642771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:50.844310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670229+0000","last_change":"2024-09-11T23:17:59.645036+0000","last_active":"2024-09-11T23:18:00.670229+0000","last_peered":"2024-09-11T23:18:00.670229+0000","last_clean":"2024-09-11T23:18:00.670229+0000","last_became_active":"2024-09-11T23:17:59.644706+0000","last_became_peered":"2024-09-11T23:17:59.644706+0000","last_unstale":"2024-09-11T23:18:00.670229+0000","last_undegraded":"2024-09-11T23:18:00.670229+0000","last_fullsized":"2024-09-11T23:18:00.670229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:04.266917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642955+0000","last_change":"2024-09-11T23:17:59.653352+0000","last_active":"2024-09-11T23:18:00.642955+0000","last_peered":"2024-09-11T23:18:00.642955+0000","last_clean":"2024-09-11T23:18:00.642955+0000","last_became_active":"2024-09-11T23:17:59.652470+0000","last_became_peered":"2024-09-11T23:17:59.652470+0000","last_unstale":"2024-09-11T23:18:00.642955+0000","last_undegraded":"2024-09-11T23:18:00.642955+0000","last_fullsized":"2024-09-11T23:18:00.642955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:15.213721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671014+0000","last_change":"2024-09-11T23:17:59.662259+0000","last_active":"2024-09-11T23:18:00.671014+0000","last_peered":"2024-09-11T23:18:00.671014+0000","last_clean":"2024-09-11T23:18:00.671014+0000","last_became_active":"2024-09-11T23:17:59.662031+0000","last_became_peered":"2024-09-11T23:17:59.662031+0000","last_unstale":"2024-09-11T23:18:00.671014+0000","last_undegraded":"2024-09-11T23:18:00.671014+0000","last_fullsized":"2024-09-11T23:18:00.671014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:34.160365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661875+0000","last_change":"2024-09-11T23:17:59.650797+0000","last_active":"2024-09-11T23:18:00.661875+0000","last_peered":"2024-09-11T23:18:00.661875+0000","last_clean":"2024-09-11T23:18:00.661875+0000","last_became_active":"2024-09-11T23:17:59.650548+0000","last_became_peered":"2024-09-11T23:17:59.650548+0000","last_unstale":"2024-09-11T23:18:00.661875+0000","last_undegraded":"2024-09-11T23:18:00.661875+0000","last_fullsized":"2024-09-11T23:18:00.661875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.341838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641767+0000","last_change":"2024-09-11T23:17:59.646422+0000","last_active":"2024-09-11T23:18:00.641767+0000","last_peered":"2024-09-11T23:18:00.641767+0000","last_clean":"2024-09-11T23:18:00.641767+0000","last_became_active":"2024-09-11T23:17:59.646112+0000","last_became_peered":"2024-09-11T23:17:59.646112+0000","last_unstale":"2024-09-11T23:18:00.641767+0000","last_undegraded":"2024-09-11T23:18:00.641767+0000","last_fullsized":"2024-09-11T23:18:00.641767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:50.844310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670965+0000","last_change":"2024-09-11T23:17:59.644063+0000","last_active":"2024-09-11T23:18:00.670965+0000","last_peered":"2024-09-11T23:18:00.670965+0000","last_clean":"2024-09-11T23:18:00.670965+0000","last_became_active":"2024-09-11T23:17:59.643760+0000","last_became_peered":"2024-09-11T23:17:59.643760+0000","last_unstale":"2024-09-11T23:18:00.670965+0000","last_undegraded":"2024-09-11T23:18:00.670965+0000","last_fullsized":"2024-09-11T23:18:00.670965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:31.141907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669864+0000","last_change":"2024-09-11T23:17:59.645858+0000","last_active":"2024-09-11T23:18:00.669864+0000","last_peered":"2024-09-11T23:18:00.669864+0000","last_clean":"2024-09-11T23:18:00.669864+0000","last_became_active":"2024-09-11T23:17:59.645602+0000","last_became_peered":"2024-09-11T23:17:59.645602+0000","last_unstale":"2024-09-11T23:18:00.669864+0000","last_undegraded":"2024-09-11T23:18:00.669864+0000","last_fullsized":"2024-09-11T23:18:00.669864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:09.804490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642891+0000","last_change":"2024-09-11T23:17:59.657821+0000","last_active":"2024-09-11T23:18:00.642891+0000","last_peered":"2024-09-11T23:18:00.642891+0000","last_clean":"2024-09-11T23:18:00.642891+0000","last_became_active":"2024-09-11T23:17:59.645334+0000","last_became_peered":"2024-09-11T23:17:59.645334+0000","last_unstale":"2024-09-11T23:18:00.642891+0000","last_undegraded":"2024-09-11T23:18:00.642891+0000","last_fullsized":"2024-09-11T23:18:00.642891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:28.813283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669574+0000","last_change":"2024-09-11T23:17:59.636987+0000","last_active":"2024-09-11T23:18:00.669574+0000","last_peered":"2024-09-11T23:18:00.669574+0000","last_clean":"2024-09-11T23:18:00.669574+0000","last_became_active":"2024-09-11T23:17:59.636762+0000","last_became_peered":"2024-09-11T23:17:59.636762+0000","last_unstale":"2024-09-11T23:18:00.669574+0000","last_undegraded":"2024-09-11T23:18:00.669574+0000","last_fullsized":"2024-09-11T23:18:00.669574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:10.353893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661493+0000","last_change":"2024-09-11T23:17:59.648354+0000","last_active":"2024-09-11T23:18:00.661493+0000","last_peered":"2024-09-11T23:18:00.661493+0000","last_clean":"2024-09-11T23:18:00.661493+0000","last_became_active":"2024-09-11T23:17:59.646693+0000","last_became_peered":"2024-09-11T23:17:59.646693+0000","last_unstale":"2024-09-11T23:18:00.661493+0000","last_undegraded":"2024-09-11T23:18:00.661493+0000","last_fullsized":"2024-09-11T23:18:00.661493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:15.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669206+0000","last_change":"2024-09-11T23:17:59.637101+0000","last_active":"2024-09-11T23:18:00.669206+0000","last_peered":"2024-09-11T23:18:00.669206+0000","last_clean":"2024-09-11T23:18:00.669206+0000","last_became_active":"2024-09-11T23:17:59.635407+0000","last_became_peered":"2024-09-11T23:17:59.635407+0000","last_unstale":"2024-09-11T23:18:00.669206+0000","last_undegraded":"2024-09-11T23:18:00.669206+0000","last_fullsized":"2024-09-11T23:18:00.669206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:35.519961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670769+0000","last_change":"2024-09-11T23:17:58.642664+0000","last_active":"2024-09-11T23:18:00.670769+0000","last_peered":"2024-09-11T23:18:00.670769+0000","last_clean":"2024-09-11T23:18:00.670769+0000","last_became_active":"2024-09-11T23:17:58.642371+0000","last_became_peered":"2024-09-11T23:17:58.642371+0000","last_unstale":"2024-09-11T23:18:00.670769+0000","last_undegraded":"2024-09-11T23:18:00.670769+0000","last_fullsized":"2024-09-11T23:18:00.670769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:31.214611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669649+0000","last_change":"2024-09-11T23:17:59.641906+0000","last_active":"2024-09-11T23:18:00.669649+0000","last_peered":"2024-09-11T23:18:00.669649+0000","last_clean":"2024-09-11T23:18:00.669649+0000","last_became_active":"2024-09-11T23:17:59.641634+0000","last_became_peered":"2024-09-11T23:17:59.641634+0000","last_unstale":"2024-09-11T23:18:00.669649+0000","last_undegraded":"2024-09-11T23:18:00.669649+0000","last_fullsized":"2024-09-11T23:18:00.669649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:36.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661629+0000","last_change":"2024-09-11T23:17:58.640442+0000","last_active":"2024-09-11T23:18:00.661629+0000","last_peered":"2024-09-11T23:18:00.661629+0000","last_clean":"2024-09-11T23:18:00.661629+0000","last_became_active":"2024-09-11T23:17:58.640148+0000","last_became_peered":"2024-09-11T23:17:58.640148+0000","last_unstale":"2024-09-11T23:18:00.661629+0000","last_undegraded":"2024-09-11T23:18:00.661629+0000","last_fullsized":"2024-09-11T23:18:00.661629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:02.505670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670322+0000","last_change":"2024-09-11T23:17:58.640181+0000","last_active":"2024-09-11T23:18:00.670322+0000","last_peered":"2024-09-11T23:18:00.670322+0000","last_clean":"2024-09-11T23:18:00.670322+0000","last_became_active":"2024-09-11T23:17:58.639944+0000","last_became_peered":"2024-09-11T23:17:58.639944+0000","last_unstale":"2024-09-11T23:18:00.670322+0000","last_undegraded":"2024-09-11T23:18:00.670322+0000","last_fullsized":"2024-09-11T23:18:00.670322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:02.827617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669793+0000","last_change":"2024-09-11T23:17:59.643922+0000","last_active":"2024-09-11T23:18:00.669793+0000","last_peered":"2024-09-11T23:18:00.669793+0000","last_clean":"2024-09-11T23:18:00.669793+0000","last_became_active":"2024-09-11T23:17:59.643613+0000","last_became_peered":"2024-09-11T23:17:59.643613+0000","last_unstale":"2024-09-11T23:18:00.669793+0000","last_undegraded":"2024-09-11T23:18:00.669793+0000","last_fullsized":"2024-09-11T23:18:00.669793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:31.792631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643050+0000","last_change":"2024-09-11T23:17:58.640428+0000","last_active":"2024-09-11T23:18:00.643050+0000","last_peered":"2024-09-11T23:18:00.643050+0000","last_clean":"2024-09-11T23:18:00.643050+0000","last_became_active":"2024-09-11T23:17:58.639860+0000","last_became_peered":"2024-09-11T23:17:58.639860+0000","last_unstale":"2024-09-11T23:18:00.643050+0000","last_undegraded":"2024-09-11T23:18:00.643050+0000","last_fullsized":"2024-09-11T23:18:00.643050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641494+0000","last_change":"2024-09-11T23:17:59.638046+0000","last_active":"2024-09-11T23:18:00.641494+0000","last_peered":"2024-09-11T23:18:00.641494+0000","last_clean":"2024-09-11T23:18:00.641494+0000","last_became_active":"2024-09-11T23:17:59.637621+0000","last_became_peered":"2024-09-11T23:17:59.637621+0000","last_unstale":"2024-09-11T23:18:00.641494+0000","last_undegraded":"2024-09-11T23:18:00.641494+0000","last_fullsized":"2024-09-11T23:18:00.641494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:15.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661844+0000","last_change":"2024-09-11T23:17:58.645977+0000","last_active":"2024-09-11T23:18:00.661844+0000","last_peered":"2024-09-11T23:18:00.661844+0000","last_clean":"2024-09-11T23:18:00.661844+0000","last_became_active":"2024-09-11T23:17:58.645482+0000","last_became_peered":"2024-09-11T23:17:58.645482+0000","last_unstale":"2024-09-11T23:18:00.661844+0000","last_undegraded":"2024-09-11T23:18:00.661844+0000","last_fullsized":"2024-09-11T23:18:00.661844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:31.277023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644953+0000","last_change":"2024-09-11T23:17:59.658501+0000","last_active":"2024-09-11T23:18:00.644953+0000","last_peered":"2024-09-11T23:18:00.644953+0000","last_clean":"2024-09-11T23:18:00.644953+0000","last_became_active":"2024-09-11T23:17:59.658268+0000","last_became_peered":"2024-09-11T23:17:59.658268+0000","last_unstale":"2024-09-11T23:18:00.644953+0000","last_undegraded":"2024-09-11T23:18:00.644953+0000","last_fullsized":"2024-09-11T23:18:00.644953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:13.861431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.645078+0000","last_change":"2024-09-11T23:17:58.640356+0000","last_active":"2024-09-11T23:18:00.645078+0000","last_peered":"2024-09-11T23:18:00.645078+0000","last_clean":"2024-09-11T23:18:00.645078+0000","last_became_active":"2024-09-11T23:17:58.640060+0000","last_became_peered":"2024-09-11T23:17:58.640060+0000","last_unstale":"2024-09-11T23:18:00.645078+0000","last_undegraded":"2024-09-11T23:18:00.645078+0000","last_fullsized":"2024-09-11T23:18:00.645078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:31.277023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669890+0000","last_change":"2024-09-11T23:17:59.669290+0000","last_active":"2024-09-11T23:18:00.669890+0000","last_peered":"2024-09-11T23:18:00.669890+0000","last_clean":"2024-09-11T23:18:00.669890+0000","last_became_active":"2024-09-11T23:17:59.668837+0000","last_became_peered":"2024-09-11T23:17:59.668837+0000","last_unstale":"2024-09-11T23:18:00.669890+0000","last_undegraded":"2024-09-11T23:18:00.669890+0000","last_fullsized":"2024-09-11T23:18:00.669890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:50.844310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641822+0000","last_change":"2024-09-11T23:17:58.646012+0000","last_active":"2024-09-11T23:18:00.641822+0000","last_peered":"2024-09-11T23:18:00.641822+0000","last_clean":"2024-09-11T23:18:00.641822+0000","last_became_active":"2024-09-11T23:17:58.645093+0000","last_became_peered":"2024-09-11T23:17:58.645093+0000","last_unstale":"2024-09-11T23:18:00.641822+0000","last_undegraded":"2024-09-11T23:18:00.641822+0000","last_fullsized":"2024-09-11T23:18:00.641822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:31.277023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669811+0000","last_change":"2024-09-11T23:17:59.653386+0000","last_active":"2024-09-11T23:18:00.669811+0000","last_peered":"2024-09-11T23:18:00.669811+0000","last_clean":"2024-09-11T23:18:00.669811+0000","last_became_active":"2024-09-11T23:17:59.653112+0000","last_became_peered":"2024-09-11T23:17:59.653112+0000","last_unstale":"2024-09-11T23:18:00.669811+0000","last_undegraded":"2024-09-11T23:18:00.669811+0000","last_fullsized":"2024-09-11T23:18:00.669811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:30.915550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661618+0000","last_change":"2024-09-11T23:17:58.642732+0000","last_active":"2024-09-11T23:18:00.661618+0000","last_peered":"2024-09-11T23:18:00.661618+0000","last_clean":"2024-09-11T23:18:00.661618+0000","last_became_active":"2024-09-11T23:17:58.642411+0000","last_became_peered":"2024-09-11T23:17:58.642411+0000","last_unstale":"2024-09-11T23:18:00.661618+0000","last_undegraded":"2024-09-11T23:18:00.661618+0000","last_fullsized":"2024-09-11T23:18:00.661618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:21.084931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643652+0000","last_change":"2024-09-11T23:17:59.652260+0000","last_active":"2024-09-11T23:18:00.643652+0000","last_peered":"2024-09-11T23:18:00.643652+0000","last_clean":"2024-09-11T23:18:00.643652+0000","last_became_active":"2024-09-11T23:17:59.651842+0000","last_became_peered":"2024-09-11T23:17:59.651842+0000","last_unstale":"2024-09-11T23:18:00.643652+0000","last_undegraded":"2024-09-11T23:18:00.643652+0000","last_fullsized":"2024-09-11T23:18:00.643652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:13.861431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669696+0000","last_change":"2024-09-11T23:17:58.629743+0000","last_active":"2024-09-11T23:18:00.669696+0000","last_peered":"2024-09-11T23:18:00.669696+0000","last_clean":"2024-09-11T23:18:00.669696+0000","last_became_active":"2024-09-11T23:17:58.629379+0000","last_became_peered":"2024-09-11T23:17:58.629379+0000","last_unstale":"2024-09-11T23:18:00.669696+0000","last_undegraded":"2024-09-11T23:18:00.669696+0000","last_fullsized":"2024-09-11T23:18:00.669696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:09.475238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669255+0000","last_change":"2024-09-11T23:17:59.647539+0000","last_active":"2024-09-11T23:18:00.669255+0000","last_peered":"2024-09-11T23:18:00.669255+0000","last_clean":"2024-09-11T23:18:00.669255+0000","last_became_active":"2024-09-11T23:17:59.647293+0000","last_became_peered":"2024-09-11T23:17:59.647293+0000","last_unstale":"2024-09-11T23:18:00.669255+0000","last_undegraded":"2024-09-11T23:18:00.669255+0000","last_fullsized":"2024-09-11T23:18:00.669255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:49.647417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642905+0000","last_change":"2024-09-11T23:17:58.641139+0000","last_active":"2024-09-11T23:18:00.642905+0000","last_peered":"2024-09-11T23:18:00.642905+0000","last_clean":"2024-09-11T23:18:00.642905+0000","last_became_active":"2024-09-11T23:17:58.640813+0000","last_became_peered":"2024-09-11T23:17:58.640813+0000","last_unstale":"2024-09-11T23:18:00.642905+0000","last_undegraded":"2024-09-11T23:18:00.642905+0000","last_fullsized":"2024-09-11T23:18:00.642905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:02.505670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643757+0000","last_change":"2024-09-11T23:17:59.661121+0000","last_active":"2024-09-11T23:18:00.643757+0000","last_peered":"2024-09-11T23:18:00.643757+0000","last_clean":"2024-09-11T23:18:00.643757+0000","last_became_active":"2024-09-11T23:17:59.660078+0000","last_became_peered":"2024-09-11T23:17:59.660078+0000","last_unstale":"2024-09-11T23:18:00.643757+0000","last_undegraded":"2024-09-11T23:18:00.643757+0000","last_fullsized":"2024-09-11T23:18:00.643757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:55.351687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661430+0000","last_change":"2024-09-11T23:17:58.636194+0000","last_active":"2024-09-11T23:18:00.661430+0000","last_peered":"2024-09-11T23:18:00.661430+0000","last_clean":"2024-09-11T23:18:00.661430+0000","last_became_active":"2024-09-11T23:17:58.635885+0000","last_became_peered":"2024-09-11T23:17:58.635885+0000","last_unstale":"2024-09-11T23:18:00.661430+0000","last_undegraded":"2024-09-11T23:18:00.661430+0000","last_fullsized":"2024-09-11T23:18:00.661430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661491+0000","last_change":"2024-09-11T23:17:59.648931+0000","last_active":"2024-09-11T23:18:00.661491+0000","last_peered":"2024-09-11T23:18:00.661491+0000","last_clean":"2024-09-11T23:18:00.661491+0000","last_became_active":"2024-09-11T23:17:59.646149+0000","last_became_peered":"2024-09-11T23:17:59.646149+0000","last_unstale":"2024-09-11T23:18:00.661491+0000","last_undegraded":"2024-09-11T23:18:00.661491+0000","last_fullsized":"2024-09-11T23:18:00.661491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.193032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669254+0000","last_change":"2024-09-11T23:17:58.631291+0000","last_active":"2024-09-11T23:18:00.669254+0000","last_peered":"2024-09-11T23:18:00.669254+0000","last_clean":"2024-09-11T23:18:00.669254+0000","last_became_active":"2024-09-11T23:17:58.630939+0000","last_became_peered":"2024-09-11T23:17:58.630939+0000","last_unstale":"2024-09-11T23:18:00.669254+0000","last_undegraded":"2024-09-11T23:18:00.669254+0000","last_fullsized":"2024-09-11T23:18:00.669254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:53:26.952229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643224+0000","last_change":"2024-09-11T23:17:59.660874+0000","last_active":"2024-09-11T23:18:00.643224+0000","last_peered":"2024-09-11T23:18:00.643224+0000","last_clean":"2024-09-11T23:18:00.643224+0000","last_became_active":"2024-09-11T23:17:59.660613+0000","last_became_peered":"2024-09-11T23:17:59.660613+0000","last_unstale":"2024-09-11T23:18:00.643224+0000","last_undegraded":"2024-09-11T23:18:00.643224+0000","last_fullsized":"2024-09-11T23:18:00.643224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:42.560113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670003+0000","last_change":"2024-09-11T23:17:58.635774+0000","last_active":"2024-09-11T23:18:00.670003+0000","last_peered":"2024-09-11T23:18:00.670003+0000","last_clean":"2024-09-11T23:18:00.670003+0000","last_became_active":"2024-09-11T23:17:58.634748+0000","last_became_peered":"2024-09-11T23:17:58.634748+0000","last_unstale":"2024-09-11T23:18:00.670003+0000","last_undegraded":"2024-09-11T23:18:00.670003+0000","last_fullsized":"2024-09-11T23:18:00.670003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:44.209956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643691+0000","last_change":"2024-09-11T23:17:59.662246+0000","last_active":"2024-09-11T23:18:00.643691+0000","last_peered":"2024-09-11T23:18:00.643691+0000","last_clean":"2024-09-11T23:18:00.643691+0000","last_became_active":"2024-09-11T23:17:59.661866+0000","last_became_peered":"2024-09-11T23:17:59.661866+0000","last_unstale":"2024-09-11T23:18:00.643691+0000","last_undegraded":"2024-09-11T23:18:00.643691+0000","last_fullsized":"2024-09-11T23:18:00.643691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:00.628195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669504+0000","last_change":"2024-09-11T23:17:58.634201+0000","last_active":"2024-09-11T23:18:00.669504+0000","last_peered":"2024-09-11T23:18:00.669504+0000","last_clean":"2024-09-11T23:18:00.669504+0000","last_became_active":"2024-09-11T23:17:58.633865+0000","last_became_peered":"2024-09-11T23:17:58.633865+0000","last_unstale":"2024-09-11T23:18:00.669504+0000","last_undegraded":"2024-09-11T23:18:00.669504+0000","last_fullsized":"2024-09-11T23:18:00.669504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:12.634428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644038+0000","last_change":"2024-09-11T23:17:59.668175+0000","last_active":"2024-09-11T23:18:00.644038+0000","last_peered":"2024-09-11T23:18:00.644038+0000","last_clean":"2024-09-11T23:18:00.644038+0000","last_became_active":"2024-09-11T23:17:59.665569+0000","last_became_peered":"2024-09-11T23:17:59.665569+0000","last_unstale":"2024-09-11T23:18:00.644038+0000","last_undegraded":"2024-09-11T23:18:00.644038+0000","last_fullsized":"2024-09-11T23:18:00.644038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:49.216535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641877+0000","last_change":"2024-09-11T23:17:58.630807+0000","last_active":"2024-09-11T23:18:00.641877+0000","last_peered":"2024-09-11T23:18:00.641877+0000","last_clean":"2024-09-11T23:18:00.641877+0000","last_became_active":"2024-09-11T23:17:58.630491+0000","last_became_peered":"2024-09-11T23:17:58.630491+0000","last_unstale":"2024-09-11T23:18:00.641877+0000","last_undegraded":"2024-09-11T23:18:00.641877+0000","last_fullsized":"2024-09-11T23:18:00.641877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.907527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644892+0000","last_change":"2024-09-11T23:17:59.643945+0000","last_active":"2024-09-11T23:18:00.644892+0000","last_peered":"2024-09-11T23:18:00.644892+0000","last_clean":"2024-09-11T23:18:00.644892+0000","last_became_active":"2024-09-11T23:17:59.643358+0000","last_became_peered":"2024-09-11T23:17:59.643358+0000","last_unstale":"2024-09-11T23:18:00.644892+0000","last_undegraded":"2024-09-11T23:18:00.644892+0000","last_fullsized":"2024-09-11T23:18:00.644892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:14.020762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670008+0000","last_change":"2024-09-11T23:17:58.645520+0000","last_active":"2024-09-11T23:18:00.670008+0000","last_peered":"2024-09-11T23:18:00.670008+0000","last_clean":"2024-09-11T23:18:00.670008+0000","last_became_active":"2024-09-11T23:17:58.645211+0000","last_became_peered":"2024-09-11T23:17:58.645211+0000","last_unstale":"2024-09-11T23:18:00.670008+0000","last_undegraded":"2024-09-11T23:18:00.670008+0000","last_fullsized":"2024-09-11T23:18:00.670008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:02.827617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643867+0000","last_change":"2024-09-11T23:17:59.669515+0000","last_active":"2024-09-11T23:18:00.643867+0000","last_peered":"2024-09-11T23:18:00.643867+0000","last_clean":"2024-09-11T23:18:00.643867+0000","last_became_active":"2024-09-11T23:17:59.669182+0000","last_became_peered":"2024-09-11T23:17:59.669182+0000","last_unstale":"2024-09-11T23:18:00.643867+0000","last_undegraded":"2024-09-11T23:18:00.643867+0000","last_fullsized":"2024-09-11T23:18:00.643867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:26.131689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642556+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:18:00.642556+0000","last_peered":"2024-09-11T23:18:00.642556+0000","last_clean":"2024-09-11T23:18:00.642556+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:18:00.642556+0000","last_undegraded":"2024-09-11T23:18:00.642556+0000","last_fullsized":"2024-09-11T23:18:00.642556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644109+0000","last_change":"2024-09-11T23:17:58.634769+0000","last_active":"2024-09-11T23:18:00.644109+0000","last_peered":"2024-09-11T23:18:00.644109+0000","last_clean":"2024-09-11T23:18:00.644109+0000","last_became_active":"2024-09-11T23:17:58.634321+0000","last_became_peered":"2024-09-11T23:17:58.634321+0000","last_unstale":"2024-09-11T23:18:00.644109+0000","last_undegraded":"2024-09-11T23:18:00.644109+0000","last_fullsized":"2024-09-11T23:18:00.644109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:21.084931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669925+0000","last_change":"2024-09-11T23:17:59.659482+0000","last_active":"2024-09-11T23:18:00.669925+0000","last_peered":"2024-09-11T23:18:00.669925+0000","last_clean":"2024-09-11T23:18:00.669925+0000","last_became_active":"2024-09-11T23:17:59.659148+0000","last_became_peered":"2024-09-11T23:17:59.659148+0000","last_unstale":"2024-09-11T23:18:00.669925+0000","last_undegraded":"2024-09-11T23:18:00.669925+0000","last_fullsized":"2024-09-11T23:18:00.669925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:22.419970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642401+0000","last_change":"2024-09-11T23:17:58.636656+0000","last_active":"2024-09-11T23:18:00.642401+0000","last_peered":"2024-09-11T23:18:00.642401+0000","last_clean":"2024-09-11T23:18:00.642401+0000","last_became_active":"2024-09-11T23:17:58.636363+0000","last_became_peered":"2024-09-11T23:17:58.636363+0000","last_unstale":"2024-09-11T23:18:00.642401+0000","last_undegraded":"2024-09-11T23:18:00.642401+0000","last_fullsized":"2024-09-11T23:18:00.642401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:04.565864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669116+0000","last_change":"2024-09-11T23:17:59.640328+0000","last_active":"2024-09-11T23:18:00.669116+0000","last_peered":"2024-09-11T23:18:00.669116+0000","last_clean":"2024-09-11T23:18:00.669116+0000","last_became_active":"2024-09-11T23:17:59.640058+0000","last_became_peered":"2024-09-11T23:17:59.640058+0000","last_unstale":"2024-09-11T23:18:00.669116+0000","last_undegraded":"2024-09-11T23:18:00.669116+0000","last_fullsized":"2024-09-11T23:18:00.669116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:31.650891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669359+0000","last_change":"2024-09-11T23:17:58.642240+0000","last_active":"2024-09-11T23:18:00.669359+0000","last_peered":"2024-09-11T23:18:00.669359+0000","last_clean":"2024-09-11T23:18:00.669359+0000","last_became_active":"2024-09-11T23:17:58.641996+0000","last_became_peered":"2024-09-11T23:17:58.641996+0000","last_unstale":"2024-09-11T23:18:00.669359+0000","last_undegraded":"2024-09-11T23:18:00.669359+0000","last_fullsized":"2024-09-11T23:18:00.669359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:29:09.781577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641685+0000","last_change":"2024-09-11T23:17:59.638548+0000","last_active":"2024-09-11T23:18:00.641685+0000","last_peered":"2024-09-11T23:18:00.641685+0000","last_clean":"2024-09-11T23:18:00.641685+0000","last_became_active":"2024-09-11T23:17:59.638044+0000","last_became_peered":"2024-09-11T23:17:59.638044+0000","last_unstale":"2024-09-11T23:18:00.641685+0000","last_undegraded":"2024-09-11T23:18:00.641685+0000","last_fullsized":"2024-09-11T23:18:00.641685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:05.705455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642958+0000","last_change":"2024-09-11T23:17:58.641231+0000","last_active":"2024-09-11T23:18:00.642958+0000","last_peered":"2024-09-11T23:18:00.642958+0000","last_clean":"2024-09-11T23:18:00.642958+0000","last_became_active":"2024-09-11T23:17:58.640860+0000","last_became_peered":"2024-09-11T23:17:58.640860+0000","last_unstale":"2024-09-11T23:18:00.642958+0000","last_undegraded":"2024-09-11T23:18:00.642958+0000","last_fullsized":"2024-09-11T23:18:00.642958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669466+0000","last_change":"2024-09-11T23:17:59.643898+0000","last_active":"2024-09-11T23:18:00.669466+0000","last_peered":"2024-09-11T23:18:00.669466+0000","last_clean":"2024-09-11T23:18:00.669466+0000","last_became_active":"2024-09-11T23:17:59.643471+0000","last_became_peered":"2024-09-11T23:17:59.643471+0000","last_unstale":"2024-09-11T23:18:00.669466+0000","last_undegraded":"2024-09-11T23:18:00.669466+0000","last_fullsized":"2024-09-11T23:18:00.669466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:32.285047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641618+0000","last_change":"2024-09-11T23:17:58.640659+0000","last_active":"2024-09-11T23:18:00.641618+0000","last_peered":"2024-09-11T23:18:00.641618+0000","last_clean":"2024-09-11T23:18:00.641618+0000","last_became_active":"2024-09-11T23:17:58.640358+0000","last_became_peered":"2024-09-11T23:17:58.640358+0000","last_unstale":"2024-09-11T23:18:00.641618+0000","last_undegraded":"2024-09-11T23:18:00.641618+0000","last_fullsized":"2024-09-11T23:18:00.641618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.645047+0000","last_change":"2024-09-11T23:17:59.659233+0000","last_active":"2024-09-11T23:18:00.645047+0000","last_peered":"2024-09-11T23:18:00.645047+0000","last_clean":"2024-09-11T23:18:00.645047+0000","last_became_active":"2024-09-11T23:17:59.655952+0000","last_became_peered":"2024-09-11T23:17:59.655952+0000","last_unstale":"2024-09-11T23:18:00.645047+0000","last_undegraded":"2024-09-11T23:18:00.645047+0000","last_fullsized":"2024-09-11T23:18:00.645047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:00.628195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644053+0000","last_change":"2024-09-11T23:17:58.642080+0000","last_active":"2024-09-11T23:18:00.644053+0000","last_peered":"2024-09-11T23:18:00.644053+0000","last_clean":"2024-09-11T23:18:00.644053+0000","last_became_active":"2024-09-11T23:17:58.641752+0000","last_became_peered":"2024-09-11T23:17:58.641752+0000","last_unstale":"2024-09-11T23:18:00.644053+0000","last_undegraded":"2024-09-11T23:18:00.644053+0000","last_fullsized":"2024-09-11T23:18:00.644053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:30.642868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641527+0000","last_change":"2024-09-11T23:17:59.634847+0000","last_active":"2024-09-11T23:18:00.641527+0000","last_peered":"2024-09-11T23:18:00.641527+0000","last_clean":"2024-09-11T23:18:00.641527+0000","last_became_active":"2024-09-11T23:17:59.634547+0000","last_became_peered":"2024-09-11T23:17:59.634547+0000","last_unstale":"2024-09-11T23:18:00.641527+0000","last_undegraded":"2024-09-11T23:18:00.641527+0000","last_fullsized":"2024-09-11T23:18:00.641527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.193032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642072+0000","last_change":"2024-09-11T23:17:58.633818+0000","last_active":"2024-09-11T23:18:00.642072+0000","last_peered":"2024-09-11T23:18:00.642072+0000","last_clean":"2024-09-11T23:18:00.642072+0000","last_became_active":"2024-09-11T23:17:58.633550+0000","last_became_peered":"2024-09-11T23:17:58.633550+0000","last_unstale":"2024-09-11T23:18:00.642072+0000","last_undegraded":"2024-09-11T23:18:00.642072+0000","last_fullsized":"2024-09-11T23:18:00.642072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:56.695668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671118+0000","last_change":"2024-09-11T23:17:59.650990+0000","last_active":"2024-09-11T23:18:00.671118+0000","last_peered":"2024-09-11T23:18:00.671118+0000","last_clean":"2024-09-11T23:18:00.671118+0000","last_became_active":"2024-09-11T23:17:59.650684+0000","last_became_peered":"2024-09-11T23:17:59.650684+0000","last_unstale":"2024-09-11T23:18:00.671118+0000","last_undegraded":"2024-09-11T23:18:00.671118+0000","last_fullsized":"2024-09-11T23:18:00.671118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:17.470426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661904+0000","last_change":"2024-09-11T23:17:58.639477+0000","last_active":"2024-09-11T23:18:00.661904+0000","last_peered":"2024-09-11T23:18:00.661904+0000","last_clean":"2024-09-11T23:18:00.661904+0000","last_became_active":"2024-09-11T23:17:58.639168+0000","last_became_peered":"2024-09-11T23:17:58.639168+0000","last_unstale":"2024-09-11T23:18:00.661904+0000","last_undegraded":"2024-09-11T23:18:00.661904+0000","last_fullsized":"2024-09-11T23:18:00.661904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669908+0000","last_change":"2024-09-11T23:17:59.650474+0000","last_active":"2024-09-11T23:18:00.669908+0000","last_peered":"2024-09-11T23:18:00.669908+0000","last_clean":"2024-09-11T23:18:00.669908+0000","last_became_active":"2024-09-11T23:17:59.650168+0000","last_became_peered":"2024-09-11T23:17:59.650168+0000","last_unstale":"2024-09-11T23:18:00.669908+0000","last_undegraded":"2024-09-11T23:18:00.669908+0000","last_fullsized":"2024-09-11T23:18:00.669908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.341838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642401+0000","last_change":"2024-09-11T23:17:58.640620+0000","last_active":"2024-09-11T23:18:00.642401+0000","last_peered":"2024-09-11T23:18:00.642401+0000","last_clean":"2024-09-11T23:18:00.642401+0000","last_became_active":"2024-09-11T23:17:58.640367+0000","last_became_peered":"2024-09-11T23:17:58.640367+0000","last_unstale":"2024-09-11T23:18:00.642401+0000","last_undegraded":"2024-09-11T23:18:00.642401+0000","last_fullsized":"2024-09-11T23:18:00.642401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.907527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669188+0000","last_change":"2024-09-11T23:17:59.635712+0000","last_active":"2024-09-11T23:18:00.669188+0000","last_peered":"2024-09-11T23:18:00.669188+0000","last_clean":"2024-09-11T23:18:00.669188+0000","last_became_active":"2024-09-11T23:17:59.635303+0000","last_became_peered":"2024-09-11T23:17:59.635303+0000","last_unstale":"2024-09-11T23:18:00.669188+0000","last_undegraded":"2024-09-11T23:18:00.669188+0000","last_fullsized":"2024-09-11T23:18:00.669188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:03.513693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641602+0000","last_change":"2024-09-11T23:17:58.639596+0000","last_active":"2024-09-11T23:18:00.641602+0000","last_peered":"2024-09-11T23:18:00.641602+0000","last_clean":"2024-09-11T23:18:00.641602+0000","last_became_active":"2024-09-11T23:17:58.639333+0000","last_became_peered":"2024-09-11T23:17:58.639333+0000","last_unstale":"2024-09-11T23:18:00.641602+0000","last_undegraded":"2024-09-11T23:18:00.641602+0000","last_fullsized":"2024-09-11T23:18:00.641602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:02.505670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669868+0000","last_change":"2024-09-11T23:17:59.643630+0000","last_active":"2024-09-11T23:18:00.669868+0000","last_peered":"2024-09-11T23:18:00.669868+0000","last_clean":"2024-09-11T23:18:00.669868+0000","last_became_active":"2024-09-11T23:17:59.643080+0000","last_became_peered":"2024-09-11T23:17:59.643080+0000","last_unstale":"2024-09-11T23:18:00.669868+0000","last_undegraded":"2024-09-11T23:18:00.669868+0000","last_fullsized":"2024-09-11T23:18:00.669868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:59.272347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641919+0000","last_change":"2024-09-11T23:17:58.634155+0000","last_active":"2024-09-11T23:18:00.641919+0000","last_peered":"2024-09-11T23:18:00.641919+0000","last_clean":"2024-09-11T23:18:00.641919+0000","last_became_active":"2024-09-11T23:17:58.633898+0000","last_became_peered":"2024-09-11T23:17:58.633898+0000","last_unstale":"2024-09-11T23:18:00.641919+0000","last_undegraded":"2024-09-11T23:18:00.641919+0000","last_fullsized":"2024-09-11T23:18:00.641919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:21.084931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670728+0000","last_change":"2024-09-11T23:17:59.648274+0000","last_active":"2024-09-11T23:18:00.670728+0000","last_peered":"2024-09-11T23:18:00.670728+0000","last_clean":"2024-09-11T23:18:00.670728+0000","last_became_active":"2024-09-11T23:17:59.646482+0000","last_became_peered":"2024-09-11T23:17:59.646482+0000","last_unstale":"2024-09-11T23:18:00.670728+0000","last_undegraded":"2024-09-11T23:18:00.670728+0000","last_fullsized":"2024-09-11T23:18:00.670728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:06.041413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643987+0000","last_change":"2024-09-11T23:17:58.644868+0000","last_active":"2024-09-11T23:18:00.643987+0000","last_peered":"2024-09-11T23:18:00.643987+0000","last_clean":"2024-09-11T23:18:00.643987+0000","last_became_active":"2024-09-11T23:17:58.644006+0000","last_became_peered":"2024-09-11T23:17:58.644006+0000","last_unstale":"2024-09-11T23:18:00.643987+0000","last_undegraded":"2024-09-11T23:18:00.643987+0000","last_fullsized":"2024-09-11T23:18:00.643987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:23.261838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661493+0000","last_change":"2024-09-11T23:17:59.642489+0000","last_active":"2024-09-11T23:18:00.661493+0000","last_peered":"2024-09-11T23:18:00.661493+0000","last_clean":"2024-09-11T23:18:00.661493+0000","last_became_active":"2024-09-11T23:17:59.642155+0000","last_became_peered":"2024-09-11T23:17:59.642155+0000","last_unstale":"2024-09-11T23:18:00.661493+0000","last_undegraded":"2024-09-11T23:18:00.661493+0000","last_fullsized":"2024-09-11T23:18:00.661493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:49.647417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644943+0000","last_change":"2024-09-11T23:17:59.636661+0000","last_active":"2024-09-11T23:18:00.644943+0000","last_peered":"2024-09-11T23:18:00.644943+0000","last_clean":"2024-09-11T23:18:00.644943+0000","last_became_active":"2024-09-11T23:17:59.635613+0000","last_became_peered":"2024-09-11T23:17:59.635613+0000","last_unstale":"2024-09-11T23:18:00.644943+0000","last_undegraded":"2024-09-11T23:18:00.644943+0000","last_fullsized":"2024-09-11T23:18:00.644943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:04.566161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643521+0000","last_change":"2024-09-11T23:17:58.646998+0000","last_active":"2024-09-11T23:18:00.643521+0000","last_peered":"2024-09-11T23:18:00.643521+0000","last_clean":"2024-09-11T23:18:00.643521+0000","last_became_active":"2024-09-11T23:17:58.646666+0000","last_became_peered":"2024-09-11T23:17:58.646666+0000","last_unstale":"2024-09-11T23:18:00.643521+0000","last_undegraded":"2024-09-11T23:18:00.643521+0000","last_fullsized":"2024-09-11T23:18:00.643521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:57.415598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644743+0000","last_change":"2024-09-11T23:17:59.637292+0000","last_active":"2024-09-11T23:18:00.644743+0000","last_peered":"2024-09-11T23:18:00.644743+0000","last_clean":"2024-09-11T23:18:00.644743+0000","last_became_active":"2024-09-11T23:17:59.637028+0000","last_became_peered":"2024-09-11T23:17:59.637028+0000","last_unstale":"2024-09-11T23:18:00.644743+0000","last_undegraded":"2024-09-11T23:18:00.644743+0000","last_fullsized":"2024-09-11T23:18:00.644743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:42.560113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643829+0000","last_change":"2024-09-11T23:17:58.641586+0000","last_active":"2024-09-11T23:18:00.643829+0000","last_peered":"2024-09-11T23:18:00.643829+0000","last_clean":"2024-09-11T23:18:00.643829+0000","last_became_active":"2024-09-11T23:17:58.636670+0000","last_became_peered":"2024-09-11T23:17:58.636670+0000","last_unstale":"2024-09-11T23:18:00.643829+0000","last_undegraded":"2024-09-11T23:18:00.643829+0000","last_fullsized":"2024-09-11T23:18:00.643829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:49.590126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669867+0000","last_change":"2024-09-11T23:17:59.669621+0000","last_active":"2024-09-11T23:18:00.669867+0000","last_peered":"2024-09-11T23:18:00.669867+0000","last_clean":"2024-09-11T23:18:00.669867+0000","last_became_active":"2024-09-11T23:17:59.669362+0000","last_became_peered":"2024-09-11T23:17:59.669362+0000","last_unstale":"2024-09-11T23:18:00.669867+0000","last_undegraded":"2024-09-11T23:18:00.669867+0000","last_fullsized":"2024-09-11T23:18:00.669867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:05.705455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671062+0000","last_change":"2024-09-11T23:17:58.646365+0000","last_active":"2024-09-11T23:18:00.671062+0000","last_peered":"2024-09-11T23:18:00.671062+0000","last_clean":"2024-09-11T23:18:00.671062+0000","last_became_active":"2024-09-11T23:17:58.646119+0000","last_became_peered":"2024-09-11T23:17:58.646119+0000","last_unstale":"2024-09-11T23:18:00.671062+0000","last_undegraded":"2024-09-11T23:18:00.671062+0000","last_fullsized":"2024-09-11T23:18:00.671062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:12.634428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670990+0000","last_change":"2024-09-11T23:17:59.654946+0000","last_active":"2024-09-11T23:18:00.670990+0000","last_peered":"2024-09-11T23:18:00.670990+0000","last_clean":"2024-09-11T23:18:00.670990+0000","last_became_active":"2024-09-11T23:17:59.654732+0000","last_became_peered":"2024-09-11T23:17:59.654732+0000","last_unstale":"2024-09-11T23:18:00.670990+0000","last_undegraded":"2024-09-11T23:18:00.670990+0000","last_fullsized":"2024-09-11T23:18:00.670990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:28.095341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669978+0000","last_change":"2024-09-11T23:17:58.638337+0000","last_active":"2024-09-11T23:18:00.669978+0000","last_peered":"2024-09-11T23:18:00.669978+0000","last_clean":"2024-09-11T23:18:00.669978+0000","last_became_active":"2024-09-11T23:17:58.638071+0000","last_became_peered":"2024-09-11T23:17:58.638071+0000","last_unstale":"2024-09-11T23:18:00.669978+0000","last_undegraded":"2024-09-11T23:18:00.669978+0000","last_fullsized":"2024-09-11T23:18:00.669978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:23.106037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476743,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":666862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476742,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":77524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476741,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":76002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476741,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":76038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":823296,"data_stored":666918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":77524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":75912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:18:08.834 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:18:08.835 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T23:18:08.835 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-11T23:18:08.835 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-11T23:18:08.836 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-11T23:18:09.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.024+0000 7fe93a200640 1 Processor -- start 2024-09-11T23:18:09.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.024+0000 7fe93a200640 1 -- start start 2024-09-11T23:18:09.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.025+0000 7fe93a200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe9340d02a0 0x7fe9340d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.025+0000 7fe93a200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe93415ceb0 0x7fe9341594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.025+0000 7fe93a200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9340d0bc0 con 0x7fe93415ca40 2024-09-11T23:18:09.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.025+0000 7fe93a200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe93415d390 con 0x7fe93415ceb0 2024-09-11T23:18:09.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.025+0000 7fe93a200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe93415d670 con 0x7fe9340d02a0 2024-09-11T23:18:09.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.025+0000 7fe933e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe93415ceb0 0x7fe9341594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.025+0000 7fe933e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe93415ceb0 0x7fe9341594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49146/0 (socket says 172.21.15.144:49146) 2024-09-11T23:18:09.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.025+0000 7fe933e00640 1 -- 172.21.15.144:0/3148331664 learned_addr learned my addr 172.21.15.144:0/3148331664 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:09.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.025+0000 7fe933400640 1 --2- 172.21.15.144:0/3148331664 >> v2:172.21.15.165:3300/0 conn(0x7fe9340d02a0 0x7fe9340d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.026+0000 7fe933e00640 1 -- 172.21.15.144:0/3148331664 >> v2:172.21.15.165:3300/0 conn(0x7fe9340d02a0 msgr2=0x7fe9340d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:09.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.026+0000 7fe933e00640 1 --2- 172.21.15.144:0/3148331664 >> v2:172.21.15.165:3300/0 conn(0x7fe9340d02a0 0x7fe9340d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.026+0000 7fe933e00640 1 -- 172.21.15.144:0/3148331664 >> v1:172.21.15.165:6789/0 conn(0x7fe93415ca40 legacy=0x7fe93415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.026+0000 7fe933e00640 1 -- 172.21.15.144:0/3148331664 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe93415d950 con 0x7fe93415ceb0 2024-09-11T23:18:09.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.027+0000 7fe933e00640 1 --2- 172.21.15.144:0/3148331664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe93415ceb0 0x7fe9341594c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe93406f030 tx=0x7fe92c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0c63f768bf5919 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.027+0000 7fe932a00640 1 -- 172.21.15.144:0/3148331664 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c036070 con 0x7fe93415ceb0 2024-09-11T23:18:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.027+0000 7fe932a00640 1 -- 172.21.15.144:0/3148331664 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe92c031600 con 0x7fe93415ceb0 2024-09-11T23:18:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.027+0000 7fe932a00640 1 -- 172.21.15.144:0/3148331664 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c0319d0 con 0x7fe93415ceb0 2024-09-11T23:18:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.027+0000 7fe93a200640 1 -- 172.21.15.144:0/3148331664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe93415ceb0 msgr2=0x7fe9341594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.027+0000 7fe93a200640 1 --2- 172.21.15.144:0/3148331664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe93415ceb0 0x7fe9341594c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe93406f030 tx=0x7fe92c02a6a0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.027+0000 7fe93a200640 1 -- 172.21.15.144:0/3148331664 shutdown_connections 2024-09-11T23:18:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.027+0000 7fe93a200640 1 --2- 172.21.15.144:0/3148331664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe93415ceb0 0x7fe9341594c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.027+0000 7fe93a200640 1 --2- 172.21.15.144:0/3148331664 >> v2:172.21.15.165:3300/0 conn(0x7fe9340d02a0 0x7fe9340d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.027+0000 7fe93a200640 1 -- 172.21.15.144:0/3148331664 >> 172.21.15.144:0/3148331664 conn(0x7fe934062cc0 msgr2=0x7fe93406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.027+0000 7fe93a200640 1 -- 172.21.15.144:0/3148331664 shutdown_connections 2024-09-11T23:18:09.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.028+0000 7fe93a200640 1 -- 172.21.15.144:0/3148331664 wait complete. 2024-09-11T23:18:09.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.029+0000 7fe93a200640 1 Processor -- start 2024-09-11T23:18:09.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.029+0000 7fe93a200640 1 -- start start 2024-09-11T23:18:09.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.030+0000 7fe93a200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9340d02a0 0x7fe934140af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.030+0000 7fe93a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe93415ca40 0x7fe93406c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.030+0000 7fe93a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe93415ceb0 0x7fe93415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.030+0000 7fe93a200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe93415eb40 con 0x7fe93415ca40 2024-09-11T23:18:09.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.030+0000 7fe93a200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe93415df10 con 0x7fe9340d02a0 2024-09-11T23:18:09.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.030+0000 7fe93a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe934155b90 con 0x7fe93415ceb0 2024-09-11T23:18:09.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.030+0000 7fe92aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe93415ca40 0x7fe93406c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.030+0000 7fe92aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe93415ca40 0x7fe93406c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49150/0 (socket says 172.21.15.144:49150) 2024-09-11T23:18:09.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.030+0000 7fe92aa00640 1 -- 172.21.15.144:0/1712600766 learned_addr learned my addr 172.21.15.144:0/1712600766 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:09.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.031+0000 7fe933400640 1 --2- 172.21.15.144:0/1712600766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9340d02a0 0x7fe934140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.031+0000 7fe92aa00640 1 -- 172.21.15.144:0/1712600766 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe93415ceb0 msgr2=0x7fe93415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.031+0000 7fe92aa00640 1 --2- 172.21.15.144:0/1712600766 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe93415ceb0 0x7fe93415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.031+0000 7fe92aa00640 1 -- 172.21.15.144:0/1712600766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9340d02a0 msgr2=0x7fe934140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.031+0000 7fe92aa00640 1 --2- 172.21.15.144:0/1712600766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9340d02a0 0x7fe934140af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.031+0000 7fe92aa00640 1 -- 172.21.15.144:0/1712600766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9340b2b90 con 0x7fe93415ca40 2024-09-11T23:18:09.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.031+0000 7fe933400640 1 --2- 172.21.15.144:0/1712600766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9340d02a0 0x7fe934140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:09.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.031+0000 7fe92aa00640 1 --2- 172.21.15.144:0/1712600766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe93415ca40 0x7fe93406c1f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00c430 tx=0x7fe91c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:09.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.031+0000 7fe92be00640 1 -- 172.21.15.144:0/1712600766 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0052d0 con 0x7fe93415ca40 2024-09-11T23:18:09.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.031+0000 7fe92be00640 1 -- 172.21.15.144:0/1712600766 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91c005490 con 0x7fe93415ca40 2024-09-11T23:18:09.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.031+0000 7fe92be00640 1 -- 172.21.15.144:0/1712600766 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c007260 con 0x7fe93415ca40 2024-09-11T23:18:09.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.031+0000 7fe93a200640 1 -- 172.21.15.144:0/1712600766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe934145cb0 con 0x7fe93415ca40 2024-09-11T23:18:09.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.031+0000 7fe93a200640 1 -- 172.21.15.144:0/1712600766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe93406c730 con 0x7fe93415ca40 2024-09-11T23:18:09.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.032+0000 7fe93a200640 1 -- 172.21.15.144:0/1712600766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9340b4790 con 0x7fe93415ca40 2024-09-11T23:18:09.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.033+0000 7fe92be00640 1 -- 172.21.15.144:0/1712600766 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe91c007400 con 0x7fe93415ca40 2024-09-11T23:18:09.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.034+0000 7fe92be00640 1 --2- 172.21.15.144:0/1712600766 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe91006be30 0x7fe91006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.035+0000 7fe92be00640 1 -- 172.21.15.144:0/1712600766 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe91c08a350 con 0x7fe93415ca40 2024-09-11T23:18:09.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.035+0000 7fe933400640 1 --2- 172.21.15.144:0/1712600766 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe91006be30 0x7fe91006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.035+0000 7fe933400640 1 --2- 172.21.15.144:0/1712600766 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe91006be30 0x7fe91006e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe9341463d0 tx=0x7fe924008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:09.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.039+0000 7fe92be00640 1 -- 172.21.15.144:0/1712600766 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe91c058d90 con 0x7fe93415ca40 2024-09-11T23:18:09.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.262+0000 7fe93a200640 1 -- 172.21.15.144:0/1712600766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe934153f50 con 0x7fe93415ca40 2024-09-11T23:18:09.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.265+0000 7fe92be00640 1 -- 172.21.15.144:0/1712600766 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172945 (secure 0 0 0) 0x7fe91c058690 con 0x7fe93415ca40 2024-09-11T23:18:09.274 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:09.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.268+0000 7fe93a200640 1 -- 172.21.15.144:0/1712600766 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe91006be30 msgr2=0x7fe91006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.268+0000 7fe93a200640 1 --2- 172.21.15.144:0/1712600766 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe91006be30 0x7fe91006e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe9341463d0 tx=0x7fe924008040 comp rx=0 tx=0).stop 2024-09-11T23:18:09.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.268+0000 7fe93a200640 1 -- 172.21.15.144:0/1712600766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe93415ca40 msgr2=0x7fe93406c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.268+0000 7fe93a200640 1 --2- 172.21.15.144:0/1712600766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe93415ca40 0x7fe93406c1f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00c430 tx=0x7fe91c00c8f0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.268+0000 7fe93a200640 1 -- 172.21.15.144:0/1712600766 shutdown_connections 2024-09-11T23:18:09.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.268+0000 7fe93a200640 1 --2- 172.21.15.144:0/1712600766 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe91006be30 0x7fe91006e2f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.268+0000 7fe93a200640 1 --2- 172.21.15.144:0/1712600766 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe93415ceb0 0x7fe93415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.268+0000 7fe93a200640 1 --2- 172.21.15.144:0/1712600766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe93415ca40 0x7fe93406c1f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.268+0000 7fe93a200640 1 --2- 172.21.15.144:0/1712600766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9340d02a0 0x7fe934140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.268+0000 7fe93a200640 1 -- 172.21.15.144:0/1712600766 >> 172.21.15.144:0/1712600766 conn(0x7fe934062cc0 msgr2=0x7fe934147da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:09.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.268+0000 7fe93a200640 1 -- 172.21.15.144:0/1712600766 shutdown_connections 2024-09-11T23:18:09.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.268+0000 7fe93a200640 1 -- 172.21.15.144:0/1712600766 wait complete. 2024-09-11T23:18:09.291 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1711334146},{"type":"v1","addr":"172.21.15.144:6801","nonce":1711334146}]},"active_addr":"172.21.15.144:6801/1711334146","active_change":"2024-09-11T23:17:39.152475+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4113,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":2791324222}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":898052131}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":4035581026}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":3284903152}]}]} 2024-09-11T23:18:09.295 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-11T23:18:09.295 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T23:18:09.295 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:18:09.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.451+0000 7f67a3600640 1 Processor -- start 2024-09-11T23:18:09.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.451+0000 7f67a3600640 1 -- start start 2024-09-11T23:18:09.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.452+0000 7f67a3600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f679c0cd300 0x7f679c06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.452+0000 7f67a3600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f679c06f010 0x7f679c0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.452+0000 7f67a3600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f679c15ecf0 con 0x7f679c15c300 2024-09-11T23:18:09.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.452+0000 7f67a3600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f679c15c6e0 con 0x7f679c06f010 2024-09-11T23:18:09.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.452+0000 7f67a3600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f679c15efb0 con 0x7f679c0cd300 2024-09-11T23:18:09.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.453+0000 7f67a0c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f679c15c300 0x7f679c0affc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46788/0 (socket says 172.21.15.144:46788) 2024-09-11T23:18:09.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.453+0000 7f67a0c00640 1 -- 172.21.15.144:0/3591793433 learned_addr learned my addr 172.21.15.144:0/3591793433 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:09.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.453+0000 7f67a1600640 1 --2- 172.21.15.144:0/3591793433 >> v2:172.21.15.165:3300/0 conn(0x7f679c06f010 0x7f679c0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.453+0000 7f679be00640 1 --2- 172.21.15.144:0/3591793433 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f679c0cd300 0x7f679c06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.453+0000 7f679b400640 1 -- 172.21.15.144:0/3591793433 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3080307209 0 0) 0x7f679c15ecf0 con 0x7f679c15c300 2024-09-11T23:18:09.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.453+0000 7f679b400640 1 -- 172.21.15.144:0/3591793433 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6784003520 con 0x7f679c15c300 2024-09-11T23:18:09.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.453+0000 7f679b400640 1 -- 172.21.15.144:0/3591793433 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1515890088 0 0) 0x7f6784003520 con 0x7f679c15c300 2024-09-11T23:18:09.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.453+0000 7f679b400640 1 -- 172.21.15.144:0/3591793433 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f679c0cd300 msgr2=0x7f679c06ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:09.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.453+0000 7f679b400640 1 --2- 172.21.15.144:0/3591793433 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f679c0cd300 0x7f679c06ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.453+0000 7f679b400640 1 -- 172.21.15.144:0/3591793433 >> v2:172.21.15.165:3300/0 conn(0x7f679c06f010 msgr2=0x7f679c0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:09.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.453+0000 7f679b400640 1 --2- 172.21.15.144:0/3591793433 >> v2:172.21.15.165:3300/0 conn(0x7f679c06f010 0x7f679c0ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.453+0000 7f679b400640 1 -- 172.21.15.144:0/3591793433 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c15f290 con 0x7f679c15c300 2024-09-11T23:18:09.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.453+0000 7f679b400640 1 -- 172.21.15.144:0/3591793433 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f6790001670 con 0x7f679c15c300 2024-09-11T23:18:09.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.453+0000 7f679b400640 1 -- 172.21.15.144:0/3591793433 >> v1:172.21.15.144:6789/0 conn(0x7f679c15c300 legacy=0x7f679c0affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.453+0000 7f679b400640 1 --2- 172.21.15.144:0/3591793433 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67840039b0 0x7f6784003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.453+0000 7f679b400640 1 --2- 172.21.15.144:0/3591793433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6784004800 0x7f6784004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.453+0000 7f679b400640 1 --2- 172.21.15.144:0/3591793433 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f679c0cd300 0x7f67840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.453+0000 7f679b400640 1 -- 172.21.15.144:0/3591793433 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f679c15c6e0 con 0x7f6784004800 2024-09-11T23:18:09.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.453+0000 7f679b400640 1 -- 172.21.15.144:0/3591793433 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f679c15efb0 con 0x7f67840039b0 2024-09-11T23:18:09.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.453+0000 7f679b400640 1 -- 172.21.15.144:0/3591793433 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f678400b9f0 con 0x7f679c0cd300 2024-09-11T23:18:09.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.454+0000 7f67a0c00640 1 --2- 172.21.15.144:0/3591793433 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67840039b0 0x7f6784003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.454+0000 7f679be00640 1 --2- 172.21.15.144:0/3591793433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6784004800 0x7f6784004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.454+0000 7f67a1600640 1 --2- 172.21.15.144:0/3591793433 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f679c0cd300 0x7f67840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.454+0000 7f679be00640 1 -- 172.21.15.144:0/3591793433 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f679c0cd300 msgr2=0x7f67840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:09.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.454+0000 7f679be00640 1 --2- 172.21.15.144:0/3591793433 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f679c0cd300 0x7f67840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.454+0000 7f679be00640 1 -- 172.21.15.144:0/3591793433 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67840039b0 msgr2=0x7f6784003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:09.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.454+0000 7f679be00640 1 --2- 172.21.15.144:0/3591793433 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67840039b0 0x7f6784003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.454+0000 7f679be00640 1 -- 172.21.15.144:0/3591793433 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6784003520 con 0x7f6784004800 2024-09-11T23:18:09.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.454+0000 7f67a0c00640 1 --2- 172.21.15.144:0/3591793433 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67840039b0 0x7f6784003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:09.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.455+0000 7f679be00640 1 --2- 172.21.15.144:0/3591793433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6784004800 0x7f6784004c80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f679c0cd740 tx=0x7f6784005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ee006a2905bc42 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:09.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.455+0000 7f679b400640 1 -- 172.21.15.144:0/3591793433 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788036070 con 0x7f6784004800 2024-09-11T23:18:09.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.455+0000 7f679b400640 1 -- 172.21.15.144:0/3591793433 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6788031400 con 0x7f6784004800 2024-09-11T23:18:09.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.455+0000 7f679b400640 1 -- 172.21.15.144:0/3591793433 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788009690 con 0x7f6784004800 2024-09-11T23:18:09.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.456+0000 7f67a3600640 1 -- 172.21.15.144:0/3591793433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6784004800 msgr2=0x7f6784004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.456+0000 7f67a3600640 1 --2- 172.21.15.144:0/3591793433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6784004800 0x7f6784004c80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f679c0cd740 tx=0x7f6784005830 comp rx=0 tx=0).stop 2024-09-11T23:18:09.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.456+0000 7f67a1600640 1 -- 172.21.15.144:0/3591793433 reap_dead start 2024-09-11T23:18:09.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.456+0000 7f67a3600640 1 -- 172.21.15.144:0/3591793433 shutdown_connections 2024-09-11T23:18:09.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.456+0000 7f67a3600640 1 -- 172.21.15.144:0/3591793433 >> 172.21.15.144:0/3591793433 conn(0x7f679c06cae0 msgr2=0x7f679c06cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:09.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.456+0000 7f67a3600640 1 -- 172.21.15.144:0/3591793433 shutdown_connections 2024-09-11T23:18:09.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.456+0000 7f67a3600640 1 -- 172.21.15.144:0/3591793433 wait complete. 2024-09-11T23:18:09.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.458+0000 7f67a3600640 1 Processor -- start 2024-09-11T23:18:09.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.458+0000 7f67a3600640 1 -- start start 2024-09-11T23:18:09.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.459+0000 7f67a3600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6784004800 0x7f679c1616f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.459+0000 7f67a3600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f679c160940 0x7f679c15b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.459+0000 7f67a3600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f679c15c860 0x7f679c14d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.459+0000 7f67a3600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f679c071880 con 0x7f679c15c860 2024-09-11T23:18:09.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.459+0000 7f67a3600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f679c15f850 con 0x7f679c160940 2024-09-11T23:18:09.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.459+0000 7f67a3600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f679c06ead0 con 0x7f6784004800 2024-09-11T23:18:09.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.459+0000 7f67a1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f679c15c860 0x7f679c14d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.459+0000 7f67a1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f679c15c860 0x7f679c14d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49170/0 (socket says 172.21.15.144:49170) 2024-09-11T23:18:09.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.459+0000 7f67a1600640 1 -- 172.21.15.144:0/2003931947 learned_addr learned my addr 172.21.15.144:0/2003931947 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:09.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.459+0000 7f67a0c00640 1 --2- 172.21.15.144:0/2003931947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6784004800 0x7f679c1616f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.459+0000 7f679be00640 1 --2- 172.21.15.144:0/2003931947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f679c160940 0x7f679c15b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.459+0000 7f67a1600640 1 -- 172.21.15.144:0/2003931947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6784004800 msgr2=0x7f679c1616f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.459+0000 7f67a1600640 1 --2- 172.21.15.144:0/2003931947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6784004800 0x7f679c1616f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.459+0000 7f67a1600640 1 -- 172.21.15.144:0/2003931947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f679c160940 msgr2=0x7f679c15b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.459+0000 7f67a1600640 1 --2- 172.21.15.144:0/2003931947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f679c160940 0x7f679c15b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.459+0000 7f67a1600640 1 -- 172.21.15.144:0/2003931947 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c15fbc0 con 0x7f679c15c860 2024-09-11T23:18:09.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.459+0000 7f67a0c00640 1 --2- 172.21.15.144:0/2003931947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6784004800 0x7f679c1616f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:09.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.460+0000 7f67a1600640 1 --2- 172.21.15.144:0/2003931947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f679c15c860 0x7f679c14d350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f679c0b3c20 tx=0x7f679400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:09.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.460+0000 7f6798c00640 1 -- 172.21.15.144:0/2003931947 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6790007d50 con 0x7f679c15c860 2024-09-11T23:18:09.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.460+0000 7f6798c00640 1 -- 172.21.15.144:0/2003931947 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6794015430 con 0x7f679c15c860 2024-09-11T23:18:09.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.460+0000 7f6798c00640 1 -- 172.21.15.144:0/2003931947 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794015820 con 0x7f679c15c860 2024-09-11T23:18:09.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.460+0000 7f67a3600640 1 -- 172.21.15.144:0/2003931947 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679c15ce20 con 0x7f679c15c860 2024-09-11T23:18:09.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.460+0000 7f67a3600640 1 -- 172.21.15.144:0/2003931947 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f679c160140 con 0x7f679c15c860 2024-09-11T23:18:09.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.461+0000 7f67a3600640 1 -- 172.21.15.144:0/2003931947 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f679c06d8b0 con 0x7f679c15c860 2024-09-11T23:18:09.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.462+0000 7f6798c00640 1 -- 172.21.15.144:0/2003931947 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f67940159c0 con 0x7f679c15c860 2024-09-11T23:18:09.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.463+0000 7f6798c00640 1 --2- 172.21.15.144:0/2003931947 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f677c06be60 0x7f677c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.463+0000 7f6798c00640 1 -- 172.21.15.144:0/2003931947 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f679408bb10 con 0x7f679c15c860 2024-09-11T23:18:09.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.463+0000 7f67a0c00640 1 --2- 172.21.15.144:0/2003931947 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f677c06be60 0x7f677c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.464+0000 7f67a0c00640 1 --2- 172.21.15.144:0/2003931947 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f677c06be60 0x7f677c06e320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6790001810 tx=0x7f6790009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:09.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.468+0000 7f6798c00640 1 -- 172.21.15.144:0/2003931947 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6794019030 con 0x7f679c15c860 2024-09-11T23:18:09.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.643+0000 7f67a3600640 1 -- 172.21.15.144:0/2003931947 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f679c158ef0 con 0x7f679c15c860 2024-09-11T23:18:09.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.644+0000 7f6798c00640 1 -- 172.21.15.144:0/2003931947 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16689 (secure 0 0 0) 0x7f6794010040 con 0x7f679c15c860 2024-09-11T23:18:09.644 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:09.644 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":22,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:18:00.633839+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:17:57.023145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:17:58.028864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:09.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.646+0000 7f67a3600640 1 -- 172.21.15.144:0/2003931947 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f677c06be60 msgr2=0x7f677c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.646+0000 7f67a3600640 1 --2- 172.21.15.144:0/2003931947 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f677c06be60 0x7f677c06e320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6790001810 tx=0x7f6790009040 comp rx=0 tx=0).stop 2024-09-11T23:18:09.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.646+0000 7f67a3600640 1 -- 172.21.15.144:0/2003931947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f679c15c860 msgr2=0x7f679c14d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.646+0000 7f67a3600640 1 --2- 172.21.15.144:0/2003931947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f679c15c860 0x7f679c14d350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f679c0b3c20 tx=0x7f679400f580 comp rx=0 tx=0).stop 2024-09-11T23:18:09.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.646+0000 7f67a3600640 1 -- 172.21.15.144:0/2003931947 shutdown_connections 2024-09-11T23:18:09.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.646+0000 7f67a3600640 1 --2- 172.21.15.144:0/2003931947 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f677c06be60 0x7f677c06e320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.646+0000 7f67a3600640 1 --2- 172.21.15.144:0/2003931947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f679c15c860 0x7f679c14d350 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.646+0000 7f67a3600640 1 --2- 172.21.15.144:0/2003931947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f679c160940 0x7f679c15b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.646+0000 7f67a3600640 1 --2- 172.21.15.144:0/2003931947 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6784004800 0x7f679c1616f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.646+0000 7f67a3600640 1 -- 172.21.15.144:0/2003931947 >> 172.21.15.144:0/2003931947 conn(0x7f679c06cae0 msgr2=0x7f679c0b0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:09.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.646+0000 7f67a3600640 1 -- 172.21.15.144:0/2003931947 shutdown_connections 2024-09-11T23:18:09.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.646+0000 7f67a3600640 1 -- 172.21.15.144:0/2003931947 wait complete. 2024-09-11T23:18:09.662 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T23:18:09.663 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:18:09.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.816+0000 7f7ecf000640 1 Processor -- start 2024-09-11T23:18:09.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.816+0000 7f7ecf000640 1 -- start start 2024-09-11T23:18:09.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.817+0000 7f7ecf000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7ec815c180 0x7f7ec80cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.818+0000 7f7ecf000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ec80ce740 con 0x7f7ec80ce230 2024-09-11T23:18:09.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.818+0000 7f7ecf000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ec8072640 con 0x7f7ec8073120 2024-09-11T23:18:09.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.818+0000 7f7ecf000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7ec8072920 con 0x7f7ec815c180 2024-09-11T23:18:09.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.818+0000 7f7ec7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7ec815c180 0x7f7ec80cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.818+0000 7f7ebfe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7ec80ce230 0x7f7ec80cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46796/0 (socket says 172.21.15.144:46796) 2024-09-11T23:18:09.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.818+0000 7f7ebfe00640 1 -- 172.21.15.144:0/1504517993 learned_addr learned my addr 172.21.15.144:0/1504517993 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:09.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.818+0000 7f7ec7e00640 1 -- 172.21.15.144:0/1504517993 >> v1:172.21.15.165:6789/0 conn(0x7f7ec8073120 legacy=0x7f7ec806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.818+0000 7f7ec7e00640 1 -- 172.21.15.144:0/1504517993 >> v1:172.21.15.144:6789/0 conn(0x7f7ec80ce230 legacy=0x7f7ec80cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.818+0000 7f7ec7e00640 1 -- 172.21.15.144:0/1504517993 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec8072c00 con 0x7f7ec815c180 2024-09-11T23:18:09.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.818+0000 7f7ec7400640 1 -- 172.21.15.144:0/1504517993 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3935353959 0 0) 0x7f7ec80ce740 con 0x7f7ec80ce230 2024-09-11T23:18:09.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.819+0000 7f7ec7e00640 1 --2- 172.21.15.144:0/1504517993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ec815c180 0x7f7ec80cdcf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7eb80097a0 tx=0x7f7eb802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348d89239e1787f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:09.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.819+0000 7f7ec7400640 1 -- 172.21.15.144:0/1504517993 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8037070 con 0x7f7ec815c180 2024-09-11T23:18:09.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.820+0000 7f7ec7400640 1 -- 172.21.15.144:0/1504517993 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb8032440 con 0x7f7ec815c180 2024-09-11T23:18:09.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.820+0000 7f7ec7400640 1 -- 172.21.15.144:0/1504517993 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8032810 con 0x7f7ec815c180 2024-09-11T23:18:09.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.820+0000 7f7ecf000640 1 -- 172.21.15.144:0/1504517993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ec815c180 msgr2=0x7f7ec80cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.820+0000 7f7ecf000640 1 --2- 172.21.15.144:0/1504517993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ec815c180 0x7f7ec80cdcf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7eb80097a0 tx=0x7f7eb802a1a0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.820+0000 7f7ecf000640 1 -- 172.21.15.144:0/1504517993 shutdown_connections 2024-09-11T23:18:09.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.820+0000 7f7ecf000640 1 --2- 172.21.15.144:0/1504517993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ec815c180 0x7f7ec80cdcf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.820+0000 7f7ecf000640 1 -- 172.21.15.144:0/1504517993 >> 172.21.15.144:0/1504517993 conn(0x7f7ec8062cc0 msgr2=0x7f7ec806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:09.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.820+0000 7f7ecf000640 1 -- 172.21.15.144:0/1504517993 shutdown_connections 2024-09-11T23:18:09.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.820+0000 7f7ecf000640 1 -- 172.21.15.144:0/1504517993 wait complete. 2024-09-11T23:18:09.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.822+0000 7f7ecf000640 1 Processor -- start 2024-09-11T23:18:09.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.822+0000 7f7ecf000640 1 -- start start 2024-09-11T23:18:09.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.823+0000 7f7ecf000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ec8073120 0x7f7ec815b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.823+0000 7f7ecf000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ec80ce230 0x7f7ec81f8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.823+0000 7f7ecf000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ec815c180 0x7f7ec81f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.823+0000 7f7ecf000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec80cf780 con 0x7f7ec80ce230 2024-09-11T23:18:09.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.823+0000 7f7ecf000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec80722f0 con 0x7f7ec815c180 2024-09-11T23:18:09.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.823+0000 7f7ecf000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec815c560 con 0x7f7ec8073120 2024-09-11T23:18:09.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.823+0000 7f7ebfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ec80ce230 0x7f7ec81f8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.823+0000 7f7ebfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ec80ce230 0x7f7ec81f8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49188/0 (socket says 172.21.15.144:49188) 2024-09-11T23:18:09.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.823+0000 7f7ebfe00640 1 -- 172.21.15.144:0/3397692321 learned_addr learned my addr 172.21.15.144:0/3397692321 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:09.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.823+0000 7f7ec7e00640 1 --2- 172.21.15.144:0/3397692321 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ec8073120 0x7f7ec815b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.823+0000 7f7ecd000640 1 --2- 172.21.15.144:0/3397692321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ec815c180 0x7f7ec81f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.823+0000 7f7ebfe00640 1 -- 172.21.15.144:0/3397692321 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ec8073120 msgr2=0x7f7ec815b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.823+0000 7f7ebfe00640 1 --2- 172.21.15.144:0/3397692321 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ec8073120 0x7f7ec815b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.823+0000 7f7ebfe00640 1 -- 172.21.15.144:0/3397692321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ec815c180 msgr2=0x7f7ec81f41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:09.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.823+0000 7f7ebfe00640 1 --2- 172.21.15.144:0/3397692321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ec815c180 0x7f7ec81f41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:09.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.823+0000 7f7ebfe00640 1 -- 172.21.15.144:0/3397692321 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec815a3e0 con 0x7f7ec80ce230 2024-09-11T23:18:09.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.824+0000 7f7ebfe00640 1 --2- 172.21.15.144:0/3397692321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ec80ce230 0x7f7ec81f8990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000c4a0 tx=0x7f7eb000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:09.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.824+0000 7f7ec4c00640 1 -- 172.21.15.144:0/3397692321 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0018070 con 0x7f7ec80ce230 2024-09-11T23:18:09.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.824+0000 7f7ec4c00640 1 -- 172.21.15.144:0/3397692321 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb00074e0 con 0x7f7ec80ce230 2024-09-11T23:18:09.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.824+0000 7f7ec4c00640 1 -- 172.21.15.144:0/3397692321 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0004a20 con 0x7f7ec80ce230 2024-09-11T23:18:09.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.824+0000 7f7ecf000640 1 -- 172.21.15.144:0/3397692321 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ec815a6c0 con 0x7f7ec80ce230 2024-09-11T23:18:09.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.824+0000 7f7ecf000640 1 -- 172.21.15.144:0/3397692321 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ec815ac80 con 0x7f7ec80ce230 2024-09-11T23:18:09.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.825+0000 7f7ecf000640 1 -- 172.21.15.144:0/3397692321 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ec80cdcd0 con 0x7f7ec80ce230 2024-09-11T23:18:09.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.826+0000 7f7ec4c00640 1 -- 172.21.15.144:0/3397692321 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7eb001b070 con 0x7f7ec80ce230 2024-09-11T23:18:09.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.827+0000 7f7ec4c00640 1 --2- 172.21.15.144:0/3397692321 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7ea406be30 0x7f7ea406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:09.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.827+0000 7f7ec4c00640 1 -- 172.21.15.144:0/3397692321 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7eb008a130 con 0x7f7ec80ce230 2024-09-11T23:18:09.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.827+0000 7f7ec7e00640 1 --2- 172.21.15.144:0/3397692321 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7ea406be30 0x7f7ea406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:09.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.828+0000 7f7ec7e00640 1 --2- 172.21.15.144:0/3397692321 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7ea406be30 0x7f7ea406e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8034000 tx=0x7f7eb802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:09.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:09.831+0000 7f7ec4c00640 1 -- 172.21.15.144:0/3397692321 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7eb0058490 con 0x7f7ec80ce230 2024-09-11T23:18:10.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.008+0000 7f7ecf000640 1 -- 172.21.15.144:0/3397692321 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ec81572a0 con 0x7f7ec80ce230 2024-09-11T23:18:10.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.009+0000 7f7ec4c00640 1 -- 172.21.15.144:0/3397692321 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16689 (secure 0 0 0) 0x7f7eb005c790 con 0x7f7ec80ce230 2024-09-11T23:18:10.009 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:10.009 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":22,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:18:00.633839+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:17:57.023145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:17:58.028864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:10.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.011+0000 7f7ecf000640 1 -- 172.21.15.144:0/3397692321 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7ea406be30 msgr2=0x7f7ea406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.011+0000 7f7ecf000640 1 --2- 172.21.15.144:0/3397692321 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7ea406be30 0x7f7ea406e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8034000 tx=0x7f7eb802e000 comp rx=0 tx=0).stop 2024-09-11T23:18:10.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.011+0000 7f7ecf000640 1 -- 172.21.15.144:0/3397692321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ec80ce230 msgr2=0x7f7ec81f8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.011+0000 7f7ecf000640 1 --2- 172.21.15.144:0/3397692321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ec80ce230 0x7f7ec81f8990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000c4a0 tx=0x7f7eb000c960 comp rx=0 tx=0).stop 2024-09-11T23:18:10.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.011+0000 7f7ecf000640 1 -- 172.21.15.144:0/3397692321 shutdown_connections 2024-09-11T23:18:10.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.011+0000 7f7ecf000640 1 --2- 172.21.15.144:0/3397692321 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7ea406be30 0x7f7ea406e2f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.011+0000 7f7ecf000640 1 --2- 172.21.15.144:0/3397692321 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ec815c180 0x7f7ec81f41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.011+0000 7f7ecf000640 1 --2- 172.21.15.144:0/3397692321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ec80ce230 0x7f7ec81f8990 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.011+0000 7f7ecf000640 1 --2- 172.21.15.144:0/3397692321 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7ec8073120 0x7f7ec815b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.011+0000 7f7ecf000640 1 -- 172.21.15.144:0/3397692321 >> 172.21.15.144:0/3397692321 conn(0x7f7ec8062cc0 msgr2=0x7f7ec806c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.011+0000 7f7ecf000640 1 -- 172.21.15.144:0/3397692321 shutdown_connections 2024-09-11T23:18:10.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.011+0000 7f7ecf000640 1 -- 172.21.15.144:0/3397692321 wait complete. 2024-09-11T23:18:10.029 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T23:18:10.029 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T23:18:10.029 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T23:18:10.030 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T23:18:10.030 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-11T23:18:10.031 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-11T23:18:10.031 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-11T23:18:10.031 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-11T23:18:10.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.302+0000 7f3d3d200640 1 Processor -- start 2024-09-11T23:18:10.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.302+0000 7f3d3d200640 1 -- start start 2024-09-11T23:18:10.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.303+0000 7f3d3d200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d38163060 0x7f3d380cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.303+0000 7f3d3d200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3d380d2300 0x7f3d380cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.303+0000 7f3d3d200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d380d3790 con 0x7f3d380d31f0 2024-09-11T23:18:10.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.303+0000 7f3d3d200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3d380b7610 con 0x7f3d380d2300 2024-09-11T23:18:10.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.303+0000 7f3d3d200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3d380d3a70 con 0x7f3d38163060 2024-09-11T23:18:10.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.304+0000 7f3d35400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3d380d2300 0x7f3d380cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.304+0000 7f3d35400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3d380d2300 0x7f3d380cf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49192/0 (socket says 172.21.15.144:49192) 2024-09-11T23:18:10.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.304+0000 7f3d35400640 1 -- 172.21.15.144:0/1329543863 learned_addr learned my addr 172.21.15.144:0/1329543863 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:10.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.305+0000 7f3d35e00640 1 --2- 172.21.15.144:0/1329543863 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d38163060 0x7f3d380cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.305+0000 7f3d35e00640 1 -- 172.21.15.144:0/1329543863 >> v2:172.21.15.144:3300/0 conn(0x7f3d380d2300 msgr2=0x7f3d380cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.305+0000 7f2651200640 1 Processor -- start 2024-09-11T23:18:10.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.305+0000 7f3d35e00640 1 --2- 172.21.15.144:0/1329543863 >> v2:172.21.15.144:3300/0 conn(0x7f3d380d2300 0x7f3d380cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.305+0000 7f3d35e00640 1 -- 172.21.15.144:0/1329543863 >> v1:172.21.15.144:6789/0 conn(0x7f3d380d31f0 legacy=0x7f3d380d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.306+0000 7f3d35e00640 1 -- 172.21.15.144:0/1329543863 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d380d3d50 con 0x7f3d38163060 2024-09-11T23:18:10.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.307+0000 7f3d35400640 1 --2- 172.21.15.144:0/1329543863 >> v2:172.21.15.144:3300/0 conn(0x7f3d380d2300 0x7f3d380cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:10.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.306+0000 7f2651200640 1 -- start start 2024-09-11T23:18:10.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.306+0000 7f6cefe00640 1 Processor -- start 2024-09-11T23:18:10.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.306+0000 7f6cefe00640 1 -- start start 2024-09-11T23:18:10.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.308+0000 7f2641400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f264c15ed20 0x7f264c0b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46826/0 (socket says 172.21.15.144:46826) 2024-09-11T23:18:10.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.308+0000 7f3d35e00640 1 --2- 172.21.15.144:0/1329543863 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d38163060 0x7f3d380cef90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3d280097a0 tx=0x7f3d2802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85142080c4757ab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.308+0000 7f2651200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f264c0b8f90 0x7f264c0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.308+0000 7f2651200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f264c0b7170 con 0x7f264c15ed20 2024-09-11T23:18:10.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.308+0000 7f6cefe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6ce80cfe90 0x7f6ce80cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.309+0000 7f6cefe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ce806c490 0x7f6ce80b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.309+0000 7f3d34a00640 1 -- 172.21.15.144:0/1329543863 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d28037070 con 0x7f3d38163060 2024-09-11T23:18:10.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.309+0000 7f3d34a00640 1 -- 172.21.15.144:0/1329543863 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d28032440 con 0x7f3d38163060 2024-09-11T23:18:10.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.309+0000 7f3d34a00640 1 -- 172.21.15.144:0/1329543863 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d28032810 con 0x7f3d38163060 2024-09-11T23:18:10.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.308+0000 7f2651200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f264c0b7aa0 con 0x7f264c15e940 2024-09-11T23:18:10.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.308+0000 7f2651200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f264c0d3660 con 0x7f264c0b8f90 2024-09-11T23:18:10.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.309+0000 7f2649e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f264c15e940 0x7f264c0d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:53230/0 (socket says 172.21.15.144:53230) 2024-09-11T23:18:10.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.309+0000 7f2649e00640 1 -- 172.21.15.144:0/622583747 learned_addr learned my addr 172.21.15.144:0/622583747 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:10.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.309+0000 7f6ced400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6ce80cfe90 0x7f6ce80cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.310+0000 7f6ceca00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6ce80b3560 0x7f6ce806bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46840/0 (socket says 172.21.15.144:46840) 2024-09-11T23:18:10.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.310+0000 7f6ceca00640 1 -- 172.21.15.144:0/2141742255 learned_addr learned my addr 172.21.15.144:0/2141742255 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:10.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.310+0000 7f6cede00640 1 --2- 172.21.15.144:0/2141742255 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ce806c490 0x7f6ce80b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.309+0000 7f6cefe00640 1 -- 172.21.15.144:0/2141742255 --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ce80741d0 con 0x7f6ce80b3560 2024-09-11T23:18:10.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.310+0000 7f3d3d200640 1 -- 172.21.15.144:0/1329543863 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d38163060 msgr2=0x7f3d380cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.310+0000 7f3d3d200640 1 --2- 172.21.15.144:0/1329543863 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d38163060 0x7f3d380cef90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3d280097a0 tx=0x7f3d2802a180 comp rx=0 tx=0).stop 2024-09-11T23:18:10.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.310+0000 7f6cefe00640 1 -- 172.21.15.144:0/2141742255 --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6ce80cdea0 con 0x7f6ce80cfe90 2024-09-11T23:18:10.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.311+0000 7f6cefe00640 1 -- 172.21.15.144:0/2141742255 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6ce8167460 con 0x7f6ce806c490 2024-09-11T23:18:10.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.311+0000 7f264a800640 1 --2- 172.21.15.144:0/622583747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f264c0b8f90 0x7f264c0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.311+0000 7f6ce7e00640 1 -- 172.21.15.144:0/2141742255 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1036970075 0 0) 0x7f6ce80741d0 con 0x7f6ce80b3560 2024-09-11T23:18:10.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.311+0000 7f6ce7e00640 1 -- 172.21.15.144:0/2141742255 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cd0003520 con 0x7f6ce80b3560 2024-09-11T23:18:10.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.311+0000 7f6ced400640 1 -- 172.21.15.144:0/2141742255 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ce806c490 msgr2=0x7f6ce80b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.312+0000 7f6ced400640 1 --2- 172.21.15.144:0/2141742255 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ce806c490 0x7f6ce80b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.312+0000 7f6ced400640 1 -- 172.21.15.144:0/2141742255 >> v1:172.21.15.144:6789/0 conn(0x7f6ce80b3560 legacy=0x7f6ce806bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.312+0000 7f3d3d200640 1 -- 172.21.15.144:0/1329543863 shutdown_connections 2024-09-11T23:18:10.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.312+0000 7f3d3d200640 1 --2- 172.21.15.144:0/1329543863 >> v2:172.21.15.144:3300/0 conn(0x7f3d380d2300 0x7f3d380cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.312+0000 7f3d3d200640 1 --2- 172.21.15.144:0/1329543863 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d38163060 0x7f3d380cef90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.312+0000 7f3d3d200640 1 -- 172.21.15.144:0/1329543863 >> 172.21.15.144:0/1329543863 conn(0x7f3d380b6240 msgr2=0x7f3d380b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.312+0000 7f6ced400640 1 -- 172.21.15.144:0/2141742255 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce81666a0 con 0x7f6ce80cfe90 2024-09-11T23:18:10.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.312+0000 7f3d3d200640 1 -- 172.21.15.144:0/1329543863 shutdown_connections 2024-09-11T23:18:10.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.312+0000 7f2649400640 1 -- 172.21.15.144:0/622583747 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3677656256 0 0) 0x7f2634001110 con 0x7f264c15ed20 2024-09-11T23:18:10.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.312+0000 7f2649400640 1 -- 172.21.15.144:0/622583747 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2630003520 con 0x7f264c15ed20 2024-09-11T23:18:10.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.312+0000 7f2649400640 1 -- 172.21.15.144:0/622583747 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3967706015 0 0) 0x7f264c0b7aa0 con 0x7f264c15e940 2024-09-11T23:18:10.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.312+0000 7f2649400640 1 -- 172.21.15.144:0/622583747 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2634001110 con 0x7f264c15e940 2024-09-11T23:18:10.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.312+0000 7f5786800640 1 Processor -- start 2024-09-11T23:18:10.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.313+0000 7f5786800640 1 -- start start 2024-09-11T23:18:10.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.313+0000 7f6ced400640 1 --2- 172.21.15.144:0/2141742255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ce80cfe90 0x7f6ce80cd7a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc0097a0 tx=0x7f6cdc02a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec898e4ac3ce69e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.312+0000 7f3d3d200640 1 -- 172.21.15.144:0/1329543863 wait complete. 2024-09-11T23:18:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.314+0000 7f2649400640 1 -- 172.21.15.144:0/622583747 <== mon.1 v1:172.21.15.165:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1608043411 0 0) 0x7f2634001110 con 0x7f264c15e940 2024-09-11T23:18:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.314+0000 7f2649400640 1 -- 172.21.15.144:0/622583747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f264c0b8f90 msgr2=0x7f264c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.314+0000 7f2649400640 1 --2- 172.21.15.144:0/622583747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f264c0b8f90 0x7f264c0b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.314+0000 7f2649400640 1 -- 172.21.15.144:0/622583747 >> v1:172.21.15.144:6789/0 conn(0x7f264c15ed20 legacy=0x7f264c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.314+0000 7f2649400640 1 -- 172.21.15.144:0/622583747 --> v1:172.21.15.165:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f264c0d3940 con 0x7f264c15e940 2024-09-11T23:18:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.314+0000 7f2649400640 1 -- 172.21.15.144:0/622583747 <== mon.1 v1:172.21.15.165:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f263c0019f0 con 0x7f264c15e940 2024-09-11T23:18:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.314+0000 7f2649400640 1 -- 172.21.15.144:0/622583747 >> v1:172.21.15.165:6789/0 conn(0x7f264c15e940 legacy=0x7f264c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.314+0000 7f2649400640 1 --2- 172.21.15.144:0/622583747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2630004ba0 0x7f2630004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.314+0000 7f2649400640 1 --2- 172.21.15.144:0/622583747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26300037a0 0x7f2630003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.314+0000 7f2649400640 1 --2- 172.21.15.144:0/622583747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2630004140 0x7f263000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.314+0000 7f2649400640 1 -- 172.21.15.144:0/622583747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f264c0d3660 con 0x7f2630004140 2024-09-11T23:18:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.314+0000 7f2649400640 1 -- 172.21.15.144:0/622583747 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f263000bfb0 con 0x7f2630004ba0 2024-09-11T23:18:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.314+0000 7f2649400640 1 -- 172.21.15.144:0/622583747 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f263000c1b0 con 0x7f26300037a0 2024-09-11T23:18:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.314+0000 7f264a800640 1 --2- 172.21.15.144:0/622583747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f264c0b8f90 0x7f264c0b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.314+0000 7f6ce7e00640 1 -- 172.21.15.144:0/2141742255 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc037070 con 0x7f6ce80cfe90 2024-09-11T23:18:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.314+0000 7f2649e00640 1 --2- 172.21.15.144:0/622583747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2630004ba0 0x7f2630004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.315+0000 7f2641400640 1 --2- 172.21.15.144:0/622583747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26300037a0 0x7f2630003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.314+0000 7f6ce7e00640 1 -- 172.21.15.144:0/2141742255 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cdc02adb0 con 0x7f6ce80cfe90 2024-09-11T23:18:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.314+0000 7f6ce7e00640 1 -- 172.21.15.144:0/2141742255 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc032660 con 0x7f6ce80cfe90 2024-09-11T23:18:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.315+0000 7f5786800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f578006beb0 0x7f57800cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.315+0000 7f5786800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f57800b3930 0x7f57800b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.315+0000 7f5786800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57800cce30 con 0x7f578006c290 2024-09-11T23:18:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.315+0000 7f5786800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f57800cda40 con 0x7f57800b3930 2024-09-11T23:18:10.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.315+0000 7f5786800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f57800cd110 con 0x7f578006beb0 2024-09-11T23:18:10.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.315+0000 7f264a800640 1 --2- 172.21.15.144:0/622583747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2630004140 0x7f263000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.315+0000 7f2641400640 1 -- 172.21.15.144:0/622583747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2630004ba0 msgr2=0x7f2630004fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.315+0000 7f2641400640 1 --2- 172.21.15.144:0/622583747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2630004ba0 0x7f2630004fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.315+0000 7f2641400640 1 -- 172.21.15.144:0/622583747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2630004140 msgr2=0x7f263000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.315+0000 7f2641400640 1 --2- 172.21.15.144:0/622583747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2630004140 0x7f263000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.315+0000 7f2641400640 1 -- 172.21.15.144:0/622583747 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f264c0d3940 con 0x7f26300037a0 2024-09-11T23:18:10.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.315+0000 7f577f400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f578006beb0 0x7f57800cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.315+0000 7f577f400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f578006beb0 0x7f57800cded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:50460/0 (socket says 172.21.15.144:50460) 2024-09-11T23:18:10.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.315+0000 7f577f400640 1 -- 172.21.15.144:0/1490631234 learned_addr learned my addr 172.21.15.144:0/1490631234 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:10.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.316+0000 7f8b5ee00640 1 Processor -- start 2024-09-11T23:18:10.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.316+0000 7f577fe00640 1 --2- 172.21.15.144:0/1490631234 >> v2:172.21.15.144:3300/0 conn(0x7f57800b3930 0x7f57800b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.316+0000 7f8b5ee00640 1 -- start start 2024-09-11T23:18:10.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.316+0000 7f577f400640 1 -- 172.21.15.144:0/1490631234 >> v2:172.21.15.144:3300/0 conn(0x7f57800b3930 msgr2=0x7f57800b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.317+0000 7f577e000640 1 -- 172.21.15.144:0/1490631234 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 38972869 0 0) 0x7f57800cce30 con 0x7f578006c290 2024-09-11T23:18:10.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.317+0000 7f3d3d200640 1 Processor -- start 2024-09-11T23:18:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.317+0000 7f577f400640 1 --2- 172.21.15.144:0/1490631234 >> v2:172.21.15.144:3300/0 conn(0x7f57800b3930 0x7f57800b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.317+0000 7f577f400640 1 -- 172.21.15.144:0/1490631234 >> v1:172.21.15.144:6789/0 conn(0x7f578006c290 legacy=0x7f57800cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.317+0000 7f577f400640 1 -- 172.21.15.144:0/1490631234 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57800cd3f0 con 0x7f578006beb0 2024-09-11T23:18:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.317+0000 7f577fe00640 1 --2- 172.21.15.144:0/1490631234 >> v2:172.21.15.144:3300/0 conn(0x7f57800b3930 0x7f57800b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.317+0000 7f6cefe00640 1 -- 172.21.15.144:0/2141742255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ce80cfe90 msgr2=0x7f6ce80cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.317+0000 7f6cefe00640 1 --2- 172.21.15.144:0/2141742255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ce80cfe90 0x7f6ce80cd7a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc0097a0 tx=0x7f6cdc02a060 comp rx=0 tx=0).stop 2024-09-11T23:18:10.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.317+0000 7f3d3d200640 1 -- start start 2024-09-11T23:18:10.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.318+0000 7f6cefe00640 1 -- 172.21.15.144:0/2141742255 shutdown_connections 2024-09-11T23:18:10.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.318+0000 7f6cefe00640 1 --2- 172.21.15.144:0/2141742255 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ce806c490 0x7f6ce80b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.318+0000 7f6cefe00640 1 --2- 172.21.15.144:0/2141742255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ce80cfe90 0x7f6ce80cd7a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.318+0000 7f6cefe00640 1 -- 172.21.15.144:0/2141742255 >> 172.21.15.144:0/2141742255 conn(0x7f6ce80b2040 msgr2=0x7f6ce80b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.318+0000 7f8b5ee00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8b5815e940 0x7f8b580d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.318+0000 7f8b5ee00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8b580cef90 0x7f8b580d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.318+0000 7f8b5ee00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b580b7170 con 0x7f8b5815ed20 2024-09-11T23:18:10.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.318+0000 7f8b5ee00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8b580d1ae0 con 0x7f8b5815e940 2024-09-11T23:18:10.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.318+0000 7f8b5ee00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8b580b7aa0 con 0x7f8b580cef90 2024-09-11T23:18:10.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.318+0000 7f2641400640 1 --2- 172.21.15.144:0/622583747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26300037a0 0x7f2630003c00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2634001b40 tx=0x7f2630005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=341d4cdc8ecdc5fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.318+0000 7f8b57400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f8b5815ed20 0x7f8b580b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:53244/0 (socket says 172.21.15.144:53244) 2024-09-11T23:18:10.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.318+0000 7f8b57400640 1 -- 172.21.15.144:0/2319262845 learned_addr learned my addr 172.21.15.144:0/2319262845 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:10.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.318+0000 7f8b5ce00640 1 --2- 172.21.15.144:0/2319262845 >> v2:172.21.15.165:3300/0 conn(0x7f8b580cef90 0x7f8b580d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.319+0000 7f2649400640 1 -- 172.21.15.144:0/622583747 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2634001740 con 0x7f26300037a0 2024-09-11T23:18:10.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.319+0000 7f8b57e00640 1 --2- 172.21.15.144:0/2319262845 >> v2:172.21.15.144:3300/0 conn(0x7f8b5815e940 0x7f8b580d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.319+0000 7f8b56a00640 1 -- 172.21.15.144:0/2319262845 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632250440 0 0) 0x7f8b48001110 con 0x7f8b5815ed20 2024-09-11T23:18:10.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.319+0000 7f8b56a00640 1 -- 172.21.15.144:0/2319262845 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b3c003520 con 0x7f8b5815ed20 2024-09-11T23:18:10.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.319+0000 7f6cefe00640 1 -- 172.21.15.144:0/2141742255 shutdown_connections 2024-09-11T23:18:10.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.319+0000 7f8b5ce00640 1 -- 172.21.15.144:0/2319262845 >> v2:172.21.15.144:3300/0 conn(0x7f8b5815e940 msgr2=0x7f8b580d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.319+0000 7f6cefe00640 1 -- 172.21.15.144:0/2141742255 wait complete. 2024-09-11T23:18:10.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.320+0000 7f3d3d200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d380d2300 0x7f3d38150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.320+0000 7f3d3d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d380d31f0 0x7f3d380cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.320+0000 7f3d3d200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d38163060 0x7f3d380b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.320+0000 7f3d3d200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3d380b8ab0 con 0x7f3d380d31f0 2024-09-11T23:18:10.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.320+0000 7f3d3d200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3d380b3ea0 con 0x7f3d380d2300 2024-09-11T23:18:10.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.320+0000 7f3d3d200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3d380b8c30 con 0x7f3d38163060 2024-09-11T23:18:10.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.319+0000 7f577f400640 1 --2- 172.21.15.144:0/1490631234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f578006beb0 0x7f57800cded0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f57800b5a30 tx=0x7f576c02b280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b462e201be3f20cd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.319+0000 7f577e000640 1 -- 172.21.15.144:0/1490631234 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c0089e0 con 0x7f578006beb0 2024-09-11T23:18:10.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.319+0000 7f577e000640 1 -- 172.21.15.144:0/1490631234 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c008b80 con 0x7f578006beb0 2024-09-11T23:18:10.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.319+0000 7f577e000640 1 -- 172.21.15.144:0/1490631234 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c00a0d0 con 0x7f578006beb0 2024-09-11T23:18:10.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.320+0000 7f5786800640 1 -- 172.21.15.144:0/1490631234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f578006beb0 msgr2=0x7f57800cded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.320+0000 7f8b56a00640 1 -- 172.21.15.144:0/2319262845 <== mon.1 v1:172.21.15.165:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 258482332 0 0) 0x7f8b3c003520 con 0x7f8b5815ed20 2024-09-11T23:18:10.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.319+0000 7f2649400640 1 -- 172.21.15.144:0/622583747 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f263402e070 con 0x7f26300037a0 2024-09-11T23:18:10.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.319+0000 7f2649400640 1 -- 172.21.15.144:0/622583747 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26340072b0 con 0x7f26300037a0 2024-09-11T23:18:10.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.320+0000 7f2651200640 1 -- 172.21.15.144:0/622583747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26300037a0 msgr2=0x7f2630003c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.320+0000 7f2651200640 1 --2- 172.21.15.144:0/622583747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26300037a0 0x7f2630003c00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2634001b40 tx=0x7f2630005830 comp rx=0 tx=0).stop 2024-09-11T23:18:10.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.320+0000 7f264a800640 1 -- 172.21.15.144:0/622583747 reap_dead start 2024-09-11T23:18:10.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.320+0000 7f2651200640 1 -- 172.21.15.144:0/622583747 shutdown_connections 2024-09-11T23:18:10.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.320+0000 7f2651200640 1 -- 172.21.15.144:0/622583747 >> 172.21.15.144:0/622583747 conn(0x7f264c0b6240 msgr2=0x7f264c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.320+0000 7f5786800640 1 --2- 172.21.15.144:0/1490631234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f578006beb0 0x7f57800cded0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f57800b5a30 tx=0x7f576c02b280 comp rx=0 tx=0).stop 2024-09-11T23:18:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.320+0000 7f5786800640 1 -- 172.21.15.144:0/1490631234 shutdown_connections 2024-09-11T23:18:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.320+0000 7f5786800640 1 --2- 172.21.15.144:0/1490631234 >> v2:172.21.15.144:3300/0 conn(0x7f57800b3930 0x7f57800b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.320+0000 7f5786800640 1 --2- 172.21.15.144:0/1490631234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f578006beb0 0x7f57800cded0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.321+0000 7f3d36800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d38163060 0x7f3d380b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.321+0000 7f3d36800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d38163060 0x7f3d380b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50112/0 (socket says 172.21.15.144:50112) 2024-09-11T23:18:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.321+0000 7f3d36800640 1 -- 172.21.15.144:0/898702357 learned_addr learned my addr 172.21.15.144:0/898702357 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:10.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.321+0000 7f2651200640 1 -- 172.21.15.144:0/622583747 shutdown_connections 2024-09-11T23:18:10.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.320+0000 7f5786800640 1 -- 172.21.15.144:0/1490631234 >> 172.21.15.144:0/1490631234 conn(0x7f57800b2040 msgr2=0x7f57800b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.321+0000 7f5786800640 1 -- 172.21.15.144:0/1490631234 shutdown_connections 2024-09-11T23:18:10.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.321+0000 7f5786800640 1 -- 172.21.15.144:0/1490631234 wait complete. 2024-09-11T23:18:10.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.321+0000 7f3cf0200640 1 Processor -- start 2024-09-11T23:18:10.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.321+0000 7f3d35e00640 1 --2- 172.21.15.144:0/898702357 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d380d2300 0x7f3d38150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.321+0000 7f8b5ce00640 1 --2- 172.21.15.144:0/2319262845 >> v2:172.21.15.144:3300/0 conn(0x7f8b5815e940 0x7f8b580d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.321+0000 7f8b5ce00640 1 -- 172.21.15.144:0/2319262845 >> v1:172.21.15.165:6789/0 conn(0x7f8b5815ed20 legacy=0x7f8b580b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.321+0000 7f8b5ce00640 1 -- 172.21.15.144:0/2319262845 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b580d3660 con 0x7f8b580cef90 2024-09-11T23:18:10.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.321+0000 7f3d35400640 1 --2- 172.21.15.144:0/898702357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d380d31f0 0x7f3d380cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.321+0000 7f3cf0200640 1 -- start start 2024-09-11T23:18:10.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.321+0000 7f2651200640 1 -- 172.21.15.144:0/622583747 wait complete. 2024-09-11T23:18:10.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.322+0000 7f2002a00640 1 Processor -- start 2024-09-11T23:18:10.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.323+0000 7f6cefe00640 1 Processor -- start 2024-09-11T23:18:10.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.323+0000 7ff392e00640 1 Processor -- start 2024-09-11T23:18:10.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.322+0000 7f2002a00640 1 -- start start 2024-09-11T23:18:10.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.322+0000 7f3d35e00640 1 -- 172.21.15.144:0/898702357 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d38163060 msgr2=0x7f3d380b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.322+0000 7f3d35e00640 1 --2- 172.21.15.144:0/898702357 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d38163060 0x7f3d380b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.322+0000 7f3d35e00640 1 -- 172.21.15.144:0/898702357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d380d31f0 msgr2=0x7f3d380cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.322+0000 7f3d35e00640 1 --2- 172.21.15.144:0/898702357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d380d31f0 0x7f3d380cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.322+0000 7f3d35e00640 1 -- 172.21.15.144:0/898702357 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d380ce060 con 0x7f3d380d2300 2024-09-11T23:18:10.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.322+0000 7f3d35400640 1 --2- 172.21.15.144:0/898702357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d380d31f0 0x7f3d380cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:10.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.323+0000 7ff392e00640 1 -- start start 2024-09-11T23:18:10.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.323+0000 7f3cf0200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3ce815eac0 0x7f3ce80cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.323+0000 7f3cf0200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ce80b68d0 0x7f3ce80b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.323+0000 7f3cf0200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ce80d26f0 con 0x7f3ce80ced90 2024-09-11T23:18:10.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.323+0000 7f3cf0200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3ce80d29d0 con 0x7f3ce815eac0 2024-09-11T23:18:10.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.323+0000 7f3cf0200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce80d2cb0 con 0x7f3ce80b68d0 2024-09-11T23:18:10.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.323+0000 7f8b57e00640 1 --2- 172.21.15.144:0/2319262845 >> v2:172.21.15.144:3300/0 conn(0x7f8b5815e940 0x7f8b580d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:10.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.323+0000 7f5786800640 1 Processor -- start 2024-09-11T23:18:10.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.323+0000 7f3ced800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3ce815eac0 0x7f3ce80cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.324+0000 7f3cece00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f3ce80ced90 0x7f3ce80b61c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:53258/0 (socket says 172.21.15.144:53258) 2024-09-11T23:18:10.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.323+0000 7f6cefe00640 1 -- start start 2024-09-11T23:18:10.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.324+0000 7f3cece00640 1 -- 172.21.15.144:0/3491252400 learned_addr learned my addr 172.21.15.144:0/3491252400 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:10.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.324+0000 7f3cee200640 1 --2- 172.21.15.144:0/3491252400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ce80b68d0 0x7f3ce80b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.324+0000 7f5786800640 1 -- start start 2024-09-11T23:18:10.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.324+0000 7f2002a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ffc06c2b0 0x7f1ffc0cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.324+0000 7f3d35e00640 1 --2- 172.21.15.144:0/898702357 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d380d2300 0x7f3d38150a60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3d28031000 tx=0x7f3d280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.324+0000 7f2651200640 1 Processor -- start 2024-09-11T23:18:10.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.324+0000 7f2002a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ffc0af900 0x7f1ffc0cf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.324+0000 7f2002a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ffc0cf3a0 con 0x7f1ffc162930 2024-09-11T23:18:10.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.324+0000 7f3cee200640 1 -- 172.21.15.144:0/3491252400 >> v2:172.21.15.165:3300/0 conn(0x7f3ce815eac0 msgr2=0x7f3ce80cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.324+0000 7f3cee200640 1 --2- 172.21.15.144:0/3491252400 >> v2:172.21.15.165:3300/0 conn(0x7f3ce815eac0 0x7f3ce80cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.324+0000 7f3cee200640 1 -- 172.21.15.144:0/3491252400 >> v1:172.21.15.165:6789/0 conn(0x7f3ce80ced90 legacy=0x7f3ce80b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.324+0000 7f3cee200640 1 -- 172.21.15.144:0/3491252400 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce80d2f90 con 0x7f3ce80b68d0 2024-09-11T23:18:10.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.324+0000 7f2002a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1ffc0b4870 con 0x7f1ffc0af900 2024-09-11T23:18:10.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.324+0000 7f2002a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1ffc0afd70 con 0x7f1ffc06c2b0 2024-09-11T23:18:10.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.324+0000 7f1ffb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ffc06c2b0 0x7f1ffc0cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.325+0000 7f8b5ce00640 1 --2- 172.21.15.144:0/2319262845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b580cef90 0x7f8b580d15a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8b5806d070 tx=0x7f8b5002a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=949a952d0f0789fb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.324+0000 7f2000a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ffc0af900 0x7f1ffc0cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.324+0000 7f1ffb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ffc06c2b0 0x7f1ffc0cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50130/0 (socket says 172.21.15.144:50130) 2024-09-11T23:18:10.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.324+0000 7f1ffb400640 1 -- 172.21.15.144:0/3263997532 learned_addr learned my addr 172.21.15.144:0/3263997532 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:10.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.325+0000 7f2651200640 1 -- start start 2024-09-11T23:18:10.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.325+0000 7f2000a00640 1 -- 172.21.15.144:0/3263997532 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ffc06c2b0 msgr2=0x7f1ffc0cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.325+0000 7f8b56a00640 1 -- 172.21.15.144:0/2319262845 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b48001840 con 0x7f8b580cef90 2024-09-11T23:18:10.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.325+0000 7f8b56a00640 1 -- 172.21.15.144:0/2319262845 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b50007540 con 0x7f8b580cef90 2024-09-11T23:18:10.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.325+0000 7f8b56a00640 1 -- 172.21.15.144:0/2319262845 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b50007910 con 0x7f8b580cef90 2024-09-11T23:18:10.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.325+0000 7f2000a00640 1 --2- 172.21.15.144:0/3263997532 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ffc06c2b0 0x7f1ffc0cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.325+0000 7f2000a00640 1 -- 172.21.15.144:0/3263997532 >> v1:172.21.15.165:6789/0 conn(0x7f1ffc162930 legacy=0x7f1ffc06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.325+0000 7f5786800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f578006beb0 0x7f5780153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.325+0000 7f2000a00640 1 -- 172.21.15.144:0/3263997532 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ffc0b4010 con 0x7f1ffc0af900 2024-09-11T23:18:10.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.325+0000 7f5786800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f578006c290 0x7f5780158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.325+0000 7f5786800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57800b3930 0x7f5780151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.325+0000 7f5786800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f578006c6d0 con 0x7f578006beb0 2024-09-11T23:18:10.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.325+0000 7f5786800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f57800b5670 con 0x7f57800b3930 2024-09-11T23:18:10.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.325+0000 7f5786800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5780158aa0 con 0x7f578006c290 2024-09-11T23:18:10.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.326+0000 7f577f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f578006beb0 0x7f5780153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.326+0000 7f577ea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f578006c290 0x7f5780158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.326+0000 7f577f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f578006beb0 0x7f5780153a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49254/0 (socket says 172.21.15.144:49254) 2024-09-11T23:18:10.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.326+0000 7f577ea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f578006c290 0x7f5780158560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50146/0 (socket says 172.21.15.144:50146) 2024-09-11T23:18:10.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.326+0000 7f577f400640 1 -- 172.21.15.144:0/610952116 learned_addr learned my addr 172.21.15.144:0/610952116 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:10.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.326+0000 7f577fe00640 1 --2- 172.21.15.144:0/610952116 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57800b3930 0x7f5780151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.326+0000 7f3cee200640 1 --2- 172.21.15.144:0/3491252400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ce80b68d0 0x7f3ce80b79b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00097a0 tx=0x7f3ce002a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=493c01df604f3ad3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.326+0000 7ff392e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff38c0b4540 0x7ff38c0b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.326+0000 7f3d2e000640 1 -- 172.21.15.144:0/898702357 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d28037050 con 0x7f3d380d2300 2024-09-11T23:18:10.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.326+0000 7f2651200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f264c154780 0x7f264c0b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.326+0000 7f2651200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f264c154b60 0x7f264c0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f2651200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f264c1f4b00 0x7f264c0ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f2651200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f264c0d3310 con 0x7f264c1f4b00 2024-09-11T23:18:10.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f2651200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f264c0d3f00 con 0x7f264c154b60 2024-09-11T23:18:10.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f2651200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f264c0d1ef0 con 0x7f264c154780 2024-09-11T23:18:10.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.326+0000 7f8b5ee00640 1 -- 172.21.15.144:0/2319262845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b580cef90 msgr2=0x7f8b580d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.326+0000 7ff392e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff38c0d03b0 con 0x7ff38c0b5520 2024-09-11T23:18:10.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7ff392e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff38c0b4ec0 con 0x7ff38c15c4f0 2024-09-11T23:18:10.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7ff392e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff38c160d00 con 0x7ff38c0b4540 2024-09-11T23:18:10.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f8b5ee00640 1 --2- 172.21.15.144:0/2319262845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b580cef90 0x7f8b580d15a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8b5806d070 tx=0x7f8b5002a6c0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f3d2e000640 1 -- 172.21.15.144:0/898702357 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d28038040 con 0x7f3d380d2300 2024-09-11T23:18:10.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f3d2e000640 1 -- 172.21.15.144:0/898702357 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2803c8f0 con 0x7f3d380d2300 2024-09-11T23:18:10.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f3ce7e00640 1 -- 172.21.15.144:0/3491252400 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0037070 con 0x7f3ce80b68d0 2024-09-11T23:18:10.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f3ce7e00640 1 -- 172.21.15.144:0/3491252400 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ce002ae40 con 0x7f3ce80b68d0 2024-09-11T23:18:10.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7ff38b400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff38c0b4540 0x7ff38c0b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7ff390e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff38c0b5520 0x7ff38c0b59b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46856/0 (socket says 172.21.15.144:46856) 2024-09-11T23:18:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7ff390e00640 1 -- 172.21.15.144:0/228365757 learned_addr learned my addr 172.21.15.144:0/228365757 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f3ce7e00640 1 -- 172.21.15.144:0/3491252400 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0037070 con 0x7f3ce80b68d0 2024-09-11T23:18:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f2649e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f264c154780 0x7f264c0b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f2641400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f264c154b60 0x7f264c0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f2641400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f264c154b60 0x7f264c0cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:50512/0 (socket says 172.21.15.144:50512) 2024-09-11T23:18:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f2641400640 1 -- 172.21.15.144:0/1980961035 learned_addr learned my addr 172.21.15.144:0/1980961035 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f6cefe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ce806c490 0x7f6ce8154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f6cefe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ce80b3560 0x7f6ce80ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f6cefe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ce80cfe90 0x7f6ce8073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f6cefe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce80b4370 con 0x7f6ce80b3560 2024-09-11T23:18:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f6cefe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce8166c60 con 0x7f6ce806c490 2024-09-11T23:18:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f6cefe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6ce80b44f0 con 0x7f6ce80cfe90 2024-09-11T23:18:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f6cede00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ce80cfe90 0x7f6ce8073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f6cede00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ce80cfe90 0x7f6ce8073710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50154/0 (socket says 172.21.15.144:50154) 2024-09-11T23:18:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f6cede00640 1 -- 172.21.15.144:0/2344920713 learned_addr learned my addr 172.21.15.144:0/2344920713 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7ff38aa00640 1 -- 172.21.15.144:0/228365757 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 526554536 0 0) 0x7ff384001490 con 0x7ff38c0b5520 2024-09-11T23:18:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7ff38aa00640 1 -- 172.21.15.144:0/228365757 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff370003520 con 0x7ff38c0b5520 2024-09-11T23:18:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f577fe00640 1 -- 172.21.15.144:0/610952116 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f578006c290 msgr2=0x7f5780158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f577fe00640 1 --2- 172.21.15.144:0/610952116 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f578006c290 0x7f5780158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f577fe00640 1 -- 172.21.15.144:0/610952116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f578006beb0 msgr2=0x7f5780153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f577fe00640 1 --2- 172.21.15.144:0/610952116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f578006beb0 0x7f5780153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f577fe00640 1 -- 172.21.15.144:0/610952116 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5780152470 con 0x7f57800b3930 2024-09-11T23:18:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f8b5ee00640 1 -- 172.21.15.144:0/2319262845 shutdown_connections 2024-09-11T23:18:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f8b5ee00640 1 --2- 172.21.15.144:0/2319262845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b580cef90 0x7f8b580d15a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f8b5ee00640 1 --2- 172.21.15.144:0/2319262845 >> v2:172.21.15.144:3300/0 conn(0x7f8b5815e940 0x7f8b580d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f8b5ee00640 1 -- 172.21.15.144:0/2319262845 >> 172.21.15.144:0/2319262845 conn(0x7f8b580b6240 msgr2=0x7f8b580b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f3cf0200640 1 -- 172.21.15.144:0/3491252400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ce80b68d0 msgr2=0x7f3ce80b79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f3cf0200640 1 --2- 172.21.15.144:0/3491252400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ce80b68d0 0x7f3ce80b79b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00097a0 tx=0x7f3ce002a130 comp rx=0 tx=0).stop 2024-09-11T23:18:10.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f2000a00640 1 --2- 172.21.15.144:0/3263997532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ffc0af900 0x7f1ffc0cf860 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009d90 tx=0x7f1ff402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24abd696087b7246 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f577ea00640 1 --2- 172.21.15.144:0/610952116 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f578006c290 0x7f5780158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:10.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f577f400640 1 --2- 172.21.15.144:0/610952116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f578006beb0 0x7f5780153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:10.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f2649e00640 1 -- 172.21.15.144:0/1980961035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f264c154b60 msgr2=0x7f264c0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f2649e00640 1 --2- 172.21.15.144:0/1980961035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f264c154b60 0x7f264c0cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f6ceca00640 1 --2- 172.21.15.144:0/2344920713 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ce80b3560 0x7f6ce80ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.327+0000 7f3d3d200640 1 -- 172.21.15.144:0/898702357 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d3815a700 con 0x7f3d380d2300 2024-09-11T23:18:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f3d3d200640 1 -- 172.21.15.144:0/898702357 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d3815acc0 con 0x7f3d380d2300 2024-09-11T23:18:10.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f6cede00640 1 -- 172.21.15.144:0/2344920713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ce806c490 msgr2=0x7f6ce8154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f6cede00640 1 --2- 172.21.15.144:0/2344920713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ce806c490 0x7f6ce8154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f6cede00640 1 -- 172.21.15.144:0/2344920713 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ce80b3560 msgr2=0x7f6ce80ac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f6cede00640 1 --2- 172.21.15.144:0/2344920713 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ce80b3560 0x7f6ce80ac6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f8b5ee00640 1 -- 172.21.15.144:0/2319262845 shutdown_connections 2024-09-11T23:18:10.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7ff38b400640 1 -- 172.21.15.144:0/228365757 >> v1:172.21.15.165:6789/0 conn(0x7ff38c15c4f0 legacy=0x7ff38c073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7ff38b400640 1 -- 172.21.15.144:0/228365757 >> v1:172.21.15.144:6789/0 conn(0x7ff38c0b5520 legacy=0x7ff38c0b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f6cede00640 1 -- 172.21.15.144:0/2344920713 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce80aa6b0 con 0x7f6ce80cfe90 2024-09-11T23:18:10.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f2649e00640 1 -- 172.21.15.144:0/1980961035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f264c1f4b00 msgr2=0x7f264c0ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f2649e00640 1 --2- 172.21.15.144:0/1980961035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f264c1f4b00 0x7f264c0ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f2649e00640 1 -- 172.21.15.144:0/1980961035 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f264c1f5090 con 0x7f264c154780 2024-09-11T23:18:10.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f577fe00640 1 --2- 172.21.15.144:0/610952116 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57800b3930 0x7f5780151f30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5778009cf0 tx=0x7f577800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f6ceca00640 1 --2- 172.21.15.144:0/2344920713 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ce80b3560 0x7f6ce80ac6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7ff38b400640 1 -- 172.21.15.144:0/228365757 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38c15c8d0 con 0x7ff38c0b4540 2024-09-11T23:18:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f3cf0200640 1 -- 172.21.15.144:0/3491252400 shutdown_connections 2024-09-11T23:18:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f3cf0200640 1 --2- 172.21.15.144:0/3491252400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ce80b68d0 0x7f3ce80b79b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f3cf0200640 1 --2- 172.21.15.144:0/3491252400 >> v2:172.21.15.165:3300/0 conn(0x7f3ce815eac0 0x7f3ce80cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f3cf0200640 1 -- 172.21.15.144:0/3491252400 >> 172.21.15.144:0/3491252400 conn(0x7f3ce80d11c0 msgr2=0x7f3ce80d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.329+0000 7f1ffaa00640 1 -- 172.21.15.144:0/3263997532 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4007740 con 0x7f1ffc0af900 2024-09-11T23:18:10.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.329+0000 7f1ffaa00640 1 -- 172.21.15.144:0/3263997532 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff40078e0 con 0x7f1ffc0af900 2024-09-11T23:18:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.329+0000 7f2649e00640 1 --2- 172.21.15.144:0/1980961035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f264c154780 0x7f264c0b5980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f263c007a30 tx=0x7f263c00e530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.329+0000 7f1ffaa00640 1 -- 172.21.15.144:0/3263997532 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4007cb0 con 0x7f1ffc0af900 2024-09-11T23:18:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.329+0000 7f2642a00640 1 -- 172.21.15.144:0/1980961035 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c00ee50 con 0x7f264c154780 2024-09-11T23:18:10.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.329+0000 7f2642a00640 1 -- 172.21.15.144:0/1980961035 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f263c018070 con 0x7f264c154780 2024-09-11T23:18:10.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.329+0000 7f5777400640 1 -- 172.21.15.144:0/610952116 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5778018030 con 0x7f57800b3930 2024-09-11T23:18:10.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.329+0000 7f5777400640 1 -- 172.21.15.144:0/610952116 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f577800cd30 con 0x7f57800b3930 2024-09-11T23:18:10.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.329+0000 7f5777400640 1 -- 172.21.15.144:0/610952116 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5778003bd0 con 0x7f57800b3930 2024-09-11T23:18:10.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.329+0000 7f5786800640 1 -- 172.21.15.144:0/610952116 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5780159570 con 0x7f57800b3930 2024-09-11T23:18:10.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.329+0000 7f5786800640 1 -- 172.21.15.144:0/610952116 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5780158fb0 con 0x7f57800b3930 2024-09-11T23:18:10.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.329+0000 7f2642a00640 1 -- 172.21.15.144:0/1980961035 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c013640 con 0x7f264c154780 2024-09-11T23:18:10.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.329+0000 7f2651200640 1 -- 172.21.15.144:0/1980961035 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f264c1f5370 con 0x7f264c154780 2024-09-11T23:18:10.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.330+0000 7f2651200640 1 -- 172.21.15.144:0/1980961035 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f264c1f5930 con 0x7f264c154780 2024-09-11T23:18:10.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.330+0000 7f6cede00640 1 --2- 172.21.15.144:0/2344920713 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ce80cfe90 0x7f6ce8073710 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000ef90 tx=0x7f6ce000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.330+0000 7f2002a00640 1 -- 172.21.15.144:0/3263997532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ffc0af900 msgr2=0x7f1ffc0cf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.330+0000 7f3cf0200640 1 -- 172.21.15.144:0/3491252400 shutdown_connections 2024-09-11T23:18:10.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.330+0000 7f5786800640 1 -- 172.21.15.144:0/610952116 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5780158350 con 0x7f57800b3930 2024-09-11T23:18:10.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.330+0000 7f3cf0200640 1 -- 172.21.15.144:0/3491252400 wait complete. 2024-09-11T23:18:10.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.330+0000 7f6ce5600640 1 -- 172.21.15.144:0/2344920713 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0018020 con 0x7f6ce80cfe90 2024-09-11T23:18:10.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.330+0000 7f6ce5600640 1 -- 172.21.15.144:0/2344920713 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce0014480 con 0x7f6ce80cfe90 2024-09-11T23:18:10.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.330+0000 7f6ce5600640 1 -- 172.21.15.144:0/2344920713 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0014870 con 0x7f6ce80cfe90 2024-09-11T23:18:10.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.331+0000 7f6cefe00640 1 -- 172.21.15.144:0/2344920713 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ce80aa990 con 0x7f6ce80cfe90 2024-09-11T23:18:10.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.331+0000 7f6cefe00640 1 -- 172.21.15.144:0/2344920713 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ce80aaf50 con 0x7f6ce80cfe90 2024-09-11T23:18:10.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.330+0000 7f2002a00640 1 --2- 172.21.15.144:0/3263997532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ffc0af900 0x7f1ffc0cf860 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009d90 tx=0x7f1ff402a660 comp rx=0 tx=0).stop 2024-09-11T23:18:10.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.331+0000 7f2002a00640 1 -- 172.21.15.144:0/3263997532 shutdown_connections 2024-09-11T23:18:10.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.331+0000 7f2002a00640 1 --2- 172.21.15.144:0/3263997532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ffc0af900 0x7f1ffc0cf860 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.331+0000 7f2002a00640 1 --2- 172.21.15.144:0/3263997532 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ffc06c2b0 0x7f1ffc0cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.331+0000 7f2002a00640 1 -- 172.21.15.144:0/3263997532 >> 172.21.15.144:0/3263997532 conn(0x7f1ffc062cc0 msgr2=0x7f1ffc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.331+0000 7f2002a00640 1 -- 172.21.15.144:0/3263997532 shutdown_connections 2024-09-11T23:18:10.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.331+0000 7f2002a00640 1 -- 172.21.15.144:0/3263997532 wait complete. 2024-09-11T23:18:10.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.328+0000 7f8b5ee00640 1 -- 172.21.15.144:0/2319262845 wait complete. 2024-09-11T23:18:10.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.331+0000 7f8b5ee00640 1 Processor -- start 2024-09-11T23:18:10.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.332+0000 7f2651200640 1 -- 172.21.15.144:0/1980961035 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f264c1f8160 con 0x7f264c154780 2024-09-11T23:18:10.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.332+0000 7f6cefe00640 1 -- 172.21.15.144:0/2344920713 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ce80b3e30 con 0x7f6ce80cfe90 2024-09-11T23:18:10.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.332+0000 7f5777400640 1 -- 172.21.15.144:0/610952116 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5778005d10 con 0x7f57800b3930 2024-09-11T23:18:10.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.333+0000 7f2642a00640 1 -- 172.21.15.144:0/1980961035 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f263c0137e0 con 0x7f264c154780 2024-09-11T23:18:10.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.333+0000 7f2002a00640 1 Processor -- start 2024-09-11T23:18:10.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.332+0000 7f3d3d200640 1 -- 172.21.15.144:0/898702357 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d380ce340 con 0x7f3d380d2300 2024-09-11T23:18:10.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.332+0000 7ff38b400640 1 --2- 172.21.15.144:0/228365757 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff38c0b4540 0x7ff38c0b4980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff3780097a0 tx=0x7ff37802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e57ef16a4c4f6f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.332+0000 7ff38aa00640 1 -- 172.21.15.144:0/228365757 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378037070 con 0x7ff38c0b4540 2024-09-11T23:18:10.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.332+0000 7ff38aa00640 1 -- 172.21.15.144:0/228365757 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff378032440 con 0x7ff38c0b4540 2024-09-11T23:18:10.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.333+0000 7f5777400640 1 --2- 172.21.15.144:0/610952116 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f576006be80 0x7f576006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.333+0000 7f5777400640 1 -- 172.21.15.144:0/610952116 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f577808b380 con 0x7f57800b3930 2024-09-11T23:18:10.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.334+0000 7f5777400640 1 --2- 172.21.15.144:0/610952116 >> [v2:172.21.15.144:6826/645991929,v1:172.21.15.144:6827/645991929] conn(0x7f57600740a0 0x7f57600764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.334+0000 7f5777400640 1 -- 172.21.15.144:0/610952116 --> [v2:172.21.15.144:6826/645991929,v1:172.21.15.144:6827/645991929] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f577800be50 con 0x7f57600740a0 2024-09-11T23:18:10.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.334+0000 7f5777400640 1 -- 172.21.15.144:0/610952116 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f5778092050 con 0x7f57800b3930 2024-09-11T23:18:10.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.332+0000 7ff38aa00640 1 -- 172.21.15.144:0/228365757 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378032810 con 0x7ff38c0b4540 2024-09-11T23:18:10.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.333+0000 7f2002a00640 1 -- start start 2024-09-11T23:18:10.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.334+0000 7f6ce5600640 1 -- 172.21.15.144:0/2344920713 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ce0005d10 con 0x7f6ce80cfe90 2024-09-11T23:18:10.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.333+0000 7f8b5ee00640 1 -- start start 2024-09-11T23:18:10.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.334+0000 7f577ea00640 1 --2- 172.21.15.144:0/610952116 >> [v2:172.21.15.144:6826/645991929,v1:172.21.15.144:6827/645991929] conn(0x7f57600740a0 0x7f57600764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.335+0000 7f2642a00640 1 --2- 172.21.15.144:0/1980961035 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f262806bf00 0x7f262806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.335+0000 7f2642a00640 1 -- 172.21.15.144:0/1980961035 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f263c08b3b0 con 0x7f264c154780 2024-09-11T23:18:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.335+0000 7f2641400640 1 --2- 172.21.15.144:0/1980961035 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f262806bf00 0x7f262806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.335+0000 7f2642a00640 1 --2- 172.21.15.144:0/1980961035 >> [v2:172.21.15.144:6811/4178698740,v1:172.21.15.144:6813/4178698740] conn(0x7f2628074100 0x7f2628076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.335+0000 7f2642a00640 1 -- 172.21.15.144:0/1980961035 --> [v2:172.21.15.144:6811/4178698740,v1:172.21.15.144:6813/4178698740] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f263c017ec0 con 0x7f2628074100 2024-09-11T23:18:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.336+0000 7f2642a00640 1 -- 172.21.15.144:0/1980961035 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f263c092050 con 0x7f264c154780 2024-09-11T23:18:10.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.335+0000 7f6ce5600640 1 --2- 172.21.15.144:0/2344920713 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6cc806bf00 0x7f6cc806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.335+0000 7f6ce5600640 1 -- 172.21.15.144:0/2344920713 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6ce008bea0 con 0x7f6ce80cfe90 2024-09-11T23:18:10.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.335+0000 7f6ce5600640 1 --2- 172.21.15.144:0/2344920713 >> [v2:172.21.15.144:6802/186820848,v1:172.21.15.144:6803/186820848] conn(0x7f6cc8074120 0x7f6cc8076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.336+0000 7f6ce5600640 1 -- 172.21.15.144:0/2344920713 --> [v2:172.21.15.144:6802/186820848,v1:172.21.15.144:6803/186820848] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ce000df90 con 0x7f6cc8074120 2024-09-11T23:18:10.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.336+0000 7f6ce5600640 1 -- 172.21.15.144:0/2344920713 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f6ce008c290 con 0x7f6ce80cfe90 2024-09-11T23:18:10.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.334+0000 7f3cf0200640 1 Processor -- start 2024-09-11T23:18:10.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.336+0000 7f3cf0200640 1 -- start start 2024-09-11T23:18:10.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.335+0000 7f2002a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ffc06c2b0 0x7f1ffc146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.335+0000 7f2002a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ffc0af900 0x7f1ffc165730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.335+0000 7f2002a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ffc162930 0x7f1ffc15b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.335+0000 7f2002a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1ffc162d10 con 0x7f1ffc0af900 2024-09-11T23:18:10.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.335+0000 7f2002a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1ffc0b4590 con 0x7f1ffc06c2b0 2024-09-11T23:18:10.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.335+0000 7f2002a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1ffc0cde00 con 0x7f1ffc162930 2024-09-11T23:18:10.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.335+0000 7f1ffbe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ffc06c2b0 0x7f1ffc146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.336+0000 7f1ffb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ffc0af900 0x7f1ffc165730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.336+0000 7f1ffb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ffc0af900 0x7f1ffc165730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49284/0 (socket says 172.21.15.144:49284) 2024-09-11T23:18:10.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.336+0000 7f1ffb400640 1 -- 172.21.15.144:0/2694233111 learned_addr learned my addr 172.21.15.144:0/2694233111 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:10.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.336+0000 7f2000a00640 1 --2- 172.21.15.144:0/2694233111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ffc162930 0x7f1ffc15b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.336+0000 7f1ffb400640 1 -- 172.21.15.144:0/2694233111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ffc162930 msgr2=0x7f1ffc15b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.336+0000 7f1ffb400640 1 --2- 172.21.15.144:0/2694233111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ffc162930 0x7f1ffc15b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.336+0000 7f1ffb400640 1 -- 172.21.15.144:0/2694233111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ffc06c2b0 msgr2=0x7f1ffc146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.336+0000 7f1ffb400640 1 --2- 172.21.15.144:0/2694233111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ffc06c2b0 0x7f1ffc146490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.336+0000 7f1ffb400640 1 -- 172.21.15.144:0/2694233111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ffc1563a0 con 0x7f1ffc0af900 2024-09-11T23:18:10.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.335+0000 7f577ea00640 1 --2- 172.21.15.144:0/610952116 >> [v2:172.21.15.144:6826/645991929,v1:172.21.15.144:6827/645991929] conn(0x7f57600740a0 0x7f57600764c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.336+0000 7f577f400640 1 --2- 172.21.15.144:0/610952116 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f576006be80 0x7f576006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.336+0000 7f1ffb400640 1 --2- 172.21.15.144:0/2694233111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ffc0af900 0x7f1ffc165730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800e7e0 tx=0x7f1fe800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.337+0000 7f8b5ee00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b580cef90 0x7f8b58156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.337+0000 7f2641400640 1 --2- 172.21.15.144:0/1980961035 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f262806bf00 0x7f262806e3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f264c15bc90 tx=0x7f2634007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.337+0000 7f5777400640 1 -- 172.21.15.144:0/610952116 <== osd.2 v2:172.21.15.144:6826/645991929 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f577800be50 con 0x7f57600740a0 2024-09-11T23:18:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.337+0000 7f3d2e000640 1 -- 172.21.15.144:0/898702357 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d28045020 con 0x7f3d380d2300 2024-09-11T23:18:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.337+0000 7f6ced400640 1 --2- 172.21.15.144:0/2344920713 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6cc806bf00 0x7f6cc806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.337+0000 7f8b5ee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b5815e940 0x7f8b58155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.337+0000 7f1ff3e00640 1 -- 172.21.15.144:0/2694233111 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8017070 con 0x7f1ffc0af900 2024-09-11T23:18:10.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.337+0000 7f1ff3e00640 1 -- 172.21.15.144:0/2694233111 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe800c8d0 con 0x7f1ffc0af900 2024-09-11T23:18:10.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.337+0000 7f1ff3e00640 1 -- 172.21.15.144:0/2694233111 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe800f040 con 0x7f1ffc0af900 2024-09-11T23:18:10.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.335+0000 7ff392e00640 1 -- 172.21.15.144:0/228365757 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff38c0b4540 msgr2=0x7ff38c0b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.335+0000 7ff392e00640 1 --2- 172.21.15.144:0/228365757 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff38c0b4540 0x7ff38c0b4980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff3780097a0 tx=0x7ff37802a230 comp rx=0 tx=0).stop 2024-09-11T23:18:10.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.338+0000 7ff392e00640 1 -- 172.21.15.144:0/228365757 shutdown_connections 2024-09-11T23:18:10.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.338+0000 7ff392e00640 1 --2- 172.21.15.144:0/228365757 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff38c0b4540 0x7ff38c0b4980 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.337+0000 7f2002a00640 1 -- 172.21.15.144:0/2694233111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ffc156680 con 0x7f1ffc0af900 2024-09-11T23:18:10.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.338+0000 7ff392e00640 1 -- 172.21.15.144:0/228365757 >> 172.21.15.144:0/228365757 conn(0x7ff38c062810 msgr2=0x7ff38c062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.338+0000 7f8b57400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b5815e940 0x7f8b58155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.338+0000 7f8b57400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b5815e940 0x7f8b58155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49316/0 (socket says 172.21.15.144:49316) 2024-09-11T23:18:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.338+0000 7f2002a00640 1 -- 172.21.15.144:0/2694233111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ffc156c40 con 0x7f1ffc0af900 2024-09-11T23:18:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.338+0000 7f6ceca00640 1 --2- 172.21.15.144:0/2344920713 >> [v2:172.21.15.144:6802/186820848,v1:172.21.15.144:6803/186820848] conn(0x7f6cc8074120 0x7f6cc8076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.338+0000 7ff392e00640 1 -- 172.21.15.144:0/228365757 shutdown_connections 2024-09-11T23:18:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.338+0000 7ff392e00640 1 -- 172.21.15.144:0/228365757 wait complete. 2024-09-11T23:18:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.338+0000 7f8b57400640 1 -- 172.21.15.144:0/2017637905 learned_addr learned my addr 172.21.15.144:0/2017637905 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:10.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.337+0000 7f3cf0200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ce80b68d0 0x7f3ce81f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.337+0000 7f3cf0200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ce80ced90 0x7f3ce80ce350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.337+0000 7f3cf0200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ce815eac0 0x7f3ce8161070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.338+0000 7f3ced800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ce80b68d0 0x7f3ce81f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.338+0000 7f3ced800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ce80b68d0 0x7f3ce81f7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49300/0 (socket says 172.21.15.144:49300) 2024-09-11T23:18:10.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.339+0000 7f264a800640 1 --2- 172.21.15.144:0/1980961035 >> [v2:172.21.15.144:6811/4178698740,v1:172.21.15.144:6813/4178698740] conn(0x7f2628074100 0x7f2628076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.339+0000 7f3ced800640 1 -- 172.21.15.144:0/3561180450 learned_addr learned my addr 172.21.15.144:0/3561180450 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:10.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.339+0000 7f3cf0200640 1 -- 172.21.15.144:0/3561180450 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce80d2490 con 0x7f3ce80b68d0 2024-09-11T23:18:10.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.339+0000 7f3cf0200640 1 -- 172.21.15.144:0/3561180450 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce80d2310 con 0x7f3ce815eac0 2024-09-11T23:18:10.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.339+0000 7f3cf0200640 1 -- 172.21.15.144:0/3561180450 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce80d3790 con 0x7f3ce80ced90 2024-09-11T23:18:10.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.339+0000 7f3cee200640 1 --2- 172.21.15.144:0/3561180450 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ce815eac0 0x7f3ce8161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.339+0000 7f3cece00640 1 --2- 172.21.15.144:0/3561180450 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ce80ced90 0x7f3ce80ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.339+0000 7f8b57e00640 1 --2- 172.21.15.144:0/2017637905 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b580cef90 0x7f8b58156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.340+0000 7f8b5ee00640 1 --2- 172.21.15.144:0/2017637905 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b5815ed20 0x7f8b58158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.340+0000 7f8b5ee00640 1 -- 172.21.15.144:0/2017637905 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8b580d3f00 con 0x7f8b5815e940 2024-09-11T23:18:10.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.340+0000 7f8b5ee00640 1 -- 172.21.15.144:0/2017637905 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8b580d3c20 con 0x7f8b5815ed20 2024-09-11T23:18:10.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.340+0000 7f8b5ee00640 1 -- 172.21.15.144:0/2017637905 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8b580d3310 con 0x7f8b580cef90 2024-09-11T23:18:10.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.340+0000 7f8b5ce00640 1 --2- 172.21.15.144:0/2017637905 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b5815ed20 0x7f8b58158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.340+0000 7f3cee200640 1 -- 172.21.15.144:0/3561180450 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ce80ced90 msgr2=0x7f3ce80ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.340+0000 7f3cee200640 1 --2- 172.21.15.144:0/3561180450 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3ce80ced90 0x7f3ce80ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.340+0000 7f3cee200640 1 -- 172.21.15.144:0/3561180450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ce80b68d0 msgr2=0x7f3ce81f7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.340+0000 7f3cee200640 1 --2- 172.21.15.144:0/3561180450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ce80b68d0 0x7f3ce81f7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.340+0000 7f3cee200640 1 -- 172.21.15.144:0/3561180450 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce81f82d0 con 0x7f3ce815eac0 2024-09-11T23:18:10.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.340+0000 7f3ced800640 1 --2- 172.21.15.144:0/3561180450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ce80b68d0 0x7f3ce81f7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:10.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.340+0000 7f3cee200640 1 --2- 172.21.15.144:0/3561180450 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ce815eac0 0x7f3ce8161070 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0031000 tx=0x7f3ce00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.340+0000 7f2002a00640 1 -- 172.21.15.144:0/2694233111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1ffc0cd750 con 0x7f1ffc0af900 2024-09-11T23:18:10.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.340+0000 7f264a800640 1 --2- 172.21.15.144:0/1980961035 >> [v2:172.21.15.144:6811/4178698740,v1:172.21.15.144:6813/4178698740] conn(0x7f2628074100 0x7f2628076520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.340+0000 7f6ced400640 1 --2- 172.21.15.144:0/2344920713 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6cc806bf00 0x7f6cc806e3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc034000 tx=0x7f6cdc02c000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.341+0000 7f8b5ce00640 1 -- 172.21.15.144:0/2017637905 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b580cef90 msgr2=0x7f8b58156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.341+0000 7f3ce5600640 1 -- 172.21.15.144:0/3561180450 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0037050 con 0x7f3ce815eac0 2024-09-11T23:18:10.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.341+0000 7f3ce5600640 1 -- 172.21.15.144:0/3561180450 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ce0043070 con 0x7f3ce815eac0 2024-09-11T23:18:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.341+0000 7f3cf0200640 1 -- 172.21.15.144:0/3561180450 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce8201760 con 0x7f3ce815eac0 2024-09-11T23:18:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.341+0000 7ff392e00640 1 Processor -- start 2024-09-11T23:18:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.341+0000 7f1ff3e00640 1 -- 172.21.15.144:0/2694233111 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fe801a070 con 0x7f1ffc0af900 2024-09-11T23:18:10.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.342+0000 7f3d2e000640 1 --2- 172.21.15.144:0/898702357 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3d1406bf00 0x7f3d1406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.341+0000 7f3ce5600640 1 -- 172.21.15.144:0/3561180450 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0006e10 con 0x7f3ce815eac0 2024-09-11T23:18:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.341+0000 7f3cf0200640 1 -- 172.21.15.144:0/3561180450 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce8201d20 con 0x7f3ce815eac0 2024-09-11T23:18:10.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.342+0000 7f577f400640 1 --2- 172.21.15.144:0/610952116 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f576006be80 0x7f576006e340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f576c0071a0 tx=0x7f576c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.341+0000 7f6ceca00640 1 --2- 172.21.15.144:0/2344920713 >> [v2:172.21.15.144:6802/186820848,v1:172.21.15.144:6803/186820848] conn(0x7f6cc8074120 0x7f6cc8076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.342+0000 7ff392e00640 1 -- start start 2024-09-11T23:18:10.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.341+0000 7f8b5ce00640 1 --2- 172.21.15.144:0/2017637905 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b580cef90 0x7f8b58156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.341+0000 7f8b5ce00640 1 -- 172.21.15.144:0/2017637905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b5815e940 msgr2=0x7f8b58155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.341+0000 7f8b5ce00640 1 --2- 172.21.15.144:0/2017637905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b5815e940 0x7f8b58155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.341+0000 7f8b5ce00640 1 -- 172.21.15.144:0/2017637905 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b58156c50 con 0x7f8b5815ed20 2024-09-11T23:18:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.342+0000 7f8b5ce00640 1 --2- 172.21.15.144:0/2017637905 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b5815ed20 0x7f8b58158e30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8b50031000 tx=0x7f8b50004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.342+0000 7f8b4fe00640 1 -- 172.21.15.144:0/2017637905 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5003f070 con 0x7f8b5815ed20 2024-09-11T23:18:10.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.342+0000 7f8b4fe00640 1 -- 172.21.15.144:0/2017637905 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b50003b90 con 0x7f8b5815ed20 2024-09-11T23:18:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.343+0000 7f6ce5600640 1 -- 172.21.15.144:0/2344920713 <== osd.3 v2:172.21.15.144:6802/186820848 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ce000df90 con 0x7f6cc8074120 2024-09-11T23:18:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.342+0000 7f8b4fe00640 1 -- 172.21.15.144:0/2017637905 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b50031940 con 0x7f8b5815ed20 2024-09-11T23:18:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.343+0000 7f1ff3e00640 1 --2- 172.21.15.144:0/2694233111 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1fdc06be80 0x7f1fdc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.343+0000 7f2642a00640 1 -- 172.21.15.144:0/1980961035 <== osd.1 v2:172.21.15.144:6811/4178698740 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f263c017ec0 con 0x7f2628074100 2024-09-11T23:18:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.343+0000 7f1ff3e00640 1 -- 172.21.15.144:0/2694233111 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1fe808aa20 con 0x7f1ffc0af900 2024-09-11T23:18:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.343+0000 7f8b5ee00640 1 -- 172.21.15.144:0/2017637905 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b58156f30 con 0x7f8b5815ed20 2024-09-11T23:18:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.343+0000 7f8b5ee00640 1 -- 172.21.15.144:0/2017637905 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b581574f0 con 0x7f8b5815ed20 2024-09-11T23:18:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.342+0000 7f3d2e000640 1 -- 172.21.15.144:0/898702357 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3d280aaee0 con 0x7f3d380d2300 2024-09-11T23:18:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.343+0000 7f3d2e000640 1 --2- 172.21.15.144:0/898702357 >> [v2:172.21.15.144:6810/1102197794,v1:172.21.15.144:6812/1102197794] conn(0x7f3d14074120 0x7f3d14076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.343+0000 7f3d2e000640 1 -- 172.21.15.144:0/898702357 --> [v2:172.21.15.144:6810/1102197794,v1:172.21.15.144:6812/1102197794] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d28004490 con 0x7f3d14074120 2024-09-11T23:18:10.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.343+0000 7f1ff3e00640 1 --2- 172.21.15.144:0/2694233111 >> [v2:172.21.15.165:6816/2335029761,v1:172.21.15.165:6818/2335029761] conn(0x7f1fdc0740a0 0x7f1fdc0764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.343+0000 7f1ff3e00640 1 -- 172.21.15.144:0/2694233111 --> [v2:172.21.15.165:6816/2335029761,v1:172.21.15.165:6818/2335029761] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1fdc076b70 con 0x7f1fdc0740a0 2024-09-11T23:18:10.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.343+0000 7f1ff3e00640 1 -- 172.21.15.144:0/2694233111 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f1fe808f2a0 con 0x7f1ffc0af900 2024-09-11T23:18:10.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.343+0000 7f1ffbe00640 1 --2- 172.21.15.144:0/2694233111 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1fdc06be80 0x7f1fdc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.343+0000 7f3d2e000640 1 -- 172.21.15.144:0/898702357 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f3d280ad540 con 0x7f3d380d2300 2024-09-11T23:18:10.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.344+0000 7f8b57e00640 1 --2- 172.21.15.144:0/2017637905 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b580cef90 0x7f8b58156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:10.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.344+0000 7f2000a00640 1 --2- 172.21.15.144:0/2694233111 >> [v2:172.21.15.165:6816/2335029761,v1:172.21.15.165:6818/2335029761] conn(0x7f1fdc0740a0 0x7f1fdc0764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.344+0000 7f3d36800640 1 --2- 172.21.15.144:0/898702357 >> [v2:172.21.15.144:6810/1102197794,v1:172.21.15.144:6812/1102197794] conn(0x7f3d14074120 0x7f3d14076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.345+0000 7f1ffbe00640 1 --2- 172.21.15.144:0/2694233111 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1fdc06be80 0x7f1fdc06e340 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1fec000f60 tx=0x7f1fec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.345+0000 7f2000a00640 1 --2- 172.21.15.144:0/2694233111 >> [v2:172.21.15.165:6816/2335029761,v1:172.21.15.165:6818/2335029761] conn(0x7f1fdc0740a0 0x7f1fdc0764c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.345+0000 7f3d35400640 1 --2- 172.21.15.144:0/898702357 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3d1406bf00 0x7f3d1406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.345+0000 7ff392e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff38c0b4540 0x7ff38c15f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.346+0000 7f1ff3e00640 1 -- 172.21.15.144:0/2694233111 <== osd.7 v2:172.21.15.165:6816/2335029761 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1fdc076b70 con 0x7f1fdc0740a0 2024-09-11T23:18:10.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.346+0000 7ff392e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff38c0b5520 0x7ff38c146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.346+0000 7ff392e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff38c15c4f0 0x7ff38c147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.346+0000 7ff38be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff38c0b4540 0x7ff38c15f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.346+0000 7ff392e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff38c1606b0 con 0x7ff38c15c4f0 2024-09-11T23:18:10.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.346+0000 7ff392e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff38c1603d0 con 0x7ff38c0b5520 2024-09-11T23:18:10.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.345+0000 7f3ce5600640 1 -- 172.21.15.144:0/3561180450 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ce0032890 con 0x7f3ce815eac0 2024-09-11T23:18:10.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.347+0000 7f3ce5600640 1 --2- 172.21.15.144:0/3561180450 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3cc806be30 0x7f3cc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.347+0000 7f3ce5600640 1 -- 172.21.15.144:0/3561180450 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3ce00ab560 con 0x7f3ce815eac0 2024-09-11T23:18:10.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.347+0000 7f3ced800640 1 --2- 172.21.15.144:0/3561180450 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3cc806be30 0x7f3cc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.346+0000 7ff392e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff38c160990 con 0x7ff38c0b4540 2024-09-11T23:18:10.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.347+0000 7ff390e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff38c15c4f0 0x7ff38c147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.347+0000 7ff390e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff38c15c4f0 0x7ff38c147530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49320/0 (socket says 172.21.15.144:49320) 2024-09-11T23:18:10.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.346+0000 7f3d35400640 1 --2- 172.21.15.144:0/898702357 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3d1406bf00 0x7f3d1406e3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3d381662e0 tx=0x7f3d20009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.346+0000 7f3d36800640 1 --2- 172.21.15.144:0/898702357 >> [v2:172.21.15.144:6810/1102197794,v1:172.21.15.144:6812/1102197794] conn(0x7f3d14074120 0x7f3d14076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.347+0000 7ff390e00640 1 -- 172.21.15.144:0/1279577633 learned_addr learned my addr 172.21.15.144:0/1279577633 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:10.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.348+0000 7f3d2e000640 1 -- 172.21.15.144:0/898702357 <== osd.0 v2:172.21.15.144:6810/1102197794 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d28004490 con 0x7f3d14074120 2024-09-11T23:18:10.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.348+0000 7ff390e00640 1 -- 172.21.15.144:0/1279577633 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff38c0b4540 msgr2=0x7ff38c15f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.348+0000 7ff390e00640 1 --2- 172.21.15.144:0/1279577633 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff38c0b4540 0x7ff38c15f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.348+0000 7ff390e00640 1 -- 172.21.15.144:0/1279577633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff38c0b5520 msgr2=0x7ff38c146ff0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T23:18:10.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.348+0000 7ff390e00640 1 --2- 172.21.15.144:0/1279577633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff38c0b5520 0x7ff38c146ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.348+0000 7ff390e00640 1 -- 172.21.15.144:0/1279577633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38c147a70 con 0x7ff38c15c4f0 2024-09-11T23:18:10.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.349+0000 7f8b5ee00640 1 -- 172.21.15.144:0/2017637905 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8b580d1ef0 con 0x7f8b5815ed20 2024-09-11T23:18:10.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.349+0000 7ff390e00640 1 --2- 172.21.15.144:0/1279577633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff38c15c4f0 0x7ff38c147530 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff38400cb50 tx=0x7ff38400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.351+0000 7f3cf0200640 1 --2- 172.21.15.144:0/3561180450 >> [v2:172.21.15.165:6817/1277452042,v1:172.21.15.165:6819/1277452042] conn(0x7f3ce80ce890 0x7f3ce80d4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.351+0000 7ff383e00640 1 -- 172.21.15.144:0/1279577633 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff384017070 con 0x7ff38c15c4f0 2024-09-11T23:18:10.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.351+0000 7f3cf0200640 1 -- 172.21.15.144:0/3561180450 --> [v2:172.21.15.165:6817/1277452042,v1:172.21.15.165:6819/1277452042] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ce80c9490 con 0x7f3ce80ce890 2024-09-11T23:18:10.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.351+0000 7f3ced800640 1 --2- 172.21.15.144:0/3561180450 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3cc806be30 0x7f3cc806e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc009fd0 tx=0x7f3cdc00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.351+0000 7ff392e00640 1 -- 172.21.15.144:0/1279577633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff38c15b430 con 0x7ff38c15c4f0 2024-09-11T23:18:10.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.352+0000 7f8b4fe00640 1 -- 172.21.15.144:0/2017637905 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b50031ae0 con 0x7f8b5815ed20 2024-09-11T23:18:10.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.352+0000 7ff383e00640 1 -- 172.21.15.144:0/1279577633 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff38400ad40 con 0x7ff38c15c4f0 2024-09-11T23:18:10.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.352+0000 7ff392e00640 1 -- 172.21.15.144:0/1279577633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff38c15ae70 con 0x7ff38c15c4f0 2024-09-11T23:18:10.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.352+0000 7ff383e00640 1 -- 172.21.15.144:0/1279577633 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff384017070 con 0x7ff38c15c4f0 2024-09-11T23:18:10.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.352+0000 7f3cece00640 1 --2- 172.21.15.144:0/3561180450 >> [v2:172.21.15.165:6817/1277452042,v1:172.21.15.165:6819/1277452042] conn(0x7f3ce80ce890 0x7f3ce80d4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.353+0000 7f8b4fe00640 1 --2- 172.21.15.144:0/2017637905 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8b3806be80 0x7f8b3806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.353+0000 7f3cece00640 1 --2- 172.21.15.144:0/3561180450 >> [v2:172.21.15.165:6817/1277452042,v1:172.21.15.165:6819/1277452042] conn(0x7f3ce80ce890 0x7f3ce80d4810 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.354+0000 7f8b4fe00640 1 -- 172.21.15.144:0/2017637905 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8b500abfe0 con 0x7f8b5815ed20 2024-09-11T23:18:10.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.354+0000 7f3ce5600640 1 -- 172.21.15.144:0/3561180450 <== osd.6 v2:172.21.15.165:6817/1277452042 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3cd4004a10 con 0x7f3ce80ce890 2024-09-11T23:18:10.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.354+0000 7f8b57e00640 1 --2- 172.21.15.144:0/2017637905 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8b3806be80 0x7f8b3806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.354+0000 7ff392e00640 1 -- 172.21.15.144:0/1279577633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff38c144c70 con 0x7ff38c15c4f0 2024-09-11T23:18:10.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.355+0000 7f8b4fe00640 1 --2- 172.21.15.144:0/2017637905 >> [v2:172.21.15.165:6808/46808092,v1:172.21.15.165:6809/46808092] conn(0x7f8b380740a0 0x7f8b380764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.356+0000 7f8b4fe00640 1 -- 172.21.15.144:0/2017637905 --> [v2:172.21.15.165:6808/46808092,v1:172.21.15.165:6809/46808092] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b50049e70 con 0x7f8b380740a0 2024-09-11T23:18:10.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.356+0000 7f8b57e00640 1 --2- 172.21.15.144:0/2017637905 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8b3806be80 0x7f8b3806e340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8b44006fd0 tx=0x7f8b44008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.356+0000 7f8b4fe00640 1 -- 172.21.15.144:0/2017637905 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f8b500b3050 con 0x7f8b5815ed20 2024-09-11T23:18:10.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.356+0000 7f8b57400640 1 --2- 172.21.15.144:0/2017637905 >> [v2:172.21.15.165:6808/46808092,v1:172.21.15.165:6809/46808092] conn(0x7f8b380740a0 0x7f8b380764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.357+0000 7f8b57400640 1 --2- 172.21.15.144:0/2017637905 >> [v2:172.21.15.165:6808/46808092,v1:172.21.15.165:6809/46808092] conn(0x7f8b380740a0 0x7f8b380764c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.357+0000 7ff383e00640 1 -- 172.21.15.144:0/1279577633 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff38401a070 con 0x7ff38c15c4f0 2024-09-11T23:18:10.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.358+0000 7f8b4fe00640 1 -- 172.21.15.144:0/2017637905 <== osd.4 v2:172.21.15.165:6808/46808092 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8b50049e70 con 0x7f8b380740a0 2024-09-11T23:18:10.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.359+0000 7ff383e00640 1 --2- 172.21.15.144:0/1279577633 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff36c06c030 0x7ff36c06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.359+0000 7ff383e00640 1 -- 172.21.15.144:0/1279577633 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff38408ac50 con 0x7ff38c15c4f0 2024-09-11T23:18:10.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.359+0000 7f5786800640 1 -- 172.21.15.144:0/610952116 --> [v2:172.21.15.144:6826/645991929,v1:172.21.15.144:6827/645991929] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f57800b1db0 con 0x7f57600740a0 2024-09-11T23:18:10.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.360+0000 7ff38be00640 1 --2- 172.21.15.144:0/1279577633 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff36c06c030 0x7ff36c06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.360+0000 7ff383e00640 1 --2- 172.21.15.144:0/1279577633 >> [v2:172.21.15.165:6800/1377669667,v1:172.21.15.165:6801/1377669667] conn(0x7ff36c0742b0 0x7ff36c0766d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.360+0000 7ff383e00640 1 -- 172.21.15.144:0/1279577633 --> [v2:172.21.15.165:6800/1377669667,v1:172.21.15.165:6801/1377669667] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff36c076d80 con 0x7ff36c0742b0 2024-09-11T23:18:10.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.361+0000 7ff383e00640 1 -- 172.21.15.144:0/1279577633 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff38408b040 con 0x7ff38c15c4f0 2024-09-11T23:18:10.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.362+0000 7ff38b400640 1 --2- 172.21.15.144:0/1279577633 >> [v2:172.21.15.165:6800/1377669667,v1:172.21.15.165:6801/1377669667] conn(0x7ff36c0742b0 0x7ff36c0766d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.362+0000 7ff38be00640 1 --2- 172.21.15.144:0/1279577633 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff36c06c030 0x7ff36c06e4f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff37c001500 tx=0x7ff37c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.363+0000 7f5777400640 1 -- 172.21.15.144:0/610952116 <== osd.2 v2:172.21.15.144:6826/645991929 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f57800b1db0 con 0x7f57600740a0 2024-09-11T23:18:10.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.363+0000 7ff38b400640 1 --2- 172.21.15.144:0/1279577633 >> [v2:172.21.15.165:6800/1377669667,v1:172.21.15.165:6801/1377669667] conn(0x7ff36c0742b0 0x7ff36c0766d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.363+0000 7f5786800640 1 -- 172.21.15.144:0/610952116 >> [v2:172.21.15.144:6826/645991929,v1:172.21.15.144:6827/645991929] conn(0x7f57600740a0 msgr2=0x7f57600764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.363+0000 7f5786800640 1 --2- 172.21.15.144:0/610952116 >> [v2:172.21.15.144:6826/645991929,v1:172.21.15.144:6827/645991929] conn(0x7f57600740a0 0x7f57600764c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.364+0000 7f5786800640 1 -- 172.21.15.144:0/610952116 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f576006be80 msgr2=0x7f576006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.364+0000 7f5786800640 1 --2- 172.21.15.144:0/610952116 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f576006be80 0x7f576006e340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f576c0071a0 tx=0x7f576c009040 comp rx=0 tx=0).stop 2024-09-11T23:18:10.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.364+0000 7f5786800640 1 -- 172.21.15.144:0/610952116 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57800b3930 msgr2=0x7f5780151f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.364+0000 7f5786800640 1 --2- 172.21.15.144:0/610952116 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57800b3930 0x7f5780151f30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5778009cf0 tx=0x7f577800c490 comp rx=0 tx=0).stop 2024-09-11T23:18:10.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.364+0000 7f577fe00640 1 -- 172.21.15.144:0/610952116 reap_dead start 2024-09-11T23:18:10.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.364+0000 7f5786800640 1 -- 172.21.15.144:0/610952116 shutdown_connections 2024-09-11T23:18:10.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.364+0000 7f5786800640 1 -- 172.21.15.144:0/610952116 >> 172.21.15.144:0/610952116 conn(0x7f57800b2040 msgr2=0x7f57800b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.365+0000 7f5786800640 1 -- 172.21.15.144:0/610952116 shutdown_connections 2024-09-11T23:18:10.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.365+0000 7f5786800640 1 -- 172.21.15.144:0/610952116 wait complete. 2024-09-11T23:18:10.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.365+0000 7ff383e00640 1 -- 172.21.15.144:0/1279577633 <== osd.5 v2:172.21.15.165:6800/1377669667 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff36c076d80 con 0x7ff36c0742b0 2024-09-11T23:18:10.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.369+0000 7f2002a00640 1 -- 172.21.15.144:0/2694233111 --> [v2:172.21.15.165:6816/2335029761,v1:172.21.15.165:6818/2335029761] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1ffc06bd40 con 0x7f1fdc0740a0 2024-09-11T23:18:10.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.373+0000 7f1ff3e00640 1 -- 172.21.15.144:0/2694233111 <== osd.7 v2:172.21.15.165:6816/2335029761 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1ffc06bd40 con 0x7f1fdc0740a0 2024-09-11T23:18:10.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.373+0000 7f6cefe00640 1 -- 172.21.15.144:0/2344920713 --> [v2:172.21.15.144:6802/186820848,v1:172.21.15.144:6803/186820848] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6ce80d0660 con 0x7f6cc8074120 2024-09-11T23:18:10.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.373+0000 7f2002a00640 1 -- 172.21.15.144:0/2694233111 >> [v2:172.21.15.165:6816/2335029761,v1:172.21.15.165:6818/2335029761] conn(0x7f1fdc0740a0 msgr2=0x7f1fdc0764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.373+0000 7f2002a00640 1 --2- 172.21.15.144:0/2694233111 >> [v2:172.21.15.165:6816/2335029761,v1:172.21.15.165:6818/2335029761] conn(0x7f1fdc0740a0 0x7f1fdc0764c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.374+0000 7f2002a00640 1 -- 172.21.15.144:0/2694233111 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1fdc06be80 msgr2=0x7f1fdc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.374+0000 7f2002a00640 1 --2- 172.21.15.144:0/2694233111 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1fdc06be80 0x7f1fdc06e340 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1fec000f60 tx=0x7f1fec009040 comp rx=0 tx=0).stop 2024-09-11T23:18:10.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.374+0000 7f2002a00640 1 -- 172.21.15.144:0/2694233111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ffc0af900 msgr2=0x7f1ffc165730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.374+0000 7f2002a00640 1 --2- 172.21.15.144:0/2694233111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ffc0af900 0x7f1ffc165730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800e7e0 tx=0x7f1fe800eca0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.374+0000 7f2000a00640 1 -- 172.21.15.144:0/2694233111 reap_dead start 2024-09-11T23:18:10.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.374+0000 7f6ce5600640 1 -- 172.21.15.144:0/2344920713 <== osd.3 v2:172.21.15.144:6802/186820848 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6ce80d0660 con 0x7f6cc8074120 2024-09-11T23:18:10.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.375+0000 7f2002a00640 1 -- 172.21.15.144:0/2694233111 shutdown_connections 2024-09-11T23:18:10.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.375+0000 7f2002a00640 1 -- 172.21.15.144:0/2694233111 >> 172.21.15.144:0/2694233111 conn(0x7f1ffc062cc0 msgr2=0x7f1ffc1ec2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.375+0000 7f2002a00640 1 -- 172.21.15.144:0/2694233111 shutdown_connections 2024-09-11T23:18:10.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.375+0000 7f2002a00640 1 -- 172.21.15.144:0/2694233111 wait complete. 2024-09-11T23:18:10.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.375+0000 7f6cefe00640 1 -- 172.21.15.144:0/2344920713 >> [v2:172.21.15.144:6802/186820848,v1:172.21.15.144:6803/186820848] conn(0x7f6cc8074120 msgr2=0x7f6cc8076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.375+0000 7f6cefe00640 1 --2- 172.21.15.144:0/2344920713 >> [v2:172.21.15.144:6802/186820848,v1:172.21.15.144:6803/186820848] conn(0x7f6cc8074120 0x7f6cc8076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.376+0000 7f6cefe00640 1 -- 172.21.15.144:0/2344920713 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6cc806bf00 msgr2=0x7f6cc806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.376+0000 7f6cefe00640 1 --2- 172.21.15.144:0/2344920713 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6cc806bf00 0x7f6cc806e3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc034000 tx=0x7f6cdc02c000 comp rx=0 tx=0).stop 2024-09-11T23:18:10.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.376+0000 7f6cefe00640 1 -- 172.21.15.144:0/2344920713 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ce80cfe90 msgr2=0x7f6ce8073710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.376+0000 7f6cefe00640 1 --2- 172.21.15.144:0/2344920713 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ce80cfe90 0x7f6ce8073710 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6ce000ef90 tx=0x7f6ce000c490 comp rx=0 tx=0).stop 2024-09-11T23:18:10.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.376+0000 7f6cede00640 1 -- 172.21.15.144:0/2344920713 reap_dead start 2024-09-11T23:18:10.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.376+0000 7f6cefe00640 1 -- 172.21.15.144:0/2344920713 shutdown_connections 2024-09-11T23:18:10.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.376+0000 7f6cefe00640 1 -- 172.21.15.144:0/2344920713 >> 172.21.15.144:0/2344920713 conn(0x7f6ce80b2040 msgr2=0x7f6ce80d0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.377+0000 7f6cefe00640 1 -- 172.21.15.144:0/2344920713 shutdown_connections 2024-09-11T23:18:10.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.377+0000 7f6cefe00640 1 -- 172.21.15.144:0/2344920713 wait complete. 2024-09-11T23:18:10.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.377+0000 7f3cf0200640 1 -- 172.21.15.144:0/3561180450 --> [v2:172.21.15.165:6817/1277452042,v1:172.21.15.165:6819/1277452042] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3ce80ba450 con 0x7f3ce80ce890 2024-09-11T23:18:10.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.378+0000 7f2651200640 1 -- 172.21.15.144:0/1980961035 --> [v2:172.21.15.144:6811/4178698740,v1:172.21.15.144:6813/4178698740] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f264c0cb400 con 0x7f2628074100 2024-09-11T23:18:10.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.378+0000 7f3ce5600640 1 -- 172.21.15.144:0/3561180450 <== osd.6 v2:172.21.15.165:6817/1277452042 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3ce80ba450 con 0x7f3ce80ce890 2024-09-11T23:18:10.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.379+0000 7f2642a00640 1 -- 172.21.15.144:0/1980961035 <== osd.1 v2:172.21.15.144:6811/4178698740 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f264c0cb400 con 0x7f2628074100 2024-09-11T23:18:10.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.379+0000 7f3cf0200640 1 -- 172.21.15.144:0/3561180450 >> [v2:172.21.15.165:6817/1277452042,v1:172.21.15.165:6819/1277452042] conn(0x7f3ce80ce890 msgr2=0x7f3ce80d4810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.379+0000 7f3cf0200640 1 --2- 172.21.15.144:0/3561180450 >> [v2:172.21.15.165:6817/1277452042,v1:172.21.15.165:6819/1277452042] conn(0x7f3ce80ce890 0x7f3ce80d4810 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.380+0000 7f2651200640 1 -- 172.21.15.144:0/1980961035 >> [v2:172.21.15.144:6811/4178698740,v1:172.21.15.144:6813/4178698740] conn(0x7f2628074100 msgr2=0x7f2628076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.380+0000 7f2651200640 1 --2- 172.21.15.144:0/1980961035 >> [v2:172.21.15.144:6811/4178698740,v1:172.21.15.144:6813/4178698740] conn(0x7f2628074100 0x7f2628076520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.380+0000 7f2651200640 1 -- 172.21.15.144:0/1980961035 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f262806bf00 msgr2=0x7f262806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.380+0000 7f2651200640 1 --2- 172.21.15.144:0/1980961035 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f262806bf00 0x7f262806e3c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f264c15bc90 tx=0x7f2634007000 comp rx=0 tx=0).stop 2024-09-11T23:18:10.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.380+0000 7f2651200640 1 -- 172.21.15.144:0/1980961035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f264c154780 msgr2=0x7f264c0b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.380+0000 7f2651200640 1 --2- 172.21.15.144:0/1980961035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f264c154780 0x7f264c0b5980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f263c007a30 tx=0x7f263c00e530 comp rx=0 tx=0).stop 2024-09-11T23:18:10.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.380+0000 7f3cf0200640 1 -- 172.21.15.144:0/3561180450 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3cc806be30 msgr2=0x7f3cc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.380+0000 7f3cf0200640 1 --2- 172.21.15.144:0/3561180450 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3cc806be30 0x7f3cc806e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc009fd0 tx=0x7f3cdc00b040 comp rx=0 tx=0).stop 2024-09-11T23:18:10.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.380+0000 7f3cf0200640 1 -- 172.21.15.144:0/3561180450 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ce815eac0 msgr2=0x7f3ce8161070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.380+0000 7f3cf0200640 1 --2- 172.21.15.144:0/3561180450 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ce815eac0 0x7f3ce8161070 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0031000 tx=0x7f3ce00046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.381+0000 7f3cee200640 1 -- 172.21.15.144:0/3561180450 reap_dead start 2024-09-11T23:18:10.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.381+0000 7f3cf0200640 1 -- 172.21.15.144:0/3561180450 shutdown_connections 2024-09-11T23:18:10.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.381+0000 7f3cf0200640 1 -- 172.21.15.144:0/3561180450 >> 172.21.15.144:0/3561180450 conn(0x7f3ce80d11c0 msgr2=0x7f3ce80b8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.381+0000 7f264a800640 1 -- 172.21.15.144:0/1980961035 reap_dead start 2024-09-11T23:18:10.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.381+0000 7f2651200640 1 -- 172.21.15.144:0/1980961035 shutdown_connections 2024-09-11T23:18:10.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.381+0000 7f2651200640 1 -- 172.21.15.144:0/1980961035 >> 172.21.15.144:0/1980961035 conn(0x7f264c0b6240 msgr2=0x7f264c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.382+0000 7f3cf0200640 1 -- 172.21.15.144:0/3561180450 shutdown_connections 2024-09-11T23:18:10.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.382+0000 7f2651200640 1 -- 172.21.15.144:0/1980961035 shutdown_connections 2024-09-11T23:18:10.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.382+0000 7f3cf0200640 1 -- 172.21.15.144:0/3561180450 wait complete. 2024-09-11T23:18:10.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.382+0000 7f3d3d200640 1 -- 172.21.15.144:0/898702357 --> [v2:172.21.15.144:6810/1102197794,v1:172.21.15.144:6812/1102197794] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3d380cef90 con 0x7f3d14074120 2024-09-11T23:18:10.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.382+0000 7f2651200640 1 -- 172.21.15.144:0/1980961035 wait complete. 2024-09-11T23:18:10.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.383+0000 7f8b5ee00640 1 -- 172.21.15.144:0/2017637905 --> [v2:172.21.15.165:6808/46808092,v1:172.21.15.165:6809/46808092] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8b580b8c70 con 0x7f8b380740a0 2024-09-11T23:18:10.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.383+0000 7f3d2e000640 1 -- 172.21.15.144:0/898702357 <== osd.0 v2:172.21.15.144:6810/1102197794 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3d380cef90 con 0x7f3d14074120 2024-09-11T23:18:10.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.384+0000 7f8b4fe00640 1 -- 172.21.15.144:0/2017637905 <== osd.4 v2:172.21.15.165:6808/46808092 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8b580b8c70 con 0x7f8b380740a0 2024-09-11T23:18:10.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.384+0000 7f8b5ee00640 1 -- 172.21.15.144:0/2017637905 >> [v2:172.21.15.165:6808/46808092,v1:172.21.15.165:6809/46808092] conn(0x7f8b380740a0 msgr2=0x7f8b380764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.384+0000 7f8b5ee00640 1 --2- 172.21.15.144:0/2017637905 >> [v2:172.21.15.165:6808/46808092,v1:172.21.15.165:6809/46808092] conn(0x7f8b380740a0 0x7f8b380764c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.385+0000 7f8b5ee00640 1 -- 172.21.15.144:0/2017637905 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8b3806be80 msgr2=0x7f8b3806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.385+0000 7f8b5ee00640 1 --2- 172.21.15.144:0/2017637905 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8b3806be80 0x7f8b3806e340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8b44006fd0 tx=0x7f8b44008040 comp rx=0 tx=0).stop 2024-09-11T23:18:10.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.385+0000 7f8b5ee00640 1 -- 172.21.15.144:0/2017637905 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b5815ed20 msgr2=0x7f8b58158e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.385+0000 7f8b5ee00640 1 --2- 172.21.15.144:0/2017637905 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b5815ed20 0x7f8b58158e30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8b50031000 tx=0x7f8b50004a40 comp rx=0 tx=0).stop 2024-09-11T23:18:10.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.385+0000 7f8b5ce00640 1 -- 172.21.15.144:0/2017637905 reap_dead start 2024-09-11T23:18:10.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.385+0000 7f8b5ee00640 1 -- 172.21.15.144:0/2017637905 shutdown_connections 2024-09-11T23:18:10.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.385+0000 7f8b5ee00640 1 -- 172.21.15.144:0/2017637905 >> 172.21.15.144:0/2017637905 conn(0x7f8b580b6240 msgr2=0x7f8b580b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.385+0000 7f3d3d200640 1 -- 172.21.15.144:0/898702357 >> [v2:172.21.15.144:6810/1102197794,v1:172.21.15.144:6812/1102197794] conn(0x7f3d14074120 msgr2=0x7f3d14076540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.385+0000 7f3d3d200640 1 --2- 172.21.15.144:0/898702357 >> [v2:172.21.15.144:6810/1102197794,v1:172.21.15.144:6812/1102197794] conn(0x7f3d14074120 0x7f3d14076540 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.385+0000 7f8b5ee00640 1 -- 172.21.15.144:0/2017637905 shutdown_connections 2024-09-11T23:18:10.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.388+0000 7f3d3d200640 1 -- 172.21.15.144:0/898702357 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3d1406bf00 msgr2=0x7f3d1406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.388+0000 7f3d3d200640 1 --2- 172.21.15.144:0/898702357 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3d1406bf00 0x7f3d1406e3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3d381662e0 tx=0x7f3d20009240 comp rx=0 tx=0).stop 2024-09-11T23:18:10.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.388+0000 7f3d3d200640 1 -- 172.21.15.144:0/898702357 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d380d2300 msgr2=0x7f3d38150a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.388+0000 7f3d3d200640 1 --2- 172.21.15.144:0/898702357 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d380d2300 0x7f3d38150a60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3d28031000 tx=0x7f3d280046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.388+0000 7f3d36800640 1 -- 172.21.15.144:0/898702357 reap_dead start 2024-09-11T23:18:10.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.388+0000 7f3d3d200640 1 -- 172.21.15.144:0/898702357 shutdown_connections 2024-09-11T23:18:10.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.388+0000 7f3d3d200640 1 -- 172.21.15.144:0/898702357 >> 172.21.15.144:0/898702357 conn(0x7f3d380b6240 msgr2=0x7f3d380d1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.389+0000 7f8b5ee00640 1 -- 172.21.15.144:0/2017637905 wait complete. 2024-09-11T23:18:10.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.389+0000 7f3d3d200640 1 -- 172.21.15.144:0/898702357 shutdown_connections 2024-09-11T23:18:10.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.389+0000 7f3d3d200640 1 -- 172.21.15.144:0/898702357 wait complete. 2024-09-11T23:18:10.443 INFO:teuthology.orchestra.run.smithi144.stdout:60129542151 2024-09-11T23:18:10.444 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T23:18:10.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.397+0000 7ff392e00640 1 -- 172.21.15.144:0/1279577633 --> [v2:172.21.15.165:6800/1377669667,v1:172.21.15.165:6801/1377669667] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff38c074140 con 0x7ff36c0742b0 2024-09-11T23:18:10.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.397+0000 7ff383e00640 1 -- 172.21.15.144:0/1279577633 <== osd.5 v2:172.21.15.165:6800/1377669667 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff38c074140 con 0x7ff36c0742b0 2024-09-11T23:18:10.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.398+0000 7ff392e00640 1 -- 172.21.15.144:0/1279577633 >> [v2:172.21.15.165:6800/1377669667,v1:172.21.15.165:6801/1377669667] conn(0x7ff36c0742b0 msgr2=0x7ff36c0766d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.398+0000 7ff392e00640 1 --2- 172.21.15.144:0/1279577633 >> [v2:172.21.15.165:6800/1377669667,v1:172.21.15.165:6801/1377669667] conn(0x7ff36c0742b0 0x7ff36c0766d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.399+0000 7ff392e00640 1 -- 172.21.15.144:0/1279577633 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff36c06c030 msgr2=0x7ff36c06e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.399+0000 7ff392e00640 1 --2- 172.21.15.144:0/1279577633 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff36c06c030 0x7ff36c06e4f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff37c001500 tx=0x7ff37c009040 comp rx=0 tx=0).stop 2024-09-11T23:18:10.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.399+0000 7ff392e00640 1 -- 172.21.15.144:0/1279577633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff38c15c4f0 msgr2=0x7ff38c147530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.399+0000 7ff392e00640 1 --2- 172.21.15.144:0/1279577633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff38c15c4f0 0x7ff38c147530 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff38400cb50 tx=0x7ff38400a430 comp rx=0 tx=0).stop 2024-09-11T23:18:10.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.399+0000 7ff390e00640 1 -- 172.21.15.144:0/1279577633 reap_dead start 2024-09-11T23:18:10.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.399+0000 7ff392e00640 1 -- 172.21.15.144:0/1279577633 shutdown_connections 2024-09-11T23:18:10.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.399+0000 7ff392e00640 1 -- 172.21.15.144:0/1279577633 >> 172.21.15.144:0/1279577633 conn(0x7ff38c062810 msgr2=0x7ff38c1591f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.399+0000 7ff392e00640 1 -- 172.21.15.144:0/1279577633 shutdown_connections 2024-09-11T23:18:10.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.399+0000 7ff392e00640 1 -- 172.21.15.144:0/1279577633 wait complete. 2024-09-11T23:18:10.447 INFO:teuthology.orchestra.run.smithi144.stdout:60129542151 2024-09-11T23:18:10.447 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T23:18:10.448 INFO:teuthology.orchestra.run.smithi144.stdout:68719476745 2024-09-11T23:18:10.448 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T23:18:10.449 INFO:teuthology.orchestra.run.smithi144.stdout:68719476744 2024-09-11T23:18:10.449 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T23:18:10.450 INFO:teuthology.orchestra.run.smithi144.stdout:64424509447 2024-09-11T23:18:10.450 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T23:18:10.451 INFO:teuthology.orchestra.run.smithi144.stdout:68719476743 2024-09-11T23:18:10.451 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T23:18:10.452 INFO:teuthology.orchestra.run.smithi144.stdout:64424509447 2024-09-11T23:18:10.452 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T23:18:10.453 INFO:teuthology.orchestra.run.smithi144.stdout:68719476743 2024-09-11T23:18:10.453 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T23:18:10.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.754+0000 7fc50a200640 1 Processor -- start 2024-09-11T23:18:10.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.754+0000 7fc50a200640 1 -- start start 2024-09-11T23:18:10.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.756+0000 7f74bfa00640 1 Processor -- start 2024-09-11T23:18:10.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.756+0000 7f74bfa00640 1 -- start start 2024-09-11T23:18:10.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.757+0000 7f4146c00640 1 Processor -- start 2024-09-11T23:18:10.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.758+0000 7f4146c00640 1 -- start start 2024-09-11T23:18:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.756+0000 7fc50a200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc5040b5fd0 0x7fc5040b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.756+0000 7fc50a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc5040b7750 0x7fc5040b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.757+0000 7fc50a200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc50406bee0 con 0x7fc50415e640 2024-09-11T23:18:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.757+0000 7fc50a200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc50415ea20 con 0x7fc5040b5fd0 2024-09-11T23:18:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.757+0000 7fc50a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc50406caf0 con 0x7fc5040b7750 2024-09-11T23:18:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.757+0000 7fc509800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc5040b7750 0x7fc5040b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.758+0000 7fc508e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc50415e640 0x7fc5040d3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46868/0 (socket says 172.21.15.144:46868) 2024-09-11T23:18:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.758+0000 7fc508e00640 1 -- 172.21.15.144:0/1088550983 learned_addr learned my addr 172.21.15.144:0/1088550983 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.759+0000 7fc503400640 1 -- 172.21.15.144:0/1088550983 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 758608692 0 0) 0x7fc50406bee0 con 0x7fc50415e640 2024-09-11T23:18:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.759+0000 7fc503400640 1 -- 172.21.15.144:0/1088550983 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4e8003520 con 0x7fc50415e640 2024-09-11T23:18:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.759+0000 7fc503400640 1 -- 172.21.15.144:0/1088550983 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2428124508 0 0) 0x7fc4e8003520 con 0x7fc50415e640 2024-09-11T23:18:10.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.759+0000 7fc503400640 1 -- 172.21.15.144:0/1088550983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc5040b7750 msgr2=0x7fc5040b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.759+0000 7fc503400640 1 --2- 172.21.15.144:0/1088550983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc5040b7750 0x7fc5040b7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.759+0000 7fc503400640 1 -- 172.21.15.144:0/1088550983 >> v2:172.21.15.165:3300/0 conn(0x7fc5040b5fd0 msgr2=0x7fc5040b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.757+0000 7fc503e00640 1 --2- 172.21.15.144:0/1088550983 >> v2:172.21.15.165:3300/0 conn(0x7fc5040b5fd0 0x7fc5040b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.759+0000 7fc503400640 1 --2- 172.21.15.144:0/1088550983 >> v2:172.21.15.165:3300/0 conn(0x7fc5040b5fd0 0x7fc5040b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.759+0000 7fc503400640 1 -- 172.21.15.144:0/1088550983 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50406c1c0 con 0x7fc50415e640 2024-09-11T23:18:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.759+0000 7fc503400640 1 -- 172.21.15.144:0/1088550983 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fc4fc0019f0 con 0x7fc50415e640 2024-09-11T23:18:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.759+0000 7fc503400640 1 -- 172.21.15.144:0/1088550983 >> v1:172.21.15.144:6789/0 conn(0x7fc50415e640 legacy=0x7fc5040d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.760+0000 7fc503400640 1 --2- 172.21.15.144:0/1088550983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4e80039b0 0x7fc4e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.760+0000 7fc503400640 1 --2- 172.21.15.144:0/1088550983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4e8004800 0x7fc4e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.760+0000 7fc503400640 1 --2- 172.21.15.144:0/1088550983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc5040b7750 0x7fc4e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.760+0000 7fc503400640 1 -- 172.21.15.144:0/1088550983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc50406caf0 con 0x7fc4e8004800 2024-09-11T23:18:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.760+0000 7fc503400640 1 -- 172.21.15.144:0/1088550983 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e800ba70 con 0x7fc4e80039b0 2024-09-11T23:18:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.760+0000 7fc503400640 1 -- 172.21.15.144:0/1088550983 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc4e800bc70 con 0x7fc5040b7750 2024-09-11T23:18:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.760+0000 7fc503e00640 1 --2- 172.21.15.144:0/1088550983 >> v2:172.21.15.165:3300/0 conn(0x7fc5040b5fd0 0x7fc5040b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:10.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.758+0000 7f74bfa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f74b8163060 0x7f74b80cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.758+0000 7f74bfa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74b80b8ab0 0x7f74b80cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.758+0000 7f74bfa00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74b80d3790 con 0x7f74b80d2300 2024-09-11T23:18:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.758+0000 7f74bfa00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f74b80b7610 con 0x7f74b8163060 2024-09-11T23:18:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.758+0000 7f74bfa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f74b80d3a70 con 0x7f74b80b8ab0 2024-09-11T23:18:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.759+0000 7f74b7e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f74b80d2300 0x7f74b80d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:53278/0 (socket says 172.21.15.144:53278) 2024-09-11T23:18:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.759+0000 7f74b7e00640 1 -- 172.21.15.144:0/2695433894 learned_addr learned my addr 172.21.15.144:0/2695433894 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.759+0000 7f74bd000640 1 --2- 172.21.15.144:0/2695433894 >> v2:172.21.15.165:3300/0 conn(0x7f74b8163060 0x7f74b80cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.759+0000 7f74bda00640 1 --2- 172.21.15.144:0/2695433894 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74b80b8ab0 0x7f74b80cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.760+0000 7f74bd000640 1 -- 172.21.15.144:0/2695433894 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74b80b8ab0 msgr2=0x7f74b80cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.760+0000 7f74bd000640 1 --2- 172.21.15.144:0/2695433894 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74b80b8ab0 0x7f74b80cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.760+0000 7f74b7400640 1 -- 172.21.15.144:0/2695433894 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 123611809 0 0) 0x7f74b80d3790 con 0x7f74b80d2300 2024-09-11T23:18:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.760+0000 7f74bd000640 1 -- 172.21.15.144:0/2695433894 >> v1:172.21.15.165:6789/0 conn(0x7f74b80d2300 legacy=0x7f74b80d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.760+0000 7f74bd000640 1 -- 172.21.15.144:0/2695433894 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b80d3d50 con 0x7f74b8163060 2024-09-11T23:18:10.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.761+0000 7f4146c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f41400b5640 0x7f414015a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.761+0000 7f4146c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41400cd7a0 0x7f41400cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.761+0000 7f4146c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f414015e3c0 con 0x7f414006f030 2024-09-11T23:18:10.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.761+0000 7f4146c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f41400ce130 con 0x7f41400b5640 2024-09-11T23:18:10.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.761+0000 7f4146c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f414015e6a0 con 0x7f41400cd7a0 2024-09-11T23:18:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.761+0000 7fc503e00640 1 --2- 172.21.15.144:0/1088550983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4e8004800 0x7fc4e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.761+0000 7fc509800640 1 --2- 172.21.15.144:0/1088550983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc5040b7750 0x7fc4e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.761+0000 7fc508e00640 1 --2- 172.21.15.144:0/1088550983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4e80039b0 0x7fc4e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.762+0000 7f413f400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f414006f030 0x7f41400cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:53290/0 (socket says 172.21.15.144:53290) 2024-09-11T23:18:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.762+0000 7f413f400640 1 -- 172.21.15.144:0/43016782 learned_addr learned my addr 172.21.15.144:0/43016782 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:10.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.762+0000 7f74bd000640 1 --2- 172.21.15.144:0/2695433894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b8163060 0x7f74b80cef90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f74a80097a0 tx=0x7f74a802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b770e1d84a35db70 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.762+0000 7fc503e00640 1 -- 172.21.15.144:0/1088550983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc5040b7750 msgr2=0x7fc4e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.762+0000 7fc503e00640 1 --2- 172.21.15.144:0/1088550983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc5040b7750 0x7fc4e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.762+0000 7fc503e00640 1 -- 172.21.15.144:0/1088550983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4e80039b0 msgr2=0x7fc4e8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.762+0000 7fc503e00640 1 --2- 172.21.15.144:0/1088550983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4e80039b0 0x7fc4e8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.762+0000 7fc503e00640 1 -- 172.21.15.144:0/1088550983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50406c1c0 con 0x7fc4e8004800 2024-09-11T23:18:10.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.762+0000 7f413fe00640 1 --2- 172.21.15.144:0/43016782 >> v2:172.21.15.144:3300/0 conn(0x7f41400b5640 0x7f414015a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.762+0000 7fc509800640 1 --2- 172.21.15.144:0/1088550983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc5040b7750 0x7fc4e80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.763+0000 7f74b7400640 1 -- 172.21.15.144:0/2695433894 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8037070 con 0x7f74b8163060 2024-09-11T23:18:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.763+0000 7f413ea00640 1 -- 172.21.15.144:0/43016782 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2414834544 0 0) 0x7f414015e3c0 con 0x7f414006f030 2024-09-11T23:18:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.763+0000 7f413ea00640 1 -- 172.21.15.144:0/43016782 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4124003520 con 0x7f414006f030 2024-09-11T23:18:10.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.763+0000 7f4144c00640 1 --2- 172.21.15.144:0/43016782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41400cd7a0 0x7f41400cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.763+0000 7f74b7400640 1 -- 172.21.15.144:0/2695433894 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a8032440 con 0x7f74b8163060 2024-09-11T23:18:10.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.763+0000 7f74b7400640 1 -- 172.21.15.144:0/2695433894 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8032810 con 0x7f74b8163060 2024-09-11T23:18:10.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.763+0000 7f413ea00640 1 -- 172.21.15.144:0/43016782 <== mon.1 v1:172.21.15.165:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3950953919 0 0) 0x7f4124003520 con 0x7f414006f030 2024-09-11T23:18:10.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.763+0000 7f413ea00640 1 -- 172.21.15.144:0/43016782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41400cd7a0 msgr2=0x7f41400cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.763+0000 7f413ea00640 1 --2- 172.21.15.144:0/43016782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41400cd7a0 0x7f41400cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.764+0000 7f413ea00640 1 -- 172.21.15.144:0/43016782 >> v2:172.21.15.144:3300/0 conn(0x7f41400b5640 msgr2=0x7f414015a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.764+0000 7f413ea00640 1 --2- 172.21.15.144:0/43016782 >> v2:172.21.15.144:3300/0 conn(0x7f41400b5640 0x7f414015a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.764+0000 7f413ea00640 1 -- 172.21.15.144:0/43016782 --> v1:172.21.15.165:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414015e980 con 0x7f414006f030 2024-09-11T23:18:10.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.764+0000 7f413ea00640 1 -- 172.21.15.144:0/43016782 <== mon.1 v1:172.21.15.165:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f412c001670 con 0x7f414006f030 2024-09-11T23:18:10.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.764+0000 7f4144c00640 1 --2- 172.21.15.144:0/43016782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41400cd7a0 0x7f41400cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:10.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.764+0000 7f413ea00640 1 -- 172.21.15.144:0/43016782 >> v1:172.21.15.165:6789/0 conn(0x7f414006f030 legacy=0x7f41400cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.764+0000 7fc503e00640 1 --2- 172.21.15.144:0/1088550983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4e8004800 0x7fc4e8004c80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00aca0 tx=0x7fc4e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118d2f37d1f9a1d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.764+0000 7f413ea00640 1 --2- 172.21.15.144:0/43016782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41240039b0 0x7f4124003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.765+0000 7f413ea00640 1 --2- 172.21.15.144:0/43016782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4124004800 0x7f4124004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.765+0000 7f413ea00640 1 --2- 172.21.15.144:0/43016782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41400cd7a0 0x7f41240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.765+0000 7f413ea00640 1 -- 172.21.15.144:0/43016782 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f41400ce130 con 0x7f4124004800 2024-09-11T23:18:10.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.765+0000 7f413ea00640 1 -- 172.21.15.144:0/43016782 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f414015e6a0 con 0x7f41240039b0 2024-09-11T23:18:10.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.765+0000 7f413ea00640 1 -- 172.21.15.144:0/43016782 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f412400ba80 con 0x7f41400cd7a0 2024-09-11T23:18:10.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.765+0000 7f413fe00640 1 --2- 172.21.15.144:0/43016782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41240039b0 0x7f4124003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.765+0000 7f74bfa00640 1 -- 172.21.15.144:0/2695433894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b8163060 msgr2=0x7f74b80cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.765+0000 7f74bfa00640 1 --2- 172.21.15.144:0/2695433894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b8163060 0x7f74b80cef90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f74a80097a0 tx=0x7f74a802a180 comp rx=0 tx=0).stop 2024-09-11T23:18:10.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.765+0000 7fc503400640 1 -- 172.21.15.144:0/1088550983 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec00a640 con 0x7fc4e8004800 2024-09-11T23:18:10.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.765+0000 7f413f400640 1 --2- 172.21.15.144:0/43016782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4124004800 0x7f4124004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.766+0000 7fc503400640 1 -- 172.21.15.144:0/1088550983 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4ec004020 con 0x7fc4e8004800 2024-09-11T23:18:10.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.766+0000 7fc503400640 1 -- 172.21.15.144:0/1088550983 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0044b0 con 0x7fc4e8004800 2024-09-11T23:18:10.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.766+0000 7f4144c00640 1 --2- 172.21.15.144:0/43016782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41400cd7a0 0x7f41240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.766+0000 7f4144c00640 1 -- 172.21.15.144:0/43016782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41240039b0 msgr2=0x7f4124003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.766+0000 7f4144c00640 1 --2- 172.21.15.144:0/43016782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41240039b0 0x7f4124003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.766+0000 7f4144c00640 1 -- 172.21.15.144:0/43016782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4124004800 msgr2=0x7f4124004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.766+0000 7f4144c00640 1 --2- 172.21.15.144:0/43016782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4124004800 0x7f4124004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.766+0000 7f4144c00640 1 -- 172.21.15.144:0/43016782 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4124003520 con 0x7f41400cd7a0 2024-09-11T23:18:10.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.767+0000 7fc50a200640 1 -- 172.21.15.144:0/1088550983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4e8004800 msgr2=0x7fc4e8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.767+0000 7fc50a200640 1 --2- 172.21.15.144:0/1088550983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4e8004800 0x7fc4e8004c80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00aca0 tx=0x7fc4e8005830 comp rx=0 tx=0).stop 2024-09-11T23:18:10.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.767+0000 7fc509800640 1 -- 172.21.15.144:0/1088550983 reap_dead start 2024-09-11T23:18:10.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.767+0000 7fc50a200640 1 -- 172.21.15.144:0/1088550983 shutdown_connections 2024-09-11T23:18:10.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.767+0000 7fc50a200640 1 -- 172.21.15.144:0/1088550983 >> 172.21.15.144:0/1088550983 conn(0x7fc5040d0fd0 msgr2=0x7fc5040d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.767+0000 7f74bfa00640 1 -- 172.21.15.144:0/2695433894 shutdown_connections 2024-09-11T23:18:10.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.767+0000 7f74bfa00640 1 --2- 172.21.15.144:0/2695433894 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74b80b8ab0 0x7f74b80cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.767+0000 7f74bfa00640 1 --2- 172.21.15.144:0/2695433894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b8163060 0x7f74b80cef90 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f74a80097a0 tx=0x7f74a802a180 comp rx=0 tx=0).stop 2024-09-11T23:18:10.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.767+0000 7f74bfa00640 1 -- 172.21.15.144:0/2695433894 >> 172.21.15.144:0/2695433894 conn(0x7f74b80b6240 msgr2=0x7f74b80b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.767+0000 7fc50a200640 1 -- 172.21.15.144:0/1088550983 shutdown_connections 2024-09-11T23:18:10.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.768+0000 7fc50a200640 1 -- 172.21.15.144:0/1088550983 wait complete. 2024-09-11T23:18:10.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.768+0000 7f4144c00640 1 --2- 172.21.15.144:0/43016782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41400cd7a0 0x7f41240051c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f41380073e0 tx=0x7f4124005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b67eeedf34f0337e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.768+0000 7f74bfa00640 1 -- 172.21.15.144:0/2695433894 shutdown_connections 2024-09-11T23:18:10.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.768+0000 7f6f73800640 1 Processor -- start 2024-09-11T23:18:10.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.768+0000 7f413ea00640 1 -- 172.21.15.144:0/43016782 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4138009c80 con 0x7f41400cd7a0 2024-09-11T23:18:10.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.768+0000 7f413ea00640 1 -- 172.21.15.144:0/43016782 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f413802c680 con 0x7f41400cd7a0 2024-09-11T23:18:10.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.768+0000 7f413ea00640 1 -- 172.21.15.144:0/43016782 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413802ca30 con 0x7f41400cd7a0 2024-09-11T23:18:10.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.768+0000 7f6f73800640 1 -- start start 2024-09-11T23:18:10.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.769+0000 7f74bfa00640 1 -- 172.21.15.144:0/2695433894 wait complete. 2024-09-11T23:18:10.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.770+0000 7f4146c00640 1 -- 172.21.15.144:0/43016782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41400cd7a0 msgr2=0x7f41240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.770+0000 7f4146c00640 1 --2- 172.21.15.144:0/43016782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41400cd7a0 0x7f41240051c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f41380073e0 tx=0x7f4124005830 comp rx=0 tx=0).stop 2024-09-11T23:18:10.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.770+0000 7f4144c00640 1 -- 172.21.15.144:0/43016782 reap_dead start 2024-09-11T23:18:10.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.770+0000 7fc50a200640 1 Processor -- start 2024-09-11T23:18:10.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.770+0000 7f4146c00640 1 -- 172.21.15.144:0/43016782 shutdown_connections 2024-09-11T23:18:10.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.770+0000 7f4146c00640 1 -- 172.21.15.144:0/43016782 >> 172.21.15.144:0/43016782 conn(0x7f4140062cc0 msgr2=0x7f414006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.771+0000 7fc50a200640 1 -- start start 2024-09-11T23:18:10.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.771+0000 7f4146c00640 1 -- 172.21.15.144:0/43016782 shutdown_connections 2024-09-11T23:18:10.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.771+0000 7f6f73800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6f6c15e940 0x7f6f6c0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.771+0000 7f74bfa00640 1 Processor -- start 2024-09-11T23:18:10.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.772+0000 7f6f73800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f6c0b7170 con 0x7f6f6c15ed20 2024-09-11T23:18:10.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.772+0000 7fc50a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4e8004800 0x7fc5041f8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.772+0000 7fc50a200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5040ccec0 0x7fc504156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.772+0000 7fc50a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc50415b090 0x7fc50415b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.772+0000 7fc50a200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc50406c780 con 0x7fc50415b090 2024-09-11T23:18:10.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.772+0000 7fc50a200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc5040b6950 con 0x7fc5040ccec0 2024-09-11T23:18:10.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.772+0000 7fc50a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc5040d4130 con 0x7fc4e8004800 2024-09-11T23:18:10.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.772+0000 7f6f70e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6f6c15e940 0x7f6f6c0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.771+0000 7f4146c00640 1 -- 172.21.15.144:0/43016782 wait complete. 2024-09-11T23:18:10.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.771+0000 7f74bfa00640 1 -- start start 2024-09-11T23:18:10.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.773+0000 7f6f71800640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f6f6c0cef90 0x7f6f6c0b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:53296/0 (socket says 172.21.15.144:53296) 2024-09-11T23:18:10.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.773+0000 7f6f71800640 1 -- 172.21.15.144:0/1725100466 learned_addr learned my addr 172.21.15.144:0/1725100466 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:10.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.773+0000 7fc508e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4e8004800 0x7fc5041f8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.773+0000 7fc508e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4e8004800 0x7fc5041f8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50258/0 (socket says 172.21.15.144:50258) 2024-09-11T23:18:10.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.773+0000 7fc508e00640 1 -- 172.21.15.144:0/4083129427 learned_addr learned my addr 172.21.15.144:0/4083129427 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:10.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.773+0000 7fc509800640 1 --2- 172.21.15.144:0/4083129427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc50415b090 0x7fc50415b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.773+0000 7f74bfa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74b80b8ab0 0x7f74b815a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.773+0000 7f74bfa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b80d2300 0x7f74b8156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.773+0000 7f74bfa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74b80cadb0 0x7f74b815c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.773+0000 7f74bfa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f74b80d31f0 con 0x7f74b80cadb0 2024-09-11T23:18:10.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.773+0000 7f74bfa00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f74b80b3ea0 con 0x7f74b80d2300 2024-09-11T23:18:10.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.773+0000 7fc503e00640 1 --2- 172.21.15.144:0/4083129427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5040ccec0 0x7fc504156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.773+0000 7f74bfa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f74b80d3370 con 0x7f74b80b8ab0 2024-09-11T23:18:10.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.774+0000 7f74b7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b80d2300 0x7f74b8156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.774+0000 7f74bd000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74b80b8ab0 0x7f74b815a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.774+0000 7f74bd000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74b80b8ab0 0x7f74b815a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50264/0 (socket says 172.21.15.144:50264) 2024-09-11T23:18:10.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.774+0000 7f74b7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b80d2300 0x7f74b8156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:50630/0 (socket says 172.21.15.144:50630) 2024-09-11T23:18:10.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.774+0000 7f74bd000640 1 -- 172.21.15.144:0/2019276549 learned_addr learned my addr 172.21.15.144:0/2019276549 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:10.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.774+0000 7f6f73800640 1 -- 172.21.15.144:0/1725100466 --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f6c0b7aa0 con 0x7f6f6c0cef90 2024-09-11T23:18:10.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.774+0000 7f6f73800640 1 -- 172.21.15.144:0/1725100466 --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6f6c0d3660 con 0x7f6f6c15e940 2024-09-11T23:18:10.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.774+0000 7f74bda00640 1 --2- 172.21.15.144:0/2019276549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74b80cadb0 0x7f74b815c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.774+0000 7f74b7e00640 1 -- 172.21.15.144:0/2019276549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74b80b8ab0 msgr2=0x7f74b815a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.774+0000 7fc503e00640 1 -- 172.21.15.144:0/4083129427 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4e8004800 msgr2=0x7fc5041f8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.774+0000 7fc503e00640 1 --2- 172.21.15.144:0/4083129427 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4e8004800 0x7fc5041f8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.774+0000 7fc503e00640 1 -- 172.21.15.144:0/4083129427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc50415b090 msgr2=0x7fc50415b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.775+0000 7f6f70e00640 1 -- 172.21.15.144:0/1725100466 >> v1:172.21.15.165:6789/0 conn(0x7f6f6c0cef90 legacy=0x7f6f6c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.774+0000 7f74b7e00640 1 --2- 172.21.15.144:0/2019276549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74b80b8ab0 0x7f74b815a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.774+0000 7f74b7e00640 1 -- 172.21.15.144:0/2019276549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74b80cadb0 msgr2=0x7f74b815c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.775+0000 7f74b7e00640 1 --2- 172.21.15.144:0/2019276549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74b80cadb0 0x7f74b815c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.775+0000 7f74b7e00640 1 -- 172.21.15.144:0/2019276549 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b815d0d0 con 0x7f74b80d2300 2024-09-11T23:18:10.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.775+0000 7f6f6b400640 1 -- 172.21.15.144:0/1725100466 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 270423279 0 0) 0x7f6f6c0b7aa0 con 0x7f6f6c0cef90 2024-09-11T23:18:10.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.775+0000 7f6f70e00640 1 -- 172.21.15.144:0/1725100466 >> v1:172.21.15.144:6789/0 conn(0x7f6f6c15ed20 legacy=0x7f6f6c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.775+0000 7f6f70e00640 1 -- 172.21.15.144:0/1725100466 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6c0d3940 con 0x7f6f6c15e940 2024-09-11T23:18:10.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.775+0000 7f74b7e00640 1 --2- 172.21.15.144:0/2019276549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b80d2300 0x7f74b8156460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f74a400c440 tx=0x7f74a400c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.775+0000 7f525de00640 1 Processor -- start 2024-09-11T23:18:10.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.776+0000 7f74b4c00640 1 -- 172.21.15.144:0/2019276549 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a40074e0 con 0x7f74b80d2300 2024-09-11T23:18:10.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.776+0000 7f74b4c00640 1 -- 172.21.15.144:0/2019276549 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a40047e0 con 0x7f74b80d2300 2024-09-11T23:18:10.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.776+0000 7f74b4c00640 1 -- 172.21.15.144:0/2019276549 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4004bd0 con 0x7f74b80d2300 2024-09-11T23:18:10.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.776+0000 7f74bfa00640 1 -- 172.21.15.144:0/2019276549 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b815d3b0 con 0x7f74b80d2300 2024-09-11T23:18:10.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.776+0000 7f74bfa00640 1 -- 172.21.15.144:0/2019276549 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b81569a0 con 0x7f74b80d2300 2024-09-11T23:18:10.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.776+0000 7f525de00640 1 -- start start 2024-09-11T23:18:10.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.776+0000 7f3727c00640 1 Processor -- start 2024-09-11T23:18:10.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.776+0000 7f3727c00640 1 -- start start 2024-09-11T23:18:10.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.775+0000 7fc503e00640 1 --2- 172.21.15.144:0/4083129427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc50415b090 0x7fc50415b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.777+0000 7f6f70e00640 1 --2- 172.21.15.144:0/1725100466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f6c15e940 0x7f6f6c0d1060 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6f600097a0 tx=0x7f6f6002a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9628b7c83e0d96e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.775+0000 7fc503e00640 1 -- 172.21.15.144:0/4083129427 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5040cdf80 con 0x7fc5040ccec0 2024-09-11T23:18:10.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.775+0000 7fc508e00640 1 --2- 172.21.15.144:0/4083129427 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4e8004800 0x7fc5041f8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:10.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.775+0000 7fc509800640 1 --2- 172.21.15.144:0/4083129427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc50415b090 0x7fc50415b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:10.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.776+0000 7fc503e00640 1 --2- 172.21.15.144:0/4083129427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5040ccec0 0x7fc504156770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8004760 tx=0x7fc4ec004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.777+0000 7f525de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f525806c070 0x7f525806c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.777+0000 7fc500c00640 1 -- 172.21.15.144:0/4083129427 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec042020 con 0x7fc5040ccec0 2024-09-11T23:18:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.778+0000 7fc500c00640 1 -- 172.21.15.144:0/4083129427 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4ec003df0 con 0x7fc5040ccec0 2024-09-11T23:18:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.778+0000 7fc500c00640 1 -- 172.21.15.144:0/4083129427 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec03e690 con 0x7fc5040ccec0 2024-09-11T23:18:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.778+0000 7f3727c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f37200b5640 0x7f37200cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.778+0000 7f3727c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f372006f030 0x7f37200cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.778+0000 7f6f6b400640 1 -- 172.21.15.144:0/1725100466 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f60037070 con 0x7f6f6c15e940 2024-09-11T23:18:10.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.778+0000 7f6f6b400640 1 -- 172.21.15.144:0/1725100466 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f60032640 con 0x7f6f6c15e940 2024-09-11T23:18:10.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.778+0000 7f6f6b400640 1 -- 172.21.15.144:0/1725100466 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f60032a10 con 0x7f6f6c15e940 2024-09-11T23:18:10.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.778+0000 7f3727c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f372006bba0 0x7f372006c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.778+0000 7f3727c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f372015e0e0 con 0x7f37200b5640 2024-09-11T23:18:10.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.778+0000 7f3727c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f372015e3c0 con 0x7f372006bba0 2024-09-11T23:18:10.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.778+0000 7f3727c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f372015e6a0 con 0x7f372006f030 2024-09-11T23:18:10.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.778+0000 7f3725200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f37200b5640 0x7f37200cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.778+0000 7f7b91c00640 1 Processor -- start 2024-09-11T23:18:10.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.778+0000 7f74bfa00640 1 -- 172.21.15.144:0/2019276549 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7490005290 con 0x7f74b80d2300 2024-09-11T23:18:10.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.779+0000 7f4146c00640 1 Processor -- start 2024-09-11T23:18:10.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.779+0000 7fc50a200640 1 -- 172.21.15.144:0/4083129427 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5040ce260 con 0x7fc5040ccec0 2024-09-11T23:18:10.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.779+0000 7f3725200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f37200b5640 0x7f37200cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49372/0 (socket says 172.21.15.144:49372) 2024-09-11T23:18:10.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.779+0000 7f3725200640 1 -- 172.21.15.144:0/3451092925 learned_addr learned my addr 172.21.15.144:0/3451092925 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:10.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.779+0000 7f3717e00640 1 --2- 172.21.15.144:0/3451092925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f372006f030 0x7f37200cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.779+0000 7f3725c00640 1 --2- 172.21.15.144:0/3451092925 >> v2:172.21.15.165:3300/0 conn(0x7f372006bba0 0x7f372006c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.779+0000 7f4146c00640 1 -- start start 2024-09-11T23:18:10.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.779+0000 7f7b91c00640 1 -- start start 2024-09-11T23:18:10.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.780+0000 7f3717e00640 1 -- 172.21.15.144:0/3451092925 >> v2:172.21.15.165:3300/0 conn(0x7f372006bba0 msgr2=0x7f372006c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.780+0000 7f3717e00640 1 --2- 172.21.15.144:0/3451092925 >> v2:172.21.15.165:3300/0 conn(0x7f372006bba0 0x7f372006c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.780+0000 7f3717e00640 1 -- 172.21.15.144:0/3451092925 >> v2:172.21.15.144:3300/0 conn(0x7f37200b5640 msgr2=0x7f37200cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.778+0000 7f525de00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f525806c9d0 con 0x7f5258161c70 2024-09-11T23:18:10.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.780+0000 7fc50a200640 1 -- 172.21.15.144:0/4083129427 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc504156cb0 con 0x7fc5040ccec0 2024-09-11T23:18:10.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.778+0000 7f525de00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52580d2340 con 0x7f52580b81b0 2024-09-11T23:18:10.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.778+0000 7f525de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5258162050 con 0x7f525806c070 2024-09-11T23:18:10.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.778+0000 7f525d400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f52580b81b0 0x7f52580b8660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:53308/0 (socket says 172.21.15.144:53308) 2024-09-11T23:18:10.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.779+0000 7f525d400640 1 -- 172.21.15.144:0/588100902 learned_addr learned my addr 172.21.15.144:0/588100902 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:10.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.779+0000 7f5257e00640 1 --2- 172.21.15.144:0/588100902 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f525806c070 0x7f525806c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.779+0000 7f5257400640 1 -- 172.21.15.144:0/588100902 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 811782538 0 0) 0x7f52580d2340 con 0x7f52580b81b0 2024-09-11T23:18:10.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.779+0000 7f5257400640 1 -- 172.21.15.144:0/588100902 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f524000bd30 con 0x7f52580b81b0 2024-09-11T23:18:10.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.779+0000 7f5257e00640 1 -- 172.21.15.144:0/588100902 >> v1:172.21.15.165:6789/0 conn(0x7f52580b81b0 legacy=0x7f52580b8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.779+0000 7f5257e00640 1 -- 172.21.15.144:0/588100902 >> v1:172.21.15.144:6789/0 conn(0x7f5258161c70 legacy=0x7f52580d32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.780+0000 7f5257e00640 1 -- 172.21.15.144:0/588100902 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52580d3e50 con 0x7f525806c070 2024-09-11T23:18:10.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.780+0000 7f4146c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41400cd7a0 0x7f41400af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.780+0000 7f4146c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f414014a060 0x7f414014a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.780+0000 7f4146c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f414015af30 0x7f414015b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.780+0000 7f4146c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f41400cdbf0 con 0x7f414014a060 2024-09-11T23:18:10.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.780+0000 7f4146c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f41400cfe60 con 0x7f41400cd7a0 2024-09-11T23:18:10.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.780+0000 7f4146c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f41400cdd70 con 0x7f414015af30 2024-09-11T23:18:10.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.780+0000 7f3717e00640 1 --2- 172.21.15.144:0/3451092925 >> v2:172.21.15.144:3300/0 conn(0x7f37200b5640 0x7f37200cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.780+0000 7f3717e00640 1 -- 172.21.15.144:0/3451092925 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372015e980 con 0x7f372006f030 2024-09-11T23:18:10.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.780+0000 7f3725200640 1 --2- 172.21.15.144:0/3451092925 >> v2:172.21.15.144:3300/0 conn(0x7f37200b5640 0x7f37200cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:10.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.781+0000 7f74b4c00640 1 -- 172.21.15.144:0/2019276549 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f74a4011070 con 0x7f74b80d2300 2024-09-11T23:18:10.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.781+0000 7f6f73800640 1 -- 172.21.15.144:0/1725100466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f6c15e940 msgr2=0x7f6f6c0d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.781+0000 7f6f73800640 1 --2- 172.21.15.144:0/1725100466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f6c15e940 0x7f6f6c0d1060 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6f600097a0 tx=0x7f6f6002a2c0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.781+0000 7f7b91c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7b8c0b8f90 0x7f7b8c0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.781+0000 7f7b91c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b8c0b7170 con 0x7f7b8c15ed20 2024-09-11T23:18:10.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.781+0000 7f7b91c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b8c0b7aa0 con 0x7f7b8c15e940 2024-09-11T23:18:10.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.781+0000 7f7b91c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7b8c0d3660 con 0x7f7b8c0b8f90 2024-09-11T23:18:10.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.781+0000 7f7b8aa00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f7b8c15e940 0x7f7b8c0d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:53320/0 (socket says 172.21.15.144:53320) 2024-09-11T23:18:10.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.781+0000 7f7b8aa00640 1 -- 172.21.15.144:0/982061129 learned_addr learned my addr 172.21.15.144:0/982061129 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:10.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.782+0000 7f6f73800640 1 -- 172.21.15.144:0/1725100466 shutdown_connections 2024-09-11T23:18:10.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.782+0000 7f6f73800640 1 --2- 172.21.15.144:0/1725100466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f6c15e940 0x7f6f6c0d1060 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.782+0000 7f6f73800640 1 -- 172.21.15.144:0/1725100466 >> 172.21.15.144:0/1725100466 conn(0x7f6f6c0b6240 msgr2=0x7f6f6c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.782+0000 7f7b8b400640 1 --2- 172.21.15.144:0/982061129 >> v2:172.21.15.165:3300/0 conn(0x7f7b8c0b8f90 0x7f7b8c0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.782+0000 7f4144c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f414015af30 0x7f414015b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.782+0000 7f5257e00640 1 --2- 172.21.15.144:0/588100902 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f525806c070 0x7f525806c490 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f524c0097d0 tx=0x7f524c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16341823136b8a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.782+0000 7f74b4c00640 1 --2- 172.21.15.144:0/2019276549 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f749806bf30 0x7f749806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.782+0000 7f6f73800640 1 -- 172.21.15.144:0/1725100466 shutdown_connections 2024-09-11T23:18:10.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.782+0000 7f5257400640 1 -- 172.21.15.144:0/588100902 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c037070 con 0x7f525806c070 2024-09-11T23:18:10.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.782+0000 7f5257400640 1 -- 172.21.15.144:0/588100902 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f524c032440 con 0x7f525806c070 2024-09-11T23:18:10.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.782+0000 7f5257400640 1 -- 172.21.15.144:0/588100902 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c032810 con 0x7f525806c070 2024-09-11T23:18:10.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.782+0000 7f74b4c00640 1 -- 172.21.15.144:0/2019276549 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f74a408a8c0 con 0x7f74b80d2300 2024-09-11T23:18:10.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.783+0000 7fc4fa000640 1 -- 172.21.15.144:0/4083129427 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4d4005290 con 0x7fc5040ccec0 2024-09-11T23:18:10.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.782+0000 7f7b8b400640 1 -- 172.21.15.144:0/982061129 >> v1:172.21.15.165:6789/0 conn(0x7f7b8c15e940 legacy=0x7f7b8c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.783+0000 7f74bd000640 1 --2- 172.21.15.144:0/2019276549 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f749806bf30 0x7f749806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.783+0000 7f413fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41400cd7a0 0x7f41400af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.783+0000 7f525de00640 1 -- 172.21.15.144:0/588100902 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f525806c070 msgr2=0x7f525806c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.783+0000 7f525de00640 1 --2- 172.21.15.144:0/588100902 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f525806c070 0x7f525806c490 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f524c0097d0 tx=0x7f524c02a210 comp rx=0 tx=0).stop 2024-09-11T23:18:10.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.783+0000 7f7b8b400640 1 -- 172.21.15.144:0/982061129 >> v1:172.21.15.144:6789/0 conn(0x7f7b8c15ed20 legacy=0x7f7b8c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.783+0000 7f7b8b400640 1 -- 172.21.15.144:0/982061129 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b8c0d3940 con 0x7f7b8c0b8f90 2024-09-11T23:18:10.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.783+0000 7f525de00640 1 -- 172.21.15.144:0/588100902 shutdown_connections 2024-09-11T23:18:10.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.783+0000 7f525de00640 1 --2- 172.21.15.144:0/588100902 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f525806c070 0x7f525806c490 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.783+0000 7f525de00640 1 -- 172.21.15.144:0/588100902 >> 172.21.15.144:0/588100902 conn(0x7f5258062a20 msgr2=0x7f5258062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.783+0000 7f3717e00640 1 --2- 172.21.15.144:0/3451092925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f372006f030 0x7f37200cdce0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f37200b37f0 tx=0x7f370802c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=837365fe8c8f0972 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.784+0000 7f525de00640 1 -- 172.21.15.144:0/588100902 shutdown_connections 2024-09-11T23:18:10.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.784+0000 7f525de00640 1 -- 172.21.15.144:0/588100902 wait complete. 2024-09-11T23:18:10.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.784+0000 7fc500c00640 1 -- 172.21.15.144:0/4083129427 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc4ec045020 con 0x7fc5040ccec0 2024-09-11T23:18:10.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.784+0000 7f413fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41400cd7a0 0x7f41400af930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:50656/0 (socket says 172.21.15.144:50656) 2024-09-11T23:18:10.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.784+0000 7f413fe00640 1 -- 172.21.15.144:0/3532346247 learned_addr learned my addr 172.21.15.144:0/3532346247 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:10.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.784+0000 7f413f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f414014a060 0x7f414014a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.784+0000 7f371fe00640 1 -- 172.21.15.144:0/3451092925 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3708039070 con 0x7f372006f030 2024-09-11T23:18:10.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.782+0000 7f6f73800640 1 -- 172.21.15.144:0/1725100466 wait complete. 2024-09-11T23:18:10.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.784+0000 7f74bd000640 1 --2- 172.21.15.144:0/2019276549 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f749806bf30 0x7f749806e3f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f74a80097a0 tx=0x7f74a802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.784+0000 7f371fe00640 1 -- 172.21.15.144:0/3451092925 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3708034640 con 0x7f372006f030 2024-09-11T23:18:10.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.785+0000 7f371fe00640 1 -- 172.21.15.144:0/3451092925 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3708034a10 con 0x7f372006f030 2024-09-11T23:18:10.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.785+0000 7f6f73800640 1 Processor -- start 2024-09-11T23:18:10.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.785+0000 7f413fe00640 1 -- 172.21.15.144:0/3532346247 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f414015af30 msgr2=0x7f414015b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.785+0000 7f413fe00640 1 --2- 172.21.15.144:0/3532346247 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f414015af30 0x7f414015b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.785+0000 7f413fe00640 1 -- 172.21.15.144:0/3532346247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f414014a060 msgr2=0x7f414014a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.785+0000 7f413fe00640 1 --2- 172.21.15.144:0/3532346247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f414014a060 0x7f414014a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.785+0000 7f7b8b400640 1 --2- 172.21.15.144:0/982061129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b8c0b8f90 0x7f7b8c0b3930 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0097a0 tx=0x7f7b7c02a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=868bf15b80f7ec81 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.785+0000 7f6f73800640 1 -- start start 2024-09-11T23:18:10.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.785+0000 7f413fe00640 1 -- 172.21.15.144:0/3532346247 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41401478e0 con 0x7f41400cd7a0 2024-09-11T23:18:10.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.785+0000 7f413f400640 1 --2- 172.21.15.144:0/3532346247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f414014a060 0x7f414014a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:10.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.785+0000 7f413fe00640 1 --2- 172.21.15.144:0/3532346247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41400cd7a0 0x7f41400af930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f413000b850 tx=0x7f413000bd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.786+0000 7fc500c00640 1 --2- 172.21.15.144:0/4083129427 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc4e006beb0 0x7fc4e006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.786+0000 7f3727c00640 1 -- 172.21.15.144:0/3451092925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f372006f030 msgr2=0x7f37200cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.786+0000 7f3727c00640 1 --2- 172.21.15.144:0/3451092925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f372006f030 0x7f37200cdce0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f37200b37f0 tx=0x7f370802c320 comp rx=0 tx=0).stop 2024-09-11T23:18:10.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.786+0000 7fc508e00640 1 --2- 172.21.15.144:0/4083129427 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc4e006beb0 0x7fc4e006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.786+0000 7f3727c00640 1 -- 172.21.15.144:0/3451092925 shutdown_connections 2024-09-11T23:18:10.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.786+0000 7f3727c00640 1 --2- 172.21.15.144:0/3451092925 >> v2:172.21.15.165:3300/0 conn(0x7f372006bba0 0x7f372006c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.786+0000 7f3727c00640 1 --2- 172.21.15.144:0/3451092925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f372006f030 0x7f37200cdce0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.786+0000 7f3727c00640 1 --2- 172.21.15.144:0/3451092925 >> v2:172.21.15.144:3300/0 conn(0x7f37200b5640 0x7f37200cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.786+0000 7f3727c00640 1 -- 172.21.15.144:0/3451092925 >> 172.21.15.144:0/3451092925 conn(0x7f3720062cc0 msgr2=0x7f372006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.786+0000 7f525de00640 1 Processor -- start 2024-09-11T23:18:10.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.786+0000 7f3727c00640 1 -- 172.21.15.144:0/3451092925 shutdown_connections 2024-09-11T23:18:10.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.786+0000 7f525de00640 1 -- start start 2024-09-11T23:18:10.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.786+0000 7f3727c00640 1 -- 172.21.15.144:0/3451092925 wait complete. 2024-09-11T23:18:10.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.787+0000 7f6f73800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f6c0cef90 0x7f6f6c157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.787+0000 7f260fe00640 1 Processor -- start 2024-09-11T23:18:10.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.787+0000 7fc508e00640 1 --2- 172.21.15.144:0/4083129427 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc4e006beb0 0x7fc4e006e370 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc001330 tx=0x7fc4fc0018e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.787+0000 7f6f73800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f6c15e940 0x7f6f6c1f5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.787+0000 7f260fe00640 1 -- start start 2024-09-11T23:18:10.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.787+0000 7f6f73800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f6c15ed20 0x7f6f6c159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.787+0000 7fc500c00640 1 -- 172.21.15.144:0/4083129427 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc4ec003fa0 con 0x7fc5040ccec0 2024-09-11T23:18:10.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.787+0000 7f6f73800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6c0d3310 con 0x7f6f6c15ed20 2024-09-11T23:18:10.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.787+0000 7f6f70e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f6c0cef90 0x7f6f6c157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.787+0000 7f6f73800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6c0d3f00 con 0x7f6f6c15e940 2024-09-11T23:18:10.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.787+0000 7f6f70e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f6c0cef90 0x7f6f6c157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50296/0 (socket says 172.21.15.144:50296) 2024-09-11T23:18:10.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f6f70e00640 1 -- 172.21.15.144:0/1926507655 learned_addr learned my addr 172.21.15.144:0/1926507655 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:10.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.787+0000 7f4137e00640 1 -- 172.21.15.144:0/3532346247 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130018070 con 0x7f41400cd7a0 2024-09-11T23:18:10.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f6f73800640 1 -- 172.21.15.144:0/1926507655 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6f6c0d1ef0 con 0x7f6f6c0cef90 2024-09-11T23:18:10.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f4146c00640 1 -- 172.21.15.144:0/3532346247 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4140147bc0 con 0x7f41400cd7a0 2024-09-11T23:18:10.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f525de00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f525806c070 0x7f525815c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f525de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52580b81b0 0x7f52580ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f525de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5258161c70 0x7f52580b96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f525de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f52580b79b0 con 0x7f52580b81b0 2024-09-11T23:18:10.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f525de00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f52580b7d20 con 0x7f525806c070 2024-09-11T23:18:10.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f525de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f52580b75f0 con 0x7f5258161c70 2024-09-11T23:18:10.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f6f6be00640 1 --2- 172.21.15.144:0/1926507655 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f6c15e940 0x7f6f6c1f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f4146c00640 1 -- 172.21.15.144:0/3532346247 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f414015aa10 con 0x7f41400cd7a0 2024-09-11T23:18:10.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f525ca00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f525806c070 0x7f525815c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f5257e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52580b81b0 0x7f52580ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f5257e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52580b81b0 0x7f52580ca690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49404/0 (socket says 172.21.15.144:49404) 2024-09-11T23:18:10.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f5257e00640 1 -- 172.21.15.144:0/1682111797 learned_addr learned my addr 172.21.15.144:0/1682111797 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:10.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f6f70e00640 1 -- 172.21.15.144:0/1926507655 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f6c15e940 msgr2=0x7f6f6c1f5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f6f70e00640 1 --2- 172.21.15.144:0/1926507655 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f6c15e940 0x7f6f6c1f5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f6f70e00640 1 -- 172.21.15.144:0/1926507655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f6c15ed20 msgr2=0x7f6f6c159120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T23:18:10.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f6f71800640 1 --2- 172.21.15.144:0/1926507655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f6c15ed20 0x7f6f6c159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f525d400640 1 --2- 172.21.15.144:0/1682111797 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5258161c70 0x7f52580b96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f6f70e00640 1 --2- 172.21.15.144:0/1926507655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f6c15ed20 0x7f6f6c159120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.788+0000 7f7b89600640 1 -- 172.21.15.144:0/982061129 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c037070 con 0x7f7b8c0b8f90 2024-09-11T23:18:10.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.789+0000 7f260fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f261006c070 0x7f261006c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.789+0000 7f6f70e00640 1 -- 172.21.15.144:0/1926507655 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6c15a5f0 con 0x7f6f6c0cef90 2024-09-11T23:18:10.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.789+0000 7f260fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f26100b81b0 0x7f26100b8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.789+0000 7f260fe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26100d2340 con 0x7f2610161c70 2024-09-11T23:18:10.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.789+0000 7f260fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2610162050 con 0x7f261006c070 2024-09-11T23:18:10.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.789+0000 7f260fe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f261006ca00 con 0x7f26100b81b0 2024-09-11T23:18:10.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.789+0000 7f74b4c00640 1 -- 172.21.15.144:0/2019276549 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f74a4059250 con 0x7f74b80d2300 2024-09-11T23:18:10.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.789+0000 7f260e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f261006c070 0x7f261006c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.789+0000 7f260ea00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f2610161c70 0x7f26100d32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:53324/0 (socket says 172.21.15.144:53324) 2024-09-11T23:18:10.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.789+0000 7f3727c00640 1 Processor -- start 2024-09-11T23:18:10.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.789+0000 7f260e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f261006c070 0x7f261006c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49414/0 (socket says 172.21.15.144:49414) 2024-09-11T23:18:10.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.789+0000 7f260ea00640 1 -- 172.21.15.144:0/3246607668 learned_addr learned my addr 172.21.15.144:0/3246607668 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:10.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.789+0000 7f260f400640 1 --2- 172.21.15.144:0/3246607668 >> v2:172.21.15.165:3300/0 conn(0x7f26100b81b0 0x7f26100b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.789+0000 7f6f70e00640 1 --2- 172.21.15.144:0/1926507655 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f6c0cef90 0x7f6f6c157b70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6f600098c0 tx=0x7f6f600046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.790+0000 7f525ca00640 1 -- 172.21.15.144:0/1682111797 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5258161c70 msgr2=0x7f52580b96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.790+0000 7f3727c00640 1 -- start start 2024-09-11T23:18:10.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.790+0000 7f525ca00640 1 --2- 172.21.15.144:0/1682111797 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5258161c70 0x7f52580b96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.790+0000 7f525ca00640 1 -- 172.21.15.144:0/1682111797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52580b81b0 msgr2=0x7f52580ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.790+0000 7f525ca00640 1 --2- 172.21.15.144:0/1682111797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52580b81b0 0x7f52580ca690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.790+0000 7f6f68c00640 1 -- 172.21.15.144:0/1926507655 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f60037050 con 0x7f6f6c0cef90 2024-09-11T23:18:10.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.790+0000 7f525ca00640 1 -- 172.21.15.144:0/1682111797 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52580cabd0 con 0x7f525806c070 2024-09-11T23:18:10.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.790+0000 7f260e000640 1 -- 172.21.15.144:0/3246607668 >> v2:172.21.15.165:3300/0 conn(0x7f26100b81b0 msgr2=0x7f26100b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:10.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.790+0000 7f260e000640 1 --2- 172.21.15.144:0/3246607668 >> v2:172.21.15.165:3300/0 conn(0x7f26100b81b0 0x7f26100b8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.790+0000 7f260e000640 1 -- 172.21.15.144:0/3246607668 >> v1:172.21.15.165:6789/0 conn(0x7f2610161c70 legacy=0x7f26100d32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.790+0000 7f6f68c00640 1 -- 172.21.15.144:0/1926507655 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f60043070 con 0x7f6f6c0cef90 2024-09-11T23:18:10.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.790+0000 7f6f68c00640 1 -- 172.21.15.144:0/1926507655 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f60030d60 con 0x7f6f6c0cef90 2024-09-11T23:18:10.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.790+0000 7f260e000640 1 -- 172.21.15.144:0/3246607668 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26100d3e50 con 0x7f261006c070 2024-09-11T23:18:10.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.790+0000 7f525d400640 1 --2- 172.21.15.144:0/1682111797 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5258161c70 0x7f52580b96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:10.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.790+0000 7f525ca00640 1 --2- 172.21.15.144:0/1682111797 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f525806c070 0x7f525815c320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f524400c3c0 tx=0x7f524400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.791+0000 7f4146c00640 1 -- 172.21.15.144:0/3532346247 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41400affb0 con 0x7f41400cd7a0 2024-09-11T23:18:10.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.790+0000 7f6f73800640 1 -- 172.21.15.144:0/1926507655 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f6c15a8d0 con 0x7f6f6c0cef90 2024-09-11T23:18:10.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.790+0000 7f6f73800640 1 -- 172.21.15.144:0/1926507655 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f6c158920 con 0x7f6f6c0cef90 2024-09-11T23:18:10.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.791+0000 7f3727c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f372006bba0 0x7f372014ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.791+0000 7f3727c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f372006f030 0x7f3720158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.791+0000 7f3727c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37200b5640 0x7f3720158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.791+0000 7f3727c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f372015a9a0 con 0x7f37200b5640 2024-09-11T23:18:10.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.791+0000 7f3727c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f372015a820 con 0x7f372006bba0 2024-09-11T23:18:10.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.791+0000 7f3727c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f372006c570 con 0x7f372006f030 2024-09-11T23:18:10.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.791+0000 7f3725200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f372006bba0 0x7f372014ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.791+0000 7f3725200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f372006bba0 0x7f372014ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:50680/0 (socket says 172.21.15.144:50680) 2024-09-11T23:18:10.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.791+0000 7f3725200640 1 -- 172.21.15.144:0/3961018332 learned_addr learned my addr 172.21.15.144:0/3961018332 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:10.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.792+0000 7f3717e00640 1 --2- 172.21.15.144:0/3961018332 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f372006f030 0x7f3720158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.792+0000 7f3725c00640 1 --2- 172.21.15.144:0/3961018332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37200b5640 0x7f3720158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.792+0000 7f3725200640 1 -- 172.21.15.144:0/3961018332 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f372006f030 msgr2=0x7f3720158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.792+0000 7f3725200640 1 --2- 172.21.15.144:0/3961018332 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f372006f030 0x7f3720158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.792+0000 7f3725200640 1 -- 172.21.15.144:0/3961018332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37200b5640 msgr2=0x7f3720158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.792+0000 7f3725200640 1 --2- 172.21.15.144:0/3961018332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37200b5640 0x7f3720158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.792+0000 7f3725200640 1 -- 172.21.15.144:0/3961018332 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372014f440 con 0x7f372006bba0 2024-09-11T23:18:10.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.792+0000 7f260e000640 1 --2- 172.21.15.144:0/3246607668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f261006c070 0x7f261006c4c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f261006cfd0 tx=0x7f25fc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d454bdfabdb9c5d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.792+0000 7f6f73800640 1 -- 172.21.15.144:0/1926507655 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f6c0d1060 con 0x7f6f6c0cef90 2024-09-11T23:18:10.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.792+0000 7f3725200640 1 --2- 172.21.15.144:0/3961018332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f372006bba0 0x7f372014ef00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f371000e9b0 tx=0x7f371000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.793+0000 7f260d600640 1 -- 172.21.15.144:0/3246607668 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc037070 con 0x7f261006c070 2024-09-11T23:18:10.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.793+0000 7f260d600640 1 -- 172.21.15.144:0/3246607668 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25fc032440 con 0x7f261006c070 2024-09-11T23:18:10.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.793+0000 7f260d600640 1 -- 172.21.15.144:0/3246607668 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc032810 con 0x7f261006c070 2024-09-11T23:18:10.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.793+0000 7f260fe00640 1 -- 172.21.15.144:0/3246607668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f261006c070 msgr2=0x7f261006c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.793+0000 7f260fe00640 1 --2- 172.21.15.144:0/3246607668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f261006c070 0x7f261006c4c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f261006cfd0 tx=0x7f25fc02a1a0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.794+0000 7f7b89600640 1 -- 172.21.15.144:0/982061129 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7c032640 con 0x7f7b8c0b8f90 2024-09-11T23:18:10.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.794+0000 7f7b89600640 1 -- 172.21.15.144:0/982061129 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c032a10 con 0x7f7b8c0b8f90 2024-09-11T23:18:10.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.794+0000 7f260fe00640 1 -- 172.21.15.144:0/3246607668 shutdown_connections 2024-09-11T23:18:10.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.794+0000 7f260fe00640 1 --2- 172.21.15.144:0/3246607668 >> v2:172.21.15.165:3300/0 conn(0x7f26100b81b0 0x7f26100b8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.794+0000 7f260fe00640 1 --2- 172.21.15.144:0/3246607668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f261006c070 0x7f261006c4c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.794+0000 7f260fe00640 1 -- 172.21.15.144:0/3246607668 >> 172.21.15.144:0/3246607668 conn(0x7f2610062a20 msgr2=0x7f2610062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.794+0000 7f5254c00640 1 -- 172.21.15.144:0/1682111797 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244017070 con 0x7f525806c070 2024-09-11T23:18:10.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.794+0000 7f5254c00640 1 -- 172.21.15.144:0/1682111797 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52440052d0 con 0x7f525806c070 2024-09-11T23:18:10.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.794+0000 7f5254c00640 1 -- 172.21.15.144:0/1682111797 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244003830 con 0x7f525806c070 2024-09-11T23:18:10.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.794+0000 7f4137e00640 1 -- 172.21.15.144:0/3532346247 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f413000be40 con 0x7f41400cd7a0 2024-09-11T23:18:10.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.794+0000 7f4137e00640 1 -- 172.21.15.144:0/3532346247 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130022060 con 0x7f41400cd7a0 2024-09-11T23:18:10.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.794+0000 7f6f68c00640 1 -- 172.21.15.144:0/1926507655 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f60048460 con 0x7f6f6c0cef90 2024-09-11T23:18:10.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.794+0000 7f525de00640 1 -- 172.21.15.144:0/1682111797 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52580ce030 con 0x7f525806c070 2024-09-11T23:18:10.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.794+0000 7f525de00640 1 -- 172.21.15.144:0/1682111797 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52580cc2a0 con 0x7f525806c070 2024-09-11T23:18:10.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.794+0000 7f371d600640 1 -- 172.21.15.144:0/3961018332 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3710017070 con 0x7f372006bba0 2024-09-11T23:18:10.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.794+0000 7fc500c00640 1 -- 172.21.15.144:0/4083129427 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc4ec07a410 con 0x7fc5040ccec0 2024-09-11T23:18:10.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.794+0000 7f260fe00640 1 -- 172.21.15.144:0/3246607668 shutdown_connections 2024-09-11T23:18:10.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.794+0000 7f260fe00640 1 -- 172.21.15.144:0/3246607668 wait complete. 2024-09-11T23:18:10.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.794+0000 7f3727c00640 1 -- 172.21.15.144:0/3961018332 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37201592e0 con 0x7f372006bba0 2024-09-11T23:18:10.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.795+0000 7f6f68c00640 1 --2- 172.21.15.144:0/1926507655 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6f4c06bf00 0x7f6f4c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.796+0000 7f6f68c00640 1 -- 172.21.15.144:0/1926507655 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6f600abd10 con 0x7f6f6c0cef90 2024-09-11T23:18:10.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.796+0000 7f6f6be00640 1 --2- 172.21.15.144:0/1926507655 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6f4c06bf00 0x7f6f4c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.797+0000 7f7b91c00640 1 -- 172.21.15.144:0/982061129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b8c0b8f90 msgr2=0x7f7b8c0b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.797+0000 7f7b91c00640 1 --2- 172.21.15.144:0/982061129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b8c0b8f90 0x7f7b8c0b3930 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0097a0 tx=0x7f7b7c02a2c0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.795+0000 7f3727c00640 1 -- 172.21.15.144:0/3961018332 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f372015acc0 con 0x7f372006bba0 2024-09-11T23:18:10.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.796+0000 7f371d600640 1 -- 172.21.15.144:0/3961018332 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f371000c9a0 con 0x7f372006bba0 2024-09-11T23:18:10.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.796+0000 7f371d600640 1 -- 172.21.15.144:0/3961018332 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371000cd50 con 0x7f372006bba0 2024-09-11T23:18:10.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.797+0000 7f7b91c00640 1 -- 172.21.15.144:0/982061129 shutdown_connections 2024-09-11T23:18:10.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.797+0000 7f7b91c00640 1 --2- 172.21.15.144:0/982061129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b8c0b8f90 0x7f7b8c0b3930 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.797+0000 7f7b91c00640 1 -- 172.21.15.144:0/982061129 >> 172.21.15.144:0/982061129 conn(0x7f7b8c0b6240 msgr2=0x7f7b8c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:10.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.797+0000 7f7b91c00640 1 -- 172.21.15.144:0/982061129 shutdown_connections 2024-09-11T23:18:10.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.798+0000 7f6f6be00640 1 --2- 172.21.15.144:0/1926507655 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6f4c06bf00 0x7f6f4c06e3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6f58007fd0 tx=0x7f6f58009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.798+0000 7f260fe00640 1 Processor -- start 2024-09-11T23:18:10.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.796+0000 7f4137e00640 1 -- 172.21.15.144:0/3532346247 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f413001b070 con 0x7f41400cd7a0 2024-09-11T23:18:10.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.797+0000 7f4137e00640 1 --2- 172.21.15.144:0/3532346247 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f412006be60 0x7f412006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.798+0000 7f4137e00640 1 -- 172.21.15.144:0/3532346247 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f413008b660 con 0x7f41400cd7a0 2024-09-11T23:18:10.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.798+0000 7f7b91c00640 1 -- 172.21.15.144:0/982061129 wait complete. 2024-09-11T23:18:10.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.798+0000 7f525de00640 1 -- 172.21.15.144:0/1682111797 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525806c490 con 0x7f525806c070 2024-09-11T23:18:10.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.798+0000 7f3716000640 1 -- 172.21.15.144:0/3961018332 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36f8005290 con 0x7f372006bba0 2024-09-11T23:18:10.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.798+0000 7f260fe00640 1 -- start start 2024-09-11T23:18:10.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.798+0000 7f413f400640 1 --2- 172.21.15.144:0/3532346247 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f412006be60 0x7f412006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.799+0000 7f413f400640 1 --2- 172.21.15.144:0/3532346247 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f412006be60 0x7f412006e320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f412c000fb0 tx=0x7f412c001d40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.799+0000 7f260fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f261006c070 0x7f26101569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.799+0000 7f4137e00640 1 -- 172.21.15.144:0/3532346247 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41300599a0 con 0x7f41400cd7a0 2024-09-11T23:18:10.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.801+0000 7f6f68c00640 1 -- 172.21.15.144:0/1926507655 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f6007a730 con 0x7f6f6c0cef90 2024-09-11T23:18:10.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.802+0000 7f5254c00640 1 -- 172.21.15.144:0/1682111797 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f524401a070 con 0x7f525806c070 2024-09-11T23:18:10.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.799+0000 7f260fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26100b81b0 0x7f26100b3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.799+0000 7f260fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2610161c70 0x7f26100aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.799+0000 7f260fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f26100b79b0 con 0x7f261006c070 2024-09-11T23:18:10.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.799+0000 7f260fe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f26100b7d20 con 0x7f2610161c70 2024-09-11T23:18:10.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.799+0000 7f260fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f26100b75f0 con 0x7f26100b81b0 2024-09-11T23:18:10.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.800+0000 7f260f400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2610161c70 0x7f26100aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.800+0000 7f260f400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2610161c70 0x7f26100aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:50692/0 (socket says 172.21.15.144:50692) 2024-09-11T23:18:10.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.800+0000 7f260f400640 1 -- 172.21.15.144:0/3095664170 learned_addr learned my addr 172.21.15.144:0/3095664170 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:10.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.801+0000 7f260f400640 1 -- 172.21.15.144:0/3095664170 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26100b81b0 msgr2=0x7f26100b3890 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T23:18:10.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.801+0000 7f260f400640 1 --2- 172.21.15.144:0/3095664170 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26100b81b0 0x7f26100b3890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.801+0000 7f260f400640 1 -- 172.21.15.144:0/3095664170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f261006c070 msgr2=0x7f26101569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.801+0000 7f260f400640 1 --2- 172.21.15.144:0/3095664170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f261006c070 0x7f26101569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.801+0000 7f260f400640 1 -- 172.21.15.144:0/3095664170 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2610156f00 con 0x7f2610161c70 2024-09-11T23:18:10.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.801+0000 7f260f400640 1 --2- 172.21.15.144:0/3095664170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2610161c70 0x7f26100aeb10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2608007e40 tx=0x7f260800e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.801+0000 7f7b91c00640 1 Processor -- start 2024-09-11T23:18:10.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.802+0000 7f7b91c00640 1 -- start start 2024-09-11T23:18:10.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.802+0000 7f371d600640 1 -- 172.21.15.144:0/3961018332 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f371001a070 con 0x7f372006bba0 2024-09-11T23:18:10.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.803+0000 7f7b91c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b8c0b8f90 0x7f7b8c0cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.803+0000 7f7b91c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b8c15e940 0x7f7b8c14e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.803+0000 7f7b91c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b8c15ed20 0x7f7b8c0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.804+0000 7f7b91c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8c0d3310 con 0x7f7b8c15e940 2024-09-11T23:18:10.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.804+0000 7f7b91c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8c0d3f00 con 0x7f7b8c0b8f90 2024-09-11T23:18:10.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.804+0000 7f7b91c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7b8c0d1ef0 con 0x7f7b8c15ed20 2024-09-11T23:18:10.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.803+0000 7f5254c00640 1 --2- 172.21.15.144:0/1682111797 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f523806be30 0x7f523806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.803+0000 7f5254c00640 1 -- 172.21.15.144:0/1682111797 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f524408a280 con 0x7f525806c070 2024-09-11T23:18:10.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.804+0000 7f7b8aa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b8c0b8f90 0x7f7b8c0cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.804+0000 7f7b8a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b8c15e940 0x7f7b8c14e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.804+0000 7f7b8b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b8c15ed20 0x7f7b8c0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.804+0000 7f7b8aa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b8c0b8f90 0x7f7b8c0cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:50694/0 (socket says 172.21.15.144:50694) 2024-09-11T23:18:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.804+0000 7f7b8aa00640 1 -- 172.21.15.144:0/509404320 learned_addr learned my addr 172.21.15.144:0/509404320 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.804+0000 7f5257e00640 1 --2- 172.21.15.144:0/1682111797 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f523806be30 0x7f523806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.804+0000 7f7b8b400640 1 -- 172.21.15.144:0/509404320 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b8c0b8f90 msgr2=0x7f7b8c0cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.804+0000 7f7b8b400640 1 --2- 172.21.15.144:0/509404320 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b8c0b8f90 0x7f7b8c0cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.804+0000 7f7b8b400640 1 -- 172.21.15.144:0/509404320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b8c15e940 msgr2=0x7f7b8c14e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:10.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.805+0000 7f7b8b400640 1 --2- 172.21.15.144:0/509404320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b8c15e940 0x7f7b8c14e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:10.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.805+0000 7f7b8b400640 1 -- 172.21.15.144:0/509404320 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b8c0ca3c0 con 0x7f7b8c15ed20 2024-09-11T23:18:10.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.805+0000 7f7b8a000640 1 --2- 172.21.15.144:0/509404320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b8c15e940 0x7f7b8c14e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:10.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.805+0000 7f7b8b400640 1 --2- 172.21.15.144:0/509404320 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b8c15ed20 0x7f7b8c0c8260 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c031000 tx=0x7f7b7c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.805+0000 7f371d600640 1 --2- 172.21.15.144:0/3961018332 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f36fc06be30 0x7f36fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.805+0000 7f5257e00640 1 --2- 172.21.15.144:0/1682111797 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f523806be30 0x7f523806e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f524c02a250 tx=0x7f524c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.805+0000 7f7b82a00640 1 -- 172.21.15.144:0/509404320 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c037040 con 0x7f7b8c15ed20 2024-09-11T23:18:10.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.806+0000 7f7b82a00640 1 -- 172.21.15.144:0/509404320 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7c0306f0 con 0x7f7b8c15ed20 2024-09-11T23:18:10.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.806+0000 7f7b82a00640 1 -- 172.21.15.144:0/509404320 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c030b00 con 0x7f7b8c15ed20 2024-09-11T23:18:10.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.806+0000 7f7b91c00640 1 -- 172.21.15.144:0/509404320 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b8c0ca6a0 con 0x7f7b8c15ed20 2024-09-11T23:18:10.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.806+0000 7f7b91c00640 1 -- 172.21.15.144:0/509404320 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b8c0cac60 con 0x7f7b8c15ed20 2024-09-11T23:18:10.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.806+0000 7f3717e00640 1 --2- 172.21.15.144:0/3961018332 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f36fc06be30 0x7f36fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.806+0000 7f371d600640 1 -- 172.21.15.144:0/3961018332 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f371008b010 con 0x7f372006bba0 2024-09-11T23:18:10.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.807+0000 7f3717e00640 1 --2- 172.21.15.144:0/3961018332 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f36fc06be30 0x7f36fc06e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3708036000 tx=0x7f3708030000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.807+0000 7f5254c00640 1 -- 172.21.15.144:0/1682111797 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5244021080 con 0x7f525806c070 2024-09-11T23:18:10.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.807+0000 7f7b91c00640 1 -- 172.21.15.144:0/509404320 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b8c0cef90 con 0x7f7b8c15ed20 2024-09-11T23:18:10.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.809+0000 7f7b82a00640 1 -- 172.21.15.144:0/509404320 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b7c044020 con 0x7f7b8c15ed20 2024-09-11T23:18:10.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.809+0000 7f2607400640 1 -- 172.21.15.144:0/3095664170 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2608014620 con 0x7f2610161c70 2024-09-11T23:18:10.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.809+0000 7f2607400640 1 -- 172.21.15.144:0/3095664170 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2608019070 con 0x7f2610161c70 2024-09-11T23:18:10.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.809+0000 7f260fe00640 1 -- 172.21.15.144:0/3095664170 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26101f7ad0 con 0x7f2610161c70 2024-09-11T23:18:10.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.810+0000 7f2607400640 1 -- 172.21.15.144:0/3095664170 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26080149c0 con 0x7f2610161c70 2024-09-11T23:18:10.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.810+0000 7f260fe00640 1 -- 172.21.15.144:0/3095664170 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26101f8090 con 0x7f2610161c70 2024-09-11T23:18:10.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.811+0000 7f7b82a00640 1 --2- 172.21.15.144:0/509404320 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7b6c06be30 0x7f7b6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.811+0000 7f7b82a00640 1 -- 172.21.15.144:0/509404320 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7b7c0ab0e0 con 0x7f7b8c15ed20 2024-09-11T23:18:10.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.812+0000 7f371d600640 1 -- 172.21.15.144:0/3961018332 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f372014f440 con 0x7f372006bba0 2024-09-11T23:18:10.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.812+0000 7f7b8aa00640 1 --2- 172.21.15.144:0/509404320 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7b6c06be30 0x7f7b6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.812+0000 7f2607400640 1 -- 172.21.15.144:0/3095664170 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2608014b60 con 0x7f2610161c70 2024-09-11T23:18:10.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.813+0000 7f260fe00640 1 -- 172.21.15.144:0/3095664170 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f261006c4c0 con 0x7f2610161c70 2024-09-11T23:18:10.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.814+0000 7f7b8aa00640 1 --2- 172.21.15.144:0/509404320 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7b6c06be30 0x7f7b6c06e2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7b84005c00 tx=0x7f7b84009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.814+0000 7f2607400640 1 --2- 172.21.15.144:0/3095664170 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f25f006be80 0x7f25f006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:10.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.814+0000 7f2607400640 1 -- 172.21.15.144:0/3095664170 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f260808b7b0 con 0x7f2610161c70 2024-09-11T23:18:10.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.815+0000 7f260ea00640 1 --2- 172.21.15.144:0/3095664170 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f25f006be80 0x7f25f006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:10.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.815+0000 7f7b82a00640 1 -- 172.21.15.144:0/509404320 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b7c079440 con 0x7f7b8c15ed20 2024-09-11T23:18:10.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.815+0000 7f260ea00640 1 --2- 172.21.15.144:0/3095664170 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f25f006be80 0x7f25f006e340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2600000f60 tx=0x7f2600007a80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:10.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:10.819+0000 7f2607400640 1 -- 172.21.15.144:0/3095664170 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f260805a140 con 0x7f2610161c70 2024-09-11T23:18:11.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.200+0000 7f74bfa00640 1 -- 172.21.15.144:0/2019276549 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7490005580 con 0x7f74b80d2300 2024-09-11T23:18:11.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.201+0000 7f74b4c00640 1 -- 172.21.15.144:0/2019276549 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f74a4058b50 con 0x7f74b80d2300 2024-09-11T23:18:11.201 INFO:teuthology.orchestra.run.smithi144.stdout:60129542150 2024-09-11T23:18:11.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.204+0000 7f74bfa00640 1 -- 172.21.15.144:0/2019276549 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f749806bf30 msgr2=0x7f749806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.204+0000 7f74bfa00640 1 --2- 172.21.15.144:0/2019276549 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f749806bf30 0x7f749806e3f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f74a80097a0 tx=0x7f74a802e000 comp rx=0 tx=0).stop 2024-09-11T23:18:11.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.205+0000 7f74bfa00640 1 -- 172.21.15.144:0/2019276549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b80d2300 msgr2=0x7f74b8156460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.205+0000 7f74bfa00640 1 --2- 172.21.15.144:0/2019276549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b80d2300 0x7f74b8156460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f74a400c440 tx=0x7f74a400c900 comp rx=0 tx=0).stop 2024-09-11T23:18:11.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.206+0000 7f74bfa00640 1 -- 172.21.15.144:0/2019276549 shutdown_connections 2024-09-11T23:18:11.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.206+0000 7f74bfa00640 1 --2- 172.21.15.144:0/2019276549 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f749806bf30 0x7f749806e3f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.206+0000 7f74bfa00640 1 --2- 172.21.15.144:0/2019276549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74b80cadb0 0x7f74b815c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.206+0000 7f74bfa00640 1 --2- 172.21.15.144:0/2019276549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b80d2300 0x7f74b8156460 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.206+0000 7f74bfa00640 1 --2- 172.21.15.144:0/2019276549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74b80b8ab0 0x7f74b815a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.206+0000 7f74bfa00640 1 -- 172.21.15.144:0/2019276549 >> 172.21.15.144:0/2019276549 conn(0x7f74b80b6240 msgr2=0x7f74b80b9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:11.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.206+0000 7f74bfa00640 1 -- 172.21.15.144:0/2019276549 shutdown_connections 2024-09-11T23:18:11.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.207+0000 7f74bfa00640 1 -- 172.21.15.144:0/2019276549 wait complete. 2024-09-11T23:18:11.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.210+0000 7fc4fa000640 1 -- 172.21.15.144:0/4083129427 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc4d4005580 con 0x7fc5040ccec0 2024-09-11T23:18:11.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.211+0000 7fc500c00640 1 -- 172.21.15.144:0/4083129427 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc4ec079d10 con 0x7fc5040ccec0 2024-09-11T23:18:11.217 INFO:teuthology.orchestra.run.smithi144.stdout:60129542150 2024-09-11T23:18:11.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.217+0000 7f4146c00640 1 -- 172.21.15.144:0/3532346247 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f414014cc90 con 0x7f41400cd7a0 2024-09-11T23:18:11.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.218+0000 7fc4fa000640 1 -- 172.21.15.144:0/4083129427 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc4e006beb0 msgr2=0x7fc4e006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.218+0000 7fc4fa000640 1 --2- 172.21.15.144:0/4083129427 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc4e006beb0 0x7fc4e006e370 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc001330 tx=0x7fc4fc0018e0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.218+0000 7fc4fa000640 1 -- 172.21.15.144:0/4083129427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5040ccec0 msgr2=0x7fc504156770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.218+0000 7fc4fa000640 1 --2- 172.21.15.144:0/4083129427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5040ccec0 0x7fc504156770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8004760 tx=0x7fc4ec004730 comp rx=0 tx=0).stop 2024-09-11T23:18:11.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.218+0000 7f6f73800640 1 -- 172.21.15.144:0/1926507655 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6f6c0ba6b0 con 0x7f6f6c0cef90 2024-09-11T23:18:11.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.219+0000 7fc4fa000640 1 -- 172.21.15.144:0/4083129427 shutdown_connections 2024-09-11T23:18:11.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.219+0000 7fc4fa000640 1 --2- 172.21.15.144:0/4083129427 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc4e006beb0 0x7fc4e006e370 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.219+0000 7fc4fa000640 1 --2- 172.21.15.144:0/4083129427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc50415b090 0x7fc50415b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.219+0000 7fc4fa000640 1 --2- 172.21.15.144:0/4083129427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5040ccec0 0x7fc504156770 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.219+0000 7fc4fa000640 1 --2- 172.21.15.144:0/4083129427 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4e8004800 0x7fc5041f8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.219+0000 7fc4fa000640 1 -- 172.21.15.144:0/4083129427 >> 172.21.15.144:0/4083129427 conn(0x7fc5040d0fd0 msgr2=0x7fc5040b3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:11.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.219+0000 7f4137e00640 1 -- 172.21.15.144:0/3532346247 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f413005dca0 con 0x7f41400cd7a0 2024-09-11T23:18:11.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.219+0000 7fc4fa000640 1 -- 172.21.15.144:0/4083129427 shutdown_connections 2024-09-11T23:18:11.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.219+0000 7fc4fa000640 1 -- 172.21.15.144:0/4083129427 wait complete. 2024-09-11T23:18:11.220 INFO:teuthology.orchestra.run.smithi144.stdout:68719476743 2024-09-11T23:18:11.221 INFO:teuthology.orchestra.run.smithi144.stdout:68719476742 2024-09-11T23:18:11.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.219+0000 7f6f68c00640 1 -- 172.21.15.144:0/1926507655 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6f6007a030 con 0x7f6f6c0cef90 2024-09-11T23:18:11.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.222+0000 7f6f73800640 1 -- 172.21.15.144:0/1926507655 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6f4c06bf00 msgr2=0x7f6f4c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.222+0000 7f6f73800640 1 --2- 172.21.15.144:0/1926507655 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6f4c06bf00 0x7f6f4c06e3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6f58007fd0 tx=0x7f6f58009040 comp rx=0 tx=0).stop 2024-09-11T23:18:11.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.223+0000 7f6f73800640 1 -- 172.21.15.144:0/1926507655 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f6c0cef90 msgr2=0x7f6f6c157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.223+0000 7f6f73800640 1 --2- 172.21.15.144:0/1926507655 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f6c0cef90 0x7f6f6c157b70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6f600098c0 tx=0x7f6f600046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.223+0000 7f4146c00640 1 -- 172.21.15.144:0/3532346247 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f412006be60 msgr2=0x7f412006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.223+0000 7f6f73800640 1 -- 172.21.15.144:0/1926507655 shutdown_connections 2024-09-11T23:18:11.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.223+0000 7f6f73800640 1 --2- 172.21.15.144:0/1926507655 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6f4c06bf00 0x7f6f4c06e3c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.223+0000 7f6f73800640 1 --2- 172.21.15.144:0/1926507655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f6c15ed20 0x7f6f6c159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.223+0000 7f6f73800640 1 --2- 172.21.15.144:0/1926507655 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f6c15e940 0x7f6f6c1f5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.223+0000 7f6f73800640 1 --2- 172.21.15.144:0/1926507655 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f6c0cef90 0x7f6f6c157b70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.223+0000 7f6f73800640 1 -- 172.21.15.144:0/1926507655 >> 172.21.15.144:0/1926507655 conn(0x7f6f6c0b6240 msgr2=0x7f6f6c161500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:11.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.223+0000 7f4146c00640 1 --2- 172.21.15.144:0/3532346247 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f412006be60 0x7f412006e320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f412c000fb0 tx=0x7f412c001d40 comp rx=0 tx=0).stop 2024-09-11T23:18:11.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.223+0000 7f6f73800640 1 -- 172.21.15.144:0/1926507655 shutdown_connections 2024-09-11T23:18:11.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.223+0000 7f6f73800640 1 -- 172.21.15.144:0/1926507655 wait complete. 2024-09-11T23:18:11.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.223+0000 7f4146c00640 1 -- 172.21.15.144:0/3532346247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41400cd7a0 msgr2=0x7f41400af930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.223+0000 7f4146c00640 1 --2- 172.21.15.144:0/3532346247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41400cd7a0 0x7f41400af930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f413000b850 tx=0x7f413000bd10 comp rx=0 tx=0).stop 2024-09-11T23:18:11.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.224+0000 7f4146c00640 1 -- 172.21.15.144:0/3532346247 shutdown_connections 2024-09-11T23:18:11.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.224+0000 7f4146c00640 1 --2- 172.21.15.144:0/3532346247 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f412006be60 0x7f412006e320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.224+0000 7f4146c00640 1 --2- 172.21.15.144:0/3532346247 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f414015af30 0x7f414015b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.224+0000 7f4146c00640 1 --2- 172.21.15.144:0/3532346247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f414014a060 0x7f414014a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.224+0000 7f4146c00640 1 --2- 172.21.15.144:0/3532346247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41400cd7a0 0x7f41400af930 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.224+0000 7f4146c00640 1 -- 172.21.15.144:0/3532346247 >> 172.21.15.144:0/3532346247 conn(0x7f4140062cc0 msgr2=0x7f4140070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:11.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.224+0000 7f4146c00640 1 -- 172.21.15.144:0/3532346247 shutdown_connections 2024-09-11T23:18:11.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.225+0000 7f4146c00640 1 -- 172.21.15.144:0/3532346247 wait complete. 2024-09-11T23:18:11.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.226+0000 7f3716000640 1 -- 172.21.15.144:0/3961018332 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f36f8005850 con 0x7f372006bba0 2024-09-11T23:18:11.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.226+0000 7f371d600640 1 -- 172.21.15.144:0/3961018332 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f37100593e0 con 0x7f372006bba0 2024-09-11T23:18:11.227 INFO:teuthology.orchestra.run.smithi144.stdout:64424509446 2024-09-11T23:18:11.230 INFO:teuthology.orchestra.run.smithi144.stdout:64424509446 2024-09-11T23:18:11.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.227+0000 7f525de00640 1 -- 172.21.15.144:0/1682111797 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f52580b6cb0 con 0x7f525806c070 2024-09-11T23:18:11.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.228+0000 7f5254c00640 1 -- 172.21.15.144:0/1682111797 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f52440585c0 con 0x7f525806c070 2024-09-11T23:18:11.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.230+0000 7f7b91c00640 1 -- 172.21.15.144:0/509404320 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7b8c0ba6b0 con 0x7f7b8c15ed20 2024-09-11T23:18:11.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.230+0000 7f260fe00640 1 -- 172.21.15.144:0/3095664170 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f26100b9690 con 0x7f2610161c70 2024-09-11T23:18:11.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.230+0000 7f3716000640 1 -- 172.21.15.144:0/3961018332 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f36fc06be30 msgr2=0x7f36fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.230+0000 7f3716000640 1 --2- 172.21.15.144:0/3961018332 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f36fc06be30 0x7f36fc06e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3708036000 tx=0x7f3708030000 comp rx=0 tx=0).stop 2024-09-11T23:18:11.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.230+0000 7f3716000640 1 -- 172.21.15.144:0/3961018332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f372006bba0 msgr2=0x7f372014ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.231+0000 7f3716000640 1 --2- 172.21.15.144:0/3961018332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f372006bba0 0x7f372014ef00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f371000e9b0 tx=0x7f371000ee70 comp rx=0 tx=0).stop 2024-09-11T23:18:11.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.231+0000 7f3716000640 1 -- 172.21.15.144:0/3961018332 shutdown_connections 2024-09-11T23:18:11.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.231+0000 7f3716000640 1 --2- 172.21.15.144:0/3961018332 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f36fc06be30 0x7f36fc06e2f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.231+0000 7f3716000640 1 --2- 172.21.15.144:0/3961018332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37200b5640 0x7f3720158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.231+0000 7f3716000640 1 --2- 172.21.15.144:0/3961018332 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f372006f030 0x7f3720158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.231+0000 7f3716000640 1 --2- 172.21.15.144:0/3961018332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f372006bba0 0x7f372014ef00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.231+0000 7f3716000640 1 -- 172.21.15.144:0/3961018332 >> 172.21.15.144:0/3961018332 conn(0x7f3720062cc0 msgr2=0x7f37200b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:11.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.231+0000 7f7b82a00640 1 -- 172.21.15.144:0/509404320 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7b7c07d740 con 0x7f7b8c15ed20 2024-09-11T23:18:11.232 INFO:teuthology.orchestra.run.smithi144.stdout:68719476741 2024-09-11T23:18:11.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.231+0000 7f2607400640 1 -- 172.21.15.144:0/3095664170 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2608059a40 con 0x7f2610161c70 2024-09-11T23:18:11.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.231+0000 7f3716000640 1 -- 172.21.15.144:0/3961018332 shutdown_connections 2024-09-11T23:18:11.233 INFO:teuthology.orchestra.run.smithi144.stdout:68719476741 2024-09-11T23:18:11.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.3 2024-09-11T23:18:11.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.233+0000 7f525de00640 1 -- 172.21.15.144:0/1682111797 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f523806be30 msgr2=0x7f523806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.233+0000 7f525de00640 1 --2- 172.21.15.144:0/1682111797 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f523806be30 0x7f523806e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f524c02a250 tx=0x7f524c02e000 comp rx=0 tx=0).stop 2024-09-11T23:18:11.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.233+0000 7f525de00640 1 -- 172.21.15.144:0/1682111797 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f525806c070 msgr2=0x7f525815c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.233+0000 7f525de00640 1 --2- 172.21.15.144:0/1682111797 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f525806c070 0x7f525815c320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f524400c3c0 tx=0x7f524400c880 comp rx=0 tx=0).stop 2024-09-11T23:18:11.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.233+0000 7f3716000640 1 -- 172.21.15.144:0/3961018332 wait complete. 2024-09-11T23:18:11.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.234+0000 7f525de00640 1 -- 172.21.15.144:0/1682111797 shutdown_connections 2024-09-11T23:18:11.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.234+0000 7f525de00640 1 --2- 172.21.15.144:0/1682111797 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f523806be30 0x7f523806e2f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.234+0000 7f525de00640 1 --2- 172.21.15.144:0/1682111797 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5258161c70 0x7f52580b96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.234+0000 7f525de00640 1 --2- 172.21.15.144:0/1682111797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52580b81b0 0x7f52580ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.234+0000 7f525de00640 1 --2- 172.21.15.144:0/1682111797 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f525806c070 0x7f525815c320 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.234+0000 7f525de00640 1 -- 172.21.15.144:0/1682111797 >> 172.21.15.144:0/1682111797 conn(0x7f5258062a20 msgr2=0x7f5258062e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:11.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.234+0000 7f525de00640 1 -- 172.21.15.144:0/1682111797 shutdown_connections 2024-09-11T23:18:11.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.234+0000 7f525de00640 1 -- 172.21.15.144:0/1682111797 wait complete. 2024-09-11T23:18:11.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.235+0000 7f7b91c00640 1 -- 172.21.15.144:0/509404320 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7b6c06be30 msgr2=0x7f7b6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.235+0000 7f7b91c00640 1 --2- 172.21.15.144:0/509404320 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7b6c06be30 0x7f7b6c06e2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7b84005c00 tx=0x7f7b84009040 comp rx=0 tx=0).stop 2024-09-11T23:18:11.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.235+0000 7f7b91c00640 1 -- 172.21.15.144:0/509404320 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b8c15ed20 msgr2=0x7f7b8c0c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.235+0000 7f7b91c00640 1 --2- 172.21.15.144:0/509404320 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b8c15ed20 0x7f7b8c0c8260 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c031000 tx=0x7f7b7c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.235+0000 7f7b91c00640 1 -- 172.21.15.144:0/509404320 shutdown_connections 2024-09-11T23:18:11.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.235+0000 7f7b91c00640 1 --2- 172.21.15.144:0/509404320 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7b6c06be30 0x7f7b6c06e2f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.235+0000 7f260fe00640 1 -- 172.21.15.144:0/3095664170 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f25f006be80 msgr2=0x7f25f006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.235+0000 7f260fe00640 1 --2- 172.21.15.144:0/3095664170 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f25f006be80 0x7f25f006e340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2600000f60 tx=0x7f2600007a80 comp rx=0 tx=0).stop 2024-09-11T23:18:11.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.235+0000 7f260fe00640 1 -- 172.21.15.144:0/3095664170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2610161c70 msgr2=0x7f26100aeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:11.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.235+0000 7f260fe00640 1 --2- 172.21.15.144:0/3095664170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2610161c70 0x7f26100aeb10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2608007e40 tx=0x7f260800e4b0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.235+0000 7f260fe00640 1 -- 172.21.15.144:0/3095664170 shutdown_connections 2024-09-11T23:18:11.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.235+0000 7f260fe00640 1 --2- 172.21.15.144:0/3095664170 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f25f006be80 0x7f25f006e340 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.235+0000 7f260fe00640 1 --2- 172.21.15.144:0/3095664170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2610161c70 0x7f26100aeb10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.235+0000 7f260fe00640 1 --2- 172.21.15.144:0/3095664170 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26100b81b0 0x7f26100b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.235+0000 7f260fe00640 1 --2- 172.21.15.144:0/3095664170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f261006c070 0x7f26101569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.235+0000 7f260fe00640 1 -- 172.21.15.144:0/3095664170 >> 172.21.15.144:0/3095664170 conn(0x7f2610062a20 msgr2=0x7f26100cd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:11.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.235+0000 7f7b91c00640 1 --2- 172.21.15.144:0/509404320 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b8c15ed20 0x7f7b8c0c8260 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.235+0000 7f7b91c00640 1 --2- 172.21.15.144:0/509404320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b8c15e940 0x7f7b8c14e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.235+0000 7f7b91c00640 1 --2- 172.21.15.144:0/509404320 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b8c0b8f90 0x7f7b8c0cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:11.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.235+0000 7f7b91c00640 1 -- 172.21.15.144:0/509404320 >> 172.21.15.144:0/509404320 conn(0x7f7b8c0b6240 msgr2=0x7f7b8c161730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:11.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.236+0000 7f260fe00640 1 -- 172.21.15.144:0/3095664170 shutdown_connections 2024-09-11T23:18:11.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.236+0000 7f260fe00640 1 -- 172.21.15.144:0/3095664170 wait complete. 2024-09-11T23:18:11.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.236+0000 7f7b91c00640 1 -- 172.21.15.144:0/509404320 shutdown_connections 2024-09-11T23:18:11.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:11.236+0000 7f7b91c00640 1 -- 172.21.15.144:0/509404320 wait complete. 2024-09-11T23:18:11.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.2 2024-09-11T23:18:11.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476744 got 68719476742 for osd.6 2024-09-11T23:18:11.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476745 got 68719476743 for osd.7 2024-09-11T23:18:11.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476741 for osd.5 2024-09-11T23:18:11.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476741 for osd.4 2024-09-11T23:18:11.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.0 2024-09-11T23:18:11.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.1 2024-09-11T23:18:12.236 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T23:18:12.250 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T23:18:12.253 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T23:18:12.256 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T23:18:12.263 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T23:18:12.265 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T23:18:12.265 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T23:18:12.267 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T23:18:12.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.491+0000 7f4466800640 1 Processor -- start 2024-09-11T23:18:12.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.491+0000 7f4466800640 1 -- start start 2024-09-11T23:18:12.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.493+0000 7f4466800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f446015e940 0x7f44600d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.493+0000 7f4466800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f446015ed20 0x7f44600d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.494+0000 7f445ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f446015ed20 0x7f44600d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.494+0000 7f445ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f446015ed20 0x7f44600d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49454/0 (socket says 172.21.15.144:49454) 2024-09-11T23:18:12.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.494+0000 7f445f400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f446015e940 0x7f44600d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.495+0000 7f445f400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f446015e940 0x7f44600d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:50700/0 (socket says 172.21.15.144:50700) 2024-09-11T23:18:12.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.495+0000 7f445ea00640 1 -- 172.21.15.144:0/2403644987 learned_addr learned my addr 172.21.15.144:0/2403644987 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:12.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.496+0000 7f4466800640 1 -- 172.21.15.144:0/2403644987 --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44600b7170 con 0x7f44600cef90 2024-09-11T23:18:12.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.496+0000 7f4466800640 1 -- 172.21.15.144:0/2403644987 --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f44600d1ae0 con 0x7f446015ed20 2024-09-11T23:18:12.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.496+0000 7f445e000640 1 -- 172.21.15.144:0/2403644987 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1581339742 0 0) 0x7f444c001110 con 0x7f44600cef90 2024-09-11T23:18:12.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.496+0000 7f4466800640 1 -- 172.21.15.144:0/2403644987 --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f44600b7aa0 con 0x7f446015e940 2024-09-11T23:18:12.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.496+0000 7f445e000640 1 -- 172.21.15.144:0/2403644987 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4444003520 con 0x7f44600cef90 2024-09-11T23:18:12.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.497+0000 7f445e000640 1 -- 172.21.15.144:0/2403644987 <== mon.1 v1:172.21.15.165:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1131648823 0 0) 0x7f4444003520 con 0x7f44600cef90 2024-09-11T23:18:12.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.497+0000 7f445ea00640 1 -- 172.21.15.144:0/2403644987 >> v2:172.21.15.165:3300/0 conn(0x7f446015e940 msgr2=0x7f44600d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:12.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.497+0000 7f445ea00640 1 --2- 172.21.15.144:0/2403644987 >> v2:172.21.15.165:3300/0 conn(0x7f446015e940 0x7f44600d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.497+0000 7f445ea00640 1 -- 172.21.15.144:0/2403644987 >> v1:172.21.15.165:6789/0 conn(0x7f44600cef90 legacy=0x7f44600b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.498+0000 7f445ea00640 1 -- 172.21.15.144:0/2403644987 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44600d3660 con 0x7f446015ed20 2024-09-11T23:18:12.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.499+0000 7f445f400640 1 --2- 172.21.15.144:0/2403644987 >> v2:172.21.15.165:3300/0 conn(0x7f446015e940 0x7f44600d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:12.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.499+0000 7f445ea00640 1 --2- 172.21.15.144:0/2403644987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f446015ed20 0x7f44600d15a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f44600509d0 tx=0x7f445802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadfcad2497dc959 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.500+0000 7f445e000640 1 -- 172.21.15.144:0/2403644987 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458036070 con 0x7f446015ed20 2024-09-11T23:18:12.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.500+0000 7f445e000640 1 -- 172.21.15.144:0/2403644987 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4458031400 con 0x7f446015ed20 2024-09-11T23:18:12.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.500+0000 7f445e000640 1 -- 172.21.15.144:0/2403644987 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c001840 con 0x7f446015ed20 2024-09-11T23:18:12.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.501+0000 7f4466800640 1 -- 172.21.15.144:0/2403644987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f446015ed20 msgr2=0x7f44600d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.501+0000 7f4466800640 1 --2- 172.21.15.144:0/2403644987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f446015ed20 0x7f44600d15a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f44600509d0 tx=0x7f445802a760 comp rx=0 tx=0).stop 2024-09-11T23:18:12.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.502+0000 7f4466800640 1 -- 172.21.15.144:0/2403644987 shutdown_connections 2024-09-11T23:18:12.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.502+0000 7f4466800640 1 --2- 172.21.15.144:0/2403644987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f446015ed20 0x7f44600d15a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.502+0000 7f4466800640 1 --2- 172.21.15.144:0/2403644987 >> v2:172.21.15.165:3300/0 conn(0x7f446015e940 0x7f44600d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.502+0000 7f4466800640 1 -- 172.21.15.144:0/2403644987 >> 172.21.15.144:0/2403644987 conn(0x7f44600b6240 msgr2=0x7f44600b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:12.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.503+0000 7f4466800640 1 -- 172.21.15.144:0/2403644987 shutdown_connections 2024-09-11T23:18:12.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.503+0000 7f4466800640 1 -- 172.21.15.144:0/2403644987 wait complete. 2024-09-11T23:18:12.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.506+0000 7f4466800640 1 Processor -- start 2024-09-11T23:18:12.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.507+0000 7f4466800640 1 -- start start 2024-09-11T23:18:12.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.509+0000 7f4466800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44600cef90 0x7f4460153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.510+0000 7f4466800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f446015e940 0x7f446015b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.510+0000 7f4466800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f446015ed20 0x7f44600b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.511+0000 7f4466800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f44600d3f00 con 0x7f44600cef90 2024-09-11T23:18:12.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.511+0000 7f445fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f446015ed20 0x7f44600b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.511+0000 7f445fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f446015ed20 0x7f44600b4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:50708/0 (socket says 172.21.15.144:50708) 2024-09-11T23:18:12.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.511+0000 7f445fe00640 1 -- 172.21.15.144:0/2767157733 learned_addr learned my addr 172.21.15.144:0/2767157733 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:12.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.511+0000 7f4466800640 1 -- 172.21.15.144:0/2767157733 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f44600d3c20 con 0x7f446015ed20 2024-09-11T23:18:12.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.512+0000 7f4466800640 1 -- 172.21.15.144:0/2767157733 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f44600d3310 con 0x7f446015e940 2024-09-11T23:18:12.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.512+0000 7f445ea00640 1 --2- 172.21.15.144:0/2767157733 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f446015e940 0x7f446015b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.512+0000 7f445f400640 1 --2- 172.21.15.144:0/2767157733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44600cef90 0x7f4460153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.513+0000 7f445fe00640 1 -- 172.21.15.144:0/2767157733 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f446015e940 msgr2=0x7f446015b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.513+0000 7f445fe00640 1 --2- 172.21.15.144:0/2767157733 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f446015e940 0x7f446015b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.513+0000 7f445fe00640 1 -- 172.21.15.144:0/2767157733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44600cef90 msgr2=0x7f4460153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.513+0000 7f445fe00640 1 --2- 172.21.15.144:0/2767157733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44600cef90 0x7f4460153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.513+0000 7f445fe00640 1 -- 172.21.15.144:0/2767157733 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44600ccc00 con 0x7f446015ed20 2024-09-11T23:18:12.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.514+0000 7f445ea00640 1 --2- 172.21.15.144:0/2767157733 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f446015e940 0x7f446015b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:12.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.514+0000 7f445fe00640 1 --2- 172.21.15.144:0/2767157733 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f446015ed20 0x7f44600b4da0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f444c001550 tx=0x7f444c00c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.515+0000 7f4457400640 1 -- 172.21.15.144:0/2767157733 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c011790 con 0x7f446015ed20 2024-09-11T23:18:12.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.515+0000 7f4457400640 1 -- 172.21.15.144:0/2767157733 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f444c017070 con 0x7f446015ed20 2024-09-11T23:18:12.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.515+0000 7f4457400640 1 -- 172.21.15.144:0/2767157733 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c011bb0 con 0x7f446015ed20 2024-09-11T23:18:12.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.515+0000 7f4466800640 1 -- 172.21.15.144:0/2767157733 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4460158a50 con 0x7f446015ed20 2024-09-11T23:18:12.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.516+0000 7f4466800640 1 -- 172.21.15.144:0/2767157733 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44600b52e0 con 0x7f446015ed20 2024-09-11T23:18:12.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.519+0000 7f4466800640 1 -- 172.21.15.144:0/2767157733 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4438005290 con 0x7f446015ed20 2024-09-11T23:18:12.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.521+0000 7f4457400640 1 -- 172.21.15.144:0/2767157733 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f444c011d50 con 0x7f446015ed20 2024-09-11T23:18:12.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.523+0000 7f4457400640 1 --2- 172.21.15.144:0/2767157733 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f444006bf00 0x7f444006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.523+0000 7f4457400640 1 -- 172.21.15.144:0/2767157733 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f444c08ac00 con 0x7f446015ed20 2024-09-11T23:18:12.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.524+0000 7f445f400640 1 --2- 172.21.15.144:0/2767157733 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f444006bf00 0x7f444006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.525+0000 7f445f400640 1 --2- 172.21.15.144:0/2767157733 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f444006bf00 0x7f444006e3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4450009560 tx=0x7f4450008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.526+0000 7f4457400640 1 -- 172.21.15.144:0/2767157733 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f44600b7170 con 0x7f446015ed20 2024-09-11T23:18:12.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.545+0000 7f4ebe200640 1 Processor -- start 2024-09-11T23:18:12.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.545+0000 7f4ebe200640 1 -- start start 2024-09-11T23:18:12.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.547+0000 7f4ebe200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4eb00e28f0 0x7f4eb0053080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.547+0000 7f4ebe200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4eb003bc60 0x7f4eb00535c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.547+0000 7f4ebe200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eb0057d80 con 0x7f4eb0057830 2024-09-11T23:18:12.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.547+0000 7f4ebe200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4eb00076c0 con 0x7f4eb00e28f0 2024-09-11T23:18:12.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.547+0000 7f4ebe200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb0058060 con 0x7f4eb003bc60 2024-09-11T23:18:12.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.548+0000 7f4eb6a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4eb003bc60 0x7f4eb00535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.548+0000 7f4eb7400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4eb00e28f0 0x7f4eb0053080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.548+0000 7f4eb7400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4eb00e28f0 0x7f4eb0053080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:50724/0 (socket says 172.21.15.144:50724) 2024-09-11T23:18:12.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.548+0000 7f4eb7400640 1 -- 172.21.15.144:0/1326024364 learned_addr learned my addr 172.21.15.144:0/1326024364 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:12.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.549+0000 7f4eb7400640 1 -- 172.21.15.144:0/1326024364 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4eb003bc60 msgr2=0x7f4eb00535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:12.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.549+0000 7f4eb7400640 1 --2- 172.21.15.144:0/1326024364 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4eb003bc60 0x7f4eb00535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.549+0000 7f4eb7400640 1 -- 172.21.15.144:0/1326024364 >> v1:172.21.15.165:6789/0 conn(0x7f4eb0057830 legacy=0x7f4eb00e66b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T23:18:12.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.549+0000 7f4eb7400640 1 -- 172.21.15.144:0/1326024364 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb0005eb0 con 0x7f4eb00e28f0 2024-09-11T23:18:12.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.550+0000 7f4eb7400640 1 --2- 172.21.15.144:0/1326024364 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4eb00e28f0 0x7f4eb0053080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009870 tx=0x7f4eac02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b8f34fa7f82404d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.553+0000 7f4eb6000640 1 -- 172.21.15.144:0/1326024364 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eac037070 con 0x7f4eb00e28f0 2024-09-11T23:18:12.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.554+0000 7f4eb6000640 1 -- 172.21.15.144:0/1326024364 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eac032440 con 0x7f4eb00e28f0 2024-09-11T23:18:12.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.554+0000 7f4eb6000640 1 -- 172.21.15.144:0/1326024364 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eac032850 con 0x7f4eb00e28f0 2024-09-11T23:18:12.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.554+0000 7f4ebe200640 1 -- 172.21.15.144:0/1326024364 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4eb00e28f0 msgr2=0x7f4eb0053080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.554+0000 7f4ebe200640 1 --2- 172.21.15.144:0/1326024364 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4eb00e28f0 0x7f4eb0053080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009870 tx=0x7f4eac02a230 comp rx=0 tx=0).stop 2024-09-11T23:18:12.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.555+0000 7f4ebe200640 1 -- 172.21.15.144:0/1326024364 shutdown_connections 2024-09-11T23:18:12.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.555+0000 7f4ebe200640 1 --2- 172.21.15.144:0/1326024364 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4eb003bc60 0x7f4eb00535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.555+0000 7f4ebe200640 1 --2- 172.21.15.144:0/1326024364 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4eb00e28f0 0x7f4eb0053080 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.555+0000 7f4ebe200640 1 -- 172.21.15.144:0/1326024364 >> 172.21.15.144:0/1326024364 conn(0x7f4eb003a520 msgr2=0x7f4eb003a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:12.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.555+0000 7f4ebe200640 1 -- 172.21.15.144:0/1326024364 shutdown_connections 2024-09-11T23:18:12.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.555+0000 7f4ebe200640 1 -- 172.21.15.144:0/1326024364 wait complete. 2024-09-11T23:18:12.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.556+0000 7f1226e00640 1 Processor -- start 2024-09-11T23:18:12.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.558+0000 7f4ebe200640 1 Processor -- start 2024-09-11T23:18:12.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.558+0000 7f4ebe200640 1 -- start start 2024-09-11T23:18:12.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.557+0000 7f1226e00640 1 -- start start 2024-09-11T23:18:12.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.559+0000 7f1226e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1218005a60 0x7f1218053f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.559+0000 7f1226e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f121804eb60 0x7f121801d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.559+0000 7f1226e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1218052330 con 0x7f12180e7120 2024-09-11T23:18:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.559+0000 7f1226e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f12180520e0 con 0x7f1218005a60 2024-09-11T23:18:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.559+0000 7f1226e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1218006c80 con 0x7f121804eb60 2024-09-11T23:18:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.559+0000 7f121fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1218005a60 0x7f1218053f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.559+0000 7f121fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1218005a60 0x7f1218053f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49480/0 (socket says 172.21.15.144:49480) 2024-09-11T23:18:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.559+0000 7f121fe00640 1 -- 172.21.15.144:0/1501224856 learned_addr learned my addr 172.21.15.144:0/1501224856 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:12.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.560+0000 7f1224e00640 1 --2- 172.21.15.144:0/1501224856 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f121804eb60 0x7f121801d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.560+0000 7f4ebe200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eb003bc60 0x7f4eb00d8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.560+0000 7f4ebe200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4eb0057830 0x7f4eb00e4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.561+0000 7f4ebe200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4eb00e28f0 0x7f4eb004e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.561+0000 7f4eb6a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4eb0057830 0x7f4eb00e4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.561+0000 7f4eb6a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4eb0057830 0x7f4eb00e4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:50732/0 (socket says 172.21.15.144:50732) 2024-09-11T23:18:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.561+0000 7f4eb6a00640 1 -- 172.21.15.144:0/3241512253 learned_addr learned my addr 172.21.15.144:0/3241512253 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.561+0000 7f4eb7e00640 1 --2- 172.21.15.144:0/3241512253 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4eb00e28f0 0x7f4eb004e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.562+0000 7f4ebe200640 1 -- 172.21.15.144:0/3241512253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb00e2cd0 con 0x7f4eb003bc60 2024-09-11T23:18:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.562+0000 7f4ebe200640 1 -- 172.21.15.144:0/3241512253 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb00568c0 con 0x7f4eb0057830 2024-09-11T23:18:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.562+0000 7f4ebe200640 1 -- 172.21.15.144:0/3241512253 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb00e2e50 con 0x7f4eb00e28f0 2024-09-11T23:18:12.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.562+0000 7f4eb7400640 1 --2- 172.21.15.144:0/3241512253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eb003bc60 0x7f4eb00d8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.560+0000 7f121fe00640 1 -- 172.21.15.144:0/1501224856 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f121804eb60 msgr2=0x7f121801d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.560+0000 7f121fe00640 1 --2- 172.21.15.144:0/1501224856 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f121804eb60 0x7f121801d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.560+0000 7f121fe00640 1 -- 172.21.15.144:0/1501224856 >> v1:172.21.15.165:6789/0 conn(0x7f12180e7120 legacy=0x7f1218005e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.560+0000 7f121fe00640 1 -- 172.21.15.144:0/1501224856 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1218006f60 con 0x7f1218005a60 2024-09-11T23:18:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.563+0000 7f4eb6a00640 1 -- 172.21.15.144:0/3241512253 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4eb00e28f0 msgr2=0x7f4eb004e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.563+0000 7f4eb6a00640 1 --2- 172.21.15.144:0/3241512253 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4eb00e28f0 0x7f4eb004e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.563+0000 7f4eb6a00640 1 -- 172.21.15.144:0/3241512253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eb003bc60 msgr2=0x7f4eb00d8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.563+0000 7f4eb6a00640 1 --2- 172.21.15.144:0/3241512253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eb003bc60 0x7f4eb00d8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.563+0000 7f4eb6a00640 1 -- 172.21.15.144:0/3241512253 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb004fd10 con 0x7f4eb0057830 2024-09-11T23:18:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.563+0000 7f4eb7400640 1 --2- 172.21.15.144:0/3241512253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eb003bc60 0x7f4eb00d8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.564+0000 7f4eb7e00640 1 --2- 172.21.15.144:0/3241512253 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4eb00e28f0 0x7f4eb004e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.564+0000 7f4eb6a00640 1 --2- 172.21.15.144:0/3241512253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4eb0057830 0x7f4eb00e4e40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400e980 tx=0x7f4ea400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.564+0000 7f121fe00640 1 --2- 172.21.15.144:0/1501224856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1218005a60 0x7f1218053f50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1214009850 tx=0x7f121402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de3390409dc3986 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.564+0000 7f4eab400640 1 -- 172.21.15.144:0/3241512253 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4017070 con 0x7f4eb0057830 2024-09-11T23:18:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.564+0000 7f4eab400640 1 -- 172.21.15.144:0/3241512253 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea400ca00 con 0x7f4eb0057830 2024-09-11T23:18:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.565+0000 7f4eab400640 1 -- 172.21.15.144:0/3241512253 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4017070 con 0x7f4eb0057830 2024-09-11T23:18:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.565+0000 7f121ea00640 1 -- 172.21.15.144:0/1501224856 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1214004230 con 0x7f1218005a60 2024-09-11T23:18:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.566+0000 7fe571a00640 1 Processor -- start 2024-09-11T23:18:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.566+0000 7f4ebe200640 1 -- 172.21.15.144:0/3241512253 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb004fff0 con 0x7f4eb0057830 2024-09-11T23:18:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.566+0000 7f4ebe200640 1 -- 172.21.15.144:0/3241512253 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb00505b0 con 0x7f4eb0057830 2024-09-11T23:18:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.566+0000 7f121ea00640 1 -- 172.21.15.144:0/1501224856 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12140043d0 con 0x7f1218005a60 2024-09-11T23:18:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.566+0000 7f121ea00640 1 -- 172.21.15.144:0/1501224856 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1214003810 con 0x7f1218005a60 2024-09-11T23:18:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.566+0000 7fe571a00640 1 -- start start 2024-09-11T23:18:12.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.567+0000 7f1226e00640 1 -- 172.21.15.144:0/1501224856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1218005a60 msgr2=0x7f1218053f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.567+0000 7f1226e00640 1 --2- 172.21.15.144:0/1501224856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1218005a60 0x7f1218053f50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1214009850 tx=0x7f121402a2c0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.568+0000 7f1226e00640 1 -- 172.21.15.144:0/1501224856 shutdown_connections 2024-09-11T23:18:12.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.568+0000 7f1226e00640 1 --2- 172.21.15.144:0/1501224856 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f121804eb60 0x7f121801d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.568+0000 7f1226e00640 1 --2- 172.21.15.144:0/1501224856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1218005a60 0x7f1218053f50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.568+0000 7f1226e00640 1 -- 172.21.15.144:0/1501224856 >> 172.21.15.144:0/1501224856 conn(0x7f1218036090 msgr2=0x7f12180364a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.568+0000 7f1226e00640 1 -- 172.21.15.144:0/1501224856 shutdown_connections 2024-09-11T23:18:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.569+0000 7fe571a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe56c151c50 0x7fe56c0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.569+0000 7fe571a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe56c06c1f0 0x7fe56c15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.569+0000 7fe571a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe56c0cd5f0 con 0x7fe56c06be10 2024-09-11T23:18:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.569+0000 7fe571a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe56c0cd8d0 con 0x7fe56c06c1f0 2024-09-11T23:18:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.569+0000 7fe571a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe56c0cdbb0 con 0x7fe56c151c50 2024-09-11T23:18:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.569+0000 7f1226e00640 1 -- 172.21.15.144:0/1501224856 wait complete. 2024-09-11T23:18:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.570+0000 7fe56aa00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fe56c06be10 0x7fe56c151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:53358/0 (socket says 172.21.15.144:53358) 2024-09-11T23:18:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.570+0000 7fe56aa00640 1 -- 172.21.15.144:0/3824276666 learned_addr learned my addr 172.21.15.144:0/3824276666 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:12.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.570+0000 7fe56a000640 1 --2- 172.21.15.144:0/3824276666 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe56c151c50 0x7fe56c0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.567+0000 7f4ebe200640 1 -- 172.21.15.144:0/3241512253 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eb0053080 con 0x7f4eb0057830 2024-09-11T23:18:12.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.569+0000 7f4eab400640 1 -- 172.21.15.144:0/3241512253 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ea401a070 con 0x7f4eb0057830 2024-09-11T23:18:12.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.570+0000 7f4eab400640 1 --2- 172.21.15.144:0/3241512253 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4e9806c230 0x7f4e9806e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.570+0000 7f4eab400640 1 -- 172.21.15.144:0/3241512253 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4ea400f040 con 0x7f4eb0057830 2024-09-11T23:18:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.571+0000 7fe56a000640 1 -- 172.21.15.144:0/3824276666 >> v2:172.21.15.165:3300/0 conn(0x7fe56c06c1f0 msgr2=0x7fe56c15baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.571+0000 7fe56a000640 1 --2- 172.21.15.144:0/3824276666 >> v2:172.21.15.165:3300/0 conn(0x7fe56c06c1f0 0x7fe56c15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.572+0000 7f4eb7400640 1 --2- 172.21.15.144:0/3241512253 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4e9806c230 0x7f4e9806e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.572+0000 7f1226e00640 1 Processor -- start 2024-09-11T23:18:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.572+0000 7fa198400640 1 Processor -- start 2024-09-11T23:18:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.572+0000 7fa198400640 1 -- start start 2024-09-11T23:18:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.571+0000 7fe56a000640 1 -- 172.21.15.144:0/3824276666 >> v1:172.21.15.165:6789/0 conn(0x7fe56c06be10 legacy=0x7fe56c151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.571+0000 7fe56a000640 1 -- 172.21.15.144:0/3824276666 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe56c0cde90 con 0x7fe56c151c50 2024-09-11T23:18:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.572+0000 7f1226e00640 1 -- start start 2024-09-11T23:18:12.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.573+0000 7fe56a000640 1 --2- 172.21.15.144:0/3824276666 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe56c151c50 0x7fe56c0cd010 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe55c0097a0 tx=0x7fe55c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abc22417fe99744f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.574+0000 7f4eb7400640 1 --2- 172.21.15.144:0/3241512253 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4e9806c230 0x7f4e9806e6f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4eac034000 tx=0x7f4eac02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.574+0000 7fe78ec00640 1 Processor -- start 2024-09-11T23:18:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.574+0000 7f4eab400640 1 -- 172.21.15.144:0/3241512253 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ea4058f40 con 0x7f4eb0057830 2024-09-11T23:18:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.574+0000 7fe569600640 1 -- 172.21.15.144:0/3824276666 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c037070 con 0x7fe56c151c50 2024-09-11T23:18:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.574+0000 7f1226e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1218005a60 0x7f12180d2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.574+0000 7fe78ec00640 1 -- start start 2024-09-11T23:18:12.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.574+0000 7fa198400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa19006c490 0x7fa1900cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.574+0000 7fa198400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa1900b3560 0x7fa1900b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.574+0000 7fa198400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1900741d0 con 0x7fa1900cfe90 2024-09-11T23:18:12.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.574+0000 7f1226e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f121804eb60 0x7f12180373d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.574+0000 7fe569600640 1 -- 172.21.15.144:0/3824276666 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe55c032440 con 0x7fe56c151c50 2024-09-11T23:18:12.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.575+0000 7fa198400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa1900cdea0 con 0x7fa19006c490 2024-09-11T23:18:12.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.575+0000 7fa198400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa190167460 con 0x7fa1900b3560 2024-09-11T23:18:12.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.575+0000 7f121fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1218005a60 0x7f12180d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.575+0000 7fa195a00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fa1900cfe90 0x7fa19006bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:53370/0 (socket says 172.21.15.144:53370) 2024-09-11T23:18:12.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.575+0000 7fa195a00640 1 -- 172.21.15.144:0/2123552557 learned_addr learned my addr 172.21.15.144:0/2123552557 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:12.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.575+0000 7f121fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1218005a60 0x7f12180d2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50356/0 (socket says 172.21.15.144:50356) 2024-09-11T23:18:12.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.575+0000 7f1226e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12180e7120 0x7f12180ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.575+0000 7fe569600640 1 -- 172.21.15.144:0/3824276666 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c032810 con 0x7fe56c151c50 2024-09-11T23:18:12.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.575+0000 7fa18fe00640 1 -- 172.21.15.144:0/2123552557 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2632016499 0 0) 0x7fa1900741d0 con 0x7fa1900cfe90 2024-09-11T23:18:12.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.576+0000 7fa196400640 1 --2- 172.21.15.144:0/2123552557 >> v2:172.21.15.165:3300/0 conn(0x7fa1900b3560 0x7fa1900b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.576+0000 7fa18fe00640 1 -- 172.21.15.144:0/2123552557 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa178003520 con 0x7fa1900cfe90 2024-09-11T23:18:12.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.576+0000 7f121f400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f121804eb60 0x7f12180373d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.576+0000 7fa195000640 1 --2- 172.21.15.144:0/2123552557 >> v2:172.21.15.144:3300/0 conn(0x7fa19006c490 0x7fa1900cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.576+0000 7fe571a00640 1 -- 172.21.15.144:0/3824276666 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe56c151c50 msgr2=0x7fe56c0cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.576+0000 7fe571a00640 1 --2- 172.21.15.144:0/3824276666 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe56c151c50 0x7fe56c0cd010 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe55c0097a0 tx=0x7fe55c02a180 comp rx=0 tx=0).stop 2024-09-11T23:18:12.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.576+0000 7f121fe00640 1 -- 172.21.15.144:0/3063595563 learned_addr learned my addr 172.21.15.144:0/3063595563 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:12.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.576+0000 7fe571a00640 1 -- 172.21.15.144:0/3824276666 shutdown_connections 2024-09-11T23:18:12.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.576+0000 7fe571a00640 1 --2- 172.21.15.144:0/3824276666 >> v2:172.21.15.165:3300/0 conn(0x7fe56c06c1f0 0x7fe56c15baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.576+0000 7fe571a00640 1 --2- 172.21.15.144:0/3824276666 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe56c151c50 0x7fe56c0cd010 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.576+0000 7fe571a00640 1 -- 172.21.15.144:0/3824276666 >> 172.21.15.144:0/3824276666 conn(0x7fe56c062cc0 msgr2=0x7fe56c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:12.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.576+0000 7f1c5d600640 1 Processor -- start 2024-09-11T23:18:12.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.576+0000 7fe571a00640 1 -- 172.21.15.144:0/3824276666 shutdown_connections 2024-09-11T23:18:12.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.576+0000 7f1226e00640 1 -- 172.21.15.144:0/3063595563 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1218047b50 con 0x7f12180e7120 2024-09-11T23:18:12.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.576+0000 7fa196400640 1 -- 172.21.15.144:0/2123552557 >> v2:172.21.15.144:3300/0 conn(0x7fa19006c490 msgr2=0x7fa1900cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:12.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.577+0000 7f1224e00640 1 --2- 172.21.15.144:0/3063595563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12180e7120 0x7f12180ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.577+0000 7fa196400640 1 --2- 172.21.15.144:0/2123552557 >> v2:172.21.15.144:3300/0 conn(0x7fa19006c490 0x7fa1900cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.577+0000 7fa196400640 1 -- 172.21.15.144:0/2123552557 >> v1:172.21.15.165:6789/0 conn(0x7fa1900cfe90 legacy=0x7fa19006bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.577+0000 7fa196400640 1 -- 172.21.15.144:0/2123552557 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1901666a0 con 0x7fa1900b3560 2024-09-11T23:18:12.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.577+0000 7f1c5d600640 1 -- start start 2024-09-11T23:18:12.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.577+0000 7fe78ec00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe78815e940 0x7fe7880d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.577+0000 7fe78ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe7880cef90 0x7fe7880d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.577+0000 7fe78ec00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7880b7170 con 0x7fe78815ed20 2024-09-11T23:18:12.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.577+0000 7fe78ec00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe7880d1ae0 con 0x7fe78815e940 2024-09-11T23:18:12.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.577+0000 7fe78ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe7880b7aa0 con 0x7fe7880cef90 2024-09-11T23:18:12.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.576+0000 7fe571a00640 1 -- 172.21.15.144:0/3824276666 wait complete. 2024-09-11T23:18:12.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.577+0000 7fa195000640 1 --2- 172.21.15.144:0/2123552557 >> v2:172.21.15.144:3300/0 conn(0x7fa19006c490 0x7fa1900cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:12.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.577+0000 7fe78cc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe7880cef90 0x7fe7880d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.577+0000 7fe78cc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe7880cef90 0x7fe7880d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50366/0 (socket says 172.21.15.144:50366) 2024-09-11T23:18:12.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.577+0000 7fe78cc00640 1 -- 172.21.15.144:0/2724125739 learned_addr learned my addr 172.21.15.144:0/2724125739 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:12.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.577+0000 7fe787e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe78815e940 0x7fe7880d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.578+0000 7f1226e00640 1 -- 172.21.15.144:0/3063595563 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1218053a10 con 0x7f121804eb60 2024-09-11T23:18:12.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.578+0000 7f1226e00640 1 -- 172.21.15.144:0/3063595563 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1218047cd0 con 0x7f1218005a60 2024-09-11T23:18:12.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.578+0000 7f1c5d600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1c58162930 0x7f1c580cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.579+0000 7f1c5d600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c580cf3a0 con 0x7f1c580af900 2024-09-11T23:18:12.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.579+0000 7f1c5d600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c580b4010 con 0x7f1c5806c2b0 2024-09-11T23:18:12.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.579+0000 7f1c5d600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1c580b4870 con 0x7f1c58162930 2024-09-11T23:18:12.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.578+0000 7eff88400640 1 Processor -- start 2024-09-11T23:18:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.579+0000 7eff88400640 1 -- start start 2024-09-11T23:18:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.579+0000 7fe571a00640 1 Processor -- start 2024-09-11T23:18:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.579+0000 7fa196400640 1 --2- 172.21.15.144:0/2123552557 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1900b3560 0x7fa1900b3e30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa1900ccac0 tx=0x7fa18802a4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96b3eb8ca18d623d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.579+0000 7f1c56000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1c580af900 0x7f1c5806bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46914/0 (socket says 172.21.15.144:46914) 2024-09-11T23:18:12.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.579+0000 7f1c56000640 1 -- 172.21.15.144:0/1946147268 learned_addr learned my addr 172.21.15.144:0/1946147268 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:12.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.579+0000 7f1c56a00640 1 --2- 172.21.15.144:0/1946147268 >> v2:172.21.15.144:3300/0 conn(0x7f1c58162930 0x7f1c580cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.580+0000 7fe571a00640 1 -- start start 2024-09-11T23:18:12.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.578+0000 7fe78cc00640 1 -- 172.21.15.144:0/2724125739 >> v2:172.21.15.165:3300/0 conn(0x7fe78815e940 msgr2=0x7fe7880d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:12.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.578+0000 7fe78cc00640 1 --2- 172.21.15.144:0/2724125739 >> v2:172.21.15.165:3300/0 conn(0x7fe78815e940 0x7fe7880d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.578+0000 7fe78cc00640 1 -- 172.21.15.144:0/2724125739 >> v1:172.21.15.165:6789/0 conn(0x7fe78815ed20 legacy=0x7fe7880b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.578+0000 7fe78cc00640 1 -- 172.21.15.144:0/2724125739 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7880d3660 con 0x7fe7880cef90 2024-09-11T23:18:12.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.580+0000 7f1c55600640 1 -- 172.21.15.144:0/1946147268 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 164452262 0 0) 0x7f1c44001110 con 0x7f1c580af900 2024-09-11T23:18:12.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.580+0000 7f1c55600640 1 -- 172.21.15.144:0/1946147268 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c3c003520 con 0x7f1c580af900 2024-09-11T23:18:12.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.580+0000 7fe78cc00640 1 --2- 172.21.15.144:0/2724125739 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe7880cef90 0x7fe7880d15a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe774009870 tx=0x7fe77402a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e24a52d271e120f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.580+0000 7eff88400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7eff80163060 0x7eff800cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.580+0000 7eff88400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7eff800d2300 0x7eff800cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7f1c56a00640 1 -- 172.21.15.144:0/1946147268 >> v1:172.21.15.165:6789/0 conn(0x7f1c5806c2b0 legacy=0x7f1c580cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7f1c56a00640 1 -- 172.21.15.144:0/1946147268 >> v1:172.21.15.144:6789/0 conn(0x7f1c580af900 legacy=0x7f1c5806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7f1c56a00640 1 -- 172.21.15.144:0/1946147268 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c580b42b0 con 0x7f1c58162930 2024-09-11T23:18:12.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7f121fe00640 1 -- 172.21.15.144:0/3063595563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f121804eb60 msgr2=0x7f12180373d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7f121fe00640 1 --2- 172.21.15.144:0/3063595563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f121804eb60 0x7f12180373d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7f121fe00640 1 -- 172.21.15.144:0/3063595563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12180e7120 msgr2=0x7f12180ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7fa18fe00640 1 -- 172.21.15.144:0/2123552557 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa188035020 con 0x7fa1900b3560 2024-09-11T23:18:12.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7fa18fe00640 1 -- 172.21.15.144:0/2123552557 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa188007540 con 0x7fa1900b3560 2024-09-11T23:18:12.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7fa18fe00640 1 -- 172.21.15.144:0/2123552557 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa188035020 con 0x7fa1900b3560 2024-09-11T23:18:12.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7fe786a00640 1 -- 172.21.15.144:0/2724125739 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe774037070 con 0x7fe7880cef90 2024-09-11T23:18:12.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7fe786a00640 1 -- 172.21.15.144:0/2724125739 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe774032640 con 0x7fe7880cef90 2024-09-11T23:18:12.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7fe786a00640 1 -- 172.21.15.144:0/2724125739 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe774032a50 con 0x7fe7880cef90 2024-09-11T23:18:12.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7fe571a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe56c06be10 0x7fe56c158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7fe571a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe56c06c1f0 0x7fe56c072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7fe571a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe56c1446e0 0x7fe56c1566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7fe571a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c0d0310 con 0x7fe56c06be10 2024-09-11T23:18:12.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7eff88400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff800d31f0 0x7eff800d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7f121fe00640 1 --2- 172.21.15.144:0/3063595563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12180e7120 0x7f12180ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7eff88400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7eff800b7610 con 0x7eff80163060 2024-09-11T23:18:12.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7eff88400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7eff800d3790 con 0x7eff800d2300 2024-09-11T23:18:12.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7eff88400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7eff800d3a70 con 0x7eff800d31f0 2024-09-11T23:18:12.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7eff85000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7eff800d2300 0x7eff800cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7eff85000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7eff800d2300 0x7eff800cf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:50772/0 (socket says 172.21.15.144:50772) 2024-09-11T23:18:12.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7eff85000640 1 -- 172.21.15.144:0/3551011807 learned_addr learned my addr 172.21.15.144:0/3551011807 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:12.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7f121fe00640 1 -- 172.21.15.144:0/3063595563 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12180cb2e0 con 0x7f1218005a60 2024-09-11T23:18:12.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7f1224e00640 1 --2- 172.21.15.144:0/3063595563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12180e7120 0x7f12180ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:12.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7eff86400640 1 --2- 172.21.15.144:0/3551011807 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff800d31f0 0x7eff800d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7eff85000640 1 -- 172.21.15.144:0/3551011807 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff800d31f0 msgr2=0x7eff800d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:12.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7eff85000640 1 --2- 172.21.15.144:0/3551011807 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff800d31f0 0x7eff800d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7eff85000640 1 -- 172.21.15.144:0/3551011807 >> v2:172.21.15.144:3300/0 conn(0x7eff80163060 msgr2=0x7eff800cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:12.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7eff85000640 1 --2- 172.21.15.144:0/3551011807 >> v2:172.21.15.144:3300/0 conn(0x7eff80163060 0x7eff800cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7eff85000640 1 -- 172.21.15.144:0/3551011807 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff800d3d50 con 0x7eff800d2300 2024-09-11T23:18:12.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7fe571a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c0ce690 con 0x7fe56c06c1f0 2024-09-11T23:18:12.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.581+0000 7fe571a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe56c0d0490 con 0x7fe56c1446e0 2024-09-11T23:18:12.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7fa198400640 1 -- 172.21.15.144:0/2123552557 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1900b3560 msgr2=0x7fa1900b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7fa198400640 1 --2- 172.21.15.144:0/2123552557 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1900b3560 0x7fa1900b3e30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa1900ccac0 tx=0x7fa18802a4d0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7fe56a000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe56c06c1f0 0x7fe56c072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7fe56a000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe56c06c1f0 0x7fe56c072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:50788/0 (socket says 172.21.15.144:50788) 2024-09-11T23:18:12.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7fe56a000640 1 -- 172.21.15.144:0/759041380 learned_addr learned my addr 172.21.15.144:0/759041380 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:12.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7fe56b400640 1 --2- 172.21.15.144:0/759041380 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe56c1446e0 0x7fe56c1566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7f1c56a00640 1 --2- 172.21.15.144:0/1946147268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c58162930 0x7f1c580cd750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1c48009a00 tx=0x7f1c4802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692b162372ca44e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7f1c55600640 1 -- 172.21.15.144:0/1946147268 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c48036070 con 0x7f1c58162930 2024-09-11T23:18:12.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7f1c55600640 1 -- 172.21.15.144:0/1946147268 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c48031600 con 0x7f1c58162930 2024-09-11T23:18:12.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7fa198400640 1 -- 172.21.15.144:0/2123552557 shutdown_connections 2024-09-11T23:18:12.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7fa198400640 1 --2- 172.21.15.144:0/2123552557 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1900b3560 0x7fa1900b3e30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7fa198400640 1 --2- 172.21.15.144:0/2123552557 >> v2:172.21.15.144:3300/0 conn(0x7fa19006c490 0x7fa1900cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7fa198400640 1 -- 172.21.15.144:0/2123552557 >> 172.21.15.144:0/2123552557 conn(0x7fa1900b2040 msgr2=0x7fa1900b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:12.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7fe56aa00640 1 --2- 172.21.15.144:0/759041380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe56c06be10 0x7fe56c158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7fe56a000640 1 -- 172.21.15.144:0/759041380 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe56c1446e0 msgr2=0x7fe56c1566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7fe56a000640 1 --2- 172.21.15.144:0/759041380 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe56c1446e0 0x7fe56c1566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7fe56a000640 1 -- 172.21.15.144:0/759041380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe56c06be10 msgr2=0x7fe56c158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7fe56a000640 1 --2- 172.21.15.144:0/759041380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe56c06be10 0x7fe56c158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7fe56a000640 1 -- 172.21.15.144:0/759041380 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe56c145140 con 0x7fe56c06c1f0 2024-09-11T23:18:12.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.582+0000 7fe56aa00640 1 --2- 172.21.15.144:0/759041380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe56c06be10 0x7fe56c158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:12.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.583+0000 7fa198400640 1 -- 172.21.15.144:0/2123552557 shutdown_connections 2024-09-11T23:18:12.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.583+0000 7f1c55600640 1 -- 172.21.15.144:0/1946147268 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c480319b0 con 0x7f1c58162930 2024-09-11T23:18:12.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.583+0000 7fa198400640 1 -- 172.21.15.144:0/2123552557 wait complete. 2024-09-11T23:18:12.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.583+0000 7f121fe00640 1 --2- 172.21.15.144:0/3063595563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1218005a60 0x7f12180d2610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1214034040 tx=0x7f12140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.583+0000 7fe56a000640 1 --2- 172.21.15.144:0/759041380 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe56c06c1f0 0x7fe56c072160 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe55c02a6f0 tx=0x7fe55c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.583+0000 7f1213e00640 1 -- 172.21.15.144:0/3063595563 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1214041030 con 0x7f1218005a60 2024-09-11T23:18:12.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.583+0000 7f1c5d600640 1 -- 172.21.15.144:0/1946147268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c58162930 msgr2=0x7f1c580cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.583+0000 7f1c5d600640 1 --2- 172.21.15.144:0/1946147268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c58162930 0x7f1c580cd750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1c48009a00 tx=0x7f1c4802a480 comp rx=0 tx=0).stop 2024-09-11T23:18:12.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.583+0000 7f1213e00640 1 -- 172.21.15.144:0/3063595563 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1214003c50 con 0x7f1218005a60 2024-09-11T23:18:12.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.583+0000 7f1213e00640 1 -- 172.21.15.144:0/3063595563 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1214003e00 con 0x7f1218005a60 2024-09-11T23:18:12.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.583+0000 7f1226e00640 1 -- 172.21.15.144:0/3063595563 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12180d2b50 con 0x7f1218005a60 2024-09-11T23:18:12.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.584+0000 7f1226e00640 1 -- 172.21.15.144:0/3063595563 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f12180cc410 con 0x7f1218005a60 2024-09-11T23:18:12.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.584+0000 7fe562a00640 1 -- 172.21.15.144:0/759041380 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c037050 con 0x7fe56c06c1f0 2024-09-11T23:18:12.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.584+0000 7fe562a00640 1 -- 172.21.15.144:0/759041380 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe55c038040 con 0x7fe56c06c1f0 2024-09-11T23:18:12.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.584+0000 7fe562a00640 1 -- 172.21.15.144:0/759041380 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c004470 con 0x7fe56c06c1f0 2024-09-11T23:18:12.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.584+0000 7fe571a00640 1 -- 172.21.15.144:0/759041380 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe56c155650 con 0x7fe56c06c1f0 2024-09-11T23:18:12.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.584+0000 7fe78ec00640 1 -- 172.21.15.144:0/2724125739 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe7880cef90 msgr2=0x7fe7880d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.584+0000 7fe78ec00640 1 --2- 172.21.15.144:0/2724125739 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe7880cef90 0x7fe7880d15a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe774009870 tx=0x7fe77402a330 comp rx=0 tx=0).stop 2024-09-11T23:18:12.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.584+0000 7f1c5d600640 1 -- 172.21.15.144:0/1946147268 shutdown_connections 2024-09-11T23:18:12.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.584+0000 7f1c5d600640 1 --2- 172.21.15.144:0/1946147268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c58162930 0x7f1c580cd750 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.584+0000 7f1c5d600640 1 -- 172.21.15.144:0/1946147268 >> 172.21.15.144:0/1946147268 conn(0x7f1c58062cc0 msgr2=0x7f1c5806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:12.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.584+0000 7fe78ec00640 1 -- 172.21.15.144:0/2724125739 shutdown_connections 2024-09-11T23:18:12.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.584+0000 7fe78ec00640 1 --2- 172.21.15.144:0/2724125739 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe7880cef90 0x7fe7880d15a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.584+0000 7fe78ec00640 1 --2- 172.21.15.144:0/2724125739 >> v2:172.21.15.165:3300/0 conn(0x7fe78815e940 0x7fe7880d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.584+0000 7fe78ec00640 1 -- 172.21.15.144:0/2724125739 >> 172.21.15.144:0/2724125739 conn(0x7fe7880b6240 msgr2=0x7fe7880b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:12.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.584+0000 7fe571a00640 1 -- 172.21.15.144:0/759041380 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe56c155c10 con 0x7fe56c06c1f0 2024-09-11T23:18:12.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.584+0000 7fe78ec00640 1 -- 172.21.15.144:0/2724125739 shutdown_connections 2024-09-11T23:18:12.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.584+0000 7eff85000640 1 --2- 172.21.15.144:0/3551011807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff800d2300 0x7eff800cf4d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7eff800732a0 tx=0x7eff7002a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37a4812e43a8df51 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.585+0000 7f1c5d600640 1 -- 172.21.15.144:0/1946147268 shutdown_connections 2024-09-11T23:18:12.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.585+0000 7eff7fe00640 1 -- 172.21.15.144:0/3551011807 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70037070 con 0x7eff800d2300 2024-09-11T23:18:12.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.585+0000 7eff7fe00640 1 -- 172.21.15.144:0/3551011807 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff70032440 con 0x7eff800d2300 2024-09-11T23:18:12.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.585+0000 7eff7fe00640 1 -- 172.21.15.144:0/3551011807 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70032810 con 0x7eff800d2300 2024-09-11T23:18:12.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.585+0000 7f1c5d600640 1 -- 172.21.15.144:0/1946147268 wait complete. 2024-09-11T23:18:12.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.586+0000 7fe571a00640 1 -- 172.21.15.144:0/759041380 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe56c0cc5e0 con 0x7fe56c06c1f0 2024-09-11T23:18:12.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.586+0000 7fa198400640 1 Processor -- start 2024-09-11T23:18:12.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.586+0000 7eff88400640 1 -- 172.21.15.144:0/3551011807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff800d2300 msgr2=0x7eff800cf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.586+0000 7eff88400640 1 --2- 172.21.15.144:0/3551011807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff800d2300 0x7eff800cf4d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7eff800732a0 tx=0x7eff7002a1e0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.586+0000 7f1226e00640 1 -- 172.21.15.144:0/3063595563 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11fc005290 con 0x7f1218005a60 2024-09-11T23:18:12.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.586+0000 7fa198400640 1 -- start start 2024-09-11T23:18:12.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.585+0000 7fe78ec00640 1 -- 172.21.15.144:0/2724125739 wait complete. 2024-09-11T23:18:12.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.586+0000 7eff88400640 1 -- 172.21.15.144:0/3551011807 shutdown_connections 2024-09-11T23:18:12.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.586+0000 7eff88400640 1 --2- 172.21.15.144:0/3551011807 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff800d31f0 0x7eff800d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.586+0000 7eff88400640 1 --2- 172.21.15.144:0/3551011807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff800d2300 0x7eff800cf4d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.586+0000 7eff88400640 1 --2- 172.21.15.144:0/3551011807 >> v2:172.21.15.144:3300/0 conn(0x7eff80163060 0x7eff800cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.586+0000 7eff88400640 1 -- 172.21.15.144:0/3551011807 >> 172.21.15.144:0/3551011807 conn(0x7eff800b6240 msgr2=0x7eff800b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:12.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.587+0000 7eff88400640 1 -- 172.21.15.144:0/3551011807 shutdown_connections 2024-09-11T23:18:12.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.587+0000 7fe562a00640 1 -- 172.21.15.144:0/759041380 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe55c030960 con 0x7fe56c06c1f0 2024-09-11T23:18:12.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.587+0000 7fe78ec00640 1 Processor -- start 2024-09-11T23:18:12.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.588+0000 7f1c5d600640 1 Processor -- start 2024-09-11T23:18:12.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.588+0000 7fe78ec00640 1 -- start start 2024-09-11T23:18:12.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.588+0000 7fa198400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa19006c490 0x7fa1901654f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.588+0000 7fa198400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1900b3560 0x7fa19015e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.588+0000 7fa198400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1900cfe90 0x7fa1900d0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.588+0000 7fa198400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa1900b4370 con 0x7fa19006c490 2024-09-11T23:18:12.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.588+0000 7fa198400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa190166c60 con 0x7fa1900cfe90 2024-09-11T23:18:12.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.588+0000 7fa198400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa1900b44f0 con 0x7fa1900b3560 2024-09-11T23:18:12.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.588+0000 7f1c5d600640 1 -- start start 2024-09-11T23:18:12.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.588+0000 7fe562a00640 1 --2- 172.21.15.144:0/759041380 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe54c06be80 0x7fe54c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.588+0000 7fe562a00640 1 -- 172.21.15.144:0/759041380 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe55c0ab9a0 con 0x7fe56c06c1f0 2024-09-11T23:18:12.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.589+0000 7f1213e00640 1 -- 172.21.15.144:0/3063595563 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1214044070 con 0x7f1218005a60 2024-09-11T23:18:12.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.589+0000 7fa195000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1900b3560 0x7fa19015e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.589+0000 7fe56aa00640 1 --2- 172.21.15.144:0/759041380 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe54c06be80 0x7fe54c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.589+0000 7fa195000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1900b3560 0x7fa19015e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50388/0 (socket says 172.21.15.144:50388) 2024-09-11T23:18:12.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.589+0000 7fa195000640 1 -- 172.21.15.144:0/3165430508 learned_addr learned my addr 172.21.15.144:0/3165430508 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:12.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.589+0000 7fa195a00640 1 --2- 172.21.15.144:0/3165430508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa19006c490 0x7fa1901654f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.589+0000 7fa196400640 1 --2- 172.21.15.144:0/3165430508 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1900cfe90 0x7fa1900d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.590+0000 7fa195000640 1 -- 172.21.15.144:0/3165430508 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1900cfe90 msgr2=0x7fa1900d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.590+0000 7fa195000640 1 --2- 172.21.15.144:0/3165430508 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1900cfe90 0x7fa1900d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.590+0000 7fe78ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe7880cef90 0x7fe7880cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.590+0000 7fe56aa00640 1 --2- 172.21.15.144:0/759041380 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe54c06be80 0x7fe54c06e340 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe558005880 tx=0x7fe558009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.590+0000 7fa195000640 1 -- 172.21.15.144:0/3165430508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa19006c490 msgr2=0x7fa1901654f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.590+0000 7f1c5d600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c5806c2b0 0x7f1c58157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.590+0000 7f1c5d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c580af900 0x7f1c58073890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.590+0000 7f1c5d600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c58162930 0x7f1c581ee490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.590+0000 7fa195000640 1 --2- 172.21.15.144:0/3165430508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa19006c490 0x7fa1901654f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.590+0000 7fa195000640 1 -- 172.21.15.144:0/3165430508 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1900afaf0 con 0x7fa1900b3560 2024-09-11T23:18:12.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.590+0000 7fe78ec00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe78815e940 0x7fe7880cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.590+0000 7fe78ec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe78815ed20 0x7fe7881e7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.590+0000 7f1c5d600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1c58162d10 con 0x7f1c580af900 2024-09-11T23:18:12.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.590+0000 7f1c5d600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1c580afd90 con 0x7f1c58162930 2024-09-11T23:18:12.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.591+0000 7f1c56a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c5806c2b0 0x7f1c58157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.590+0000 7fa195a00640 1 --2- 172.21.15.144:0/3165430508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa19006c490 0x7fa1901654f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:12.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.591+0000 7fa195000640 1 --2- 172.21.15.144:0/3165430508 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1900b3560 0x7fa19015e0a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00e7e0 tx=0x7fa17c00eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.590+0000 7fa196400640 1 --2- 172.21.15.144:0/3165430508 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1900cfe90 0x7fa1900d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:12.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.591+0000 7f1c5d600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1c580cde00 con 0x7f1c5806c2b0 2024-09-11T23:18:12.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.591+0000 7f1c57400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c58162930 0x7f1c581ee490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.591+0000 7f1c56000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c580af900 0x7f1c58073890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.591+0000 7f1c57400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c58162930 0x7f1c581ee490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:50816/0 (socket says 172.21.15.144:50816) 2024-09-11T23:18:12.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.591+0000 7f1c57400640 1 -- 172.21.15.144:0/353186191 learned_addr learned my addr 172.21.15.144:0/353186191 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:12.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.590+0000 7eff88400640 1 -- 172.21.15.144:0/3551011807 wait complete. 2024-09-11T23:18:12.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.591+0000 7fe787e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe7880cef90 0x7fe7880cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.591+0000 7f1c57400640 1 -- 172.21.15.144:0/353186191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c5806c2b0 msgr2=0x7f1c58157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.591+0000 7f1c57400640 1 --2- 172.21.15.144:0/353186191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c5806c2b0 0x7f1c58157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.591+0000 7f1c57400640 1 -- 172.21.15.144:0/353186191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c580af900 msgr2=0x7f1c58073890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.591+0000 7f1c57400640 1 --2- 172.21.15.144:0/353186191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c580af900 0x7f1c58073890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.591+0000 7f1c57400640 1 -- 172.21.15.144:0/353186191 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c580aa570 con 0x7f1c58162930 2024-09-11T23:18:12.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.592+0000 7f1c56000640 1 --2- 172.21.15.144:0/353186191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c580af900 0x7f1c58073890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:12.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.591+0000 7fe787e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe7880cef90 0x7fe7880cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50394/0 (socket says 172.21.15.144:50394) 2024-09-11T23:18:12.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.591+0000 7fe787400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe78815e940 0x7fe7880cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.591+0000 7fe787400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe78815e940 0x7fe7880cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:50820/0 (socket says 172.21.15.144:50820) 2024-09-11T23:18:12.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.592+0000 7fe78cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe78815ed20 0x7fe7881e7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.592+0000 7eff88400640 1 Processor -- start 2024-09-11T23:18:12.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.592+0000 7f1c57400640 1 --2- 172.21.15.144:0/353186191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c58162930 0x7f1c581ee490 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000c740 tx=0x7f1c5000cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.590+0000 7f1213e00640 1 --2- 172.21.15.144:0/3063595563 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f120006be80 0x7f120006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.590+0000 7f1213e00640 1 -- 172.21.15.144:0/3063595563 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f12140abb90 con 0x7f1218005a60 2024-09-11T23:18:12.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.590+0000 7f121f400640 1 --2- 172.21.15.144:0/3063595563 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f120006be80 0x7f120006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.592+0000 7f121f400640 1 --2- 172.21.15.144:0/3063595563 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f120006be80 0x7f120006e340 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f12180d4ae0 tx=0x7f120c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.592+0000 7fe78ec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe7880d3f00 con 0x7fe78815ed20 2024-09-11T23:18:12.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.592+0000 7eff88400640 1 -- start start 2024-09-11T23:18:12.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.592+0000 7fe787e00640 1 -- 172.21.15.144:0/345368570 learned_addr learned my addr 172.21.15.144:0/345368570 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:12.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.592+0000 7fe78ec00640 1 -- 172.21.15.144:0/345368570 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe7880d3c20 con 0x7fe78815e940 2024-09-11T23:18:12.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.592+0000 7fe78ec00640 1 -- 172.21.15.144:0/345368570 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe7880d3310 con 0x7fe7880cef90 2024-09-11T23:18:12.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.593+0000 7fe562a00640 1 -- 172.21.15.144:0/759041380 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe56c0cc5e0 con 0x7fe56c06c1f0 2024-09-11T23:18:12.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.593+0000 7f1c4ea00640 1 -- 172.21.15.144:0/353186191 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c50016020 con 0x7f1c58162930 2024-09-11T23:18:12.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.593+0000 7f1c4ea00640 1 -- 172.21.15.144:0/353186191 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c5000ce50 con 0x7f1c58162930 2024-09-11T23:18:12.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.593+0000 7f1c4ea00640 1 -- 172.21.15.144:0/353186191 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c50003970 con 0x7f1c58162930 2024-09-11T23:18:12.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.594+0000 7eff88400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff800d2300 0x7eff80159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.594+0000 7eff88400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff800d31f0 0x7eff80163860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.593+0000 7fe787e00640 1 -- 172.21.15.144:0/345368570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe78815e940 msgr2=0x7fe7880cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.593+0000 7fe787e00640 1 --2- 172.21.15.144:0/345368570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe78815e940 0x7fe7880cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.593+0000 7fe787e00640 1 -- 172.21.15.144:0/345368570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe78815ed20 msgr2=0x7fe7881e7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.593+0000 7fe787e00640 1 --2- 172.21.15.144:0/345368570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe78815ed20 0x7fe7881e7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.593+0000 7fe787e00640 1 -- 172.21.15.144:0/345368570 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7880ce620 con 0x7fe7880cef90 2024-09-11T23:18:12.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.593+0000 7fe787400640 1 --2- 172.21.15.144:0/345368570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe78815e940 0x7fe7880cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:12.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.593+0000 7f1c5d600640 1 -- 172.21.15.144:0/353186191 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c58157a20 con 0x7f1c58162930 2024-09-11T23:18:12.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.594+0000 7fe787e00640 1 --2- 172.21.15.144:0/345368570 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe7880cef90 0x7fe7880cc8d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe780009db0 tx=0x7fe78000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.593+0000 7f1c5d600640 1 -- 172.21.15.144:0/353186191 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c580ab4c0 con 0x7f1c58162930 2024-09-11T23:18:12.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.594+0000 7f1213e00640 1 -- 172.21.15.144:0/3063595563 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f121407a640 con 0x7f1218005a60 2024-09-11T23:18:12.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.594+0000 7eff88400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff80163060 0x7eff800c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.594+0000 7eff88400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff800d1420 con 0x7eff80163060 2024-09-11T23:18:12.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.594+0000 7eff88400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7eff800b3ea0 con 0x7eff800d2300 2024-09-11T23:18:12.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.594+0000 7eff88400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7eff800d15a0 con 0x7eff800d31f0 2024-09-11T23:18:12.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.594+0000 7eff85a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff800d2300 0x7eff80159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.594+0000 7eff85000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff800d31f0 0x7eff80163860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.594+0000 7eff85a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff800d2300 0x7eff80159bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:50836/0 (socket says 172.21.15.144:50836) 2024-09-11T23:18:12.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.594+0000 7eff85a00640 1 -- 172.21.15.144:0/3273153470 learned_addr learned my addr 172.21.15.144:0/3273153470 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:12.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.594+0000 7eff85000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff800d31f0 0x7eff80163860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50414/0 (socket says 172.21.15.144:50414) 2024-09-11T23:18:12.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.595+0000 7fa18d600640 1 -- 172.21.15.144:0/3165430508 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c00f040 con 0x7fa1900b3560 2024-09-11T23:18:12.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.595+0000 7fa18d600640 1 -- 172.21.15.144:0/3165430508 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa17c004030 con 0x7fa1900b3560 2024-09-11T23:18:12.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.595+0000 7fa18d600640 1 -- 172.21.15.144:0/3165430508 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0043e0 con 0x7fa1900b3560 2024-09-11T23:18:12.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.594+0000 7eff86400640 1 --2- 172.21.15.144:0/3273153470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff80163060 0x7eff800c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.595+0000 7eff85000640 1 -- 172.21.15.144:0/3273153470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff800d2300 msgr2=0x7eff80159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.595+0000 7eff85000640 1 --2- 172.21.15.144:0/3273153470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff800d2300 0x7eff80159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.595+0000 7eff85000640 1 -- 172.21.15.144:0/3273153470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff80163060 msgr2=0x7eff800c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.595+0000 7eff85000640 1 --2- 172.21.15.144:0/3273153470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff80163060 0x7eff800c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.595+0000 7eff85000640 1 -- 172.21.15.144:0/3273153470 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff80165200 con 0x7eff800d31f0 2024-09-11T23:18:12.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.595+0000 7fa198400640 1 -- 172.21.15.144:0/3165430508 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa19015e5e0 con 0x7fa1900b3560 2024-09-11T23:18:12.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.595+0000 7fa198400640 1 -- 172.21.15.144:0/3165430508 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1900ae9c0 con 0x7fa1900b3560 2024-09-11T23:18:12.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.595+0000 7eff86400640 1 --2- 172.21.15.144:0/3273153470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff80163060 0x7eff800c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:12.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.595+0000 7fe77fe00640 1 -- 172.21.15.144:0/345368570 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe780018020 con 0x7fe7880cef90 2024-09-11T23:18:12.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.595+0000 7fe77fe00640 1 -- 172.21.15.144:0/345368570 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe780014480 con 0x7fe7880cef90 2024-09-11T23:18:12.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.596+0000 7eff85000640 1 --2- 172.21.15.144:0/3273153470 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff800d31f0 0x7eff80163860 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7eff70031000 tx=0x7eff700046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.596+0000 7eff7d600640 1 -- 172.21.15.144:0/3273153470 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70041020 con 0x7eff800d31f0 2024-09-11T23:18:12.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.596+0000 7eff7d600640 1 -- 172.21.15.144:0/3273153470 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff70030780 con 0x7eff800d31f0 2024-09-11T23:18:12.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.596+0000 7fe77fe00640 1 -- 172.21.15.144:0/345368570 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe780014850 con 0x7fe7880cef90 2024-09-11T23:18:12.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.596+0000 7fe78ec00640 1 -- 172.21.15.144:0/345368570 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7880ce900 con 0x7fe7880cef90 2024-09-11T23:18:12.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.596+0000 7fe78ec00640 1 -- 172.21.15.144:0/345368570 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7881e8400 con 0x7fe7880cef90 2024-09-11T23:18:12.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.596+0000 7eff7d600640 1 -- 172.21.15.144:0/3273153470 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70041020 con 0x7eff800d31f0 2024-09-11T23:18:12.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.597+0000 7fa198400640 1 -- 172.21.15.144:0/3165430508 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1900b5780 con 0x7fa1900b3560 2024-09-11T23:18:12.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.598+0000 7eff88400640 1 -- 172.21.15.144:0/3273153470 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff80164160 con 0x7eff800d31f0 2024-09-11T23:18:12.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.598+0000 7eff88400640 1 -- 172.21.15.144:0/3273153470 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7eff80164720 con 0x7eff800d31f0 2024-09-11T23:18:12.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.597+0000 7f1c5d600640 1 -- 172.21.15.144:0/353186191 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c580cd750 con 0x7f1c58162930 2024-09-11T23:18:12.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.597+0000 7f1c4ea00640 1 -- 172.21.15.144:0/353186191 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1c50003b10 con 0x7f1c58162930 2024-09-11T23:18:12.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.599+0000 7fe78ec00640 1 -- 172.21.15.144:0/345368570 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7880d1ef0 con 0x7fe7880cef90 2024-09-11T23:18:12.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.598+0000 7fa18d600640 1 -- 172.21.15.144:0/3165430508 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa17c00c6d0 con 0x7fa1900b3560 2024-09-11T23:18:12.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.600+0000 7f1c4ea00640 1 --2- 172.21.15.144:0/353186191 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1c3806be80 0x7f1c3806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.600+0000 7fa18d600640 1 --2- 172.21.15.144:0/3165430508 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa17006be80 0x7fa17006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.600+0000 7fa18d600640 1 -- 172.21.15.144:0/3165430508 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa17c08aad0 con 0x7fa1900b3560 2024-09-11T23:18:12.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.600+0000 7eff88400640 1 -- 172.21.15.144:0/3273153470 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff800d0ee0 con 0x7eff800d31f0 2024-09-11T23:18:12.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.601+0000 7f1c4ea00640 1 -- 172.21.15.144:0/353186191 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1c5008a930 con 0x7f1c58162930 2024-09-11T23:18:12.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.601+0000 7fa195a00640 1 --2- 172.21.15.144:0/3165430508 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa17006be80 0x7fa17006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.601+0000 7fe77fe00640 1 -- 172.21.15.144:0/345368570 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe780005d10 con 0x7fe7880cef90 2024-09-11T23:18:12.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.601+0000 7f1c56a00640 1 --2- 172.21.15.144:0/353186191 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1c3806be80 0x7f1c3806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.602+0000 7fa195a00640 1 --2- 172.21.15.144:0/3165430508 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa17006be80 0x7fa17006e340 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa184001640 tx=0x7fa184009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.603+0000 7fe77fe00640 1 --2- 172.21.15.144:0/345368570 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe76806bf00 0x7fe76806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.603+0000 7fe77fe00640 1 -- 172.21.15.144:0/345368570 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe78008bb80 con 0x7fe7880cef90 2024-09-11T23:18:12.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.603+0000 7fe787400640 1 --2- 172.21.15.144:0/345368570 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe76806bf00 0x7fe76806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.602+0000 7eff7d600640 1 -- 172.21.15.144:0/3273153470 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff70044020 con 0x7eff800d31f0 2024-09-11T23:18:12.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.604+0000 7fe787400640 1 --2- 172.21.15.144:0/345368570 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe76806bf00 0x7fe76806e3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe7880732a0 tx=0x7fe778009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.604+0000 7eff7d600640 1 --2- 172.21.15.144:0/3273153470 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7eff6006c030 0x7eff6006e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:12.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.604+0000 7eff7d600640 1 -- 172.21.15.144:0/3273153470 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7eff700ab130 con 0x7eff800d31f0 2024-09-11T23:18:12.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.604+0000 7fa18d600640 1 -- 172.21.15.144:0/3165430508 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa17c017020 con 0x7fa1900b3560 2024-09-11T23:18:12.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.604+0000 7eff85a00640 1 --2- 172.21.15.144:0/3273153470 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7eff6006c030 0x7eff6006e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:12.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.605+0000 7f1c4ea00640 1 -- 172.21.15.144:0/353186191 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1c50020020 con 0x7f1c58162930 2024-09-11T23:18:12.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.605+0000 7eff85a00640 1 --2- 172.21.15.144:0/3273153470 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7eff6006c030 0x7eff6006e4f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7eff801fc280 tx=0x7eff6c006f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.606+0000 7f1c56a00640 1 --2- 172.21.15.144:0/353186191 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1c3806be80 0x7f1c3806e340 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1c48033000 tx=0x7f1c48008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:12.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.610+0000 7fe77fe00640 1 -- 172.21.15.144:0/345368570 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe780022030 con 0x7fe7880cef90 2024-09-11T23:18:12.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.615+0000 7eff7d600640 1 -- 172.21.15.144:0/3273153470 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7eff7004b030 con 0x7eff800d31f0 2024-09-11T23:18:12.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.925+0000 7f4466800640 1 -- 172.21.15.144:0/2767157733 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4438005580 con 0x7f446015ed20 2024-09-11T23:18:12.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.926+0000 7f4457400640 1 -- 172.21.15.144:0/2767157733 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f444c059620 con 0x7f446015ed20 2024-09-11T23:18:12.926 INFO:teuthology.orchestra.run.smithi144.stdout:60129542151 2024-09-11T23:18:12.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.929+0000 7f4466800640 1 -- 172.21.15.144:0/2767157733 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f444006bf00 msgr2=0x7f444006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.930+0000 7f4466800640 1 --2- 172.21.15.144:0/2767157733 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f444006bf00 0x7f444006e3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4450009560 tx=0x7f4450008040 comp rx=0 tx=0).stop 2024-09-11T23:18:12.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.930+0000 7f4466800640 1 -- 172.21.15.144:0/2767157733 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f446015ed20 msgr2=0x7f44600b4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.930+0000 7f4466800640 1 --2- 172.21.15.144:0/2767157733 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f446015ed20 0x7f44600b4da0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f444c001550 tx=0x7f444c00c8e0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.931+0000 7f4466800640 1 -- 172.21.15.144:0/2767157733 shutdown_connections 2024-09-11T23:18:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.931+0000 7f4466800640 1 --2- 172.21.15.144:0/2767157733 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f444006bf00 0x7f444006e3c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.931+0000 7f4466800640 1 --2- 172.21.15.144:0/2767157733 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f446015ed20 0x7f44600b4da0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.931+0000 7f4466800640 1 --2- 172.21.15.144:0/2767157733 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f446015e940 0x7f446015b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.931+0000 7f4466800640 1 --2- 172.21.15.144:0/2767157733 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f44600cef90 0x7f4460153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.931+0000 7f4466800640 1 -- 172.21.15.144:0/2767157733 >> 172.21.15.144:0/2767157733 conn(0x7f44600b6240 msgr2=0x7f44600b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:12.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.932+0000 7f4466800640 1 -- 172.21.15.144:0/2767157733 shutdown_connections 2024-09-11T23:18:12.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.932+0000 7f4466800640 1 -- 172.21.15.144:0/2767157733 wait complete. 2024-09-11T23:18:12.936 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:18:12.951 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:18:12.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.3 2024-09-11T23:18:12.965 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:12.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.980+0000 7f4ebe200640 1 -- 172.21.15.144:0/3241512253 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f4eb003e9b0 con 0x7f4eb0057830 2024-09-11T23:18:12.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.981+0000 7f4eab400640 1 -- 172.21.15.144:0/3241512253 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4ea405d240 con 0x7f4eb0057830 2024-09-11T23:18:12.981 INFO:teuthology.orchestra.run.smithi144.stdout:60129542151 2024-09-11T23:18:12.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.986+0000 7f4ebe200640 1 -- 172.21.15.144:0/3241512253 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4e9806c230 msgr2=0x7f4e9806e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.987+0000 7f4ebe200640 1 --2- 172.21.15.144:0/3241512253 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4e9806c230 0x7f4e9806e6f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4eac034000 tx=0x7f4eac02e000 comp rx=0 tx=0).stop 2024-09-11T23:18:12.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.987+0000 7f4ebe200640 1 -- 172.21.15.144:0/3241512253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4eb0057830 msgr2=0x7f4eb00e4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:12.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.987+0000 7f4ebe200640 1 --2- 172.21.15.144:0/3241512253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4eb0057830 0x7f4eb00e4e40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400e980 tx=0x7f4ea400ee40 comp rx=0 tx=0).stop 2024-09-11T23:18:12.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.988+0000 7f4ebe200640 1 -- 172.21.15.144:0/3241512253 shutdown_connections 2024-09-11T23:18:12.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.988+0000 7f4ebe200640 1 --2- 172.21.15.144:0/3241512253 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4e9806c230 0x7f4e9806e6f0 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4eac034000 tx=0x7f4eac02e000 comp rx=0 tx=0).stop 2024-09-11T23:18:12.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.988+0000 7f4ebe200640 1 --2- 172.21.15.144:0/3241512253 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4eb00e28f0 0x7f4eb004e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.988+0000 7f4ebe200640 1 --2- 172.21.15.144:0/3241512253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4eb0057830 0x7f4eb00e4e40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.988+0000 7f4ebe200640 1 --2- 172.21.15.144:0/3241512253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4eb003bc60 0x7f4eb00d8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:12.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.988+0000 7f4ebe200640 1 -- 172.21.15.144:0/3241512253 >> 172.21.15.144:0/3241512253 conn(0x7f4eb003a520 msgr2=0x7f4eb0053290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:12.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.990+0000 7f4ebe200640 1 -- 172.21.15.144:0/3241512253 shutdown_connections 2024-09-11T23:18:12.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.990+0000 7f4ebe200640 1 -- 172.21.15.144:0/3241512253 wait complete. 2024-09-11T23:18:12.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.996+0000 7fe571a00640 1 -- 172.21.15.144:0/759041380 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe56c0d08f0 con 0x7fe56c06c1f0 2024-09-11T23:18:12.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:12.997+0000 7fe562a00640 1 -- 172.21.15.144:0/759041380 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe56c145140 con 0x7fe56c06c1f0 2024-09-11T23:18:12.996 INFO:teuthology.orchestra.run.smithi144.stdout:68719476743 2024-09-11T23:18:13.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.002+0000 7fe571a00640 1 -- 172.21.15.144:0/759041380 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe54c06be80 msgr2=0x7fe54c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.002+0000 7fe571a00640 1 --2- 172.21.15.144:0/759041380 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe54c06be80 0x7fe54c06e340 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe558005880 tx=0x7fe558009040 comp rx=0 tx=0).stop 2024-09-11T23:18:13.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.002+0000 7fe571a00640 1 -- 172.21.15.144:0/759041380 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe56c06c1f0 msgr2=0x7fe56c072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.002+0000 7fe571a00640 1 --2- 172.21.15.144:0/759041380 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe56c06c1f0 0x7fe56c072160 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe55c02a6f0 tx=0x7fe55c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.002+0000 7fe571a00640 1 -- 172.21.15.144:0/759041380 shutdown_connections 2024-09-11T23:18:13.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.002+0000 7fe571a00640 1 --2- 172.21.15.144:0/759041380 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe54c06be80 0x7fe54c06e340 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.002+0000 7fe571a00640 1 --2- 172.21.15.144:0/759041380 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe56c1446e0 0x7fe56c1566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.002+0000 7fe571a00640 1 --2- 172.21.15.144:0/759041380 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe56c06c1f0 0x7fe56c072160 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.002+0000 7fe571a00640 1 --2- 172.21.15.144:0/759041380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe56c06be10 0x7fe56c158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.002+0000 7fe571a00640 1 -- 172.21.15.144:0/759041380 >> 172.21.15.144:0/759041380 conn(0x7fe56c062cc0 msgr2=0x7fe56c159490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:13.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.003+0000 7fe571a00640 1 -- 172.21.15.144:0/759041380 shutdown_connections 2024-09-11T23:18:13.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.003+0000 7fe571a00640 1 -- 172.21.15.144:0/759041380 wait complete. 2024-09-11T23:18:13.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.009+0000 7f1226e00640 1 -- 172.21.15.144:0/3063595563 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f11fc005850 con 0x7f1218005a60 2024-09-11T23:18:13.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.009+0000 7f1213e00640 1 -- 172.21.15.144:0/3063595563 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f12140ab030 con 0x7f1218005a60 2024-09-11T23:18:13.009 INFO:teuthology.orchestra.run.smithi144.stdout:68719476745 2024-09-11T23:18:13.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.012+0000 7fa198400640 1 -- 172.21.15.144:0/3165430508 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa1900b1750 con 0x7fa1900b3560 2024-09-11T23:18:13.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.013+0000 7fa18d600640 1 -- 172.21.15.144:0/3165430508 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa17c0595f0 con 0x7fa1900b3560 2024-09-11T23:18:13.013 INFO:teuthology.orchestra.run.smithi144.stdout:68719476744 2024-09-11T23:18:13.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.013+0000 7fe78ec00640 1 -- 172.21.15.144:0/345368570 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe7880ba6b0 con 0x7fe7880cef90 2024-09-11T23:18:13.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.013+0000 7f1226e00640 1 -- 172.21.15.144:0/3063595563 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f120006be80 msgr2=0x7f120006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.013+0000 7f1226e00640 1 --2- 172.21.15.144:0/3063595563 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f120006be80 0x7f120006e340 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f12180d4ae0 tx=0x7f120c009040 comp rx=0 tx=0).stop 2024-09-11T23:18:13.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.014+0000 7f1226e00640 1 -- 172.21.15.144:0/3063595563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1218005a60 msgr2=0x7f12180d2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.014+0000 7f1226e00640 1 --2- 172.21.15.144:0/3063595563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1218005a60 0x7f12180d2610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1214034040 tx=0x7f12140046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.014+0000 7f1226e00640 1 -- 172.21.15.144:0/3063595563 shutdown_connections 2024-09-11T23:18:13.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.014+0000 7f1226e00640 1 --2- 172.21.15.144:0/3063595563 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f120006be80 0x7f120006e340 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.014+0000 7f1226e00640 1 --2- 172.21.15.144:0/3063595563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12180e7120 0x7f12180ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.014+0000 7f1226e00640 1 --2- 172.21.15.144:0/3063595563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f121804eb60 0x7f12180373d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.014+0000 7f1226e00640 1 --2- 172.21.15.144:0/3063595563 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1218005a60 0x7f12180d2610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.014+0000 7f1226e00640 1 -- 172.21.15.144:0/3063595563 >> 172.21.15.144:0/3063595563 conn(0x7f1218036090 msgr2=0x7f1218031190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:13.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.014+0000 7fe77fe00640 1 -- 172.21.15.144:0/345368570 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe780010040 con 0x7fe7880cef90 2024-09-11T23:18:13.016 INFO:teuthology.orchestra.run.smithi144.stdout:64424509447 2024-09-11T23:18:13.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.016+0000 7f1226e00640 1 -- 172.21.15.144:0/3063595563 shutdown_connections 2024-09-11T23:18:13.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.016+0000 7fa198400640 1 -- 172.21.15.144:0/3165430508 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa17006be80 msgr2=0x7fa17006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.016+0000 7fa198400640 1 --2- 172.21.15.144:0/3165430508 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa17006be80 0x7fa17006e340 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa184001640 tx=0x7fa184009040 comp rx=0 tx=0).stop 2024-09-11T23:18:13.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.016+0000 7fa198400640 1 -- 172.21.15.144:0/3165430508 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1900b3560 msgr2=0x7fa19015e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.016+0000 7fa198400640 1 --2- 172.21.15.144:0/3165430508 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1900b3560 0x7fa19015e0a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00e7e0 tx=0x7fa17c00eca0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.016+0000 7f1226e00640 1 -- 172.21.15.144:0/3063595563 wait complete. 2024-09-11T23:18:13.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.017+0000 7fa198400640 1 -- 172.21.15.144:0/3165430508 shutdown_connections 2024-09-11T23:18:13.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.017+0000 7fa198400640 1 --2- 172.21.15.144:0/3165430508 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa17006be80 0x7fa17006e340 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.017+0000 7fa198400640 1 --2- 172.21.15.144:0/3165430508 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1900cfe90 0x7fa1900d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.017+0000 7fa198400640 1 --2- 172.21.15.144:0/3165430508 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1900b3560 0x7fa19015e0a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.017+0000 7fa198400640 1 --2- 172.21.15.144:0/3165430508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa19006c490 0x7fa1901654f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.017+0000 7fa198400640 1 -- 172.21.15.144:0/3165430508 >> 172.21.15.144:0/3165430508 conn(0x7fa1900b2040 msgr2=0x7fa19006bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:13.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.017+0000 7fa198400640 1 -- 172.21.15.144:0/3165430508 shutdown_connections 2024-09-11T23:18:13.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.017+0000 7fa198400640 1 -- 172.21.15.144:0/3165430508 wait complete. 2024-09-11T23:18:13.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.018+0000 7fe78ec00640 1 -- 172.21.15.144:0/345368570 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe76806bf00 msgr2=0x7fe76806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.018+0000 7fe78ec00640 1 --2- 172.21.15.144:0/345368570 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe76806bf00 0x7fe76806e3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe7880732a0 tx=0x7fe778009040 comp rx=0 tx=0).stop 2024-09-11T23:18:13.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.018+0000 7fe78ec00640 1 -- 172.21.15.144:0/345368570 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe7880cef90 msgr2=0x7fe7880cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.018+0000 7fe78ec00640 1 --2- 172.21.15.144:0/345368570 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe7880cef90 0x7fe7880cc8d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe780009db0 tx=0x7fe78000c490 comp rx=0 tx=0).stop 2024-09-11T23:18:13.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.2 2024-09-11T23:18:13.020 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:13.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.018+0000 7fe78ec00640 1 -- 172.21.15.144:0/345368570 shutdown_connections 2024-09-11T23:18:13.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.018+0000 7fe78ec00640 1 --2- 172.21.15.144:0/345368570 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe76806bf00 0x7fe76806e3c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.018+0000 7fe78ec00640 1 --2- 172.21.15.144:0/345368570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe78815ed20 0x7fe7881e7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.018+0000 7fe78ec00640 1 --2- 172.21.15.144:0/345368570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe78815e940 0x7fe7880cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.018+0000 7fe78ec00640 1 --2- 172.21.15.144:0/345368570 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe7880cef90 0x7fe7880cc8d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.018+0000 7fe78ec00640 1 -- 172.21.15.144:0/345368570 >> 172.21.15.144:0/345368570 conn(0x7fe7880b6240 msgr2=0x7fe7880d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:13.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.018+0000 7fe78ec00640 1 -- 172.21.15.144:0/345368570 shutdown_connections 2024-09-11T23:18:13.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.018+0000 7fe78ec00640 1 -- 172.21.15.144:0/345368570 wait complete. 2024-09-11T23:18:13.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.022+0000 7f1c5d600640 1 -- 172.21.15.144:0/353186191 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f1c580b20f0 con 0x7f1c58162930 2024-09-11T23:18:13.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.022+0000 7f1c4ea00640 1 -- 172.21.15.144:0/353186191 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1c50058d00 con 0x7f1c58162930 2024-09-11T23:18:13.023 INFO:teuthology.orchestra.run.smithi144.stdout:68719476743 2024-09-11T23:18:13.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.026+0000 7f1c5d600640 1 -- 172.21.15.144:0/353186191 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1c3806be80 msgr2=0x7f1c3806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.026+0000 7f1c5d600640 1 --2- 172.21.15.144:0/353186191 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1c3806be80 0x7f1c3806e340 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1c48033000 tx=0x7f1c48008030 comp rx=0 tx=0).stop 2024-09-11T23:18:13.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.026+0000 7f1c5d600640 1 -- 172.21.15.144:0/353186191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c58162930 msgr2=0x7f1c581ee490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.026+0000 7f1c5d600640 1 --2- 172.21.15.144:0/353186191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c58162930 0x7f1c581ee490 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000c740 tx=0x7f1c5000cc00 comp rx=0 tx=0).stop 2024-09-11T23:18:13.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.027+0000 7f1c5d600640 1 -- 172.21.15.144:0/353186191 shutdown_connections 2024-09-11T23:18:13.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.027+0000 7f1c5d600640 1 --2- 172.21.15.144:0/353186191 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1c3806be80 0x7f1c3806e340 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.027+0000 7f1c5d600640 1 --2- 172.21.15.144:0/353186191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c58162930 0x7f1c581ee490 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.027+0000 7f1c5d600640 1 --2- 172.21.15.144:0/353186191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c580af900 0x7f1c58073890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.027+0000 7f1c5d600640 1 --2- 172.21.15.144:0/353186191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c5806c2b0 0x7f1c58157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.027+0000 7f1c5d600640 1 -- 172.21.15.144:0/353186191 >> 172.21.15.144:0/353186191 conn(0x7f1c58062cc0 msgr2=0x7f1c5806bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:13.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.028+0000 7f1c5d600640 1 -- 172.21.15.144:0/353186191 shutdown_connections 2024-09-11T23:18:13.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.029+0000 7f1c5d600640 1 -- 172.21.15.144:0/353186191 wait complete. 2024-09-11T23:18:13.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.5 2024-09-11T23:18:13.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.032+0000 7eff88400640 1 -- 172.21.15.144:0/3273153470 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7eff800cd9c0 con 0x7eff800d31f0 2024-09-11T23:18:13.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.033+0000 7eff7d600640 1 -- 172.21.15.144:0/3273153470 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7eff70079ae0 con 0x7eff800d31f0 2024-09-11T23:18:13.034 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:13.034 INFO:teuthology.orchestra.run.smithi144.stdout:64424509447 2024-09-11T23:18:13.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.036+0000 7eff88400640 1 -- 172.21.15.144:0/3273153470 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7eff6006c030 msgr2=0x7eff6006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.036+0000 7eff88400640 1 --2- 172.21.15.144:0/3273153470 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7eff6006c030 0x7eff6006e4f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7eff801fc280 tx=0x7eff6c006f90 comp rx=0 tx=0).stop 2024-09-11T23:18:13.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.036+0000 7eff88400640 1 -- 172.21.15.144:0/3273153470 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff800d31f0 msgr2=0x7eff80163860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.036+0000 7eff88400640 1 --2- 172.21.15.144:0/3273153470 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff800d31f0 0x7eff80163860 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7eff70031000 tx=0x7eff700046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.037+0000 7eff88400640 1 -- 172.21.15.144:0/3273153470 shutdown_connections 2024-09-11T23:18:13.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.037+0000 7eff88400640 1 --2- 172.21.15.144:0/3273153470 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7eff6006c030 0x7eff6006e4f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.037+0000 7eff88400640 1 --2- 172.21.15.144:0/3273153470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff80163060 0x7eff800c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.037+0000 7eff88400640 1 --2- 172.21.15.144:0/3273153470 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff800d31f0 0x7eff80163860 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.037+0000 7eff88400640 1 --2- 172.21.15.144:0/3273153470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff800d2300 0x7eff80159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.037+0000 7eff88400640 1 -- 172.21.15.144:0/3273153470 >> 172.21.15.144:0/3273153470 conn(0x7eff800b6240 msgr2=0x7eff800cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:13.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.037+0000 7eff88400640 1 -- 172.21.15.144:0/3273153470 shutdown_connections 2024-09-11T23:18:13.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.037+0000 7eff88400640 1 -- 172.21.15.144:0/3273153470 wait complete. 2024-09-11T23:18:13.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476744 got 68719476744 for osd.6 2024-09-11T23:18:13.046 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:13.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476745 got 68719476745 for osd.7 2024-09-11T23:18:13.047 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:13.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2024-09-11T23:18:13.047 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:13.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.4 2024-09-11T23:18:13.052 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:13.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2024-09-11T23:18:13.058 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:13.059 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:18:13.059 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:18:13.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.260+0000 7f82e6e00640 1 Processor -- start 2024-09-11T23:18:13.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.260+0000 7f82e6e00640 1 -- start start 2024-09-11T23:18:13.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.261+0000 7f82e6e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82e015e640 0x7f82e00d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:13.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.262+0000 7f82e6e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f82e00d3f60 0x7f82e00b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:13.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.262+0000 7f82e6e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f82e00b6510 0x7f82e00d27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:13.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.262+0000 7f82e6e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f82e015ea20 con 0x7f82e00b6510 2024-09-11T23:18:13.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.262+0000 7f82e6e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f82e006caf0 con 0x7f82e00d3f60 2024-09-11T23:18:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.262+0000 7f82e6e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f82e006bee0 con 0x7f82e015e640 2024-09-11T23:18:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.262+0000 7f82e6400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f82e00b6510 0x7f82e00d27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.262+0000 7f82e6400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f82e00b6510 0x7f82e00d27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49560/0 (socket says 172.21.15.144:49560) 2024-09-11T23:18:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.262+0000 7f82e6400640 1 -- 172.21.15.144:0/1285935735 learned_addr learned my addr 172.21.15.144:0/1285935735 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.262+0000 7f82e5a00640 1 --2- 172.21.15.144:0/1285935735 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82e015e640 0x7f82e00d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.262+0000 7f82e5000640 1 --2- 172.21.15.144:0/1285935735 >> v2:172.21.15.165:3300/0 conn(0x7f82e00d3f60 0x7f82e00b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.262+0000 7f82e6400640 1 -- 172.21.15.144:0/1285935735 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82e015e640 msgr2=0x7f82e00d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.262+0000 7f82e6400640 1 --2- 172.21.15.144:0/1285935735 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82e015e640 0x7f82e00d3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.262+0000 7f82e6400640 1 -- 172.21.15.144:0/1285935735 >> v2:172.21.15.165:3300/0 conn(0x7f82e00d3f60 msgr2=0x7f82e00b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.262+0000 7f82e6400640 1 --2- 172.21.15.144:0/1285935735 >> v2:172.21.15.165:3300/0 conn(0x7f82e00d3f60 0x7f82e00b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.262+0000 7f82e6400640 1 -- 172.21.15.144:0/1285935735 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e006c1c0 con 0x7f82e00b6510 2024-09-11T23:18:13.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.263+0000 7f82e6400640 1 --2- 172.21.15.144:0/1285935735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e00b6510 0x7f82e00d27c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f82e00d5650 tx=0x7f82d802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e83d499c7e6a378 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:13.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.263+0000 7f82dfe00640 1 -- 172.21.15.144:0/1285935735 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d8036070 con 0x7f82e00b6510 2024-09-11T23:18:13.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.263+0000 7f82dfe00640 1 -- 172.21.15.144:0/1285935735 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d8031600 con 0x7f82e00b6510 2024-09-11T23:18:13.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.263+0000 7f82dfe00640 1 -- 172.21.15.144:0/1285935735 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d80319d0 con 0x7f82e00b6510 2024-09-11T23:18:13.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.264+0000 7f82e6e00640 1 -- 172.21.15.144:0/1285935735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e00b6510 msgr2=0x7f82e00d27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.264+0000 7f82e6e00640 1 --2- 172.21.15.144:0/1285935735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e00b6510 0x7f82e00d27c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f82e00d5650 tx=0x7f82d802a6a0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.264+0000 7f82e6e00640 1 -- 172.21.15.144:0/1285935735 shutdown_connections 2024-09-11T23:18:13.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.264+0000 7f82e6e00640 1 --2- 172.21.15.144:0/1285935735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e00b6510 0x7f82e00d27c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.264+0000 7f82e6e00640 1 --2- 172.21.15.144:0/1285935735 >> v2:172.21.15.165:3300/0 conn(0x7f82e00d3f60 0x7f82e00b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.264+0000 7f82e6e00640 1 --2- 172.21.15.144:0/1285935735 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82e015e640 0x7f82e00d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.264+0000 7f82e6e00640 1 -- 172.21.15.144:0/1285935735 >> 172.21.15.144:0/1285935735 conn(0x7f82e00d0fd0 msgr2=0x7f82e00d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:13.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.264+0000 7f82e6e00640 1 -- 172.21.15.144:0/1285935735 shutdown_connections 2024-09-11T23:18:13.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.264+0000 7f82e6e00640 1 -- 172.21.15.144:0/1285935735 wait complete. 2024-09-11T23:18:13.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.266+0000 7f82e6e00640 1 Processor -- start 2024-09-11T23:18:13.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.266+0000 7f82e6e00640 1 -- start start 2024-09-11T23:18:13.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.267+0000 7f82e6e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82e00b6510 0x7f82e00ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:13.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.267+0000 7f82e6e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e00d3f60 0x7f82e0151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:13.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.267+0000 7f82e6e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82e015e640 0x7f82e0160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:13.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.267+0000 7f82e6e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f82e00d2d00 con 0x7f82e00d3f60 2024-09-11T23:18:13.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.267+0000 7f82e6e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f82e006c780 con 0x7f82e015e640 2024-09-11T23:18:13.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.267+0000 7f82e6e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f82e00d2e80 con 0x7f82e00b6510 2024-09-11T23:18:13.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.267+0000 7f82e5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e00d3f60 0x7f82e0151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:13.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.267+0000 7f82e5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e00d3f60 0x7f82e0151930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49574/0 (socket says 172.21.15.144:49574) 2024-09-11T23:18:13.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.267+0000 7f82e5000640 1 -- 172.21.15.144:0/1692877165 learned_addr learned my addr 172.21.15.144:0/1692877165 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.267+0000 7f82e5a00640 1 --2- 172.21.15.144:0/1692877165 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82e00b6510 0x7f82e00ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.267+0000 7f82e6400640 1 --2- 172.21.15.144:0/1692877165 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82e015e640 0x7f82e0160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.267+0000 7f82e5000640 1 -- 172.21.15.144:0/1692877165 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82e00b6510 msgr2=0x7f82e00ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.267+0000 7f82e5000640 1 --2- 172.21.15.144:0/1692877165 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82e00b6510 0x7f82e00ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.267+0000 7f82e5000640 1 -- 172.21.15.144:0/1692877165 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82e015e640 msgr2=0x7f82e0160bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.268+0000 7f82e5000640 1 --2- 172.21.15.144:0/1692877165 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82e015e640 0x7f82e0160bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.268+0000 7f82e5000640 1 -- 172.21.15.144:0/1692877165 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e00cd100 con 0x7f82e00d3f60 2024-09-11T23:18:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.268+0000 7f82e5000640 1 --2- 172.21.15.144:0/1692877165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e00d3f60 0x7f82e0151930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00e980 tx=0x7f82cc00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.268+0000 7f82dd600640 1 -- 172.21.15.144:0/1692877165 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc017070 con 0x7f82e00d3f60 2024-09-11T23:18:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.268+0000 7f82dd600640 1 -- 172.21.15.144:0/1692877165 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82cc00ca00 con 0x7f82e00d3f60 2024-09-11T23:18:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.268+0000 7f82dd600640 1 -- 172.21.15.144:0/1692877165 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc00cdd0 con 0x7f82e00d3f60 2024-09-11T23:18:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.268+0000 7f82e6e00640 1 -- 172.21.15.144:0/1692877165 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e00cd3e0 con 0x7f82e00d3f60 2024-09-11T23:18:13.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.268+0000 7f82e6e00640 1 -- 172.21.15.144:0/1692877165 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e00cd9a0 con 0x7f82e00d3f60 2024-09-11T23:18:13.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.269+0000 7f82e6e00640 1 -- 172.21.15.144:0/1692877165 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82e00d32b0 con 0x7f82e00d3f60 2024-09-11T23:18:13.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.270+0000 7f82dd600640 1 -- 172.21.15.144:0/1692877165 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f82cc01a070 con 0x7f82e00d3f60 2024-09-11T23:18:13.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.271+0000 7f82dd600640 1 --2- 172.21.15.144:0/1692877165 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f82c006be30 0x7f82c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:13.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.271+0000 7f82dd600640 1 -- 172.21.15.144:0/1692877165 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f82cc08b140 con 0x7f82e00d3f60 2024-09-11T23:18:13.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.271+0000 7f82e5a00640 1 --2- 172.21.15.144:0/1692877165 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f82c006be30 0x7f82c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:13.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.272+0000 7f82e5a00640 1 --2- 172.21.15.144:0/1692877165 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f82c006be30 0x7f82c006e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009a20 tx=0x7f82d4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:13.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.275+0000 7f82dd600640 1 -- 172.21.15.144:0/1692877165 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f82cc059490 con 0x7f82e00d3f60 2024-09-11T23:18:13.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.447+0000 7f82e6e00640 1 -- 172.21.15.144:0/1692877165 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f82e00cb120 con 0x7f82c006be30 2024-09-11T23:18:13.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.453+0000 7f82dd600640 1 -- 172.21.15.144:0/1692877165 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251835 (secure 0 0 0) 0x7f82d4011940 con 0x7f82c006be30 2024-09-11T23:18:13.456 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:13.457 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:18:13.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.457+0000 7f82e6e00640 1 -- 172.21.15.144:0/1692877165 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f82c006be30 msgr2=0x7f82c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.457+0000 7f82e6e00640 1 --2- 172.21.15.144:0/1692877165 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f82c006be30 0x7f82c006e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009a20 tx=0x7f82d4009190 comp rx=0 tx=0).stop 2024-09-11T23:18:13.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.457+0000 7f82e6e00640 1 -- 172.21.15.144:0/1692877165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e00d3f60 msgr2=0x7f82e0151930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.457+0000 7f82e6e00640 1 --2- 172.21.15.144:0/1692877165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e00d3f60 0x7f82e0151930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00e980 tx=0x7f82cc00ee40 comp rx=0 tx=0).stop 2024-09-11T23:18:13.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.457+0000 7f82e6e00640 1 -- 172.21.15.144:0/1692877165 shutdown_connections 2024-09-11T23:18:13.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.457+0000 7f82e6e00640 1 --2- 172.21.15.144:0/1692877165 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f82c006be30 0x7f82c006e2f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.457+0000 7f82e6e00640 1 --2- 172.21.15.144:0/1692877165 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82e015e640 0x7f82e0160bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.457+0000 7f82e6e00640 1 --2- 172.21.15.144:0/1692877165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82e00d3f60 0x7f82e0151930 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.457+0000 7f82e6e00640 1 --2- 172.21.15.144:0/1692877165 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82e00b6510 0x7f82e00ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.457+0000 7f82e6e00640 1 -- 172.21.15.144:0/1692877165 >> 172.21.15.144:0/1692877165 conn(0x7f82e00d0fd0 msgr2=0x7f82e00cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:13.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.457+0000 7f82e6e00640 1 -- 172.21.15.144:0/1692877165 shutdown_connections 2024-09-11T23:18:13.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.457+0000 7f82e6e00640 1 -- 172.21.15.144:0/1692877165 wait complete. 2024-09-11T23:18:13.473 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-11T23:18:13.164967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219188,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755532,"statfs":{"total":773094113280,"available":772869664768,"internally_reserved":0,"allocated":2990080,"data_stored":1792852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002680"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643816+0000","last_change":"2024-09-11T23:17:59.655120+0000","last_active":"2024-09-11T23:18:00.643816+0000","last_peered":"2024-09-11T23:18:00.643816+0000","last_clean":"2024-09-11T23:18:00.643816+0000","last_became_active":"2024-09-11T23:17:59.654860+0000","last_became_peered":"2024-09-11T23:17:59.654860+0000","last_unstale":"2024-09-11T23:18:00.643816+0000","last_undegraded":"2024-09-11T23:18:00.643816+0000","last_fullsized":"2024-09-11T23:18:00.643816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:25.734147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642029+0000","last_change":"2024-09-11T23:17:59.641566+0000","last_active":"2024-09-11T23:18:00.642029+0000","last_peered":"2024-09-11T23:18:00.642029+0000","last_clean":"2024-09-11T23:18:00.642029+0000","last_became_active":"2024-09-11T23:17:59.641276+0000","last_became_peered":"2024-09-11T23:17:59.641276+0000","last_unstale":"2024-09-11T23:18:00.642029+0000","last_undegraded":"2024-09-11T23:18:00.642029+0000","last_fullsized":"2024-09-11T23:18:00.642029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.341838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669562+0000","last_change":"2024-09-11T23:17:59.635790+0000","last_active":"2024-09-11T23:18:00.669562+0000","last_peered":"2024-09-11T23:18:00.669562+0000","last_clean":"2024-09-11T23:18:00.669562+0000","last_became_active":"2024-09-11T23:17:59.635509+0000","last_became_peered":"2024-09-11T23:17:59.635509+0000","last_unstale":"2024-09-11T23:18:00.669562+0000","last_undegraded":"2024-09-11T23:18:00.669562+0000","last_fullsized":"2024-09-11T23:18:00.669562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.193032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644696+0000","last_change":"2024-09-11T23:17:59.644202+0000","last_active":"2024-09-11T23:18:00.644696+0000","last_peered":"2024-09-11T23:18:00.644696+0000","last_clean":"2024-09-11T23:18:00.644696+0000","last_became_active":"2024-09-11T23:17:59.643634+0000","last_became_peered":"2024-09-11T23:17:59.643634+0000","last_unstale":"2024-09-11T23:18:00.644696+0000","last_undegraded":"2024-09-11T23:18:00.644696+0000","last_fullsized":"2024-09-11T23:18:00.644696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:38.039621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643545+0000","last_change":"2024-09-11T23:17:59.652783+0000","last_active":"2024-09-11T23:18:00.643545+0000","last_peered":"2024-09-11T23:18:00.643545+0000","last_clean":"2024-09-11T23:18:00.643545+0000","last_became_active":"2024-09-11T23:17:59.652508+0000","last_became_peered":"2024-09-11T23:17:59.652508+0000","last_unstale":"2024-09-11T23:18:00.643545+0000","last_undegraded":"2024-09-11T23:18:00.643545+0000","last_fullsized":"2024-09-11T23:18:00.643545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:04.566161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642782+0000","last_change":"2024-09-11T23:17:59.659401+0000","last_active":"2024-09-11T23:18:00.642782+0000","last_peered":"2024-09-11T23:18:00.642782+0000","last_clean":"2024-09-11T23:18:00.642782+0000","last_became_active":"2024-09-11T23:17:59.655926+0000","last_became_peered":"2024-09-11T23:17:59.655926+0000","last_unstale":"2024-09-11T23:18:00.642782+0000","last_undegraded":"2024-09-11T23:18:00.642782+0000","last_fullsized":"2024-09-11T23:18:00.642782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:09.804490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643447+0000","last_change":"2024-09-11T23:17:59.657900+0000","last_active":"2024-09-11T23:18:00.643447+0000","last_peered":"2024-09-11T23:18:00.643447+0000","last_clean":"2024-09-11T23:18:00.643447+0000","last_became_active":"2024-09-11T23:17:59.657621+0000","last_became_peered":"2024-09-11T23:17:59.657621+0000","last_unstale":"2024-09-11T23:18:00.643447+0000","last_undegraded":"2024-09-11T23:18:00.643447+0000","last_fullsized":"2024-09-11T23:18:00.643447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:14.020762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669094+0000","last_change":"2024-09-11T23:17:59.643006+0000","last_active":"2024-09-11T23:18:00.669094+0000","last_peered":"2024-09-11T23:18:00.669094+0000","last_clean":"2024-09-11T23:18:00.669094+0000","last_became_active":"2024-09-11T23:17:59.642338+0000","last_became_peered":"2024-09-11T23:17:59.642338+0000","last_unstale":"2024-09-11T23:18:00.669094+0000","last_undegraded":"2024-09-11T23:18:00.669094+0000","last_fullsized":"2024-09-11T23:18:00.669094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:29.873658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644073+0000","last_change":"2024-09-11T23:17:59.671758+0000","last_active":"2024-09-11T23:18:00.644073+0000","last_peered":"2024-09-11T23:18:00.644073+0000","last_clean":"2024-09-11T23:18:00.644073+0000","last_became_active":"2024-09-11T23:17:59.671418+0000","last_became_peered":"2024-09-11T23:17:59.671418+0000","last_unstale":"2024-09-11T23:18:00.644073+0000","last_undegraded":"2024-09-11T23:18:00.644073+0000","last_fullsized":"2024-09-11T23:18:00.644073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:31.034856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661864+0000","last_change":"2024-09-11T23:17:59.656199+0000","last_active":"2024-09-11T23:18:00.661864+0000","last_peered":"2024-09-11T23:18:00.661864+0000","last_clean":"2024-09-11T23:18:00.661864+0000","last_became_active":"2024-09-11T23:17:59.655919+0000","last_became_peered":"2024-09-11T23:17:59.655919+0000","last_unstale":"2024-09-11T23:18:00.661864+0000","last_undegraded":"2024-09-11T23:18:00.661864+0000","last_fullsized":"2024-09-11T23:18:00.661864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:50.844310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661743+0000","last_change":"2024-09-11T23:17:59.646129+0000","last_active":"2024-09-11T23:18:00.661743+0000","last_peered":"2024-09-11T23:18:00.661743+0000","last_clean":"2024-09-11T23:18:00.661743+0000","last_became_active":"2024-09-11T23:17:59.645346+0000","last_became_peered":"2024-09-11T23:17:59.645346+0000","last_unstale":"2024-09-11T23:18:00.661743+0000","last_undegraded":"2024-09-11T23:18:00.661743+0000","last_fullsized":"2024-09-11T23:18:00.661743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:05.705455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669760+0000","last_change":"2024-09-11T23:17:59.642874+0000","last_active":"2024-09-11T23:18:00.669760+0000","last_peered":"2024-09-11T23:18:00.669760+0000","last_clean":"2024-09-11T23:18:00.669760+0000","last_became_active":"2024-09-11T23:17:59.642586+0000","last_became_peered":"2024-09-11T23:17:59.642586+0000","last_unstale":"2024-09-11T23:18:00.669760+0000","last_undegraded":"2024-09-11T23:18:00.669760+0000","last_fullsized":"2024-09-11T23:18:00.669760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:57.703691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670655+0000","last_change":"2024-09-11T23:17:59.644814+0000","last_active":"2024-09-11T23:18:00.670655+0000","last_peered":"2024-09-11T23:18:00.670655+0000","last_clean":"2024-09-11T23:18:00.670655+0000","last_became_active":"2024-09-11T23:17:59.643305+0000","last_became_peered":"2024-09-11T23:17:59.643305+0000","last_unstale":"2024-09-11T23:18:00.670655+0000","last_undegraded":"2024-09-11T23:18:00.670655+0000","last_fullsized":"2024-09-11T23:18:00.670655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:29.321395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669106+0000","last_change":"2024-09-11T23:17:59.645525+0000","last_active":"2024-09-11T23:18:00.669106+0000","last_peered":"2024-09-11T23:18:00.669106+0000","last_clean":"2024-09-11T23:18:00.669106+0000","last_became_active":"2024-09-11T23:17:59.642799+0000","last_became_peered":"2024-09-11T23:17:59.642799+0000","last_unstale":"2024-09-11T23:18:00.669106+0000","last_undegraded":"2024-09-11T23:18:00.669106+0000","last_fullsized":"2024-09-11T23:18:00.669106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:24.269862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641613+0000","last_change":"2024-09-11T23:17:59.634022+0000","last_active":"2024-09-11T23:18:00.641613+0000","last_peered":"2024-09-11T23:18:00.641613+0000","last_clean":"2024-09-11T23:18:00.641613+0000","last_became_active":"2024-09-11T23:17:59.632934+0000","last_became_peered":"2024-09-11T23:17:59.632934+0000","last_unstale":"2024-09-11T23:18:00.641613+0000","last_undegraded":"2024-09-11T23:18:00.641613+0000","last_fullsized":"2024-09-11T23:18:00.641613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:36.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642779+0000","last_change":"2024-09-11T23:17:59.653627+0000","last_active":"2024-09-11T23:18:00.642779+0000","last_peered":"2024-09-11T23:18:00.642779+0000","last_clean":"2024-09-11T23:18:00.642779+0000","last_became_active":"2024-09-11T23:17:59.653088+0000","last_became_peered":"2024-09-11T23:17:59.653088+0000","last_unstale":"2024-09-11T23:18:00.642779+0000","last_undegraded":"2024-09-11T23:18:00.642779+0000","last_fullsized":"2024-09-11T23:18:00.642779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.341838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.645123+0000","last_change":"2024-09-11T23:17:59.660074+0000","last_active":"2024-09-11T23:18:00.645123+0000","last_peered":"2024-09-11T23:18:00.645123+0000","last_clean":"2024-09-11T23:18:00.645123+0000","last_became_active":"2024-09-11T23:17:59.659174+0000","last_became_peered":"2024-09-11T23:17:59.659174+0000","last_unstale":"2024-09-11T23:18:00.645123+0000","last_undegraded":"2024-09-11T23:18:00.645123+0000","last_fullsized":"2024-09-11T23:18:00.645123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:55.351687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669448+0000","last_change":"2024-09-11T23:17:59.641202+0000","last_active":"2024-09-11T23:18:00.669448+0000","last_peered":"2024-09-11T23:18:00.669448+0000","last_clean":"2024-09-11T23:18:00.669448+0000","last_became_active":"2024-09-11T23:17:59.640609+0000","last_became_peered":"2024-09-11T23:17:59.640609+0000","last_unstale":"2024-09-11T23:18:00.669448+0000","last_undegraded":"2024-09-11T23:18:00.669448+0000","last_fullsized":"2024-09-11T23:18:00.669448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:34.428505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643995+0000","last_change":"2024-09-11T23:17:59.654884+0000","last_active":"2024-09-11T23:18:00.643995+0000","last_peered":"2024-09-11T23:18:00.643995+0000","last_clean":"2024-09-11T23:18:00.643995+0000","last_became_active":"2024-09-11T23:17:59.654578+0000","last_became_peered":"2024-09-11T23:17:59.654578+0000","last_unstale":"2024-09-11T23:18:00.643995+0000","last_undegraded":"2024-09-11T23:18:00.643995+0000","last_fullsized":"2024-09-11T23:18:00.643995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:32.837922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661704+0000","last_change":"2024-09-11T23:17:59.643411+0000","last_active":"2024-09-11T23:18:00.661704+0000","last_peered":"2024-09-11T23:18:00.661704+0000","last_clean":"2024-09-11T23:18:00.661704+0000","last_became_active":"2024-09-11T23:17:59.643076+0000","last_became_peered":"2024-09-11T23:17:59.643076+0000","last_unstale":"2024-09-11T23:18:00.661704+0000","last_undegraded":"2024-09-11T23:18:00.661704+0000","last_fullsized":"2024-09-11T23:18:00.661704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:36.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669545+0000","last_change":"2024-09-11T23:17:59.650880+0000","last_active":"2024-09-11T23:18:00.669545+0000","last_peered":"2024-09-11T23:18:00.669545+0000","last_clean":"2024-09-11T23:18:00.669545+0000","last_became_active":"2024-09-11T23:17:59.650568+0000","last_became_peered":"2024-09-11T23:17:59.650568+0000","last_unstale":"2024-09-11T23:18:00.669545+0000","last_undegraded":"2024-09-11T23:18:00.669545+0000","last_fullsized":"2024-09-11T23:18:00.669545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:15.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642771+0000","last_change":"2024-09-11T23:17:59.666448+0000","last_active":"2024-09-11T23:18:00.642771+0000","last_peered":"2024-09-11T23:18:00.642771+0000","last_clean":"2024-09-11T23:18:00.642771+0000","last_became_active":"2024-09-11T23:17:59.664741+0000","last_became_peered":"2024-09-11T23:17:59.664741+0000","last_unstale":"2024-09-11T23:18:00.642771+0000","last_undegraded":"2024-09-11T23:18:00.642771+0000","last_fullsized":"2024-09-11T23:18:00.642771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:50.844310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670229+0000","last_change":"2024-09-11T23:17:59.645036+0000","last_active":"2024-09-11T23:18:00.670229+0000","last_peered":"2024-09-11T23:18:00.670229+0000","last_clean":"2024-09-11T23:18:00.670229+0000","last_became_active":"2024-09-11T23:17:59.644706+0000","last_became_peered":"2024-09-11T23:17:59.644706+0000","last_unstale":"2024-09-11T23:18:00.670229+0000","last_undegraded":"2024-09-11T23:18:00.670229+0000","last_fullsized":"2024-09-11T23:18:00.670229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:04.266917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642955+0000","last_change":"2024-09-11T23:17:59.653352+0000","last_active":"2024-09-11T23:18:00.642955+0000","last_peered":"2024-09-11T23:18:00.642955+0000","last_clean":"2024-09-11T23:18:00.642955+0000","last_became_active":"2024-09-11T23:17:59.652470+0000","last_became_peered":"2024-09-11T23:17:59.652470+0000","last_unstale":"2024-09-11T23:18:00.642955+0000","last_undegraded":"2024-09-11T23:18:00.642955+0000","last_fullsized":"2024-09-11T23:18:00.642955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:15.213721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671014+0000","last_change":"2024-09-11T23:17:59.662259+0000","last_active":"2024-09-11T23:18:00.671014+0000","last_peered":"2024-09-11T23:18:00.671014+0000","last_clean":"2024-09-11T23:18:00.671014+0000","last_became_active":"2024-09-11T23:17:59.662031+0000","last_became_peered":"2024-09-11T23:17:59.662031+0000","last_unstale":"2024-09-11T23:18:00.671014+0000","last_undegraded":"2024-09-11T23:18:00.671014+0000","last_fullsized":"2024-09-11T23:18:00.671014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:34.160365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661875+0000","last_change":"2024-09-11T23:17:59.650797+0000","last_active":"2024-09-11T23:18:00.661875+0000","last_peered":"2024-09-11T23:18:00.661875+0000","last_clean":"2024-09-11T23:18:00.661875+0000","last_became_active":"2024-09-11T23:17:59.650548+0000","last_became_peered":"2024-09-11T23:17:59.650548+0000","last_unstale":"2024-09-11T23:18:00.661875+0000","last_undegraded":"2024-09-11T23:18:00.661875+0000","last_fullsized":"2024-09-11T23:18:00.661875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.341838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641767+0000","last_change":"2024-09-11T23:17:59.646422+0000","last_active":"2024-09-11T23:18:00.641767+0000","last_peered":"2024-09-11T23:18:00.641767+0000","last_clean":"2024-09-11T23:18:00.641767+0000","last_became_active":"2024-09-11T23:17:59.646112+0000","last_became_peered":"2024-09-11T23:17:59.646112+0000","last_unstale":"2024-09-11T23:18:00.641767+0000","last_undegraded":"2024-09-11T23:18:00.641767+0000","last_fullsized":"2024-09-11T23:18:00.641767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:50.844310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670965+0000","last_change":"2024-09-11T23:17:59.644063+0000","last_active":"2024-09-11T23:18:00.670965+0000","last_peered":"2024-09-11T23:18:00.670965+0000","last_clean":"2024-09-11T23:18:00.670965+0000","last_became_active":"2024-09-11T23:17:59.643760+0000","last_became_peered":"2024-09-11T23:17:59.643760+0000","last_unstale":"2024-09-11T23:18:00.670965+0000","last_undegraded":"2024-09-11T23:18:00.670965+0000","last_fullsized":"2024-09-11T23:18:00.670965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:31.141907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669864+0000","last_change":"2024-09-11T23:17:59.645858+0000","last_active":"2024-09-11T23:18:00.669864+0000","last_peered":"2024-09-11T23:18:00.669864+0000","last_clean":"2024-09-11T23:18:00.669864+0000","last_became_active":"2024-09-11T23:17:59.645602+0000","last_became_peered":"2024-09-11T23:17:59.645602+0000","last_unstale":"2024-09-11T23:18:00.669864+0000","last_undegraded":"2024-09-11T23:18:00.669864+0000","last_fullsized":"2024-09-11T23:18:00.669864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:09.804490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642891+0000","last_change":"2024-09-11T23:17:59.657821+0000","last_active":"2024-09-11T23:18:00.642891+0000","last_peered":"2024-09-11T23:18:00.642891+0000","last_clean":"2024-09-11T23:18:00.642891+0000","last_became_active":"2024-09-11T23:17:59.645334+0000","last_became_peered":"2024-09-11T23:17:59.645334+0000","last_unstale":"2024-09-11T23:18:00.642891+0000","last_undegraded":"2024-09-11T23:18:00.642891+0000","last_fullsized":"2024-09-11T23:18:00.642891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:28.813283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669574+0000","last_change":"2024-09-11T23:17:59.636987+0000","last_active":"2024-09-11T23:18:00.669574+0000","last_peered":"2024-09-11T23:18:00.669574+0000","last_clean":"2024-09-11T23:18:00.669574+0000","last_became_active":"2024-09-11T23:17:59.636762+0000","last_became_peered":"2024-09-11T23:17:59.636762+0000","last_unstale":"2024-09-11T23:18:00.669574+0000","last_undegraded":"2024-09-11T23:18:00.669574+0000","last_fullsized":"2024-09-11T23:18:00.669574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:10.353893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661493+0000","last_change":"2024-09-11T23:17:59.648354+0000","last_active":"2024-09-11T23:18:00.661493+0000","last_peered":"2024-09-11T23:18:00.661493+0000","last_clean":"2024-09-11T23:18:00.661493+0000","last_became_active":"2024-09-11T23:17:59.646693+0000","last_became_peered":"2024-09-11T23:17:59.646693+0000","last_unstale":"2024-09-11T23:18:00.661493+0000","last_undegraded":"2024-09-11T23:18:00.661493+0000","last_fullsized":"2024-09-11T23:18:00.661493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:15.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669206+0000","last_change":"2024-09-11T23:17:59.637101+0000","last_active":"2024-09-11T23:18:00.669206+0000","last_peered":"2024-09-11T23:18:00.669206+0000","last_clean":"2024-09-11T23:18:00.669206+0000","last_became_active":"2024-09-11T23:17:59.635407+0000","last_became_peered":"2024-09-11T23:17:59.635407+0000","last_unstale":"2024-09-11T23:18:00.669206+0000","last_undegraded":"2024-09-11T23:18:00.669206+0000","last_fullsized":"2024-09-11T23:18:00.669206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:35.519961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670769+0000","last_change":"2024-09-11T23:17:58.642664+0000","last_active":"2024-09-11T23:18:00.670769+0000","last_peered":"2024-09-11T23:18:00.670769+0000","last_clean":"2024-09-11T23:18:00.670769+0000","last_became_active":"2024-09-11T23:17:58.642371+0000","last_became_peered":"2024-09-11T23:17:58.642371+0000","last_unstale":"2024-09-11T23:18:00.670769+0000","last_undegraded":"2024-09-11T23:18:00.670769+0000","last_fullsized":"2024-09-11T23:18:00.670769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:31.214611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669649+0000","last_change":"2024-09-11T23:17:59.641906+0000","last_active":"2024-09-11T23:18:00.669649+0000","last_peered":"2024-09-11T23:18:00.669649+0000","last_clean":"2024-09-11T23:18:00.669649+0000","last_became_active":"2024-09-11T23:17:59.641634+0000","last_became_peered":"2024-09-11T23:17:59.641634+0000","last_unstale":"2024-09-11T23:18:00.669649+0000","last_undegraded":"2024-09-11T23:18:00.669649+0000","last_fullsized":"2024-09-11T23:18:00.669649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:36.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661629+0000","last_change":"2024-09-11T23:17:58.640442+0000","last_active":"2024-09-11T23:18:00.661629+0000","last_peered":"2024-09-11T23:18:00.661629+0000","last_clean":"2024-09-11T23:18:00.661629+0000","last_became_active":"2024-09-11T23:17:58.640148+0000","last_became_peered":"2024-09-11T23:17:58.640148+0000","last_unstale":"2024-09-11T23:18:00.661629+0000","last_undegraded":"2024-09-11T23:18:00.661629+0000","last_fullsized":"2024-09-11T23:18:00.661629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:02.505670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670322+0000","last_change":"2024-09-11T23:17:58.640181+0000","last_active":"2024-09-11T23:18:00.670322+0000","last_peered":"2024-09-11T23:18:00.670322+0000","last_clean":"2024-09-11T23:18:00.670322+0000","last_became_active":"2024-09-11T23:17:58.639944+0000","last_became_peered":"2024-09-11T23:17:58.639944+0000","last_unstale":"2024-09-11T23:18:00.670322+0000","last_undegraded":"2024-09-11T23:18:00.670322+0000","last_fullsized":"2024-09-11T23:18:00.670322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:02.827617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669793+0000","last_change":"2024-09-11T23:17:59.643922+0000","last_active":"2024-09-11T23:18:00.669793+0000","last_peered":"2024-09-11T23:18:00.669793+0000","last_clean":"2024-09-11T23:18:00.669793+0000","last_became_active":"2024-09-11T23:17:59.643613+0000","last_became_peered":"2024-09-11T23:17:59.643613+0000","last_unstale":"2024-09-11T23:18:00.669793+0000","last_undegraded":"2024-09-11T23:18:00.669793+0000","last_fullsized":"2024-09-11T23:18:00.669793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:31.792631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643050+0000","last_change":"2024-09-11T23:17:58.640428+0000","last_active":"2024-09-11T23:18:00.643050+0000","last_peered":"2024-09-11T23:18:00.643050+0000","last_clean":"2024-09-11T23:18:00.643050+0000","last_became_active":"2024-09-11T23:17:58.639860+0000","last_became_peered":"2024-09-11T23:17:58.639860+0000","last_unstale":"2024-09-11T23:18:00.643050+0000","last_undegraded":"2024-09-11T23:18:00.643050+0000","last_fullsized":"2024-09-11T23:18:00.643050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641494+0000","last_change":"2024-09-11T23:17:59.638046+0000","last_active":"2024-09-11T23:18:00.641494+0000","last_peered":"2024-09-11T23:18:00.641494+0000","last_clean":"2024-09-11T23:18:00.641494+0000","last_became_active":"2024-09-11T23:17:59.637621+0000","last_became_peered":"2024-09-11T23:17:59.637621+0000","last_unstale":"2024-09-11T23:18:00.641494+0000","last_undegraded":"2024-09-11T23:18:00.641494+0000","last_fullsized":"2024-09-11T23:18:00.641494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:15.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661844+0000","last_change":"2024-09-11T23:17:58.645977+0000","last_active":"2024-09-11T23:18:00.661844+0000","last_peered":"2024-09-11T23:18:00.661844+0000","last_clean":"2024-09-11T23:18:00.661844+0000","last_became_active":"2024-09-11T23:17:58.645482+0000","last_became_peered":"2024-09-11T23:17:58.645482+0000","last_unstale":"2024-09-11T23:18:00.661844+0000","last_undegraded":"2024-09-11T23:18:00.661844+0000","last_fullsized":"2024-09-11T23:18:00.661844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:31.277023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644953+0000","last_change":"2024-09-11T23:17:59.658501+0000","last_active":"2024-09-11T23:18:00.644953+0000","last_peered":"2024-09-11T23:18:00.644953+0000","last_clean":"2024-09-11T23:18:00.644953+0000","last_became_active":"2024-09-11T23:17:59.658268+0000","last_became_peered":"2024-09-11T23:17:59.658268+0000","last_unstale":"2024-09-11T23:18:00.644953+0000","last_undegraded":"2024-09-11T23:18:00.644953+0000","last_fullsized":"2024-09-11T23:18:00.644953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:13.861431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.645078+0000","last_change":"2024-09-11T23:17:58.640356+0000","last_active":"2024-09-11T23:18:00.645078+0000","last_peered":"2024-09-11T23:18:00.645078+0000","last_clean":"2024-09-11T23:18:00.645078+0000","last_became_active":"2024-09-11T23:17:58.640060+0000","last_became_peered":"2024-09-11T23:17:58.640060+0000","last_unstale":"2024-09-11T23:18:00.645078+0000","last_undegraded":"2024-09-11T23:18:00.645078+0000","last_fullsized":"2024-09-11T23:18:00.645078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:31.277023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669890+0000","last_change":"2024-09-11T23:17:59.669290+0000","last_active":"2024-09-11T23:18:00.669890+0000","last_peered":"2024-09-11T23:18:00.669890+0000","last_clean":"2024-09-11T23:18:00.669890+0000","last_became_active":"2024-09-11T23:17:59.668837+0000","last_became_peered":"2024-09-11T23:17:59.668837+0000","last_unstale":"2024-09-11T23:18:00.669890+0000","last_undegraded":"2024-09-11T23:18:00.669890+0000","last_fullsized":"2024-09-11T23:18:00.669890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:50.844310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641822+0000","last_change":"2024-09-11T23:17:58.646012+0000","last_active":"2024-09-11T23:18:00.641822+0000","last_peered":"2024-09-11T23:18:00.641822+0000","last_clean":"2024-09-11T23:18:00.641822+0000","last_became_active":"2024-09-11T23:17:58.645093+0000","last_became_peered":"2024-09-11T23:17:58.645093+0000","last_unstale":"2024-09-11T23:18:00.641822+0000","last_undegraded":"2024-09-11T23:18:00.641822+0000","last_fullsized":"2024-09-11T23:18:00.641822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:31.277023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669811+0000","last_change":"2024-09-11T23:17:59.653386+0000","last_active":"2024-09-11T23:18:00.669811+0000","last_peered":"2024-09-11T23:18:00.669811+0000","last_clean":"2024-09-11T23:18:00.669811+0000","last_became_active":"2024-09-11T23:17:59.653112+0000","last_became_peered":"2024-09-11T23:17:59.653112+0000","last_unstale":"2024-09-11T23:18:00.669811+0000","last_undegraded":"2024-09-11T23:18:00.669811+0000","last_fullsized":"2024-09-11T23:18:00.669811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:30.915550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661618+0000","last_change":"2024-09-11T23:17:58.642732+0000","last_active":"2024-09-11T23:18:00.661618+0000","last_peered":"2024-09-11T23:18:00.661618+0000","last_clean":"2024-09-11T23:18:00.661618+0000","last_became_active":"2024-09-11T23:17:58.642411+0000","last_became_peered":"2024-09-11T23:17:58.642411+0000","last_unstale":"2024-09-11T23:18:00.661618+0000","last_undegraded":"2024-09-11T23:18:00.661618+0000","last_fullsized":"2024-09-11T23:18:00.661618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:21.084931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643652+0000","last_change":"2024-09-11T23:17:59.652260+0000","last_active":"2024-09-11T23:18:00.643652+0000","last_peered":"2024-09-11T23:18:00.643652+0000","last_clean":"2024-09-11T23:18:00.643652+0000","last_became_active":"2024-09-11T23:17:59.651842+0000","last_became_peered":"2024-09-11T23:17:59.651842+0000","last_unstale":"2024-09-11T23:18:00.643652+0000","last_undegraded":"2024-09-11T23:18:00.643652+0000","last_fullsized":"2024-09-11T23:18:00.643652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:13.861431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669696+0000","last_change":"2024-09-11T23:17:58.629743+0000","last_active":"2024-09-11T23:18:00.669696+0000","last_peered":"2024-09-11T23:18:00.669696+0000","last_clean":"2024-09-11T23:18:00.669696+0000","last_became_active":"2024-09-11T23:17:58.629379+0000","last_became_peered":"2024-09-11T23:17:58.629379+0000","last_unstale":"2024-09-11T23:18:00.669696+0000","last_undegraded":"2024-09-11T23:18:00.669696+0000","last_fullsized":"2024-09-11T23:18:00.669696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:09.475238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669255+0000","last_change":"2024-09-11T23:17:59.647539+0000","last_active":"2024-09-11T23:18:00.669255+0000","last_peered":"2024-09-11T23:18:00.669255+0000","last_clean":"2024-09-11T23:18:00.669255+0000","last_became_active":"2024-09-11T23:17:59.647293+0000","last_became_peered":"2024-09-11T23:17:59.647293+0000","last_unstale":"2024-09-11T23:18:00.669255+0000","last_undegraded":"2024-09-11T23:18:00.669255+0000","last_fullsized":"2024-09-11T23:18:00.669255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:49.647417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642905+0000","last_change":"2024-09-11T23:17:58.641139+0000","last_active":"2024-09-11T23:18:00.642905+0000","last_peered":"2024-09-11T23:18:00.642905+0000","last_clean":"2024-09-11T23:18:00.642905+0000","last_became_active":"2024-09-11T23:17:58.640813+0000","last_became_peered":"2024-09-11T23:17:58.640813+0000","last_unstale":"2024-09-11T23:18:00.642905+0000","last_undegraded":"2024-09-11T23:18:00.642905+0000","last_fullsized":"2024-09-11T23:18:00.642905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:02.505670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643757+0000","last_change":"2024-09-11T23:17:59.661121+0000","last_active":"2024-09-11T23:18:00.643757+0000","last_peered":"2024-09-11T23:18:00.643757+0000","last_clean":"2024-09-11T23:18:00.643757+0000","last_became_active":"2024-09-11T23:17:59.660078+0000","last_became_peered":"2024-09-11T23:17:59.660078+0000","last_unstale":"2024-09-11T23:18:00.643757+0000","last_undegraded":"2024-09-11T23:18:00.643757+0000","last_fullsized":"2024-09-11T23:18:00.643757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:55.351687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661430+0000","last_change":"2024-09-11T23:17:58.636194+0000","last_active":"2024-09-11T23:18:00.661430+0000","last_peered":"2024-09-11T23:18:00.661430+0000","last_clean":"2024-09-11T23:18:00.661430+0000","last_became_active":"2024-09-11T23:17:58.635885+0000","last_became_peered":"2024-09-11T23:17:58.635885+0000","last_unstale":"2024-09-11T23:18:00.661430+0000","last_undegraded":"2024-09-11T23:18:00.661430+0000","last_fullsized":"2024-09-11T23:18:00.661430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661491+0000","last_change":"2024-09-11T23:17:59.648931+0000","last_active":"2024-09-11T23:18:00.661491+0000","last_peered":"2024-09-11T23:18:00.661491+0000","last_clean":"2024-09-11T23:18:00.661491+0000","last_became_active":"2024-09-11T23:17:59.646149+0000","last_became_peered":"2024-09-11T23:17:59.646149+0000","last_unstale":"2024-09-11T23:18:00.661491+0000","last_undegraded":"2024-09-11T23:18:00.661491+0000","last_fullsized":"2024-09-11T23:18:00.661491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.193032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669254+0000","last_change":"2024-09-11T23:17:58.631291+0000","last_active":"2024-09-11T23:18:00.669254+0000","last_peered":"2024-09-11T23:18:00.669254+0000","last_clean":"2024-09-11T23:18:00.669254+0000","last_became_active":"2024-09-11T23:17:58.630939+0000","last_became_peered":"2024-09-11T23:17:58.630939+0000","last_unstale":"2024-09-11T23:18:00.669254+0000","last_undegraded":"2024-09-11T23:18:00.669254+0000","last_fullsized":"2024-09-11T23:18:00.669254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:53:26.952229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643224+0000","last_change":"2024-09-11T23:17:59.660874+0000","last_active":"2024-09-11T23:18:00.643224+0000","last_peered":"2024-09-11T23:18:00.643224+0000","last_clean":"2024-09-11T23:18:00.643224+0000","last_became_active":"2024-09-11T23:17:59.660613+0000","last_became_peered":"2024-09-11T23:17:59.660613+0000","last_unstale":"2024-09-11T23:18:00.643224+0000","last_undegraded":"2024-09-11T23:18:00.643224+0000","last_fullsized":"2024-09-11T23:18:00.643224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:42.560113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670003+0000","last_change":"2024-09-11T23:17:58.635774+0000","last_active":"2024-09-11T23:18:00.670003+0000","last_peered":"2024-09-11T23:18:00.670003+0000","last_clean":"2024-09-11T23:18:00.670003+0000","last_became_active":"2024-09-11T23:17:58.634748+0000","last_became_peered":"2024-09-11T23:17:58.634748+0000","last_unstale":"2024-09-11T23:18:00.670003+0000","last_undegraded":"2024-09-11T23:18:00.670003+0000","last_fullsized":"2024-09-11T23:18:00.670003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:44.209956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643691+0000","last_change":"2024-09-11T23:17:59.662246+0000","last_active":"2024-09-11T23:18:00.643691+0000","last_peered":"2024-09-11T23:18:00.643691+0000","last_clean":"2024-09-11T23:18:00.643691+0000","last_became_active":"2024-09-11T23:17:59.661866+0000","last_became_peered":"2024-09-11T23:17:59.661866+0000","last_unstale":"2024-09-11T23:18:00.643691+0000","last_undegraded":"2024-09-11T23:18:00.643691+0000","last_fullsized":"2024-09-11T23:18:00.643691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:00.628195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669504+0000","last_change":"2024-09-11T23:17:58.634201+0000","last_active":"2024-09-11T23:18:00.669504+0000","last_peered":"2024-09-11T23:18:00.669504+0000","last_clean":"2024-09-11T23:18:00.669504+0000","last_became_active":"2024-09-11T23:17:58.633865+0000","last_became_peered":"2024-09-11T23:17:58.633865+0000","last_unstale":"2024-09-11T23:18:00.669504+0000","last_undegraded":"2024-09-11T23:18:00.669504+0000","last_fullsized":"2024-09-11T23:18:00.669504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:12.634428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644038+0000","last_change":"2024-09-11T23:17:59.668175+0000","last_active":"2024-09-11T23:18:00.644038+0000","last_peered":"2024-09-11T23:18:00.644038+0000","last_clean":"2024-09-11T23:18:00.644038+0000","last_became_active":"2024-09-11T23:17:59.665569+0000","last_became_peered":"2024-09-11T23:17:59.665569+0000","last_unstale":"2024-09-11T23:18:00.644038+0000","last_undegraded":"2024-09-11T23:18:00.644038+0000","last_fullsized":"2024-09-11T23:18:00.644038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:49.216535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641877+0000","last_change":"2024-09-11T23:17:58.630807+0000","last_active":"2024-09-11T23:18:00.641877+0000","last_peered":"2024-09-11T23:18:00.641877+0000","last_clean":"2024-09-11T23:18:00.641877+0000","last_became_active":"2024-09-11T23:17:58.630491+0000","last_became_peered":"2024-09-11T23:17:58.630491+0000","last_unstale":"2024-09-11T23:18:00.641877+0000","last_undegraded":"2024-09-11T23:18:00.641877+0000","last_fullsized":"2024-09-11T23:18:00.641877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.907527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644892+0000","last_change":"2024-09-11T23:17:59.643945+0000","last_active":"2024-09-11T23:18:00.644892+0000","last_peered":"2024-09-11T23:18:00.644892+0000","last_clean":"2024-09-11T23:18:00.644892+0000","last_became_active":"2024-09-11T23:17:59.643358+0000","last_became_peered":"2024-09-11T23:17:59.643358+0000","last_unstale":"2024-09-11T23:18:00.644892+0000","last_undegraded":"2024-09-11T23:18:00.644892+0000","last_fullsized":"2024-09-11T23:18:00.644892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:14.020762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670008+0000","last_change":"2024-09-11T23:17:58.645520+0000","last_active":"2024-09-11T23:18:00.670008+0000","last_peered":"2024-09-11T23:18:00.670008+0000","last_clean":"2024-09-11T23:18:00.670008+0000","last_became_active":"2024-09-11T23:17:58.645211+0000","last_became_peered":"2024-09-11T23:17:58.645211+0000","last_unstale":"2024-09-11T23:18:00.670008+0000","last_undegraded":"2024-09-11T23:18:00.670008+0000","last_fullsized":"2024-09-11T23:18:00.670008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:02.827617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643867+0000","last_change":"2024-09-11T23:17:59.669515+0000","last_active":"2024-09-11T23:18:00.643867+0000","last_peered":"2024-09-11T23:18:00.643867+0000","last_clean":"2024-09-11T23:18:00.643867+0000","last_became_active":"2024-09-11T23:17:59.669182+0000","last_became_peered":"2024-09-11T23:17:59.669182+0000","last_unstale":"2024-09-11T23:18:00.643867+0000","last_undegraded":"2024-09-11T23:18:00.643867+0000","last_fullsized":"2024-09-11T23:18:00.643867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:26.131689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642556+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:18:00.642556+0000","last_peered":"2024-09-11T23:18:00.642556+0000","last_clean":"2024-09-11T23:18:00.642556+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:18:00.642556+0000","last_undegraded":"2024-09-11T23:18:00.642556+0000","last_fullsized":"2024-09-11T23:18:00.642556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644109+0000","last_change":"2024-09-11T23:17:58.634769+0000","last_active":"2024-09-11T23:18:00.644109+0000","last_peered":"2024-09-11T23:18:00.644109+0000","last_clean":"2024-09-11T23:18:00.644109+0000","last_became_active":"2024-09-11T23:17:58.634321+0000","last_became_peered":"2024-09-11T23:17:58.634321+0000","last_unstale":"2024-09-11T23:18:00.644109+0000","last_undegraded":"2024-09-11T23:18:00.644109+0000","last_fullsized":"2024-09-11T23:18:00.644109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:21.084931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669925+0000","last_change":"2024-09-11T23:17:59.659482+0000","last_active":"2024-09-11T23:18:00.669925+0000","last_peered":"2024-09-11T23:18:00.669925+0000","last_clean":"2024-09-11T23:18:00.669925+0000","last_became_active":"2024-09-11T23:17:59.659148+0000","last_became_peered":"2024-09-11T23:17:59.659148+0000","last_unstale":"2024-09-11T23:18:00.669925+0000","last_undegraded":"2024-09-11T23:18:00.669925+0000","last_fullsized":"2024-09-11T23:18:00.669925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:22.419970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642401+0000","last_change":"2024-09-11T23:17:58.636656+0000","last_active":"2024-09-11T23:18:00.642401+0000","last_peered":"2024-09-11T23:18:00.642401+0000","last_clean":"2024-09-11T23:18:00.642401+0000","last_became_active":"2024-09-11T23:17:58.636363+0000","last_became_peered":"2024-09-11T23:17:58.636363+0000","last_unstale":"2024-09-11T23:18:00.642401+0000","last_undegraded":"2024-09-11T23:18:00.642401+0000","last_fullsized":"2024-09-11T23:18:00.642401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:04.565864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669116+0000","last_change":"2024-09-11T23:17:59.640328+0000","last_active":"2024-09-11T23:18:00.669116+0000","last_peered":"2024-09-11T23:18:00.669116+0000","last_clean":"2024-09-11T23:18:00.669116+0000","last_became_active":"2024-09-11T23:17:59.640058+0000","last_became_peered":"2024-09-11T23:17:59.640058+0000","last_unstale":"2024-09-11T23:18:00.669116+0000","last_undegraded":"2024-09-11T23:18:00.669116+0000","last_fullsized":"2024-09-11T23:18:00.669116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:31.650891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669359+0000","last_change":"2024-09-11T23:17:58.642240+0000","last_active":"2024-09-11T23:18:00.669359+0000","last_peered":"2024-09-11T23:18:00.669359+0000","last_clean":"2024-09-11T23:18:00.669359+0000","last_became_active":"2024-09-11T23:17:58.641996+0000","last_became_peered":"2024-09-11T23:17:58.641996+0000","last_unstale":"2024-09-11T23:18:00.669359+0000","last_undegraded":"2024-09-11T23:18:00.669359+0000","last_fullsized":"2024-09-11T23:18:00.669359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:29:09.781577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641685+0000","last_change":"2024-09-11T23:17:59.638548+0000","last_active":"2024-09-11T23:18:00.641685+0000","last_peered":"2024-09-11T23:18:00.641685+0000","last_clean":"2024-09-11T23:18:00.641685+0000","last_became_active":"2024-09-11T23:17:59.638044+0000","last_became_peered":"2024-09-11T23:17:59.638044+0000","last_unstale":"2024-09-11T23:18:00.641685+0000","last_undegraded":"2024-09-11T23:18:00.641685+0000","last_fullsized":"2024-09-11T23:18:00.641685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:05.705455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642958+0000","last_change":"2024-09-11T23:17:58.641231+0000","last_active":"2024-09-11T23:18:00.642958+0000","last_peered":"2024-09-11T23:18:00.642958+0000","last_clean":"2024-09-11T23:18:00.642958+0000","last_became_active":"2024-09-11T23:17:58.640860+0000","last_became_peered":"2024-09-11T23:17:58.640860+0000","last_unstale":"2024-09-11T23:18:00.642958+0000","last_undegraded":"2024-09-11T23:18:00.642958+0000","last_fullsized":"2024-09-11T23:18:00.642958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669466+0000","last_change":"2024-09-11T23:17:59.643898+0000","last_active":"2024-09-11T23:18:00.669466+0000","last_peered":"2024-09-11T23:18:00.669466+0000","last_clean":"2024-09-11T23:18:00.669466+0000","last_became_active":"2024-09-11T23:17:59.643471+0000","last_became_peered":"2024-09-11T23:17:59.643471+0000","last_unstale":"2024-09-11T23:18:00.669466+0000","last_undegraded":"2024-09-11T23:18:00.669466+0000","last_fullsized":"2024-09-11T23:18:00.669466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:32.285047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641618+0000","last_change":"2024-09-11T23:17:58.640659+0000","last_active":"2024-09-11T23:18:00.641618+0000","last_peered":"2024-09-11T23:18:00.641618+0000","last_clean":"2024-09-11T23:18:00.641618+0000","last_became_active":"2024-09-11T23:17:58.640358+0000","last_became_peered":"2024-09-11T23:17:58.640358+0000","last_unstale":"2024-09-11T23:18:00.641618+0000","last_undegraded":"2024-09-11T23:18:00.641618+0000","last_fullsized":"2024-09-11T23:18:00.641618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.645047+0000","last_change":"2024-09-11T23:17:59.659233+0000","last_active":"2024-09-11T23:18:00.645047+0000","last_peered":"2024-09-11T23:18:00.645047+0000","last_clean":"2024-09-11T23:18:00.645047+0000","last_became_active":"2024-09-11T23:17:59.655952+0000","last_became_peered":"2024-09-11T23:17:59.655952+0000","last_unstale":"2024-09-11T23:18:00.645047+0000","last_undegraded":"2024-09-11T23:18:00.645047+0000","last_fullsized":"2024-09-11T23:18:00.645047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:00.628195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644053+0000","last_change":"2024-09-11T23:17:58.642080+0000","last_active":"2024-09-11T23:18:00.644053+0000","last_peered":"2024-09-11T23:18:00.644053+0000","last_clean":"2024-09-11T23:18:00.644053+0000","last_became_active":"2024-09-11T23:17:58.641752+0000","last_became_peered":"2024-09-11T23:17:58.641752+0000","last_unstale":"2024-09-11T23:18:00.644053+0000","last_undegraded":"2024-09-11T23:18:00.644053+0000","last_fullsized":"2024-09-11T23:18:00.644053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:30.642868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641527+0000","last_change":"2024-09-11T23:17:59.634847+0000","last_active":"2024-09-11T23:18:00.641527+0000","last_peered":"2024-09-11T23:18:00.641527+0000","last_clean":"2024-09-11T23:18:00.641527+0000","last_became_active":"2024-09-11T23:17:59.634547+0000","last_became_peered":"2024-09-11T23:17:59.634547+0000","last_unstale":"2024-09-11T23:18:00.641527+0000","last_undegraded":"2024-09-11T23:18:00.641527+0000","last_fullsized":"2024-09-11T23:18:00.641527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.193032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642072+0000","last_change":"2024-09-11T23:17:58.633818+0000","last_active":"2024-09-11T23:18:00.642072+0000","last_peered":"2024-09-11T23:18:00.642072+0000","last_clean":"2024-09-11T23:18:00.642072+0000","last_became_active":"2024-09-11T23:17:58.633550+0000","last_became_peered":"2024-09-11T23:17:58.633550+0000","last_unstale":"2024-09-11T23:18:00.642072+0000","last_undegraded":"2024-09-11T23:18:00.642072+0000","last_fullsized":"2024-09-11T23:18:00.642072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:56.695668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671118+0000","last_change":"2024-09-11T23:17:59.650990+0000","last_active":"2024-09-11T23:18:00.671118+0000","last_peered":"2024-09-11T23:18:00.671118+0000","last_clean":"2024-09-11T23:18:00.671118+0000","last_became_active":"2024-09-11T23:17:59.650684+0000","last_became_peered":"2024-09-11T23:17:59.650684+0000","last_unstale":"2024-09-11T23:18:00.671118+0000","last_undegraded":"2024-09-11T23:18:00.671118+0000","last_fullsized":"2024-09-11T23:18:00.671118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:17.470426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661904+0000","last_change":"2024-09-11T23:17:58.639477+0000","last_active":"2024-09-11T23:18:00.661904+0000","last_peered":"2024-09-11T23:18:00.661904+0000","last_clean":"2024-09-11T23:18:00.661904+0000","last_became_active":"2024-09-11T23:17:58.639168+0000","last_became_peered":"2024-09-11T23:17:58.639168+0000","last_unstale":"2024-09-11T23:18:00.661904+0000","last_undegraded":"2024-09-11T23:18:00.661904+0000","last_fullsized":"2024-09-11T23:18:00.661904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669908+0000","last_change":"2024-09-11T23:17:59.650474+0000","last_active":"2024-09-11T23:18:00.669908+0000","last_peered":"2024-09-11T23:18:00.669908+0000","last_clean":"2024-09-11T23:18:00.669908+0000","last_became_active":"2024-09-11T23:17:59.650168+0000","last_became_peered":"2024-09-11T23:17:59.650168+0000","last_unstale":"2024-09-11T23:18:00.669908+0000","last_undegraded":"2024-09-11T23:18:00.669908+0000","last_fullsized":"2024-09-11T23:18:00.669908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.341838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642401+0000","last_change":"2024-09-11T23:17:58.640620+0000","last_active":"2024-09-11T23:18:00.642401+0000","last_peered":"2024-09-11T23:18:00.642401+0000","last_clean":"2024-09-11T23:18:00.642401+0000","last_became_active":"2024-09-11T23:17:58.640367+0000","last_became_peered":"2024-09-11T23:17:58.640367+0000","last_unstale":"2024-09-11T23:18:00.642401+0000","last_undegraded":"2024-09-11T23:18:00.642401+0000","last_fullsized":"2024-09-11T23:18:00.642401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.907527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669188+0000","last_change":"2024-09-11T23:17:59.635712+0000","last_active":"2024-09-11T23:18:00.669188+0000","last_peered":"2024-09-11T23:18:00.669188+0000","last_clean":"2024-09-11T23:18:00.669188+0000","last_became_active":"2024-09-11T23:17:59.635303+0000","last_became_peered":"2024-09-11T23:17:59.635303+0000","last_unstale":"2024-09-11T23:18:00.669188+0000","last_undegraded":"2024-09-11T23:18:00.669188+0000","last_fullsized":"2024-09-11T23:18:00.669188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:03.513693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641602+0000","last_change":"2024-09-11T23:17:58.639596+0000","last_active":"2024-09-11T23:18:00.641602+0000","last_peered":"2024-09-11T23:18:00.641602+0000","last_clean":"2024-09-11T23:18:00.641602+0000","last_became_active":"2024-09-11T23:17:58.639333+0000","last_became_peered":"2024-09-11T23:17:58.639333+0000","last_unstale":"2024-09-11T23:18:00.641602+0000","last_undegraded":"2024-09-11T23:18:00.641602+0000","last_fullsized":"2024-09-11T23:18:00.641602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:02.505670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669868+0000","last_change":"2024-09-11T23:17:59.643630+0000","last_active":"2024-09-11T23:18:00.669868+0000","last_peered":"2024-09-11T23:18:00.669868+0000","last_clean":"2024-09-11T23:18:00.669868+0000","last_became_active":"2024-09-11T23:17:59.643080+0000","last_became_peered":"2024-09-11T23:17:59.643080+0000","last_unstale":"2024-09-11T23:18:00.669868+0000","last_undegraded":"2024-09-11T23:18:00.669868+0000","last_fullsized":"2024-09-11T23:18:00.669868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:59.272347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641919+0000","last_change":"2024-09-11T23:17:58.634155+0000","last_active":"2024-09-11T23:18:00.641919+0000","last_peered":"2024-09-11T23:18:00.641919+0000","last_clean":"2024-09-11T23:18:00.641919+0000","last_became_active":"2024-09-11T23:17:58.633898+0000","last_became_peered":"2024-09-11T23:17:58.633898+0000","last_unstale":"2024-09-11T23:18:00.641919+0000","last_undegraded":"2024-09-11T23:18:00.641919+0000","last_fullsized":"2024-09-11T23:18:00.641919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:21.084931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670728+0000","last_change":"2024-09-11T23:17:59.648274+0000","last_active":"2024-09-11T23:18:00.670728+0000","last_peered":"2024-09-11T23:18:00.670728+0000","last_clean":"2024-09-11T23:18:00.670728+0000","last_became_active":"2024-09-11T23:17:59.646482+0000","last_became_peered":"2024-09-11T23:17:59.646482+0000","last_unstale":"2024-09-11T23:18:00.670728+0000","last_undegraded":"2024-09-11T23:18:00.670728+0000","last_fullsized":"2024-09-11T23:18:00.670728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:06.041413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643987+0000","last_change":"2024-09-11T23:17:58.644868+0000","last_active":"2024-09-11T23:18:00.643987+0000","last_peered":"2024-09-11T23:18:00.643987+0000","last_clean":"2024-09-11T23:18:00.643987+0000","last_became_active":"2024-09-11T23:17:58.644006+0000","last_became_peered":"2024-09-11T23:17:58.644006+0000","last_unstale":"2024-09-11T23:18:00.643987+0000","last_undegraded":"2024-09-11T23:18:00.643987+0000","last_fullsized":"2024-09-11T23:18:00.643987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:23.261838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661493+0000","last_change":"2024-09-11T23:17:59.642489+0000","last_active":"2024-09-11T23:18:00.661493+0000","last_peered":"2024-09-11T23:18:00.661493+0000","last_clean":"2024-09-11T23:18:00.661493+0000","last_became_active":"2024-09-11T23:17:59.642155+0000","last_became_peered":"2024-09-11T23:17:59.642155+0000","last_unstale":"2024-09-11T23:18:00.661493+0000","last_undegraded":"2024-09-11T23:18:00.661493+0000","last_fullsized":"2024-09-11T23:18:00.661493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:49.647417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644943+0000","last_change":"2024-09-11T23:17:59.636661+0000","last_active":"2024-09-11T23:18:00.644943+0000","last_peered":"2024-09-11T23:18:00.644943+0000","last_clean":"2024-09-11T23:18:00.644943+0000","last_became_active":"2024-09-11T23:17:59.635613+0000","last_became_peered":"2024-09-11T23:17:59.635613+0000","last_unstale":"2024-09-11T23:18:00.644943+0000","last_undegraded":"2024-09-11T23:18:00.644943+0000","last_fullsized":"2024-09-11T23:18:00.644943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:04.566161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643521+0000","last_change":"2024-09-11T23:17:58.646998+0000","last_active":"2024-09-11T23:18:00.643521+0000","last_peered":"2024-09-11T23:18:00.643521+0000","last_clean":"2024-09-11T23:18:00.643521+0000","last_became_active":"2024-09-11T23:17:58.646666+0000","last_became_peered":"2024-09-11T23:17:58.646666+0000","last_unstale":"2024-09-11T23:18:00.643521+0000","last_undegraded":"2024-09-11T23:18:00.643521+0000","last_fullsized":"2024-09-11T23:18:00.643521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:57.415598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644743+0000","last_change":"2024-09-11T23:17:59.637292+0000","last_active":"2024-09-11T23:18:00.644743+0000","last_peered":"2024-09-11T23:18:00.644743+0000","last_clean":"2024-09-11T23:18:00.644743+0000","last_became_active":"2024-09-11T23:17:59.637028+0000","last_became_peered":"2024-09-11T23:17:59.637028+0000","last_unstale":"2024-09-11T23:18:00.644743+0000","last_undegraded":"2024-09-11T23:18:00.644743+0000","last_fullsized":"2024-09-11T23:18:00.644743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:42.560113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643829+0000","last_change":"2024-09-11T23:17:58.641586+0000","last_active":"2024-09-11T23:18:00.643829+0000","last_peered":"2024-09-11T23:18:00.643829+0000","last_clean":"2024-09-11T23:18:00.643829+0000","last_became_active":"2024-09-11T23:17:58.636670+0000","last_became_peered":"2024-09-11T23:17:58.636670+0000","last_unstale":"2024-09-11T23:18:00.643829+0000","last_undegraded":"2024-09-11T23:18:00.643829+0000","last_fullsized":"2024-09-11T23:18:00.643829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:49.590126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669867+0000","last_change":"2024-09-11T23:17:59.669621+0000","last_active":"2024-09-11T23:18:00.669867+0000","last_peered":"2024-09-11T23:18:00.669867+0000","last_clean":"2024-09-11T23:18:00.669867+0000","last_became_active":"2024-09-11T23:17:59.669362+0000","last_became_peered":"2024-09-11T23:17:59.669362+0000","last_unstale":"2024-09-11T23:18:00.669867+0000","last_undegraded":"2024-09-11T23:18:00.669867+0000","last_fullsized":"2024-09-11T23:18:00.669867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:05.705455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671062+0000","last_change":"2024-09-11T23:17:58.646365+0000","last_active":"2024-09-11T23:18:00.671062+0000","last_peered":"2024-09-11T23:18:00.671062+0000","last_clean":"2024-09-11T23:18:00.671062+0000","last_became_active":"2024-09-11T23:17:58.646119+0000","last_became_peered":"2024-09-11T23:17:58.646119+0000","last_unstale":"2024-09-11T23:18:00.671062+0000","last_undegraded":"2024-09-11T23:18:00.671062+0000","last_fullsized":"2024-09-11T23:18:00.671062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:12.634428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670990+0000","last_change":"2024-09-11T23:17:59.654946+0000","last_active":"2024-09-11T23:18:00.670990+0000","last_peered":"2024-09-11T23:18:00.670990+0000","last_clean":"2024-09-11T23:18:00.670990+0000","last_became_active":"2024-09-11T23:17:59.654732+0000","last_became_peered":"2024-09-11T23:17:59.654732+0000","last_unstale":"2024-09-11T23:18:00.670990+0000","last_undegraded":"2024-09-11T23:18:00.670990+0000","last_fullsized":"2024-09-11T23:18:00.670990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:28.095341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669978+0000","last_change":"2024-09-11T23:17:58.638337+0000","last_active":"2024-09-11T23:18:00.669978+0000","last_peered":"2024-09-11T23:18:00.669978+0000","last_clean":"2024-09-11T23:18:00.669978+0000","last_became_active":"2024-09-11T23:17:58.638071+0000","last_became_peered":"2024-09-11T23:17:58.638071+0000","last_unstale":"2024-09-11T23:18:00.669978+0000","last_undegraded":"2024-09-11T23:18:00.669978+0000","last_fullsized":"2024-09-11T23:18:00.669978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:23.106037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476745,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":666862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476744,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":77524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476743,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":76002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476743,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":76038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":823296,"data_stored":666918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":77524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":75912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:18:13.477 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:18:13.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.667+0000 7f9c10c00640 1 Processor -- start 2024-09-11T23:18:13.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.667+0000 7f9c10c00640 1 -- start start 2024-09-11T23:18:13.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.668+0000 7f9c10c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9c0c15e640 0x7f9c0c0d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:13.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.668+0000 7f9c10c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9c0c0b66e0 0x7f9c0c0b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:13.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.668+0000 7f9c10c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c0c06bee0 con 0x7f9c0c0d3f60 2024-09-11T23:18:13.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.668+0000 7f9c10c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9c0c15ea20 con 0x7f9c0c0b66e0 2024-09-11T23:18:13.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.668+0000 7f9c10c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9c0c06caf0 con 0x7f9c0c15e640 2024-09-11T23:18:13.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.668+0000 7f9c0be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9c0c0b66e0 0x7f9c0c0b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:13.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.668+0000 7f9c0aa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9c0c0d3f60 0x7f9c0c0b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46916/0 (socket says 172.21.15.144:46916) 2024-09-11T23:18:13.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.668+0000 7f9c0aa00640 1 -- 172.21.15.144:0/2375353239 learned_addr learned my addr 172.21.15.144:0/2375353239 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:13.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.668+0000 7f9c0b400640 1 --2- 172.21.15.144:0/2375353239 >> v2:172.21.15.165:3300/0 conn(0x7f9c0c15e640 0x7f9c0c0d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:13.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.669+0000 7f9c0be00640 1 -- 172.21.15.144:0/2375353239 >> v2:172.21.15.165:3300/0 conn(0x7f9c0c15e640 msgr2=0x7f9c0c0d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:13.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.669+0000 7f9c0be00640 1 --2- 172.21.15.144:0/2375353239 >> v2:172.21.15.165:3300/0 conn(0x7f9c0c15e640 0x7f9c0c0d3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.669+0000 7f9c0be00640 1 -- 172.21.15.144:0/2375353239 >> v1:172.21.15.144:6789/0 conn(0x7f9c0c0d3f60 legacy=0x7f9c0c0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.669+0000 7f9c0be00640 1 -- 172.21.15.144:0/2375353239 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0c06c1c0 con 0x7f9c0c0b66e0 2024-09-11T23:18:13.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.669+0000 7f9c0a000640 1 -- 172.21.15.144:0/2375353239 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3852265910 0 0) 0x7f9c0c06bee0 con 0x7f9c0c0d3f60 2024-09-11T23:18:13.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.670+0000 7f9c0be00640 1 --2- 172.21.15.144:0/2375353239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c0c0b66e0 0x7f9c0c0b7750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0d2030 tx=0x7f9c0402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ef340196c32793 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:13.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.670+0000 7f9c0a000640 1 -- 172.21.15.144:0/2375353239 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c04007740 con 0x7f9c0c0b66e0 2024-09-11T23:18:13.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.670+0000 7f9c0a000640 1 -- 172.21.15.144:0/2375353239 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c040078e0 con 0x7f9c0c0b66e0 2024-09-11T23:18:13.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.670+0000 7f9c0a000640 1 -- 172.21.15.144:0/2375353239 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c04007cb0 con 0x7f9c0c0b66e0 2024-09-11T23:18:13.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.671+0000 7f9c10c00640 1 -- 172.21.15.144:0/2375353239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c0c0b66e0 msgr2=0x7f9c0c0b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.671+0000 7f9c10c00640 1 --2- 172.21.15.144:0/2375353239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c0c0b66e0 0x7f9c0c0b7750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0d2030 tx=0x7f9c0402a680 comp rx=0 tx=0).stop 2024-09-11T23:18:13.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.671+0000 7f9c10c00640 1 -- 172.21.15.144:0/2375353239 shutdown_connections 2024-09-11T23:18:13.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.671+0000 7f9c10c00640 1 --2- 172.21.15.144:0/2375353239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c0c0b66e0 0x7f9c0c0b7750 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.671+0000 7f9c10c00640 1 --2- 172.21.15.144:0/2375353239 >> v2:172.21.15.165:3300/0 conn(0x7f9c0c15e640 0x7f9c0c0d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.671+0000 7f9c10c00640 1 -- 172.21.15.144:0/2375353239 >> 172.21.15.144:0/2375353239 conn(0x7f9c0c0d0fd0 msgr2=0x7f9c0c0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:13.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.671+0000 7f9c10c00640 1 -- 172.21.15.144:0/2375353239 shutdown_connections 2024-09-11T23:18:13.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.671+0000 7f9c10c00640 1 -- 172.21.15.144:0/2375353239 wait complete. 2024-09-11T23:18:13.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.672+0000 7f9c10c00640 1 Processor -- start 2024-09-11T23:18:13.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.672+0000 7f9c10c00640 1 -- start start 2024-09-11T23:18:13.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.673+0000 7f9c10c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c0c0b66e0 0x7f9c0c0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:13.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.673+0000 7f9c10c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c0c0d3f60 0x7f9c0c1f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:13.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.673+0000 7f9c10c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c0c15e640 0x7f9c0c160940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:13.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.673+0000 7f9c10c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c0b7c90 con 0x7f9c0c0d3f60 2024-09-11T23:18:13.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.673+0000 7f9c10c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c06c780 con 0x7f9c0c15e640 2024-09-11T23:18:13.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.673+0000 7f9c10c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9c0c0b7e10 con 0x7f9c0c0b66e0 2024-09-11T23:18:13.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.673+0000 7f9c0aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c0c0d3f60 0x7f9c0c1f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:13.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.673+0000 7f9c0aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c0c0d3f60 0x7f9c0c1f3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49594/0 (socket says 172.21.15.144:49594) 2024-09-11T23:18:13.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.673+0000 7f9c0aa00640 1 -- 172.21.15.144:0/2083918398 learned_addr learned my addr 172.21.15.144:0/2083918398 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:13.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.674+0000 7f9c0be00640 1 --2- 172.21.15.144:0/2083918398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c0c15e640 0x7f9c0c160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:13.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.674+0000 7f9c0b400640 1 --2- 172.21.15.144:0/2083918398 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c0c0b66e0 0x7f9c0c0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:13.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.674+0000 7f9c0aa00640 1 -- 172.21.15.144:0/2083918398 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c0c0b66e0 msgr2=0x7f9c0c0cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.674+0000 7f9c0aa00640 1 --2- 172.21.15.144:0/2083918398 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c0c0b66e0 0x7f9c0c0cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.674+0000 7f9c0aa00640 1 -- 172.21.15.144:0/2083918398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c0c15e640 msgr2=0x7f9c0c160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.674+0000 7f9c0aa00640 1 --2- 172.21.15.144:0/2083918398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c0c15e640 0x7f9c0c160940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.674+0000 7f9c0aa00640 1 -- 172.21.15.144:0/2083918398 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0c160e80 con 0x7f9c0c0d3f60 2024-09-11T23:18:13.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.674+0000 7f9c0b400640 1 --2- 172.21.15.144:0/2083918398 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c0c0b66e0 0x7f9c0c0cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:13.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.674+0000 7f9c0aa00640 1 --2- 172.21.15.144:0/2083918398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c0c0d3f60 0x7f9c0c1f3ed0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800c4d0 tx=0x7f9bf800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:13.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.674+0000 7f9c03400640 1 -- 172.21.15.144:0/2083918398 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8018070 con 0x7f9c0c0d3f60 2024-09-11T23:18:13.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.674+0000 7f9c03400640 1 -- 172.21.15.144:0/2083918398 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf8007500 con 0x7f9c0c0d3f60 2024-09-11T23:18:13.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.674+0000 7f9c03400640 1 -- 172.21.15.144:0/2083918398 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8004a20 con 0x7f9c0c0d3f60 2024-09-11T23:18:13.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.674+0000 7f9c10c00640 1 -- 172.21.15.144:0/2083918398 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0c1f4e70 con 0x7f9c0c0d3f60 2024-09-11T23:18:13.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.674+0000 7f9c10c00640 1 -- 172.21.15.144:0/2083918398 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c0c1f48b0 con 0x7f9c0c0d3f60 2024-09-11T23:18:13.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.675+0000 7f9c10c00640 1 -- 172.21.15.144:0/2083918398 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c0c0b7750 con 0x7f9c0c0d3f60 2024-09-11T23:18:13.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.676+0000 7f9c03400640 1 -- 172.21.15.144:0/2083918398 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9bf801b070 con 0x7f9c0c0d3f60 2024-09-11T23:18:13.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.677+0000 7f9c03400640 1 --2- 172.21.15.144:0/2083918398 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9bec06be30 0x7f9bec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:13.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.677+0000 7f9c03400640 1 -- 172.21.15.144:0/2083918398 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9bf808a110 con 0x7f9c0c0d3f60 2024-09-11T23:18:13.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.677+0000 7f9c0b400640 1 --2- 172.21.15.144:0/2083918398 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9bec06be30 0x7f9bec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:13.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.678+0000 7f9c0b400640 1 --2- 172.21.15.144:0/2083918398 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9bec06be30 0x7f9bec06e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009af0 tx=0x7f9bfc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:13.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.682+0000 7f9c03400640 1 -- 172.21.15.144:0/2083918398 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9bf8058460 con 0x7f9c0c0d3f60 2024-09-11T23:18:13.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.852+0000 7f9c10c00640 1 -- 172.21.15.144:0/2083918398 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9c0c0ce960 con 0x7f9bec06be30 2024-09-11T23:18:13.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.858+0000 7f9c03400640 1 -- 172.21.15.144:0/2083918398 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251835 (secure 0 0 0) 0x7f9c0c0ce960 con 0x7f9bec06be30 2024-09-11T23:18:13.905 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:13.930 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:18:13.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.862+0000 7f9c10c00640 1 -- 172.21.15.144:0/2083918398 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9bec06be30 msgr2=0x7f9bec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.862+0000 7f9c10c00640 1 --2- 172.21.15.144:0/2083918398 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9bec06be30 0x7f9bec06e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009af0 tx=0x7f9bfc008040 comp rx=0 tx=0).stop 2024-09-11T23:18:13.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.862+0000 7f9c10c00640 1 -- 172.21.15.144:0/2083918398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c0c0d3f60 msgr2=0x7f9c0c1f3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:13.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.862+0000 7f9c10c00640 1 --2- 172.21.15.144:0/2083918398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c0c0d3f60 0x7f9c0c1f3ed0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800c4d0 tx=0x7f9bf800c990 comp rx=0 tx=0).stop 2024-09-11T23:18:13.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.862+0000 7f9c10c00640 1 -- 172.21.15.144:0/2083918398 shutdown_connections 2024-09-11T23:18:13.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.862+0000 7f9c10c00640 1 --2- 172.21.15.144:0/2083918398 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9bec06be30 0x7f9bec06e2f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.862+0000 7f9c10c00640 1 --2- 172.21.15.144:0/2083918398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c0c15e640 0x7f9c0c160940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.862+0000 7f9c10c00640 1 --2- 172.21.15.144:0/2083918398 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c0c0d3f60 0x7f9c0c1f3ed0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.862+0000 7f9c10c00640 1 --2- 172.21.15.144:0/2083918398 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c0c0b66e0 0x7f9c0c0cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:13.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.862+0000 7f9c10c00640 1 -- 172.21.15.144:0/2083918398 >> 172.21.15.144:0/2083918398 conn(0x7f9c0c0d0fd0 msgr2=0x7f9c0c0d0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:13.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.862+0000 7f9c10c00640 1 -- 172.21.15.144:0/2083918398 shutdown_connections 2024-09-11T23:18:13.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:13.862+0000 7f9c10c00640 1 -- 172.21.15.144:0/2083918398 wait complete. 2024-09-11T23:18:13.934 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-11T23:18:13.164967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219188,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755532,"statfs":{"total":773094113280,"available":772869664768,"internally_reserved":0,"allocated":2990080,"data_stored":1792852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002680"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643816+0000","last_change":"2024-09-11T23:17:59.655120+0000","last_active":"2024-09-11T23:18:00.643816+0000","last_peered":"2024-09-11T23:18:00.643816+0000","last_clean":"2024-09-11T23:18:00.643816+0000","last_became_active":"2024-09-11T23:17:59.654860+0000","last_became_peered":"2024-09-11T23:17:59.654860+0000","last_unstale":"2024-09-11T23:18:00.643816+0000","last_undegraded":"2024-09-11T23:18:00.643816+0000","last_fullsized":"2024-09-11T23:18:00.643816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:25.734147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642029+0000","last_change":"2024-09-11T23:17:59.641566+0000","last_active":"2024-09-11T23:18:00.642029+0000","last_peered":"2024-09-11T23:18:00.642029+0000","last_clean":"2024-09-11T23:18:00.642029+0000","last_became_active":"2024-09-11T23:17:59.641276+0000","last_became_peered":"2024-09-11T23:17:59.641276+0000","last_unstale":"2024-09-11T23:18:00.642029+0000","last_undegraded":"2024-09-11T23:18:00.642029+0000","last_fullsized":"2024-09-11T23:18:00.642029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.341838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669562+0000","last_change":"2024-09-11T23:17:59.635790+0000","last_active":"2024-09-11T23:18:00.669562+0000","last_peered":"2024-09-11T23:18:00.669562+0000","last_clean":"2024-09-11T23:18:00.669562+0000","last_became_active":"2024-09-11T23:17:59.635509+0000","last_became_peered":"2024-09-11T23:17:59.635509+0000","last_unstale":"2024-09-11T23:18:00.669562+0000","last_undegraded":"2024-09-11T23:18:00.669562+0000","last_fullsized":"2024-09-11T23:18:00.669562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.193032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644696+0000","last_change":"2024-09-11T23:17:59.644202+0000","last_active":"2024-09-11T23:18:00.644696+0000","last_peered":"2024-09-11T23:18:00.644696+0000","last_clean":"2024-09-11T23:18:00.644696+0000","last_became_active":"2024-09-11T23:17:59.643634+0000","last_became_peered":"2024-09-11T23:17:59.643634+0000","last_unstale":"2024-09-11T23:18:00.644696+0000","last_undegraded":"2024-09-11T23:18:00.644696+0000","last_fullsized":"2024-09-11T23:18:00.644696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:38.039621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643545+0000","last_change":"2024-09-11T23:17:59.652783+0000","last_active":"2024-09-11T23:18:00.643545+0000","last_peered":"2024-09-11T23:18:00.643545+0000","last_clean":"2024-09-11T23:18:00.643545+0000","last_became_active":"2024-09-11T23:17:59.652508+0000","last_became_peered":"2024-09-11T23:17:59.652508+0000","last_unstale":"2024-09-11T23:18:00.643545+0000","last_undegraded":"2024-09-11T23:18:00.643545+0000","last_fullsized":"2024-09-11T23:18:00.643545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:04.566161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642782+0000","last_change":"2024-09-11T23:17:59.659401+0000","last_active":"2024-09-11T23:18:00.642782+0000","last_peered":"2024-09-11T23:18:00.642782+0000","last_clean":"2024-09-11T23:18:00.642782+0000","last_became_active":"2024-09-11T23:17:59.655926+0000","last_became_peered":"2024-09-11T23:17:59.655926+0000","last_unstale":"2024-09-11T23:18:00.642782+0000","last_undegraded":"2024-09-11T23:18:00.642782+0000","last_fullsized":"2024-09-11T23:18:00.642782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:09.804490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643447+0000","last_change":"2024-09-11T23:17:59.657900+0000","last_active":"2024-09-11T23:18:00.643447+0000","last_peered":"2024-09-11T23:18:00.643447+0000","last_clean":"2024-09-11T23:18:00.643447+0000","last_became_active":"2024-09-11T23:17:59.657621+0000","last_became_peered":"2024-09-11T23:17:59.657621+0000","last_unstale":"2024-09-11T23:18:00.643447+0000","last_undegraded":"2024-09-11T23:18:00.643447+0000","last_fullsized":"2024-09-11T23:18:00.643447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:14.020762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669094+0000","last_change":"2024-09-11T23:17:59.643006+0000","last_active":"2024-09-11T23:18:00.669094+0000","last_peered":"2024-09-11T23:18:00.669094+0000","last_clean":"2024-09-11T23:18:00.669094+0000","last_became_active":"2024-09-11T23:17:59.642338+0000","last_became_peered":"2024-09-11T23:17:59.642338+0000","last_unstale":"2024-09-11T23:18:00.669094+0000","last_undegraded":"2024-09-11T23:18:00.669094+0000","last_fullsized":"2024-09-11T23:18:00.669094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:29.873658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644073+0000","last_change":"2024-09-11T23:17:59.671758+0000","last_active":"2024-09-11T23:18:00.644073+0000","last_peered":"2024-09-11T23:18:00.644073+0000","last_clean":"2024-09-11T23:18:00.644073+0000","last_became_active":"2024-09-11T23:17:59.671418+0000","last_became_peered":"2024-09-11T23:17:59.671418+0000","last_unstale":"2024-09-11T23:18:00.644073+0000","last_undegraded":"2024-09-11T23:18:00.644073+0000","last_fullsized":"2024-09-11T23:18:00.644073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:31.034856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661864+0000","last_change":"2024-09-11T23:17:59.656199+0000","last_active":"2024-09-11T23:18:00.661864+0000","last_peered":"2024-09-11T23:18:00.661864+0000","last_clean":"2024-09-11T23:18:00.661864+0000","last_became_active":"2024-09-11T23:17:59.655919+0000","last_became_peered":"2024-09-11T23:17:59.655919+0000","last_unstale":"2024-09-11T23:18:00.661864+0000","last_undegraded":"2024-09-11T23:18:00.661864+0000","last_fullsized":"2024-09-11T23:18:00.661864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:50.844310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661743+0000","last_change":"2024-09-11T23:17:59.646129+0000","last_active":"2024-09-11T23:18:00.661743+0000","last_peered":"2024-09-11T23:18:00.661743+0000","last_clean":"2024-09-11T23:18:00.661743+0000","last_became_active":"2024-09-11T23:17:59.645346+0000","last_became_peered":"2024-09-11T23:17:59.645346+0000","last_unstale":"2024-09-11T23:18:00.661743+0000","last_undegraded":"2024-09-11T23:18:00.661743+0000","last_fullsized":"2024-09-11T23:18:00.661743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:05.705455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669760+0000","last_change":"2024-09-11T23:17:59.642874+0000","last_active":"2024-09-11T23:18:00.669760+0000","last_peered":"2024-09-11T23:18:00.669760+0000","last_clean":"2024-09-11T23:18:00.669760+0000","last_became_active":"2024-09-11T23:17:59.642586+0000","last_became_peered":"2024-09-11T23:17:59.642586+0000","last_unstale":"2024-09-11T23:18:00.669760+0000","last_undegraded":"2024-09-11T23:18:00.669760+0000","last_fullsized":"2024-09-11T23:18:00.669760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:57.703691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670655+0000","last_change":"2024-09-11T23:17:59.644814+0000","last_active":"2024-09-11T23:18:00.670655+0000","last_peered":"2024-09-11T23:18:00.670655+0000","last_clean":"2024-09-11T23:18:00.670655+0000","last_became_active":"2024-09-11T23:17:59.643305+0000","last_became_peered":"2024-09-11T23:17:59.643305+0000","last_unstale":"2024-09-11T23:18:00.670655+0000","last_undegraded":"2024-09-11T23:18:00.670655+0000","last_fullsized":"2024-09-11T23:18:00.670655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:29.321395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669106+0000","last_change":"2024-09-11T23:17:59.645525+0000","last_active":"2024-09-11T23:18:00.669106+0000","last_peered":"2024-09-11T23:18:00.669106+0000","last_clean":"2024-09-11T23:18:00.669106+0000","last_became_active":"2024-09-11T23:17:59.642799+0000","last_became_peered":"2024-09-11T23:17:59.642799+0000","last_unstale":"2024-09-11T23:18:00.669106+0000","last_undegraded":"2024-09-11T23:18:00.669106+0000","last_fullsized":"2024-09-11T23:18:00.669106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:24.269862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641613+0000","last_change":"2024-09-11T23:17:59.634022+0000","last_active":"2024-09-11T23:18:00.641613+0000","last_peered":"2024-09-11T23:18:00.641613+0000","last_clean":"2024-09-11T23:18:00.641613+0000","last_became_active":"2024-09-11T23:17:59.632934+0000","last_became_peered":"2024-09-11T23:17:59.632934+0000","last_unstale":"2024-09-11T23:18:00.641613+0000","last_undegraded":"2024-09-11T23:18:00.641613+0000","last_fullsized":"2024-09-11T23:18:00.641613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:36.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642779+0000","last_change":"2024-09-11T23:17:59.653627+0000","last_active":"2024-09-11T23:18:00.642779+0000","last_peered":"2024-09-11T23:18:00.642779+0000","last_clean":"2024-09-11T23:18:00.642779+0000","last_became_active":"2024-09-11T23:17:59.653088+0000","last_became_peered":"2024-09-11T23:17:59.653088+0000","last_unstale":"2024-09-11T23:18:00.642779+0000","last_undegraded":"2024-09-11T23:18:00.642779+0000","last_fullsized":"2024-09-11T23:18:00.642779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.341838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.645123+0000","last_change":"2024-09-11T23:17:59.660074+0000","last_active":"2024-09-11T23:18:00.645123+0000","last_peered":"2024-09-11T23:18:00.645123+0000","last_clean":"2024-09-11T23:18:00.645123+0000","last_became_active":"2024-09-11T23:17:59.659174+0000","last_became_peered":"2024-09-11T23:17:59.659174+0000","last_unstale":"2024-09-11T23:18:00.645123+0000","last_undegraded":"2024-09-11T23:18:00.645123+0000","last_fullsized":"2024-09-11T23:18:00.645123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:55.351687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669448+0000","last_change":"2024-09-11T23:17:59.641202+0000","last_active":"2024-09-11T23:18:00.669448+0000","last_peered":"2024-09-11T23:18:00.669448+0000","last_clean":"2024-09-11T23:18:00.669448+0000","last_became_active":"2024-09-11T23:17:59.640609+0000","last_became_peered":"2024-09-11T23:17:59.640609+0000","last_unstale":"2024-09-11T23:18:00.669448+0000","last_undegraded":"2024-09-11T23:18:00.669448+0000","last_fullsized":"2024-09-11T23:18:00.669448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:34.428505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643995+0000","last_change":"2024-09-11T23:17:59.654884+0000","last_active":"2024-09-11T23:18:00.643995+0000","last_peered":"2024-09-11T23:18:00.643995+0000","last_clean":"2024-09-11T23:18:00.643995+0000","last_became_active":"2024-09-11T23:17:59.654578+0000","last_became_peered":"2024-09-11T23:17:59.654578+0000","last_unstale":"2024-09-11T23:18:00.643995+0000","last_undegraded":"2024-09-11T23:18:00.643995+0000","last_fullsized":"2024-09-11T23:18:00.643995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:32.837922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661704+0000","last_change":"2024-09-11T23:17:59.643411+0000","last_active":"2024-09-11T23:18:00.661704+0000","last_peered":"2024-09-11T23:18:00.661704+0000","last_clean":"2024-09-11T23:18:00.661704+0000","last_became_active":"2024-09-11T23:17:59.643076+0000","last_became_peered":"2024-09-11T23:17:59.643076+0000","last_unstale":"2024-09-11T23:18:00.661704+0000","last_undegraded":"2024-09-11T23:18:00.661704+0000","last_fullsized":"2024-09-11T23:18:00.661704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:36.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669545+0000","last_change":"2024-09-11T23:17:59.650880+0000","last_active":"2024-09-11T23:18:00.669545+0000","last_peered":"2024-09-11T23:18:00.669545+0000","last_clean":"2024-09-11T23:18:00.669545+0000","last_became_active":"2024-09-11T23:17:59.650568+0000","last_became_peered":"2024-09-11T23:17:59.650568+0000","last_unstale":"2024-09-11T23:18:00.669545+0000","last_undegraded":"2024-09-11T23:18:00.669545+0000","last_fullsized":"2024-09-11T23:18:00.669545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:15.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642771+0000","last_change":"2024-09-11T23:17:59.666448+0000","last_active":"2024-09-11T23:18:00.642771+0000","last_peered":"2024-09-11T23:18:00.642771+0000","last_clean":"2024-09-11T23:18:00.642771+0000","last_became_active":"2024-09-11T23:17:59.664741+0000","last_became_peered":"2024-09-11T23:17:59.664741+0000","last_unstale":"2024-09-11T23:18:00.642771+0000","last_undegraded":"2024-09-11T23:18:00.642771+0000","last_fullsized":"2024-09-11T23:18:00.642771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:50.844310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670229+0000","last_change":"2024-09-11T23:17:59.645036+0000","last_active":"2024-09-11T23:18:00.670229+0000","last_peered":"2024-09-11T23:18:00.670229+0000","last_clean":"2024-09-11T23:18:00.670229+0000","last_became_active":"2024-09-11T23:17:59.644706+0000","last_became_peered":"2024-09-11T23:17:59.644706+0000","last_unstale":"2024-09-11T23:18:00.670229+0000","last_undegraded":"2024-09-11T23:18:00.670229+0000","last_fullsized":"2024-09-11T23:18:00.670229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:04.266917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642955+0000","last_change":"2024-09-11T23:17:59.653352+0000","last_active":"2024-09-11T23:18:00.642955+0000","last_peered":"2024-09-11T23:18:00.642955+0000","last_clean":"2024-09-11T23:18:00.642955+0000","last_became_active":"2024-09-11T23:17:59.652470+0000","last_became_peered":"2024-09-11T23:17:59.652470+0000","last_unstale":"2024-09-11T23:18:00.642955+0000","last_undegraded":"2024-09-11T23:18:00.642955+0000","last_fullsized":"2024-09-11T23:18:00.642955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:15.213721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671014+0000","last_change":"2024-09-11T23:17:59.662259+0000","last_active":"2024-09-11T23:18:00.671014+0000","last_peered":"2024-09-11T23:18:00.671014+0000","last_clean":"2024-09-11T23:18:00.671014+0000","last_became_active":"2024-09-11T23:17:59.662031+0000","last_became_peered":"2024-09-11T23:17:59.662031+0000","last_unstale":"2024-09-11T23:18:00.671014+0000","last_undegraded":"2024-09-11T23:18:00.671014+0000","last_fullsized":"2024-09-11T23:18:00.671014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:34.160365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661875+0000","last_change":"2024-09-11T23:17:59.650797+0000","last_active":"2024-09-11T23:18:00.661875+0000","last_peered":"2024-09-11T23:18:00.661875+0000","last_clean":"2024-09-11T23:18:00.661875+0000","last_became_active":"2024-09-11T23:17:59.650548+0000","last_became_peered":"2024-09-11T23:17:59.650548+0000","last_unstale":"2024-09-11T23:18:00.661875+0000","last_undegraded":"2024-09-11T23:18:00.661875+0000","last_fullsized":"2024-09-11T23:18:00.661875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.341838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641767+0000","last_change":"2024-09-11T23:17:59.646422+0000","last_active":"2024-09-11T23:18:00.641767+0000","last_peered":"2024-09-11T23:18:00.641767+0000","last_clean":"2024-09-11T23:18:00.641767+0000","last_became_active":"2024-09-11T23:17:59.646112+0000","last_became_peered":"2024-09-11T23:17:59.646112+0000","last_unstale":"2024-09-11T23:18:00.641767+0000","last_undegraded":"2024-09-11T23:18:00.641767+0000","last_fullsized":"2024-09-11T23:18:00.641767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:50.844310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670965+0000","last_change":"2024-09-11T23:17:59.644063+0000","last_active":"2024-09-11T23:18:00.670965+0000","last_peered":"2024-09-11T23:18:00.670965+0000","last_clean":"2024-09-11T23:18:00.670965+0000","last_became_active":"2024-09-11T23:17:59.643760+0000","last_became_peered":"2024-09-11T23:17:59.643760+0000","last_unstale":"2024-09-11T23:18:00.670965+0000","last_undegraded":"2024-09-11T23:18:00.670965+0000","last_fullsized":"2024-09-11T23:18:00.670965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:31.141907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669864+0000","last_change":"2024-09-11T23:17:59.645858+0000","last_active":"2024-09-11T23:18:00.669864+0000","last_peered":"2024-09-11T23:18:00.669864+0000","last_clean":"2024-09-11T23:18:00.669864+0000","last_became_active":"2024-09-11T23:17:59.645602+0000","last_became_peered":"2024-09-11T23:17:59.645602+0000","last_unstale":"2024-09-11T23:18:00.669864+0000","last_undegraded":"2024-09-11T23:18:00.669864+0000","last_fullsized":"2024-09-11T23:18:00.669864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:09.804490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642891+0000","last_change":"2024-09-11T23:17:59.657821+0000","last_active":"2024-09-11T23:18:00.642891+0000","last_peered":"2024-09-11T23:18:00.642891+0000","last_clean":"2024-09-11T23:18:00.642891+0000","last_became_active":"2024-09-11T23:17:59.645334+0000","last_became_peered":"2024-09-11T23:17:59.645334+0000","last_unstale":"2024-09-11T23:18:00.642891+0000","last_undegraded":"2024-09-11T23:18:00.642891+0000","last_fullsized":"2024-09-11T23:18:00.642891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:28.813283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669574+0000","last_change":"2024-09-11T23:17:59.636987+0000","last_active":"2024-09-11T23:18:00.669574+0000","last_peered":"2024-09-11T23:18:00.669574+0000","last_clean":"2024-09-11T23:18:00.669574+0000","last_became_active":"2024-09-11T23:17:59.636762+0000","last_became_peered":"2024-09-11T23:17:59.636762+0000","last_unstale":"2024-09-11T23:18:00.669574+0000","last_undegraded":"2024-09-11T23:18:00.669574+0000","last_fullsized":"2024-09-11T23:18:00.669574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:10.353893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661493+0000","last_change":"2024-09-11T23:17:59.648354+0000","last_active":"2024-09-11T23:18:00.661493+0000","last_peered":"2024-09-11T23:18:00.661493+0000","last_clean":"2024-09-11T23:18:00.661493+0000","last_became_active":"2024-09-11T23:17:59.646693+0000","last_became_peered":"2024-09-11T23:17:59.646693+0000","last_unstale":"2024-09-11T23:18:00.661493+0000","last_undegraded":"2024-09-11T23:18:00.661493+0000","last_fullsized":"2024-09-11T23:18:00.661493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:15.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669206+0000","last_change":"2024-09-11T23:17:59.637101+0000","last_active":"2024-09-11T23:18:00.669206+0000","last_peered":"2024-09-11T23:18:00.669206+0000","last_clean":"2024-09-11T23:18:00.669206+0000","last_became_active":"2024-09-11T23:17:59.635407+0000","last_became_peered":"2024-09-11T23:17:59.635407+0000","last_unstale":"2024-09-11T23:18:00.669206+0000","last_undegraded":"2024-09-11T23:18:00.669206+0000","last_fullsized":"2024-09-11T23:18:00.669206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:35.519961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670769+0000","last_change":"2024-09-11T23:17:58.642664+0000","last_active":"2024-09-11T23:18:00.670769+0000","last_peered":"2024-09-11T23:18:00.670769+0000","last_clean":"2024-09-11T23:18:00.670769+0000","last_became_active":"2024-09-11T23:17:58.642371+0000","last_became_peered":"2024-09-11T23:17:58.642371+0000","last_unstale":"2024-09-11T23:18:00.670769+0000","last_undegraded":"2024-09-11T23:18:00.670769+0000","last_fullsized":"2024-09-11T23:18:00.670769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:31.214611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669649+0000","last_change":"2024-09-11T23:17:59.641906+0000","last_active":"2024-09-11T23:18:00.669649+0000","last_peered":"2024-09-11T23:18:00.669649+0000","last_clean":"2024-09-11T23:18:00.669649+0000","last_became_active":"2024-09-11T23:17:59.641634+0000","last_became_peered":"2024-09-11T23:17:59.641634+0000","last_unstale":"2024-09-11T23:18:00.669649+0000","last_undegraded":"2024-09-11T23:18:00.669649+0000","last_fullsized":"2024-09-11T23:18:00.669649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:36.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661629+0000","last_change":"2024-09-11T23:17:58.640442+0000","last_active":"2024-09-11T23:18:00.661629+0000","last_peered":"2024-09-11T23:18:00.661629+0000","last_clean":"2024-09-11T23:18:00.661629+0000","last_became_active":"2024-09-11T23:17:58.640148+0000","last_became_peered":"2024-09-11T23:17:58.640148+0000","last_unstale":"2024-09-11T23:18:00.661629+0000","last_undegraded":"2024-09-11T23:18:00.661629+0000","last_fullsized":"2024-09-11T23:18:00.661629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:02.505670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670322+0000","last_change":"2024-09-11T23:17:58.640181+0000","last_active":"2024-09-11T23:18:00.670322+0000","last_peered":"2024-09-11T23:18:00.670322+0000","last_clean":"2024-09-11T23:18:00.670322+0000","last_became_active":"2024-09-11T23:17:58.639944+0000","last_became_peered":"2024-09-11T23:17:58.639944+0000","last_unstale":"2024-09-11T23:18:00.670322+0000","last_undegraded":"2024-09-11T23:18:00.670322+0000","last_fullsized":"2024-09-11T23:18:00.670322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:02.827617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669793+0000","last_change":"2024-09-11T23:17:59.643922+0000","last_active":"2024-09-11T23:18:00.669793+0000","last_peered":"2024-09-11T23:18:00.669793+0000","last_clean":"2024-09-11T23:18:00.669793+0000","last_became_active":"2024-09-11T23:17:59.643613+0000","last_became_peered":"2024-09-11T23:17:59.643613+0000","last_unstale":"2024-09-11T23:18:00.669793+0000","last_undegraded":"2024-09-11T23:18:00.669793+0000","last_fullsized":"2024-09-11T23:18:00.669793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:31.792631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643050+0000","last_change":"2024-09-11T23:17:58.640428+0000","last_active":"2024-09-11T23:18:00.643050+0000","last_peered":"2024-09-11T23:18:00.643050+0000","last_clean":"2024-09-11T23:18:00.643050+0000","last_became_active":"2024-09-11T23:17:58.639860+0000","last_became_peered":"2024-09-11T23:17:58.639860+0000","last_unstale":"2024-09-11T23:18:00.643050+0000","last_undegraded":"2024-09-11T23:18:00.643050+0000","last_fullsized":"2024-09-11T23:18:00.643050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641494+0000","last_change":"2024-09-11T23:17:59.638046+0000","last_active":"2024-09-11T23:18:00.641494+0000","last_peered":"2024-09-11T23:18:00.641494+0000","last_clean":"2024-09-11T23:18:00.641494+0000","last_became_active":"2024-09-11T23:17:59.637621+0000","last_became_peered":"2024-09-11T23:17:59.637621+0000","last_unstale":"2024-09-11T23:18:00.641494+0000","last_undegraded":"2024-09-11T23:18:00.641494+0000","last_fullsized":"2024-09-11T23:18:00.641494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:15.476978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661844+0000","last_change":"2024-09-11T23:17:58.645977+0000","last_active":"2024-09-11T23:18:00.661844+0000","last_peered":"2024-09-11T23:18:00.661844+0000","last_clean":"2024-09-11T23:18:00.661844+0000","last_became_active":"2024-09-11T23:17:58.645482+0000","last_became_peered":"2024-09-11T23:17:58.645482+0000","last_unstale":"2024-09-11T23:18:00.661844+0000","last_undegraded":"2024-09-11T23:18:00.661844+0000","last_fullsized":"2024-09-11T23:18:00.661844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:31.277023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644953+0000","last_change":"2024-09-11T23:17:59.658501+0000","last_active":"2024-09-11T23:18:00.644953+0000","last_peered":"2024-09-11T23:18:00.644953+0000","last_clean":"2024-09-11T23:18:00.644953+0000","last_became_active":"2024-09-11T23:17:59.658268+0000","last_became_peered":"2024-09-11T23:17:59.658268+0000","last_unstale":"2024-09-11T23:18:00.644953+0000","last_undegraded":"2024-09-11T23:18:00.644953+0000","last_fullsized":"2024-09-11T23:18:00.644953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:13.861431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.645078+0000","last_change":"2024-09-11T23:17:58.640356+0000","last_active":"2024-09-11T23:18:00.645078+0000","last_peered":"2024-09-11T23:18:00.645078+0000","last_clean":"2024-09-11T23:18:00.645078+0000","last_became_active":"2024-09-11T23:17:58.640060+0000","last_became_peered":"2024-09-11T23:17:58.640060+0000","last_unstale":"2024-09-11T23:18:00.645078+0000","last_undegraded":"2024-09-11T23:18:00.645078+0000","last_fullsized":"2024-09-11T23:18:00.645078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:31.277023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669890+0000","last_change":"2024-09-11T23:17:59.669290+0000","last_active":"2024-09-11T23:18:00.669890+0000","last_peered":"2024-09-11T23:18:00.669890+0000","last_clean":"2024-09-11T23:18:00.669890+0000","last_became_active":"2024-09-11T23:17:59.668837+0000","last_became_peered":"2024-09-11T23:17:59.668837+0000","last_unstale":"2024-09-11T23:18:00.669890+0000","last_undegraded":"2024-09-11T23:18:00.669890+0000","last_fullsized":"2024-09-11T23:18:00.669890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:50.844310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641822+0000","last_change":"2024-09-11T23:17:58.646012+0000","last_active":"2024-09-11T23:18:00.641822+0000","last_peered":"2024-09-11T23:18:00.641822+0000","last_clean":"2024-09-11T23:18:00.641822+0000","last_became_active":"2024-09-11T23:17:58.645093+0000","last_became_peered":"2024-09-11T23:17:58.645093+0000","last_unstale":"2024-09-11T23:18:00.641822+0000","last_undegraded":"2024-09-11T23:18:00.641822+0000","last_fullsized":"2024-09-11T23:18:00.641822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:31.277023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669811+0000","last_change":"2024-09-11T23:17:59.653386+0000","last_active":"2024-09-11T23:18:00.669811+0000","last_peered":"2024-09-11T23:18:00.669811+0000","last_clean":"2024-09-11T23:18:00.669811+0000","last_became_active":"2024-09-11T23:17:59.653112+0000","last_became_peered":"2024-09-11T23:17:59.653112+0000","last_unstale":"2024-09-11T23:18:00.669811+0000","last_undegraded":"2024-09-11T23:18:00.669811+0000","last_fullsized":"2024-09-11T23:18:00.669811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:30.915550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661618+0000","last_change":"2024-09-11T23:17:58.642732+0000","last_active":"2024-09-11T23:18:00.661618+0000","last_peered":"2024-09-11T23:18:00.661618+0000","last_clean":"2024-09-11T23:18:00.661618+0000","last_became_active":"2024-09-11T23:17:58.642411+0000","last_became_peered":"2024-09-11T23:17:58.642411+0000","last_unstale":"2024-09-11T23:18:00.661618+0000","last_undegraded":"2024-09-11T23:18:00.661618+0000","last_fullsized":"2024-09-11T23:18:00.661618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:21.084931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643652+0000","last_change":"2024-09-11T23:17:59.652260+0000","last_active":"2024-09-11T23:18:00.643652+0000","last_peered":"2024-09-11T23:18:00.643652+0000","last_clean":"2024-09-11T23:18:00.643652+0000","last_became_active":"2024-09-11T23:17:59.651842+0000","last_became_peered":"2024-09-11T23:17:59.651842+0000","last_unstale":"2024-09-11T23:18:00.643652+0000","last_undegraded":"2024-09-11T23:18:00.643652+0000","last_fullsized":"2024-09-11T23:18:00.643652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:13.861431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669696+0000","last_change":"2024-09-11T23:17:58.629743+0000","last_active":"2024-09-11T23:18:00.669696+0000","last_peered":"2024-09-11T23:18:00.669696+0000","last_clean":"2024-09-11T23:18:00.669696+0000","last_became_active":"2024-09-11T23:17:58.629379+0000","last_became_peered":"2024-09-11T23:17:58.629379+0000","last_unstale":"2024-09-11T23:18:00.669696+0000","last_undegraded":"2024-09-11T23:18:00.669696+0000","last_fullsized":"2024-09-11T23:18:00.669696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:09.475238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669255+0000","last_change":"2024-09-11T23:17:59.647539+0000","last_active":"2024-09-11T23:18:00.669255+0000","last_peered":"2024-09-11T23:18:00.669255+0000","last_clean":"2024-09-11T23:18:00.669255+0000","last_became_active":"2024-09-11T23:17:59.647293+0000","last_became_peered":"2024-09-11T23:17:59.647293+0000","last_unstale":"2024-09-11T23:18:00.669255+0000","last_undegraded":"2024-09-11T23:18:00.669255+0000","last_fullsized":"2024-09-11T23:18:00.669255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:49.647417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642905+0000","last_change":"2024-09-11T23:17:58.641139+0000","last_active":"2024-09-11T23:18:00.642905+0000","last_peered":"2024-09-11T23:18:00.642905+0000","last_clean":"2024-09-11T23:18:00.642905+0000","last_became_active":"2024-09-11T23:17:58.640813+0000","last_became_peered":"2024-09-11T23:17:58.640813+0000","last_unstale":"2024-09-11T23:18:00.642905+0000","last_undegraded":"2024-09-11T23:18:00.642905+0000","last_fullsized":"2024-09-11T23:18:00.642905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:02.505670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643757+0000","last_change":"2024-09-11T23:17:59.661121+0000","last_active":"2024-09-11T23:18:00.643757+0000","last_peered":"2024-09-11T23:18:00.643757+0000","last_clean":"2024-09-11T23:18:00.643757+0000","last_became_active":"2024-09-11T23:17:59.660078+0000","last_became_peered":"2024-09-11T23:17:59.660078+0000","last_unstale":"2024-09-11T23:18:00.643757+0000","last_undegraded":"2024-09-11T23:18:00.643757+0000","last_fullsized":"2024-09-11T23:18:00.643757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:55.351687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661430+0000","last_change":"2024-09-11T23:17:58.636194+0000","last_active":"2024-09-11T23:18:00.661430+0000","last_peered":"2024-09-11T23:18:00.661430+0000","last_clean":"2024-09-11T23:18:00.661430+0000","last_became_active":"2024-09-11T23:17:58.635885+0000","last_became_peered":"2024-09-11T23:17:58.635885+0000","last_unstale":"2024-09-11T23:18:00.661430+0000","last_undegraded":"2024-09-11T23:18:00.661430+0000","last_fullsized":"2024-09-11T23:18:00.661430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:35.088737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661491+0000","last_change":"2024-09-11T23:17:59.648931+0000","last_active":"2024-09-11T23:18:00.661491+0000","last_peered":"2024-09-11T23:18:00.661491+0000","last_clean":"2024-09-11T23:18:00.661491+0000","last_became_active":"2024-09-11T23:17:59.646149+0000","last_became_peered":"2024-09-11T23:17:59.646149+0000","last_unstale":"2024-09-11T23:18:00.661491+0000","last_undegraded":"2024-09-11T23:18:00.661491+0000","last_fullsized":"2024-09-11T23:18:00.661491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.193032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669254+0000","last_change":"2024-09-11T23:17:58.631291+0000","last_active":"2024-09-11T23:18:00.669254+0000","last_peered":"2024-09-11T23:18:00.669254+0000","last_clean":"2024-09-11T23:18:00.669254+0000","last_became_active":"2024-09-11T23:17:58.630939+0000","last_became_peered":"2024-09-11T23:17:58.630939+0000","last_unstale":"2024-09-11T23:18:00.669254+0000","last_undegraded":"2024-09-11T23:18:00.669254+0000","last_fullsized":"2024-09-11T23:18:00.669254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:53:26.952229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643224+0000","last_change":"2024-09-11T23:17:59.660874+0000","last_active":"2024-09-11T23:18:00.643224+0000","last_peered":"2024-09-11T23:18:00.643224+0000","last_clean":"2024-09-11T23:18:00.643224+0000","last_became_active":"2024-09-11T23:17:59.660613+0000","last_became_peered":"2024-09-11T23:17:59.660613+0000","last_unstale":"2024-09-11T23:18:00.643224+0000","last_undegraded":"2024-09-11T23:18:00.643224+0000","last_fullsized":"2024-09-11T23:18:00.643224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:42.560113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670003+0000","last_change":"2024-09-11T23:17:58.635774+0000","last_active":"2024-09-11T23:18:00.670003+0000","last_peered":"2024-09-11T23:18:00.670003+0000","last_clean":"2024-09-11T23:18:00.670003+0000","last_became_active":"2024-09-11T23:17:58.634748+0000","last_became_peered":"2024-09-11T23:17:58.634748+0000","last_unstale":"2024-09-11T23:18:00.670003+0000","last_undegraded":"2024-09-11T23:18:00.670003+0000","last_fullsized":"2024-09-11T23:18:00.670003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:44.209956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643691+0000","last_change":"2024-09-11T23:17:59.662246+0000","last_active":"2024-09-11T23:18:00.643691+0000","last_peered":"2024-09-11T23:18:00.643691+0000","last_clean":"2024-09-11T23:18:00.643691+0000","last_became_active":"2024-09-11T23:17:59.661866+0000","last_became_peered":"2024-09-11T23:17:59.661866+0000","last_unstale":"2024-09-11T23:18:00.643691+0000","last_undegraded":"2024-09-11T23:18:00.643691+0000","last_fullsized":"2024-09-11T23:18:00.643691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:00.628195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669504+0000","last_change":"2024-09-11T23:17:58.634201+0000","last_active":"2024-09-11T23:18:00.669504+0000","last_peered":"2024-09-11T23:18:00.669504+0000","last_clean":"2024-09-11T23:18:00.669504+0000","last_became_active":"2024-09-11T23:17:58.633865+0000","last_became_peered":"2024-09-11T23:17:58.633865+0000","last_unstale":"2024-09-11T23:18:00.669504+0000","last_undegraded":"2024-09-11T23:18:00.669504+0000","last_fullsized":"2024-09-11T23:18:00.669504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:12.634428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644038+0000","last_change":"2024-09-11T23:17:59.668175+0000","last_active":"2024-09-11T23:18:00.644038+0000","last_peered":"2024-09-11T23:18:00.644038+0000","last_clean":"2024-09-11T23:18:00.644038+0000","last_became_active":"2024-09-11T23:17:59.665569+0000","last_became_peered":"2024-09-11T23:17:59.665569+0000","last_unstale":"2024-09-11T23:18:00.644038+0000","last_undegraded":"2024-09-11T23:18:00.644038+0000","last_fullsized":"2024-09-11T23:18:00.644038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:49.216535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641877+0000","last_change":"2024-09-11T23:17:58.630807+0000","last_active":"2024-09-11T23:18:00.641877+0000","last_peered":"2024-09-11T23:18:00.641877+0000","last_clean":"2024-09-11T23:18:00.641877+0000","last_became_active":"2024-09-11T23:17:58.630491+0000","last_became_peered":"2024-09-11T23:17:58.630491+0000","last_unstale":"2024-09-11T23:18:00.641877+0000","last_undegraded":"2024-09-11T23:18:00.641877+0000","last_fullsized":"2024-09-11T23:18:00.641877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.907527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644892+0000","last_change":"2024-09-11T23:17:59.643945+0000","last_active":"2024-09-11T23:18:00.644892+0000","last_peered":"2024-09-11T23:18:00.644892+0000","last_clean":"2024-09-11T23:18:00.644892+0000","last_became_active":"2024-09-11T23:17:59.643358+0000","last_became_peered":"2024-09-11T23:17:59.643358+0000","last_unstale":"2024-09-11T23:18:00.644892+0000","last_undegraded":"2024-09-11T23:18:00.644892+0000","last_fullsized":"2024-09-11T23:18:00.644892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:14.020762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670008+0000","last_change":"2024-09-11T23:17:58.645520+0000","last_active":"2024-09-11T23:18:00.670008+0000","last_peered":"2024-09-11T23:18:00.670008+0000","last_clean":"2024-09-11T23:18:00.670008+0000","last_became_active":"2024-09-11T23:17:58.645211+0000","last_became_peered":"2024-09-11T23:17:58.645211+0000","last_unstale":"2024-09-11T23:18:00.670008+0000","last_undegraded":"2024-09-11T23:18:00.670008+0000","last_fullsized":"2024-09-11T23:18:00.670008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:02.827617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643867+0000","last_change":"2024-09-11T23:17:59.669515+0000","last_active":"2024-09-11T23:18:00.643867+0000","last_peered":"2024-09-11T23:18:00.643867+0000","last_clean":"2024-09-11T23:18:00.643867+0000","last_became_active":"2024-09-11T23:17:59.669182+0000","last_became_peered":"2024-09-11T23:17:59.669182+0000","last_unstale":"2024-09-11T23:18:00.643867+0000","last_undegraded":"2024-09-11T23:18:00.643867+0000","last_fullsized":"2024-09-11T23:18:00.643867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:26.131689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642556+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:18:00.642556+0000","last_peered":"2024-09-11T23:18:00.642556+0000","last_clean":"2024-09-11T23:18:00.642556+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:18:00.642556+0000","last_undegraded":"2024-09-11T23:18:00.642556+0000","last_fullsized":"2024-09-11T23:18:00.642556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644109+0000","last_change":"2024-09-11T23:17:58.634769+0000","last_active":"2024-09-11T23:18:00.644109+0000","last_peered":"2024-09-11T23:18:00.644109+0000","last_clean":"2024-09-11T23:18:00.644109+0000","last_became_active":"2024-09-11T23:17:58.634321+0000","last_became_peered":"2024-09-11T23:17:58.634321+0000","last_unstale":"2024-09-11T23:18:00.644109+0000","last_undegraded":"2024-09-11T23:18:00.644109+0000","last_fullsized":"2024-09-11T23:18:00.644109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:21.084931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669925+0000","last_change":"2024-09-11T23:17:59.659482+0000","last_active":"2024-09-11T23:18:00.669925+0000","last_peered":"2024-09-11T23:18:00.669925+0000","last_clean":"2024-09-11T23:18:00.669925+0000","last_became_active":"2024-09-11T23:17:59.659148+0000","last_became_peered":"2024-09-11T23:17:59.659148+0000","last_unstale":"2024-09-11T23:18:00.669925+0000","last_undegraded":"2024-09-11T23:18:00.669925+0000","last_fullsized":"2024-09-11T23:18:00.669925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:22.419970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642401+0000","last_change":"2024-09-11T23:17:58.636656+0000","last_active":"2024-09-11T23:18:00.642401+0000","last_peered":"2024-09-11T23:18:00.642401+0000","last_clean":"2024-09-11T23:18:00.642401+0000","last_became_active":"2024-09-11T23:17:58.636363+0000","last_became_peered":"2024-09-11T23:17:58.636363+0000","last_unstale":"2024-09-11T23:18:00.642401+0000","last_undegraded":"2024-09-11T23:18:00.642401+0000","last_fullsized":"2024-09-11T23:18:00.642401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:04.565864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669116+0000","last_change":"2024-09-11T23:17:59.640328+0000","last_active":"2024-09-11T23:18:00.669116+0000","last_peered":"2024-09-11T23:18:00.669116+0000","last_clean":"2024-09-11T23:18:00.669116+0000","last_became_active":"2024-09-11T23:17:59.640058+0000","last_became_peered":"2024-09-11T23:17:59.640058+0000","last_unstale":"2024-09-11T23:18:00.669116+0000","last_undegraded":"2024-09-11T23:18:00.669116+0000","last_fullsized":"2024-09-11T23:18:00.669116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:31.650891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669359+0000","last_change":"2024-09-11T23:17:58.642240+0000","last_active":"2024-09-11T23:18:00.669359+0000","last_peered":"2024-09-11T23:18:00.669359+0000","last_clean":"2024-09-11T23:18:00.669359+0000","last_became_active":"2024-09-11T23:17:58.641996+0000","last_became_peered":"2024-09-11T23:17:58.641996+0000","last_unstale":"2024-09-11T23:18:00.669359+0000","last_undegraded":"2024-09-11T23:18:00.669359+0000","last_fullsized":"2024-09-11T23:18:00.669359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:29:09.781577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641685+0000","last_change":"2024-09-11T23:17:59.638548+0000","last_active":"2024-09-11T23:18:00.641685+0000","last_peered":"2024-09-11T23:18:00.641685+0000","last_clean":"2024-09-11T23:18:00.641685+0000","last_became_active":"2024-09-11T23:17:59.638044+0000","last_became_peered":"2024-09-11T23:17:59.638044+0000","last_unstale":"2024-09-11T23:18:00.641685+0000","last_undegraded":"2024-09-11T23:18:00.641685+0000","last_fullsized":"2024-09-11T23:18:00.641685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:05.705455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642958+0000","last_change":"2024-09-11T23:17:58.641231+0000","last_active":"2024-09-11T23:18:00.642958+0000","last_peered":"2024-09-11T23:18:00.642958+0000","last_clean":"2024-09-11T23:18:00.642958+0000","last_became_active":"2024-09-11T23:17:58.640860+0000","last_became_peered":"2024-09-11T23:17:58.640860+0000","last_unstale":"2024-09-11T23:18:00.642958+0000","last_undegraded":"2024-09-11T23:18:00.642958+0000","last_fullsized":"2024-09-11T23:18:00.642958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669466+0000","last_change":"2024-09-11T23:17:59.643898+0000","last_active":"2024-09-11T23:18:00.669466+0000","last_peered":"2024-09-11T23:18:00.669466+0000","last_clean":"2024-09-11T23:18:00.669466+0000","last_became_active":"2024-09-11T23:17:59.643471+0000","last_became_peered":"2024-09-11T23:17:59.643471+0000","last_unstale":"2024-09-11T23:18:00.669466+0000","last_undegraded":"2024-09-11T23:18:00.669466+0000","last_fullsized":"2024-09-11T23:18:00.669466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:32.285047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641618+0000","last_change":"2024-09-11T23:17:58.640659+0000","last_active":"2024-09-11T23:18:00.641618+0000","last_peered":"2024-09-11T23:18:00.641618+0000","last_clean":"2024-09-11T23:18:00.641618+0000","last_became_active":"2024-09-11T23:17:58.640358+0000","last_became_peered":"2024-09-11T23:17:58.640358+0000","last_unstale":"2024-09-11T23:18:00.641618+0000","last_undegraded":"2024-09-11T23:18:00.641618+0000","last_fullsized":"2024-09-11T23:18:00.641618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.645047+0000","last_change":"2024-09-11T23:17:59.659233+0000","last_active":"2024-09-11T23:18:00.645047+0000","last_peered":"2024-09-11T23:18:00.645047+0000","last_clean":"2024-09-11T23:18:00.645047+0000","last_became_active":"2024-09-11T23:17:59.655952+0000","last_became_peered":"2024-09-11T23:17:59.655952+0000","last_unstale":"2024-09-11T23:18:00.645047+0000","last_undegraded":"2024-09-11T23:18:00.645047+0000","last_fullsized":"2024-09-11T23:18:00.645047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:00.628195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644053+0000","last_change":"2024-09-11T23:17:58.642080+0000","last_active":"2024-09-11T23:18:00.644053+0000","last_peered":"2024-09-11T23:18:00.644053+0000","last_clean":"2024-09-11T23:18:00.644053+0000","last_became_active":"2024-09-11T23:17:58.641752+0000","last_became_peered":"2024-09-11T23:17:58.641752+0000","last_unstale":"2024-09-11T23:18:00.644053+0000","last_undegraded":"2024-09-11T23:18:00.644053+0000","last_fullsized":"2024-09-11T23:18:00.644053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:30.642868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641527+0000","last_change":"2024-09-11T23:17:59.634847+0000","last_active":"2024-09-11T23:18:00.641527+0000","last_peered":"2024-09-11T23:18:00.641527+0000","last_clean":"2024-09-11T23:18:00.641527+0000","last_became_active":"2024-09-11T23:17:59.634547+0000","last_became_peered":"2024-09-11T23:17:59.634547+0000","last_unstale":"2024-09-11T23:18:00.641527+0000","last_undegraded":"2024-09-11T23:18:00.641527+0000","last_fullsized":"2024-09-11T23:18:00.641527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:49.193032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642072+0000","last_change":"2024-09-11T23:17:58.633818+0000","last_active":"2024-09-11T23:18:00.642072+0000","last_peered":"2024-09-11T23:18:00.642072+0000","last_clean":"2024-09-11T23:18:00.642072+0000","last_became_active":"2024-09-11T23:17:58.633550+0000","last_became_peered":"2024-09-11T23:17:58.633550+0000","last_unstale":"2024-09-11T23:18:00.642072+0000","last_undegraded":"2024-09-11T23:18:00.642072+0000","last_fullsized":"2024-09-11T23:18:00.642072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:56.695668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671118+0000","last_change":"2024-09-11T23:17:59.650990+0000","last_active":"2024-09-11T23:18:00.671118+0000","last_peered":"2024-09-11T23:18:00.671118+0000","last_clean":"2024-09-11T23:18:00.671118+0000","last_became_active":"2024-09-11T23:17:59.650684+0000","last_became_peered":"2024-09-11T23:17:59.650684+0000","last_unstale":"2024-09-11T23:18:00.671118+0000","last_undegraded":"2024-09-11T23:18:00.671118+0000","last_fullsized":"2024-09-11T23:18:00.671118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:17.470426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661904+0000","last_change":"2024-09-11T23:17:58.639477+0000","last_active":"2024-09-11T23:18:00.661904+0000","last_peered":"2024-09-11T23:18:00.661904+0000","last_clean":"2024-09-11T23:18:00.661904+0000","last_became_active":"2024-09-11T23:17:58.639168+0000","last_became_peered":"2024-09-11T23:17:58.639168+0000","last_unstale":"2024-09-11T23:18:00.661904+0000","last_undegraded":"2024-09-11T23:18:00.661904+0000","last_fullsized":"2024-09-11T23:18:00.661904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:34.511938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669908+0000","last_change":"2024-09-11T23:17:59.650474+0000","last_active":"2024-09-11T23:18:00.669908+0000","last_peered":"2024-09-11T23:18:00.669908+0000","last_clean":"2024-09-11T23:18:00.669908+0000","last_became_active":"2024-09-11T23:17:59.650168+0000","last_became_peered":"2024-09-11T23:17:59.650168+0000","last_unstale":"2024-09-11T23:18:00.669908+0000","last_undegraded":"2024-09-11T23:18:00.669908+0000","last_fullsized":"2024-09-11T23:18:00.669908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.341838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.642401+0000","last_change":"2024-09-11T23:17:58.640620+0000","last_active":"2024-09-11T23:18:00.642401+0000","last_peered":"2024-09-11T23:18:00.642401+0000","last_clean":"2024-09-11T23:18:00.642401+0000","last_became_active":"2024-09-11T23:17:58.640367+0000","last_became_peered":"2024-09-11T23:17:58.640367+0000","last_unstale":"2024-09-11T23:18:00.642401+0000","last_undegraded":"2024-09-11T23:18:00.642401+0000","last_fullsized":"2024-09-11T23:18:00.642401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:29.907527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669188+0000","last_change":"2024-09-11T23:17:59.635712+0000","last_active":"2024-09-11T23:18:00.669188+0000","last_peered":"2024-09-11T23:18:00.669188+0000","last_clean":"2024-09-11T23:18:00.669188+0000","last_became_active":"2024-09-11T23:17:59.635303+0000","last_became_peered":"2024-09-11T23:17:59.635303+0000","last_unstale":"2024-09-11T23:18:00.669188+0000","last_undegraded":"2024-09-11T23:18:00.669188+0000","last_fullsized":"2024-09-11T23:18:00.669188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:03.513693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641602+0000","last_change":"2024-09-11T23:17:58.639596+0000","last_active":"2024-09-11T23:18:00.641602+0000","last_peered":"2024-09-11T23:18:00.641602+0000","last_clean":"2024-09-11T23:18:00.641602+0000","last_became_active":"2024-09-11T23:17:58.639333+0000","last_became_peered":"2024-09-11T23:17:58.639333+0000","last_unstale":"2024-09-11T23:18:00.641602+0000","last_undegraded":"2024-09-11T23:18:00.641602+0000","last_fullsized":"2024-09-11T23:18:00.641602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:02.505670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669868+0000","last_change":"2024-09-11T23:17:59.643630+0000","last_active":"2024-09-11T23:18:00.669868+0000","last_peered":"2024-09-11T23:18:00.669868+0000","last_clean":"2024-09-11T23:18:00.669868+0000","last_became_active":"2024-09-11T23:17:59.643080+0000","last_became_peered":"2024-09-11T23:17:59.643080+0000","last_unstale":"2024-09-11T23:18:00.669868+0000","last_undegraded":"2024-09-11T23:18:00.669868+0000","last_fullsized":"2024-09-11T23:18:00.669868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:59.272347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.641919+0000","last_change":"2024-09-11T23:17:58.634155+0000","last_active":"2024-09-11T23:18:00.641919+0000","last_peered":"2024-09-11T23:18:00.641919+0000","last_clean":"2024-09-11T23:18:00.641919+0000","last_became_active":"2024-09-11T23:17:58.633898+0000","last_became_peered":"2024-09-11T23:17:58.633898+0000","last_unstale":"2024-09-11T23:18:00.641919+0000","last_undegraded":"2024-09-11T23:18:00.641919+0000","last_fullsized":"2024-09-11T23:18:00.641919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:21.084931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670728+0000","last_change":"2024-09-11T23:17:59.648274+0000","last_active":"2024-09-11T23:18:00.670728+0000","last_peered":"2024-09-11T23:18:00.670728+0000","last_clean":"2024-09-11T23:18:00.670728+0000","last_became_active":"2024-09-11T23:17:59.646482+0000","last_became_peered":"2024-09-11T23:17:59.646482+0000","last_unstale":"2024-09-11T23:18:00.670728+0000","last_undegraded":"2024-09-11T23:18:00.670728+0000","last_fullsized":"2024-09-11T23:18:00.670728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:06.041413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643987+0000","last_change":"2024-09-11T23:17:58.644868+0000","last_active":"2024-09-11T23:18:00.643987+0000","last_peered":"2024-09-11T23:18:00.643987+0000","last_clean":"2024-09-11T23:18:00.643987+0000","last_became_active":"2024-09-11T23:17:58.644006+0000","last_became_peered":"2024-09-11T23:17:58.644006+0000","last_unstale":"2024-09-11T23:18:00.643987+0000","last_undegraded":"2024-09-11T23:18:00.643987+0000","last_fullsized":"2024-09-11T23:18:00.643987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:23.261838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.661493+0000","last_change":"2024-09-11T23:17:59.642489+0000","last_active":"2024-09-11T23:18:00.661493+0000","last_peered":"2024-09-11T23:18:00.661493+0000","last_clean":"2024-09-11T23:18:00.661493+0000","last_became_active":"2024-09-11T23:17:59.642155+0000","last_became_peered":"2024-09-11T23:17:59.642155+0000","last_unstale":"2024-09-11T23:18:00.661493+0000","last_undegraded":"2024-09-11T23:18:00.661493+0000","last_fullsized":"2024-09-11T23:18:00.661493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:49.647417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644943+0000","last_change":"2024-09-11T23:17:59.636661+0000","last_active":"2024-09-11T23:18:00.644943+0000","last_peered":"2024-09-11T23:18:00.644943+0000","last_clean":"2024-09-11T23:18:00.644943+0000","last_became_active":"2024-09-11T23:17:59.635613+0000","last_became_peered":"2024-09-11T23:17:59.635613+0000","last_unstale":"2024-09-11T23:18:00.644943+0000","last_undegraded":"2024-09-11T23:18:00.644943+0000","last_fullsized":"2024-09-11T23:18:00.644943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:04.566161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643521+0000","last_change":"2024-09-11T23:17:58.646998+0000","last_active":"2024-09-11T23:18:00.643521+0000","last_peered":"2024-09-11T23:18:00.643521+0000","last_clean":"2024-09-11T23:18:00.643521+0000","last_became_active":"2024-09-11T23:17:58.646666+0000","last_became_peered":"2024-09-11T23:17:58.646666+0000","last_unstale":"2024-09-11T23:18:00.643521+0000","last_undegraded":"2024-09-11T23:18:00.643521+0000","last_fullsized":"2024-09-11T23:18:00.643521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:57.415598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.644743+0000","last_change":"2024-09-11T23:17:59.637292+0000","last_active":"2024-09-11T23:18:00.644743+0000","last_peered":"2024-09-11T23:18:00.644743+0000","last_clean":"2024-09-11T23:18:00.644743+0000","last_became_active":"2024-09-11T23:17:59.637028+0000","last_became_peered":"2024-09-11T23:17:59.637028+0000","last_unstale":"2024-09-11T23:18:00.644743+0000","last_undegraded":"2024-09-11T23:18:00.644743+0000","last_fullsized":"2024-09-11T23:18:00.644743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:42.560113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.643829+0000","last_change":"2024-09-11T23:17:58.641586+0000","last_active":"2024-09-11T23:18:00.643829+0000","last_peered":"2024-09-11T23:18:00.643829+0000","last_clean":"2024-09-11T23:18:00.643829+0000","last_became_active":"2024-09-11T23:17:58.636670+0000","last_became_peered":"2024-09-11T23:17:58.636670+0000","last_unstale":"2024-09-11T23:18:00.643829+0000","last_undegraded":"2024-09-11T23:18:00.643829+0000","last_fullsized":"2024-09-11T23:18:00.643829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:25:49.590126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669867+0000","last_change":"2024-09-11T23:17:59.669621+0000","last_active":"2024-09-11T23:18:00.669867+0000","last_peered":"2024-09-11T23:18:00.669867+0000","last_clean":"2024-09-11T23:18:00.669867+0000","last_became_active":"2024-09-11T23:17:59.669362+0000","last_became_peered":"2024-09-11T23:17:59.669362+0000","last_unstale":"2024-09-11T23:18:00.669867+0000","last_undegraded":"2024-09-11T23:18:00.669867+0000","last_fullsized":"2024-09-11T23:18:00.669867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:05.705455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.671062+0000","last_change":"2024-09-11T23:17:58.646365+0000","last_active":"2024-09-11T23:18:00.671062+0000","last_peered":"2024-09-11T23:18:00.671062+0000","last_clean":"2024-09-11T23:18:00.671062+0000","last_became_active":"2024-09-11T23:17:58.646119+0000","last_became_peered":"2024-09-11T23:17:58.646119+0000","last_unstale":"2024-09-11T23:18:00.671062+0000","last_undegraded":"2024-09-11T23:18:00.671062+0000","last_fullsized":"2024-09-11T23:18:00.671062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:12.634428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.670990+0000","last_change":"2024-09-11T23:17:59.654946+0000","last_active":"2024-09-11T23:18:00.670990+0000","last_peered":"2024-09-11T23:18:00.670990+0000","last_clean":"2024-09-11T23:18:00.670990+0000","last_became_active":"2024-09-11T23:17:59.654732+0000","last_became_peered":"2024-09-11T23:17:59.654732+0000","last_unstale":"2024-09-11T23:18:00.670990+0000","last_undegraded":"2024-09-11T23:18:00.670990+0000","last_fullsized":"2024-09-11T23:18:00.670990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:58.610546+0000","last_clean_scrub_stamp":"2024-09-11T23:17:58.610546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:28.095341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-11T23:18:00.669978+0000","last_change":"2024-09-11T23:17:58.638337+0000","last_active":"2024-09-11T23:18:00.669978+0000","last_peered":"2024-09-11T23:18:00.669978+0000","last_clean":"2024-09-11T23:18:00.669978+0000","last_became_active":"2024-09-11T23:17:58.638071+0000","last_became_peered":"2024-09-11T23:17:58.638071+0000","last_unstale":"2024-09-11T23:18:00.669978+0000","last_undegraded":"2024-09-11T23:18:00.669978+0000","last_fullsized":"2024-09-11T23:18:00.669978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:57.602523+0000","last_clean_scrub_stamp":"2024-09-11T23:17:57.602523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:23.106037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476745,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":666862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476744,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":77524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476743,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":76002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476743,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":76038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":823296,"data_stored":666918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":77524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":75912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:18:13.939 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:18:13.939 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T23:18:13.940 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-11T23:18:13.940 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T23:18:14.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.130+0000 7f5c15600640 1 Processor -- start 2024-09-11T23:18:14.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.130+0000 7f5c15600640 1 -- start start 2024-09-11T23:18:14.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.131+0000 7f5c15600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5c100b32e0 0x7f5c100b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.131+0000 7f5c15600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c100cfb00 con 0x7f5c100b3830 2024-09-11T23:18:14.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.131+0000 7f5c15600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c100d3a30 con 0x7f5c100d1440 2024-09-11T23:18:14.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.131+0000 7f5c15600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5c1006cf60 con 0x7f5c100b32e0 2024-09-11T23:18:14.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.131+0000 7f5c14c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5c100b32e0 0x7f5c100b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.131+0000 7f5c0f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5c100b3830 0x7f5c1006c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46928/0 (socket says 172.21.15.144:46928) 2024-09-11T23:18:14.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.131+0000 7f5c0f400640 1 -- 172.21.15.144:0/3325518752 learned_addr learned my addr 172.21.15.144:0/3325518752 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:14.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.132+0000 7f5c14c00640 1 -- 172.21.15.144:0/3325518752 >> v1:172.21.15.165:6789/0 conn(0x7f5c100d1440 legacy=0x7f5c100d1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.132+0000 7f5c14c00640 1 -- 172.21.15.144:0/3325518752 >> v1:172.21.15.144:6789/0 conn(0x7f5c100b3830 legacy=0x7f5c1006c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.132+0000 7f5c14c00640 1 -- 172.21.15.144:0/3325518752 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c100d3d10 con 0x7f5c100b32e0 2024-09-11T23:18:14.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.132+0000 7f5c0ea00640 1 -- 172.21.15.144:0/3325518752 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3919623100 0 0) 0x7f5bfc001110 con 0x7f5c100b3830 2024-09-11T23:18:14.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.133+0000 7f5c14c00640 1 --2- 172.21.15.144:0/3325518752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c100b32e0 0x7f5c100b74d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5c08009d90 tx=0x7f5c0802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4aa7984b5799a14 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:14.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.133+0000 7f5c0ea00640 1 -- 172.21.15.144:0/3325518752 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08007740 con 0x7f5c100b32e0 2024-09-11T23:18:14.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.133+0000 7f5c0ea00640 1 -- 172.21.15.144:0/3325518752 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c080078e0 con 0x7f5c100b32e0 2024-09-11T23:18:14.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.133+0000 7f5c0ea00640 1 -- 172.21.15.144:0/3325518752 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08007cb0 con 0x7f5c100b32e0 2024-09-11T23:18:14.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.133+0000 7f5c15600640 1 -- 172.21.15.144:0/3325518752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c100b32e0 msgr2=0x7f5c100b74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.133+0000 7f5c15600640 1 --2- 172.21.15.144:0/3325518752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c100b32e0 0x7f5c100b74d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5c08009d90 tx=0x7f5c0802a6f0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.134+0000 7f5c15600640 1 -- 172.21.15.144:0/3325518752 shutdown_connections 2024-09-11T23:18:14.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.134+0000 7f5c15600640 1 --2- 172.21.15.144:0/3325518752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c100b32e0 0x7f5c100b74d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.134+0000 7f5c15600640 1 -- 172.21.15.144:0/3325518752 >> 172.21.15.144:0/3325518752 conn(0x7f5c100b6400 msgr2=0x7f5c100b6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:14.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.134+0000 7f5c15600640 1 -- 172.21.15.144:0/3325518752 shutdown_connections 2024-09-11T23:18:14.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.134+0000 7f5c15600640 1 -- 172.21.15.144:0/3325518752 wait complete. 2024-09-11T23:18:14.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.135+0000 7f5c15600640 1 Processor -- start 2024-09-11T23:18:14.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.135+0000 7f5c15600640 1 -- start start 2024-09-11T23:18:14.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.136+0000 7f5c15600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c100b32e0 0x7f5c1015afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.136+0000 7f5c15600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c100b3830 0x7f5c100cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.136+0000 7f5c15600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5c100d1440 0x7f5c100ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.136+0000 7f5c15600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1006c350 con 0x7f5c100b32e0 2024-09-11T23:18:14.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.136+0000 7f5c15600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1006c070 con 0x7f5c100b3830 2024-09-11T23:18:14.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.136+0000 7f5c15600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1015eb40 con 0x7f5c100d1440 2024-09-11T23:18:14.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.136+0000 7f5c0fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c100b32e0 0x7f5c1015afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.136+0000 7f5c0fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c100b32e0 0x7f5c1015afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49620/0 (socket says 172.21.15.144:49620) 2024-09-11T23:18:14.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.136+0000 7f5c0fe00640 1 -- 172.21.15.144:0/717980553 learned_addr learned my addr 172.21.15.144:0/717980553 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:14.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.136+0000 7f5c14c00640 1 --2- 172.21.15.144:0/717980553 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5c100d1440 0x7f5c100ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.137+0000 7f5c0f400640 1 --2- 172.21.15.144:0/717980553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c100b3830 0x7f5c100cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.137+0000 7f5c0fe00640 1 -- 172.21.15.144:0/717980553 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5c100d1440 msgr2=0x7f5c100ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.137+0000 7f5c0fe00640 1 --2- 172.21.15.144:0/717980553 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5c100d1440 0x7f5c100ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.137+0000 7f5c0fe00640 1 -- 172.21.15.144:0/717980553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c100b3830 msgr2=0x7f5c100cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.137+0000 7f5c0fe00640 1 --2- 172.21.15.144:0/717980553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c100b3830 0x7f5c100cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.137+0000 7f5c0fe00640 1 -- 172.21.15.144:0/717980553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c100ac560 con 0x7f5c100b32e0 2024-09-11T23:18:14.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.137+0000 7f5c0fe00640 1 --2- 172.21.15.144:0/717980553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c100b32e0 0x7f5c1015afb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000c430 tx=0x7f5c0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:14.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.137+0000 7f5c07e00640 1 -- 172.21.15.144:0/717980553 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c00017070 con 0x7f5c100b32e0 2024-09-11T23:18:14.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.137+0000 7f5c07e00640 1 -- 172.21.15.144:0/717980553 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c000052d0 con 0x7f5c100b32e0 2024-09-11T23:18:14.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.137+0000 7f5c07e00640 1 -- 172.21.15.144:0/717980553 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c00003830 con 0x7f5c100b32e0 2024-09-11T23:18:14.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.137+0000 7f5c15600640 1 -- 172.21.15.144:0/717980553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c100ac840 con 0x7f5c100b32e0 2024-09-11T23:18:14.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.137+0000 7f5c15600640 1 -- 172.21.15.144:0/717980553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c100c9cf0 con 0x7f5c100b32e0 2024-09-11T23:18:14.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.138+0000 7f5c15600640 1 -- 172.21.15.144:0/717980553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c1006c850 con 0x7f5c100b32e0 2024-09-11T23:18:14.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.139+0000 7f5c07e00640 1 -- 172.21.15.144:0/717980553 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c0001a070 con 0x7f5c100b32e0 2024-09-11T23:18:14.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.140+0000 7f5c07e00640 1 --2- 172.21.15.144:0/717980553 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5bf006be30 0x7f5bf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.140+0000 7f5c07e00640 1 -- 172.21.15.144:0/717980553 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5c0008a1c0 con 0x7f5c100b32e0 2024-09-11T23:18:14.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.141+0000 7f5c0f400640 1 --2- 172.21.15.144:0/717980553 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5bf006be30 0x7f5bf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.141+0000 7f5c0f400640 1 --2- 172.21.15.144:0/717980553 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5bf006be30 0x7f5bf006e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5c100d3a00 tx=0x7f5bfc007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:14.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.144+0000 7f5c07e00640 1 -- 172.21.15.144:0/717980553 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5c00058480 con 0x7f5c100b32e0 2024-09-11T23:18:14.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.356+0000 7f5c15600640 1 -- 172.21.15.144:0/717980553 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5c1015d5e0 con 0x7f5c100b32e0 2024-09-11T23:18:14.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.356+0000 7f5c07e00640 1 -- 172.21.15.144:0/717980553 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f5c0005c780 con 0x7f5c100b32e0 2024-09-11T23:18:14.357 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:14.357 INFO:teuthology.orchestra.run.smithi144.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T23:18:14.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.358+0000 7f5c15600640 1 -- 172.21.15.144:0/717980553 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5bf006be30 msgr2=0x7f5bf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.358+0000 7f5c15600640 1 --2- 172.21.15.144:0/717980553 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5bf006be30 0x7f5bf006e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5c100d3a00 tx=0x7f5bfc007b50 comp rx=0 tx=0).stop 2024-09-11T23:18:14.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.358+0000 7f5c15600640 1 -- 172.21.15.144:0/717980553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c100b32e0 msgr2=0x7f5c1015afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.358+0000 7f5c15600640 1 --2- 172.21.15.144:0/717980553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c100b32e0 0x7f5c1015afb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000c430 tx=0x7f5c0000c8f0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.358+0000 7f5c15600640 1 -- 172.21.15.144:0/717980553 shutdown_connections 2024-09-11T23:18:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.358+0000 7f5c15600640 1 --2- 172.21.15.144:0/717980553 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5bf006be30 0x7f5bf006e2f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.358+0000 7f5c15600640 1 --2- 172.21.15.144:0/717980553 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5c100d1440 0x7f5c100ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.358+0000 7f5c15600640 1 --2- 172.21.15.144:0/717980553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c100b3830 0x7f5c100cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.358+0000 7f5c15600640 1 --2- 172.21.15.144:0/717980553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c100b32e0 0x7f5c1015afb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.358+0000 7f5c15600640 1 -- 172.21.15.144:0/717980553 >> 172.21.15.144:0/717980553 conn(0x7f5c100b6400 msgr2=0x7f5c100b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.358+0000 7f5c15600640 1 -- 172.21.15.144:0/717980553 shutdown_connections 2024-09-11T23:18:14.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.358+0000 7f5c15600640 1 -- 172.21.15.144:0/717980553 wait complete. 2024-09-11T23:18:14.375 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-11T23:18:14.375 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:14.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.528+0000 7fdbef200640 1 Processor -- start 2024-09-11T23:18:14.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.528+0000 7fdbef200640 1 -- start start 2024-09-11T23:18:14.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.529+0000 7fdbef200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fdbe815ca40 0x7fdbe815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.529+0000 7fdbef200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdbe815ceb0 0x7fdbe81594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.529+0000 7fdbef200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbe815d390 con 0x7fdbe80d02a0 2024-09-11T23:18:14.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.529+0000 7fdbef200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fdbe815d670 con 0x7fdbe815ca40 2024-09-11T23:18:14.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.529+0000 7fdbef200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe815d950 con 0x7fdbe815ceb0 2024-09-11T23:18:14.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.530+0000 7fdbed200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdbe815ceb0 0x7fdbe81594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.530+0000 7fdbe7e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fdbe80d02a0 0x7fdbe80d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:57114/0 (socket says 172.21.15.144:57114) 2024-09-11T23:18:14.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.530+0000 7fdbe7e00640 1 -- 172.21.15.144:0/3344883720 learned_addr learned my addr 172.21.15.144:0/3344883720 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:14.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.530+0000 7fdbe7400640 1 --2- 172.21.15.144:0/3344883720 >> v2:172.21.15.165:3300/0 conn(0x7fdbe815ca40 0x7fdbe815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.531+0000 7fdbed200640 1 -- 172.21.15.144:0/3344883720 >> v2:172.21.15.165:3300/0 conn(0x7fdbe815ca40 msgr2=0x7fdbe815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:14.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.531+0000 7fdbed200640 1 --2- 172.21.15.144:0/3344883720 >> v2:172.21.15.165:3300/0 conn(0x7fdbe815ca40 0x7fdbe815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.531+0000 7fdbed200640 1 -- 172.21.15.144:0/3344883720 >> v1:172.21.15.165:6789/0 conn(0x7fdbe80d02a0 legacy=0x7fdbe80d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.531+0000 7fdbe6a00640 1 -- 172.21.15.144:0/3344883720 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 990730369 0 0) 0x7fdbe815d390 con 0x7fdbe80d02a0 2024-09-11T23:18:14.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.531+0000 7fdbed200640 1 -- 172.21.15.144:0/3344883720 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe815dc30 con 0x7fdbe815ceb0 2024-09-11T23:18:14.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.532+0000 7fdbed200640 1 --2- 172.21.15.144:0/3344883720 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdbe815ceb0 0x7fdbe81594c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000ba40 tx=0x7fdbe002c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab6a54cf76256f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:14.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.532+0000 7fdbe6a00640 1 -- 172.21.15.144:0/3344883720 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0031710 con 0x7fdbe815ceb0 2024-09-11T23:18:14.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.532+0000 7fdbe6a00640 1 -- 172.21.15.144:0/3344883720 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe00318b0 con 0x7fdbe815ceb0 2024-09-11T23:18:14.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.532+0000 7fdbe6a00640 1 -- 172.21.15.144:0/3344883720 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0031c80 con 0x7fdbe815ceb0 2024-09-11T23:18:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.533+0000 7fdbef200640 1 -- 172.21.15.144:0/3344883720 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdbe815ceb0 msgr2=0x7fdbe81594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.533+0000 7fdbef200640 1 --2- 172.21.15.144:0/3344883720 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdbe815ceb0 0x7fdbe81594c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000ba40 tx=0x7fdbe002c7b0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.533+0000 7fdbef200640 1 -- 172.21.15.144:0/3344883720 shutdown_connections 2024-09-11T23:18:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.533+0000 7fdbef200640 1 --2- 172.21.15.144:0/3344883720 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdbe815ceb0 0x7fdbe81594c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.533+0000 7fdbef200640 1 --2- 172.21.15.144:0/3344883720 >> v2:172.21.15.165:3300/0 conn(0x7fdbe815ca40 0x7fdbe815e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.533+0000 7fdbef200640 1 -- 172.21.15.144:0/3344883720 >> 172.21.15.144:0/3344883720 conn(0x7fdbe8062cc0 msgr2=0x7fdbe806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.533+0000 7fdbef200640 1 -- 172.21.15.144:0/3344883720 shutdown_connections 2024-09-11T23:18:14.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.533+0000 7fdbef200640 1 -- 172.21.15.144:0/3344883720 wait complete. 2024-09-11T23:18:14.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.534+0000 7fdbef200640 1 Processor -- start 2024-09-11T23:18:14.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.534+0000 7fdbef200640 1 -- start start 2024-09-11T23:18:14.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.535+0000 7fdbef200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbe80d02a0 0x7fdbe81f5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.535+0000 7fdbef200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdbe815ca40 0x7fdbe81f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.535+0000 7fdbef200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbe815ceb0 0x7fdbe81f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.535+0000 7fdbef200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe8155d10 con 0x7fdbe815ceb0 2024-09-11T23:18:14.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.535+0000 7fdbef200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe8155b90 con 0x7fdbe80d02a0 2024-09-11T23:18:14.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.535+0000 7fdbef200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe80b4790 con 0x7fdbe815ca40 2024-09-11T23:18:14.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.536+0000 7fdbe7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbe80d02a0 0x7fdbe81f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.536+0000 7fdbe7400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdbe815ca40 0x7fdbe81f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.536+0000 7fdbed200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbe815ceb0 0x7fdbe81f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.536+0000 7fdbe7400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdbe815ca40 0x7fdbe81f4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:40010/0 (socket says 172.21.15.144:40010) 2024-09-11T23:18:14.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.536+0000 7fdbe7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbe80d02a0 0x7fdbe81f5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:41482/0 (socket says 172.21.15.144:41482) 2024-09-11T23:18:14.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.536+0000 7fdbe7400640 1 -- 172.21.15.144:0/1506039325 learned_addr learned my addr 172.21.15.144:0/1506039325 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:14.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.536+0000 7fdbe7400640 1 -- 172.21.15.144:0/1506039325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbe80d02a0 msgr2=0x7fdbe81f5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.536+0000 7fdbe7400640 1 --2- 172.21.15.144:0/1506039325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbe80d02a0 0x7fdbe81f5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.536+0000 7fdbe7400640 1 -- 172.21.15.144:0/1506039325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbe815ceb0 msgr2=0x7fdbe81f3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.536+0000 7fdbe7400640 1 --2- 172.21.15.144:0/1506039325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbe815ceb0 0x7fdbe81f3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.536+0000 7fdbe7400640 1 -- 172.21.15.144:0/1506039325 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe81f3e50 con 0x7fdbe815ca40 2024-09-11T23:18:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.536+0000 7fdbed200640 1 --2- 172.21.15.144:0/1506039325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbe815ceb0 0x7fdbe81f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.536+0000 7fdbe7400640 1 --2- 172.21.15.144:0/1506039325 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdbe815ca40 0x7fdbe81f4a30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400e9b0 tx=0x7fdbd400ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.537+0000 7fdbdfe00640 1 -- 172.21.15.144:0/1506039325 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4017070 con 0x7fdbe815ca40 2024-09-11T23:18:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.537+0000 7fdbdfe00640 1 -- 172.21.15.144:0/1506039325 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd400c9a0 con 0x7fdbe815ca40 2024-09-11T23:18:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.537+0000 7fdbef200640 1 -- 172.21.15.144:0/1506039325 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe8072890 con 0x7fdbe815ca40 2024-09-11T23:18:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.537+0000 7fdbdfe00640 1 -- 172.21.15.144:0/1506039325 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd400cd90 con 0x7fdbe815ca40 2024-09-11T23:18:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.537+0000 7fdbef200640 1 -- 172.21.15.144:0/1506039325 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe8072e50 con 0x7fdbe815ca40 2024-09-11T23:18:14.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.538+0000 7fdbef200640 1 -- 172.21.15.144:0/1506039325 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe80d0680 con 0x7fdbe815ca40 2024-09-11T23:18:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.539+0000 7fdbdfe00640 1 -- 172.21.15.144:0/1506039325 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdbd401a070 con 0x7fdbe815ca40 2024-09-11T23:18:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.540+0000 7fdbdfe00640 1 --2- 172.21.15.144:0/1506039325 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdbc806be60 0x7fdbc806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.540+0000 7fdbdfe00640 1 -- 172.21.15.144:0/1506039325 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdbd408ae40 con 0x7fdbe815ca40 2024-09-11T23:18:14.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.540+0000 7fdbe7e00640 1 --2- 172.21.15.144:0/1506039325 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdbc806be60 0x7fdbc806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.540+0000 7fdbe7e00640 1 --2- 172.21.15.144:0/1506039325 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdbc806be60 0x7fdbc806e320 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80012e0 tx=0x7fdbd8001630 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:14.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.545+0000 7fdbdfe00640 1 -- 172.21.15.144:0/1506039325 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdbd4059100 con 0x7fdbe815ca40 2024-09-11T23:18:14.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.759+0000 7fdbef200640 1 -- 172.21.15.144:0/1506039325 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdbe806c880 con 0x7fdbe815ca40 2024-09-11T23:18:14.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.760+0000 7fdbdfe00640 1 -- 172.21.15.144:0/1506039325 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7fdbd405d400 con 0x7fdbe815ca40 2024-09-11T23:18:14.760 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:14.760 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"btime":"2024-09-11T23:18:02:645252+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1741936320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1741936320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1741936320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1295491349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1295491349},{"type":"v1","addr":"172.21.15.144:6836","nonce":1295491349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1020006630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1020006630},{"type":"v1","addr":"172.21.15.144:6837","nonce":1020006630}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:59.036096+0000","modified":"2024-09-11T23:18:02.054236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2270648598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2270648598},{"type":"v1","addr":"172.21.15.165:6835","nonce":2270648598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-09-11T23:18:14.761 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-09-11T23:18:14.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.762+0000 7fdbef200640 1 -- 172.21.15.144:0/1506039325 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdbc806be60 msgr2=0x7fdbc806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.762+0000 7fdbef200640 1 --2- 172.21.15.144:0/1506039325 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdbc806be60 0x7fdbc806e320 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80012e0 tx=0x7fdbd8001630 comp rx=0 tx=0).stop 2024-09-11T23:18:14.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.762+0000 7fdbef200640 1 -- 172.21.15.144:0/1506039325 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdbe815ca40 msgr2=0x7fdbe81f4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.762+0000 7fdbef200640 1 --2- 172.21.15.144:0/1506039325 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdbe815ca40 0x7fdbe81f4a30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400e9b0 tx=0x7fdbd400ee70 comp rx=0 tx=0).stop 2024-09-11T23:18:14.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.762+0000 7fdbef200640 1 -- 172.21.15.144:0/1506039325 shutdown_connections 2024-09-11T23:18:14.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.762+0000 7fdbef200640 1 --2- 172.21.15.144:0/1506039325 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdbc806be60 0x7fdbc806e320 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.762+0000 7fdbef200640 1 --2- 172.21.15.144:0/1506039325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbe815ceb0 0x7fdbe81f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.762+0000 7fdbef200640 1 --2- 172.21.15.144:0/1506039325 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdbe815ca40 0x7fdbe81f4a30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.762+0000 7fdbef200640 1 --2- 172.21.15.144:0/1506039325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbe80d02a0 0x7fdbe81f5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.762+0000 7fdbef200640 1 -- 172.21.15.144:0/1506039325 >> 172.21.15.144:0/1506039325 conn(0x7fdbe8062cc0 msgr2=0x7fdbe80b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:14.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.763+0000 7fdbef200640 1 -- 172.21.15.144:0/1506039325 shutdown_connections 2024-09-11T23:18:14.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.763+0000 7fdbef200640 1 -- 172.21.15.144:0/1506039325 wait complete. 2024-09-11T23:18:14.778 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:14.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.932+0000 7fe1d3200640 1 Processor -- start 2024-09-11T23:18:14.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.932+0000 7fe1d3200640 1 -- start start 2024-09-11T23:18:14.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.933+0000 7fe1d3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1d40b6410 0x7fe1d40b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.933+0000 7fe1d3200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d406bee0 con 0x7fe1d415e640 2024-09-11T23:18:14.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.933+0000 7fe1d3200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d406c1c0 con 0x7fe1d40b5fd0 2024-09-11T23:18:14.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.933+0000 7fe1d3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d415ea20 con 0x7fe1d40b6410 2024-09-11T23:18:14.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.933+0000 7fe1d1e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe1d415e640 0x7fe1d40d3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35432/0 (socket says 172.21.15.144:35432) 2024-09-11T23:18:14.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.933+0000 7fe1d1e00640 1 -- 172.21.15.144:0/1103421424 learned_addr learned my addr 172.21.15.144:0/1103421424 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:14.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.934+0000 7fe1d2800640 1 --2- 172.21.15.144:0/1103421424 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1d40b6410 0x7fe1d40b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.934+0000 7fe1d0a00640 1 -- 172.21.15.144:0/1103421424 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3076031184 0 0) 0x7fe1d406bee0 con 0x7fe1d415e640 2024-09-11T23:18:14.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.934+0000 7fe1d0a00640 1 -- 172.21.15.144:0/1103421424 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1b8003520 con 0x7fe1d415e640 2024-09-11T23:18:14.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.934+0000 7fe1d0a00640 1 -- 172.21.15.144:0/1103421424 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2933547004 0 0) 0x7fe1d406c1c0 con 0x7fe1d40b5fd0 2024-09-11T23:18:14.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.934+0000 7fe1d0a00640 1 -- 172.21.15.144:0/1103421424 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1d406bee0 con 0x7fe1d40b5fd0 2024-09-11T23:18:14.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.934+0000 7fe1d0a00640 1 -- 172.21.15.144:0/1103421424 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1812073676 0 0) 0x7fe1b8003520 con 0x7fe1d415e640 2024-09-11T23:18:14.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.934+0000 7fe1d2800640 1 -- 172.21.15.144:0/1103421424 >> v1:172.21.15.165:6789/0 conn(0x7fe1d40b5fd0 legacy=0x7fe1d40b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.934+0000 7fe1d2800640 1 -- 172.21.15.144:0/1103421424 >> v1:172.21.15.144:6789/0 conn(0x7fe1d415e640 legacy=0x7fe1d40d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.934+0000 7fe1d2800640 1 -- 172.21.15.144:0/1103421424 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d406c4a0 con 0x7fe1d40b6410 2024-09-11T23:18:14.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.935+0000 7fe1d2800640 1 --2- 172.21.15.144:0/1103421424 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1d40b6410 0x7fe1d40b7e60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009dc0 tx=0x7fe1cc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f0505e8097b16c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:14.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.935+0000 7fe1d0a00640 1 -- 172.21.15.144:0/1103421424 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4001670 con 0x7fe1d40b6410 2024-09-11T23:18:14.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.935+0000 7fe1d0a00640 1 -- 172.21.15.144:0/1103421424 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1cc007540 con 0x7fe1d40b6410 2024-09-11T23:18:14.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.935+0000 7fe1d0a00640 1 -- 172.21.15.144:0/1103421424 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc007910 con 0x7fe1d40b6410 2024-09-11T23:18:14.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.936+0000 7fe1d3200640 1 -- 172.21.15.144:0/1103421424 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1d40b6410 msgr2=0x7fe1d40b7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.936+0000 7fe1d3200640 1 --2- 172.21.15.144:0/1103421424 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1d40b6410 0x7fe1d40b7e60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009dc0 tx=0x7fe1cc02a660 comp rx=0 tx=0).stop 2024-09-11T23:18:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.936+0000 7fe1d3200640 1 -- 172.21.15.144:0/1103421424 shutdown_connections 2024-09-11T23:18:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.936+0000 7fe1d3200640 1 --2- 172.21.15.144:0/1103421424 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1d40b6410 0x7fe1d40b7e60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.936+0000 7fe1d3200640 1 -- 172.21.15.144:0/1103421424 >> 172.21.15.144:0/1103421424 conn(0x7fe1d40d0fd0 msgr2=0x7fe1d40d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.936+0000 7fe1d3200640 1 -- 172.21.15.144:0/1103421424 shutdown_connections 2024-09-11T23:18:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.936+0000 7fe1d3200640 1 -- 172.21.15.144:0/1103421424 wait complete. 2024-09-11T23:18:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.938+0000 7fe1d3200640 1 Processor -- start 2024-09-11T23:18:14.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.938+0000 7fe1d3200640 1 -- start start 2024-09-11T23:18:14.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.939+0000 7fe1d3200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1d40b5fd0 0x7fe1d415b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.939+0000 7fe1d3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1d40b6410 0x7fe1d40cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.939+0000 7fe1d3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1d415e640 0x7fe1d40d27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.939+0000 7fe1d3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d40b68a0 con 0x7fe1d40b6410 2024-09-11T23:18:14.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.939+0000 7fe1d3200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d406caf0 con 0x7fe1d40b5fd0 2024-09-11T23:18:14.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.939+0000 7fe1d3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d40d4130 con 0x7fe1d415e640 2024-09-11T23:18:14.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.939+0000 7fe1d1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1d40b6410 0x7fe1d40cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.939+0000 7fe1d1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1d40b6410 0x7fe1d40cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46098/0 (socket says 172.21.15.144:46098) 2024-09-11T23:18:14.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.939+0000 7fe1d1400640 1 -- 172.21.15.144:0/659579229 learned_addr learned my addr 172.21.15.144:0/659579229 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:14.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.939+0000 7fe1d1e00640 1 --2- 172.21.15.144:0/659579229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1d40b5fd0 0x7fe1d415b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.939+0000 7fe1d2800640 1 --2- 172.21.15.144:0/659579229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1d415e640 0x7fe1d40d27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.939+0000 7fe1d1400640 1 -- 172.21.15.144:0/659579229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1d415e640 msgr2=0x7fe1d40d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.939+0000 7fe1d1400640 1 --2- 172.21.15.144:0/659579229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1d415e640 0x7fe1d40d27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.939+0000 7fe1d1400640 1 -- 172.21.15.144:0/659579229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1d40b5fd0 msgr2=0x7fe1d415b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:14.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.939+0000 7fe1d1400640 1 --2- 172.21.15.144:0/659579229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1d40b5fd0 0x7fe1d415b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:14.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.939+0000 7fe1d1400640 1 -- 172.21.15.144:0/659579229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d40abf60 con 0x7fe1d40b6410 2024-09-11T23:18:14.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.940+0000 7fe1d1400640 1 --2- 172.21.15.144:0/659579229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1d40b6410 0x7fe1d40cd7b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000c490 tx=0x7fe1c000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:14.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.940+0000 7fe1ca000640 1 -- 172.21.15.144:0/659579229 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c00052d0 con 0x7fe1d40b6410 2024-09-11T23:18:14.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.940+0000 7fe1ca000640 1 -- 172.21.15.144:0/659579229 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c0005470 con 0x7fe1d40b6410 2024-09-11T23:18:14.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.940+0000 7fe1ca000640 1 -- 172.21.15.144:0/659579229 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0012850 con 0x7fe1d40b6410 2024-09-11T23:18:14.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.940+0000 7fe1d3200640 1 -- 172.21.15.144:0/659579229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d40ac240 con 0x7fe1d40b6410 2024-09-11T23:18:14.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.940+0000 7fe1d3200640 1 -- 172.21.15.144:0/659579229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d40ac800 con 0x7fe1d40b6410 2024-09-11T23:18:14.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.941+0000 7fe1d3200640 1 -- 172.21.15.144:0/659579229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d40d3a20 con 0x7fe1d40b6410 2024-09-11T23:18:14.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.942+0000 7fe1ca000640 1 -- 172.21.15.144:0/659579229 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe1c00129f0 con 0x7fe1d40b6410 2024-09-11T23:18:14.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.943+0000 7fe1ca000640 1 --2- 172.21.15.144:0/659579229 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe1b406be30 0x7fe1b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:14.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.943+0000 7fe1ca000640 1 -- 172.21.15.144:0/659579229 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe1c008aaf0 con 0x7fe1d40b6410 2024-09-11T23:18:14.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.943+0000 7fe1d1e00640 1 --2- 172.21.15.144:0/659579229 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe1b406be30 0x7fe1b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:14.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.944+0000 7fe1d1e00640 1 --2- 172.21.15.144:0/659579229 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe1b406be30 0x7fe1b406e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40011e0 tx=0x7fe1c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:14.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:14.947+0000 7fe1ca000640 1 -- 172.21.15.144:0/659579229 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe1c0059490 con 0x7fe1d40b6410 2024-09-11T23:18:15.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.156+0000 7fe1d3200640 1 -- 172.21.15.144:0/659579229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1d40d3500 con 0x7fe1d40b6410 2024-09-11T23:18:15.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.157+0000 7fe1ca000640 1 -- 172.21.15.144:0/659579229 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7fe1c0058d90 con 0x7fe1d40b6410 2024-09-11T23:18:15.157 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:15.157 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"btime":"2024-09-11T23:18:02:645252+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1741936320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1741936320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1741936320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1295491349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1295491349},{"type":"v1","addr":"172.21.15.144:6836","nonce":1295491349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1020006630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1020006630},{"type":"v1","addr":"172.21.15.144:6837","nonce":1020006630}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:59.036096+0000","modified":"2024-09-11T23:18:02.054236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2270648598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2270648598},{"type":"v1","addr":"172.21.15.165:6835","nonce":2270648598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-09-11T23:18:15.157 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-09-11T23:18:15.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.159+0000 7fe1d3200640 1 -- 172.21.15.144:0/659579229 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe1b406be30 msgr2=0x7fe1b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.159+0000 7fe1d3200640 1 --2- 172.21.15.144:0/659579229 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe1b406be30 0x7fe1b406e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40011e0 tx=0x7fe1c4009040 comp rx=0 tx=0).stop 2024-09-11T23:18:15.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.159+0000 7fe1d3200640 1 -- 172.21.15.144:0/659579229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1d40b6410 msgr2=0x7fe1d40cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.159+0000 7fe1d3200640 1 --2- 172.21.15.144:0/659579229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1d40b6410 0x7fe1d40cd7b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000c490 tx=0x7fe1c000c950 comp rx=0 tx=0).stop 2024-09-11T23:18:15.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.159+0000 7fe1d3200640 1 -- 172.21.15.144:0/659579229 shutdown_connections 2024-09-11T23:18:15.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.159+0000 7fe1d3200640 1 --2- 172.21.15.144:0/659579229 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe1b406be30 0x7fe1b406e2f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.159+0000 7fe1d3200640 1 --2- 172.21.15.144:0/659579229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1d415e640 0x7fe1d40d27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.159+0000 7fe1d3200640 1 --2- 172.21.15.144:0/659579229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1d40b6410 0x7fe1d40cd7b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.159+0000 7fe1d3200640 1 --2- 172.21.15.144:0/659579229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1d40b5fd0 0x7fe1d415b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.159+0000 7fe1d3200640 1 -- 172.21.15.144:0/659579229 >> 172.21.15.144:0/659579229 conn(0x7fe1d40d0fd0 msgr2=0x7fe1d40b77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:15.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.159+0000 7fe1d3200640 1 -- 172.21.15.144:0/659579229 shutdown_connections 2024-09-11T23:18:15.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.159+0000 7fe1d3200640 1 -- 172.21.15.144:0/659579229 wait complete. 2024-09-11T23:18:15.175 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:18:15.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.330+0000 7f952be00640 1 Processor -- start 2024-09-11T23:18:15.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.330+0000 7f952be00640 1 -- start start 2024-09-11T23:18:15.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.331+0000 7f952be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f952c15e640 0x7f952c0d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.331+0000 7f952be00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f952c06bee0 con 0x7f952c0b66e0 2024-09-11T23:18:15.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.331+0000 7f952be00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f952c06c1c0 con 0x7f952c0d3f60 2024-09-11T23:18:15.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.331+0000 7f952be00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f952c15ea20 con 0x7f952c15e640 2024-09-11T23:18:15.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.331+0000 7f952aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f952c15e640 0x7f952c0d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.331+0000 7f952b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f952c0b66e0 0x7f952c0b7750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35448/0 (socket says 172.21.15.144:35448) 2024-09-11T23:18:15.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.331+0000 7f952b400640 1 -- 172.21.15.144:0/1628793194 learned_addr learned my addr 172.21.15.144:0/1628793194 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:15.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.332+0000 7f952aa00640 1 -- 172.21.15.144:0/1628793194 >> v1:172.21.15.165:6789/0 conn(0x7f952c0d3f60 legacy=0x7f952c0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.332+0000 7f952aa00640 1 -- 172.21.15.144:0/1628793194 >> v1:172.21.15.144:6789/0 conn(0x7f952c0b66e0 legacy=0x7f952c0b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.332+0000 7f952aa00640 1 -- 172.21.15.144:0/1628793194 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952c06c4a0 con 0x7f952c15e640 2024-09-11T23:18:15.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.332+0000 7f9529600640 1 -- 172.21.15.144:0/1628793194 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4089085498 0 0) 0x7f952c06bee0 con 0x7f952c0b66e0 2024-09-11T23:18:15.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.333+0000 7f952aa00640 1 --2- 172.21.15.144:0/1628793194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c15e640 0x7f952c0d3a20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f951c0097a0 tx=0x7f951c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc975c17380de4c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:15.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.333+0000 7f9529600640 1 -- 172.21.15.144:0/1628793194 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c037070 con 0x7f952c15e640 2024-09-11T23:18:15.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.333+0000 7f9529600640 1 -- 172.21.15.144:0/1628793194 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f951c032440 con 0x7f952c15e640 2024-09-11T23:18:15.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.333+0000 7f9529600640 1 -- 172.21.15.144:0/1628793194 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c032810 con 0x7f952c15e640 2024-09-11T23:18:15.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.334+0000 7f952be00640 1 -- 172.21.15.144:0/1628793194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c15e640 msgr2=0x7f952c0d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.334+0000 7f952be00640 1 --2- 172.21.15.144:0/1628793194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c15e640 0x7f952c0d3a20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f951c0097a0 tx=0x7f951c02a230 comp rx=0 tx=0).stop 2024-09-11T23:18:15.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.334+0000 7f952be00640 1 -- 172.21.15.144:0/1628793194 shutdown_connections 2024-09-11T23:18:15.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.334+0000 7f952be00640 1 --2- 172.21.15.144:0/1628793194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c15e640 0x7f952c0d3a20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.334+0000 7f952be00640 1 -- 172.21.15.144:0/1628793194 >> 172.21.15.144:0/1628793194 conn(0x7f952c0d0fd0 msgr2=0x7f952c0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:15.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.334+0000 7f952be00640 1 -- 172.21.15.144:0/1628793194 shutdown_connections 2024-09-11T23:18:15.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.334+0000 7f952be00640 1 -- 172.21.15.144:0/1628793194 wait complete. 2024-09-11T23:18:15.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.335+0000 7f952be00640 1 Processor -- start 2024-09-11T23:18:15.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.335+0000 7f952be00640 1 -- start start 2024-09-11T23:18:15.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.336+0000 7f952be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f952c0b66e0 0x7f952c1f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.336+0000 7f952be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c0d3f60 0x7f952c0aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.336+0000 7f952be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f952c15e640 0x7f952c0ab4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.336+0000 7f952be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f952c0b7e60 con 0x7f952c0d3f60 2024-09-11T23:18:15.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.336+0000 7f952be00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f952c06caf0 con 0x7f952c0b66e0 2024-09-11T23:18:15.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.336+0000 7f952be00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f952c0b7fe0 con 0x7f952c15e640 2024-09-11T23:18:15.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.337+0000 7f952a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c0d3f60 0x7f952c0aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.337+0000 7f952aa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f952c0b66e0 0x7f952c1f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.337+0000 7f952a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c0d3f60 0x7f952c0aafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46114/0 (socket says 172.21.15.144:46114) 2024-09-11T23:18:15.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.337+0000 7f952a000640 1 -- 172.21.15.144:0/2527036303 learned_addr learned my addr 172.21.15.144:0/2527036303 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:15.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.337+0000 7f952b400640 1 --2- 172.21.15.144:0/2527036303 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f952c15e640 0x7f952c0ab4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.337+0000 7f952a000640 1 -- 172.21.15.144:0/2527036303 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f952c15e640 msgr2=0x7f952c0ab4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.337+0000 7f952a000640 1 --2- 172.21.15.144:0/2527036303 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f952c15e640 0x7f952c0ab4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.337+0000 7f952a000640 1 -- 172.21.15.144:0/2527036303 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f952c0b66e0 msgr2=0x7f952c1f3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.337+0000 7f952a000640 1 --2- 172.21.15.144:0/2527036303 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f952c0b66e0 0x7f952c1f3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.337+0000 7f952a000640 1 -- 172.21.15.144:0/2527036303 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952c1f4f50 con 0x7f952c0d3f60 2024-09-11T23:18:15.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.337+0000 7f952a000640 1 --2- 172.21.15.144:0/2527036303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c0d3f60 0x7f952c0aafb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f951800c450 tx=0x7f951800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:15.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.337+0000 7f9523400640 1 -- 172.21.15.144:0/2527036303 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95180052d0 con 0x7f952c0d3f60 2024-09-11T23:18:15.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.338+0000 7f9523400640 1 -- 172.21.15.144:0/2527036303 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9518005470 con 0x7f952c0d3f60 2024-09-11T23:18:15.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.338+0000 7f952be00640 1 -- 172.21.15.144:0/2527036303 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952c1f5230 con 0x7f952c0d3f60 2024-09-11T23:18:15.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.338+0000 7f9523400640 1 -- 172.21.15.144:0/2527036303 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518012870 con 0x7f952c0d3f60 2024-09-11T23:18:15.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.338+0000 7f952be00640 1 -- 172.21.15.144:0/2527036303 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f952c1f57f0 con 0x7f952c0d3f60 2024-09-11T23:18:15.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.339+0000 7f952be00640 1 -- 172.21.15.144:0/2527036303 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f952c0d3a20 con 0x7f952c0d3f60 2024-09-11T23:18:15.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.340+0000 7f9523400640 1 -- 172.21.15.144:0/2527036303 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9518012a10 con 0x7f952c0d3f60 2024-09-11T23:18:15.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.340+0000 7f9523400640 1 --2- 172.21.15.144:0/2527036303 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f950c06be30 0x7f950c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.341+0000 7f9523400640 1 -- 172.21.15.144:0/2527036303 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f951808a910 con 0x7f952c0d3f60 2024-09-11T23:18:15.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.341+0000 7f952aa00640 1 --2- 172.21.15.144:0/2527036303 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f950c06be30 0x7f950c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.341+0000 7f952aa00640 1 --2- 172.21.15.144:0/2527036303 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f950c06be30 0x7f950c06e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f951c034000 tx=0x7f951c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:15.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.345+0000 7f9523400640 1 -- 172.21.15.144:0/2527036303 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9518058c70 con 0x7f952c0d3f60 2024-09-11T23:18:15.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.522+0000 7f952be00640 1 -- 172.21.15.144:0/2527036303 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f952c0b9470 con 0x7f952c0d3f60 2024-09-11T23:18:15.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.524+0000 7f9523400640 1 -- 172.21.15.144:0/2527036303 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16689 (secure 0 0 0) 0x7f951805cf70 con 0x7f952c0d3f60 2024-09-11T23:18:15.524 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:15.524 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":22,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:18:00.633839+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:17:57.023145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:17:58.028864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:15.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.526+0000 7f952be00640 1 -- 172.21.15.144:0/2527036303 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f950c06be30 msgr2=0x7f950c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.526+0000 7f952be00640 1 --2- 172.21.15.144:0/2527036303 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f950c06be30 0x7f950c06e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f951c034000 tx=0x7f951c02e000 comp rx=0 tx=0).stop 2024-09-11T23:18:15.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.526+0000 7f952be00640 1 -- 172.21.15.144:0/2527036303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c0d3f60 msgr2=0x7f952c0aafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.526+0000 7f952be00640 1 --2- 172.21.15.144:0/2527036303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c0d3f60 0x7f952c0aafb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f951800c450 tx=0x7f951800c910 comp rx=0 tx=0).stop 2024-09-11T23:18:15.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.526+0000 7f952be00640 1 -- 172.21.15.144:0/2527036303 shutdown_connections 2024-09-11T23:18:15.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.526+0000 7f952be00640 1 --2- 172.21.15.144:0/2527036303 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f950c06be30 0x7f950c06e2f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.526+0000 7f952be00640 1 --2- 172.21.15.144:0/2527036303 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f952c15e640 0x7f952c0ab4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.526+0000 7f952be00640 1 --2- 172.21.15.144:0/2527036303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c0d3f60 0x7f952c0aafb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.526+0000 7f952be00640 1 --2- 172.21.15.144:0/2527036303 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f952c0b66e0 0x7f952c1f3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.526+0000 7f952be00640 1 -- 172.21.15.144:0/2527036303 >> 172.21.15.144:0/2527036303 conn(0x7f952c0d0fd0 msgr2=0x7f952c160bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:15.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.526+0000 7f952be00640 1 -- 172.21.15.144:0/2527036303 shutdown_connections 2024-09-11T23:18:15.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.526+0000 7f952be00640 1 -- 172.21.15.144:0/2527036303 wait complete. 2024-09-11T23:18:15.541 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:15.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.700+0000 7f42f7a00640 1 Processor -- start 2024-09-11T23:18:15.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.700+0000 7f42f7a00640 1 -- start start 2024-09-11T23:18:15.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.701+0000 7f42f7a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42f015ca40 0x7f42f015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.701+0000 7f42f7a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42f015d390 con 0x7f42f00d02a0 2024-09-11T23:18:15.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.701+0000 7f42f7a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42f015d670 con 0x7f42f015ce80 2024-09-11T23:18:15.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.701+0000 7f42f7a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f42f015d950 con 0x7f42f015ca40 2024-09-11T23:18:15.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.702+0000 7f42f5000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f42f00d02a0 0x7f42f00d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35462/0 (socket says 172.21.15.144:35462) 2024-09-11T23:18:15.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.702+0000 7f42f5000640 1 -- 172.21.15.144:0/3978087497 learned_addr learned my addr 172.21.15.144:0/3978087497 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:15.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.702+0000 7f42efe00640 1 --2- 172.21.15.144:0/3978087497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42f015ca40 0x7f42f015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.702+0000 7f42ef400640 1 -- 172.21.15.144:0/3978087497 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1300257096 0 0) 0x7f42f015d390 con 0x7f42f00d02a0 2024-09-11T23:18:15.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.702+0000 7f42ef400640 1 -- 172.21.15.144:0/3978087497 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42d8003520 con 0x7f42f00d02a0 2024-09-11T23:18:15.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.702+0000 7f42ef400640 1 -- 172.21.15.144:0/3978087497 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1034128892 0 0) 0x7f42f015d670 con 0x7f42f015ce80 2024-09-11T23:18:15.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.702+0000 7f42efe00640 1 -- 172.21.15.144:0/3978087497 >> v1:172.21.15.165:6789/0 conn(0x7f42f015ce80 legacy=0x7f42f01594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.702+0000 7f42efe00640 1 -- 172.21.15.144:0/3978087497 >> v1:172.21.15.144:6789/0 conn(0x7f42f00d02a0 legacy=0x7f42f00d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.702+0000 7f42efe00640 1 -- 172.21.15.144:0/3978087497 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f015dc30 con 0x7f42f015ca40 2024-09-11T23:18:15.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.703+0000 7f42efe00640 1 --2- 172.21.15.144:0/3978087497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42f015ca40 0x7f42f015e430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0097d0 tx=0x7f42dc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=289ce235051b2f47 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:15.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.703+0000 7f42ef400640 1 -- 172.21.15.144:0/3978087497 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42dc037070 con 0x7f42f015ca40 2024-09-11T23:18:15.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.703+0000 7f42ef400640 1 -- 172.21.15.144:0/3978087497 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42dc032440 con 0x7f42f015ca40 2024-09-11T23:18:15.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.703+0000 7f42ef400640 1 -- 172.21.15.144:0/3978087497 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42dc032810 con 0x7f42f015ca40 2024-09-11T23:18:15.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.704+0000 7f42f7a00640 1 -- 172.21.15.144:0/3978087497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42f015ca40 msgr2=0x7f42f015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.704+0000 7f42f7a00640 1 --2- 172.21.15.144:0/3978087497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42f015ca40 0x7f42f015e430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0097d0 tx=0x7f42dc02a180 comp rx=0 tx=0).stop 2024-09-11T23:18:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.704+0000 7f42f7a00640 1 -- 172.21.15.144:0/3978087497 shutdown_connections 2024-09-11T23:18:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.704+0000 7f42f7a00640 1 --2- 172.21.15.144:0/3978087497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42f015ca40 0x7f42f015e430 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.704+0000 7f42f7a00640 1 -- 172.21.15.144:0/3978087497 >> 172.21.15.144:0/3978087497 conn(0x7f42f0062cc0 msgr2=0x7f42f006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.704+0000 7f42f7a00640 1 -- 172.21.15.144:0/3978087497 shutdown_connections 2024-09-11T23:18:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.704+0000 7f42f7a00640 1 -- 172.21.15.144:0/3978087497 wait complete. 2024-09-11T23:18:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.706+0000 7f42f7a00640 1 Processor -- start 2024-09-11T23:18:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.706+0000 7f42f7a00640 1 -- start start 2024-09-11T23:18:15.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.707+0000 7f42f7a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42f00d02a0 0x7f42f01581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.707+0000 7f42f7a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42f015ca40 0x7f42f01567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.707+0000 7f42f7a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42f015ce80 0x7f42f015ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.707+0000 7f42f7a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f42f0155d10 con 0x7f42f015ce80 2024-09-11T23:18:15.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.707+0000 7f42f7a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f42f0155b90 con 0x7f42f00d02a0 2024-09-11T23:18:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.707+0000 7f42f7a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f42f00b4790 con 0x7f42f015ca40 2024-09-11T23:18:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.707+0000 7f42f5a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42f015ce80 0x7f42f015ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.707+0000 7f42f5a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42f015ce80 0x7f42f015ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46118/0 (socket says 172.21.15.144:46118) 2024-09-11T23:18:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.707+0000 7f42f5a00640 1 -- 172.21.15.144:0/1720205539 learned_addr learned my addr 172.21.15.144:0/1720205539 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.707+0000 7f42f5000640 1 --2- 172.21.15.144:0/1720205539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42f00d02a0 0x7f42f01581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.707+0000 7f42efe00640 1 --2- 172.21.15.144:0/1720205539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42f015ca40 0x7f42f01567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.707+0000 7f42f5a00640 1 -- 172.21.15.144:0/1720205539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42f015ca40 msgr2=0x7f42f01567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.707+0000 7f42f5a00640 1 --2- 172.21.15.144:0/1720205539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42f015ca40 0x7f42f01567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.707+0000 7f42f5a00640 1 -- 172.21.15.144:0/1720205539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42f00d02a0 msgr2=0x7f42f01581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.707+0000 7f42f5a00640 1 --2- 172.21.15.144:0/1720205539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42f00d02a0 0x7f42f01581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.707+0000 7f42f5a00640 1 -- 172.21.15.144:0/1720205539 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f015b320 con 0x7f42f015ce80 2024-09-11T23:18:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.708+0000 7f42f5a00640 1 --2- 172.21.15.144:0/1720205539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42f015ce80 0x7f42f015ade0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f42e800c760 tx=0x7f42e800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:15.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.708+0000 7f42ecc00640 1 -- 172.21.15.144:0/1720205539 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e8003da0 con 0x7f42f015ce80 2024-09-11T23:18:15.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.708+0000 7f42ecc00640 1 -- 172.21.15.144:0/1720205539 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e8005070 con 0x7f42f015ce80 2024-09-11T23:18:15.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.708+0000 7f42f7a00640 1 -- 172.21.15.144:0/1720205539 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f0158820 con 0x7f42f015ce80 2024-09-11T23:18:15.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.708+0000 7f42ecc00640 1 -- 172.21.15.144:0/1720205539 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e8005460 con 0x7f42f015ce80 2024-09-11T23:18:15.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.708+0000 7f42f7a00640 1 -- 172.21.15.144:0/1720205539 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f0158de0 con 0x7f42f015ce80 2024-09-11T23:18:15.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.709+0000 7f42f7a00640 1 -- 172.21.15.144:0/1720205539 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f00d0680 con 0x7f42f015ce80 2024-09-11T23:18:15.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.710+0000 7f42ecc00640 1 -- 172.21.15.144:0/1720205539 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f42e8005600 con 0x7f42f015ce80 2024-09-11T23:18:15.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.711+0000 7f42ecc00640 1 --2- 172.21.15.144:0/1720205539 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f42d006be30 0x7f42d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:15.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.711+0000 7f42ecc00640 1 -- 172.21.15.144:0/1720205539 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f42e808adb0 con 0x7f42f015ce80 2024-09-11T23:18:15.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.711+0000 7f42f5000640 1 --2- 172.21.15.144:0/1720205539 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f42d006be30 0x7f42d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:15.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.712+0000 7f42f5000640 1 --2- 172.21.15.144:0/1720205539 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f42d006be30 0x7f42d006e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f42e4005880 tx=0x7f42e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:15.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.715+0000 7f42ecc00640 1 -- 172.21.15.144:0/1720205539 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42e808f070 con 0x7f42f015ce80 2024-09-11T23:18:15.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.922+0000 7f42f7a00640 1 -- 172.21.15.144:0/1720205539 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42f015d530 con 0x7f42f015ce80 2024-09-11T23:18:15.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.923+0000 7f42ecc00640 1 -- 172.21.15.144:0/1720205539 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7f42f015b320 con 0x7f42f015ce80 2024-09-11T23:18:15.923 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:15.923 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"btime":"2024-09-11T23:18:02:645252+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1741936320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1741936320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1741936320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1295491349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1295491349},{"type":"v1","addr":"172.21.15.144:6836","nonce":1295491349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1020006630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1020006630},{"type":"v1","addr":"172.21.15.144:6837","nonce":1020006630}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:59.036096+0000","modified":"2024-09-11T23:18:02.054236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2270648598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2270648598},{"type":"v1","addr":"172.21.15.165:6835","nonce":2270648598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-09-11T23:18:15.923 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-09-11T23:18:15.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.925+0000 7f42f7a00640 1 -- 172.21.15.144:0/1720205539 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f42d006be30 msgr2=0x7f42d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.925+0000 7f42f7a00640 1 --2- 172.21.15.144:0/1720205539 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f42d006be30 0x7f42d006e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f42e4005880 tx=0x7f42e4009040 comp rx=0 tx=0).stop 2024-09-11T23:18:15.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.925+0000 7f42f7a00640 1 -- 172.21.15.144:0/1720205539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42f015ce80 msgr2=0x7f42f015ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:15.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.925+0000 7f42f7a00640 1 --2- 172.21.15.144:0/1720205539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42f015ce80 0x7f42f015ade0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f42e800c760 tx=0x7f42e800cc20 comp rx=0 tx=0).stop 2024-09-11T23:18:15.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.925+0000 7f42f7a00640 1 -- 172.21.15.144:0/1720205539 shutdown_connections 2024-09-11T23:18:15.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.925+0000 7f42f7a00640 1 --2- 172.21.15.144:0/1720205539 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f42d006be30 0x7f42d006e2f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.925+0000 7f42f7a00640 1 --2- 172.21.15.144:0/1720205539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42f015ce80 0x7f42f015ade0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.925+0000 7f42f7a00640 1 --2- 172.21.15.144:0/1720205539 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42f015ca40 0x7f42f01567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.925+0000 7f42f7a00640 1 --2- 172.21.15.144:0/1720205539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42f00d02a0 0x7f42f01581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:15.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.925+0000 7f42f7a00640 1 -- 172.21.15.144:0/1720205539 >> 172.21.15.144:0/1720205539 conn(0x7f42f0062cc0 msgr2=0x7f42f006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:15.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.925+0000 7f42f7a00640 1 -- 172.21.15.144:0/1720205539 shutdown_connections 2024-09-11T23:18:15.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:15.925+0000 7f42f7a00640 1 -- 172.21.15.144:0/1720205539 wait complete. 2024-09-11T23:18:16.345 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:17:59.036096+0000', 'modified': '2024-09-11T23:18:02.054236+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4297': {'gid': 4297, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.165:6835/2270648598', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6834', 'nonce': 2270648598}, {'type': 'v1', 'addr': '172.21.15.165:6835', 'nonce': 2270648598}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4297, 'qdb_cluster': [4297]} 2024-09-11T23:18:16.345 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:18:16.345 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-11T23:18:16.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.499+0000 7f0f61200640 1 Processor -- start 2024-09-11T23:18:16.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.499+0000 7f0f61200640 1 -- start start 2024-09-11T23:18:16.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.500+0000 7f0f61200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0f5c15ca40 0x7f0f5c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.500+0000 7f0f61200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0f5c15ceb0 0x7f0f5c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.500+0000 7f0f61200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5c15d390 con 0x7f0f5c0d02a0 2024-09-11T23:18:16.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.500+0000 7f0f61200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0f5c15d670 con 0x7f0f5c15ceb0 2024-09-11T23:18:16.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.500+0000 7f0f61200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0f5c15d950 con 0x7f0f5c15ca40 2024-09-11T23:18:16.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.501+0000 7f0f5a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0f5c15ceb0 0x7f0f5c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.501+0000 7f0f5a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0f5c15ceb0 0x7f0f5c1594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46132/0 (socket says 172.21.15.144:46132) 2024-09-11T23:18:16.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.501+0000 7f0f5a800640 1 -- 172.21.15.144:0/3384555621 learned_addr learned my addr 172.21.15.144:0/3384555621 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:16.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.501+0000 7f0f51400640 1 --2- 172.21.15.144:0/3384555621 >> v2:172.21.15.165:3300/0 conn(0x7f0f5c15ca40 0x7f0f5c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.501+0000 7f0f5a800640 1 -- 172.21.15.144:0/3384555621 >> v2:172.21.15.165:3300/0 conn(0x7f0f5c15ca40 msgr2=0x7f0f5c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:16.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.501+0000 7f0f5a800640 1 --2- 172.21.15.144:0/3384555621 >> v2:172.21.15.165:3300/0 conn(0x7f0f5c15ca40 0x7f0f5c15e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.501+0000 7f0f5a800640 1 -- 172.21.15.144:0/3384555621 >> v1:172.21.15.165:6789/0 conn(0x7f0f5c0d02a0 legacy=0x7f0f5c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.501+0000 7f0f5a800640 1 -- 172.21.15.144:0/3384555621 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5c15dc30 con 0x7f0f5c15ceb0 2024-09-11T23:18:16.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.502+0000 7f0f5a800640 1 --2- 172.21.15.144:0/3384555621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5c15ceb0 0x7f0f5c1594c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0cf320 tx=0x7f0f5402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f0dce266ab8a41 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:16.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.502+0000 7f0f59400640 1 -- 172.21.15.144:0/3384555621 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54036070 con 0x7f0f5c15ceb0 2024-09-11T23:18:16.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.502+0000 7f0f59400640 1 -- 172.21.15.144:0/3384555621 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f54031600 con 0x7f0f5c15ceb0 2024-09-11T23:18:16.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.502+0000 7f0f59400640 1 -- 172.21.15.144:0/3384555621 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f540319d0 con 0x7f0f5c15ceb0 2024-09-11T23:18:16.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.503+0000 7f0f61200640 1 -- 172.21.15.144:0/3384555621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5c15ceb0 msgr2=0x7f0f5c1594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.503+0000 7f0f61200640 1 --2- 172.21.15.144:0/3384555621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5c15ceb0 0x7f0f5c1594c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0cf320 tx=0x7f0f5402a6a0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.503+0000 7f0f61200640 1 -- 172.21.15.144:0/3384555621 shutdown_connections 2024-09-11T23:18:16.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.503+0000 7f0f61200640 1 --2- 172.21.15.144:0/3384555621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5c15ceb0 0x7f0f5c1594c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.503+0000 7f0f61200640 1 --2- 172.21.15.144:0/3384555621 >> v2:172.21.15.165:3300/0 conn(0x7f0f5c15ca40 0x7f0f5c15e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.503+0000 7f0f61200640 1 -- 172.21.15.144:0/3384555621 >> 172.21.15.144:0/3384555621 conn(0x7f0f5c062cc0 msgr2=0x7f0f5c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:16.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.503+0000 7f0f61200640 1 -- 172.21.15.144:0/3384555621 shutdown_connections 2024-09-11T23:18:16.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.503+0000 7f0f61200640 1 -- 172.21.15.144:0/3384555621 wait complete. 2024-09-11T23:18:16.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.505+0000 7f0f61200640 1 Processor -- start 2024-09-11T23:18:16.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.505+0000 7f0f61200640 1 -- start start 2024-09-11T23:18:16.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.506+0000 7f0f61200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f5c0d02a0 0x7f0f5c14ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.506+0000 7f0f61200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f5c15ca40 0x7f0f5c0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.506+0000 7f0f61200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5c15ceb0 0x7f0f5c06be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.506+0000 7f0f61200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c155d10 con 0x7f0f5c15ceb0 2024-09-11T23:18:16.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.506+0000 7f0f61200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c155b90 con 0x7f0f5c15ca40 2024-09-11T23:18:16.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.506+0000 7f0f61200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0f5c0b4790 con 0x7f0f5c0d02a0 2024-09-11T23:18:16.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.506+0000 7f0f5a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5c15ceb0 0x7f0f5c06be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.506+0000 7f0f5a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5c15ceb0 0x7f0f5c06be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46144/0 (socket says 172.21.15.144:46144) 2024-09-11T23:18:16.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.506+0000 7f0f5a800640 1 -- 172.21.15.144:0/436966791 learned_addr learned my addr 172.21.15.144:0/436966791 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:16.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.506+0000 7f0f51400640 1 --2- 172.21.15.144:0/436966791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f5c15ca40 0x7f0f5c0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.506+0000 7f0f59e00640 1 --2- 172.21.15.144:0/436966791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f5c0d02a0 0x7f0f5c14ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.506+0000 7f0f5a800640 1 -- 172.21.15.144:0/436966791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f5c0d02a0 msgr2=0x7f0f5c14ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.506+0000 7f0f5a800640 1 --2- 172.21.15.144:0/436966791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f5c0d02a0 0x7f0f5c14ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.506+0000 7f0f5a800640 1 -- 172.21.15.144:0/436966791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f5c15ca40 msgr2=0x7f0f5c0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.506+0000 7f0f5a800640 1 --2- 172.21.15.144:0/436966791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f5c15ca40 0x7f0f5c0cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.506+0000 7f0f5a800640 1 -- 172.21.15.144:0/436966791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5c1560d0 con 0x7f0f5c15ceb0 2024-09-11T23:18:16.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.507+0000 7f0f5a800640 1 --2- 172.21.15.144:0/436966791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5c15ceb0 0x7f0f5c06be80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0f54034040 tx=0x7f0f54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:16.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.507+0000 7f0f52a00640 1 -- 172.21.15.144:0/436966791 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54036050 con 0x7f0f5c15ceb0 2024-09-11T23:18:16.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.507+0000 7f0f52a00640 1 -- 172.21.15.144:0/436966791 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f54042070 con 0x7f0f5c15ceb0 2024-09-11T23:18:16.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.507+0000 7f0f52a00640 1 -- 172.21.15.144:0/436966791 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54009510 con 0x7f0f5c15ceb0 2024-09-11T23:18:16.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.507+0000 7f0f61200640 1 -- 172.21.15.144:0/436966791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5c15a590 con 0x7f0f5c15ceb0 2024-09-11T23:18:16.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.507+0000 7f0f61200640 1 -- 172.21.15.144:0/436966791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f5c15ab50 con 0x7f0f5c15ceb0 2024-09-11T23:18:16.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.509+0000 7f0f52a00640 1 -- 172.21.15.144:0/436966791 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f54007bf0 con 0x7f0f5c15ceb0 2024-09-11T23:18:16.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.510+0000 7f0f52a00640 1 --2- 172.21.15.144:0/436966791 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0f3806be30 0x7f0f3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.510+0000 7f0f52a00640 1 -- 172.21.15.144:0/436966791 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0f540abc70 con 0x7f0f5c15ceb0 2024-09-11T23:18:16.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.510+0000 7f0f59e00640 1 --2- 172.21.15.144:0/436966791 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0f3806be30 0x7f0f3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.510+0000 7f0f6406e740 1 Processor -- start 2024-09-11T23:18:16.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.510+0000 7f0f59e00640 1 --2- 172.21.15.144:0/436966791 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0f3806be30 0x7f0f3806e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c007fd0 tx=0x7f0f4c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:16.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.510+0000 7f0f6406e740 1 -- start start 2024-09-11T23:18:16.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.511+0000 7f0f6406e740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b6cf0 0x55bce11fc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.511+0000 7f0f6406e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11b44b0 0x55bce11b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.511+0000 7f0f6406e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b8480 0x55bce11b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.511+0000 7f0f6406e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55bce11153b0 con 0x55bce11b44b0 2024-09-11T23:18:16.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.511+0000 7f0f6406e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55bce111a410 con 0x55bce11b8480 2024-09-11T23:18:16.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.511+0000 7f0f6406e740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55bce10c2620 con 0x55bce11b6cf0 2024-09-11T23:18:16.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.511+0000 7f0f51400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11b44b0 0x55bce11b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.512+0000 7f0f51400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11b44b0 0x55bce11b70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46156/0 (socket says 172.21.15.144:46156) 2024-09-11T23:18:16.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.512+0000 7f0f51400640 1 -- 172.21.15.144:0/306931470 learned_addr learned my addr 172.21.15.144:0/306931470 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:16.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.512+0000 7f0f59e00640 1 --2- 172.21.15.144:0/306931470 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b6cf0 0x55bce11fc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.512+0000 7f0f5a800640 1 --2- 172.21.15.144:0/306931470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b8480 0x55bce11b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.512+0000 7f0f51400640 1 -- 172.21.15.144:0/306931470 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b6cf0 msgr2=0x55bce11fc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:16.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.512+0000 7f0f51400640 1 --2- 172.21.15.144:0/306931470 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b6cf0 0x55bce11fc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.512+0000 7f0f51400640 1 -- 172.21.15.144:0/306931470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b8480 msgr2=0x55bce11b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:16.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.512+0000 7f0f51400640 1 --2- 172.21.15.144:0/306931470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b8480 0x55bce11b1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.512+0000 7f0f51400640 1 -- 172.21.15.144:0/306931470 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce0e2d2d0 con 0x55bce11b44b0 2024-09-11T23:18:16.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.512+0000 7f0f51400640 1 --2- 172.21.15.144:0/306931470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11b44b0 0x55bce11b70d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009bb0 tx=0x7f0f44009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541cae43fd788888 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:16.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.512+0000 7f0f4aa00640 1 -- 172.21.15.144:0/306931470 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44009ca0 con 0x55bce11b44b0 2024-09-11T23:18:16.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.512+0000 7f0f4aa00640 1 -- 172.21.15.144:0/306931470 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f44009e40 con 0x55bce11b44b0 2024-09-11T23:18:16.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.512+0000 7f0f4aa00640 1 -- 172.21.15.144:0/306931470 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44004270 con 0x55bce11b44b0 2024-09-11T23:18:16.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.513+0000 7f0f6406e740 1 -- 172.21.15.144:0/306931470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11b44b0 msgr2=0x55bce11b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.513+0000 7f0f6406e740 1 --2- 172.21.15.144:0/306931470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11b44b0 0x55bce11b70d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009bb0 tx=0x7f0f44009190 comp rx=0 tx=0).stop 2024-09-11T23:18:16.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.513+0000 7f0f6406e740 1 -- 172.21.15.144:0/306931470 shutdown_connections 2024-09-11T23:18:16.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.513+0000 7f0f6406e740 1 --2- 172.21.15.144:0/306931470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b8480 0x55bce11b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.513+0000 7f0f6406e740 1 --2- 172.21.15.144:0/306931470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11b44b0 0x55bce11b70d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.513+0000 7f0f6406e740 1 --2- 172.21.15.144:0/306931470 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b6cf0 0x55bce11fc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.513+0000 7f0f6406e740 1 -- 172.21.15.144:0/306931470 >> 172.21.15.144:0/306931470 conn(0x55bce11b3740 msgr2=0x55bce11fb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:16.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.513+0000 7f0f6406e740 1 -- 172.21.15.144:0/306931470 shutdown_connections 2024-09-11T23:18:16.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.513+0000 7f0f6406e740 1 -- 172.21.15.144:0/306931470 wait complete. 2024-09-11T23:18:16.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.514+0000 7f0f6406e740 1 -- start start 2024-09-11T23:18:16.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.514+0000 7f0f6406e740 1 Processor -- start 2024-09-11T23:18:16.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.515+0000 7f0f6406e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b6cf0 0x55bce11d6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.515+0000 7f0f6406e740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b8480 0x55bce11d6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.515+0000 7f0f6406e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 0x55bce11da230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.515+0000 7f0f6406e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55bce10d5780 con 0x55bce11d9db0 2024-09-11T23:18:16.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.515+0000 7f0f6406e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55bce11163d0 con 0x55bce11b6cf0 2024-09-11T23:18:16.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.515+0000 7f0f6406e740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55bce11b2be0 con 0x55bce11b8480 2024-09-11T23:18:16.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.515+0000 7f0f6406e740 10 client.0 _ll_register_callbacks cb 0x55bce11135d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:16.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.515+0000 7f0f5a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 0x55bce11da230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.515+0000 7f0f5a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 0x55bce11da230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46162/0 (socket says 172.21.15.144:46162) 2024-09-11T23:18:16.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.515+0000 7f0f59e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b6cf0 0x55bce11d6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.515+0000 7f0f5a800640 1 -- 172.21.15.144:0/1508973762 learned_addr learned my addr 172.21.15.144:0/1508973762 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:16.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.515+0000 7f0f51400640 1 --2- 172.21.15.144:0/1508973762 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b8480 0x55bce11d6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.516+0000 7f0f5a800640 1 -- 172.21.15.144:0/1508973762 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b8480 msgr2=0x55bce11d6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:16.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.516+0000 7f0f5a800640 1 --2- 172.21.15.144:0/1508973762 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b8480 0x55bce11d6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.516+0000 7f0f5a800640 1 -- 172.21.15.144:0/1508973762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b6cf0 msgr2=0x55bce11d6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:16.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.516+0000 7f0f5a800640 1 --2- 172.21.15.144:0/1508973762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b6cf0 0x55bce11d6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.516+0000 7f0f5a800640 1 -- 172.21.15.144:0/1508973762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bce0ef76b0 con 0x55bce11d9db0 2024-09-11T23:18:16.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.516+0000 7f0f5a800640 1 --2- 172.21.15.144:0/1508973762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 0x55bce11da230 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0f5402a6e0 tx=0x7f0f54079960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efab79c206e3400e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:16.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.516+0000 7f0f3f400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:18:16.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.516+0000 7f0f3f400640 1 -- 172.21.15.144:0/1508973762 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54093060 con 0x55bce11d9db0 2024-09-11T23:18:16.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.516+0000 7f0f3f400640 1 -- 172.21.15.144:0/1508973762 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0f54079560 con 0x55bce11d9db0 2024-09-11T23:18:16.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.516+0000 7f0f6406e740 1 -- 172.21.15.144:0/1508973762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bce1127b40 con 0x55bce11d9db0 2024-09-11T23:18:16.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.516+0000 7f0f3f400640 1 -- 172.21.15.144:0/1508973762 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f0f5407e2c0 con 0x55bce11d9db0 2024-09-11T23:18:16.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.516+0000 7f0f6406e740 10 client.4608 fetch_fsmap learned FSMap version 8 2024-09-11T23:18:16.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.516+0000 7f0f6406e740 1 -- 172.21.15.144:0/1508973762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55bce11d7ef0 con 0x55bce11d9db0 2024-09-11T23:18:16.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.517+0000 7f0f3f400640 1 -- 172.21.15.144:0/1508973762 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55bce1127b40 con 0x55bce11d9db0 2024-09-11T23:18:16.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.517+0000 7f0f3f400640 1 -- 172.21.15.144:0/1508973762 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f0f540a3af0 con 0x55bce11d9db0 2024-09-11T23:18:16.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.517+0000 7f0f6406e740 10 client.4608 fetch_fsmap finished waiting for FSMap version 8 2024-09-11T23:18:16.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.517+0000 7f0f6406e740 10 client.4608 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-11T23:18:16.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.517+0000 7f0f6406e740 20 client.4608 populate_metadata read hostname 'smithi144' 2024-09-11T23:18:16.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.517+0000 7f0f6406e740 1 --2- 172.21.15.144:0/1508973762 >> [v2:172.21.15.165:6834/2270648598,v1:172.21.15.165:6835/2270648598] conn(0x55bce11e0f40 0x55bce11df2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.517+0000 7f0f6406e740 4 client.4608 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:18:16.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.517+0000 7f0f6406e740 1 -- 172.21.15.144:0/1508973762 --> [v2:172.21.15.165:6834/2270648598,v1:172.21.15.165:6835/2270648598] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bce1121e90 con 0x55bce11e0f40 2024-09-11T23:18:16.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.517+0000 7f0f59e00640 1 --2- 172.21.15.144:0/1508973762 >> [v2:172.21.15.165:6834/2270648598,v1:172.21.15.165:6835/2270648598] conn(0x55bce11e0f40 0x55bce11df2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.518+0000 7f0f59e00640 1 --2- 172.21.15.144:0/1508973762 >> [v2:172.21.15.165:6834/2270648598,v1:172.21.15.165:6835/2270648598] conn(0x55bce11e0f40 0x55bce11df2f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6520208dabf38160 server_cookie=b7962ef06b716c86 in_seq=0 out_seq=0 2024-09-11T23:18:16.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.518+0000 7f0f3f400640 10 client.4608 ms_handle_connect on v2:172.21.15.165:6834/2270648598 2024-09-11T23:18:16.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.519+0000 7f0f3f400640 1 -- 172.21.15.144:0/1508973762 <== mds.0 v2:172.21.15.165:6834/2270648598 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bce1121e90 con 0x55bce11e0f40 2024-09-11T23:18:16.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.519+0000 7f0f3f400640 10 client.4608 handle_command_reply: tid=0 2024-09-11T23:18:16.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.519+0000 7f0f6406e740 1 client.4608 shutdown 2024-09-11T23:18:16.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.519+0000 7f0f6406e740 1 -- 172.21.15.144:0/1508973762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 msgr2=0x55bce11da230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.519+0000 7f0f6406e740 1 --2- 172.21.15.144:0/1508973762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 0x55bce11da230 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0f5402a6e0 tx=0x7f0f54079960 comp rx=0 tx=0).stop 2024-09-11T23:18:16.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.519+0000 7f0f6406e740 1 -- 172.21.15.144:0/1508973762 shutdown_connections 2024-09-11T23:18:16.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.519+0000 7f0f6406e740 1 --2- 172.21.15.144:0/1508973762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 0x55bce11da230 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.519+0000 7f0f6406e740 1 --2- 172.21.15.144:0/1508973762 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b8480 0x55bce11d6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.519+0000 7f0f6406e740 1 --2- 172.21.15.144:0/1508973762 >> [v2:172.21.15.165:6834/2270648598,v1:172.21.15.165:6835/2270648598] conn(0x55bce11e0f40 0x55bce11df2f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.519+0000 7f0f6406e740 1 --2- 172.21.15.144:0/1508973762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b6cf0 0x55bce11d6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.519+0000 7f0f6406e740 1 -- 172.21.15.144:0/1508973762 >> 172.21.15.144:0/1508973762 conn(0x55bce11b44b0 msgr2=0x55bce11faec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:16.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.519+0000 7f0f3f400640 0 client.4608 ms_handle_reset on v2:172.21.15.165:6834/2270648598 2024-09-11T23:18:16.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.519+0000 7f0f6406e740 1 -- 172.21.15.144:0/1508973762 shutdown_connections 2024-09-11T23:18:16.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.519+0000 7f0f6406e740 1 -- 172.21.15.144:0/1508973762 wait complete. 2024-09-11T23:18:16.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.519+0000 7f0f6406e740 20 client.4608 trim_cache size 0 max 16384 2024-09-11T23:18:16.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.538+0000 7f0f6406e740 1 Processor -- start 2024-09-11T23:18:16.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.538+0000 7f0f6406e740 1 -- start start 2024-09-11T23:18:16.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.539+0000 7f0f6406e740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b6cf0 0x55bce11d9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.539+0000 7f0f6406e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b8480 0x55bce11fc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.539+0000 7f0f6406e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 0x55bce11f8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.539+0000 7f0f6406e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c1ffaf0 con 0x55bce11d9db0 2024-09-11T23:18:16.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.539+0000 7f0f6406e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c158170 con 0x55bce11b8480 2024-09-11T23:18:16.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.539+0000 7f0f6406e740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0f5c1587c0 con 0x55bce11b6cf0 2024-09-11T23:18:16.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.539+0000 7f0f5a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 0x55bce11f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.539+0000 7f0f5a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 0x55bce11f8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46178/0 (socket says 172.21.15.144:46178) 2024-09-11T23:18:16.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.539+0000 7f0f5a800640 1 -- 172.21.15.144:0/4003459424 learned_addr learned my addr 172.21.15.144:0/4003459424 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:16.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.539+0000 7f0f51400640 1 --2- 172.21.15.144:0/4003459424 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b8480 0x55bce11fc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.539+0000 7f0f59e00640 1 --2- 172.21.15.144:0/4003459424 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b6cf0 0x55bce11d9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.539+0000 7f0f5a800640 1 -- 172.21.15.144:0/4003459424 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b6cf0 msgr2=0x55bce11d9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:16.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.539+0000 7f0f5a800640 1 --2- 172.21.15.144:0/4003459424 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b6cf0 0x55bce11d9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.539+0000 7f0f5a800640 1 -- 172.21.15.144:0/4003459424 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b8480 msgr2=0x55bce11fc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:16.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.539+0000 7f0f5a800640 1 --2- 172.21.15.144:0/4003459424 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b8480 0x55bce11fc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.539+0000 7f0f5a800640 1 -- 172.21.15.144:0/4003459424 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce120b740 con 0x55bce11d9db0 2024-09-11T23:18:16.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.539+0000 7f0f59e00640 1 --2- 172.21.15.144:0/4003459424 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b6cf0 0x55bce11d9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:16.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.539+0000 7f0f51400640 1 --2- 172.21.15.144:0/4003459424 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b8480 0x55bce11fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:16.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.540+0000 7f0f5a800640 1 --2- 172.21.15.144:0/4003459424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 0x55bce11f8fe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009c90 tx=0x7f0f54091000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d25f2d4b8539ab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:16.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.540+0000 7f0f4a000640 1 -- 172.21.15.144:0/4003459424 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f540a1070 con 0x55bce11d9db0 2024-09-11T23:18:16.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.540+0000 7f0f4a000640 1 -- 172.21.15.144:0/4003459424 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f540a8070 con 0x55bce11d9db0 2024-09-11T23:18:16.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.540+0000 7f0f4a000640 1 -- 172.21.15.144:0/4003459424 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54079580 con 0x55bce11d9db0 2024-09-11T23:18:16.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.540+0000 7f0f6406e740 1 -- 172.21.15.144:0/4003459424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 msgr2=0x55bce11f8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.540+0000 7f0f6406e740 1 --2- 172.21.15.144:0/4003459424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 0x55bce11f8fe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009c90 tx=0x7f0f54091000 comp rx=0 tx=0).stop 2024-09-11T23:18:16.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.540+0000 7f0f6406e740 1 -- 172.21.15.144:0/4003459424 shutdown_connections 2024-09-11T23:18:16.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.540+0000 7f0f6406e740 1 --2- 172.21.15.144:0/4003459424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 0x55bce11f8fe0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.540+0000 7f0f6406e740 1 --2- 172.21.15.144:0/4003459424 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b8480 0x55bce11fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.540+0000 7f0f6406e740 1 --2- 172.21.15.144:0/4003459424 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b6cf0 0x55bce11d9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.540+0000 7f0f6406e740 1 -- 172.21.15.144:0/4003459424 >> 172.21.15.144:0/4003459424 conn(0x55bce11b44b0 msgr2=0x55bce11da9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:16.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.541+0000 7f0f6406e740 1 -- 172.21.15.144:0/4003459424 shutdown_connections 2024-09-11T23:18:16.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.541+0000 7f0f6406e740 1 -- 172.21.15.144:0/4003459424 wait complete. 2024-09-11T23:18:16.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.541+0000 7f0f6406e740 1 -- start start 2024-09-11T23:18:16.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.541+0000 7f0f6406e740 1 Processor -- start 2024-09-11T23:18:16.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.542+0000 7f0f6406e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b6cf0 0x55bce127af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.542+0000 7f0f6406e740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b8480 0x55bce121e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.542+0000 7f0f6406e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 0x55bce1277870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.542+0000 7f0f6406e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55bce11dfd60 con 0x55bce11d9db0 2024-09-11T23:18:16.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.542+0000 7f0f6406e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55bce10d5780 con 0x55bce11b6cf0 2024-09-11T23:18:16.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.542+0000 7f0f6406e740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55bce11e1340 con 0x55bce11b8480 2024-09-11T23:18:16.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.542+0000 7f0f6406e740 10 client.0 _ll_register_callbacks cb 0x7f0f54031f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:16.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.543+0000 7f0f5a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 0x55bce1277870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.543+0000 7f0f5a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 0x55bce1277870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46182/0 (socket says 172.21.15.144:46182) 2024-09-11T23:18:16.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.543+0000 7f0f5a800640 1 -- 172.21.15.144:0/4078067748 learned_addr learned my addr 172.21.15.144:0/4078067748 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:16.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.543+0000 7f0f59e00640 1 --2- 172.21.15.144:0/4078067748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b6cf0 0x55bce127af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.543+0000 7f0f51400640 1 --2- 172.21.15.144:0/4078067748 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b8480 0x55bce121e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.543+0000 7f0f5a800640 1 -- 172.21.15.144:0/4078067748 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b8480 msgr2=0x55bce121e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:16.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.543+0000 7f0f5a800640 1 --2- 172.21.15.144:0/4078067748 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b8480 0x55bce121e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.543+0000 7f0f5a800640 1 -- 172.21.15.144:0/4078067748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b6cf0 msgr2=0x55bce127af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:16.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.543+0000 7f0f5a800640 1 --2- 172.21.15.144:0/4078067748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b6cf0 0x55bce127af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.543+0000 7f0f5a800640 1 -- 172.21.15.144:0/4078067748 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bce120e8f0 con 0x55bce11d9db0 2024-09-11T23:18:16.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.543+0000 7f0f5a800640 1 --2- 172.21.15.144:0/4078067748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 0x55bce1277870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0f5402a6e0 tx=0x7f0f540aa060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac993b19cd8be01a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:16.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.543+0000 7f0f3f400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:18:16.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.543+0000 7f0f3f400640 1 -- 172.21.15.144:0/4078067748 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f540a1070 con 0x55bce11d9db0 2024-09-11T23:18:16.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.543+0000 7f0f3f400640 1 -- 172.21.15.144:0/4078067748 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0f54078dd0 con 0x55bce11d9db0 2024-09-11T23:18:16.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.543+0000 7f0f6406e740 1 -- 172.21.15.144:0/4078067748 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f540a8070 con 0x55bce11d9db0 2024-09-11T23:18:16.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.544+0000 7f0f3f400640 1 -- 172.21.15.144:0/4078067748 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f0f5408a050 con 0x55bce11d9db0 2024-09-11T23:18:16.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.544+0000 7f0f6406e740 10 client.4614 fetch_fsmap learned FSMap version 8 2024-09-11T23:18:16.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.544+0000 7f0f6406e740 1 -- 172.21.15.144:0/4078067748 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55bce120e8f0 con 0x55bce11d9db0 2024-09-11T23:18:16.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.544+0000 7f0f3f400640 1 -- 172.21.15.144:0/4078067748 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f540a8070 con 0x55bce11d9db0 2024-09-11T23:18:16.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.544+0000 7f0f3f400640 1 -- 172.21.15.144:0/4078067748 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f0f5408d020 con 0x55bce11d9db0 2024-09-11T23:18:16.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.544+0000 7f0f6406e740 10 client.4614 fetch_fsmap finished waiting for FSMap version 8 2024-09-11T23:18:16.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.544+0000 7f0f6406e740 10 client.4614 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-11T23:18:16.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.544+0000 7f0f6406e740 20 client.4614 populate_metadata read hostname 'smithi144' 2024-09-11T23:18:16.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.544+0000 7f0f6406e740 1 --2- 172.21.15.144:0/4078067748 >> [v2:172.21.15.165:6834/2270648598,v1:172.21.15.165:6835/2270648598] conn(0x55bce11cd260 0x55bce11b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:16.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.544+0000 7f0f6406e740 4 client.4614 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:18:16.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.544+0000 7f0f6406e740 1 -- 172.21.15.144:0/4078067748 --> [v2:172.21.15.165:6834/2270648598,v1:172.21.15.165:6835/2270648598] -- command(tid 0: {"prefix": "status"}) -- 0x55bce109ea40 con 0x55bce11cd260 2024-09-11T23:18:16.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.544+0000 7f0f59e00640 1 --2- 172.21.15.144:0/4078067748 >> [v2:172.21.15.165:6834/2270648598,v1:172.21.15.165:6835/2270648598] conn(0x55bce11cd260 0x55bce11b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:16.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.545+0000 7f0f59e00640 1 --2- 172.21.15.144:0/4078067748 >> [v2:172.21.15.165:6834/2270648598,v1:172.21.15.165:6835/2270648598] conn(0x55bce11cd260 0x55bce11b0530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=365881f880187660 server_cookie=6670374988bc4911 in_seq=0 out_seq=0 2024-09-11T23:18:16.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.545+0000 7f0f3f400640 10 client.4614 ms_handle_connect on v2:172.21.15.165:6834/2270648598 2024-09-11T23:18:16.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.545+0000 7f0f3f400640 1 -- 172.21.15.144:0/4078067748 <== mds.0 v2:172.21.15.165:6834/2270648598 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55bce109ea40 con 0x55bce11cd260 2024-09-11T23:18:16.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.545+0000 7f0f3f400640 10 client.4614 handle_command_reply: tid=0 2024-09-11T23:18:16.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.545+0000 7f0f6406e740 1 client.4614 shutdown 2024-09-11T23:18:16.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.545+0000 7f0f6406e740 1 -- 172.21.15.144:0/4078067748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 msgr2=0x55bce1277870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.545+0000 7f0f6406e740 1 --2- 172.21.15.144:0/4078067748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 0x55bce1277870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0f5402a6e0 tx=0x7f0f540aa060 comp rx=0 tx=0).stop 2024-09-11T23:18:16.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.545+0000 7f0f6406e740 1 -- 172.21.15.144:0/4078067748 shutdown_connections 2024-09-11T23:18:16.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.545+0000 7f0f6406e740 1 --2- 172.21.15.144:0/4078067748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bce11d9db0 0x55bce1277870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.545+0000 7f0f6406e740 1 --2- 172.21.15.144:0/4078067748 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55bce11b8480 0x55bce121e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.545+0000 7f0f6406e740 1 --2- 172.21.15.144:0/4078067748 >> [v2:172.21.15.165:6834/2270648598,v1:172.21.15.165:6835/2270648598] conn(0x55bce11cd260 0x55bce11b0530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.545+0000 7f0f6406e740 1 --2- 172.21.15.144:0/4078067748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55bce11b6cf0 0x55bce127af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.545+0000 7f0f6406e740 1 -- 172.21.15.144:0/4078067748 >> 172.21.15.144:0/4078067748 conn(0x55bce11b44b0 msgr2=0x55bce11f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:16.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.545+0000 7f0f3f400640 0 client.4614 ms_handle_reset on v2:172.21.15.165:6834/2270648598 2024-09-11T23:18:16.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.545+0000 7f0f6406e740 1 -- 172.21.15.144:0/4078067748 shutdown_connections 2024-09-11T23:18:16.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.546+0000 7f0f6406e740 1 -- 172.21.15.144:0/4078067748 wait complete. 2024-09-11T23:18:16.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.546+0000 7f0f6406e740 20 client.4614 trim_cache size 0 max 16384 2024-09-11T23:18:16.550 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:18:16.550 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "4b73e4b7-12f0-4e37-94bc-45e333efe84e", 2024-09-11T23:18:16.550 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-11T23:18:16.550 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 4297, 2024-09-11T23:18:16.550 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-11T23:18:16.550 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-11T23:18:16.550 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-11T23:18:16.550 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 16.907086372999999, 2024-09-11T23:18:16.550 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 8, 2024-09-11T23:18:16.550 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 22, 2024-09-11T23:18:16.550 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 22, 2024-09-11T23:18:16.550 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 22.940932911000001 2024-09-11T23:18:16.551 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:18:16.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.546+0000 7f0f61200640 1 -- 172.21.15.144:0/436966791 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0f3806be30 msgr2=0x7f0f3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.546+0000 7f0f61200640 1 --2- 172.21.15.144:0/436966791 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0f3806be30 0x7f0f3806e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c007fd0 tx=0x7f0f4c009040 comp rx=0 tx=0).stop 2024-09-11T23:18:16.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.546+0000 7f0f61200640 1 -- 172.21.15.144:0/436966791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5c15ceb0 msgr2=0x7f0f5c06be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:16.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.546+0000 7f0f61200640 1 --2- 172.21.15.144:0/436966791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5c15ceb0 0x7f0f5c06be80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0f54034040 tx=0x7f0f54004a40 comp rx=0 tx=0).stop 2024-09-11T23:18:16.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.546+0000 7f0f61200640 1 -- 172.21.15.144:0/436966791 shutdown_connections 2024-09-11T23:18:16.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.546+0000 7f0f61200640 1 --2- 172.21.15.144:0/436966791 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0f3806be30 0x7f0f3806e2f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.546+0000 7f0f61200640 1 --2- 172.21.15.144:0/436966791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f5c15ceb0 0x7f0f5c06be80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.546+0000 7f0f61200640 1 --2- 172.21.15.144:0/436966791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f5c15ca40 0x7f0f5c0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.546+0000 7f0f61200640 1 --2- 172.21.15.144:0/436966791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f5c0d02a0 0x7f0f5c14ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:16.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.546+0000 7f0f61200640 1 -- 172.21.15.144:0/436966791 >> 172.21.15.144:0/436966791 conn(0x7f0f5c062cc0 msgr2=0x7f0f5c0b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:16.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.546+0000 7f0f61200640 1 -- 172.21.15.144:0/436966791 shutdown_connections 2024-09-11T23:18:16.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:16.546+0000 7f0f61200640 1 -- 172.21.15.144:0/436966791 wait complete. 2024-09-11T23:18:16.561 INFO:teuthology.run_tasks:Running task sequential... 2024-09-11T23:18:16.770 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-11T23:18:16.770 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-11T23:18:16.770 INFO:teuthology.task.print:Enabling mgr modules 2024-09-11T23:18:16.771 INFO:teuthology.run_tasks:Running task kclient... 2024-09-11T23:18:16.822 INFO:tasks.kclient:Mounting kernel clients... 2024-09-11T23:18:16.822 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-11T23:18:16.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:16.822 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-11T23:18:16.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:16.858 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2024-09-11T23:18:16.957 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2024-09-11T23:18:16.960 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:18:16.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:16.961 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-11T23:18:16.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:16.996 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2024-09-11T23:18:17.093 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2024-09-11T23:18:17.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:18:17.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:17.096 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-11T23:18:17.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:17.136 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link delete ceph-brx 2024-09-11T23:18:17.239 INFO:teuthology.orchestra.run.smithi165.stderr:Cannot find device "ceph-brx" 2024-09-11T23:18:17.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:18:17.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:17.242 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-11T23:18:17.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:17.279 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link delete ceph-brx 2024-09-11T23:18:17.379 INFO:teuthology.orchestra.run.smithi165.stderr:Cannot find device "ceph-brx" 2024-09-11T23:18:17.381 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:18:17.382 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-11T23:18:17.382 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T23:18:17.382 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:18:17.383 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:18:17.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.537+0000 7f563a600640 1 Processor -- start 2024-09-11T23:18:17.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.537+0000 7f563a600640 1 -- start start 2024-09-11T23:18:17.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.538+0000 7f563a600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f563415a0a0 0x7f5634073180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.538+0000 7f563a600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f56340ceb90 0x7f56340b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.538+0000 7f563a600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5634072100 con 0x7f56340736c0 2024-09-11T23:18:17.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.538+0000 7f563a600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f56340723c0 con 0x7f56340ceb90 2024-09-11T23:18:17.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.538+0000 7f563a600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f56340726a0 con 0x7f563415a0a0 2024-09-11T23:18:17.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.538+0000 7f5639c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f56340ceb90 0x7f56340b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.538+0000 7f562be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f56340736c0 0x7f56340ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35468/0 (socket says 172.21.15.144:35468) 2024-09-11T23:18:17.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.538+0000 7f562be00640 1 -- 172.21.15.144:0/3028024100 learned_addr learned my addr 172.21.15.144:0/3028024100 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:17.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.538+0000 7f5639200640 1 --2- 172.21.15.144:0/3028024100 >> v2:172.21.15.165:3300/0 conn(0x7f563415a0a0 0x7f5634073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.539+0000 7f5633e00640 1 -- 172.21.15.144:0/3028024100 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 883481422 0 0) 0x7f5634072100 con 0x7f56340736c0 2024-09-11T23:18:17.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.539+0000 7f5633e00640 1 -- 172.21.15.144:0/3028024100 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5618003520 con 0x7f56340736c0 2024-09-11T23:18:17.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.539+0000 7f5639c00640 1 -- 172.21.15.144:0/3028024100 >> v2:172.21.15.165:3300/0 conn(0x7f563415a0a0 msgr2=0x7f5634073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:17.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.539+0000 7f5639c00640 1 --2- 172.21.15.144:0/3028024100 >> v2:172.21.15.165:3300/0 conn(0x7f563415a0a0 0x7f5634073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.539+0000 7f5639c00640 1 -- 172.21.15.144:0/3028024100 >> v1:172.21.15.144:6789/0 conn(0x7f56340736c0 legacy=0x7f56340ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.539+0000 7f5639c00640 1 -- 172.21.15.144:0/3028024100 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5634072980 con 0x7f56340ceb90 2024-09-11T23:18:17.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.539+0000 7f5639200640 1 --2- 172.21.15.144:0/3028024100 >> v2:172.21.15.165:3300/0 conn(0x7f563415a0a0 0x7f5634073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:17.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.540+0000 7f5639c00640 1 --2- 172.21.15.144:0/3028024100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56340ceb90 0x7f56340b1dc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f56340d1160 tx=0x7f562c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d96a815258ff6b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:17.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.540+0000 7f5633e00640 1 -- 172.21.15.144:0/3028024100 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c007740 con 0x7f56340ceb90 2024-09-11T23:18:17.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.540+0000 7f5633e00640 1 -- 172.21.15.144:0/3028024100 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f562c0078e0 con 0x7f56340ceb90 2024-09-11T23:18:17.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.540+0000 7f5633e00640 1 -- 172.21.15.144:0/3028024100 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c007cb0 con 0x7f56340ceb90 2024-09-11T23:18:17.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.541+0000 7f563a600640 1 -- 172.21.15.144:0/3028024100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56340ceb90 msgr2=0x7f56340b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.541+0000 7f563a600640 1 --2- 172.21.15.144:0/3028024100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56340ceb90 0x7f56340b1dc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f56340d1160 tx=0x7f562c02a680 comp rx=0 tx=0).stop 2024-09-11T23:18:17.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.541+0000 7f563a600640 1 -- 172.21.15.144:0/3028024100 shutdown_connections 2024-09-11T23:18:17.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.541+0000 7f563a600640 1 --2- 172.21.15.144:0/3028024100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56340ceb90 0x7f56340b1dc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.541+0000 7f563a600640 1 --2- 172.21.15.144:0/3028024100 >> v2:172.21.15.165:3300/0 conn(0x7f563415a0a0 0x7f5634073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.541+0000 7f563a600640 1 -- 172.21.15.144:0/3028024100 >> 172.21.15.144:0/3028024100 conn(0x7f563406e910 msgr2=0x7f563406bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:17.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.541+0000 7f563a600640 1 -- 172.21.15.144:0/3028024100 shutdown_connections 2024-09-11T23:18:17.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.541+0000 7f563a600640 1 -- 172.21.15.144:0/3028024100 wait complete. 2024-09-11T23:18:17.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.542+0000 7f563a600640 1 Processor -- start 2024-09-11T23:18:17.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.543+0000 7f563a600640 1 -- start start 2024-09-11T23:18:17.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.543+0000 7f563a600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56340ceb90 0x7f5634158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.543+0000 7f563a600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f563415a0a0 0x7f563415de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.544+0000 7f563a600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5634153d60 0x7f563415e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.544+0000 7f563a600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f56340b2690 con 0x7f563415a0a0 2024-09-11T23:18:17.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.544+0000 7f563a600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f56340b2510 con 0x7f5634153d60 2024-09-11T23:18:17.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.544+0000 7f563a600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f56340cf240 con 0x7f56340ceb90 2024-09-11T23:18:17.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.544+0000 7f562be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f563415a0a0 0x7f563415de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.544+0000 7f562be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f563415a0a0 0x7f563415de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46210/0 (socket says 172.21.15.144:46210) 2024-09-11T23:18:17.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.544+0000 7f562be00640 1 -- 172.21.15.144:0/2445494878 learned_addr learned my addr 172.21.15.144:0/2445494878 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:17.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.544+0000 7f5639c00640 1 --2- 172.21.15.144:0/2445494878 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5634153d60 0x7f563415e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.544+0000 7f5639200640 1 --2- 172.21.15.144:0/2445494878 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56340ceb90 0x7f5634158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.544+0000 7f562be00640 1 -- 172.21.15.144:0/2445494878 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56340ceb90 msgr2=0x7f5634158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.544+0000 7f562be00640 1 --2- 172.21.15.144:0/2445494878 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56340ceb90 0x7f5634158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.544+0000 7f562be00640 1 -- 172.21.15.144:0/2445494878 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5634153d60 msgr2=0x7f563415e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.544+0000 7f562be00640 1 --2- 172.21.15.144:0/2445494878 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5634153d60 0x7f563415e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.544+0000 7f562be00640 1 -- 172.21.15.144:0/2445494878 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5634154ae0 con 0x7f563415a0a0 2024-09-11T23:18:17.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.544+0000 7f562be00640 1 --2- 172.21.15.144:0/2445494878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f563415a0a0 0x7f563415de20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f561c00c430 tx=0x7f561c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:17.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.545+0000 7f5631600640 1 -- 172.21.15.144:0/2445494878 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c017070 con 0x7f563415a0a0 2024-09-11T23:18:17.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.545+0000 7f5631600640 1 -- 172.21.15.144:0/2445494878 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f561c005ce0 con 0x7f563415a0a0 2024-09-11T23:18:17.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.545+0000 7f5631600640 1 -- 172.21.15.144:0/2445494878 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c0072f0 con 0x7f563415a0a0 2024-09-11T23:18:17.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.545+0000 7f563a600640 1 -- 172.21.15.144:0/2445494878 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5634154dc0 con 0x7f563415a0a0 2024-09-11T23:18:17.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.545+0000 7f563a600640 1 -- 172.21.15.144:0/2445494878 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5634155380 con 0x7f563415a0a0 2024-09-11T23:18:17.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.546+0000 7f563a600640 1 -- 172.21.15.144:0/2445494878 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56340b1dc0 con 0x7f563415a0a0 2024-09-11T23:18:17.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.547+0000 7f5631600640 1 -- 172.21.15.144:0/2445494878 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f561c01a070 con 0x7f563415a0a0 2024-09-11T23:18:17.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.547+0000 7f5631600640 1 --2- 172.21.15.144:0/2445494878 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f561006be60 0x7f561006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:17.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.548+0000 7f5631600640 1 -- 172.21.15.144:0/2445494878 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f561c08a240 con 0x7f563415a0a0 2024-09-11T23:18:17.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.548+0000 7f5639200640 1 --2- 172.21.15.144:0/2445494878 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f561006be60 0x7f561006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:17.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.548+0000 7f5639200640 1 --2- 172.21.15.144:0/2445494878 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f561006be60 0x7f561006e320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f563415f830 tx=0x7f5624009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:17.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.552+0000 7f5631600640 1 -- 172.21.15.144:0/2445494878 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f561c058500 con 0x7f563415a0a0 2024-09-11T23:18:17.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.760+0000 7f563a600640 1 -- 172.21.15.144:0/2445494878 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f56340cf020 con 0x7f563415a0a0 2024-09-11T23:18:17.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.760+0000 7f5631600640 1 -- 172.21.15.144:0/2445494878 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f561c05c800 con 0x7f563415a0a0 2024-09-11T23:18:17.760 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:18:17.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.762+0000 7f563a600640 1 -- 172.21.15.144:0/2445494878 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f561006be60 msgr2=0x7f561006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.762+0000 7f563a600640 1 --2- 172.21.15.144:0/2445494878 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f561006be60 0x7f561006e320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f563415f830 tx=0x7f5624009190 comp rx=0 tx=0).stop 2024-09-11T23:18:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.762+0000 7f563a600640 1 -- 172.21.15.144:0/2445494878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f563415a0a0 msgr2=0x7f563415de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.762+0000 7f563a600640 1 --2- 172.21.15.144:0/2445494878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f563415a0a0 0x7f563415de20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f561c00c430 tx=0x7f561c00c8f0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.762+0000 7f563a600640 1 -- 172.21.15.144:0/2445494878 shutdown_connections 2024-09-11T23:18:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.762+0000 7f563a600640 1 --2- 172.21.15.144:0/2445494878 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f561006be60 0x7f561006e320 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.762+0000 7f563a600640 1 --2- 172.21.15.144:0/2445494878 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5634153d60 0x7f563415e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.762+0000 7f563a600640 1 --2- 172.21.15.144:0/2445494878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f563415a0a0 0x7f563415de20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.762+0000 7f563a600640 1 --2- 172.21.15.144:0/2445494878 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56340ceb90 0x7f5634158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.762+0000 7f563a600640 1 -- 172.21.15.144:0/2445494878 >> 172.21.15.144:0/2445494878 conn(0x7f563406e910 msgr2=0x7f563406da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.763+0000 7f563a600640 1 -- 172.21.15.144:0/2445494878 shutdown_connections 2024-09-11T23:18:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17.763+0000 7f563a600640 1 -- 172.21.15.144:0/2445494878 wait complete. 2024-09-11T23:18:17.778 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:18:17.778 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:18:17.778 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-11T23:18:17.778 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:18:17.778 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:18:17.778 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:18:17.778 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:18:17.779 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:18:17.779 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:18:17.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:17.779 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-11T23:18:17.814 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:18:17.814 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:18:17.814 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:18:17.814 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:17.814 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-11T23:18:17.814 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:17.815 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:18:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-11T23:18:17.815 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:18:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-11T23:18:17.815 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:18:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:17.815 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:18:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:17.815 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:18:17.816 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42665sec preferred_lft 42665sec 2024-09-11T23:18:17.816 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2024-09-11T23:18:17.816 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:17.817 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T23:18:17.817 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:17.817 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-11T23:18:17.817 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add name ceph-brx type bridge 2024-09-11T23:18:17.817 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr flush dev ceph-brx 2024-09-11T23:18:17.817 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set ceph-brx up 2024-09-11T23:18:17.817 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T23:18:17.817 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-11T23:18:17.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:18.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:18.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:18.235 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:18:18.292 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-11T23:18:18.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:18.295 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-11T23:18:18.347 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-11T23:18:18.347 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:18:18.347 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:18:18.347 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:18:18.347 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:18:18.348 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:18.348 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-11T23:18:18.348 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:18:18.348 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:18:18.348 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:18:18.348 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-11T23:18:18.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:18.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:18.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:18.933 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-11T23:18:18.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:18.970 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list-id 2024-09-11T23:18:19.046 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:19.046 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-11T23:18:19.046 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:18:19.046 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-11T23:18:19.046 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-11T23:18:19.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:19.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:19.225 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-11T23:18:19.225 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:19.225 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-11T23:18:19.225 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-11T23:18:19.225 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T23:18:19.225 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-11T23:18:19.225 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-11T23:18:19.225 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-11T23:18:19.225 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-11T23:18:19.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:19.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:19.470 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:19.470 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-11T23:18:19.470 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-11T23:18:19.470 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T23:18:19.470 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-11T23:18:19.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:19.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:19.636 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:18:19.636 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:18:19.671 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:18:19.672 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:18:19.672 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:18:19.747 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T23:18:19.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:19.747 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:18:19.882 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:18:19.883 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:18:20.550 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:18:20.550 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:18:20.550 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:18:20.550 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:18:20.551 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:18:20.552 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T23:18:20.552 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:18:20.553 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:18:20.553 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:18:20.553 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:18:20.555 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:18:20.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:20.556 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:18:20.613 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:18:20.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:18:20.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:20.713 INFO:teuthology.orchestra.run.smithi144.stdout:client4630 2024-09-11T23:18:20.713 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:18:20.713 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:20.749 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:18:20.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:18:20.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:20.887 INFO:teuthology.orchestra.run.smithi144.stdout:client4630 2024-09-11T23:18:20.888 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:18:20.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:18:20.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:20.985 INFO:teuthology.orchestra.run.smithi144.stdout:client4630 2024-09-11T23:18:20.986 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4b73e4b7-12f0-4e37-94bc-45e333efe84e.client4630/status') 2024-09-11T23:18:21.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:21.092 INFO:teuthology.orchestra.run.smithi144.stdout:instance: client.4630 (3)172.21.15.144:0/122338449 2024-09-11T23:18:21.092 INFO:teuthology.orchestra.run.smithi144.stdout:blocklisted: false 2024-09-11T23:18:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records in 2024-09-11T23:18:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records out 2024-09-11T23:18:21.092 INFO:teuthology.orchestra.run.smithi144.stderr:70 bytes copied, 5.6983e-05 s, 1.2 MB/s 2024-09-11T23:18:21.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:21.102 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-09-11T23:18:21.102 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T23:18:21.102 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-11T23:18:21.103 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:18:21.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.257+0000 7faec2c00640 1 Processor -- start 2024-09-11T23:18:21.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.257+0000 7faec2c00640 1 -- start start 2024-09-11T23:18:21.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.258+0000 7faec2c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faebc0b7740 0x7faebc0d2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:21.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.258+0000 7faec2c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faebc0d1f40 con 0x7faebc0d4ae0 2024-09-11T23:18:21.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.258+0000 7faec2c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faebc0d1c60 con 0x7faebc0d3ff0 2024-09-11T23:18:21.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.258+0000 7faec2c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faebc0cf680 con 0x7faebc0b7740 2024-09-11T23:18:21.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.258+0000 7faec1800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7faebc0d4ae0 0x7faebc0d4ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35474/0 (socket says 172.21.15.144:35474) 2024-09-11T23:18:21.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.258+0000 7faec1800640 1 -- 172.21.15.144:0/3464954528 learned_addr learned my addr 172.21.15.144:0/3464954528 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:21.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.259+0000 7faec0e00640 1 --2- 172.21.15.144:0/3464954528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faebc0b7740 0x7faebc0d2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:21.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.259+0000 7faebbe00640 1 -- 172.21.15.144:0/3464954528 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1079655730 0 0) 0x7faebc0d1f40 con 0x7faebc0d4ae0 2024-09-11T23:18:21.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.259+0000 7faebbe00640 1 -- 172.21.15.144:0/3464954528 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faea4003520 con 0x7faebc0d4ae0 2024-09-11T23:18:21.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.259+0000 7faebbe00640 1 -- 172.21.15.144:0/3464954528 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1650010410 0 0) 0x7faea4003520 con 0x7faebc0d4ae0 2024-09-11T23:18:21.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.259+0000 7faebbe00640 1 -- 172.21.15.144:0/3464954528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faebc0b7740 msgr2=0x7faebc0d2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:21.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.259+0000 7faebbe00640 1 --2- 172.21.15.144:0/3464954528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faebc0b7740 0x7faebc0d2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:21.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.259+0000 7faebbe00640 1 -- 172.21.15.144:0/3464954528 >> v1:172.21.15.165:6789/0 conn(0x7faebc0d3ff0 legacy=0x7faebc0d3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:21.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.259+0000 7faebbe00640 1 -- 172.21.15.144:0/3464954528 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faebc0cf960 con 0x7faebc0d4ae0 2024-09-11T23:18:21.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.259+0000 7faebbe00640 1 -- 172.21.15.144:0/3464954528 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7faeb0001670 con 0x7faebc0d4ae0 2024-09-11T23:18:21.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.259+0000 7faebbe00640 1 -- 172.21.15.144:0/3464954528 >> v1:172.21.15.144:6789/0 conn(0x7faebc0d4ae0 legacy=0x7faebc0d4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:21.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.259+0000 7faebbe00640 1 --2- 172.21.15.144:0/3464954528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faebc0b7740 0x7faea40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:21.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.259+0000 7faebbe00640 1 --2- 172.21.15.144:0/3464954528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faea4003f60 0x7faea4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:21.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.259+0000 7faebbe00640 1 --2- 172.21.15.144:0/3464954528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faea4004d40 0x7faea40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:21.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.259+0000 7faebbe00640 1 -- 172.21.15.144:0/3464954528 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faebc0cf680 con 0x7faea4004d40 2024-09-11T23:18:21.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.259+0000 7faebbe00640 1 -- 172.21.15.144:0/3464954528 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faea400bb50 con 0x7faea4003f60 2024-09-11T23:18:21.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.259+0000 7faebbe00640 1 -- 172.21.15.144:0/3464954528 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faea400bd50 con 0x7faebc0b7740 2024-09-11T23:18:21.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.259+0000 7faec2200640 1 --2- 172.21.15.144:0/3464954528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faea4004d40 0x7faea40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:21.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.259+0000 7faec1800640 1 --2- 172.21.15.144:0/3464954528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faebc0b7740 0x7faea40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:21.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.259+0000 7faec0e00640 1 --2- 172.21.15.144:0/3464954528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faea4003f60 0x7faea4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:21.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.260+0000 7faec1800640 1 -- 172.21.15.144:0/3464954528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faea4003f60 msgr2=0x7faea4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:21.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.260+0000 7faec1800640 1 --2- 172.21.15.144:0/3464954528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faea4003f60 0x7faea4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:21.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.260+0000 7faec1800640 1 -- 172.21.15.144:0/3464954528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faea4004d40 msgr2=0x7faea40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:21.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.260+0000 7faec1800640 1 --2- 172.21.15.144:0/3464954528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faea4004d40 0x7faea40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:21.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.260+0000 7faec1800640 1 -- 172.21.15.144:0/3464954528 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea4003520 con 0x7faebc0b7740 2024-09-11T23:18:21.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.261+0000 7faec1800640 1 --2- 172.21.15.144:0/3464954528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faebc0b7740 0x7faea40039e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faeb000c270 tx=0x7faea4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=123dd4bbe9bc06b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:21.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.261+0000 7faebbe00640 1 -- 172.21.15.144:0/3464954528 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb0007cf0 con 0x7faebc0b7740 2024-09-11T23:18:21.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.261+0000 7faebbe00640 1 -- 172.21.15.144:0/3464954528 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb0005af0 con 0x7faebc0b7740 2024-09-11T23:18:21.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.261+0000 7faebbe00640 1 -- 172.21.15.144:0/3464954528 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb0007070 con 0x7faebc0b7740 2024-09-11T23:18:21.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.262+0000 7faec2c00640 1 -- 172.21.15.144:0/3464954528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faebc0b7740 msgr2=0x7faea40039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:21.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.262+0000 7faec2c00640 1 --2- 172.21.15.144:0/3464954528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faebc0b7740 0x7faea40039e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faeb000c270 tx=0x7faea4005830 comp rx=0 tx=0).stop 2024-09-11T23:18:21.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.262+0000 7faec2200640 1 -- 172.21.15.144:0/3464954528 reap_dead start 2024-09-11T23:18:21.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.262+0000 7faec2c00640 1 -- 172.21.15.144:0/3464954528 shutdown_connections 2024-09-11T23:18:21.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.262+0000 7faec2c00640 1 -- 172.21.15.144:0/3464954528 >> 172.21.15.144:0/3464954528 conn(0x7faebc062a50 msgr2=0x7faebc062e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:21.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.262+0000 7faec2c00640 1 -- 172.21.15.144:0/3464954528 shutdown_connections 2024-09-11T23:18:21.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.262+0000 7faec2c00640 1 -- 172.21.15.144:0/3464954528 wait complete. 2024-09-11T23:18:21.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.263+0000 7faec2c00640 1 Processor -- start 2024-09-11T23:18:21.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.264+0000 7faec2c00640 1 -- start start 2024-09-11T23:18:21.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.264+0000 7faec2c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faebc0b7740 0x7faebc1587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:21.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.265+0000 7faec2c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faebc15fd40 0x7faebc1606e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:21.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.265+0000 7faec2c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faebc158f50 0x7faebc160c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:21.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.265+0000 7faec2c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faebc0d18c0 con 0x7faebc158f50 2024-09-11T23:18:21.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.265+0000 7faec2c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faebc161f10 con 0x7faebc0b7740 2024-09-11T23:18:21.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.265+0000 7faec2c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faebc0d1a40 con 0x7faebc15fd40 2024-09-11T23:18:21.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.265+0000 7faec2200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faebc158f50 0x7faebc160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:21.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.265+0000 7faec2200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faebc158f50 0x7faebc160c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46238/0 (socket says 172.21.15.144:46238) 2024-09-11T23:18:21.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.265+0000 7faec2200640 1 -- 172.21.15.144:0/448653872 learned_addr learned my addr 172.21.15.144:0/448653872 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:21.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.265+0000 7faec1800640 1 --2- 172.21.15.144:0/448653872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faebc0b7740 0x7faebc1587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:21.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.265+0000 7faec0e00640 1 --2- 172.21.15.144:0/448653872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faebc15fd40 0x7faebc1606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:21.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.265+0000 7faec2200640 1 -- 172.21.15.144:0/448653872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faebc15fd40 msgr2=0x7faebc1606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:21.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.265+0000 7faec2200640 1 --2- 172.21.15.144:0/448653872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faebc15fd40 0x7faebc1606e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:21.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.265+0000 7faec2200640 1 -- 172.21.15.144:0/448653872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faebc0b7740 msgr2=0x7faebc1587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:21.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.265+0000 7faec2200640 1 --2- 172.21.15.144:0/448653872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faebc0b7740 0x7faebc1587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:21.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.265+0000 7faec2200640 1 -- 172.21.15.144:0/448653872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faebc158d00 con 0x7faebc158f50 2024-09-11T23:18:21.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.266+0000 7faec2200640 1 --2- 172.21.15.144:0/448653872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faebc158f50 0x7faebc160c20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faebc06cdd0 tx=0x7faeb400fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:21.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.266+0000 7faeb9600640 1 -- 172.21.15.144:0/448653872 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb401a070 con 0x7faebc158f50 2024-09-11T23:18:21.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.266+0000 7faeb9600640 1 -- 172.21.15.144:0/448653872 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb400fe70 con 0x7faebc158f50 2024-09-11T23:18:21.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.266+0000 7faec2c00640 1 -- 172.21.15.144:0/448653872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faebc1602b0 con 0x7faebc158f50 2024-09-11T23:18:21.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.266+0000 7faeb9600640 1 -- 172.21.15.144:0/448653872 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb4003970 con 0x7faebc158f50 2024-09-11T23:18:21.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.266+0000 7faec2c00640 1 -- 172.21.15.144:0/448653872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faebc15f1f0 con 0x7faebc158f50 2024-09-11T23:18:21.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.267+0000 7faec2c00640 1 -- 172.21.15.144:0/448653872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faebc15ed40 con 0x7faebc158f50 2024-09-11T23:18:21.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.268+0000 7faeb9600640 1 -- 172.21.15.144:0/448653872 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faeb401d070 con 0x7faebc158f50 2024-09-11T23:18:21.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.269+0000 7faeb9600640 1 --2- 172.21.15.144:0/448653872 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fae9c06be60 0x7fae9c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:21.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.269+0000 7faeb9600640 1 -- 172.21.15.144:0/448653872 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7faeb408a2a0 con 0x7faebc158f50 2024-09-11T23:18:21.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.269+0000 7faec1800640 1 --2- 172.21.15.144:0/448653872 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fae9c06be60 0x7fae9c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:21.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.270+0000 7faec1800640 1 --2- 172.21.15.144:0/448653872 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fae9c06be60 0x7fae9c06e320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faeb0033000 tx=0x7faeb0009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:21.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.273+0000 7faeb9600640 1 -- 172.21.15.144:0/448653872 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faeb4058560 con 0x7faebc158f50 2024-09-11T23:18:21.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.483+0000 7faec2c00640 1 -- 172.21.15.144:0/448653872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7faebc0b3720 con 0x7faebc158f50 2024-09-11T23:18:21.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.483+0000 7faeb9600640 1 -- 172.21.15.144:0/448653872 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7faeb405c860 con 0x7faebc158f50 2024-09-11T23:18:21.483 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:18:21.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.485+0000 7faec2c00640 1 -- 172.21.15.144:0/448653872 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fae9c06be60 msgr2=0x7fae9c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:21.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.485+0000 7faec2c00640 1 --2- 172.21.15.144:0/448653872 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fae9c06be60 0x7fae9c06e320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faeb0033000 tx=0x7faeb0009030 comp rx=0 tx=0).stop 2024-09-11T23:18:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.485+0000 7faec2c00640 1 -- 172.21.15.144:0/448653872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faebc158f50 msgr2=0x7faebc160c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.485+0000 7faec2c00640 1 --2- 172.21.15.144:0/448653872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faebc158f50 0x7faebc160c20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faebc06cdd0 tx=0x7faeb400fc80 comp rx=0 tx=0).stop 2024-09-11T23:18:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.485+0000 7faec2c00640 1 -- 172.21.15.144:0/448653872 shutdown_connections 2024-09-11T23:18:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.485+0000 7faec2c00640 1 --2- 172.21.15.144:0/448653872 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fae9c06be60 0x7fae9c06e320 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.485+0000 7faec2c00640 1 --2- 172.21.15.144:0/448653872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faebc158f50 0x7faebc160c20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.485+0000 7faec2c00640 1 --2- 172.21.15.144:0/448653872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faebc15fd40 0x7faebc1606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.485+0000 7faec2c00640 1 --2- 172.21.15.144:0/448653872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faebc0b7740 0x7faebc1587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.485+0000 7faec2c00640 1 -- 172.21.15.144:0/448653872 >> 172.21.15.144:0/448653872 conn(0x7faebc062a50 msgr2=0x7faebc062e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.486+0000 7faec2c00640 1 -- 172.21.15.144:0/448653872 shutdown_connections 2024-09-11T23:18:21.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21.486+0000 7faec2c00640 1 -- 172.21.15.144:0/448653872 wait complete. 2024-09-11T23:18:21.501 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:18:21.501 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:18:21.501 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-11T23:18:21.501 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-11T23:18:21.501 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-11T23:18:21.502 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:18:21.502 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:18:21.502 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:18:21.502 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-11T23:18:21.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:21.502 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-11T23:18:21.538 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:18:21.538 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:18:21.538 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:18:21.538 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:21.538 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-11T23:18:21.538 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:21.538 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:18:21.539 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:21.539 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-11T23:18:21.539 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:18:21.539 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:21.539 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-11T23:18:21.539 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:18:21.539 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:21.539 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:18:21.539 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:21.539 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:18:21.539 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42661sec preferred_lft 42661sec 2024-09-11T23:18:21.539 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2024-09-11T23:18:21.539 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:21.539 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:18:21.540 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:21.540 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:18:21.540 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:21.540 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::243b:82ff:fe06:fac9/64 scope link 2024-09-11T23:18:21.540 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:21.540 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:18:21.540 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:18:21.540 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::74ca:30ff:fef2:cddf/64 scope link 2024-09-11T23:18:21.540 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:21.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:21.541 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:18:21.632 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-11T23:18:21.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:21.636 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-11T23:18:21.674 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-11T23:18:21.674 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:18:21.674 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:18:21.674 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:18:21.674 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:18:21.674 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:21.675 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-11T23:18:21.675 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:18:21.675 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:18:21.675 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:18:21.675 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-11T23:18:21.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:21.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:21.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:21.871 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-11T23:18:21.906 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:18:21.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:21.907 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list-id 2024-09-11T23:18:21.981 INFO:teuthology.orchestra.run.smithi144.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-11T23:18:21.982 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:21.982 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-11T23:18:21.982 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:18:21.983 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-11T23:18:21.983 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-11T23:18:22.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:22.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:22.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:22.160 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-11T23:18:22.217 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:18:22.217 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:18:22.217 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:18:22.217 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:22.217 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-11T23:18:22.217 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:22.217 INFO:teuthology.orchestra.run.smithi144.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:18:22.217 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:1d:ca:e2:2f:ef brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T23:18:22.218 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T23:18:22.218 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:22.218 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::741d:caff:fee2:2fef/64 scope link 2024-09-11T23:18:22.218 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:22.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:22.221 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-11T23:18:22.276 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:18:22.277 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:18:22.277 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:18:22.277 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:22.277 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-11T23:18:22.277 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:22.277 INFO:teuthology.orchestra.run.smithi144.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:18:22.277 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:1d:ca:e2:2f:ef brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T23:18:22.277 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T23:18:22.277 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:22.277 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::741d:caff:fee2:2fef/64 scope link 2024-09-11T23:18:22.277 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:22.279 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-11T23:18:22.280 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:22.280 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-11T23:18:22.280 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-11T23:18:22.280 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-11T23:18:22.280 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-11T23:18:22.280 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-11T23:18:22.280 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-11T23:18:22.280 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-11T23:18:22.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:22.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:22.496 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:22.496 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-11T23:18:22.496 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.1 up 2024-09-11T23:18:22.497 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set dev brx.1 master ceph-brx 2024-09-11T23:18:22.497 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-11T23:18:22.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:22.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:22.663 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:18:22.663 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-11T23:18:22.699 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-11T23:18:22.700 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:18:22.700 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-11T23:18:22.774 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-11T23:18:22.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:22.775 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:18:22.904 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:18:22.904 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:18:22.933 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:18:22.933 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:18:22.933 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:18:22.933 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 2@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:18:22.934 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:18:22.936 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-11T23:18:22.936 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:18:22.936 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:18:22.936 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:18:22.936 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:18:22.939 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:18:22.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:22.939 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-11T23:18:22.995 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:18:23.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:18:23.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:23.086 INFO:teuthology.orchestra.run.smithi144.stdout:client4639 2024-09-11T23:18:23.086 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:18:23.086 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:23.122 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:18:23.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:18:23.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:23.252 INFO:teuthology.orchestra.run.smithi144.stdout:client4639 2024-09-11T23:18:23.252 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:18:23.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:18:23.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:23.342 INFO:teuthology.orchestra.run.smithi144.stdout:client4639 2024-09-11T23:18:23.342 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4b73e4b7-12f0-4e37-94bc-45e333efe84e.client4639/status') 2024-09-11T23:18:23.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:23.441 INFO:teuthology.orchestra.run.smithi144.stdout:instance: client.4639 (3)172.21.15.144:0/962448791 2024-09-11T23:18:23.441 INFO:teuthology.orchestra.run.smithi144.stdout:blocklisted: false 2024-09-11T23:18:23.441 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records in 2024-09-11T23:18:23.442 INFO:teuthology.orchestra.run.smithi144.stderr:0+1 records out 2024-09-11T23:18:23.442 INFO:teuthology.orchestra.run.smithi144.stderr:70 bytes copied, 5.1516e-05 s, 1.4 MB/s 2024-09-11T23:18:23.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:23.452 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-09-11T23:18:23.452 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T23:18:23.452 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:18:23.452 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:18:23.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.607+0000 7f3ef3a00640 1 Processor -- start 2024-09-11T23:18:23.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.607+0000 7f3ef3a00640 1 -- start start 2024-09-11T23:18:23.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.608+0000 7f3ef3a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3eec0cf070 0x7f3eec0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:23.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.608+0000 7f3ef3a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3eec073120 0x7f3eec0735b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:23.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.608+0000 7f3ef3a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eec0ce740 con 0x7f3eec15c180 2024-09-11T23:18:23.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.608+0000 7f3ef3a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3eec072640 con 0x7f3eec0cf070 2024-09-11T23:18:23.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.608+0000 7f3ef3a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3eec072920 con 0x7f3eec073120 2024-09-11T23:18:23.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.608+0000 7f3eebe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3eec0cf070 0x7f3eec0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:23.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.608+0000 7f3ef1000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3eec15c180 0x7f3eec0cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35484/0 (socket says 172.21.15.144:35484) 2024-09-11T23:18:23.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.608+0000 7f3ef1000640 1 -- 172.21.15.144:0/3429971940 learned_addr learned my addr 172.21.15.144:0/3429971940 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:23.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.609+0000 7f3ef1a00640 1 --2- 172.21.15.144:0/3429971940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3eec073120 0x7f3eec0735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:23.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.609+0000 7f3eebe00640 1 -- 172.21.15.144:0/3429971940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3eec073120 msgr2=0x7f3eec0735b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:23.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.609+0000 7f3eebe00640 1 --2- 172.21.15.144:0/3429971940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3eec073120 0x7f3eec0735b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.609+0000 7f3eebe00640 1 -- 172.21.15.144:0/3429971940 >> v1:172.21.15.144:6789/0 conn(0x7f3eec15c180 legacy=0x7f3eec0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:23.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.609+0000 7f3eebe00640 1 -- 172.21.15.144:0/3429971940 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eec072c00 con 0x7f3eec0cf070 2024-09-11T23:18:23.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.609+0000 7f3eeb400640 1 -- 172.21.15.144:0/3429971940 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1915798044 0 0) 0x7f3eec0ce740 con 0x7f3eec15c180 2024-09-11T23:18:23.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.610+0000 7f3eebe00640 1 --2- 172.21.15.144:0/3429971940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3eec0cf070 0x7f3eec0cf4e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80097a0 tx=0x7f3ed802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4abcc4c833448d12 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:23.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.610+0000 7f3eeb400640 1 -- 172.21.15.144:0/3429971940 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8037070 con 0x7f3eec0cf070 2024-09-11T23:18:23.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.610+0000 7f3eeb400640 1 -- 172.21.15.144:0/3429971940 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed802ae50 con 0x7f3eec0cf070 2024-09-11T23:18:23.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.610+0000 7f3eeb400640 1 -- 172.21.15.144:0/3429971940 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8032660 con 0x7f3eec0cf070 2024-09-11T23:18:23.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.611+0000 7f3ef3a00640 1 -- 172.21.15.144:0/3429971940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3eec0cf070 msgr2=0x7f3eec0cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:23.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.611+0000 7f3ef3a00640 1 --2- 172.21.15.144:0/3429971940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3eec0cf070 0x7f3eec0cf4e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80097a0 tx=0x7f3ed802a100 comp rx=0 tx=0).stop 2024-09-11T23:18:23.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.611+0000 7f3ef3a00640 1 -- 172.21.15.144:0/3429971940 shutdown_connections 2024-09-11T23:18:23.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.611+0000 7f3ef3a00640 1 --2- 172.21.15.144:0/3429971940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3eec073120 0x7f3eec0735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.611+0000 7f3ef3a00640 1 --2- 172.21.15.144:0/3429971940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3eec0cf070 0x7f3eec0cf4e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.611+0000 7f3ef3a00640 1 -- 172.21.15.144:0/3429971940 >> 172.21.15.144:0/3429971940 conn(0x7f3eec062cc0 msgr2=0x7f3eec06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:23.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.611+0000 7f3ef3a00640 1 -- 172.21.15.144:0/3429971940 shutdown_connections 2024-09-11T23:18:23.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.611+0000 7f3ef3a00640 1 -- 172.21.15.144:0/3429971940 wait complete. 2024-09-11T23:18:23.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.612+0000 7f3ef3a00640 1 Processor -- start 2024-09-11T23:18:23.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.613+0000 7f3ef3a00640 1 -- start start 2024-09-11T23:18:23.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.613+0000 7f3ef3a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3eec073120 0x7f3eec14ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:23.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.613+0000 7f3ef3a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3eec0cf070 0x7f3eec0b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:23.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.613+0000 7f3ef3a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3eec15c180 0x7f3eec0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:23.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.613+0000 7f3ef3a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3eec0722f0 con 0x7f3eec0cf070 2024-09-11T23:18:23.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.613+0000 7f3ef3a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3eec0ced00 con 0x7f3eec15c180 2024-09-11T23:18:23.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.613+0000 7f3ef3a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3eec15c560 con 0x7f3eec073120 2024-09-11T23:18:23.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.614+0000 7f3ef1a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3eec15c180 0x7f3eec0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:23.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.614+0000 7f3ef1000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3eec073120 0x7f3eec14ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:23.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.614+0000 7f3ef1000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3eec073120 0x7f3eec14ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:40170/0 (socket says 172.21.15.144:40170) 2024-09-11T23:18:23.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.614+0000 7f3ef1000640 1 -- 172.21.15.144:0/1715368284 learned_addr learned my addr 172.21.15.144:0/1715368284 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:23.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.614+0000 7f3eebe00640 1 --2- 172.21.15.144:0/1715368284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3eec0cf070 0x7f3eec0b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:23.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.614+0000 7f3ef1000640 1 -- 172.21.15.144:0/1715368284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3eec15c180 msgr2=0x7f3eec0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:23.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.614+0000 7f3ef1000640 1 --2- 172.21.15.144:0/1715368284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3eec15c180 0x7f3eec0ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.614+0000 7f3ef1000640 1 -- 172.21.15.144:0/1715368284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3eec0cf070 msgr2=0x7f3eec0b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:23.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.614+0000 7f3ef1000640 1 --2- 172.21.15.144:0/1715368284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3eec0cf070 0x7f3eec0b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.614+0000 7f3ef1000640 1 -- 172.21.15.144:0/1715368284 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eec0b0590 con 0x7f3eec073120 2024-09-11T23:18:23.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.614+0000 7f3eebe00640 1 --2- 172.21.15.144:0/1715368284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3eec0cf070 0x7f3eec0b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:23.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.615+0000 7f3ef1000640 1 --2- 172.21.15.144:0/1715368284 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3eec073120 0x7f3eec14ba10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000c4a0 tx=0x7f3ee000c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:23.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.615+0000 7f3ee8c00640 1 -- 172.21.15.144:0/1715368284 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0017070 con 0x7f3eec073120 2024-09-11T23:18:23.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.615+0000 7f3ee8c00640 1 -- 172.21.15.144:0/1715368284 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ee0005ce0 con 0x7f3eec073120 2024-09-11T23:18:23.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.615+0000 7f3ee8c00640 1 -- 172.21.15.144:0/1715368284 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee00072b0 con 0x7f3eec073120 2024-09-11T23:18:23.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.615+0000 7f3ef3a00640 1 -- 172.21.15.144:0/1715368284 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eec0b0870 con 0x7f3eec073120 2024-09-11T23:18:23.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.615+0000 7f3ef3a00640 1 -- 172.21.15.144:0/1715368284 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eec0b0e30 con 0x7f3eec073120 2024-09-11T23:18:23.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.616+0000 7f3ef3a00640 1 -- 172.21.15.144:0/1715368284 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eec0cf4e0 con 0x7f3eec073120 2024-09-11T23:18:23.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.617+0000 7f3ee8c00640 1 -- 172.21.15.144:0/1715368284 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ee001a070 con 0x7f3eec073120 2024-09-11T23:18:23.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.618+0000 7f3ee8c00640 1 --2- 172.21.15.144:0/1715368284 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3ecc06be30 0x7f3ecc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:23.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.618+0000 7f3ee8c00640 1 -- 172.21.15.144:0/1715368284 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3ee008a180 con 0x7f3eec073120 2024-09-11T23:18:23.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.618+0000 7f3eebe00640 1 --2- 172.21.15.144:0/1715368284 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3ecc06be30 0x7f3ecc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:23.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.619+0000 7f3eebe00640 1 --2- 172.21.15.144:0/1715368284 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3ecc06be30 0x7f3ecc06e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8034000 tx=0x7f3ed802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:23.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.624+0000 7f3ee8c00640 1 -- 172.21.15.144:0/1715368284 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3ee00584d0 con 0x7f3eec073120 2024-09-11T23:18:23.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.837+0000 7f3ef3a00640 1 -- 172.21.15.144:0/1715368284 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3eec06d4d0 con 0x7f3eec073120 2024-09-11T23:18:23.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.838+0000 7f3ee8c00640 1 -- 172.21.15.144:0/1715368284 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f3ee005c7d0 con 0x7f3eec073120 2024-09-11T23:18:23.838 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:18:23.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.840+0000 7f3ef3a00640 1 -- 172.21.15.144:0/1715368284 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3ecc06be30 msgr2=0x7f3ecc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:23.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.840+0000 7f3ef3a00640 1 --2- 172.21.15.144:0/1715368284 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3ecc06be30 0x7f3ecc06e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8034000 tx=0x7f3ed802e000 comp rx=0 tx=0).stop 2024-09-11T23:18:23.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.840+0000 7f3ef3a00640 1 -- 172.21.15.144:0/1715368284 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3eec073120 msgr2=0x7f3eec14ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:23.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.840+0000 7f3ef3a00640 1 --2- 172.21.15.144:0/1715368284 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3eec073120 0x7f3eec14ba10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000c4a0 tx=0x7f3ee000c960 comp rx=0 tx=0).stop 2024-09-11T23:18:23.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.840+0000 7f3ef3a00640 1 -- 172.21.15.144:0/1715368284 shutdown_connections 2024-09-11T23:18:23.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.840+0000 7f3ef3a00640 1 --2- 172.21.15.144:0/1715368284 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3ecc06be30 0x7f3ecc06e2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.840+0000 7f3ef3a00640 1 --2- 172.21.15.144:0/1715368284 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3eec15c180 0x7f3eec0ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.840+0000 7f3ef3a00640 1 --2- 172.21.15.144:0/1715368284 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3eec0cf070 0x7f3eec0b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.840+0000 7f3ef3a00640 1 --2- 172.21.15.144:0/1715368284 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3eec073120 0x7f3eec14ba10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:23.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.840+0000 7f3ef3a00640 1 -- 172.21.15.144:0/1715368284 >> 172.21.15.144:0/1715368284 conn(0x7f3eec062cc0 msgr2=0x7f3eec159a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:23.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.840+0000 7f3ef3a00640 1 -- 172.21.15.144:0/1715368284 shutdown_connections 2024-09-11T23:18:23.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:23.840+0000 7f3ef3a00640 1 -- 172.21.15.144:0/1715368284 wait complete. 2024-09-11T23:18:23.856 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:18:23.856 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:18:23.856 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi165.front.sepia.ceph.com 2024-09-11T23:18:23.856 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T23:18:23.857 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:18:23.857 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:18:23.857 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:18:23.857 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:18:23.857 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:18:23.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:23.857 DEBUG:teuthology.orchestra.run.smithi165:> ip addr 2024-09-11T23:18:23.897 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:18:23.897 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:18:23.897 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:18:23.897 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:23.897 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-11T23:18:23.897 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:23.897 INFO:teuthology.orchestra.run.smithi165.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:18:23.897 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:94 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:23.898 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f0 2024-09-11T23:18:23.898 INFO:teuthology.orchestra.run.smithi165.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:18:23.898 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:95 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:23.898 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f1 2024-09-11T23:18:23.898 INFO:teuthology.orchestra.run.smithi165.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:18:23.898 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:23.898 INFO:teuthology.orchestra.run.smithi165.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:18:23.898 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:23.898 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.21.15.165/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:18:23.898 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft 42662sec preferred_lft 42662sec 2024-09-11T23:18:23.898 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::ec4:7aff:fe88:7f63/64 scope link noprefixroute 2024-09-11T23:18:23.898 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:23.899 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T23:18:23.899 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:23.899 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-11T23:18:23.899 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link add name ceph-brx type bridge 2024-09-11T23:18:23.899 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip addr flush dev ceph-brx 2024-09-11T23:18:23.899 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set ceph-brx up 2024-09-11T23:18:23.899 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T23:18:23.899 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-11T23:18:24.022 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:24.305 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:24.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:24.316 DEBUG:teuthology.orchestra.run.smithi165:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:18:24.372 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-11T23:18:24.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:24.375 DEBUG:teuthology.orchestra.run.smithi165:> route 2024-09-11T23:18:24.426 INFO:teuthology.orchestra.run.smithi165.stdout:Kernel IP routing table 2024-09-11T23:18:24.426 INFO:teuthology.orchestra.run.smithi165.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:18:24.426 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:18:24.426 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:18:24.426 INFO:teuthology.orchestra.run.smithi165.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:18:24.426 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:24.427 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-11T23:18:24.427 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:18:24.427 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:18:24.427 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:18:24.427 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-11T23:18:24.504 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:25.037 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:25.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:25.045 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-11T23:18:25.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:25.082 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list-id 2024-09-11T23:18:25.156 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:25.156 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-11T23:18:25.157 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:18:25.157 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-11T23:18:25.157 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-11T23:18:25.274 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:25.326 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:25.335 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-11T23:18:25.335 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:25.335 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-11T23:18:25.335 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-11T23:18:25.335 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T23:18:25.335 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-11T23:18:25.335 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-11T23:18:25.335 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-11T23:18:25.335 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-11T23:18:25.413 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:25.565 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:25.574 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:25.574 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-11T23:18:25.574 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set brx.0 up 2024-09-11T23:18:25.574 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T23:18:25.574 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-11T23:18:25.652 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:25.733 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:25.741 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:18:25.741 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T23:18:25.776 INFO:teuthology.orchestra.run.smithi165.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:18:25.777 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:18:25.777 DEBUG:teuthology.orchestra.run.smithi165:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:18:25.852 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-11T23:18:25.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:25.852 DEBUG:teuthology.orchestra.run.smithi165:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:18:25.998 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:18:25.998 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:18:26.596 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:18:26.596 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:18:26.597 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:18:26.597 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: trying mount with new device syntax: 1@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:18:26.597 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:18:26.599 INFO:teuthology.orchestra.run.smithi165.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-11T23:18:26.599 INFO:teuthology.orchestra.run.smithi165.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:18:26.599 INFO:teuthology.orchestra.run.smithi165.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:18:26.600 INFO:teuthology.orchestra.run.smithi165.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:18:26.600 INFO:teuthology.orchestra.run.smithi165.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:18:26.602 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:18:26.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:26.603 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:18:26.659 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:18:26.738 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:18:26.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:26.749 INFO:teuthology.orchestra.run.smithi165.stdout:client4645 2024-09-11T23:18:26.749 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:18:26.750 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:26.785 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:18:26.904 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:18:26.907 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:26.918 INFO:teuthology.orchestra.run.smithi165.stdout:client4645 2024-09-11T23:18:26.918 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:18:26.996 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:18:27.000 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:27.007 INFO:teuthology.orchestra.run.smithi165.stdout:client4645 2024-09-11T23:18:27.007 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4b73e4b7-12f0-4e37-94bc-45e333efe84e.client4645/status') 2024-09-11T23:18:27.085 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:27.107 INFO:teuthology.orchestra.run.smithi165.stdout:instance: client.4645 (3)192.168.0.1:0/2778589389 2024-09-11T23:18:27.107 INFO:teuthology.orchestra.run.smithi165.stdout:blocklisted: false 2024-09-11T23:18:27.107 INFO:teuthology.orchestra.run.smithi165.stderr:0+1 records in 2024-09-11T23:18:27.107 INFO:teuthology.orchestra.run.smithi165.stderr:0+1 records out 2024-09-11T23:18:27.107 INFO:teuthology.orchestra.run.smithi165.stderr:69 bytes copied, 5.1925e-05 s, 1.3 MB/s 2024-09-11T23:18:27.109 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:27.121 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-09-11T23:18:27.121 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T23:18:27.121 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-11T23:18:27.122 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:18:27.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.285+0000 7f0a11400640 1 Processor -- start 2024-09-11T23:18:27.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.285+0000 7f0a11400640 1 -- start start 2024-09-11T23:18:27.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.286+0000 7f0a11400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0a0c0b68d0 0x7f0a0c0cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.286+0000 7f0a11400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0a0c0ced90 0x7f0a0c0b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.287+0000 7f0a11400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a0c0d26f0 con 0x7f0a0c15eac0 2024-09-11T23:18:27.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.287+0000 7f0a11400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0a0c0d29d0 con 0x7f0a0c0ced90 2024-09-11T23:18:27.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.287+0000 7f0a11400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0a0c0d2cb0 con 0x7f0a0c0b68d0 2024-09-11T23:18:27.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.287+0000 7f0a0b200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0a0c0ced90 0x7f0a0c0b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.287+0000 7f0a0b200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0a0c0ced90 0x7f0a0c0b79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60268/0 (socket says 172.21.15.144:60268) 2024-09-11T23:18:27.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.287+0000 7f0a0b200640 1 -- 172.21.15.144:0/1700146872 learned_addr learned my addr 172.21.15.144:0/1700146872 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:27.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.287+0000 7f0a03e00640 1 --2- 172.21.15.144:0/1700146872 >> v2:172.21.15.165:3300/0 conn(0x7f0a0c0b68d0 0x7f0a0c0cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.287+0000 7f0a0b200640 1 -- 172.21.15.144:0/1700146872 >> v2:172.21.15.165:3300/0 conn(0x7f0a0c0b68d0 msgr2=0x7f0a0c0cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:27.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.287+0000 7f0a0b200640 1 --2- 172.21.15.144:0/1700146872 >> v2:172.21.15.165:3300/0 conn(0x7f0a0c0b68d0 0x7f0a0c0cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.287+0000 7f0a0b200640 1 -- 172.21.15.144:0/1700146872 >> v1:172.21.15.165:6789/0 conn(0x7f0a0c15eac0 legacy=0x7f0a0c0b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.287+0000 7f0a0b200640 1 -- 172.21.15.144:0/1700146872 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a0c0d2f90 con 0x7f0a0c0ced90 2024-09-11T23:18:27.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.288+0000 7f0a0b200640 1 --2- 172.21.15.144:0/1700146872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a0c0ced90 0x7f0a0c0b79b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c06ee00 tx=0x7f0a0402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb765abda0a8f6f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:27.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.288+0000 7f0a09e00640 1 -- 172.21.15.144:0/1700146872 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a04036070 con 0x7f0a0c0ced90 2024-09-11T23:18:27.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.288+0000 7f0a09e00640 1 -- 172.21.15.144:0/1700146872 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a04031600 con 0x7f0a0c0ced90 2024-09-11T23:18:27.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.288+0000 7f0a09e00640 1 -- 172.21.15.144:0/1700146872 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a040319d0 con 0x7f0a0c0ced90 2024-09-11T23:18:27.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.289+0000 7f0a11400640 1 -- 172.21.15.144:0/1700146872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a0c0ced90 msgr2=0x7f0a0c0b79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.289+0000 7f0a11400640 1 --2- 172.21.15.144:0/1700146872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a0c0ced90 0x7f0a0c0b79b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c06ee00 tx=0x7f0a0402a730 comp rx=0 tx=0).stop 2024-09-11T23:18:27.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.289+0000 7f0a11400640 1 -- 172.21.15.144:0/1700146872 shutdown_connections 2024-09-11T23:18:27.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.289+0000 7f0a11400640 1 --2- 172.21.15.144:0/1700146872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a0c0ced90 0x7f0a0c0b79b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.289+0000 7f0a11400640 1 --2- 172.21.15.144:0/1700146872 >> v2:172.21.15.165:3300/0 conn(0x7f0a0c0b68d0 0x7f0a0c0cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.289+0000 7f0a11400640 1 -- 172.21.15.144:0/1700146872 >> 172.21.15.144:0/1700146872 conn(0x7f0a0c0d11c0 msgr2=0x7f0a0c0d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:27.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.289+0000 7f0a11400640 1 -- 172.21.15.144:0/1700146872 shutdown_connections 2024-09-11T23:18:27.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.289+0000 7f0a11400640 1 -- 172.21.15.144:0/1700146872 wait complete. 2024-09-11T23:18:27.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.291+0000 7f0a11400640 1 Processor -- start 2024-09-11T23:18:27.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.291+0000 7f0a11400640 1 -- start start 2024-09-11T23:18:27.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.292+0000 7f0a11400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a0c0b68d0 0x7f0a0c0ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.292+0000 7f0a11400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a0c0ced90 0x7f0a0c0cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.292+0000 7f0a11400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a0c15eac0 0x7f0a0c14a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.292+0000 7f0a11400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0a0c0d2490 con 0x7f0a0c0b68d0 2024-09-11T23:18:27.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.292+0000 7f0a11400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0a0c0d2310 con 0x7f0a0c0ced90 2024-09-11T23:18:27.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.292+0000 7f0a11400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0a0c0d3790 con 0x7f0a0c15eac0 2024-09-11T23:18:27.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.292+0000 7f0a0a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a0c0b68d0 0x7f0a0c0ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.292+0000 7f0a0a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a0c0b68d0 0x7f0a0c0ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60272/0 (socket says 172.21.15.144:60272) 2024-09-11T23:18:27.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.292+0000 7f0a0a800640 1 -- 172.21.15.144:0/3618036159 learned_addr learned my addr 172.21.15.144:0/3618036159 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:27.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.292+0000 7f0a03e00640 1 --2- 172.21.15.144:0/3618036159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a0c0ced90 0x7f0a0c0cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.292+0000 7f0a0b200640 1 --2- 172.21.15.144:0/3618036159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a0c15eac0 0x7f0a0c14a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.292+0000 7f0a0a800640 1 -- 172.21.15.144:0/3618036159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a0c15eac0 msgr2=0x7f0a0c14a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.292+0000 7f0a0a800640 1 --2- 172.21.15.144:0/3618036159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a0c15eac0 0x7f0a0c14a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.292+0000 7f0a0a800640 1 -- 172.21.15.144:0/3618036159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a0c0ced90 msgr2=0x7f0a0c0cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.292+0000 7f0a0a800640 1 --2- 172.21.15.144:0/3618036159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a0c0ced90 0x7f0a0c0cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.293+0000 7f0a0a800640 1 -- 172.21.15.144:0/3618036159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a0c0cd3a0 con 0x7f0a0c0b68d0 2024-09-11T23:18:27.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.293+0000 7f0a0a800640 1 --2- 172.21.15.144:0/3618036159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a0c0b68d0 0x7f0a0c0ce440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00c3f0 tx=0x7f09fc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:27.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.293+0000 7f0a02a00640 1 -- 172.21.15.144:0/3618036159 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09fc0052d0 con 0x7f0a0c0b68d0 2024-09-11T23:18:27.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.293+0000 7f0a02a00640 1 -- 172.21.15.144:0/3618036159 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09fc005490 con 0x7f0a0c0b68d0 2024-09-11T23:18:27.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.293+0000 7f0a02a00640 1 -- 172.21.15.144:0/3618036159 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09fc007260 con 0x7f0a0c0b68d0 2024-09-11T23:18:27.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.293+0000 7f0a11400640 1 -- 172.21.15.144:0/3618036159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a0c0cd680 con 0x7f0a0c0b68d0 2024-09-11T23:18:27.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.293+0000 7f0a11400640 1 -- 172.21.15.144:0/3618036159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a0c0cdc40 con 0x7f0a0c0b68d0 2024-09-11T23:18:27.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.294+0000 7f0a11400640 1 -- 172.21.15.144:0/3618036159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a0c0d0d40 con 0x7f0a0c0b68d0 2024-09-11T23:18:27.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.295+0000 7f0a02a00640 1 -- 172.21.15.144:0/3618036159 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f09fc007400 con 0x7f0a0c0b68d0 2024-09-11T23:18:27.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.296+0000 7f0a02a00640 1 --2- 172.21.15.144:0/3618036159 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f09e806be30 0x7f09e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:27.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.296+0000 7f0a02a00640 1 -- 172.21.15.144:0/3618036159 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f09fc08a320 con 0x7f0a0c0b68d0 2024-09-11T23:18:27.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.296+0000 7f0a03e00640 1 --2- 172.21.15.144:0/3618036159 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f09e806be30 0x7f09e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:27.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.297+0000 7f0a03e00640 1 --2- 172.21.15.144:0/3618036159 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f09e806be30 0x7f09e806e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c160d00 tx=0x7f09f4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:27.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.300+0000 7f0a02a00640 1 -- 172.21.15.144:0/3618036159 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0a0c0d0d40 con 0x7f0a0c0b68d0 2024-09-11T23:18:27.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.510+0000 7f0a11400640 1 -- 172.21.15.144:0/3618036159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0a0c0cfc80 con 0x7f0a0c0b68d0 2024-09-11T23:18:27.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.510+0000 7f0a02a00640 1 -- 172.21.15.144:0/3618036159 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f09fc0585e0 con 0x7f0a0c0b68d0 2024-09-11T23:18:27.511 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:18:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.512+0000 7f0a11400640 1 -- 172.21.15.144:0/3618036159 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f09e806be30 msgr2=0x7f09e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.512+0000 7f0a11400640 1 --2- 172.21.15.144:0/3618036159 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f09e806be30 0x7f09e806e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c160d00 tx=0x7f09f4009190 comp rx=0 tx=0).stop 2024-09-11T23:18:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.513+0000 7f0a11400640 1 -- 172.21.15.144:0/3618036159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a0c0b68d0 msgr2=0x7f0a0c0ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.513+0000 7f0a11400640 1 --2- 172.21.15.144:0/3618036159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a0c0b68d0 0x7f0a0c0ce440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00c3f0 tx=0x7f09fc00c8b0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.513+0000 7f0a11400640 1 -- 172.21.15.144:0/3618036159 shutdown_connections 2024-09-11T23:18:27.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.513+0000 7f0a11400640 1 --2- 172.21.15.144:0/3618036159 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f09e806be30 0x7f09e806e2f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.513+0000 7f0a11400640 1 --2- 172.21.15.144:0/3618036159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0a0c15eac0 0x7f0a0c14a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.513+0000 7f0a11400640 1 --2- 172.21.15.144:0/3618036159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a0c0ced90 0x7f0a0c0cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.513+0000 7f0a11400640 1 --2- 172.21.15.144:0/3618036159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a0c0b68d0 0x7f0a0c0ce440 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:27.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.513+0000 7f0a11400640 1 -- 172.21.15.144:0/3618036159 >> 172.21.15.144:0/3618036159 conn(0x7f0a0c0d11c0 msgr2=0x7f0a0c0d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:27.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.513+0000 7f0a11400640 1 -- 172.21.15.144:0/3618036159 shutdown_connections 2024-09-11T23:18:27.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:27.513+0000 7f0a11400640 1 -- 172.21.15.144:0/3618036159 wait complete. 2024-09-11T23:18:27.529 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T23:18:27.529 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:18:27.529 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi165.front.sepia.ceph.com 2024-09-11T23:18:27.529 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-11T23:18:27.530 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-11T23:18:27.530 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T23:18:27.530 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T23:18:27.530 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:18:27.530 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-11T23:18:27.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:27.530 DEBUG:teuthology.orchestra.run.smithi165:> ip addr 2024-09-11T23:18:27.566 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:18:27.566 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:18:27.566 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:18:27.566 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:27.566 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-11T23:18:27.566 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:27.566 INFO:teuthology.orchestra.run.smithi165.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:18:27.566 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:94 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:27.566 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f0 2024-09-11T23:18:27.566 INFO:teuthology.orchestra.run.smithi165.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:18:27.567 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:95 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:27.567 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f1 2024-09-11T23:18:27.567 INFO:teuthology.orchestra.run.smithi165.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:18:27.567 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:27.567 INFO:teuthology.orchestra.run.smithi165.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:18:27.567 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:27.567 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.21.15.165/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:18:27.567 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft 42658sec preferred_lft 42658sec 2024-09-11T23:18:27.567 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::ec4:7aff:fe88:7f63/64 scope link noprefixroute 2024-09-11T23:18:27.567 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:27.567 INFO:teuthology.orchestra.run.smithi165.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:18:27.567 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:18:27.567 INFO:teuthology.orchestra.run.smithi165.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:18:27.567 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:27.568 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::c063:d7ff:fec8:c56c/64 scope link 2024-09-11T23:18:27.568 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:27.568 INFO:teuthology.orchestra.run.smithi165.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:18:27.568 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:18:27.568 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::5478:e4ff:fecd:76c/64 scope link tentative 2024-09-11T23:18:27.568 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:27.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:27.569 DEBUG:teuthology.orchestra.run.smithi165:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:18:27.663 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-11T23:18:27.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:27.667 DEBUG:teuthology.orchestra.run.smithi165:> route 2024-09-11T23:18:27.703 INFO:teuthology.orchestra.run.smithi165.stdout:Kernel IP routing table 2024-09-11T23:18:27.703 INFO:teuthology.orchestra.run.smithi165.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:18:27.704 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:18:27.704 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:18:27.704 INFO:teuthology.orchestra.run.smithi165.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:18:27.704 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:27.704 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-11T23:18:27.704 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:18:27.704 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:18:27.704 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:18:27.704 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-11T23:18:27.820 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:27.891 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:27.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:27.899 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-11T23:18:27.934 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-11T23:18:27.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:27.935 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list-id 2024-09-11T23:18:28.011 INFO:teuthology.orchestra.run.smithi165.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-11T23:18:28.012 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:28.012 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-11T23:18:28.012 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:18:28.012 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-11T23:18:28.012 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-11T23:18:28.128 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:28.178 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:28.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:28.187 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-11T23:18:28.241 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:18:28.242 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:18:28.242 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:18:28.242 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:28.242 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-11T23:18:28.242 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:28.242 INFO:teuthology.orchestra.run.smithi165.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:18:28.242 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 9a:9d:97:d6:97:f2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T23:18:28.242 INFO:teuthology.orchestra.run.smithi165.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T23:18:28.242 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:28.242 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::989d:97ff:fed6:97f2/64 scope link 2024-09-11T23:18:28.242 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:28.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:28.245 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-11T23:18:28.301 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:18:28.301 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:18:28.301 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:18:28.302 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:28.302 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-11T23:18:28.302 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:28.302 INFO:teuthology.orchestra.run.smithi165.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:18:28.302 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 9a:9d:97:d6:97:f2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-11T23:18:28.302 INFO:teuthology.orchestra.run.smithi165.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-11T23:18:28.302 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:28.302 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::989d:97ff:fed6:97f2/64 scope link 2024-09-11T23:18:28.302 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:18:28.304 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-11T23:18:28.304 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:28.304 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-11T23:18:28.305 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-11T23:18:28.305 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-11T23:18:28.305 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-11T23:18:28.305 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-11T23:18:28.305 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-11T23:18:28.305 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-11T23:18:28.383 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:28.513 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:28.521 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:18:28.521 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-11T23:18:28.521 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set brx.1 up 2024-09-11T23:18:28.521 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set dev brx.1 master ceph-brx 2024-09-11T23:18:28.521 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-11T23:18:28.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:28.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:28.687 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:18:28.687 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-11T23:18:28.723 INFO:teuthology.orchestra.run.smithi165.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-11T23:18:28.723 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:18:28.723 DEBUG:teuthology.orchestra.run.smithi165:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-11T23:18:28.802 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-11T23:18:28.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:28.802 DEBUG:teuthology.orchestra.run.smithi165:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:18:28.929 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:18:28.930 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:18:28.957 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:18:28.957 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:18:28.957 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:18:28.957 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: trying mount with new device syntax: 3@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:18:28.957 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:18:28.960 INFO:teuthology.orchestra.run.smithi165.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-11T23:18:28.960 INFO:teuthology.orchestra.run.smithi165.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:18:28.960 INFO:teuthology.orchestra.run.smithi165.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:18:28.960 INFO:teuthology.orchestra.run.smithi165.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:18:28.960 INFO:teuthology.orchestra.run.smithi165.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:18:28.963 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:18:28.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:28.963 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-11T23:18:29.019 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:18:29.097 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:18:29.100 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:29.108 INFO:teuthology.orchestra.run.smithi165.stdout:client4647 2024-09-11T23:18:29.109 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:18:29.109 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:29.144 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:18:29.262 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:18:29.265 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:29.273 INFO:teuthology.orchestra.run.smithi165.stdout:client4647 2024-09-11T23:18:29.273 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:18:29.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:18:29.355 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:29.363 INFO:teuthology.orchestra.run.smithi165.stdout:client4647 2024-09-11T23:18:29.364 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4b73e4b7-12f0-4e37-94bc-45e333efe84e.client4647/status') 2024-09-11T23:18:29.441 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:18:29.462 INFO:teuthology.orchestra.run.smithi165.stdout:instance: client.4647 (3)172.21.15.165:0/1889632120 2024-09-11T23:18:29.462 INFO:teuthology.orchestra.run.smithi165.stdout:blocklisted: false 2024-09-11T23:18:29.463 INFO:teuthology.orchestra.run.smithi165.stderr:0+1 records in 2024-09-11T23:18:29.463 INFO:teuthology.orchestra.run.smithi165.stderr:0+1 records out 2024-09-11T23:18:29.463 INFO:teuthology.orchestra.run.smithi165.stderr:71 bytes copied, 5.8259e-05 s, 1.2 MB/s 2024-09-11T23:18:29.464 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:18:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:18:29.473 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-11T23:18:29.618 INFO:tasks.cephfs_test_runner:Starting test: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate binary .meta file on legacy subvol root doesn't break the system 2024-09-11T23:18:29.618 INFO:tasks.cephfs_test_runner:test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2024-09-11T23:18:29.618 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:18:29.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.774+0000 7f0711e00640 1 Processor -- start 2024-09-11T23:18:29.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.774+0000 7f0711e00640 1 -- start start 2024-09-11T23:18:29.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.775+0000 7f0711e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f070c0d0a50 0x7f070c1620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:29.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.775+0000 7f0711e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f070c0b4930 0x7f070c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.775+0000 7f0711e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f070c1625f0 con 0x7f070c15f620 2024-09-11T23:18:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.775+0000 7f0711e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f070c0b52d0 con 0x7f070c0d0a50 2024-09-11T23:18:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.775+0000 7f0711e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f070c162870 con 0x7f070c0b4930 2024-09-11T23:18:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.776+0000 7f070aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f070c0d0a50 0x7f070c1620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.776+0000 7f070aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f070c0d0a50 0x7f070c1620b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60280/0 (socket says 172.21.15.144:60280) 2024-09-11T23:18:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.776+0000 7f070aa00640 1 -- 172.21.15.144:0/588507834 learned_addr learned my addr 172.21.15.144:0/588507834 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.776+0000 7f070b400640 1 --1- 172.21.15.144:0/588507834 >> v1:172.21.15.144:6789/0 conn(0x7f070c15f620 0x7f070c15fab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58916/0 (socket says 172.21.15.144:58916) 2024-09-11T23:18:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.776+0000 7f070a000640 1 --2- 172.21.15.144:0/588507834 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f070c0b4930 0x7f070c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.776+0000 7f070aa00640 1 -- 172.21.15.144:0/588507834 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f070c0b4930 msgr2=0x7f070c0b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.776+0000 7f070aa00640 1 --2- 172.21.15.144:0/588507834 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f070c0b4930 0x7f070c0b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:29.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.776+0000 7f070aa00640 1 -- 172.21.15.144:0/588507834 >> v1:172.21.15.144:6789/0 conn(0x7f070c15f620 legacy=0x7f070c15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:29.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.776+0000 7f070aa00640 1 -- 172.21.15.144:0/588507834 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070c162b50 con 0x7f070c0d0a50 2024-09-11T23:18:29.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.776+0000 7f0709600640 1 -- 172.21.15.144:0/588507834 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1827253912 0 0) 0x7f0704001490 con 0x7f070c15f620 2024-09-11T23:18:29.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.777+0000 7f070aa00640 1 --2- 172.21.15.144:0/588507834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f070c0d0a50 0x7f070c1620b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f06fc009870 tx=0x7f06fc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc38ed1e09e7997 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:29.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.777+0000 7f0709600640 1 -- 172.21.15.144:0/588507834 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc037070 con 0x7f070c0d0a50 2024-09-11T23:18:29.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.777+0000 7f0709600640 1 -- 172.21.15.144:0/588507834 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06fc032440 con 0x7f070c0d0a50 2024-09-11T23:18:29.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.777+0000 7f0709600640 1 -- 172.21.15.144:0/588507834 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc032810 con 0x7f070c0d0a50 2024-09-11T23:18:29.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.778+0000 7f0711e00640 1 -- 172.21.15.144:0/588507834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f070c0d0a50 msgr2=0x7f070c1620b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:29.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.778+0000 7f0711e00640 1 --2- 172.21.15.144:0/588507834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f070c0d0a50 0x7f070c1620b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f06fc009870 tx=0x7f06fc02a1c0 comp rx=0 tx=0).stop 2024-09-11T23:18:29.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.778+0000 7f0711e00640 1 -- 172.21.15.144:0/588507834 shutdown_connections 2024-09-11T23:18:29.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.778+0000 7f0711e00640 1 --2- 172.21.15.144:0/588507834 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f070c0b4930 0x7f070c0b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:29.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.778+0000 7f0711e00640 1 --2- 172.21.15.144:0/588507834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f070c0d0a50 0x7f070c1620b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:29.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.778+0000 7f0711e00640 1 -- 172.21.15.144:0/588507834 >> 172.21.15.144:0/588507834 conn(0x7f070c062cc0 msgr2=0x7f070c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:29.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.778+0000 7f0711e00640 1 -- 172.21.15.144:0/588507834 shutdown_connections 2024-09-11T23:18:29.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.778+0000 7f0711e00640 1 -- 172.21.15.144:0/588507834 wait complete. 2024-09-11T23:18:29.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.780+0000 7f0711e00640 1 Processor -- start 2024-09-11T23:18:29.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.780+0000 7f0711e00640 1 -- start start 2024-09-11T23:18:29.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.781+0000 7f0711e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f070c0b4930 0x7f070c154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:29.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.781+0000 7f0711e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f070c15f620 0x7f070c15da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:29.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.781+0000 7f0711e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f070c15df40 0x7f070c070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:29.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.781+0000 7f0711e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f070c0b3620 con 0x7f070c0b4930 2024-09-11T23:18:29.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.781+0000 7f0711e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f070c0b3340 con 0x7f070c15f620 2024-09-11T23:18:29.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.781+0000 7f0711e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f070c0b3b40 con 0x7f070c15df40 2024-09-11T23:18:29.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.781+0000 7f070aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f070c0b4930 0x7f070c154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:29.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.781+0000 7f070aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f070c0b4930 0x7f070c154f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60294/0 (socket says 172.21.15.144:60294) 2024-09-11T23:18:29.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.781+0000 7f070aa00640 1 -- 172.21.15.144:0/2174671844 learned_addr learned my addr 172.21.15.144:0/2174671844 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:29.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.781+0000 7f070a000640 1 --2- 172.21.15.144:0/2174671844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f070c15f620 0x7f070c15da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:29.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.781+0000 7f070b400640 1 --2- 172.21.15.144:0/2174671844 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f070c15df40 0x7f070c070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:29.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.781+0000 7f070aa00640 1 -- 172.21.15.144:0/2174671844 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f070c15df40 msgr2=0x7f070c070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:29.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.781+0000 7f070aa00640 1 --2- 172.21.15.144:0/2174671844 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f070c15df40 0x7f070c070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:29.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.781+0000 7f070aa00640 1 -- 172.21.15.144:0/2174671844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f070c15f620 msgr2=0x7f070c15da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:29.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.781+0000 7f070aa00640 1 --2- 172.21.15.144:0/2174671844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f070c15f620 0x7f070c15da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:29.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.781+0000 7f070aa00640 1 -- 172.21.15.144:0/2174671844 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070c071c30 con 0x7f070c0b4930 2024-09-11T23:18:29.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.782+0000 7f070aa00640 1 --2- 172.21.15.144:0/2174671844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f070c0b4930 0x7f070c154f40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f06fc000c00 tx=0x7f06fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:29.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.782+0000 7f0703400640 1 -- 172.21.15.144:0/2174671844 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc037040 con 0x7f070c0b4930 2024-09-11T23:18:29.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.782+0000 7f0703400640 1 -- 172.21.15.144:0/2174671844 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06fc042070 con 0x7f070c0b4930 2024-09-11T23:18:29.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.782+0000 7f0711e00640 1 -- 172.21.15.144:0/2174671844 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f070c071f10 con 0x7f070c0b4930 2024-09-11T23:18:29.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.782+0000 7f0703400640 1 -- 172.21.15.144:0/2174671844 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc030880 con 0x7f070c0b4930 2024-09-11T23:18:29.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.782+0000 7f0711e00640 1 -- 172.21.15.144:0/2174671844 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f070c0724d0 con 0x7f070c0b4930 2024-09-11T23:18:29.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.783+0000 7f0711e00640 1 -- 172.21.15.144:0/2174671844 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f070c15e350 con 0x7f070c0b4930 2024-09-11T23:18:29.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.784+0000 7f0703400640 1 -- 172.21.15.144:0/2174671844 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f06fc02ad10 con 0x7f070c0b4930 2024-09-11T23:18:29.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.785+0000 7f0703400640 1 --2- 172.21.15.144:0/2174671844 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f06ec06be30 0x7f06ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:29.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.785+0000 7f0703400640 1 -- 172.21.15.144:0/2174671844 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f06fc0ab270 con 0x7f070c0b4930 2024-09-11T23:18:29.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.785+0000 7f070a000640 1 --2- 172.21.15.144:0/2174671844 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f06ec06be30 0x7f06ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:29.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.786+0000 7f070a000640 1 --2- 172.21.15.144:0/2174671844 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f06ec06be30 0x7f06ec06e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f070c1f7b40 tx=0x7f06f8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:29.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.790+0000 7f0703400640 1 -- 172.21.15.144:0/2174671844 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f070c15e350 con 0x7f070c0b4930 2024-09-11T23:18:29.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.967+0000 7f0711e00640 1 -- 172.21.15.144:0/2174671844 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f070c0b4d90 con 0x7f070c0b4930 2024-09-11T23:18:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.968+0000 7f0703400640 1 -- 172.21.15.144:0/2174671844 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16689 (secure 0 0 0) 0x7f06fc0795d0 con 0x7f070c0b4930 2024-09-11T23:18:29.969 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:29.969 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":22,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:18:00.633839+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:17:57.023145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:17:58.028864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.971+0000 7f0711e00640 1 -- 172.21.15.144:0/2174671844 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f06ec06be30 msgr2=0x7f06ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.971+0000 7f0711e00640 1 --2- 172.21.15.144:0/2174671844 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f06ec06be30 0x7f06ec06e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f070c1f7b40 tx=0x7f06f8009190 comp rx=0 tx=0).stop 2024-09-11T23:18:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.971+0000 7f0711e00640 1 -- 172.21.15.144:0/2174671844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f070c0b4930 msgr2=0x7f070c154f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.971+0000 7f0711e00640 1 --2- 172.21.15.144:0/2174671844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f070c0b4930 0x7f070c154f40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f06fc000c00 tx=0x7f06fc0046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.971+0000 7f0711e00640 1 -- 172.21.15.144:0/2174671844 shutdown_connections 2024-09-11T23:18:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.971+0000 7f0711e00640 1 --2- 172.21.15.144:0/2174671844 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f06ec06be30 0x7f06ec06e2f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:29.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.971+0000 7f0711e00640 1 --2- 172.21.15.144:0/2174671844 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f070c15df40 0x7f070c070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:29.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.971+0000 7f0711e00640 1 --2- 172.21.15.144:0/2174671844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f070c15f620 0x7f070c15da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:29.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.971+0000 7f0711e00640 1 --2- 172.21.15.144:0/2174671844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f070c0b4930 0x7f070c154f40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:29.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.971+0000 7f0711e00640 1 -- 172.21.15.144:0/2174671844 >> 172.21.15.144:0/2174671844 conn(0x7f070c062cc0 msgr2=0x7f070c15b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:29.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.971+0000 7f0711e00640 1 -- 172.21.15.144:0/2174671844 shutdown_connections 2024-09-11T23:18:29.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:29.971+0000 7f0711e00640 1 -- 172.21.15.144:0/2174671844 wait complete. 2024-09-11T23:18:29.986 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:17:47.307937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T23:17:57.023145+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T23:17:58.028864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:18:29.987 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:18:30.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.143+0000 7fc13ae00640 1 Processor -- start 2024-09-11T23:18:30.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.144+0000 7fc13ae00640 1 -- start start 2024-09-11T23:18:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.145+0000 7fc13ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc13415ed50 0x7fc134143d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.145+0000 7fc13ae00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc1340714d0 0x7fc1340ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.145+0000 7fc13ae00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1341443d0 con 0x7fc134071080 2024-09-11T23:18:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.145+0000 7fc13ae00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc1341446b0 con 0x7fc1340714d0 2024-09-11T23:18:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.145+0000 7fc13ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc134144990 con 0x7fc13415ed50 2024-09-11T23:18:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.145+0000 7fc138e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc1340714d0 0x7fc1340ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.145+0000 7fc138e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc1340714d0 0x7fc1340ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60296/0 (socket says 172.21.15.144:60296) 2024-09-11T23:18:30.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.145+0000 7fc138e00640 1 -- 172.21.15.144:0/967871548 learned_addr learned my addr 172.21.15.144:0/967871548 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:30.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.145+0000 7fc133e00640 1 --2- 172.21.15.144:0/967871548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc13415ed50 0x7fc134143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:30.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.145+0000 7fc138e00640 1 -- 172.21.15.144:0/967871548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc13415ed50 msgr2=0x7fc134143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:30.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.146+0000 7fc138e00640 1 --2- 172.21.15.144:0/967871548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc13415ed50 0x7fc134143d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.146+0000 7fc138e00640 1 -- 172.21.15.144:0/967871548 >> v1:172.21.15.165:6789/0 conn(0x7fc134071080 legacy=0x7fc1340b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:30.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.146+0000 7fc138e00640 1 -- 172.21.15.144:0/967871548 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1340b35c0 con 0x7fc1340714d0 2024-09-11T23:18:30.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.147+0000 7fc138e00640 1 --2- 172.21.15.144:0/967871548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1340714d0 0x7fc1340ae8e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009e50 tx=0x7fc12c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c377ff2ae85cad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:30.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.147+0000 7fc133400640 1 -- 172.21.15.144:0/967871548 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12c036070 con 0x7fc1340714d0 2024-09-11T23:18:30.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.147+0000 7fc133400640 1 -- 172.21.15.144:0/967871548 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc12c031600 con 0x7fc1340714d0 2024-09-11T23:18:30.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.147+0000 7fc133400640 1 -- 172.21.15.144:0/967871548 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12c0319d0 con 0x7fc1340714d0 2024-09-11T23:18:30.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.147+0000 7fc13ae00640 1 -- 172.21.15.144:0/967871548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1340714d0 msgr2=0x7fc1340ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:30.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.147+0000 7fc13ae00640 1 --2- 172.21.15.144:0/967871548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1340714d0 0x7fc1340ae8e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009e50 tx=0x7fc12c02a680 comp rx=0 tx=0).stop 2024-09-11T23:18:30.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.147+0000 7fc13ae00640 1 -- 172.21.15.144:0/967871548 shutdown_connections 2024-09-11T23:18:30.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.147+0000 7fc13ae00640 1 --2- 172.21.15.144:0/967871548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1340714d0 0x7fc1340ae8e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.147+0000 7fc13ae00640 1 --2- 172.21.15.144:0/967871548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc13415ed50 0x7fc134143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.147+0000 7fc13ae00640 1 -- 172.21.15.144:0/967871548 >> 172.21.15.144:0/967871548 conn(0x7fc13406bba0 msgr2=0x7fc13406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:30.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.148+0000 7fc13ae00640 1 -- 172.21.15.144:0/967871548 shutdown_connections 2024-09-11T23:18:30.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.148+0000 7fc13ae00640 1 -- 172.21.15.144:0/967871548 wait complete. 2024-09-11T23:18:30.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.149+0000 7fc13ae00640 1 Processor -- start 2024-09-11T23:18:30.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.149+0000 7fc13ae00640 1 -- start start 2024-09-11T23:18:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.150+0000 7fc13ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc134071080 0x7fc1340b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.150+0000 7fc13ae00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1340714d0 0x7fc134155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.150+0000 7fc13ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc13415ed50 0x7fc134157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.150+0000 7fc13ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc1340aee20 con 0x7fc13415ed50 2024-09-11T23:18:30.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.150+0000 7fc13ae00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc1340b4420 con 0x7fc1340714d0 2024-09-11T23:18:30.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.150+0000 7fc13ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc1340aefa0 con 0x7fc134071080 2024-09-11T23:18:30.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.150+0000 7fc138e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc13415ed50 0x7fc134157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:30.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.150+0000 7fc133e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc134071080 0x7fc1340b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:30.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.150+0000 7fc138e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc13415ed50 0x7fc134157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60302/0 (socket says 172.21.15.144:60302) 2024-09-11T23:18:30.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.150+0000 7fc138e00640 1 -- 172.21.15.144:0/1701106898 learned_addr learned my addr 172.21.15.144:0/1701106898 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:30.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.150+0000 7fc12b400640 1 --2- 172.21.15.144:0/1701106898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1340714d0 0x7fc134155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:30.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.151+0000 7fc138e00640 1 -- 172.21.15.144:0/1701106898 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc134071080 msgr2=0x7fc1340b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:30.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.151+0000 7fc138e00640 1 --2- 172.21.15.144:0/1701106898 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc134071080 0x7fc1340b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.151+0000 7fc138e00640 1 -- 172.21.15.144:0/1701106898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1340714d0 msgr2=0x7fc134155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:30.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.151+0000 7fc138e00640 1 --2- 172.21.15.144:0/1701106898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1340714d0 0x7fc134155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.151+0000 7fc138e00640 1 -- 172.21.15.144:0/1701106898 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc134156ae0 con 0x7fc13415ed50 2024-09-11T23:18:30.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.151+0000 7fc138e00640 1 --2- 172.21.15.144:0/1701106898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc13415ed50 0x7fc134157230 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009f70 tx=0x7fc12c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:30.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.151+0000 7fc130c00640 1 -- 172.21.15.144:0/1701106898 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12c03f020 con 0x7fc13415ed50 2024-09-11T23:18:30.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.151+0000 7fc130c00640 1 -- 172.21.15.144:0/1701106898 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc12c037040 con 0x7fc13415ed50 2024-09-11T23:18:30.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.151+0000 7fc13ae00640 1 -- 172.21.15.144:0/1701106898 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc134156240 con 0x7fc13415ed50 2024-09-11T23:18:30.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.151+0000 7fc130c00640 1 -- 172.21.15.144:0/1701106898 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12c036070 con 0x7fc13415ed50 2024-09-11T23:18:30.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.152+0000 7fc13ae00640 1 -- 172.21.15.144:0/1701106898 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc134156800 con 0x7fc13415ed50 2024-09-11T23:18:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.153+0000 7fc13ae00640 1 -- 172.21.15.144:0/1701106898 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1340ae8e0 con 0x7fc13415ed50 2024-09-11T23:18:30.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.154+0000 7fc130c00640 1 -- 172.21.15.144:0/1701106898 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc12c042020 con 0x7fc13415ed50 2024-09-11T23:18:30.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.154+0000 7fc130c00640 1 --2- 172.21.15.144:0/1701106898 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc11006be30 0x7fc11006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:30.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.154+0000 7fc130c00640 1 -- 172.21.15.144:0/1701106898 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc12c0ab150 con 0x7fc13415ed50 2024-09-11T23:18:30.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.155+0000 7fc133e00640 1 --2- 172.21.15.144:0/1701106898 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc11006be30 0x7fc11006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:30.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.155+0000 7fc133e00640 1 --2- 172.21.15.144:0/1701106898 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc11006be30 0x7fc11006e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc124009b40 tx=0x7fc124009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:30.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.159+0000 7fc130c00640 1 -- 172.21.15.144:0/1701106898 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc12c049030 con 0x7fc13415ed50 2024-09-11T23:18:30.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.333+0000 7fc13ae00640 1 -- 172.21.15.144:0/1701106898 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc1340725a0 con 0x7fc13415ed50 2024-09-11T23:18:30.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.333+0000 7fc130c00640 1 -- 172.21.15.144:0/1701106898 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fc12c0794a0 con 0x7fc13415ed50 2024-09-11T23:18:30.333 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-11T23:18:30.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.336+0000 7fc13ae00640 1 -- 172.21.15.144:0/1701106898 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc11006be30 msgr2=0x7fc11006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:30.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.336+0000 7fc13ae00640 1 --2- 172.21.15.144:0/1701106898 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc11006be30 0x7fc11006e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc124009b40 tx=0x7fc124009190 comp rx=0 tx=0).stop 2024-09-11T23:18:30.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.336+0000 7fc13ae00640 1 -- 172.21.15.144:0/1701106898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc13415ed50 msgr2=0x7fc134157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:30.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.336+0000 7fc13ae00640 1 --2- 172.21.15.144:0/1701106898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc13415ed50 0x7fc134157230 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009f70 tx=0x7fc12c004a40 comp rx=0 tx=0).stop 2024-09-11T23:18:30.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.336+0000 7fc13ae00640 1 -- 172.21.15.144:0/1701106898 shutdown_connections 2024-09-11T23:18:30.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.336+0000 7fc13ae00640 1 --2- 172.21.15.144:0/1701106898 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc11006be30 0x7fc11006e2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.336+0000 7fc13ae00640 1 --2- 172.21.15.144:0/1701106898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc13415ed50 0x7fc134157230 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.336+0000 7fc13ae00640 1 --2- 172.21.15.144:0/1701106898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1340714d0 0x7fc134155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.336+0000 7fc13ae00640 1 --2- 172.21.15.144:0/1701106898 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc134071080 0x7fc1340b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.336+0000 7fc13ae00640 1 -- 172.21.15.144:0/1701106898 >> 172.21.15.144:0/1701106898 conn(0x7fc13406bba0 msgr2=0x7fc13415fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:30.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.336+0000 7fc13ae00640 1 -- 172.21.15.144:0/1701106898 shutdown_connections 2024-09-11T23:18:30.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.336+0000 7fc13ae00640 1 -- 172.21.15.144:0/1701106898 wait complete. 2024-09-11T23:18:30.351 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T23:18:30.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.508+0000 7f3d1f000640 1 Processor -- start 2024-09-11T23:18:30.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.508+0000 7f3d1f000640 1 -- start start 2024-09-11T23:18:30.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.509+0000 7f3d1f000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3d1806bba0 0x7f3d1806bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:30.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.509+0000 7f3d1f000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3d180cc6e0 0x7f3d180cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:30.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.509+0000 7f3d1f000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d1806c4c0 con 0x7f3d180b33b0 2024-09-11T23:18:30.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.509+0000 7f3d1f000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3d180cdea0 con 0x7f3d1806bba0 2024-09-11T23:18:30.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.509+0000 7f3d1f000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3d180ce180 con 0x7f3d180cc6e0 2024-09-11T23:18:30.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.509+0000 7f3d1dc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3d1806bba0 0x7f3d1806bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:30.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.509+0000 7f3d1e600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3d180b33b0 0x7f3d180b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58920/0 (socket says 172.21.15.144:58920) 2024-09-11T23:18:30.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.509+0000 7f3d1e600640 1 -- 172.21.15.144:0/939160048 learned_addr learned my addr 172.21.15.144:0/939160048 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:30.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.510+0000 7f3d1d200640 1 --2- 172.21.15.144:0/939160048 >> v2:172.21.15.165:3300/0 conn(0x7f3d180cc6e0 0x7f3d180cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:30.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.510+0000 7f3d1dc00640 1 -- 172.21.15.144:0/939160048 >> v2:172.21.15.165:3300/0 conn(0x7f3d180cc6e0 msgr2=0x7f3d180cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:30.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.510+0000 7f3d1dc00640 1 --2- 172.21.15.144:0/939160048 >> v2:172.21.15.165:3300/0 conn(0x7f3d180cc6e0 0x7f3d180cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.510+0000 7f3d1dc00640 1 -- 172.21.15.144:0/939160048 >> v1:172.21.15.144:6789/0 conn(0x7f3d180b33b0 legacy=0x7f3d180b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:30.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.510+0000 7f3d1dc00640 1 -- 172.21.15.144:0/939160048 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d180ce460 con 0x7f3d1806bba0 2024-09-11T23:18:30.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.510+0000 7f3d17e00640 1 -- 172.21.15.144:0/939160048 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 57879216 0 0) 0x7f3d1806c4c0 con 0x7f3d180b33b0 2024-09-11T23:18:30.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.511+0000 7f3d1dc00640 1 --2- 172.21.15.144:0/939160048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d1806bba0 0x7f3d1806bf80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3d180afd20 tx=0x7f3d0c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d024f05011a9cd1e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:30.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.511+0000 7f3d17e00640 1 -- 172.21.15.144:0/939160048 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c037070 con 0x7f3d1806bba0 2024-09-11T23:18:30.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.511+0000 7f3d17e00640 1 -- 172.21.15.144:0/939160048 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d0c032440 con 0x7f3d1806bba0 2024-09-11T23:18:30.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.511+0000 7f3d17e00640 1 -- 172.21.15.144:0/939160048 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c032810 con 0x7f3d1806bba0 2024-09-11T23:18:30.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.511+0000 7f3d1f000640 1 -- 172.21.15.144:0/939160048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d1806bba0 msgr2=0x7f3d1806bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:30.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.511+0000 7f3d1f000640 1 --2- 172.21.15.144:0/939160048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d1806bba0 0x7f3d1806bf80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3d180afd20 tx=0x7f3d0c02a250 comp rx=0 tx=0).stop 2024-09-11T23:18:30.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.512+0000 7f3d1f000640 1 -- 172.21.15.144:0/939160048 shutdown_connections 2024-09-11T23:18:30.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.512+0000 7f3d1f000640 1 --2- 172.21.15.144:0/939160048 >> v2:172.21.15.165:3300/0 conn(0x7f3d180cc6e0 0x7f3d180cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.512+0000 7f3d1f000640 1 --2- 172.21.15.144:0/939160048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d1806bba0 0x7f3d1806bf80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.512+0000 7f3d1f000640 1 -- 172.21.15.144:0/939160048 >> 172.21.15.144:0/939160048 conn(0x7f3d180d0300 msgr2=0x7f3d180d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:30.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.512+0000 7f3d1f000640 1 -- 172.21.15.144:0/939160048 shutdown_connections 2024-09-11T23:18:30.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.512+0000 7f3d1f000640 1 -- 172.21.15.144:0/939160048 wait complete. 2024-09-11T23:18:30.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.513+0000 7f3d1f000640 1 Processor -- start 2024-09-11T23:18:30.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.513+0000 7f3d1f000640 1 -- start start 2024-09-11T23:18:30.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.514+0000 7f3d1f000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d1806bba0 0x7f3d1815d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:30.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.514+0000 7f3d1f000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d180b33b0 0x7f3d1815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:30.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.514+0000 7f3d1f000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d180cc6e0 0x7f3d1815e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:30.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.514+0000 7f3d1f000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3d180cdab0 con 0x7f3d180cc6e0 2024-09-11T23:18:30.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.514+0000 7f3d1f000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3d180cea20 con 0x7f3d1806bba0 2024-09-11T23:18:30.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.514+0000 7f3d1f000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3d180cdc30 con 0x7f3d180b33b0 2024-09-11T23:18:30.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.514+0000 7f3d1e600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d180cc6e0 0x7f3d1815e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:30.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.514+0000 7f3d1e600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d180cc6e0 0x7f3d1815e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60326/0 (socket says 172.21.15.144:60326) 2024-09-11T23:18:30.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.515+0000 7f3d1e600640 1 -- 172.21.15.144:0/2899284024 learned_addr learned my addr 172.21.15.144:0/2899284024 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:30.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.515+0000 7f3d1dc00640 1 --2- 172.21.15.144:0/2899284024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d1806bba0 0x7f3d1815d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:30.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.515+0000 7f3d1d200640 1 --2- 172.21.15.144:0/2899284024 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d180b33b0 0x7f3d1815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:30.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.515+0000 7f3d1e600640 1 -- 172.21.15.144:0/2899284024 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d180b33b0 msgr2=0x7f3d1815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:30.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.515+0000 7f3d1e600640 1 --2- 172.21.15.144:0/2899284024 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d180b33b0 0x7f3d1815dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.515+0000 7f3d1e600640 1 -- 172.21.15.144:0/2899284024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d1806bba0 msgr2=0x7f3d1815d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:30.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.515+0000 7f3d1e600640 1 --2- 172.21.15.144:0/2899284024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d1806bba0 0x7f3d1815d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.515+0000 7f3d1e600640 1 -- 172.21.15.144:0/2899284024 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d180b0030 con 0x7f3d180cc6e0 2024-09-11T23:18:30.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.515+0000 7f3d1e600640 1 --2- 172.21.15.144:0/2899284024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d180cc6e0 0x7f3d1815e170 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000c7a0 tx=0x7f3d1000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:30.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.515+0000 7f3d15600640 1 -- 172.21.15.144:0/2899284024 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10018070 con 0x7f3d180cc6e0 2024-09-11T23:18:30.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.515+0000 7f3d15600640 1 -- 172.21.15.144:0/2899284024 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d1000a640 con 0x7f3d180cc6e0 2024-09-11T23:18:30.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.515+0000 7f3d15600640 1 -- 172.21.15.144:0/2899284024 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1000aab0 con 0x7f3d180cc6e0 2024-09-11T23:18:30.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.516+0000 7f3d1f000640 1 -- 172.21.15.144:0/2899284024 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d180b0310 con 0x7f3d180cc6e0 2024-09-11T23:18:30.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.516+0000 7f3d1f000640 1 -- 172.21.15.144:0/2899284024 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d180b08d0 con 0x7f3d180cc6e0 2024-09-11T23:18:30.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.517+0000 7f3d1f000640 1 -- 172.21.15.144:0/2899284024 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d18074250 con 0x7f3d180cc6e0 2024-09-11T23:18:30.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.517+0000 7f3d15600640 1 -- 172.21.15.144:0/2899284024 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d1000ac50 con 0x7f3d180cc6e0 2024-09-11T23:18:30.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.518+0000 7f3d15600640 1 --2- 172.21.15.144:0/2899284024 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3cf806be30 0x7f3cf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:30.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.518+0000 7f3d15600640 1 -- 172.21.15.144:0/2899284024 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3d1008a440 con 0x7f3d180cc6e0 2024-09-11T23:18:30.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.519+0000 7f3d1dc00640 1 --2- 172.21.15.144:0/2899284024 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3cf806be30 0x7f3cf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:30.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.519+0000 7f3d1dc00640 1 --2- 172.21.15.144:0/2899284024 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3cf806be30 0x7f3cf806e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c034000 tx=0x7f3d0c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:30.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.522+0000 7f3d15600640 1 -- 172.21.15.144:0/2899284024 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d10058790 con 0x7f3d180cc6e0 2024-09-11T23:18:30.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.699+0000 7f3d1f000640 1 -- 172.21.15.144:0/2899284024 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3d18151eb0 con 0x7f3d180cc6e0 2024-09-11T23:18:30.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.699+0000 7f3d15600640 1 -- 172.21.15.144:0/2899284024 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f3d1005ca90 con 0x7f3d180cc6e0 2024-09-11T23:18:30.699 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 32 2024-09-11T23:18:30.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.702+0000 7f3d1f000640 1 -- 172.21.15.144:0/2899284024 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3cf806be30 msgr2=0x7f3cf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:30.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.702+0000 7f3d1f000640 1 --2- 172.21.15.144:0/2899284024 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3cf806be30 0x7f3cf806e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c034000 tx=0x7f3d0c02e000 comp rx=0 tx=0).stop 2024-09-11T23:18:30.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.702+0000 7f3d1f000640 1 -- 172.21.15.144:0/2899284024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d180cc6e0 msgr2=0x7f3d1815e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:30.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.702+0000 7f3d1f000640 1 --2- 172.21.15.144:0/2899284024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d180cc6e0 0x7f3d1815e170 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000c7a0 tx=0x7f3d1000cc60 comp rx=0 tx=0).stop 2024-09-11T23:18:30.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.702+0000 7f3d1f000640 1 -- 172.21.15.144:0/2899284024 shutdown_connections 2024-09-11T23:18:30.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.702+0000 7f3d1f000640 1 --2- 172.21.15.144:0/2899284024 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3cf806be30 0x7f3cf806e2f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.702+0000 7f3d1f000640 1 --2- 172.21.15.144:0/2899284024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d180cc6e0 0x7f3d1815e170 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.702+0000 7f3d1f000640 1 --2- 172.21.15.144:0/2899284024 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d180b33b0 0x7f3d1815dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.702+0000 7f3d1f000640 1 --2- 172.21.15.144:0/2899284024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d1806bba0 0x7f3d1815d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.702+0000 7f3d1f000640 1 -- 172.21.15.144:0/2899284024 >> 172.21.15.144:0/2899284024 conn(0x7f3d180d0300 msgr2=0x7f3d180ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:30.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.702+0000 7f3d1f000640 1 -- 172.21.15.144:0/2899284024 shutdown_connections 2024-09-11T23:18:30.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.702+0000 7f3d1f000640 1 -- 172.21.15.144:0/2899284024 wait complete. 2024-09-11T23:18:30.718 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T23:18:30.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.873+0000 7ff4cf200640 1 Processor -- start 2024-09-11T23:18:30.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.873+0000 7ff4cf200640 1 -- start start 2024-09-11T23:18:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.874+0000 7ff4cf200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4d006bba0 0x7ff4d006bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.874+0000 7ff4cf200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff4d00cc6e0 0x7ff4d00cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:30.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.874+0000 7ff4cf200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff4d00b33b0 0x7ff4d00b3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:30.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.874+0000 7ff4cf200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff4d006c4c0 con 0x7ff4d00b33b0 2024-09-11T23:18:30.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.874+0000 7ff4cf200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff4d00cdea0 con 0x7ff4d00cc6e0 2024-09-11T23:18:30.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.874+0000 7ff4cf200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff4d00ce180 con 0x7ff4d006bba0 2024-09-11T23:18:30.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.875+0000 7ff4ce800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff4d00b33b0 0x7ff4d00b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:30.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.875+0000 7ff4ce800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff4d00b33b0 0x7ff4d00b3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60334/0 (socket says 172.21.15.144:60334) 2024-09-11T23:18:30.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.875+0000 7ff4ce800640 1 -- 172.21.15.144:0/4005989362 learned_addr learned my addr 172.21.15.144:0/4005989362 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:30.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.875+0000 7ff4cde00640 1 --2- 172.21.15.144:0/4005989362 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4d006bba0 0x7ff4d006bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:30.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.875+0000 7ff4cd400640 1 --2- 172.21.15.144:0/4005989362 >> v2:172.21.15.165:3300/0 conn(0x7ff4d00cc6e0 0x7ff4d00cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.875+0000 7ff4ce800640 1 -- 172.21.15.144:0/4005989362 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4d006bba0 msgr2=0x7ff4d006bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.875+0000 7ff4ce800640 1 --2- 172.21.15.144:0/4005989362 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4d006bba0 0x7ff4d006bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.875+0000 7ff4ce800640 1 -- 172.21.15.144:0/4005989362 >> v2:172.21.15.165:3300/0 conn(0x7ff4d00cc6e0 msgr2=0x7ff4d00cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.875+0000 7ff4ce800640 1 --2- 172.21.15.144:0/4005989362 >> v2:172.21.15.165:3300/0 conn(0x7ff4d00cc6e0 0x7ff4d00cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.875+0000 7ff4ce800640 1 -- 172.21.15.144:0/4005989362 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d00ce460 con 0x7ff4d00b33b0 2024-09-11T23:18:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.876+0000 7ff4ce800640 1 --2- 172.21.15.144:0/4005989362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4d00b33b0 0x7ff4d00b3840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0069e30 tx=0x7ff4c802c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329c650a28ea0a1a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:30.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.876+0000 7ff4cca00640 1 -- 172.21.15.144:0/4005989362 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c8032430 con 0x7ff4d00b33b0 2024-09-11T23:18:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.876+0000 7ff4cca00640 1 -- 172.21.15.144:0/4005989362 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c8037070 con 0x7ff4d00b33b0 2024-09-11T23:18:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.876+0000 7ff4cca00640 1 -- 172.21.15.144:0/4005989362 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c80327f0 con 0x7ff4d00b33b0 2024-09-11T23:18:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.877+0000 7ff4cf200640 1 -- 172.21.15.144:0/4005989362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4d00b33b0 msgr2=0x7ff4d00b3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.877+0000 7ff4cf200640 1 --2- 172.21.15.144:0/4005989362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4d00b33b0 0x7ff4d00b3840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0069e30 tx=0x7ff4c802c940 comp rx=0 tx=0).stop 2024-09-11T23:18:30.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.877+0000 7ff4cf200640 1 -- 172.21.15.144:0/4005989362 shutdown_connections 2024-09-11T23:18:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.877+0000 7ff4cf200640 1 --2- 172.21.15.144:0/4005989362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4d00b33b0 0x7ff4d00b3840 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.877+0000 7ff4cf200640 1 --2- 172.21.15.144:0/4005989362 >> v2:172.21.15.165:3300/0 conn(0x7ff4d00cc6e0 0x7ff4d00cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.877+0000 7ff4cf200640 1 --2- 172.21.15.144:0/4005989362 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4d006bba0 0x7ff4d006bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.877+0000 7ff4cf200640 1 -- 172.21.15.144:0/4005989362 >> 172.21.15.144:0/4005989362 conn(0x7ff4d00d0300 msgr2=0x7ff4d00d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.877+0000 7ff4cf200640 1 -- 172.21.15.144:0/4005989362 shutdown_connections 2024-09-11T23:18:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.877+0000 7ff4cf200640 1 -- 172.21.15.144:0/4005989362 wait complete. 2024-09-11T23:18:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.879+0000 7ff4cf200640 1 Processor -- start 2024-09-11T23:18:30.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.879+0000 7ff4cf200640 1 -- start start 2024-09-11T23:18:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.880+0000 7ff4cf200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4d006bba0 0x7ff4d0152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.880+0000 7ff4cf200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4d00b33b0 0x7ff4d015b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.880+0000 7ff4cf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4d00cc6e0 0x7ff4d015bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:30.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.880+0000 7ff4cf200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d00cdab0 con 0x7ff4d00cc6e0 2024-09-11T23:18:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.880+0000 7ff4cf200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d00cea20 con 0x7ff4d006bba0 2024-09-11T23:18:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.880+0000 7ff4cf200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff4d00cdc30 con 0x7ff4d00b33b0 2024-09-11T23:18:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.880+0000 7ff4ce800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4d00cc6e0 0x7ff4d015bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.880+0000 7ff4ce800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4d00cc6e0 0x7ff4d015bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60344/0 (socket says 172.21.15.144:60344) 2024-09-11T23:18:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.880+0000 7ff4ce800640 1 -- 172.21.15.144:0/2366680436 learned_addr learned my addr 172.21.15.144:0/2366680436 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.880+0000 7ff4cd400640 1 --2- 172.21.15.144:0/2366680436 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4d00b33b0 0x7ff4d015b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.880+0000 7ff4cde00640 1 --2- 172.21.15.144:0/2366680436 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4d006bba0 0x7ff4d0152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.880+0000 7ff4ce800640 1 -- 172.21.15.144:0/2366680436 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4d00b33b0 msgr2=0x7ff4d015b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.880+0000 7ff4ce800640 1 --2- 172.21.15.144:0/2366680436 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4d00b33b0 0x7ff4d015b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.880+0000 7ff4ce800640 1 -- 172.21.15.144:0/2366680436 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4d006bba0 msgr2=0x7ff4d0152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:30.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.880+0000 7ff4ce800640 1 --2- 172.21.15.144:0/2366680436 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4d006bba0 0x7ff4d0152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:30.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.880+0000 7ff4ce800640 1 -- 172.21.15.144:0/2366680436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d015d760 con 0x7ff4d00cc6e0 2024-09-11T23:18:30.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.881+0000 7ff4ce800640 1 --2- 172.21.15.144:0/2366680436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4d00cc6e0 0x7ff4d015bb60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8034040 tx=0x7ff4c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:30.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.881+0000 7ff4c6000640 1 -- 172.21.15.144:0/2366680436 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c8009510 con 0x7ff4d00cc6e0 2024-09-11T23:18:30.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.881+0000 7ff4c6000640 1 -- 172.21.15.144:0/2366680436 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c803b810 con 0x7ff4d00cc6e0 2024-09-11T23:18:30.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.881+0000 7ff4cf200640 1 -- 172.21.15.144:0/2366680436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4d015da00 con 0x7ff4d00cc6e0 2024-09-11T23:18:30.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.881+0000 7ff4c6000640 1 -- 172.21.15.144:0/2366680436 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c803bc00 con 0x7ff4d00cc6e0 2024-09-11T23:18:30.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.881+0000 7ff4cf200640 1 -- 172.21.15.144:0/2366680436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4d015dfc0 con 0x7ff4d00cc6e0 2024-09-11T23:18:30.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.882+0000 7ff4cf200640 1 -- 172.21.15.144:0/2366680436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4d015b410 con 0x7ff4d00cc6e0 2024-09-11T23:18:30.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.883+0000 7ff4c6000640 1 -- 172.21.15.144:0/2366680436 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff4c803c400 con 0x7ff4d00cc6e0 2024-09-11T23:18:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.884+0000 7ff4c6000640 1 --2- 172.21.15.144:0/2366680436 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff4b006be60 0x7ff4b006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.884+0000 7ff4c6000640 1 -- 172.21.15.144:0/2366680436 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff4c80ae070 con 0x7ff4d00cc6e0 2024-09-11T23:18:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.885+0000 7ff4cde00640 1 --2- 172.21.15.144:0/2366680436 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff4b006be60 0x7ff4b006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:30.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.885+0000 7ff4cde00640 1 --2- 172.21.15.144:0/2366680436 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff4b006be60 0x7ff4b006e320 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009b40 tx=0x7ff4c0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:30.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:30.889+0000 7ff4c6000640 1 -- 172.21.15.144:0/2366680436 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff4c807c3c0 con 0x7ff4d00cc6e0 2024-09-11T23:18:31.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.061+0000 7ff4cf200640 1 -- 172.21.15.144:0/2366680436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff4d00cd170 con 0x7ff4d00cc6e0 2024-09-11T23:18:31.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.062+0000 7ff4c6000640 1 -- 172.21.15.144:0/2366680436 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7ff4c80806c0 con 0x7ff4d00cc6e0 2024-09-11T23:18:31.062 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 64 2024-09-11T23:18:31.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.064+0000 7ff4cf200640 1 -- 172.21.15.144:0/2366680436 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff4b006be60 msgr2=0x7ff4b006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.064+0000 7ff4cf200640 1 --2- 172.21.15.144:0/2366680436 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff4b006be60 0x7ff4b006e320 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009b40 tx=0x7ff4c0009190 comp rx=0 tx=0).stop 2024-09-11T23:18:31.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.064+0000 7ff4cf200640 1 -- 172.21.15.144:0/2366680436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4d00cc6e0 msgr2=0x7ff4d015bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.064+0000 7ff4cf200640 1 --2- 172.21.15.144:0/2366680436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4d00cc6e0 0x7ff4d015bb60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8034040 tx=0x7ff4c8004a40 comp rx=0 tx=0).stop 2024-09-11T23:18:31.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.064+0000 7ff4cf200640 1 -- 172.21.15.144:0/2366680436 shutdown_connections 2024-09-11T23:18:31.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.064+0000 7ff4cf200640 1 --2- 172.21.15.144:0/2366680436 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff4b006be60 0x7ff4b006e320 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.064+0000 7ff4cf200640 1 --2- 172.21.15.144:0/2366680436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4d00cc6e0 0x7ff4d015bb60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.064+0000 7ff4cf200640 1 --2- 172.21.15.144:0/2366680436 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4d00b33b0 0x7ff4d015b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.064+0000 7ff4cf200640 1 --2- 172.21.15.144:0/2366680436 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4d006bba0 0x7ff4d0152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.064+0000 7ff4cf200640 1 -- 172.21.15.144:0/2366680436 >> 172.21.15.144:0/2366680436 conn(0x7ff4d00d0300 msgr2=0x7ff4d0073160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:31.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.064+0000 7ff4cf200640 1 -- 172.21.15.144:0/2366680436 shutdown_connections 2024-09-11T23:18:31.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.064+0000 7ff4cf200640 1 -- 172.21.15.144:0/2366680436 wait complete. 2024-09-11T23:18:31.080 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2024-09-11T23:18:31.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.233+0000 7f76fa800640 1 Processor -- start 2024-09-11T23:18:31.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.233+0000 7f76fa800640 1 -- start start 2024-09-11T23:18:31.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.234+0000 7f76fa800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76f40b6410 0x7f76f40b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.234+0000 7f76fa800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f406bee0 con 0x7f76f40b5fd0 2024-09-11T23:18:31.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.234+0000 7f76fa800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f406c1c0 con 0x7f76f415e640 2024-09-11T23:18:31.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.234+0000 7f76fa800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f76f415ea20 con 0x7f76f40b6410 2024-09-11T23:18:31.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.234+0000 7f76f8a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f76f40b5fd0 0x7f76f40b7750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58924/0 (socket says 172.21.15.144:58924) 2024-09-11T23:18:31.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.234+0000 7f76f8a00640 1 -- 172.21.15.144:0/1857784913 learned_addr learned my addr 172.21.15.144:0/1857784913 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:31.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.235+0000 7f76f9e00640 1 --2- 172.21.15.144:0/1857784913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76f40b6410 0x7f76f40b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.235+0000 7f76f3e00640 1 -- 172.21.15.144:0/1857784913 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4208150850 0 0) 0x7f76f406bee0 con 0x7f76f40b5fd0 2024-09-11T23:18:31.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.235+0000 7f76f3e00640 1 -- 172.21.15.144:0/1857784913 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76dc003520 con 0x7f76f40b5fd0 2024-09-11T23:18:31.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.235+0000 7f76f3e00640 1 -- 172.21.15.144:0/1857784913 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 488234689 0 0) 0x7f76dc003520 con 0x7f76f40b5fd0 2024-09-11T23:18:31.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.235+0000 7f76f3e00640 1 -- 172.21.15.144:0/1857784913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76f40b6410 msgr2=0x7f76f40b7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:31.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.235+0000 7f76f3e00640 1 --2- 172.21.15.144:0/1857784913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76f40b6410 0x7f76f40b7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.235+0000 7f76f3e00640 1 -- 172.21.15.144:0/1857784913 >> v1:172.21.15.165:6789/0 conn(0x7f76f415e640 legacy=0x7f76f40d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.235+0000 7f76f3e00640 1 -- 172.21.15.144:0/1857784913 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f406c4a0 con 0x7f76f40b5fd0 2024-09-11T23:18:31.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.235+0000 7f76f3e00640 1 -- 172.21.15.144:0/1857784913 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f76e0001670 con 0x7f76f40b5fd0 2024-09-11T23:18:31.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.235+0000 7f76f3e00640 1 -- 172.21.15.144:0/1857784913 >> v1:172.21.15.144:6789/0 conn(0x7f76f40b5fd0 legacy=0x7f76f40b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.235+0000 7f76f3e00640 1 --2- 172.21.15.144:0/1857784913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76f40b6410 0x7f76dc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.235+0000 7f76f3e00640 1 --2- 172.21.15.144:0/1857784913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76dc003fb0 0x7f76dc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.235+0000 7f76f3e00640 1 --2- 172.21.15.144:0/1857784913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76dc004d40 0x7f76dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.235+0000 7f76f3e00640 1 -- 172.21.15.144:0/1857784913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc00bad0 con 0x7f76dc003fb0 2024-09-11T23:18:31.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.235+0000 7f76f3e00640 1 -- 172.21.15.144:0/1857784913 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc00bc80 con 0x7f76dc004d40 2024-09-11T23:18:31.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.235+0000 7f76f3e00640 1 -- 172.21.15.144:0/1857784913 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f76dc00be80 con 0x7f76f40b6410 2024-09-11T23:18:31.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.236+0000 7f76f8a00640 1 --2- 172.21.15.144:0/1857784913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76dc003fb0 0x7f76dc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.236+0000 7f76f9400640 1 --2- 172.21.15.144:0/1857784913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76f40b6410 0x7f76dc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.236+0000 7f76f9e00640 1 --2- 172.21.15.144:0/1857784913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76dc004d40 0x7f76dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.236+0000 7f76f8a00640 1 -- 172.21.15.144:0/1857784913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76f40b6410 msgr2=0x7f76dc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:31.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.236+0000 7f76f8a00640 1 --2- 172.21.15.144:0/1857784913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76f40b6410 0x7f76dc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.236+0000 7f76f8a00640 1 -- 172.21.15.144:0/1857784913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76dc004d40 msgr2=0x7f76dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:31.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.236+0000 7f76f8a00640 1 --2- 172.21.15.144:0/1857784913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76dc004d40 0x7f76dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.236+0000 7f76f8a00640 1 -- 172.21.15.144:0/1857784913 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76dc003520 con 0x7f76dc003fb0 2024-09-11T23:18:31.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.236+0000 7f76f9e00640 1 --2- 172.21.15.144:0/1857784913 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76dc004d40 0x7f76dc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:31.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.237+0000 7f76f8a00640 1 --2- 172.21.15.144:0/1857784913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76dc003fb0 0x7f76dc004800 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f76e000c190 tx=0x7f76dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b629270bb6f39f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.237+0000 7f76f3e00640 1 -- 172.21.15.144:0/1857784913 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e0007c60 con 0x7f76dc003fb0 2024-09-11T23:18:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.237+0000 7f76f3e00640 1 -- 172.21.15.144:0/1857784913 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e0005ad0 con 0x7f76dc003fb0 2024-09-11T23:18:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.237+0000 7f76f3e00640 1 -- 172.21.15.144:0/1857784913 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e0007070 con 0x7f76dc003fb0 2024-09-11T23:18:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.238+0000 7f76fa800640 1 -- 172.21.15.144:0/1857784913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76dc003fb0 msgr2=0x7f76dc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.238+0000 7f76fa800640 1 --2- 172.21.15.144:0/1857784913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76dc003fb0 0x7f76dc004800 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f76e000c190 tx=0x7f76dc005830 comp rx=0 tx=0).stop 2024-09-11T23:18:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.238+0000 7f76f9e00640 1 -- 172.21.15.144:0/1857784913 reap_dead start 2024-09-11T23:18:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.238+0000 7f76fa800640 1 -- 172.21.15.144:0/1857784913 shutdown_connections 2024-09-11T23:18:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.238+0000 7f76fa800640 1 -- 172.21.15.144:0/1857784913 >> 172.21.15.144:0/1857784913 conn(0x7f76f40d0fd0 msgr2=0x7f76f40d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.238+0000 7f76fa800640 1 -- 172.21.15.144:0/1857784913 shutdown_connections 2024-09-11T23:18:31.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.238+0000 7f76fa800640 1 -- 172.21.15.144:0/1857784913 wait complete. 2024-09-11T23:18:31.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.240+0000 7f76fa800640 1 Processor -- start 2024-09-11T23:18:31.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.240+0000 7f76fa800640 1 -- start start 2024-09-11T23:18:31.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.241+0000 7f76fa800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76dc003fb0 0x7f76f415b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.241+0000 7f76fa800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f40ac0f0 0x7f76f41f73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.241+0000 7f76fa800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76f41f7900 0x7f76f40ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.241+0000 7f76fa800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f76f40b68a0 con 0x7f76f40ac0f0 2024-09-11T23:18:31.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.241+0000 7f76fa800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f76f406caf0 con 0x7f76f41f7900 2024-09-11T23:18:31.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.241+0000 7f76fa800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f76f40d4130 con 0x7f76dc003fb0 2024-09-11T23:18:31.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.241+0000 7f76f8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f40ac0f0 0x7f76f41f73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.241+0000 7f76f8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f40ac0f0 0x7f76f41f73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60350/0 (socket says 172.21.15.144:60350) 2024-09-11T23:18:31.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.241+0000 7f76f8a00640 1 -- 172.21.15.144:0/1003303338 learned_addr learned my addr 172.21.15.144:0/1003303338 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:31.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.241+0000 7f76f9400640 1 --2- 172.21.15.144:0/1003303338 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76dc003fb0 0x7f76f415b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.241+0000 7f76f9e00640 1 --2- 172.21.15.144:0/1003303338 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76f41f7900 0x7f76f40ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.241+0000 7f76f8a00640 1 -- 172.21.15.144:0/1003303338 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76dc003fb0 msgr2=0x7f76f415b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.241+0000 7f76f8a00640 1 --2- 172.21.15.144:0/1003303338 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76dc003fb0 0x7f76f415b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.241+0000 7f76f8a00640 1 -- 172.21.15.144:0/1003303338 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76f41f7900 msgr2=0x7f76f40ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:31.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.241+0000 7f76f8a00640 1 --2- 172.21.15.144:0/1003303338 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76f41f7900 0x7f76f40ad6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:31.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.241+0000 7f76f8a00640 1 -- 172.21.15.144:0/1003303338 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f415b920 con 0x7f76f40ac0f0 2024-09-11T23:18:31.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.242+0000 7f76f8a00640 1 --2- 172.21.15.144:0/1003303338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f40ac0f0 0x7f76f41f73c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f76e000c1f0 tx=0x7f76e0001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:31.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.242+0000 7f76f1600640 1 -- 172.21.15.144:0/1003303338 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e0041020 con 0x7f76f40ac0f0 2024-09-11T23:18:31.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.242+0000 7f76f1600640 1 -- 172.21.15.144:0/1003303338 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e0005e40 con 0x7f76f40ac0f0 2024-09-11T23:18:31.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.242+0000 7f76fa800640 1 -- 172.21.15.144:0/1003303338 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f40ce820 con 0x7f76f40ac0f0 2024-09-11T23:18:31.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.242+0000 7f76f1600640 1 -- 172.21.15.144:0/1003303338 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e0007070 con 0x7f76f40ac0f0 2024-09-11T23:18:31.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.242+0000 7f76fa800640 1 -- 172.21.15.144:0/1003303338 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f40ab330 con 0x7f76f40ac0f0 2024-09-11T23:18:31.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.243+0000 7f76fa800640 1 -- 172.21.15.144:0/1003303338 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76f40d3a20 con 0x7f76f40ac0f0 2024-09-11T23:18:31.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.244+0000 7f76f1600640 1 -- 172.21.15.144:0/1003303338 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76e0044020 con 0x7f76f40ac0f0 2024-09-11T23:18:31.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.245+0000 7f76f1600640 1 --2- 172.21.15.144:0/1003303338 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f76d406be30 0x7f76d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:31.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.245+0000 7f76f1600640 1 -- 172.21.15.144:0/1003303338 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f76e00ab4e0 con 0x7f76f40ac0f0 2024-09-11T23:18:31.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.245+0000 7f76f9400640 1 --2- 172.21.15.144:0/1003303338 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f76d406be30 0x7f76d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:31.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.246+0000 7f76f9400640 1 --2- 172.21.15.144:0/1003303338 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f76d406be30 0x7f76d406e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f76e8000c00 tx=0x7f76e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:31.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.249+0000 7f76f1600640 1 -- 172.21.15.144:0/1003303338 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76e004b020 con 0x7f76f40ac0f0 2024-09-11T23:18:31.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:31.489+0000 7f76fa800640 1 -- 172.21.15.144:0/1003303338 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7f76f40b7700 con 0x7f76f40ac0f0 2024-09-11T23:18:32.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.297+0000 7f76f1600640 1 -- 172.21.15.144:0/1003303338 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v50) ==== 161+0+0 (secure 0 0 0) 0x7f76f40ce820 con 0x7f76f40ac0f0 2024-09-11T23:18:32.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.299+0000 7f76fa800640 1 -- 172.21.15.144:0/1003303338 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f76d406be30 msgr2=0x7f76d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.299+0000 7f76fa800640 1 --2- 172.21.15.144:0/1003303338 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f76d406be30 0x7f76d406e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f76e8000c00 tx=0x7f76e8009040 comp rx=0 tx=0).stop 2024-09-11T23:18:32.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.299+0000 7f76fa800640 1 -- 172.21.15.144:0/1003303338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f40ac0f0 msgr2=0x7f76f41f73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.299+0000 7f76fa800640 1 --2- 172.21.15.144:0/1003303338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f40ac0f0 0x7f76f41f73c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f76e000c1f0 tx=0x7f76e0001970 comp rx=0 tx=0).stop 2024-09-11T23:18:32.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.299+0000 7f76fa800640 1 -- 172.21.15.144:0/1003303338 shutdown_connections 2024-09-11T23:18:32.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.299+0000 7f76fa800640 1 --2- 172.21.15.144:0/1003303338 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f76d406be30 0x7f76d406e2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.299+0000 7f76fa800640 1 --2- 172.21.15.144:0/1003303338 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76f41f7900 0x7f76f40ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.299+0000 7f76fa800640 1 --2- 172.21.15.144:0/1003303338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f40ac0f0 0x7f76f41f73c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.299+0000 7f76fa800640 1 --2- 172.21.15.144:0/1003303338 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76dc003fb0 0x7f76f415b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.300+0000 7f76fa800640 1 -- 172.21.15.144:0/1003303338 >> 172.21.15.144:0/1003303338 conn(0x7f76f40d0fd0 msgr2=0x7f76f40b90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:32.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.300+0000 7f76fa800640 1 -- 172.21.15.144:0/1003303338 shutdown_connections 2024-09-11T23:18:32.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.300+0000 7f76fa800640 1 -- 172.21.15.144:0/1003303338 wait complete. 2024-09-11T23:18:32.318 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:18:32.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.474+0000 7ff41aa00640 1 Processor -- start 2024-09-11T23:18:32.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.474+0000 7ff41aa00640 1 -- start start 2024-09-11T23:18:32.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.475+0000 7ff41aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff41415e390 0x7ff41406c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.475+0000 7ff41aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4140b5f50 0x7ff4140b6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.475+0000 7ff41aa00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4140b68b0 con 0x7ff414161fb0 2024-09-11T23:18:32.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.475+0000 7ff41aa00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff4140d20a0 con 0x7ff41415e390 2024-09-11T23:18:32.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.475+0000 7ff41aa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff4140ced30 con 0x7ff4140b5f50 2024-09-11T23:18:32.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.475+0000 7ff419600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff41415e390 0x7ff41406c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.475+0000 7ff419600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff41415e390 0x7ff41406c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60360/0 (socket says 172.21.15.144:60360) 2024-09-11T23:18:32.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.475+0000 7ff419600640 1 -- 172.21.15.144:0/3807109868 learned_addr learned my addr 172.21.15.144:0/3807109868 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:32.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.475+0000 7ff41a000640 1 --1- 172.21.15.144:0/3807109868 >> v1:172.21.15.144:6789/0 conn(0x7ff414161fb0 0x7ff414162460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58930/0 (socket says 172.21.15.144:58930) 2024-09-11T23:18:32.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.476+0000 7ff418c00640 1 --2- 172.21.15.144:0/3807109868 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4140b5f50 0x7ff4140b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.476+0000 7ff419600640 1 -- 172.21.15.144:0/3807109868 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4140b5f50 msgr2=0x7ff4140b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:32.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.476+0000 7ff419600640 1 --2- 172.21.15.144:0/3807109868 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4140b5f50 0x7ff4140b6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.476+0000 7ff419600640 1 -- 172.21.15.144:0/3807109868 >> v1:172.21.15.144:6789/0 conn(0x7ff414161fb0 legacy=0x7ff414162460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.476+0000 7ff419600640 1 -- 172.21.15.144:0/3807109868 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4140cf010 con 0x7ff41415e390 2024-09-11T23:18:32.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.476+0000 7ff413e00640 1 -- 172.21.15.144:0/3807109868 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1188943059 0 0) 0x7ff4140b68b0 con 0x7ff414161fb0 2024-09-11T23:18:32.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.477+0000 7ff419600640 1 --2- 172.21.15.144:0/3807109868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff41415e390 0x7ff41406c8e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff4080098a0 tx=0x7ff40802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6038ff14fb02e45e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:32.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.477+0000 7ff413e00640 1 -- 172.21.15.144:0/3807109868 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff408037070 con 0x7ff41415e390 2024-09-11T23:18:32.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.477+0000 7ff413e00640 1 -- 172.21.15.144:0/3807109868 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff408032440 con 0x7ff41415e390 2024-09-11T23:18:32.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.477+0000 7ff413e00640 1 -- 172.21.15.144:0/3807109868 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff408032810 con 0x7ff41415e390 2024-09-11T23:18:32.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.478+0000 7ff41aa00640 1 -- 172.21.15.144:0/3807109868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff41415e390 msgr2=0x7ff41406c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.478+0000 7ff41aa00640 1 --2- 172.21.15.144:0/3807109868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff41415e390 0x7ff41406c8e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff4080098a0 tx=0x7ff40802a290 comp rx=0 tx=0).stop 2024-09-11T23:18:32.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.478+0000 7ff41aa00640 1 -- 172.21.15.144:0/3807109868 shutdown_connections 2024-09-11T23:18:32.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.478+0000 7ff41aa00640 1 --2- 172.21.15.144:0/3807109868 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4140b5f50 0x7ff4140b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.478+0000 7ff41aa00640 1 --2- 172.21.15.144:0/3807109868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff41415e390 0x7ff41406c8e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.478+0000 7ff41aa00640 1 -- 172.21.15.144:0/3807109868 >> 172.21.15.144:0/3807109868 conn(0x7ff4140d1130 msgr2=0x7ff4140d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:32.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.478+0000 7ff41aa00640 1 -- 172.21.15.144:0/3807109868 shutdown_connections 2024-09-11T23:18:32.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.478+0000 7ff41aa00640 1 -- 172.21.15.144:0/3807109868 wait complete. 2024-09-11T23:18:32.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.479+0000 7ff41aa00640 1 Processor -- start 2024-09-11T23:18:32.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.479+0000 7ff41aa00640 1 -- start start 2024-09-11T23:18:32.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.480+0000 7ff41aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4140b5f50 0x7ff41414c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.480+0000 7ff41aa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff41415e390 0x7ff41415fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.480+0000 7ff41aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff414161fb0 0x7ff414161380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.480+0000 7ff41aa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff4140cf8b0 con 0x7ff4140b5f50 2024-09-11T23:18:32.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.480+0000 7ff41aa00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff4140cf5d0 con 0x7ff41415e390 2024-09-11T23:18:32.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.480+0000 7ff41aa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff41415e770 con 0x7ff414161fb0 2024-09-11T23:18:32.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.480+0000 7ff419600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4140b5f50 0x7ff41414c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.481+0000 7ff419600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4140b5f50 0x7ff41414c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60362/0 (socket says 172.21.15.144:60362) 2024-09-11T23:18:32.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.481+0000 7ff419600640 1 -- 172.21.15.144:0/2475604479 learned_addr learned my addr 172.21.15.144:0/2475604479 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:32.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.481+0000 7ff41a000640 1 --2- 172.21.15.144:0/2475604479 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff414161fb0 0x7ff414161380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.481+0000 7ff418c00640 1 --2- 172.21.15.144:0/2475604479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff41415e390 0x7ff41415fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.481+0000 7ff419600640 1 -- 172.21.15.144:0/2475604479 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff414161fb0 msgr2=0x7ff414161380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.481+0000 7ff419600640 1 --2- 172.21.15.144:0/2475604479 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff414161fb0 0x7ff414161380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.481+0000 7ff419600640 1 -- 172.21.15.144:0/2475604479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff41415e390 msgr2=0x7ff41415fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.481+0000 7ff419600640 1 --2- 172.21.15.144:0/2475604479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff41415e390 0x7ff41415fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.481+0000 7ff419600640 1 -- 172.21.15.144:0/2475604479 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41415ebb0 con 0x7ff4140b5f50 2024-09-11T23:18:32.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.481+0000 7ff418c00640 1 --2- 172.21.15.144:0/2475604479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff41415e390 0x7ff41415fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:32.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.481+0000 7ff419600640 1 --2- 172.21.15.144:0/2475604479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4140b5f50 0x7ff41414c7c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff408000c00 tx=0x7ff4080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:32.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.481+0000 7ff411600640 1 -- 172.21.15.144:0/2475604479 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff408037040 con 0x7ff4140b5f50 2024-09-11T23:18:32.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.482+0000 7ff411600640 1 -- 172.21.15.144:0/2475604479 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff408042070 con 0x7ff4140b5f50 2024-09-11T23:18:32.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.482+0000 7ff411600640 1 -- 172.21.15.144:0/2475604479 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff408030880 con 0x7ff4140b5f50 2024-09-11T23:18:32.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.482+0000 7ff41aa00640 1 -- 172.21.15.144:0/2475604479 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff41415ee90 con 0x7ff4140b5f50 2024-09-11T23:18:32.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.482+0000 7ff41aa00640 1 -- 172.21.15.144:0/2475604479 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff41415f450 con 0x7ff4140b5f50 2024-09-11T23:18:32.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.483+0000 7ff41aa00640 1 -- 172.21.15.144:0/2475604479 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4140b6370 con 0x7ff4140b5f50 2024-09-11T23:18:32.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.483+0000 7ff411600640 1 -- 172.21.15.144:0/2475604479 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff408030a20 con 0x7ff4140b5f50 2024-09-11T23:18:32.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.484+0000 7ff411600640 1 --2- 172.21.15.144:0/2475604479 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff3f406be60 0x7ff3f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:32.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.484+0000 7ff411600640 1 -- 172.21.15.144:0/2475604479 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff4080ab700 con 0x7ff4140b5f50 2024-09-11T23:18:32.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.485+0000 7ff418c00640 1 --2- 172.21.15.144:0/2475604479 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff3f406be60 0x7ff3f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:32.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.485+0000 7ff418c00640 1 --2- 172.21.15.144:0/2475604479 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff3f406be60 0x7ff3f406e320 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff4141f7930 tx=0x7ff400008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:32.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.489+0000 7ff411600640 1 -- 172.21.15.144:0/2475604479 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff40807a0a0 con 0x7ff4140b5f50 2024-09-11T23:18:32.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.662+0000 7ff41aa00640 1 -- 172.21.15.144:0/2475604479 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff414073760 con 0x7ff4140b5f50 2024-09-11T23:18:32.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.666+0000 7ff411600640 1 -- 172.21.15.144:0/2475604479 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7ff4080799a0 con 0x7ff4140b5f50 2024-09-11T23:18:32.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.668+0000 7ff41aa00640 1 -- 172.21.15.144:0/2475604479 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff3f406be60 msgr2=0x7ff3f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.668+0000 7ff41aa00640 1 --2- 172.21.15.144:0/2475604479 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff3f406be60 0x7ff3f406e320 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff4141f7930 tx=0x7ff400008040 comp rx=0 tx=0).stop 2024-09-11T23:18:32.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.668+0000 7ff41aa00640 1 -- 172.21.15.144:0/2475604479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4140b5f50 msgr2=0x7ff41414c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:32.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.668+0000 7ff41aa00640 1 --2- 172.21.15.144:0/2475604479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4140b5f50 0x7ff41414c7c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff408000c00 tx=0x7ff4080046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.668+0000 7ff41aa00640 1 -- 172.21.15.144:0/2475604479 shutdown_connections 2024-09-11T23:18:32.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.668+0000 7ff41aa00640 1 --2- 172.21.15.144:0/2475604479 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff3f406be60 0x7ff3f406e320 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.668+0000 7ff41aa00640 1 --2- 172.21.15.144:0/2475604479 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff414161fb0 0x7ff414161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.668+0000 7ff41aa00640 1 --2- 172.21.15.144:0/2475604479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff41415e390 0x7ff41415fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.668+0000 7ff41aa00640 1 --2- 172.21.15.144:0/2475604479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4140b5f50 0x7ff41414c7c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:32.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.668+0000 7ff41aa00640 1 -- 172.21.15.144:0/2475604479 >> 172.21.15.144:0/2475604479 conn(0x7ff4140d1130 msgr2=0x7ff4140d1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:32.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.668+0000 7ff41aa00640 1 -- 172.21.15.144:0/2475604479 shutdown_connections 2024-09-11T23:18:32.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:32.668+0000 7ff41aa00640 1 -- 172.21.15.144:0/2475604479 wait complete. 2024-09-11T23:18:32.684 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:18:32.684 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:18:32.788 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:18:32.891 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:18:32.891 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:18:32.891 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:32.928 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:18:32.928 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:33.004 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:18:33.004 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:33.079 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:18:33.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.274+0000 7fa695200640 1 Processor -- start 2024-09-11T23:18:33.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.274+0000 7fa695200640 1 -- start start 2024-09-11T23:18:33.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.275+0000 7fa695200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa69015e640 0x7fa6900d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:33.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.275+0000 7fa695200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa6900b66e0 0x7fa6900b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:33.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.275+0000 7fa695200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa69006bee0 con 0x7fa6900d3f60 2024-09-11T23:18:33.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.275+0000 7fa695200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa69015ea20 con 0x7fa69015e640 2024-09-11T23:18:33.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.275+0000 7fa695200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa69006caf0 con 0x7fa6900b66e0 2024-09-11T23:18:33.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.275+0000 7fa68f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa69015e640 0x7fa6900d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:33.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.275+0000 7fa68f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa69015e640 0x7fa6900d3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60374/0 (socket says 172.21.15.144:60374) 2024-09-11T23:18:33.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.276+0000 7fa68f400640 1 -- 172.21.15.144:0/1534857681 learned_addr learned my addr 172.21.15.144:0/1534857681 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:33.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.276+0000 7fa68fe00640 1 --2- 172.21.15.144:0/1534857681 >> v2:172.21.15.165:3300/0 conn(0x7fa6900b66e0 0x7fa6900b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:33.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.276+0000 7fa68f400640 1 -- 172.21.15.144:0/1534857681 >> v2:172.21.15.165:3300/0 conn(0x7fa6900b66e0 msgr2=0x7fa6900b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:33.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.276+0000 7fa68f400640 1 --2- 172.21.15.144:0/1534857681 >> v2:172.21.15.165:3300/0 conn(0x7fa6900b66e0 0x7fa6900b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.276+0000 7fa68f400640 1 -- 172.21.15.144:0/1534857681 >> v1:172.21.15.165:6789/0 conn(0x7fa6900d3f60 legacy=0x7fa6900b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:33.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.276+0000 7fa68f400640 1 -- 172.21.15.144:0/1534857681 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69006c1c0 con 0x7fa69015e640 2024-09-11T23:18:33.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.277+0000 7fa68f400640 1 --2- 172.21.15.144:0/1534857681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa69015e640 0x7fa6900d3a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa6900d26e0 tx=0x7fa68002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49820c8b4c04132d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:33.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.277+0000 7fa68e000640 1 -- 172.21.15.144:0/1534857681 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa680037070 con 0x7fa69015e640 2024-09-11T23:18:33.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.277+0000 7fa68e000640 1 -- 172.21.15.144:0/1534857681 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa680032440 con 0x7fa69015e640 2024-09-11T23:18:33.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.277+0000 7fa68e000640 1 -- 172.21.15.144:0/1534857681 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa680032810 con 0x7fa69015e640 2024-09-11T23:18:33.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.278+0000 7fa695200640 1 -- 172.21.15.144:0/1534857681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa69015e640 msgr2=0x7fa6900d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:33.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.278+0000 7fa695200640 1 --2- 172.21.15.144:0/1534857681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa69015e640 0x7fa6900d3a20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa6900d26e0 tx=0x7fa68002a270 comp rx=0 tx=0).stop 2024-09-11T23:18:33.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.278+0000 7fa695200640 1 -- 172.21.15.144:0/1534857681 shutdown_connections 2024-09-11T23:18:33.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.278+0000 7fa695200640 1 --2- 172.21.15.144:0/1534857681 >> v2:172.21.15.165:3300/0 conn(0x7fa6900b66e0 0x7fa6900b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.278+0000 7fa695200640 1 --2- 172.21.15.144:0/1534857681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa69015e640 0x7fa6900d3a20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.278+0000 7fa695200640 1 -- 172.21.15.144:0/1534857681 >> 172.21.15.144:0/1534857681 conn(0x7fa6900d0fd0 msgr2=0x7fa6900d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:33.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.278+0000 7fa695200640 1 -- 172.21.15.144:0/1534857681 shutdown_connections 2024-09-11T23:18:33.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.278+0000 7fa695200640 1 -- 172.21.15.144:0/1534857681 wait complete. 2024-09-11T23:18:33.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.279+0000 7fa695200640 1 Processor -- start 2024-09-11T23:18:33.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.280+0000 7fa695200640 1 -- start start 2024-09-11T23:18:33.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.280+0000 7fa695200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6900b66e0 0x7fa6901e7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:33.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.280+0000 7fa695200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6900d3f60 0x7fa69015d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:33.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.280+0000 7fa695200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa69015e640 0x7fa6901f4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:33.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.280+0000 7fa695200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa6900b7c90 con 0x7fa6900d3f60 2024-09-11T23:18:33.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.280+0000 7fa695200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa69006c780 con 0x7fa6900b66e0 2024-09-11T23:18:33.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.280+0000 7fa695200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa6900b7e10 con 0x7fa69015e640 2024-09-11T23:18:33.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.281+0000 7fa68ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6900d3f60 0x7fa69015d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:33.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.281+0000 7fa68ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6900d3f60 0x7fa69015d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60376/0 (socket says 172.21.15.144:60376) 2024-09-11T23:18:33.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.281+0000 7fa68ea00640 1 -- 172.21.15.144:0/1291162529 learned_addr learned my addr 172.21.15.144:0/1291162529 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:33.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.281+0000 7fa68fe00640 1 --2- 172.21.15.144:0/1291162529 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa69015e640 0x7fa6901f4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:33.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.281+0000 7fa68f400640 1 --2- 172.21.15.144:0/1291162529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6900b66e0 0x7fa6901e7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:33.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.281+0000 7fa68ea00640 1 -- 172.21.15.144:0/1291162529 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa69015e640 msgr2=0x7fa6901f4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:33.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.281+0000 7fa68ea00640 1 --2- 172.21.15.144:0/1291162529 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa69015e640 0x7fa6901f4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.281+0000 7fa68ea00640 1 -- 172.21.15.144:0/1291162529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6900b66e0 msgr2=0x7fa6901e7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:33.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.281+0000 7fa68ea00640 1 --2- 172.21.15.144:0/1291162529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6900b66e0 0x7fa6901e7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.281+0000 7fa68ea00640 1 -- 172.21.15.144:0/1291162529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6901e8380 con 0x7fa6900d3f60 2024-09-11T23:18:33.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.281+0000 7fa68ea00640 1 --2- 172.21.15.144:0/1291162529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6900d3f60 0x7fa69015d570 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00c400 tx=0x7fa67c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:33.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.282+0000 7fa687400640 1 -- 172.21.15.144:0/1291162529 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67c0052d0 con 0x7fa6900d3f60 2024-09-11T23:18:33.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.282+0000 7fa687400640 1 -- 172.21.15.144:0/1291162529 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa67c005490 con 0x7fa6900d3f60 2024-09-11T23:18:33.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.282+0000 7fa687400640 1 -- 172.21.15.144:0/1291162529 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67c007260 con 0x7fa6900d3f60 2024-09-11T23:18:33.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.282+0000 7fa695200640 1 -- 172.21.15.144:0/1291162529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6901e8660 con 0x7fa6900d3f60 2024-09-11T23:18:33.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.282+0000 7fa695200640 1 -- 172.21.15.144:0/1291162529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6901e8c20 con 0x7fa6900d3f60 2024-09-11T23:18:33.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.283+0000 7fa695200640 1 -- 172.21.15.144:0/1291162529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6900b7750 con 0x7fa6900d3f60 2024-09-11T23:18:33.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.284+0000 7fa687400640 1 -- 172.21.15.144:0/1291162529 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa67c007400 con 0x7fa6900d3f60 2024-09-11T23:18:33.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.285+0000 7fa687400640 1 --2- 172.21.15.144:0/1291162529 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa67006be30 0x7fa67006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:33.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.285+0000 7fa687400640 1 -- 172.21.15.144:0/1291162529 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa67c08a390 con 0x7fa6900d3f60 2024-09-11T23:18:33.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.285+0000 7fa68f400640 1 --2- 172.21.15.144:0/1291162529 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa67006be30 0x7fa67006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:33.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.286+0000 7fa68f400640 1 --2- 172.21.15.144:0/1291162529 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa67006be30 0x7fa67006e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa680034000 tx=0x7fa68002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:33.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.289+0000 7fa687400640 1 -- 172.21.15.144:0/1291162529 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa67c058650 con 0x7fa6900d3f60 2024-09-11T23:18:33.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.475+0000 7fa695200640 1 -- 172.21.15.144:0/1291162529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa6900b3720 con 0x7fa6900d3f60 2024-09-11T23:18:33.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.476+0000 7fa687400640 1 -- 172.21.15.144:0/1291162529 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fa67c05c950 con 0x7fa6900d3f60 2024-09-11T23:18:33.476 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:18:33.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.478+0000 7fa695200640 1 -- 172.21.15.144:0/1291162529 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa67006be30 msgr2=0x7fa67006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:33.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.478+0000 7fa695200640 1 --2- 172.21.15.144:0/1291162529 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa67006be30 0x7fa67006e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa680034000 tx=0x7fa68002e000 comp rx=0 tx=0).stop 2024-09-11T23:18:33.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.478+0000 7fa695200640 1 -- 172.21.15.144:0/1291162529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6900d3f60 msgr2=0x7fa69015d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:33.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.478+0000 7fa695200640 1 --2- 172.21.15.144:0/1291162529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6900d3f60 0x7fa69015d570 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00c400 tx=0x7fa67c00c8c0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.478+0000 7fa695200640 1 -- 172.21.15.144:0/1291162529 shutdown_connections 2024-09-11T23:18:33.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.478+0000 7fa695200640 1 --2- 172.21.15.144:0/1291162529 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa67006be30 0x7fa67006e2f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.478+0000 7fa695200640 1 --2- 172.21.15.144:0/1291162529 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa69015e640 0x7fa6901f4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.478+0000 7fa695200640 1 --2- 172.21.15.144:0/1291162529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6900d3f60 0x7fa69015d570 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.478+0000 7fa695200640 1 --2- 172.21.15.144:0/1291162529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6900b66e0 0x7fa6901e7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.478+0000 7fa695200640 1 -- 172.21.15.144:0/1291162529 >> 172.21.15.144:0/1291162529 conn(0x7fa6900d0fd0 msgr2=0x7fa6900d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:33.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.478+0000 7fa695200640 1 -- 172.21.15.144:0/1291162529 shutdown_connections 2024-09-11T23:18:33.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.478+0000 7fa695200640 1 -- 172.21.15.144:0/1291162529 wait complete. 2024-09-11T23:18:33.494 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T23:18:33.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:33.494 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-11T23:18:33.557 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:18:33.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:33.557 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:18:33.606 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:18:33.606 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:33.646 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:18:33.646 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:33.726 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:18:33.726 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:33.804 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:18:33.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.959+0000 7f3e0d600640 1 Processor -- start 2024-09-11T23:18:33.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.959+0000 7f3e0d600640 1 -- start start 2024-09-11T23:18:33.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.961+0000 7f3e0d600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e0815ca40 0x7f3e0815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:33.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.961+0000 7f3e0d600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3e0815ce80 0x7f3e081594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:33.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.961+0000 7f3e0d600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e0815d390 con 0x7f3e080d02a0 2024-09-11T23:18:33.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.961+0000 7f3e0d600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3e0815d670 con 0x7f3e0815ce80 2024-09-11T23:18:33.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.961+0000 7f3e0d600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3e0815d950 con 0x7f3e0815ca40 2024-09-11T23:18:33.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.961+0000 7f3e06a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3e080d02a0 0x7f3e080d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58932/0 (socket says 172.21.15.144:58932) 2024-09-11T23:18:33.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.961+0000 7f3e06a00640 1 -- 172.21.15.144:0/1481780872 learned_addr learned my addr 172.21.15.144:0/1481780872 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:33.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.961+0000 7f3e06000640 1 --2- 172.21.15.144:0/1481780872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e0815ca40 0x7f3e0815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:33.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.961+0000 7f3e07400640 1 --2- 172.21.15.144:0/1481780872 >> v2:172.21.15.165:3300/0 conn(0x7f3e0815ce80 0x7f3e081594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:33.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.961+0000 7f3e05600640 1 -- 172.21.15.144:0/1481780872 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3367768759 0 0) 0x7f3e0815d390 con 0x7f3e080d02a0 2024-09-11T23:18:33.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.961+0000 7f3e05600640 1 -- 172.21.15.144:0/1481780872 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dec005730 con 0x7f3e080d02a0 2024-09-11T23:18:33.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e05600640 1 -- 172.21.15.144:0/1481780872 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3639068715 0 0) 0x7f3dec005730 con 0x7f3e080d02a0 2024-09-11T23:18:33.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e05600640 1 -- 172.21.15.144:0/1481780872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e0815ca40 msgr2=0x7f3e0815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e05600640 1 --2- 172.21.15.144:0/1481780872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e0815ca40 0x7f3e0815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e05600640 1 -- 172.21.15.144:0/1481780872 >> v2:172.21.15.165:3300/0 conn(0x7f3e0815ce80 msgr2=0x7f3e081594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e05600640 1 --2- 172.21.15.144:0/1481780872 >> v2:172.21.15.165:3300/0 conn(0x7f3e0815ce80 0x7f3e081594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e05600640 1 -- 172.21.15.144:0/1481780872 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0815dc30 con 0x7f3e080d02a0 2024-09-11T23:18:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e05600640 1 -- 172.21.15.144:0/1481780872 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f3df8001670 con 0x7f3e080d02a0 2024-09-11T23:18:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e06000640 1 --2- 172.21.15.144:0/1481780872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e0815ca40 0x7f3e0815e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e05600640 1 -- 172.21.15.144:0/1481780872 >> v1:172.21.15.144:6789/0 conn(0x7f3e080d02a0 legacy=0x7f3e080d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e05600640 1 --2- 172.21.15.144:0/1481780872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dec005bc0 0x7f3dec005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:33.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e05600640 1 --2- 172.21.15.144:0/1481780872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dec006a10 0x7f3dec006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e05600640 1 --2- 172.21.15.144:0/1481780872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e0815ca40 0x7f3dec0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e05600640 1 -- 172.21.15.144:0/1481780872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0815d670 con 0x7f3dec005bc0 2024-09-11T23:18:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e05600640 1 -- 172.21.15.144:0/1481780872 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0815d950 con 0x7f3dec006a10 2024-09-11T23:18:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e05600640 1 -- 172.21.15.144:0/1481780872 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3dec00dbd0 con 0x7f3e0815ca40 2024-09-11T23:18:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e06a00640 1 --2- 172.21.15.144:0/1481780872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dec005bc0 0x7f3dec005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e06000640 1 --2- 172.21.15.144:0/1481780872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dec006a10 0x7f3dec006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e07400640 1 --2- 172.21.15.144:0/1481780872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e0815ca40 0x7f3dec0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e06a00640 1 -- 172.21.15.144:0/1481780872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e0815ca40 msgr2=0x7f3dec0073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e06a00640 1 --2- 172.21.15.144:0/1481780872 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e0815ca40 0x7f3dec0073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e06a00640 1 -- 172.21.15.144:0/1481780872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dec006a10 msgr2=0x7f3dec006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e06a00640 1 --2- 172.21.15.144:0/1481780872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dec006a10 0x7f3dec006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.962+0000 7f3e06a00640 1 -- 172.21.15.144:0/1481780872 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dec005730 con 0x7f3dec005bc0 2024-09-11T23:18:33.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.963+0000 7f3e06a00640 1 --2- 172.21.15.144:0/1481780872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dec005bc0 0x7f3dec005fe0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3df800c210 tx=0x7f3dec007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3bb028206601c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:33.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.964+0000 7f3e05600640 1 -- 172.21.15.144:0/1481780872 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8007d50 con 0x7f3dec005bc0 2024-09-11T23:18:33.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.964+0000 7f3e05600640 1 -- 172.21.15.144:0/1481780872 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df8005af0 con 0x7f3dec005bc0 2024-09-11T23:18:33.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.964+0000 7f3e05600640 1 -- 172.21.15.144:0/1481780872 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8007070 con 0x7f3dec005bc0 2024-09-11T23:18:33.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.964+0000 7f3e0d600640 1 -- 172.21.15.144:0/1481780872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dec005bc0 msgr2=0x7f3dec005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:33.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.964+0000 7f3e0d600640 1 --2- 172.21.15.144:0/1481780872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dec005bc0 0x7f3dec005fe0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3df800c210 tx=0x7f3dec007a40 comp rx=0 tx=0).stop 2024-09-11T23:18:33.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.964+0000 7f3e07400640 1 -- 172.21.15.144:0/1481780872 reap_dead start 2024-09-11T23:18:33.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.964+0000 7f3e0d600640 1 -- 172.21.15.144:0/1481780872 shutdown_connections 2024-09-11T23:18:33.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.964+0000 7f3e0d600640 1 -- 172.21.15.144:0/1481780872 >> 172.21.15.144:0/1481780872 conn(0x7f3e08062cc0 msgr2=0x7f3e0806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:33.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.964+0000 7f3e0d600640 1 -- 172.21.15.144:0/1481780872 shutdown_connections 2024-09-11T23:18:33.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.964+0000 7f3e0d600640 1 -- 172.21.15.144:0/1481780872 wait complete. 2024-09-11T23:18:33.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.966+0000 7f3e0d600640 1 Processor -- start 2024-09-11T23:18:33.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.966+0000 7f3e0d600640 1 -- start start 2024-09-11T23:18:33.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.967+0000 7f3e0d600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dec005bc0 0x7f3e080cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:33.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.967+0000 7f3e0d600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e080cd6e0 0x7f3e080b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:33.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.967+0000 7f3e0d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e080b26c0 0x7f3e081f6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:33.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.967+0000 7f3e0d600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3e08155d10 con 0x7f3e080b26c0 2024-09-11T23:18:33.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.967+0000 7f3e0d600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3e08155b90 con 0x7f3dec005bc0 2024-09-11T23:18:33.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.967+0000 7f3e0d600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3e080b4790 con 0x7f3e080cd6e0 2024-09-11T23:18:33.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.967+0000 7f3e07400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e080b26c0 0x7f3e081f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:33.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.967+0000 7f3e07400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e080b26c0 0x7f3e081f6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60380/0 (socket says 172.21.15.144:60380) 2024-09-11T23:18:33.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.967+0000 7f3e07400640 1 -- 172.21.15.144:0/1500632895 learned_addr learned my addr 172.21.15.144:0/1500632895 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:33.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.967+0000 7f3e06a00640 1 --2- 172.21.15.144:0/1500632895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dec005bc0 0x7f3e080cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:33.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.967+0000 7f3e06000640 1 --2- 172.21.15.144:0/1500632895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e080cd6e0 0x7f3e080b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:33.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.968+0000 7f3e07400640 1 -- 172.21.15.144:0/1500632895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e080cd6e0 msgr2=0x7f3e080b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:33.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.968+0000 7f3e07400640 1 --2- 172.21.15.144:0/1500632895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e080cd6e0 0x7f3e080b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.968+0000 7f3e07400640 1 -- 172.21.15.144:0/1500632895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dec005bc0 msgr2=0x7f3e080cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:33.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.968+0000 7f3e07400640 1 --2- 172.21.15.144:0/1500632895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dec005bc0 0x7f3e080cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:33.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.968+0000 7f3e07400640 1 -- 172.21.15.144:0/1500632895 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e081f5360 con 0x7f3e080b26c0 2024-09-11T23:18:33.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.968+0000 7f3e06a00640 1 --2- 172.21.15.144:0/1500632895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dec005bc0 0x7f3e080cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:33.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.968+0000 7f3e07400640 1 --2- 172.21.15.144:0/1500632895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e080b26c0 0x7f3e081f6400 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3e080b52b0 tx=0x7f3e000115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:33.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.968+0000 7f3dfea00640 1 -- 172.21.15.144:0/1500632895 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00011db0 con 0x7f3e080b26c0 2024-09-11T23:18:33.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.968+0000 7f3dfea00640 1 -- 172.21.15.144:0/1500632895 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e0001b070 con 0x7f3e080b26c0 2024-09-11T23:18:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.968+0000 7f3e0d600640 1 -- 172.21.15.144:0/1500632895 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e081f5640 con 0x7f3e080b26c0 2024-09-11T23:18:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.968+0000 7f3dfea00640 1 -- 172.21.15.144:0/1500632895 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00003990 con 0x7f3e080b26c0 2024-09-11T23:18:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.968+0000 7f3e0d600640 1 -- 172.21.15.144:0/1500632895 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e081f5c00 con 0x7f3e080b26c0 2024-09-11T23:18:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.969+0000 7f3e0d600640 1 -- 172.21.15.144:0/1500632895 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e080d0680 con 0x7f3e080b26c0 2024-09-11T23:18:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.970+0000 7f3dfea00640 1 -- 172.21.15.144:0/1500632895 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e00005d10 con 0x7f3e080b26c0 2024-09-11T23:18:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.971+0000 7f3dfea00640 1 --2- 172.21.15.144:0/1500632895 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3de806be60 0x7f3de806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.971+0000 7f3dfea00640 1 -- 172.21.15.144:0/1500632895 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3e0008b3e0 con 0x7f3e080b26c0 2024-09-11T23:18:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.971+0000 7f3e06a00640 1 --2- 172.21.15.144:0/1500632895 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3de806be60 0x7f3de806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.972+0000 7f3e06a00640 1 --2- 172.21.15.144:0/1500632895 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3de806be60 0x7f3de806e320 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3df8033000 tx=0x7f3df8009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:33.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:33.975+0000 7f3dfea00640 1 -- 172.21.15.144:0/1500632895 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e00025020 con 0x7f3e080b26c0 2024-09-11T23:18:34.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.161+0000 7f3e0d600640 1 -- 172.21.15.144:0/1500632895 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3e0806d280 con 0x7f3e080b26c0 2024-09-11T23:18:34.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.162+0000 7f3dfea00640 1 -- 172.21.15.144:0/1500632895 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f3e00059cf0 con 0x7f3e080b26c0 2024-09-11T23:18:34.162 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:18:34.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.164+0000 7f3e0d600640 1 -- 172.21.15.144:0/1500632895 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3de806be60 msgr2=0x7f3de806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:34.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.164+0000 7f3e0d600640 1 --2- 172.21.15.144:0/1500632895 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3de806be60 0x7f3de806e320 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3df8033000 tx=0x7f3df8009030 comp rx=0 tx=0).stop 2024-09-11T23:18:34.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.164+0000 7f3e0d600640 1 -- 172.21.15.144:0/1500632895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e080b26c0 msgr2=0x7f3e081f6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:34.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.164+0000 7f3e0d600640 1 --2- 172.21.15.144:0/1500632895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e080b26c0 0x7f3e081f6400 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3e080b52b0 tx=0x7f3e000115a0 comp rx=0 tx=0).stop 2024-09-11T23:18:34.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.164+0000 7f3e0d600640 1 -- 172.21.15.144:0/1500632895 shutdown_connections 2024-09-11T23:18:34.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.164+0000 7f3e0d600640 1 --2- 172.21.15.144:0/1500632895 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3de806be60 0x7f3de806e320 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:34.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.164+0000 7f3e0d600640 1 --2- 172.21.15.144:0/1500632895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e080b26c0 0x7f3e081f6400 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:34.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.164+0000 7f3e0d600640 1 --2- 172.21.15.144:0/1500632895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e080cd6e0 0x7f3e080b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:34.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.164+0000 7f3e0d600640 1 --2- 172.21.15.144:0/1500632895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dec005bc0 0x7f3e080cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:34.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.164+0000 7f3e0d600640 1 -- 172.21.15.144:0/1500632895 >> 172.21.15.144:0/1500632895 conn(0x7f3e08062cc0 msgr2=0x7f3e0806bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:34.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.164+0000 7f3e0d600640 1 -- 172.21.15.144:0/1500632895 shutdown_connections 2024-09-11T23:18:34.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.164+0000 7f3e0d600640 1 -- 172.21.15.144:0/1500632895 wait complete. 2024-09-11T23:18:34.179 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-11T23:18:34.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:34.180 DEBUG:teuthology.orchestra.run.smithi165:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-11T23:18:34.244 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:18:34.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:34.245 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:18:34.303 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:18:34.303 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:34.340 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:18:34.340 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:34.415 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:18:34.415 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:34.490 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:18:34.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.684+0000 7f6c4dc00640 1 Processor -- start 2024-09-11T23:18:34.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.684+0000 7f6c4dc00640 1 -- start start 2024-09-11T23:18:34.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.685+0000 7f6c4dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c480d02a0 0x7f6c480d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:34.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.685+0000 7f6c4dc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6c4815ca40 0x7f6c4815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:34.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.685+0000 7f6c4dc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6c4815ce80 0x7f6c481594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:34.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.685+0000 7f6c4dc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6c480d0bc0 con 0x7f6c4815ca40 2024-09-11T23:18:34.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.685+0000 7f6c4dc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6c4815d390 con 0x7f6c4815ce80 2024-09-11T23:18:34.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.685+0000 7f6c4dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4815d670 con 0x7f6c480d02a0 2024-09-11T23:18:34.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.685+0000 7f6c46000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6c4815ca40 0x7f6c4815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:34.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.686+0000 7f6c46000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6c4815ca40 0x7f6c4815e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57364/0 (socket says 172.21.15.144:57364) 2024-09-11T23:18:34.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.686+0000 7f6c46000640 1 -- 172.21.15.144:0/795873409 learned_addr learned my addr 172.21.15.144:0/795873409 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:34.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.686+0000 7f6c47400640 1 --2- 172.21.15.144:0/795873409 >> v2:172.21.15.165:3300/0 conn(0x7f6c4815ce80 0x7f6c481594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:34.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.686+0000 7f6c46a00640 1 --2- 172.21.15.144:0/795873409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c480d02a0 0x7f6c480d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:34.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.686+0000 7f6c46000640 1 -- 172.21.15.144:0/795873409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c480d02a0 msgr2=0x7f6c480d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:34.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.686+0000 7f6c46000640 1 --2- 172.21.15.144:0/795873409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c480d02a0 0x7f6c480d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:34.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.686+0000 7f6c46000640 1 -- 172.21.15.144:0/795873409 >> v2:172.21.15.165:3300/0 conn(0x7f6c4815ce80 msgr2=0x7f6c481594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:34.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.686+0000 7f6c46000640 1 --2- 172.21.15.144:0/795873409 >> v2:172.21.15.165:3300/0 conn(0x7f6c4815ce80 0x7f6c481594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:34.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.686+0000 7f6c46000640 1 -- 172.21.15.144:0/795873409 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4815d950 con 0x7f6c4815ca40 2024-09-11T23:18:34.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.687+0000 7f6c46000640 1 --2- 172.21.15.144:0/795873409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4815ca40 0x7f6c4815e430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6c4806cd20 tx=0x7f6c3402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1c6c8c5fc605e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:34.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.687+0000 7f6c45600640 1 -- 172.21.15.144:0/795873409 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34037070 con 0x7f6c4815ca40 2024-09-11T23:18:34.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.687+0000 7f6c45600640 1 -- 172.21.15.144:0/795873409 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c34032440 con 0x7f6c4815ca40 2024-09-11T23:18:34.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.687+0000 7f6c45600640 1 -- 172.21.15.144:0/795873409 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34032810 con 0x7f6c4815ca40 2024-09-11T23:18:34.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.688+0000 7f6c4dc00640 1 -- 172.21.15.144:0/795873409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4815ca40 msgr2=0x7f6c4815e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:34.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.688+0000 7f6c4dc00640 1 --2- 172.21.15.144:0/795873409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4815ca40 0x7f6c4815e430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6c4806cd20 tx=0x7f6c3402a140 comp rx=0 tx=0).stop 2024-09-11T23:18:34.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.688+0000 7f6c4dc00640 1 -- 172.21.15.144:0/795873409 shutdown_connections 2024-09-11T23:18:34.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.688+0000 7f6c4dc00640 1 --2- 172.21.15.144:0/795873409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4815ca40 0x7f6c4815e430 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:34.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.688+0000 7f6c4dc00640 1 --2- 172.21.15.144:0/795873409 >> v2:172.21.15.165:3300/0 conn(0x7f6c4815ce80 0x7f6c481594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:34.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.688+0000 7f6c4dc00640 1 --2- 172.21.15.144:0/795873409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c480d02a0 0x7f6c480d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:34.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.688+0000 7f6c4dc00640 1 -- 172.21.15.144:0/795873409 >> 172.21.15.144:0/795873409 conn(0x7f6c48062cc0 msgr2=0x7f6c4806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:34.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.688+0000 7f6c4dc00640 1 -- 172.21.15.144:0/795873409 shutdown_connections 2024-09-11T23:18:34.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.688+0000 7f6c4dc00640 1 -- 172.21.15.144:0/795873409 wait complete. 2024-09-11T23:18:34.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.690+0000 7f6c4dc00640 1 Processor -- start 2024-09-11T23:18:34.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.690+0000 7f6c4dc00640 1 -- start start 2024-09-11T23:18:34.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.691+0000 7f6c4dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c480d02a0 0x7f6c48149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:34.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.691+0000 7f6c4dc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c4815ca40 0x7f6c480ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:34.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.691+0000 7f6c4dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4815ce80 0x7f6c480aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:34.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.691+0000 7f6c4dc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6c48155b90 con 0x7f6c4815ce80 2024-09-11T23:18:34.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.691+0000 7f6c4dc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4815df10 con 0x7f6c4815ca40 2024-09-11T23:18:34.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.691+0000 7f6c4dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6c48155d10 con 0x7f6c480d02a0 2024-09-11T23:18:34.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.691+0000 7f6c47400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4815ce80 0x7f6c480aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:34.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.691+0000 7f6c47400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4815ce80 0x7f6c480aee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57380/0 (socket says 172.21.15.144:57380) 2024-09-11T23:18:34.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.691+0000 7f6c47400640 1 -- 172.21.15.144:0/2314667908 learned_addr learned my addr 172.21.15.144:0/2314667908 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:34.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.691+0000 7f6c46a00640 1 --2- 172.21.15.144:0/2314667908 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c480d02a0 0x7f6c48149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:34.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.691+0000 7f6c46000640 1 --2- 172.21.15.144:0/2314667908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c4815ca40 0x7f6c480ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:34.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.691+0000 7f6c47400640 1 -- 172.21.15.144:0/2314667908 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c480d02a0 msgr2=0x7f6c48149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:34.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.691+0000 7f6c47400640 1 --2- 172.21.15.144:0/2314667908 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c480d02a0 0x7f6c48149eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:34.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.691+0000 7f6c47400640 1 -- 172.21.15.144:0/2314667908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c4815ca40 msgr2=0x7f6c480ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:34.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.691+0000 7f6c47400640 1 --2- 172.21.15.144:0/2314667908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c4815ca40 0x7f6c480ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:34.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.691+0000 7f6c47400640 1 -- 172.21.15.144:0/2314667908 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c481f5af0 con 0x7f6c4815ce80 2024-09-11T23:18:34.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.692+0000 7f6c47400640 1 --2- 172.21.15.144:0/2314667908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4815ce80 0x7f6c480aee20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000efc0 tx=0x7f6c4000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:34.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.692+0000 7f6c3ea00640 1 -- 172.21.15.144:0/2314667908 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c40018020 con 0x7f6c4815ce80 2024-09-11T23:18:34.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.692+0000 7f6c3ea00640 1 -- 172.21.15.144:0/2314667908 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c40014480 con 0x7f6c4815ce80 2024-09-11T23:18:34.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.692+0000 7f6c3ea00640 1 -- 172.21.15.144:0/2314667908 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c40014870 con 0x7f6c4815ce80 2024-09-11T23:18:34.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.692+0000 7f6c4dc00640 1 -- 172.21.15.144:0/2314667908 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c481f5dd0 con 0x7f6c4815ce80 2024-09-11T23:18:34.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.692+0000 7f6c4dc00640 1 -- 172.21.15.144:0/2314667908 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c48072d70 con 0x7f6c4815ce80 2024-09-11T23:18:34.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.693+0000 7f6c4dc00640 1 -- 172.21.15.144:0/2314667908 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c480cdef0 con 0x7f6c4815ce80 2024-09-11T23:18:34.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.694+0000 7f6c3ea00640 1 -- 172.21.15.144:0/2314667908 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c40005d10 con 0x7f6c4815ce80 2024-09-11T23:18:34.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.695+0000 7f6c3ea00640 1 --2- 172.21.15.144:0/2314667908 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6c2806be30 0x7f6c2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:34.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.695+0000 7f6c3ea00640 1 -- 172.21.15.144:0/2314667908 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6c4008bb30 con 0x7f6c4815ce80 2024-09-11T23:18:34.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.695+0000 7f6c46a00640 1 --2- 172.21.15.144:0/2314667908 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6c2806be30 0x7f6c2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:34.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.696+0000 7f6c46a00640 1 --2- 172.21.15.144:0/2314667908 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6c2806be30 0x7f6c2806e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009a20 tx=0x7f6c38009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:34.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.699+0000 7f6c3ea00640 1 -- 172.21.15.144:0/2314667908 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c480cdef0 con 0x7f6c4815ce80 2024-09-11T23:18:34.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.884+0000 7f6c4dc00640 1 -- 172.21.15.144:0/2314667908 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6c480b4790 con 0x7f6c4815ce80 2024-09-11T23:18:34.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.885+0000 7f6c3ea00640 1 -- 172.21.15.144:0/2314667908 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f6c40022030 con 0x7f6c4815ce80 2024-09-11T23:18:34.885 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:18:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.887+0000 7f6c4dc00640 1 -- 172.21.15.144:0/2314667908 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6c2806be30 msgr2=0x7f6c2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.887+0000 7f6c4dc00640 1 --2- 172.21.15.144:0/2314667908 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6c2806be30 0x7f6c2806e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009a20 tx=0x7f6c38009190 comp rx=0 tx=0).stop 2024-09-11T23:18:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.887+0000 7f6c4dc00640 1 -- 172.21.15.144:0/2314667908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4815ce80 msgr2=0x7f6c480aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.887+0000 7f6c4dc00640 1 --2- 172.21.15.144:0/2314667908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4815ce80 0x7f6c480aee20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000efc0 tx=0x7f6c4000c490 comp rx=0 tx=0).stop 2024-09-11T23:18:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.887+0000 7f6c4dc00640 1 -- 172.21.15.144:0/2314667908 shutdown_connections 2024-09-11T23:18:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.887+0000 7f6c4dc00640 1 --2- 172.21.15.144:0/2314667908 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6c2806be30 0x7f6c2806e2f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.887+0000 7f6c4dc00640 1 --2- 172.21.15.144:0/2314667908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c4815ce80 0x7f6c480aee20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.887+0000 7f6c4dc00640 1 --2- 172.21.15.144:0/2314667908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c4815ca40 0x7f6c480ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:34.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.887+0000 7f6c4dc00640 1 --2- 172.21.15.144:0/2314667908 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c480d02a0 0x7f6c48149eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:34.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.887+0000 7f6c4dc00640 1 -- 172.21.15.144:0/2314667908 >> 172.21.15.144:0/2314667908 conn(0x7f6c48062cc0 msgr2=0x7f6c480ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:34.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.887+0000 7f6c4dc00640 1 -- 172.21.15.144:0/2314667908 shutdown_connections 2024-09-11T23:18:34.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:34.887+0000 7f6c4dc00640 1 -- 172.21.15.144:0/2314667908 wait complete. 2024-09-11T23:18:34.902 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-11T23:18:34.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:34.902 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-11T23:18:34.961 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:18:34.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:34.962 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-11T23:18:34.998 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:18:34.998 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:35.036 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:18:35.037 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:35.112 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:18:35.112 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:18:35.188 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:18:35.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.344+0000 7f4191a00640 1 Processor -- start 2024-09-11T23:18:35.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.344+0000 7f4191a00640 1 -- start start 2024-09-11T23:18:35.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.345+0000 7f4191a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f418c0b6410 0x7f418c0b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.345+0000 7f4191a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f418c06bee0 con 0x7f418c15e640 2024-09-11T23:18:35.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.345+0000 7f4191a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f418c06c1c0 con 0x7f418c0b5fd0 2024-09-11T23:18:35.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.345+0000 7f4191a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f418c15ea20 con 0x7f418c0b6410 2024-09-11T23:18:35.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.345+0000 7f418be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f418c15e640 0x7f418c0d3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34830/0 (socket says 172.21.15.144:34830) 2024-09-11T23:18:35.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.345+0000 7f418be00640 1 -- 172.21.15.144:0/529246163 learned_addr learned my addr 172.21.15.144:0/529246163 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:35.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.345+0000 7f4191000640 1 --2- 172.21.15.144:0/529246163 >> v2:172.21.15.165:3300/0 conn(0x7f418c0b6410 0x7f418c0b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.346+0000 7f418b400640 1 -- 172.21.15.144:0/529246163 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2989809768 0 0) 0x7f418c06bee0 con 0x7f418c15e640 2024-09-11T23:18:35.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.346+0000 7f418b400640 1 -- 172.21.15.144:0/529246163 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4170003520 con 0x7f418c15e640 2024-09-11T23:18:35.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.346+0000 7f418b400640 1 -- 172.21.15.144:0/529246163 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2611260472 0 0) 0x7f418c06c1c0 con 0x7f418c0b5fd0 2024-09-11T23:18:35.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.346+0000 7f4191000640 1 -- 172.21.15.144:0/529246163 >> v1:172.21.15.165:6789/0 conn(0x7f418c0b5fd0 legacy=0x7f418c0b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.346+0000 7f4191000640 1 -- 172.21.15.144:0/529246163 >> v1:172.21.15.144:6789/0 conn(0x7f418c15e640 legacy=0x7f418c0d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.346+0000 7f4191000640 1 -- 172.21.15.144:0/529246163 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418c06c4a0 con 0x7f418c0b6410 2024-09-11T23:18:35.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.347+0000 7f4191000640 1 --2- 172.21.15.144:0/529246163 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f418c0b6410 0x7f418c0b7e60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f41840097a0 tx=0x7f418402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdc6457bd0e159b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:35.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.347+0000 7f418b400640 1 -- 172.21.15.144:0/529246163 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4184037070 con 0x7f418c0b6410 2024-09-11T23:18:35.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.347+0000 7f418b400640 1 -- 172.21.15.144:0/529246163 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4184032440 con 0x7f418c0b6410 2024-09-11T23:18:35.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.347+0000 7f418b400640 1 -- 172.21.15.144:0/529246163 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41840327f0 con 0x7f418c0b6410 2024-09-11T23:18:35.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.348+0000 7f4191a00640 1 -- 172.21.15.144:0/529246163 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f418c0b6410 msgr2=0x7f418c0b7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.348+0000 7f4191a00640 1 --2- 172.21.15.144:0/529246163 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f418c0b6410 0x7f418c0b7e60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f41840097a0 tx=0x7f418402a230 comp rx=0 tx=0).stop 2024-09-11T23:18:35.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.348+0000 7f4191a00640 1 -- 172.21.15.144:0/529246163 shutdown_connections 2024-09-11T23:18:35.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.348+0000 7f4191a00640 1 --2- 172.21.15.144:0/529246163 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f418c0b6410 0x7f418c0b7e60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.348+0000 7f4191a00640 1 -- 172.21.15.144:0/529246163 >> 172.21.15.144:0/529246163 conn(0x7f418c0d0fd0 msgr2=0x7f418c0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:35.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.348+0000 7f4191a00640 1 -- 172.21.15.144:0/529246163 shutdown_connections 2024-09-11T23:18:35.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.348+0000 7f4191a00640 1 -- 172.21.15.144:0/529246163 wait complete. 2024-09-11T23:18:35.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.349+0000 7f4191a00640 1 Processor -- start 2024-09-11T23:18:35.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.349+0000 7f4191a00640 1 -- start start 2024-09-11T23:18:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.350+0000 7f4191a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f418c0b5fd0 0x7f418c0cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.350+0000 7f4191a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f418c0b6410 0x7f418c158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.350+0000 7f4191a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f418c15e640 0x7f418c0ce110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.350+0000 7f4191a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f418c0b68a0 con 0x7f418c0b5fd0 2024-09-11T23:18:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.350+0000 7f4191a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f418c06caf0 con 0x7f418c0b6410 2024-09-11T23:18:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.350+0000 7f4191a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f418c0d4130 con 0x7f418c15e640 2024-09-11T23:18:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.351+0000 7f418be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f418c0b5fd0 0x7f418c0cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.351+0000 7f418be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f418c0b5fd0 0x7f418c0cca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57388/0 (socket says 172.21.15.144:57388) 2024-09-11T23:18:35.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.351+0000 7f418be00640 1 -- 172.21.15.144:0/2377191678 learned_addr learned my addr 172.21.15.144:0/2377191678 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:35.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.351+0000 7f4191000640 1 --2- 172.21.15.144:0/2377191678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f418c15e640 0x7f418c0ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.351+0000 7f4183400640 1 --2- 172.21.15.144:0/2377191678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f418c0b6410 0x7f418c158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.351+0000 7f418be00640 1 -- 172.21.15.144:0/2377191678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f418c15e640 msgr2=0x7f418c0ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.351+0000 7f418be00640 1 --2- 172.21.15.144:0/2377191678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f418c15e640 0x7f418c0ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.351+0000 7f418be00640 1 -- 172.21.15.144:0/2377191678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f418c0b6410 msgr2=0x7f418c158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.351+0000 7f418be00640 1 --2- 172.21.15.144:0/2377191678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f418c0b6410 0x7f418c158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.351+0000 7f418be00640 1 -- 172.21.15.144:0/2377191678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418c0ce650 con 0x7f418c0b5fd0 2024-09-11T23:18:35.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.351+0000 7f418be00640 1 --2- 172.21.15.144:0/2377191678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f418c0b5fd0 0x7f418c0cca90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f417c00cb40 tx=0x7f417c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:35.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.352+0000 7f4188c00640 1 -- 172.21.15.144:0/2377191678 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c017070 con 0x7f418c0b5fd0 2024-09-11T23:18:35.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.352+0000 7f4188c00640 1 -- 172.21.15.144:0/2377191678 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c00aca0 con 0x7f418c0b5fd0 2024-09-11T23:18:35.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.352+0000 7f4188c00640 1 -- 172.21.15.144:0/2377191678 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c012620 con 0x7f418c0b5fd0 2024-09-11T23:18:35.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.352+0000 7f4191a00640 1 -- 172.21.15.144:0/2377191678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f418c0cd070 con 0x7f418c0b5fd0 2024-09-11T23:18:35.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.352+0000 7f4191a00640 1 -- 172.21.15.144:0/2377191678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f418c0cd630 con 0x7f418c0b5fd0 2024-09-11T23:18:35.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.353+0000 7f4191a00640 1 -- 172.21.15.144:0/2377191678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f418c0d3a20 con 0x7f418c0b5fd0 2024-09-11T23:18:35.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.354+0000 7f4188c00640 1 -- 172.21.15.144:0/2377191678 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f417c01a070 con 0x7f418c0b5fd0 2024-09-11T23:18:35.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.355+0000 7f4188c00640 1 --2- 172.21.15.144:0/2377191678 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f416806be30 0x7f416806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.355+0000 7f4188c00640 1 -- 172.21.15.144:0/2377191678 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f417c08ac20 con 0x7f418c0b5fd0 2024-09-11T23:18:35.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.355+0000 7f4183400640 1 --2- 172.21.15.144:0/2377191678 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f416806be30 0x7f416806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.355+0000 7f4183400640 1 --2- 172.21.15.144:0/2377191678 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f416806be30 0x7f416806e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f418c161ab0 tx=0x7f4174009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:35.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.359+0000 7f4188c00640 1 -- 172.21.15.144:0/2377191678 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f417c058f70 con 0x7f418c0b5fd0 2024-09-11T23:18:35.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.544+0000 7f4191a00640 1 -- 172.21.15.144:0/2377191678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f418c0b48f0 con 0x7f418c0b5fd0 2024-09-11T23:18:35.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.545+0000 7f4188c00640 1 -- 172.21.15.144:0/2377191678 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f417c05d270 con 0x7f418c0b5fd0 2024-09-11T23:18:35.545 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:18:35.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.547+0000 7f4191a00640 1 -- 172.21.15.144:0/2377191678 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f416806be30 msgr2=0x7f416806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.547+0000 7f4191a00640 1 --2- 172.21.15.144:0/2377191678 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f416806be30 0x7f416806e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f418c161ab0 tx=0x7f4174009040 comp rx=0 tx=0).stop 2024-09-11T23:18:35.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.547+0000 7f4191a00640 1 -- 172.21.15.144:0/2377191678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f418c0b5fd0 msgr2=0x7f418c0cca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.547+0000 7f4191a00640 1 --2- 172.21.15.144:0/2377191678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f418c0b5fd0 0x7f418c0cca90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f417c00cb40 tx=0x7f417c00a060 comp rx=0 tx=0).stop 2024-09-11T23:18:35.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.547+0000 7f4191a00640 1 -- 172.21.15.144:0/2377191678 shutdown_connections 2024-09-11T23:18:35.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.547+0000 7f4191a00640 1 --2- 172.21.15.144:0/2377191678 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f416806be30 0x7f416806e2f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.547+0000 7f4191a00640 1 --2- 172.21.15.144:0/2377191678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f418c15e640 0x7f418c0ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.547+0000 7f4191a00640 1 --2- 172.21.15.144:0/2377191678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f418c0b6410 0x7f418c158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.547+0000 7f4191a00640 1 --2- 172.21.15.144:0/2377191678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f418c0b5fd0 0x7f418c0cca90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.547+0000 7f4191a00640 1 -- 172.21.15.144:0/2377191678 >> 172.21.15.144:0/2377191678 conn(0x7f418c0d0fd0 msgr2=0x7f418c0d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:35.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.547+0000 7f4191a00640 1 -- 172.21.15.144:0/2377191678 shutdown_connections 2024-09-11T23:18:35.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.547+0000 7f4191a00640 1 -- 172.21.15.144:0/2377191678 wait complete. 2024-09-11T23:18:35.563 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-11T23:18:35.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:35.564 DEBUG:teuthology.orchestra.run.smithi165:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-11T23:18:35.624 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:18:35.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:18:35.625 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-11T23:18:35.660 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T23:18:35.661 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:35.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.814+0000 7fed15c00640 1 Processor -- start 2024-09-11T23:18:35.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.814+0000 7fed15c00640 1 -- start start 2024-09-11T23:18:35.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.816+0000 7fed15c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed100d02a0 0x7fed100d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.816+0000 7fed15c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fed1015ca40 0x7fed1015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.816+0000 7fed15c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed100d0bc0 con 0x7fed1015ce80 2024-09-11T23:18:35.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.816+0000 7fed15c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fed1015d390 con 0x7fed1015ca40 2024-09-11T23:18:35.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.816+0000 7fed15c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fed1015d670 con 0x7fed100d02a0 2024-09-11T23:18:35.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.816+0000 7fed06000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fed1015ca40 0x7fed1015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.816+0000 7fed0f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fed1015ce80 0x7fed101594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34834/0 (socket says 172.21.15.144:34834) 2024-09-11T23:18:35.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.816+0000 7fed0f400640 1 -- 172.21.15.144:0/2707930650 learned_addr learned my addr 172.21.15.144:0/2707930650 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:35.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.816+0000 7fed0ea00640 1 --2- 172.21.15.144:0/2707930650 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed100d02a0 0x7fed100d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.816+0000 7fed06000640 1 -- 172.21.15.144:0/2707930650 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed100d02a0 msgr2=0x7fed100d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:35.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.816+0000 7fed06000640 1 --2- 172.21.15.144:0/2707930650 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed100d02a0 0x7fed100d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.816+0000 7fed06000640 1 -- 172.21.15.144:0/2707930650 >> v1:172.21.15.144:6789/0 conn(0x7fed1015ce80 legacy=0x7fed101594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.816+0000 7fed06000640 1 -- 172.21.15.144:0/2707930650 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1015d950 con 0x7fed1015ca40 2024-09-11T23:18:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.817+0000 7fed0ea00640 1 --2- 172.21.15.144:0/2707930650 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed100d02a0 0x7fed100d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.816+0000 7fed0e000640 1 -- 172.21.15.144:0/2707930650 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1481343790 0 0) 0x7fed100d0bc0 con 0x7fed1015ce80 2024-09-11T23:18:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.817+0000 7fed06000640 1 --2- 172.21.15.144:0/2707930650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed1015ca40 0x7fed1015e430 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fecf80097a0 tx=0x7fecf802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fd176f322aa53e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.818+0000 7fed0e000640 1 -- 172.21.15.144:0/2707930650 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf8037070 con 0x7fed1015ca40 2024-09-11T23:18:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.818+0000 7fed0e000640 1 -- 172.21.15.144:0/2707930650 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf802ae50 con 0x7fed1015ca40 2024-09-11T23:18:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.818+0000 7fed0e000640 1 -- 172.21.15.144:0/2707930650 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf8032660 con 0x7fed1015ca40 2024-09-11T23:18:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.818+0000 7fed15c00640 1 -- 172.21.15.144:0/2707930650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed1015ca40 msgr2=0x7fed1015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.818+0000 7fed15c00640 1 --2- 172.21.15.144:0/2707930650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed1015ca40 0x7fed1015e430 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fecf80097a0 tx=0x7fecf802a100 comp rx=0 tx=0).stop 2024-09-11T23:18:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.818+0000 7fed15c00640 1 -- 172.21.15.144:0/2707930650 shutdown_connections 2024-09-11T23:18:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.818+0000 7fed15c00640 1 --2- 172.21.15.144:0/2707930650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed1015ca40 0x7fed1015e430 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.818+0000 7fed15c00640 1 --2- 172.21.15.144:0/2707930650 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed100d02a0 0x7fed100d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.818+0000 7fed15c00640 1 -- 172.21.15.144:0/2707930650 >> 172.21.15.144:0/2707930650 conn(0x7fed10062cc0 msgr2=0x7fed1006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:35.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.818+0000 7fed15c00640 1 -- 172.21.15.144:0/2707930650 shutdown_connections 2024-09-11T23:18:35.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.818+0000 7fed15c00640 1 -- 172.21.15.144:0/2707930650 wait complete. 2024-09-11T23:18:35.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.820+0000 7fed15c00640 1 Processor -- start 2024-09-11T23:18:35.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.820+0000 7fed15c00640 1 -- start start 2024-09-11T23:18:35.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.821+0000 7fed15c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed100d02a0 0x7fed1014c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.821+0000 7fed15c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed1015ca40 0x7fed10071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.821+0000 7fed15c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed1015ce80 0x7fed10152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.821+0000 7fed15c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fed10155b90 con 0x7fed100d02a0 2024-09-11T23:18:35.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.821+0000 7fed15c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fed1015df10 con 0x7fed1015ca40 2024-09-11T23:18:35.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.821+0000 7fed15c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fed10155d10 con 0x7fed1015ce80 2024-09-11T23:18:35.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.821+0000 7fed0ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed100d02a0 0x7fed1014c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.821+0000 7fed0ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed100d02a0 0x7fed1014c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57408/0 (socket says 172.21.15.144:57408) 2024-09-11T23:18:35.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.821+0000 7fed0ea00640 1 -- 172.21.15.144:0/3691529830 learned_addr learned my addr 172.21.15.144:0/3691529830 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:35.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.822+0000 7fed06000640 1 --2- 172.21.15.144:0/3691529830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed1015ca40 0x7fed10071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.822+0000 7fed0f400640 1 --2- 172.21.15.144:0/3691529830 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed1015ce80 0x7fed10152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.822+0000 7fed0ea00640 1 -- 172.21.15.144:0/3691529830 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed1015ce80 msgr2=0x7fed10152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.822+0000 7fed0ea00640 1 --2- 172.21.15.144:0/3691529830 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed1015ce80 0x7fed10152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.822+0000 7fed0ea00640 1 -- 172.21.15.144:0/3691529830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed1015ca40 msgr2=0x7fed10071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:35.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.822+0000 7fed0ea00640 1 --2- 172.21.15.144:0/3691529830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed1015ca40 0x7fed10071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:35.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.822+0000 7fed0ea00640 1 -- 172.21.15.144:0/3691529830 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed100719e0 con 0x7fed100d02a0 2024-09-11T23:18:35.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.822+0000 7fed0ea00640 1 --2- 172.21.15.144:0/3691529830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed100d02a0 0x7fed1014c720 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fed0000c7f0 tx=0x7fed0000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:35.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.822+0000 7fed07400640 1 -- 172.21.15.144:0/3691529830 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed00015070 con 0x7fed100d02a0 2024-09-11T23:18:35.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.822+0000 7fed07400640 1 -- 172.21.15.144:0/3691529830 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed00007820 con 0x7fed100d02a0 2024-09-11T23:18:35.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.822+0000 7fed07400640 1 -- 172.21.15.144:0/3691529830 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed00007bd0 con 0x7fed100d02a0 2024-09-11T23:18:35.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.822+0000 7fed15c00640 1 -- 172.21.15.144:0/3691529830 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed10071cc0 con 0x7fed100d02a0 2024-09-11T23:18:35.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.823+0000 7fed15c00640 1 -- 172.21.15.144:0/3691529830 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed10072280 con 0x7fed100d02a0 2024-09-11T23:18:35.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.823+0000 7fed15c00640 1 -- 172.21.15.144:0/3691529830 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed100b4790 con 0x7fed100d02a0 2024-09-11T23:18:35.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.824+0000 7fed07400640 1 -- 172.21.15.144:0/3691529830 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed00018070 con 0x7fed100d02a0 2024-09-11T23:18:35.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.825+0000 7fed07400640 1 --2- 172.21.15.144:0/3691529830 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fecec06be30 0x7fecec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:35.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.825+0000 7fed07400640 1 -- 172.21.15.144:0/3691529830 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fed0008afe0 con 0x7fed100d02a0 2024-09-11T23:18:35.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.825+0000 7fed06000640 1 --2- 172.21.15.144:0/3691529830 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fecec06be30 0x7fecec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:35.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.826+0000 7fed06000640 1 --2- 172.21.15.144:0/3691529830 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fecec06be30 0x7fecec06e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fecf8034000 tx=0x7fecf802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:35.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:35.829+0000 7fed07400640 1 -- 172.21.15.144:0/3691529830 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed00059930 con 0x7fed100d02a0 2024-09-11T23:18:36.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.038+0000 7fed15c00640 1 -- 172.21.15.144:0/3691529830 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed100760c0 con 0x7fed100d02a0 2024-09-11T23:18:36.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.038+0000 7fed07400640 1 -- 172.21.15.144:0/3691529830 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7fed00059230 con 0x7fed100d02a0 2024-09-11T23:18:36.038 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:36.038 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"btime":"2024-09-11T23:18:02:645252+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1741936320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1741936320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1741936320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1295491349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1295491349},{"type":"v1","addr":"172.21.15.144:6836","nonce":1295491349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1020006630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1020006630},{"type":"v1","addr":"172.21.15.144:6837","nonce":1020006630}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:59.036096+0000","modified":"2024-09-11T23:18:02.054236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2270648598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2270648598},{"type":"v1","addr":"172.21.15.165:6835","nonce":2270648598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-09-11T23:18:36.039 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-09-11T23:18:36.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.040+0000 7fed15c00640 1 -- 172.21.15.144:0/3691529830 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fecec06be30 msgr2=0x7fecec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:36.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.040+0000 7fed15c00640 1 --2- 172.21.15.144:0/3691529830 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fecec06be30 0x7fecec06e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fecf8034000 tx=0x7fecf802e000 comp rx=0 tx=0).stop 2024-09-11T23:18:36.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.040+0000 7fed15c00640 1 -- 172.21.15.144:0/3691529830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed100d02a0 msgr2=0x7fed1014c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:36.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.040+0000 7fed15c00640 1 --2- 172.21.15.144:0/3691529830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed100d02a0 0x7fed1014c720 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fed0000c7f0 tx=0x7fed0000ccb0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.041+0000 7fed15c00640 1 -- 172.21.15.144:0/3691529830 shutdown_connections 2024-09-11T23:18:36.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.041+0000 7fed15c00640 1 --2- 172.21.15.144:0/3691529830 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fecec06be30 0x7fecec06e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.041+0000 7fed15c00640 1 --2- 172.21.15.144:0/3691529830 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed1015ce80 0x7fed10152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.041+0000 7fed15c00640 1 --2- 172.21.15.144:0/3691529830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed1015ca40 0x7fed10071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.041+0000 7fed15c00640 1 --2- 172.21.15.144:0/3691529830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed100d02a0 0x7fed1014c720 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.041+0000 7fed15c00640 1 -- 172.21.15.144:0/3691529830 >> 172.21.15.144:0/3691529830 conn(0x7fed10062cc0 msgr2=0x7fed100b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:36.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.041+0000 7fed15c00640 1 -- 172.21.15.144:0/3691529830 shutdown_connections 2024-09-11T23:18:36.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.041+0000 7fed15c00640 1 -- 172.21.15.144:0/3691529830 wait complete. 2024-09-11T23:18:36.057 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:36.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.211+0000 7f3d59200640 1 Processor -- start 2024-09-11T23:18:36.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.211+0000 7f3d59200640 1 -- start start 2024-09-11T23:18:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.212+0000 7f3d59200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3d540b4f60 0x7f3d540b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.212+0000 7f3d59200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3d540b3c10 0x7f3d540b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.212+0000 7f3d59200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d540d0810 con 0x7f3d54157000 2024-09-11T23:18:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.212+0000 7f3d59200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3d540b5910 con 0x7f3d540b4f60 2024-09-11T23:18:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.212+0000 7f3d59200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3d540b3780 con 0x7f3d540b3c10 2024-09-11T23:18:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.212+0000 7f3d51e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3d54157000 0x7f3d540cfd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34840/0 (socket says 172.21.15.144:34840) 2024-09-11T23:18:36.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.212+0000 7f3d51400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3d540b4f60 0x7f3d540b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:36.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.212+0000 7f3d51e00640 1 -- 172.21.15.144:0/4007504286 learned_addr learned my addr 172.21.15.144:0/4007504286 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:36.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.213+0000 7f3d52800640 1 --2- 172.21.15.144:0/4007504286 >> v2:172.21.15.165:3300/0 conn(0x7f3d540b3c10 0x7f3d540b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:36.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.213+0000 7f3d51400640 1 -- 172.21.15.144:0/4007504286 >> v2:172.21.15.165:3300/0 conn(0x7f3d540b3c10 msgr2=0x7f3d540b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:36.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.213+0000 7f3d51400640 1 --2- 172.21.15.144:0/4007504286 >> v2:172.21.15.165:3300/0 conn(0x7f3d540b3c10 0x7f3d540b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.213+0000 7f3d51400640 1 -- 172.21.15.144:0/4007504286 >> v1:172.21.15.144:6789/0 conn(0x7f3d54157000 legacy=0x7f3d540cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:36.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.213+0000 7f3d51400640 1 -- 172.21.15.144:0/4007504286 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d540d0af0 con 0x7f3d540b4f60 2024-09-11T23:18:36.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.213+0000 7f3d50a00640 1 -- 172.21.15.144:0/4007504286 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3712356471 0 0) 0x7f3d540d0810 con 0x7f3d54157000 2024-09-11T23:18:36.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.214+0000 7f3d51400640 1 --2- 172.21.15.144:0/4007504286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d540b4f60 0x7f3d540b53d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3d54069f00 tx=0x7f3d4002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a465f0d72fb858f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:36.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.214+0000 7f3d50a00640 1 -- 172.21.15.144:0/4007504286 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40037070 con 0x7f3d540b4f60 2024-09-11T23:18:36.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.214+0000 7f3d50a00640 1 -- 172.21.15.144:0/4007504286 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d40032440 con 0x7f3d540b4f60 2024-09-11T23:18:36.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.214+0000 7f3d50a00640 1 -- 172.21.15.144:0/4007504286 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40032810 con 0x7f3d540b4f60 2024-09-11T23:18:36.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.215+0000 7f3d59200640 1 -- 172.21.15.144:0/4007504286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d540b4f60 msgr2=0x7f3d540b53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:36.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.215+0000 7f3d59200640 1 --2- 172.21.15.144:0/4007504286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d540b4f60 0x7f3d540b53d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3d54069f00 tx=0x7f3d4002a1a0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.215+0000 7f3d59200640 1 -- 172.21.15.144:0/4007504286 shutdown_connections 2024-09-11T23:18:36.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.215+0000 7f3d59200640 1 --2- 172.21.15.144:0/4007504286 >> v2:172.21.15.165:3300/0 conn(0x7f3d540b3c10 0x7f3d540b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.215+0000 7f3d59200640 1 --2- 172.21.15.144:0/4007504286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d540b4f60 0x7f3d540b53d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.215+0000 7f3d59200640 1 -- 172.21.15.144:0/4007504286 >> 172.21.15.144:0/4007504286 conn(0x7f3d540b2480 msgr2=0x7f3d540b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:36.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.215+0000 7f3d59200640 1 -- 172.21.15.144:0/4007504286 shutdown_connections 2024-09-11T23:18:36.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.215+0000 7f3d59200640 1 -- 172.21.15.144:0/4007504286 wait complete. 2024-09-11T23:18:36.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.216+0000 7f3d59200640 1 Processor -- start 2024-09-11T23:18:36.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.217+0000 7f3d59200640 1 -- start start 2024-09-11T23:18:36.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.217+0000 7f3d59200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d540b3c10 0x7f3d541f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:36.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.217+0000 7f3d59200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d540b4f60 0x7f3d541462b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:36.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.217+0000 7f3d59200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d54071980 0x7f3d54154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:36.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.217+0000 7f3d59200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3d540cf5f0 con 0x7f3d54071980 2024-09-11T23:18:36.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.217+0000 7f3d59200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3d540d10b0 con 0x7f3d540b3c10 2024-09-11T23:18:36.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.217+0000 7f3d59200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3d5406e080 con 0x7f3d540b4f60 2024-09-11T23:18:36.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.218+0000 7f3d52800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d54071980 0x7f3d54154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:36.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.218+0000 7f3d52800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d54071980 0x7f3d54154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57438/0 (socket says 172.21.15.144:57438) 2024-09-11T23:18:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.218+0000 7f3d52800640 1 -- 172.21.15.144:0/4052144352 learned_addr learned my addr 172.21.15.144:0/4052144352 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.218+0000 7f3d51e00640 1 --2- 172.21.15.144:0/4052144352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d540b3c10 0x7f3d541f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.218+0000 7f3d51400640 1 --2- 172.21.15.144:0/4052144352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d540b4f60 0x7f3d541462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.218+0000 7f3d52800640 1 -- 172.21.15.144:0/4052144352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d540b4f60 msgr2=0x7f3d541462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.218+0000 7f3d52800640 1 --2- 172.21.15.144:0/4052144352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d540b4f60 0x7f3d541462b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.218+0000 7f3d52800640 1 -- 172.21.15.144:0/4052144352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d540b3c10 msgr2=0x7f3d541f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.218+0000 7f3d52800640 1 --2- 172.21.15.144:0/4052144352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d540b3c10 0x7f3d541f4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.218+0000 7f3d52800640 1 -- 172.21.15.144:0/4052144352 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d541467f0 con 0x7f3d54071980 2024-09-11T23:18:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.218+0000 7f3d52800640 1 --2- 172.21.15.144:0/4052144352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d54071980 0x7f3d54154980 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009dd0 tx=0x7f3d4c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.219+0000 7f3d4a000640 1 -- 172.21.15.144:0/4052144352 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c018020 con 0x7f3d54071980 2024-09-11T23:18:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.219+0000 7f3d4a000640 1 -- 172.21.15.144:0/4052144352 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4c014480 con 0x7f3d54071980 2024-09-11T23:18:36.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.219+0000 7f3d59200640 1 -- 172.21.15.144:0/4052144352 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d54071e80 con 0x7f3d54071980 2024-09-11T23:18:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.219+0000 7f3d4a000640 1 -- 172.21.15.144:0/4052144352 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c014870 con 0x7f3d54071980 2024-09-11T23:18:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.219+0000 7f3d59200640 1 -- 172.21.15.144:0/4052144352 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d54072440 con 0x7f3d54071980 2024-09-11T23:18:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.220+0000 7f3d59200640 1 -- 172.21.15.144:0/4052144352 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d540b53d0 con 0x7f3d54071980 2024-09-11T23:18:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.221+0000 7f3d4a000640 1 -- 172.21.15.144:0/4052144352 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d4c005d10 con 0x7f3d54071980 2024-09-11T23:18:36.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.221+0000 7f3d4a000640 1 --2- 172.21.15.144:0/4052144352 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3d3406be30 0x7f3d3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:36.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.222+0000 7f3d4a000640 1 -- 172.21.15.144:0/4052144352 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3d4c08ba90 con 0x7f3d54071980 2024-09-11T23:18:36.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.222+0000 7f3d51e00640 1 --2- 172.21.15.144:0/4052144352 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3d3406be30 0x7f3d3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:36.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.222+0000 7f3d51e00640 1 --2- 172.21.15.144:0/4052144352 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3d3406be30 0x7f3d3406e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3d44000f60 tx=0x7f3d44007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:36.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.226+0000 7f3d4a000640 1 -- 172.21.15.144:0/4052144352 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d4c022070 con 0x7f3d54071980 2024-09-11T23:18:36.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.436+0000 7f3d59200640 1 -- 172.21.15.144:0/4052144352 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d541560b0 con 0x7f3d54071980 2024-09-11T23:18:36.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.437+0000 7f3d4a000640 1 -- 172.21.15.144:0/4052144352 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7f3d541467f0 con 0x7f3d54071980 2024-09-11T23:18:36.437 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:36.437 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"btime":"2024-09-11T23:18:02:645252+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1741936320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1741936320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1741936320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1295491349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1295491349},{"type":"v1","addr":"172.21.15.144:6836","nonce":1295491349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1020006630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1020006630},{"type":"v1","addr":"172.21.15.144:6837","nonce":1020006630}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:59.036096+0000","modified":"2024-09-11T23:18:02.054236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2270648598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2270648598},{"type":"v1","addr":"172.21.15.165:6835","nonce":2270648598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-09-11T23:18:36.438 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-09-11T23:18:36.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.439+0000 7f3d59200640 1 -- 172.21.15.144:0/4052144352 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3d3406be30 msgr2=0x7f3d3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:36.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.439+0000 7f3d59200640 1 --2- 172.21.15.144:0/4052144352 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3d3406be30 0x7f3d3406e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3d44000f60 tx=0x7f3d44007c00 comp rx=0 tx=0).stop 2024-09-11T23:18:36.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.439+0000 7f3d59200640 1 -- 172.21.15.144:0/4052144352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d54071980 msgr2=0x7f3d54154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:36.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.439+0000 7f3d59200640 1 --2- 172.21.15.144:0/4052144352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d54071980 0x7f3d54154980 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009dd0 tx=0x7f3d4c00c490 comp rx=0 tx=0).stop 2024-09-11T23:18:36.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.439+0000 7f3d59200640 1 -- 172.21.15.144:0/4052144352 shutdown_connections 2024-09-11T23:18:36.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.439+0000 7f3d59200640 1 --2- 172.21.15.144:0/4052144352 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3d3406be30 0x7f3d3406e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.439+0000 7f3d59200640 1 --2- 172.21.15.144:0/4052144352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d54071980 0x7f3d54154980 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.439+0000 7f3d59200640 1 --2- 172.21.15.144:0/4052144352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3d540b4f60 0x7f3d541462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.439+0000 7f3d59200640 1 --2- 172.21.15.144:0/4052144352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d540b3c10 0x7f3d541f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.439+0000 7f3d59200640 1 -- 172.21.15.144:0/4052144352 >> 172.21.15.144:0/4052144352 conn(0x7f3d540b2480 msgr2=0x7f3d540b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:36.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.439+0000 7f3d59200640 1 -- 172.21.15.144:0/4052144352 shutdown_connections 2024-09-11T23:18:36.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.440+0000 7f3d59200640 1 -- 172.21.15.144:0/4052144352 wait complete. 2024-09-11T23:18:36.456 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:18:36.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.610+0000 7f9c15200640 1 Processor -- start 2024-09-11T23:18:36.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.610+0000 7f9c15200640 1 -- start start 2024-09-11T23:18:36.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.611+0000 7f9c15200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c1015e4f0 0x7f9c100cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:36.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.611+0000 7f9c15200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9c100ce740 0x7f9c1006e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:36.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.611+0000 7f9c15200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9c1006e720 0x7f9c100b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:36.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.611+0000 7f9c15200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9c1006eb80 con 0x7f9c1006e720 2024-09-11T23:18:36.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.611+0000 7f9c15200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9c100d0070 con 0x7f9c100ce740 2024-09-11T23:18:36.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.611+0000 7f9c15200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9c100d12a0 con 0x7f9c1015e4f0 2024-09-11T23:18:36.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.611+0000 7f9c0fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9c1006e720 0x7f9c100b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:36.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.611+0000 7f9c0fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9c1006e720 0x7f9c100b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57450/0 (socket says 172.21.15.144:57450) 2024-09-11T23:18:36.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.611+0000 7f9c0fe00640 1 -- 172.21.15.144:0/2400613634 learned_addr learned my addr 172.21.15.144:0/2400613634 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:36.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.611+0000 7f9c0f400640 1 --2- 172.21.15.144:0/2400613634 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c1015e4f0 0x7f9c100cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:36.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.611+0000 7f9c07e00640 1 --2- 172.21.15.144:0/2400613634 >> v2:172.21.15.165:3300/0 conn(0x7f9c100ce740 0x7f9c1006e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:36.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.612+0000 7f9c0fe00640 1 -- 172.21.15.144:0/2400613634 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c1015e4f0 msgr2=0x7f9c100cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:36.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.612+0000 7f9c0fe00640 1 --2- 172.21.15.144:0/2400613634 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c1015e4f0 0x7f9c100cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.612+0000 7f9c0fe00640 1 -- 172.21.15.144:0/2400613634 >> v2:172.21.15.165:3300/0 conn(0x7f9c100ce740 msgr2=0x7f9c1006e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:36.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.612+0000 7f9c0fe00640 1 --2- 172.21.15.144:0/2400613634 >> v2:172.21.15.165:3300/0 conn(0x7f9c100ce740 0x7f9c1006e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.612+0000 7f9c0fe00640 1 -- 172.21.15.144:0/2400613634 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c100d1580 con 0x7f9c1006e720 2024-09-11T23:18:36.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.613+0000 7f9c0fe00640 1 --2- 172.21.15.144:0/2400613634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c1006e720 0x7f9c100b2e70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9c1006bc00 tx=0x7f9c0802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73314b5a85d0d610 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:36.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.613+0000 7f9c0ea00640 1 -- 172.21.15.144:0/2400613634 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c08036070 con 0x7f9c1006e720 2024-09-11T23:18:36.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.613+0000 7f9c0ea00640 1 -- 172.21.15.144:0/2400613634 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c08031600 con 0x7f9c1006e720 2024-09-11T23:18:36.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.613+0000 7f9c0ea00640 1 -- 172.21.15.144:0/2400613634 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c080319d0 con 0x7f9c1006e720 2024-09-11T23:18:36.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.614+0000 7f9c15200640 1 -- 172.21.15.144:0/2400613634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c1006e720 msgr2=0x7f9c100b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:36.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.614+0000 7f9c15200640 1 --2- 172.21.15.144:0/2400613634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c1006e720 0x7f9c100b2e70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9c1006bc00 tx=0x7f9c0802a610 comp rx=0 tx=0).stop 2024-09-11T23:18:36.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.614+0000 7f9c15200640 1 -- 172.21.15.144:0/2400613634 shutdown_connections 2024-09-11T23:18:36.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.614+0000 7f9c15200640 1 --2- 172.21.15.144:0/2400613634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c1006e720 0x7f9c100b2e70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.614+0000 7f9c15200640 1 --2- 172.21.15.144:0/2400613634 >> v2:172.21.15.165:3300/0 conn(0x7f9c100ce740 0x7f9c1006e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.614+0000 7f9c15200640 1 --2- 172.21.15.144:0/2400613634 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c1015e4f0 0x7f9c100cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.614+0000 7f9c15200640 1 -- 172.21.15.144:0/2400613634 >> 172.21.15.144:0/2400613634 conn(0x7f9c100b6700 msgr2=0x7f9c100b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:36.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.614+0000 7f9c15200640 1 -- 172.21.15.144:0/2400613634 shutdown_connections 2024-09-11T23:18:36.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.614+0000 7f9c15200640 1 -- 172.21.15.144:0/2400613634 wait complete. 2024-09-11T23:18:36.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.615+0000 7f9c15200640 1 Processor -- start 2024-09-11T23:18:36.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.616+0000 7f9c15200640 1 -- start start 2024-09-11T23:18:36.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.616+0000 7f9c15200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c1006e720 0x7f9c100b3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:36.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.616+0000 7f9c15200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c100ce740 0x7f9c101487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:36.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.617+0000 7f9c15200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c1015e4f0 0x7f9c10148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:36.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.617+0000 7f9c15200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1015e8d0 con 0x7f9c100ce740 2024-09-11T23:18:36.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.617+0000 7f9c15200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9c100d1b40 con 0x7f9c1006e720 2024-09-11T23:18:36.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.617+0000 7f9c15200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9c101f5080 con 0x7f9c1015e4f0 2024-09-11T23:18:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.617+0000 7f9c07e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c100ce740 0x7f9c101487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.617+0000 7f9c07e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c100ce740 0x7f9c101487e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57466/0 (socket says 172.21.15.144:57466) 2024-09-11T23:18:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.617+0000 7f9c07e00640 1 -- 172.21.15.144:0/1826923707 learned_addr learned my addr 172.21.15.144:0/1826923707 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.617+0000 7f9c0f400640 1 --2- 172.21.15.144:0/1826923707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c1006e720 0x7f9c100b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.617+0000 7f9c0fe00640 1 --2- 172.21.15.144:0/1826923707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c1015e4f0 0x7f9c10148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.617+0000 7f9c07e00640 1 -- 172.21.15.144:0/1826923707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c1015e4f0 msgr2=0x7f9c10148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.617+0000 7f9c07e00640 1 --2- 172.21.15.144:0/1826923707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c1015e4f0 0x7f9c10148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.617+0000 7f9c07e00640 1 -- 172.21.15.144:0/1826923707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c1006e720 msgr2=0x7f9c100b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.617+0000 7f9c07e00640 1 --2- 172.21.15.144:0/1826923707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c1006e720 0x7f9c100b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.617+0000 7f9c07e00640 1 -- 172.21.15.144:0/1826923707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c101f52d0 con 0x7f9c100ce740 2024-09-11T23:18:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.617+0000 7f9c0fe00640 1 --2- 172.21.15.144:0/1826923707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c1015e4f0 0x7f9c10148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.617+0000 7f9c07e00640 1 --2- 172.21.15.144:0/1826923707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c100ce740 0x7f9c101487e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800e860 tx=0x7f9bf800ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.618+0000 7f9c07400640 1 -- 172.21.15.144:0/1826923707 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8017070 con 0x7f9c100ce740 2024-09-11T23:18:36.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.618+0000 7f9c07400640 1 -- 172.21.15.144:0/1826923707 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf800c940 con 0x7f9c100ce740 2024-09-11T23:18:36.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.618+0000 7f9c07400640 1 -- 172.21.15.144:0/1826923707 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf800cd10 con 0x7f9c100ce740 2024-09-11T23:18:36.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.618+0000 7f9c15200640 1 -- 172.21.15.144:0/1826923707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c101f55b0 con 0x7f9c100ce740 2024-09-11T23:18:36.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.618+0000 7f9c15200640 1 -- 172.21.15.144:0/1826923707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c100b3760 con 0x7f9c100ce740 2024-09-11T23:18:36.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.619+0000 7f9c15200640 1 -- 172.21.15.144:0/1826923707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c1006e1e0 con 0x7f9c100ce740 2024-09-11T23:18:36.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.620+0000 7f9c07400640 1 -- 172.21.15.144:0/1826923707 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9bf801a070 con 0x7f9c100ce740 2024-09-11T23:18:36.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.621+0000 7f9c07400640 1 --2- 172.21.15.144:0/1826923707 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9bec06be60 0x7f9bec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:36.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.621+0000 7f9c07400640 1 -- 172.21.15.144:0/1826923707 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9bf808b170 con 0x7f9c100ce740 2024-09-11T23:18:36.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.621+0000 7f9c0f400640 1 --2- 172.21.15.144:0/1826923707 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9bec06be60 0x7f9bec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:36.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.622+0000 7f9c0f400640 1 --2- 172.21.15.144:0/1826923707 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9bec06be60 0x7f9bec06e320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9c00009b40 tx=0x7f9c00009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:36.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.625+0000 7f9c07400640 1 -- 172.21.15.144:0/1826923707 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9bf80594c0 con 0x7f9c100ce740 2024-09-11T23:18:36.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.800+0000 7f9c15200640 1 -- 172.21.15.144:0/1826923707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c100720b0 con 0x7f9c100ce740 2024-09-11T23:18:36.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.801+0000 7f9c07400640 1 -- 172.21.15.144:0/1826923707 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16689 (secure 0 0 0) 0x7f9bf805d7c0 con 0x7f9c100ce740 2024-09-11T23:18:36.801 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:36.802 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":22,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:18:00.633839+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:17:57.023145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:17:58.028864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:36.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.803+0000 7f9c15200640 1 -- 172.21.15.144:0/1826923707 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9bec06be60 msgr2=0x7f9bec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:36.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.803+0000 7f9c15200640 1 --2- 172.21.15.144:0/1826923707 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9bec06be60 0x7f9bec06e320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9c00009b40 tx=0x7f9c00009190 comp rx=0 tx=0).stop 2024-09-11T23:18:36.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.803+0000 7f9c15200640 1 -- 172.21.15.144:0/1826923707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c100ce740 msgr2=0x7f9c101487e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:36.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.803+0000 7f9c15200640 1 --2- 172.21.15.144:0/1826923707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c100ce740 0x7f9c101487e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800e860 tx=0x7f9bf800ed20 comp rx=0 tx=0).stop 2024-09-11T23:18:36.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.803+0000 7f9c15200640 1 -- 172.21.15.144:0/1826923707 shutdown_connections 2024-09-11T23:18:36.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.803+0000 7f9c15200640 1 --2- 172.21.15.144:0/1826923707 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9bec06be60 0x7f9bec06e320 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.803+0000 7f9c15200640 1 --2- 172.21.15.144:0/1826923707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c1015e4f0 0x7f9c10148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.803+0000 7f9c15200640 1 --2- 172.21.15.144:0/1826923707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c100ce740 0x7f9c101487e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.803+0000 7f9c15200640 1 --2- 172.21.15.144:0/1826923707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c1006e720 0x7f9c100b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.803+0000 7f9c15200640 1 -- 172.21.15.144:0/1826923707 >> 172.21.15.144:0/1826923707 conn(0x7f9c100b6700 msgr2=0x7f9c10159f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:36.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.803+0000 7f9c15200640 1 -- 172.21.15.144:0/1826923707 shutdown_connections 2024-09-11T23:18:36.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.803+0000 7f9c15200640 1 -- 172.21.15.144:0/1826923707 wait complete. 2024-09-11T23:18:36.819 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:18:36.820 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:36.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.971+0000 7f9052400640 1 Processor -- start 2024-09-11T23:18:36.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.972+0000 7f9052400640 1 -- start start 2024-09-11T23:18:36.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.973+0000 7f9052400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f904c0cf070 0x7f904c0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:36.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.973+0000 7f9052400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f904c073120 0x7f904c0735b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:36.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.973+0000 7f9052400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f904c0ce740 con 0x7f904c15c180 2024-09-11T23:18:36.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.973+0000 7f9052400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f904c072640 con 0x7f904c0cf070 2024-09-11T23:18:36.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.973+0000 7f9052400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f904c072920 con 0x7f904c073120 2024-09-11T23:18:36.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.973+0000 7f904b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f904c15c180 0x7f904c0cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34844/0 (socket says 172.21.15.144:34844) 2024-09-11T23:18:36.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.973+0000 7f904b400640 1 -- 172.21.15.144:0/1848915635 learned_addr learned my addr 172.21.15.144:0/1848915635 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:36.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.973+0000 7f9042a00640 1 --2- 172.21.15.144:0/1848915635 >> v2:172.21.15.165:3300/0 conn(0x7f904c0cf070 0x7f904c0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:36.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.973+0000 7f904be00640 1 --2- 172.21.15.144:0/1848915635 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f904c073120 0x7f904c0735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:36.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.974+0000 7f904aa00640 1 -- 172.21.15.144:0/1848915635 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2545376445 0 0) 0x7f904c0ce740 con 0x7f904c15c180 2024-09-11T23:18:36.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.974+0000 7f904aa00640 1 -- 172.21.15.144:0/1848915635 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9030003520 con 0x7f904c15c180 2024-09-11T23:18:36.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.974+0000 7f904be00640 1 -- 172.21.15.144:0/1848915635 >> v2:172.21.15.165:3300/0 conn(0x7f904c0cf070 msgr2=0x7f904c0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.974+0000 7f904be00640 1 --2- 172.21.15.144:0/1848915635 >> v2:172.21.15.165:3300/0 conn(0x7f904c0cf070 0x7f904c0cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.974+0000 7f904be00640 1 -- 172.21.15.144:0/1848915635 >> v1:172.21.15.144:6789/0 conn(0x7f904c15c180 legacy=0x7f904c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.974+0000 7f904be00640 1 -- 172.21.15.144:0/1848915635 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904c072c00 con 0x7f904c073120 2024-09-11T23:18:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.974+0000 7f9042a00640 1 --2- 172.21.15.144:0/1848915635 >> v2:172.21.15.165:3300/0 conn(0x7f904c0cf070 0x7f904c0cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.975+0000 7f904be00640 1 --2- 172.21.15.144:0/1848915635 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f904c073120 0x7f904c0735b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9044009d90 tx=0x7f904402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f69267ae316726d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.975+0000 7f904aa00640 1 -- 172.21.15.144:0/1848915635 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044031600 con 0x7f904c073120 2024-09-11T23:18:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.975+0000 7f904aa00640 1 -- 172.21.15.144:0/1848915635 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90440317a0 con 0x7f904c073120 2024-09-11T23:18:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.975+0000 7f904aa00640 1 -- 172.21.15.144:0/1848915635 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9044031b50 con 0x7f904c073120 2024-09-11T23:18:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.976+0000 7f9052400640 1 -- 172.21.15.144:0/1848915635 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f904c073120 msgr2=0x7f904c0735b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.976+0000 7f9052400640 1 --2- 172.21.15.144:0/1848915635 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f904c073120 0x7f904c0735b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9044009d90 tx=0x7f904402a5d0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.976+0000 7f9052400640 1 -- 172.21.15.144:0/1848915635 shutdown_connections 2024-09-11T23:18:36.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.976+0000 7f9052400640 1 --2- 172.21.15.144:0/1848915635 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f904c073120 0x7f904c0735b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.976+0000 7f9052400640 1 --2- 172.21.15.144:0/1848915635 >> v2:172.21.15.165:3300/0 conn(0x7f904c0cf070 0x7f904c0cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.976+0000 7f9052400640 1 -- 172.21.15.144:0/1848915635 >> 172.21.15.144:0/1848915635 conn(0x7f904c062cc0 msgr2=0x7f904c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:36.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.976+0000 7f9052400640 1 -- 172.21.15.144:0/1848915635 shutdown_connections 2024-09-11T23:18:36.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.976+0000 7f9052400640 1 -- 172.21.15.144:0/1848915635 wait complete. 2024-09-11T23:18:36.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.978+0000 7f9052400640 1 Processor -- start 2024-09-11T23:18:36.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.978+0000 7f9052400640 1 -- start start 2024-09-11T23:18:36.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.979+0000 7f9052400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f904c073120 0x7f904c149250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:36.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.979+0000 7f9052400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f904c0cf070 0x7f904c1e5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:36.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.979+0000 7f9052400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f904c15c180 0x7f904c159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:36.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.979+0000 7f9052400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f904c0722f0 con 0x7f904c0cf070 2024-09-11T23:18:36.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.979+0000 7f9052400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f904c0ced00 con 0x7f904c073120 2024-09-11T23:18:36.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.979+0000 7f9052400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f904c15c560 con 0x7f904c15c180 2024-09-11T23:18:36.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.979+0000 7f9042a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f904c0cf070 0x7f904c1e5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:36.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.979+0000 7f9042a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f904c0cf070 0x7f904c1e5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57476/0 (socket says 172.21.15.144:57476) 2024-09-11T23:18:36.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.979+0000 7f9042a00640 1 -- 172.21.15.144:0/2781338258 learned_addr learned my addr 172.21.15.144:0/2781338258 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:36.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.979+0000 7f9042a00640 1 -- 172.21.15.144:0/2781338258 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f904c15c180 msgr2=0x7f904c159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:36.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.979+0000 7f9042a00640 1 --2- 172.21.15.144:0/2781338258 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f904c15c180 0x7f904c159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.979+0000 7f9042a00640 1 -- 172.21.15.144:0/2781338258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f904c073120 msgr2=0x7f904c149250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:36.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.979+0000 7f9042a00640 1 --2- 172.21.15.144:0/2781338258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f904c073120 0x7f904c149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:36.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.979+0000 7f9042a00640 1 -- 172.21.15.144:0/2781338258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904c1e7680 con 0x7f904c0cf070 2024-09-11T23:18:36.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.980+0000 7f9042a00640 1 --2- 172.21.15.144:0/2781338258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f904c0cf070 0x7f904c1e5c70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f903400e940 tx=0x7f903400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:36.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.980+0000 7f9043e00640 1 -- 172.21.15.144:0/2781338258 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9034017070 con 0x7f904c0cf070 2024-09-11T23:18:36.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.980+0000 7f9043e00640 1 -- 172.21.15.144:0/2781338258 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f903400ca00 con 0x7f904c0cf070 2024-09-11T23:18:36.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.980+0000 7f9043e00640 1 -- 172.21.15.144:0/2781338258 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903400cdd0 con 0x7f904c0cf070 2024-09-11T23:18:36.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.980+0000 7f9052400640 1 -- 172.21.15.144:0/2781338258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f904c1e65e0 con 0x7f904c0cf070 2024-09-11T23:18:36.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.980+0000 7f9052400640 1 -- 172.21.15.144:0/2781338258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f904c1e6ba0 con 0x7f904c0cf070 2024-09-11T23:18:36.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.981+0000 7f9052400640 1 -- 172.21.15.144:0/2781338258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f904c0cf4e0 con 0x7f904c0cf070 2024-09-11T23:18:36.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.982+0000 7f9043e00640 1 -- 172.21.15.144:0/2781338258 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f903401a070 con 0x7f904c0cf070 2024-09-11T23:18:36.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.983+0000 7f9043e00640 1 --2- 172.21.15.144:0/2781338258 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f902806be30 0x7f902806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:36.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.983+0000 7f9043e00640 1 -- 172.21.15.144:0/2781338258 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f903408ae10 con 0x7f904c0cf070 2024-09-11T23:18:36.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.983+0000 7f904b400640 1 --2- 172.21.15.144:0/2781338258 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f902806be30 0x7f902806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:36.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.984+0000 7f904b400640 1 --2- 172.21.15.144:0/2781338258 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f902806be30 0x7f902806e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f903c000f60 tx=0x7f903c0078f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:36.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:36.987+0000 7f9043e00640 1 -- 172.21.15.144:0/2781338258 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f903408e030 con 0x7f904c0cf070 2024-09-11T23:18:37.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.195+0000 7f9052400640 1 -- 172.21.15.144:0/2781338258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f904c0b05b0 con 0x7f904c0cf070 2024-09-11T23:18:37.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.196+0000 7f9043e00640 1 -- 172.21.15.144:0/2781338258 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7f904c1e7680 con 0x7f904c0cf070 2024-09-11T23:18:37.196 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:37.196 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"btime":"2024-09-11T23:18:02:645252+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1741936320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1741936320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1741936320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1295491349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1295491349},{"type":"v1","addr":"172.21.15.144:6836","nonce":1295491349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1020006630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1020006630},{"type":"v1","addr":"172.21.15.144:6837","nonce":1020006630}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:59.036096+0000","modified":"2024-09-11T23:18:02.054236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2270648598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2270648598},{"type":"v1","addr":"172.21.15.165:6835","nonce":2270648598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-09-11T23:18:37.196 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-09-11T23:18:37.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.198+0000 7f9052400640 1 -- 172.21.15.144:0/2781338258 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f902806be30 msgr2=0x7f902806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:37.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.198+0000 7f9052400640 1 --2- 172.21.15.144:0/2781338258 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f902806be30 0x7f902806e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f903c000f60 tx=0x7f903c0078f0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.198+0000 7f9052400640 1 -- 172.21.15.144:0/2781338258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f904c0cf070 msgr2=0x7f904c1e5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:37.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.198+0000 7f9052400640 1 --2- 172.21.15.144:0/2781338258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f904c0cf070 0x7f904c1e5c70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f903400e940 tx=0x7f903400ee00 comp rx=0 tx=0).stop 2024-09-11T23:18:37.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.198+0000 7f9052400640 1 -- 172.21.15.144:0/2781338258 shutdown_connections 2024-09-11T23:18:37.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.198+0000 7f9052400640 1 --2- 172.21.15.144:0/2781338258 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f902806be30 0x7f902806e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.198+0000 7f9052400640 1 --2- 172.21.15.144:0/2781338258 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f904c15c180 0x7f904c159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.198+0000 7f9052400640 1 --2- 172.21.15.144:0/2781338258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f904c0cf070 0x7f904c1e5c70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.198+0000 7f9052400640 1 --2- 172.21.15.144:0/2781338258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f904c073120 0x7f904c149250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.198+0000 7f9052400640 1 -- 172.21.15.144:0/2781338258 >> 172.21.15.144:0/2781338258 conn(0x7f904c062cc0 msgr2=0x7f904c0b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:37.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.198+0000 7f9052400640 1 -- 172.21.15.144:0/2781338258 shutdown_connections 2024-09-11T23:18:37.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.198+0000 7f9052400640 1 -- 172.21.15.144:0/2781338258 wait complete. 2024-09-11T23:18:37.214 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:37.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.368+0000 7fb8fde00640 1 Processor -- start 2024-09-11T23:18:37.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.368+0000 7fb8fde00640 1 -- start start 2024-09-11T23:18:37.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.369+0000 7fb8fde00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb8f815e640 0x7fb8f80d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:37.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.369+0000 7fb8fde00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb8f80d3f60 0x7fb8f80b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:37.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.369+0000 7fb8fde00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8f806bee0 con 0x7fb8f80b6510 2024-09-11T23:18:37.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.369+0000 7fb8fde00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb8f815ea20 con 0x7fb8f80d3f60 2024-09-11T23:18:37.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.369+0000 7fb8fde00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb8f806caf0 con 0x7fb8f815e640 2024-09-11T23:18:37.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.369+0000 7fb8f7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb8f80d3f60 0x7fb8f80b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:37.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.369+0000 7fb8f7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb8f80d3f60 0x7fb8f80b5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57492/0 (socket says 172.21.15.144:57492) 2024-09-11T23:18:37.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.369+0000 7fb8f7e00640 1 -- 172.21.15.144:0/3146449157 learned_addr learned my addr 172.21.15.144:0/3146449157 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:37.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.369+0000 7fb8fca00640 1 --2- 172.21.15.144:0/3146449157 >> v2:172.21.15.165:3300/0 conn(0x7fb8f815e640 0x7fb8f80d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:37.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.370+0000 7fb8f7e00640 1 -- 172.21.15.144:0/3146449157 >> v2:172.21.15.165:3300/0 conn(0x7fb8f815e640 msgr2=0x7fb8f80d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:37.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.370+0000 7fb8f7e00640 1 --2- 172.21.15.144:0/3146449157 >> v2:172.21.15.165:3300/0 conn(0x7fb8f815e640 0x7fb8f80d3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.370+0000 7fb8f7e00640 1 -- 172.21.15.144:0/3146449157 >> v1:172.21.15.165:6789/0 conn(0x7fb8f80b6510 legacy=0x7fb8f80d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:37.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.370+0000 7fb8f7e00640 1 -- 172.21.15.144:0/3146449157 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f806c1c0 con 0x7fb8f80d3f60 2024-09-11T23:18:37.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.371+0000 7fb8f7e00640 1 --2- 172.21.15.144:0/3146449157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f80d3f60 0x7fb8f80b5fd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80d2030 tx=0x7fb8e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198f315329a25882 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:37.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.371+0000 7fb8f7400640 1 -- 172.21.15.144:0/3146449157 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4037070 con 0x7fb8f80d3f60 2024-09-11T23:18:37.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.371+0000 7fb8f7400640 1 -- 172.21.15.144:0/3146449157 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e4032440 con 0x7fb8f80d3f60 2024-09-11T23:18:37.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.371+0000 7fb8f7400640 1 -- 172.21.15.144:0/3146449157 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4032810 con 0x7fb8f80d3f60 2024-09-11T23:18:37.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.372+0000 7fb8fde00640 1 -- 172.21.15.144:0/3146449157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f80d3f60 msgr2=0x7fb8f80b5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:37.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.372+0000 7fb8fde00640 1 --2- 172.21.15.144:0/3146449157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f80d3f60 0x7fb8f80b5fd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80d2030 tx=0x7fb8e402a270 comp rx=0 tx=0).stop 2024-09-11T23:18:37.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.372+0000 7fb8fde00640 1 -- 172.21.15.144:0/3146449157 shutdown_connections 2024-09-11T23:18:37.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.372+0000 7fb8fde00640 1 --2- 172.21.15.144:0/3146449157 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f80d3f60 0x7fb8f80b5fd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.372+0000 7fb8fde00640 1 --2- 172.21.15.144:0/3146449157 >> v2:172.21.15.165:3300/0 conn(0x7fb8f815e640 0x7fb8f80d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.372+0000 7fb8fde00640 1 -- 172.21.15.144:0/3146449157 >> 172.21.15.144:0/3146449157 conn(0x7fb8f80d0fd0 msgr2=0x7fb8f80d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:37.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.372+0000 7fb8fde00640 1 -- 172.21.15.144:0/3146449157 shutdown_connections 2024-09-11T23:18:37.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.372+0000 7fb8fde00640 1 -- 172.21.15.144:0/3146449157 wait complete. 2024-09-11T23:18:37.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.373+0000 7fb8fde00640 1 Processor -- start 2024-09-11T23:18:37.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.374+0000 7fb8fde00640 1 -- start start 2024-09-11T23:18:37.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.374+0000 7fb8fde00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8f80b6510 0x7fb8f814e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:37.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.374+0000 7fb8fde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f80d3f60 0x7fb8f8151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:37.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.374+0000 7fb8fde00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8f815e640 0x7fb8f80ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:37.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.374+0000 7fb8fde00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f80b8760 con 0x7fb8f80d3f60 2024-09-11T23:18:37.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.375+0000 7fb8fde00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f806c780 con 0x7fb8f80b6510 2024-09-11T23:18:37.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.375+0000 7fb8fde00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f80b88e0 con 0x7fb8f815e640 2024-09-11T23:18:37.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.375+0000 7fb8f7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f80d3f60 0x7fb8f8151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:37.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.375+0000 7fb8f7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f80d3f60 0x7fb8f8151540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57498/0 (socket says 172.21.15.144:57498) 2024-09-11T23:18:37.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.375+0000 7fb8f7e00640 1 -- 172.21.15.144:0/3294379599 learned_addr learned my addr 172.21.15.144:0/3294379599 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:37.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.375+0000 7fb8fca00640 1 --2- 172.21.15.144:0/3294379599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8f80b6510 0x7fb8f814e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:37.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.375+0000 7fb8fd400640 1 --2- 172.21.15.144:0/3294379599 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8f815e640 0x7fb8f80ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:37.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.375+0000 7fb8f7e00640 1 -- 172.21.15.144:0/3294379599 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8f815e640 msgr2=0x7fb8f80ac270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:37.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.375+0000 7fb8f7e00640 1 --2- 172.21.15.144:0/3294379599 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8f815e640 0x7fb8f80ac270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.375+0000 7fb8f7e00640 1 -- 172.21.15.144:0/3294379599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8f80b6510 msgr2=0x7fb8f814e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:37.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.375+0000 7fb8f7e00640 1 --2- 172.21.15.144:0/3294379599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8f80b6510 0x7fb8f814e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.375+0000 7fb8f7e00640 1 -- 172.21.15.144:0/3294379599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f80aef40 con 0x7fb8f80d3f60 2024-09-11T23:18:37.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.375+0000 7fb8f7e00640 1 --2- 172.21.15.144:0/3294379599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f80d3f60 0x7fb8f8151540 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb8e402a2b0 tx=0x7fb8e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:37.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.376+0000 7fb8f4c00640 1 -- 172.21.15.144:0/3294379599 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4037040 con 0x7fb8f80d3f60 2024-09-11T23:18:37.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.376+0000 7fb8f4c00640 1 -- 172.21.15.144:0/3294379599 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e4042070 con 0x7fb8f80d3f60 2024-09-11T23:18:37.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.376+0000 7fb8f4c00640 1 -- 172.21.15.144:0/3294379599 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4030880 con 0x7fb8f80d3f60 2024-09-11T23:18:37.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.376+0000 7fb8fde00640 1 -- 172.21.15.144:0/3294379599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f8151a80 con 0x7fb8f80d3f60 2024-09-11T23:18:37.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.376+0000 7fb8fde00640 1 -- 172.21.15.144:0/3294379599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f814f220 con 0x7fb8f80d3f60 2024-09-11T23:18:37.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.377+0000 7fb8fde00640 1 -- 172.21.15.144:0/3294379599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8f80b5fd0 con 0x7fb8f80d3f60 2024-09-11T23:18:37.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.378+0000 7fb8f4c00640 1 -- 172.21.15.144:0/3294379599 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb8e4030a20 con 0x7fb8f80d3f60 2024-09-11T23:18:37.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.379+0000 7fb8f4c00640 1 --2- 172.21.15.144:0/3294379599 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb8d806be60 0x7fb8d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:37.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.379+0000 7fb8f4c00640 1 -- 172.21.15.144:0/3294379599 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb8e40ab530 con 0x7fb8f80d3f60 2024-09-11T23:18:37.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.379+0000 7fb8fca00640 1 --2- 172.21.15.144:0/3294379599 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb8d806be60 0x7fb8d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:37.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.379+0000 7fb8fca00640 1 --2- 172.21.15.144:0/3294379599 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb8d806be60 0x7fb8d806e320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80ac1c0 tx=0x7fb8ec009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:37.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.383+0000 7fb8f4c00640 1 -- 172.21.15.144:0/3294379599 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb8e4079f70 con 0x7fb8f80d3f60 2024-09-11T23:18:37.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.589+0000 7fb8fde00640 1 -- 172.21.15.144:0/3294379599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8f80d3830 con 0x7fb8f80d3f60 2024-09-11T23:18:37.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.589+0000 7fb8f4c00640 1 -- 172.21.15.144:0/3294379599 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5229 (secure 0 0 0) 0x7fb8e4079870 con 0x7fb8f80d3f60 2024-09-11T23:18:37.589 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:37.590 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":8,"btime":"2024-09-11T23:18:02:645252+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/1741936320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1741936320},{"type":"v1","addr":"172.21.15.165:6833","nonce":1741936320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1295491349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1295491349},{"type":"v1","addr":"172.21.15.144:6836","nonce":1295491349}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1020006630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1020006630},{"type":"v1","addr":"172.21.15.144:6837","nonce":1020006630}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:17:59.036096+0000","modified":"2024-09-11T23:18:02.054236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/2270648598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2270648598},{"type":"v1","addr":"172.21.15.165:6835","nonce":2270648598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-09-11T23:18:37.590 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 8 2024-09-11T23:18:37.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.592+0000 7fb8fde00640 1 -- 172.21.15.144:0/3294379599 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb8d806be60 msgr2=0x7fb8d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:37.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.592+0000 7fb8fde00640 1 --2- 172.21.15.144:0/3294379599 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb8d806be60 0x7fb8d806e320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80ac1c0 tx=0x7fb8ec009190 comp rx=0 tx=0).stop 2024-09-11T23:18:37.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.592+0000 7fb8fde00640 1 -- 172.21.15.144:0/3294379599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f80d3f60 msgr2=0x7fb8f8151540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:37.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.592+0000 7fb8fde00640 1 --2- 172.21.15.144:0/3294379599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f80d3f60 0x7fb8f8151540 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb8e402a2b0 tx=0x7fb8e40046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.592+0000 7fb8fde00640 1 -- 172.21.15.144:0/3294379599 shutdown_connections 2024-09-11T23:18:37.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.592+0000 7fb8fde00640 1 --2- 172.21.15.144:0/3294379599 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb8d806be60 0x7fb8d806e320 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.592+0000 7fb8fde00640 1 --2- 172.21.15.144:0/3294379599 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8f815e640 0x7fb8f80ac270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.592+0000 7fb8fde00640 1 --2- 172.21.15.144:0/3294379599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f80d3f60 0x7fb8f8151540 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.592+0000 7fb8fde00640 1 --2- 172.21.15.144:0/3294379599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8f80b6510 0x7fb8f814e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.592+0000 7fb8fde00640 1 -- 172.21.15.144:0/3294379599 >> 172.21.15.144:0/3294379599 conn(0x7fb8f80d0fd0 msgr2=0x7fb8f80b75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:37.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.592+0000 7fb8fde00640 1 -- 172.21.15.144:0/3294379599 shutdown_connections 2024-09-11T23:18:37.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.592+0000 7fb8fde00640 1 -- 172.21.15.144:0/3294379599 wait complete. 2024-09-11T23:18:37.609 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:18:37.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.762+0000 7f41a7400640 1 Processor -- start 2024-09-11T23:18:37.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.762+0000 7f41a7400640 1 -- start start 2024-09-11T23:18:37.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.763+0000 7f41a7400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f41a006ccb0 0x7f41a006d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:37.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.763+0000 7f41a7400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a00741c0 con 0x7f41a00b5600 2024-09-11T23:18:37.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.763+0000 7f41a7400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a006e8d0 con 0x7f41a015e7b0 2024-09-11T23:18:37.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.763+0000 7f41a7400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f41a006e680 con 0x7f41a006ccb0 2024-09-11T23:18:37.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.764+0000 7f41a5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f41a006ccb0 0x7f41a006d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:37.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.764+0000 7f419fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f41a00b5600 0x7f41a0073ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34852/0 (socket says 172.21.15.144:34852) 2024-09-11T23:18:37.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.764+0000 7f419fe00640 1 -- 172.21.15.144:0/152934873 learned_addr learned my addr 172.21.15.144:0/152934873 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:37.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.764+0000 7f41a5400640 1 -- 172.21.15.144:0/152934873 >> v1:172.21.15.165:6789/0 conn(0x7f41a015e7b0 legacy=0x7f41a0071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:37.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.764+0000 7f41a5400640 1 -- 172.21.15.144:0/152934873 >> v1:172.21.15.144:6789/0 conn(0x7f41a00b5600 legacy=0x7f41a0073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:37.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.764+0000 7f41a5400640 1 -- 172.21.15.144:0/152934873 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a006ebb0 con 0x7f41a006ccb0 2024-09-11T23:18:37.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.764+0000 7f419f400640 1 -- 172.21.15.144:0/152934873 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2514164108 0 0) 0x7f41a00741c0 con 0x7f41a00b5600 2024-09-11T23:18:37.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.765+0000 7f41a5400640 1 --2- 172.21.15.144:0/152934873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41a006ccb0 0x7f41a006d0d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4198009d90 tx=0x7f419802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188bda3a29195f3e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:37.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.765+0000 7f419f400640 1 -- 172.21.15.144:0/152934873 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4198007740 con 0x7f41a006ccb0 2024-09-11T23:18:37.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.765+0000 7f419f400640 1 -- 172.21.15.144:0/152934873 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41980078e0 con 0x7f41a006ccb0 2024-09-11T23:18:37.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.765+0000 7f419f400640 1 -- 172.21.15.144:0/152934873 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4198007cb0 con 0x7f41a006ccb0 2024-09-11T23:18:37.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.766+0000 7f41a7400640 1 -- 172.21.15.144:0/152934873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41a006ccb0 msgr2=0x7f41a006d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:37.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.766+0000 7f41a7400640 1 --2- 172.21.15.144:0/152934873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41a006ccb0 0x7f41a006d0d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4198009d90 tx=0x7f419802a660 comp rx=0 tx=0).stop 2024-09-11T23:18:37.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.766+0000 7f41a7400640 1 -- 172.21.15.144:0/152934873 shutdown_connections 2024-09-11T23:18:37.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.766+0000 7f41a7400640 1 --2- 172.21.15.144:0/152934873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41a006ccb0 0x7f41a006d0d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.766+0000 7f41a7400640 1 -- 172.21.15.144:0/152934873 >> 172.21.15.144:0/152934873 conn(0x7f41a00b4300 msgr2=0x7f41a00b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:37.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.766+0000 7f41a7400640 1 -- 172.21.15.144:0/152934873 shutdown_connections 2024-09-11T23:18:37.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.766+0000 7f41a7400640 1 -- 172.21.15.144:0/152934873 wait complete. 2024-09-11T23:18:37.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.768+0000 7f41a7400640 1 Processor -- start 2024-09-11T23:18:37.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.768+0000 7f41a7400640 1 -- start start 2024-09-11T23:18:37.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.769+0000 7f41a7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41a006ccb0 0x7f41a0157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:37.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.769+0000 7f41a7400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41a00b5600 0x7f41a0160ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:37.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.769+0000 7f41a7400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41a015e7b0 0x7f41a0161400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:37.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.769+0000 7f41a7400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f41a006d610 con 0x7f41a006ccb0 2024-09-11T23:18:37.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.769+0000 7f41a7400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f41a0073590 con 0x7f41a00b5600 2024-09-11T23:18:37.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.769+0000 7f41a7400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f41a00b6ce0 con 0x7f41a015e7b0 2024-09-11T23:18:37.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.769+0000 7f41a4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41a006ccb0 0x7f41a0157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:37.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.769+0000 7f41a4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41a006ccb0 0x7f41a0157880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57510/0 (socket says 172.21.15.144:57510) 2024-09-11T23:18:37.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.769+0000 7f41a4a00640 1 -- 172.21.15.144:0/3648111361 learned_addr learned my addr 172.21.15.144:0/3648111361 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:37.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.769+0000 7f41a4a00640 1 -- 172.21.15.144:0/3648111361 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41a015e7b0 msgr2=0x7f41a0161400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:37.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.769+0000 7f41a4a00640 1 --2- 172.21.15.144:0/3648111361 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41a015e7b0 0x7f41a0161400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.769+0000 7f41a4a00640 1 -- 172.21.15.144:0/3648111361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41a00b5600 msgr2=0x7f41a0160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:37.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.769+0000 7f41a4a00640 1 --2- 172.21.15.144:0/3648111361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41a00b5600 0x7f41a0160ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.769+0000 7f41a4a00640 1 -- 172.21.15.144:0/3648111361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a0161d20 con 0x7f41a006ccb0 2024-09-11T23:18:37.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.769+0000 7f41a4a00640 1 --2- 172.21.15.144:0/3648111361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41a006ccb0 0x7f41a0157880 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f419400c400 tx=0x7f419400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:37.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.770+0000 7f419cc00640 1 -- 172.21.15.144:0/3648111361 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4194017070 con 0x7f41a006ccb0 2024-09-11T23:18:37.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.770+0000 7f419cc00640 1 -- 172.21.15.144:0/3648111361 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41940052d0 con 0x7f41a006ccb0 2024-09-11T23:18:37.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.770+0000 7f419cc00640 1 -- 172.21.15.144:0/3648111361 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4194003830 con 0x7f41a006ccb0 2024-09-11T23:18:37.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.770+0000 7f41a7400640 1 -- 172.21.15.144:0/3648111361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a01e7bf0 con 0x7f41a006ccb0 2024-09-11T23:18:37.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.770+0000 7f41a7400640 1 -- 172.21.15.144:0/3648111361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a01e81b0 con 0x7f41a006ccb0 2024-09-11T23:18:37.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.771+0000 7f41a7400640 1 -- 172.21.15.144:0/3648111361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a006d0d0 con 0x7f41a006ccb0 2024-09-11T23:18:37.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.772+0000 7f419cc00640 1 -- 172.21.15.144:0/3648111361 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f419401a070 con 0x7f41a006ccb0 2024-09-11T23:18:37.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.773+0000 7f419cc00640 1 --2- 172.21.15.144:0/3648111361 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f418006be60 0x7f418006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:37.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.773+0000 7f419cc00640 1 -- 172.21.15.144:0/3648111361 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f419408a1c0 con 0x7f41a006ccb0 2024-09-11T23:18:37.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.773+0000 7f419fe00640 1 --2- 172.21.15.144:0/3648111361 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f418006be60 0x7f418006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:37.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.774+0000 7f419fe00640 1 --2- 172.21.15.144:0/3648111361 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f418006be60 0x7f418006e320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f418c007fd0 tx=0x7f418c007900 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:37.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.777+0000 7f419cc00640 1 -- 172.21.15.144:0/3648111361 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41a0161d20 con 0x7f41a006ccb0 2024-09-11T23:18:37.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.950+0000 7f41a7400640 1 -- 172.21.15.144:0/3648111361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41a00b1a90 con 0x7f41a006ccb0 2024-09-11T23:18:37.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.952+0000 7f419cc00640 1 -- 172.21.15.144:0/3648111361 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16689 (secure 0 0 0) 0x7f4194058b60 con 0x7f41a006ccb0 2024-09-11T23:18:37.955 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:37.955 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":22,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:18:00.633839+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:17:57.023145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T23:17:58.028864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:37.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.954+0000 7f41a7400640 1 -- 172.21.15.144:0/3648111361 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f418006be60 msgr2=0x7f418006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:37.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.954+0000 7f41a7400640 1 --2- 172.21.15.144:0/3648111361 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f418006be60 0x7f418006e320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f418c007fd0 tx=0x7f418c007900 comp rx=0 tx=0).stop 2024-09-11T23:18:37.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.954+0000 7f41a7400640 1 -- 172.21.15.144:0/3648111361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41a006ccb0 msgr2=0x7f41a0157880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:37.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.954+0000 7f41a7400640 1 --2- 172.21.15.144:0/3648111361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41a006ccb0 0x7f41a0157880 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f419400c400 tx=0x7f419400c8c0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.954+0000 7f41a7400640 1 -- 172.21.15.144:0/3648111361 shutdown_connections 2024-09-11T23:18:37.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.954+0000 7f41a7400640 1 --2- 172.21.15.144:0/3648111361 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f418006be60 0x7f418006e320 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.954+0000 7f41a7400640 1 --2- 172.21.15.144:0/3648111361 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f41a015e7b0 0x7f41a0161400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.954+0000 7f41a7400640 1 --2- 172.21.15.144:0/3648111361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f41a00b5600 0x7f41a0160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.954+0000 7f41a7400640 1 --2- 172.21.15.144:0/3648111361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41a006ccb0 0x7f41a0157880 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:37.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.954+0000 7f41a7400640 1 -- 172.21.15.144:0/3648111361 >> 172.21.15.144:0/3648111361 conn(0x7f41a00b4300 msgr2=0x7f41a00b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:37.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.954+0000 7f41a7400640 1 -- 172.21.15.144:0/3648111361 shutdown_connections 2024-09-11T23:18:37.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:37.954+0000 7f41a7400640 1 -- 172.21.15.144:0/3648111361 wait complete. 2024-09-11T23:18:37.970 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:18:38.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.125+0000 7fef96200640 1 Processor -- start 2024-09-11T23:18:38.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.125+0000 7fef96200640 1 -- start start 2024-09-11T23:18:38.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.126+0000 7fef96200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fef900d02a0 0x7fef900d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:38.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.126+0000 7fef96200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fef9015ca40 0x7fef9015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:38.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.127+0000 7fef96200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef900d0bc0 con 0x7fef9015ce80 2024-09-11T23:18:38.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.127+0000 7fef96200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fef9015d390 con 0x7fef9015ca40 2024-09-11T23:18:38.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.127+0000 7fef96200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fef9015d670 con 0x7fef900d02a0 2024-09-11T23:18:38.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.127+0000 7fef8ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fef9015ca40 0x7fef9015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:38.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.127+0000 7fef8ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fef9015ca40 0x7fef9015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57518/0 (socket says 172.21.15.144:57518) 2024-09-11T23:18:38.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.127+0000 7fef8ea00640 1 -- 172.21.15.144:0/4227853329 learned_addr learned my addr 172.21.15.144:0/4227853329 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:38.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.127+0000 7fef8f400640 1 --2- 172.21.15.144:0/4227853329 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fef900d02a0 0x7fef900d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:38.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.127+0000 7fef8ea00640 1 -- 172.21.15.144:0/4227853329 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fef900d02a0 msgr2=0x7fef900d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:38.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.127+0000 7fef8ea00640 1 --2- 172.21.15.144:0/4227853329 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fef900d02a0 0x7fef900d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:38.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.127+0000 7fef8ea00640 1 -- 172.21.15.144:0/4227853329 >> v1:172.21.15.165:6789/0 conn(0x7fef9015ce80 legacy=0x7fef901594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:38.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.127+0000 7fef8ea00640 1 -- 172.21.15.144:0/4227853329 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef9015d950 con 0x7fef9015ca40 2024-09-11T23:18:38.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.128+0000 7fef8ea00640 1 --2- 172.21.15.144:0/4227853329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef9015ca40 0x7fef9015e430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009870 tx=0x7fef7c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=face89eeb04cff7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:38.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.128+0000 7fef8e000640 1 -- 172.21.15.144:0/4227853329 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c037070 con 0x7fef9015ca40 2024-09-11T23:18:38.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.129+0000 7fef8e000640 1 -- 172.21.15.144:0/4227853329 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef7c032440 con 0x7fef9015ca40 2024-09-11T23:18:38.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.129+0000 7fef8e000640 1 -- 172.21.15.144:0/4227853329 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c032810 con 0x7fef9015ca40 2024-09-11T23:18:38.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.129+0000 7fef96200640 1 -- 172.21.15.144:0/4227853329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef9015ca40 msgr2=0x7fef9015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:38.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.129+0000 7fef96200640 1 --2- 172.21.15.144:0/4227853329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef9015ca40 0x7fef9015e430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009870 tx=0x7fef7c02a1c0 comp rx=0 tx=0).stop 2024-09-11T23:18:38.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.129+0000 7fef96200640 1 -- 172.21.15.144:0/4227853329 shutdown_connections 2024-09-11T23:18:38.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.129+0000 7fef96200640 1 --2- 172.21.15.144:0/4227853329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef9015ca40 0x7fef9015e430 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:38.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.129+0000 7fef96200640 1 --2- 172.21.15.144:0/4227853329 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fef900d02a0 0x7fef900d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:38.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.129+0000 7fef96200640 1 -- 172.21.15.144:0/4227853329 >> 172.21.15.144:0/4227853329 conn(0x7fef90062cc0 msgr2=0x7fef9006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:38.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.129+0000 7fef96200640 1 -- 172.21.15.144:0/4227853329 shutdown_connections 2024-09-11T23:18:38.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.129+0000 7fef96200640 1 -- 172.21.15.144:0/4227853329 wait complete. 2024-09-11T23:18:38.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.131+0000 7fef96200640 1 Processor -- start 2024-09-11T23:18:38.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.131+0000 7fef96200640 1 -- start start 2024-09-11T23:18:38.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.132+0000 7fef96200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fef900d02a0 0x7fef900b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:38.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.132+0000 7fef96200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef9015ca40 0x7fef90148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:38.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.132+0000 7fef96200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef9015ce80 0x7fef900b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:38.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.132+0000 7fef96200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fef90155b90 con 0x7fef9015ca40 2024-09-11T23:18:38.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.132+0000 7fef96200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fef9015df10 con 0x7fef9015ce80 2024-09-11T23:18:38.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.132+0000 7fef96200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fef90155d10 con 0x7fef900d02a0 2024-09-11T23:18:38.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.132+0000 7fef8ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef9015ca40 0x7fef90148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:38.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.132+0000 7fef8ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef9015ca40 0x7fef90148950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57528/0 (socket says 172.21.15.144:57528) 2024-09-11T23:18:38.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.132+0000 7fef8ea00640 1 -- 172.21.15.144:0/1637893643 learned_addr learned my addr 172.21.15.144:0/1637893643 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:38.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.132+0000 7fef8f400640 1 --2- 172.21.15.144:0/1637893643 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fef900d02a0 0x7fef900b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:38.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.132+0000 7fef8fe00640 1 --2- 172.21.15.144:0/1637893643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef9015ce80 0x7fef900b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:38.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.132+0000 7fef8ea00640 1 -- 172.21.15.144:0/1637893643 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fef900d02a0 msgr2=0x7fef900b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:38.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.132+0000 7fef8ea00640 1 --2- 172.21.15.144:0/1637893643 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fef900d02a0 0x7fef900b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:38.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.132+0000 7fef8ea00640 1 -- 172.21.15.144:0/1637893643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef9015ce80 msgr2=0x7fef900b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:38.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.132+0000 7fef8ea00640 1 --2- 172.21.15.144:0/1637893643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef9015ce80 0x7fef900b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:38.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.132+0000 7fef8ea00640 1 -- 172.21.15.144:0/1637893643 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef900b09d0 con 0x7fef9015ca40 2024-09-11T23:18:38.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.133+0000 7fef8ea00640 1 --2- 172.21.15.144:0/1637893643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef9015ca40 0x7fef90148950 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fef7c02a200 tx=0x7fef7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:38.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.133+0000 7fef87400640 1 -- 172.21.15.144:0/1637893643 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c041020 con 0x7fef9015ca40 2024-09-11T23:18:38.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.133+0000 7fef87400640 1 -- 172.21.15.144:0/1637893643 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef7c0306c0 con 0x7fef9015ca40 2024-09-11T23:18:38.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.133+0000 7fef96200640 1 -- 172.21.15.144:0/1637893643 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef901679a0 con 0x7fef9015ca40 2024-09-11T23:18:38.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.133+0000 7fef87400640 1 -- 172.21.15.144:0/1637893643 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c037040 con 0x7fef9015ca40 2024-09-11T23:18:38.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.133+0000 7fef96200640 1 -- 172.21.15.144:0/1637893643 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef90168a80 con 0x7fef9015ca40 2024-09-11T23:18:38.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.134+0000 7fef96200640 1 -- 172.21.15.144:0/1637893643 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef900b4790 con 0x7fef9015ca40 2024-09-11T23:18:38.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.135+0000 7fef87400640 1 -- 172.21.15.144:0/1637893643 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef7c044020 con 0x7fef9015ca40 2024-09-11T23:18:38.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.136+0000 7fef87400640 1 --2- 172.21.15.144:0/1637893643 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fef7006be30 0x7fef7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:38.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.137+0000 7fef87400640 1 -- 172.21.15.144:0/1637893643 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fef7c0ab540 con 0x7fef9015ca40 2024-09-11T23:18:38.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.137+0000 7fef8f400640 1 --2- 172.21.15.144:0/1637893643 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fef7006be30 0x7fef7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:38.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.137+0000 7fef8f400640 1 --2- 172.21.15.144:0/1637893643 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fef7006be30 0x7fef7006e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fef901689b0 tx=0x7fef80008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:38.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.141+0000 7fef87400640 1 -- 172.21.15.144:0/1637893643 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fef7c04b030 con 0x7fef9015ca40 2024-09-11T23:18:38.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.352+0000 7fef96200640 1 -- 172.21.15.144:0/1637893643 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fef9006d320 con 0x7fef9015ca40 2024-09-11T23:18:38.353 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-11T23:18:38.353+0000 7f86fcc00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:18:38.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.356+0000 7fef87400640 1 -- 172.21.15.144:0/1637893643 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7fef900b09d0 con 0x7fef9015ca40 2024-09-11T23:18:38.356 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:18:38.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.358+0000 7fef96200640 1 -- 172.21.15.144:0/1637893643 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fef7006be30 msgr2=0x7fef7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:38.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.358+0000 7fef96200640 1 --2- 172.21.15.144:0/1637893643 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fef7006be30 0x7fef7006e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fef901689b0 tx=0x7fef80008040 comp rx=0 tx=0).stop 2024-09-11T23:18:38.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.358+0000 7fef96200640 1 -- 172.21.15.144:0/1637893643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef9015ca40 msgr2=0x7fef90148950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:38.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.358+0000 7fef96200640 1 --2- 172.21.15.144:0/1637893643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef9015ca40 0x7fef90148950 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fef7c02a200 tx=0x7fef7c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:38.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.359+0000 7fef96200640 1 -- 172.21.15.144:0/1637893643 shutdown_connections 2024-09-11T23:18:38.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.359+0000 7fef96200640 1 --2- 172.21.15.144:0/1637893643 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fef7006be30 0x7fef7006e2f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:38.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.359+0000 7fef96200640 1 --2- 172.21.15.144:0/1637893643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef9015ce80 0x7fef900b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:38.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.359+0000 7fef96200640 1 --2- 172.21.15.144:0/1637893643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef9015ca40 0x7fef90148950 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:38.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.359+0000 7fef96200640 1 --2- 172.21.15.144:0/1637893643 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fef900d02a0 0x7fef900b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:38.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.359+0000 7fef96200640 1 -- 172.21.15.144:0/1637893643 >> 172.21.15.144:0/1637893643 conn(0x7fef90062cc0 msgr2=0x7fef900cdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:38.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.359+0000 7fef96200640 1 -- 172.21.15.144:0/1637893643 shutdown_connections 2024-09-11T23:18:38.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.359+0000 7fef96200640 1 -- 172.21.15.144:0/1637893643 wait complete. 2024-09-11T23:18:38.372 INFO:tasks.ceph.mds.d.smithi165.stderr: -7049> 2024-09-11T23:18:04.602+0000 7f6e15c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:18:38.375 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:18:38.425 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-11T23:18:38.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.534+0000 7f770ea00640 1 Processor -- start 2024-09-11T23:18:38.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.534+0000 7f770ea00640 1 -- start start 2024-09-11T23:18:38.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.536+0000 7f770ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7708158e50 0x7f77080b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:38.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.536+0000 7f770ea00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f770815c370 0x7f770806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:38.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.536+0000 7f770ea00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f770815c800 con 0x7f770806ef60 2024-09-11T23:18:38.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.536+0000 7f770ea00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f77080b43f0 con 0x7f7708158e50 2024-09-11T23:18:38.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.536+0000 7f770ea00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f77080b3630 con 0x7f770815c370 2024-09-11T23:18:38.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.536+0000 7f7707e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7708158e50 0x7f77080b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:38.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.536+0000 7f7707e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7708158e50 0x7f77080b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57542/0 (socket says 172.21.15.144:57542) 2024-09-11T23:18:38.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.536+0000 7f7707e00640 1 -- 172.21.15.144:0/3470660416 learned_addr learned my addr 172.21.15.144:0/3470660416 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:38.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.536+0000 7f76ff400640 1 --2- 172.21.15.144:0/3470660416 >> v2:172.21.15.165:3300/0 conn(0x7f770815c370 0x7f770806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:38.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.536+0000 7f7707e00640 1 -- 172.21.15.144:0/3470660416 >> v2:172.21.15.165:3300/0 conn(0x7f770815c370 msgr2=0x7f770806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:38.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.536+0000 7f7707e00640 1 --2- 172.21.15.144:0/3470660416 >> v2:172.21.15.165:3300/0 conn(0x7f770815c370 0x7f770806ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:38.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.536+0000 7f7707e00640 1 -- 172.21.15.144:0/3470660416 >> v1:172.21.15.165:6789/0 conn(0x7f770806ef60 legacy=0x7f770815ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:38.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.536+0000 7f7707e00640 1 -- 172.21.15.144:0/3470660416 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77080b3910 con 0x7f7708158e50 2024-09-11T23:18:38.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.537+0000 7f7707e00640 1 --2- 172.21.15.144:0/3470660416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7708158e50 0x7f77080b5050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f77080cdd40 tx=0x7f76f802c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4dee989b9fb046 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:38.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.538+0000 7f7707400640 1 -- 172.21.15.144:0/3470660416 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f8038070 con 0x7f7708158e50 2024-09-11T23:18:38.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.538+0000 7f7707400640 1 -- 172.21.15.144:0/3470660416 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76f8031710 con 0x7f7708158e50 2024-09-11T23:18:38.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.538+0000 7f7707400640 1 -- 172.21.15.144:0/3470660416 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f8031ae0 con 0x7f7708158e50 2024-09-11T23:18:38.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.538+0000 7f770ea00640 1 -- 172.21.15.144:0/3470660416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7708158e50 msgr2=0x7f77080b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:38.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.538+0000 7f770ea00640 1 --2- 172.21.15.144:0/3470660416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7708158e50 0x7f77080b5050 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f77080cdd40 tx=0x7f76f802c480 comp rx=0 tx=0).stop 2024-09-11T23:18:38.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.538+0000 7f770ea00640 1 -- 172.21.15.144:0/3470660416 shutdown_connections 2024-09-11T23:18:38.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.538+0000 7f770ea00640 1 --2- 172.21.15.144:0/3470660416 >> v2:172.21.15.165:3300/0 conn(0x7f770815c370 0x7f770806ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:38.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.538+0000 7f770ea00640 1 --2- 172.21.15.144:0/3470660416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7708158e50 0x7f77080b5050 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:38.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.538+0000 7f770ea00640 1 -- 172.21.15.144:0/3470660416 >> 172.21.15.144:0/3470660416 conn(0x7f770806bba0 msgr2=0x7f770806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:38.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.538+0000 7f770ea00640 1 -- 172.21.15.144:0/3470660416 shutdown_connections 2024-09-11T23:18:38.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.538+0000 7f770ea00640 1 -- 172.21.15.144:0/3470660416 wait complete. 2024-09-11T23:18:38.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.540+0000 7f770ea00640 1 Processor -- start 2024-09-11T23:18:38.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.540+0000 7f770ea00640 1 -- start start 2024-09-11T23:18:38.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.541+0000 7f770ea00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f770806ef60 0x7f7708151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:38.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.541+0000 7f770ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7708158e50 0x7f7708150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:38.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.541+0000 7f770ea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f770815c370 0x7f77080b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:38.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.541+0000 7f770ea00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7708159230 con 0x7f7708158e50 2024-09-11T23:18:38.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.541+0000 7f770ea00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f77080b3ed0 con 0x7f770806ef60 2024-09-11T23:18:38.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.541+0000 7f770ea00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f77080cf210 con 0x7f770815c370 2024-09-11T23:18:38.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.541+0000 7f76ff400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7708158e50 0x7f7708150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:38.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.541+0000 7f76ff400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7708158e50 0x7f7708150100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57552/0 (socket says 172.21.15.144:57552) 2024-09-11T23:18:38.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.541+0000 7f76ff400640 1 -- 172.21.15.144:0/3362856510 learned_addr learned my addr 172.21.15.144:0/3362856510 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:38.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.541+0000 7f770ca00640 1 --2- 172.21.15.144:0/3362856510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f770815c370 0x7f77080b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:38.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.541+0000 7f7707e00640 1 --2- 172.21.15.144:0/3362856510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f770806ef60 0x7f7708151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:38.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.542+0000 7f76ff400640 1 -- 172.21.15.144:0/3362856510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f770815c370 msgr2=0x7f77080b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:38.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.542+0000 7f76ff400640 1 --2- 172.21.15.144:0/3362856510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f770815c370 0x7f77080b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:38.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.542+0000 7f76ff400640 1 -- 172.21.15.144:0/3362856510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f770806ef60 msgr2=0x7f7708151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:38.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.542+0000 7f76ff400640 1 --2- 172.21.15.144:0/3362856510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f770806ef60 0x7f7708151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:38.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.542+0000 7f76ff400640 1 -- 172.21.15.144:0/3362856510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770815f7a0 con 0x7f7708158e50 2024-09-11T23:18:38.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.542+0000 7f76ff400640 1 --2- 172.21.15.144:0/3362856510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7708158e50 0x7f7708150100 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f76f000e870 tx=0x7f76f000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:38.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.542+0000 7f7704c00640 1 -- 172.21.15.144:0/3362856510 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0017070 con 0x7f7708158e50 2024-09-11T23:18:38.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.542+0000 7f7704c00640 1 -- 172.21.15.144:0/3362856510 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76f000c940 con 0x7f7708158e50 2024-09-11T23:18:38.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.542+0000 7f7704c00640 1 -- 172.21.15.144:0/3362856510 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f000ccf0 con 0x7f7708158e50 2024-09-11T23:18:38.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.542+0000 7f770ea00640 1 -- 172.21.15.144:0/3362856510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f770815fa80 con 0x7f7708158e50 2024-09-11T23:18:38.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.542+0000 7f770ea00640 1 -- 172.21.15.144:0/3362856510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f770815cf30 con 0x7f7708158e50 2024-09-11T23:18:38.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.543+0000 7f770ea00640 1 -- 172.21.15.144:0/3362856510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77080afd90 con 0x7f7708158e50 2024-09-11T23:18:38.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.544+0000 7f7704c00640 1 -- 172.21.15.144:0/3362856510 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76f001a070 con 0x7f7708158e50 2024-09-11T23:18:38.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.545+0000 7f7704c00640 1 --2- 172.21.15.144:0/3362856510 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f76e406be30 0x7f76e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:38.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.545+0000 7f7704c00640 1 -- 172.21.15.144:0/3362856510 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5795+0+0 (secure 0 0 0) 0x7f76f008b240 con 0x7f7708158e50 2024-09-11T23:18:38.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.545+0000 7f7707e00640 1 --2- 172.21.15.144:0/3362856510 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f76e406be30 0x7f76e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:38.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.546+0000 7f7707e00640 1 --2- 172.21.15.144:0/3362856510 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f76e406be30 0x7f76e406e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f76f8035000 tx=0x7f76f8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:38.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.551+0000 7f7704c00640 1 -- 172.21.15.144:0/3362856510 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76f0059560 con 0x7f7708158e50 2024-09-11T23:18:38.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:38.766+0000 7f770ea00640 1 -- 172.21.15.144:0/3362856510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7708158440 con 0x7f7708158e50 2024-09-11T23:18:39.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.361+0000 7f7704c00640 1 -- 172.21.15.144:0/3362856510 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f76f005d860 con 0x7f7708158e50 2024-09-11T23:18:39.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.365+0000 7f770ea00640 1 -- 172.21.15.144:0/3362856510 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f76e406be30 msgr2=0x7f76e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:39.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.365+0000 7f770ea00640 1 --2- 172.21.15.144:0/3362856510 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f76e406be30 0x7f76e406e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f76f8035000 tx=0x7f76f8008030 comp rx=0 tx=0).stop 2024-09-11T23:18:39.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.365+0000 7f770ea00640 1 -- 172.21.15.144:0/3362856510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7708158e50 msgr2=0x7f7708150100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:39.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.365+0000 7f770ea00640 1 --2- 172.21.15.144:0/3362856510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7708158e50 0x7f7708150100 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f76f000e870 tx=0x7f76f000ed30 comp rx=0 tx=0).stop 2024-09-11T23:18:39.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.365+0000 7f770ea00640 1 -- 172.21.15.144:0/3362856510 shutdown_connections 2024-09-11T23:18:39.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.365+0000 7f770ea00640 1 --2- 172.21.15.144:0/3362856510 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f76e406be30 0x7f76e406e2f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:39.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.365+0000 7f770ea00640 1 --2- 172.21.15.144:0/3362856510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f770815c370 0x7f77080b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:39.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.365+0000 7f770ea00640 1 --2- 172.21.15.144:0/3362856510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7708158e50 0x7f7708150100 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:39.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.365+0000 7f770ea00640 1 --2- 172.21.15.144:0/3362856510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f770806ef60 0x7f7708151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:39.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.365+0000 7f770ea00640 1 -- 172.21.15.144:0/3362856510 >> 172.21.15.144:0/3362856510 conn(0x7f770806bba0 msgr2=0x7f7708156b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:39.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.366+0000 7f770ea00640 1 -- 172.21.15.144:0/3362856510 shutdown_connections 2024-09-11T23:18:39.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.366+0000 7f770ea00640 1 -- 172.21.15.144:0/3362856510 wait complete. 2024-09-11T23:18:39.384 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:18:39.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.542+0000 7f2636000640 1 Processor -- start 2024-09-11T23:18:39.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.542+0000 7f2636000640 1 -- start start 2024-09-11T23:18:39.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.544+0000 7f2636000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26300b2160 0x7f26300d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:39.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.544+0000 7f2636000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26300cfa90 con 0x7f26300cf5b0 2024-09-11T23:18:39.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.544+0000 7f2636000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26300cfd70 con 0x7f26300b2540 2024-09-11T23:18:39.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.544+0000 7f2636000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f26300d06a0 con 0x7f26300b2160 2024-09-11T23:18:39.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.544+0000 7f2627e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f26300cf5b0 0x7f26300ceae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34866/0 (socket says 172.21.15.144:34866) 2024-09-11T23:18:39.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.544+0000 7f2627e00640 1 -- 172.21.15.144:0/2561447666 learned_addr learned my addr 172.21.15.144:0/2561447666 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:39.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.544+0000 7f2634c00640 1 --2- 172.21.15.144:0/2561447666 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26300b2160 0x7f26300d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:39.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.544+0000 7f262fe00640 1 -- 172.21.15.144:0/2561447666 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2535336079 0 0) 0x7f26300cfa90 con 0x7f26300cf5b0 2024-09-11T23:18:39.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.544+0000 7f262fe00640 1 -- 172.21.15.144:0/2561447666 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2614003520 con 0x7f26300cf5b0 2024-09-11T23:18:39.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.545+0000 7f262fe00640 1 -- 172.21.15.144:0/2561447666 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 320796442 0 0) 0x7f26300cfd70 con 0x7f26300b2540 2024-09-11T23:18:39.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.545+0000 7f262fe00640 1 -- 172.21.15.144:0/2561447666 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26300cfa90 con 0x7f26300b2540 2024-09-11T23:18:39.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.545+0000 7f2634c00640 1 -- 172.21.15.144:0/2561447666 >> v1:172.21.15.165:6789/0 conn(0x7f26300b2540 legacy=0x7f263015f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:39.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.545+0000 7f262fe00640 1 -- 172.21.15.144:0/2561447666 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1048632381 0 0) 0x7f2614003520 con 0x7f26300cf5b0 2024-09-11T23:18:39.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.545+0000 7f2634c00640 1 -- 172.21.15.144:0/2561447666 >> v1:172.21.15.144:6789/0 conn(0x7f26300cf5b0 legacy=0x7f26300ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:39.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.545+0000 7f2634c00640 1 -- 172.21.15.144:0/2561447666 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26300d0050 con 0x7f26300b2160 2024-09-11T23:18:39.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.546+0000 7f2634c00640 1 --2- 172.21.15.144:0/2561447666 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26300b2160 0x7f26300d0b30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2620009800 tx=0x7f262002a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb5a6ea06ec2e943 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:39.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.546+0000 7f262fe00640 1 -- 172.21.15.144:0/2561447666 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2620037070 con 0x7f26300b2160 2024-09-11T23:18:39.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.546+0000 7f262fe00640 1 -- 172.21.15.144:0/2561447666 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262002abc0 con 0x7f26300b2160 2024-09-11T23:18:39.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.546+0000 7f262fe00640 1 -- 172.21.15.144:0/2561447666 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2618001670 con 0x7f26300b2160 2024-09-11T23:18:39.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.546+0000 7f2636000640 1 -- 172.21.15.144:0/2561447666 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26300b2160 msgr2=0x7f26300d0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:39.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.546+0000 7f2636000640 1 --2- 172.21.15.144:0/2561447666 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26300b2160 0x7f26300d0b30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2620009800 tx=0x7f262002a130 comp rx=0 tx=0).stop 2024-09-11T23:18:39.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.547+0000 7f2636000640 1 -- 172.21.15.144:0/2561447666 shutdown_connections 2024-09-11T23:18:39.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.547+0000 7f2636000640 1 --2- 172.21.15.144:0/2561447666 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26300b2160 0x7f26300d0b30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:39.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.547+0000 7f2636000640 1 -- 172.21.15.144:0/2561447666 >> 172.21.15.144:0/2561447666 conn(0x7f263006bba0 msgr2=0x7f263006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:39.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.547+0000 7f2636000640 1 -- 172.21.15.144:0/2561447666 shutdown_connections 2024-09-11T23:18:39.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.547+0000 7f2636000640 1 -- 172.21.15.144:0/2561447666 wait complete. 2024-09-11T23:18:39.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.548+0000 7f2636000640 1 Processor -- start 2024-09-11T23:18:39.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.548+0000 7f2636000640 1 -- start start 2024-09-11T23:18:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.549+0000 7f2636000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26300b2160 0x7f2630071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.549+0000 7f2636000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26300b2540 0x7f263015c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.549+0000 7f2636000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26300cf5b0 0x7f263015cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.549+0000 7f2636000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f263015f9b0 con 0x7f26300b2540 2024-09-11T23:18:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.549+0000 7f2636000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f26300cf1f0 con 0x7f26300cf5b0 2024-09-11T23:18:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.549+0000 7f2636000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f263015fc70 con 0x7f26300b2160 2024-09-11T23:18:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.550+0000 7f2627e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26300b2540 0x7f263015c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.550+0000 7f2627e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26300b2540 0x7f263015c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57556/0 (socket says 172.21.15.144:57556) 2024-09-11T23:18:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.550+0000 7f2627e00640 1 -- 172.21.15.144:0/1474955964 learned_addr learned my addr 172.21.15.144:0/1474955964 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.550+0000 7f2634c00640 1 --2- 172.21.15.144:0/1474955964 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26300b2160 0x7f2630071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.550+0000 7f2635600640 1 --2- 172.21.15.144:0/1474955964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26300cf5b0 0x7f263015cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.550+0000 7f2627e00640 1 -- 172.21.15.144:0/1474955964 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26300b2160 msgr2=0x7f2630071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.550+0000 7f2627e00640 1 --2- 172.21.15.144:0/1474955964 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26300b2160 0x7f2630071180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.550+0000 7f2627e00640 1 -- 172.21.15.144:0/1474955964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26300cf5b0 msgr2=0x7f263015cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.550+0000 7f2627e00640 1 --2- 172.21.15.144:0/1474955964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26300cf5b0 0x7f263015cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.550+0000 7f2627e00640 1 -- 172.21.15.144:0/1474955964 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263015d010 con 0x7f26300b2540 2024-09-11T23:18:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.550+0000 7f2627e00640 1 --2- 172.21.15.144:0/1474955964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26300b2540 0x7f263015c590 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2618000fd0 tx=0x7f261800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.551+0000 7f262d600640 1 -- 172.21.15.144:0/1474955964 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2618017070 con 0x7f26300b2540 2024-09-11T23:18:39.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.551+0000 7f262d600640 1 -- 172.21.15.144:0/1474955964 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2618005ce0 con 0x7f26300b2540 2024-09-11T23:18:39.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.551+0000 7f262d600640 1 -- 172.21.15.144:0/1474955964 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2618007270 con 0x7f26300b2540 2024-09-11T23:18:39.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.551+0000 7f2636000640 1 -- 172.21.15.144:0/1474955964 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f263015b7d0 con 0x7f26300b2540 2024-09-11T23:18:39.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.551+0000 7f2636000640 1 -- 172.21.15.144:0/1474955964 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f263015bd90 con 0x7f26300b2540 2024-09-11T23:18:39.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.552+0000 7f2636000640 1 -- 172.21.15.144:0/1474955964 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26300d0b30 con 0x7f26300b2540 2024-09-11T23:18:39.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.553+0000 7f262d600640 1 -- 172.21.15.144:0/1474955964 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f261801a070 con 0x7f26300b2540 2024-09-11T23:18:39.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.554+0000 7f262d600640 1 --2- 172.21.15.144:0/1474955964 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f260c06be30 0x7f260c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:39.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.554+0000 7f262d600640 1 -- 172.21.15.144:0/1474955964 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5911+0+0 (secure 0 0 0) 0x7f261808a2b0 con 0x7f26300b2540 2024-09-11T23:18:39.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.554+0000 7f2634c00640 1 --2- 172.21.15.144:0/1474955964 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f260c06be30 0x7f260c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:39.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.554+0000 7f2634c00640 1 --2- 172.21.15.144:0/1474955964 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f260c06be30 0x7f260c06e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2620034000 tx=0x7f262002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:39.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.558+0000 7f262d600640 1 -- 172.21.15.144:0/1474955964 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2618058530 con 0x7f26300b2540 2024-09-11T23:18:39.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:39.735+0000 7f2636000640 1 -- 172.21.15.144:0/1474955964 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f26300cedb0 con 0x7f26300b2540 2024-09-11T23:18:40.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.363+0000 7f262d600640 1 -- 172.21.15.144:0/1474955964 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7f261805c830 con 0x7f26300b2540 2024-09-11T23:18:40.363 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:18:40.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.367+0000 7f2636000640 1 -- 172.21.15.144:0/1474955964 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f260c06be30 msgr2=0x7f260c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:40.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.367+0000 7f2636000640 1 --2- 172.21.15.144:0/1474955964 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f260c06be30 0x7f260c06e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2620034000 tx=0x7f262002e000 comp rx=0 tx=0).stop 2024-09-11T23:18:40.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.367+0000 7f2636000640 1 -- 172.21.15.144:0/1474955964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26300b2540 msgr2=0x7f263015c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:40.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.367+0000 7f2636000640 1 --2- 172.21.15.144:0/1474955964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26300b2540 0x7f263015c590 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2618000fd0 tx=0x7f261800c960 comp rx=0 tx=0).stop 2024-09-11T23:18:40.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.367+0000 7f2636000640 1 -- 172.21.15.144:0/1474955964 shutdown_connections 2024-09-11T23:18:40.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.367+0000 7f2636000640 1 --2- 172.21.15.144:0/1474955964 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f260c06be30 0x7f260c06e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:40.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.367+0000 7f2636000640 1 --2- 172.21.15.144:0/1474955964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26300cf5b0 0x7f263015cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:40.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.367+0000 7f2636000640 1 --2- 172.21.15.144:0/1474955964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26300b2540 0x7f263015c590 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:40.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.367+0000 7f2636000640 1 --2- 172.21.15.144:0/1474955964 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26300b2160 0x7f2630071180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:40.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.367+0000 7f2636000640 1 -- 172.21.15.144:0/1474955964 >> 172.21.15.144:0/1474955964 conn(0x7f263006bba0 msgr2=0x7f26300af690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:40.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.367+0000 7f2636000640 1 -- 172.21.15.144:0/1474955964 shutdown_connections 2024-09-11T23:18:40.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.367+0000 7f2636000640 1 -- 172.21.15.144:0/1474955964 wait complete. 2024-09-11T23:18:40.388 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:18:40.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.548+0000 7f3dc3e00640 1 Processor -- start 2024-09-11T23:18:40.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.548+0000 7f3dc3e00640 1 -- start start 2024-09-11T23:18:40.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.549+0000 7f3dc3e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dc415c030 0x7f3dc4071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:40.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.549+0000 7f3dc3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3dc415c410 0x7f3dc40b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:40.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.549+0000 7f3dc3e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3dc40b2ab0 0x7f3dc40b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:40.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.549+0000 7f3dc3e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3dc4072870 con 0x7f3dc415c410 2024-09-11T23:18:40.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.549+0000 7f3dc3e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3dc4072b50 con 0x7f3dc40b2ab0 2024-09-11T23:18:40.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.549+0000 7f3dc3e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3dc4072e30 con 0x7f3dc415c030 2024-09-11T23:18:40.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.549+0000 7f3dbbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3dc415c410 0x7f3dc40b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:40.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.549+0000 7f3dbbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3dc415c410 0x7f3dc40b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57568/0 (socket says 172.21.15.144:57568) 2024-09-11T23:18:40.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.549+0000 7f3dbbe00640 1 -- 172.21.15.144:0/2366696409 learned_addr learned my addr 172.21.15.144:0/2366696409 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:40.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.550+0000 7f3dc2a00640 1 --2- 172.21.15.144:0/2366696409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dc415c030 0x7f3dc4071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:40.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.550+0000 7f3dc3400640 1 --2- 172.21.15.144:0/2366696409 >> v2:172.21.15.165:3300/0 conn(0x7f3dc40b2ab0 0x7f3dc40b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:40.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.550+0000 7f3dbbe00640 1 -- 172.21.15.144:0/2366696409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dc415c030 msgr2=0x7f3dc4071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:40.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.550+0000 7f3dbbe00640 1 --2- 172.21.15.144:0/2366696409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dc415c030 0x7f3dc4071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:40.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.550+0000 7f3dbbe00640 1 -- 172.21.15.144:0/2366696409 >> v2:172.21.15.165:3300/0 conn(0x7f3dc40b2ab0 msgr2=0x7f3dc40b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:40.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.550+0000 7f3dbbe00640 1 --2- 172.21.15.144:0/2366696409 >> v2:172.21.15.165:3300/0 conn(0x7f3dc40b2ab0 0x7f3dc40b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:40.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.550+0000 7f3dbbe00640 1 -- 172.21.15.144:0/2366696409 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc4073110 con 0x7f3dc415c410 2024-09-11T23:18:40.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.551+0000 7f3dbbe00640 1 --2- 172.21.15.144:0/2366696409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dc415c410 0x7f3dc40b1e60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40717f0 tx=0x7f3dac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f694364f1ea5eee6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:40.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.551+0000 7f3dc2000640 1 -- 172.21.15.144:0/2366696409 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac037070 con 0x7f3dc415c410 2024-09-11T23:18:40.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.551+0000 7f3dc2000640 1 -- 172.21.15.144:0/2366696409 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dac032440 con 0x7f3dc415c410 2024-09-11T23:18:40.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.551+0000 7f3dc2000640 1 -- 172.21.15.144:0/2366696409 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac032810 con 0x7f3dc415c410 2024-09-11T23:18:40.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.551+0000 7f3dc3e00640 1 -- 172.21.15.144:0/2366696409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dc415c410 msgr2=0x7f3dc40b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:40.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.551+0000 7f3dc3e00640 1 --2- 172.21.15.144:0/2366696409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dc415c410 0x7f3dc40b1e60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40717f0 tx=0x7f3dac02a1e0 comp rx=0 tx=0).stop 2024-09-11T23:18:40.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.552+0000 7f3dc3e00640 1 -- 172.21.15.144:0/2366696409 shutdown_connections 2024-09-11T23:18:40.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.552+0000 7f3dc3e00640 1 --2- 172.21.15.144:0/2366696409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dc415c410 0x7f3dc40b1e60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:40.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.552+0000 7f3dc3e00640 1 --2- 172.21.15.144:0/2366696409 >> v2:172.21.15.165:3300/0 conn(0x7f3dc40b2ab0 0x7f3dc40b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:40.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.552+0000 7f3dc3e00640 1 --2- 172.21.15.144:0/2366696409 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dc415c030 0x7f3dc4071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:40.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.552+0000 7f3dc3e00640 1 -- 172.21.15.144:0/2366696409 >> 172.21.15.144:0/2366696409 conn(0x7f3dc406bba0 msgr2=0x7f3dc406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:40.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.552+0000 7f3dc3e00640 1 -- 172.21.15.144:0/2366696409 shutdown_connections 2024-09-11T23:18:40.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.552+0000 7f3dc3e00640 1 -- 172.21.15.144:0/2366696409 wait complete. 2024-09-11T23:18:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.553+0000 7f3dc3e00640 1 Processor -- start 2024-09-11T23:18:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.553+0000 7f3dc3e00640 1 -- start start 2024-09-11T23:18:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.554+0000 7f3dc3e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dc40b2ab0 0x7f3dc414be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.554+0000 7f3dc3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dc415c030 0x7f3dc40aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.554+0000 7f3dc3e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dc415c410 0x7f3dc4157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.554+0000 7f3dc3e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc4072620 con 0x7f3dc415c030 2024-09-11T23:18:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.554+0000 7f3dc3e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc40724a0 con 0x7f3dc415c410 2024-09-11T23:18:40.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.554+0000 7f3dc3e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3dc40cff30 con 0x7f3dc40b2ab0 2024-09-11T23:18:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.554+0000 7f3dbbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dc415c030 0x7f3dc40aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.554+0000 7f3dbbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dc415c030 0x7f3dc40aaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57582/0 (socket says 172.21.15.144:57582) 2024-09-11T23:18:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.554+0000 7f3dbbe00640 1 -- 172.21.15.144:0/796793493 learned_addr learned my addr 172.21.15.144:0/796793493 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.555+0000 7f3dc2a00640 1 --2- 172.21.15.144:0/796793493 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dc40b2ab0 0x7f3dc414be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.555+0000 7f3dc3400640 1 --2- 172.21.15.144:0/796793493 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dc415c410 0x7f3dc4157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.555+0000 7f3dbbe00640 1 -- 172.21.15.144:0/796793493 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dc40b2ab0 msgr2=0x7f3dc414be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.555+0000 7f3dbbe00640 1 --2- 172.21.15.144:0/796793493 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dc40b2ab0 0x7f3dc414be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.555+0000 7f3dbbe00640 1 -- 172.21.15.144:0/796793493 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dc415c410 msgr2=0x7f3dc4157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.555+0000 7f3dbbe00640 1 --2- 172.21.15.144:0/796793493 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dc415c410 0x7f3dc4157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.555+0000 7f3dbbe00640 1 -- 172.21.15.144:0/796793493 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc40ae3c0 con 0x7f3dc415c030 2024-09-11T23:18:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.555+0000 7f3dbbe00640 1 --2- 172.21.15.144:0/796793493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dc415c030 0x7f3dc40aaeb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3dac02a220 tx=0x7f3dac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:40.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.555+0000 7f3dbaa00640 1 -- 172.21.15.144:0/796793493 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac041020 con 0x7f3dc415c030 2024-09-11T23:18:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.555+0000 7f3dbaa00640 1 -- 172.21.15.144:0/796793493 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dac0306c0 con 0x7f3dc415c030 2024-09-11T23:18:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.555+0000 7f3dbaa00640 1 -- 172.21.15.144:0/796793493 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac037040 con 0x7f3dc415c030 2024-09-11T23:18:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.555+0000 7f3dc3e00640 1 -- 172.21.15.144:0/796793493 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dc40ae6a0 con 0x7f3dc415c030 2024-09-11T23:18:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.556+0000 7f3dc3e00640 1 -- 172.21.15.144:0/796793493 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dc40aec60 con 0x7f3dc415c030 2024-09-11T23:18:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.557+0000 7f3dc3e00640 1 -- 172.21.15.144:0/796793493 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dc4071f60 con 0x7f3dc415c030 2024-09-11T23:18:40.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.557+0000 7f3dbaa00640 1 -- 172.21.15.144:0/796793493 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3dac044020 con 0x7f3dc415c030 2024-09-11T23:18:40.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.558+0000 7f3dbaa00640 1 --2- 172.21.15.144:0/796793493 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3da006be30 0x7f3da006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:40.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.558+0000 7f3dbaa00640 1 -- 172.21.15.144:0/796793493 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5473+0+0 (secure 0 0 0) 0x7f3dac0ab510 con 0x7f3dc415c030 2024-09-11T23:18:40.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.559+0000 7f3dc2a00640 1 --2- 172.21.15.144:0/796793493 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3da006be30 0x7f3da006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:40.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.559+0000 7f3dc2a00640 1 --2- 172.21.15.144:0/796793493 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3da006be30 0x7f3da006e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3db4006fd0 tx=0x7f3db4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:40.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.562+0000 7f3dbaa00640 1 -- 172.21.15.144:0/796793493 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3dac04b030 con 0x7f3dc415c030 2024-09-11T23:18:40.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:40.741+0000 7f3dc3e00640 1 -- 172.21.15.144:0/796793493 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3dc415ad90 con 0x7f3dc415c030 2024-09-11T23:18:41.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.369+0000 7f3dbaa00640 1 -- 172.21.15.144:0/796793493 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7f3dac079820 con 0x7f3dc415c030 2024-09-11T23:18:41.679 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-11T23:18:41.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.373+0000 7f3dc3e00640 1 -- 172.21.15.144:0/796793493 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3da006be30 msgr2=0x7f3da006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:41.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.373+0000 7f3dc3e00640 1 --2- 172.21.15.144:0/796793493 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3da006be30 0x7f3da006e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3db4006fd0 tx=0x7f3db4008040 comp rx=0 tx=0).stop 2024-09-11T23:18:41.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.373+0000 7f3dc3e00640 1 -- 172.21.15.144:0/796793493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dc415c030 msgr2=0x7f3dc40aaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:41.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.373+0000 7f3dc3e00640 1 --2- 172.21.15.144:0/796793493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dc415c030 0x7f3dc40aaeb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3dac02a220 tx=0x7f3dac0046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:41.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.374+0000 7f3dc3e00640 1 -- 172.21.15.144:0/796793493 shutdown_connections 2024-09-11T23:18:41.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.374+0000 7f3dc3e00640 1 --2- 172.21.15.144:0/796793493 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3da006be30 0x7f3da006e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:41.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.374+0000 7f3dc3e00640 1 --2- 172.21.15.144:0/796793493 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3dc415c410 0x7f3dc4157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:41.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.374+0000 7f3dc3e00640 1 --2- 172.21.15.144:0/796793493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3dc415c030 0x7f3dc40aaeb0 secure :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3dac02a220 tx=0x7f3dac0046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:41.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.374+0000 7f3dc3e00640 1 --2- 172.21.15.144:0/796793493 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3dc40b2ab0 0x7f3dc414be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:41.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.374+0000 7f3dc3e00640 1 -- 172.21.15.144:0/796793493 >> 172.21.15.144:0/796793493 conn(0x7f3dc406bba0 msgr2=0x7f3dc40b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:41.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.374+0000 7f3dc3e00640 1 -- 172.21.15.144:0/796793493 shutdown_connections 2024-09-11T23:18:41.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.374+0000 7f3dc3e00640 1 -- 172.21.15.144:0/796793493 wait complete. 2024-09-11T23:18:41.681 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:18:41.681 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:18:41.682 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:18:41.682 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:18:41.682 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:18:41.682 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T23:18:41.682 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:18:41.682 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:18:41.683 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:18:41.683 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:18:41.683 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:18:41.683 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:18:41.683 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:18:41.683 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T23:18:41.684 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:18:41.684 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:18:41.702 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:18:41.702 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:18:41.703 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:18:41.704 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:18:41.705 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:18:41.705 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:18:41.706 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:18:41.706 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:18:41.747 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:18:41.747 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:41.749 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:18:41.749 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:41.750 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:18:41.750 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:41.751 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:18:41.752 DEBUG:teuthology.parallel:result is None 2024-09-11T23:18:41.752 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:18:41.884 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-11T23:18:41.884 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-11T23:18:41.885 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-11T23:18:41.885 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-11T23:18:41.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.919+0000 7ff2bd200640 1 Processor -- start 2024-09-11T23:18:41.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.920+0000 7ff2bd200640 1 -- start start 2024-09-11T23:18:41.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.921+0000 7ff2bd200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b815c0b0 0x7ff2b80cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:41.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.921+0000 7ff2bd200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff2b815c490 0x7ff2b815fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:41.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.921+0000 7ff2bd200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2b8160970 con 0x7ff2b8160410 2024-09-11T23:18:41.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.921+0000 7ff2bd200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff2b8160c50 con 0x7ff2b815c490 2024-09-11T23:18:41.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.921+0000 7ff2bd200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b80ce200 con 0x7ff2b815c0b0 2024-09-11T23:18:41.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.921+0000 7ff2b5e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b815c0b0 0x7ff2b80cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:41.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.921+0000 7ff2b5400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff2b815c490 0x7ff2b815fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:41.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.921+0000 7ff2b5e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b815c0b0 0x7ff2b80cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:45698/0 (socket says 172.21.15.144:45698) 2024-09-11T23:18:41.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.921+0000 7ff2b5e00640 1 -- 172.21.15.144:0/2710296588 learned_addr learned my addr 172.21.15.144:0/2710296588 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:41.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.921+0000 7ff2b6800640 1 --1- 172.21.15.144:0/2710296588 >> v1:172.21.15.165:6789/0 conn(0x7ff2b8160410 0x7ff2b80b3550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:38056/0 (socket says 172.21.15.144:38056) 2024-09-11T23:18:41.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.922+0000 7ff2b5e00640 1 -- 172.21.15.144:0/2710296588 >> v2:172.21.15.165:3300/0 conn(0x7ff2b815c490 msgr2=0x7ff2b815fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:41.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.922+0000 7ff2b5e00640 1 --2- 172.21.15.144:0/2710296588 >> v2:172.21.15.165:3300/0 conn(0x7ff2b815c490 0x7ff2b815fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:41.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.922+0000 7ff2b5e00640 1 -- 172.21.15.144:0/2710296588 >> v1:172.21.15.165:6789/0 conn(0x7ff2b8160410 legacy=0x7ff2b80b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:41.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.922+0000 7ff2b5e00640 1 -- 172.21.15.144:0/2710296588 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b80ce4e0 con 0x7ff2b815c0b0 2024-09-11T23:18:41.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.923+0000 7ff2b5e00640 1 --2- 172.21.15.144:0/2710296588 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b815c0b0 0x7ff2b80cea00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8009870 tx=0x7ff2a802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2565ec01773ba698 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:41.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.923+0000 7ff2b4a00640 1 -- 172.21.15.144:0/2710296588 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8037070 con 0x7ff2b815c0b0 2024-09-11T23:18:41.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.923+0000 7ff2b4a00640 1 -- 172.21.15.144:0/2710296588 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a8032440 con 0x7ff2b815c0b0 2024-09-11T23:18:41.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.923+0000 7ff2b4a00640 1 -- 172.21.15.144:0/2710296588 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8032810 con 0x7ff2b815c0b0 2024-09-11T23:18:41.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.923+0000 7ff2bd200640 1 -- 172.21.15.144:0/2710296588 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b815c0b0 msgr2=0x7ff2b80cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:41.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.923+0000 7ff2bd200640 1 --2- 172.21.15.144:0/2710296588 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b815c0b0 0x7ff2b80cea00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8009870 tx=0x7ff2a802a270 comp rx=0 tx=0).stop 2024-09-11T23:18:41.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.924+0000 7ff2bd200640 1 -- 172.21.15.144:0/2710296588 shutdown_connections 2024-09-11T23:18:41.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.924+0000 7ff2bd200640 1 --2- 172.21.15.144:0/2710296588 >> v2:172.21.15.165:3300/0 conn(0x7ff2b815c490 0x7ff2b815fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:41.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.924+0000 7ff2bd200640 1 --2- 172.21.15.144:0/2710296588 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b815c0b0 0x7ff2b80cea00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:41.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.924+0000 7ff2bd200640 1 -- 172.21.15.144:0/2710296588 >> 172.21.15.144:0/2710296588 conn(0x7ff2b806ce90 msgr2=0x7ff2b806d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:41.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.924+0000 7ff2bd200640 1 -- 172.21.15.144:0/2710296588 shutdown_connections 2024-09-11T23:18:41.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.924+0000 7ff2bd200640 1 -- 172.21.15.144:0/2710296588 wait complete. 2024-09-11T23:18:41.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.925+0000 7ff2bd200640 1 Processor -- start 2024-09-11T23:18:41.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.925+0000 7ff2bd200640 1 -- start start 2024-09-11T23:18:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.926+0000 7ff2bd200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b815c0b0 0x7ff2b8154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.926+0000 7ff2bd200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2b815c490 0x7ff2b8158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.926+0000 7ff2bd200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2b8160410 0x7ff2b81f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:41.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.926+0000 7ff2bd200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b80b3c60 con 0x7ff2b8160410 2024-09-11T23:18:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.926+0000 7ff2bd200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b80cef40 con 0x7ff2b815c490 2024-09-11T23:18:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.926+0000 7ff2bd200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b80b3de0 con 0x7ff2b815c0b0 2024-09-11T23:18:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.927+0000 7ff2b5400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2b815c490 0x7ff2b8158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.927+0000 7ff2b6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2b8160410 0x7ff2b81f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.927+0000 7ff2b5e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b815c0b0 0x7ff2b8154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.927+0000 7ff2b5400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2b815c490 0x7ff2b8158420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:41604/0 (socket says 172.21.15.144:41604) 2024-09-11T23:18:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.927+0000 7ff2b5400640 1 -- 172.21.15.144:0/2236313711 learned_addr learned my addr 172.21.15.144:0/2236313711 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.927+0000 7ff2b5e00640 1 --2- 172.21.15.144:0/2236313711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b815c0b0 0x7ff2b8154aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:45708/0 (socket says 172.21.15.144:45708) 2024-09-11T23:18:41.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.927+0000 7ff2b5e00640 1 -- 172.21.15.144:0/2236313711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2b815c490 msgr2=0x7ff2b8158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.927+0000 7ff2b5e00640 1 --2- 172.21.15.144:0/2236313711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2b815c490 0x7ff2b8158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.927+0000 7ff2b5e00640 1 -- 172.21.15.144:0/2236313711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2b8160410 msgr2=0x7ff2b81f2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.927+0000 7ff2b5e00640 1 --2- 172.21.15.144:0/2236313711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2b8160410 0x7ff2b81f2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.927+0000 7ff2b5e00640 1 -- 172.21.15.144:0/2236313711 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b8157380 con 0x7ff2b815c0b0 2024-09-11T23:18:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.927+0000 7ff2b5400640 1 --2- 172.21.15.144:0/2236313711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2b815c490 0x7ff2b8158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.927+0000 7ff2b6800640 1 --2- 172.21.15.144:0/2236313711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2b8160410 0x7ff2b81f2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.927+0000 7ff2b5e00640 1 --2- 172.21.15.144:0/2236313711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b815c0b0 0x7ff2b8154aa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8031000 tx=0x7ff2a80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.928+0000 7ff2ae000640 1 -- 172.21.15.144:0/2236313711 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8041020 con 0x7ff2b815c0b0 2024-09-11T23:18:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.928+0000 7ff2ae000640 1 -- 172.21.15.144:0/2236313711 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a8030660 con 0x7ff2b815c0b0 2024-09-11T23:18:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.928+0000 7ff2bd200640 1 -- 172.21.15.144:0/2236313711 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b8157660 con 0x7ff2b815c0b0 2024-09-11T23:18:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.928+0000 7ff2ae000640 1 -- 172.21.15.144:0/2236313711 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8037040 con 0x7ff2b815c0b0 2024-09-11T23:18:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.928+0000 7ff2bd200640 1 -- 172.21.15.144:0/2236313711 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b8157c20 con 0x7ff2b815c0b0 2024-09-11T23:18:41.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.929+0000 7ff2bd200640 1 -- 172.21.15.144:0/2236313711 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2b80cea00 con 0x7ff2b815c0b0 2024-09-11T23:18:41.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.930+0000 7ff2ae000640 1 -- 172.21.15.144:0/2236313711 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff2a8044020 con 0x7ff2b815c0b0 2024-09-11T23:18:41.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.931+0000 7ff2ae000640 1 --2- 172.21.15.144:0/2236313711 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff29806be60 0x7ff29806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:41.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.931+0000 7ff2ae000640 1 -- 172.21.15.144:0/2236313711 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 4943+0+0 (secure 0 0 0) 0x7ff2a80ab300 con 0x7ff2b815c0b0 2024-09-11T23:18:41.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.931+0000 7ff2b5400640 1 --2- 172.21.15.144:0/2236313711 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff29806be60 0x7ff29806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:41.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.932+0000 7ff2b5400640 1 --2- 172.21.15.144:0/2236313711 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff29806be60 0x7ff29806e320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80cdfb0 tx=0x7ff2a4009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:41.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:41.934+0000 7ff2ae000640 1 -- 172.21.15.144:0/2236313711 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff2a804b030 con 0x7ff2b815c0b0 2024-09-11T23:18:42.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.124+0000 7ff2bd200640 1 -- 172.21.15.144:0/2236313711 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ff2b80b4660 con 0x7ff2b815c0b0 2024-09-11T23:18:42.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.383+0000 7ff2ae000640 1 -- 172.21.15.144:0/2236313711 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) ==== 97+0+0 (secure 0 0 0) 0x7ff2a8079940 con 0x7ff2b815c0b0 2024-09-11T23:18:42.383 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-11T23:18:42.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.386+0000 7ff2bd200640 1 -- 172.21.15.144:0/2236313711 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff29806be60 msgr2=0x7ff29806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:42.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.386+0000 7ff2bd200640 1 --2- 172.21.15.144:0/2236313711 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff29806be60 0x7ff29806e320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80cdfb0 tx=0x7ff2a4009190 comp rx=0 tx=0).stop 2024-09-11T23:18:42.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.386+0000 7ff2bd200640 1 -- 172.21.15.144:0/2236313711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b815c0b0 msgr2=0x7ff2b8154aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:42.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.386+0000 7ff2bd200640 1 --2- 172.21.15.144:0/2236313711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b815c0b0 0x7ff2b8154aa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8031000 tx=0x7ff2a80046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:42.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.386+0000 7ff2bd200640 1 -- 172.21.15.144:0/2236313711 shutdown_connections 2024-09-11T23:18:42.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.386+0000 7ff2bd200640 1 --2- 172.21.15.144:0/2236313711 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff29806be60 0x7ff29806e320 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:42.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.386+0000 7ff2bd200640 1 --2- 172.21.15.144:0/2236313711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2b8160410 0x7ff2b81f2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:42.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.386+0000 7ff2bd200640 1 --2- 172.21.15.144:0/2236313711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2b815c490 0x7ff2b8158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:42.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.386+0000 7ff2bd200640 1 --2- 172.21.15.144:0/2236313711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b815c0b0 0x7ff2b8154aa0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:42.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.386+0000 7ff2bd200640 1 -- 172.21.15.144:0/2236313711 >> 172.21.15.144:0/2236313711 conn(0x7ff2b806ce90 msgr2=0x7ff2b80b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:42.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.386+0000 7ff2bd200640 1 -- 172.21.15.144:0/2236313711 shutdown_connections 2024-09-11T23:18:42.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.386+0000 7ff2bd200640 1 -- 172.21.15.144:0/2236313711 wait complete. 2024-09-11T23:18:42.404 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:18:42.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.555+0000 7f9aee800640 1 Processor -- start 2024-09-11T23:18:42.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.556+0000 7f9aee800640 1 -- start start 2024-09-11T23:18:42.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.557+0000 7f9aee800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ae815ca40 0x7f9ae815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:42.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.557+0000 7f9aee800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9ae815ce80 0x7f9ae81594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:42.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.557+0000 7f9aee800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae815d390 con 0x7f9ae80d02a0 2024-09-11T23:18:42.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.557+0000 7f9aee800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9ae815d670 con 0x7f9ae815ce80 2024-09-11T23:18:42.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.557+0000 7f9aee800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9ae815d950 con 0x7f9ae815ca40 2024-09-11T23:18:42.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.557+0000 7f9ae7400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9ae80d02a0 0x7f9ae80d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34898/0 (socket says 172.21.15.144:34898) 2024-09-11T23:18:42.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.557+0000 7f9ae7400640 1 -- 172.21.15.144:0/1200255198 learned_addr learned my addr 172.21.15.144:0/1200255198 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:42.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.557+0000 7f9adea00640 1 --2- 172.21.15.144:0/1200255198 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ae815ca40 0x7f9ae815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:42.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.557+0000 7f9ae7e00640 1 --2- 172.21.15.144:0/1200255198 >> v2:172.21.15.165:3300/0 conn(0x7f9ae815ce80 0x7f9ae81594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:42.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.558+0000 7f9ae6a00640 1 -- 172.21.15.144:0/1200255198 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3996838877 0 0) 0x7f9ae815d390 con 0x7f9ae80d02a0 2024-09-11T23:18:42.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.558+0000 7f9ae6a00640 1 -- 172.21.15.144:0/1200255198 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9acc005730 con 0x7f9ae80d02a0 2024-09-11T23:18:42.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.558+0000 7f9adea00640 1 -- 172.21.15.144:0/1200255198 >> v2:172.21.15.165:3300/0 conn(0x7f9ae815ce80 msgr2=0x7f9ae81594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:42.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.558+0000 7f9adea00640 1 --2- 172.21.15.144:0/1200255198 >> v2:172.21.15.165:3300/0 conn(0x7f9ae815ce80 0x7f9ae81594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:42.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.558+0000 7f9adea00640 1 -- 172.21.15.144:0/1200255198 >> v1:172.21.15.144:6789/0 conn(0x7f9ae80d02a0 legacy=0x7f9ae80d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:42.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.558+0000 7f9adea00640 1 -- 172.21.15.144:0/1200255198 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae815dc30 con 0x7f9ae815ca40 2024-09-11T23:18:42.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.558+0000 7f9ae7e00640 1 --2- 172.21.15.144:0/1200255198 >> v2:172.21.15.165:3300/0 conn(0x7f9ae815ce80 0x7f9ae81594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:42.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.559+0000 7f9adea00640 1 --2- 172.21.15.144:0/1200255198 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ae815ca40 0x7f9ae815e430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9ad00097a0 tx=0x7f9ad002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0438a80a3692059 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:42.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.559+0000 7f9ae6a00640 1 -- 172.21.15.144:0/1200255198 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0037070 con 0x7f9ae815ca40 2024-09-11T23:18:42.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.559+0000 7f9ae6a00640 1 -- 172.21.15.144:0/1200255198 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad002ae50 con 0x7f9ae815ca40 2024-09-11T23:18:42.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.559+0000 7f9ae6a00640 1 -- 172.21.15.144:0/1200255198 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0032660 con 0x7f9ae815ca40 2024-09-11T23:18:42.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.560+0000 7f9aee800640 1 -- 172.21.15.144:0/1200255198 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ae815ca40 msgr2=0x7f9ae815e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:42.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.560+0000 7f9aee800640 1 --2- 172.21.15.144:0/1200255198 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ae815ca40 0x7f9ae815e430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9ad00097a0 tx=0x7f9ad002a100 comp rx=0 tx=0).stop 2024-09-11T23:18:42.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.560+0000 7f9aee800640 1 -- 172.21.15.144:0/1200255198 shutdown_connections 2024-09-11T23:18:42.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.560+0000 7f9aee800640 1 --2- 172.21.15.144:0/1200255198 >> v2:172.21.15.165:3300/0 conn(0x7f9ae815ce80 0x7f9ae81594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:42.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.560+0000 7f9aee800640 1 --2- 172.21.15.144:0/1200255198 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ae815ca40 0x7f9ae815e430 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:42.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.560+0000 7f9aee800640 1 -- 172.21.15.144:0/1200255198 >> 172.21.15.144:0/1200255198 conn(0x7f9ae8062cc0 msgr2=0x7f9ae806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:42.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.560+0000 7f9aee800640 1 -- 172.21.15.144:0/1200255198 shutdown_connections 2024-09-11T23:18:42.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.560+0000 7f9aee800640 1 -- 172.21.15.144:0/1200255198 wait complete. 2024-09-11T23:18:42.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.562+0000 7f9aee800640 1 Processor -- start 2024-09-11T23:18:42.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.562+0000 7f9aee800640 1 -- start start 2024-09-11T23:18:42.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.563+0000 7f9aee800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ae80d02a0 0x7f9ae8147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:42.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.563+0000 7f9aee800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae815ca40 0x7f9ae8072d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:42.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.563+0000 7f9aee800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ae815ce80 0x7f9ae80b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:42.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.563+0000 7f9aee800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae8155d10 con 0x7f9ae815ca40 2024-09-11T23:18:42.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.563+0000 7f9aee800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae8155b90 con 0x7f9ae80d02a0 2024-09-11T23:18:42.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.563+0000 7f9aee800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9ae80b4790 con 0x7f9ae815ce80 2024-09-11T23:18:42.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.563+0000 7f9adea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae815ca40 0x7f9ae8072d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:42.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.563+0000 7f9adea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae815ca40 0x7f9ae8072d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57618/0 (socket says 172.21.15.144:57618) 2024-09-11T23:18:42.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.563+0000 7f9adea00640 1 -- 172.21.15.144:0/2165132119 learned_addr learned my addr 172.21.15.144:0/2165132119 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:42.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.563+0000 7f9ae7e00640 1 --2- 172.21.15.144:0/2165132119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ae815ce80 0x7f9ae80b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:42.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.563+0000 7f9ae7400640 1 --2- 172.21.15.144:0/2165132119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ae80d02a0 0x7f9ae8147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:42.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.563+0000 7f9adea00640 1 -- 172.21.15.144:0/2165132119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ae815ce80 msgr2=0x7f9ae80b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:42.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.563+0000 7f9adea00640 1 --2- 172.21.15.144:0/2165132119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ae815ce80 0x7f9ae80b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:42.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.563+0000 7f9adea00640 1 -- 172.21.15.144:0/2165132119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ae80d02a0 msgr2=0x7f9ae8147e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:42.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.563+0000 7f9adea00640 1 --2- 172.21.15.144:0/2165132119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ae80d02a0 0x7f9ae8147e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:42.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.564+0000 7f9adea00640 1 -- 172.21.15.144:0/2165132119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae8073660 con 0x7f9ae815ca40 2024-09-11T23:18:42.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.564+0000 7f9adea00640 1 --2- 172.21.15.144:0/2165132119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae815ca40 0x7f9ae8072d60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9ad002a6f0 tx=0x7f9ad00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:42.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.564+0000 7f9adfe00640 1 -- 172.21.15.144:0/2165132119 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0042020 con 0x7f9ae815ca40 2024-09-11T23:18:42.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.564+0000 7f9adfe00640 1 -- 172.21.15.144:0/2165132119 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad003d470 con 0x7f9ae815ca40 2024-09-11T23:18:42.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.564+0000 7f9adfe00640 1 -- 172.21.15.144:0/2165132119 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0037040 con 0x7f9ae815ca40 2024-09-11T23:18:42.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.564+0000 7f9aee800640 1 -- 172.21.15.144:0/2165132119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae80b0150 con 0x7f9ae815ca40 2024-09-11T23:18:42.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.564+0000 7f9aee800640 1 -- 172.21.15.144:0/2165132119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae81f5560 con 0x7f9ae815ca40 2024-09-11T23:18:42.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.565+0000 7f9aee800640 1 -- 172.21.15.144:0/2165132119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ae80d0680 con 0x7f9ae815ca40 2024-09-11T23:18:42.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.566+0000 7f9adfe00640 1 -- 172.21.15.144:0/2165132119 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ad0045020 con 0x7f9ae815ca40 2024-09-11T23:18:42.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.567+0000 7f9adfe00640 1 --2- 172.21.15.144:0/2165132119 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9ac406be30 0x7f9ac406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:42.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.567+0000 7f9adfe00640 1 -- 172.21.15.144:0/2165132119 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f9ad00ab0c0 con 0x7f9ae815ca40 2024-09-11T23:18:42.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.567+0000 7f9ae7400640 1 --2- 172.21.15.144:0/2165132119 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9ac406be30 0x7f9ac406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:42.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.568+0000 7f9ae7400640 1 --2- 172.21.15.144:0/2165132119 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9ac406be30 0x7f9ac406e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8005880 tx=0x7f9ad8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:42.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.572+0000 7f9adfe00640 1 -- 172.21.15.144:0/2165132119 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ad004c030 con 0x7f9ae815ca40 2024-09-11T23:18:42.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.810+0000 7f9aee800640 1 -- 172.21.15.144:0/2165132119 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9ae80aff30 con 0x7f9ae815ca40 2024-09-11T23:18:42.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.811+0000 7f9adfe00640 1 -- 172.21.15.144:0/2165132119 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7f9ad0079d20 con 0x7f9ae815ca40 2024-09-11T23:18:42.811 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:42.811 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:18:42.811 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-11T23:18:42.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.811 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-11T23:18:42.811 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmQjymBhAA4BWEVNGY37RsnMGLL3Ow8A==", 2024-09-11T23:18:42.812 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.812 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:18:42.812 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:18:42.812 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:18:42.812 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:18:42.812 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.812 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-11T23:18:42.812 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmD0mIGhAAvug7T/kOcEmnyMyG++V+zA==", 2024-09-11T23:18:42.812 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.812 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:18:42.812 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:18:42.812 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:18:42.813 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:18:42.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.813 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-11T23:18:42.813 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmDwSZEBAAdf4eF3MrADSPzBTICzpOiA==", 2024-09-11T23:18:42.813 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.813 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:18:42.813 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:18:42.813 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:18:42.813 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:18:42.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.814 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-11T23:18:42.814 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmqYtRJBAAgpzvHNUPVnxNoflhqVIJuQ==", 2024-09-11T23:18:42.814 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.814 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:18:42.814 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:18:42.814 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:18:42.814 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:18:42.814 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.814 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-11T23:18:42.814 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDiJOJmzDABABAA+Qa772+Mm69pecG0QUXlyA==", 2024-09-11T23:18:42.814 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.814 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:18:42.814 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:18:42.815 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:18:42.815 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.815 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-11T23:18:42.815 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDlJOJmgVjJKRAAtl30JxJHurKdrn1vLUneww==", 2024-09-11T23:18:42.815 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.815 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:18:42.815 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:18:42.815 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:18:42.815 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.815 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-11T23:18:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDpJOJmRzO6FxAAiLDOwDlXYTj6WfEhlI+uVQ==", 2024-09-11T23:18:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:18:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:18:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:18:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-11T23:18:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDtJOJmVFh6EhAA7hcJn4k31nEPMcqiB7+djA==", 2024-09-11T23:18:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:18:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:18:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:18:42.816 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.817 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-11T23:18:42.817 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD0JOJmpIFTAhAAYQyoBrMjL6CcDDCNAOMGwQ==", 2024-09-11T23:18:42.817 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.817 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:18:42.817 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:18:42.817 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:18:42.817 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.817 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-11T23:18:42.817 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD4JOJmBAIIDhAA8G/usUslfQPNpFP1YZsgmg==", 2024-09-11T23:18:42.817 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.818 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:18:42.818 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:18:42.818 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:18:42.818 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.818 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-11T23:18:42.818 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD8JOJmDl2dCBAA5bL+2AIp0uWL4qjpI/mAdQ==", 2024-09-11T23:18:42.818 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.818 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:18:42.818 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:18:42.818 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:18:42.818 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.819 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-11T23:18:42.819 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAAJeJmMWX+AhAA7ABVgJPwhRZNkPNdZzmnOQ==", 2024-09-11T23:18:42.819 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.819 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:18:42.819 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:18:42.819 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:18:42.819 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.819 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-11T23:18:42.819 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A==", 2024-09-11T23:18:42.819 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.819 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:18:42.819 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:18:42.820 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:18:42.820 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:18:42.820 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.820 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-11T23:18:42.820 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmLFrBORAAT64lj0sWlVoTHVUZQf0JjA==", 2024-09-11T23:18:42.820 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.820 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:18:42.820 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:18:42.820 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:18:42.820 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:18:42.820 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.821 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-11T23:18:42.821 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJm2/dLMxAAbuKdVAbscrlF5jcBnouBOQ==", 2024-09-11T23:18:42.821 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.821 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:18:42.821 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:18:42.821 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:18:42.821 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:18:42.821 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.821 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-11T23:18:42.821 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDfJOJmse6UBBAAq+3afsp+2jApe9sTFmVVOw==", 2024-09-11T23:18:42.822 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.822 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:18:42.822 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:18:42.822 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:18:42.822 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:18:42.822 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.822 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-11T23:18:42.822 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmHmAwEhAAEGCvu0NgtyjIPcJBk6bkdA==", 2024-09-11T23:18:42.822 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.822 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:18:42.822 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:18:42.822 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:18:42.823 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:18:42.823 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.823 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-mds", 2024-09-11T23:18:42.823 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQANJeJm9t/9JhAA3T8F0/ElRPp2qjsNylJ0vg==", 2024-09-11T23:18:42.823 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.823 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-mds" 2024-09-11T23:18:42.823 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.823 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-mgr", 2024-09-11T23:18:42.823 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQANJeJmJur9JhAAxtK+5nwJokOaaJ1MOnrzTQ==", 2024-09-11T23:18:42.823 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.824 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-11T23:18:42.824 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.824 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-osd", 2024-09-11T23:18:42.824 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQANJeJmnfL9JhAA2pxfTXGc7X3Ma/DXLSViZA==", 2024-09-11T23:18:42.824 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.824 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-osd" 2024-09-11T23:18:42.824 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.824 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-rbd", 2024-09-11T23:18:42.824 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQANJeJmB/v9JhAA54yunpZg4CXoheWIwP2mjg==", 2024-09-11T23:18:42.824 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.825 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-11T23:18:42.825 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.825 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-11T23:18:42.825 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQANJeJmPQX+JhAAoBRGiyijXGgThbawdzYovA==", 2024-09-11T23:18:42.825 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.825 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-11T23:18:42.825 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.825 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.bootstrap-rgw", 2024-09-11T23:18:42.825 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQANJeJm8g3+JhAAyDlI5yz7nPbt2ZAA3U/ldg==", 2024-09-11T23:18:42.825 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.826 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-11T23:18:42.826 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.826 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-11T23:18:42.826 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmxMaVOxAA62zJwlyk0qdrsemalijH4Q==", 2024-09-11T23:18:42.826 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.826 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:18:42.826 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:18:42.826 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:18:42.826 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:18:42.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:42.826 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-11T23:18:42.827 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmWZRNNBAAwZ2GCP7mGn87ZSnsKCcDRQ==", 2024-09-11T23:18:42.827 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:18:42.827 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:18:42.827 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:18:42.827 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:18:42.827 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.827 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:42.827 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:18:42.827 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:18:42.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.813+0000 7f9aee800640 1 -- 172.21.15.144:0/2165132119 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9ac406be30 msgr2=0x7f9ac406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:42.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.813+0000 7f9aee800640 1 --2- 172.21.15.144:0/2165132119 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9ac406be30 0x7f9ac406e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8005880 tx=0x7f9ad8009040 comp rx=0 tx=0).stop 2024-09-11T23:18:42.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.813+0000 7f9aee800640 1 -- 172.21.15.144:0/2165132119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae815ca40 msgr2=0x7f9ae8072d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:42.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.813+0000 7f9aee800640 1 --2- 172.21.15.144:0/2165132119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae815ca40 0x7f9ae8072d60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9ad002a6f0 tx=0x7f9ad00046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:42.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.813+0000 7f9aee800640 1 -- 172.21.15.144:0/2165132119 shutdown_connections 2024-09-11T23:18:42.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.813+0000 7f9aee800640 1 --2- 172.21.15.144:0/2165132119 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9ac406be30 0x7f9ac406e2f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:42.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.813+0000 7f9aee800640 1 --2- 172.21.15.144:0/2165132119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ae815ce80 0x7f9ae80b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:42.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.813+0000 7f9aee800640 1 --2- 172.21.15.144:0/2165132119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ae815ca40 0x7f9ae8072d60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:42.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.813+0000 7f9aee800640 1 --2- 172.21.15.144:0/2165132119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ae80d02a0 0x7f9ae8147e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:42.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.813+0000 7f9aee800640 1 -- 172.21.15.144:0/2165132119 >> 172.21.15.144:0/2165132119 conn(0x7f9ae8062cc0 msgr2=0x7f9ae80b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:42.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.813+0000 7f9aee800640 1 -- 172.21.15.144:0/2165132119 shutdown_connections 2024-09-11T23:18:42.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.814+0000 7f9aee800640 1 -- 172.21.15.144:0/2165132119 wait complete. 2024-09-11T23:18:42.830 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-11T23:18:42.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.983+0000 7fa064c00640 1 Processor -- start 2024-09-11T23:18:42.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.983+0000 7fa064c00640 1 -- start start 2024-09-11T23:18:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.985+0000 7fa064c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa060073830 0x7fa0600cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.985+0000 7fa064c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0600ce740 con 0x7fa0600cf070 2024-09-11T23:18:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.985+0000 7fa064c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa060072640 con 0x7fa06015c180 2024-09-11T23:18:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.985+0000 7fa064c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa060072920 con 0x7fa060073830 2024-09-11T23:18:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.985+0000 7fa055400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa0600cf070 0x7fa060073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34902/0 (socket says 172.21.15.144:34902) 2024-09-11T23:18:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.985+0000 7fa055400640 1 -- 172.21.15.144:0/1137678455 learned_addr learned my addr 172.21.15.144:0/1137678455 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:42.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.985+0000 7fa05e800640 1 --2- 172.21.15.144:0/1137678455 >> v2:172.21.15.165:3300/0 conn(0x7fa060073830 0x7fa0600cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:42.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.985+0000 7fa05d400640 1 -- 172.21.15.144:0/1137678455 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3561039236 0 0) 0x7fa0600ce740 con 0x7fa0600cf070 2024-09-11T23:18:42.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.985+0000 7fa05d400640 1 -- 172.21.15.144:0/1137678455 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa044003520 con 0x7fa0600cf070 2024-09-11T23:18:42.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.986+0000 7fa05e800640 1 -- 172.21.15.144:0/1137678455 >> v1:172.21.15.165:6789/0 conn(0x7fa06015c180 legacy=0x7fa0600cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:42.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.986+0000 7fa05e800640 1 -- 172.21.15.144:0/1137678455 >> v1:172.21.15.144:6789/0 conn(0x7fa0600cf070 legacy=0x7fa060073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:42.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.986+0000 7fa05e800640 1 -- 172.21.15.144:0/1137678455 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa060072c00 con 0x7fa060073830 2024-09-11T23:18:42.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.987+0000 7fa05e800640 1 --2- 172.21.15.144:0/1137678455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa060073830 0x7fa0600cf4e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa058009d90 tx=0x7fa05802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dba8e2b0eafc869 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:42.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.987+0000 7fa05d400640 1 -- 172.21.15.144:0/1137678455 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058007740 con 0x7fa060073830 2024-09-11T23:18:42.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.987+0000 7fa05d400640 1 -- 172.21.15.144:0/1137678455 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0580078e0 con 0x7fa060073830 2024-09-11T23:18:42.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.987+0000 7fa05d400640 1 -- 172.21.15.144:0/1137678455 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058007cb0 con 0x7fa060073830 2024-09-11T23:18:42.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.987+0000 7fa064c00640 1 -- 172.21.15.144:0/1137678455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa060073830 msgr2=0x7fa0600cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:42.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.988+0000 7fa064c00640 1 --2- 172.21.15.144:0/1137678455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa060073830 0x7fa0600cf4e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa058009d90 tx=0x7fa05802a660 comp rx=0 tx=0).stop 2024-09-11T23:18:42.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.988+0000 7fa064c00640 1 -- 172.21.15.144:0/1137678455 shutdown_connections 2024-09-11T23:18:42.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.988+0000 7fa064c00640 1 --2- 172.21.15.144:0/1137678455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa060073830 0x7fa0600cf4e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:42.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.988+0000 7fa064c00640 1 -- 172.21.15.144:0/1137678455 >> 172.21.15.144:0/1137678455 conn(0x7fa060062cc0 msgr2=0x7fa06006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:42.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.988+0000 7fa064c00640 1 -- 172.21.15.144:0/1137678455 shutdown_connections 2024-09-11T23:18:42.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.988+0000 7fa064c00640 1 -- 172.21.15.144:0/1137678455 wait complete. 2024-09-11T23:18:42.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.989+0000 7fa064c00640 1 Processor -- start 2024-09-11T23:18:42.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.989+0000 7fa064c00640 1 -- start start 2024-09-11T23:18:42.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.990+0000 7fa064c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa060073830 0x7fa060155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:42.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.990+0000 7fa064c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0600cf070 0x7fa0601f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:42.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.990+0000 7fa064c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa06015c180 0x7fa0600ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:42.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.990+0000 7fa064c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa0600722f0 con 0x7fa060073830 2024-09-11T23:18:42.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.990+0000 7fa064c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa0600ced00 con 0x7fa06015c180 2024-09-11T23:18:42.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.990+0000 7fa064c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa06015c560 con 0x7fa0600cf070 2024-09-11T23:18:42.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.990+0000 7fa05de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa060073830 0x7fa060155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:42.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.991+0000 7fa05de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa060073830 0x7fa060155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57624/0 (socket says 172.21.15.144:57624) 2024-09-11T23:18:42.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.991+0000 7fa05de00640 1 -- 172.21.15.144:0/2744068875 learned_addr learned my addr 172.21.15.144:0/2744068875 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:42.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.991+0000 7fa055400640 1 --2- 172.21.15.144:0/2744068875 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0600cf070 0x7fa0601f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:42.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.991+0000 7fa05e800640 1 --2- 172.21.15.144:0/2744068875 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa06015c180 0x7fa0600ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:42.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.991+0000 7fa05de00640 1 -- 172.21.15.144:0/2744068875 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0600cf070 msgr2=0x7fa0601f4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:42.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.991+0000 7fa05de00640 1 --2- 172.21.15.144:0/2744068875 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0600cf070 0x7fa0601f4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:42.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.991+0000 7fa05de00640 1 -- 172.21.15.144:0/2744068875 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa06015c180 msgr2=0x7fa0600ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:42.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.991+0000 7fa05de00640 1 --2- 172.21.15.144:0/2744068875 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa06015c180 0x7fa0600ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:42.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.991+0000 7fa05de00640 1 -- 172.21.15.144:0/2744068875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0601f5490 con 0x7fa060073830 2024-09-11T23:18:42.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.991+0000 7fa05de00640 1 --2- 172.21.15.144:0/2744068875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa060073830 0x7fa060155a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa05000c3c0 tx=0x7fa05000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:42.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.991+0000 7fa056a00640 1 -- 172.21.15.144:0/2744068875 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0500052d0 con 0x7fa060073830 2024-09-11T23:18:42.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.991+0000 7fa056a00640 1 -- 172.21.15.144:0/2744068875 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa050005490 con 0x7fa060073830 2024-09-11T23:18:42.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.991+0000 7fa056a00640 1 -- 172.21.15.144:0/2744068875 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa050007260 con 0x7fa060073830 2024-09-11T23:18:42.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.991+0000 7fa064c00640 1 -- 172.21.15.144:0/2744068875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0600affc0 con 0x7fa060073830 2024-09-11T23:18:42.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.992+0000 7fa064c00640 1 -- 172.21.15.144:0/2744068875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0600b0580 con 0x7fa060073830 2024-09-11T23:18:42.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.993+0000 7fa064c00640 1 -- 172.21.15.144:0/2744068875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa060158b50 con 0x7fa060073830 2024-09-11T23:18:42.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.994+0000 7fa056a00640 1 -- 172.21.15.144:0/2744068875 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa050007400 con 0x7fa060073830 2024-09-11T23:18:42.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.994+0000 7fa056a00640 1 --2- 172.21.15.144:0/2744068875 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa03c06be30 0x7fa03c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:42.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.994+0000 7fa056a00640 1 -- 172.21.15.144:0/2744068875 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fa05008a090 con 0x7fa060073830 2024-09-11T23:18:42.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.995+0000 7fa055400640 1 --2- 172.21.15.144:0/2744068875 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa03c06be30 0x7fa03c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:42.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.995+0000 7fa055400640 1 --2- 172.21.15.144:0/2744068875 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa03c06be30 0x7fa03c06e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa0480011e0 tx=0x7fa048009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:42.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:42.999+0000 7fa056a00640 1 -- 172.21.15.144:0/2744068875 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa0601f5490 con 0x7fa060073830 2024-09-11T23:18:43.066 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:18:43.071 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:18:43.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.247+0000 7fa064c00640 1 -- 172.21.15.144:0/2744068875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fa0600cf9d0 con 0x7fa060073830 2024-09-11T23:18:43.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.249+0000 7fa056a00640 1 -- 172.21.15.144:0/2744068875 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7fa050058cf0 con 0x7fa060073830 2024-09-11T23:18:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.252+0000 7fa064c00640 1 -- 172.21.15.144:0/2744068875 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa03c06be30 msgr2=0x7fa03c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.252+0000 7fa064c00640 1 --2- 172.21.15.144:0/2744068875 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa03c06be30 0x7fa03c06e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa0480011e0 tx=0x7fa048009040 comp rx=0 tx=0).stop 2024-09-11T23:18:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.252+0000 7fa064c00640 1 -- 172.21.15.144:0/2744068875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa060073830 msgr2=0x7fa060155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.252+0000 7fa064c00640 1 --2- 172.21.15.144:0/2744068875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa060073830 0x7fa060155a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa05000c3c0 tx=0x7fa05000c880 comp rx=0 tx=0).stop 2024-09-11T23:18:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.252+0000 7fa064c00640 1 -- 172.21.15.144:0/2744068875 shutdown_connections 2024-09-11T23:18:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.252+0000 7fa064c00640 1 --2- 172.21.15.144:0/2744068875 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa03c06be30 0x7fa03c06e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.252+0000 7fa064c00640 1 --2- 172.21.15.144:0/2744068875 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa06015c180 0x7fa0600ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.252+0000 7fa064c00640 1 --2- 172.21.15.144:0/2744068875 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0600cf070 0x7fa0601f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.252+0000 7fa064c00640 1 --2- 172.21.15.144:0/2744068875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa060073830 0x7fa060155a90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.252+0000 7fa064c00640 1 -- 172.21.15.144:0/2744068875 >> 172.21.15.144:0/2744068875 conn(0x7fa060062cc0 msgr2=0x7fa0601598e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:43.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.252+0000 7fa064c00640 1 -- 172.21.15.144:0/2744068875 shutdown_connections 2024-09-11T23:18:43.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.252+0000 7fa064c00640 1 -- 172.21.15.144:0/2744068875 wait complete. 2024-09-11T23:18:43.268 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-11T23:18:43.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.426+0000 7fbfada00640 1 Processor -- start 2024-09-11T23:18:43.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.426+0000 7fbfada00640 1 -- start start 2024-09-11T23:18:43.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.428+0000 7fbfada00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbfa80d3ff0 0x7fbfa80d3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:43.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.428+0000 7fbfada00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfa80d1f40 con 0x7fbfa80d4ae0 2024-09-11T23:18:43.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.428+0000 7fbfada00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfa80d1c60 con 0x7fbfa80b7740 2024-09-11T23:18:43.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.428+0000 7fbfada00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fbfa80cf680 con 0x7fbfa80d3ff0 2024-09-11T23:18:43.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.428+0000 7fbfa7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbfa80d4ae0 0x7fbfa80d4ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34918/0 (socket says 172.21.15.144:34918) 2024-09-11T23:18:43.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.428+0000 7fbfa7e00640 1 -- 172.21.15.144:0/3523189908 learned_addr learned my addr 172.21.15.144:0/3523189908 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:43.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.428+0000 7fbfad000640 1 --2- 172.21.15.144:0/3523189908 >> v2:172.21.15.165:3300/0 conn(0x7fbfa80d3ff0 0x7fbfa80d3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:43.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.428+0000 7fbfa6a00640 1 -- 172.21.15.144:0/3523189908 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4158549480 0 0) 0x7fbfa80d1f40 con 0x7fbfa80d4ae0 2024-09-11T23:18:43.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.428+0000 7fbfa6a00640 1 -- 172.21.15.144:0/3523189908 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf8c003520 con 0x7fbfa80d4ae0 2024-09-11T23:18:43.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.428+0000 7fbfad000640 1 -- 172.21.15.144:0/3523189908 >> v1:172.21.15.165:6789/0 conn(0x7fbfa80b7740 legacy=0x7fbfa80d2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:43.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.428+0000 7fbfad000640 1 -- 172.21.15.144:0/3523189908 >> v1:172.21.15.144:6789/0 conn(0x7fbfa80d4ae0 legacy=0x7fbfa80d4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:43.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.428+0000 7fbfad000640 1 -- 172.21.15.144:0/3523189908 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa80cf960 con 0x7fbfa80d3ff0 2024-09-11T23:18:43.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.429+0000 7fbfad000640 1 --2- 172.21.15.144:0/3523189908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbfa80d3ff0 0x7fbfa80d3330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009d90 tx=0x7fbfa002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc94f6ea3d6d3482 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:43.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.430+0000 7fbfa6a00640 1 -- 172.21.15.144:0/3523189908 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0007740 con 0x7fbfa80d3ff0 2024-09-11T23:18:43.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.430+0000 7fbfa6a00640 1 -- 172.21.15.144:0/3523189908 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfa00078e0 con 0x7fbfa80d3ff0 2024-09-11T23:18:43.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.430+0000 7fbfa6a00640 1 -- 172.21.15.144:0/3523189908 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0007cb0 con 0x7fbfa80d3ff0 2024-09-11T23:18:43.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.430+0000 7fbfada00640 1 -- 172.21.15.144:0/3523189908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbfa80d3ff0 msgr2=0x7fbfa80d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:43.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.430+0000 7fbfada00640 1 --2- 172.21.15.144:0/3523189908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbfa80d3ff0 0x7fbfa80d3330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009d90 tx=0x7fbfa002a660 comp rx=0 tx=0).stop 2024-09-11T23:18:43.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.430+0000 7fbfada00640 1 -- 172.21.15.144:0/3523189908 shutdown_connections 2024-09-11T23:18:43.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.430+0000 7fbfada00640 1 --2- 172.21.15.144:0/3523189908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbfa80d3ff0 0x7fbfa80d3330 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.430+0000 7fbfada00640 1 -- 172.21.15.144:0/3523189908 >> 172.21.15.144:0/3523189908 conn(0x7fbfa8062a50 msgr2=0x7fbfa8062e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:43.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.430+0000 7fbfada00640 1 -- 172.21.15.144:0/3523189908 shutdown_connections 2024-09-11T23:18:43.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.431+0000 7fbfada00640 1 -- 172.21.15.144:0/3523189908 wait complete. 2024-09-11T23:18:43.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.432+0000 7fbfada00640 1 Processor -- start 2024-09-11T23:18:43.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.432+0000 7fbfada00640 1 -- start start 2024-09-11T23:18:43.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.433+0000 7fbfada00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbfa80b7740 0x7fbfa80cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:43.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.433+0000 7fbfada00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbfa80d3ff0 0x7fbfa8146640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:43.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.433+0000 7fbfada00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa80d4ae0 0x7fbfa8146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:43.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.433+0000 7fbfada00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa80d18c0 con 0x7fbfa80d4ae0 2024-09-11T23:18:43.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.433+0000 7fbfada00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa8161f10 con 0x7fbfa80d3ff0 2024-09-11T23:18:43.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.433+0000 7fbfada00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa80d1a40 con 0x7fbfa80b7740 2024-09-11T23:18:43.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.433+0000 7fbfad000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa80d4ae0 0x7fbfa8146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:43.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.433+0000 7fbfad000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa80d4ae0 0x7fbfa8146b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57638/0 (socket says 172.21.15.144:57638) 2024-09-11T23:18:43.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.433+0000 7fbfad000640 1 -- 172.21.15.144:0/1167773478 learned_addr learned my addr 172.21.15.144:0/1167773478 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:43.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.434+0000 7fbfa7400640 1 --2- 172.21.15.144:0/1167773478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbfa80d3ff0 0x7fbfa8146640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:43.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.434+0000 7fbfa7e00640 1 --2- 172.21.15.144:0/1167773478 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbfa80b7740 0x7fbfa80cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:43.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.434+0000 7fbfad000640 1 -- 172.21.15.144:0/1167773478 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbfa80b7740 msgr2=0x7fbfa80cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:43.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.434+0000 7fbfad000640 1 --2- 172.21.15.144:0/1167773478 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbfa80b7740 0x7fbfa80cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.434+0000 7fbfad000640 1 -- 172.21.15.144:0/1167773478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbfa80d3ff0 msgr2=0x7fbfa8146640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:43.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.434+0000 7fbfad000640 1 --2- 172.21.15.144:0/1167773478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbfa80d3ff0 0x7fbfa8146640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.434+0000 7fbfad000640 1 -- 172.21.15.144:0/1167773478 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa815ffb0 con 0x7fbfa80d4ae0 2024-09-11T23:18:43.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.434+0000 7fbfa7400640 1 --2- 172.21.15.144:0/1167773478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbfa80d3ff0 0x7fbfa8146640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:43.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.434+0000 7fbfad000640 1 --2- 172.21.15.144:0/1167773478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa80d4ae0 0x7fbfa8146b80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009eb0 tx=0x7fbfa0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:43.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.434+0000 7fbf9fe00640 1 -- 172.21.15.144:0/1167773478 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0040070 con 0x7fbfa80d4ae0 2024-09-11T23:18:43.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.434+0000 7fbf9fe00640 1 -- 172.21.15.144:0/1167773478 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfa0031bc0 con 0x7fbfa80d4ae0 2024-09-11T23:18:43.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.434+0000 7fbf9fe00640 1 -- 172.21.15.144:0/1167773478 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0009450 con 0x7fbfa80d4ae0 2024-09-11T23:18:43.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.434+0000 7fbfada00640 1 -- 172.21.15.144:0/1167773478 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfa8160290 con 0x7fbfa80d4ae0 2024-09-11T23:18:43.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.435+0000 7fbfada00640 1 -- 172.21.15.144:0/1167773478 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfa8160850 con 0x7fbfa80d4ae0 2024-09-11T23:18:43.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.435+0000 7fbfada00640 1 -- 172.21.15.144:0/1167773478 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfa80b48a0 con 0x7fbfa80d4ae0 2024-09-11T23:18:43.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.436+0000 7fbf9fe00640 1 -- 172.21.15.144:0/1167773478 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbfa0039040 con 0x7fbfa80d4ae0 2024-09-11T23:18:43.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.437+0000 7fbf9fe00640 1 --2- 172.21.15.144:0/1167773478 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbf8806be60 0x7fbf8806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:43.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.437+0000 7fbf9fe00640 1 -- 172.21.15.144:0/1167773478 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fbfa00ac490 con 0x7fbfa80d4ae0 2024-09-11T23:18:43.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.438+0000 7fbfa7e00640 1 --2- 172.21.15.144:0/1167773478 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbf8806be60 0x7fbf8806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:43.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.438+0000 7fbfa7e00640 1 --2- 172.21.15.144:0/1167773478 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbf8806be60 0x7fbf8806e320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbf980011e0 tx=0x7fbf98009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:43.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.442+0000 7fbf9fe00640 1 -- 172.21.15.144:0/1167773478 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbfa0043360 con 0x7fbfa80d4ae0 2024-09-11T23:18:43.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.681+0000 7fbfada00640 1 -- 172.21.15.144:0/1167773478 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fbfa80d3dd0 con 0x7fbfa80d4ae0 2024-09-11T23:18:43.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.685+0000 7fbf9fe00640 1 -- 172.21.15.144:0/1167773478 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7fbfa007b0f0 con 0x7fbfa80d4ae0 2024-09-11T23:18:43.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.687+0000 7fbfada00640 1 -- 172.21.15.144:0/1167773478 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbf8806be60 msgr2=0x7fbf8806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:43.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.687+0000 7fbfada00640 1 --2- 172.21.15.144:0/1167773478 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbf8806be60 0x7fbf8806e320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbf980011e0 tx=0x7fbf98009040 comp rx=0 tx=0).stop 2024-09-11T23:18:43.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.687+0000 7fbfada00640 1 -- 172.21.15.144:0/1167773478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa80d4ae0 msgr2=0x7fbfa8146b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:43.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.687+0000 7fbfada00640 1 --2- 172.21.15.144:0/1167773478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa80d4ae0 0x7fbfa8146b80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009eb0 tx=0x7fbfa0004a40 comp rx=0 tx=0).stop 2024-09-11T23:18:43.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.687+0000 7fbfada00640 1 -- 172.21.15.144:0/1167773478 shutdown_connections 2024-09-11T23:18:43.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.687+0000 7fbfada00640 1 --2- 172.21.15.144:0/1167773478 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbf8806be60 0x7fbf8806e320 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.687+0000 7fbfada00640 1 --2- 172.21.15.144:0/1167773478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbfa80d4ae0 0x7fbfa8146b80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.687+0000 7fbfada00640 1 --2- 172.21.15.144:0/1167773478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbfa80d3ff0 0x7fbfa8146640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.687+0000 7fbfada00640 1 --2- 172.21.15.144:0/1167773478 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbfa80b7740 0x7fbfa80cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.687+0000 7fbfada00640 1 -- 172.21.15.144:0/1167773478 >> 172.21.15.144:0/1167773478 conn(0x7fbfa8062a50 msgr2=0x7fbfa80d2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:43.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.687+0000 7fbfada00640 1 -- 172.21.15.144:0/1167773478 shutdown_connections 2024-09-11T23:18:43.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.687+0000 7fbfada00640 1 -- 172.21.15.144:0/1167773478 wait complete. 2024-09-11T23:18:43.703 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-11T23:18:43.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.857+0000 7f2b63200640 1 Processor -- start 2024-09-11T23:18:43.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.857+0000 7f2b63200640 1 -- start start 2024-09-11T23:18:43.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.858+0000 7f2b63200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2b5c15e640 0x7f2b5c0d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:43.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.858+0000 7f2b63200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b5c0d3f60 0x7f2b5c0b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:43.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.858+0000 7f2b63200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b5c06bee0 con 0x7f2b5c0b6510 2024-09-11T23:18:43.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.858+0000 7f2b63200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2b5c15ea20 con 0x7f2b5c15e640 2024-09-11T23:18:43.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.858+0000 7f2b63200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2b5c06caf0 con 0x7f2b5c0d3f60 2024-09-11T23:18:43.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.859+0000 7f2b61e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2b5c15e640 0x7f2b5c0d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:43.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.859+0000 7f2b61400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b5c0d3f60 0x7f2b5c0b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:43.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.859+0000 7f2b61e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2b5c15e640 0x7f2b5c0d3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:41650/0 (socket says 172.21.15.144:41650) 2024-09-11T23:18:43.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.859+0000 7f2b61e00640 1 -- 172.21.15.144:0/4178559576 learned_addr learned my addr 172.21.15.144:0/4178559576 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:43.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.859+0000 7f2b61e00640 1 -- 172.21.15.144:0/4178559576 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b5c0d3f60 msgr2=0x7f2b5c0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:43.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.859+0000 7f2b61e00640 1 --2- 172.21.15.144:0/4178559576 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b5c0d3f60 0x7f2b5c0b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.859+0000 7f2b61e00640 1 -- 172.21.15.144:0/4178559576 >> v1:172.21.15.165:6789/0 conn(0x7f2b5c0b6510 legacy=0x7f2b5c0d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:43.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.859+0000 7f2b61e00640 1 -- 172.21.15.144:0/4178559576 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5c06c1c0 con 0x7f2b5c15e640 2024-09-11T23:18:43.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.859+0000 7f2b61400640 1 --2- 172.21.15.144:0/4178559576 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b5c0d3f60 0x7f2b5c0b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:43.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.860+0000 7f2b61e00640 1 --2- 172.21.15.144:0/4178559576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b5c15e640 0x7f2b5c0d3a20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009870 tx=0x7f2b5002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85b3c0d5a1a552e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:43.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.860+0000 7f2b60a00640 1 -- 172.21.15.144:0/4178559576 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b50037070 con 0x7f2b5c15e640 2024-09-11T23:18:43.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.861+0000 7f2b60a00640 1 -- 172.21.15.144:0/4178559576 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b50032440 con 0x7f2b5c15e640 2024-09-11T23:18:43.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.861+0000 7f2b60a00640 1 -- 172.21.15.144:0/4178559576 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b50032810 con 0x7f2b5c15e640 2024-09-11T23:18:43.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.861+0000 7f2b63200640 1 -- 172.21.15.144:0/4178559576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b5c15e640 msgr2=0x7f2b5c0d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:43.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.861+0000 7f2b63200640 1 --2- 172.21.15.144:0/4178559576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b5c15e640 0x7f2b5c0d3a20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009870 tx=0x7f2b5002a250 comp rx=0 tx=0).stop 2024-09-11T23:18:43.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.861+0000 7f2b63200640 1 -- 172.21.15.144:0/4178559576 shutdown_connections 2024-09-11T23:18:43.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.861+0000 7f2b63200640 1 --2- 172.21.15.144:0/4178559576 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b5c0d3f60 0x7f2b5c0b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.861+0000 7f2b63200640 1 --2- 172.21.15.144:0/4178559576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b5c15e640 0x7f2b5c0d3a20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.861+0000 7f2b63200640 1 -- 172.21.15.144:0/4178559576 >> 172.21.15.144:0/4178559576 conn(0x7f2b5c0d0fd0 msgr2=0x7f2b5c0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:43.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.861+0000 7f2b63200640 1 -- 172.21.15.144:0/4178559576 shutdown_connections 2024-09-11T23:18:43.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.861+0000 7f2b63200640 1 -- 172.21.15.144:0/4178559576 wait complete. 2024-09-11T23:18:43.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.863+0000 7f2b63200640 1 Processor -- start 2024-09-11T23:18:43.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.863+0000 7f2b63200640 1 -- start start 2024-09-11T23:18:43.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.864+0000 7f2b63200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b5c0b6510 0x7f2b5c1e90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:43.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.864+0000 7f2b63200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b5c0d3f60 0x7f2b5c14a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:43.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.864+0000 7f2b63200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b5c15e640 0x7f2b5c14c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:43.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.864+0000 7f2b63200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c0b8760 con 0x7f2b5c0b6510 2024-09-11T23:18:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.864+0000 7f2b63200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c06c780 con 0x7f2b5c15e640 2024-09-11T23:18:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.864+0000 7f2b63200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2b5c0b88e0 con 0x7f2b5c0d3f60 2024-09-11T23:18:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.864+0000 7f2b61e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b5c0b6510 0x7f2b5c1e90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.864+0000 7f2b61e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b5c0b6510 0x7f2b5c1e90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57654/0 (socket says 172.21.15.144:57654) 2024-09-11T23:18:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.864+0000 7f2b61e00640 1 -- 172.21.15.144:0/956455240 learned_addr learned my addr 172.21.15.144:0/956455240 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.864+0000 7f2b61400640 1 --2- 172.21.15.144:0/956455240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b5c0d3f60 0x7f2b5c14a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.864+0000 7f2b62800640 1 --2- 172.21.15.144:0/956455240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b5c15e640 0x7f2b5c14c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.865+0000 7f2b61e00640 1 -- 172.21.15.144:0/956455240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b5c0d3f60 msgr2=0x7f2b5c14a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.865+0000 7f2b61e00640 1 --2- 172.21.15.144:0/956455240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b5c0d3f60 0x7f2b5c14a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.865+0000 7f2b61e00640 1 -- 172.21.15.144:0/956455240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b5c15e640 msgr2=0x7f2b5c14c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.865+0000 7f2b61e00640 1 --2- 172.21.15.144:0/956455240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b5c15e640 0x7f2b5c14c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.865+0000 7f2b61e00640 1 -- 172.21.15.144:0/956455240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5c15dd00 con 0x7f2b5c0b6510 2024-09-11T23:18:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.865+0000 7f2b61e00640 1 --2- 172.21.15.144:0/956455240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b5c0b6510 0x7f2b5c1e90e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2b5002a290 tx=0x7f2b500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:43.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.865+0000 7f2b56000640 1 -- 172.21.15.144:0/956455240 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b50037040 con 0x7f2b5c0b6510 2024-09-11T23:18:43.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.865+0000 7f2b56000640 1 -- 172.21.15.144:0/956455240 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b50042070 con 0x7f2b5c0b6510 2024-09-11T23:18:43.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.865+0000 7f2b63200640 1 -- 172.21.15.144:0/956455240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b5c0c8510 con 0x7f2b5c0b6510 2024-09-11T23:18:43.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.865+0000 7f2b56000640 1 -- 172.21.15.144:0/956455240 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b50030880 con 0x7f2b5c0b6510 2024-09-11T23:18:43.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.865+0000 7f2b63200640 1 -- 172.21.15.144:0/956455240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b5c1e88e0 con 0x7f2b5c0b6510 2024-09-11T23:18:43.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.867+0000 7f2b63200640 1 -- 172.21.15.144:0/956455240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b5c0b5fd0 con 0x7f2b5c0b6510 2024-09-11T23:18:43.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.867+0000 7f2b56000640 1 -- 172.21.15.144:0/956455240 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b50030a20 con 0x7f2b5c0b6510 2024-09-11T23:18:43.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.868+0000 7f2b56000640 1 --2- 172.21.15.144:0/956455240 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2b4006be60 0x7f2b4006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:43.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.868+0000 7f2b56000640 1 -- 172.21.15.144:0/956455240 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f2b500ab3f0 con 0x7f2b5c0b6510 2024-09-11T23:18:43.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.868+0000 7f2b61400640 1 --2- 172.21.15.144:0/956455240 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2b4006be60 0x7f2b4006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:43.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.869+0000 7f2b61400640 1 --2- 172.21.15.144:0/956455240 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2b4006be60 0x7f2b4006e320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c009560 tx=0x7f2b4c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:43.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:43.872+0000 7f2b56000640 1 -- 172.21.15.144:0/956455240 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2b5007a050 con 0x7f2b5c0b6510 2024-09-11T23:18:44.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.113+0000 7f2b63200640 1 -- 172.21.15.144:0/956455240 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f2b5c0d3200 con 0x7f2b5c0b6510 2024-09-11T23:18:44.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.117+0000 7f2b56000640 1 -- 172.21.15.144:0/956455240 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f2b50079950 con 0x7f2b5c0b6510 2024-09-11T23:18:44.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.119+0000 7f2b63200640 1 -- 172.21.15.144:0/956455240 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2b4006be60 msgr2=0x7f2b4006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:44.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.119+0000 7f2b63200640 1 --2- 172.21.15.144:0/956455240 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2b4006be60 0x7f2b4006e320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c009560 tx=0x7f2b4c008040 comp rx=0 tx=0).stop 2024-09-11T23:18:44.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.119+0000 7f2b63200640 1 -- 172.21.15.144:0/956455240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b5c0b6510 msgr2=0x7f2b5c1e90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:44.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.119+0000 7f2b63200640 1 --2- 172.21.15.144:0/956455240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b5c0b6510 0x7f2b5c1e90e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2b5002a290 tx=0x7f2b500046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.119+0000 7f2b63200640 1 -- 172.21.15.144:0/956455240 shutdown_connections 2024-09-11T23:18:44.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.119+0000 7f2b63200640 1 --2- 172.21.15.144:0/956455240 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2b4006be60 0x7f2b4006e320 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.119+0000 7f2b63200640 1 --2- 172.21.15.144:0/956455240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b5c15e640 0x7f2b5c14c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.119+0000 7f2b63200640 1 --2- 172.21.15.144:0/956455240 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b5c0d3f60 0x7f2b5c14a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.119+0000 7f2b63200640 1 --2- 172.21.15.144:0/956455240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b5c0b6510 0x7f2b5c1e90e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.119+0000 7f2b63200640 1 -- 172.21.15.144:0/956455240 >> 172.21.15.144:0/956455240 conn(0x7f2b5c0d0fd0 msgr2=0x7f2b5c0b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:44.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.119+0000 7f2b63200640 1 -- 172.21.15.144:0/956455240 shutdown_connections 2024-09-11T23:18:44.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.119+0000 7f2b63200640 1 -- 172.21.15.144:0/956455240 wait complete. 2024-09-11T23:18:44.135 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-11T23:18:44.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.289+0000 7f121be00640 1 Processor -- start 2024-09-11T23:18:44.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.290+0000 7f121be00640 1 -- start start 2024-09-11T23:18:44.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.291+0000 7f121be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f121415c180 0x7f12140cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:44.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.291+0000 7f121be00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1214073120 0x7f12140735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:44.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.291+0000 7f121be00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12140ce740 con 0x7f12140ce230 2024-09-11T23:18:44.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.291+0000 7f121be00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1214072640 con 0x7f1214073120 2024-09-11T23:18:44.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.291+0000 7f121be00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1214072920 con 0x7f121415c180 2024-09-11T23:18:44.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.291+0000 7f1218a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f12140ce230 0x7f12140cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34922/0 (socket says 172.21.15.144:34922) 2024-09-11T23:18:44.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.291+0000 7f1218a00640 1 -- 172.21.15.144:0/2791049093 learned_addr learned my addr 172.21.15.144:0/2791049093 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:44.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.291+0000 7f1219e00640 1 --2- 172.21.15.144:0/2791049093 >> v2:172.21.15.165:3300/0 conn(0x7f1214073120 0x7f12140735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:44.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.291+0000 7f1219400640 1 --2- 172.21.15.144:0/2791049093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f121415c180 0x7f12140cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:44.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.292+0000 7f1213e00640 1 -- 172.21.15.144:0/2791049093 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2963806647 0 0) 0x7f12140ce740 con 0x7f12140ce230 2024-09-11T23:18:44.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.292+0000 7f1213e00640 1 -- 172.21.15.144:0/2791049093 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11fc003520 con 0x7f12140ce230 2024-09-11T23:18:44.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.292+0000 7f1219e00640 1 -- 172.21.15.144:0/2791049093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f121415c180 msgr2=0x7f12140cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:44.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.292+0000 7f1219e00640 1 --2- 172.21.15.144:0/2791049093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f121415c180 0x7f12140cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.292+0000 7f1219e00640 1 -- 172.21.15.144:0/2791049093 >> v1:172.21.15.144:6789/0 conn(0x7f12140ce230 legacy=0x7f12140cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:44.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.292+0000 7f1219e00640 1 -- 172.21.15.144:0/2791049093 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1214072c00 con 0x7f1214073120 2024-09-11T23:18:44.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.293+0000 7f1219e00640 1 --2- 172.21.15.144:0/2791049093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1214073120 0x7f12140735d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f120c009d90 tx=0x7f120c02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b586147c954068e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:44.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.293+0000 7f1213e00640 1 -- 172.21.15.144:0/2791049093 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c031600 con 0x7f1214073120 2024-09-11T23:18:44.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.293+0000 7f1213e00640 1 -- 172.21.15.144:0/2791049093 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f120c0317a0 con 0x7f1214073120 2024-09-11T23:18:44.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.293+0000 7f1213e00640 1 -- 172.21.15.144:0/2791049093 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c031b70 con 0x7f1214073120 2024-09-11T23:18:44.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.294+0000 7f121be00640 1 -- 172.21.15.144:0/2791049093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1214073120 msgr2=0x7f12140735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:44.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.294+0000 7f121be00640 1 --2- 172.21.15.144:0/2791049093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1214073120 0x7f12140735d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f120c009d90 tx=0x7f120c02a5d0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.294+0000 7f121be00640 1 -- 172.21.15.144:0/2791049093 shutdown_connections 2024-09-11T23:18:44.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.294+0000 7f121be00640 1 --2- 172.21.15.144:0/2791049093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1214073120 0x7f12140735d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.294+0000 7f121be00640 1 --2- 172.21.15.144:0/2791049093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f121415c180 0x7f12140cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.294+0000 7f121be00640 1 -- 172.21.15.144:0/2791049093 >> 172.21.15.144:0/2791049093 conn(0x7f1214062cc0 msgr2=0x7f121406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:44.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.294+0000 7f121be00640 1 -- 172.21.15.144:0/2791049093 shutdown_connections 2024-09-11T23:18:44.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.294+0000 7f121be00640 1 -- 172.21.15.144:0/2791049093 wait complete. 2024-09-11T23:18:44.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.296+0000 7f121be00640 1 Processor -- start 2024-09-11T23:18:44.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.296+0000 7f121be00640 1 -- start start 2024-09-11T23:18:44.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.296+0000 7f121be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1214073120 0x7f12141490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:44.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.297+0000 7f121be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12140ce230 0x7f121414f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:44.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.297+0000 7f121be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f121415c180 0x7f1214151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:44.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.297+0000 7f121be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f12140cf780 con 0x7f121415c180 2024-09-11T23:18:44.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.297+0000 7f121be00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f12140722f0 con 0x7f1214073120 2024-09-11T23:18:44.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.297+0000 7f121be00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f121415c560 con 0x7f12140ce230 2024-09-11T23:18:44.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.297+0000 7f1219e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f121415c180 0x7f1214151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:44.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.297+0000 7f1219e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f121415c180 0x7f1214151eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57664/0 (socket says 172.21.15.144:57664) 2024-09-11T23:18:44.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.297+0000 7f1219e00640 1 -- 172.21.15.144:0/3435857334 learned_addr learned my addr 172.21.15.144:0/3435857334 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:44.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.297+0000 7f1218a00640 1 --2- 172.21.15.144:0/3435857334 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12140ce230 0x7f121414f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:44.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.297+0000 7f1219400640 1 --2- 172.21.15.144:0/3435857334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1214073120 0x7f12141490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:44.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.297+0000 7f1219e00640 1 -- 172.21.15.144:0/3435857334 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12140ce230 msgr2=0x7f121414f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:44.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.297+0000 7f1219e00640 1 --2- 172.21.15.144:0/3435857334 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12140ce230 0x7f121414f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.297+0000 7f1219e00640 1 -- 172.21.15.144:0/3435857334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1214073120 msgr2=0x7f12141490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:44.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.297+0000 7f1219e00640 1 --2- 172.21.15.144:0/3435857334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1214073120 0x7f12141490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.297+0000 7f1219e00640 1 -- 172.21.15.144:0/3435857334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1214154c60 con 0x7f121415c180 2024-09-11T23:18:44.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.297+0000 7f1219400640 1 --2- 172.21.15.144:0/3435857334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1214073120 0x7f12141490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:44.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.297+0000 7f1218a00640 1 --2- 172.21.15.144:0/3435857334 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12140ce230 0x7f121414f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:44.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.298+0000 7f1219e00640 1 --2- 172.21.15.144:0/3435857334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f121415c180 0x7f1214151eb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f120c02abc0 tx=0x7f120c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:44.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.298+0000 7f1211600640 1 -- 172.21.15.144:0/3435857334 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c03f070 con 0x7f121415c180 2024-09-11T23:18:44.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.298+0000 7f1211600640 1 -- 172.21.15.144:0/3435857334 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f120c03b820 con 0x7f121415c180 2024-09-11T23:18:44.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.298+0000 7f1211600640 1 -- 172.21.15.144:0/3435857334 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c03bbd0 con 0x7f121415c180 2024-09-11T23:18:44.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.298+0000 7f121be00640 1 -- 172.21.15.144:0/3435857334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1214154f40 con 0x7f121415c180 2024-09-11T23:18:44.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.298+0000 7f121be00640 1 -- 172.21.15.144:0/3435857334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1214150250 con 0x7f121415c180 2024-09-11T23:18:44.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.299+0000 7f121be00640 1 -- 172.21.15.144:0/3435857334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1214156e80 con 0x7f121415c180 2024-09-11T23:18:44.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.300+0000 7f1211600640 1 -- 172.21.15.144:0/3435857334 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f120c04d3f0 con 0x7f121415c180 2024-09-11T23:18:44.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.301+0000 7f1211600640 1 --2- 172.21.15.144:0/3435857334 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f11f406be60 0x7f11f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:44.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.301+0000 7f1211600640 1 -- 172.21.15.144:0/3435857334 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f120c0abff0 con 0x7f121415c180 2024-09-11T23:18:44.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.301+0000 7f1219400640 1 --2- 172.21.15.144:0/3435857334 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f11f406be60 0x7f11f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:44.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.302+0000 7f1219400640 1 --2- 172.21.15.144:0/3435857334 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f11f406be60 0x7f11f406e320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1208009ac0 tx=0x7f1208008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:44.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.305+0000 7f1211600640 1 -- 172.21.15.144:0/3435857334 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f120c07ac70 con 0x7f121415c180 2024-09-11T23:18:44.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.543+0000 7f121be00640 1 -- 172.21.15.144:0/3435857334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f1214159140 con 0x7f121415c180 2024-09-11T23:18:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.547+0000 7f1211600640 1 -- 172.21.15.144:0/3435857334 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f120c07a570 con 0x7f121415c180 2024-09-11T23:18:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.550+0000 7f121be00640 1 -- 172.21.15.144:0/3435857334 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f11f406be60 msgr2=0x7f11f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.550+0000 7f121be00640 1 --2- 172.21.15.144:0/3435857334 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f11f406be60 0x7f11f406e320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1208009ac0 tx=0x7f1208008040 comp rx=0 tx=0).stop 2024-09-11T23:18:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.550+0000 7f121be00640 1 -- 172.21.15.144:0/3435857334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f121415c180 msgr2=0x7f1214151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.550+0000 7f121be00640 1 --2- 172.21.15.144:0/3435857334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f121415c180 0x7f1214151eb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f120c02abc0 tx=0x7f120c004a40 comp rx=0 tx=0).stop 2024-09-11T23:18:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.550+0000 7f121be00640 1 -- 172.21.15.144:0/3435857334 shutdown_connections 2024-09-11T23:18:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.550+0000 7f121be00640 1 --2- 172.21.15.144:0/3435857334 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f11f406be60 0x7f11f406e320 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.550+0000 7f121be00640 1 --2- 172.21.15.144:0/3435857334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f121415c180 0x7f1214151eb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.550+0000 7f121be00640 1 --2- 172.21.15.144:0/3435857334 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12140ce230 0x7f121414f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.550+0000 7f121be00640 1 --2- 172.21.15.144:0/3435857334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1214073120 0x7f12141490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.550+0000 7f121be00640 1 -- 172.21.15.144:0/3435857334 >> 172.21.15.144:0/3435857334 conn(0x7f1214062cc0 msgr2=0x7f1214157680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.550+0000 7f121be00640 1 -- 172.21.15.144:0/3435857334 shutdown_connections 2024-09-11T23:18:44.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.550+0000 7f121be00640 1 -- 172.21.15.144:0/3435857334 wait complete. 2024-09-11T23:18:44.566 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-11T23:18:44.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.722+0000 7ff53a200640 1 Processor -- start 2024-09-11T23:18:44.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.722+0000 7ff53a200640 1 -- start start 2024-09-11T23:18:44.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.724+0000 7ff53a200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff53415a0a0 0x7ff534073180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:44.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.724+0000 7ff53a200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff5340ceb90 0x7ff5340b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:44.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.724+0000 7ff53a200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff534072100 con 0x7ff5340736c0 2024-09-11T23:18:44.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.724+0000 7ff53a200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff5340723c0 con 0x7ff53415a0a0 2024-09-11T23:18:44.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.724+0000 7ff53a200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff5340726a0 con 0x7ff5340ceb90 2024-09-11T23:18:44.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.724+0000 7ff538e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff53415a0a0 0x7ff534073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:44.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.724+0000 7ff52be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff5340736c0 0x7ff5340ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50698/0 (socket says 172.21.15.144:50698) 2024-09-11T23:18:44.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.724+0000 7ff52be00640 1 -- 172.21.15.144:0/4143633492 learned_addr learned my addr 172.21.15.144:0/4143633492 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:44.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.724+0000 7ff539800640 1 --2- 172.21.15.144:0/4143633492 >> v2:172.21.15.165:3300/0 conn(0x7ff5340ceb90 0x7ff5340b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:44.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.724+0000 7ff538e00640 1 -- 172.21.15.144:0/4143633492 >> v2:172.21.15.165:3300/0 conn(0x7ff5340ceb90 msgr2=0x7ff5340b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:44.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.725+0000 7ff538e00640 1 --2- 172.21.15.144:0/4143633492 >> v2:172.21.15.165:3300/0 conn(0x7ff5340ceb90 0x7ff5340b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.725+0000 7ff538e00640 1 -- 172.21.15.144:0/4143633492 >> v1:172.21.15.144:6789/0 conn(0x7ff5340736c0 legacy=0x7ff5340ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:44.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.725+0000 7ff538e00640 1 -- 172.21.15.144:0/4143633492 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff534072980 con 0x7ff53415a0a0 2024-09-11T23:18:44.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.725+0000 7ff533e00640 1 -- 172.21.15.144:0/4143633492 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 990596163 0 0) 0x7ff534072100 con 0x7ff5340736c0 2024-09-11T23:18:44.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.726+0000 7ff538e00640 1 --2- 172.21.15.144:0/4143633492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff53415a0a0 0x7ff534073180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff534072c60 tx=0x7ff52402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c18ee0a6105939a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:44.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.726+0000 7ff533e00640 1 -- 172.21.15.144:0/4143633492 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524037070 con 0x7ff53415a0a0 2024-09-11T23:18:44.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.726+0000 7ff533e00640 1 -- 172.21.15.144:0/4143633492 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff524032440 con 0x7ff53415a0a0 2024-09-11T23:18:44.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.726+0000 7ff533e00640 1 -- 172.21.15.144:0/4143633492 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524032810 con 0x7ff53415a0a0 2024-09-11T23:18:44.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.726+0000 7ff53a200640 1 -- 172.21.15.144:0/4143633492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff53415a0a0 msgr2=0x7ff534073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:44.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.726+0000 7ff53a200640 1 --2- 172.21.15.144:0/4143633492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff53415a0a0 0x7ff534073180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff534072c60 tx=0x7ff52402a1a0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.726+0000 7ff53a200640 1 -- 172.21.15.144:0/4143633492 shutdown_connections 2024-09-11T23:18:44.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.726+0000 7ff53a200640 1 --2- 172.21.15.144:0/4143633492 >> v2:172.21.15.165:3300/0 conn(0x7ff5340ceb90 0x7ff5340b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.726+0000 7ff53a200640 1 --2- 172.21.15.144:0/4143633492 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff53415a0a0 0x7ff534073180 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.726+0000 7ff53a200640 1 -- 172.21.15.144:0/4143633492 >> 172.21.15.144:0/4143633492 conn(0x7ff53406e910 msgr2=0x7ff53406bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:44.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.726+0000 7ff53a200640 1 -- 172.21.15.144:0/4143633492 shutdown_connections 2024-09-11T23:18:44.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.726+0000 7ff53a200640 1 -- 172.21.15.144:0/4143633492 wait complete. 2024-09-11T23:18:44.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.728+0000 7ff53a200640 1 Processor -- start 2024-09-11T23:18:44.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.728+0000 7ff53a200640 1 -- start start 2024-09-11T23:18:44.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.729+0000 7ff53a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5340ceb90 0x7ff534152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:44.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.729+0000 7ff53a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff53415a0a0 0x7ff5341567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:44.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.729+0000 7ff53a200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5340b13d0 0x7ff5341475a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:44.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.729+0000 7ff53a200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff5340b26d0 con 0x7ff53415a0a0 2024-09-11T23:18:44.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.729+0000 7ff53a200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff5340b2550 con 0x7ff5340b13d0 2024-09-11T23:18:44.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.729+0000 7ff53a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff5340cf240 con 0x7ff5340ceb90 2024-09-11T23:18:44.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.729+0000 7ff52be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff53415a0a0 0x7ff5341567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:44.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.729+0000 7ff52be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff53415a0a0 0x7ff5341567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49928/0 (socket says 172.21.15.144:49928) 2024-09-11T23:18:44.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.729+0000 7ff52be00640 1 -- 172.21.15.144:0/1580436435 learned_addr learned my addr 172.21.15.144:0/1580436435 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:44.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.729+0000 7ff538e00640 1 --2- 172.21.15.144:0/1580436435 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5340ceb90 0x7ff534152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:44.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.729+0000 7ff539800640 1 --2- 172.21.15.144:0/1580436435 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5340b13d0 0x7ff5341475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:44.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.730+0000 7ff52be00640 1 -- 172.21.15.144:0/1580436435 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5340ceb90 msgr2=0x7ff534152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:44.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.730+0000 7ff52be00640 1 --2- 172.21.15.144:0/1580436435 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5340ceb90 0x7ff534152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.730+0000 7ff52be00640 1 -- 172.21.15.144:0/1580436435 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5340b13d0 msgr2=0x7ff5341475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:44.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.730+0000 7ff52be00640 1 --2- 172.21.15.144:0/1580436435 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5340b13d0 0x7ff5341475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.730+0000 7ff52be00640 1 -- 172.21.15.144:0/1580436435 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5341519f0 con 0x7ff53415a0a0 2024-09-11T23:18:44.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.730+0000 7ff52be00640 1 --2- 172.21.15.144:0/1580436435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff53415a0a0 0x7ff5341567e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00c500 tx=0x7ff51c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:44.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.730+0000 7ff531600640 1 -- 172.21.15.144:0/1580436435 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c018070 con 0x7ff53415a0a0 2024-09-11T23:18:44.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.730+0000 7ff531600640 1 -- 172.21.15.144:0/1580436435 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff51c007580 con 0x7ff53415a0a0 2024-09-11T23:18:44.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.730+0000 7ff531600640 1 -- 172.21.15.144:0/1580436435 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c004a20 con 0x7ff53415a0a0 2024-09-11T23:18:44.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.730+0000 7ff53a200640 1 -- 172.21.15.144:0/1580436435 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff534151cd0 con 0x7ff53415a0a0 2024-09-11T23:18:44.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.730+0000 7ff53a200640 1 -- 172.21.15.144:0/1580436435 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff534152290 con 0x7ff53415a0a0 2024-09-11T23:18:44.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.731+0000 7ff53a200640 1 -- 172.21.15.144:0/1580436435 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5340b1dc0 con 0x7ff53415a0a0 2024-09-11T23:18:44.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.732+0000 7ff531600640 1 -- 172.21.15.144:0/1580436435 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff51c01b070 con 0x7ff53415a0a0 2024-09-11T23:18:44.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.733+0000 7ff531600640 1 --2- 172.21.15.144:0/1580436435 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff51006be30 0x7ff51006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:44.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.733+0000 7ff531600640 1 -- 172.21.15.144:0/1580436435 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7ff51c089de0 con 0x7ff53415a0a0 2024-09-11T23:18:44.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.733+0000 7ff538e00640 1 --2- 172.21.15.144:0/1580436435 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff51006be30 0x7ff51006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:44.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.734+0000 7ff538e00640 1 --2- 172.21.15.144:0/1580436435 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff51006be30 0x7ff51006e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff524034000 tx=0x7ff52402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:44.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.737+0000 7ff531600640 1 -- 172.21.15.144:0/1580436435 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff51c058480 con 0x7ff53415a0a0 2024-09-11T23:18:44.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.972+0000 7ff53a200640 1 -- 172.21.15.144:0/1580436435 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7ff5340cf020 con 0x7ff53415a0a0 2024-09-11T23:18:44.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.976+0000 7ff531600640 1 -- 172.21.15.144:0/1580436435 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7ff51c05c780 con 0x7ff53415a0a0 2024-09-11T23:18:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.978+0000 7ff53a200640 1 -- 172.21.15.144:0/1580436435 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff51006be30 msgr2=0x7ff51006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.978+0000 7ff53a200640 1 --2- 172.21.15.144:0/1580436435 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff51006be30 0x7ff51006e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff524034000 tx=0x7ff52402e000 comp rx=0 tx=0).stop 2024-09-11T23:18:44.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.978+0000 7ff53a200640 1 -- 172.21.15.144:0/1580436435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff53415a0a0 msgr2=0x7ff5341567e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:44.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.978+0000 7ff53a200640 1 --2- 172.21.15.144:0/1580436435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff53415a0a0 0x7ff5341567e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00c500 tx=0x7ff51c00c9c0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.978+0000 7ff53a200640 1 -- 172.21.15.144:0/1580436435 shutdown_connections 2024-09-11T23:18:44.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.978+0000 7ff53a200640 1 --2- 172.21.15.144:0/1580436435 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff51006be30 0x7ff51006e2f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.978+0000 7ff53a200640 1 --2- 172.21.15.144:0/1580436435 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5340b13d0 0x7ff5341475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.978+0000 7ff53a200640 1 --2- 172.21.15.144:0/1580436435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff53415a0a0 0x7ff5341567e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.978+0000 7ff53a200640 1 --2- 172.21.15.144:0/1580436435 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5340ceb90 0x7ff534152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:44.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.978+0000 7ff53a200640 1 -- 172.21.15.144:0/1580436435 >> 172.21.15.144:0/1580436435 conn(0x7ff53406e910 msgr2=0x7ff5340ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:44.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.979+0000 7ff53a200640 1 -- 172.21.15.144:0/1580436435 shutdown_connections 2024-09-11T23:18:44.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:44.979+0000 7ff53a200640 1 -- 172.21.15.144:0/1580436435 wait complete. 2024-09-11T23:18:44.995 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-11T23:18:45.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.149+0000 7f038b200640 1 Processor -- start 2024-09-11T23:18:45.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.149+0000 7f038b200640 1 -- start start 2024-09-11T23:18:45.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.150+0000 7f038b200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f038c15e640 0x7f038c0d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.150+0000 7f038b200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f038c06bee0 con 0x7f038c0d3f60 2024-09-11T23:18:45.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.150+0000 7f038b200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f038c06c1c0 con 0x7f038c0b66e0 2024-09-11T23:18:45.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.150+0000 7f038b200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f038c15ea20 con 0x7f038c15e640 2024-09-11T23:18:45.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.150+0000 7f0389400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f038c0d3f60 0x7f038c0b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50708/0 (socket says 172.21.15.144:50708) 2024-09-11T23:18:45.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.150+0000 7f0389400640 1 -- 172.21.15.144:0/3360363869 learned_addr learned my addr 172.21.15.144:0/3360363869 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:45.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.151+0000 7f0389e00640 1 --2- 172.21.15.144:0/3360363869 >> v2:172.21.15.165:3300/0 conn(0x7f038c15e640 0x7f038c0d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.151+0000 7f0388a00640 1 -- 172.21.15.144:0/3360363869 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3125859366 0 0) 0x7f038c06bee0 con 0x7f038c0d3f60 2024-09-11T23:18:45.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.151+0000 7f0388a00640 1 -- 172.21.15.144:0/3360363869 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0370003520 con 0x7f038c0d3f60 2024-09-11T23:18:45.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.151+0000 7f0388a00640 1 -- 172.21.15.144:0/3360363869 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1102697705 0 0) 0x7f038c06c1c0 con 0x7f038c0b66e0 2024-09-11T23:18:45.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.151+0000 7f0388a00640 1 -- 172.21.15.144:0/3360363869 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f038c06bee0 con 0x7f038c0b66e0 2024-09-11T23:18:45.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.151+0000 7f0389e00640 1 -- 172.21.15.144:0/3360363869 >> v1:172.21.15.165:6789/0 conn(0x7f038c0b66e0 legacy=0x7f038c0b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.151+0000 7f0389e00640 1 -- 172.21.15.144:0/3360363869 >> v1:172.21.15.144:6789/0 conn(0x7f038c0d3f60 legacy=0x7f038c0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.151+0000 7f0389e00640 1 -- 172.21.15.144:0/3360363869 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038c06c4a0 con 0x7f038c15e640 2024-09-11T23:18:45.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.152+0000 7f0389e00640 1 --2- 172.21.15.144:0/3360363869 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f038c15e640 0x7f038c0d3a20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f037c0097a0 tx=0x7f037c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98019c47c3726c47 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:45.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.152+0000 7f0388a00640 1 -- 172.21.15.144:0/3360363869 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c037070 con 0x7f038c15e640 2024-09-11T23:18:45.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.152+0000 7f0388a00640 1 -- 172.21.15.144:0/3360363869 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f037c032440 con 0x7f038c15e640 2024-09-11T23:18:45.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.152+0000 7f0388a00640 1 -- 172.21.15.144:0/3360363869 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c032810 con 0x7f038c15e640 2024-09-11T23:18:45.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.153+0000 7f038b200640 1 -- 172.21.15.144:0/3360363869 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f038c15e640 msgr2=0x7f038c0d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.153+0000 7f038b200640 1 --2- 172.21.15.144:0/3360363869 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f038c15e640 0x7f038c0d3a20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f037c0097a0 tx=0x7f037c02a230 comp rx=0 tx=0).stop 2024-09-11T23:18:45.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.153+0000 7f038b200640 1 -- 172.21.15.144:0/3360363869 shutdown_connections 2024-09-11T23:18:45.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.153+0000 7f038b200640 1 --2- 172.21.15.144:0/3360363869 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f038c15e640 0x7f038c0d3a20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.153+0000 7f038b200640 1 -- 172.21.15.144:0/3360363869 >> 172.21.15.144:0/3360363869 conn(0x7f038c0d0fd0 msgr2=0x7f038c0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:45.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.153+0000 7f038b200640 1 -- 172.21.15.144:0/3360363869 shutdown_connections 2024-09-11T23:18:45.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.153+0000 7f038b200640 1 -- 172.21.15.144:0/3360363869 wait complete. 2024-09-11T23:18:45.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.155+0000 7f038b200640 1 Processor -- start 2024-09-11T23:18:45.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.155+0000 7f038b200640 1 -- start start 2024-09-11T23:18:45.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.156+0000 7f038b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f038c0b66e0 0x7f038c1e7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.156+0000 7f038b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038c0d3f60 0x7f038c14d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.156+0000 7f038b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f038c15e640 0x7f038c0aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.156+0000 7f038b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f038c0b7e60 con 0x7f038c0d3f60 2024-09-11T23:18:45.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.156+0000 7f038b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f038c06caf0 con 0x7f038c0b66e0 2024-09-11T23:18:45.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.156+0000 7f038b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f038c0b7fe0 con 0x7f038c15e640 2024-09-11T23:18:45.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.156+0000 7f0389400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038c0d3f60 0x7f038c14d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.156+0000 7f0389e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f038c0b66e0 0x7f038c1e7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.156+0000 7f0389400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038c0d3f60 0x7f038c14d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49932/0 (socket says 172.21.15.144:49932) 2024-09-11T23:18:45.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.156+0000 7f0389400640 1 -- 172.21.15.144:0/3519846339 learned_addr learned my addr 172.21.15.144:0/3519846339 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:45.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.156+0000 7f038a800640 1 --2- 172.21.15.144:0/3519846339 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f038c15e640 0x7f038c0aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.156+0000 7f0389400640 1 -- 172.21.15.144:0/3519846339 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f038c15e640 msgr2=0x7f038c0aafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.156+0000 7f0389400640 1 --2- 172.21.15.144:0/3519846339 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f038c15e640 0x7f038c0aafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.156+0000 7f0389400640 1 -- 172.21.15.144:0/3519846339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f038c0b66e0 msgr2=0x7f038c1e7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.156+0000 7f0389400640 1 --2- 172.21.15.144:0/3519846339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f038c0b66e0 0x7f038c1e7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.156+0000 7f0389400640 1 -- 172.21.15.144:0/3519846339 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038c14a6b0 con 0x7f038c0d3f60 2024-09-11T23:18:45.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.157+0000 7f0389400640 1 --2- 172.21.15.144:0/3519846339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038c0d3f60 0x7f038c14d240 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f037800c500 tx=0x7f037800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:45.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.157+0000 7f0382000640 1 -- 172.21.15.144:0/3519846339 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0378017070 con 0x7f038c0d3f60 2024-09-11T23:18:45.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.157+0000 7f0382000640 1 -- 172.21.15.144:0/3519846339 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0378005ce0 con 0x7f038c0d3f60 2024-09-11T23:18:45.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.157+0000 7f0382000640 1 -- 172.21.15.144:0/3519846339 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03780072f0 con 0x7f038c0d3f60 2024-09-11T23:18:45.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.157+0000 7f038b200640 1 -- 172.21.15.144:0/3519846339 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f038c14a990 con 0x7f038c0d3f60 2024-09-11T23:18:45.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.157+0000 7f038b200640 1 -- 172.21.15.144:0/3519846339 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f038c14af50 con 0x7f038c0d3f60 2024-09-11T23:18:45.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.158+0000 7f038b200640 1 -- 172.21.15.144:0/3519846339 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f038c0d3a20 con 0x7f038c0d3f60 2024-09-11T23:18:45.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.159+0000 7f0382000640 1 -- 172.21.15.144:0/3519846339 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f037801a070 con 0x7f038c0d3f60 2024-09-11T23:18:45.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.160+0000 7f0382000640 1 --2- 172.21.15.144:0/3519846339 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f036c06be30 0x7f036c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.160+0000 7f0382000640 1 -- 172.21.15.144:0/3519846339 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f0378089ea0 con 0x7f038c0d3f60 2024-09-11T23:18:45.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.160+0000 7f0389e00640 1 --2- 172.21.15.144:0/3519846339 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f036c06be30 0x7f036c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.161+0000 7f0389e00640 1 --2- 172.21.15.144:0/3519846339 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f036c06be30 0x7f036c06e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f037c034000 tx=0x7f037c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:45.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.164+0000 7f0382000640 1 -- 172.21.15.144:0/3519846339 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0378058540 con 0x7f038c0d3f60 2024-09-11T23:18:45.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.407+0000 7f038b200640 1 -- 172.21.15.144:0/3519846339 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f038c0b6320 con 0x7f038c0d3f60 2024-09-11T23:18:45.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.411+0000 7f0382000640 1 -- 172.21.15.144:0/3519846339 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f037805c840 con 0x7f038c0d3f60 2024-09-11T23:18:45.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.413+0000 7f038b200640 1 -- 172.21.15.144:0/3519846339 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f036c06be30 msgr2=0x7f036c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.413+0000 7f038b200640 1 --2- 172.21.15.144:0/3519846339 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f036c06be30 0x7f036c06e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f037c034000 tx=0x7f037c02e000 comp rx=0 tx=0).stop 2024-09-11T23:18:45.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.413+0000 7f038b200640 1 -- 172.21.15.144:0/3519846339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038c0d3f60 msgr2=0x7f038c14d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.413+0000 7f038b200640 1 --2- 172.21.15.144:0/3519846339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038c0d3f60 0x7f038c14d240 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f037800c500 tx=0x7f037800c9c0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.413+0000 7f038b200640 1 -- 172.21.15.144:0/3519846339 shutdown_connections 2024-09-11T23:18:45.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.413+0000 7f038b200640 1 --2- 172.21.15.144:0/3519846339 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f036c06be30 0x7f036c06e2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.413+0000 7f038b200640 1 --2- 172.21.15.144:0/3519846339 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f038c15e640 0x7f038c0aafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.413+0000 7f038b200640 1 --2- 172.21.15.144:0/3519846339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038c0d3f60 0x7f038c14d240 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.413+0000 7f038b200640 1 --2- 172.21.15.144:0/3519846339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f038c0b66e0 0x7f038c1e7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.413+0000 7f038b200640 1 -- 172.21.15.144:0/3519846339 >> 172.21.15.144:0/3519846339 conn(0x7f038c0d0fd0 msgr2=0x7f038c1613c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.413+0000 7f038b200640 1 -- 172.21.15.144:0/3519846339 shutdown_connections 2024-09-11T23:18:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.413+0000 7f038b200640 1 -- 172.21.15.144:0/3519846339 wait complete. 2024-09-11T23:18:45.429 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:18:45.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.582+0000 7f69f2800640 1 Processor -- start 2024-09-11T23:18:45.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.582+0000 7f69f2800640 1 -- start start 2024-09-11T23:18:45.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.583+0000 7f69f2800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f69ec15c180 0x7f69ec0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.583+0000 7f69f2800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69ec073120 0x7f69ec073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.583+0000 7f69f2800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69ec0ce740 con 0x7f69ec0ce230 2024-09-11T23:18:45.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.583+0000 7f69f2800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f69ec072640 con 0x7f69ec15c180 2024-09-11T23:18:45.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.583+0000 7f69f2800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f69ec072920 con 0x7f69ec073120 2024-09-11T23:18:45.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.584+0000 7f69eb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f69ec15c180 0x7f69ec0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.584+0000 7f69eb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f69ec15c180 0x7f69ec0cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49940/0 (socket says 172.21.15.144:49940) 2024-09-11T23:18:45.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.584+0000 7f69eb400640 1 -- 172.21.15.144:0/1252744788 learned_addr learned my addr 172.21.15.144:0/1252744788 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:45.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.584+0000 7f69ebe00640 1 --2- 172.21.15.144:0/1252744788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69ec073120 0x7f69ec073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.584+0000 7f69eb400640 1 -- 172.21.15.144:0/1252744788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69ec073120 msgr2=0x7f69ec073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:45.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.584+0000 7f69eb400640 1 --2- 172.21.15.144:0/1252744788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69ec073120 0x7f69ec073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.584+0000 7f69eb400640 1 -- 172.21.15.144:0/1252744788 >> v1:172.21.15.165:6789/0 conn(0x7f69ec0ce230 legacy=0x7f69ec0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.584+0000 7f69eaa00640 1 -- 172.21.15.144:0/1252744788 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2364175127 0 0) 0x7f69ec0ce740 con 0x7f69ec0ce230 2024-09-11T23:18:45.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.584+0000 7f69eb400640 1 -- 172.21.15.144:0/1252744788 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ec072c00 con 0x7f69ec15c180 2024-09-11T23:18:45.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.584+0000 7f69ebe00640 1 --2- 172.21.15.144:0/1252744788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69ec073120 0x7f69ec073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:45.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.585+0000 7f69eb400640 1 --2- 172.21.15.144:0/1252744788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69ec15c180 0x7f69ec0cdcf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009870 tx=0x7f69dc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531f3c1582c7ba93 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:45.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.586+0000 7f69eaa00640 1 -- 172.21.15.144:0/1252744788 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc037070 con 0x7f69ec15c180 2024-09-11T23:18:45.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.586+0000 7f69eaa00640 1 -- 172.21.15.144:0/1252744788 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69dc032440 con 0x7f69ec15c180 2024-09-11T23:18:45.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.586+0000 7f69eaa00640 1 -- 172.21.15.144:0/1252744788 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc032810 con 0x7f69ec15c180 2024-09-11T23:18:45.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.586+0000 7f69f2800640 1 -- 172.21.15.144:0/1252744788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69ec15c180 msgr2=0x7f69ec0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.586+0000 7f69f2800640 1 --2- 172.21.15.144:0/1252744788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69ec15c180 0x7f69ec0cdcf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009870 tx=0x7f69dc02a1c0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.586+0000 7f69f2800640 1 -- 172.21.15.144:0/1252744788 shutdown_connections 2024-09-11T23:18:45.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.586+0000 7f69f2800640 1 --2- 172.21.15.144:0/1252744788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69ec073120 0x7f69ec073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.586+0000 7f69f2800640 1 --2- 172.21.15.144:0/1252744788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69ec15c180 0x7f69ec0cdcf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.586+0000 7f69f2800640 1 -- 172.21.15.144:0/1252744788 >> 172.21.15.144:0/1252744788 conn(0x7f69ec062cc0 msgr2=0x7f69ec06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:45.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.586+0000 7f69f2800640 1 -- 172.21.15.144:0/1252744788 shutdown_connections 2024-09-11T23:18:45.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.586+0000 7f69f2800640 1 -- 172.21.15.144:0/1252744788 wait complete. 2024-09-11T23:18:45.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.588+0000 7f69f2800640 1 Processor -- start 2024-09-11T23:18:45.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.588+0000 7f69f2800640 1 -- start start 2024-09-11T23:18:45.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.589+0000 7f69f2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69ec073120 0x7f69ec152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.589+0000 7f69f2800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69ec0ce230 0x7f69ec0ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.589+0000 7f69f2800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69ec15c180 0x7f69ec0af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.589+0000 7f69f2800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec0cf780 con 0x7f69ec073120 2024-09-11T23:18:45.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.589+0000 7f69f2800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec0722f0 con 0x7f69ec15c180 2024-09-11T23:18:45.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.589+0000 7f69f2800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f69ec15c560 con 0x7f69ec0ce230 2024-09-11T23:18:45.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.589+0000 7f69eb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69ec073120 0x7f69ec152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.589+0000 7f69eb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69ec073120 0x7f69ec152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49952/0 (socket says 172.21.15.144:49952) 2024-09-11T23:18:45.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.589+0000 7f69eb400640 1 -- 172.21.15.144:0/2499400048 learned_addr learned my addr 172.21.15.144:0/2499400048 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:45.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.589+0000 7f69e2a00640 1 --2- 172.21.15.144:0/2499400048 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69ec0ce230 0x7f69ec0ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.589+0000 7f69ebe00640 1 --2- 172.21.15.144:0/2499400048 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69ec15c180 0x7f69ec0af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.589+0000 7f69eb400640 1 -- 172.21.15.144:0/2499400048 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69ec0ce230 msgr2=0x7f69ec0ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.589+0000 7f69eb400640 1 --2- 172.21.15.144:0/2499400048 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69ec0ce230 0x7f69ec0ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.589+0000 7f69eb400640 1 -- 172.21.15.144:0/2499400048 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69ec15c180 msgr2=0x7f69ec0af460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.589+0000 7f69eb400640 1 --2- 172.21.15.144:0/2499400048 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69ec15c180 0x7f69ec0af460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.589+0000 7f69eb400640 1 -- 172.21.15.144:0/2499400048 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ec0acbe0 con 0x7f69ec073120 2024-09-11T23:18:45.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.590+0000 7f69eb400640 1 --2- 172.21.15.144:0/2499400048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69ec073120 0x7f69ec152cf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f69dc02a200 tx=0x7f69dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:45.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.590+0000 7f69e3e00640 1 -- 172.21.15.144:0/2499400048 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc037040 con 0x7f69ec073120 2024-09-11T23:18:45.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.590+0000 7f69e3e00640 1 -- 172.21.15.144:0/2499400048 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69dc042070 con 0x7f69ec073120 2024-09-11T23:18:45.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.590+0000 7f69e3e00640 1 -- 172.21.15.144:0/2499400048 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc0308a0 con 0x7f69ec073120 2024-09-11T23:18:45.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.590+0000 7f69f2800640 1 -- 172.21.15.144:0/2499400048 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69ec0ae3c0 con 0x7f69ec073120 2024-09-11T23:18:45.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.590+0000 7f69f2800640 1 -- 172.21.15.144:0/2499400048 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69ec0ae980 con 0x7f69ec073120 2024-09-11T23:18:45.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.591+0000 7f69f2800640 1 -- 172.21.15.144:0/2499400048 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69ec0cdcf0 con 0x7f69ec073120 2024-09-11T23:18:45.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.592+0000 7f69e3e00640 1 -- 172.21.15.144:0/2499400048 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f69dc02ad10 con 0x7f69ec073120 2024-09-11T23:18:45.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.593+0000 7f69e3e00640 1 --2- 172.21.15.144:0/2499400048 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f69c806be60 0x7f69c806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.593+0000 7f69e3e00640 1 -- 172.21.15.144:0/2499400048 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f69dc0aafa0 con 0x7f69ec073120 2024-09-11T23:18:45.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.593+0000 7f69e2a00640 1 --2- 172.21.15.144:0/2499400048 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f69c806be60 0x7f69c806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.594+0000 7f69e2a00640 1 --2- 172.21.15.144:0/2499400048 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f69c806be60 0x7f69c806e320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f69ec06f170 tx=0x7f69d4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:45.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.597+0000 7f69e3e00640 1 -- 172.21.15.144:0/2499400048 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f69dc079c10 con 0x7f69ec073120 2024-09-11T23:18:45.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.773+0000 7f69f2800640 1 -- 172.21.15.144:0/2499400048 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f69ec06d1d0 con 0x7f69ec073120 2024-09-11T23:18:45.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.774+0000 7f69e3e00640 1 -- 172.21.15.144:0/2499400048 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) ==== 84+0+65 (secure 0 0 0) 0x7f69dc079510 con 0x7f69ec073120 2024-09-11T23:18:45.774 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:45.774 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:18:45.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:18:45.774 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-11T23:18:45.774 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-11T23:18:45.774 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:18:45.774 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:18:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.776+0000 7f69f2800640 1 -- 172.21.15.144:0/2499400048 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f69c806be60 msgr2=0x7f69c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.776+0000 7f69f2800640 1 --2- 172.21.15.144:0/2499400048 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f69c806be60 0x7f69c806e320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f69ec06f170 tx=0x7f69d4009040 comp rx=0 tx=0).stop 2024-09-11T23:18:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.776+0000 7f69f2800640 1 -- 172.21.15.144:0/2499400048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69ec073120 msgr2=0x7f69ec152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.776+0000 7f69f2800640 1 --2- 172.21.15.144:0/2499400048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69ec073120 0x7f69ec152cf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f69dc02a200 tx=0x7f69dc0046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.776+0000 7f69f2800640 1 -- 172.21.15.144:0/2499400048 shutdown_connections 2024-09-11T23:18:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.776+0000 7f69f2800640 1 --2- 172.21.15.144:0/2499400048 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f69c806be60 0x7f69c806e320 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.776+0000 7f69f2800640 1 --2- 172.21.15.144:0/2499400048 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69ec15c180 0x7f69ec0af460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.776+0000 7f69f2800640 1 --2- 172.21.15.144:0/2499400048 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69ec0ce230 0x7f69ec0ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.776+0000 7f69f2800640 1 --2- 172.21.15.144:0/2499400048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69ec073120 0x7f69ec152cf0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.776+0000 7f69f2800640 1 -- 172.21.15.144:0/2499400048 >> 172.21.15.144:0/2499400048 conn(0x7f69ec062cc0 msgr2=0x7f69ec06c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:45.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.776+0000 7f69f2800640 1 -- 172.21.15.144:0/2499400048 shutdown_connections 2024-09-11T23:18:45.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.776+0000 7f69f2800640 1 -- 172.21.15.144:0/2499400048 wait complete. 2024-09-11T23:18:45.792 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:18:45.792 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:18:45.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.950+0000 7f8a8f400640 1 Processor -- start 2024-09-11T23:18:45.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.950+0000 7f8a8f400640 1 -- start start 2024-09-11T23:18:45.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.951+0000 7f8a8f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8a8806e500 0x7f8a88167310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.951+0000 7f8a8f400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a880b4240 con 0x7f8a880cf5d0 2024-09-11T23:18:45.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.951+0000 7f8a8f400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a880b4520 con 0x7f8a88145d90 2024-09-11T23:18:45.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.951+0000 7f8a8f400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8a8806d080 con 0x7f8a8806e500 2024-09-11T23:18:45.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.952+0000 7f8a8d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8a8806e500 0x7f8a88167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.952+0000 7f8a8d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8a8806e500 0x7f8a88167310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49958/0 (socket says 172.21.15.144:49958) 2024-09-11T23:18:45.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.952+0000 7f8a8d400640 1 -- 172.21.15.144:0/3854114860 learned_addr learned my addr 172.21.15.144:0/3854114860 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:45.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.952+0000 7f8a8d400640 1 -- 172.21.15.144:0/3854114860 >> v1:172.21.15.165:6789/0 conn(0x7f8a88145d90 legacy=0x7f8a880ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.952+0000 7f8a8d400640 1 -- 172.21.15.144:0/3854114860 >> v1:172.21.15.144:6789/0 conn(0x7f8a880cf5d0 legacy=0x7f8a880cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.952+0000 7f8a8d400640 1 -- 172.21.15.144:0/3854114860 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a880b4800 con 0x7f8a8806e500 2024-09-11T23:18:45.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.953+0000 7f8a8d400640 1 --2- 172.21.15.144:0/3854114860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a8806e500 0x7f8a88167310 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009e50 tx=0x7f8a8002a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d2d19b4834e673 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:45.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.953+0000 7f8a87400640 1 -- 172.21.15.144:0/3854114860 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80036070 con 0x7f8a8806e500 2024-09-11T23:18:45.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.953+0000 7f8a87400640 1 -- 172.21.15.144:0/3854114860 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a80031600 con 0x7f8a8806e500 2024-09-11T23:18:45.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.953+0000 7f8a87400640 1 -- 172.21.15.144:0/3854114860 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a800319f0 con 0x7f8a8806e500 2024-09-11T23:18:45.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.954+0000 7f8a8f400640 1 -- 172.21.15.144:0/3854114860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a8806e500 msgr2=0x7f8a88167310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.954+0000 7f8a8f400640 1 --2- 172.21.15.144:0/3854114860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a8806e500 0x7f8a88167310 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009e50 tx=0x7f8a8002a7c0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.954+0000 7f8a8f400640 1 -- 172.21.15.144:0/3854114860 shutdown_connections 2024-09-11T23:18:45.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.954+0000 7f8a8f400640 1 --2- 172.21.15.144:0/3854114860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a8806e500 0x7f8a88167310 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.954+0000 7f8a8f400640 1 -- 172.21.15.144:0/3854114860 >> 172.21.15.144:0/3854114860 conn(0x7f8a8806bba0 msgr2=0x7f8a8806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:45.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.954+0000 7f8a8f400640 1 -- 172.21.15.144:0/3854114860 shutdown_connections 2024-09-11T23:18:45.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.954+0000 7f8a8f400640 1 -- 172.21.15.144:0/3854114860 wait complete. 2024-09-11T23:18:45.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.956+0000 7f8a8f400640 1 Processor -- start 2024-09-11T23:18:45.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.956+0000 7f8a8f400640 1 -- start start 2024-09-11T23:18:45.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.956+0000 7f8a8f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a8806e500 0x7f8a881f3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.957+0000 7f8a8f400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a880cf5d0 0x7f8a881439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.957+0000 7f8a8f400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a88145d90 0x7f8a88160120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.957+0000 7f8a8f400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8a880b5610 con 0x7f8a8806e500 2024-09-11T23:18:45.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.957+0000 7f8a8f400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8a880cd660 con 0x7f8a88145d90 2024-09-11T23:18:45.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.957+0000 7f8a8f400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8a880b5790 con 0x7f8a880cf5d0 2024-09-11T23:18:45.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.957+0000 7f8a8ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a8806e500 0x7f8a881f3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.957+0000 7f8a8ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a8806e500 0x7f8a881f3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49972/0 (socket says 172.21.15.144:49972) 2024-09-11T23:18:45.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.957+0000 7f8a8ca00640 1 -- 172.21.15.144:0/548267263 learned_addr learned my addr 172.21.15.144:0/548267263 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:45.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.957+0000 7f8a87e00640 1 --2- 172.21.15.144:0/548267263 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a880cf5d0 0x7f8a881439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.957+0000 7f8a8d400640 1 --2- 172.21.15.144:0/548267263 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a88145d90 0x7f8a88160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.957+0000 7f8a8ca00640 1 -- 172.21.15.144:0/548267263 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a880cf5d0 msgr2=0x7f8a881439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.957+0000 7f8a8ca00640 1 --2- 172.21.15.144:0/548267263 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a880cf5d0 0x7f8a881439d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.957+0000 7f8a8ca00640 1 -- 172.21.15.144:0/548267263 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a88145d90 msgr2=0x7f8a88160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:45.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.957+0000 7f8a8ca00640 1 --2- 172.21.15.144:0/548267263 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a88145d90 0x7f8a88160120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:45.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.957+0000 7f8a8ca00640 1 -- 172.21.15.144:0/548267263 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a881e5ff0 con 0x7f8a8806e500 2024-09-11T23:18:45.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.958+0000 7f8a8ca00640 1 --2- 172.21.15.144:0/548267263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a8806e500 0x7f8a881f3ce0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00c3c0 tx=0x7f8a7c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:45.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.958+0000 7f8a84c00640 1 -- 172.21.15.144:0/548267263 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c0052d0 con 0x7f8a8806e500 2024-09-11T23:18:45.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.958+0000 7f8a84c00640 1 -- 172.21.15.144:0/548267263 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a7c005490 con 0x7f8a8806e500 2024-09-11T23:18:45.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.958+0000 7f8a84c00640 1 -- 172.21.15.144:0/548267263 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c007260 con 0x7f8a8806e500 2024-09-11T23:18:45.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.958+0000 7f8a8f400640 1 -- 172.21.15.144:0/548267263 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a881e62d0 con 0x7f8a8806e500 2024-09-11T23:18:45.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.958+0000 7f8a8f400640 1 -- 172.21.15.144:0/548267263 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a881e6890 con 0x7f8a8806e500 2024-09-11T23:18:45.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.959+0000 7f8a8f400640 1 -- 172.21.15.144:0/548267263 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a88146170 con 0x7f8a8806e500 2024-09-11T23:18:45.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.960+0000 7f8a84c00640 1 -- 172.21.15.144:0/548267263 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a7c007400 con 0x7f8a8806e500 2024-09-11T23:18:45.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.961+0000 7f8a84c00640 1 --2- 172.21.15.144:0/548267263 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a6806be30 0x7f8a6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:45.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.961+0000 7f8a84c00640 1 -- 172.21.15.144:0/548267263 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f8a7c089fb0 con 0x7f8a8806e500 2024-09-11T23:18:45.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.961+0000 7f8a87e00640 1 --2- 172.21.15.144:0/548267263 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a6806be30 0x7f8a6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:45.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.962+0000 7f8a87e00640 1 --2- 172.21.15.144:0/548267263 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a6806be30 0x7f8a6806e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8a880afbb0 tx=0x7f8a74009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:45.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:45.965+0000 7f8a84c00640 1 -- 172.21.15.144:0/548267263 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a7c0585c0 con 0x7f8a8806e500 2024-09-11T23:18:46.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:46.140+0000 7f8a8f400640 1 -- 172.21.15.144:0/548267263 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8a8815fa40 con 0x7f8a8806e500 2024-09-11T23:18:46.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:46.980+0000 7f8a84c00640 1 -- 172.21.15.144:0/548267263 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) ==== 138+0+0 (secure 0 0 0) 0x7f8a7c05c8c0 con 0x7f8a8806e500 2024-09-11T23:18:46.980 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-11T23:18:46.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:46.983+0000 7f8a8f400640 1 -- 172.21.15.144:0/548267263 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a6806be30 msgr2=0x7f8a6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:46.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:46.983+0000 7f8a8f400640 1 --2- 172.21.15.144:0/548267263 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a6806be30 0x7f8a6806e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8a880afbb0 tx=0x7f8a74009040 comp rx=0 tx=0).stop 2024-09-11T23:18:46.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:46.983+0000 7f8a8f400640 1 -- 172.21.15.144:0/548267263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a8806e500 msgr2=0x7f8a881f3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:46.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:46.983+0000 7f8a8f400640 1 --2- 172.21.15.144:0/548267263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a8806e500 0x7f8a881f3ce0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00c3c0 tx=0x7f8a7c00c880 comp rx=0 tx=0).stop 2024-09-11T23:18:46.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:46.983+0000 7f8a8f400640 1 -- 172.21.15.144:0/548267263 shutdown_connections 2024-09-11T23:18:46.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:46.983+0000 7f8a8f400640 1 --2- 172.21.15.144:0/548267263 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a6806be30 0x7f8a6806e2f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:46.983+0000 7f8a8f400640 1 --2- 172.21.15.144:0/548267263 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a88145d90 0x7f8a88160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:46.983+0000 7f8a8f400640 1 --2- 172.21.15.144:0/548267263 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a880cf5d0 0x7f8a881439d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:46.983+0000 7f8a8f400640 1 --2- 172.21.15.144:0/548267263 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a8806e500 0x7f8a881f3ce0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:46.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:46.983+0000 7f8a8f400640 1 -- 172.21.15.144:0/548267263 >> 172.21.15.144:0/548267263 conn(0x7f8a8806bba0 msgr2=0x7f8a880b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:46.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:46.984+0000 7f8a8f400640 1 -- 172.21.15.144:0/548267263 shutdown_connections 2024-09-11T23:18:46.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:46.984+0000 7f8a8f400640 1 -- 172.21.15.144:0/548267263 wait complete. 2024-09-11T23:18:47.005 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:18:47.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.188+0000 7f7910400640 1 Processor -- start 2024-09-11T23:18:47.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.188+0000 7f7910400640 1 -- start start 2024-09-11T23:18:47.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.189+0000 7f7910400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f79080cf5d0 0x7f79080cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:47.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.189+0000 7f7910400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f790806d4f0 0x7f790806d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:47.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.189+0000 7f7910400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79080b4240 con 0x7f7908145d90 2024-09-11T23:18:47.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.189+0000 7f7910400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f790806d080 con 0x7f790806d4f0 2024-09-11T23:18:47.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.189+0000 7f7910400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f79080b4520 con 0x7f79080cf5d0 2024-09-11T23:18:47.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.190+0000 7f790da00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7908145d90 0x7f79080ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50724/0 (socket says 172.21.15.144:50724) 2024-09-11T23:18:47.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.190+0000 7f790da00640 1 -- 172.21.15.144:0/3807288614 learned_addr learned my addr 172.21.15.144:0/3807288614 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:47.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.190+0000 7f790d000640 1 --2- 172.21.15.144:0/3807288614 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f79080cf5d0 0x7f79080cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:47.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.190+0000 7f790e400640 1 --2- 172.21.15.144:0/3807288614 >> v2:172.21.15.165:3300/0 conn(0x7f790806d4f0 0x7f790806d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:47.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.190+0000 7f7907e00640 1 -- 172.21.15.144:0/3807288614 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3414554369 0 0) 0x7f79080b4240 con 0x7f7908145d90 2024-09-11T23:18:47.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.190+0000 7f7907e00640 1 -- 172.21.15.144:0/3807288614 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78f0003520 con 0x7f7908145d90 2024-09-11T23:18:47.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.190+0000 7f7907e00640 1 -- 172.21.15.144:0/3807288614 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 893832758 0 0) 0x7f78f0003520 con 0x7f7908145d90 2024-09-11T23:18:47.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.190+0000 7f7907e00640 1 -- 172.21.15.144:0/3807288614 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f79080cf5d0 msgr2=0x7f79080cfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:47.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f7907e00640 1 --2- 172.21.15.144:0/3807288614 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f79080cf5d0 0x7f79080cfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f7907e00640 1 -- 172.21.15.144:0/3807288614 >> v2:172.21.15.165:3300/0 conn(0x7f790806d4f0 msgr2=0x7f790806d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:47.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f7907e00640 1 --2- 172.21.15.144:0/3807288614 >> v2:172.21.15.165:3300/0 conn(0x7f790806d4f0 0x7f790806d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f7907e00640 1 -- 172.21.15.144:0/3807288614 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79080b4800 con 0x7f7908145d90 2024-09-11T23:18:47.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f7907e00640 1 -- 172.21.15.144:0/3807288614 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f78fc001670 con 0x7f7908145d90 2024-09-11T23:18:47.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f7907e00640 1 -- 172.21.15.144:0/3807288614 >> v1:172.21.15.144:6789/0 conn(0x7f7908145d90 legacy=0x7f79080ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:47.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f7907e00640 1 --2- 172.21.15.144:0/3807288614 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78f00039b0 0x7f78f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:47.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f7907e00640 1 --2- 172.21.15.144:0/3807288614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78f0004800 0x7f78f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:47.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f7907e00640 1 --2- 172.21.15.144:0/3807288614 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78f00051c0 0x7f78f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:47.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f7907e00640 1 -- 172.21.15.144:0/3807288614 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f79080b4520 con 0x7f78f00039b0 2024-09-11T23:18:47.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f7907e00640 1 -- 172.21.15.144:0/3807288614 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f78f000bf00 con 0x7f78f0004800 2024-09-11T23:18:47.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f7907e00640 1 -- 172.21.15.144:0/3807288614 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f78f000c080 con 0x7f78f00051c0 2024-09-11T23:18:47.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f790d000640 1 --2- 172.21.15.144:0/3807288614 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f79080cf5d0 0x7f79080cfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:47.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f790e400640 1 --2- 172.21.15.144:0/3807288614 >> v2:172.21.15.165:3300/0 conn(0x7f790806d4f0 0x7f790806d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:47.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f790da00640 1 --2- 172.21.15.144:0/3807288614 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78f00039b0 0x7f78f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:47.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f790d000640 1 --2- 172.21.15.144:0/3807288614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78f0004800 0x7f78f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:47.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f790e400640 1 --2- 172.21.15.144:0/3807288614 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78f00051c0 0x7f78f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:47.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f790da00640 1 -- 172.21.15.144:0/3807288614 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78f00051c0 msgr2=0x7f78f000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:47.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f790da00640 1 --2- 172.21.15.144:0/3807288614 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78f00051c0 0x7f78f000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f790da00640 1 -- 172.21.15.144:0/3807288614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78f0004800 msgr2=0x7f78f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:47.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f790da00640 1 --2- 172.21.15.144:0/3807288614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78f0004800 0x7f78f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.191+0000 7f790da00640 1 -- 172.21.15.144:0/3807288614 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f0003520 con 0x7f78f00039b0 2024-09-11T23:18:47.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.192+0000 7f790da00640 1 --2- 172.21.15.144:0/3807288614 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78f00039b0 0x7f78f0003dd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00c290 tx=0x7f78f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903ed31a5831f4aa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:47.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.193+0000 7f7907e00640 1 -- 172.21.15.144:0/3807288614 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc007d50 con 0x7f78f00039b0 2024-09-11T23:18:47.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.193+0000 7f7907e00640 1 -- 172.21.15.144:0/3807288614 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78fc02e070 con 0x7f78f00039b0 2024-09-11T23:18:47.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.193+0000 7f7907e00640 1 -- 172.21.15.144:0/3807288614 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc005d30 con 0x7f78f00039b0 2024-09-11T23:18:47.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.193+0000 7f7910400640 1 -- 172.21.15.144:0/3807288614 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78f00039b0 msgr2=0x7f78f0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:47.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.193+0000 7f7910400640 1 --2- 172.21.15.144:0/3807288614 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78f00039b0 0x7f78f0003dd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00c290 tx=0x7f78f0005830 comp rx=0 tx=0).stop 2024-09-11T23:18:47.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.193+0000 7f790e400640 1 -- 172.21.15.144:0/3807288614 reap_dead start 2024-09-11T23:18:47.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.193+0000 7f7910400640 1 -- 172.21.15.144:0/3807288614 shutdown_connections 2024-09-11T23:18:47.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.193+0000 7f7910400640 1 -- 172.21.15.144:0/3807288614 >> 172.21.15.144:0/3807288614 conn(0x7f790806bba0 msgr2=0x7f790806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:47.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.193+0000 7f7910400640 1 -- 172.21.15.144:0/3807288614 shutdown_connections 2024-09-11T23:18:47.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.193+0000 7f7910400640 1 -- 172.21.15.144:0/3807288614 wait complete. 2024-09-11T23:18:47.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.195+0000 7f7910400640 1 Processor -- start 2024-09-11T23:18:47.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.195+0000 7f7910400640 1 -- start start 2024-09-11T23:18:47.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.196+0000 7f7910400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78f00039b0 0x7f79081f49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:47.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.196+0000 7f7910400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f790813bdf0 0x7f79080aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:47.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.196+0000 7f7910400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f790806dcf0 0x7f790806e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:47.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.196+0000 7f7910400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f79080b5610 con 0x7f790806dcf0 2024-09-11T23:18:47.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.196+0000 7f7910400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f79080cd660 con 0x7f78f00039b0 2024-09-11T23:18:47.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.196+0000 7f7910400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f79080b5790 con 0x7f790813bdf0 2024-09-11T23:18:47.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.196+0000 7f790e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f790806dcf0 0x7f790806e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:47.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.196+0000 7f790e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f790806dcf0 0x7f790806e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49986/0 (socket says 172.21.15.144:49986) 2024-09-11T23:18:47.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.196+0000 7f790e400640 1 -- 172.21.15.144:0/3396705467 learned_addr learned my addr 172.21.15.144:0/3396705467 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:47.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.196+0000 7f790da00640 1 --2- 172.21.15.144:0/3396705467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78f00039b0 0x7f79081f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:47.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.196+0000 7f790d000640 1 --2- 172.21.15.144:0/3396705467 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f790813bdf0 0x7f79080aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:47.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.197+0000 7f790e400640 1 -- 172.21.15.144:0/3396705467 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f790813bdf0 msgr2=0x7f79080aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:47.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.197+0000 7f790e400640 1 --2- 172.21.15.144:0/3396705467 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f790813bdf0 0x7f79080aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.197+0000 7f790e400640 1 -- 172.21.15.144:0/3396705467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78f00039b0 msgr2=0x7f79081f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:47.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.197+0000 7f790e400640 1 --2- 172.21.15.144:0/3396705467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78f00039b0 0x7f79081f49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.197+0000 7f790e400640 1 -- 172.21.15.144:0/3396705467 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790813c270 con 0x7f790806dcf0 2024-09-11T23:18:47.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.197+0000 7f790e400640 1 --2- 172.21.15.144:0/3396705467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f790806dcf0 0x7f790806e170 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f790806f400 tx=0x7f79000115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:47.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.197+0000 7f7905600640 1 -- 172.21.15.144:0/3396705467 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900011e10 con 0x7f790806dcf0 2024-09-11T23:18:47.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.197+0000 7f7905600640 1 -- 172.21.15.144:0/3396705467 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f790001b070 con 0x7f790806dcf0 2024-09-11T23:18:47.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.197+0000 7f7910400640 1 -- 172.21.15.144:0/3396705467 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79080af2e0 con 0x7f790806dcf0 2024-09-11T23:18:47.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.197+0000 7f7905600640 1 -- 172.21.15.144:0/3396705467 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900003990 con 0x7f790806dcf0 2024-09-11T23:18:47.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.197+0000 7f7910400640 1 -- 172.21.15.144:0/3396705467 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79081f7850 con 0x7f790806dcf0 2024-09-11T23:18:47.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.198+0000 7f7910400640 1 -- 172.21.15.144:0/3396705467 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7908146170 con 0x7f790806dcf0 2024-09-11T23:18:47.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.200+0000 7f7905600640 1 -- 172.21.15.144:0/3396705467 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7900005d10 con 0x7f790806dcf0 2024-09-11T23:18:47.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.200+0000 7f7905600640 1 --2- 172.21.15.144:0/3396705467 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f78e806be60 0x7f78e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:47.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.201+0000 7f7905600640 1 -- 172.21.15.144:0/3396705467 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5227+0+0 (secure 0 0 0) 0x7f790008aff0 con 0x7f790806dcf0 2024-09-11T23:18:47.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.201+0000 7f790da00640 1 --2- 172.21.15.144:0/3396705467 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f78e806be60 0x7f78e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:47.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.201+0000 7f790da00640 1 --2- 172.21.15.144:0/3396705467 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f78e806be60 0x7f78e806e320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f78fc033000 tx=0x7f78fc009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:47.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.205+0000 7f7905600640 1 -- 172.21.15.144:0/3396705467 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f79080af2e0 con 0x7f790806dcf0 2024-09-11T23:18:47.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.380+0000 7f7910400640 1 -- 172.21.15.144:0/3396705467 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f790806c330 con 0x7f790806dcf0 2024-09-11T23:18:47.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.986+0000 7f7905600640 1 -- 172.21.15.144:0/3396705467 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) ==== 170+0+0 (secure 0 0 0) 0x7f790813c270 con 0x7f790806dcf0 2024-09-11T23:18:47.986 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-11T23:18:47.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.989+0000 7f7910400640 1 -- 172.21.15.144:0/3396705467 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f78e806be60 msgr2=0x7f78e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:47.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.989+0000 7f7910400640 1 --2- 172.21.15.144:0/3396705467 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f78e806be60 0x7f78e806e320 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f78fc033000 tx=0x7f78fc009030 comp rx=0 tx=0).stop 2024-09-11T23:18:47.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.989+0000 7f7910400640 1 -- 172.21.15.144:0/3396705467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f790806dcf0 msgr2=0x7f790806e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:47.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.989+0000 7f7910400640 1 --2- 172.21.15.144:0/3396705467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f790806dcf0 0x7f790806e170 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f790806f400 tx=0x7f79000115a0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.990+0000 7f7910400640 1 -- 172.21.15.144:0/3396705467 shutdown_connections 2024-09-11T23:18:47.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.990+0000 7f7910400640 1 --2- 172.21.15.144:0/3396705467 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f78e806be60 0x7f78e806e320 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.990+0000 7f7910400640 1 --2- 172.21.15.144:0/3396705467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f790806dcf0 0x7f790806e170 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.990+0000 7f7910400640 1 --2- 172.21.15.144:0/3396705467 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f790813bdf0 0x7f79080aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.990+0000 7f7910400640 1 --2- 172.21.15.144:0/3396705467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78f00039b0 0x7f79081f49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:47.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.990+0000 7f7910400640 1 -- 172.21.15.144:0/3396705467 >> 172.21.15.144:0/3396705467 conn(0x7f790806bba0 msgr2=0x7f79080b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:47.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.990+0000 7f7910400640 1 -- 172.21.15.144:0/3396705467 shutdown_connections 2024-09-11T23:18:47.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:47.990+0000 7f7910400640 1 -- 172.21.15.144:0/3396705467 wait complete. 2024-09-11T23:18:48.022 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:18:48.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.181+0000 7fb0c1600640 1 Processor -- start 2024-09-11T23:18:48.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.181+0000 7fb0c1600640 1 -- start start 2024-09-11T23:18:48.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.182+0000 7fb0c1600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb0bc15ed50 0x7fb0bc143d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.182+0000 7fb0c1600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0bc071080 0x7fb0bc0714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.182+0000 7fb0c1600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0bc1443d0 con 0x7fb0bc0b3ac0 2024-09-11T23:18:48.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.182+0000 7fb0c1600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb0bc1446b0 con 0x7fb0bc15ed50 2024-09-11T23:18:48.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.182+0000 7fb0c1600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb0bc144990 con 0x7fb0bc071080 2024-09-11T23:18:48.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.182+0000 7fb0baa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb0bc15ed50 0x7fb0bc143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.182+0000 7fb0baa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb0bc15ed50 0x7fb0bc143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49990/0 (socket says 172.21.15.144:49990) 2024-09-11T23:18:48.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.183+0000 7fb0baa00640 1 -- 172.21.15.144:0/4187998895 learned_addr learned my addr 172.21.15.144:0/4187998895 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:48.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.183+0000 7fb0ba000640 1 --2- 172.21.15.144:0/4187998895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0bc071080 0x7fb0bc0714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.183+0000 7fb0baa00640 1 -- 172.21.15.144:0/4187998895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0bc071080 msgr2=0x7fb0bc0714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:48.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.183+0000 7fb0baa00640 1 --2- 172.21.15.144:0/4187998895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0bc071080 0x7fb0bc0714d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.183+0000 7fb0baa00640 1 -- 172.21.15.144:0/4187998895 >> v1:172.21.15.165:6789/0 conn(0x7fb0bc0b3ac0 legacy=0x7fb0bc0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:48.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.183+0000 7fb0baa00640 1 -- 172.21.15.144:0/4187998895 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0bc0b35c0 con 0x7fb0bc15ed50 2024-09-11T23:18:48.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.183+0000 7fb0ba000640 1 --2- 172.21.15.144:0/4187998895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0bc071080 0x7fb0bc0714d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:48.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.184+0000 7fb0baa00640 1 --2- 172.21.15.144:0/4187998895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0bc15ed50 0x7fb0bc143d40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac009870 tx=0x7fb0ac02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6e916e6264f69a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:48.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.184+0000 7fb0b9600640 1 -- 172.21.15.144:0/4187998895 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac037070 con 0x7fb0bc15ed50 2024-09-11T23:18:48.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.184+0000 7fb0b9600640 1 -- 172.21.15.144:0/4187998895 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0ac032440 con 0x7fb0bc15ed50 2024-09-11T23:18:48.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.184+0000 7fb0b9600640 1 -- 172.21.15.144:0/4187998895 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac032810 con 0x7fb0bc15ed50 2024-09-11T23:18:48.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.185+0000 7fb0c1600640 1 -- 172.21.15.144:0/4187998895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0bc15ed50 msgr2=0x7fb0bc143d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:48.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.185+0000 7fb0c1600640 1 --2- 172.21.15.144:0/4187998895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0bc15ed50 0x7fb0bc143d40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac009870 tx=0x7fb0ac02a180 comp rx=0 tx=0).stop 2024-09-11T23:18:48.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.185+0000 7fb0c1600640 1 -- 172.21.15.144:0/4187998895 shutdown_connections 2024-09-11T23:18:48.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.185+0000 7fb0c1600640 1 --2- 172.21.15.144:0/4187998895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0bc071080 0x7fb0bc0714d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.185+0000 7fb0c1600640 1 --2- 172.21.15.144:0/4187998895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0bc15ed50 0x7fb0bc143d40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.185+0000 7fb0c1600640 1 -- 172.21.15.144:0/4187998895 >> 172.21.15.144:0/4187998895 conn(0x7fb0bc06bba0 msgr2=0x7fb0bc06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:48.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.185+0000 7fb0c1600640 1 -- 172.21.15.144:0/4187998895 shutdown_connections 2024-09-11T23:18:48.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.185+0000 7fb0c1600640 1 -- 172.21.15.144:0/4187998895 wait complete. 2024-09-11T23:18:48.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.186+0000 7fb0c1600640 1 Processor -- start 2024-09-11T23:18:48.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.187+0000 7fb0c1600640 1 -- start start 2024-09-11T23:18:48.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.187+0000 7fb0c1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0bc071080 0x7fb0bc13ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.187+0000 7fb0c1600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0bc0b3ac0 0x7fb0bc1566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.187+0000 7fb0c1600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0bc15ed50 0x7fb0bc157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.187+0000 7fb0c1600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb0bc0b3f20 con 0x7fb0bc071080 2024-09-11T23:18:48.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.187+0000 7fb0c1600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb0bc0af240 con 0x7fb0bc0b3ac0 2024-09-11T23:18:48.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.187+0000 7fb0c1600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb0bc0b40a0 con 0x7fb0bc15ed50 2024-09-11T23:18:48.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.188+0000 7fb0baa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0bc071080 0x7fb0bc13ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.188+0000 7fb0baa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0bc071080 0x7fb0bc13ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49996/0 (socket says 172.21.15.144:49996) 2024-09-11T23:18:48.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.188+0000 7fb0baa00640 1 -- 172.21.15.144:0/829995652 learned_addr learned my addr 172.21.15.144:0/829995652 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:48.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.188+0000 7fb0ba000640 1 --2- 172.21.15.144:0/829995652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0bc0b3ac0 0x7fb0bc1566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.188+0000 7fb0bb400640 1 --2- 172.21.15.144:0/829995652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0bc15ed50 0x7fb0bc157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.188+0000 7fb0baa00640 1 -- 172.21.15.144:0/829995652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0bc15ed50 msgr2=0x7fb0bc157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:48.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.188+0000 7fb0baa00640 1 --2- 172.21.15.144:0/829995652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0bc15ed50 0x7fb0bc157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.188+0000 7fb0baa00640 1 -- 172.21.15.144:0/829995652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0bc0b3ac0 msgr2=0x7fb0bc1566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:48.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.188+0000 7fb0baa00640 1 --2- 172.21.15.144:0/829995652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0bc0b3ac0 0x7fb0bc1566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.188+0000 7fb0baa00640 1 -- 172.21.15.144:0/829995652 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0bc1578c0 con 0x7fb0bc071080 2024-09-11T23:18:48.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.188+0000 7fb0bb400640 1 --2- 172.21.15.144:0/829995652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0bc15ed50 0x7fb0bc157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:48.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.188+0000 7fb0baa00640 1 --2- 172.21.15.144:0/829995652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0bc071080 0x7fb0bc13ff60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac009870 tx=0x7fb0ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:48.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.189+0000 7fb0b2a00640 1 -- 172.21.15.144:0/829995652 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac037040 con 0x7fb0bc071080 2024-09-11T23:18:48.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.189+0000 7fb0b2a00640 1 -- 172.21.15.144:0/829995652 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0ac042070 con 0x7fb0bc071080 2024-09-11T23:18:48.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.189+0000 7fb0b2a00640 1 -- 172.21.15.144:0/829995652 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac030bb0 con 0x7fb0bc071080 2024-09-11T23:18:48.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.189+0000 7fb0c1600640 1 -- 172.21.15.144:0/829995652 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0bc157ba0 con 0x7fb0bc071080 2024-09-11T23:18:48.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.189+0000 7fb0c1600640 1 -- 172.21.15.144:0/829995652 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0bc158160 con 0x7fb0bc071080 2024-09-11T23:18:48.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.190+0000 7fb0c1600640 1 -- 172.21.15.144:0/829995652 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0bc0714d0 con 0x7fb0bc071080 2024-09-11T23:18:48.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.191+0000 7fb0b2a00640 1 -- 172.21.15.144:0/829995652 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb0ac047460 con 0x7fb0bc071080 2024-09-11T23:18:48.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.192+0000 7fb0b2a00640 1 --2- 172.21.15.144:0/829995652 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb09c06be30 0x7fb09c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:48.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.192+0000 7fb0b2a00640 1 -- 172.21.15.144:0/829995652 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5609+0+0 (secure 0 0 0) 0x7fb0ac0ab9e0 con 0x7fb0bc071080 2024-09-11T23:18:48.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.192+0000 7fb0ba000640 1 --2- 172.21.15.144:0/829995652 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb09c06be30 0x7fb09c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:48.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.193+0000 7fb0ba000640 1 --2- 172.21.15.144:0/829995652 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb09c06be30 0x7fb09c06e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8006fd0 tx=0x7fb0a8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:48.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.197+0000 7fb0b2a00640 1 -- 172.21.15.144:0/829995652 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb0ac07a3e0 con 0x7fb0bc071080 2024-09-11T23:18:48.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.403+0000 7fb0c1600640 1 -- 172.21.15.144:0/829995652 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb0bc0725a0 con 0x7fb0bc071080 2024-09-11T23:18:48.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.988+0000 7fb0b2a00640 1 -- 172.21.15.144:0/829995652 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7fb0ac079ce0 con 0x7fb0bc071080 2024-09-11T23:18:48.989 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 4 and data pool 5 2024-09-11T23:18:48.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.992+0000 7fb0c1600640 1 -- 172.21.15.144:0/829995652 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb09c06be30 msgr2=0x7fb09c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:48.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.992+0000 7fb0c1600640 1 --2- 172.21.15.144:0/829995652 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb09c06be30 0x7fb09c06e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8006fd0 tx=0x7fb0a8008040 comp rx=0 tx=0).stop 2024-09-11T23:18:48.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.992+0000 7fb0c1600640 1 -- 172.21.15.144:0/829995652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0bc071080 msgr2=0x7fb0bc13ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:48.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.992+0000 7fb0c1600640 1 --2- 172.21.15.144:0/829995652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0bc071080 0x7fb0bc13ff60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac009870 tx=0x7fb0ac0046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.997+0000 7fb0c1600640 1 -- 172.21.15.144:0/829995652 shutdown_connections 2024-09-11T23:18:48.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.997+0000 7fb0c1600640 1 --2- 172.21.15.144:0/829995652 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb09c06be30 0x7fb09c06e2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.997+0000 7fb0c1600640 1 --2- 172.21.15.144:0/829995652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb0bc15ed50 0x7fb0bc157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.997+0000 7fb0c1600640 1 --2- 172.21.15.144:0/829995652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb0bc0b3ac0 0x7fb0bc1566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.997+0000 7fb0c1600640 1 --2- 172.21.15.144:0/829995652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb0bc071080 0x7fb0bc13ff60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:48.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.997+0000 7fb0c1600640 1 -- 172.21.15.144:0/829995652 >> 172.21.15.144:0/829995652 conn(0x7fb0bc06bba0 msgr2=0x7fb0bc0cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:48.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:48.998+0000 7fb0c1600640 1 -- 172.21.15.144:0/829995652 shutdown_connections 2024-09-11T23:18:49.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.003+0000 7fb0c1600640 1 -- 172.21.15.144:0/829995652 wait complete. 2024-09-11T23:18:49.042 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:18:49.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.196+0000 7f9a5fe00640 1 Processor -- start 2024-09-11T23:18:49.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.196+0000 7f9a5fe00640 1 -- start start 2024-09-11T23:18:49.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.198+0000 7f9a5fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9a580cf070 0x7f9a580cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:49.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.198+0000 7f9a5fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9a58073120 0x7f9a580735b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:49.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.198+0000 7f9a5fe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a580ce740 con 0x7f9a5815c180 2024-09-11T23:18:49.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.198+0000 7f9a5fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9a58072640 con 0x7f9a580cf070 2024-09-11T23:18:49.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.198+0000 7f9a5fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9a58072920 con 0x7f9a58073120 2024-09-11T23:18:49.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.198+0000 7f9a5ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9a580cf070 0x7f9a580cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:49.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.198+0000 7f9a5ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9a580cf070 0x7f9a580cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50012/0 (socket says 172.21.15.144:50012) 2024-09-11T23:18:49.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.198+0000 7f9a5ca00640 1 -- 172.21.15.144:0/201142890 learned_addr learned my addr 172.21.15.144:0/201142890 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:49.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.198+0000 7f9a5ca00640 1 -- 172.21.15.144:0/201142890 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9a58073120 msgr2=0x7f9a580735b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:49.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.198+0000 7f9a5ca00640 1 --2- 172.21.15.144:0/201142890 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9a58073120 0x7f9a580735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.198+0000 7f9a5ca00640 1 -- 172.21.15.144:0/201142890 >> v1:172.21.15.165:6789/0 conn(0x7f9a5815c180 legacy=0x7f9a580cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:49.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.198+0000 7f9a5ca00640 1 -- 172.21.15.144:0/201142890 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a58072c00 con 0x7f9a580cf070 2024-09-11T23:18:49.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.199+0000 7f9a5ca00640 1 --2- 172.21.15.144:0/201142890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a580cf070 0x7f9a580cf4e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9a5806f430 tx=0x7f9a4402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=616e08f4f865605b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:49.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.200+0000 7f9a57e00640 1 -- 172.21.15.144:0/201142890 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a44037070 con 0x7f9a580cf070 2024-09-11T23:18:49.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.200+0000 7f9a57e00640 1 -- 172.21.15.144:0/201142890 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a4402ae50 con 0x7f9a580cf070 2024-09-11T23:18:49.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.200+0000 7f9a57e00640 1 -- 172.21.15.144:0/201142890 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a44032660 con 0x7f9a580cf070 2024-09-11T23:18:49.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.200+0000 7f9a5fe00640 1 -- 172.21.15.144:0/201142890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a580cf070 msgr2=0x7f9a580cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:49.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.200+0000 7f9a5fe00640 1 --2- 172.21.15.144:0/201142890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a580cf070 0x7f9a580cf4e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9a5806f430 tx=0x7f9a4402a140 comp rx=0 tx=0).stop 2024-09-11T23:18:49.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.200+0000 7f9a5fe00640 1 -- 172.21.15.144:0/201142890 shutdown_connections 2024-09-11T23:18:49.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.200+0000 7f9a5fe00640 1 --2- 172.21.15.144:0/201142890 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9a58073120 0x7f9a580735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.200+0000 7f9a5fe00640 1 --2- 172.21.15.144:0/201142890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a580cf070 0x7f9a580cf4e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.200+0000 7f9a5fe00640 1 -- 172.21.15.144:0/201142890 >> 172.21.15.144:0/201142890 conn(0x7f9a58062cc0 msgr2=0x7f9a5806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:49.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.200+0000 7f9a5fe00640 1 -- 172.21.15.144:0/201142890 shutdown_connections 2024-09-11T23:18:49.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.200+0000 7f9a5fe00640 1 -- 172.21.15.144:0/201142890 wait complete. 2024-09-11T23:18:49.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.202+0000 7f9a5fe00640 1 Processor -- start 2024-09-11T23:18:49.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.202+0000 7f9a5fe00640 1 -- start start 2024-09-11T23:18:49.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.203+0000 7f9a5fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a58073120 0x7f9a5814e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:49.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.203+0000 7f9a5fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9a580cf070 0x7f9a580b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:49.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.203+0000 7f9a5fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a5815c180 0x7f9a580ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:49.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.203+0000 7f9a5fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9a580722f0 con 0x7f9a5815c180 2024-09-11T23:18:49.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.203+0000 7f9a5fe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9a580ced00 con 0x7f9a58073120 2024-09-11T23:18:49.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.203+0000 7f9a5fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9a5815c560 con 0x7f9a580cf070 2024-09-11T23:18:49.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.203+0000 7f9a5de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a5815c180 0x7f9a580ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:49.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.203+0000 7f9a5de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a5815c180 0x7f9a580ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50014/0 (socket says 172.21.15.144:50014) 2024-09-11T23:18:49.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.203+0000 7f9a5de00640 1 -- 172.21.15.144:0/3590717639 learned_addr learned my addr 172.21.15.144:0/3590717639 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:49.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.203+0000 7f9a5ca00640 1 --2- 172.21.15.144:0/3590717639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9a580cf070 0x7f9a580b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:49.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.203+0000 7f9a5d400640 1 --2- 172.21.15.144:0/3590717639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a58073120 0x7f9a5814e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:49.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.204+0000 7f9a5de00640 1 -- 172.21.15.144:0/3590717639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9a580cf070 msgr2=0x7f9a580b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:49.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.204+0000 7f9a5de00640 1 --2- 172.21.15.144:0/3590717639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9a580cf070 0x7f9a580b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.204+0000 7f9a5de00640 1 -- 172.21.15.144:0/3590717639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a58073120 msgr2=0x7f9a5814e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:49.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.204+0000 7f9a5de00640 1 --2- 172.21.15.144:0/3590717639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a58073120 0x7f9a5814e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.204+0000 7f9a5de00640 1 -- 172.21.15.144:0/3590717639 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a580b3dc0 con 0x7f9a5815c180 2024-09-11T23:18:49.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.204+0000 7f9a5de00640 1 --2- 172.21.15.144:0/3590717639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a5815c180 0x7f9a580ae8e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000b970 tx=0x7f9a5000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:49.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.204+0000 7f9a55600640 1 -- 172.21.15.144:0/3590717639 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50019070 con 0x7f9a5815c180 2024-09-11T23:18:49.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.204+0000 7f9a55600640 1 -- 172.21.15.144:0/3590717639 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5000cb00 con 0x7f9a5815c180 2024-09-11T23:18:49.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.204+0000 7f9a55600640 1 -- 172.21.15.144:0/3590717639 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50014440 con 0x7f9a5815c180 2024-09-11T23:18:49.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.204+0000 7f9a5fe00640 1 -- 172.21.15.144:0/3590717639 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a580b4080 con 0x7f9a5815c180 2024-09-11T23:18:49.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.204+0000 7f9a5fe00640 1 -- 172.21.15.144:0/3590717639 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a581554f0 con 0x7f9a5815c180 2024-09-11T23:18:49.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.206+0000 7f9a5fe00640 1 -- 172.21.15.144:0/3590717639 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a580cf4e0 con 0x7f9a5815c180 2024-09-11T23:18:49.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.206+0000 7f9a55600640 1 -- 172.21.15.144:0/3590717639 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a5001c070 con 0x7f9a5815c180 2024-09-11T23:18:49.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.208+0000 7f9a55600640 1 --2- 172.21.15.144:0/3590717639 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9a3806be30 0x7f9a3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:49.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.208+0000 7f9a55600640 1 -- 172.21.15.144:0/3590717639 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f9a5008aac0 con 0x7f9a5815c180 2024-09-11T23:18:49.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.208+0000 7f9a5d400640 1 --2- 172.21.15.144:0/3590717639 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9a3806be30 0x7f9a3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:49.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.209+0000 7f9a5d400640 1 --2- 172.21.15.144:0/3590717639 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9a3806be30 0x7f9a3806e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c004f60 tx=0x7f9a4c007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:49.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.213+0000 7f9a55600640 1 -- 172.21.15.144:0/3590717639 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a50058e20 con 0x7f9a5815c180 2024-09-11T23:18:49.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.389+0000 7f9a5fe00640 1 -- 172.21.15.144:0/3590717639 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a580cc8d0 con 0x7f9a5815c180 2024-09-11T23:18:49.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.390+0000 7f9a55600640 1 -- 172.21.15.144:0/3590717639 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16766 (secure 0 0 0) 0x7f9a5005d120 con 0x7f9a5815c180 2024-09-11T23:18:49.390 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:49.390 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":33,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:18:48.404718+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:18:46.180295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-11T23:18:47.420116+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:49.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.392+0000 7f9a5fe00640 1 -- 172.21.15.144:0/3590717639 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9a3806be30 msgr2=0x7f9a3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:49.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.392+0000 7f9a5fe00640 1 --2- 172.21.15.144:0/3590717639 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9a3806be30 0x7f9a3806e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c004f60 tx=0x7f9a4c007e30 comp rx=0 tx=0).stop 2024-09-11T23:18:49.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.392+0000 7f9a5fe00640 1 -- 172.21.15.144:0/3590717639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a5815c180 msgr2=0x7f9a580ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:49.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.392+0000 7f9a5fe00640 1 --2- 172.21.15.144:0/3590717639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a5815c180 0x7f9a580ae8e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9a5000b970 tx=0x7f9a5000be30 comp rx=0 tx=0).stop 2024-09-11T23:18:49.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.392+0000 7f9a5fe00640 1 -- 172.21.15.144:0/3590717639 shutdown_connections 2024-09-11T23:18:49.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.392+0000 7f9a5fe00640 1 --2- 172.21.15.144:0/3590717639 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9a3806be30 0x7f9a3806e2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.392+0000 7f9a5fe00640 1 --2- 172.21.15.144:0/3590717639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a5815c180 0x7f9a580ae8e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.392+0000 7f9a5fe00640 1 --2- 172.21.15.144:0/3590717639 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9a580cf070 0x7f9a580b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.392+0000 7f9a5fe00640 1 --2- 172.21.15.144:0/3590717639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a58073120 0x7f9a5814e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.392+0000 7f9a5fe00640 1 -- 172.21.15.144:0/3590717639 >> 172.21.15.144:0/3590717639 conn(0x7f9a58062cc0 msgr2=0x7f9a580cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:49.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.392+0000 7f9a5fe00640 1 -- 172.21.15.144:0/3590717639 shutdown_connections 2024-09-11T23:18:49.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.392+0000 7f9a5fe00640 1 -- 172.21.15.144:0/3590717639 wait complete. 2024-09-11T23:18:49.409 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:18:49.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.563+0000 7f8bd9800640 1 Processor -- start 2024-09-11T23:18:49.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.563+0000 7f8bd9800640 1 -- start start 2024-09-11T23:18:49.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.564+0000 7f8bd9800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd40d02a0 0x7f8bd40d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:49.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.564+0000 7f8bd9800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8bd415ca40 0x7f8bd415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:49.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.564+0000 7f8bd9800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8bd415ce80 0x7f8bd41594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:49.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.564+0000 7f8bd9800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8bd40d0bc0 con 0x7f8bd415ca40 2024-09-11T23:18:49.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.564+0000 7f8bd9800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8bd415d390 con 0x7f8bd415ce80 2024-09-11T23:18:49.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.564+0000 7f8bd9800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd415d670 con 0x7f8bd40d02a0 2024-09-11T23:18:49.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.565+0000 7f8bca000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8bd415ca40 0x7f8bd415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:49.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.565+0000 7f8bca000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8bd415ca40 0x7f8bd415e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50018/0 (socket says 172.21.15.144:50018) 2024-09-11T23:18:49.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.565+0000 7f8bca000640 1 -- 172.21.15.144:0/946338551 learned_addr learned my addr 172.21.15.144:0/946338551 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:49.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.565+0000 7f8bca000640 1 -- 172.21.15.144:0/946338551 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd40d02a0 msgr2=0x7f8bd40d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:49.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.565+0000 7f8bd2a00640 1 --2- 172.21.15.144:0/946338551 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd40d02a0 0x7f8bd40d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:49.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.565+0000 7f8bd3400640 1 --2- 172.21.15.144:0/946338551 >> v2:172.21.15.165:3300/0 conn(0x7f8bd415ce80 0x7f8bd41594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:49.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.565+0000 7f8bca000640 1 --2- 172.21.15.144:0/946338551 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd40d02a0 0x7f8bd40d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.565+0000 7f8bca000640 1 -- 172.21.15.144:0/946338551 >> v2:172.21.15.165:3300/0 conn(0x7f8bd415ce80 msgr2=0x7f8bd41594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:49.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.565+0000 7f8bca000640 1 --2- 172.21.15.144:0/946338551 >> v2:172.21.15.165:3300/0 conn(0x7f8bd415ce80 0x7f8bd41594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.565+0000 7f8bca000640 1 -- 172.21.15.144:0/946338551 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd415d950 con 0x7f8bd415ca40 2024-09-11T23:18:49.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.565+0000 7f8bd2a00640 1 --2- 172.21.15.144:0/946338551 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd40d02a0 0x7f8bd40d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:49.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.565+0000 7f8bd3400640 1 --2- 172.21.15.144:0/946338551 >> v2:172.21.15.165:3300/0 conn(0x7f8bd415ce80 0x7f8bd41594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:49.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.566+0000 7f8bca000640 1 --2- 172.21.15.144:0/946338551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bd415ca40 0x7f8bd415e430 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8bd406cd20 tx=0x7f8bbc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78b718ae96cc33c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:49.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.566+0000 7f8bd2000640 1 -- 172.21.15.144:0/946338551 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc037070 con 0x7f8bd415ca40 2024-09-11T23:18:49.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.566+0000 7f8bd2000640 1 -- 172.21.15.144:0/946338551 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bbc032440 con 0x7f8bd415ca40 2024-09-11T23:18:49.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.566+0000 7f8bd2000640 1 -- 172.21.15.144:0/946338551 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc032810 con 0x7f8bd415ca40 2024-09-11T23:18:49.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.567+0000 7f8bd9800640 1 -- 172.21.15.144:0/946338551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bd415ca40 msgr2=0x7f8bd415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:49.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.567+0000 7f8bd9800640 1 --2- 172.21.15.144:0/946338551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bd415ca40 0x7f8bd415e430 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8bd406cd20 tx=0x7f8bbc02a140 comp rx=0 tx=0).stop 2024-09-11T23:18:49.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.567+0000 7f8bd9800640 1 -- 172.21.15.144:0/946338551 shutdown_connections 2024-09-11T23:18:49.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.567+0000 7f8bd9800640 1 --2- 172.21.15.144:0/946338551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bd415ca40 0x7f8bd415e430 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.567+0000 7f8bd9800640 1 --2- 172.21.15.144:0/946338551 >> v2:172.21.15.165:3300/0 conn(0x7f8bd415ce80 0x7f8bd41594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.567+0000 7f8bd9800640 1 --2- 172.21.15.144:0/946338551 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd40d02a0 0x7f8bd40d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.567+0000 7f8bd9800640 1 -- 172.21.15.144:0/946338551 >> 172.21.15.144:0/946338551 conn(0x7f8bd4062cc0 msgr2=0x7f8bd406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:49.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.567+0000 7f8bd9800640 1 -- 172.21.15.144:0/946338551 shutdown_connections 2024-09-11T23:18:49.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.567+0000 7f8bd9800640 1 -- 172.21.15.144:0/946338551 wait complete. 2024-09-11T23:18:49.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.569+0000 7f8bd9800640 1 Processor -- start 2024-09-11T23:18:49.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.569+0000 7f8bd9800640 1 -- start start 2024-09-11T23:18:49.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.570+0000 7f8bd9800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bd40d02a0 0x7f8bd41ee790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:49.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.570+0000 7f8bd9800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd415ca40 0x7f8bd40cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:49.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.570+0000 7f8bd9800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bd415ce80 0x7f8bd40ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:49.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.570+0000 7f8bd9800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd4155b90 con 0x7f8bd415ce80 2024-09-11T23:18:49.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.570+0000 7f8bd9800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd415df10 con 0x7f8bd40d02a0 2024-09-11T23:18:49.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.570+0000 7f8bd9800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd4155d10 con 0x7f8bd415ca40 2024-09-11T23:18:49.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.570+0000 7f8bd3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bd415ce80 0x7f8bd40ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:49.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.570+0000 7f8bd3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bd415ce80 0x7f8bd40ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50024/0 (socket says 172.21.15.144:50024) 2024-09-11T23:18:49.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.570+0000 7f8bd3400640 1 -- 172.21.15.144:0/2100948888 learned_addr learned my addr 172.21.15.144:0/2100948888 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:49.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.570+0000 7f8bd2a00640 1 --2- 172.21.15.144:0/2100948888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bd40d02a0 0x7f8bd41ee790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:49.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.570+0000 7f8bca000640 1 --2- 172.21.15.144:0/2100948888 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd415ca40 0x7f8bd40cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:49.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.570+0000 7f8bd3400640 1 -- 172.21.15.144:0/2100948888 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd415ca40 msgr2=0x7f8bd40cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:49.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.570+0000 7f8bd3400640 1 --2- 172.21.15.144:0/2100948888 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd415ca40 0x7f8bd40cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.570+0000 7f8bd3400640 1 -- 172.21.15.144:0/2100948888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bd40d02a0 msgr2=0x7f8bd41ee790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:49.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.570+0000 7f8bd3400640 1 --2- 172.21.15.144:0/2100948888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bd40d02a0 0x7f8bd41ee790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.570+0000 7f8bd3400640 1 -- 172.21.15.144:0/2100948888 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd41eecd0 con 0x7f8bd415ce80 2024-09-11T23:18:49.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.571+0000 7f8bd3400640 1 --2- 172.21.15.144:0/2100948888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bd415ce80 0x7f8bd40ae8e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc00cd80 tx=0x7f8bcc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:49.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.571+0000 7f8bcb400640 1 -- 172.21.15.144:0/2100948888 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc00f680 con 0x7f8bd415ce80 2024-09-11T23:18:49.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.571+0000 7f8bcb400640 1 -- 172.21.15.144:0/2100948888 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bcc00f840 con 0x7f8bd415ce80 2024-09-11T23:18:49.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.571+0000 7f8bcb400640 1 -- 172.21.15.144:0/2100948888 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc00fc30 con 0x7f8bd415ce80 2024-09-11T23:18:49.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.571+0000 7f8bd9800640 1 -- 172.21.15.144:0/2100948888 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd40cdc40 con 0x7f8bd415ce80 2024-09-11T23:18:49.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.571+0000 7f8bd9800640 1 -- 172.21.15.144:0/2100948888 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd40714f0 con 0x7f8bd415ce80 2024-09-11T23:18:49.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.572+0000 7f8bd9800640 1 -- 172.21.15.144:0/2100948888 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bd40b4790 con 0x7f8bd415ce80 2024-09-11T23:18:49.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.573+0000 7f8bcb400640 1 -- 172.21.15.144:0/2100948888 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8bcc0213f0 con 0x7f8bd415ce80 2024-09-11T23:18:49.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.574+0000 7f8bcb400640 1 --2- 172.21.15.144:0/2100948888 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8bb006be30 0x7f8bb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:49.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.574+0000 7f8bcb400640 1 -- 172.21.15.144:0/2100948888 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8bcc08bb20 con 0x7f8bd415ce80 2024-09-11T23:18:49.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.575+0000 7f8bd2a00640 1 --2- 172.21.15.144:0/2100948888 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8bb006be30 0x7f8bb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:49.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.575+0000 7f8bd2a00640 1 --2- 172.21.15.144:0/2100948888 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8bb006be30 0x7f8bb006e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4006fd0 tx=0x7f8bc4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:49.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.579+0000 7f8bcb400640 1 -- 172.21.15.144:0/2100948888 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8bcc014030 con 0x7f8bd415ce80 2024-09-11T23:18:49.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.753+0000 7f8bd9800640 1 -- 172.21.15.144:0/2100948888 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8bd40b3ea0 con 0x7f8bd415ce80 2024-09-11T23:18:49.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.755+0000 7f8bcb400640 1 -- 172.21.15.144:0/2100948888 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16766 (secure 0 0 0) 0x7f8bcc059de0 con 0x7f8bd415ce80 2024-09-11T23:18:49.755 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:49.755 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":33,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:18:48.404718+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:18:46.180295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-11T23:18:47.420116+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:49.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.757+0000 7f8bd9800640 1 -- 172.21.15.144:0/2100948888 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8bb006be30 msgr2=0x7f8bb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:49.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.757+0000 7f8bd9800640 1 --2- 172.21.15.144:0/2100948888 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8bb006be30 0x7f8bb006e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4006fd0 tx=0x7f8bc4008040 comp rx=0 tx=0).stop 2024-09-11T23:18:49.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.757+0000 7f8bd9800640 1 -- 172.21.15.144:0/2100948888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bd415ce80 msgr2=0x7f8bd40ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:49.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.757+0000 7f8bd9800640 1 --2- 172.21.15.144:0/2100948888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bd415ce80 0x7f8bd40ae8e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc00cd80 tx=0x7f8bcc00a650 comp rx=0 tx=0).stop 2024-09-11T23:18:49.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.757+0000 7f8bd9800640 1 -- 172.21.15.144:0/2100948888 shutdown_connections 2024-09-11T23:18:49.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.757+0000 7f8bd9800640 1 --2- 172.21.15.144:0/2100948888 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8bb006be30 0x7f8bb006e2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.757+0000 7f8bd9800640 1 --2- 172.21.15.144:0/2100948888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bd415ce80 0x7f8bd40ae8e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.757+0000 7f8bd9800640 1 --2- 172.21.15.144:0/2100948888 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd415ca40 0x7f8bd40cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.757+0000 7f8bd9800640 1 --2- 172.21.15.144:0/2100948888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bd40d02a0 0x7f8bd41ee790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.757+0000 7f8bd9800640 1 -- 172.21.15.144:0/2100948888 >> 172.21.15.144:0/2100948888 conn(0x7f8bd4062cc0 msgr2=0x7f8bd40b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:49.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.757+0000 7f8bd9800640 1 -- 172.21.15.144:0/2100948888 shutdown_connections 2024-09-11T23:18:49.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.757+0000 7f8bd9800640 1 -- 172.21.15.144:0/2100948888 wait complete. 2024-09-11T23:18:49.773 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:18:49.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.930+0000 7f81fb000640 1 Processor -- start 2024-09-11T23:18:49.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.930+0000 7f81fb000640 1 -- start start 2024-09-11T23:18:49.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.932+0000 7f81fb000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f81f415ed50 0x7f81f4143d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:49.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.932+0000 7f81fb000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f81f40714d0 0x7f81f40ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:49.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.932+0000 7f81fb000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81f41443d0 con 0x7f81f4071080 2024-09-11T23:18:49.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.932+0000 7f81fb000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f81f41446b0 con 0x7f81f415ed50 2024-09-11T23:18:49.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.932+0000 7f81fb000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f81f4144990 con 0x7f81f40714d0 2024-09-11T23:18:49.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.932+0000 7f81f3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f81f415ed50 0x7f81f4143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:49.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.932+0000 7f81f3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f81f415ed50 0x7f81f4143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50038/0 (socket says 172.21.15.144:50038) 2024-09-11T23:18:49.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.932+0000 7f81f3e00640 1 -- 172.21.15.144:0/4238082034 learned_addr learned my addr 172.21.15.144:0/4238082034 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:49.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.932+0000 7f81f9000640 1 --2- 172.21.15.144:0/4238082034 >> v2:172.21.15.165:3300/0 conn(0x7f81f40714d0 0x7f81f40ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:49.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.932+0000 7f81f3e00640 1 -- 172.21.15.144:0/4238082034 >> v2:172.21.15.165:3300/0 conn(0x7f81f40714d0 msgr2=0x7f81f40ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:49.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.932+0000 7f81f3e00640 1 --2- 172.21.15.144:0/4238082034 >> v2:172.21.15.165:3300/0 conn(0x7f81f40714d0 0x7f81f40ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.932+0000 7f81f3e00640 1 -- 172.21.15.144:0/4238082034 >> v1:172.21.15.165:6789/0 conn(0x7f81f4071080 legacy=0x7f81f40b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:49.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.932+0000 7f81f3e00640 1 -- 172.21.15.144:0/4238082034 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f40b35c0 con 0x7f81f415ed50 2024-09-11T23:18:49.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.932+0000 7f81f9000640 1 --2- 172.21.15.144:0/4238082034 >> v2:172.21.15.165:3300/0 conn(0x7f81f40714d0 0x7f81f40ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:49.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.933+0000 7f81f3e00640 1 --2- 172.21.15.144:0/4238082034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81f415ed50 0x7f81f4143d40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f81f406d630 tx=0x7f81e402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69556c432946ac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:49.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.934+0000 7f81f2a00640 1 -- 172.21.15.144:0/4238082034 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4037070 con 0x7f81f415ed50 2024-09-11T23:18:49.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.934+0000 7f81f2a00640 1 -- 172.21.15.144:0/4238082034 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e4032440 con 0x7f81f415ed50 2024-09-11T23:18:49.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.934+0000 7f81f2a00640 1 -- 172.21.15.144:0/4238082034 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4032810 con 0x7f81f415ed50 2024-09-11T23:18:49.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.934+0000 7f81fb000640 1 -- 172.21.15.144:0/4238082034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81f415ed50 msgr2=0x7f81f4143d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:49.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.934+0000 7f81fb000640 1 --2- 172.21.15.144:0/4238082034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81f415ed50 0x7f81f4143d40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f81f406d630 tx=0x7f81e402a1a0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.934+0000 7f81fb000640 1 -- 172.21.15.144:0/4238082034 shutdown_connections 2024-09-11T23:18:49.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.934+0000 7f81fb000640 1 --2- 172.21.15.144:0/4238082034 >> v2:172.21.15.165:3300/0 conn(0x7f81f40714d0 0x7f81f40ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.934+0000 7f81fb000640 1 --2- 172.21.15.144:0/4238082034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81f415ed50 0x7f81f4143d40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.934+0000 7f81fb000640 1 -- 172.21.15.144:0/4238082034 >> 172.21.15.144:0/4238082034 conn(0x7f81f406bba0 msgr2=0x7f81f406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:49.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.934+0000 7f81fb000640 1 -- 172.21.15.144:0/4238082034 shutdown_connections 2024-09-11T23:18:49.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.934+0000 7f81fb000640 1 -- 172.21.15.144:0/4238082034 wait complete. 2024-09-11T23:18:49.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.936+0000 7f81fb000640 1 Processor -- start 2024-09-11T23:18:49.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.936+0000 7f81fb000640 1 -- start start 2024-09-11T23:18:49.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.937+0000 7f81fb000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81f4071080 0x7f81f40b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:49.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.937+0000 7f81fb000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81f40714d0 0x7f81f4140d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:49.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.937+0000 7f81fb000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81f415ed50 0x7f81f40b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:49.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.937+0000 7f81fb000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f81f40aee20 con 0x7f81f40714d0 2024-09-11T23:18:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.937+0000 7f81fb000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f81f40b43e0 con 0x7f81f4071080 2024-09-11T23:18:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.937+0000 7f81fb000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f81f40aefa0 con 0x7f81f415ed50 2024-09-11T23:18:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.937+0000 7f81f3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81f40714d0 0x7f81f4140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.937+0000 7f81f3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81f40714d0 0x7f81f4140d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50052/0 (socket says 172.21.15.144:50052) 2024-09-11T23:18:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.937+0000 7f81f3400640 1 -- 172.21.15.144:0/1599250803 learned_addr learned my addr 172.21.15.144:0/1599250803 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.937+0000 7f81f9000640 1 --2- 172.21.15.144:0/1599250803 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81f415ed50 0x7f81f40b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.937+0000 7f81f3e00640 1 --2- 172.21.15.144:0/1599250803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81f4071080 0x7f81f40b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.938+0000 7f81f3400640 1 -- 172.21.15.144:0/1599250803 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81f415ed50 msgr2=0x7f81f40b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:49.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.938+0000 7f81f3400640 1 --2- 172.21.15.144:0/1599250803 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81f415ed50 0x7f81f40b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.938+0000 7f81f3400640 1 -- 172.21.15.144:0/1599250803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81f4071080 msgr2=0x7f81f40b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:49.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.938+0000 7f81f3400640 1 --2- 172.21.15.144:0/1599250803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81f4071080 0x7f81f40b12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:49.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.938+0000 7f81f3400640 1 -- 172.21.15.144:0/1599250803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f41599c0 con 0x7f81f40714d0 2024-09-11T23:18:49.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.938+0000 7f81f3400640 1 --2- 172.21.15.144:0/1599250803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81f40714d0 0x7f81f4140d40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f81e0004640 tx=0x7f81e000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:49.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.938+0000 7f81ebe00640 1 -- 172.21.15.144:0/1599250803 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0011790 con 0x7f81f40714d0 2024-09-11T23:18:49.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.938+0000 7f81ebe00640 1 -- 172.21.15.144:0/1599250803 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e0017070 con 0x7f81f40714d0 2024-09-11T23:18:49.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.938+0000 7f81ebe00640 1 -- 172.21.15.144:0/1599250803 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0011bb0 con 0x7f81f40714d0 2024-09-11T23:18:49.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.938+0000 7f81fb000640 1 -- 172.21.15.144:0/1599250803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f40b17f0 con 0x7f81f40714d0 2024-09-11T23:18:49.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.938+0000 7f81fb000640 1 -- 172.21.15.144:0/1599250803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f4159390 con 0x7f81f40714d0 2024-09-11T23:18:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.939+0000 7f81fb000640 1 -- 172.21.15.144:0/1599250803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f40ae8e0 con 0x7f81f40714d0 2024-09-11T23:18:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.940+0000 7f81ebe00640 1 -- 172.21.15.144:0/1599250803 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81e0011d50 con 0x7f81f40714d0 2024-09-11T23:18:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.941+0000 7f81ebe00640 1 --2- 172.21.15.144:0/1599250803 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f81d406be30 0x7f81d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.941+0000 7f81ebe00640 1 -- 172.21.15.144:0/1599250803 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f81e008a870 con 0x7f81f40714d0 2024-09-11T23:18:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.941+0000 7f81f3e00640 1 --2- 172.21.15.144:0/1599250803 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f81d406be30 0x7f81d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:49.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.942+0000 7f81f3e00640 1 --2- 172.21.15.144:0/1599250803 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f81d406be30 0x7f81d406e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f81e4034000 tx=0x7f81e402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:49.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:49.945+0000 7f81ebe00640 1 -- 172.21.15.144:0/1599250803 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f81f40b17f0 con 0x7f81f40714d0 2024-09-11T23:18:50.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:50.157+0000 7f81fb000640 1 -- 172.21.15.144:0/1599250803 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f81f40b04d0 con 0x7f81f40714d0 2024-09-11T23:18:51.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.014+0000 7f81ebe00640 1 -- 172.21.15.144:0/1599250803 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f81e0058bc0 con 0x7f81f40714d0 2024-09-11T23:18:51.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.017+0000 7f81fb000640 1 -- 172.21.15.144:0/1599250803 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f81d406be30 msgr2=0x7f81d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:51.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.017+0000 7f81fb000640 1 --2- 172.21.15.144:0/1599250803 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f81d406be30 0x7f81d406e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f81e4034000 tx=0x7f81e402e000 comp rx=0 tx=0).stop 2024-09-11T23:18:51.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.017+0000 7f81fb000640 1 -- 172.21.15.144:0/1599250803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81f40714d0 msgr2=0x7f81f4140d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:51.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.017+0000 7f81fb000640 1 --2- 172.21.15.144:0/1599250803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81f40714d0 0x7f81f4140d40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f81e0004640 tx=0x7f81e000c8e0 comp rx=0 tx=0).stop 2024-09-11T23:18:51.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.018+0000 7f81fb000640 1 -- 172.21.15.144:0/1599250803 shutdown_connections 2024-09-11T23:18:51.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.018+0000 7f81fb000640 1 --2- 172.21.15.144:0/1599250803 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f81d406be30 0x7f81d406e2f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:51.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.018+0000 7f81fb000640 1 --2- 172.21.15.144:0/1599250803 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81f415ed50 0x7f81f40b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:51.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.018+0000 7f81fb000640 1 --2- 172.21.15.144:0/1599250803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81f40714d0 0x7f81f4140d40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:51.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.018+0000 7f81fb000640 1 --2- 172.21.15.144:0/1599250803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81f4071080 0x7f81f40b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:51.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.018+0000 7f81fb000640 1 -- 172.21.15.144:0/1599250803 >> 172.21.15.144:0/1599250803 conn(0x7f81f406bba0 msgr2=0x7f81f4071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:51.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.018+0000 7f81fb000640 1 -- 172.21.15.144:0/1599250803 shutdown_connections 2024-09-11T23:18:51.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.018+0000 7f81fb000640 1 -- 172.21.15.144:0/1599250803 wait complete. 2024-09-11T23:18:51.036 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:18:51.036 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:18:51.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.195+0000 7fc56d200640 1 Processor -- start 2024-09-11T23:18:51.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.196+0000 7fc56d200640 1 -- start start 2024-09-11T23:18:51.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.197+0000 7fc56d200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc56815d790 0x7fc5680cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:51.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.197+0000 7fc56d200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc5680cd3b0 0x7fc5680cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.197+0000 7fc56d200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc56806d700 con 0x7fc56815d3b0 2024-09-11T23:18:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.197+0000 7fc56d200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc56806da30 con 0x7fc5680cd3b0 2024-09-11T23:18:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.197+0000 7fc56d200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc5680cde80 con 0x7fc56815d790 2024-09-11T23:18:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.197+0000 7fc566800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc5680cd3b0 0x7fc5680cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.197+0000 7fc566800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc5680cd3b0 0x7fc5680cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50058/0 (socket says 172.21.15.144:50058) 2024-09-11T23:18:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.197+0000 7fc566800640 1 -- 172.21.15.144:0/2261219473 learned_addr learned my addr 172.21.15.144:0/2261219473 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.197+0000 7fc565e00640 1 --1- 172.21.15.144:0/2261219473 >> v1:172.21.15.144:6789/0 conn(0x7fc56815d3b0 0x7fc568071080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50730/0 (socket says 172.21.15.144:50730) 2024-09-11T23:18:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.197+0000 7fc566800640 1 -- 172.21.15.144:0/2261219473 >> v2:172.21.15.165:3300/0 conn(0x7fc56815d790 msgr2=0x7fc5680cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.197+0000 7fc566800640 1 --2- 172.21.15.144:0/2261219473 >> v2:172.21.15.165:3300/0 conn(0x7fc56815d790 0x7fc5680cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.197+0000 7fc566800640 1 -- 172.21.15.144:0/2261219473 >> v1:172.21.15.144:6789/0 conn(0x7fc56815d3b0 legacy=0x7fc568071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.198+0000 7fc566800640 1 -- 172.21.15.144:0/2261219473 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5680cd8c0 con 0x7fc5680cd3b0 2024-09-11T23:18:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.198+0000 7fc565400640 1 -- 172.21.15.144:0/2261219473 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3785369390 0 0) 0x7fc56806d700 con 0x7fc56815d3b0 2024-09-11T23:18:51.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.198+0000 7fc566800640 1 --2- 172.21.15.144:0/2261219473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5680cd3b0 0x7fc5680cf320 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc56806dbb0 tx=0x7fc56002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb84a08912809861 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:51.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.199+0000 7fc565400640 1 -- 172.21.15.144:0/2261219473 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560036070 con 0x7fc5680cd3b0 2024-09-11T23:18:51.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.199+0000 7fc565400640 1 -- 172.21.15.144:0/2261219473 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc560031600 con 0x7fc5680cd3b0 2024-09-11T23:18:51.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.199+0000 7fc565400640 1 -- 172.21.15.144:0/2261219473 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5600319d0 con 0x7fc5680cd3b0 2024-09-11T23:18:51.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.199+0000 7fc56d200640 1 -- 172.21.15.144:0/2261219473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5680cd3b0 msgr2=0x7fc5680cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:51.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.199+0000 7fc56d200640 1 --2- 172.21.15.144:0/2261219473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5680cd3b0 0x7fc5680cf320 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc56806dbb0 tx=0x7fc56002a730 comp rx=0 tx=0).stop 2024-09-11T23:18:51.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.199+0000 7fc56d200640 1 -- 172.21.15.144:0/2261219473 shutdown_connections 2024-09-11T23:18:51.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.199+0000 7fc56d200640 1 --2- 172.21.15.144:0/2261219473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc5680cd3b0 0x7fc5680cf320 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:51.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.199+0000 7fc56d200640 1 --2- 172.21.15.144:0/2261219473 >> v2:172.21.15.165:3300/0 conn(0x7fc56815d790 0x7fc5680cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:51.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.199+0000 7fc56d200640 1 -- 172.21.15.144:0/2261219473 >> 172.21.15.144:0/2261219473 conn(0x7fc56806bba0 msgr2=0x7fc56806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:51.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.199+0000 7fc56d200640 1 -- 172.21.15.144:0/2261219473 shutdown_connections 2024-09-11T23:18:51.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.199+0000 7fc56d200640 1 -- 172.21.15.144:0/2261219473 wait complete. 2024-09-11T23:18:51.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.201+0000 7fc56d200640 1 Processor -- start 2024-09-11T23:18:51.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.201+0000 7fc56d200640 1 -- start start 2024-09-11T23:18:51.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.202+0000 7fc56d200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5680cd3b0 0x7fc5681550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:51.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.202+0000 7fc56d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc56815d3b0 0x7fc568155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:51.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.202+0000 7fc56d200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc568153ae0 0x7fc5680aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:51.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.202+0000 7fc56d200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc56815cd70 con 0x7fc56815d3b0 2024-09-11T23:18:51.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.202+0000 7fc56d200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc56815cbf0 con 0x7fc5680cd3b0 2024-09-11T23:18:51.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.202+0000 7fc56d200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc5680cf860 con 0x7fc568153ae0 2024-09-11T23:18:51.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.202+0000 7fc55d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc56815d3b0 0x7fc568155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:51.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.202+0000 7fc55d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc56815d3b0 0x7fc568155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50062/0 (socket says 172.21.15.144:50062) 2024-09-11T23:18:51.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.202+0000 7fc55d400640 1 -- 172.21.15.144:0/2444243768 learned_addr learned my addr 172.21.15.144:0/2444243768 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:51.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.203+0000 7fc566800640 1 --2- 172.21.15.144:0/2444243768 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc568153ae0 0x7fc5680aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:51.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.203+0000 7fc565e00640 1 --2- 172.21.15.144:0/2444243768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5680cd3b0 0x7fc5681550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:51.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.203+0000 7fc55d400640 1 -- 172.21.15.144:0/2444243768 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc568153ae0 msgr2=0x7fc5680aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:51.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.203+0000 7fc55d400640 1 --2- 172.21.15.144:0/2444243768 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc568153ae0 0x7fc5680aa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:51.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.203+0000 7fc55d400640 1 -- 172.21.15.144:0/2444243768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5680cd3b0 msgr2=0x7fc5681550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:51.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.203+0000 7fc55d400640 1 --2- 172.21.15.144:0/2444243768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5680cd3b0 0x7fc5681550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:51.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.203+0000 7fc55d400640 1 -- 172.21.15.144:0/2444243768 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc568154050 con 0x7fc56815d3b0 2024-09-11T23:18:51.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.203+0000 7fc566800640 1 --2- 172.21.15.144:0/2444243768 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc568153ae0 0x7fc5680aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:51.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.203+0000 7fc565e00640 1 --2- 172.21.15.144:0/2444243768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5680cd3b0 0x7fc5681550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:51.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.203+0000 7fc55d400640 1 --2- 172.21.15.144:0/2444243768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc56815d3b0 0x7fc568155d30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc55000b3c0 tx=0x7fc55000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:51.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.203+0000 7fc55ea00640 1 -- 172.21.15.144:0/2444243768 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550005970 con 0x7fc56815d3b0 2024-09-11T23:18:51.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.203+0000 7fc55ea00640 1 -- 172.21.15.144:0/2444243768 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc550005b10 con 0x7fc56815d3b0 2024-09-11T23:18:51.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.203+0000 7fc56d200640 1 -- 172.21.15.144:0/2444243768 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc568154330 con 0x7fc56815d3b0 2024-09-11T23:18:51.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.203+0000 7fc55ea00640 1 -- 172.21.15.144:0/2444243768 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550006020 con 0x7fc56815d3b0 2024-09-11T23:18:51.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.203+0000 7fc56d200640 1 -- 172.21.15.144:0/2444243768 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5681548f0 con 0x7fc56815d3b0 2024-09-11T23:18:51.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.204+0000 7fc56d200640 1 -- 172.21.15.144:0/2444243768 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5680cfc50 con 0x7fc56815d3b0 2024-09-11T23:18:51.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.205+0000 7fc55ea00640 1 -- 172.21.15.144:0/2444243768 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc550018020 con 0x7fc56815d3b0 2024-09-11T23:18:51.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.206+0000 7fc55ea00640 1 --2- 172.21.15.144:0/2444243768 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc54406be30 0x7fc54406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:51.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.206+0000 7fc55ea00640 1 -- 172.21.15.144:0/2444243768 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc55008a530 con 0x7fc56815d3b0 2024-09-11T23:18:51.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.206+0000 7fc565e00640 1 --2- 172.21.15.144:0/2444243768 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc54406be30 0x7fc54406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:51.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.207+0000 7fc565e00640 1 --2- 172.21.15.144:0/2444243768 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc54406be30 0x7fc54406e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc558000f60 tx=0x7fc558009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:51.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.210+0000 7fc55ea00640 1 -- 172.21.15.144:0/2444243768 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc550058e40 con 0x7fc56815d3b0 2024-09-11T23:18:51.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:51.418+0000 7fc56d200640 1 -- 172.21.15.144:0/2444243768 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc5680634e0 con 0x7fc56815d3b0 2024-09-11T23:18:52.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.020+0000 7fc55ea00640 1 -- 172.21.15.144:0/2444243768 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7fc550058740 con 0x7fc56815d3b0 2024-09-11T23:18:52.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.022+0000 7fc56d200640 1 -- 172.21.15.144:0/2444243768 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc54406be30 msgr2=0x7fc54406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.022+0000 7fc56d200640 1 --2- 172.21.15.144:0/2444243768 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc54406be30 0x7fc54406e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc558000f60 tx=0x7fc558009040 comp rx=0 tx=0).stop 2024-09-11T23:18:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.022+0000 7fc56d200640 1 -- 172.21.15.144:0/2444243768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc56815d3b0 msgr2=0x7fc568155d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.022+0000 7fc56d200640 1 --2- 172.21.15.144:0/2444243768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc56815d3b0 0x7fc568155d30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc55000b3c0 tx=0x7fc55000b880 comp rx=0 tx=0).stop 2024-09-11T23:18:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.022+0000 7fc56d200640 1 -- 172.21.15.144:0/2444243768 shutdown_connections 2024-09-11T23:18:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.022+0000 7fc56d200640 1 --2- 172.21.15.144:0/2444243768 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc54406be30 0x7fc54406e2f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.022+0000 7fc56d200640 1 --2- 172.21.15.144:0/2444243768 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc568153ae0 0x7fc5680aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.022+0000 7fc56d200640 1 --2- 172.21.15.144:0/2444243768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc56815d3b0 0x7fc568155d30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.022+0000 7fc56d200640 1 --2- 172.21.15.144:0/2444243768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5680cd3b0 0x7fc5681550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.022+0000 7fc56d200640 1 -- 172.21.15.144:0/2444243768 >> 172.21.15.144:0/2444243768 conn(0x7fc56806bba0 msgr2=0x7fc56815e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.022+0000 7fc56d200640 1 -- 172.21.15.144:0/2444243768 shutdown_connections 2024-09-11T23:18:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.023+0000 7fc56d200640 1 -- 172.21.15.144:0/2444243768 wait complete. 2024-09-11T23:18:52.039 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:18:52.039 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:52.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.193+0000 7fba7a800640 1 Processor -- start 2024-09-11T23:18:52.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.194+0000 7fba7a800640 1 -- start start 2024-09-11T23:18:52.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.195+0000 7fba7a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fba7415ca40 0x7fba7415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.195+0000 7fba7a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba7415ceb0 0x7fba741594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.195+0000 7fba7a800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba7415d390 con 0x7fba740d02a0 2024-09-11T23:18:52.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.195+0000 7fba7a800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fba7415d670 con 0x7fba7415ca40 2024-09-11T23:18:52.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.195+0000 7fba7a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fba7415d950 con 0x7fba7415ceb0 2024-09-11T23:18:52.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.195+0000 7fba73400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fba740d02a0 0x7fba740d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50732/0 (socket says 172.21.15.144:50732) 2024-09-11T23:18:52.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.195+0000 7fba73400640 1 -- 172.21.15.144:0/3672803808 learned_addr learned my addr 172.21.15.144:0/3672803808 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:52.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.195+0000 7fba6aa00640 1 --2- 172.21.15.144:0/3672803808 >> v2:172.21.15.144:3300/0 conn(0x7fba7415ca40 0x7fba7415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.195+0000 7fba73e00640 1 --2- 172.21.15.144:0/3672803808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba7415ceb0 0x7fba741594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.195+0000 7fba72a00640 1 -- 172.21.15.144:0/3672803808 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1108533236 0 0) 0x7fba7415d390 con 0x7fba740d02a0 2024-09-11T23:18:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.195+0000 7fba72a00640 1 -- 172.21.15.144:0/3672803808 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba58003520 con 0x7fba740d02a0 2024-09-11T23:18:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.195+0000 7fba6aa00640 1 -- 172.21.15.144:0/3672803808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba7415ceb0 msgr2=0x7fba741594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.195+0000 7fba6aa00640 1 --2- 172.21.15.144:0/3672803808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba7415ceb0 0x7fba741594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.195+0000 7fba6aa00640 1 -- 172.21.15.144:0/3672803808 >> v1:172.21.15.144:6789/0 conn(0x7fba740d02a0 legacy=0x7fba740d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.195+0000 7fba6aa00640 1 -- 172.21.15.144:0/3672803808 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba7415dc30 con 0x7fba7415ca40 2024-09-11T23:18:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.196+0000 7fba6aa00640 1 --2- 172.21.15.144:0/3672803808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7415ca40 0x7fba7415e430 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0097a0 tx=0x7fba5c02a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab306f774546cec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:52.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.197+0000 7fba72a00640 1 -- 172.21.15.144:0/3672803808 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c037070 con 0x7fba7415ca40 2024-09-11T23:18:52.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.197+0000 7fba72a00640 1 -- 172.21.15.144:0/3672803808 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba5c02ae40 con 0x7fba7415ca40 2024-09-11T23:18:52.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.197+0000 7fba72a00640 1 -- 172.21.15.144:0/3672803808 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c032640 con 0x7fba7415ca40 2024-09-11T23:18:52.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.197+0000 7fba7a800640 1 -- 172.21.15.144:0/3672803808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7415ca40 msgr2=0x7fba7415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.197+0000 7fba7a800640 1 --2- 172.21.15.144:0/3672803808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7415ca40 0x7fba7415e430 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0097a0 tx=0x7fba5c02a0f0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.197+0000 7fba7a800640 1 -- 172.21.15.144:0/3672803808 shutdown_connections 2024-09-11T23:18:52.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.197+0000 7fba7a800640 1 --2- 172.21.15.144:0/3672803808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba7415ceb0 0x7fba741594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.197+0000 7fba7a800640 1 --2- 172.21.15.144:0/3672803808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7415ca40 0x7fba7415e430 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.197+0000 7fba7a800640 1 -- 172.21.15.144:0/3672803808 >> 172.21.15.144:0/3672803808 conn(0x7fba74062cc0 msgr2=0x7fba7406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:52.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.197+0000 7fba7a800640 1 -- 172.21.15.144:0/3672803808 shutdown_connections 2024-09-11T23:18:52.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.197+0000 7fba7a800640 1 -- 172.21.15.144:0/3672803808 wait complete. 2024-09-11T23:18:52.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.199+0000 7fba7a800640 1 Processor -- start 2024-09-11T23:18:52.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.199+0000 7fba7a800640 1 -- start start 2024-09-11T23:18:52.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.200+0000 7fba7a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba740d02a0 0x7fba74071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.200+0000 7fba7a800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba7415ca40 0x7fba7414c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.200+0000 7fba7a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7415ceb0 0x7fba74158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.200+0000 7fba7a800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fba74155d10 con 0x7fba7415ceb0 2024-09-11T23:18:52.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.200+0000 7fba7a800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fba74155b90 con 0x7fba7415ca40 2024-09-11T23:18:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.200+0000 7fba7a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fba740b4790 con 0x7fba740d02a0 2024-09-11T23:18:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.200+0000 7fba73e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7415ceb0 0x7fba74158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.200+0000 7fba73e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7415ceb0 0x7fba74158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50082/0 (socket says 172.21.15.144:50082) 2024-09-11T23:18:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.200+0000 7fba73e00640 1 -- 172.21.15.144:0/3608982996 learned_addr learned my addr 172.21.15.144:0/3608982996 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.201+0000 7fba73400640 1 --2- 172.21.15.144:0/3608982996 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba740d02a0 0x7fba74071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.201+0000 7fba6aa00640 1 --2- 172.21.15.144:0/3608982996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba7415ca40 0x7fba7414c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.201+0000 7fba73e00640 1 -- 172.21.15.144:0/3608982996 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba740d02a0 msgr2=0x7fba74071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.201+0000 7fba73e00640 1 --2- 172.21.15.144:0/3608982996 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba740d02a0 0x7fba74071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.201+0000 7fba73e00640 1 -- 172.21.15.144:0/3608982996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba7415ca40 msgr2=0x7fba7414c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.201+0000 7fba73e00640 1 --2- 172.21.15.144:0/3608982996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba7415ca40 0x7fba7414c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.201+0000 7fba73e00640 1 -- 172.21.15.144:0/3608982996 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba7414ced0 con 0x7fba7415ceb0 2024-09-11T23:18:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.201+0000 7fba6aa00640 1 --2- 172.21.15.144:0/3608982996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba7415ca40 0x7fba7414c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.201+0000 7fba73e00640 1 --2- 172.21.15.144:0/3608982996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7415ceb0 0x7fba74158820 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fba6c007de0 tx=0x7fba6c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.201+0000 7fba6be00640 1 -- 172.21.15.144:0/3608982996 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6c014620 con 0x7fba7415ceb0 2024-09-11T23:18:52.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.201+0000 7fba6be00640 1 -- 172.21.15.144:0/3608982996 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba6c019070 con 0x7fba7415ceb0 2024-09-11T23:18:52.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.201+0000 7fba6be00640 1 -- 172.21.15.144:0/3608982996 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6c014a20 con 0x7fba7415ceb0 2024-09-11T23:18:52.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.201+0000 7fba7a800640 1 -- 172.21.15.144:0/3608982996 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba74071650 con 0x7fba7415ceb0 2024-09-11T23:18:52.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.202+0000 7fba7a800640 1 -- 172.21.15.144:0/3608982996 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba74071c10 con 0x7fba7415ceb0 2024-09-11T23:18:52.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.202+0000 7fba7a800640 1 -- 172.21.15.144:0/3608982996 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba740d0680 con 0x7fba7415ceb0 2024-09-11T23:18:52.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.203+0000 7fba6be00640 1 -- 172.21.15.144:0/3608982996 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba6c014bc0 con 0x7fba7415ceb0 2024-09-11T23:18:52.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.204+0000 7fba6be00640 1 --2- 172.21.15.144:0/3608982996 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fba5006be30 0x7fba5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.204+0000 7fba6be00640 1 -- 172.21.15.144:0/3608982996 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fba6c08b7f0 con 0x7fba7415ceb0 2024-09-11T23:18:52.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.205+0000 7fba73400640 1 --2- 172.21.15.144:0/3608982996 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fba5006be30 0x7fba5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.205+0000 7fba73400640 1 --2- 172.21.15.144:0/3608982996 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fba5006be30 0x7fba5006e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fba64005880 tx=0x7fba64009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:52.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.209+0000 7fba6be00640 1 -- 172.21.15.144:0/3608982996 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba6c05a190 con 0x7fba7415ceb0 2024-09-11T23:18:52.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.417+0000 7fba7a800640 1 -- 172.21.15.144:0/3608982996 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba740b5550 con 0x7fba7415ceb0 2024-09-11T23:18:52.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.418+0000 7fba6be00640 1 -- 172.21.15.144:0/3608982996 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5229 (secure 0 0 0) 0x7fba6c059a90 con 0x7fba7415ceb0 2024-09-11T23:18:52.418 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:52.418 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":17,"btime":"2024-09-11T23:18:52:015546+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4601,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/4045809607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":4045809607},{"type":"v1","addr":"172.21.15.165:6835","nonce":4045809607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2584561527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2584561527},{"type":"v1","addr":"172.21.15.165:6834","nonce":2584561527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4815,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/787593912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":787593912},{"type":"v1","addr":"172.21.15.144:6836","nonce":787593912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:18:48.405093+0000","modified":"2024-09-11T23:18:51.419894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4818},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4818":{"gid":4818,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/163510896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":163510896},{"type":"v1","addr":"172.21.15.144:6837","nonce":163510896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4818,"qdb_cluster":[4818]},"id":2}]} 2024-09-11T23:18:52.418 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 17 2024-09-11T23:18:52.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.420+0000 7fba7a800640 1 -- 172.21.15.144:0/3608982996 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fba5006be30 msgr2=0x7fba5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.420+0000 7fba7a800640 1 --2- 172.21.15.144:0/3608982996 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fba5006be30 0x7fba5006e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fba64005880 tx=0x7fba64009040 comp rx=0 tx=0).stop 2024-09-11T23:18:52.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.420+0000 7fba7a800640 1 -- 172.21.15.144:0/3608982996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7415ceb0 msgr2=0x7fba74158820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.420+0000 7fba7a800640 1 --2- 172.21.15.144:0/3608982996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7415ceb0 0x7fba74158820 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fba6c007de0 tx=0x7fba6c00e4b0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.420+0000 7fba7a800640 1 -- 172.21.15.144:0/3608982996 shutdown_connections 2024-09-11T23:18:52.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.420+0000 7fba7a800640 1 --2- 172.21.15.144:0/3608982996 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fba5006be30 0x7fba5006e2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.420+0000 7fba7a800640 1 --2- 172.21.15.144:0/3608982996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba7415ceb0 0x7fba74158820 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.420+0000 7fba7a800640 1 --2- 172.21.15.144:0/3608982996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba7415ca40 0x7fba7414c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.420+0000 7fba7a800640 1 --2- 172.21.15.144:0/3608982996 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba740d02a0 0x7fba74071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.420+0000 7fba7a800640 1 -- 172.21.15.144:0/3608982996 >> 172.21.15.144:0/3608982996 conn(0x7fba74062cc0 msgr2=0x7fba7406c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:52.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.420+0000 7fba7a800640 1 -- 172.21.15.144:0/3608982996 shutdown_connections 2024-09-11T23:18:52.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.420+0000 7fba7a800640 1 -- 172.21.15.144:0/3608982996 wait complete. 2024-09-11T23:18:52.436 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:18:52.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.589+0000 7f134c400640 1 Processor -- start 2024-09-11T23:18:52.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.589+0000 7f134c400640 1 -- start start 2024-09-11T23:18:52.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.590+0000 7f134c400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13440cf070 0x7f13440cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.590+0000 7f134c400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1344073120 0x7f1344073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.591+0000 7f134c400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13440ce740 con 0x7f134415c180 2024-09-11T23:18:52.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.591+0000 7f134c400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1344072640 con 0x7f1344073120 2024-09-11T23:18:52.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.591+0000 7f134c400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1344072920 con 0x7f13440cf070 2024-09-11T23:18:52.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.591+0000 7f1349a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f134415c180 0x7f13440cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50748/0 (socket says 172.21.15.144:50748) 2024-09-11T23:18:52.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.591+0000 7f1349a00640 1 -- 172.21.15.144:0/3592375832 learned_addr learned my addr 172.21.15.144:0/3592375832 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:52.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.591+0000 7f134a400640 1 --2- 172.21.15.144:0/3592375832 >> v2:172.21.15.165:3300/0 conn(0x7f1344073120 0x7f1344073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.591+0000 7f1349000640 1 --2- 172.21.15.144:0/3592375832 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13440cf070 0x7f13440cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.591+0000 7f1343e00640 1 -- 172.21.15.144:0/3592375832 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 667687004 0 0) 0x7f13440ce740 con 0x7f134415c180 2024-09-11T23:18:52.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.591+0000 7f1343e00640 1 -- 172.21.15.144:0/3592375832 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f132c003520 con 0x7f134415c180 2024-09-11T23:18:52.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.592+0000 7f134a400640 1 -- 172.21.15.144:0/3592375832 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13440cf070 msgr2=0x7f13440cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:52.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.592+0000 7f134a400640 1 --2- 172.21.15.144:0/3592375832 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13440cf070 0x7f13440cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.592+0000 7f134a400640 1 -- 172.21.15.144:0/3592375832 >> v1:172.21.15.144:6789/0 conn(0x7f134415c180 legacy=0x7f13440cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.592+0000 7f1343e00640 1 -- 172.21.15.144:0/3592375832 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2910256305 0 0) 0x7f132c003520 con 0x7f134415c180 2024-09-11T23:18:52.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.592+0000 7f134a400640 1 -- 172.21.15.144:0/3592375832 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1344072c00 con 0x7f1344073120 2024-09-11T23:18:52.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.593+0000 7f134a400640 1 --2- 172.21.15.144:0/3592375832 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1344073120 0x7f1344073590 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f133c009d90 tx=0x7f133c02a550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff54e2623e65b01 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:52.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.593+0000 7f1343e00640 1 -- 172.21.15.144:0/3592375832 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1338001690 con 0x7f1344073120 2024-09-11T23:18:52.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.593+0000 7f1343e00640 1 -- 172.21.15.144:0/3592375832 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f133c007540 con 0x7f1344073120 2024-09-11T23:18:52.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.593+0000 7f1343e00640 1 -- 172.21.15.144:0/3592375832 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c007910 con 0x7f1344073120 2024-09-11T23:18:52.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.594+0000 7f134c400640 1 -- 172.21.15.144:0/3592375832 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1344073120 msgr2=0x7f1344073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.594+0000 7f134c400640 1 --2- 172.21.15.144:0/3592375832 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1344073120 0x7f1344073590 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f133c009d90 tx=0x7f133c02a550 comp rx=0 tx=0).stop 2024-09-11T23:18:52.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.594+0000 7f134c400640 1 -- 172.21.15.144:0/3592375832 shutdown_connections 2024-09-11T23:18:52.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.594+0000 7f134c400640 1 --2- 172.21.15.144:0/3592375832 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1344073120 0x7f1344073590 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.594+0000 7f134c400640 1 --2- 172.21.15.144:0/3592375832 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13440cf070 0x7f13440cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.594+0000 7f134c400640 1 -- 172.21.15.144:0/3592375832 >> 172.21.15.144:0/3592375832 conn(0x7f1344062cc0 msgr2=0x7f134406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:52.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.594+0000 7f134c400640 1 -- 172.21.15.144:0/3592375832 shutdown_connections 2024-09-11T23:18:52.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.594+0000 7f134c400640 1 -- 172.21.15.144:0/3592375832 wait complete. 2024-09-11T23:18:52.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.596+0000 7f134c400640 1 Processor -- start 2024-09-11T23:18:52.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.596+0000 7f134c400640 1 -- start start 2024-09-11T23:18:52.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.597+0000 7f134c400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1344073120 0x7f134414d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.597+0000 7f134c400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13440cf070 0x7f13440b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.597+0000 7f134c400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f134415c180 0x7f13440ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.597+0000 7f134c400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f13440722f0 con 0x7f134415c180 2024-09-11T23:18:52.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.597+0000 7f134c400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f13440ced00 con 0x7f1344073120 2024-09-11T23:18:52.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.597+0000 7f134c400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f134415c560 con 0x7f13440cf070 2024-09-11T23:18:52.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.597+0000 7f134a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f134415c180 0x7f13440ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.597+0000 7f134a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f134415c180 0x7f13440ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50084/0 (socket says 172.21.15.144:50084) 2024-09-11T23:18:52.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.597+0000 7f134a400640 1 -- 172.21.15.144:0/3543199261 learned_addr learned my addr 172.21.15.144:0/3543199261 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:52.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.597+0000 7f1349a00640 1 --2- 172.21.15.144:0/3543199261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1344073120 0x7f134414d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.597+0000 7f1349000640 1 --2- 172.21.15.144:0/3543199261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13440cf070 0x7f13440b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.597+0000 7f134a400640 1 -- 172.21.15.144:0/3543199261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13440cf070 msgr2=0x7f13440b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.597+0000 7f134a400640 1 --2- 172.21.15.144:0/3543199261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13440cf070 0x7f13440b2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.598+0000 7f134a400640 1 -- 172.21.15.144:0/3543199261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1344073120 msgr2=0x7f134414d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.598+0000 7f134a400640 1 --2- 172.21.15.144:0/3543199261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1344073120 0x7f134414d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.598+0000 7f134a400640 1 -- 172.21.15.144:0/3543199261 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1344153830 con 0x7f134415c180 2024-09-11T23:18:52.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.598+0000 7f134a400640 1 --2- 172.21.15.144:0/3543199261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f134415c180 0x7f13440ae8e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f133c009d90 tx=0x7f133c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:52.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.598+0000 7f1341600640 1 -- 172.21.15.144:0/3543199261 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c040070 con 0x7f134415c180 2024-09-11T23:18:52.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.598+0000 7f1341600640 1 -- 172.21.15.144:0/3543199261 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f133c031b40 con 0x7f134415c180 2024-09-11T23:18:52.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.598+0000 7f1341600640 1 -- 172.21.15.144:0/3543199261 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c007e90 con 0x7f134415c180 2024-09-11T23:18:52.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.598+0000 7f134c400640 1 -- 172.21.15.144:0/3543199261 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1344153b10 con 0x7f134415c180 2024-09-11T23:18:52.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.598+0000 7f134c400640 1 -- 172.21.15.144:0/3543199261 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13440b34e0 con 0x7f134415c180 2024-09-11T23:18:52.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.599+0000 7f134c400640 1 -- 172.21.15.144:0/3543199261 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f134406d030 con 0x7f134415c180 2024-09-11T23:18:52.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.600+0000 7f1341600640 1 -- 172.21.15.144:0/3543199261 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f133c039040 con 0x7f134415c180 2024-09-11T23:18:52.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.601+0000 7f1341600640 1 --2- 172.21.15.144:0/3543199261 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f132406be30 0x7f132406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.601+0000 7f1341600640 1 -- 172.21.15.144:0/3543199261 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f133c0abd60 con 0x7f134415c180 2024-09-11T23:18:52.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.601+0000 7f1349a00640 1 --2- 172.21.15.144:0/3543199261 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f132406be30 0x7f132406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.602+0000 7f1349a00640 1 --2- 172.21.15.144:0/3543199261 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f132406be30 0x7f132406e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1338000f60 tx=0x7f1338000ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:52.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.605+0000 7f1341600640 1 -- 172.21.15.144:0/3543199261 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f134406d030 con 0x7f134415c180 2024-09-11T23:18:52.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.780+0000 7f134c400640 1 -- 172.21.15.144:0/3543199261 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13440cf4b0 con 0x7f134415c180 2024-09-11T23:18:52.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.781+0000 7f1341600640 1 -- 172.21.15.144:0/3543199261 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16753 (secure 0 0 0) 0x7f133c07a0b0 con 0x7f134415c180 2024-09-11T23:18:52.782 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:52.783 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":34,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:18:49.999965+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:18:46.180295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-11T23:18:47.420116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:18:52.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.783+0000 7f134c400640 1 -- 172.21.15.144:0/3543199261 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f132406be30 msgr2=0x7f132406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.783+0000 7f134c400640 1 --2- 172.21.15.144:0/3543199261 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f132406be30 0x7f132406e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1338000f60 tx=0x7f1338000ed0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.783+0000 7f134c400640 1 -- 172.21.15.144:0/3543199261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f134415c180 msgr2=0x7f13440ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.783+0000 7f134c400640 1 --2- 172.21.15.144:0/3543199261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f134415c180 0x7f13440ae8e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f133c009d90 tx=0x7f133c004a40 comp rx=0 tx=0).stop 2024-09-11T23:18:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.784+0000 7f134c400640 1 -- 172.21.15.144:0/3543199261 shutdown_connections 2024-09-11T23:18:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.784+0000 7f134c400640 1 --2- 172.21.15.144:0/3543199261 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f132406be30 0x7f132406e2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.784+0000 7f134c400640 1 --2- 172.21.15.144:0/3543199261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f134415c180 0x7f13440ae8e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.784+0000 7f134c400640 1 --2- 172.21.15.144:0/3543199261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f13440cf070 0x7f13440b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.784+0000 7f134c400640 1 --2- 172.21.15.144:0/3543199261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1344073120 0x7f134414d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.784+0000 7f134c400640 1 -- 172.21.15.144:0/3543199261 >> 172.21.15.144:0/3543199261 conn(0x7f1344062cc0 msgr2=0x7f134406c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.784+0000 7f134c400640 1 -- 172.21.15.144:0/3543199261 shutdown_connections 2024-09-11T23:18:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.784+0000 7f134c400640 1 -- 172.21.15.144:0/3543199261 wait complete. 2024-09-11T23:18:52.801 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:18:52.801 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:18:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.952+0000 7fba40600640 1 Processor -- start 2024-09-11T23:18:52.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.952+0000 7fba40600640 1 -- start start 2024-09-11T23:18:52.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.954+0000 7fba40600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fba3815c180 0x7fba380cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.954+0000 7fba40600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fba380ce230 0x7fba380cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.954+0000 7fba40600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba380ce740 con 0x7fba380cf5b0 2024-09-11T23:18:52.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.954+0000 7fba40600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fba38072640 con 0x7fba3815c180 2024-09-11T23:18:52.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.954+0000 7fba40600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fba38072920 con 0x7fba380ce230 2024-09-11T23:18:52.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.954+0000 7fba3dc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fba3815c180 0x7fba380cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.954+0000 7fba3dc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fba3815c180 0x7fba380cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50094/0 (socket says 172.21.15.144:50094) 2024-09-11T23:18:52.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.954+0000 7fba3dc00640 1 -- 172.21.15.144:0/2645660497 learned_addr learned my addr 172.21.15.144:0/2645660497 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:52.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.954+0000 7fba3e600640 1 --1- 172.21.15.144:0/2645660497 >> v1:172.21.15.144:6789/0 conn(0x7fba380cf5b0 0x7fba38073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50750/0 (socket says 172.21.15.144:50750) 2024-09-11T23:18:52.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.954+0000 7fba3d200640 1 --2- 172.21.15.144:0/2645660497 >> v2:172.21.15.165:3300/0 conn(0x7fba380ce230 0x7fba380cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.954+0000 7fba3dc00640 1 -- 172.21.15.144:0/2645660497 >> v2:172.21.15.165:3300/0 conn(0x7fba380ce230 msgr2=0x7fba380cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:52.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.954+0000 7fba3dc00640 1 --2- 172.21.15.144:0/2645660497 >> v2:172.21.15.165:3300/0 conn(0x7fba380ce230 0x7fba380cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.954+0000 7fba3dc00640 1 -- 172.21.15.144:0/2645660497 >> v1:172.21.15.144:6789/0 conn(0x7fba380cf5b0 legacy=0x7fba38073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.954+0000 7fba3dc00640 1 -- 172.21.15.144:0/2645660497 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba38072c00 con 0x7fba3815c180 2024-09-11T23:18:52.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.954+0000 7fba3d200640 1 --2- 172.21.15.144:0/2645660497 >> v2:172.21.15.165:3300/0 conn(0x7fba380ce230 0x7fba380cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:52.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.954+0000 7fba37e00640 1 -- 172.21.15.144:0/2645660497 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 598538253 0 0) 0x7fba380ce740 con 0x7fba380cf5b0 2024-09-11T23:18:52.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.955+0000 7fba3dc00640 1 --2- 172.21.15.144:0/2645660497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba3815c180 0x7fba380cdcf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fba38071d60 tx=0x7fba2c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2e86daaa7569d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.956+0000 7fba37e00640 1 -- 172.21.15.144:0/2645660497 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c037070 con 0x7fba3815c180 2024-09-11T23:18:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.956+0000 7fba37e00640 1 -- 172.21.15.144:0/2645660497 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba2c032440 con 0x7fba3815c180 2024-09-11T23:18:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.956+0000 7fba37e00640 1 -- 172.21.15.144:0/2645660497 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c032810 con 0x7fba3815c180 2024-09-11T23:18:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.956+0000 7fba40600640 1 -- 172.21.15.144:0/2645660497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba3815c180 msgr2=0x7fba380cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.956+0000 7fba40600640 1 --2- 172.21.15.144:0/2645660497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba3815c180 0x7fba380cdcf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fba38071d60 tx=0x7fba2c02a1e0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.956+0000 7fba40600640 1 -- 172.21.15.144:0/2645660497 shutdown_connections 2024-09-11T23:18:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.956+0000 7fba40600640 1 --2- 172.21.15.144:0/2645660497 >> v2:172.21.15.165:3300/0 conn(0x7fba380ce230 0x7fba380cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.956+0000 7fba40600640 1 --2- 172.21.15.144:0/2645660497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba3815c180 0x7fba380cdcf0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.956+0000 7fba40600640 1 -- 172.21.15.144:0/2645660497 >> 172.21.15.144:0/2645660497 conn(0x7fba38062cc0 msgr2=0x7fba3806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.956+0000 7fba40600640 1 -- 172.21.15.144:0/2645660497 shutdown_connections 2024-09-11T23:18:52.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.956+0000 7fba40600640 1 -- 172.21.15.144:0/2645660497 wait complete. 2024-09-11T23:18:52.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.958+0000 7fba40600640 1 Processor -- start 2024-09-11T23:18:52.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.958+0000 7fba40600640 1 -- start start 2024-09-11T23:18:52.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.959+0000 7fba40600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba380ce230 0x7fba38148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.959+0000 7fba40600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba380cf5b0 0x7fba3815a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.959+0000 7fba40600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba3815c180 0x7fba3815f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.959+0000 7fba40600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fba3815c560 con 0x7fba3815c180 2024-09-11T23:18:52.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.959+0000 7fba40600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fba380722f0 con 0x7fba380ce230 2024-09-11T23:18:52.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.959+0000 7fba40600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fba3815c6e0 con 0x7fba380cf5b0 2024-09-11T23:18:52.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.959+0000 7fba3e600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba3815c180 0x7fba3815f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.959+0000 7fba3e600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba3815c180 0x7fba3815f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50096/0 (socket says 172.21.15.144:50096) 2024-09-11T23:18:52.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.959+0000 7fba3e600640 1 -- 172.21.15.144:0/4123763261 learned_addr learned my addr 172.21.15.144:0/4123763261 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:52.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.959+0000 7fba3dc00640 1 --2- 172.21.15.144:0/4123763261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba380ce230 0x7fba38148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.959+0000 7fba3d200640 1 --2- 172.21.15.144:0/4123763261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba380cf5b0 0x7fba3815a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.960+0000 7fba3e600640 1 -- 172.21.15.144:0/4123763261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba380cf5b0 msgr2=0x7fba3815a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.960+0000 7fba3e600640 1 --2- 172.21.15.144:0/4123763261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba380cf5b0 0x7fba3815a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.960+0000 7fba3e600640 1 -- 172.21.15.144:0/4123763261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba380ce230 msgr2=0x7fba38148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:52.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.960+0000 7fba3e600640 1 --2- 172.21.15.144:0/4123763261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba380ce230 0x7fba38148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:52.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.960+0000 7fba3e600640 1 -- 172.21.15.144:0/4123763261 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3815d140 con 0x7fba3815c180 2024-09-11T23:18:52.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.960+0000 7fba3e600640 1 --2- 172.21.15.144:0/4123763261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba3815c180 0x7fba3815f8e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fba3000c7d0 tx=0x7fba3000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:52.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.960+0000 7fba35600640 1 -- 172.21.15.144:0/4123763261 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba30018070 con 0x7fba3815c180 2024-09-11T23:18:52.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.960+0000 7fba35600640 1 -- 172.21.15.144:0/4123763261 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba3000a640 con 0x7fba3815c180 2024-09-11T23:18:52.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.960+0000 7fba40600640 1 -- 172.21.15.144:0/4123763261 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba3815d3b0 con 0x7fba3815c180 2024-09-11T23:18:52.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.960+0000 7fba35600640 1 -- 172.21.15.144:0/4123763261 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3000aa70 con 0x7fba3815c180 2024-09-11T23:18:52.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.960+0000 7fba40600640 1 -- 172.21.15.144:0/4123763261 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba3815b190 con 0x7fba3815c180 2024-09-11T23:18:52.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.961+0000 7fba40600640 1 -- 172.21.15.144:0/4123763261 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba38071910 con 0x7fba3815c180 2024-09-11T23:18:52.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.962+0000 7fba35600640 1 -- 172.21.15.144:0/4123763261 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba3001b070 con 0x7fba3815c180 2024-09-11T23:18:52.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.963+0000 7fba35600640 1 --2- 172.21.15.144:0/4123763261 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fba1806be30 0x7fba1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:52.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.963+0000 7fba35600640 1 -- 172.21.15.144:0/4123763261 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fba3008a510 con 0x7fba3815c180 2024-09-11T23:18:52.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.963+0000 7fba3dc00640 1 --2- 172.21.15.144:0/4123763261 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fba1806be30 0x7fba1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:52.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.964+0000 7fba3dc00640 1 --2- 172.21.15.144:0/4123763261 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fba1806be30 0x7fba1806e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fba2c034000 tx=0x7fba2c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:52.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:52.967+0000 7fba35600640 1 -- 172.21.15.144:0/4123763261 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba38071910 con 0x7fba3815c180 2024-09-11T23:18:53.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.140+0000 7fba40600640 1 -- 172.21.15.144:0/4123763261 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fba380cf070 con 0x7fba1806be30 2024-09-11T23:18:53.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.147+0000 7fba35600640 1 -- 172.21.15.144:0/4123763261 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250031 (secure 0 0 0) 0x7fba380cf070 con 0x7fba1806be30 2024-09-11T23:18:53.150 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:53.151 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:18:53.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.150+0000 7fba40600640 1 -- 172.21.15.144:0/4123763261 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fba1806be30 msgr2=0x7fba1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.150+0000 7fba40600640 1 --2- 172.21.15.144:0/4123763261 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fba1806be30 0x7fba1806e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fba2c034000 tx=0x7fba2c02e000 comp rx=0 tx=0).stop 2024-09-11T23:18:53.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.150+0000 7fba40600640 1 -- 172.21.15.144:0/4123763261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba3815c180 msgr2=0x7fba3815f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.150+0000 7fba40600640 1 --2- 172.21.15.144:0/4123763261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba3815c180 0x7fba3815f8e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fba3000c7d0 tx=0x7fba3000cc90 comp rx=0 tx=0).stop 2024-09-11T23:18:53.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.151+0000 7fba40600640 1 -- 172.21.15.144:0/4123763261 shutdown_connections 2024-09-11T23:18:53.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.151+0000 7fba40600640 1 --2- 172.21.15.144:0/4123763261 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fba1806be30 0x7fba1806e2f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.151+0000 7fba40600640 1 --2- 172.21.15.144:0/4123763261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba3815c180 0x7fba3815f8e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.151+0000 7fba40600640 1 --2- 172.21.15.144:0/4123763261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba380cf5b0 0x7fba3815a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.151+0000 7fba40600640 1 --2- 172.21.15.144:0/4123763261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba380ce230 0x7fba38148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.151+0000 7fba40600640 1 -- 172.21.15.144:0/4123763261 >> 172.21.15.144:0/4123763261 conn(0x7fba38062cc0 msgr2=0x7fba380afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:53.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.151+0000 7fba40600640 1 -- 172.21.15.144:0/4123763261 shutdown_connections 2024-09-11T23:18:53.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.151+0000 7fba40600640 1 -- 172.21.15.144:0/4123763261 wait complete. 2024-09-11T23:18:53.167 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-11T23:18:51.172891+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":175,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224332,"kb_used_data":3932,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750388,"statfs":{"total":773094113280,"available":772864397312,"internally_reserved":0,"allocated":4026368,"data_stored":2256432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.190485"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028722+0000","last_change":"2024-09-11T23:18:49.023570+0000","last_active":"2024-09-11T23:18:49.028722+0000","last_peered":"2024-09-11T23:18:49.028722+0000","last_clean":"2024-09-11T23:18:49.028722+0000","last_became_active":"2024-09-11T23:18:49.022977+0000","last_became_peered":"2024-09-11T23:18:49.022977+0000","last_unstale":"2024-09-11T23:18:49.028722+0000","last_undegraded":"2024-09-11T23:18:49.028722+0000","last_fullsized":"2024-09-11T23:18:49.028722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:01.751435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T23:18:47.996504+0000","last_change":"2024-09-11T23:18:47.996504+0000","last_active":"2024-09-11T23:18:47.981836+0000","last_peered":"2024-09-11T23:18:47.981836+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.996504+0000","last_undegraded":"2024-09-11T23:18:47.996504+0000","last_fullsized":"2024-09-11T23:18:47.996504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011797+0000","last_change":"2024-09-11T23:18:49.024403+0000","last_active":"2024-09-11T23:18:50.011797+0000","last_peered":"2024-09-11T23:18:50.011797+0000","last_clean":"2024-09-11T23:18:50.011797+0000","last_became_active":"2024-09-11T23:18:49.023902+0000","last_became_peered":"2024-09-11T23:18:49.023902+0000","last_unstale":"2024-09-11T23:18:50.011797+0000","last_undegraded":"2024-09-11T23:18:50.011797+0000","last_fullsized":"2024-09-11T23:18:50.011797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:47.530225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028571+0000","last_change":"2024-09-11T23:18:49.023773+0000","last_active":"2024-09-11T23:18:49.028571+0000","last_peered":"2024-09-11T23:18:49.028571+0000","last_clean":"2024-09-11T23:18:49.028571+0000","last_became_active":"2024-09-11T23:18:49.022616+0000","last_became_peered":"2024-09-11T23:18:49.022616+0000","last_unstale":"2024-09-11T23:18:49.028571+0000","last_undegraded":"2024-09-11T23:18:49.028571+0000","last_fullsized":"2024-09-11T23:18:49.028571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:52.437981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T23:18:47.997446+0000","last_change":"2024-09-11T23:18:47.997446+0000","last_active":"2024-09-11T23:18:47.981836+0000","last_peered":"2024-09-11T23:18:47.981836+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.997446+0000","last_undegraded":"2024-09-11T23:18:47.997446+0000","last_fullsized":"2024-09-11T23:18:47.997446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T23:18:47.995254+0000","last_change":"2024-09-11T23:18:47.995254+0000","last_active":"2024-09-11T23:18:47.981836+0000","last_peered":"2024-09-11T23:18:47.981836+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.995254+0000","last_undegraded":"2024-09-11T23:18:47.995254+0000","last_fullsized":"2024-09-11T23:18:47.995254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.027054+0000","last_change":"2024-09-11T23:18:49.019807+0000","last_active":"2024-09-11T23:18:49.027054+0000","last_peered":"2024-09-11T23:18:49.027054+0000","last_clean":"2024-09-11T23:18:49.027054+0000","last_became_active":"2024-09-11T23:18:49.019507+0000","last_became_peered":"2024-09-11T23:18:49.019507+0000","last_unstale":"2024-09-11T23:18:49.027054+0000","last_undegraded":"2024-09-11T23:18:49.027054+0000","last_fullsized":"2024-09-11T23:18:49.027054+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.721415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.017203+0000","last_change":"2024-09-11T23:18:49.010390+0000","last_active":"2024-09-11T23:18:49.017203+0000","last_peered":"2024-09-11T23:18:49.017203+0000","last_clean":"2024-09-11T23:18:49.017203+0000","last_became_active":"2024-09-11T23:18:49.008190+0000","last_became_peered":"2024-09-11T23:18:49.008190+0000","last_unstale":"2024-09-11T23:18:49.017203+0000","last_undegraded":"2024-09-11T23:18:49.017203+0000","last_fullsized":"2024-09-11T23:18:49.017203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:59.469342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.013000+0000","last_change":"2024-09-11T23:18:49.011361+0000","last_active":"2024-09-11T23:18:50.013000+0000","last_peered":"2024-09-11T23:18:50.013000+0000","last_clean":"2024-09-11T23:18:50.013000+0000","last_became_active":"2024-09-11T23:18:49.011101+0000","last_became_peered":"2024-09-11T23:18:49.011101+0000","last_unstale":"2024-09-11T23:18:50.013000+0000","last_undegraded":"2024-09-11T23:18:50.013000+0000","last_fullsized":"2024-09-11T23:18:50.013000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:59.469342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028654+0000","last_change":"2024-09-11T23:18:49.025064+0000","last_active":"2024-09-11T23:18:49.028654+0000","last_peered":"2024-09-11T23:18:49.028654+0000","last_clean":"2024-09-11T23:18:49.028654+0000","last_became_active":"2024-09-11T23:18:49.024637+0000","last_became_peered":"2024-09-11T23:18:49.024637+0000","last_unstale":"2024-09-11T23:18:49.028654+0000","last_undegraded":"2024-09-11T23:18:49.028654+0000","last_fullsized":"2024-09-11T23:18:49.028654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:35.168942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028217+0000","last_change":"2024-09-11T23:18:49.023722+0000","last_active":"2024-09-11T23:18:49.028217+0000","last_peered":"2024-09-11T23:18:49.028217+0000","last_clean":"2024-09-11T23:18:49.028217+0000","last_became_active":"2024-09-11T23:18:49.022908+0000","last_became_peered":"2024-09-11T23:18:49.022908+0000","last_unstale":"2024-09-11T23:18:49.028217+0000","last_undegraded":"2024-09-11T23:18:49.028217+0000","last_fullsized":"2024-09-11T23:18:49.028217+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:36.393454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011452+0000","last_change":"2024-09-11T23:18:49.008770+0000","last_active":"2024-09-11T23:18:50.011452+0000","last_peered":"2024-09-11T23:18:50.011452+0000","last_clean":"2024-09-11T23:18:50.011452+0000","last_became_active":"2024-09-11T23:18:49.008476+0000","last_became_peered":"2024-09-11T23:18:49.008476+0000","last_unstale":"2024-09-11T23:18:50.011452+0000","last_undegraded":"2024-09-11T23:18:50.011452+0000","last_fullsized":"2024-09-11T23:18:50.011452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.721415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T23:18:47.997026+0000","last_change":"2024-09-11T23:18:47.997026+0000","last_active":"2024-09-11T23:18:47.981836+0000","last_peered":"2024-09-11T23:18:47.981836+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.997026+0000","last_undegraded":"2024-09-11T23:18:47.997026+0000","last_fullsized":"2024-09-11T23:18:47.997026+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T23:18:47.994799+0000","last_change":"2024-09-11T23:18:47.994799+0000","last_active":"2024-09-11T23:18:47.981836+0000","last_peered":"2024-09-11T23:18:47.981836+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.994799+0000","last_undegraded":"2024-09-11T23:18:47.994799+0000","last_fullsized":"2024-09-11T23:18:47.994799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012474+0000","last_change":"2024-09-11T23:18:49.010416+0000","last_active":"2024-09-11T23:18:50.012474+0000","last_peered":"2024-09-11T23:18:50.012474+0000","last_clean":"2024-09-11T23:18:50.012474+0000","last_became_active":"2024-09-11T23:18:49.010120+0000","last_became_peered":"2024-09-11T23:18:49.010120+0000","last_unstale":"2024-09-11T23:18:50.012474+0000","last_undegraded":"2024-09-11T23:18:50.012474+0000","last_fullsized":"2024-09-11T23:18:50.012474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:30.972000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.012104+0000","last_change":"2024-09-11T23:18:49.008741+0000","last_active":"2024-09-11T23:18:49.012104+0000","last_peered":"2024-09-11T23:18:49.012104+0000","last_clean":"2024-09-11T23:18:49.012104+0000","last_became_active":"2024-09-11T23:18:49.008543+0000","last_became_peered":"2024-09-11T23:18:49.008543+0000","last_unstale":"2024-09-11T23:18:49.012104+0000","last_undegraded":"2024-09-11T23:18:49.012104+0000","last_fullsized":"2024-09-11T23:18:49.012104+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:00.772427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.024083+0000","last_change":"2024-09-11T23:18:49.017267+0000","last_active":"2024-09-11T23:18:49.024083+0000","last_peered":"2024-09-11T23:18:49.024083+0000","last_clean":"2024-09-11T23:18:49.024083+0000","last_became_active":"2024-09-11T23:18:49.016994+0000","last_became_peered":"2024-09-11T23:18:49.016994+0000","last_unstale":"2024-09-11T23:18:49.024083+0000","last_undegraded":"2024-09-11T23:18:49.024083+0000","last_fullsized":"2024-09-11T23:18:49.024083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:04.572090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T23:18:47.996109+0000","last_change":"2024-09-11T23:18:47.996109+0000","last_active":"2024-09-11T23:18:47.981836+0000","last_peered":"2024-09-11T23:18:47.981836+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.996109+0000","last_undegraded":"2024-09-11T23:18:47.996109+0000","last_fullsized":"2024-09-11T23:18:47.996109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T23:18:47.995423+0000","last_change":"2024-09-11T23:18:47.995423+0000","last_active":"2024-09-11T23:18:47.981836+0000","last_peered":"2024-09-11T23:18:47.981836+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.995423+0000","last_undegraded":"2024-09-11T23:18:47.995423+0000","last_fullsized":"2024-09-11T23:18:47.995423+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T23:18:47.995838+0000","last_change":"2024-09-11T23:18:47.995838+0000","last_active":"2024-09-11T23:18:47.981836+0000","last_peered":"2024-09-11T23:18:47.981836+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.995838+0000","last_undegraded":"2024-09-11T23:18:47.995838+0000","last_fullsized":"2024-09-11T23:18:47.995838+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011922+0000","last_change":"2024-09-11T23:18:49.013009+0000","last_active":"2024-09-11T23:18:50.011922+0000","last_peered":"2024-09-11T23:18:50.011922+0000","last_clean":"2024-09-11T23:18:50.011922+0000","last_became_active":"2024-09-11T23:18:49.012755+0000","last_became_peered":"2024-09-11T23:18:49.012755+0000","last_unstale":"2024-09-11T23:18:50.011922+0000","last_undegraded":"2024-09-11T23:18:50.011922+0000","last_fullsized":"2024-09-11T23:18:50.011922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:35.168942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012053+0000","last_change":"2024-09-11T23:18:49.009624+0000","last_active":"2024-09-11T23:18:50.012053+0000","last_peered":"2024-09-11T23:18:50.012053+0000","last_clean":"2024-09-11T23:18:50.012053+0000","last_became_active":"2024-09-11T23:18:49.009160+0000","last_became_peered":"2024-09-11T23:18:49.009160+0000","last_unstale":"2024-09-11T23:18:50.012053+0000","last_undegraded":"2024-09-11T23:18:50.012053+0000","last_fullsized":"2024-09-11T23:18:50.012053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:44.169273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.021931+0000","last_change":"2024-09-11T23:18:49.016619+0000","last_active":"2024-09-11T23:18:49.021931+0000","last_peered":"2024-09-11T23:18:49.021931+0000","last_clean":"2024-09-11T23:18:49.021931+0000","last_became_active":"2024-09-11T23:18:49.016367+0000","last_became_peered":"2024-09-11T23:18:49.016367+0000","last_unstale":"2024-09-11T23:18:49.021931+0000","last_undegraded":"2024-09-11T23:18:49.021931+0000","last_fullsized":"2024-09-11T23:18:49.021931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:08.846324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011169+0000","last_change":"2024-09-11T23:18:49.012178+0000","last_active":"2024-09-11T23:18:50.011169+0000","last_peered":"2024-09-11T23:18:50.011169+0000","last_clean":"2024-09-11T23:18:50.011169+0000","last_became_active":"2024-09-11T23:18:49.008877+0000","last_became_peered":"2024-09-11T23:18:49.008877+0000","last_unstale":"2024-09-11T23:18:50.011169+0000","last_undegraded":"2024-09-11T23:18:50.011169+0000","last_fullsized":"2024-09-11T23:18:50.011169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:02.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":6,"reported_epoch":33,"state":"active","last_fresh":"2024-09-11T23:18:49.031327+0000","last_change":"2024-09-11T23:18:49.031264+0000","last_active":"2024-09-11T23:18:49.031327+0000","last_peered":"2024-09-11T23:18:49.031327+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"2024-09-11T23:18:49.031264+0000","last_became_peered":"2024-09-11T23:18:49.031264+0000","last_unstale":"2024-09-11T23:18:49.031327+0000","last_undegraded":"2024-09-11T23:18:49.031327+0000","last_fullsized":"2024-09-11T23:18:49.031327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T23:18:47.995626+0000","last_change":"2024-09-11T23:18:47.995626+0000","last_active":"2024-09-11T23:18:47.981836+0000","last_peered":"2024-09-11T23:18:47.981836+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.995626+0000","last_undegraded":"2024-09-11T23:18:47.995626+0000","last_fullsized":"2024-09-11T23:18:47.995626+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028782+0000","last_change":"2024-09-11T23:18:49.023143+0000","last_active":"2024-09-11T23:18:49.028782+0000","last_peered":"2024-09-11T23:18:49.028782+0000","last_clean":"2024-09-11T23:18:49.028782+0000","last_became_active":"2024-09-11T23:18:49.022916+0000","last_became_peered":"2024-09-11T23:18:49.022916+0000","last_unstale":"2024-09-11T23:18:49.028782+0000","last_undegraded":"2024-09-11T23:18:49.028782+0000","last_fullsized":"2024-09-11T23:18:49.028782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:42.935157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012197+0000","last_change":"2024-09-11T23:18:49.015459+0000","last_active":"2024-09-11T23:18:50.012197+0000","last_peered":"2024-09-11T23:18:50.012197+0000","last_clean":"2024-09-11T23:18:50.012197+0000","last_became_active":"2024-09-11T23:18:49.014648+0000","last_became_peered":"2024-09-11T23:18:49.014648+0000","last_unstale":"2024-09-11T23:18:50.012197+0000","last_undegraded":"2024-09-11T23:18:50.012197+0000","last_fullsized":"2024-09-11T23:18:50.012197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:49.663140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012050+0000","last_change":"2024-09-11T23:18:49.009617+0000","last_active":"2024-09-11T23:18:50.012050+0000","last_peered":"2024-09-11T23:18:50.012050+0000","last_clean":"2024-09-11T23:18:50.012050+0000","last_became_active":"2024-09-11T23:18:49.007209+0000","last_became_peered":"2024-09-11T23:18:49.007209+0000","last_unstale":"2024-09-11T23:18:50.012050+0000","last_undegraded":"2024-09-11T23:18:50.012050+0000","last_fullsized":"2024-09-11T23:18:50.012050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:20.040267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.019964+0000","last_change":"2024-09-11T23:18:49.012641+0000","last_active":"2024-09-11T23:18:49.019964+0000","last_peered":"2024-09-11T23:18:49.019964+0000","last_clean":"2024-09-11T23:18:49.019964+0000","last_became_active":"2024-09-11T23:18:49.012332+0000","last_became_peered":"2024-09-11T23:18:49.012332+0000","last_unstale":"2024-09-11T23:18:49.019964+0000","last_undegraded":"2024-09-11T23:18:49.019964+0000","last_fullsized":"2024-09-11T23:18:49.019964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:16.182623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.020434+0000","last_change":"2024-09-11T23:18:49.013323+0000","last_active":"2024-09-11T23:18:49.020434+0000","last_peered":"2024-09-11T23:18:49.020434+0000","last_clean":"2024-09-11T23:18:49.020434+0000","last_became_active":"2024-09-11T23:18:49.012492+0000","last_became_peered":"2024-09-11T23:18:49.012492+0000","last_unstale":"2024-09-11T23:18:49.020434+0000","last_undegraded":"2024-09-11T23:18:49.020434+0000","last_fullsized":"2024-09-11T23:18:49.020434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:23.411234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.019831+0000","last_change":"2024-09-11T23:18:49.014929+0000","last_active":"2024-09-11T23:18:49.019831+0000","last_peered":"2024-09-11T23:18:49.019831+0000","last_clean":"2024-09-11T23:18:49.019831+0000","last_became_active":"2024-09-11T23:18:49.014660+0000","last_became_peered":"2024-09-11T23:18:49.014660+0000","last_unstale":"2024-09-11T23:18:49.019831+0000","last_undegraded":"2024-09-11T23:18:49.019831+0000","last_fullsized":"2024-09-11T23:18:49.019831+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:05.424937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.022471+0000","last_change":"2024-09-11T23:18:49.019336+0000","last_active":"2024-09-11T23:18:49.022471+0000","last_peered":"2024-09-11T23:18:49.022471+0000","last_clean":"2024-09-11T23:18:49.022471+0000","last_became_active":"2024-09-11T23:18:49.019078+0000","last_became_peered":"2024-09-11T23:18:49.019078+0000","last_unstale":"2024-09-11T23:18:49.022471+0000","last_undegraded":"2024-09-11T23:18:49.022471+0000","last_fullsized":"2024-09-11T23:18:49.022471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:35.168942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.031200+0000","last_change":"2024-09-11T23:18:48.007751+0000","last_active":"2024-09-11T23:18:49.031200+0000","last_peered":"2024-09-11T23:18:49.031200+0000","last_clean":"2024-09-11T23:18:49.031200+0000","last_became_active":"2024-09-11T23:18:48.007453+0000","last_became_peered":"2024-09-11T23:18:48.007453+0000","last_unstale":"2024-09-11T23:18:49.031200+0000","last_undegraded":"2024-09-11T23:18:49.031200+0000","last_fullsized":"2024-09-11T23:18:49.031200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:18.222705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028706+0000","last_change":"2024-09-11T23:18:49.023248+0000","last_active":"2024-09-11T23:18:49.028706+0000","last_peered":"2024-09-11T23:18:49.028706+0000","last_clean":"2024-09-11T23:18:49.028706+0000","last_became_active":"2024-09-11T23:18:49.018856+0000","last_became_peered":"2024-09-11T23:18:49.018856+0000","last_unstale":"2024-09-11T23:18:49.028706+0000","last_undegraded":"2024-09-11T23:18:49.028706+0000","last_fullsized":"2024-09-11T23:18:49.028706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:14.448085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.024169+0000","last_change":"2024-09-11T23:18:48.015111+0000","last_active":"2024-09-11T23:18:49.024169+0000","last_peered":"2024-09-11T23:18:49.024169+0000","last_clean":"2024-09-11T23:18:49.024169+0000","last_became_active":"2024-09-11T23:18:48.014804+0000","last_became_peered":"2024-09-11T23:18:48.014804+0000","last_unstale":"2024-09-11T23:18:49.024169+0000","last_undegraded":"2024-09-11T23:18:49.024169+0000","last_fullsized":"2024-09-11T23:18:49.024169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:43.882021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012303+0000","last_change":"2024-09-11T23:18:49.008030+0000","last_active":"2024-09-11T23:18:50.012303+0000","last_peered":"2024-09-11T23:18:50.012303+0000","last_clean":"2024-09-11T23:18:50.012303+0000","last_became_active":"2024-09-11T23:18:49.007228+0000","last_became_peered":"2024-09-11T23:18:49.007228+0000","last_unstale":"2024-09-11T23:18:50.012303+0000","last_undegraded":"2024-09-11T23:18:50.012303+0000","last_fullsized":"2024-09-11T23:18:50.012303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:05.371678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T23:18:48.010963+0000","last_change":"2024-09-11T23:18:48.010963+0000","last_active":"2024-09-11T23:18:48.010963+0000","last_peered":"2024-09-11T23:18:48.010963+0000","last_clean":"2024-09-11T23:18:48.010963+0000","last_became_active":"2024-09-11T23:18:48.010705+0000","last_became_peered":"2024-09-11T23:18:48.010705+0000","last_unstale":"2024-09-11T23:18:48.010963+0000","last_undegraded":"2024-09-11T23:18:48.010963+0000","last_fullsized":"2024-09-11T23:18:48.010963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:07:26.962555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028763+0000","last_change":"2024-09-11T23:18:49.023043+0000","last_active":"2024-09-11T23:18:49.028763+0000","last_peered":"2024-09-11T23:18:49.028763+0000","last_clean":"2024-09-11T23:18:49.028763+0000","last_became_active":"2024-09-11T23:18:49.022537+0000","last_became_peered":"2024-09-11T23:18:49.022537+0000","last_unstale":"2024-09-11T23:18:49.028763+0000","last_undegraded":"2024-09-11T23:18:49.028763+0000","last_fullsized":"2024-09-11T23:18:49.028763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:01.751435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T23:18:48.012267+0000","last_change":"2024-09-11T23:18:48.012267+0000","last_active":"2024-09-11T23:18:48.012267+0000","last_peered":"2024-09-11T23:18:48.012267+0000","last_clean":"2024-09-11T23:18:48.012267+0000","last_became_active":"2024-09-11T23:18:48.011880+0000","last_became_peered":"2024-09-11T23:18:48.011880+0000","last_unstale":"2024-09-11T23:18:48.012267+0000","last_undegraded":"2024-09-11T23:18:48.012267+0000","last_fullsized":"2024-09-11T23:18:48.012267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:05.838754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.023373+0000","last_change":"2024-09-11T23:18:49.017731+0000","last_active":"2024-09-11T23:18:49.023373+0000","last_peered":"2024-09-11T23:18:49.023373+0000","last_clean":"2024-09-11T23:18:49.023373+0000","last_became_active":"2024-09-11T23:18:49.017469+0000","last_became_peered":"2024-09-11T23:18:49.017469+0000","last_unstale":"2024-09-11T23:18:49.023373+0000","last_undegraded":"2024-09-11T23:18:49.023373+0000","last_fullsized":"2024-09-11T23:18:49.023373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:18.200252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012044+0000","last_change":"2024-09-11T23:18:48.011580+0000","last_active":"2024-09-11T23:18:50.012044+0000","last_peered":"2024-09-11T23:18:50.012044+0000","last_clean":"2024-09-11T23:18:50.012044+0000","last_became_active":"2024-09-11T23:18:48.011045+0000","last_became_peered":"2024-09-11T23:18:48.011045+0000","last_unstale":"2024-09-11T23:18:50.012044+0000","last_undegraded":"2024-09-11T23:18:50.012044+0000","last_fullsized":"2024-09-11T23:18:50.012044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:18.496309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011199+0000","last_change":"2024-09-11T23:18:49.015000+0000","last_active":"2024-09-11T23:18:50.011199+0000","last_peered":"2024-09-11T23:18:50.011199+0000","last_clean":"2024-09-11T23:18:50.011199+0000","last_became_active":"2024-09-11T23:18:49.014091+0000","last_became_peered":"2024-09-11T23:18:49.014091+0000","last_unstale":"2024-09-11T23:18:50.011199+0000","last_undegraded":"2024-09-11T23:18:50.011199+0000","last_fullsized":"2024-09-11T23:18:50.011199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:31.695691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012184+0000","last_change":"2024-09-11T23:18:48.009914+0000","last_active":"2024-09-11T23:18:50.012184+0000","last_peered":"2024-09-11T23:18:50.012184+0000","last_clean":"2024-09-11T23:18:50.012184+0000","last_became_active":"2024-09-11T23:18:48.007555+0000","last_became_peered":"2024-09-11T23:18:48.007555+0000","last_unstale":"2024-09-11T23:18:50.012184+0000","last_undegraded":"2024-09-11T23:18:50.012184+0000","last_fullsized":"2024-09-11T23:18:50.012184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:11.259384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011290+0000","last_change":"2024-09-11T23:18:49.006529+0000","last_active":"2024-09-11T23:18:50.011290+0000","last_peered":"2024-09-11T23:18:50.011290+0000","last_clean":"2024-09-11T23:18:50.011290+0000","last_became_active":"2024-09-11T23:18:49.006239+0000","last_became_peered":"2024-09-11T23:18:49.006239+0000","last_unstale":"2024-09-11T23:18:50.011290+0000","last_undegraded":"2024-09-11T23:18:50.011290+0000","last_fullsized":"2024-09-11T23:18:50.011290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:52.437981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-11T23:18:48.008910+0000","last_change":"2024-09-11T23:18:48.005888+0000","last_active":"2024-09-11T23:18:48.008910+0000","last_peered":"2024-09-11T23:18:48.008910+0000","last_clean":"2024-09-11T23:18:48.008910+0000","last_became_active":"2024-09-11T23:18:48.005594+0000","last_became_peered":"2024-09-11T23:18:48.005594+0000","last_unstale":"2024-09-11T23:18:48.008910+0000","last_undegraded":"2024-09-11T23:18:48.008910+0000","last_fullsized":"2024-09-11T23:18:48.008910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:08.277108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.027881+0000","last_change":"2024-09-11T23:18:49.022786+0000","last_active":"2024-09-11T23:18:49.027881+0000","last_peered":"2024-09-11T23:18:49.027881+0000","last_clean":"2024-09-11T23:18:49.027881+0000","last_became_active":"2024-09-11T23:18:49.022512+0000","last_became_peered":"2024-09-11T23:18:49.022512+0000","last_unstale":"2024-09-11T23:18:49.027881+0000","last_undegraded":"2024-09-11T23:18:49.027881+0000","last_fullsized":"2024-09-11T23:18:49.027881+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:14.448085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011412+0000","last_change":"2024-09-11T23:18:48.001028+0000","last_active":"2024-09-11T23:18:50.011412+0000","last_peered":"2024-09-11T23:18:50.011412+0000","last_clean":"2024-09-11T23:18:50.011412+0000","last_became_active":"2024-09-11T23:18:48.000366+0000","last_became_peered":"2024-09-11T23:18:48.000366+0000","last_unstale":"2024-09-11T23:18:50.011412+0000","last_undegraded":"2024-09-11T23:18:50.011412+0000","last_fullsized":"2024-09-11T23:18:50.011412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:21.206250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011482+0000","last_change":"2024-09-11T23:18:49.010058+0000","last_active":"2024-09-11T23:18:50.011482+0000","last_peered":"2024-09-11T23:18:50.011482+0000","last_clean":"2024-09-11T23:18:50.011482+0000","last_became_active":"2024-09-11T23:18:49.007625+0000","last_became_peered":"2024-09-11T23:18:49.007625+0000","last_unstale":"2024-09-11T23:18:50.011482+0000","last_undegraded":"2024-09-11T23:18:50.011482+0000","last_fullsized":"2024-09-11T23:18:50.011482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:36.393454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":3,"reported_epoch":32,"state":"creating+activating","last_fresh":"2024-09-11T23:18:47.997661+0000","last_change":"2024-09-11T23:18:47.997661+0000","last_active":"2024-09-11T23:18:46.978874+0000","last_peered":"2024-09-11T23:18:46.978874+0000","last_clean":"2024-09-11T23:18:46.978874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.997661+0000","last_undegraded":"2024-09-11T23:18:47.997661+0000","last_fullsized":"2024-09-11T23:18:47.997661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T23:18:48.000767+0000","last_change":"2024-09-11T23:18:48.000767+0000","last_active":"2024-09-11T23:18:47.981836+0000","last_peered":"2024-09-11T23:18:47.981836+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:48.000767+0000","last_undegraded":"2024-09-11T23:18:48.000767+0000","last_fullsized":"2024-09-11T23:18:48.000767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.002487+0000","last_change":"2024-09-11T23:18:48.011655+0000","last_active":"2024-09-11T23:18:49.002487+0000","last_peered":"2024-09-11T23:18:49.002487+0000","last_clean":"2024-09-11T23:18:49.002487+0000","last_became_active":"2024-09-11T23:18:48.008273+0000","last_became_peered":"2024-09-11T23:18:48.008273+0000","last_unstale":"2024-09-11T23:18:49.002487+0000","last_undegraded":"2024-09-11T23:18:49.002487+0000","last_fullsized":"2024-09-11T23:18:49.002487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:51.349730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T23:18:47.997321+0000","last_change":"2024-09-11T23:18:47.997321+0000","last_active":"2024-09-11T23:18:47.981836+0000","last_peered":"2024-09-11T23:18:47.981836+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.997321+0000","last_undegraded":"2024-09-11T23:18:47.997321+0000","last_fullsized":"2024-09-11T23:18:47.997321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011904+0000","last_change":"2024-09-11T23:18:48.011616+0000","last_active":"2024-09-11T23:18:50.011904+0000","last_peered":"2024-09-11T23:18:50.011904+0000","last_clean":"2024-09-11T23:18:50.011904+0000","last_became_active":"2024-09-11T23:18:48.011108+0000","last_became_peered":"2024-09-11T23:18:48.011108+0000","last_unstale":"2024-09-11T23:18:50.011904+0000","last_undegraded":"2024-09-11T23:18:50.011904+0000","last_fullsized":"2024-09-11T23:18:50.011904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:34.165980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011637+0000","last_change":"2024-09-11T23:18:49.024580+0000","last_active":"2024-09-11T23:18:50.011637+0000","last_peered":"2024-09-11T23:18:50.011637+0000","last_clean":"2024-09-11T23:18:50.011637+0000","last_became_active":"2024-09-11T23:18:49.024279+0000","last_became_peered":"2024-09-11T23:18:49.024279+0000","last_unstale":"2024-09-11T23:18:50.011637+0000","last_undegraded":"2024-09-11T23:18:50.011637+0000","last_fullsized":"2024-09-11T23:18:50.011637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:22.301700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":3,"reported_epoch":32,"state":"creating+activating","last_fresh":"2024-09-11T23:18:47.996965+0000","last_change":"2024-09-11T23:18:47.996965+0000","last_active":"2024-09-11T23:18:46.978874+0000","last_peered":"2024-09-11T23:18:46.978874+0000","last_clean":"2024-09-11T23:18:46.978874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.996965+0000","last_undegraded":"2024-09-11T23:18:47.996965+0000","last_fullsized":"2024-09-11T23:18:47.996965+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.017286+0000","last_change":"2024-09-11T23:18:49.012373+0000","last_active":"2024-09-11T23:18:49.017286+0000","last_peered":"2024-09-11T23:18:49.017286+0000","last_clean":"2024-09-11T23:18:49.017286+0000","last_became_active":"2024-09-11T23:18:49.011979+0000","last_became_peered":"2024-09-11T23:18:49.011979+0000","last_unstale":"2024-09-11T23:18:49.017286+0000","last_undegraded":"2024-09-11T23:18:49.017286+0000","last_fullsized":"2024-09-11T23:18:49.017286+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:44.884982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012156+0000","last_change":"2024-09-11T23:18:48.002333+0000","last_active":"2024-09-11T23:18:50.012156+0000","last_peered":"2024-09-11T23:18:50.012156+0000","last_clean":"2024-09-11T23:18:50.012156+0000","last_became_active":"2024-09-11T23:18:48.001101+0000","last_became_peered":"2024-09-11T23:18:48.001101+0000","last_unstale":"2024-09-11T23:18:50.012156+0000","last_undegraded":"2024-09-11T23:18:50.012156+0000","last_fullsized":"2024-09-11T23:18:50.012156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:30.420649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T23:18:47.998874+0000","last_change":"2024-09-11T23:18:47.998874+0000","last_active":"2024-09-11T23:18:47.981836+0000","last_peered":"2024-09-11T23:18:47.981836+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.998874+0000","last_undegraded":"2024-09-11T23:18:47.998874+0000","last_fullsized":"2024-09-11T23:18:47.998874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.011178+0000","last_change":"2024-09-11T23:18:48.010282+0000","last_active":"2024-09-11T23:18:49.011178+0000","last_peered":"2024-09-11T23:18:49.011178+0000","last_clean":"2024-09-11T23:18:49.011178+0000","last_became_active":"2024-09-11T23:18:48.007053+0000","last_became_peered":"2024-09-11T23:18:48.007053+0000","last_unstale":"2024-09-11T23:18:49.011178+0000","last_undegraded":"2024-09-11T23:18:49.011178+0000","last_fullsized":"2024-09-11T23:18:49.011178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:18.309385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.026361+0000","last_change":"2024-09-11T23:18:49.019508+0000","last_active":"2024-09-11T23:18:49.026361+0000","last_peered":"2024-09-11T23:18:49.026361+0000","last_clean":"2024-09-11T23:18:49.026361+0000","last_became_active":"2024-09-11T23:18:49.019067+0000","last_became_peered":"2024-09-11T23:18:49.019067+0000","last_unstale":"2024-09-11T23:18:49.026361+0000","last_undegraded":"2024-09-11T23:18:49.026361+0000","last_fullsized":"2024-09-11T23:18:49.026361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:31.695691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":3,"reported_epoch":32,"state":"creating+activating","last_fresh":"2024-09-11T23:18:47.993704+0000","last_change":"2024-09-11T23:18:47.993704+0000","last_active":"2024-09-11T23:18:46.978874+0000","last_peered":"2024-09-11T23:18:46.978874+0000","last_clean":"2024-09-11T23:18:46.978874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.993704+0000","last_undegraded":"2024-09-11T23:18:47.993704+0000","last_fullsized":"2024-09-11T23:18:47.993704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.023632+0000","last_change":"2024-09-11T23:18:49.017642+0000","last_active":"2024-09-11T23:18:49.023632+0000","last_peered":"2024-09-11T23:18:49.023632+0000","last_clean":"2024-09-11T23:18:49.023632+0000","last_became_active":"2024-09-11T23:18:49.017344+0000","last_became_peered":"2024-09-11T23:18:49.017344+0000","last_unstale":"2024-09-11T23:18:49.023632+0000","last_undegraded":"2024-09-11T23:18:49.023632+0000","last_fullsized":"2024-09-11T23:18:49.023632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:52.352691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":3,"reported_epoch":32,"state":"creating+activating","last_fresh":"2024-09-11T23:18:47.993505+0000","last_change":"2024-09-11T23:18:47.993505+0000","last_active":"2024-09-11T23:18:46.978874+0000","last_peered":"2024-09-11T23:18:46.978874+0000","last_clean":"2024-09-11T23:18:46.978874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.993505+0000","last_undegraded":"2024-09-11T23:18:47.993505+0000","last_fullsized":"2024-09-11T23:18:47.993505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012770+0000","last_change":"2024-09-11T23:18:49.015641+0000","last_active":"2024-09-11T23:18:50.012770+0000","last_peered":"2024-09-11T23:18:50.012770+0000","last_clean":"2024-09-11T23:18:50.012770+0000","last_became_active":"2024-09-11T23:18:49.014210+0000","last_became_peered":"2024-09-11T23:18:49.014210+0000","last_unstale":"2024-09-11T23:18:50.012770+0000","last_undegraded":"2024-09-11T23:18:50.012770+0000","last_fullsized":"2024-09-11T23:18:50.012770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:00.772427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.031601+0000","last_change":"2024-09-11T23:18:48.013143+0000","last_active":"2024-09-11T23:18:49.031601+0000","last_peered":"2024-09-11T23:18:49.031601+0000","last_clean":"2024-09-11T23:18:49.031601+0000","last_became_active":"2024-09-11T23:18:48.012875+0000","last_became_peered":"2024-09-11T23:18:48.012875+0000","last_unstale":"2024-09-11T23:18:49.031601+0000","last_undegraded":"2024-09-11T23:18:49.031601+0000","last_fullsized":"2024-09-11T23:18:49.031601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:43.166311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011688+0000","last_change":"2024-09-11T23:18:49.006253+0000","last_active":"2024-09-11T23:18:50.011688+0000","last_peered":"2024-09-11T23:18:50.011688+0000","last_clean":"2024-09-11T23:18:50.011688+0000","last_became_active":"2024-09-11T23:18:49.004054+0000","last_became_peered":"2024-09-11T23:18:49.004054+0000","last_unstale":"2024-09-11T23:18:50.011688+0000","last_undegraded":"2024-09-11T23:18:50.011688+0000","last_fullsized":"2024-09-11T23:18:50.011688+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:18.145725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012844+0000","last_change":"2024-09-11T23:18:48.001857+0000","last_active":"2024-09-11T23:18:50.012844+0000","last_peered":"2024-09-11T23:18:50.012844+0000","last_clean":"2024-09-11T23:18:50.012844+0000","last_became_active":"2024-09-11T23:18:48.001543+0000","last_became_peered":"2024-09-11T23:18:48.001543+0000","last_unstale":"2024-09-11T23:18:50.012844+0000","last_undegraded":"2024-09-11T23:18:50.012844+0000","last_fullsized":"2024-09-11T23:18:50.012844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:14.102475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028592+0000","last_change":"2024-09-11T23:18:49.024287+0000","last_active":"2024-09-11T23:18:49.028592+0000","last_peered":"2024-09-11T23:18:49.028592+0000","last_clean":"2024-09-11T23:18:49.028592+0000","last_became_active":"2024-09-11T23:18:49.022965+0000","last_became_peered":"2024-09-11T23:18:49.022965+0000","last_unstale":"2024-09-11T23:18:49.028592+0000","last_undegraded":"2024-09-11T23:18:49.028592+0000","last_fullsized":"2024-09-11T23:18:49.028592+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:08.846324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012525+0000","last_change":"2024-09-11T23:18:48.004742+0000","last_active":"2024-09-11T23:18:50.012525+0000","last_peered":"2024-09-11T23:18:50.012525+0000","last_clean":"2024-09-11T23:18:50.012525+0000","last_became_active":"2024-09-11T23:18:48.004317+0000","last_became_peered":"2024-09-11T23:18:48.004317+0000","last_unstale":"2024-09-11T23:18:50.012525+0000","last_undegraded":"2024-09-11T23:18:50.012525+0000","last_fullsized":"2024-09-11T23:18:50.012525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:14.500017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T23:18:47.996547+0000","last_change":"2024-09-11T23:18:47.996547+0000","last_active":"2024-09-11T23:18:47.981836+0000","last_peered":"2024-09-11T23:18:47.981836+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.996547+0000","last_undegraded":"2024-09-11T23:18:47.996547+0000","last_fullsized":"2024-09-11T23:18:47.996547+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012482+0000","last_change":"2024-09-11T23:18:48.004710+0000","last_active":"2024-09-11T23:18:50.012482+0000","last_peered":"2024-09-11T23:18:50.012482+0000","last_clean":"2024-09-11T23:18:50.012482+0000","last_became_active":"2024-09-11T23:18:48.004396+0000","last_became_peered":"2024-09-11T23:18:48.004396+0000","last_unstale":"2024-09-11T23:18:50.012482+0000","last_undegraded":"2024-09-11T23:18:50.012482+0000","last_fullsized":"2024-09-11T23:18:50.012482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:58.115645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T23:18:47.997404+0000","last_change":"2024-09-11T23:18:47.997404+0000","last_active":"2024-09-11T23:18:47.981836+0000","last_peered":"2024-09-11T23:18:47.981836+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.997404+0000","last_undegraded":"2024-09-11T23:18:47.997404+0000","last_fullsized":"2024-09-11T23:18:47.997404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.005713+0000","last_change":"2024-09-11T23:18:48.009114+0000","last_active":"2024-09-11T23:18:49.005713+0000","last_peered":"2024-09-11T23:18:49.005713+0000","last_clean":"2024-09-11T23:18:49.005713+0000","last_became_active":"2024-09-11T23:18:48.008595+0000","last_became_peered":"2024-09-11T23:18:48.008595+0000","last_unstale":"2024-09-11T23:18:49.005713+0000","last_undegraded":"2024-09-11T23:18:49.005713+0000","last_fullsized":"2024-09-11T23:18:49.005713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:41.932196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T23:18:47.996566+0000","last_change":"2024-09-11T23:18:47.996566+0000","last_active":"2024-09-11T23:18:47.981836+0000","last_peered":"2024-09-11T23:18:47.981836+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.996566+0000","last_undegraded":"2024-09-11T23:18:47.996566+0000","last_fullsized":"2024-09-11T23:18:47.996566+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.003131+0000","last_change":"2024-09-11T23:18:48.014456+0000","last_active":"2024-09-11T23:18:49.003131+0000","last_peered":"2024-09-11T23:18:49.003131+0000","last_clean":"2024-09-11T23:18:49.003131+0000","last_became_active":"2024-09-11T23:18:48.014078+0000","last_became_peered":"2024-09-11T23:18:48.014078+0000","last_unstale":"2024-09-11T23:18:49.003131+0000","last_undegraded":"2024-09-11T23:18:49.003131+0000","last_fullsized":"2024-09-11T23:18:49.003131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:18.309385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T23:18:47.998573+0000","last_change":"2024-09-11T23:18:47.998573+0000","last_active":"2024-09-11T23:18:47.981836+0000","last_peered":"2024-09-11T23:18:47.981836+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.998573+0000","last_undegraded":"2024-09-11T23:18:47.998573+0000","last_fullsized":"2024-09-11T23:18:47.998573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011799+0000","last_change":"2024-09-11T23:18:48.003928+0000","last_active":"2024-09-11T23:18:50.011799+0000","last_peered":"2024-09-11T23:18:50.011799+0000","last_clean":"2024-09-11T23:18:50.011799+0000","last_became_active":"2024-09-11T23:18:48.003048+0000","last_became_peered":"2024-09-11T23:18:48.003048+0000","last_unstale":"2024-09-11T23:18:50.011799+0000","last_undegraded":"2024-09-11T23:18:50.011799+0000","last_fullsized":"2024-09-11T23:18:50.011799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:37.584863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.024045+0000","last_change":"2024-09-11T23:18:49.013365+0000","last_active":"2024-09-11T23:18:49.024045+0000","last_peered":"2024-09-11T23:18:49.024045+0000","last_clean":"2024-09-11T23:18:49.024045+0000","last_became_active":"2024-09-11T23:18:49.013014+0000","last_became_peered":"2024-09-11T23:18:49.013014+0000","last_unstale":"2024-09-11T23:18:49.024045+0000","last_undegraded":"2024-09-11T23:18:49.024045+0000","last_fullsized":"2024-09-11T23:18:49.024045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:02.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011282+0000","last_change":"2024-09-11T23:18:48.013115+0000","last_active":"2024-09-11T23:18:50.011282+0000","last_peered":"2024-09-11T23:18:50.011282+0000","last_clean":"2024-09-11T23:18:50.011282+0000","last_became_active":"2024-09-11T23:18:48.012783+0000","last_became_peered":"2024-09-11T23:18:48.012783+0000","last_unstale":"2024-09-11T23:18:50.011282+0000","last_undegraded":"2024-09-11T23:18:50.011282+0000","last_fullsized":"2024-09-11T23:18:50.011282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:07.843362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T23:18:48.001000+0000","last_change":"2024-09-11T23:18:48.001000+0000","last_active":"2024-09-11T23:18:47.981836+0000","last_peered":"2024-09-11T23:18:47.981836+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:48.001000+0000","last_undegraded":"2024-09-11T23:18:48.001000+0000","last_fullsized":"2024-09-11T23:18:48.001000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.031657+0000","last_change":"2024-09-11T23:18:48.009617+0000","last_active":"2024-09-11T23:18:49.031657+0000","last_peered":"2024-09-11T23:18:49.031657+0000","last_clean":"2024-09-11T23:18:49.031657+0000","last_became_active":"2024-09-11T23:18:48.009195+0000","last_became_peered":"2024-09-11T23:18:48.009195+0000","last_unstale":"2024-09-11T23:18:49.031657+0000","last_undegraded":"2024-09-11T23:18:49.031657+0000","last_fullsized":"2024-09-11T23:18:49.031657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:19.037305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011847+0000","last_change":"2024-09-11T23:18:49.012656+0000","last_active":"2024-09-11T23:18:50.011847+0000","last_peered":"2024-09-11T23:18:50.011847+0000","last_clean":"2024-09-11T23:18:50.011847+0000","last_became_active":"2024-09-11T23:18:49.012305+0000","last_became_peered":"2024-09-11T23:18:49.012305+0000","last_unstale":"2024-09-11T23:18:50.011847+0000","last_undegraded":"2024-09-11T23:18:50.011847+0000","last_fullsized":"2024-09-11T23:18:50.011847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:46.582189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.002677+0000","last_change":"2024-09-11T23:18:48.005217+0000","last_active":"2024-09-11T23:18:49.002677+0000","last_peered":"2024-09-11T23:18:49.002677+0000","last_clean":"2024-09-11T23:18:49.002677+0000","last_became_active":"2024-09-11T23:18:48.004931+0000","last_became_peered":"2024-09-11T23:18:48.004931+0000","last_unstale":"2024-09-11T23:18:49.002677+0000","last_undegraded":"2024-09-11T23:18:49.002677+0000","last_fullsized":"2024-09-11T23:18:49.002677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:13.445123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.027344+0000","last_change":"2024-09-11T23:18:49.027344+0000","last_active":"2024-09-11T23:18:49.027344+0000","last_peered":"2024-09-11T23:18:49.027344+0000","last_clean":"2024-09-11T23:18:49.027344+0000","last_became_active":"2024-09-11T23:18:49.027022+0000","last_became_peered":"2024-09-11T23:18:49.027022+0000","last_unstale":"2024-09-11T23:18:49.027344+0000","last_undegraded":"2024-09-11T23:18:49.027344+0000","last_fullsized":"2024-09-11T23:18:49.027344+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:44.169273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.015580+0000","last_change":"2024-09-11T23:18:48.011606+0000","last_active":"2024-09-11T23:18:49.015580+0000","last_peered":"2024-09-11T23:18:49.015580+0000","last_clean":"2024-09-11T23:18:49.015580+0000","last_became_active":"2024-09-11T23:18:48.011355+0000","last_became_peered":"2024-09-11T23:18:48.011355+0000","last_unstale":"2024-09-11T23:18:49.015580+0000","last_undegraded":"2024-09-11T23:18:49.015580+0000","last_fullsized":"2024-09-11T23:18:49.015580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:51.349730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.020551+0000","last_change":"2024-09-11T23:18:49.014470+0000","last_active":"2024-09-11T23:18:49.020551+0000","last_peered":"2024-09-11T23:18:49.020551+0000","last_clean":"2024-09-11T23:18:49.020551+0000","last_became_active":"2024-09-11T23:18:49.013737+0000","last_became_peered":"2024-09-11T23:18:49.013737+0000","last_unstale":"2024-09-11T23:18:49.020551+0000","last_undegraded":"2024-09-11T23:18:49.020551+0000","last_fullsized":"2024-09-11T23:18:49.020551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:44.884982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.005691+0000","last_change":"2024-09-11T23:18:48.006018+0000","last_active":"2024-09-11T23:18:49.005691+0000","last_peered":"2024-09-11T23:18:49.005691+0000","last_clean":"2024-09-11T23:18:49.005691+0000","last_became_active":"2024-09-11T23:18:48.005721+0000","last_became_peered":"2024-09-11T23:18:48.005721+0000","last_unstale":"2024-09-11T23:18:49.005691+0000","last_undegraded":"2024-09-11T23:18:49.005691+0000","last_fullsized":"2024-09-11T23:18:49.005691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:00.748473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.016200+0000","last_change":"2024-09-11T23:18:49.010494+0000","last_active":"2024-09-11T23:18:49.016200+0000","last_peered":"2024-09-11T23:18:49.016200+0000","last_clean":"2024-09-11T23:18:49.016200+0000","last_became_active":"2024-09-11T23:18:49.010206+0000","last_became_peered":"2024-09-11T23:18:49.010206+0000","last_unstale":"2024-09-11T23:18:49.016200+0000","last_undegraded":"2024-09-11T23:18:49.016200+0000","last_fullsized":"2024-09-11T23:18:49.016200+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:52.437981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.011307+0000","last_change":"2024-09-11T23:18:48.012601+0000","last_active":"2024-09-11T23:18:49.011307+0000","last_peered":"2024-09-11T23:18:49.011307+0000","last_clean":"2024-09-11T23:18:49.011307+0000","last_became_active":"2024-09-11T23:18:48.010086+0000","last_became_peered":"2024-09-11T23:18:48.010086+0000","last_unstale":"2024-09-11T23:18:49.011307+0000","last_undegraded":"2024-09-11T23:18:49.011307+0000","last_fullsized":"2024-09-11T23:18:49.011307+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:22.408272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-11T23:18:47.993906+0000","last_change":"2024-09-11T23:18:47.993906+0000","last_active":"2024-09-11T23:18:47.981836+0000","last_peered":"2024-09-11T23:18:47.981836+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.993906+0000","last_undegraded":"2024-09-11T23:18:47.993906+0000","last_fullsized":"2024-09-11T23:18:47.993906+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012956+0000","last_change":"2024-09-11T23:18:48.000946+0000","last_active":"2024-09-11T23:18:50.012956+0000","last_peered":"2024-09-11T23:18:50.012956+0000","last_clean":"2024-09-11T23:18:50.012956+0000","last_became_active":"2024-09-11T23:18:48.000299+0000","last_became_peered":"2024-09-11T23:18:48.000299+0000","last_unstale":"2024-09-11T23:18:50.012956+0000","last_undegraded":"2024-09-11T23:18:50.012956+0000","last_fullsized":"2024-09-11T23:18:50.012956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:19.403184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011694+0000","last_change":"2024-09-11T23:18:49.000439+0000","last_active":"2024-09-11T23:18:50.011694+0000","last_peered":"2024-09-11T23:18:50.011694+0000","last_clean":"2024-09-11T23:18:50.011694+0000","last_became_active":"2024-09-11T23:18:49.000122+0000","last_became_peered":"2024-09-11T23:18:49.000122+0000","last_unstale":"2024-09-11T23:18:50.011694+0000","last_undegraded":"2024-09-11T23:18:50.011694+0000","last_fullsized":"2024-09-11T23:18:50.011694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:08.846324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":3,"reported_epoch":32,"state":"creating+activating","last_fresh":"2024-09-11T23:18:47.993174+0000","last_change":"2024-09-11T23:18:47.993174+0000","last_active":"2024-09-11T23:18:46.978874+0000","last_peered":"2024-09-11T23:18:46.978874+0000","last_clean":"2024-09-11T23:18:46.978874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:18:47.993174+0000","last_undegraded":"2024-09-11T23:18:47.993174+0000","last_fullsized":"2024-09-11T23:18:47.993174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.020509+0000","last_change":"2024-09-11T23:18:49.012546+0000","last_active":"2024-09-11T23:18:49.020509+0000","last_peered":"2024-09-11T23:18:49.020509+0000","last_clean":"2024-09-11T23:18:49.020509+0000","last_became_active":"2024-09-11T23:18:49.012189+0000","last_became_peered":"2024-09-11T23:18:49.012189+0000","last_unstale":"2024-09-11T23:18:49.020509+0000","last_undegraded":"2024-09-11T23:18:49.020509+0000","last_fullsized":"2024-09-11T23:18:49.020509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:49.321225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:48.999430+0000","last_change":"2024-09-11T23:18:48.008963+0000","last_active":"2024-09-11T23:18:48.999430+0000","last_peered":"2024-09-11T23:18:48.999430+0000","last_clean":"2024-09-11T23:18:48.999430+0000","last_became_active":"2024-09-11T23:18:48.008162+0000","last_became_peered":"2024-09-11T23:18:48.008162+0000","last_unstale":"2024-09-11T23:18:48.999430+0000","last_undegraded":"2024-09-11T23:18:48.999430+0000","last_fullsized":"2024-09-11T23:18:48.999430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:30.420649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":189,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.000785+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:18:49.000785+0000","last_peered":"2024-09-11T23:18:49.000785+0000","last_clean":"2024-09-11T23:18:49.000785+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:18:49.000785+0000","last_undegraded":"2024-09-11T23:18:49.000785+0000","last_fullsized":"2024-09-11T23:18:49.000785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476753,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":729689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476752,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":139847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476751,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":139903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476751,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":368640,"data_stored":139335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":348160,"data_stored":132456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":942080,"data_stored":722824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":335872,"data_stored":126189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":335872,"data_stored":126189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:18:53.172 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:18:53.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.360+0000 7ff6eb600640 1 Processor -- start 2024-09-11T23:18:53.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.360+0000 7ff6eb600640 1 -- start start 2024-09-11T23:18:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.361+0000 7ff6eb600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff6e40d02a0 0x7ff6e40d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.361+0000 7ff6eb600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e415ca40 0x7ff6e415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.361+0000 7ff6eb600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff6e415ce80 0x7ff6e41594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.361+0000 7ff6eb600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e40d0bc0 con 0x7ff6e40d02a0 2024-09-11T23:18:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.361+0000 7ff6eb600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e415d390 con 0x7ff6e415ce80 2024-09-11T23:18:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.361+0000 7ff6eb600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e415d670 con 0x7ff6e415ca40 2024-09-11T23:18:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.362+0000 7ff6e8c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff6e40d02a0 0x7ff6e40d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.362+0000 7ff6e8c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff6e40d02a0 0x7ff6e40d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50100/0 (socket says 172.21.15.144:50100) 2024-09-11T23:18:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.362+0000 7ff6e8c00640 1 -- 172.21.15.144:0/1336229881 learned_addr learned my addr 172.21.15.144:0/1336229881 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.362+0000 7ff6e3e00640 1 --2- 172.21.15.144:0/1336229881 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e415ca40 0x7ff6e415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.362+0000 7ff6e9600640 1 --2- 172.21.15.144:0/1336229881 >> v2:172.21.15.165:3300/0 conn(0x7ff6e415ce80 0x7ff6e41594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.362+0000 7ff6e8c00640 1 -- 172.21.15.144:0/1336229881 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e415ca40 msgr2=0x7ff6e415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.362+0000 7ff6e8c00640 1 --2- 172.21.15.144:0/1336229881 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e415ca40 0x7ff6e415e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.362+0000 7ff6e8c00640 1 -- 172.21.15.144:0/1336229881 >> v2:172.21.15.165:3300/0 conn(0x7ff6e415ce80 msgr2=0x7ff6e41594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.362+0000 7ff6e8c00640 1 --2- 172.21.15.144:0/1336229881 >> v2:172.21.15.165:3300/0 conn(0x7ff6e415ce80 0x7ff6e41594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.362+0000 7ff6e8c00640 1 -- 172.21.15.144:0/1336229881 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e415d950 con 0x7ff6e40d02a0 2024-09-11T23:18:53.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.363+0000 7ff6e8c00640 1 --2- 172.21.15.144:0/1336229881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6e40d02a0 0x7ff6e40d0680 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff6e406cd20 tx=0x7ff6d802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294fa11eb077dbfd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:53.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.363+0000 7ff6e3400640 1 -- 172.21.15.144:0/1336229881 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8037070 con 0x7ff6e40d02a0 2024-09-11T23:18:53.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.363+0000 7ff6e3400640 1 -- 172.21.15.144:0/1336229881 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d8032440 con 0x7ff6e40d02a0 2024-09-11T23:18:53.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.363+0000 7ff6e3400640 1 -- 172.21.15.144:0/1336229881 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8032810 con 0x7ff6e40d02a0 2024-09-11T23:18:53.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.364+0000 7ff6eb600640 1 -- 172.21.15.144:0/1336229881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6e40d02a0 msgr2=0x7ff6e40d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.364+0000 7ff6eb600640 1 --2- 172.21.15.144:0/1336229881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6e40d02a0 0x7ff6e40d0680 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff6e406cd20 tx=0x7ff6d802a140 comp rx=0 tx=0).stop 2024-09-11T23:18:53.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.364+0000 7ff6eb600640 1 -- 172.21.15.144:0/1336229881 shutdown_connections 2024-09-11T23:18:53.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.364+0000 7ff6eb600640 1 --2- 172.21.15.144:0/1336229881 >> v2:172.21.15.165:3300/0 conn(0x7ff6e415ce80 0x7ff6e41594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.364+0000 7ff6eb600640 1 --2- 172.21.15.144:0/1336229881 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e415ca40 0x7ff6e415e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.364+0000 7ff6eb600640 1 --2- 172.21.15.144:0/1336229881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6e40d02a0 0x7ff6e40d0680 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.364+0000 7ff6eb600640 1 -- 172.21.15.144:0/1336229881 >> 172.21.15.144:0/1336229881 conn(0x7ff6e4062cc0 msgr2=0x7ff6e406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:53.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.364+0000 7ff6eb600640 1 -- 172.21.15.144:0/1336229881 shutdown_connections 2024-09-11T23:18:53.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.364+0000 7ff6eb600640 1 -- 172.21.15.144:0/1336229881 wait complete. 2024-09-11T23:18:53.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.366+0000 7ff6eb600640 1 Processor -- start 2024-09-11T23:18:53.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.366+0000 7ff6eb600640 1 -- start start 2024-09-11T23:18:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.367+0000 7ff6eb600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6e40d02a0 0x7ff6e414cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.367+0000 7ff6eb600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e415ca40 0x7ff6e40ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.367+0000 7ff6eb600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6e415ce80 0x7ff6e40aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.367+0000 7ff6eb600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e4155b90 con 0x7ff6e40d02a0 2024-09-11T23:18:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.367+0000 7ff6eb600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e415df10 con 0x7ff6e415ce80 2024-09-11T23:18:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.367+0000 7ff6eb600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e4155d10 con 0x7ff6e415ca40 2024-09-11T23:18:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.367+0000 7ff6e8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6e40d02a0 0x7ff6e414cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.367+0000 7ff6e8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6e40d02a0 0x7ff6e414cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50114/0 (socket says 172.21.15.144:50114) 2024-09-11T23:18:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.367+0000 7ff6e8c00640 1 -- 172.21.15.144:0/533489194 learned_addr learned my addr 172.21.15.144:0/533489194 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.367+0000 7ff6e9600640 1 --2- 172.21.15.144:0/533489194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6e415ce80 0x7ff6e40aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.367+0000 7ff6e3e00640 1 --2- 172.21.15.144:0/533489194 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e415ca40 0x7ff6e40ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.367+0000 7ff6e8c00640 1 -- 172.21.15.144:0/533489194 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e415ca40 msgr2=0x7ff6e40ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.367+0000 7ff6e8c00640 1 --2- 172.21.15.144:0/533489194 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e415ca40 0x7ff6e40ae910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.367+0000 7ff6e8c00640 1 -- 172.21.15.144:0/533489194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6e415ce80 msgr2=0x7ff6e40aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.367+0000 7ff6e8c00640 1 --2- 172.21.15.144:0/533489194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6e415ce80 0x7ff6e40aee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.367+0000 7ff6e8c00640 1 -- 172.21.15.144:0/533489194 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e41f4170 con 0x7ff6e40d02a0 2024-09-11T23:18:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.367+0000 7ff6e9600640 1 --2- 172.21.15.144:0/533489194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6e415ce80 0x7ff6e40aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.368+0000 7ff6e8c00640 1 --2- 172.21.15.144:0/533489194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6e40d02a0 0x7ff6e414cee0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff6d802a180 tx=0x7ff6d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.368+0000 7ff6e0c00640 1 -- 172.21.15.144:0/533489194 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8041020 con 0x7ff6e40d02a0 2024-09-11T23:18:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.368+0000 7ff6e0c00640 1 -- 172.21.15.144:0/533489194 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d80306c0 con 0x7ff6e40d02a0 2024-09-11T23:18:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.368+0000 7ff6eb600640 1 -- 172.21.15.144:0/533489194 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e41f4410 con 0x7ff6e40d02a0 2024-09-11T23:18:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.368+0000 7ff6e0c00640 1 -- 172.21.15.144:0/533489194 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8037040 con 0x7ff6e40d02a0 2024-09-11T23:18:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.368+0000 7ff6eb600640 1 -- 172.21.15.144:0/533489194 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e41f49d0 con 0x7ff6e40d02a0 2024-09-11T23:18:53.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.369+0000 7ff6eb600640 1 -- 172.21.15.144:0/533489194 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e40b4790 con 0x7ff6e40d02a0 2024-09-11T23:18:53.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.370+0000 7ff6e0c00640 1 -- 172.21.15.144:0/533489194 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6d8044020 con 0x7ff6e40d02a0 2024-09-11T23:18:53.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.371+0000 7ff6e0c00640 1 --2- 172.21.15.144:0/533489194 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff6c406be30 0x7ff6c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.371+0000 7ff6e0c00640 1 -- 172.21.15.144:0/533489194 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff6d80ab740 con 0x7ff6e40d02a0 2024-09-11T23:18:53.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.371+0000 7ff6e3e00640 1 --2- 172.21.15.144:0/533489194 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff6c406be30 0x7ff6c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.372+0000 7ff6e3e00640 1 --2- 172.21.15.144:0/533489194 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff6c406be30 0x7ff6c406e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0006fd0 tx=0x7ff6d0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:53.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.375+0000 7ff6e0c00640 1 -- 172.21.15.144:0/533489194 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff6d804b030 con 0x7ff6e40d02a0 2024-09-11T23:18:53.386 INFO:tasks.ceph.mds.c.smithi144.stderr:2024-09-11T23:18:53.386+0000 7f35a7200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:18:53.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.545+0000 7ff6eb600640 1 -- 172.21.15.144:0/533489194 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff6e40b0150 con 0x7ff6c406be30 2024-09-11T23:18:53.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.551+0000 7ff6e0c00640 1 -- 172.21.15.144:0/533489194 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251877 (secure 0 0 0) 0x7ff6e40b0150 con 0x7ff6c406be30 2024-09-11T23:18:53.555 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:53.556 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:18:53.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.555+0000 7ff6eb600640 1 -- 172.21.15.144:0/533489194 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff6c406be30 msgr2=0x7ff6c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.555+0000 7ff6eb600640 1 --2- 172.21.15.144:0/533489194 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff6c406be30 0x7ff6c406e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0006fd0 tx=0x7ff6d0008040 comp rx=0 tx=0).stop 2024-09-11T23:18:53.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.555+0000 7ff6eb600640 1 -- 172.21.15.144:0/533489194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6e40d02a0 msgr2=0x7ff6e414cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.555+0000 7ff6eb600640 1 --2- 172.21.15.144:0/533489194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6e40d02a0 0x7ff6e414cee0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff6d802a180 tx=0x7ff6d80046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.555+0000 7ff6eb600640 1 -- 172.21.15.144:0/533489194 shutdown_connections 2024-09-11T23:18:53.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.555+0000 7ff6eb600640 1 --2- 172.21.15.144:0/533489194 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff6c406be30 0x7ff6c406e2f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.555+0000 7ff6eb600640 1 --2- 172.21.15.144:0/533489194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6e415ce80 0x7ff6e40aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.555+0000 7ff6eb600640 1 --2- 172.21.15.144:0/533489194 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff6e415ca40 0x7ff6e40ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.555+0000 7ff6eb600640 1 --2- 172.21.15.144:0/533489194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6e40d02a0 0x7ff6e414cee0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.555+0000 7ff6eb600640 1 -- 172.21.15.144:0/533489194 >> 172.21.15.144:0/533489194 conn(0x7ff6e4062cc0 msgr2=0x7ff6e406bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:53.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.555+0000 7ff6eb600640 1 -- 172.21.15.144:0/533489194 shutdown_connections 2024-09-11T23:18:53.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.555+0000 7ff6eb600640 1 -- 172.21.15.144:0/533489194 wait complete. 2024-09-11T23:18:53.572 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-09-11T23:18:53.173454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224424,"kb_used_data":4024,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750296,"statfs":{"total":773094113280,"available":772864303104,"internally_reserved":0,"allocated":4120576,"data_stored":2296820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001325"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028722+0000","last_change":"2024-09-11T23:18:49.023570+0000","last_active":"2024-09-11T23:18:49.028722+0000","last_peered":"2024-09-11T23:18:49.028722+0000","last_clean":"2024-09-11T23:18:49.028722+0000","last_became_active":"2024-09-11T23:18:49.022977+0000","last_became_peered":"2024-09-11T23:18:49.022977+0000","last_unstale":"2024-09-11T23:18:49.028722+0000","last_undegraded":"2024-09-11T23:18:49.028722+0000","last_fullsized":"2024-09-11T23:18:49.028722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:01.751435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.588089+0000","last_change":"2024-09-11T23:18:49.021369+0000","last_active":"2024-09-11T23:18:50.588089+0000","last_peered":"2024-09-11T23:18:50.588089+0000","last_clean":"2024-09-11T23:18:50.588089+0000","last_became_active":"2024-09-11T23:18:49.019525+0000","last_became_peered":"2024-09-11T23:18:49.019525+0000","last_unstale":"2024-09-11T23:18:50.588089+0000","last_undegraded":"2024-09-11T23:18:50.588089+0000","last_fullsized":"2024-09-11T23:18:50.588089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:22.587749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011797+0000","last_change":"2024-09-11T23:18:49.024403+0000","last_active":"2024-09-11T23:18:50.011797+0000","last_peered":"2024-09-11T23:18:50.011797+0000","last_clean":"2024-09-11T23:18:50.011797+0000","last_became_active":"2024-09-11T23:18:49.023902+0000","last_became_peered":"2024-09-11T23:18:49.023902+0000","last_unstale":"2024-09-11T23:18:50.011797+0000","last_undegraded":"2024-09-11T23:18:50.011797+0000","last_fullsized":"2024-09-11T23:18:50.011797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:47.530225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028571+0000","last_change":"2024-09-11T23:18:49.023773+0000","last_active":"2024-09-11T23:18:49.028571+0000","last_peered":"2024-09-11T23:18:49.028571+0000","last_clean":"2024-09-11T23:18:49.028571+0000","last_became_active":"2024-09-11T23:18:49.022616+0000","last_became_peered":"2024-09-11T23:18:49.022616+0000","last_unstale":"2024-09-11T23:18:49.028571+0000","last_undegraded":"2024-09-11T23:18:49.028571+0000","last_fullsized":"2024-09-11T23:18:49.028571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:52.437981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586124+0000","last_change":"2024-09-11T23:18:49.007229+0000","last_active":"2024-09-11T23:18:50.586124+0000","last_peered":"2024-09-11T23:18:50.586124+0000","last_clean":"2024-09-11T23:18:50.586124+0000","last_became_active":"2024-09-11T23:18:49.006975+0000","last_became_peered":"2024-09-11T23:18:49.006975+0000","last_unstale":"2024-09-11T23:18:50.586124+0000","last_undegraded":"2024-09-11T23:18:50.586124+0000","last_fullsized":"2024-09-11T23:18:50.586124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:03.728796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586606+0000","last_change":"2024-09-11T23:18:49.018644+0000","last_active":"2024-09-11T23:18:50.586606+0000","last_peered":"2024-09-11T23:18:50.586606+0000","last_clean":"2024-09-11T23:18:50.586606+0000","last_became_active":"2024-09-11T23:18:49.018385+0000","last_became_peered":"2024-09-11T23:18:49.018385+0000","last_unstale":"2024-09-11T23:18:50.586606+0000","last_undegraded":"2024-09-11T23:18:50.586606+0000","last_fullsized":"2024-09-11T23:18:50.586606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:45.542576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.027054+0000","last_change":"2024-09-11T23:18:49.019807+0000","last_active":"2024-09-11T23:18:49.027054+0000","last_peered":"2024-09-11T23:18:49.027054+0000","last_clean":"2024-09-11T23:18:49.027054+0000","last_became_active":"2024-09-11T23:18:49.019507+0000","last_became_peered":"2024-09-11T23:18:49.019507+0000","last_unstale":"2024-09-11T23:18:49.027054+0000","last_undegraded":"2024-09-11T23:18:49.027054+0000","last_fullsized":"2024-09-11T23:18:49.027054+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.721415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.017203+0000","last_change":"2024-09-11T23:18:49.010390+0000","last_active":"2024-09-11T23:18:49.017203+0000","last_peered":"2024-09-11T23:18:49.017203+0000","last_clean":"2024-09-11T23:18:49.017203+0000","last_became_active":"2024-09-11T23:18:49.008190+0000","last_became_peered":"2024-09-11T23:18:49.008190+0000","last_unstale":"2024-09-11T23:18:49.017203+0000","last_undegraded":"2024-09-11T23:18:49.017203+0000","last_fullsized":"2024-09-11T23:18:49.017203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:59.469342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.013000+0000","last_change":"2024-09-11T23:18:49.011361+0000","last_active":"2024-09-11T23:18:50.013000+0000","last_peered":"2024-09-11T23:18:50.013000+0000","last_clean":"2024-09-11T23:18:50.013000+0000","last_became_active":"2024-09-11T23:18:49.011101+0000","last_became_peered":"2024-09-11T23:18:49.011101+0000","last_unstale":"2024-09-11T23:18:50.013000+0000","last_undegraded":"2024-09-11T23:18:50.013000+0000","last_fullsized":"2024-09-11T23:18:50.013000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:59.469342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028654+0000","last_change":"2024-09-11T23:18:49.025064+0000","last_active":"2024-09-11T23:18:49.028654+0000","last_peered":"2024-09-11T23:18:49.028654+0000","last_clean":"2024-09-11T23:18:49.028654+0000","last_became_active":"2024-09-11T23:18:49.024637+0000","last_became_peered":"2024-09-11T23:18:49.024637+0000","last_unstale":"2024-09-11T23:18:49.028654+0000","last_undegraded":"2024-09-11T23:18:49.028654+0000","last_fullsized":"2024-09-11T23:18:49.028654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:35.168942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028217+0000","last_change":"2024-09-11T23:18:49.023722+0000","last_active":"2024-09-11T23:18:49.028217+0000","last_peered":"2024-09-11T23:18:49.028217+0000","last_clean":"2024-09-11T23:18:49.028217+0000","last_became_active":"2024-09-11T23:18:49.022908+0000","last_became_peered":"2024-09-11T23:18:49.022908+0000","last_unstale":"2024-09-11T23:18:49.028217+0000","last_undegraded":"2024-09-11T23:18:49.028217+0000","last_fullsized":"2024-09-11T23:18:49.028217+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:36.393454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011452+0000","last_change":"2024-09-11T23:18:49.008770+0000","last_active":"2024-09-11T23:18:50.011452+0000","last_peered":"2024-09-11T23:18:50.011452+0000","last_clean":"2024-09-11T23:18:50.011452+0000","last_became_active":"2024-09-11T23:18:49.008476+0000","last_became_peered":"2024-09-11T23:18:49.008476+0000","last_unstale":"2024-09-11T23:18:50.011452+0000","last_undegraded":"2024-09-11T23:18:50.011452+0000","last_fullsized":"2024-09-11T23:18:50.011452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.721415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586138+0000","last_change":"2024-09-11T23:18:49.028967+0000","last_active":"2024-09-11T23:18:50.586138+0000","last_peered":"2024-09-11T23:18:50.586138+0000","last_clean":"2024-09-11T23:18:50.586138+0000","last_became_active":"2024-09-11T23:18:49.028293+0000","last_became_peered":"2024-09-11T23:18:49.028293+0000","last_unstale":"2024-09-11T23:18:50.586138+0000","last_undegraded":"2024-09-11T23:18:50.586138+0000","last_fullsized":"2024-09-11T23:18:50.586138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:08.235979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586726+0000","last_change":"2024-09-11T23:18:49.005657+0000","last_active":"2024-09-11T23:18:50.586726+0000","last_peered":"2024-09-11T23:18:50.586726+0000","last_clean":"2024-09-11T23:18:50.586726+0000","last_became_active":"2024-09-11T23:18:49.005387+0000","last_became_peered":"2024-09-11T23:18:49.005387+0000","last_unstale":"2024-09-11T23:18:50.586726+0000","last_undegraded":"2024-09-11T23:18:50.586726+0000","last_fullsized":"2024-09-11T23:18:50.586726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:54.924531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012474+0000","last_change":"2024-09-11T23:18:49.010416+0000","last_active":"2024-09-11T23:18:50.012474+0000","last_peered":"2024-09-11T23:18:50.012474+0000","last_clean":"2024-09-11T23:18:50.012474+0000","last_became_active":"2024-09-11T23:18:49.010120+0000","last_became_peered":"2024-09-11T23:18:49.010120+0000","last_unstale":"2024-09-11T23:18:50.012474+0000","last_undegraded":"2024-09-11T23:18:50.012474+0000","last_fullsized":"2024-09-11T23:18:50.012474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:30.972000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.012104+0000","last_change":"2024-09-11T23:18:49.008741+0000","last_active":"2024-09-11T23:18:49.012104+0000","last_peered":"2024-09-11T23:18:49.012104+0000","last_clean":"2024-09-11T23:18:49.012104+0000","last_became_active":"2024-09-11T23:18:49.008543+0000","last_became_peered":"2024-09-11T23:18:49.008543+0000","last_unstale":"2024-09-11T23:18:49.012104+0000","last_undegraded":"2024-09-11T23:18:49.012104+0000","last_fullsized":"2024-09-11T23:18:49.012104+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:00.772427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.024083+0000","last_change":"2024-09-11T23:18:49.017267+0000","last_active":"2024-09-11T23:18:49.024083+0000","last_peered":"2024-09-11T23:18:49.024083+0000","last_clean":"2024-09-11T23:18:49.024083+0000","last_became_active":"2024-09-11T23:18:49.016994+0000","last_became_peered":"2024-09-11T23:18:49.016994+0000","last_unstale":"2024-09-11T23:18:49.024083+0000","last_undegraded":"2024-09-11T23:18:49.024083+0000","last_fullsized":"2024-09-11T23:18:49.024083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:04.572090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.588162+0000","last_change":"2024-09-11T23:18:49.016833+0000","last_active":"2024-09-11T23:18:50.588162+0000","last_peered":"2024-09-11T23:18:50.588162+0000","last_clean":"2024-09-11T23:18:50.588162+0000","last_became_active":"2024-09-11T23:18:49.009287+0000","last_became_peered":"2024-09-11T23:18:49.009287+0000","last_unstale":"2024-09-11T23:18:50.588162+0000","last_undegraded":"2024-09-11T23:18:50.588162+0000","last_fullsized":"2024-09-11T23:18:50.588162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:55.162354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587912+0000","last_change":"2024-09-11T23:18:49.024077+0000","last_active":"2024-09-11T23:18:50.587912+0000","last_peered":"2024-09-11T23:18:50.587912+0000","last_clean":"2024-09-11T23:18:50.587912+0000","last_became_active":"2024-09-11T23:18:49.023804+0000","last_became_peered":"2024-09-11T23:18:49.023804+0000","last_unstale":"2024-09-11T23:18:50.587912+0000","last_undegraded":"2024-09-11T23:18:50.587912+0000","last_fullsized":"2024-09-11T23:18:50.587912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:24.356397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586526+0000","last_change":"2024-09-11T23:18:49.024077+0000","last_active":"2024-09-11T23:18:50.586526+0000","last_peered":"2024-09-11T23:18:50.586526+0000","last_clean":"2024-09-11T23:18:50.586526+0000","last_became_active":"2024-09-11T23:18:49.023773+0000","last_became_peered":"2024-09-11T23:18:49.023773+0000","last_unstale":"2024-09-11T23:18:50.586526+0000","last_undegraded":"2024-09-11T23:18:50.586526+0000","last_fullsized":"2024-09-11T23:18:50.586526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:26.306962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011922+0000","last_change":"2024-09-11T23:18:49.013009+0000","last_active":"2024-09-11T23:18:50.011922+0000","last_peered":"2024-09-11T23:18:50.011922+0000","last_clean":"2024-09-11T23:18:50.011922+0000","last_became_active":"2024-09-11T23:18:49.012755+0000","last_became_peered":"2024-09-11T23:18:49.012755+0000","last_unstale":"2024-09-11T23:18:50.011922+0000","last_undegraded":"2024-09-11T23:18:50.011922+0000","last_fullsized":"2024-09-11T23:18:50.011922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:35.168942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012053+0000","last_change":"2024-09-11T23:18:49.009624+0000","last_active":"2024-09-11T23:18:50.012053+0000","last_peered":"2024-09-11T23:18:50.012053+0000","last_clean":"2024-09-11T23:18:50.012053+0000","last_became_active":"2024-09-11T23:18:49.009160+0000","last_became_peered":"2024-09-11T23:18:49.009160+0000","last_unstale":"2024-09-11T23:18:50.012053+0000","last_undegraded":"2024-09-11T23:18:50.012053+0000","last_fullsized":"2024-09-11T23:18:50.012053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:44.169273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.021931+0000","last_change":"2024-09-11T23:18:49.016619+0000","last_active":"2024-09-11T23:18:49.021931+0000","last_peered":"2024-09-11T23:18:49.021931+0000","last_clean":"2024-09-11T23:18:49.021931+0000","last_became_active":"2024-09-11T23:18:49.016367+0000","last_became_peered":"2024-09-11T23:18:49.016367+0000","last_unstale":"2024-09-11T23:18:49.021931+0000","last_undegraded":"2024-09-11T23:18:49.021931+0000","last_fullsized":"2024-09-11T23:18:49.021931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:08.846324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011169+0000","last_change":"2024-09-11T23:18:49.012178+0000","last_active":"2024-09-11T23:18:50.011169+0000","last_peered":"2024-09-11T23:18:50.011169+0000","last_clean":"2024-09-11T23:18:50.011169+0000","last_became_active":"2024-09-11T23:18:49.008877+0000","last_became_peered":"2024-09-11T23:18:49.008877+0000","last_unstale":"2024-09-11T23:18:50.011169+0000","last_undegraded":"2024-09-11T23:18:50.011169+0000","last_fullsized":"2024-09-11T23:18:50.011169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:02.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":6,"reported_epoch":33,"state":"active","last_fresh":"2024-09-11T23:18:49.031327+0000","last_change":"2024-09-11T23:18:49.031264+0000","last_active":"2024-09-11T23:18:49.031327+0000","last_peered":"2024-09-11T23:18:49.031327+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"2024-09-11T23:18:49.031264+0000","last_became_peered":"2024-09-11T23:18:49.031264+0000","last_unstale":"2024-09-11T23:18:49.031327+0000","last_undegraded":"2024-09-11T23:18:49.031327+0000","last_fullsized":"2024-09-11T23:18:49.031327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.588238+0000","last_change":"2024-09-11T23:18:49.017955+0000","last_active":"2024-09-11T23:18:50.588238+0000","last_peered":"2024-09-11T23:18:50.588238+0000","last_clean":"2024-09-11T23:18:50.588238+0000","last_became_active":"2024-09-11T23:18:49.008731+0000","last_became_peered":"2024-09-11T23:18:49.008731+0000","last_unstale":"2024-09-11T23:18:50.588238+0000","last_undegraded":"2024-09-11T23:18:50.588238+0000","last_fullsized":"2024-09-11T23:18:50.588238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:38.477516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028782+0000","last_change":"2024-09-11T23:18:49.023143+0000","last_active":"2024-09-11T23:18:49.028782+0000","last_peered":"2024-09-11T23:18:49.028782+0000","last_clean":"2024-09-11T23:18:49.028782+0000","last_became_active":"2024-09-11T23:18:49.022916+0000","last_became_peered":"2024-09-11T23:18:49.022916+0000","last_unstale":"2024-09-11T23:18:49.028782+0000","last_undegraded":"2024-09-11T23:18:49.028782+0000","last_fullsized":"2024-09-11T23:18:49.028782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:42.935157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012197+0000","last_change":"2024-09-11T23:18:49.015459+0000","last_active":"2024-09-11T23:18:50.012197+0000","last_peered":"2024-09-11T23:18:50.012197+0000","last_clean":"2024-09-11T23:18:50.012197+0000","last_became_active":"2024-09-11T23:18:49.014648+0000","last_became_peered":"2024-09-11T23:18:49.014648+0000","last_unstale":"2024-09-11T23:18:50.012197+0000","last_undegraded":"2024-09-11T23:18:50.012197+0000","last_fullsized":"2024-09-11T23:18:50.012197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:49.663140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012050+0000","last_change":"2024-09-11T23:18:49.009617+0000","last_active":"2024-09-11T23:18:50.012050+0000","last_peered":"2024-09-11T23:18:50.012050+0000","last_clean":"2024-09-11T23:18:50.012050+0000","last_became_active":"2024-09-11T23:18:49.007209+0000","last_became_peered":"2024-09-11T23:18:49.007209+0000","last_unstale":"2024-09-11T23:18:50.012050+0000","last_undegraded":"2024-09-11T23:18:50.012050+0000","last_fullsized":"2024-09-11T23:18:50.012050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:20.040267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.019964+0000","last_change":"2024-09-11T23:18:49.012641+0000","last_active":"2024-09-11T23:18:49.019964+0000","last_peered":"2024-09-11T23:18:49.019964+0000","last_clean":"2024-09-11T23:18:49.019964+0000","last_became_active":"2024-09-11T23:18:49.012332+0000","last_became_peered":"2024-09-11T23:18:49.012332+0000","last_unstale":"2024-09-11T23:18:49.019964+0000","last_undegraded":"2024-09-11T23:18:49.019964+0000","last_fullsized":"2024-09-11T23:18:49.019964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:16.182623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.020434+0000","last_change":"2024-09-11T23:18:49.013323+0000","last_active":"2024-09-11T23:18:49.020434+0000","last_peered":"2024-09-11T23:18:49.020434+0000","last_clean":"2024-09-11T23:18:49.020434+0000","last_became_active":"2024-09-11T23:18:49.012492+0000","last_became_peered":"2024-09-11T23:18:49.012492+0000","last_unstale":"2024-09-11T23:18:49.020434+0000","last_undegraded":"2024-09-11T23:18:49.020434+0000","last_fullsized":"2024-09-11T23:18:49.020434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:23.411234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.019831+0000","last_change":"2024-09-11T23:18:49.014929+0000","last_active":"2024-09-11T23:18:49.019831+0000","last_peered":"2024-09-11T23:18:49.019831+0000","last_clean":"2024-09-11T23:18:49.019831+0000","last_became_active":"2024-09-11T23:18:49.014660+0000","last_became_peered":"2024-09-11T23:18:49.014660+0000","last_unstale":"2024-09-11T23:18:49.019831+0000","last_undegraded":"2024-09-11T23:18:49.019831+0000","last_fullsized":"2024-09-11T23:18:49.019831+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:05.424937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.022471+0000","last_change":"2024-09-11T23:18:49.019336+0000","last_active":"2024-09-11T23:18:49.022471+0000","last_peered":"2024-09-11T23:18:49.022471+0000","last_clean":"2024-09-11T23:18:49.022471+0000","last_became_active":"2024-09-11T23:18:49.019078+0000","last_became_peered":"2024-09-11T23:18:49.019078+0000","last_unstale":"2024-09-11T23:18:49.022471+0000","last_undegraded":"2024-09-11T23:18:49.022471+0000","last_fullsized":"2024-09-11T23:18:49.022471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:35.168942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.031200+0000","last_change":"2024-09-11T23:18:48.007751+0000","last_active":"2024-09-11T23:18:49.031200+0000","last_peered":"2024-09-11T23:18:49.031200+0000","last_clean":"2024-09-11T23:18:49.031200+0000","last_became_active":"2024-09-11T23:18:48.007453+0000","last_became_peered":"2024-09-11T23:18:48.007453+0000","last_unstale":"2024-09-11T23:18:49.031200+0000","last_undegraded":"2024-09-11T23:18:49.031200+0000","last_fullsized":"2024-09-11T23:18:49.031200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:18.222705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028706+0000","last_change":"2024-09-11T23:18:49.023248+0000","last_active":"2024-09-11T23:18:49.028706+0000","last_peered":"2024-09-11T23:18:49.028706+0000","last_clean":"2024-09-11T23:18:49.028706+0000","last_became_active":"2024-09-11T23:18:49.018856+0000","last_became_peered":"2024-09-11T23:18:49.018856+0000","last_unstale":"2024-09-11T23:18:49.028706+0000","last_undegraded":"2024-09-11T23:18:49.028706+0000","last_fullsized":"2024-09-11T23:18:49.028706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:14.448085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.024169+0000","last_change":"2024-09-11T23:18:48.015111+0000","last_active":"2024-09-11T23:18:49.024169+0000","last_peered":"2024-09-11T23:18:49.024169+0000","last_clean":"2024-09-11T23:18:49.024169+0000","last_became_active":"2024-09-11T23:18:48.014804+0000","last_became_peered":"2024-09-11T23:18:48.014804+0000","last_unstale":"2024-09-11T23:18:49.024169+0000","last_undegraded":"2024-09-11T23:18:49.024169+0000","last_fullsized":"2024-09-11T23:18:49.024169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:43.882021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012303+0000","last_change":"2024-09-11T23:18:49.008030+0000","last_active":"2024-09-11T23:18:50.012303+0000","last_peered":"2024-09-11T23:18:50.012303+0000","last_clean":"2024-09-11T23:18:50.012303+0000","last_became_active":"2024-09-11T23:18:49.007228+0000","last_became_peered":"2024-09-11T23:18:49.007228+0000","last_unstale":"2024-09-11T23:18:50.012303+0000","last_undegraded":"2024-09-11T23:18:50.012303+0000","last_fullsized":"2024-09-11T23:18:50.012303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:05.371678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587895+0000","last_change":"2024-09-11T23:18:48.010963+0000","last_active":"2024-09-11T23:18:50.587895+0000","last_peered":"2024-09-11T23:18:50.587895+0000","last_clean":"2024-09-11T23:18:50.587895+0000","last_became_active":"2024-09-11T23:18:48.010705+0000","last_became_peered":"2024-09-11T23:18:48.010705+0000","last_unstale":"2024-09-11T23:18:50.587895+0000","last_undegraded":"2024-09-11T23:18:50.587895+0000","last_fullsized":"2024-09-11T23:18:50.587895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:49.742344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028763+0000","last_change":"2024-09-11T23:18:49.023043+0000","last_active":"2024-09-11T23:18:49.028763+0000","last_peered":"2024-09-11T23:18:49.028763+0000","last_clean":"2024-09-11T23:18:49.028763+0000","last_became_active":"2024-09-11T23:18:49.022537+0000","last_became_peered":"2024-09-11T23:18:49.022537+0000","last_unstale":"2024-09-11T23:18:49.028763+0000","last_undegraded":"2024-09-11T23:18:49.028763+0000","last_fullsized":"2024-09-11T23:18:49.028763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:01.751435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586466+0000","last_change":"2024-09-11T23:18:48.012267+0000","last_active":"2024-09-11T23:18:50.586466+0000","last_peered":"2024-09-11T23:18:50.586466+0000","last_clean":"2024-09-11T23:18:50.586466+0000","last_became_active":"2024-09-11T23:18:48.011880+0000","last_became_peered":"2024-09-11T23:18:48.011880+0000","last_unstale":"2024-09-11T23:18:50.586466+0000","last_undegraded":"2024-09-11T23:18:50.586466+0000","last_fullsized":"2024-09-11T23:18:50.586466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:20.606934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.023373+0000","last_change":"2024-09-11T23:18:49.017731+0000","last_active":"2024-09-11T23:18:49.023373+0000","last_peered":"2024-09-11T23:18:49.023373+0000","last_clean":"2024-09-11T23:18:49.023373+0000","last_became_active":"2024-09-11T23:18:49.017469+0000","last_became_peered":"2024-09-11T23:18:49.017469+0000","last_unstale":"2024-09-11T23:18:49.023373+0000","last_undegraded":"2024-09-11T23:18:49.023373+0000","last_fullsized":"2024-09-11T23:18:49.023373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:18.200252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012044+0000","last_change":"2024-09-11T23:18:48.011580+0000","last_active":"2024-09-11T23:18:50.012044+0000","last_peered":"2024-09-11T23:18:50.012044+0000","last_clean":"2024-09-11T23:18:50.012044+0000","last_became_active":"2024-09-11T23:18:48.011045+0000","last_became_peered":"2024-09-11T23:18:48.011045+0000","last_unstale":"2024-09-11T23:18:50.012044+0000","last_undegraded":"2024-09-11T23:18:50.012044+0000","last_fullsized":"2024-09-11T23:18:50.012044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:18.496309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011199+0000","last_change":"2024-09-11T23:18:49.015000+0000","last_active":"2024-09-11T23:18:50.011199+0000","last_peered":"2024-09-11T23:18:50.011199+0000","last_clean":"2024-09-11T23:18:50.011199+0000","last_became_active":"2024-09-11T23:18:49.014091+0000","last_became_peered":"2024-09-11T23:18:49.014091+0000","last_unstale":"2024-09-11T23:18:50.011199+0000","last_undegraded":"2024-09-11T23:18:50.011199+0000","last_fullsized":"2024-09-11T23:18:50.011199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:31.695691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012184+0000","last_change":"2024-09-11T23:18:48.009914+0000","last_active":"2024-09-11T23:18:50.012184+0000","last_peered":"2024-09-11T23:18:50.012184+0000","last_clean":"2024-09-11T23:18:50.012184+0000","last_became_active":"2024-09-11T23:18:48.007555+0000","last_became_peered":"2024-09-11T23:18:48.007555+0000","last_unstale":"2024-09-11T23:18:50.012184+0000","last_undegraded":"2024-09-11T23:18:50.012184+0000","last_fullsized":"2024-09-11T23:18:50.012184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:11.259384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011290+0000","last_change":"2024-09-11T23:18:49.006529+0000","last_active":"2024-09-11T23:18:50.011290+0000","last_peered":"2024-09-11T23:18:50.011290+0000","last_clean":"2024-09-11T23:18:50.011290+0000","last_became_active":"2024-09-11T23:18:49.006239+0000","last_became_peered":"2024-09-11T23:18:49.006239+0000","last_unstale":"2024-09-11T23:18:50.011290+0000","last_undegraded":"2024-09-11T23:18:50.011290+0000","last_fullsized":"2024-09-11T23:18:50.011290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:52.437981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586305+0000","last_change":"2024-09-11T23:18:48.005888+0000","last_active":"2024-09-11T23:18:50.586305+0000","last_peered":"2024-09-11T23:18:50.586305+0000","last_clean":"2024-09-11T23:18:50.586305+0000","last_became_active":"2024-09-11T23:18:48.005594+0000","last_became_peered":"2024-09-11T23:18:48.005594+0000","last_unstale":"2024-09-11T23:18:50.586305+0000","last_undegraded":"2024-09-11T23:18:50.586305+0000","last_fullsized":"2024-09-11T23:18:50.586305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:20.376536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.027881+0000","last_change":"2024-09-11T23:18:49.022786+0000","last_active":"2024-09-11T23:18:49.027881+0000","last_peered":"2024-09-11T23:18:49.027881+0000","last_clean":"2024-09-11T23:18:49.027881+0000","last_became_active":"2024-09-11T23:18:49.022512+0000","last_became_peered":"2024-09-11T23:18:49.022512+0000","last_unstale":"2024-09-11T23:18:49.027881+0000","last_undegraded":"2024-09-11T23:18:49.027881+0000","last_fullsized":"2024-09-11T23:18:49.027881+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:14.448085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011412+0000","last_change":"2024-09-11T23:18:48.001028+0000","last_active":"2024-09-11T23:18:50.011412+0000","last_peered":"2024-09-11T23:18:50.011412+0000","last_clean":"2024-09-11T23:18:50.011412+0000","last_became_active":"2024-09-11T23:18:48.000366+0000","last_became_peered":"2024-09-11T23:18:48.000366+0000","last_unstale":"2024-09-11T23:18:50.011412+0000","last_undegraded":"2024-09-11T23:18:50.011412+0000","last_fullsized":"2024-09-11T23:18:50.011412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:21.206250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011482+0000","last_change":"2024-09-11T23:18:49.010058+0000","last_active":"2024-09-11T23:18:50.011482+0000","last_peered":"2024-09-11T23:18:50.011482+0000","last_clean":"2024-09-11T23:18:50.011482+0000","last_became_active":"2024-09-11T23:18:49.007625+0000","last_became_peered":"2024-09-11T23:18:49.007625+0000","last_unstale":"2024-09-11T23:18:50.011482+0000","last_undegraded":"2024-09-11T23:18:50.011482+0000","last_fullsized":"2024-09-11T23:18:50.011482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:36.393454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587725+0000","last_change":"2024-09-11T23:18:48.017295+0000","last_active":"2024-09-11T23:18:50.587725+0000","last_peered":"2024-09-11T23:18:50.587725+0000","last_clean":"2024-09-11T23:18:50.587725+0000","last_became_active":"2024-09-11T23:18:48.016882+0000","last_became_peered":"2024-09-11T23:18:48.016882+0000","last_unstale":"2024-09-11T23:18:50.587725+0000","last_undegraded":"2024-09-11T23:18:50.587725+0000","last_fullsized":"2024-09-11T23:18:50.587725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:27.807403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587637+0000","last_change":"2024-09-11T23:18:49.024058+0000","last_active":"2024-09-11T23:18:50.587637+0000","last_peered":"2024-09-11T23:18:50.587637+0000","last_clean":"2024-09-11T23:18:50.587637+0000","last_became_active":"2024-09-11T23:18:49.023763+0000","last_became_peered":"2024-09-11T23:18:49.023763+0000","last_unstale":"2024-09-11T23:18:50.587637+0000","last_undegraded":"2024-09-11T23:18:50.587637+0000","last_fullsized":"2024-09-11T23:18:50.587637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:15.178674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.002487+0000","last_change":"2024-09-11T23:18:48.011655+0000","last_active":"2024-09-11T23:18:49.002487+0000","last_peered":"2024-09-11T23:18:49.002487+0000","last_clean":"2024-09-11T23:18:49.002487+0000","last_became_active":"2024-09-11T23:18:48.008273+0000","last_became_peered":"2024-09-11T23:18:48.008273+0000","last_unstale":"2024-09-11T23:18:49.002487+0000","last_undegraded":"2024-09-11T23:18:49.002487+0000","last_fullsized":"2024-09-11T23:18:49.002487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:51.349730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587574+0000","last_change":"2024-09-11T23:18:49.015893+0000","last_active":"2024-09-11T23:18:50.587574+0000","last_peered":"2024-09-11T23:18:50.587574+0000","last_clean":"2024-09-11T23:18:50.587574+0000","last_became_active":"2024-09-11T23:18:49.008793+0000","last_became_peered":"2024-09-11T23:18:49.008793+0000","last_unstale":"2024-09-11T23:18:50.587574+0000","last_undegraded":"2024-09-11T23:18:50.587574+0000","last_fullsized":"2024-09-11T23:18:50.587574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:01.289535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011904+0000","last_change":"2024-09-11T23:18:48.011616+0000","last_active":"2024-09-11T23:18:50.011904+0000","last_peered":"2024-09-11T23:18:50.011904+0000","last_clean":"2024-09-11T23:18:50.011904+0000","last_became_active":"2024-09-11T23:18:48.011108+0000","last_became_peered":"2024-09-11T23:18:48.011108+0000","last_unstale":"2024-09-11T23:18:50.011904+0000","last_undegraded":"2024-09-11T23:18:50.011904+0000","last_fullsized":"2024-09-11T23:18:50.011904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:34.165980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011637+0000","last_change":"2024-09-11T23:18:49.024580+0000","last_active":"2024-09-11T23:18:50.011637+0000","last_peered":"2024-09-11T23:18:50.011637+0000","last_clean":"2024-09-11T23:18:50.011637+0000","last_became_active":"2024-09-11T23:18:49.024279+0000","last_became_peered":"2024-09-11T23:18:49.024279+0000","last_unstale":"2024-09-11T23:18:50.011637+0000","last_undegraded":"2024-09-11T23:18:50.011637+0000","last_fullsized":"2024-09-11T23:18:50.011637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:22.301700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587334+0000","last_change":"2024-09-11T23:18:48.016996+0000","last_active":"2024-09-11T23:18:50.587334+0000","last_peered":"2024-09-11T23:18:50.587334+0000","last_clean":"2024-09-11T23:18:50.587334+0000","last_became_active":"2024-09-11T23:18:48.016503+0000","last_became_peered":"2024-09-11T23:18:48.016503+0000","last_unstale":"2024-09-11T23:18:50.587334+0000","last_undegraded":"2024-09-11T23:18:50.587334+0000","last_fullsized":"2024-09-11T23:18:50.587334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:33.072147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.017286+0000","last_change":"2024-09-11T23:18:49.012373+0000","last_active":"2024-09-11T23:18:49.017286+0000","last_peered":"2024-09-11T23:18:49.017286+0000","last_clean":"2024-09-11T23:18:49.017286+0000","last_became_active":"2024-09-11T23:18:49.011979+0000","last_became_peered":"2024-09-11T23:18:49.011979+0000","last_unstale":"2024-09-11T23:18:49.017286+0000","last_undegraded":"2024-09-11T23:18:49.017286+0000","last_fullsized":"2024-09-11T23:18:49.017286+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:44.884982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012156+0000","last_change":"2024-09-11T23:18:48.002333+0000","last_active":"2024-09-11T23:18:50.012156+0000","last_peered":"2024-09-11T23:18:50.012156+0000","last_clean":"2024-09-11T23:18:50.012156+0000","last_became_active":"2024-09-11T23:18:48.001101+0000","last_became_peered":"2024-09-11T23:18:48.001101+0000","last_unstale":"2024-09-11T23:18:50.012156+0000","last_undegraded":"2024-09-11T23:18:50.012156+0000","last_fullsized":"2024-09-11T23:18:50.012156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:30.420649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586953+0000","last_change":"2024-09-11T23:18:49.019321+0000","last_active":"2024-09-11T23:18:50.586953+0000","last_peered":"2024-09-11T23:18:50.586953+0000","last_clean":"2024-09-11T23:18:50.586953+0000","last_became_active":"2024-09-11T23:18:49.015579+0000","last_became_peered":"2024-09-11T23:18:49.015579+0000","last_unstale":"2024-09-11T23:18:50.586953+0000","last_undegraded":"2024-09-11T23:18:50.586953+0000","last_fullsized":"2024-09-11T23:18:50.586953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:06.688839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.011178+0000","last_change":"2024-09-11T23:18:48.010282+0000","last_active":"2024-09-11T23:18:49.011178+0000","last_peered":"2024-09-11T23:18:49.011178+0000","last_clean":"2024-09-11T23:18:49.011178+0000","last_became_active":"2024-09-11T23:18:48.007053+0000","last_became_peered":"2024-09-11T23:18:48.007053+0000","last_unstale":"2024-09-11T23:18:49.011178+0000","last_undegraded":"2024-09-11T23:18:49.011178+0000","last_fullsized":"2024-09-11T23:18:49.011178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:18.309385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.026361+0000","last_change":"2024-09-11T23:18:49.019508+0000","last_active":"2024-09-11T23:18:49.026361+0000","last_peered":"2024-09-11T23:18:49.026361+0000","last_clean":"2024-09-11T23:18:49.026361+0000","last_became_active":"2024-09-11T23:18:49.019067+0000","last_became_peered":"2024-09-11T23:18:49.019067+0000","last_unstale":"2024-09-11T23:18:49.026361+0000","last_undegraded":"2024-09-11T23:18:49.026361+0000","last_fullsized":"2024-09-11T23:18:49.026361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:31.695691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586329+0000","last_change":"2024-09-11T23:18:48.014618+0000","last_active":"2024-09-11T23:18:50.586329+0000","last_peered":"2024-09-11T23:18:50.586329+0000","last_clean":"2024-09-11T23:18:50.586329+0000","last_became_active":"2024-09-11T23:18:48.014376+0000","last_became_peered":"2024-09-11T23:18:48.014376+0000","last_unstale":"2024-09-11T23:18:50.586329+0000","last_undegraded":"2024-09-11T23:18:50.586329+0000","last_fullsized":"2024-09-11T23:18:50.586329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:00.540786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.023632+0000","last_change":"2024-09-11T23:18:49.017642+0000","last_active":"2024-09-11T23:18:49.023632+0000","last_peered":"2024-09-11T23:18:49.023632+0000","last_clean":"2024-09-11T23:18:49.023632+0000","last_became_active":"2024-09-11T23:18:49.017344+0000","last_became_peered":"2024-09-11T23:18:49.017344+0000","last_unstale":"2024-09-11T23:18:49.023632+0000","last_undegraded":"2024-09-11T23:18:49.023632+0000","last_fullsized":"2024-09-11T23:18:49.023632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:52.352691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586028+0000","last_change":"2024-09-11T23:18:48.016597+0000","last_active":"2024-09-11T23:18:50.586028+0000","last_peered":"2024-09-11T23:18:50.586028+0000","last_clean":"2024-09-11T23:18:50.586028+0000","last_became_active":"2024-09-11T23:18:48.016314+0000","last_became_peered":"2024-09-11T23:18:48.016314+0000","last_unstale":"2024-09-11T23:18:50.586028+0000","last_undegraded":"2024-09-11T23:18:50.586028+0000","last_fullsized":"2024-09-11T23:18:50.586028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:54.884414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012770+0000","last_change":"2024-09-11T23:18:49.015641+0000","last_active":"2024-09-11T23:18:50.012770+0000","last_peered":"2024-09-11T23:18:50.012770+0000","last_clean":"2024-09-11T23:18:50.012770+0000","last_became_active":"2024-09-11T23:18:49.014210+0000","last_became_peered":"2024-09-11T23:18:49.014210+0000","last_unstale":"2024-09-11T23:18:50.012770+0000","last_undegraded":"2024-09-11T23:18:50.012770+0000","last_fullsized":"2024-09-11T23:18:50.012770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:00.772427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.031601+0000","last_change":"2024-09-11T23:18:48.013143+0000","last_active":"2024-09-11T23:18:49.031601+0000","last_peered":"2024-09-11T23:18:49.031601+0000","last_clean":"2024-09-11T23:18:49.031601+0000","last_became_active":"2024-09-11T23:18:48.012875+0000","last_became_peered":"2024-09-11T23:18:48.012875+0000","last_unstale":"2024-09-11T23:18:49.031601+0000","last_undegraded":"2024-09-11T23:18:49.031601+0000","last_fullsized":"2024-09-11T23:18:49.031601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:43.166311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011688+0000","last_change":"2024-09-11T23:18:49.006253+0000","last_active":"2024-09-11T23:18:50.011688+0000","last_peered":"2024-09-11T23:18:50.011688+0000","last_clean":"2024-09-11T23:18:50.011688+0000","last_became_active":"2024-09-11T23:18:49.004054+0000","last_became_peered":"2024-09-11T23:18:49.004054+0000","last_unstale":"2024-09-11T23:18:50.011688+0000","last_undegraded":"2024-09-11T23:18:50.011688+0000","last_fullsized":"2024-09-11T23:18:50.011688+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:18.145725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012844+0000","last_change":"2024-09-11T23:18:48.001857+0000","last_active":"2024-09-11T23:18:50.012844+0000","last_peered":"2024-09-11T23:18:50.012844+0000","last_clean":"2024-09-11T23:18:50.012844+0000","last_became_active":"2024-09-11T23:18:48.001543+0000","last_became_peered":"2024-09-11T23:18:48.001543+0000","last_unstale":"2024-09-11T23:18:50.012844+0000","last_undegraded":"2024-09-11T23:18:50.012844+0000","last_fullsized":"2024-09-11T23:18:50.012844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:14.102475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028592+0000","last_change":"2024-09-11T23:18:49.024287+0000","last_active":"2024-09-11T23:18:49.028592+0000","last_peered":"2024-09-11T23:18:49.028592+0000","last_clean":"2024-09-11T23:18:49.028592+0000","last_became_active":"2024-09-11T23:18:49.022965+0000","last_became_peered":"2024-09-11T23:18:49.022965+0000","last_unstale":"2024-09-11T23:18:49.028592+0000","last_undegraded":"2024-09-11T23:18:49.028592+0000","last_fullsized":"2024-09-11T23:18:49.028592+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:08.846324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012525+0000","last_change":"2024-09-11T23:18:48.004742+0000","last_active":"2024-09-11T23:18:50.012525+0000","last_peered":"2024-09-11T23:18:50.012525+0000","last_clean":"2024-09-11T23:18:50.012525+0000","last_became_active":"2024-09-11T23:18:48.004317+0000","last_became_peered":"2024-09-11T23:18:48.004317+0000","last_unstale":"2024-09-11T23:18:50.012525+0000","last_undegraded":"2024-09-11T23:18:50.012525+0000","last_fullsized":"2024-09-11T23:18:50.012525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:14.500017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586351+0000","last_change":"2024-09-11T23:18:49.014969+0000","last_active":"2024-09-11T23:18:50.586351+0000","last_peered":"2024-09-11T23:18:50.586351+0000","last_clean":"2024-09-11T23:18:50.586351+0000","last_became_active":"2024-09-11T23:18:49.014665+0000","last_became_peered":"2024-09-11T23:18:49.014665+0000","last_unstale":"2024-09-11T23:18:50.586351+0000","last_undegraded":"2024-09-11T23:18:50.586351+0000","last_fullsized":"2024-09-11T23:18:50.586351+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:07:27.965516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012482+0000","last_change":"2024-09-11T23:18:48.004710+0000","last_active":"2024-09-11T23:18:50.012482+0000","last_peered":"2024-09-11T23:18:50.012482+0000","last_clean":"2024-09-11T23:18:50.012482+0000","last_became_active":"2024-09-11T23:18:48.004396+0000","last_became_peered":"2024-09-11T23:18:48.004396+0000","last_unstale":"2024-09-11T23:18:50.012482+0000","last_undegraded":"2024-09-11T23:18:50.012482+0000","last_fullsized":"2024-09-11T23:18:50.012482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:58.115645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586139+0000","last_change":"2024-09-11T23:18:49.013677+0000","last_active":"2024-09-11T23:18:50.586139+0000","last_peered":"2024-09-11T23:18:50.586139+0000","last_clean":"2024-09-11T23:18:50.586139+0000","last_became_active":"2024-09-11T23:18:49.013135+0000","last_became_peered":"2024-09-11T23:18:49.013135+0000","last_unstale":"2024-09-11T23:18:50.586139+0000","last_undegraded":"2024-09-11T23:18:50.586139+0000","last_fullsized":"2024-09-11T23:18:50.586139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:05.649394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.005713+0000","last_change":"2024-09-11T23:18:48.009114+0000","last_active":"2024-09-11T23:18:49.005713+0000","last_peered":"2024-09-11T23:18:49.005713+0000","last_clean":"2024-09-11T23:18:49.005713+0000","last_became_active":"2024-09-11T23:18:48.008595+0000","last_became_peered":"2024-09-11T23:18:48.008595+0000","last_unstale":"2024-09-11T23:18:49.005713+0000","last_undegraded":"2024-09-11T23:18:49.005713+0000","last_fullsized":"2024-09-11T23:18:49.005713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:41.932196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586528+0000","last_change":"2024-09-11T23:18:49.012606+0000","last_active":"2024-09-11T23:18:50.586528+0000","last_peered":"2024-09-11T23:18:50.586528+0000","last_clean":"2024-09-11T23:18:50.586528+0000","last_became_active":"2024-09-11T23:18:49.012315+0000","last_became_peered":"2024-09-11T23:18:49.012315+0000","last_unstale":"2024-09-11T23:18:50.586528+0000","last_undegraded":"2024-09-11T23:18:50.586528+0000","last_fullsized":"2024-09-11T23:18:50.586528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:02.102975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.003131+0000","last_change":"2024-09-11T23:18:48.014456+0000","last_active":"2024-09-11T23:18:49.003131+0000","last_peered":"2024-09-11T23:18:49.003131+0000","last_clean":"2024-09-11T23:18:49.003131+0000","last_became_active":"2024-09-11T23:18:48.014078+0000","last_became_peered":"2024-09-11T23:18:48.014078+0000","last_unstale":"2024-09-11T23:18:49.003131+0000","last_undegraded":"2024-09-11T23:18:49.003131+0000","last_fullsized":"2024-09-11T23:18:49.003131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:18.309385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.585986+0000","last_change":"2024-09-11T23:18:49.008898+0000","last_active":"2024-09-11T23:18:50.585986+0000","last_peered":"2024-09-11T23:18:50.585986+0000","last_clean":"2024-09-11T23:18:50.585986+0000","last_became_active":"2024-09-11T23:18:49.008538+0000","last_became_peered":"2024-09-11T23:18:49.008538+0000","last_unstale":"2024-09-11T23:18:50.585986+0000","last_undegraded":"2024-09-11T23:18:50.585986+0000","last_fullsized":"2024-09-11T23:18:50.585986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:00.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011799+0000","last_change":"2024-09-11T23:18:48.003928+0000","last_active":"2024-09-11T23:18:50.011799+0000","last_peered":"2024-09-11T23:18:50.011799+0000","last_clean":"2024-09-11T23:18:50.011799+0000","last_became_active":"2024-09-11T23:18:48.003048+0000","last_became_peered":"2024-09-11T23:18:48.003048+0000","last_unstale":"2024-09-11T23:18:50.011799+0000","last_undegraded":"2024-09-11T23:18:50.011799+0000","last_fullsized":"2024-09-11T23:18:50.011799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:37.584863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.024045+0000","last_change":"2024-09-11T23:18:49.013365+0000","last_active":"2024-09-11T23:18:49.024045+0000","last_peered":"2024-09-11T23:18:49.024045+0000","last_clean":"2024-09-11T23:18:49.024045+0000","last_became_active":"2024-09-11T23:18:49.013014+0000","last_became_peered":"2024-09-11T23:18:49.013014+0000","last_unstale":"2024-09-11T23:18:49.024045+0000","last_undegraded":"2024-09-11T23:18:49.024045+0000","last_fullsized":"2024-09-11T23:18:49.024045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:02.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011282+0000","last_change":"2024-09-11T23:18:48.013115+0000","last_active":"2024-09-11T23:18:50.011282+0000","last_peered":"2024-09-11T23:18:50.011282+0000","last_clean":"2024-09-11T23:18:50.011282+0000","last_became_active":"2024-09-11T23:18:48.012783+0000","last_became_peered":"2024-09-11T23:18:48.012783+0000","last_unstale":"2024-09-11T23:18:50.011282+0000","last_undegraded":"2024-09-11T23:18:50.011282+0000","last_fullsized":"2024-09-11T23:18:50.011282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:07.843362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586275+0000","last_change":"2024-09-11T23:18:49.013885+0000","last_active":"2024-09-11T23:18:50.586275+0000","last_peered":"2024-09-11T23:18:50.586275+0000","last_clean":"2024-09-11T23:18:50.586275+0000","last_became_active":"2024-09-11T23:18:49.013611+0000","last_became_peered":"2024-09-11T23:18:49.013611+0000","last_unstale":"2024-09-11T23:18:50.586275+0000","last_undegraded":"2024-09-11T23:18:50.586275+0000","last_fullsized":"2024-09-11T23:18:50.586275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:09.280069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.031657+0000","last_change":"2024-09-11T23:18:48.009617+0000","last_active":"2024-09-11T23:18:49.031657+0000","last_peered":"2024-09-11T23:18:49.031657+0000","last_clean":"2024-09-11T23:18:49.031657+0000","last_became_active":"2024-09-11T23:18:48.009195+0000","last_became_peered":"2024-09-11T23:18:48.009195+0000","last_unstale":"2024-09-11T23:18:49.031657+0000","last_undegraded":"2024-09-11T23:18:49.031657+0000","last_fullsized":"2024-09-11T23:18:49.031657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:19.037305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011847+0000","last_change":"2024-09-11T23:18:49.012656+0000","last_active":"2024-09-11T23:18:50.011847+0000","last_peered":"2024-09-11T23:18:50.011847+0000","last_clean":"2024-09-11T23:18:50.011847+0000","last_became_active":"2024-09-11T23:18:49.012305+0000","last_became_peered":"2024-09-11T23:18:49.012305+0000","last_unstale":"2024-09-11T23:18:50.011847+0000","last_undegraded":"2024-09-11T23:18:50.011847+0000","last_fullsized":"2024-09-11T23:18:50.011847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:46.582189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.002677+0000","last_change":"2024-09-11T23:18:48.005217+0000","last_active":"2024-09-11T23:18:49.002677+0000","last_peered":"2024-09-11T23:18:49.002677+0000","last_clean":"2024-09-11T23:18:49.002677+0000","last_became_active":"2024-09-11T23:18:48.004931+0000","last_became_peered":"2024-09-11T23:18:48.004931+0000","last_unstale":"2024-09-11T23:18:49.002677+0000","last_undegraded":"2024-09-11T23:18:49.002677+0000","last_fullsized":"2024-09-11T23:18:49.002677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:13.445123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.027344+0000","last_change":"2024-09-11T23:18:49.027344+0000","last_active":"2024-09-11T23:18:49.027344+0000","last_peered":"2024-09-11T23:18:49.027344+0000","last_clean":"2024-09-11T23:18:49.027344+0000","last_became_active":"2024-09-11T23:18:49.027022+0000","last_became_peered":"2024-09-11T23:18:49.027022+0000","last_unstale":"2024-09-11T23:18:49.027344+0000","last_undegraded":"2024-09-11T23:18:49.027344+0000","last_fullsized":"2024-09-11T23:18:49.027344+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:44.169273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.015580+0000","last_change":"2024-09-11T23:18:48.011606+0000","last_active":"2024-09-11T23:18:49.015580+0000","last_peered":"2024-09-11T23:18:49.015580+0000","last_clean":"2024-09-11T23:18:49.015580+0000","last_became_active":"2024-09-11T23:18:48.011355+0000","last_became_peered":"2024-09-11T23:18:48.011355+0000","last_unstale":"2024-09-11T23:18:49.015580+0000","last_undegraded":"2024-09-11T23:18:49.015580+0000","last_fullsized":"2024-09-11T23:18:49.015580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:51.349730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.020551+0000","last_change":"2024-09-11T23:18:49.014470+0000","last_active":"2024-09-11T23:18:49.020551+0000","last_peered":"2024-09-11T23:18:49.020551+0000","last_clean":"2024-09-11T23:18:49.020551+0000","last_became_active":"2024-09-11T23:18:49.013737+0000","last_became_peered":"2024-09-11T23:18:49.013737+0000","last_unstale":"2024-09-11T23:18:49.020551+0000","last_undegraded":"2024-09-11T23:18:49.020551+0000","last_fullsized":"2024-09-11T23:18:49.020551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:44.884982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.005691+0000","last_change":"2024-09-11T23:18:48.006018+0000","last_active":"2024-09-11T23:18:49.005691+0000","last_peered":"2024-09-11T23:18:49.005691+0000","last_clean":"2024-09-11T23:18:49.005691+0000","last_became_active":"2024-09-11T23:18:48.005721+0000","last_became_peered":"2024-09-11T23:18:48.005721+0000","last_unstale":"2024-09-11T23:18:49.005691+0000","last_undegraded":"2024-09-11T23:18:49.005691+0000","last_fullsized":"2024-09-11T23:18:49.005691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:00.748473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.016200+0000","last_change":"2024-09-11T23:18:49.010494+0000","last_active":"2024-09-11T23:18:49.016200+0000","last_peered":"2024-09-11T23:18:49.016200+0000","last_clean":"2024-09-11T23:18:49.016200+0000","last_became_active":"2024-09-11T23:18:49.010206+0000","last_became_peered":"2024-09-11T23:18:49.010206+0000","last_unstale":"2024-09-11T23:18:49.016200+0000","last_undegraded":"2024-09-11T23:18:49.016200+0000","last_fullsized":"2024-09-11T23:18:49.016200+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:52.437981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.011307+0000","last_change":"2024-09-11T23:18:48.012601+0000","last_active":"2024-09-11T23:18:49.011307+0000","last_peered":"2024-09-11T23:18:49.011307+0000","last_clean":"2024-09-11T23:18:49.011307+0000","last_became_active":"2024-09-11T23:18:48.010086+0000","last_became_peered":"2024-09-11T23:18:48.010086+0000","last_unstale":"2024-09-11T23:18:49.011307+0000","last_undegraded":"2024-09-11T23:18:49.011307+0000","last_fullsized":"2024-09-11T23:18:49.011307+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:22.408272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586065+0000","last_change":"2024-09-11T23:18:49.009424+0000","last_active":"2024-09-11T23:18:50.586065+0000","last_peered":"2024-09-11T23:18:50.586065+0000","last_clean":"2024-09-11T23:18:50.586065+0000","last_became_active":"2024-09-11T23:18:49.008854+0000","last_became_peered":"2024-09-11T23:18:49.008854+0000","last_unstale":"2024-09-11T23:18:50.586065+0000","last_undegraded":"2024-09-11T23:18:50.586065+0000","last_fullsized":"2024-09-11T23:18:50.586065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:54.389826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012956+0000","last_change":"2024-09-11T23:18:48.000946+0000","last_active":"2024-09-11T23:18:50.012956+0000","last_peered":"2024-09-11T23:18:50.012956+0000","last_clean":"2024-09-11T23:18:50.012956+0000","last_became_active":"2024-09-11T23:18:48.000299+0000","last_became_peered":"2024-09-11T23:18:48.000299+0000","last_unstale":"2024-09-11T23:18:50.012956+0000","last_undegraded":"2024-09-11T23:18:50.012956+0000","last_fullsized":"2024-09-11T23:18:50.012956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:19.403184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011694+0000","last_change":"2024-09-11T23:18:49.000439+0000","last_active":"2024-09-11T23:18:50.011694+0000","last_peered":"2024-09-11T23:18:50.011694+0000","last_clean":"2024-09-11T23:18:50.011694+0000","last_became_active":"2024-09-11T23:18:49.000122+0000","last_became_peered":"2024-09-11T23:18:49.000122+0000","last_unstale":"2024-09-11T23:18:50.011694+0000","last_undegraded":"2024-09-11T23:18:50.011694+0000","last_fullsized":"2024-09-11T23:18:50.011694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:08.846324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586132+0000","last_change":"2024-09-11T23:18:48.016472+0000","last_active":"2024-09-11T23:18:50.586132+0000","last_peered":"2024-09-11T23:18:50.586132+0000","last_clean":"2024-09-11T23:18:50.586132+0000","last_became_active":"2024-09-11T23:18:48.016190+0000","last_became_peered":"2024-09-11T23:18:48.016190+0000","last_unstale":"2024-09-11T23:18:50.586132+0000","last_undegraded":"2024-09-11T23:18:50.586132+0000","last_fullsized":"2024-09-11T23:18:50.586132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:19.031495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.020509+0000","last_change":"2024-09-11T23:18:49.012546+0000","last_active":"2024-09-11T23:18:49.020509+0000","last_peered":"2024-09-11T23:18:49.020509+0000","last_clean":"2024-09-11T23:18:49.020509+0000","last_became_active":"2024-09-11T23:18:49.012189+0000","last_became_peered":"2024-09-11T23:18:49.012189+0000","last_unstale":"2024-09-11T23:18:49.020509+0000","last_undegraded":"2024-09-11T23:18:49.020509+0000","last_fullsized":"2024-09-11T23:18:49.020509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:49.321225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:48.999430+0000","last_change":"2024-09-11T23:18:48.008963+0000","last_active":"2024-09-11T23:18:48.999430+0000","last_peered":"2024-09-11T23:18:48.999430+0000","last_clean":"2024-09-11T23:18:48.999430+0000","last_became_active":"2024-09-11T23:18:48.008162+0000","last_became_peered":"2024-09-11T23:18:48.008162+0000","last_unstale":"2024-09-11T23:18:48.999430+0000","last_undegraded":"2024-09-11T23:18:48.999430+0000","last_fullsized":"2024-09-11T23:18:48.999430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:30.420649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":189,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.000785+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:18:49.000785+0000","last_peered":"2024-09-11T23:18:49.000785+0000","last_clean":"2024-09-11T23:18:49.000785+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:18:49.000785+0000","last_undegraded":"2024-09-11T23:18:49.000785+0000","last_fullsized":"2024-09-11T23:18:49.000785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476753,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":729689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476752,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":139847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476751,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":139903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476751,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":368640,"data_stored":139335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":348160,"data_stored":132456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":942080,"data_stored":722824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":147165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":145601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:18:53.576 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:18:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.764+0000 7f5281400640 1 Processor -- start 2024-09-11T23:18:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.765+0000 7f5281400640 1 -- start start 2024-09-11T23:18:53.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.766+0000 7f5281400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f527c15ceb0 0x7f527c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.766+0000 7f5281400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f527c15d390 con 0x7f527c15ca40 2024-09-11T23:18:53.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.766+0000 7f5281400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f527c15d670 con 0x7f527c0d02a0 2024-09-11T23:18:53.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.766+0000 7f5281400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f527c15d950 con 0x7f527c15ceb0 2024-09-11T23:18:53.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.766+0000 7f5279e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f527c15ca40 0x7f527c15e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50754/0 (socket says 172.21.15.144:50754) 2024-09-11T23:18:53.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.766+0000 7f5279e00640 1 -- 172.21.15.144:0/367032288 learned_addr learned my addr 172.21.15.144:0/367032288 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:53.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.766+0000 7f527b200640 1 --2- 172.21.15.144:0/367032288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f527c15ceb0 0x7f527c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.766+0000 7f5279400640 1 -- 172.21.15.144:0/367032288 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2429677382 0 0) 0x7f527c15d390 con 0x7f527c15ca40 2024-09-11T23:18:53.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.767+0000 7f5279400640 1 -- 172.21.15.144:0/367032288 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5260003520 con 0x7f527c15ca40 2024-09-11T23:18:53.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.767+0000 7f5279400640 1 -- 172.21.15.144:0/367032288 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3639340574 0 0) 0x7f527c15d670 con 0x7f527c0d02a0 2024-09-11T23:18:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.767+0000 7f5279400640 1 -- 172.21.15.144:0/367032288 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f527c15d390 con 0x7f527c0d02a0 2024-09-11T23:18:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.767+0000 7f5279400640 1 -- 172.21.15.144:0/367032288 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1594047984 0 0) 0x7f5260003520 con 0x7f527c15ca40 2024-09-11T23:18:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.767+0000 7f5279400640 1 -- 172.21.15.144:0/367032288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f527c15ceb0 msgr2=0x7f527c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.767+0000 7f5279400640 1 --2- 172.21.15.144:0/367032288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f527c15ceb0 0x7f527c1594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.767+0000 7f5279400640 1 -- 172.21.15.144:0/367032288 >> v1:172.21.15.165:6789/0 conn(0x7f527c0d02a0 legacy=0x7f527c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.767+0000 7f5279400640 1 -- 172.21.15.144:0/367032288 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527c15dc30 con 0x7f527c15ca40 2024-09-11T23:18:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.767+0000 7f5279400640 1 -- 172.21.15.144:0/367032288 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f5268001670 con 0x7f527c15ca40 2024-09-11T23:18:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.767+0000 7f527b200640 1 --2- 172.21.15.144:0/367032288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f527c15ceb0 0x7f527c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.767+0000 7f5279400640 1 -- 172.21.15.144:0/367032288 >> v1:172.21.15.144:6789/0 conn(0x7f527c15ca40 legacy=0x7f527c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.767+0000 7f5279400640 1 --2- 172.21.15.144:0/367032288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f527c15ceb0 0x7f5260003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.767+0000 7f5279400640 1 --2- 172.21.15.144:0/367032288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5260004100 0x7f5260004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.767+0000 7f5279400640 1 --2- 172.21.15.144:0/367032288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5260004d40 0x7f52600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.767+0000 7f5279400640 1 -- 172.21.15.144:0/367032288 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f527c15d950 con 0x7f5260004100 2024-09-11T23:18:53.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.767+0000 7f5279400640 1 -- 172.21.15.144:0/367032288 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f526000bb80 con 0x7f5260004d40 2024-09-11T23:18:53.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.767+0000 7f5279400640 1 -- 172.21.15.144:0/367032288 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f526000bd80 con 0x7f527c15ceb0 2024-09-11T23:18:53.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.767+0000 7f5279e00640 1 --2- 172.21.15.144:0/367032288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5260004100 0x7f5260004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.767+0000 7f527a800640 1 --2- 172.21.15.144:0/367032288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f527c15ceb0 0x7f5260003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.767+0000 7f527b200640 1 --2- 172.21.15.144:0/367032288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5260004d40 0x7f52600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.768+0000 7f527a800640 1 -- 172.21.15.144:0/367032288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5260004d40 msgr2=0x7f52600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:53.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.768+0000 7f527a800640 1 --2- 172.21.15.144:0/367032288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5260004d40 0x7f52600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.768+0000 7f527a800640 1 -- 172.21.15.144:0/367032288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5260004100 msgr2=0x7f5260004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:53.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.768+0000 7f527a800640 1 --2- 172.21.15.144:0/367032288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5260004100 0x7f5260004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.768+0000 7f527a800640 1 -- 172.21.15.144:0/367032288 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5260003520 con 0x7f527c15ceb0 2024-09-11T23:18:53.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.768+0000 7f5279e00640 1 --2- 172.21.15.144:0/367032288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5260004100 0x7f5260004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:18:53.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.769+0000 7f527a800640 1 --2- 172.21.15.144:0/367032288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f527c15ceb0 0x7f5260003b70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f526c0018d0 tx=0x7f5260005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dd3a6556d4d3c0e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:53.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.769+0000 7f5279400640 1 -- 172.21.15.144:0/367032288 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c0014f0 con 0x7f527c15ceb0 2024-09-11T23:18:53.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.769+0000 7f5279400640 1 -- 172.21.15.144:0/367032288 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f526c0052d0 con 0x7f527c15ceb0 2024-09-11T23:18:53.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.769+0000 7f5279400640 1 -- 172.21.15.144:0/367032288 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c02aca0 con 0x7f527c15ceb0 2024-09-11T23:18:53.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.770+0000 7f5281400640 1 -- 172.21.15.144:0/367032288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f527c15ceb0 msgr2=0x7f5260003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.770+0000 7f5281400640 1 --2- 172.21.15.144:0/367032288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f527c15ceb0 0x7f5260003b70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f526c0018d0 tx=0x7f5260005830 comp rx=0 tx=0).stop 2024-09-11T23:18:53.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.770+0000 7f527b200640 1 -- 172.21.15.144:0/367032288 reap_dead start 2024-09-11T23:18:53.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.770+0000 7f5281400640 1 -- 172.21.15.144:0/367032288 shutdown_connections 2024-09-11T23:18:53.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.770+0000 7f5281400640 1 -- 172.21.15.144:0/367032288 >> 172.21.15.144:0/367032288 conn(0x7f527c062cc0 msgr2=0x7f527c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:53.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.770+0000 7f5281400640 1 -- 172.21.15.144:0/367032288 shutdown_connections 2024-09-11T23:18:53.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.770+0000 7f5281400640 1 -- 172.21.15.144:0/367032288 wait complete. 2024-09-11T23:18:53.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.771+0000 7f5281400640 1 Processor -- start 2024-09-11T23:18:53.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.772+0000 7f5281400640 1 -- start start 2024-09-11T23:18:53.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.772+0000 7f5281400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f527c15ceb0 0x7f527c14ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.773+0000 7f5281400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f527c15b880 0x7f527c15bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.773+0000 7f5281400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f527c1597d0 0x7f527c159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.773+0000 7f5281400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f527c155b90 con 0x7f527c15ceb0 2024-09-11T23:18:53.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.773+0000 7f5281400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f527c15eb40 con 0x7f527c15b880 2024-09-11T23:18:53.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.773+0000 7f5281400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f527c155d10 con 0x7f527c1597d0 2024-09-11T23:18:53.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.773+0000 7f527a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f527c15ceb0 0x7f527c14ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.773+0000 7f527a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f527c15ceb0 0x7f527c14ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50140/0 (socket says 172.21.15.144:50140) 2024-09-11T23:18:53.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.773+0000 7f527a800640 1 -- 172.21.15.144:0/3691544976 learned_addr learned my addr 172.21.15.144:0/3691544976 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:53.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.773+0000 7f527b200640 1 --2- 172.21.15.144:0/3691544976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f527c1597d0 0x7f527c159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.773+0000 7f5279e00640 1 --2- 172.21.15.144:0/3691544976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f527c15b880 0x7f527c15bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.773+0000 7f527a800640 1 -- 172.21.15.144:0/3691544976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f527c1597d0 msgr2=0x7f527c159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.773+0000 7f527a800640 1 --2- 172.21.15.144:0/3691544976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f527c1597d0 0x7f527c159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.773+0000 7f527a800640 1 -- 172.21.15.144:0/3691544976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f527c15b880 msgr2=0x7f527c15bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.773+0000 7f527a800640 1 --2- 172.21.15.144:0/3691544976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f527c15b880 0x7f527c15bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.773+0000 7f527a800640 1 -- 172.21.15.144:0/3691544976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527c14ff30 con 0x7f527c15ceb0 2024-09-11T23:18:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.773+0000 7f5279e00640 1 --2- 172.21.15.144:0/3691544976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f527c15b880 0x7f527c15bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.774+0000 7f527a800640 1 --2- 172.21.15.144:0/3691544976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f527c15ceb0 0x7f527c14ac20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f526c02a730 tx=0x7f526c0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.774+0000 7f5272a00640 1 -- 172.21.15.144:0/3691544976 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c03f020 con 0x7f527c15ceb0 2024-09-11T23:18:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.774+0000 7f5272a00640 1 -- 172.21.15.144:0/3691544976 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f526c006e50 con 0x7f527c15ceb0 2024-09-11T23:18:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.774+0000 7f5281400640 1 -- 172.21.15.144:0/3691544976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f527c150210 con 0x7f527c15ceb0 2024-09-11T23:18:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.774+0000 7f5272a00640 1 -- 172.21.15.144:0/3691544976 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c037040 con 0x7f527c15ceb0 2024-09-11T23:18:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.774+0000 7f5281400640 1 -- 172.21.15.144:0/3691544976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f527c1507d0 con 0x7f527c15ceb0 2024-09-11T23:18:53.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.775+0000 7f5281400640 1 -- 172.21.15.144:0/3691544976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f527c15c240 con 0x7f527c15ceb0 2024-09-11T23:18:53.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.776+0000 7f5272a00640 1 -- 172.21.15.144:0/3691544976 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f526c042020 con 0x7f527c15ceb0 2024-09-11T23:18:53.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.777+0000 7f5272a00640 1 --2- 172.21.15.144:0/3691544976 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f525c06be30 0x7f525c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:53.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.777+0000 7f5272a00640 1 -- 172.21.15.144:0/3691544976 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f526c0aafb0 con 0x7f527c15ceb0 2024-09-11T23:18:53.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.777+0000 7f5279e00640 1 --2- 172.21.15.144:0/3691544976 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f525c06be30 0x7f525c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:53.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.778+0000 7f5279e00640 1 --2- 172.21.15.144:0/3691544976 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f525c06be30 0x7f525c06e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f527c0cdab0 tx=0x7f5268009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:53.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.782+0000 7f5272a00640 1 -- 172.21.15.144:0/3691544976 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f526c049020 con 0x7f527c15ceb0 2024-09-11T23:18:53.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.951+0000 7f5281400640 1 -- 172.21.15.144:0/3691544976 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f527c15d670 con 0x7f525c06be30 2024-09-11T23:18:53.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.961+0000 7f5272a00640 1 -- 172.21.15.144:0/3691544976 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251877 (secure 0 0 0) 0x7f527c15d670 con 0x7f525c06be30 2024-09-11T23:18:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:53.967 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:18:53.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.965+0000 7f5281400640 1 -- 172.21.15.144:0/3691544976 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f525c06be30 msgr2=0x7f525c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.965+0000 7f5281400640 1 --2- 172.21.15.144:0/3691544976 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f525c06be30 0x7f525c06e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f527c0cdab0 tx=0x7f5268009040 comp rx=0 tx=0).stop 2024-09-11T23:18:53.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.965+0000 7f5281400640 1 -- 172.21.15.144:0/3691544976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f527c15ceb0 msgr2=0x7f527c14ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:53.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.965+0000 7f5281400640 1 --2- 172.21.15.144:0/3691544976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f527c15ceb0 0x7f527c14ac20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f526c02a730 tx=0x7f526c0012d0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.965+0000 7f5281400640 1 -- 172.21.15.144:0/3691544976 shutdown_connections 2024-09-11T23:18:53.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.965+0000 7f5281400640 1 --2- 172.21.15.144:0/3691544976 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f525c06be30 0x7f525c06e2f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.965+0000 7f5281400640 1 --2- 172.21.15.144:0/3691544976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f527c1597d0 0x7f527c159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.965+0000 7f5281400640 1 --2- 172.21.15.144:0/3691544976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f527c15b880 0x7f527c15bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.965+0000 7f5281400640 1 --2- 172.21.15.144:0/3691544976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f527c15ceb0 0x7f527c14ac20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:53.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.965+0000 7f5281400640 1 -- 172.21.15.144:0/3691544976 >> 172.21.15.144:0/3691544976 conn(0x7f527c062cc0 msgr2=0x7f527c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:53.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.966+0000 7f5281400640 1 -- 172.21.15.144:0/3691544976 shutdown_connections 2024-09-11T23:18:53.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:53.966+0000 7f5281400640 1 -- 172.21.15.144:0/3691544976 wait complete. 2024-09-11T23:18:53.983 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-09-11T23:18:53.173454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224424,"kb_used_data":4024,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750296,"statfs":{"total":773094113280,"available":772864303104,"internally_reserved":0,"allocated":4120576,"data_stored":2296820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001325"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028722+0000","last_change":"2024-09-11T23:18:49.023570+0000","last_active":"2024-09-11T23:18:49.028722+0000","last_peered":"2024-09-11T23:18:49.028722+0000","last_clean":"2024-09-11T23:18:49.028722+0000","last_became_active":"2024-09-11T23:18:49.022977+0000","last_became_peered":"2024-09-11T23:18:49.022977+0000","last_unstale":"2024-09-11T23:18:49.028722+0000","last_undegraded":"2024-09-11T23:18:49.028722+0000","last_fullsized":"2024-09-11T23:18:49.028722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:01.751435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.588089+0000","last_change":"2024-09-11T23:18:49.021369+0000","last_active":"2024-09-11T23:18:50.588089+0000","last_peered":"2024-09-11T23:18:50.588089+0000","last_clean":"2024-09-11T23:18:50.588089+0000","last_became_active":"2024-09-11T23:18:49.019525+0000","last_became_peered":"2024-09-11T23:18:49.019525+0000","last_unstale":"2024-09-11T23:18:50.588089+0000","last_undegraded":"2024-09-11T23:18:50.588089+0000","last_fullsized":"2024-09-11T23:18:50.588089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:22.587749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011797+0000","last_change":"2024-09-11T23:18:49.024403+0000","last_active":"2024-09-11T23:18:50.011797+0000","last_peered":"2024-09-11T23:18:50.011797+0000","last_clean":"2024-09-11T23:18:50.011797+0000","last_became_active":"2024-09-11T23:18:49.023902+0000","last_became_peered":"2024-09-11T23:18:49.023902+0000","last_unstale":"2024-09-11T23:18:50.011797+0000","last_undegraded":"2024-09-11T23:18:50.011797+0000","last_fullsized":"2024-09-11T23:18:50.011797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:47.530225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028571+0000","last_change":"2024-09-11T23:18:49.023773+0000","last_active":"2024-09-11T23:18:49.028571+0000","last_peered":"2024-09-11T23:18:49.028571+0000","last_clean":"2024-09-11T23:18:49.028571+0000","last_became_active":"2024-09-11T23:18:49.022616+0000","last_became_peered":"2024-09-11T23:18:49.022616+0000","last_unstale":"2024-09-11T23:18:49.028571+0000","last_undegraded":"2024-09-11T23:18:49.028571+0000","last_fullsized":"2024-09-11T23:18:49.028571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:52.437981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586124+0000","last_change":"2024-09-11T23:18:49.007229+0000","last_active":"2024-09-11T23:18:50.586124+0000","last_peered":"2024-09-11T23:18:50.586124+0000","last_clean":"2024-09-11T23:18:50.586124+0000","last_became_active":"2024-09-11T23:18:49.006975+0000","last_became_peered":"2024-09-11T23:18:49.006975+0000","last_unstale":"2024-09-11T23:18:50.586124+0000","last_undegraded":"2024-09-11T23:18:50.586124+0000","last_fullsized":"2024-09-11T23:18:50.586124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:03.728796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586606+0000","last_change":"2024-09-11T23:18:49.018644+0000","last_active":"2024-09-11T23:18:50.586606+0000","last_peered":"2024-09-11T23:18:50.586606+0000","last_clean":"2024-09-11T23:18:50.586606+0000","last_became_active":"2024-09-11T23:18:49.018385+0000","last_became_peered":"2024-09-11T23:18:49.018385+0000","last_unstale":"2024-09-11T23:18:50.586606+0000","last_undegraded":"2024-09-11T23:18:50.586606+0000","last_fullsized":"2024-09-11T23:18:50.586606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:45.542576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.027054+0000","last_change":"2024-09-11T23:18:49.019807+0000","last_active":"2024-09-11T23:18:49.027054+0000","last_peered":"2024-09-11T23:18:49.027054+0000","last_clean":"2024-09-11T23:18:49.027054+0000","last_became_active":"2024-09-11T23:18:49.019507+0000","last_became_peered":"2024-09-11T23:18:49.019507+0000","last_unstale":"2024-09-11T23:18:49.027054+0000","last_undegraded":"2024-09-11T23:18:49.027054+0000","last_fullsized":"2024-09-11T23:18:49.027054+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.721415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.017203+0000","last_change":"2024-09-11T23:18:49.010390+0000","last_active":"2024-09-11T23:18:49.017203+0000","last_peered":"2024-09-11T23:18:49.017203+0000","last_clean":"2024-09-11T23:18:49.017203+0000","last_became_active":"2024-09-11T23:18:49.008190+0000","last_became_peered":"2024-09-11T23:18:49.008190+0000","last_unstale":"2024-09-11T23:18:49.017203+0000","last_undegraded":"2024-09-11T23:18:49.017203+0000","last_fullsized":"2024-09-11T23:18:49.017203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:59.469342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.013000+0000","last_change":"2024-09-11T23:18:49.011361+0000","last_active":"2024-09-11T23:18:50.013000+0000","last_peered":"2024-09-11T23:18:50.013000+0000","last_clean":"2024-09-11T23:18:50.013000+0000","last_became_active":"2024-09-11T23:18:49.011101+0000","last_became_peered":"2024-09-11T23:18:49.011101+0000","last_unstale":"2024-09-11T23:18:50.013000+0000","last_undegraded":"2024-09-11T23:18:50.013000+0000","last_fullsized":"2024-09-11T23:18:50.013000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:59.469342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028654+0000","last_change":"2024-09-11T23:18:49.025064+0000","last_active":"2024-09-11T23:18:49.028654+0000","last_peered":"2024-09-11T23:18:49.028654+0000","last_clean":"2024-09-11T23:18:49.028654+0000","last_became_active":"2024-09-11T23:18:49.024637+0000","last_became_peered":"2024-09-11T23:18:49.024637+0000","last_unstale":"2024-09-11T23:18:49.028654+0000","last_undegraded":"2024-09-11T23:18:49.028654+0000","last_fullsized":"2024-09-11T23:18:49.028654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:35.168942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028217+0000","last_change":"2024-09-11T23:18:49.023722+0000","last_active":"2024-09-11T23:18:49.028217+0000","last_peered":"2024-09-11T23:18:49.028217+0000","last_clean":"2024-09-11T23:18:49.028217+0000","last_became_active":"2024-09-11T23:18:49.022908+0000","last_became_peered":"2024-09-11T23:18:49.022908+0000","last_unstale":"2024-09-11T23:18:49.028217+0000","last_undegraded":"2024-09-11T23:18:49.028217+0000","last_fullsized":"2024-09-11T23:18:49.028217+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:36.393454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011452+0000","last_change":"2024-09-11T23:18:49.008770+0000","last_active":"2024-09-11T23:18:50.011452+0000","last_peered":"2024-09-11T23:18:50.011452+0000","last_clean":"2024-09-11T23:18:50.011452+0000","last_became_active":"2024-09-11T23:18:49.008476+0000","last_became_peered":"2024-09-11T23:18:49.008476+0000","last_unstale":"2024-09-11T23:18:50.011452+0000","last_undegraded":"2024-09-11T23:18:50.011452+0000","last_fullsized":"2024-09-11T23:18:50.011452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.721415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586138+0000","last_change":"2024-09-11T23:18:49.028967+0000","last_active":"2024-09-11T23:18:50.586138+0000","last_peered":"2024-09-11T23:18:50.586138+0000","last_clean":"2024-09-11T23:18:50.586138+0000","last_became_active":"2024-09-11T23:18:49.028293+0000","last_became_peered":"2024-09-11T23:18:49.028293+0000","last_unstale":"2024-09-11T23:18:50.586138+0000","last_undegraded":"2024-09-11T23:18:50.586138+0000","last_fullsized":"2024-09-11T23:18:50.586138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:08.235979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586726+0000","last_change":"2024-09-11T23:18:49.005657+0000","last_active":"2024-09-11T23:18:50.586726+0000","last_peered":"2024-09-11T23:18:50.586726+0000","last_clean":"2024-09-11T23:18:50.586726+0000","last_became_active":"2024-09-11T23:18:49.005387+0000","last_became_peered":"2024-09-11T23:18:49.005387+0000","last_unstale":"2024-09-11T23:18:50.586726+0000","last_undegraded":"2024-09-11T23:18:50.586726+0000","last_fullsized":"2024-09-11T23:18:50.586726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:54.924531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012474+0000","last_change":"2024-09-11T23:18:49.010416+0000","last_active":"2024-09-11T23:18:50.012474+0000","last_peered":"2024-09-11T23:18:50.012474+0000","last_clean":"2024-09-11T23:18:50.012474+0000","last_became_active":"2024-09-11T23:18:49.010120+0000","last_became_peered":"2024-09-11T23:18:49.010120+0000","last_unstale":"2024-09-11T23:18:50.012474+0000","last_undegraded":"2024-09-11T23:18:50.012474+0000","last_fullsized":"2024-09-11T23:18:50.012474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:30.972000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.012104+0000","last_change":"2024-09-11T23:18:49.008741+0000","last_active":"2024-09-11T23:18:49.012104+0000","last_peered":"2024-09-11T23:18:49.012104+0000","last_clean":"2024-09-11T23:18:49.012104+0000","last_became_active":"2024-09-11T23:18:49.008543+0000","last_became_peered":"2024-09-11T23:18:49.008543+0000","last_unstale":"2024-09-11T23:18:49.012104+0000","last_undegraded":"2024-09-11T23:18:49.012104+0000","last_fullsized":"2024-09-11T23:18:49.012104+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:00.772427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.024083+0000","last_change":"2024-09-11T23:18:49.017267+0000","last_active":"2024-09-11T23:18:49.024083+0000","last_peered":"2024-09-11T23:18:49.024083+0000","last_clean":"2024-09-11T23:18:49.024083+0000","last_became_active":"2024-09-11T23:18:49.016994+0000","last_became_peered":"2024-09-11T23:18:49.016994+0000","last_unstale":"2024-09-11T23:18:49.024083+0000","last_undegraded":"2024-09-11T23:18:49.024083+0000","last_fullsized":"2024-09-11T23:18:49.024083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:04.572090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.588162+0000","last_change":"2024-09-11T23:18:49.016833+0000","last_active":"2024-09-11T23:18:50.588162+0000","last_peered":"2024-09-11T23:18:50.588162+0000","last_clean":"2024-09-11T23:18:50.588162+0000","last_became_active":"2024-09-11T23:18:49.009287+0000","last_became_peered":"2024-09-11T23:18:49.009287+0000","last_unstale":"2024-09-11T23:18:50.588162+0000","last_undegraded":"2024-09-11T23:18:50.588162+0000","last_fullsized":"2024-09-11T23:18:50.588162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:55.162354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587912+0000","last_change":"2024-09-11T23:18:49.024077+0000","last_active":"2024-09-11T23:18:50.587912+0000","last_peered":"2024-09-11T23:18:50.587912+0000","last_clean":"2024-09-11T23:18:50.587912+0000","last_became_active":"2024-09-11T23:18:49.023804+0000","last_became_peered":"2024-09-11T23:18:49.023804+0000","last_unstale":"2024-09-11T23:18:50.587912+0000","last_undegraded":"2024-09-11T23:18:50.587912+0000","last_fullsized":"2024-09-11T23:18:50.587912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:24.356397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586526+0000","last_change":"2024-09-11T23:18:49.024077+0000","last_active":"2024-09-11T23:18:50.586526+0000","last_peered":"2024-09-11T23:18:50.586526+0000","last_clean":"2024-09-11T23:18:50.586526+0000","last_became_active":"2024-09-11T23:18:49.023773+0000","last_became_peered":"2024-09-11T23:18:49.023773+0000","last_unstale":"2024-09-11T23:18:50.586526+0000","last_undegraded":"2024-09-11T23:18:50.586526+0000","last_fullsized":"2024-09-11T23:18:50.586526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:26.306962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011922+0000","last_change":"2024-09-11T23:18:49.013009+0000","last_active":"2024-09-11T23:18:50.011922+0000","last_peered":"2024-09-11T23:18:50.011922+0000","last_clean":"2024-09-11T23:18:50.011922+0000","last_became_active":"2024-09-11T23:18:49.012755+0000","last_became_peered":"2024-09-11T23:18:49.012755+0000","last_unstale":"2024-09-11T23:18:50.011922+0000","last_undegraded":"2024-09-11T23:18:50.011922+0000","last_fullsized":"2024-09-11T23:18:50.011922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:35.168942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012053+0000","last_change":"2024-09-11T23:18:49.009624+0000","last_active":"2024-09-11T23:18:50.012053+0000","last_peered":"2024-09-11T23:18:50.012053+0000","last_clean":"2024-09-11T23:18:50.012053+0000","last_became_active":"2024-09-11T23:18:49.009160+0000","last_became_peered":"2024-09-11T23:18:49.009160+0000","last_unstale":"2024-09-11T23:18:50.012053+0000","last_undegraded":"2024-09-11T23:18:50.012053+0000","last_fullsized":"2024-09-11T23:18:50.012053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:44.169273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.021931+0000","last_change":"2024-09-11T23:18:49.016619+0000","last_active":"2024-09-11T23:18:49.021931+0000","last_peered":"2024-09-11T23:18:49.021931+0000","last_clean":"2024-09-11T23:18:49.021931+0000","last_became_active":"2024-09-11T23:18:49.016367+0000","last_became_peered":"2024-09-11T23:18:49.016367+0000","last_unstale":"2024-09-11T23:18:49.021931+0000","last_undegraded":"2024-09-11T23:18:49.021931+0000","last_fullsized":"2024-09-11T23:18:49.021931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:08.846324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011169+0000","last_change":"2024-09-11T23:18:49.012178+0000","last_active":"2024-09-11T23:18:50.011169+0000","last_peered":"2024-09-11T23:18:50.011169+0000","last_clean":"2024-09-11T23:18:50.011169+0000","last_became_active":"2024-09-11T23:18:49.008877+0000","last_became_peered":"2024-09-11T23:18:49.008877+0000","last_unstale":"2024-09-11T23:18:50.011169+0000","last_undegraded":"2024-09-11T23:18:50.011169+0000","last_fullsized":"2024-09-11T23:18:50.011169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:02.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":6,"reported_epoch":33,"state":"active","last_fresh":"2024-09-11T23:18:49.031327+0000","last_change":"2024-09-11T23:18:49.031264+0000","last_active":"2024-09-11T23:18:49.031327+0000","last_peered":"2024-09-11T23:18:49.031327+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"2024-09-11T23:18:49.031264+0000","last_became_peered":"2024-09-11T23:18:49.031264+0000","last_unstale":"2024-09-11T23:18:49.031327+0000","last_undegraded":"2024-09-11T23:18:49.031327+0000","last_fullsized":"2024-09-11T23:18:49.031327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.588238+0000","last_change":"2024-09-11T23:18:49.017955+0000","last_active":"2024-09-11T23:18:50.588238+0000","last_peered":"2024-09-11T23:18:50.588238+0000","last_clean":"2024-09-11T23:18:50.588238+0000","last_became_active":"2024-09-11T23:18:49.008731+0000","last_became_peered":"2024-09-11T23:18:49.008731+0000","last_unstale":"2024-09-11T23:18:50.588238+0000","last_undegraded":"2024-09-11T23:18:50.588238+0000","last_fullsized":"2024-09-11T23:18:50.588238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:38.477516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028782+0000","last_change":"2024-09-11T23:18:49.023143+0000","last_active":"2024-09-11T23:18:49.028782+0000","last_peered":"2024-09-11T23:18:49.028782+0000","last_clean":"2024-09-11T23:18:49.028782+0000","last_became_active":"2024-09-11T23:18:49.022916+0000","last_became_peered":"2024-09-11T23:18:49.022916+0000","last_unstale":"2024-09-11T23:18:49.028782+0000","last_undegraded":"2024-09-11T23:18:49.028782+0000","last_fullsized":"2024-09-11T23:18:49.028782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:42.935157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012197+0000","last_change":"2024-09-11T23:18:49.015459+0000","last_active":"2024-09-11T23:18:50.012197+0000","last_peered":"2024-09-11T23:18:50.012197+0000","last_clean":"2024-09-11T23:18:50.012197+0000","last_became_active":"2024-09-11T23:18:49.014648+0000","last_became_peered":"2024-09-11T23:18:49.014648+0000","last_unstale":"2024-09-11T23:18:50.012197+0000","last_undegraded":"2024-09-11T23:18:50.012197+0000","last_fullsized":"2024-09-11T23:18:50.012197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:49.663140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012050+0000","last_change":"2024-09-11T23:18:49.009617+0000","last_active":"2024-09-11T23:18:50.012050+0000","last_peered":"2024-09-11T23:18:50.012050+0000","last_clean":"2024-09-11T23:18:50.012050+0000","last_became_active":"2024-09-11T23:18:49.007209+0000","last_became_peered":"2024-09-11T23:18:49.007209+0000","last_unstale":"2024-09-11T23:18:50.012050+0000","last_undegraded":"2024-09-11T23:18:50.012050+0000","last_fullsized":"2024-09-11T23:18:50.012050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:20.040267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.019964+0000","last_change":"2024-09-11T23:18:49.012641+0000","last_active":"2024-09-11T23:18:49.019964+0000","last_peered":"2024-09-11T23:18:49.019964+0000","last_clean":"2024-09-11T23:18:49.019964+0000","last_became_active":"2024-09-11T23:18:49.012332+0000","last_became_peered":"2024-09-11T23:18:49.012332+0000","last_unstale":"2024-09-11T23:18:49.019964+0000","last_undegraded":"2024-09-11T23:18:49.019964+0000","last_fullsized":"2024-09-11T23:18:49.019964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:16.182623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.020434+0000","last_change":"2024-09-11T23:18:49.013323+0000","last_active":"2024-09-11T23:18:49.020434+0000","last_peered":"2024-09-11T23:18:49.020434+0000","last_clean":"2024-09-11T23:18:49.020434+0000","last_became_active":"2024-09-11T23:18:49.012492+0000","last_became_peered":"2024-09-11T23:18:49.012492+0000","last_unstale":"2024-09-11T23:18:49.020434+0000","last_undegraded":"2024-09-11T23:18:49.020434+0000","last_fullsized":"2024-09-11T23:18:49.020434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:23.411234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.019831+0000","last_change":"2024-09-11T23:18:49.014929+0000","last_active":"2024-09-11T23:18:49.019831+0000","last_peered":"2024-09-11T23:18:49.019831+0000","last_clean":"2024-09-11T23:18:49.019831+0000","last_became_active":"2024-09-11T23:18:49.014660+0000","last_became_peered":"2024-09-11T23:18:49.014660+0000","last_unstale":"2024-09-11T23:18:49.019831+0000","last_undegraded":"2024-09-11T23:18:49.019831+0000","last_fullsized":"2024-09-11T23:18:49.019831+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:05.424937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.022471+0000","last_change":"2024-09-11T23:18:49.019336+0000","last_active":"2024-09-11T23:18:49.022471+0000","last_peered":"2024-09-11T23:18:49.022471+0000","last_clean":"2024-09-11T23:18:49.022471+0000","last_became_active":"2024-09-11T23:18:49.019078+0000","last_became_peered":"2024-09-11T23:18:49.019078+0000","last_unstale":"2024-09-11T23:18:49.022471+0000","last_undegraded":"2024-09-11T23:18:49.022471+0000","last_fullsized":"2024-09-11T23:18:49.022471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:35.168942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.031200+0000","last_change":"2024-09-11T23:18:48.007751+0000","last_active":"2024-09-11T23:18:49.031200+0000","last_peered":"2024-09-11T23:18:49.031200+0000","last_clean":"2024-09-11T23:18:49.031200+0000","last_became_active":"2024-09-11T23:18:48.007453+0000","last_became_peered":"2024-09-11T23:18:48.007453+0000","last_unstale":"2024-09-11T23:18:49.031200+0000","last_undegraded":"2024-09-11T23:18:49.031200+0000","last_fullsized":"2024-09-11T23:18:49.031200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:18.222705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028706+0000","last_change":"2024-09-11T23:18:49.023248+0000","last_active":"2024-09-11T23:18:49.028706+0000","last_peered":"2024-09-11T23:18:49.028706+0000","last_clean":"2024-09-11T23:18:49.028706+0000","last_became_active":"2024-09-11T23:18:49.018856+0000","last_became_peered":"2024-09-11T23:18:49.018856+0000","last_unstale":"2024-09-11T23:18:49.028706+0000","last_undegraded":"2024-09-11T23:18:49.028706+0000","last_fullsized":"2024-09-11T23:18:49.028706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:14.448085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.024169+0000","last_change":"2024-09-11T23:18:48.015111+0000","last_active":"2024-09-11T23:18:49.024169+0000","last_peered":"2024-09-11T23:18:49.024169+0000","last_clean":"2024-09-11T23:18:49.024169+0000","last_became_active":"2024-09-11T23:18:48.014804+0000","last_became_peered":"2024-09-11T23:18:48.014804+0000","last_unstale":"2024-09-11T23:18:49.024169+0000","last_undegraded":"2024-09-11T23:18:49.024169+0000","last_fullsized":"2024-09-11T23:18:49.024169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:43.882021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012303+0000","last_change":"2024-09-11T23:18:49.008030+0000","last_active":"2024-09-11T23:18:50.012303+0000","last_peered":"2024-09-11T23:18:50.012303+0000","last_clean":"2024-09-11T23:18:50.012303+0000","last_became_active":"2024-09-11T23:18:49.007228+0000","last_became_peered":"2024-09-11T23:18:49.007228+0000","last_unstale":"2024-09-11T23:18:50.012303+0000","last_undegraded":"2024-09-11T23:18:50.012303+0000","last_fullsized":"2024-09-11T23:18:50.012303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:05.371678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587895+0000","last_change":"2024-09-11T23:18:48.010963+0000","last_active":"2024-09-11T23:18:50.587895+0000","last_peered":"2024-09-11T23:18:50.587895+0000","last_clean":"2024-09-11T23:18:50.587895+0000","last_became_active":"2024-09-11T23:18:48.010705+0000","last_became_peered":"2024-09-11T23:18:48.010705+0000","last_unstale":"2024-09-11T23:18:50.587895+0000","last_undegraded":"2024-09-11T23:18:50.587895+0000","last_fullsized":"2024-09-11T23:18:50.587895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:49.742344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028763+0000","last_change":"2024-09-11T23:18:49.023043+0000","last_active":"2024-09-11T23:18:49.028763+0000","last_peered":"2024-09-11T23:18:49.028763+0000","last_clean":"2024-09-11T23:18:49.028763+0000","last_became_active":"2024-09-11T23:18:49.022537+0000","last_became_peered":"2024-09-11T23:18:49.022537+0000","last_unstale":"2024-09-11T23:18:49.028763+0000","last_undegraded":"2024-09-11T23:18:49.028763+0000","last_fullsized":"2024-09-11T23:18:49.028763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:01.751435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586466+0000","last_change":"2024-09-11T23:18:48.012267+0000","last_active":"2024-09-11T23:18:50.586466+0000","last_peered":"2024-09-11T23:18:50.586466+0000","last_clean":"2024-09-11T23:18:50.586466+0000","last_became_active":"2024-09-11T23:18:48.011880+0000","last_became_peered":"2024-09-11T23:18:48.011880+0000","last_unstale":"2024-09-11T23:18:50.586466+0000","last_undegraded":"2024-09-11T23:18:50.586466+0000","last_fullsized":"2024-09-11T23:18:50.586466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:20.606934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.023373+0000","last_change":"2024-09-11T23:18:49.017731+0000","last_active":"2024-09-11T23:18:49.023373+0000","last_peered":"2024-09-11T23:18:49.023373+0000","last_clean":"2024-09-11T23:18:49.023373+0000","last_became_active":"2024-09-11T23:18:49.017469+0000","last_became_peered":"2024-09-11T23:18:49.017469+0000","last_unstale":"2024-09-11T23:18:49.023373+0000","last_undegraded":"2024-09-11T23:18:49.023373+0000","last_fullsized":"2024-09-11T23:18:49.023373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:18.200252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012044+0000","last_change":"2024-09-11T23:18:48.011580+0000","last_active":"2024-09-11T23:18:50.012044+0000","last_peered":"2024-09-11T23:18:50.012044+0000","last_clean":"2024-09-11T23:18:50.012044+0000","last_became_active":"2024-09-11T23:18:48.011045+0000","last_became_peered":"2024-09-11T23:18:48.011045+0000","last_unstale":"2024-09-11T23:18:50.012044+0000","last_undegraded":"2024-09-11T23:18:50.012044+0000","last_fullsized":"2024-09-11T23:18:50.012044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:18.496309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011199+0000","last_change":"2024-09-11T23:18:49.015000+0000","last_active":"2024-09-11T23:18:50.011199+0000","last_peered":"2024-09-11T23:18:50.011199+0000","last_clean":"2024-09-11T23:18:50.011199+0000","last_became_active":"2024-09-11T23:18:49.014091+0000","last_became_peered":"2024-09-11T23:18:49.014091+0000","last_unstale":"2024-09-11T23:18:50.011199+0000","last_undegraded":"2024-09-11T23:18:50.011199+0000","last_fullsized":"2024-09-11T23:18:50.011199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:31.695691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012184+0000","last_change":"2024-09-11T23:18:48.009914+0000","last_active":"2024-09-11T23:18:50.012184+0000","last_peered":"2024-09-11T23:18:50.012184+0000","last_clean":"2024-09-11T23:18:50.012184+0000","last_became_active":"2024-09-11T23:18:48.007555+0000","last_became_peered":"2024-09-11T23:18:48.007555+0000","last_unstale":"2024-09-11T23:18:50.012184+0000","last_undegraded":"2024-09-11T23:18:50.012184+0000","last_fullsized":"2024-09-11T23:18:50.012184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:11.259384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011290+0000","last_change":"2024-09-11T23:18:49.006529+0000","last_active":"2024-09-11T23:18:50.011290+0000","last_peered":"2024-09-11T23:18:50.011290+0000","last_clean":"2024-09-11T23:18:50.011290+0000","last_became_active":"2024-09-11T23:18:49.006239+0000","last_became_peered":"2024-09-11T23:18:49.006239+0000","last_unstale":"2024-09-11T23:18:50.011290+0000","last_undegraded":"2024-09-11T23:18:50.011290+0000","last_fullsized":"2024-09-11T23:18:50.011290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:52.437981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586305+0000","last_change":"2024-09-11T23:18:48.005888+0000","last_active":"2024-09-11T23:18:50.586305+0000","last_peered":"2024-09-11T23:18:50.586305+0000","last_clean":"2024-09-11T23:18:50.586305+0000","last_became_active":"2024-09-11T23:18:48.005594+0000","last_became_peered":"2024-09-11T23:18:48.005594+0000","last_unstale":"2024-09-11T23:18:50.586305+0000","last_undegraded":"2024-09-11T23:18:50.586305+0000","last_fullsized":"2024-09-11T23:18:50.586305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:20.376536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.027881+0000","last_change":"2024-09-11T23:18:49.022786+0000","last_active":"2024-09-11T23:18:49.027881+0000","last_peered":"2024-09-11T23:18:49.027881+0000","last_clean":"2024-09-11T23:18:49.027881+0000","last_became_active":"2024-09-11T23:18:49.022512+0000","last_became_peered":"2024-09-11T23:18:49.022512+0000","last_unstale":"2024-09-11T23:18:49.027881+0000","last_undegraded":"2024-09-11T23:18:49.027881+0000","last_fullsized":"2024-09-11T23:18:49.027881+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:14.448085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011412+0000","last_change":"2024-09-11T23:18:48.001028+0000","last_active":"2024-09-11T23:18:50.011412+0000","last_peered":"2024-09-11T23:18:50.011412+0000","last_clean":"2024-09-11T23:18:50.011412+0000","last_became_active":"2024-09-11T23:18:48.000366+0000","last_became_peered":"2024-09-11T23:18:48.000366+0000","last_unstale":"2024-09-11T23:18:50.011412+0000","last_undegraded":"2024-09-11T23:18:50.011412+0000","last_fullsized":"2024-09-11T23:18:50.011412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:21.206250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011482+0000","last_change":"2024-09-11T23:18:49.010058+0000","last_active":"2024-09-11T23:18:50.011482+0000","last_peered":"2024-09-11T23:18:50.011482+0000","last_clean":"2024-09-11T23:18:50.011482+0000","last_became_active":"2024-09-11T23:18:49.007625+0000","last_became_peered":"2024-09-11T23:18:49.007625+0000","last_unstale":"2024-09-11T23:18:50.011482+0000","last_undegraded":"2024-09-11T23:18:50.011482+0000","last_fullsized":"2024-09-11T23:18:50.011482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:36.393454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587725+0000","last_change":"2024-09-11T23:18:48.017295+0000","last_active":"2024-09-11T23:18:50.587725+0000","last_peered":"2024-09-11T23:18:50.587725+0000","last_clean":"2024-09-11T23:18:50.587725+0000","last_became_active":"2024-09-11T23:18:48.016882+0000","last_became_peered":"2024-09-11T23:18:48.016882+0000","last_unstale":"2024-09-11T23:18:50.587725+0000","last_undegraded":"2024-09-11T23:18:50.587725+0000","last_fullsized":"2024-09-11T23:18:50.587725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:27.807403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587637+0000","last_change":"2024-09-11T23:18:49.024058+0000","last_active":"2024-09-11T23:18:50.587637+0000","last_peered":"2024-09-11T23:18:50.587637+0000","last_clean":"2024-09-11T23:18:50.587637+0000","last_became_active":"2024-09-11T23:18:49.023763+0000","last_became_peered":"2024-09-11T23:18:49.023763+0000","last_unstale":"2024-09-11T23:18:50.587637+0000","last_undegraded":"2024-09-11T23:18:50.587637+0000","last_fullsized":"2024-09-11T23:18:50.587637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:15.178674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.002487+0000","last_change":"2024-09-11T23:18:48.011655+0000","last_active":"2024-09-11T23:18:49.002487+0000","last_peered":"2024-09-11T23:18:49.002487+0000","last_clean":"2024-09-11T23:18:49.002487+0000","last_became_active":"2024-09-11T23:18:48.008273+0000","last_became_peered":"2024-09-11T23:18:48.008273+0000","last_unstale":"2024-09-11T23:18:49.002487+0000","last_undegraded":"2024-09-11T23:18:49.002487+0000","last_fullsized":"2024-09-11T23:18:49.002487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:51.349730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587574+0000","last_change":"2024-09-11T23:18:49.015893+0000","last_active":"2024-09-11T23:18:50.587574+0000","last_peered":"2024-09-11T23:18:50.587574+0000","last_clean":"2024-09-11T23:18:50.587574+0000","last_became_active":"2024-09-11T23:18:49.008793+0000","last_became_peered":"2024-09-11T23:18:49.008793+0000","last_unstale":"2024-09-11T23:18:50.587574+0000","last_undegraded":"2024-09-11T23:18:50.587574+0000","last_fullsized":"2024-09-11T23:18:50.587574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:01.289535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011904+0000","last_change":"2024-09-11T23:18:48.011616+0000","last_active":"2024-09-11T23:18:50.011904+0000","last_peered":"2024-09-11T23:18:50.011904+0000","last_clean":"2024-09-11T23:18:50.011904+0000","last_became_active":"2024-09-11T23:18:48.011108+0000","last_became_peered":"2024-09-11T23:18:48.011108+0000","last_unstale":"2024-09-11T23:18:50.011904+0000","last_undegraded":"2024-09-11T23:18:50.011904+0000","last_fullsized":"2024-09-11T23:18:50.011904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:34.165980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011637+0000","last_change":"2024-09-11T23:18:49.024580+0000","last_active":"2024-09-11T23:18:50.011637+0000","last_peered":"2024-09-11T23:18:50.011637+0000","last_clean":"2024-09-11T23:18:50.011637+0000","last_became_active":"2024-09-11T23:18:49.024279+0000","last_became_peered":"2024-09-11T23:18:49.024279+0000","last_unstale":"2024-09-11T23:18:50.011637+0000","last_undegraded":"2024-09-11T23:18:50.011637+0000","last_fullsized":"2024-09-11T23:18:50.011637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:22.301700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587334+0000","last_change":"2024-09-11T23:18:48.016996+0000","last_active":"2024-09-11T23:18:50.587334+0000","last_peered":"2024-09-11T23:18:50.587334+0000","last_clean":"2024-09-11T23:18:50.587334+0000","last_became_active":"2024-09-11T23:18:48.016503+0000","last_became_peered":"2024-09-11T23:18:48.016503+0000","last_unstale":"2024-09-11T23:18:50.587334+0000","last_undegraded":"2024-09-11T23:18:50.587334+0000","last_fullsized":"2024-09-11T23:18:50.587334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:33.072147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.017286+0000","last_change":"2024-09-11T23:18:49.012373+0000","last_active":"2024-09-11T23:18:49.017286+0000","last_peered":"2024-09-11T23:18:49.017286+0000","last_clean":"2024-09-11T23:18:49.017286+0000","last_became_active":"2024-09-11T23:18:49.011979+0000","last_became_peered":"2024-09-11T23:18:49.011979+0000","last_unstale":"2024-09-11T23:18:49.017286+0000","last_undegraded":"2024-09-11T23:18:49.017286+0000","last_fullsized":"2024-09-11T23:18:49.017286+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:44.884982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012156+0000","last_change":"2024-09-11T23:18:48.002333+0000","last_active":"2024-09-11T23:18:50.012156+0000","last_peered":"2024-09-11T23:18:50.012156+0000","last_clean":"2024-09-11T23:18:50.012156+0000","last_became_active":"2024-09-11T23:18:48.001101+0000","last_became_peered":"2024-09-11T23:18:48.001101+0000","last_unstale":"2024-09-11T23:18:50.012156+0000","last_undegraded":"2024-09-11T23:18:50.012156+0000","last_fullsized":"2024-09-11T23:18:50.012156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:30.420649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586953+0000","last_change":"2024-09-11T23:18:49.019321+0000","last_active":"2024-09-11T23:18:50.586953+0000","last_peered":"2024-09-11T23:18:50.586953+0000","last_clean":"2024-09-11T23:18:50.586953+0000","last_became_active":"2024-09-11T23:18:49.015579+0000","last_became_peered":"2024-09-11T23:18:49.015579+0000","last_unstale":"2024-09-11T23:18:50.586953+0000","last_undegraded":"2024-09-11T23:18:50.586953+0000","last_fullsized":"2024-09-11T23:18:50.586953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:06.688839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.011178+0000","last_change":"2024-09-11T23:18:48.010282+0000","last_active":"2024-09-11T23:18:49.011178+0000","last_peered":"2024-09-11T23:18:49.011178+0000","last_clean":"2024-09-11T23:18:49.011178+0000","last_became_active":"2024-09-11T23:18:48.007053+0000","last_became_peered":"2024-09-11T23:18:48.007053+0000","last_unstale":"2024-09-11T23:18:49.011178+0000","last_undegraded":"2024-09-11T23:18:49.011178+0000","last_fullsized":"2024-09-11T23:18:49.011178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:18.309385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.026361+0000","last_change":"2024-09-11T23:18:49.019508+0000","last_active":"2024-09-11T23:18:49.026361+0000","last_peered":"2024-09-11T23:18:49.026361+0000","last_clean":"2024-09-11T23:18:49.026361+0000","last_became_active":"2024-09-11T23:18:49.019067+0000","last_became_peered":"2024-09-11T23:18:49.019067+0000","last_unstale":"2024-09-11T23:18:49.026361+0000","last_undegraded":"2024-09-11T23:18:49.026361+0000","last_fullsized":"2024-09-11T23:18:49.026361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:31.695691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586329+0000","last_change":"2024-09-11T23:18:48.014618+0000","last_active":"2024-09-11T23:18:50.586329+0000","last_peered":"2024-09-11T23:18:50.586329+0000","last_clean":"2024-09-11T23:18:50.586329+0000","last_became_active":"2024-09-11T23:18:48.014376+0000","last_became_peered":"2024-09-11T23:18:48.014376+0000","last_unstale":"2024-09-11T23:18:50.586329+0000","last_undegraded":"2024-09-11T23:18:50.586329+0000","last_fullsized":"2024-09-11T23:18:50.586329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:00.540786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.023632+0000","last_change":"2024-09-11T23:18:49.017642+0000","last_active":"2024-09-11T23:18:49.023632+0000","last_peered":"2024-09-11T23:18:49.023632+0000","last_clean":"2024-09-11T23:18:49.023632+0000","last_became_active":"2024-09-11T23:18:49.017344+0000","last_became_peered":"2024-09-11T23:18:49.017344+0000","last_unstale":"2024-09-11T23:18:49.023632+0000","last_undegraded":"2024-09-11T23:18:49.023632+0000","last_fullsized":"2024-09-11T23:18:49.023632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:52.352691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586028+0000","last_change":"2024-09-11T23:18:48.016597+0000","last_active":"2024-09-11T23:18:50.586028+0000","last_peered":"2024-09-11T23:18:50.586028+0000","last_clean":"2024-09-11T23:18:50.586028+0000","last_became_active":"2024-09-11T23:18:48.016314+0000","last_became_peered":"2024-09-11T23:18:48.016314+0000","last_unstale":"2024-09-11T23:18:50.586028+0000","last_undegraded":"2024-09-11T23:18:50.586028+0000","last_fullsized":"2024-09-11T23:18:50.586028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:54.884414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012770+0000","last_change":"2024-09-11T23:18:49.015641+0000","last_active":"2024-09-11T23:18:50.012770+0000","last_peered":"2024-09-11T23:18:50.012770+0000","last_clean":"2024-09-11T23:18:50.012770+0000","last_became_active":"2024-09-11T23:18:49.014210+0000","last_became_peered":"2024-09-11T23:18:49.014210+0000","last_unstale":"2024-09-11T23:18:50.012770+0000","last_undegraded":"2024-09-11T23:18:50.012770+0000","last_fullsized":"2024-09-11T23:18:50.012770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:00.772427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.031601+0000","last_change":"2024-09-11T23:18:48.013143+0000","last_active":"2024-09-11T23:18:49.031601+0000","last_peered":"2024-09-11T23:18:49.031601+0000","last_clean":"2024-09-11T23:18:49.031601+0000","last_became_active":"2024-09-11T23:18:48.012875+0000","last_became_peered":"2024-09-11T23:18:48.012875+0000","last_unstale":"2024-09-11T23:18:49.031601+0000","last_undegraded":"2024-09-11T23:18:49.031601+0000","last_fullsized":"2024-09-11T23:18:49.031601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:43.166311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011688+0000","last_change":"2024-09-11T23:18:49.006253+0000","last_active":"2024-09-11T23:18:50.011688+0000","last_peered":"2024-09-11T23:18:50.011688+0000","last_clean":"2024-09-11T23:18:50.011688+0000","last_became_active":"2024-09-11T23:18:49.004054+0000","last_became_peered":"2024-09-11T23:18:49.004054+0000","last_unstale":"2024-09-11T23:18:50.011688+0000","last_undegraded":"2024-09-11T23:18:50.011688+0000","last_fullsized":"2024-09-11T23:18:50.011688+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:18.145725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012844+0000","last_change":"2024-09-11T23:18:48.001857+0000","last_active":"2024-09-11T23:18:50.012844+0000","last_peered":"2024-09-11T23:18:50.012844+0000","last_clean":"2024-09-11T23:18:50.012844+0000","last_became_active":"2024-09-11T23:18:48.001543+0000","last_became_peered":"2024-09-11T23:18:48.001543+0000","last_unstale":"2024-09-11T23:18:50.012844+0000","last_undegraded":"2024-09-11T23:18:50.012844+0000","last_fullsized":"2024-09-11T23:18:50.012844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:14.102475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028592+0000","last_change":"2024-09-11T23:18:49.024287+0000","last_active":"2024-09-11T23:18:49.028592+0000","last_peered":"2024-09-11T23:18:49.028592+0000","last_clean":"2024-09-11T23:18:49.028592+0000","last_became_active":"2024-09-11T23:18:49.022965+0000","last_became_peered":"2024-09-11T23:18:49.022965+0000","last_unstale":"2024-09-11T23:18:49.028592+0000","last_undegraded":"2024-09-11T23:18:49.028592+0000","last_fullsized":"2024-09-11T23:18:49.028592+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:08.846324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012525+0000","last_change":"2024-09-11T23:18:48.004742+0000","last_active":"2024-09-11T23:18:50.012525+0000","last_peered":"2024-09-11T23:18:50.012525+0000","last_clean":"2024-09-11T23:18:50.012525+0000","last_became_active":"2024-09-11T23:18:48.004317+0000","last_became_peered":"2024-09-11T23:18:48.004317+0000","last_unstale":"2024-09-11T23:18:50.012525+0000","last_undegraded":"2024-09-11T23:18:50.012525+0000","last_fullsized":"2024-09-11T23:18:50.012525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:14.500017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586351+0000","last_change":"2024-09-11T23:18:49.014969+0000","last_active":"2024-09-11T23:18:50.586351+0000","last_peered":"2024-09-11T23:18:50.586351+0000","last_clean":"2024-09-11T23:18:50.586351+0000","last_became_active":"2024-09-11T23:18:49.014665+0000","last_became_peered":"2024-09-11T23:18:49.014665+0000","last_unstale":"2024-09-11T23:18:50.586351+0000","last_undegraded":"2024-09-11T23:18:50.586351+0000","last_fullsized":"2024-09-11T23:18:50.586351+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:07:27.965516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012482+0000","last_change":"2024-09-11T23:18:48.004710+0000","last_active":"2024-09-11T23:18:50.012482+0000","last_peered":"2024-09-11T23:18:50.012482+0000","last_clean":"2024-09-11T23:18:50.012482+0000","last_became_active":"2024-09-11T23:18:48.004396+0000","last_became_peered":"2024-09-11T23:18:48.004396+0000","last_unstale":"2024-09-11T23:18:50.012482+0000","last_undegraded":"2024-09-11T23:18:50.012482+0000","last_fullsized":"2024-09-11T23:18:50.012482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:58.115645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586139+0000","last_change":"2024-09-11T23:18:49.013677+0000","last_active":"2024-09-11T23:18:50.586139+0000","last_peered":"2024-09-11T23:18:50.586139+0000","last_clean":"2024-09-11T23:18:50.586139+0000","last_became_active":"2024-09-11T23:18:49.013135+0000","last_became_peered":"2024-09-11T23:18:49.013135+0000","last_unstale":"2024-09-11T23:18:50.586139+0000","last_undegraded":"2024-09-11T23:18:50.586139+0000","last_fullsized":"2024-09-11T23:18:50.586139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:05.649394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.005713+0000","last_change":"2024-09-11T23:18:48.009114+0000","last_active":"2024-09-11T23:18:49.005713+0000","last_peered":"2024-09-11T23:18:49.005713+0000","last_clean":"2024-09-11T23:18:49.005713+0000","last_became_active":"2024-09-11T23:18:48.008595+0000","last_became_peered":"2024-09-11T23:18:48.008595+0000","last_unstale":"2024-09-11T23:18:49.005713+0000","last_undegraded":"2024-09-11T23:18:49.005713+0000","last_fullsized":"2024-09-11T23:18:49.005713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:41.932196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586528+0000","last_change":"2024-09-11T23:18:49.012606+0000","last_active":"2024-09-11T23:18:50.586528+0000","last_peered":"2024-09-11T23:18:50.586528+0000","last_clean":"2024-09-11T23:18:50.586528+0000","last_became_active":"2024-09-11T23:18:49.012315+0000","last_became_peered":"2024-09-11T23:18:49.012315+0000","last_unstale":"2024-09-11T23:18:50.586528+0000","last_undegraded":"2024-09-11T23:18:50.586528+0000","last_fullsized":"2024-09-11T23:18:50.586528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:02.102975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.003131+0000","last_change":"2024-09-11T23:18:48.014456+0000","last_active":"2024-09-11T23:18:49.003131+0000","last_peered":"2024-09-11T23:18:49.003131+0000","last_clean":"2024-09-11T23:18:49.003131+0000","last_became_active":"2024-09-11T23:18:48.014078+0000","last_became_peered":"2024-09-11T23:18:48.014078+0000","last_unstale":"2024-09-11T23:18:49.003131+0000","last_undegraded":"2024-09-11T23:18:49.003131+0000","last_fullsized":"2024-09-11T23:18:49.003131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:18.309385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.585986+0000","last_change":"2024-09-11T23:18:49.008898+0000","last_active":"2024-09-11T23:18:50.585986+0000","last_peered":"2024-09-11T23:18:50.585986+0000","last_clean":"2024-09-11T23:18:50.585986+0000","last_became_active":"2024-09-11T23:18:49.008538+0000","last_became_peered":"2024-09-11T23:18:49.008538+0000","last_unstale":"2024-09-11T23:18:50.585986+0000","last_undegraded":"2024-09-11T23:18:50.585986+0000","last_fullsized":"2024-09-11T23:18:50.585986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:00.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011799+0000","last_change":"2024-09-11T23:18:48.003928+0000","last_active":"2024-09-11T23:18:50.011799+0000","last_peered":"2024-09-11T23:18:50.011799+0000","last_clean":"2024-09-11T23:18:50.011799+0000","last_became_active":"2024-09-11T23:18:48.003048+0000","last_became_peered":"2024-09-11T23:18:48.003048+0000","last_unstale":"2024-09-11T23:18:50.011799+0000","last_undegraded":"2024-09-11T23:18:50.011799+0000","last_fullsized":"2024-09-11T23:18:50.011799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:37.584863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.024045+0000","last_change":"2024-09-11T23:18:49.013365+0000","last_active":"2024-09-11T23:18:49.024045+0000","last_peered":"2024-09-11T23:18:49.024045+0000","last_clean":"2024-09-11T23:18:49.024045+0000","last_became_active":"2024-09-11T23:18:49.013014+0000","last_became_peered":"2024-09-11T23:18:49.013014+0000","last_unstale":"2024-09-11T23:18:49.024045+0000","last_undegraded":"2024-09-11T23:18:49.024045+0000","last_fullsized":"2024-09-11T23:18:49.024045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:02.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011282+0000","last_change":"2024-09-11T23:18:48.013115+0000","last_active":"2024-09-11T23:18:50.011282+0000","last_peered":"2024-09-11T23:18:50.011282+0000","last_clean":"2024-09-11T23:18:50.011282+0000","last_became_active":"2024-09-11T23:18:48.012783+0000","last_became_peered":"2024-09-11T23:18:48.012783+0000","last_unstale":"2024-09-11T23:18:50.011282+0000","last_undegraded":"2024-09-11T23:18:50.011282+0000","last_fullsized":"2024-09-11T23:18:50.011282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:07.843362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586275+0000","last_change":"2024-09-11T23:18:49.013885+0000","last_active":"2024-09-11T23:18:50.586275+0000","last_peered":"2024-09-11T23:18:50.586275+0000","last_clean":"2024-09-11T23:18:50.586275+0000","last_became_active":"2024-09-11T23:18:49.013611+0000","last_became_peered":"2024-09-11T23:18:49.013611+0000","last_unstale":"2024-09-11T23:18:50.586275+0000","last_undegraded":"2024-09-11T23:18:50.586275+0000","last_fullsized":"2024-09-11T23:18:50.586275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:09.280069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.031657+0000","last_change":"2024-09-11T23:18:48.009617+0000","last_active":"2024-09-11T23:18:49.031657+0000","last_peered":"2024-09-11T23:18:49.031657+0000","last_clean":"2024-09-11T23:18:49.031657+0000","last_became_active":"2024-09-11T23:18:48.009195+0000","last_became_peered":"2024-09-11T23:18:48.009195+0000","last_unstale":"2024-09-11T23:18:49.031657+0000","last_undegraded":"2024-09-11T23:18:49.031657+0000","last_fullsized":"2024-09-11T23:18:49.031657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:19.037305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011847+0000","last_change":"2024-09-11T23:18:49.012656+0000","last_active":"2024-09-11T23:18:50.011847+0000","last_peered":"2024-09-11T23:18:50.011847+0000","last_clean":"2024-09-11T23:18:50.011847+0000","last_became_active":"2024-09-11T23:18:49.012305+0000","last_became_peered":"2024-09-11T23:18:49.012305+0000","last_unstale":"2024-09-11T23:18:50.011847+0000","last_undegraded":"2024-09-11T23:18:50.011847+0000","last_fullsized":"2024-09-11T23:18:50.011847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:46.582189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.002677+0000","last_change":"2024-09-11T23:18:48.005217+0000","last_active":"2024-09-11T23:18:49.002677+0000","last_peered":"2024-09-11T23:18:49.002677+0000","last_clean":"2024-09-11T23:18:49.002677+0000","last_became_active":"2024-09-11T23:18:48.004931+0000","last_became_peered":"2024-09-11T23:18:48.004931+0000","last_unstale":"2024-09-11T23:18:49.002677+0000","last_undegraded":"2024-09-11T23:18:49.002677+0000","last_fullsized":"2024-09-11T23:18:49.002677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:13.445123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.027344+0000","last_change":"2024-09-11T23:18:49.027344+0000","last_active":"2024-09-11T23:18:49.027344+0000","last_peered":"2024-09-11T23:18:49.027344+0000","last_clean":"2024-09-11T23:18:49.027344+0000","last_became_active":"2024-09-11T23:18:49.027022+0000","last_became_peered":"2024-09-11T23:18:49.027022+0000","last_unstale":"2024-09-11T23:18:49.027344+0000","last_undegraded":"2024-09-11T23:18:49.027344+0000","last_fullsized":"2024-09-11T23:18:49.027344+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:44.169273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.015580+0000","last_change":"2024-09-11T23:18:48.011606+0000","last_active":"2024-09-11T23:18:49.015580+0000","last_peered":"2024-09-11T23:18:49.015580+0000","last_clean":"2024-09-11T23:18:49.015580+0000","last_became_active":"2024-09-11T23:18:48.011355+0000","last_became_peered":"2024-09-11T23:18:48.011355+0000","last_unstale":"2024-09-11T23:18:49.015580+0000","last_undegraded":"2024-09-11T23:18:49.015580+0000","last_fullsized":"2024-09-11T23:18:49.015580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:51.349730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.020551+0000","last_change":"2024-09-11T23:18:49.014470+0000","last_active":"2024-09-11T23:18:49.020551+0000","last_peered":"2024-09-11T23:18:49.020551+0000","last_clean":"2024-09-11T23:18:49.020551+0000","last_became_active":"2024-09-11T23:18:49.013737+0000","last_became_peered":"2024-09-11T23:18:49.013737+0000","last_unstale":"2024-09-11T23:18:49.020551+0000","last_undegraded":"2024-09-11T23:18:49.020551+0000","last_fullsized":"2024-09-11T23:18:49.020551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:44.884982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.005691+0000","last_change":"2024-09-11T23:18:48.006018+0000","last_active":"2024-09-11T23:18:49.005691+0000","last_peered":"2024-09-11T23:18:49.005691+0000","last_clean":"2024-09-11T23:18:49.005691+0000","last_became_active":"2024-09-11T23:18:48.005721+0000","last_became_peered":"2024-09-11T23:18:48.005721+0000","last_unstale":"2024-09-11T23:18:49.005691+0000","last_undegraded":"2024-09-11T23:18:49.005691+0000","last_fullsized":"2024-09-11T23:18:49.005691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:00.748473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.016200+0000","last_change":"2024-09-11T23:18:49.010494+0000","last_active":"2024-09-11T23:18:49.016200+0000","last_peered":"2024-09-11T23:18:49.016200+0000","last_clean":"2024-09-11T23:18:49.016200+0000","last_became_active":"2024-09-11T23:18:49.010206+0000","last_became_peered":"2024-09-11T23:18:49.010206+0000","last_unstale":"2024-09-11T23:18:49.016200+0000","last_undegraded":"2024-09-11T23:18:49.016200+0000","last_fullsized":"2024-09-11T23:18:49.016200+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:52.437981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.011307+0000","last_change":"2024-09-11T23:18:48.012601+0000","last_active":"2024-09-11T23:18:49.011307+0000","last_peered":"2024-09-11T23:18:49.011307+0000","last_clean":"2024-09-11T23:18:49.011307+0000","last_became_active":"2024-09-11T23:18:48.010086+0000","last_became_peered":"2024-09-11T23:18:48.010086+0000","last_unstale":"2024-09-11T23:18:49.011307+0000","last_undegraded":"2024-09-11T23:18:49.011307+0000","last_fullsized":"2024-09-11T23:18:49.011307+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:22.408272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586065+0000","last_change":"2024-09-11T23:18:49.009424+0000","last_active":"2024-09-11T23:18:50.586065+0000","last_peered":"2024-09-11T23:18:50.586065+0000","last_clean":"2024-09-11T23:18:50.586065+0000","last_became_active":"2024-09-11T23:18:49.008854+0000","last_became_peered":"2024-09-11T23:18:49.008854+0000","last_unstale":"2024-09-11T23:18:50.586065+0000","last_undegraded":"2024-09-11T23:18:50.586065+0000","last_fullsized":"2024-09-11T23:18:50.586065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:54.389826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012956+0000","last_change":"2024-09-11T23:18:48.000946+0000","last_active":"2024-09-11T23:18:50.012956+0000","last_peered":"2024-09-11T23:18:50.012956+0000","last_clean":"2024-09-11T23:18:50.012956+0000","last_became_active":"2024-09-11T23:18:48.000299+0000","last_became_peered":"2024-09-11T23:18:48.000299+0000","last_unstale":"2024-09-11T23:18:50.012956+0000","last_undegraded":"2024-09-11T23:18:50.012956+0000","last_fullsized":"2024-09-11T23:18:50.012956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:19.403184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011694+0000","last_change":"2024-09-11T23:18:49.000439+0000","last_active":"2024-09-11T23:18:50.011694+0000","last_peered":"2024-09-11T23:18:50.011694+0000","last_clean":"2024-09-11T23:18:50.011694+0000","last_became_active":"2024-09-11T23:18:49.000122+0000","last_became_peered":"2024-09-11T23:18:49.000122+0000","last_unstale":"2024-09-11T23:18:50.011694+0000","last_undegraded":"2024-09-11T23:18:50.011694+0000","last_fullsized":"2024-09-11T23:18:50.011694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:08.846324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586132+0000","last_change":"2024-09-11T23:18:48.016472+0000","last_active":"2024-09-11T23:18:50.586132+0000","last_peered":"2024-09-11T23:18:50.586132+0000","last_clean":"2024-09-11T23:18:50.586132+0000","last_became_active":"2024-09-11T23:18:48.016190+0000","last_became_peered":"2024-09-11T23:18:48.016190+0000","last_unstale":"2024-09-11T23:18:50.586132+0000","last_undegraded":"2024-09-11T23:18:50.586132+0000","last_fullsized":"2024-09-11T23:18:50.586132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:19.031495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.020509+0000","last_change":"2024-09-11T23:18:49.012546+0000","last_active":"2024-09-11T23:18:49.020509+0000","last_peered":"2024-09-11T23:18:49.020509+0000","last_clean":"2024-09-11T23:18:49.020509+0000","last_became_active":"2024-09-11T23:18:49.012189+0000","last_became_peered":"2024-09-11T23:18:49.012189+0000","last_unstale":"2024-09-11T23:18:49.020509+0000","last_undegraded":"2024-09-11T23:18:49.020509+0000","last_fullsized":"2024-09-11T23:18:49.020509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:49.321225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:48.999430+0000","last_change":"2024-09-11T23:18:48.008963+0000","last_active":"2024-09-11T23:18:48.999430+0000","last_peered":"2024-09-11T23:18:48.999430+0000","last_clean":"2024-09-11T23:18:48.999430+0000","last_became_active":"2024-09-11T23:18:48.008162+0000","last_became_peered":"2024-09-11T23:18:48.008162+0000","last_unstale":"2024-09-11T23:18:48.999430+0000","last_undegraded":"2024-09-11T23:18:48.999430+0000","last_fullsized":"2024-09-11T23:18:48.999430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:30.420649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":189,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.000785+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:18:49.000785+0000","last_peered":"2024-09-11T23:18:49.000785+0000","last_clean":"2024-09-11T23:18:49.000785+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:18:49.000785+0000","last_undegraded":"2024-09-11T23:18:49.000785+0000","last_fullsized":"2024-09-11T23:18:49.000785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476753,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":729689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476752,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":139847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476751,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":139903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476751,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":368640,"data_stored":139335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":348160,"data_stored":132456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":942080,"data_stored":722824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":147165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":145601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:18:53.987 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-09-11T23:18:53.987 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 6, 'reported_epoch': 33, 'state': 'active', 'last_fresh': '2024-09-11T23:18:49.031327+0000', 'last_change': '2024-09-11T23:18:49.031264+0000', 'last_active': '2024-09-11T23:18:49.031327+0000', 'last_peered': '2024-09-11T23:18:49.031327+0000', 'last_clean': '2024-09-11T23:18:47.981836+0000', 'last_became_active': '2024-09-11T23:18:49.031264+0000', 'last_became_peered': '2024-09-11T23:18:49.031264+0000', 'last_unstale': '2024-09-11T23:18:49.031327+0000', 'last_undegraded': '2024-09-11T23:18:49.031327+0000', 'last_fullsized': '2024-09-11T23:18:49.031327+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:18:47.981836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:18:47.981836+0000', 'last_clean_scrub_stamp': '2024-09-11T23:18:47.981836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': ['1', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:18:53.988 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T23:18:54.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.177+0000 7f68c9e00640 1 Processor -- start 2024-09-11T23:18:54.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.177+0000 7f68c9e00640 1 -- start start 2024-09-11T23:18:54.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.178+0000 7f68c9e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f68c40b32e0 0x7f68c40b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.178+0000 7f68c9e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68c40cfb00 con 0x7f68c40d1440 2024-09-11T23:18:54.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.178+0000 7f68c9e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68c40d3a30 con 0x7f68c40b3830 2024-09-11T23:18:54.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.178+0000 7f68c9e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f68c406cf60 con 0x7f68c40b32e0 2024-09-11T23:18:54.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.178+0000 7f68c8a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f68c40d1440 0x7f68c40d1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50762/0 (socket says 172.21.15.144:50762) 2024-09-11T23:18:54.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.178+0000 7f68c8a00640 1 -- 172.21.15.144:0/3028182602 learned_addr learned my addr 172.21.15.144:0/3028182602 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:54.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.179+0000 7f68c9400640 1 --2- 172.21.15.144:0/3028182602 >> v2:172.21.15.165:3300/0 conn(0x7f68c40b32e0 0x7f68c40b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.179+0000 7f68c3400640 1 -- 172.21.15.144:0/3028182602 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3233181601 0 0) 0x7f68b8001110 con 0x7f68c40d1440 2024-09-11T23:18:54.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.179+0000 7f68c3400640 1 -- 172.21.15.144:0/3028182602 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68ac003520 con 0x7f68c40d1440 2024-09-11T23:18:54.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.179+0000 7f68c9400640 1 -- 172.21.15.144:0/3028182602 >> v1:172.21.15.165:6789/0 conn(0x7f68c40b3830 legacy=0x7f68c406c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.179+0000 7f68c3400640 1 -- 172.21.15.144:0/3028182602 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4258687994 0 0) 0x7f68ac003520 con 0x7f68c40d1440 2024-09-11T23:18:54.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.179+0000 7f68c9400640 1 -- 172.21.15.144:0/3028182602 >> v1:172.21.15.144:6789/0 conn(0x7f68c40d1440 legacy=0x7f68c40d1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.179+0000 7f68c9400640 1 -- 172.21.15.144:0/3028182602 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c40d3d10 con 0x7f68c40b32e0 2024-09-11T23:18:54.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.180+0000 7f68c9400640 1 --2- 172.21.15.144:0/3028182602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f68c40b32e0 0x7f68c40b74d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009d90 tx=0x7f68bc02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2686326fced690f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:54.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.180+0000 7f68c3400640 1 -- 172.21.15.144:0/3028182602 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b8001840 con 0x7f68c40b32e0 2024-09-11T23:18:54.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.181+0000 7f68c3400640 1 -- 172.21.15.144:0/3028182602 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68bc007540 con 0x7f68c40b32e0 2024-09-11T23:18:54.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.181+0000 7f68c3400640 1 -- 172.21.15.144:0/3028182602 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc0078f0 con 0x7f68c40b32e0 2024-09-11T23:18:54.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.181+0000 7f68c9e00640 1 -- 172.21.15.144:0/3028182602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f68c40b32e0 msgr2=0x7f68c40b74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.181+0000 7f68c9e00640 1 --2- 172.21.15.144:0/3028182602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f68c40b32e0 0x7f68c40b74d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009d90 tx=0x7f68bc02a680 comp rx=0 tx=0).stop 2024-09-11T23:18:54.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.181+0000 7f68c9e00640 1 -- 172.21.15.144:0/3028182602 shutdown_connections 2024-09-11T23:18:54.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.181+0000 7f68c9e00640 1 --2- 172.21.15.144:0/3028182602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f68c40b32e0 0x7f68c40b74d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.181+0000 7f68c9e00640 1 -- 172.21.15.144:0/3028182602 >> 172.21.15.144:0/3028182602 conn(0x7f68c40b6400 msgr2=0x7f68c40b6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:54.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.181+0000 7f68c9e00640 1 -- 172.21.15.144:0/3028182602 shutdown_connections 2024-09-11T23:18:54.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.181+0000 7f68c9e00640 1 -- 172.21.15.144:0/3028182602 wait complete. 2024-09-11T23:18:54.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.183+0000 7f68c9e00640 1 Processor -- start 2024-09-11T23:18:54.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.183+0000 7f68c9e00640 1 -- start start 2024-09-11T23:18:54.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.184+0000 7f68c9e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f68c40b32e0 0x7f68c41f6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.184+0000 7f68c9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68c40b3830 0x7f68c41f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.184+0000 7f68c9e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68c40d1440 0x7f68c41f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.184+0000 7f68c9e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f68c406c350 con 0x7f68c40b3830 2024-09-11T23:18:54.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.184+0000 7f68c9e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f68c406c070 con 0x7f68c40b32e0 2024-09-11T23:18:54.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.184+0000 7f68c9e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f68c415eb40 con 0x7f68c40d1440 2024-09-11T23:18:54.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.184+0000 7f68c3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68c40b3830 0x7f68c41f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.184+0000 7f68c3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68c40b3830 0x7f68c41f51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50154/0 (socket says 172.21.15.144:50154) 2024-09-11T23:18:54.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.184+0000 7f68c3e00640 1 -- 172.21.15.144:0/3398049725 learned_addr learned my addr 172.21.15.144:0/3398049725 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:54.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.184+0000 7f68c8a00640 1 --2- 172.21.15.144:0/3398049725 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f68c40b32e0 0x7f68c41f6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.184+0000 7f68c9400640 1 --2- 172.21.15.144:0/3398049725 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68c40d1440 0x7f68c41f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.185+0000 7f68c3e00640 1 -- 172.21.15.144:0/3398049725 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68c40d1440 msgr2=0x7f68c41f3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.185+0000 7f68c3e00640 1 --2- 172.21.15.144:0/3398049725 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68c40d1440 0x7f68c41f3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.185+0000 7f68c3e00640 1 -- 172.21.15.144:0/3398049725 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f68c40b32e0 msgr2=0x7f68c41f6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.185+0000 7f68c3e00640 1 --2- 172.21.15.144:0/3398049725 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f68c40b32e0 0x7f68c41f6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.185+0000 7f68c3e00640 1 -- 172.21.15.144:0/3398049725 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c41f4aa0 con 0x7f68c40b3830 2024-09-11T23:18:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.185+0000 7f68c9400640 1 --2- 172.21.15.144:0/3398049725 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68c40d1440 0x7f68c41f3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:54.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.185+0000 7f68c3e00640 1 --2- 172.21.15.144:0/3398049725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68c40b3830 0x7f68c41f51c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f68b000c480 tx=0x7f68b000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:54.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.185+0000 7f68c0c00640 1 -- 172.21.15.144:0/3398049725 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b00052d0 con 0x7f68c40b3830 2024-09-11T23:18:54.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.185+0000 7f68c0c00640 1 -- 172.21.15.144:0/3398049725 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68b0005470 con 0x7f68c40b3830 2024-09-11T23:18:54.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.185+0000 7f68c9e00640 1 -- 172.21.15.144:0/3398049725 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c41f4d80 con 0x7f68c40b3830 2024-09-11T23:18:54.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.185+0000 7f68c0c00640 1 -- 172.21.15.144:0/3398049725 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b0012870 con 0x7f68c40b3830 2024-09-11T23:18:54.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.185+0000 7f68c9e00640 1 -- 172.21.15.144:0/3398049725 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c40cba20 con 0x7f68c40b3830 2024-09-11T23:18:54.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.186+0000 7f68c9e00640 1 -- 172.21.15.144:0/3398049725 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68c40d0840 con 0x7f68c40b3830 2024-09-11T23:18:54.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.187+0000 7f68c0c00640 1 -- 172.21.15.144:0/3398049725 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f68b0012a10 con 0x7f68c40b3830 2024-09-11T23:18:54.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.188+0000 7f68c0c00640 1 --2- 172.21.15.144:0/3398049725 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f68a406be30 0x7f68a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.188+0000 7f68c0c00640 1 -- 172.21.15.144:0/3398049725 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f68b008aac0 con 0x7f68c40b3830 2024-09-11T23:18:54.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.188+0000 7f68c8a00640 1 --2- 172.21.15.144:0/3398049725 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f68a406be30 0x7f68a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.189+0000 7f68c8a00640 1 --2- 172.21.15.144:0/3398049725 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f68a406be30 0x7f68a406e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f68b8005880 tx=0x7f68b80011d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:54.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.193+0000 7f68c0c00640 1 -- 172.21.15.144:0/3398049725 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f68c40d0840 con 0x7f68c40b3830 2024-09-11T23:18:54.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.427+0000 7f68c9e00640 1 -- 172.21.15.144:0/3398049725 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f68c40cbc20 con 0x7f68c40b3830 2024-09-11T23:18:54.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.428+0000 7f68c0c00640 1 -- 172.21.15.144:0/3398049725 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1637 (secure 0 0 0) 0x7f68c40cbc20 con 0x7f68c40b3830 2024-09-11T23:18:54.430 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:54.430 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":80,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1726096669,"num_in_osds":8,"osd_in_since":1726096657,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":96},{"state_name":"active","count":1}],"num_pgs":97,"num_pools":3,"num_objects":21,"data_bytes":592756,"bytes_used":229810176,"bytes_avail":772864303104,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":17,"btime":"2024-09-11T23:18:52:015546+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4818}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-11T23:18:51.173074+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T23:18:54.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.430+0000 7f68c9e00640 1 -- 172.21.15.144:0/3398049725 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f68a406be30 msgr2=0x7f68a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.430+0000 7f68c9e00640 1 --2- 172.21.15.144:0/3398049725 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f68a406be30 0x7f68a406e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f68b8005880 tx=0x7f68b80011d0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.430+0000 7f68c9e00640 1 -- 172.21.15.144:0/3398049725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68c40b3830 msgr2=0x7f68c41f51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.430+0000 7f68c9e00640 1 --2- 172.21.15.144:0/3398049725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68c40b3830 0x7f68c41f51c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f68b000c480 tx=0x7f68b000c940 comp rx=0 tx=0).stop 2024-09-11T23:18:54.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.430+0000 7f68c9e00640 1 -- 172.21.15.144:0/3398049725 shutdown_connections 2024-09-11T23:18:54.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.430+0000 7f68c9e00640 1 --2- 172.21.15.144:0/3398049725 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f68a406be30 0x7f68a406e2f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.430+0000 7f68c9e00640 1 --2- 172.21.15.144:0/3398049725 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68c40d1440 0x7f68c41f3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.430+0000 7f68c9e00640 1 --2- 172.21.15.144:0/3398049725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68c40b3830 0x7f68c41f51c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.430+0000 7f68c9e00640 1 --2- 172.21.15.144:0/3398049725 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f68c40b32e0 0x7f68c41f6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.430+0000 7f68c9e00640 1 -- 172.21.15.144:0/3398049725 >> 172.21.15.144:0/3398049725 conn(0x7f68c40b6400 msgr2=0x7f68c40b7560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:54.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.430+0000 7f68c9e00640 1 -- 172.21.15.144:0/3398049725 shutdown_connections 2024-09-11T23:18:54.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.430+0000 7f68c9e00640 1 -- 172.21.15.144:0/3398049725 wait complete. 2024-09-11T23:18:54.448 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T23:18:54.448 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:18:54.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.601+0000 7f8e67200640 1 Processor -- start 2024-09-11T23:18:54.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.601+0000 7f8e67200640 1 -- start start 2024-09-11T23:18:54.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.602+0000 7f8e67200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8e6815b150 0x7f8e680ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.602+0000 7f8e67200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e680cd030 0x7f8e6815b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.602+0000 7f8e67200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e680b31d0 con 0x7f8e680b4510 2024-09-11T23:18:54.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.602+0000 7f8e67200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8e6815c0a0 con 0x7f8e6815b150 2024-09-11T23:18:54.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.602+0000 7f8e67200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8e6815c380 con 0x7f8e680cd030 2024-09-11T23:18:54.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.602+0000 7f8e65e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8e6815b150 0x7f8e680ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.602+0000 7f8e66800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e680cd030 0x7f8e6815b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.602+0000 7f8e65e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8e6815b150 0x7f8e680ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:37856/0 (socket says 172.21.15.144:37856) 2024-09-11T23:18:54.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.602+0000 7f8e65e00640 1 -- 172.21.15.144:0/1950162830 learned_addr learned my addr 172.21.15.144:0/1950162830 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:54.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.603+0000 7f8e65e00640 1 -- 172.21.15.144:0/1950162830 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e680cd030 msgr2=0x7f8e6815b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:54.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.603+0000 7f8e65e00640 1 --2- 172.21.15.144:0/1950162830 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e680cd030 0x7f8e6815b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.603+0000 7f8e65e00640 1 -- 172.21.15.144:0/1950162830 >> v1:172.21.15.165:6789/0 conn(0x7f8e680b4510 legacy=0x7f8e680b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.603+0000 7f8e65e00640 1 -- 172.21.15.144:0/1950162830 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e680b3440 con 0x7f8e6815b150 2024-09-11T23:18:54.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.603+0000 7f8e65400640 1 -- 172.21.15.144:0/1950162830 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 732735608 0 0) 0x7f8e680b31d0 con 0x7f8e680b4510 2024-09-11T23:18:54.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.604+0000 7f8e65e00640 1 --2- 172.21.15.144:0/1950162830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e6815b150 0x7f8e680ccaf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8e580098a0 tx=0x7f8e5802a290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c12df50e5bbb0ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:54.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.604+0000 7f8e65400640 1 -- 172.21.15.144:0/1950162830 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58037070 con 0x7f8e6815b150 2024-09-11T23:18:54.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.604+0000 7f8e65400640 1 -- 172.21.15.144:0/1950162830 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e58032440 con 0x7f8e6815b150 2024-09-11T23:18:54.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.604+0000 7f8e65400640 1 -- 172.21.15.144:0/1950162830 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58032810 con 0x7f8e6815b150 2024-09-11T23:18:54.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.604+0000 7f8e67200640 1 -- 172.21.15.144:0/1950162830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e6815b150 msgr2=0x7f8e680ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.604+0000 7f8e67200640 1 --2- 172.21.15.144:0/1950162830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e6815b150 0x7f8e680ccaf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8e580098a0 tx=0x7f8e5802a290 comp rx=0 tx=0).stop 2024-09-11T23:18:54.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.605+0000 7f8e67200640 1 -- 172.21.15.144:0/1950162830 shutdown_connections 2024-09-11T23:18:54.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.605+0000 7f8e67200640 1 --2- 172.21.15.144:0/1950162830 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e680cd030 0x7f8e6815b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.605+0000 7f8e67200640 1 --2- 172.21.15.144:0/1950162830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e6815b150 0x7f8e680ccaf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.605+0000 7f8e67200640 1 -- 172.21.15.144:0/1950162830 >> 172.21.15.144:0/1950162830 conn(0x7f8e6806e910 msgr2=0x7f8e6806bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:54.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.605+0000 7f8e67200640 1 -- 172.21.15.144:0/1950162830 shutdown_connections 2024-09-11T23:18:54.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.605+0000 7f8e67200640 1 -- 172.21.15.144:0/1950162830 wait complete. 2024-09-11T23:18:54.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.606+0000 7f8e67200640 1 Processor -- start 2024-09-11T23:18:54.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.606+0000 7f8e67200640 1 -- start start 2024-09-11T23:18:54.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.607+0000 7f8e67200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e680b4510 0x7f8e681542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.607+0000 7f8e67200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e680cd030 0x7f8e68071160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.607+0000 7f8e67200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e6815b150 0x7f8e680716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.607+0000 7f8e67200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8e680b41f0 con 0x7f8e680b4510 2024-09-11T23:18:54.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.607+0000 7f8e67200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8e680b4070 con 0x7f8e6815b150 2024-09-11T23:18:54.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.607+0000 7f8e67200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8e6815ba70 con 0x7f8e680cd030 2024-09-11T23:18:54.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.607+0000 7f8e65e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e680b4510 0x7f8e681542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.608+0000 7f8e65e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e680b4510 0x7f8e681542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37406/0 (socket says 172.21.15.144:37406) 2024-09-11T23:18:54.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.608+0000 7f8e65e00640 1 -- 172.21.15.144:0/2637350113 learned_addr learned my addr 172.21.15.144:0/2637350113 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:54.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.608+0000 7f8e66800640 1 --2- 172.21.15.144:0/2637350113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e6815b150 0x7f8e680716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.608+0000 7f8e5d400640 1 --2- 172.21.15.144:0/2637350113 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e680cd030 0x7f8e68071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.608+0000 7f8e65e00640 1 -- 172.21.15.144:0/2637350113 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e680cd030 msgr2=0x7f8e68071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.608+0000 7f8e65e00640 1 --2- 172.21.15.144:0/2637350113 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e680cd030 0x7f8e68071160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.608+0000 7f8e65e00640 1 -- 172.21.15.144:0/2637350113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e6815b150 msgr2=0x7f8e680716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.608+0000 7f8e65e00640 1 --2- 172.21.15.144:0/2637350113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e6815b150 0x7f8e680716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.608+0000 7f8e65e00640 1 -- 172.21.15.144:0/2637350113 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e68071be0 con 0x7f8e680b4510 2024-09-11T23:18:54.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.608+0000 7f8e66800640 1 --2- 172.21.15.144:0/2637350113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e6815b150 0x7f8e680716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:54.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.608+0000 7f8e65e00640 1 --2- 172.21.15.144:0/2637350113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e680b4510 0x7f8e681542c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8e580098a0 tx=0x7f8e580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:54.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.608+0000 7f8e5ea00640 1 -- 172.21.15.144:0/2637350113 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58041020 con 0x7f8e680b4510 2024-09-11T23:18:54.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.608+0000 7f8e5ea00640 1 -- 172.21.15.144:0/2637350113 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e58030640 con 0x7f8e680b4510 2024-09-11T23:18:54.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.609+0000 7f8e67200640 1 -- 172.21.15.144:0/2637350113 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e68071e90 con 0x7f8e680b4510 2024-09-11T23:18:54.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.609+0000 7f8e5ea00640 1 -- 172.21.15.144:0/2637350113 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58037040 con 0x7f8e680b4510 2024-09-11T23:18:54.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.609+0000 7f8e67200640 1 -- 172.21.15.144:0/2637350113 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e68072730 con 0x7f8e680b4510 2024-09-11T23:18:54.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.610+0000 7f8e67200640 1 -- 172.21.15.144:0/2637350113 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e6815b530 con 0x7f8e680b4510 2024-09-11T23:18:54.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.611+0000 7f8e5ea00640 1 -- 172.21.15.144:0/2637350113 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e58044020 con 0x7f8e680b4510 2024-09-11T23:18:54.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.611+0000 7f8e5ea00640 1 --2- 172.21.15.144:0/2637350113 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8e4406be30 0x7f8e4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:54.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.612+0000 7f8e5ea00640 1 -- 172.21.15.144:0/2637350113 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8e580ab5c0 con 0x7f8e680b4510 2024-09-11T23:18:54.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.612+0000 7f8e5d400640 1 --2- 172.21.15.144:0/2637350113 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8e4406be30 0x7f8e4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:54.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.612+0000 7f8e5d400640 1 --2- 172.21.15.144:0/2637350113 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8e4406be30 0x7f8e4406e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8e680cf430 tx=0x7f8e50009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:54.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.616+0000 7f8e5ea00640 1 -- 172.21.15.144:0/2637350113 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e5804b030 con 0x7f8e680b4510 2024-09-11T23:18:54.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.789+0000 7f8e67200640 1 -- 172.21.15.144:0/2637350113 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8e680631d0 con 0x7f8e4406be30 2024-09-11T23:18:54.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.795+0000 7f8e5ea00640 1 -- 172.21.15.144:0/2637350113 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251877 (secure 0 0 0) 0x7f8e680631d0 con 0x7f8e4406be30 2024-09-11T23:18:54.801 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:54.804 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:18:54.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.799+0000 7f8e67200640 1 -- 172.21.15.144:0/2637350113 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8e4406be30 msgr2=0x7f8e4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.799+0000 7f8e67200640 1 --2- 172.21.15.144:0/2637350113 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8e4406be30 0x7f8e4406e2f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8e680cf430 tx=0x7f8e50009040 comp rx=0 tx=0).stop 2024-09-11T23:18:54.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.799+0000 7f8e67200640 1 -- 172.21.15.144:0/2637350113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e680b4510 msgr2=0x7f8e681542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:54.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.799+0000 7f8e67200640 1 --2- 172.21.15.144:0/2637350113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e680b4510 0x7f8e681542c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8e580098a0 tx=0x7f8e580046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.799+0000 7f8e67200640 1 -- 172.21.15.144:0/2637350113 shutdown_connections 2024-09-11T23:18:54.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.799+0000 7f8e67200640 1 --2- 172.21.15.144:0/2637350113 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8e4406be30 0x7f8e4406e2f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.799+0000 7f8e67200640 1 --2- 172.21.15.144:0/2637350113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e6815b150 0x7f8e680716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.799+0000 7f8e67200640 1 --2- 172.21.15.144:0/2637350113 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e680cd030 0x7f8e68071160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.799+0000 7f8e67200640 1 --2- 172.21.15.144:0/2637350113 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e680b4510 0x7f8e681542c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:54.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.799+0000 7f8e67200640 1 -- 172.21.15.144:0/2637350113 >> 172.21.15.144:0/2637350113 conn(0x7f8e6806e910 msgr2=0x7f8e6806d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:54.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.799+0000 7f8e67200640 1 -- 172.21.15.144:0/2637350113 shutdown_connections 2024-09-11T23:18:54.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:54.799+0000 7f8e67200640 1 -- 172.21.15.144:0/2637350113 wait complete. 2024-09-11T23:18:54.816 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-09-11T23:18:53.173454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224424,"kb_used_data":4024,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750296,"statfs":{"total":773094113280,"available":772864303104,"internally_reserved":0,"allocated":4120576,"data_stored":2296820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001325"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028722+0000","last_change":"2024-09-11T23:18:49.023570+0000","last_active":"2024-09-11T23:18:49.028722+0000","last_peered":"2024-09-11T23:18:49.028722+0000","last_clean":"2024-09-11T23:18:49.028722+0000","last_became_active":"2024-09-11T23:18:49.022977+0000","last_became_peered":"2024-09-11T23:18:49.022977+0000","last_unstale":"2024-09-11T23:18:49.028722+0000","last_undegraded":"2024-09-11T23:18:49.028722+0000","last_fullsized":"2024-09-11T23:18:49.028722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:01.751435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.588089+0000","last_change":"2024-09-11T23:18:49.021369+0000","last_active":"2024-09-11T23:18:50.588089+0000","last_peered":"2024-09-11T23:18:50.588089+0000","last_clean":"2024-09-11T23:18:50.588089+0000","last_became_active":"2024-09-11T23:18:49.019525+0000","last_became_peered":"2024-09-11T23:18:49.019525+0000","last_unstale":"2024-09-11T23:18:50.588089+0000","last_undegraded":"2024-09-11T23:18:50.588089+0000","last_fullsized":"2024-09-11T23:18:50.588089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:22.587749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011797+0000","last_change":"2024-09-11T23:18:49.024403+0000","last_active":"2024-09-11T23:18:50.011797+0000","last_peered":"2024-09-11T23:18:50.011797+0000","last_clean":"2024-09-11T23:18:50.011797+0000","last_became_active":"2024-09-11T23:18:49.023902+0000","last_became_peered":"2024-09-11T23:18:49.023902+0000","last_unstale":"2024-09-11T23:18:50.011797+0000","last_undegraded":"2024-09-11T23:18:50.011797+0000","last_fullsized":"2024-09-11T23:18:50.011797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:47.530225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028571+0000","last_change":"2024-09-11T23:18:49.023773+0000","last_active":"2024-09-11T23:18:49.028571+0000","last_peered":"2024-09-11T23:18:49.028571+0000","last_clean":"2024-09-11T23:18:49.028571+0000","last_became_active":"2024-09-11T23:18:49.022616+0000","last_became_peered":"2024-09-11T23:18:49.022616+0000","last_unstale":"2024-09-11T23:18:49.028571+0000","last_undegraded":"2024-09-11T23:18:49.028571+0000","last_fullsized":"2024-09-11T23:18:49.028571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:52.437981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586124+0000","last_change":"2024-09-11T23:18:49.007229+0000","last_active":"2024-09-11T23:18:50.586124+0000","last_peered":"2024-09-11T23:18:50.586124+0000","last_clean":"2024-09-11T23:18:50.586124+0000","last_became_active":"2024-09-11T23:18:49.006975+0000","last_became_peered":"2024-09-11T23:18:49.006975+0000","last_unstale":"2024-09-11T23:18:50.586124+0000","last_undegraded":"2024-09-11T23:18:50.586124+0000","last_fullsized":"2024-09-11T23:18:50.586124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:03.728796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586606+0000","last_change":"2024-09-11T23:18:49.018644+0000","last_active":"2024-09-11T23:18:50.586606+0000","last_peered":"2024-09-11T23:18:50.586606+0000","last_clean":"2024-09-11T23:18:50.586606+0000","last_became_active":"2024-09-11T23:18:49.018385+0000","last_became_peered":"2024-09-11T23:18:49.018385+0000","last_unstale":"2024-09-11T23:18:50.586606+0000","last_undegraded":"2024-09-11T23:18:50.586606+0000","last_fullsized":"2024-09-11T23:18:50.586606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:45.542576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.027054+0000","last_change":"2024-09-11T23:18:49.019807+0000","last_active":"2024-09-11T23:18:49.027054+0000","last_peered":"2024-09-11T23:18:49.027054+0000","last_clean":"2024-09-11T23:18:49.027054+0000","last_became_active":"2024-09-11T23:18:49.019507+0000","last_became_peered":"2024-09-11T23:18:49.019507+0000","last_unstale":"2024-09-11T23:18:49.027054+0000","last_undegraded":"2024-09-11T23:18:49.027054+0000","last_fullsized":"2024-09-11T23:18:49.027054+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.721415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.017203+0000","last_change":"2024-09-11T23:18:49.010390+0000","last_active":"2024-09-11T23:18:49.017203+0000","last_peered":"2024-09-11T23:18:49.017203+0000","last_clean":"2024-09-11T23:18:49.017203+0000","last_became_active":"2024-09-11T23:18:49.008190+0000","last_became_peered":"2024-09-11T23:18:49.008190+0000","last_unstale":"2024-09-11T23:18:49.017203+0000","last_undegraded":"2024-09-11T23:18:49.017203+0000","last_fullsized":"2024-09-11T23:18:49.017203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:59.469342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.013000+0000","last_change":"2024-09-11T23:18:49.011361+0000","last_active":"2024-09-11T23:18:50.013000+0000","last_peered":"2024-09-11T23:18:50.013000+0000","last_clean":"2024-09-11T23:18:50.013000+0000","last_became_active":"2024-09-11T23:18:49.011101+0000","last_became_peered":"2024-09-11T23:18:49.011101+0000","last_unstale":"2024-09-11T23:18:50.013000+0000","last_undegraded":"2024-09-11T23:18:50.013000+0000","last_fullsized":"2024-09-11T23:18:50.013000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:59.469342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028654+0000","last_change":"2024-09-11T23:18:49.025064+0000","last_active":"2024-09-11T23:18:49.028654+0000","last_peered":"2024-09-11T23:18:49.028654+0000","last_clean":"2024-09-11T23:18:49.028654+0000","last_became_active":"2024-09-11T23:18:49.024637+0000","last_became_peered":"2024-09-11T23:18:49.024637+0000","last_unstale":"2024-09-11T23:18:49.028654+0000","last_undegraded":"2024-09-11T23:18:49.028654+0000","last_fullsized":"2024-09-11T23:18:49.028654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:35.168942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028217+0000","last_change":"2024-09-11T23:18:49.023722+0000","last_active":"2024-09-11T23:18:49.028217+0000","last_peered":"2024-09-11T23:18:49.028217+0000","last_clean":"2024-09-11T23:18:49.028217+0000","last_became_active":"2024-09-11T23:18:49.022908+0000","last_became_peered":"2024-09-11T23:18:49.022908+0000","last_unstale":"2024-09-11T23:18:49.028217+0000","last_undegraded":"2024-09-11T23:18:49.028217+0000","last_fullsized":"2024-09-11T23:18:49.028217+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:36.393454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011452+0000","last_change":"2024-09-11T23:18:49.008770+0000","last_active":"2024-09-11T23:18:50.011452+0000","last_peered":"2024-09-11T23:18:50.011452+0000","last_clean":"2024-09-11T23:18:50.011452+0000","last_became_active":"2024-09-11T23:18:49.008476+0000","last_became_peered":"2024-09-11T23:18:49.008476+0000","last_unstale":"2024-09-11T23:18:50.011452+0000","last_undegraded":"2024-09-11T23:18:50.011452+0000","last_fullsized":"2024-09-11T23:18:50.011452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.721415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586138+0000","last_change":"2024-09-11T23:18:49.028967+0000","last_active":"2024-09-11T23:18:50.586138+0000","last_peered":"2024-09-11T23:18:50.586138+0000","last_clean":"2024-09-11T23:18:50.586138+0000","last_became_active":"2024-09-11T23:18:49.028293+0000","last_became_peered":"2024-09-11T23:18:49.028293+0000","last_unstale":"2024-09-11T23:18:50.586138+0000","last_undegraded":"2024-09-11T23:18:50.586138+0000","last_fullsized":"2024-09-11T23:18:50.586138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:08.235979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586726+0000","last_change":"2024-09-11T23:18:49.005657+0000","last_active":"2024-09-11T23:18:50.586726+0000","last_peered":"2024-09-11T23:18:50.586726+0000","last_clean":"2024-09-11T23:18:50.586726+0000","last_became_active":"2024-09-11T23:18:49.005387+0000","last_became_peered":"2024-09-11T23:18:49.005387+0000","last_unstale":"2024-09-11T23:18:50.586726+0000","last_undegraded":"2024-09-11T23:18:50.586726+0000","last_fullsized":"2024-09-11T23:18:50.586726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:54.924531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012474+0000","last_change":"2024-09-11T23:18:49.010416+0000","last_active":"2024-09-11T23:18:50.012474+0000","last_peered":"2024-09-11T23:18:50.012474+0000","last_clean":"2024-09-11T23:18:50.012474+0000","last_became_active":"2024-09-11T23:18:49.010120+0000","last_became_peered":"2024-09-11T23:18:49.010120+0000","last_unstale":"2024-09-11T23:18:50.012474+0000","last_undegraded":"2024-09-11T23:18:50.012474+0000","last_fullsized":"2024-09-11T23:18:50.012474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:30.972000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.012104+0000","last_change":"2024-09-11T23:18:49.008741+0000","last_active":"2024-09-11T23:18:49.012104+0000","last_peered":"2024-09-11T23:18:49.012104+0000","last_clean":"2024-09-11T23:18:49.012104+0000","last_became_active":"2024-09-11T23:18:49.008543+0000","last_became_peered":"2024-09-11T23:18:49.008543+0000","last_unstale":"2024-09-11T23:18:49.012104+0000","last_undegraded":"2024-09-11T23:18:49.012104+0000","last_fullsized":"2024-09-11T23:18:49.012104+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:00.772427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.024083+0000","last_change":"2024-09-11T23:18:49.017267+0000","last_active":"2024-09-11T23:18:49.024083+0000","last_peered":"2024-09-11T23:18:49.024083+0000","last_clean":"2024-09-11T23:18:49.024083+0000","last_became_active":"2024-09-11T23:18:49.016994+0000","last_became_peered":"2024-09-11T23:18:49.016994+0000","last_unstale":"2024-09-11T23:18:49.024083+0000","last_undegraded":"2024-09-11T23:18:49.024083+0000","last_fullsized":"2024-09-11T23:18:49.024083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:04.572090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.588162+0000","last_change":"2024-09-11T23:18:49.016833+0000","last_active":"2024-09-11T23:18:50.588162+0000","last_peered":"2024-09-11T23:18:50.588162+0000","last_clean":"2024-09-11T23:18:50.588162+0000","last_became_active":"2024-09-11T23:18:49.009287+0000","last_became_peered":"2024-09-11T23:18:49.009287+0000","last_unstale":"2024-09-11T23:18:50.588162+0000","last_undegraded":"2024-09-11T23:18:50.588162+0000","last_fullsized":"2024-09-11T23:18:50.588162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:55.162354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587912+0000","last_change":"2024-09-11T23:18:49.024077+0000","last_active":"2024-09-11T23:18:50.587912+0000","last_peered":"2024-09-11T23:18:50.587912+0000","last_clean":"2024-09-11T23:18:50.587912+0000","last_became_active":"2024-09-11T23:18:49.023804+0000","last_became_peered":"2024-09-11T23:18:49.023804+0000","last_unstale":"2024-09-11T23:18:50.587912+0000","last_undegraded":"2024-09-11T23:18:50.587912+0000","last_fullsized":"2024-09-11T23:18:50.587912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:24.356397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586526+0000","last_change":"2024-09-11T23:18:49.024077+0000","last_active":"2024-09-11T23:18:50.586526+0000","last_peered":"2024-09-11T23:18:50.586526+0000","last_clean":"2024-09-11T23:18:50.586526+0000","last_became_active":"2024-09-11T23:18:49.023773+0000","last_became_peered":"2024-09-11T23:18:49.023773+0000","last_unstale":"2024-09-11T23:18:50.586526+0000","last_undegraded":"2024-09-11T23:18:50.586526+0000","last_fullsized":"2024-09-11T23:18:50.586526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:26.306962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011922+0000","last_change":"2024-09-11T23:18:49.013009+0000","last_active":"2024-09-11T23:18:50.011922+0000","last_peered":"2024-09-11T23:18:50.011922+0000","last_clean":"2024-09-11T23:18:50.011922+0000","last_became_active":"2024-09-11T23:18:49.012755+0000","last_became_peered":"2024-09-11T23:18:49.012755+0000","last_unstale":"2024-09-11T23:18:50.011922+0000","last_undegraded":"2024-09-11T23:18:50.011922+0000","last_fullsized":"2024-09-11T23:18:50.011922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:35.168942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012053+0000","last_change":"2024-09-11T23:18:49.009624+0000","last_active":"2024-09-11T23:18:50.012053+0000","last_peered":"2024-09-11T23:18:50.012053+0000","last_clean":"2024-09-11T23:18:50.012053+0000","last_became_active":"2024-09-11T23:18:49.009160+0000","last_became_peered":"2024-09-11T23:18:49.009160+0000","last_unstale":"2024-09-11T23:18:50.012053+0000","last_undegraded":"2024-09-11T23:18:50.012053+0000","last_fullsized":"2024-09-11T23:18:50.012053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:44.169273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.021931+0000","last_change":"2024-09-11T23:18:49.016619+0000","last_active":"2024-09-11T23:18:49.021931+0000","last_peered":"2024-09-11T23:18:49.021931+0000","last_clean":"2024-09-11T23:18:49.021931+0000","last_became_active":"2024-09-11T23:18:49.016367+0000","last_became_peered":"2024-09-11T23:18:49.016367+0000","last_unstale":"2024-09-11T23:18:49.021931+0000","last_undegraded":"2024-09-11T23:18:49.021931+0000","last_fullsized":"2024-09-11T23:18:49.021931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:08.846324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011169+0000","last_change":"2024-09-11T23:18:49.012178+0000","last_active":"2024-09-11T23:18:50.011169+0000","last_peered":"2024-09-11T23:18:50.011169+0000","last_clean":"2024-09-11T23:18:50.011169+0000","last_became_active":"2024-09-11T23:18:49.008877+0000","last_became_peered":"2024-09-11T23:18:49.008877+0000","last_unstale":"2024-09-11T23:18:50.011169+0000","last_undegraded":"2024-09-11T23:18:50.011169+0000","last_fullsized":"2024-09-11T23:18:50.011169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:02.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":6,"reported_epoch":33,"state":"active","last_fresh":"2024-09-11T23:18:49.031327+0000","last_change":"2024-09-11T23:18:49.031264+0000","last_active":"2024-09-11T23:18:49.031327+0000","last_peered":"2024-09-11T23:18:49.031327+0000","last_clean":"2024-09-11T23:18:47.981836+0000","last_became_active":"2024-09-11T23:18:49.031264+0000","last_became_peered":"2024-09-11T23:18:49.031264+0000","last_unstale":"2024-09-11T23:18:49.031327+0000","last_undegraded":"2024-09-11T23:18:49.031327+0000","last_fullsized":"2024-09-11T23:18:49.031327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":["1","7"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.588238+0000","last_change":"2024-09-11T23:18:49.017955+0000","last_active":"2024-09-11T23:18:50.588238+0000","last_peered":"2024-09-11T23:18:50.588238+0000","last_clean":"2024-09-11T23:18:50.588238+0000","last_became_active":"2024-09-11T23:18:49.008731+0000","last_became_peered":"2024-09-11T23:18:49.008731+0000","last_unstale":"2024-09-11T23:18:50.588238+0000","last_undegraded":"2024-09-11T23:18:50.588238+0000","last_fullsized":"2024-09-11T23:18:50.588238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:38.477516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028782+0000","last_change":"2024-09-11T23:18:49.023143+0000","last_active":"2024-09-11T23:18:49.028782+0000","last_peered":"2024-09-11T23:18:49.028782+0000","last_clean":"2024-09-11T23:18:49.028782+0000","last_became_active":"2024-09-11T23:18:49.022916+0000","last_became_peered":"2024-09-11T23:18:49.022916+0000","last_unstale":"2024-09-11T23:18:49.028782+0000","last_undegraded":"2024-09-11T23:18:49.028782+0000","last_fullsized":"2024-09-11T23:18:49.028782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:42.935157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012197+0000","last_change":"2024-09-11T23:18:49.015459+0000","last_active":"2024-09-11T23:18:50.012197+0000","last_peered":"2024-09-11T23:18:50.012197+0000","last_clean":"2024-09-11T23:18:50.012197+0000","last_became_active":"2024-09-11T23:18:49.014648+0000","last_became_peered":"2024-09-11T23:18:49.014648+0000","last_unstale":"2024-09-11T23:18:50.012197+0000","last_undegraded":"2024-09-11T23:18:50.012197+0000","last_fullsized":"2024-09-11T23:18:50.012197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:49.663140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012050+0000","last_change":"2024-09-11T23:18:49.009617+0000","last_active":"2024-09-11T23:18:50.012050+0000","last_peered":"2024-09-11T23:18:50.012050+0000","last_clean":"2024-09-11T23:18:50.012050+0000","last_became_active":"2024-09-11T23:18:49.007209+0000","last_became_peered":"2024-09-11T23:18:49.007209+0000","last_unstale":"2024-09-11T23:18:50.012050+0000","last_undegraded":"2024-09-11T23:18:50.012050+0000","last_fullsized":"2024-09-11T23:18:50.012050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:20.040267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.019964+0000","last_change":"2024-09-11T23:18:49.012641+0000","last_active":"2024-09-11T23:18:49.019964+0000","last_peered":"2024-09-11T23:18:49.019964+0000","last_clean":"2024-09-11T23:18:49.019964+0000","last_became_active":"2024-09-11T23:18:49.012332+0000","last_became_peered":"2024-09-11T23:18:49.012332+0000","last_unstale":"2024-09-11T23:18:49.019964+0000","last_undegraded":"2024-09-11T23:18:49.019964+0000","last_fullsized":"2024-09-11T23:18:49.019964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:16.182623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.020434+0000","last_change":"2024-09-11T23:18:49.013323+0000","last_active":"2024-09-11T23:18:49.020434+0000","last_peered":"2024-09-11T23:18:49.020434+0000","last_clean":"2024-09-11T23:18:49.020434+0000","last_became_active":"2024-09-11T23:18:49.012492+0000","last_became_peered":"2024-09-11T23:18:49.012492+0000","last_unstale":"2024-09-11T23:18:49.020434+0000","last_undegraded":"2024-09-11T23:18:49.020434+0000","last_fullsized":"2024-09-11T23:18:49.020434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:23.411234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.019831+0000","last_change":"2024-09-11T23:18:49.014929+0000","last_active":"2024-09-11T23:18:49.019831+0000","last_peered":"2024-09-11T23:18:49.019831+0000","last_clean":"2024-09-11T23:18:49.019831+0000","last_became_active":"2024-09-11T23:18:49.014660+0000","last_became_peered":"2024-09-11T23:18:49.014660+0000","last_unstale":"2024-09-11T23:18:49.019831+0000","last_undegraded":"2024-09-11T23:18:49.019831+0000","last_fullsized":"2024-09-11T23:18:49.019831+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:05.424937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.022471+0000","last_change":"2024-09-11T23:18:49.019336+0000","last_active":"2024-09-11T23:18:49.022471+0000","last_peered":"2024-09-11T23:18:49.022471+0000","last_clean":"2024-09-11T23:18:49.022471+0000","last_became_active":"2024-09-11T23:18:49.019078+0000","last_became_peered":"2024-09-11T23:18:49.019078+0000","last_unstale":"2024-09-11T23:18:49.022471+0000","last_undegraded":"2024-09-11T23:18:49.022471+0000","last_fullsized":"2024-09-11T23:18:49.022471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:35.168942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.031200+0000","last_change":"2024-09-11T23:18:48.007751+0000","last_active":"2024-09-11T23:18:49.031200+0000","last_peered":"2024-09-11T23:18:49.031200+0000","last_clean":"2024-09-11T23:18:49.031200+0000","last_became_active":"2024-09-11T23:18:48.007453+0000","last_became_peered":"2024-09-11T23:18:48.007453+0000","last_unstale":"2024-09-11T23:18:49.031200+0000","last_undegraded":"2024-09-11T23:18:49.031200+0000","last_fullsized":"2024-09-11T23:18:49.031200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:18.222705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028706+0000","last_change":"2024-09-11T23:18:49.023248+0000","last_active":"2024-09-11T23:18:49.028706+0000","last_peered":"2024-09-11T23:18:49.028706+0000","last_clean":"2024-09-11T23:18:49.028706+0000","last_became_active":"2024-09-11T23:18:49.018856+0000","last_became_peered":"2024-09-11T23:18:49.018856+0000","last_unstale":"2024-09-11T23:18:49.028706+0000","last_undegraded":"2024-09-11T23:18:49.028706+0000","last_fullsized":"2024-09-11T23:18:49.028706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:14.448085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.024169+0000","last_change":"2024-09-11T23:18:48.015111+0000","last_active":"2024-09-11T23:18:49.024169+0000","last_peered":"2024-09-11T23:18:49.024169+0000","last_clean":"2024-09-11T23:18:49.024169+0000","last_became_active":"2024-09-11T23:18:48.014804+0000","last_became_peered":"2024-09-11T23:18:48.014804+0000","last_unstale":"2024-09-11T23:18:49.024169+0000","last_undegraded":"2024-09-11T23:18:49.024169+0000","last_fullsized":"2024-09-11T23:18:49.024169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:43.882021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012303+0000","last_change":"2024-09-11T23:18:49.008030+0000","last_active":"2024-09-11T23:18:50.012303+0000","last_peered":"2024-09-11T23:18:50.012303+0000","last_clean":"2024-09-11T23:18:50.012303+0000","last_became_active":"2024-09-11T23:18:49.007228+0000","last_became_peered":"2024-09-11T23:18:49.007228+0000","last_unstale":"2024-09-11T23:18:50.012303+0000","last_undegraded":"2024-09-11T23:18:50.012303+0000","last_fullsized":"2024-09-11T23:18:50.012303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:05.371678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587895+0000","last_change":"2024-09-11T23:18:48.010963+0000","last_active":"2024-09-11T23:18:50.587895+0000","last_peered":"2024-09-11T23:18:50.587895+0000","last_clean":"2024-09-11T23:18:50.587895+0000","last_became_active":"2024-09-11T23:18:48.010705+0000","last_became_peered":"2024-09-11T23:18:48.010705+0000","last_unstale":"2024-09-11T23:18:50.587895+0000","last_undegraded":"2024-09-11T23:18:50.587895+0000","last_fullsized":"2024-09-11T23:18:50.587895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:49.742344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028763+0000","last_change":"2024-09-11T23:18:49.023043+0000","last_active":"2024-09-11T23:18:49.028763+0000","last_peered":"2024-09-11T23:18:49.028763+0000","last_clean":"2024-09-11T23:18:49.028763+0000","last_became_active":"2024-09-11T23:18:49.022537+0000","last_became_peered":"2024-09-11T23:18:49.022537+0000","last_unstale":"2024-09-11T23:18:49.028763+0000","last_undegraded":"2024-09-11T23:18:49.028763+0000","last_fullsized":"2024-09-11T23:18:49.028763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:01.751435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586466+0000","last_change":"2024-09-11T23:18:48.012267+0000","last_active":"2024-09-11T23:18:50.586466+0000","last_peered":"2024-09-11T23:18:50.586466+0000","last_clean":"2024-09-11T23:18:50.586466+0000","last_became_active":"2024-09-11T23:18:48.011880+0000","last_became_peered":"2024-09-11T23:18:48.011880+0000","last_unstale":"2024-09-11T23:18:50.586466+0000","last_undegraded":"2024-09-11T23:18:50.586466+0000","last_fullsized":"2024-09-11T23:18:50.586466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:20.606934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.023373+0000","last_change":"2024-09-11T23:18:49.017731+0000","last_active":"2024-09-11T23:18:49.023373+0000","last_peered":"2024-09-11T23:18:49.023373+0000","last_clean":"2024-09-11T23:18:49.023373+0000","last_became_active":"2024-09-11T23:18:49.017469+0000","last_became_peered":"2024-09-11T23:18:49.017469+0000","last_unstale":"2024-09-11T23:18:49.023373+0000","last_undegraded":"2024-09-11T23:18:49.023373+0000","last_fullsized":"2024-09-11T23:18:49.023373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:18.200252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012044+0000","last_change":"2024-09-11T23:18:48.011580+0000","last_active":"2024-09-11T23:18:50.012044+0000","last_peered":"2024-09-11T23:18:50.012044+0000","last_clean":"2024-09-11T23:18:50.012044+0000","last_became_active":"2024-09-11T23:18:48.011045+0000","last_became_peered":"2024-09-11T23:18:48.011045+0000","last_unstale":"2024-09-11T23:18:50.012044+0000","last_undegraded":"2024-09-11T23:18:50.012044+0000","last_fullsized":"2024-09-11T23:18:50.012044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:18.496309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011199+0000","last_change":"2024-09-11T23:18:49.015000+0000","last_active":"2024-09-11T23:18:50.011199+0000","last_peered":"2024-09-11T23:18:50.011199+0000","last_clean":"2024-09-11T23:18:50.011199+0000","last_became_active":"2024-09-11T23:18:49.014091+0000","last_became_peered":"2024-09-11T23:18:49.014091+0000","last_unstale":"2024-09-11T23:18:50.011199+0000","last_undegraded":"2024-09-11T23:18:50.011199+0000","last_fullsized":"2024-09-11T23:18:50.011199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:31.695691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012184+0000","last_change":"2024-09-11T23:18:48.009914+0000","last_active":"2024-09-11T23:18:50.012184+0000","last_peered":"2024-09-11T23:18:50.012184+0000","last_clean":"2024-09-11T23:18:50.012184+0000","last_became_active":"2024-09-11T23:18:48.007555+0000","last_became_peered":"2024-09-11T23:18:48.007555+0000","last_unstale":"2024-09-11T23:18:50.012184+0000","last_undegraded":"2024-09-11T23:18:50.012184+0000","last_fullsized":"2024-09-11T23:18:50.012184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:11.259384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011290+0000","last_change":"2024-09-11T23:18:49.006529+0000","last_active":"2024-09-11T23:18:50.011290+0000","last_peered":"2024-09-11T23:18:50.011290+0000","last_clean":"2024-09-11T23:18:50.011290+0000","last_became_active":"2024-09-11T23:18:49.006239+0000","last_became_peered":"2024-09-11T23:18:49.006239+0000","last_unstale":"2024-09-11T23:18:50.011290+0000","last_undegraded":"2024-09-11T23:18:50.011290+0000","last_fullsized":"2024-09-11T23:18:50.011290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:52.437981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586305+0000","last_change":"2024-09-11T23:18:48.005888+0000","last_active":"2024-09-11T23:18:50.586305+0000","last_peered":"2024-09-11T23:18:50.586305+0000","last_clean":"2024-09-11T23:18:50.586305+0000","last_became_active":"2024-09-11T23:18:48.005594+0000","last_became_peered":"2024-09-11T23:18:48.005594+0000","last_unstale":"2024-09-11T23:18:50.586305+0000","last_undegraded":"2024-09-11T23:18:50.586305+0000","last_fullsized":"2024-09-11T23:18:50.586305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:20.376536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.027881+0000","last_change":"2024-09-11T23:18:49.022786+0000","last_active":"2024-09-11T23:18:49.027881+0000","last_peered":"2024-09-11T23:18:49.027881+0000","last_clean":"2024-09-11T23:18:49.027881+0000","last_became_active":"2024-09-11T23:18:49.022512+0000","last_became_peered":"2024-09-11T23:18:49.022512+0000","last_unstale":"2024-09-11T23:18:49.027881+0000","last_undegraded":"2024-09-11T23:18:49.027881+0000","last_fullsized":"2024-09-11T23:18:49.027881+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:14.448085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011412+0000","last_change":"2024-09-11T23:18:48.001028+0000","last_active":"2024-09-11T23:18:50.011412+0000","last_peered":"2024-09-11T23:18:50.011412+0000","last_clean":"2024-09-11T23:18:50.011412+0000","last_became_active":"2024-09-11T23:18:48.000366+0000","last_became_peered":"2024-09-11T23:18:48.000366+0000","last_unstale":"2024-09-11T23:18:50.011412+0000","last_undegraded":"2024-09-11T23:18:50.011412+0000","last_fullsized":"2024-09-11T23:18:50.011412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:21.206250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011482+0000","last_change":"2024-09-11T23:18:49.010058+0000","last_active":"2024-09-11T23:18:50.011482+0000","last_peered":"2024-09-11T23:18:50.011482+0000","last_clean":"2024-09-11T23:18:50.011482+0000","last_became_active":"2024-09-11T23:18:49.007625+0000","last_became_peered":"2024-09-11T23:18:49.007625+0000","last_unstale":"2024-09-11T23:18:50.011482+0000","last_undegraded":"2024-09-11T23:18:50.011482+0000","last_fullsized":"2024-09-11T23:18:50.011482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:36.393454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587725+0000","last_change":"2024-09-11T23:18:48.017295+0000","last_active":"2024-09-11T23:18:50.587725+0000","last_peered":"2024-09-11T23:18:50.587725+0000","last_clean":"2024-09-11T23:18:50.587725+0000","last_became_active":"2024-09-11T23:18:48.016882+0000","last_became_peered":"2024-09-11T23:18:48.016882+0000","last_unstale":"2024-09-11T23:18:50.587725+0000","last_undegraded":"2024-09-11T23:18:50.587725+0000","last_fullsized":"2024-09-11T23:18:50.587725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:27.807403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587637+0000","last_change":"2024-09-11T23:18:49.024058+0000","last_active":"2024-09-11T23:18:50.587637+0000","last_peered":"2024-09-11T23:18:50.587637+0000","last_clean":"2024-09-11T23:18:50.587637+0000","last_became_active":"2024-09-11T23:18:49.023763+0000","last_became_peered":"2024-09-11T23:18:49.023763+0000","last_unstale":"2024-09-11T23:18:50.587637+0000","last_undegraded":"2024-09-11T23:18:50.587637+0000","last_fullsized":"2024-09-11T23:18:50.587637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:15.178674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.002487+0000","last_change":"2024-09-11T23:18:48.011655+0000","last_active":"2024-09-11T23:18:49.002487+0000","last_peered":"2024-09-11T23:18:49.002487+0000","last_clean":"2024-09-11T23:18:49.002487+0000","last_became_active":"2024-09-11T23:18:48.008273+0000","last_became_peered":"2024-09-11T23:18:48.008273+0000","last_unstale":"2024-09-11T23:18:49.002487+0000","last_undegraded":"2024-09-11T23:18:49.002487+0000","last_fullsized":"2024-09-11T23:18:49.002487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:51.349730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587574+0000","last_change":"2024-09-11T23:18:49.015893+0000","last_active":"2024-09-11T23:18:50.587574+0000","last_peered":"2024-09-11T23:18:50.587574+0000","last_clean":"2024-09-11T23:18:50.587574+0000","last_became_active":"2024-09-11T23:18:49.008793+0000","last_became_peered":"2024-09-11T23:18:49.008793+0000","last_unstale":"2024-09-11T23:18:50.587574+0000","last_undegraded":"2024-09-11T23:18:50.587574+0000","last_fullsized":"2024-09-11T23:18:50.587574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:01.289535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011904+0000","last_change":"2024-09-11T23:18:48.011616+0000","last_active":"2024-09-11T23:18:50.011904+0000","last_peered":"2024-09-11T23:18:50.011904+0000","last_clean":"2024-09-11T23:18:50.011904+0000","last_became_active":"2024-09-11T23:18:48.011108+0000","last_became_peered":"2024-09-11T23:18:48.011108+0000","last_unstale":"2024-09-11T23:18:50.011904+0000","last_undegraded":"2024-09-11T23:18:50.011904+0000","last_fullsized":"2024-09-11T23:18:50.011904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:34.165980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011637+0000","last_change":"2024-09-11T23:18:49.024580+0000","last_active":"2024-09-11T23:18:50.011637+0000","last_peered":"2024-09-11T23:18:50.011637+0000","last_clean":"2024-09-11T23:18:50.011637+0000","last_became_active":"2024-09-11T23:18:49.024279+0000","last_became_peered":"2024-09-11T23:18:49.024279+0000","last_unstale":"2024-09-11T23:18:50.011637+0000","last_undegraded":"2024-09-11T23:18:50.011637+0000","last_fullsized":"2024-09-11T23:18:50.011637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:22.301700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587334+0000","last_change":"2024-09-11T23:18:48.016996+0000","last_active":"2024-09-11T23:18:50.587334+0000","last_peered":"2024-09-11T23:18:50.587334+0000","last_clean":"2024-09-11T23:18:50.587334+0000","last_became_active":"2024-09-11T23:18:48.016503+0000","last_became_peered":"2024-09-11T23:18:48.016503+0000","last_unstale":"2024-09-11T23:18:50.587334+0000","last_undegraded":"2024-09-11T23:18:50.587334+0000","last_fullsized":"2024-09-11T23:18:50.587334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:33.072147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.017286+0000","last_change":"2024-09-11T23:18:49.012373+0000","last_active":"2024-09-11T23:18:49.017286+0000","last_peered":"2024-09-11T23:18:49.017286+0000","last_clean":"2024-09-11T23:18:49.017286+0000","last_became_active":"2024-09-11T23:18:49.011979+0000","last_became_peered":"2024-09-11T23:18:49.011979+0000","last_unstale":"2024-09-11T23:18:49.017286+0000","last_undegraded":"2024-09-11T23:18:49.017286+0000","last_fullsized":"2024-09-11T23:18:49.017286+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:44.884982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012156+0000","last_change":"2024-09-11T23:18:48.002333+0000","last_active":"2024-09-11T23:18:50.012156+0000","last_peered":"2024-09-11T23:18:50.012156+0000","last_clean":"2024-09-11T23:18:50.012156+0000","last_became_active":"2024-09-11T23:18:48.001101+0000","last_became_peered":"2024-09-11T23:18:48.001101+0000","last_unstale":"2024-09-11T23:18:50.012156+0000","last_undegraded":"2024-09-11T23:18:50.012156+0000","last_fullsized":"2024-09-11T23:18:50.012156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:30.420649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586953+0000","last_change":"2024-09-11T23:18:49.019321+0000","last_active":"2024-09-11T23:18:50.586953+0000","last_peered":"2024-09-11T23:18:50.586953+0000","last_clean":"2024-09-11T23:18:50.586953+0000","last_became_active":"2024-09-11T23:18:49.015579+0000","last_became_peered":"2024-09-11T23:18:49.015579+0000","last_unstale":"2024-09-11T23:18:50.586953+0000","last_undegraded":"2024-09-11T23:18:50.586953+0000","last_fullsized":"2024-09-11T23:18:50.586953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:06.688839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.011178+0000","last_change":"2024-09-11T23:18:48.010282+0000","last_active":"2024-09-11T23:18:49.011178+0000","last_peered":"2024-09-11T23:18:49.011178+0000","last_clean":"2024-09-11T23:18:49.011178+0000","last_became_active":"2024-09-11T23:18:48.007053+0000","last_became_peered":"2024-09-11T23:18:48.007053+0000","last_unstale":"2024-09-11T23:18:49.011178+0000","last_undegraded":"2024-09-11T23:18:49.011178+0000","last_fullsized":"2024-09-11T23:18:49.011178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:18.309385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.026361+0000","last_change":"2024-09-11T23:18:49.019508+0000","last_active":"2024-09-11T23:18:49.026361+0000","last_peered":"2024-09-11T23:18:49.026361+0000","last_clean":"2024-09-11T23:18:49.026361+0000","last_became_active":"2024-09-11T23:18:49.019067+0000","last_became_peered":"2024-09-11T23:18:49.019067+0000","last_unstale":"2024-09-11T23:18:49.026361+0000","last_undegraded":"2024-09-11T23:18:49.026361+0000","last_fullsized":"2024-09-11T23:18:49.026361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:31.695691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586329+0000","last_change":"2024-09-11T23:18:48.014618+0000","last_active":"2024-09-11T23:18:50.586329+0000","last_peered":"2024-09-11T23:18:50.586329+0000","last_clean":"2024-09-11T23:18:50.586329+0000","last_became_active":"2024-09-11T23:18:48.014376+0000","last_became_peered":"2024-09-11T23:18:48.014376+0000","last_unstale":"2024-09-11T23:18:50.586329+0000","last_undegraded":"2024-09-11T23:18:50.586329+0000","last_fullsized":"2024-09-11T23:18:50.586329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:00.540786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.023632+0000","last_change":"2024-09-11T23:18:49.017642+0000","last_active":"2024-09-11T23:18:49.023632+0000","last_peered":"2024-09-11T23:18:49.023632+0000","last_clean":"2024-09-11T23:18:49.023632+0000","last_became_active":"2024-09-11T23:18:49.017344+0000","last_became_peered":"2024-09-11T23:18:49.017344+0000","last_unstale":"2024-09-11T23:18:49.023632+0000","last_undegraded":"2024-09-11T23:18:49.023632+0000","last_fullsized":"2024-09-11T23:18:49.023632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:52.352691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586028+0000","last_change":"2024-09-11T23:18:48.016597+0000","last_active":"2024-09-11T23:18:50.586028+0000","last_peered":"2024-09-11T23:18:50.586028+0000","last_clean":"2024-09-11T23:18:50.586028+0000","last_became_active":"2024-09-11T23:18:48.016314+0000","last_became_peered":"2024-09-11T23:18:48.016314+0000","last_unstale":"2024-09-11T23:18:50.586028+0000","last_undegraded":"2024-09-11T23:18:50.586028+0000","last_fullsized":"2024-09-11T23:18:50.586028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:54.884414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012770+0000","last_change":"2024-09-11T23:18:49.015641+0000","last_active":"2024-09-11T23:18:50.012770+0000","last_peered":"2024-09-11T23:18:50.012770+0000","last_clean":"2024-09-11T23:18:50.012770+0000","last_became_active":"2024-09-11T23:18:49.014210+0000","last_became_peered":"2024-09-11T23:18:49.014210+0000","last_unstale":"2024-09-11T23:18:50.012770+0000","last_undegraded":"2024-09-11T23:18:50.012770+0000","last_fullsized":"2024-09-11T23:18:50.012770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:00.772427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.031601+0000","last_change":"2024-09-11T23:18:48.013143+0000","last_active":"2024-09-11T23:18:49.031601+0000","last_peered":"2024-09-11T23:18:49.031601+0000","last_clean":"2024-09-11T23:18:49.031601+0000","last_became_active":"2024-09-11T23:18:48.012875+0000","last_became_peered":"2024-09-11T23:18:48.012875+0000","last_unstale":"2024-09-11T23:18:49.031601+0000","last_undegraded":"2024-09-11T23:18:49.031601+0000","last_fullsized":"2024-09-11T23:18:49.031601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:43.166311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011688+0000","last_change":"2024-09-11T23:18:49.006253+0000","last_active":"2024-09-11T23:18:50.011688+0000","last_peered":"2024-09-11T23:18:50.011688+0000","last_clean":"2024-09-11T23:18:50.011688+0000","last_became_active":"2024-09-11T23:18:49.004054+0000","last_became_peered":"2024-09-11T23:18:49.004054+0000","last_unstale":"2024-09-11T23:18:50.011688+0000","last_undegraded":"2024-09-11T23:18:50.011688+0000","last_fullsized":"2024-09-11T23:18:50.011688+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:18.145725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012844+0000","last_change":"2024-09-11T23:18:48.001857+0000","last_active":"2024-09-11T23:18:50.012844+0000","last_peered":"2024-09-11T23:18:50.012844+0000","last_clean":"2024-09-11T23:18:50.012844+0000","last_became_active":"2024-09-11T23:18:48.001543+0000","last_became_peered":"2024-09-11T23:18:48.001543+0000","last_unstale":"2024-09-11T23:18:50.012844+0000","last_undegraded":"2024-09-11T23:18:50.012844+0000","last_fullsized":"2024-09-11T23:18:50.012844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:14.102475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.028592+0000","last_change":"2024-09-11T23:18:49.024287+0000","last_active":"2024-09-11T23:18:49.028592+0000","last_peered":"2024-09-11T23:18:49.028592+0000","last_clean":"2024-09-11T23:18:49.028592+0000","last_became_active":"2024-09-11T23:18:49.022965+0000","last_became_peered":"2024-09-11T23:18:49.022965+0000","last_unstale":"2024-09-11T23:18:49.028592+0000","last_undegraded":"2024-09-11T23:18:49.028592+0000","last_fullsized":"2024-09-11T23:18:49.028592+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:08.846324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012525+0000","last_change":"2024-09-11T23:18:48.004742+0000","last_active":"2024-09-11T23:18:50.012525+0000","last_peered":"2024-09-11T23:18:50.012525+0000","last_clean":"2024-09-11T23:18:50.012525+0000","last_became_active":"2024-09-11T23:18:48.004317+0000","last_became_peered":"2024-09-11T23:18:48.004317+0000","last_unstale":"2024-09-11T23:18:50.012525+0000","last_undegraded":"2024-09-11T23:18:50.012525+0000","last_fullsized":"2024-09-11T23:18:50.012525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:14.500017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586351+0000","last_change":"2024-09-11T23:18:49.014969+0000","last_active":"2024-09-11T23:18:50.586351+0000","last_peered":"2024-09-11T23:18:50.586351+0000","last_clean":"2024-09-11T23:18:50.586351+0000","last_became_active":"2024-09-11T23:18:49.014665+0000","last_became_peered":"2024-09-11T23:18:49.014665+0000","last_unstale":"2024-09-11T23:18:50.586351+0000","last_undegraded":"2024-09-11T23:18:50.586351+0000","last_fullsized":"2024-09-11T23:18:50.586351+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:07:27.965516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012482+0000","last_change":"2024-09-11T23:18:48.004710+0000","last_active":"2024-09-11T23:18:50.012482+0000","last_peered":"2024-09-11T23:18:50.012482+0000","last_clean":"2024-09-11T23:18:50.012482+0000","last_became_active":"2024-09-11T23:18:48.004396+0000","last_became_peered":"2024-09-11T23:18:48.004396+0000","last_unstale":"2024-09-11T23:18:50.012482+0000","last_undegraded":"2024-09-11T23:18:50.012482+0000","last_fullsized":"2024-09-11T23:18:50.012482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:58.115645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586139+0000","last_change":"2024-09-11T23:18:49.013677+0000","last_active":"2024-09-11T23:18:50.586139+0000","last_peered":"2024-09-11T23:18:50.586139+0000","last_clean":"2024-09-11T23:18:50.586139+0000","last_became_active":"2024-09-11T23:18:49.013135+0000","last_became_peered":"2024-09-11T23:18:49.013135+0000","last_unstale":"2024-09-11T23:18:50.586139+0000","last_undegraded":"2024-09-11T23:18:50.586139+0000","last_fullsized":"2024-09-11T23:18:50.586139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:05.649394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.005713+0000","last_change":"2024-09-11T23:18:48.009114+0000","last_active":"2024-09-11T23:18:49.005713+0000","last_peered":"2024-09-11T23:18:49.005713+0000","last_clean":"2024-09-11T23:18:49.005713+0000","last_became_active":"2024-09-11T23:18:48.008595+0000","last_became_peered":"2024-09-11T23:18:48.008595+0000","last_unstale":"2024-09-11T23:18:49.005713+0000","last_undegraded":"2024-09-11T23:18:49.005713+0000","last_fullsized":"2024-09-11T23:18:49.005713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:41.932196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586528+0000","last_change":"2024-09-11T23:18:49.012606+0000","last_active":"2024-09-11T23:18:50.586528+0000","last_peered":"2024-09-11T23:18:50.586528+0000","last_clean":"2024-09-11T23:18:50.586528+0000","last_became_active":"2024-09-11T23:18:49.012315+0000","last_became_peered":"2024-09-11T23:18:49.012315+0000","last_unstale":"2024-09-11T23:18:50.586528+0000","last_undegraded":"2024-09-11T23:18:50.586528+0000","last_fullsized":"2024-09-11T23:18:50.586528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:02.102975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.003131+0000","last_change":"2024-09-11T23:18:48.014456+0000","last_active":"2024-09-11T23:18:49.003131+0000","last_peered":"2024-09-11T23:18:49.003131+0000","last_clean":"2024-09-11T23:18:49.003131+0000","last_became_active":"2024-09-11T23:18:48.014078+0000","last_became_peered":"2024-09-11T23:18:48.014078+0000","last_unstale":"2024-09-11T23:18:49.003131+0000","last_undegraded":"2024-09-11T23:18:49.003131+0000","last_fullsized":"2024-09-11T23:18:49.003131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:18.309385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.585986+0000","last_change":"2024-09-11T23:18:49.008898+0000","last_active":"2024-09-11T23:18:50.585986+0000","last_peered":"2024-09-11T23:18:50.585986+0000","last_clean":"2024-09-11T23:18:50.585986+0000","last_became_active":"2024-09-11T23:18:49.008538+0000","last_became_peered":"2024-09-11T23:18:49.008538+0000","last_unstale":"2024-09-11T23:18:50.585986+0000","last_undegraded":"2024-09-11T23:18:50.585986+0000","last_fullsized":"2024-09-11T23:18:50.585986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:00.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011799+0000","last_change":"2024-09-11T23:18:48.003928+0000","last_active":"2024-09-11T23:18:50.011799+0000","last_peered":"2024-09-11T23:18:50.011799+0000","last_clean":"2024-09-11T23:18:50.011799+0000","last_became_active":"2024-09-11T23:18:48.003048+0000","last_became_peered":"2024-09-11T23:18:48.003048+0000","last_unstale":"2024-09-11T23:18:50.011799+0000","last_undegraded":"2024-09-11T23:18:50.011799+0000","last_fullsized":"2024-09-11T23:18:50.011799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:37.584863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.024045+0000","last_change":"2024-09-11T23:18:49.013365+0000","last_active":"2024-09-11T23:18:49.024045+0000","last_peered":"2024-09-11T23:18:49.024045+0000","last_clean":"2024-09-11T23:18:49.024045+0000","last_became_active":"2024-09-11T23:18:49.013014+0000","last_became_peered":"2024-09-11T23:18:49.013014+0000","last_unstale":"2024-09-11T23:18:49.024045+0000","last_undegraded":"2024-09-11T23:18:49.024045+0000","last_fullsized":"2024-09-11T23:18:49.024045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:02.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011282+0000","last_change":"2024-09-11T23:18:48.013115+0000","last_active":"2024-09-11T23:18:50.011282+0000","last_peered":"2024-09-11T23:18:50.011282+0000","last_clean":"2024-09-11T23:18:50.011282+0000","last_became_active":"2024-09-11T23:18:48.012783+0000","last_became_peered":"2024-09-11T23:18:48.012783+0000","last_unstale":"2024-09-11T23:18:50.011282+0000","last_undegraded":"2024-09-11T23:18:50.011282+0000","last_fullsized":"2024-09-11T23:18:50.011282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:07.843362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586275+0000","last_change":"2024-09-11T23:18:49.013885+0000","last_active":"2024-09-11T23:18:50.586275+0000","last_peered":"2024-09-11T23:18:50.586275+0000","last_clean":"2024-09-11T23:18:50.586275+0000","last_became_active":"2024-09-11T23:18:49.013611+0000","last_became_peered":"2024-09-11T23:18:49.013611+0000","last_unstale":"2024-09-11T23:18:50.586275+0000","last_undegraded":"2024-09-11T23:18:50.586275+0000","last_fullsized":"2024-09-11T23:18:50.586275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:09.280069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.031657+0000","last_change":"2024-09-11T23:18:48.009617+0000","last_active":"2024-09-11T23:18:49.031657+0000","last_peered":"2024-09-11T23:18:49.031657+0000","last_clean":"2024-09-11T23:18:49.031657+0000","last_became_active":"2024-09-11T23:18:48.009195+0000","last_became_peered":"2024-09-11T23:18:48.009195+0000","last_unstale":"2024-09-11T23:18:49.031657+0000","last_undegraded":"2024-09-11T23:18:49.031657+0000","last_fullsized":"2024-09-11T23:18:49.031657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:19.037305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011847+0000","last_change":"2024-09-11T23:18:49.012656+0000","last_active":"2024-09-11T23:18:50.011847+0000","last_peered":"2024-09-11T23:18:50.011847+0000","last_clean":"2024-09-11T23:18:50.011847+0000","last_became_active":"2024-09-11T23:18:49.012305+0000","last_became_peered":"2024-09-11T23:18:49.012305+0000","last_unstale":"2024-09-11T23:18:50.011847+0000","last_undegraded":"2024-09-11T23:18:50.011847+0000","last_fullsized":"2024-09-11T23:18:50.011847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:46.582189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.002677+0000","last_change":"2024-09-11T23:18:48.005217+0000","last_active":"2024-09-11T23:18:49.002677+0000","last_peered":"2024-09-11T23:18:49.002677+0000","last_clean":"2024-09-11T23:18:49.002677+0000","last_became_active":"2024-09-11T23:18:48.004931+0000","last_became_peered":"2024-09-11T23:18:48.004931+0000","last_unstale":"2024-09-11T23:18:49.002677+0000","last_undegraded":"2024-09-11T23:18:49.002677+0000","last_fullsized":"2024-09-11T23:18:49.002677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:13.445123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.027344+0000","last_change":"2024-09-11T23:18:49.027344+0000","last_active":"2024-09-11T23:18:49.027344+0000","last_peered":"2024-09-11T23:18:49.027344+0000","last_clean":"2024-09-11T23:18:49.027344+0000","last_became_active":"2024-09-11T23:18:49.027022+0000","last_became_peered":"2024-09-11T23:18:49.027022+0000","last_unstale":"2024-09-11T23:18:49.027344+0000","last_undegraded":"2024-09-11T23:18:49.027344+0000","last_fullsized":"2024-09-11T23:18:49.027344+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:44.169273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.015580+0000","last_change":"2024-09-11T23:18:48.011606+0000","last_active":"2024-09-11T23:18:49.015580+0000","last_peered":"2024-09-11T23:18:49.015580+0000","last_clean":"2024-09-11T23:18:49.015580+0000","last_became_active":"2024-09-11T23:18:48.011355+0000","last_became_peered":"2024-09-11T23:18:48.011355+0000","last_unstale":"2024-09-11T23:18:49.015580+0000","last_undegraded":"2024-09-11T23:18:49.015580+0000","last_fullsized":"2024-09-11T23:18:49.015580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:51.349730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.020551+0000","last_change":"2024-09-11T23:18:49.014470+0000","last_active":"2024-09-11T23:18:49.020551+0000","last_peered":"2024-09-11T23:18:49.020551+0000","last_clean":"2024-09-11T23:18:49.020551+0000","last_became_active":"2024-09-11T23:18:49.013737+0000","last_became_peered":"2024-09-11T23:18:49.013737+0000","last_unstale":"2024-09-11T23:18:49.020551+0000","last_undegraded":"2024-09-11T23:18:49.020551+0000","last_fullsized":"2024-09-11T23:18:49.020551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:44.884982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.005691+0000","last_change":"2024-09-11T23:18:48.006018+0000","last_active":"2024-09-11T23:18:49.005691+0000","last_peered":"2024-09-11T23:18:49.005691+0000","last_clean":"2024-09-11T23:18:49.005691+0000","last_became_active":"2024-09-11T23:18:48.005721+0000","last_became_peered":"2024-09-11T23:18:48.005721+0000","last_unstale":"2024-09-11T23:18:49.005691+0000","last_undegraded":"2024-09-11T23:18:49.005691+0000","last_fullsized":"2024-09-11T23:18:49.005691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:00.748473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.016200+0000","last_change":"2024-09-11T23:18:49.010494+0000","last_active":"2024-09-11T23:18:49.016200+0000","last_peered":"2024-09-11T23:18:49.016200+0000","last_clean":"2024-09-11T23:18:49.016200+0000","last_became_active":"2024-09-11T23:18:49.010206+0000","last_became_peered":"2024-09-11T23:18:49.010206+0000","last_unstale":"2024-09-11T23:18:49.016200+0000","last_undegraded":"2024-09-11T23:18:49.016200+0000","last_fullsized":"2024-09-11T23:18:49.016200+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:52.437981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.011307+0000","last_change":"2024-09-11T23:18:48.012601+0000","last_active":"2024-09-11T23:18:49.011307+0000","last_peered":"2024-09-11T23:18:49.011307+0000","last_clean":"2024-09-11T23:18:49.011307+0000","last_became_active":"2024-09-11T23:18:48.010086+0000","last_became_peered":"2024-09-11T23:18:48.010086+0000","last_unstale":"2024-09-11T23:18:49.011307+0000","last_undegraded":"2024-09-11T23:18:49.011307+0000","last_fullsized":"2024-09-11T23:18:49.011307+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:22.408272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586065+0000","last_change":"2024-09-11T23:18:49.009424+0000","last_active":"2024-09-11T23:18:50.586065+0000","last_peered":"2024-09-11T23:18:50.586065+0000","last_clean":"2024-09-11T23:18:50.586065+0000","last_became_active":"2024-09-11T23:18:49.008854+0000","last_became_peered":"2024-09-11T23:18:49.008854+0000","last_unstale":"2024-09-11T23:18:50.586065+0000","last_undegraded":"2024-09-11T23:18:50.586065+0000","last_fullsized":"2024-09-11T23:18:50.586065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:54.389826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012956+0000","last_change":"2024-09-11T23:18:48.000946+0000","last_active":"2024-09-11T23:18:50.012956+0000","last_peered":"2024-09-11T23:18:50.012956+0000","last_clean":"2024-09-11T23:18:50.012956+0000","last_became_active":"2024-09-11T23:18:48.000299+0000","last_became_peered":"2024-09-11T23:18:48.000299+0000","last_unstale":"2024-09-11T23:18:50.012956+0000","last_undegraded":"2024-09-11T23:18:50.012956+0000","last_fullsized":"2024-09-11T23:18:50.012956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:19.403184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011694+0000","last_change":"2024-09-11T23:18:49.000439+0000","last_active":"2024-09-11T23:18:50.011694+0000","last_peered":"2024-09-11T23:18:50.011694+0000","last_clean":"2024-09-11T23:18:50.011694+0000","last_became_active":"2024-09-11T23:18:49.000122+0000","last_became_peered":"2024-09-11T23:18:49.000122+0000","last_unstale":"2024-09-11T23:18:50.011694+0000","last_undegraded":"2024-09-11T23:18:50.011694+0000","last_fullsized":"2024-09-11T23:18:50.011694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:08.846324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586132+0000","last_change":"2024-09-11T23:18:48.016472+0000","last_active":"2024-09-11T23:18:50.586132+0000","last_peered":"2024-09-11T23:18:50.586132+0000","last_clean":"2024-09-11T23:18:50.586132+0000","last_became_active":"2024-09-11T23:18:48.016190+0000","last_became_peered":"2024-09-11T23:18:48.016190+0000","last_unstale":"2024-09-11T23:18:50.586132+0000","last_undegraded":"2024-09-11T23:18:50.586132+0000","last_fullsized":"2024-09-11T23:18:50.586132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:19.031495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.020509+0000","last_change":"2024-09-11T23:18:49.012546+0000","last_active":"2024-09-11T23:18:49.020509+0000","last_peered":"2024-09-11T23:18:49.020509+0000","last_clean":"2024-09-11T23:18:49.020509+0000","last_became_active":"2024-09-11T23:18:49.012189+0000","last_became_peered":"2024-09-11T23:18:49.012189+0000","last_unstale":"2024-09-11T23:18:49.020509+0000","last_undegraded":"2024-09-11T23:18:49.020509+0000","last_fullsized":"2024-09-11T23:18:49.020509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:49.321225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:48.999430+0000","last_change":"2024-09-11T23:18:48.008963+0000","last_active":"2024-09-11T23:18:48.999430+0000","last_peered":"2024-09-11T23:18:48.999430+0000","last_clean":"2024-09-11T23:18:48.999430+0000","last_became_active":"2024-09-11T23:18:48.008162+0000","last_became_peered":"2024-09-11T23:18:48.008162+0000","last_unstale":"2024-09-11T23:18:48.999430+0000","last_undegraded":"2024-09-11T23:18:48.999430+0000","last_fullsized":"2024-09-11T23:18:48.999430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:30.420649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":189,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-11T23:18:49.000785+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:18:49.000785+0000","last_peered":"2024-09-11T23:18:49.000785+0000","last_clean":"2024-09-11T23:18:49.000785+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:18:49.000785+0000","last_undegraded":"2024-09-11T23:18:49.000785+0000","last_fullsized":"2024-09-11T23:18:49.000785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476753,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":729689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476752,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":139847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476751,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":139903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476751,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":368640,"data_stored":139335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":348160,"data_stored":132456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":942080,"data_stored":722824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":147165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":145601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:18:57.825 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:18:57.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.989+0000 7f085fe00640 1 Processor -- start 2024-09-11T23:18:57.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.989+0000 7f085fe00640 1 -- start start 2024-09-11T23:18:57.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.991+0000 7f085fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f08580cf070 0x7f08580cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:57.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.991+0000 7f085fe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08580ce740 con 0x7f085815c180 2024-09-11T23:18:57.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.991+0000 7f085fe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0858072640 con 0x7f0858073120 2024-09-11T23:18:57.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.991+0000 7f085fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0858072920 con 0x7f08580cf070 2024-09-11T23:18:57.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.991+0000 7f085ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f08580cf070 0x7f08580cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:57.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.991+0000 7f085ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f08580cf070 0x7f08580cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37416/0 (socket says 172.21.15.144:37416) 2024-09-11T23:18:57.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.991+0000 7f085ca00640 1 -- 172.21.15.144:0/990184199 learned_addr learned my addr 172.21.15.144:0/990184199 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:57.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.991+0000 7f085ca00640 1 -- 172.21.15.144:0/990184199 >> v1:172.21.15.165:6789/0 conn(0x7f0858073120 legacy=0x7f085806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:57.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.991+0000 7f085ca00640 1 -- 172.21.15.144:0/990184199 >> v1:172.21.15.144:6789/0 conn(0x7f085815c180 legacy=0x7f08580cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:57.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.991+0000 7f085ca00640 1 -- 172.21.15.144:0/990184199 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0858072c00 con 0x7f08580cf070 2024-09-11T23:18:57.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.992+0000 7f085ca00640 1 --2- 172.21.15.144:0/990184199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08580cf070 0x7f08580cf4e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0844009870 tx=0x7f084402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5f4a6d4ca4077b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:57.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.993+0000 7f0857e00640 1 -- 172.21.15.144:0/990184199 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0844037070 con 0x7f08580cf070 2024-09-11T23:18:57.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.993+0000 7f0857e00640 1 -- 172.21.15.144:0/990184199 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f084402ada0 con 0x7f08580cf070 2024-09-11T23:18:57.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.993+0000 7f0857e00640 1 -- 172.21.15.144:0/990184199 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0844032660 con 0x7f08580cf070 2024-09-11T23:18:57.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.993+0000 7f085fe00640 1 -- 172.21.15.144:0/990184199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08580cf070 msgr2=0x7f08580cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:57.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.993+0000 7f085fe00640 1 --2- 172.21.15.144:0/990184199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08580cf070 0x7f08580cf4e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0844009870 tx=0x7f084402a110 comp rx=0 tx=0).stop 2024-09-11T23:18:57.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.993+0000 7f085fe00640 1 -- 172.21.15.144:0/990184199 shutdown_connections 2024-09-11T23:18:57.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.993+0000 7f085fe00640 1 --2- 172.21.15.144:0/990184199 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08580cf070 0x7f08580cf4e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:57.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.993+0000 7f085fe00640 1 -- 172.21.15.144:0/990184199 >> 172.21.15.144:0/990184199 conn(0x7f0858062cc0 msgr2=0x7f085806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:57.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.993+0000 7f085fe00640 1 -- 172.21.15.144:0/990184199 shutdown_connections 2024-09-11T23:18:57.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.993+0000 7f085fe00640 1 -- 172.21.15.144:0/990184199 wait complete. 2024-09-11T23:18:57.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.995+0000 7f085fe00640 1 Processor -- start 2024-09-11T23:18:57.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.995+0000 7f085fe00640 1 -- start start 2024-09-11T23:18:57.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.996+0000 7f085fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0858073120 0x7f08581507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:57.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.996+0000 7f085fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08580cf070 0x7f08580b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:57.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.996+0000 7f085fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f085815c180 0x7f08580b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:57.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.996+0000 7f085fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f08580722f0 con 0x7f08580cf070 2024-09-11T23:18:57.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.996+0000 7f085fe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f08580ced00 con 0x7f0858073120 2024-09-11T23:18:57.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.996+0000 7f085fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f085815c560 con 0x7f085815c180 2024-09-11T23:18:57.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.996+0000 7f085ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08580cf070 0x7f08580b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:57.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.996+0000 7f085ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08580cf070 0x7f08580b2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37428/0 (socket says 172.21.15.144:37428) 2024-09-11T23:18:57.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.996+0000 7f085ca00640 1 -- 172.21.15.144:0/920387103 learned_addr learned my addr 172.21.15.144:0/920387103 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:57.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.996+0000 7f085ca00640 1 -- 172.21.15.144:0/920387103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f085815c180 msgr2=0x7f08580b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:57.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.996+0000 7f085ca00640 1 --2- 172.21.15.144:0/920387103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f085815c180 0x7f08580b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:57.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.996+0000 7f085ca00640 1 -- 172.21.15.144:0/920387103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0858073120 msgr2=0x7f08581507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:57.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.996+0000 7f085ca00640 1 --2- 172.21.15.144:0/920387103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0858073120 0x7f08581507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:57.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.996+0000 7f085ca00640 1 -- 172.21.15.144:0/920387103 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085815dd00 con 0x7f08580cf070 2024-09-11T23:18:57.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.997+0000 7f085ca00640 1 --2- 172.21.15.144:0/920387103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08580cf070 0x7f08580b2290 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0844009870 tx=0x7f08440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:57.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.997+0000 7f0855600640 1 -- 172.21.15.144:0/920387103 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0844037040 con 0x7f08580cf070 2024-09-11T23:18:57.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.997+0000 7f0855600640 1 -- 172.21.15.144:0/920387103 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0844004030 con 0x7f08580cf070 2024-09-11T23:18:58.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.997+0000 7f0855600640 1 -- 172.21.15.144:0/920387103 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0844004420 con 0x7f08580cf070 2024-09-11T23:18:58.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.997+0000 7f085fe00640 1 -- 172.21.15.144:0/920387103 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f085815dfe0 con 0x7f08580cf070 2024-09-11T23:18:58.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.997+0000 7f085fe00640 1 -- 172.21.15.144:0/920387103 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f085815e5a0 con 0x7f08580cf070 2024-09-11T23:18:58.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.998+0000 7f085fe00640 1 -- 172.21.15.144:0/920387103 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08580d0660 con 0x7f08580cf070 2024-09-11T23:18:58.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:57.999+0000 7f0855600640 1 -- 172.21.15.144:0/920387103 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f084403a070 con 0x7f08580cf070 2024-09-11T23:18:58.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.000+0000 7f0855600640 1 --2- 172.21.15.144:0/920387103 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f083806be60 0x7f083806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.001+0000 7f0855600640 1 -- 172.21.15.144:0/920387103 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f08440ab3c0 con 0x7f08580cf070 2024-09-11T23:18:58.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.001+0000 7f085d400640 1 --2- 172.21.15.144:0/920387103 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f083806be60 0x7f083806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.001+0000 7f085d400640 1 --2- 172.21.15.144:0/920387103 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f083806be60 0x7f083806e320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f084c000f60 tx=0x7f084c007990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:58.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.005+0000 7f0855600640 1 -- 172.21.15.144:0/920387103 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0844041020 con 0x7f08580cf070 2024-09-11T23:18:58.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.178+0000 7f085fe00640 1 -- 172.21.15.144:0/920387103 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f085815a700 con 0x7f083806be60 2024-09-11T23:18:58.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.184+0000 7f0855600640 1 -- 172.21.15.144:0/920387103 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251927 (secure 0 0 0) 0x7f085815a700 con 0x7f083806be60 2024-09-11T23:18:58.189 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:58.190 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:18:58.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.189+0000 7f085fe00640 1 -- 172.21.15.144:0/920387103 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f083806be60 msgr2=0x7f083806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.189+0000 7f085fe00640 1 --2- 172.21.15.144:0/920387103 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f083806be60 0x7f083806e320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f084c000f60 tx=0x7f084c007990 comp rx=0 tx=0).stop 2024-09-11T23:18:58.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.189+0000 7f085fe00640 1 -- 172.21.15.144:0/920387103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08580cf070 msgr2=0x7f08580b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.189+0000 7f085fe00640 1 --2- 172.21.15.144:0/920387103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08580cf070 0x7f08580b2290 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0844009870 tx=0x7f08440046c0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.189+0000 7f085fe00640 1 -- 172.21.15.144:0/920387103 shutdown_connections 2024-09-11T23:18:58.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.189+0000 7f085fe00640 1 --2- 172.21.15.144:0/920387103 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f083806be60 0x7f083806e320 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.189+0000 7f085fe00640 1 --2- 172.21.15.144:0/920387103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f085815c180 0x7f08580b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.189+0000 7f085fe00640 1 --2- 172.21.15.144:0/920387103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08580cf070 0x7f08580b2290 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.189+0000 7f085fe00640 1 --2- 172.21.15.144:0/920387103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0858073120 0x7f08581507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.189+0000 7f085fe00640 1 -- 172.21.15.144:0/920387103 >> 172.21.15.144:0/920387103 conn(0x7f0858062cc0 msgr2=0x7f0858159c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:58.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.189+0000 7f085fe00640 1 -- 172.21.15.144:0/920387103 shutdown_connections 2024-09-11T23:18:58.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.189+0000 7f085fe00640 1 -- 172.21.15.144:0/920387103 wait complete. 2024-09-11T23:18:58.205 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-09-11T23:18:57.174435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224548,"kb_used_data":4136,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750172,"statfs":{"total":773094113280,"available":772864176128,"internally_reserved":0,"allocated":4235264,"data_stored":2349804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.183210"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.086065+0000","last_change":"2024-09-11T23:18:49.023570+0000","last_active":"2024-09-11T23:18:50.086065+0000","last_peered":"2024-09-11T23:18:50.086065+0000","last_clean":"2024-09-11T23:18:50.086065+0000","last_became_active":"2024-09-11T23:18:49.022977+0000","last_became_peered":"2024-09-11T23:18:49.022977+0000","last_unstale":"2024-09-11T23:18:50.086065+0000","last_undegraded":"2024-09-11T23:18:50.086065+0000","last_fullsized":"2024-09-11T23:18:50.086065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:35.168942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.588089+0000","last_change":"2024-09-11T23:18:49.021369+0000","last_active":"2024-09-11T23:18:50.588089+0000","last_peered":"2024-09-11T23:18:50.588089+0000","last_clean":"2024-09-11T23:18:50.588089+0000","last_became_active":"2024-09-11T23:18:49.019525+0000","last_became_peered":"2024-09-11T23:18:49.019525+0000","last_unstale":"2024-09-11T23:18:50.588089+0000","last_undegraded":"2024-09-11T23:18:50.588089+0000","last_fullsized":"2024-09-11T23:18:50.588089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:22.587749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011797+0000","last_change":"2024-09-11T23:18:49.024403+0000","last_active":"2024-09-11T23:18:50.011797+0000","last_peered":"2024-09-11T23:18:50.011797+0000","last_clean":"2024-09-11T23:18:50.011797+0000","last_became_active":"2024-09-11T23:18:49.023902+0000","last_became_peered":"2024-09-11T23:18:49.023902+0000","last_unstale":"2024-09-11T23:18:50.011797+0000","last_undegraded":"2024-09-11T23:18:50.011797+0000","last_fullsized":"2024-09-11T23:18:50.011797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:47.530225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587297+0000","last_change":"2024-09-11T23:18:49.023773+0000","last_active":"2024-09-11T23:18:50.587297+0000","last_peered":"2024-09-11T23:18:50.587297+0000","last_clean":"2024-09-11T23:18:50.587297+0000","last_became_active":"2024-09-11T23:18:49.022616+0000","last_became_peered":"2024-09-11T23:18:49.022616+0000","last_unstale":"2024-09-11T23:18:50.587297+0000","last_undegraded":"2024-09-11T23:18:50.587297+0000","last_fullsized":"2024-09-11T23:18:50.587297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:16.182623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586124+0000","last_change":"2024-09-11T23:18:49.007229+0000","last_active":"2024-09-11T23:18:50.586124+0000","last_peered":"2024-09-11T23:18:50.586124+0000","last_clean":"2024-09-11T23:18:50.586124+0000","last_became_active":"2024-09-11T23:18:49.006975+0000","last_became_peered":"2024-09-11T23:18:49.006975+0000","last_unstale":"2024-09-11T23:18:50.586124+0000","last_undegraded":"2024-09-11T23:18:50.586124+0000","last_fullsized":"2024-09-11T23:18:50.586124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:03.728796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586606+0000","last_change":"2024-09-11T23:18:49.018644+0000","last_active":"2024-09-11T23:18:50.586606+0000","last_peered":"2024-09-11T23:18:50.586606+0000","last_clean":"2024-09-11T23:18:50.586606+0000","last_became_active":"2024-09-11T23:18:49.018385+0000","last_became_peered":"2024-09-11T23:18:49.018385+0000","last_unstale":"2024-09-11T23:18:50.586606+0000","last_undegraded":"2024-09-11T23:18:50.586606+0000","last_fullsized":"2024-09-11T23:18:50.586606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:45.542576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586220+0000","last_change":"2024-09-11T23:18:49.019807+0000","last_active":"2024-09-11T23:18:50.586220+0000","last_peered":"2024-09-11T23:18:50.586220+0000","last_clean":"2024-09-11T23:18:50.586220+0000","last_became_active":"2024-09-11T23:18:49.019507+0000","last_became_peered":"2024-09-11T23:18:49.019507+0000","last_unstale":"2024-09-11T23:18:50.586220+0000","last_undegraded":"2024-09-11T23:18:50.586220+0000","last_fullsized":"2024-09-11T23:18:50.586220+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:46.582189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586044+0000","last_change":"2024-09-11T23:18:49.010390+0000","last_active":"2024-09-11T23:18:50.586044+0000","last_peered":"2024-09-11T23:18:50.586044+0000","last_clean":"2024-09-11T23:18:50.586044+0000","last_became_active":"2024-09-11T23:18:49.008190+0000","last_became_peered":"2024-09-11T23:18:49.008190+0000","last_unstale":"2024-09-11T23:18:50.586044+0000","last_undegraded":"2024-09-11T23:18:50.586044+0000","last_fullsized":"2024-09-11T23:18:50.586044+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:47.530225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.013000+0000","last_change":"2024-09-11T23:18:49.011361+0000","last_active":"2024-09-11T23:18:50.013000+0000","last_peered":"2024-09-11T23:18:50.013000+0000","last_clean":"2024-09-11T23:18:50.013000+0000","last_became_active":"2024-09-11T23:18:49.011101+0000","last_became_peered":"2024-09-11T23:18:49.011101+0000","last_unstale":"2024-09-11T23:18:50.013000+0000","last_undegraded":"2024-09-11T23:18:50.013000+0000","last_fullsized":"2024-09-11T23:18:50.013000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:59.469342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587799+0000","last_change":"2024-09-11T23:18:49.025064+0000","last_active":"2024-09-11T23:18:50.587799+0000","last_peered":"2024-09-11T23:18:50.587799+0000","last_clean":"2024-09-11T23:18:50.587799+0000","last_became_active":"2024-09-11T23:18:49.024637+0000","last_became_peered":"2024-09-11T23:18:49.024637+0000","last_unstale":"2024-09-11T23:18:50.587799+0000","last_undegraded":"2024-09-11T23:18:50.587799+0000","last_fullsized":"2024-09-11T23:18:50.587799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:31.695691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586285+0000","last_change":"2024-09-11T23:18:49.023722+0000","last_active":"2024-09-11T23:18:50.586285+0000","last_peered":"2024-09-11T23:18:50.586285+0000","last_clean":"2024-09-11T23:18:50.586285+0000","last_became_active":"2024-09-11T23:18:49.022908+0000","last_became_peered":"2024-09-11T23:18:49.022908+0000","last_unstale":"2024-09-11T23:18:50.586285+0000","last_undegraded":"2024-09-11T23:18:50.586285+0000","last_fullsized":"2024-09-11T23:18:50.586285+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:30.972000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011452+0000","last_change":"2024-09-11T23:18:49.008770+0000","last_active":"2024-09-11T23:18:50.011452+0000","last_peered":"2024-09-11T23:18:50.011452+0000","last_clean":"2024-09-11T23:18:50.011452+0000","last_became_active":"2024-09-11T23:18:49.008476+0000","last_became_peered":"2024-09-11T23:18:49.008476+0000","last_unstale":"2024-09-11T23:18:50.011452+0000","last_undegraded":"2024-09-11T23:18:50.011452+0000","last_fullsized":"2024-09-11T23:18:50.011452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.721415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586138+0000","last_change":"2024-09-11T23:18:49.028967+0000","last_active":"2024-09-11T23:18:50.586138+0000","last_peered":"2024-09-11T23:18:50.586138+0000","last_clean":"2024-09-11T23:18:50.586138+0000","last_became_active":"2024-09-11T23:18:49.028293+0000","last_became_peered":"2024-09-11T23:18:49.028293+0000","last_unstale":"2024-09-11T23:18:50.586138+0000","last_undegraded":"2024-09-11T23:18:50.586138+0000","last_fullsized":"2024-09-11T23:18:50.586138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:08.235979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586726+0000","last_change":"2024-09-11T23:18:49.005657+0000","last_active":"2024-09-11T23:18:50.586726+0000","last_peered":"2024-09-11T23:18:50.586726+0000","last_clean":"2024-09-11T23:18:50.586726+0000","last_became_active":"2024-09-11T23:18:49.005387+0000","last_became_peered":"2024-09-11T23:18:49.005387+0000","last_unstale":"2024-09-11T23:18:50.586726+0000","last_undegraded":"2024-09-11T23:18:50.586726+0000","last_fullsized":"2024-09-11T23:18:50.586726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:54.924531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012474+0000","last_change":"2024-09-11T23:18:49.010416+0000","last_active":"2024-09-11T23:18:50.012474+0000","last_peered":"2024-09-11T23:18:50.012474+0000","last_clean":"2024-09-11T23:18:50.012474+0000","last_became_active":"2024-09-11T23:18:49.010120+0000","last_became_peered":"2024-09-11T23:18:49.010120+0000","last_unstale":"2024-09-11T23:18:50.012474+0000","last_undegraded":"2024-09-11T23:18:50.012474+0000","last_fullsized":"2024-09-11T23:18:50.012474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:30.972000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586573+0000","last_change":"2024-09-11T23:18:49.008741+0000","last_active":"2024-09-11T23:18:50.586573+0000","last_peered":"2024-09-11T23:18:50.586573+0000","last_clean":"2024-09-11T23:18:50.586573+0000","last_became_active":"2024-09-11T23:18:49.008543+0000","last_became_peered":"2024-09-11T23:18:49.008543+0000","last_unstale":"2024-09-11T23:18:50.586573+0000","last_undegraded":"2024-09-11T23:18:50.586573+0000","last_fullsized":"2024-09-11T23:18:50.586573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:27:25.364486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586737+0000","last_change":"2024-09-11T23:18:49.017267+0000","last_active":"2024-09-11T23:18:50.586737+0000","last_peered":"2024-09-11T23:18:50.586737+0000","last_clean":"2024-09-11T23:18:50.586737+0000","last_became_active":"2024-09-11T23:18:49.016994+0000","last_became_peered":"2024-09-11T23:18:49.016994+0000","last_unstale":"2024-09-11T23:18:50.586737+0000","last_undegraded":"2024-09-11T23:18:50.586737+0000","last_fullsized":"2024-09-11T23:18:50.586737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:32.867647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.588162+0000","last_change":"2024-09-11T23:18:49.016833+0000","last_active":"2024-09-11T23:18:50.588162+0000","last_peered":"2024-09-11T23:18:50.588162+0000","last_clean":"2024-09-11T23:18:50.588162+0000","last_became_active":"2024-09-11T23:18:49.009287+0000","last_became_peered":"2024-09-11T23:18:49.009287+0000","last_unstale":"2024-09-11T23:18:50.588162+0000","last_undegraded":"2024-09-11T23:18:50.588162+0000","last_fullsized":"2024-09-11T23:18:50.588162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:55.162354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587912+0000","last_change":"2024-09-11T23:18:49.024077+0000","last_active":"2024-09-11T23:18:50.587912+0000","last_peered":"2024-09-11T23:18:50.587912+0000","last_clean":"2024-09-11T23:18:50.587912+0000","last_became_active":"2024-09-11T23:18:49.023804+0000","last_became_peered":"2024-09-11T23:18:49.023804+0000","last_unstale":"2024-09-11T23:18:50.587912+0000","last_undegraded":"2024-09-11T23:18:50.587912+0000","last_fullsized":"2024-09-11T23:18:50.587912+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:24.356397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586526+0000","last_change":"2024-09-11T23:18:49.024077+0000","last_active":"2024-09-11T23:18:50.586526+0000","last_peered":"2024-09-11T23:18:50.586526+0000","last_clean":"2024-09-11T23:18:50.586526+0000","last_became_active":"2024-09-11T23:18:49.023773+0000","last_became_peered":"2024-09-11T23:18:49.023773+0000","last_unstale":"2024-09-11T23:18:50.586526+0000","last_undegraded":"2024-09-11T23:18:50.586526+0000","last_fullsized":"2024-09-11T23:18:50.586526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:26.306962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011922+0000","last_change":"2024-09-11T23:18:49.013009+0000","last_active":"2024-09-11T23:18:50.011922+0000","last_peered":"2024-09-11T23:18:50.011922+0000","last_clean":"2024-09-11T23:18:50.011922+0000","last_became_active":"2024-09-11T23:18:49.012755+0000","last_became_peered":"2024-09-11T23:18:49.012755+0000","last_unstale":"2024-09-11T23:18:50.011922+0000","last_undegraded":"2024-09-11T23:18:50.011922+0000","last_fullsized":"2024-09-11T23:18:50.011922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:35.168942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012053+0000","last_change":"2024-09-11T23:18:49.009624+0000","last_active":"2024-09-11T23:18:50.012053+0000","last_peered":"2024-09-11T23:18:50.012053+0000","last_clean":"2024-09-11T23:18:50.012053+0000","last_became_active":"2024-09-11T23:18:49.009160+0000","last_became_peered":"2024-09-11T23:18:49.009160+0000","last_unstale":"2024-09-11T23:18:50.012053+0000","last_undegraded":"2024-09-11T23:18:50.012053+0000","last_fullsized":"2024-09-11T23:18:50.012053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:44.169273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.007606+0000","last_change":"2024-09-11T23:18:49.016619+0000","last_active":"2024-09-11T23:18:50.007606+0000","last_peered":"2024-09-11T23:18:50.007606+0000","last_clean":"2024-09-11T23:18:50.007606+0000","last_became_active":"2024-09-11T23:18:49.016367+0000","last_became_peered":"2024-09-11T23:18:49.016367+0000","last_unstale":"2024-09-11T23:18:50.007606+0000","last_undegraded":"2024-09-11T23:18:50.007606+0000","last_fullsized":"2024-09-11T23:18:50.007606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:20.040267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011169+0000","last_change":"2024-09-11T23:18:49.012178+0000","last_active":"2024-09-11T23:18:50.011169+0000","last_peered":"2024-09-11T23:18:50.011169+0000","last_clean":"2024-09-11T23:18:50.011169+0000","last_became_active":"2024-09-11T23:18:49.008877+0000","last_became_peered":"2024-09-11T23:18:49.008877+0000","last_unstale":"2024-09-11T23:18:50.011169+0000","last_undegraded":"2024-09-11T23:18:50.011169+0000","last_fullsized":"2024-09-11T23:18:50.011169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:02.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587582+0000","last_change":"2024-09-11T23:18:49.031721+0000","last_active":"2024-09-11T23:18:50.587582+0000","last_peered":"2024-09-11T23:18:50.587582+0000","last_clean":"2024-09-11T23:18:50.587582+0000","last_became_active":"2024-09-11T23:18:49.031264+0000","last_became_peered":"2024-09-11T23:18:49.031264+0000","last_unstale":"2024-09-11T23:18:50.587582+0000","last_undegraded":"2024-09-11T23:18:50.587582+0000","last_fullsized":"2024-09-11T23:18:50.587582+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:05.424937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.588238+0000","last_change":"2024-09-11T23:18:49.017955+0000","last_active":"2024-09-11T23:18:50.588238+0000","last_peered":"2024-09-11T23:18:50.588238+0000","last_clean":"2024-09-11T23:18:50.588238+0000","last_became_active":"2024-09-11T23:18:49.008731+0000","last_became_peered":"2024-09-11T23:18:49.008731+0000","last_unstale":"2024-09-11T23:18:50.588238+0000","last_undegraded":"2024-09-11T23:18:50.588238+0000","last_fullsized":"2024-09-11T23:18:50.588238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:38.477516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587631+0000","last_change":"2024-09-11T23:18:49.023143+0000","last_active":"2024-09-11T23:18:50.587631+0000","last_peered":"2024-09-11T23:18:50.587631+0000","last_clean":"2024-09-11T23:18:50.587631+0000","last_became_active":"2024-09-11T23:18:49.022916+0000","last_became_peered":"2024-09-11T23:18:49.022916+0000","last_unstale":"2024-09-11T23:18:50.587631+0000","last_undegraded":"2024-09-11T23:18:50.587631+0000","last_fullsized":"2024-09-11T23:18:50.587631+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:18.200252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012197+0000","last_change":"2024-09-11T23:18:49.015459+0000","last_active":"2024-09-11T23:18:50.012197+0000","last_peered":"2024-09-11T23:18:50.012197+0000","last_clean":"2024-09-11T23:18:50.012197+0000","last_became_active":"2024-09-11T23:18:49.014648+0000","last_became_peered":"2024-09-11T23:18:49.014648+0000","last_unstale":"2024-09-11T23:18:50.012197+0000","last_undegraded":"2024-09-11T23:18:50.012197+0000","last_fullsized":"2024-09-11T23:18:50.012197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:49.663140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012050+0000","last_change":"2024-09-11T23:18:49.009617+0000","last_active":"2024-09-11T23:18:50.012050+0000","last_peered":"2024-09-11T23:18:50.012050+0000","last_clean":"2024-09-11T23:18:50.012050+0000","last_became_active":"2024-09-11T23:18:49.007209+0000","last_became_peered":"2024-09-11T23:18:49.007209+0000","last_unstale":"2024-09-11T23:18:50.012050+0000","last_undegraded":"2024-09-11T23:18:50.012050+0000","last_fullsized":"2024-09-11T23:18:50.012050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:20.040267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586317+0000","last_change":"2024-09-11T23:18:49.012641+0000","last_active":"2024-09-11T23:18:50.586317+0000","last_peered":"2024-09-11T23:18:50.586317+0000","last_clean":"2024-09-11T23:18:50.586317+0000","last_became_active":"2024-09-11T23:18:49.012332+0000","last_became_peered":"2024-09-11T23:18:49.012332+0000","last_unstale":"2024-09-11T23:18:50.586317+0000","last_undegraded":"2024-09-11T23:18:50.586317+0000","last_fullsized":"2024-09-11T23:18:50.586317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:17.826020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.086191+0000","last_change":"2024-09-11T23:18:49.013323+0000","last_active":"2024-09-11T23:18:50.086191+0000","last_peered":"2024-09-11T23:18:50.086191+0000","last_clean":"2024-09-11T23:18:50.086191+0000","last_became_active":"2024-09-11T23:18:49.012492+0000","last_became_peered":"2024-09-11T23:18:49.012492+0000","last_unstale":"2024-09-11T23:18:50.086191+0000","last_undegraded":"2024-09-11T23:18:50.086191+0000","last_fullsized":"2024-09-11T23:18:50.086191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:05.371678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586030+0000","last_change":"2024-09-11T23:18:49.014929+0000","last_active":"2024-09-11T23:18:50.586030+0000","last_peered":"2024-09-11T23:18:50.586030+0000","last_clean":"2024-09-11T23:18:50.586030+0000","last_became_active":"2024-09-11T23:18:49.014660+0000","last_became_peered":"2024-09-11T23:18:49.014660+0000","last_unstale":"2024-09-11T23:18:50.586030+0000","last_undegraded":"2024-09-11T23:18:50.586030+0000","last_fullsized":"2024-09-11T23:18:50.586030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:18.145725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.007989+0000","last_change":"2024-09-11T23:18:49.019336+0000","last_active":"2024-09-11T23:18:50.007989+0000","last_peered":"2024-09-11T23:18:50.007989+0000","last_clean":"2024-09-11T23:18:50.007989+0000","last_became_active":"2024-09-11T23:18:49.019078+0000","last_became_peered":"2024-09-11T23:18:49.019078+0000","last_unstale":"2024-09-11T23:18:50.007989+0000","last_undegraded":"2024-09-11T23:18:50.007989+0000","last_fullsized":"2024-09-11T23:18:50.007989+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:59.469342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.086187+0000","last_change":"2024-09-11T23:18:48.007751+0000","last_active":"2024-09-11T23:18:50.086187+0000","last_peered":"2024-09-11T23:18:50.086187+0000","last_clean":"2024-09-11T23:18:50.086187+0000","last_became_active":"2024-09-11T23:18:48.007453+0000","last_became_peered":"2024-09-11T23:18:48.007453+0000","last_unstale":"2024-09-11T23:18:50.086187+0000","last_undegraded":"2024-09-11T23:18:50.086187+0000","last_fullsized":"2024-09-11T23:18:50.086187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:18.222705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.086182+0000","last_change":"2024-09-11T23:18:49.023248+0000","last_active":"2024-09-11T23:18:50.086182+0000","last_peered":"2024-09-11T23:18:50.086182+0000","last_clean":"2024-09-11T23:18:50.086182+0000","last_became_active":"2024-09-11T23:18:49.018856+0000","last_became_peered":"2024-09-11T23:18:49.018856+0000","last_unstale":"2024-09-11T23:18:50.086182+0000","last_undegraded":"2024-09-11T23:18:50.086182+0000","last_fullsized":"2024-09-11T23:18:50.086182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:20.040267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.008001+0000","last_change":"2024-09-11T23:18:48.015111+0000","last_active":"2024-09-11T23:18:50.008001+0000","last_peered":"2024-09-11T23:18:50.008001+0000","last_clean":"2024-09-11T23:18:50.008001+0000","last_became_active":"2024-09-11T23:18:48.014804+0000","last_became_peered":"2024-09-11T23:18:48.014804+0000","last_unstale":"2024-09-11T23:18:50.008001+0000","last_undegraded":"2024-09-11T23:18:50.008001+0000","last_fullsized":"2024-09-11T23:18:50.008001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:43.882021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012303+0000","last_change":"2024-09-11T23:18:49.008030+0000","last_active":"2024-09-11T23:18:50.012303+0000","last_peered":"2024-09-11T23:18:50.012303+0000","last_clean":"2024-09-11T23:18:50.012303+0000","last_became_active":"2024-09-11T23:18:49.007228+0000","last_became_peered":"2024-09-11T23:18:49.007228+0000","last_unstale":"2024-09-11T23:18:50.012303+0000","last_undegraded":"2024-09-11T23:18:50.012303+0000","last_fullsized":"2024-09-11T23:18:50.012303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:05.371678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587895+0000","last_change":"2024-09-11T23:18:48.010963+0000","last_active":"2024-09-11T23:18:50.587895+0000","last_peered":"2024-09-11T23:18:50.587895+0000","last_clean":"2024-09-11T23:18:50.587895+0000","last_became_active":"2024-09-11T23:18:48.010705+0000","last_became_peered":"2024-09-11T23:18:48.010705+0000","last_unstale":"2024-09-11T23:18:50.587895+0000","last_undegraded":"2024-09-11T23:18:50.587895+0000","last_fullsized":"2024-09-11T23:18:50.587895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:49.742344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587659+0000","last_change":"2024-09-11T23:18:49.023043+0000","last_active":"2024-09-11T23:18:50.587659+0000","last_peered":"2024-09-11T23:18:50.587659+0000","last_clean":"2024-09-11T23:18:50.587659+0000","last_became_active":"2024-09-11T23:18:49.022537+0000","last_became_peered":"2024-09-11T23:18:49.022537+0000","last_unstale":"2024-09-11T23:18:50.587659+0000","last_undegraded":"2024-09-11T23:18:50.587659+0000","last_fullsized":"2024-09-11T23:18:50.587659+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:02.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586466+0000","last_change":"2024-09-11T23:18:48.012267+0000","last_active":"2024-09-11T23:18:50.586466+0000","last_peered":"2024-09-11T23:18:50.586466+0000","last_clean":"2024-09-11T23:18:50.586466+0000","last_became_active":"2024-09-11T23:18:48.011880+0000","last_became_peered":"2024-09-11T23:18:48.011880+0000","last_unstale":"2024-09-11T23:18:50.586466+0000","last_undegraded":"2024-09-11T23:18:50.586466+0000","last_fullsized":"2024-09-11T23:18:50.586466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:20.606934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586349+0000","last_change":"2024-09-11T23:18:49.017731+0000","last_active":"2024-09-11T23:18:50.586349+0000","last_peered":"2024-09-11T23:18:50.586349+0000","last_clean":"2024-09-11T23:18:50.586349+0000","last_became_active":"2024-09-11T23:18:49.017469+0000","last_became_peered":"2024-09-11T23:18:49.017469+0000","last_unstale":"2024-09-11T23:18:50.586349+0000","last_undegraded":"2024-09-11T23:18:50.586349+0000","last_fullsized":"2024-09-11T23:18:50.586349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:06.401378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012044+0000","last_change":"2024-09-11T23:18:48.011580+0000","last_active":"2024-09-11T23:18:50.012044+0000","last_peered":"2024-09-11T23:18:50.012044+0000","last_clean":"2024-09-11T23:18:50.012044+0000","last_became_active":"2024-09-11T23:18:48.011045+0000","last_became_peered":"2024-09-11T23:18:48.011045+0000","last_unstale":"2024-09-11T23:18:50.012044+0000","last_undegraded":"2024-09-11T23:18:50.012044+0000","last_fullsized":"2024-09-11T23:18:50.012044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:18.496309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011199+0000","last_change":"2024-09-11T23:18:49.015000+0000","last_active":"2024-09-11T23:18:50.011199+0000","last_peered":"2024-09-11T23:18:50.011199+0000","last_clean":"2024-09-11T23:18:50.011199+0000","last_became_active":"2024-09-11T23:18:49.014091+0000","last_became_peered":"2024-09-11T23:18:49.014091+0000","last_unstale":"2024-09-11T23:18:50.011199+0000","last_undegraded":"2024-09-11T23:18:50.011199+0000","last_fullsized":"2024-09-11T23:18:50.011199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:31.695691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012184+0000","last_change":"2024-09-11T23:18:48.009914+0000","last_active":"2024-09-11T23:18:50.012184+0000","last_peered":"2024-09-11T23:18:50.012184+0000","last_clean":"2024-09-11T23:18:50.012184+0000","last_became_active":"2024-09-11T23:18:48.007555+0000","last_became_peered":"2024-09-11T23:18:48.007555+0000","last_unstale":"2024-09-11T23:18:50.012184+0000","last_undegraded":"2024-09-11T23:18:50.012184+0000","last_fullsized":"2024-09-11T23:18:50.012184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:11.259384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011290+0000","last_change":"2024-09-11T23:18:49.006529+0000","last_active":"2024-09-11T23:18:50.011290+0000","last_peered":"2024-09-11T23:18:50.011290+0000","last_clean":"2024-09-11T23:18:50.011290+0000","last_became_active":"2024-09-11T23:18:49.006239+0000","last_became_peered":"2024-09-11T23:18:49.006239+0000","last_unstale":"2024-09-11T23:18:50.011290+0000","last_undegraded":"2024-09-11T23:18:50.011290+0000","last_fullsized":"2024-09-11T23:18:50.011290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:52.437981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586305+0000","last_change":"2024-09-11T23:18:48.005888+0000","last_active":"2024-09-11T23:18:50.586305+0000","last_peered":"2024-09-11T23:18:50.586305+0000","last_clean":"2024-09-11T23:18:50.586305+0000","last_became_active":"2024-09-11T23:18:48.005594+0000","last_became_peered":"2024-09-11T23:18:48.005594+0000","last_unstale":"2024-09-11T23:18:50.586305+0000","last_undegraded":"2024-09-11T23:18:50.586305+0000","last_fullsized":"2024-09-11T23:18:50.586305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:20.376536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587189+0000","last_change":"2024-09-11T23:18:49.022786+0000","last_active":"2024-09-11T23:18:50.587189+0000","last_peered":"2024-09-11T23:18:50.587189+0000","last_clean":"2024-09-11T23:18:50.587189+0000","last_became_active":"2024-09-11T23:18:49.022512+0000","last_became_peered":"2024-09-11T23:18:49.022512+0000","last_unstale":"2024-09-11T23:18:50.587189+0000","last_undegraded":"2024-09-11T23:18:50.587189+0000","last_fullsized":"2024-09-11T23:18:50.587189+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:59.469342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011412+0000","last_change":"2024-09-11T23:18:48.001028+0000","last_active":"2024-09-11T23:18:50.011412+0000","last_peered":"2024-09-11T23:18:50.011412+0000","last_clean":"2024-09-11T23:18:50.011412+0000","last_became_active":"2024-09-11T23:18:48.000366+0000","last_became_peered":"2024-09-11T23:18:48.000366+0000","last_unstale":"2024-09-11T23:18:50.011412+0000","last_undegraded":"2024-09-11T23:18:50.011412+0000","last_fullsized":"2024-09-11T23:18:50.011412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:21.206250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011482+0000","last_change":"2024-09-11T23:18:49.010058+0000","last_active":"2024-09-11T23:18:50.011482+0000","last_peered":"2024-09-11T23:18:50.011482+0000","last_clean":"2024-09-11T23:18:50.011482+0000","last_became_active":"2024-09-11T23:18:49.007625+0000","last_became_peered":"2024-09-11T23:18:49.007625+0000","last_unstale":"2024-09-11T23:18:50.011482+0000","last_undegraded":"2024-09-11T23:18:50.011482+0000","last_fullsized":"2024-09-11T23:18:50.011482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:44:36.393454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587725+0000","last_change":"2024-09-11T23:18:48.017295+0000","last_active":"2024-09-11T23:18:50.587725+0000","last_peered":"2024-09-11T23:18:50.587725+0000","last_clean":"2024-09-11T23:18:50.587725+0000","last_became_active":"2024-09-11T23:18:48.016882+0000","last_became_peered":"2024-09-11T23:18:48.016882+0000","last_unstale":"2024-09-11T23:18:50.587725+0000","last_undegraded":"2024-09-11T23:18:50.587725+0000","last_fullsized":"2024-09-11T23:18:50.587725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:27.807403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587637+0000","last_change":"2024-09-11T23:18:49.024058+0000","last_active":"2024-09-11T23:18:50.587637+0000","last_peered":"2024-09-11T23:18:50.587637+0000","last_clean":"2024-09-11T23:18:50.587637+0000","last_became_active":"2024-09-11T23:18:49.023763+0000","last_became_peered":"2024-09-11T23:18:49.023763+0000","last_unstale":"2024-09-11T23:18:50.587637+0000","last_undegraded":"2024-09-11T23:18:50.587637+0000","last_fullsized":"2024-09-11T23:18:50.587637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:15.178674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.008068+0000","last_change":"2024-09-11T23:18:48.011655+0000","last_active":"2024-09-11T23:18:50.008068+0000","last_peered":"2024-09-11T23:18:50.008068+0000","last_clean":"2024-09-11T23:18:50.008068+0000","last_became_active":"2024-09-11T23:18:48.008273+0000","last_became_peered":"2024-09-11T23:18:48.008273+0000","last_unstale":"2024-09-11T23:18:50.008068+0000","last_undegraded":"2024-09-11T23:18:50.008068+0000","last_fullsized":"2024-09-11T23:18:50.008068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:51.349730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587574+0000","last_change":"2024-09-11T23:18:49.015893+0000","last_active":"2024-09-11T23:18:50.587574+0000","last_peered":"2024-09-11T23:18:50.587574+0000","last_clean":"2024-09-11T23:18:50.587574+0000","last_became_active":"2024-09-11T23:18:49.008793+0000","last_became_peered":"2024-09-11T23:18:49.008793+0000","last_unstale":"2024-09-11T23:18:50.587574+0000","last_undegraded":"2024-09-11T23:18:50.587574+0000","last_fullsized":"2024-09-11T23:18:50.587574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:01.289535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011904+0000","last_change":"2024-09-11T23:18:48.011616+0000","last_active":"2024-09-11T23:18:50.011904+0000","last_peered":"2024-09-11T23:18:50.011904+0000","last_clean":"2024-09-11T23:18:50.011904+0000","last_became_active":"2024-09-11T23:18:48.011108+0000","last_became_peered":"2024-09-11T23:18:48.011108+0000","last_unstale":"2024-09-11T23:18:50.011904+0000","last_undegraded":"2024-09-11T23:18:50.011904+0000","last_fullsized":"2024-09-11T23:18:50.011904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:34.165980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011637+0000","last_change":"2024-09-11T23:18:49.024580+0000","last_active":"2024-09-11T23:18:50.011637+0000","last_peered":"2024-09-11T23:18:50.011637+0000","last_clean":"2024-09-11T23:18:50.011637+0000","last_became_active":"2024-09-11T23:18:49.024279+0000","last_became_peered":"2024-09-11T23:18:49.024279+0000","last_unstale":"2024-09-11T23:18:50.011637+0000","last_undegraded":"2024-09-11T23:18:50.011637+0000","last_fullsized":"2024-09-11T23:18:50.011637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:22.301700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587334+0000","last_change":"2024-09-11T23:18:48.016996+0000","last_active":"2024-09-11T23:18:50.587334+0000","last_peered":"2024-09-11T23:18:50.587334+0000","last_clean":"2024-09-11T23:18:50.587334+0000","last_became_active":"2024-09-11T23:18:48.016503+0000","last_became_peered":"2024-09-11T23:18:48.016503+0000","last_unstale":"2024-09-11T23:18:50.587334+0000","last_undegraded":"2024-09-11T23:18:50.587334+0000","last_fullsized":"2024-09-11T23:18:50.587334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:33.072147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587300+0000","last_change":"2024-09-11T23:18:49.012373+0000","last_active":"2024-09-11T23:18:50.587300+0000","last_peered":"2024-09-11T23:18:50.587300+0000","last_clean":"2024-09-11T23:18:50.587300+0000","last_became_active":"2024-09-11T23:18:49.011979+0000","last_became_peered":"2024-09-11T23:18:49.011979+0000","last_unstale":"2024-09-11T23:18:50.587300+0000","last_undegraded":"2024-09-11T23:18:50.587300+0000","last_fullsized":"2024-09-11T23:18:50.587300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:49.321225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012156+0000","last_change":"2024-09-11T23:18:48.002333+0000","last_active":"2024-09-11T23:18:50.012156+0000","last_peered":"2024-09-11T23:18:50.012156+0000","last_clean":"2024-09-11T23:18:50.012156+0000","last_became_active":"2024-09-11T23:18:48.001101+0000","last_became_peered":"2024-09-11T23:18:48.001101+0000","last_unstale":"2024-09-11T23:18:50.012156+0000","last_undegraded":"2024-09-11T23:18:50.012156+0000","last_fullsized":"2024-09-11T23:18:50.012156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:30.420649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586953+0000","last_change":"2024-09-11T23:18:49.019321+0000","last_active":"2024-09-11T23:18:50.586953+0000","last_peered":"2024-09-11T23:18:50.586953+0000","last_clean":"2024-09-11T23:18:50.586953+0000","last_became_active":"2024-09-11T23:18:49.015579+0000","last_became_peered":"2024-09-11T23:18:49.015579+0000","last_unstale":"2024-09-11T23:18:50.586953+0000","last_undegraded":"2024-09-11T23:18:50.586953+0000","last_fullsized":"2024-09-11T23:18:50.586953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:06.688839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587675+0000","last_change":"2024-09-11T23:18:48.010282+0000","last_active":"2024-09-11T23:18:50.587675+0000","last_peered":"2024-09-11T23:18:50.587675+0000","last_clean":"2024-09-11T23:18:50.587675+0000","last_became_active":"2024-09-11T23:18:48.007053+0000","last_became_peered":"2024-09-11T23:18:48.007053+0000","last_unstale":"2024-09-11T23:18:50.587675+0000","last_undegraded":"2024-09-11T23:18:50.587675+0000","last_fullsized":"2024-09-11T23:18:50.587675+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:18.309385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586273+0000","last_change":"2024-09-11T23:18:49.019508+0000","last_active":"2024-09-11T23:18:50.586273+0000","last_peered":"2024-09-11T23:18:50.586273+0000","last_clean":"2024-09-11T23:18:50.586273+0000","last_became_active":"2024-09-11T23:18:49.019067+0000","last_became_peered":"2024-09-11T23:18:49.019067+0000","last_unstale":"2024-09-11T23:18:50.586273+0000","last_undegraded":"2024-09-11T23:18:50.586273+0000","last_fullsized":"2024-09-11T23:18:50.586273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:14.729166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586329+0000","last_change":"2024-09-11T23:18:48.014618+0000","last_active":"2024-09-11T23:18:50.586329+0000","last_peered":"2024-09-11T23:18:50.586329+0000","last_clean":"2024-09-11T23:18:50.586329+0000","last_became_active":"2024-09-11T23:18:48.014376+0000","last_became_peered":"2024-09-11T23:18:48.014376+0000","last_unstale":"2024-09-11T23:18:50.586329+0000","last_undegraded":"2024-09-11T23:18:50.586329+0000","last_fullsized":"2024-09-11T23:18:50.586329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:00.540786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.086042+0000","last_change":"2024-09-11T23:18:49.017642+0000","last_active":"2024-09-11T23:18:50.086042+0000","last_peered":"2024-09-11T23:18:50.086042+0000","last_clean":"2024-09-11T23:18:50.086042+0000","last_became_active":"2024-09-11T23:18:49.017344+0000","last_became_peered":"2024-09-11T23:18:49.017344+0000","last_unstale":"2024-09-11T23:18:50.086042+0000","last_undegraded":"2024-09-11T23:18:50.086042+0000","last_fullsized":"2024-09-11T23:18:50.086042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:08.846324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586028+0000","last_change":"2024-09-11T23:18:48.016597+0000","last_active":"2024-09-11T23:18:50.586028+0000","last_peered":"2024-09-11T23:18:50.586028+0000","last_clean":"2024-09-11T23:18:50.586028+0000","last_became_active":"2024-09-11T23:18:48.016314+0000","last_became_peered":"2024-09-11T23:18:48.016314+0000","last_unstale":"2024-09-11T23:18:50.586028+0000","last_undegraded":"2024-09-11T23:18:50.586028+0000","last_fullsized":"2024-09-11T23:18:50.586028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:54.884414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012770+0000","last_change":"2024-09-11T23:18:49.015641+0000","last_active":"2024-09-11T23:18:50.012770+0000","last_peered":"2024-09-11T23:18:50.012770+0000","last_clean":"2024-09-11T23:18:50.012770+0000","last_became_active":"2024-09-11T23:18:49.014210+0000","last_became_peered":"2024-09-11T23:18:49.014210+0000","last_unstale":"2024-09-11T23:18:50.012770+0000","last_undegraded":"2024-09-11T23:18:50.012770+0000","last_fullsized":"2024-09-11T23:18:50.012770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:00.772427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587934+0000","last_change":"2024-09-11T23:18:48.013143+0000","last_active":"2024-09-11T23:18:50.587934+0000","last_peered":"2024-09-11T23:18:50.587934+0000","last_clean":"2024-09-11T23:18:50.587934+0000","last_became_active":"2024-09-11T23:18:48.012875+0000","last_became_peered":"2024-09-11T23:18:48.012875+0000","last_unstale":"2024-09-11T23:18:50.587934+0000","last_undegraded":"2024-09-11T23:18:50.587934+0000","last_fullsized":"2024-09-11T23:18:50.587934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:43.166311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011688+0000","last_change":"2024-09-11T23:18:49.006253+0000","last_active":"2024-09-11T23:18:50.011688+0000","last_peered":"2024-09-11T23:18:50.011688+0000","last_clean":"2024-09-11T23:18:50.011688+0000","last_became_active":"2024-09-11T23:18:49.004054+0000","last_became_peered":"2024-09-11T23:18:49.004054+0000","last_unstale":"2024-09-11T23:18:50.011688+0000","last_undegraded":"2024-09-11T23:18:50.011688+0000","last_fullsized":"2024-09-11T23:18:50.011688+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:18.145725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012844+0000","last_change":"2024-09-11T23:18:48.001857+0000","last_active":"2024-09-11T23:18:50.012844+0000","last_peered":"2024-09-11T23:18:50.012844+0000","last_clean":"2024-09-11T23:18:50.012844+0000","last_became_active":"2024-09-11T23:18:48.001543+0000","last_became_peered":"2024-09-11T23:18:48.001543+0000","last_unstale":"2024-09-11T23:18:50.012844+0000","last_undegraded":"2024-09-11T23:18:50.012844+0000","last_fullsized":"2024-09-11T23:18:50.012844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:14.102475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587616+0000","last_change":"2024-09-11T23:18:49.024287+0000","last_active":"2024-09-11T23:18:50.587616+0000","last_peered":"2024-09-11T23:18:50.587616+0000","last_clean":"2024-09-11T23:18:50.587616+0000","last_became_active":"2024-09-11T23:18:49.022965+0000","last_became_peered":"2024-09-11T23:18:49.022965+0000","last_unstale":"2024-09-11T23:18:50.587616+0000","last_undegraded":"2024-09-11T23:18:50.587616+0000","last_fullsized":"2024-09-11T23:18:50.587616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:19:04.572090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012525+0000","last_change":"2024-09-11T23:18:48.004742+0000","last_active":"2024-09-11T23:18:50.012525+0000","last_peered":"2024-09-11T23:18:50.012525+0000","last_clean":"2024-09-11T23:18:50.012525+0000","last_became_active":"2024-09-11T23:18:48.004317+0000","last_became_peered":"2024-09-11T23:18:48.004317+0000","last_unstale":"2024-09-11T23:18:50.012525+0000","last_undegraded":"2024-09-11T23:18:50.012525+0000","last_fullsized":"2024-09-11T23:18:50.012525+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:14.500017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586351+0000","last_change":"2024-09-11T23:18:49.014969+0000","last_active":"2024-09-11T23:18:50.586351+0000","last_peered":"2024-09-11T23:18:50.586351+0000","last_clean":"2024-09-11T23:18:50.586351+0000","last_became_active":"2024-09-11T23:18:49.014665+0000","last_became_peered":"2024-09-11T23:18:49.014665+0000","last_unstale":"2024-09-11T23:18:50.586351+0000","last_undegraded":"2024-09-11T23:18:50.586351+0000","last_fullsized":"2024-09-11T23:18:50.586351+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:07:27.965516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012482+0000","last_change":"2024-09-11T23:18:48.004710+0000","last_active":"2024-09-11T23:18:50.012482+0000","last_peered":"2024-09-11T23:18:50.012482+0000","last_clean":"2024-09-11T23:18:50.012482+0000","last_became_active":"2024-09-11T23:18:48.004396+0000","last_became_peered":"2024-09-11T23:18:48.004396+0000","last_unstale":"2024-09-11T23:18:50.012482+0000","last_undegraded":"2024-09-11T23:18:50.012482+0000","last_fullsized":"2024-09-11T23:18:50.012482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:58.115645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586139+0000","last_change":"2024-09-11T23:18:49.013677+0000","last_active":"2024-09-11T23:18:50.586139+0000","last_peered":"2024-09-11T23:18:50.586139+0000","last_clean":"2024-09-11T23:18:50.586139+0000","last_became_active":"2024-09-11T23:18:49.013135+0000","last_became_peered":"2024-09-11T23:18:49.013135+0000","last_unstale":"2024-09-11T23:18:50.586139+0000","last_undegraded":"2024-09-11T23:18:50.586139+0000","last_fullsized":"2024-09-11T23:18:50.586139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:05.649394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.007761+0000","last_change":"2024-09-11T23:18:48.009114+0000","last_active":"2024-09-11T23:18:50.007761+0000","last_peered":"2024-09-11T23:18:50.007761+0000","last_clean":"2024-09-11T23:18:50.007761+0000","last_became_active":"2024-09-11T23:18:48.008595+0000","last_became_peered":"2024-09-11T23:18:48.008595+0000","last_unstale":"2024-09-11T23:18:50.007761+0000","last_undegraded":"2024-09-11T23:18:50.007761+0000","last_fullsized":"2024-09-11T23:18:50.007761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:41.932196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586528+0000","last_change":"2024-09-11T23:18:49.012606+0000","last_active":"2024-09-11T23:18:50.586528+0000","last_peered":"2024-09-11T23:18:50.586528+0000","last_clean":"2024-09-11T23:18:50.586528+0000","last_became_active":"2024-09-11T23:18:49.012315+0000","last_became_peered":"2024-09-11T23:18:49.012315+0000","last_unstale":"2024-09-11T23:18:50.586528+0000","last_undegraded":"2024-09-11T23:18:50.586528+0000","last_fullsized":"2024-09-11T23:18:50.586528+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:02.102975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.086035+0000","last_change":"2024-09-11T23:18:48.014456+0000","last_active":"2024-09-11T23:18:50.086035+0000","last_peered":"2024-09-11T23:18:50.086035+0000","last_clean":"2024-09-11T23:18:50.086035+0000","last_became_active":"2024-09-11T23:18:48.014078+0000","last_became_peered":"2024-09-11T23:18:48.014078+0000","last_unstale":"2024-09-11T23:18:50.086035+0000","last_undegraded":"2024-09-11T23:18:50.086035+0000","last_fullsized":"2024-09-11T23:18:50.086035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:18.309385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.585986+0000","last_change":"2024-09-11T23:18:49.008898+0000","last_active":"2024-09-11T23:18:50.585986+0000","last_peered":"2024-09-11T23:18:50.585986+0000","last_clean":"2024-09-11T23:18:50.585986+0000","last_became_active":"2024-09-11T23:18:49.008538+0000","last_became_peered":"2024-09-11T23:18:49.008538+0000","last_unstale":"2024-09-11T23:18:50.585986+0000","last_undegraded":"2024-09-11T23:18:50.585986+0000","last_fullsized":"2024-09-11T23:18:50.585986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:00.280869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011799+0000","last_change":"2024-09-11T23:18:48.003928+0000","last_active":"2024-09-11T23:18:50.011799+0000","last_peered":"2024-09-11T23:18:50.011799+0000","last_clean":"2024-09-11T23:18:50.011799+0000","last_became_active":"2024-09-11T23:18:48.003048+0000","last_became_peered":"2024-09-11T23:18:48.003048+0000","last_unstale":"2024-09-11T23:18:50.011799+0000","last_undegraded":"2024-09-11T23:18:50.011799+0000","last_fullsized":"2024-09-11T23:18:50.011799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:37.584863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586216+0000","last_change":"2024-09-11T23:18:49.013365+0000","last_active":"2024-09-11T23:18:50.586216+0000","last_peered":"2024-09-11T23:18:50.586216+0000","last_clean":"2024-09-11T23:18:50.586216+0000","last_became_active":"2024-09-11T23:18:49.013014+0000","last_became_peered":"2024-09-11T23:18:49.013014+0000","last_unstale":"2024-09-11T23:18:50.586216+0000","last_undegraded":"2024-09-11T23:18:50.586216+0000","last_fullsized":"2024-09-11T23:18:50.586216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:49.663140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011282+0000","last_change":"2024-09-11T23:18:48.013115+0000","last_active":"2024-09-11T23:18:50.011282+0000","last_peered":"2024-09-11T23:18:50.011282+0000","last_clean":"2024-09-11T23:18:50.011282+0000","last_became_active":"2024-09-11T23:18:48.012783+0000","last_became_peered":"2024-09-11T23:18:48.012783+0000","last_unstale":"2024-09-11T23:18:50.011282+0000","last_undegraded":"2024-09-11T23:18:50.011282+0000","last_fullsized":"2024-09-11T23:18:50.011282+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:07.843362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586275+0000","last_change":"2024-09-11T23:18:49.013885+0000","last_active":"2024-09-11T23:18:50.586275+0000","last_peered":"2024-09-11T23:18:50.586275+0000","last_clean":"2024-09-11T23:18:50.586275+0000","last_became_active":"2024-09-11T23:18:49.013611+0000","last_became_peered":"2024-09-11T23:18:49.013611+0000","last_unstale":"2024-09-11T23:18:50.586275+0000","last_undegraded":"2024-09-11T23:18:50.586275+0000","last_fullsized":"2024-09-11T23:18:50.586275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:09.280069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587982+0000","last_change":"2024-09-11T23:18:48.009617+0000","last_active":"2024-09-11T23:18:50.587982+0000","last_peered":"2024-09-11T23:18:50.587982+0000","last_clean":"2024-09-11T23:18:50.587982+0000","last_became_active":"2024-09-11T23:18:48.009195+0000","last_became_peered":"2024-09-11T23:18:48.009195+0000","last_unstale":"2024-09-11T23:18:50.587982+0000","last_undegraded":"2024-09-11T23:18:50.587982+0000","last_fullsized":"2024-09-11T23:18:50.587982+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:19.037305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011847+0000","last_change":"2024-09-11T23:18:49.012656+0000","last_active":"2024-09-11T23:18:50.011847+0000","last_peered":"2024-09-11T23:18:50.011847+0000","last_clean":"2024-09-11T23:18:50.011847+0000","last_became_active":"2024-09-11T23:18:49.012305+0000","last_became_peered":"2024-09-11T23:18:49.012305+0000","last_unstale":"2024-09-11T23:18:50.011847+0000","last_undegraded":"2024-09-11T23:18:50.011847+0000","last_fullsized":"2024-09-11T23:18:50.011847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:46.582189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.008131+0000","last_change":"2024-09-11T23:18:48.005217+0000","last_active":"2024-09-11T23:18:50.008131+0000","last_peered":"2024-09-11T23:18:50.008131+0000","last_clean":"2024-09-11T23:18:50.008131+0000","last_became_active":"2024-09-11T23:18:48.004931+0000","last_became_peered":"2024-09-11T23:18:48.004931+0000","last_unstale":"2024-09-11T23:18:50.008131+0000","last_undegraded":"2024-09-11T23:18:50.008131+0000","last_fullsized":"2024-09-11T23:18:50.008131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:13.445123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.007893+0000","last_change":"2024-09-11T23:18:49.027344+0000","last_active":"2024-09-11T23:18:50.007893+0000","last_peered":"2024-09-11T23:18:50.007893+0000","last_clean":"2024-09-11T23:18:50.007893+0000","last_became_active":"2024-09-11T23:18:49.027022+0000","last_became_peered":"2024-09-11T23:18:49.027022+0000","last_unstale":"2024-09-11T23:18:50.007893+0000","last_undegraded":"2024-09-11T23:18:50.007893+0000","last_fullsized":"2024-09-11T23:18:50.007893+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:00.772427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587398+0000","last_change":"2024-09-11T23:18:48.011606+0000","last_active":"2024-09-11T23:18:50.587398+0000","last_peered":"2024-09-11T23:18:50.587398+0000","last_clean":"2024-09-11T23:18:50.587398+0000","last_became_active":"2024-09-11T23:18:48.011355+0000","last_became_peered":"2024-09-11T23:18:48.011355+0000","last_unstale":"2024-09-11T23:18:50.587398+0000","last_undegraded":"2024-09-11T23:18:50.587398+0000","last_fullsized":"2024-09-11T23:18:50.587398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:51.349730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.086080+0000","last_change":"2024-09-11T23:18:49.014470+0000","last_active":"2024-09-11T23:18:50.086080+0000","last_peered":"2024-09-11T23:18:50.086080+0000","last_clean":"2024-09-11T23:18:50.086080+0000","last_became_active":"2024-09-11T23:18:49.013737+0000","last_became_peered":"2024-09-11T23:18:49.013737+0000","last_unstale":"2024-09-11T23:18:50.086080+0000","last_undegraded":"2024-09-11T23:18:50.086080+0000","last_fullsized":"2024-09-11T23:18:50.086080+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:44.169273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.007961+0000","last_change":"2024-09-11T23:18:48.006018+0000","last_active":"2024-09-11T23:18:50.007961+0000","last_peered":"2024-09-11T23:18:50.007961+0000","last_clean":"2024-09-11T23:18:50.007961+0000","last_became_active":"2024-09-11T23:18:48.005721+0000","last_became_peered":"2024-09-11T23:18:48.005721+0000","last_unstale":"2024-09-11T23:18:50.007961+0000","last_undegraded":"2024-09-11T23:18:50.007961+0000","last_fullsized":"2024-09-11T23:18:50.007961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:00.748473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.007872+0000","last_change":"2024-09-11T23:18:49.010494+0000","last_active":"2024-09-11T23:18:50.007872+0000","last_peered":"2024-09-11T23:18:50.007872+0000","last_clean":"2024-09-11T23:18:50.007872+0000","last_became_active":"2024-09-11T23:18:49.010206+0000","last_became_peered":"2024-09-11T23:18:49.010206+0000","last_unstale":"2024-09-11T23:18:50.007872+0000","last_undegraded":"2024-09-11T23:18:50.007872+0000","last_fullsized":"2024-09-11T23:18:50.007872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:05.371678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.587413+0000","last_change":"2024-09-11T23:18:48.012601+0000","last_active":"2024-09-11T23:18:50.587413+0000","last_peered":"2024-09-11T23:18:50.587413+0000","last_clean":"2024-09-11T23:18:50.587413+0000","last_became_active":"2024-09-11T23:18:48.010086+0000","last_became_peered":"2024-09-11T23:18:48.010086+0000","last_unstale":"2024-09-11T23:18:50.587413+0000","last_undegraded":"2024-09-11T23:18:50.587413+0000","last_fullsized":"2024-09-11T23:18:50.587413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:22.408272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586065+0000","last_change":"2024-09-11T23:18:49.009424+0000","last_active":"2024-09-11T23:18:50.586065+0000","last_peered":"2024-09-11T23:18:50.586065+0000","last_clean":"2024-09-11T23:18:50.586065+0000","last_became_active":"2024-09-11T23:18:49.008854+0000","last_became_peered":"2024-09-11T23:18:49.008854+0000","last_unstale":"2024-09-11T23:18:50.586065+0000","last_undegraded":"2024-09-11T23:18:50.586065+0000","last_fullsized":"2024-09-11T23:18:50.586065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:54.389826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.012956+0000","last_change":"2024-09-11T23:18:48.000946+0000","last_active":"2024-09-11T23:18:50.012956+0000","last_peered":"2024-09-11T23:18:50.012956+0000","last_clean":"2024-09-11T23:18:50.012956+0000","last_became_active":"2024-09-11T23:18:48.000299+0000","last_became_peered":"2024-09-11T23:18:48.000299+0000","last_unstale":"2024-09-11T23:18:50.012956+0000","last_undegraded":"2024-09-11T23:18:50.012956+0000","last_fullsized":"2024-09-11T23:18:50.012956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:19.403184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.011694+0000","last_change":"2024-09-11T23:18:49.000439+0000","last_active":"2024-09-11T23:18:50.011694+0000","last_peered":"2024-09-11T23:18:50.011694+0000","last_clean":"2024-09-11T23:18:50.011694+0000","last_became_active":"2024-09-11T23:18:49.000122+0000","last_became_peered":"2024-09-11T23:18:49.000122+0000","last_unstale":"2024-09-11T23:18:50.011694+0000","last_undegraded":"2024-09-11T23:18:50.011694+0000","last_fullsized":"2024-09-11T23:18:50.011694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:08.846324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586132+0000","last_change":"2024-09-11T23:18:48.016472+0000","last_active":"2024-09-11T23:18:50.586132+0000","last_peered":"2024-09-11T23:18:50.586132+0000","last_clean":"2024-09-11T23:18:50.586132+0000","last_became_active":"2024-09-11T23:18:48.016190+0000","last_became_peered":"2024-09-11T23:18:48.016190+0000","last_unstale":"2024-09-11T23:18:50.586132+0000","last_undegraded":"2024-09-11T23:18:50.586132+0000","last_fullsized":"2024-09-11T23:18:50.586132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:19.031495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586270+0000","last_change":"2024-09-11T23:18:49.012546+0000","last_active":"2024-09-11T23:18:50.586270+0000","last_peered":"2024-09-11T23:18:50.586270+0000","last_clean":"2024-09-11T23:18:50.586270+0000","last_became_active":"2024-09-11T23:18:49.012189+0000","last_became_peered":"2024-09-11T23:18:49.012189+0000","last_unstale":"2024-09-11T23:18:50.586270+0000","last_undegraded":"2024-09-11T23:18:50.586270+0000","last_fullsized":"2024-09-11T23:18:50.586270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:47.981836+0000","last_clean_scrub_stamp":"2024-09-11T23:18:47.981836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:20.993650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.085910+0000","last_change":"2024-09-11T23:18:48.008963+0000","last_active":"2024-09-11T23:18:50.085910+0000","last_peered":"2024-09-11T23:18:50.085910+0000","last_clean":"2024-09-11T23:18:50.085910+0000","last_became_active":"2024-09-11T23:18:48.008162+0000","last_became_peered":"2024-09-11T23:18:48.008162+0000","last_unstale":"2024-09-11T23:18:50.085910+0000","last_undegraded":"2024-09-11T23:18:50.085910+0000","last_fullsized":"2024-09-11T23:18:50.085910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:18:46.978874+0000","last_clean_scrub_stamp":"2024-09-11T23:18:46.978874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:30.420649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":191,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-11T23:18:50.586540+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:18:50.586540+0000","last_peered":"2024-09-11T23:18:50.586540+0000","last_clean":"2024-09-11T23:18:50.586540+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:18:50.586540+0000","last_undegraded":"2024-09-11T23:18:50.586540+0000","last_fullsized":"2024-09-11T23:18:50.586540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476754,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":970752,"data_stored":735989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476753,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":380928,"data_stored":146147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476752,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":380928,"data_stored":146203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476752,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":145635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":147165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":966656,"data_stored":735899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":147165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542160,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":145601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:18:58.209 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:18:58.209 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:18:58.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.405+0000 7f206ce00640 1 Processor -- start 2024-09-11T23:18:58.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.405+0000 7f206ce00640 1 -- start start 2024-09-11T23:18:58.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.406+0000 7f206ce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f206815b370 0x7f2068072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.406+0000 7f206ce00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f206815f9f0 0x7f206806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.406+0000 7f206ce00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f206815c970 con 0x7f206806ef60 2024-09-11T23:18:58.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.406+0000 7f206ce00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f206815fef0 con 0x7f206815f9f0 2024-09-11T23:18:58.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.406+0000 7f206ce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f206815bbb0 con 0x7f206815b370 2024-09-11T23:18:58.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.407+0000 7f2066800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f206806ef60 0x7f2068071040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56816/0 (socket says 172.21.15.144:56816) 2024-09-11T23:18:58.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.407+0000 7f2066800640 1 -- 172.21.15.144:0/4173804277 learned_addr learned my addr 172.21.15.144:0/4173804277 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:58.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.407+0000 7f2065400640 1 --2- 172.21.15.144:0/4173804277 >> v2:172.21.15.165:3300/0 conn(0x7f206815f9f0 0x7f206806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.407+0000 7f2065e00640 1 --2- 172.21.15.144:0/4173804277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f206815b370 0x7f2068072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.407+0000 7f2064a00640 1 -- 172.21.15.144:0/4173804277 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3002883942 0 0) 0x7f206815c970 con 0x7f206806ef60 2024-09-11T23:18:58.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.407+0000 7f2064a00640 1 -- 172.21.15.144:0/4173804277 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f204c003520 con 0x7f206806ef60 2024-09-11T23:18:58.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.407+0000 7f2065400640 1 -- 172.21.15.144:0/4173804277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f206815b370 msgr2=0x7f2068072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:58.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.407+0000 7f2065400640 1 --2- 172.21.15.144:0/4173804277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f206815b370 0x7f2068072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.407+0000 7f2065400640 1 -- 172.21.15.144:0/4173804277 >> v1:172.21.15.144:6789/0 conn(0x7f206806ef60 legacy=0x7f2068071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.407+0000 7f2065400640 1 -- 172.21.15.144:0/4173804277 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f206815be90 con 0x7f206815f9f0 2024-09-11T23:18:58.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.408+0000 7f2065400640 1 --2- 172.21.15.144:0/4173804277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f206815f9f0 0x7f206806ea20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f20540097a0 tx=0x7f205402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=629a76fb0b8a82f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:58.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.409+0000 7f2064a00640 1 -- 172.21.15.144:0/4173804277 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2054037070 con 0x7f206815f9f0 2024-09-11T23:18:58.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.409+0000 7f2064a00640 1 -- 172.21.15.144:0/4173804277 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205402ae50 con 0x7f206815f9f0 2024-09-11T23:18:58.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.409+0000 7f2064a00640 1 -- 172.21.15.144:0/4173804277 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2054032660 con 0x7f206815f9f0 2024-09-11T23:18:58.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.409+0000 7f206ce00640 1 -- 172.21.15.144:0/4173804277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f206815f9f0 msgr2=0x7f206806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.409+0000 7f206ce00640 1 --2- 172.21.15.144:0/4173804277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f206815f9f0 0x7f206806ea20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f20540097a0 tx=0x7f205402a100 comp rx=0 tx=0).stop 2024-09-11T23:18:58.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.409+0000 7f206ce00640 1 -- 172.21.15.144:0/4173804277 shutdown_connections 2024-09-11T23:18:58.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.409+0000 7f206ce00640 1 --2- 172.21.15.144:0/4173804277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f206815f9f0 0x7f206806ea20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.409+0000 7f206ce00640 1 --2- 172.21.15.144:0/4173804277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f206815b370 0x7f2068072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.409+0000 7f206ce00640 1 -- 172.21.15.144:0/4173804277 >> 172.21.15.144:0/4173804277 conn(0x7f206806bba0 msgr2=0x7f206806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:58.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.409+0000 7f206ce00640 1 -- 172.21.15.144:0/4173804277 shutdown_connections 2024-09-11T23:18:58.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.409+0000 7f206ce00640 1 -- 172.21.15.144:0/4173804277 wait complete. 2024-09-11T23:18:58.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.411+0000 7f206ce00640 1 Processor -- start 2024-09-11T23:18:58.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.411+0000 7f206ce00640 1 -- start start 2024-09-11T23:18:58.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.412+0000 7f206ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f206806ef60 0x7f20680ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.412+0000 7f206ce00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f206815b370 0x7f20680ae590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.412+0000 7f206ce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f206815f9f0 0x7f20680ad010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.412+0000 7f206ce00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f20680731b0 con 0x7f206806ef60 2024-09-11T23:18:58.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.412+0000 7f206ce00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f206815c450 con 0x7f206815b370 2024-09-11T23:18:58.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.412+0000 7f206ce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f20680cf4a0 con 0x7f206815f9f0 2024-09-11T23:18:58.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.412+0000 7f2065e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f206806ef60 0x7f20680ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.412+0000 7f2065e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f206806ef60 0x7f20680ab7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37434/0 (socket says 172.21.15.144:37434) 2024-09-11T23:18:58.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.412+0000 7f2065e00640 1 -- 172.21.15.144:0/980863455 learned_addr learned my addr 172.21.15.144:0/980863455 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:58.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.412+0000 7f2065400640 1 --2- 172.21.15.144:0/980863455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f206815b370 0x7f20680ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.412+0000 7f2066800640 1 --2- 172.21.15.144:0/980863455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f206815f9f0 0x7f20680ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.412+0000 7f2065e00640 1 -- 172.21.15.144:0/980863455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f206815f9f0 msgr2=0x7f20680ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.412+0000 7f2065e00640 1 --2- 172.21.15.144:0/980863455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f206815f9f0 0x7f20680ad010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.412+0000 7f2065e00640 1 -- 172.21.15.144:0/980863455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f206815b370 msgr2=0x7f20680ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.412+0000 7f2065e00640 1 --2- 172.21.15.144:0/980863455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f206815b370 0x7f20680ae590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.412+0000 7f2065e00640 1 -- 172.21.15.144:0/980863455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20680abcf0 con 0x7f206806ef60 2024-09-11T23:18:58.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.413+0000 7f2065400640 1 --2- 172.21.15.144:0/980863455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f206815b370 0x7f20680ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:58.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.413+0000 7f2066800640 1 --2- 172.21.15.144:0/980863455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f206815f9f0 0x7f20680ad010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:58.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.413+0000 7f2065e00640 1 --2- 172.21.15.144:0/980863455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f206806ef60 0x7f20680ab7b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f205800e9b0 tx=0x7f205800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:58.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.413+0000 7f205e000640 1 -- 172.21.15.144:0/980863455 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058017070 con 0x7f206806ef60 2024-09-11T23:18:58.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.413+0000 7f205e000640 1 -- 172.21.15.144:0/980863455 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205800c9a0 con 0x7f206806ef60 2024-09-11T23:18:58.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.413+0000 7f205e000640 1 -- 172.21.15.144:0/980863455 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205800cd90 con 0x7f206806ef60 2024-09-11T23:18:58.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.413+0000 7f206ce00640 1 -- 172.21.15.144:0/980863455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20680ac250 con 0x7f206806ef60 2024-09-11T23:18:58.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.413+0000 7f206ce00640 1 -- 172.21.15.144:0/980863455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20680ac810 con 0x7f206806ef60 2024-09-11T23:18:58.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.414+0000 7f206ce00640 1 -- 172.21.15.144:0/980863455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f206815b750 con 0x7f206806ef60 2024-09-11T23:18:58.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.415+0000 7f205e000640 1 -- 172.21.15.144:0/980863455 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f205801a070 con 0x7f206806ef60 2024-09-11T23:18:58.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.416+0000 7f205e000640 1 --2- 172.21.15.144:0/980863455 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f204806be30 0x7f204806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.416+0000 7f205e000640 1 -- 172.21.15.144:0/980863455 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f205808aea0 con 0x7f206806ef60 2024-09-11T23:18:58.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.416+0000 7f2065400640 1 --2- 172.21.15.144:0/980863455 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f204806be30 0x7f204806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.417+0000 7f2065400640 1 --2- 172.21.15.144:0/980863455 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f204806be30 0x7f204806e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2054034000 tx=0x7f205402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:58.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.421+0000 7f205e000640 1 -- 172.21.15.144:0/980863455 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f20680abcf0 con 0x7f206806ef60 2024-09-11T23:18:58.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.658+0000 7f206ce00640 1 -- 172.21.15.144:0/980863455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f20680b5580 con 0x7f206806ef60 2024-09-11T23:18:58.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.662+0000 7f205e000640 1 -- 172.21.15.144:0/980863455 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7f2058059840 con 0x7f206806ef60 2024-09-11T23:18:58.663 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-11T23:18:58.663 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A== 2024-09-11T23:18:58.663 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-11T23:18:58.663 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-11T23:18:58.664 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:18:58.664 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-11T23:18:58.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.665+0000 7f206ce00640 1 -- 172.21.15.144:0/980863455 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f204806be30 msgr2=0x7f204806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.665+0000 7f206ce00640 1 --2- 172.21.15.144:0/980863455 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f204806be30 0x7f204806e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2054034000 tx=0x7f205402e000 comp rx=0 tx=0).stop 2024-09-11T23:18:58.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.665+0000 7f206ce00640 1 -- 172.21.15.144:0/980863455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f206806ef60 msgr2=0x7f20680ab7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.665+0000 7f206ce00640 1 --2- 172.21.15.144:0/980863455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f206806ef60 0x7f20680ab7b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f205800e9b0 tx=0x7f205800ee70 comp rx=0 tx=0).stop 2024-09-11T23:18:58.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.665+0000 7f206ce00640 1 -- 172.21.15.144:0/980863455 shutdown_connections 2024-09-11T23:18:58.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.665+0000 7f206ce00640 1 --2- 172.21.15.144:0/980863455 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f204806be30 0x7f204806e2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.665+0000 7f206ce00640 1 --2- 172.21.15.144:0/980863455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f206815f9f0 0x7f20680ad010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.665+0000 7f206ce00640 1 --2- 172.21.15.144:0/980863455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f206815b370 0x7f20680ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.665+0000 7f206ce00640 1 --2- 172.21.15.144:0/980863455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f206806ef60 0x7f20680ab7b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.665+0000 7f206ce00640 1 -- 172.21.15.144:0/980863455 >> 172.21.15.144:0/980863455 conn(0x7f206806bba0 msgr2=0x7f2068072310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:58.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.665+0000 7f206ce00640 1 -- 172.21.15.144:0/980863455 shutdown_connections 2024-09-11T23:18:58.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.665+0000 7f206ce00640 1 -- 172.21.15.144:0/980863455 wait complete. 2024-09-11T23:18:58.682 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:18:58.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.834+0000 7f06e0400640 1 Processor -- start 2024-09-11T23:18:58.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.834+0000 7f06e0400640 1 -- start start 2024-09-11T23:18:58.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.836+0000 7f06e0400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f06d80d02a0 0x7f06d80d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.836+0000 7f06e0400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f06d815ca40 0x7f06d815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.836+0000 7f06e0400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06d815ceb0 0x7f06d81594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.836+0000 7f06e0400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f06d80d0bc0 con 0x7f06d80d02a0 2024-09-11T23:18:58.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.836+0000 7f06e0400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f06d815d390 con 0x7f06d815ca40 2024-09-11T23:18:58.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.836+0000 7f06e0400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f06d815d670 con 0x7f06d815ceb0 2024-09-11T23:18:58.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.836+0000 7f06dda00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f06d80d02a0 0x7f06d80d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.836+0000 7f06dda00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f06d80d02a0 0x7f06d80d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37442/0 (socket says 172.21.15.144:37442) 2024-09-11T23:18:58.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.836+0000 7f06dda00640 1 -- 172.21.15.144:0/4213788693 learned_addr learned my addr 172.21.15.144:0/4213788693 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:58.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.836+0000 7f06dd000640 1 --2- 172.21.15.144:0/4213788693 >> v2:172.21.15.165:3300/0 conn(0x7f06d815ca40 0x7f06d815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.836+0000 7f06de400640 1 --2- 172.21.15.144:0/4213788693 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06d815ceb0 0x7f06d81594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.837+0000 7f06dda00640 1 -- 172.21.15.144:0/4213788693 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06d815ceb0 msgr2=0x7f06d81594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:58.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.837+0000 7f06dda00640 1 --2- 172.21.15.144:0/4213788693 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06d815ceb0 0x7f06d81594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.837+0000 7f06dda00640 1 -- 172.21.15.144:0/4213788693 >> v2:172.21.15.165:3300/0 conn(0x7f06d815ca40 msgr2=0x7f06d815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:58.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.837+0000 7f06dda00640 1 --2- 172.21.15.144:0/4213788693 >> v2:172.21.15.165:3300/0 conn(0x7f06d815ca40 0x7f06d815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.837+0000 7f06dda00640 1 -- 172.21.15.144:0/4213788693 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d815d950 con 0x7f06d80d02a0 2024-09-11T23:18:58.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.837+0000 7f06de400640 1 --2- 172.21.15.144:0/4213788693 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06d815ceb0 0x7f06d81594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:18:58.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.838+0000 7f06dda00640 1 --2- 172.21.15.144:0/4213788693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d80d02a0 0x7f06d80d0680 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f06d80cf320 tx=0x7f06cc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c99b4d22c10a45 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:58.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.838+0000 7f06d7e00640 1 -- 172.21.15.144:0/4213788693 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc037070 con 0x7f06d80d02a0 2024-09-11T23:18:58.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.838+0000 7f06d7e00640 1 -- 172.21.15.144:0/4213788693 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06cc032440 con 0x7f06d80d02a0 2024-09-11T23:18:58.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.838+0000 7f06d7e00640 1 -- 172.21.15.144:0/4213788693 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc032810 con 0x7f06d80d02a0 2024-09-11T23:18:58.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.838+0000 7f06e0400640 1 -- 172.21.15.144:0/4213788693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d80d02a0 msgr2=0x7f06d80d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.838+0000 7f06e0400640 1 --2- 172.21.15.144:0/4213788693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d80d02a0 0x7f06d80d0680 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f06d80cf320 tx=0x7f06cc02a140 comp rx=0 tx=0).stop 2024-09-11T23:18:58.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.839+0000 7f06e0400640 1 -- 172.21.15.144:0/4213788693 shutdown_connections 2024-09-11T23:18:58.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.839+0000 7f06e0400640 1 --2- 172.21.15.144:0/4213788693 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06d815ceb0 0x7f06d81594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.839+0000 7f06e0400640 1 --2- 172.21.15.144:0/4213788693 >> v2:172.21.15.165:3300/0 conn(0x7f06d815ca40 0x7f06d815e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.839+0000 7f06e0400640 1 --2- 172.21.15.144:0/4213788693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d80d02a0 0x7f06d80d0680 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.839+0000 7f06e0400640 1 -- 172.21.15.144:0/4213788693 >> 172.21.15.144:0/4213788693 conn(0x7f06d8062cc0 msgr2=0x7f06d806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:58.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.839+0000 7f06e0400640 1 -- 172.21.15.144:0/4213788693 shutdown_connections 2024-09-11T23:18:58.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.839+0000 7f06e0400640 1 -- 172.21.15.144:0/4213788693 wait complete. 2024-09-11T23:18:58.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.840+0000 7f06e0400640 1 Processor -- start 2024-09-11T23:18:58.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.840+0000 7f06e0400640 1 -- start start 2024-09-11T23:18:58.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.841+0000 7f06e0400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06d80d02a0 0x7f06d81f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.841+0000 7f06e0400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d815ca40 0x7f06d8158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.841+0000 7f06e0400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06d815ceb0 0x7f06d8156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.841+0000 7f06e0400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f06d8155b90 con 0x7f06d815ca40 2024-09-11T23:18:58.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.841+0000 7f06e0400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f06d815df10 con 0x7f06d80d02a0 2024-09-11T23:18:58.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.841+0000 7f06e0400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f06d8155d10 con 0x7f06d815ceb0 2024-09-11T23:18:58.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.842+0000 7f06dd000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d815ca40 0x7f06d8158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.842+0000 7f06dd000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d815ca40 0x7f06d8158a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37454/0 (socket says 172.21.15.144:37454) 2024-09-11T23:18:58.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.842+0000 7f06dd000640 1 -- 172.21.15.144:0/1555625155 learned_addr learned my addr 172.21.15.144:0/1555625155 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:58.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.842+0000 7f06dda00640 1 --2- 172.21.15.144:0/1555625155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06d80d02a0 0x7f06d81f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.842+0000 7f06de400640 1 --2- 172.21.15.144:0/1555625155 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06d815ceb0 0x7f06d8156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.842+0000 7f06dd000640 1 -- 172.21.15.144:0/1555625155 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06d815ceb0 msgr2=0x7f06d8156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.842+0000 7f06dd000640 1 --2- 172.21.15.144:0/1555625155 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06d815ceb0 0x7f06d8156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.842+0000 7f06dd000640 1 -- 172.21.15.144:0/1555625155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06d80d02a0 msgr2=0x7f06d81f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:58.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.842+0000 7f06dd000640 1 --2- 172.21.15.144:0/1555625155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06d80d02a0 0x7f06d81f1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:58.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.842+0000 7f06dd000640 1 -- 172.21.15.144:0/1555625155 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d8157990 con 0x7f06d815ca40 2024-09-11T23:18:58.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.842+0000 7f06dd000640 1 --2- 172.21.15.144:0/1555625155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d815ca40 0x7f06d8158a30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f06c400d800 tx=0x7f06c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:58.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.842+0000 7f06d5600640 1 -- 172.21.15.144:0/1555625155 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c4018030 con 0x7f06d815ca40 2024-09-11T23:18:58.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.843+0000 7f06d5600640 1 -- 172.21.15.144:0/1555625155 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c4009640 con 0x7f06d815ca40 2024-09-11T23:18:58.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.843+0000 7f06d5600640 1 -- 172.21.15.144:0/1555625155 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c4009810 con 0x7f06d815ca40 2024-09-11T23:18:58.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.843+0000 7f06e0400640 1 -- 172.21.15.144:0/1555625155 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d8157c70 con 0x7f06d815ca40 2024-09-11T23:18:58.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.843+0000 7f06e0400640 1 -- 172.21.15.144:0/1555625155 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d8158230 con 0x7f06d815ca40 2024-09-11T23:18:58.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.844+0000 7f06e0400640 1 -- 172.21.15.144:0/1555625155 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d80b4790 con 0x7f06d815ca40 2024-09-11T23:18:58.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.845+0000 7f06d5600640 1 -- 172.21.15.144:0/1555625155 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f06c401b070 con 0x7f06d815ca40 2024-09-11T23:18:58.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.845+0000 7f06d5600640 1 --2- 172.21.15.144:0/1555625155 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f06b806be60 0x7f06b806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:58.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.846+0000 7f06d5600640 1 -- 172.21.15.144:0/1555625155 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f06c408b0c0 con 0x7f06d815ca40 2024-09-11T23:18:58.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.846+0000 7f06dda00640 1 --2- 172.21.15.144:0/1555625155 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f06b806be60 0x7f06b806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:58.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.846+0000 7f06dda00640 1 --2- 172.21.15.144:0/1555625155 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f06b806be60 0x7f06b806e320 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f06cc034000 tx=0x7f06cc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:58.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:58.850+0000 7f06d5600640 1 -- 172.21.15.144:0/1555625155 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f06c4059a60 con 0x7f06d815ca40 2024-09-11T23:18:59.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.059+0000 7f06e0400640 1 -- 172.21.15.144:0/1555625155 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06d8063470 con 0x7f06d815ca40 2024-09-11T23:18:59.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.059+0000 7f06d5600640 1 -- 172.21.15.144:0/1555625155 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5229 (secure 0 0 0) 0x7f06c4059360 con 0x7f06d815ca40 2024-09-11T23:18:59.060 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:18:59.061 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":17,"btime":"2024-09-11T23:18:52:015546+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4601,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/4045809607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":4045809607},{"type":"v1","addr":"172.21.15.165:6835","nonce":4045809607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2584561527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2584561527},{"type":"v1","addr":"172.21.15.165:6834","nonce":2584561527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4815,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/787593912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":787593912},{"type":"v1","addr":"172.21.15.144:6836","nonce":787593912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:18:48.405093+0000","modified":"2024-09-11T23:18:51.419894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4818},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4818":{"gid":4818,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/163510896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":163510896},{"type":"v1","addr":"172.21.15.144:6837","nonce":163510896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4818,"qdb_cluster":[4818]},"id":2}]} 2024-09-11T23:18:59.061 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 17 2024-09-11T23:18:59.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.061+0000 7f06e0400640 1 -- 172.21.15.144:0/1555625155 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f06b806be60 msgr2=0x7f06b806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.061+0000 7f06e0400640 1 --2- 172.21.15.144:0/1555625155 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f06b806be60 0x7f06b806e320 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f06cc034000 tx=0x7f06cc02e000 comp rx=0 tx=0).stop 2024-09-11T23:18:59.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.062+0000 7f06e0400640 1 -- 172.21.15.144:0/1555625155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d815ca40 msgr2=0x7f06d8158a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.062+0000 7f06e0400640 1 --2- 172.21.15.144:0/1555625155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d815ca40 0x7f06d8158a30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f06c400d800 tx=0x7f06c400dcc0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.062+0000 7f06e0400640 1 -- 172.21.15.144:0/1555625155 shutdown_connections 2024-09-11T23:18:59.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.062+0000 7f06e0400640 1 --2- 172.21.15.144:0/1555625155 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f06b806be60 0x7f06b806e320 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.062+0000 7f06e0400640 1 --2- 172.21.15.144:0/1555625155 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f06d815ceb0 0x7f06d8156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.062+0000 7f06e0400640 1 --2- 172.21.15.144:0/1555625155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f06d815ca40 0x7f06d8158a30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.062+0000 7f06e0400640 1 --2- 172.21.15.144:0/1555625155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06d80d02a0 0x7f06d81f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.062+0000 7f06e0400640 1 -- 172.21.15.144:0/1555625155 >> 172.21.15.144:0/1555625155 conn(0x7f06d8062cc0 msgr2=0x7f06d81595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:59.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.062+0000 7f06e0400640 1 -- 172.21.15.144:0/1555625155 shutdown_connections 2024-09-11T23:18:59.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.062+0000 7f06e0400640 1 -- 172.21.15.144:0/1555625155 wait complete. 2024-09-11T23:18:59.481 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:18:48.405093+0000', 'modified': '2024-09-11T23:18:51.419894+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4818}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4818': {'gid': 4818, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6837/163510896', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6835', 'nonce': 163510896}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 163510896}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4818, 'qdb_cluster': [4818]} 2024-09-11T23:18:59.481 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:18:59.481 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-11T23:18:59.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.635+0000 7f4fd0000640 1 Processor -- start 2024-09-11T23:18:59.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.635+0000 7f4fd0000640 1 -- start start 2024-09-11T23:18:59.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.636+0000 7f4fd0000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4fc815c180 0x7f4fc80cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.637+0000 7f4fd0000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc80ce740 con 0x7f4fc80ce230 2024-09-11T23:18:59.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.637+0000 7f4fd0000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc8072640 con 0x7f4fc8073120 2024-09-11T23:18:59.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.637+0000 7f4fd0000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4fc8072920 con 0x7f4fc815c180 2024-09-11T23:18:59.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.637+0000 7f4fccc00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4fc80ce230 0x7f4fc80cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56832/0 (socket says 172.21.15.144:56832) 2024-09-11T23:18:59.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.637+0000 7f4fccc00640 1 -- 172.21.15.144:0/2482039444 learned_addr learned my addr 172.21.15.144:0/2482039444 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:59.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.637+0000 7f4fcd600640 1 --2- 172.21.15.144:0/2482039444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4fc815c180 0x7f4fc80cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.637+0000 7f4fc7e00640 1 -- 172.21.15.144:0/2482039444 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1187297677 0 0) 0x7f4fc80ce740 con 0x7f4fc80ce230 2024-09-11T23:18:59.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.637+0000 7f4fc7e00640 1 -- 172.21.15.144:0/2482039444 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fb0003520 con 0x7f4fc80ce230 2024-09-11T23:18:59.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.637+0000 7f4fc7e00640 1 -- 172.21.15.144:0/2482039444 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328455445 0 0) 0x7f4fc8072640 con 0x7f4fc8073120 2024-09-11T23:18:59.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.637+0000 7f4fc7e00640 1 -- 172.21.15.144:0/2482039444 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fc80ce740 con 0x7f4fc8073120 2024-09-11T23:18:59.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.638+0000 7f4fcd600640 1 -- 172.21.15.144:0/2482039444 >> v1:172.21.15.165:6789/0 conn(0x7f4fc8073120 legacy=0x7f4fc806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.638+0000 7f4fcd600640 1 -- 172.21.15.144:0/2482039444 >> v1:172.21.15.144:6789/0 conn(0x7f4fc80ce230 legacy=0x7f4fc80cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.638+0000 7f4fcd600640 1 -- 172.21.15.144:0/2482039444 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc8072c00 con 0x7f4fc815c180 2024-09-11T23:18:59.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.639+0000 7f4fcd600640 1 --2- 172.21.15.144:0/2482039444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4fc815c180 0x7f4fc80cdcf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc0097d0 tx=0x7f4fbc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbb8da63db331aa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:59.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.639+0000 7f4fc7e00640 1 -- 172.21.15.144:0/2482039444 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc037070 con 0x7f4fc815c180 2024-09-11T23:18:59.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.639+0000 7f4fc7e00640 1 -- 172.21.15.144:0/2482039444 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fbc032440 con 0x7f4fc815c180 2024-09-11T23:18:59.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.639+0000 7f4fc7e00640 1 -- 172.21.15.144:0/2482039444 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0327f0 con 0x7f4fc815c180 2024-09-11T23:18:59.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.639+0000 7f4fd0000640 1 -- 172.21.15.144:0/2482039444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4fc815c180 msgr2=0x7f4fc80cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.639+0000 7f4fd0000640 1 --2- 172.21.15.144:0/2482039444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4fc815c180 0x7f4fc80cdcf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc0097d0 tx=0x7f4fbc02a180 comp rx=0 tx=0).stop 2024-09-11T23:18:59.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.639+0000 7f4fd0000640 1 -- 172.21.15.144:0/2482039444 shutdown_connections 2024-09-11T23:18:59.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.639+0000 7f4fd0000640 1 --2- 172.21.15.144:0/2482039444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4fc815c180 0x7f4fc80cdcf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.640+0000 7f4fd0000640 1 -- 172.21.15.144:0/2482039444 >> 172.21.15.144:0/2482039444 conn(0x7f4fc8062cc0 msgr2=0x7f4fc806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:59.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.640+0000 7f4fd0000640 1 -- 172.21.15.144:0/2482039444 shutdown_connections 2024-09-11T23:18:59.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.640+0000 7f4fd0000640 1 -- 172.21.15.144:0/2482039444 wait complete. 2024-09-11T23:18:59.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.641+0000 7f4fd0000640 1 Processor -- start 2024-09-11T23:18:59.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.641+0000 7f4fd0000640 1 -- start start 2024-09-11T23:18:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.642+0000 7f4fd0000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fc8073120 0x7f4fc81581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.642+0000 7f4fd0000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fc80ce230 0x7f4fc8155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.642+0000 7f4fd0000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4fc815c180 0x7f4fc8156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.642+0000 7f4fd0000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc80cf780 con 0x7f4fc80ce230 2024-09-11T23:18:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.642+0000 7f4fd0000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc80722f0 con 0x7f4fc8073120 2024-09-11T23:18:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.642+0000 7f4fd0000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4fc815c560 con 0x7f4fc815c180 2024-09-11T23:18:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.642+0000 7f4fccc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fc80ce230 0x7f4fc8155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.642+0000 7f4fcd600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fc8073120 0x7f4fc81581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.642+0000 7f4fccc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fc80ce230 0x7f4fc8155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37464/0 (socket says 172.21.15.144:37464) 2024-09-11T23:18:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.642+0000 7f4fccc00640 1 -- 172.21.15.144:0/3742815357 learned_addr learned my addr 172.21.15.144:0/3742815357 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.643+0000 7f4fce000640 1 --2- 172.21.15.144:0/3742815357 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4fc815c180 0x7f4fc8156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.643+0000 7f4fccc00640 1 -- 172.21.15.144:0/3742815357 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4fc815c180 msgr2=0x7f4fc8156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.643+0000 7f4fccc00640 1 --2- 172.21.15.144:0/3742815357 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4fc815c180 0x7f4fc8156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.643+0000 7f4fccc00640 1 -- 172.21.15.144:0/3742815357 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fc8073120 msgr2=0x7f4fc81581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.643+0000 7f4fccc00640 1 --2- 172.21.15.144:0/3742815357 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fc8073120 0x7f4fc81581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.643+0000 7f4fccc00640 1 -- 172.21.15.144:0/3742815357 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc8158a40 con 0x7f4fc80ce230 2024-09-11T23:18:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.643+0000 7f4fccc00640 1 --2- 172.21.15.144:0/3742815357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fc80ce230 0x7f4fc8155cd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400c3e0 tx=0x7f4fb400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.643+0000 7f4fc5600640 1 -- 172.21.15.144:0/3742815357 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4017070 con 0x7f4fc80ce230 2024-09-11T23:18:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.643+0000 7f4fc5600640 1 -- 172.21.15.144:0/3742815357 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fb4005ce0 con 0x7f4fc80ce230 2024-09-11T23:18:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.643+0000 7f4fc5600640 1 -- 172.21.15.144:0/3742815357 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40072d0 con 0x7f4fc80ce230 2024-09-11T23:18:59.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.643+0000 7f4fd0000640 1 -- 172.21.15.144:0/3742815357 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc8158d20 con 0x7f4fc80ce230 2024-09-11T23:18:59.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.644+0000 7f4fd0000640 1 -- 172.21.15.144:0/3742815357 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc8158730 con 0x7f4fc80ce230 2024-09-11T23:18:59.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.646+0000 7f4fc5600640 1 -- 172.21.15.144:0/3742815357 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4fb401a070 con 0x7f4fc80ce230 2024-09-11T23:18:59.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.646+0000 7f4fc5600640 1 --2- 172.21.15.144:0/3742815357 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4fa806be60 0x7f4fa806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.646+0000 7f4fc5600640 1 -- 172.21.15.144:0/3742815357 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4fb408a100 con 0x7f4fc80ce230 2024-09-11T23:18:59.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.647+0000 7f4fcd600640 1 --2- 172.21.15.144:0/3742815357 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4fa806be60 0x7f4fa806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.647+0000 7f4fd3014740 1 Processor -- start 2024-09-11T23:18:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.647+0000 7f4fd3014740 1 -- start start 2024-09-11T23:18:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.647+0000 7f4fcd600640 1 --2- 172.21.15.144:0/3742815357 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4fa806be60 0x7f4fa806e320 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc034000 tx=0x7f4fbc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.648+0000 7f4fd3014740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 0x55cafede6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.648+0000 7f4fd3014740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafed9e4b0 0x55cafeda10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.648+0000 7f4fd3014740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cafeda2480 0x55cafed9b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.648+0000 7f4fd3014740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55cafecff3b0 con 0x55cafeda0cf0 2024-09-11T23:18:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.648+0000 7f4fd3014740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55cafed04410 con 0x55cafeda2480 2024-09-11T23:18:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.648+0000 7f4fd3014740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55cafecac620 con 0x55cafed9e4b0 2024-09-11T23:18:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.648+0000 7f4fcd600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 0x55cafede6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.648+0000 7f4fcd600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 0x55cafede6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37480/0 (socket says 172.21.15.144:37480) 2024-09-11T23:18:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.648+0000 7f4fcd600640 1 -- 172.21.15.144:0/2499719585 learned_addr learned my addr 172.21.15.144:0/2499719585 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.648+0000 7f4fccc00640 1 --2- 172.21.15.144:0/2499719585 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafed9e4b0 0x55cafeda10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.648+0000 7f4fce000640 1 --2- 172.21.15.144:0/2499719585 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cafeda2480 0x55cafed9b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.649+0000 7f4fcd600640 1 -- 172.21.15.144:0/2499719585 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafed9e4b0 msgr2=0x55cafeda10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.649+0000 7f4fcd600640 1 --2- 172.21.15.144:0/2499719585 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafed9e4b0 0x55cafeda10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.649+0000 7f4fcd600640 1 -- 172.21.15.144:0/2499719585 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cafeda2480 msgr2=0x55cafed9b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.649+0000 7f4fcd600640 1 --2- 172.21.15.144:0/2499719585 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cafeda2480 0x55cafed9b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.649+0000 7f4fcd600640 1 -- 172.21.15.144:0/2499719585 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cafea172d0 con 0x55cafeda0cf0 2024-09-11T23:18:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.649+0000 7f4fccc00640 1 --2- 172.21.15.144:0/2499719585 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafed9e4b0 0x55cafeda10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.649+0000 7f4fcd600640 1 --2- 172.21.15.144:0/2499719585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 0x55cafede6490 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc02a770 tx=0x7f4fbc02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b71a32d1570629 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.649+0000 7f4fb9c00640 1 -- 172.21.15.144:0/2499719585 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc037040 con 0x55cafeda0cf0 2024-09-11T23:18:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.649+0000 7f4fb9c00640 1 -- 172.21.15.144:0/2499719585 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fbc04c070 con 0x55cafeda0cf0 2024-09-11T23:18:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.649+0000 7f4fb9c00640 1 -- 172.21.15.144:0/2499719585 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc032440 con 0x55cafeda0cf0 2024-09-11T23:18:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.650+0000 7f4fd3014740 1 -- 172.21.15.144:0/2499719585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 msgr2=0x55cafede6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.650+0000 7f4fd3014740 1 --2- 172.21.15.144:0/2499719585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 0x55cafede6490 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc02a770 tx=0x7f4fbc02c000 comp rx=0 tx=0).stop 2024-09-11T23:18:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.650+0000 7f4fd3014740 1 -- 172.21.15.144:0/2499719585 shutdown_connections 2024-09-11T23:18:59.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.650+0000 7f4fd3014740 1 --2- 172.21.15.144:0/2499719585 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cafeda2480 0x55cafed9b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.650+0000 7f4fd3014740 1 --2- 172.21.15.144:0/2499719585 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafed9e4b0 0x55cafeda10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.650+0000 7f4fd3014740 1 --2- 172.21.15.144:0/2499719585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 0x55cafede6490 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.650+0000 7f4fd3014740 1 -- 172.21.15.144:0/2499719585 >> 172.21.15.144:0/2499719585 conn(0x55cafed9d740 msgr2=0x55cafede5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:59.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.650+0000 7f4fd3014740 1 -- 172.21.15.144:0/2499719585 shutdown_connections 2024-09-11T23:18:59.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.650+0000 7f4fd3014740 1 -- 172.21.15.144:0/2499719585 wait complete. 2024-09-11T23:18:59.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.651+0000 7f4fd3014740 1 -- start start 2024-09-11T23:18:59.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.651+0000 7f4fd3014740 1 Processor -- start 2024-09-11T23:18:59.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.652+0000 7f4fd3014740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cafeda0cf0 0x55cafedbb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.652+0000 7f4fd3014740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda2480 0x55cafedbfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.652+0000 7f4fd3014740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafedbfa60 0x55cafed9f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.652+0000 7f4fd3014740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55cafecbf780 con 0x55cafeda2480 2024-09-11T23:18:59.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.652+0000 7f4fd3014740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55cafed003d0 con 0x55cafeda0cf0 2024-09-11T23:18:59.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.652+0000 7f4fd3014740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55cafed9cbe0 con 0x55cafedbfa60 2024-09-11T23:18:59.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.652+0000 7f4fd3014740 10 client.0 _ll_register_callbacks cb 0x55cafecfd5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:59.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.652+0000 7f4fccc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda2480 0x55cafedbfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.652+0000 7f4fccc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda2480 0x55cafedbfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37484/0 (socket says 172.21.15.144:37484) 2024-09-11T23:18:59.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.652+0000 7f4fccc00640 1 -- 172.21.15.144:0/2334486354 learned_addr learned my addr 172.21.15.144:0/2334486354 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:59.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.652+0000 7f4fcd600640 1 --2- 172.21.15.144:0/2334486354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cafeda0cf0 0x55cafedbb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.652+0000 7f4fce000640 1 --2- 172.21.15.144:0/2334486354 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafedbfa60 0x55cafed9f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.652+0000 7f4fccc00640 1 -- 172.21.15.144:0/2334486354 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafedbfa60 msgr2=0x55cafed9f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:59.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.652+0000 7f4fccc00640 1 --2- 172.21.15.144:0/2334486354 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafedbfa60 0x55cafed9f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.652+0000 7f4fccc00640 1 -- 172.21.15.144:0/2334486354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cafeda0cf0 msgr2=0x55cafedbb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:59.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.652+0000 7f4fccc00640 1 --2- 172.21.15.144:0/2334486354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cafeda0cf0 0x55cafedbb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.653+0000 7f4fccc00640 1 -- 172.21.15.144:0/2334486354 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cafeae16b0 con 0x55cafeda2480 2024-09-11T23:18:59.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.653+0000 7f4fccc00640 1 --2- 172.21.15.144:0/2334486354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda2480 0x55cafedbfef0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40548b0 tx=0x7f4fb4058450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d580b0a3919a2540 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:59.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.653+0000 7f4fae000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:18:59.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.653+0000 7f4fae000640 1 -- 172.21.15.144:0/2334486354 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40703d0 con 0x55cafeda2480 2024-09-11T23:18:59.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.653+0000 7f4fae000640 1 -- 172.21.15.144:0/2334486354 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4fb4007470 con 0x55cafeda2480 2024-09-11T23:18:59.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.653+0000 7f4fd3014740 1 -- 172.21.15.144:0/2334486354 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fbc04c070 con 0x55cafeda2480 2024-09-11T23:18:59.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.653+0000 7f4fae000640 1 -- 172.21.15.144:0/2334486354 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f4fb4088050 con 0x55cafeda2480 2024-09-11T23:18:59.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.653+0000 7f4fd3014740 10 client.4995 fetch_fsmap learned FSMap version 17 2024-09-11T23:18:59.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.653+0000 7f4fd3014740 1 -- 172.21.15.144:0/2334486354 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55cafedc0e20 con 0x55cafeda2480 2024-09-11T23:18:59.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.653+0000 7f4fae000640 1 -- 172.21.15.144:0/2334486354 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fbc04c070 con 0x55cafeda2480 2024-09-11T23:18:59.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.653+0000 7f4fae000640 1 -- 172.21.15.144:0/2334486354 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f4fb40578a0 con 0x55cafeda2480 2024-09-11T23:18:59.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.653+0000 7f4fd3014740 10 client.4995 fetch_fsmap finished waiting for FSMap version 17 2024-09-11T23:18:59.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.654+0000 7f4fd3014740 10 client.4995 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:18:59.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.654+0000 7f4fd3014740 20 client.4995 populate_metadata read hostname 'smithi144' 2024-09-11T23:18:59.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.654+0000 7f4fd3014740 1 --2- 172.21.15.144:0/2334486354 >> [v2:172.21.15.144:6835/163510896,v1:172.21.15.144:6837/163510896] conn(0x55cafedca4b0 0x55cafedf6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.654+0000 7f4fd3014740 4 client.4995 mds_command: new command op to 4818 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:18:59.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.654+0000 7f4fd3014740 1 -- 172.21.15.144:0/2334486354 --> [v2:172.21.15.144:6835/163510896,v1:172.21.15.144:6837/163510896] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cafed11b40 con 0x55cafedca4b0 2024-09-11T23:18:59.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.654+0000 7f4fcd600640 1 --2- 172.21.15.144:0/2334486354 >> [v2:172.21.15.144:6835/163510896,v1:172.21.15.144:6837/163510896] conn(0x55cafedca4b0 0x55cafedf6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.654+0000 7f4fcd600640 1 --2- 172.21.15.144:0/2334486354 >> [v2:172.21.15.144:6835/163510896,v1:172.21.15.144:6837/163510896] conn(0x55cafedca4b0 0x55cafedf6050 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be80095e95d1230f server_cookie=1918930054541b0a in_seq=0 out_seq=0 2024-09-11T23:18:59.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.654+0000 7f4fae000640 10 client.4995 ms_handle_connect on v2:172.21.15.144:6835/163510896 2024-09-11T23:18:59.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.655+0000 7f4fae000640 1 -- 172.21.15.144:0/2334486354 <== mds.0 v2:172.21.15.144:6835/163510896 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cafed11b40 con 0x55cafedca4b0 2024-09-11T23:18:59.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.655+0000 7f4fae000640 10 client.4995 handle_command_reply: tid=0 2024-09-11T23:18:59.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.655+0000 7f4fd3014740 1 client.4995 shutdown 2024-09-11T23:18:59.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.655+0000 7f4fd3014740 1 -- 172.21.15.144:0/2334486354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda2480 msgr2=0x55cafedbfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.655+0000 7f4fd3014740 1 --2- 172.21.15.144:0/2334486354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda2480 0x55cafedbfef0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40548b0 tx=0x7f4fb4058450 comp rx=0 tx=0).stop 2024-09-11T23:18:59.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.656+0000 7f4fd3014740 1 -- 172.21.15.144:0/2334486354 shutdown_connections 2024-09-11T23:18:59.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.656+0000 7f4fd3014740 1 --2- 172.21.15.144:0/2334486354 >> [v2:172.21.15.144:6835/163510896,v1:172.21.15.144:6837/163510896] conn(0x55cafedca4b0 0x55cafedf6050 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.656+0000 7f4fd3014740 1 --2- 172.21.15.144:0/2334486354 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafedbfa60 0x55cafed9f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.656+0000 7f4fd3014740 1 --2- 172.21.15.144:0/2334486354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda2480 0x55cafedbfef0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.656+0000 7f4fd3014740 1 --2- 172.21.15.144:0/2334486354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cafeda0cf0 0x55cafedbb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.656+0000 7f4fae000640 0 client.4995 ms_handle_reset on v2:172.21.15.144:6835/163510896 2024-09-11T23:18:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.656+0000 7f4fd3014740 1 -- 172.21.15.144:0/2334486354 >> 172.21.15.144:0/2334486354 conn(0x55cafed9e4b0 msgr2=0x55cafede4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.656+0000 7f4fd3014740 1 -- 172.21.15.144:0/2334486354 shutdown_connections 2024-09-11T23:18:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.656+0000 7f4fd3014740 1 -- 172.21.15.144:0/2334486354 wait complete. 2024-09-11T23:18:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.656+0000 7f4fd3014740 20 client.4995 trim_cache size 0 max 16384 2024-09-11T23:18:59.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.675+0000 7f4fd3014740 1 Processor -- start 2024-09-11T23:18:59.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.675+0000 7f4fd3014740 1 -- start start 2024-09-11T23:18:59.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.676+0000 7f4fd3014740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 0x55cafede3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.676+0000 7f4fd3014740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafeda2480 0x55cafee09240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.676+0000 7f4fd3014740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cafedbfa60 0x55cafee09780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.676+0000 7f4fd3014740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc81ffb10 con 0x55cafeda0cf0 2024-09-11T23:18:59.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.676+0000 7f4fd3014740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc81fee70 con 0x55cafedbfa60 2024-09-11T23:18:59.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.676+0000 7f4fd3014740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4fc81ff4c0 con 0x55cafeda2480 2024-09-11T23:18:59.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.676+0000 7f4fcd600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 0x55cafede3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.676+0000 7f4fcd600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 0x55cafede3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37494/0 (socket says 172.21.15.144:37494) 2024-09-11T23:18:59.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.676+0000 7f4fcd600640 1 -- 172.21.15.144:0/205307789 learned_addr learned my addr 172.21.15.144:0/205307789 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:59.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.677+0000 7f4fce000640 1 --2- 172.21.15.144:0/205307789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cafedbfa60 0x55cafee09780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.677+0000 7f4fccc00640 1 --2- 172.21.15.144:0/205307789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafeda2480 0x55cafee09240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.677+0000 7f4fcd600640 1 -- 172.21.15.144:0/205307789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafeda2480 msgr2=0x55cafee09240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:59.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.677+0000 7f4fcd600640 1 --2- 172.21.15.144:0/205307789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafeda2480 0x55cafee09240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.677+0000 7f4fcd600640 1 -- 172.21.15.144:0/205307789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cafedbfa60 msgr2=0x55cafee09780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:59.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.677+0000 7f4fcd600640 1 --2- 172.21.15.144:0/205307789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cafedbfa60 0x55cafee09780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.677+0000 7f4fcd600640 1 -- 172.21.15.144:0/205307789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cafedf4f10 con 0x55cafeda0cf0 2024-09-11T23:18:59.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.677+0000 7f4fcd600640 1 --2- 172.21.15.144:0/205307789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 0x55cafede3bd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc02a770 tx=0x7f4fbc009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3fb177e23a6560 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:59.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.677+0000 7f4fb9200640 1 -- 172.21.15.144:0/205307789 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc060070 con 0x55cafeda0cf0 2024-09-11T23:18:59.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.677+0000 7f4fb9200640 1 -- 172.21.15.144:0/205307789 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fbc04c040 con 0x55cafeda0cf0 2024-09-11T23:18:59.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.677+0000 7f4fb9200640 1 -- 172.21.15.144:0/205307789 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc037040 con 0x55cafeda0cf0 2024-09-11T23:18:59.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.678+0000 7f4fd3014740 1 -- 172.21.15.144:0/205307789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 msgr2=0x55cafede3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.678+0000 7f4fd3014740 1 --2- 172.21.15.144:0/205307789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 0x55cafede3bd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc02a770 tx=0x7f4fbc009190 comp rx=0 tx=0).stop 2024-09-11T23:18:59.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.678+0000 7f4fd3014740 1 -- 172.21.15.144:0/205307789 shutdown_connections 2024-09-11T23:18:59.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.678+0000 7f4fd3014740 1 --2- 172.21.15.144:0/205307789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cafedbfa60 0x55cafee09780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.678+0000 7f4fd3014740 1 --2- 172.21.15.144:0/205307789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafeda2480 0x55cafee09240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.678+0000 7f4fd3014740 1 --2- 172.21.15.144:0/205307789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 0x55cafede3bd0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.678+0000 7f4fd3014740 1 -- 172.21.15.144:0/205307789 >> 172.21.15.144:0/205307789 conn(0x55cafed9e4b0 msgr2=0x55cafedc1520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:59.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.678+0000 7f4fd3014740 1 -- 172.21.15.144:0/205307789 shutdown_connections 2024-09-11T23:18:59.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.678+0000 7f4fd3014740 1 -- 172.21.15.144:0/205307789 wait complete. 2024-09-11T23:18:59.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.679+0000 7f4fd3014740 1 -- start start 2024-09-11T23:18:59.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.679+0000 7f4fd3014740 1 Processor -- start 2024-09-11T23:18:59.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.680+0000 7f4fd3014740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 0x55cafede7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.680+0000 7f4fd3014740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafeda2480 0x55cafee62ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.680+0000 7f4fd3014740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cafedbfa60 0x55cafede5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.680+0000 7f4fd3014740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55cafedca330 con 0x55cafeda0cf0 2024-09-11T23:18:59.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.680+0000 7f4fd3014740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55cafedc1160 con 0x55cafedbfa60 2024-09-11T23:18:59.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.680+0000 7f4fd3014740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55cafedca980 con 0x55cafeda2480 2024-09-11T23:18:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.680+0000 7f4fd3014740 10 client.0 _ll_register_callbacks cb 0x7f4fbc035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:18:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.680+0000 7f4fcd600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 0x55cafede7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.680+0000 7f4fcd600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 0x55cafede7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37496/0 (socket says 172.21.15.144:37496) 2024-09-11T23:18:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.680+0000 7f4fcd600640 1 -- 172.21.15.144:0/3222173979 learned_addr learned my addr 172.21.15.144:0/3222173979 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.680+0000 7f4fccc00640 1 --2- 172.21.15.144:0/3222173979 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafeda2480 0x55cafee62ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.680+0000 7f4fce000640 1 --2- 172.21.15.144:0/3222173979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cafedbfa60 0x55cafede5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.680+0000 7f4fcd600640 1 -- 172.21.15.144:0/3222173979 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafeda2480 msgr2=0x55cafee62ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.680+0000 7f4fcd600640 1 --2- 172.21.15.144:0/3222173979 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafeda2480 0x55cafee62ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.680+0000 7f4fcd600640 1 -- 172.21.15.144:0/3222173979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cafedbfa60 msgr2=0x55cafede5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.680+0000 7f4fcd600640 1 --2- 172.21.15.144:0/3222173979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cafedbfa60 0x55cafede5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.680+0000 7f4fcd600640 1 -- 172.21.15.144:0/3222173979 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cafedc6ac0 con 0x55cafeda0cf0 2024-09-11T23:18:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.681+0000 7f4fcd600640 1 --2- 172.21.15.144:0/3222173979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 0x55cafede7ed0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc02a770 tx=0x7f4fbc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ce2f7a83e6150a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:59.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.681+0000 7f4fae000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:18:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.681+0000 7f4fae000640 1 -- 172.21.15.144:0/3222173979 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc060070 con 0x55cafeda0cf0 2024-09-11T23:18:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.681+0000 7f4fae000640 1 -- 172.21.15.144:0/3222173979 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4fbc003df0 con 0x55cafeda0cf0 2024-09-11T23:18:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.681+0000 7f4fd3014740 1 -- 172.21.15.144:0/3222173979 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fbc04c040 con 0x55cafeda0cf0 2024-09-11T23:18:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.681+0000 7f4fae000640 1 -- 172.21.15.144:0/3222173979 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f4fbc068050 con 0x55cafeda0cf0 2024-09-11T23:18:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.681+0000 7f4fd3014740 10 client.5001 fetch_fsmap learned FSMap version 17 2024-09-11T23:18:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.681+0000 7f4fd3014740 1 -- 172.21.15.144:0/3222173979 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55cafede5a70 con 0x55cafeda0cf0 2024-09-11T23:18:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.681+0000 7f4fae000640 1 -- 172.21.15.144:0/3222173979 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fbc04c040 con 0x55cafeda0cf0 2024-09-11T23:18:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.681+0000 7f4fae000640 1 -- 172.21.15.144:0/3222173979 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f4fbc06b020 con 0x55cafeda0cf0 2024-09-11T23:18:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.681+0000 7f4fd3014740 10 client.5001 fetch_fsmap finished waiting for FSMap version 17 2024-09-11T23:18:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.681+0000 7f4fd3014740 10 client.5001 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:18:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.681+0000 7f4fd3014740 20 client.5001 populate_metadata read hostname 'smithi144' 2024-09-11T23:18:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.681+0000 7f4fd3014740 1 --2- 172.21.15.144:0/3222173979 >> [v2:172.21.15.144:6835/163510896,v1:172.21.15.144:6837/163510896] conn(0x55cafedcade0 0x55cafedcb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.681+0000 7f4fd3014740 4 client.5001 mds_command: new command op to 4818 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:18:59.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.681+0000 7f4fd3014740 1 -- 172.21.15.144:0/3222173979 --> [v2:172.21.15.144:6835/163510896,v1:172.21.15.144:6837/163510896] -- command(tid 0: {"prefix": "status"}) -- 0x55cafed0be90 con 0x55cafedcade0 2024-09-11T23:18:59.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.682+0000 7f4fccc00640 1 --2- 172.21.15.144:0/3222173979 >> [v2:172.21.15.144:6835/163510896,v1:172.21.15.144:6837/163510896] conn(0x55cafedcade0 0x55cafedcb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.682+0000 7f4fccc00640 1 --2- 172.21.15.144:0/3222173979 >> [v2:172.21.15.144:6835/163510896,v1:172.21.15.144:6837/163510896] conn(0x55cafedcade0 0x55cafedcb1c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2da1f44490d05b68 server_cookie=d146b9192f2cb361 in_seq=0 out_seq=0 2024-09-11T23:18:59.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.682+0000 7f4fae000640 10 client.5001 ms_handle_connect on v2:172.21.15.144:6835/163510896 2024-09-11T23:18:59.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.682+0000 7f4fae000640 1 -- 172.21.15.144:0/3222173979 <== mds.0 v2:172.21.15.144:6835/163510896 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55cafed0be90 con 0x55cafedcade0 2024-09-11T23:18:59.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.682+0000 7f4fae000640 10 client.5001 handle_command_reply: tid=0 2024-09-11T23:18:59.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.682+0000 7f4fd3014740 1 client.5001 shutdown 2024-09-11T23:18:59.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.683+0000 7f4fd3014740 1 -- 172.21.15.144:0/3222173979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 msgr2=0x55cafede7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.683+0000 7f4fd3014740 1 --2- 172.21.15.144:0/3222173979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 0x55cafede7ed0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc02a770 tx=0x7f4fbc004730 comp rx=0 tx=0).stop 2024-09-11T23:18:59.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.683+0000 7f4fd3014740 1 -- 172.21.15.144:0/3222173979 shutdown_connections 2024-09-11T23:18:59.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.683+0000 7f4fd3014740 1 --2- 172.21.15.144:0/3222173979 >> [v2:172.21.15.144:6835/163510896,v1:172.21.15.144:6837/163510896] conn(0x55cafedcade0 0x55cafedcb1c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.683+0000 7f4fd3014740 1 --2- 172.21.15.144:0/3222173979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55cafedbfa60 0x55cafede5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.683+0000 7f4fd3014740 1 --2- 172.21.15.144:0/3222173979 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55cafeda2480 0x55cafee62ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.683+0000 7f4fae000640 0 client.5001 ms_handle_reset on v2:172.21.15.144:6835/163510896 2024-09-11T23:18:59.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.683+0000 7f4fd3014740 1 --2- 172.21.15.144:0/3222173979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cafeda0cf0 0x55cafede7ed0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.683+0000 7f4fd3014740 1 -- 172.21.15.144:0/3222173979 >> 172.21.15.144:0/3222173979 conn(0x55cafed9e4b0 msgr2=0x55cafede3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:59.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.683+0000 7f4fd3014740 1 -- 172.21.15.144:0/3222173979 shutdown_connections 2024-09-11T23:18:59.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.683+0000 7f4fd3014740 1 -- 172.21.15.144:0/3222173979 wait complete. 2024-09-11T23:18:59.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.683+0000 7f4fd3014740 20 client.5001 trim_cache size 0 max 16384 2024-09-11T23:18:59.688 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:18:59.688 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "4b73e4b7-12f0-4e37-94bc-45e333efe84e", 2024-09-11T23:18:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-11T23:18:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 4818, 2024-09-11T23:18:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-11T23:18:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-11T23:18:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-11T23:18:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 10.694093465, 2024-09-11T23:18:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 17, 2024-09-11T23:18:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 34, 2024-09-11T23:18:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 34, 2024-09-11T23:18:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 17.790409195999999 2024-09-11T23:18:59.689 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:18:59.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.683+0000 7f4fd0000640 1 -- 172.21.15.144:0/3742815357 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4fa806be60 msgr2=0x7f4fa806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.683+0000 7f4fd0000640 1 --2- 172.21.15.144:0/3742815357 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4fa806be60 0x7f4fa806e320 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc034000 tx=0x7f4fbc02e000 comp rx=0 tx=0).stop 2024-09-11T23:18:59.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.683+0000 7f4fd0000640 1 -- 172.21.15.144:0/3742815357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fc80ce230 msgr2=0x7f4fc8155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.683+0000 7f4fd0000640 1 --2- 172.21.15.144:0/3742815357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fc80ce230 0x7f4fc8155cd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400c3e0 tx=0x7f4fb400c8a0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.684+0000 7f4fd0000640 1 -- 172.21.15.144:0/3742815357 shutdown_connections 2024-09-11T23:18:59.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.684+0000 7f4fd0000640 1 --2- 172.21.15.144:0/3742815357 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4fa806be60 0x7f4fa806e320 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.684+0000 7f4fd0000640 1 --2- 172.21.15.144:0/3742815357 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4fc815c180 0x7f4fc8156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.684+0000 7f4fd0000640 1 --2- 172.21.15.144:0/3742815357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4fc80ce230 0x7f4fc8155cd0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.684+0000 7f4fd0000640 1 --2- 172.21.15.144:0/3742815357 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fc8073120 0x7f4fc81581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.684+0000 7f4fd0000640 1 -- 172.21.15.144:0/3742815357 >> 172.21.15.144:0/3742815357 conn(0x7f4fc8062cc0 msgr2=0x7f4fc80b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:59.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.684+0000 7f4fd0000640 1 -- 172.21.15.144:0/3742815357 shutdown_connections 2024-09-11T23:18:59.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.684+0000 7f4fd0000640 1 -- 172.21.15.144:0/3742815357 wait complete. 2024-09-11T23:18:59.700 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:18:59.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.851+0000 7f662c200640 1 Processor -- start 2024-09-11T23:18:59.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.851+0000 7f662c200640 1 -- start start 2024-09-11T23:18:59.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.852+0000 7f662c200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66240d02a0 0x7f66240d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.852+0000 7f662c200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f662415ca40 0x7f662415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.852+0000 7f662c200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66240d0bc0 con 0x7f662415ce80 2024-09-11T23:18:59.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.853+0000 7f662c200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f662415d390 con 0x7f662415ca40 2024-09-11T23:18:59.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.853+0000 7f662c200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f662415d670 con 0x7f66240d02a0 2024-09-11T23:18:59.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.853+0000 7f6628e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f662415ca40 0x7f662415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.853+0000 7f662a200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f662415ce80 0x7f66241594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56840/0 (socket says 172.21.15.144:56840) 2024-09-11T23:18:59.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.853+0000 7f662a200640 1 -- 172.21.15.144:0/720708175 learned_addr learned my addr 172.21.15.144:0/720708175 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:18:59.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.853+0000 7f6629800640 1 --2- 172.21.15.144:0/720708175 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66240d02a0 0x7f66240d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.853+0000 7f6628e00640 1 -- 172.21.15.144:0/720708175 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66240d02a0 msgr2=0x7f66240d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:18:59.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.853+0000 7f6628e00640 1 --2- 172.21.15.144:0/720708175 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66240d02a0 0x7f66240d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.853+0000 7f6628e00640 1 -- 172.21.15.144:0/720708175 >> v1:172.21.15.144:6789/0 conn(0x7f662415ce80 legacy=0x7f66241594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.853+0000 7f6623e00640 1 -- 172.21.15.144:0/720708175 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3605709238 0 0) 0x7f66240d0bc0 con 0x7f662415ce80 2024-09-11T23:18:59.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.853+0000 7f6628e00640 1 -- 172.21.15.144:0/720708175 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662415d950 con 0x7f662415ca40 2024-09-11T23:18:59.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.853+0000 7f6629800640 1 --2- 172.21.15.144:0/720708175 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66240d02a0 0x7f66240d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:59.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.854+0000 7f6628e00640 1 --2- 172.21.15.144:0/720708175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f662415ca40 0x7f662415e430 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f661000ba40 tx=0x7f661002c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da042bd0a7a40d89 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:59.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.855+0000 7f6623e00640 1 -- 172.21.15.144:0/720708175 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6610031710 con 0x7f662415ca40 2024-09-11T23:18:59.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.855+0000 7f6623e00640 1 -- 172.21.15.144:0/720708175 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66100318b0 con 0x7f662415ca40 2024-09-11T23:18:59.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.855+0000 7f6623e00640 1 -- 172.21.15.144:0/720708175 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6610031c80 con 0x7f662415ca40 2024-09-11T23:18:59.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.855+0000 7f662c200640 1 -- 172.21.15.144:0/720708175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f662415ca40 msgr2=0x7f662415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.855+0000 7f662c200640 1 --2- 172.21.15.144:0/720708175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f662415ca40 0x7f662415e430 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f661000ba40 tx=0x7f661002c7b0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.855+0000 7f662c200640 1 -- 172.21.15.144:0/720708175 shutdown_connections 2024-09-11T23:18:59.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.855+0000 7f662c200640 1 --2- 172.21.15.144:0/720708175 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f662415ca40 0x7f662415e430 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.855+0000 7f662c200640 1 --2- 172.21.15.144:0/720708175 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66240d02a0 0x7f66240d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.855+0000 7f662c200640 1 -- 172.21.15.144:0/720708175 >> 172.21.15.144:0/720708175 conn(0x7f6624062cc0 msgr2=0x7f662406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:18:59.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.855+0000 7f662c200640 1 -- 172.21.15.144:0/720708175 shutdown_connections 2024-09-11T23:18:59.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.855+0000 7f662c200640 1 -- 172.21.15.144:0/720708175 wait complete. 2024-09-11T23:18:59.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.857+0000 7f662c200640 1 Processor -- start 2024-09-11T23:18:59.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.857+0000 7f662c200640 1 -- start start 2024-09-11T23:18:59.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.858+0000 7f662c200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66240d02a0 0x7f6624157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.858+0000 7f662c200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f662415ca40 0x7f66240b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.858+0000 7f662c200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f662415ce80 0x7f662414bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.858+0000 7f662c200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6624155b90 con 0x7f662415ca40 2024-09-11T23:18:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.858+0000 7f662c200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f662415df10 con 0x7f662415ce80 2024-09-11T23:18:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.858+0000 7f662c200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6624155d10 con 0x7f66240d02a0 2024-09-11T23:18:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.858+0000 7f6628e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f662415ca40 0x7f66240b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.858+0000 7f6628e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f662415ca40 0x7f66240b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37518/0 (socket says 172.21.15.144:37518) 2024-09-11T23:18:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.858+0000 7f6628e00640 1 -- 172.21.15.144:0/1052765510 learned_addr learned my addr 172.21.15.144:0/1052765510 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:18:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.858+0000 7f662a200640 1 --2- 172.21.15.144:0/1052765510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f662415ce80 0x7f662414bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.858+0000 7f6629800640 1 --2- 172.21.15.144:0/1052765510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66240d02a0 0x7f6624157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.858+0000 7f6628e00640 1 -- 172.21.15.144:0/1052765510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66240d02a0 msgr2=0x7f6624157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.858+0000 7f6628e00640 1 --2- 172.21.15.144:0/1052765510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66240d02a0 0x7f6624157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.858+0000 7f6628e00640 1 -- 172.21.15.144:0/1052765510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f662415ce80 msgr2=0x7f662414bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:18:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.858+0000 7f6628e00640 1 --2- 172.21.15.144:0/1052765510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f662415ce80 0x7f662414bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:18:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.859+0000 7f6628e00640 1 -- 172.21.15.144:0/1052765510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662414e2f0 con 0x7f662415ca40 2024-09-11T23:18:59.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.859+0000 7f662a200640 1 --2- 172.21.15.144:0/1052765510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f662415ce80 0x7f662414bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:18:59.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.859+0000 7f6628e00640 1 --2- 172.21.15.144:0/1052765510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f662415ca40 0x7f66240b0630 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f661000bb30 tx=0x7f66100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:59.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.859+0000 7f6621600640 1 -- 172.21.15.144:0/1052765510 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6610033d30 con 0x7f662415ca40 2024-09-11T23:18:59.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.859+0000 7f6621600640 1 -- 172.21.15.144:0/1052765510 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f661003e420 con 0x7f662415ca40 2024-09-11T23:18:59.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.859+0000 7f662c200640 1 -- 172.21.15.144:0/1052765510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6624072ec0 con 0x7f662415ca40 2024-09-11T23:18:59.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.859+0000 7f6621600640 1 -- 172.21.15.144:0/1052765510 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661003e810 con 0x7f662415ca40 2024-09-11T23:18:59.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.859+0000 7f662c200640 1 -- 172.21.15.144:0/1052765510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6624073760 con 0x7f662415ca40 2024-09-11T23:18:59.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.860+0000 7f662c200640 1 -- 172.21.15.144:0/1052765510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66240732b0 con 0x7f662415ca40 2024-09-11T23:18:59.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.861+0000 7f6621600640 1 -- 172.21.15.144:0/1052765510 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f661003b040 con 0x7f662415ca40 2024-09-11T23:18:59.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.862+0000 7f6621600640 1 --2- 172.21.15.144:0/1052765510 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f660406be30 0x7f660406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:18:59.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.862+0000 7f6621600640 1 -- 172.21.15.144:0/1052765510 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f66100ae650 con 0x7f662415ca40 2024-09-11T23:18:59.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.862+0000 7f6629800640 1 --2- 172.21.15.144:0/1052765510 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f660406be30 0x7f660406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:18:59.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.863+0000 7f6629800640 1 --2- 172.21.15.144:0/1052765510 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f660406be30 0x7f660406e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6618006fd0 tx=0x7f6618008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:18:59.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:18:59.866+0000 7f6621600640 1 -- 172.21.15.144:0/1052765510 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6610042030 con 0x7f662415ca40 2024-09-11T23:19:00.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:00.076+0000 7f662c200640 1 -- 172.21.15.144:0/1052765510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f66241553f0 con 0x7f662415ca40 2024-09-11T23:19:00.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:00.077+0000 7f6621600640 1 -- 172.21.15.144:0/1052765510 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f66241553f0 con 0x7f662415ca40 2024-09-11T23:19:00.078 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:19:00.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:00.079+0000 7f662c200640 1 -- 172.21.15.144:0/1052765510 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f660406be30 msgr2=0x7f660406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:00.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:00.079+0000 7f662c200640 1 --2- 172.21.15.144:0/1052765510 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f660406be30 0x7f660406e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6618006fd0 tx=0x7f6618008040 comp rx=0 tx=0).stop 2024-09-11T23:19:00.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:00.079+0000 7f662c200640 1 -- 172.21.15.144:0/1052765510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f662415ca40 msgr2=0x7f66240b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:00.079+0000 7f662c200640 1 --2- 172.21.15.144:0/1052765510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f662415ca40 0x7f66240b0630 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f661000bb30 tx=0x7f66100046c0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:00.079+0000 7f662c200640 1 -- 172.21.15.144:0/1052765510 shutdown_connections 2024-09-11T23:19:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:00.079+0000 7f662c200640 1 --2- 172.21.15.144:0/1052765510 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f660406be30 0x7f660406e2f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:00.079+0000 7f662c200640 1 --2- 172.21.15.144:0/1052765510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f662415ce80 0x7f662414bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:00.079+0000 7f662c200640 1 --2- 172.21.15.144:0/1052765510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f662415ca40 0x7f66240b0630 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:00.079+0000 7f662c200640 1 --2- 172.21.15.144:0/1052765510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66240d02a0 0x7f6624157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:00.079+0000 7f662c200640 1 -- 172.21.15.144:0/1052765510 >> 172.21.15.144:0/1052765510 conn(0x7f6624062cc0 msgr2=0x7f66240b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:00.079+0000 7f662c200640 1 -- 172.21.15.144:0/1052765510 shutdown_connections 2024-09-11T23:19:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:00.079+0000 7f662c200640 1 -- 172.21.15.144:0/1052765510 wait complete. 2024-09-11T23:19:00.095 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:19:00.095 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:19:00.096 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-11T23:19:00.096 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:19:00.096 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:00.096 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:19:00.096 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:19:00.096 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:19:00.096 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:19:00.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:00.096 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-11T23:19:00.132 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:19:00.132 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:19:00.132 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:19:00.132 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-11T23:19:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:00.133 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:19:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-11T23:19:00.133 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:19:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-11T23:19:00.133 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:19:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:00.133 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:19:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:00.133 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:19:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42622sec preferred_lft 42622sec 2024-09-11T23:19:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2024-09-11T23:19:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:00.134 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:19:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:19:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::243b:82ff:fe06:fac9/64 scope link 2024-09-11T23:19:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:00.134 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:19:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:19:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::74ca:30ff:fef2:cddf/64 scope link 2024-09-11T23:19:00.134 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:00.134 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:19:00.135 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether be:01:ec:87:34:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:19:00.135 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bc01:ecff:fe87:34e1/64 scope link 2024-09-11T23:19:00.135 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:00.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:00.135 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:19:00.226 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-11T23:19:00.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:00.230 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-11T23:19:00.266 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-11T23:19:00.266 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:19:00.267 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:19:00.267 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:19:00.267 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:19:00.267 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:19:00.267 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-11T23:19:00.267 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:19:00.267 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:19:00.267 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:19:00.267 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-11T23:19:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:19:00.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:19:00.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:00.464 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-11T23:19:00.499 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:19:00.499 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:19:00.500 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:19:00.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:00.500 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-11T23:19:00.595 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:19:00.596 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:00.631 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:19:00.631 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:19:00.631 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:00.705 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T23:19:00.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:00.706 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:19:00.833 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:19:00.834 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:19:00.861 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:19:00.862 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:19:00.862 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:19:00.862 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:19:00.862 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:19:00.863 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T23:19:00.863 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:19:00.863 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:19:00.863 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:19:00.863 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:19:00.866 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:19:00.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:00.867 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:00.923 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:19:01.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:19:01.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:19:01.020 INFO:teuthology.orchestra.run.smithi144.stdout:client4730 2024-09-11T23:19:01.021 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:19:01.021 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:01.057 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:19:01.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.250+0000 7f5b9de00640 1 Processor -- start 2024-09-11T23:19:01.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.250+0000 7f5b9de00640 1 -- start start 2024-09-11T23:19:01.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.252+0000 7f5b9de00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5b9815c180 0x7f5b980cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.252+0000 7f5b9de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5b980ce230 0x7f5b980cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.252+0000 7f5b9de00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b980ce740 con 0x7f5b980cf5b0 2024-09-11T23:19:01.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.252+0000 7f5b9de00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5b98072640 con 0x7f5b980ce230 2024-09-11T23:19:01.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.252+0000 7f5b9de00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5b98072920 con 0x7f5b9815c180 2024-09-11T23:19:01.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.252+0000 7f5b8e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5b980ce230 0x7f5b980cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.252+0000 7f5b8e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5b980ce230 0x7f5b980cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37520/0 (socket says 172.21.15.144:37520) 2024-09-11T23:19:01.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.252+0000 7f5b8e000640 1 -- 172.21.15.144:0/386186907 learned_addr learned my addr 172.21.15.144:0/386186907 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:01.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.252+0000 7f5b97400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5b980cf5b0 0x7f5b98073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56844/0 (socket says 172.21.15.144:56844) 2024-09-11T23:19:01.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.252+0000 7f5b96a00640 1 --2- 172.21.15.144:0/386186907 >> v2:172.21.15.165:3300/0 conn(0x7f5b9815c180 0x7f5b980cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.252+0000 7f5b8e000640 1 -- 172.21.15.144:0/386186907 >> v2:172.21.15.165:3300/0 conn(0x7f5b9815c180 msgr2=0x7f5b980cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:01.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.252+0000 7f5b8e000640 1 --2- 172.21.15.144:0/386186907 >> v2:172.21.15.165:3300/0 conn(0x7f5b9815c180 0x7f5b980cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.252+0000 7f5b8e000640 1 -- 172.21.15.144:0/386186907 >> v1:172.21.15.144:6789/0 conn(0x7f5b980cf5b0 legacy=0x7f5b98073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.252+0000 7f5b96000640 1 -- 172.21.15.144:0/386186907 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 676015852 0 0) 0x7f5b980ce740 con 0x7f5b980cf5b0 2024-09-11T23:19:01.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.252+0000 7f5b8e000640 1 -- 172.21.15.144:0/386186907 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b98072c00 con 0x7f5b980ce230 2024-09-11T23:19:01.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.253+0000 7f5b8e000640 1 --2- 172.21.15.144:0/386186907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b980ce230 0x7f5b980cf070 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5b9806cc10 tx=0x7f5b8002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df370627ae2ad69 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:01.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.254+0000 7f5b96000640 1 -- 172.21.15.144:0/386186907 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b80037070 con 0x7f5b980ce230 2024-09-11T23:19:01.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.254+0000 7f5b96000640 1 -- 172.21.15.144:0/386186907 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b80032440 con 0x7f5b980ce230 2024-09-11T23:19:01.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.254+0000 7f5b96000640 1 -- 172.21.15.144:0/386186907 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b80032810 con 0x7f5b980ce230 2024-09-11T23:19:01.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.254+0000 7f5b9de00640 1 -- 172.21.15.144:0/386186907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b980ce230 msgr2=0x7f5b980cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.254+0000 7f5b9de00640 1 --2- 172.21.15.144:0/386186907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b980ce230 0x7f5b980cf070 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5b9806cc10 tx=0x7f5b8002a1e0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.254+0000 7f5b9de00640 1 -- 172.21.15.144:0/386186907 shutdown_connections 2024-09-11T23:19:01.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.254+0000 7f5b9de00640 1 --2- 172.21.15.144:0/386186907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b980ce230 0x7f5b980cf070 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.254+0000 7f5b9de00640 1 --2- 172.21.15.144:0/386186907 >> v2:172.21.15.165:3300/0 conn(0x7f5b9815c180 0x7f5b980cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.254+0000 7f5b9de00640 1 -- 172.21.15.144:0/386186907 >> 172.21.15.144:0/386186907 conn(0x7f5b98062cc0 msgr2=0x7f5b9806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:01.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.254+0000 7f5b9de00640 1 -- 172.21.15.144:0/386186907 shutdown_connections 2024-09-11T23:19:01.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.254+0000 7f5b9de00640 1 -- 172.21.15.144:0/386186907 wait complete. 2024-09-11T23:19:01.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.256+0000 7f5b9de00640 1 Processor -- start 2024-09-11T23:19:01.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.256+0000 7f5b9de00640 1 -- start start 2024-09-11T23:19:01.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.257+0000 7f5b9de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5b980ce230 0x7f5b9814ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.257+0000 7f5b9de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b980cf5b0 0x7f5b98151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.257+0000 7f5b9de00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b9815c180 0x7f5b980b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.257+0000 7f5b9de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9815c560 con 0x7f5b980cf5b0 2024-09-11T23:19:01.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.257+0000 7f5b9de00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5b980722f0 con 0x7f5b9815c180 2024-09-11T23:19:01.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.257+0000 7f5b9de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5b9815c6e0 con 0x7f5b980ce230 2024-09-11T23:19:01.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.257+0000 7f5b8e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b980cf5b0 0x7f5b98151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.257+0000 7f5b8e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b980cf5b0 0x7f5b98151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37526/0 (socket says 172.21.15.144:37526) 2024-09-11T23:19:01.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.257+0000 7f5b8e000640 1 -- 172.21.15.144:0/1573644277 learned_addr learned my addr 172.21.15.144:0/1573644277 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:01.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.257+0000 7f5b97400640 1 --2- 172.21.15.144:0/1573644277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b9815c180 0x7f5b980b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.258+0000 7f5b96a00640 1 --2- 172.21.15.144:0/1573644277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5b980ce230 0x7f5b9814ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.258+0000 7f5b8e000640 1 -- 172.21.15.144:0/1573644277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5b980ce230 msgr2=0x7f5b9814ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.258+0000 7f5b8e000640 1 --2- 172.21.15.144:0/1573644277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5b980ce230 0x7f5b9814ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.258+0000 7f5b8e000640 1 -- 172.21.15.144:0/1573644277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b9815c180 msgr2=0x7f5b980b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.258+0000 7f5b8e000640 1 --2- 172.21.15.144:0/1573644277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b9815c180 0x7f5b980b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.258+0000 7f5b8e000640 1 -- 172.21.15.144:0/1573644277 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9814f220 con 0x7f5b980cf5b0 2024-09-11T23:19:01.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.258+0000 7f5b97400640 1 --2- 172.21.15.144:0/1573644277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b9815c180 0x7f5b980b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:01.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.258+0000 7f5b8e000640 1 --2- 172.21.15.144:0/1573644277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b980cf5b0 0x7f5b98151c90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5b8002a220 tx=0x7f5b800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:01.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.258+0000 7f5b8fe00640 1 -- 172.21.15.144:0/1573644277 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b80041020 con 0x7f5b980cf5b0 2024-09-11T23:19:01.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.258+0000 7f5b8fe00640 1 -- 172.21.15.144:0/1573644277 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b800306c0 con 0x7f5b980cf5b0 2024-09-11T23:19:01.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.258+0000 7f5b8fe00640 1 -- 172.21.15.144:0/1573644277 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b80037040 con 0x7f5b980cf5b0 2024-09-11T23:19:01.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.258+0000 7f5b9de00640 1 -- 172.21.15.144:0/1573644277 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b98152600 con 0x7f5b980cf5b0 2024-09-11T23:19:01.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.258+0000 7f5b9de00640 1 -- 172.21.15.144:0/1573644277 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b9814f7a0 con 0x7f5b980cf5b0 2024-09-11T23:19:01.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.259+0000 7f5b9de00640 1 -- 172.21.15.144:0/1573644277 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b98071910 con 0x7f5b980cf5b0 2024-09-11T23:19:01.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.260+0000 7f5b8fe00640 1 -- 172.21.15.144:0/1573644277 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b80044020 con 0x7f5b980cf5b0 2024-09-11T23:19:01.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.261+0000 7f5b8fe00640 1 --2- 172.21.15.144:0/1573644277 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b7406be60 0x7f5b7406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:01.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.261+0000 7f5b8fe00640 1 -- 172.21.15.144:0/1573644277 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f5b800ab670 con 0x7f5b980cf5b0 2024-09-11T23:19:01.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.261+0000 7f5b96a00640 1 --2- 172.21.15.144:0/1573644277 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b7406be60 0x7f5b7406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:01.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.262+0000 7f5b96a00640 1 --2- 172.21.15.144:0/1573644277 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b7406be60 0x7f5b7406e320 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5b88006fd0 tx=0x7f5b88008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:01.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.265+0000 7f5b8fe00640 1 -- 172.21.15.144:0/1573644277 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5b98071910 con 0x7f5b980cf5b0 2024-09-11T23:19:01.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.473+0000 7f5b9de00640 1 -- 172.21.15.144:0/1573644277 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5b980cf070 con 0x7f5b980cf5b0 2024-09-11T23:19:01.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.474+0000 7f5b8fe00640 1 -- 172.21.15.144:0/1573644277 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f5b8004b030 con 0x7f5b980cf5b0 2024-09-11T23:19:01.474 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:19:01.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.476+0000 7f5b9de00640 1 -- 172.21.15.144:0/1573644277 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b7406be60 msgr2=0x7f5b7406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.476+0000 7f5b9de00640 1 --2- 172.21.15.144:0/1573644277 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b7406be60 0x7f5b7406e320 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5b88006fd0 tx=0x7f5b88008040 comp rx=0 tx=0).stop 2024-09-11T23:19:01.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.476+0000 7f5b9de00640 1 -- 172.21.15.144:0/1573644277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b980cf5b0 msgr2=0x7f5b98151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:01.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.476+0000 7f5b9de00640 1 --2- 172.21.15.144:0/1573644277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b980cf5b0 0x7f5b98151c90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5b8002a220 tx=0x7f5b800046c0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.476+0000 7f5b9de00640 1 -- 172.21.15.144:0/1573644277 shutdown_connections 2024-09-11T23:19:01.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.476+0000 7f5b9de00640 1 --2- 172.21.15.144:0/1573644277 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b7406be60 0x7f5b7406e320 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.476+0000 7f5b9de00640 1 --2- 172.21.15.144:0/1573644277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b9815c180 0x7f5b980b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.476+0000 7f5b9de00640 1 --2- 172.21.15.144:0/1573644277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b980cf5b0 0x7f5b98151c90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.476+0000 7f5b9de00640 1 --2- 172.21.15.144:0/1573644277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5b980ce230 0x7f5b9814ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:01.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.476+0000 7f5b9de00640 1 -- 172.21.15.144:0/1573644277 >> 172.21.15.144:0/1573644277 conn(0x7f5b98062cc0 msgr2=0x7f5b9806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:01.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.476+0000 7f5b9de00640 1 -- 172.21.15.144:0/1573644277 shutdown_connections 2024-09-11T23:19:01.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:01.476+0000 7f5b9de00640 1 -- 172.21.15.144:0/1573644277 wait complete. 2024-09-11T23:19:01.493 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:19:01.493 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:19:01.493 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi165.front.sepia.ceph.com 2024-09-11T23:19:01.493 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T23:19:01.493 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:19:01.493 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:19:01.493 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:19:01.493 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:19:01.493 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:19:01.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:01.494 DEBUG:teuthology.orchestra.run.smithi165:> ip addr 2024-09-11T23:19:01.536 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:19:01.536 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:19:01.536 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:19:01.536 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:01.536 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-11T23:19:01.536 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:01.536 INFO:teuthology.orchestra.run.smithi165.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:19:01.536 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:94 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:01.537 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f0 2024-09-11T23:19:01.537 INFO:teuthology.orchestra.run.smithi165.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:19:01.537 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:95 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:01.537 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f1 2024-09-11T23:19:01.537 INFO:teuthology.orchestra.run.smithi165.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:19:01.537 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:01.537 INFO:teuthology.orchestra.run.smithi165.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:19:01.537 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:01.537 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.21.15.165/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:19:01.537 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft 42624sec preferred_lft 42624sec 2024-09-11T23:19:01.537 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::ec4:7aff:fe88:7f63/64 scope link noprefixroute 2024-09-11T23:19:01.537 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:01.537 INFO:teuthology.orchestra.run.smithi165.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:19:01.537 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:01.538 INFO:teuthology.orchestra.run.smithi165.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:19:01.538 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:01.538 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::c063:d7ff:fec8:c56c/64 scope link 2024-09-11T23:19:01.538 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:01.538 INFO:teuthology.orchestra.run.smithi165.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:19:01.538 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:19:01.538 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::5478:e4ff:fecd:76c/64 scope link 2024-09-11T23:19:01.538 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:01.538 INFO:teuthology.orchestra.run.smithi165.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:19:01.538 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether ba:fa:43:78:5f:29 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:19:01.538 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::b8fa:43ff:fe78:5f29/64 scope link 2024-09-11T23:19:01.538 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:01.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:01.539 DEBUG:teuthology.orchestra.run.smithi165:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:19:01.634 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-11T23:19:01.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:01.638 DEBUG:teuthology.orchestra.run.smithi165:> route 2024-09-11T23:19:01.675 INFO:teuthology.orchestra.run.smithi165.stdout:Kernel IP routing table 2024-09-11T23:19:01.675 INFO:teuthology.orchestra.run.smithi165.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:19:01.675 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:19:01.675 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:19:01.675 INFO:teuthology.orchestra.run.smithi165.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:19:01.675 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:19:01.675 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-11T23:19:01.675 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:19:01.676 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:19:01.676 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:19:01.676 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-11T23:19:01.793 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:19:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:19:01.864 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:19:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:19:01.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:01.873 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-11T23:19:01.912 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-11T23:19:01.912 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-11T23:19:01.912 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:19:01.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:01.913 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set brx.0 up 2024-09-11T23:19:02.009 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:19:02.010 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T23:19:02.045 INFO:teuthology.orchestra.run.smithi165.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:19:02.045 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:19:02.045 DEBUG:teuthology.orchestra.run.smithi165:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:19:02.120 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-11T23:19:02.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:02.120 DEBUG:teuthology.orchestra.run.smithi165:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:19:02.249 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:19:02.249 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:19:02.277 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:19:02.277 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:19:02.277 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:19:02.277 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: trying mount with new device syntax: 1@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:19:02.277 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:19:02.280 INFO:teuthology.orchestra.run.smithi165.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-11T23:19:02.280 INFO:teuthology.orchestra.run.smithi165.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:19:02.280 INFO:teuthology.orchestra.run.smithi165.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:19:02.280 INFO:teuthology.orchestra.run.smithi165.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:19:02.280 INFO:teuthology.orchestra.run.smithi165.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:19:02.285 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:19:02.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:02.285 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:19:02.341 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:19:02.419 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:19:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:19:02.423 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:19:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:19:02.431 INFO:teuthology.orchestra.run.smithi165.stdout:client5022 2024-09-11T23:19:02.431 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:19:02.431 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:02.467 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-11T23:19:02.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.631+0000 7f30afe00640 1 Processor -- start 2024-09-11T23:19:02.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.631+0000 7f30afe00640 1 -- start start 2024-09-11T23:19:02.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.633+0000 7f30afe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f30a806f130 0x7f30a8072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.633+0000 7f30afe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f30a815f9f0 0x7f30a80ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.633+0000 7f30afe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30a815c970 con 0x7f30a815b370 2024-09-11T23:19:02.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.633+0000 7f30afe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f30a815fef0 con 0x7f30a806f130 2024-09-11T23:19:02.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.633+0000 7f30afe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f30a815bbb0 con 0x7f30a815f9f0 2024-09-11T23:19:02.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.633+0000 7f30aca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f30a806f130 0x7f30a8072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:02.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.633+0000 7f30ad400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f30a815b370 0x7f30a806ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56852/0 (socket says 172.21.15.144:56852) 2024-09-11T23:19:02.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.633+0000 7f30ad400640 1 -- 172.21.15.144:0/1387832070 learned_addr learned my addr 172.21.15.144:0/1387832070 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:02.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.633+0000 7f30aca00640 1 -- 172.21.15.144:0/1387832070 >> v2:172.21.15.165:3300/0 conn(0x7f30a815f9f0 msgr2=0x7f30a80ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:02.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.633+0000 7f30aca00640 1 --2- 172.21.15.144:0/1387832070 >> v2:172.21.15.165:3300/0 conn(0x7f30a815f9f0 0x7f30a80ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.633+0000 7f30aca00640 1 -- 172.21.15.144:0/1387832070 >> v1:172.21.15.144:6789/0 conn(0x7f30a815b370 legacy=0x7f30a806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:02.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.633+0000 7f30a7e00640 1 -- 172.21.15.144:0/1387832070 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1111208597 0 0) 0x7f30a815c970 con 0x7f30a815b370 2024-09-11T23:19:02.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.633+0000 7f30aca00640 1 -- 172.21.15.144:0/1387832070 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a815be90 con 0x7f30a806f130 2024-09-11T23:19:02.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.634+0000 7f30aca00640 1 --2- 172.21.15.144:0/1387832070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30a806f130 0x7f30a8072560 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f30a80cce80 tx=0x7f309402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8591403d6fde5ed4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:02.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.635+0000 7f30a7e00640 1 -- 172.21.15.144:0/1387832070 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3094037070 con 0x7f30a806f130 2024-09-11T23:19:02.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.635+0000 7f30a7e00640 1 -- 172.21.15.144:0/1387832070 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3094032440 con 0x7f30a806f130 2024-09-11T23:19:02.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.635+0000 7f30a7e00640 1 -- 172.21.15.144:0/1387832070 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309402ae60 con 0x7f30a806f130 2024-09-11T23:19:02.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.635+0000 7f30afe00640 1 -- 172.21.15.144:0/1387832070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30a806f130 msgr2=0x7f30a8072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:02.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.635+0000 7f30afe00640 1 --2- 172.21.15.144:0/1387832070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30a806f130 0x7f30a8072560 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f30a80cce80 tx=0x7f309402a110 comp rx=0 tx=0).stop 2024-09-11T23:19:02.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.635+0000 7f30afe00640 1 -- 172.21.15.144:0/1387832070 shutdown_connections 2024-09-11T23:19:02.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.635+0000 7f30afe00640 1 --2- 172.21.15.144:0/1387832070 >> v2:172.21.15.165:3300/0 conn(0x7f30a815f9f0 0x7f30a80ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.635+0000 7f30afe00640 1 --2- 172.21.15.144:0/1387832070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30a806f130 0x7f30a8072560 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.635+0000 7f30afe00640 1 -- 172.21.15.144:0/1387832070 >> 172.21.15.144:0/1387832070 conn(0x7f30a806bba0 msgr2=0x7f30a806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:02.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.635+0000 7f30afe00640 1 -- 172.21.15.144:0/1387832070 shutdown_connections 2024-09-11T23:19:02.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.635+0000 7f30afe00640 1 -- 172.21.15.144:0/1387832070 wait complete. 2024-09-11T23:19:02.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.637+0000 7f30afe00640 1 Processor -- start 2024-09-11T23:19:02.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.637+0000 7f30afe00640 1 -- start start 2024-09-11T23:19:02.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.638+0000 7f30afe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30a806f130 0x7f30a815a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.638+0000 7f30afe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30a815b370 0x7f30a81f75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.638+0000 7f30afe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30a815f9f0 0x7f30a8159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.638+0000 7f30afe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f30a80731b0 con 0x7f30a806f130 2024-09-11T23:19:02.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.638+0000 7f30afe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f30a815c450 con 0x7f30a815b370 2024-09-11T23:19:02.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.638+0000 7f30afe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f30a815b750 con 0x7f30a815f9f0 2024-09-11T23:19:02.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.638+0000 7f30ad400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30a806f130 0x7f30a815a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:02.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.638+0000 7f30ad400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30a806f130 0x7f30a815a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37556/0 (socket says 172.21.15.144:37556) 2024-09-11T23:19:02.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.638+0000 7f30ad400640 1 -- 172.21.15.144:0/1394456884 learned_addr learned my addr 172.21.15.144:0/1394456884 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:02.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.638+0000 7f30aca00640 1 --2- 172.21.15.144:0/1394456884 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30a815b370 0x7f30a81f75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:02.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.638+0000 7f30ade00640 1 --2- 172.21.15.144:0/1394456884 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30a815f9f0 0x7f30a8159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:02.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.639+0000 7f30ad400640 1 -- 172.21.15.144:0/1394456884 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30a815f9f0 msgr2=0x7f30a8159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:02.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.639+0000 7f30ad400640 1 --2- 172.21.15.144:0/1394456884 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30a815f9f0 0x7f30a8159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.639+0000 7f30ad400640 1 -- 172.21.15.144:0/1394456884 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30a815b370 msgr2=0x7f30a81f75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:02.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.639+0000 7f30ad400640 1 --2- 172.21.15.144:0/1394456884 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30a815b370 0x7f30a81f75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:02.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.639+0000 7f30ad400640 1 -- 172.21.15.144:0/1394456884 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a80b4120 con 0x7f30a806f130 2024-09-11T23:19:02.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.639+0000 7f30ad400640 1 --2- 172.21.15.144:0/1394456884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30a806f130 0x7f30a815a6d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f309c00c890 tx=0x7f309c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:02.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.639+0000 7f30a5600640 1 -- 172.21.15.144:0/1394456884 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c018070 con 0x7f30a806f130 2024-09-11T23:19:02.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.639+0000 7f30a5600640 1 -- 172.21.15.144:0/1394456884 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c00a640 con 0x7f30a806f130 2024-09-11T23:19:02.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.639+0000 7f30afe00640 1 -- 172.21.15.144:0/1394456884 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a8153ec0 con 0x7f30a806f130 2024-09-11T23:19:02.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.639+0000 7f30a5600640 1 -- 172.21.15.144:0/1394456884 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c00aa30 con 0x7f30a806f130 2024-09-11T23:19:02.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.639+0000 7f30afe00640 1 -- 172.21.15.144:0/1394456884 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a8153be0 con 0x7f30a806f130 2024-09-11T23:19:02.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.640+0000 7f30afe00640 1 -- 172.21.15.144:0/1394456884 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a8072560 con 0x7f30a806f130 2024-09-11T23:19:02.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.642+0000 7f30a5600640 1 -- 172.21.15.144:0/1394456884 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f309c01b070 con 0x7f30a806f130 2024-09-11T23:19:02.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.642+0000 7f30a5600640 1 --2- 172.21.15.144:0/1394456884 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f308806be30 0x7f308806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:02.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.643+0000 7f30a5600640 1 -- 172.21.15.144:0/1394456884 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f309c08a470 con 0x7f30a806f130 2024-09-11T23:19:02.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.643+0000 7f30aca00640 1 --2- 172.21.15.144:0/1394456884 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f308806be30 0x7f308806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:02.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.643+0000 7f30aca00640 1 --2- 172.21.15.144:0/1394456884 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f308806be30 0x7f308806e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3094034000 tx=0x7f309402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:02.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.647+0000 7f30a5600640 1 -- 172.21.15.144:0/1394456884 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f309c0587c0 con 0x7f30a806f130 2024-09-11T23:19:02.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:02.855+0000 7f30afe00640 1 -- 172.21.15.144:0/1394456884 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f30a80af390 con 0x7f30a806f130 2024-09-11T23:19:03.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.243+0000 7f30a5600640 1 -- 172.21.15.144:0/1394456884 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) ==== 136+0+0 (secure 0 0 0) 0x7f309c05cac0 con 0x7f30a806f130 2024-09-11T23:19:03.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.245+0000 7f30afe00640 1 -- 172.21.15.144:0/1394456884 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f308806be30 msgr2=0x7f308806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:03.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.245+0000 7f30afe00640 1 --2- 172.21.15.144:0/1394456884 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f308806be30 0x7f308806e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3094034000 tx=0x7f309402e000 comp rx=0 tx=0).stop 2024-09-11T23:19:03.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.245+0000 7f30afe00640 1 -- 172.21.15.144:0/1394456884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30a806f130 msgr2=0x7f30a815a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:03.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.245+0000 7f30afe00640 1 --2- 172.21.15.144:0/1394456884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30a806f130 0x7f30a815a6d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f309c00c890 tx=0x7f309c00cd50 comp rx=0 tx=0).stop 2024-09-11T23:19:03.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.245+0000 7f30afe00640 1 -- 172.21.15.144:0/1394456884 shutdown_connections 2024-09-11T23:19:03.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.245+0000 7f30afe00640 1 --2- 172.21.15.144:0/1394456884 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f308806be30 0x7f308806e2f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.245+0000 7f30afe00640 1 --2- 172.21.15.144:0/1394456884 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30a815f9f0 0x7f30a8159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.245+0000 7f30afe00640 1 --2- 172.21.15.144:0/1394456884 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30a815b370 0x7f30a81f75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.245+0000 7f30afe00640 1 --2- 172.21.15.144:0/1394456884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30a806f130 0x7f30a815a6d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.245+0000 7f30afe00640 1 -- 172.21.15.144:0/1394456884 >> 172.21.15.144:0/1394456884 conn(0x7f30a806bba0 msgr2=0x7f30a80b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:03.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.245+0000 7f30afe00640 1 -- 172.21.15.144:0/1394456884 shutdown_connections 2024-09-11T23:19:03.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.245+0000 7f30afe00640 1 -- 172.21.15.144:0/1394456884 wait complete. 2024-09-11T23:19:03.264 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-11T23:19:03.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.417+0000 7fd599800640 1 Processor -- start 2024-09-11T23:19:03.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.417+0000 7fd599800640 1 -- start start 2024-09-11T23:19:03.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.418+0000 7fd599800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd59415ca40 0x7fd59415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:03.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.418+0000 7fd599800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd59415d390 con 0x7fd59415ceb0 2024-09-11T23:19:03.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.418+0000 7fd599800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd59415d670 con 0x7fd5940d02a0 2024-09-11T23:19:03.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.418+0000 7fd599800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd59415d950 con 0x7fd59415ca40 2024-09-11T23:19:03.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.419+0000 7fd593400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd59415ceb0 0x7fd5941594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56858/0 (socket says 172.21.15.144:56858) 2024-09-11T23:19:03.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.419+0000 7fd593400640 1 -- 172.21.15.144:0/3878152277 learned_addr learned my addr 172.21.15.144:0/3878152277 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:03.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.419+0000 7fd58a000640 1 --2- 172.21.15.144:0/3878152277 >> v2:172.21.15.165:3300/0 conn(0x7fd59415ca40 0x7fd59415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:03.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.419+0000 7fd592000640 1 -- 172.21.15.144:0/3878152277 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 772697523 0 0) 0x7fd59415d390 con 0x7fd59415ceb0 2024-09-11T23:19:03.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.419+0000 7fd592000640 1 -- 172.21.15.144:0/3878152277 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd578005730 con 0x7fd59415ceb0 2024-09-11T23:19:03.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.419+0000 7fd58a000640 1 -- 172.21.15.144:0/3878152277 >> v1:172.21.15.165:6789/0 conn(0x7fd5940d02a0 legacy=0x7fd5940d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:03.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.419+0000 7fd58a000640 1 -- 172.21.15.144:0/3878152277 >> v1:172.21.15.144:6789/0 conn(0x7fd59415ceb0 legacy=0x7fd5941594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:03.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.419+0000 7fd58a000640 1 -- 172.21.15.144:0/3878152277 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59415dc30 con 0x7fd59415ca40 2024-09-11T23:19:03.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.420+0000 7fd58a000640 1 --2- 172.21.15.144:0/3878152277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd59415ca40 0x7fd59415e430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0097a0 tx=0x7fd57c02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a28df6e9a27d694 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:03.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.421+0000 7fd592000640 1 -- 172.21.15.144:0/3878152277 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c037070 con 0x7fd59415ca40 2024-09-11T23:19:03.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.421+0000 7fd592000640 1 -- 172.21.15.144:0/3878152277 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd57c032440 con 0x7fd59415ca40 2024-09-11T23:19:03.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.421+0000 7fd592000640 1 -- 172.21.15.144:0/3878152277 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c032810 con 0x7fd59415ca40 2024-09-11T23:19:03.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.421+0000 7fd599800640 1 -- 172.21.15.144:0/3878152277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd59415ca40 msgr2=0x7fd59415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:03.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.421+0000 7fd599800640 1 --2- 172.21.15.144:0/3878152277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd59415ca40 0x7fd59415e430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0097a0 tx=0x7fd57c02a1a0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.421+0000 7fd599800640 1 -- 172.21.15.144:0/3878152277 shutdown_connections 2024-09-11T23:19:03.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.421+0000 7fd599800640 1 --2- 172.21.15.144:0/3878152277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd59415ca40 0x7fd59415e430 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.421+0000 7fd599800640 1 -- 172.21.15.144:0/3878152277 >> 172.21.15.144:0/3878152277 conn(0x7fd594062cc0 msgr2=0x7fd59406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:03.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.421+0000 7fd599800640 1 -- 172.21.15.144:0/3878152277 shutdown_connections 2024-09-11T23:19:03.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.421+0000 7fd599800640 1 -- 172.21.15.144:0/3878152277 wait complete. 2024-09-11T23:19:03.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.423+0000 7fd599800640 1 Processor -- start 2024-09-11T23:19:03.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.423+0000 7fd599800640 1 -- start start 2024-09-11T23:19:03.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.424+0000 7fd599800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5940d02a0 0x7fd59414aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:03.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.424+0000 7fd599800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd59415ca40 0x7fd5940738c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:03.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.424+0000 7fd599800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd59415ceb0 0x7fd59414d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:03.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.424+0000 7fd599800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd594155d10 con 0x7fd5940d02a0 2024-09-11T23:19:03.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.424+0000 7fd599800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd594155b90 con 0x7fd59415ca40 2024-09-11T23:19:03.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.424+0000 7fd599800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd5940b4790 con 0x7fd59415ceb0 2024-09-11T23:19:03.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.424+0000 7fd592a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5940d02a0 0x7fd59414aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:03.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.424+0000 7fd592a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5940d02a0 0x7fd59414aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37568/0 (socket says 172.21.15.144:37568) 2024-09-11T23:19:03.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.424+0000 7fd592a00640 1 -- 172.21.15.144:0/2191644599 learned_addr learned my addr 172.21.15.144:0/2191644599 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:03.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.424+0000 7fd58a000640 1 --2- 172.21.15.144:0/2191644599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd59415ca40 0x7fd5940738c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:03.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.424+0000 7fd593400640 1 --2- 172.21.15.144:0/2191644599 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd59415ceb0 0x7fd59414d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.425+0000 7fd592a00640 1 -- 172.21.15.144:0/2191644599 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd59415ceb0 msgr2=0x7fd59414d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.425+0000 7fd592a00640 1 --2- 172.21.15.144:0/2191644599 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd59415ceb0 0x7fd59414d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.425+0000 7fd592a00640 1 -- 172.21.15.144:0/2191644599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd59415ca40 msgr2=0x7fd5940738c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.425+0000 7fd592a00640 1 --2- 172.21.15.144:0/2191644599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd59415ca40 0x7fd5940738c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.425+0000 7fd592a00640 1 -- 172.21.15.144:0/2191644599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5941f5080 con 0x7fd5940d02a0 2024-09-11T23:19:03.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.425+0000 7fd592a00640 1 --2- 172.21.15.144:0/2191644599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5940d02a0 0x7fd59414aea0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd58400c400 tx=0x7fd58400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:03.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.425+0000 7fd58b400640 1 -- 172.21.15.144:0/2191644599 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5840052d0 con 0x7fd5940d02a0 2024-09-11T23:19:03.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.425+0000 7fd58b400640 1 -- 172.21.15.144:0/2191644599 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd584005490 con 0x7fd5940d02a0 2024-09-11T23:19:03.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.425+0000 7fd58b400640 1 -- 172.21.15.144:0/2191644599 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd584007260 con 0x7fd5940d02a0 2024-09-11T23:19:03.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.425+0000 7fd599800640 1 -- 172.21.15.144:0/2191644599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd594072b00 con 0x7fd5940d02a0 2024-09-11T23:19:03.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.425+0000 7fd599800640 1 -- 172.21.15.144:0/2191644599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5940730c0 con 0x7fd5940d02a0 2024-09-11T23:19:03.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.426+0000 7fd599800640 1 -- 172.21.15.144:0/2191644599 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5940d0680 con 0x7fd5940d02a0 2024-09-11T23:19:03.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.427+0000 7fd58b400640 1 -- 172.21.15.144:0/2191644599 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd584007400 con 0x7fd5940d02a0 2024-09-11T23:19:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.428+0000 7fd58b400640 1 --2- 172.21.15.144:0/2191644599 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd57006be30 0x7fd57006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.428+0000 7fd58b400640 1 -- 172.21.15.144:0/2191644599 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd58408a300 con 0x7fd5940d02a0 2024-09-11T23:19:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.429+0000 7fd58a000640 1 --2- 172.21.15.144:0/2191644599 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd57006be30 0x7fd57006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:03.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.429+0000 7fd58a000640 1 --2- 172.21.15.144:0/2191644599 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd57006be30 0x7fd57006e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd57c034000 tx=0x7fd57c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:03.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.433+0000 7fd58b400640 1 -- 172.21.15.144:0/2191644599 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd584058650 con 0x7fd5940d02a0 2024-09-11T23:19:03.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.631+0000 7fd599800640 1 -- 172.21.15.144:0/2191644599 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fd5940d09c0 con 0x7fd57006be30 2024-09-11T23:19:03.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.632+0000 7fd58b400640 1 -- 172.21.15.144:0/2191644599 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fd5940d09c0 con 0x7fd57006be30 2024-09-11T23:19:03.633 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:19:03.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:03.633 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephfs" 2024-09-11T23:19:03.634 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:03.634 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:19:03.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.634+0000 7fd599800640 1 -- 172.21.15.144:0/2191644599 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd57006be30 msgr2=0x7fd57006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:03.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.634+0000 7fd599800640 1 --2- 172.21.15.144:0/2191644599 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd57006be30 0x7fd57006e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd57c034000 tx=0x7fd57c02e000 comp rx=0 tx=0).stop 2024-09-11T23:19:03.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.634+0000 7fd599800640 1 -- 172.21.15.144:0/2191644599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5940d02a0 msgr2=0x7fd59414aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:03.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.634+0000 7fd599800640 1 --2- 172.21.15.144:0/2191644599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5940d02a0 0x7fd59414aea0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd58400c400 tx=0x7fd58400c8c0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.635+0000 7fd599800640 1 -- 172.21.15.144:0/2191644599 shutdown_connections 2024-09-11T23:19:03.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.635+0000 7fd599800640 1 --2- 172.21.15.144:0/2191644599 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd57006be30 0x7fd57006e2f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.635+0000 7fd599800640 1 --2- 172.21.15.144:0/2191644599 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd59415ceb0 0x7fd59414d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.635+0000 7fd599800640 1 --2- 172.21.15.144:0/2191644599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd59415ca40 0x7fd5940738c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.635+0000 7fd599800640 1 --2- 172.21.15.144:0/2191644599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5940d02a0 0x7fd59414aea0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.635+0000 7fd599800640 1 -- 172.21.15.144:0/2191644599 >> 172.21.15.144:0/2191644599 conn(0x7fd594062cc0 msgr2=0x7fd59406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:03.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.635+0000 7fd599800640 1 -- 172.21.15.144:0/2191644599 shutdown_connections 2024-09-11T23:19:03.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.635+0000 7fd599800640 1 -- 172.21.15.144:0/2191644599 wait complete. 2024-09-11T23:19:03.652 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:19:03.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.808+0000 7fd8c8200640 1 Processor -- start 2024-09-11T23:19:03.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.808+0000 7fd8c8200640 1 -- start start 2024-09-11T23:19:03.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.809+0000 7fd8c8200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c015d3b0 0x7fd8c0071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:03.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.809+0000 7fd8c8200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd8c015d790 0x7fd8c00cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:03.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.809+0000 7fd8c8200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8c00715c0 con 0x7fd8c00cd3b0 2024-09-11T23:19:03.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.809+0000 7fd8c8200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd8c006da30 con 0x7fd8c015d790 2024-09-11T23:19:03.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.809+0000 7fd8c8200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c006d700 con 0x7fd8c015d3b0 2024-09-11T23:19:03.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.810+0000 7fd8c4e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd8c015d790 0x7fd8c00cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:03.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.810+0000 7fd8c4e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd8c015d790 0x7fd8c00cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37582/0 (socket says 172.21.15.144:37582) 2024-09-11T23:19:03.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.810+0000 7fd8c4e00640 1 -- 172.21.15.144:0/1958740411 learned_addr learned my addr 172.21.15.144:0/1958740411 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:03.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.810+0000 7fd8c5800640 1 --2- 172.21.15.144:0/1958740411 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c015d3b0 0x7fd8c0071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:03.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.810+0000 7fd8c4e00640 1 -- 172.21.15.144:0/1958740411 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c015d3b0 msgr2=0x7fd8c0071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:03.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.810+0000 7fd8c4e00640 1 --2- 172.21.15.144:0/1958740411 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c015d3b0 0x7fd8c0071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.810+0000 7fd8c4e00640 1 -- 172.21.15.144:0/1958740411 >> v1:172.21.15.165:6789/0 conn(0x7fd8c00cd3b0 legacy=0x7fd8c00cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:03.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.810+0000 7fd8c4e00640 1 -- 172.21.15.144:0/1958740411 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c00cde80 con 0x7fd8c015d790 2024-09-11T23:19:03.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.810+0000 7fd8c5800640 1 --2- 172.21.15.144:0/1958740411 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c015d3b0 0x7fd8c0071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:03.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.811+0000 7fd8c4e00640 1 --2- 172.21.15.144:0/1958740411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c015d790 0x7fd8c00cce70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac009850 tx=0x7fd8ac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07e18406ade7450 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:03.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.811+0000 7fd8bfe00640 1 -- 172.21.15.144:0/1958740411 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac004030 con 0x7fd8c015d790 2024-09-11T23:19:03.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.811+0000 7fd8bfe00640 1 -- 172.21.15.144:0/1958740411 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8ac0041d0 con 0x7fd8c015d790 2024-09-11T23:19:03.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.811+0000 7fd8bfe00640 1 -- 172.21.15.144:0/1958740411 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac003610 con 0x7fd8c015d790 2024-09-11T23:19:03.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.812+0000 7fd8c8200640 1 -- 172.21.15.144:0/1958740411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c015d790 msgr2=0x7fd8c00cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:03.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.812+0000 7fd8c8200640 1 --2- 172.21.15.144:0/1958740411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c015d790 0x7fd8c00cce70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac009850 tx=0x7fd8ac02a1e0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.812+0000 7fd8c8200640 1 -- 172.21.15.144:0/1958740411 shutdown_connections 2024-09-11T23:19:03.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.812+0000 7fd8c8200640 1 --2- 172.21.15.144:0/1958740411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c015d790 0x7fd8c00cce70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.812+0000 7fd8c8200640 1 --2- 172.21.15.144:0/1958740411 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c015d3b0 0x7fd8c0071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.812+0000 7fd8c8200640 1 -- 172.21.15.144:0/1958740411 >> 172.21.15.144:0/1958740411 conn(0x7fd8c006bba0 msgr2=0x7fd8c006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:03.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.812+0000 7fd8c8200640 1 -- 172.21.15.144:0/1958740411 shutdown_connections 2024-09-11T23:19:03.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.812+0000 7fd8c8200640 1 -- 172.21.15.144:0/1958740411 wait complete. 2024-09-11T23:19:03.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.814+0000 7fd8c8200640 1 Processor -- start 2024-09-11T23:19:03.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.814+0000 7fd8c8200640 1 -- start start 2024-09-11T23:19:03.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.815+0000 7fd8c8200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8c00cd3b0 0x7fd8c01f1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:03.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.815+0000 7fd8c8200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c015d3b0 0x7fd8c014edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:03.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.815+0000 7fd8c8200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c014d160 0x7fd8c014f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:03.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.815+0000 7fd8c8200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c015cbf0 con 0x7fd8c014d160 2024-09-11T23:19:03.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.815+0000 7fd8c8200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c00cdba0 con 0x7fd8c00cd3b0 2024-09-11T23:19:03.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.815+0000 7fd8c8200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c015cd70 con 0x7fd8c015d3b0 2024-09-11T23:19:03.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.815+0000 7fd8c6200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c014d160 0x7fd8c014f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:03.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.815+0000 7fd8c6200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c014d160 0x7fd8c014f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37592/0 (socket says 172.21.15.144:37592) 2024-09-11T23:19:03.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.815+0000 7fd8c6200640 1 -- 172.21.15.144:0/1276639278 learned_addr learned my addr 172.21.15.144:0/1276639278 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:03.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.815+0000 7fd8c5800640 1 --2- 172.21.15.144:0/1276639278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8c00cd3b0 0x7fd8c01f1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:03.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.815+0000 7fd8c4e00640 1 --2- 172.21.15.144:0/1276639278 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c015d3b0 0x7fd8c014edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:03.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.815+0000 7fd8c6200640 1 -- 172.21.15.144:0/1276639278 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c015d3b0 msgr2=0x7fd8c014edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:03.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.815+0000 7fd8c6200640 1 --2- 172.21.15.144:0/1276639278 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c015d3b0 0x7fd8c014edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.815+0000 7fd8c6200640 1 -- 172.21.15.144:0/1276639278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8c00cd3b0 msgr2=0x7fd8c01f1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:03.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.815+0000 7fd8c6200640 1 --2- 172.21.15.144:0/1276639278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8c00cd3b0 0x7fd8c01f1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:03.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.815+0000 7fd8c6200640 1 -- 172.21.15.144:0/1276639278 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c00cc730 con 0x7fd8c014d160 2024-09-11T23:19:03.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.815+0000 7fd8c5800640 1 --2- 172.21.15.144:0/1276639278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8c00cd3b0 0x7fd8c01f1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:03.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.815+0000 7fd8c4e00640 1 --2- 172.21.15.144:0/1276639278 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c015d3b0 0x7fd8c014edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:03.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.816+0000 7fd8c6200640 1 --2- 172.21.15.144:0/1276639278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c014d160 0x7fd8c014f330 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800c780 tx=0x7fd8b800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:03.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.816+0000 7fd8bd600640 1 -- 172.21.15.144:0/1276639278 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8004b60 con 0x7fd8c014d160 2024-09-11T23:19:03.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.816+0000 7fd8bd600640 1 -- 172.21.15.144:0/1276639278 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b8004d00 con 0x7fd8c014d160 2024-09-11T23:19:03.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.816+0000 7fd8bd600640 1 -- 172.21.15.144:0/1276639278 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b800aa90 con 0x7fd8c014d160 2024-09-11T23:19:03.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.816+0000 7fd8c8200640 1 -- 172.21.15.144:0/1276639278 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c014d820 con 0x7fd8c014d160 2024-09-11T23:19:03.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.816+0000 7fd8c8200640 1 -- 172.21.15.144:0/1276639278 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c0154eb0 con 0x7fd8c014d160 2024-09-11T23:19:03.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.817+0000 7fd8c8200640 1 -- 172.21.15.144:0/1276639278 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8c00cfba0 con 0x7fd8c014d160 2024-09-11T23:19:03.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.818+0000 7fd8bd600640 1 -- 172.21.15.144:0/1276639278 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8b800ac30 con 0x7fd8c014d160 2024-09-11T23:19:03.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.819+0000 7fd8bd600640 1 --2- 172.21.15.144:0/1276639278 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd8a006be30 0x7fd8a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:03.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.819+0000 7fd8bd600640 1 -- 172.21.15.144:0/1276639278 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd8b808b120 con 0x7fd8c014d160 2024-09-11T23:19:03.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.819+0000 7fd8c5800640 1 --2- 172.21.15.144:0/1276639278 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd8a006be30 0x7fd8a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:03.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.820+0000 7fd8c5800640 1 --2- 172.21.15.144:0/1276639278 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd8a006be30 0x7fd8a006e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00cd000 tx=0x7fd8b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:03.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:03.823+0000 7fd8bd600640 1 -- 172.21.15.144:0/1276639278 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd8b8020070 con 0x7fd8c014d160 2024-09-11T23:19:04.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.000+0000 7fd8c8200640 1 -- 172.21.15.144:0/1276639278 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd8c014d5d0 con 0x7fd8c014d160 2024-09-11T23:19:04.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.001+0000 7fd8bd600640 1 -- 172.21.15.144:0/1276639278 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fd8b8059ad0 con 0x7fd8c014d160 2024-09-11T23:19:04.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.003+0000 7fd8c8200640 1 -- 172.21.15.144:0/1276639278 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd8a006be30 msgr2=0x7fd8a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.003+0000 7fd8c8200640 1 --2- 172.21.15.144:0/1276639278 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd8a006be30 0x7fd8a006e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00cd000 tx=0x7fd8b4008040 comp rx=0 tx=0).stop 2024-09-11T23:19:04.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.003+0000 7fd8c8200640 1 -- 172.21.15.144:0/1276639278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c014d160 msgr2=0x7fd8c014f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.003+0000 7fd8c8200640 1 --2- 172.21.15.144:0/1276639278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c014d160 0x7fd8c014f330 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800c780 tx=0x7fd8b800cc40 comp rx=0 tx=0).stop 2024-09-11T23:19:04.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.003+0000 7fd8c8200640 1 -- 172.21.15.144:0/1276639278 shutdown_connections 2024-09-11T23:19:04.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.003+0000 7fd8c8200640 1 --2- 172.21.15.144:0/1276639278 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd8a006be30 0x7fd8a006e2f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.003+0000 7fd8c8200640 1 --2- 172.21.15.144:0/1276639278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8c014d160 0x7fd8c014f330 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.003+0000 7fd8c8200640 1 --2- 172.21.15.144:0/1276639278 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8c015d3b0 0x7fd8c014edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.003+0000 7fd8c8200640 1 --2- 172.21.15.144:0/1276639278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8c00cd3b0 0x7fd8c01f1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.003+0000 7fd8c8200640 1 -- 172.21.15.144:0/1276639278 >> 172.21.15.144:0/1276639278 conn(0x7fd8c006bba0 msgr2=0x7fd8c006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:04.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.004+0000 7fd8c8200640 1 -- 172.21.15.144:0/1276639278 shutdown_connections 2024-09-11T23:19:04.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.004+0000 7fd8c8200640 1 -- 172.21.15.144:0/1276639278 wait complete. 2024-09-11T23:19:04.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:04.021 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp42250/subvol95610) 2024-09-11T23:19:04.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:04.086 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-11T23:19:04.123 INFO:teuthology.orchestra.run.smithi144.stdout:cephfs_data 2024-09-11T23:19:04.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:04.123 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/subvol_grp42250/subvol95610) 2024-09-11T23:19:04.234 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:19:04.234 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/mnt.0/./volumes/subvol_grp42250/subvol95610/.meta 2024-09-11T23:19:04.296 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol95610 subvol_grp42250 2024-09-11T23:19:04.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.494+0000 7ff8c1c00640 1 Processor -- start 2024-09-11T23:19:04.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.494+0000 7ff8c1c00640 1 -- start start 2024-09-11T23:19:04.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.495+0000 7ff8c1c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc15b370 0x7ff8bc072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.496+0000 7ff8c1c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff8bc15f9f0 0x7ff8bc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.496+0000 7ff8c1c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff8bc06ef60 0x7ff8bc071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.496+0000 7ff8c1c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff8bc15fef0 con 0x7ff8bc15f9f0 2024-09-11T23:19:04.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.496+0000 7ff8c1c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff8bc15c970 con 0x7ff8bc06ef60 2024-09-11T23:19:04.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.496+0000 7ff8c1c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff8bc15bbb0 con 0x7ff8bc15b370 2024-09-11T23:19:04.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.496+0000 7ff8b2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff8bc15f9f0 0x7ff8bc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.496+0000 7ff8b2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff8bc15f9f0 0x7ff8bc06ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33036/0 (socket says 172.21.15.144:33036) 2024-09-11T23:19:04.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.496+0000 7ff8b2000640 1 -- 172.21.15.144:0/2125220289 learned_addr learned my addr 172.21.15.144:0/2125220289 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:04.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.496+0000 7ff8bb400640 1 --2- 172.21.15.144:0/2125220289 >> v2:172.21.15.165:3300/0 conn(0x7ff8bc06ef60 0x7ff8bc071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.496+0000 7ff8baa00640 1 --2- 172.21.15.144:0/2125220289 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc15b370 0x7ff8bc072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.496+0000 7ff8b2000640 1 -- 172.21.15.144:0/2125220289 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc15b370 msgr2=0x7ff8bc072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:04.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.496+0000 7ff8b2000640 1 --2- 172.21.15.144:0/2125220289 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc15b370 0x7ff8bc072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.496+0000 7ff8b2000640 1 -- 172.21.15.144:0/2125220289 >> v2:172.21.15.165:3300/0 conn(0x7ff8bc06ef60 msgr2=0x7ff8bc071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:04.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.496+0000 7ff8b2000640 1 --2- 172.21.15.144:0/2125220289 >> v2:172.21.15.165:3300/0 conn(0x7ff8bc06ef60 0x7ff8bc071040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.496+0000 7ff8b2000640 1 -- 172.21.15.144:0/2125220289 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8bc15be90 con 0x7ff8bc15f9f0 2024-09-11T23:19:04.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.497+0000 7ff8b2000640 1 --2- 172.21.15.144:0/2125220289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8bc15f9f0 0x7ff8bc06ea20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc070fd0 tx=0x7ff8a402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d627d3c8c8e67f43 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:04.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.498+0000 7ff8ba000640 1 -- 172.21.15.144:0/2125220289 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4037070 con 0x7ff8bc15f9f0 2024-09-11T23:19:04.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.498+0000 7ff8ba000640 1 -- 172.21.15.144:0/2125220289 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8a4032440 con 0x7ff8bc15f9f0 2024-09-11T23:19:04.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.498+0000 7ff8ba000640 1 -- 172.21.15.144:0/2125220289 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4032810 con 0x7ff8bc15f9f0 2024-09-11T23:19:04.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.498+0000 7ff8c1c00640 1 -- 172.21.15.144:0/2125220289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8bc15f9f0 msgr2=0x7ff8bc06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.498+0000 7ff8c1c00640 1 --2- 172.21.15.144:0/2125220289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8bc15f9f0 0x7ff8bc06ea20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc070fd0 tx=0x7ff8a402a140 comp rx=0 tx=0).stop 2024-09-11T23:19:04.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.498+0000 7ff8c1c00640 1 -- 172.21.15.144:0/2125220289 shutdown_connections 2024-09-11T23:19:04.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.498+0000 7ff8c1c00640 1 --2- 172.21.15.144:0/2125220289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8bc15f9f0 0x7ff8bc06ea20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.498+0000 7ff8c1c00640 1 --2- 172.21.15.144:0/2125220289 >> v2:172.21.15.165:3300/0 conn(0x7ff8bc06ef60 0x7ff8bc071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.498+0000 7ff8c1c00640 1 --2- 172.21.15.144:0/2125220289 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc15b370 0x7ff8bc072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.498+0000 7ff8c1c00640 1 -- 172.21.15.144:0/2125220289 >> 172.21.15.144:0/2125220289 conn(0x7ff8bc06bba0 msgr2=0x7ff8bc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:04.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.498+0000 7ff8c1c00640 1 -- 172.21.15.144:0/2125220289 shutdown_connections 2024-09-11T23:19:04.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.498+0000 7ff8c1c00640 1 -- 172.21.15.144:0/2125220289 wait complete. 2024-09-11T23:19:04.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.500+0000 7ff8c1c00640 1 Processor -- start 2024-09-11T23:19:04.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.500+0000 7ff8c1c00640 1 -- start start 2024-09-11T23:19:04.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.501+0000 7ff8c1c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8bc06ef60 0x7ff8bc1556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.501+0000 7ff8c1c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8bc15b370 0x7ff8bc1538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.501+0000 7ff8c1c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc15f9f0 0x7ff8bc14bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.501+0000 7ff8c1c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc0731b0 con 0x7ff8bc06ef60 2024-09-11T23:19:04.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.501+0000 7ff8c1c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc15c450 con 0x7ff8bc15b370 2024-09-11T23:19:04.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.501+0000 7ff8c1c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff8bc15b750 con 0x7ff8bc15f9f0 2024-09-11T23:19:04.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.501+0000 7ff8baa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8bc06ef60 0x7ff8bc1556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.501+0000 7ff8baa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8bc06ef60 0x7ff8bc1556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33052/0 (socket says 172.21.15.144:33052) 2024-09-11T23:19:04.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.501+0000 7ff8baa00640 1 -- 172.21.15.144:0/2008218281 learned_addr learned my addr 172.21.15.144:0/2008218281 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:04.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.501+0000 7ff8bb400640 1 --2- 172.21.15.144:0/2008218281 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc15f9f0 0x7ff8bc14bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.501+0000 7ff8b2000640 1 --2- 172.21.15.144:0/2008218281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8bc15b370 0x7ff8bc1538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.502+0000 7ff8baa00640 1 -- 172.21.15.144:0/2008218281 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc15f9f0 msgr2=0x7ff8bc14bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.502+0000 7ff8baa00640 1 --2- 172.21.15.144:0/2008218281 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc15f9f0 0x7ff8bc14bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.502+0000 7ff8baa00640 1 -- 172.21.15.144:0/2008218281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8bc15b370 msgr2=0x7ff8bc1538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.502+0000 7ff8baa00640 1 --2- 172.21.15.144:0/2008218281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8bc15b370 0x7ff8bc1538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.502+0000 7ff8baa00640 1 -- 172.21.15.144:0/2008218281 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8bc1f53d0 con 0x7ff8bc06ef60 2024-09-11T23:19:04.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.502+0000 7ff8baa00640 1 --2- 172.21.15.144:0/2008218281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8bc06ef60 0x7ff8bc1556f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac00d800 tx=0x7ff8ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:04.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.502+0000 7ff8b3400640 1 -- 172.21.15.144:0/2008218281 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac00b6c0 con 0x7ff8bc06ef60 2024-09-11T23:19:04.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.502+0000 7ff8b3400640 1 -- 172.21.15.144:0/2008218281 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ac019070 con 0x7ff8bc06ef60 2024-09-11T23:19:04.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.502+0000 7ff8b3400640 1 -- 172.21.15.144:0/2008218281 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac00ba80 con 0x7ff8bc06ef60 2024-09-11T23:19:04.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.502+0000 7ff8c1c00640 1 -- 172.21.15.144:0/2008218281 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8bc1f4610 con 0x7ff8bc06ef60 2024-09-11T23:19:04.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.502+0000 7ff8c1c00640 1 -- 172.21.15.144:0/2008218281 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8bc1f4bd0 con 0x7ff8bc06ef60 2024-09-11T23:19:04.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.503+0000 7ff8c1c00640 1 -- 172.21.15.144:0/2008218281 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8bc072560 con 0x7ff8bc06ef60 2024-09-11T23:19:04.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.504+0000 7ff8b3400640 1 -- 172.21.15.144:0/2008218281 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff8ac00bc20 con 0x7ff8bc06ef60 2024-09-11T23:19:04.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.505+0000 7ff8b3400640 1 --2- 172.21.15.144:0/2008218281 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff89806be30 0x7ff89806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.505+0000 7ff8b3400640 1 -- 172.21.15.144:0/2008218281 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff8ac08b280 con 0x7ff8bc06ef60 2024-09-11T23:19:04.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.505+0000 7ff8b2000640 1 --2- 172.21.15.144:0/2008218281 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff89806be30 0x7ff89806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.506+0000 7ff8b2000640 1 --2- 172.21.15.144:0/2008218281 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff89806be30 0x7ff89806e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4034000 tx=0x7ff8a402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:04.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.510+0000 7ff8b3400640 1 -- 172.21.15.144:0/2008218281 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff8ac059540 con 0x7ff8bc06ef60 2024-09-11T23:19:04.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.711+0000 7ff8c1c00640 1 -- 172.21.15.144:0/2008218281 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol95610", "group_name": "subvol_grp42250", "target": ["mon-mgr", ""]}) -- 0x7ff8bc1575a0 con 0x7ff89806be30 2024-09-11T23:19:04.718 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:19:04.717+0000 7f9c68e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:04.718 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:19:04.717+0000 7f9c68e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:04.718 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:19:04.717+0000 7f9c68e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:04.718 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:19:04.717+0000 7f9c68e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:04.718 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:19:04.717+0000 7f9c68e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:04.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.754+0000 7ff8b3400640 1 -- 172.21.15.144:0/2008218281 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff8bc1575a0 con 0x7ff89806be30 2024-09-11T23:19:04.755 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/subvol_grp42250/subvol95610 2024-09-11T23:19:04.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.756+0000 7ff8c1c00640 1 -- 172.21.15.144:0/2008218281 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff89806be30 msgr2=0x7ff89806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.756+0000 7ff8c1c00640 1 --2- 172.21.15.144:0/2008218281 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff89806be30 0x7ff89806e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4034000 tx=0x7ff8a402e000 comp rx=0 tx=0).stop 2024-09-11T23:19:04.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.756+0000 7ff8c1c00640 1 -- 172.21.15.144:0/2008218281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8bc06ef60 msgr2=0x7ff8bc1556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.756+0000 7ff8c1c00640 1 --2- 172.21.15.144:0/2008218281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8bc06ef60 0x7ff8bc1556f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac00d800 tx=0x7ff8ac00dcc0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.757+0000 7ff8c1c00640 1 -- 172.21.15.144:0/2008218281 shutdown_connections 2024-09-11T23:19:04.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.757+0000 7ff8c1c00640 1 --2- 172.21.15.144:0/2008218281 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff89806be30 0x7ff89806e2f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.757+0000 7ff8c1c00640 1 --2- 172.21.15.144:0/2008218281 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff8bc15f9f0 0x7ff8bc14bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.757+0000 7ff8c1c00640 1 --2- 172.21.15.144:0/2008218281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8bc15b370 0x7ff8bc1538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.757+0000 7ff8c1c00640 1 --2- 172.21.15.144:0/2008218281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff8bc06ef60 0x7ff8bc1556f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.757+0000 7ff8c1c00640 1 -- 172.21.15.144:0/2008218281 >> 172.21.15.144:0/2008218281 conn(0x7ff8bc06bba0 msgr2=0x7ff8bc0ceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:04.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.757+0000 7ff8c1c00640 1 -- 172.21.15.144:0/2008218281 shutdown_connections 2024-09-11T23:19:04.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.757+0000 7ff8c1c00640 1 -- 172.21.15.144:0/2008218281 wait complete. 2024-09-11T23:19:04.774 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol95610 subvol_grp42250 2024-09-11T23:19:04.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.929+0000 7f2b69e00640 1 Processor -- start 2024-09-11T23:19:04.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.930+0000 7f2b69e00640 1 -- start start 2024-09-11T23:19:04.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.931+0000 7f2b69e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b64145d90 0x7f2b640ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.931+0000 7f2b69e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2b640cd490 0x7f2b640cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.931+0000 7f2b69e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b640b4240 con 0x7f2b640cfb10 2024-09-11T23:19:04.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.931+0000 7f2b69e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2b6406d080 con 0x7f2b640cd490 2024-09-11T23:19:04.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.931+0000 7f2b69e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2b640b4520 con 0x7f2b64145d90 2024-09-11T23:19:04.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.931+0000 7f2b62000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2b640cd490 0x7f2b640cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.931+0000 7f2b62a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b64145d90 0x7f2b640ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.931+0000 7f2b62000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2b640cd490 0x7f2b640cf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:51466/0 (socket says 172.21.15.144:51466) 2024-09-11T23:19:04.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.931+0000 7f2b62000640 1 -- 172.21.15.144:0/3398873363 learned_addr learned my addr 172.21.15.144:0/3398873363 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:04.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.932+0000 7f2b62a00640 1 -- 172.21.15.144:0/3398873363 >> v2:172.21.15.165:3300/0 conn(0x7f2b640cd490 msgr2=0x7f2b640cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:04.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.932+0000 7f2b62a00640 1 --2- 172.21.15.144:0/3398873363 >> v2:172.21.15.165:3300/0 conn(0x7f2b640cd490 0x7f2b640cf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.932+0000 7f2b62a00640 1 -- 172.21.15.144:0/3398873363 >> v1:172.21.15.165:6789/0 conn(0x7f2b640cfb10 legacy=0x7f2b641601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.932+0000 7f2b62a00640 1 -- 172.21.15.144:0/3398873363 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b640b4800 con 0x7f2b64145d90 2024-09-11T23:19:04.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.932+0000 7f2b62000640 1 --2- 172.21.15.144:0/3398873363 >> v2:172.21.15.165:3300/0 conn(0x7f2b640cd490 0x7f2b640cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:19:04.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.933+0000 7f2b62a00640 1 --2- 172.21.15.144:0/3398873363 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b64145d90 0x7f2b640ccf50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2b540097a0 tx=0x7f2b5402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e64482e41ecc403d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:04.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.933+0000 7f2b61600640 1 -- 172.21.15.144:0/3398873363 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b54037070 con 0x7f2b64145d90 2024-09-11T23:19:04.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.933+0000 7f2b61600640 1 -- 172.21.15.144:0/3398873363 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b54032440 con 0x7f2b64145d90 2024-09-11T23:19:04.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.933+0000 7f2b61600640 1 -- 172.21.15.144:0/3398873363 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b54032810 con 0x7f2b64145d90 2024-09-11T23:19:04.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.934+0000 7f2b69e00640 1 -- 172.21.15.144:0/3398873363 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b64145d90 msgr2=0x7f2b640ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.934+0000 7f2b69e00640 1 --2- 172.21.15.144:0/3398873363 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b64145d90 0x7f2b640ccf50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2b540097a0 tx=0x7f2b5402a180 comp rx=0 tx=0).stop 2024-09-11T23:19:04.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.934+0000 7f2b69e00640 1 -- 172.21.15.144:0/3398873363 shutdown_connections 2024-09-11T23:19:04.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.934+0000 7f2b69e00640 1 --2- 172.21.15.144:0/3398873363 >> v2:172.21.15.165:3300/0 conn(0x7f2b640cd490 0x7f2b640cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.934+0000 7f2b69e00640 1 --2- 172.21.15.144:0/3398873363 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b64145d90 0x7f2b640ccf50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.934+0000 7f2b69e00640 1 -- 172.21.15.144:0/3398873363 >> 172.21.15.144:0/3398873363 conn(0x7f2b6406bba0 msgr2=0x7f2b6406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:04.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.934+0000 7f2b69e00640 1 -- 172.21.15.144:0/3398873363 shutdown_connections 2024-09-11T23:19:04.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.934+0000 7f2b69e00640 1 -- 172.21.15.144:0/3398873363 wait complete. 2024-09-11T23:19:04.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.936+0000 7f2b69e00640 1 Processor -- start 2024-09-11T23:19:04.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.936+0000 7f2b69e00640 1 -- start start 2024-09-11T23:19:04.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.936+0000 7f2b69e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b640cd490 0x7f2b6415f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.936+0000 7f2b69e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b640cfb10 0x7f2b641e6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.936+0000 7f2b69e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b64145d90 0x7f2b64131f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.937+0000 7f2b69e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2b640b5610 con 0x7f2b640cfb10 2024-09-11T23:19:04.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.937+0000 7f2b69e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2b640cffc0 con 0x7f2b64145d90 2024-09-11T23:19:04.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.937+0000 7f2b69e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2b640b5790 con 0x7f2b640cd490 2024-09-11T23:19:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.937+0000 7f2b62000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b640cfb10 0x7f2b641e6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.937+0000 7f2b62000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b640cfb10 0x7f2b641e6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33090/0 (socket says 172.21.15.144:33090) 2024-09-11T23:19:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.937+0000 7f2b62000640 1 -- 172.21.15.144:0/1277027955 learned_addr learned my addr 172.21.15.144:0/1277027955 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.937+0000 7f2b62a00640 1 --2- 172.21.15.144:0/1277027955 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b640cd490 0x7f2b6415f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.937+0000 7f2b63400640 1 --2- 172.21.15.144:0/1277027955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b64145d90 0x7f2b64131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.937+0000 7f2b62000640 1 -- 172.21.15.144:0/1277027955 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b640cd490 msgr2=0x7f2b6415f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.937+0000 7f2b62000640 1 --2- 172.21.15.144:0/1277027955 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b640cd490 0x7f2b6415f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.937+0000 7f2b62000640 1 -- 172.21.15.144:0/1277027955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b64145d90 msgr2=0x7f2b64131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.937+0000 7f2b62000640 1 --2- 172.21.15.144:0/1277027955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b64145d90 0x7f2b64131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.937+0000 7f2b62000640 1 -- 172.21.15.144:0/1277027955 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6412ed80 con 0x7f2b640cfb10 2024-09-11T23:19:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.937+0000 7f2b62000640 1 --2- 172.21.15.144:0/1277027955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b640cfb10 0x7f2b641e6360 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000e900 tx=0x7f2b5000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:04.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.938+0000 7f2b5b400640 1 -- 172.21.15.144:0/1277027955 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b50017070 con 0x7f2b640cfb10 2024-09-11T23:19:04.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.938+0000 7f2b5b400640 1 -- 172.21.15.144:0/1277027955 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b5000c9a0 con 0x7f2b640cfb10 2024-09-11T23:19:04.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.938+0000 7f2b69e00640 1 -- 172.21.15.144:0/1277027955 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b6412f060 con 0x7f2b640cfb10 2024-09-11T23:19:04.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.938+0000 7f2b5b400640 1 -- 172.21.15.144:0/1277027955 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5000cd90 con 0x7f2b640cfb10 2024-09-11T23:19:04.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.938+0000 7f2b69e00640 1 -- 172.21.15.144:0/1277027955 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b6412f620 con 0x7f2b640cfb10 2024-09-11T23:19:04.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.939+0000 7f2b69e00640 1 -- 172.21.15.144:0/1277027955 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b64146200 con 0x7f2b640cfb10 2024-09-11T23:19:04.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.940+0000 7f2b5b400640 1 -- 172.21.15.144:0/1277027955 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b5001a070 con 0x7f2b640cfb10 2024-09-11T23:19:04.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.941+0000 7f2b5b400640 1 --2- 172.21.15.144:0/1277027955 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2b4406be30 0x7f2b4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:04.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.941+0000 7f2b5b400640 1 -- 172.21.15.144:0/1277027955 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2b5008afe0 con 0x7f2b640cfb10 2024-09-11T23:19:04.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.941+0000 7f2b62a00640 1 --2- 172.21.15.144:0/1277027955 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2b4406be30 0x7f2b4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:04.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.942+0000 7f2b62a00640 1 --2- 172.21.15.144:0/1277027955 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2b4406be30 0x7f2b4406e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2b54034000 tx=0x7f2b5402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:04.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:04.945+0000 7f2b5b400640 1 -- 172.21.15.144:0/1277027955 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2b50059300 con 0x7f2b640cfb10 2024-09-11T23:19:05.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.151+0000 7f2b69e00640 1 -- 172.21.15.144:0/1277027955 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol95610", "group_name": "subvol_grp42250", "target": ["mon-mgr", ""]}) -- 0x7f2b640b1e80 con 0x7f2b4406be30 2024-09-11T23:19:05.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.155+0000 7f2b5b400640 1 -- 172.21.15.144:0/1277027955 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2b640b1e80 con 0x7f2b4406be30 2024-09-11T23:19:05.157 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/subvol_grp42250/subvol95610 2024-09-11T23:19:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.157+0000 7f2b69e00640 1 -- 172.21.15.144:0/1277027955 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2b4406be30 msgr2=0x7f2b4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.157+0000 7f2b69e00640 1 --2- 172.21.15.144:0/1277027955 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2b4406be30 0x7f2b4406e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2b54034000 tx=0x7f2b5402e000 comp rx=0 tx=0).stop 2024-09-11T23:19:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.157+0000 7f2b69e00640 1 -- 172.21.15.144:0/1277027955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b640cfb10 msgr2=0x7f2b641e6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.157+0000 7f2b69e00640 1 --2- 172.21.15.144:0/1277027955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b640cfb10 0x7f2b641e6360 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000e900 tx=0x7f2b5000edc0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.157+0000 7f2b69e00640 1 -- 172.21.15.144:0/1277027955 shutdown_connections 2024-09-11T23:19:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.157+0000 7f2b69e00640 1 --2- 172.21.15.144:0/1277027955 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2b4406be30 0x7f2b4406e2f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.157+0000 7f2b69e00640 1 --2- 172.21.15.144:0/1277027955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b64145d90 0x7f2b64131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.157+0000 7f2b69e00640 1 --2- 172.21.15.144:0/1277027955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b640cfb10 0x7f2b641e6360 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.157+0000 7f2b69e00640 1 --2- 172.21.15.144:0/1277027955 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b640cd490 0x7f2b6415f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.158+0000 7f2b69e00640 1 -- 172.21.15.144:0/1277027955 >> 172.21.15.144:0/1277027955 conn(0x7f2b6406bba0 msgr2=0x7f2b6406e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.158+0000 7f2b69e00640 1 -- 172.21.15.144:0/1277027955 shutdown_connections 2024-09-11T23:19:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.158+0000 7f2b69e00640 1 -- 172.21.15.144:0/1277027955 wait complete. 2024-09-11T23:19:05.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:05.174 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/f16ce3e958703855eb612a6f881060f5.meta) 2024-09-11T23:19:05.235 INFO:teuthology.orchestra.run.smithi144.stdout:[GLOBAL] 2024-09-11T23:19:05.235 INFO:teuthology.orchestra.run.smithi144.stdout:version = 1 2024-09-11T23:19:05.235 INFO:teuthology.orchestra.run.smithi144.stdout:type = subvolume 2024-09-11T23:19:05.235 INFO:teuthology.orchestra.run.smithi144.stdout:path = /volumes/subvol_grp42250/subvol95610 2024-09-11T23:19:05.235 INFO:teuthology.orchestra.run.smithi144.stdout:state = complete 2024-09-11T23:19:05.235 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:05.238 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol95610 subvol_grp42250 2024-09-11T23:19:05.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.398+0000 7f5bc3000640 1 Processor -- start 2024-09-11T23:19:05.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.398+0000 7f5bc3000640 1 -- start start 2024-09-11T23:19:05.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.399+0000 7f5bc3000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5bbc06f130 0x7f5bbc072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.399+0000 7f5bc3000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bbc15c970 con 0x7f5bbc15b370 2024-09-11T23:19:05.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.399+0000 7f5bc3000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bbc15bbb0 con 0x7f5bbc15f9f0 2024-09-11T23:19:05.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.399+0000 7f5bc3000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5bbc15fef0 con 0x7f5bbc06f130 2024-09-11T23:19:05.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.399+0000 7f5bb3400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5bbc06f130 0x7f5bbc072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.399+0000 7f5bbbe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5bbc15b370 0x7f5bbc06ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44364/0 (socket says 172.21.15.144:44364) 2024-09-11T23:19:05.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.399+0000 7f5bbbe00640 1 -- 172.21.15.144:0/2274758979 learned_addr learned my addr 172.21.15.144:0/2274758979 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:05.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.400+0000 7f5bbb400640 1 -- 172.21.15.144:0/2274758979 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1049807980 0 0) 0x7f5bbc15c970 con 0x7f5bbc15b370 2024-09-11T23:19:05.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.400+0000 7f5bb3400640 1 -- 172.21.15.144:0/2274758979 >> v1:172.21.15.165:6789/0 conn(0x7f5bbc15f9f0 legacy=0x7f5bbc0ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.400+0000 7f5bb3400640 1 -- 172.21.15.144:0/2274758979 >> v1:172.21.15.144:6789/0 conn(0x7f5bbc15b370 legacy=0x7f5bbc06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.400+0000 7f5bb3400640 1 -- 172.21.15.144:0/2274758979 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bbc15be90 con 0x7f5bbc06f130 2024-09-11T23:19:05.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.401+0000 7f5bb3400640 1 --2- 172.21.15.144:0/2274758979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bbc06f130 0x7f5bbc072560 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40097a0 tx=0x7f5ba402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98832611329a2a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:05.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.401+0000 7f5bbb400640 1 -- 172.21.15.144:0/2274758979 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4037070 con 0x7f5bbc06f130 2024-09-11T23:19:05.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.401+0000 7f5bbb400640 1 -- 172.21.15.144:0/2274758979 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba4032440 con 0x7f5bbc06f130 2024-09-11T23:19:05.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.401+0000 7f5bbb400640 1 -- 172.21.15.144:0/2274758979 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4032810 con 0x7f5bbc06f130 2024-09-11T23:19:05.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.401+0000 7f5bc3000640 1 -- 172.21.15.144:0/2274758979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bbc06f130 msgr2=0x7f5bbc072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.401+0000 7f5bc3000640 1 --2- 172.21.15.144:0/2274758979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bbc06f130 0x7f5bbc072560 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40097a0 tx=0x7f5ba402a1a0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.402+0000 7f5bc3000640 1 -- 172.21.15.144:0/2274758979 shutdown_connections 2024-09-11T23:19:05.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.402+0000 7f5bc3000640 1 --2- 172.21.15.144:0/2274758979 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bbc06f130 0x7f5bbc072560 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.402+0000 7f5bc3000640 1 -- 172.21.15.144:0/2274758979 >> 172.21.15.144:0/2274758979 conn(0x7f5bbc06bba0 msgr2=0x7f5bbc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:05.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.402+0000 7f5bc3000640 1 -- 172.21.15.144:0/2274758979 shutdown_connections 2024-09-11T23:19:05.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.402+0000 7f5bc3000640 1 -- 172.21.15.144:0/2274758979 wait complete. 2024-09-11T23:19:05.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.403+0000 7f5bc3000640 1 Processor -- start 2024-09-11T23:19:05.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.403+0000 7f5bc3000640 1 -- start start 2024-09-11T23:19:05.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.404+0000 7f5bc3000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bbc06f130 0x7f5bbc155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.404+0000 7f5bc3000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bbc15b370 0x7f5bbc0b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.404+0000 7f5bc3000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bbc15f9f0 0x7f5bbc0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.404+0000 7f5bc3000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc0731b0 con 0x7f5bbc15b370 2024-09-11T23:19:05.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.404+0000 7f5bc3000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc15c450 con 0x7f5bbc15f9f0 2024-09-11T23:19:05.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.404+0000 7f5bc3000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5bbc15b750 con 0x7f5bbc06f130 2024-09-11T23:19:05.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.404+0000 7f5bb3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bbc15b370 0x7f5bbc0b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.404+0000 7f5bb3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bbc15b370 0x7f5bbc0b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33106/0 (socket says 172.21.15.144:33106) 2024-09-11T23:19:05.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.404+0000 7f5bb3400640 1 -- 172.21.15.144:0/1572235448 learned_addr learned my addr 172.21.15.144:0/1572235448 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:05.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.405+0000 7f5bbbe00640 1 --2- 172.21.15.144:0/1572235448 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bbc06f130 0x7f5bbc155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.405+0000 7f5bc1000640 1 --2- 172.21.15.144:0/1572235448 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bbc15f9f0 0x7f5bbc0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.405+0000 7f5bb3400640 1 -- 172.21.15.144:0/1572235448 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bbc06f130 msgr2=0x7f5bbc155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.405+0000 7f5bb3400640 1 --2- 172.21.15.144:0/1572235448 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bbc06f130 0x7f5bbc155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.405+0000 7f5bb3400640 1 -- 172.21.15.144:0/1572235448 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bbc15f9f0 msgr2=0x7f5bbc0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.405+0000 7f5bb3400640 1 --2- 172.21.15.144:0/1572235448 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bbc15f9f0 0x7f5bbc0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.405+0000 7f5bb3400640 1 -- 172.21.15.144:0/1572235448 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bbc0ac990 con 0x7f5bbc15b370 2024-09-11T23:19:05.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.405+0000 7f5bc1000640 1 --2- 172.21.15.144:0/1572235448 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bbc15f9f0 0x7f5bbc0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:05.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.405+0000 7f5bb3400640 1 --2- 172.21.15.144:0/1572235448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bbc15b370 0x7f5bbc0b4290 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40098c0 tx=0x7f5ba40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:05.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.405+0000 7f5bb8c00640 1 -- 172.21.15.144:0/1572235448 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4037040 con 0x7f5bbc15b370 2024-09-11T23:19:05.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.405+0000 7f5bb8c00640 1 -- 172.21.15.144:0/1572235448 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba4042070 con 0x7f5bbc15b370 2024-09-11T23:19:05.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.405+0000 7f5bc3000640 1 -- 172.21.15.144:0/1572235448 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bbc0b4ff0 con 0x7f5bbc15b370 2024-09-11T23:19:05.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.405+0000 7f5bb8c00640 1 -- 172.21.15.144:0/1572235448 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4030a70 con 0x7f5bbc15b370 2024-09-11T23:19:05.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.406+0000 7f5bc3000640 1 -- 172.21.15.144:0/1572235448 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bbc0b55b0 con 0x7f5bbc15b370 2024-09-11T23:19:05.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.407+0000 7f5bc3000640 1 -- 172.21.15.144:0/1572235448 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bbc072560 con 0x7f5bbc15b370 2024-09-11T23:19:05.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.407+0000 7f5bb8c00640 1 -- 172.21.15.144:0/1572235448 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 6) ==== 90549+0+0 (secure 0 0 0) 0x7f5ba4030c10 con 0x7f5bbc15b370 2024-09-11T23:19:05.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.408+0000 7f5bb8c00640 1 --2- 172.21.15.144:0/1572235448 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b9806bef0 0x7f5b9806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.408+0000 7f5bb8c00640 1 -- 172.21.15.144:0/1572235448 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f5ba40ab930 con 0x7f5bbc15b370 2024-09-11T23:19:05.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.408+0000 7f5bbbe00640 1 --2- 172.21.15.144:0/1572235448 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b9806bef0 0x7f5b9806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.409+0000 7f5bbbe00640 1 --2- 172.21.15.144:0/1572235448 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b9806bef0 0x7f5b9806e3b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5bac000f60 tx=0x7f5bac007b90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:05.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.413+0000 7f5bb8c00640 1 -- 172.21.15.144:0/1572235448 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ba407a280 con 0x7f5bbc15b370 2024-09-11T23:19:05.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.611+0000 7f5bc3000640 1 -- 172.21.15.144:0/1572235448 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol95610", "group_name": "subvol_grp42250", "target": ["mon-mgr", ""]}) -- 0x7f5bbc0b4d10 con 0x7f5b9806bef0 2024-09-11T23:19:05.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.636+0000 7f5bb8c00640 1 -- 172.21.15.144:0/1572235448 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5bbc0b4d10 con 0x7f5b9806bef0 2024-09-11T23:19:05.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.639+0000 7f5bc3000640 1 -- 172.21.15.144:0/1572235448 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b9806bef0 msgr2=0x7f5b9806e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.639+0000 7f5bc3000640 1 --2- 172.21.15.144:0/1572235448 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b9806bef0 0x7f5b9806e3b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5bac000f60 tx=0x7f5bac007b90 comp rx=0 tx=0).stop 2024-09-11T23:19:05.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.639+0000 7f5bc3000640 1 -- 172.21.15.144:0/1572235448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bbc15b370 msgr2=0x7f5bbc0b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.639+0000 7f5bc3000640 1 --2- 172.21.15.144:0/1572235448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bbc15b370 0x7f5bbc0b4290 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5ba40098c0 tx=0x7f5ba40046c0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.639+0000 7f5bc3000640 1 -- 172.21.15.144:0/1572235448 shutdown_connections 2024-09-11T23:19:05.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.639+0000 7f5bc3000640 1 --2- 172.21.15.144:0/1572235448 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b9806bef0 0x7f5b9806e3b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.639+0000 7f5bc3000640 1 --2- 172.21.15.144:0/1572235448 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bbc15f9f0 0x7f5bbc0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.639+0000 7f5bc3000640 1 --2- 172.21.15.144:0/1572235448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bbc15b370 0x7f5bbc0b4290 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.639+0000 7f5bc3000640 1 --2- 172.21.15.144:0/1572235448 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bbc06f130 0x7f5bbc155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.639+0000 7f5bc3000640 1 -- 172.21.15.144:0/1572235448 >> 172.21.15.144:0/1572235448 conn(0x7f5bbc06bba0 msgr2=0x7f5bbc155a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:05.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.639+0000 7f5bc3000640 1 -- 172.21.15.144:0/1572235448 shutdown_connections 2024-09-11T23:19:05.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.639+0000 7f5bc3000640 1 -- 172.21.15.144:0/1572235448 wait complete. 2024-09-11T23:19:05.642 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:19:05.641+0000 7f9c6ca00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:05.642 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:19:05.641+0000 7f9c6ca00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:05.642 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:19:05.641+0000 7f9c6ca00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:05.642 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:19:05.641+0000 7f9c6ca00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:05.642 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:19:05.641+0000 7f9c6ca00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:05.659 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:19:05.658+0000 7f9c6c000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:05.659 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:19:05.658+0000 7f9c6c000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:05.660 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:19:05.658+0000 7f9c6c000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:05.660 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:19:05.658+0000 7f9c6c000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:05.660 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:19:05.658+0000 7f9c6c000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:05.661 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-11T23:19:05.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:19:05.747 INFO:teuthology.orchestra.run.smithi144.stdout:2 2024-09-11T23:19:05.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:19:05.757 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp42250 2024-09-11T23:19:05.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.913+0000 7fa4c6400640 1 Processor -- start 2024-09-11T23:19:05.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.913+0000 7fa4c6400640 1 -- start start 2024-09-11T23:19:05.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.915+0000 7fa4c6400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4c0143d40 0x7fa4c00b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.915+0000 7fa4c6400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4c00b4000 0x7fa4c00ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.915+0000 7fa4c6400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c01443d0 con 0x7fa4c015ed50 2024-09-11T23:19:05.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.915+0000 7fa4c6400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa4c0144190 con 0x7fa4c00b4000 2024-09-11T23:19:05.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.915+0000 7fa4c6400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa4c01446b0 con 0x7fa4c0143d40 2024-09-11T23:19:05.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.915+0000 7fa4bf400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa4c015ed50 0x7fa4c0071080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44378/0 (socket says 172.21.15.144:44378) 2024-09-11T23:19:05.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.915+0000 7fa4bf400640 1 -- 172.21.15.144:0/131844793 learned_addr learned my addr 172.21.15.144:0/131844793 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:05.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.915+0000 7fa4bfe00640 1 --2- 172.21.15.144:0/131844793 >> v2:172.21.15.144:3300/0 conn(0x7fa4c00b4000 0x7fa4c00ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.915+0000 7fa4b6a00640 1 --2- 172.21.15.144:0/131844793 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4c0143d40 0x7fa4c00b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.915+0000 7fa4bea00640 1 -- 172.21.15.144:0/131844793 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3419705527 0 0) 0x7fa4c01443d0 con 0x7fa4c015ed50 2024-09-11T23:19:05.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.915+0000 7fa4bea00640 1 -- 172.21.15.144:0/131844793 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4a4003520 con 0x7fa4c015ed50 2024-09-11T23:19:05.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.915+0000 7fa4bfe00640 1 -- 172.21.15.144:0/131844793 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4c0143d40 msgr2=0x7fa4c00b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:05.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.915+0000 7fa4bfe00640 1 --2- 172.21.15.144:0/131844793 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4c0143d40 0x7fa4c00b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.915+0000 7fa4bfe00640 1 -- 172.21.15.144:0/131844793 >> v1:172.21.15.144:6789/0 conn(0x7fa4c015ed50 legacy=0x7fa4c0071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.915+0000 7fa4bfe00640 1 -- 172.21.15.144:0/131844793 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c0144990 con 0x7fa4c00b4000 2024-09-11T23:19:05.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.916+0000 7fa4bfe00640 1 --2- 172.21.15.144:0/131844793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c00b4000 0x7fa4c00ae8e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009d90 tx=0x7fa4b802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b551adaf392269 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:05.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.917+0000 7fa4bea00640 1 -- 172.21.15.144:0/131844793 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8031600 con 0x7fa4c00b4000 2024-09-11T23:19:05.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.917+0000 7fa4bea00640 1 -- 172.21.15.144:0/131844793 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b80317a0 con 0x7fa4c00b4000 2024-09-11T23:19:05.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.917+0000 7fa4bea00640 1 -- 172.21.15.144:0/131844793 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8031b50 con 0x7fa4c00b4000 2024-09-11T23:19:05.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.917+0000 7fa4c6400640 1 -- 172.21.15.144:0/131844793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c00b4000 msgr2=0x7fa4c00ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.917+0000 7fa4c6400640 1 --2- 172.21.15.144:0/131844793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c00b4000 0x7fa4c00ae8e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009d90 tx=0x7fa4b802a5d0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.917+0000 7fa4c6400640 1 -- 172.21.15.144:0/131844793 shutdown_connections 2024-09-11T23:19:05.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.917+0000 7fa4c6400640 1 --2- 172.21.15.144:0/131844793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c00b4000 0x7fa4c00ae8e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.917+0000 7fa4c6400640 1 --2- 172.21.15.144:0/131844793 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4c0143d40 0x7fa4c00b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.917+0000 7fa4c6400640 1 -- 172.21.15.144:0/131844793 >> 172.21.15.144:0/131844793 conn(0x7fa4c006bba0 msgr2=0x7fa4c006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:05.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.917+0000 7fa4c6400640 1 -- 172.21.15.144:0/131844793 shutdown_connections 2024-09-11T23:19:05.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.917+0000 7fa4c6400640 1 -- 172.21.15.144:0/131844793 wait complete. 2024-09-11T23:19:05.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.919+0000 7fa4c6400640 1 Processor -- start 2024-09-11T23:19:05.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.919+0000 7fa4c6400640 1 -- start start 2024-09-11T23:19:05.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.920+0000 7fa4c6400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c00b4000 0x7fa4c0140b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.920+0000 7fa4c6400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4c0143d40 0x7fa4c00b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.920+0000 7fa4c6400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4c015ed50 0x7fa4c00b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.920+0000 7fa4c6400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c0071790 con 0x7fa4c00b4000 2024-09-11T23:19:05.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.920+0000 7fa4c6400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c00aee20 con 0x7fa4c0143d40 2024-09-11T23:19:05.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.920+0000 7fa4c6400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa4c0159580 con 0x7fa4c015ed50 2024-09-11T23:19:05.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.920+0000 7fa4bf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c00b4000 0x7fa4c0140b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.920+0000 7fa4bf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c00b4000 0x7fa4c0140b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33144/0 (socket says 172.21.15.144:33144) 2024-09-11T23:19:05.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.920+0000 7fa4bf400640 1 -- 172.21.15.144:0/3208457742 learned_addr learned my addr 172.21.15.144:0/3208457742 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.920+0000 7fa4bfe00640 1 --2- 172.21.15.144:0/3208457742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4c015ed50 0x7fa4c00b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.920+0000 7fa4b6a00640 1 --2- 172.21.15.144:0/3208457742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4c0143d40 0x7fa4c00b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.921+0000 7fa4bf400640 1 -- 172.21.15.144:0/3208457742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4c015ed50 msgr2=0x7fa4c00b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.921+0000 7fa4bf400640 1 --2- 172.21.15.144:0/3208457742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4c015ed50 0x7fa4c00b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.921+0000 7fa4bf400640 1 -- 172.21.15.144:0/3208457742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4c0143d40 msgr2=0x7fa4c00b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.921+0000 7fa4bf400640 1 --2- 172.21.15.144:0/3208457742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4c0143d40 0x7fa4c00b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.921+0000 7fa4bf400640 1 -- 172.21.15.144:0/3208457742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c015b4a0 con 0x7fa4c00b4000 2024-09-11T23:19:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.921+0000 7fa4bfe00640 1 --2- 172.21.15.144:0/3208457742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4c015ed50 0x7fa4c00b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:05.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.921+0000 7fa4bf400640 1 --2- 172.21.15.144:0/3208457742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c00b4000 0x7fa4c0140b80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000c390 tx=0x7fa4b000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:05.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.921+0000 7fa4b7e00640 1 -- 172.21.15.144:0/3208457742 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0017070 con 0x7fa4c00b4000 2024-09-11T23:19:05.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.921+0000 7fa4b7e00640 1 -- 172.21.15.144:0/3208457742 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b0005ce0 con 0x7fa4c00b4000 2024-09-11T23:19:05.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.921+0000 7fa4b7e00640 1 -- 172.21.15.144:0/3208457742 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b00072f0 con 0x7fa4c00b4000 2024-09-11T23:19:05.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.921+0000 7fa4c6400640 1 -- 172.21.15.144:0/3208457742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c01577b0 con 0x7fa4c00b4000 2024-09-11T23:19:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.921+0000 7fa4c6400640 1 -- 172.21.15.144:0/3208457742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c0157d70 con 0x7fa4c00b4000 2024-09-11T23:19:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.923+0000 7fa4c6400640 1 -- 172.21.15.144:0/3208457742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4c00ae8e0 con 0x7fa4c00b4000 2024-09-11T23:19:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.923+0000 7fa4b7e00640 1 -- 172.21.15.144:0/3208457742 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 6) ==== 90549+0+0 (secure 0 0 0) 0x7fa4b001a070 con 0x7fa4c00b4000 2024-09-11T23:19:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.924+0000 7fa4b7e00640 1 --2- 172.21.15.144:0/3208457742 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa49c06bec0 0x7fa49c06e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.924+0000 7fa4b7e00640 1 -- 172.21.15.144:0/3208457742 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa4b008a240 con 0x7fa4c00b4000 2024-09-11T23:19:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.925+0000 7fa4b6a00640 1 --2- 172.21.15.144:0/3208457742 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa49c06bec0 0x7fa49c06e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:05.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.925+0000 7fa4b6a00640 1 --2- 172.21.15.144:0/3208457742 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa49c06bec0 0x7fa49c06e380 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa4c01f7550 tx=0x7fa4a8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:05.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:05.928+0000 7fa4b7e00640 1 -- 172.21.15.144:0/3208457742 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa4b0058540 con 0x7fa4c00b4000 2024-09-11T23:19:06.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.127+0000 7fa4c6400640 1 -- 172.21.15.144:0/3208457742 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp42250", "target": ["mon-mgr", ""]}) -- 0x7fa4c015b670 con 0x7fa49c06bec0 2024-09-11T23:19:06.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.132+0000 7fa4b7e00640 1 -- 172.21.15.144:0/3208457742 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa4c015b670 con 0x7fa49c06bec0 2024-09-11T23:19:06.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.134+0000 7fa4c6400640 1 -- 172.21.15.144:0/3208457742 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa49c06bec0 msgr2=0x7fa49c06e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:06.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.134+0000 7fa4c6400640 1 --2- 172.21.15.144:0/3208457742 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa49c06bec0 0x7fa49c06e380 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa4c01f7550 tx=0x7fa4a8008040 comp rx=0 tx=0).stop 2024-09-11T23:19:06.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.134+0000 7fa4c6400640 1 -- 172.21.15.144:0/3208457742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c00b4000 msgr2=0x7fa4c0140b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:06.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.134+0000 7fa4c6400640 1 --2- 172.21.15.144:0/3208457742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c00b4000 0x7fa4c0140b80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa4b000c390 tx=0x7fa4b000c850 comp rx=0 tx=0).stop 2024-09-11T23:19:06.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.134+0000 7fa4c6400640 1 -- 172.21.15.144:0/3208457742 shutdown_connections 2024-09-11T23:19:06.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.134+0000 7fa4c6400640 1 --2- 172.21.15.144:0/3208457742 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa49c06bec0 0x7fa49c06e380 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.134+0000 7fa4c6400640 1 --2- 172.21.15.144:0/3208457742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4c015ed50 0x7fa4c00b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.134+0000 7fa4c6400640 1 --2- 172.21.15.144:0/3208457742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4c0143d40 0x7fa4c00b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.134+0000 7fa4c6400640 1 --2- 172.21.15.144:0/3208457742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4c00b4000 0x7fa4c0140b80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.134+0000 7fa4c6400640 1 -- 172.21.15.144:0/3208457742 >> 172.21.15.144:0/3208457742 conn(0x7fa4c006bba0 msgr2=0x7fa4c01425e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:06.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.134+0000 7fa4c6400640 1 -- 172.21.15.144:0/3208457742 shutdown_connections 2024-09-11T23:19:06.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.134+0000 7fa4c6400640 1 -- 172.21.15.144:0/3208457742 wait complete. 2024-09-11T23:19:06.150 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:19:06.151 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:19:06.243 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:19:06.342 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:19:06.342 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:19:06.342 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:19:06.342 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:06.378 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:19:06.378 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:06.454 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:19:06.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.646+0000 7f3f8f000640 1 Processor -- start 2024-09-11T23:19:06.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.646+0000 7f3f8f000640 1 -- start start 2024-09-11T23:19:06.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.648+0000 7f3f8f000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f880d02a0 0x7f3f880d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:06.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.648+0000 7f3f8f000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3f8815ce80 0x7f3f881594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:06.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.648+0000 7f3f8f000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f880d0bc0 con 0x7f3f8815ca40 2024-09-11T23:19:06.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.648+0000 7f3f8f000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3f8815d390 con 0x7f3f8815ce80 2024-09-11T23:19:06.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.648+0000 7f3f8f000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3f8815d670 con 0x7f3f880d02a0 2024-09-11T23:19:06.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.648+0000 7f3f8d000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3f8815ce80 0x7f3f881594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:06.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.648+0000 7f3f87e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f880d02a0 0x7f3f880d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:06.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.648+0000 7f3f8d000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3f8815ce80 0x7f3f881594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:51496/0 (socket says 172.21.15.144:51496) 2024-09-11T23:19:06.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.648+0000 7f3f8d000640 1 -- 172.21.15.144:0/3476287926 learned_addr learned my addr 172.21.15.144:0/3476287926 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:06.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.649+0000 7f3f87e00640 1 -- 172.21.15.144:0/3476287926 >> v2:172.21.15.165:3300/0 conn(0x7f3f8815ce80 msgr2=0x7f3f881594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:06.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.649+0000 7f3f87e00640 1 --2- 172.21.15.144:0/3476287926 >> v2:172.21.15.165:3300/0 conn(0x7f3f8815ce80 0x7f3f881594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.649+0000 7f3f87e00640 1 -- 172.21.15.144:0/3476287926 >> v1:172.21.15.165:6789/0 conn(0x7f3f8815ca40 legacy=0x7f3f8815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:06.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.649+0000 7f3f87e00640 1 -- 172.21.15.144:0/3476287926 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8815d950 con 0x7f3f880d02a0 2024-09-11T23:19:06.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.649+0000 7f3f8d000640 1 --2- 172.21.15.144:0/3476287926 >> v2:172.21.15.165:3300/0 conn(0x7f3f8815ce80 0x7f3f881594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:19:06.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.650+0000 7f3f87e00640 1 --2- 172.21.15.144:0/3476287926 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f880d02a0 0x7f3f880d0680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3f780097a0 tx=0x7f3f7802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7861716b29368f4d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:06.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.650+0000 7f3f86a00640 1 -- 172.21.15.144:0/3476287926 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f78037070 con 0x7f3f880d02a0 2024-09-11T23:19:06.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.650+0000 7f3f86a00640 1 -- 172.21.15.144:0/3476287926 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f7802ae50 con 0x7f3f880d02a0 2024-09-11T23:19:06.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.650+0000 7f3f86a00640 1 -- 172.21.15.144:0/3476287926 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f78032660 con 0x7f3f880d02a0 2024-09-11T23:19:06.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.651+0000 7f3f8f000640 1 -- 172.21.15.144:0/3476287926 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f880d02a0 msgr2=0x7f3f880d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:06.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.651+0000 7f3f8f000640 1 --2- 172.21.15.144:0/3476287926 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f880d02a0 0x7f3f880d0680 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3f780097a0 tx=0x7f3f7802a100 comp rx=0 tx=0).stop 2024-09-11T23:19:06.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.651+0000 7f3f8f000640 1 -- 172.21.15.144:0/3476287926 shutdown_connections 2024-09-11T23:19:06.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.651+0000 7f3f8f000640 1 --2- 172.21.15.144:0/3476287926 >> v2:172.21.15.165:3300/0 conn(0x7f3f8815ce80 0x7f3f881594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.651+0000 7f3f8f000640 1 --2- 172.21.15.144:0/3476287926 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f880d02a0 0x7f3f880d0680 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.651+0000 7f3f8f000640 1 -- 172.21.15.144:0/3476287926 >> 172.21.15.144:0/3476287926 conn(0x7f3f88062cc0 msgr2=0x7f3f8806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:06.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.651+0000 7f3f8f000640 1 -- 172.21.15.144:0/3476287926 shutdown_connections 2024-09-11T23:19:06.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.651+0000 7f3f8f000640 1 -- 172.21.15.144:0/3476287926 wait complete. 2024-09-11T23:19:06.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.653+0000 7f3f8f000640 1 Processor -- start 2024-09-11T23:19:06.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.653+0000 7f3f8f000640 1 -- start start 2024-09-11T23:19:06.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.654+0000 7f3f8f000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f880d02a0 0x7f3f8814a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:06.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.654+0000 7f3f8f000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f8815ca40 0x7f3f8815c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:06.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.654+0000 7f3f8f000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f8815ce80 0x7f3f880ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:06.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.654+0000 7f3f8f000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8815eb40 con 0x7f3f880d02a0 2024-09-11T23:19:06.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.654+0000 7f3f8f000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8815df10 con 0x7f3f8815ca40 2024-09-11T23:19:06.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.654+0000 7f3f8f000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3f88155b90 con 0x7f3f8815ce80 2024-09-11T23:19:06.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.654+0000 7f3f87e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f880d02a0 0x7f3f8814a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:06.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.654+0000 7f3f87e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f880d02a0 0x7f3f8814a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33152/0 (socket says 172.21.15.144:33152) 2024-09-11T23:19:06.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.654+0000 7f3f87e00640 1 -- 172.21.15.144:0/2220184547 learned_addr learned my addr 172.21.15.144:0/2220184547 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:06.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.654+0000 7f3f8d000640 1 --2- 172.21.15.144:0/2220184547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f8815ce80 0x7f3f880ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:06.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.654+0000 7f3f87400640 1 --2- 172.21.15.144:0/2220184547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f8815ca40 0x7f3f8815c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:06.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.654+0000 7f3f87e00640 1 -- 172.21.15.144:0/2220184547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f8815ce80 msgr2=0x7f3f880ae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:06.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.654+0000 7f3f87e00640 1 --2- 172.21.15.144:0/2220184547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f8815ce80 0x7f3f880ae620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.654+0000 7f3f87e00640 1 -- 172.21.15.144:0/2220184547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f8815ca40 msgr2=0x7f3f8815c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:06.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.654+0000 7f3f87e00640 1 --2- 172.21.15.144:0/2220184547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f8815ca40 0x7f3f8815c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.654+0000 7f3f87e00640 1 -- 172.21.15.144:0/2220184547 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f880ac8f0 con 0x7f3f880d02a0 2024-09-11T23:19:06.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.655+0000 7f3f87e00640 1 --2- 172.21.15.144:0/2220184547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f880d02a0 0x7f3f8814a4d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3f78035040 tx=0x7f3f780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:06.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.655+0000 7f3f7fe00640 1 -- 172.21.15.144:0/2220184547 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f78041070 con 0x7f3f880d02a0 2024-09-11T23:19:06.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.655+0000 7f3f7fe00640 1 -- 172.21.15.144:0/2220184547 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f7803c460 con 0x7f3f880d02a0 2024-09-11T23:19:06.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.655+0000 7f3f8f000640 1 -- 172.21.15.144:0/2220184547 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f880acbd0 con 0x7f3f880d02a0 2024-09-11T23:19:06.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.655+0000 7f3f7fe00640 1 -- 172.21.15.144:0/2220184547 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f78037040 con 0x7f3f880d02a0 2024-09-11T23:19:06.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.655+0000 7f3f8f000640 1 -- 172.21.15.144:0/2220184547 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f8815a690 con 0x7f3f880d02a0 2024-09-11T23:19:06.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.656+0000 7f3f8f000640 1 -- 172.21.15.144:0/2220184547 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f880ad0f0 con 0x7f3f880d02a0 2024-09-11T23:19:06.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.657+0000 7f3f7fe00640 1 -- 172.21.15.144:0/2220184547 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 6) ==== 90549+0+0 (secure 0 0 0) 0x7f3f7803a070 con 0x7f3f880d02a0 2024-09-11T23:19:06.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.658+0000 7f3f7fe00640 1 --2- 172.21.15.144:0/2220184547 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3f6806bec0 0x7f3f6806e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:06.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.658+0000 7f3f7fe00640 1 -- 172.21.15.144:0/2220184547 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3f780ab580 con 0x7f3f880d02a0 2024-09-11T23:19:06.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.658+0000 7f3f87400640 1 --2- 172.21.15.144:0/2220184547 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3f6806bec0 0x7f3f6806e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:06.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.659+0000 7f3f87400640 1 --2- 172.21.15.144:0/2220184547 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3f6806bec0 0x7f3f6806e380 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3f881e8400 tx=0x7f3f74009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:06.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.662+0000 7f3f7fe00640 1 -- 172.21.15.144:0/2220184547 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3f880ad0f0 con 0x7f3f880d02a0 2024-09-11T23:19:06.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.849+0000 7f3f8f000640 1 -- 172.21.15.144:0/2220184547 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3f880b4790 con 0x7f3f880d02a0 2024-09-11T23:19:06.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.849+0000 7f3f7fe00640 1 -- 172.21.15.144:0/2220184547 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f3f78079f60 con 0x7f3f880d02a0 2024-09-11T23:19:06.850 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:19:06.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.852+0000 7f3f8f000640 1 -- 172.21.15.144:0/2220184547 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3f6806bec0 msgr2=0x7f3f6806e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:06.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.852+0000 7f3f8f000640 1 --2- 172.21.15.144:0/2220184547 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3f6806bec0 0x7f3f6806e380 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3f881e8400 tx=0x7f3f74009040 comp rx=0 tx=0).stop 2024-09-11T23:19:06.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.852+0000 7f3f8f000640 1 -- 172.21.15.144:0/2220184547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f880d02a0 msgr2=0x7f3f8814a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:06.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.852+0000 7f3f8f000640 1 --2- 172.21.15.144:0/2220184547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f880d02a0 0x7f3f8814a4d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3f78035040 tx=0x7f3f780046c0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.852+0000 7f3f8f000640 1 -- 172.21.15.144:0/2220184547 shutdown_connections 2024-09-11T23:19:06.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.852+0000 7f3f8f000640 1 --2- 172.21.15.144:0/2220184547 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3f6806bec0 0x7f3f6806e380 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.852+0000 7f3f8f000640 1 --2- 172.21.15.144:0/2220184547 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f8815ce80 0x7f3f880ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.852+0000 7f3f8f000640 1 --2- 172.21.15.144:0/2220184547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f8815ca40 0x7f3f8815c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.852+0000 7f3f8f000640 1 --2- 172.21.15.144:0/2220184547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f880d02a0 0x7f3f8814a4d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:06.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.852+0000 7f3f8f000640 1 -- 172.21.15.144:0/2220184547 >> 172.21.15.144:0/2220184547 conn(0x7f3f88062cc0 msgr2=0x7f3f880b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:06.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.852+0000 7f3f8f000640 1 -- 172.21.15.144:0/2220184547 shutdown_connections 2024-09-11T23:19:06.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:06.852+0000 7f3f8f000640 1 -- 172.21.15.144:0/2220184547 wait complete. 2024-09-11T23:19:06.869 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T23:19:06.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:06.869 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:06.948 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:19:06.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:06.948 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:19:07.003 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:19:07.003 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:19:07.003 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:07.041 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:19:07.042 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:07.118 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:19:07.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.276+0000 7fb6a0400640 1 Processor -- start 2024-09-11T23:19:07.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.277+0000 7fb6a0400640 1 -- start start 2024-09-11T23:19:07.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.278+0000 7fb6a0400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb6980d02a0 0x7fb6980d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:07.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.278+0000 7fb6a0400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6980d0bc0 con 0x7fb69815ce80 2024-09-11T23:19:07.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.278+0000 7fb6a0400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb69815d390 con 0x7fb69815ca40 2024-09-11T23:19:07.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.278+0000 7fb6a0400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb69815d670 con 0x7fb6980d02a0 2024-09-11T23:19:07.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.278+0000 7fb69e400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb69815ce80 0x7fb6981594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44390/0 (socket says 172.21.15.144:44390) 2024-09-11T23:19:07.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.278+0000 7fb69e400640 1 -- 172.21.15.144:0/1491910632 learned_addr learned my addr 172.21.15.144:0/1491910632 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:07.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.279+0000 7fb69da00640 1 --2- 172.21.15.144:0/1491910632 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb6980d02a0 0x7fb6980d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:07.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.279+0000 7fb697e00640 1 -- 172.21.15.144:0/1491910632 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1184923442 0 0) 0x7fb6980d0bc0 con 0x7fb69815ce80 2024-09-11T23:19:07.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.279+0000 7fb697e00640 1 -- 172.21.15.144:0/1491910632 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb680003520 con 0x7fb69815ce80 2024-09-11T23:19:07.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.279+0000 7fb697e00640 1 -- 172.21.15.144:0/1491910632 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1550595599 0 0) 0x7fb69815d390 con 0x7fb69815ca40 2024-09-11T23:19:07.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.279+0000 7fb697e00640 1 -- 172.21.15.144:0/1491910632 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6980d0bc0 con 0x7fb69815ca40 2024-09-11T23:19:07.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.279+0000 7fb69da00640 1 -- 172.21.15.144:0/1491910632 >> v1:172.21.15.165:6789/0 conn(0x7fb69815ca40 legacy=0x7fb69815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:07.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.279+0000 7fb69da00640 1 -- 172.21.15.144:0/1491910632 >> v1:172.21.15.144:6789/0 conn(0x7fb69815ce80 legacy=0x7fb6981594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:07.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.279+0000 7fb69da00640 1 -- 172.21.15.144:0/1491910632 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69815d950 con 0x7fb6980d02a0 2024-09-11T23:19:07.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.280+0000 7fb69da00640 1 --2- 172.21.15.144:0/1491910632 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb6980d02a0 0x7fb6980d0680 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0097d0 tx=0x7fb68c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d34234b2f21e3dee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:07.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.280+0000 7fb697e00640 1 -- 172.21.15.144:0/1491910632 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c037070 con 0x7fb6980d02a0 2024-09-11T23:19:07.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.280+0000 7fb697e00640 1 -- 172.21.15.144:0/1491910632 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c032440 con 0x7fb6980d02a0 2024-09-11T23:19:07.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.280+0000 7fb697e00640 1 -- 172.21.15.144:0/1491910632 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c0327f0 con 0x7fb6980d02a0 2024-09-11T23:19:07.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.281+0000 7fb6a0400640 1 -- 172.21.15.144:0/1491910632 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb6980d02a0 msgr2=0x7fb6980d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:07.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.281+0000 7fb6a0400640 1 --2- 172.21.15.144:0/1491910632 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb6980d02a0 0x7fb6980d0680 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0097d0 tx=0x7fb68c02a180 comp rx=0 tx=0).stop 2024-09-11T23:19:07.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.281+0000 7fb6a0400640 1 -- 172.21.15.144:0/1491910632 shutdown_connections 2024-09-11T23:19:07.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.281+0000 7fb6a0400640 1 --2- 172.21.15.144:0/1491910632 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb6980d02a0 0x7fb6980d0680 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.281+0000 7fb6a0400640 1 -- 172.21.15.144:0/1491910632 >> 172.21.15.144:0/1491910632 conn(0x7fb698062cc0 msgr2=0x7fb69806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:07.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.281+0000 7fb6a0400640 1 -- 172.21.15.144:0/1491910632 shutdown_connections 2024-09-11T23:19:07.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.281+0000 7fb6a0400640 1 -- 172.21.15.144:0/1491910632 wait complete. 2024-09-11T23:19:07.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.283+0000 7fb6a0400640 1 Processor -- start 2024-09-11T23:19:07.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.283+0000 7fb6a0400640 1 -- start start 2024-09-11T23:19:07.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb6a0400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6980d02a0 0x7fb6980cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:07.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb6a0400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb69815ca40 0x7fb6981f8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:07.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb6a0400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb69815ce80 0x7fb6981f7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:07.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb6a0400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb69815eb40 con 0x7fb6980d02a0 2024-09-11T23:19:07.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb6a0400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb69815df10 con 0x7fb69815ce80 2024-09-11T23:19:07.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb6a0400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb698155b90 con 0x7fb69815ca40 2024-09-11T23:19:07.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb69da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6980d02a0 0x7fb6980cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:07.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb69da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6980d02a0 0x7fb6980cd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33160/0 (socket says 172.21.15.144:33160) 2024-09-11T23:19:07.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb69da00640 1 -- 172.21.15.144:0/2673453324 learned_addr learned my addr 172.21.15.144:0/2673453324 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:07.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb69e400640 1 --2- 172.21.15.144:0/2673453324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb69815ce80 0x7fb6981f7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:07.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb69d000640 1 --2- 172.21.15.144:0/2673453324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb69815ca40 0x7fb6981f8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:07.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb69da00640 1 -- 172.21.15.144:0/2673453324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb69815ca40 msgr2=0x7fb6981f8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:07.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb69da00640 1 --2- 172.21.15.144:0/2673453324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb69815ca40 0x7fb6981f8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb69da00640 1 -- 172.21.15.144:0/2673453324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb69815ce80 msgr2=0x7fb6981f7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:07.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb69da00640 1 --2- 172.21.15.144:0/2673453324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb69815ce80 0x7fb6981f7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb69da00640 1 -- 172.21.15.144:0/2673453324 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6980cdc70 con 0x7fb6980d02a0 2024-09-11T23:19:07.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb69e400640 1 --2- 172.21.15.144:0/2673453324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb69815ce80 0x7fb6981f7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:07.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb69d000640 1 --2- 172.21.15.144:0/2673453324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb69815ca40 0x7fb6981f8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:07.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb69da00640 1 --2- 172.21.15.144:0/2673453324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6980d02a0 0x7fb6980cd5e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb68c035040 tx=0x7fb68c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:07.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb695600640 1 -- 172.21.15.144:0/2673453324 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c037040 con 0x7fb6980d02a0 2024-09-11T23:19:07.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb695600640 1 -- 172.21.15.144:0/2673453324 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c042070 con 0x7fb6980d02a0 2024-09-11T23:19:07.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb695600640 1 -- 172.21.15.144:0/2673453324 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c032810 con 0x7fb6980d02a0 2024-09-11T23:19:07.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb6a0400640 1 -- 172.21.15.144:0/2673453324 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6980cdf50 con 0x7fb6980d02a0 2024-09-11T23:19:07.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.285+0000 7fb6a0400640 1 -- 172.21.15.144:0/2673453324 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6980ce510 con 0x7fb6980d02a0 2024-09-11T23:19:07.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.286+0000 7fb6a0400640 1 -- 172.21.15.144:0/2673453324 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6980b4790 con 0x7fb6980d02a0 2024-09-11T23:19:07.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.287+0000 7fb695600640 1 -- 172.21.15.144:0/2673453324 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fb68c0329b0 con 0x7fb6980d02a0 2024-09-11T23:19:07.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.288+0000 7fb695600640 1 --2- 172.21.15.144:0/2673453324 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb67806bfe0 0x7fb67806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:07.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.288+0000 7fb695600640 1 -- 172.21.15.144:0/2673453324 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb68c0ab9c0 con 0x7fb6980d02a0 2024-09-11T23:19:07.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.288+0000 7fb69d000640 1 --2- 172.21.15.144:0/2673453324 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb67806bfe0 0x7fb67806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:07.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.289+0000 7fb69d000640 1 --2- 172.21.15.144:0/2673453324 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb67806bfe0 0x7fb67806e4a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb69806c7a0 tx=0x7fb684009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:07.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.293+0000 7fb695600640 1 -- 172.21.15.144:0/2673453324 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb68c07a0e0 con 0x7fb6980d02a0 2024-09-11T23:19:07.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.477+0000 7fb6a0400640 1 -- 172.21.15.144:0/2673453324 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb698152480 con 0x7fb6980d02a0 2024-09-11T23:19:07.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.478+0000 7fb695600640 1 -- 172.21.15.144:0/2673453324 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7fb68c0799e0 con 0x7fb6980d02a0 2024-09-11T23:19:07.479 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:19:07.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.480+0000 7fb6a0400640 1 -- 172.21.15.144:0/2673453324 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb67806bfe0 msgr2=0x7fb67806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:07.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.480+0000 7fb6a0400640 1 --2- 172.21.15.144:0/2673453324 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb67806bfe0 0x7fb67806e4a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb69806c7a0 tx=0x7fb684009040 comp rx=0 tx=0).stop 2024-09-11T23:19:07.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.480+0000 7fb6a0400640 1 -- 172.21.15.144:0/2673453324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6980d02a0 msgr2=0x7fb6980cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:07.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.480+0000 7fb6a0400640 1 --2- 172.21.15.144:0/2673453324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6980d02a0 0x7fb6980cd5e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb68c035040 tx=0x7fb68c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.480+0000 7fb6a0400640 1 -- 172.21.15.144:0/2673453324 shutdown_connections 2024-09-11T23:19:07.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.480+0000 7fb6a0400640 1 --2- 172.21.15.144:0/2673453324 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb67806bfe0 0x7fb67806e4a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.480+0000 7fb6a0400640 1 --2- 172.21.15.144:0/2673453324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb69815ce80 0x7fb6981f7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.480+0000 7fb6a0400640 1 --2- 172.21.15.144:0/2673453324 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb69815ca40 0x7fb6981f8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.480+0000 7fb6a0400640 1 --2- 172.21.15.144:0/2673453324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6980d02a0 0x7fb6980cd5e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.480+0000 7fb6a0400640 1 -- 172.21.15.144:0/2673453324 >> 172.21.15.144:0/2673453324 conn(0x7fb698062cc0 msgr2=0x7fb698157f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:07.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.480+0000 7fb6a0400640 1 -- 172.21.15.144:0/2673453324 shutdown_connections 2024-09-11T23:19:07.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.480+0000 7fb6a0400640 1 -- 172.21.15.144:0/2673453324 wait complete. 2024-09-11T23:19:07.496 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-11T23:19:07.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:07.497 DEBUG:teuthology.orchestra.run.smithi165:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-11T23:19:07.559 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:19:07.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:07.559 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:19:07.598 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:19:07.598 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:19:07.598 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:07.633 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:19:07.634 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:19:07.634 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:19:07.634 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:07.674 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:19:07.674 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:07.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.826+0000 7f3059e00640 1 Processor -- start 2024-09-11T23:19:07.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.826+0000 7f3059e00640 1 -- start start 2024-09-11T23:19:07.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.827+0000 7f3059e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f305415ca40 0x7f305415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:07.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.827+0000 7f3059e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f305415ceb0 0x7f30541594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:07.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.827+0000 7f3059e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f305415d390 con 0x7f30540d02a0 2024-09-11T23:19:07.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.827+0000 7f3059e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f305415d670 con 0x7f305415ca40 2024-09-11T23:19:07.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.827+0000 7f3059e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f305415d950 con 0x7f305415ceb0 2024-09-11T23:19:07.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.828+0000 7f3052a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f30540d02a0 0x7f30540d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44398/0 (socket says 172.21.15.144:44398) 2024-09-11T23:19:07.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.828+0000 7f3052a00640 1 -- 172.21.15.144:0/2147212324 learned_addr learned my addr 172.21.15.144:0/2147212324 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:07.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.828+0000 7f304be00640 1 --2- 172.21.15.144:0/2147212324 >> v2:172.21.15.144:3300/0 conn(0x7f305415ca40 0x7f305415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:07.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.828+0000 7f3053400640 1 --2- 172.21.15.144:0/2147212324 >> v2:172.21.15.165:3300/0 conn(0x7f305415ceb0 0x7f30541594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:07.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.828+0000 7f304be00640 1 -- 172.21.15.144:0/2147212324 >> v2:172.21.15.165:3300/0 conn(0x7f305415ceb0 msgr2=0x7f30541594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:07.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.828+0000 7f304be00640 1 --2- 172.21.15.144:0/2147212324 >> v2:172.21.15.165:3300/0 conn(0x7f305415ceb0 0x7f30541594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.828+0000 7f304be00640 1 -- 172.21.15.144:0/2147212324 >> v1:172.21.15.144:6789/0 conn(0x7f30540d02a0 legacy=0x7f30540d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:07.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.828+0000 7f304be00640 1 -- 172.21.15.144:0/2147212324 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305415dc30 con 0x7f305415ca40 2024-09-11T23:19:07.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.828+0000 7f3052000640 1 -- 172.21.15.144:0/2147212324 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1412642840 0 0) 0x7f305415d390 con 0x7f30540d02a0 2024-09-11T23:19:07.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.828+0000 7f3053400640 1 --2- 172.21.15.144:0/2147212324 >> v2:172.21.15.165:3300/0 conn(0x7f305415ceb0 0x7f30541594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:07.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.829+0000 7f304be00640 1 --2- 172.21.15.144:0/2147212324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f305415ca40 0x7f305415e430 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f30540b4be0 tx=0x7f303c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a905bb244a6e3ef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:07.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.829+0000 7f3052000640 1 -- 172.21.15.144:0/2147212324 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c037070 con 0x7f305415ca40 2024-09-11T23:19:07.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.830+0000 7f3052000640 1 -- 172.21.15.144:0/2147212324 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f303c032440 con 0x7f305415ca40 2024-09-11T23:19:07.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.830+0000 7f3052000640 1 -- 172.21.15.144:0/2147212324 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c02ae60 con 0x7f305415ca40 2024-09-11T23:19:07.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.830+0000 7f3059e00640 1 -- 172.21.15.144:0/2147212324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f305415ca40 msgr2=0x7f305415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:07.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.830+0000 7f3059e00640 1 --2- 172.21.15.144:0/2147212324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f305415ca40 0x7f305415e430 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f30540b4be0 tx=0x7f303c02a110 comp rx=0 tx=0).stop 2024-09-11T23:19:07.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.830+0000 7f3059e00640 1 -- 172.21.15.144:0/2147212324 shutdown_connections 2024-09-11T23:19:07.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.830+0000 7f3059e00640 1 --2- 172.21.15.144:0/2147212324 >> v2:172.21.15.165:3300/0 conn(0x7f305415ceb0 0x7f30541594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.830+0000 7f3059e00640 1 --2- 172.21.15.144:0/2147212324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f305415ca40 0x7f305415e430 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.830+0000 7f3059e00640 1 -- 172.21.15.144:0/2147212324 >> 172.21.15.144:0/2147212324 conn(0x7f3054062cc0 msgr2=0x7f305406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:07.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.830+0000 7f3059e00640 1 -- 172.21.15.144:0/2147212324 shutdown_connections 2024-09-11T23:19:07.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.830+0000 7f3059e00640 1 -- 172.21.15.144:0/2147212324 wait complete. 2024-09-11T23:19:07.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.832+0000 7f3059e00640 1 Processor -- start 2024-09-11T23:19:07.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.832+0000 7f3059e00640 1 -- start start 2024-09-11T23:19:07.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f3059e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30540d02a0 0x7f30540ce400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:07.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f3059e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f305415ca40 0x7f305415a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:07.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f3059e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f305415ceb0 0x7f305415ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:07.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f3059e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3054155d10 con 0x7f305415ca40 2024-09-11T23:19:07.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f3059e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3054155b90 con 0x7f305415ceb0 2024-09-11T23:19:07.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f3059e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f30540b4790 con 0x7f30540d02a0 2024-09-11T23:19:07.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f304be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f305415ca40 0x7f305415a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:07.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f304be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f305415ca40 0x7f305415a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33176/0 (socket says 172.21.15.144:33176) 2024-09-11T23:19:07.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f304be00640 1 -- 172.21.15.144:0/3453000862 learned_addr learned my addr 172.21.15.144:0/3453000862 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:07.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f3052a00640 1 --2- 172.21.15.144:0/3453000862 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30540d02a0 0x7f30540ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:07.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f3053400640 1 --2- 172.21.15.144:0/3453000862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f305415ceb0 0x7f305415ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:07.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f304be00640 1 -- 172.21.15.144:0/3453000862 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30540d02a0 msgr2=0x7f30540ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:07.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f304be00640 1 --2- 172.21.15.144:0/3453000862 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30540d02a0 0x7f30540ce400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f304be00640 1 -- 172.21.15.144:0/3453000862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f305415ceb0 msgr2=0x7f305415ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:07.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f304be00640 1 --2- 172.21.15.144:0/3453000862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f305415ceb0 0x7f305415ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:07.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f304be00640 1 -- 172.21.15.144:0/3453000862 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305414a320 con 0x7f305415ca40 2024-09-11T23:19:07.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f3052a00640 1 --2- 172.21.15.144:0/3453000862 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30540d02a0 0x7f30540ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:07.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f3053400640 1 --2- 172.21.15.144:0/3453000862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f305415ceb0 0x7f305415ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:07.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f304be00640 1 --2- 172.21.15.144:0/3453000862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f305415ca40 0x7f305415a620 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f303c000c00 tx=0x7f303c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:07.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f304b400640 1 -- 172.21.15.144:0/3453000862 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c037040 con 0x7f305415ca40 2024-09-11T23:19:07.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f304b400640 1 -- 172.21.15.144:0/3453000862 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f303c042070 con 0x7f305415ca40 2024-09-11T23:19:07.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f304b400640 1 -- 172.21.15.144:0/3453000862 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f303c030a50 con 0x7f305415ca40 2024-09-11T23:19:07.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f3059e00640 1 -- 172.21.15.144:0/3453000862 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30541f8290 con 0x7f305415ca40 2024-09-11T23:19:07.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.834+0000 7f3059e00640 1 -- 172.21.15.144:0/3453000862 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30541510f0 con 0x7f305415ca40 2024-09-11T23:19:07.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.835+0000 7f3059e00640 1 -- 172.21.15.144:0/3453000862 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3054153700 con 0x7f305415ca40 2024-09-11T23:19:07.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.836+0000 7f304b400640 1 -- 172.21.15.144:0/3453000862 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f303c030bf0 con 0x7f305415ca40 2024-09-11T23:19:07.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.837+0000 7f304b400640 1 --2- 172.21.15.144:0/3453000862 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f303006c010 0x7f303006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:07.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.837+0000 7f304b400640 1 -- 172.21.15.144:0/3453000862 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f303c0abc90 con 0x7f305415ca40 2024-09-11T23:19:07.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.837+0000 7f3052a00640 1 --2- 172.21.15.144:0/3453000862 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f303006c010 0x7f303006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:07.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.838+0000 7f3052a00640 1 --2- 172.21.15.144:0/3453000862 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f303006c010 0x7f303006e4d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3044000f60 tx=0x7f3044007c10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:07.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:07.842+0000 7f304b400640 1 -- 172.21.15.144:0/3453000862 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3054153700 con 0x7f305415ca40 2024-09-11T23:19:08.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.049+0000 7f3059e00640 1 -- 172.21.15.144:0/3453000862 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30540d0680 con 0x7f305415ca40 2024-09-11T23:19:08.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.050+0000 7f304b400640 1 -- 172.21.15.144:0/3453000862 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5229 (secure 0 0 0) 0x7f303c045360 con 0x7f305415ca40 2024-09-11T23:19:08.051 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:08.051 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":18,"btime":"2024-09-11T23:19:03:236797+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4601,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/4045809607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":4045809607},{"type":"v1","addr":"172.21.15.165:6835","nonce":4045809607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2584561527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2584561527},{"type":"v1","addr":"172.21.15.165:6834","nonce":2584561527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4815,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/787593912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":787593912},{"type":"v1","addr":"172.21.15.144:6836","nonce":787593912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:18:48.405093+0000","modified":"2024-09-11T23:18:51.419894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4818},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4818":{"gid":4818,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/163510896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":163510896},{"type":"v1","addr":"172.21.15.144:6837","nonce":163510896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4818,"qdb_cluster":[4818]},"id":2}]} 2024-09-11T23:19:08.051 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 18 2024-09-11T23:19:08.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.052+0000 7f3059e00640 1 -- 172.21.15.144:0/3453000862 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f303006c010 msgr2=0x7f303006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.052+0000 7f3059e00640 1 --2- 172.21.15.144:0/3453000862 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f303006c010 0x7f303006e4d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3044000f60 tx=0x7f3044007c10 comp rx=0 tx=0).stop 2024-09-11T23:19:08.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.052+0000 7f3059e00640 1 -- 172.21.15.144:0/3453000862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f305415ca40 msgr2=0x7f305415a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.052+0000 7f3059e00640 1 --2- 172.21.15.144:0/3453000862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f305415ca40 0x7f305415a620 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f303c000c00 tx=0x7f303c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.052+0000 7f3059e00640 1 -- 172.21.15.144:0/3453000862 shutdown_connections 2024-09-11T23:19:08.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.052+0000 7f3059e00640 1 --2- 172.21.15.144:0/3453000862 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f303006c010 0x7f303006e4d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.052+0000 7f3059e00640 1 --2- 172.21.15.144:0/3453000862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f305415ceb0 0x7f305415ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.052+0000 7f3059e00640 1 --2- 172.21.15.144:0/3453000862 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f305415ca40 0x7f305415a620 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.052+0000 7f3059e00640 1 --2- 172.21.15.144:0/3453000862 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f30540d02a0 0x7f30540ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.052+0000 7f3059e00640 1 -- 172.21.15.144:0/3453000862 >> 172.21.15.144:0/3453000862 conn(0x7f3054062cc0 msgr2=0x7f3054152ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:08.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.052+0000 7f3059e00640 1 -- 172.21.15.144:0/3453000862 shutdown_connections 2024-09-11T23:19:08.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.052+0000 7f3059e00640 1 -- 172.21.15.144:0/3453000862 wait complete. 2024-09-11T23:19:08.070 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:08.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.224+0000 7f8231e00640 1 Processor -- start 2024-09-11T23:19:08.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.224+0000 7f8231e00640 1 -- start start 2024-09-11T23:19:08.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.225+0000 7f8231e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f822c158a70 0x7f822c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.225+0000 7f8231e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f822c0b3e80 0x7f822c0725e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.225+0000 7f8231e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c072b20 0x7f822c162090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.225+0000 7f8231e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f822c0b4c30 con 0x7f822c0b3e80 2024-09-11T23:19:08.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.225+0000 7f8231e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f822c0b4390 con 0x7f822c158a70 2024-09-11T23:19:08.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.225+0000 7f8231e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f822c0b4670 con 0x7f822c072b20 2024-09-11T23:19:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.225+0000 7f822be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f822c0b3e80 0x7f822c0725e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.225+0000 7f822be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f822c0b3e80 0x7f822c0725e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33178/0 (socket says 172.21.15.144:33178) 2024-09-11T23:19:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.225+0000 7f822be00640 1 -- 172.21.15.144:0/4116175116 learned_addr learned my addr 172.21.15.144:0/4116175116 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.225+0000 7f8230a00640 1 --2- 172.21.15.144:0/4116175116 >> v2:172.21.15.165:3300/0 conn(0x7f822c158a70 0x7f822c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.225+0000 7f8231400640 1 --2- 172.21.15.144:0/4116175116 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c072b20 0x7f822c162090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.226+0000 7f822be00640 1 -- 172.21.15.144:0/4116175116 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c072b20 msgr2=0x7f822c162090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.226+0000 7f822be00640 1 --2- 172.21.15.144:0/4116175116 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c072b20 0x7f822c162090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.226+0000 7f822be00640 1 -- 172.21.15.144:0/4116175116 >> v2:172.21.15.165:3300/0 conn(0x7f822c158a70 msgr2=0x7f822c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.226+0000 7f822be00640 1 --2- 172.21.15.144:0/4116175116 >> v2:172.21.15.165:3300/0 conn(0x7f822c158a70 0x7f822c0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.226+0000 7f822be00640 1 -- 172.21.15.144:0/4116175116 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822c0b4950 con 0x7f822c0b3e80 2024-09-11T23:19:08.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.226+0000 7f8231400640 1 --2- 172.21.15.144:0/4116175116 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c072b20 0x7f822c162090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:08.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.227+0000 7f822be00640 1 --2- 172.21.15.144:0/4116175116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c0b3e80 0x7f822c0725e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8218009870 tx=0x7f821802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0abea458aba752 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:08.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.227+0000 7f822b400640 1 -- 172.21.15.144:0/4116175116 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218037070 con 0x7f822c0b3e80 2024-09-11T23:19:08.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.227+0000 7f822b400640 1 -- 172.21.15.144:0/4116175116 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8218032440 con 0x7f822c0b3e80 2024-09-11T23:19:08.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.227+0000 7f822b400640 1 -- 172.21.15.144:0/4116175116 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218032810 con 0x7f822c0b3e80 2024-09-11T23:19:08.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.228+0000 7f8231e00640 1 -- 172.21.15.144:0/4116175116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c0b3e80 msgr2=0x7f822c0725e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.228+0000 7f8231e00640 1 --2- 172.21.15.144:0/4116175116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c0b3e80 0x7f822c0725e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8218009870 tx=0x7f821802a180 comp rx=0 tx=0).stop 2024-09-11T23:19:08.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.228+0000 7f8231e00640 1 -- 172.21.15.144:0/4116175116 shutdown_connections 2024-09-11T23:19:08.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.228+0000 7f8231e00640 1 --2- 172.21.15.144:0/4116175116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c0b3e80 0x7f822c0725e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.228+0000 7f8231e00640 1 --2- 172.21.15.144:0/4116175116 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c072b20 0x7f822c162090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.228+0000 7f8231e00640 1 --2- 172.21.15.144:0/4116175116 >> v2:172.21.15.165:3300/0 conn(0x7f822c158a70 0x7f822c0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.228+0000 7f8231e00640 1 -- 172.21.15.144:0/4116175116 >> 172.21.15.144:0/4116175116 conn(0x7f822c0d0af0 msgr2=0x7f822c0d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:08.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.228+0000 7f8231e00640 1 -- 172.21.15.144:0/4116175116 shutdown_connections 2024-09-11T23:19:08.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.228+0000 7f8231e00640 1 -- 172.21.15.144:0/4116175116 wait complete. 2024-09-11T23:19:08.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.229+0000 7f8231e00640 1 Processor -- start 2024-09-11T23:19:08.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.229+0000 7f8231e00640 1 -- start start 2024-09-11T23:19:08.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.230+0000 7f8231e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c072b20 0x7f822c0aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.230+0000 7f8231e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f822c0b3e80 0x7f822c156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.230+0000 7f8231e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c158a70 0x7f822c157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.230+0000 7f8231e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f822c158e50 con 0x7f822c072b20 2024-09-11T23:19:08.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.230+0000 7f8231e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f822c0b5c60 con 0x7f822c0b3e80 2024-09-11T23:19:08.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.230+0000 7f8231e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f822c141ae0 con 0x7f822c158a70 2024-09-11T23:19:08.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.231+0000 7f8230a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c072b20 0x7f822c0aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.231+0000 7f8230a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c072b20 0x7f822c0aa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33182/0 (socket says 172.21.15.144:33182) 2024-09-11T23:19:08.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.231+0000 7f8230a00640 1 -- 172.21.15.144:0/3155818069 learned_addr learned my addr 172.21.15.144:0/3155818069 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:08.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.231+0000 7f822be00640 1 --2- 172.21.15.144:0/3155818069 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f822c0b3e80 0x7f822c156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.231+0000 7f8231400640 1 --2- 172.21.15.144:0/3155818069 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c158a70 0x7f822c157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.231+0000 7f8230a00640 1 -- 172.21.15.144:0/3155818069 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c158a70 msgr2=0x7f822c157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.231+0000 7f8230a00640 1 --2- 172.21.15.144:0/3155818069 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c158a70 0x7f822c157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.231+0000 7f8230a00640 1 -- 172.21.15.144:0/3155818069 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f822c0b3e80 msgr2=0x7f822c156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.231+0000 7f8230a00640 1 --2- 172.21.15.144:0/3155818069 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f822c0b3e80 0x7f822c156dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.231+0000 7f8230a00640 1 -- 172.21.15.144:0/3155818069 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822c0aadd0 con 0x7f822c072b20 2024-09-11T23:19:08.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.231+0000 7f8230a00640 1 --2- 172.21.15.144:0/3155818069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c072b20 0x7f822c0aa4d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f821c00e870 tx=0x7f821c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:08.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.231+0000 7f8228c00640 1 -- 172.21.15.144:0/3155818069 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c017070 con 0x7f822c072b20 2024-09-11T23:19:08.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.232+0000 7f8228c00640 1 -- 172.21.15.144:0/3155818069 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f821c00ee60 con 0x7f822c072b20 2024-09-11T23:19:08.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.232+0000 7f8231e00640 1 -- 172.21.15.144:0/3155818069 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f822c0ab0b0 con 0x7f822c072b20 2024-09-11T23:19:08.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.232+0000 7f8228c00640 1 -- 172.21.15.144:0/3155818069 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c00cb00 con 0x7f822c072b20 2024-09-11T23:19:08.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.232+0000 7f8231e00640 1 -- 172.21.15.144:0/3155818069 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f822c141770 con 0x7f822c072b20 2024-09-11T23:19:08.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.233+0000 7f8231e00640 1 -- 172.21.15.144:0/3155818069 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f822c0725e0 con 0x7f822c072b20 2024-09-11T23:19:08.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.233+0000 7f8228c00640 1 -- 172.21.15.144:0/3155818069 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f821c01a070 con 0x7f822c072b20 2024-09-11T23:19:08.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.235+0000 7f8228c00640 1 --2- 172.21.15.144:0/3155818069 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f820c06bfe0 0x7f820c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.235+0000 7f8228c00640 1 -- 172.21.15.144:0/3155818069 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f821c08b2a0 con 0x7f822c072b20 2024-09-11T23:19:08.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.235+0000 7f822be00640 1 --2- 172.21.15.144:0/3155818069 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f820c06bfe0 0x7f820c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.236+0000 7f822be00640 1 --2- 172.21.15.144:0/3155818069 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f820c06bfe0 0x7f820c06e4a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8218034000 tx=0x7f821802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:08.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.238+0000 7f8228c00640 1 -- 172.21.15.144:0/3155818069 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f821c059390 con 0x7f822c072b20 2024-09-11T23:19:08.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.449+0000 7f8231e00640 1 -- 172.21.15.144:0/3155818069 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f822c0b05b0 con 0x7f822c072b20 2024-09-11T23:19:08.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.449+0000 7f8228c00640 1 -- 172.21.15.144:0/3155818069 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5229 (secure 0 0 0) 0x7f821c05d690 con 0x7f822c072b20 2024-09-11T23:19:08.449 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:08.449 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":18,"btime":"2024-09-11T23:19:03:236797+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4601,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/4045809607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":4045809607},{"type":"v1","addr":"172.21.15.165:6835","nonce":4045809607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2584561527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2584561527},{"type":"v1","addr":"172.21.15.165:6834","nonce":2584561527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4815,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/787593912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":787593912},{"type":"v1","addr":"172.21.15.144:6836","nonce":787593912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:18:48.405093+0000","modified":"2024-09-11T23:18:51.419894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4818},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4818":{"gid":4818,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/163510896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":163510896},{"type":"v1","addr":"172.21.15.144:6837","nonce":163510896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4818,"qdb_cluster":[4818]},"id":2}]} 2024-09-11T23:19:08.450 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 18 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.452+0000 7f8231e00640 1 -- 172.21.15.144:0/3155818069 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f820c06bfe0 msgr2=0x7f820c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.452+0000 7f8231e00640 1 --2- 172.21.15.144:0/3155818069 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f820c06bfe0 0x7f820c06e4a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8218034000 tx=0x7f821802e000 comp rx=0 tx=0).stop 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.452+0000 7f8231e00640 1 -- 172.21.15.144:0/3155818069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c072b20 msgr2=0x7f822c0aa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.452+0000 7f8231e00640 1 --2- 172.21.15.144:0/3155818069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c072b20 0x7f822c0aa4d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f821c00e870 tx=0x7f821c00ed30 comp rx=0 tx=0).stop 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.452+0000 7f8231e00640 1 -- 172.21.15.144:0/3155818069 shutdown_connections 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.452+0000 7f8231e00640 1 --2- 172.21.15.144:0/3155818069 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f820c06bfe0 0x7f820c06e4a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.452+0000 7f8231e00640 1 --2- 172.21.15.144:0/3155818069 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c158a70 0x7f822c157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.452+0000 7f8231e00640 1 --2- 172.21.15.144:0/3155818069 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f822c0b3e80 0x7f822c156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.452+0000 7f8231e00640 1 --2- 172.21.15.144:0/3155818069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c072b20 0x7f822c0aa4d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.452+0000 7f8231e00640 1 -- 172.21.15.144:0/3155818069 >> 172.21.15.144:0/3155818069 conn(0x7f822c0d0af0 msgr2=0x7f822c0b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:08.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.452+0000 7f8231e00640 1 -- 172.21.15.144:0/3155818069 shutdown_connections 2024-09-11T23:19:08.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.452+0000 7f8231e00640 1 -- 172.21.15.144:0/3155818069 wait complete. 2024-09-11T23:19:08.468 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:19:08.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.620+0000 7fb1fbc00640 1 Processor -- start 2024-09-11T23:19:08.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.620+0000 7fb1fbc00640 1 -- start start 2024-09-11T23:19:08.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.621+0000 7fb1fbc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb1f40d0a50 0x7fb1f41620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.621+0000 7fb1fbc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1f40b4930 0x7fb1f40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.621+0000 7fb1fbc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb1f415f620 0x7fb1f415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.621+0000 7fb1fbc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb1f40b52d0 con 0x7fb1f415f620 2024-09-11T23:19:08.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.621+0000 7fb1fbc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb1f41625f0 con 0x7fb1f40d0a50 2024-09-11T23:19:08.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.621+0000 7fb1fbc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f4162870 con 0x7fb1f40b4930 2024-09-11T23:19:08.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.621+0000 7fb1f9c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb1f415f620 0x7fb1f415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.622+0000 7fb1f9c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb1f415f620 0x7fb1f415fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33188/0 (socket says 172.21.15.144:33188) 2024-09-11T23:19:08.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.622+0000 7fb1f9c00640 1 -- 172.21.15.144:0/2398565942 learned_addr learned my addr 172.21.15.144:0/2398565942 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:08.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.622+0000 7fb1f9200640 1 --2- 172.21.15.144:0/2398565942 >> v2:172.21.15.165:3300/0 conn(0x7fb1f40d0a50 0x7fb1f41620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.622+0000 7fb1f3e00640 1 --2- 172.21.15.144:0/2398565942 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1f40b4930 0x7fb1f40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.622+0000 7fb1f9c00640 1 -- 172.21.15.144:0/2398565942 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1f40b4930 msgr2=0x7fb1f40b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:08.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.622+0000 7fb1f9c00640 1 --2- 172.21.15.144:0/2398565942 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1f40b4930 0x7fb1f40b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.622+0000 7fb1f9c00640 1 -- 172.21.15.144:0/2398565942 >> v2:172.21.15.165:3300/0 conn(0x7fb1f40d0a50 msgr2=0x7fb1f41620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:08.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.622+0000 7fb1f9c00640 1 --2- 172.21.15.144:0/2398565942 >> v2:172.21.15.165:3300/0 conn(0x7fb1f40d0a50 0x7fb1f41620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.622+0000 7fb1f9c00640 1 -- 172.21.15.144:0/2398565942 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f4162b50 con 0x7fb1f415f620 2024-09-11T23:19:08.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.622+0000 7fb1f3e00640 1 --2- 172.21.15.144:0/2398565942 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1f40b4930 0x7fb1f40b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:08.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.623+0000 7fb1f9c00640 1 --2- 172.21.15.144:0/2398565942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1f415f620 0x7fb1f415fab0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb1f406cc40 tx=0x7fb1ec02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9280ea6351370d15 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:08.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.623+0000 7fb1f3400640 1 -- 172.21.15.144:0/2398565942 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec036070 con 0x7fb1f415f620 2024-09-11T23:19:08.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.623+0000 7fb1f3400640 1 -- 172.21.15.144:0/2398565942 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1ec031600 con 0x7fb1f415f620 2024-09-11T23:19:08.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.623+0000 7fb1f3400640 1 -- 172.21.15.144:0/2398565942 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec0319d0 con 0x7fb1f415f620 2024-09-11T23:19:08.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.624+0000 7fb1fbc00640 1 -- 172.21.15.144:0/2398565942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1f415f620 msgr2=0x7fb1f415fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.624+0000 7fb1fbc00640 1 --2- 172.21.15.144:0/2398565942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1f415f620 0x7fb1f415fab0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb1f406cc40 tx=0x7fb1ec02a610 comp rx=0 tx=0).stop 2024-09-11T23:19:08.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.624+0000 7fb1fbc00640 1 -- 172.21.15.144:0/2398565942 shutdown_connections 2024-09-11T23:19:08.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.624+0000 7fb1fbc00640 1 --2- 172.21.15.144:0/2398565942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1f415f620 0x7fb1f415fab0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.624+0000 7fb1fbc00640 1 --2- 172.21.15.144:0/2398565942 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1f40b4930 0x7fb1f40b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.624+0000 7fb1fbc00640 1 --2- 172.21.15.144:0/2398565942 >> v2:172.21.15.165:3300/0 conn(0x7fb1f40d0a50 0x7fb1f41620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.624+0000 7fb1fbc00640 1 -- 172.21.15.144:0/2398565942 >> 172.21.15.144:0/2398565942 conn(0x7fb1f4062cc0 msgr2=0x7fb1f406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:08.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.624+0000 7fb1fbc00640 1 -- 172.21.15.144:0/2398565942 shutdown_connections 2024-09-11T23:19:08.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.624+0000 7fb1fbc00640 1 -- 172.21.15.144:0/2398565942 wait complete. 2024-09-11T23:19:08.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.625+0000 7fb1fbc00640 1 Processor -- start 2024-09-11T23:19:08.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.626+0000 7fb1fbc00640 1 -- start start 2024-09-11T23:19:08.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.626+0000 7fb1fbc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1f40b4930 0x7fb1f4073b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.627+0000 7fb1fbc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1f415f620 0x7fb1f4144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.627+0000 7fb1fbc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1f4070f40 0x7fb1f40713d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.627+0000 7fb1fbc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f40b3620 con 0x7fb1f4070f40 2024-09-11T23:19:08.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.627+0000 7fb1fbc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f40b3340 con 0x7fb1f415f620 2024-09-11T23:19:08.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.627+0000 7fb1fbc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f415fff0 con 0x7fb1f40b4930 2024-09-11T23:19:08.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.627+0000 7fb1f9c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1f4070f40 0x7fb1f40713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.627+0000 7fb1f9c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1f4070f40 0x7fb1f40713d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33196/0 (socket says 172.21.15.144:33196) 2024-09-11T23:19:08.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.627+0000 7fb1f9c00640 1 -- 172.21.15.144:0/1176612227 learned_addr learned my addr 172.21.15.144:0/1176612227 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:08.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.627+0000 7fb1f3e00640 1 --2- 172.21.15.144:0/1176612227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1f415f620 0x7fb1f4144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.627+0000 7fb1f9200640 1 --2- 172.21.15.144:0/1176612227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1f40b4930 0x7fb1f4073b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.627+0000 7fb1f9c00640 1 -- 172.21.15.144:0/1176612227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1f40b4930 msgr2=0x7fb1f4073b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.627+0000 7fb1f9c00640 1 --2- 172.21.15.144:0/1176612227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1f40b4930 0x7fb1f4073b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.627+0000 7fb1f9c00640 1 -- 172.21.15.144:0/1176612227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1f415f620 msgr2=0x7fb1f4144c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.627+0000 7fb1f9c00640 1 --2- 172.21.15.144:0/1176612227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1f415f620 0x7fb1f4144c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.627+0000 7fb1f9c00640 1 -- 172.21.15.144:0/1176612227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f415aa40 con 0x7fb1f4070f40 2024-09-11T23:19:08.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.628+0000 7fb1f9c00640 1 --2- 172.21.15.144:0/1176612227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1f4070f40 0x7fb1f40713d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec009f40 tx=0x7fb1ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:08.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.628+0000 7fb1f0c00640 1 -- 172.21.15.144:0/1176612227 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec041020 con 0x7fb1f4070f40 2024-09-11T23:19:08.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.628+0000 7fb1f0c00640 1 -- 172.21.15.144:0/1176612227 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1ec0077a0 con 0x7fb1f4070f40 2024-09-11T23:19:08.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.628+0000 7fb1f0c00640 1 -- 172.21.15.144:0/1176612227 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec036040 con 0x7fb1f4070f40 2024-09-11T23:19:08.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.628+0000 7fb1fbc00640 1 -- 172.21.15.144:0/1176612227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f41f5500 con 0x7fb1f4070f40 2024-09-11T23:19:08.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.628+0000 7fb1fbc00640 1 -- 172.21.15.144:0/1176612227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f4073020 con 0x7fb1f4070f40 2024-09-11T23:19:08.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.629+0000 7fb1fbc00640 1 -- 172.21.15.144:0/1176612227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f41620b0 con 0x7fb1f4070f40 2024-09-11T23:19:08.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.630+0000 7fb1f0c00640 1 -- 172.21.15.144:0/1176612227 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fb1ec044020 con 0x7fb1f4070f40 2024-09-11T23:19:08.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.631+0000 7fb1f0c00640 1 --2- 172.21.15.144:0/1176612227 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb1d406bfe0 0x7fb1d406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.631+0000 7fb1f0c00640 1 -- 172.21.15.144:0/1176612227 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb1ec0abf70 con 0x7fb1f4070f40 2024-09-11T23:19:08.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.631+0000 7fb1f9200640 1 --2- 172.21.15.144:0/1176612227 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb1d406bfe0 0x7fb1d406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.631+0000 7fb1f9200640 1 --2- 172.21.15.144:0/1176612227 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb1d406bfe0 0x7fb1d406e4a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8009a30 tx=0x7fb1e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:08.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.635+0000 7fb1f0c00640 1 -- 172.21.15.144:0/1176612227 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb1ec04b030 con 0x7fb1f4070f40 2024-09-11T23:19:08.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.811+0000 7fb1fbc00640 1 -- 172.21.15.144:0/1176612227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1f40b1db0 con 0x7fb1f4070f40 2024-09-11T23:19:08.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.812+0000 7fb1f0c00640 1 -- 172.21.15.144:0/1176612227 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16753 (secure 0 0 0) 0x7fb1f415aa40 con 0x7fb1f4070f40 2024-09-11T23:19:08.812 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:08.812 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":34,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:18:49.999965+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:18:46.180295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-11T23:18:47.420116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:19:08.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.814+0000 7fb1fbc00640 1 -- 172.21.15.144:0/1176612227 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb1d406bfe0 msgr2=0x7fb1d406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.814+0000 7fb1fbc00640 1 --2- 172.21.15.144:0/1176612227 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb1d406bfe0 0x7fb1d406e4a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8009a30 tx=0x7fb1e8008040 comp rx=0 tx=0).stop 2024-09-11T23:19:08.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.814+0000 7fb1fbc00640 1 -- 172.21.15.144:0/1176612227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1f4070f40 msgr2=0x7fb1f40713d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.814+0000 7fb1fbc00640 1 --2- 172.21.15.144:0/1176612227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1f4070f40 0x7fb1f40713d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec009f40 tx=0x7fb1ec004a40 comp rx=0 tx=0).stop 2024-09-11T23:19:08.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.814+0000 7fb1fbc00640 1 -- 172.21.15.144:0/1176612227 shutdown_connections 2024-09-11T23:19:08.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.814+0000 7fb1fbc00640 1 --2- 172.21.15.144:0/1176612227 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb1d406bfe0 0x7fb1d406e4a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.814+0000 7fb1fbc00640 1 --2- 172.21.15.144:0/1176612227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1f4070f40 0x7fb1f40713d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.814+0000 7fb1fbc00640 1 --2- 172.21.15.144:0/1176612227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb1f415f620 0x7fb1f4144c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.814+0000 7fb1fbc00640 1 --2- 172.21.15.144:0/1176612227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb1f40b4930 0x7fb1f4073b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.814+0000 7fb1fbc00640 1 -- 172.21.15.144:0/1176612227 >> 172.21.15.144:0/1176612227 conn(0x7fb1f4062cc0 msgr2=0x7fb1f406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:08.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.814+0000 7fb1fbc00640 1 -- 172.21.15.144:0/1176612227 shutdown_connections 2024-09-11T23:19:08.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.815+0000 7fb1fbc00640 1 -- 172.21.15.144:0/1176612227 wait complete. 2024-09-11T23:19:08.831 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:19:08.832 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:08.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.986+0000 7f59d1c00640 1 Processor -- start 2024-09-11T23:19:08.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.986+0000 7f59d1c00640 1 -- start start 2024-09-11T23:19:08.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.987+0000 7f59d1c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f59cc15e640 0x7f59cc0d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.987+0000 7f59d1c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59cc0d3f60 0x7f59cc0b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.987+0000 7f59d1c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59cc06bee0 con 0x7f59cc0b6510 2024-09-11T23:19:08.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.987+0000 7f59d1c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f59cc15ea20 con 0x7f59cc15e640 2024-09-11T23:19:08.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.987+0000 7f59d1c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f59cc06caf0 con 0x7f59cc0d3f60 2024-09-11T23:19:08.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.987+0000 7f59cbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f59cc15e640 0x7f59cc0d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.987+0000 7f59cbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f59cc15e640 0x7f59cc0d3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33212/0 (socket says 172.21.15.144:33212) 2024-09-11T23:19:08.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.987+0000 7f59cbe00640 1 -- 172.21.15.144:0/1920039774 learned_addr learned my addr 172.21.15.144:0/1920039774 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:08.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.987+0000 7f59c3400640 1 --2- 172.21.15.144:0/1920039774 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59cc0d3f60 0x7f59cc0b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.988+0000 7f59cbe00640 1 -- 172.21.15.144:0/1920039774 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59cc0d3f60 msgr2=0x7f59cc0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:08.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.988+0000 7f59cbe00640 1 --2- 172.21.15.144:0/1920039774 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59cc0d3f60 0x7f59cc0b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.988+0000 7f59cbe00640 1 -- 172.21.15.144:0/1920039774 >> v1:172.21.15.165:6789/0 conn(0x7f59cc0b6510 legacy=0x7f59cc0d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.988+0000 7f59cbe00640 1 -- 172.21.15.144:0/1920039774 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59cc06c1c0 con 0x7f59cc15e640 2024-09-11T23:19:08.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.989+0000 7f59cbe00640 1 --2- 172.21.15.144:0/1920039774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59cc15e640 0x7f59cc0d3a20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009870 tx=0x7f59bc02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0782b852104f95c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:08.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.989+0000 7f59cb400640 1 -- 172.21.15.144:0/1920039774 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc037070 con 0x7f59cc15e640 2024-09-11T23:19:08.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.989+0000 7f59cb400640 1 -- 172.21.15.144:0/1920039774 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59bc032440 con 0x7f59cc15e640 2024-09-11T23:19:08.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.989+0000 7f59cb400640 1 -- 172.21.15.144:0/1920039774 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc032810 con 0x7f59cc15e640 2024-09-11T23:19:08.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.989+0000 7f59d1c00640 1 -- 172.21.15.144:0/1920039774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59cc15e640 msgr2=0x7f59cc0d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.989+0000 7f59d1c00640 1 --2- 172.21.15.144:0/1920039774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59cc15e640 0x7f59cc0d3a20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009870 tx=0x7f59bc02a250 comp rx=0 tx=0).stop 2024-09-11T23:19:08.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.990+0000 7f59d1c00640 1 -- 172.21.15.144:0/1920039774 shutdown_connections 2024-09-11T23:19:08.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.990+0000 7f59d1c00640 1 --2- 172.21.15.144:0/1920039774 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59cc0d3f60 0x7f59cc0b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.990+0000 7f59d1c00640 1 --2- 172.21.15.144:0/1920039774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59cc15e640 0x7f59cc0d3a20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.990+0000 7f59d1c00640 1 -- 172.21.15.144:0/1920039774 >> 172.21.15.144:0/1920039774 conn(0x7f59cc0d0fd0 msgr2=0x7f59cc0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:08.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.990+0000 7f59d1c00640 1 -- 172.21.15.144:0/1920039774 shutdown_connections 2024-09-11T23:19:08.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.990+0000 7f59d1c00640 1 -- 172.21.15.144:0/1920039774 wait complete. 2024-09-11T23:19:08.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.991+0000 7f59d1c00640 1 Processor -- start 2024-09-11T23:19:08.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.991+0000 7f59d1c00640 1 -- start start 2024-09-11T23:19:08.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.992+0000 7f59d1c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59cc0b6510 0x7f59cc151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.992+0000 7f59d1c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59cc0d3f60 0x7f59cc0cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.992+0000 7f59d1c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59cc15e640 0x7f59cc1e8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.992+0000 7f59d1c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc0b8760 con 0x7f59cc0d3f60 2024-09-11T23:19:08.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.992+0000 7f59d1c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc06c780 con 0x7f59cc15e640 2024-09-11T23:19:08.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.992+0000 7f59d1c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f59cc0b88e0 con 0x7f59cc0b6510 2024-09-11T23:19:08.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.993+0000 7f59c3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59cc0d3f60 0x7f59cc0cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.993+0000 7f59c3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59cc0d3f60 0x7f59cc0cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33224/0 (socket says 172.21.15.144:33224) 2024-09-11T23:19:08.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.993+0000 7f59c3400640 1 -- 172.21.15.144:0/3279028970 learned_addr learned my addr 172.21.15.144:0/3279028970 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:08.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.993+0000 7f59d1200640 1 --2- 172.21.15.144:0/3279028970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59cc15e640 0x7f59cc1e8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.993+0000 7f59cbe00640 1 --2- 172.21.15.144:0/3279028970 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59cc0b6510 0x7f59cc151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.993+0000 7f59c3400640 1 -- 172.21.15.144:0/3279028970 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59cc0b6510 msgr2=0x7f59cc151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.993+0000 7f59c3400640 1 --2- 172.21.15.144:0/3279028970 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59cc0b6510 0x7f59cc151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.993+0000 7f59c3400640 1 -- 172.21.15.144:0/3279028970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59cc15e640 msgr2=0x7f59cc1e8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:08.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.993+0000 7f59c3400640 1 --2- 172.21.15.144:0/3279028970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59cc15e640 0x7f59cc1e8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:08.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.993+0000 7f59c3400640 1 -- 172.21.15.144:0/3279028970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59cc0ce140 con 0x7f59cc0d3f60 2024-09-11T23:19:08.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.993+0000 7f59c3400640 1 --2- 172.21.15.144:0/3279028970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59cc0d3f60 0x7f59cc0cd490 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f59b400d800 tx=0x7f59b400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:08.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.993+0000 7f59c8c00640 1 -- 172.21.15.144:0/3279028970 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b4004020 con 0x7f59cc0d3f60 2024-09-11T23:19:08.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.994+0000 7f59c8c00640 1 -- 172.21.15.144:0/3279028970 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b40041c0 con 0x7f59cc0d3f60 2024-09-11T23:19:08.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.994+0000 7f59c8c00640 1 -- 172.21.15.144:0/3279028970 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b4004390 con 0x7f59cc0d3f60 2024-09-11T23:19:08.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.994+0000 7f59d1c00640 1 -- 172.21.15.144:0/3279028970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59cc0c8e00 con 0x7f59cc0d3f60 2024-09-11T23:19:08.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.994+0000 7f59d1c00640 1 -- 172.21.15.144:0/3279028970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59cc0c93c0 con 0x7f59cc0d3f60 2024-09-11T23:19:08.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.995+0000 7f59d1c00640 1 -- 172.21.15.144:0/3279028970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59cc068cd0 con 0x7f59cc0d3f60 2024-09-11T23:19:08.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.996+0000 7f59c8c00640 1 -- 172.21.15.144:0/3279028970 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f59b401b020 con 0x7f59cc0d3f60 2024-09-11T23:19:08.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.996+0000 7f59c8c00640 1 --2- 172.21.15.144:0/3279028970 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f59a806bfe0 0x7f59a806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:08.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.997+0000 7f59c8c00640 1 -- 172.21.15.144:0/3279028970 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f59b408adb0 con 0x7f59cc0d3f60 2024-09-11T23:19:08.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.997+0000 7f59cbe00640 1 --2- 172.21.15.144:0/3279028970 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f59a806bfe0 0x7f59a806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:08.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:08.997+0000 7f59cbe00640 1 --2- 172.21.15.144:0/3279028970 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f59a806bfe0 0x7f59a806e4a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f59bc034000 tx=0x7f59bc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:09.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.001+0000 7f59c8c00640 1 -- 172.21.15.144:0/3279028970 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59cc068cd0 con 0x7f59cc0d3f60 2024-09-11T23:19:09.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.213+0000 7f59d1c00640 1 -- 172.21.15.144:0/3279028970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59cc0b5fd0 con 0x7f59cc0d3f60 2024-09-11T23:19:09.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.214+0000 7f59c8c00640 1 -- 172.21.15.144:0/3279028970 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5229 (secure 0 0 0) 0x7f59b4058f20 con 0x7f59cc0d3f60 2024-09-11T23:19:09.214 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:09.214 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":18,"btime":"2024-09-11T23:19:03:236797+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4601,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/4045809607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":4045809607},{"type":"v1","addr":"172.21.15.165:6835","nonce":4045809607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2584561527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2584561527},{"type":"v1","addr":"172.21.15.165:6834","nonce":2584561527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4815,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/787593912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":787593912},{"type":"v1","addr":"172.21.15.144:6836","nonce":787593912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:18:48.405093+0000","modified":"2024-09-11T23:18:51.419894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4818},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4818":{"gid":4818,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/163510896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":163510896},{"type":"v1","addr":"172.21.15.144:6837","nonce":163510896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4818,"qdb_cluster":[4818]},"id":2}]} 2024-09-11T23:19:09.214 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 18 2024-09-11T23:19:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.216+0000 7f59d1c00640 1 -- 172.21.15.144:0/3279028970 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f59a806bfe0 msgr2=0x7f59a806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.216+0000 7f59d1c00640 1 --2- 172.21.15.144:0/3279028970 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f59a806bfe0 0x7f59a806e4a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f59bc034000 tx=0x7f59bc02e000 comp rx=0 tx=0).stop 2024-09-11T23:19:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.216+0000 7f59d1c00640 1 -- 172.21.15.144:0/3279028970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59cc0d3f60 msgr2=0x7f59cc0cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.216+0000 7f59d1c00640 1 --2- 172.21.15.144:0/3279028970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59cc0d3f60 0x7f59cc0cd490 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f59b400d800 tx=0x7f59b400dcc0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.216+0000 7f59d1c00640 1 -- 172.21.15.144:0/3279028970 shutdown_connections 2024-09-11T23:19:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.216+0000 7f59d1c00640 1 --2- 172.21.15.144:0/3279028970 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f59a806bfe0 0x7f59a806e4a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.216+0000 7f59d1c00640 1 --2- 172.21.15.144:0/3279028970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59cc15e640 0x7f59cc1e8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.216+0000 7f59d1c00640 1 --2- 172.21.15.144:0/3279028970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59cc0d3f60 0x7f59cc0cd490 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.216+0000 7f59d1c00640 1 --2- 172.21.15.144:0/3279028970 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59cc0b6510 0x7f59cc151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.216+0000 7f59d1c00640 1 -- 172.21.15.144:0/3279028970 >> 172.21.15.144:0/3279028970 conn(0x7f59cc0d0fd0 msgr2=0x7f59cc0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:09.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.217+0000 7f59d1c00640 1 -- 172.21.15.144:0/3279028970 shutdown_connections 2024-09-11T23:19:09.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.217+0000 7f59d1c00640 1 -- 172.21.15.144:0/3279028970 wait complete. 2024-09-11T23:19:09.232 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:09.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.388+0000 7f05b0e00640 1 Processor -- start 2024-09-11T23:19:09.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.388+0000 7f05b0e00640 1 -- start start 2024-09-11T23:19:09.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.389+0000 7f05b0e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f05ac15ceb0 0x7f05ac1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:09.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.389+0000 7f05b0e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05ac15d390 con 0x7f05ac0d02a0 2024-09-11T23:19:09.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.389+0000 7f05b0e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05ac15d670 con 0x7f05ac15ca40 2024-09-11T23:19:09.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.389+0000 7f05b0e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f05ac15d950 con 0x7f05ac15ceb0 2024-09-11T23:19:09.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.389+0000 7f05a9e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f05ac0d02a0 0x7f05ac0d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44402/0 (socket says 172.21.15.144:44402) 2024-09-11T23:19:09.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.389+0000 7f05a9e00640 1 -- 172.21.15.144:0/1934640707 learned_addr learned my addr 172.21.15.144:0/1934640707 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:09.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.389+0000 7f05aa800640 1 --2- 172.21.15.144:0/1934640707 >> v2:172.21.15.144:3300/0 conn(0x7f05ac15ceb0 0x7f05ac1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:09.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.390+0000 7f05aa800640 1 -- 172.21.15.144:0/1934640707 >> v1:172.21.15.165:6789/0 conn(0x7f05ac15ca40 legacy=0x7f05ac15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.390+0000 7f05aa800640 1 -- 172.21.15.144:0/1934640707 >> v1:172.21.15.144:6789/0 conn(0x7f05ac0d02a0 legacy=0x7f05ac0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.390+0000 7f05aa800640 1 -- 172.21.15.144:0/1934640707 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ac15dc30 con 0x7f05ac15ceb0 2024-09-11T23:19:09.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.391+0000 7f05aa800640 1 --2- 172.21.15.144:0/1934640707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05ac15ceb0 0x7f05ac1594c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009d90 tx=0x7f05a402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bb9b0c069553dc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:09.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.391+0000 7f05a9400640 1 -- 172.21.15.144:0/1934640707 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4007740 con 0x7f05ac15ceb0 2024-09-11T23:19:09.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.391+0000 7f05a9400640 1 -- 172.21.15.144:0/1934640707 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a40078e0 con 0x7f05ac15ceb0 2024-09-11T23:19:09.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.391+0000 7f05a9400640 1 -- 172.21.15.144:0/1934640707 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4007cb0 con 0x7f05ac15ceb0 2024-09-11T23:19:09.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.392+0000 7f05b0e00640 1 -- 172.21.15.144:0/1934640707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05ac15ceb0 msgr2=0x7f05ac1594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.392+0000 7f05b0e00640 1 --2- 172.21.15.144:0/1934640707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05ac15ceb0 0x7f05ac1594c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009d90 tx=0x7f05a402a660 comp rx=0 tx=0).stop 2024-09-11T23:19:09.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.392+0000 7f05b0e00640 1 -- 172.21.15.144:0/1934640707 shutdown_connections 2024-09-11T23:19:09.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.392+0000 7f05b0e00640 1 --2- 172.21.15.144:0/1934640707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05ac15ceb0 0x7f05ac1594c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.392+0000 7f05b0e00640 1 -- 172.21.15.144:0/1934640707 >> 172.21.15.144:0/1934640707 conn(0x7f05ac062cc0 msgr2=0x7f05ac06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:09.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.392+0000 7f05b0e00640 1 -- 172.21.15.144:0/1934640707 shutdown_connections 2024-09-11T23:19:09.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.392+0000 7f05b0e00640 1 -- 172.21.15.144:0/1934640707 wait complete. 2024-09-11T23:19:09.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.393+0000 7f05b0e00640 1 Processor -- start 2024-09-11T23:19:09.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.393+0000 7f05b0e00640 1 -- start start 2024-09-11T23:19:09.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.394+0000 7f05b0e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05ac0d02a0 0x7f05ac14cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:09.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.394+0000 7f05b0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05ac15ca40 0x7f05ac158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:09.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.394+0000 7f05b0e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05ac15ceb0 0x7f05ac14e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:09.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.394+0000 7f05b0e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac155b90 con 0x7f05ac15ca40 2024-09-11T23:19:09.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.394+0000 7f05b0e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac15eb40 con 0x7f05ac15ceb0 2024-09-11T23:19:09.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.394+0000 7f05b0e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f05ac155d10 con 0x7f05ac0d02a0 2024-09-11T23:19:09.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.395+0000 7f05a1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05ac15ca40 0x7f05ac158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:09.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.395+0000 7f05a1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05ac15ca40 0x7f05ac158770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33240/0 (socket says 172.21.15.144:33240) 2024-09-11T23:19:09.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.395+0000 7f05a1400640 1 -- 172.21.15.144:0/3173005682 learned_addr learned my addr 172.21.15.144:0/3173005682 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:09.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.395+0000 7f05a9e00640 1 --2- 172.21.15.144:0/3173005682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05ac0d02a0 0x7f05ac14cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:09.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.395+0000 7f05aa800640 1 --2- 172.21.15.144:0/3173005682 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05ac15ceb0 0x7f05ac14e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:09.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.395+0000 7f05a1400640 1 -- 172.21.15.144:0/3173005682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05ac0d02a0 msgr2=0x7f05ac14cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.395+0000 7f05a1400640 1 --2- 172.21.15.144:0/3173005682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05ac0d02a0 0x7f05ac14cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.395+0000 7f05a1400640 1 -- 172.21.15.144:0/3173005682 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05ac15ceb0 msgr2=0x7f05ac14e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.395+0000 7f05a1400640 1 --2- 172.21.15.144:0/3173005682 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05ac15ceb0 0x7f05ac14e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.395+0000 7f05a1400640 1 -- 172.21.15.144:0/3173005682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ac0aeac0 con 0x7f05ac15ca40 2024-09-11T23:19:09.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.395+0000 7f05a1400640 1 --2- 172.21.15.144:0/3173005682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05ac15ca40 0x7f05ac158770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f059400c430 tx=0x7f059400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:09.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.396+0000 7f05a2a00640 1 -- 172.21.15.144:0/3173005682 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05940052d0 con 0x7f05ac15ca40 2024-09-11T23:19:09.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.396+0000 7f05a2a00640 1 -- 172.21.15.144:0/3173005682 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0594005490 con 0x7f05ac15ca40 2024-09-11T23:19:09.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.396+0000 7f05a2a00640 1 -- 172.21.15.144:0/3173005682 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0594007260 con 0x7f05ac15ca40 2024-09-11T23:19:09.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.396+0000 7f05b0e00640 1 -- 172.21.15.144:0/3173005682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05ac0aeda0 con 0x7f05ac15ca40 2024-09-11T23:19:09.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.396+0000 7f05b0e00640 1 -- 172.21.15.144:0/3173005682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05ac0af360 con 0x7f05ac15ca40 2024-09-11T23:19:09.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.397+0000 7f05b0e00640 1 -- 172.21.15.144:0/3173005682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05ac0b4790 con 0x7f05ac15ca40 2024-09-11T23:19:09.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.398+0000 7f05a2a00640 1 -- 172.21.15.144:0/3173005682 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f0594007400 con 0x7f05ac15ca40 2024-09-11T23:19:09.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.399+0000 7f05a2a00640 1 --2- 172.21.15.144:0/3173005682 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f058806bfe0 0x7f058806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:09.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.399+0000 7f05a2a00640 1 -- 172.21.15.144:0/3173005682 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f059408a5c0 con 0x7f05ac15ca40 2024-09-11T23:19:09.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.399+0000 7f05a9e00640 1 --2- 172.21.15.144:0/3173005682 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f058806bfe0 0x7f058806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:09.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.400+0000 7f05a9e00640 1 --2- 172.21.15.144:0/3173005682 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f058806bfe0 0x7f058806e4a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f059c005880 tx=0x7f059c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:09.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.403+0000 7f05a2a00640 1 -- 172.21.15.144:0/3173005682 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05940586c0 con 0x7f05ac15ca40 2024-09-11T23:19:09.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.610+0000 7f05b0e00640 1 -- 172.21.15.144:0/3173005682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05ac0d0680 con 0x7f05ac15ca40 2024-09-11T23:19:09.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.611+0000 7f05a2a00640 1 -- 172.21.15.144:0/3173005682 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5229 (secure 0 0 0) 0x7f059405c9c0 con 0x7f05ac15ca40 2024-09-11T23:19:09.611 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:09.611 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":18,"btime":"2024-09-11T23:19:03:236797+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4601,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/4045809607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":4045809607},{"type":"v1","addr":"172.21.15.165:6835","nonce":4045809607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2584561527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2584561527},{"type":"v1","addr":"172.21.15.165:6834","nonce":2584561527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4815,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/787593912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":787593912},{"type":"v1","addr":"172.21.15.144:6836","nonce":787593912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:18:48.405093+0000","modified":"2024-09-11T23:18:51.419894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4818},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4818":{"gid":4818,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/163510896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":163510896},{"type":"v1","addr":"172.21.15.144:6837","nonce":163510896}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4818,"qdb_cluster":[4818]},"id":2}]} 2024-09-11T23:19:09.611 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 18 2024-09-11T23:19:09.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.613+0000 7f05b0e00640 1 -- 172.21.15.144:0/3173005682 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f058806bfe0 msgr2=0x7f058806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.613+0000 7f05b0e00640 1 --2- 172.21.15.144:0/3173005682 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f058806bfe0 0x7f058806e4a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f059c005880 tx=0x7f059c009040 comp rx=0 tx=0).stop 2024-09-11T23:19:09.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.613+0000 7f05b0e00640 1 -- 172.21.15.144:0/3173005682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05ac15ca40 msgr2=0x7f05ac158770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.613+0000 7f05b0e00640 1 --2- 172.21.15.144:0/3173005682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05ac15ca40 0x7f05ac158770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f059400c430 tx=0x7f059400c8f0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.613+0000 7f05b0e00640 1 -- 172.21.15.144:0/3173005682 shutdown_connections 2024-09-11T23:19:09.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.613+0000 7f05b0e00640 1 --2- 172.21.15.144:0/3173005682 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f058806bfe0 0x7f058806e4a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.613+0000 7f05b0e00640 1 --2- 172.21.15.144:0/3173005682 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05ac15ceb0 0x7f05ac14e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.613+0000 7f05b0e00640 1 --2- 172.21.15.144:0/3173005682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05ac15ca40 0x7f05ac158770 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.613+0000 7f05b0e00640 1 --2- 172.21.15.144:0/3173005682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05ac0d02a0 0x7f05ac14cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.613+0000 7f05b0e00640 1 -- 172.21.15.144:0/3173005682 >> 172.21.15.144:0/3173005682 conn(0x7f05ac062cc0 msgr2=0x7f05ac154190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:09.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.613+0000 7f05b0e00640 1 -- 172.21.15.144:0/3173005682 shutdown_connections 2024-09-11T23:19:09.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.613+0000 7f05b0e00640 1 -- 172.21.15.144:0/3173005682 wait complete. 2024-09-11T23:19:09.628 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:19:09.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.782+0000 7fe18f200640 1 Processor -- start 2024-09-11T23:19:09.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.782+0000 7fe18f200640 1 -- start start 2024-09-11T23:19:09.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.784+0000 7fe18f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe19006e8f0 0x7fe1900cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:09.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.784+0000 7fe18f200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1900d0070 con 0x7fe1900ce740 2024-09-11T23:19:09.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.784+0000 7fe18f200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1900d12a0 con 0x7fe19015e4f0 2024-09-11T23:19:09.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.784+0000 7fe18f200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe1900d1580 con 0x7fe19006e8f0 2024-09-11T23:19:09.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.784+0000 7fe18e800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe1900ce740 0x7fe1900b4890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44414/0 (socket says 172.21.15.144:44414) 2024-09-11T23:19:09.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.784+0000 7fe18e800640 1 -- 172.21.15.144:0/1734626799 learned_addr learned my addr 172.21.15.144:0/1734626799 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:09.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.784+0000 7fe185400640 1 --2- 172.21.15.144:0/1734626799 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe19006e8f0 0x7fe1900cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:09.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.785+0000 7fe18d400640 1 -- 172.21.15.144:0/1734626799 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1497634175 0 0) 0x7fe1900d0070 con 0x7fe1900ce740 2024-09-11T23:19:09.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.785+0000 7fe18d400640 1 -- 172.21.15.144:0/1734626799 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe174003520 con 0x7fe1900ce740 2024-09-11T23:19:09.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.785+0000 7fe185400640 1 -- 172.21.15.144:0/1734626799 >> v1:172.21.15.165:6789/0 conn(0x7fe19015e4f0 legacy=0x7fe19006e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.785+0000 7fe185400640 1 -- 172.21.15.144:0/1734626799 >> v1:172.21.15.144:6789/0 conn(0x7fe1900ce740 legacy=0x7fe1900b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.785+0000 7fe185400640 1 -- 172.21.15.144:0/1734626799 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1900d1860 con 0x7fe19006e8f0 2024-09-11T23:19:09.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.786+0000 7fe185400640 1 --2- 172.21.15.144:0/1734626799 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe19006e8f0 0x7fe1900cdb60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe1780097d0 tx=0x7fe17802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff94ed9296a2bdcb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:09.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.786+0000 7fe18d400640 1 -- 172.21.15.144:0/1734626799 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178037070 con 0x7fe19006e8f0 2024-09-11T23:19:09.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.786+0000 7fe18d400640 1 -- 172.21.15.144:0/1734626799 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe178032440 con 0x7fe19006e8f0 2024-09-11T23:19:09.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.786+0000 7fe18d400640 1 -- 172.21.15.144:0/1734626799 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1780327f0 con 0x7fe19006e8f0 2024-09-11T23:19:09.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.787+0000 7fe18f200640 1 -- 172.21.15.144:0/1734626799 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe19006e8f0 msgr2=0x7fe1900cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.787+0000 7fe18f200640 1 --2- 172.21.15.144:0/1734626799 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe19006e8f0 0x7fe1900cdb60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe1780097d0 tx=0x7fe17802a180 comp rx=0 tx=0).stop 2024-09-11T23:19:09.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.787+0000 7fe18f200640 1 -- 172.21.15.144:0/1734626799 shutdown_connections 2024-09-11T23:19:09.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.787+0000 7fe18f200640 1 --2- 172.21.15.144:0/1734626799 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe19006e8f0 0x7fe1900cdb60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.787+0000 7fe18f200640 1 -- 172.21.15.144:0/1734626799 >> 172.21.15.144:0/1734626799 conn(0x7fe1900b6700 msgr2=0x7fe1900b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:09.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.787+0000 7fe18f200640 1 -- 172.21.15.144:0/1734626799 shutdown_connections 2024-09-11T23:19:09.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.787+0000 7fe18f200640 1 -- 172.21.15.144:0/1734626799 wait complete. 2024-09-11T23:19:09.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.789+0000 7fe18f200640 1 Processor -- start 2024-09-11T23:19:09.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.789+0000 7fe18f200640 1 -- start start 2024-09-11T23:19:09.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.790+0000 7fe18f200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe19006e8f0 0x7fe19014cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:09.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.790+0000 7fe18f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1900ce740 0x7fe1900c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:09.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.790+0000 7fe18f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe19015e4f0 0x7fe1900c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:09.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.790+0000 7fe18f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe19015e8d0 con 0x7fe1900ce740 2024-09-11T23:19:09.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.790+0000 7fe18f200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe1900b4fa0 con 0x7fe19006e8f0 2024-09-11T23:19:09.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.790+0000 7fe18f200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe19015ff80 con 0x7fe19015e4f0 2024-09-11T23:19:09.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.790+0000 7fe185400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1900ce740 0x7fe1900c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:09.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.790+0000 7fe185400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1900ce740 0x7fe1900c6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33244/0 (socket says 172.21.15.144:33244) 2024-09-11T23:19:09.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.790+0000 7fe185400640 1 -- 172.21.15.144:0/2270527774 learned_addr learned my addr 172.21.15.144:0/2270527774 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:09.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.790+0000 7fe18de00640 1 --2- 172.21.15.144:0/2270527774 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe19006e8f0 0x7fe19014cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:09.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.790+0000 7fe18e800640 1 --2- 172.21.15.144:0/2270527774 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe19015e4f0 0x7fe1900c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:09.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.790+0000 7fe185400640 1 -- 172.21.15.144:0/2270527774 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe19015e4f0 msgr2=0x7fe1900c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.790+0000 7fe185400640 1 --2- 172.21.15.144:0/2270527774 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe19015e4f0 0x7fe1900c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.790+0000 7fe185400640 1 -- 172.21.15.144:0/2270527774 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe19006e8f0 msgr2=0x7fe19014cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.790+0000 7fe185400640 1 --2- 172.21.15.144:0/2270527774 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe19006e8f0 0x7fe19014cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.790+0000 7fe185400640 1 -- 172.21.15.144:0/2270527774 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1900b1450 con 0x7fe1900ce740 2024-09-11T23:19:09.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.790+0000 7fe18de00640 1 --2- 172.21.15.144:0/2270527774 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe19006e8f0 0x7fe19014cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:09.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.790+0000 7fe18e800640 1 --2- 172.21.15.144:0/2270527774 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe19015e4f0 0x7fe1900c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:09.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.791+0000 7fe185400640 1 --2- 172.21.15.144:0/2270527774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1900ce740 0x7fe1900c6230 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe178035040 tx=0x7fe1780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:09.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.791+0000 7fe186a00640 1 -- 172.21.15.144:0/2270527774 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178037050 con 0x7fe1900ce740 2024-09-11T23:19:09.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.791+0000 7fe186a00640 1 -- 172.21.15.144:0/2270527774 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe178043070 con 0x7fe1900ce740 2024-09-11T23:19:09.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.791+0000 7fe18f200640 1 -- 172.21.15.144:0/2270527774 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1900b1730 con 0x7fe1900ce740 2024-09-11T23:19:09.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.791+0000 7fe186a00640 1 -- 172.21.15.144:0/2270527774 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178006e10 con 0x7fe1900ce740 2024-09-11T23:19:09.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.791+0000 7fe18f200640 1 -- 172.21.15.144:0/2270527774 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1900b1cf0 con 0x7fe1900ce740 2024-09-11T23:19:09.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.792+0000 7fe18f200640 1 -- 172.21.15.144:0/2270527774 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1900cdb60 con 0x7fe1900ce740 2024-09-11T23:19:09.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.793+0000 7fe186a00640 1 -- 172.21.15.144:0/2270527774 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fe178032810 con 0x7fe1900ce740 2024-09-11T23:19:09.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.794+0000 7fe186a00640 1 --2- 172.21.15.144:0/2270527774 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe16c06bfe0 0x7fe16c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:09.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.794+0000 7fe186a00640 1 -- 172.21.15.144:0/2270527774 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe1780abbf0 con 0x7fe1900ce740 2024-09-11T23:19:09.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.794+0000 7fe18de00640 1 --2- 172.21.15.144:0/2270527774 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe16c06bfe0 0x7fe16c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:09.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.795+0000 7fe18de00640 1 --2- 172.21.15.144:0/2270527774 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe16c06bfe0 0x7fe16c06e4a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe180000f60 tx=0x7fe180009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:09.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.798+0000 7fe186a00640 1 -- 172.21.15.144:0/2270527774 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe17807a3a0 con 0x7fe1900ce740 2024-09-11T23:19:09.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.973+0000 7fe18f200640 1 -- 172.21.15.144:0/2270527774 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe190073fd0 con 0x7fe1900ce740 2024-09-11T23:19:09.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.974+0000 7fe186a00640 1 -- 172.21.15.144:0/2270527774 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16753 (secure 0 0 0) 0x7fe178079ca0 con 0x7fe1900ce740 2024-09-11T23:19:09.974 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:09.975 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":34,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:18:49.999965+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:18:46.180295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-11T23:18:47.420116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:19:09.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.976+0000 7fe18f200640 1 -- 172.21.15.144:0/2270527774 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe16c06bfe0 msgr2=0x7fe16c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.976+0000 7fe18f200640 1 --2- 172.21.15.144:0/2270527774 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe16c06bfe0 0x7fe16c06e4a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe180000f60 tx=0x7fe180009040 comp rx=0 tx=0).stop 2024-09-11T23:19:09.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.977+0000 7fe18f200640 1 -- 172.21.15.144:0/2270527774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1900ce740 msgr2=0x7fe1900c6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:09.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.977+0000 7fe18f200640 1 --2- 172.21.15.144:0/2270527774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1900ce740 0x7fe1900c6230 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe178035040 tx=0x7fe1780046c0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.977+0000 7fe18f200640 1 -- 172.21.15.144:0/2270527774 shutdown_connections 2024-09-11T23:19:09.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.977+0000 7fe18f200640 1 --2- 172.21.15.144:0/2270527774 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe16c06bfe0 0x7fe16c06e4a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.977+0000 7fe18f200640 1 --2- 172.21.15.144:0/2270527774 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe19015e4f0 0x7fe1900c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.977+0000 7fe18f200640 1 --2- 172.21.15.144:0/2270527774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1900ce740 0x7fe1900c6230 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.977+0000 7fe18f200640 1 --2- 172.21.15.144:0/2270527774 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe19006e8f0 0x7fe19014cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:09.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.977+0000 7fe18f200640 1 -- 172.21.15.144:0/2270527774 >> 172.21.15.144:0/2270527774 conn(0x7fe1900b6700 msgr2=0x7fe1900aee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:09.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.977+0000 7fe18f200640 1 -- 172.21.15.144:0/2270527774 shutdown_connections 2024-09-11T23:19:09.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:09.977+0000 7fe18f200640 1 -- 172.21.15.144:0/2270527774 wait complete. 2024-09-11T23:19:09.992 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:19:10.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.147+0000 7fcb3c600640 1 Processor -- start 2024-09-11T23:19:10.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.147+0000 7fcb3c600640 1 -- start start 2024-09-11T23:19:10.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.148+0000 7fcb3c600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcb3415c180 0x7fcb340cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:10.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.149+0000 7fcb3c600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fcb340ce230 0x7fcb340cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:10.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.149+0000 7fcb3c600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb340ce740 con 0x7fcb340cf5b0 2024-09-11T23:19:10.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.149+0000 7fcb3c600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fcb34072640 con 0x7fcb340ce230 2024-09-11T23:19:10.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.149+0000 7fcb3c600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcb34072920 con 0x7fcb3415c180 2024-09-11T23:19:10.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.149+0000 7fcb39200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fcb340ce230 0x7fcb340cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:10.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.149+0000 7fcb39c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcb3415c180 0x7fcb340cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:10.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.149+0000 7fcb3a600640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fcb340cf5b0 0x7fcb34073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:44876/0 (socket says 172.21.15.144:44876) 2024-09-11T23:19:10.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.149+0000 7fcb3a600640 1 -- 172.21.15.144:0/4289689830 learned_addr learned my addr 172.21.15.144:0/4289689830 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:10.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.150+0000 7fcb39c00640 1 -- 172.21.15.144:0/4289689830 >> v2:172.21.15.165:3300/0 conn(0x7fcb340ce230 msgr2=0x7fcb340cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:10.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.150+0000 7fcb39c00640 1 --2- 172.21.15.144:0/4289689830 >> v2:172.21.15.165:3300/0 conn(0x7fcb340ce230 0x7fcb340cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.150+0000 7fcb39c00640 1 -- 172.21.15.144:0/4289689830 >> v1:172.21.15.165:6789/0 conn(0x7fcb340cf5b0 legacy=0x7fcb34073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:10.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.150+0000 7fcb39c00640 1 -- 172.21.15.144:0/4289689830 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb34072c00 con 0x7fcb3415c180 2024-09-11T23:19:10.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.150+0000 7fcb39200640 1 --2- 172.21.15.144:0/4289689830 >> v2:172.21.15.165:3300/0 conn(0x7fcb340ce230 0x7fcb340cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:19:10.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.150+0000 7fcb33e00640 1 -- 172.21.15.144:0/4289689830 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1112322287 0 0) 0x7fcb340ce740 con 0x7fcb340cf5b0 2024-09-11T23:19:10.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.151+0000 7fcb39c00640 1 --2- 172.21.15.144:0/4289689830 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcb3415c180 0x7fcb340cdcf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcb280097a0 tx=0x7fcb2802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a31395d7a9594b42 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.151+0000 7fcb33e00640 1 -- 172.21.15.144:0/4289689830 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb28037070 con 0x7fcb3415c180 2024-09-11T23:19:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.151+0000 7fcb33e00640 1 -- 172.21.15.144:0/4289689830 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb2802ae50 con 0x7fcb3415c180 2024-09-11T23:19:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.151+0000 7fcb33e00640 1 -- 172.21.15.144:0/4289689830 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb28032660 con 0x7fcb3415c180 2024-09-11T23:19:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.152+0000 7fcb3c600640 1 -- 172.21.15.144:0/4289689830 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcb3415c180 msgr2=0x7fcb340cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.152+0000 7fcb3c600640 1 --2- 172.21.15.144:0/4289689830 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcb3415c180 0x7fcb340cdcf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcb280097a0 tx=0x7fcb2802a100 comp rx=0 tx=0).stop 2024-09-11T23:19:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.152+0000 7fcb3c600640 1 -- 172.21.15.144:0/4289689830 shutdown_connections 2024-09-11T23:19:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.152+0000 7fcb3c600640 1 --2- 172.21.15.144:0/4289689830 >> v2:172.21.15.165:3300/0 conn(0x7fcb340ce230 0x7fcb340cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.152+0000 7fcb3c600640 1 --2- 172.21.15.144:0/4289689830 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcb3415c180 0x7fcb340cdcf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.152+0000 7fcb3c600640 1 -- 172.21.15.144:0/4289689830 >> 172.21.15.144:0/4289689830 conn(0x7fcb34062cc0 msgr2=0x7fcb3406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.152+0000 7fcb3c600640 1 -- 172.21.15.144:0/4289689830 shutdown_connections 2024-09-11T23:19:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.152+0000 7fcb3c600640 1 -- 172.21.15.144:0/4289689830 wait complete. 2024-09-11T23:19:10.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.153+0000 7fcb3c600640 1 Processor -- start 2024-09-11T23:19:10.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.154+0000 7fcb3c600640 1 -- start start 2024-09-11T23:19:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.154+0000 7fcb3c600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcb340ce230 0x7fcb3413ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.154+0000 7fcb3c600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb340cf5b0 0x7fcb3415c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.154+0000 7fcb3c600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb3415c180 0x7fcb3415ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.154+0000 7fcb3c600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3415c560 con 0x7fcb340cf5b0 2024-09-11T23:19:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.154+0000 7fcb3c600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcb340722f0 con 0x7fcb3415c180 2024-09-11T23:19:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.154+0000 7fcb3c600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcb3415c6e0 con 0x7fcb340ce230 2024-09-11T23:19:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.155+0000 7fcb39200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb340cf5b0 0x7fcb3415c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.155+0000 7fcb39200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb340cf5b0 0x7fcb3415c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33258/0 (socket says 172.21.15.144:33258) 2024-09-11T23:19:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.155+0000 7fcb39200640 1 -- 172.21.15.144:0/1819114824 learned_addr learned my addr 172.21.15.144:0/1819114824 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.155+0000 7fcb39c00640 1 --2- 172.21.15.144:0/1819114824 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcb340ce230 0x7fcb3413ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.155+0000 7fcb3a600640 1 --2- 172.21.15.144:0/1819114824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb3415c180 0x7fcb3415ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.155+0000 7fcb39200640 1 -- 172.21.15.144:0/1819114824 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcb340ce230 msgr2=0x7fcb3413ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.155+0000 7fcb39200640 1 --2- 172.21.15.144:0/1819114824 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcb340ce230 0x7fcb3413ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.155+0000 7fcb39200640 1 -- 172.21.15.144:0/1819114824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb3415c180 msgr2=0x7fcb3415ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.155+0000 7fcb39200640 1 --2- 172.21.15.144:0/1819114824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb3415c180 0x7fcb3415ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.155+0000 7fcb39200640 1 -- 172.21.15.144:0/1819114824 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb3413f980 con 0x7fcb340cf5b0 2024-09-11T23:19:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.155+0000 7fcb39200640 1 --2- 172.21.15.144:0/1819114824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb340cf5b0 0x7fcb3415c920 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000e940 tx=0x7fcb2000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.156+0000 7fcb31600640 1 -- 172.21.15.144:0/1819114824 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb20017070 con 0x7fcb340cf5b0 2024-09-11T23:19:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.156+0000 7fcb31600640 1 -- 172.21.15.144:0/1819114824 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb2000ca00 con 0x7fcb340cf5b0 2024-09-11T23:19:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.156+0000 7fcb31600640 1 -- 172.21.15.144:0/1819114824 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2000cdd0 con 0x7fcb340cf5b0 2024-09-11T23:19:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.156+0000 7fcb3c600640 1 -- 172.21.15.144:0/1819114824 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb3413fc60 con 0x7fcb340cf5b0 2024-09-11T23:19:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.156+0000 7fcb3c600640 1 -- 172.21.15.144:0/1819114824 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb3413f3d0 con 0x7fcb340cf5b0 2024-09-11T23:19:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.157+0000 7fcb3c600640 1 -- 172.21.15.144:0/1819114824 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb340cf070 con 0x7fcb340cf5b0 2024-09-11T23:19:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.158+0000 7fcb31600640 1 -- 172.21.15.144:0/1819114824 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fcb2001a070 con 0x7fcb340cf5b0 2024-09-11T23:19:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.159+0000 7fcb31600640 1 --2- 172.21.15.144:0/1819114824 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fcb1406bfe0 0x7fcb1406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.159+0000 7fcb31600640 1 -- 172.21.15.144:0/1819114824 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fcb2008b320 con 0x7fcb340cf5b0 2024-09-11T23:19:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.159+0000 7fcb39c00640 1 --2- 172.21.15.144:0/1819114824 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fcb1406bfe0 0x7fcb1406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.159+0000 7fcb39c00640 1 --2- 172.21.15.144:0/1819114824 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fcb1406bfe0 0x7fcb1406e4a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcb28034000 tx=0x7fcb2802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:10.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.163+0000 7fcb31600640 1 -- 172.21.15.144:0/1819114824 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb20059380 con 0x7fcb340cf5b0 2024-09-11T23:19:10.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.373+0000 7fcb3c600640 1 -- 172.21.15.144:0/1819114824 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fcb340d0710 con 0x7fcb340cf5b0 2024-09-11T23:19:10.374 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-11T23:19:10.374+0000 7f86fcc00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:19:10.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.376+0000 7fcb31600640 1 -- 172.21.15.144:0/1819114824 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7fcb2005d680 con 0x7fcb340cf5b0 2024-09-11T23:19:10.376 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:19:10.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.379+0000 7fcb3c600640 1 -- 172.21.15.144:0/1819114824 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fcb1406bfe0 msgr2=0x7fcb1406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:10.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.379+0000 7fcb3c600640 1 --2- 172.21.15.144:0/1819114824 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fcb1406bfe0 0x7fcb1406e4a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcb28034000 tx=0x7fcb2802e000 comp rx=0 tx=0).stop 2024-09-11T23:19:10.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.379+0000 7fcb3c600640 1 -- 172.21.15.144:0/1819114824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb340cf5b0 msgr2=0x7fcb3415c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:10.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.379+0000 7fcb3c600640 1 --2- 172.21.15.144:0/1819114824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb340cf5b0 0x7fcb3415c920 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000e940 tx=0x7fcb2000ee00 comp rx=0 tx=0).stop 2024-09-11T23:19:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.380+0000 7fcb3c600640 1 -- 172.21.15.144:0/1819114824 shutdown_connections 2024-09-11T23:19:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.380+0000 7fcb3c600640 1 --2- 172.21.15.144:0/1819114824 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fcb1406bfe0 0x7fcb1406e4a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.380+0000 7fcb3c600640 1 --2- 172.21.15.144:0/1819114824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb3415c180 0x7fcb3415ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.380+0000 7fcb3c600640 1 --2- 172.21.15.144:0/1819114824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb340cf5b0 0x7fcb3415c920 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.380+0000 7fcb3c600640 1 --2- 172.21.15.144:0/1819114824 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcb340ce230 0x7fcb3413ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.380+0000 7fcb3c600640 1 -- 172.21.15.144:0/1819114824 >> 172.21.15.144:0/1819114824 conn(0x7fcb34062cc0 msgr2=0x7fcb340cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.380+0000 7fcb3c600640 1 -- 172.21.15.144:0/1819114824 shutdown_connections 2024-09-11T23:19:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.380+0000 7fcb3c600640 1 -- 172.21.15.144:0/1819114824 wait complete. 2024-09-11T23:19:10.398 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:19:10.446 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-11T23:19:10.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.555+0000 7fdd7b200640 1 Processor -- start 2024-09-11T23:19:10.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.555+0000 7fdd7b200640 1 -- start start 2024-09-11T23:19:10.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.556+0000 7fdd7b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd7c06c2b0 0x7fdd7c15d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:10.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.556+0000 7fdd7b200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd7c0ce430 con 0x7fdd7c159dd0 2024-09-11T23:19:10.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.556+0000 7fdd7b200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd7c0cfd20 con 0x7fdd7c0cdfc0 2024-09-11T23:19:10.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.556+0000 7fdd7b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdd7c0cd4e0 con 0x7fdd7c06c2b0 2024-09-11T23:19:10.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.556+0000 7fdd79e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdd7c159dd0 0x7fdd7c0cf260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44428/0 (socket says 172.21.15.144:44428) 2024-09-11T23:19:10.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.556+0000 7fdd79e00640 1 -- 172.21.15.144:0/633618722 learned_addr learned my addr 172.21.15.144:0/633618722 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:10.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.557+0000 7fdd7a800640 1 --2- 172.21.15.144:0/633618722 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd7c06c2b0 0x7fdd7c15d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:10.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.557+0000 7fdd78a00640 1 -- 172.21.15.144:0/633618722 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3435189700 0 0) 0x7fdd7c0ce430 con 0x7fdd7c159dd0 2024-09-11T23:19:10.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.557+0000 7fdd78a00640 1 -- 172.21.15.144:0/633618722 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd60003520 con 0x7fdd7c159dd0 2024-09-11T23:19:10.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.557+0000 7fdd78a00640 1 -- 172.21.15.144:0/633618722 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3486125836 0 0) 0x7fdd7c0cfd20 con 0x7fdd7c0cdfc0 2024-09-11T23:19:10.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.557+0000 7fdd78a00640 1 -- 172.21.15.144:0/633618722 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd7c0ce430 con 0x7fdd7c0cdfc0 2024-09-11T23:19:10.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.557+0000 7fdd78a00640 1 -- 172.21.15.144:0/633618722 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1695798353 0 0) 0x7fdd60003520 con 0x7fdd7c159dd0 2024-09-11T23:19:10.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.557+0000 7fdd7a800640 1 -- 172.21.15.144:0/633618722 >> v1:172.21.15.165:6789/0 conn(0x7fdd7c0cdfc0 legacy=0x7fdd7c06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:10.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.557+0000 7fdd7a800640 1 -- 172.21.15.144:0/633618722 >> v1:172.21.15.144:6789/0 conn(0x7fdd7c159dd0 legacy=0x7fdd7c0cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:10.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.557+0000 7fdd7a800640 1 -- 172.21.15.144:0/633618722 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd7c0cd7c0 con 0x7fdd7c06c2b0 2024-09-11T23:19:10.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.558+0000 7fdd7a800640 1 --2- 172.21.15.144:0/633618722 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd7c06c2b0 0x7fdd7c15d9e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009dc0 tx=0x7fdd7402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7788f278a1ab8330 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:10.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.559+0000 7fdd78a00640 1 -- 172.21.15.144:0/633618722 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c001670 con 0x7fdd7c06c2b0 2024-09-11T23:19:10.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.559+0000 7fdd78a00640 1 -- 172.21.15.144:0/633618722 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd74007540 con 0x7fdd7c06c2b0 2024-09-11T23:19:10.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.559+0000 7fdd78a00640 1 -- 172.21.15.144:0/633618722 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd74007910 con 0x7fdd7c06c2b0 2024-09-11T23:19:10.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.559+0000 7fdd7b200640 1 -- 172.21.15.144:0/633618722 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd7c06c2b0 msgr2=0x7fdd7c15d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:10.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.559+0000 7fdd7b200640 1 --2- 172.21.15.144:0/633618722 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd7c06c2b0 0x7fdd7c15d9e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009dc0 tx=0x7fdd7402a660 comp rx=0 tx=0).stop 2024-09-11T23:19:10.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.559+0000 7fdd7b200640 1 -- 172.21.15.144:0/633618722 shutdown_connections 2024-09-11T23:19:10.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.559+0000 7fdd7b200640 1 --2- 172.21.15.144:0/633618722 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd7c06c2b0 0x7fdd7c15d9e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.559+0000 7fdd7b200640 1 -- 172.21.15.144:0/633618722 >> 172.21.15.144:0/633618722 conn(0x7fdd7c0d0300 msgr2=0x7fdd7c0d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:10.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.559+0000 7fdd7b200640 1 -- 172.21.15.144:0/633618722 shutdown_connections 2024-09-11T23:19:10.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.559+0000 7fdd7b200640 1 -- 172.21.15.144:0/633618722 wait complete. 2024-09-11T23:19:10.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.561+0000 7fdd7b200640 1 Processor -- start 2024-09-11T23:19:10.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.561+0000 7fdd7b200640 1 -- start start 2024-09-11T23:19:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.562+0000 7fdd7b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd7c06c2b0 0x7fdd7c1460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.562+0000 7fdd7b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd7c0cdfc0 0x7fdd7c1e9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.562+0000 7fdd7b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd7c159dd0 0x7fdd7c0ad170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.562+0000 7fdd7b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7c15d6d0 con 0x7fdd7c0cdfc0 2024-09-11T23:19:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.562+0000 7fdd7b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7c15a1b0 con 0x7fdd7c159dd0 2024-09-11T23:19:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.562+0000 7fdd7b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdd7c0cf970 con 0x7fdd7c06c2b0 2024-09-11T23:19:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.562+0000 7fdd79400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd7c0cdfc0 0x7fdd7c1e9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.562+0000 7fdd79400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd7c0cdfc0 0x7fdd7c1e9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33266/0 (socket says 172.21.15.144:33266) 2024-09-11T23:19:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.562+0000 7fdd79400640 1 -- 172.21.15.144:0/111633192 learned_addr learned my addr 172.21.15.144:0/111633192 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.562+0000 7fdd79e00640 1 --2- 172.21.15.144:0/111633192 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd7c06c2b0 0x7fdd7c1460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:10.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.562+0000 7fdd7a800640 1 --2- 172.21.15.144:0/111633192 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd7c159dd0 0x7fdd7c0ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:10.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.563+0000 7fdd79400640 1 -- 172.21.15.144:0/111633192 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd7c06c2b0 msgr2=0x7fdd7c1460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:10.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.563+0000 7fdd79400640 1 --2- 172.21.15.144:0/111633192 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd7c06c2b0 0x7fdd7c1460c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.563+0000 7fdd79400640 1 -- 172.21.15.144:0/111633192 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd7c159dd0 msgr2=0x7fdd7c0ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:10.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.563+0000 7fdd79400640 1 --2- 172.21.15.144:0/111633192 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd7c159dd0 0x7fdd7c0ad170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:10.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.563+0000 7fdd79400640 1 -- 172.21.15.144:0/111633192 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd7c0ab100 con 0x7fdd7c0cdfc0 2024-09-11T23:19:10.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.563+0000 7fdd7a800640 1 --2- 172.21.15.144:0/111633192 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd7c159dd0 0x7fdd7c0ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:10.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.563+0000 7fdd79400640 1 --2- 172.21.15.144:0/111633192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd7c0cdfc0 0x7fdd7c1e9100 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdd6800c4c0 tx=0x7fdd6800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:10.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.563+0000 7fdd72000640 1 -- 172.21.15.144:0/111633192 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd680052d0 con 0x7fdd7c0cdfc0 2024-09-11T23:19:10.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.563+0000 7fdd72000640 1 -- 172.21.15.144:0/111633192 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd68005470 con 0x7fdd7c0cdfc0 2024-09-11T23:19:10.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.563+0000 7fdd7b200640 1 -- 172.21.15.144:0/111633192 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd7c0ab3e0 con 0x7fdd7c0cdfc0 2024-09-11T23:19:10.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.563+0000 7fdd72000640 1 -- 172.21.15.144:0/111633192 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd68012870 con 0x7fdd7c0cdfc0 2024-09-11T23:19:10.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.564+0000 7fdd7b200640 1 -- 172.21.15.144:0/111633192 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd7c0ab9a0 con 0x7fdd7c0cdfc0 2024-09-11T23:19:10.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.565+0000 7fdd7b200640 1 -- 172.21.15.144:0/111633192 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd7c06bba0 con 0x7fdd7c0cdfc0 2024-09-11T23:19:10.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.565+0000 7fdd72000640 1 -- 172.21.15.144:0/111633192 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fdd68012a10 con 0x7fdd7c0cdfc0 2024-09-11T23:19:10.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.566+0000 7fdd72000640 1 --2- 172.21.15.144:0/111633192 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdd5c06c010 0x7fdd5c06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:10.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.566+0000 7fdd72000640 1 -- 172.21.15.144:0/111633192 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7fdd6808ad50 con 0x7fdd7c0cdfc0 2024-09-11T23:19:10.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.567+0000 7fdd79e00640 1 --2- 172.21.15.144:0/111633192 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdd5c06c010 0x7fdd5c06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:10.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.567+0000 7fdd79e00640 1 --2- 172.21.15.144:0/111633192 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdd5c06c010 0x7fdd5c06e4d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c0017e0 tx=0x7fdd6c001610 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:10.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.570+0000 7fdd72000640 1 -- 172.21.15.144:0/111633192 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd6808e030 con 0x7fdd7c0cdfc0 2024-09-11T23:19:10.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:10.784+0000 7fdd7b200640 1 -- 172.21.15.144:0/111633192 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fdd7c063280 con 0x7fdd7c0cdfc0 2024-09-11T23:19:11.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.381+0000 7fdd72000640 1 -- 172.21.15.144:0/111633192 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7fdd68059430 con 0x7fdd7c0cdfc0 2024-09-11T23:19:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.384+0000 7fdd7b200640 1 -- 172.21.15.144:0/111633192 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdd5c06c010 msgr2=0x7fdd5c06e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.384+0000 7fdd7b200640 1 --2- 172.21.15.144:0/111633192 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdd5c06c010 0x7fdd5c06e4d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c0017e0 tx=0x7fdd6c001610 comp rx=0 tx=0).stop 2024-09-11T23:19:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.384+0000 7fdd7b200640 1 -- 172.21.15.144:0/111633192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd7c0cdfc0 msgr2=0x7fdd7c1e9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.384+0000 7fdd7b200640 1 --2- 172.21.15.144:0/111633192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd7c0cdfc0 0x7fdd7c1e9100 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdd6800c4c0 tx=0x7fdd6800c980 comp rx=0 tx=0).stop 2024-09-11T23:19:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.384+0000 7fdd7b200640 1 -- 172.21.15.144:0/111633192 shutdown_connections 2024-09-11T23:19:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.384+0000 7fdd7b200640 1 --2- 172.21.15.144:0/111633192 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdd5c06c010 0x7fdd5c06e4d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.384+0000 7fdd7b200640 1 --2- 172.21.15.144:0/111633192 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd7c159dd0 0x7fdd7c0ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.384+0000 7fdd7b200640 1 --2- 172.21.15.144:0/111633192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd7c0cdfc0 0x7fdd7c1e9100 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.384+0000 7fdd7b200640 1 --2- 172.21.15.144:0/111633192 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd7c06c2b0 0x7fdd7c1460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.384+0000 7fdd7b200640 1 -- 172.21.15.144:0/111633192 >> 172.21.15.144:0/111633192 conn(0x7fdd7c0d0300 msgr2=0x7fdd7c15aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:11.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.384+0000 7fdd7b200640 1 -- 172.21.15.144:0/111633192 shutdown_connections 2024-09-11T23:19:11.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.384+0000 7fdd7b200640 1 -- 172.21.15.144:0/111633192 wait complete. 2024-09-11T23:19:11.403 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:19:11.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.560+0000 7f0ad7a00640 1 Processor -- start 2024-09-11T23:19:11.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.560+0000 7f0ad7a00640 1 -- start start 2024-09-11T23:19:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.561+0000 7f0ad7a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0ad00cd920 0x7f0ad006d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.561+0000 7f0ad7a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0ad00cffe0 0x7f0ad015cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.561+0000 7f0ad7a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad015d880 con 0x7f0ad00cdd00 2024-09-11T23:19:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.561+0000 7f0ad7a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0ad00b42c0 con 0x7f0ad00cffe0 2024-09-11T23:19:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.561+0000 7f0ad7a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0ad00b45a0 con 0x7f0ad00cd920 2024-09-11T23:19:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.561+0000 7f0ad5a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0ad00cffe0 0x7f0ad015cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.561+0000 7f0acfe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0ad00cdd00 0x7f0ad00cf8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44442/0 (socket says 172.21.15.144:44442) 2024-09-11T23:19:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.561+0000 7f0acfe00640 1 -- 172.21.15.144:0/3941278417 learned_addr learned my addr 172.21.15.144:0/3941278417 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.561+0000 7f0ad5a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0ad00cffe0 0x7f0ad015cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33272/0 (socket says 172.21.15.144:33272) 2024-09-11T23:19:11.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.562+0000 7f0ad5000640 1 --2- 172.21.15.144:0/3941278417 >> v2:172.21.15.165:3300/0 conn(0x7f0ad00cd920 0x7f0ad006d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.562+0000 7f0ad5a00640 1 -- 172.21.15.144:0/3941278417 >> v2:172.21.15.165:3300/0 conn(0x7f0ad00cd920 msgr2=0x7f0ad006d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:11.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.562+0000 7f0ad5a00640 1 --2- 172.21.15.144:0/3941278417 >> v2:172.21.15.165:3300/0 conn(0x7f0ad00cd920 0x7f0ad006d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.562+0000 7f0ad5a00640 1 -- 172.21.15.144:0/3941278417 >> v1:172.21.15.144:6789/0 conn(0x7f0ad00cdd00 legacy=0x7f0ad00cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.562+0000 7f0ad5a00640 1 -- 172.21.15.144:0/3941278417 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad00b4880 con 0x7f0ad00cffe0 2024-09-11T23:19:11.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.562+0000 7f0ad5000640 1 --2- 172.21.15.144:0/3941278417 >> v2:172.21.15.165:3300/0 conn(0x7f0ad00cd920 0x7f0ad006d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:11.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.563+0000 7f0ad5a00640 1 --2- 172.21.15.144:0/3941278417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad00cffe0 0x7f0ad015cb20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009d90 tx=0x7f0ac802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fddab3914b1f3316 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:11.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.563+0000 7f0acf400640 1 -- 172.21.15.144:0/3941278417 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8007740 con 0x7f0ad00cffe0 2024-09-11T23:19:11.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.563+0000 7f0acf400640 1 -- 172.21.15.144:0/3941278417 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ac80078e0 con 0x7f0ad00cffe0 2024-09-11T23:19:11.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.563+0000 7f0acf400640 1 -- 172.21.15.144:0/3941278417 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8007cb0 con 0x7f0ad00cffe0 2024-09-11T23:19:11.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.564+0000 7f0ad7a00640 1 -- 172.21.15.144:0/3941278417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad00cffe0 msgr2=0x7f0ad015cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.564+0000 7f0ad7a00640 1 --2- 172.21.15.144:0/3941278417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad00cffe0 0x7f0ad015cb20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009d90 tx=0x7f0ac802a6a0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.564+0000 7f0ad7a00640 1 -- 172.21.15.144:0/3941278417 shutdown_connections 2024-09-11T23:19:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.564+0000 7f0ad7a00640 1 --2- 172.21.15.144:0/3941278417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad00cffe0 0x7f0ad015cb20 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.564+0000 7f0ad7a00640 1 --2- 172.21.15.144:0/3941278417 >> v2:172.21.15.165:3300/0 conn(0x7f0ad00cd920 0x7f0ad006d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.564+0000 7f0ad7a00640 1 -- 172.21.15.144:0/3941278417 >> 172.21.15.144:0/3941278417 conn(0x7f0ad006bba0 msgr2=0x7f0ad006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.564+0000 7f0ad7a00640 1 -- 172.21.15.144:0/3941278417 shutdown_connections 2024-09-11T23:19:11.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.564+0000 7f0ad7a00640 1 -- 172.21.15.144:0/3941278417 wait complete. 2024-09-11T23:19:11.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.565+0000 7f0ad7a00640 1 Processor -- start 2024-09-11T23:19:11.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.566+0000 7f0ad7a00640 1 -- start start 2024-09-11T23:19:11.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.566+0000 7f0ad7a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ad00cd920 0x7f0ad00ac610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.566+0000 7f0ad7a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ad00cdd00 0x7f0ad0156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.566+0000 7f0ad7a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad00cffe0 0x7f0ad014f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.566+0000 7f0ad7a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad015d3f0 con 0x7f0ad00cffe0 2024-09-11T23:19:11.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.566+0000 7f0ad7a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad015d270 con 0x7f0ad00cdd00 2024-09-11T23:19:11.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.566+0000 7f0ad7a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad015d570 con 0x7f0ad00cd920 2024-09-11T23:19:11.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.567+0000 7f0ad5a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad00cffe0 0x7f0ad014f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.567+0000 7f0ad5a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad00cffe0 0x7f0ad014f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33274/0 (socket says 172.21.15.144:33274) 2024-09-11T23:19:11.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.567+0000 7f0ad5a00640 1 -- 172.21.15.144:0/1870027821 learned_addr learned my addr 172.21.15.144:0/1870027821 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:11.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.567+0000 7f0ad5000640 1 --2- 172.21.15.144:0/1870027821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ad00cd920 0x7f0ad00ac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.567+0000 7f0acfe00640 1 --2- 172.21.15.144:0/1870027821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ad00cdd00 0x7f0ad0156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.567+0000 7f0ad5a00640 1 -- 172.21.15.144:0/1870027821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ad00cd920 msgr2=0x7f0ad00ac610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.567+0000 7f0ad5a00640 1 --2- 172.21.15.144:0/1870027821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ad00cd920 0x7f0ad00ac610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.567+0000 7f0ad5a00640 1 -- 172.21.15.144:0/1870027821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ad00cdd00 msgr2=0x7f0ad0156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.567+0000 7f0ad5a00640 1 --2- 172.21.15.144:0/1870027821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ad00cdd00 0x7f0ad0156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.567+0000 7f0ad5a00640 1 -- 172.21.15.144:0/1870027821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad015ec00 con 0x7f0ad00cffe0 2024-09-11T23:19:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.567+0000 7f0ad5000640 1 --2- 172.21.15.144:0/1870027821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ad00cd920 0x7f0ad00ac610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.567+0000 7f0acfe00640 1 --2- 172.21.15.144:0/1870027821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ad00cdd00 0x7f0ad0156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.567+0000 7f0ad5a00640 1 --2- 172.21.15.144:0/1870027821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad00cffe0 0x7f0ad014f7c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009eb0 tx=0x7f0ac8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.568+0000 7f0accc00640 1 -- 172.21.15.144:0/1870027821 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac803f070 con 0x7f0ad00cffe0 2024-09-11T23:19:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.568+0000 7f0accc00640 1 -- 172.21.15.144:0/1870027821 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ac8031c90 con 0x7f0ad00cffe0 2024-09-11T23:19:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.568+0000 7f0accc00640 1 -- 172.21.15.144:0/1870027821 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8044680 con 0x7f0ad00cffe0 2024-09-11T23:19:11.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.568+0000 7f0ad7a00640 1 -- 172.21.15.144:0/1870027821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad00ab190 con 0x7f0ad00cffe0 2024-09-11T23:19:11.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.568+0000 7f0ad7a00640 1 -- 172.21.15.144:0/1870027821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad0156040 con 0x7f0ad00cffe0 2024-09-11T23:19:11.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.569+0000 7f0ad7a00640 1 -- 172.21.15.144:0/1870027821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad00b2da0 con 0x7f0ad00cffe0 2024-09-11T23:19:11.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.570+0000 7f0accc00640 1 -- 172.21.15.144:0/1870027821 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f0ac803b410 con 0x7f0ad00cffe0 2024-09-11T23:19:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.571+0000 7f0accc00640 1 --2- 172.21.15.144:0/1870027821 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0ab006bfe0 0x7f0ab006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.571+0000 7f0accc00640 1 -- 172.21.15.144:0/1870027821 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f0ac80acc90 con 0x7f0ad00cffe0 2024-09-11T23:19:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.571+0000 7f0ad5000640 1 --2- 172.21.15.144:0/1870027821 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0ab006bfe0 0x7f0ab006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:11.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.572+0000 7f0ad5000640 1 --2- 172.21.15.144:0/1870027821 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0ab006bfe0 0x7f0ab006e4a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0ac400aa30 tx=0x7f0ac4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:11.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.575+0000 7f0accc00640 1 -- 172.21.15.144:0/1870027821 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ad00b2da0 con 0x7f0ad00cffe0 2024-09-11T23:19:11.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:11.749+0000 7f0ad7a00640 1 -- 172.21.15.144:0/1870027821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0ad00b2ff0 con 0x7f0ad00cffe0 2024-09-11T23:19:12.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.383+0000 7f0accc00640 1 -- 172.21.15.144:0/1870027821 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7f0ad00b2ff0 con 0x7f0ad00cffe0 2024-09-11T23:19:12.383 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:19:12.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.386+0000 7f0ad7a00640 1 -- 172.21.15.144:0/1870027821 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0ab006bfe0 msgr2=0x7f0ab006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:12.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.386+0000 7f0ad7a00640 1 --2- 172.21.15.144:0/1870027821 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0ab006bfe0 0x7f0ab006e4a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0ac400aa30 tx=0x7f0ac4008040 comp rx=0 tx=0).stop 2024-09-11T23:19:12.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.386+0000 7f0ad7a00640 1 -- 172.21.15.144:0/1870027821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad00cffe0 msgr2=0x7f0ad014f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:12.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.386+0000 7f0ad7a00640 1 --2- 172.21.15.144:0/1870027821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad00cffe0 0x7f0ad014f7c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009eb0 tx=0x7f0ac8004a40 comp rx=0 tx=0).stop 2024-09-11T23:19:12.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.387+0000 7f0ad7a00640 1 -- 172.21.15.144:0/1870027821 shutdown_connections 2024-09-11T23:19:12.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.387+0000 7f0ad7a00640 1 --2- 172.21.15.144:0/1870027821 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0ab006bfe0 0x7f0ab006e4a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.387+0000 7f0ad7a00640 1 --2- 172.21.15.144:0/1870027821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ad00cffe0 0x7f0ad014f7c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.387+0000 7f0ad7a00640 1 --2- 172.21.15.144:0/1870027821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ad00cdd00 0x7f0ad0156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.387+0000 7f0ad7a00640 1 --2- 172.21.15.144:0/1870027821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0ad00cd920 0x7f0ad00ac610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.387+0000 7f0ad7a00640 1 -- 172.21.15.144:0/1870027821 >> 172.21.15.144:0/1870027821 conn(0x7f0ad006bba0 msgr2=0x7f0ad015c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:12.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.387+0000 7f0ad7a00640 1 -- 172.21.15.144:0/1870027821 shutdown_connections 2024-09-11T23:19:12.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.387+0000 7f0ad7a00640 1 -- 172.21.15.144:0/1870027821 wait complete. 2024-09-11T23:19:12.406 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:19:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.564+0000 7f9049600640 1 Processor -- start 2024-09-11T23:19:12.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.564+0000 7f9049600640 1 -- start start 2024-09-11T23:19:12.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.566+0000 7f9049600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9044148150 0x7f904406d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.566+0000 7f9049600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f904406d5c0 0x7f90440ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.566+0000 7f9049600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90440710e0 con 0x7f9044147d70 2024-09-11T23:19:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.566+0000 7f9049600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f90440b5700 con 0x7f9044148150 2024-09-11T23:19:12.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.566+0000 7f9049600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9044071350 con 0x7f904406d5c0 2024-09-11T23:19:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.566+0000 7f903a000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9044148150 0x7f904406d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.566+0000 7f9043400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f904406d5c0 0x7f90440ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.566+0000 7f9043400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f904406d5c0 0x7f90440ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:52238/0 (socket says 172.21.15.144:52238) 2024-09-11T23:19:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.566+0000 7f9043400640 1 -- 172.21.15.144:0/2042232696 learned_addr learned my addr 172.21.15.144:0/2042232696 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.567+0000 7f9043400640 1 -- 172.21.15.144:0/2042232696 >> v2:172.21.15.165:3300/0 conn(0x7f9044148150 msgr2=0x7f904406d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.567+0000 7f9043400640 1 --2- 172.21.15.144:0/2042232696 >> v2:172.21.15.165:3300/0 conn(0x7f9044148150 0x7f904406d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.567+0000 7f9043400640 1 -- 172.21.15.144:0/2042232696 >> v1:172.21.15.165:6789/0 conn(0x7f9044147d70 legacy=0x7f9044071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.567+0000 7f9043400640 1 -- 172.21.15.144:0/2042232696 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9044071630 con 0x7f904406d5c0 2024-09-11T23:19:12.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.567+0000 7f9042000640 1 -- 172.21.15.144:0/2042232696 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4053084116 0 0) 0x7f90440710e0 con 0x7f9044147d70 2024-09-11T23:19:12.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.568+0000 7f9043400640 1 --2- 172.21.15.144:0/2042232696 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f904406d5c0 0x7f90440ae8e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f903c009e50 tx=0x7f903c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a73ddb08fef9a457 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:12.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.568+0000 7f9042000640 1 -- 172.21.15.144:0/2042232696 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c036070 con 0x7f904406d5c0 2024-09-11T23:19:12.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.568+0000 7f9042000640 1 -- 172.21.15.144:0/2042232696 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f903c031600 con 0x7f904406d5c0 2024-09-11T23:19:12.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.568+0000 7f9042000640 1 -- 172.21.15.144:0/2042232696 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c0319d0 con 0x7f904406d5c0 2024-09-11T23:19:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.569+0000 7f9049600640 1 -- 172.21.15.144:0/2042232696 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f904406d5c0 msgr2=0x7f90440ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.569+0000 7f9049600640 1 --2- 172.21.15.144:0/2042232696 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f904406d5c0 0x7f90440ae8e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f903c009e50 tx=0x7f903c02a710 comp rx=0 tx=0).stop 2024-09-11T23:19:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.569+0000 7f9049600640 1 -- 172.21.15.144:0/2042232696 shutdown_connections 2024-09-11T23:19:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.569+0000 7f9049600640 1 --2- 172.21.15.144:0/2042232696 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f904406d5c0 0x7f90440ae8e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.569+0000 7f9049600640 1 --2- 172.21.15.144:0/2042232696 >> v2:172.21.15.165:3300/0 conn(0x7f9044148150 0x7f904406d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.569+0000 7f9049600640 1 -- 172.21.15.144:0/2042232696 >> 172.21.15.144:0/2042232696 conn(0x7f904406bba0 msgr2=0x7f904406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.569+0000 7f9049600640 1 -- 172.21.15.144:0/2042232696 shutdown_connections 2024-09-11T23:19:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.569+0000 7f9049600640 1 -- 172.21.15.144:0/2042232696 wait complete. 2024-09-11T23:19:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.570+0000 7f9049600640 1 Processor -- start 2024-09-11T23:19:12.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.571+0000 7f9049600640 1 -- start start 2024-09-11T23:19:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.571+0000 7f9049600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f904406d5c0 0x7f904413e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.571+0000 7f9049600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9044147d70 0x7f90441f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.571+0000 7f9049600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9044148150 0x7f9044160f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.571+0000 7f9049600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f90440723e0 con 0x7f9044148150 2024-09-11T23:19:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.571+0000 7f9049600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9044072260 con 0x7f904406d5c0 2024-09-11T23:19:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.571+0000 7f9049600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f90440aee20 con 0x7f9044147d70 2024-09-11T23:19:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.572+0000 7f9043400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9044148150 0x7f9044160f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.572+0000 7f9043400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9044148150 0x7f9044160f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33282/0 (socket says 172.21.15.144:33282) 2024-09-11T23:19:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.572+0000 7f9043400640 1 -- 172.21.15.144:0/2081070764 learned_addr learned my addr 172.21.15.144:0/2081070764 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.572+0000 7f9042a00640 1 --2- 172.21.15.144:0/2081070764 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f904406d5c0 0x7f904413e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.572+0000 7f903a000640 1 --2- 172.21.15.144:0/2081070764 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9044147d70 0x7f90441f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.572+0000 7f9043400640 1 -- 172.21.15.144:0/2081070764 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9044147d70 msgr2=0x7f90441f75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.572+0000 7f9043400640 1 --2- 172.21.15.144:0/2081070764 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9044147d70 0x7f90441f75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.572+0000 7f9043400640 1 -- 172.21.15.144:0/2081070764 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f904406d5c0 msgr2=0x7f904413e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.572+0000 7f9043400640 1 --2- 172.21.15.144:0/2081070764 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f904406d5c0 0x7f904413e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.572+0000 7f9043400640 1 -- 172.21.15.144:0/2081070764 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90441f3bd0 con 0x7f9044148150 2024-09-11T23:19:12.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.572+0000 7f9043400640 1 --2- 172.21.15.144:0/2081070764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9044148150 0x7f9044160f00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f903c009e50 tx=0x7f903c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:12.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.573+0000 7f903b400640 1 -- 172.21.15.144:0/2081070764 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c036050 con 0x7f9044148150 2024-09-11T23:19:12.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.573+0000 7f903b400640 1 -- 172.21.15.144:0/2081070764 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f903c042070 con 0x7f9044148150 2024-09-11T23:19:12.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.573+0000 7f903b400640 1 -- 172.21.15.144:0/2081070764 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c009510 con 0x7f9044148150 2024-09-11T23:19:12.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.573+0000 7f9049600640 1 -- 172.21.15.144:0/2081070764 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9044130770 con 0x7f9044148150 2024-09-11T23:19:12.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.573+0000 7f9049600640 1 -- 172.21.15.144:0/2081070764 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9044130d30 con 0x7f9044148150 2024-09-11T23:19:12.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.574+0000 7f9049600640 1 -- 172.21.15.144:0/2081070764 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90440ae8e0 con 0x7f9044148150 2024-09-11T23:19:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.575+0000 7f903b400640 1 -- 172.21.15.144:0/2081070764 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f903c007bf0 con 0x7f9044148150 2024-09-11T23:19:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.575+0000 7f903b400640 1 --2- 172.21.15.144:0/2081070764 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f902006bfe0 0x7f902006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.575+0000 7f903b400640 1 -- 172.21.15.144:0/2081070764 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5357+0+0 (secure 0 0 0) 0x7f903c0abda0 con 0x7f9044148150 2024-09-11T23:19:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.576+0000 7f9042a00640 1 --2- 172.21.15.144:0/2081070764 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f902006bfe0 0x7f902006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:12.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.576+0000 7f9042a00640 1 --2- 172.21.15.144:0/2081070764 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f902006bfe0 0x7f902006e4a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9034000f60 tx=0x7f9034009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:12.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.580+0000 7f903b400640 1 -- 172.21.15.144:0/2081070764 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f90441f3bd0 con 0x7f9044148150 2024-09-11T23:19:12.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:12.759+0000 7f9049600640 1 -- 172.21.15.144:0/2081070764 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f904415e420 con 0x7f9044148150 2024-09-11T23:19:13.168 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:19:13.172 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:19:13.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.388+0000 7f903b400640 1 -- 172.21.15.144:0/2081070764 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7f903c079ec0 con 0x7f9044148150 2024-09-11T23:19:13.388 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-11T23:19:13.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.391+0000 7f9049600640 1 -- 172.21.15.144:0/2081070764 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f902006bfe0 msgr2=0x7f902006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:13.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.391+0000 7f9049600640 1 --2- 172.21.15.144:0/2081070764 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f902006bfe0 0x7f902006e4a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9034000f60 tx=0x7f9034009040 comp rx=0 tx=0).stop 2024-09-11T23:19:13.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.391+0000 7f9049600640 1 -- 172.21.15.144:0/2081070764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9044148150 msgr2=0x7f9044160f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:13.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.391+0000 7f9049600640 1 --2- 172.21.15.144:0/2081070764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9044148150 0x7f9044160f00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f903c009e50 tx=0x7f903c004a40 comp rx=0 tx=0).stop 2024-09-11T23:19:13.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.391+0000 7f9049600640 1 -- 172.21.15.144:0/2081070764 shutdown_connections 2024-09-11T23:19:13.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.391+0000 7f9049600640 1 --2- 172.21.15.144:0/2081070764 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f902006bfe0 0x7f902006e4a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.391+0000 7f9049600640 1 --2- 172.21.15.144:0/2081070764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9044148150 0x7f9044160f00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.391+0000 7f9049600640 1 --2- 172.21.15.144:0/2081070764 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9044147d70 0x7f90441f75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.391+0000 7f9049600640 1 --2- 172.21.15.144:0/2081070764 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f904406d5c0 0x7f904413e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.391+0000 7f9049600640 1 -- 172.21.15.144:0/2081070764 >> 172.21.15.144:0/2081070764 conn(0x7f904406bba0 msgr2=0x7f904415d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:13.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.391+0000 7f9049600640 1 -- 172.21.15.144:0/2081070764 shutdown_connections 2024-09-11T23:19:13.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.391+0000 7f9049600640 1 -- 172.21.15.144:0/2081070764 wait complete. 2024-09-11T23:19:13.409 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:19:13.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.563+0000 7fbe99800640 1 Processor -- start 2024-09-11T23:19:13.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.564+0000 7fbe99800640 1 -- start start 2024-09-11T23:19:13.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.565+0000 7fbe99800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbe940b5590 0x7fbe940d23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:13.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.565+0000 7fbe99800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe940d28f0 0x7fbe9406dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:13.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.565+0000 7fbe99800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe940d2d80 con 0x7fbe9415e950 2024-09-11T23:19:13.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.565+0000 7fbe99800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fbe9415ed30 con 0x7fbe940b5590 2024-09-11T23:19:13.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.565+0000 7fbe99800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbe940d0f40 con 0x7fbe940d28f0 2024-09-11T23:19:13.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.565+0000 7fbe92a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbe9415e950 0x7fbe940d04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44444/0 (socket says 172.21.15.144:44444) 2024-09-11T23:19:13.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.565+0000 7fbe92a00640 1 -- 172.21.15.144:0/2111341171 learned_addr learned my addr 172.21.15.144:0/2111341171 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.565+0000 7fbe93400640 1 --2- 172.21.15.144:0/2111341171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe940d28f0 0x7fbe9406dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.565+0000 7fbe8be00640 1 --2- 172.21.15.144:0/2111341171 >> v2:172.21.15.165:3300/0 conn(0x7fbe940b5590 0x7fbe940d23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.565+0000 7fbe92000640 1 -- 172.21.15.144:0/2111341171 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1974584883 0 0) 0x7fbe940d2d80 con 0x7fbe9415e950 2024-09-11T23:19:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.566+0000 7fbe92000640 1 -- 172.21.15.144:0/2111341171 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe78003520 con 0x7fbe9415e950 2024-09-11T23:19:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.566+0000 7fbe93400640 1 -- 172.21.15.144:0/2111341171 >> v2:172.21.15.165:3300/0 conn(0x7fbe940b5590 msgr2=0x7fbe940d23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.566+0000 7fbe93400640 1 --2- 172.21.15.144:0/2111341171 >> v2:172.21.15.165:3300/0 conn(0x7fbe940b5590 0x7fbe940d23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.566+0000 7fbe93400640 1 -- 172.21.15.144:0/2111341171 >> v1:172.21.15.144:6789/0 conn(0x7fbe9415e950 legacy=0x7fbe940d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.566+0000 7fbe93400640 1 -- 172.21.15.144:0/2111341171 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe940d1220 con 0x7fbe940d28f0 2024-09-11T23:19:13.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.566+0000 7fbe8be00640 1 --2- 172.21.15.144:0/2111341171 >> v2:172.21.15.165:3300/0 conn(0x7fbe940b5590 0x7fbe940d23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:19:13.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.567+0000 7fbe93400640 1 --2- 172.21.15.144:0/2111341171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe940d28f0 0x7fbe9406dc20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009d90 tx=0x7fbe8c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35f3041df35b454f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:13.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.567+0000 7fbe92000640 1 -- 172.21.15.144:0/2111341171 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c007740 con 0x7fbe940d28f0 2024-09-11T23:19:13.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.567+0000 7fbe92000640 1 -- 172.21.15.144:0/2111341171 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8c0078e0 con 0x7fbe940d28f0 2024-09-11T23:19:13.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.567+0000 7fbe92000640 1 -- 172.21.15.144:0/2111341171 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c007cb0 con 0x7fbe940d28f0 2024-09-11T23:19:13.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.568+0000 7fbe99800640 1 -- 172.21.15.144:0/2111341171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe940d28f0 msgr2=0x7fbe9406dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:13.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.568+0000 7fbe99800640 1 --2- 172.21.15.144:0/2111341171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe940d28f0 0x7fbe9406dc20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009d90 tx=0x7fbe8c02a660 comp rx=0 tx=0).stop 2024-09-11T23:19:13.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.568+0000 7fbe99800640 1 -- 172.21.15.144:0/2111341171 shutdown_connections 2024-09-11T23:19:13.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.568+0000 7fbe99800640 1 --2- 172.21.15.144:0/2111341171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe940d28f0 0x7fbe9406dc20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.568+0000 7fbe99800640 1 --2- 172.21.15.144:0/2111341171 >> v2:172.21.15.165:3300/0 conn(0x7fbe940b5590 0x7fbe940d23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.568+0000 7fbe99800640 1 -- 172.21.15.144:0/2111341171 >> 172.21.15.144:0/2111341171 conn(0x7fbe9406f310 msgr2=0x7fbe9406f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:13.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.568+0000 7fbe99800640 1 -- 172.21.15.144:0/2111341171 shutdown_connections 2024-09-11T23:19:13.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.568+0000 7fbe99800640 1 -- 172.21.15.144:0/2111341171 wait complete. 2024-09-11T23:19:13.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.569+0000 7fbe99800640 1 Processor -- start 2024-09-11T23:19:13.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.569+0000 7fbe99800640 1 -- start start 2024-09-11T23:19:13.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.570+0000 7fbe99800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe940b5590 0x7fbe9414c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:13.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.570+0000 7fbe99800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe940d28f0 0x7fbe940cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:13.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.570+0000 7fbe99800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe9415e950 0x7fbe940ce380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:13.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.570+0000 7fbe99800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbe940b59b0 con 0x7fbe940d28f0 2024-09-11T23:19:13.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.570+0000 7fbe99800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9406d700 con 0x7fbe940b5590 2024-09-11T23:19:13.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.570+0000 7fbe99800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbe940cf410 con 0x7fbe9415e950 2024-09-11T23:19:13.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.570+0000 7fbe8be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe940d28f0 0x7fbe940cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:13.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.571+0000 7fbe8be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe940d28f0 0x7fbe940cde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33290/0 (socket says 172.21.15.144:33290) 2024-09-11T23:19:13.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.571+0000 7fbe8be00640 1 -- 172.21.15.144:0/426531561 learned_addr learned my addr 172.21.15.144:0/426531561 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:13.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.571+0000 7fbe93400640 1 --2- 172.21.15.144:0/426531561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe9415e950 0x7fbe940ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:13.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.571+0000 7fbe92a00640 1 --2- 172.21.15.144:0/426531561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe940b5590 0x7fbe9414c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:13.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.571+0000 7fbe8be00640 1 -- 172.21.15.144:0/426531561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe9415e950 msgr2=0x7fbe940ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:13.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.571+0000 7fbe8be00640 1 --2- 172.21.15.144:0/426531561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe9415e950 0x7fbe940ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.571+0000 7fbe8be00640 1 -- 172.21.15.144:0/426531561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe940b5590 msgr2=0x7fbe9414c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:13.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.571+0000 7fbe8be00640 1 --2- 172.21.15.144:0/426531561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe940b5590 0x7fbe9414c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.571+0000 7fbe8be00640 1 -- 172.21.15.144:0/426531561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe941f44e0 con 0x7fbe940d28f0 2024-09-11T23:19:13.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.571+0000 7fbe8be00640 1 --2- 172.21.15.144:0/426531561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe940d28f0 0x7fbe940cde40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c00ec10 tx=0x7fbe7c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:13.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.571+0000 7fbe8aa00640 1 -- 172.21.15.144:0/426531561 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c017070 con 0x7fbe940d28f0 2024-09-11T23:19:13.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.571+0000 7fbe8aa00640 1 -- 172.21.15.144:0/426531561 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7c00cc30 con 0x7fbe940d28f0 2024-09-11T23:19:13.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.571+0000 7fbe8aa00640 1 -- 172.21.15.144:0/426531561 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c013470 con 0x7fbe940d28f0 2024-09-11T23:19:13.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.571+0000 7fbe99800640 1 -- 172.21.15.144:0/426531561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9414c680 con 0x7fbe940d28f0 2024-09-11T23:19:13.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.572+0000 7fbe99800640 1 -- 172.21.15.144:0/426531561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe941f4a30 con 0x7fbe940d28f0 2024-09-11T23:19:13.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.573+0000 7fbe99800640 1 -- 172.21.15.144:0/426531561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe9406d040 con 0x7fbe940d28f0 2024-09-11T23:19:13.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.574+0000 7fbe8aa00640 1 -- 172.21.15.144:0/426531561 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fbe7c01a070 con 0x7fbe940d28f0 2024-09-11T23:19:13.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.574+0000 7fbe8aa00640 1 --2- 172.21.15.144:0/426531561 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbe7006bfe0 0x7fbe7006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:13.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.575+0000 7fbe8aa00640 1 -- 172.21.15.144:0/426531561 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fbe7c08ad20 con 0x7fbe940d28f0 2024-09-11T23:19:13.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.575+0000 7fbe92a00640 1 --2- 172.21.15.144:0/426531561 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbe7006bfe0 0x7fbe7006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:13.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.575+0000 7fbe92a00640 1 --2- 172.21.15.144:0/426531561 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbe7006bfe0 0x7fbe7006e4a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbe84005880 tx=0x7fbe84009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:13.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.579+0000 7fbe8aa00640 1 -- 172.21.15.144:0/426531561 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe7c0591a0 con 0x7fbe940d28f0 2024-09-11T23:19:13.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.763+0000 7fbe99800640 1 -- 172.21.15.144:0/426531561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fbe9415dff0 con 0x7fbe940d28f0 2024-09-11T23:19:13.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.766+0000 7fbe8aa00640 1 -- 172.21.15.144:0/426531561 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fbe7c05d4a0 con 0x7fbe940d28f0 2024-09-11T23:19:13.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.769+0000 7fbe99800640 1 -- 172.21.15.144:0/426531561 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbe7006bfe0 msgr2=0x7fbe7006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:13.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.769+0000 7fbe99800640 1 --2- 172.21.15.144:0/426531561 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbe7006bfe0 0x7fbe7006e4a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbe84005880 tx=0x7fbe84009040 comp rx=0 tx=0).stop 2024-09-11T23:19:13.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.769+0000 7fbe99800640 1 -- 172.21.15.144:0/426531561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe940d28f0 msgr2=0x7fbe940cde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:13.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.769+0000 7fbe99800640 1 --2- 172.21.15.144:0/426531561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe940d28f0 0x7fbe940cde40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c00ec10 tx=0x7fbe7c00c520 comp rx=0 tx=0).stop 2024-09-11T23:19:13.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.769+0000 7fbe99800640 1 -- 172.21.15.144:0/426531561 shutdown_connections 2024-09-11T23:19:13.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.769+0000 7fbe99800640 1 --2- 172.21.15.144:0/426531561 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbe7006bfe0 0x7fbe7006e4a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.769+0000 7fbe99800640 1 --2- 172.21.15.144:0/426531561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe9415e950 0x7fbe940ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.769+0000 7fbe99800640 1 --2- 172.21.15.144:0/426531561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe940d28f0 0x7fbe940cde40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.769+0000 7fbe99800640 1 --2- 172.21.15.144:0/426531561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe940b5590 0x7fbe9414c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.769+0000 7fbe99800640 1 -- 172.21.15.144:0/426531561 >> 172.21.15.144:0/426531561 conn(0x7fbe9406f310 msgr2=0x7fbe940b5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:13.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.769+0000 7fbe99800640 1 -- 172.21.15.144:0/426531561 shutdown_connections 2024-09-11T23:19:13.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.769+0000 7fbe99800640 1 -- 172.21.15.144:0/426531561 wait complete. 2024-09-11T23:19:13.784 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2024-09-11T23:19:13.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.938+0000 7f0b51800640 1 Processor -- start 2024-09-11T23:19:13.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.939+0000 7f0b51800640 1 -- start start 2024-09-11T23:19:13.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.940+0000 7f0b51800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b4c073830 0x7f0b4c0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.940+0000 7f0b51800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b4c0ce740 con 0x7f0b4c15c180 2024-09-11T23:19:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.940+0000 7f0b51800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b4c072640 con 0x7f0b4c0cf070 2024-09-11T23:19:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.940+0000 7f0b51800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0b4c072920 con 0x7f0b4c073830 2024-09-11T23:19:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.940+0000 7f0b4aa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0b4c15c180 0x7f0b4c0cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:44448/0 (socket says 172.21.15.144:44448) 2024-09-11T23:19:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.940+0000 7f0b4aa00640 1 -- 172.21.15.144:0/760887093 learned_addr learned my addr 172.21.15.144:0/760887093 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:13.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.940+0000 7f0b4b400640 1 --2- 172.21.15.144:0/760887093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b4c073830 0x7f0b4c0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:13.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.940+0000 7f0b4a000640 1 -- 172.21.15.144:0/760887093 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 990230543 0 0) 0x7f0b4c0ce740 con 0x7f0b4c15c180 2024-09-11T23:19:13.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.940+0000 7f0b4a000640 1 -- 172.21.15.144:0/760887093 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b30003520 con 0x7f0b4c15c180 2024-09-11T23:19:13.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.941+0000 7f0b4a000640 1 -- 172.21.15.144:0/760887093 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 616330627 0 0) 0x7f0b4c072640 con 0x7f0b4c0cf070 2024-09-11T23:19:13.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.941+0000 7f0b4a000640 1 -- 172.21.15.144:0/760887093 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b4c0ce740 con 0x7f0b4c0cf070 2024-09-11T23:19:13.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.941+0000 7f0b4a000640 1 -- 172.21.15.144:0/760887093 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2985837310 0 0) 0x7f0b30003520 con 0x7f0b4c15c180 2024-09-11T23:19:13.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.941+0000 7f0b4a000640 1 -- 172.21.15.144:0/760887093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b4c073830 msgr2=0x7f0b4c0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:13.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.941+0000 7f0b4a000640 1 --2- 172.21.15.144:0/760887093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b4c073830 0x7f0b4c0cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.941+0000 7f0b4a000640 1 -- 172.21.15.144:0/760887093 >> v1:172.21.15.165:6789/0 conn(0x7f0b4c0cf070 legacy=0x7f0b4c073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:13.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.941+0000 7f0b4a000640 1 -- 172.21.15.144:0/760887093 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4c072c00 con 0x7f0b4c15c180 2024-09-11T23:19:13.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.941+0000 7f0b4a000640 1 -- 172.21.15.144:0/760887093 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f0b3c001670 con 0x7f0b4c15c180 2024-09-11T23:19:13.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.941+0000 7f0b4a000640 1 -- 172.21.15.144:0/760887093 >> v1:172.21.15.144:6789/0 conn(0x7f0b4c15c180 legacy=0x7f0b4c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:13.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.941+0000 7f0b4a000640 1 --2- 172.21.15.144:0/760887093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b30003b70 0x7f0b30003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.941+0000 7f0b4a000640 1 --2- 172.21.15.144:0/760887093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b30004800 0x7f0b30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.941+0000 7f0b4a000640 1 --2- 172.21.15.144:0/760887093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b4c073830 0x7f0b300051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.941+0000 7f0b4a000640 1 -- 172.21.15.144:0/760887093 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c072920 con 0x7f0b30004800 2024-09-11T23:19:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.941+0000 7f0b4a000640 1 -- 172.21.15.144:0/760887093 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3000bb00 con 0x7f0b30003b70 2024-09-11T23:19:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.941+0000 7f0b4a000640 1 -- 172.21.15.144:0/760887093 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0b3000bd00 con 0x7f0b4c073830 2024-09-11T23:19:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.941+0000 7f0b42000640 1 --2- 172.21.15.144:0/760887093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b30004800 0x7f0b30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.941+0000 7f0b4aa00640 1 --2- 172.21.15.144:0/760887093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b30003b70 0x7f0b30003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.941+0000 7f0b4b400640 1 --2- 172.21.15.144:0/760887093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b4c073830 0x7f0b300051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.942+0000 7f0b42000640 1 -- 172.21.15.144:0/760887093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b4c073830 msgr2=0x7f0b300051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.942+0000 7f0b42000640 1 --2- 172.21.15.144:0/760887093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b4c073830 0x7f0b300051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.942+0000 7f0b42000640 1 -- 172.21.15.144:0/760887093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b30003b70 msgr2=0x7f0b30003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.942+0000 7f0b42000640 1 --2- 172.21.15.144:0/760887093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b30003b70 0x7f0b30003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.942+0000 7f0b42000640 1 -- 172.21.15.144:0/760887093 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b30003520 con 0x7f0b30004800 2024-09-11T23:19:13.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.942+0000 7f0b4b400640 1 --2- 172.21.15.144:0/760887093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b4c073830 0x7f0b300051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:13.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.943+0000 7f0b42000640 1 --2- 172.21.15.144:0/760887093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b30004800 0x7f0b30004c80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0b340018d0 tx=0x7f0b30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9705c9f19e2ee5d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:13.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.943+0000 7f0b4a000640 1 -- 172.21.15.144:0/760887093 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b340014f0 con 0x7f0b30004800 2024-09-11T23:19:13.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.943+0000 7f0b4a000640 1 -- 172.21.15.144:0/760887093 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b340052d0 con 0x7f0b30004800 2024-09-11T23:19:13.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.943+0000 7f0b4a000640 1 -- 172.21.15.144:0/760887093 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3402aca0 con 0x7f0b30004800 2024-09-11T23:19:13.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.943+0000 7f0b51800640 1 -- 172.21.15.144:0/760887093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b30004800 msgr2=0x7f0b30004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:13.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.943+0000 7f0b51800640 1 --2- 172.21.15.144:0/760887093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b30004800 0x7f0b30004c80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0b340018d0 tx=0x7f0b30005830 comp rx=0 tx=0).stop 2024-09-11T23:19:13.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.943+0000 7f0b4b400640 1 -- 172.21.15.144:0/760887093 reap_dead start 2024-09-11T23:19:13.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.943+0000 7f0b51800640 1 -- 172.21.15.144:0/760887093 shutdown_connections 2024-09-11T23:19:13.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.943+0000 7f0b51800640 1 -- 172.21.15.144:0/760887093 >> 172.21.15.144:0/760887093 conn(0x7f0b4c062cc0 msgr2=0x7f0b4c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:13.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.943+0000 7f0b51800640 1 -- 172.21.15.144:0/760887093 shutdown_connections 2024-09-11T23:19:13.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.943+0000 7f0b51800640 1 -- 172.21.15.144:0/760887093 wait complete. 2024-09-11T23:19:13.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.945+0000 7f0b51800640 1 Processor -- start 2024-09-11T23:19:13.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.945+0000 7f0b51800640 1 -- start start 2024-09-11T23:19:13.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.946+0000 7f0b51800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b30004800 0x7f0b4c1f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:13.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.946+0000 7f0b51800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b4c0b3cd0 0x7f0b4c0b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:13.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.946+0000 7f0b51800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b4c0c9fb0 0x7f0b4c0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:13.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.946+0000 7f0b51800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c0722f0 con 0x7f0b30004800 2024-09-11T23:19:13.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.946+0000 7f0b51800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c0ced00 con 0x7f0b4c0c9fb0 2024-09-11T23:19:13.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.946+0000 7f0b51800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0b4c15c560 con 0x7f0b4c0b3cd0 2024-09-11T23:19:13.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.946+0000 7f0b4aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b30004800 0x7f0b4c1f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:13.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.946+0000 7f0b4aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b30004800 0x7f0b4c1f06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33304/0 (socket says 172.21.15.144:33304) 2024-09-11T23:19:13.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.946+0000 7f0b4aa00640 1 -- 172.21.15.144:0/3230360853 learned_addr learned my addr 172.21.15.144:0/3230360853 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:13.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.947+0000 7f0b4aa00640 1 -- 172.21.15.144:0/3230360853 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b4c0b3cd0 msgr2=0x7f0b4c0b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:13.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.947+0000 7f0b4aa00640 1 --2- 172.21.15.144:0/3230360853 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b4c0b3cd0 0x7f0b4c0b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.947+0000 7f0b4aa00640 1 -- 172.21.15.144:0/3230360853 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b4c0c9fb0 msgr2=0x7f0b4c0ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:13.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.947+0000 7f0b4aa00640 1 --2- 172.21.15.144:0/3230360853 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b4c0c9fb0 0x7f0b4c0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:13.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.947+0000 7f0b4aa00640 1 -- 172.21.15.144:0/3230360853 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4c0cac90 con 0x7f0b30004800 2024-09-11T23:19:13.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.947+0000 7f0b4aa00640 1 --2- 172.21.15.144:0/3230360853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b30004800 0x7f0b4c1f06c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c004f70 tx=0x7f0b3c0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:13.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.947+0000 7f0b43400640 1 -- 172.21.15.144:0/3230360853 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c001080 con 0x7f0b30004800 2024-09-11T23:19:13.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.947+0000 7f0b43400640 1 -- 172.21.15.144:0/3230360853 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b3c018070 con 0x7f0b30004800 2024-09-11T23:19:13.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.947+0000 7f0b43400640 1 -- 172.21.15.144:0/3230360853 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c00f8f0 con 0x7f0b30004800 2024-09-11T23:19:13.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.947+0000 7f0b51800640 1 -- 172.21.15.144:0/3230360853 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4c0caf70 con 0x7f0b30004800 2024-09-11T23:19:13.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.947+0000 7f0b51800640 1 -- 172.21.15.144:0/3230360853 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b4c0cb530 con 0x7f0b30004800 2024-09-11T23:19:13.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.948+0000 7f0b51800640 1 -- 172.21.15.144:0/3230360853 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b4c0cf4e0 con 0x7f0b30004800 2024-09-11T23:19:13.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.949+0000 7f0b43400640 1 -- 172.21.15.144:0/3230360853 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f0b3c00fa90 con 0x7f0b30004800 2024-09-11T23:19:13.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.950+0000 7f0b43400640 1 --2- 172.21.15.144:0/3230360853 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0b2806c180 0x7f0b2806e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:13.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.950+0000 7f0b43400640 1 -- 172.21.15.144:0/3230360853 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f0b3c08ae00 con 0x7f0b30004800 2024-09-11T23:19:13.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.950+0000 7f0b42000640 1 --2- 172.21.15.144:0/3230360853 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0b2806c180 0x7f0b2806e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:13.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.951+0000 7f0b42000640 1 --2- 172.21.15.144:0/3230360853 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0b2806c180 0x7f0b2806e640 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0b34032000 tx=0x7f0b3402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:13.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:13.955+0000 7f0b43400640 1 -- 172.21.15.144:0/3230360853 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0b3c059790 con 0x7f0b30004800 2024-09-11T23:19:14.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.191+0000 7f0b51800640 1 -- 172.21.15.144:0/3230360853 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7f0b4c0b37b0 con 0x7f0b30004800 2024-09-11T23:19:14.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.389+0000 7f0b43400640 1 -- 172.21.15.144:0/3230360853 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v89) ==== 158+0+0 (secure 0 0 0) 0x7f0b3c059090 con 0x7f0b30004800 2024-09-11T23:19:14.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.392+0000 7f0b51800640 1 -- 172.21.15.144:0/3230360853 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0b2806c180 msgr2=0x7f0b2806e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:14.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.392+0000 7f0b51800640 1 --2- 172.21.15.144:0/3230360853 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0b2806c180 0x7f0b2806e640 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0b34032000 tx=0x7f0b3402e000 comp rx=0 tx=0).stop 2024-09-11T23:19:14.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.392+0000 7f0b51800640 1 -- 172.21.15.144:0/3230360853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b30004800 msgr2=0x7f0b4c1f06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:14.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.392+0000 7f0b51800640 1 --2- 172.21.15.144:0/3230360853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b30004800 0x7f0b4c1f06c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c004f70 tx=0x7f0b3c0074f0 comp rx=0 tx=0).stop 2024-09-11T23:19:14.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.392+0000 7f0b51800640 1 -- 172.21.15.144:0/3230360853 shutdown_connections 2024-09-11T23:19:14.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.392+0000 7f0b51800640 1 --2- 172.21.15.144:0/3230360853 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0b2806c180 0x7f0b2806e640 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:14.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.392+0000 7f0b51800640 1 --2- 172.21.15.144:0/3230360853 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b4c0c9fb0 0x7f0b4c0ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:14.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.392+0000 7f0b51800640 1 --2- 172.21.15.144:0/3230360853 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b4c0b3cd0 0x7f0b4c0b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:14.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.392+0000 7f0b51800640 1 --2- 172.21.15.144:0/3230360853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b30004800 0x7f0b4c1f06c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:14.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.392+0000 7f0b51800640 1 -- 172.21.15.144:0/3230360853 >> 172.21.15.144:0/3230360853 conn(0x7f0b4c062cc0 msgr2=0x7f0b4c159a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:14.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.392+0000 7f0b51800640 1 -- 172.21.15.144:0/3230360853 shutdown_connections 2024-09-11T23:19:14.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.392+0000 7f0b51800640 1 -- 172.21.15.144:0/3230360853 wait complete. 2024-09-11T23:19:14.409 INFO:tasks.cephfs_test_runner:Validate binary .meta file on legacy subvol root doesn't break the system ... ok 2024-09-11T23:19:14.409 INFO:tasks.cephfs_test_runner:Starting test: test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) 2024-09-11T23:19:14.410 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:19:14.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.562+0000 7f11b4600640 1 Processor -- start 2024-09-11T23:19:14.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.562+0000 7f11b4600640 1 -- start start 2024-09-11T23:19:14.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.563+0000 7f11b4600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f11ac06be10 0x7f11ac0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.563+0000 7f11b4600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11ac151c50 0x7f11ac15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.564+0000 7f11b4600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11ac0cd5f0 con 0x7f11ac06c1f0 2024-09-11T23:19:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.564+0000 7f11b4600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f11ac0cd8d0 con 0x7f11ac06be10 2024-09-11T23:19:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.564+0000 7f11b4600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f11ac0cdbb0 con 0x7f11ac151c50 2024-09-11T23:19:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.564+0000 7f11b1c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f11ac06be10 0x7f11ac0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.564+0000 7f11b1200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f11ac06c1f0 0x7f11ac151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33612/0 (socket says 172.21.15.144:33612) 2024-09-11T23:19:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.564+0000 7f11b1200640 1 -- 172.21.15.144:0/3073445920 learned_addr learned my addr 172.21.15.144:0/3073445920 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:14.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.564+0000 7f11b2600640 1 --2- 172.21.15.144:0/3073445920 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11ac151c50 0x7f11ac15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:14.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.564+0000 7f11b1c00640 1 -- 172.21.15.144:0/3073445920 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11ac151c50 msgr2=0x7f11ac15baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:14.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.564+0000 7f11b1c00640 1 --2- 172.21.15.144:0/3073445920 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11ac151c50 0x7f11ac15baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:14.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.564+0000 7f11b1c00640 1 -- 172.21.15.144:0/3073445920 >> v1:172.21.15.144:6789/0 conn(0x7f11ac06c1f0 legacy=0x7f11ac151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:14.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.564+0000 7f11abe00640 1 -- 172.21.15.144:0/3073445920 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2495779138 0 0) 0x7f11ac0cd5f0 con 0x7f11ac06c1f0 2024-09-11T23:19:14.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.564+0000 7f11b1c00640 1 -- 172.21.15.144:0/3073445920 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11ac0cde90 con 0x7f11ac06be10 2024-09-11T23:19:14.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.565+0000 7f11b1c00640 1 --2- 172.21.15.144:0/3073445920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11ac06be10 0x7f11ac0cd010 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f11a000bfa0 tx=0x7f11a002c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed58d15f0f0e1e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:14.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.566+0000 7f11abe00640 1 -- 172.21.15.144:0/3073445920 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a003b070 con 0x7f11ac06be10 2024-09-11T23:19:14.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.566+0000 7f11abe00640 1 -- 172.21.15.144:0/3073445920 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11a00336d0 con 0x7f11ac06be10 2024-09-11T23:19:14.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.566+0000 7f11abe00640 1 -- 172.21.15.144:0/3073445920 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a0033aa0 con 0x7f11ac06be10 2024-09-11T23:19:14.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.566+0000 7f11b4600640 1 -- 172.21.15.144:0/3073445920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11ac06be10 msgr2=0x7f11ac0cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:14.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.566+0000 7f11b4600640 1 --2- 172.21.15.144:0/3073445920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11ac06be10 0x7f11ac0cd010 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f11a000bfa0 tx=0x7f11a002c860 comp rx=0 tx=0).stop 2024-09-11T23:19:14.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.566+0000 7f11b4600640 1 -- 172.21.15.144:0/3073445920 shutdown_connections 2024-09-11T23:19:14.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.566+0000 7f11b4600640 1 --2- 172.21.15.144:0/3073445920 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11ac151c50 0x7f11ac15baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:14.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.566+0000 7f11b4600640 1 --2- 172.21.15.144:0/3073445920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11ac06be10 0x7f11ac0cd010 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:14.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.566+0000 7f11b4600640 1 -- 172.21.15.144:0/3073445920 >> 172.21.15.144:0/3073445920 conn(0x7f11ac062cc0 msgr2=0x7f11ac06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:14.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.566+0000 7f11b4600640 1 -- 172.21.15.144:0/3073445920 shutdown_connections 2024-09-11T23:19:14.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.566+0000 7f11b4600640 1 -- 172.21.15.144:0/3073445920 wait complete. 2024-09-11T23:19:14.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.568+0000 7f11b4600640 1 Processor -- start 2024-09-11T23:19:14.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.568+0000 7f11b4600640 1 -- start start 2024-09-11T23:19:14.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.569+0000 7f11b4600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11ac06be10 0x7f11ac1f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:14.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.569+0000 7f11b4600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11ac06c1f0 0x7f11ac15b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:14.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.569+0000 7f11b4600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11ac151c50 0x7f11ac1f3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:14.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.569+0000 7f11b4600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac0d0310 con 0x7f11ac151c50 2024-09-11T23:19:14.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.569+0000 7f11b4600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac0ce690 con 0x7f11ac06c1f0 2024-09-11T23:19:14.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.569+0000 7f11b4600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f11ac0d0490 con 0x7f11ac06be10 2024-09-11T23:19:14.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.569+0000 7f11b2600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11ac151c50 0x7f11ac1f3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:14.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.569+0000 7f11b2600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11ac151c50 0x7f11ac1f3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:60990/0 (socket says 172.21.15.144:60990) 2024-09-11T23:19:14.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.569+0000 7f11b2600640 1 -- 172.21.15.144:0/3178513173 learned_addr learned my addr 172.21.15.144:0/3178513173 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:14.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.569+0000 7f11b1c00640 1 --2- 172.21.15.144:0/3178513173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11ac06be10 0x7f11ac1f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:14.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.569+0000 7f11b1200640 1 --2- 172.21.15.144:0/3178513173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11ac06c1f0 0x7f11ac15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:14.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.569+0000 7f11b2600640 1 -- 172.21.15.144:0/3178513173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11ac06be10 msgr2=0x7f11ac1f50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:14.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.569+0000 7f11b2600640 1 --2- 172.21.15.144:0/3178513173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11ac06be10 0x7f11ac1f50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:14.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.569+0000 7f11b2600640 1 -- 172.21.15.144:0/3178513173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11ac06c1f0 msgr2=0x7f11ac15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:14.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.569+0000 7f11b2600640 1 --2- 172.21.15.144:0/3178513173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11ac06c1f0 0x7f11ac15b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:14.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.570+0000 7f11b2600640 1 -- 172.21.15.144:0/3178513173 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11ac1f7d20 con 0x7f11ac151c50 2024-09-11T23:19:14.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.570+0000 7f11b2600640 1 --2- 172.21.15.144:0/3178513173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11ac151c50 0x7f11ac1f3ce0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f11a400d5d0 tx=0x7f11a400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:14.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.570+0000 7f11a9600640 1 -- 172.21.15.144:0/3178513173 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a40125f0 con 0x7f11ac151c50 2024-09-11T23:19:14.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.570+0000 7f11a9600640 1 -- 172.21.15.144:0/3178513173 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11a4019070 con 0x7f11ac151c50 2024-09-11T23:19:14.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.570+0000 7f11b4600640 1 -- 172.21.15.144:0/3178513173 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11ac1f8000 con 0x7f11ac151c50 2024-09-11T23:19:14.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.570+0000 7f11a9600640 1 -- 172.21.15.144:0/3178513173 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a40129f0 con 0x7f11ac151c50 2024-09-11T23:19:14.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.570+0000 7f11b4600640 1 -- 172.21.15.144:0/3178513173 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11ac1f85c0 con 0x7f11ac151c50 2024-09-11T23:19:14.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.571+0000 7f11b4600640 1 -- 172.21.15.144:0/3178513173 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11ac1f87c0 con 0x7f11ac151c50 2024-09-11T23:19:14.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.572+0000 7f11a9600640 1 -- 172.21.15.144:0/3178513173 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f11a4012b90 con 0x7f11ac151c50 2024-09-11T23:19:14.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.573+0000 7f11a9600640 1 --2- 172.21.15.144:0/3178513173 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f118c06c010 0x7f118c06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:14.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.573+0000 7f11a9600640 1 -- 172.21.15.144:0/3178513173 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f11a408b230 con 0x7f11ac151c50 2024-09-11T23:19:14.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.573+0000 7f11b1c00640 1 --2- 172.21.15.144:0/3178513173 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f118c06c010 0x7f118c06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:14.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.574+0000 7f11b1c00640 1 --2- 172.21.15.144:0/3178513173 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f118c06c010 0x7f118c06e4d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f11a0038000 tx=0x7f11a0031000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:14.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.577+0000 7f11a9600640 1 -- 172.21.15.144:0/3178513173 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f11ac1f87c0 con 0x7f11ac151c50 2024-09-11T23:19:14.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.752+0000 7f11b4600640 1 -- 172.21.15.144:0/3178513173 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f11ac0d08c0 con 0x7f11ac151c50 2024-09-11T23:19:14.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.753+0000 7f11a9600640 1 -- 172.21.15.144:0/3178513173 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+13056 (secure 0 0 0) 0x7f11a4059bd0 con 0x7f11ac151c50 2024-09-11T23:19:14.753 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:14.753 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":37,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:19:13.384402+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6837/163510896":"2024-09-12T23:19:10.374789+0000","172.21.15.144:6835/163510896":"2024-09-12T23:19:10.374789+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:19:14.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.755+0000 7f11b4600640 1 -- 172.21.15.144:0/3178513173 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f118c06c010 msgr2=0x7f118c06e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:14.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.755+0000 7f11b4600640 1 --2- 172.21.15.144:0/3178513173 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f118c06c010 0x7f118c06e4d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f11a0038000 tx=0x7f11a0031000 comp rx=0 tx=0).stop 2024-09-11T23:19:14.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.755+0000 7f11b4600640 1 -- 172.21.15.144:0/3178513173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11ac151c50 msgr2=0x7f11ac1f3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:14.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.755+0000 7f11b4600640 1 --2- 172.21.15.144:0/3178513173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11ac151c50 0x7f11ac1f3ce0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f11a400d5d0 tx=0x7f11a400da90 comp rx=0 tx=0).stop 2024-09-11T23:19:14.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.755+0000 7f11b4600640 1 -- 172.21.15.144:0/3178513173 shutdown_connections 2024-09-11T23:19:14.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.755+0000 7f11b4600640 1 --2- 172.21.15.144:0/3178513173 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f118c06c010 0x7f118c06e4d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:14.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.755+0000 7f11b4600640 1 --2- 172.21.15.144:0/3178513173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11ac151c50 0x7f11ac1f3ce0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:14.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.755+0000 7f11b4600640 1 --2- 172.21.15.144:0/3178513173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11ac06c1f0 0x7f11ac15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:14.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.755+0000 7f11b4600640 1 --2- 172.21.15.144:0/3178513173 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f11ac06be10 0x7f11ac1f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:14.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.755+0000 7f11b4600640 1 -- 172.21.15.144:0/3178513173 >> 172.21.15.144:0/3178513173 conn(0x7f11ac062cc0 msgr2=0x7f11ac14cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:14.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.755+0000 7f11b4600640 1 -- 172.21.15.144:0/3178513173 shutdown_connections 2024-09-11T23:19:14.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.755+0000 7f11b4600640 1 -- 172.21.15.144:0/3178513173 wait complete. 2024-09-11T23:19:14.772 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:17:47.307937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:19:14.772 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:19:14.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.928+0000 7f2a73e00640 1 Processor -- start 2024-09-11T23:19:14.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.929+0000 7f2a73e00640 1 -- start start 2024-09-11T23:19:14.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.930+0000 7f2a73e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2a6c15ed50 0x7f2a6c143d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:14.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.930+0000 7f2a73e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2a6c0714d0 0x7f2a6c0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:14.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.930+0000 7f2a73e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a6c1443d0 con 0x7f2a6c071080 2024-09-11T23:19:14.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.930+0000 7f2a73e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2a6c1446b0 con 0x7f2a6c15ed50 2024-09-11T23:19:14.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.930+0000 7f2a73e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2a6c144990 con 0x7f2a6c0714d0 2024-09-11T23:19:14.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.930+0000 7f2a71400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2a6c15ed50 0x7f2a6c143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:14.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.930+0000 7f2a71400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2a6c15ed50 0x7f2a6c143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32768/0 (socket says 172.21.15.144:32768) 2024-09-11T23:19:14.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.930+0000 7f2a71400640 1 -- 172.21.15.144:0/3928074083 learned_addr learned my addr 172.21.15.144:0/3928074083 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:14.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.930+0000 7f2a71e00640 1 --2- 172.21.15.144:0/3928074083 >> v2:172.21.15.165:3300/0 conn(0x7f2a6c0714d0 0x7f2a6c0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:14.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.930+0000 7f2a71400640 1 -- 172.21.15.144:0/3928074083 >> v2:172.21.15.165:3300/0 conn(0x7f2a6c0714d0 msgr2=0x7f2a6c0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:14.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.930+0000 7f2a71400640 1 --2- 172.21.15.144:0/3928074083 >> v2:172.21.15.165:3300/0 conn(0x7f2a6c0714d0 0x7f2a6c0ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:14.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.930+0000 7f2a71400640 1 -- 172.21.15.144:0/3928074083 >> v1:172.21.15.144:6789/0 conn(0x7f2a6c071080 legacy=0x7f2a6c0b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:14.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.931+0000 7f2a71400640 1 -- 172.21.15.144:0/3928074083 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a6c0b35c0 con 0x7f2a6c15ed50 2024-09-11T23:19:14.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.930+0000 7f2a6be00640 1 -- 172.21.15.144:0/3928074083 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3081484971 0 0) 0x7f2a6c1443d0 con 0x7f2a6c071080 2024-09-11T23:19:14.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.931+0000 7f2a71400640 1 --2- 172.21.15.144:0/3928074083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a6c15ed50 0x7f2a6c143d40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c06d630 tx=0x7f2a6002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82561ac1bc9711ab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:14.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.932+0000 7f2a6be00640 1 -- 172.21.15.144:0/3928074083 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a60037070 con 0x7f2a6c15ed50 2024-09-11T23:19:14.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.932+0000 7f2a6be00640 1 -- 172.21.15.144:0/3928074083 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a60032440 con 0x7f2a6c15ed50 2024-09-11T23:19:14.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.932+0000 7f2a6be00640 1 -- 172.21.15.144:0/3928074083 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a60032810 con 0x7f2a6c15ed50 2024-09-11T23:19:14.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.932+0000 7f2a73e00640 1 -- 172.21.15.144:0/3928074083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a6c15ed50 msgr2=0x7f2a6c143d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:14.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.932+0000 7f2a73e00640 1 --2- 172.21.15.144:0/3928074083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a6c15ed50 0x7f2a6c143d40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c06d630 tx=0x7f2a6002a1e0 comp rx=0 tx=0).stop 2024-09-11T23:19:14.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.932+0000 7f2a73e00640 1 -- 172.21.15.144:0/3928074083 shutdown_connections 2024-09-11T23:19:14.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.932+0000 7f2a73e00640 1 --2- 172.21.15.144:0/3928074083 >> v2:172.21.15.165:3300/0 conn(0x7f2a6c0714d0 0x7f2a6c0ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:14.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.932+0000 7f2a73e00640 1 --2- 172.21.15.144:0/3928074083 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a6c15ed50 0x7f2a6c143d40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:14.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.932+0000 7f2a73e00640 1 -- 172.21.15.144:0/3928074083 >> 172.21.15.144:0/3928074083 conn(0x7f2a6c06bba0 msgr2=0x7f2a6c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:14.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.932+0000 7f2a73e00640 1 -- 172.21.15.144:0/3928074083 shutdown_connections 2024-09-11T23:19:14.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.932+0000 7f2a73e00640 1 -- 172.21.15.144:0/3928074083 wait complete. 2024-09-11T23:19:14.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.934+0000 7f2a73e00640 1 Processor -- start 2024-09-11T23:19:14.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.934+0000 7f2a73e00640 1 -- start start 2024-09-11T23:19:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.935+0000 7f2a73e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a6c071080 0x7f2a6c155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.935+0000 7f2a73e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a6c0714d0 0x7f2a6c0b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.935+0000 7f2a73e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a6c15ed50 0x7f2a6c1408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.935+0000 7f2a73e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c0aee20 con 0x7f2a6c15ed50 2024-09-11T23:19:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.935+0000 7f2a73e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c0b43e0 con 0x7f2a6c071080 2024-09-11T23:19:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.935+0000 7f2a73e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2a6c0aefa0 con 0x7f2a6c0714d0 2024-09-11T23:19:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.935+0000 7f2a71e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a6c15ed50 0x7f2a6c1408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.935+0000 7f2a71e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a6c15ed50 0x7f2a6c1408c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32770/0 (socket says 172.21.15.144:32770) 2024-09-11T23:19:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.935+0000 7f2a71e00640 1 -- 172.21.15.144:0/1722147535 learned_addr learned my addr 172.21.15.144:0/1722147535 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.936+0000 7f2a71400640 1 --2- 172.21.15.144:0/1722147535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a6c071080 0x7f2a6c155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:14.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.936+0000 7f2a70a00640 1 --2- 172.21.15.144:0/1722147535 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a6c0714d0 0x7f2a6c0b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:14.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.936+0000 7f2a71e00640 1 -- 172.21.15.144:0/1722147535 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a6c0714d0 msgr2=0x7f2a6c0b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:14.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.936+0000 7f2a71e00640 1 --2- 172.21.15.144:0/1722147535 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a6c0714d0 0x7f2a6c0b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:14.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.936+0000 7f2a71e00640 1 -- 172.21.15.144:0/1722147535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a6c071080 msgr2=0x7f2a6c155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:14.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.936+0000 7f2a71e00640 1 --2- 172.21.15.144:0/1722147535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a6c071080 0x7f2a6c155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:14.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.936+0000 7f2a71e00640 1 -- 172.21.15.144:0/1722147535 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a6c0b1c70 con 0x7f2a6c15ed50 2024-09-11T23:19:14.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.936+0000 7f2a71400640 1 --2- 172.21.15.144:0/1722147535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a6c071080 0x7f2a6c155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:14.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.936+0000 7f2a71e00640 1 --2- 172.21.15.144:0/1722147535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a6c15ed50 0x7f2a6c1408c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2a64007e40 tx=0x7f2a6400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:14.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.936+0000 7f2a69600640 1 -- 172.21.15.144:0/1722147535 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a64014620 con 0x7f2a6c15ed50 2024-09-11T23:19:14.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.936+0000 7f2a69600640 1 -- 172.21.15.144:0/1722147535 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a64019070 con 0x7f2a6c15ed50 2024-09-11T23:19:14.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.936+0000 7f2a73e00640 1 -- 172.21.15.144:0/1722147535 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a6c0b1f50 con 0x7f2a6c15ed50 2024-09-11T23:19:14.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.936+0000 7f2a69600640 1 -- 172.21.15.144:0/1722147535 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a64014a20 con 0x7f2a6c15ed50 2024-09-11T23:19:14.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.937+0000 7f2a73e00640 1 -- 172.21.15.144:0/1722147535 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a6c0b2510 con 0x7f2a6c15ed50 2024-09-11T23:19:14.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.938+0000 7f2a73e00640 1 -- 172.21.15.144:0/1722147535 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a6c0ae8e0 con 0x7f2a6c15ed50 2024-09-11T23:19:14.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.938+0000 7f2a69600640 1 -- 172.21.15.144:0/1722147535 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f2a64014bc0 con 0x7f2a6c15ed50 2024-09-11T23:19:14.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.939+0000 7f2a69600640 1 --2- 172.21.15.144:0/1722147535 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2a4c06bfe0 0x7f2a4c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:14.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.939+0000 7f2a69600640 1 -- 172.21.15.144:0/1722147535 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f2a6408b7c0 con 0x7f2a6c15ed50 2024-09-11T23:19:14.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.940+0000 7f2a71400640 1 --2- 172.21.15.144:0/1722147535 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2a4c06bfe0 0x7f2a4c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:14.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.940+0000 7f2a71400640 1 --2- 172.21.15.144:0/1722147535 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2a4c06bfe0 0x7f2a4c06e4a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2a60034000 tx=0x7f2a6002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:14.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:14.944+0000 7f2a69600640 1 -- 172.21.15.144:0/1722147535 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a6405a160 con 0x7f2a6c15ed50 2024-09-11T23:19:15.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.118+0000 7f2a73e00640 1 -- 172.21.15.144:0/1722147535 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2a6c1427b0 con 0x7f2a6c15ed50 2024-09-11T23:19:15.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.118+0000 7f2a69600640 1 -- 172.21.15.144:0/1722147535 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7f2a64059a60 con 0x7f2a6c15ed50 2024-09-11T23:19:15.118 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-11T23:19:15.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.120+0000 7f2a73e00640 1 -- 172.21.15.144:0/1722147535 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2a4c06bfe0 msgr2=0x7f2a4c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:15.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.120+0000 7f2a73e00640 1 --2- 172.21.15.144:0/1722147535 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2a4c06bfe0 0x7f2a4c06e4a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2a60034000 tx=0x7f2a6002e000 comp rx=0 tx=0).stop 2024-09-11T23:19:15.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.120+0000 7f2a73e00640 1 -- 172.21.15.144:0/1722147535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a6c15ed50 msgr2=0x7f2a6c1408c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:15.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.120+0000 7f2a73e00640 1 --2- 172.21.15.144:0/1722147535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a6c15ed50 0x7f2a6c1408c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2a64007e40 tx=0x7f2a6400e4b0 comp rx=0 tx=0).stop 2024-09-11T23:19:15.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.121+0000 7f2a73e00640 1 -- 172.21.15.144:0/1722147535 shutdown_connections 2024-09-11T23:19:15.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.121+0000 7f2a73e00640 1 --2- 172.21.15.144:0/1722147535 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2a4c06bfe0 0x7f2a4c06e4a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:15.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.121+0000 7f2a73e00640 1 --2- 172.21.15.144:0/1722147535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a6c15ed50 0x7f2a6c1408c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:15.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.121+0000 7f2a73e00640 1 --2- 172.21.15.144:0/1722147535 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a6c0714d0 0x7f2a6c0b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:15.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.121+0000 7f2a73e00640 1 --2- 172.21.15.144:0/1722147535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a6c071080 0x7f2a6c155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:15.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.121+0000 7f2a73e00640 1 -- 172.21.15.144:0/1722147535 >> 172.21.15.144:0/1722147535 conn(0x7f2a6c06bba0 msgr2=0x7f2a6c143bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:15.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.121+0000 7f2a73e00640 1 -- 172.21.15.144:0/1722147535 shutdown_connections 2024-09-11T23:19:15.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.121+0000 7f2a73e00640 1 -- 172.21.15.144:0/1722147535 wait complete. 2024-09-11T23:19:15.136 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2024-09-11T23:19:15.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.291+0000 7fb339c00640 1 Processor -- start 2024-09-11T23:19:15.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.291+0000 7fb339c00640 1 -- start start 2024-09-11T23:19:15.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.292+0000 7fb339c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb3340d02a0 0x7fb3340d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:15.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.292+0000 7fb339c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb33415ca40 0x7fb33415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:15.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.292+0000 7fb339c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3340d0bc0 con 0x7fb33415ce80 2024-09-11T23:19:15.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.292+0000 7fb339c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb33415d390 con 0x7fb33415ca40 2024-09-11T23:19:15.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.292+0000 7fb339c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb33415d670 con 0x7fb3340d02a0 2024-09-11T23:19:15.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.292+0000 7fb332000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb33415ca40 0x7fb33415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:15.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.292+0000 7fb332000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb33415ca40 0x7fb33415e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32774/0 (socket says 172.21.15.144:32774) 2024-09-11T23:19:15.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.292+0000 7fb332000640 1 -- 172.21.15.144:0/2166354351 learned_addr learned my addr 172.21.15.144:0/2166354351 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:15.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.292+0000 7fb332a00640 1 --2- 172.21.15.144:0/2166354351 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb3340d02a0 0x7fb3340d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:15.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.293+0000 7fb332000640 1 -- 172.21.15.144:0/2166354351 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb3340d02a0 msgr2=0x7fb3340d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:15.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.293+0000 7fb332000640 1 --2- 172.21.15.144:0/2166354351 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb3340d02a0 0x7fb3340d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:15.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.293+0000 7fb332000640 1 -- 172.21.15.144:0/2166354351 >> v1:172.21.15.165:6789/0 conn(0x7fb33415ce80 legacy=0x7fb3341594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:15.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.293+0000 7fb332000640 1 -- 172.21.15.144:0/2166354351 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33415d950 con 0x7fb33415ca40 2024-09-11T23:19:15.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.294+0000 7fb332000640 1 --2- 172.21.15.144:0/2166354351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33415ca40 0x7fb33415e430 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb32000bb10 tx=0x7fb32002c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8900f94f1c525f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:15.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.294+0000 7fb331600640 1 -- 172.21.15.144:0/2166354351 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb320032790 con 0x7fb33415ca40 2024-09-11T23:19:15.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.294+0000 7fb331600640 1 -- 172.21.15.144:0/2166354351 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb320038070 con 0x7fb33415ca40 2024-09-11T23:19:15.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.294+0000 7fb331600640 1 -- 172.21.15.144:0/2166354351 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb320032b50 con 0x7fb33415ca40 2024-09-11T23:19:15.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.295+0000 7fb339c00640 1 -- 172.21.15.144:0/2166354351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33415ca40 msgr2=0x7fb33415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:15.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.295+0000 7fb339c00640 1 --2- 172.21.15.144:0/2166354351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33415ca40 0x7fb33415e430 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb32000bb10 tx=0x7fb32002c890 comp rx=0 tx=0).stop 2024-09-11T23:19:15.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.295+0000 7fb339c00640 1 -- 172.21.15.144:0/2166354351 shutdown_connections 2024-09-11T23:19:15.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.295+0000 7fb339c00640 1 --2- 172.21.15.144:0/2166354351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33415ca40 0x7fb33415e430 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:15.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.295+0000 7fb339c00640 1 --2- 172.21.15.144:0/2166354351 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb3340d02a0 0x7fb3340d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:15.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.295+0000 7fb339c00640 1 -- 172.21.15.144:0/2166354351 >> 172.21.15.144:0/2166354351 conn(0x7fb334062cc0 msgr2=0x7fb33406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:15.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.295+0000 7fb339c00640 1 -- 172.21.15.144:0/2166354351 shutdown_connections 2024-09-11T23:19:15.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.295+0000 7fb339c00640 1 -- 172.21.15.144:0/2166354351 wait complete. 2024-09-11T23:19:15.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.296+0000 7fb339c00640 1 Processor -- start 2024-09-11T23:19:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.296+0000 7fb339c00640 1 -- start start 2024-09-11T23:19:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.297+0000 7fb339c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb3340d02a0 0x7fb3341ee790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.297+0000 7fb339c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33415ca40 0x7fb334157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.297+0000 7fb339c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb33415ce80 0x7fb334158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.297+0000 7fb339c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb334155b90 con 0x7fb33415ca40 2024-09-11T23:19:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.297+0000 7fb339c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb33415df10 con 0x7fb3340d02a0 2024-09-11T23:19:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.297+0000 7fb339c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb334155d10 con 0x7fb33415ce80 2024-09-11T23:19:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.298+0000 7fb332000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33415ca40 0x7fb334157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.298+0000 7fb332a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb3340d02a0 0x7fb3341ee790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.298+0000 7fb332000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33415ca40 0x7fb334157bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32776/0 (socket says 172.21.15.144:32776) 2024-09-11T23:19:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.298+0000 7fb332000640 1 -- 172.21.15.144:0/4004534010 learned_addr learned my addr 172.21.15.144:0/4004534010 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.298+0000 7fb333400640 1 --2- 172.21.15.144:0/4004534010 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb33415ce80 0x7fb334158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.298+0000 7fb332000640 1 -- 172.21.15.144:0/4004534010 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb33415ce80 msgr2=0x7fb334158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.298+0000 7fb332000640 1 --2- 172.21.15.144:0/4004534010 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb33415ce80 0x7fb334158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.298+0000 7fb332000640 1 -- 172.21.15.144:0/4004534010 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb3340d02a0 msgr2=0x7fb3341ee790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.298+0000 7fb332000640 1 --2- 172.21.15.144:0/4004534010 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb3340d02a0 0x7fb3341ee790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.298+0000 7fb332000640 1 -- 172.21.15.144:0/4004534010 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3341560c0 con 0x7fb33415ca40 2024-09-11T23:19:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.298+0000 7fb333400640 1 --2- 172.21.15.144:0/4004534010 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb33415ce80 0x7fb334158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.298+0000 7fb332000640 1 --2- 172.21.15.144:0/4004534010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33415ca40 0x7fb334157bc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb320000c00 tx=0x7fb320004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.299+0000 7fb32aa00640 1 -- 172.21.15.144:0/4004534010 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb320043070 con 0x7fb33415ca40 2024-09-11T23:19:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.299+0000 7fb32aa00640 1 -- 172.21.15.144:0/4004534010 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb32003c640 con 0x7fb33415ca40 2024-09-11T23:19:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.299+0000 7fb32aa00640 1 -- 172.21.15.144:0/4004534010 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32003ca30 con 0x7fb33415ca40 2024-09-11T23:19:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.299+0000 7fb339c00640 1 -- 172.21.15.144:0/4004534010 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3341563a0 con 0x7fb33415ca40 2024-09-11T23:19:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.299+0000 7fb339c00640 1 -- 172.21.15.144:0/4004534010 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb334156960 con 0x7fb33415ca40 2024-09-11T23:19:15.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.300+0000 7fb339c00640 1 -- 172.21.15.144:0/4004534010 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3340b4790 con 0x7fb33415ca40 2024-09-11T23:19:15.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.301+0000 7fb32aa00640 1 -- 172.21.15.144:0/4004534010 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fb320046070 con 0x7fb33415ca40 2024-09-11T23:19:15.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.301+0000 7fb32aa00640 1 --2- 172.21.15.144:0/4004534010 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb31406bfe0 0x7fb31406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:15.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.302+0000 7fb32aa00640 1 -- 172.21.15.144:0/4004534010 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fb3200ab3f0 con 0x7fb33415ca40 2024-09-11T23:19:15.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.302+0000 7fb332a00640 1 --2- 172.21.15.144:0/4004534010 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb31406bfe0 0x7fb31406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:15.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.302+0000 7fb332a00640 1 --2- 172.21.15.144:0/4004534010 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb31406bfe0 0x7fb31406e4a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb334157410 tx=0x7fb324008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:15.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.306+0000 7fb32aa00640 1 -- 172.21.15.144:0/4004534010 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb3200796b0 con 0x7fb33415ca40 2024-09-11T23:19:15.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:15.544+0000 7fb339c00640 1 -- 172.21.15.144:0/4004534010 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) -- 0x7fb33406cb00 con 0x7fb33415ca40 2024-09-11T23:19:16.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.397+0000 7fb32aa00640 1 -- 172.21.15.144:0/4004534010 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v91) ==== 143+0+0 (secure 0 0 0) 0x7fb32007d9b0 con 0x7fb33415ca40 2024-09-11T23:19:16.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.400+0000 7fb339c00640 1 -- 172.21.15.144:0/4004534010 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb31406bfe0 msgr2=0x7fb31406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.400+0000 7fb339c00640 1 --2- 172.21.15.144:0/4004534010 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb31406bfe0 0x7fb31406e4a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb334157410 tx=0x7fb324008040 comp rx=0 tx=0).stop 2024-09-11T23:19:16.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.400+0000 7fb339c00640 1 -- 172.21.15.144:0/4004534010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33415ca40 msgr2=0x7fb334157bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.400+0000 7fb339c00640 1 --2- 172.21.15.144:0/4004534010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33415ca40 0x7fb334157bc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb320000c00 tx=0x7fb320004730 comp rx=0 tx=0).stop 2024-09-11T23:19:16.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.401+0000 7fb339c00640 1 -- 172.21.15.144:0/4004534010 shutdown_connections 2024-09-11T23:19:16.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.401+0000 7fb339c00640 1 --2- 172.21.15.144:0/4004534010 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb31406bfe0 0x7fb31406e4a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.401+0000 7fb339c00640 1 --2- 172.21.15.144:0/4004534010 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb33415ce80 0x7fb334158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.401+0000 7fb339c00640 1 --2- 172.21.15.144:0/4004534010 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb33415ca40 0x7fb334157bc0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.401+0000 7fb339c00640 1 --2- 172.21.15.144:0/4004534010 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb3340d02a0 0x7fb3341ee790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.401+0000 7fb339c00640 1 -- 172.21.15.144:0/4004534010 >> 172.21.15.144:0/4004534010 conn(0x7fb334062cc0 msgr2=0x7fb334154190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:16.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.401+0000 7fb339c00640 1 -- 172.21.15.144:0/4004534010 shutdown_connections 2024-09-11T23:19:16.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.401+0000 7fb339c00640 1 -- 172.21.15.144:0/4004534010 wait complete. 2024-09-11T23:19:16.419 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:19:16.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.578+0000 7f8dca200640 1 Processor -- start 2024-09-11T23:19:16.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.579+0000 7f8dca200640 1 -- start start 2024-09-11T23:19:16.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.580+0000 7f8dca200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dc415c3f0 0x7f8dc406f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.580+0000 7f8dca200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dc415c7d0 con 0x7f8dc40d1f40 2024-09-11T23:19:16.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.580+0000 7f8dca200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dc40b1d60 con 0x7f8dc406f730 2024-09-11T23:19:16.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.580+0000 7f8dca200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc406fba0 con 0x7f8dc415c3f0 2024-09-11T23:19:16.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.580+0000 7f8dbbe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8dc40d1f40 0x7f8dc40d0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33616/0 (socket says 172.21.15.144:33616) 2024-09-11T23:19:16.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.580+0000 7f8dbbe00640 1 -- 172.21.15.144:0/1954610880 learned_addr learned my addr 172.21.15.144:0/1954610880 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:16.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.580+0000 7f8dc8e00640 1 --2- 172.21.15.144:0/1954610880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dc415c3f0 0x7f8dc406f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.580+0000 7f8dc3e00640 1 -- 172.21.15.144:0/1954610880 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1712587756 0 0) 0x7f8dc415c7d0 con 0x7f8dc40d1f40 2024-09-11T23:19:16.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.581+0000 7f8dc3e00640 1 -- 172.21.15.144:0/1954610880 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8da8003520 con 0x7f8dc40d1f40 2024-09-11T23:19:16.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.581+0000 7f8dc3e00640 1 -- 172.21.15.144:0/1954610880 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4251666141 0 0) 0x7f8dc40b1d60 con 0x7f8dc406f730 2024-09-11T23:19:16.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.581+0000 7f8dc3e00640 1 -- 172.21.15.144:0/1954610880 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dc415c7d0 con 0x7f8dc406f730 2024-09-11T23:19:16.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.581+0000 7f8dc8e00640 1 -- 172.21.15.144:0/1954610880 >> v1:172.21.15.165:6789/0 conn(0x7f8dc406f730 legacy=0x7f8dc40d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.581+0000 7f8dc8e00640 1 -- 172.21.15.144:0/1954610880 >> v1:172.21.15.144:6789/0 conn(0x7f8dc40d1f40 legacy=0x7f8dc40d0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.581+0000 7f8dc3e00640 1 -- 172.21.15.144:0/1954610880 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3781835616 0 0) 0x7f8da8003520 con 0x7f8dc40d1f40 2024-09-11T23:19:16.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.581+0000 7f8dc8e00640 1 -- 172.21.15.144:0/1954610880 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc40739f0 con 0x7f8dc415c3f0 2024-09-11T23:19:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.582+0000 7f8dc8e00640 1 --2- 172.21.15.144:0/1954610880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dc415c3f0 0x7f8dc406f1f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8db40097d0 tx=0x7f8db402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad730de48360b0a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.582+0000 7f8dc3e00640 1 -- 172.21.15.144:0/1954610880 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db4037070 con 0x7f8dc415c3f0 2024-09-11T23:19:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.582+0000 7f8dc3e00640 1 -- 172.21.15.144:0/1954610880 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db402ac30 con 0x7f8dc415c3f0 2024-09-11T23:19:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.582+0000 7f8dc3e00640 1 -- 172.21.15.144:0/1954610880 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac001670 con 0x7f8dc415c3f0 2024-09-11T23:19:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.583+0000 7f8dca200640 1 -- 172.21.15.144:0/1954610880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dc415c3f0 msgr2=0x7f8dc406f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.583+0000 7f8dca200640 1 --2- 172.21.15.144:0/1954610880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dc415c3f0 0x7f8dc406f1f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8db40097d0 tx=0x7f8db402a1a0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.583+0000 7f8dca200640 1 -- 172.21.15.144:0/1954610880 shutdown_connections 2024-09-11T23:19:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.583+0000 7f8dca200640 1 --2- 172.21.15.144:0/1954610880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dc415c3f0 0x7f8dc406f1f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.583+0000 7f8dca200640 1 -- 172.21.15.144:0/1954610880 >> 172.21.15.144:0/1954610880 conn(0x7f8dc40b4220 msgr2=0x7f8dc40b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:16.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.583+0000 7f8dca200640 1 -- 172.21.15.144:0/1954610880 shutdown_connections 2024-09-11T23:19:16.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.583+0000 7f8dca200640 1 -- 172.21.15.144:0/1954610880 wait complete. 2024-09-11T23:19:16.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.584+0000 7f8dca200640 1 Processor -- start 2024-09-11T23:19:16.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.585+0000 7f8dca200640 1 -- start start 2024-09-11T23:19:16.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.585+0000 7f8dca200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dc406f730 0x7f8dc414bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.586+0000 7f8dca200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dc40d1f40 0x7f8dc41e4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.586+0000 7f8dca200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dc415c3f0 0x7f8dc40abfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.586+0000 7f8dca200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc40b5520 con 0x7f8dc415c3f0 2024-09-11T23:19:16.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.586+0000 7f8dca200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc40b1b10 con 0x7f8dc40d1f40 2024-09-11T23:19:16.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.586+0000 7f8dca200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc40b56a0 con 0x7f8dc406f730 2024-09-11T23:19:16.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.586+0000 7f8dc9800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dc415c3f0 0x7f8dc40abfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.586+0000 7f8dc9800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dc415c3f0 0x7f8dc40abfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32790/0 (socket says 172.21.15.144:32790) 2024-09-11T23:19:16.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.586+0000 7f8dc9800640 1 -- 172.21.15.144:0/2656666593 learned_addr learned my addr 172.21.15.144:0/2656666593 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:16.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.586+0000 7f8dbbe00640 1 --2- 172.21.15.144:0/2656666593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dc40d1f40 0x7f8dc41e4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.586+0000 7f8dc8e00640 1 --2- 172.21.15.144:0/2656666593 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dc406f730 0x7f8dc414bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.586+0000 7f8dc9800640 1 -- 172.21.15.144:0/2656666593 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dc406f730 msgr2=0x7f8dc414bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.586+0000 7f8dc9800640 1 --2- 172.21.15.144:0/2656666593 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dc406f730 0x7f8dc414bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.586+0000 7f8dc9800640 1 -- 172.21.15.144:0/2656666593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dc40d1f40 msgr2=0x7f8dc41e4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.586+0000 7f8dc9800640 1 --2- 172.21.15.144:0/2656666593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dc40d1f40 0x7f8dc41e4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.586+0000 7f8dc9800640 1 -- 172.21.15.144:0/2656666593 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc41e5860 con 0x7f8dc415c3f0 2024-09-11T23:19:16.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.587+0000 7f8dc9800640 1 --2- 172.21.15.144:0/2656666593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dc415c3f0 0x7f8dc40abfa0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00c6e0 tx=0x7f8dbc00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:16.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.587+0000 7f8dc1600640 1 -- 172.21.15.144:0/2656666593 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc003b70 con 0x7f8dc415c3f0 2024-09-11T23:19:16.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.587+0000 7f8dc1600640 1 -- 172.21.15.144:0/2656666593 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dbc003d10 con 0x7f8dc415c3f0 2024-09-11T23:19:16.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.587+0000 7f8dc1600640 1 -- 172.21.15.144:0/2656666593 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc0052d0 con 0x7f8dc415c3f0 2024-09-11T23:19:16.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.587+0000 7f8dca200640 1 -- 172.21.15.144:0/2656666593 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc41e5b40 con 0x7f8dc415c3f0 2024-09-11T23:19:16.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.587+0000 7f8dca200640 1 -- 172.21.15.144:0/2656666593 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc41e6100 con 0x7f8dc415c3f0 2024-09-11T23:19:16.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.588+0000 7f8dca200640 1 -- 172.21.15.144:0/2656666593 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dc406f1f0 con 0x7f8dc415c3f0 2024-09-11T23:19:16.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.589+0000 7f8dc1600640 1 -- 172.21.15.144:0/2656666593 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f8dbc005470 con 0x7f8dc415c3f0 2024-09-11T23:19:16.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.590+0000 7f8dc1600640 1 --2- 172.21.15.144:0/2656666593 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8da006bfe0 0x7f8da006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:16.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.590+0000 7f8dc1600640 1 -- 172.21.15.144:0/2656666593 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f8dbc08ac20 con 0x7f8dc415c3f0 2024-09-11T23:19:16.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.591+0000 7f8dc8e00640 1 --2- 172.21.15.144:0/2656666593 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8da006bfe0 0x7f8da006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:16.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.591+0000 7f8dc8e00640 1 --2- 172.21.15.144:0/2656666593 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8da006bfe0 0x7f8da006e4a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8db4034000 tx=0x7f8db402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:16.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.595+0000 7f8dc1600640 1 -- 172.21.15.144:0/2656666593 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8dbc058ff0 con 0x7f8dc415c3f0 2024-09-11T23:19:16.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.770+0000 7f8dca200640 1 -- 172.21.15.144:0/2656666593 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8dc40b2150 con 0x7f8dc415c3f0 2024-09-11T23:19:16.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.774+0000 7f8dc1600640 1 -- 172.21.15.144:0/2656666593 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f8dbc05d2f0 con 0x7f8dc415c3f0 2024-09-11T23:19:16.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.776+0000 7f8dca200640 1 -- 172.21.15.144:0/2656666593 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8da006bfe0 msgr2=0x7f8da006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.776+0000 7f8dca200640 1 --2- 172.21.15.144:0/2656666593 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8da006bfe0 0x7f8da006e4a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8db4034000 tx=0x7f8db402e000 comp rx=0 tx=0).stop 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.776+0000 7f8dca200640 1 -- 172.21.15.144:0/2656666593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dc415c3f0 msgr2=0x7f8dc40abfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.776+0000 7f8dca200640 1 --2- 172.21.15.144:0/2656666593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dc415c3f0 0x7f8dc40abfa0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00c6e0 tx=0x7f8dbc00cba0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.776+0000 7f8dca200640 1 -- 172.21.15.144:0/2656666593 shutdown_connections 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.776+0000 7f8dca200640 1 --2- 172.21.15.144:0/2656666593 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8da006bfe0 0x7f8da006e4a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.776+0000 7f8dca200640 1 --2- 172.21.15.144:0/2656666593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dc415c3f0 0x7f8dc40abfa0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.776+0000 7f8dca200640 1 --2- 172.21.15.144:0/2656666593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dc40d1f40 0x7f8dc41e4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.776+0000 7f8dca200640 1 --2- 172.21.15.144:0/2656666593 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dc406f730 0x7f8dc414bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.776+0000 7f8dca200640 1 -- 172.21.15.144:0/2656666593 >> 172.21.15.144:0/2656666593 conn(0x7f8dc40b4220 msgr2=0x7f8dc40b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.777+0000 7f8dca200640 1 -- 172.21.15.144:0/2656666593 shutdown_connections 2024-09-11T23:19:16.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:16.777+0000 7f8dca200640 1 -- 172.21.15.144:0/2656666593 wait complete. 2024-09-11T23:19:16.793 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:19:16.793 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:19:16.881 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:19:16.975 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:19:16.976 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:19:16.976 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:17.014 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:19:17.014 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:19:17.014 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:17.051 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:19:17.051 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:19:17.051 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:17.090 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:19:17.091 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:19:17.091 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:17.127 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:19:17.127 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T23:19:17.127 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:17.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.283+0000 7f6a1a400640 1 Processor -- start 2024-09-11T23:19:17.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.283+0000 7f6a1a400640 1 -- start start 2024-09-11T23:19:17.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.284+0000 7f6a1a400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a1415c180 0x7f6a140cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.284+0000 7f6a1a400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a140ce230 0x7f6a140cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.284+0000 7f6a1a400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a140ce740 con 0x7f6a140cf5b0 2024-09-11T23:19:17.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.284+0000 7f6a1a400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6a14072640 con 0x7f6a140ce230 2024-09-11T23:19:17.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.284+0000 7f6a1a400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6a14072920 con 0x7f6a1415c180 2024-09-11T23:19:17.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.285+0000 7f6a12a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a140ce230 0x7f6a140cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.285+0000 7f6a12a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a140ce230 0x7f6a140cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32792/0 (socket says 172.21.15.144:32792) 2024-09-11T23:19:17.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.285+0000 7f6a12a00640 1 -- 172.21.15.144:0/1806665543 learned_addr learned my addr 172.21.15.144:0/1806665543 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:17.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.285+0000 7f6a13e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6a140cf5b0 0x7f6a14073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33618/0 (socket says 172.21.15.144:33618) 2024-09-11T23:19:17.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.285+0000 7f6a13400640 1 --2- 172.21.15.144:0/1806665543 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a1415c180 0x7f6a140cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.285+0000 7f6a12a00640 1 -- 172.21.15.144:0/1806665543 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a1415c180 msgr2=0x7f6a140cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:17.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.285+0000 7f6a12a00640 1 --2- 172.21.15.144:0/1806665543 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a1415c180 0x7f6a140cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.285+0000 7f6a12a00640 1 -- 172.21.15.144:0/1806665543 >> v1:172.21.15.144:6789/0 conn(0x7f6a140cf5b0 legacy=0x7f6a14073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.285+0000 7f6a12a00640 1 -- 172.21.15.144:0/1806665543 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a14072c00 con 0x7f6a140ce230 2024-09-11T23:19:17.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.286+0000 7f6a12a00640 1 --2- 172.21.15.144:0/1806665543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a140ce230 0x7f6a140cf070 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009870 tx=0x7f6a0002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09d2d6d3bb14efb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:17.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.286+0000 7f6a12000640 1 -- 172.21.15.144:0/1806665543 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00037070 con 0x7f6a140ce230 2024-09-11T23:19:17.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.286+0000 7f6a12000640 1 -- 172.21.15.144:0/1806665543 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a00032440 con 0x7f6a140ce230 2024-09-11T23:19:17.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.286+0000 7f6a12000640 1 -- 172.21.15.144:0/1806665543 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00032810 con 0x7f6a140ce230 2024-09-11T23:19:17.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.287+0000 7f6a1a400640 1 -- 172.21.15.144:0/1806665543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a140ce230 msgr2=0x7f6a140cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.287+0000 7f6a1a400640 1 --2- 172.21.15.144:0/1806665543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a140ce230 0x7f6a140cf070 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009870 tx=0x7f6a0002a1e0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.287+0000 7f6a1a400640 1 -- 172.21.15.144:0/1806665543 shutdown_connections 2024-09-11T23:19:17.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.287+0000 7f6a1a400640 1 --2- 172.21.15.144:0/1806665543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a140ce230 0x7f6a140cf070 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.287+0000 7f6a1a400640 1 --2- 172.21.15.144:0/1806665543 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a1415c180 0x7f6a140cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.287+0000 7f6a1a400640 1 -- 172.21.15.144:0/1806665543 >> 172.21.15.144:0/1806665543 conn(0x7f6a14062cc0 msgr2=0x7f6a1406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:17.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.287+0000 7f6a1a400640 1 -- 172.21.15.144:0/1806665543 shutdown_connections 2024-09-11T23:19:17.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.287+0000 7f6a1a400640 1 -- 172.21.15.144:0/1806665543 wait complete. 2024-09-11T23:19:17.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.289+0000 7f6a1a400640 1 Processor -- start 2024-09-11T23:19:17.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.289+0000 7f6a1a400640 1 -- start start 2024-09-11T23:19:17.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.290+0000 7f6a1a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a140ce230 0x7f6a140aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.290+0000 7f6a1a400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a140cf5b0 0x7f6a14152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.290+0000 7f6a1a400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a1415c180 0x7f6a14154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.290+0000 7f6a1a400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1415c560 con 0x7f6a140ce230 2024-09-11T23:19:17.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.290+0000 7f6a1a400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6a140722f0 con 0x7f6a1415c180 2024-09-11T23:19:17.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.290+0000 7f6a1a400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6a1415c6e0 con 0x7f6a140cf5b0 2024-09-11T23:19:17.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.290+0000 7f6a13400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a140ce230 0x7f6a140aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.290+0000 7f6a13400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a140ce230 0x7f6a140aa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32794/0 (socket says 172.21.15.144:32794) 2024-09-11T23:19:17.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.290+0000 7f6a13400640 1 -- 172.21.15.144:0/967148675 learned_addr learned my addr 172.21.15.144:0/967148675 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:17.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.290+0000 7f6a12a00640 1 --2- 172.21.15.144:0/967148675 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a140cf5b0 0x7f6a14152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.290+0000 7f6a13e00640 1 --2- 172.21.15.144:0/967148675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a1415c180 0x7f6a14154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.290+0000 7f6a13400640 1 -- 172.21.15.144:0/967148675 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a140cf5b0 msgr2=0x7f6a14152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.290+0000 7f6a13400640 1 --2- 172.21.15.144:0/967148675 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a140cf5b0 0x7f6a14152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.290+0000 7f6a13400640 1 -- 172.21.15.144:0/967148675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a1415c180 msgr2=0x7f6a14154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.290+0000 7f6a13400640 1 --2- 172.21.15.144:0/967148675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a1415c180 0x7f6a14154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.290+0000 7f6a13400640 1 -- 172.21.15.144:0/967148675 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a140b0e70 con 0x7f6a140ce230 2024-09-11T23:19:17.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.290+0000 7f6a13e00640 1 --2- 172.21.15.144:0/967148675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a1415c180 0x7f6a14154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:17.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.290+0000 7f6a12a00640 1 --2- 172.21.15.144:0/967148675 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a140cf5b0 0x7f6a14152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:17.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.291+0000 7f6a13400640 1 --2- 172.21.15.144:0/967148675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a140ce230 0x7f6a140aa4d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400e9b0 tx=0x7f6a0400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:17.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.291+0000 7f6a0b400640 1 -- 172.21.15.144:0/967148675 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a04017070 con 0x7f6a140ce230 2024-09-11T23:19:17.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.291+0000 7f6a0b400640 1 -- 172.21.15.144:0/967148675 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0400c9a0 con 0x7f6a140ce230 2024-09-11T23:19:17.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.291+0000 7f6a0b400640 1 -- 172.21.15.144:0/967148675 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400cd90 con 0x7f6a140ce230 2024-09-11T23:19:17.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.291+0000 7f6a1a400640 1 -- 172.21.15.144:0/967148675 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a140b1390 con 0x7f6a140ce230 2024-09-11T23:19:17.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.291+0000 7f6a1a400640 1 -- 172.21.15.144:0/967148675 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a140b1950 con 0x7f6a140ce230 2024-09-11T23:19:17.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.292+0000 7f6a1a400640 1 -- 172.21.15.144:0/967148675 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a140cf070 con 0x7f6a140ce230 2024-09-11T23:19:17.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.293+0000 7f6a0b400640 1 -- 172.21.15.144:0/967148675 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f6a0401a070 con 0x7f6a140ce230 2024-09-11T23:19:17.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.294+0000 7f6a0b400640 1 --2- 172.21.15.144:0/967148675 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f69f406bfe0 0x7f69f406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.294+0000 7f6a0b400640 1 -- 172.21.15.144:0/967148675 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f6a0408b280 con 0x7f6a140ce230 2024-09-11T23:19:17.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.294+0000 7f6a12a00640 1 --2- 172.21.15.144:0/967148675 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f69f406bfe0 0x7f69f406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.295+0000 7f6a12a00640 1 --2- 172.21.15.144:0/967148675 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f69f406bfe0 0x7f69f406e4a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6a00034000 tx=0x7f6a0002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:17.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.298+0000 7f6a0b400640 1 -- 172.21.15.144:0/967148675 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a04059ca0 con 0x7f6a140ce230 2024-09-11T23:19:17.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.508+0000 7f6a1a400640 1 -- 172.21.15.144:0/967148675 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a14073f60 con 0x7f6a140ce230 2024-09-11T23:19:17.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.508+0000 7f6a0b400640 1 -- 172.21.15.144:0/967148675 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3917 (secure 0 0 0) 0x7f6a040595a0 con 0x7f6a140ce230 2024-09-11T23:19:17.508 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:17.508 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":20,"btime":"2024-09-11T23:19:11:377449+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4601,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/4045809607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":4045809607},{"type":"v1","addr":"172.21.15.165:6835","nonce":4045809607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2584561527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2584561527},{"type":"v1","addr":"172.21.15.165:6834","nonce":2584561527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4815,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/787593912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":787593912},{"type":"v1","addr":"172.21.15.144:6836","nonce":787593912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5151,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/917850246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":917850246},{"type":"v1","addr":"172.21.15.144:6837","nonce":917850246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-09-11T23:19:17.509 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 20 2024-09-11T23:19:17.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.510+0000 7f6a1a400640 1 -- 172.21.15.144:0/967148675 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f69f406bfe0 msgr2=0x7f69f406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.510+0000 7f6a1a400640 1 --2- 172.21.15.144:0/967148675 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f69f406bfe0 0x7f69f406e4a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6a00034000 tx=0x7f6a0002e000 comp rx=0 tx=0).stop 2024-09-11T23:19:17.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.510+0000 7f6a1a400640 1 -- 172.21.15.144:0/967148675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a140ce230 msgr2=0x7f6a140aa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.510+0000 7f6a1a400640 1 --2- 172.21.15.144:0/967148675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a140ce230 0x7f6a140aa4d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400e9b0 tx=0x7f6a0400ee70 comp rx=0 tx=0).stop 2024-09-11T23:19:17.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.511+0000 7f6a1a400640 1 -- 172.21.15.144:0/967148675 shutdown_connections 2024-09-11T23:19:17.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.511+0000 7f6a1a400640 1 --2- 172.21.15.144:0/967148675 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f69f406bfe0 0x7f69f406e4a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.511+0000 7f6a1a400640 1 --2- 172.21.15.144:0/967148675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a1415c180 0x7f6a14154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.511+0000 7f6a1a400640 1 --2- 172.21.15.144:0/967148675 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a140cf5b0 0x7f6a14152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.511+0000 7f6a1a400640 1 --2- 172.21.15.144:0/967148675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a140ce230 0x7f6a140aa4d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.511+0000 7f6a1a400640 1 -- 172.21.15.144:0/967148675 >> 172.21.15.144:0/967148675 conn(0x7f6a14062cc0 msgr2=0x7f6a140b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:17.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.511+0000 7f6a1a400640 1 -- 172.21.15.144:0/967148675 shutdown_connections 2024-09-11T23:19:17.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.511+0000 7f6a1a400640 1 -- 172.21.15.144:0/967148675 wait complete. 2024-09-11T23:19:17.527 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:19:17.528 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:19:17.528 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:19:17.528 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:19:17.528 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:19:17.528 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T23:19:17.528 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:19:17.529 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:19:17.529 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:19:17.529 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:19:17.529 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:19:17.529 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:19:17.529 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:19:17.529 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T23:19:17.530 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:19:17.530 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:19:17.544 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:19:17.545 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:19:17.545 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:19:17.545 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:19:17.546 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:19:17.547 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:19:17.547 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:19:17.548 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:19:17.589 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:19:17.589 DEBUG:teuthology.parallel:result is None 2024-09-11T23:19:17.591 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:19:17.591 DEBUG:teuthology.parallel:result is None 2024-09-11T23:19:17.591 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:19:17.592 DEBUG:teuthology.parallel:result is None 2024-09-11T23:19:17.593 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:19:17.593 DEBUG:teuthology.parallel:result is None 2024-09-11T23:19:17.594 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:19:17.719 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-11T23:19:17.720 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-11T23:19:17.721 INFO:tasks.ceph.mds.d.smithi165.stderr:2024-09-11T23:19:17.721+0000 7fb9da200640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-11T23:19:17.723 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-11T23:19:17.723 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-11T23:19:17.748 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-11T23:19:17.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.754+0000 7fb674000640 1 Processor -- start 2024-09-11T23:19:17.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.754+0000 7fb674000640 1 -- start start 2024-09-11T23:19:17.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.755+0000 7fb674000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb66c15ed20 0x7fb66c0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.755+0000 7fb674000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb66c0b7170 con 0x7fb66c15e940 2024-09-11T23:19:17.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.755+0000 7fb674000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb66c0b7aa0 con 0x7fb66c0cef90 2024-09-11T23:19:17.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.755+0000 7fb674000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb66c0d3660 con 0x7fb66c15ed20 2024-09-11T23:19:17.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.755+0000 7fb670c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb66c15ed20 0x7fb66c0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.756+0000 7fb670c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb66c15ed20 0x7fb66c0b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32828/0 (socket says 172.21.15.144:32828) 2024-09-11T23:19:17.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.756+0000 7fb670c00640 1 -- 172.21.15.144:0/2562905361 learned_addr learned my addr 172.21.15.144:0/2562905361 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:17.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.756+0000 7fb671600640 1 --1- 172.21.15.144:0/2562905361 >> v1:172.21.15.144:6789/0 conn(0x7fb66c15e940 0x7fb66c0d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33640/0 (socket says 172.21.15.144:33640) 2024-09-11T23:19:17.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.756+0000 7fb66be00640 1 -- 172.21.15.144:0/2562905361 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2082645813 0 0) 0x7fb66c0b7aa0 con 0x7fb66c0cef90 2024-09-11T23:19:17.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.756+0000 7fb670c00640 1 -- 172.21.15.144:0/2562905361 >> v1:172.21.15.165:6789/0 conn(0x7fb66c0cef90 legacy=0x7fb66c0b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.756+0000 7fb670c00640 1 -- 172.21.15.144:0/2562905361 >> v1:172.21.15.144:6789/0 conn(0x7fb66c15e940 legacy=0x7fb66c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.756+0000 7fb670c00640 1 -- 172.21.15.144:0/2562905361 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66c0d3940 con 0x7fb66c15ed20 2024-09-11T23:19:17.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.757+0000 7fb670c00640 1 --2- 172.21.15.144:0/2562905361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb66c15ed20 0x7fb66c0b3220 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb658009870 tx=0x7fb65802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d1ef533a275429 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:17.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.757+0000 7fb66be00640 1 -- 172.21.15.144:0/2562905361 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb658037070 con 0x7fb66c15ed20 2024-09-11T23:19:17.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.757+0000 7fb66be00640 1 -- 172.21.15.144:0/2562905361 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb658032440 con 0x7fb66c15ed20 2024-09-11T23:19:17.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.757+0000 7fb66be00640 1 -- 172.21.15.144:0/2562905361 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb658032810 con 0x7fb66c15ed20 2024-09-11T23:19:17.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.758+0000 7fb674000640 1 -- 172.21.15.144:0/2562905361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb66c15ed20 msgr2=0x7fb66c0b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.758+0000 7fb674000640 1 --2- 172.21.15.144:0/2562905361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb66c15ed20 0x7fb66c0b3220 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb658009870 tx=0x7fb65802a290 comp rx=0 tx=0).stop 2024-09-11T23:19:17.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.758+0000 7fb674000640 1 -- 172.21.15.144:0/2562905361 shutdown_connections 2024-09-11T23:19:17.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.758+0000 7fb674000640 1 --2- 172.21.15.144:0/2562905361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb66c15ed20 0x7fb66c0b3220 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.758+0000 7fb674000640 1 -- 172.21.15.144:0/2562905361 >> 172.21.15.144:0/2562905361 conn(0x7fb66c0b6240 msgr2=0x7fb66c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:17.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.758+0000 7fb674000640 1 -- 172.21.15.144:0/2562905361 shutdown_connections 2024-09-11T23:19:17.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.758+0000 7fb674000640 1 -- 172.21.15.144:0/2562905361 wait complete. 2024-09-11T23:19:17.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.760+0000 7fb674000640 1 Processor -- start 2024-09-11T23:19:17.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.760+0000 7fb674000640 1 -- start start 2024-09-11T23:19:17.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.760+0000 7fb674000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb66c0cef90 0x7fb66c157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.760+0000 7fb674000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb66c15e940 0x7fb66c15b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.761+0000 7fb674000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb66c15ed20 0x7fb66c0cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.761+0000 7fb674000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c0d3310 con 0x7fb66c0cef90 2024-09-11T23:19:17.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.761+0000 7fb674000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c0d3f00 con 0x7fb66c15e940 2024-09-11T23:19:17.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.761+0000 7fb674000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb66c0d1ef0 con 0x7fb66c15ed20 2024-09-11T23:19:17.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.761+0000 7fb671600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb66c0cef90 0x7fb66c157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.761+0000 7fb671600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb66c0cef90 0x7fb66c157c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32842/0 (socket says 172.21.15.144:32842) 2024-09-11T23:19:17.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.761+0000 7fb671600640 1 -- 172.21.15.144:0/3693034323 learned_addr learned my addr 172.21.15.144:0/3693034323 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:17.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.761+0000 7fb670c00640 1 --2- 172.21.15.144:0/3693034323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb66c15e940 0x7fb66c15b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.761+0000 7fb672000640 1 --2- 172.21.15.144:0/3693034323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb66c15ed20 0x7fb66c0cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.761+0000 7fb671600640 1 -- 172.21.15.144:0/3693034323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb66c15ed20 msgr2=0x7fb66c0cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.761+0000 7fb671600640 1 --2- 172.21.15.144:0/3693034323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb66c15ed20 0x7fb66c0cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.761+0000 7fb671600640 1 -- 172.21.15.144:0/3693034323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb66c15e940 msgr2=0x7fb66c15b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.761+0000 7fb671600640 1 --2- 172.21.15.144:0/3693034323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb66c15e940 0x7fb66c15b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.761+0000 7fb671600640 1 -- 172.21.15.144:0/3693034323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66c15b6e0 con 0x7fb66c0cef90 2024-09-11T23:19:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.761+0000 7fb671600640 1 --2- 172.21.15.144:0/3693034323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb66c0cef90 0x7fb66c157c90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb66000c8c0 tx=0x7fb66000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.762+0000 7fb669600640 1 -- 172.21.15.144:0/3693034323 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb660018070 con 0x7fb66c0cef90 2024-09-11T23:19:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.762+0000 7fb669600640 1 -- 172.21.15.144:0/3693034323 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6600074e0 con 0x7fb66c0cef90 2024-09-11T23:19:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.762+0000 7fb669600640 1 -- 172.21.15.144:0/3693034323 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb660004a20 con 0x7fb66c0cef90 2024-09-11T23:19:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.762+0000 7fb674000640 1 -- 172.21.15.144:0/3693034323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb66c1f4b90 con 0x7fb66c0cef90 2024-09-11T23:19:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.762+0000 7fb674000640 1 -- 172.21.15.144:0/3693034323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb66c1f5150 con 0x7fb66c0cef90 2024-09-11T23:19:17.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.763+0000 7fb674000640 1 -- 172.21.15.144:0/3693034323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb66c068cd0 con 0x7fb66c0cef90 2024-09-11T23:19:17.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.764+0000 7fb669600640 1 -- 172.21.15.144:0/3693034323 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fb66001b070 con 0x7fb66c0cef90 2024-09-11T23:19:17.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.765+0000 7fb669600640 1 --2- 172.21.15.144:0/3693034323 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb64c06c030 0x7fb64c06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:17.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.765+0000 7fb669600640 1 -- 172.21.15.144:0/3693034323 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fb66008a990 con 0x7fb66c0cef90 2024-09-11T23:19:17.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.766+0000 7fb670c00640 1 --2- 172.21.15.144:0/3693034323 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb64c06c030 0x7fb64c06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:17.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.766+0000 7fb670c00640 1 --2- 172.21.15.144:0/3693034323 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb64c06c030 0x7fb64c06e4f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb658034000 tx=0x7fb65802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:17.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.768+0000 7fb669600640 1 -- 172.21.15.144:0/3693034323 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb66c068cd0 con 0x7fb66c0cef90 2024-09-11T23:19:17.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:17.956+0000 7fb674000640 1 -- 172.21.15.144:0/3693034323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fb66c0d1060 con 0x7fb66c0cef90 2024-09-11T23:19:18.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.790+0000 7fb669600640 1 -- 172.21.15.144:0/3693034323 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v42) ==== 97+0+0 (secure 0 0 0) 0x7fb660022020 con 0x7fb66c0cef90 2024-09-11T23:19:18.790 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-11T23:19:18.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.793+0000 7fb674000640 1 -- 172.21.15.144:0/3693034323 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb64c06c030 msgr2=0x7fb64c06e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:18.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.793+0000 7fb674000640 1 --2- 172.21.15.144:0/3693034323 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb64c06c030 0x7fb64c06e4f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb658034000 tx=0x7fb65802e000 comp rx=0 tx=0).stop 2024-09-11T23:19:18.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.793+0000 7fb674000640 1 -- 172.21.15.144:0/3693034323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb66c0cef90 msgr2=0x7fb66c157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:18.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.793+0000 7fb674000640 1 --2- 172.21.15.144:0/3693034323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb66c0cef90 0x7fb66c157c90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb66000c8c0 tx=0x7fb66000cd80 comp rx=0 tx=0).stop 2024-09-11T23:19:18.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.794+0000 7fb674000640 1 -- 172.21.15.144:0/3693034323 shutdown_connections 2024-09-11T23:19:18.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.794+0000 7fb674000640 1 --2- 172.21.15.144:0/3693034323 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb64c06c030 0x7fb64c06e4f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:18.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.794+0000 7fb674000640 1 --2- 172.21.15.144:0/3693034323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb66c15ed20 0x7fb66c0cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:18.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.794+0000 7fb674000640 1 --2- 172.21.15.144:0/3693034323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb66c15e940 0x7fb66c15b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:18.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.794+0000 7fb674000640 1 --2- 172.21.15.144:0/3693034323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb66c0cef90 0x7fb66c157c90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:18.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.794+0000 7fb674000640 1 -- 172.21.15.144:0/3693034323 >> 172.21.15.144:0/3693034323 conn(0x7fb66c0b6240 msgr2=0x7fb66c15f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:18.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.794+0000 7fb674000640 1 -- 172.21.15.144:0/3693034323 shutdown_connections 2024-09-11T23:19:18.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.794+0000 7fb674000640 1 -- 172.21.15.144:0/3693034323 wait complete. 2024-09-11T23:19:18.812 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:19:18.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.969+0000 7f1dd0400640 1 Processor -- start 2024-09-11T23:19:18.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.969+0000 7f1dd0400640 1 -- start start 2024-09-11T23:19:18.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.971+0000 7f1dd0400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dc80d02a0 0x7f1dc80d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:18.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.971+0000 7f1dd0400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1dc815ca40 0x7f1dc815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:18.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.971+0000 7f1dd0400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dc80d0bc0 con 0x7f1dc815ce80 2024-09-11T23:19:18.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.971+0000 7f1dd0400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1dc815d390 con 0x7f1dc815ca40 2024-09-11T23:19:18.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.971+0000 7f1dd0400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc815d670 con 0x7f1dc80d02a0 2024-09-11T23:19:18.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.971+0000 7f1dcd000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1dc815ca40 0x7f1dc815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:18.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.971+0000 7f1dcd000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1dc815ca40 0x7f1dc815e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32846/0 (socket says 172.21.15.144:32846) 2024-09-11T23:19:18.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.971+0000 7f1dcd000640 1 -- 172.21.15.144:0/3348323928 learned_addr learned my addr 172.21.15.144:0/3348323928 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:18.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.971+0000 7f1dcda00640 1 --2- 172.21.15.144:0/3348323928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dc80d02a0 0x7f1dc80d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:18.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.971+0000 7f1dcd000640 1 -- 172.21.15.144:0/3348323928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dc80d02a0 msgr2=0x7f1dc80d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:18.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.971+0000 7f1dcd000640 1 --2- 172.21.15.144:0/3348323928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dc80d02a0 0x7f1dc80d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:18.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.971+0000 7f1dcd000640 1 -- 172.21.15.144:0/3348323928 >> v1:172.21.15.165:6789/0 conn(0x7f1dc815ce80 legacy=0x7f1dc81594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:18.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.971+0000 7f1dcd000640 1 -- 172.21.15.144:0/3348323928 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc815d950 con 0x7f1dc815ca40 2024-09-11T23:19:18.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.971+0000 7f1dcda00640 1 --2- 172.21.15.144:0/3348323928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dc80d02a0 0x7f1dc80d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:18.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.972+0000 7f1dcd000640 1 --2- 172.21.15.144:0/3348323928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dc815ca40 0x7f1dc815e430 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009870 tx=0x7f1db402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24adb5db7ea8c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:18.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.973+0000 7f1dc7e00640 1 -- 172.21.15.144:0/3348323928 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db4037070 con 0x7f1dc815ca40 2024-09-11T23:19:18.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.973+0000 7f1dc7e00640 1 -- 172.21.15.144:0/3348323928 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db4032440 con 0x7f1dc815ca40 2024-09-11T23:19:18.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.973+0000 7f1dc7e00640 1 -- 172.21.15.144:0/3348323928 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db4032810 con 0x7f1dc815ca40 2024-09-11T23:19:18.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.973+0000 7f1dd0400640 1 -- 172.21.15.144:0/3348323928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dc815ca40 msgr2=0x7f1dc815e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:18.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.973+0000 7f1dd0400640 1 --2- 172.21.15.144:0/3348323928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dc815ca40 0x7f1dc815e430 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009870 tx=0x7f1db402a180 comp rx=0 tx=0).stop 2024-09-11T23:19:18.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.973+0000 7f1dd0400640 1 -- 172.21.15.144:0/3348323928 shutdown_connections 2024-09-11T23:19:18.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.973+0000 7f1dd0400640 1 --2- 172.21.15.144:0/3348323928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dc815ca40 0x7f1dc815e430 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:18.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.973+0000 7f1dd0400640 1 --2- 172.21.15.144:0/3348323928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dc80d02a0 0x7f1dc80d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:18.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.973+0000 7f1dd0400640 1 -- 172.21.15.144:0/3348323928 >> 172.21.15.144:0/3348323928 conn(0x7f1dc8062cc0 msgr2=0x7f1dc806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:18.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.973+0000 7f1dd0400640 1 -- 172.21.15.144:0/3348323928 shutdown_connections 2024-09-11T23:19:18.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.973+0000 7f1dd0400640 1 -- 172.21.15.144:0/3348323928 wait complete. 2024-09-11T23:19:18.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.975+0000 7f1dd0400640 1 Processor -- start 2024-09-11T23:19:18.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.975+0000 7f1dd0400640 1 -- start start 2024-09-11T23:19:18.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.976+0000 7f1dd0400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dc80d02a0 0x7f1dc81f3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:18.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.976+0000 7f1dd0400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1dc815ca40 0x7f1dc814b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:18.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.976+0000 7f1dd0400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dc815ce80 0x7f1dc815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:18.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.976+0000 7f1dd0400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc8155b90 con 0x7f1dc815ce80 2024-09-11T23:19:18.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.976+0000 7f1dd0400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc815df10 con 0x7f1dc815ca40 2024-09-11T23:19:18.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.976+0000 7f1dd0400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc8155d10 con 0x7f1dc80d02a0 2024-09-11T23:19:18.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.976+0000 7f1dce400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dc815ce80 0x7f1dc815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:18.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.976+0000 7f1dce400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dc815ce80 0x7f1dc815b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32860/0 (socket says 172.21.15.144:32860) 2024-09-11T23:19:18.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.976+0000 7f1dce400640 1 -- 172.21.15.144:0/2352996564 learned_addr learned my addr 172.21.15.144:0/2352996564 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:18.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.976+0000 7f1dcda00640 1 --2- 172.21.15.144:0/2352996564 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dc80d02a0 0x7f1dc81f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:18.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.976+0000 7f1dcd000640 1 --2- 172.21.15.144:0/2352996564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1dc815ca40 0x7f1dc814b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:18.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.977+0000 7f1dce400640 1 -- 172.21.15.144:0/2352996564 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dc80d02a0 msgr2=0x7f1dc81f3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:18.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.977+0000 7f1dce400640 1 --2- 172.21.15.144:0/2352996564 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dc80d02a0 0x7f1dc81f3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:18.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.977+0000 7f1dce400640 1 -- 172.21.15.144:0/2352996564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1dc815ca40 msgr2=0x7f1dc814b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:18.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.977+0000 7f1dce400640 1 --2- 172.21.15.144:0/2352996564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1dc815ca40 0x7f1dc814b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:18.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.977+0000 7f1dce400640 1 -- 172.21.15.144:0/2352996564 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc814bfc0 con 0x7f1dc815ce80 2024-09-11T23:19:18.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.977+0000 7f1dce400640 1 --2- 172.21.15.144:0/2352996564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dc815ce80 0x7f1dc815b1c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000c780 tx=0x7f1dc000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:18.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.977+0000 7f1dc5600640 1 -- 172.21.15.144:0/2352996564 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0004b60 con 0x7f1dc815ce80 2024-09-11T23:19:18.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.977+0000 7f1dc5600640 1 -- 172.21.15.144:0/2352996564 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dc0004d00 con 0x7f1dc815ce80 2024-09-11T23:19:18.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.977+0000 7f1dc5600640 1 -- 172.21.15.144:0/2352996564 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc000aa90 con 0x7f1dc815ce80 2024-09-11T23:19:18.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.977+0000 7f1dd0400640 1 -- 172.21.15.144:0/2352996564 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc814c2a0 con 0x7f1dc815ce80 2024-09-11T23:19:18.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.977+0000 7f1dd0400640 1 -- 172.21.15.144:0/2352996564 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc814c860 con 0x7f1dc815ce80 2024-09-11T23:19:18.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.978+0000 7f1dd0400640 1 -- 172.21.15.144:0/2352996564 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dc80b4790 con 0x7f1dc815ce80 2024-09-11T23:19:18.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.979+0000 7f1dc5600640 1 -- 172.21.15.144:0/2352996564 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f1dc000ac30 con 0x7f1dc815ce80 2024-09-11T23:19:18.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.980+0000 7f1dc5600640 1 --2- 172.21.15.144:0/2352996564 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1da806bfe0 0x7f1da806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:18.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.980+0000 7f1dc5600640 1 -- 172.21.15.144:0/2352996564 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f1dc008afd0 con 0x7f1dc815ce80 2024-09-11T23:19:18.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.980+0000 7f1dcda00640 1 --2- 172.21.15.144:0/2352996564 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1da806bfe0 0x7f1da806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:18.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.981+0000 7f1dcda00640 1 --2- 172.21.15.144:0/2352996564 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1da806bfe0 0x7f1da806e4a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1dc815b150 tx=0x7f1dbc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:18.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:18.985+0000 7f1dc5600640 1 -- 172.21.15.144:0/2352996564 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1dc0020070 con 0x7f1dc815ce80 2024-09-11T23:19:19.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.221+0000 7f1dd0400640 1 -- 172.21.15.144:0/2352996564 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f1dc81f3d40 con 0x7f1dc815ce80 2024-09-11T23:19:19.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.222+0000 7f1dc5600640 1 -- 172.21.15.144:0/2352996564 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) ==== 80+0+5304 (secure 0 0 0) 0x7f1dc00593f0 con 0x7f1dc815ce80 2024-09-11T23:19:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:19.222 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:19:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-11T23:19:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-11T23:19:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmQjymBhAA4BWEVNGY37RsnMGLL3Ow8A==", 2024-09-11T23:19:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:19:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:19:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:19:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:19:19.222 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:19:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:19:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-11T23:19:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmD0mIGhAAvug7T/kOcEmnyMyG++V+zA==", 2024-09-11T23:19:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:19:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:19:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:19:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:19:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:19:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:19:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:19.223 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-11T23:19:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmDwSZEBAAdf4eF3MrADSPzBTICzpOiA==", 2024-09-11T23:19:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:19:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:19:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:19:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:19:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:19:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:19:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-11T23:19:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmqYtRJBAAgpzvHNUPVnxNoflhqVIJuQ==", 2024-09-11T23:19:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:19:19.224 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:19:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:19:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:19:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:19:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:19:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-11T23:19:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDiJOJmzDABABAA+Qa772+Mm69pecG0QUXlyA==", 2024-09-11T23:19:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:19:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:19:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:19:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:19:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-11T23:19:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDlJOJmgVjJKRAAtl30JxJHurKdrn1vLUneww==", 2024-09-11T23:19:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:19:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:19:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:19:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:19:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-11T23:19:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDpJOJmRzO6FxAAiLDOwDlXYTj6WfEhlI+uVQ==", 2024-09-11T23:19:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:19:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:19.226 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:19:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:19:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:19:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-11T23:19:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDtJOJmVFh6EhAA7hcJn4k31nEPMcqiB7+djA==", 2024-09-11T23:19:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:19:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:19:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:19:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:19:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:19.227 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-11T23:19:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD0JOJmpIFTAhAAYQyoBrMjL6CcDDCNAOMGwQ==", 2024-09-11T23:19:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:19:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:19:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:19:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:19:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-11T23:19:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD4JOJmBAIIDhAA8G/usUslfQPNpFP1YZsgmg==", 2024-09-11T23:19:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:19:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:19:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:19:19.228 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:19:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-11T23:19:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD8JOJmDl2dCBAA5bL+2AIp0uWL4qjpI/mAdQ==", 2024-09-11T23:19:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:19:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:19:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:19:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:19:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-11T23:19:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAAJeJmMWX+AhAA7ABVgJPwhRZNkPNdZzmnOQ==", 2024-09-11T23:19:19.229 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:19:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:19:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:19:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:19:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:19:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-11T23:19:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A==", 2024-09-11T23:19:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:19:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:19:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-11T23:19:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T23:19:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:19:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-11T23:19:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmLFrBORAAT64lj0sWlVoTHVUZQf0JjA==", 2024-09-11T23:19:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:19:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:19:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:19:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:19:19.231 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:19:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:19:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-11T23:19:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJm2/dLMxAAbuKdVAbscrlF5jcBnouBOQ==", 2024-09-11T23:19:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:19:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:19:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:19:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:19:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:19:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:19:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:19.232 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-11T23:19:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDfJOJmse6UBBAAq+3afsp+2jApe9sTFmVVOw==", 2024-09-11T23:19:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:19:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:19:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:19:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:19:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:19:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:19:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-11T23:19:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmHmAwEhAAEGCvu0NgtyjIPcJBk6bkdA==", 2024-09-11T23:19:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:19:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:19:19.233 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:19:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:19:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:19:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:19:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-11T23:19:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmxMaVOxAA62zJwlyk0qdrsemalijH4Q==", 2024-09-11T23:19:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:19:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:19:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:19:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:19:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:19:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:19.234 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-11T23:19:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmWZRNNBAAwZ2GCP7mGn87ZSnsKCcDRQ==", 2024-09-11T23:19:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:19:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:19:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:19:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:19:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.235 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:19:19.235 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:19:19.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.224+0000 7f1dd0400640 1 -- 172.21.15.144:0/2352996564 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1da806bfe0 msgr2=0x7f1da806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:19.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.224+0000 7f1dd0400640 1 --2- 172.21.15.144:0/2352996564 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1da806bfe0 0x7f1da806e4a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1dc815b150 tx=0x7f1dbc008040 comp rx=0 tx=0).stop 2024-09-11T23:19:19.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.224+0000 7f1dd0400640 1 -- 172.21.15.144:0/2352996564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dc815ce80 msgr2=0x7f1dc815b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:19.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.224+0000 7f1dd0400640 1 --2- 172.21.15.144:0/2352996564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dc815ce80 0x7f1dc815b1c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000c780 tx=0x7f1dc000cc40 comp rx=0 tx=0).stop 2024-09-11T23:19:19.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.224+0000 7f1dd0400640 1 -- 172.21.15.144:0/2352996564 shutdown_connections 2024-09-11T23:19:19.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.224+0000 7f1dd0400640 1 --2- 172.21.15.144:0/2352996564 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1da806bfe0 0x7f1da806e4a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:19.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.224+0000 7f1dd0400640 1 --2- 172.21.15.144:0/2352996564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1dc815ce80 0x7f1dc815b1c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:19.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.224+0000 7f1dd0400640 1 --2- 172.21.15.144:0/2352996564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1dc815ca40 0x7f1dc814b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:19.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.224+0000 7f1dd0400640 1 --2- 172.21.15.144:0/2352996564 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1dc80d02a0 0x7f1dc81f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:19.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.224+0000 7f1dd0400640 1 -- 172.21.15.144:0/2352996564 >> 172.21.15.144:0/2352996564 conn(0x7f1dc8062cc0 msgr2=0x7f1dc80af380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:19.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.224+0000 7f1dd0400640 1 -- 172.21.15.144:0/2352996564 shutdown_connections 2024-09-11T23:19:19.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.224+0000 7f1dd0400640 1 -- 172.21.15.144:0/2352996564 wait complete. 2024-09-11T23:19:19.239 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:19:19.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.393+0000 7f6467200640 1 Processor -- start 2024-09-11T23:19:19.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.393+0000 7f6467200640 1 -- start start 2024-09-11T23:19:19.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.394+0000 7f6467200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f646806bba0 0x7f646806e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:19.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.394+0000 7f6467200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f646806c180 con 0x7f646815e570 2024-09-11T23:19:19.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.394+0000 7f6467200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f646806c460 con 0x7f646806e6d0 2024-09-11T23:19:19.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.394+0000 7f6467200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f646806c740 con 0x7f646806bba0 2024-09-11T23:19:19.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.395+0000 7f6465e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f646815e570 0x7f64680ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33650/0 (socket says 172.21.15.144:33650) 2024-09-11T23:19:19.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.395+0000 7f6465e00640 1 -- 172.21.15.144:0/3790931896 learned_addr learned my addr 172.21.15.144:0/3790931896 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:19.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.395+0000 7f6465400640 1 --2- 172.21.15.144:0/3790931896 >> v2:172.21.15.144:3300/0 conn(0x7f646806bba0 0x7f646806e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:19.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.395+0000 7f6465400640 1 -- 172.21.15.144:0/3790931896 >> v1:172.21.15.165:6789/0 conn(0x7f646806e6d0 legacy=0x7f64680cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:19.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.395+0000 7f6465400640 1 -- 172.21.15.144:0/3790931896 >> v1:172.21.15.144:6789/0 conn(0x7f646815e570 legacy=0x7f64680ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:19.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.395+0000 7f6465400640 1 -- 172.21.15.144:0/3790931896 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646806ca20 con 0x7f646806bba0 2024-09-11T23:19:19.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.395+0000 7f6464a00640 1 -- 172.21.15.144:0/3790931896 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1495277589 0 0) 0x7f646806c180 con 0x7f646815e570 2024-09-11T23:19:19.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.396+0000 7f6465400640 1 --2- 172.21.15.144:0/3790931896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f646806bba0 0x7f646806e190 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f64540097a0 tx=0x7f645402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fdb6875bbe25f81 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:19.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.396+0000 7f6464a00640 1 -- 172.21.15.144:0/3790931896 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454037070 con 0x7f646806bba0 2024-09-11T23:19:19.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.396+0000 7f6464a00640 1 -- 172.21.15.144:0/3790931896 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6454032440 con 0x7f646806bba0 2024-09-11T23:19:19.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.396+0000 7f6464a00640 1 -- 172.21.15.144:0/3790931896 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6454032810 con 0x7f646806bba0 2024-09-11T23:19:19.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.397+0000 7f6467200640 1 -- 172.21.15.144:0/3790931896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f646806bba0 msgr2=0x7f646806e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:19.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.397+0000 7f6467200640 1 --2- 172.21.15.144:0/3790931896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f646806bba0 0x7f646806e190 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f64540097a0 tx=0x7f645402a230 comp rx=0 tx=0).stop 2024-09-11T23:19:19.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.397+0000 7f6467200640 1 -- 172.21.15.144:0/3790931896 shutdown_connections 2024-09-11T23:19:19.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.397+0000 7f6467200640 1 --2- 172.21.15.144:0/3790931896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f646806bba0 0x7f646806e190 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:19.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.397+0000 7f6467200640 1 -- 172.21.15.144:0/3790931896 >> 172.21.15.144:0/3790931896 conn(0x7f6468062c60 msgr2=0x7f64680b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:19.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.397+0000 7f6467200640 1 -- 172.21.15.144:0/3790931896 shutdown_connections 2024-09-11T23:19:19.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.397+0000 7f6467200640 1 -- 172.21.15.144:0/3790931896 wait complete. 2024-09-11T23:19:19.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.399+0000 7f6467200640 1 Processor -- start 2024-09-11T23:19:19.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.399+0000 7f6467200640 1 -- start start 2024-09-11T23:19:19.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.400+0000 7f6467200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f646806bba0 0x7f64681610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:19.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.400+0000 7f6467200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f646806e6d0 0x7f64681f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:19.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.400+0000 7f6467200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f646815e570 0x7f64681571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:19.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.400+0000 7f6467200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f646815e950 con 0x7f646815e570 2024-09-11T23:19:19.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.400+0000 7f6467200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f64680d00c0 con 0x7f646806bba0 2024-09-11T23:19:19.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.400+0000 7f6467200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f64681f4d30 con 0x7f646806e6d0 2024-09-11T23:19:19.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.400+0000 7f6466800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f646815e570 0x7f64681571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:19.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.400+0000 7f6466800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f646815e570 0x7f64681571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32878/0 (socket says 172.21.15.144:32878) 2024-09-11T23:19:19.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.400+0000 7f6466800640 1 -- 172.21.15.144:0/3450626207 learned_addr learned my addr 172.21.15.144:0/3450626207 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:19.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.400+0000 7f6465400640 1 --2- 172.21.15.144:0/3450626207 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f646806e6d0 0x7f64681f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:19.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.400+0000 7f6465e00640 1 --2- 172.21.15.144:0/3450626207 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f646806bba0 0x7f64681610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:19.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.400+0000 7f6466800640 1 -- 172.21.15.144:0/3450626207 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f646806e6d0 msgr2=0x7f64681f47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:19.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.400+0000 7f6466800640 1 --2- 172.21.15.144:0/3450626207 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f646806e6d0 0x7f64681f47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:19.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.400+0000 7f6466800640 1 -- 172.21.15.144:0/3450626207 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f646806bba0 msgr2=0x7f64681610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:19.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.400+0000 7f6466800640 1 --2- 172.21.15.144:0/3450626207 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f646806bba0 0x7f64681610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:19.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.400+0000 7f6466800640 1 -- 172.21.15.144:0/3450626207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6468158680 con 0x7f646815e570 2024-09-11T23:19:19.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.401+0000 7f6466800640 1 --2- 172.21.15.144:0/3450626207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f646815e570 0x7f64681571d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f646000c7a0 tx=0x7f646000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:19.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.401+0000 7f645e000640 1 -- 172.21.15.144:0/3450626207 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6460003b70 con 0x7f646815e570 2024-09-11T23:19:19.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.401+0000 7f645e000640 1 -- 172.21.15.144:0/3450626207 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6460003d30 con 0x7f646815e570 2024-09-11T23:19:19.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.401+0000 7f645e000640 1 -- 172.21.15.144:0/3450626207 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646000aa90 con 0x7f646815e570 2024-09-11T23:19:19.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.401+0000 7f6467200640 1 -- 172.21.15.144:0/3450626207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6468157710 con 0x7f646815e570 2024-09-11T23:19:19.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.401+0000 7f6467200640 1 -- 172.21.15.144:0/3450626207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6468158bd0 con 0x7f646815e570 2024-09-11T23:19:19.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.402+0000 7f6467200640 1 -- 172.21.15.144:0/3450626207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f646806f1b0 con 0x7f646815e570 2024-09-11T23:19:19.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.403+0000 7f645e000640 1 -- 172.21.15.144:0/3450626207 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f646000ac30 con 0x7f646815e570 2024-09-11T23:19:19.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.404+0000 7f645e000640 1 --2- 172.21.15.144:0/3450626207 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f644806bfe0 0x7f644806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:19.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.404+0000 7f645e000640 1 -- 172.21.15.144:0/3450626207 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f646008acf0 con 0x7f646815e570 2024-09-11T23:19:19.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.404+0000 7f6465e00640 1 --2- 172.21.15.144:0/3450626207 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f644806bfe0 0x7f644806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:19.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.405+0000 7f6465e00640 1 --2- 172.21.15.144:0/3450626207 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f644806bfe0 0x7f644806e4a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6458000f60 tx=0x7f6458007e40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:19.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.408+0000 7f645e000640 1 -- 172.21.15.144:0/3450626207 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6460059080 con 0x7f646815e570 2024-09-11T23:19:19.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.587+0000 7f6467200640 1 -- 172.21.15.144:0/3450626207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f646815dcf0 con 0x7f646815e570 2024-09-11T23:19:19.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.587+0000 7f645e000640 1 -- 172.21.15.144:0/3450626207 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v42) ==== 84+0+65 (secure 0 0 0) 0x7f646005d380 con 0x7f646815e570 2024-09-11T23:19:19.587 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:19.587 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:19:19.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:19.588 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-11T23:19:19.588 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-11T23:19:19.588 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:19.588 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:19:19.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.590+0000 7f6467200640 1 -- 172.21.15.144:0/3450626207 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f644806bfe0 msgr2=0x7f644806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:19.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.590+0000 7f6467200640 1 --2- 172.21.15.144:0/3450626207 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f644806bfe0 0x7f644806e4a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6458000f60 tx=0x7f6458007e40 comp rx=0 tx=0).stop 2024-09-11T23:19:19.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.590+0000 7f6467200640 1 -- 172.21.15.144:0/3450626207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f646815e570 msgr2=0x7f64681571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:19.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.590+0000 7f6467200640 1 --2- 172.21.15.144:0/3450626207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f646815e570 0x7f64681571d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f646000c7a0 tx=0x7f646000cc60 comp rx=0 tx=0).stop 2024-09-11T23:19:19.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.590+0000 7f6467200640 1 -- 172.21.15.144:0/3450626207 shutdown_connections 2024-09-11T23:19:19.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.590+0000 7f6467200640 1 --2- 172.21.15.144:0/3450626207 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f644806bfe0 0x7f644806e4a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:19.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.590+0000 7f6467200640 1 --2- 172.21.15.144:0/3450626207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f646815e570 0x7f64681571d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:19.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.590+0000 7f6467200640 1 --2- 172.21.15.144:0/3450626207 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f646806e6d0 0x7f64681f47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:19.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.590+0000 7f6467200640 1 --2- 172.21.15.144:0/3450626207 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f646806bba0 0x7f64681610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:19.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.590+0000 7f6467200640 1 -- 172.21.15.144:0/3450626207 >> 172.21.15.144:0/3450626207 conn(0x7f6468062c60 msgr2=0x7f64680ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:19.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.590+0000 7f6467200640 1 -- 172.21.15.144:0/3450626207 shutdown_connections 2024-09-11T23:19:19.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.590+0000 7f6467200640 1 -- 172.21.15.144:0/3450626207 wait complete. 2024-09-11T23:19:19.606 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:19:19.607 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:19:19.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.764+0000 7f7c15600640 1 Processor -- start 2024-09-11T23:19:19.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.765+0000 7f7c15600640 1 -- start start 2024-09-11T23:19:19.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.766+0000 7f7c15600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c100cf5d0 0x7f7c100cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:19.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.766+0000 7f7c15600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7c1006d4f0 0x7f7c1006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:19.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.766+0000 7f7c15600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c100b4240 con 0x7f7c10145d90 2024-09-11T23:19:19.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.766+0000 7f7c15600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7c1006d080 con 0x7f7c1006d4f0 2024-09-11T23:19:19.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.766+0000 7f7c15600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7c100b4520 con 0x7f7c100cf5d0 2024-09-11T23:19:19.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.766+0000 7f7c0f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7c1006d4f0 0x7f7c1006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:19.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.766+0000 7f7c0f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7c1006d4f0 0x7f7c1006d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32882/0 (socket says 172.21.15.144:32882) 2024-09-11T23:19:19.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.766+0000 7f7c0f400640 1 -- 172.21.15.144:0/3090463459 learned_addr learned my addr 172.21.15.144:0/3090463459 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:19.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.766+0000 7f7c0e000640 1 --2- 172.21.15.144:0/3090463459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c100cf5d0 0x7f7c100cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:19.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.767+0000 7f7c0f400640 1 -- 172.21.15.144:0/3090463459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c100cf5d0 msgr2=0x7f7c100cfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:19.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.767+0000 7f7c0f400640 1 --2- 172.21.15.144:0/3090463459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c100cf5d0 0x7f7c100cfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:19.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.767+0000 7f7c0f400640 1 -- 172.21.15.144:0/3090463459 >> v1:172.21.15.165:6789/0 conn(0x7f7c10145d90 legacy=0x7f7c100ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:19.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.767+0000 7f7c0f400640 1 -- 172.21.15.144:0/3090463459 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c100b4800 con 0x7f7c1006d4f0 2024-09-11T23:19:19.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.768+0000 7f7c0f400640 1 --2- 172.21.15.144:0/3090463459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c1006d4f0 0x7f7c1006d980 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009e50 tx=0x7f7c0802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff619776c2c47f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:19.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.768+0000 7f7c0d600640 1 -- 172.21.15.144:0/3090463459 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c08036070 con 0x7f7c1006d4f0 2024-09-11T23:19:19.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.768+0000 7f7c0d600640 1 -- 172.21.15.144:0/3090463459 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c08031600 con 0x7f7c1006d4f0 2024-09-11T23:19:19.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.768+0000 7f7c0d600640 1 -- 172.21.15.144:0/3090463459 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c080319d0 con 0x7f7c1006d4f0 2024-09-11T23:19:19.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.768+0000 7f7c15600640 1 -- 172.21.15.144:0/3090463459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c1006d4f0 msgr2=0x7f7c1006d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:19.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.768+0000 7f7c15600640 1 --2- 172.21.15.144:0/3090463459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c1006d4f0 0x7f7c1006d980 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009e50 tx=0x7f7c0802a710 comp rx=0 tx=0).stop 2024-09-11T23:19:19.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.769+0000 7f7c15600640 1 -- 172.21.15.144:0/3090463459 shutdown_connections 2024-09-11T23:19:19.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.769+0000 7f7c15600640 1 --2- 172.21.15.144:0/3090463459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c1006d4f0 0x7f7c1006d980 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:19.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.769+0000 7f7c15600640 1 --2- 172.21.15.144:0/3090463459 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c100cf5d0 0x7f7c100cfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:19.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.769+0000 7f7c15600640 1 -- 172.21.15.144:0/3090463459 >> 172.21.15.144:0/3090463459 conn(0x7f7c1006bba0 msgr2=0x7f7c1006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:19.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.769+0000 7f7c15600640 1 -- 172.21.15.144:0/3090463459 shutdown_connections 2024-09-11T23:19:19.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.769+0000 7f7c15600640 1 -- 172.21.15.144:0/3090463459 wait complete. 2024-09-11T23:19:19.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.770+0000 7f7c15600640 1 Processor -- start 2024-09-11T23:19:19.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.770+0000 7f7c15600640 1 -- start start 2024-09-11T23:19:19.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.771+0000 7f7c15600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c1006d4f0 0x7f7c100c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:19.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.771+0000 7f7c15600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c100cf5d0 0x7f7c10144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:19.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.771+0000 7f7c15600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c10145d90 0x7f7c100ca300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:19.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.771+0000 7f7c15600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7c100cd660 con 0x7f7c100cf5d0 2024-09-11T23:19:19.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.771+0000 7f7c15600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7c100cff50 con 0x7f7c10145d90 2024-09-11T23:19:19.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.771+0000 7f7c15600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7c100b5610 con 0x7f7c1006d4f0 2024-09-11T23:19:19.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.772+0000 7f7c0e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c100cf5d0 0x7f7c10144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:19.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.772+0000 7f7c0e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c100cf5d0 0x7f7c10144cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32886/0 (socket says 172.21.15.144:32886) 2024-09-11T23:19:19.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.772+0000 7f7c0e000640 1 -- 172.21.15.144:0/822868788 learned_addr learned my addr 172.21.15.144:0/822868788 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:19.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.772+0000 7f7c0f400640 1 --2- 172.21.15.144:0/822868788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c10145d90 0x7f7c100ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:19.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.772+0000 7f7c0ea00640 1 --2- 172.21.15.144:0/822868788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c1006d4f0 0x7f7c100c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:19.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.772+0000 7f7c0e000640 1 -- 172.21.15.144:0/822868788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c1006d4f0 msgr2=0x7f7c100c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:19.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.772+0000 7f7c0e000640 1 --2- 172.21.15.144:0/822868788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c1006d4f0 0x7f7c100c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:19.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.772+0000 7f7c0e000640 1 -- 172.21.15.144:0/822868788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c10145d90 msgr2=0x7f7c100ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:19.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.772+0000 7f7c0e000640 1 --2- 172.21.15.144:0/822868788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c10145d90 0x7f7c100ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:19.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.772+0000 7f7c0e000640 1 -- 172.21.15.144:0/822868788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c100cc6d0 con 0x7f7c100cf5d0 2024-09-11T23:19:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.772+0000 7f7c0e000640 1 --2- 172.21.15.144:0/822868788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c100cf5d0 0x7f7c10144cf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00e9b0 tx=0x7f7bfc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.773+0000 7f7c06a00640 1 -- 172.21.15.144:0/822868788 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc017070 con 0x7f7c100cf5d0 2024-09-11T23:19:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.773+0000 7f7c06a00640 1 -- 172.21.15.144:0/822868788 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bfc00c9a0 con 0x7f7c100cf5d0 2024-09-11T23:19:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.773+0000 7f7c15600640 1 -- 172.21.15.144:0/822868788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c100710e0 con 0x7f7c100cf5d0 2024-09-11T23:19:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.773+0000 7f7c06a00640 1 -- 172.21.15.144:0/822868788 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00cd90 con 0x7f7c100cf5d0 2024-09-11T23:19:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.773+0000 7f7c15600640 1 -- 172.21.15.144:0/822868788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c100716a0 con 0x7f7c100cf5d0 2024-09-11T23:19:19.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.774+0000 7f7c15600640 1 -- 172.21.15.144:0/822868788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c100ccad0 con 0x7f7c100cf5d0 2024-09-11T23:19:19.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.775+0000 7f7c06a00640 1 -- 172.21.15.144:0/822868788 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f7bfc01a070 con 0x7f7c100cf5d0 2024-09-11T23:19:19.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.776+0000 7f7c06a00640 1 --2- 172.21.15.144:0/822868788 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7bf006bfe0 0x7f7bf006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:19.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.776+0000 7f7c06a00640 1 -- 172.21.15.144:0/822868788 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f7bfc08b0d0 con 0x7f7c100cf5d0 2024-09-11T23:19:19.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.776+0000 7f7c0ea00640 1 --2- 172.21.15.144:0/822868788 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7bf006bfe0 0x7f7bf006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:19.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.777+0000 7f7c0ea00640 1 --2- 172.21.15.144:0/822868788 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7bf006bfe0 0x7f7bf006e4a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7c000016e0 tx=0x7f7c00009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:19.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.780+0000 7f7c06a00640 1 -- 172.21.15.144:0/822868788 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7bfc0595a0 con 0x7f7c100cf5d0 2024-09-11T23:19:19.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:19.954+0000 7f7c15600640 1 -- 172.21.15.144:0/822868788 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7c10146170 con 0x7f7c100cf5d0 2024-09-11T23:19:20.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.794+0000 7f7c06a00640 1 -- 172.21.15.144:0/822868788 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v43) ==== 138+0+0 (secure 0 0 0) 0x7f7bfc05d8a0 con 0x7f7c100cf5d0 2024-09-11T23:19:20.794 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-11T23:19:20.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.798+0000 7f7c15600640 1 -- 172.21.15.144:0/822868788 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7bf006bfe0 msgr2=0x7f7bf006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:20.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.798+0000 7f7c15600640 1 --2- 172.21.15.144:0/822868788 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7bf006bfe0 0x7f7bf006e4a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7c000016e0 tx=0x7f7c00009040 comp rx=0 tx=0).stop 2024-09-11T23:19:20.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.798+0000 7f7c15600640 1 -- 172.21.15.144:0/822868788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c100cf5d0 msgr2=0x7f7c10144cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:20.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.798+0000 7f7c15600640 1 --2- 172.21.15.144:0/822868788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c100cf5d0 0x7f7c10144cf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc00e9b0 tx=0x7f7bfc00ee70 comp rx=0 tx=0).stop 2024-09-11T23:19:20.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.798+0000 7f7c15600640 1 -- 172.21.15.144:0/822868788 shutdown_connections 2024-09-11T23:19:20.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.798+0000 7f7c15600640 1 --2- 172.21.15.144:0/822868788 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7bf006bfe0 0x7f7bf006e4a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:20.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.798+0000 7f7c15600640 1 --2- 172.21.15.144:0/822868788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c10145d90 0x7f7c100ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:20.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.798+0000 7f7c15600640 1 --2- 172.21.15.144:0/822868788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c100cf5d0 0x7f7c10144cf0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:20.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.798+0000 7f7c15600640 1 --2- 172.21.15.144:0/822868788 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7c1006d4f0 0x7f7c100c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:20.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.798+0000 7f7c15600640 1 -- 172.21.15.144:0/822868788 >> 172.21.15.144:0/822868788 conn(0x7f7c1006bba0 msgr2=0x7f7c10160120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:20.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.798+0000 7f7c15600640 1 -- 172.21.15.144:0/822868788 shutdown_connections 2024-09-11T23:19:20.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.798+0000 7f7c15600640 1 -- 172.21.15.144:0/822868788 wait complete. 2024-09-11T23:19:20.820 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:19:20.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.984+0000 7f1ceb000640 1 Processor -- start 2024-09-11T23:19:20.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.984+0000 7f1ceb000640 1 -- start start 2024-09-11T23:19:20.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.985+0000 7f1ceb000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1ce4145d90 0x7f1ce40ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:20.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.985+0000 7f1ceb000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ce40cd490 0x7f1ce40cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:20.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.985+0000 7f1ceb000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ce40cfb10 0x7f1ce41601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:20.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.985+0000 7f1ceb000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1ce406d080 con 0x7f1ce40cd490 2024-09-11T23:19:20.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.985+0000 7f1ceb000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1ce40b4240 con 0x7f1ce4145d90 2024-09-11T23:19:20.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.985+0000 7f1ceb000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce40b4520 con 0x7f1ce40cfb10 2024-09-11T23:19:20.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.986+0000 7f1ce3400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ce40cd490 0x7f1ce40cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:20.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.986+0000 7f1ce3400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ce40cd490 0x7f1ce40cf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32892/0 (socket says 172.21.15.144:32892) 2024-09-11T23:19:20.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.986+0000 7f1ce3400640 1 -- 172.21.15.144:0/3915521984 learned_addr learned my addr 172.21.15.144:0/3915521984 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:20.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.986+0000 7f1ce3e00640 1 --2- 172.21.15.144:0/3915521984 >> v2:172.21.15.165:3300/0 conn(0x7f1ce4145d90 0x7f1ce40ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:20.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.986+0000 7f1ce9000640 1 --2- 172.21.15.144:0/3915521984 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ce40cfb10 0x7f1ce41601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:20.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.986+0000 7f1ce3400640 1 -- 172.21.15.144:0/3915521984 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ce40cfb10 msgr2=0x7f1ce41601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:20.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.986+0000 7f1ce3400640 1 --2- 172.21.15.144:0/3915521984 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ce40cfb10 0x7f1ce41601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:20.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.986+0000 7f1ce3400640 1 -- 172.21.15.144:0/3915521984 >> v2:172.21.15.165:3300/0 conn(0x7f1ce4145d90 msgr2=0x7f1ce40ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:20.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.986+0000 7f1ce3400640 1 --2- 172.21.15.144:0/3915521984 >> v2:172.21.15.165:3300/0 conn(0x7f1ce4145d90 0x7f1ce40ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:20.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.986+0000 7f1ce3400640 1 -- 172.21.15.144:0/3915521984 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce40b4800 con 0x7f1ce40cd490 2024-09-11T23:19:20.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.987+0000 7f1ce3400640 1 --2- 172.21.15.144:0/3915521984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40cd490 0x7f1ce40cf5d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1ce406f430 tx=0x7f1cd002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ead0c6bab62a567 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:20.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.987+0000 7f1ce2a00640 1 -- 172.21.15.144:0/3915521984 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0037070 con 0x7f1ce40cd490 2024-09-11T23:19:20.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.987+0000 7f1ce2a00640 1 -- 172.21.15.144:0/3915521984 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd0032440 con 0x7f1ce40cd490 2024-09-11T23:19:20.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.987+0000 7f1ce2a00640 1 -- 172.21.15.144:0/3915521984 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0032810 con 0x7f1ce40cd490 2024-09-11T23:19:20.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.988+0000 7f1ceb000640 1 -- 172.21.15.144:0/3915521984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40cd490 msgr2=0x7f1ce40cf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:20.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.988+0000 7f1ceb000640 1 --2- 172.21.15.144:0/3915521984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40cd490 0x7f1ce40cf5d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1ce406f430 tx=0x7f1cd002a1e0 comp rx=0 tx=0).stop 2024-09-11T23:19:20.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.988+0000 7f1ceb000640 1 -- 172.21.15.144:0/3915521984 shutdown_connections 2024-09-11T23:19:20.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.988+0000 7f1ceb000640 1 --2- 172.21.15.144:0/3915521984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40cd490 0x7f1ce40cf5d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:20.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.988+0000 7f1ceb000640 1 --2- 172.21.15.144:0/3915521984 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ce40cfb10 0x7f1ce41601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:20.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.988+0000 7f1ceb000640 1 --2- 172.21.15.144:0/3915521984 >> v2:172.21.15.165:3300/0 conn(0x7f1ce4145d90 0x7f1ce40ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:20.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.988+0000 7f1ceb000640 1 -- 172.21.15.144:0/3915521984 >> 172.21.15.144:0/3915521984 conn(0x7f1ce406bba0 msgr2=0x7f1ce406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:20.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.988+0000 7f1ceb000640 1 -- 172.21.15.144:0/3915521984 shutdown_connections 2024-09-11T23:19:20.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.988+0000 7f1ceb000640 1 -- 172.21.15.144:0/3915521984 wait complete. 2024-09-11T23:19:20.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.990+0000 7f1ceb000640 1 Processor -- start 2024-09-11T23:19:20.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.990+0000 7f1ceb000640 1 -- start start 2024-09-11T23:19:20.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.991+0000 7f1ceb000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ce40cd490 0x7f1ce40c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:20.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.991+0000 7f1ceb000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40cfb10 0x7f1ce4143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:20.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.991+0000 7f1ceb000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ce4145d90 0x7f1ce413f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:20.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.991+0000 7f1ceb000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce40b5610 con 0x7f1ce40cfb10 2024-09-11T23:19:20.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.991+0000 7f1ceb000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce40cffa0 con 0x7f1ce40cd490 2024-09-11T23:19:20.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.991+0000 7f1ceb000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce40b5790 con 0x7f1ce4145d90 2024-09-11T23:19:20.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.991+0000 7f1ce3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40cfb10 0x7f1ce4143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:20.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.991+0000 7f1ce3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40cfb10 0x7f1ce4143440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32896/0 (socket says 172.21.15.144:32896) 2024-09-11T23:19:20.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.991+0000 7f1ce3400640 1 -- 172.21.15.144:0/2608745682 learned_addr learned my addr 172.21.15.144:0/2608745682 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:20.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.991+0000 7f1ce3400640 1 -- 172.21.15.144:0/2608745682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ce4145d90 msgr2=0x7f1ce413f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:20.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.991+0000 7f1ce3400640 1 --2- 172.21.15.144:0/2608745682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ce4145d90 0x7f1ce413f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:20.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.991+0000 7f1ce3400640 1 -- 172.21.15.144:0/2608745682 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ce40cd490 msgr2=0x7f1ce40c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:20.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.991+0000 7f1ce3400640 1 --2- 172.21.15.144:0/2608745682 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ce40cd490 0x7f1ce40c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:20.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.991+0000 7f1ce3400640 1 -- 172.21.15.144:0/2608745682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce4141760 con 0x7f1ce40cfb10 2024-09-11T23:19:20.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.992+0000 7f1ce3400640 1 --2- 172.21.15.144:0/2608745682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40cfb10 0x7f1ce4143440 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1cd002a220 tx=0x7f1cd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:20.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.992+0000 7f1cdbe00640 1 -- 172.21.15.144:0/2608745682 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0037040 con 0x7f1ce40cfb10 2024-09-11T23:19:20.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.992+0000 7f1cdbe00640 1 -- 172.21.15.144:0/2608745682 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd0042070 con 0x7f1ce40cfb10 2024-09-11T23:19:20.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.992+0000 7f1cdbe00640 1 -- 172.21.15.144:0/2608745682 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd003d880 con 0x7f1ce40cfb10 2024-09-11T23:19:20.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.992+0000 7f1ceb000640 1 -- 172.21.15.144:0/2608745682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce4141a40 con 0x7f1ce40cfb10 2024-09-11T23:19:20.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.992+0000 7f1ceb000640 1 -- 172.21.15.144:0/2608745682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce413f820 con 0x7f1ce40cfb10 2024-09-11T23:19:20.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.993+0000 7f1ceb000640 1 -- 172.21.15.144:0/2608745682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce4146200 con 0x7f1ce40cfb10 2024-09-11T23:19:20.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.994+0000 7f1cdbe00640 1 -- 172.21.15.144:0/2608745682 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f1cd003da20 con 0x7f1ce40cfb10 2024-09-11T23:19:20.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.995+0000 7f1cdbe00640 1 --2- 172.21.15.144:0/2608745682 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1cc406bfe0 0x7f1cc406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:20.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.995+0000 7f1cdbe00640 1 -- 172.21.15.144:0/2608745682 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5227+0+0 (secure 0 0 0) 0x7f1cd00ac190 con 0x7f1ce40cfb10 2024-09-11T23:19:20.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.995+0000 7f1ce3e00640 1 --2- 172.21.15.144:0/2608745682 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1cc406bfe0 0x7f1cc406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:20.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.996+0000 7f1ce3e00640 1 --2- 172.21.15.144:0/2608745682 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1cc406bfe0 0x7f1cc406e4a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4006a90 tx=0x7f1cd4006a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:20.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:20.999+0000 7f1cdbe00640 1 -- 172.21.15.144:0/2608745682 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1cd007ac10 con 0x7f1ce40cfb10 2024-09-11T23:19:21.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.177+0000 7f1ceb000640 1 -- 172.21.15.144:0/2608745682 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1ce40cdc70 con 0x7f1ce40cfb10 2024-09-11T23:19:21.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.801+0000 7f1cdbe00640 1 -- 172.21.15.144:0/2608745682 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v44) ==== 170+0+0 (secure 0 0 0) 0x7f1cd007a510 con 0x7f1ce40cfb10 2024-09-11T23:19:21.802 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-11T23:19:21.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.804+0000 7f1ceb000640 1 -- 172.21.15.144:0/2608745682 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1cc406bfe0 msgr2=0x7f1cc406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:21.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.804+0000 7f1ceb000640 1 --2- 172.21.15.144:0/2608745682 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1cc406bfe0 0x7f1cc406e4a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4006a90 tx=0x7f1cd4006a20 comp rx=0 tx=0).stop 2024-09-11T23:19:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.804+0000 7f1ceb000640 1 -- 172.21.15.144:0/2608745682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40cfb10 msgr2=0x7f1ce4143440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.804+0000 7f1ceb000640 1 --2- 172.21.15.144:0/2608745682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40cfb10 0x7f1ce4143440 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1cd002a220 tx=0x7f1cd00046c0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.804+0000 7f1ceb000640 1 -- 172.21.15.144:0/2608745682 shutdown_connections 2024-09-11T23:19:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.804+0000 7f1ceb000640 1 --2- 172.21.15.144:0/2608745682 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1cc406bfe0 0x7f1cc406e4a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.804+0000 7f1ceb000640 1 --2- 172.21.15.144:0/2608745682 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ce4145d90 0x7f1ce413f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.804+0000 7f1ceb000640 1 --2- 172.21.15.144:0/2608745682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ce40cfb10 0x7f1ce4143440 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.804+0000 7f1ceb000640 1 --2- 172.21.15.144:0/2608745682 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ce40cd490 0x7f1ce40c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.804+0000 7f1ceb000640 1 -- 172.21.15.144:0/2608745682 >> 172.21.15.144:0/2608745682 conn(0x7f1ce406bba0 msgr2=0x7f1ce40b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.805+0000 7f1ceb000640 1 -- 172.21.15.144:0/2608745682 shutdown_connections 2024-09-11T23:19:21.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.805+0000 7f1ceb000640 1 -- 172.21.15.144:0/2608745682 wait complete. 2024-09-11T23:19:21.832 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:19:21.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.990+0000 7fec9dc00640 1 Processor -- start 2024-09-11T23:19:21.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.990+0000 7fec9dc00640 1 -- start start 2024-09-11T23:19:21.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.992+0000 7fec9dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec980cdfc0 0x7fec9806bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.992+0000 7fec9dc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fec9806c0e0 0x7fec9815d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.992+0000 7fec9dc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec980ce430 con 0x7fec98159dd0 2024-09-11T23:19:21.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.992+0000 7fec9dc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fec9806c550 con 0x7fec9806c0e0 2024-09-11T23:19:21.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.992+0000 7fec9dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fec980cfd20 con 0x7fec980cdfc0 2024-09-11T23:19:21.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.992+0000 7fec8f400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec980cdfc0 0x7fec9806bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.992+0000 7fec9d200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fec9806c0e0 0x7fec9815d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.992+0000 7fec9d200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fec9806c0e0 0x7fec9815d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:54374/0 (socket says 172.21.15.144:54374) 2024-09-11T23:19:21.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.992+0000 7fec9d200640 1 -- 172.21.15.144:0/4140694444 learned_addr learned my addr 172.21.15.144:0/4140694444 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:21.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.992+0000 7fec8f400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec980cdfc0 0x7fec9806bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:60858/0 (socket says 172.21.15.144:60858) 2024-09-11T23:19:21.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.993+0000 7fec8f400640 1 -- 172.21.15.144:0/4140694444 >> v2:172.21.15.165:3300/0 conn(0x7fec9806c0e0 msgr2=0x7fec9815d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:21.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.993+0000 7fec8f400640 1 --2- 172.21.15.144:0/4140694444 >> v2:172.21.15.165:3300/0 conn(0x7fec9806c0e0 0x7fec9815d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.993+0000 7fec8f400640 1 -- 172.21.15.144:0/4140694444 >> v1:172.21.15.165:6789/0 conn(0x7fec98159dd0 legacy=0x7fec980cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:21.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.993+0000 7fec8f400640 1 -- 172.21.15.144:0/4140694444 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec980cd4e0 con 0x7fec980cdfc0 2024-09-11T23:19:21.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.994+0000 7fec8f400640 1 --2- 172.21.15.144:0/4140694444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec980cdfc0 0x7fec9806bba0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fec800097a0 tx=0x7fec8002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f22255658fb6646 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:21.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.994+0000 7fec97400640 1 -- 172.21.15.144:0/4140694444 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec80037070 con 0x7fec980cdfc0 2024-09-11T23:19:21.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.994+0000 7fec97400640 1 -- 172.21.15.144:0/4140694444 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec80032440 con 0x7fec980cdfc0 2024-09-11T23:19:21.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.994+0000 7fec97400640 1 -- 172.21.15.144:0/4140694444 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec80032810 con 0x7fec980cdfc0 2024-09-11T23:19:21.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.994+0000 7fec9dc00640 1 -- 172.21.15.144:0/4140694444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec980cdfc0 msgr2=0x7fec9806bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:21.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.994+0000 7fec9dc00640 1 --2- 172.21.15.144:0/4140694444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec980cdfc0 0x7fec9806bba0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fec800097a0 tx=0x7fec8002a180 comp rx=0 tx=0).stop 2024-09-11T23:19:21.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.994+0000 7fec9dc00640 1 -- 172.21.15.144:0/4140694444 shutdown_connections 2024-09-11T23:19:21.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.994+0000 7fec9dc00640 1 --2- 172.21.15.144:0/4140694444 >> v2:172.21.15.165:3300/0 conn(0x7fec9806c0e0 0x7fec9815d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.994+0000 7fec9dc00640 1 --2- 172.21.15.144:0/4140694444 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec980cdfc0 0x7fec9806bba0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.994+0000 7fec9dc00640 1 -- 172.21.15.144:0/4140694444 >> 172.21.15.144:0/4140694444 conn(0x7fec980d0300 msgr2=0x7fec980d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:21.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.995+0000 7fec9dc00640 1 -- 172.21.15.144:0/4140694444 shutdown_connections 2024-09-11T23:19:21.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.995+0000 7fec9dc00640 1 -- 172.21.15.144:0/4140694444 wait complete. 2024-09-11T23:19:21.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.996+0000 7fec9dc00640 1 Processor -- start 2024-09-11T23:19:21.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.996+0000 7fec9dc00640 1 -- start start 2024-09-11T23:19:21.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.997+0000 7fec9dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec9806c0e0 0x7fec98151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.997+0000 7fec9dc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec980cdfc0 0x7fec981f56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.997+0000 7fec9dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec98159dd0 0x7fec98141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:21.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.997+0000 7fec9dc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fec9815a1b0 con 0x7fec9806c0e0 2024-09-11T23:19:21.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.997+0000 7fec9dc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fec980cdaa0 con 0x7fec980cdfc0 2024-09-11T23:19:21.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.997+0000 7fec9dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fec9815d6d0 con 0x7fec98159dd0 2024-09-11T23:19:21.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.997+0000 7fec97e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec9806c0e0 0x7fec98151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.997+0000 7fec9d200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec98159dd0 0x7fec98141ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.997+0000 7fec8f400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec980cdfc0 0x7fec981f56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:21.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.997+0000 7fec9d200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec98159dd0 0x7fec98141ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:60862/0 (socket says 172.21.15.144:60862) 2024-09-11T23:19:21.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.998+0000 7fec9d200640 1 -- 172.21.15.144:0/3108230637 learned_addr learned my addr 172.21.15.144:0/3108230637 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:21.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.998+0000 7fec8f400640 1 -- 172.21.15.144:0/3108230637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec98159dd0 msgr2=0x7fec98141ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:21.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.998+0000 7fec8f400640 1 --2- 172.21.15.144:0/3108230637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec98159dd0 0x7fec98141ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.998+0000 7fec8f400640 1 -- 172.21.15.144:0/3108230637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec9806c0e0 msgr2=0x7fec98151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:21.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.998+0000 7fec8f400640 1 --2- 172.21.15.144:0/3108230637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec9806c0e0 0x7fec98151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:21.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.998+0000 7fec8f400640 1 -- 172.21.15.144:0/3108230637 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec981f60b0 con 0x7fec980cdfc0 2024-09-11T23:19:21.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.998+0000 7fec8f400640 1 --2- 172.21.15.144:0/3108230637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec980cdfc0 0x7fec981f56d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fec980ce620 tx=0x7fec800046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:22.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.999+0000 7fec94c00640 1 -- 172.21.15.144:0/3108230637 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec80041030 con 0x7fec980cdfc0 2024-09-11T23:19:22.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.999+0000 7fec94c00640 1 -- 172.21.15.144:0/3108230637 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec80030500 con 0x7fec980cdfc0 2024-09-11T23:19:22.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.999+0000 7fec94c00640 1 -- 172.21.15.144:0/3108230637 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec80037040 con 0x7fec980cdfc0 2024-09-11T23:19:22.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.999+0000 7fec9dc00640 1 -- 172.21.15.144:0/3108230637 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec981f6390 con 0x7fec980cdfc0 2024-09-11T23:19:22.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:21.999+0000 7fec9dc00640 1 -- 172.21.15.144:0/3108230637 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec98152400 con 0x7fec980cdfc0 2024-09-11T23:19:22.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.000+0000 7fec9dc00640 1 -- 172.21.15.144:0/3108230637 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec9806bba0 con 0x7fec980cdfc0 2024-09-11T23:19:22.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.001+0000 7fec94c00640 1 -- 172.21.15.144:0/3108230637 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fec80044070 con 0x7fec980cdfc0 2024-09-11T23:19:22.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.002+0000 7fec94c00640 1 --2- 172.21.15.144:0/3108230637 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fec7406c030 0x7fec7406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:22.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.002+0000 7fec94c00640 1 -- 172.21.15.144:0/3108230637 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5609+0+0 (secure 0 0 0) 0x7fec800ab8c0 con 0x7fec980cdfc0 2024-09-11T23:19:22.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.002+0000 7fec97e00640 1 --2- 172.21.15.144:0/3108230637 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fec7406c030 0x7fec7406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:22.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.002+0000 7fec97e00640 1 --2- 172.21.15.144:0/3108230637 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fec7406c030 0x7fec7406e4f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fec880012e0 tx=0x7fec88009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:22.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.006+0000 7fec94c00640 1 -- 172.21.15.144:0/3108230637 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec800799e0 con 0x7fec980cdfc0 2024-09-11T23:19:22.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.216+0000 7fec9dc00640 1 -- 172.21.15.144:0/3108230637 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fec9815af00 con 0x7fec980cdfc0 2024-09-11T23:19:22.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.809+0000 7fec94c00640 1 -- 172.21.15.144:0/3108230637 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v22) ==== 172+0+0 (secure 0 0 0) 0x7fec8007dce0 con 0x7fec980cdfc0 2024-09-11T23:19:22.810 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 6 and data pool 7 2024-09-11T23:19:22.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.816+0000 7fec9dc00640 1 -- 172.21.15.144:0/3108230637 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fec7406c030 msgr2=0x7fec7406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:22.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.816+0000 7fec9dc00640 1 --2- 172.21.15.144:0/3108230637 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fec7406c030 0x7fec7406e4f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fec880012e0 tx=0x7fec88009040 comp rx=0 tx=0).stop 2024-09-11T23:19:22.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.816+0000 7fec9dc00640 1 -- 172.21.15.144:0/3108230637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec980cdfc0 msgr2=0x7fec981f56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:22.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.816+0000 7fec9dc00640 1 --2- 172.21.15.144:0/3108230637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec980cdfc0 0x7fec981f56d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fec980ce620 tx=0x7fec800046c0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.818+0000 7fec9dc00640 1 -- 172.21.15.144:0/3108230637 shutdown_connections 2024-09-11T23:19:22.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.818+0000 7fec9dc00640 1 --2- 172.21.15.144:0/3108230637 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fec7406c030 0x7fec7406e4f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.818+0000 7fec9dc00640 1 --2- 172.21.15.144:0/3108230637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec98159dd0 0x7fec98141ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.818+0000 7fec9dc00640 1 --2- 172.21.15.144:0/3108230637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec980cdfc0 0x7fec981f56d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.818+0000 7fec9dc00640 1 --2- 172.21.15.144:0/3108230637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec9806c0e0 0x7fec98151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:22.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.818+0000 7fec9dc00640 1 -- 172.21.15.144:0/3108230637 >> 172.21.15.144:0/3108230637 conn(0x7fec980d0300 msgr2=0x7fec980b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:22.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.819+0000 7fec9dc00640 1 -- 172.21.15.144:0/3108230637 shutdown_connections 2024-09-11T23:19:22.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:22.820+0000 7fec9dc00640 1 -- 172.21.15.144:0/3108230637 wait complete. 2024-09-11T23:19:22.858 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:19:23.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.013+0000 7fb747200640 1 Processor -- start 2024-09-11T23:19:23.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.013+0000 7fb747200640 1 -- start start 2024-09-11T23:19:23.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.014+0000 7fb747200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb7480b5fd0 0x7fb7480b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.014+0000 7fb747200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb74806bee0 con 0x7fb74815e640 2024-09-11T23:19:23.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.014+0000 7fb747200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb74806c1c0 con 0x7fb7480b7750 2024-09-11T23:19:23.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.014+0000 7fb747200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb74815ea20 con 0x7fb7480b5fd0 2024-09-11T23:19:23.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.014+0000 7fb745400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb7480b5fd0 0x7fb7480b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.014+0000 7fb745400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb7480b5fd0 0x7fb7480b6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32904/0 (socket says 172.21.15.144:32904) 2024-09-11T23:19:23.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.014+0000 7fb745400640 1 -- 172.21.15.144:0/2754016337 learned_addr learned my addr 172.21.15.144:0/2754016337 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:23.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.015+0000 7fb745400640 1 -- 172.21.15.144:0/2754016337 >> v1:172.21.15.165:6789/0 conn(0x7fb7480b7750 legacy=0x7fb7480b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:23.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.015+0000 7fb745400640 1 -- 172.21.15.144:0/2754016337 >> v1:172.21.15.144:6789/0 conn(0x7fb74815e640 legacy=0x7fb7480d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.015+0000 7fb745400640 1 -- 172.21.15.144:0/2754016337 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74806c4a0 con 0x7fb7480b5fd0 2024-09-11T23:19:23.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.016+0000 7fb745400640 1 --2- 172.21.15.144:0/2754016337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7480b5fd0 0x7fb7480b6410 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb734009870 tx=0x7fb73402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f71717ee3e096ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:23.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.016+0000 7fb744a00640 1 -- 172.21.15.144:0/2754016337 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb734037070 con 0x7fb7480b5fd0 2024-09-11T23:19:23.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.016+0000 7fb744a00640 1 -- 172.21.15.144:0/2754016337 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb734032440 con 0x7fb7480b5fd0 2024-09-11T23:19:23.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.016+0000 7fb744a00640 1 -- 172.21.15.144:0/2754016337 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb734032810 con 0x7fb7480b5fd0 2024-09-11T23:19:23.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.017+0000 7fb747200640 1 -- 172.21.15.144:0/2754016337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7480b5fd0 msgr2=0x7fb7480b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.017+0000 7fb747200640 1 --2- 172.21.15.144:0/2754016337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7480b5fd0 0x7fb7480b6410 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb734009870 tx=0x7fb73402a2a0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.017+0000 7fb747200640 1 -- 172.21.15.144:0/2754016337 shutdown_connections 2024-09-11T23:19:23.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.017+0000 7fb747200640 1 --2- 172.21.15.144:0/2754016337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7480b5fd0 0x7fb7480b6410 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.017+0000 7fb747200640 1 -- 172.21.15.144:0/2754016337 >> 172.21.15.144:0/2754016337 conn(0x7fb7480d0fd0 msgr2=0x7fb7480d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:23.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.017+0000 7fb747200640 1 -- 172.21.15.144:0/2754016337 shutdown_connections 2024-09-11T23:19:23.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.017+0000 7fb747200640 1 -- 172.21.15.144:0/2754016337 wait complete. 2024-09-11T23:19:23.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.019+0000 7fb747200640 1 Processor -- start 2024-09-11T23:19:23.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.019+0000 7fb747200640 1 -- start start 2024-09-11T23:19:23.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.020+0000 7fb747200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7480b5fd0 0x7fb748152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.020+0000 7fb747200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7480b7750 0x7fb7480cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.020+0000 7fb747200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb74815e640 0x7fb748160e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.020+0000 7fb747200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb7480b6950 con 0x7fb74815e640 2024-09-11T23:19:23.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.020+0000 7fb747200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb74806caf0 con 0x7fb7480b5fd0 2024-09-11T23:19:23.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.020+0000 7fb747200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb7480d4130 con 0x7fb7480b7750 2024-09-11T23:19:23.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.020+0000 7fb746800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb74815e640 0x7fb748160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.020+0000 7fb746800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb74815e640 0x7fb748160e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32906/0 (socket says 172.21.15.144:32906) 2024-09-11T23:19:23.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.020+0000 7fb746800640 1 -- 172.21.15.144:0/2968797886 learned_addr learned my addr 172.21.15.144:0/2968797886 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:23.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.020+0000 7fb745e00640 1 --2- 172.21.15.144:0/2968797886 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7480b5fd0 0x7fb748152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.020+0000 7fb745400640 1 --2- 172.21.15.144:0/2968797886 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7480b7750 0x7fb7480cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.020+0000 7fb746800640 1 -- 172.21.15.144:0/2968797886 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7480b7750 msgr2=0x7fb7480cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.020+0000 7fb746800640 1 --2- 172.21.15.144:0/2968797886 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7480b7750 0x7fb7480cde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.020+0000 7fb746800640 1 -- 172.21.15.144:0/2968797886 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7480b5fd0 msgr2=0x7fb748152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.020+0000 7fb746800640 1 --2- 172.21.15.144:0/2968797886 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7480b5fd0 0x7fb748152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.020+0000 7fb746800640 1 -- 172.21.15.144:0/2968797886 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7480cb870 con 0x7fb74815e640 2024-09-11T23:19:23.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.021+0000 7fb746800640 1 --2- 172.21.15.144:0/2968797886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb74815e640 0x7fb748160e20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb74000c780 tx=0x7fb74000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:23.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.021+0000 7fb73e000640 1 -- 172.21.15.144:0/2968797886 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb740004b60 con 0x7fb74815e640 2024-09-11T23:19:23.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.021+0000 7fb73e000640 1 -- 172.21.15.144:0/2968797886 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb740004d00 con 0x7fb74815e640 2024-09-11T23:19:23.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.021+0000 7fb73e000640 1 -- 172.21.15.144:0/2968797886 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74000aa90 con 0x7fb74815e640 2024-09-11T23:19:23.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.021+0000 7fb747200640 1 -- 172.21.15.144:0/2968797886 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7480cbb50 con 0x7fb74815e640 2024-09-11T23:19:23.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.021+0000 7fb747200640 1 -- 172.21.15.144:0/2968797886 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7480cc110 con 0x7fb74815e640 2024-09-11T23:19:23.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.022+0000 7fb747200640 1 -- 172.21.15.144:0/2968797886 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7480cc4f0 con 0x7fb74815e640 2024-09-11T23:19:23.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.023+0000 7fb73e000640 1 -- 172.21.15.144:0/2968797886 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fb74000ac30 con 0x7fb74815e640 2024-09-11T23:19:23.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.024+0000 7fb73e000640 1 --2- 172.21.15.144:0/2968797886 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb72806c010 0x7fb72806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.024+0000 7fb73e000640 1 -- 172.21.15.144:0/2968797886 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fb74008b440 con 0x7fb74815e640 2024-09-11T23:19:23.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.024+0000 7fb745e00640 1 --2- 172.21.15.144:0/2968797886 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb72806c010 0x7fb72806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.025+0000 7fb745e00640 1 --2- 172.21.15.144:0/2968797886 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb72806c010 0x7fb72806e4d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb738001640 tx=0x7fb738009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:23.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.029+0000 7fb73e000640 1 -- 172.21.15.144:0/2968797886 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7480cc4f0 con 0x7fb74815e640 2024-09-11T23:19:23.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.207+0000 7fb747200640 1 -- 172.21.15.144:0/2968797886 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb7480b6410 con 0x7fb74815e640 2024-09-11T23:19:23.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.208+0000 7fb73e000640 1 -- 172.21.15.144:0/2968797886 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16710 (secure 0 0 0) 0x7fb740020070 con 0x7fb74815e640 2024-09-11T23:19:23.209 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:23.209 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":45,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:19:22.219140+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:19:19.995015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-11T23:19:21.218463+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:19:23.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.210+0000 7fb747200640 1 -- 172.21.15.144:0/2968797886 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb72806c010 msgr2=0x7fb72806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.210+0000 7fb747200640 1 --2- 172.21.15.144:0/2968797886 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb72806c010 0x7fb72806e4d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb738001640 tx=0x7fb738009040 comp rx=0 tx=0).stop 2024-09-11T23:19:23.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.210+0000 7fb747200640 1 -- 172.21.15.144:0/2968797886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb74815e640 msgr2=0x7fb748160e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.210+0000 7fb747200640 1 --2- 172.21.15.144:0/2968797886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb74815e640 0x7fb748160e20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb74000c780 tx=0x7fb74000cc40 comp rx=0 tx=0).stop 2024-09-11T23:19:23.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.211+0000 7fb747200640 1 -- 172.21.15.144:0/2968797886 shutdown_connections 2024-09-11T23:19:23.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.211+0000 7fb747200640 1 --2- 172.21.15.144:0/2968797886 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb72806c010 0x7fb72806e4d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.211+0000 7fb747200640 1 --2- 172.21.15.144:0/2968797886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb74815e640 0x7fb748160e20 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.211+0000 7fb747200640 1 --2- 172.21.15.144:0/2968797886 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb7480b7750 0x7fb7480cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.211+0000 7fb747200640 1 --2- 172.21.15.144:0/2968797886 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7480b5fd0 0x7fb748152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.211+0000 7fb747200640 1 -- 172.21.15.144:0/2968797886 >> 172.21.15.144:0/2968797886 conn(0x7fb7480d0fd0 msgr2=0x7fb7480cac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:23.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.211+0000 7fb747200640 1 -- 172.21.15.144:0/2968797886 shutdown_connections 2024-09-11T23:19:23.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.211+0000 7fb747200640 1 -- 172.21.15.144:0/2968797886 wait complete. 2024-09-11T23:19:23.226 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:19:23.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.380+0000 7fb49a400640 1 Processor -- start 2024-09-11T23:19:23.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.380+0000 7fb49a400640 1 -- start start 2024-09-11T23:19:23.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.381+0000 7fb49a400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb494162860 0x7fb494162c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.381+0000 7fb49a400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb49415f020 0x7fb49406bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.381+0000 7fb49a400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb49415f520 con 0x7fb49415ebb0 2024-09-11T23:19:23.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.381+0000 7fb49a400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb49415fae0 con 0x7fb494162860 2024-09-11T23:19:23.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.381+0000 7fb49a400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb49415f800 con 0x7fb49415f020 2024-09-11T23:19:23.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.381+0000 7fb493400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb494162860 0x7fb494162c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.382+0000 7fb493400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb494162860 0x7fb494162c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32914/0 (socket says 172.21.15.144:32914) 2024-09-11T23:19:23.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.382+0000 7fb493400640 1 -- 172.21.15.144:0/3240137123 learned_addr learned my addr 172.21.15.144:0/3240137123 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:23.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.382+0000 7fb493e00640 1 --2- 172.21.15.144:0/3240137123 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb49415f020 0x7fb49406bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.382+0000 7fb493400640 1 -- 172.21.15.144:0/3240137123 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb49415f020 msgr2=0x7fb49406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:23.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.382+0000 7fb493400640 1 --2- 172.21.15.144:0/3240137123 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb49415f020 0x7fb49406bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.382+0000 7fb493400640 1 -- 172.21.15.144:0/3240137123 >> v1:172.21.15.144:6789/0 conn(0x7fb49415ebb0 legacy=0x7fb4940b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.382+0000 7fb493400640 1 -- 172.21.15.144:0/3240137123 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4940b2b00 con 0x7fb494162860 2024-09-11T23:19:23.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.382+0000 7fb492000640 1 -- 172.21.15.144:0/3240137123 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3915162093 0 0) 0x7fb49415f520 con 0x7fb49415ebb0 2024-09-11T23:19:23.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.382+0000 7fb493e00640 1 --2- 172.21.15.144:0/3240137123 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb49415f020 0x7fb49406bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:23.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.383+0000 7fb493400640 1 --2- 172.21.15.144:0/3240137123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb494162860 0x7fb494162c40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb484009870 tx=0x7fb48402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b16f9299624e195 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:23.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.383+0000 7fb492000640 1 -- 172.21.15.144:0/3240137123 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb484037070 con 0x7fb494162860 2024-09-11T23:19:23.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.383+0000 7fb492000640 1 -- 172.21.15.144:0/3240137123 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb484032440 con 0x7fb494162860 2024-09-11T23:19:23.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.383+0000 7fb492000640 1 -- 172.21.15.144:0/3240137123 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb484032810 con 0x7fb494162860 2024-09-11T23:19:23.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.384+0000 7fb49a400640 1 -- 172.21.15.144:0/3240137123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb494162860 msgr2=0x7fb494162c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.384+0000 7fb49a400640 1 --2- 172.21.15.144:0/3240137123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb494162860 0x7fb494162c40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb484009870 tx=0x7fb48402a1c0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.384+0000 7fb49a400640 1 -- 172.21.15.144:0/3240137123 shutdown_connections 2024-09-11T23:19:23.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.384+0000 7fb49a400640 1 --2- 172.21.15.144:0/3240137123 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb49415f020 0x7fb49406bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.384+0000 7fb49a400640 1 --2- 172.21.15.144:0/3240137123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb494162860 0x7fb494162c40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.384+0000 7fb49a400640 1 -- 172.21.15.144:0/3240137123 >> 172.21.15.144:0/3240137123 conn(0x7fb49406ce90 msgr2=0x7fb49406d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:23.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.384+0000 7fb49a400640 1 -- 172.21.15.144:0/3240137123 shutdown_connections 2024-09-11T23:19:23.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.384+0000 7fb49a400640 1 -- 172.21.15.144:0/3240137123 wait complete. 2024-09-11T23:19:23.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.385+0000 7fb49a400640 1 Processor -- start 2024-09-11T23:19:23.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.386+0000 7fb49a400640 1 -- start start 2024-09-11T23:19:23.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.386+0000 7fb49a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb49415ebb0 0x7fb4941ea040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.386+0000 7fb49a400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb49415f020 0x7fb4941579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.386+0000 7fb49a400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb494162860 0x7fb4940ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.386+0000 7fb49a400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb49406c0e0 con 0x7fb49415ebb0 2024-09-11T23:19:23.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.386+0000 7fb49a400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb4940b3a10 con 0x7fb494162860 2024-09-11T23:19:23.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.386+0000 7fb49a400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb49406c260 con 0x7fb49415f020 2024-09-11T23:19:23.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.387+0000 7fb493400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb49415ebb0 0x7fb4941ea040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.387+0000 7fb493400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb49415ebb0 0x7fb4941ea040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32926/0 (socket says 172.21.15.144:32926) 2024-09-11T23:19:23.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.387+0000 7fb493400640 1 -- 172.21.15.144:0/3202468828 learned_addr learned my addr 172.21.15.144:0/3202468828 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:23.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.387+0000 7fb493e00640 1 --2- 172.21.15.144:0/3202468828 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb494162860 0x7fb4940ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.387+0000 7fb492a00640 1 --2- 172.21.15.144:0/3202468828 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb49415f020 0x7fb4941579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.387+0000 7fb493400640 1 -- 172.21.15.144:0/3202468828 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb49415f020 msgr2=0x7fb4941579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.387+0000 7fb493400640 1 --2- 172.21.15.144:0/3202468828 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb49415f020 0x7fb4941579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.387+0000 7fb493400640 1 -- 172.21.15.144:0/3202468828 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb494162860 msgr2=0x7fb4940ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.387+0000 7fb493400640 1 --2- 172.21.15.144:0/3202468828 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb494162860 0x7fb4940ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.387+0000 7fb493400640 1 -- 172.21.15.144:0/3202468828 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb494145800 con 0x7fb49415ebb0 2024-09-11T23:19:23.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.387+0000 7fb493e00640 1 --2- 172.21.15.144:0/3202468828 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb494162860 0x7fb4940ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:23.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.387+0000 7fb492a00640 1 --2- 172.21.15.144:0/3202468828 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb49415f020 0x7fb4941579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:23.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.387+0000 7fb493400640 1 --2- 172.21.15.144:0/3202468828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb49415ebb0 0x7fb4941ea040 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb484000c00 tx=0x7fb4840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:23.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.388+0000 7fb48b400640 1 -- 172.21.15.144:0/3202468828 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb484041020 con 0x7fb49415ebb0 2024-09-11T23:19:23.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.388+0000 7fb48b400640 1 -- 172.21.15.144:0/3202468828 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4840306c0 con 0x7fb49415ebb0 2024-09-11T23:19:23.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.388+0000 7fb48b400640 1 -- 172.21.15.144:0/3202468828 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb484037040 con 0x7fb49415ebb0 2024-09-11T23:19:23.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.388+0000 7fb49a400640 1 -- 172.21.15.144:0/3202468828 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4941f7cf0 con 0x7fb49415ebb0 2024-09-11T23:19:23.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.388+0000 7fb49a400640 1 -- 172.21.15.144:0/3202468828 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4941f82b0 con 0x7fb49415ebb0 2024-09-11T23:19:23.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.389+0000 7fb49a400640 1 -- 172.21.15.144:0/3202468828 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb49406bba0 con 0x7fb49415ebb0 2024-09-11T23:19:23.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.390+0000 7fb48b400640 1 -- 172.21.15.144:0/3202468828 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fb484044020 con 0x7fb49415ebb0 2024-09-11T23:19:23.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.391+0000 7fb48b400640 1 --2- 172.21.15.144:0/3202468828 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb47406bfe0 0x7fb47406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.391+0000 7fb48b400640 1 -- 172.21.15.144:0/3202468828 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fb4840ab960 con 0x7fb49415ebb0 2024-09-11T23:19:23.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.391+0000 7fb492a00640 1 --2- 172.21.15.144:0/3202468828 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb47406bfe0 0x7fb47406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.392+0000 7fb492a00640 1 --2- 172.21.15.144:0/3202468828 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb47406bfe0 0x7fb47406e4a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb4941e96b0 tx=0x7fb480009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:23.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.395+0000 7fb48b400640 1 -- 172.21.15.144:0/3202468828 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb48404b030 con 0x7fb49415ebb0 2024-09-11T23:19:23.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.572+0000 7fb49a400640 1 -- 172.21.15.144:0/3202468828 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb494161950 con 0x7fb49415ebb0 2024-09-11T23:19:23.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.573+0000 7fb48b400640 1 -- 172.21.15.144:0/3202468828 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16710 (secure 0 0 0) 0x7fb48407a120 con 0x7fb49415ebb0 2024-09-11T23:19:23.574 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:23.574 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":45,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:19:22.219140+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:19:19.995015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-11T23:19:21.218463+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:19:23.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.575+0000 7fb49a400640 1 -- 172.21.15.144:0/3202468828 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb47406bfe0 msgr2=0x7fb47406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.575+0000 7fb49a400640 1 --2- 172.21.15.144:0/3202468828 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb47406bfe0 0x7fb47406e4a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb4941e96b0 tx=0x7fb480009040 comp rx=0 tx=0).stop 2024-09-11T23:19:23.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.575+0000 7fb49a400640 1 -- 172.21.15.144:0/3202468828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb49415ebb0 msgr2=0x7fb4941ea040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.575+0000 7fb49a400640 1 --2- 172.21.15.144:0/3202468828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb49415ebb0 0x7fb4941ea040 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb484000c00 tx=0x7fb4840046c0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.575+0000 7fb49a400640 1 -- 172.21.15.144:0/3202468828 shutdown_connections 2024-09-11T23:19:23.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.575+0000 7fb49a400640 1 --2- 172.21.15.144:0/3202468828 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb47406bfe0 0x7fb47406e4a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.576+0000 7fb49a400640 1 --2- 172.21.15.144:0/3202468828 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb494162860 0x7fb4940ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.576+0000 7fb49a400640 1 --2- 172.21.15.144:0/3202468828 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb49415f020 0x7fb4941579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.576+0000 7fb49a400640 1 --2- 172.21.15.144:0/3202468828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb49415ebb0 0x7fb4941ea040 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.576+0000 7fb49a400640 1 -- 172.21.15.144:0/3202468828 >> 172.21.15.144:0/3202468828 conn(0x7fb49406ce90 msgr2=0x7fb49406d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:23.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.576+0000 7fb49a400640 1 -- 172.21.15.144:0/3202468828 shutdown_connections 2024-09-11T23:19:23.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.576+0000 7fb49a400640 1 -- 172.21.15.144:0/3202468828 wait complete. 2024-09-11T23:19:23.591 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:19:23.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.749+0000 7fb964000640 1 Processor -- start 2024-09-11T23:19:23.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.749+0000 7fb964000640 1 -- start start 2024-09-11T23:19:23.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.751+0000 7fb964000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb95c06f130 0x7fb95c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.751+0000 7fb964000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb95c15c370 0x7fb95c0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.751+0000 7fb964000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb95c15c820 con 0x7fb95c158e50 2024-09-11T23:19:23.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.751+0000 7fb964000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb95c0b43f0 con 0x7fb95c06f130 2024-09-11T23:19:23.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.751+0000 7fb964000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb95c0b3630 con 0x7fb95c15c370 2024-09-11T23:19:23.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.751+0000 7fb962000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb95c15c370 0x7fb95c0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.751+0000 7fb962000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb95c15c370 0x7fb95c0ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:60912/0 (socket says 172.21.15.144:60912) 2024-09-11T23:19:23.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.751+0000 7fb962000640 1 -- 172.21.15.144:0/2649131763 learned_addr learned my addr 172.21.15.144:0/2649131763 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:23.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.751+0000 7fb960c00640 1 --2- 172.21.15.144:0/2649131763 >> v2:172.21.15.165:3300/0 conn(0x7fb95c06f130 0x7fb95c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.752+0000 7fb962000640 1 -- 172.21.15.144:0/2649131763 >> v2:172.21.15.165:3300/0 conn(0x7fb95c06f130 msgr2=0x7fb95c0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:23.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.752+0000 7fb962000640 1 --2- 172.21.15.144:0/2649131763 >> v2:172.21.15.165:3300/0 conn(0x7fb95c06f130 0x7fb95c0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.752+0000 7fb962000640 1 -- 172.21.15.144:0/2649131763 >> v1:172.21.15.165:6789/0 conn(0x7fb95c158e50 legacy=0x7fb95c06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.752+0000 7fb962000640 1 -- 172.21.15.144:0/2649131763 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95c0b3910 con 0x7fb95c15c370 2024-09-11T23:19:23.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.753+0000 7fb962000640 1 --2- 172.21.15.144:0/2649131763 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb95c15c370 0x7fb95c0ce200 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb954009e50 tx=0x7fb95402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7938c82998d8dd15 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:23.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.753+0000 7fb95be00640 1 -- 172.21.15.144:0/2649131763 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb954036070 con 0x7fb95c15c370 2024-09-11T23:19:23.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.753+0000 7fb95be00640 1 -- 172.21.15.144:0/2649131763 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb954031600 con 0x7fb95c15c370 2024-09-11T23:19:23.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.753+0000 7fb95be00640 1 -- 172.21.15.144:0/2649131763 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9540319d0 con 0x7fb95c15c370 2024-09-11T23:19:23.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.753+0000 7fb964000640 1 -- 172.21.15.144:0/2649131763 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb95c15c370 msgr2=0x7fb95c0ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.753+0000 7fb964000640 1 --2- 172.21.15.144:0/2649131763 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb95c15c370 0x7fb95c0ce200 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb954009e50 tx=0x7fb95402a710 comp rx=0 tx=0).stop 2024-09-11T23:19:23.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.753+0000 7fb964000640 1 -- 172.21.15.144:0/2649131763 shutdown_connections 2024-09-11T23:19:23.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.753+0000 7fb964000640 1 --2- 172.21.15.144:0/2649131763 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb95c15c370 0x7fb95c0ce200 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.753+0000 7fb964000640 1 --2- 172.21.15.144:0/2649131763 >> v2:172.21.15.165:3300/0 conn(0x7fb95c06f130 0x7fb95c0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.753+0000 7fb964000640 1 -- 172.21.15.144:0/2649131763 >> 172.21.15.144:0/2649131763 conn(0x7fb95c06bba0 msgr2=0x7fb95c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:23.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.754+0000 7fb964000640 1 -- 172.21.15.144:0/2649131763 shutdown_connections 2024-09-11T23:19:23.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.754+0000 7fb964000640 1 -- 172.21.15.144:0/2649131763 wait complete. 2024-09-11T23:19:23.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.755+0000 7fb964000640 1 Processor -- start 2024-09-11T23:19:23.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.755+0000 7fb964000640 1 -- start start 2024-09-11T23:19:23.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.756+0000 7fb964000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb95c06f130 0x7fb95c15cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.756+0000 7fb964000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c158e50 0x7fb95c14e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.756+0000 7fb964000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb95c15c370 0x7fb95c0b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.756+0000 7fb964000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c159230 con 0x7fb95c158e50 2024-09-11T23:19:23.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.756+0000 7fb964000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c0b3ed0 con 0x7fb95c06f130 2024-09-11T23:19:23.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.756+0000 7fb964000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb95c0ce740 con 0x7fb95c15c370 2024-09-11T23:19:23.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.756+0000 7fb960c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c158e50 0x7fb95c14e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.756+0000 7fb960c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c158e50 0x7fb95c14e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:32940/0 (socket says 172.21.15.144:32940) 2024-09-11T23:19:23.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.756+0000 7fb960c00640 1 -- 172.21.15.144:0/3881578337 learned_addr learned my addr 172.21.15.144:0/3881578337 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:23.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.756+0000 7fb961600640 1 --2- 172.21.15.144:0/3881578337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb95c06f130 0x7fb95c15cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.756+0000 7fb962000640 1 --2- 172.21.15.144:0/3881578337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb95c15c370 0x7fb95c0b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.757+0000 7fb960c00640 1 -- 172.21.15.144:0/3881578337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb95c15c370 msgr2=0x7fb95c0b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.757+0000 7fb960c00640 1 --2- 172.21.15.144:0/3881578337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb95c15c370 0x7fb95c0b1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.757+0000 7fb960c00640 1 -- 172.21.15.144:0/3881578337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb95c06f130 msgr2=0x7fb95c15cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:23.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.757+0000 7fb960c00640 1 --2- 172.21.15.144:0/3881578337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb95c06f130 0x7fb95c15cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:23.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.757+0000 7fb960c00640 1 -- 172.21.15.144:0/3881578337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95c15f790 con 0x7fb95c158e50 2024-09-11T23:19:23.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.757+0000 7fb960c00640 1 --2- 172.21.15.144:0/3881578337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c158e50 0x7fb95c14e6b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb94800e8d0 tx=0x7fb94800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:23.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.757+0000 7fb959600640 1 -- 172.21.15.144:0/3881578337 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948017070 con 0x7fb95c158e50 2024-09-11T23:19:23.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.757+0000 7fb959600640 1 -- 172.21.15.144:0/3881578337 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94800c940 con 0x7fb95c158e50 2024-09-11T23:19:23.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.757+0000 7fb959600640 1 -- 172.21.15.144:0/3881578337 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94800cd30 con 0x7fb95c158e50 2024-09-11T23:19:23.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.757+0000 7fb964000640 1 -- 172.21.15.144:0/3881578337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb95c148670 con 0x7fb95c158e50 2024-09-11T23:19:23.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.758+0000 7fb964000640 1 -- 172.21.15.144:0/3881578337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb95c148c30 con 0x7fb95c158e50 2024-09-11T23:19:23.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.759+0000 7fb964000640 1 -- 172.21.15.144:0/3881578337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb95c0ce200 con 0x7fb95c158e50 2024-09-11T23:19:23.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.760+0000 7fb959600640 1 -- 172.21.15.144:0/3881578337 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fb94801a070 con 0x7fb95c158e50 2024-09-11T23:19:23.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.760+0000 7fb959600640 1 --2- 172.21.15.144:0/3881578337 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb93c06bfe0 0x7fb93c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:23.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.761+0000 7fb959600640 1 -- 172.21.15.144:0/3881578337 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fb94808b380 con 0x7fb95c158e50 2024-09-11T23:19:23.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.761+0000 7fb961600640 1 --2- 172.21.15.144:0/3881578337 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb93c06bfe0 0x7fb93c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:23.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.761+0000 7fb961600640 1 --2- 172.21.15.144:0/3881578337 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb93c06bfe0 0x7fb93c06e4a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb950000f60 tx=0x7fb950009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:23.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.765+0000 7fb959600640 1 -- 172.21.15.144:0/3881578337 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb948059500 con 0x7fb95c158e50 2024-09-11T23:19:23.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:23.975+0000 7fb964000640 1 -- 172.21.15.144:0/3881578337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb95c153620 con 0x7fb95c158e50 2024-09-11T23:19:24.460 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-11T23:19:24.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:24.825+0000 7fb959600640 1 -- 172.21.15.144:0/3881578337 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7fb94805d800 con 0x7fb95c158e50 2024-09-11T23:19:24.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:24.828+0000 7fb964000640 1 -- 172.21.15.144:0/3881578337 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb93c06bfe0 msgr2=0x7fb93c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:24.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:24.828+0000 7fb964000640 1 --2- 172.21.15.144:0/3881578337 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb93c06bfe0 0x7fb93c06e4a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb950000f60 tx=0x7fb950009040 comp rx=0 tx=0).stop 2024-09-11T23:19:24.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:24.828+0000 7fb964000640 1 -- 172.21.15.144:0/3881578337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c158e50 msgr2=0x7fb95c14e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:24.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:24.828+0000 7fb964000640 1 --2- 172.21.15.144:0/3881578337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c158e50 0x7fb95c14e6b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb94800e8d0 tx=0x7fb94800ed90 comp rx=0 tx=0).stop 2024-09-11T23:19:24.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:24.828+0000 7fb964000640 1 -- 172.21.15.144:0/3881578337 shutdown_connections 2024-09-11T23:19:24.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:24.828+0000 7fb964000640 1 --2- 172.21.15.144:0/3881578337 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb93c06bfe0 0x7fb93c06e4a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:24.828+0000 7fb964000640 1 --2- 172.21.15.144:0/3881578337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb95c15c370 0x7fb95c0b1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:24.828+0000 7fb964000640 1 --2- 172.21.15.144:0/3881578337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c158e50 0x7fb95c14e6b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:24.828+0000 7fb964000640 1 --2- 172.21.15.144:0/3881578337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb95c06f130 0x7fb95c15cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:24.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:24.828+0000 7fb964000640 1 -- 172.21.15.144:0/3881578337 >> 172.21.15.144:0/3881578337 conn(0x7fb95c06bba0 msgr2=0x7fb95c06d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:24.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:24.828+0000 7fb964000640 1 -- 172.21.15.144:0/3881578337 shutdown_connections 2024-09-11T23:19:24.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:24.828+0000 7fb964000640 1 -- 172.21.15.144:0/3881578337 wait complete. 2024-09-11T23:19:24.844 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:19:24.845 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:19:25.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.001+0000 7f02d2400640 1 Processor -- start 2024-09-11T23:19:25.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.001+0000 7f02d2400640 1 -- start start 2024-09-11T23:19:25.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.003+0000 7f02d2400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f02cc158e50 0x7f02cc0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:25.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.003+0000 7f02d2400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f02cc15c370 0x7f02cc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:25.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.003+0000 7f02d2400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f02cc06ef60 0x7f02cc15ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:25.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.003+0000 7f02d2400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f02cc15c800 con 0x7f02cc15c370 2024-09-11T23:19:25.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.003+0000 7f02d2400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f02cc0b43f0 con 0x7f02cc158e50 2024-09-11T23:19:25.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.003+0000 7f02d2400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f02cc0b3630 con 0x7f02cc06ef60 2024-09-11T23:19:25.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.003+0000 7f02c2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f02cc15c370 0x7f02cc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:25.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.003+0000 7f02c2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f02cc15c370 0x7f02cc06ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37036/0 (socket says 172.21.15.144:37036) 2024-09-11T23:19:25.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.003+0000 7f02c2a00640 1 -- 172.21.15.144:0/2711135608 learned_addr learned my addr 172.21.15.144:0/2711135608 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:25.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.003+0000 7f02cb400640 1 --2- 172.21.15.144:0/2711135608 >> v2:172.21.15.165:3300/0 conn(0x7f02cc158e50 0x7f02cc0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:25.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.003+0000 7f02cbe00640 1 --2- 172.21.15.144:0/2711135608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f02cc06ef60 0x7f02cc15ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:25.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.003+0000 7f02c2a00640 1 -- 172.21.15.144:0/2711135608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f02cc06ef60 msgr2=0x7f02cc15ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:25.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.003+0000 7f02c2a00640 1 --2- 172.21.15.144:0/2711135608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f02cc06ef60 0x7f02cc15ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.004+0000 7f02c2a00640 1 -- 172.21.15.144:0/2711135608 >> v2:172.21.15.165:3300/0 conn(0x7f02cc158e50 msgr2=0x7f02cc0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:25.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.004+0000 7f02c2a00640 1 --2- 172.21.15.144:0/2711135608 >> v2:172.21.15.165:3300/0 conn(0x7f02cc158e50 0x7f02cc0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.004+0000 7f02c2a00640 1 -- 172.21.15.144:0/2711135608 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02cc0b3910 con 0x7f02cc15c370 2024-09-11T23:19:25.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.004+0000 7f02cbe00640 1 --2- 172.21.15.144:0/2711135608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f02cc06ef60 0x7f02cc15ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:25.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.005+0000 7f02c2a00640 1 --2- 172.21.15.144:0/2711135608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02cc15c370 0x7f02cc06ea20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f02cc069580 tx=0x7f02b402c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b46675f4941d8dd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:25.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.005+0000 7f02caa00640 1 -- 172.21.15.144:0/2711135608 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4004230 con 0x7f02cc15c370 2024-09-11T23:19:25.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.005+0000 7f02caa00640 1 -- 172.21.15.144:0/2711135608 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b40043d0 con 0x7f02cc15c370 2024-09-11T23:19:25.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.005+0000 7f02caa00640 1 -- 172.21.15.144:0/2711135608 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4003810 con 0x7f02cc15c370 2024-09-11T23:19:25.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.005+0000 7f02d2400640 1 -- 172.21.15.144:0/2711135608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02cc15c370 msgr2=0x7f02cc06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:25.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.005+0000 7f02d2400640 1 --2- 172.21.15.144:0/2711135608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02cc15c370 0x7f02cc06ea20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f02cc069580 tx=0x7f02b402c870 comp rx=0 tx=0).stop 2024-09-11T23:19:25.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.006+0000 7f02d2400640 1 -- 172.21.15.144:0/2711135608 shutdown_connections 2024-09-11T23:19:25.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.006+0000 7f02d2400640 1 --2- 172.21.15.144:0/2711135608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02cc15c370 0x7f02cc06ea20 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.006+0000 7f02d2400640 1 --2- 172.21.15.144:0/2711135608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f02cc06ef60 0x7f02cc15ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.006+0000 7f02d2400640 1 --2- 172.21.15.144:0/2711135608 >> v2:172.21.15.165:3300/0 conn(0x7f02cc158e50 0x7f02cc0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.006+0000 7f02d2400640 1 -- 172.21.15.144:0/2711135608 >> 172.21.15.144:0/2711135608 conn(0x7f02cc06bba0 msgr2=0x7f02cc06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:25.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.006+0000 7f02d2400640 1 -- 172.21.15.144:0/2711135608 shutdown_connections 2024-09-11T23:19:25.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.006+0000 7f02d2400640 1 -- 172.21.15.144:0/2711135608 wait complete. 2024-09-11T23:19:25.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.007+0000 7f02d2400640 1 Processor -- start 2024-09-11T23:19:25.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.008+0000 7f02d2400640 1 -- start start 2024-09-11T23:19:25.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.008+0000 7f02d2400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02cc06ef60 0x7f02cc14fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:25.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.008+0000 7f02d2400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f02cc158e50 0x7f02cc151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:25.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.008+0000 7f02d2400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02cc15c370 0x7f02cc0b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:25.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.009+0000 7f02d2400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc159230 con 0x7f02cc06ef60 2024-09-11T23:19:25.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.009+0000 7f02d2400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc0b3ed0 con 0x7f02cc15c370 2024-09-11T23:19:25.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.009+0000 7f02d2400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f02cc15f390 con 0x7f02cc158e50 2024-09-11T23:19:25.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.009+0000 7f02cb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02cc06ef60 0x7f02cc14fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:25.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.009+0000 7f02cb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02cc06ef60 0x7f02cc14fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37048/0 (socket says 172.21.15.144:37048) 2024-09-11T23:19:25.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.009+0000 7f02cb400640 1 -- 172.21.15.144:0/613340140 learned_addr learned my addr 172.21.15.144:0/613340140 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:25.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.009+0000 7f02cbe00640 1 --2- 172.21.15.144:0/613340140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02cc15c370 0x7f02cc0b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:25.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.009+0000 7f02cb400640 1 -- 172.21.15.144:0/613340140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f02cc158e50 msgr2=0x7f02cc151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:25.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.009+0000 7f02cb400640 1 --2- 172.21.15.144:0/613340140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f02cc158e50 0x7f02cc151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.009+0000 7f02cb400640 1 -- 172.21.15.144:0/613340140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02cc15c370 msgr2=0x7f02cc0b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:25.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.009+0000 7f02cb400640 1 --2- 172.21.15.144:0/613340140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02cc15c370 0x7f02cc0b14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.009+0000 7f02cb400640 1 -- 172.21.15.144:0/613340140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02cc15e790 con 0x7f02cc06ef60 2024-09-11T23:19:25.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.009+0000 7f02cb400640 1 --2- 172.21.15.144:0/613340140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02cc06ef60 0x7f02cc14fc00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00e9b0 tx=0x7f02bc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:25.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.010+0000 7f02c3e00640 1 -- 172.21.15.144:0/613340140 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc017070 con 0x7f02cc06ef60 2024-09-11T23:19:25.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.010+0000 7f02c3e00640 1 -- 172.21.15.144:0/613340140 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02bc00c9a0 con 0x7f02cc06ef60 2024-09-11T23:19:25.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.010+0000 7f02c3e00640 1 -- 172.21.15.144:0/613340140 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc00cd90 con 0x7f02cc06ef60 2024-09-11T23:19:25.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.010+0000 7f02d2400640 1 -- 172.21.15.144:0/613340140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02cc15e030 con 0x7f02cc06ef60 2024-09-11T23:19:25.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.010+0000 7f02d2400640 1 -- 172.21.15.144:0/613340140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02cc157cc0 con 0x7f02cc06ef60 2024-09-11T23:19:25.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.011+0000 7f02d2400640 1 -- 172.21.15.144:0/613340140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02cc15ee50 con 0x7f02cc06ef60 2024-09-11T23:19:25.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.012+0000 7f02c3e00640 1 -- 172.21.15.144:0/613340140 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f02bc01a070 con 0x7f02cc06ef60 2024-09-11T23:19:25.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.012+0000 7f02c3e00640 1 --2- 172.21.15.144:0/613340140 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f02a806bfe0 0x7f02a806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:25.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.013+0000 7f02c3e00640 1 -- 172.21.15.144:0/613340140 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f02bc08b610 con 0x7f02cc06ef60 2024-09-11T23:19:25.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.013+0000 7f02c2a00640 1 --2- 172.21.15.144:0/613340140 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f02a806bfe0 0x7f02a806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:25.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.013+0000 7f02c2a00640 1 --2- 172.21.15.144:0/613340140 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f02a806bfe0 0x7f02a806e4a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f02b4036000 tx=0x7f02b4031000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:25.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.017+0000 7f02c3e00640 1 -- 172.21.15.144:0/613340140 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02bc059ca0 con 0x7f02cc06ef60 2024-09-11T23:19:25.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.227+0000 7f02d2400640 1 -- 172.21.15.144:0/613340140 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f02cc072e80 con 0x7f02cc06ef60 2024-09-11T23:19:25.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.831+0000 7f02c3e00640 1 -- 172.21.15.144:0/613340140 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) ==== 122+0+0 (secure 0 0 0) 0x7f02bc0595a0 con 0x7f02cc06ef60 2024-09-11T23:19:25.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.833+0000 7f02d2400640 1 -- 172.21.15.144:0/613340140 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f02a806bfe0 msgr2=0x7f02a806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:25.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.833+0000 7f02d2400640 1 --2- 172.21.15.144:0/613340140 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f02a806bfe0 0x7f02a806e4a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f02b4036000 tx=0x7f02b4031000 comp rx=0 tx=0).stop 2024-09-11T23:19:25.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.833+0000 7f02d2400640 1 -- 172.21.15.144:0/613340140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02cc06ef60 msgr2=0x7f02cc14fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:25.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.833+0000 7f02d2400640 1 --2- 172.21.15.144:0/613340140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02cc06ef60 0x7f02cc14fc00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00e9b0 tx=0x7f02bc00ee70 comp rx=0 tx=0).stop 2024-09-11T23:19:25.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.833+0000 7f02d2400640 1 -- 172.21.15.144:0/613340140 shutdown_connections 2024-09-11T23:19:25.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.833+0000 7f02d2400640 1 --2- 172.21.15.144:0/613340140 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f02a806bfe0 0x7f02a806e4a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.833+0000 7f02d2400640 1 --2- 172.21.15.144:0/613340140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02cc15c370 0x7f02cc0b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.833+0000 7f02d2400640 1 --2- 172.21.15.144:0/613340140 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f02cc158e50 0x7f02cc151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.833+0000 7f02d2400640 1 --2- 172.21.15.144:0/613340140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02cc06ef60 0x7f02cc14fc00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:25.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.833+0000 7f02d2400640 1 -- 172.21.15.144:0/613340140 >> 172.21.15.144:0/613340140 conn(0x7f02cc06bba0 msgr2=0x7f02cc15b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:25.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.834+0000 7f02d2400640 1 -- 172.21.15.144:0/613340140 shutdown_connections 2024-09-11T23:19:25.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:25.834+0000 7f02d2400640 1 -- 172.21.15.144:0/613340140 wait complete. 2024-09-11T23:19:25.851 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:19:25.851 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:26.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.004+0000 7f724be00640 1 Processor -- start 2024-09-11T23:19:26.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.004+0000 7f724be00640 1 -- start start 2024-09-11T23:19:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.005+0000 7f724be00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7244073390 0x7f72440b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.005+0000 7f724be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72440b4bd0 0x7f72440cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.005+0000 7f724be00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f724415ed40 con 0x7f724415e960 2024-09-11T23:19:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.005+0000 7f724be00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f72440b78a0 con 0x7f7244073390 2024-09-11T23:19:26.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.005+0000 7f724be00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f724406ce50 con 0x7f72440b4bd0 2024-09-11T23:19:26.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.006+0000 7f7249e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72440b4bd0 0x7f72440cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.006+0000 7f7248a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7244073390 0x7f72440b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.006+0000 7f7249400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f724415e960 0x7f72440b44c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:56272/0 (socket says 172.21.15.144:56272) 2024-09-11T23:19:26.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.006+0000 7f7249400640 1 -- 172.21.15.144:0/1341602694 learned_addr learned my addr 172.21.15.144:0/1341602694 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:26.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.006+0000 7f7243e00640 1 -- 172.21.15.144:0/1341602694 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3484834446 0 0) 0x7f724415ed40 con 0x7f724415e960 2024-09-11T23:19:26.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.006+0000 7f7243e00640 1 -- 172.21.15.144:0/1341602694 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f722c003520 con 0x7f724415e960 2024-09-11T23:19:26.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.006+0000 7f7248a00640 1 -- 172.21.15.144:0/1341602694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72440b4bd0 msgr2=0x7f72440cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:26.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.006+0000 7f7248a00640 1 --2- 172.21.15.144:0/1341602694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72440b4bd0 0x7f72440cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.006+0000 7f7248a00640 1 -- 172.21.15.144:0/1341602694 >> v1:172.21.15.165:6789/0 conn(0x7f724415e960 legacy=0x7f72440b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.006+0000 7f7248a00640 1 -- 172.21.15.144:0/1341602694 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72440b72e0 con 0x7f7244073390 2024-09-11T23:19:26.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.007+0000 7f7248a00640 1 --2- 172.21.15.144:0/1341602694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7244073390 0x7f72440b6ce0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f72300097a0 tx=0x7f723002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bba199d9ee95ae5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:26.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.008+0000 7f7243e00640 1 -- 172.21.15.144:0/1341602694 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7230037070 con 0x7f7244073390 2024-09-11T23:19:26.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.008+0000 7f7243e00640 1 -- 172.21.15.144:0/1341602694 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7230032440 con 0x7f7244073390 2024-09-11T23:19:26.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.008+0000 7f7243e00640 1 -- 172.21.15.144:0/1341602694 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72300327f0 con 0x7f7244073390 2024-09-11T23:19:26.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.008+0000 7f724be00640 1 -- 172.21.15.144:0/1341602694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7244073390 msgr2=0x7f72440b6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.008+0000 7f724be00640 1 --2- 172.21.15.144:0/1341602694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7244073390 0x7f72440b6ce0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f72300097a0 tx=0x7f723002a180 comp rx=0 tx=0).stop 2024-09-11T23:19:26.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.008+0000 7f724be00640 1 -- 172.21.15.144:0/1341602694 shutdown_connections 2024-09-11T23:19:26.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.008+0000 7f724be00640 1 --2- 172.21.15.144:0/1341602694 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72440b4bd0 0x7f72440cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.008+0000 7f724be00640 1 --2- 172.21.15.144:0/1341602694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7244073390 0x7f72440b6ce0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.008+0000 7f724be00640 1 -- 172.21.15.144:0/1341602694 >> 172.21.15.144:0/1341602694 conn(0x7f7244062810 msgr2=0x7f7244062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:26.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.008+0000 7f724be00640 1 -- 172.21.15.144:0/1341602694 shutdown_connections 2024-09-11T23:19:26.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.008+0000 7f724be00640 1 -- 172.21.15.144:0/1341602694 wait complete. 2024-09-11T23:19:26.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.010+0000 7f724be00640 1 Processor -- start 2024-09-11T23:19:26.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.010+0000 7f724be00640 1 -- start start 2024-09-11T23:19:26.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.011+0000 7f724be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7244073390 0x7f72441f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.011+0000 7f724be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72440b4bd0 0x7f7244154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.011+0000 7f724be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f724415e960 0x7f7244156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.011+0000 7f724be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7244073cb0 con 0x7f7244073390 2024-09-11T23:19:26.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.011+0000 7f724be00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f724406d0f0 con 0x7f72440b4bd0 2024-09-11T23:19:26.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.011+0000 7f724be00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7244073e30 con 0x7f724415e960 2024-09-11T23:19:26.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.011+0000 7f7249400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7244073390 0x7f72441f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.011+0000 7f7249400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7244073390 0x7f72441f4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37058/0 (socket says 172.21.15.144:37058) 2024-09-11T23:19:26.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.011+0000 7f7249400640 1 -- 172.21.15.144:0/3370009521 learned_addr learned my addr 172.21.15.144:0/3370009521 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:26.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.011+0000 7f7248a00640 1 --2- 172.21.15.144:0/3370009521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72440b4bd0 0x7f7244154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.011+0000 7f7249e00640 1 --2- 172.21.15.144:0/3370009521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f724415e960 0x7f7244156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.012+0000 7f7249400640 1 -- 172.21.15.144:0/3370009521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f724415e960 msgr2=0x7f7244156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.012+0000 7f7249400640 1 --2- 172.21.15.144:0/3370009521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f724415e960 0x7f7244156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.012+0000 7f7249400640 1 -- 172.21.15.144:0/3370009521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72440b4bd0 msgr2=0x7f7244154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.012+0000 7f7249400640 1 --2- 172.21.15.144:0/3370009521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72440b4bd0 0x7f7244154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.012+0000 7f7249400640 1 -- 172.21.15.144:0/3370009521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72441552b0 con 0x7f7244073390 2024-09-11T23:19:26.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.012+0000 7f7249e00640 1 --2- 172.21.15.144:0/3370009521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f724415e960 0x7f7244156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:26.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.012+0000 7f7248a00640 1 --2- 172.21.15.144:0/3370009521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72440b4bd0 0x7f7244154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:26.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.012+0000 7f7249400640 1 --2- 172.21.15.144:0/3370009521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7244073390 0x7f72441f4ca0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f723800c460 tx=0x7f723800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:26.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.012+0000 7f7241600640 1 -- 172.21.15.144:0/3370009521 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7238017070 con 0x7f7244073390 2024-09-11T23:19:26.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.012+0000 7f7241600640 1 -- 172.21.15.144:0/3370009521 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7238005ce0 con 0x7f7244073390 2024-09-11T23:19:26.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.012+0000 7f7241600640 1 -- 172.21.15.144:0/3370009521 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7238007290 con 0x7f7244073390 2024-09-11T23:19:26.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.012+0000 7f724be00640 1 -- 172.21.15.144:0/3370009521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7244155590 con 0x7f7244073390 2024-09-11T23:19:26.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.012+0000 7f724be00640 1 -- 172.21.15.144:0/3370009521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7244157a80 con 0x7f7244073390 2024-09-11T23:19:26.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.014+0000 7f724be00640 1 -- 172.21.15.144:0/3370009521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72440b6ce0 con 0x7f7244073390 2024-09-11T23:19:26.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.014+0000 7f7241600640 1 -- 172.21.15.144:0/3370009521 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f723801a070 con 0x7f7244073390 2024-09-11T23:19:26.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.015+0000 7f7241600640 1 --2- 172.21.15.144:0/3370009521 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f722406bfe0 0x7f722406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.015+0000 7f7241600640 1 -- 172.21.15.144:0/3370009521 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f723808a580 con 0x7f7244073390 2024-09-11T23:19:26.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.015+0000 7f7248a00640 1 --2- 172.21.15.144:0/3370009521 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f722406bfe0 0x7f722406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.016+0000 7f7248a00640 1 --2- 172.21.15.144:0/3370009521 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f722406bfe0 0x7f722406e4a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7230034000 tx=0x7f723002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:26.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.019+0000 7f7241600640 1 -- 172.21.15.144:0/3370009521 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7238058ca0 con 0x7f7244073390 2024-09-11T23:19:26.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.231+0000 7f724be00640 1 -- 172.21.15.144:0/3370009521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7244069160 con 0x7f7244073390 2024-09-11T23:19:26.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.232+0000 7f7241600640 1 -- 172.21.15.144:0/3370009521 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5232 (secure 0 0 0) 0x7f72380585a0 con 0x7f7244073390 2024-09-11T23:19:26.232 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:26.232 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":25,"btime":"2024-09-11T23:19:25:826744+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:19:26.232 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 25 2024-09-11T23:19:26.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.234+0000 7f724be00640 1 -- 172.21.15.144:0/3370009521 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f722406bfe0 msgr2=0x7f722406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.234+0000 7f724be00640 1 --2- 172.21.15.144:0/3370009521 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f722406bfe0 0x7f722406e4a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7230034000 tx=0x7f723002e000 comp rx=0 tx=0).stop 2024-09-11T23:19:26.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.234+0000 7f724be00640 1 -- 172.21.15.144:0/3370009521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7244073390 msgr2=0x7f72441f4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.234+0000 7f724be00640 1 --2- 172.21.15.144:0/3370009521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7244073390 0x7f72441f4ca0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f723800c460 tx=0x7f723800c920 comp rx=0 tx=0).stop 2024-09-11T23:19:26.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.234+0000 7f724be00640 1 -- 172.21.15.144:0/3370009521 shutdown_connections 2024-09-11T23:19:26.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.234+0000 7f724be00640 1 --2- 172.21.15.144:0/3370009521 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f722406bfe0 0x7f722406e4a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.234+0000 7f724be00640 1 --2- 172.21.15.144:0/3370009521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f724415e960 0x7f7244156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.234+0000 7f724be00640 1 --2- 172.21.15.144:0/3370009521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72440b4bd0 0x7f7244154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.234+0000 7f724be00640 1 --2- 172.21.15.144:0/3370009521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7244073390 0x7f72441f4ca0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.234+0000 7f724be00640 1 -- 172.21.15.144:0/3370009521 >> 172.21.15.144:0/3370009521 conn(0x7f7244062810 msgr2=0x7f72440b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:26.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.234+0000 7f724be00640 1 -- 172.21.15.144:0/3370009521 shutdown_connections 2024-09-11T23:19:26.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.235+0000 7f724be00640 1 -- 172.21.15.144:0/3370009521 wait complete. 2024-09-11T23:19:26.250 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:19:26.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.403+0000 7f04e3600640 1 Processor -- start 2024-09-11T23:19:26.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.403+0000 7f04e3600640 1 -- start start 2024-09-11T23:19:26.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.404+0000 7f04e3600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f04dc0d02a0 0x7f04dc0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.405+0000 7f04e3600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f04dc15ceb0 0x7f04dc1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.405+0000 7f04e3600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04dc0d0bc0 con 0x7f04dc15ca40 2024-09-11T23:19:26.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.405+0000 7f04e3600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f04dc15d390 con 0x7f04dc15ceb0 2024-09-11T23:19:26.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.405+0000 7f04e3600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f04dc15d670 con 0x7f04dc0d02a0 2024-09-11T23:19:26.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.405+0000 7f04e1600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f04dc15ceb0 0x7f04dc1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.405+0000 7f04e1600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f04dc15ceb0 0x7f04dc1594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37060/0 (socket says 172.21.15.144:37060) 2024-09-11T23:19:26.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.405+0000 7f04e1600640 1 -- 172.21.15.144:0/1787405316 learned_addr learned my addr 172.21.15.144:0/1787405316 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:26.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.405+0000 7f04d3e00640 1 --1- 172.21.15.144:0/1787405316 >> v1:172.21.15.144:6789/0 conn(0x7f04dc15ca40 0x7f04dc15e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34374/0 (socket says 172.21.15.144:34374) 2024-09-11T23:19:26.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.405+0000 7f04e0c00640 1 --2- 172.21.15.144:0/1787405316 >> v2:172.21.15.165:3300/0 conn(0x7f04dc0d02a0 0x7f04dc0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.405+0000 7f04e1600640 1 -- 172.21.15.144:0/1787405316 >> v2:172.21.15.165:3300/0 conn(0x7f04dc0d02a0 msgr2=0x7f04dc0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:26.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.405+0000 7f04e1600640 1 --2- 172.21.15.144:0/1787405316 >> v2:172.21.15.165:3300/0 conn(0x7f04dc0d02a0 0x7f04dc0d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.405+0000 7f04e1600640 1 -- 172.21.15.144:0/1787405316 >> v1:172.21.15.144:6789/0 conn(0x7f04dc15ca40 legacy=0x7f04dc15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.405+0000 7f04e1600640 1 -- 172.21.15.144:0/1787405316 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04dc15d950 con 0x7f04dc15ceb0 2024-09-11T23:19:26.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.405+0000 7f04dbe00640 1 -- 172.21.15.144:0/1787405316 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4229850943 0 0) 0x7f04dc0d0bc0 con 0x7f04dc15ca40 2024-09-11T23:19:26.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.406+0000 7f04e1600640 1 --2- 172.21.15.144:0/1787405316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04dc15ceb0 0x7f04dc1594c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f04dc06f030 tx=0x7f04d402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a6d030b2c2a1ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:26.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.407+0000 7f04dbe00640 1 -- 172.21.15.144:0/1787405316 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d4036070 con 0x7f04dc15ceb0 2024-09-11T23:19:26.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.407+0000 7f04dbe00640 1 -- 172.21.15.144:0/1787405316 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d4031600 con 0x7f04dc15ceb0 2024-09-11T23:19:26.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.407+0000 7f04dbe00640 1 -- 172.21.15.144:0/1787405316 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d40319d0 con 0x7f04dc15ceb0 2024-09-11T23:19:26.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.407+0000 7f04e3600640 1 -- 172.21.15.144:0/1787405316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04dc15ceb0 msgr2=0x7f04dc1594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.407+0000 7f04e3600640 1 --2- 172.21.15.144:0/1787405316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04dc15ceb0 0x7f04dc1594c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f04dc06f030 tx=0x7f04d402a6a0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.407+0000 7f04e3600640 1 -- 172.21.15.144:0/1787405316 shutdown_connections 2024-09-11T23:19:26.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.407+0000 7f04e3600640 1 --2- 172.21.15.144:0/1787405316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04dc15ceb0 0x7f04dc1594c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.407+0000 7f04e3600640 1 --2- 172.21.15.144:0/1787405316 >> v2:172.21.15.165:3300/0 conn(0x7f04dc0d02a0 0x7f04dc0d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.407+0000 7f04e3600640 1 -- 172.21.15.144:0/1787405316 >> 172.21.15.144:0/1787405316 conn(0x7f04dc062cc0 msgr2=0x7f04dc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:26.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.407+0000 7f04e3600640 1 -- 172.21.15.144:0/1787405316 shutdown_connections 2024-09-11T23:19:26.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.407+0000 7f04e3600640 1 -- 172.21.15.144:0/1787405316 wait complete. 2024-09-11T23:19:26.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.409+0000 7f04e3600640 1 Processor -- start 2024-09-11T23:19:26.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.409+0000 7f04e3600640 1 -- start start 2024-09-11T23:19:26.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.410+0000 7f04e3600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04dc0d02a0 0x7f04dc143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.410+0000 7f04e3600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04dc15ca40 0x7f04dc143ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.410+0000 7f04e3600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04dc15ceb0 0x7f04dc13df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.410+0000 7f04e3600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc15eb40 con 0x7f04dc0d02a0 2024-09-11T23:19:26.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.410+0000 7f04e3600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc15df10 con 0x7f04dc15ca40 2024-09-11T23:19:26.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.410+0000 7f04e3600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f04dc155b90 con 0x7f04dc15ceb0 2024-09-11T23:19:26.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.410+0000 7f04e0c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04dc0d02a0 0x7f04dc143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.410+0000 7f04e0c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04dc0d02a0 0x7f04dc143390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37064/0 (socket says 172.21.15.144:37064) 2024-09-11T23:19:26.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.410+0000 7f04e0c00640 1 -- 172.21.15.144:0/2481767929 learned_addr learned my addr 172.21.15.144:0/2481767929 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:26.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.410+0000 7f04e0c00640 1 -- 172.21.15.144:0/2481767929 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04dc15ceb0 msgr2=0x7f04dc13df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.410+0000 7f04e0c00640 1 --2- 172.21.15.144:0/2481767929 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04dc15ceb0 0x7f04dc13df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.410+0000 7f04e0c00640 1 -- 172.21.15.144:0/2481767929 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04dc15ca40 msgr2=0x7f04dc143ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.410+0000 7f04d3e00640 1 --2- 172.21.15.144:0/2481767929 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04dc15ca40 0x7f04dc143ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.410+0000 7f04e0c00640 1 --2- 172.21.15.144:0/2481767929 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04dc15ca40 0x7f04dc143ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.410+0000 7f04e0c00640 1 -- 172.21.15.144:0/2481767929 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04dc15ae20 con 0x7f04dc0d02a0 2024-09-11T23:19:26.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.410+0000 7f04d3e00640 1 --2- 172.21.15.144:0/2481767929 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04dc15ca40 0x7f04dc143ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:26.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.411+0000 7f04e0c00640 1 --2- 172.21.15.144:0/2481767929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04dc0d02a0 0x7f04dc143390 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00e960 tx=0x7f04cc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:26.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.411+0000 7f04d9600640 1 -- 172.21.15.144:0/2481767929 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc017070 con 0x7f04dc0d02a0 2024-09-11T23:19:26.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.411+0000 7f04d9600640 1 -- 172.21.15.144:0/2481767929 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04cc00ca00 con 0x7f04dc0d02a0 2024-09-11T23:19:26.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.411+0000 7f04e3600640 1 -- 172.21.15.144:0/2481767929 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04dc15b100 con 0x7f04dc0d02a0 2024-09-11T23:19:26.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.411+0000 7f04d9600640 1 -- 172.21.15.144:0/2481767929 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc00cdf0 con 0x7f04dc0d02a0 2024-09-11T23:19:26.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.411+0000 7f04e3600640 1 -- 172.21.15.144:0/2481767929 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04dc1419c0 con 0x7f04dc0d02a0 2024-09-11T23:19:26.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.412+0000 7f04e3600640 1 -- 172.21.15.144:0/2481767929 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04dc0b4790 con 0x7f04dc0d02a0 2024-09-11T23:19:26.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.413+0000 7f04d9600640 1 -- 172.21.15.144:0/2481767929 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f04cc01a070 con 0x7f04dc0d02a0 2024-09-11T23:19:26.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.414+0000 7f04d9600640 1 --2- 172.21.15.144:0/2481767929 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f04b806bfe0 0x7f04b806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.414+0000 7f04d9600640 1 -- 172.21.15.144:0/2481767929 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f04cc08b2c0 con 0x7f04dc0d02a0 2024-09-11T23:19:26.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.414+0000 7f04d3e00640 1 --2- 172.21.15.144:0/2481767929 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f04b806bfe0 0x7f04b806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.415+0000 7f04d3e00640 1 --2- 172.21.15.144:0/2481767929 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f04b806bfe0 0x7f04b806e4a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f04dc154000 tx=0x7f04c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:26.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.418+0000 7f04d9600640 1 -- 172.21.15.144:0/2481767929 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f04cc059950 con 0x7f04dc0d02a0 2024-09-11T23:19:26.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.591+0000 7f04e3600640 1 -- 172.21.15.144:0/2481767929 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04dc0d0820 con 0x7f04dc0d02a0 2024-09-11T23:19:26.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.593+0000 7f04d9600640 1 -- 172.21.15.144:0/2481767929 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16697 (secure 0 0 0) 0x7f04cc08b0c0 con 0x7f04dc0d02a0 2024-09-11T23:19:26.593 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:26.593 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":46,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:19:23.814967+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:19:19.995015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-11T23:19:21.218463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:19:26.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.595+0000 7f04e3600640 1 -- 172.21.15.144:0/2481767929 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f04b806bfe0 msgr2=0x7f04b806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.595+0000 7f04e3600640 1 --2- 172.21.15.144:0/2481767929 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f04b806bfe0 0x7f04b806e4a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f04dc154000 tx=0x7f04c4009040 comp rx=0 tx=0).stop 2024-09-11T23:19:26.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.595+0000 7f04e3600640 1 -- 172.21.15.144:0/2481767929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04dc0d02a0 msgr2=0x7f04dc143390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.595+0000 7f04e3600640 1 --2- 172.21.15.144:0/2481767929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04dc0d02a0 0x7f04dc143390 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00e960 tx=0x7f04cc00ee20 comp rx=0 tx=0).stop 2024-09-11T23:19:26.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.595+0000 7f04e3600640 1 -- 172.21.15.144:0/2481767929 shutdown_connections 2024-09-11T23:19:26.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.595+0000 7f04e3600640 1 --2- 172.21.15.144:0/2481767929 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f04b806bfe0 0x7f04b806e4a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.595+0000 7f04e3600640 1 --2- 172.21.15.144:0/2481767929 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04dc15ceb0 0x7f04dc13df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.595+0000 7f04e3600640 1 --2- 172.21.15.144:0/2481767929 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04dc15ca40 0x7f04dc143ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.595+0000 7f04e3600640 1 --2- 172.21.15.144:0/2481767929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04dc0d02a0 0x7f04dc143390 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.595+0000 7f04e3600640 1 -- 172.21.15.144:0/2481767929 >> 172.21.15.144:0/2481767929 conn(0x7f04dc062cc0 msgr2=0x7f04dc154d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:26.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.595+0000 7f04e3600640 1 -- 172.21.15.144:0/2481767929 shutdown_connections 2024-09-11T23:19:26.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.595+0000 7f04e3600640 1 -- 172.21.15.144:0/2481767929 wait complete. 2024-09-11T23:19:26.611 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:19:26.611 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:19:26.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.765+0000 7f7f67e00640 1 Processor -- start 2024-09-11T23:19:26.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.765+0000 7f7f67e00640 1 -- start start 2024-09-11T23:19:26.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.766+0000 7f7f67e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7f6815e640 0x7f7f680d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.766+0000 7f7f67e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7f680d3f60 0x7f7f680b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.766+0000 7f7f67e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f680b6510 0x7f7f680d27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.766+0000 7f7f67e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7f6815ea20 con 0x7f7f6815e640 2024-09-11T23:19:26.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.766+0000 7f7f67e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7f6806caf0 con 0x7f7f680d3f60 2024-09-11T23:19:26.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.766+0000 7f7f67e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7f6806bee0 con 0x7f7f680b6510 2024-09-11T23:19:26.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.767+0000 7f7f66a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7f6815e640 0x7f7f680d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.767+0000 7f7f66a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7f6815e640 0x7f7f680d3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37066/0 (socket says 172.21.15.144:37066) 2024-09-11T23:19:26.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.767+0000 7f7f66a00640 1 -- 172.21.15.144:0/2535496214 learned_addr learned my addr 172.21.15.144:0/2535496214 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:26.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.767+0000 7f7f5e000640 1 --2- 172.21.15.144:0/2535496214 >> v2:172.21.15.165:3300/0 conn(0x7f7f680d3f60 0x7f7f680b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.767+0000 7f7f67400640 1 --2- 172.21.15.144:0/2535496214 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f680b6510 0x7f7f680d27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.767+0000 7f7f66a00640 1 -- 172.21.15.144:0/2535496214 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f680b6510 msgr2=0x7f7f680d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:26.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.767+0000 7f7f66a00640 1 --2- 172.21.15.144:0/2535496214 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f680b6510 0x7f7f680d27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.767+0000 7f7f66a00640 1 -- 172.21.15.144:0/2535496214 >> v2:172.21.15.165:3300/0 conn(0x7f7f680d3f60 msgr2=0x7f7f680b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:26.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.767+0000 7f7f66a00640 1 --2- 172.21.15.144:0/2535496214 >> v2:172.21.15.165:3300/0 conn(0x7f7f680d3f60 0x7f7f680b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.767+0000 7f7f66a00640 1 -- 172.21.15.144:0/2535496214 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6806c1c0 con 0x7f7f6815e640 2024-09-11T23:19:26.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.768+0000 7f7f66a00640 1 --2- 172.21.15.144:0/2535496214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f6815e640 0x7f7f680d3a20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7f680d0fa0 tx=0x7f7f5802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c262076c5a25c118 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:26.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.768+0000 7f7f66000640 1 -- 172.21.15.144:0/2535496214 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58036070 con 0x7f7f6815e640 2024-09-11T23:19:26.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.768+0000 7f7f66000640 1 -- 172.21.15.144:0/2535496214 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f58031600 con 0x7f7f6815e640 2024-09-11T23:19:26.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.768+0000 7f7f66000640 1 -- 172.21.15.144:0/2535496214 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f580319d0 con 0x7f7f6815e640 2024-09-11T23:19:26.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.769+0000 7f7f67e00640 1 -- 172.21.15.144:0/2535496214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f6815e640 msgr2=0x7f7f680d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.769+0000 7f7f67e00640 1 --2- 172.21.15.144:0/2535496214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f6815e640 0x7f7f680d3a20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7f680d0fa0 tx=0x7f7f5802a6a0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.769+0000 7f7f67e00640 1 -- 172.21.15.144:0/2535496214 shutdown_connections 2024-09-11T23:19:26.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.769+0000 7f7f67e00640 1 --2- 172.21.15.144:0/2535496214 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f680b6510 0x7f7f680d27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.769+0000 7f7f67e00640 1 --2- 172.21.15.144:0/2535496214 >> v2:172.21.15.165:3300/0 conn(0x7f7f680d3f60 0x7f7f680b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.769+0000 7f7f67e00640 1 --2- 172.21.15.144:0/2535496214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f6815e640 0x7f7f680d3a20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.769+0000 7f7f67e00640 1 -- 172.21.15.144:0/2535496214 >> 172.21.15.144:0/2535496214 conn(0x7f7f680d0fd0 msgr2=0x7f7f680d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:26.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.769+0000 7f7f67e00640 1 -- 172.21.15.144:0/2535496214 shutdown_connections 2024-09-11T23:19:26.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.769+0000 7f7f67e00640 1 -- 172.21.15.144:0/2535496214 wait complete. 2024-09-11T23:19:26.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.771+0000 7f7f67e00640 1 Processor -- start 2024-09-11T23:19:26.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.771+0000 7f7f67e00640 1 -- start start 2024-09-11T23:19:26.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.772+0000 7f7f67e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f680b6510 0x7f7f68156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.772+0000 7f7f67e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f680d3f60 0x7f7f68154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.772+0000 7f7f67e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f6815e640 0x7f7f68158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.772+0000 7f7f67e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7f680d2d00 con 0x7f7f680d3f60 2024-09-11T23:19:26.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.772+0000 7f7f67e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6806c780 con 0x7f7f680b6510 2024-09-11T23:19:26.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.772+0000 7f7f67e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7f680d2e80 con 0x7f7f6815e640 2024-09-11T23:19:26.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.772+0000 7f7f5e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f680d3f60 0x7f7f68154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.772+0000 7f7f5e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f680d3f60 0x7f7f68154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37080/0 (socket says 172.21.15.144:37080) 2024-09-11T23:19:26.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.772+0000 7f7f5e000640 1 -- 172.21.15.144:0/938323548 learned_addr learned my addr 172.21.15.144:0/938323548 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:26.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.772+0000 7f7f66a00640 1 --2- 172.21.15.144:0/938323548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f680b6510 0x7f7f68156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.772+0000 7f7f67400640 1 --2- 172.21.15.144:0/938323548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f6815e640 0x7f7f68158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.772+0000 7f7f5e000640 1 -- 172.21.15.144:0/938323548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f6815e640 msgr2=0x7f7f68158840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.772+0000 7f7f5e000640 1 --2- 172.21.15.144:0/938323548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f6815e640 0x7f7f68158840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.772+0000 7f7f5e000640 1 -- 172.21.15.144:0/938323548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f680b6510 msgr2=0x7f7f68156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.772+0000 7f7f5e000640 1 --2- 172.21.15.144:0/938323548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f680b6510 0x7f7f68156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.772+0000 7f7f5e000640 1 -- 172.21.15.144:0/938323548 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f681597d0 con 0x7f7f680d3f60 2024-09-11T23:19:26.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.772+0000 7f7f66a00640 1 --2- 172.21.15.144:0/938323548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f680b6510 0x7f7f68156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:26.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.773+0000 7f7f5e000640 1 --2- 172.21.15.144:0/938323548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f680d3f60 0x7f7f68154480 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000e9b0 tx=0x7f7f5000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:26.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.773+0000 7f7f5f400640 1 -- 172.21.15.144:0/938323548 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50017070 con 0x7f7f680d3f60 2024-09-11T23:19:26.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.773+0000 7f7f5f400640 1 -- 172.21.15.144:0/938323548 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f5000c9a0 con 0x7f7f680d3f60 2024-09-11T23:19:26.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.773+0000 7f7f5f400640 1 -- 172.21.15.144:0/938323548 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5000cd90 con 0x7f7f680d3f60 2024-09-11T23:19:26.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.773+0000 7f7f67e00640 1 -- 172.21.15.144:0/938323548 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f68159ab0 con 0x7f7f680d3f60 2024-09-11T23:19:26.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.773+0000 7f7f67e00640 1 -- 172.21.15.144:0/938323548 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f6815a070 con 0x7f7f680d3f60 2024-09-11T23:19:26.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.774+0000 7f7f67e00640 1 -- 172.21.15.144:0/938323548 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f680b5fd0 con 0x7f7f680d3f60 2024-09-11T23:19:26.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.775+0000 7f7f5f400640 1 -- 172.21.15.144:0/938323548 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f7f5001a070 con 0x7f7f680d3f60 2024-09-11T23:19:26.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.776+0000 7f7f5f400640 1 --2- 172.21.15.144:0/938323548 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7f4406bfe0 0x7f7f4406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:26.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.776+0000 7f7f5f400640 1 -- 172.21.15.144:0/938323548 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f7f5008b4b0 con 0x7f7f680d3f60 2024-09-11T23:19:26.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.776+0000 7f7f66a00640 1 --2- 172.21.15.144:0/938323548 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7f4406bfe0 0x7f7f4406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:26.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.777+0000 7f7f66a00640 1 --2- 172.21.15.144:0/938323548 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7f4406bfe0 0x7f7f4406e4a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7f58033000 tx=0x7f7f58009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:26.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.780+0000 7f7f5f400640 1 -- 172.21.15.144:0/938323548 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7f50059bd0 con 0x7f7f680d3f60 2024-09-11T23:19:26.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.952+0000 7f7f67e00640 1 -- 172.21.15.144:0/938323548 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7f681574f0 con 0x7f7f4406bfe0 2024-09-11T23:19:26.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.959+0000 7f7f5f400640 1 -- 172.21.15.144:0/938323548 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251929 (secure 0 0 0) 0x7f7f681574f0 con 0x7f7f4406bfe0 2024-09-11T23:19:26.962 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:26.964 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:19:26.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.963+0000 7f7f67e00640 1 -- 172.21.15.144:0/938323548 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7f4406bfe0 msgr2=0x7f7f4406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.963+0000 7f7f67e00640 1 --2- 172.21.15.144:0/938323548 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7f4406bfe0 0x7f7f4406e4a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7f58033000 tx=0x7f7f58009000 comp rx=0 tx=0).stop 2024-09-11T23:19:26.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.963+0000 7f7f67e00640 1 -- 172.21.15.144:0/938323548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f680d3f60 msgr2=0x7f7f68154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:26.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.963+0000 7f7f67e00640 1 --2- 172.21.15.144:0/938323548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f680d3f60 0x7f7f68154480 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000e9b0 tx=0x7f7f5000ee70 comp rx=0 tx=0).stop 2024-09-11T23:19:26.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.963+0000 7f7f67e00640 1 -- 172.21.15.144:0/938323548 shutdown_connections 2024-09-11T23:19:26.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.963+0000 7f7f67e00640 1 --2- 172.21.15.144:0/938323548 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7f4406bfe0 0x7f7f4406e4a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.963+0000 7f7f67e00640 1 --2- 172.21.15.144:0/938323548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7f6815e640 0x7f7f68158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.963+0000 7f7f67e00640 1 --2- 172.21.15.144:0/938323548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f680d3f60 0x7f7f68154480 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.963+0000 7f7f67e00640 1 --2- 172.21.15.144:0/938323548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f680b6510 0x7f7f68156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:26.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.963+0000 7f7f67e00640 1 -- 172.21.15.144:0/938323548 >> 172.21.15.144:0/938323548 conn(0x7f7f680d0fd0 msgr2=0x7f7f68160bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:26.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.964+0000 7f7f67e00640 1 -- 172.21.15.144:0/938323548 shutdown_connections 2024-09-11T23:19:26.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:26.964+0000 7f7f67e00640 1 -- 172.21.15.144:0/938323548 wait complete. 2024-09-11T23:19:26.979 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-09-11T23:19:25.179992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229848,"kb_used_data":5280,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744872,"statfs":{"total":773094113280,"available":772858748928,"internally_reserved":0,"allocated":5406720,"data_stored":2865247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.382991"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156792+0000","last_change":"2024-09-11T23:19:22.829654+0000","last_active":"2024-09-11T23:19:24.156792+0000","last_peered":"2024-09-11T23:19:24.156792+0000","last_clean":"2024-09-11T23:19:24.156792+0000","last_became_active":"2024-09-11T23:19:22.829393+0000","last_became_peered":"2024-09-11T23:19:22.829393+0000","last_unstale":"2024-09-11T23:19:24.156792+0000","last_undegraded":"2024-09-11T23:19:24.156792+0000","last_fullsized":"2024-09-11T23:19:24.156792+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:01.947903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.824411+0000","last_change":"2024-09-11T23:19:22.844582+0000","last_active":"2024-09-11T23:19:23.824411+0000","last_peered":"2024-09-11T23:19:23.824411+0000","last_clean":"2024-09-11T23:19:23.824411+0000","last_became_active":"2024-09-11T23:19:22.844145+0000","last_became_peered":"2024-09-11T23:19:22.844145+0000","last_unstale":"2024-09-11T23:19:23.824411+0000","last_undegraded":"2024-09-11T23:19:23.824411+0000","last_fullsized":"2024-09-11T23:19:23.824411+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:21.131519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.824282+0000","last_change":"2024-09-11T23:19:22.834727+0000","last_active":"2024-09-11T23:19:23.824282+0000","last_peered":"2024-09-11T23:19:23.824282+0000","last_clean":"2024-09-11T23:19:23.824282+0000","last_became_active":"2024-09-11T23:19:22.833479+0000","last_became_peered":"2024-09-11T23:19:22.833479+0000","last_unstale":"2024-09-11T23:19:23.824282+0000","last_undegraded":"2024-09-11T23:19:23.824282+0000","last_fullsized":"2024-09-11T23:19:23.824282+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:00.048134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.841467+0000","last_change":"2024-09-11T23:19:22.835852+0000","last_active":"2024-09-11T23:19:22.841467+0000","last_peered":"2024-09-11T23:19:22.841467+0000","last_clean":"2024-09-11T23:19:22.841467+0000","last_became_active":"2024-09-11T23:19:22.835138+0000","last_became_peered":"2024-09-11T23:19:22.835138+0000","last_unstale":"2024-09-11T23:19:22.841467+0000","last_undegraded":"2024-09-11T23:19:22.841467+0000","last_fullsized":"2024-09-11T23:19:22.841467+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:06.681636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.824084+0000","last_change":"2024-09-11T23:19:22.836779+0000","last_active":"2024-09-11T23:19:23.824084+0000","last_peered":"2024-09-11T23:19:23.824084+0000","last_clean":"2024-09-11T23:19:23.824084+0000","last_became_active":"2024-09-11T23:19:22.836533+0000","last_became_peered":"2024-09-11T23:19:22.836533+0000","last_unstale":"2024-09-11T23:19:23.824084+0000","last_undegraded":"2024-09-11T23:19:23.824084+0000","last_fullsized":"2024-09-11T23:19:23.824084+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:33.272460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.836999+0000","last_change":"2024-09-11T23:19:22.832113+0000","last_active":"2024-09-11T23:19:22.836999+0000","last_peered":"2024-09-11T23:19:22.836999+0000","last_clean":"2024-09-11T23:19:22.836999+0000","last_became_active":"2024-09-11T23:19:22.831278+0000","last_became_peered":"2024-09-11T23:19:22.831278+0000","last_unstale":"2024-09-11T23:19:22.836999+0000","last_undegraded":"2024-09-11T23:19:22.836999+0000","last_fullsized":"2024-09-11T23:19:22.836999+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:31.341753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156056+0000","last_change":"2024-09-11T23:19:22.825881+0000","last_active":"2024-09-11T23:19:24.156056+0000","last_peered":"2024-09-11T23:19:24.156056+0000","last_clean":"2024-09-11T23:19:24.156056+0000","last_became_active":"2024-09-11T23:19:22.822890+0000","last_became_peered":"2024-09-11T23:19:22.822890+0000","last_unstale":"2024-09-11T23:19:24.156056+0000","last_undegraded":"2024-09-11T23:19:24.156056+0000","last_fullsized":"2024-09-11T23:19:24.156056+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:10.380863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.848151+0000","last_change":"2024-09-11T23:19:22.836061+0000","last_active":"2024-09-11T23:19:22.848151+0000","last_peered":"2024-09-11T23:19:22.848151+0000","last_clean":"2024-09-11T23:19:22.848151+0000","last_became_active":"2024-09-11T23:19:22.833362+0000","last_became_peered":"2024-09-11T23:19:22.833362+0000","last_unstale":"2024-09-11T23:19:22.848151+0000","last_undegraded":"2024-09-11T23:19:22.848151+0000","last_fullsized":"2024-09-11T23:19:22.848151+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:02.312755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.849388+0000","last_change":"2024-09-11T23:19:22.845078+0000","last_active":"2024-09-11T23:19:22.849388+0000","last_peered":"2024-09-11T23:19:22.849388+0000","last_clean":"2024-09-11T23:19:22.849388+0000","last_became_active":"2024-09-11T23:19:22.844785+0000","last_became_peered":"2024-09-11T23:19:22.844785+0000","last_unstale":"2024-09-11T23:19:22.849388+0000","last_undegraded":"2024-09-11T23:19:22.849388+0000","last_fullsized":"2024-09-11T23:19:22.849388+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:06.723140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.848464+0000","last_change":"2024-09-11T23:19:22.844338+0000","last_active":"2024-09-11T23:19:22.848464+0000","last_peered":"2024-09-11T23:19:22.848464+0000","last_clean":"2024-09-11T23:19:22.848464+0000","last_became_active":"2024-09-11T23:19:22.842319+0000","last_became_peered":"2024-09-11T23:19:22.842319+0000","last_unstale":"2024-09-11T23:19:22.848464+0000","last_undegraded":"2024-09-11T23:19:22.848464+0000","last_fullsized":"2024-09-11T23:19:22.848464+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:55.235653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.848814+0000","last_change":"2024-09-11T23:19:22.844528+0000","last_active":"2024-09-11T23:19:22.848814+0000","last_peered":"2024-09-11T23:19:22.848814+0000","last_clean":"2024-09-11T23:19:22.848814+0000","last_became_active":"2024-09-11T23:19:22.842547+0000","last_became_peered":"2024-09-11T23:19:22.842547+0000","last_unstale":"2024-09-11T23:19:22.848814+0000","last_undegraded":"2024-09-11T23:19:22.848814+0000","last_fullsized":"2024-09-11T23:19:22.848814+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:58.708745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.824145+0000","last_change":"2024-09-11T23:19:22.825798+0000","last_active":"2024-09-11T23:19:23.824145+0000","last_peered":"2024-09-11T23:19:23.824145+0000","last_clean":"2024-09-11T23:19:23.824145+0000","last_became_active":"2024-09-11T23:19:22.825521+0000","last_became_peered":"2024-09-11T23:19:22.825521+0000","last_unstale":"2024-09-11T23:19:23.824145+0000","last_undegraded":"2024-09-11T23:19:23.824145+0000","last_fullsized":"2024-09-11T23:19:23.824145+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:48.119705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.840709+0000","last_change":"2024-09-11T23:19:22.834053+0000","last_active":"2024-09-11T23:19:22.840709+0000","last_peered":"2024-09-11T23:19:22.840709+0000","last_clean":"2024-09-11T23:19:22.840709+0000","last_became_active":"2024-09-11T23:19:22.833733+0000","last_became_peered":"2024-09-11T23:19:22.833733+0000","last_unstale":"2024-09-11T23:19:22.840709+0000","last_undegraded":"2024-09-11T23:19:22.840709+0000","last_fullsized":"2024-09-11T23:19:22.840709+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:51.722762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.843516+0000","last_change":"2024-09-11T23:19:22.839762+0000","last_active":"2024-09-11T23:19:22.843516+0000","last_peered":"2024-09-11T23:19:22.843516+0000","last_clean":"2024-09-11T23:19:22.843516+0000","last_became_active":"2024-09-11T23:19:22.837918+0000","last_became_peered":"2024-09-11T23:19:22.837918+0000","last_unstale":"2024-09-11T23:19:22.843516+0000","last_undegraded":"2024-09-11T23:19:22.843516+0000","last_fullsized":"2024-09-11T23:19:22.843516+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:11.137762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.837255+0000","last_change":"2024-09-11T23:19:22.832372+0000","last_active":"2024-09-11T23:19:22.837255+0000","last_peered":"2024-09-11T23:19:22.837255+0000","last_clean":"2024-09-11T23:19:22.837255+0000","last_became_active":"2024-09-11T23:19:22.832129+0000","last_became_peered":"2024-09-11T23:19:22.832129+0000","last_unstale":"2024-09-11T23:19:22.837255+0000","last_undegraded":"2024-09-11T23:19:22.837255+0000","last_fullsized":"2024-09-11T23:19:22.837255+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:39.536267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156969+0000","last_change":"2024-09-11T23:19:22.836214+0000","last_active":"2024-09-11T23:19:24.156969+0000","last_peered":"2024-09-11T23:19:24.156969+0000","last_clean":"2024-09-11T23:19:24.156969+0000","last_became_active":"2024-09-11T23:19:22.835901+0000","last_became_peered":"2024-09-11T23:19:22.835901+0000","last_unstale":"2024-09-11T23:19:24.156969+0000","last_undegraded":"2024-09-11T23:19:24.156969+0000","last_fullsized":"2024-09-11T23:19:24.156969+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:55.235653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.825038+0000","last_change":"2024-09-11T23:19:22.828722+0000","last_active":"2024-09-11T23:19:23.825038+0000","last_peered":"2024-09-11T23:19:23.825038+0000","last_clean":"2024-09-11T23:19:23.825038+0000","last_became_active":"2024-09-11T23:19:22.828438+0000","last_became_peered":"2024-09-11T23:19:22.828438+0000","last_unstale":"2024-09-11T23:19:23.825038+0000","last_undegraded":"2024-09-11T23:19:23.825038+0000","last_fullsized":"2024-09-11T23:19:23.825038+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:24.166241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.824600+0000","last_change":"2024-09-11T23:19:22.844224+0000","last_active":"2024-09-11T23:19:23.824600+0000","last_peered":"2024-09-11T23:19:23.824600+0000","last_clean":"2024-09-11T23:19:23.824600+0000","last_became_active":"2024-09-11T23:19:22.843964+0000","last_became_peered":"2024-09-11T23:19:22.843964+0000","last_unstale":"2024-09-11T23:19:23.824600+0000","last_undegraded":"2024-09-11T23:19:23.824600+0000","last_fullsized":"2024-09-11T23:19:23.824600+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:48.316537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156676+0000","last_change":"2024-09-11T23:19:22.842355+0000","last_active":"2024-09-11T23:19:24.156676+0000","last_peered":"2024-09-11T23:19:24.156676+0000","last_clean":"2024-09-11T23:19:24.156676+0000","last_became_active":"2024-09-11T23:19:22.842007+0000","last_became_peered":"2024-09-11T23:19:22.842007+0000","last_unstale":"2024-09-11T23:19:24.156676+0000","last_undegraded":"2024-09-11T23:19:24.156676+0000","last_fullsized":"2024-09-11T23:19:24.156676+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:54.131817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.840852+0000","last_change":"2024-09-11T23:19:22.837339+0000","last_active":"2024-09-11T23:19:22.840852+0000","last_peered":"2024-09-11T23:19:22.840852+0000","last_clean":"2024-09-11T23:19:22.840852+0000","last_became_active":"2024-09-11T23:19:22.837082+0000","last_became_peered":"2024-09-11T23:19:22.837082+0000","last_unstale":"2024-09-11T23:19:22.840852+0000","last_undegraded":"2024-09-11T23:19:22.840852+0000","last_fullsized":"2024-09-11T23:19:22.840852+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:15.352952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.839291+0000","last_change":"2024-09-11T23:19:22.836841+0000","last_active":"2024-09-11T23:19:22.839291+0000","last_peered":"2024-09-11T23:19:22.839291+0000","last_clean":"2024-09-11T23:19:22.839291+0000","last_became_active":"2024-09-11T23:19:22.836496+0000","last_became_peered":"2024-09-11T23:19:22.836496+0000","last_unstale":"2024-09-11T23:19:22.839291+0000","last_undegraded":"2024-09-11T23:19:22.839291+0000","last_fullsized":"2024-09-11T23:19:22.839291+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:53.861009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.843534+0000","last_change":"2024-09-11T23:19:22.840595+0000","last_active":"2024-09-11T23:19:22.843534+0000","last_peered":"2024-09-11T23:19:22.843534+0000","last_clean":"2024-09-11T23:19:22.843534+0000","last_became_active":"2024-09-11T23:19:22.837591+0000","last_became_peered":"2024-09-11T23:19:22.837591+0000","last_unstale":"2024-09-11T23:19:22.843534+0000","last_undegraded":"2024-09-11T23:19:22.843534+0000","last_fullsized":"2024-09-11T23:19:22.843534+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:23.177222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156694+0000","last_change":"2024-09-11T23:19:22.823477+0000","last_active":"2024-09-11T23:19:24.156694+0000","last_peered":"2024-09-11T23:19:24.156694+0000","last_clean":"2024-09-11T23:19:24.156694+0000","last_became_active":"2024-09-11T23:19:22.823132+0000","last_became_peered":"2024-09-11T23:19:22.823132+0000","last_unstale":"2024-09-11T23:19:24.156694+0000","last_undegraded":"2024-09-11T23:19:24.156694+0000","last_fullsized":"2024-09-11T23:19:24.156694+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:11.137762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156319+0000","last_change":"2024-09-11T23:19:22.820251+0000","last_active":"2024-09-11T23:19:24.156319+0000","last_peered":"2024-09-11T23:19:24.156319+0000","last_clean":"2024-09-11T23:19:24.156319+0000","last_became_active":"2024-09-11T23:19:22.819930+0000","last_became_peered":"2024-09-11T23:19:22.819930+0000","last_unstale":"2024-09-11T23:19:24.156319+0000","last_undegraded":"2024-09-11T23:19:24.156319+0000","last_fullsized":"2024-09-11T23:19:24.156319+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:27:59.178475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.157071+0000","last_change":"2024-09-11T23:19:22.825166+0000","last_active":"2024-09-11T23:19:24.157071+0000","last_peered":"2024-09-11T23:19:24.157071+0000","last_clean":"2024-09-11T23:19:24.157071+0000","last_became_active":"2024-09-11T23:19:22.824894+0000","last_became_peered":"2024-09-11T23:19:22.824894+0000","last_unstale":"2024-09-11T23:19:24.157071+0000","last_undegraded":"2024-09-11T23:19:24.157071+0000","last_fullsized":"2024-09-11T23:19:24.157071+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:20.115770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.843113+0000","last_change":"2024-09-11T23:19:22.839919+0000","last_active":"2024-09-11T23:19:22.843113+0000","last_peered":"2024-09-11T23:19:22.843113+0000","last_clean":"2024-09-11T23:19:22.843113+0000","last_became_active":"2024-09-11T23:19:22.839064+0000","last_became_peered":"2024-09-11T23:19:22.839064+0000","last_unstale":"2024-09-11T23:19:22.843113+0000","last_undegraded":"2024-09-11T23:19:22.843113+0000","last_fullsized":"2024-09-11T23:19:22.843113+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:54.704961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.823889+0000","last_change":"2024-09-11T23:19:22.827706+0000","last_active":"2024-09-11T23:19:23.823889+0000","last_peered":"2024-09-11T23:19:23.823889+0000","last_clean":"2024-09-11T23:19:23.823889+0000","last_became_active":"2024-09-11T23:19:22.827418+0000","last_became_peered":"2024-09-11T23:19:22.827418+0000","last_unstale":"2024-09-11T23:19:23.823889+0000","last_undegraded":"2024-09-11T23:19:23.823889+0000","last_fullsized":"2024-09-11T23:19:23.823889+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:06.723140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.824169+0000","last_change":"2024-09-11T23:19:22.818149+0000","last_active":"2024-09-11T23:19:23.824169+0000","last_peered":"2024-09-11T23:19:23.824169+0000","last_clean":"2024-09-11T23:19:23.824169+0000","last_became_active":"2024-09-11T23:19:22.817878+0000","last_became_peered":"2024-09-11T23:19:22.817878+0000","last_unstale":"2024-09-11T23:19:23.824169+0000","last_undegraded":"2024-09-11T23:19:23.824169+0000","last_fullsized":"2024-09-11T23:19:23.824169+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:09.300654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156836+0000","last_change":"2024-09-11T23:19:22.834251+0000","last_active":"2024-09-11T23:19:24.156836+0000","last_peered":"2024-09-11T23:19:24.156836+0000","last_clean":"2024-09-11T23:19:24.156836+0000","last_became_active":"2024-09-11T23:19:22.833985+0000","last_became_peered":"2024-09-11T23:19:22.833985+0000","last_unstale":"2024-09-11T23:19:24.156836+0000","last_undegraded":"2024-09-11T23:19:24.156836+0000","last_fullsized":"2024-09-11T23:19:24.156836+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:23.177222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.823642+0000","last_change":"2024-09-11T23:19:22.826037+0000","last_active":"2024-09-11T23:19:23.823642+0000","last_peered":"2024-09-11T23:19:23.823642+0000","last_clean":"2024-09-11T23:19:23.823642+0000","last_became_active":"2024-09-11T23:19:22.825763+0000","last_became_peered":"2024-09-11T23:19:22.825763+0000","last_unstale":"2024-09-11T23:19:23.823642+0000","last_undegraded":"2024-09-11T23:19:23.823642+0000","last_fullsized":"2024-09-11T23:19:23.823642+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:20.115770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.836322+0000","last_change":"2024-09-11T23:19:22.829633+0000","last_active":"2024-09-11T23:19:22.836322+0000","last_peered":"2024-09-11T23:19:22.836322+0000","last_clean":"2024-09-11T23:19:22.836322+0000","last_became_active":"2024-09-11T23:19:22.823414+0000","last_became_peered":"2024-09-11T23:19:22.823414+0000","last_unstale":"2024-09-11T23:19:22.836322+0000","last_undegraded":"2024-09-11T23:19:22.836322+0000","last_fullsized":"2024-09-11T23:19:22.836322+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:18.410715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.834297+0000","last_change":"2024-09-11T23:19:22.829523+0000","last_active":"2024-09-11T23:19:22.834297+0000","last_peered":"2024-09-11T23:19:22.834297+0000","last_clean":"2024-09-11T23:19:22.834297+0000","last_became_active":"2024-09-11T23:19:22.829281+0000","last_became_peered":"2024-09-11T23:19:22.829281+0000","last_unstale":"2024-09-11T23:19:22.834297+0000","last_undegraded":"2024-09-11T23:19:22.834297+0000","last_fullsized":"2024-09-11T23:19:22.834297+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:08.576008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.841098+0000","last_change":"2024-09-11T23:19:22.835117+0000","last_active":"2024-09-11T23:19:22.841098+0000","last_peered":"2024-09-11T23:19:22.841098+0000","last_clean":"2024-09-11T23:19:22.841098+0000","last_became_active":"2024-09-11T23:19:22.834836+0000","last_became_peered":"2024-09-11T23:19:22.834836+0000","last_unstale":"2024-09-11T23:19:22.841098+0000","last_undegraded":"2024-09-11T23:19:22.841098+0000","last_fullsized":"2024-09-11T23:19:22.841098+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:55.235653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.841896+0000","last_change":"2024-09-11T23:19:21.832292+0000","last_active":"2024-09-11T23:19:22.841896+0000","last_peered":"2024-09-11T23:19:22.841896+0000","last_clean":"2024-09-11T23:19:22.841896+0000","last_became_active":"2024-09-11T23:19:21.831910+0000","last_became_peered":"2024-09-11T23:19:21.831910+0000","last_unstale":"2024-09-11T23:19:22.841896+0000","last_undegraded":"2024-09-11T23:19:22.841896+0000","last_fullsized":"2024-09-11T23:19:22.841896+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:22.252113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156878+0000","last_change":"2024-09-11T23:19:22.829679+0000","last_active":"2024-09-11T23:19:24.156878+0000","last_peered":"2024-09-11T23:19:24.156878+0000","last_clean":"2024-09-11T23:19:24.156878+0000","last_became_active":"2024-09-11T23:19:22.829423+0000","last_became_peered":"2024-09-11T23:19:22.829423+0000","last_unstale":"2024-09-11T23:19:24.156878+0000","last_undegraded":"2024-09-11T23:19:24.156878+0000","last_fullsized":"2024-09-11T23:19:24.156878+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:41.318922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.825118+0000","last_change":"2024-09-11T23:19:21.826750+0000","last_active":"2024-09-11T23:19:23.825118+0000","last_peered":"2024-09-11T23:19:23.825118+0000","last_clean":"2024-09-11T23:19:23.825118+0000","last_became_active":"2024-09-11T23:19:21.825573+0000","last_became_peered":"2024-09-11T23:19:21.825573+0000","last_unstale":"2024-09-11T23:19:23.825118+0000","last_undegraded":"2024-09-11T23:19:23.825118+0000","last_fullsized":"2024-09-11T23:19:23.825118+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:53.804795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.824274+0000","last_change":"2024-09-11T23:19:22.834294+0000","last_active":"2024-09-11T23:19:23.824274+0000","last_peered":"2024-09-11T23:19:23.824274+0000","last_clean":"2024-09-11T23:19:23.824274+0000","last_became_active":"2024-09-11T23:19:22.834009+0000","last_became_peered":"2024-09-11T23:19:22.834009+0000","last_unstale":"2024-09-11T23:19:23.824274+0000","last_undegraded":"2024-09-11T23:19:23.824274+0000","last_fullsized":"2024-09-11T23:19:23.824274+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:03.116624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.835447+0000","last_change":"2024-09-11T23:19:21.822230+0000","last_active":"2024-09-11T23:19:22.835447+0000","last_peered":"2024-09-11T23:19:22.835447+0000","last_clean":"2024-09-11T23:19:22.835447+0000","last_became_active":"2024-09-11T23:19:21.821981+0000","last_became_peered":"2024-09-11T23:19:21.821981+0000","last_unstale":"2024-09-11T23:19:22.835447+0000","last_undegraded":"2024-09-11T23:19:22.835447+0000","last_fullsized":"2024-09-11T23:19:22.835447+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:10.134917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.830577+0000","last_change":"2024-09-11T23:19:22.822620+0000","last_active":"2024-09-11T23:19:22.830577+0000","last_peered":"2024-09-11T23:19:22.830577+0000","last_clean":"2024-09-11T23:19:22.830577+0000","last_became_active":"2024-09-11T23:19:22.822362+0000","last_became_peered":"2024-09-11T23:19:22.822362+0000","last_unstale":"2024-09-11T23:19:22.830577+0000","last_undegraded":"2024-09-11T23:19:22.830577+0000","last_fullsized":"2024-09-11T23:19:22.830577+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:41.318922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156307+0000","last_change":"2024-09-11T23:19:21.826877+0000","last_active":"2024-09-11T23:19:24.156307+0000","last_peered":"2024-09-11T23:19:24.156307+0000","last_clean":"2024-09-11T23:19:24.156307+0000","last_became_active":"2024-09-11T23:19:21.826568+0000","last_became_peered":"2024-09-11T23:19:21.826568+0000","last_unstale":"2024-09-11T23:19:24.156307+0000","last_undegraded":"2024-09-11T23:19:24.156307+0000","last_fullsized":"2024-09-11T23:19:24.156307+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:32.269615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.823468+0000","last_change":"2024-09-11T23:19:22.832179+0000","last_active":"2024-09-11T23:19:23.823468+0000","last_peered":"2024-09-11T23:19:23.823468+0000","last_clean":"2024-09-11T23:19:23.823468+0000","last_became_active":"2024-09-11T23:19:22.831882+0000","last_became_peered":"2024-09-11T23:19:22.831882+0000","last_unstale":"2024-09-11T23:19:23.823468+0000","last_undegraded":"2024-09-11T23:19:23.823468+0000","last_fullsized":"2024-09-11T23:19:23.823468+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:58.708745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.843251+0000","last_change":"2024-09-11T23:19:21.828883+0000","last_active":"2024-09-11T23:19:22.843251+0000","last_peered":"2024-09-11T23:19:22.843251+0000","last_clean":"2024-09-11T23:19:22.843251+0000","last_became_active":"2024-09-11T23:19:21.828581+0000","last_became_peered":"2024-09-11T23:19:21.828581+0000","last_unstale":"2024-09-11T23:19:22.843251+0000","last_undegraded":"2024-09-11T23:19:22.843251+0000","last_fullsized":"2024-09-11T23:19:22.843251+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:29.494238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.849160+0000","last_change":"2024-09-11T23:19:22.847956+0000","last_active":"2024-09-11T23:19:22.849160+0000","last_peered":"2024-09-11T23:19:22.849160+0000","last_clean":"2024-09-11T23:19:22.849160+0000","last_became_active":"2024-09-11T23:19:22.845042+0000","last_became_peered":"2024-09-11T23:19:22.845042+0000","last_unstale":"2024-09-11T23:19:22.849160+0000","last_undegraded":"2024-09-11T23:19:22.849160+0000","last_fullsized":"2024-09-11T23:19:22.849160+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:48.316537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.824536+0000","last_change":"2024-09-11T23:19:21.818597+0000","last_active":"2024-09-11T23:19:23.824536+0000","last_peered":"2024-09-11T23:19:23.824536+0000","last_clean":"2024-09-11T23:19:23.824536+0000","last_became_active":"2024-09-11T23:19:21.818035+0000","last_became_peered":"2024-09-11T23:19:21.818035+0000","last_unstale":"2024-09-11T23:19:23.824536+0000","last_undegraded":"2024-09-11T23:19:23.824536+0000","last_fullsized":"2024-09-11T23:19:23.824536+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:03.783145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.848130+0000","last_change":"2024-09-11T23:19:22.833068+0000","last_active":"2024-09-11T23:19:22.848130+0000","last_peered":"2024-09-11T23:19:22.848130+0000","last_clean":"2024-09-11T23:19:22.848130+0000","last_became_active":"2024-09-11T23:19:22.832514+0000","last_became_peered":"2024-09-11T23:19:22.832514+0000","last_unstale":"2024-09-11T23:19:22.848130+0000","last_undegraded":"2024-09-11T23:19:22.848130+0000","last_fullsized":"2024-09-11T23:19:22.848130+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:27:59.178475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.823541+0000","last_change":"2024-09-11T23:19:21.822444+0000","last_active":"2024-09-11T23:19:23.823541+0000","last_peered":"2024-09-11T23:19:23.823541+0000","last_clean":"2024-09-11T23:19:23.823541+0000","last_became_active":"2024-09-11T23:19:21.821950+0000","last_became_peered":"2024-09-11T23:19:21.821950+0000","last_unstale":"2024-09-11T23:19:23.823541+0000","last_undegraded":"2024-09-11T23:19:23.823541+0000","last_fullsized":"2024-09-11T23:19:23.823541+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:47.313692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156518+0000","last_change":"2024-09-11T23:19:22.822891+0000","last_active":"2024-09-11T23:19:24.156518+0000","last_peered":"2024-09-11T23:19:24.156518+0000","last_clean":"2024-09-11T23:19:24.156518+0000","last_became_active":"2024-09-11T23:19:22.822634+0000","last_became_peered":"2024-09-11T23:19:22.822634+0000","last_unstale":"2024-09-11T23:19:24.156518+0000","last_undegraded":"2024-09-11T23:19:24.156518+0000","last_fullsized":"2024-09-11T23:19:24.156518+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:06.681636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.815926+0000","last_change":"2024-09-11T23:19:21.832469+0000","last_active":"2024-09-11T23:19:22.815926+0000","last_peered":"2024-09-11T23:19:22.815926+0000","last_clean":"2024-09-11T23:19:22.815926+0000","last_became_active":"2024-09-11T23:19:21.832132+0000","last_became_peered":"2024-09-11T23:19:21.832132+0000","last_unstale":"2024-09-11T23:19:22.815926+0000","last_undegraded":"2024-09-11T23:19:22.815926+0000","last_fullsized":"2024-09-11T23:19:22.815926+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:03.783145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.825105+0000","last_change":"2024-09-11T23:19:22.846114+0000","last_active":"2024-09-11T23:19:23.825105+0000","last_peered":"2024-09-11T23:19:23.825105+0000","last_clean":"2024-09-11T23:19:23.825105+0000","last_became_active":"2024-09-11T23:19:22.845863+0000","last_became_peered":"2024-09-11T23:19:22.845863+0000","last_unstale":"2024-09-11T23:19:23.825105+0000","last_undegraded":"2024-09-11T23:19:23.825105+0000","last_fullsized":"2024-09-11T23:19:23.825105+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:16.638388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.825042+0000","last_change":"2024-09-11T23:19:21.822257+0000","last_active":"2024-09-11T23:19:23.825042+0000","last_peered":"2024-09-11T23:19:23.825042+0000","last_clean":"2024-09-11T23:19:23.825042+0000","last_became_active":"2024-09-11T23:19:21.821645+0000","last_became_peered":"2024-09-11T23:19:21.821645+0000","last_unstale":"2024-09-11T23:19:23.825042+0000","last_undegraded":"2024-09-11T23:19:23.825042+0000","last_fullsized":"2024-09-11T23:19:23.825042+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:47.540311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156880+0000","last_change":"2024-09-11T23:19:22.819043+0000","last_active":"2024-09-11T23:19:24.156880+0000","last_peered":"2024-09-11T23:19:24.156880+0000","last_clean":"2024-09-11T23:19:24.156880+0000","last_became_active":"2024-09-11T23:19:22.818772+0000","last_became_peered":"2024-09-11T23:19:22.818772+0000","last_unstale":"2024-09-11T23:19:24.156880+0000","last_undegraded":"2024-09-11T23:19:24.156880+0000","last_fullsized":"2024-09-11T23:19:24.156880+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:11.762260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.828101+0000","last_change":"2024-09-11T23:19:21.832854+0000","last_active":"2024-09-11T23:19:22.828101+0000","last_peered":"2024-09-11T23:19:22.828101+0000","last_clean":"2024-09-11T23:19:22.828101+0000","last_became_active":"2024-09-11T23:19:21.832601+0000","last_became_peered":"2024-09-11T23:19:21.832601+0000","last_unstale":"2024-09-11T23:19:22.828101+0000","last_undegraded":"2024-09-11T23:19:22.828101+0000","last_fullsized":"2024-09-11T23:19:22.828101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:47.540311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.836797+0000","last_change":"2024-09-11T23:19:22.830488+0000","last_active":"2024-09-11T23:19:22.836797+0000","last_peered":"2024-09-11T23:19:22.836797+0000","last_clean":"2024-09-11T23:19:22.836797+0000","last_became_active":"2024-09-11T23:19:22.830218+0000","last_became_peered":"2024-09-11T23:19:22.830218+0000","last_unstale":"2024-09-11T23:19:22.836797+0000","last_undegraded":"2024-09-11T23:19:22.836797+0000","last_fullsized":"2024-09-11T23:19:22.836797+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:57.632293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.157038+0000","last_change":"2024-09-11T23:19:21.830153+0000","last_active":"2024-09-11T23:19:24.157038+0000","last_peered":"2024-09-11T23:19:24.157038+0000","last_clean":"2024-09-11T23:19:24.157038+0000","last_became_active":"2024-09-11T23:19:21.829536+0000","last_became_peered":"2024-09-11T23:19:21.829536+0000","last_unstale":"2024-09-11T23:19:24.157038+0000","last_undegraded":"2024-09-11T23:19:24.157038+0000","last_fullsized":"2024-09-11T23:19:24.157038+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:47.116860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.157001+0000","last_change":"2024-09-11T23:19:22.824218+0000","last_active":"2024-09-11T23:19:24.157001+0000","last_peered":"2024-09-11T23:19:24.157001+0000","last_clean":"2024-09-11T23:19:24.157001+0000","last_became_active":"2024-09-11T23:19:22.822547+0000","last_became_peered":"2024-09-11T23:19:22.822547+0000","last_unstale":"2024-09-11T23:19:24.157001+0000","last_undegraded":"2024-09-11T23:19:24.157001+0000","last_fullsized":"2024-09-11T23:19:24.157001+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:47.477256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.851407+0000","last_change":"2024-09-11T23:19:21.820994+0000","last_active":"2024-09-11T23:19:22.851407+0000","last_peered":"2024-09-11T23:19:22.851407+0000","last_clean":"2024-09-11T23:19:22.851407+0000","last_became_active":"2024-09-11T23:19:21.818598+0000","last_became_peered":"2024-09-11T23:19:21.818598+0000","last_unstale":"2024-09-11T23:19:22.851407+0000","last_undegraded":"2024-09-11T23:19:22.851407+0000","last_fullsized":"2024-09-11T23:19:22.851407+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:26.669285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156124+0000","last_change":"2024-09-11T23:19:22.832087+0000","last_active":"2024-09-11T23:19:24.156124+0000","last_peered":"2024-09-11T23:19:24.156124+0000","last_clean":"2024-09-11T23:19:24.156124+0000","last_became_active":"2024-09-11T23:19:22.831796+0000","last_became_peered":"2024-09-11T23:19:22.831796+0000","last_unstale":"2024-09-11T23:19:24.156124+0000","last_undegraded":"2024-09-11T23:19:24.156124+0000","last_fullsized":"2024-09-11T23:19:24.156124+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:48.543156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.845977+0000","last_change":"2024-09-11T23:19:21.830911+0000","last_active":"2024-09-11T23:19:22.845977+0000","last_peered":"2024-09-11T23:19:22.845977+0000","last_clean":"2024-09-11T23:19:22.845977+0000","last_became_active":"2024-09-11T23:19:21.830610+0000","last_became_peered":"2024-09-11T23:19:21.830610+0000","last_unstale":"2024-09-11T23:19:22.845977+0000","last_undegraded":"2024-09-11T23:19:22.845977+0000","last_fullsized":"2024-09-11T23:19:22.845977+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:49.448951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.849144+0000","last_change":"2024-09-11T23:19:22.847941+0000","last_active":"2024-09-11T23:19:22.849144+0000","last_peered":"2024-09-11T23:19:22.849144+0000","last_clean":"2024-09-11T23:19:22.849144+0000","last_became_active":"2024-09-11T23:19:22.844989+0000","last_became_peered":"2024-09-11T23:19:22.844989+0000","last_unstale":"2024-09-11T23:19:22.849144+0000","last_undegraded":"2024-09-11T23:19:22.849144+0000","last_fullsized":"2024-09-11T23:19:22.849144+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:00.048134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156093+0000","last_change":"2024-09-11T23:19:21.827803+0000","last_active":"2024-09-11T23:19:24.156093+0000","last_peered":"2024-09-11T23:19:24.156093+0000","last_clean":"2024-09-11T23:19:24.156093+0000","last_became_active":"2024-09-11T23:19:21.827415+0000","last_became_peered":"2024-09-11T23:19:21.827415+0000","last_unstale":"2024-09-11T23:19:24.156093+0000","last_undegraded":"2024-09-11T23:19:24.156093+0000","last_fullsized":"2024-09-11T23:19:24.156093+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:45.435536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.828869+0000","last_change":"2024-09-11T23:19:22.823721+0000","last_active":"2024-09-11T23:19:22.828869+0000","last_peered":"2024-09-11T23:19:22.828869+0000","last_clean":"2024-09-11T23:19:22.828869+0000","last_became_active":"2024-09-11T23:19:22.823456+0000","last_became_peered":"2024-09-11T23:19:22.823456+0000","last_unstale":"2024-09-11T23:19:22.828869+0000","last_undegraded":"2024-09-11T23:19:22.828869+0000","last_fullsized":"2024-09-11T23:19:22.828869+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:59.732274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.823028+0000","last_change":"2024-09-11T23:19:21.830884+0000","last_active":"2024-09-11T23:19:22.823028+0000","last_peered":"2024-09-11T23:19:22.823028+0000","last_clean":"2024-09-11T23:19:22.823028+0000","last_became_active":"2024-09-11T23:19:21.830571+0000","last_became_peered":"2024-09-11T23:19:21.830571+0000","last_unstale":"2024-09-11T23:19:22.823028+0000","last_undegraded":"2024-09-11T23:19:22.823028+0000","last_fullsized":"2024-09-11T23:19:22.823028+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:15.309438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156222+0000","last_change":"2024-09-11T23:19:22.819318+0000","last_active":"2024-09-11T23:19:24.156222+0000","last_peered":"2024-09-11T23:19:24.156222+0000","last_clean":"2024-09-11T23:19:24.156222+0000","last_became_active":"2024-09-11T23:19:22.818984+0000","last_became_peered":"2024-09-11T23:19:22.818984+0000","last_unstale":"2024-09-11T23:19:24.156222+0000","last_undegraded":"2024-09-11T23:19:24.156222+0000","last_fullsized":"2024-09-11T23:19:24.156222+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:30.850180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.850657+0000","last_change":"2024-09-11T23:19:21.829195+0000","last_active":"2024-09-11T23:19:22.850657+0000","last_peered":"2024-09-11T23:19:22.850657+0000","last_clean":"2024-09-11T23:19:22.850657+0000","last_became_active":"2024-09-11T23:19:21.828538+0000","last_became_peered":"2024-09-11T23:19:21.828538+0000","last_unstale":"2024-09-11T23:19:22.850657+0000","last_undegraded":"2024-09-11T23:19:22.850657+0000","last_fullsized":"2024-09-11T23:19:22.850657+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:50.637165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.821122+0000","last_change":"2024-09-11T23:19:22.817947+0000","last_active":"2024-09-11T23:19:22.821122+0000","last_peered":"2024-09-11T23:19:22.821122+0000","last_clean":"2024-09-11T23:19:22.821122+0000","last_became_active":"2024-09-11T23:19:22.817640+0000","last_became_peered":"2024-09-11T23:19:22.817640+0000","last_unstale":"2024-09-11T23:19:22.821122+0000","last_undegraded":"2024-09-11T23:19:22.821122+0000","last_fullsized":"2024-09-11T23:19:22.821122+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:30.273614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.846407+0000","last_change":"2024-09-11T23:19:21.829798+0000","last_active":"2024-09-11T23:19:22.846407+0000","last_peered":"2024-09-11T23:19:22.846407+0000","last_clean":"2024-09-11T23:19:22.846407+0000","last_became_active":"2024-09-11T23:19:21.828075+0000","last_became_peered":"2024-09-11T23:19:21.828075+0000","last_unstale":"2024-09-11T23:19:22.846407+0000","last_undegraded":"2024-09-11T23:19:22.846407+0000","last_fullsized":"2024-09-11T23:19:22.846407+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:25.746133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.848579+0000","last_change":"2024-09-11T23:19:22.842149+0000","last_active":"2024-09-11T23:19:22.848579+0000","last_peered":"2024-09-11T23:19:22.848579+0000","last_clean":"2024-09-11T23:19:22.848579+0000","last_became_active":"2024-09-11T23:19:22.841882+0000","last_became_peered":"2024-09-11T23:19:22.841882+0000","last_unstale":"2024-09-11T23:19:22.848579+0000","last_undegraded":"2024-09-11T23:19:22.848579+0000","last_fullsized":"2024-09-11T23:19:22.848579+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:41.318922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.825218+0000","last_change":"2024-09-11T23:19:21.826467+0000","last_active":"2024-09-11T23:19:23.825218+0000","last_peered":"2024-09-11T23:19:23.825218+0000","last_clean":"2024-09-11T23:19:23.825218+0000","last_became_active":"2024-09-11T23:19:21.826019+0000","last_became_peered":"2024-09-11T23:19:21.826019+0000","last_unstale":"2024-09-11T23:19:23.825218+0000","last_undegraded":"2024-09-11T23:19:23.825218+0000","last_fullsized":"2024-09-11T23:19:23.825218+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:39.212523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156961+0000","last_change":"2024-09-11T23:19:22.831114+0000","last_active":"2024-09-11T23:19:24.156961+0000","last_peered":"2024-09-11T23:19:24.156961+0000","last_clean":"2024-09-11T23:19:24.156961+0000","last_became_active":"2024-09-11T23:19:22.830712+0000","last_became_peered":"2024-09-11T23:19:22.830712+0000","last_unstale":"2024-09-11T23:19:24.156961+0000","last_undegraded":"2024-09-11T23:19:24.156961+0000","last_fullsized":"2024-09-11T23:19:24.156961+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:07.325179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.824412+0000","last_change":"2024-09-11T23:19:21.827215+0000","last_active":"2024-09-11T23:19:23.824412+0000","last_peered":"2024-09-11T23:19:23.824412+0000","last_clean":"2024-09-11T23:19:23.824412+0000","last_became_active":"2024-09-11T23:19:21.826877+0000","last_became_peered":"2024-09-11T23:19:21.826877+0000","last_unstale":"2024-09-11T23:19:23.824412+0000","last_undegraded":"2024-09-11T23:19:23.824412+0000","last_fullsized":"2024-09-11T23:19:23.824412+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:15.635543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156545+0000","last_change":"2024-09-11T23:19:22.828224+0000","last_active":"2024-09-11T23:19:24.156545+0000","last_peered":"2024-09-11T23:19:24.156545+0000","last_clean":"2024-09-11T23:19:24.156545+0000","last_became_active":"2024-09-11T23:19:22.827933+0000","last_became_peered":"2024-09-11T23:19:22.827933+0000","last_unstale":"2024-09-11T23:19:24.156545+0000","last_undegraded":"2024-09-11T23:19:24.156545+0000","last_fullsized":"2024-09-11T23:19:24.156545+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:02.312755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.828347+0000","last_change":"2024-09-11T23:19:21.835655+0000","last_active":"2024-09-11T23:19:22.828347+0000","last_peered":"2024-09-11T23:19:22.828347+0000","last_clean":"2024-09-11T23:19:22.828347+0000","last_became_active":"2024-09-11T23:19:21.835307+0000","last_became_peered":"2024-09-11T23:19:21.835307+0000","last_unstale":"2024-09-11T23:19:22.828347+0000","last_undegraded":"2024-09-11T23:19:22.828347+0000","last_fullsized":"2024-09-11T23:19:22.828347+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:42.801937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.836979+0000","last_change":"2024-09-11T23:19:22.831893+0000","last_active":"2024-09-11T23:19:22.836979+0000","last_peered":"2024-09-11T23:19:22.836979+0000","last_clean":"2024-09-11T23:19:22.836979+0000","last_became_active":"2024-09-11T23:19:22.829993+0000","last_became_peered":"2024-09-11T23:19:22.829993+0000","last_unstale":"2024-09-11T23:19:22.836979+0000","last_undegraded":"2024-09-11T23:19:22.836979+0000","last_fullsized":"2024-09-11T23:19:22.836979+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:45.309519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.843166+0000","last_change":"2024-09-11T23:19:21.835426+0000","last_active":"2024-09-11T23:19:22.843166+0000","last_peered":"2024-09-11T23:19:22.843166+0000","last_clean":"2024-09-11T23:19:22.843166+0000","last_became_active":"2024-09-11T23:19:21.835151+0000","last_became_peered":"2024-09-11T23:19:21.835151+0000","last_unstale":"2024-09-11T23:19:22.843166+0000","last_undegraded":"2024-09-11T23:19:22.843166+0000","last_fullsized":"2024-09-11T23:19:22.843166+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:53.810993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.828944+0000","last_change":"2024-09-11T23:19:22.826776+0000","last_active":"2024-09-11T23:19:22.828944+0000","last_peered":"2024-09-11T23:19:22.828944+0000","last_clean":"2024-09-11T23:19:22.828944+0000","last_became_active":"2024-09-11T23:19:22.826423+0000","last_became_peered":"2024-09-11T23:19:22.826423+0000","last_unstale":"2024-09-11T23:19:22.828944+0000","last_undegraded":"2024-09-11T23:19:22.828944+0000","last_fullsized":"2024-09-11T23:19:22.828944+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:07.325179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.823845+0000","last_change":"2024-09-11T23:19:21.829931+0000","last_active":"2024-09-11T23:19:23.823845+0000","last_peered":"2024-09-11T23:19:23.823845+0000","last_clean":"2024-09-11T23:19:23.823845+0000","last_became_active":"2024-09-11T23:19:21.829638+0000","last_became_peered":"2024-09-11T23:19:21.829638+0000","last_unstale":"2024-09-11T23:19:23.823845+0000","last_undegraded":"2024-09-11T23:19:23.823845+0000","last_fullsized":"2024-09-11T23:19:23.823845+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:23.163396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.826807+0000","last_change":"2024-09-11T23:19:22.820367+0000","last_active":"2024-09-11T23:19:22.826807+0000","last_peered":"2024-09-11T23:19:22.826807+0000","last_clean":"2024-09-11T23:19:22.826807+0000","last_became_active":"2024-09-11T23:19:22.817466+0000","last_became_peered":"2024-09-11T23:19:22.817466+0000","last_unstale":"2024-09-11T23:19:22.826807+0000","last_undegraded":"2024-09-11T23:19:22.826807+0000","last_fullsized":"2024-09-11T23:19:22.826807+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:44.961428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.825128+0000","last_change":"2024-09-11T23:19:21.830995+0000","last_active":"2024-09-11T23:19:22.825128+0000","last_peered":"2024-09-11T23:19:22.825128+0000","last_clean":"2024-09-11T23:19:22.825128+0000","last_became_active":"2024-09-11T23:19:21.830737+0000","last_became_peered":"2024-09-11T23:19:21.830737+0000","last_unstale":"2024-09-11T23:19:22.825128+0000","last_undegraded":"2024-09-11T23:19:22.825128+0000","last_fullsized":"2024-09-11T23:19:22.825128+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:39.212523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.842722+0000","last_change":"2024-09-11T23:19:22.838380+0000","last_active":"2024-09-11T23:19:22.842722+0000","last_peered":"2024-09-11T23:19:22.842722+0000","last_clean":"2024-09-11T23:19:22.842722+0000","last_became_active":"2024-09-11T23:19:22.838008+0000","last_became_peered":"2024-09-11T23:19:22.838008+0000","last_unstale":"2024-09-11T23:19:22.842722+0000","last_undegraded":"2024-09-11T23:19:22.842722+0000","last_fullsized":"2024-09-11T23:19:22.842722+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:54.131817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.155832+0000","last_change":"2024-09-11T23:19:21.822971+0000","last_active":"2024-09-11T23:19:24.155832+0000","last_peered":"2024-09-11T23:19:24.155832+0000","last_clean":"2024-09-11T23:19:24.155832+0000","last_became_active":"2024-09-11T23:19:21.822697+0000","last_became_peered":"2024-09-11T23:19:21.822697+0000","last_unstale":"2024-09-11T23:19:24.155832+0000","last_undegraded":"2024-09-11T23:19:24.155832+0000","last_fullsized":"2024-09-11T23:19:24.155832+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:33.669261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.157043+0000","last_change":"2024-09-11T23:19:22.839762+0000","last_active":"2024-09-11T23:19:24.157043+0000","last_peered":"2024-09-11T23:19:24.157043+0000","last_clean":"2024-09-11T23:19:24.157043+0000","last_became_active":"2024-09-11T23:19:22.839499+0000","last_became_peered":"2024-09-11T23:19:22.839499+0000","last_unstale":"2024-09-11T23:19:24.157043+0000","last_undegraded":"2024-09-11T23:19:24.157043+0000","last_fullsized":"2024-09-11T23:19:24.157043+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:58.708745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.828286+0000","last_change":"2024-09-11T23:19:21.830571+0000","last_active":"2024-09-11T23:19:22.828286+0000","last_peered":"2024-09-11T23:19:22.828286+0000","last_clean":"2024-09-11T23:19:22.828286+0000","last_became_active":"2024-09-11T23:19:21.830308+0000","last_became_peered":"2024-09-11T23:19:21.830308+0000","last_unstale":"2024-09-11T23:19:22.828286+0000","last_undegraded":"2024-09-11T23:19:22.828286+0000","last_fullsized":"2024-09-11T23:19:22.828286+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:17.436432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.849483+0000","last_change":"2024-09-11T23:19:22.844306+0000","last_active":"2024-09-11T23:19:22.849483+0000","last_peered":"2024-09-11T23:19:22.849483+0000","last_clean":"2024-09-11T23:19:22.849483+0000","last_became_active":"2024-09-11T23:19:22.842555+0000","last_became_peered":"2024-09-11T23:19:22.842555+0000","last_unstale":"2024-09-11T23:19:22.849483+0000","last_undegraded":"2024-09-11T23:19:22.849483+0000","last_fullsized":"2024-09-11T23:19:22.849483+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:07.325179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.157104+0000","last_change":"2024-09-11T23:19:21.830420+0000","last_active":"2024-09-11T23:19:24.157104+0000","last_peered":"2024-09-11T23:19:24.157104+0000","last_clean":"2024-09-11T23:19:24.157104+0000","last_became_active":"2024-09-11T23:19:21.829895+0000","last_became_peered":"2024-09-11T23:19:21.829895+0000","last_unstale":"2024-09-11T23:19:24.157104+0000","last_undegraded":"2024-09-11T23:19:24.157104+0000","last_fullsized":"2024-09-11T23:19:24.157104+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:08.297810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156972+0000","last_change":"2024-09-11T23:19:22.822143+0000","last_active":"2024-09-11T23:19:24.156972+0000","last_peered":"2024-09-11T23:19:24.156972+0000","last_clean":"2024-09-11T23:19:24.156972+0000","last_became_active":"2024-09-11T23:19:22.821843+0000","last_became_peered":"2024-09-11T23:19:22.821843+0000","last_unstale":"2024-09-11T23:19:24.156972+0000","last_undegraded":"2024-09-11T23:19:24.156972+0000","last_fullsized":"2024-09-11T23:19:24.156972+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:50.373257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.817765+0000","last_change":"2024-09-11T23:19:21.821139+0000","last_active":"2024-09-11T23:19:22.817765+0000","last_peered":"2024-09-11T23:19:22.817765+0000","last_clean":"2024-09-11T23:19:22.817765+0000","last_became_active":"2024-09-11T23:19:21.820869+0000","last_became_peered":"2024-09-11T23:19:21.820869+0000","last_unstale":"2024-09-11T23:19:22.817765+0000","last_undegraded":"2024-09-11T23:19:22.817765+0000","last_fullsized":"2024-09-11T23:19:22.817765+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:53.128972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.838282+0000","last_change":"2024-09-11T23:19:22.834670+0000","last_active":"2024-09-11T23:19:22.838282+0000","last_peered":"2024-09-11T23:19:22.838282+0000","last_clean":"2024-09-11T23:19:22.838282+0000","last_became_active":"2024-09-11T23:19:22.833296+0000","last_became_peered":"2024-09-11T23:19:22.833296+0000","last_unstale":"2024-09-11T23:19:22.838282+0000","last_undegraded":"2024-09-11T23:19:22.838282+0000","last_fullsized":"2024-09-11T23:19:22.838282+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:07.196019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156403+0000","last_change":"2024-09-11T23:19:21.829755+0000","last_active":"2024-09-11T23:19:24.156403+0000","last_peered":"2024-09-11T23:19:24.156403+0000","last_clean":"2024-09-11T23:19:24.156403+0000","last_became_active":"2024-09-11T23:19:21.829229+0000","last_became_peered":"2024-09-11T23:19:21.829229+0000","last_unstale":"2024-09-11T23:19:24.156403+0000","last_undegraded":"2024-09-11T23:19:24.156403+0000","last_fullsized":"2024-09-11T23:19:24.156403+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:25.307646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.849343+0000","last_change":"2024-09-11T23:19:22.844460+0000","last_active":"2024-09-11T23:19:22.849343+0000","last_peered":"2024-09-11T23:19:22.849343+0000","last_clean":"2024-09-11T23:19:22.849343+0000","last_became_active":"2024-09-11T23:19:22.840886+0000","last_became_peered":"2024-09-11T23:19:22.840886+0000","last_unstale":"2024-09-11T23:19:22.849343+0000","last_undegraded":"2024-09-11T23:19:22.849343+0000","last_fullsized":"2024-09-11T23:19:22.849343+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:29.345760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.823757+0000","last_change":"2024-09-11T23:19:21.836238+0000","last_active":"2024-09-11T23:19:23.823757+0000","last_peered":"2024-09-11T23:19:23.823757+0000","last_clean":"2024-09-11T23:19:23.823757+0000","last_became_active":"2024-09-11T23:19:21.835963+0000","last_became_peered":"2024-09-11T23:19:21.835963+0000","last_unstale":"2024-09-11T23:19:23.823757+0000","last_undegraded":"2024-09-11T23:19:23.823757+0000","last_fullsized":"2024-09-11T23:19:23.823757+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:50.637165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.823258+0000","last_change":"2024-09-11T23:19:22.825041+0000","last_active":"2024-09-11T23:19:23.823258+0000","last_peered":"2024-09-11T23:19:23.823258+0000","last_clean":"2024-09-11T23:19:23.823258+0000","last_became_active":"2024-09-11T23:19:22.823631+0000","last_became_peered":"2024-09-11T23:19:22.823631+0000","last_unstale":"2024-09-11T23:19:23.823258+0000","last_undegraded":"2024-09-11T23:19:23.823258+0000","last_fullsized":"2024-09-11T23:19:23.823258+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:26.310491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.817528+0000","last_change":"2024-09-11T23:19:21.829220+0000","last_active":"2024-09-11T23:19:22.817528+0000","last_peered":"2024-09-11T23:19:22.817528+0000","last_clean":"2024-09-11T23:19:22.817528+0000","last_became_active":"2024-09-11T23:19:21.828979+0000","last_became_peered":"2024-09-11T23:19:21.828979+0000","last_unstale":"2024-09-11T23:19:22.817528+0000","last_undegraded":"2024-09-11T23:19:22.817528+0000","last_fullsized":"2024-09-11T23:19:22.817528+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:01.309910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.823244+0000","last_change":"2024-09-11T23:19:22.830996+0000","last_active":"2024-09-11T23:19:23.823244+0000","last_peered":"2024-09-11T23:19:23.823244+0000","last_clean":"2024-09-11T23:19:23.823244+0000","last_became_active":"2024-09-11T23:19:22.830687+0000","last_became_peered":"2024-09-11T23:19:22.830687+0000","last_unstale":"2024-09-11T23:19:23.823244+0000","last_undegraded":"2024-09-11T23:19:23.823244+0000","last_fullsized":"2024-09-11T23:19:23.823244+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:55.235653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.816207+0000","last_change":"2024-09-11T23:19:21.836026+0000","last_active":"2024-09-11T23:19:22.816207+0000","last_peered":"2024-09-11T23:19:22.816207+0000","last_clean":"2024-09-11T23:19:22.816207+0000","last_became_active":"2024-09-11T23:19:21.835605+0000","last_became_peered":"2024-09-11T23:19:21.835605+0000","last_unstale":"2024-09-11T23:19:22.816207+0000","last_undegraded":"2024-09-11T23:19:22.816207+0000","last_fullsized":"2024-09-11T23:19:22.816207+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:53.804795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.848904+0000","last_change":"2024-09-11T23:19:22.844760+0000","last_active":"2024-09-11T23:19:22.848904+0000","last_peered":"2024-09-11T23:19:22.848904+0000","last_clean":"2024-09-11T23:19:22.848904+0000","last_became_active":"2024-09-11T23:19:22.844453+0000","last_became_peered":"2024-09-11T23:19:22.844453+0000","last_unstale":"2024-09-11T23:19:22.848904+0000","last_undegraded":"2024-09-11T23:19:22.848904+0000","last_fullsized":"2024-09-11T23:19:22.848904+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:20.115770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.824693+0000","last_change":"2024-09-11T23:19:21.828258+0000","last_active":"2024-09-11T23:19:23.824693+0000","last_peered":"2024-09-11T23:19:23.824693+0000","last_clean":"2024-09-11T23:19:23.824693+0000","last_became_active":"2024-09-11T23:19:21.827950+0000","last_became_peered":"2024-09-11T23:19:21.827950+0000","last_unstale":"2024-09-11T23:19:23.824693+0000","last_undegraded":"2024-09-11T23:19:23.824693+0000","last_fullsized":"2024-09-11T23:19:23.824693+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:17.532109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":213,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.155757+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:19:24.155757+0000","last_peered":"2024-09-11T23:19:24.155757+0000","last_clean":"2024-09-11T23:19:24.155757+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:19:24.155757+0000","last_undegraded":"2024-09-11T23:19:24.155757+0000","last_fullsized":"2024-09-11T23:19:24.155757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476760,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1126400,"data_stored":804496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476759,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":214710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476758,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":532480,"data_stored":214108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476758,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":540672,"data_stored":215650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31704,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":520192,"data_stored":207808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1114112,"data_stored":798140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":503808,"data_stored":200963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":532480,"data_stored":209372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:19:26.983 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:19:27.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.171+0000 7f2845600640 1 Processor -- start 2024-09-11T23:19:27.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.172+0000 7f2845600640 1 -- start start 2024-09-11T23:19:27.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.173+0000 7f2845600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f28400d02a0 0x7f28400d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.173+0000 7f2845600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f284015ca40 0x7f284015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.173+0000 7f2845600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f284015ceb0 0x7f28401594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.173+0000 7f2845600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f28400d0bc0 con 0x7f284015ca40 2024-09-11T23:19:27.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.173+0000 7f2845600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f284015d390 con 0x7f28400d02a0 2024-09-11T23:19:27.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.173+0000 7f2845600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f284015d670 con 0x7f284015ceb0 2024-09-11T23:19:27.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.173+0000 7f2836000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f284015ca40 0x7f284015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.173+0000 7f2836000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f284015ca40 0x7f284015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37088/0 (socket says 172.21.15.144:37088) 2024-09-11T23:19:27.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.173+0000 7f2836000640 1 -- 172.21.15.144:0/4091218410 learned_addr learned my addr 172.21.15.144:0/4091218410 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:27.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.173+0000 7f283f400640 1 --2- 172.21.15.144:0/4091218410 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f284015ceb0 0x7f28401594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.173+0000 7f2836000640 1 -- 172.21.15.144:0/4091218410 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f284015ceb0 msgr2=0x7f28401594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:27.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.173+0000 7f283ea00640 1 --2- 172.21.15.144:0/4091218410 >> v2:172.21.15.165:3300/0 conn(0x7f28400d02a0 0x7f28400d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.173+0000 7f2836000640 1 --2- 172.21.15.144:0/4091218410 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f284015ceb0 0x7f28401594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.174+0000 7f2836000640 1 -- 172.21.15.144:0/4091218410 >> v2:172.21.15.165:3300/0 conn(0x7f28400d02a0 msgr2=0x7f28400d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:27.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.174+0000 7f2836000640 1 --2- 172.21.15.144:0/4091218410 >> v2:172.21.15.165:3300/0 conn(0x7f28400d02a0 0x7f28400d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.174+0000 7f2836000640 1 -- 172.21.15.144:0/4091218410 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284015d950 con 0x7f284015ca40 2024-09-11T23:19:27.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.174+0000 7f283f400640 1 --2- 172.21.15.144:0/4091218410 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f284015ceb0 0x7f28401594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:27.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.174+0000 7f283ea00640 1 --2- 172.21.15.144:0/4091218410 >> v2:172.21.15.165:3300/0 conn(0x7f28400d02a0 0x7f28400d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:27.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.175+0000 7f2836000640 1 --2- 172.21.15.144:0/4091218410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f284015ca40 0x7f284015e430 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f284006f030 tx=0x7f282802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23f133a2d14f061 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:27.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.175+0000 7f283e000640 1 -- 172.21.15.144:0/4091218410 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2828037070 con 0x7f284015ca40 2024-09-11T23:19:27.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.175+0000 7f283e000640 1 -- 172.21.15.144:0/4091218410 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2828032440 con 0x7f284015ca40 2024-09-11T23:19:27.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.175+0000 7f283e000640 1 -- 172.21.15.144:0/4091218410 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2828032810 con 0x7f284015ca40 2024-09-11T23:19:27.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.175+0000 7f2845600640 1 -- 172.21.15.144:0/4091218410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f284015ca40 msgr2=0x7f284015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:27.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.175+0000 7f2845600640 1 --2- 172.21.15.144:0/4091218410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f284015ca40 0x7f284015e430 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f284006f030 tx=0x7f282802a140 comp rx=0 tx=0).stop 2024-09-11T23:19:27.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.176+0000 7f2845600640 1 -- 172.21.15.144:0/4091218410 shutdown_connections 2024-09-11T23:19:27.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.176+0000 7f2845600640 1 --2- 172.21.15.144:0/4091218410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f284015ca40 0x7f284015e430 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.176+0000 7f2845600640 1 --2- 172.21.15.144:0/4091218410 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f284015ceb0 0x7f28401594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.176+0000 7f2845600640 1 --2- 172.21.15.144:0/4091218410 >> v2:172.21.15.165:3300/0 conn(0x7f28400d02a0 0x7f28400d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.176+0000 7f2845600640 1 -- 172.21.15.144:0/4091218410 >> 172.21.15.144:0/4091218410 conn(0x7f2840062cc0 msgr2=0x7f284006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:27.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.176+0000 7f2845600640 1 -- 172.21.15.144:0/4091218410 shutdown_connections 2024-09-11T23:19:27.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.176+0000 7f2845600640 1 -- 172.21.15.144:0/4091218410 wait complete. 2024-09-11T23:19:27.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.177+0000 7f2845600640 1 Processor -- start 2024-09-11T23:19:27.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.177+0000 7f2845600640 1 -- start start 2024-09-11T23:19:27.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.178+0000 7f2845600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28400d02a0 0x7f28401503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.178+0000 7f2845600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f284015ca40 0x7f28400ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.178+0000 7f2845600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f284015ceb0 0x7f28400aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.178+0000 7f2845600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2840155b90 con 0x7f284015ca40 2024-09-11T23:19:27.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.178+0000 7f2845600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f284015df10 con 0x7f284015ceb0 2024-09-11T23:19:27.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.178+0000 7f2845600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2840155d10 con 0x7f28400d02a0 2024-09-11T23:19:27.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.178+0000 7f2836000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f284015ca40 0x7f28400ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.179+0000 7f2836000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f284015ca40 0x7f28400ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37094/0 (socket says 172.21.15.144:37094) 2024-09-11T23:19:27.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.179+0000 7f2836000640 1 -- 172.21.15.144:0/3321390577 learned_addr learned my addr 172.21.15.144:0/3321390577 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:27.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.179+0000 7f283ea00640 1 --2- 172.21.15.144:0/3321390577 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28400d02a0 0x7f28401503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.179+0000 7f283f400640 1 --2- 172.21.15.144:0/3321390577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f284015ceb0 0x7f28400aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.179+0000 7f2836000640 1 -- 172.21.15.144:0/3321390577 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28400d02a0 msgr2=0x7f28401503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:27.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.179+0000 7f2836000640 1 --2- 172.21.15.144:0/3321390577 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28400d02a0 0x7f28401503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.179+0000 7f2836000640 1 -- 172.21.15.144:0/3321390577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f284015ceb0 msgr2=0x7f28400aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:27.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.179+0000 7f2836000640 1 --2- 172.21.15.144:0/3321390577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f284015ceb0 0x7f28400aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.179+0000 7f2836000640 1 -- 172.21.15.144:0/3321390577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28401563b0 con 0x7f284015ca40 2024-09-11T23:19:27.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.179+0000 7f2836000640 1 --2- 172.21.15.144:0/3321390577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f284015ca40 0x7f28400ae8e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f282802a180 tx=0x7f28280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:27.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.180+0000 7f2837400640 1 -- 172.21.15.144:0/3321390577 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2828037040 con 0x7f284015ca40 2024-09-11T23:19:27.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.180+0000 7f2837400640 1 -- 172.21.15.144:0/3321390577 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2828042070 con 0x7f284015ca40 2024-09-11T23:19:27.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.180+0000 7f2845600640 1 -- 172.21.15.144:0/3321390577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2840156690 con 0x7f284015ca40 2024-09-11T23:19:27.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.180+0000 7f2837400640 1 -- 172.21.15.144:0/3321390577 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2828030bb0 con 0x7f284015ca40 2024-09-11T23:19:27.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.180+0000 7f2845600640 1 -- 172.21.15.144:0/3321390577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2840156c50 con 0x7f284015ca40 2024-09-11T23:19:27.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.181+0000 7f2845600640 1 -- 172.21.15.144:0/3321390577 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28400b4790 con 0x7f284015ca40 2024-09-11T23:19:27.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.182+0000 7f2837400640 1 -- 172.21.15.144:0/3321390577 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f2828047460 con 0x7f284015ca40 2024-09-11T23:19:27.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.183+0000 7f2837400640 1 --2- 172.21.15.144:0/3321390577 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f281c06bfe0 0x7f281c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.183+0000 7f2837400640 1 -- 172.21.15.144:0/3321390577 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f28280abba0 con 0x7f284015ca40 2024-09-11T23:19:27.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.183+0000 7f283ea00640 1 --2- 172.21.15.144:0/3321390577 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f281c06bfe0 0x7f281c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.184+0000 7f283ea00640 1 --2- 172.21.15.144:0/3321390577 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f281c06bfe0 0x7f281c06e4a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2840158170 tx=0x7f2830008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:27.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.187+0000 7f2837400640 1 -- 172.21.15.144:0/3321390577 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2828079d10 con 0x7f284015ca40 2024-09-11T23:19:27.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.360+0000 7f2845600640 1 -- 172.21.15.144:0/3321390577 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2840156fa0 con 0x7f281c06bfe0 2024-09-11T23:19:27.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.367+0000 7f2837400640 1 -- 172.21.15.144:0/3321390577 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251929 (secure 0 0 0) 0x7f2840156fa0 con 0x7f281c06bfe0 2024-09-11T23:19:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:27.371 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:19:27.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.371+0000 7f2845600640 1 -- 172.21.15.144:0/3321390577 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f281c06bfe0 msgr2=0x7f281c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:27.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.371+0000 7f2845600640 1 --2- 172.21.15.144:0/3321390577 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f281c06bfe0 0x7f281c06e4a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2840158170 tx=0x7f2830008040 comp rx=0 tx=0).stop 2024-09-11T23:19:27.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.371+0000 7f2845600640 1 -- 172.21.15.144:0/3321390577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f284015ca40 msgr2=0x7f28400ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:27.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.371+0000 7f2845600640 1 --2- 172.21.15.144:0/3321390577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f284015ca40 0x7f28400ae8e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f282802a180 tx=0x7f28280046c0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.371+0000 7f2845600640 1 -- 172.21.15.144:0/3321390577 shutdown_connections 2024-09-11T23:19:27.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.371+0000 7f2845600640 1 --2- 172.21.15.144:0/3321390577 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f281c06bfe0 0x7f281c06e4a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.371+0000 7f2845600640 1 --2- 172.21.15.144:0/3321390577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f284015ceb0 0x7f28400aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.371+0000 7f2845600640 1 --2- 172.21.15.144:0/3321390577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f284015ca40 0x7f28400ae8e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.371+0000 7f2845600640 1 --2- 172.21.15.144:0/3321390577 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28400d02a0 0x7f28401503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.371+0000 7f2845600640 1 -- 172.21.15.144:0/3321390577 >> 172.21.15.144:0/3321390577 conn(0x7f2840062cc0 msgr2=0x7f2840154e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:27.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.371+0000 7f2845600640 1 -- 172.21.15.144:0/3321390577 shutdown_connections 2024-09-11T23:19:27.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.371+0000 7f2845600640 1 -- 172.21.15.144:0/3321390577 wait complete. 2024-09-11T23:19:27.387 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-09-11T23:19:27.180363+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229848,"kb_used_data":5280,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744872,"statfs":{"total":773094113280,"available":772858748928,"internally_reserved":0,"allocated":5406720,"data_stored":2865247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001100"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156792+0000","last_change":"2024-09-11T23:19:22.829654+0000","last_active":"2024-09-11T23:19:24.156792+0000","last_peered":"2024-09-11T23:19:24.156792+0000","last_clean":"2024-09-11T23:19:24.156792+0000","last_became_active":"2024-09-11T23:19:22.829393+0000","last_became_peered":"2024-09-11T23:19:22.829393+0000","last_unstale":"2024-09-11T23:19:24.156792+0000","last_undegraded":"2024-09-11T23:19:24.156792+0000","last_fullsized":"2024-09-11T23:19:24.156792+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:01.947903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.824411+0000","last_change":"2024-09-11T23:19:22.844582+0000","last_active":"2024-09-11T23:19:23.824411+0000","last_peered":"2024-09-11T23:19:23.824411+0000","last_clean":"2024-09-11T23:19:23.824411+0000","last_became_active":"2024-09-11T23:19:22.844145+0000","last_became_peered":"2024-09-11T23:19:22.844145+0000","last_unstale":"2024-09-11T23:19:23.824411+0000","last_undegraded":"2024-09-11T23:19:23.824411+0000","last_fullsized":"2024-09-11T23:19:23.824411+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:21.131519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.824282+0000","last_change":"2024-09-11T23:19:22.834727+0000","last_active":"2024-09-11T23:19:23.824282+0000","last_peered":"2024-09-11T23:19:23.824282+0000","last_clean":"2024-09-11T23:19:23.824282+0000","last_became_active":"2024-09-11T23:19:22.833479+0000","last_became_peered":"2024-09-11T23:19:22.833479+0000","last_unstale":"2024-09-11T23:19:23.824282+0000","last_undegraded":"2024-09-11T23:19:23.824282+0000","last_fullsized":"2024-09-11T23:19:23.824282+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:00.048134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.841467+0000","last_change":"2024-09-11T23:19:22.835852+0000","last_active":"2024-09-11T23:19:22.841467+0000","last_peered":"2024-09-11T23:19:22.841467+0000","last_clean":"2024-09-11T23:19:22.841467+0000","last_became_active":"2024-09-11T23:19:22.835138+0000","last_became_peered":"2024-09-11T23:19:22.835138+0000","last_unstale":"2024-09-11T23:19:22.841467+0000","last_undegraded":"2024-09-11T23:19:22.841467+0000","last_fullsized":"2024-09-11T23:19:22.841467+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:06.681636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.824084+0000","last_change":"2024-09-11T23:19:22.836779+0000","last_active":"2024-09-11T23:19:23.824084+0000","last_peered":"2024-09-11T23:19:23.824084+0000","last_clean":"2024-09-11T23:19:23.824084+0000","last_became_active":"2024-09-11T23:19:22.836533+0000","last_became_peered":"2024-09-11T23:19:22.836533+0000","last_unstale":"2024-09-11T23:19:23.824084+0000","last_undegraded":"2024-09-11T23:19:23.824084+0000","last_fullsized":"2024-09-11T23:19:23.824084+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:33.272460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.836999+0000","last_change":"2024-09-11T23:19:22.832113+0000","last_active":"2024-09-11T23:19:22.836999+0000","last_peered":"2024-09-11T23:19:22.836999+0000","last_clean":"2024-09-11T23:19:22.836999+0000","last_became_active":"2024-09-11T23:19:22.831278+0000","last_became_peered":"2024-09-11T23:19:22.831278+0000","last_unstale":"2024-09-11T23:19:22.836999+0000","last_undegraded":"2024-09-11T23:19:22.836999+0000","last_fullsized":"2024-09-11T23:19:22.836999+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:31.341753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156056+0000","last_change":"2024-09-11T23:19:22.825881+0000","last_active":"2024-09-11T23:19:24.156056+0000","last_peered":"2024-09-11T23:19:24.156056+0000","last_clean":"2024-09-11T23:19:24.156056+0000","last_became_active":"2024-09-11T23:19:22.822890+0000","last_became_peered":"2024-09-11T23:19:22.822890+0000","last_unstale":"2024-09-11T23:19:24.156056+0000","last_undegraded":"2024-09-11T23:19:24.156056+0000","last_fullsized":"2024-09-11T23:19:24.156056+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:10.380863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.848151+0000","last_change":"2024-09-11T23:19:22.836061+0000","last_active":"2024-09-11T23:19:22.848151+0000","last_peered":"2024-09-11T23:19:22.848151+0000","last_clean":"2024-09-11T23:19:22.848151+0000","last_became_active":"2024-09-11T23:19:22.833362+0000","last_became_peered":"2024-09-11T23:19:22.833362+0000","last_unstale":"2024-09-11T23:19:22.848151+0000","last_undegraded":"2024-09-11T23:19:22.848151+0000","last_fullsized":"2024-09-11T23:19:22.848151+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:02.312755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.849388+0000","last_change":"2024-09-11T23:19:22.845078+0000","last_active":"2024-09-11T23:19:22.849388+0000","last_peered":"2024-09-11T23:19:22.849388+0000","last_clean":"2024-09-11T23:19:22.849388+0000","last_became_active":"2024-09-11T23:19:22.844785+0000","last_became_peered":"2024-09-11T23:19:22.844785+0000","last_unstale":"2024-09-11T23:19:22.849388+0000","last_undegraded":"2024-09-11T23:19:22.849388+0000","last_fullsized":"2024-09-11T23:19:22.849388+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:06.723140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.848464+0000","last_change":"2024-09-11T23:19:22.844338+0000","last_active":"2024-09-11T23:19:22.848464+0000","last_peered":"2024-09-11T23:19:22.848464+0000","last_clean":"2024-09-11T23:19:22.848464+0000","last_became_active":"2024-09-11T23:19:22.842319+0000","last_became_peered":"2024-09-11T23:19:22.842319+0000","last_unstale":"2024-09-11T23:19:22.848464+0000","last_undegraded":"2024-09-11T23:19:22.848464+0000","last_fullsized":"2024-09-11T23:19:22.848464+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:55.235653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.848814+0000","last_change":"2024-09-11T23:19:22.844528+0000","last_active":"2024-09-11T23:19:22.848814+0000","last_peered":"2024-09-11T23:19:22.848814+0000","last_clean":"2024-09-11T23:19:22.848814+0000","last_became_active":"2024-09-11T23:19:22.842547+0000","last_became_peered":"2024-09-11T23:19:22.842547+0000","last_unstale":"2024-09-11T23:19:22.848814+0000","last_undegraded":"2024-09-11T23:19:22.848814+0000","last_fullsized":"2024-09-11T23:19:22.848814+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:58.708745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.824145+0000","last_change":"2024-09-11T23:19:22.825798+0000","last_active":"2024-09-11T23:19:23.824145+0000","last_peered":"2024-09-11T23:19:23.824145+0000","last_clean":"2024-09-11T23:19:23.824145+0000","last_became_active":"2024-09-11T23:19:22.825521+0000","last_became_peered":"2024-09-11T23:19:22.825521+0000","last_unstale":"2024-09-11T23:19:23.824145+0000","last_undegraded":"2024-09-11T23:19:23.824145+0000","last_fullsized":"2024-09-11T23:19:23.824145+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:48.119705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.840709+0000","last_change":"2024-09-11T23:19:22.834053+0000","last_active":"2024-09-11T23:19:22.840709+0000","last_peered":"2024-09-11T23:19:22.840709+0000","last_clean":"2024-09-11T23:19:22.840709+0000","last_became_active":"2024-09-11T23:19:22.833733+0000","last_became_peered":"2024-09-11T23:19:22.833733+0000","last_unstale":"2024-09-11T23:19:22.840709+0000","last_undegraded":"2024-09-11T23:19:22.840709+0000","last_fullsized":"2024-09-11T23:19:22.840709+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:51.722762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.843516+0000","last_change":"2024-09-11T23:19:22.839762+0000","last_active":"2024-09-11T23:19:22.843516+0000","last_peered":"2024-09-11T23:19:22.843516+0000","last_clean":"2024-09-11T23:19:22.843516+0000","last_became_active":"2024-09-11T23:19:22.837918+0000","last_became_peered":"2024-09-11T23:19:22.837918+0000","last_unstale":"2024-09-11T23:19:22.843516+0000","last_undegraded":"2024-09-11T23:19:22.843516+0000","last_fullsized":"2024-09-11T23:19:22.843516+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:11.137762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.837255+0000","last_change":"2024-09-11T23:19:22.832372+0000","last_active":"2024-09-11T23:19:22.837255+0000","last_peered":"2024-09-11T23:19:22.837255+0000","last_clean":"2024-09-11T23:19:22.837255+0000","last_became_active":"2024-09-11T23:19:22.832129+0000","last_became_peered":"2024-09-11T23:19:22.832129+0000","last_unstale":"2024-09-11T23:19:22.837255+0000","last_undegraded":"2024-09-11T23:19:22.837255+0000","last_fullsized":"2024-09-11T23:19:22.837255+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:39.536267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156969+0000","last_change":"2024-09-11T23:19:22.836214+0000","last_active":"2024-09-11T23:19:24.156969+0000","last_peered":"2024-09-11T23:19:24.156969+0000","last_clean":"2024-09-11T23:19:24.156969+0000","last_became_active":"2024-09-11T23:19:22.835901+0000","last_became_peered":"2024-09-11T23:19:22.835901+0000","last_unstale":"2024-09-11T23:19:24.156969+0000","last_undegraded":"2024-09-11T23:19:24.156969+0000","last_fullsized":"2024-09-11T23:19:24.156969+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:55.235653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.825038+0000","last_change":"2024-09-11T23:19:22.828722+0000","last_active":"2024-09-11T23:19:23.825038+0000","last_peered":"2024-09-11T23:19:23.825038+0000","last_clean":"2024-09-11T23:19:23.825038+0000","last_became_active":"2024-09-11T23:19:22.828438+0000","last_became_peered":"2024-09-11T23:19:22.828438+0000","last_unstale":"2024-09-11T23:19:23.825038+0000","last_undegraded":"2024-09-11T23:19:23.825038+0000","last_fullsized":"2024-09-11T23:19:23.825038+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:24.166241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.824600+0000","last_change":"2024-09-11T23:19:22.844224+0000","last_active":"2024-09-11T23:19:23.824600+0000","last_peered":"2024-09-11T23:19:23.824600+0000","last_clean":"2024-09-11T23:19:23.824600+0000","last_became_active":"2024-09-11T23:19:22.843964+0000","last_became_peered":"2024-09-11T23:19:22.843964+0000","last_unstale":"2024-09-11T23:19:23.824600+0000","last_undegraded":"2024-09-11T23:19:23.824600+0000","last_fullsized":"2024-09-11T23:19:23.824600+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:48.316537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156676+0000","last_change":"2024-09-11T23:19:22.842355+0000","last_active":"2024-09-11T23:19:24.156676+0000","last_peered":"2024-09-11T23:19:24.156676+0000","last_clean":"2024-09-11T23:19:24.156676+0000","last_became_active":"2024-09-11T23:19:22.842007+0000","last_became_peered":"2024-09-11T23:19:22.842007+0000","last_unstale":"2024-09-11T23:19:24.156676+0000","last_undegraded":"2024-09-11T23:19:24.156676+0000","last_fullsized":"2024-09-11T23:19:24.156676+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:54.131817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.840852+0000","last_change":"2024-09-11T23:19:22.837339+0000","last_active":"2024-09-11T23:19:22.840852+0000","last_peered":"2024-09-11T23:19:22.840852+0000","last_clean":"2024-09-11T23:19:22.840852+0000","last_became_active":"2024-09-11T23:19:22.837082+0000","last_became_peered":"2024-09-11T23:19:22.837082+0000","last_unstale":"2024-09-11T23:19:22.840852+0000","last_undegraded":"2024-09-11T23:19:22.840852+0000","last_fullsized":"2024-09-11T23:19:22.840852+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:15.352952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.839291+0000","last_change":"2024-09-11T23:19:22.836841+0000","last_active":"2024-09-11T23:19:22.839291+0000","last_peered":"2024-09-11T23:19:22.839291+0000","last_clean":"2024-09-11T23:19:22.839291+0000","last_became_active":"2024-09-11T23:19:22.836496+0000","last_became_peered":"2024-09-11T23:19:22.836496+0000","last_unstale":"2024-09-11T23:19:22.839291+0000","last_undegraded":"2024-09-11T23:19:22.839291+0000","last_fullsized":"2024-09-11T23:19:22.839291+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:53.861009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.843534+0000","last_change":"2024-09-11T23:19:22.840595+0000","last_active":"2024-09-11T23:19:22.843534+0000","last_peered":"2024-09-11T23:19:22.843534+0000","last_clean":"2024-09-11T23:19:22.843534+0000","last_became_active":"2024-09-11T23:19:22.837591+0000","last_became_peered":"2024-09-11T23:19:22.837591+0000","last_unstale":"2024-09-11T23:19:22.843534+0000","last_undegraded":"2024-09-11T23:19:22.843534+0000","last_fullsized":"2024-09-11T23:19:22.843534+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:23.177222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156694+0000","last_change":"2024-09-11T23:19:22.823477+0000","last_active":"2024-09-11T23:19:24.156694+0000","last_peered":"2024-09-11T23:19:24.156694+0000","last_clean":"2024-09-11T23:19:24.156694+0000","last_became_active":"2024-09-11T23:19:22.823132+0000","last_became_peered":"2024-09-11T23:19:22.823132+0000","last_unstale":"2024-09-11T23:19:24.156694+0000","last_undegraded":"2024-09-11T23:19:24.156694+0000","last_fullsized":"2024-09-11T23:19:24.156694+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:11.137762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156319+0000","last_change":"2024-09-11T23:19:22.820251+0000","last_active":"2024-09-11T23:19:24.156319+0000","last_peered":"2024-09-11T23:19:24.156319+0000","last_clean":"2024-09-11T23:19:24.156319+0000","last_became_active":"2024-09-11T23:19:22.819930+0000","last_became_peered":"2024-09-11T23:19:22.819930+0000","last_unstale":"2024-09-11T23:19:24.156319+0000","last_undegraded":"2024-09-11T23:19:24.156319+0000","last_fullsized":"2024-09-11T23:19:24.156319+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:27:59.178475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.157071+0000","last_change":"2024-09-11T23:19:22.825166+0000","last_active":"2024-09-11T23:19:24.157071+0000","last_peered":"2024-09-11T23:19:24.157071+0000","last_clean":"2024-09-11T23:19:24.157071+0000","last_became_active":"2024-09-11T23:19:22.824894+0000","last_became_peered":"2024-09-11T23:19:22.824894+0000","last_unstale":"2024-09-11T23:19:24.157071+0000","last_undegraded":"2024-09-11T23:19:24.157071+0000","last_fullsized":"2024-09-11T23:19:24.157071+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:20.115770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.843113+0000","last_change":"2024-09-11T23:19:22.839919+0000","last_active":"2024-09-11T23:19:22.843113+0000","last_peered":"2024-09-11T23:19:22.843113+0000","last_clean":"2024-09-11T23:19:22.843113+0000","last_became_active":"2024-09-11T23:19:22.839064+0000","last_became_peered":"2024-09-11T23:19:22.839064+0000","last_unstale":"2024-09-11T23:19:22.843113+0000","last_undegraded":"2024-09-11T23:19:22.843113+0000","last_fullsized":"2024-09-11T23:19:22.843113+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:54.704961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.823889+0000","last_change":"2024-09-11T23:19:22.827706+0000","last_active":"2024-09-11T23:19:23.823889+0000","last_peered":"2024-09-11T23:19:23.823889+0000","last_clean":"2024-09-11T23:19:23.823889+0000","last_became_active":"2024-09-11T23:19:22.827418+0000","last_became_peered":"2024-09-11T23:19:22.827418+0000","last_unstale":"2024-09-11T23:19:23.823889+0000","last_undegraded":"2024-09-11T23:19:23.823889+0000","last_fullsized":"2024-09-11T23:19:23.823889+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:06.723140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.824169+0000","last_change":"2024-09-11T23:19:22.818149+0000","last_active":"2024-09-11T23:19:23.824169+0000","last_peered":"2024-09-11T23:19:23.824169+0000","last_clean":"2024-09-11T23:19:23.824169+0000","last_became_active":"2024-09-11T23:19:22.817878+0000","last_became_peered":"2024-09-11T23:19:22.817878+0000","last_unstale":"2024-09-11T23:19:23.824169+0000","last_undegraded":"2024-09-11T23:19:23.824169+0000","last_fullsized":"2024-09-11T23:19:23.824169+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:09.300654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156836+0000","last_change":"2024-09-11T23:19:22.834251+0000","last_active":"2024-09-11T23:19:24.156836+0000","last_peered":"2024-09-11T23:19:24.156836+0000","last_clean":"2024-09-11T23:19:24.156836+0000","last_became_active":"2024-09-11T23:19:22.833985+0000","last_became_peered":"2024-09-11T23:19:22.833985+0000","last_unstale":"2024-09-11T23:19:24.156836+0000","last_undegraded":"2024-09-11T23:19:24.156836+0000","last_fullsized":"2024-09-11T23:19:24.156836+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:23.177222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.823642+0000","last_change":"2024-09-11T23:19:22.826037+0000","last_active":"2024-09-11T23:19:23.823642+0000","last_peered":"2024-09-11T23:19:23.823642+0000","last_clean":"2024-09-11T23:19:23.823642+0000","last_became_active":"2024-09-11T23:19:22.825763+0000","last_became_peered":"2024-09-11T23:19:22.825763+0000","last_unstale":"2024-09-11T23:19:23.823642+0000","last_undegraded":"2024-09-11T23:19:23.823642+0000","last_fullsized":"2024-09-11T23:19:23.823642+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:20.115770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.836322+0000","last_change":"2024-09-11T23:19:22.829633+0000","last_active":"2024-09-11T23:19:22.836322+0000","last_peered":"2024-09-11T23:19:22.836322+0000","last_clean":"2024-09-11T23:19:22.836322+0000","last_became_active":"2024-09-11T23:19:22.823414+0000","last_became_peered":"2024-09-11T23:19:22.823414+0000","last_unstale":"2024-09-11T23:19:22.836322+0000","last_undegraded":"2024-09-11T23:19:22.836322+0000","last_fullsized":"2024-09-11T23:19:22.836322+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:18.410715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.834297+0000","last_change":"2024-09-11T23:19:22.829523+0000","last_active":"2024-09-11T23:19:22.834297+0000","last_peered":"2024-09-11T23:19:22.834297+0000","last_clean":"2024-09-11T23:19:22.834297+0000","last_became_active":"2024-09-11T23:19:22.829281+0000","last_became_peered":"2024-09-11T23:19:22.829281+0000","last_unstale":"2024-09-11T23:19:22.834297+0000","last_undegraded":"2024-09-11T23:19:22.834297+0000","last_fullsized":"2024-09-11T23:19:22.834297+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:08.576008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.841098+0000","last_change":"2024-09-11T23:19:22.835117+0000","last_active":"2024-09-11T23:19:22.841098+0000","last_peered":"2024-09-11T23:19:22.841098+0000","last_clean":"2024-09-11T23:19:22.841098+0000","last_became_active":"2024-09-11T23:19:22.834836+0000","last_became_peered":"2024-09-11T23:19:22.834836+0000","last_unstale":"2024-09-11T23:19:22.841098+0000","last_undegraded":"2024-09-11T23:19:22.841098+0000","last_fullsized":"2024-09-11T23:19:22.841098+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:55.235653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.841896+0000","last_change":"2024-09-11T23:19:21.832292+0000","last_active":"2024-09-11T23:19:22.841896+0000","last_peered":"2024-09-11T23:19:22.841896+0000","last_clean":"2024-09-11T23:19:22.841896+0000","last_became_active":"2024-09-11T23:19:21.831910+0000","last_became_peered":"2024-09-11T23:19:21.831910+0000","last_unstale":"2024-09-11T23:19:22.841896+0000","last_undegraded":"2024-09-11T23:19:22.841896+0000","last_fullsized":"2024-09-11T23:19:22.841896+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:22.252113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156878+0000","last_change":"2024-09-11T23:19:22.829679+0000","last_active":"2024-09-11T23:19:24.156878+0000","last_peered":"2024-09-11T23:19:24.156878+0000","last_clean":"2024-09-11T23:19:24.156878+0000","last_became_active":"2024-09-11T23:19:22.829423+0000","last_became_peered":"2024-09-11T23:19:22.829423+0000","last_unstale":"2024-09-11T23:19:24.156878+0000","last_undegraded":"2024-09-11T23:19:24.156878+0000","last_fullsized":"2024-09-11T23:19:24.156878+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:41.318922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.825118+0000","last_change":"2024-09-11T23:19:21.826750+0000","last_active":"2024-09-11T23:19:23.825118+0000","last_peered":"2024-09-11T23:19:23.825118+0000","last_clean":"2024-09-11T23:19:23.825118+0000","last_became_active":"2024-09-11T23:19:21.825573+0000","last_became_peered":"2024-09-11T23:19:21.825573+0000","last_unstale":"2024-09-11T23:19:23.825118+0000","last_undegraded":"2024-09-11T23:19:23.825118+0000","last_fullsized":"2024-09-11T23:19:23.825118+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:53.804795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.824274+0000","last_change":"2024-09-11T23:19:22.834294+0000","last_active":"2024-09-11T23:19:23.824274+0000","last_peered":"2024-09-11T23:19:23.824274+0000","last_clean":"2024-09-11T23:19:23.824274+0000","last_became_active":"2024-09-11T23:19:22.834009+0000","last_became_peered":"2024-09-11T23:19:22.834009+0000","last_unstale":"2024-09-11T23:19:23.824274+0000","last_undegraded":"2024-09-11T23:19:23.824274+0000","last_fullsized":"2024-09-11T23:19:23.824274+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:03.116624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.835447+0000","last_change":"2024-09-11T23:19:21.822230+0000","last_active":"2024-09-11T23:19:22.835447+0000","last_peered":"2024-09-11T23:19:22.835447+0000","last_clean":"2024-09-11T23:19:22.835447+0000","last_became_active":"2024-09-11T23:19:21.821981+0000","last_became_peered":"2024-09-11T23:19:21.821981+0000","last_unstale":"2024-09-11T23:19:22.835447+0000","last_undegraded":"2024-09-11T23:19:22.835447+0000","last_fullsized":"2024-09-11T23:19:22.835447+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:10.134917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.830577+0000","last_change":"2024-09-11T23:19:22.822620+0000","last_active":"2024-09-11T23:19:22.830577+0000","last_peered":"2024-09-11T23:19:22.830577+0000","last_clean":"2024-09-11T23:19:22.830577+0000","last_became_active":"2024-09-11T23:19:22.822362+0000","last_became_peered":"2024-09-11T23:19:22.822362+0000","last_unstale":"2024-09-11T23:19:22.830577+0000","last_undegraded":"2024-09-11T23:19:22.830577+0000","last_fullsized":"2024-09-11T23:19:22.830577+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:41.318922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156307+0000","last_change":"2024-09-11T23:19:21.826877+0000","last_active":"2024-09-11T23:19:24.156307+0000","last_peered":"2024-09-11T23:19:24.156307+0000","last_clean":"2024-09-11T23:19:24.156307+0000","last_became_active":"2024-09-11T23:19:21.826568+0000","last_became_peered":"2024-09-11T23:19:21.826568+0000","last_unstale":"2024-09-11T23:19:24.156307+0000","last_undegraded":"2024-09-11T23:19:24.156307+0000","last_fullsized":"2024-09-11T23:19:24.156307+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:32.269615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.823468+0000","last_change":"2024-09-11T23:19:22.832179+0000","last_active":"2024-09-11T23:19:23.823468+0000","last_peered":"2024-09-11T23:19:23.823468+0000","last_clean":"2024-09-11T23:19:23.823468+0000","last_became_active":"2024-09-11T23:19:22.831882+0000","last_became_peered":"2024-09-11T23:19:22.831882+0000","last_unstale":"2024-09-11T23:19:23.823468+0000","last_undegraded":"2024-09-11T23:19:23.823468+0000","last_fullsized":"2024-09-11T23:19:23.823468+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:58.708745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.843251+0000","last_change":"2024-09-11T23:19:21.828883+0000","last_active":"2024-09-11T23:19:22.843251+0000","last_peered":"2024-09-11T23:19:22.843251+0000","last_clean":"2024-09-11T23:19:22.843251+0000","last_became_active":"2024-09-11T23:19:21.828581+0000","last_became_peered":"2024-09-11T23:19:21.828581+0000","last_unstale":"2024-09-11T23:19:22.843251+0000","last_undegraded":"2024-09-11T23:19:22.843251+0000","last_fullsized":"2024-09-11T23:19:22.843251+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:29.494238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.849160+0000","last_change":"2024-09-11T23:19:22.847956+0000","last_active":"2024-09-11T23:19:22.849160+0000","last_peered":"2024-09-11T23:19:22.849160+0000","last_clean":"2024-09-11T23:19:22.849160+0000","last_became_active":"2024-09-11T23:19:22.845042+0000","last_became_peered":"2024-09-11T23:19:22.845042+0000","last_unstale":"2024-09-11T23:19:22.849160+0000","last_undegraded":"2024-09-11T23:19:22.849160+0000","last_fullsized":"2024-09-11T23:19:22.849160+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:48.316537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.824536+0000","last_change":"2024-09-11T23:19:21.818597+0000","last_active":"2024-09-11T23:19:23.824536+0000","last_peered":"2024-09-11T23:19:23.824536+0000","last_clean":"2024-09-11T23:19:23.824536+0000","last_became_active":"2024-09-11T23:19:21.818035+0000","last_became_peered":"2024-09-11T23:19:21.818035+0000","last_unstale":"2024-09-11T23:19:23.824536+0000","last_undegraded":"2024-09-11T23:19:23.824536+0000","last_fullsized":"2024-09-11T23:19:23.824536+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:03.783145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.848130+0000","last_change":"2024-09-11T23:19:22.833068+0000","last_active":"2024-09-11T23:19:22.848130+0000","last_peered":"2024-09-11T23:19:22.848130+0000","last_clean":"2024-09-11T23:19:22.848130+0000","last_became_active":"2024-09-11T23:19:22.832514+0000","last_became_peered":"2024-09-11T23:19:22.832514+0000","last_unstale":"2024-09-11T23:19:22.848130+0000","last_undegraded":"2024-09-11T23:19:22.848130+0000","last_fullsized":"2024-09-11T23:19:22.848130+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:27:59.178475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.823541+0000","last_change":"2024-09-11T23:19:21.822444+0000","last_active":"2024-09-11T23:19:23.823541+0000","last_peered":"2024-09-11T23:19:23.823541+0000","last_clean":"2024-09-11T23:19:23.823541+0000","last_became_active":"2024-09-11T23:19:21.821950+0000","last_became_peered":"2024-09-11T23:19:21.821950+0000","last_unstale":"2024-09-11T23:19:23.823541+0000","last_undegraded":"2024-09-11T23:19:23.823541+0000","last_fullsized":"2024-09-11T23:19:23.823541+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:47.313692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156518+0000","last_change":"2024-09-11T23:19:22.822891+0000","last_active":"2024-09-11T23:19:24.156518+0000","last_peered":"2024-09-11T23:19:24.156518+0000","last_clean":"2024-09-11T23:19:24.156518+0000","last_became_active":"2024-09-11T23:19:22.822634+0000","last_became_peered":"2024-09-11T23:19:22.822634+0000","last_unstale":"2024-09-11T23:19:24.156518+0000","last_undegraded":"2024-09-11T23:19:24.156518+0000","last_fullsized":"2024-09-11T23:19:24.156518+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:06.681636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.815926+0000","last_change":"2024-09-11T23:19:21.832469+0000","last_active":"2024-09-11T23:19:22.815926+0000","last_peered":"2024-09-11T23:19:22.815926+0000","last_clean":"2024-09-11T23:19:22.815926+0000","last_became_active":"2024-09-11T23:19:21.832132+0000","last_became_peered":"2024-09-11T23:19:21.832132+0000","last_unstale":"2024-09-11T23:19:22.815926+0000","last_undegraded":"2024-09-11T23:19:22.815926+0000","last_fullsized":"2024-09-11T23:19:22.815926+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:03.783145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.825105+0000","last_change":"2024-09-11T23:19:22.846114+0000","last_active":"2024-09-11T23:19:23.825105+0000","last_peered":"2024-09-11T23:19:23.825105+0000","last_clean":"2024-09-11T23:19:23.825105+0000","last_became_active":"2024-09-11T23:19:22.845863+0000","last_became_peered":"2024-09-11T23:19:22.845863+0000","last_unstale":"2024-09-11T23:19:23.825105+0000","last_undegraded":"2024-09-11T23:19:23.825105+0000","last_fullsized":"2024-09-11T23:19:23.825105+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:16.638388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.825042+0000","last_change":"2024-09-11T23:19:21.822257+0000","last_active":"2024-09-11T23:19:23.825042+0000","last_peered":"2024-09-11T23:19:23.825042+0000","last_clean":"2024-09-11T23:19:23.825042+0000","last_became_active":"2024-09-11T23:19:21.821645+0000","last_became_peered":"2024-09-11T23:19:21.821645+0000","last_unstale":"2024-09-11T23:19:23.825042+0000","last_undegraded":"2024-09-11T23:19:23.825042+0000","last_fullsized":"2024-09-11T23:19:23.825042+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:47.540311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156880+0000","last_change":"2024-09-11T23:19:22.819043+0000","last_active":"2024-09-11T23:19:24.156880+0000","last_peered":"2024-09-11T23:19:24.156880+0000","last_clean":"2024-09-11T23:19:24.156880+0000","last_became_active":"2024-09-11T23:19:22.818772+0000","last_became_peered":"2024-09-11T23:19:22.818772+0000","last_unstale":"2024-09-11T23:19:24.156880+0000","last_undegraded":"2024-09-11T23:19:24.156880+0000","last_fullsized":"2024-09-11T23:19:24.156880+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:11.762260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.828101+0000","last_change":"2024-09-11T23:19:21.832854+0000","last_active":"2024-09-11T23:19:22.828101+0000","last_peered":"2024-09-11T23:19:22.828101+0000","last_clean":"2024-09-11T23:19:22.828101+0000","last_became_active":"2024-09-11T23:19:21.832601+0000","last_became_peered":"2024-09-11T23:19:21.832601+0000","last_unstale":"2024-09-11T23:19:22.828101+0000","last_undegraded":"2024-09-11T23:19:22.828101+0000","last_fullsized":"2024-09-11T23:19:22.828101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:47.540311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.836797+0000","last_change":"2024-09-11T23:19:22.830488+0000","last_active":"2024-09-11T23:19:22.836797+0000","last_peered":"2024-09-11T23:19:22.836797+0000","last_clean":"2024-09-11T23:19:22.836797+0000","last_became_active":"2024-09-11T23:19:22.830218+0000","last_became_peered":"2024-09-11T23:19:22.830218+0000","last_unstale":"2024-09-11T23:19:22.836797+0000","last_undegraded":"2024-09-11T23:19:22.836797+0000","last_fullsized":"2024-09-11T23:19:22.836797+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:57.632293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.157038+0000","last_change":"2024-09-11T23:19:21.830153+0000","last_active":"2024-09-11T23:19:24.157038+0000","last_peered":"2024-09-11T23:19:24.157038+0000","last_clean":"2024-09-11T23:19:24.157038+0000","last_became_active":"2024-09-11T23:19:21.829536+0000","last_became_peered":"2024-09-11T23:19:21.829536+0000","last_unstale":"2024-09-11T23:19:24.157038+0000","last_undegraded":"2024-09-11T23:19:24.157038+0000","last_fullsized":"2024-09-11T23:19:24.157038+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:47.116860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.157001+0000","last_change":"2024-09-11T23:19:22.824218+0000","last_active":"2024-09-11T23:19:24.157001+0000","last_peered":"2024-09-11T23:19:24.157001+0000","last_clean":"2024-09-11T23:19:24.157001+0000","last_became_active":"2024-09-11T23:19:22.822547+0000","last_became_peered":"2024-09-11T23:19:22.822547+0000","last_unstale":"2024-09-11T23:19:24.157001+0000","last_undegraded":"2024-09-11T23:19:24.157001+0000","last_fullsized":"2024-09-11T23:19:24.157001+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:47.477256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.851407+0000","last_change":"2024-09-11T23:19:21.820994+0000","last_active":"2024-09-11T23:19:22.851407+0000","last_peered":"2024-09-11T23:19:22.851407+0000","last_clean":"2024-09-11T23:19:22.851407+0000","last_became_active":"2024-09-11T23:19:21.818598+0000","last_became_peered":"2024-09-11T23:19:21.818598+0000","last_unstale":"2024-09-11T23:19:22.851407+0000","last_undegraded":"2024-09-11T23:19:22.851407+0000","last_fullsized":"2024-09-11T23:19:22.851407+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:26.669285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156124+0000","last_change":"2024-09-11T23:19:22.832087+0000","last_active":"2024-09-11T23:19:24.156124+0000","last_peered":"2024-09-11T23:19:24.156124+0000","last_clean":"2024-09-11T23:19:24.156124+0000","last_became_active":"2024-09-11T23:19:22.831796+0000","last_became_peered":"2024-09-11T23:19:22.831796+0000","last_unstale":"2024-09-11T23:19:24.156124+0000","last_undegraded":"2024-09-11T23:19:24.156124+0000","last_fullsized":"2024-09-11T23:19:24.156124+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:48.543156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.845977+0000","last_change":"2024-09-11T23:19:21.830911+0000","last_active":"2024-09-11T23:19:22.845977+0000","last_peered":"2024-09-11T23:19:22.845977+0000","last_clean":"2024-09-11T23:19:22.845977+0000","last_became_active":"2024-09-11T23:19:21.830610+0000","last_became_peered":"2024-09-11T23:19:21.830610+0000","last_unstale":"2024-09-11T23:19:22.845977+0000","last_undegraded":"2024-09-11T23:19:22.845977+0000","last_fullsized":"2024-09-11T23:19:22.845977+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:49.448951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.849144+0000","last_change":"2024-09-11T23:19:22.847941+0000","last_active":"2024-09-11T23:19:22.849144+0000","last_peered":"2024-09-11T23:19:22.849144+0000","last_clean":"2024-09-11T23:19:22.849144+0000","last_became_active":"2024-09-11T23:19:22.844989+0000","last_became_peered":"2024-09-11T23:19:22.844989+0000","last_unstale":"2024-09-11T23:19:22.849144+0000","last_undegraded":"2024-09-11T23:19:22.849144+0000","last_fullsized":"2024-09-11T23:19:22.849144+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:00.048134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156093+0000","last_change":"2024-09-11T23:19:21.827803+0000","last_active":"2024-09-11T23:19:24.156093+0000","last_peered":"2024-09-11T23:19:24.156093+0000","last_clean":"2024-09-11T23:19:24.156093+0000","last_became_active":"2024-09-11T23:19:21.827415+0000","last_became_peered":"2024-09-11T23:19:21.827415+0000","last_unstale":"2024-09-11T23:19:24.156093+0000","last_undegraded":"2024-09-11T23:19:24.156093+0000","last_fullsized":"2024-09-11T23:19:24.156093+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:45.435536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.828869+0000","last_change":"2024-09-11T23:19:22.823721+0000","last_active":"2024-09-11T23:19:22.828869+0000","last_peered":"2024-09-11T23:19:22.828869+0000","last_clean":"2024-09-11T23:19:22.828869+0000","last_became_active":"2024-09-11T23:19:22.823456+0000","last_became_peered":"2024-09-11T23:19:22.823456+0000","last_unstale":"2024-09-11T23:19:22.828869+0000","last_undegraded":"2024-09-11T23:19:22.828869+0000","last_fullsized":"2024-09-11T23:19:22.828869+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:59.732274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.823028+0000","last_change":"2024-09-11T23:19:21.830884+0000","last_active":"2024-09-11T23:19:22.823028+0000","last_peered":"2024-09-11T23:19:22.823028+0000","last_clean":"2024-09-11T23:19:22.823028+0000","last_became_active":"2024-09-11T23:19:21.830571+0000","last_became_peered":"2024-09-11T23:19:21.830571+0000","last_unstale":"2024-09-11T23:19:22.823028+0000","last_undegraded":"2024-09-11T23:19:22.823028+0000","last_fullsized":"2024-09-11T23:19:22.823028+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:15.309438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156222+0000","last_change":"2024-09-11T23:19:22.819318+0000","last_active":"2024-09-11T23:19:24.156222+0000","last_peered":"2024-09-11T23:19:24.156222+0000","last_clean":"2024-09-11T23:19:24.156222+0000","last_became_active":"2024-09-11T23:19:22.818984+0000","last_became_peered":"2024-09-11T23:19:22.818984+0000","last_unstale":"2024-09-11T23:19:24.156222+0000","last_undegraded":"2024-09-11T23:19:24.156222+0000","last_fullsized":"2024-09-11T23:19:24.156222+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:30.850180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":20,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.850657+0000","last_change":"2024-09-11T23:19:21.829195+0000","last_active":"2024-09-11T23:19:22.850657+0000","last_peered":"2024-09-11T23:19:22.850657+0000","last_clean":"2024-09-11T23:19:22.850657+0000","last_became_active":"2024-09-11T23:19:21.828538+0000","last_became_peered":"2024-09-11T23:19:21.828538+0000","last_unstale":"2024-09-11T23:19:22.850657+0000","last_undegraded":"2024-09-11T23:19:22.850657+0000","last_fullsized":"2024-09-11T23:19:22.850657+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:50.637165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.821122+0000","last_change":"2024-09-11T23:19:22.817947+0000","last_active":"2024-09-11T23:19:22.821122+0000","last_peered":"2024-09-11T23:19:22.821122+0000","last_clean":"2024-09-11T23:19:22.821122+0000","last_became_active":"2024-09-11T23:19:22.817640+0000","last_became_peered":"2024-09-11T23:19:22.817640+0000","last_unstale":"2024-09-11T23:19:22.821122+0000","last_undegraded":"2024-09-11T23:19:22.821122+0000","last_fullsized":"2024-09-11T23:19:22.821122+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:30.273614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.846407+0000","last_change":"2024-09-11T23:19:21.829798+0000","last_active":"2024-09-11T23:19:22.846407+0000","last_peered":"2024-09-11T23:19:22.846407+0000","last_clean":"2024-09-11T23:19:22.846407+0000","last_became_active":"2024-09-11T23:19:21.828075+0000","last_became_peered":"2024-09-11T23:19:21.828075+0000","last_unstale":"2024-09-11T23:19:22.846407+0000","last_undegraded":"2024-09-11T23:19:22.846407+0000","last_fullsized":"2024-09-11T23:19:22.846407+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:25.746133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.848579+0000","last_change":"2024-09-11T23:19:22.842149+0000","last_active":"2024-09-11T23:19:22.848579+0000","last_peered":"2024-09-11T23:19:22.848579+0000","last_clean":"2024-09-11T23:19:22.848579+0000","last_became_active":"2024-09-11T23:19:22.841882+0000","last_became_peered":"2024-09-11T23:19:22.841882+0000","last_unstale":"2024-09-11T23:19:22.848579+0000","last_undegraded":"2024-09-11T23:19:22.848579+0000","last_fullsized":"2024-09-11T23:19:22.848579+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:41.318922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.825218+0000","last_change":"2024-09-11T23:19:21.826467+0000","last_active":"2024-09-11T23:19:23.825218+0000","last_peered":"2024-09-11T23:19:23.825218+0000","last_clean":"2024-09-11T23:19:23.825218+0000","last_became_active":"2024-09-11T23:19:21.826019+0000","last_became_peered":"2024-09-11T23:19:21.826019+0000","last_unstale":"2024-09-11T23:19:23.825218+0000","last_undegraded":"2024-09-11T23:19:23.825218+0000","last_fullsized":"2024-09-11T23:19:23.825218+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:39.212523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156961+0000","last_change":"2024-09-11T23:19:22.831114+0000","last_active":"2024-09-11T23:19:24.156961+0000","last_peered":"2024-09-11T23:19:24.156961+0000","last_clean":"2024-09-11T23:19:24.156961+0000","last_became_active":"2024-09-11T23:19:22.830712+0000","last_became_peered":"2024-09-11T23:19:22.830712+0000","last_unstale":"2024-09-11T23:19:24.156961+0000","last_undegraded":"2024-09-11T23:19:24.156961+0000","last_fullsized":"2024-09-11T23:19:24.156961+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:07.325179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.824412+0000","last_change":"2024-09-11T23:19:21.827215+0000","last_active":"2024-09-11T23:19:23.824412+0000","last_peered":"2024-09-11T23:19:23.824412+0000","last_clean":"2024-09-11T23:19:23.824412+0000","last_became_active":"2024-09-11T23:19:21.826877+0000","last_became_peered":"2024-09-11T23:19:21.826877+0000","last_unstale":"2024-09-11T23:19:23.824412+0000","last_undegraded":"2024-09-11T23:19:23.824412+0000","last_fullsized":"2024-09-11T23:19:23.824412+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:15.635543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156545+0000","last_change":"2024-09-11T23:19:22.828224+0000","last_active":"2024-09-11T23:19:24.156545+0000","last_peered":"2024-09-11T23:19:24.156545+0000","last_clean":"2024-09-11T23:19:24.156545+0000","last_became_active":"2024-09-11T23:19:22.827933+0000","last_became_peered":"2024-09-11T23:19:22.827933+0000","last_unstale":"2024-09-11T23:19:24.156545+0000","last_undegraded":"2024-09-11T23:19:24.156545+0000","last_fullsized":"2024-09-11T23:19:24.156545+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:02.312755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.828347+0000","last_change":"2024-09-11T23:19:21.835655+0000","last_active":"2024-09-11T23:19:22.828347+0000","last_peered":"2024-09-11T23:19:22.828347+0000","last_clean":"2024-09-11T23:19:22.828347+0000","last_became_active":"2024-09-11T23:19:21.835307+0000","last_became_peered":"2024-09-11T23:19:21.835307+0000","last_unstale":"2024-09-11T23:19:22.828347+0000","last_undegraded":"2024-09-11T23:19:22.828347+0000","last_fullsized":"2024-09-11T23:19:22.828347+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:42.801937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.836979+0000","last_change":"2024-09-11T23:19:22.831893+0000","last_active":"2024-09-11T23:19:22.836979+0000","last_peered":"2024-09-11T23:19:22.836979+0000","last_clean":"2024-09-11T23:19:22.836979+0000","last_became_active":"2024-09-11T23:19:22.829993+0000","last_became_peered":"2024-09-11T23:19:22.829993+0000","last_unstale":"2024-09-11T23:19:22.836979+0000","last_undegraded":"2024-09-11T23:19:22.836979+0000","last_fullsized":"2024-09-11T23:19:22.836979+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:45.309519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.843166+0000","last_change":"2024-09-11T23:19:21.835426+0000","last_active":"2024-09-11T23:19:22.843166+0000","last_peered":"2024-09-11T23:19:22.843166+0000","last_clean":"2024-09-11T23:19:22.843166+0000","last_became_active":"2024-09-11T23:19:21.835151+0000","last_became_peered":"2024-09-11T23:19:21.835151+0000","last_unstale":"2024-09-11T23:19:22.843166+0000","last_undegraded":"2024-09-11T23:19:22.843166+0000","last_fullsized":"2024-09-11T23:19:22.843166+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:53.810993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.828944+0000","last_change":"2024-09-11T23:19:22.826776+0000","last_active":"2024-09-11T23:19:22.828944+0000","last_peered":"2024-09-11T23:19:22.828944+0000","last_clean":"2024-09-11T23:19:22.828944+0000","last_became_active":"2024-09-11T23:19:22.826423+0000","last_became_peered":"2024-09-11T23:19:22.826423+0000","last_unstale":"2024-09-11T23:19:22.828944+0000","last_undegraded":"2024-09-11T23:19:22.828944+0000","last_fullsized":"2024-09-11T23:19:22.828944+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:07.325179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.823845+0000","last_change":"2024-09-11T23:19:21.829931+0000","last_active":"2024-09-11T23:19:23.823845+0000","last_peered":"2024-09-11T23:19:23.823845+0000","last_clean":"2024-09-11T23:19:23.823845+0000","last_became_active":"2024-09-11T23:19:21.829638+0000","last_became_peered":"2024-09-11T23:19:21.829638+0000","last_unstale":"2024-09-11T23:19:23.823845+0000","last_undegraded":"2024-09-11T23:19:23.823845+0000","last_fullsized":"2024-09-11T23:19:23.823845+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:23.163396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.826807+0000","last_change":"2024-09-11T23:19:22.820367+0000","last_active":"2024-09-11T23:19:22.826807+0000","last_peered":"2024-09-11T23:19:22.826807+0000","last_clean":"2024-09-11T23:19:22.826807+0000","last_became_active":"2024-09-11T23:19:22.817466+0000","last_became_peered":"2024-09-11T23:19:22.817466+0000","last_unstale":"2024-09-11T23:19:22.826807+0000","last_undegraded":"2024-09-11T23:19:22.826807+0000","last_fullsized":"2024-09-11T23:19:22.826807+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:44.961428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.825128+0000","last_change":"2024-09-11T23:19:21.830995+0000","last_active":"2024-09-11T23:19:22.825128+0000","last_peered":"2024-09-11T23:19:22.825128+0000","last_clean":"2024-09-11T23:19:22.825128+0000","last_became_active":"2024-09-11T23:19:21.830737+0000","last_became_peered":"2024-09-11T23:19:21.830737+0000","last_unstale":"2024-09-11T23:19:22.825128+0000","last_undegraded":"2024-09-11T23:19:22.825128+0000","last_fullsized":"2024-09-11T23:19:22.825128+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:39.212523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.842722+0000","last_change":"2024-09-11T23:19:22.838380+0000","last_active":"2024-09-11T23:19:22.842722+0000","last_peered":"2024-09-11T23:19:22.842722+0000","last_clean":"2024-09-11T23:19:22.842722+0000","last_became_active":"2024-09-11T23:19:22.838008+0000","last_became_peered":"2024-09-11T23:19:22.838008+0000","last_unstale":"2024-09-11T23:19:22.842722+0000","last_undegraded":"2024-09-11T23:19:22.842722+0000","last_fullsized":"2024-09-11T23:19:22.842722+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:54.131817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.155832+0000","last_change":"2024-09-11T23:19:21.822971+0000","last_active":"2024-09-11T23:19:24.155832+0000","last_peered":"2024-09-11T23:19:24.155832+0000","last_clean":"2024-09-11T23:19:24.155832+0000","last_became_active":"2024-09-11T23:19:21.822697+0000","last_became_peered":"2024-09-11T23:19:21.822697+0000","last_unstale":"2024-09-11T23:19:24.155832+0000","last_undegraded":"2024-09-11T23:19:24.155832+0000","last_fullsized":"2024-09-11T23:19:24.155832+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:33.669261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.157043+0000","last_change":"2024-09-11T23:19:22.839762+0000","last_active":"2024-09-11T23:19:24.157043+0000","last_peered":"2024-09-11T23:19:24.157043+0000","last_clean":"2024-09-11T23:19:24.157043+0000","last_became_active":"2024-09-11T23:19:22.839499+0000","last_became_peered":"2024-09-11T23:19:22.839499+0000","last_unstale":"2024-09-11T23:19:24.157043+0000","last_undegraded":"2024-09-11T23:19:24.157043+0000","last_fullsized":"2024-09-11T23:19:24.157043+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:58.708745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.828286+0000","last_change":"2024-09-11T23:19:21.830571+0000","last_active":"2024-09-11T23:19:22.828286+0000","last_peered":"2024-09-11T23:19:22.828286+0000","last_clean":"2024-09-11T23:19:22.828286+0000","last_became_active":"2024-09-11T23:19:21.830308+0000","last_became_peered":"2024-09-11T23:19:21.830308+0000","last_unstale":"2024-09-11T23:19:22.828286+0000","last_undegraded":"2024-09-11T23:19:22.828286+0000","last_fullsized":"2024-09-11T23:19:22.828286+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:17.436432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.849483+0000","last_change":"2024-09-11T23:19:22.844306+0000","last_active":"2024-09-11T23:19:22.849483+0000","last_peered":"2024-09-11T23:19:22.849483+0000","last_clean":"2024-09-11T23:19:22.849483+0000","last_became_active":"2024-09-11T23:19:22.842555+0000","last_became_peered":"2024-09-11T23:19:22.842555+0000","last_unstale":"2024-09-11T23:19:22.849483+0000","last_undegraded":"2024-09-11T23:19:22.849483+0000","last_fullsized":"2024-09-11T23:19:22.849483+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:07.325179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.157104+0000","last_change":"2024-09-11T23:19:21.830420+0000","last_active":"2024-09-11T23:19:24.157104+0000","last_peered":"2024-09-11T23:19:24.157104+0000","last_clean":"2024-09-11T23:19:24.157104+0000","last_became_active":"2024-09-11T23:19:21.829895+0000","last_became_peered":"2024-09-11T23:19:21.829895+0000","last_unstale":"2024-09-11T23:19:24.157104+0000","last_undegraded":"2024-09-11T23:19:24.157104+0000","last_fullsized":"2024-09-11T23:19:24.157104+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:08.297810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156972+0000","last_change":"2024-09-11T23:19:22.822143+0000","last_active":"2024-09-11T23:19:24.156972+0000","last_peered":"2024-09-11T23:19:24.156972+0000","last_clean":"2024-09-11T23:19:24.156972+0000","last_became_active":"2024-09-11T23:19:22.821843+0000","last_became_peered":"2024-09-11T23:19:22.821843+0000","last_unstale":"2024-09-11T23:19:24.156972+0000","last_undegraded":"2024-09-11T23:19:24.156972+0000","last_fullsized":"2024-09-11T23:19:24.156972+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:50.373257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.817765+0000","last_change":"2024-09-11T23:19:21.821139+0000","last_active":"2024-09-11T23:19:22.817765+0000","last_peered":"2024-09-11T23:19:22.817765+0000","last_clean":"2024-09-11T23:19:22.817765+0000","last_became_active":"2024-09-11T23:19:21.820869+0000","last_became_peered":"2024-09-11T23:19:21.820869+0000","last_unstale":"2024-09-11T23:19:22.817765+0000","last_undegraded":"2024-09-11T23:19:22.817765+0000","last_fullsized":"2024-09-11T23:19:22.817765+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:53.128972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.838282+0000","last_change":"2024-09-11T23:19:22.834670+0000","last_active":"2024-09-11T23:19:22.838282+0000","last_peered":"2024-09-11T23:19:22.838282+0000","last_clean":"2024-09-11T23:19:22.838282+0000","last_became_active":"2024-09-11T23:19:22.833296+0000","last_became_peered":"2024-09-11T23:19:22.833296+0000","last_unstale":"2024-09-11T23:19:22.838282+0000","last_undegraded":"2024-09-11T23:19:22.838282+0000","last_fullsized":"2024-09-11T23:19:22.838282+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:07.196019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.156403+0000","last_change":"2024-09-11T23:19:21.829755+0000","last_active":"2024-09-11T23:19:24.156403+0000","last_peered":"2024-09-11T23:19:24.156403+0000","last_clean":"2024-09-11T23:19:24.156403+0000","last_became_active":"2024-09-11T23:19:21.829229+0000","last_became_peered":"2024-09-11T23:19:21.829229+0000","last_unstale":"2024-09-11T23:19:24.156403+0000","last_undegraded":"2024-09-11T23:19:24.156403+0000","last_fullsized":"2024-09-11T23:19:24.156403+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:25.307646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.849343+0000","last_change":"2024-09-11T23:19:22.844460+0000","last_active":"2024-09-11T23:19:22.849343+0000","last_peered":"2024-09-11T23:19:22.849343+0000","last_clean":"2024-09-11T23:19:22.849343+0000","last_became_active":"2024-09-11T23:19:22.840886+0000","last_became_peered":"2024-09-11T23:19:22.840886+0000","last_unstale":"2024-09-11T23:19:22.849343+0000","last_undegraded":"2024-09-11T23:19:22.849343+0000","last_fullsized":"2024-09-11T23:19:22.849343+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:29.345760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.823757+0000","last_change":"2024-09-11T23:19:21.836238+0000","last_active":"2024-09-11T23:19:23.823757+0000","last_peered":"2024-09-11T23:19:23.823757+0000","last_clean":"2024-09-11T23:19:23.823757+0000","last_became_active":"2024-09-11T23:19:21.835963+0000","last_became_peered":"2024-09-11T23:19:21.835963+0000","last_unstale":"2024-09-11T23:19:23.823757+0000","last_undegraded":"2024-09-11T23:19:23.823757+0000","last_fullsized":"2024-09-11T23:19:23.823757+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:50.637165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.823258+0000","last_change":"2024-09-11T23:19:22.825041+0000","last_active":"2024-09-11T23:19:23.823258+0000","last_peered":"2024-09-11T23:19:23.823258+0000","last_clean":"2024-09-11T23:19:23.823258+0000","last_became_active":"2024-09-11T23:19:22.823631+0000","last_became_peered":"2024-09-11T23:19:22.823631+0000","last_unstale":"2024-09-11T23:19:23.823258+0000","last_undegraded":"2024-09-11T23:19:23.823258+0000","last_fullsized":"2024-09-11T23:19:23.823258+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:26.310491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.817528+0000","last_change":"2024-09-11T23:19:21.829220+0000","last_active":"2024-09-11T23:19:22.817528+0000","last_peered":"2024-09-11T23:19:22.817528+0000","last_clean":"2024-09-11T23:19:22.817528+0000","last_became_active":"2024-09-11T23:19:21.828979+0000","last_became_peered":"2024-09-11T23:19:21.828979+0000","last_unstale":"2024-09-11T23:19:22.817528+0000","last_undegraded":"2024-09-11T23:19:22.817528+0000","last_fullsized":"2024-09-11T23:19:22.817528+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:01.309910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.823244+0000","last_change":"2024-09-11T23:19:22.830996+0000","last_active":"2024-09-11T23:19:23.823244+0000","last_peered":"2024-09-11T23:19:23.823244+0000","last_clean":"2024-09-11T23:19:23.823244+0000","last_became_active":"2024-09-11T23:19:22.830687+0000","last_became_peered":"2024-09-11T23:19:22.830687+0000","last_unstale":"2024-09-11T23:19:23.823244+0000","last_undegraded":"2024-09-11T23:19:23.823244+0000","last_fullsized":"2024-09-11T23:19:23.823244+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:55.235653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.816207+0000","last_change":"2024-09-11T23:19:21.836026+0000","last_active":"2024-09-11T23:19:22.816207+0000","last_peered":"2024-09-11T23:19:22.816207+0000","last_clean":"2024-09-11T23:19:22.816207+0000","last_became_active":"2024-09-11T23:19:21.835605+0000","last_became_peered":"2024-09-11T23:19:21.835605+0000","last_unstale":"2024-09-11T23:19:22.816207+0000","last_undegraded":"2024-09-11T23:19:22.816207+0000","last_fullsized":"2024-09-11T23:19:22.816207+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:53.804795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-11T23:19:22.848904+0000","last_change":"2024-09-11T23:19:22.844760+0000","last_active":"2024-09-11T23:19:22.848904+0000","last_peered":"2024-09-11T23:19:22.848904+0000","last_clean":"2024-09-11T23:19:22.848904+0000","last_became_active":"2024-09-11T23:19:22.844453+0000","last_became_peered":"2024-09-11T23:19:22.844453+0000","last_unstale":"2024-09-11T23:19:22.848904+0000","last_undegraded":"2024-09-11T23:19:22.848904+0000","last_fullsized":"2024-09-11T23:19:22.848904+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:21.795825+0000","last_clean_scrub_stamp":"2024-09-11T23:19:21.795825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:20.115770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:23.824693+0000","last_change":"2024-09-11T23:19:21.828258+0000","last_active":"2024-09-11T23:19:23.824693+0000","last_peered":"2024-09-11T23:19:23.824693+0000","last_clean":"2024-09-11T23:19:23.824693+0000","last_became_active":"2024-09-11T23:19:21.827950+0000","last_became_peered":"2024-09-11T23:19:21.827950+0000","last_unstale":"2024-09-11T23:19:23.824693+0000","last_undegraded":"2024-09-11T23:19:23.824693+0000","last_fullsized":"2024-09-11T23:19:23.824693+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:19:20.792981+0000","last_clean_scrub_stamp":"2024-09-11T23:19:20.792981+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:17.532109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":213,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-11T23:19:24.155757+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:19:24.155757+0000","last_peered":"2024-09-11T23:19:24.155757+0000","last_clean":"2024-09-11T23:19:24.155757+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:19:24.155757+0000","last_undegraded":"2024-09-11T23:19:24.155757+0000","last_fullsized":"2024-09-11T23:19:24.155757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476760,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1126400,"data_stored":804496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476759,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":214710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476758,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":532480,"data_stored":214108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476758,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":540672,"data_stored":215650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31704,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":520192,"data_stored":207808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1114112,"data_stored":798140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":503808,"data_stored":200963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542166,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":532480,"data_stored":209372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:19:27.391 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:19:27.392 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:19:27.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.589+0000 7fe76d600640 1 Processor -- start 2024-09-11T23:19:27.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.589+0000 7fe76d600640 1 -- start start 2024-09-11T23:19:27.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.590+0000 7fe76d600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe76806e500 0x7fe768167310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.590+0000 7fe76d600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7680b4240 con 0x7fe768145d90 2024-09-11T23:19:27.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.590+0000 7fe76d600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7680b4520 con 0x7fe7680cf5d0 2024-09-11T23:19:27.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.590+0000 7fe76d600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe76806d080 con 0x7fe76806e500 2024-09-11T23:19:27.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.591+0000 7fe766a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe768145d90 0x7fe7680ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34384/0 (socket says 172.21.15.144:34384) 2024-09-11T23:19:27.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.591+0000 7fe766a00640 1 -- 172.21.15.144:0/308333341 learned_addr learned my addr 172.21.15.144:0/308333341 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:27.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.591+0000 7fe767400640 1 --2- 172.21.15.144:0/308333341 >> v2:172.21.15.144:3300/0 conn(0x7fe76806e500 0x7fe768167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.591+0000 7fe767400640 1 -- 172.21.15.144:0/308333341 >> v1:172.21.15.165:6789/0 conn(0x7fe7680cf5d0 legacy=0x7fe7680cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:27.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.591+0000 7fe767400640 1 -- 172.21.15.144:0/308333341 >> v1:172.21.15.144:6789/0 conn(0x7fe768145d90 legacy=0x7fe7680ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:27.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.591+0000 7fe767400640 1 -- 172.21.15.144:0/308333341 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7680b4800 con 0x7fe76806e500 2024-09-11T23:19:27.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.591+0000 7fe766000640 1 -- 172.21.15.144:0/308333341 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2720527731 0 0) 0x7fe7680b4240 con 0x7fe768145d90 2024-09-11T23:19:27.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.592+0000 7fe767400640 1 --2- 172.21.15.144:0/308333341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe76806e500 0x7fe768167310 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe760009d90 tx=0x7fe76002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91100cc2252d566b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:27.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.592+0000 7fe766000640 1 -- 172.21.15.144:0/308333341 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe760007740 con 0x7fe76806e500 2024-09-11T23:19:27.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.592+0000 7fe766000640 1 -- 172.21.15.144:0/308333341 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7600078e0 con 0x7fe76806e500 2024-09-11T23:19:27.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.592+0000 7fe766000640 1 -- 172.21.15.144:0/308333341 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe760007cb0 con 0x7fe76806e500 2024-09-11T23:19:27.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.593+0000 7fe76d600640 1 -- 172.21.15.144:0/308333341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe76806e500 msgr2=0x7fe768167310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:27.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.593+0000 7fe76d600640 1 --2- 172.21.15.144:0/308333341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe76806e500 0x7fe768167310 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe760009d90 tx=0x7fe76002a6a0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.593+0000 7fe76d600640 1 -- 172.21.15.144:0/308333341 shutdown_connections 2024-09-11T23:19:27.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.593+0000 7fe76d600640 1 --2- 172.21.15.144:0/308333341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe76806e500 0x7fe768167310 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.593+0000 7fe76d600640 1 -- 172.21.15.144:0/308333341 >> 172.21.15.144:0/308333341 conn(0x7fe76806bba0 msgr2=0x7fe76806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:27.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.593+0000 7fe76d600640 1 -- 172.21.15.144:0/308333341 shutdown_connections 2024-09-11T23:19:27.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.593+0000 7fe76d600640 1 -- 172.21.15.144:0/308333341 wait complete. 2024-09-11T23:19:27.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.595+0000 7fe76d600640 1 Processor -- start 2024-09-11T23:19:27.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.595+0000 7fe76d600640 1 -- start start 2024-09-11T23:19:27.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.596+0000 7fe76d600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe76806e500 0x7fe7680c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.596+0000 7fe76d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7680cf5d0 0x7fe768136750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.596+0000 7fe76d600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe768145d90 0x7fe76815bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.596+0000 7fe76d600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe7680b5610 con 0x7fe7680cf5d0 2024-09-11T23:19:27.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.596+0000 7fe76d600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe7680cd660 con 0x7fe76806e500 2024-09-11T23:19:27.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.596+0000 7fe76d600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe7680b5790 con 0x7fe768145d90 2024-09-11T23:19:27.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.596+0000 7fe75e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7680cf5d0 0x7fe768136750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.596+0000 7fe75e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7680cf5d0 0x7fe768136750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37118/0 (socket says 172.21.15.144:37118) 2024-09-11T23:19:27.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.596+0000 7fe75e000640 1 -- 172.21.15.144:0/1618917264 learned_addr learned my addr 172.21.15.144:0/1618917264 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:27.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.596+0000 7fe766a00640 1 --2- 172.21.15.144:0/1618917264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe76806e500 0x7fe7680c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.596+0000 7fe767400640 1 --2- 172.21.15.144:0/1618917264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe768145d90 0x7fe76815bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.597+0000 7fe75e000640 1 -- 172.21.15.144:0/1618917264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe768145d90 msgr2=0x7fe76815bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:27.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.597+0000 7fe75e000640 1 --2- 172.21.15.144:0/1618917264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe768145d90 0x7fe76815bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.597+0000 7fe75e000640 1 -- 172.21.15.144:0/1618917264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe76806e500 msgr2=0x7fe7680c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:27.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.597+0000 7fe75e000640 1 --2- 172.21.15.144:0/1618917264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe76806e500 0x7fe7680c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.597+0000 7fe75e000640 1 -- 172.21.15.144:0/1618917264 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7680ae110 con 0x7fe7680cf5d0 2024-09-11T23:19:27.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.597+0000 7fe75e000640 1 --2- 172.21.15.144:0/1618917264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7680cf5d0 0x7fe768136750 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe75000c460 tx=0x7fe75000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:27.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.597+0000 7fe75f400640 1 -- 172.21.15.144:0/1618917264 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe750016020 con 0x7fe7680cf5d0 2024-09-11T23:19:27.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.597+0000 7fe75f400640 1 -- 172.21.15.144:0/1618917264 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe750012870 con 0x7fe7680cf5d0 2024-09-11T23:19:27.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.597+0000 7fe76d600640 1 -- 172.21.15.144:0/1618917264 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7680ae3b0 con 0x7fe7680cf5d0 2024-09-11T23:19:27.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.597+0000 7fe75f400640 1 -- 172.21.15.144:0/1618917264 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe750012c60 con 0x7fe7680cf5d0 2024-09-11T23:19:27.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.597+0000 7fe76d600640 1 -- 172.21.15.144:0/1618917264 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7680ae970 con 0x7fe7680cf5d0 2024-09-11T23:19:27.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.599+0000 7fe76d600640 1 -- 172.21.15.144:0/1618917264 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7680ce8d0 con 0x7fe7680cf5d0 2024-09-11T23:19:27.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.599+0000 7fe75f400640 1 -- 172.21.15.144:0/1618917264 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fe750019020 con 0x7fe7680cf5d0 2024-09-11T23:19:27.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.600+0000 7fe75f400640 1 --2- 172.21.15.144:0/1618917264 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe74406bfe0 0x7fe74406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:27.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.600+0000 7fe75f400640 1 -- 172.21.15.144:0/1618917264 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fe75008ab70 con 0x7fe7680cf5d0 2024-09-11T23:19:27.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.600+0000 7fe766a00640 1 --2- 172.21.15.144:0/1618917264 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe74406bfe0 0x7fe74406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:27.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.601+0000 7fe766a00640 1 --2- 172.21.15.144:0/1618917264 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe74406bfe0 0x7fe74406e4a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe758007fd0 tx=0x7fe758007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:27.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.605+0000 7fe75f400640 1 -- 172.21.15.144:0/1618917264 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe7680ce8d0 con 0x7fe7680cf5d0 2024-09-11T23:19:27.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.844+0000 7fe76d600640 1 -- 172.21.15.144:0/1618917264 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe768069b00 con 0x7fe7680cf5d0 2024-09-11T23:19:27.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.848+0000 7fe75f400640 1 -- 172.21.15.144:0/1618917264 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) ==== 190+0+147 (secure 0 0 0) 0x7fe768069b00 con 0x7fe7680cf5d0 2024-09-11T23:19:27.848 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-11T23:19:27.848 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A== 2024-09-11T23:19:27.848 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-11T23:19:27.848 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-11T23:19:27.848 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:19:27.848 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-11T23:19:27.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.850+0000 7fe76d600640 1 -- 172.21.15.144:0/1618917264 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe74406bfe0 msgr2=0x7fe74406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:27.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.850+0000 7fe76d600640 1 --2- 172.21.15.144:0/1618917264 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe74406bfe0 0x7fe74406e4a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe758007fd0 tx=0x7fe758007de0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.850+0000 7fe76d600640 1 -- 172.21.15.144:0/1618917264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7680cf5d0 msgr2=0x7fe768136750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:27.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.850+0000 7fe76d600640 1 --2- 172.21.15.144:0/1618917264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7680cf5d0 0x7fe768136750 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe75000c460 tx=0x7fe75000c920 comp rx=0 tx=0).stop 2024-09-11T23:19:27.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.850+0000 7fe76d600640 1 -- 172.21.15.144:0/1618917264 shutdown_connections 2024-09-11T23:19:27.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.850+0000 7fe76d600640 1 --2- 172.21.15.144:0/1618917264 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe74406bfe0 0x7fe74406e4a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.850+0000 7fe76d600640 1 --2- 172.21.15.144:0/1618917264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe768145d90 0x7fe76815bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.850+0000 7fe76d600640 1 --2- 172.21.15.144:0/1618917264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe7680cf5d0 0x7fe768136750 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.850+0000 7fe76d600640 1 --2- 172.21.15.144:0/1618917264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe76806e500 0x7fe7680c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:27.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.850+0000 7fe76d600640 1 -- 172.21.15.144:0/1618917264 >> 172.21.15.144:0/1618917264 conn(0x7fe76806bba0 msgr2=0x7fe7680b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:27.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.850+0000 7fe76d600640 1 -- 172.21.15.144:0/1618917264 shutdown_connections 2024-09-11T23:19:27.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:27.850+0000 7fe76d600640 1 -- 172.21.15.144:0/1618917264 wait complete. 2024-09-11T23:19:27.865 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:28.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.020+0000 7f9ea7200640 1 Processor -- start 2024-09-11T23:19:28.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.020+0000 7f9ea7200640 1 -- start start 2024-09-11T23:19:28.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.021+0000 7f9ea7200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9ea015c180 0x7f9ea00cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.021+0000 7f9ea7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea00ce230 0x7f9ea00cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.021+0000 7f9ea7200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ea00ce740 con 0x7f9ea00cf5b0 2024-09-11T23:19:28.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.021+0000 7f9ea7200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea0072640 con 0x7f9ea015c180 2024-09-11T23:19:28.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.021+0000 7f9ea7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea0072920 con 0x7f9ea00ce230 2024-09-11T23:19:28.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.021+0000 7f9ea5200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9ea00cf5b0 0x7f9ea0073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34386/0 (socket says 172.21.15.144:34386) 2024-09-11T23:19:28.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.021+0000 7f9ea5200640 1 -- 172.21.15.144:0/4145386275 learned_addr learned my addr 172.21.15.144:0/4145386275 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:28.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.022+0000 7f9e9fe00640 1 --2- 172.21.15.144:0/4145386275 >> v2:172.21.15.165:3300/0 conn(0x7f9ea015c180 0x7f9ea00cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.022+0000 7f9e97400640 1 --2- 172.21.15.144:0/4145386275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea00ce230 0x7f9ea00cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.022+0000 7f9e9f400640 1 -- 172.21.15.144:0/4145386275 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3495707576 0 0) 0x7f9ea00ce740 con 0x7f9ea00cf5b0 2024-09-11T23:19:28.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.022+0000 7f9e9f400640 1 -- 172.21.15.144:0/4145386275 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e84003520 con 0x7f9ea00cf5b0 2024-09-11T23:19:28.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.022+0000 7f9e9f400640 1 -- 172.21.15.144:0/4145386275 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 392541249 0 0) 0x7f9e84003520 con 0x7f9ea00cf5b0 2024-09-11T23:19:28.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.022+0000 7f9e9f400640 1 -- 172.21.15.144:0/4145386275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea00ce230 msgr2=0x7f9ea00cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:28.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.022+0000 7f9e9f400640 1 --2- 172.21.15.144:0/4145386275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea00ce230 0x7f9ea00cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.022+0000 7f9e9f400640 1 -- 172.21.15.144:0/4145386275 >> v2:172.21.15.165:3300/0 conn(0x7f9ea015c180 msgr2=0x7f9ea00cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:28.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.022+0000 7f9e9f400640 1 --2- 172.21.15.144:0/4145386275 >> v2:172.21.15.165:3300/0 conn(0x7f9ea015c180 0x7f9ea00cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.022+0000 7f9e9f400640 1 -- 172.21.15.144:0/4145386275 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea0072c00 con 0x7f9ea00cf5b0 2024-09-11T23:19:28.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.022+0000 7f9e9f400640 1 -- 172.21.15.144:0/4145386275 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f9e98001670 con 0x7f9ea00cf5b0 2024-09-11T23:19:28.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.022+0000 7f9e9f400640 1 -- 172.21.15.144:0/4145386275 >> v1:172.21.15.144:6789/0 conn(0x7f9ea00cf5b0 legacy=0x7f9ea0073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.022+0000 7f9e9f400640 1 --2- 172.21.15.144:0/4145386275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e840039b0 0x7f9e84003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.022+0000 7f9e9f400640 1 --2- 172.21.15.144:0/4145386275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e84004800 0x7f9e84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.022+0000 7f9e9f400640 1 --2- 172.21.15.144:0/4145386275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea00ce230 0x7f9e840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.022+0000 7f9e9f400640 1 -- 172.21.15.144:0/4145386275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea0072640 con 0x7f9e84004800 2024-09-11T23:19:28.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.022+0000 7f9e9f400640 1 -- 172.21.15.144:0/4145386275 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea0072920 con 0x7f9e840039b0 2024-09-11T23:19:28.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.022+0000 7f9e9f400640 1 -- 172.21.15.144:0/4145386275 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9e8400b9f0 con 0x7f9ea00ce230 2024-09-11T23:19:28.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.022+0000 7f9e97400640 1 --2- 172.21.15.144:0/4145386275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e84004800 0x7f9e84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.022+0000 7f9e9fe00640 1 --2- 172.21.15.144:0/4145386275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e840039b0 0x7f9e84003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.023+0000 7f9ea5200640 1 --2- 172.21.15.144:0/4145386275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea00ce230 0x7f9e840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.023+0000 7f9e97400640 1 -- 172.21.15.144:0/4145386275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea00ce230 msgr2=0x7f9e840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:28.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.023+0000 7f9e97400640 1 --2- 172.21.15.144:0/4145386275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ea00ce230 0x7f9e840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.023+0000 7f9e97400640 1 -- 172.21.15.144:0/4145386275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e840039b0 msgr2=0x7f9e84003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:28.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.023+0000 7f9e97400640 1 --2- 172.21.15.144:0/4145386275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e840039b0 0x7f9e84003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.023+0000 7f9e97400640 1 -- 172.21.15.144:0/4145386275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e84003520 con 0x7f9e84004800 2024-09-11T23:19:28.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.024+0000 7f9e97400640 1 --2- 172.21.15.144:0/4145386275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e84004800 0x7f9e84004c80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009a90 tx=0x7f9e84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a75f5e6634793 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:28.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.024+0000 7f9e9f400640 1 -- 172.21.15.144:0/4145386275 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88036070 con 0x7f9e84004800 2024-09-11T23:19:28.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.024+0000 7f9e9f400640 1 -- 172.21.15.144:0/4145386275 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e88031400 con 0x7f9e84004800 2024-09-11T23:19:28.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.024+0000 7f9e9f400640 1 -- 172.21.15.144:0/4145386275 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88009690 con 0x7f9e84004800 2024-09-11T23:19:28.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.024+0000 7f9ea7200640 1 -- 172.21.15.144:0/4145386275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e84004800 msgr2=0x7f9e84004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.024+0000 7f9ea7200640 1 --2- 172.21.15.144:0/4145386275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e84004800 0x7f9e84004c80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009a90 tx=0x7f9e84005830 comp rx=0 tx=0).stop 2024-09-11T23:19:28.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.025+0000 7f9ea5200640 1 -- 172.21.15.144:0/4145386275 reap_dead start 2024-09-11T23:19:28.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.025+0000 7f9ea7200640 1 -- 172.21.15.144:0/4145386275 shutdown_connections 2024-09-11T23:19:28.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.025+0000 7f9ea7200640 1 -- 172.21.15.144:0/4145386275 >> 172.21.15.144:0/4145386275 conn(0x7f9ea0062cc0 msgr2=0x7f9ea006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:28.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.025+0000 7f9ea7200640 1 -- 172.21.15.144:0/4145386275 shutdown_connections 2024-09-11T23:19:28.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.025+0000 7f9ea7200640 1 -- 172.21.15.144:0/4145386275 wait complete. 2024-09-11T23:19:28.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.026+0000 7f9ea7200640 1 Processor -- start 2024-09-11T23:19:28.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.027+0000 7f9ea7200640 1 -- start start 2024-09-11T23:19:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.027+0000 7f9ea7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e84004800 0x7f9ea01e9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.027+0000 7f9ea7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea01e8e70 0x7f9ea01e92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.027+0000 7f9ea7200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea015a8b0 0x7f9ea015ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.027+0000 7f9ea7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea015c560 con 0x7f9ea01e8e70 2024-09-11T23:19:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.027+0000 7f9ea7200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea00722f0 con 0x7f9ea015a8b0 2024-09-11T23:19:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.027+0000 7f9ea7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea015c6e0 con 0x7f9e84004800 2024-09-11T23:19:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.028+0000 7f9e97400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea01e8e70 0x7f9ea01e92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.028+0000 7f9e97400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea01e8e70 0x7f9ea01e92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37138/0 (socket says 172.21.15.144:37138) 2024-09-11T23:19:28.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.028+0000 7f9e9fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e84004800 0x7f9ea01e9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.028+0000 7f9e97400640 1 -- 172.21.15.144:0/1883299666 learned_addr learned my addr 172.21.15.144:0/1883299666 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.028+0000 7f9ea5200640 1 --2- 172.21.15.144:0/1883299666 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea015a8b0 0x7f9ea015ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.028+0000 7f9e97400640 1 -- 172.21.15.144:0/1883299666 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e84004800 msgr2=0x7f9ea01e9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.028+0000 7f9e97400640 1 --2- 172.21.15.144:0/1883299666 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e84004800 0x7f9ea01e9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.028+0000 7f9e97400640 1 -- 172.21.15.144:0/1883299666 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea015a8b0 msgr2=0x7f9ea015ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.028+0000 7f9e97400640 1 --2- 172.21.15.144:0/1883299666 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea015a8b0 0x7f9ea015ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.028+0000 7f9e97400640 1 -- 172.21.15.144:0/1883299666 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea01e7dd0 con 0x7f9ea01e8e70 2024-09-11T23:19:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.028+0000 7f9e97400640 1 --2- 172.21.15.144:0/1883299666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea01e8e70 0x7f9ea01e92f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9e88034040 tx=0x7f9e88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.029+0000 7f9e9cc00640 1 -- 172.21.15.144:0/1883299666 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88040070 con 0x7f9ea01e8e70 2024-09-11T23:19:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.029+0000 7f9e9cc00640 1 -- 172.21.15.144:0/1883299666 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8803b460 con 0x7f9ea01e8e70 2024-09-11T23:19:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.029+0000 7f9e9cc00640 1 -- 172.21.15.144:0/1883299666 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88036040 con 0x7f9ea01e8e70 2024-09-11T23:19:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.029+0000 7f9ea7200640 1 -- 172.21.15.144:0/1883299666 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea01e80b0 con 0x7f9ea01e8e70 2024-09-11T23:19:28.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.029+0000 7f9ea7200640 1 -- 172.21.15.144:0/1883299666 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea01e8670 con 0x7f9ea01e8e70 2024-09-11T23:19:28.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.030+0000 7f9ea7200640 1 -- 172.21.15.144:0/1883299666 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea00cdcf0 con 0x7f9ea01e8e70 2024-09-11T23:19:28.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.031+0000 7f9e9cc00640 1 -- 172.21.15.144:0/1883299666 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f9e88043070 con 0x7f9ea01e8e70 2024-09-11T23:19:28.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.031+0000 7f9e9cc00640 1 --2- 172.21.15.144:0/1883299666 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9e7c06bfe0 0x7f9e7c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.032+0000 7f9e9cc00640 1 -- 172.21.15.144:0/1883299666 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f9e880ab710 con 0x7f9ea01e8e70 2024-09-11T23:19:28.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.032+0000 7f9e9fe00640 1 --2- 172.21.15.144:0/1883299666 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9e7c06bfe0 0x7f9e7c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.032+0000 7f9e9fe00640 1 --2- 172.21.15.144:0/1883299666 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9e7c06bfe0 0x7f9e7c06e4a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9e90014510 tx=0x7f9e9000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:28.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.036+0000 7f9e9cc00640 1 -- 172.21.15.144:0/1883299666 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e88079800 con 0x7f9ea01e8e70 2024-09-11T23:19:28.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.246+0000 7f9ea7200640 1 -- 172.21.15.144:0/1883299666 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ea006f1e0 con 0x7f9ea01e8e70 2024-09-11T23:19:28.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.246+0000 7f9e9cc00640 1 -- 172.21.15.144:0/1883299666 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5232 (secure 0 0 0) 0x7f9e8807db00 con 0x7f9ea01e8e70 2024-09-11T23:19:28.246 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:28.246 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":25,"btime":"2024-09-11T23:19:25:826744+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:19:28.247 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 25 2024-09-11T23:19:28.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.248+0000 7f9ea7200640 1 -- 172.21.15.144:0/1883299666 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9e7c06bfe0 msgr2=0x7f9e7c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.248+0000 7f9ea7200640 1 --2- 172.21.15.144:0/1883299666 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9e7c06bfe0 0x7f9e7c06e4a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9e90014510 tx=0x7f9e9000b040 comp rx=0 tx=0).stop 2024-09-11T23:19:28.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.249+0000 7f9ea7200640 1 -- 172.21.15.144:0/1883299666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea01e8e70 msgr2=0x7f9ea01e92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.249+0000 7f9ea7200640 1 --2- 172.21.15.144:0/1883299666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea01e8e70 0x7f9ea01e92f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9e88034040 tx=0x7f9e88004730 comp rx=0 tx=0).stop 2024-09-11T23:19:28.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.249+0000 7f9ea7200640 1 -- 172.21.15.144:0/1883299666 shutdown_connections 2024-09-11T23:19:28.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.249+0000 7f9ea7200640 1 --2- 172.21.15.144:0/1883299666 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9e7c06bfe0 0x7f9e7c06e4a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.249+0000 7f9ea7200640 1 --2- 172.21.15.144:0/1883299666 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ea015a8b0 0x7f9ea015ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.249+0000 7f9ea7200640 1 --2- 172.21.15.144:0/1883299666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ea01e8e70 0x7f9ea01e92f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.249+0000 7f9ea7200640 1 --2- 172.21.15.144:0/1883299666 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9e84004800 0x7f9ea01e9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.249+0000 7f9ea7200640 1 -- 172.21.15.144:0/1883299666 >> 172.21.15.144:0/1883299666 conn(0x7f9ea0062cc0 msgr2=0x7f9ea0158a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:28.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.249+0000 7f9ea7200640 1 -- 172.21.15.144:0/1883299666 shutdown_connections 2024-09-11T23:19:28.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.249+0000 7f9ea7200640 1 -- 172.21.15.144:0/1883299666 wait complete. 2024-09-11T23:19:28.411 INFO:tasks.ceph.mds.a.smithi144.stderr:2024-09-11T23:19:28.411+0000 7fd8fb200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:19:28.669 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:19:22.219557+0000', 'modified': '2024-09-11T23:19:25.228354+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5247}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5247': {'gid': 5247, 'name': 'a', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6837/1940447658', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 1940447658}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 1940447658}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5247, 'qdb_cluster': [5247]} 2024-09-11T23:19:28.669 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:19:28.669 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T23:19:28.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.831+0000 7f4684000640 1 Processor -- start 2024-09-11T23:19:28.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.832+0000 7f4684000640 1 -- start start 2024-09-11T23:19:28.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.833+0000 7f4684000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f467c0d02a0 0x7f467c0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.833+0000 7f4684000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f467c15ceb0 0x7f467c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.833+0000 7f4684000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f467c0d0bc0 con 0x7f467c15ca40 2024-09-11T23:19:28.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.833+0000 7f4684000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f467c15d390 con 0x7f467c0d02a0 2024-09-11T23:19:28.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.833+0000 7f4684000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f467c15d670 con 0x7f467c15ceb0 2024-09-11T23:19:28.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.833+0000 7f4681600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f467c0d02a0 0x7f467c0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.833+0000 7f4680c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f467c15ca40 0x7f467c15e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34396/0 (socket says 172.21.15.144:34396) 2024-09-11T23:19:28.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.833+0000 7f4680c00640 1 -- 172.21.15.144:0/2964161106 learned_addr learned my addr 172.21.15.144:0/2964161106 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:28.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.833+0000 7f4681600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f467c0d02a0 0x7f467c0d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37144/0 (socket says 172.21.15.144:37144) 2024-09-11T23:19:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.833+0000 7f4682000640 1 --2- 172.21.15.144:0/2964161106 >> v2:172.21.15.165:3300/0 conn(0x7f467c15ceb0 0x7f467c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.834+0000 7f4681600640 1 -- 172.21.15.144:0/2964161106 >> v2:172.21.15.165:3300/0 conn(0x7f467c15ceb0 msgr2=0x7f467c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.834+0000 7f4681600640 1 --2- 172.21.15.144:0/2964161106 >> v2:172.21.15.165:3300/0 conn(0x7f467c15ceb0 0x7f467c1594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.834+0000 7f4681600640 1 -- 172.21.15.144:0/2964161106 >> v1:172.21.15.144:6789/0 conn(0x7f467c15ca40 legacy=0x7f467c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.834+0000 7f4681600640 1 -- 172.21.15.144:0/2964161106 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467c15d950 con 0x7f467c0d02a0 2024-09-11T23:19:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.834+0000 7f4682000640 1 --2- 172.21.15.144:0/2964161106 >> v2:172.21.15.165:3300/0 conn(0x7f467c15ceb0 0x7f467c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.834+0000 7f467be00640 1 -- 172.21.15.144:0/2964161106 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1870084221 0 0) 0x7f467c0d0bc0 con 0x7f467c15ca40 2024-09-11T23:19:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.835+0000 7f4681600640 1 --2- 172.21.15.144:0/2964161106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467c0d02a0 0x7f467c0d0680 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f467c0b52b0 tx=0x7f467002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9106be44df52af40 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.835+0000 7f467be00640 1 -- 172.21.15.144:0/2964161106 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4670037070 con 0x7f467c0d02a0 2024-09-11T23:19:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.835+0000 7f467be00640 1 -- 172.21.15.144:0/2964161106 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4670032440 con 0x7f467c0d02a0 2024-09-11T23:19:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.835+0000 7f467be00640 1 -- 172.21.15.144:0/2964161106 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467002ae60 con 0x7f467c0d02a0 2024-09-11T23:19:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.835+0000 7f4684000640 1 -- 172.21.15.144:0/2964161106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467c0d02a0 msgr2=0x7f467c0d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.835+0000 7f4684000640 1 --2- 172.21.15.144:0/2964161106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467c0d02a0 0x7f467c0d0680 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f467c0b52b0 tx=0x7f467002a110 comp rx=0 tx=0).stop 2024-09-11T23:19:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.835+0000 7f4684000640 1 -- 172.21.15.144:0/2964161106 shutdown_connections 2024-09-11T23:19:28.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.835+0000 7f4684000640 1 --2- 172.21.15.144:0/2964161106 >> v2:172.21.15.165:3300/0 conn(0x7f467c15ceb0 0x7f467c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.835+0000 7f4684000640 1 --2- 172.21.15.144:0/2964161106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467c0d02a0 0x7f467c0d0680 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.835+0000 7f4684000640 1 -- 172.21.15.144:0/2964161106 >> 172.21.15.144:0/2964161106 conn(0x7f467c062cc0 msgr2=0x7f467c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:28.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.836+0000 7f4684000640 1 -- 172.21.15.144:0/2964161106 shutdown_connections 2024-09-11T23:19:28.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.836+0000 7f4684000640 1 -- 172.21.15.144:0/2964161106 wait complete. 2024-09-11T23:19:28.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.837+0000 7f4684000640 1 Processor -- start 2024-09-11T23:19:28.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.837+0000 7f4684000640 1 -- start start 2024-09-11T23:19:28.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.838+0000 7f4684000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f467c0d02a0 0x7f467c157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.838+0000 7f4684000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467c15ca40 0x7f467c158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.838+0000 7f4684000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f467c15ceb0 0x7f467c0714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.838+0000 7f4684000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f467c15eb40 con 0x7f467c15ca40 2024-09-11T23:19:28.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.838+0000 7f4684000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f467c15df10 con 0x7f467c0d02a0 2024-09-11T23:19:28.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.838+0000 7f4684000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f467c155b90 con 0x7f467c15ceb0 2024-09-11T23:19:28.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.839+0000 7f4680c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467c15ca40 0x7f467c158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.839+0000 7f4680c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467c15ca40 0x7f467c158710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37146/0 (socket says 172.21.15.144:37146) 2024-09-11T23:19:28.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.839+0000 7f4680c00640 1 -- 172.21.15.144:0/2203115067 learned_addr learned my addr 172.21.15.144:0/2203115067 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:28.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.839+0000 7f4681600640 1 --2- 172.21.15.144:0/2203115067 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f467c0d02a0 0x7f467c157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.839+0000 7f4682000640 1 --2- 172.21.15.144:0/2203115067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f467c15ceb0 0x7f467c0714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.839+0000 7f4680c00640 1 -- 172.21.15.144:0/2203115067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f467c15ceb0 msgr2=0x7f467c0714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.839+0000 7f4680c00640 1 --2- 172.21.15.144:0/2203115067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f467c15ceb0 0x7f467c0714d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.839+0000 7f4680c00640 1 -- 172.21.15.144:0/2203115067 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f467c0d02a0 msgr2=0x7f467c157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.839+0000 7f4680c00640 1 --2- 172.21.15.144:0/2203115067 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f467c0d02a0 0x7f467c157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.839+0000 7f4680c00640 1 -- 172.21.15.144:0/2203115067 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467c156b70 con 0x7f467c15ca40 2024-09-11T23:19:28.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.839+0000 7f4680c00640 1 --2- 172.21.15.144:0/2203115067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467c15ca40 0x7f467c158710 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f466800c4d0 tx=0x7f466800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:28.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.840+0000 7f4679600640 1 -- 172.21.15.144:0/2203115067 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668018070 con 0x7f467c15ca40 2024-09-11T23:19:28.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.840+0000 7f4679600640 1 -- 172.21.15.144:0/2203115067 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4668007500 con 0x7f467c15ca40 2024-09-11T23:19:28.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.840+0000 7f4679600640 1 -- 172.21.15.144:0/2203115067 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668004a20 con 0x7f467c15ca40 2024-09-11T23:19:28.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.840+0000 7f4684000640 1 -- 172.21.15.144:0/2203115067 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467c156e50 con 0x7f467c15ca40 2024-09-11T23:19:28.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.840+0000 7f4684000640 1 -- 172.21.15.144:0/2203115067 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f467c157410 con 0x7f467c15ca40 2024-09-11T23:19:28.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.842+0000 7f4679600640 1 -- 172.21.15.144:0/2203115067 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f4668004bc0 con 0x7f467c15ca40 2024-09-11T23:19:28.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.843+0000 7f4679600640 1 --2- 172.21.15.144:0/2203115067 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f465c06bfe0 0x7f465c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.843+0000 7f4679600640 1 -- 172.21.15.144:0/2203115067 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f466808a320 con 0x7f467c15ca40 2024-09-11T23:19:28.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.843+0000 7f4681600640 1 --2- 172.21.15.144:0/2203115067 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f465c06bfe0 0x7f465c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.843+0000 7f4686de3740 1 Processor -- start 2024-09-11T23:19:28.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.843+0000 7f4686de3740 1 -- start start 2024-09-11T23:19:28.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.844+0000 7f4681600640 1 --2- 172.21.15.144:0/2203115067 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f465c06bfe0 0x7f465c06e4a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4670034000 tx=0x7f467002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:28.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.844+0000 7f4686de3740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed36cf0 0x55ff0ed7c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.844+0000 7f4686de3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed344b0 0x55ff0ed370d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.844+0000 7f4686de3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed38480 0x55ff0ed31570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.844+0000 7f4686de3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ff0ec953b0 con 0x55ff0ed38480 2024-09-11T23:19:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.844+0000 7f4686de3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ff0ec9a410 con 0x55ff0ed344b0 2024-09-11T23:19:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.844+0000 7f4686de3740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ff0ec42620 con 0x55ff0ed36cf0 2024-09-11T23:19:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.845+0000 7f4682000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed38480 0x55ff0ed31570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.845+0000 7f4681600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed36cf0 0x55ff0ed7c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.845+0000 7f4682000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed38480 0x55ff0ed31570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37150/0 (socket says 172.21.15.144:37150) 2024-09-11T23:19:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.845+0000 7f4682000640 1 -- 172.21.15.144:0/1128960018 learned_addr learned my addr 172.21.15.144:0/1128960018 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.845+0000 7f4680c00640 1 --2- 172.21.15.144:0/1128960018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed344b0 0x55ff0ed370d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.845+0000 7f4682000640 1 -- 172.21.15.144:0/1128960018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed36cf0 msgr2=0x55ff0ed7c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:28.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.845+0000 7f4682000640 1 --2- 172.21.15.144:0/1128960018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed36cf0 0x55ff0ed7c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.845+0000 7f4682000640 1 -- 172.21.15.144:0/1128960018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed344b0 msgr2=0x55ff0ed370d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:28.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.845+0000 7f4682000640 1 --2- 172.21.15.144:0/1128960018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed344b0 0x55ff0ed370d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.845+0000 7f4682000640 1 -- 172.21.15.144:0/1128960018 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff0e9ad2d0 con 0x55ff0ed38480 2024-09-11T23:19:28.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.845+0000 7f4682000640 1 --2- 172.21.15.144:0/1128960018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed38480 0x55ff0ed31570 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f467400f4d0 tx=0x7f467400f990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83119165607d082e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:28.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.845+0000 7f466dc00640 1 -- 172.21.15.144:0/1128960018 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467400d980 con 0x55ff0ed38480 2024-09-11T23:19:28.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.845+0000 7f466dc00640 1 -- 172.21.15.144:0/1128960018 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467400db20 con 0x55ff0ed38480 2024-09-11T23:19:28.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.845+0000 7f466dc00640 1 -- 172.21.15.144:0/1128960018 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674018440 con 0x55ff0ed38480 2024-09-11T23:19:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.846+0000 7f4686de3740 1 -- 172.21.15.144:0/1128960018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed38480 msgr2=0x55ff0ed31570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.846+0000 7f4686de3740 1 --2- 172.21.15.144:0/1128960018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed38480 0x55ff0ed31570 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f467400f4d0 tx=0x7f467400f990 comp rx=0 tx=0).stop 2024-09-11T23:19:28.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.846+0000 7f4686de3740 1 -- 172.21.15.144:0/1128960018 shutdown_connections 2024-09-11T23:19:28.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.846+0000 7f4686de3740 1 --2- 172.21.15.144:0/1128960018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed38480 0x55ff0ed31570 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.846+0000 7f4686de3740 1 --2- 172.21.15.144:0/1128960018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed344b0 0x55ff0ed370d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.846+0000 7f4686de3740 1 --2- 172.21.15.144:0/1128960018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed36cf0 0x55ff0ed7c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.846+0000 7f4686de3740 1 -- 172.21.15.144:0/1128960018 >> 172.21.15.144:0/1128960018 conn(0x55ff0ed33740 msgr2=0x55ff0ed7b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:28.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.846+0000 7f4686de3740 1 -- 172.21.15.144:0/1128960018 shutdown_connections 2024-09-11T23:19:28.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.846+0000 7f4686de3740 1 -- 172.21.15.144:0/1128960018 wait complete. 2024-09-11T23:19:28.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.847+0000 7f4686de3740 1 -- start start 2024-09-11T23:19:28.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.847+0000 7f4686de3740 1 Processor -- start 2024-09-11T23:19:28.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.848+0000 7f4686de3740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed36cf0 0x55ff0ed8f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.848+0000 7f4686de3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed38480 0x55ff0ed31750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.848+0000 7f4686de3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 0x55ff0ed350a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.848+0000 7f4686de3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ff0ec55780 con 0x55ff0ed56770 2024-09-11T23:19:28.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.848+0000 7f4686de3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ff0ec963d0 con 0x55ff0ed38480 2024-09-11T23:19:28.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.848+0000 7f4686de3740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ff0ed32be0 con 0x55ff0ed36cf0 2024-09-11T23:19:28.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.848+0000 7f4686de3740 10 client.0 _ll_register_callbacks cb 0x55ff0ec935d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:19:28.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.849+0000 7f4682000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 0x55ff0ed350a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.849+0000 7f4682000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 0x55ff0ed350a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37152/0 (socket says 172.21.15.144:37152) 2024-09-11T23:19:28.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.849+0000 7f4681600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed36cf0 0x55ff0ed8f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.849+0000 7f4682000640 1 -- 172.21.15.144:0/4181460501 learned_addr learned my addr 172.21.15.144:0/4181460501 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:28.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.849+0000 7f4680c00640 1 --2- 172.21.15.144:0/4181460501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed38480 0x55ff0ed31750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.849+0000 7f4682000640 1 -- 172.21.15.144:0/4181460501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed36cf0 msgr2=0x55ff0ed8f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:28.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.849+0000 7f4682000640 1 --2- 172.21.15.144:0/4181460501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed36cf0 0x55ff0ed8f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.849+0000 7f4682000640 1 -- 172.21.15.144:0/4181460501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed38480 msgr2=0x55ff0ed31750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:28.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.849+0000 7f4682000640 1 --2- 172.21.15.144:0/4181460501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed38480 0x55ff0ed31750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.849+0000 7f4682000640 1 -- 172.21.15.144:0/4181460501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff0ea776b0 con 0x55ff0ed56770 2024-09-11T23:19:28.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.849+0000 7f4682000640 1 --2- 172.21.15.144:0/4181460501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 0x55ff0ed350a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f46740070c0 tx=0x7f4674004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afffc785c30c0075 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:28.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.849+0000 7f4662000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:19:28.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.849+0000 7f4662000640 1 -- 172.21.15.144:0/4181460501 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674025020 con 0x55ff0ed56770 2024-09-11T23:19:28.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.849+0000 7f4686de3740 1 -- 172.21.15.144:0/4181460501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f467400db20 con 0x55ff0ed56770 2024-09-11T23:19:28.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.850+0000 7f4662000640 1 -- 172.21.15.144:0/4181460501 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f4674003990 con 0x55ff0ed56770 2024-09-11T23:19:28.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.850+0000 7f4662000640 1 -- 172.21.15.144:0/4181460501 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4674007cb0 con 0x55ff0ed56770 2024-09-11T23:19:28.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.850+0000 7f4686de3740 10 client.5367 fetch_fsmap learned FSMap version 25 2024-09-11T23:19:28.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.850+0000 7f4686de3740 1 -- 172.21.15.144:0/4181460501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55ff0ed56250 con 0x55ff0ed56770 2024-09-11T23:19:28.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.850+0000 7f4662000640 1 -- 172.21.15.144:0/4181460501 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467400db20 con 0x55ff0ed56770 2024-09-11T23:19:28.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.850+0000 7f4662000640 1 -- 172.21.15.144:0/4181460501 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f4674016070 con 0x55ff0ed56770 2024-09-11T23:19:28.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.850+0000 7f4686de3740 10 client.5367 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T23:19:28.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.850+0000 7f4686de3740 10 client.5367 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T23:19:28.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.850+0000 7f4686de3740 20 client.5367 populate_metadata read hostname 'smithi144' 2024-09-11T23:19:28.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.850+0000 7f4686de3740 1 --2- 172.21.15.144:0/4181460501 >> [v2:172.21.15.144:6834/1940447658,v1:172.21.15.144:6837/1940447658] conn(0x55ff0ed57870 0x55ff0ed30c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.850+0000 7f4686de3740 4 client.5367 mds_command: new command op to 5247 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:19:28.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.850+0000 7f4686de3740 1 -- 172.21.15.144:0/4181460501 --> [v2:172.21.15.144:6834/1940447658,v1:172.21.15.144:6837/1940447658] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff0eca7b40 con 0x55ff0ed57870 2024-09-11T23:19:28.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.850+0000 7f4681600640 1 --2- 172.21.15.144:0/4181460501 >> [v2:172.21.15.144:6834/1940447658,v1:172.21.15.144:6837/1940447658] conn(0x55ff0ed57870 0x55ff0ed30c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.851+0000 7f4662000640 10 client.5367 ms_handle_connect on v2:172.21.15.144:6834/1940447658 2024-09-11T23:19:28.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.851+0000 7f4681600640 1 --2- 172.21.15.144:0/4181460501 >> [v2:172.21.15.144:6834/1940447658,v1:172.21.15.144:6837/1940447658] conn(0x55ff0ed57870 0x55ff0ed30c20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa558e3da488aad7 server_cookie=5fabf3ee2588f72d in_seq=0 out_seq=0 2024-09-11T23:19:28.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.852+0000 7f4662000640 1 -- 172.21.15.144:0/4181460501 <== mds.0 v2:172.21.15.144:6834/1940447658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff0eca7b40 con 0x55ff0ed57870 2024-09-11T23:19:28.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.852+0000 7f4662000640 10 client.5367 handle_command_reply: tid=0 2024-09-11T23:19:28.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.852+0000 7f4686de3740 1 client.5367 shutdown 2024-09-11T23:19:28.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.852+0000 7f4686de3740 1 -- 172.21.15.144:0/4181460501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 msgr2=0x55ff0ed350a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.852+0000 7f4686de3740 1 --2- 172.21.15.144:0/4181460501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 0x55ff0ed350a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f46740070c0 tx=0x7f4674004ab0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.852+0000 7f4686de3740 1 -- 172.21.15.144:0/4181460501 shutdown_connections 2024-09-11T23:19:28.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.852+0000 7f4686de3740 1 --2- 172.21.15.144:0/4181460501 >> [v2:172.21.15.144:6834/1940447658,v1:172.21.15.144:6837/1940447658] conn(0x55ff0ed57870 0x55ff0ed30c20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.852+0000 7f4686de3740 1 --2- 172.21.15.144:0/4181460501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 0x55ff0ed350a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.852+0000 7f4686de3740 1 --2- 172.21.15.144:0/4181460501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed38480 0x55ff0ed31750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.852+0000 7f4686de3740 1 --2- 172.21.15.144:0/4181460501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed36cf0 0x55ff0ed8f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.852+0000 7f4662000640 0 client.5367 ms_handle_reset on v2:172.21.15.144:6834/1940447658 2024-09-11T23:19:28.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.852+0000 7f4686de3740 1 -- 172.21.15.144:0/4181460501 >> 172.21.15.144:0/4181460501 conn(0x55ff0ed344b0 msgr2=0x55ff0ed7b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:28.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.852+0000 7f4686de3740 1 -- 172.21.15.144:0/4181460501 shutdown_connections 2024-09-11T23:19:28.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.852+0000 7f4686de3740 1 -- 172.21.15.144:0/4181460501 wait complete. 2024-09-11T23:19:28.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.852+0000 7f4686de3740 20 client.5367 trim_cache size 0 max 16384 2024-09-11T23:19:28.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.870+0000 7f4686de3740 1 Processor -- start 2024-09-11T23:19:28.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.871+0000 7f4686de3740 1 -- start start 2024-09-11T23:19:28.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.871+0000 7f4686de3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed36cf0 0x55ff0ed34a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.871+0000 7f4686de3740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed38480 0x55ff0ed34f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.871+0000 7f4686de3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 0x55ff0ed30c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.871+0000 7f4686de3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f467c0aef10 con 0x55ff0ed56770 2024-09-11T23:19:28.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.871+0000 7f4686de3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f467c153d00 con 0x55ff0ed36cf0 2024-09-11T23:19:28.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.871+0000 7f4686de3740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f467c0ae8c0 con 0x55ff0ed38480 2024-09-11T23:19:28.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.872+0000 7f4682000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 0x55ff0ed30c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.872+0000 7f4682000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 0x55ff0ed30c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37162/0 (socket says 172.21.15.144:37162) 2024-09-11T23:19:28.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.872+0000 7f4682000640 1 -- 172.21.15.144:0/1300162719 learned_addr learned my addr 172.21.15.144:0/1300162719 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:28.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.872+0000 7f4680c00640 1 --2- 172.21.15.144:0/1300162719 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed38480 0x55ff0ed34f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.872+0000 7f4681600640 1 --2- 172.21.15.144:0/1300162719 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed36cf0 0x55ff0ed34a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.872+0000 7f4682000640 1 -- 172.21.15.144:0/1300162719 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed38480 msgr2=0x55ff0ed34f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:28.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.872+0000 7f4682000640 1 --2- 172.21.15.144:0/1300162719 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed38480 0x55ff0ed34f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.872+0000 7f4682000640 1 -- 172.21.15.144:0/1300162719 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed36cf0 msgr2=0x55ff0ed34a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:28.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.872+0000 7f4682000640 1 --2- 172.21.15.144:0/1300162719 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed36cf0 0x55ff0ed34a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.872+0000 7f4682000640 1 -- 172.21.15.144:0/1300162719 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff0ed37420 con 0x55ff0ed56770 2024-09-11T23:19:28.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.872+0000 7f4682000640 1 --2- 172.21.15.144:0/1300162719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 0x55ff0ed30c20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4674010fd0 tx=0x7f4674020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb84c83ea6ddf358 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:28.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.873+0000 7f466d200640 1 -- 172.21.15.144:0/1300162719 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674003990 con 0x55ff0ed56770 2024-09-11T23:19:28.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.873+0000 7f466d200640 1 -- 172.21.15.144:0/1300162719 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4674007c30 con 0x55ff0ed56770 2024-09-11T23:19:28.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.873+0000 7f466d200640 1 -- 172.21.15.144:0/1300162719 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467400da80 con 0x55ff0ed56770 2024-09-11T23:19:28.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.873+0000 7f4686de3740 1 -- 172.21.15.144:0/1300162719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 msgr2=0x55ff0ed30c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.873+0000 7f4686de3740 1 --2- 172.21.15.144:0/1300162719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 0x55ff0ed30c20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4674010fd0 tx=0x7f4674020000 comp rx=0 tx=0).stop 2024-09-11T23:19:28.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.873+0000 7f4686de3740 1 -- 172.21.15.144:0/1300162719 shutdown_connections 2024-09-11T23:19:28.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.873+0000 7f4686de3740 1 --2- 172.21.15.144:0/1300162719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 0x55ff0ed30c20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.873+0000 7f4686de3740 1 --2- 172.21.15.144:0/1300162719 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed38480 0x55ff0ed34f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.873+0000 7f4686de3740 1 --2- 172.21.15.144:0/1300162719 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed36cf0 0x55ff0ed34a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.873+0000 7f4686de3740 1 -- 172.21.15.144:0/1300162719 >> 172.21.15.144:0/1300162719 conn(0x55ff0ed344b0 msgr2=0x55ff0ed7d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:28.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.873+0000 7f4686de3740 1 -- 172.21.15.144:0/1300162719 shutdown_connections 2024-09-11T23:19:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.873+0000 7f4686de3740 1 -- 172.21.15.144:0/1300162719 wait complete. 2024-09-11T23:19:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.874+0000 7f4686de3740 1 -- start start 2024-09-11T23:19:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.874+0000 7f4686de3740 1 Processor -- start 2024-09-11T23:19:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.875+0000 7f4686de3740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed36cf0 0x55ff0eddff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.875+0000 7f4686de3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed38480 0x55ff0ed54c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.875+0000 7f4686de3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 0x55ff0ed55190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.875+0000 7f4686de3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ff0ed576f0 con 0x55ff0ed56770 2024-09-11T23:19:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.875+0000 7f4686de3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ff0ed31c90 con 0x55ff0ed38480 2024-09-11T23:19:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.875+0000 7f4686de3740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ff0ed57d40 con 0x55ff0ed36cf0 2024-09-11T23:19:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.875+0000 7f4686de3740 10 client.0 _ll_register_callbacks cb 0x7f46740075a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:19:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.875+0000 7f4682000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 0x55ff0ed55190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.875+0000 7f4682000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 0x55ff0ed55190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37178/0 (socket says 172.21.15.144:37178) 2024-09-11T23:19:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.875+0000 7f4682000640 1 -- 172.21.15.144:0/1374201045 learned_addr learned my addr 172.21.15.144:0/1374201045 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:28.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.876+0000 7f4680c00640 1 --2- 172.21.15.144:0/1374201045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed38480 0x55ff0ed54c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.876+0000 7f4681600640 1 --2- 172.21.15.144:0/1374201045 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed36cf0 0x55ff0eddff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.876+0000 7f4682000640 1 -- 172.21.15.144:0/1374201045 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed36cf0 msgr2=0x55ff0eddff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:28.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.876+0000 7f4682000640 1 --2- 172.21.15.144:0/1374201045 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed36cf0 0x55ff0eddff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.876+0000 7f4682000640 1 -- 172.21.15.144:0/1374201045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed38480 msgr2=0x55ff0ed54c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:28.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.876+0000 7f4682000640 1 --2- 172.21.15.144:0/1374201045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed38480 0x55ff0ed54c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.876+0000 7f4682000640 1 -- 172.21.15.144:0/1374201045 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff0ede0450 con 0x55ff0ed56770 2024-09-11T23:19:28.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.876+0000 7f4680c00640 1 --2- 172.21.15.144:0/1374201045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed38480 0x55ff0ed54c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:28.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.876+0000 7f4681600640 1 --2- 172.21.15.144:0/1374201045 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed36cf0 0x55ff0eddff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:28.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.876+0000 7f4682000640 1 --2- 172.21.15.144:0/1374201045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 0x55ff0ed55190 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f467402c040 tx=0x7f467400a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f44e6c7ac4025d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:28.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.876+0000 7f4662000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:19:28.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.876+0000 7f4662000640 1 -- 172.21.15.144:0/1374201045 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674039070 con 0x55ff0ed56770 2024-09-11T23:19:28.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.876+0000 7f4662000640 1 -- 172.21.15.144:0/1374201045 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f467403eab0 con 0x55ff0ed56770 2024-09-11T23:19:28.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.876+0000 7f4686de3740 1 -- 172.21.15.144:0/1374201045 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4674007c30 con 0x55ff0ed56770 2024-09-11T23:19:28.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.876+0000 7f4662000640 1 -- 172.21.15.144:0/1374201045 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f467403ecb0 con 0x55ff0ed56770 2024-09-11T23:19:28.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.876+0000 7f4686de3740 10 client.5373 fetch_fsmap learned FSMap version 25 2024-09-11T23:19:28.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.876+0000 7f4686de3740 1 -- 172.21.15.144:0/1374201045 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55ff0edfe610 con 0x55ff0ed56770 2024-09-11T23:19:28.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.877+0000 7f4662000640 1 -- 172.21.15.144:0/1374201045 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4674007c30 con 0x55ff0ed56770 2024-09-11T23:19:28.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.877+0000 7f4662000640 1 -- 172.21.15.144:0/1374201045 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7f4674016040 con 0x55ff0ed56770 2024-09-11T23:19:28.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.877+0000 7f4686de3740 10 client.5373 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T23:19:28.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.877+0000 7f4686de3740 10 client.5373 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T23:19:28.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.877+0000 7f4686de3740 20 client.5373 populate_metadata read hostname 'smithi144' 2024-09-11T23:19:28.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.877+0000 7f4686de3740 1 --2- 172.21.15.144:0/1374201045 >> [v2:172.21.15.144:6834/1940447658,v1:172.21.15.144:6837/1940447658] conn(0x55ff0edfa970 0x55ff0edfad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:28.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.877+0000 7f4686de3740 4 client.5373 mds_command: new command op to 5247 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:19:28.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.877+0000 7f4686de3740 1 -- 172.21.15.144:0/1374201045 --> [v2:172.21.15.144:6834/1940447658,v1:172.21.15.144:6837/1940447658] -- command(tid 0: {"prefix": "status"}) -- 0x55ff0eca1e90 con 0x55ff0edfa970 2024-09-11T23:19:28.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.877+0000 7f4681600640 1 --2- 172.21.15.144:0/1374201045 >> [v2:172.21.15.144:6834/1940447658,v1:172.21.15.144:6837/1940447658] conn(0x55ff0edfa970 0x55ff0edfad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:28.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.878+0000 7f4662000640 10 client.5373 ms_handle_connect on v2:172.21.15.144:6834/1940447658 2024-09-11T23:19:28.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.877+0000 7f4681600640 1 --2- 172.21.15.144:0/1374201045 >> [v2:172.21.15.144:6834/1940447658,v1:172.21.15.144:6837/1940447658] conn(0x55ff0edfa970 0x55ff0edfad50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c3672a7446aa293 server_cookie=39dd1cd7dfad9d17 in_seq=0 out_seq=0 2024-09-11T23:19:28.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.878+0000 7f4662000640 1 -- 172.21.15.144:0/1374201045 <== mds.0 v2:172.21.15.144:6834/1940447658 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55ff0eca1e90 con 0x55ff0edfa970 2024-09-11T23:19:28.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.878+0000 7f4662000640 10 client.5373 handle_command_reply: tid=0 2024-09-11T23:19:28.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.878+0000 7f4686de3740 1 client.5373 shutdown 2024-09-11T23:19:28.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.878+0000 7f4686de3740 1 -- 172.21.15.144:0/1374201045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 msgr2=0x55ff0ed55190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.878+0000 7f4686de3740 1 --2- 172.21.15.144:0/1374201045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 0x55ff0ed55190 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f467402c040 tx=0x7f467400a000 comp rx=0 tx=0).stop 2024-09-11T23:19:28.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.878+0000 7f4686de3740 1 -- 172.21.15.144:0/1374201045 shutdown_connections 2024-09-11T23:19:28.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.878+0000 7f4686de3740 1 --2- 172.21.15.144:0/1374201045 >> [v2:172.21.15.144:6834/1940447658,v1:172.21.15.144:6837/1940447658] conn(0x55ff0edfa970 0x55ff0edfad50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.878+0000 7f4686de3740 1 --2- 172.21.15.144:0/1374201045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ff0ed56770 0x55ff0ed55190 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.878+0000 7f4686de3740 1 --2- 172.21.15.144:0/1374201045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ff0ed38480 0x55ff0ed54c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.878+0000 7f4686de3740 1 --2- 172.21.15.144:0/1374201045 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ff0ed36cf0 0x55ff0eddff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.878+0000 7f4662000640 0 client.5373 ms_handle_reset on v2:172.21.15.144:6834/1940447658 2024-09-11T23:19:28.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.878+0000 7f4686de3740 1 -- 172.21.15.144:0/1374201045 >> 172.21.15.144:0/1374201045 conn(0x55ff0ed344b0 msgr2=0x55ff0ed34a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:28.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.878+0000 7f4686de3740 1 -- 172.21.15.144:0/1374201045 shutdown_connections 2024-09-11T23:19:28.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.878+0000 7f4686de3740 1 -- 172.21.15.144:0/1374201045 wait complete. 2024-09-11T23:19:28.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.878+0000 7f4686de3740 20 client.5373 trim_cache size 0 max 16384 2024-09-11T23:19:28.883 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:19:28.883 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "4b73e4b7-12f0-4e37-94bc-45e333efe84e", 2024-09-11T23:19:28.883 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-11T23:19:28.883 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 5247, 2024-09-11T23:19:28.884 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-11T23:19:28.884 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-11T23:19:28.884 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-11T23:19:28.884 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 6.0733379679999997, 2024-09-11T23:19:28.884 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 25, 2024-09-11T23:19:28.884 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 46, 2024-09-11T23:19:28.884 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 46, 2024-09-11T23:19:28.884 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 11.150543361 2024-09-11T23:19:28.884 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:19:28.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.879+0000 7f4684000640 1 -- 172.21.15.144:0/2203115067 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f465c06bfe0 msgr2=0x7f465c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.879+0000 7f4684000640 1 --2- 172.21.15.144:0/2203115067 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f465c06bfe0 0x7f465c06e4a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4670034000 tx=0x7f467002e000 comp rx=0 tx=0).stop 2024-09-11T23:19:28.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.879+0000 7f4684000640 1 -- 172.21.15.144:0/2203115067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467c15ca40 msgr2=0x7f467c158710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:28.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.879+0000 7f4684000640 1 --2- 172.21.15.144:0/2203115067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467c15ca40 0x7f467c158710 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f466800c4d0 tx=0x7f466800c990 comp rx=0 tx=0).stop 2024-09-11T23:19:28.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.879+0000 7f4684000640 1 -- 172.21.15.144:0/2203115067 shutdown_connections 2024-09-11T23:19:28.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.879+0000 7f4684000640 1 --2- 172.21.15.144:0/2203115067 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f465c06bfe0 0x7f465c06e4a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.879+0000 7f4684000640 1 --2- 172.21.15.144:0/2203115067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f467c15ceb0 0x7f467c0714d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.879+0000 7f4684000640 1 --2- 172.21.15.144:0/2203115067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f467c15ca40 0x7f467c158710 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.879+0000 7f4684000640 1 --2- 172.21.15.144:0/2203115067 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f467c0d02a0 0x7f467c157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:28.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.879+0000 7f4684000640 1 -- 172.21.15.144:0/2203115067 >> 172.21.15.144:0/2203115067 conn(0x7f467c062cc0 msgr2=0x7f467c0b5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:28.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.879+0000 7f4684000640 1 -- 172.21.15.144:0/2203115067 shutdown_connections 2024-09-11T23:19:28.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:28.879+0000 7f4684000640 1 -- 172.21.15.144:0/2203115067 wait complete. 2024-09-11T23:19:28.895 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:19:29.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.052+0000 7f8251e00640 1 Processor -- start 2024-09-11T23:19:29.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.052+0000 7f8251e00640 1 -- start start 2024-09-11T23:19:29.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.053+0000 7f8251e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f824c0b5590 0x7f824c06f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.053+0000 7f8251e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c06f7e0 0x7f824c06d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.053+0000 7f8251e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f824c06fc30 con 0x7f824c15c010 2024-09-11T23:19:29.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.053+0000 7f8251e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f824c0b5bb0 con 0x7f824c0b5590 2024-09-11T23:19:29.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.053+0000 7f8251e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f824c0b5e90 con 0x7f824c06f7e0 2024-09-11T23:19:29.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.053+0000 7f8251400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c06f7e0 0x7f824c06d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.054+0000 7f8243e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f824c0b5590 0x7f824c06f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.054+0000 7f8251400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c06f7e0 0x7f824c06d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:40948/0 (socket says 172.21.15.144:40948) 2024-09-11T23:19:29.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.054+0000 7f8251400640 1 -- 172.21.15.144:0/1617618146 learned_addr learned my addr 172.21.15.144:0/1617618146 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:29.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.054+0000 7f8243e00640 1 -- 172.21.15.144:0/1617618146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c06f7e0 msgr2=0x7f824c06d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:29.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.054+0000 7f8243e00640 1 --2- 172.21.15.144:0/1617618146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c06f7e0 0x7f824c06d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.054+0000 7f8243e00640 1 -- 172.21.15.144:0/1617618146 >> v1:172.21.15.165:6789/0 conn(0x7f824c15c010 legacy=0x7f824c15f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.054+0000 7f8243e00640 1 -- 172.21.15.144:0/1617618146 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824c0b6170 con 0x7f824c0b5590 2024-09-11T23:19:29.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.054+0000 7f8251400640 1 --2- 172.21.15.144:0/1617618146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c06f7e0 0x7f824c06d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:19:29.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.054+0000 7f824be00640 1 -- 172.21.15.144:0/1617618146 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1198524218 0 0) 0x7f823c001110 con 0x7f824c15c010 2024-09-11T23:19:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.055+0000 7f8243e00640 1 --2- 172.21.15.144:0/1617618146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c0b5590 0x7f824c06f2a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f82340097a0 tx=0x7f823402a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23d3ec4ecd2f223d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.055+0000 7f824be00640 1 -- 172.21.15.144:0/1617618146 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234037070 con 0x7f824c0b5590 2024-09-11T23:19:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.055+0000 7f824be00640 1 -- 172.21.15.144:0/1617618146 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f823402adb0 con 0x7f824c0b5590 2024-09-11T23:19:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.055+0000 7f824be00640 1 -- 172.21.15.144:0/1617618146 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234032660 con 0x7f824c0b5590 2024-09-11T23:19:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.056+0000 7f8251e00640 1 -- 172.21.15.144:0/1617618146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c0b5590 msgr2=0x7f824c06f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.056+0000 7f8251e00640 1 --2- 172.21.15.144:0/1617618146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c0b5590 0x7f824c06f2a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f82340097a0 tx=0x7f823402a060 comp rx=0 tx=0).stop 2024-09-11T23:19:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.056+0000 7f8251e00640 1 -- 172.21.15.144:0/1617618146 shutdown_connections 2024-09-11T23:19:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.056+0000 7f8251e00640 1 --2- 172.21.15.144:0/1617618146 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c06f7e0 0x7f824c06d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.056+0000 7f8251e00640 1 --2- 172.21.15.144:0/1617618146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c0b5590 0x7f824c06f2a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.056+0000 7f8251e00640 1 -- 172.21.15.144:0/1617618146 >> 172.21.15.144:0/1617618146 conn(0x7f824c062630 msgr2=0x7f824c062a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:29.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.056+0000 7f8251e00640 1 -- 172.21.15.144:0/1617618146 shutdown_connections 2024-09-11T23:19:29.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.056+0000 7f8251e00640 1 -- 172.21.15.144:0/1617618146 wait complete. 2024-09-11T23:19:29.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.058+0000 7f8251e00640 1 Processor -- start 2024-09-11T23:19:29.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.058+0000 7f8251e00640 1 -- start start 2024-09-11T23:19:29.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.059+0000 7f8251e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c06f7e0 0x7f824c150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.059+0000 7f8251e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c0b5590 0x7f824c1e5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.059+0000 7f8251e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c15c010 0x7f824c0d1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.059+0000 7f8251e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f824c15c570 con 0x7f824c06f7e0 2024-09-11T23:19:29.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.059+0000 7f8251e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f824c15c3f0 con 0x7f824c15c010 2024-09-11T23:19:29.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.059+0000 7f8251e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f824c06da60 con 0x7f824c0b5590 2024-09-11T23:19:29.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.059+0000 7f8250a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c06f7e0 0x7f824c150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.059+0000 7f8250a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c06f7e0 0x7f824c150f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37188/0 (socket says 172.21.15.144:37188) 2024-09-11T23:19:29.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.059+0000 7f8250a00640 1 -- 172.21.15.144:0/4049406097 learned_addr learned my addr 172.21.15.144:0/4049406097 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:29.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.059+0000 7f8251400640 1 --2- 172.21.15.144:0/4049406097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c15c010 0x7f824c0d1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.059+0000 7f8243e00640 1 --2- 172.21.15.144:0/4049406097 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c0b5590 0x7f824c1e5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.059+0000 7f8250a00640 1 -- 172.21.15.144:0/4049406097 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c0b5590 msgr2=0x7f824c1e5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.059+0000 7f8250a00640 1 --2- 172.21.15.144:0/4049406097 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c0b5590 0x7f824c1e5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.059+0000 7f8250a00640 1 -- 172.21.15.144:0/4049406097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c15c010 msgr2=0x7f824c0d1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.059+0000 7f8250a00640 1 --2- 172.21.15.144:0/4049406097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c15c010 0x7f824c0d1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.059+0000 7f8250a00640 1 -- 172.21.15.144:0/4049406097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824c153a60 con 0x7f824c06f7e0 2024-09-11T23:19:29.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.060+0000 7f8250a00640 1 --2- 172.21.15.144:0/4049406097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c06f7e0 0x7f824c150f40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f823c00c410 tx=0x7f823c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:29.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.060+0000 7f8249600640 1 -- 172.21.15.144:0/4049406097 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c017070 con 0x7f824c06f7e0 2024-09-11T23:19:29.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.060+0000 7f8249600640 1 -- 172.21.15.144:0/4049406097 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f823c0035f0 con 0x7f824c06f7e0 2024-09-11T23:19:29.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.060+0000 7f8251e00640 1 -- 172.21.15.144:0/4049406097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f824c153d40 con 0x7f824c06f7e0 2024-09-11T23:19:29.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.060+0000 7f8249600640 1 -- 172.21.15.144:0/4049406097 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c0039e0 con 0x7f824c06f7e0 2024-09-11T23:19:29.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.060+0000 7f8251e00640 1 -- 172.21.15.144:0/4049406097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f824c151480 con 0x7f824c06f7e0 2024-09-11T23:19:29.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.061+0000 7f8251e00640 1 -- 172.21.15.144:0/4049406097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f824c15d5a0 con 0x7f824c06f7e0 2024-09-11T23:19:29.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.062+0000 7f8249600640 1 -- 172.21.15.144:0/4049406097 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f823c01a070 con 0x7f824c06f7e0 2024-09-11T23:19:29.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.063+0000 7f8249600640 1 --2- 172.21.15.144:0/4049406097 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f822806bfe0 0x7f822806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:29.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.063+0000 7f8249600640 1 -- 172.21.15.144:0/4049406097 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f823c08a560 con 0x7f824c06f7e0 2024-09-11T23:19:29.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.064+0000 7f8243e00640 1 --2- 172.21.15.144:0/4049406097 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f822806bfe0 0x7f822806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:29.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.064+0000 7f8243e00640 1 --2- 172.21.15.144:0/4049406097 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f822806bfe0 0x7f822806e4a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8234034000 tx=0x7f823402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:29.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.068+0000 7f8249600640 1 -- 172.21.15.144:0/4049406097 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f824c15d5a0 con 0x7f824c06f7e0 2024-09-11T23:19:29.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.276+0000 7f8251e00640 1 -- 172.21.15.144:0/4049406097 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f824c06d520 con 0x7f824c06f7e0 2024-09-11T23:19:29.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.276+0000 7f8249600640 1 -- 172.21.15.144:0/4049406097 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f824c06fc30 con 0x7f824c06f7e0 2024-09-11T23:19:29.276 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:19:29.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.278+0000 7f8251e00640 1 -- 172.21.15.144:0/4049406097 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f822806bfe0 msgr2=0x7f822806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.278+0000 7f8251e00640 1 --2- 172.21.15.144:0/4049406097 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f822806bfe0 0x7f822806e4a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8234034000 tx=0x7f823402e000 comp rx=0 tx=0).stop 2024-09-11T23:19:29.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.278+0000 7f8251e00640 1 -- 172.21.15.144:0/4049406097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c06f7e0 msgr2=0x7f824c150f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:29.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.278+0000 7f8251e00640 1 --2- 172.21.15.144:0/4049406097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c06f7e0 0x7f824c150f40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f823c00c410 tx=0x7f823c00c8d0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.278+0000 7f8251e00640 1 -- 172.21.15.144:0/4049406097 shutdown_connections 2024-09-11T23:19:29.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.278+0000 7f8251e00640 1 --2- 172.21.15.144:0/4049406097 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f822806bfe0 0x7f822806e4a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.278+0000 7f8251e00640 1 --2- 172.21.15.144:0/4049406097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c15c010 0x7f824c0d1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.278+0000 7f8251e00640 1 --2- 172.21.15.144:0/4049406097 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c0b5590 0x7f824c1e5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.278+0000 7f8251e00640 1 --2- 172.21.15.144:0/4049406097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c06f7e0 0x7f824c150f40 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:29.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.278+0000 7f8251e00640 1 -- 172.21.15.144:0/4049406097 >> 172.21.15.144:0/4049406097 conn(0x7f824c062630 msgr2=0x7f824c15ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:29.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.278+0000 7f8251e00640 1 -- 172.21.15.144:0/4049406097 shutdown_connections 2024-09-11T23:19:29.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29.278+0000 7f8251e00640 1 -- 172.21.15.144:0/4049406097 wait complete. 2024-09-11T23:19:29.294 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:19:29.295 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:19:29.295 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-11T23:19:29.295 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:19:29.295 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:29.295 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:19:29.295 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:19:29.295 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:19:29.295 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:19:29.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:29.295 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-11T23:19:29.332 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:19:29.332 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:19:29.332 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:19:29.332 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:29.332 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-11T23:19:29.332 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:29.332 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:19:29.332 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:29.332 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-11T23:19:29.333 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:19:29.333 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:29.333 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-11T23:19:29.333 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:19:29.333 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:29.333 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:19:29.333 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:29.333 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:19:29.333 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42593sec preferred_lft 42593sec 2024-09-11T23:19:29.333 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2024-09-11T23:19:29.334 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:29.334 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:19:29.334 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:29.334 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:19:29.334 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:29.334 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::243b:82ff:fe06:fac9/64 scope link 2024-09-11T23:19:29.334 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:29.334 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:19:29.334 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:19:29.334 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::74ca:30ff:fef2:cddf/64 scope link 2024-09-11T23:19:29.334 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:29.334 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:19:29.334 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether be:01:ec:87:34:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:19:29.334 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bc01:ecff:fe87:34e1/64 scope link 2024-09-11T23:19:29.335 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:29.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:29.335 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:19:29.427 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-11T23:19:29.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:29.430 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-11T23:19:29.466 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-11T23:19:29.466 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:19:29.466 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:19:29.466 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:19:29.467 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:19:29.467 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:19:29.467 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-11T23:19:29.467 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:19:29.467 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:19:29.467 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:19:29.467 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-11T23:19:29.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:19:29.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:19:29.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:29.662 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-11T23:19:29.698 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:19:29.698 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:19:29.698 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:19:29.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:29.698 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-11T23:19:29.795 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:19:29.795 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:29.831 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:19:29.832 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:19:29.832 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:29.907 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T23:19:29.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:29.907 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:19:30.035 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:19:30.035 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:19:30.062 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:19:30.062 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:19:30.062 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:19:30.062 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:19:30.062 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:19:30.064 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T23:19:30.064 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:19:30.064 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:19:30.064 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:19:30.064 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:19:30.067 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:19:30.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:30.067 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:30.123 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:19:30.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:19:30.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:19:30.220 INFO:teuthology.orchestra.run.smithi144.stdout:client5379 2024-09-11T23:19:30.220 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:19:30.220 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:30.256 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:19:30.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.449+0000 7f0158200640 1 Processor -- start 2024-09-11T23:19:30.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.449+0000 7f0158200640 1 -- start start 2024-09-11T23:19:30.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.450+0000 7f0158200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f01500cf070 0x7f01500cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.451+0000 7f0158200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0150073120 0x7f0150073560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.451+0000 7f0158200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01500ce740 con 0x7f015015c180 2024-09-11T23:19:30.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.451+0000 7f0158200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0150072640 con 0x7f01500cf070 2024-09-11T23:19:30.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.451+0000 7f0158200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0150072920 con 0x7f0150073120 2024-09-11T23:19:30.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.451+0000 7f0155800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f015015c180 0x7f01500cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34410/0 (socket says 172.21.15.144:34410) 2024-09-11T23:19:30.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.451+0000 7f0155800640 1 -- 172.21.15.144:0/434762268 learned_addr learned my addr 172.21.15.144:0/434762268 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:30.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.451+0000 7f0154e00640 1 --2- 172.21.15.144:0/434762268 >> v2:172.21.15.144:3300/0 conn(0x7f01500cf070 0x7f01500cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.451+0000 7f0156200640 1 --2- 172.21.15.144:0/434762268 >> v2:172.21.15.165:3300/0 conn(0x7f0150073120 0x7f0150073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.451+0000 7f0154e00640 1 -- 172.21.15.144:0/434762268 >> v2:172.21.15.165:3300/0 conn(0x7f0150073120 msgr2=0x7f0150073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:30.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.451+0000 7f0154e00640 1 --2- 172.21.15.144:0/434762268 >> v2:172.21.15.165:3300/0 conn(0x7f0150073120 0x7f0150073560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.451+0000 7f0154e00640 1 -- 172.21.15.144:0/434762268 >> v1:172.21.15.144:6789/0 conn(0x7f015015c180 legacy=0x7f01500cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:30.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.451+0000 7f014fe00640 1 -- 172.21.15.144:0/434762268 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4054062599 0 0) 0x7f01500ce740 con 0x7f015015c180 2024-09-11T23:19:30.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.451+0000 7f0154e00640 1 -- 172.21.15.144:0/434762268 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0150072c00 con 0x7f01500cf070 2024-09-11T23:19:30.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.451+0000 7f0156200640 1 --2- 172.21.15.144:0/434762268 >> v2:172.21.15.165:3300/0 conn(0x7f0150073120 0x7f0150073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:30.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.452+0000 7f0154e00640 1 --2- 172.21.15.144:0/434762268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01500cf070 0x7f01500cf4e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f01500cd070 tx=0x7f013c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83f2854f3e7e157 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:30.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.453+0000 7f014fe00640 1 -- 172.21.15.144:0/434762268 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c037070 con 0x7f01500cf070 2024-09-11T23:19:30.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.453+0000 7f014fe00640 1 -- 172.21.15.144:0/434762268 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f013c032440 con 0x7f01500cf070 2024-09-11T23:19:30.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.453+0000 7f014fe00640 1 -- 172.21.15.144:0/434762268 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c02ae60 con 0x7f01500cf070 2024-09-11T23:19:30.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.453+0000 7f0158200640 1 -- 172.21.15.144:0/434762268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01500cf070 msgr2=0x7f01500cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:30.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.453+0000 7f0158200640 1 --2- 172.21.15.144:0/434762268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01500cf070 0x7f01500cf4e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f01500cd070 tx=0x7f013c02a110 comp rx=0 tx=0).stop 2024-09-11T23:19:30.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.453+0000 7f0158200640 1 -- 172.21.15.144:0/434762268 shutdown_connections 2024-09-11T23:19:30.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.453+0000 7f0158200640 1 --2- 172.21.15.144:0/434762268 >> v2:172.21.15.165:3300/0 conn(0x7f0150073120 0x7f0150073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.453+0000 7f0158200640 1 --2- 172.21.15.144:0/434762268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01500cf070 0x7f01500cf4e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.453+0000 7f0158200640 1 -- 172.21.15.144:0/434762268 >> 172.21.15.144:0/434762268 conn(0x7f0150062cc0 msgr2=0x7f015006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:30.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.453+0000 7f0158200640 1 -- 172.21.15.144:0/434762268 shutdown_connections 2024-09-11T23:19:30.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.453+0000 7f0158200640 1 -- 172.21.15.144:0/434762268 wait complete. 2024-09-11T23:19:30.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.455+0000 7f0158200640 1 Processor -- start 2024-09-11T23:19:30.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.455+0000 7f0158200640 1 -- start start 2024-09-11T23:19:30.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.456+0000 7f0158200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0150073120 0x7f015015e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.456+0000 7f0158200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01500cf070 0x7f015014bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.456+0000 7f0158200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f015015c180 0x7f015015f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.456+0000 7f0158200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f01500722f0 con 0x7f01500cf070 2024-09-11T23:19:30.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.456+0000 7f0158200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f01500ced00 con 0x7f015015c180 2024-09-11T23:19:30.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.456+0000 7f0158200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f015015c560 con 0x7f0150073120 2024-09-11T23:19:30.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.456+0000 7f0154e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01500cf070 0x7f015014bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.456+0000 7f0154e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01500cf070 0x7f015014bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37204/0 (socket says 172.21.15.144:37204) 2024-09-11T23:19:30.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.456+0000 7f0154e00640 1 -- 172.21.15.144:0/2221207111 learned_addr learned my addr 172.21.15.144:0/2221207111 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:30.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.456+0000 7f0155800640 1 --2- 172.21.15.144:0/2221207111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0150073120 0x7f015015e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.456+0000 7f0156200640 1 --2- 172.21.15.144:0/2221207111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f015015c180 0x7f015015f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.457+0000 7f0154e00640 1 -- 172.21.15.144:0/2221207111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0150073120 msgr2=0x7f015015e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:30.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.457+0000 7f0154e00640 1 --2- 172.21.15.144:0/2221207111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0150073120 0x7f015015e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.457+0000 7f0154e00640 1 -- 172.21.15.144:0/2221207111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f015015c180 msgr2=0x7f015015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:30.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.457+0000 7f0154e00640 1 --2- 172.21.15.144:0/2221207111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f015015c180 0x7f015015f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.457+0000 7f0154e00640 1 -- 172.21.15.144:0/2221207111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f015015d460 con 0x7f01500cf070 2024-09-11T23:19:30.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.457+0000 7f0156200640 1 --2- 172.21.15.144:0/2221207111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f015015c180 0x7f015015f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:30.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.457+0000 7f0154e00640 1 --2- 172.21.15.144:0/2221207111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01500cf070 0x7f015014bca0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f013c000c00 tx=0x7f013c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:30.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.457+0000 7f014d600640 1 -- 172.21.15.144:0/2221207111 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c037040 con 0x7f01500cf070 2024-09-11T23:19:30.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.457+0000 7f014d600640 1 -- 172.21.15.144:0/2221207111 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f013c042070 con 0x7f01500cf070 2024-09-11T23:19:30.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.457+0000 7f014d600640 1 -- 172.21.15.144:0/2221207111 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c030a50 con 0x7f01500cf070 2024-09-11T23:19:30.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.457+0000 7f0158200640 1 -- 172.21.15.144:0/2221207111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f015015d700 con 0x7f01500cf070 2024-09-11T23:19:30.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.458+0000 7f0158200640 1 -- 172.21.15.144:0/2221207111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f015015dcc0 con 0x7f01500cf070 2024-09-11T23:19:30.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.459+0000 7f0158200640 1 -- 172.21.15.144:0/2221207111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01500cf4e0 con 0x7f01500cf070 2024-09-11T23:19:30.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.460+0000 7f014d600640 1 -- 172.21.15.144:0/2221207111 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f013c030bf0 con 0x7f01500cf070 2024-09-11T23:19:30.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.460+0000 7f014d600640 1 --2- 172.21.15.144:0/2221207111 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f013006bfe0 0x7f013006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:30.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.461+0000 7f014d600640 1 -- 172.21.15.144:0/2221207111 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f013c0abb60 con 0x7f01500cf070 2024-09-11T23:19:30.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.461+0000 7f0155800640 1 --2- 172.21.15.144:0/2221207111 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f013006bfe0 0x7f013006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:30.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.461+0000 7f0155800640 1 --2- 172.21.15.144:0/2221207111 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f013006bfe0 0x7f013006e4a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0144007fd0 tx=0x7f0144007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:30.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.465+0000 7f014d600640 1 -- 172.21.15.144:0/2221207111 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f013c07a280 con 0x7f01500cf070 2024-09-11T23:19:30.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.672+0000 7f0158200640 1 -- 172.21.15.144:0/2221207111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f01500af300 con 0x7f01500cf070 2024-09-11T23:19:30.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.672+0000 7f014d600640 1 -- 172.21.15.144:0/2221207111 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7f013c079b80 con 0x7f01500cf070 2024-09-11T23:19:30.672 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:19:30.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.674+0000 7f0158200640 1 -- 172.21.15.144:0/2221207111 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f013006bfe0 msgr2=0x7f013006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:30.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.674+0000 7f0158200640 1 --2- 172.21.15.144:0/2221207111 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f013006bfe0 0x7f013006e4a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0144007fd0 tx=0x7f0144007de0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.674+0000 7f0158200640 1 -- 172.21.15.144:0/2221207111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01500cf070 msgr2=0x7f015014bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:30.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.674+0000 7f0158200640 1 --2- 172.21.15.144:0/2221207111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01500cf070 0x7f015014bca0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f013c000c00 tx=0x7f013c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.675+0000 7f0158200640 1 -- 172.21.15.144:0/2221207111 shutdown_connections 2024-09-11T23:19:30.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.675+0000 7f0158200640 1 --2- 172.21.15.144:0/2221207111 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f013006bfe0 0x7f013006e4a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.675+0000 7f0158200640 1 --2- 172.21.15.144:0/2221207111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f015015c180 0x7f015015f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.675+0000 7f0158200640 1 --2- 172.21.15.144:0/2221207111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01500cf070 0x7f015014bca0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.675+0000 7f0158200640 1 --2- 172.21.15.144:0/2221207111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0150073120 0x7f015015e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:30.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.675+0000 7f0158200640 1 -- 172.21.15.144:0/2221207111 >> 172.21.15.144:0/2221207111 conn(0x7f0150062cc0 msgr2=0x7f015015fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:30.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.675+0000 7f0158200640 1 -- 172.21.15.144:0/2221207111 shutdown_connections 2024-09-11T23:19:30.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:30.675+0000 7f0158200640 1 -- 172.21.15.144:0/2221207111 wait complete. 2024-09-11T23:19:30.693 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:19:30.694 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:19:30.694 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi165.front.sepia.ceph.com 2024-09-11T23:19:30.694 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T23:19:30.694 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:19:30.694 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:19:30.694 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:19:30.694 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:19:30.694 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:19:30.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:30.694 DEBUG:teuthology.orchestra.run.smithi165:> ip addr 2024-09-11T23:19:30.735 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:19:30.735 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:19:30.735 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:19:30.735 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:30.735 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-11T23:19:30.735 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:30.735 INFO:teuthology.orchestra.run.smithi165.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:19:30.735 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:94 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:30.735 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f0 2024-09-11T23:19:30.735 INFO:teuthology.orchestra.run.smithi165.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:19:30.736 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:95 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:30.736 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f1 2024-09-11T23:19:30.736 INFO:teuthology.orchestra.run.smithi165.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:19:30.736 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:30.736 INFO:teuthology.orchestra.run.smithi165.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:19:30.736 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:30.736 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.21.15.165/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:19:30.736 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft 42595sec preferred_lft 42595sec 2024-09-11T23:19:30.736 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::ec4:7aff:fe88:7f63/64 scope link noprefixroute 2024-09-11T23:19:30.736 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:30.736 INFO:teuthology.orchestra.run.smithi165.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:19:30.736 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:19:30.736 INFO:teuthology.orchestra.run.smithi165.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:19:30.737 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:30.737 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::c063:d7ff:fec8:c56c/64 scope link 2024-09-11T23:19:30.737 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:30.737 INFO:teuthology.orchestra.run.smithi165.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:19:30.737 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:19:30.737 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::5478:e4ff:fecd:76c/64 scope link 2024-09-11T23:19:30.737 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:30.737 INFO:teuthology.orchestra.run.smithi165.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:19:30.737 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether ba:fa:43:78:5f:29 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:19:30.737 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::b8fa:43ff:fe78:5f29/64 scope link 2024-09-11T23:19:30.737 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:19:30.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:30.738 DEBUG:teuthology.orchestra.run.smithi165:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:19:30.839 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-11T23:19:30.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:30.842 DEBUG:teuthology.orchestra.run.smithi165:> route 2024-09-11T23:19:30.880 INFO:teuthology.orchestra.run.smithi165.stdout:Kernel IP routing table 2024-09-11T23:19:30.880 INFO:teuthology.orchestra.run.smithi165.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:19:30.880 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:19:30.880 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:19:30.880 INFO:teuthology.orchestra.run.smithi165.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:19:30.880 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:19:30.881 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-11T23:19:30.881 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:19:30.881 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:19:30.881 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:19:30.881 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-11T23:19:30.999 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:19:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:19:31.069 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:19:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:19:31.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:31.077 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-11T23:19:31.113 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-11T23:19:31.113 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-11T23:19:31.113 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:19:31.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:31.113 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set brx.0 up 2024-09-11T23:19:31.209 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:19:31.210 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T23:19:31.245 INFO:teuthology.orchestra.run.smithi165.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:19:31.245 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:19:31.245 DEBUG:teuthology.orchestra.run.smithi165:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:19:31.321 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-11T23:19:31.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:31.322 DEBUG:teuthology.orchestra.run.smithi165:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:19:31.449 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:19:31.450 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:19:31.478 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:19:31.478 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:19:31.478 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:19:31.478 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: trying mount with new device syntax: 1@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:19:31.478 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:19:31.480 INFO:teuthology.orchestra.run.smithi165.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-11T23:19:31.480 INFO:teuthology.orchestra.run.smithi165.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:19:31.481 INFO:teuthology.orchestra.run.smithi165.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:19:31.481 INFO:teuthology.orchestra.run.smithi165.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:19:31.481 INFO:teuthology.orchestra.run.smithi165.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:19:31.483 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:19:31.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:31.484 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:19:31.538 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:19:31.616 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:19:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:19:31.619 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:19:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:19:31.627 INFO:teuthology.orchestra.run.smithi165.stdout:client5251 2024-09-11T23:19:31.628 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:19:31.628 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:31.664 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-11T23:19:31.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.826+0000 7f244a600640 1 Processor -- start 2024-09-11T23:19:31.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.827+0000 7f244a600640 1 -- start start 2024-09-11T23:19:31.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.828+0000 7f244a600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f244406e500 0x7f2444167310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:31.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.828+0000 7f244a600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24440b4240 con 0x7f24440cf5d0 2024-09-11T23:19:31.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.828+0000 7f244a600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24440b4520 con 0x7f2444145d90 2024-09-11T23:19:31.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.828+0000 7f244a600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f244406d080 con 0x7f244406e500 2024-09-11T23:19:31.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.828+0000 7f243aa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f24440cf5d0 0x7f24440cfa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34418/0 (socket says 172.21.15.144:34418) 2024-09-11T23:19:31.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.828+0000 7f243aa00640 1 -- 172.21.15.144:0/321823701 learned_addr learned my addr 172.21.15.144:0/321823701 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:31.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.828+0000 7f2443e00640 1 --2- 172.21.15.144:0/321823701 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f244406e500 0x7f2444167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:31.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.829+0000 7f2442a00640 1 -- 172.21.15.144:0/321823701 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 612928860 0 0) 0x7f24440b4240 con 0x7f24440cf5d0 2024-09-11T23:19:31.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.829+0000 7f2442a00640 1 -- 172.21.15.144:0/321823701 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2428003520 con 0x7f24440cf5d0 2024-09-11T23:19:31.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.829+0000 7f2442a00640 1 -- 172.21.15.144:0/321823701 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 695580879 0 0) 0x7f24440b4520 con 0x7f2444145d90 2024-09-11T23:19:31.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.829+0000 7f2442a00640 1 -- 172.21.15.144:0/321823701 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24440b4240 con 0x7f2444145d90 2024-09-11T23:19:31.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.829+0000 7f2443e00640 1 -- 172.21.15.144:0/321823701 >> v1:172.21.15.165:6789/0 conn(0x7f2444145d90 legacy=0x7f24440ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:31.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.829+0000 7f2443e00640 1 -- 172.21.15.144:0/321823701 >> v1:172.21.15.144:6789/0 conn(0x7f24440cf5d0 legacy=0x7f24440cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:31.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.829+0000 7f2443e00640 1 -- 172.21.15.144:0/321823701 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24440b4800 con 0x7f244406e500 2024-09-11T23:19:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.830+0000 7f2443e00640 1 --2- 172.21.15.144:0/321823701 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f244406e500 0x7f2444167310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f243c009dc0 tx=0x7f243c02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8c244b31152e392 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.830+0000 7f2442a00640 1 -- 172.21.15.144:0/321823701 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c007740 con 0x7f244406e500 2024-09-11T23:19:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.830+0000 7f2442a00640 1 -- 172.21.15.144:0/321823701 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f243c0078e0 con 0x7f244406e500 2024-09-11T23:19:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.830+0000 7f2442a00640 1 -- 172.21.15.144:0/321823701 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c007cb0 con 0x7f244406e500 2024-09-11T23:19:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.831+0000 7f244a600640 1 -- 172.21.15.144:0/321823701 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f244406e500 msgr2=0x7f2444167310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.831+0000 7f244a600640 1 --2- 172.21.15.144:0/321823701 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f244406e500 0x7f2444167310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f243c009dc0 tx=0x7f243c02a6d0 comp rx=0 tx=0).stop 2024-09-11T23:19:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.831+0000 7f244a600640 1 -- 172.21.15.144:0/321823701 shutdown_connections 2024-09-11T23:19:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.831+0000 7f244a600640 1 --2- 172.21.15.144:0/321823701 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f244406e500 0x7f2444167310 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.831+0000 7f244a600640 1 -- 172.21.15.144:0/321823701 >> 172.21.15.144:0/321823701 conn(0x7f244406bba0 msgr2=0x7f244406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.831+0000 7f244a600640 1 -- 172.21.15.144:0/321823701 shutdown_connections 2024-09-11T23:19:31.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.831+0000 7f244a600640 1 -- 172.21.15.144:0/321823701 wait complete. 2024-09-11T23:19:31.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.832+0000 7f244a600640 1 Processor -- start 2024-09-11T23:19:31.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.833+0000 7f244a600640 1 -- start start 2024-09-11T23:19:31.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.833+0000 7f244a600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f244406e500 0x7f244415e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:31.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.833+0000 7f244a600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24440cf5d0 0x7f244413cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:31.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.833+0000 7f244a600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2444145d90 0x7f24441603b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:31.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.833+0000 7f244a600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f24440b5610 con 0x7f2444145d90 2024-09-11T23:19:31.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.834+0000 7f244a600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f24440cd660 con 0x7f24440cf5d0 2024-09-11T23:19:31.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.834+0000 7f244a600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f24440b5790 con 0x7f244406e500 2024-09-11T23:19:31.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.834+0000 7f2443e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2444145d90 0x7f24441603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:31.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.834+0000 7f243aa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24440cf5d0 0x7f244413cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:31.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.834+0000 7f2443e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2444145d90 0x7f24441603b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37208/0 (socket says 172.21.15.144:37208) 2024-09-11T23:19:31.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.834+0000 7f2443e00640 1 -- 172.21.15.144:0/1563475082 learned_addr learned my addr 172.21.15.144:0/1563475082 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:31.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.834+0000 7f2443400640 1 --2- 172.21.15.144:0/1563475082 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f244406e500 0x7f244415e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:31.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.834+0000 7f2443e00640 1 -- 172.21.15.144:0/1563475082 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f244406e500 msgr2=0x7f244415e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:31.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.834+0000 7f2443e00640 1 --2- 172.21.15.144:0/1563475082 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f244406e500 0x7f244415e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:31.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.834+0000 7f2443e00640 1 -- 172.21.15.144:0/1563475082 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24440cf5d0 msgr2=0x7f244413cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:31.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.834+0000 7f2443e00640 1 --2- 172.21.15.144:0/1563475082 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24440cf5d0 0x7f244413cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:31.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.834+0000 7f2443e00640 1 -- 172.21.15.144:0/1563475082 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f244415e840 con 0x7f2444145d90 2024-09-11T23:19:31.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.835+0000 7f2443e00640 1 --2- 172.21.15.144:0/1563475082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2444145d90 0x7f24441603b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f243c009ee0 tx=0x7f243c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:31.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.835+0000 7f243be00640 1 -- 172.21.15.144:0/1563475082 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c040070 con 0x7f2444145d90 2024-09-11T23:19:31.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.835+0000 7f243be00640 1 -- 172.21.15.144:0/1563475082 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f243c031bc0 con 0x7f2444145d90 2024-09-11T23:19:31.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.835+0000 7f243be00640 1 -- 172.21.15.144:0/1563475082 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c009450 con 0x7f2444145d90 2024-09-11T23:19:31.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.835+0000 7f244a600640 1 -- 172.21.15.144:0/1563475082 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f244415eb20 con 0x7f2444145d90 2024-09-11T23:19:31.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.835+0000 7f244a600640 1 -- 172.21.15.144:0/1563475082 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f244415f0e0 con 0x7f2444145d90 2024-09-11T23:19:31.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.836+0000 7f244a600640 1 -- 172.21.15.144:0/1563475082 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2444146170 con 0x7f2444145d90 2024-09-11T23:19:31.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.837+0000 7f243be00640 1 -- 172.21.15.144:0/1563475082 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f243c039040 con 0x7f2444145d90 2024-09-11T23:19:31.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.838+0000 7f243be00640 1 --2- 172.21.15.144:0/1563475082 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f242006bfe0 0x7f242006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:31.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.838+0000 7f243be00640 1 -- 172.21.15.144:0/1563475082 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f243c0ac750 con 0x7f2444145d90 2024-09-11T23:19:31.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.838+0000 7f2443400640 1 --2- 172.21.15.144:0/1563475082 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f242006bfe0 0x7f242006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:31.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.839+0000 7f2443400640 1 --2- 172.21.15.144:0/1563475082 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f242006bfe0 0x7f242006e4a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2434007fd0 tx=0x7f2434009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:31.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:31.842+0000 7f243be00640 1 -- 172.21.15.144:0/1563475082 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f243c07a790 con 0x7f2444145d90 2024-09-11T23:19:32.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:32.050+0000 7f244a600640 1 -- 172.21.15.144:0/1563475082 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f24440b0750 con 0x7f2444145d90 2024-09-11T23:19:32.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:32.862+0000 7f243be00640 1 -- 172.21.15.144:0/1563475082 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v26) ==== 136+0+0 (secure 0 0 0) 0x7f243c07ea90 con 0x7f2444145d90 2024-09-11T23:19:32.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:32.864+0000 7f244a600640 1 -- 172.21.15.144:0/1563475082 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f242006bfe0 msgr2=0x7f242006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:32.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:32.864+0000 7f244a600640 1 --2- 172.21.15.144:0/1563475082 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f242006bfe0 0x7f242006e4a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2434007fd0 tx=0x7f2434009040 comp rx=0 tx=0).stop 2024-09-11T23:19:32.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:32.864+0000 7f244a600640 1 -- 172.21.15.144:0/1563475082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2444145d90 msgr2=0x7f24441603b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:32.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:32.864+0000 7f244a600640 1 --2- 172.21.15.144:0/1563475082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2444145d90 0x7f24441603b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f243c009ee0 tx=0x7f243c004a40 comp rx=0 tx=0).stop 2024-09-11T23:19:32.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:32.864+0000 7f244a600640 1 -- 172.21.15.144:0/1563475082 shutdown_connections 2024-09-11T23:19:32.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:32.864+0000 7f244a600640 1 --2- 172.21.15.144:0/1563475082 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f242006bfe0 0x7f242006e4a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:32.864+0000 7f244a600640 1 --2- 172.21.15.144:0/1563475082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2444145d90 0x7f24441603b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:32.864+0000 7f244a600640 1 --2- 172.21.15.144:0/1563475082 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24440cf5d0 0x7f244413cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:32.864+0000 7f244a600640 1 --2- 172.21.15.144:0/1563475082 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f244406e500 0x7f244415e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:32.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:32.864+0000 7f244a600640 1 -- 172.21.15.144:0/1563475082 >> 172.21.15.144:0/1563475082 conn(0x7f244406bba0 msgr2=0x7f244406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:32.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:32.865+0000 7f244a600640 1 -- 172.21.15.144:0/1563475082 shutdown_connections 2024-09-11T23:19:32.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:32.865+0000 7f244a600640 1 -- 172.21.15.144:0/1563475082 wait complete. 2024-09-11T23:19:32.882 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-11T23:19:33.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.039+0000 7feb4ae00640 1 Processor -- start 2024-09-11T23:19:33.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.039+0000 7feb4ae00640 1 -- start start 2024-09-11T23:19:33.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.040+0000 7feb4ae00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feb440cf070 0x7feb440cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.040+0000 7feb4ae00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7feb44073120 0x7feb44073560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.040+0000 7feb4ae00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb440ce740 con 0x7feb4415c180 2024-09-11T23:19:33.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.040+0000 7feb4ae00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7feb44072640 con 0x7feb440cf070 2024-09-11T23:19:33.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.040+0000 7feb4ae00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7feb44072920 con 0x7feb44073120 2024-09-11T23:19:33.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.040+0000 7feb43400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feb440cf070 0x7feb440cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.041+0000 7feb43400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feb440cf070 0x7feb440cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37216/0 (socket says 172.21.15.144:37216) 2024-09-11T23:19:33.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.041+0000 7feb43400640 1 -- 172.21.15.144:0/1450761610 learned_addr learned my addr 172.21.15.144:0/1450761610 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:33.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.041+0000 7feb48e00640 1 --2- 172.21.15.144:0/1450761610 >> v2:172.21.15.165:3300/0 conn(0x7feb44073120 0x7feb44073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.041+0000 7feb43400640 1 -- 172.21.15.144:0/1450761610 >> v2:172.21.15.165:3300/0 conn(0x7feb44073120 msgr2=0x7feb44073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:33.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.041+0000 7feb43400640 1 --2- 172.21.15.144:0/1450761610 >> v2:172.21.15.165:3300/0 conn(0x7feb44073120 0x7feb44073560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.041+0000 7feb43400640 1 -- 172.21.15.144:0/1450761610 >> v1:172.21.15.165:6789/0 conn(0x7feb4415c180 legacy=0x7feb440cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.041+0000 7feb43400640 1 -- 172.21.15.144:0/1450761610 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb44072c00 con 0x7feb440cf070 2024-09-11T23:19:33.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.042+0000 7feb43400640 1 --2- 172.21.15.144:0/1450761610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb440cf070 0x7feb440cf4e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7feb440cd070 tx=0x7feb3002a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfd79f8ccb00b57 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:33.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.042+0000 7feb42a00640 1 -- 172.21.15.144:0/1450761610 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb30037070 con 0x7feb440cf070 2024-09-11T23:19:33.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.042+0000 7feb42a00640 1 -- 172.21.15.144:0/1450761610 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb30032440 con 0x7feb440cf070 2024-09-11T23:19:33.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.042+0000 7feb42a00640 1 -- 172.21.15.144:0/1450761610 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb30032810 con 0x7feb440cf070 2024-09-11T23:19:33.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.043+0000 7feb4ae00640 1 -- 172.21.15.144:0/1450761610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb440cf070 msgr2=0x7feb440cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.043+0000 7feb4ae00640 1 --2- 172.21.15.144:0/1450761610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb440cf070 0x7feb440cf4e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7feb440cd070 tx=0x7feb3002a1f0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.043+0000 7feb4ae00640 1 -- 172.21.15.144:0/1450761610 shutdown_connections 2024-09-11T23:19:33.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.043+0000 7feb4ae00640 1 --2- 172.21.15.144:0/1450761610 >> v2:172.21.15.165:3300/0 conn(0x7feb44073120 0x7feb44073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.043+0000 7feb4ae00640 1 --2- 172.21.15.144:0/1450761610 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb440cf070 0x7feb440cf4e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.043+0000 7feb4ae00640 1 -- 172.21.15.144:0/1450761610 >> 172.21.15.144:0/1450761610 conn(0x7feb44062cc0 msgr2=0x7feb4406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:33.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.043+0000 7feb4ae00640 1 -- 172.21.15.144:0/1450761610 shutdown_connections 2024-09-11T23:19:33.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.043+0000 7feb4ae00640 1 -- 172.21.15.144:0/1450761610 wait complete. 2024-09-11T23:19:33.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.044+0000 7feb4ae00640 1 Processor -- start 2024-09-11T23:19:33.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.044+0000 7feb4ae00640 1 -- start start 2024-09-11T23:19:33.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.045+0000 7feb4ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb44073120 0x7feb44149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.045+0000 7feb4ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb440cf070 0x7feb440c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.045+0000 7feb4ae00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb4415c180 0x7feb44158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.045+0000 7feb4ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feb440722f0 con 0x7feb440cf070 2024-09-11T23:19:33.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.045+0000 7feb4ae00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feb440ced00 con 0x7feb4415c180 2024-09-11T23:19:33.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.045+0000 7feb4ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7feb4415c560 con 0x7feb44073120 2024-09-11T23:19:33.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.046+0000 7feb43400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb440cf070 0x7feb440c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.046+0000 7feb43400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb440cf070 0x7feb440c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37222/0 (socket says 172.21.15.144:37222) 2024-09-11T23:19:33.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.046+0000 7feb43400640 1 -- 172.21.15.144:0/421297464 learned_addr learned my addr 172.21.15.144:0/421297464 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:33.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.046+0000 7feb48e00640 1 --2- 172.21.15.144:0/421297464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb4415c180 0x7feb44158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.046+0000 7feb43e00640 1 --2- 172.21.15.144:0/421297464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb44073120 0x7feb44149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.046+0000 7feb43400640 1 -- 172.21.15.144:0/421297464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb44073120 msgr2=0x7feb44149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.046+0000 7feb43400640 1 --2- 172.21.15.144:0/421297464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb44073120 0x7feb44149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.046+0000 7feb43400640 1 -- 172.21.15.144:0/421297464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb4415c180 msgr2=0x7feb44158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.046+0000 7feb43400640 1 --2- 172.21.15.144:0/421297464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb4415c180 0x7feb44158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.046+0000 7feb43400640 1 -- 172.21.15.144:0/421297464 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb44147750 con 0x7feb440cf070 2024-09-11T23:19:33.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.046+0000 7feb43400640 1 --2- 172.21.15.144:0/421297464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb440cf070 0x7feb440c89c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7feb3002a230 tx=0x7feb300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:33.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.047+0000 7feb3be00640 1 -- 172.21.15.144:0/421297464 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb30037040 con 0x7feb440cf070 2024-09-11T23:19:33.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.047+0000 7feb3be00640 1 -- 172.21.15.144:0/421297464 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb30042070 con 0x7feb440cf070 2024-09-11T23:19:33.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.047+0000 7feb3be00640 1 -- 172.21.15.144:0/421297464 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb30030880 con 0x7feb440cf070 2024-09-11T23:19:33.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.047+0000 7feb4ae00640 1 -- 172.21.15.144:0/421297464 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb4414a510 con 0x7feb440cf070 2024-09-11T23:19:33.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.047+0000 7feb4ae00640 1 -- 172.21.15.144:0/421297464 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb44147fb0 con 0x7feb440cf070 2024-09-11T23:19:33.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.048+0000 7feb4ae00640 1 -- 172.21.15.144:0/421297464 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb44147920 con 0x7feb440cf070 2024-09-11T23:19:33.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.049+0000 7feb3be00640 1 -- 172.21.15.144:0/421297464 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7feb30030a20 con 0x7feb440cf070 2024-09-11T23:19:33.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.050+0000 7feb3be00640 1 --2- 172.21.15.144:0/421297464 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7feb2406c010 0x7feb2406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.050+0000 7feb3be00640 1 -- 172.21.15.144:0/421297464 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7feb300ab830 con 0x7feb440cf070 2024-09-11T23:19:33.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.050+0000 7feb43e00640 1 --2- 172.21.15.144:0/421297464 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7feb2406c010 0x7feb2406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.050+0000 7feb43e00640 1 --2- 172.21.15.144:0/421297464 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7feb2406c010 0x7feb2406e4d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7feb340016e0 tx=0x7feb34009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:33.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.054+0000 7feb3be00640 1 -- 172.21.15.144:0/421297464 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feb30079900 con 0x7feb440cf070 2024-09-11T23:19:33.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.249+0000 7feb4ae00640 1 -- 172.21.15.144:0/421297464 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7feb440cf4e0 con 0x7feb2406c010 2024-09-11T23:19:33.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.250+0000 7feb3be00640 1 -- 172.21.15.144:0/421297464 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7feb440cf4e0 con 0x7feb2406c010 2024-09-11T23:19:33.250 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:19:33.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:19:33.250 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephfs" 2024-09-11T23:19:33.250 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:19:33.250 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:19:33.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.252+0000 7feb4ae00640 1 -- 172.21.15.144:0/421297464 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7feb2406c010 msgr2=0x7feb2406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.252+0000 7feb4ae00640 1 --2- 172.21.15.144:0/421297464 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7feb2406c010 0x7feb2406e4d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7feb340016e0 tx=0x7feb34009040 comp rx=0 tx=0).stop 2024-09-11T23:19:33.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.252+0000 7feb4ae00640 1 -- 172.21.15.144:0/421297464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb440cf070 msgr2=0x7feb440c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.252+0000 7feb4ae00640 1 --2- 172.21.15.144:0/421297464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb440cf070 0x7feb440c89c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7feb3002a230 tx=0x7feb300046c0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.252+0000 7feb4ae00640 1 -- 172.21.15.144:0/421297464 shutdown_connections 2024-09-11T23:19:33.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.252+0000 7feb4ae00640 1 --2- 172.21.15.144:0/421297464 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7feb2406c010 0x7feb2406e4d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.252+0000 7feb4ae00640 1 --2- 172.21.15.144:0/421297464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb4415c180 0x7feb44158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.252+0000 7feb4ae00640 1 --2- 172.21.15.144:0/421297464 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb440cf070 0x7feb440c89c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.252+0000 7feb4ae00640 1 --2- 172.21.15.144:0/421297464 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb44073120 0x7feb44149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.252+0000 7feb4ae00640 1 -- 172.21.15.144:0/421297464 >> 172.21.15.144:0/421297464 conn(0x7feb44062cc0 msgr2=0x7feb440cf920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:33.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.252+0000 7feb4ae00640 1 -- 172.21.15.144:0/421297464 shutdown_connections 2024-09-11T23:19:33.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.252+0000 7feb4ae00640 1 -- 172.21.15.144:0/421297464 wait complete. 2024-09-11T23:19:33.268 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:19:33.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.425+0000 7fec55e00640 1 Processor -- start 2024-09-11T23:19:33.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.425+0000 7fec55e00640 1 -- start start 2024-09-11T23:19:33.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.426+0000 7fec55e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fec50161e30 0x7fec500d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.426+0000 7fec55e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec500b3d50 0x7fec5006d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.426+0000 7fec55e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec500cf9a0 con 0x7fec500b3290 2024-09-11T23:19:33.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.426+0000 7fec55e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fec500cfcf0 con 0x7fec500b3d50 2024-09-11T23:19:33.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.426+0000 7fec55e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fec50162210 con 0x7fec50161e30 2024-09-11T23:19:33.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.426+0000 7fec46000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec500b3d50 0x7fec5006d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.426+0000 7fec46000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec500b3d50 0x7fec5006d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37234/0 (socket says 172.21.15.144:37234) 2024-09-11T23:19:33.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.426+0000 7fec46000640 1 -- 172.21.15.144:0/568540834 learned_addr learned my addr 172.21.15.144:0/568540834 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:33.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.426+0000 7fec4f400640 1 --1- 172.21.15.144:0/568540834 >> v1:172.21.15.144:6789/0 conn(0x7fec500b3290 0x7fec500b78b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34424/0 (socket says 172.21.15.144:34424) 2024-09-11T23:19:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.427+0000 7fec4ea00640 1 --2- 172.21.15.144:0/568540834 >> v2:172.21.15.165:3300/0 conn(0x7fec50161e30 0x7fec500d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.427+0000 7fec46000640 1 -- 172.21.15.144:0/568540834 >> v2:172.21.15.165:3300/0 conn(0x7fec50161e30 msgr2=0x7fec500d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.427+0000 7fec46000640 1 --2- 172.21.15.144:0/568540834 >> v2:172.21.15.165:3300/0 conn(0x7fec50161e30 0x7fec500d34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.427+0000 7fec46000640 1 -- 172.21.15.144:0/568540834 >> v1:172.21.15.144:6789/0 conn(0x7fec500b3290 legacy=0x7fec500b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.427+0000 7fec46000640 1 -- 172.21.15.144:0/568540834 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec500d5210 con 0x7fec500b3d50 2024-09-11T23:19:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.428+0000 7fec46000640 1 --2- 172.21.15.144:0/568540834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec500b3d50 0x7fec5006d8c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fec5008dc90 tx=0x7fec3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389a5c2359c58a1f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.428+0000 7fec4e000640 1 -- 172.21.15.144:0/568540834 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec38037070 con 0x7fec500b3d50 2024-09-11T23:19:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.428+0000 7fec4e000640 1 -- 172.21.15.144:0/568540834 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec38032440 con 0x7fec500b3d50 2024-09-11T23:19:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.428+0000 7fec4e000640 1 -- 172.21.15.144:0/568540834 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec38032810 con 0x7fec500b3d50 2024-09-11T23:19:33.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.429+0000 7fec55e00640 1 -- 172.21.15.144:0/568540834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec500b3d50 msgr2=0x7fec5006d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.429+0000 7fec55e00640 1 --2- 172.21.15.144:0/568540834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec500b3d50 0x7fec5006d8c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fec5008dc90 tx=0x7fec3802a270 comp rx=0 tx=0).stop 2024-09-11T23:19:33.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.429+0000 7fec55e00640 1 -- 172.21.15.144:0/568540834 shutdown_connections 2024-09-11T23:19:33.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.429+0000 7fec55e00640 1 --2- 172.21.15.144:0/568540834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec500b3d50 0x7fec5006d8c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.429+0000 7fec55e00640 1 --2- 172.21.15.144:0/568540834 >> v2:172.21.15.165:3300/0 conn(0x7fec50161e30 0x7fec500d34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.429+0000 7fec55e00640 1 -- 172.21.15.144:0/568540834 >> 172.21.15.144:0/568540834 conn(0x7fec500d1870 msgr2=0x7fec500d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:33.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.429+0000 7fec55e00640 1 -- 172.21.15.144:0/568540834 shutdown_connections 2024-09-11T23:19:33.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.429+0000 7fec55e00640 1 -- 172.21.15.144:0/568540834 wait complete. 2024-09-11T23:19:33.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.430+0000 7fec55e00640 1 Processor -- start 2024-09-11T23:19:33.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.431+0000 7fec55e00640 1 -- start start 2024-09-11T23:19:33.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.431+0000 7fec55e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec500b3290 0x7fec500cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.432+0000 7fec55e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec500b3d50 0x7fec500cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.432+0000 7fec55e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec50161e30 0x7fec5014d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.432+0000 7fec55e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fec500d39e0 con 0x7fec500b3d50 2024-09-11T23:19:33.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.432+0000 7fec55e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fec500b3950 con 0x7fec50161e30 2024-09-11T23:19:33.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.432+0000 7fec55e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fec500ccd80 con 0x7fec500b3290 2024-09-11T23:19:33.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.432+0000 7fec46000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec500b3d50 0x7fec500cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.432+0000 7fec46000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec500b3d50 0x7fec500cd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37236/0 (socket says 172.21.15.144:37236) 2024-09-11T23:19:33.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.432+0000 7fec46000640 1 -- 172.21.15.144:0/1169073480 learned_addr learned my addr 172.21.15.144:0/1169073480 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:33.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.432+0000 7fec46000640 1 -- 172.21.15.144:0/1169073480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec500b3290 msgr2=0x7fec500cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.432+0000 7fec4ea00640 1 --2- 172.21.15.144:0/1169073480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec500b3290 0x7fec500cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.432+0000 7fec4f400640 1 --2- 172.21.15.144:0/1169073480 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec50161e30 0x7fec5014d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.432+0000 7fec46000640 1 --2- 172.21.15.144:0/1169073480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec500b3290 0x7fec500cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.432+0000 7fec46000640 1 -- 172.21.15.144:0/1169073480 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec50161e30 msgr2=0x7fec5014d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.432+0000 7fec46000640 1 --2- 172.21.15.144:0/1169073480 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec50161e30 0x7fec5014d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.432+0000 7fec46000640 1 -- 172.21.15.144:0/1169073480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec500cc170 con 0x7fec500b3d50 2024-09-11T23:19:33.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.432+0000 7fec4ea00640 1 --2- 172.21.15.144:0/1169073480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec500b3290 0x7fec500cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:33.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.432+0000 7fec4f400640 1 --2- 172.21.15.144:0/1169073480 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec50161e30 0x7fec5014d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:33.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.433+0000 7fec46000640 1 --2- 172.21.15.144:0/1169073480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec500b3d50 0x7fec500cd9a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fec3802a2b0 tx=0x7fec380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:33.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.433+0000 7fec47e00640 1 -- 172.21.15.144:0/1169073480 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec38041020 con 0x7fec500b3d50 2024-09-11T23:19:33.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.433+0000 7fec47e00640 1 -- 172.21.15.144:0/1169073480 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec380306c0 con 0x7fec500b3d50 2024-09-11T23:19:33.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.433+0000 7fec47e00640 1 -- 172.21.15.144:0/1169073480 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec38037040 con 0x7fec500b3d50 2024-09-11T23:19:33.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.433+0000 7fec55e00640 1 -- 172.21.15.144:0/1169073480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec500cc450 con 0x7fec500b3d50 2024-09-11T23:19:33.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.433+0000 7fec55e00640 1 -- 172.21.15.144:0/1169073480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec500cca10 con 0x7fec500b3d50 2024-09-11T23:19:33.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.434+0000 7fec55e00640 1 -- 172.21.15.144:0/1169073480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec500cf390 con 0x7fec500b3d50 2024-09-11T23:19:33.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.435+0000 7fec47e00640 1 -- 172.21.15.144:0/1169073480 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fec38044020 con 0x7fec500b3d50 2024-09-11T23:19:33.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.436+0000 7fec47e00640 1 --2- 172.21.15.144:0/1169073480 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fec2c06bfe0 0x7fec2c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.436+0000 7fec47e00640 1 -- 172.21.15.144:0/1169073480 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fec380abae0 con 0x7fec500b3d50 2024-09-11T23:19:33.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.436+0000 7fec4ea00640 1 --2- 172.21.15.144:0/1169073480 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fec2c06bfe0 0x7fec2c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.437+0000 7fec4ea00640 1 --2- 172.21.15.144:0/1169073480 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fec2c06bfe0 0x7fec2c06e4a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fec5006e440 tx=0x7fec4000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:33.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.440+0000 7fec47e00640 1 -- 172.21.15.144:0/1169073480 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec500cf390 con 0x7fec500b3d50 2024-09-11T23:19:33.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.613+0000 7fec55e00640 1 -- 172.21.15.144:0/1169073480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fec50069190 con 0x7fec500b3d50 2024-09-11T23:19:33.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.613+0000 7fec47e00640 1 -- 172.21.15.144:0/1169073480 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7fec3804b030 con 0x7fec500b3d50 2024-09-11T23:19:33.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.615+0000 7fec55e00640 1 -- 172.21.15.144:0/1169073480 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fec2c06bfe0 msgr2=0x7fec2c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.615+0000 7fec55e00640 1 --2- 172.21.15.144:0/1169073480 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fec2c06bfe0 0x7fec2c06e4a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fec5006e440 tx=0x7fec4000b040 comp rx=0 tx=0).stop 2024-09-11T23:19:33.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.615+0000 7fec55e00640 1 -- 172.21.15.144:0/1169073480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec500b3d50 msgr2=0x7fec500cd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.615+0000 7fec55e00640 1 --2- 172.21.15.144:0/1169073480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec500b3d50 0x7fec500cd9a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fec3802a2b0 tx=0x7fec380046c0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.615+0000 7fec55e00640 1 -- 172.21.15.144:0/1169073480 shutdown_connections 2024-09-11T23:19:33.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.615+0000 7fec55e00640 1 --2- 172.21.15.144:0/1169073480 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fec2c06bfe0 0x7fec2c06e4a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.615+0000 7fec55e00640 1 --2- 172.21.15.144:0/1169073480 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec50161e30 0x7fec5014d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.615+0000 7fec55e00640 1 --2- 172.21.15.144:0/1169073480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec500b3d50 0x7fec500cd9a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.615+0000 7fec55e00640 1 --2- 172.21.15.144:0/1169073480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec500b3290 0x7fec500cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.615+0000 7fec55e00640 1 -- 172.21.15.144:0/1169073480 >> 172.21.15.144:0/1169073480 conn(0x7fec500d1870 msgr2=0x7fec500b89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:33.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.615+0000 7fec55e00640 1 -- 172.21.15.144:0/1169073480 shutdown_connections 2024-09-11T23:19:33.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.616+0000 7fec55e00640 1 -- 172.21.15.144:0/1169073480 wait complete. 2024-09-11T23:19:33.631 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:19:33.631 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:33.667 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:19:33.668 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:33.743 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:19:33.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.939+0000 7ffbd3200640 1 Processor -- start 2024-09-11T23:19:33.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.939+0000 7ffbd3200640 1 -- start start 2024-09-11T23:19:33.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.940+0000 7ffbd3200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffbcc15c180 0x7ffbcc0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.940+0000 7ffbd3200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ffbcc0ce230 0x7ffbcc0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.940+0000 7ffbd3200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbcc0ce740 con 0x7ffbcc0cf5b0 2024-09-11T23:19:33.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.940+0000 7ffbd3200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ffbcc072640 con 0x7ffbcc15c180 2024-09-11T23:19:33.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.940+0000 7ffbd3200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ffbcc072920 con 0x7ffbcc0ce230 2024-09-11T23:19:33.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.941+0000 7ffbcbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffbcc15c180 0x7ffbcc0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.941+0000 7ffbcbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffbcc15c180 0x7ffbcc0cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37244/0 (socket says 172.21.15.144:37244) 2024-09-11T23:19:33.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.941+0000 7ffbcbe00640 1 -- 172.21.15.144:0/2907656165 learned_addr learned my addr 172.21.15.144:0/2907656165 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:33.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.941+0000 7ffbcbe00640 1 -- 172.21.15.144:0/2907656165 >> v2:172.21.15.165:3300/0 conn(0x7ffbcc0ce230 msgr2=0x7ffbcc0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:33.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.941+0000 7ffbcbe00640 1 --2- 172.21.15.144:0/2907656165 >> v2:172.21.15.165:3300/0 conn(0x7ffbcc0ce230 0x7ffbcc0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.941+0000 7ffbcbe00640 1 -- 172.21.15.144:0/2907656165 >> v1:172.21.15.165:6789/0 conn(0x7ffbcc0cf5b0 legacy=0x7ffbcc073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:33.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.941+0000 7ffbcbe00640 1 -- 172.21.15.144:0/2907656165 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbcc072c00 con 0x7ffbcc15c180 2024-09-11T23:19:33.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.942+0000 7ffbcbe00640 1 --2- 172.21.15.144:0/2907656165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbcc15c180 0x7ffbcc0cdcf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc071d60 tx=0x7ffbbc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400b62efd6ec7005 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:33.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.942+0000 7ffbcaa00640 1 -- 172.21.15.144:0/2907656165 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc037070 con 0x7ffbcc15c180 2024-09-11T23:19:33.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.942+0000 7ffbcaa00640 1 -- 172.21.15.144:0/2907656165 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbbc032440 con 0x7ffbcc15c180 2024-09-11T23:19:33.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.942+0000 7ffbcaa00640 1 -- 172.21.15.144:0/2907656165 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc032810 con 0x7ffbcc15c180 2024-09-11T23:19:33.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.943+0000 7ffbd3200640 1 -- 172.21.15.144:0/2907656165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbcc15c180 msgr2=0x7ffbcc0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.943+0000 7ffbd3200640 1 --2- 172.21.15.144:0/2907656165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbcc15c180 0x7ffbcc0cdcf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc071d60 tx=0x7ffbbc02a1a0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.943+0000 7ffbd3200640 1 -- 172.21.15.144:0/2907656165 shutdown_connections 2024-09-11T23:19:33.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.943+0000 7ffbd3200640 1 --2- 172.21.15.144:0/2907656165 >> v2:172.21.15.165:3300/0 conn(0x7ffbcc0ce230 0x7ffbcc0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.943+0000 7ffbd3200640 1 --2- 172.21.15.144:0/2907656165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbcc15c180 0x7ffbcc0cdcf0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.943+0000 7ffbd3200640 1 -- 172.21.15.144:0/2907656165 >> 172.21.15.144:0/2907656165 conn(0x7ffbcc062cc0 msgr2=0x7ffbcc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:33.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.943+0000 7ffbd3200640 1 -- 172.21.15.144:0/2907656165 shutdown_connections 2024-09-11T23:19:33.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.943+0000 7ffbd3200640 1 -- 172.21.15.144:0/2907656165 wait complete. 2024-09-11T23:19:33.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.945+0000 7ffbd3200640 1 Processor -- start 2024-09-11T23:19:33.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.945+0000 7ffbd3200640 1 -- start start 2024-09-11T23:19:33.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.946+0000 7ffbd3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffbcc0ce230 0x7ffbcc15a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.946+0000 7ffbd3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbcc0cf5b0 0x7ffbcc0b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.946+0000 7ffbd3200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffbcc15c180 0x7ffbcc0b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.946+0000 7ffbd3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc15c560 con 0x7ffbcc0cf5b0 2024-09-11T23:19:33.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.946+0000 7ffbd3200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc0722f0 con 0x7ffbcc15c180 2024-09-11T23:19:33.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.946+0000 7ffbd3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffbcc15c6e0 con 0x7ffbcc0ce230 2024-09-11T23:19:33.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.946+0000 7ffbcb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbcc0cf5b0 0x7ffbcc0b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.946+0000 7ffbcb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbcc0cf5b0 0x7ffbcc0b3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37246/0 (socket says 172.21.15.144:37246) 2024-09-11T23:19:33.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.946+0000 7ffbcb400640 1 -- 172.21.15.144:0/735206314 learned_addr learned my addr 172.21.15.144:0/735206314 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:33.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.946+0000 7ffbd1200640 1 --2- 172.21.15.144:0/735206314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffbcc15c180 0x7ffbcc0b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.946+0000 7ffbcbe00640 1 --2- 172.21.15.144:0/735206314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffbcc0ce230 0x7ffbcc15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.947+0000 7ffbcb400640 1 -- 172.21.15.144:0/735206314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffbcc0ce230 msgr2=0x7ffbcc15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.947+0000 7ffbcb400640 1 --2- 172.21.15.144:0/735206314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffbcc0ce230 0x7ffbcc15a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.947+0000 7ffbcb400640 1 -- 172.21.15.144:0/735206314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffbcc15c180 msgr2=0x7ffbcc0b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:33.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.947+0000 7ffbcb400640 1 --2- 172.21.15.144:0/735206314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffbcc15c180 0x7ffbcc0b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:33.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.947+0000 7ffbcb400640 1 -- 172.21.15.144:0/735206314 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbcc0b3ec0 con 0x7ffbcc0cf5b0 2024-09-11T23:19:33.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.947+0000 7ffbd1200640 1 --2- 172.21.15.144:0/735206314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffbcc15c180 0x7ffbcc0b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:19:33.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.947+0000 7ffbcb400640 1 --2- 172.21.15.144:0/735206314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbcc0cf5b0 0x7ffbcc0b3440 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800b4d0 tx=0x7ffbb800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:33.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.947+0000 7ffbc3e00640 1 -- 172.21.15.144:0/735206314 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8014070 con 0x7ffbcc0cf5b0 2024-09-11T23:19:33.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.947+0000 7ffbc3e00640 1 -- 172.21.15.144:0/735206314 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb8010870 con 0x7ffbcc0cf5b0 2024-09-11T23:19:33.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.947+0000 7ffbc3e00640 1 -- 172.21.15.144:0/735206314 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8010c60 con 0x7ffbcc0cf5b0 2024-09-11T23:19:33.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.947+0000 7ffbd3200640 1 -- 172.21.15.144:0/735206314 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbcc0b4170 con 0x7ffbcc0cf5b0 2024-09-11T23:19:33.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.947+0000 7ffbd3200640 1 -- 172.21.15.144:0/735206314 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbcc0b4730 con 0x7ffbcc0cf5b0 2024-09-11T23:19:33.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.948+0000 7ffbd3200640 1 -- 172.21.15.144:0/735206314 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbcc0cf070 con 0x7ffbcc0cf5b0 2024-09-11T23:19:33.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.949+0000 7ffbc3e00640 1 -- 172.21.15.144:0/735206314 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7ffbb8017070 con 0x7ffbcc0cf5b0 2024-09-11T23:19:33.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.950+0000 7ffbc3e00640 1 --2- 172.21.15.144:0/735206314 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ffbac06bfe0 0x7ffbac06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:33.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.950+0000 7ffbc3e00640 1 -- 172.21.15.144:0/735206314 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7ffbb808af30 con 0x7ffbcc0cf5b0 2024-09-11T23:19:33.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.950+0000 7ffbcbe00640 1 --2- 172.21.15.144:0/735206314 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ffbac06bfe0 0x7ffbac06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:33.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.951+0000 7ffbcbe00640 1 --2- 172.21.15.144:0/735206314 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ffbac06bfe0 0x7ffbac06e4a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc034000 tx=0x7ffbbc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:33.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:33.954+0000 7ffbc3e00640 1 -- 172.21.15.144:0/735206314 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffbb8059000 con 0x7ffbcc0cf5b0 2024-09-11T23:19:34.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.137+0000 7ffbd3200640 1 -- 172.21.15.144:0/735206314 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ffbcc06d170 con 0x7ffbcc0cf5b0 2024-09-11T23:19:34.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.138+0000 7ffbc3e00640 1 -- 172.21.15.144:0/735206314 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) ==== 80+0+0 (secure 0 0 0) 0x7ffbb805d300 con 0x7ffbcc0cf5b0 2024-09-11T23:19:34.138 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:19:34.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.140+0000 7ffbd3200640 1 -- 172.21.15.144:0/735206314 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ffbac06bfe0 msgr2=0x7ffbac06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:34.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.140+0000 7ffbd3200640 1 --2- 172.21.15.144:0/735206314 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ffbac06bfe0 0x7ffbac06e4a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc034000 tx=0x7ffbbc02e000 comp rx=0 tx=0).stop 2024-09-11T23:19:34.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.140+0000 7ffbd3200640 1 -- 172.21.15.144:0/735206314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbcc0cf5b0 msgr2=0x7ffbcc0b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:34.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.140+0000 7ffbd3200640 1 --2- 172.21.15.144:0/735206314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbcc0cf5b0 0x7ffbcc0b3440 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800b4d0 tx=0x7ffbb800b990 comp rx=0 tx=0).stop 2024-09-11T23:19:34.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.140+0000 7ffbd3200640 1 -- 172.21.15.144:0/735206314 shutdown_connections 2024-09-11T23:19:34.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.140+0000 7ffbd3200640 1 --2- 172.21.15.144:0/735206314 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ffbac06bfe0 0x7ffbac06e4a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.140+0000 7ffbd3200640 1 --2- 172.21.15.144:0/735206314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffbcc15c180 0x7ffbcc0b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.140+0000 7ffbd3200640 1 --2- 172.21.15.144:0/735206314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffbcc0cf5b0 0x7ffbcc0b3440 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.140+0000 7ffbd3200640 1 --2- 172.21.15.144:0/735206314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffbcc0ce230 0x7ffbcc15a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.140+0000 7ffbd3200640 1 -- 172.21.15.144:0/735206314 >> 172.21.15.144:0/735206314 conn(0x7ffbcc062cc0 msgr2=0x7ffbcc0cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:34.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.140+0000 7ffbd3200640 1 -- 172.21.15.144:0/735206314 shutdown_connections 2024-09-11T23:19:34.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.140+0000 7ffbd3200640 1 -- 172.21.15.144:0/735206314 wait complete. 2024-09-11T23:19:34.156 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T23:19:34.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:34.157 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T23:19:34.219 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:19:34.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:34.220 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:19:34.256 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:19:34.256 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:34.296 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:19:34.297 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:19:34.379 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:19:34.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.535+0000 7fed8e800640 1 Processor -- start 2024-09-11T23:19:34.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.535+0000 7fed8e800640 1 -- start start 2024-09-11T23:19:34.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.536+0000 7fed8e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fed880d02a0 0x7fed880d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:34.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.536+0000 7fed8e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed8815ceb0 0x7fed881594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:34.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.536+0000 7fed8e800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed880d0bc0 con 0x7fed8815ca40 2024-09-11T23:19:34.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.536+0000 7fed8e800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fed8815d390 con 0x7fed880d02a0 2024-09-11T23:19:34.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.536+0000 7fed8e800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fed8815d670 con 0x7fed8815ceb0 2024-09-11T23:19:34.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.537+0000 7fed87400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fed880d02a0 0x7fed880d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:34.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.537+0000 7fed87400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fed880d02a0 0x7fed880d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37786/0 (socket says 172.21.15.144:37786) 2024-09-11T23:19:34.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.537+0000 7fed87400640 1 -- 172.21.15.144:0/446359632 learned_addr learned my addr 172.21.15.144:0/446359632 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:34.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.537+0000 7fed7ea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fed8815ca40 0x7fed8815e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37482/0 (socket says 172.21.15.144:37482) 2024-09-11T23:19:34.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.537+0000 7fed87400640 1 -- 172.21.15.144:0/446359632 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed8815ceb0 msgr2=0x7fed881594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:34.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.537+0000 7fed87400640 1 --2- 172.21.15.144:0/446359632 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed8815ceb0 0x7fed881594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.537+0000 7fed87400640 1 -- 172.21.15.144:0/446359632 >> v1:172.21.15.144:6789/0 conn(0x7fed8815ca40 legacy=0x7fed8815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:34.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.537+0000 7fed87400640 1 -- 172.21.15.144:0/446359632 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed8815d950 con 0x7fed880d02a0 2024-09-11T23:19:34.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.538+0000 7fed87400640 1 --2- 172.21.15.144:0/446359632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed880d02a0 0x7fed880d0680 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fed78009870 tx=0x7fed7802c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1c2d95097a2649 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:34.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.538+0000 7fed86a00640 1 -- 172.21.15.144:0/446359632 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed78038070 con 0x7fed880d02a0 2024-09-11T23:19:34.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.538+0000 7fed86a00640 1 -- 172.21.15.144:0/446359632 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed78031710 con 0x7fed880d02a0 2024-09-11T23:19:34.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.538+0000 7fed86a00640 1 -- 172.21.15.144:0/446359632 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed78031ae0 con 0x7fed880d02a0 2024-09-11T23:19:34.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.539+0000 7fed8e800640 1 -- 172.21.15.144:0/446359632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed880d02a0 msgr2=0x7fed880d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:34.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.539+0000 7fed8e800640 1 --2- 172.21.15.144:0/446359632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed880d02a0 0x7fed880d0680 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fed78009870 tx=0x7fed7802c3f0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.539+0000 7fed8e800640 1 -- 172.21.15.144:0/446359632 shutdown_connections 2024-09-11T23:19:34.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.539+0000 7fed8e800640 1 --2- 172.21.15.144:0/446359632 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed8815ceb0 0x7fed881594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.539+0000 7fed8e800640 1 --2- 172.21.15.144:0/446359632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed880d02a0 0x7fed880d0680 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.539+0000 7fed8e800640 1 -- 172.21.15.144:0/446359632 >> 172.21.15.144:0/446359632 conn(0x7fed88062cc0 msgr2=0x7fed8806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:34.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.539+0000 7fed8e800640 1 -- 172.21.15.144:0/446359632 shutdown_connections 2024-09-11T23:19:34.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.539+0000 7fed8e800640 1 -- 172.21.15.144:0/446359632 wait complete. 2024-09-11T23:19:34.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.541+0000 7fed8e800640 1 Processor -- start 2024-09-11T23:19:34.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.541+0000 7fed8e800640 1 -- start start 2024-09-11T23:19:34.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.542+0000 7fed8e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed880d02a0 0x7fed8814c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:34.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.542+0000 7fed8e800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed8815ca40 0x7fed88154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:34.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.542+0000 7fed8e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed8815ceb0 0x7fed88154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:34.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.542+0000 7fed8e800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fed8815eb40 con 0x7fed8815ceb0 2024-09-11T23:19:34.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.542+0000 7fed8e800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fed8815df10 con 0x7fed8815ca40 2024-09-11T23:19:34.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.542+0000 7fed8e800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fed88155b90 con 0x7fed880d02a0 2024-09-11T23:19:34.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.542+0000 7fed87e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed8815ceb0 0x7fed88154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:34.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.542+0000 7fed87e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed8815ceb0 0x7fed88154580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37792/0 (socket says 172.21.15.144:37792) 2024-09-11T23:19:34.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.542+0000 7fed87e00640 1 -- 172.21.15.144:0/516594207 learned_addr learned my addr 172.21.15.144:0/516594207 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:34.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.542+0000 7fed87400640 1 --2- 172.21.15.144:0/516594207 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed880d02a0 0x7fed8814c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:34.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.542+0000 7fed7ea00640 1 --2- 172.21.15.144:0/516594207 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed8815ca40 0x7fed88154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:34.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.543+0000 7fed87e00640 1 -- 172.21.15.144:0/516594207 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed880d02a0 msgr2=0x7fed8814c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:34.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.543+0000 7fed87e00640 1 --2- 172.21.15.144:0/516594207 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed880d02a0 0x7fed8814c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.543+0000 7fed87e00640 1 -- 172.21.15.144:0/516594207 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed8815ca40 msgr2=0x7fed88154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:34.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.543+0000 7fed87e00640 1 --2- 172.21.15.144:0/516594207 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed8815ca40 0x7fed88154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.543+0000 7fed87e00640 1 -- 172.21.15.144:0/516594207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed88156b30 con 0x7fed8815ceb0 2024-09-11T23:19:34.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.543+0000 7fed87400640 1 --2- 172.21.15.144:0/516594207 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed880d02a0 0x7fed8814c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:34.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.543+0000 7fed7ea00640 1 --2- 172.21.15.144:0/516594207 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed8815ca40 0x7fed88154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:34.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.543+0000 7fed87e00640 1 --2- 172.21.15.144:0/516594207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed8815ceb0 0x7fed88154580 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fed8000b9e0 tx=0x7fed8000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:34.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.543+0000 7fed7fe00640 1 -- 172.21.15.144:0/516594207 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed80019070 con 0x7fed8815ceb0 2024-09-11T23:19:34.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.543+0000 7fed7fe00640 1 -- 172.21.15.144:0/516594207 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed8000cb20 con 0x7fed8815ceb0 2024-09-11T23:19:34.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.543+0000 7fed7fe00640 1 -- 172.21.15.144:0/516594207 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed80014440 con 0x7fed8815ceb0 2024-09-11T23:19:34.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.543+0000 7fed8e800640 1 -- 172.21.15.144:0/516594207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed88156850 con 0x7fed8815ceb0 2024-09-11T23:19:34.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.543+0000 7fed8e800640 1 -- 172.21.15.144:0/516594207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed880af3b0 con 0x7fed8815ceb0 2024-09-11T23:19:34.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.544+0000 7fed8e800640 1 -- 172.21.15.144:0/516594207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed880b50a0 con 0x7fed8815ceb0 2024-09-11T23:19:34.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.545+0000 7fed7fe00640 1 -- 172.21.15.144:0/516594207 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fed8001c070 con 0x7fed8815ceb0 2024-09-11T23:19:34.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.546+0000 7fed7fe00640 1 --2- 172.21.15.144:0/516594207 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fed6406bfe0 0x7fed6406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:34.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.546+0000 7fed7fe00640 1 -- 172.21.15.144:0/516594207 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fed8008aee0 con 0x7fed8815ceb0 2024-09-11T23:19:34.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.546+0000 7fed87400640 1 --2- 172.21.15.144:0/516594207 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fed6406bfe0 0x7fed6406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:34.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.547+0000 7fed87400640 1 --2- 172.21.15.144:0/516594207 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fed6406bfe0 0x7fed6406e4a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fed78035000 tx=0x7fed78008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:34.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.550+0000 7fed7fe00640 1 -- 172.21.15.144:0/516594207 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed880b50a0 con 0x7fed8815ceb0 2024-09-11T23:19:34.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.739+0000 7fed8e800640 1 -- 172.21.15.144:0/516594207 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fed880b4790 con 0x7fed8815ceb0 2024-09-11T23:19:34.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.740+0000 7fed7fe00640 1 -- 172.21.15.144:0/516594207 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) ==== 80+0+0 (secure 0 0 0) 0x7fed80059570 con 0x7fed8815ceb0 2024-09-11T23:19:34.740 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:19:34.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.742+0000 7fed8e800640 1 -- 172.21.15.144:0/516594207 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fed6406bfe0 msgr2=0x7fed6406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:34.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.742+0000 7fed8e800640 1 --2- 172.21.15.144:0/516594207 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fed6406bfe0 0x7fed6406e4a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fed78035000 tx=0x7fed78008030 comp rx=0 tx=0).stop 2024-09-11T23:19:34.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.742+0000 7fed8e800640 1 -- 172.21.15.144:0/516594207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed8815ceb0 msgr2=0x7fed88154580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:34.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.742+0000 7fed8e800640 1 --2- 172.21.15.144:0/516594207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed8815ceb0 0x7fed88154580 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fed8000b9e0 tx=0x7fed8000bea0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.742+0000 7fed8e800640 1 -- 172.21.15.144:0/516594207 shutdown_connections 2024-09-11T23:19:34.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.742+0000 7fed8e800640 1 --2- 172.21.15.144:0/516594207 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fed6406bfe0 0x7fed6406e4a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.742+0000 7fed8e800640 1 --2- 172.21.15.144:0/516594207 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fed8815ceb0 0x7fed88154580 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.742+0000 7fed8e800640 1 --2- 172.21.15.144:0/516594207 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed8815ca40 0x7fed88154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.742+0000 7fed8e800640 1 --2- 172.21.15.144:0/516594207 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fed880d02a0 0x7fed8814c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:34.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.742+0000 7fed8e800640 1 -- 172.21.15.144:0/516594207 >> 172.21.15.144:0/516594207 conn(0x7fed88062cc0 msgr2=0x7fed880b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:34.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.742+0000 7fed8e800640 1 -- 172.21.15.144:0/516594207 shutdown_connections 2024-09-11T23:19:34.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:34.743+0000 7fed8e800640 1 -- 172.21.15.144:0/516594207 wait complete. 2024-09-11T23:19:34.758 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-11T23:19:34.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:34.759 DEBUG:teuthology.orchestra.run.smithi165:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-11T23:19:34.828 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:19:34.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:19:34.828 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:19:34.866 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:35.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.020+0000 7f38eb200640 1 Processor -- start 2024-09-11T23:19:35.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.020+0000 7f38eb200640 1 -- start start 2024-09-11T23:19:35.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.021+0000 7f38eb200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38ec0b4510 0x7f38ec0b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:35.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.021+0000 7f38eb200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38ec0b31d0 con 0x7f38ec0b3ea0 2024-09-11T23:19:35.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.021+0000 7f38eb200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38ec15c0a0 con 0x7f38ec15b150 2024-09-11T23:19:35.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.021+0000 7f38eb200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f38ec15c380 con 0x7f38ec0b4510 2024-09-11T23:19:35.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.021+0000 7f38ea800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f38ec0b3ea0 0x7f38ec15b530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37488/0 (socket says 172.21.15.144:37488) 2024-09-11T23:19:35.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.021+0000 7f38ea800640 1 -- 172.21.15.144:0/3946173533 learned_addr learned my addr 172.21.15.144:0/3946173533 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:19:35.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.021+0000 7f38e9400640 1 --2- 172.21.15.144:0/3946173533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38ec0b4510 0x7f38ec0b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:35.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.022+0000 7f38e8a00640 1 -- 172.21.15.144:0/3946173533 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1709535514 0 0) 0x7f38ec0b31d0 con 0x7f38ec0b3ea0 2024-09-11T23:19:35.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.022+0000 7f38e9400640 1 -- 172.21.15.144:0/3946173533 >> v1:172.21.15.165:6789/0 conn(0x7f38ec15b150 legacy=0x7f38ec0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:35.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.022+0000 7f38e9400640 1 -- 172.21.15.144:0/3946173533 >> v1:172.21.15.144:6789/0 conn(0x7f38ec0b3ea0 legacy=0x7f38ec15b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:35.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.022+0000 7f38e9400640 1 -- 172.21.15.144:0/3946173533 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ec0b3440 con 0x7f38ec0b4510 2024-09-11T23:19:35.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.023+0000 7f38e9400640 1 --2- 172.21.15.144:0/3946173533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38ec0b4510 0x7f38ec0b3960 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009750 tx=0x7f38d802a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bacc5d6512e07afe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:35.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.023+0000 7f38e8a00640 1 -- 172.21.15.144:0/3946173533 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8037070 con 0x7f38ec0b4510 2024-09-11T23:19:35.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.023+0000 7f38e8a00640 1 -- 172.21.15.144:0/3946173533 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d802adb0 con 0x7f38ec0b4510 2024-09-11T23:19:35.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.023+0000 7f38e8a00640 1 -- 172.21.15.144:0/3946173533 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8032660 con 0x7f38ec0b4510 2024-09-11T23:19:35.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.024+0000 7f38eb200640 1 -- 172.21.15.144:0/3946173533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38ec0b4510 msgr2=0x7f38ec0b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:35.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.024+0000 7f38eb200640 1 --2- 172.21.15.144:0/3946173533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38ec0b4510 0x7f38ec0b3960 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009750 tx=0x7f38d802a0a0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.024+0000 7f38eb200640 1 -- 172.21.15.144:0/3946173533 shutdown_connections 2024-09-11T23:19:35.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.024+0000 7f38eb200640 1 --2- 172.21.15.144:0/3946173533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38ec0b4510 0x7f38ec0b3960 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.024+0000 7f38eb200640 1 -- 172.21.15.144:0/3946173533 >> 172.21.15.144:0/3946173533 conn(0x7f38ec06e910 msgr2=0x7f38ec06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:35.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.024+0000 7f38eb200640 1 -- 172.21.15.144:0/3946173533 shutdown_connections 2024-09-11T23:19:35.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.024+0000 7f38eb200640 1 -- 172.21.15.144:0/3946173533 wait complete. 2024-09-11T23:19:35.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.025+0000 7f38eb200640 1 Processor -- start 2024-09-11T23:19:35.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.025+0000 7f38eb200640 1 -- start start 2024-09-11T23:19:35.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.026+0000 7f38eb200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38ec0b3ea0 0x7f38ec071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:35.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.026+0000 7f38eb200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38ec0b4510 0x7f38ec073a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:35.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.026+0000 7f38eb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38ec15b150 0x7f38ec146a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:35.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.026+0000 7f38eb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec0cd200 con 0x7f38ec15b150 2024-09-11T23:19:35.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.026+0000 7f38eb200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec15bc40 con 0x7f38ec0b3ea0 2024-09-11T23:19:35.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.026+0000 7f38eb200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f38ec0729b0 con 0x7f38ec0b4510 2024-09-11T23:19:35.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.026+0000 7f38ea800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38ec15b150 0x7f38ec146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:35.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.027+0000 7f38ea800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38ec15b150 0x7f38ec146a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37800/0 (socket says 172.21.15.144:37800) 2024-09-11T23:19:35.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.027+0000 7f38e9400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38ec0b4510 0x7f38ec073a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:35.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.027+0000 7f38ea800640 1 -- 172.21.15.144:0/3330189509 learned_addr learned my addr 172.21.15.144:0/3330189509 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:35.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.027+0000 7f38e9e00640 1 --2- 172.21.15.144:0/3330189509 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38ec0b3ea0 0x7f38ec071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:35.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.027+0000 7f38e9400640 1 -- 172.21.15.144:0/3330189509 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38ec0b3ea0 msgr2=0x7f38ec071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:35.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.027+0000 7f38e9400640 1 --2- 172.21.15.144:0/3330189509 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38ec0b3ea0 0x7f38ec071010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.027+0000 7f38e9400640 1 -- 172.21.15.144:0/3330189509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38ec15b150 msgr2=0x7f38ec146a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:35.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.027+0000 7f38e9400640 1 --2- 172.21.15.144:0/3330189509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38ec15b150 0x7f38ec146a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.027+0000 7f38e9400640 1 -- 172.21.15.144:0/3330189509 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ec071910 con 0x7f38ec0b4510 2024-09-11T23:19:35.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.027+0000 7f38ea800640 1 --2- 172.21.15.144:0/3330189509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38ec15b150 0x7f38ec146a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:19:35.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.027+0000 7f38e9400640 1 --2- 172.21.15.144:0/3330189509 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38ec0b4510 0x7f38ec073a50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0b4980 tx=0x7f38d80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:35.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.028+0000 7f38e2000640 1 -- 172.21.15.144:0/3330189509 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8037040 con 0x7f38ec0b4510 2024-09-11T23:19:35.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.028+0000 7f38e2000640 1 -- 172.21.15.144:0/3330189509 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d8032e50 con 0x7f38ec0b4510 2024-09-11T23:19:35.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.028+0000 7f38eb200640 1 -- 172.21.15.144:0/3330189509 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38ec071bf0 con 0x7f38ec0b4510 2024-09-11T23:19:35.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.028+0000 7f38e2000640 1 -- 172.21.15.144:0/3330189509 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8004270 con 0x7f38ec0b4510 2024-09-11T23:19:35.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.028+0000 7f38eb200640 1 -- 172.21.15.144:0/3330189509 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f38ec072490 con 0x7f38ec0b4510 2024-09-11T23:19:35.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.029+0000 7f38eb200640 1 -- 172.21.15.144:0/3330189509 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38ec071fe0 con 0x7f38ec0b4510 2024-09-11T23:19:35.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.030+0000 7f38e2000640 1 -- 172.21.15.144:0/3330189509 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7f38d803a070 con 0x7f38ec0b4510 2024-09-11T23:19:35.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.031+0000 7f38e2000640 1 --2- 172.21.15.144:0/3330189509 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f38cc06c030 0x7f38cc06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:35.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.031+0000 7f38e2000640 1 -- 172.21.15.144:0/3330189509 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f38d80ab530 con 0x7f38ec0b4510 2024-09-11T23:19:35.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.031+0000 7f38e9e00640 1 --2- 172.21.15.144:0/3330189509 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f38cc06c030 0x7f38cc06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:35.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.032+0000 7f38e9e00640 1 --2- 172.21.15.144:0/3330189509 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f38cc06c030 0x7f38cc06e4f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f38dc000f60 tx=0x7f38dc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:35.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.036+0000 7f38e2000640 1 -- 172.21.15.144:0/3330189509 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f38d8041020 con 0x7f38ec0b4510 2024-09-11T23:19:35.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.246+0000 7f38eb200640 1 -- 172.21.15.144:0/3330189509 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38ec0b3960 con 0x7f38ec0b4510 2024-09-11T23:19:35.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.247+0000 7f38e2000640 1 -- 172.21.15.144:0/3330189509 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5232 (secure 0 0 0) 0x7f38d8079710 con 0x7f38ec0b4510 2024-09-11T23:19:35.247 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:35.247 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-11T23:19:32:857168+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:19:35.247 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-11T23:19:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.249+0000 7f38eb200640 1 -- 172.21.15.144:0/3330189509 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f38cc06c030 msgr2=0x7f38cc06e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.249+0000 7f38eb200640 1 --2- 172.21.15.144:0/3330189509 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f38cc06c030 0x7f38cc06e4f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f38dc000f60 tx=0x7f38dc009040 comp rx=0 tx=0).stop 2024-09-11T23:19:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.249+0000 7f38eb200640 1 -- 172.21.15.144:0/3330189509 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38ec0b4510 msgr2=0x7f38ec073a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.249+0000 7f38eb200640 1 --2- 172.21.15.144:0/3330189509 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38ec0b4510 0x7f38ec073a50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0b4980 tx=0x7f38d80046c0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.249+0000 7f38eb200640 1 -- 172.21.15.144:0/3330189509 shutdown_connections 2024-09-11T23:19:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.249+0000 7f38eb200640 1 --2- 172.21.15.144:0/3330189509 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f38cc06c030 0x7f38cc06e4f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.249+0000 7f38eb200640 1 --2- 172.21.15.144:0/3330189509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38ec15b150 0x7f38ec146a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.249+0000 7f38eb200640 1 --2- 172.21.15.144:0/3330189509 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38ec0b4510 0x7f38ec073a50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.249+0000 7f38eb200640 1 --2- 172.21.15.144:0/3330189509 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38ec0b3ea0 0x7f38ec071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.249+0000 7f38eb200640 1 -- 172.21.15.144:0/3330189509 >> 172.21.15.144:0/3330189509 conn(0x7f38ec06e910 msgr2=0x7f38ec157610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.249+0000 7f38eb200640 1 -- 172.21.15.144:0/3330189509 shutdown_connections 2024-09-11T23:19:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.249+0000 7f38eb200640 1 -- 172.21.15.144:0/3330189509 wait complete. 2024-09-11T23:19:35.266 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-11T23:19:35.441 INFO:teuthology.orchestra.run.smithi144.stdout:[] 2024-09-11T23:19:35.441 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-11T23:19:35.442 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol6320 2024-09-11T23:19:35.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.598+0000 7fb233600640 1 Processor -- start 2024-09-11T23:19:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.598+0000 7fb233600640 1 -- start start 2024-09-11T23:19:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.599+0000 7fb233600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb22c15d790 0x7fb22c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.599+0000 7fb233600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb22c0cd3b0 0x7fb22c0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.599+0000 7fb233600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22c06d700 con 0x7fb22c15d3b0 2024-09-11T23:19:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.599+0000 7fb233600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb22c06da30 con 0x7fb22c15d790 2024-09-11T23:19:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.599+0000 7fb233600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb22c0cde80 con 0x7fb22c0cd3b0 2024-09-11T23:19:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.599+0000 7fb22be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb22c15d790 0x7fb22c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.599+0000 7fb22be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb22c15d790 0x7fb22c0cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37816/0 (socket says 172.21.15.144:37816) 2024-09-11T23:19:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.599+0000 7fb22be00640 1 -- 172.21.15.144:0/2650480149 learned_addr learned my addr 172.21.15.144:0/2650480149 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.600+0000 7fb231600640 1 --2- 172.21.15.144:0/2650480149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb22c0cd3b0 0x7fb22c0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.600+0000 7fb22be00640 1 -- 172.21.15.144:0/2650480149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb22c0cd3b0 msgr2=0x7fb22c0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.600+0000 7fb22be00640 1 --2- 172.21.15.144:0/2650480149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb22c0cd3b0 0x7fb22c0cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.600+0000 7fb22be00640 1 -- 172.21.15.144:0/2650480149 >> v1:172.21.15.165:6789/0 conn(0x7fb22c15d3b0 legacy=0x7fb22c071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.600+0000 7fb22be00640 1 -- 172.21.15.144:0/2650480149 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22c0cd8c0 con 0x7fb22c15d790 2024-09-11T23:19:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.601+0000 7fb22be00640 1 --2- 172.21.15.144:0/2650480149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb22c15d790 0x7fb22c0cce70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb22c06dbb0 tx=0x7fb21802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c044e1c0d6fd20 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.601+0000 7fb22b400640 1 -- 172.21.15.144:0/2650480149 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb218004030 con 0x7fb22c15d790 2024-09-11T23:19:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.601+0000 7fb22b400640 1 -- 172.21.15.144:0/2650480149 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2180041d0 con 0x7fb22c15d790 2024-09-11T23:19:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.601+0000 7fb22b400640 1 -- 172.21.15.144:0/2650480149 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb218003610 con 0x7fb22c15d790 2024-09-11T23:19:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.601+0000 7fb233600640 1 -- 172.21.15.144:0/2650480149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb22c15d790 msgr2=0x7fb22c0cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.601+0000 7fb233600640 1 --2- 172.21.15.144:0/2650480149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb22c15d790 0x7fb22c0cce70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb22c06dbb0 tx=0x7fb21802a230 comp rx=0 tx=0).stop 2024-09-11T23:19:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.602+0000 7fb233600640 1 -- 172.21.15.144:0/2650480149 shutdown_connections 2024-09-11T23:19:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.602+0000 7fb233600640 1 --2- 172.21.15.144:0/2650480149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb22c0cd3b0 0x7fb22c0cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.602+0000 7fb233600640 1 --2- 172.21.15.144:0/2650480149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb22c15d790 0x7fb22c0cce70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.602+0000 7fb233600640 1 -- 172.21.15.144:0/2650480149 >> 172.21.15.144:0/2650480149 conn(0x7fb22c06bba0 msgr2=0x7fb22c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.602+0000 7fb233600640 1 -- 172.21.15.144:0/2650480149 shutdown_connections 2024-09-11T23:19:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.602+0000 7fb233600640 1 -- 172.21.15.144:0/2650480149 wait complete. 2024-09-11T23:19:35.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.603+0000 7fb233600640 1 Processor -- start 2024-09-11T23:19:35.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.603+0000 7fb233600640 1 -- start start 2024-09-11T23:19:35.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.604+0000 7fb233600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb22c0cd3b0 0x7fb22c0af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:35.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.604+0000 7fb233600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb22c15d3b0 0x7fb22c148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:35.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.604+0000 7fb233600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb22c0ae250 0x7fb22c0ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:35.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.604+0000 7fb233600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c15cd70 con 0x7fb22c0cd3b0 2024-09-11T23:19:35.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.604+0000 7fb233600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c15cbf0 con 0x7fb22c15d3b0 2024-09-11T23:19:35.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.604+0000 7fb233600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb22c0cf860 con 0x7fb22c0ae250 2024-09-11T23:19:35.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.604+0000 7fb230c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb22c0cd3b0 0x7fb22c0af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:35.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.604+0000 7fb230c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb22c0cd3b0 0x7fb22c0af290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37824/0 (socket says 172.21.15.144:37824) 2024-09-11T23:19:35.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.604+0000 7fb230c00640 1 -- 172.21.15.144:0/3104131850 learned_addr learned my addr 172.21.15.144:0/3104131850 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:35.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.605+0000 7fb231600640 1 --2- 172.21.15.144:0/3104131850 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb22c0ae250 0x7fb22c0ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:35.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.605+0000 7fb22be00640 1 --2- 172.21.15.144:0/3104131850 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb22c15d3b0 0x7fb22c148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:35.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.605+0000 7fb230c00640 1 -- 172.21.15.144:0/3104131850 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb22c0ae250 msgr2=0x7fb22c0ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:35.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.605+0000 7fb230c00640 1 --2- 172.21.15.144:0/3104131850 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb22c0ae250 0x7fb22c0ae700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.605+0000 7fb230c00640 1 -- 172.21.15.144:0/3104131850 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb22c15d3b0 msgr2=0x7fb22c148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:35.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.605+0000 7fb230c00640 1 --2- 172.21.15.144:0/3104131850 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb22c15d3b0 0x7fb22c148c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.605+0000 7fb230c00640 1 -- 172.21.15.144:0/3104131850 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22c0af7d0 con 0x7fb22c0cd3b0 2024-09-11T23:19:35.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.605+0000 7fb22be00640 1 --2- 172.21.15.144:0/3104131850 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb22c15d3b0 0x7fb22c148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:35.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.605+0000 7fb230c00640 1 --2- 172.21.15.144:0/3104131850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb22c0cd3b0 0x7fb22c0af290 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb22000c400 tx=0x7fb22000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:35.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.605+0000 7fb228c00640 1 -- 172.21.15.144:0/3104131850 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2200052d0 con 0x7fb22c0cd3b0 2024-09-11T23:19:35.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.605+0000 7fb228c00640 1 -- 172.21.15.144:0/3104131850 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb220005490 con 0x7fb22c0cd3b0 2024-09-11T23:19:35.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.605+0000 7fb233600640 1 -- 172.21.15.144:0/3104131850 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb22c157740 con 0x7fb22c0cd3b0 2024-09-11T23:19:35.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.605+0000 7fb228c00640 1 -- 172.21.15.144:0/3104131850 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220007260 con 0x7fb22c0cd3b0 2024-09-11T23:19:35.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.606+0000 7fb233600640 1 -- 172.21.15.144:0/3104131850 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb22c0ad770 con 0x7fb22c0cd3b0 2024-09-11T23:19:35.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.607+0000 7fb233600640 1 -- 172.21.15.144:0/3104131850 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb22c0cfc40 con 0x7fb22c0cd3b0 2024-09-11T23:19:35.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.607+0000 7fb228c00640 1 -- 172.21.15.144:0/3104131850 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fb220007400 con 0x7fb22c0cd3b0 2024-09-11T23:19:35.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.608+0000 7fb228c00640 1 --2- 172.21.15.144:0/3104131850 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb20c06bfe0 0x7fb20c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:35.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.608+0000 7fb228c00640 1 -- 172.21.15.144:0/3104131850 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fb22008a6c0 con 0x7fb22c0cd3b0 2024-09-11T23:19:35.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.608+0000 7fb22be00640 1 --2- 172.21.15.144:0/3104131850 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb20c06bfe0 0x7fb20c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:35.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.609+0000 7fb22be00640 1 --2- 172.21.15.144:0/3104131850 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb20c06bfe0 0x7fb20c06e4a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb218033000 tx=0x7fb21802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:35.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.612+0000 7fb228c00640 1 -- 172.21.15.144:0/3104131850 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb220058de0 con 0x7fb22c0cd3b0 2024-09-11T23:19:35.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.810+0000 7fb233600640 1 -- 172.21.15.144:0/3104131850 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol6320", "target": ["mon-mgr", ""]}) -- 0x7fb22c06c120 con 0x7fb20c06bfe0 2024-09-11T23:19:35.816 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:19:35.816+0000 7f9c68e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:35.816 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:19:35.816+0000 7f9c68e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:35.816 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:19:35.816+0000 7f9c68e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:35.816 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:19:35.816+0000 7f9c68e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:35.816 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:19:35.816+0000 7f9c68e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:19:35.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.850+0000 7fb228c00640 1 -- 172.21.15.144:0/3104131850 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb22c06c120 con 0x7fb20c06bfe0 2024-09-11T23:19:35.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.852+0000 7fb233600640 1 -- 172.21.15.144:0/3104131850 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb20c06bfe0 msgr2=0x7fb20c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:35.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.852+0000 7fb233600640 1 --2- 172.21.15.144:0/3104131850 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb20c06bfe0 0x7fb20c06e4a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb218033000 tx=0x7fb21802e000 comp rx=0 tx=0).stop 2024-09-11T23:19:35.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.852+0000 7fb233600640 1 -- 172.21.15.144:0/3104131850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb22c0cd3b0 msgr2=0x7fb22c0af290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:35.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.852+0000 7fb233600640 1 --2- 172.21.15.144:0/3104131850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb22c0cd3b0 0x7fb22c0af290 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb22000c400 tx=0x7fb22000c8c0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.852+0000 7fb233600640 1 -- 172.21.15.144:0/3104131850 shutdown_connections 2024-09-11T23:19:35.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.852+0000 7fb233600640 1 --2- 172.21.15.144:0/3104131850 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb20c06bfe0 0x7fb20c06e4a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.852+0000 7fb233600640 1 --2- 172.21.15.144:0/3104131850 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb22c0ae250 0x7fb22c0ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.852+0000 7fb233600640 1 --2- 172.21.15.144:0/3104131850 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb22c15d3b0 0x7fb22c148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.852+0000 7fb233600640 1 --2- 172.21.15.144:0/3104131850 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb22c0cd3b0 0x7fb22c0af290 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:35.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.852+0000 7fb233600640 1 -- 172.21.15.144:0/3104131850 >> 172.21.15.144:0/3104131850 conn(0x7fb22c06bba0 msgr2=0x7fb22c0b06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:35.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.853+0000 7fb233600640 1 -- 172.21.15.144:0/3104131850 shutdown_connections 2024-09-11T23:19:35.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:35.853+0000 7fb233600640 1 -- 172.21.15.144:0/3104131850 wait complete. 2024-09-11T23:19:35.868 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:36.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.021+0000 7fd5eac00640 1 Processor -- start 2024-09-11T23:19:36.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.021+0000 7fd5eac00640 1 -- start start 2024-09-11T23:19:36.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.023+0000 7fd5eac00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd5e40d0a50 0x7fd5e41620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.023+0000 7fd5eac00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd5e415fd30 0x7fd5e40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.023+0000 7fd5eac00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e41625f0 con 0x7fd5e40b4930 2024-09-11T23:19:36.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.023+0000 7fd5eac00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd5e4160180 con 0x7fd5e415fd30 2024-09-11T23:19:36.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.023+0000 7fd5eac00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd5e40b52d0 con 0x7fd5e40d0a50 2024-09-11T23:19:36.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.023+0000 7fd5e8c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd5e415fd30 0x7fd5e40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.023+0000 7fd5e8c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd5e415fd30 0x7fd5e40b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37842/0 (socket says 172.21.15.144:37842) 2024-09-11T23:19:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.023+0000 7fd5e8c00640 1 -- 172.21.15.144:0/1501922194 learned_addr learned my addr 172.21.15.144:0/1501922194 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.023+0000 7fd5e3e00640 1 --2- 172.21.15.144:0/1501922194 >> v2:172.21.15.165:3300/0 conn(0x7fd5e40d0a50 0x7fd5e41620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.023+0000 7fd5e8c00640 1 -- 172.21.15.144:0/1501922194 >> v2:172.21.15.165:3300/0 conn(0x7fd5e40d0a50 msgr2=0x7fd5e41620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.023+0000 7fd5e8c00640 1 --2- 172.21.15.144:0/1501922194 >> v2:172.21.15.165:3300/0 conn(0x7fd5e40d0a50 0x7fd5e41620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.023+0000 7fd5e8c00640 1 -- 172.21.15.144:0/1501922194 >> v1:172.21.15.165:6789/0 conn(0x7fd5e40b4930 legacy=0x7fd5e415f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.023+0000 7fd5e8c00640 1 -- 172.21.15.144:0/1501922194 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e4162870 con 0x7fd5e415fd30 2024-09-11T23:19:36.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.023+0000 7fd5e3e00640 1 --2- 172.21.15.144:0/1501922194 >> v2:172.21.15.165:3300/0 conn(0x7fd5e40d0a50 0x7fd5e41620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:36.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.024+0000 7fd5e8c00640 1 --2- 172.21.15.144:0/1501922194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e415fd30 0x7fd5e40b4d90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd5e406cc40 tx=0x7fd5dc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fdda2f1e074bb5b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:36.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.025+0000 7fd5e3400640 1 -- 172.21.15.144:0/1501922194 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc036070 con 0x7fd5e415fd30 2024-09-11T23:19:36.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.025+0000 7fd5e3400640 1 -- 172.21.15.144:0/1501922194 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5dc031600 con 0x7fd5e415fd30 2024-09-11T23:19:36.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.025+0000 7fd5e3400640 1 -- 172.21.15.144:0/1501922194 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc0319d0 con 0x7fd5e415fd30 2024-09-11T23:19:36.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.025+0000 7fd5eac00640 1 -- 172.21.15.144:0/1501922194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e415fd30 msgr2=0x7fd5e40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.025+0000 7fd5eac00640 1 --2- 172.21.15.144:0/1501922194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e415fd30 0x7fd5e40b4d90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd5e406cc40 tx=0x7fd5dc02a660 comp rx=0 tx=0).stop 2024-09-11T23:19:36.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.025+0000 7fd5eac00640 1 -- 172.21.15.144:0/1501922194 shutdown_connections 2024-09-11T23:19:36.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.025+0000 7fd5eac00640 1 --2- 172.21.15.144:0/1501922194 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e415fd30 0x7fd5e40b4d90 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.025+0000 7fd5eac00640 1 --2- 172.21.15.144:0/1501922194 >> v2:172.21.15.165:3300/0 conn(0x7fd5e40d0a50 0x7fd5e41620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.025+0000 7fd5eac00640 1 -- 172.21.15.144:0/1501922194 >> 172.21.15.144:0/1501922194 conn(0x7fd5e4062cc0 msgr2=0x7fd5e406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:36.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.025+0000 7fd5eac00640 1 -- 172.21.15.144:0/1501922194 shutdown_connections 2024-09-11T23:19:36.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.025+0000 7fd5eac00640 1 -- 172.21.15.144:0/1501922194 wait complete. 2024-09-11T23:19:36.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.027+0000 7fd5eac00640 1 Processor -- start 2024-09-11T23:19:36.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.027+0000 7fd5eac00640 1 -- start start 2024-09-11T23:19:36.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.028+0000 7fd5eac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd5e40b4930 0x7fd5e41f8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.028+0000 7fd5eac00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5e415fd30 0x7fd5e4071410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.028+0000 7fd5eac00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e41f8cc0 0x7fd5e4071950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.028+0000 7fd5eac00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e40b3340 con 0x7fd5e41f8cc0 2024-09-11T23:19:36.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.028+0000 7fd5eac00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e4162e30 con 0x7fd5e415fd30 2024-09-11T23:19:36.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.028+0000 7fd5eac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e40b3620 con 0x7fd5e40b4930 2024-09-11T23:19:36.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.028+0000 7fd5e8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e41f8cc0 0x7fd5e4071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.028+0000 7fd5e8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e41f8cc0 0x7fd5e4071950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37848/0 (socket says 172.21.15.144:37848) 2024-09-11T23:19:36.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.028+0000 7fd5e8c00640 1 -- 172.21.15.144:0/2142292455 learned_addr learned my addr 172.21.15.144:0/2142292455 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:36.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.028+0000 7fd5e3e00640 1 --2- 172.21.15.144:0/2142292455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd5e40b4930 0x7fd5e41f8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.028+0000 7fd5db400640 1 --2- 172.21.15.144:0/2142292455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5e415fd30 0x7fd5e4071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.029+0000 7fd5e8c00640 1 -- 172.21.15.144:0/2142292455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd5e40b4930 msgr2=0x7fd5e41f8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.029+0000 7fd5e8c00640 1 --2- 172.21.15.144:0/2142292455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd5e40b4930 0x7fd5e41f8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.029+0000 7fd5e8c00640 1 -- 172.21.15.144:0/2142292455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5e415fd30 msgr2=0x7fd5e4071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.029+0000 7fd5e8c00640 1 --2- 172.21.15.144:0/2142292455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5e415fd30 0x7fd5e4071410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.029+0000 7fd5e8c00640 1 -- 172.21.15.144:0/2142292455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e414ad00 con 0x7fd5e41f8cc0 2024-09-11T23:19:36.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.029+0000 7fd5e8c00640 1 --2- 172.21.15.144:0/2142292455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e41f8cc0 0x7fd5e4071950 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009f40 tx=0x7fd5dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:36.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.029+0000 7fd5e0c00640 1 -- 172.21.15.144:0/2142292455 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc036050 con 0x7fd5e41f8cc0 2024-09-11T23:19:36.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.029+0000 7fd5e0c00640 1 -- 172.21.15.144:0/2142292455 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5dc042070 con 0x7fd5e41f8cc0 2024-09-11T23:19:36.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.029+0000 7fd5e0c00640 1 -- 172.21.15.144:0/2142292455 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc009510 con 0x7fd5e41f8cc0 2024-09-11T23:19:36.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.029+0000 7fd5eac00640 1 -- 172.21.15.144:0/2142292455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e414afe0 con 0x7fd5e41f8cc0 2024-09-11T23:19:36.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.030+0000 7fd5eac00640 1 -- 172.21.15.144:0/2142292455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e41f8260 con 0x7fd5e41f8cc0 2024-09-11T23:19:36.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.030+0000 7fd5eac00640 1 -- 172.21.15.144:0/2142292455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e41f8460 con 0x7fd5e41f8cc0 2024-09-11T23:19:36.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.031+0000 7fd5e0c00640 1 -- 172.21.15.144:0/2142292455 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7fd5dc007bd0 con 0x7fd5e41f8cc0 2024-09-11T23:19:36.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.032+0000 7fd5e0c00640 1 --2- 172.21.15.144:0/2142292455 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd5c006bfe0 0x7fd5c006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.032+0000 7fd5e0c00640 1 -- 172.21.15.144:0/2142292455 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fd5dc0ac140 con 0x7fd5e41f8cc0 2024-09-11T23:19:36.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.033+0000 7fd5e3e00640 1 --2- 172.21.15.144:0/2142292455 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd5c006bfe0 0x7fd5c006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.033+0000 7fd5e3e00640 1 --2- 172.21.15.144:0/2142292455 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd5c006bfe0 0x7fd5c006e4a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400ab60 tx=0x7fd5d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:36.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.036+0000 7fd5e0c00640 1 -- 172.21.15.144:0/2142292455 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd5e41f8460 con 0x7fd5e41f8cc0 2024-09-11T23:19:36.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.245+0000 7fd5eac00640 1 -- 172.21.15.144:0/2142292455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5e41f8050 con 0x7fd5e41f8cc0 2024-09-11T23:19:36.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.246+0000 7fd5e0c00640 1 -- 172.21.15.144:0/2142292455 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5232 (secure 0 0 0) 0x7fd5e41625f0 con 0x7fd5e41f8cc0 2024-09-11T23:19:36.246 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:36.246 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-11T23:19:32:857168+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:19:36.246 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-11T23:19:36.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.248+0000 7fd5eac00640 1 -- 172.21.15.144:0/2142292455 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd5c006bfe0 msgr2=0x7fd5c006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.248+0000 7fd5eac00640 1 --2- 172.21.15.144:0/2142292455 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd5c006bfe0 0x7fd5c006e4a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400ab60 tx=0x7fd5d4008040 comp rx=0 tx=0).stop 2024-09-11T23:19:36.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.248+0000 7fd5eac00640 1 -- 172.21.15.144:0/2142292455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e41f8cc0 msgr2=0x7fd5e4071950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.248+0000 7fd5eac00640 1 --2- 172.21.15.144:0/2142292455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e41f8cc0 0x7fd5e4071950 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009f40 tx=0x7fd5dc004a40 comp rx=0 tx=0).stop 2024-09-11T23:19:36.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.248+0000 7fd5eac00640 1 -- 172.21.15.144:0/2142292455 shutdown_connections 2024-09-11T23:19:36.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.248+0000 7fd5eac00640 1 --2- 172.21.15.144:0/2142292455 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd5c006bfe0 0x7fd5c006e4a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.248+0000 7fd5eac00640 1 --2- 172.21.15.144:0/2142292455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5e41f8cc0 0x7fd5e4071950 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.248+0000 7fd5eac00640 1 --2- 172.21.15.144:0/2142292455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5e415fd30 0x7fd5e4071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.248+0000 7fd5eac00640 1 --2- 172.21.15.144:0/2142292455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd5e40b4930 0x7fd5e41f8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.248+0000 7fd5eac00640 1 -- 172.21.15.144:0/2142292455 >> 172.21.15.144:0/2142292455 conn(0x7fd5e4062cc0 msgr2=0x7fd5e40b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:36.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.248+0000 7fd5eac00640 1 -- 172.21.15.144:0/2142292455 shutdown_connections 2024-09-11T23:19:36.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.248+0000 7fd5eac00640 1 -- 172.21.15.144:0/2142292455 wait complete. 2024-09-11T23:19:36.264 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-11T23:19:36.438 INFO:teuthology.orchestra.run.smithi144.stdout:[{"id":5439,"entity":{"name":{"type":"client","num":5439},"addr":{"type":"any","addr":"172.21.15.144:0","nonce":2058902015}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":0.60499004700000003,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.969855405788937,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5439 172.21.15.144:0/2058902015","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc","ceph_version":"ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)","entity_id":"y","hostname":"smithi144","pid":"35684","root":"/"}}] 2024-09-11T23:19:36.438 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi144", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35684", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.144:0", "nonce": 2058902015, "type": "any" }, "name": { "num": 5439, "type": "client" } }, "id": 5439, "inst": "client.5439 172.21.15.144:0/2058902015", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.969855405788937 }, "state": "open", "uptime": 0.604990047 } ] 2024-09-11T23:19:36.439 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:36.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.592+0000 7effc4a00640 1 Processor -- start 2024-09-11T23:19:36.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.592+0000 7effc4a00640 1 -- start start 2024-09-11T23:19:36.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.593+0000 7effc4a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7effc015b150 0x7effc00ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.593+0000 7effc4a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effc00b31d0 con 0x7effc00cd030 2024-09-11T23:19:36.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.593+0000 7effc4a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effc015c0a0 con 0x7effc00b4510 2024-09-11T23:19:36.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.593+0000 7effc4a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7effc015c380 con 0x7effc015b150 2024-09-11T23:19:36.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.593+0000 7effbf400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7effc015b150 0x7effc00ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.593+0000 7effbf400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7effc015b150 0x7effc00ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37856/0 (socket says 172.21.15.144:37856) 2024-09-11T23:19:36.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.593+0000 7effbf400640 1 -- 172.21.15.144:0/4177110064 learned_addr learned my addr 172.21.15.144:0/4177110064 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:36.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.593+0000 7effbfe00640 1 --1- 172.21.15.144:0/4177110064 >> v1:172.21.15.144:6789/0 conn(0x7effc00cd030 0x7effc015b530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37504/0 (socket says 172.21.15.144:37504) 2024-09-11T23:19:36.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.594+0000 7effbf400640 1 -- 172.21.15.144:0/4177110064 >> v1:172.21.15.165:6789/0 conn(0x7effc00b4510 legacy=0x7effc00b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:36.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.594+0000 7effbf400640 1 -- 172.21.15.144:0/4177110064 >> v1:172.21.15.144:6789/0 conn(0x7effc00cd030 legacy=0x7effc015b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.594+0000 7effbf400640 1 -- 172.21.15.144:0/4177110064 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc00b3440 con 0x7effc015b150 2024-09-11T23:19:36.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.595+0000 7effbf400640 1 --2- 172.21.15.144:0/4177110064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effc015b150 0x7effc00ccaf0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7effb00098a0 tx=0x7effb002a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee1bef2f1f7ec92 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:36.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.595+0000 7effbe000640 1 -- 172.21.15.144:0/4177110064 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb0037070 con 0x7effc015b150 2024-09-11T23:19:36.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.595+0000 7effbe000640 1 -- 172.21.15.144:0/4177110064 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb0032440 con 0x7effc015b150 2024-09-11T23:19:36.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.595+0000 7effbe000640 1 -- 172.21.15.144:0/4177110064 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb0032810 con 0x7effc015b150 2024-09-11T23:19:36.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.596+0000 7effc4a00640 1 -- 172.21.15.144:0/4177110064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effc015b150 msgr2=0x7effc00ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.596+0000 7effc4a00640 1 --2- 172.21.15.144:0/4177110064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effc015b150 0x7effc00ccaf0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7effb00098a0 tx=0x7effb002a2e0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.596+0000 7effc4a00640 1 -- 172.21.15.144:0/4177110064 shutdown_connections 2024-09-11T23:19:36.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.596+0000 7effc4a00640 1 --2- 172.21.15.144:0/4177110064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effc015b150 0x7effc00ccaf0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.596+0000 7effc4a00640 1 -- 172.21.15.144:0/4177110064 >> 172.21.15.144:0/4177110064 conn(0x7effc006e910 msgr2=0x7effc006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:36.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.596+0000 7effc4a00640 1 -- 172.21.15.144:0/4177110064 shutdown_connections 2024-09-11T23:19:36.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.596+0000 7effc4a00640 1 -- 172.21.15.144:0/4177110064 wait complete. 2024-09-11T23:19:36.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.597+0000 7effc4a00640 1 Processor -- start 2024-09-11T23:19:36.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.598+0000 7effc4a00640 1 -- start start 2024-09-11T23:19:36.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.598+0000 7effc4a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effc00b4510 0x7effc0150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.598+0000 7effc4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effc00cd030 0x7effc00c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.598+0000 7effc4a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effc015b150 0x7effc00ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.598+0000 7effc4a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7effc00b41f0 con 0x7effc00cd030 2024-09-11T23:19:36.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.598+0000 7effc4a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7effc00b4070 con 0x7effc00b4510 2024-09-11T23:19:36.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.599+0000 7effc4a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7effc015bc40 con 0x7effc015b150 2024-09-11T23:19:36.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.599+0000 7effbea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effc00cd030 0x7effc00c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.599+0000 7effbea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effc00cd030 0x7effc00c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37866/0 (socket says 172.21.15.144:37866) 2024-09-11T23:19:36.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.599+0000 7effbea00640 1 -- 172.21.15.144:0/3143054092 learned_addr learned my addr 172.21.15.144:0/3143054092 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:36.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.599+0000 7effbf400640 1 --2- 172.21.15.144:0/3143054092 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effc00b4510 0x7effc0150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.599+0000 7effbfe00640 1 --2- 172.21.15.144:0/3143054092 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effc015b150 0x7effc00ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.599+0000 7effbea00640 1 -- 172.21.15.144:0/3143054092 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effc015b150 msgr2=0x7effc00ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.599+0000 7effbea00640 1 --2- 172.21.15.144:0/3143054092 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effc015b150 0x7effc00ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.599+0000 7effbea00640 1 -- 172.21.15.144:0/3143054092 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effc00b4510 msgr2=0x7effc0150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.599+0000 7effbea00640 1 --2- 172.21.15.144:0/3143054092 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effc00b4510 0x7effc0150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.599+0000 7effbea00640 1 -- 172.21.15.144:0/3143054092 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc0151000 con 0x7effc00cd030 2024-09-11T23:19:36.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.600+0000 7effbea00640 1 --2- 172.21.15.144:0/3143054092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effc00cd030 0x7effc00c6d10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7effac00b3f0 tx=0x7effac00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:36.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.600+0000 7effb7400640 1 -- 172.21.15.144:0/3143054092 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac015020 con 0x7effc00cd030 2024-09-11T23:19:36.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.600+0000 7effb7400640 1 -- 172.21.15.144:0/3143054092 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effac011830 con 0x7effc00cd030 2024-09-11T23:19:36.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.600+0000 7effc4a00640 1 -- 172.21.15.144:0/3143054092 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effc00c7810 con 0x7effc00cd030 2024-09-11T23:19:36.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.600+0000 7effb7400640 1 -- 172.21.15.144:0/3143054092 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac011c20 con 0x7effc00cd030 2024-09-11T23:19:36.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.600+0000 7effc4a00640 1 -- 172.21.15.144:0/3143054092 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effc015cda0 con 0x7effc00cd030 2024-09-11T23:19:36.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.601+0000 7effc4a00640 1 -- 172.21.15.144:0/3143054092 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effc015c8b0 con 0x7effc00cd030 2024-09-11T23:19:36.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.602+0000 7effb7400640 1 -- 172.21.15.144:0/3143054092 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 7) ==== 90651+0+0 (secure 0 0 0) 0x7effac018020 con 0x7effc00cd030 2024-09-11T23:19:36.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.603+0000 7effb7400640 1 --2- 172.21.15.144:0/3143054092 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7effa006c010 0x7effa006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:36.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.603+0000 7effb7400640 1 -- 172.21.15.144:0/3143054092 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7effac08ab80 con 0x7effc00cd030 2024-09-11T23:19:36.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.603+0000 7effbf400640 1 --2- 172.21.15.144:0/3143054092 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7effa006c010 0x7effa006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:36.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.604+0000 7effbf400640 1 --2- 172.21.15.144:0/3143054092 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7effa006c010 0x7effa006e4d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7effb0034000 tx=0x7effb002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:36.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.607+0000 7effb7400640 1 -- 172.21.15.144:0/3143054092 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7effac01f030 con 0x7effc00cd030 2024-09-11T23:19:36.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.815+0000 7effc4a00640 1 -- 172.21.15.144:0/3143054092 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effc00ccaf0 con 0x7effc00cd030 2024-09-11T23:19:36.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.816+0000 7effb7400640 1 -- 172.21.15.144:0/3143054092 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5232 (secure 0 0 0) 0x7effac058c60 con 0x7effc00cd030 2024-09-11T23:19:36.816 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:36.816 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-11T23:19:32:857168+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:19:36.816 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-11T23:19:36.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.818+0000 7effc4a00640 1 -- 172.21.15.144:0/3143054092 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7effa006c010 msgr2=0x7effa006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.818+0000 7effc4a00640 1 --2- 172.21.15.144:0/3143054092 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7effa006c010 0x7effa006e4d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7effb0034000 tx=0x7effb002e000 comp rx=0 tx=0).stop 2024-09-11T23:19:36.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.818+0000 7effc4a00640 1 -- 172.21.15.144:0/3143054092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effc00cd030 msgr2=0x7effc00c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:36.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.818+0000 7effc4a00640 1 --2- 172.21.15.144:0/3143054092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effc00cd030 0x7effc00c6d10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7effac00b3f0 tx=0x7effac00b8b0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.818+0000 7effc4a00640 1 -- 172.21.15.144:0/3143054092 shutdown_connections 2024-09-11T23:19:36.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.818+0000 7effc4a00640 1 --2- 172.21.15.144:0/3143054092 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7effa006c010 0x7effa006e4d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.818+0000 7effc4a00640 1 --2- 172.21.15.144:0/3143054092 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effc015b150 0x7effc00ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.818+0000 7effc4a00640 1 --2- 172.21.15.144:0/3143054092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effc00cd030 0x7effc00c6d10 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.818+0000 7effc4a00640 1 --2- 172.21.15.144:0/3143054092 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effc00b4510 0x7effc0150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:36.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.818+0000 7effc4a00640 1 -- 172.21.15.144:0/3143054092 >> 172.21.15.144:0/3143054092 conn(0x7effc006e910 msgr2=0x7effc006d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:36.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.818+0000 7effc4a00640 1 -- 172.21.15.144:0/3143054092 shutdown_connections 2024-09-11T23:19:36.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:36.818+0000 7effc4a00640 1 -- 172.21.15.144:0/3143054092 wait complete. 2024-09-11T23:19:36.834 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-11T23:19:37.009 INFO:teuthology.orchestra.run.smithi144.stdout:[{"id":5439,"entity":{"name":{"type":"client","num":5439},"addr":{"type":"any","addr":"172.21.15.144:0","nonce":2058902015}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":1.17798062,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.94078899315263,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5439 172.21.15.144:0/2058902015","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc","ceph_version":"ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)","entity_id":"y","hostname":"smithi144","pid":"35684","root":"/"}}] 2024-09-11T23:19:37.010 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi144", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35684", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.144:0", "nonce": 2058902015, "type": "any" }, "name": { "num": 5439, "type": "client" } }, "id": 5439, "inst": "client.5439 172.21.15.144:0/2058902015", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.94078899315263 }, "state": "open", "uptime": 1.17798062 } ] 2024-09-11T23:19:37.010 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-11T23:19:42.012 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:42.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.175+0000 7f4f65400640 1 Processor -- start 2024-09-11T23:19:42.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.175+0000 7f4f65400640 1 -- start start 2024-09-11T23:19:42.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.176+0000 7f4f65400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4f600b5fd0 0x7f4f600b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:42.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.176+0000 7f4f65400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4f600b7750 0x7f4f600b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:42.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.176+0000 7f4f65400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f6006bee0 con 0x7f4f6015e640 2024-09-11T23:19:42.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.176+0000 7f4f65400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f4f6015ea20 con 0x7f4f600b5fd0 2024-09-11T23:19:42.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.176+0000 7f4f65400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4f6006caf0 con 0x7f4f600b7750 2024-09-11T23:19:42.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.176+0000 7f4f5f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4f600b5fd0 0x7f4f600b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:42.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.176+0000 7f4f5f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4f600b5fd0 0x7f4f600b6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37876/0 (socket says 172.21.15.144:37876) 2024-09-11T23:19:42.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.176+0000 7f4f5f400640 1 -- 172.21.15.144:0/1845678482 learned_addr learned my addr 172.21.15.144:0/1845678482 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:42.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.176+0000 7f4f64a00640 1 --2- 172.21.15.144:0/1845678482 >> v2:172.21.15.165:3300/0 conn(0x7f4f600b7750 0x7f4f600b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:42.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.177+0000 7f4f5f400640 1 -- 172.21.15.144:0/1845678482 >> v2:172.21.15.165:3300/0 conn(0x7f4f600b7750 msgr2=0x7f4f600b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:42.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.177+0000 7f4f5f400640 1 --2- 172.21.15.144:0/1845678482 >> v2:172.21.15.165:3300/0 conn(0x7f4f600b7750 0x7f4f600b7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:42.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.177+0000 7f4f5f400640 1 -- 172.21.15.144:0/1845678482 >> v1:172.21.15.165:6789/0 conn(0x7f4f6015e640 legacy=0x7f4f600d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:42.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.177+0000 7f4f5f400640 1 -- 172.21.15.144:0/1845678482 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6006c1c0 con 0x7f4f600b5fd0 2024-09-11T23:19:42.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.178+0000 7f4f5f400640 1 --2- 172.21.15.144:0/1845678482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f600b5fd0 0x7f4f600b6410 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4f6008d350 tx=0x7f4f4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe65d12b23a6e6c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:42.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.178+0000 7f4f5ea00640 1 -- 172.21.15.144:0/1845678482 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c037070 con 0x7f4f600b5fd0 2024-09-11T23:19:42.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.178+0000 7f4f5ea00640 1 -- 172.21.15.144:0/1845678482 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f4c032440 con 0x7f4f600b5fd0 2024-09-11T23:19:42.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.178+0000 7f4f5ea00640 1 -- 172.21.15.144:0/1845678482 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c032810 con 0x7f4f600b5fd0 2024-09-11T23:19:42.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.179+0000 7f4f65400640 1 -- 172.21.15.144:0/1845678482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f600b5fd0 msgr2=0x7f4f600b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:42.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.179+0000 7f4f65400640 1 --2- 172.21.15.144:0/1845678482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f600b5fd0 0x7f4f600b6410 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4f6008d350 tx=0x7f4f4c02a270 comp rx=0 tx=0).stop 2024-09-11T23:19:42.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.179+0000 7f4f65400640 1 -- 172.21.15.144:0/1845678482 shutdown_connections 2024-09-11T23:19:42.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.179+0000 7f4f65400640 1 --2- 172.21.15.144:0/1845678482 >> v2:172.21.15.165:3300/0 conn(0x7f4f600b7750 0x7f4f600b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:42.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.179+0000 7f4f65400640 1 --2- 172.21.15.144:0/1845678482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f600b5fd0 0x7f4f600b6410 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:42.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.179+0000 7f4f65400640 1 -- 172.21.15.144:0/1845678482 >> 172.21.15.144:0/1845678482 conn(0x7f4f600d0fd0 msgr2=0x7f4f600d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:42.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.179+0000 7f4f65400640 1 -- 172.21.15.144:0/1845678482 shutdown_connections 2024-09-11T23:19:42.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.179+0000 7f4f65400640 1 -- 172.21.15.144:0/1845678482 wait complete. 2024-09-11T23:19:42.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.180+0000 7f4f65400640 1 Processor -- start 2024-09-11T23:19:42.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.181+0000 7f4f65400640 1 -- start start 2024-09-11T23:19:42.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.181+0000 7f4f65400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f600b5fd0 0x7f4f600cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:42.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.181+0000 7f4f65400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f600b7750 0x7f4f600ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:42.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.181+0000 7f4f65400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f6015e640 0x7f4f6015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:42.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.181+0000 7f4f65400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6006c780 con 0x7f4f600b7750 2024-09-11T23:19:42.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.181+0000 7f4f65400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4f600b6950 con 0x7f4f6015e640 2024-09-11T23:19:42.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.181+0000 7f4f65400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4f600d4130 con 0x7f4f600b5fd0 2024-09-11T23:19:42.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.182+0000 7f4f5f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f600b7750 0x7f4f600ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:42.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.182+0000 7f4f5f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f600b7750 0x7f4f600ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37892/0 (socket says 172.21.15.144:37892) 2024-09-11T23:19:42.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.182+0000 7f4f5f400640 1 -- 172.21.15.144:0/1082324490 learned_addr learned my addr 172.21.15.144:0/1082324490 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:42.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.182+0000 7f4f5fe00640 1 --2- 172.21.15.144:0/1082324490 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f600b5fd0 0x7f4f600cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:42.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.182+0000 7f4f64a00640 1 --2- 172.21.15.144:0/1082324490 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f6015e640 0x7f4f6015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:42.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.182+0000 7f4f5f400640 1 -- 172.21.15.144:0/1082324490 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f600b5fd0 msgr2=0x7f4f600cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:42.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.182+0000 7f4f5f400640 1 --2- 172.21.15.144:0/1082324490 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f600b5fd0 0x7f4f600cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:42.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.182+0000 7f4f5f400640 1 -- 172.21.15.144:0/1082324490 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f6015e640 msgr2=0x7f4f6015abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:42.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.182+0000 7f4f5f400640 1 --2- 172.21.15.144:0/1082324490 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f6015e640 0x7f4f6015abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:42.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.182+0000 7f4f5f400640 1 -- 172.21.15.144:0/1082324490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f600ce630 con 0x7f4f600b7750 2024-09-11T23:19:42.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.182+0000 7f4f5f400640 1 --2- 172.21.15.144:0/1082324490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f600b7750 0x7f4f600ce0f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c02a2b0 tx=0x7f4f4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:42.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.183+0000 7f4f57e00640 1 -- 172.21.15.144:0/1082324490 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c037040 con 0x7f4f600b7750 2024-09-11T23:19:42.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.183+0000 7f4f57e00640 1 -- 172.21.15.144:0/1082324490 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f4c042070 con 0x7f4f600b7750 2024-09-11T23:19:42.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.183+0000 7f4f57e00640 1 -- 172.21.15.144:0/1082324490 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c030880 con 0x7f4f600b7750 2024-09-11T23:19:42.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.183+0000 7f4f65400640 1 -- 172.21.15.144:0/1082324490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f6015b120 con 0x7f4f600b7750 2024-09-11T23:19:42.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.183+0000 7f4f65400640 1 -- 172.21.15.144:0/1082324490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f600cb900 con 0x7f4f600b7750 2024-09-11T23:19:42.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.184+0000 7f4f65400640 1 -- 172.21.15.144:0/1082324490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f600b6410 con 0x7f4f600b7750 2024-09-11T23:19:42.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.185+0000 7f4f57e00640 1 -- 172.21.15.144:0/1082324490 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 90702+0+0 (secure 0 0 0) 0x7f4f4c030a20 con 0x7f4f600b7750 2024-09-11T23:19:42.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.185+0000 7f4f57e00640 1 --2- 172.21.15.144:0/1082324490 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4f4006c0a0 0x7f4f4006e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:42.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.186+0000 7f4f57e00640 1 -- 172.21.15.144:0/1082324490 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f4f4c0ab980 con 0x7f4f600b7750 2024-09-11T23:19:42.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.186+0000 7f4f5fe00640 1 --2- 172.21.15.144:0/1082324490 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4f4006c0a0 0x7f4f4006e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:42.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.186+0000 7f4f5fe00640 1 --2- 172.21.15.144:0/1082324490 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4f4006c0a0 0x7f4f4006e560 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4f50001780 tx=0x7f4f50009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:42.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.190+0000 7f4f57e00640 1 -- 172.21.15.144:0/1082324490 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4f4c079930 con 0x7f4f600b7750 2024-09-11T23:19:42.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.396+0000 7f4f65400640 1 -- 172.21.15.144:0/1082324490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f600cf890 con 0x7f4f600b7750 2024-09-11T23:19:42.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.397+0000 7f4f57e00640 1 -- 172.21.15.144:0/1082324490 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5232 (secure 0 0 0) 0x7f4f4c07dc30 con 0x7f4f600b7750 2024-09-11T23:19:42.397 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:42.397 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-11T23:19:32:857168+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:19:42.397 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-11T23:19:42.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.399+0000 7f4f65400640 1 -- 172.21.15.144:0/1082324490 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4f4006c0a0 msgr2=0x7f4f4006e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:42.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.399+0000 7f4f65400640 1 --2- 172.21.15.144:0/1082324490 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4f4006c0a0 0x7f4f4006e560 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4f50001780 tx=0x7f4f50009040 comp rx=0 tx=0).stop 2024-09-11T23:19:42.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.399+0000 7f4f65400640 1 -- 172.21.15.144:0/1082324490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f600b7750 msgr2=0x7f4f600ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:42.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.399+0000 7f4f65400640 1 --2- 172.21.15.144:0/1082324490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f600b7750 0x7f4f600ce0f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c02a2b0 tx=0x7f4f4c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:19:42.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.400+0000 7f4f65400640 1 -- 172.21.15.144:0/1082324490 shutdown_connections 2024-09-11T23:19:42.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.400+0000 7f4f65400640 1 --2- 172.21.15.144:0/1082324490 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4f4006c0a0 0x7f4f4006e560 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:42.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.400+0000 7f4f65400640 1 --2- 172.21.15.144:0/1082324490 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f6015e640 0x7f4f6015abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:42.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.400+0000 7f4f65400640 1 --2- 172.21.15.144:0/1082324490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f600b7750 0x7f4f600ce0f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:42.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.400+0000 7f4f65400640 1 --2- 172.21.15.144:0/1082324490 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4f600b5fd0 0x7f4f600cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:42.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.400+0000 7f4f65400640 1 -- 172.21.15.144:0/1082324490 >> 172.21.15.144:0/1082324490 conn(0x7f4f600d0fd0 msgr2=0x7f4f600b7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:42.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.400+0000 7f4f65400640 1 -- 172.21.15.144:0/1082324490 shutdown_connections 2024-09-11T23:19:42.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:42.400+0000 7f4f65400640 1 -- 172.21.15.144:0/1082324490 wait complete. 2024-09-11T23:19:42.416 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-11T23:19:42.590 INFO:teuthology.orchestra.run.smithi144.stdout:[{"id":5439,"entity":{"name":{"type":"client","num":5439},"addr":{"type":"any","addr":"172.21.15.144:0","nonce":2058902015}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":6.7588888020000004,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.659686758050864,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5439 172.21.15.144:0/2058902015","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc","ceph_version":"ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)","entity_id":"y","hostname":"smithi144","pid":"35684","root":"/"}}] 2024-09-11T23:19:42.591 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi144", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35684", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.144:0", "nonce": 2058902015, "type": "any" }, "name": { "num": 5439, "type": "client" } }, "id": 5439, "inst": "client.5439 172.21.15.144:0/2058902015", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.659686758050864 }, "state": "open", "uptime": 6.758888802 } ] 2024-09-11T23:19:42.591 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-11T23:19:43.325 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:19:43.329 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:19:47.592 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.757+0000 7f20a0200640 1 Processor -- start 2024-09-11T23:19:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.757+0000 7f20a0200640 1 -- start start 2024-09-11T23:19:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.758+0000 7f20a0200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20980cf070 0x7f20980cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.758+0000 7f20a0200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2098073120 0x7f20980735b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.758+0000 7f20a0200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20980ce740 con 0x7f209815c180 2024-09-11T23:19:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.758+0000 7f20a0200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2098072640 con 0x7f20980cf070 2024-09-11T23:19:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.758+0000 7f20a0200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2098072920 con 0x7f2098073120 2024-09-11T23:19:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.759+0000 7f209ce00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20980cf070 0x7f20980cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.759+0000 7f209ce00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20980cf070 0x7f20980cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42414/0 (socket says 172.21.15.144:42414) 2024-09-11T23:19:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.759+0000 7f209ce00640 1 -- 172.21.15.144:0/4050111789 learned_addr learned my addr 172.21.15.144:0/4050111789 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.759+0000 7f209e200640 1 --2- 172.21.15.144:0/4050111789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2098073120 0x7f20980735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.759+0000 7f209ce00640 1 -- 172.21.15.144:0/4050111789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2098073120 msgr2=0x7f20980735b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.759+0000 7f209ce00640 1 --2- 172.21.15.144:0/4050111789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2098073120 0x7f20980735b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.759+0000 7f209ce00640 1 -- 172.21.15.144:0/4050111789 >> v1:172.21.15.165:6789/0 conn(0x7f209815c180 legacy=0x7f20980cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.759+0000 7f209ce00640 1 -- 172.21.15.144:0/4050111789 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2098072c00 con 0x7f20980cf070 2024-09-11T23:19:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.759+0000 7f209e200640 1 --2- 172.21.15.144:0/4050111789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2098073120 0x7f20980735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:47.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.760+0000 7f209ce00640 1 --2- 172.21.15.144:0/4050111789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20980cf070 0x7f20980cf4e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f209806f430 tx=0x7f208402a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1996d9a5973881e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:47.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.760+0000 7f2097e00640 1 -- 172.21.15.144:0/4050111789 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2084037070 con 0x7f20980cf070 2024-09-11T23:19:47.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.760+0000 7f2097e00640 1 -- 172.21.15.144:0/4050111789 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2084032440 con 0x7f20980cf070 2024-09-11T23:19:47.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.760+0000 7f2097e00640 1 -- 172.21.15.144:0/4050111789 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2084032810 con 0x7f20980cf070 2024-09-11T23:19:47.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.761+0000 7f20a0200640 1 -- 172.21.15.144:0/4050111789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20980cf070 msgr2=0x7f20980cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:47.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.761+0000 7f20a0200640 1 --2- 172.21.15.144:0/4050111789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20980cf070 0x7f20980cf4e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f209806f430 tx=0x7f208402a160 comp rx=0 tx=0).stop 2024-09-11T23:19:47.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.761+0000 7f20a0200640 1 -- 172.21.15.144:0/4050111789 shutdown_connections 2024-09-11T23:19:47.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.761+0000 7f20a0200640 1 --2- 172.21.15.144:0/4050111789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2098073120 0x7f20980735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:47.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.761+0000 7f20a0200640 1 --2- 172.21.15.144:0/4050111789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20980cf070 0x7f20980cf4e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:47.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.761+0000 7f20a0200640 1 -- 172.21.15.144:0/4050111789 >> 172.21.15.144:0/4050111789 conn(0x7f2098062cc0 msgr2=0x7f209806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:47.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.761+0000 7f20a0200640 1 -- 172.21.15.144:0/4050111789 shutdown_connections 2024-09-11T23:19:47.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.761+0000 7f20a0200640 1 -- 172.21.15.144:0/4050111789 wait complete. 2024-09-11T23:19:47.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.762+0000 7f20a0200640 1 Processor -- start 2024-09-11T23:19:47.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.763+0000 7f20a0200640 1 -- start start 2024-09-11T23:19:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.763+0000 7f20a0200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2098073120 0x7f209815f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.763+0000 7f20a0200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20980cf070 0x7f20981f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.763+0000 7f20a0200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f209815c180 0x7f20980cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.763+0000 7f20a0200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f20980722f0 con 0x7f2098073120 2024-09-11T23:19:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.763+0000 7f20a0200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f20980ced00 con 0x7f20980cf070 2024-09-11T23:19:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.763+0000 7f20a0200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f209815c560 con 0x7f209815c180 2024-09-11T23:19:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.764+0000 7f209d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2098073120 0x7f209815f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:47.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.764+0000 7f209d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2098073120 0x7f209815f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42428/0 (socket says 172.21.15.144:42428) 2024-09-11T23:19:47.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.764+0000 7f209d800640 1 -- 172.21.15.144:0/939925042 learned_addr learned my addr 172.21.15.144:0/939925042 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:47.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.764+0000 7f209ce00640 1 --2- 172.21.15.144:0/939925042 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20980cf070 0x7f20981f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:47.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.764+0000 7f209e200640 1 --2- 172.21.15.144:0/939925042 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f209815c180 0x7f20980cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:47.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.764+0000 7f209d800640 1 -- 172.21.15.144:0/939925042 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f209815c180 msgr2=0x7f20980cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:47.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.764+0000 7f209d800640 1 --2- 172.21.15.144:0/939925042 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f209815c180 0x7f20980cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:47.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.764+0000 7f209d800640 1 -- 172.21.15.144:0/939925042 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20980cf070 msgr2=0x7f20981f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:47.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.764+0000 7f209d800640 1 --2- 172.21.15.144:0/939925042 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20980cf070 0x7f20981f5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:47.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.764+0000 7f209d800640 1 -- 172.21.15.144:0/939925042 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20981f5770 con 0x7f2098073120 2024-09-11T23:19:47.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.765+0000 7f209d800640 1 --2- 172.21.15.144:0/939925042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2098073120 0x7f209815f840 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f208c00c440 tx=0x7f208c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:47.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.765+0000 7f2095600640 1 -- 172.21.15.144:0/939925042 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c017070 con 0x7f2098073120 2024-09-11T23:19:47.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.765+0000 7f2095600640 1 -- 172.21.15.144:0/939925042 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f208c0035f0 con 0x7f2098073120 2024-09-11T23:19:47.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.765+0000 7f20a0200640 1 -- 172.21.15.144:0/939925042 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20980cc580 con 0x7f2098073120 2024-09-11T23:19:47.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.765+0000 7f2095600640 1 -- 172.21.15.144:0/939925042 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c0039e0 con 0x7f2098073120 2024-09-11T23:19:47.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.765+0000 7f20a0200640 1 -- 172.21.15.144:0/939925042 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20980c5490 con 0x7f2098073120 2024-09-11T23:19:47.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.766+0000 7f20a0200640 1 -- 172.21.15.144:0/939925042 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20980c52b0 con 0x7f2098073120 2024-09-11T23:19:47.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.767+0000 7f2095600640 1 -- 172.21.15.144:0/939925042 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 90702+0+0 (secure 0 0 0) 0x7f208c01a070 con 0x7f2098073120 2024-09-11T23:19:47.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.768+0000 7f2095600640 1 --2- 172.21.15.144:0/939925042 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f207806c070 0x7f207806e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:47.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.768+0000 7f2095600640 1 -- 172.21.15.144:0/939925042 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f208c08a5b0 con 0x7f2098073120 2024-09-11T23:19:47.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.768+0000 7f209ce00640 1 --2- 172.21.15.144:0/939925042 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f207806c070 0x7f207806e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:47.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.769+0000 7f209ce00640 1 --2- 172.21.15.144:0/939925042 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f207806c070 0x7f207806e530 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2084034000 tx=0x7f208402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:47.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.773+0000 7f2095600640 1 -- 172.21.15.144:0/939925042 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f20980c52b0 con 0x7f2098073120 2024-09-11T23:19:47.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.980+0000 7f20a0200640 1 -- 172.21.15.144:0/939925042 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20980cf4e0 con 0x7f2098073120 2024-09-11T23:19:47.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.980+0000 7f2095600640 1 -- 172.21.15.144:0/939925042 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5232 (secure 0 0 0) 0x7f208c0010c0 con 0x7f2098073120 2024-09-11T23:19:47.980 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:47.980 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-11T23:19:32:857168+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:19:47.981 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-11T23:19:47.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.982+0000 7f20a0200640 1 -- 172.21.15.144:0/939925042 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f207806c070 msgr2=0x7f207806e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:47.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.982+0000 7f20a0200640 1 --2- 172.21.15.144:0/939925042 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f207806c070 0x7f207806e530 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2084034000 tx=0x7f208402e000 comp rx=0 tx=0).stop 2024-09-11T23:19:47.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.982+0000 7f20a0200640 1 -- 172.21.15.144:0/939925042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2098073120 msgr2=0x7f209815f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:47.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.982+0000 7f20a0200640 1 --2- 172.21.15.144:0/939925042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2098073120 0x7f209815f840 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f208c00c440 tx=0x7f208c00c900 comp rx=0 tx=0).stop 2024-09-11T23:19:47.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.982+0000 7f20a0200640 1 -- 172.21.15.144:0/939925042 shutdown_connections 2024-09-11T23:19:47.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.982+0000 7f20a0200640 1 --2- 172.21.15.144:0/939925042 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f207806c070 0x7f207806e530 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:47.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.982+0000 7f20a0200640 1 --2- 172.21.15.144:0/939925042 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f209815c180 0x7f20980cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:47.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.982+0000 7f20a0200640 1 --2- 172.21.15.144:0/939925042 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20980cf070 0x7f20981f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:47.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.982+0000 7f20a0200640 1 --2- 172.21.15.144:0/939925042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2098073120 0x7f209815f840 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:47.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.982+0000 7f20a0200640 1 -- 172.21.15.144:0/939925042 >> 172.21.15.144:0/939925042 conn(0x7f2098062cc0 msgr2=0x7f2098159800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:47.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.983+0000 7f20a0200640 1 -- 172.21.15.144:0/939925042 shutdown_connections 2024-09-11T23:19:47.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:47.983+0000 7f20a0200640 1 -- 172.21.15.144:0/939925042 wait complete. 2024-09-11T23:19:47.999 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-11T23:19:48.174 INFO:teuthology.orchestra.run.smithi144.stdout:[{"id":5439,"entity":{"name":{"type":"client","num":5439},"addr":{"type":"any","addr":"172.21.15.144:0","nonce":2058902015}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":12.342796935999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.382037757249154,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5439 172.21.15.144:0/2058902015","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc","ceph_version":"ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)","entity_id":"y","hostname":"smithi144","pid":"35684","root":"/"}}] 2024-09-11T23:19:48.175 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi144", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35684", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.144:0", "nonce": 2058902015, "type": "any" }, "name": { "num": 5439, "type": "client" } }, "id": 5439, "inst": "client.5439 172.21.15.144:0/2058902015", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.382037757249154 }, "state": "open", "uptime": 12.342796936 } ] 2024-09-11T23:19:48.175 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-11T23:19:53.176 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:53.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.341+0000 7f1656e00640 1 Processor -- start 2024-09-11T23:19:53.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.341+0000 7f1656e00640 1 -- start start 2024-09-11T23:19:53.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.342+0000 7f1656e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f165015e640 0x7f16500d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:53.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.342+0000 7f1656e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16500d3f60 0x7f16500b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:53.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.342+0000 7f1656e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f165006bee0 con 0x7f16500b6510 2024-09-11T23:19:53.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.342+0000 7f1656e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f165015ea20 con 0x7f165015e640 2024-09-11T23:19:53.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.342+0000 7f1656e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f165006caf0 con 0x7f16500d3f60 2024-09-11T23:19:53.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.342+0000 7f1655a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f165015e640 0x7f16500d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:53.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.342+0000 7f1655a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f165015e640 0x7f16500d3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42442/0 (socket says 172.21.15.144:42442) 2024-09-11T23:19:53.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.342+0000 7f1655a00640 1 -- 172.21.15.144:0/4031327586 learned_addr learned my addr 172.21.15.144:0/4031327586 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:53.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.343+0000 7f1655000640 1 --2- 172.21.15.144:0/4031327586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16500d3f60 0x7f16500b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:53.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.343+0000 7f1655a00640 1 -- 172.21.15.144:0/4031327586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16500d3f60 msgr2=0x7f16500b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:53.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.343+0000 7f1655a00640 1 --2- 172.21.15.144:0/4031327586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16500d3f60 0x7f16500b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:53.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.343+0000 7f1655a00640 1 -- 172.21.15.144:0/4031327586 >> v1:172.21.15.144:6789/0 conn(0x7f16500b6510 legacy=0x7f16500d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:53.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.343+0000 7f164fe00640 1 -- 172.21.15.144:0/4031327586 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 50609088 0 0) 0x7f165006bee0 con 0x7f16500b6510 2024-09-11T23:19:53.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.343+0000 7f1655a00640 1 -- 172.21.15.144:0/4031327586 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165006c1c0 con 0x7f165015e640 2024-09-11T23:19:53.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.344+0000 7f1655a00640 1 --2- 172.21.15.144:0/4031327586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f165015e640 0x7f16500d3a20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1644009870 tx=0x7f164402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15849cdd149ac69b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:53.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.344+0000 7f164fe00640 1 -- 172.21.15.144:0/4031327586 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644037070 con 0x7f165015e640 2024-09-11T23:19:53.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.344+0000 7f164fe00640 1 -- 172.21.15.144:0/4031327586 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1644032440 con 0x7f165015e640 2024-09-11T23:19:53.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.344+0000 7f164fe00640 1 -- 172.21.15.144:0/4031327586 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644032810 con 0x7f165015e640 2024-09-11T23:19:53.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.345+0000 7f1656e00640 1 -- 172.21.15.144:0/4031327586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f165015e640 msgr2=0x7f16500d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:53.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.345+0000 7f1656e00640 1 --2- 172.21.15.144:0/4031327586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f165015e640 0x7f16500d3a20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1644009870 tx=0x7f164402a270 comp rx=0 tx=0).stop 2024-09-11T23:19:53.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.345+0000 7f1656e00640 1 -- 172.21.15.144:0/4031327586 shutdown_connections 2024-09-11T23:19:53.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.345+0000 7f1656e00640 1 --2- 172.21.15.144:0/4031327586 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16500d3f60 0x7f16500b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:53.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.345+0000 7f1656e00640 1 --2- 172.21.15.144:0/4031327586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f165015e640 0x7f16500d3a20 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:53.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.345+0000 7f1656e00640 1 -- 172.21.15.144:0/4031327586 >> 172.21.15.144:0/4031327586 conn(0x7f16500d0fd0 msgr2=0x7f16500d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:53.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.345+0000 7f1656e00640 1 -- 172.21.15.144:0/4031327586 shutdown_connections 2024-09-11T23:19:53.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.345+0000 7f1656e00640 1 -- 172.21.15.144:0/4031327586 wait complete. 2024-09-11T23:19:53.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.346+0000 7f1656e00640 1 Processor -- start 2024-09-11T23:19:53.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.346+0000 7f1656e00640 1 -- start start 2024-09-11T23:19:53.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.347+0000 7f1656e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16500b6510 0x7f16500b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:53.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.347+0000 7f1656e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16500d3f60 0x7f16500aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:53.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.347+0000 7f1656e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f165015e640 0x7f16500ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:53.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.347+0000 7f1656e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f16500b8760 con 0x7f165015e640 2024-09-11T23:19:53.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.347+0000 7f1656e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f165006c780 con 0x7f16500b6510 2024-09-11T23:19:53.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.347+0000 7f1656e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f16500b88e0 con 0x7f16500d3f60 2024-09-11T23:19:53.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.348+0000 7f1656400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f165015e640 0x7f16500ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:53.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.348+0000 7f1656400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f165015e640 0x7f16500ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42454/0 (socket says 172.21.15.144:42454) 2024-09-11T23:19:53.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.348+0000 7f1656400640 1 -- 172.21.15.144:0/4256408972 learned_addr learned my addr 172.21.15.144:0/4256408972 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:53.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.348+0000 7f1655a00640 1 --2- 172.21.15.144:0/4256408972 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16500b6510 0x7f16500b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:53.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.348+0000 7f1655000640 1 --2- 172.21.15.144:0/4256408972 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16500d3f60 0x7f16500aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:53.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.348+0000 7f1656400640 1 -- 172.21.15.144:0/4256408972 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16500d3f60 msgr2=0x7f16500aafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:53.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.348+0000 7f1656400640 1 --2- 172.21.15.144:0/4256408972 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16500d3f60 0x7f16500aafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:53.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.348+0000 7f1656400640 1 -- 172.21.15.144:0/4256408972 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16500b6510 msgr2=0x7f16500b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:53.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.348+0000 7f1656400640 1 --2- 172.21.15.144:0/4256408972 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16500b6510 0x7f16500b32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:53.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.348+0000 7f1656400640 1 -- 172.21.15.144:0/4256408972 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165015afc0 con 0x7f165015e640 2024-09-11T23:19:53.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.348+0000 7f1655000640 1 --2- 172.21.15.144:0/4256408972 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16500d3f60 0x7f16500aafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:19:53.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.348+0000 7f1656400640 1 --2- 172.21.15.144:0/4256408972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f165015e640 0x7f16500ca520 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f164800c7e0 tx=0x7f164800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:53.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.349+0000 7f164d600640 1 -- 172.21.15.144:0/4256408972 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1648017070 con 0x7f165015e640 2024-09-11T23:19:53.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.349+0000 7f164d600640 1 -- 172.21.15.144:0/4256408972 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1648003dc0 con 0x7f165015e640 2024-09-11T23:19:53.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.349+0000 7f164d600640 1 -- 172.21.15.144:0/4256408972 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16480052b0 con 0x7f165015e640 2024-09-11T23:19:53.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.349+0000 7f1656e00640 1 -- 172.21.15.144:0/4256408972 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f165015b2a0 con 0x7f165015e640 2024-09-11T23:19:53.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.349+0000 7f1656e00640 1 -- 172.21.15.144:0/4256408972 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16500c8680 con 0x7f165015e640 2024-09-11T23:19:53.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.350+0000 7f1656e00640 1 -- 172.21.15.144:0/4256408972 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16500cf770 con 0x7f165015e640 2024-09-11T23:19:53.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.351+0000 7f164d600640 1 -- 172.21.15.144:0/4256408972 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 90702+0+0 (secure 0 0 0) 0x7f164801a070 con 0x7f165015e640 2024-09-11T23:19:53.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.351+0000 7f164d600640 1 --2- 172.21.15.144:0/4256408972 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f163006c070 0x7f163006e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:53.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.352+0000 7f164d600640 1 -- 172.21.15.144:0/4256408972 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f164808a940 con 0x7f165015e640 2024-09-11T23:19:53.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.352+0000 7f1655a00640 1 --2- 172.21.15.144:0/4256408972 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f163006c070 0x7f163006e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:53.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.352+0000 7f1655a00640 1 --2- 172.21.15.144:0/4256408972 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f163006c070 0x7f163006e530 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1644034000 tx=0x7f164402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:53.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.356+0000 7f164d600640 1 -- 172.21.15.144:0/4256408972 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1648058f40 con 0x7f165015e640 2024-09-11T23:19:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.565+0000 7f1656e00640 1 -- 172.21.15.144:0/4256408972 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16500b8120 con 0x7f165015e640 2024-09-11T23:19:53.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.566+0000 7f164d600640 1 -- 172.21.15.144:0/4256408972 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5232 (secure 0 0 0) 0x7f164808a070 con 0x7f165015e640 2024-09-11T23:19:53.566 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:53.566 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-11T23:19:32:857168+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:19:53.566 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-11T23:19:53.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.568+0000 7f1656e00640 1 -- 172.21.15.144:0/4256408972 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f163006c070 msgr2=0x7f163006e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:53.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.568+0000 7f1656e00640 1 --2- 172.21.15.144:0/4256408972 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f163006c070 0x7f163006e530 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1644034000 tx=0x7f164402e000 comp rx=0 tx=0).stop 2024-09-11T23:19:53.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.568+0000 7f1656e00640 1 -- 172.21.15.144:0/4256408972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f165015e640 msgr2=0x7f16500ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:53.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.568+0000 7f1656e00640 1 --2- 172.21.15.144:0/4256408972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f165015e640 0x7f16500ca520 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f164800c7e0 tx=0x7f164800cca0 comp rx=0 tx=0).stop 2024-09-11T23:19:53.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.568+0000 7f1656e00640 1 -- 172.21.15.144:0/4256408972 shutdown_connections 2024-09-11T23:19:53.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.568+0000 7f1656e00640 1 --2- 172.21.15.144:0/4256408972 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f163006c070 0x7f163006e530 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:53.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.568+0000 7f1656e00640 1 --2- 172.21.15.144:0/4256408972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f165015e640 0x7f16500ca520 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:53.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.568+0000 7f1656e00640 1 --2- 172.21.15.144:0/4256408972 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16500d3f60 0x7f16500aafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:53.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.568+0000 7f1656e00640 1 --2- 172.21.15.144:0/4256408972 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16500b6510 0x7f16500b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:53.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.568+0000 7f1656e00640 1 -- 172.21.15.144:0/4256408972 >> 172.21.15.144:0/4256408972 conn(0x7f16500d0fd0 msgr2=0x7f1650160fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:53.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.568+0000 7f1656e00640 1 -- 172.21.15.144:0/4256408972 shutdown_connections 2024-09-11T23:19:53.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:53.568+0000 7f1656e00640 1 -- 172.21.15.144:0/4256408972 wait complete. 2024-09-11T23:19:53.585 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-11T23:19:53.760 INFO:teuthology.orchestra.run.smithi144.stdout:[{"id":5439,"entity":{"name":{"type":"client","num":5439},"addr":{"type":"any","addr":"172.21.15.144:0","nonce":2058902015}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":12,"uptime":17.927705054,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.107899086484249,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5439 172.21.15.144:0/2058902015","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc","ceph_version":"ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)","entity_id":"y","hostname":"smithi144","pid":"35684","root":"/"}}] 2024-09-11T23:19:53.760 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi144", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35684", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.144:0", "nonce": 2058902015, "type": "any" }, "name": { "num": 5439, "type": "client" } }, "id": 5439, "inst": "client.5439 172.21.15.144:0/2058902015", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 12, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.10789908648425 }, "state": "open", "uptime": 17.927705054 } ] 2024-09-11T23:19:53.761 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-11T23:19:58.762 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:19:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.926+0000 7f6a6ce00640 1 Processor -- start 2024-09-11T23:19:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.926+0000 7f6a6ce00640 1 -- start start 2024-09-11T23:19:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.927+0000 7f6a6ce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a680d02a0 0x7f6a680d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.927+0000 7f6a6ce00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6a6815ca40 0x7f6a6815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.927+0000 7f6a6ce00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a6815ce80 0x7f6a681594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.927+0000 7f6a6ce00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6a680d0bc0 con 0x7f6a6815ce80 2024-09-11T23:19:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.927+0000 7f6a6ce00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6a6815d390 con 0x7f6a6815ca40 2024-09-11T23:19:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.927+0000 7f6a6ce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6815d670 con 0x7f6a680d02a0 2024-09-11T23:19:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.927+0000 7f6a66800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a6815ce80 0x7f6a681594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.927+0000 7f6a66800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a6815ce80 0x7f6a681594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45786/0 (socket says 172.21.15.144:45786) 2024-09-11T23:19:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.927+0000 7f6a66800640 1 -- 172.21.15.144:0/3927586780 learned_addr learned my addr 172.21.15.144:0/3927586780 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.927+0000 7f6a5d400640 1 --2- 172.21.15.144:0/3927586780 >> v2:172.21.15.165:3300/0 conn(0x7f6a6815ca40 0x7f6a6815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.927+0000 7f6a65e00640 1 --2- 172.21.15.144:0/3927586780 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a680d02a0 0x7f6a680d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.928+0000 7f6a66800640 1 -- 172.21.15.144:0/3927586780 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a680d02a0 msgr2=0x7f6a680d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.928+0000 7f6a66800640 1 --2- 172.21.15.144:0/3927586780 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a680d02a0 0x7f6a680d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.928+0000 7f6a66800640 1 -- 172.21.15.144:0/3927586780 >> v2:172.21.15.165:3300/0 conn(0x7f6a6815ca40 msgr2=0x7f6a6815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:19:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.928+0000 7f6a66800640 1 --2- 172.21.15.144:0/3927586780 >> v2:172.21.15.165:3300/0 conn(0x7f6a6815ca40 0x7f6a6815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.928+0000 7f6a66800640 1 -- 172.21.15.144:0/3927586780 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6815d950 con 0x7f6a6815ce80 2024-09-11T23:19:58.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.929+0000 7f6a66800640 1 --2- 172.21.15.144:0/3927586780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a6815ce80 0x7f6a681594c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6a6806f400 tx=0x7f6a6002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c000ed7779cbded5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:58.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.929+0000 7f6a65400640 1 -- 172.21.15.144:0/3927586780 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a60036070 con 0x7f6a6815ce80 2024-09-11T23:19:58.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.929+0000 7f6a65400640 1 -- 172.21.15.144:0/3927586780 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a60031600 con 0x7f6a6815ce80 2024-09-11T23:19:58.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.929+0000 7f6a65400640 1 -- 172.21.15.144:0/3927586780 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a600319d0 con 0x7f6a6815ce80 2024-09-11T23:19:58.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.929+0000 7f6a6ce00640 1 -- 172.21.15.144:0/3927586780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a6815ce80 msgr2=0x7f6a681594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:58.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.929+0000 7f6a6ce00640 1 --2- 172.21.15.144:0/3927586780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a6815ce80 0x7f6a681594c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6a6806f400 tx=0x7f6a6002a610 comp rx=0 tx=0).stop 2024-09-11T23:19:58.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.930+0000 7f6a6ce00640 1 -- 172.21.15.144:0/3927586780 shutdown_connections 2024-09-11T23:19:58.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.930+0000 7f6a6ce00640 1 --2- 172.21.15.144:0/3927586780 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a6815ce80 0x7f6a681594c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:58.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.930+0000 7f6a6ce00640 1 --2- 172.21.15.144:0/3927586780 >> v2:172.21.15.165:3300/0 conn(0x7f6a6815ca40 0x7f6a6815e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:58.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.930+0000 7f6a6ce00640 1 --2- 172.21.15.144:0/3927586780 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a680d02a0 0x7f6a680d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:58.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.930+0000 7f6a6ce00640 1 -- 172.21.15.144:0/3927586780 >> 172.21.15.144:0/3927586780 conn(0x7f6a68062cc0 msgr2=0x7f6a6806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:58.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.930+0000 7f6a6ce00640 1 -- 172.21.15.144:0/3927586780 shutdown_connections 2024-09-11T23:19:58.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.930+0000 7f6a6ce00640 1 -- 172.21.15.144:0/3927586780 wait complete. 2024-09-11T23:19:58.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.931+0000 7f6a6ce00640 1 Processor -- start 2024-09-11T23:19:58.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.931+0000 7f6a6ce00640 1 -- start start 2024-09-11T23:19:58.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.932+0000 7f6a6ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a680d02a0 0x7f6a681546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:58.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.932+0000 7f6a6ce00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a6815ca40 0x7f6a68071a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:58.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.932+0000 7f6a6ce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a6815ce80 0x7f6a6814a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:58.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.932+0000 7f6a6ce00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6a68155b90 con 0x7f6a680d02a0 2024-09-11T23:19:58.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.932+0000 7f6a6ce00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6815df10 con 0x7f6a6815ca40 2024-09-11T23:19:58.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.932+0000 7f6a6ce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6a68155d10 con 0x7f6a6815ce80 2024-09-11T23:19:58.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.932+0000 7f6a65e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a680d02a0 0x7f6a681546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:58.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.932+0000 7f6a65e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a680d02a0 0x7f6a681546d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45792/0 (socket says 172.21.15.144:45792) 2024-09-11T23:19:58.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.932+0000 7f6a65e00640 1 -- 172.21.15.144:0/3190406249 learned_addr learned my addr 172.21.15.144:0/3190406249 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:19:58.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.933+0000 7f6a5d400640 1 --2- 172.21.15.144:0/3190406249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a6815ca40 0x7f6a68071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:58.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.933+0000 7f6a66800640 1 --2- 172.21.15.144:0/3190406249 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a6815ce80 0x7f6a6814a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:58.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.933+0000 7f6a65e00640 1 -- 172.21.15.144:0/3190406249 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a6815ce80 msgr2=0x7f6a6814a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:58.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.933+0000 7f6a65e00640 1 --2- 172.21.15.144:0/3190406249 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a6815ce80 0x7f6a6814a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:58.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.933+0000 7f6a65e00640 1 -- 172.21.15.144:0/3190406249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a6815ca40 msgr2=0x7f6a68071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:58.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.933+0000 7f6a65e00640 1 --2- 172.21.15.144:0/3190406249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a6815ca40 0x7f6a68071a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:58.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.933+0000 7f6a65e00640 1 -- 172.21.15.144:0/3190406249 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a68072420 con 0x7f6a680d02a0 2024-09-11T23:19:58.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.933+0000 7f6a65e00640 1 --2- 172.21.15.144:0/3190406249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a680d02a0 0x7f6a681546d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800d800 tx=0x7f6a5800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:58.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.933+0000 7f6a5ea00640 1 -- 172.21.15.144:0/3190406249 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a58018030 con 0x7f6a680d02a0 2024-09-11T23:19:58.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.934+0000 7f6a5ea00640 1 -- 172.21.15.144:0/3190406249 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a58009640 con 0x7f6a680d02a0 2024-09-11T23:19:58.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.934+0000 7f6a6ce00640 1 -- 172.21.15.144:0/3190406249 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a68072700 con 0x7f6a680d02a0 2024-09-11T23:19:58.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.934+0000 7f6a5ea00640 1 -- 172.21.15.144:0/3190406249 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a58009810 con 0x7f6a680d02a0 2024-09-11T23:19:58.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.934+0000 7f6a6ce00640 1 -- 172.21.15.144:0/3190406249 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a68072cc0 con 0x7f6a680d02a0 2024-09-11T23:19:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.935+0000 7f6a6ce00640 1 -- 172.21.15.144:0/3190406249 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a680b4790 con 0x7f6a680d02a0 2024-09-11T23:19:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.936+0000 7f6a5ea00640 1 -- 172.21.15.144:0/3190406249 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 90702+0+0 (secure 0 0 0) 0x7f6a5801b070 con 0x7f6a680d02a0 2024-09-11T23:19:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.937+0000 7f6a5ea00640 1 --2- 172.21.15.144:0/3190406249 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6a4406c0a0 0x7f6a4406e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:19:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.937+0000 7f6a5ea00640 1 -- 172.21.15.144:0/3190406249 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f6a5808b2d0 con 0x7f6a680d02a0 2024-09-11T23:19:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.937+0000 7f6a5d400640 1 --2- 172.21.15.144:0/3190406249 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6a4406c0a0 0x7f6a4406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:19:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.938+0000 7f6a5d400640 1 --2- 172.21.15.144:0/3190406249 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6a4406c0a0 0x7f6a4406e560 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6a681f79a0 tx=0x7f6a50008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:19:58.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:58.942+0000 7f6a5ea00640 1 -- 172.21.15.144:0/3190406249 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a58059350 con 0x7f6a680d02a0 2024-09-11T23:19:59.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:59.151+0000 7f6a6ce00640 1 -- 172.21.15.144:0/3190406249 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a680b1240 con 0x7f6a680d02a0 2024-09-11T23:19:59.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:59.151+0000 7f6a5ea00640 1 -- 172.21.15.144:0/3190406249 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5232 (secure 0 0 0) 0x7f6a5805d650 con 0x7f6a680d02a0 2024-09-11T23:19:59.153 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:19:59.153 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-11T23:19:32:857168+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:19:59.153 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-11T23:19:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:59.154+0000 7f6a6ce00640 1 -- 172.21.15.144:0/3190406249 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6a4406c0a0 msgr2=0x7f6a4406e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:59.154+0000 7f6a6ce00640 1 --2- 172.21.15.144:0/3190406249 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6a4406c0a0 0x7f6a4406e560 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6a681f79a0 tx=0x7f6a50008040 comp rx=0 tx=0).stop 2024-09-11T23:19:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:59.154+0000 7f6a6ce00640 1 -- 172.21.15.144:0/3190406249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a680d02a0 msgr2=0x7f6a681546d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:19:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:59.154+0000 7f6a6ce00640 1 --2- 172.21.15.144:0/3190406249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a680d02a0 0x7f6a681546d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800d800 tx=0x7f6a5800dcc0 comp rx=0 tx=0).stop 2024-09-11T23:19:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:59.154+0000 7f6a6ce00640 1 -- 172.21.15.144:0/3190406249 shutdown_connections 2024-09-11T23:19:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:59.154+0000 7f6a6ce00640 1 --2- 172.21.15.144:0/3190406249 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6a4406c0a0 0x7f6a4406e560 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:59.154+0000 7f6a6ce00640 1 --2- 172.21.15.144:0/3190406249 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a6815ce80 0x7f6a6814a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:59.154+0000 7f6a6ce00640 1 --2- 172.21.15.144:0/3190406249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a6815ca40 0x7f6a68071a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:59.154+0000 7f6a6ce00640 1 --2- 172.21.15.144:0/3190406249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a680d02a0 0x7f6a681546d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:19:59.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:59.154+0000 7f6a6ce00640 1 -- 172.21.15.144:0/3190406249 >> 172.21.15.144:0/3190406249 conn(0x7f6a68062cc0 msgr2=0x7f6a6806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:19:59.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:59.154+0000 7f6a6ce00640 1 -- 172.21.15.144:0/3190406249 shutdown_connections 2024-09-11T23:19:59.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:19:59.154+0000 7f6a6ce00640 1 -- 172.21.15.144:0/3190406249 wait complete. 2024-09-11T23:19:59.171 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-11T23:19:59.346 INFO:teuthology.orchestra.run.smithi144.stdout:[{"id":5439,"entity":{"name":{"type":"client","num":5439},"addr":{"type":"any","addr":"172.21.15.144:0","nonce":2058902015}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":11,"uptime":23.514613138000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.837178855238587,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5439 172.21.15.144:0/2058902015","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc","ceph_version":"ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)","entity_id":"y","hostname":"smithi144","pid":"35684","root":"/"}}] 2024-09-11T23:19:59.347 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi144", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35684", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.144:0", "nonce": 2058902015, "type": "any" }, "name": { "num": 5439, "type": "client" } }, "id": 5439, "inst": "client.5439 172.21.15.144:0/2058902015", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 11, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.837178855238587 }, "state": "open", "uptime": 23.514613138 } ] 2024-09-11T23:19:59.347 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-11T23:20:04.349 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:04.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.516+0000 7fdf48600640 1 Processor -- start 2024-09-11T23:20:04.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.516+0000 7fdf48600640 1 -- start start 2024-09-11T23:20:04.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.517+0000 7fdf48600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdf4015e860 0x7fdf400cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:04.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.517+0000 7fdf48600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fdf400b61f0 0x7fdf400b6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:04.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.517+0000 7fdf48600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf4006c070 0x7fdf4006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:04.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.518+0000 7fdf48600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fdf400b6b80 con 0x7fdf4015e860 2024-09-11T23:20:04.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.518+0000 7fdf48600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fdf400d34d0 con 0x7fdf400b61f0 2024-09-11T23:20:04.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.518+0000 7fdf48600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdf400d3790 con 0x7fdf4006c070 2024-09-11T23:20:04.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.518+0000 7fdf45c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdf4015e860 0x7fdf400cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:04.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.518+0000 7fdf45c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdf4015e860 0x7fdf400cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41668/0 (socket says 172.21.15.144:41668) 2024-09-11T23:20:04.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.518+0000 7fdf45c00640 1 -- 172.21.15.144:0/828121589 learned_addr learned my addr 172.21.15.144:0/828121589 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:04.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.518+0000 7fdf46600640 1 --2- 172.21.15.144:0/828121589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf4006c070 0x7fdf4006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:04.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.518+0000 7fdf45200640 1 --2- 172.21.15.144:0/828121589 >> v2:172.21.15.165:3300/0 conn(0x7fdf400b61f0 0x7fdf400b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:04.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.518+0000 7fdf45c00640 1 -- 172.21.15.144:0/828121589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf4006c070 msgr2=0x7fdf4006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:04.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.518+0000 7fdf45c00640 1 --2- 172.21.15.144:0/828121589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf4006c070 0x7fdf4006c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.518+0000 7fdf45c00640 1 -- 172.21.15.144:0/828121589 >> v2:172.21.15.165:3300/0 conn(0x7fdf400b61f0 msgr2=0x7fdf400b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:04.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.518+0000 7fdf45c00640 1 --2- 172.21.15.144:0/828121589 >> v2:172.21.15.165:3300/0 conn(0x7fdf400b61f0 0x7fdf400b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.518+0000 7fdf45c00640 1 -- 172.21.15.144:0/828121589 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf400d3a70 con 0x7fdf4015e860 2024-09-11T23:20:04.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.518+0000 7fdf46600640 1 --2- 172.21.15.144:0/828121589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf4006c070 0x7fdf4006c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:04.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.519+0000 7fdf45c00640 1 --2- 172.21.15.144:0/828121589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf4015e860 0x7fdf400cf720 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdf400cecc0 tx=0x7fdf3402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae62532db8ff13b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:04.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.519+0000 7fdf3fe00640 1 -- 172.21.15.144:0/828121589 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf34037070 con 0x7fdf4015e860 2024-09-11T23:20:04.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.520+0000 7fdf3fe00640 1 -- 172.21.15.144:0/828121589 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf34032440 con 0x7fdf4015e860 2024-09-11T23:20:04.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.520+0000 7fdf3fe00640 1 -- 172.21.15.144:0/828121589 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf34032810 con 0x7fdf4015e860 2024-09-11T23:20:04.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.520+0000 7fdf48600640 1 -- 172.21.15.144:0/828121589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf4015e860 msgr2=0x7fdf400cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:04.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.520+0000 7fdf48600640 1 --2- 172.21.15.144:0/828121589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf4015e860 0x7fdf400cf720 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdf400cecc0 tx=0x7fdf3402a270 comp rx=0 tx=0).stop 2024-09-11T23:20:04.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.520+0000 7fdf48600640 1 -- 172.21.15.144:0/828121589 shutdown_connections 2024-09-11T23:20:04.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.520+0000 7fdf48600640 1 --2- 172.21.15.144:0/828121589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf4006c070 0x7fdf4006c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.520+0000 7fdf48600640 1 --2- 172.21.15.144:0/828121589 >> v2:172.21.15.165:3300/0 conn(0x7fdf400b61f0 0x7fdf400b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.520+0000 7fdf48600640 1 --2- 172.21.15.144:0/828121589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf4015e860 0x7fdf400cf720 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.520+0000 7fdf48600640 1 -- 172.21.15.144:0/828121589 >> 172.21.15.144:0/828121589 conn(0x7fdf40062c60 msgr2=0x7fdf400d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:04.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.520+0000 7fdf48600640 1 -- 172.21.15.144:0/828121589 shutdown_connections 2024-09-11T23:20:04.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.520+0000 7fdf48600640 1 -- 172.21.15.144:0/828121589 wait complete. 2024-09-11T23:20:04.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.522+0000 7fdf48600640 1 Processor -- start 2024-09-11T23:20:04.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.522+0000 7fdf48600640 1 -- start start 2024-09-11T23:20:04.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.523+0000 7fdf48600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf4006c070 0x7fdf4015c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:04.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.523+0000 7fdf48600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf400b61f0 0x7fdf400c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.523+0000 7fdf48600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf4015e860 0x7fdf400b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.523+0000 7fdf48600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdf400d4310 con 0x7fdf400b61f0 2024-09-11T23:20:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.523+0000 7fdf48600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdf400d4030 con 0x7fdf4006c070 2024-09-11T23:20:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.523+0000 7fdf48600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdf4015ec40 con 0x7fdf4015e860 2024-09-11T23:20:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.523+0000 7fdf45200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf400b61f0 0x7fdf400c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.523+0000 7fdf45200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf400b61f0 0x7fdf400c92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41682/0 (socket says 172.21.15.144:41682) 2024-09-11T23:20:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.523+0000 7fdf45200640 1 -- 172.21.15.144:0/1634985268 learned_addr learned my addr 172.21.15.144:0/1634985268 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.523+0000 7fdf45c00640 1 --2- 172.21.15.144:0/1634985268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf4006c070 0x7fdf4015c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.523+0000 7fdf46600640 1 --2- 172.21.15.144:0/1634985268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf4015e860 0x7fdf400b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.524+0000 7fdf45200640 1 -- 172.21.15.144:0/1634985268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf4015e860 msgr2=0x7fdf400b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.524+0000 7fdf45200640 1 --2- 172.21.15.144:0/1634985268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf4015e860 0x7fdf400b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.524+0000 7fdf45200640 1 -- 172.21.15.144:0/1634985268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf4006c070 msgr2=0x7fdf4015c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:04.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.524+0000 7fdf45200640 1 --2- 172.21.15.144:0/1634985268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf4006c070 0x7fdf4015c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.524+0000 7fdf45200640 1 -- 172.21.15.144:0/1634985268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf400c9bd0 con 0x7fdf400b61f0 2024-09-11T23:20:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.524+0000 7fdf45200640 1 --2- 172.21.15.144:0/1634985268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf400b61f0 0x7fdf400c92a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00d800 tx=0x7fdf2c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.524+0000 7fdf3d600640 1 -- 172.21.15.144:0/1634985268 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c00b6c0 con 0x7fdf400b61f0 2024-09-11T23:20:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.524+0000 7fdf3d600640 1 -- 172.21.15.144:0/1634985268 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf2c019070 con 0x7fdf400b61f0 2024-09-11T23:20:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.524+0000 7fdf48600640 1 -- 172.21.15.144:0/1634985268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf400c9eb0 con 0x7fdf400b61f0 2024-09-11T23:20:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.524+0000 7fdf3d600640 1 -- 172.21.15.144:0/1634985268 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c00ba80 con 0x7fdf400b61f0 2024-09-11T23:20:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.524+0000 7fdf48600640 1 -- 172.21.15.144:0/1634985268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf400c97e0 con 0x7fdf400b61f0 2024-09-11T23:20:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.526+0000 7fdf48600640 1 -- 172.21.15.144:0/1634985268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf400b3ad0 con 0x7fdf400b61f0 2024-09-11T23:20:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.526+0000 7fdf3d600640 1 -- 172.21.15.144:0/1634985268 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 90702+0+0 (secure 0 0 0) 0x7fdf2c00bc20 con 0x7fdf400b61f0 2024-09-11T23:20:04.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.527+0000 7fdf3d600640 1 --2- 172.21.15.144:0/1634985268 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdf2006c070 0x7fdf2006e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:04.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.527+0000 7fdf3d600640 1 -- 172.21.15.144:0/1634985268 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fdf2c08b590 con 0x7fdf400b61f0 2024-09-11T23:20:04.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.527+0000 7fdf45c00640 1 --2- 172.21.15.144:0/1634985268 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdf2006c070 0x7fdf2006e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:04.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.528+0000 7fdf45c00640 1 --2- 172.21.15.144:0/1634985268 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdf2006c070 0x7fdf2006e530 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdf34034000 tx=0x7fdf3402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:04.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.532+0000 7fdf3d600640 1 -- 172.21.15.144:0/1634985268 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdf2c059540 con 0x7fdf400b61f0 2024-09-11T23:20:04.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.751+0000 7fdf48600640 1 -- 172.21.15.144:0/1634985268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf400d2700 con 0x7fdf400b61f0 2024-09-11T23:20:04.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.752+0000 7fdf3d600640 1 -- 172.21.15.144:0/1634985268 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5232 (secure 0 0 0) 0x7fdf2c05d840 con 0x7fdf400b61f0 2024-09-11T23:20:04.753 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:20:04.753 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-11T23:19:32:857168+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:20:04.753 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-11T23:20:04.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.754+0000 7fdf48600640 1 -- 172.21.15.144:0/1634985268 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdf2006c070 msgr2=0x7fdf2006e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:04.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.754+0000 7fdf48600640 1 --2- 172.21.15.144:0/1634985268 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdf2006c070 0x7fdf2006e530 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdf34034000 tx=0x7fdf3402e000 comp rx=0 tx=0).stop 2024-09-11T23:20:04.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.754+0000 7fdf48600640 1 -- 172.21.15.144:0/1634985268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf400b61f0 msgr2=0x7fdf400c92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:04.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.754+0000 7fdf48600640 1 --2- 172.21.15.144:0/1634985268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf400b61f0 0x7fdf400c92a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00d800 tx=0x7fdf2c00dcc0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.754+0000 7fdf48600640 1 -- 172.21.15.144:0/1634985268 shutdown_connections 2024-09-11T23:20:04.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.754+0000 7fdf48600640 1 --2- 172.21.15.144:0/1634985268 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdf2006c070 0x7fdf2006e530 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.754+0000 7fdf48600640 1 --2- 172.21.15.144:0/1634985268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf4015e860 0x7fdf400b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.754+0000 7fdf48600640 1 --2- 172.21.15.144:0/1634985268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf400b61f0 0x7fdf400c92a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.754+0000 7fdf48600640 1 --2- 172.21.15.144:0/1634985268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf4006c070 0x7fdf4015c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:04.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.754+0000 7fdf48600640 1 -- 172.21.15.144:0/1634985268 >> 172.21.15.144:0/1634985268 conn(0x7fdf40062c60 msgr2=0x7fdf40160f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:04.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.755+0000 7fdf48600640 1 -- 172.21.15.144:0/1634985268 shutdown_connections 2024-09-11T23:20:04.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:04.755+0000 7fdf48600640 1 -- 172.21.15.144:0/1634985268 wait complete. 2024-09-11T23:20:04.780 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-11T23:20:04.955 INFO:teuthology.orchestra.run.smithi144.stdout:[{"id":5439,"entity":{"name":{"type":"client","num":5439},"addr":{"type":"any","addr":"172.21.15.144:0","nonce":2058902015}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":10,"uptime":29.123520860999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.568885215328837,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5439 172.21.15.144:0/2058902015","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc","ceph_version":"ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)","entity_id":"y","hostname":"smithi144","pid":"35684","root":"/"}}] 2024-09-11T23:20:04.956 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi144", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35684", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.144:0", "nonce": 2058902015, "type": "any" }, "name": { "num": 5439, "type": "client" } }, "id": 5439, "inst": "client.5439 172.21.15.144:0/2058902015", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 10, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.568885215328837 }, "state": "open", "uptime": 29.123520861 } ] 2024-09-11T23:20:04.956 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-11T23:20:09.957 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:10.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.121+0000 7efc46400640 1 Processor -- start 2024-09-11T23:20:10.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.121+0000 7efc46400640 1 -- start start 2024-09-11T23:20:10.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.122+0000 7efc46400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efc4015c300 0x7efc400affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:10.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.122+0000 7efc46400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc400cd300 0x7efc4006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:10.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.122+0000 7efc46400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc4015ecf0 con 0x7efc4006f010 2024-09-11T23:20:10.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.122+0000 7efc46400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efc4015c6e0 con 0x7efc4015c300 2024-09-11T23:20:10.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.122+0000 7efc46400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efc4015efb0 con 0x7efc400cd300 2024-09-11T23:20:10.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.123+0000 7efc3f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efc4015c300 0x7efc400affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:10.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.123+0000 7efc3f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efc4015c300 0x7efc400affc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41686/0 (socket says 172.21.15.144:41686) 2024-09-11T23:20:10.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.123+0000 7efc3f400640 1 -- 172.21.15.144:0/3458291016 learned_addr learned my addr 172.21.15.144:0/3458291016 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:10.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.123+0000 7efc3ea00640 1 --2- 172.21.15.144:0/3458291016 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc400cd300 0x7efc4006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:10.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.123+0000 7efc3f400640 1 -- 172.21.15.144:0/3458291016 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc400cd300 msgr2=0x7efc4006ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:10.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.123+0000 7efc3f400640 1 --2- 172.21.15.144:0/3458291016 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc400cd300 0x7efc4006ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:10.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.123+0000 7efc3f400640 1 -- 172.21.15.144:0/3458291016 >> v1:172.21.15.165:6789/0 conn(0x7efc4006f010 legacy=0x7efc401622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:10.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.123+0000 7efc3f400640 1 -- 172.21.15.144:0/3458291016 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc4015f290 con 0x7efc4015c300 2024-09-11T23:20:10.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.124+0000 7efc3f400640 1 --2- 172.21.15.144:0/3458291016 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc4015c300 0x7efc400affc0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7efc30009870 tx=0x7efc3002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910041a50bacc8f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:10.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.124+0000 7efc3e000640 1 -- 172.21.15.144:0/3458291016 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30037070 con 0x7efc4015c300 2024-09-11T23:20:10.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.124+0000 7efc3e000640 1 -- 172.21.15.144:0/3458291016 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc30032440 con 0x7efc4015c300 2024-09-11T23:20:10.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.124+0000 7efc3e000640 1 -- 172.21.15.144:0/3458291016 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30032810 con 0x7efc4015c300 2024-09-11T23:20:10.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.125+0000 7efc46400640 1 -- 172.21.15.144:0/3458291016 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc4015c300 msgr2=0x7efc400affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:10.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.125+0000 7efc46400640 1 --2- 172.21.15.144:0/3458291016 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc4015c300 0x7efc400affc0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7efc30009870 tx=0x7efc3002a1c0 comp rx=0 tx=0).stop 2024-09-11T23:20:10.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.125+0000 7efc46400640 1 -- 172.21.15.144:0/3458291016 shutdown_connections 2024-09-11T23:20:10.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.125+0000 7efc46400640 1 --2- 172.21.15.144:0/3458291016 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc400cd300 0x7efc4006ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:10.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.125+0000 7efc46400640 1 --2- 172.21.15.144:0/3458291016 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc4015c300 0x7efc400affc0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:10.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.125+0000 7efc46400640 1 -- 172.21.15.144:0/3458291016 >> 172.21.15.144:0/3458291016 conn(0x7efc4006cae0 msgr2=0x7efc4006cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:10.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.125+0000 7efc46400640 1 -- 172.21.15.144:0/3458291016 shutdown_connections 2024-09-11T23:20:10.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.125+0000 7efc46400640 1 -- 172.21.15.144:0/3458291016 wait complete. 2024-09-11T23:20:10.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.127+0000 7efc46400640 1 Processor -- start 2024-09-11T23:20:10.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.127+0000 7efc46400640 1 -- start start 2024-09-11T23:20:10.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.128+0000 7efc46400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc4006f010 0x7efc400cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:10.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.128+0000 7efc46400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc400cd300 0x7efc4015c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:10.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.128+0000 7efc46400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc4015c300 0x7efc400730f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:10.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.128+0000 7efc46400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efc40071880 con 0x7efc4006f010 2024-09-11T23:20:10.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.128+0000 7efc46400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efc4015f850 con 0x7efc4015c300 2024-09-11T23:20:10.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.128+0000 7efc46400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efc400b0500 con 0x7efc400cd300 2024-09-11T23:20:10.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.128+0000 7efc3f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc4006f010 0x7efc400cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:10.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.128+0000 7efc3f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc4006f010 0x7efc400cd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41694/0 (socket says 172.21.15.144:41694) 2024-09-11T23:20:10.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.128+0000 7efc3f400640 1 -- 172.21.15.144:0/593592379 learned_addr learned my addr 172.21.15.144:0/593592379 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:10.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.128+0000 7efc3ea00640 1 --2- 172.21.15.144:0/593592379 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc400cd300 0x7efc4015c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:10.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.128+0000 7efc3fe00640 1 --2- 172.21.15.144:0/593592379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc4015c300 0x7efc400730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:10.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.129+0000 7efc3f400640 1 -- 172.21.15.144:0/593592379 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc400cd300 msgr2=0x7efc4015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:10.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.129+0000 7efc3f400640 1 --2- 172.21.15.144:0/593592379 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc400cd300 0x7efc4015c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:10.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.129+0000 7efc3f400640 1 -- 172.21.15.144:0/593592379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc4015c300 msgr2=0x7efc400730f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:10.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.129+0000 7efc3f400640 1 --2- 172.21.15.144:0/593592379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc4015c300 0x7efc400730f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:10.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.129+0000 7efc3f400640 1 -- 172.21.15.144:0/593592379 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc400b2810 con 0x7efc4006f010 2024-09-11T23:20:10.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.129+0000 7efc3f400640 1 --2- 172.21.15.144:0/593592379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc4006f010 0x7efc400cd860 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7efc30000c00 tx=0x7efc300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:10.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.129+0000 7efc37400640 1 -- 172.21.15.144:0/593592379 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30037040 con 0x7efc4006f010 2024-09-11T23:20:10.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.129+0000 7efc37400640 1 -- 172.21.15.144:0/593592379 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc30042070 con 0x7efc4006f010 2024-09-11T23:20:10.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.129+0000 7efc46400640 1 -- 172.21.15.144:0/593592379 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc4015e530 con 0x7efc4006f010 2024-09-11T23:20:10.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.129+0000 7efc37400640 1 -- 172.21.15.144:0/593592379 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30030880 con 0x7efc4006f010 2024-09-11T23:20:10.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.129+0000 7efc46400640 1 -- 172.21.15.144:0/593592379 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc4014db40 con 0x7efc4006f010 2024-09-11T23:20:10.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.130+0000 7efc46400640 1 -- 172.21.15.144:0/593592379 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc4006ead0 con 0x7efc4006f010 2024-09-11T23:20:10.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.131+0000 7efc37400640 1 -- 172.21.15.144:0/593592379 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 90702+0+0 (secure 0 0 0) 0x7efc3002ad10 con 0x7efc4006f010 2024-09-11T23:20:10.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.132+0000 7efc37400640 1 --2- 172.21.15.144:0/593592379 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc2006c070 0x7efc2006e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:10.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.132+0000 7efc37400640 1 -- 172.21.15.144:0/593592379 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7efc300ab850 con 0x7efc4006f010 2024-09-11T23:20:10.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.132+0000 7efc3ea00640 1 --2- 172.21.15.144:0/593592379 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc2006c070 0x7efc2006e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:10.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.133+0000 7efc3ea00640 1 --2- 172.21.15.144:0/593592379 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc2006c070 0x7efc2006e530 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efc40159fd0 tx=0x7efc2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:10.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.137+0000 7efc37400640 1 -- 172.21.15.144:0/593592379 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc30079e50 con 0x7efc4006f010 2024-09-11T23:20:10.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.344+0000 7efc46400640 1 -- 172.21.15.144:0/593592379 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc400b69d0 con 0x7efc4006f010 2024-09-11T23:20:10.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.345+0000 7efc37400640 1 -- 172.21.15.144:0/593592379 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5232 (secure 0 0 0) 0x7efc30079750 con 0x7efc4006f010 2024-09-11T23:20:10.345 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:20:10.345 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-11T23:19:32:857168+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:20:10.345 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-11T23:20:10.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.347+0000 7efc46400640 1 -- 172.21.15.144:0/593592379 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc2006c070 msgr2=0x7efc2006e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:10.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.347+0000 7efc46400640 1 --2- 172.21.15.144:0/593592379 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc2006c070 0x7efc2006e530 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efc40159fd0 tx=0x7efc2c008040 comp rx=0 tx=0).stop 2024-09-11T23:20:10.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.347+0000 7efc46400640 1 -- 172.21.15.144:0/593592379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc4006f010 msgr2=0x7efc400cd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:10.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.347+0000 7efc46400640 1 --2- 172.21.15.144:0/593592379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc4006f010 0x7efc400cd860 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7efc30000c00 tx=0x7efc300046c0 comp rx=0 tx=0).stop 2024-09-11T23:20:10.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.347+0000 7efc46400640 1 -- 172.21.15.144:0/593592379 shutdown_connections 2024-09-11T23:20:10.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.347+0000 7efc46400640 1 --2- 172.21.15.144:0/593592379 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc2006c070 0x7efc2006e530 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.347+0000 7efc46400640 1 --2- 172.21.15.144:0/593592379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc4015c300 0x7efc400730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.347+0000 7efc46400640 1 --2- 172.21.15.144:0/593592379 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc400cd300 0x7efc4015c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.347+0000 7efc46400640 1 --2- 172.21.15.144:0/593592379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc4006f010 0x7efc400cd860 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.347+0000 7efc46400640 1 -- 172.21.15.144:0/593592379 >> 172.21.15.144:0/593592379 conn(0x7efc4006cae0 msgr2=0x7efc40162270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.347+0000 7efc46400640 1 -- 172.21.15.144:0/593592379 shutdown_connections 2024-09-11T23:20:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:10.347+0000 7efc46400640 1 -- 172.21.15.144:0/593592379 wait complete. 2024-09-11T23:20:10.362 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-11T23:20:10.537 INFO:teuthology.orchestra.run.smithi144.stdout:[{"id":5439,"entity":{"name":{"type":"client","num":5439},"addr":{"type":"any","addr":"172.21.15.144:0","nonce":2058902015}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":10,"uptime":34.705429027000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.30531269971155,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5439 172.21.15.144:0/2058902015","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc","ceph_version":"ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)","entity_id":"y","hostname":"smithi144","pid":"35684","root":"/"}}] 2024-09-11T23:20:10.537 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi144", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35684", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.144:0", "nonce": 2058902015, "type": "any" }, "name": { "num": 5439, "type": "client" } }, "id": 5439, "inst": "client.5439 172.21.15.144:0/2058902015", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 10, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.30531269971155 }, "state": "open", "uptime": 34.705429027 } ] 2024-09-11T23:20:10.537 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-11T23:20:13.430 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:20:13.436 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:20:15.538 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:15.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.702+0000 7f5b34000640 1 Processor -- start 2024-09-11T23:20:15.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.702+0000 7f5b34000640 1 -- start start 2024-09-11T23:20:15.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.704+0000 7f5b34000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5b2c15ca40 0x7f5b2c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:15.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.704+0000 7f5b34000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5b2c15ceb0 0x7f5b2c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:15.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.704+0000 7f5b34000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b2c15d390 con 0x7f5b2c0d02a0 2024-09-11T23:20:15.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.704+0000 7f5b34000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5b2c15d670 con 0x7f5b2c15ca40 2024-09-11T23:20:15.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.704+0000 7f5b34000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5b2c15d950 con 0x7f5b2c15ceb0 2024-09-11T23:20:15.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.704+0000 7f5b31600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5b2c0d02a0 0x7f5b2c0d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43058/0 (socket says 172.21.15.144:43058) 2024-09-11T23:20:15.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.704+0000 7f5b31600640 1 -- 172.21.15.144:0/3003667696 learned_addr learned my addr 172.21.15.144:0/3003667696 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:20:15.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.704+0000 7f5b30c00640 1 --2- 172.21.15.144:0/3003667696 >> v2:172.21.15.144:3300/0 conn(0x7f5b2c15ca40 0x7f5b2c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.704+0000 7f5b32000640 1 --2- 172.21.15.144:0/3003667696 >> v2:172.21.15.165:3300/0 conn(0x7f5b2c15ceb0 0x7f5b2c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.704+0000 7f5b30c00640 1 -- 172.21.15.144:0/3003667696 >> v2:172.21.15.165:3300/0 conn(0x7f5b2c15ceb0 msgr2=0x7f5b2c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.704+0000 7f5b30c00640 1 --2- 172.21.15.144:0/3003667696 >> v2:172.21.15.165:3300/0 conn(0x7f5b2c15ceb0 0x7f5b2c1594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.704+0000 7f5b30c00640 1 -- 172.21.15.144:0/3003667696 >> v1:172.21.15.144:6789/0 conn(0x7f5b2c0d02a0 legacy=0x7f5b2c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:15.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.704+0000 7f5b30c00640 1 -- 172.21.15.144:0/3003667696 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2c15dc30 con 0x7f5b2c15ca40 2024-09-11T23:20:15.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.705+0000 7f5b30c00640 1 --2- 172.21.15.144:0/3003667696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b2c15ca40 0x7f5b2c15e430 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0b4be0 tx=0x7f5b1802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72eaa647caeca6ef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:15.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.706+0000 7f5b2be00640 1 -- 172.21.15.144:0/3003667696 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b18037070 con 0x7f5b2c15ca40 2024-09-11T23:20:15.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.706+0000 7f5b2be00640 1 -- 172.21.15.144:0/3003667696 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b18032440 con 0x7f5b2c15ca40 2024-09-11T23:20:15.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.706+0000 7f5b2be00640 1 -- 172.21.15.144:0/3003667696 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1802ae60 con 0x7f5b2c15ca40 2024-09-11T23:20:15.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.706+0000 7f5b34000640 1 -- 172.21.15.144:0/3003667696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b2c15ca40 msgr2=0x7f5b2c15e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:15.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.706+0000 7f5b34000640 1 --2- 172.21.15.144:0/3003667696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b2c15ca40 0x7f5b2c15e430 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0b4be0 tx=0x7f5b1802a110 comp rx=0 tx=0).stop 2024-09-11T23:20:15.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.706+0000 7f5b34000640 1 -- 172.21.15.144:0/3003667696 shutdown_connections 2024-09-11T23:20:15.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.706+0000 7f5b34000640 1 --2- 172.21.15.144:0/3003667696 >> v2:172.21.15.165:3300/0 conn(0x7f5b2c15ceb0 0x7f5b2c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.706+0000 7f5b34000640 1 --2- 172.21.15.144:0/3003667696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b2c15ca40 0x7f5b2c15e430 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.706+0000 7f5b34000640 1 -- 172.21.15.144:0/3003667696 >> 172.21.15.144:0/3003667696 conn(0x7f5b2c062cc0 msgr2=0x7f5b2c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:15.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.706+0000 7f5b34000640 1 -- 172.21.15.144:0/3003667696 shutdown_connections 2024-09-11T23:20:15.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.706+0000 7f5b34000640 1 -- 172.21.15.144:0/3003667696 wait complete. 2024-09-11T23:20:15.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.708+0000 7f5b34000640 1 Processor -- start 2024-09-11T23:20:15.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.708+0000 7f5b34000640 1 -- start start 2024-09-11T23:20:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.709+0000 7f5b34000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5b2c0d02a0 0x7f5b2c071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.709+0000 7f5b34000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b2c15ca40 0x7f5b2c144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.709+0000 7f5b34000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b2c15ceb0 0x7f5b2c1493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.709+0000 7f5b34000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c155d10 con 0x7f5b2c15ca40 2024-09-11T23:20:15.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.709+0000 7f5b34000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c155b90 con 0x7f5b2c15ceb0 2024-09-11T23:20:15.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.709+0000 7f5b34000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5b2c0b4790 con 0x7f5b2c0d02a0 2024-09-11T23:20:15.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.709+0000 7f5b30c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b2c15ca40 0x7f5b2c144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:15.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.709+0000 7f5b30c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b2c15ca40 0x7f5b2c144ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45836/0 (socket says 172.21.15.144:45836) 2024-09-11T23:20:15.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.709+0000 7f5b30c00640 1 -- 172.21.15.144:0/4061395323 learned_addr learned my addr 172.21.15.144:0/4061395323 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:15.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.709+0000 7f5b31600640 1 --2- 172.21.15.144:0/4061395323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5b2c0d02a0 0x7f5b2c071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:15.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.709+0000 7f5b32000640 1 --2- 172.21.15.144:0/4061395323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b2c15ceb0 0x7f5b2c1493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:15.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.709+0000 7f5b30c00640 1 -- 172.21.15.144:0/4061395323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5b2c0d02a0 msgr2=0x7f5b2c071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:15.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.709+0000 7f5b30c00640 1 --2- 172.21.15.144:0/4061395323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5b2c0d02a0 0x7f5b2c071cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.709+0000 7f5b30c00640 1 -- 172.21.15.144:0/4061395323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b2c15ceb0 msgr2=0x7f5b2c1493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:15.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.709+0000 7f5b30c00640 1 --2- 172.21.15.144:0/4061395323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b2c15ceb0 0x7f5b2c1493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.709+0000 7f5b30c00640 1 -- 172.21.15.144:0/4061395323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2c14abe0 con 0x7f5b2c15ca40 2024-09-11T23:20:15.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.710+0000 7f5b30c00640 1 --2- 172.21.15.144:0/4061395323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b2c15ca40 0x7f5b2c144ef0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5b18000c00 tx=0x7f5b180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:15.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.710+0000 7f5b29600640 1 -- 172.21.15.144:0/4061395323 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b18037040 con 0x7f5b2c15ca40 2024-09-11T23:20:15.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.710+0000 7f5b29600640 1 -- 172.21.15.144:0/4061395323 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b18042070 con 0x7f5b2c15ca40 2024-09-11T23:20:15.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.710+0000 7f5b34000640 1 -- 172.21.15.144:0/4061395323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b2c149b40 con 0x7f5b2c15ca40 2024-09-11T23:20:15.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.710+0000 7f5b29600640 1 -- 172.21.15.144:0/4061395323 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b18030bd0 con 0x7f5b2c15ca40 2024-09-11T23:20:15.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.710+0000 7f5b34000640 1 -- 172.21.15.144:0/4061395323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b2c14a100 con 0x7f5b2c15ca40 2024-09-11T23:20:15.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.711+0000 7f5b34000640 1 -- 172.21.15.144:0/4061395323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b2c0d0680 con 0x7f5b2c15ca40 2024-09-11T23:20:15.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.712+0000 7f5b29600640 1 -- 172.21.15.144:0/4061395323 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 90702+0+0 (secure 0 0 0) 0x7f5b18047460 con 0x7f5b2c15ca40 2024-09-11T23:20:15.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.713+0000 7f5b29600640 1 --2- 172.21.15.144:0/4061395323 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b0c06c070 0x7f5b0c06e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:15.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.713+0000 7f5b29600640 1 -- 172.21.15.144:0/4061395323 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f5b180abf50 con 0x7f5b2c15ca40 2024-09-11T23:20:15.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.713+0000 7f5b31600640 1 --2- 172.21.15.144:0/4061395323 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b0c06c070 0x7f5b0c06e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:15.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.714+0000 7f5b31600640 1 --2- 172.21.15.144:0/4061395323 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b0c06c070 0x7f5b0c06e530 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5b20000f60 tx=0x7f5b20009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:15.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.717+0000 7f5b29600640 1 -- 172.21.15.144:0/4061395323 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5b18032e20 con 0x7f5b2c15ca40 2024-09-11T23:20:15.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.928+0000 7f5b34000640 1 -- 172.21.15.144:0/4061395323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b2c06d500 con 0x7f5b2c15ca40 2024-09-11T23:20:15.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.928+0000 7f5b29600640 1 -- 172.21.15.144:0/4061395323 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5232 (secure 0 0 0) 0x7f5b1807a4c0 con 0x7f5b2c15ca40 2024-09-11T23:20:15.928 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:20:15.928 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-11T23:19:32:857168+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:20:15.929 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-11T23:20:15.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.930+0000 7f5b34000640 1 -- 172.21.15.144:0/4061395323 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b0c06c070 msgr2=0x7f5b0c06e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:15.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.930+0000 7f5b34000640 1 --2- 172.21.15.144:0/4061395323 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b0c06c070 0x7f5b0c06e530 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5b20000f60 tx=0x7f5b20009040 comp rx=0 tx=0).stop 2024-09-11T23:20:15.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.930+0000 7f5b34000640 1 -- 172.21.15.144:0/4061395323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b2c15ca40 msgr2=0x7f5b2c144ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:15.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.930+0000 7f5b34000640 1 --2- 172.21.15.144:0/4061395323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b2c15ca40 0x7f5b2c144ef0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5b18000c00 tx=0x7f5b180046c0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.931+0000 7f5b34000640 1 -- 172.21.15.144:0/4061395323 shutdown_connections 2024-09-11T23:20:15.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.931+0000 7f5b34000640 1 --2- 172.21.15.144:0/4061395323 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b0c06c070 0x7f5b0c06e530 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.931+0000 7f5b34000640 1 --2- 172.21.15.144:0/4061395323 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b2c15ceb0 0x7f5b2c1493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.931+0000 7f5b34000640 1 --2- 172.21.15.144:0/4061395323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b2c15ca40 0x7f5b2c144ef0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.931+0000 7f5b34000640 1 --2- 172.21.15.144:0/4061395323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5b2c0d02a0 0x7f5b2c071cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:15.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.931+0000 7f5b34000640 1 -- 172.21.15.144:0/4061395323 >> 172.21.15.144:0/4061395323 conn(0x7f5b2c062cc0 msgr2=0x7f5b2c0b5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:15.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.931+0000 7f5b34000640 1 -- 172.21.15.144:0/4061395323 shutdown_connections 2024-09-11T23:20:15.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:15.931+0000 7f5b34000640 1 -- 172.21.15.144:0/4061395323 wait complete. 2024-09-11T23:20:15.946 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-11T23:20:16.120 INFO:teuthology.orchestra.run.smithi144.stdout:[{"id":5439,"entity":{"name":{"type":"client","num":5439},"addr":{"type":"any","addr":"172.21.15.144:0","nonce":2058902015}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":9,"uptime":40.289337160000002,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.045025012081787,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5439 172.21.15.144:0/2058902015","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc","ceph_version":"ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)","entity_id":"y","hostname":"smithi144","pid":"35684","root":"/"}}] 2024-09-11T23:20:16.120 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi144", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35684", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.144:0", "nonce": 2058902015, "type": "any" }, "name": { "num": 5439, "type": "client" } }, "id": 5439, "inst": "client.5439 172.21.15.144:0/2058902015", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 9, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.045025012081787 }, "state": "open", "uptime": 40.28933716 } ] 2024-09-11T23:20:16.120 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-11T23:20:21.122 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:21.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.285+0000 7f8a2b400640 1 Processor -- start 2024-09-11T23:20:21.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.286+0000 7f8a2b400640 1 -- start start 2024-09-11T23:20:21.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.287+0000 7f8a2b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8a240d02a0 0x7f8a240d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:21.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.287+0000 7f8a2b400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8a2415ca40 0x7f8a2415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:21.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.287+0000 7f8a2b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a2415ceb0 0x7f8a241594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:21.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.287+0000 7f8a2b400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8a240d0bc0 con 0x7f8a240d02a0 2024-09-11T23:20:21.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.287+0000 7f8a2b400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8a2415d390 con 0x7f8a2415ca40 2024-09-11T23:20:21.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.287+0000 7f8a2b400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8a2415d670 con 0x7f8a2415ceb0 2024-09-11T23:20:21.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.287+0000 7f8a28a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8a240d02a0 0x7f8a240d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:21.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.287+0000 7f8a28a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8a240d02a0 0x7f8a240d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45852/0 (socket says 172.21.15.144:45852) 2024-09-11T23:20:21.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.287+0000 7f8a28a00640 1 -- 172.21.15.144:0/64090462 learned_addr learned my addr 172.21.15.144:0/64090462 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:21.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.287+0000 7f8a1be00640 1 --2- 172.21.15.144:0/64090462 >> v2:172.21.15.165:3300/0 conn(0x7f8a2415ca40 0x7f8a2415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:21.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.287+0000 7f8a29400640 1 --2- 172.21.15.144:0/64090462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a2415ceb0 0x7f8a241594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:21.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.288+0000 7f8a28a00640 1 -- 172.21.15.144:0/64090462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a2415ceb0 msgr2=0x7f8a241594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:21.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.288+0000 7f8a28a00640 1 --2- 172.21.15.144:0/64090462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a2415ceb0 0x7f8a241594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.288+0000 7f8a28a00640 1 -- 172.21.15.144:0/64090462 >> v2:172.21.15.165:3300/0 conn(0x7f8a2415ca40 msgr2=0x7f8a2415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:21.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.288+0000 7f8a28a00640 1 --2- 172.21.15.144:0/64090462 >> v2:172.21.15.165:3300/0 conn(0x7f8a2415ca40 0x7f8a2415e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.288+0000 7f8a28a00640 1 -- 172.21.15.144:0/64090462 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2415d950 con 0x7f8a240d02a0 2024-09-11T23:20:21.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.289+0000 7f8a28a00640 1 --2- 172.21.15.144:0/64090462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a240d02a0 0x7f8a240d0680 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8a240cf320 tx=0x7f8a1402c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7733db69fe466d28 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:21.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.289+0000 7f8a23e00640 1 -- 172.21.15.144:0/64090462 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a14032700 con 0x7f8a240d02a0 2024-09-11T23:20:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.289+0000 7f8a23e00640 1 -- 172.21.15.144:0/64090462 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a140328a0 con 0x7f8a240d02a0 2024-09-11T23:20:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.289+0000 7f8a23e00640 1 -- 172.21.15.144:0/64090462 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a14032c70 con 0x7f8a240d02a0 2024-09-11T23:20:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.289+0000 7f8a2b400640 1 -- 172.21.15.144:0/64090462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a240d02a0 msgr2=0x7f8a240d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.289+0000 7f8a2b400640 1 --2- 172.21.15.144:0/64090462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a240d02a0 0x7f8a240d0680 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8a240cf320 tx=0x7f8a1402c800 comp rx=0 tx=0).stop 2024-09-11T23:20:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.290+0000 7f8a2b400640 1 -- 172.21.15.144:0/64090462 shutdown_connections 2024-09-11T23:20:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.290+0000 7f8a2b400640 1 --2- 172.21.15.144:0/64090462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a2415ceb0 0x7f8a241594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.290+0000 7f8a2b400640 1 --2- 172.21.15.144:0/64090462 >> v2:172.21.15.165:3300/0 conn(0x7f8a2415ca40 0x7f8a2415e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.290+0000 7f8a2b400640 1 --2- 172.21.15.144:0/64090462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a240d02a0 0x7f8a240d0680 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.290+0000 7f8a2b400640 1 -- 172.21.15.144:0/64090462 >> 172.21.15.144:0/64090462 conn(0x7f8a24062cc0 msgr2=0x7f8a2406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.290+0000 7f8a2b400640 1 -- 172.21.15.144:0/64090462 shutdown_connections 2024-09-11T23:20:21.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.290+0000 7f8a2b400640 1 -- 172.21.15.144:0/64090462 wait complete. 2024-09-11T23:20:21.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.291+0000 7f8a2b400640 1 Processor -- start 2024-09-11T23:20:21.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.291+0000 7f8a2b400640 1 -- start start 2024-09-11T23:20:21.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.292+0000 7f8a2b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a240d02a0 0x7f8a24071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:21.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.292+0000 7f8a2b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a2415ca40 0x7f8a2414ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:21.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.292+0000 7f8a2b400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a2415ceb0 0x7f8a24153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:21.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.292+0000 7f8a2b400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8a24155b90 con 0x7f8a2415ca40 2024-09-11T23:20:21.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.292+0000 7f8a2b400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2415df10 con 0x7f8a2415ceb0 2024-09-11T23:20:21.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.292+0000 7f8a2b400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8a24155d10 con 0x7f8a240d02a0 2024-09-11T23:20:21.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.293+0000 7f8a1be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a2415ca40 0x7f8a2414ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:21.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.293+0000 7f8a1be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a2415ca40 0x7f8a2414ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:45864/0 (socket says 172.21.15.144:45864) 2024-09-11T23:20:21.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.293+0000 7f8a1be00640 1 -- 172.21.15.144:0/1455839066 learned_addr learned my addr 172.21.15.144:0/1455839066 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:21.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.293+0000 7f8a28a00640 1 --2- 172.21.15.144:0/1455839066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a240d02a0 0x7f8a24071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:21.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.293+0000 7f8a29400640 1 --2- 172.21.15.144:0/1455839066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a2415ceb0 0x7f8a24153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:21.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.293+0000 7f8a1be00640 1 -- 172.21.15.144:0/1455839066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a240d02a0 msgr2=0x7f8a24071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:21.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.293+0000 7f8a1be00640 1 --2- 172.21.15.144:0/1455839066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a240d02a0 0x7f8a24071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.293+0000 7f8a1be00640 1 -- 172.21.15.144:0/1455839066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a2415ceb0 msgr2=0x7f8a24153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:21.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.293+0000 7f8a1be00640 1 --2- 172.21.15.144:0/1455839066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a2415ceb0 0x7f8a24153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.293+0000 7f8a1be00640 1 -- 172.21.15.144:0/1455839066 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a240725a0 con 0x7f8a2415ca40 2024-09-11T23:20:21.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.293+0000 7f8a1be00640 1 --2- 172.21.15.144:0/1455839066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a2415ca40 0x7f8a2414ca00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00d800 tx=0x7f8a0c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:21.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.294+0000 7f8a21600640 1 -- 172.21.15.144:0/1455839066 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c018030 con 0x7f8a2415ca40 2024-09-11T23:20:21.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.294+0000 7f8a21600640 1 -- 172.21.15.144:0/1455839066 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a0c0096a0 con 0x7f8a2415ca40 2024-09-11T23:20:21.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.294+0000 7f8a21600640 1 -- 172.21.15.144:0/1455839066 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c009870 con 0x7f8a2415ca40 2024-09-11T23:20:21.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.294+0000 7f8a2b400640 1 -- 172.21.15.144:0/1455839066 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a24072880 con 0x7f8a2415ca40 2024-09-11T23:20:21.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.294+0000 7f8a2b400640 1 -- 172.21.15.144:0/1455839066 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a24158810 con 0x7f8a2415ca40 2024-09-11T23:20:21.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.295+0000 7f8a2b400640 1 -- 172.21.15.144:0/1455839066 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a24158350 con 0x7f8a2415ca40 2024-09-11T23:20:21.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.296+0000 7f8a21600640 1 -- 172.21.15.144:0/1455839066 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 90702+0+0 (secure 0 0 0) 0x7f8a0c01b070 con 0x7f8a2415ca40 2024-09-11T23:20:21.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.296+0000 7f8a21600640 1 --2- 172.21.15.144:0/1455839066 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a0006c0a0 0x7f8a0006e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:21.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.297+0000 7f8a21600640 1 -- 172.21.15.144:0/1455839066 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f8a0c08b320 con 0x7f8a2415ca40 2024-09-11T23:20:21.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.297+0000 7f8a28a00640 1 --2- 172.21.15.144:0/1455839066 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a0006c0a0 0x7f8a0006e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:21.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.297+0000 7f8a28a00640 1 --2- 172.21.15.144:0/1455839066 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a0006c0a0 0x7f8a0006e560 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8a14037000 tx=0x7f8a14008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:21.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.301+0000 7f8a21600640 1 -- 172.21.15.144:0/1455839066 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a24158350 con 0x7f8a2415ca40 2024-09-11T23:20:21.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.513+0000 7f8a2b400640 1 -- 172.21.15.144:0/1455839066 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a240b4790 con 0x7f8a2415ca40 2024-09-11T23:20:21.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.513+0000 7f8a21600640 1 -- 172.21.15.144:0/1455839066 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5232 (secure 0 0 0) 0x7f8a0c0593a0 con 0x7f8a2415ca40 2024-09-11T23:20:21.513 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:20:21.513 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-11T23:19:32:857168+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:20:21.514 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-11T23:20:21.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.515+0000 7f8a2b400640 1 -- 172.21.15.144:0/1455839066 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a0006c0a0 msgr2=0x7f8a0006e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.515+0000 7f8a2b400640 1 --2- 172.21.15.144:0/1455839066 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a0006c0a0 0x7f8a0006e560 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8a14037000 tx=0x7f8a14008040 comp rx=0 tx=0).stop 2024-09-11T23:20:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.515+0000 7f8a2b400640 1 -- 172.21.15.144:0/1455839066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a2415ca40 msgr2=0x7f8a2414ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.515+0000 7f8a2b400640 1 --2- 172.21.15.144:0/1455839066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a2415ca40 0x7f8a2414ca00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00d800 tx=0x7f8a0c00dcc0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.516+0000 7f8a2b400640 1 -- 172.21.15.144:0/1455839066 shutdown_connections 2024-09-11T23:20:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.516+0000 7f8a2b400640 1 --2- 172.21.15.144:0/1455839066 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a0006c0a0 0x7f8a0006e560 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.516+0000 7f8a2b400640 1 --2- 172.21.15.144:0/1455839066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a2415ceb0 0x7f8a24153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.516+0000 7f8a2b400640 1 --2- 172.21.15.144:0/1455839066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a2415ca40 0x7f8a2414ca00 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.516+0000 7f8a2b400640 1 --2- 172.21.15.144:0/1455839066 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a240d02a0 0x7f8a24071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.516+0000 7f8a2b400640 1 -- 172.21.15.144:0/1455839066 >> 172.21.15.144:0/1455839066 conn(0x7f8a24062cc0 msgr2=0x7f8a240cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.516+0000 7f8a2b400640 1 -- 172.21.15.144:0/1455839066 shutdown_connections 2024-09-11T23:20:21.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:21.516+0000 7f8a2b400640 1 -- 172.21.15.144:0/1455839066 wait complete. 2024-09-11T23:20:21.532 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-11T23:20:21.707 INFO:teuthology.orchestra.run.smithi144.stdout:[{"id":5439,"entity":{"name":{"type":"client","num":5439},"addr":{"type":"any","addr":"172.21.15.144:0","nonce":2058902015}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":45.875245237000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.787982436376442,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5439 172.21.15.144:0/2058902015","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc","ceph_version":"ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)","entity_id":"y","hostname":"smithi144","pid":"35684","root":"/"}}] 2024-09-11T23:20:21.707 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi144", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35684", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.144:0", "nonce": 2058902015, "type": "any" }, "name": { "num": 5439, "type": "client" } }, "id": 5439, "inst": "client.5439 172.21.15.144:0/2058902015", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.787982436376442 }, "state": "open", "uptime": 45.875245237 } ] 2024-09-11T23:20:21.707 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-11T23:20:26.708 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:26.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.877+0000 7fac05800640 1 Processor -- start 2024-09-11T23:20:26.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.877+0000 7fac05800640 1 -- start start 2024-09-11T23:20:26.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.878+0000 7fac05800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac000d02a0 0x7fac000d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:26.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.878+0000 7fac05800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fac0015ca40 0x7fac0015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:26.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.878+0000 7fac05800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac000d0bc0 con 0x7fac0015ce80 2024-09-11T23:20:26.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.878+0000 7fac05800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fac0015d390 con 0x7fac0015ca40 2024-09-11T23:20:26.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.878+0000 7fac05800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fac0015d670 con 0x7fac000d02a0 2024-09-11T23:20:26.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.879+0000 7fabfea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac000d02a0 0x7fac000d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:26.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.879+0000 7fabfe000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fac0015ca40 0x7fac0015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:26.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.879+0000 7fabfea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac000d02a0 0x7fac000d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:45150/0 (socket says 172.21.15.144:45150) 2024-09-11T23:20:26.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.879+0000 7fabfea00640 1 -- 172.21.15.144:0/1295275261 learned_addr learned my addr 172.21.15.144:0/1295275261 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:26.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.879+0000 7fabfe000640 1 -- 172.21.15.144:0/1295275261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac000d02a0 msgr2=0x7fac000d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:26.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.879+0000 7fabfe000640 1 --2- 172.21.15.144:0/1295275261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac000d02a0 0x7fac000d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:26.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.879+0000 7fabfe000640 1 -- 172.21.15.144:0/1295275261 >> v1:172.21.15.165:6789/0 conn(0x7fac0015ce80 legacy=0x7fac001594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:26.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.879+0000 7fabfe000640 1 -- 172.21.15.144:0/1295275261 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0015d950 con 0x7fac0015ca40 2024-09-11T23:20:26.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.879+0000 7fabfea00640 1 --2- 172.21.15.144:0/1295275261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac000d02a0 0x7fac000d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:20:26.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.880+0000 7fabfe000640 1 --2- 172.21.15.144:0/1295275261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac0015ca40 0x7fac0015e430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fabec0097a0 tx=0x7fabec02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8a448eff0d3b68e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:26.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.880+0000 7fabfd600640 1 -- 172.21.15.144:0/1295275261 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec037070 con 0x7fac0015ca40 2024-09-11T23:20:26.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.881+0000 7fabfd600640 1 -- 172.21.15.144:0/1295275261 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabec02ae50 con 0x7fac0015ca40 2024-09-11T23:20:26.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.881+0000 7fabfd600640 1 -- 172.21.15.144:0/1295275261 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec032660 con 0x7fac0015ca40 2024-09-11T23:20:26.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.881+0000 7fac05800640 1 -- 172.21.15.144:0/1295275261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac0015ca40 msgr2=0x7fac0015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:26.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.881+0000 7fac05800640 1 --2- 172.21.15.144:0/1295275261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac0015ca40 0x7fac0015e430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fabec0097a0 tx=0x7fabec02a100 comp rx=0 tx=0).stop 2024-09-11T23:20:26.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.881+0000 7fac05800640 1 -- 172.21.15.144:0/1295275261 shutdown_connections 2024-09-11T23:20:26.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.881+0000 7fac05800640 1 --2- 172.21.15.144:0/1295275261 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac0015ca40 0x7fac0015e430 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:26.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.881+0000 7fac05800640 1 --2- 172.21.15.144:0/1295275261 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac000d02a0 0x7fac000d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:26.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.881+0000 7fac05800640 1 -- 172.21.15.144:0/1295275261 >> 172.21.15.144:0/1295275261 conn(0x7fac00062cc0 msgr2=0x7fac0006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:26.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.881+0000 7fac05800640 1 -- 172.21.15.144:0/1295275261 shutdown_connections 2024-09-11T23:20:26.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.881+0000 7fac05800640 1 -- 172.21.15.144:0/1295275261 wait complete. 2024-09-11T23:20:26.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.883+0000 7fac05800640 1 Processor -- start 2024-09-11T23:20:26.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.883+0000 7fac05800640 1 -- start start 2024-09-11T23:20:26.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.884+0000 7fac05800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac000d02a0 0x7fac0014ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:26.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.884+0000 7fac05800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac0015ca40 0x7fac0014ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:26.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.884+0000 7fac05800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac0015ce80 0x7fac000b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:26.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.884+0000 7fac05800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fac00155b90 con 0x7fac0015ce80 2024-09-11T23:20:26.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.884+0000 7fac05800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fac0015df10 con 0x7fac000d02a0 2024-09-11T23:20:26.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.884+0000 7fac05800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fac00155d10 con 0x7fac0015ca40 2024-09-11T23:20:26.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.884+0000 7fabff400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac0015ce80 0x7fac000b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:26.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.884+0000 7fabff400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac0015ce80 0x7fac000b19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49244/0 (socket says 172.21.15.144:49244) 2024-09-11T23:20:26.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.884+0000 7fabff400640 1 -- 172.21.15.144:0/3452084729 learned_addr learned my addr 172.21.15.144:0/3452084729 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:26.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.884+0000 7fabfea00640 1 --2- 172.21.15.144:0/3452084729 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac000d02a0 0x7fac0014ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:26.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.884+0000 7fabfe000640 1 --2- 172.21.15.144:0/3452084729 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac0015ca40 0x7fac0014ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:26.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.885+0000 7fabff400640 1 -- 172.21.15.144:0/3452084729 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac0015ca40 msgr2=0x7fac0014ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:26.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.885+0000 7fabff400640 1 --2- 172.21.15.144:0/3452084729 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac0015ca40 0x7fac0014ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:26.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.885+0000 7fabff400640 1 -- 172.21.15.144:0/3452084729 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac000d02a0 msgr2=0x7fac0014ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:26.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.885+0000 7fabff400640 1 --2- 172.21.15.144:0/3452084729 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac000d02a0 0x7fac0014ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:26.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.885+0000 7fabff400640 1 -- 172.21.15.144:0/3452084729 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0014db90 con 0x7fac0015ce80 2024-09-11T23:20:26.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.885+0000 7fabff400640 1 --2- 172.21.15.144:0/3452084729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac0015ce80 0x7fac000b19e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fabf800c7a0 tx=0x7fabf800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:26.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.885+0000 7fabf6a00640 1 -- 172.21.15.144:0/3452084729 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf8003b70 con 0x7fac0015ce80 2024-09-11T23:20:26.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.885+0000 7fabf6a00640 1 -- 172.21.15.144:0/3452084729 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabf8003d30 con 0x7fac0015ce80 2024-09-11T23:20:26.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.885+0000 7fabf6a00640 1 -- 172.21.15.144:0/3452084729 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf800aa90 con 0x7fac0015ce80 2024-09-11T23:20:26.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.885+0000 7fac05800640 1 -- 172.21.15.144:0/3452084729 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac0014de70 con 0x7fac0015ce80 2024-09-11T23:20:26.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.885+0000 7fac05800640 1 -- 172.21.15.144:0/3452084729 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac0014e430 con 0x7fac0015ce80 2024-09-11T23:20:26.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.886+0000 7fac05800640 1 -- 172.21.15.144:0/3452084729 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac000b4790 con 0x7fac0015ce80 2024-09-11T23:20:26.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.887+0000 7fabf6a00640 1 -- 172.21.15.144:0/3452084729 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 90702+0+0 (secure 0 0 0) 0x7fabf800ac30 con 0x7fac0015ce80 2024-09-11T23:20:26.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.888+0000 7fabf6a00640 1 --2- 172.21.15.144:0/3452084729 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fabe006c070 0x7fabe006e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:26.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.888+0000 7fabf6a00640 1 -- 172.21.15.144:0/3452084729 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fabf808b170 con 0x7fac0015ce80 2024-09-11T23:20:26.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.888+0000 7fabfea00640 1 --2- 172.21.15.144:0/3452084729 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fabe006c070 0x7fabe006e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:26.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.889+0000 7fabfea00640 1 --2- 172.21.15.144:0/3452084729 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fabe006c070 0x7fabe006e530 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fabf0009630 tx=0x7fabf0009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:26.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:26.893+0000 7fabf6a00640 1 -- 172.21.15.144:0/3452084729 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fabf8059090 con 0x7fac0015ce80 2024-09-11T23:20:27.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:27.100+0000 7fac05800640 1 -- 172.21.15.144:0/3452084729 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac00074250 con 0x7fac0015ce80 2024-09-11T23:20:27.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:27.101+0000 7fabf6a00640 1 -- 172.21.15.144:0/3452084729 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5232 (secure 0 0 0) 0x7fabf805d390 con 0x7fac0015ce80 2024-09-11T23:20:27.101 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:20:27.101 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-11T23:19:32:857168+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:20:27.101 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-11T23:20:27.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:27.103+0000 7fac05800640 1 -- 172.21.15.144:0/3452084729 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fabe006c070 msgr2=0x7fabe006e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:27.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:27.103+0000 7fac05800640 1 --2- 172.21.15.144:0/3452084729 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fabe006c070 0x7fabe006e530 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fabf0009630 tx=0x7fabf0009240 comp rx=0 tx=0).stop 2024-09-11T23:20:27.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:27.103+0000 7fac05800640 1 -- 172.21.15.144:0/3452084729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac0015ce80 msgr2=0x7fac000b19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:27.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:27.103+0000 7fac05800640 1 --2- 172.21.15.144:0/3452084729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac0015ce80 0x7fac000b19e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fabf800c7a0 tx=0x7fabf800cc60 comp rx=0 tx=0).stop 2024-09-11T23:20:27.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:27.103+0000 7fac05800640 1 -- 172.21.15.144:0/3452084729 shutdown_connections 2024-09-11T23:20:27.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:27.103+0000 7fac05800640 1 --2- 172.21.15.144:0/3452084729 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fabe006c070 0x7fabe006e530 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:27.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:27.103+0000 7fac05800640 1 --2- 172.21.15.144:0/3452084729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac0015ce80 0x7fac000b19e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:27.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:27.103+0000 7fac05800640 1 --2- 172.21.15.144:0/3452084729 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac0015ca40 0x7fac0014ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:27.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:27.103+0000 7fac05800640 1 --2- 172.21.15.144:0/3452084729 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac000d02a0 0x7fac0014ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:27.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:27.103+0000 7fac05800640 1 -- 172.21.15.144:0/3452084729 >> 172.21.15.144:0/3452084729 conn(0x7fac00062cc0 msgr2=0x7fac0006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:27.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:27.103+0000 7fac05800640 1 -- 172.21.15.144:0/3452084729 shutdown_connections 2024-09-11T23:20:27.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:27.103+0000 7fac05800640 1 -- 172.21.15.144:0/3452084729 wait complete. 2024-09-11T23:20:27.119 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-11T23:20:27.294 INFO:teuthology.orchestra.run.smithi144.stdout:[{"id":5439,"entity":{"name":{"type":"client","num":5439},"addr":{"type":"any","addr":"172.21.15.144:0","nonce":2058902015}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":51.463152510999997,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.534145753669883,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5439 172.21.15.144:0/2058902015","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc","ceph_version":"ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)","entity_id":"y","hostname":"smithi144","pid":"35684","root":"/"}}] 2024-09-11T23:20:27.295 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi144", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35684", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.144:0", "nonce": 2058902015, "type": "any" }, "name": { "num": 5439, "type": "client" } }, "id": 5439, "inst": "client.5439 172.21.15.144:0/2058902015", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.534145753669883 }, "state": "open", "uptime": 51.463152511 } ] 2024-09-11T23:20:27.295 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-11T23:20:32.296 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:32.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.462+0000 7f409a800640 1 Processor -- start 2024-09-11T23:20:32.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.462+0000 7f409a800640 1 -- start start 2024-09-11T23:20:32.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.463+0000 7f409a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4094162860 0x7f4094162c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.463+0000 7f409a800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f409415f020 0x7f409406bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.463+0000 7f409a800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f409415f520 con 0x7f409415ebb0 2024-09-11T23:20:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.463+0000 7f409a800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f409415fae0 con 0x7f4094162860 2024-09-11T23:20:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.463+0000 7f409a800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f409415f800 con 0x7f409415f020 2024-09-11T23:20:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.463+0000 7f4093400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4094162860 0x7f4094162c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.463+0000 7f4093400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4094162860 0x7f4094162c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49254/0 (socket says 172.21.15.144:49254) 2024-09-11T23:20:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.463+0000 7f4093400640 1 -- 172.21.15.144:0/122310188 learned_addr learned my addr 172.21.15.144:0/122310188 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.463+0000 7f4092a00640 1 --1- 172.21.15.144:0/122310188 >> v1:172.21.15.144:6789/0 conn(0x7f409415ebb0 0x7f40940b3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37052/0 (socket says 172.21.15.144:37052) 2024-09-11T23:20:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.464+0000 7f4093e00640 1 --2- 172.21.15.144:0/122310188 >> v2:172.21.15.165:3300/0 conn(0x7f409415f020 0x7f409406bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.464+0000 7f4093400640 1 -- 172.21.15.144:0/122310188 >> v2:172.21.15.165:3300/0 conn(0x7f409415f020 msgr2=0x7f409406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.464+0000 7f4093400640 1 --2- 172.21.15.144:0/122310188 >> v2:172.21.15.165:3300/0 conn(0x7f409415f020 0x7f409406bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.464+0000 7f4093400640 1 -- 172.21.15.144:0/122310188 >> v1:172.21.15.144:6789/0 conn(0x7f409415ebb0 legacy=0x7f40940b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:32.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.464+0000 7f4093400640 1 -- 172.21.15.144:0/122310188 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40940b2b00 con 0x7f4094162860 2024-09-11T23:20:32.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.465+0000 7f4093400640 1 --2- 172.21.15.144:0/122310188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4094162860 0x7f4094162c40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f409415c6f0 tx=0x7f408402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05eb28bf0c1092a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.465+0000 7f4092000640 1 -- 172.21.15.144:0/122310188 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084037070 con 0x7f4094162860 2024-09-11T23:20:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.465+0000 7f4092000640 1 -- 172.21.15.144:0/122310188 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4084032440 con 0x7f4094162860 2024-09-11T23:20:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.465+0000 7f4092000640 1 -- 172.21.15.144:0/122310188 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084032810 con 0x7f4094162860 2024-09-11T23:20:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.466+0000 7f409a800640 1 -- 172.21.15.144:0/122310188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4094162860 msgr2=0x7f4094162c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.466+0000 7f409a800640 1 --2- 172.21.15.144:0/122310188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4094162860 0x7f4094162c40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f409415c6f0 tx=0x7f408402a1e0 comp rx=0 tx=0).stop 2024-09-11T23:20:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.466+0000 7f409a800640 1 -- 172.21.15.144:0/122310188 shutdown_connections 2024-09-11T23:20:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.466+0000 7f409a800640 1 --2- 172.21.15.144:0/122310188 >> v2:172.21.15.165:3300/0 conn(0x7f409415f020 0x7f409406bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.466+0000 7f409a800640 1 --2- 172.21.15.144:0/122310188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4094162860 0x7f4094162c40 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.466+0000 7f409a800640 1 -- 172.21.15.144:0/122310188 >> 172.21.15.144:0/122310188 conn(0x7f409406ce90 msgr2=0x7f409406d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.466+0000 7f409a800640 1 -- 172.21.15.144:0/122310188 shutdown_connections 2024-09-11T23:20:32.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.466+0000 7f409a800640 1 -- 172.21.15.144:0/122310188 wait complete. 2024-09-11T23:20:32.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.467+0000 7f409a800640 1 Processor -- start 2024-09-11T23:20:32.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.468+0000 7f409a800640 1 -- start start 2024-09-11T23:20:32.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.468+0000 7f409a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409415ebb0 0x7f40940d0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:32.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.468+0000 7f409a800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f409415f020 0x7f4094145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:32.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.468+0000 7f409a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4094162860 0x7f40940aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:32.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.468+0000 7f409a800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f409406c0e0 con 0x7f409415ebb0 2024-09-11T23:20:32.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.468+0000 7f409a800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f40940b3a10 con 0x7f409415f020 2024-09-11T23:20:32.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.468+0000 7f409a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f409406c260 con 0x7f4094162860 2024-09-11T23:20:32.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.469+0000 7f4093400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409415ebb0 0x7f40940d0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:32.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.469+0000 7f4093400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409415ebb0 0x7f40940d0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49264/0 (socket says 172.21.15.144:49264) 2024-09-11T23:20:32.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.469+0000 7f4093400640 1 -- 172.21.15.144:0/2648810446 learned_addr learned my addr 172.21.15.144:0/2648810446 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:32.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.469+0000 7f4092a00640 1 --2- 172.21.15.144:0/2648810446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f409415f020 0x7f4094145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:32.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.469+0000 7f4093e00640 1 --2- 172.21.15.144:0/2648810446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4094162860 0x7f40940aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:32.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.469+0000 7f4093400640 1 -- 172.21.15.144:0/2648810446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4094162860 msgr2=0x7f40940aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:32.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.469+0000 7f4093400640 1 --2- 172.21.15.144:0/2648810446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4094162860 0x7f40940aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:32.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.469+0000 7f4093400640 1 -- 172.21.15.144:0/2648810446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f409415f020 msgr2=0x7f4094145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:32.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.469+0000 7f4093400640 1 --2- 172.21.15.144:0/2648810446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f409415f020 0x7f4094145de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:32.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.469+0000 7f4093400640 1 -- 172.21.15.144:0/2648810446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4094146320 con 0x7f409415ebb0 2024-09-11T23:20:32.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.469+0000 7f4093e00640 1 --2- 172.21.15.144:0/2648810446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4094162860 0x7f40940aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:32.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.469+0000 7f4092a00640 1 --2- 172.21.15.144:0/2648810446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f409415f020 0x7f4094145de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:32.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.469+0000 7f4093400640 1 --2- 172.21.15.144:0/2648810446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409415ebb0 0x7f40940d0b00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f408402a220 tx=0x7f40840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:32.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.470+0000 7f408b400640 1 -- 172.21.15.144:0/2648810446 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084037040 con 0x7f409415ebb0 2024-09-11T23:20:32.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.470+0000 7f408b400640 1 -- 172.21.15.144:0/2648810446 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4084042070 con 0x7f409415ebb0 2024-09-11T23:20:32.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.470+0000 7f408b400640 1 -- 172.21.15.144:0/2648810446 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084030880 con 0x7f409415ebb0 2024-09-11T23:20:32.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.470+0000 7f409a800640 1 -- 172.21.15.144:0/2648810446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40941f7eb0 con 0x7f409415ebb0 2024-09-11T23:20:32.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.470+0000 7f409a800640 1 -- 172.21.15.144:0/2648810446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40941f8470 con 0x7f409415ebb0 2024-09-11T23:20:32.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.471+0000 7f409a800640 1 -- 172.21.15.144:0/2648810446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f409406bba0 con 0x7f409415ebb0 2024-09-11T23:20:32.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.472+0000 7f408b400640 1 -- 172.21.15.144:0/2648810446 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 90702+0+0 (secure 0 0 0) 0x7f4084030a20 con 0x7f409415ebb0 2024-09-11T23:20:32.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.472+0000 7f408b400640 1 --2- 172.21.15.144:0/2648810446 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f407406c070 0x7f407406e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:32.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.473+0000 7f408b400640 1 -- 172.21.15.144:0/2648810446 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f40840abbc0 con 0x7f409415ebb0 2024-09-11T23:20:32.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.473+0000 7f4092a00640 1 --2- 172.21.15.144:0/2648810446 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f407406c070 0x7f407406e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:32.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.473+0000 7f4092a00640 1 --2- 172.21.15.144:0/2648810446 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f407406c070 0x7f407406e530 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f40940d0700 tx=0x7f4080009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:32.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.477+0000 7f408b400640 1 -- 172.21.15.144:0/2648810446 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4094146320 con 0x7f409415ebb0 2024-09-11T23:20:32.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.682+0000 7f409a800640 1 -- 172.21.15.144:0/2648810446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40940b7730 con 0x7f409415ebb0 2024-09-11T23:20:32.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.682+0000 7f408b400640 1 -- 172.21.15.144:0/2648810446 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5232 (secure 0 0 0) 0x7f408407a1c0 con 0x7f409415ebb0 2024-09-11T23:20:32.682 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:20:32.682 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-11T23:19:32:857168+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:20:32.683 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-11T23:20:32.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.684+0000 7f409a800640 1 -- 172.21.15.144:0/2648810446 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f407406c070 msgr2=0x7f407406e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:32.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.684+0000 7f409a800640 1 --2- 172.21.15.144:0/2648810446 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f407406c070 0x7f407406e530 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f40940d0700 tx=0x7f4080009040 comp rx=0 tx=0).stop 2024-09-11T23:20:32.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.684+0000 7f409a800640 1 -- 172.21.15.144:0/2648810446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409415ebb0 msgr2=0x7f40940d0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:32.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.684+0000 7f409a800640 1 --2- 172.21.15.144:0/2648810446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409415ebb0 0x7f40940d0b00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f408402a220 tx=0x7f40840046c0 comp rx=0 tx=0).stop 2024-09-11T23:20:32.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.685+0000 7f409a800640 1 -- 172.21.15.144:0/2648810446 shutdown_connections 2024-09-11T23:20:32.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.685+0000 7f409a800640 1 --2- 172.21.15.144:0/2648810446 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f407406c070 0x7f407406e530 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:32.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.685+0000 7f409a800640 1 --2- 172.21.15.144:0/2648810446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4094162860 0x7f40940aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:32.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.685+0000 7f409a800640 1 --2- 172.21.15.144:0/2648810446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f409415f020 0x7f4094145de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:32.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.685+0000 7f409a800640 1 --2- 172.21.15.144:0/2648810446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f409415ebb0 0x7f40940d0b00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:32.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.685+0000 7f409a800640 1 -- 172.21.15.144:0/2648810446 >> 172.21.15.144:0/2648810446 conn(0x7f409406ce90 msgr2=0x7f409415fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:32.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.685+0000 7f409a800640 1 -- 172.21.15.144:0/2648810446 shutdown_connections 2024-09-11T23:20:32.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:32.685+0000 7f409a800640 1 -- 172.21.15.144:0/2648810446 wait complete. 2024-09-11T23:20:32.702 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-11T23:20:32.881 INFO:teuthology.orchestra.run.smithi144.stdout:[{"id":5439,"entity":{"name":{"type":"client","num":5439},"addr":{"type":"any","addr":"172.21.15.144:0","nonce":2058902015}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":7,"uptime":57.050059803000003,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.283609796059277,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5439 172.21.15.144:0/2058902015","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc","ceph_version":"ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)","entity_id":"y","hostname":"smithi144","pid":"35684","root":"/"}}] 2024-09-11T23:20:32.882 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi144", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35684", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.144:0", "nonce": 2058902015, "type": "any" }, "name": { "num": 5439, "type": "client" } }, "id": 5439, "inst": "client.5439 172.21.15.144:0/2058902015", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 7, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.283609796059277 }, "state": "open", "uptime": 57.050059803 } ] 2024-09-11T23:20:32.882 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-11T23:20:37.882 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:38.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.049+0000 7fb762e00640 1 Processor -- start 2024-09-11T23:20:38.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.049+0000 7fb762e00640 1 -- start start 2024-09-11T23:20:38.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.050+0000 7fb762e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb75c0d02a0 0x7fb75c0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.050+0000 7fb762e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb75c15ca40 0x7fb75c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.050+0000 7fb762e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb75c0d0bc0 con 0x7fb75c15ce80 2024-09-11T23:20:38.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.050+0000 7fb762e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb75c15d390 con 0x7fb75c0d02a0 2024-09-11T23:20:38.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.050+0000 7fb762e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb75c15d670 con 0x7fb75c15ca40 2024-09-11T23:20:38.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.050+0000 7fb760e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb75c15ce80 0x7fb75c1594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34704/0 (socket says 172.21.15.144:34704) 2024-09-11T23:20:38.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.050+0000 7fb760e00640 1 -- 172.21.15.144:0/1306771581 learned_addr learned my addr 172.21.15.144:0/1306771581 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:20:38.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb753400640 1 --2- 172.21.15.144:0/1306771581 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb75c15ca40 0x7fb75c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:38.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb75be00640 1 --2- 172.21.15.144:0/1306771581 >> v2:172.21.15.165:3300/0 conn(0x7fb75c0d02a0 0x7fb75c0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:38.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb75b400640 1 -- 172.21.15.144:0/1306771581 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3919492962 0 0) 0x7fb75c0d0bc0 con 0x7fb75c15ce80 2024-09-11T23:20:38.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb75b400640 1 -- 172.21.15.144:0/1306771581 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb740003520 con 0x7fb75c15ce80 2024-09-11T23:20:38.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb75b400640 1 -- 172.21.15.144:0/1306771581 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2939824180 0 0) 0x7fb740003520 con 0x7fb75c15ce80 2024-09-11T23:20:38.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb75b400640 1 -- 172.21.15.144:0/1306771581 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb75c15ca40 msgr2=0x7fb75c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:38.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb75b400640 1 --2- 172.21.15.144:0/1306771581 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb75c15ca40 0x7fb75c15e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb75b400640 1 -- 172.21.15.144:0/1306771581 >> v2:172.21.15.165:3300/0 conn(0x7fb75c0d02a0 msgr2=0x7fb75c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:38.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb75b400640 1 --2- 172.21.15.144:0/1306771581 >> v2:172.21.15.165:3300/0 conn(0x7fb75c0d02a0 0x7fb75c0d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb75b400640 1 -- 172.21.15.144:0/1306771581 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb75c15d950 con 0x7fb75c15ce80 2024-09-11T23:20:38.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb75b400640 1 -- 172.21.15.144:0/1306771581 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fb7540019f0 con 0x7fb75c15ce80 2024-09-11T23:20:38.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb75b400640 1 -- 172.21.15.144:0/1306771581 >> v1:172.21.15.144:6789/0 conn(0x7fb75c15ce80 legacy=0x7fb75c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:38.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb75b400640 1 --2- 172.21.15.144:0/1306771581 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb75c15ca40 0x7fb7400039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb75b400640 1 --2- 172.21.15.144:0/1306771581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb740003f30 0x7fb740004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb75b400640 1 --2- 172.21.15.144:0/1306771581 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb740004d40 0x7fb7400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb75b400640 1 -- 172.21.15.144:0/1306771581 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb75c15d390 con 0x7fb740003f30 2024-09-11T23:20:38.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb75b400640 1 -- 172.21.15.144:0/1306771581 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb75c15d670 con 0x7fb740004d40 2024-09-11T23:20:38.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb75b400640 1 -- 172.21.15.144:0/1306771581 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb74000ba10 con 0x7fb75c15ca40 2024-09-11T23:20:38.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb753400640 1 --2- 172.21.15.144:0/1306771581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb740003f30 0x7fb740004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:38.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb75be00640 1 --2- 172.21.15.144:0/1306771581 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb75c15ca40 0x7fb7400039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:38.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.051+0000 7fb760e00640 1 --2- 172.21.15.144:0/1306771581 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb740004d40 0x7fb7400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:38.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.052+0000 7fb753400640 1 -- 172.21.15.144:0/1306771581 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb75c15ca40 msgr2=0x7fb7400039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:38.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.052+0000 7fb753400640 1 --2- 172.21.15.144:0/1306771581 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb75c15ca40 0x7fb7400039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.052+0000 7fb753400640 1 -- 172.21.15.144:0/1306771581 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb740004d40 msgr2=0x7fb7400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:38.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.052+0000 7fb753400640 1 --2- 172.21.15.144:0/1306771581 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb740004d40 0x7fb7400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.052+0000 7fb753400640 1 -- 172.21.15.144:0/1306771581 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb75c15d950 con 0x7fb740003f30 2024-09-11T23:20:38.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.052+0000 7fb760e00640 1 --2- 172.21.15.144:0/1306771581 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb740004d40 0x7fb7400051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:38.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.053+0000 7fb753400640 1 --2- 172.21.15.144:0/1306771581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb740003f30 0x7fb740004800 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb744009650 tx=0x7fb740005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06e685adf543201 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:38.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.053+0000 7fb75b400640 1 -- 172.21.15.144:0/1306771581 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb744038070 con 0x7fb740003f30 2024-09-11T23:20:38.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.053+0000 7fb75b400640 1 -- 172.21.15.144:0/1306771581 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb744033400 con 0x7fb740003f30 2024-09-11T23:20:38.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.053+0000 7fb75b400640 1 -- 172.21.15.144:0/1306771581 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb744009690 con 0x7fb740003f30 2024-09-11T23:20:38.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.053+0000 7fb762e00640 1 -- 172.21.15.144:0/1306771581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb740003f30 msgr2=0x7fb740004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:38.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.053+0000 7fb762e00640 1 --2- 172.21.15.144:0/1306771581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb740003f30 0x7fb740004800 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb744009650 tx=0x7fb740005830 comp rx=0 tx=0).stop 2024-09-11T23:20:38.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.053+0000 7fb760e00640 1 -- 172.21.15.144:0/1306771581 reap_dead start 2024-09-11T23:20:38.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.053+0000 7fb762e00640 1 -- 172.21.15.144:0/1306771581 shutdown_connections 2024-09-11T23:20:38.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.053+0000 7fb762e00640 1 -- 172.21.15.144:0/1306771581 >> 172.21.15.144:0/1306771581 conn(0x7fb75c062cc0 msgr2=0x7fb75c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:38.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.054+0000 7fb762e00640 1 -- 172.21.15.144:0/1306771581 shutdown_connections 2024-09-11T23:20:38.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.054+0000 7fb762e00640 1 -- 172.21.15.144:0/1306771581 wait complete. 2024-09-11T23:20:38.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.055+0000 7fb762e00640 1 Processor -- start 2024-09-11T23:20:38.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.055+0000 7fb762e00640 1 -- start start 2024-09-11T23:20:38.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.056+0000 7fb762e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb740003f30 0x7fb75c149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.056+0000 7fb762e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb75c155f40 0x7fb75c149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.056+0000 7fb762e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb75c073ad0 0x7fb75c1539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.056+0000 7fb762e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb75c155b90 con 0x7fb740003f30 2024-09-11T23:20:38.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.056+0000 7fb762e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb75c15df10 con 0x7fb75c073ad0 2024-09-11T23:20:38.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.056+0000 7fb762e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb75c155d10 con 0x7fb75c155f40 2024-09-11T23:20:38.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.056+0000 7fb75be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb740003f30 0x7fb75c149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:38.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.056+0000 7fb75be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb740003f30 0x7fb75c149dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46928/0 (socket says 172.21.15.144:46928) 2024-09-11T23:20:38.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.057+0000 7fb75be00640 1 -- 172.21.15.144:0/4264059253 learned_addr learned my addr 172.21.15.144:0/4264059253 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:38.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.057+0000 7fb753400640 1 --2- 172.21.15.144:0/4264059253 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb75c155f40 0x7fb75c149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:38.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.057+0000 7fb760e00640 1 --2- 172.21.15.144:0/4264059253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb75c073ad0 0x7fb75c1539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:38.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.057+0000 7fb75be00640 1 -- 172.21.15.144:0/4264059253 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb75c155f40 msgr2=0x7fb75c149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:38.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.057+0000 7fb75be00640 1 --2- 172.21.15.144:0/4264059253 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb75c155f40 0x7fb75c149740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.057+0000 7fb75be00640 1 -- 172.21.15.144:0/4264059253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb75c073ad0 msgr2=0x7fb75c1539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:38.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.057+0000 7fb75be00640 1 --2- 172.21.15.144:0/4264059253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb75c073ad0 0x7fb75c1539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.057+0000 7fb75be00640 1 -- 172.21.15.144:0/4264059253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb75c1563c0 con 0x7fb740003f30 2024-09-11T23:20:38.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.057+0000 7fb760e00640 1 --2- 172.21.15.144:0/4264059253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb75c073ad0 0x7fb75c1539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:38.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.057+0000 7fb75be00640 1 --2- 172.21.15.144:0/4264059253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb740003f30 0x7fb75c149dc0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb74c011a70 tx=0x7fb74c011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:38.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.057+0000 7fb758c00640 1 -- 172.21.15.144:0/4264059253 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74c00fb50 con 0x7fb740003f30 2024-09-11T23:20:38.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.057+0000 7fb758c00640 1 -- 172.21.15.144:0/4264059253 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb74c00fcf0 con 0x7fb740003f30 2024-09-11T23:20:38.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.057+0000 7fb758c00640 1 -- 172.21.15.144:0/4264059253 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74c00fea0 con 0x7fb740003f30 2024-09-11T23:20:38.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.057+0000 7fb762e00640 1 -- 172.21.15.144:0/4264059253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb75c14a3a0 con 0x7fb740003f30 2024-09-11T23:20:38.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.058+0000 7fb762e00640 1 -- 172.21.15.144:0/4264059253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb75c14a960 con 0x7fb740003f30 2024-09-11T23:20:38.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.059+0000 7fb762e00640 1 -- 172.21.15.144:0/4264059253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb75c0b4790 con 0x7fb740003f30 2024-09-11T23:20:38.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.059+0000 7fb758c00640 1 -- 172.21.15.144:0/4264059253 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 8) ==== 90702+0+0 (secure 0 0 0) 0x7fb74c012040 con 0x7fb740003f30 2024-09-11T23:20:38.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.060+0000 7fb758c00640 1 --2- 172.21.15.144:0/4264059253 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb73806c0a0 0x7fb73806e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:38.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.060+0000 7fb758c00640 1 -- 172.21.15.144:0/4264059253 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fb74c08b900 con 0x7fb740003f30 2024-09-11T23:20:38.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.061+0000 7fb753400640 1 --2- 172.21.15.144:0/4264059253 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb73806c0a0 0x7fb73806e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:38.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.061+0000 7fb753400640 1 --2- 172.21.15.144:0/4264059253 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb73806c0a0 0x7fb73806e560 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb744035000 tx=0x7fb744008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:38.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.065+0000 7fb758c00640 1 -- 172.21.15.144:0/4264059253 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb75c1563c0 con 0x7fb740003f30 2024-09-11T23:20:38.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.271+0000 7fb762e00640 1 -- 172.21.15.144:0/4264059253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb75c0b5390 con 0x7fb740003f30 2024-09-11T23:20:38.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.272+0000 7fb758c00640 1 -- 172.21.15.144:0/4264059253 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5232 (secure 0 0 0) 0x7fb74c019030 con 0x7fb740003f30 2024-09-11T23:20:38.272 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:20:38.272 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-11T23:19:32:857168+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:20:38.272 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-11T23:20:38.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.274+0000 7fb762e00640 1 -- 172.21.15.144:0/4264059253 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb73806c0a0 msgr2=0x7fb73806e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:38.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.274+0000 7fb762e00640 1 --2- 172.21.15.144:0/4264059253 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb73806c0a0 0x7fb73806e560 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb744035000 tx=0x7fb744008030 comp rx=0 tx=0).stop 2024-09-11T23:20:38.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.274+0000 7fb762e00640 1 -- 172.21.15.144:0/4264059253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb740003f30 msgr2=0x7fb75c149dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:38.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.274+0000 7fb762e00640 1 --2- 172.21.15.144:0/4264059253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb740003f30 0x7fb75c149dc0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb74c011a70 tx=0x7fb74c011f30 comp rx=0 tx=0).stop 2024-09-11T23:20:38.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.274+0000 7fb762e00640 1 -- 172.21.15.144:0/4264059253 shutdown_connections 2024-09-11T23:20:38.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.274+0000 7fb762e00640 1 --2- 172.21.15.144:0/4264059253 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb73806c0a0 0x7fb73806e560 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.274+0000 7fb762e00640 1 --2- 172.21.15.144:0/4264059253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb75c073ad0 0x7fb75c1539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.274+0000 7fb762e00640 1 --2- 172.21.15.144:0/4264059253 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb75c155f40 0x7fb75c149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.274+0000 7fb762e00640 1 --2- 172.21.15.144:0/4264059253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb740003f30 0x7fb75c149dc0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:38.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.274+0000 7fb762e00640 1 -- 172.21.15.144:0/4264059253 >> 172.21.15.144:0/4264059253 conn(0x7fb75c062cc0 msgr2=0x7fb75c0b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:38.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.274+0000 7fb762e00640 1 -- 172.21.15.144:0/4264059253 shutdown_connections 2024-09-11T23:20:38.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:38.274+0000 7fb762e00640 1 -- 172.21.15.144:0/4264059253 wait complete. 2024-09-11T23:20:38.290 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-11T23:20:38.467 INFO:teuthology.orchestra.run.smithi144.stdout:[{"id":5439,"entity":{"name":{"type":"client","num":5439},"addr":{"type":"any","addr":"172.21.15.144:0","nonce":2058902015}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":7,"uptime":62.634967128,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.036375062341317,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5439 172.21.15.144:0/2058902015","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc","ceph_version":"ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)","entity_id":"y","hostname":"smithi144","pid":"35684","root":"/"}}] 2024-09-11T23:20:38.467 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi144", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35684", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.144:0", "nonce": 2058902015, "type": "any" }, "name": { "num": 5439, "type": "client" } }, "id": 5439, "inst": "client.5439 172.21.15.144:0/2058902015", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 7, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.036375062341317 }, "state": "open", "uptime": 62.634967128 } ] 2024-09-11T23:20:38.468 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-11T23:20:43.469 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:43.527 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:20:43.531 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:20:43.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.639+0000 7f780e000640 1 Processor -- start 2024-09-11T23:20:43.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.639+0000 7f780e000640 1 -- start start 2024-09-11T23:20:43.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.640+0000 7f780e000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f78080cf070 0x7f78080cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:43.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.640+0000 7f780e000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78080ce740 con 0x7f7808073120 2024-09-11T23:20:43.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.640+0000 7f780e000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7808072640 con 0x7f780815c180 2024-09-11T23:20:43.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.640+0000 7f780e000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7808072920 con 0x7f78080cf070 2024-09-11T23:20:43.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.641+0000 7f7807e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7808073120 0x7f780806bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34716/0 (socket says 172.21.15.144:34716) 2024-09-11T23:20:43.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.641+0000 7f7807e00640 1 -- 172.21.15.144:0/2402976061 learned_addr learned my addr 172.21.15.144:0/2402976061 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:20:43.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.641+0000 7f7806a00640 1 --2- 172.21.15.144:0/2402976061 >> v2:172.21.15.165:3300/0 conn(0x7f78080cf070 0x7f78080cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:43.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.641+0000 7f7806000640 1 -- 172.21.15.144:0/2402976061 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4113990458 0 0) 0x7f78080ce740 con 0x7f7808073120 2024-09-11T23:20:43.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.641+0000 7f7806000640 1 -- 172.21.15.144:0/2402976061 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77ec003520 con 0x7f7808073120 2024-09-11T23:20:43.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.641+0000 7f7806a00640 1 -- 172.21.15.144:0/2402976061 >> v1:172.21.15.165:6789/0 conn(0x7f780815c180 legacy=0x7f78080cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:43.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.641+0000 7f7806a00640 1 -- 172.21.15.144:0/2402976061 >> v1:172.21.15.144:6789/0 conn(0x7f7808073120 legacy=0x7f780806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:43.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.641+0000 7f7806a00640 1 -- 172.21.15.144:0/2402976061 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7808072c00 con 0x7f78080cf070 2024-09-11T23:20:43.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.642+0000 7f7806a00640 1 --2- 172.21.15.144:0/2402976061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78080cf070 0x7f78080cf4e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f77f40097a0 tx=0x7f77f402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1637afdeeb184be7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:43.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.643+0000 7f7806000640 1 -- 172.21.15.144:0/2402976061 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4037070 con 0x7f78080cf070 2024-09-11T23:20:43.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.643+0000 7f7806000640 1 -- 172.21.15.144:0/2402976061 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f4032440 con 0x7f78080cf070 2024-09-11T23:20:43.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.643+0000 7f7806000640 1 -- 172.21.15.144:0/2402976061 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4032810 con 0x7f78080cf070 2024-09-11T23:20:43.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.643+0000 7f780e000640 1 -- 172.21.15.144:0/2402976061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78080cf070 msgr2=0x7f78080cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:43.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.643+0000 7f780e000640 1 --2- 172.21.15.144:0/2402976061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78080cf070 0x7f78080cf4e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f77f40097a0 tx=0x7f77f402a1a0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.643+0000 7f780e000640 1 -- 172.21.15.144:0/2402976061 shutdown_connections 2024-09-11T23:20:43.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.643+0000 7f780e000640 1 --2- 172.21.15.144:0/2402976061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78080cf070 0x7f78080cf4e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.643+0000 7f780e000640 1 -- 172.21.15.144:0/2402976061 >> 172.21.15.144:0/2402976061 conn(0x7f7808062cc0 msgr2=0x7f780806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:43.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.643+0000 7f780e000640 1 -- 172.21.15.144:0/2402976061 shutdown_connections 2024-09-11T23:20:43.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.643+0000 7f780e000640 1 -- 172.21.15.144:0/2402976061 wait complete. 2024-09-11T23:20:43.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.645+0000 7f780e000640 1 Processor -- start 2024-09-11T23:20:43.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.645+0000 7f780e000640 1 -- start start 2024-09-11T23:20:43.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.646+0000 7f780e000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7808073120 0x7f78081521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:43.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.646+0000 7f780e000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78080cf070 0x7f780814c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:43.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.646+0000 7f780e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f780815c180 0x7f7808152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:43.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.646+0000 7f780e000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f78080722f0 con 0x7f780815c180 2024-09-11T23:20:43.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.646+0000 7f780e000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f78080ced00 con 0x7f7808073120 2024-09-11T23:20:43.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.646+0000 7f780e000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f780815c560 con 0x7f78080cf070 2024-09-11T23:20:43.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.646+0000 7f7807e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f780815c180 0x7f7808152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:43.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.646+0000 7f7807e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f780815c180 0x7f7808152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46938/0 (socket says 172.21.15.144:46938) 2024-09-11T23:20:43.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.646+0000 7f7807e00640 1 -- 172.21.15.144:0/2620751055 learned_addr learned my addr 172.21.15.144:0/2620751055 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:43.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.646+0000 7f7807400640 1 --2- 172.21.15.144:0/2620751055 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7808073120 0x7f78081521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:43.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.646+0000 7f7806a00640 1 --2- 172.21.15.144:0/2620751055 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78080cf070 0x7f780814c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:43.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.647+0000 7f7807e00640 1 -- 172.21.15.144:0/2620751055 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78080cf070 msgr2=0x7f780814c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:43.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.647+0000 7f7807e00640 1 --2- 172.21.15.144:0/2620751055 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78080cf070 0x7f780814c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.647+0000 7f7807e00640 1 -- 172.21.15.144:0/2620751055 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7808073120 msgr2=0x7f78081521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:43.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.647+0000 7f7807e00640 1 --2- 172.21.15.144:0/2620751055 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7808073120 0x7f78081521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.647+0000 7f7807e00640 1 -- 172.21.15.144:0/2620751055 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780814d450 con 0x7f780815c180 2024-09-11T23:20:43.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.647+0000 7f7807e00640 1 --2- 172.21.15.144:0/2620751055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f780815c180 0x7f7808152fb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f780000cb40 tx=0x7f780000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:43.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.647+0000 7f77ff400640 1 -- 172.21.15.144:0/2620751055 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7800017070 con 0x7f780815c180 2024-09-11T23:20:43.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.647+0000 7f77ff400640 1 -- 172.21.15.144:0/2620751055 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f780000ac40 con 0x7f780815c180 2024-09-11T23:20:43.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.647+0000 7f780e000640 1 -- 172.21.15.144:0/2620751055 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7808152b80 con 0x7f780815c180 2024-09-11T23:20:43.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.647+0000 7f77ff400640 1 -- 172.21.15.144:0/2620751055 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7800012620 con 0x7f780815c180 2024-09-11T23:20:43.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.647+0000 7f780e000640 1 -- 172.21.15.144:0/2620751055 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f780815e250 con 0x7f780815c180 2024-09-11T23:20:43.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.649+0000 7f780e000640 1 -- 172.21.15.144:0/2620751055 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78080cf4e0 con 0x7f780815c180 2024-09-11T23:20:43.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.649+0000 7f77ff400640 1 -- 172.21.15.144:0/2620751055 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f780001a070 con 0x7f780815c180 2024-09-11T23:20:43.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.650+0000 7f77ff400640 1 --2- 172.21.15.144:0/2620751055 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f77e806c010 0x7f77e806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:43.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.650+0000 7f77ff400640 1 -- 172.21.15.144:0/2620751055 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f780008ae60 con 0x7f780815c180 2024-09-11T23:20:43.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.650+0000 7f7807400640 1 --2- 172.21.15.144:0/2620751055 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f77e806c010 0x7f77e806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:43.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.651+0000 7f7807400640 1 --2- 172.21.15.144:0/2620751055 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f77e806c010 0x7f77e806e4d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f77f80016e0 tx=0x7f77f8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:43.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.655+0000 7f77ff400640 1 -- 172.21.15.144:0/2620751055 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7800058fa0 con 0x7f780815c180 2024-09-11T23:20:43.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.863+0000 7f780e000640 1 -- 172.21.15.144:0/2620751055 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78081579b0 con 0x7f780815c180 2024-09-11T23:20:43.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.864+0000 7f77ff400640 1 -- 172.21.15.144:0/2620751055 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5232 (secure 0 0 0) 0x7f780005d2a0 con 0x7f780815c180 2024-09-11T23:20:43.864 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:20:43.864 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-11T23:19:32:857168+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:20:43.864 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-11T23:20:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.866+0000 7f780e000640 1 -- 172.21.15.144:0/2620751055 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f77e806c010 msgr2=0x7f77e806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.866+0000 7f780e000640 1 --2- 172.21.15.144:0/2620751055 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f77e806c010 0x7f77e806e4d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f77f80016e0 tx=0x7f77f8009040 comp rx=0 tx=0).stop 2024-09-11T23:20:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.866+0000 7f780e000640 1 -- 172.21.15.144:0/2620751055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f780815c180 msgr2=0x7f7808152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.866+0000 7f780e000640 1 --2- 172.21.15.144:0/2620751055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f780815c180 0x7f7808152fb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f780000cb40 tx=0x7f780000a060 comp rx=0 tx=0).stop 2024-09-11T23:20:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.866+0000 7f780e000640 1 -- 172.21.15.144:0/2620751055 shutdown_connections 2024-09-11T23:20:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.866+0000 7f780e000640 1 --2- 172.21.15.144:0/2620751055 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f77e806c010 0x7f77e806e4d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.866+0000 7f780e000640 1 --2- 172.21.15.144:0/2620751055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f780815c180 0x7f7808152fb0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.866+0000 7f780e000640 1 --2- 172.21.15.144:0/2620751055 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f78080cf070 0x7f780814c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.866+0000 7f780e000640 1 --2- 172.21.15.144:0/2620751055 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7808073120 0x7f78081521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:43.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.866+0000 7f780e000640 1 -- 172.21.15.144:0/2620751055 >> 172.21.15.144:0/2620751055 conn(0x7f7808062cc0 msgr2=0x7f7808156cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:43.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.866+0000 7f780e000640 1 -- 172.21.15.144:0/2620751055 shutdown_connections 2024-09-11T23:20:43.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:43.866+0000 7f780e000640 1 -- 172.21.15.144:0/2620751055 wait complete. 2024-09-11T23:20:43.882 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-11T23:20:44.095 INFO:teuthology.orchestra.run.smithi144.stdout:[] 2024-09-11T23:20:44.095 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-11T23:20:44.095 DEBUG:tasks.ceph_test_case:wait_until_true: success in 60s and 0 retries 2024-09-11T23:20:44.096 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:20:44.096 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:20:44.192 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:20:44.288 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:20:44.289 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:20:44.289 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:20:44.289 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:44.325 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:20:44.325 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:20:44.326 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:20:44.326 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:44.363 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:20:44.363 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:20:44.363 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:20:44.363 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:44.401 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:20:44.401 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:20:44.402 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:20:44.402 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:44.439 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:20:44.440 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:44.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.594+0000 7f0f9ac00640 1 Processor -- start 2024-09-11T23:20:44.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.595+0000 7f0f9ac00640 1 -- start start 2024-09-11T23:20:44.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.596+0000 7f0f9ac00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0f9415a0a0 0x7f0f94073180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.596+0000 7f0f9ac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f940ceb90 0x7f0f940b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.596+0000 7f0f9ac00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f94072100 con 0x7f0f940736c0 2024-09-11T23:20:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.596+0000 7f0f9ac00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0f940723c0 con 0x7f0f9415a0a0 2024-09-11T23:20:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.596+0000 7f0f9ac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0f940726a0 con 0x7f0f940ceb90 2024-09-11T23:20:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.596+0000 7f0f99800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0f9415a0a0 0x7f0f94073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.596+0000 7f0f99800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0f9415a0a0 0x7f0f94073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37694/0 (socket says 172.21.15.144:37694) 2024-09-11T23:20:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.596+0000 7f0f99800640 1 -- 172.21.15.144:0/1747013737 learned_addr learned my addr 172.21.15.144:0/1747013737 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.596+0000 7f0f9a200640 1 --2- 172.21.15.144:0/1747013737 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f940ceb90 0x7f0f940b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.596+0000 7f0f99800640 1 -- 172.21.15.144:0/1747013737 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f940ceb90 msgr2=0x7f0f940b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.596+0000 7f0f99800640 1 --2- 172.21.15.144:0/1747013737 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f940ceb90 0x7f0f940b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.596+0000 7f0f99800640 1 -- 172.21.15.144:0/1747013737 >> v1:172.21.15.165:6789/0 conn(0x7f0f940736c0 legacy=0x7f0f940ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:44.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.596+0000 7f0f99800640 1 -- 172.21.15.144:0/1747013737 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f94072980 con 0x7f0f9415a0a0 2024-09-11T23:20:44.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.597+0000 7f0f99800640 1 --2- 172.21.15.144:0/1747013737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f9415a0a0 0x7f0f94073180 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009870 tx=0x7f0f8802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f2d1174730e156 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:44.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.598+0000 7f0f93e00640 1 -- 172.21.15.144:0/1747013737 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f88037070 con 0x7f0f9415a0a0 2024-09-11T23:20:44.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.598+0000 7f0f93e00640 1 -- 172.21.15.144:0/1747013737 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f88032440 con 0x7f0f9415a0a0 2024-09-11T23:20:44.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.598+0000 7f0f93e00640 1 -- 172.21.15.144:0/1747013737 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f88032810 con 0x7f0f9415a0a0 2024-09-11T23:20:44.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.598+0000 7f0f9ac00640 1 -- 172.21.15.144:0/1747013737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f9415a0a0 msgr2=0x7f0f94073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.598+0000 7f0f9ac00640 1 --2- 172.21.15.144:0/1747013737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f9415a0a0 0x7f0f94073180 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009870 tx=0x7f0f8802a210 comp rx=0 tx=0).stop 2024-09-11T23:20:44.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.598+0000 7f0f9ac00640 1 -- 172.21.15.144:0/1747013737 shutdown_connections 2024-09-11T23:20:44.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.598+0000 7f0f9ac00640 1 --2- 172.21.15.144:0/1747013737 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f940ceb90 0x7f0f940b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.598+0000 7f0f9ac00640 1 --2- 172.21.15.144:0/1747013737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f9415a0a0 0x7f0f94073180 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.598+0000 7f0f9ac00640 1 -- 172.21.15.144:0/1747013737 >> 172.21.15.144:0/1747013737 conn(0x7f0f9406e910 msgr2=0x7f0f9406bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:44.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.598+0000 7f0f9ac00640 1 -- 172.21.15.144:0/1747013737 shutdown_connections 2024-09-11T23:20:44.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.598+0000 7f0f9ac00640 1 -- 172.21.15.144:0/1747013737 wait complete. 2024-09-11T23:20:44.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.600+0000 7f0f9ac00640 1 Processor -- start 2024-09-11T23:20:44.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.600+0000 7f0f9ac00640 1 -- start start 2024-09-11T23:20:44.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.601+0000 7f0f9ac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f940ceb90 0x7f0f941e58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.601+0000 7f0f9ac00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f9415a0a0 0x7f0f9415e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.601+0000 7f0f9ac00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f9415ba90 0x7f0f940c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.601+0000 7f0f9ac00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0f940b2690 con 0x7f0f9415ba90 2024-09-11T23:20:44.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.601+0000 7f0f9ac00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0f940b2510 con 0x7f0f9415a0a0 2024-09-11T23:20:44.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.601+0000 7f0f9ac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0f940cf240 con 0x7f0f940ceb90 2024-09-11T23:20:44.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.601+0000 7f0f9a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f9415ba90 0x7f0f940c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.601+0000 7f0f99800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f940ceb90 0x7f0f941e58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.601+0000 7f0f99800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f940ceb90 0x7f0f941e58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:56898/0 (socket says 172.21.15.144:56898) 2024-09-11T23:20:44.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.601+0000 7f0f9a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f9415ba90 0x7f0f940c50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37698/0 (socket says 172.21.15.144:37698) 2024-09-11T23:20:44.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.601+0000 7f0f99800640 1 -- 172.21.15.144:0/2295618839 learned_addr learned my addr 172.21.15.144:0/2295618839 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:44.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.601+0000 7f0f98e00640 1 --2- 172.21.15.144:0/2295618839 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f9415a0a0 0x7f0f9415e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.602+0000 7f0f99800640 1 -- 172.21.15.144:0/2295618839 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f9415a0a0 msgr2=0x7f0f9415e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.602+0000 7f0f99800640 1 --2- 172.21.15.144:0/2295618839 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f9415a0a0 0x7f0f9415e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.602+0000 7f0f99800640 1 -- 172.21.15.144:0/2295618839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f9415ba90 msgr2=0x7f0f940c50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.602+0000 7f0f99800640 1 --2- 172.21.15.144:0/2295618839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f9415ba90 0x7f0f940c50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.602+0000 7f0f99800640 1 -- 172.21.15.144:0/2295618839 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f941e5df0 con 0x7f0f940ceb90 2024-09-11T23:20:44.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.602+0000 7f0f99800640 1 --2- 172.21.15.144:0/2295618839 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f940ceb90 0x7f0f941e58b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009870 tx=0x7f0f880046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:44.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.602+0000 7f0f91600640 1 -- 172.21.15.144:0/2295618839 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f88041020 con 0x7f0f940ceb90 2024-09-11T23:20:44.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.602+0000 7f0f91600640 1 -- 172.21.15.144:0/2295618839 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f880306c0 con 0x7f0f940ceb90 2024-09-11T23:20:44.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.602+0000 7f0f9ac00640 1 -- 172.21.15.144:0/2295618839 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f9415c090 con 0x7f0f940ceb90 2024-09-11T23:20:44.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.603+0000 7f0f91600640 1 -- 172.21.15.144:0/2295618839 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f88037040 con 0x7f0f940ceb90 2024-09-11T23:20:44.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.603+0000 7f0f9ac00640 1 -- 172.21.15.144:0/2295618839 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f9415c8d0 con 0x7f0f940ceb90 2024-09-11T23:20:44.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.604+0000 7f0f9ac00640 1 -- 172.21.15.144:0/2295618839 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f940b1dc0 con 0x7f0f940ceb90 2024-09-11T23:20:44.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.604+0000 7f0f91600640 1 -- 172.21.15.144:0/2295618839 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f0f88044020 con 0x7f0f940ceb90 2024-09-11T23:20:44.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.605+0000 7f0f91600640 1 --2- 172.21.15.144:0/2295618839 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0f7406bfe0 0x7f0f7406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.605+0000 7f0f91600640 1 -- 172.21.15.144:0/2295618839 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f0f880ab970 con 0x7f0f940ceb90 2024-09-11T23:20:44.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.606+0000 7f0f98e00640 1 --2- 172.21.15.144:0/2295618839 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0f7406bfe0 0x7f0f7406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.606+0000 7f0f98e00640 1 --2- 172.21.15.144:0/2295618839 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0f7406bfe0 0x7f0f7406e4a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0f9415e2e0 tx=0x7f0f80007e30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:44.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.610+0000 7f0f91600640 1 -- 172.21.15.144:0/2295618839 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f8804b030 con 0x7f0f940ceb90 2024-09-11T23:20:44.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.818+0000 7f0f9ac00640 1 -- 172.21.15.144:0/2295618839 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f940cf020 con 0x7f0f940ceb90 2024-09-11T23:20:44.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.818+0000 7f0f91600640 1 -- 172.21.15.144:0/2295618839 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5232 (secure 0 0 0) 0x7f0f9415c090 con 0x7f0f940ceb90 2024-09-11T23:20:44.819 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:20:44.819 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-11T23:19:32:857168+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:20:44.819 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-11T23:20:44.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.821+0000 7f0f9ac00640 1 -- 172.21.15.144:0/2295618839 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0f7406bfe0 msgr2=0x7f0f7406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.821+0000 7f0f9ac00640 1 --2- 172.21.15.144:0/2295618839 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0f7406bfe0 0x7f0f7406e4a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0f9415e2e0 tx=0x7f0f80007e30 comp rx=0 tx=0).stop 2024-09-11T23:20:44.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.821+0000 7f0f9ac00640 1 -- 172.21.15.144:0/2295618839 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f940ceb90 msgr2=0x7f0f941e58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.821+0000 7f0f9ac00640 1 --2- 172.21.15.144:0/2295618839 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f940ceb90 0x7f0f941e58b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009870 tx=0x7f0f880046c0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.821+0000 7f0f9ac00640 1 -- 172.21.15.144:0/2295618839 shutdown_connections 2024-09-11T23:20:44.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.821+0000 7f0f9ac00640 1 --2- 172.21.15.144:0/2295618839 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f0f7406bfe0 0x7f0f7406e4a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.821+0000 7f0f9ac00640 1 --2- 172.21.15.144:0/2295618839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f9415ba90 0x7f0f940c50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.821+0000 7f0f9ac00640 1 --2- 172.21.15.144:0/2295618839 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f9415a0a0 0x7f0f9415e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.821+0000 7f0f9ac00640 1 --2- 172.21.15.144:0/2295618839 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f940ceb90 0x7f0f941e58b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.821+0000 7f0f9ac00640 1 -- 172.21.15.144:0/2295618839 >> 172.21.15.144:0/2295618839 conn(0x7f0f9406e910 msgr2=0x7f0f940afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:44.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.821+0000 7f0f9ac00640 1 -- 172.21.15.144:0/2295618839 shutdown_connections 2024-09-11T23:20:44.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.821+0000 7f0f9ac00640 1 -- 172.21.15.144:0/2295618839 wait complete. 2024-09-11T23:20:44.837 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:44.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.991+0000 7f8b64600640 1 Processor -- start 2024-09-11T23:20:44.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.992+0000 7f8b64600640 1 -- start start 2024-09-11T23:20:44.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.993+0000 7f8b64600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8b5c0cf070 0x7f8b5c0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.993+0000 7f8b64600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b5c073120 0x7f8b5c0735b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.993+0000 7f8b64600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b5c0ce740 con 0x7f8b5c15c180 2024-09-11T23:20:44.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.993+0000 7f8b64600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8b5c072640 con 0x7f8b5c0cf070 2024-09-11T23:20:44.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.993+0000 7f8b64600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8b5c072920 con 0x7f8b5c073120 2024-09-11T23:20:44.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.993+0000 7f8b61c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8b5c15c180 0x7f8b5c0cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60624/0 (socket says 172.21.15.144:60624) 2024-09-11T23:20:44.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.993+0000 7f8b61c00640 1 -- 172.21.15.144:0/879275549 learned_addr learned my addr 172.21.15.144:0/879275549 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:20:44.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.993+0000 7f8b62600640 1 --2- 172.21.15.144:0/879275549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b5c073120 0x7f8b5c0735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.993+0000 7f8b61200640 1 --2- 172.21.15.144:0/879275549 >> v2:172.21.15.165:3300/0 conn(0x7f8b5c0cf070 0x7f8b5c0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.993+0000 7f8b5be00640 1 -- 172.21.15.144:0/879275549 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3095407494 0 0) 0x7f8b5c0ce740 con 0x7f8b5c15c180 2024-09-11T23:20:44.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.993+0000 7f8b5be00640 1 -- 172.21.15.144:0/879275549 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b44003520 con 0x7f8b5c15c180 2024-09-11T23:20:44.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.994+0000 7f8b5be00640 1 -- 172.21.15.144:0/879275549 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2491141651 0 0) 0x7f8b44003520 con 0x7f8b5c15c180 2024-09-11T23:20:44.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.994+0000 7f8b5be00640 1 -- 172.21.15.144:0/879275549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b5c073120 msgr2=0x7f8b5c0735b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:44.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.994+0000 7f8b5be00640 1 --2- 172.21.15.144:0/879275549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b5c073120 0x7f8b5c0735b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.994+0000 7f8b5be00640 1 -- 172.21.15.144:0/879275549 >> v2:172.21.15.165:3300/0 conn(0x7f8b5c0cf070 msgr2=0x7f8b5c0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:44.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.994+0000 7f8b5be00640 1 --2- 172.21.15.144:0/879275549 >> v2:172.21.15.165:3300/0 conn(0x7f8b5c0cf070 0x7f8b5c0cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.994+0000 7f8b5be00640 1 -- 172.21.15.144:0/879275549 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5c072c00 con 0x7f8b5c15c180 2024-09-11T23:20:44.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.994+0000 7f8b5be00640 1 -- 172.21.15.144:0/879275549 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f8b50001690 con 0x7f8b5c15c180 2024-09-11T23:20:44.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.994+0000 7f8b5be00640 1 -- 172.21.15.144:0/879275549 >> v1:172.21.15.144:6789/0 conn(0x7f8b5c15c180 legacy=0x7f8b5c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:44.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.994+0000 7f8b5be00640 1 --2- 172.21.15.144:0/879275549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b440039b0 0x7f8b44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.994+0000 7f8b5be00640 1 --2- 172.21.15.144:0/879275549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b440043a0 0x7f8b44004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.994+0000 7f8b5be00640 1 --2- 172.21.15.144:0/879275549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b44004f90 0x7f8b4400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:44.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.994+0000 7f8b5be00640 1 -- 172.21.15.144:0/879275549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c072640 con 0x7f8b440043a0 2024-09-11T23:20:44.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.994+0000 7f8b5be00640 1 -- 172.21.15.144:0/879275549 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c072920 con 0x7f8b44004f90 2024-09-11T23:20:44.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.994+0000 7f8b5be00640 1 -- 172.21.15.144:0/879275549 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8b4400bf30 con 0x7f8b440039b0 2024-09-11T23:20:44.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.994+0000 7f8b62600640 1 --2- 172.21.15.144:0/879275549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b5c073120 0x7f8b5c0735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:20:44.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.994+0000 7f8b61200640 1 --2- 172.21.15.144:0/879275549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b440043a0 0x7f8b44004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.994+0000 7f8b61c00640 1 --2- 172.21.15.144:0/879275549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b440039b0 0x7f8b44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.994+0000 7f8b62600640 1 --2- 172.21.15.144:0/879275549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b44004f90 0x7f8b4400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:44.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.995+0000 7f8b61200640 1 -- 172.21.15.144:0/879275549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b440039b0 msgr2=0x7f8b44003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:44.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.995+0000 7f8b61200640 1 --2- 172.21.15.144:0/879275549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b440039b0 0x7f8b44003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.995+0000 7f8b61200640 1 -- 172.21.15.144:0/879275549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b44004f90 msgr2=0x7f8b4400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:44.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.995+0000 7f8b61200640 1 --2- 172.21.15.144:0/879275549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b44004f90 0x7f8b4400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:44.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.995+0000 7f8b61200640 1 -- 172.21.15.144:0/879275549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b44003520 con 0x7f8b440043a0 2024-09-11T23:20:44.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.996+0000 7f8b61200640 1 --2- 172.21.15.144:0/879275549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b440043a0 0x7f8b44004880 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8b48009a90 tx=0x7f8b44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606f55bcd9106c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:45.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.996+0000 7f8b5be00640 1 -- 172.21.15.144:0/879275549 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b48036070 con 0x7f8b440043a0 2024-09-11T23:20:45.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.996+0000 7f8b5be00640 1 -- 172.21.15.144:0/879275549 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b48031400 con 0x7f8b440043a0 2024-09-11T23:20:45.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.996+0000 7f8b5be00640 1 -- 172.21.15.144:0/879275549 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b48009690 con 0x7f8b440043a0 2024-09-11T23:20:45.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.996+0000 7f8b64600640 1 -- 172.21.15.144:0/879275549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b440043a0 msgr2=0x7f8b44004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.996+0000 7f8b64600640 1 --2- 172.21.15.144:0/879275549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b440043a0 0x7f8b44004880 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8b48009a90 tx=0x7f8b44005830 comp rx=0 tx=0).stop 2024-09-11T23:20:45.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.996+0000 7f8b62600640 1 -- 172.21.15.144:0/879275549 reap_dead start 2024-09-11T23:20:45.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.996+0000 7f8b64600640 1 -- 172.21.15.144:0/879275549 shutdown_connections 2024-09-11T23:20:45.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.996+0000 7f8b64600640 1 -- 172.21.15.144:0/879275549 >> 172.21.15.144:0/879275549 conn(0x7f8b5c062cc0 msgr2=0x7f8b5c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:45.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.996+0000 7f8b64600640 1 -- 172.21.15.144:0/879275549 shutdown_connections 2024-09-11T23:20:45.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.996+0000 7f8b64600640 1 -- 172.21.15.144:0/879275549 wait complete. 2024-09-11T23:20:45.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.998+0000 7f8b64600640 1 Processor -- start 2024-09-11T23:20:45.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.998+0000 7f8b64600640 1 -- start start 2024-09-11T23:20:45.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.999+0000 7f8b64600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b440043a0 0x7f8b5c145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.999+0000 7f8b64600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b5c153e60 0x7f8b5c145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.999+0000 7f8b64600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b5c148810 0x7f8b5c0aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.999+0000 7f8b64600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c0722f0 con 0x7f8b440043a0 2024-09-11T23:20:45.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.999+0000 7f8b64600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c0ced00 con 0x7f8b5c153e60 2024-09-11T23:20:45.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.999+0000 7f8b64600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8b5c15c560 con 0x7f8b5c148810 2024-09-11T23:20:45.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.999+0000 7f8b61c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b440043a0 0x7f8b5c145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.999+0000 7f8b61c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b440043a0 0x7f8b5c145db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37726/0 (socket says 172.21.15.144:37726) 2024-09-11T23:20:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.999+0000 7f8b61c00640 1 -- 172.21.15.144:0/4175366426 learned_addr learned my addr 172.21.15.144:0/4175366426 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.999+0000 7f8b61200640 1 --2- 172.21.15.144:0/4175366426 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b5c153e60 0x7f8b5c145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:44.999+0000 7f8b62600640 1 --2- 172.21.15.144:0/4175366426 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b5c148810 0x7f8b5c0aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.000+0000 7f8b61c00640 1 -- 172.21.15.144:0/4175366426 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b5c148810 msgr2=0x7f8b5c0aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.000+0000 7f8b61c00640 1 --2- 172.21.15.144:0/4175366426 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b5c148810 0x7f8b5c0aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.000+0000 7f8b61c00640 1 -- 172.21.15.144:0/4175366426 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b5c153e60 msgr2=0x7f8b5c145560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.000+0000 7f8b61c00640 1 --2- 172.21.15.144:0/4175366426 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b5c153e60 0x7f8b5c145560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.000+0000 7f8b61c00640 1 -- 172.21.15.144:0/4175366426 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5c145aa0 con 0x7f8b440043a0 2024-09-11T23:20:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.000+0000 7f8b61c00640 1 --2- 172.21.15.144:0/4175366426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b440043a0 0x7f8b5c145db0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8b500073a0 tx=0x7f8b50007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.000+0000 7f8b59600640 1 -- 172.21.15.144:0/4175366426 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5001a070 con 0x7f8b440043a0 2024-09-11T23:20:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.000+0000 7f8b59600640 1 -- 172.21.15.144:0/4175366426 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b5000f940 con 0x7f8b440043a0 2024-09-11T23:20:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.000+0000 7f8b59600640 1 -- 172.21.15.144:0/4175366426 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5000fd10 con 0x7f8b440043a0 2024-09-11T23:20:45.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.000+0000 7f8b64600640 1 -- 172.21.15.144:0/4175366426 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b5c15c9c0 con 0x7f8b440043a0 2024-09-11T23:20:45.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.000+0000 7f8b64600640 1 -- 172.21.15.144:0/4175366426 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b5c15e660 con 0x7f8b440043a0 2024-09-11T23:20:45.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.001+0000 7f8b64600640 1 -- 172.21.15.144:0/4175366426 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b5c0cf4e0 con 0x7f8b440043a0 2024-09-11T23:20:45.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.002+0000 7f8b59600640 1 -- 172.21.15.144:0/4175366426 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f8b50014450 con 0x7f8b440043a0 2024-09-11T23:20:45.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.003+0000 7f8b59600640 1 --2- 172.21.15.144:0/4175366426 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8b3c06c010 0x7f8b3c06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.004+0000 7f8b59600640 1 -- 172.21.15.144:0/4175366426 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f8b5008a9f0 con 0x7f8b440043a0 2024-09-11T23:20:45.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.004+0000 7f8b61200640 1 --2- 172.21.15.144:0/4175366426 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8b3c06c010 0x7f8b3c06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.004+0000 7f8b61200640 1 --2- 172.21.15.144:0/4175366426 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8b3c06c010 0x7f8b3c06e4d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8b48033000 tx=0x7f8b48008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:45.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.008+0000 7f8b59600640 1 -- 172.21.15.144:0/4175366426 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b50058b30 con 0x7f8b440043a0 2024-09-11T23:20:45.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.217+0000 7f8b64600640 1 -- 172.21.15.144:0/4175366426 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b5c0b4360 con 0x7f8b440043a0 2024-09-11T23:20:45.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.218+0000 7f8b59600640 1 -- 172.21.15.144:0/4175366426 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5232 (secure 0 0 0) 0x7f8b5005ce30 con 0x7f8b440043a0 2024-09-11T23:20:45.218 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:20:45.218 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-11T23:19:32:857168+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:20:45.218 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-11T23:20:45.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.220+0000 7f8b64600640 1 -- 172.21.15.144:0/4175366426 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8b3c06c010 msgr2=0x7f8b3c06e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.220+0000 7f8b64600640 1 --2- 172.21.15.144:0/4175366426 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8b3c06c010 0x7f8b3c06e4d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8b48033000 tx=0x7f8b48008030 comp rx=0 tx=0).stop 2024-09-11T23:20:45.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.220+0000 7f8b64600640 1 -- 172.21.15.144:0/4175366426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b440043a0 msgr2=0x7f8b5c145db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.220+0000 7f8b64600640 1 --2- 172.21.15.144:0/4175366426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b440043a0 0x7f8b5c145db0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8b500073a0 tx=0x7f8b50007860 comp rx=0 tx=0).stop 2024-09-11T23:20:45.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.221+0000 7f8b64600640 1 -- 172.21.15.144:0/4175366426 shutdown_connections 2024-09-11T23:20:45.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.221+0000 7f8b64600640 1 --2- 172.21.15.144:0/4175366426 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8b3c06c010 0x7f8b3c06e4d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.221+0000 7f8b64600640 1 --2- 172.21.15.144:0/4175366426 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b5c148810 0x7f8b5c0aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.221+0000 7f8b64600640 1 --2- 172.21.15.144:0/4175366426 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b5c153e60 0x7f8b5c145560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.221+0000 7f8b64600640 1 --2- 172.21.15.144:0/4175366426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b440043a0 0x7f8b5c145db0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.221+0000 7f8b64600640 1 -- 172.21.15.144:0/4175366426 >> 172.21.15.144:0/4175366426 conn(0x7f8b5c062cc0 msgr2=0x7f8b5c0b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:45.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.221+0000 7f8b64600640 1 -- 172.21.15.144:0/4175366426 shutdown_connections 2024-09-11T23:20:45.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.221+0000 7f8b64600640 1 -- 172.21.15.144:0/4175366426 wait complete. 2024-09-11T23:20:45.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:20:45.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.390+0000 7f3b22800640 1 Processor -- start 2024-09-11T23:20:45.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.390+0000 7f3b22800640 1 -- start start 2024-09-11T23:20:45.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.391+0000 7f3b22800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b1c15c180 0x7f3b1c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.391+0000 7f3b22800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3b1c073120 0x7f3b1c0735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.392+0000 7f3b22800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b1c0ce740 con 0x7f3b1c0ce230 2024-09-11T23:20:45.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.392+0000 7f3b22800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3b1c072640 con 0x7f3b1c073120 2024-09-11T23:20:45.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.392+0000 7f3b22800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3b1c072920 con 0x7f3b1c15c180 2024-09-11T23:20:45.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.392+0000 7f3b1aa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3b1c0ce230 0x7f3b1c0cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60628/0 (socket says 172.21.15.144:60628) 2024-09-11T23:20:45.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.392+0000 7f3b1aa00640 1 -- 172.21.15.144:0/3567112118 learned_addr learned my addr 172.21.15.144:0/3567112118 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:20:45.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.392+0000 7f3b1b400640 1 --2- 172.21.15.144:0/3567112118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b1c15c180 0x7f3b1c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.392+0000 7f3b1be00640 1 --2- 172.21.15.144:0/3567112118 >> v2:172.21.15.165:3300/0 conn(0x7f3b1c073120 0x7f3b1c0735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.392+0000 7f3b1a000640 1 -- 172.21.15.144:0/3567112118 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1733390455 0 0) 0x7f3b1c0ce740 con 0x7f3b1c0ce230 2024-09-11T23:20:45.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.392+0000 7f3b1a000640 1 -- 172.21.15.144:0/3567112118 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b00003520 con 0x7f3b1c0ce230 2024-09-11T23:20:45.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.392+0000 7f3b1b400640 1 -- 172.21.15.144:0/3567112118 >> v2:172.21.15.165:3300/0 conn(0x7f3b1c073120 msgr2=0x7f3b1c0735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:45.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.392+0000 7f3b1b400640 1 --2- 172.21.15.144:0/3567112118 >> v2:172.21.15.165:3300/0 conn(0x7f3b1c073120 0x7f3b1c0735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.392+0000 7f3b1b400640 1 -- 172.21.15.144:0/3567112118 >> v1:172.21.15.144:6789/0 conn(0x7f3b1c0ce230 legacy=0x7f3b1c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.392+0000 7f3b1b400640 1 -- 172.21.15.144:0/3567112118 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1c072c00 con 0x7f3b1c15c180 2024-09-11T23:20:45.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.394+0000 7f3b1b400640 1 --2- 172.21.15.144:0/3567112118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b1c15c180 0x7f3b1c0cdcf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0097a0 tx=0x7f3b0c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bc1872f0e1f854d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:45.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.394+0000 7f3b1a000640 1 -- 172.21.15.144:0/3567112118 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c037070 con 0x7f3b1c15c180 2024-09-11T23:20:45.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.394+0000 7f3b1a000640 1 -- 172.21.15.144:0/3567112118 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b0c02ae50 con 0x7f3b1c15c180 2024-09-11T23:20:45.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.394+0000 7f3b1a000640 1 -- 172.21.15.144:0/3567112118 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c032660 con 0x7f3b1c15c180 2024-09-11T23:20:45.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.394+0000 7f3b22800640 1 -- 172.21.15.144:0/3567112118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b1c15c180 msgr2=0x7f3b1c0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.394+0000 7f3b22800640 1 --2- 172.21.15.144:0/3567112118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b1c15c180 0x7f3b1c0cdcf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0097a0 tx=0x7f3b0c02a100 comp rx=0 tx=0).stop 2024-09-11T23:20:45.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.395+0000 7f3b22800640 1 -- 172.21.15.144:0/3567112118 shutdown_connections 2024-09-11T23:20:45.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.395+0000 7f3b22800640 1 --2- 172.21.15.144:0/3567112118 >> v2:172.21.15.165:3300/0 conn(0x7f3b1c073120 0x7f3b1c0735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.395+0000 7f3b22800640 1 --2- 172.21.15.144:0/3567112118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b1c15c180 0x7f3b1c0cdcf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.395+0000 7f3b22800640 1 -- 172.21.15.144:0/3567112118 >> 172.21.15.144:0/3567112118 conn(0x7f3b1c062cc0 msgr2=0x7f3b1c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:45.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.395+0000 7f3b22800640 1 -- 172.21.15.144:0/3567112118 shutdown_connections 2024-09-11T23:20:45.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.395+0000 7f3b22800640 1 -- 172.21.15.144:0/3567112118 wait complete. 2024-09-11T23:20:45.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.396+0000 7f3b22800640 1 Processor -- start 2024-09-11T23:20:45.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.396+0000 7f3b22800640 1 -- start start 2024-09-11T23:20:45.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.397+0000 7f3b22800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b1c073120 0x7f3b1c15e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.397+0000 7f3b22800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b1c0ce230 0x7f3b1c15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.397+0000 7f3b22800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c15c180 0x7f3b1c13ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.397+0000 7f3b22800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c0cf780 con 0x7f3b1c15c180 2024-09-11T23:20:45.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.397+0000 7f3b22800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c0722f0 con 0x7f3b1c073120 2024-09-11T23:20:45.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.397+0000 7f3b22800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3b1c15c560 con 0x7f3b1c0ce230 2024-09-11T23:20:45.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.397+0000 7f3b1be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c15c180 0x7f3b1c13ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.398+0000 7f3b1be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c15c180 0x7f3b1c13ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37742/0 (socket says 172.21.15.144:37742) 2024-09-11T23:20:45.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.398+0000 7f3b1be00640 1 -- 172.21.15.144:0/295305276 learned_addr learned my addr 172.21.15.144:0/295305276 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:45.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.398+0000 7f3b1b400640 1 --2- 172.21.15.144:0/295305276 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b1c073120 0x7f3b1c15e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.398+0000 7f3b1aa00640 1 --2- 172.21.15.144:0/295305276 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b1c0ce230 0x7f3b1c15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.398+0000 7f3b1be00640 1 -- 172.21.15.144:0/295305276 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b1c0ce230 msgr2=0x7f3b1c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.398+0000 7f3b1be00640 1 --2- 172.21.15.144:0/295305276 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b1c0ce230 0x7f3b1c15c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.398+0000 7f3b1be00640 1 -- 172.21.15.144:0/295305276 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b1c073120 msgr2=0x7f3b1c15e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.398+0000 7f3b1be00640 1 --2- 172.21.15.144:0/295305276 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b1c073120 0x7f3b1c15e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.398+0000 7f3b1be00640 1 -- 172.21.15.144:0/295305276 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1c13cda0 con 0x7f3b1c15c180 2024-09-11T23:20:45.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.398+0000 7f3b1be00640 1 --2- 172.21.15.144:0/295305276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c15c180 0x7f3b1c13ec90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400efc0 tx=0x7f3b1400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:45.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.398+0000 7f3b13400640 1 -- 172.21.15.144:0/295305276 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b14018020 con 0x7f3b1c15c180 2024-09-11T23:20:45.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.398+0000 7f3b13400640 1 -- 172.21.15.144:0/295305276 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b14014480 con 0x7f3b1c15c180 2024-09-11T23:20:45.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.398+0000 7f3b22800640 1 -- 172.21.15.144:0/295305276 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b1c13d080 con 0x7f3b1c15c180 2024-09-11T23:20:45.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.398+0000 7f3b13400640 1 -- 172.21.15.144:0/295305276 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b14014870 con 0x7f3b1c15c180 2024-09-11T23:20:45.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.399+0000 7f3b22800640 1 -- 172.21.15.144:0/295305276 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b1c13d640 con 0x7f3b1c15c180 2024-09-11T23:20:45.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.400+0000 7f3b22800640 1 -- 172.21.15.144:0/295305276 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b1c0cdcf0 con 0x7f3b1c15c180 2024-09-11T23:20:45.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.400+0000 7f3b13400640 1 -- 172.21.15.144:0/295305276 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f3b1401b020 con 0x7f3b1c15c180 2024-09-11T23:20:45.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.401+0000 7f3b13400640 1 --2- 172.21.15.144:0/295305276 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3afc06bfe0 0x7f3afc06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.401+0000 7f3b13400640 1 -- 172.21.15.144:0/295305276 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f3b1408bc40 con 0x7f3b1c15c180 2024-09-11T23:20:45.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.402+0000 7f3b1b400640 1 --2- 172.21.15.144:0/295305276 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3afc06bfe0 0x7f3afc06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.402+0000 7f3b1b400640 1 --2- 172.21.15.144:0/295305276 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3afc06bfe0 0x7f3afc06e4a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c034000 tx=0x7f3b0c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:45.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.405+0000 7f3b13400640 1 -- 172.21.15.144:0/295305276 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b14022030 con 0x7f3b1c15c180 2024-09-11T23:20:45.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.579+0000 7f3b22800640 1 -- 172.21.15.144:0/295305276 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b1c0d06f0 con 0x7f3b1c15c180 2024-09-11T23:20:45.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.580+0000 7f3b13400640 1 -- 172.21.15.144:0/295305276 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16848 (secure 0 0 0) 0x7f3b14010040 con 0x7f3b1c15c180 2024-09-11T23:20:45.580 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:20:45.581 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":48,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:19:40.894876+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:19:19.995015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-11T23:19:21.218463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":4}]},{"pgid":"7.2d","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:20:45.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.582+0000 7f3b22800640 1 -- 172.21.15.144:0/295305276 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3afc06bfe0 msgr2=0x7f3afc06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.582+0000 7f3b22800640 1 --2- 172.21.15.144:0/295305276 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3afc06bfe0 0x7f3afc06e4a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c034000 tx=0x7f3b0c02e000 comp rx=0 tx=0).stop 2024-09-11T23:20:45.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.582+0000 7f3b22800640 1 -- 172.21.15.144:0/295305276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c15c180 msgr2=0x7f3b1c13ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.582+0000 7f3b22800640 1 --2- 172.21.15.144:0/295305276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c15c180 0x7f3b1c13ec90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400efc0 tx=0x7f3b1400c490 comp rx=0 tx=0).stop 2024-09-11T23:20:45.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.582+0000 7f3b22800640 1 -- 172.21.15.144:0/295305276 shutdown_connections 2024-09-11T23:20:45.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.582+0000 7f3b22800640 1 --2- 172.21.15.144:0/295305276 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f3afc06bfe0 0x7f3afc06e4a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.582+0000 7f3b22800640 1 --2- 172.21.15.144:0/295305276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c15c180 0x7f3b1c13ec90 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.582+0000 7f3b22800640 1 --2- 172.21.15.144:0/295305276 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b1c0ce230 0x7f3b1c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.582+0000 7f3b22800640 1 --2- 172.21.15.144:0/295305276 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b1c073120 0x7f3b1c15e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.582+0000 7f3b22800640 1 -- 172.21.15.144:0/295305276 >> 172.21.15.144:0/295305276 conn(0x7f3b1c062cc0 msgr2=0x7f3b1c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:45.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.582+0000 7f3b22800640 1 -- 172.21.15.144:0/295305276 shutdown_connections 2024-09-11T23:20:45.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.582+0000 7f3b22800640 1 -- 172.21.15.144:0/295305276 wait complete. 2024-09-11T23:20:45.598 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:20:45.599 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:45.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.753+0000 7ff5ef200640 1 Processor -- start 2024-09-11T23:20:45.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.753+0000 7ff5ef200640 1 -- start start 2024-09-11T23:20:45.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.754+0000 7ff5ef200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff5f015b150 0x7ff5f00ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.754+0000 7ff5ef200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f00b4510 0x7ff5f00b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.754+0000 7ff5ef200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5f00b31d0 con 0x7ff5f00cd030 2024-09-11T23:20:45.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.754+0000 7ff5ef200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff5f015c0a0 con 0x7ff5f015b150 2024-09-11T23:20:45.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.754+0000 7ff5ef200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f015c380 con 0x7ff5f00b4510 2024-09-11T23:20:45.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.754+0000 7ff5ede00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff5f015b150 0x7ff5f00ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.754+0000 7ff5ee800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff5f00cd030 0x7ff5f015b530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60632/0 (socket says 172.21.15.144:60632) 2024-09-11T23:20:45.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.754+0000 7ff5ede00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff5f015b150 0x7ff5f00ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37750/0 (socket says 172.21.15.144:37750) 2024-09-11T23:20:45.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.754+0000 7ff5ee800640 1 -- 172.21.15.144:0/2937274044 learned_addr learned my addr 172.21.15.144:0/2937274044 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:20:45.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.755+0000 7ff5e5400640 1 --2- 172.21.15.144:0/2937274044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f00b4510 0x7ff5f00b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.755+0000 7ff5ede00640 1 -- 172.21.15.144:0/2937274044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f00b4510 msgr2=0x7ff5f00b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:45.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.755+0000 7ff5ede00640 1 --2- 172.21.15.144:0/2937274044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f00b4510 0x7ff5f00b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.755+0000 7ff5ede00640 1 -- 172.21.15.144:0/2937274044 >> v1:172.21.15.144:6789/0 conn(0x7ff5f00cd030 legacy=0x7ff5f015b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.755+0000 7ff5ede00640 1 -- 172.21.15.144:0/2937274044 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f00b3440 con 0x7ff5f015b150 2024-09-11T23:20:45.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.755+0000 7ff5ed400640 1 -- 172.21.15.144:0/2937274044 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3427377889 0 0) 0x7ff5f00b31d0 con 0x7ff5f00cd030 2024-09-11T23:20:45.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.755+0000 7ff5e5400640 1 --2- 172.21.15.144:0/2937274044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f00b4510 0x7ff5f00b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:45.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.756+0000 7ff5ede00640 1 --2- 172.21.15.144:0/2937274044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f015b150 0x7ff5f00ccaf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00097a0 tx=0x7ff5e002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40877365f73594a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:45.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.756+0000 7ff5ed400640 1 -- 172.21.15.144:0/2937274044 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0037070 con 0x7ff5f015b150 2024-09-11T23:20:45.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.756+0000 7ff5ed400640 1 -- 172.21.15.144:0/2937274044 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e0032440 con 0x7ff5f015b150 2024-09-11T23:20:45.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.756+0000 7ff5ed400640 1 -- 172.21.15.144:0/2937274044 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0032810 con 0x7ff5f015b150 2024-09-11T23:20:45.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.756+0000 7ff5ef200640 1 -- 172.21.15.144:0/2937274044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f015b150 msgr2=0x7ff5f00ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.756+0000 7ff5ef200640 1 --2- 172.21.15.144:0/2937274044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f015b150 0x7ff5f00ccaf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00097a0 tx=0x7ff5e002a180 comp rx=0 tx=0).stop 2024-09-11T23:20:45.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.756+0000 7ff5ef200640 1 -- 172.21.15.144:0/2937274044 shutdown_connections 2024-09-11T23:20:45.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.757+0000 7ff5ef200640 1 --2- 172.21.15.144:0/2937274044 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f00b4510 0x7ff5f00b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.757+0000 7ff5ef200640 1 --2- 172.21.15.144:0/2937274044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f015b150 0x7ff5f00ccaf0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.757+0000 7ff5ef200640 1 -- 172.21.15.144:0/2937274044 >> 172.21.15.144:0/2937274044 conn(0x7ff5f006e910 msgr2=0x7ff5f006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:45.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.757+0000 7ff5ef200640 1 -- 172.21.15.144:0/2937274044 shutdown_connections 2024-09-11T23:20:45.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.757+0000 7ff5ef200640 1 -- 172.21.15.144:0/2937274044 wait complete. 2024-09-11T23:20:45.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.758+0000 7ff5ef200640 1 Processor -- start 2024-09-11T23:20:45.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.758+0000 7ff5ef200640 1 -- start start 2024-09-11T23:20:45.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.759+0000 7ff5ef200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f00b4510 0x7ff5f0153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.759+0000 7ff5ef200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f00cd030 0x7ff5f00cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.759+0000 7ff5ef200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5f015b150 0x7ff5f00cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.759+0000 7ff5ef200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f015bdc0 con 0x7ff5f00cd030 2024-09-11T23:20:45.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.759+0000 7ff5ef200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f015bc40 con 0x7ff5f015b150 2024-09-11T23:20:45.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.759+0000 7ff5ef200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f00b3ea0 con 0x7ff5f00b4510 2024-09-11T23:20:45.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.759+0000 7ff5e5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f00cd030 0x7ff5f00cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.759+0000 7ff5e5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f00cd030 0x7ff5f00cd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37756/0 (socket says 172.21.15.144:37756) 2024-09-11T23:20:45.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.759+0000 7ff5e5400640 1 -- 172.21.15.144:0/744931216 learned_addr learned my addr 172.21.15.144:0/744931216 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:45.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.759+0000 7ff5ede00640 1 --2- 172.21.15.144:0/744931216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f00b4510 0x7ff5f0153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.760+0000 7ff5ee800640 1 --2- 172.21.15.144:0/744931216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5f015b150 0x7ff5f00cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.760+0000 7ff5e5400640 1 -- 172.21.15.144:0/744931216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f00b4510 msgr2=0x7ff5f0153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.760+0000 7ff5e5400640 1 --2- 172.21.15.144:0/744931216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f00b4510 0x7ff5f0153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.760+0000 7ff5e5400640 1 -- 172.21.15.144:0/744931216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5f015b150 msgr2=0x7ff5f00cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.760+0000 7ff5e5400640 1 --2- 172.21.15.144:0/744931216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5f015b150 0x7ff5f00cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.760+0000 7ff5e5400640 1 -- 172.21.15.144:0/744931216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f0157280 con 0x7ff5f00cd030 2024-09-11T23:20:45.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.760+0000 7ff5ee800640 1 --2- 172.21.15.144:0/744931216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5f015b150 0x7ff5f00cdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:45.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.760+0000 7ff5e5400640 1 --2- 172.21.15.144:0/744931216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f00cd030 0x7ff5f00cd7f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800c7f0 tx=0x7ff5d800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:45.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.760+0000 7ff5e6a00640 1 -- 172.21.15.144:0/744931216 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8015070 con 0x7ff5f00cd030 2024-09-11T23:20:45.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.760+0000 7ff5e6a00640 1 -- 172.21.15.144:0/744931216 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5d8007a30 con 0x7ff5f00cd030 2024-09-11T23:20:45.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.760+0000 7ff5e6a00640 1 -- 172.21.15.144:0/744931216 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8007e00 con 0x7ff5f00cd030 2024-09-11T23:20:45.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.760+0000 7ff5ef200640 1 -- 172.21.15.144:0/744931216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f0157560 con 0x7ff5f00cd030 2024-09-11T23:20:45.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.760+0000 7ff5ef200640 1 -- 172.21.15.144:0/744931216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f0157b20 con 0x7ff5f00cd030 2024-09-11T23:20:45.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.761+0000 7ff5ef200640 1 -- 172.21.15.144:0/744931216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5f00b3be0 con 0x7ff5f00cd030 2024-09-11T23:20:45.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.762+0000 7ff5e6a00640 1 -- 172.21.15.144:0/744931216 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7ff5d8018070 con 0x7ff5f00cd030 2024-09-11T23:20:45.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.764+0000 7ff5e6a00640 1 --2- 172.21.15.144:0/744931216 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff5cc06bfe0 0x7ff5cc06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:45.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.764+0000 7ff5e6a00640 1 -- 172.21.15.144:0/744931216 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7ff5d808b2a0 con 0x7ff5f00cd030 2024-09-11T23:20:45.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.764+0000 7ff5ede00640 1 --2- 172.21.15.144:0/744931216 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff5cc06bfe0 0x7ff5cc06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:45.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.764+0000 7ff5ede00640 1 --2- 172.21.15.144:0/744931216 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff5cc06bfe0 0x7ff5cc06e4a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0034000 tx=0x7ff5e002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:45.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.768+0000 7ff5e6a00640 1 -- 172.21.15.144:0/744931216 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff5f00b3be0 con 0x7ff5f00cd030 2024-09-11T23:20:45.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.976+0000 7ff5ef200640 1 -- 172.21.15.144:0/744931216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5f00ccb20 con 0x7ff5f00cd030 2024-09-11T23:20:45.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.977+0000 7ff5e6a00640 1 -- 172.21.15.144:0/744931216 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5232 (secure 0 0 0) 0x7ff5d8059190 con 0x7ff5f00cd030 2024-09-11T23:20:45.977 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:20:45.977 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-11T23:19:32:857168+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:20:45.977 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-11T23:20:45.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.979+0000 7ff5ef200640 1 -- 172.21.15.144:0/744931216 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff5cc06bfe0 msgr2=0x7ff5cc06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.979+0000 7ff5ef200640 1 --2- 172.21.15.144:0/744931216 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff5cc06bfe0 0x7ff5cc06e4a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0034000 tx=0x7ff5e002e000 comp rx=0 tx=0).stop 2024-09-11T23:20:45.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.979+0000 7ff5ef200640 1 -- 172.21.15.144:0/744931216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f00cd030 msgr2=0x7ff5f00cd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:45.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.979+0000 7ff5ef200640 1 --2- 172.21.15.144:0/744931216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f00cd030 0x7ff5f00cd7f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800c7f0 tx=0x7ff5d800cbf0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.979+0000 7ff5ef200640 1 -- 172.21.15.144:0/744931216 shutdown_connections 2024-09-11T23:20:45.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.979+0000 7ff5ef200640 1 --2- 172.21.15.144:0/744931216 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff5cc06bfe0 0x7ff5cc06e4a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.979+0000 7ff5ef200640 1 --2- 172.21.15.144:0/744931216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5f015b150 0x7ff5f00cdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.979+0000 7ff5ef200640 1 --2- 172.21.15.144:0/744931216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f00cd030 0x7ff5f00cd7f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.979+0000 7ff5ef200640 1 --2- 172.21.15.144:0/744931216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f00b4510 0x7ff5f0153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:45.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.979+0000 7ff5ef200640 1 -- 172.21.15.144:0/744931216 >> 172.21.15.144:0/744931216 conn(0x7ff5f006e910 msgr2=0x7ff5f00d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:45.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.979+0000 7ff5ef200640 1 -- 172.21.15.144:0/744931216 shutdown_connections 2024-09-11T23:20:45.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:45.979+0000 7ff5ef200640 1 -- 172.21.15.144:0/744931216 wait complete. 2024-09-11T23:20:45.995 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:46.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.149+0000 7f772c200640 1 Processor -- start 2024-09-11T23:20:46.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.149+0000 7f772c200640 1 -- start start 2024-09-11T23:20:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.151+0000 7f772c200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f772406be10 0x7f77240cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.151+0000 7f772c200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f772406c1f0 0x7f772415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.151+0000 7f772c200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77240cd5f0 con 0x7f7724151540 2024-09-11T23:20:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.151+0000 7f772c200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f77240cd8d0 con 0x7f772406be10 2024-09-11T23:20:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.151+0000 7f772c200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f77240cdbb0 con 0x7f772406c1f0 2024-09-11T23:20:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.151+0000 7f7729800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f772406be10 0x7f77240cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.151+0000 7f7728e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f772406c1f0 0x7f772415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.151+0000 7f7729800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f772406be10 0x7f77240cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:37062/0 (socket says 172.21.15.144:37062) 2024-09-11T23:20:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.151+0000 7f7729800640 1 -- 172.21.15.144:0/472044304 learned_addr learned my addr 172.21.15.144:0/472044304 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:46.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.151+0000 7f772a200640 1 --1- 172.21.15.144:0/472044304 >> v1:172.21.15.165:6789/0 conn(0x7f7724151540 0x7f772415e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:40218/0 (socket says 172.21.15.144:40218) 2024-09-11T23:20:46.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.151+0000 7f7728e00640 1 -- 172.21.15.144:0/472044304 >> v2:172.21.15.165:3300/0 conn(0x7f772406be10 msgr2=0x7f77240cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:46.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.151+0000 7f7728e00640 1 --2- 172.21.15.144:0/472044304 >> v2:172.21.15.165:3300/0 conn(0x7f772406be10 0x7f77240cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.151+0000 7f7728e00640 1 -- 172.21.15.144:0/472044304 >> v1:172.21.15.165:6789/0 conn(0x7f7724151540 legacy=0x7f772415e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.152+0000 7f7728e00640 1 -- 172.21.15.144:0/472044304 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77240cde90 con 0x7f772406c1f0 2024-09-11T23:20:46.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.153+0000 7f7728e00640 1 --2- 172.21.15.144:0/472044304 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f772406c1f0 0x7f772415baa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f77100097a0 tx=0x7f771002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa0ef10dcdae5207 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.153+0000 7f7723e00640 1 -- 172.21.15.144:0/472044304 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7710037070 con 0x7f772406c1f0 2024-09-11T23:20:46.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.153+0000 7f7723e00640 1 -- 172.21.15.144:0/472044304 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7710032440 con 0x7f772406c1f0 2024-09-11T23:20:46.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.153+0000 7f7723e00640 1 -- 172.21.15.144:0/472044304 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7710032810 con 0x7f772406c1f0 2024-09-11T23:20:46.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.153+0000 7f772c200640 1 -- 172.21.15.144:0/472044304 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f772406c1f0 msgr2=0x7f772415baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.153+0000 7f772c200640 1 --2- 172.21.15.144:0/472044304 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f772406c1f0 0x7f772415baa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f77100097a0 tx=0x7f771002a180 comp rx=0 tx=0).stop 2024-09-11T23:20:46.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.153+0000 7f772c200640 1 -- 172.21.15.144:0/472044304 shutdown_connections 2024-09-11T23:20:46.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.153+0000 7f772c200640 1 --2- 172.21.15.144:0/472044304 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f772406c1f0 0x7f772415baa0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.153+0000 7f772c200640 1 --2- 172.21.15.144:0/472044304 >> v2:172.21.15.165:3300/0 conn(0x7f772406be10 0x7f77240cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.153+0000 7f772c200640 1 -- 172.21.15.144:0/472044304 >> 172.21.15.144:0/472044304 conn(0x7f7724062cc0 msgr2=0x7f772406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:46.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.154+0000 7f772c200640 1 -- 172.21.15.144:0/472044304 shutdown_connections 2024-09-11T23:20:46.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.154+0000 7f772c200640 1 -- 172.21.15.144:0/472044304 wait complete. 2024-09-11T23:20:46.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.155+0000 7f772c200640 1 Processor -- start 2024-09-11T23:20:46.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.155+0000 7f772c200640 1 -- start start 2024-09-11T23:20:46.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.156+0000 7f772c200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f772406be10 0x7f77240af080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.156+0000 7f772c200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f772406c1f0 0x7f77241f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.156+0000 7f772c200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7724151540 0x7f77240b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.156+0000 7f772c200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f77241519b0 con 0x7f7724151540 2024-09-11T23:20:46.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.156+0000 7f772c200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f77240ce690 con 0x7f772406be10 2024-09-11T23:20:46.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.156+0000 7f772c200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7724151b30 con 0x7f772406c1f0 2024-09-11T23:20:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.156+0000 7f7729800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f772406be10 0x7f77240af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.156+0000 7f7728e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f772406c1f0 0x7f77241f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.157+0000 7f772a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7724151540 0x7f77240b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.157+0000 7f7728e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f772406c1f0 0x7f77241f4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:56996/0 (socket says 172.21.15.144:56996) 2024-09-11T23:20:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.157+0000 7f7729800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f772406be10 0x7f77240af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:37070/0 (socket says 172.21.15.144:37070) 2024-09-11T23:20:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.157+0000 7f7728e00640 1 -- 172.21.15.144:0/686097102 learned_addr learned my addr 172.21.15.144:0/686097102 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.157+0000 7f7728e00640 1 -- 172.21.15.144:0/686097102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f772406be10 msgr2=0x7f77240af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.157+0000 7f7728e00640 1 --2- 172.21.15.144:0/686097102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f772406be10 0x7f77240af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.157+0000 7f7728e00640 1 -- 172.21.15.144:0/686097102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7724151540 msgr2=0x7f77240b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.157+0000 7f7728e00640 1 --2- 172.21.15.144:0/686097102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7724151540 0x7f77240b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.157+0000 7f7728e00640 1 -- 172.21.15.144:0/686097102 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f772415c8c0 con 0x7f772406c1f0 2024-09-11T23:20:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.157+0000 7f7728e00640 1 --2- 172.21.15.144:0/686097102 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f772406c1f0 0x7f77241f4cc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7710035040 tx=0x7f77100046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.158+0000 7f7721600640 1 -- 172.21.15.144:0/686097102 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7710037040 con 0x7f772406c1f0 2024-09-11T23:20:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.158+0000 7f7721600640 1 -- 172.21.15.144:0/686097102 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7710030500 con 0x7f772406c1f0 2024-09-11T23:20:46.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.158+0000 7f7721600640 1 -- 172.21.15.144:0/686097102 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7710030910 con 0x7f772406c1f0 2024-09-11T23:20:46.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.158+0000 7f772c200640 1 -- 172.21.15.144:0/686097102 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f772415cba0 con 0x7f772406c1f0 2024-09-11T23:20:46.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.158+0000 7f772c200640 1 -- 172.21.15.144:0/686097102 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f772415d160 con 0x7f772406c1f0 2024-09-11T23:20:46.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.159+0000 7f772c200640 1 -- 172.21.15.144:0/686097102 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77240cd010 con 0x7f772406c1f0 2024-09-11T23:20:46.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.160+0000 7f7721600640 1 -- 172.21.15.144:0/686097102 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f7710044020 con 0x7f772406c1f0 2024-09-11T23:20:46.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.161+0000 7f7721600640 1 --2- 172.21.15.144:0/686097102 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f770406bfe0 0x7f770406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.161+0000 7f7721600640 1 -- 172.21.15.144:0/686097102 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f77100ab570 con 0x7f772406c1f0 2024-09-11T23:20:46.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.161+0000 7f7729800640 1 --2- 172.21.15.144:0/686097102 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f770406bfe0 0x7f770406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.161+0000 7f7729800640 1 --2- 172.21.15.144:0/686097102 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f770406bfe0 0x7f770406e4a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f77240b3910 tx=0x7f771800a350 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.164+0000 7f7721600640 1 -- 172.21.15.144:0/686097102 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7710079680 con 0x7f772406c1f0 2024-09-11T23:20:46.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.373+0000 7f772c200640 1 -- 172.21.15.144:0/686097102 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77240d0d20 con 0x7f772406c1f0 2024-09-11T23:20:46.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.374+0000 7f7721600640 1 -- 172.21.15.144:0/686097102 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5232 (secure 0 0 0) 0x7f771007d980 con 0x7f772406c1f0 2024-09-11T23:20:46.374 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:20:46.374 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":26,"btime":"2024-09-11T23:19:32:857168+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:19:22.219557+0000","modified":"2024-09-11T23:19:25.228354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5247},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5247":{"gid":5247,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1940447658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1940447658},{"type":"v1","addr":"172.21.15.144:6837","nonce":1940447658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5247,"qdb_cluster":[5247]},"id":3}]} 2024-09-11T23:20:46.374 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 26 2024-09-11T23:20:46.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.376+0000 7f772c200640 1 -- 172.21.15.144:0/686097102 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f770406bfe0 msgr2=0x7f770406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.376+0000 7f772c200640 1 --2- 172.21.15.144:0/686097102 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f770406bfe0 0x7f770406e4a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f77240b3910 tx=0x7f771800a350 comp rx=0 tx=0).stop 2024-09-11T23:20:46.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.376+0000 7f772c200640 1 -- 172.21.15.144:0/686097102 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f772406c1f0 msgr2=0x7f77241f4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.376+0000 7f772c200640 1 --2- 172.21.15.144:0/686097102 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f772406c1f0 0x7f77241f4cc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7710035040 tx=0x7f77100046c0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.376+0000 7f772c200640 1 -- 172.21.15.144:0/686097102 shutdown_connections 2024-09-11T23:20:46.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.376+0000 7f772c200640 1 --2- 172.21.15.144:0/686097102 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f770406bfe0 0x7f770406e4a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.376+0000 7f772c200640 1 --2- 172.21.15.144:0/686097102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7724151540 0x7f77240b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.376+0000 7f772c200640 1 --2- 172.21.15.144:0/686097102 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f772406c1f0 0x7f77241f4cc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.376+0000 7f772c200640 1 --2- 172.21.15.144:0/686097102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f772406be10 0x7f77240af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.376+0000 7f772c200640 1 -- 172.21.15.144:0/686097102 >> 172.21.15.144:0/686097102 conn(0x7f7724062cc0 msgr2=0x7f772406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:46.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.376+0000 7f772c200640 1 -- 172.21.15.144:0/686097102 shutdown_connections 2024-09-11T23:20:46.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.376+0000 7f772c200640 1 -- 172.21.15.144:0/686097102 wait complete. 2024-09-11T23:20:46.394 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:20:46.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.546+0000 7f1539000640 1 Processor -- start 2024-09-11T23:20:46.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.546+0000 7f1539000640 1 -- start start 2024-09-11T23:20:46.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.547+0000 7f1539000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f15340b5fd0 0x7f15340b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.547+0000 7f1539000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f153406bee0 con 0x7f15340b7750 2024-09-11T23:20:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.547+0000 7f1539000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f153406c1c0 con 0x7f153415e640 2024-09-11T23:20:46.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.547+0000 7f1539000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f153415ea20 con 0x7f15340b5fd0 2024-09-11T23:20:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.547+0000 7f1533e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f15340b7750 0x7f15340b7be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60640/0 (socket says 172.21.15.144:60640) 2024-09-11T23:20:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.547+0000 7f1533e00640 1 -- 172.21.15.144:0/2952286162 learned_addr learned my addr 172.21.15.144:0/2952286162 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:20:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.547+0000 7f1532a00640 1 --2- 172.21.15.144:0/2952286162 >> v2:172.21.15.165:3300/0 conn(0x7f15340b5fd0 0x7f15340b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.548+0000 7f1532000640 1 -- 172.21.15.144:0/2952286162 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2485288153 0 0) 0x7f153406bee0 con 0x7f15340b7750 2024-09-11T23:20:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.548+0000 7f1532000640 1 -- 172.21.15.144:0/2952286162 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1518003520 con 0x7f15340b7750 2024-09-11T23:20:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.548+0000 7f1532000640 1 -- 172.21.15.144:0/2952286162 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3600822663 0 0) 0x7f1518003520 con 0x7f15340b7750 2024-09-11T23:20:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.548+0000 7f1532000640 1 -- 172.21.15.144:0/2952286162 >> v2:172.21.15.165:3300/0 conn(0x7f15340b5fd0 msgr2=0x7f15340b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.548+0000 7f1532000640 1 --2- 172.21.15.144:0/2952286162 >> v2:172.21.15.165:3300/0 conn(0x7f15340b5fd0 0x7f15340b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.548+0000 7f1532000640 1 -- 172.21.15.144:0/2952286162 >> v1:172.21.15.165:6789/0 conn(0x7f153415e640 legacy=0x7f15340d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.548+0000 7f1532000640 1 -- 172.21.15.144:0/2952286162 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f153406c4a0 con 0x7f15340b7750 2024-09-11T23:20:46.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.548+0000 7f1532000640 1 -- 172.21.15.144:0/2952286162 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f152c0019f0 con 0x7f15340b7750 2024-09-11T23:20:46.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.548+0000 7f1532000640 1 -- 172.21.15.144:0/2952286162 >> v1:172.21.15.144:6789/0 conn(0x7f15340b7750 legacy=0x7f15340b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.548+0000 7f1532000640 1 --2- 172.21.15.144:0/2952286162 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15180039b0 0x7f1518003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.548+0000 7f1532000640 1 --2- 172.21.15.144:0/2952286162 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1518004800 0x7f1518004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.548+0000 7f1532000640 1 --2- 172.21.15.144:0/2952286162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15180051c0 0x7f151800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.548+0000 7f1532000640 1 -- 172.21.15.144:0/2952286162 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f151800c030 con 0x7f15180051c0 2024-09-11T23:20:46.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.548+0000 7f1532000640 1 -- 172.21.15.144:0/2952286162 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f151800c1e0 con 0x7f15180039b0 2024-09-11T23:20:46.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.548+0000 7f1532000640 1 -- 172.21.15.144:0/2952286162 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f151800c3e0 con 0x7f1518004800 2024-09-11T23:20:46.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.548+0000 7f1533e00640 1 --2- 172.21.15.144:0/2952286162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15180051c0 0x7f151800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.548+0000 7f1533400640 1 --2- 172.21.15.144:0/2952286162 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15180039b0 0x7f1518003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.548+0000 7f1532a00640 1 --2- 172.21.15.144:0/2952286162 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1518004800 0x7f1518004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.549+0000 7f1533e00640 1 -- 172.21.15.144:0/2952286162 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1518004800 msgr2=0x7f1518004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:46.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.549+0000 7f1533e00640 1 --2- 172.21.15.144:0/2952286162 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1518004800 0x7f1518004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.549+0000 7f1533e00640 1 -- 172.21.15.144:0/2952286162 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15180039b0 msgr2=0x7f1518003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:46.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.549+0000 7f1533e00640 1 --2- 172.21.15.144:0/2952286162 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15180039b0 0x7f1518003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.549+0000 7f1533e00640 1 -- 172.21.15.144:0/2952286162 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1518003520 con 0x7f15180051c0 2024-09-11T23:20:46.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.550+0000 7f1533e00640 1 -- 172.21.15.144:0/2952286162 reap_dead start 2024-09-11T23:20:46.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.550+0000 7f1533e00640 1 --2- 172.21.15.144:0/2952286162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15180051c0 0x7f151800b9c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f152c00a860 tx=0x7f1518005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94243ddf5e25a49b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.550+0000 7f1532000640 1 -- 172.21.15.144:0/2952286162 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152c00a480 con 0x7f15180051c0 2024-09-11T23:20:46.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.550+0000 7f1532000640 1 -- 172.21.15.144:0/2952286162 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f152c02f070 con 0x7f15180051c0 2024-09-11T23:20:46.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.550+0000 7f1532000640 1 -- 172.21.15.144:0/2952286162 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152c02bca0 con 0x7f15180051c0 2024-09-11T23:20:46.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.551+0000 7f1539000640 1 -- 172.21.15.144:0/2952286162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15180051c0 msgr2=0x7f151800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.551+0000 7f1539000640 1 --2- 172.21.15.144:0/2952286162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15180051c0 0x7f151800b9c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f152c00a860 tx=0x7f1518005830 comp rx=0 tx=0).stop 2024-09-11T23:20:46.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.551+0000 7f1539000640 1 -- 172.21.15.144:0/2952286162 shutdown_connections 2024-09-11T23:20:46.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.551+0000 7f1539000640 1 --2- 172.21.15.144:0/2952286162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15180051c0 0x7f151800b9c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.551+0000 7f1539000640 1 -- 172.21.15.144:0/2952286162 >> 172.21.15.144:0/2952286162 conn(0x7f15340d0fd0 msgr2=0x7f15340d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:46.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.551+0000 7f1539000640 1 -- 172.21.15.144:0/2952286162 shutdown_connections 2024-09-11T23:20:46.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.551+0000 7f1539000640 1 -- 172.21.15.144:0/2952286162 wait complete. 2024-09-11T23:20:46.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.552+0000 7f1539000640 1 Processor -- start 2024-09-11T23:20:46.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.553+0000 7f1539000640 1 -- start start 2024-09-11T23:20:46.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.553+0000 7f1539000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15180051c0 0x7f1534154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.553+0000 7f1539000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1534157d80 0x7f15341552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.553+0000 7f1539000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1534160970 0x7f1534160df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.553+0000 7f1539000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f15340b6410 con 0x7f1534160970 2024-09-11T23:20:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.553+0000 7f1539000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f153406caf0 con 0x7f15180051c0 2024-09-11T23:20:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.553+0000 7f1539000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f15340b6590 con 0x7f1534157d80 2024-09-11T23:20:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.554+0000 7f1533e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1534160970 0x7f1534160df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.554+0000 7f1533e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1534160970 0x7f1534160df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37790/0 (socket says 172.21.15.144:37790) 2024-09-11T23:20:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.554+0000 7f1533e00640 1 -- 172.21.15.144:0/1347603497 learned_addr learned my addr 172.21.15.144:0/1347603497 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.554+0000 7f1532a00640 1 --2- 172.21.15.144:0/1347603497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1534157d80 0x7f15341552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.554+0000 7f1533400640 1 --2- 172.21.15.144:0/1347603497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15180051c0 0x7f1534154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.554+0000 7f1533e00640 1 -- 172.21.15.144:0/1347603497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1534157d80 msgr2=0x7f15341552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.554+0000 7f1533e00640 1 --2- 172.21.15.144:0/1347603497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1534157d80 0x7f15341552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.554+0000 7f1533e00640 1 -- 172.21.15.144:0/1347603497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15180051c0 msgr2=0x7f1534154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.554+0000 7f1533e00640 1 --2- 172.21.15.144:0/1347603497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15180051c0 0x7f1534154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.554+0000 7f1533e00640 1 -- 172.21.15.144:0/1347603497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1534155b10 con 0x7f1534160970 2024-09-11T23:20:46.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.554+0000 7f1532a00640 1 --2- 172.21.15.144:0/1347603497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1534157d80 0x7f15341552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:46.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.554+0000 7f1533400640 1 --2- 172.21.15.144:0/1347603497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15180051c0 0x7f1534154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:46.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.554+0000 7f1533e00640 1 --2- 172.21.15.144:0/1347603497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1534160970 0x7f1534160df0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f152c02b530 tx=0x7f152c02d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.554+0000 7f152b400640 1 -- 172.21.15.144:0/1347603497 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152c00a480 con 0x7f1534160970 2024-09-11T23:20:46.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.554+0000 7f152b400640 1 -- 172.21.15.144:0/1347603497 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f152c034670 con 0x7f1534160970 2024-09-11T23:20:46.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.554+0000 7f152b400640 1 -- 172.21.15.144:0/1347603497 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152c034a40 con 0x7f1534160970 2024-09-11T23:20:46.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.555+0000 7f1539000640 1 -- 172.21.15.144:0/1347603497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1534155df0 con 0x7f1534160970 2024-09-11T23:20:46.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.555+0000 7f1539000640 1 -- 172.21.15.144:0/1347603497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15341563b0 con 0x7f1534160970 2024-09-11T23:20:46.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.556+0000 7f1539000640 1 -- 172.21.15.144:0/1347603497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15340d41e0 con 0x7f1534160970 2024-09-11T23:20:46.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.556+0000 7f152b400640 1 -- 172.21.15.144:0/1347603497 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f152c034be0 con 0x7f1534160970 2024-09-11T23:20:46.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.558+0000 7f152b400640 1 --2- 172.21.15.144:0/1347603497 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f151406bfe0 0x7f151406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.558+0000 7f152b400640 1 -- 172.21.15.144:0/1347603497 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f152c0ab380 con 0x7f1534160970 2024-09-11T23:20:46.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.558+0000 7f1533400640 1 --2- 172.21.15.144:0/1347603497 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f151406bfe0 0x7f151406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.559+0000 7f1533400640 1 --2- 172.21.15.144:0/1347603497 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f151406bfe0 0x7f151406e4a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1524000c00 tx=0x7f1524009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.562+0000 7f152b400640 1 -- 172.21.15.144:0/1347603497 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f152c046060 con 0x7f1534160970 2024-09-11T23:20:46.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.738+0000 7f1539000640 1 -- 172.21.15.144:0/1347603497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15340b6de0 con 0x7f1534160970 2024-09-11T23:20:46.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.739+0000 7f152b400640 1 -- 172.21.15.144:0/1347603497 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16848 (secure 0 0 0) 0x7f152c079a70 con 0x7f1534160970 2024-09-11T23:20:46.739 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:20:46.739 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":48,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:19:40.894876+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:19:19.995015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-11T23:19:21.218463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":4}]},{"pgid":"7.2d","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:20:46.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.741+0000 7f1539000640 1 -- 172.21.15.144:0/1347603497 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f151406bfe0 msgr2=0x7f151406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.741+0000 7f1539000640 1 --2- 172.21.15.144:0/1347603497 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f151406bfe0 0x7f151406e4a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1524000c00 tx=0x7f1524009040 comp rx=0 tx=0).stop 2024-09-11T23:20:46.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.741+0000 7f1539000640 1 -- 172.21.15.144:0/1347603497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1534160970 msgr2=0x7f1534160df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.741+0000 7f1539000640 1 --2- 172.21.15.144:0/1347603497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1534160970 0x7f1534160df0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f152c02b530 tx=0x7f152c02d070 comp rx=0 tx=0).stop 2024-09-11T23:20:46.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.741+0000 7f1539000640 1 -- 172.21.15.144:0/1347603497 shutdown_connections 2024-09-11T23:20:46.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.741+0000 7f1539000640 1 --2- 172.21.15.144:0/1347603497 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f151406bfe0 0x7f151406e4a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.741+0000 7f1539000640 1 --2- 172.21.15.144:0/1347603497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1534160970 0x7f1534160df0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.741+0000 7f1539000640 1 --2- 172.21.15.144:0/1347603497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1534157d80 0x7f15341552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.741+0000 7f1539000640 1 --2- 172.21.15.144:0/1347603497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15180051c0 0x7f1534154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.741+0000 7f1539000640 1 -- 172.21.15.144:0/1347603497 >> 172.21.15.144:0/1347603497 conn(0x7f15340d0fd0 msgr2=0x7f15340cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:46.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.741+0000 7f1539000640 1 -- 172.21.15.144:0/1347603497 shutdown_connections 2024-09-11T23:20:46.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.741+0000 7f1539000640 1 -- 172.21.15.144:0/1347603497 wait complete. 2024-09-11T23:20:46.758 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:20:46.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.913+0000 7f2e4e800640 1 Processor -- start 2024-09-11T23:20:46.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.913+0000 7f2e4e800640 1 -- start start 2024-09-11T23:20:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.915+0000 7f2e4e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e4815ceb0 0x7f2e481594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.915+0000 7f2e4e800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e4815d390 con 0x7f2e480d02a0 2024-09-11T23:20:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.915+0000 7f2e4e800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e4815d670 con 0x7f2e4815ca40 2024-09-11T23:20:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.915+0000 7f2e4e800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2e4815d950 con 0x7f2e4815ceb0 2024-09-11T23:20:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.915+0000 7f2e47400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f2e480d02a0 0x7f2e480d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60650/0 (socket says 172.21.15.144:60650) 2024-09-11T23:20:46.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.915+0000 7f2e47400640 1 -- 172.21.15.144:0/903054529 learned_addr learned my addr 172.21.15.144:0/903054529 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:20:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.915+0000 7f2e47e00640 1 --2- 172.21.15.144:0/903054529 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e4815ceb0 0x7f2e481594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.915+0000 7f2e46a00640 1 -- 172.21.15.144:0/903054529 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3011052021 0 0) 0x7f2e4815d390 con 0x7f2e480d02a0 2024-09-11T23:20:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.915+0000 7f2e46a00640 1 -- 172.21.15.144:0/903054529 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e2c003520 con 0x7f2e480d02a0 2024-09-11T23:20:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.916+0000 7f2e46a00640 1 -- 172.21.15.144:0/903054529 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2358918651 0 0) 0x7f2e2c003520 con 0x7f2e480d02a0 2024-09-11T23:20:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.916+0000 7f2e46a00640 1 -- 172.21.15.144:0/903054529 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e4815ceb0 msgr2=0x7f2e481594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.916+0000 7f2e46a00640 1 --2- 172.21.15.144:0/903054529 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e4815ceb0 0x7f2e481594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.916+0000 7f2e46a00640 1 -- 172.21.15.144:0/903054529 >> v1:172.21.15.165:6789/0 conn(0x7f2e4815ca40 legacy=0x7f2e4815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.916+0000 7f2e46a00640 1 -- 172.21.15.144:0/903054529 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e4815dc30 con 0x7f2e480d02a0 2024-09-11T23:20:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.916+0000 7f2e46a00640 1 -- 172.21.15.144:0/903054529 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f2e38001670 con 0x7f2e480d02a0 2024-09-11T23:20:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.916+0000 7f2e46a00640 1 -- 172.21.15.144:0/903054529 >> v1:172.21.15.144:6789/0 conn(0x7f2e480d02a0 legacy=0x7f2e480d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.916+0000 7f2e46a00640 1 --2- 172.21.15.144:0/903054529 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e4815ceb0 0x7f2e2c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.916+0000 7f2e46a00640 1 --2- 172.21.15.144:0/903054529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e2c003f60 0x7f2e2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.916+0000 7f2e46a00640 1 --2- 172.21.15.144:0/903054529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e2c004d40 0x7f2e2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.916+0000 7f2e46a00640 1 -- 172.21.15.144:0/903054529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4815d950 con 0x7f2e2c004d40 2024-09-11T23:20:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.916+0000 7f2e46a00640 1 -- 172.21.15.144:0/903054529 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c00bb50 con 0x7f2e2c003f60 2024-09-11T23:20:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.916+0000 7f2e46a00640 1 -- 172.21.15.144:0/903054529 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2e2c00bd50 con 0x7f2e4815ceb0 2024-09-11T23:20:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.916+0000 7f2e47e00640 1 --2- 172.21.15.144:0/903054529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e2c004d40 0x7f2e2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.916+0000 7f2e47400640 1 --2- 172.21.15.144:0/903054529 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e4815ceb0 0x7f2e2c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.916+0000 7f2e3ea00640 1 --2- 172.21.15.144:0/903054529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e2c003f60 0x7f2e2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.917+0000 7f2e47e00640 1 -- 172.21.15.144:0/903054529 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e4815ceb0 msgr2=0x7f2e2c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.917+0000 7f2e47e00640 1 --2- 172.21.15.144:0/903054529 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e4815ceb0 0x7f2e2c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.917+0000 7f2e47e00640 1 -- 172.21.15.144:0/903054529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e2c003f60 msgr2=0x7f2e2c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.917+0000 7f2e47e00640 1 --2- 172.21.15.144:0/903054529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e2c003f60 0x7f2e2c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.917+0000 7f2e47e00640 1 -- 172.21.15.144:0/903054529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2c003520 con 0x7f2e2c004d40 2024-09-11T23:20:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.917+0000 7f2e47e00640 1 --2- 172.21.15.144:0/903054529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e2c004d40 0x7f2e2c0051c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2e4815d2c0 tx=0x7f2e2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d767cd75e228338d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.918+0000 7f2e46a00640 1 -- 172.21.15.144:0/903054529 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e40037070 con 0x7f2e2c004d40 2024-09-11T23:20:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.918+0000 7f2e46a00640 1 -- 172.21.15.144:0/903054529 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e4002e050 con 0x7f2e2c004d40 2024-09-11T23:20:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.918+0000 7f2e46a00640 1 -- 172.21.15.144:0/903054529 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e40009c10 con 0x7f2e2c004d40 2024-09-11T23:20:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.918+0000 7f2e4e800640 1 -- 172.21.15.144:0/903054529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e2c004d40 msgr2=0x7f2e2c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.918+0000 7f2e4e800640 1 --2- 172.21.15.144:0/903054529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e2c004d40 0x7f2e2c0051c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2e4815d2c0 tx=0x7f2e2c005830 comp rx=0 tx=0).stop 2024-09-11T23:20:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.918+0000 7f2e47e00640 1 -- 172.21.15.144:0/903054529 reap_dead start 2024-09-11T23:20:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.918+0000 7f2e4e800640 1 -- 172.21.15.144:0/903054529 shutdown_connections 2024-09-11T23:20:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.918+0000 7f2e4e800640 1 -- 172.21.15.144:0/903054529 >> 172.21.15.144:0/903054529 conn(0x7f2e48062cc0 msgr2=0x7f2e4806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:46.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.918+0000 7f2e4e800640 1 -- 172.21.15.144:0/903054529 shutdown_connections 2024-09-11T23:20:46.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.918+0000 7f2e4e800640 1 -- 172.21.15.144:0/903054529 wait complete. 2024-09-11T23:20:46.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.920+0000 7f2e4e800640 1 Processor -- start 2024-09-11T23:20:46.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.920+0000 7f2e4e800640 1 -- start start 2024-09-11T23:20:46.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.921+0000 7f2e4e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e2c004d40 0x7f2e48143dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.921+0000 7f2e4e800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e4814cd80 0x7f2e48151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.921+0000 7f2e4e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e480cdf90 0x7f2e48151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.921+0000 7f2e4e800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2e48155b90 con 0x7f2e480cdf90 2024-09-11T23:20:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.921+0000 7f2e4e800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4815eb40 con 0x7f2e4814cd80 2024-09-11T23:20:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.921+0000 7f2e4e800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2e48155d10 con 0x7f2e2c004d40 2024-09-11T23:20:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.921+0000 7f2e47e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e480cdf90 0x7f2e48151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.921+0000 7f2e47e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e480cdf90 0x7f2e48151fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37804/0 (socket says 172.21.15.144:37804) 2024-09-11T23:20:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.921+0000 7f2e47e00640 1 -- 172.21.15.144:0/3116587691 learned_addr learned my addr 172.21.15.144:0/3116587691 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:46.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.921+0000 7f2e47400640 1 --2- 172.21.15.144:0/3116587691 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e2c004d40 0x7f2e48143dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.922+0000 7f2e3ea00640 1 --2- 172.21.15.144:0/3116587691 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e4814cd80 0x7f2e48151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.922+0000 7f2e47e00640 1 -- 172.21.15.144:0/3116587691 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e2c004d40 msgr2=0x7f2e48143dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.922+0000 7f2e47e00640 1 --2- 172.21.15.144:0/3116587691 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e2c004d40 0x7f2e48143dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.922+0000 7f2e47e00640 1 -- 172.21.15.144:0/3116587691 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e4814cd80 msgr2=0x7f2e48151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:46.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.922+0000 7f2e47e00640 1 --2- 172.21.15.144:0/3116587691 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e4814cd80 0x7f2e48151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:46.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.922+0000 7f2e47e00640 1 -- 172.21.15.144:0/3116587691 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e481e5e50 con 0x7f2e480cdf90 2024-09-11T23:20:46.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.922+0000 7f2e47e00640 1 --2- 172.21.15.144:0/3116587691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e480cdf90 0x7f2e48151fe0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2e4002ae80 tx=0x7f2e40009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.922+0000 7f2e3fe00640 1 -- 172.21.15.144:0/3116587691 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e40042020 con 0x7f2e480cdf90 2024-09-11T23:20:46.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.922+0000 7f2e3fe00640 1 -- 172.21.15.144:0/3116587691 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e40003b90 con 0x7f2e480cdf90 2024-09-11T23:20:46.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.922+0000 7f2e4e800640 1 -- 172.21.15.144:0/3116587691 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e481e6130 con 0x7f2e480cdf90 2024-09-11T23:20:46.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.922+0000 7f2e3fe00640 1 -- 172.21.15.144:0/3116587691 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e40037040 con 0x7f2e480cdf90 2024-09-11T23:20:46.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.923+0000 7f2e4e800640 1 -- 172.21.15.144:0/3116587691 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e481e5a70 con 0x7f2e480cdf90 2024-09-11T23:20:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.924+0000 7f2e4e800640 1 -- 172.21.15.144:0/3116587691 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e480b4790 con 0x7f2e480cdf90 2024-09-11T23:20:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.924+0000 7f2e3fe00640 1 -- 172.21.15.144:0/3116587691 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f2e40045070 con 0x7f2e480cdf90 2024-09-11T23:20:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.925+0000 7f2e3fe00640 1 --2- 172.21.15.144:0/3116587691 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2e2406c010 0x7f2e2406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.925+0000 7f2e3fe00640 1 -- 172.21.15.144:0/3116587691 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f2e400ab570 con 0x7f2e480cdf90 2024-09-11T23:20:46.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.925+0000 7f2e47400640 1 --2- 172.21.15.144:0/3116587691 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2e2406c010 0x7f2e2406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:46.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.926+0000 7f2e47400640 1 --2- 172.21.15.144:0/3116587691 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2e2406c010 0x7f2e2406e4d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2e38001050 tx=0x7f2e38000f80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:46.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:46.929+0000 7f2e3fe00640 1 -- 172.21.15.144:0/3116587691 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e40079620 con 0x7f2e480cdf90 2024-09-11T23:20:47.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.138+0000 7f2e4e800640 1 -- 172.21.15.144:0/3116587691 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2e480ce780 con 0x7f2e480cdf90 2024-09-11T23:20:47.138 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-11T23:20:47.138+0000 7f86fcc00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:20:47.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.140+0000 7f2e3fe00640 1 -- 172.21.15.144:0/3116587691 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) ==== 161+0+0 (secure 0 0 0) 0x7f2e4007d920 con 0x7f2e480cdf90 2024-09-11T23:20:47.140 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:20:47.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.143+0000 7f2e4e800640 1 -- 172.21.15.144:0/3116587691 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2e2406c010 msgr2=0x7f2e2406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.143+0000 7f2e4e800640 1 --2- 172.21.15.144:0/3116587691 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2e2406c010 0x7f2e2406e4d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2e38001050 tx=0x7f2e38000f80 comp rx=0 tx=0).stop 2024-09-11T23:20:47.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.143+0000 7f2e4e800640 1 -- 172.21.15.144:0/3116587691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e480cdf90 msgr2=0x7f2e48151fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.143+0000 7f2e4e800640 1 --2- 172.21.15.144:0/3116587691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e480cdf90 0x7f2e48151fe0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2e4002ae80 tx=0x7f2e40009750 comp rx=0 tx=0).stop 2024-09-11T23:20:47.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.143+0000 7f2e4e800640 1 -- 172.21.15.144:0/3116587691 shutdown_connections 2024-09-11T23:20:47.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.143+0000 7f2e4e800640 1 --2- 172.21.15.144:0/3116587691 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2e2406c010 0x7f2e2406e4d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.143+0000 7f2e4e800640 1 --2- 172.21.15.144:0/3116587691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e480cdf90 0x7f2e48151fe0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.143+0000 7f2e4e800640 1 --2- 172.21.15.144:0/3116587691 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e4814cd80 0x7f2e48151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.143+0000 7f2e4e800640 1 --2- 172.21.15.144:0/3116587691 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e2c004d40 0x7f2e48143dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.143+0000 7f2e4e800640 1 -- 172.21.15.144:0/3116587691 >> 172.21.15.144:0/3116587691 conn(0x7f2e48062cc0 msgr2=0x7f2e48153d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:47.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.143+0000 7f2e4e800640 1 -- 172.21.15.144:0/3116587691 shutdown_connections 2024-09-11T23:20:47.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.143+0000 7f2e4e800640 1 -- 172.21.15.144:0/3116587691 wait complete. 2024-09-11T23:20:47.160 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:20:47.207 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-11T23:20:47.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.319+0000 7fdfbb600640 1 Processor -- start 2024-09-11T23:20:47.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.319+0000 7fdfbb600640 1 -- start start 2024-09-11T23:20:47.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.320+0000 7fdfbb600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdfb40b3430 0x7fdfb40cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.320+0000 7fdfbb600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fdfb40d2d10 0x7fdfb40d3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.320+0000 7fdfbb600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb415e9d0 con 0x7fdfb406c2d0 2024-09-11T23:20:47.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.320+0000 7fdfbb600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fdfb40d22c0 con 0x7fdfb40b3430 2024-09-11T23:20:47.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.320+0000 7fdfbb600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fdfb406ca70 con 0x7fdfb40d2d10 2024-09-11T23:20:47.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.320+0000 7fdfb8c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdfb40b3430 0x7fdfb40cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.320+0000 7fdfb8c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdfb40b3430 0x7fdfb40cf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37818/0 (socket says 172.21.15.144:37818) 2024-09-11T23:20:47.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.320+0000 7fdfb8c00640 1 -- 172.21.15.144:0/148111708 learned_addr learned my addr 172.21.15.144:0/148111708 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:47.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.321+0000 7fdfb9600640 1 --2- 172.21.15.144:0/148111708 >> v2:172.21.15.165:3300/0 conn(0x7fdfb40d2d10 0x7fdfb40d3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.321+0000 7fdfb8c00640 1 -- 172.21.15.144:0/148111708 >> v2:172.21.15.165:3300/0 conn(0x7fdfb40d2d10 msgr2=0x7fdfb40d3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:47.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.321+0000 7fdfb8c00640 1 --2- 172.21.15.144:0/148111708 >> v2:172.21.15.165:3300/0 conn(0x7fdfb40d2d10 0x7fdfb40d3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.321+0000 7fdfb8c00640 1 -- 172.21.15.144:0/148111708 >> v1:172.21.15.165:6789/0 conn(0x7fdfb406c2d0 legacy=0x7fdfb40b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.321+0000 7fdfb8c00640 1 -- 172.21.15.144:0/148111708 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb406cd50 con 0x7fdfb40b3430 2024-09-11T23:20:47.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.322+0000 7fdfb8c00640 1 --2- 172.21.15.144:0/148111708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfb40b3430 0x7fdfb40cf750 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4075890 tx=0x7fdfa802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4683ef13e5b30ad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:47.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.322+0000 7fdfb3400640 1 -- 172.21.15.144:0/148111708 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8037070 con 0x7fdfb40b3430 2024-09-11T23:20:47.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.322+0000 7fdfb3400640 1 -- 172.21.15.144:0/148111708 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa8032440 con 0x7fdfb40b3430 2024-09-11T23:20:47.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.322+0000 7fdfb3400640 1 -- 172.21.15.144:0/148111708 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8032810 con 0x7fdfb40b3430 2024-09-11T23:20:47.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.323+0000 7fdfbb600640 1 -- 172.21.15.144:0/148111708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfb40b3430 msgr2=0x7fdfb40cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.323+0000 7fdfbb600640 1 --2- 172.21.15.144:0/148111708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfb40b3430 0x7fdfb40cf750 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4075890 tx=0x7fdfa802a200 comp rx=0 tx=0).stop 2024-09-11T23:20:47.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.323+0000 7fdfbb600640 1 -- 172.21.15.144:0/148111708 shutdown_connections 2024-09-11T23:20:47.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.323+0000 7fdfbb600640 1 --2- 172.21.15.144:0/148111708 >> v2:172.21.15.165:3300/0 conn(0x7fdfb40d2d10 0x7fdfb40d3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.323+0000 7fdfbb600640 1 --2- 172.21.15.144:0/148111708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfb40b3430 0x7fdfb40cf750 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.323+0000 7fdfbb600640 1 -- 172.21.15.144:0/148111708 >> 172.21.15.144:0/148111708 conn(0x7fdfb40d4b10 msgr2=0x7fdfb40d4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:47.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.323+0000 7fdfbb600640 1 -- 172.21.15.144:0/148111708 shutdown_connections 2024-09-11T23:20:47.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.323+0000 7fdfbb600640 1 -- 172.21.15.144:0/148111708 wait complete. 2024-09-11T23:20:47.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.324+0000 7fdfbb600640 1 Processor -- start 2024-09-11T23:20:47.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.325+0000 7fdfbb600640 1 -- start start 2024-09-11T23:20:47.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.325+0000 7fdfbb600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdfb406c2d0 0x7fdfb415ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.325+0000 7fdfbb600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfb40b3430 0x7fdfb40cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.325+0000 7fdfbb600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfb40d2d10 0x7fdfb4160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.325+0000 7fdfbb600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb406c740 con 0x7fdfb40d2d10 2024-09-11T23:20:47.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.325+0000 7fdfbb600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb40d27f0 con 0x7fdfb40b3430 2024-09-11T23:20:47.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.325+0000 7fdfbb600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb40d36a0 con 0x7fdfb406c2d0 2024-09-11T23:20:47.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.326+0000 7fdfb9600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfb40d2d10 0x7fdfb4160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.326+0000 7fdfb9600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfb40d2d10 0x7fdfb4160f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37820/0 (socket says 172.21.15.144:37820) 2024-09-11T23:20:47.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.326+0000 7fdfb9600640 1 -- 172.21.15.144:0/142099144 learned_addr learned my addr 172.21.15.144:0/142099144 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:47.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.326+0000 7fdfb8c00640 1 --2- 172.21.15.144:0/142099144 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdfb406c2d0 0x7fdfb415ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.326+0000 7fdfb3e00640 1 --2- 172.21.15.144:0/142099144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfb40b3430 0x7fdfb40cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.326+0000 7fdfb9600640 1 -- 172.21.15.144:0/142099144 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdfb406c2d0 msgr2=0x7fdfb415ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.326+0000 7fdfb9600640 1 --2- 172.21.15.144:0/142099144 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdfb406c2d0 0x7fdfb415ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.326+0000 7fdfb9600640 1 -- 172.21.15.144:0/142099144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfb40b3430 msgr2=0x7fdfb40cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:47.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.326+0000 7fdfb9600640 1 --2- 172.21.15.144:0/142099144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfb40b3430 0x7fdfb40cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:47.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.326+0000 7fdfb9600640 1 -- 172.21.15.144:0/142099144 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb415f2e0 con 0x7fdfb40d2d10 2024-09-11T23:20:47.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.326+0000 7fdfb9600640 1 --2- 172.21.15.144:0/142099144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfb40d2d10 0x7fdfb4160f30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdfac007d20 tx=0x7fdfac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:47.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.327+0000 7fdfb0c00640 1 -- 172.21.15.144:0/142099144 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac014420 con 0x7fdfb40d2d10 2024-09-11T23:20:47.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.327+0000 7fdfb0c00640 1 -- 172.21.15.144:0/142099144 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfac019070 con 0x7fdfb40d2d10 2024-09-11T23:20:47.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.327+0000 7fdfb0c00640 1 -- 172.21.15.144:0/142099144 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac014820 con 0x7fdfb40d2d10 2024-09-11T23:20:47.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.327+0000 7fdfbb600640 1 -- 172.21.15.144:0/142099144 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb415f5c0 con 0x7fdfb40d2d10 2024-09-11T23:20:47.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.327+0000 7fdfbb600640 1 -- 172.21.15.144:0/142099144 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb415fe60 con 0x7fdfb40d2d10 2024-09-11T23:20:47.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.328+0000 7fdfbb600640 1 -- 172.21.15.144:0/142099144 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb40b7040 con 0x7fdfb40d2d10 2024-09-11T23:20:47.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.329+0000 7fdfb0c00640 1 -- 172.21.15.144:0/142099144 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7fdfac0149c0 con 0x7fdfb40d2d10 2024-09-11T23:20:47.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.330+0000 7fdfb0c00640 1 --2- 172.21.15.144:0/142099144 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdf9406bfe0 0x7fdf9406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:47.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.330+0000 7fdfb0c00640 1 -- 172.21.15.144:0/142099144 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5853+0+0 (secure 0 0 0) 0x7fdfac08b9d0 con 0x7fdfb40d2d10 2024-09-11T23:20:47.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.330+0000 7fdfb8c00640 1 --2- 172.21.15.144:0/142099144 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdf9406bfe0 0x7fdf9406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:47.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.331+0000 7fdfb8c00640 1 --2- 172.21.15.144:0/142099144 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdf9406bfe0 0x7fdf9406e4a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8034000 tx=0x7fdfa802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:47.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.334+0000 7fdfb0c00640 1 -- 172.21.15.144:0/142099144 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdfb40b7040 con 0x7fdfb40d2d10 2024-09-11T23:20:47.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:47.543+0000 7fdfbb600640 1 -- 172.21.15.144:0/142099144 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fdfb415f790 con 0x7fdfb40d2d10 2024-09-11T23:20:48.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.146+0000 7fdfb0c00640 1 -- 172.21.15.144:0/142099144 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) ==== 104+0+0 (secure 0 0 0) 0x7fdfac0599c0 con 0x7fdfb40d2d10 2024-09-11T23:20:48.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.149+0000 7fdfbb600640 1 -- 172.21.15.144:0/142099144 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdf9406bfe0 msgr2=0x7fdf9406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.149+0000 7fdfbb600640 1 --2- 172.21.15.144:0/142099144 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdf9406bfe0 0x7fdf9406e4a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8034000 tx=0x7fdfa802e000 comp rx=0 tx=0).stop 2024-09-11T23:20:48.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.149+0000 7fdfbb600640 1 -- 172.21.15.144:0/142099144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfb40d2d10 msgr2=0x7fdfb4160f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.149+0000 7fdfbb600640 1 --2- 172.21.15.144:0/142099144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfb40d2d10 0x7fdfb4160f30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdfac007d20 tx=0x7fdfac00e4b0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.149+0000 7fdfbb600640 1 -- 172.21.15.144:0/142099144 shutdown_connections 2024-09-11T23:20:48.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.149+0000 7fdfbb600640 1 --2- 172.21.15.144:0/142099144 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fdf9406bfe0 0x7fdf9406e4a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.149+0000 7fdfbb600640 1 --2- 172.21.15.144:0/142099144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfb40d2d10 0x7fdfb4160f30 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.149+0000 7fdfbb600640 1 --2- 172.21.15.144:0/142099144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfb40b3430 0x7fdfb40cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.149+0000 7fdfbb600640 1 --2- 172.21.15.144:0/142099144 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdfb406c2d0 0x7fdfb415ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.149+0000 7fdfbb600640 1 -- 172.21.15.144:0/142099144 >> 172.21.15.144:0/142099144 conn(0x7fdfb40d4b10 msgr2=0x7fdfb40b4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:48.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.149+0000 7fdfbb600640 1 -- 172.21.15.144:0/142099144 shutdown_connections 2024-09-11T23:20:48.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.149+0000 7fdfbb600640 1 -- 172.21.15.144:0/142099144 wait complete. 2024-09-11T23:20:48.167 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:20:48.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.325+0000 7f8a46200640 1 Processor -- start 2024-09-11T23:20:48.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.325+0000 7f8a46200640 1 -- start start 2024-09-11T23:20:48.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.326+0000 7f8a46200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8a4015c450 0x7f8a400ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.326+0000 7f8a46200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a400b1ef0 0x7f8a400b2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.326+0000 7f8a46200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a400cd390 con 0x7f8a40072cc0 2024-09-11T23:20:48.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.327+0000 7f8a46200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8a400b2880 con 0x7f8a4015c450 2024-09-11T23:20:48.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.327+0000 7f8a46200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8a400cd670 con 0x7f8a400b1ef0 2024-09-11T23:20:48.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.327+0000 7f8a44e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8a4015c450 0x7f8a400ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.327+0000 7f8a37e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a400b1ef0 0x7f8a400b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.327+0000 7f8a37e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a400b1ef0 0x7f8a400b2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:57068/0 (socket says 172.21.15.144:57068) 2024-09-11T23:20:48.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.327+0000 7f8a44e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8a4015c450 0x7f8a400ce430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:37166/0 (socket says 172.21.15.144:37166) 2024-09-11T23:20:48.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.327+0000 7f8a37e00640 1 -- 172.21.15.144:0/554898889 learned_addr learned my addr 172.21.15.144:0/554898889 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:48.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.327+0000 7f8a45800640 1 --1- 172.21.15.144:0/554898889 >> v1:172.21.15.165:6789/0 conn(0x7f8a40072cc0 0x7f8a400cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:40268/0 (socket says 172.21.15.144:40268) 2024-09-11T23:20:48.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.327+0000 7f8a37e00640 1 -- 172.21.15.144:0/554898889 >> v2:172.21.15.165:3300/0 conn(0x7f8a4015c450 msgr2=0x7f8a400ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:48.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.327+0000 7f8a37e00640 1 --2- 172.21.15.144:0/554898889 >> v2:172.21.15.165:3300/0 conn(0x7f8a4015c450 0x7f8a400ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.327+0000 7f8a37e00640 1 -- 172.21.15.144:0/554898889 >> v1:172.21.15.165:6789/0 conn(0x7f8a40072cc0 legacy=0x7f8a400cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.328+0000 7f8a37e00640 1 -- 172.21.15.144:0/554898889 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a400cd950 con 0x7f8a400b1ef0 2024-09-11T23:20:48.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.328+0000 7f8a44e00640 1 --2- 172.21.15.144:0/554898889 >> v2:172.21.15.165:3300/0 conn(0x7f8a4015c450 0x7f8a400ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:20:48.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.328+0000 7f8a37e00640 1 --2- 172.21.15.144:0/554898889 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a400b1ef0 0x7f8a400b2340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009870 tx=0x7f8a2802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20f9425114fd4389 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:48.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.329+0000 7f8a3fe00640 1 -- 172.21.15.144:0/554898889 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28037070 con 0x7f8a400b1ef0 2024-09-11T23:20:48.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.329+0000 7f8a3fe00640 1 -- 172.21.15.144:0/554898889 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a28032440 con 0x7f8a400b1ef0 2024-09-11T23:20:48.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.329+0000 7f8a3fe00640 1 -- 172.21.15.144:0/554898889 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28032810 con 0x7f8a400b1ef0 2024-09-11T23:20:48.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.330+0000 7f8a46200640 1 -- 172.21.15.144:0/554898889 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a400b1ef0 msgr2=0x7f8a400b2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.330+0000 7f8a46200640 1 --2- 172.21.15.144:0/554898889 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a400b1ef0 0x7f8a400b2340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009870 tx=0x7f8a2802a250 comp rx=0 tx=0).stop 2024-09-11T23:20:48.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.330+0000 7f8a46200640 1 -- 172.21.15.144:0/554898889 shutdown_connections 2024-09-11T23:20:48.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.330+0000 7f8a46200640 1 --2- 172.21.15.144:0/554898889 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a400b1ef0 0x7f8a400b2340 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.330+0000 7f8a46200640 1 --2- 172.21.15.144:0/554898889 >> v2:172.21.15.165:3300/0 conn(0x7f8a4015c450 0x7f8a400ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.330+0000 7f8a46200640 1 -- 172.21.15.144:0/554898889 >> 172.21.15.144:0/554898889 conn(0x7f8a4006bba0 msgr2=0x7f8a4006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:48.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.330+0000 7f8a46200640 1 -- 172.21.15.144:0/554898889 shutdown_connections 2024-09-11T23:20:48.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.330+0000 7f8a46200640 1 -- 172.21.15.144:0/554898889 wait complete. 2024-09-11T23:20:48.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.331+0000 7f8a46200640 1 Processor -- start 2024-09-11T23:20:48.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.331+0000 7f8a46200640 1 -- start start 2024-09-11T23:20:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.332+0000 7f8a46200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a40072cc0 0x7f8a400cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.332+0000 7f8a46200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a400b1ef0 0x7f8a4015a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.332+0000 7f8a46200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a4015c450 0x7f8a4015aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.332+0000 7f8a46200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8a40073150 con 0x7f8a400b1ef0 2024-09-11T23:20:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.332+0000 7f8a46200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8a400cdf10 con 0x7f8a40072cc0 2024-09-11T23:20:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.332+0000 7f8a46200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8a400732d0 con 0x7f8a4015c450 2024-09-11T23:20:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.333+0000 7f8a37e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a400b1ef0 0x7f8a4015a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.333+0000 7f8a37e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a400b1ef0 0x7f8a4015a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37834/0 (socket says 172.21.15.144:37834) 2024-09-11T23:20:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.333+0000 7f8a37e00640 1 -- 172.21.15.144:0/3442082789 learned_addr learned my addr 172.21.15.144:0/3442082789 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.333+0000 7f8a44e00640 1 --2- 172.21.15.144:0/3442082789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a40072cc0 0x7f8a400cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.333+0000 7f8a45800640 1 --2- 172.21.15.144:0/3442082789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a4015c450 0x7f8a4015aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.333+0000 7f8a37e00640 1 -- 172.21.15.144:0/3442082789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a4015c450 msgr2=0x7f8a4015aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.333+0000 7f8a37e00640 1 --2- 172.21.15.144:0/3442082789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a4015c450 0x7f8a4015aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.333+0000 7f8a37e00640 1 -- 172.21.15.144:0/3442082789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a40072cc0 msgr2=0x7f8a400cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.333+0000 7f8a37e00640 1 --2- 172.21.15.144:0/3442082789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a40072cc0 0x7f8a400cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.333+0000 7f8a37e00640 1 -- 172.21.15.144:0/3442082789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4013dd80 con 0x7f8a400b1ef0 2024-09-11T23:20:48.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.333+0000 7f8a37e00640 1 --2- 172.21.15.144:0/3442082789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a400b1ef0 0x7f8a4015a980 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8a28000c00 tx=0x7f8a280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:48.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.334+0000 7f8a3d600640 1 -- 172.21.15.144:0/3442082789 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28037040 con 0x7f8a400b1ef0 2024-09-11T23:20:48.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.334+0000 7f8a3d600640 1 -- 172.21.15.144:0/3442082789 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a28042070 con 0x7f8a400b1ef0 2024-09-11T23:20:48.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.334+0000 7f8a3d600640 1 -- 172.21.15.144:0/3442082789 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28030880 con 0x7f8a400b1ef0 2024-09-11T23:20:48.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.334+0000 7f8a46200640 1 -- 172.21.15.144:0/3442082789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4013e060 con 0x7f8a400b1ef0 2024-09-11T23:20:48.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.334+0000 7f8a46200640 1 -- 172.21.15.144:0/3442082789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a4013e620 con 0x7f8a400b1ef0 2024-09-11T23:20:48.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.335+0000 7f8a46200640 1 -- 172.21.15.144:0/3442082789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a400b2340 con 0x7f8a400b1ef0 2024-09-11T23:20:48.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.336+0000 7f8a3d600640 1 -- 172.21.15.144:0/3442082789 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f8a28030a20 con 0x7f8a400b1ef0 2024-09-11T23:20:48.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.336+0000 7f8a3d600640 1 --2- 172.21.15.144:0/3442082789 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a1c06bfe0 0x7f8a1c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:48.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.336+0000 7f8a3d600640 1 -- 172.21.15.144:0/3442082789 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5853+0+0 (secure 0 0 0) 0x7f8a280ab910 con 0x7f8a400b1ef0 2024-09-11T23:20:48.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.337+0000 7f8a44e00640 1 --2- 172.21.15.144:0/3442082789 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a1c06bfe0 0x7f8a1c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:48.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.337+0000 7f8a44e00640 1 --2- 172.21.15.144:0/3442082789 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a1c06bfe0 0x7f8a1c06e4a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8a4014f340 tx=0x7f8a30009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:48.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.340+0000 7f8a3d600640 1 -- 172.21.15.144:0/3442082789 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a28079960 con 0x7f8a400b1ef0 2024-09-11T23:20:48.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:48.516+0000 7f8a46200640 1 -- 172.21.15.144:0/3442082789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8a40063210 con 0x7f8a400b1ef0 2024-09-11T23:20:49.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.391+0000 7f8a3d600640 1 -- 172.21.15.144:0/3442082789 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v50) ==== 181+0+0 (secure 0 0 0) 0x7f8a2807dc60 con 0x7f8a400b1ef0 2024-09-11T23:20:49.391 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:20:49.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.394+0000 7f8a46200640 1 -- 172.21.15.144:0/3442082789 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a1c06bfe0 msgr2=0x7f8a1c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.394+0000 7f8a46200640 1 --2- 172.21.15.144:0/3442082789 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a1c06bfe0 0x7f8a1c06e4a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8a4014f340 tx=0x7f8a30009190 comp rx=0 tx=0).stop 2024-09-11T23:20:49.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.394+0000 7f8a46200640 1 -- 172.21.15.144:0/3442082789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a400b1ef0 msgr2=0x7f8a4015a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.394+0000 7f8a46200640 1 --2- 172.21.15.144:0/3442082789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a400b1ef0 0x7f8a4015a980 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8a28000c00 tx=0x7f8a280046c0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.395+0000 7f8a46200640 1 -- 172.21.15.144:0/3442082789 shutdown_connections 2024-09-11T23:20:49.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.395+0000 7f8a46200640 1 --2- 172.21.15.144:0/3442082789 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a1c06bfe0 0x7f8a1c06e4a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.395+0000 7f8a46200640 1 --2- 172.21.15.144:0/3442082789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a4015c450 0x7f8a4015aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.395+0000 7f8a46200640 1 --2- 172.21.15.144:0/3442082789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a400b1ef0 0x7f8a4015a980 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.395+0000 7f8a46200640 1 --2- 172.21.15.144:0/3442082789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a40072cc0 0x7f8a400cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.395+0000 7f8a46200640 1 -- 172.21.15.144:0/3442082789 >> 172.21.15.144:0/3442082789 conn(0x7f8a4006bba0 msgr2=0x7f8a400b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:49.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.395+0000 7f8a46200640 1 -- 172.21.15.144:0/3442082789 shutdown_connections 2024-09-11T23:20:49.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.395+0000 7f8a46200640 1 -- 172.21.15.144:0/3442082789 wait complete. 2024-09-11T23:20:49.415 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:20:49.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.577+0000 7f2eb4600640 1 Processor -- start 2024-09-11T23:20:49.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.577+0000 7f2eb4600640 1 -- start start 2024-09-11T23:20:49.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.578+0000 7f2eb4600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2eac0d1fd0 0x7f2eac0710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.578+0000 7f2eb4600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eac06ec90 con 0x7f2eac0d1860 2024-09-11T23:20:49.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.578+0000 7f2eb4600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eac073d20 con 0x7f2eac15e5c0 2024-09-11T23:20:49.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.578+0000 7f2eb4600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2eac0d1dd0 con 0x7f2eac0d1fd0 2024-09-11T23:20:49.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.578+0000 7f2eb1200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f2eac0d1860 0x7f2eac0709d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60664/0 (socket says 172.21.15.144:60664) 2024-09-11T23:20:49.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.578+0000 7f2eb1200640 1 -- 172.21.15.144:0/2265221858 learned_addr learned my addr 172.21.15.144:0/2265221858 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:20:49.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.578+0000 7f2eb2600640 1 --2- 172.21.15.144:0/2265221858 >> v2:172.21.15.144:3300/0 conn(0x7f2eac0d1fd0 0x7f2eac0710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.579+0000 7f2eabe00640 1 -- 172.21.15.144:0/2265221858 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3612151682 0 0) 0x7f2eac06ec90 con 0x7f2eac0d1860 2024-09-11T23:20:49.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.579+0000 7f2eabe00640 1 -- 172.21.15.144:0/2265221858 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e94003520 con 0x7f2eac0d1860 2024-09-11T23:20:49.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.579+0000 7f2eb2600640 1 -- 172.21.15.144:0/2265221858 >> v1:172.21.15.165:6789/0 conn(0x7f2eac15e5c0 legacy=0x7f2eac0b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.579+0000 7f2eb2600640 1 -- 172.21.15.144:0/2265221858 >> v1:172.21.15.144:6789/0 conn(0x7f2eac0d1860 legacy=0x7f2eac0709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.579+0000 7f2eb2600640 1 -- 172.21.15.144:0/2265221858 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eac074000 con 0x7f2eac0d1fd0 2024-09-11T23:20:49.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.580+0000 7f2eb2600640 1 --2- 172.21.15.144:0/2265221858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2eac0d1fd0 0x7f2eac0710e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009d90 tx=0x7f2ea402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1969b87271f24451 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:49.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.580+0000 7f2eabe00640 1 -- 172.21.15.144:0/2265221858 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4031600 con 0x7f2eac0d1fd0 2024-09-11T23:20:49.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.580+0000 7f2eabe00640 1 -- 172.21.15.144:0/2265221858 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea40317a0 con 0x7f2eac0d1fd0 2024-09-11T23:20:49.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.580+0000 7f2eabe00640 1 -- 172.21.15.144:0/2265221858 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4031b50 con 0x7f2eac0d1fd0 2024-09-11T23:20:49.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.581+0000 7f2eb4600640 1 -- 172.21.15.144:0/2265221858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2eac0d1fd0 msgr2=0x7f2eac0710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.581+0000 7f2eb4600640 1 --2- 172.21.15.144:0/2265221858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2eac0d1fd0 0x7f2eac0710e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009d90 tx=0x7f2ea402a5d0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.581+0000 7f2eb4600640 1 -- 172.21.15.144:0/2265221858 shutdown_connections 2024-09-11T23:20:49.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.581+0000 7f2eb4600640 1 --2- 172.21.15.144:0/2265221858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2eac0d1fd0 0x7f2eac0710e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.581+0000 7f2eb4600640 1 -- 172.21.15.144:0/2265221858 >> 172.21.15.144:0/2265221858 conn(0x7f2eac0d25b0 msgr2=0x7f2eac0d2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:49.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.581+0000 7f2eb4600640 1 -- 172.21.15.144:0/2265221858 shutdown_connections 2024-09-11T23:20:49.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.581+0000 7f2eb4600640 1 -- 172.21.15.144:0/2265221858 wait complete. 2024-09-11T23:20:49.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.582+0000 7f2eb4600640 1 Processor -- start 2024-09-11T23:20:49.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.582+0000 7f2eb4600640 1 -- start start 2024-09-11T23:20:49.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.583+0000 7f2eb4600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2eac0d1860 0x7f2eac14d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.583+0000 7f2eb4600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2eac0d1fd0 0x7f2eac0ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.583+0000 7f2eb4600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2eac15e5c0 0x7f2eac0ce850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.583+0000 7f2eb4600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac0b5890 con 0x7f2eac0d1fd0 2024-09-11T23:20:49.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.583+0000 7f2eb4600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac0b5710 con 0x7f2eac0d1860 2024-09-11T23:20:49.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.583+0000 7f2eb4600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2eac15e9a0 con 0x7f2eac15e5c0 2024-09-11T23:20:49.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.584+0000 7f2eb1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2eac0d1fd0 0x7f2eac0ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.584+0000 7f2eb1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2eac0d1fd0 0x7f2eac0ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37848/0 (socket says 172.21.15.144:37848) 2024-09-11T23:20:49.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.584+0000 7f2eb1200640 1 -- 172.21.15.144:0/3319286588 learned_addr learned my addr 172.21.15.144:0/3319286588 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:49.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.584+0000 7f2eb2600640 1 --2- 172.21.15.144:0/3319286588 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2eac15e5c0 0x7f2eac0ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.584+0000 7f2eb1c00640 1 --2- 172.21.15.144:0/3319286588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2eac0d1860 0x7f2eac14d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.584+0000 7f2eb1200640 1 -- 172.21.15.144:0/3319286588 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2eac15e5c0 msgr2=0x7f2eac0ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.584+0000 7f2eb1200640 1 --2- 172.21.15.144:0/3319286588 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2eac15e5c0 0x7f2eac0ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.584+0000 7f2eb1200640 1 -- 172.21.15.144:0/3319286588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2eac0d1860 msgr2=0x7f2eac14d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:49.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.584+0000 7f2eb1200640 1 --2- 172.21.15.144:0/3319286588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2eac0d1860 0x7f2eac14d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:49.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.584+0000 7f2eb1200640 1 -- 172.21.15.144:0/3319286588 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eac0cd4f0 con 0x7f2eac0d1fd0 2024-09-11T23:20:49.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.584+0000 7f2eb1c00640 1 --2- 172.21.15.144:0/3319286588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2eac0d1860 0x7f2eac14d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:49.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.584+0000 7f2eb1200640 1 --2- 172.21.15.144:0/3319286588 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2eac0d1fd0 0x7f2eac0ccb60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800c440 tx=0x7f2e9800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:49.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.585+0000 7f2ea9600640 1 -- 172.21.15.144:0/3319286588 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98017070 con 0x7f2eac0d1fd0 2024-09-11T23:20:49.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.585+0000 7f2ea9600640 1 -- 172.21.15.144:0/3319286588 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e98005ce0 con 0x7f2eac0d1fd0 2024-09-11T23:20:49.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.585+0000 7f2ea9600640 1 -- 172.21.15.144:0/3319286588 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e980072b0 con 0x7f2eac0d1fd0 2024-09-11T23:20:49.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.585+0000 7f2eb4600640 1 -- 172.21.15.144:0/3319286588 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eac0cd0a0 con 0x7f2eac0d1fd0 2024-09-11T23:20:49.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.585+0000 7f2eb4600640 1 -- 172.21.15.144:0/3319286588 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eac0cda90 con 0x7f2eac0d1fd0 2024-09-11T23:20:49.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.586+0000 7f2eb4600640 1 -- 172.21.15.144:0/3319286588 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eac0b6d80 con 0x7f2eac0d1fd0 2024-09-11T23:20:49.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.587+0000 7f2ea9600640 1 -- 172.21.15.144:0/3319286588 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f2e9801a070 con 0x7f2eac0d1fd0 2024-09-11T23:20:49.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.587+0000 7f2ea9600640 1 --2- 172.21.15.144:0/3319286588 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2e8c06bfe0 0x7f2e8c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:49.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.588+0000 7f2ea9600640 1 -- 172.21.15.144:0/3319286588 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5415+0+0 (secure 0 0 0) 0x7f2e9808a470 con 0x7f2eac0d1fd0 2024-09-11T23:20:49.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.588+0000 7f2eb1c00640 1 --2- 172.21.15.144:0/3319286588 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2e8c06bfe0 0x7f2e8c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:49.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.588+0000 7f2eb1c00640 1 --2- 172.21.15.144:0/3319286588 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2e8c06bfe0 0x7f2e8c06e4a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0001700 tx=0x7f2ea0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:49.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.592+0000 7f2ea9600640 1 -- 172.21.15.144:0/3319286588 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e98058ce0 con 0x7f2eac0d1fd0 2024-09-11T23:20:49.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:49.768+0000 7f2eb4600640 1 -- 172.21.15.144:0/3319286588 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2eac0cd2d0 con 0x7f2eac0d1fd0 2024-09-11T23:20:50.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.393+0000 7f2ea9600640 1 -- 172.21.15.144:0/3319286588 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v51) ==== 169+0+0 (secure 0 0 0) 0x7f2e980585e0 con 0x7f2eac0d1fd0 2024-09-11T23:20:50.393 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-11T23:20:50.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.397+0000 7f2eb4600640 1 -- 172.21.15.144:0/3319286588 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2e8c06bfe0 msgr2=0x7f2e8c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:50.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.397+0000 7f2eb4600640 1 --2- 172.21.15.144:0/3319286588 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2e8c06bfe0 0x7f2e8c06e4a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0001700 tx=0x7f2ea0009040 comp rx=0 tx=0).stop 2024-09-11T23:20:50.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.397+0000 7f2eb4600640 1 -- 172.21.15.144:0/3319286588 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2eac0d1fd0 msgr2=0x7f2eac0ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:50.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.397+0000 7f2eb4600640 1 --2- 172.21.15.144:0/3319286588 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2eac0d1fd0 0x7f2eac0ccb60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2e9800c440 tx=0x7f2e9800c900 comp rx=0 tx=0).stop 2024-09-11T23:20:50.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.397+0000 7f2eb4600640 1 -- 172.21.15.144:0/3319286588 shutdown_connections 2024-09-11T23:20:50.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.397+0000 7f2eb4600640 1 --2- 172.21.15.144:0/3319286588 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2e8c06bfe0 0x7f2e8c06e4a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:50.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.397+0000 7f2eb4600640 1 --2- 172.21.15.144:0/3319286588 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2eac15e5c0 0x7f2eac0ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:50.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.397+0000 7f2eb4600640 1 --2- 172.21.15.144:0/3319286588 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2eac0d1fd0 0x7f2eac0ccb60 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:50.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.397+0000 7f2eb4600640 1 --2- 172.21.15.144:0/3319286588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2eac0d1860 0x7f2eac14d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:50.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.397+0000 7f2eb4600640 1 -- 172.21.15.144:0/3319286588 >> 172.21.15.144:0/3319286588 conn(0x7f2eac0d25b0 msgr2=0x7f2eac0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:50.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.398+0000 7f2eb4600640 1 -- 172.21.15.144:0/3319286588 shutdown_connections 2024-09-11T23:20:50.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.398+0000 7f2eb4600640 1 -- 172.21.15.144:0/3319286588 wait complete. 2024-09-11T23:20:50.418 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:20:50.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.577+0000 7f71b7200640 1 Processor -- start 2024-09-11T23:20:50.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.577+0000 7f71b7200640 1 -- start start 2024-09-11T23:20:50.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.578+0000 7f71b7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b815e6f0 0x7f71b80d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:50.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.579+0000 7f71b7200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f71b80b73c0 0x7f71b80d2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:50.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.579+0000 7f71b7200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71b80b7930 con 0x7f71b806d6e0 2024-09-11T23:20:50.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.579+0000 7f71b7200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f71b80b90a0 con 0x7f71b80b73c0 2024-09-11T23:20:50.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.579+0000 7f71b7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f71b80b9380 con 0x7f71b815e6f0 2024-09-11T23:20:50.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.579+0000 7f71b5e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f71b806d6e0 0x7f71b806dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60674/0 (socket says 172.21.15.144:60674) 2024-09-11T23:20:50.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.579+0000 7f71b5e00640 1 -- 172.21.15.144:0/1404602260 learned_addr learned my addr 172.21.15.144:0/1404602260 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:20:50.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.579+0000 7f71b6800640 1 --2- 172.21.15.144:0/1404602260 >> v2:172.21.15.144:3300/0 conn(0x7f71b80b73c0 0x7f71b80d2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:50.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.579+0000 7f71ad400640 1 --2- 172.21.15.144:0/1404602260 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b815e6f0 0x7f71b80d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:50.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.579+0000 7f71b5400640 1 -- 172.21.15.144:0/1404602260 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4266759492 0 0) 0x7f71b80b7930 con 0x7f71b806d6e0 2024-09-11T23:20:50.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.579+0000 7f71b5400640 1 -- 172.21.15.144:0/1404602260 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f719c003520 con 0x7f71b806d6e0 2024-09-11T23:20:50.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.579+0000 7f71b6800640 1 -- 172.21.15.144:0/1404602260 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b815e6f0 msgr2=0x7f71b80d1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:50.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.579+0000 7f71b6800640 1 --2- 172.21.15.144:0/1404602260 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b815e6f0 0x7f71b80d1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:50.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.579+0000 7f71b6800640 1 -- 172.21.15.144:0/1404602260 >> v1:172.21.15.144:6789/0 conn(0x7f71b806d6e0 legacy=0x7f71b806dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:50.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.579+0000 7f71b6800640 1 -- 172.21.15.144:0/1404602260 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b80d24f0 con 0x7f71b80b73c0 2024-09-11T23:20:50.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.579+0000 7f71ad400640 1 --2- 172.21.15.144:0/1404602260 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b815e6f0 0x7f71b80d1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:50.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.580+0000 7f71b6800640 1 --2- 172.21.15.144:0/1404602260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b80b73c0 0x7f71b80d2a10 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f71b00097d0 tx=0x7f71b002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a019037294014802 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:50.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.581+0000 7f71b5400640 1 -- 172.21.15.144:0/1404602260 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0037070 con 0x7f71b80b73c0 2024-09-11T23:20:50.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.581+0000 7f71b5400640 1 -- 172.21.15.144:0/1404602260 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b0032440 con 0x7f71b80b73c0 2024-09-11T23:20:50.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.581+0000 7f71b5400640 1 -- 172.21.15.144:0/1404602260 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b00327f0 con 0x7f71b80b73c0 2024-09-11T23:20:50.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.581+0000 7f71b7200640 1 -- 172.21.15.144:0/1404602260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b80b73c0 msgr2=0x7f71b80d2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:50.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.581+0000 7f71b7200640 1 --2- 172.21.15.144:0/1404602260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b80b73c0 0x7f71b80d2a10 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f71b00097d0 tx=0x7f71b002a1c0 comp rx=0 tx=0).stop 2024-09-11T23:20:50.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.581+0000 7f71b7200640 1 -- 172.21.15.144:0/1404602260 shutdown_connections 2024-09-11T23:20:50.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.581+0000 7f71b7200640 1 --2- 172.21.15.144:0/1404602260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b80b73c0 0x7f71b80d2a10 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:50.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.581+0000 7f71b7200640 1 --2- 172.21.15.144:0/1404602260 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b815e6f0 0x7f71b80d1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:50.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.581+0000 7f71b7200640 1 -- 172.21.15.144:0/1404602260 >> 172.21.15.144:0/1404602260 conn(0x7f71b80d4970 msgr2=0x7f71b80d4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:50.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.581+0000 7f71b7200640 1 -- 172.21.15.144:0/1404602260 shutdown_connections 2024-09-11T23:20:50.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.581+0000 7f71b7200640 1 -- 172.21.15.144:0/1404602260 wait complete. 2024-09-11T23:20:50.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.583+0000 7f71b7200640 1 Processor -- start 2024-09-11T23:20:50.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.583+0000 7f71b7200640 1 -- start start 2024-09-11T23:20:50.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.584+0000 7f71b7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b806d6e0 0x7f71b8156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:50.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.584+0000 7f71b7200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71b80b73c0 0x7f71b8149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:50.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.584+0000 7f71b7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b815e6f0 0x7f71b81f4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:50.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.584+0000 7f71b7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f71b80d30d0 con 0x7f71b815e6f0 2024-09-11T23:20:50.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.584+0000 7f71b7200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f71b80d2f50 con 0x7f71b80b73c0 2024-09-11T23:20:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.584+0000 7f71b7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f71b80d3250 con 0x7f71b806d6e0 2024-09-11T23:20:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.584+0000 7f71b6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b815e6f0 0x7f71b81f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.584+0000 7f71b6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b815e6f0 0x7f71b81f4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37868/0 (socket says 172.21.15.144:37868) 2024-09-11T23:20:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.584+0000 7f71b6800640 1 -- 172.21.15.144:0/2715166907 learned_addr learned my addr 172.21.15.144:0/2715166907 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.585+0000 7f71b5e00640 1 --2- 172.21.15.144:0/2715166907 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b806d6e0 0x7f71b8156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.585+0000 7f71ad400640 1 --2- 172.21.15.144:0/2715166907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71b80b73c0 0x7f71b8149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.585+0000 7f71b6800640 1 -- 172.21.15.144:0/2715166907 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b806d6e0 msgr2=0x7f71b8156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.585+0000 7f71b6800640 1 --2- 172.21.15.144:0/2715166907 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b806d6e0 0x7f71b8156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.585+0000 7f71b6800640 1 -- 172.21.15.144:0/2715166907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71b80b73c0 msgr2=0x7f71b8149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.585+0000 7f71b6800640 1 --2- 172.21.15.144:0/2715166907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71b80b73c0 0x7f71b8149030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.585+0000 7f71b6800640 1 -- 172.21.15.144:0/2715166907 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b8156ce0 con 0x7f71b815e6f0 2024-09-11T23:20:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.585+0000 7f71b5e00640 1 --2- 172.21.15.144:0/2715166907 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b806d6e0 0x7f71b8156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:50.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.585+0000 7f71b6800640 1 --2- 172.21.15.144:0/2715166907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b815e6f0 0x7f71b81f4190 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f71b00098f0 tx=0x7f71b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:50.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.585+0000 7f71aea00640 1 -- 172.21.15.144:0/2715166907 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0037040 con 0x7f71b815e6f0 2024-09-11T23:20:50.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.585+0000 7f71aea00640 1 -- 172.21.15.144:0/2715166907 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b0042070 con 0x7f71b815e6f0 2024-09-11T23:20:50.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.585+0000 7f71aea00640 1 -- 172.21.15.144:0/2715166907 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b0006e10 con 0x7f71b815e6f0 2024-09-11T23:20:50.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.585+0000 7f71b7200640 1 -- 172.21.15.144:0/2715166907 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b815ec90 con 0x7f71b815e6f0 2024-09-11T23:20:50.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.586+0000 7f71b7200640 1 -- 172.21.15.144:0/2715166907 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b815f250 con 0x7f71b815e6f0 2024-09-11T23:20:50.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.587+0000 7f71b7200640 1 -- 172.21.15.144:0/2715166907 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71b815f450 con 0x7f71b815e6f0 2024-09-11T23:20:50.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.587+0000 7f71aea00640 1 -- 172.21.15.144:0/2715166907 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f71b0032830 con 0x7f71b815e6f0 2024-09-11T23:20:50.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.588+0000 7f71aea00640 1 --2- 172.21.15.144:0/2715166907 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f719406bfe0 0x7f719406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:50.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.588+0000 7f71aea00640 1 -- 172.21.15.144:0/2715166907 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f71b00ab740 con 0x7f71b815e6f0 2024-09-11T23:20:50.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.588+0000 7f71b5e00640 1 --2- 172.21.15.144:0/2715166907 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f719406bfe0 0x7f719406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:50.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.589+0000 7f71b5e00640 1 --2- 172.21.15.144:0/2715166907 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f719406bfe0 0x7f719406e4a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f71a8005c00 tx=0x7f71a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:50.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.592+0000 7f71aea00640 1 -- 172.21.15.144:0/2715166907 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f71b815f450 con 0x7f71b815e6f0 2024-09-11T23:20:50.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.769+0000 7f71b7200640 1 -- 172.21.15.144:0/2715166907 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f71b80d2a10 con 0x7f71b815e6f0 2024-09-11T23:20:50.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.772+0000 7f71aea00640 1 -- 172.21.15.144:0/2715166907 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f71b007a1f0 con 0x7f71b815e6f0 2024-09-11T23:20:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.775+0000 7f71b7200640 1 -- 172.21.15.144:0/2715166907 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f719406bfe0 msgr2=0x7f719406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.775+0000 7f71b7200640 1 --2- 172.21.15.144:0/2715166907 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f719406bfe0 0x7f719406e4a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f71a8005c00 tx=0x7f71a8009040 comp rx=0 tx=0).stop 2024-09-11T23:20:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.775+0000 7f71b7200640 1 -- 172.21.15.144:0/2715166907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b815e6f0 msgr2=0x7f71b81f4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.775+0000 7f71b7200640 1 --2- 172.21.15.144:0/2715166907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b815e6f0 0x7f71b81f4190 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f71b00098f0 tx=0x7f71b00046c0 comp rx=0 tx=0).stop 2024-09-11T23:20:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.775+0000 7f71b7200640 1 -- 172.21.15.144:0/2715166907 shutdown_connections 2024-09-11T23:20:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.775+0000 7f71b7200640 1 --2- 172.21.15.144:0/2715166907 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f719406bfe0 0x7f719406e4a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.775+0000 7f71b7200640 1 --2- 172.21.15.144:0/2715166907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71b815e6f0 0x7f71b81f4190 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:50.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.775+0000 7f71b7200640 1 --2- 172.21.15.144:0/2715166907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f71b80b73c0 0x7f71b8149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:50.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.775+0000 7f71b7200640 1 --2- 172.21.15.144:0/2715166907 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f71b806d6e0 0x7f71b8156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:50.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.775+0000 7f71b7200640 1 -- 172.21.15.144:0/2715166907 >> 172.21.15.144:0/2715166907 conn(0x7f71b80d4970 msgr2=0x7f71b80b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:50.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.775+0000 7f71b7200640 1 -- 172.21.15.144:0/2715166907 shutdown_connections 2024-09-11T23:20:50.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.775+0000 7f71b7200640 1 -- 172.21.15.144:0/2715166907 wait complete. 2024-09-11T23:20:50.791 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2024-09-11T23:20:50.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.946+0000 7fa035e00640 1 Processor -- start 2024-09-11T23:20:50.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.946+0000 7fa035e00640 1 -- start start 2024-09-11T23:20:50.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.947+0000 7fa035e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa03015ec30 0x7fa0300d0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:50.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.947+0000 7fa035e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa030162650 0x7fa030164a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:50.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.947+0000 7fa035e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0300ccfb0 con 0x7fa030151960 2024-09-11T23:20:50.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.948+0000 7fa035e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa0300d0a40 con 0x7fa03015ec30 2024-09-11T23:20:50.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.948+0000 7fa035e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa0300cd290 con 0x7fa030162650 2024-09-11T23:20:50.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.948+0000 7fa027e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa03015ec30 0x7fa0300d0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:50.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.948+0000 7fa034a00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fa030151960 0x7fa03015e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:40278/0 (socket says 172.21.15.144:40278) 2024-09-11T23:20:50.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.948+0000 7fa034a00640 1 -- 172.21.15.144:0/2145840158 learned_addr learned my addr 172.21.15.144:0/2145840158 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:20:50.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.948+0000 7fa035400640 1 --2- 172.21.15.144:0/2145840158 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa030162650 0x7fa030164a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:50.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.949+0000 7fa02fe00640 1 -- 172.21.15.144:0/2145840158 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1925914402 0 0) 0x7fa0300ccfb0 con 0x7fa030151960 2024-09-11T23:20:50.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.949+0000 7fa02fe00640 1 -- 172.21.15.144:0/2145840158 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa014003520 con 0x7fa030151960 2024-09-11T23:20:50.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.949+0000 7fa035400640 1 -- 172.21.15.144:0/2145840158 >> v2:172.21.15.165:3300/0 conn(0x7fa03015ec30 msgr2=0x7fa0300d0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:50.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.949+0000 7fa035400640 1 --2- 172.21.15.144:0/2145840158 >> v2:172.21.15.165:3300/0 conn(0x7fa03015ec30 0x7fa0300d0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:50.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.949+0000 7fa035400640 1 -- 172.21.15.144:0/2145840158 >> v1:172.21.15.165:6789/0 conn(0x7fa030151960 legacy=0x7fa03015e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:50.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.949+0000 7fa035400640 1 -- 172.21.15.144:0/2145840158 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0300cd570 con 0x7fa030162650 2024-09-11T23:20:50.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.949+0000 7fa027e00640 1 --2- 172.21.15.144:0/2145840158 >> v2:172.21.15.165:3300/0 conn(0x7fa03015ec30 0x7fa0300d0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:20:50.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.950+0000 7fa035400640 1 --2- 172.21.15.144:0/2145840158 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa030162650 0x7fa030164a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa028009d90 tx=0x7fa02802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcda5aa113824a37 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:50.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.950+0000 7fa02fe00640 1 -- 172.21.15.144:0/2145840158 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa028007740 con 0x7fa030162650 2024-09-11T23:20:50.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.950+0000 7fa02fe00640 1 -- 172.21.15.144:0/2145840158 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0280078e0 con 0x7fa030162650 2024-09-11T23:20:50.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.950+0000 7fa02fe00640 1 -- 172.21.15.144:0/2145840158 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa028007c90 con 0x7fa030162650 2024-09-11T23:20:50.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.951+0000 7fa035e00640 1 -- 172.21.15.144:0/2145840158 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa030162650 msgr2=0x7fa030164a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:50.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.951+0000 7fa035e00640 1 --2- 172.21.15.144:0/2145840158 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa030162650 0x7fa030164a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa028009d90 tx=0x7fa02802a660 comp rx=0 tx=0).stop 2024-09-11T23:20:50.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.951+0000 7fa035e00640 1 -- 172.21.15.144:0/2145840158 shutdown_connections 2024-09-11T23:20:50.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.951+0000 7fa035e00640 1 --2- 172.21.15.144:0/2145840158 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa030162650 0x7fa030164a40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:50.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.951+0000 7fa035e00640 1 --2- 172.21.15.144:0/2145840158 >> v2:172.21.15.165:3300/0 conn(0x7fa03015ec30 0x7fa0300d0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:50.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.951+0000 7fa035e00640 1 -- 172.21.15.144:0/2145840158 >> 172.21.15.144:0/2145840158 conn(0x7fa03006e910 msgr2=0x7fa03006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:50.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.951+0000 7fa035e00640 1 -- 172.21.15.144:0/2145840158 shutdown_connections 2024-09-11T23:20:50.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.951+0000 7fa035e00640 1 -- 172.21.15.144:0/2145840158 wait complete. 2024-09-11T23:20:50.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.952+0000 7fa035e00640 1 Processor -- start 2024-09-11T23:20:50.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.952+0000 7fa035e00640 1 -- start start 2024-09-11T23:20:50.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.953+0000 7fa035e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa030151960 0x7fa030160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:50.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.953+0000 7fa035e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa03015ec30 0x7fa030073360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:50.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.953+0000 7fa035e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa030162650 0x7fa0301406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:50.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.953+0000 7fa035e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa0300cde10 con 0x7fa03015ec30 2024-09-11T23:20:50.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.953+0000 7fa035e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa0300cdb30 con 0x7fa030151960 2024-09-11T23:20:50.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.953+0000 7fa035e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa030151d40 con 0x7fa030162650 2024-09-11T23:20:50.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.954+0000 7fa027e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa03015ec30 0x7fa030073360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:50.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.954+0000 7fa027e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa03015ec30 0x7fa030073360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37884/0 (socket says 172.21.15.144:37884) 2024-09-11T23:20:50.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.954+0000 7fa027e00640 1 -- 172.21.15.144:0/97309143 learned_addr learned my addr 172.21.15.144:0/97309143 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:50.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.954+0000 7fa034a00640 1 --2- 172.21.15.144:0/97309143 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa030151960 0x7fa030160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:50.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.954+0000 7fa035400640 1 --2- 172.21.15.144:0/97309143 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa030162650 0x7fa0301406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:50.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.954+0000 7fa027e00640 1 -- 172.21.15.144:0/97309143 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa030162650 msgr2=0x7fa0301406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:50.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.954+0000 7fa027e00640 1 --2- 172.21.15.144:0/97309143 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa030162650 0x7fa0301406c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:50.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.954+0000 7fa027e00640 1 -- 172.21.15.144:0/97309143 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa030151960 msgr2=0x7fa030160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:50.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.954+0000 7fa027e00640 1 --2- 172.21.15.144:0/97309143 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa030151960 0x7fa030160fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:50.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.954+0000 7fa027e00640 1 -- 172.21.15.144:0/97309143 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0300b0160 con 0x7fa03015ec30 2024-09-11T23:20:50.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.955+0000 7fa027e00640 1 --2- 172.21.15.144:0/97309143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa03015ec30 0x7fa030073360 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa01800ec10 tx=0x7fa01800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:50.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.955+0000 7fa02d600640 1 -- 172.21.15.144:0/97309143 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa018017070 con 0x7fa03015ec30 2024-09-11T23:20:50.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.955+0000 7fa02d600640 1 -- 172.21.15.144:0/97309143 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa01800cc30 con 0x7fa03015ec30 2024-09-11T23:20:50.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.955+0000 7fa02d600640 1 -- 172.21.15.144:0/97309143 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa018013470 con 0x7fa03015ec30 2024-09-11T23:20:50.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.955+0000 7fa035e00640 1 -- 172.21.15.144:0/97309143 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0300b0440 con 0x7fa03015ec30 2024-09-11T23:20:50.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.955+0000 7fa035e00640 1 -- 172.21.15.144:0/97309143 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0300b0a00 con 0x7fa03015ec30 2024-09-11T23:20:50.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.956+0000 7fa035e00640 1 -- 172.21.15.144:0/97309143 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0300ce330 con 0x7fa03015ec30 2024-09-11T23:20:50.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.957+0000 7fa02d600640 1 -- 172.21.15.144:0/97309143 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7fa01801a070 con 0x7fa03015ec30 2024-09-11T23:20:50.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.958+0000 7fa02d600640 1 --2- 172.21.15.144:0/97309143 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa00c06bfe0 0x7fa00c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:50.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.958+0000 7fa02d600640 1 -- 172.21.15.144:0/97309143 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fa01808afe0 con 0x7fa03015ec30 2024-09-11T23:20:50.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.958+0000 7fa034a00640 1 --2- 172.21.15.144:0/97309143 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa00c06bfe0 0x7fa00c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:50.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.958+0000 7fa034a00640 1 --2- 172.21.15.144:0/97309143 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa00c06bfe0 0x7fa00c06e4a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa020005880 tx=0x7fa020009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:50.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:50.962+0000 7fa02d600640 1 -- 172.21.15.144:0/97309143 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa0180594a0 con 0x7fa03015ec30 2024-09-11T23:20:51.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.198+0000 7fa035e00640 1 -- 172.21.15.144:0/97309143 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) -- 0x7fa03006bdf0 con 0x7fa03015ec30 2024-09-11T23:20:51.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.401+0000 7fa02d600640 1 -- 172.21.15.144:0/97309143 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v160) ==== 140+0+0 (secure 0 0 0) 0x7fa01805d7a0 con 0x7fa03015ec30 2024-09-11T23:20:51.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.404+0000 7fa035e00640 1 -- 172.21.15.144:0/97309143 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa00c06bfe0 msgr2=0x7fa00c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:51.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.404+0000 7fa035e00640 1 --2- 172.21.15.144:0/97309143 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa00c06bfe0 0x7fa00c06e4a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa020005880 tx=0x7fa020009040 comp rx=0 tx=0).stop 2024-09-11T23:20:51.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.404+0000 7fa035e00640 1 -- 172.21.15.144:0/97309143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa03015ec30 msgr2=0x7fa030073360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:51.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.404+0000 7fa035e00640 1 --2- 172.21.15.144:0/97309143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa03015ec30 0x7fa030073360 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa01800ec10 tx=0x7fa01800c520 comp rx=0 tx=0).stop 2024-09-11T23:20:51.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.404+0000 7fa035e00640 1 -- 172.21.15.144:0/97309143 shutdown_connections 2024-09-11T23:20:51.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.404+0000 7fa035e00640 1 --2- 172.21.15.144:0/97309143 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa00c06bfe0 0x7fa00c06e4a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:51.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.404+0000 7fa035e00640 1 --2- 172.21.15.144:0/97309143 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa030162650 0x7fa0301406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:51.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.404+0000 7fa035e00640 1 --2- 172.21.15.144:0/97309143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa03015ec30 0x7fa030073360 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:51.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.404+0000 7fa035e00640 1 --2- 172.21.15.144:0/97309143 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa030151960 0x7fa030160fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:51.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.404+0000 7fa035e00640 1 -- 172.21.15.144:0/97309143 >> 172.21.15.144:0/97309143 conn(0x7fa03006e910 msgr2=0x7fa03006d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:51.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.404+0000 7fa035e00640 1 -- 172.21.15.144:0/97309143 shutdown_connections 2024-09-11T23:20:51.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.404+0000 7fa035e00640 1 -- 172.21.15.144:0/97309143 wait complete. 2024-09-11T23:20:51.419 INFO:tasks.cephfs_test_runner:test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) ... ok 2024-09-11T23:20:51.420 INFO:tasks.cephfs_test_runner:Starting test: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate handcrafted .meta file on legacy subvol root doesn't break the system 2024-09-11T23:20:51.420 INFO:tasks.cephfs_test_runner:test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2024-09-11T23:20:51.420 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:20:51.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.573+0000 7f72e3c00640 1 Processor -- start 2024-09-11T23:20:51.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.573+0000 7f72e3c00640 1 -- start start 2024-09-11T23:20:51.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.574+0000 7f72e3c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f72dc0d02a0 0x7f72dc0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:51.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.574+0000 7f72e3c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72dc15ca40 0x7f72dc15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:51.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.574+0000 7f72e3c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72dc0d0bc0 con 0x7f72dc15ce80 2024-09-11T23:20:51.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.574+0000 7f72e3c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f72dc15d390 con 0x7f72dc0d02a0 2024-09-11T23:20:51.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.574+0000 7f72e3c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f72dc15d670 con 0x7f72dc15ca40 2024-09-11T23:20:51.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.575+0000 7f72e1200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f72dc0d02a0 0x7f72dc0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:51.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.575+0000 7f72e1c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f72dc15ce80 0x7f72dc1594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60676/0 (socket says 172.21.15.144:60676) 2024-09-11T23:20:51.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.575+0000 7f72e1c00640 1 -- 172.21.15.144:0/2033339262 learned_addr learned my addr 172.21.15.144:0/2033339262 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:20:51.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.575+0000 7f72d3e00640 1 --2- 172.21.15.144:0/2033339262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72dc15ca40 0x7f72dc15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:51.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.575+0000 7f72e1200640 1 -- 172.21.15.144:0/2033339262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72dc15ca40 msgr2=0x7f72dc15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:51.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.575+0000 7f72e1200640 1 --2- 172.21.15.144:0/2033339262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72dc15ca40 0x7f72dc15e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:51.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.575+0000 7f72e1200640 1 -- 172.21.15.144:0/2033339262 >> v1:172.21.15.144:6789/0 conn(0x7f72dc15ce80 legacy=0x7f72dc1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:51.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.575+0000 7f72e1200640 1 -- 172.21.15.144:0/2033339262 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc15d950 con 0x7f72dc0d02a0 2024-09-11T23:20:51.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.575+0000 7f72dbe00640 1 -- 172.21.15.144:0/2033339262 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 722897328 0 0) 0x7f72dc0d0bc0 con 0x7f72dc15ce80 2024-09-11T23:20:51.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.576+0000 7f72e1200640 1 --2- 172.21.15.144:0/2033339262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72dc0d02a0 0x7f72dc0d0680 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0097a0 tx=0x7f72cc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23195071197bbaf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:51.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.576+0000 7f72dbe00640 1 -- 172.21.15.144:0/2033339262 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc037070 con 0x7f72dc0d02a0 2024-09-11T23:20:51.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.577+0000 7f72dbe00640 1 -- 172.21.15.144:0/2033339262 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72cc02ae50 con 0x7f72dc0d02a0 2024-09-11T23:20:51.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.577+0000 7f72dbe00640 1 -- 172.21.15.144:0/2033339262 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc032660 con 0x7f72dc0d02a0 2024-09-11T23:20:51.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.577+0000 7f72e3c00640 1 -- 172.21.15.144:0/2033339262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72dc0d02a0 msgr2=0x7f72dc0d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:51.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.577+0000 7f72e3c00640 1 --2- 172.21.15.144:0/2033339262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72dc0d02a0 0x7f72dc0d0680 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0097a0 tx=0x7f72cc02a100 comp rx=0 tx=0).stop 2024-09-11T23:20:51.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.577+0000 7f72e3c00640 1 -- 172.21.15.144:0/2033339262 shutdown_connections 2024-09-11T23:20:51.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.577+0000 7f72e3c00640 1 --2- 172.21.15.144:0/2033339262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72dc15ca40 0x7f72dc15e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:51.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.577+0000 7f72e3c00640 1 --2- 172.21.15.144:0/2033339262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72dc0d02a0 0x7f72dc0d0680 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:51.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.577+0000 7f72e3c00640 1 -- 172.21.15.144:0/2033339262 >> 172.21.15.144:0/2033339262 conn(0x7f72dc062cc0 msgr2=0x7f72dc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:51.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.577+0000 7f72e3c00640 1 -- 172.21.15.144:0/2033339262 shutdown_connections 2024-09-11T23:20:51.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.577+0000 7f72e3c00640 1 -- 172.21.15.144:0/2033339262 wait complete. 2024-09-11T23:20:51.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.579+0000 7f72e3c00640 1 Processor -- start 2024-09-11T23:20:51.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.579+0000 7f72e3c00640 1 -- start start 2024-09-11T23:20:51.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.580+0000 7f72e3c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72dc0d02a0 0x7f72dc14a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:51.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.580+0000 7f72e3c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72dc15ca40 0x7f72dc147a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:51.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.580+0000 7f72e3c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72dc15ce80 0x7f72dc073490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:51.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.580+0000 7f72e3c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc155b90 con 0x7f72dc15ca40 2024-09-11T23:20:51.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.580+0000 7f72e3c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc15df10 con 0x7f72dc0d02a0 2024-09-11T23:20:51.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.580+0000 7f72e3c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f72dc155d10 con 0x7f72dc15ce80 2024-09-11T23:20:51.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.580+0000 7f72d3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72dc15ca40 0x7f72dc147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:51.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.580+0000 7f72d3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72dc15ca40 0x7f72dc147a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37892/0 (socket says 172.21.15.144:37892) 2024-09-11T23:20:51.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.580+0000 7f72d3e00640 1 -- 172.21.15.144:0/1993949558 learned_addr learned my addr 172.21.15.144:0/1993949558 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:51.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.580+0000 7f72e1200640 1 --2- 172.21.15.144:0/1993949558 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72dc0d02a0 0x7f72dc14a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:51.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.580+0000 7f72d3e00640 1 -- 172.21.15.144:0/1993949558 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72dc15ce80 msgr2=0x7f72dc073490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:51.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.580+0000 7f72e1c00640 1 --2- 172.21.15.144:0/1993949558 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72dc15ce80 0x7f72dc073490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:51.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.580+0000 7f72d3e00640 1 --2- 172.21.15.144:0/1993949558 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72dc15ce80 0x7f72dc073490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:51.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.580+0000 7f72d3e00640 1 -- 172.21.15.144:0/1993949558 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72dc0d02a0 msgr2=0x7f72dc14a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:51.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.580+0000 7f72d3e00640 1 --2- 172.21.15.144:0/1993949558 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72dc0d02a0 0x7f72dc14a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:51.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.580+0000 7f72d3e00640 1 -- 172.21.15.144:0/1993949558 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc148190 con 0x7f72dc15ca40 2024-09-11T23:20:51.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.580+0000 7f72e1200640 1 --2- 172.21.15.144:0/1993949558 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72dc0d02a0 0x7f72dc14a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:51.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.581+0000 7f72e1c00640 1 --2- 172.21.15.144:0/1993949558 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72dc15ce80 0x7f72dc073490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:51.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.581+0000 7f72d3e00640 1 --2- 172.21.15.144:0/1993949558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72dc15ca40 0x7f72dc147a60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f72c400d620 tx=0x7f72c400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:51.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.581+0000 7f72d9600640 1 -- 172.21.15.144:0/1993949558 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c400b620 con 0x7f72dc15ca40 2024-09-11T23:20:51.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.581+0000 7f72d9600640 1 -- 172.21.15.144:0/1993949558 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c4019070 con 0x7f72dc15ca40 2024-09-11T23:20:51.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.581+0000 7f72d9600640 1 -- 172.21.15.144:0/1993949558 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c400ba00 con 0x7f72dc15ca40 2024-09-11T23:20:51.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.581+0000 7f72e3c00640 1 -- 172.21.15.144:0/1993949558 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72dc0b01c0 con 0x7f72dc15ca40 2024-09-11T23:20:51.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.581+0000 7f72e3c00640 1 -- 172.21.15.144:0/1993949558 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72dc0b26a0 con 0x7f72dc15ca40 2024-09-11T23:20:51.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.582+0000 7f72e3c00640 1 -- 172.21.15.144:0/1993949558 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72dc0affb0 con 0x7f72dc15ca40 2024-09-11T23:20:51.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.583+0000 7f72d9600640 1 -- 172.21.15.144:0/1993949558 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f72c400bba0 con 0x7f72dc15ca40 2024-09-11T23:20:51.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.584+0000 7f72d9600640 1 --2- 172.21.15.144:0/1993949558 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f72b806bfe0 0x7f72b806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:51.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.584+0000 7f72d9600640 1 -- 172.21.15.144:0/1993949558 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f72c408b280 con 0x7f72dc15ca40 2024-09-11T23:20:51.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.584+0000 7f72e1200640 1 --2- 172.21.15.144:0/1993949558 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f72b806bfe0 0x7f72b806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:51.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.585+0000 7f72e1200640 1 --2- 172.21.15.144:0/1993949558 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f72b806bfe0 0x7f72b806e4a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f72cc034000 tx=0x7f72cc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:51.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.588+0000 7f72d9600640 1 -- 172.21.15.144:0/1993949558 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72c4059ca0 con 0x7f72dc15ca40 2024-09-11T23:20:51.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.765+0000 7f72e3c00640 1 -- 172.21.15.144:0/1993949558 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72dc0b4790 con 0x7f72dc15ca40 2024-09-11T23:20:51.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.766+0000 7f72d9600640 1 -- 172.21.15.144:0/1993949558 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+13058 (secure 0 0 0) 0x7f72c40595a0 con 0x7f72dc15ca40 2024-09-11T23:20:51.766 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:20:51.766 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":51,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:20:50.391696+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6837/1940447658":"2024-09-12T23:20:47.139090+0000","172.21.15.144:6834/1940447658":"2024-09-12T23:20:47.139090+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:20:51.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.769+0000 7f72e3c00640 1 -- 172.21.15.144:0/1993949558 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f72b806bfe0 msgr2=0x7f72b806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:51.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.769+0000 7f72e3c00640 1 --2- 172.21.15.144:0/1993949558 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f72b806bfe0 0x7f72b806e4a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f72cc034000 tx=0x7f72cc02e000 comp rx=0 tx=0).stop 2024-09-11T23:20:51.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.769+0000 7f72e3c00640 1 -- 172.21.15.144:0/1993949558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72dc15ca40 msgr2=0x7f72dc147a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:51.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.769+0000 7f72e3c00640 1 --2- 172.21.15.144:0/1993949558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72dc15ca40 0x7f72dc147a60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f72c400d620 tx=0x7f72c400dae0 comp rx=0 tx=0).stop 2024-09-11T23:20:51.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.769+0000 7f72e3c00640 1 -- 172.21.15.144:0/1993949558 shutdown_connections 2024-09-11T23:20:51.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.769+0000 7f72e3c00640 1 --2- 172.21.15.144:0/1993949558 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f72b806bfe0 0x7f72b806e4a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:51.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.769+0000 7f72e3c00640 1 --2- 172.21.15.144:0/1993949558 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72dc15ce80 0x7f72dc073490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:51.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.769+0000 7f72e3c00640 1 --2- 172.21.15.144:0/1993949558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72dc15ca40 0x7f72dc147a60 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:51.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.769+0000 7f72e3c00640 1 --2- 172.21.15.144:0/1993949558 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72dc0d02a0 0x7f72dc14a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:51.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.769+0000 7f72e3c00640 1 -- 172.21.15.144:0/1993949558 >> 172.21.15.144:0/1993949558 conn(0x7f72dc062cc0 msgr2=0x7f72dc15ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:51.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.769+0000 7f72e3c00640 1 -- 172.21.15.144:0/1993949558 shutdown_connections 2024-09-11T23:20:51.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.769+0000 7f72e3c00640 1 -- 172.21.15.144:0/1993949558 wait complete. 2024-09-11T23:20:51.785 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:17:47.307937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:20:51.785 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:20:51.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.940+0000 7fb8c3e00640 1 Processor -- start 2024-09-11T23:20:51.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.940+0000 7fb8c3e00640 1 -- start start 2024-09-11T23:20:51.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.941+0000 7fb8c3e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8bc15d3b0 0x7fb8bc071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:51.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.941+0000 7fb8c3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb8bc15d790 0x7fb8bc0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:51.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.941+0000 7fb8c3e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8bc0715c0 con 0x7fb8bc0cd3b0 2024-09-11T23:20:51.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.941+0000 7fb8c3e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb8bc06da30 con 0x7fb8bc15d790 2024-09-11T23:20:51.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.941+0000 7fb8c3e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb8bc06d700 con 0x7fb8bc15d3b0 2024-09-11T23:20:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.942+0000 7fb8c0a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb8bc15d790 0x7fb8bc0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:51.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.942+0000 7fb8c1e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb8bc0cd3b0 0x7fb8bc0cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60692/0 (socket says 172.21.15.144:60692) 2024-09-11T23:20:51.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.942+0000 7fb8c1e00640 1 -- 172.21.15.144:0/771625507 learned_addr learned my addr 172.21.15.144:0/771625507 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:20:51.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.942+0000 7fb8c1400640 1 --2- 172.21.15.144:0/771625507 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8bc15d3b0 0x7fb8bc071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:51.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.942+0000 7fb8c0a00640 1 -- 172.21.15.144:0/771625507 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8bc15d3b0 msgr2=0x7fb8bc071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:51.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.942+0000 7fb8c0a00640 1 --2- 172.21.15.144:0/771625507 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8bc15d3b0 0x7fb8bc071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:51.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.942+0000 7fb8c0a00640 1 -- 172.21.15.144:0/771625507 >> v1:172.21.15.144:6789/0 conn(0x7fb8bc0cd3b0 legacy=0x7fb8bc0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:51.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.942+0000 7fb8c0a00640 1 -- 172.21.15.144:0/771625507 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8bc0cde80 con 0x7fb8bc15d790 2024-09-11T23:20:51.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.942+0000 7fb8bbe00640 1 -- 172.21.15.144:0/771625507 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4108207254 0 0) 0x7fb8bc0715c0 con 0x7fb8bc0cd3b0 2024-09-11T23:20:51.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.943+0000 7fb8c0a00640 1 --2- 172.21.15.144:0/771625507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8bc15d790 0x7fb8bc0cce70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009790 tx=0x7fb8a802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e505c298a64206a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:51.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.943+0000 7fb8bbe00640 1 -- 172.21.15.144:0/771625507 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8037070 con 0x7fb8bc15d790 2024-09-11T23:20:51.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.944+0000 7fb8bbe00640 1 -- 172.21.15.144:0/771625507 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8a8032440 con 0x7fb8bc15d790 2024-09-11T23:20:51.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.944+0000 7fb8bbe00640 1 -- 172.21.15.144:0/771625507 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8032810 con 0x7fb8bc15d790 2024-09-11T23:20:51.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.944+0000 7fb8c3e00640 1 -- 172.21.15.144:0/771625507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8bc15d790 msgr2=0x7fb8bc0cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:51.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.944+0000 7fb8c3e00640 1 --2- 172.21.15.144:0/771625507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8bc15d790 0x7fb8bc0cce70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009790 tx=0x7fb8a802a180 comp rx=0 tx=0).stop 2024-09-11T23:20:51.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.944+0000 7fb8c3e00640 1 -- 172.21.15.144:0/771625507 shutdown_connections 2024-09-11T23:20:51.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.944+0000 7fb8c3e00640 1 --2- 172.21.15.144:0/771625507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8bc15d790 0x7fb8bc0cce70 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:51.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.944+0000 7fb8c3e00640 1 --2- 172.21.15.144:0/771625507 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8bc15d3b0 0x7fb8bc071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:51.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.944+0000 7fb8c3e00640 1 -- 172.21.15.144:0/771625507 >> 172.21.15.144:0/771625507 conn(0x7fb8bc06bba0 msgr2=0x7fb8bc06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:51.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.944+0000 7fb8c3e00640 1 -- 172.21.15.144:0/771625507 shutdown_connections 2024-09-11T23:20:51.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.944+0000 7fb8c3e00640 1 -- 172.21.15.144:0/771625507 wait complete. 2024-09-11T23:20:51.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.946+0000 7fb8c3e00640 1 Processor -- start 2024-09-11T23:20:51.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.946+0000 7fb8c3e00640 1 -- start start 2024-09-11T23:20:51.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.947+0000 7fb8c3e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8bc0cd3b0 0x7fb8bc142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:51.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.947+0000 7fb8c3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8bc15d3b0 0x7fb8bc0aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:51.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.947+0000 7fb8c3e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8bc159bd0 0x7fb8bc0aaa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:51.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.947+0000 7fb8c3e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc15cbf0 con 0x7fb8bc15d3b0 2024-09-11T23:20:51.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.947+0000 7fb8c3e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc0cdba0 con 0x7fb8bc159bd0 2024-09-11T23:20:51.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.947+0000 7fb8c3e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb8bc15cd70 con 0x7fb8bc0cd3b0 2024-09-11T23:20:51.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.947+0000 7fb8c0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8bc15d3b0 0x7fb8bc0aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:51.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.947+0000 7fb8c0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8bc15d3b0 0x7fb8bc0aa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37910/0 (socket says 172.21.15.144:37910) 2024-09-11T23:20:51.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.947+0000 7fb8c0a00640 1 -- 172.21.15.144:0/112988264 learned_addr learned my addr 172.21.15.144:0/112988264 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:51.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.947+0000 7fb8c1400640 1 --2- 172.21.15.144:0/112988264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8bc0cd3b0 0x7fb8bc142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:51.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.947+0000 7fb8c1e00640 1 --2- 172.21.15.144:0/112988264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8bc159bd0 0x7fb8bc0aaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:51.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.948+0000 7fb8c0a00640 1 -- 172.21.15.144:0/112988264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8bc0cd3b0 msgr2=0x7fb8bc142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:51.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.948+0000 7fb8c0a00640 1 --2- 172.21.15.144:0/112988264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8bc0cd3b0 0x7fb8bc142400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:51.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.948+0000 7fb8c0a00640 1 -- 172.21.15.144:0/112988264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8bc159bd0 msgr2=0x7fb8bc0aaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:51.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.948+0000 7fb8c0a00640 1 --2- 172.21.15.144:0/112988264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8bc159bd0 0x7fb8bc0aaa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:51.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.948+0000 7fb8c0a00640 1 -- 172.21.15.144:0/112988264 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8bc142f40 con 0x7fb8bc15d3b0 2024-09-11T23:20:51.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.948+0000 7fb8c0a00640 1 --2- 172.21.15.144:0/112988264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8bc15d3b0 0x7fb8bc0aa4d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80098b0 tx=0x7fb8a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:51.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.948+0000 7fb8b9600640 1 -- 172.21.15.144:0/112988264 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8037040 con 0x7fb8bc15d3b0 2024-09-11T23:20:51.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.948+0000 7fb8b9600640 1 -- 172.21.15.144:0/112988264 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8a8005b90 con 0x7fb8bc15d3b0 2024-09-11T23:20:51.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.948+0000 7fb8c3e00640 1 -- 172.21.15.144:0/112988264 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8bc143220 con 0x7fb8bc15d3b0 2024-09-11T23:20:51.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.948+0000 7fb8b9600640 1 -- 172.21.15.144:0/112988264 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8030770 con 0x7fb8bc15d3b0 2024-09-11T23:20:51.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.948+0000 7fb8c3e00640 1 -- 172.21.15.144:0/112988264 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8bc142940 con 0x7fb8bc15d3b0 2024-09-11T23:20:51.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.949+0000 7fb8c3e00640 1 -- 172.21.15.144:0/112988264 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8bc0cfba0 con 0x7fb8bc15d3b0 2024-09-11T23:20:51.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.950+0000 7fb8b9600640 1 -- 172.21.15.144:0/112988264 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7fb8a8030910 con 0x7fb8bc15d3b0 2024-09-11T23:20:51.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.951+0000 7fb8b9600640 1 --2- 172.21.15.144:0/112988264 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb89c06bfe0 0x7fb89c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:51.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.951+0000 7fb8b9600640 1 -- 172.21.15.144:0/112988264 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fb8a80ab760 con 0x7fb8bc15d3b0 2024-09-11T23:20:51.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.952+0000 7fb8c1400640 1 --2- 172.21.15.144:0/112988264 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb89c06bfe0 0x7fb89c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:51.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.952+0000 7fb8c1400640 1 --2- 172.21.15.144:0/112988264 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb89c06bfe0 0x7fb89c06e4a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0006fd0 tx=0x7fb8b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:51.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:51.955+0000 7fb8b9600640 1 -- 172.21.15.144:0/112988264 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb8a8032e20 con 0x7fb8bc15d3b0 2024-09-11T23:20:52.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.129+0000 7fb8c3e00640 1 -- 172.21.15.144:0/112988264 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb8bc153710 con 0x7fb8bc15d3b0 2024-09-11T23:20:52.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.130+0000 7fb8b9600640 1 -- 172.21.15.144:0/112988264 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) ==== 93+0+10 (secure 0 0 0) 0x7fb8a8079b30 con 0x7fb8bc15d3b0 2024-09-11T23:20:52.130 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-11T23:20:52.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.132+0000 7fb8c3e00640 1 -- 172.21.15.144:0/112988264 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb89c06bfe0 msgr2=0x7fb89c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:52.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.132+0000 7fb8c3e00640 1 --2- 172.21.15.144:0/112988264 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb89c06bfe0 0x7fb89c06e4a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0006fd0 tx=0x7fb8b0008040 comp rx=0 tx=0).stop 2024-09-11T23:20:52.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.132+0000 7fb8c3e00640 1 -- 172.21.15.144:0/112988264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8bc15d3b0 msgr2=0x7fb8bc0aa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:52.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.132+0000 7fb8c3e00640 1 --2- 172.21.15.144:0/112988264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8bc15d3b0 0x7fb8bc0aa4d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80098b0 tx=0x7fb8a80046c0 comp rx=0 tx=0).stop 2024-09-11T23:20:52.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.132+0000 7fb8c3e00640 1 -- 172.21.15.144:0/112988264 shutdown_connections 2024-09-11T23:20:52.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.132+0000 7fb8c3e00640 1 --2- 172.21.15.144:0/112988264 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb89c06bfe0 0x7fb89c06e4a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:52.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.132+0000 7fb8c3e00640 1 --2- 172.21.15.144:0/112988264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8bc159bd0 0x7fb8bc0aaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:52.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.132+0000 7fb8c3e00640 1 --2- 172.21.15.144:0/112988264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8bc15d3b0 0x7fb8bc0aa4d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:52.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.132+0000 7fb8c3e00640 1 --2- 172.21.15.144:0/112988264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8bc0cd3b0 0x7fb8bc142400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:52.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.132+0000 7fb8c3e00640 1 -- 172.21.15.144:0/112988264 >> 172.21.15.144:0/112988264 conn(0x7fb8bc06bba0 msgr2=0x7fb8bc06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:52.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.132+0000 7fb8c3e00640 1 -- 172.21.15.144:0/112988264 shutdown_connections 2024-09-11T23:20:52.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.132+0000 7fb8c3e00640 1 -- 172.21.15.144:0/112988264 wait complete. 2024-09-11T23:20:52.148 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2024-09-11T23:20:52.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.300+0000 7f5a08800640 1 Processor -- start 2024-09-11T23:20:52.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.301+0000 7f5a08800640 1 -- start start 2024-09-11T23:20:52.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.302+0000 7f5a08800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5a00073830 0x7f5a000cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:52.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.302+0000 7f5a08800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a000ce740 con 0x7f5a0015c180 2024-09-11T23:20:52.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.302+0000 7f5a08800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a00072640 con 0x7f5a000cf070 2024-09-11T23:20:52.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.302+0000 7f5a08800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5a00072920 con 0x7f5a00073830 2024-09-11T23:20:52.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.302+0000 7f5a05e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5a0015c180 0x7f5a000cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60694/0 (socket says 172.21.15.144:60694) 2024-09-11T23:20:52.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.302+0000 7f5a05e00640 1 -- 172.21.15.144:0/1611602940 learned_addr learned my addr 172.21.15.144:0/1611602940 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:20:52.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.302+0000 7f5a06800640 1 --2- 172.21.15.144:0/1611602940 >> v2:172.21.15.165:3300/0 conn(0x7f5a00073830 0x7f5a000cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:52.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.302+0000 7f5a04a00640 1 -- 172.21.15.144:0/1611602940 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 388868037 0 0) 0x7f5a000ce740 con 0x7f5a0015c180 2024-09-11T23:20:52.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.303+0000 7f5a04a00640 1 -- 172.21.15.144:0/1611602940 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59e8003520 con 0x7f5a0015c180 2024-09-11T23:20:52.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.303+0000 7f5a04a00640 1 -- 172.21.15.144:0/1611602940 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2015455017 0 0) 0x7f59e8003520 con 0x7f5a0015c180 2024-09-11T23:20:52.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.303+0000 7f5a04a00640 1 -- 172.21.15.144:0/1611602940 >> v2:172.21.15.165:3300/0 conn(0x7f5a00073830 msgr2=0x7f5a000cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:52.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.303+0000 7f5a04a00640 1 --2- 172.21.15.144:0/1611602940 >> v2:172.21.15.165:3300/0 conn(0x7f5a00073830 0x7f5a000cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:52.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.303+0000 7f5a04a00640 1 -- 172.21.15.144:0/1611602940 >> v1:172.21.15.165:6789/0 conn(0x7f5a000cf070 legacy=0x7f5a00073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:52.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.303+0000 7f5a04a00640 1 -- 172.21.15.144:0/1611602940 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a00072c00 con 0x7f5a0015c180 2024-09-11T23:20:52.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.303+0000 7f5a04a00640 1 -- 172.21.15.144:0/1611602940 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f59f4001670 con 0x7f5a0015c180 2024-09-11T23:20:52.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.303+0000 7f5a04a00640 1 -- 172.21.15.144:0/1611602940 >> v1:172.21.15.144:6789/0 conn(0x7f5a0015c180 legacy=0x7f5a000cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:52.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.303+0000 7f5a04a00640 1 --2- 172.21.15.144:0/1611602940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e80039b0 0x7f59e8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:52.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.303+0000 7f5a04a00640 1 --2- 172.21.15.144:0/1611602940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59e80043b0 0x7f59e8004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:52.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.303+0000 7f5a04a00640 1 --2- 172.21.15.144:0/1611602940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59e8005120 0x7f59e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:52.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.303+0000 7f5a04a00640 1 -- 172.21.15.144:0/1611602940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5a00072920 con 0x7f59e80039b0 2024-09-11T23:20:52.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.303+0000 7f5a04a00640 1 -- 172.21.15.144:0/1611602940 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f59e800c060 con 0x7f59e8005120 2024-09-11T23:20:52.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.303+0000 7f5a04a00640 1 -- 172.21.15.144:0/1611602940 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f59e800c260 con 0x7f59e80043b0 2024-09-11T23:20:52.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.303+0000 7f5a06800640 1 --2- 172.21.15.144:0/1611602940 >> v2:172.21.15.165:3300/0 conn(0x7f5a00073830 0x7f5a000cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:20:52.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.303+0000 7f5a05e00640 1 --2- 172.21.15.144:0/1611602940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e80039b0 0x7f59e8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:52.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.303+0000 7f5a05400640 1 --2- 172.21.15.144:0/1611602940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59e80043b0 0x7f59e8004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:52.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.304+0000 7f5a06800640 1 --2- 172.21.15.144:0/1611602940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59e8005120 0x7f59e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:52.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.304+0000 7f5a05e00640 1 -- 172.21.15.144:0/1611602940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59e80043b0 msgr2=0x7f59e8004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:52.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.304+0000 7f5a05e00640 1 --2- 172.21.15.144:0/1611602940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59e80043b0 0x7f59e8004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:52.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.304+0000 7f5a05e00640 1 -- 172.21.15.144:0/1611602940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59e8005120 msgr2=0x7f59e800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:52.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.304+0000 7f5a05e00640 1 --2- 172.21.15.144:0/1611602940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59e8005120 0x7f59e800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:52.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.304+0000 7f5a05e00640 1 -- 172.21.15.144:0/1611602940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e8003520 con 0x7f59e80039b0 2024-09-11T23:20:52.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.304+0000 7f5a06800640 1 -- 172.21.15.144:0/1611602940 reap_dead start 2024-09-11T23:20:52.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.305+0000 7f5a05e00640 1 --2- 172.21.15.144:0/1611602940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e80039b0 0x7f59e8003d90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f59f400c240 tx=0x7f59e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a080cfa94f8233ad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:52.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.305+0000 7f5a04a00640 1 -- 172.21.15.144:0/1611602940 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f4007d10 con 0x7f59e80039b0 2024-09-11T23:20:52.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.305+0000 7f5a04a00640 1 -- 172.21.15.144:0/1611602940 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f40058d0 con 0x7f59e80039b0 2024-09-11T23:20:52.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.305+0000 7f5a04a00640 1 -- 172.21.15.144:0/1611602940 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f4005d20 con 0x7f59e80039b0 2024-09-11T23:20:52.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.305+0000 7f5a08800640 1 -- 172.21.15.144:0/1611602940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e80039b0 msgr2=0x7f59e8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:52.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.305+0000 7f5a08800640 1 --2- 172.21.15.144:0/1611602940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e80039b0 0x7f59e8003d90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f59f400c240 tx=0x7f59e8005830 comp rx=0 tx=0).stop 2024-09-11T23:20:52.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.305+0000 7f5a08800640 1 -- 172.21.15.144:0/1611602940 shutdown_connections 2024-09-11T23:20:52.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.305+0000 7f5a08800640 1 --2- 172.21.15.144:0/1611602940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e80039b0 0x7f59e8003d90 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:52.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.305+0000 7f5a08800640 1 -- 172.21.15.144:0/1611602940 >> 172.21.15.144:0/1611602940 conn(0x7f5a00062cc0 msgr2=0x7f5a0006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:52.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.305+0000 7f5a08800640 1 -- 172.21.15.144:0/1611602940 shutdown_connections 2024-09-11T23:20:52.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.306+0000 7f5a08800640 1 -- 172.21.15.144:0/1611602940 wait complete. 2024-09-11T23:20:52.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.307+0000 7f5a08800640 1 Processor -- start 2024-09-11T23:20:52.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.307+0000 7f5a08800640 1 -- start start 2024-09-11T23:20:52.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.308+0000 7f5a08800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e80039b0 0x7f5a0014cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:52.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.308+0000 7f5a08800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a000c52b0 0x7f5a000b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:52.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.308+0000 7f5a08800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a000b5190 0x7f5a0014d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:52.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.308+0000 7f5a08800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0015c560 con 0x7f59e80039b0 2024-09-11T23:20:52.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.308+0000 7f5a08800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5a000722f0 con 0x7f5a000b5190 2024-09-11T23:20:52.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.308+0000 7f5a08800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5a0015c6e0 con 0x7f5a000c52b0 2024-09-11T23:20:52.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.308+0000 7f5a05e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e80039b0 0x7f5a0014cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:52.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.308+0000 7f5a05e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e80039b0 0x7f5a0014cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37920/0 (socket says 172.21.15.144:37920) 2024-09-11T23:20:52.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.308+0000 7f5a05e00640 1 -- 172.21.15.144:0/3092216580 learned_addr learned my addr 172.21.15.144:0/3092216580 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:52.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.309+0000 7f5a06800640 1 --2- 172.21.15.144:0/3092216580 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a000b5190 0x7f5a0014d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:52.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.309+0000 7f5a05400640 1 --2- 172.21.15.144:0/3092216580 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a000c52b0 0x7f5a000b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:52.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.309+0000 7f5a05e00640 1 -- 172.21.15.144:0/3092216580 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a000c52b0 msgr2=0x7f5a000b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:52.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.309+0000 7f5a05e00640 1 --2- 172.21.15.144:0/3092216580 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a000c52b0 0x7f5a000b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:52.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.309+0000 7f5a05e00640 1 -- 172.21.15.144:0/3092216580 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a000b5190 msgr2=0x7f5a0014d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:52.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.309+0000 7f5a05e00640 1 --2- 172.21.15.144:0/3092216580 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a000b5190 0x7f5a0014d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:52.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.309+0000 7f5a05e00640 1 -- 172.21.15.144:0/3092216580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a000b3bb0 con 0x7f59e80039b0 2024-09-11T23:20:52.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.309+0000 7f5a05e00640 1 --2- 172.21.15.144:0/3092216580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e80039b0 0x7f5a0014cd50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f59f400c240 tx=0x7f5a00072810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:52.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.309+0000 7f59fa000640 1 -- 172.21.15.144:0/3092216580 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f4038040 con 0x7f59e80039b0 2024-09-11T23:20:52.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.309+0000 7f59fa000640 1 -- 172.21.15.144:0/3092216580 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f4042070 con 0x7f59e80039b0 2024-09-11T23:20:52.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.309+0000 7f5a08800640 1 -- 172.21.15.144:0/3092216580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a000b3e90 con 0x7f59e80039b0 2024-09-11T23:20:52.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.310+0000 7f59fa000640 1 -- 172.21.15.144:0/3092216580 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f4007d10 con 0x7f59e80039b0 2024-09-11T23:20:52.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.310+0000 7f5a08800640 1 -- 172.21.15.144:0/3092216580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a000b4450 con 0x7f59e80039b0 2024-09-11T23:20:52.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.311+0000 7f5a08800640 1 -- 172.21.15.144:0/3092216580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a000cf4e0 con 0x7f59e80039b0 2024-09-11T23:20:52.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.311+0000 7f59fa000640 1 -- 172.21.15.144:0/3092216580 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f59f40049e0 con 0x7f59e80039b0 2024-09-11T23:20:52.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.312+0000 7f59fa000640 1 --2- 172.21.15.144:0/3092216580 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f59e406bfe0 0x7f59e406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:52.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.312+0000 7f59fa000640 1 -- 172.21.15.144:0/3092216580 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f59f40aa970 con 0x7f59e80039b0 2024-09-11T23:20:52.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.313+0000 7f5a05400640 1 --2- 172.21.15.144:0/3092216580 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f59e406bfe0 0x7f59e406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:52.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.313+0000 7f5a05400640 1 --2- 172.21.15.144:0/3092216580 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f59e406bfe0 0x7f59e406e4a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f59f0007f60 tx=0x7f59f0007ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:52.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.317+0000 7f59fa000640 1 -- 172.21.15.144:0/3092216580 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59f4079310 con 0x7f59e80039b0 2024-09-11T23:20:52.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:52.557+0000 7f5a08800640 1 -- 172.21.15.144:0/3092216580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7f5a000b0d90 con 0x7f59e80039b0 2024-09-11T23:20:53.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.408+0000 7f59fa000640 1 -- 172.21.15.144:0/3092216580 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v162) ==== 164+0+0 (secure 0 0 0) 0x7f59f4078c10 con 0x7f59e80039b0 2024-09-11T23:20:53.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.411+0000 7f5a08800640 1 -- 172.21.15.144:0/3092216580 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f59e406bfe0 msgr2=0x7f59e406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:53.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.411+0000 7f5a08800640 1 --2- 172.21.15.144:0/3092216580 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f59e406bfe0 0x7f59e406e4a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f59f0007f60 tx=0x7f59f0007ef0 comp rx=0 tx=0).stop 2024-09-11T23:20:53.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.411+0000 7f5a08800640 1 -- 172.21.15.144:0/3092216580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e80039b0 msgr2=0x7f5a0014cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:53.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.411+0000 7f5a08800640 1 --2- 172.21.15.144:0/3092216580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e80039b0 0x7f5a0014cd50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f59f400c240 tx=0x7f5a00072810 comp rx=0 tx=0).stop 2024-09-11T23:20:53.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.411+0000 7f5a08800640 1 -- 172.21.15.144:0/3092216580 shutdown_connections 2024-09-11T23:20:53.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.411+0000 7f5a08800640 1 --2- 172.21.15.144:0/3092216580 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f59e406bfe0 0x7f59e406e4a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:53.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.411+0000 7f5a08800640 1 --2- 172.21.15.144:0/3092216580 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a000b5190 0x7f5a0014d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:53.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.411+0000 7f5a08800640 1 --2- 172.21.15.144:0/3092216580 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a000c52b0 0x7f5a000b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:53.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.412+0000 7f5a08800640 1 --2- 172.21.15.144:0/3092216580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59e80039b0 0x7f5a0014cd50 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:53.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.412+0000 7f5a08800640 1 -- 172.21.15.144:0/3092216580 >> 172.21.15.144:0/3092216580 conn(0x7f5a00062cc0 msgr2=0x7f5a0015eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:53.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.412+0000 7f5a08800640 1 -- 172.21.15.144:0/3092216580 shutdown_connections 2024-09-11T23:20:53.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.412+0000 7f5a08800640 1 -- 172.21.15.144:0/3092216580 wait complete. 2024-09-11T23:20:53.430 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:20:53.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.589+0000 7f7e39600640 1 Processor -- start 2024-09-11T23:20:53.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.590+0000 7f7e39600640 1 -- start start 2024-09-11T23:20:53.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.591+0000 7f7e39600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e34158e50 0x7f7e340b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:53.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.591+0000 7f7e39600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e340b43f0 con 0x7f7e3415c370 2024-09-11T23:20:53.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.591+0000 7f7e39600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e3415c7d0 con 0x7f7e3406f130 2024-09-11T23:20:53.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.591+0000 7f7e39600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7e340b3630 con 0x7f7e34158e50 2024-09-11T23:20:53.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.591+0000 7f7e2a000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f7e3415c370 0x7f7e3406ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60698/0 (socket says 172.21.15.144:60698) 2024-09-11T23:20:53.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.591+0000 7f7e2a000640 1 -- 172.21.15.144:0/438826998 learned_addr learned my addr 172.21.15.144:0/438826998 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:20:53.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.591+0000 7f7e32a00640 1 --2- 172.21.15.144:0/438826998 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e34158e50 0x7f7e340b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:53.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.591+0000 7f7e32000640 1 -- 172.21.15.144:0/438826998 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2644048228 0 0) 0x7f7e340b43f0 con 0x7f7e3415c370 2024-09-11T23:20:53.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.592+0000 7f7e32000640 1 -- 172.21.15.144:0/438826998 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e18003520 con 0x7f7e3415c370 2024-09-11T23:20:53.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.592+0000 7f7e32000640 1 -- 172.21.15.144:0/438826998 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3834753111 0 0) 0x7f7e3415c7d0 con 0x7f7e3406f130 2024-09-11T23:20:53.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.592+0000 7f7e32000640 1 -- 172.21.15.144:0/438826998 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e340b43f0 con 0x7f7e3406f130 2024-09-11T23:20:53.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.592+0000 7f7e32000640 1 -- 172.21.15.144:0/438826998 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3883462670 0 0) 0x7f7e18003520 con 0x7f7e3415c370 2024-09-11T23:20:53.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.592+0000 7f7e32000640 1 -- 172.21.15.144:0/438826998 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e34158e50 msgr2=0x7f7e340b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:53.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.592+0000 7f7e32000640 1 --2- 172.21.15.144:0/438826998 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e34158e50 0x7f7e340b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:53.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.592+0000 7f7e32000640 1 -- 172.21.15.144:0/438826998 >> v1:172.21.15.165:6789/0 conn(0x7f7e3406f130 legacy=0x7f7e340ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:53.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.592+0000 7f7e32000640 1 -- 172.21.15.144:0/438826998 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e340b3910 con 0x7f7e3415c370 2024-09-11T23:20:53.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.592+0000 7f7e32000640 1 -- 172.21.15.144:0/438826998 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f7e1c0017f0 con 0x7f7e3415c370 2024-09-11T23:20:53.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.592+0000 7f7e32000640 1 -- 172.21.15.144:0/438826998 >> v1:172.21.15.144:6789/0 conn(0x7f7e3415c370 legacy=0x7f7e3406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:53.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.592+0000 7f7e32000640 1 --2- 172.21.15.144:0/438826998 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e34158e50 0x7f7e18003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:53.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.592+0000 7f7e32000640 1 --2- 172.21.15.144:0/438826998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e18004120 0x7f7e18004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:53.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.592+0000 7f7e32000640 1 --2- 172.21.15.144:0/438826998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e18004d40 0x7f7e180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:53.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.592+0000 7f7e32000640 1 -- 172.21.15.144:0/438826998 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7e340b3630 con 0x7f7e18004120 2024-09-11T23:20:53.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.592+0000 7f7e32000640 1 -- 172.21.15.144:0/438826998 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1800bb00 con 0x7f7e18004d40 2024-09-11T23:20:53.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.592+0000 7f7e32000640 1 -- 172.21.15.144:0/438826998 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7e1800bd00 con 0x7f7e34158e50 2024-09-11T23:20:53.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.592+0000 7f7e2a000640 1 --2- 172.21.15.144:0/438826998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e18004120 0x7f7e18004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:53.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.592+0000 7f7e33400640 1 --2- 172.21.15.144:0/438826998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e18004d40 0x7f7e180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:53.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.592+0000 7f7e32a00640 1 --2- 172.21.15.144:0/438826998 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e34158e50 0x7f7e18003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:53.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.593+0000 7f7e2a000640 1 -- 172.21.15.144:0/438826998 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e34158e50 msgr2=0x7f7e18003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:53.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.593+0000 7f7e2a000640 1 --2- 172.21.15.144:0/438826998 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e34158e50 0x7f7e18003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:53.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.593+0000 7f7e2a000640 1 -- 172.21.15.144:0/438826998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e18004d40 msgr2=0x7f7e180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:53.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.593+0000 7f7e2a000640 1 --2- 172.21.15.144:0/438826998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e18004d40 0x7f7e180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:53.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.593+0000 7f7e2a000640 1 -- 172.21.15.144:0/438826998 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e18003520 con 0x7f7e18004120 2024-09-11T23:20:53.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.594+0000 7f7e2a000640 1 --2- 172.21.15.144:0/438826998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e18004120 0x7f7e18004800 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00c0e0 tx=0x7f7e18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151eaabacc3b625f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:53.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.594+0000 7f7e32000640 1 -- 172.21.15.144:0/438826998 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c007c00 con 0x7f7e18004120 2024-09-11T23:20:53.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.594+0000 7f7e32000640 1 -- 172.21.15.144:0/438826998 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e1c007270 con 0x7f7e18004120 2024-09-11T23:20:53.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.594+0000 7f7e32000640 1 -- 172.21.15.144:0/438826998 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0057a0 con 0x7f7e18004120 2024-09-11T23:20:53.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.594+0000 7f7e39600640 1 -- 172.21.15.144:0/438826998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e18004120 msgr2=0x7f7e18004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:53.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.594+0000 7f7e39600640 1 --2- 172.21.15.144:0/438826998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e18004120 0x7f7e18004800 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00c0e0 tx=0x7f7e18005830 comp rx=0 tx=0).stop 2024-09-11T23:20:53.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.594+0000 7f7e33400640 1 -- 172.21.15.144:0/438826998 reap_dead start 2024-09-11T23:20:53.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.594+0000 7f7e39600640 1 -- 172.21.15.144:0/438826998 shutdown_connections 2024-09-11T23:20:53.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.594+0000 7f7e39600640 1 -- 172.21.15.144:0/438826998 >> 172.21.15.144:0/438826998 conn(0x7f7e3406bba0 msgr2=0x7f7e3406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:53.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.595+0000 7f7e39600640 1 -- 172.21.15.144:0/438826998 shutdown_connections 2024-09-11T23:20:53.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.595+0000 7f7e39600640 1 -- 172.21.15.144:0/438826998 wait complete. 2024-09-11T23:20:53.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.596+0000 7f7e39600640 1 Processor -- start 2024-09-11T23:20:53.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.596+0000 7f7e39600640 1 -- start start 2024-09-11T23:20:53.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.597+0000 7f7e39600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e18004120 0x7f7e34152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:53.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.597+0000 7f7e39600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e3415f1c0 0x7f7e341f4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:53.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.597+0000 7f7e39600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e341534f0 0x7f7e341506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:53.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.597+0000 7f7e39600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7e34159230 con 0x7f7e341534f0 2024-09-11T23:20:53.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.597+0000 7f7e39600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7e340b3ed0 con 0x7f7e18004120 2024-09-11T23:20:53.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.597+0000 7f7e39600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7e340b5050 con 0x7f7e3415f1c0 2024-09-11T23:20:53.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.597+0000 7f7e33400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e341534f0 0x7f7e341506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:53.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.597+0000 7f7e33400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e341534f0 0x7f7e341506f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37928/0 (socket says 172.21.15.144:37928) 2024-09-11T23:20:53.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.597+0000 7f7e33400640 1 -- 172.21.15.144:0/1504223312 learned_addr learned my addr 172.21.15.144:0/1504223312 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:53.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.598+0000 7f7e32a00640 1 --2- 172.21.15.144:0/1504223312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e18004120 0x7f7e34152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:53.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.598+0000 7f7e2a000640 1 --2- 172.21.15.144:0/1504223312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e3415f1c0 0x7f7e341f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:53.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.598+0000 7f7e33400640 1 -- 172.21.15.144:0/1504223312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e3415f1c0 msgr2=0x7f7e341f4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:53.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.598+0000 7f7e33400640 1 --2- 172.21.15.144:0/1504223312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e3415f1c0 0x7f7e341f4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:53.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.598+0000 7f7e33400640 1 -- 172.21.15.144:0/1504223312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e18004120 msgr2=0x7f7e34152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:53.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.598+0000 7f7e33400640 1 --2- 172.21.15.144:0/1504223312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e18004120 0x7f7e34152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:53.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.598+0000 7f7e33400640 1 -- 172.21.15.144:0/1504223312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e341516b0 con 0x7f7e341534f0 2024-09-11T23:20:53.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.598+0000 7f7e2a000640 1 --2- 172.21.15.144:0/1504223312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e3415f1c0 0x7f7e341f4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:53.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.598+0000 7f7e33400640 1 --2- 172.21.15.144:0/1504223312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e341534f0 0x7f7e341506f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7e340aff80 tx=0x7f7e2c00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:53.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.598+0000 7f7e2b400640 1 -- 172.21.15.144:0/1504223312 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c019070 con 0x7f7e341534f0 2024-09-11T23:20:53.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.598+0000 7f7e2b400640 1 -- 172.21.15.144:0/1504223312 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e2c006e20 con 0x7f7e341534f0 2024-09-11T23:20:53.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.598+0000 7f7e2b400640 1 -- 172.21.15.144:0/1504223312 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c003b70 con 0x7f7e341534f0 2024-09-11T23:20:53.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.598+0000 7f7e39600640 1 -- 172.21.15.144:0/1504223312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e34151990 con 0x7f7e341534f0 2024-09-11T23:20:53.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.598+0000 7f7e39600640 1 -- 172.21.15.144:0/1504223312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e34151f50 con 0x7f7e341534f0 2024-09-11T23:20:53.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.600+0000 7f7e39600640 1 -- 172.21.15.144:0/1504223312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e340b5430 con 0x7f7e341534f0 2024-09-11T23:20:53.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.600+0000 7f7e2b400640 1 -- 172.21.15.144:0/1504223312 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f7e2c01c070 con 0x7f7e341534f0 2024-09-11T23:20:53.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.602+0000 7f7e2b400640 1 --2- 172.21.15.144:0/1504223312 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7e1006c010 0x7f7e1006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:53.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.602+0000 7f7e2b400640 1 -- 172.21.15.144:0/1504223312 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f7e2c08a430 con 0x7f7e341534f0 2024-09-11T23:20:53.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.602+0000 7f7e32a00640 1 --2- 172.21.15.144:0/1504223312 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7e1006c010 0x7f7e1006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:53.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.603+0000 7f7e32a00640 1 --2- 172.21.15.144:0/1504223312 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7e1006c010 0x7f7e1006e4d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7e340cfeb0 tx=0x7f7e24008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:53.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.606+0000 7f7e2b400640 1 -- 172.21.15.144:0/1504223312 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e2c058dc0 con 0x7f7e341534f0 2024-09-11T23:20:53.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.780+0000 7f7e39600640 1 -- 172.21.15.144:0/1504223312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f7e34071120 con 0x7f7e341534f0 2024-09-11T23:20:53.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.784+0000 7f7e2b400640 1 -- 172.21.15.144:0/1504223312 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f7e2c0586c0 con 0x7f7e341534f0 2024-09-11T23:20:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.787+0000 7f7e39600640 1 -- 172.21.15.144:0/1504223312 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7e1006c010 msgr2=0x7f7e1006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.787+0000 7f7e39600640 1 --2- 172.21.15.144:0/1504223312 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7e1006c010 0x7f7e1006e4d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7e340cfeb0 tx=0x7f7e24008040 comp rx=0 tx=0).stop 2024-09-11T23:20:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.787+0000 7f7e39600640 1 -- 172.21.15.144:0/1504223312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e341534f0 msgr2=0x7f7e341506f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.787+0000 7f7e39600640 1 --2- 172.21.15.144:0/1504223312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e341534f0 0x7f7e341506f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7e340aff80 tx=0x7f7e2c00ff70 comp rx=0 tx=0).stop 2024-09-11T23:20:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.787+0000 7f7e39600640 1 -- 172.21.15.144:0/1504223312 shutdown_connections 2024-09-11T23:20:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.787+0000 7f7e39600640 1 --2- 172.21.15.144:0/1504223312 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7e1006c010 0x7f7e1006e4d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.787+0000 7f7e39600640 1 --2- 172.21.15.144:0/1504223312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e341534f0 0x7f7e341506f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.787+0000 7f7e39600640 1 --2- 172.21.15.144:0/1504223312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e3415f1c0 0x7f7e341f4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:53.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.787+0000 7f7e39600640 1 --2- 172.21.15.144:0/1504223312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e18004120 0x7f7e34152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:53.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.787+0000 7f7e39600640 1 -- 172.21.15.144:0/1504223312 >> 172.21.15.144:0/1504223312 conn(0x7f7e3406bba0 msgr2=0x7f7e3415b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:53.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.787+0000 7f7e39600640 1 -- 172.21.15.144:0/1504223312 shutdown_connections 2024-09-11T23:20:53.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:53.787+0000 7f7e39600640 1 -- 172.21.15.144:0/1504223312 wait complete. 2024-09-11T23:20:53.803 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:20:53.803 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:20:53.880 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:20:53.981 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:20:53.982 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:20:53.982 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:54.017 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:20:54.018 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:20:54.018 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:54.055 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:20:54.055 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:20:54.055 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:54.093 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:20:54.093 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:20:54.093 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:20:54.131 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:20:54.131 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T23:20:54.131 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:20:54.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.285+0000 7f65f9a00640 1 Processor -- start 2024-09-11T23:20:54.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.285+0000 7f65f9a00640 1 -- start start 2024-09-11T23:20:54.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.286+0000 7f65f9a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f65f40b4930 0x7f65f40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:54.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.287+0000 7f65f9a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f65f415f620 0x7f65f415fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:54.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.287+0000 7f65f9a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65f4162870 con 0x7f65f40d0a50 2024-09-11T23:20:54.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.287+0000 7f65f9a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f65f40b52d0 con 0x7f65f415f620 2024-09-11T23:20:54.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.287+0000 7f65f9a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f65f4162b50 con 0x7f65f40b4930 2024-09-11T23:20:54.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.287+0000 7f65f3400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f65f415f620 0x7f65f415fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:54.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.287+0000 7f65f2a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f65f40d0a50 0x7f65f41620b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60706/0 (socket says 172.21.15.144:60706) 2024-09-11T23:20:54.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.287+0000 7f65f2a00640 1 -- 172.21.15.144:0/2269816202 learned_addr learned my addr 172.21.15.144:0/2269816202 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:20:54.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.287+0000 7f65f2000640 1 --2- 172.21.15.144:0/2269816202 >> v2:172.21.15.165:3300/0 conn(0x7f65f40b4930 0x7f65f40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:54.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.287+0000 7f65f1600640 1 -- 172.21.15.144:0/2269816202 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1266208284 0 0) 0x7f65f4162870 con 0x7f65f40d0a50 2024-09-11T23:20:54.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.287+0000 7f65f3400640 1 -- 172.21.15.144:0/2269816202 >> v2:172.21.15.165:3300/0 conn(0x7f65f40b4930 msgr2=0x7f65f40b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:54.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.287+0000 7f65f3400640 1 --2- 172.21.15.144:0/2269816202 >> v2:172.21.15.165:3300/0 conn(0x7f65f40b4930 0x7f65f40b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:54.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.287+0000 7f65f3400640 1 -- 172.21.15.144:0/2269816202 >> v1:172.21.15.144:6789/0 conn(0x7f65f40d0a50 legacy=0x7f65f41620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:54.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.287+0000 7f65f3400640 1 -- 172.21.15.144:0/2269816202 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f4162e30 con 0x7f65f415f620 2024-09-11T23:20:54.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.288+0000 7f65f3400640 1 --2- 172.21.15.144:0/2269816202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65f415f620 0x7f65f415fa70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f65f4070ef0 tx=0x7f65ec02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80916b359423af2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:54.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.289+0000 7f65f1600640 1 -- 172.21.15.144:0/2269816202 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec007740 con 0x7f65f415f620 2024-09-11T23:20:54.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.289+0000 7f65f1600640 1 -- 172.21.15.144:0/2269816202 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ec0078e0 con 0x7f65f415f620 2024-09-11T23:20:54.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.289+0000 7f65f1600640 1 -- 172.21.15.144:0/2269816202 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec007cb0 con 0x7f65f415f620 2024-09-11T23:20:54.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.289+0000 7f65f9a00640 1 -- 172.21.15.144:0/2269816202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65f415f620 msgr2=0x7f65f415fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:54.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.289+0000 7f65f9a00640 1 --2- 172.21.15.144:0/2269816202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65f415f620 0x7f65f415fa70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f65f4070ef0 tx=0x7f65ec02a5f0 comp rx=0 tx=0).stop 2024-09-11T23:20:54.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.289+0000 7f65f9a00640 1 -- 172.21.15.144:0/2269816202 shutdown_connections 2024-09-11T23:20:54.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.289+0000 7f65f9a00640 1 --2- 172.21.15.144:0/2269816202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65f415f620 0x7f65f415fa70 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:54.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.289+0000 7f65f9a00640 1 --2- 172.21.15.144:0/2269816202 >> v2:172.21.15.165:3300/0 conn(0x7f65f40b4930 0x7f65f40b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:54.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.289+0000 7f65f9a00640 1 -- 172.21.15.144:0/2269816202 >> 172.21.15.144:0/2269816202 conn(0x7f65f4062cc0 msgr2=0x7f65f406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:54.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.289+0000 7f65f9a00640 1 -- 172.21.15.144:0/2269816202 shutdown_connections 2024-09-11T23:20:54.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.289+0000 7f65f9a00640 1 -- 172.21.15.144:0/2269816202 wait complete. 2024-09-11T23:20:54.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.291+0000 7f65f9a00640 1 Processor -- start 2024-09-11T23:20:54.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.291+0000 7f65f9a00640 1 -- start start 2024-09-11T23:20:54.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.292+0000 7f65f9a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f65f40b4930 0x7f65f41581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:54.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.292+0000 7f65f9a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65f415f620 0x7f65f4070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:54.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.292+0000 7f65f9a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65f40b0be0 0x7f65f40724c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:54.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.292+0000 7f65f9a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f65f415ffb0 con 0x7f65f40b0be0 2024-09-11T23:20:54.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.292+0000 7f65f9a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f65f40b3620 con 0x7f65f40b4930 2024-09-11T23:20:54.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.292+0000 7f65f9a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f65f4160130 con 0x7f65f415f620 2024-09-11T23:20:54.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.292+0000 7f65f3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65f40b0be0 0x7f65f40724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:54.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.292+0000 7f65f3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65f40b0be0 0x7f65f40724c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37954/0 (socket says 172.21.15.144:37954) 2024-09-11T23:20:54.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.292+0000 7f65f3400640 1 -- 172.21.15.144:0/1317041710 learned_addr learned my addr 172.21.15.144:0/1317041710 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:54.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.292+0000 7f65f2a00640 1 --2- 172.21.15.144:0/1317041710 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f65f40b4930 0x7f65f41581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:54.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.292+0000 7f65f2000640 1 --2- 172.21.15.144:0/1317041710 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65f415f620 0x7f65f4070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:54.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.293+0000 7f65f3400640 1 -- 172.21.15.144:0/1317041710 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65f415f620 msgr2=0x7f65f4070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:54.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.293+0000 7f65f3400640 1 --2- 172.21.15.144:0/1317041710 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65f415f620 0x7f65f4070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:54.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.293+0000 7f65f3400640 1 -- 172.21.15.144:0/1317041710 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f65f40b4930 msgr2=0x7f65f41581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:54.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.293+0000 7f65f3400640 1 --2- 172.21.15.144:0/1317041710 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f65f40b4930 0x7f65f41581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:54.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.293+0000 7f65f3400640 1 -- 172.21.15.144:0/1317041710 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f4071840 con 0x7f65f40b0be0 2024-09-11T23:20:54.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.293+0000 7f65f3400640 1 --2- 172.21.15.144:0/1317041710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65f40b0be0 0x7f65f40724c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f65ec009e50 tx=0x7f65ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:54.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.293+0000 7f65eaa00640 1 -- 172.21.15.144:0/1317041710 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec03f070 con 0x7f65f40b0be0 2024-09-11T23:20:54.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.293+0000 7f65eaa00640 1 -- 172.21.15.144:0/1317041710 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ec031bf0 con 0x7f65f40b0be0 2024-09-11T23:20:54.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.293+0000 7f65eaa00640 1 -- 172.21.15.144:0/1317041710 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec009450 con 0x7f65f40b0be0 2024-09-11T23:20:54.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.293+0000 7f65f9a00640 1 -- 172.21.15.144:0/1317041710 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f4071b20 con 0x7f65f40b0be0 2024-09-11T23:20:54.295 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.293+0000 7f65f9a00640 1 -- 172.21.15.144:0/1317041710 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f40720e0 con 0x7f65f40b0be0 2024-09-11T23:20:54.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.294+0000 7f65f9a00640 1 -- 172.21.15.144:0/1317041710 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65f4161460 con 0x7f65f40b0be0 2024-09-11T23:20:54.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.295+0000 7f65eaa00640 1 -- 172.21.15.144:0/1317041710 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f65ec03b410 con 0x7f65f40b0be0 2024-09-11T23:20:54.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.296+0000 7f65eaa00640 1 --2- 172.21.15.144:0/1317041710 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f65d406c010 0x7f65d406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:54.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.296+0000 7f65eaa00640 1 -- 172.21.15.144:0/1317041710 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f65ec0ac740 con 0x7f65f40b0be0 2024-09-11T23:20:54.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.296+0000 7f65f2a00640 1 --2- 172.21.15.144:0/1317041710 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f65d406c010 0x7f65d406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:54.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.297+0000 7f65f2a00640 1 --2- 172.21.15.144:0/1317041710 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f65d406c010 0x7f65d406e4d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f65e4000f60 tx=0x7f65e4007b50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:54.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.300+0000 7f65eaa00640 1 -- 172.21.15.144:0/1317041710 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f65ec07afc0 con 0x7f65f40b0be0 2024-09-11T23:20:54.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.509+0000 7f65f9a00640 1 -- 172.21.15.144:0/1317041710 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65f41586f0 con 0x7f65f40b0be0 2024-09-11T23:20:54.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.510+0000 7f65eaa00640 1 -- 172.21.15.144:0/1317041710 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+3920 (secure 0 0 0) 0x7f65ec07a8c0 con 0x7f65f40b0be0 2024-09-11T23:20:54.511 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:20:54.511 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":28,"btime":"2024-09-11T23:20:48:141883+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4874,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3914039828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3914039828},{"type":"v1","addr":"172.21.15.165:6834","nonce":3914039828}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5131,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3725562224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3725562224},{"type":"v1","addr":"172.21.15.165:6835","nonce":3725562224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5137,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/698045968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":698045968},{"type":"v1","addr":"172.21.15.144:6836","nonce":698045968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5580,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1744713953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1744713953},{"type":"v1","addr":"172.21.15.144:6837","nonce":1744713953}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[]} 2024-09-11T23:20:54.511 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 28 2024-09-11T23:20:54.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.512+0000 7f65f9a00640 1 -- 172.21.15.144:0/1317041710 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f65d406c010 msgr2=0x7f65d406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:54.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.512+0000 7f65f9a00640 1 --2- 172.21.15.144:0/1317041710 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f65d406c010 0x7f65d406e4d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f65e4000f60 tx=0x7f65e4007b50 comp rx=0 tx=0).stop 2024-09-11T23:20:54.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.512+0000 7f65f9a00640 1 -- 172.21.15.144:0/1317041710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65f40b0be0 msgr2=0x7f65f40724c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:54.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.512+0000 7f65f9a00640 1 --2- 172.21.15.144:0/1317041710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65f40b0be0 0x7f65f40724c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f65ec009e50 tx=0x7f65ec004a40 comp rx=0 tx=0).stop 2024-09-11T23:20:54.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.512+0000 7f65f9a00640 1 -- 172.21.15.144:0/1317041710 shutdown_connections 2024-09-11T23:20:54.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.512+0000 7f65f9a00640 1 --2- 172.21.15.144:0/1317041710 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f65d406c010 0x7f65d406e4d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:54.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.512+0000 7f65f9a00640 1 --2- 172.21.15.144:0/1317041710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65f40b0be0 0x7f65f40724c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:54.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.512+0000 7f65f9a00640 1 --2- 172.21.15.144:0/1317041710 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65f415f620 0x7f65f4070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:54.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.512+0000 7f65f9a00640 1 --2- 172.21.15.144:0/1317041710 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f65f40b4930 0x7f65f41581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:54.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.512+0000 7f65f9a00640 1 -- 172.21.15.144:0/1317041710 >> 172.21.15.144:0/1317041710 conn(0x7f65f4062cc0 msgr2=0x7f65f40b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:54.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.513+0000 7f65f9a00640 1 -- 172.21.15.144:0/1317041710 shutdown_connections 2024-09-11T23:20:54.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.513+0000 7f65f9a00640 1 -- 172.21.15.144:0/1317041710 wait complete. 2024-09-11T23:20:54.532 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:20:54.532 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:20:54.532 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:20:54.532 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:20:54.533 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:20:54.533 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T23:20:54.533 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:20:54.533 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:20:54.533 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:20:54.533 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:20:54.534 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:20:54.534 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:20:54.534 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:20:54.534 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T23:20:54.534 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:20:54.534 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:20:54.548 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:20:54.548 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:20:54.549 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:20:54.549 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:20:54.550 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:20:54.550 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:20:54.551 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:20:54.551 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:20:54.592 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:20:54.592 DEBUG:teuthology.parallel:result is None 2024-09-11T23:20:54.594 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:20:54.594 DEBUG:teuthology.parallel:result is None 2024-09-11T23:20:54.595 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:20:54.595 DEBUG:teuthology.parallel:result is None 2024-09-11T23:20:54.596 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:20:54.597 DEBUG:teuthology.parallel:result is None 2024-09-11T23:20:54.597 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:20:54.723 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-11T23:20:54.723 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-11T23:20:54.724 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-11T23:20:54.726 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-11T23:20:54.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.758+0000 7f651bc00640 1 Processor -- start 2024-09-11T23:20:54.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.758+0000 7f651bc00640 1 -- start start 2024-09-11T23:20:54.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.759+0000 7f651bc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65140cf070 0x7f65140cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:54.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.759+0000 7f651bc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65140ce740 con 0x7f6514073120 2024-09-11T23:20:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.759+0000 7f651bc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6514072640 con 0x7f651415c180 2024-09-11T23:20:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.759+0000 7f651bc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6514072920 con 0x7f65140cf070 2024-09-11T23:20:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.760+0000 7f6519c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6514073120 0x7f651406bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34722/0 (socket says 172.21.15.144:34722) 2024-09-11T23:20:54.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.760+0000 7f6519c00640 1 -- 172.21.15.144:0/2448701105 learned_addr learned my addr 172.21.15.144:0/2448701105 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:20:54.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.760+0000 7f6513e00640 1 --2- 172.21.15.144:0/2448701105 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65140cf070 0x7f65140cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.760+0000 7f6513400640 1 -- 172.21.15.144:0/2448701105 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2176897427 0 0) 0x7f65140ce740 con 0x7f6514073120 2024-09-11T23:20:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.760+0000 7f6513400640 1 -- 172.21.15.144:0/2448701105 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64fc003520 con 0x7f6514073120 2024-09-11T23:20:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.760+0000 7f6513400640 1 -- 172.21.15.144:0/2448701105 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2783161668 0 0) 0x7f64fc003520 con 0x7f6514073120 2024-09-11T23:20:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.760+0000 7f6513400640 1 -- 172.21.15.144:0/2448701105 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65140cf070 msgr2=0x7f65140cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.760+0000 7f6513400640 1 --2- 172.21.15.144:0/2448701105 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65140cf070 0x7f65140cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.760+0000 7f6513400640 1 -- 172.21.15.144:0/2448701105 >> v1:172.21.15.165:6789/0 conn(0x7f651415c180 legacy=0x7f65140cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.760+0000 7f6513400640 1 -- 172.21.15.144:0/2448701105 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6514072c00 con 0x7f6514073120 2024-09-11T23:20:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.760+0000 7f6513400640 1 -- 172.21.15.144:0/2448701105 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f650c001a10 con 0x7f6514073120 2024-09-11T23:20:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.760+0000 7f6513e00640 1 --2- 172.21.15.144:0/2448701105 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65140cf070 0x7f65140cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:20:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.761+0000 7f6513400640 1 -- 172.21.15.144:0/2448701105 >> v1:172.21.15.144:6789/0 conn(0x7f6514073120 legacy=0x7f651406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.761+0000 7f6513400640 1 --2- 172.21.15.144:0/2448701105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64fc0039e0 0x7f64fc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.761+0000 7f6513400640 1 --2- 172.21.15.144:0/2448701105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64fc004800 0x7f64fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.761+0000 7f6513400640 1 --2- 172.21.15.144:0/2448701105 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65140cf070 0x7f64fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.761+0000 7f6513400640 1 -- 172.21.15.144:0/2448701105 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6514072920 con 0x7f64fc0039e0 2024-09-11T23:20:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.761+0000 7f6513400640 1 -- 172.21.15.144:0/2448701105 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f64fc00ff00 con 0x7f64fc004800 2024-09-11T23:20:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.761+0000 7f6513400640 1 -- 172.21.15.144:0/2448701105 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f64fc010100 con 0x7f65140cf070 2024-09-11T23:20:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.761+0000 7f6519200640 1 --2- 172.21.15.144:0/2448701105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64fc0039e0 0x7f64fc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.761+0000 7f6513e00640 1 --2- 172.21.15.144:0/2448701105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64fc004800 0x7f64fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.761+0000 7f6519c00640 1 --2- 172.21.15.144:0/2448701105 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65140cf070 0x7f64fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.761+0000 7f6519200640 1 -- 172.21.15.144:0/2448701105 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65140cf070 msgr2=0x7f64fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.761+0000 7f6519200640 1 --2- 172.21.15.144:0/2448701105 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65140cf070 0x7f64fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.761+0000 7f6519200640 1 -- 172.21.15.144:0/2448701105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64fc004800 msgr2=0x7f64fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.761+0000 7f6519200640 1 --2- 172.21.15.144:0/2448701105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64fc004800 0x7f64fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.761+0000 7f6519200640 1 -- 172.21.15.144:0/2448701105 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64fc003520 con 0x7f64fc0039e0 2024-09-11T23:20:54.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.762+0000 7f6519200640 1 --2- 172.21.15.144:0/2448701105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64fc0039e0 0x7f64fc003e00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6508001750 tx=0x7f64fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe808c6b5943728 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:54.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.763+0000 7f6513400640 1 -- 172.21.15.144:0/2448701105 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6508001370 con 0x7f64fc0039e0 2024-09-11T23:20:54.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.763+0000 7f6513400640 1 -- 172.21.15.144:0/2448701105 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65080052d0 con 0x7f64fc0039e0 2024-09-11T23:20:54.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.763+0000 7f6513400640 1 -- 172.21.15.144:0/2448701105 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650802abe0 con 0x7f64fc0039e0 2024-09-11T23:20:54.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.763+0000 7f651bc00640 1 -- 172.21.15.144:0/2448701105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64fc0039e0 msgr2=0x7f64fc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:54.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.763+0000 7f651bc00640 1 --2- 172.21.15.144:0/2448701105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64fc0039e0 0x7f64fc003e00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6508001750 tx=0x7f64fc005830 comp rx=0 tx=0).stop 2024-09-11T23:20:54.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.763+0000 7f6519c00640 1 -- 172.21.15.144:0/2448701105 reap_dead start 2024-09-11T23:20:54.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.763+0000 7f651bc00640 1 -- 172.21.15.144:0/2448701105 shutdown_connections 2024-09-11T23:20:54.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.763+0000 7f651bc00640 1 -- 172.21.15.144:0/2448701105 >> 172.21.15.144:0/2448701105 conn(0x7f6514062cc0 msgr2=0x7f651406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:54.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.763+0000 7f651bc00640 1 -- 172.21.15.144:0/2448701105 shutdown_connections 2024-09-11T23:20:54.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.763+0000 7f651bc00640 1 -- 172.21.15.144:0/2448701105 wait complete. 2024-09-11T23:20:54.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.765+0000 7f651bc00640 1 Processor -- start 2024-09-11T23:20:54.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.765+0000 7f651bc00640 1 -- start start 2024-09-11T23:20:54.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.766+0000 7f651bc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64fc0039e0 0x7f6514151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:54.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.766+0000 7f651bc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65140b0ab0 0x7f65140b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:54.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.766+0000 7f651bc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f651415e700 0x7f651415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:54.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.766+0000 7f651bc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f65140722f0 con 0x7f65140b0ab0 2024-09-11T23:20:54.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.766+0000 7f651bc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f65140ced00 con 0x7f64fc0039e0 2024-09-11T23:20:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.766+0000 7f651bc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f651415c560 con 0x7f651415e700 2024-09-11T23:20:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.766+0000 7f6513e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65140b0ab0 0x7f65140b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.766+0000 7f6513e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65140b0ab0 0x7f65140b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53300/0 (socket says 172.21.15.144:53300) 2024-09-11T23:20:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.766+0000 7f6513e00640 1 -- 172.21.15.144:0/2391484249 learned_addr learned my addr 172.21.15.144:0/2391484249 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.766+0000 7f6519200640 1 --2- 172.21.15.144:0/2391484249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64fc0039e0 0x7f6514151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.766+0000 7f6519c00640 1 --2- 172.21.15.144:0/2391484249 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f651415e700 0x7f651415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.766+0000 7f6513e00640 1 -- 172.21.15.144:0/2391484249 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f651415e700 msgr2=0x7f651415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.766+0000 7f6513e00640 1 --2- 172.21.15.144:0/2391484249 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f651415e700 0x7f651415eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.766+0000 7f6513e00640 1 -- 172.21.15.144:0/2391484249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64fc0039e0 msgr2=0x7f6514151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.766+0000 7f6513e00640 1 --2- 172.21.15.144:0/2391484249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64fc0039e0 0x7f6514151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.766+0000 7f6513e00640 1 -- 172.21.15.144:0/2391484249 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6514158d00 con 0x7f65140b0ab0 2024-09-11T23:20:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.766+0000 7f6519200640 1 --2- 172.21.15.144:0/2391484249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64fc0039e0 0x7f6514151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:54.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.767+0000 7f6513e00640 1 --2- 172.21.15.144:0/2391484249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65140b0ab0 0x7f65140b1ef0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6500011a00 tx=0x7f6500011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:54.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.767+0000 7f6510c00640 1 -- 172.21.15.144:0/2391484249 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650000faf0 con 0x7f65140b0ab0 2024-09-11T23:20:54.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.767+0000 7f6510c00640 1 -- 172.21.15.144:0/2391484249 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f650000fc90 con 0x7f65140b0ab0 2024-09-11T23:20:54.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.767+0000 7f651bc00640 1 -- 172.21.15.144:0/2391484249 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65140b1050 con 0x7f65140b0ab0 2024-09-11T23:20:54.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.767+0000 7f6510c00640 1 -- 172.21.15.144:0/2391484249 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6500004030 con 0x7f65140b0ab0 2024-09-11T23:20:54.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.767+0000 7f651bc00640 1 -- 172.21.15.144:0/2391484249 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65140b1610 con 0x7f65140b0ab0 2024-09-11T23:20:54.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.768+0000 7f651bc00640 1 -- 172.21.15.144:0/2391484249 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65140cf4b0 con 0x7f65140b0ab0 2024-09-11T23:20:54.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.769+0000 7f6510c00640 1 -- 172.21.15.144:0/2391484249 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f6500012040 con 0x7f65140b0ab0 2024-09-11T23:20:54.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.770+0000 7f6510c00640 1 --2- 172.21.15.144:0/2391484249 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f64f406bfe0 0x7f64f406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:54.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.770+0000 7f6510c00640 1 -- 172.21.15.144:0/2391484249 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f650008b140 con 0x7f65140b0ab0 2024-09-11T23:20:54.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.770+0000 7f6519200640 1 --2- 172.21.15.144:0/2391484249 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f64f406bfe0 0x7f64f406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:54.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.771+0000 7f6519200640 1 --2- 172.21.15.144:0/2391484249 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f64f406bfe0 0x7f64f406e4a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6508032000 tx=0x7f650802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:54.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.774+0000 7f6510c00640 1 -- 172.21.15.144:0/2391484249 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6514158d00 con 0x7f65140b0ab0 2024-09-11T23:20:54.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:54.958+0000 7f651bc00640 1 -- 172.21.15.144:0/2391484249 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f651406d280 con 0x7f65140b0ab0 2024-09-11T23:20:55.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.425+0000 7f6510c00640 1 -- 172.21.15.144:0/2391484249 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v53) ==== 97+0+0 (secure 0 0 0) 0x7f6500019070 con 0x7f65140b0ab0 2024-09-11T23:20:55.427 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-11T23:20:55.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.428+0000 7f651bc00640 1 -- 172.21.15.144:0/2391484249 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f64f406bfe0 msgr2=0x7f64f406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:55.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.428+0000 7f651bc00640 1 --2- 172.21.15.144:0/2391484249 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f64f406bfe0 0x7f64f406e4a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6508032000 tx=0x7f650802e000 comp rx=0 tx=0).stop 2024-09-11T23:20:55.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.428+0000 7f651bc00640 1 -- 172.21.15.144:0/2391484249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65140b0ab0 msgr2=0x7f65140b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:55.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.428+0000 7f651bc00640 1 --2- 172.21.15.144:0/2391484249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65140b0ab0 0x7f65140b1ef0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6500011a00 tx=0x7f6500011ec0 comp rx=0 tx=0).stop 2024-09-11T23:20:55.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.428+0000 7f651bc00640 1 -- 172.21.15.144:0/2391484249 shutdown_connections 2024-09-11T23:20:55.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.428+0000 7f651bc00640 1 --2- 172.21.15.144:0/2391484249 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f64f406bfe0 0x7f64f406e4a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:55.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.428+0000 7f651bc00640 1 --2- 172.21.15.144:0/2391484249 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f651415e700 0x7f651415eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:55.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.428+0000 7f651bc00640 1 --2- 172.21.15.144:0/2391484249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65140b0ab0 0x7f65140b1ef0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:55.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.428+0000 7f651bc00640 1 --2- 172.21.15.144:0/2391484249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64fc0039e0 0x7f6514151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:55.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.428+0000 7f651bc00640 1 -- 172.21.15.144:0/2391484249 >> 172.21.15.144:0/2391484249 conn(0x7f6514062cc0 msgr2=0x7f651415fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:55.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.428+0000 7f651bc00640 1 -- 172.21.15.144:0/2391484249 shutdown_connections 2024-09-11T23:20:55.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.428+0000 7f651bc00640 1 -- 172.21.15.144:0/2391484249 wait complete. 2024-09-11T23:20:55.447 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:20:55.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.599+0000 7faae5000640 1 Processor -- start 2024-09-11T23:20:55.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.600+0000 7faae5000640 1 -- start start 2024-09-11T23:20:55.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.601+0000 7faae5000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7faae015a0a0 0x7faae0073180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:55.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.601+0000 7faae5000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faae00ceb90 0x7faae00b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:55.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.601+0000 7faae5000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faae0072100 con 0x7faae00736c0 2024-09-11T23:20:55.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.601+0000 7faae5000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7faae00723c0 con 0x7faae00ceb90 2024-09-11T23:20:55.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.601+0000 7faae5000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7faae00726a0 con 0x7faae015a0a0 2024-09-11T23:20:55.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.601+0000 7faadfe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faae00ceb90 0x7faae00b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:55.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.601+0000 7faad7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7faae00736c0 0x7faae00ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34732/0 (socket says 172.21.15.144:34732) 2024-09-11T23:20:55.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.601+0000 7faad7e00640 1 -- 172.21.15.144:0/4273992920 learned_addr learned my addr 172.21.15.144:0/4273992920 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:20:55.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.601+0000 7faadfe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faae00ceb90 0x7faae00b1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53314/0 (socket says 172.21.15.144:53314) 2024-09-11T23:20:55.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.601+0000 7faadf400640 1 --2- 172.21.15.144:0/4273992920 >> v2:172.21.15.165:3300/0 conn(0x7faae015a0a0 0x7faae0073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:55.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.601+0000 7faadfe00640 1 -- 172.21.15.144:0/4273992920 >> v2:172.21.15.165:3300/0 conn(0x7faae015a0a0 msgr2=0x7faae0073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:55.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.601+0000 7faadfe00640 1 --2- 172.21.15.144:0/4273992920 >> v2:172.21.15.165:3300/0 conn(0x7faae015a0a0 0x7faae0073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:55.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.601+0000 7faadfe00640 1 -- 172.21.15.144:0/4273992920 >> v1:172.21.15.144:6789/0 conn(0x7faae00736c0 legacy=0x7faae00ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:55.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.601+0000 7faadfe00640 1 -- 172.21.15.144:0/4273992920 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae0072980 con 0x7faae00ceb90 2024-09-11T23:20:55.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.602+0000 7faadfe00640 1 --2- 172.21.15.144:0/4273992920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae00ceb90 0x7faae00b1dc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7faae00d1160 tx=0x7faad802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e862f8d5d218524 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:55.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.603+0000 7faadea00640 1 -- 172.21.15.144:0/4273992920 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad8007740 con 0x7faae00ceb90 2024-09-11T23:20:55.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.603+0000 7faadea00640 1 -- 172.21.15.144:0/4273992920 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad80078e0 con 0x7faae00ceb90 2024-09-11T23:20:55.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.603+0000 7faadea00640 1 -- 172.21.15.144:0/4273992920 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad8007cb0 con 0x7faae00ceb90 2024-09-11T23:20:55.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.603+0000 7faae5000640 1 -- 172.21.15.144:0/4273992920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae00ceb90 msgr2=0x7faae00b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:55.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.603+0000 7faae5000640 1 --2- 172.21.15.144:0/4273992920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae00ceb90 0x7faae00b1dc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7faae00d1160 tx=0x7faad802a680 comp rx=0 tx=0).stop 2024-09-11T23:20:55.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.603+0000 7faae5000640 1 -- 172.21.15.144:0/4273992920 shutdown_connections 2024-09-11T23:20:55.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.603+0000 7faae5000640 1 --2- 172.21.15.144:0/4273992920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae00ceb90 0x7faae00b1dc0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:55.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.603+0000 7faae5000640 1 --2- 172.21.15.144:0/4273992920 >> v2:172.21.15.165:3300/0 conn(0x7faae015a0a0 0x7faae0073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:55.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.603+0000 7faae5000640 1 -- 172.21.15.144:0/4273992920 >> 172.21.15.144:0/4273992920 conn(0x7faae006e910 msgr2=0x7faae006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:55.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.603+0000 7faae5000640 1 -- 172.21.15.144:0/4273992920 shutdown_connections 2024-09-11T23:20:55.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.603+0000 7faae5000640 1 -- 172.21.15.144:0/4273992920 wait complete. 2024-09-11T23:20:55.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.605+0000 7faae5000640 1 Processor -- start 2024-09-11T23:20:55.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.605+0000 7faae5000640 1 -- start start 2024-09-11T23:20:55.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.606+0000 7faae5000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faae00ceb90 0x7faae015d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.606+0000 7faae5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae015a0a0 0x7faae014fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.606+0000 7faae5000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faae00c63c0 0x7faae015ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.606+0000 7faae5000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faae00b26d0 con 0x7faae015a0a0 2024-09-11T23:20:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.606+0000 7faae5000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faae00b2550 con 0x7faae00ceb90 2024-09-11T23:20:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.606+0000 7faae5000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faae00cf240 con 0x7faae00c63c0 2024-09-11T23:20:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.606+0000 7faad7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae015a0a0 0x7faae014fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.606+0000 7faad7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae015a0a0 0x7faae014fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53322/0 (socket says 172.21.15.144:53322) 2024-09-11T23:20:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.606+0000 7faad7e00640 1 -- 172.21.15.144:0/137937879 learned_addr learned my addr 172.21.15.144:0/137937879 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.606+0000 7faadf400640 1 --2- 172.21.15.144:0/137937879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faae00ceb90 0x7faae015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.606+0000 7faadfe00640 1 --2- 172.21.15.144:0/137937879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faae00c63c0 0x7faae015ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.607+0000 7faad7e00640 1 -- 172.21.15.144:0/137937879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faae00c63c0 msgr2=0x7faae015ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:55.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.607+0000 7faad7e00640 1 --2- 172.21.15.144:0/137937879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faae00c63c0 0x7faae015ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:55.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.607+0000 7faad7e00640 1 -- 172.21.15.144:0/137937879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faae00ceb90 msgr2=0x7faae015d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:55.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.607+0000 7faad7e00640 1 --2- 172.21.15.144:0/137937879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faae00ceb90 0x7faae015d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:55.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.607+0000 7faad7e00640 1 -- 172.21.15.144:0/137937879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae0150120 con 0x7faae015a0a0 2024-09-11T23:20:55.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.607+0000 7faad7e00640 1 --2- 172.21.15.144:0/137937879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae015a0a0 0x7faae014fbe0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7faac800c400 tx=0x7faac800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:55.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.607+0000 7faad7400640 1 -- 172.21.15.144:0/137937879 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac8017070 con 0x7faae015a0a0 2024-09-11T23:20:55.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.607+0000 7faad7400640 1 -- 172.21.15.144:0/137937879 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac8005ce0 con 0x7faae015a0a0 2024-09-11T23:20:55.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.607+0000 7faad7400640 1 -- 172.21.15.144:0/137937879 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac80072f0 con 0x7faae015a0a0 2024-09-11T23:20:55.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.607+0000 7faae5000640 1 -- 172.21.15.144:0/137937879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae015dc70 con 0x7faae015a0a0 2024-09-11T23:20:55.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.608+0000 7faae5000640 1 -- 172.21.15.144:0/137937879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae015e230 con 0x7faae015a0a0 2024-09-11T23:20:55.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.609+0000 7faae5000640 1 -- 172.21.15.144:0/137937879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faae00b1dc0 con 0x7faae015a0a0 2024-09-11T23:20:55.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.609+0000 7faad7400640 1 -- 172.21.15.144:0/137937879 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7faac801a070 con 0x7faae015a0a0 2024-09-11T23:20:55.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.610+0000 7faad7400640 1 --2- 172.21.15.144:0/137937879 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7faabc06bfe0 0x7faabc06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:55.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.610+0000 7faad7400640 1 -- 172.21.15.144:0/137937879 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4857+0+0 (secure 0 0 0) 0x7faac808a1d0 con 0x7faae015a0a0 2024-09-11T23:20:55.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.610+0000 7faadf400640 1 --2- 172.21.15.144:0/137937879 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7faabc06bfe0 0x7faabc06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:55.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.611+0000 7faadf400640 1 --2- 172.21.15.144:0/137937879 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7faabc06bfe0 0x7faabc06e4a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faad0009a80 tx=0x7faad0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:55.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.615+0000 7faad7400640 1 -- 172.21.15.144:0/137937879 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faae0150120 con 0x7faae015a0a0 2024-09-11T23:20:55.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.852+0000 7faae5000640 1 -- 172.21.15.144:0/137937879 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7faae006bdf0 con 0x7faae015a0a0 2024-09-11T23:20:55.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.852+0000 7faad7400640 1 -- 172.21.15.144:0/137937879 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) ==== 80+0+5304 (secure 0 0 0) 0x7faac8058580 con 0x7faae015a0a0 2024-09-11T23:20:55.853 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:20:55.853 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:20:55.853 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-11T23:20:55.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:20:55.854 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-11T23:20:55.854 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmQjymBhAA4BWEVNGY37RsnMGLL3Ow8A==", 2024-09-11T23:20:55.854 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:20:55.854 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:20:55.854 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:20:55.854 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:20:55.854 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:20:55.854 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:55.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:20:55.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:20:55.855 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-11T23:20:55.855 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmD0mIGhAAvug7T/kOcEmnyMyG++V+zA==", 2024-09-11T23:20:55.855 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:20:55.855 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:20:55.855 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:20:55.855 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:20:55.855 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:20:55.855 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:55.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:20:55.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:20:55.855 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-11T23:20:55.855 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmDwSZEBAAdf4eF3MrADSPzBTICzpOiA==", 2024-09-11T23:20:55.855 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:20:55.856 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:20:55.856 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:20:55.856 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:20:55.856 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:20:55.856 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:55.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:20:55.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:20:55.856 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-11T23:20:55.856 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmqYtRJBAAgpzvHNUPVnxNoflhqVIJuQ==", 2024-09-11T23:20:55.856 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:20:55.856 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:20:55.856 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:20:55.856 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:20:55.857 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:20:55.857 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:55.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:20:55.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:20:55.857 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-11T23:20:55.857 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDiJOJmzDABABAA+Qa772+Mm69pecG0QUXlyA==", 2024-09-11T23:20:55.857 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:20:55.857 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:20:55.857 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:20:55.857 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:20:55.857 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:55.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:20:55.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:20:55.858 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-11T23:20:55.858 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDlJOJmgVjJKRAAtl30JxJHurKdrn1vLUneww==", 2024-09-11T23:20:55.858 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:20:55.858 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:20:55.858 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:20:55.858 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:20:55.858 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:55.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:20:55.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:20:55.858 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-11T23:20:55.858 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDpJOJmRzO6FxAAiLDOwDlXYTj6WfEhlI+uVQ==", 2024-09-11T23:20:55.858 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:20:55.858 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:20:55.858 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:20:55.859 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:20:55.859 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:55.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:20:55.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:20:55.859 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-11T23:20:55.859 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDtJOJmVFh6EhAA7hcJn4k31nEPMcqiB7+djA==", 2024-09-11T23:20:55.859 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:20:55.859 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:20:55.859 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:20:55.859 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:20:55.859 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:55.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:20:55.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:20:55.860 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-11T23:20:55.860 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD0JOJmpIFTAhAAYQyoBrMjL6CcDDCNAOMGwQ==", 2024-09-11T23:20:55.860 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:20:55.860 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:20:55.860 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:20:55.860 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:20:55.860 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:55.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:20:55.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:20:55.860 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-11T23:20:55.860 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD4JOJmBAIIDhAA8G/usUslfQPNpFP1YZsgmg==", 2024-09-11T23:20:55.860 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:20:55.860 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:20:55.861 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:20:55.861 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:20:55.861 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:55.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:20:55.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:20:55.861 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-11T23:20:55.861 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD8JOJmDl2dCBAA5bL+2AIp0uWL4qjpI/mAdQ==", 2024-09-11T23:20:55.861 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:20:55.861 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:20:55.861 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:20:55.862 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:20:55.862 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:55.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:20:55.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:20:55.862 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-11T23:20:55.862 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAAJeJmMWX+AhAA7ABVgJPwhRZNkPNdZzmnOQ==", 2024-09-11T23:20:55.862 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:20:55.862 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:20:55.862 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:20:55.862 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:20:55.862 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:55.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:20:55.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:20:55.863 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-11T23:20:55.863 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A==", 2024-09-11T23:20:55.863 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:20:55.863 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:20:55.863 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-11T23:20:55.863 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T23:20:55.863 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:55.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:20:55.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:20:55.863 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-11T23:20:55.863 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmLFrBORAAT64lj0sWlVoTHVUZQf0JjA==", 2024-09-11T23:20:55.864 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:20:55.864 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:20:55.864 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:20:55.864 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:20:55.864 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:20:55.864 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:55.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:20:55.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:20:55.864 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-11T23:20:55.864 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJm2/dLMxAAbuKdVAbscrlF5jcBnouBOQ==", 2024-09-11T23:20:55.864 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:20:55.864 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:20:55.864 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:20:55.864 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:20:55.865 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:20:55.865 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:55.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:20:55.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:20:55.865 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-11T23:20:55.865 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDfJOJmse6UBBAAq+3afsp+2jApe9sTFmVVOw==", 2024-09-11T23:20:55.865 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:20:55.865 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:20:55.865 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:20:55.865 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:20:55.866 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:20:55.866 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:55.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:20:55.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:20:55.866 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-11T23:20:55.866 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmHmAwEhAAEGCvu0NgtyjIPcJBk6bkdA==", 2024-09-11T23:20:55.866 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:20:55.866 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:20:55.866 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:20:55.866 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:20:55.866 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:20:55.866 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:55.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:20:55.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:20:55.867 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-11T23:20:55.867 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmxMaVOxAA62zJwlyk0qdrsemalijH4Q==", 2024-09-11T23:20:55.867 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:20:55.867 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:20:55.867 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:20:55.867 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:20:55.867 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:55.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:20:55.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:20:55.867 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-11T23:20:55.867 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmWZRNNBAAwZ2GCP7mGn87ZSnsKCcDRQ==", 2024-09-11T23:20:55.867 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:20:55.868 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:20:55.868 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:20:55.868 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:20:55.868 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:55.868 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:55.868 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:20:55.868 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:20:55.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.854+0000 7faae5000640 1 -- 172.21.15.144:0/137937879 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7faabc06bfe0 msgr2=0x7faabc06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:55.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.854+0000 7faae5000640 1 --2- 172.21.15.144:0/137937879 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7faabc06bfe0 0x7faabc06e4a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faad0009a80 tx=0x7faad0009190 comp rx=0 tx=0).stop 2024-09-11T23:20:55.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.854+0000 7faae5000640 1 -- 172.21.15.144:0/137937879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae015a0a0 msgr2=0x7faae014fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:55.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.854+0000 7faae5000640 1 --2- 172.21.15.144:0/137937879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae015a0a0 0x7faae014fbe0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7faac800c400 tx=0x7faac800c8c0 comp rx=0 tx=0).stop 2024-09-11T23:20:55.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.854+0000 7faae5000640 1 -- 172.21.15.144:0/137937879 shutdown_connections 2024-09-11T23:20:55.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.854+0000 7faae5000640 1 --2- 172.21.15.144:0/137937879 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7faabc06bfe0 0x7faabc06e4a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:55.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.854+0000 7faae5000640 1 --2- 172.21.15.144:0/137937879 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faae00c63c0 0x7faae015ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:55.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.854+0000 7faae5000640 1 --2- 172.21.15.144:0/137937879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faae015a0a0 0x7faae014fbe0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:55.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.854+0000 7faae5000640 1 --2- 172.21.15.144:0/137937879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faae00ceb90 0x7faae015d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:55.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.854+0000 7faae5000640 1 -- 172.21.15.144:0/137937879 >> 172.21.15.144:0/137937879 conn(0x7faae006e910 msgr2=0x7faae015ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:55.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.855+0000 7faae5000640 1 -- 172.21.15.144:0/137937879 shutdown_connections 2024-09-11T23:20:55.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:55.855+0000 7faae5000640 1 -- 172.21.15.144:0/137937879 wait complete. 2024-09-11T23:20:55.871 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:20:56.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.025+0000 7f7687e00640 1 Processor -- start 2024-09-11T23:20:56.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.025+0000 7f7687e00640 1 -- start start 2024-09-11T23:20:56.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.026+0000 7f7687e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f768806dfd0 0x7f768806e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:56.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.026+0000 7f7687e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76880d16c0 0x7f76880d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:56.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.026+0000 7f7687e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7688073860 con 0x7f768815e530 2024-09-11T23:20:56.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.026+0000 7f7687e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f76880cfee0 con 0x7f768806dfd0 2024-09-11T23:20:56.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.026+0000 7f7687e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f76880d2040 con 0x7f76880d16c0 2024-09-11T23:20:56.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.026+0000 7f7687400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76880d16c0 0x7f76880d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:56.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.026+0000 7f767e000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f768806dfd0 0x7f768806e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:56.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.026+0000 7f7686a00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f768815e530 0x7f7688073080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:57878/0 (socket says 172.21.15.144:57878) 2024-09-11T23:20:56.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.026+0000 7f7686a00640 1 -- 172.21.15.144:0/3245476429 learned_addr learned my addr 172.21.15.144:0/3245476429 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:20:56.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.027+0000 7f767e000640 1 -- 172.21.15.144:0/3245476429 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76880d16c0 msgr2=0x7f76880d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:56.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.027+0000 7f767e000640 1 --2- 172.21.15.144:0/3245476429 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76880d16c0 0x7f76880d1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:56.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.027+0000 7f767e000640 1 -- 172.21.15.144:0/3245476429 >> v1:172.21.15.165:6789/0 conn(0x7f768815e530 legacy=0x7f7688073080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:56.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.027+0000 7f767e000640 1 -- 172.21.15.144:0/3245476429 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768806d4f0 con 0x7f768806dfd0 2024-09-11T23:20:56.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.028+0000 7f767e000640 1 --2- 172.21.15.144:0/3245476429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f768806dfd0 0x7f768806e8d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f76700097a0 tx=0x7f767002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeb681d6e5365425 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:56.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.028+0000 7f7686000640 1 -- 172.21.15.144:0/3245476429 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670037070 con 0x7f768806dfd0 2024-09-11T23:20:56.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.028+0000 7f7686000640 1 -- 172.21.15.144:0/3245476429 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7670032440 con 0x7f768806dfd0 2024-09-11T23:20:56.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.028+0000 7f7686000640 1 -- 172.21.15.144:0/3245476429 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670032810 con 0x7f768806dfd0 2024-09-11T23:20:56.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.029+0000 7f7687e00640 1 -- 172.21.15.144:0/3245476429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f768806dfd0 msgr2=0x7f768806e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:56.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.029+0000 7f7687e00640 1 --2- 172.21.15.144:0/3245476429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f768806dfd0 0x7f768806e8d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f76700097a0 tx=0x7f767002a180 comp rx=0 tx=0).stop 2024-09-11T23:20:56.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.029+0000 7f7687e00640 1 -- 172.21.15.144:0/3245476429 shutdown_connections 2024-09-11T23:20:56.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.029+0000 7f7687e00640 1 --2- 172.21.15.144:0/3245476429 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76880d16c0 0x7f76880d1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:56.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.029+0000 7f7687e00640 1 --2- 172.21.15.144:0/3245476429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f768806dfd0 0x7f768806e8d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:56.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.029+0000 7f7687e00640 1 -- 172.21.15.144:0/3245476429 >> 172.21.15.144:0/3245476429 conn(0x7f76880b40d0 msgr2=0x7f76880b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:56.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.029+0000 7f7687e00640 1 -- 172.21.15.144:0/3245476429 shutdown_connections 2024-09-11T23:20:56.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.029+0000 7f7687e00640 1 -- 172.21.15.144:0/3245476429 wait complete. 2024-09-11T23:20:56.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.031+0000 7f7687e00640 1 Processor -- start 2024-09-11T23:20:56.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.031+0000 7f7687e00640 1 -- start start 2024-09-11T23:20:56.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.032+0000 7f7687e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f768806dfd0 0x7f76880b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:56.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.032+0000 7f7687e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76880d16c0 0x7f7688150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:56.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.032+0000 7f7687e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f768815e530 0x7f76880b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.032+0000 7f7687e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f768806dab0 con 0x7f76880d16c0 2024-09-11T23:20:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.032+0000 7f7687e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7688073b40 con 0x7f768806dfd0 2024-09-11T23:20:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.032+0000 7f7687e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f768815e910 con 0x7f768815e530 2024-09-11T23:20:56.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.032+0000 7f767e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76880d16c0 0x7f7688150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:56.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.032+0000 7f767e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76880d16c0 0x7f7688150930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53332/0 (socket says 172.21.15.144:53332) 2024-09-11T23:20:56.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.032+0000 7f767e000640 1 -- 172.21.15.144:0/1597012752 learned_addr learned my addr 172.21.15.144:0/1597012752 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:56.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.032+0000 7f7686a00640 1 --2- 172.21.15.144:0/1597012752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f768806dfd0 0x7f76880b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:56.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.032+0000 7f767e000640 1 -- 172.21.15.144:0/1597012752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f768815e530 msgr2=0x7f76880b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:56.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.032+0000 7f7687400640 1 --2- 172.21.15.144:0/1597012752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f768815e530 0x7f76880b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:56.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.032+0000 7f767e000640 1 --2- 172.21.15.144:0/1597012752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f768815e530 0x7f76880b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.032+0000 7f767e000640 1 -- 172.21.15.144:0/1597012752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f768806dfd0 msgr2=0x7f76880b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.032+0000 7f767e000640 1 --2- 172.21.15.144:0/1597012752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f768806dfd0 0x7f76880b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.032+0000 7f767e000640 1 -- 172.21.15.144:0/1597012752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76880b14a0 con 0x7f76880d16c0 2024-09-11T23:20:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.032+0000 7f7686a00640 1 --2- 172.21.15.144:0/1597012752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f768806dfd0 0x7f76880b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.032+0000 7f7687400640 1 --2- 172.21.15.144:0/1597012752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f768815e530 0x7f76880b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:20:56.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.033+0000 7f767e000640 1 --2- 172.21.15.144:0/1597012752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76880d16c0 0x7f7688150930 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f76700098c0 tx=0x7f76700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:56.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.033+0000 7f767f400640 1 -- 172.21.15.144:0/1597012752 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670037040 con 0x7f76880d16c0 2024-09-11T23:20:56.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.033+0000 7f767f400640 1 -- 172.21.15.144:0/1597012752 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7670030500 con 0x7f76880d16c0 2024-09-11T23:20:56.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.033+0000 7f767f400640 1 -- 172.21.15.144:0/1597012752 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76700308d0 con 0x7f76880d16c0 2024-09-11T23:20:56.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.033+0000 7f7687e00640 1 -- 172.21.15.144:0/1597012752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7688150e70 con 0x7f76880d16c0 2024-09-11T23:20:56.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.033+0000 7f7687e00640 1 -- 172.21.15.144:0/1597012752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7688153050 con 0x7f76880d16c0 2024-09-11T23:20:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.034+0000 7f7687e00640 1 -- 172.21.15.144:0/1597012752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7688073d50 con 0x7f76880d16c0 2024-09-11T23:20:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.035+0000 7f767f400640 1 -- 172.21.15.144:0/1597012752 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f7670044020 con 0x7f76880d16c0 2024-09-11T23:20:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.036+0000 7f767f400640 1 --2- 172.21.15.144:0/1597012752 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f766406c010 0x7f766406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.036+0000 7f767f400640 1 -- 172.21.15.144:0/1597012752 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4857+0+0 (secure 0 0 0) 0x7f76700ab1f0 con 0x7f76880d16c0 2024-09-11T23:20:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.036+0000 7f7686a00640 1 --2- 172.21.15.144:0/1597012752 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f766406c010 0x7f766406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.037+0000 7f7686a00640 1 --2- 172.21.15.144:0/1597012752 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f766406c010 0x7f766406e4d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7678000f60 tx=0x7f7678009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:56.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.040+0000 7f767f400640 1 -- 172.21.15.144:0/1597012752 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7688073d50 con 0x7f76880d16c0 2024-09-11T23:20:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.217+0000 7f7687e00640 1 -- 172.21.15.144:0/1597012752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7688070410 con 0x7f76880d16c0 2024-09-11T23:20:56.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.217+0000 7f767f400640 1 -- 172.21.15.144:0/1597012752 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v55) ==== 84+0+65 (secure 0 0 0) 0x7f7670079b40 con 0x7f76880d16c0 2024-09-11T23:20:56.220 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:20:56.220 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:20:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:20:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-11T23:20:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-11T23:20:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:20:56.221 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:20:56.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.220+0000 7f7687e00640 1 -- 172.21.15.144:0/1597012752 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f766406c010 msgr2=0x7f766406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:56.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.220+0000 7f7687e00640 1 --2- 172.21.15.144:0/1597012752 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f766406c010 0x7f766406e4d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7678000f60 tx=0x7f7678009040 comp rx=0 tx=0).stop 2024-09-11T23:20:56.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.220+0000 7f7687e00640 1 -- 172.21.15.144:0/1597012752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76880d16c0 msgr2=0x7f7688150930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:56.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.220+0000 7f7687e00640 1 --2- 172.21.15.144:0/1597012752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76880d16c0 0x7f7688150930 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f76700098c0 tx=0x7f76700046c0 comp rx=0 tx=0).stop 2024-09-11T23:20:56.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.220+0000 7f7687e00640 1 -- 172.21.15.144:0/1597012752 shutdown_connections 2024-09-11T23:20:56.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.220+0000 7f7687e00640 1 --2- 172.21.15.144:0/1597012752 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f766406c010 0x7f766406e4d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:56.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.220+0000 7f7687e00640 1 --2- 172.21.15.144:0/1597012752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f768815e530 0x7f76880b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:56.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.220+0000 7f7687e00640 1 --2- 172.21.15.144:0/1597012752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76880d16c0 0x7f7688150930 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:56.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.220+0000 7f7687e00640 1 --2- 172.21.15.144:0/1597012752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f768806dfd0 0x7f76880b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:56.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.220+0000 7f7687e00640 1 -- 172.21.15.144:0/1597012752 >> 172.21.15.144:0/1597012752 conn(0x7f76880b40d0 msgr2=0x7f768815b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:56.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.220+0000 7f7687e00640 1 -- 172.21.15.144:0/1597012752 shutdown_connections 2024-09-11T23:20:56.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.220+0000 7f7687e00640 1 -- 172.21.15.144:0/1597012752 wait complete. 2024-09-11T23:20:56.238 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:20:56.238 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:20:56.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.396+0000 7f6363e00640 1 Processor -- start 2024-09-11T23:20:56.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.397+0000 7f6363e00640 1 -- start start 2024-09-11T23:20:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.398+0000 7f6363e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f635c145d90 0x7f635c0ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:56.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.398+0000 7f6363e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f635c0cfce0 0x7f635c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:56.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.398+0000 7f6363e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f635c0b4240 con 0x7f635c0cd490 2024-09-11T23:20:56.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.398+0000 7f6363e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f635c06d080 con 0x7f635c0cfce0 2024-09-11T23:20:56.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.398+0000 7f6363e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f635c0b4520 con 0x7f635c145d90 2024-09-11T23:20:56.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.398+0000 7f6361e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f635c0cfce0 0x7f635c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:56.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.398+0000 7f6361e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f635c0cfce0 0x7f635c06d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53344/0 (socket says 172.21.15.144:53344) 2024-09-11T23:20:56.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.398+0000 7f6361e00640 1 -- 172.21.15.144:0/3221744603 learned_addr learned my addr 172.21.15.144:0/3221744603 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:56.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.398+0000 7f6361400640 1 --2- 172.21.15.144:0/3221744603 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f635c145d90 0x7f635c0ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:56.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.399+0000 7f6361e00640 1 -- 172.21.15.144:0/3221744603 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f635c145d90 msgr2=0x7f635c0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:56.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.399+0000 7f6361e00640 1 --2- 172.21.15.144:0/3221744603 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f635c145d90 0x7f635c0ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:56.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.399+0000 7f6361e00640 1 -- 172.21.15.144:0/3221744603 >> v1:172.21.15.165:6789/0 conn(0x7f635c0cd490 legacy=0x7f635c0cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:56.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.399+0000 7f6361e00640 1 -- 172.21.15.144:0/3221744603 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635c0b4800 con 0x7f635c0cfce0 2024-09-11T23:20:56.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.399+0000 7f635be00640 1 -- 172.21.15.144:0/3221744603 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3273534390 0 0) 0x7f635c0b4240 con 0x7f635c0cd490 2024-09-11T23:20:56.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.400+0000 7f6361e00640 1 --2- 172.21.15.144:0/3221744603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f635c0cfce0 0x7f635c06d4f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6354009e50 tx=0x7f635402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76008f9c65a8dd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:56.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.400+0000 7f635be00640 1 -- 172.21.15.144:0/3221744603 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354036070 con 0x7f635c0cfce0 2024-09-11T23:20:56.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.400+0000 7f635be00640 1 -- 172.21.15.144:0/3221744603 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6354031600 con 0x7f635c0cfce0 2024-09-11T23:20:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.400+0000 7f635be00640 1 -- 172.21.15.144:0/3221744603 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63540319d0 con 0x7f635c0cfce0 2024-09-11T23:20:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.400+0000 7f6363e00640 1 -- 172.21.15.144:0/3221744603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f635c0cfce0 msgr2=0x7f635c06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.400+0000 7f6363e00640 1 --2- 172.21.15.144:0/3221744603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f635c0cfce0 0x7f635c06d4f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6354009e50 tx=0x7f635402a710 comp rx=0 tx=0).stop 2024-09-11T23:20:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.400+0000 7f6363e00640 1 -- 172.21.15.144:0/3221744603 shutdown_connections 2024-09-11T23:20:56.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.400+0000 7f6363e00640 1 --2- 172.21.15.144:0/3221744603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f635c0cfce0 0x7f635c06d4f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:56.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.400+0000 7f6363e00640 1 --2- 172.21.15.144:0/3221744603 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f635c145d90 0x7f635c0ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:56.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.401+0000 7f6363e00640 1 -- 172.21.15.144:0/3221744603 >> 172.21.15.144:0/3221744603 conn(0x7f635c06bba0 msgr2=0x7f635c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:56.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.401+0000 7f6363e00640 1 -- 172.21.15.144:0/3221744603 shutdown_connections 2024-09-11T23:20:56.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.401+0000 7f6363e00640 1 -- 172.21.15.144:0/3221744603 wait complete. 2024-09-11T23:20:56.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.402+0000 7f6363e00640 1 Processor -- start 2024-09-11T23:20:56.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.402+0000 7f6363e00640 1 -- start start 2024-09-11T23:20:56.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.403+0000 7f6363e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f635c0cd490 0x7f635c15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:56.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.403+0000 7f6363e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f635c0cfce0 0x7f635c15c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:56.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.403+0000 7f6363e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f635c145d90 0x7f635c0c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:56.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.403+0000 7f6363e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f635c0b5790 con 0x7f635c0cfce0 2024-09-11T23:20:56.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.403+0000 7f6363e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f635c0b5610 con 0x7f635c145d90 2024-09-11T23:20:56.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.403+0000 7f6363e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f635c146170 con 0x7f635c0cd490 2024-09-11T23:20:56.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.404+0000 7f6360a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f635c0cfce0 0x7f635c15c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:56.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.404+0000 7f6360a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f635c0cfce0 0x7f635c15c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53360/0 (socket says 172.21.15.144:53360) 2024-09-11T23:20:56.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.404+0000 7f6360a00640 1 -- 172.21.15.144:0/3677910525 learned_addr learned my addr 172.21.15.144:0/3677910525 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:56.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.404+0000 7f6361e00640 1 --2- 172.21.15.144:0/3677910525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f635c145d90 0x7f635c0c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:56.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.404+0000 7f6361400640 1 --2- 172.21.15.144:0/3677910525 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f635c0cd490 0x7f635c15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:56.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.404+0000 7f6360a00640 1 -- 172.21.15.144:0/3677910525 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f635c0cd490 msgr2=0x7f635c15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:56.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.404+0000 7f6360a00640 1 --2- 172.21.15.144:0/3677910525 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f635c0cd490 0x7f635c15d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:56.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.404+0000 7f6360a00640 1 -- 172.21.15.144:0/3677910525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f635c145d90 msgr2=0x7f635c0c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.404+0000 7f6360a00640 1 --2- 172.21.15.144:0/3677910525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f635c145d90 0x7f635c0c79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.404+0000 7f6360a00640 1 -- 172.21.15.144:0/3677910525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635c15c660 con 0x7f635c0cfce0 2024-09-11T23:20:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.404+0000 7f6360a00640 1 --2- 172.21.15.144:0/3677910525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f635c0cfce0 0x7f635c15c120 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f634800c3e0 tx=0x7f634800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.404+0000 7f6359600640 1 -- 172.21.15.144:0/3677910525 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348017070 con 0x7f635c0cfce0 2024-09-11T23:20:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.405+0000 7f6359600640 1 -- 172.21.15.144:0/3677910525 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63480035f0 con 0x7f635c0cfce0 2024-09-11T23:20:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.405+0000 7f6363e00640 1 -- 172.21.15.144:0/3677910525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f635c15d990 con 0x7f635c0cfce0 2024-09-11T23:20:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.405+0000 7f6359600640 1 -- 172.21.15.144:0/3677910525 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348003a00 con 0x7f635c0cfce0 2024-09-11T23:20:56.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.405+0000 7f6363e00640 1 -- 172.21.15.144:0/3677910525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f635c15df50 con 0x7f635c0cfce0 2024-09-11T23:20:56.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.406+0000 7f6363e00640 1 -- 172.21.15.144:0/3677910525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f635c0ccf50 con 0x7f635c0cfce0 2024-09-11T23:20:56.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.407+0000 7f6359600640 1 -- 172.21.15.144:0/3677910525 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f634801a070 con 0x7f635c0cfce0 2024-09-11T23:20:56.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.407+0000 7f6359600640 1 --2- 172.21.15.144:0/3677910525 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f633c06bfe0 0x7f633c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:56.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.407+0000 7f6359600640 1 -- 172.21.15.144:0/3677910525 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4857+0+0 (secure 0 0 0) 0x7f634808a120 con 0x7f635c0cfce0 2024-09-11T23:20:56.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.408+0000 7f6361400640 1 --2- 172.21.15.144:0/3677910525 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f633c06bfe0 0x7f633c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:56.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.408+0000 7f6361400640 1 --2- 172.21.15.144:0/3677910525 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f633c06bfe0 0x7f633c06e4a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6350009b40 tx=0x7f6350009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:56.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.412+0000 7f6359600640 1 -- 172.21.15.144:0/3677910525 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6348058560 con 0x7f635c0cfce0 2024-09-11T23:20:56.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:56.590+0000 7f6363e00640 1 -- 172.21.15.144:0/3677910525 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f635c0af8b0 con 0x7f635c0cfce0 2024-09-11T23:20:57.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.433+0000 7f6359600640 1 -- 172.21.15.144:0/3677910525 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v56) ==== 138+0+0 (secure 0 0 0) 0x7f634805c860 con 0x7f635c0cfce0 2024-09-11T23:20:57.434 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-11T23:20:57.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.435+0000 7f6363e00640 1 -- 172.21.15.144:0/3677910525 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f633c06bfe0 msgr2=0x7f633c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:57.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.435+0000 7f6363e00640 1 --2- 172.21.15.144:0/3677910525 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f633c06bfe0 0x7f633c06e4a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6350009b40 tx=0x7f6350009190 comp rx=0 tx=0).stop 2024-09-11T23:20:57.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.435+0000 7f6363e00640 1 -- 172.21.15.144:0/3677910525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f635c0cfce0 msgr2=0x7f635c15c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:57.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.435+0000 7f6363e00640 1 --2- 172.21.15.144:0/3677910525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f635c0cfce0 0x7f635c15c120 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f634800c3e0 tx=0x7f634800c8a0 comp rx=0 tx=0).stop 2024-09-11T23:20:57.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.436+0000 7f6363e00640 1 -- 172.21.15.144:0/3677910525 shutdown_connections 2024-09-11T23:20:57.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.436+0000 7f6363e00640 1 --2- 172.21.15.144:0/3677910525 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f633c06bfe0 0x7f633c06e4a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:57.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.436+0000 7f6363e00640 1 --2- 172.21.15.144:0/3677910525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f635c145d90 0x7f635c0c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:57.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.436+0000 7f6363e00640 1 --2- 172.21.15.144:0/3677910525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f635c0cfce0 0x7f635c15c120 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:57.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.436+0000 7f6363e00640 1 --2- 172.21.15.144:0/3677910525 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f635c0cd490 0x7f635c15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:57.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.436+0000 7f6363e00640 1 -- 172.21.15.144:0/3677910525 >> 172.21.15.144:0/3677910525 conn(0x7f635c06bba0 msgr2=0x7f635c0cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:57.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.436+0000 7f6363e00640 1 -- 172.21.15.144:0/3677910525 shutdown_connections 2024-09-11T23:20:57.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.436+0000 7f6363e00640 1 -- 172.21.15.144:0/3677910525 wait complete. 2024-09-11T23:20:57.459 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:20:57.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.620+0000 7fa24de00640 1 Processor -- start 2024-09-11T23:20:57.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.620+0000 7fa24de00640 1 -- start start 2024-09-11T23:20:57.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.621+0000 7fa24de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa248145d90 0x7fa2480ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:57.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.621+0000 7fa24de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa2480cd490 0x7fa2480cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:57.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.621+0000 7fa24de00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2480b4240 con 0x7fa2480cfb10 2024-09-11T23:20:57.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.621+0000 7fa24de00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa24806d080 con 0x7fa2480cd490 2024-09-11T23:20:57.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.621+0000 7fa24de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa2480b4520 con 0x7fa248145d90 2024-09-11T23:20:57.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.621+0000 7fa246000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa2480cd490 0x7fa2480cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:57.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.621+0000 7fa246000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa2480cd490 0x7fa2480cf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53368/0 (socket says 172.21.15.144:53368) 2024-09-11T23:20:57.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.621+0000 7fa246000640 1 -- 172.21.15.144:0/3297552020 learned_addr learned my addr 172.21.15.144:0/3297552020 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:57.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.622+0000 7fa246a00640 1 --2- 172.21.15.144:0/3297552020 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa248145d90 0x7fa2480ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:57.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.622+0000 7fa246000640 1 -- 172.21.15.144:0/3297552020 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa248145d90 msgr2=0x7fa2480ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:57.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.622+0000 7fa246000640 1 --2- 172.21.15.144:0/3297552020 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa248145d90 0x7fa2480ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:57.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.622+0000 7fa246000640 1 -- 172.21.15.144:0/3297552020 >> v1:172.21.15.165:6789/0 conn(0x7fa2480cfb10 legacy=0x7fa2481601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:57.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.622+0000 7fa246000640 1 -- 172.21.15.144:0/3297552020 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2480b4800 con 0x7fa2480cd490 2024-09-11T23:20:57.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.623+0000 7fa246000640 1 --2- 172.21.15.144:0/3297552020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2480cd490 0x7fa2480cf5d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa234009870 tx=0x7fa23402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6ef41b54ffa13 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:57.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.623+0000 7fa245600640 1 -- 172.21.15.144:0/3297552020 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234037070 con 0x7fa2480cd490 2024-09-11T23:20:57.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.623+0000 7fa245600640 1 -- 172.21.15.144:0/3297552020 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa234032440 con 0x7fa2480cd490 2024-09-11T23:20:57.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.623+0000 7fa245600640 1 -- 172.21.15.144:0/3297552020 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234032810 con 0x7fa2480cd490 2024-09-11T23:20:57.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.624+0000 7fa24de00640 1 -- 172.21.15.144:0/3297552020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2480cd490 msgr2=0x7fa2480cf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:57.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.624+0000 7fa24de00640 1 --2- 172.21.15.144:0/3297552020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2480cd490 0x7fa2480cf5d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa234009870 tx=0x7fa23402a270 comp rx=0 tx=0).stop 2024-09-11T23:20:57.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.624+0000 7fa24de00640 1 -- 172.21.15.144:0/3297552020 shutdown_connections 2024-09-11T23:20:57.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.624+0000 7fa24de00640 1 --2- 172.21.15.144:0/3297552020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2480cd490 0x7fa2480cf5d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:57.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.624+0000 7fa24de00640 1 --2- 172.21.15.144:0/3297552020 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa248145d90 0x7fa2480ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:57.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.624+0000 7fa24de00640 1 -- 172.21.15.144:0/3297552020 >> 172.21.15.144:0/3297552020 conn(0x7fa24806bba0 msgr2=0x7fa24806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:57.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.624+0000 7fa24de00640 1 -- 172.21.15.144:0/3297552020 shutdown_connections 2024-09-11T23:20:57.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.624+0000 7fa24de00640 1 -- 172.21.15.144:0/3297552020 wait complete. 2024-09-11T23:20:57.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.625+0000 7fa24de00640 1 Processor -- start 2024-09-11T23:20:57.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.626+0000 7fa24de00640 1 -- start start 2024-09-11T23:20:57.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.626+0000 7fa24de00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2480cd490 0x7fa248141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:57.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.626+0000 7fa24de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2480cfb10 0x7fa24813db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:57.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.626+0000 7fa24de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa248145d90 0x7fa24813e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:57.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.626+0000 7fa24de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa2480b5610 con 0x7fa248145d90 2024-09-11T23:20:57.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.626+0000 7fa24de00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa2480cffc0 con 0x7fa2480cd490 2024-09-11T23:20:57.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.626+0000 7fa24de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa2480b5790 con 0x7fa2480cfb10 2024-09-11T23:20:57.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.627+0000 7fa247400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa248145d90 0x7fa24813e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:57.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.627+0000 7fa247400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa248145d90 0x7fa24813e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53370/0 (socket says 172.21.15.144:53370) 2024-09-11T23:20:57.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.627+0000 7fa247400640 1 -- 172.21.15.144:0/4280688076 learned_addr learned my addr 172.21.15.144:0/4280688076 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:57.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.627+0000 7fa246a00640 1 --2- 172.21.15.144:0/4280688076 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2480cd490 0x7fa248141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:57.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.627+0000 7fa246000640 1 --2- 172.21.15.144:0/4280688076 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2480cfb10 0x7fa24813db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:57.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.627+0000 7fa247400640 1 -- 172.21.15.144:0/4280688076 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2480cfb10 msgr2=0x7fa24813db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:57.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.627+0000 7fa247400640 1 --2- 172.21.15.144:0/4280688076 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2480cfb10 0x7fa24813db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:57.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.627+0000 7fa247400640 1 -- 172.21.15.144:0/4280688076 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2480cd490 msgr2=0x7fa248141920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:57.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.627+0000 7fa247400640 1 --2- 172.21.15.144:0/4280688076 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2480cd490 0x7fa248141920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:57.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.627+0000 7fa247400640 1 -- 172.21.15.144:0/4280688076 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa248142000 con 0x7fa248145d90 2024-09-11T23:20:57.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.627+0000 7fa247400640 1 --2- 172.21.15.144:0/4280688076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa248145d90 0x7fa24813e0d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa24000c760 tx=0x7fa24000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:57.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.628+0000 7fa23f400640 1 -- 172.21.15.144:0/4280688076 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240003b70 con 0x7fa248145d90 2024-09-11T23:20:57.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.628+0000 7fa23f400640 1 -- 172.21.15.144:0/4280688076 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa240003d30 con 0x7fa248145d90 2024-09-11T23:20:57.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.628+0000 7fa23f400640 1 -- 172.21.15.144:0/4280688076 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24000aa90 con 0x7fa248145d90 2024-09-11T23:20:57.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.628+0000 7fa24de00640 1 -- 172.21.15.144:0/4280688076 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2481422e0 con 0x7fa248145d90 2024-09-11T23:20:57.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.628+0000 7fa24de00640 1 -- 172.21.15.144:0/4280688076 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2481428a0 con 0x7fa248145d90 2024-09-11T23:20:57.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.629+0000 7fa24de00640 1 -- 172.21.15.144:0/4280688076 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa248146200 con 0x7fa248145d90 2024-09-11T23:20:57.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.630+0000 7fa23f400640 1 -- 172.21.15.144:0/4280688076 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7fa24000ac30 con 0x7fa248145d90 2024-09-11T23:20:57.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.631+0000 7fa23f400640 1 --2- 172.21.15.144:0/4280688076 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa22806bfe0 0x7fa22806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:57.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.631+0000 7fa23f400640 1 -- 172.21.15.144:0/4280688076 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5227+0+0 (secure 0 0 0) 0x7fa24008acc0 con 0x7fa248145d90 2024-09-11T23:20:57.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.631+0000 7fa246a00640 1 --2- 172.21.15.144:0/4280688076 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa22806bfe0 0x7fa22806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:57.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.631+0000 7fa246a00640 1 --2- 172.21.15.144:0/4280688076 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa22806bfe0 0x7fa22806e4a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa238006fd0 tx=0x7fa238008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:57.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.635+0000 7fa23f400640 1 -- 172.21.15.144:0/4280688076 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa240091080 con 0x7fa248145d90 2024-09-11T23:20:57.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:57.813+0000 7fa24de00640 1 -- 172.21.15.144:0/4280688076 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa24806e590 con 0x7fa248145d90 2024-09-11T23:20:58.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.441+0000 7fa23f400640 1 -- 172.21.15.144:0/4280688076 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v57) ==== 170+0+0 (secure 0 0 0) 0x7fa240058f70 con 0x7fa248145d90 2024-09-11T23:20:58.442 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-11T23:20:58.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.445+0000 7fa24de00640 1 -- 172.21.15.144:0/4280688076 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa22806bfe0 msgr2=0x7fa22806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:58.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.445+0000 7fa24de00640 1 --2- 172.21.15.144:0/4280688076 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa22806bfe0 0x7fa22806e4a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa238006fd0 tx=0x7fa238008040 comp rx=0 tx=0).stop 2024-09-11T23:20:58.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.445+0000 7fa24de00640 1 -- 172.21.15.144:0/4280688076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa248145d90 msgr2=0x7fa24813e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:58.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.445+0000 7fa24de00640 1 --2- 172.21.15.144:0/4280688076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa248145d90 0x7fa24813e0d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa24000c760 tx=0x7fa24000cc20 comp rx=0 tx=0).stop 2024-09-11T23:20:58.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.445+0000 7fa24de00640 1 -- 172.21.15.144:0/4280688076 shutdown_connections 2024-09-11T23:20:58.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.445+0000 7fa24de00640 1 --2- 172.21.15.144:0/4280688076 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa22806bfe0 0x7fa22806e4a0 secure :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa238006fd0 tx=0x7fa238008040 comp rx=0 tx=0).stop 2024-09-11T23:20:58.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.445+0000 7fa24de00640 1 --2- 172.21.15.144:0/4280688076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa248145d90 0x7fa24813e0d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:58.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.445+0000 7fa24de00640 1 --2- 172.21.15.144:0/4280688076 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2480cfb10 0x7fa24813db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:58.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.445+0000 7fa24de00640 1 --2- 172.21.15.144:0/4280688076 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2480cd490 0x7fa248141920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:58.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.445+0000 7fa24de00640 1 -- 172.21.15.144:0/4280688076 >> 172.21.15.144:0/4280688076 conn(0x7fa24806bba0 msgr2=0x7fa2480b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:58.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.446+0000 7fa24de00640 1 -- 172.21.15.144:0/4280688076 shutdown_connections 2024-09-11T23:20:58.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.446+0000 7fa24de00640 1 -- 172.21.15.144:0/4280688076 wait complete. 2024-09-11T23:20:58.476 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:20:58.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.632+0000 7efc3b400640 1 Processor -- start 2024-09-11T23:20:58.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.632+0000 7efc3b400640 1 -- start start 2024-09-11T23:20:58.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.633+0000 7efc3b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc34161e30 0x7efc340d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:58.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.633+0000 7efc3b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efc3406dfd0 0x7efc340b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:58.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.633+0000 7efc3b400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc340cf9a0 con 0x7efc340b3d50 2024-09-11T23:20:58.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.633+0000 7efc3b400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efc340cfcf0 con 0x7efc3406dfd0 2024-09-11T23:20:58.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.633+0000 7efc3b400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efc34162210 con 0x7efc34161e30 2024-09-11T23:20:58.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.633+0000 7efc39400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efc3406dfd0 0x7efc340b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:58.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.633+0000 7efc39400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efc3406dfd0 0x7efc340b78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53376/0 (socket says 172.21.15.144:53376) 2024-09-11T23:20:58.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.633+0000 7efc39400640 1 -- 172.21.15.144:0/2443728220 learned_addr learned my addr 172.21.15.144:0/2443728220 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:58.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.634+0000 7efc38a00640 1 --2- 172.21.15.144:0/2443728220 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc34161e30 0x7efc340d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:58.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.634+0000 7efc39400640 1 -- 172.21.15.144:0/2443728220 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc34161e30 msgr2=0x7efc340d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:58.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.634+0000 7efc39400640 1 --2- 172.21.15.144:0/2443728220 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc34161e30 0x7efc340d34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:58.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.634+0000 7efc39400640 1 -- 172.21.15.144:0/2443728220 >> v1:172.21.15.165:6789/0 conn(0x7efc340b3d50 legacy=0x7efc3406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:58.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.634+0000 7efc39400640 1 -- 172.21.15.144:0/2443728220 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc340d5210 con 0x7efc3406dfd0 2024-09-11T23:20:58.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.635+0000 7efc39400640 1 --2- 172.21.15.144:0/2443728220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3406dfd0 0x7efc340b78b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7efc3408d8a0 tx=0x7efc2c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35cf1462857f987 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:58.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.635+0000 7efc33e00640 1 -- 172.21.15.144:0/2443728220 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c036070 con 0x7efc3406dfd0 2024-09-11T23:20:58.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.635+0000 7efc33e00640 1 -- 172.21.15.144:0/2443728220 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2c031600 con 0x7efc3406dfd0 2024-09-11T23:20:58.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.635+0000 7efc33e00640 1 -- 172.21.15.144:0/2443728220 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c0319d0 con 0x7efc3406dfd0 2024-09-11T23:20:58.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.636+0000 7efc3b400640 1 -- 172.21.15.144:0/2443728220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3406dfd0 msgr2=0x7efc340b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:58.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.636+0000 7efc3b400640 1 --2- 172.21.15.144:0/2443728220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3406dfd0 0x7efc340b78b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7efc3408d8a0 tx=0x7efc2c02a6c0 comp rx=0 tx=0).stop 2024-09-11T23:20:58.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.636+0000 7efc3b400640 1 -- 172.21.15.144:0/2443728220 shutdown_connections 2024-09-11T23:20:58.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.636+0000 7efc3b400640 1 --2- 172.21.15.144:0/2443728220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc3406dfd0 0x7efc340b78b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:58.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.636+0000 7efc3b400640 1 --2- 172.21.15.144:0/2443728220 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc34161e30 0x7efc340d34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:58.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.636+0000 7efc3b400640 1 -- 172.21.15.144:0/2443728220 >> 172.21.15.144:0/2443728220 conn(0x7efc340d1870 msgr2=0x7efc340d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:58.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.636+0000 7efc3b400640 1 -- 172.21.15.144:0/2443728220 shutdown_connections 2024-09-11T23:20:58.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.636+0000 7efc3b400640 1 -- 172.21.15.144:0/2443728220 wait complete. 2024-09-11T23:20:58.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.637+0000 7efc3b400640 1 Processor -- start 2024-09-11T23:20:58.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.637+0000 7efc3b400640 1 -- start start 2024-09-11T23:20:58.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.638+0000 7efc3b400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc3406dfd0 0x7efc3414ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:58.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.638+0000 7efc3b400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc340b3d50 0x7efc340c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:58.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.638+0000 7efc3b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc34161e30 0x7efc340cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:58.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.638+0000 7efc3b400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efc340d39e0 con 0x7efc34161e30 2024-09-11T23:20:58.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.638+0000 7efc3b400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efc340b3950 con 0x7efc340b3d50 2024-09-11T23:20:58.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.638+0000 7efc3b400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efc340ca290 con 0x7efc3406dfd0 2024-09-11T23:20:58.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.639+0000 7efc39400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc34161e30 0x7efc340cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:58.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.639+0000 7efc38a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc3406dfd0 0x7efc3414ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:58.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.639+0000 7efc39400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc34161e30 0x7efc340cbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53382/0 (socket says 172.21.15.144:53382) 2024-09-11T23:20:58.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.639+0000 7efc38a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc3406dfd0 0x7efc3414ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50770/0 (socket says 172.21.15.144:50770) 2024-09-11T23:20:58.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.639+0000 7efc39400640 1 -- 172.21.15.144:0/1494896032 learned_addr learned my addr 172.21.15.144:0/1494896032 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:58.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.639+0000 7efc2be00640 1 --2- 172.21.15.144:0/1494896032 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc340b3d50 0x7efc340c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:58.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.639+0000 7efc39400640 1 -- 172.21.15.144:0/1494896032 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc3406dfd0 msgr2=0x7efc3414ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:58.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.639+0000 7efc39400640 1 --2- 172.21.15.144:0/1494896032 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc3406dfd0 0x7efc3414ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:58.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.639+0000 7efc39400640 1 -- 172.21.15.144:0/1494896032 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc340b3d50 msgr2=0x7efc340c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:58.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.639+0000 7efc39400640 1 --2- 172.21.15.144:0/1494896032 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc340b3d50 0x7efc340c9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:58.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.639+0000 7efc39400640 1 -- 172.21.15.144:0/1494896032 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc340b4c90 con 0x7efc34161e30 2024-09-11T23:20:58.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.640+0000 7efc39400640 1 --2- 172.21.15.144:0/1494896032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc34161e30 0x7efc340cbb30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efc2c009f40 tx=0x7efc2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:58.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.640+0000 7efc31600640 1 -- 172.21.15.144:0/1494896032 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c036050 con 0x7efc34161e30 2024-09-11T23:20:58.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.640+0000 7efc31600640 1 -- 172.21.15.144:0/1494896032 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2c042070 con 0x7efc34161e30 2024-09-11T23:20:58.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.640+0000 7efc31600640 1 -- 172.21.15.144:0/1494896032 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c007bf0 con 0x7efc34161e30 2024-09-11T23:20:58.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.640+0000 7efc3b400640 1 -- 172.21.15.144:0/1494896032 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc340ca4c0 con 0x7efc34161e30 2024-09-11T23:20:58.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.640+0000 7efc3b400640 1 -- 172.21.15.144:0/1494896032 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc340caa80 con 0x7efc34161e30 2024-09-11T23:20:58.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.641+0000 7efc3b400640 1 -- 172.21.15.144:0/1494896032 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc34069190 con 0x7efc34161e30 2024-09-11T23:20:58.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.642+0000 7efc31600640 1 -- 172.21.15.144:0/1494896032 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7efc2c047460 con 0x7efc34161e30 2024-09-11T23:20:58.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.643+0000 7efc31600640 1 --2- 172.21.15.144:0/1494896032 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc1006bfe0 0x7efc1006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:58.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.643+0000 7efc31600640 1 -- 172.21.15.144:0/1494896032 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5609+0+0 (secure 0 0 0) 0x7efc2c0abeb0 con 0x7efc34161e30 2024-09-11T23:20:58.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.643+0000 7efc38a00640 1 --2- 172.21.15.144:0/1494896032 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc1006bfe0 0x7efc1006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:58.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.644+0000 7efc38a00640 1 --2- 172.21.15.144:0/1494896032 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc1006bfe0 0x7efc1006e4a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efc240079a0 tx=0x7efc24008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:58.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.648+0000 7efc31600640 1 -- 172.21.15.144:0/1494896032 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc2c079ed0 con 0x7efc34161e30 2024-09-11T23:20:58.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:58.857+0000 7efc3b400640 1 -- 172.21.15.144:0/1494896032 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7efc340b4e60 con 0x7efc34161e30 2024-09-11T23:20:59.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.451+0000 7efc31600640 1 -- 172.21.15.144:0/1494896032 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v31) ==== 172+0+0 (secure 0 0 0) 0x7efc2c07e1d0 con 0x7efc34161e30 2024-09-11T23:20:59.455 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 8 and data pool 9 2024-09-11T23:20:59.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.458+0000 7efc3b400640 1 -- 172.21.15.144:0/1494896032 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc1006bfe0 msgr2=0x7efc1006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:59.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.458+0000 7efc3b400640 1 --2- 172.21.15.144:0/1494896032 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc1006bfe0 0x7efc1006e4a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7efc240079a0 tx=0x7efc24008040 comp rx=0 tx=0).stop 2024-09-11T23:20:59.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.458+0000 7efc3b400640 1 -- 172.21.15.144:0/1494896032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc34161e30 msgr2=0x7efc340cbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:59.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.458+0000 7efc3b400640 1 --2- 172.21.15.144:0/1494896032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc34161e30 0x7efc340cbb30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efc2c009f40 tx=0x7efc2c004a40 comp rx=0 tx=0).stop 2024-09-11T23:20:59.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.461+0000 7efc3b400640 1 -- 172.21.15.144:0/1494896032 shutdown_connections 2024-09-11T23:20:59.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.461+0000 7efc3b400640 1 --2- 172.21.15.144:0/1494896032 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc1006bfe0 0x7efc1006e4a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:59.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.461+0000 7efc3b400640 1 --2- 172.21.15.144:0/1494896032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc34161e30 0x7efc340cbb30 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:59.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.461+0000 7efc3b400640 1 --2- 172.21.15.144:0/1494896032 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc340b3d50 0x7efc340c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:59.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.461+0000 7efc3b400640 1 --2- 172.21.15.144:0/1494896032 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc3406dfd0 0x7efc3414ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:59.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.461+0000 7efc3b400640 1 -- 172.21.15.144:0/1494896032 >> 172.21.15.144:0/1494896032 conn(0x7efc340d1870 msgr2=0x7efc3406d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:59.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.462+0000 7efc3b400640 1 -- 172.21.15.144:0/1494896032 shutdown_connections 2024-09-11T23:20:59.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.463+0000 7efc3b400640 1 -- 172.21.15.144:0/1494896032 wait complete. 2024-09-11T23:20:59.493 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:20:59.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.646+0000 7f8666400640 1 Processor -- start 2024-09-11T23:20:59.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.646+0000 7f8666400640 1 -- start start 2024-09-11T23:20:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.647+0000 7f8666400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f866015c180 0x7f86600cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.647+0000 7f8666400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86600ce230 0x7f86600cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.647+0000 7f8666400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f86600cf5b0 0x7f8660073120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.647+0000 7f8666400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f86600ce740 con 0x7f86600cf5b0 2024-09-11T23:20:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.647+0000 7f8666400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8660072640 con 0x7f866015c180 2024-09-11T23:20:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.647+0000 7f8666400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8660072920 con 0x7f86600ce230 2024-09-11T23:20:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.647+0000 7f865fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f86600cf5b0 0x7f8660073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.648+0000 7f865fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f86600cf5b0 0x7f8660073120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53396/0 (socket says 172.21.15.144:53396) 2024-09-11T23:20:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.648+0000 7f865fe00640 1 -- 172.21.15.144:0/2986858646 learned_addr learned my addr 172.21.15.144:0/2986858646 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.648+0000 7f865f400640 1 --2- 172.21.15.144:0/2986858646 >> v2:172.21.15.165:3300/0 conn(0x7f866015c180 0x7f86600cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.648+0000 7f865ea00640 1 --2- 172.21.15.144:0/2986858646 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86600ce230 0x7f86600cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.648+0000 7f865fe00640 1 -- 172.21.15.144:0/2986858646 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86600ce230 msgr2=0x7f86600cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.648+0000 7f865fe00640 1 --2- 172.21.15.144:0/2986858646 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86600ce230 0x7f86600cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.648+0000 7f865fe00640 1 -- 172.21.15.144:0/2986858646 >> v2:172.21.15.165:3300/0 conn(0x7f866015c180 msgr2=0x7f86600cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:20:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.648+0000 7f865fe00640 1 --2- 172.21.15.144:0/2986858646 >> v2:172.21.15.165:3300/0 conn(0x7f866015c180 0x7f86600cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.648+0000 7f865fe00640 1 -- 172.21.15.144:0/2986858646 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8660072c00 con 0x7f86600cf5b0 2024-09-11T23:20:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.648+0000 7f865f400640 1 --2- 172.21.15.144:0/2986858646 >> v2:172.21.15.165:3300/0 conn(0x7f866015c180 0x7f86600cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.648+0000 7f865ea00640 1 --2- 172.21.15.144:0/2986858646 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86600ce230 0x7f86600cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:20:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.649+0000 7f865fe00640 1 --2- 172.21.15.144:0/2986858646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86600cf5b0 0x7f8660073120 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f866006cc10 tx=0x7f865802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff51e07ab3b35ef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.649+0000 7f865e000640 1 -- 172.21.15.144:0/2986858646 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8658036070 con 0x7f86600cf5b0 2024-09-11T23:20:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.649+0000 7f865e000640 1 -- 172.21.15.144:0/2986858646 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8658031600 con 0x7f86600cf5b0 2024-09-11T23:20:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.649+0000 7f865e000640 1 -- 172.21.15.144:0/2986858646 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86580319d0 con 0x7f86600cf5b0 2024-09-11T23:20:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.650+0000 7f8666400640 1 -- 172.21.15.144:0/2986858646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86600cf5b0 msgr2=0x7f8660073120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.650+0000 7f8666400640 1 --2- 172.21.15.144:0/2986858646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86600cf5b0 0x7f8660073120 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f866006cc10 tx=0x7f865802a610 comp rx=0 tx=0).stop 2024-09-11T23:20:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.650+0000 7f8666400640 1 -- 172.21.15.144:0/2986858646 shutdown_connections 2024-09-11T23:20:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.650+0000 7f8666400640 1 --2- 172.21.15.144:0/2986858646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86600cf5b0 0x7f8660073120 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.650+0000 7f8666400640 1 --2- 172.21.15.144:0/2986858646 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86600ce230 0x7f86600cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.650+0000 7f8666400640 1 --2- 172.21.15.144:0/2986858646 >> v2:172.21.15.165:3300/0 conn(0x7f866015c180 0x7f86600cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.650+0000 7f8666400640 1 -- 172.21.15.144:0/2986858646 >> 172.21.15.144:0/2986858646 conn(0x7f8660062cc0 msgr2=0x7f866006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.650+0000 7f8666400640 1 -- 172.21.15.144:0/2986858646 shutdown_connections 2024-09-11T23:20:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.650+0000 7f8666400640 1 -- 172.21.15.144:0/2986858646 wait complete. 2024-09-11T23:20:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.651+0000 7f8666400640 1 Processor -- start 2024-09-11T23:20:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.652+0000 7f8666400640 1 -- start start 2024-09-11T23:20:59.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.652+0000 7f8666400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86600ce230 0x7f86601f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:59.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.652+0000 7f8666400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86600cf5b0 0x7f8660160590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:59.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.652+0000 7f8666400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f866015c180 0x7f866015a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:59.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.653+0000 7f8666400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f866015c560 con 0x7f86600ce230 2024-09-11T23:20:59.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.653+0000 7f8666400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f86600722f0 con 0x7f866015c180 2024-09-11T23:20:59.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.653+0000 7f8666400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f866015c6e0 con 0x7f86600cf5b0 2024-09-11T23:20:59.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.653+0000 7f865f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86600ce230 0x7f86601f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:59.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.653+0000 7f865f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86600ce230 0x7f86601f2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53412/0 (socket says 172.21.15.144:53412) 2024-09-11T23:20:59.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.653+0000 7f865f400640 1 -- 172.21.15.144:0/2684767198 learned_addr learned my addr 172.21.15.144:0/2684767198 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:20:59.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.653+0000 7f865f400640 1 -- 172.21.15.144:0/2684767198 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86600cf5b0 msgr2=0x7f8660160590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:59.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.653+0000 7f865f400640 1 --2- 172.21.15.144:0/2684767198 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86600cf5b0 0x7f8660160590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:59.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.653+0000 7f865f400640 1 -- 172.21.15.144:0/2684767198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f866015c180 msgr2=0x7f866015a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:59.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.653+0000 7f865f400640 1 --2- 172.21.15.144:0/2684767198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f866015c180 0x7f866015a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:59.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.653+0000 7f865f400640 1 -- 172.21.15.144:0/2684767198 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86601f2b70 con 0x7f86600ce230 2024-09-11T23:20:59.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.653+0000 7f865f400640 1 --2- 172.21.15.144:0/2684767198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86600ce230 0x7f86601f2630 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f865000e730 tx=0x7f865000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:59.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.654+0000 7f8657400640 1 -- 172.21.15.144:0/2684767198 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865000f040 con 0x7f86600ce230 2024-09-11T23:20:59.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.654+0000 7f8657400640 1 -- 172.21.15.144:0/2684767198 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8650004230 con 0x7f86600ce230 2024-09-11T23:20:59.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.654+0000 7f8657400640 1 -- 172.21.15.144:0/2684767198 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865000ee40 con 0x7f86600ce230 2024-09-11T23:20:59.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.654+0000 7f8666400640 1 -- 172.21.15.144:0/2684767198 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f866015cdf0 con 0x7f86600ce230 2024-09-11T23:20:59.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.654+0000 7f8666400640 1 -- 172.21.15.144:0/2684767198 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f866015d3b0 con 0x7f86600ce230 2024-09-11T23:20:59.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.655+0000 7f8666400640 1 -- 172.21.15.144:0/2684767198 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86600cf070 con 0x7f86600ce230 2024-09-11T23:20:59.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.656+0000 7f8657400640 1 -- 172.21.15.144:0/2684767198 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f865000c6d0 con 0x7f86600ce230 2024-09-11T23:20:59.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.656+0000 7f8657400640 1 --2- 172.21.15.144:0/2684767198 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f864006bfe0 0x7f864006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:20:59.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.657+0000 7f8657400640 1 -- 172.21.15.144:0/2684767198 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f865008af10 con 0x7f86600ce230 2024-09-11T23:20:59.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.657+0000 7f865ea00640 1 --2- 172.21.15.144:0/2684767198 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f864006bfe0 0x7f864006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:20:59.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.657+0000 7f865ea00640 1 --2- 172.21.15.144:0/2684767198 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f864006bfe0 0x7f864006e4a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f864c006fd0 tx=0x7f864c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:20:59.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.661+0000 7f8657400640 1 -- 172.21.15.144:0/2684767198 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f86601f2b70 con 0x7f86600ce230 2024-09-11T23:20:59.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.836+0000 7f8666400640 1 -- 172.21.15.144:0/2684767198 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86601f2d70 con 0x7f86600ce230 2024-09-11T23:20:59.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.838+0000 7f8657400640 1 -- 172.21.15.144:0/2684767198 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+16762 (secure 0 0 0) 0x7f8650017020 con 0x7f86600ce230 2024-09-11T23:20:59.840 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:20:59.840 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":58,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:20:58.859948+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:20:56.632085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-11T23:20:57.855096+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:20:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.840+0000 7f8666400640 1 -- 172.21.15.144:0/2684767198 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f864006bfe0 msgr2=0x7f864006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.840+0000 7f8666400640 1 --2- 172.21.15.144:0/2684767198 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f864006bfe0 0x7f864006e4a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f864c006fd0 tx=0x7f864c008040 comp rx=0 tx=0).stop 2024-09-11T23:20:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.840+0000 7f8666400640 1 -- 172.21.15.144:0/2684767198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86600ce230 msgr2=0x7f86601f2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:20:59.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.840+0000 7f8666400640 1 --2- 172.21.15.144:0/2684767198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86600ce230 0x7f86601f2630 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f865000e730 tx=0x7f865000ebf0 comp rx=0 tx=0).stop 2024-09-11T23:20:59.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.840+0000 7f8666400640 1 -- 172.21.15.144:0/2684767198 shutdown_connections 2024-09-11T23:20:59.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.840+0000 7f8666400640 1 --2- 172.21.15.144:0/2684767198 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f864006bfe0 0x7f864006e4a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:59.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.840+0000 7f8666400640 1 --2- 172.21.15.144:0/2684767198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f866015c180 0x7f866015a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:59.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.840+0000 7f8666400640 1 --2- 172.21.15.144:0/2684767198 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86600cf5b0 0x7f8660160590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:59.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.840+0000 7f8666400640 1 --2- 172.21.15.144:0/2684767198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86600ce230 0x7f86601f2630 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:20:59.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.840+0000 7f8666400640 1 -- 172.21.15.144:0/2684767198 >> 172.21.15.144:0/2684767198 conn(0x7f8660062cc0 msgr2=0x7f86600afe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:20:59.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.840+0000 7f8666400640 1 -- 172.21.15.144:0/2684767198 shutdown_connections 2024-09-11T23:20:59.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:20:59.840+0000 7f8666400640 1 -- 172.21.15.144:0/2684767198 wait complete. 2024-09-11T23:20:59.858 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:21:00.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.012+0000 7f6b5d200640 1 Processor -- start 2024-09-11T23:21:00.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.012+0000 7f6b5d200640 1 -- start start 2024-09-11T23:21:00.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.013+0000 7f6b5d200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6b5815e640 0x7f6b580d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:00.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.013+0000 7f6b5d200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b580b66e0 0x7f6b580b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:00.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.013+0000 7f6b5d200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b5806bee0 con 0x7f6b580d3f60 2024-09-11T23:21:00.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.013+0000 7f6b5d200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6b5815ea20 con 0x7f6b5815e640 2024-09-11T23:21:00.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.013+0000 7f6b5d200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6b5806caf0 con 0x7f6b580b66e0 2024-09-11T23:21:00.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.013+0000 7f6b56a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6b580d3f60 0x7f6b580b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34736/0 (socket says 172.21.15.144:34736) 2024-09-11T23:21:00.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.013+0000 7f6b56a00640 1 -- 172.21.15.144:0/727020031 learned_addr learned my addr 172.21.15.144:0/727020031 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:00.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.014+0000 7f6b57400640 1 --2- 172.21.15.144:0/727020031 >> v2:172.21.15.165:3300/0 conn(0x7f6b5815e640 0x7f6b580d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:00.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.014+0000 7f6b57e00640 1 --2- 172.21.15.144:0/727020031 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b580b66e0 0x7f6b580b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:00.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.014+0000 7f6b56000640 1 -- 172.21.15.144:0/727020031 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 709541538 0 0) 0x7f6b5806bee0 con 0x7f6b580d3f60 2024-09-11T23:21:00.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.014+0000 7f6b56000640 1 -- 172.21.15.144:0/727020031 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b3c003520 con 0x7f6b580d3f60 2024-09-11T23:21:00.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.014+0000 7f6b57e00640 1 -- 172.21.15.144:0/727020031 >> v2:172.21.15.165:3300/0 conn(0x7f6b5815e640 msgr2=0x7f6b580d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:00.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.014+0000 7f6b57e00640 1 --2- 172.21.15.144:0/727020031 >> v2:172.21.15.165:3300/0 conn(0x7f6b5815e640 0x7f6b580d3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:00.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.014+0000 7f6b57e00640 1 -- 172.21.15.144:0/727020031 >> v1:172.21.15.144:6789/0 conn(0x7f6b580d3f60 legacy=0x7f6b580b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:00.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.014+0000 7f6b57e00640 1 -- 172.21.15.144:0/727020031 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5806c1c0 con 0x7f6b580b66e0 2024-09-11T23:21:00.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.014+0000 7f6b57400640 1 --2- 172.21.15.144:0/727020031 >> v2:172.21.15.165:3300/0 conn(0x7f6b5815e640 0x7f6b580d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:21:00.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.015+0000 7f6b57e00640 1 --2- 172.21.15.144:0/727020031 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b580b66e0 0x7f6b580b7750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009d90 tx=0x7f6b5002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2d984ec61e7e473 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:00.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.016+0000 7f6b56000640 1 -- 172.21.15.144:0/727020031 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b50007740 con 0x7f6b580b66e0 2024-09-11T23:21:00.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.016+0000 7f6b56000640 1 -- 172.21.15.144:0/727020031 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b500078e0 con 0x7f6b580b66e0 2024-09-11T23:21:00.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.016+0000 7f6b56000640 1 -- 172.21.15.144:0/727020031 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b50007cb0 con 0x7f6b580b66e0 2024-09-11T23:21:00.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.016+0000 7f6b5d200640 1 -- 172.21.15.144:0/727020031 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b580b66e0 msgr2=0x7f6b580b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:00.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.016+0000 7f6b5d200640 1 --2- 172.21.15.144:0/727020031 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b580b66e0 0x7f6b580b7750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009d90 tx=0x7f6b5002a660 comp rx=0 tx=0).stop 2024-09-11T23:21:00.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.016+0000 7f6b5d200640 1 -- 172.21.15.144:0/727020031 shutdown_connections 2024-09-11T23:21:00.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.016+0000 7f6b5d200640 1 --2- 172.21.15.144:0/727020031 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b580b66e0 0x7f6b580b7750 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:00.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.016+0000 7f6b5d200640 1 --2- 172.21.15.144:0/727020031 >> v2:172.21.15.165:3300/0 conn(0x7f6b5815e640 0x7f6b580d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:00.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.016+0000 7f6b5d200640 1 -- 172.21.15.144:0/727020031 >> 172.21.15.144:0/727020031 conn(0x7f6b580d0fd0 msgr2=0x7f6b580d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:00.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.016+0000 7f6b5d200640 1 -- 172.21.15.144:0/727020031 shutdown_connections 2024-09-11T23:21:00.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.016+0000 7f6b5d200640 1 -- 172.21.15.144:0/727020031 wait complete. 2024-09-11T23:21:00.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.018+0000 7f6b5d200640 1 Processor -- start 2024-09-11T23:21:00.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.018+0000 7f6b5d200640 1 -- start start 2024-09-11T23:21:00.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.019+0000 7f6b5d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b580b66e0 0x7f6b580af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:00.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.019+0000 7f6b5d200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b580d3f60 0x7f6b58154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:00.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.019+0000 7f6b5d200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b5815e640 0x7f6b580acd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.019+0000 7f6b5d200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6b580b7c90 con 0x7f6b580b66e0 2024-09-11T23:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.019+0000 7f6b5d200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5806c780 con 0x7f6b5815e640 2024-09-11T23:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.019+0000 7f6b5d200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6b580b7e10 con 0x7f6b580d3f60 2024-09-11T23:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.019+0000 7f6b57400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b580b66e0 0x7f6b580af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.019+0000 7f6b57400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b580b66e0 0x7f6b580af400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53414/0 (socket says 172.21.15.144:53414) 2024-09-11T23:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.019+0000 7f6b57400640 1 -- 172.21.15.144:0/2169801860 learned_addr learned my addr 172.21.15.144:0/2169801860 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.019+0000 7f6b56a00640 1 --2- 172.21.15.144:0/2169801860 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b580d3f60 0x7f6b58154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.019+0000 7f6b57e00640 1 --2- 172.21.15.144:0/2169801860 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b5815e640 0x7f6b580acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.020+0000 7f6b57400640 1 -- 172.21.15.144:0/2169801860 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b580d3f60 msgr2=0x7f6b58154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.020+0000 7f6b57400640 1 --2- 172.21.15.144:0/2169801860 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b580d3f60 0x7f6b58154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.020+0000 7f6b57400640 1 -- 172.21.15.144:0/2169801860 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b5815e640 msgr2=0x7f6b580acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.020+0000 7f6b57400640 1 --2- 172.21.15.144:0/2169801860 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b5815e640 0x7f6b580acd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:00.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.020+0000 7f6b57400640 1 -- 172.21.15.144:0/2169801860 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b580ae0c0 con 0x7f6b580b66e0 2024-09-11T23:21:00.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.020+0000 7f6b57e00640 1 --2- 172.21.15.144:0/2169801860 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b5815e640 0x7f6b580acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:00.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.020+0000 7f6b57400640 1 --2- 172.21.15.144:0/2169801860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b580b66e0 0x7f6b580af400 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800e990 tx=0x7f6b4800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:00.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.020+0000 7f6b4f400640 1 -- 172.21.15.144:0/2169801860 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b48017070 con 0x7f6b580b66e0 2024-09-11T23:21:00.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.020+0000 7f6b4f400640 1 -- 172.21.15.144:0/2169801860 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b4800c9e0 con 0x7f6b580b66e0 2024-09-11T23:21:00.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.020+0000 7f6b4f400640 1 -- 172.21.15.144:0/2169801860 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4800cdb0 con 0x7f6b580b66e0 2024-09-11T23:21:00.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.020+0000 7f6b5d200640 1 -- 172.21.15.144:0/2169801860 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b580ad540 con 0x7f6b580b66e0 2024-09-11T23:21:00.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.020+0000 7f6b5d200640 1 -- 172.21.15.144:0/2169801860 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b580adb00 con 0x7f6b580b66e0 2024-09-11T23:21:00.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.021+0000 7f6b5d200640 1 -- 172.21.15.144:0/2169801860 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b580b7750 con 0x7f6b580b66e0 2024-09-11T23:21:00.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.022+0000 7f6b4f400640 1 -- 172.21.15.144:0/2169801860 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f6b4801a070 con 0x7f6b580b66e0 2024-09-11T23:21:00.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.023+0000 7f6b4f400640 1 --2- 172.21.15.144:0/2169801860 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6b3806bfe0 0x7f6b3806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:00.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.023+0000 7f6b4f400640 1 -- 172.21.15.144:0/2169801860 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f6b4808af30 con 0x7f6b580b66e0 2024-09-11T23:21:00.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.023+0000 7f6b56a00640 1 --2- 172.21.15.144:0/2169801860 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6b3806bfe0 0x7f6b3806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:00.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.024+0000 7f6b56a00640 1 --2- 172.21.15.144:0/2169801860 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6b3806bfe0 0x7f6b3806e4a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6b58076340 tx=0x7f6b44009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:00.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.027+0000 7f6b4f400640 1 -- 172.21.15.144:0/2169801860 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b480590a0 con 0x7f6b580b66e0 2024-09-11T23:21:00.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.201+0000 7f6b5d200640 1 -- 172.21.15.144:0/2169801860 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b581617a0 con 0x7f6b580b66e0 2024-09-11T23:21:00.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.202+0000 7f6b4f400640 1 -- 172.21.15.144:0/2169801860 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+16762 (secure 0 0 0) 0x7f6b4805d3a0 con 0x7f6b580b66e0 2024-09-11T23:21:00.203 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:00.204 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":58,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:20:58.859948+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:20:56.632085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-11T23:20:57.855096+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:21:00.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.204+0000 7f6b5d200640 1 -- 172.21.15.144:0/2169801860 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6b3806bfe0 msgr2=0x7f6b3806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:00.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.204+0000 7f6b5d200640 1 --2- 172.21.15.144:0/2169801860 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6b3806bfe0 0x7f6b3806e4a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6b58076340 tx=0x7f6b44009040 comp rx=0 tx=0).stop 2024-09-11T23:21:00.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.204+0000 7f6b5d200640 1 -- 172.21.15.144:0/2169801860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b580b66e0 msgr2=0x7f6b580af400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:00.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.204+0000 7f6b5d200640 1 --2- 172.21.15.144:0/2169801860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b580b66e0 0x7f6b580af400 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800e990 tx=0x7f6b4800ee50 comp rx=0 tx=0).stop 2024-09-11T23:21:00.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.204+0000 7f6b5d200640 1 -- 172.21.15.144:0/2169801860 shutdown_connections 2024-09-11T23:21:00.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.204+0000 7f6b5d200640 1 --2- 172.21.15.144:0/2169801860 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6b3806bfe0 0x7f6b3806e4a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:00.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.204+0000 7f6b5d200640 1 --2- 172.21.15.144:0/2169801860 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b5815e640 0x7f6b580acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:00.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.204+0000 7f6b5d200640 1 --2- 172.21.15.144:0/2169801860 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b580d3f60 0x7f6b58154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:00.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.204+0000 7f6b5d200640 1 --2- 172.21.15.144:0/2169801860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b580b66e0 0x7f6b580af400 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:00.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.204+0000 7f6b5d200640 1 -- 172.21.15.144:0/2169801860 >> 172.21.15.144:0/2169801860 conn(0x7f6b580d0fd0 msgr2=0x7f6b580d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:00.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.204+0000 7f6b5d200640 1 -- 172.21.15.144:0/2169801860 shutdown_connections 2024-09-11T23:21:00.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.205+0000 7f6b5d200640 1 -- 172.21.15.144:0/2169801860 wait complete. 2024-09-11T23:21:00.221 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:21:00.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.376+0000 7fc20dc00640 1 Processor -- start 2024-09-11T23:21:00.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.376+0000 7fc20dc00640 1 -- start start 2024-09-11T23:21:00.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.377+0000 7fc20dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2080cf510 0x7fc2080b7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:00.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.377+0000 7fc20dc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc2080b7bb0 0x7fc20806d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:00.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.377+0000 7fc20dc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc20815eaa0 con 0x7fc20815e6c0 2024-09-11T23:21:00.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.377+0000 7fc20dc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc2080d34d0 con 0x7fc2080b7bb0 2024-09-11T23:21:00.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.377+0000 7fc20dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc2080d28c0 con 0x7fc2080cf510 2024-09-11T23:21:00.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.377+0000 7fc207e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc20815e6c0 0x7fc20806c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34748/0 (socket says 172.21.15.144:34748) 2024-09-11T23:21:00.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.377+0000 7fc207e00640 1 -- 172.21.15.144:0/3979132550 learned_addr learned my addr 172.21.15.144:0/3979132550 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:00.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.377+0000 7fc207400640 1 --2- 172.21.15.144:0/3979132550 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2080cf510 0x7fc2080b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.378+0000 7fc20d200640 1 --2- 172.21.15.144:0/3979132550 >> v2:172.21.15.165:3300/0 conn(0x7fc2080b7bb0 0x7fc20806d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.378+0000 7fc206a00640 1 -- 172.21.15.144:0/3979132550 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2045691215 0 0) 0x7fc20815eaa0 con 0x7fc20815e6c0 2024-09-11T23:21:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.378+0000 7fc206a00640 1 -- 172.21.15.144:0/3979132550 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1ec003520 con 0x7fc20815e6c0 2024-09-11T23:21:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.378+0000 7fc207400640 1 -- 172.21.15.144:0/3979132550 >> v2:172.21.15.165:3300/0 conn(0x7fc2080b7bb0 msgr2=0x7fc20806d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.378+0000 7fc207400640 1 --2- 172.21.15.144:0/3979132550 >> v2:172.21.15.165:3300/0 conn(0x7fc2080b7bb0 0x7fc20806d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.378+0000 7fc207400640 1 -- 172.21.15.144:0/3979132550 >> v1:172.21.15.144:6789/0 conn(0x7fc20815e6c0 legacy=0x7fc20806c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.378+0000 7fc207400640 1 -- 172.21.15.144:0/3979132550 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2080d2ba0 con 0x7fc2080cf510 2024-09-11T23:21:00.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.379+0000 7fc207400640 1 --2- 172.21.15.144:0/3979132550 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2080cf510 0x7fc2080b7670 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40097a0 tx=0x7fc1f402a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bd2e8d9f81f3b35 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:00.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.379+0000 7fc206a00640 1 -- 172.21.15.144:0/3979132550 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4037070 con 0x7fc2080cf510 2024-09-11T23:21:00.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.379+0000 7fc206a00640 1 -- 172.21.15.144:0/3979132550 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1f4032440 con 0x7fc2080cf510 2024-09-11T23:21:00.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.379+0000 7fc206a00640 1 -- 172.21.15.144:0/3979132550 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4032810 con 0x7fc2080cf510 2024-09-11T23:21:00.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.380+0000 7fc20dc00640 1 -- 172.21.15.144:0/3979132550 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2080cf510 msgr2=0x7fc2080b7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:00.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.380+0000 7fc20dc00640 1 --2- 172.21.15.144:0/3979132550 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2080cf510 0x7fc2080b7670 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40097a0 tx=0x7fc1f402a230 comp rx=0 tx=0).stop 2024-09-11T23:21:00.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.380+0000 7fc20dc00640 1 -- 172.21.15.144:0/3979132550 shutdown_connections 2024-09-11T23:21:00.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.380+0000 7fc20dc00640 1 --2- 172.21.15.144:0/3979132550 >> v2:172.21.15.165:3300/0 conn(0x7fc2080b7bb0 0x7fc20806d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:00.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.380+0000 7fc20dc00640 1 --2- 172.21.15.144:0/3979132550 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2080cf510 0x7fc2080b7670 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:00.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.380+0000 7fc20dc00640 1 -- 172.21.15.144:0/3979132550 >> 172.21.15.144:0/3979132550 conn(0x7fc2080d4720 msgr2=0x7fc2080d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:00.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.380+0000 7fc20dc00640 1 -- 172.21.15.144:0/3979132550 shutdown_connections 2024-09-11T23:21:00.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.380+0000 7fc20dc00640 1 -- 172.21.15.144:0/3979132550 wait complete. 2024-09-11T23:21:00.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.382+0000 7fc20dc00640 1 Processor -- start 2024-09-11T23:21:00.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.382+0000 7fc20dc00640 1 -- start start 2024-09-11T23:21:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.383+0000 7fc20dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2080b7bb0 0x7fc2081576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.383+0000 7fc20dc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2080cf510 0x7fc208158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:00.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.383+0000 7fc20dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc20815e6c0 0x7fc2080ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:00.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.383+0000 7fc20dc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc20806db50 con 0x7fc20815e6c0 2024-09-11T23:21:00.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.383+0000 7fc20dc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc2080d3160 con 0x7fc2080cf510 2024-09-11T23:21:00.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.383+0000 7fc20dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc20806dcd0 con 0x7fc2080b7bb0 2024-09-11T23:21:00.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.383+0000 7fc20d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc20815e6c0 0x7fc2080ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:00.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.383+0000 7fc20d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc20815e6c0 0x7fc2080ccef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53428/0 (socket says 172.21.15.144:53428) 2024-09-11T23:21:00.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.383+0000 7fc20d200640 1 -- 172.21.15.144:0/451523275 learned_addr learned my addr 172.21.15.144:0/451523275 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:00.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.383+0000 7fc207400640 1 --2- 172.21.15.144:0/451523275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2080cf510 0x7fc208158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:00.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.383+0000 7fc20d200640 1 -- 172.21.15.144:0/451523275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2080b7bb0 msgr2=0x7fc2081576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:00.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.383+0000 7fc207e00640 1 --2- 172.21.15.144:0/451523275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2080b7bb0 0x7fc2081576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:00.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.383+0000 7fc20d200640 1 --2- 172.21.15.144:0/451523275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2080b7bb0 0x7fc2081576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:00.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.383+0000 7fc20d200640 1 -- 172.21.15.144:0/451523275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2080cf510 msgr2=0x7fc208158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:00.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.383+0000 7fc20d200640 1 --2- 172.21.15.144:0/451523275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2080cf510 0x7fc208158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:00.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.383+0000 7fc20d200640 1 -- 172.21.15.144:0/451523275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc208158ca0 con 0x7fc20815e6c0 2024-09-11T23:21:00.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.383+0000 7fc207400640 1 --2- 172.21.15.144:0/451523275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2080cf510 0x7fc208158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:00.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.383+0000 7fc207e00640 1 --2- 172.21.15.144:0/451523275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2080b7bb0 0x7fc2081576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:00.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.384+0000 7fc20d200640 1 --2- 172.21.15.144:0/451523275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc20815e6c0 0x7fc2080ccef0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc20000efc0 tx=0x7fc20000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.384+0000 7fc1ffe00640 1 -- 172.21.15.144:0/451523275 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200018020 con 0x7fc20815e6c0 2024-09-11T23:21:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.384+0000 7fc1ffe00640 1 -- 172.21.15.144:0/451523275 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc200014480 con 0x7fc20815e6c0 2024-09-11T23:21:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.384+0000 7fc1ffe00640 1 -- 172.21.15.144:0/451523275 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200014870 con 0x7fc20815e6c0 2024-09-11T23:21:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.384+0000 7fc20dc00640 1 -- 172.21.15.144:0/451523275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc208158f80 con 0x7fc20815e6c0 2024-09-11T23:21:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.384+0000 7fc20dc00640 1 -- 172.21.15.144:0/451523275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc208159540 con 0x7fc20815e6c0 2024-09-11T23:21:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.385+0000 7fc20dc00640 1 -- 172.21.15.144:0/451523275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc20806d610 con 0x7fc20815e6c0 2024-09-11T23:21:00.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.386+0000 7fc1ffe00640 1 -- 172.21.15.144:0/451523275 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7fc200005d10 con 0x7fc20815e6c0 2024-09-11T23:21:00.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.387+0000 7fc1ffe00640 1 --2- 172.21.15.144:0/451523275 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc1e806bfe0 0x7fc1e806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:00.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.387+0000 7fc1ffe00640 1 -- 172.21.15.144:0/451523275 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fc20008c200 con 0x7fc20815e6c0 2024-09-11T23:21:00.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.388+0000 7fc207e00640 1 --2- 172.21.15.144:0/451523275 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc1e806bfe0 0x7fc1e806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:00.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.388+0000 7fc207e00640 1 --2- 172.21.15.144:0/451523275 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc1e806bfe0 0x7fc1e806e4a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8005880 tx=0x7fc1f8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:00.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.392+0000 7fc1ffe00640 1 -- 172.21.15.144:0/451523275 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc200022030 con 0x7fc20815e6c0 2024-09-11T23:21:00.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:00.601+0000 7fc20dc00640 1 -- 172.21.15.144:0/451523275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc2080d2600 con 0x7fc20815e6c0 2024-09-11T23:21:01.431 INFO:tasks.ceph.mds.c.smithi144.stderr:2024-09-11T23:21:01.431+0000 7f9ddae00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:21:01.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.478+0000 7fc1ffe00640 1 -- 172.21.15.144:0/451523275 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) ==== 118+0+0 (secure 0 0 0) 0x7fc200010040 con 0x7fc20815e6c0 2024-09-11T23:21:01.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.481+0000 7fc20dc00640 1 -- 172.21.15.144:0/451523275 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc1e806bfe0 msgr2=0x7fc1e806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:01.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.481+0000 7fc20dc00640 1 --2- 172.21.15.144:0/451523275 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc1e806bfe0 0x7fc1e806e4a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8005880 tx=0x7fc1f8009040 comp rx=0 tx=0).stop 2024-09-11T23:21:01.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.481+0000 7fc20dc00640 1 -- 172.21.15.144:0/451523275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc20815e6c0 msgr2=0x7fc2080ccef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:01.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.481+0000 7fc20dc00640 1 --2- 172.21.15.144:0/451523275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc20815e6c0 0x7fc2080ccef0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc20000efc0 tx=0x7fc20000c490 comp rx=0 tx=0).stop 2024-09-11T23:21:01.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.482+0000 7fc20dc00640 1 -- 172.21.15.144:0/451523275 shutdown_connections 2024-09-11T23:21:01.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.482+0000 7fc20dc00640 1 --2- 172.21.15.144:0/451523275 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc1e806bfe0 0x7fc1e806e4a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:01.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.482+0000 7fc20dc00640 1 --2- 172.21.15.144:0/451523275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc20815e6c0 0x7fc2080ccef0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:01.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.482+0000 7fc20dc00640 1 --2- 172.21.15.144:0/451523275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2080cf510 0x7fc208158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:01.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.482+0000 7fc20dc00640 1 --2- 172.21.15.144:0/451523275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2080b7bb0 0x7fc2081576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:01.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.482+0000 7fc20dc00640 1 -- 172.21.15.144:0/451523275 >> 172.21.15.144:0/451523275 conn(0x7fc2080d4720 msgr2=0x7fc2080d4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:01.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.482+0000 7fc20dc00640 1 -- 172.21.15.144:0/451523275 shutdown_connections 2024-09-11T23:21:01.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.482+0000 7fc20dc00640 1 -- 172.21.15.144:0/451523275 wait complete. 2024-09-11T23:21:01.501 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:21:01.501 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:21:01.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.659+0000 7f654fa00640 1 Processor -- start 2024-09-11T23:21:02.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.660+0000 7f654fa00640 1 -- start start 2024-09-11T23:21:02.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.661+0000 7f654fa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f654806f130 0x7f65480b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:02.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.661+0000 7f654fa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f654815c370 0x7f65480ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:02.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.661+0000 7f654fa00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f654815c820 con 0x7f6548158e50 2024-09-11T23:21:02.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.661+0000 7f654fa00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f65480b43f0 con 0x7f654815c370 2024-09-11T23:21:02.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.661+0000 7f654fa00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f65480b3630 con 0x7f654806f130 2024-09-11T23:21:02.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.661+0000 7f654da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f654815c370 0x7f65480ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:02.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.661+0000 7f654da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f654815c370 0x7f65480ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53440/0 (socket says 172.21.15.144:53440) 2024-09-11T23:21:02.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.661+0000 7f654da00640 1 -- 172.21.15.144:0/1711062845 learned_addr learned my addr 172.21.15.144:0/1711062845 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:02.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.661+0000 7f654d000640 1 --1- 172.21.15.144:0/1711062845 >> v1:172.21.15.144:6789/0 conn(0x7f6548158e50 0x7f654806ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34754/0 (socket says 172.21.15.144:34754) 2024-09-11T23:21:02.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.661+0000 7f6547e00640 1 --2- 172.21.15.144:0/1711062845 >> v2:172.21.15.165:3300/0 conn(0x7f654806f130 0x7f65480b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:02.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.662+0000 7f654da00640 1 -- 172.21.15.144:0/1711062845 >> v2:172.21.15.165:3300/0 conn(0x7f654806f130 msgr2=0x7f65480b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:02.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.662+0000 7f654da00640 1 --2- 172.21.15.144:0/1711062845 >> v2:172.21.15.165:3300/0 conn(0x7f654806f130 0x7f65480b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.662+0000 7f654da00640 1 -- 172.21.15.144:0/1711062845 >> v1:172.21.15.144:6789/0 conn(0x7f6548158e50 legacy=0x7f654806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:02.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.662+0000 7f654da00640 1 -- 172.21.15.144:0/1711062845 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65480b3910 con 0x7f654815c370 2024-09-11T23:21:02.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.662+0000 7f6547400640 1 -- 172.21.15.144:0/1711062845 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2508752574 0 0) 0x7f653c001110 con 0x7f6548158e50 2024-09-11T23:21:02.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.663+0000 7f654da00640 1 --2- 172.21.15.144:0/1711062845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f654815c370 0x7f65480ce200 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f65480ccee0 tx=0x7f654002c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c0bfb459d2d5a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:02.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.663+0000 7f6547400640 1 -- 172.21.15.144:0/1711062845 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6540033400 con 0x7f654815c370 2024-09-11T23:21:02.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.663+0000 7f6547400640 1 -- 172.21.15.144:0/1711062845 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65400335a0 con 0x7f654815c370 2024-09-11T23:21:02.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.663+0000 7f6547400640 1 -- 172.21.15.144:0/1711062845 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6540033970 con 0x7f654815c370 2024-09-11T23:21:02.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.663+0000 7f654fa00640 1 -- 172.21.15.144:0/1711062845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f654815c370 msgr2=0x7f65480ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:02.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.663+0000 7f654fa00640 1 --2- 172.21.15.144:0/1711062845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f654815c370 0x7f65480ce200 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f65480ccee0 tx=0x7f654002c8b0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.663+0000 7f654fa00640 1 -- 172.21.15.144:0/1711062845 shutdown_connections 2024-09-11T23:21:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.663+0000 7f654fa00640 1 --2- 172.21.15.144:0/1711062845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f654815c370 0x7f65480ce200 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.664+0000 7f654fa00640 1 --2- 172.21.15.144:0/1711062845 >> v2:172.21.15.165:3300/0 conn(0x7f654806f130 0x7f65480b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.664+0000 7f654fa00640 1 -- 172.21.15.144:0/1711062845 >> 172.21.15.144:0/1711062845 conn(0x7f654806bba0 msgr2=0x7f654806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.664+0000 7f654fa00640 1 -- 172.21.15.144:0/1711062845 shutdown_connections 2024-09-11T23:21:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.664+0000 7f654fa00640 1 -- 172.21.15.144:0/1711062845 wait complete. 2024-09-11T23:21:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.665+0000 7f654fa00640 1 Processor -- start 2024-09-11T23:21:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.665+0000 7f654fa00640 1 -- start start 2024-09-11T23:21:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.666+0000 7f654fa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f654806f130 0x7f6548153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.666+0000 7f654fa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6548158e50 0x7f654815f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.666+0000 7f654fa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f654815c370 0x7f654815cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.666+0000 7f654fa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6548159230 con 0x7f6548158e50 2024-09-11T23:21:02.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.666+0000 7f654fa00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f65480b3ed0 con 0x7f654806f130 2024-09-11T23:21:02.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.666+0000 7f654fa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f65480ce740 con 0x7f654815c370 2024-09-11T23:21:02.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.666+0000 7f6547e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6548158e50 0x7f654815f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:02.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.666+0000 7f6547e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6548158e50 0x7f654815f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53454/0 (socket says 172.21.15.144:53454) 2024-09-11T23:21:02.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.666+0000 7f6547e00640 1 -- 172.21.15.144:0/3776442916 learned_addr learned my addr 172.21.15.144:0/3776442916 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:02.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.667+0000 7f654d000640 1 --2- 172.21.15.144:0/3776442916 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f654806f130 0x7f6548153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:02.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.667+0000 7f654da00640 1 --2- 172.21.15.144:0/3776442916 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f654815c370 0x7f654815cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:02.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.667+0000 7f6547e00640 1 -- 172.21.15.144:0/3776442916 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f654815c370 msgr2=0x7f654815cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:02.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.667+0000 7f6547e00640 1 --2- 172.21.15.144:0/3776442916 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f654815c370 0x7f654815cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.667+0000 7f6547e00640 1 -- 172.21.15.144:0/3776442916 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f654806f130 msgr2=0x7f6548153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:02.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.667+0000 7f6547e00640 1 --2- 172.21.15.144:0/3776442916 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f654806f130 0x7f6548153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.667+0000 7f6547e00640 1 -- 172.21.15.144:0/3776442916 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6548142230 con 0x7f6548158e50 2024-09-11T23:21:02.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.667+0000 7f6547e00640 1 --2- 172.21.15.144:0/3776442916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6548158e50 0x7f654815f4e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f653400e8d0 tx=0x7f653400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:02.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.667+0000 7f6544c00640 1 -- 172.21.15.144:0/3776442916 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534017070 con 0x7f6548158e50 2024-09-11T23:21:02.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.667+0000 7f6544c00640 1 -- 172.21.15.144:0/3776442916 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653400c940 con 0x7f6548158e50 2024-09-11T23:21:02.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.667+0000 7f6544c00640 1 -- 172.21.15.144:0/3776442916 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653400cd30 con 0x7f6548158e50 2024-09-11T23:21:02.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.667+0000 7f654fa00640 1 -- 172.21.15.144:0/3776442916 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65481525f0 con 0x7f6548158e50 2024-09-11T23:21:02.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.667+0000 7f654fa00640 1 -- 172.21.15.144:0/3776442916 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6548152bb0 con 0x7f6548158e50 2024-09-11T23:21:02.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.668+0000 7f654fa00640 1 -- 172.21.15.144:0/3776442916 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65480ce200 con 0x7f6548158e50 2024-09-11T23:21:02.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.669+0000 7f6544c00640 1 -- 172.21.15.144:0/3776442916 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f653401a070 con 0x7f6548158e50 2024-09-11T23:21:02.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.670+0000 7f6544c00640 1 --2- 172.21.15.144:0/3776442916 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f652806bfe0 0x7f652806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:02.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.670+0000 7f6544c00640 1 -- 172.21.15.144:0/3776442916 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f653408b570 con 0x7f6548158e50 2024-09-11T23:21:02.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.671+0000 7f654d000640 1 --2- 172.21.15.144:0/3776442916 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f652806bfe0 0x7f652806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:02.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.671+0000 7f654d000640 1 --2- 172.21.15.144:0/3776442916 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f652806bfe0 0x7f652806e4a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f653c000f60 tx=0x7f653c007970 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:02.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.675+0000 7f6544c00640 1 -- 172.21.15.144:0/3776442916 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6534059c00 con 0x7f6548158e50 2024-09-11T23:21:02.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:01.886+0000 7f654fa00640 1 -- 172.21.15.144:0/3776442916 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f6548074f70 con 0x7f6548158e50 2024-09-11T23:21:02.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.480+0000 7f6544c00640 1 -- 172.21.15.144:0/3776442916 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v35) ==== 122+0+0 (secure 0 0 0) 0x7f6534089e20 con 0x7f6548158e50 2024-09-11T23:21:02.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.483+0000 7f654fa00640 1 -- 172.21.15.144:0/3776442916 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f652806bfe0 msgr2=0x7f652806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:02.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.483+0000 7f654fa00640 1 --2- 172.21.15.144:0/3776442916 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f652806bfe0 0x7f652806e4a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f653c000f60 tx=0x7f653c007970 comp rx=0 tx=0).stop 2024-09-11T23:21:02.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.483+0000 7f654fa00640 1 -- 172.21.15.144:0/3776442916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6548158e50 msgr2=0x7f654815f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:02.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.483+0000 7f654fa00640 1 --2- 172.21.15.144:0/3776442916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6548158e50 0x7f654815f4e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f653400e8d0 tx=0x7f653400ed90 comp rx=0 tx=0).stop 2024-09-11T23:21:02.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.483+0000 7f654fa00640 1 -- 172.21.15.144:0/3776442916 shutdown_connections 2024-09-11T23:21:02.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.483+0000 7f654fa00640 1 --2- 172.21.15.144:0/3776442916 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f652806bfe0 0x7f652806e4a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.483+0000 7f654fa00640 1 --2- 172.21.15.144:0/3776442916 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f654815c370 0x7f654815cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.483+0000 7f654fa00640 1 --2- 172.21.15.144:0/3776442916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6548158e50 0x7f654815f4e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.483+0000 7f654fa00640 1 --2- 172.21.15.144:0/3776442916 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f654806f130 0x7f6548153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.483+0000 7f654fa00640 1 -- 172.21.15.144:0/3776442916 >> 172.21.15.144:0/3776442916 conn(0x7f654806bba0 msgr2=0x7f6548156370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:02.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.483+0000 7f654fa00640 1 -- 172.21.15.144:0/3776442916 shutdown_connections 2024-09-11T23:21:02.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.483+0000 7f654fa00640 1 -- 172.21.15.144:0/3776442916 wait complete. 2024-09-11T23:21:02.506 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:21:02.506 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:21:02.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.660+0000 7f7295800640 1 Processor -- start 2024-09-11T23:21:02.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.661+0000 7f7295800640 1 -- start start 2024-09-11T23:21:02.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.662+0000 7f7295800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f72900d02a0 0x7f72900d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:02.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.662+0000 7f7295800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f729015ceb0 0x7f72901594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:02.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.662+0000 7f7295800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72900d0bc0 con 0x7f729015ca40 2024-09-11T23:21:02.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.662+0000 7f7295800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f729015d390 con 0x7f72900d02a0 2024-09-11T23:21:02.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.662+0000 7f7295800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f729015d670 con 0x7f729015ceb0 2024-09-11T23:21:02.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.662+0000 7f728ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f72900d02a0 0x7f72900d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:02.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.662+0000 7f728ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f72900d02a0 0x7f72900d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53470/0 (socket says 172.21.15.144:53470) 2024-09-11T23:21:02.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.662+0000 7f728ea00640 1 -- 172.21.15.144:0/636955881 learned_addr learned my addr 172.21.15.144:0/636955881 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:02.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.662+0000 7f728f400640 1 --2- 172.21.15.144:0/636955881 >> v2:172.21.15.165:3300/0 conn(0x7f729015ceb0 0x7f72901594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:02.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.663+0000 7f728ea00640 1 -- 172.21.15.144:0/636955881 >> v2:172.21.15.165:3300/0 conn(0x7f729015ceb0 msgr2=0x7f72901594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:02.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.663+0000 7f728ea00640 1 --2- 172.21.15.144:0/636955881 >> v2:172.21.15.165:3300/0 conn(0x7f729015ceb0 0x7f72901594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.663+0000 7f728ea00640 1 -- 172.21.15.144:0/636955881 >> v1:172.21.15.144:6789/0 conn(0x7f729015ca40 legacy=0x7f729015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:02.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.663+0000 7f728ea00640 1 -- 172.21.15.144:0/636955881 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729015d950 con 0x7f72900d02a0 2024-09-11T23:21:02.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.663+0000 7f728d600640 1 -- 172.21.15.144:0/636955881 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3203386643 0 0) 0x7f72900d0bc0 con 0x7f729015ca40 2024-09-11T23:21:02.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.664+0000 7f728ea00640 1 --2- 172.21.15.144:0/636955881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72900d02a0 0x7f72900d0680 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f72900b52b0 tx=0x7f728002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b870887ce67d644 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:02.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.664+0000 7f728d600640 1 -- 172.21.15.144:0/636955881 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7280036070 con 0x7f72900d02a0 2024-09-11T23:21:02.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.664+0000 7f728d600640 1 -- 172.21.15.144:0/636955881 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7280031600 con 0x7f72900d02a0 2024-09-11T23:21:02.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.664+0000 7f728d600640 1 -- 172.21.15.144:0/636955881 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72800319d0 con 0x7f72900d02a0 2024-09-11T23:21:02.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.664+0000 7f7295800640 1 -- 172.21.15.144:0/636955881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72900d02a0 msgr2=0x7f72900d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:02.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.664+0000 7f7295800640 1 --2- 172.21.15.144:0/636955881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72900d02a0 0x7f72900d0680 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f72900b52b0 tx=0x7f728002a6a0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.665+0000 7f7295800640 1 -- 172.21.15.144:0/636955881 shutdown_connections 2024-09-11T23:21:02.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.665+0000 7f7295800640 1 --2- 172.21.15.144:0/636955881 >> v2:172.21.15.165:3300/0 conn(0x7f729015ceb0 0x7f72901594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.665+0000 7f7295800640 1 --2- 172.21.15.144:0/636955881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72900d02a0 0x7f72900d0680 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.665+0000 7f7295800640 1 -- 172.21.15.144:0/636955881 >> 172.21.15.144:0/636955881 conn(0x7f7290062cc0 msgr2=0x7f729006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:02.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.665+0000 7f7295800640 1 -- 172.21.15.144:0/636955881 shutdown_connections 2024-09-11T23:21:02.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.665+0000 7f7295800640 1 -- 172.21.15.144:0/636955881 wait complete. 2024-09-11T23:21:02.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.666+0000 7f7295800640 1 Processor -- start 2024-09-11T23:21:02.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.666+0000 7f7295800640 1 -- start start 2024-09-11T23:21:02.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.667+0000 7f7295800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72900d02a0 0x7f7290142ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:02.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.667+0000 7f7295800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f729015ca40 0x7f72900ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:02.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.667+0000 7f7295800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f729015ceb0 0x7f72900aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:02.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.667+0000 7f7295800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f729015eb40 con 0x7f729015ca40 2024-09-11T23:21:02.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.667+0000 7f7295800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f729015df10 con 0x7f72900d02a0 2024-09-11T23:21:02.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.667+0000 7f7295800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7290155b90 con 0x7f729015ceb0 2024-09-11T23:21:02.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.667+0000 7f728e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f729015ca40 0x7f72900ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:02.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.668+0000 7f728e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f729015ca40 0x7f72900ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53480/0 (socket says 172.21.15.144:53480) 2024-09-11T23:21:02.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.668+0000 7f728e000640 1 -- 172.21.15.144:0/1952061859 learned_addr learned my addr 172.21.15.144:0/1952061859 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:02.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.668+0000 7f728ea00640 1 --2- 172.21.15.144:0/1952061859 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72900d02a0 0x7f7290142ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:02.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.668+0000 7f728f400640 1 --2- 172.21.15.144:0/1952061859 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f729015ceb0 0x7f72900aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:02.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.668+0000 7f728e000640 1 -- 172.21.15.144:0/1952061859 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f729015ceb0 msgr2=0x7f72900aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:02.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.668+0000 7f728e000640 1 --2- 172.21.15.144:0/1952061859 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f729015ceb0 0x7f72900aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.668+0000 7f728e000640 1 -- 172.21.15.144:0/1952061859 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72900d02a0 msgr2=0x7f7290142ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:02.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.668+0000 7f728e000640 1 --2- 172.21.15.144:0/1952061859 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72900d02a0 0x7f7290142ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.668+0000 7f728e000640 1 -- 172.21.15.144:0/1952061859 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7290143420 con 0x7f729015ca40 2024-09-11T23:21:02.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.668+0000 7f728ea00640 1 --2- 172.21.15.144:0/1952061859 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72900d02a0 0x7f7290142ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:02.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.668+0000 7f728e000640 1 --2- 172.21.15.144:0/1952061859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f729015ca40 0x7f72900ae8e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f727c00c4e0 tx=0x7f727c00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:02.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.668+0000 7f7286a00640 1 -- 172.21.15.144:0/1952061859 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c017070 con 0x7f729015ca40 2024-09-11T23:21:02.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.668+0000 7f7286a00640 1 -- 172.21.15.144:0/1952061859 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f727c0035f0 con 0x7f729015ca40 2024-09-11T23:21:02.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.668+0000 7f7295800640 1 -- 172.21.15.144:0/1952061859 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7290073490 con 0x7f729015ca40 2024-09-11T23:21:02.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.669+0000 7f7286a00640 1 -- 172.21.15.144:0/1952061859 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727c0039e0 con 0x7f729015ca40 2024-09-11T23:21:02.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.669+0000 7f7295800640 1 -- 172.21.15.144:0/1952061859 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7290073a50 con 0x7f729015ca40 2024-09-11T23:21:02.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.670+0000 7f7295800640 1 -- 172.21.15.144:0/1952061859 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72900b4790 con 0x7f729015ca40 2024-09-11T23:21:02.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.671+0000 7f7286a00640 1 -- 172.21.15.144:0/1952061859 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f727c01a070 con 0x7f729015ca40 2024-09-11T23:21:02.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.671+0000 7f7286a00640 1 --2- 172.21.15.144:0/1952061859 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f727006c010 0x7f727006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:02.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.672+0000 7f7286a00640 1 -- 172.21.15.144:0/1952061859 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f727c08a3b0 con 0x7f729015ca40 2024-09-11T23:21:02.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.672+0000 7f728ea00640 1 --2- 172.21.15.144:0/1952061859 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f727006c010 0x7f727006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:02.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.672+0000 7f728ea00640 1 --2- 172.21.15.144:0/1952061859 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f727006c010 0x7f727006e4d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7280033000 tx=0x7f7280009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:02.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.676+0000 7f7286a00640 1 -- 172.21.15.144:0/1952061859 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f727c058490 con 0x7f729015ca40 2024-09-11T23:21:02.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.883+0000 7f7295800640 1 -- 172.21.15.144:0/1952061859 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72900731d0 con 0x7f729015ca40 2024-09-11T23:21:02.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.884+0000 7f7286a00640 1 -- 172.21.15.144:0/1952061859 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5235 (secure 0 0 0) 0x7f727c05c790 con 0x7f729015ca40 2024-09-11T23:21:02.885 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:02.885 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":35,"btime":"2024-09-11T23:21:02:480138+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2161458369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2161458369},{"type":"v1","addr":"172.21.15.144:6836","nonce":2161458369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5150,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/2242935376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2242935376},{"type":"v1","addr":"172.21.15.165:6833","nonce":2242935376}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5156,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3703078361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3703078361},{"type":"v1","addr":"172.21.15.165:6835","nonce":3703078361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:20:58.860267+0000","modified":"2024-09-11T23:21:01.888764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1648435689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1648435689},{"type":"v1","addr":"172.21.15.144:6837","nonce":1648435689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5667,"qdb_cluster":[5667]},"id":4}]} 2024-09-11T23:21:02.886 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 35 2024-09-11T23:21:02.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.886+0000 7f7295800640 1 -- 172.21.15.144:0/1952061859 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f727006c010 msgr2=0x7f727006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:02.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.886+0000 7f7295800640 1 --2- 172.21.15.144:0/1952061859 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f727006c010 0x7f727006e4d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7280033000 tx=0x7f7280009000 comp rx=0 tx=0).stop 2024-09-11T23:21:02.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.886+0000 7f7295800640 1 -- 172.21.15.144:0/1952061859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f729015ca40 msgr2=0x7f72900ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:02.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.886+0000 7f7295800640 1 --2- 172.21.15.144:0/1952061859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f729015ca40 0x7f72900ae8e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f727c00c4e0 tx=0x7f727c00c9a0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.886+0000 7f7295800640 1 -- 172.21.15.144:0/1952061859 shutdown_connections 2024-09-11T23:21:02.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.886+0000 7f7295800640 1 --2- 172.21.15.144:0/1952061859 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f727006c010 0x7f727006e4d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.886+0000 7f7295800640 1 --2- 172.21.15.144:0/1952061859 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f729015ceb0 0x7f72900aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.886+0000 7f7295800640 1 --2- 172.21.15.144:0/1952061859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f729015ca40 0x7f72900ae8e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.886+0000 7f7295800640 1 --2- 172.21.15.144:0/1952061859 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72900d02a0 0x7f7290142ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:02.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.886+0000 7f7295800640 1 -- 172.21.15.144:0/1952061859 >> 172.21.15.144:0/1952061859 conn(0x7f7290062cc0 msgr2=0x7f729006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:02.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.886+0000 7f7295800640 1 -- 172.21.15.144:0/1952061859 shutdown_connections 2024-09-11T23:21:02.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:02.887+0000 7f7295800640 1 -- 172.21.15.144:0/1952061859 wait complete. 2024-09-11T23:21:02.904 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:21:03.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.057+0000 7f6cfd800640 1 Processor -- start 2024-09-11T23:21:03.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.057+0000 7f6cfd800640 1 -- start start 2024-09-11T23:21:03.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.058+0000 7f6cfd800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6cf815c180 0x7f6cf80cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:03.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.059+0000 7f6cfd800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf8073120 0x7f6cf8073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:03.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.059+0000 7f6cfd800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf80ce740 con 0x7f6cf80ce230 2024-09-11T23:21:03.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.059+0000 7f6cfd800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6cf8072640 con 0x7f6cf815c180 2024-09-11T23:21:03.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.059+0000 7f6cfd800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf8072920 con 0x7f6cf8073120 2024-09-11T23:21:03.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.059+0000 7f6cee000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6cf80ce230 0x7f6cf80cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34764/0 (socket says 172.21.15.144:34764) 2024-09-11T23:21:03.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.059+0000 7f6cee000640 1 -- 172.21.15.144:0/1131395322 learned_addr learned my addr 172.21.15.144:0/1131395322 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:03.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.059+0000 7f6cf6a00640 1 --2- 172.21.15.144:0/1131395322 >> v2:172.21.15.165:3300/0 conn(0x7f6cf815c180 0x7f6cf80cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:03.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.059+0000 7f6cf7400640 1 --2- 172.21.15.144:0/1131395322 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf8073120 0x7f6cf8073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:03.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.059+0000 7f6cf6000640 1 -- 172.21.15.144:0/1131395322 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2837498433 0 0) 0x7f6cf80ce740 con 0x7f6cf80ce230 2024-09-11T23:21:03.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.059+0000 7f6cf6000640 1 -- 172.21.15.144:0/1131395322 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cdc003520 con 0x7f6cf80ce230 2024-09-11T23:21:03.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.060+0000 7f6cf6a00640 1 -- 172.21.15.144:0/1131395322 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf8073120 msgr2=0x7f6cf8073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:03.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.060+0000 7f6cf6a00640 1 --2- 172.21.15.144:0/1131395322 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf8073120 0x7f6cf8073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.060+0000 7f6cf6000640 1 -- 172.21.15.144:0/1131395322 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 243784551 0 0) 0x7f6cdc003520 con 0x7f6cf80ce230 2024-09-11T23:21:03.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.060+0000 7f6cf6a00640 1 -- 172.21.15.144:0/1131395322 >> v1:172.21.15.144:6789/0 conn(0x7f6cf80ce230 legacy=0x7f6cf80cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:03.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.060+0000 7f6cf6a00640 1 -- 172.21.15.144:0/1131395322 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf8072c00 con 0x7f6cf815c180 2024-09-11T23:21:03.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.061+0000 7f6cf6a00640 1 --2- 172.21.15.144:0/1131395322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cf815c180 0x7f6cf80cdcf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80097a0 tx=0x7f6ce802a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97d597fdb08750b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:03.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.061+0000 7f6cf6000640 1 -- 172.21.15.144:0/1131395322 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8037070 con 0x7f6cf815c180 2024-09-11T23:21:03.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.061+0000 7f6cf6000640 1 -- 172.21.15.144:0/1131395322 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce802ab10 con 0x7f6cf815c180 2024-09-11T23:21:03.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.061+0000 7f6cf6000640 1 -- 172.21.15.144:0/1131395322 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce0001690 con 0x7f6cf815c180 2024-09-11T23:21:03.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.062+0000 7f6cfd800640 1 -- 172.21.15.144:0/1131395322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cf815c180 msgr2=0x7f6cf80cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:03.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.062+0000 7f6cfd800640 1 --2- 172.21.15.144:0/1131395322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cf815c180 0x7f6cf80cdcf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6ce80097a0 tx=0x7f6ce802a080 comp rx=0 tx=0).stop 2024-09-11T23:21:03.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.062+0000 7f6cfd800640 1 -- 172.21.15.144:0/1131395322 shutdown_connections 2024-09-11T23:21:03.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.062+0000 7f6cfd800640 1 --2- 172.21.15.144:0/1131395322 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf8073120 0x7f6cf8073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.062+0000 7f6cfd800640 1 --2- 172.21.15.144:0/1131395322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cf815c180 0x7f6cf80cdcf0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.062+0000 7f6cfd800640 1 -- 172.21.15.144:0/1131395322 >> 172.21.15.144:0/1131395322 conn(0x7f6cf8062cc0 msgr2=0x7f6cf806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:03.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.062+0000 7f6cfd800640 1 -- 172.21.15.144:0/1131395322 shutdown_connections 2024-09-11T23:21:03.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.062+0000 7f6cfd800640 1 -- 172.21.15.144:0/1131395322 wait complete. 2024-09-11T23:21:03.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.063+0000 7f6cfd800640 1 Processor -- start 2024-09-11T23:21:03.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.063+0000 7f6cfd800640 1 -- start start 2024-09-11T23:21:03.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.064+0000 7f6cfd800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cf8073120 0x7f6cf80c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:03.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.064+0000 7f6cfd800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf80ce230 0x7f6cf80aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:03.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.064+0000 7f6cfd800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cf815c180 0x7f6cf80cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:03.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.064+0000 7f6cfd800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf80cf780 con 0x7f6cf815c180 2024-09-11T23:21:03.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.064+0000 7f6cfd800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf80722f0 con 0x7f6cf8073120 2024-09-11T23:21:03.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.064+0000 7f6cfd800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf815c560 con 0x7f6cf80ce230 2024-09-11T23:21:03.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.065+0000 7f6cf7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cf815c180 0x7f6cf80cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:03.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.065+0000 7f6cf7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cf815c180 0x7f6cf80cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53494/0 (socket says 172.21.15.144:53494) 2024-09-11T23:21:03.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.065+0000 7f6cf7400640 1 -- 172.21.15.144:0/2852044058 learned_addr learned my addr 172.21.15.144:0/2852044058 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:03.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.065+0000 7f6cee000640 1 --2- 172.21.15.144:0/2852044058 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf80ce230 0x7f6cf80aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:03.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.065+0000 7f6cf6a00640 1 --2- 172.21.15.144:0/2852044058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cf8073120 0x7f6cf80c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:03.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.065+0000 7f6cf7400640 1 -- 172.21.15.144:0/2852044058 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf80ce230 msgr2=0x7f6cf80aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:03.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.065+0000 7f6cf7400640 1 --2- 172.21.15.144:0/2852044058 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf80ce230 0x7f6cf80aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.065+0000 7f6cf7400640 1 -- 172.21.15.144:0/2852044058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cf8073120 msgr2=0x7f6cf80c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:03.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.065+0000 7f6cf7400640 1 --2- 172.21.15.144:0/2852044058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cf8073120 0x7f6cf80c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.065+0000 7f6cf7400640 1 -- 172.21.15.144:0/2852044058 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf80cc310 con 0x7f6cf815c180 2024-09-11T23:21:03.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.065+0000 7f6cf7400640 1 --2- 172.21.15.144:0/2852044058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cf815c180 0x7f6cf80cbdd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000efc0 tx=0x7f6cf000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:03.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.065+0000 7f6cef400640 1 -- 172.21.15.144:0/2852044058 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0018020 con 0x7f6cf815c180 2024-09-11T23:21:03.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.066+0000 7f6cef400640 1 -- 172.21.15.144:0/2852044058 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf0014480 con 0x7f6cf815c180 2024-09-11T23:21:03.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.066+0000 7f6cef400640 1 -- 172.21.15.144:0/2852044058 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0014870 con 0x7f6cf815c180 2024-09-11T23:21:03.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.066+0000 7f6cfd800640 1 -- 172.21.15.144:0/2852044058 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf80c6310 con 0x7f6cf815c180 2024-09-11T23:21:03.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.066+0000 7f6cfd800640 1 -- 172.21.15.144:0/2852044058 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf80c68d0 con 0x7f6cf815c180 2024-09-11T23:21:03.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.067+0000 7f6cfd800640 1 -- 172.21.15.144:0/2852044058 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf80cdcf0 con 0x7f6cf815c180 2024-09-11T23:21:03.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.068+0000 7f6cef400640 1 -- 172.21.15.144:0/2852044058 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f6cf0005d10 con 0x7f6cf815c180 2024-09-11T23:21:03.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.069+0000 7f6cef400640 1 --2- 172.21.15.144:0/2852044058 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6cd406c010 0x7f6cd406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:03.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.069+0000 7f6cef400640 1 -- 172.21.15.144:0/2852044058 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f6cf008c030 con 0x7f6cf815c180 2024-09-11T23:21:03.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.069+0000 7f6cf6a00640 1 --2- 172.21.15.144:0/2852044058 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6cd406c010 0x7f6cd406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:03.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.070+0000 7f6cf6a00640 1 --2- 172.21.15.144:0/2852044058 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6cd406c010 0x7f6cd406e4d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8034000 tx=0x7f6ce802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:03.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.073+0000 7f6cef400640 1 -- 172.21.15.144:0/2852044058 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6cf0022030 con 0x7f6cf815c180 2024-09-11T23:21:03.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.248+0000 7f6cfd800640 1 -- 172.21.15.144:0/2852044058 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6cf8076240 con 0x7f6cf815c180 2024-09-11T23:21:03.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.249+0000 7f6cef400640 1 -- 172.21.15.144:0/2852044058 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16749 (secure 0 0 0) 0x7f6cf0010040 con 0x7f6cf815c180 2024-09-11T23:21:03.251 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:03.251 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":59,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:21:00.452382+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:20:56.632085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-11T23:20:57.855096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:21:03.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.252+0000 7f6cfd800640 1 -- 172.21.15.144:0/2852044058 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6cd406c010 msgr2=0x7f6cd406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:03.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.252+0000 7f6cfd800640 1 --2- 172.21.15.144:0/2852044058 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6cd406c010 0x7f6cd406e4d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8034000 tx=0x7f6ce802e000 comp rx=0 tx=0).stop 2024-09-11T23:21:03.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.252+0000 7f6cfd800640 1 -- 172.21.15.144:0/2852044058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cf815c180 msgr2=0x7f6cf80cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:03.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.252+0000 7f6cfd800640 1 --2- 172.21.15.144:0/2852044058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cf815c180 0x7f6cf80cbdd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000efc0 tx=0x7f6cf000c490 comp rx=0 tx=0).stop 2024-09-11T23:21:03.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.252+0000 7f6cfd800640 1 -- 172.21.15.144:0/2852044058 shutdown_connections 2024-09-11T23:21:03.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.252+0000 7f6cfd800640 1 --2- 172.21.15.144:0/2852044058 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6cd406c010 0x7f6cd406e4d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.252+0000 7f6cfd800640 1 --2- 172.21.15.144:0/2852044058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cf815c180 0x7f6cf80cbdd0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.252+0000 7f6cfd800640 1 --2- 172.21.15.144:0/2852044058 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6cf80ce230 0x7f6cf80aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.252+0000 7f6cfd800640 1 --2- 172.21.15.144:0/2852044058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cf8073120 0x7f6cf80c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.252+0000 7f6cfd800640 1 -- 172.21.15.144:0/2852044058 >> 172.21.15.144:0/2852044058 conn(0x7f6cf8062cc0 msgr2=0x7f6cf80cd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:03.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.252+0000 7f6cfd800640 1 -- 172.21.15.144:0/2852044058 shutdown_connections 2024-09-11T23:21:03.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.252+0000 7f6cfd800640 1 -- 172.21.15.144:0/2852044058 wait complete. 2024-09-11T23:21:03.271 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:21:03.271 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:21:03.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.423+0000 7fba2c800640 1 Processor -- start 2024-09-11T23:21:03.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.423+0000 7fba2c800640 1 -- start start 2024-09-11T23:21:03.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.425+0000 7fba2c800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fba240b4930 0x7fba240b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:03.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.425+0000 7fba2c800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba24162870 con 0x7fba240d0a50 2024-09-11T23:21:03.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.425+0000 7fba2c800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba24162b50 con 0x7fba2415f620 2024-09-11T23:21:03.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.425+0000 7fba2c800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fba24160180 con 0x7fba240b4930 2024-09-11T23:21:03.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.425+0000 7fba29e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fba240d0a50 0x7fba241620b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34768/0 (socket says 172.21.15.144:34768) 2024-09-11T23:21:03.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.425+0000 7fba29e00640 1 -- 172.21.15.144:0/958473373 learned_addr learned my addr 172.21.15.144:0/958473373 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:03.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.425+0000 7fba29400640 1 --2- 172.21.15.144:0/958473373 >> v2:172.21.15.165:3300/0 conn(0x7fba240b4930 0x7fba240b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:03.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.425+0000 7fba28a00640 1 -- 172.21.15.144:0/958473373 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1191101464 0 0) 0x7fba24162870 con 0x7fba240d0a50 2024-09-11T23:21:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.425+0000 7fba28a00640 1 -- 172.21.15.144:0/958473373 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba0c003520 con 0x7fba240d0a50 2024-09-11T23:21:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.426+0000 7fba28a00640 1 -- 172.21.15.144:0/958473373 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2563678824 0 0) 0x7fba24162b50 con 0x7fba2415f620 2024-09-11T23:21:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.426+0000 7fba28a00640 1 -- 172.21.15.144:0/958473373 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba24162870 con 0x7fba2415f620 2024-09-11T23:21:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.426+0000 7fba28a00640 1 -- 172.21.15.144:0/958473373 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3383223789 0 0) 0x7fba0c003520 con 0x7fba240d0a50 2024-09-11T23:21:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.426+0000 7fba28a00640 1 -- 172.21.15.144:0/958473373 >> v2:172.21.15.165:3300/0 conn(0x7fba240b4930 msgr2=0x7fba240b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.426+0000 7fba28a00640 1 --2- 172.21.15.144:0/958473373 >> v2:172.21.15.165:3300/0 conn(0x7fba240b4930 0x7fba240b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.426+0000 7fba28a00640 1 -- 172.21.15.144:0/958473373 >> v1:172.21.15.165:6789/0 conn(0x7fba2415f620 legacy=0x7fba2415fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.426+0000 7fba28a00640 1 -- 172.21.15.144:0/958473373 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba24162e30 con 0x7fba240d0a50 2024-09-11T23:21:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.426+0000 7fba28a00640 1 -- 172.21.15.144:0/958473373 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fba18001670 con 0x7fba240d0a50 2024-09-11T23:21:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.426+0000 7fba28a00640 1 -- 172.21.15.144:0/958473373 >> v1:172.21.15.144:6789/0 conn(0x7fba240d0a50 legacy=0x7fba241620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.426+0000 7fba28a00640 1 --2- 172.21.15.144:0/958473373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba0c003b40 0x7fba0c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:03.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.426+0000 7fba28a00640 1 --2- 172.21.15.144:0/958473373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba0c004800 0x7fba0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:03.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.426+0000 7fba28a00640 1 --2- 172.21.15.144:0/958473373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba0c0051c0 0x7fba0c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:03.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.426+0000 7fba28a00640 1 -- 172.21.15.144:0/958473373 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fba24160180 con 0x7fba0c0051c0 2024-09-11T23:21:03.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.426+0000 7fba28a00640 1 -- 172.21.15.144:0/958473373 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c00c0f0 con 0x7fba0c004800 2024-09-11T23:21:03.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.426+0000 7fba28a00640 1 -- 172.21.15.144:0/958473373 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fba0c00c2f0 con 0x7fba0c003b40 2024-09-11T23:21:03.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.426+0000 7fba2a800640 1 --2- 172.21.15.144:0/958473373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba0c0051c0 0x7fba0c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:03.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.426+0000 7fba29400640 1 --2- 172.21.15.144:0/958473373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba0c004800 0x7fba0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:03.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.426+0000 7fba29e00640 1 --2- 172.21.15.144:0/958473373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba0c003b40 0x7fba0c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:03.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.427+0000 7fba2a800640 1 -- 172.21.15.144:0/958473373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba0c003b40 msgr2=0x7fba0c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:03.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.427+0000 7fba2a800640 1 --2- 172.21.15.144:0/958473373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba0c003b40 0x7fba0c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.427+0000 7fba2a800640 1 -- 172.21.15.144:0/958473373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba0c004800 msgr2=0x7fba0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:03.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.427+0000 7fba2a800640 1 --2- 172.21.15.144:0/958473373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba0c004800 0x7fba0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.427+0000 7fba2a800640 1 -- 172.21.15.144:0/958473373 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0c003520 con 0x7fba0c0051c0 2024-09-11T23:21:03.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.427+0000 7fba29e00640 1 --2- 172.21.15.144:0/958473373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba0c003b40 0x7fba0c003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:03.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.427+0000 7fba2a800640 1 -- 172.21.15.144:0/958473373 reap_dead start 2024-09-11T23:21:03.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.428+0000 7fba2a800640 1 --2- 172.21.15.144:0/958473373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba0c0051c0 0x7fba0c00b9c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fba20001fd0 tx=0x7fba0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b2562cbba96e29 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:03.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.428+0000 7fba28a00640 1 -- 172.21.15.144:0/958473373 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba20001bf0 con 0x7fba0c0051c0 2024-09-11T23:21:03.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.428+0000 7fba28a00640 1 -- 172.21.15.144:0/958473373 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba20003b70 con 0x7fba0c0051c0 2024-09-11T23:21:03.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.428+0000 7fba28a00640 1 -- 172.21.15.144:0/958473373 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba200050d0 con 0x7fba0c0051c0 2024-09-11T23:21:03.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.428+0000 7fba2c800640 1 -- 172.21.15.144:0/958473373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba0c0051c0 msgr2=0x7fba0c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:03.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.428+0000 7fba2c800640 1 --2- 172.21.15.144:0/958473373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba0c0051c0 0x7fba0c00b9c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fba20001fd0 tx=0x7fba0c005830 comp rx=0 tx=0).stop 2024-09-11T23:21:03.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.428+0000 7fba2c800640 1 -- 172.21.15.144:0/958473373 shutdown_connections 2024-09-11T23:21:03.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.428+0000 7fba2c800640 1 --2- 172.21.15.144:0/958473373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba0c0051c0 0x7fba0c00b9c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.428+0000 7fba2c800640 1 -- 172.21.15.144:0/958473373 >> 172.21.15.144:0/958473373 conn(0x7fba24062cc0 msgr2=0x7fba2406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:03.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.428+0000 7fba2c800640 1 -- 172.21.15.144:0/958473373 shutdown_connections 2024-09-11T23:21:03.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.428+0000 7fba2c800640 1 -- 172.21.15.144:0/958473373 wait complete. 2024-09-11T23:21:03.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.430+0000 7fba2c800640 1 Processor -- start 2024-09-11T23:21:03.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.430+0000 7fba2c800640 1 -- start start 2024-09-11T23:21:03.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.431+0000 7fba2c800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba0c0051c0 0x7fba24144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:03.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.431+0000 7fba2c800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba24144ca0 0x7fba24073230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:03.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.431+0000 7fba2c800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba24073770 0x7fba24146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:03.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.431+0000 7fba2c800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fba240b4d90 con 0x7fba24073770 2024-09-11T23:21:03.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.431+0000 7fba2c800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fba240b3620 con 0x7fba0c0051c0 2024-09-11T23:21:03.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.431+0000 7fba2c800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fba240b4f10 con 0x7fba24144ca0 2024-09-11T23:21:03.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.431+0000 7fba2a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba24073770 0x7fba24146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:03.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.431+0000 7fba2a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba24073770 0x7fba24146ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53516/0 (socket says 172.21.15.144:53516) 2024-09-11T23:21:03.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.431+0000 7fba2a800640 1 -- 172.21.15.144:0/2191673202 learned_addr learned my addr 172.21.15.144:0/2191673202 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:03.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.432+0000 7fba29e00640 1 --2- 172.21.15.144:0/2191673202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba0c0051c0 0x7fba24144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:03.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.432+0000 7fba29400640 1 --2- 172.21.15.144:0/2191673202 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba24144ca0 0x7fba24073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:03.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.432+0000 7fba2a800640 1 -- 172.21.15.144:0/2191673202 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba24144ca0 msgr2=0x7fba24073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:03.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.432+0000 7fba2a800640 1 --2- 172.21.15.144:0/2191673202 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba24144ca0 0x7fba24073230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.432+0000 7fba2a800640 1 -- 172.21.15.144:0/2191673202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba0c0051c0 msgr2=0x7fba24144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:03.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.432+0000 7fba2a800640 1 --2- 172.21.15.144:0/2191673202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba0c0051c0 0x7fba24144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.432+0000 7fba2a800640 1 -- 172.21.15.144:0/2191673202 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba241449b0 con 0x7fba24073770 2024-09-11T23:21:03.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.432+0000 7fba2a800640 1 --2- 172.21.15.144:0/2191673202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba24073770 0x7fba24146ca0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fba2002aab0 tx=0x7fba20001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:03.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.432+0000 7fba1e000640 1 -- 172.21.15.144:0/2191673202 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba20001bf0 con 0x7fba24073770 2024-09-11T23:21:03.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.432+0000 7fba1e000640 1 -- 172.21.15.144:0/2191673202 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba20003970 con 0x7fba24073770 2024-09-11T23:21:03.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.432+0000 7fba1e000640 1 -- 172.21.15.144:0/2191673202 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba200052e0 con 0x7fba24073770 2024-09-11T23:21:03.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.432+0000 7fba2c800640 1 -- 172.21.15.144:0/2191673202 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba24073c10 con 0x7fba24073770 2024-09-11T23:21:03.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.433+0000 7fba2c800640 1 -- 172.21.15.144:0/2191673202 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba240afb70 con 0x7fba24073770 2024-09-11T23:21:03.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.434+0000 7fba2c800640 1 -- 172.21.15.144:0/2191673202 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba2415e310 con 0x7fba24073770 2024-09-11T23:21:03.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.434+0000 7fba1e000640 1 -- 172.21.15.144:0/2191673202 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7fba20042020 con 0x7fba24073770 2024-09-11T23:21:03.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.435+0000 7fba1e000640 1 --2- 172.21.15.144:0/2191673202 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fba0806c010 0x7fba0806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:03.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.435+0000 7fba1e000640 1 -- 172.21.15.144:0/2191673202 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fba200aa8e0 con 0x7fba24073770 2024-09-11T23:21:03.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.435+0000 7fba29e00640 1 --2- 172.21.15.144:0/2191673202 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fba0806c010 0x7fba0806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:03.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.436+0000 7fba29e00640 1 --2- 172.21.15.144:0/2191673202 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fba0806c010 0x7fba0806e4d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fba18001200 tx=0x7fba18009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:03.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.439+0000 7fba1e000640 1 -- 172.21.15.144:0/2191673202 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba2415e310 con 0x7fba24073770 2024-09-11T23:21:03.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.613+0000 7fba2c800640 1 -- 172.21.15.144:0/2191673202 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fba2415fad0 con 0x7fba0806c010 2024-09-11T23:21:03.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.620+0000 7fba1e000640 1 -- 172.21.15.144:0/2191673202 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250592 (secure 0 0 0) 0x7fba2415fad0 con 0x7fba0806c010 2024-09-11T23:21:03.624 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:03.625 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:21:03.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.624+0000 7fba2c800640 1 -- 172.21.15.144:0/2191673202 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fba0806c010 msgr2=0x7fba0806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:03.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.624+0000 7fba2c800640 1 --2- 172.21.15.144:0/2191673202 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fba0806c010 0x7fba0806e4d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fba18001200 tx=0x7fba18009040 comp rx=0 tx=0).stop 2024-09-11T23:21:03.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.624+0000 7fba2c800640 1 -- 172.21.15.144:0/2191673202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba24073770 msgr2=0x7fba24146ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:03.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.624+0000 7fba2c800640 1 --2- 172.21.15.144:0/2191673202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba24073770 0x7fba24146ca0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fba2002aab0 tx=0x7fba20001650 comp rx=0 tx=0).stop 2024-09-11T23:21:03.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.624+0000 7fba2c800640 1 -- 172.21.15.144:0/2191673202 shutdown_connections 2024-09-11T23:21:03.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.624+0000 7fba2c800640 1 --2- 172.21.15.144:0/2191673202 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fba0806c010 0x7fba0806e4d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.624+0000 7fba2c800640 1 --2- 172.21.15.144:0/2191673202 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba24073770 0x7fba24146ca0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.624+0000 7fba2c800640 1 --2- 172.21.15.144:0/2191673202 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fba24144ca0 0x7fba24073230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.624+0000 7fba2c800640 1 --2- 172.21.15.144:0/2191673202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba0c0051c0 0x7fba24144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.624+0000 7fba2c800640 1 -- 172.21.15.144:0/2191673202 >> 172.21.15.144:0/2191673202 conn(0x7fba24062cc0 msgr2=0x7fba240cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:03.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.624+0000 7fba2c800640 1 -- 172.21.15.144:0/2191673202 shutdown_connections 2024-09-11T23:21:03.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.624+0000 7fba2c800640 1 -- 172.21.15.144:0/2191673202 wait complete. 2024-09-11T23:21:03.641 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-11T23:21:03.204993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":190,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231096,"kb_used_data":6524,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743624,"statfs":{"total":773094113280,"available":772857470976,"internally_reserved":0,"allocated":6680576,"data_stored":3433984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.768930"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456550+0000","last_change":"2024-09-11T23:20:59.472164+0000","last_active":"2024-09-11T23:21:00.456550+0000","last_peered":"2024-09-11T23:21:00.456550+0000","last_clean":"2024-09-11T23:21:00.456550+0000","last_became_active":"2024-09-11T23:20:59.471476+0000","last_became_peered":"2024-09-11T23:20:59.471476+0000","last_unstale":"2024-09-11T23:21:00.456550+0000","last_undegraded":"2024-09-11T23:21:00.456550+0000","last_fullsized":"2024-09-11T23:21:00.456550+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:26.417418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871704+0000","last_change":"2024-09-11T23:20:59.467559+0000","last_active":"2024-09-11T23:21:00.871704+0000","last_peered":"2024-09-11T23:21:00.871704+0000","last_clean":"2024-09-11T23:21:00.871704+0000","last_became_active":"2024-09-11T23:20:59.467289+0000","last_became_peered":"2024-09-11T23:20:59.467289+0000","last_unstale":"2024-09-11T23:21:00.871704+0000","last_undegraded":"2024-09-11T23:21:00.871704+0000","last_fullsized":"2024-09-11T23:21:00.871704+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:31.251559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.475161+0000","last_change":"2024-09-11T23:20:59.469746+0000","last_active":"2024-09-11T23:20:59.475161+0000","last_peered":"2024-09-11T23:20:59.475161+0000","last_clean":"2024-09-11T23:20:59.475161+0000","last_became_active":"2024-09-11T23:20:59.469438+0000","last_became_peered":"2024-09-11T23:20:59.469438+0000","last_unstale":"2024-09-11T23:20:59.475161+0000","last_undegraded":"2024-09-11T23:20:59.475161+0000","last_fullsized":"2024-09-11T23:20:59.475161+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:49.249112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.472552+0000","last_change":"2024-09-11T23:20:59.468119+0000","last_active":"2024-09-11T23:20:59.472552+0000","last_peered":"2024-09-11T23:20:59.472552+0000","last_clean":"2024-09-11T23:20:59.472552+0000","last_became_active":"2024-09-11T23:20:59.467847+0000","last_became_peered":"2024-09-11T23:20:59.467847+0000","last_unstale":"2024-09-11T23:20:59.472552+0000","last_undegraded":"2024-09-11T23:20:59.472552+0000","last_fullsized":"2024-09-11T23:20:59.472552+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:50.317785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456756+0000","last_change":"2024-09-11T23:20:59.462985+0000","last_active":"2024-09-11T23:21:00.456756+0000","last_peered":"2024-09-11T23:21:00.456756+0000","last_clean":"2024-09-11T23:21:00.456756+0000","last_became_active":"2024-09-11T23:20:59.462699+0000","last_became_peered":"2024-09-11T23:20:59.462699+0000","last_unstale":"2024-09-11T23:21:00.456756+0000","last_undegraded":"2024-09-11T23:21:00.456756+0000","last_fullsized":"2024-09-11T23:21:00.456756+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:58.821334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.449691+0000","last_change":"2024-09-11T23:20:58.449691+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.449691+0000","last_undegraded":"2024-09-11T23:20:58.449691+0000","last_fullsized":"2024-09-11T23:20:58.449691+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.470273+0000","last_change":"2024-09-11T23:20:59.464854+0000","last_active":"2024-09-11T23:20:59.470273+0000","last_peered":"2024-09-11T23:20:59.470273+0000","last_clean":"2024-09-11T23:20:59.470273+0000","last_became_active":"2024-09-11T23:20:59.464585+0000","last_became_peered":"2024-09-11T23:20:59.464585+0000","last_unstale":"2024-09-11T23:20:59.470273+0000","last_undegraded":"2024-09-11T23:20:59.470273+0000","last_fullsized":"2024-09-11T23:20:59.470273+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:39.929849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871393+0000","last_change":"2024-09-11T23:20:59.461801+0000","last_active":"2024-09-11T23:21:00.871393+0000","last_peered":"2024-09-11T23:21:00.871393+0000","last_clean":"2024-09-11T23:21:00.871393+0000","last_became_active":"2024-09-11T23:20:59.461531+0000","last_became_peered":"2024-09-11T23:20:59.461531+0000","last_unstale":"2024-09-11T23:21:00.871393+0000","last_undegraded":"2024-09-11T23:21:00.871393+0000","last_fullsized":"2024-09-11T23:21:00.871393+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:44.244935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.488243+0000","last_change":"2024-09-11T23:20:59.483367+0000","last_active":"2024-09-11T23:20:59.488243+0000","last_peered":"2024-09-11T23:20:59.488243+0000","last_clean":"2024-09-11T23:20:59.488243+0000","last_became_active":"2024-09-11T23:20:59.483009+0000","last_became_peered":"2024-09-11T23:20:59.483009+0000","last_unstale":"2024-09-11T23:20:59.488243+0000","last_undegraded":"2024-09-11T23:20:59.488243+0000","last_fullsized":"2024-09-11T23:20:59.488243+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:22.679717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.450117+0000","last_change":"2024-09-11T23:20:58.450117+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.450117+0000","last_undegraded":"2024-09-11T23:20:58.450117+0000","last_fullsized":"2024-09-11T23:20:58.450117+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.450382+0000","last_change":"2024-09-11T23:20:58.450382+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.450382+0000","last_undegraded":"2024-09-11T23:20:58.450382+0000","last_fullsized":"2024-09-11T23:20:58.450382+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.472531+0000","last_change":"2024-09-11T23:20:59.467528+0000","last_active":"2024-09-11T23:20:59.472531+0000","last_peered":"2024-09-11T23:20:59.472531+0000","last_clean":"2024-09-11T23:20:59.472531+0000","last_became_active":"2024-09-11T23:20:59.467148+0000","last_became_peered":"2024-09-11T23:20:59.467148+0000","last_unstale":"2024-09-11T23:20:59.472531+0000","last_undegraded":"2024-09-11T23:20:59.472531+0000","last_fullsized":"2024-09-11T23:20:59.472531+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:31.276490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.475119+0000","last_change":"2024-09-11T23:20:59.471352+0000","last_active":"2024-09-11T23:20:59.475119+0000","last_peered":"2024-09-11T23:20:59.475119+0000","last_clean":"2024-09-11T23:20:59.475119+0000","last_became_active":"2024-09-11T23:20:59.470968+0000","last_became_peered":"2024-09-11T23:20:59.470968+0000","last_unstale":"2024-09-11T23:20:59.475119+0000","last_undegraded":"2024-09-11T23:20:59.475119+0000","last_fullsized":"2024-09-11T23:20:59.475119+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:45.696532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.462287+0000","last_change":"2024-09-11T23:20:59.458141+0000","last_active":"2024-09-11T23:20:59.462287+0000","last_peered":"2024-09-11T23:20:59.462287+0000","last_clean":"2024-09-11T23:20:59.462287+0000","last_became_active":"2024-09-11T23:20:59.457853+0000","last_became_peered":"2024-09-11T23:20:59.457853+0000","last_unstale":"2024-09-11T23:20:59.462287+0000","last_undegraded":"2024-09-11T23:20:59.462287+0000","last_fullsized":"2024-09-11T23:20:59.462287+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:28.453235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.464989+0000","last_change":"2024-09-11T23:20:59.457958+0000","last_active":"2024-09-11T23:20:59.464989+0000","last_peered":"2024-09-11T23:20:59.464989+0000","last_clean":"2024-09-11T23:20:59.464989+0000","last_became_active":"2024-09-11T23:20:59.457672+0000","last_became_peered":"2024-09-11T23:20:59.457672+0000","last_unstale":"2024-09-11T23:20:59.464989+0000","last_undegraded":"2024-09-11T23:20:59.464989+0000","last_fullsized":"2024-09-11T23:20:59.464989+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:35.174888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.449499+0000","last_change":"2024-09-11T23:20:58.449499+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.449499+0000","last_undegraded":"2024-09-11T23:20:58.449499+0000","last_fullsized":"2024-09-11T23:20:58.449499+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871858+0000","last_change":"2024-09-11T23:20:59.465949+0000","last_active":"2024-09-11T23:21:00.871858+0000","last_peered":"2024-09-11T23:21:00.871858+0000","last_clean":"2024-09-11T23:21:00.871858+0000","last_became_active":"2024-09-11T23:20:59.465251+0000","last_became_peered":"2024-09-11T23:20:59.465251+0000","last_unstale":"2024-09-11T23:21:00.871858+0000","last_undegraded":"2024-09-11T23:21:00.871858+0000","last_fullsized":"2024-09-11T23:21:00.871858+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:40.463156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.473417+0000","last_change":"2024-09-11T23:20:59.469311+0000","last_active":"2024-09-11T23:20:59.473417+0000","last_peered":"2024-09-11T23:20:59.473417+0000","last_clean":"2024-09-11T23:20:59.473417+0000","last_became_active":"2024-09-11T23:20:59.468802+0000","last_became_peered":"2024-09-11T23:20:59.468802+0000","last_unstale":"2024-09-11T23:20:59.473417+0000","last_undegraded":"2024-09-11T23:20:59.473417+0000","last_fullsized":"2024-09-11T23:20:59.473417+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:50.317785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456586+0000","last_change":"2024-09-11T23:20:59.468862+0000","last_active":"2024-09-11T23:21:00.456586+0000","last_peered":"2024-09-11T23:21:00.456586+0000","last_clean":"2024-09-11T23:21:00.456586+0000","last_became_active":"2024-09-11T23:20:59.468588+0000","last_became_peered":"2024-09-11T23:20:59.468588+0000","last_unstale":"2024-09-11T23:21:00.456586+0000","last_undegraded":"2024-09-11T23:21:00.456586+0000","last_fullsized":"2024-09-11T23:21:00.456586+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:09.356677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871622+0000","last_change":"2024-09-11T23:20:59.468990+0000","last_active":"2024-09-11T23:21:00.871622+0000","last_peered":"2024-09-11T23:21:00.871622+0000","last_clean":"2024-09-11T23:21:00.871622+0000","last_became_active":"2024-09-11T23:20:59.468736+0000","last_became_peered":"2024-09-11T23:20:59.468736+0000","last_unstale":"2024-09-11T23:21:00.871622+0000","last_undegraded":"2024-09-11T23:21:00.871622+0000","last_fullsized":"2024-09-11T23:21:00.871622+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:08.951140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.480672+0000","last_change":"2024-09-11T23:20:59.477858+0000","last_active":"2024-09-11T23:20:59.480672+0000","last_peered":"2024-09-11T23:20:59.480672+0000","last_clean":"2024-09-11T23:20:59.480672+0000","last_became_active":"2024-09-11T23:20:59.477437+0000","last_became_peered":"2024-09-11T23:20:59.477437+0000","last_unstale":"2024-09-11T23:20:59.480672+0000","last_undegraded":"2024-09-11T23:20:59.480672+0000","last_fullsized":"2024-09-11T23:20:59.480672+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:27.032373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871537+0000","last_change":"2024-09-11T23:20:59.461667+0000","last_active":"2024-09-11T23:21:00.871537+0000","last_peered":"2024-09-11T23:21:00.871537+0000","last_clean":"2024-09-11T23:21:00.871537+0000","last_became_active":"2024-09-11T23:20:59.461421+0000","last_became_peered":"2024-09-11T23:20:59.461421+0000","last_unstale":"2024-09-11T23:21:00.871537+0000","last_undegraded":"2024-09-11T23:21:00.871537+0000","last_fullsized":"2024-09-11T23:21:00.871537+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:45.567676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.479809+0000","last_change":"2024-09-11T23:20:59.476578+0000","last_active":"2024-09-11T23:20:59.479809+0000","last_peered":"2024-09-11T23:20:59.479809+0000","last_clean":"2024-09-11T23:20:59.479809+0000","last_became_active":"2024-09-11T23:20:59.476300+0000","last_became_peered":"2024-09-11T23:20:59.476300+0000","last_unstale":"2024-09-11T23:20:59.479809+0000","last_undegraded":"2024-09-11T23:20:59.479809+0000","last_fullsized":"2024-09-11T23:20:59.479809+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:12.645604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.475062+0000","last_change":"2024-09-11T23:20:59.472368+0000","last_active":"2024-09-11T23:20:59.475062+0000","last_peered":"2024-09-11T23:20:59.475062+0000","last_clean":"2024-09-11T23:20:59.475062+0000","last_became_active":"2024-09-11T23:20:59.472087+0000","last_became_peered":"2024-09-11T23:20:59.472087+0000","last_unstale":"2024-09-11T23:20:59.475062+0000","last_undegraded":"2024-09-11T23:20:59.475062+0000","last_fullsized":"2024-09-11T23:20:59.475062+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:25.693967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456689+0000","last_change":"2024-09-11T23:20:59.472381+0000","last_active":"2024-09-11T23:21:00.456689+0000","last_peered":"2024-09-11T23:21:00.456689+0000","last_clean":"2024-09-11T23:21:00.456689+0000","last_became_active":"2024-09-11T23:20:59.471907+0000","last_became_peered":"2024-09-11T23:20:59.471907+0000","last_unstale":"2024-09-11T23:21:00.456689+0000","last_undegraded":"2024-09-11T23:21:00.456689+0000","last_fullsized":"2024-09-11T23:21:00.456689+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:03.162864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.478427+0000","last_change":"2024-09-11T23:20:59.472931+0000","last_active":"2024-09-11T23:20:59.478427+0000","last_peered":"2024-09-11T23:20:59.478427+0000","last_clean":"2024-09-11T23:20:59.478427+0000","last_became_active":"2024-09-11T23:20:59.472664+0000","last_became_peered":"2024-09-11T23:20:59.472664+0000","last_unstale":"2024-09-11T23:20:59.478427+0000","last_undegraded":"2024-09-11T23:20:59.478427+0000","last_fullsized":"2024-09-11T23:20:59.478427+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:39.771178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.451550+0000","last_change":"2024-09-11T23:20:58.451550+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.451550+0000","last_undegraded":"2024-09-11T23:20:58.451550+0000","last_fullsized":"2024-09-11T23:20:58.451550+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456643+0000","last_change":"2024-09-11T23:20:59.469067+0000","last_active":"2024-09-11T23:21:00.456643+0000","last_peered":"2024-09-11T23:21:00.456643+0000","last_clean":"2024-09-11T23:21:00.456643+0000","last_became_active":"2024-09-11T23:20:59.468802+0000","last_became_peered":"2024-09-11T23:20:59.468802+0000","last_unstale":"2024-09-11T23:21:00.456643+0000","last_undegraded":"2024-09-11T23:21:00.456643+0000","last_fullsized":"2024-09-11T23:21:00.456643+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:34.477242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871779+0000","last_change":"2024-09-11T23:20:59.466832+0000","last_active":"2024-09-11T23:21:00.871779+0000","last_peered":"2024-09-11T23:21:00.871779+0000","last_clean":"2024-09-11T23:21:00.871779+0000","last_became_active":"2024-09-11T23:20:59.466560+0000","last_became_peered":"2024-09-11T23:20:59.466560+0000","last_unstale":"2024-09-11T23:21:00.871779+0000","last_undegraded":"2024-09-11T23:21:00.871779+0000","last_fullsized":"2024-09-11T23:21:00.871779+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:42.410011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.475209+0000","last_change":"2024-09-11T23:20:59.470126+0000","last_active":"2024-09-11T23:20:59.475209+0000","last_peered":"2024-09-11T23:20:59.475209+0000","last_clean":"2024-09-11T23:20:59.475209+0000","last_became_active":"2024-09-11T23:20:59.469730+0000","last_became_peered":"2024-09-11T23:20:59.469730+0000","last_unstale":"2024-09-11T23:20:59.475209+0000","last_undegraded":"2024-09-11T23:20:59.475209+0000","last_fullsized":"2024-09-11T23:20:59.475209+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:39.610047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456362+0000","last_change":"2024-09-11T23:20:59.474680+0000","last_active":"2024-09-11T23:21:00.456362+0000","last_peered":"2024-09-11T23:21:00.456362+0000","last_clean":"2024-09-11T23:21:00.456362+0000","last_became_active":"2024-09-11T23:20:59.472530+0000","last_became_peered":"2024-09-11T23:20:59.472530+0000","last_unstale":"2024-09-11T23:21:00.456362+0000","last_undegraded":"2024-09-11T23:21:00.456362+0000","last_fullsized":"2024-09-11T23:21:00.456362+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:37.774651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.449099+0000","last_change":"2024-09-11T23:20:58.449099+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.449099+0000","last_undegraded":"2024-09-11T23:20:58.449099+0000","last_fullsized":"2024-09-11T23:20:58.449099+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.449131+0000","last_change":"2024-09-11T23:20:58.449131+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.449131+0000","last_undegraded":"2024-09-11T23:20:58.449131+0000","last_fullsized":"2024-09-11T23:20:58.449131+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.467758+0000","last_change":"2024-09-11T23:20:58.461846+0000","last_active":"2024-09-11T23:20:58.467758+0000","last_peered":"2024-09-11T23:20:58.467758+0000","last_clean":"2024-09-11T23:20:58.467758+0000","last_became_active":"2024-09-11T23:20:58.461591+0000","last_became_peered":"2024-09-11T23:20:58.461591+0000","last_unstale":"2024-09-11T23:20:58.467758+0000","last_undegraded":"2024-09-11T23:20:58.467758+0000","last_fullsized":"2024-09-11T23:20:58.467758+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:30.133913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.451217+0000","last_change":"2024-09-11T23:20:58.451217+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.451217+0000","last_undegraded":"2024-09-11T23:20:58.451217+0000","last_fullsized":"2024-09-11T23:20:58.451217+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871666+0000","last_change":"2024-09-11T23:20:58.465371+0000","last_active":"2024-09-11T23:21:00.871666+0000","last_peered":"2024-09-11T23:21:00.871666+0000","last_clean":"2024-09-11T23:21:00.871666+0000","last_became_active":"2024-09-11T23:20:58.465117+0000","last_became_peered":"2024-09-11T23:20:58.465117+0000","last_unstale":"2024-09-11T23:21:00.871666+0000","last_undegraded":"2024-09-11T23:21:00.871666+0000","last_fullsized":"2024-09-11T23:21:00.871666+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:38.868184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.450075+0000","last_change":"2024-09-11T23:20:58.450075+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.450075+0000","last_undegraded":"2024-09-11T23:20:58.450075+0000","last_fullsized":"2024-09-11T23:20:58.450075+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.465326+0000","last_change":"2024-09-11T23:20:58.460984+0000","last_active":"2024-09-11T23:20:58.465326+0000","last_peered":"2024-09-11T23:20:58.465326+0000","last_clean":"2024-09-11T23:20:58.465326+0000","last_became_active":"2024-09-11T23:20:58.460659+0000","last_became_peered":"2024-09-11T23:20:58.460659+0000","last_unstale":"2024-09-11T23:20:58.465326+0000","last_undegraded":"2024-09-11T23:20:58.465326+0000","last_fullsized":"2024-09-11T23:20:58.465326+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:38.922109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.450534+0000","last_change":"2024-09-11T23:20:58.450534+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.450534+0000","last_undegraded":"2024-09-11T23:20:58.450534+0000","last_fullsized":"2024-09-11T23:20:58.450534+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.480470+0000","last_change":"2024-09-11T23:20:58.462668+0000","last_active":"2024-09-11T23:20:59.480470+0000","last_peered":"2024-09-11T23:20:59.480470+0000","last_clean":"2024-09-11T23:20:59.480470+0000","last_became_active":"2024-09-11T23:20:58.462349+0000","last_became_peered":"2024-09-11T23:20:58.462349+0000","last_unstale":"2024-09-11T23:20:59.480470+0000","last_undegraded":"2024-09-11T23:20:59.480470+0000","last_fullsized":"2024-09-11T23:20:59.480470+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:16.896074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871423+0000","last_change":"2024-09-11T23:20:59.461146+0000","last_active":"2024-09-11T23:21:00.871423+0000","last_peered":"2024-09-11T23:21:00.871423+0000","last_clean":"2024-09-11T23:21:00.871423+0000","last_became_active":"2024-09-11T23:20:59.460868+0000","last_became_peered":"2024-09-11T23:20:59.460868+0000","last_unstale":"2024-09-11T23:21:00.871423+0000","last_undegraded":"2024-09-11T23:21:00.871423+0000","last_fullsized":"2024-09-11T23:21:00.871423+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:12.270988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.483394+0000","last_change":"2024-09-11T23:20:58.459200+0000","last_active":"2024-09-11T23:20:59.483394+0000","last_peered":"2024-09-11T23:20:59.483394+0000","last_clean":"2024-09-11T23:20:59.483394+0000","last_became_active":"2024-09-11T23:20:58.458940+0000","last_became_peered":"2024-09-11T23:20:58.458940+0000","last_unstale":"2024-09-11T23:20:59.483394+0000","last_undegraded":"2024-09-11T23:20:59.483394+0000","last_fullsized":"2024-09-11T23:20:59.483394+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:24.686226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871421+0000","last_change":"2024-09-11T23:20:59.471438+0000","last_active":"2024-09-11T23:21:00.871421+0000","last_peered":"2024-09-11T23:21:00.871421+0000","last_clean":"2024-09-11T23:21:00.871421+0000","last_became_active":"2024-09-11T23:20:59.471170+0000","last_became_peered":"2024-09-11T23:20:59.471170+0000","last_unstale":"2024-09-11T23:21:00.871421+0000","last_undegraded":"2024-09-11T23:21:00.871421+0000","last_fullsized":"2024-09-11T23:21:00.871421+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:52.111971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.465963+0000","last_change":"2024-09-11T23:20:58.459414+0000","last_active":"2024-09-11T23:20:58.465963+0000","last_peered":"2024-09-11T23:20:58.465963+0000","last_clean":"2024-09-11T23:20:58.465963+0000","last_became_active":"2024-09-11T23:20:58.459152+0000","last_became_peered":"2024-09-11T23:20:58.459152+0000","last_unstale":"2024-09-11T23:20:58.465963+0000","last_undegraded":"2024-09-11T23:20:58.465963+0000","last_fullsized":"2024-09-11T23:20:58.465963+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:34.167147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.470020+0000","last_change":"2024-09-11T23:20:59.464299+0000","last_active":"2024-09-11T23:20:59.470020+0000","last_peered":"2024-09-11T23:20:59.470020+0000","last_clean":"2024-09-11T23:20:59.470020+0000","last_became_active":"2024-09-11T23:20:59.463578+0000","last_became_peered":"2024-09-11T23:20:59.463578+0000","last_unstale":"2024-09-11T23:20:59.470020+0000","last_undegraded":"2024-09-11T23:20:59.470020+0000","last_fullsized":"2024-09-11T23:20:59.470020+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:37.020538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.458543+0000","last_change":"2024-09-11T23:20:58.462986+0000","last_active":"2024-09-11T23:20:59.458543+0000","last_peered":"2024-09-11T23:20:59.458543+0000","last_clean":"2024-09-11T23:20:59.458543+0000","last_became_active":"2024-09-11T23:20:58.462292+0000","last_became_peered":"2024-09-11T23:20:58.462292+0000","last_unstale":"2024-09-11T23:20:59.458543+0000","last_undegraded":"2024-09-11T23:20:59.458543+0000","last_fullsized":"2024-09-11T23:20:59.458543+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.187950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871431+0000","last_change":"2024-09-11T23:20:59.461080+0000","last_active":"2024-09-11T23:21:00.871431+0000","last_peered":"2024-09-11T23:21:00.871431+0000","last_clean":"2024-09-11T23:21:00.871431+0000","last_became_active":"2024-09-11T23:20:59.460840+0000","last_became_peered":"2024-09-11T23:20:59.460840+0000","last_unstale":"2024-09-11T23:21:00.871431+0000","last_undegraded":"2024-09-11T23:21:00.871431+0000","last_fullsized":"2024-09-11T23:21:00.871431+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:06.473547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.451422+0000","last_change":"2024-09-11T23:20:58.462888+0000","last_active":"2024-09-11T23:20:59.451422+0000","last_peered":"2024-09-11T23:20:59.451422+0000","last_clean":"2024-09-11T23:20:59.451422+0000","last_became_active":"2024-09-11T23:20:58.462609+0000","last_became_peered":"2024-09-11T23:20:58.462609+0000","last_unstale":"2024-09-11T23:20:59.451422+0000","last_undegraded":"2024-09-11T23:20:59.451422+0000","last_fullsized":"2024-09-11T23:20:59.451422+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:29.652502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.466007+0000","last_change":"2024-09-11T23:20:59.458893+0000","last_active":"2024-09-11T23:20:59.466007+0000","last_peered":"2024-09-11T23:20:59.466007+0000","last_clean":"2024-09-11T23:20:59.466007+0000","last_became_active":"2024-09-11T23:20:59.458626+0000","last_became_peered":"2024-09-11T23:20:59.458626+0000","last_unstale":"2024-09-11T23:20:59.466007+0000","last_undegraded":"2024-09-11T23:20:59.466007+0000","last_fullsized":"2024-09-11T23:20:59.466007+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:04.817794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.461256+0000","last_change":"2024-09-11T23:20:58.473089+0000","last_active":"2024-09-11T23:20:59.461256+0000","last_peered":"2024-09-11T23:20:59.461256+0000","last_clean":"2024-09-11T23:20:59.461256+0000","last_became_active":"2024-09-11T23:20:58.472866+0000","last_became_peered":"2024-09-11T23:20:58.472866+0000","last_unstale":"2024-09-11T23:20:59.461256+0000","last_undegraded":"2024-09-11T23:20:59.461256+0000","last_fullsized":"2024-09-11T23:20:59.461256+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:24.239996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.482690+0000","last_change":"2024-09-11T23:20:59.480062+0000","last_active":"2024-09-11T23:20:59.482690+0000","last_peered":"2024-09-11T23:20:59.482690+0000","last_clean":"2024-09-11T23:20:59.482690+0000","last_became_active":"2024-09-11T23:20:59.479528+0000","last_became_peered":"2024-09-11T23:20:59.479528+0000","last_unstale":"2024-09-11T23:20:59.482690+0000","last_undegraded":"2024-09-11T23:20:59.482690+0000","last_fullsized":"2024-09-11T23:20:59.482690+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:17.572628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871771+0000","last_change":"2024-09-11T23:20:58.466599+0000","last_active":"2024-09-11T23:21:00.871771+0000","last_peered":"2024-09-11T23:21:00.871771+0000","last_clean":"2024-09-11T23:21:00.871771+0000","last_became_active":"2024-09-11T23:20:58.466282+0000","last_became_peered":"2024-09-11T23:20:58.466282+0000","last_unstale":"2024-09-11T23:21:00.871771+0000","last_undegraded":"2024-09-11T23:21:00.871771+0000","last_fullsized":"2024-09-11T23:21:00.871771+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:39.888169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.449799+0000","last_change":"2024-09-11T23:20:58.449799+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.449799+0000","last_undegraded":"2024-09-11T23:20:58.449799+0000","last_fullsized":"2024-09-11T23:20:58.449799+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"58'3","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.484705+0000","last_change":"2024-09-11T23:20:58.466818+0000","last_active":"2024-09-11T23:20:59.484705+0000","last_peered":"2024-09-11T23:20:59.484705+0000","last_clean":"2024-09-11T23:20:59.484705+0000","last_became_active":"2024-09-11T23:20:58.466361+0000","last_became_peered":"2024-09-11T23:20:58.466361+0000","last_unstale":"2024-09-11T23:20:59.484705+0000","last_undegraded":"2024-09-11T23:20:59.484705+0000","last_fullsized":"2024-09-11T23:20:59.484705+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:43.819715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.488716+0000","last_change":"2024-09-11T23:20:59.483767+0000","last_active":"2024-09-11T23:20:59.488716+0000","last_peered":"2024-09-11T23:20:59.488716+0000","last_clean":"2024-09-11T23:20:59.488716+0000","last_became_active":"2024-09-11T23:20:59.483431+0000","last_became_peered":"2024-09-11T23:20:59.483431+0000","last_unstale":"2024-09-11T23:20:59.488716+0000","last_undegraded":"2024-09-11T23:20:59.488716+0000","last_fullsized":"2024-09-11T23:20:59.488716+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:29.787221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"58'6","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.488822+0000","last_change":"2024-09-11T23:20:58.456875+0000","last_active":"2024-09-11T23:20:59.488822+0000","last_peered":"2024-09-11T23:20:59.488822+0000","last_clean":"2024-09-11T23:20:59.488822+0000","last_became_active":"2024-09-11T23:20:58.456579+0000","last_became_peered":"2024-09-11T23:20:58.456579+0000","last_unstale":"2024-09-11T23:20:59.488822+0000","last_undegraded":"2024-09-11T23:20:59.488822+0000","last_fullsized":"2024-09-11T23:20:59.488822+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:39.167478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.475829+0000","last_change":"2024-09-11T23:20:59.469201+0000","last_active":"2024-09-11T23:20:59.475829+0000","last_peered":"2024-09-11T23:20:59.475829+0000","last_clean":"2024-09-11T23:20:59.475829+0000","last_became_active":"2024-09-11T23:20:59.468613+0000","last_became_peered":"2024-09-11T23:20:59.468613+0000","last_unstale":"2024-09-11T23:20:59.475829+0000","last_undegraded":"2024-09-11T23:20:59.475829+0000","last_fullsized":"2024-09-11T23:20:59.475829+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:39.610047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871362+0000","last_change":"2024-09-11T23:20:58.467171+0000","last_active":"2024-09-11T23:21:00.871362+0000","last_peered":"2024-09-11T23:21:00.871362+0000","last_clean":"2024-09-11T23:21:00.871362+0000","last_became_active":"2024-09-11T23:20:58.466901+0000","last_became_peered":"2024-09-11T23:20:58.466901+0000","last_unstale":"2024-09-11T23:21:00.871362+0000","last_undegraded":"2024-09-11T23:21:00.871362+0000","last_fullsized":"2024-09-11T23:21:00.871362+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:42.485376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.472676+0000","last_change":"2024-09-11T23:20:59.467990+0000","last_active":"2024-09-11T23:20:59.472676+0000","last_peered":"2024-09-11T23:20:59.472676+0000","last_clean":"2024-09-11T23:20:59.472676+0000","last_became_active":"2024-09-11T23:20:59.467663+0000","last_became_peered":"2024-09-11T23:20:59.467663+0000","last_unstale":"2024-09-11T23:20:59.472676+0000","last_undegraded":"2024-09-11T23:20:59.472676+0000","last_fullsized":"2024-09-11T23:20:59.472676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:31.276490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.451054+0000","last_change":"2024-09-11T23:20:58.463853+0000","last_active":"2024-09-11T23:20:59.451054+0000","last_peered":"2024-09-11T23:20:59.451054+0000","last_clean":"2024-09-11T23:20:59.451054+0000","last_became_active":"2024-09-11T23:20:58.463592+0000","last_became_peered":"2024-09-11T23:20:58.463592+0000","last_unstale":"2024-09-11T23:20:59.451054+0000","last_undegraded":"2024-09-11T23:20:59.451054+0000","last_fullsized":"2024-09-11T23:20:59.451054+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:08.131569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.469850+0000","last_change":"2024-09-11T23:20:59.465985+0000","last_active":"2024-09-11T23:20:59.469850+0000","last_peered":"2024-09-11T23:20:59.469850+0000","last_clean":"2024-09-11T23:20:59.469850+0000","last_became_active":"2024-09-11T23:20:59.465623+0000","last_became_peered":"2024-09-11T23:20:59.465623+0000","last_unstale":"2024-09-11T23:20:59.469850+0000","last_undegraded":"2024-09-11T23:20:59.469850+0000","last_fullsized":"2024-09-11T23:20:59.469850+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:31.141653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.458700+0000","last_change":"2024-09-11T23:20:58.463387+0000","last_active":"2024-09-11T23:20:59.458700+0000","last_peered":"2024-09-11T23:20:59.458700+0000","last_clean":"2024-09-11T23:20:59.458700+0000","last_became_active":"2024-09-11T23:20:58.463106+0000","last_became_peered":"2024-09-11T23:20:58.463106+0000","last_unstale":"2024-09-11T23:20:59.458700+0000","last_undegraded":"2024-09-11T23:20:59.458700+0000","last_fullsized":"2024-09-11T23:20:59.458700+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:18.406488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.479594+0000","last_change":"2024-09-11T23:20:59.476552+0000","last_active":"2024-09-11T23:20:59.479594+0000","last_peered":"2024-09-11T23:20:59.479594+0000","last_clean":"2024-09-11T23:20:59.479594+0000","last_became_active":"2024-09-11T23:20:59.476173+0000","last_became_peered":"2024-09-11T23:20:59.476173+0000","last_unstale":"2024-09-11T23:20:59.479594+0000","last_undegraded":"2024-09-11T23:20:59.479594+0000","last_fullsized":"2024-09-11T23:20:59.479594+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:50.314018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"58'8","reported_seq":20,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.482839+0000","last_change":"2024-09-11T23:20:58.467986+0000","last_active":"2024-09-11T23:20:59.482839+0000","last_peered":"2024-09-11T23:20:59.482839+0000","last_clean":"2024-09-11T23:20:59.482839+0000","last_became_active":"2024-09-11T23:20:58.466944+0000","last_became_peered":"2024-09-11T23:20:58.466944+0000","last_unstale":"2024-09-11T23:20:59.482839+0000","last_undegraded":"2024-09-11T23:20:59.482839+0000","last_fullsized":"2024-09-11T23:20:59.482839+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:06.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.478297+0000","last_change":"2024-09-11T23:20:59.472856+0000","last_active":"2024-09-11T23:20:59.478297+0000","last_peered":"2024-09-11T23:20:59.478297+0000","last_clean":"2024-09-11T23:20:59.478297+0000","last_became_active":"2024-09-11T23:20:59.471121+0000","last_became_peered":"2024-09-11T23:20:59.471121+0000","last_unstale":"2024-09-11T23:20:59.478297+0000","last_undegraded":"2024-09-11T23:20:59.478297+0000","last_fullsized":"2024-09-11T23:20:59.478297+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:34.060404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871796+0000","last_change":"2024-09-11T23:20:58.466456+0000","last_active":"2024-09-11T23:21:00.871796+0000","last_peered":"2024-09-11T23:21:00.871796+0000","last_clean":"2024-09-11T23:21:00.871796+0000","last_became_active":"2024-09-11T23:20:58.466200+0000","last_became_peered":"2024-09-11T23:20:58.466200+0000","last_unstale":"2024-09-11T23:21:00.871796+0000","last_undegraded":"2024-09-11T23:21:00.871796+0000","last_fullsized":"2024-09-11T23:21:00.871796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:23.944565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.474147+0000","last_change":"2024-09-11T23:20:59.466534+0000","last_active":"2024-09-11T23:20:59.474147+0000","last_peered":"2024-09-11T23:20:59.474147+0000","last_clean":"2024-09-11T23:20:59.474147+0000","last_became_active":"2024-09-11T23:20:59.466243+0000","last_became_peered":"2024-09-11T23:20:59.466243+0000","last_unstale":"2024-09-11T23:20:59.474147+0000","last_undegraded":"2024-09-11T23:20:59.474147+0000","last_fullsized":"2024-09-11T23:20:59.474147+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:44.827455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.472249+0000","last_change":"2024-09-11T23:20:58.468458+0000","last_active":"2024-09-11T23:20:58.472249+0000","last_peered":"2024-09-11T23:20:58.472249+0000","last_clean":"2024-09-11T23:20:58.472249+0000","last_became_active":"2024-09-11T23:20:58.468206+0000","last_became_peered":"2024-09-11T23:20:58.468206+0000","last_unstale":"2024-09-11T23:20:58.472249+0000","last_undegraded":"2024-09-11T23:20:58.472249+0000","last_fullsized":"2024-09-11T23:20:58.472249+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:29.469606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871909+0000","last_change":"2024-09-11T23:20:59.462675+0000","last_active":"2024-09-11T23:21:00.871909+0000","last_peered":"2024-09-11T23:21:00.871909+0000","last_clean":"2024-09-11T23:21:00.871909+0000","last_became_active":"2024-09-11T23:20:59.462426+0000","last_became_peered":"2024-09-11T23:20:59.462426+0000","last_unstale":"2024-09-11T23:21:00.871909+0000","last_undegraded":"2024-09-11T23:21:00.871909+0000","last_fullsized":"2024-09-11T23:21:00.871909+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:13.970806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.480288+0000","last_change":"2024-09-11T23:20:58.467884+0000","last_active":"2024-09-11T23:20:59.480288+0000","last_peered":"2024-09-11T23:20:59.480288+0000","last_clean":"2024-09-11T23:20:59.480288+0000","last_became_active":"2024-09-11T23:20:58.467589+0000","last_became_peered":"2024-09-11T23:20:58.467589+0000","last_unstale":"2024-09-11T23:20:59.480288+0000","last_undegraded":"2024-09-11T23:20:59.480288+0000","last_fullsized":"2024-09-11T23:20:59.480288+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:06.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.488729+0000","last_change":"2024-09-11T23:20:59.483962+0000","last_active":"2024-09-11T23:20:59.488729+0000","last_peered":"2024-09-11T23:20:59.488729+0000","last_clean":"2024-09-11T23:20:59.488729+0000","last_became_active":"2024-09-11T23:20:59.483698+0000","last_became_peered":"2024-09-11T23:20:59.483698+0000","last_unstale":"2024-09-11T23:20:59.488729+0000","last_undegraded":"2024-09-11T23:20:59.488729+0000","last_fullsized":"2024-09-11T23:20:59.488729+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:08.772254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.467635+0000","last_change":"2024-09-11T23:20:58.464827+0000","last_active":"2024-09-11T23:20:58.467635+0000","last_peered":"2024-09-11T23:20:58.467635+0000","last_clean":"2024-09-11T23:20:58.467635+0000","last_became_active":"2024-09-11T23:20:58.464593+0000","last_became_peered":"2024-09-11T23:20:58.464593+0000","last_unstale":"2024-09-11T23:20:58.467635+0000","last_undegraded":"2024-09-11T23:20:58.467635+0000","last_fullsized":"2024-09-11T23:20:58.467635+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:20.242907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.478418+0000","last_change":"2024-09-11T23:20:59.468489+0000","last_active":"2024-09-11T23:20:59.478418+0000","last_peered":"2024-09-11T23:20:59.478418+0000","last_clean":"2024-09-11T23:20:59.478418+0000","last_became_active":"2024-09-11T23:20:59.466325+0000","last_became_peered":"2024-09-11T23:20:59.466325+0000","last_unstale":"2024-09-11T23:20:59.478418+0000","last_undegraded":"2024-09-11T23:20:59.478418+0000","last_fullsized":"2024-09-11T23:20:59.478418+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:49.249112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871522+0000","last_change":"2024-09-11T23:20:58.461629+0000","last_active":"2024-09-11T23:21:00.871522+0000","last_peered":"2024-09-11T23:21:00.871522+0000","last_clean":"2024-09-11T23:21:00.871522+0000","last_became_active":"2024-09-11T23:20:58.461361+0000","last_became_peered":"2024-09-11T23:20:58.461361+0000","last_unstale":"2024-09-11T23:21:00.871522+0000","last_undegraded":"2024-09-11T23:21:00.871522+0000","last_fullsized":"2024-09-11T23:21:00.871522+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:39.804195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.448097+0000","last_change":"2024-09-11T23:20:58.448097+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.448097+0000","last_undegraded":"2024-09-11T23:20:58.448097+0000","last_fullsized":"2024-09-11T23:20:58.448097+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.465691+0000","last_change":"2024-09-11T23:20:58.461264+0000","last_active":"2024-09-11T23:20:58.465691+0000","last_peered":"2024-09-11T23:20:58.465691+0000","last_clean":"2024-09-11T23:20:58.465691+0000","last_became_active":"2024-09-11T23:20:58.461014+0000","last_became_peered":"2024-09-11T23:20:58.461014+0000","last_unstale":"2024-09-11T23:20:58.465691+0000","last_undegraded":"2024-09-11T23:20:58.465691+0000","last_fullsized":"2024-09-11T23:20:58.465691+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:41.170235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.450734+0000","last_change":"2024-09-11T23:20:58.450734+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.450734+0000","last_undegraded":"2024-09-11T23:20:58.450734+0000","last_fullsized":"2024-09-11T23:20:58.450734+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.461077+0000","last_change":"2024-09-11T23:20:58.465129+0000","last_active":"2024-09-11T23:20:59.461077+0000","last_peered":"2024-09-11T23:20:59.461077+0000","last_clean":"2024-09-11T23:20:59.461077+0000","last_became_active":"2024-09-11T23:20:58.464847+0000","last_became_peered":"2024-09-11T23:20:58.464847+0000","last_unstale":"2024-09-11T23:20:59.461077+0000","last_undegraded":"2024-09-11T23:20:59.461077+0000","last_fullsized":"2024-09-11T23:20:59.461077+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:58.558566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.476804+0000","last_change":"2024-09-11T23:20:59.470013+0000","last_active":"2024-09-11T23:20:59.476804+0000","last_peered":"2024-09-11T23:20:59.476804+0000","last_clean":"2024-09-11T23:20:59.476804+0000","last_became_active":"2024-09-11T23:20:59.469672+0000","last_became_peered":"2024-09-11T23:20:59.469672+0000","last_unstale":"2024-09-11T23:20:59.476804+0000","last_undegraded":"2024-09-11T23:20:59.476804+0000","last_fullsized":"2024-09-11T23:20:59.476804+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:34.060404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.465616+0000","last_change":"2024-09-11T23:20:58.461093+0000","last_active":"2024-09-11T23:20:58.465616+0000","last_peered":"2024-09-11T23:20:58.465616+0000","last_clean":"2024-09-11T23:20:58.465616+0000","last_became_active":"2024-09-11T23:20:58.460732+0000","last_became_peered":"2024-09-11T23:20:58.460732+0000","last_unstale":"2024-09-11T23:20:58.465616+0000","last_undegraded":"2024-09-11T23:20:58.465616+0000","last_fullsized":"2024-09-11T23:20:58.465616+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:13:21.428952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.474167+0000","last_change":"2024-09-11T23:20:59.467473+0000","last_active":"2024-09-11T23:20:59.474167+0000","last_peered":"2024-09-11T23:20:59.474167+0000","last_clean":"2024-09-11T23:20:59.474167+0000","last_became_active":"2024-09-11T23:20:59.467131+0000","last_became_peered":"2024-09-11T23:20:59.467131+0000","last_unstale":"2024-09-11T23:20:59.474167+0000","last_undegraded":"2024-09-11T23:20:59.474167+0000","last_fullsized":"2024-09-11T23:20:59.474167+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:25.247737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.467582+0000","last_change":"2024-09-11T23:20:58.464274+0000","last_active":"2024-09-11T23:20:58.467582+0000","last_peered":"2024-09-11T23:20:58.467582+0000","last_clean":"2024-09-11T23:20:58.467582+0000","last_became_active":"2024-09-11T23:20:58.462488+0000","last_became_peered":"2024-09-11T23:20:58.462488+0000","last_unstale":"2024-09-11T23:20:58.467582+0000","last_undegraded":"2024-09-11T23:20:58.467582+0000","last_fullsized":"2024-09-11T23:20:58.467582+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:21.671976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.449333+0000","last_change":"2024-09-11T23:20:58.449333+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.449333+0000","last_undegraded":"2024-09-11T23:20:58.449333+0000","last_fullsized":"2024-09-11T23:20:58.449333+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.449844+0000","last_change":"2024-09-11T23:20:58.461597+0000","last_active":"2024-09-11T23:20:59.449844+0000","last_peered":"2024-09-11T23:20:59.449844+0000","last_clean":"2024-09-11T23:20:59.449844+0000","last_became_active":"2024-09-11T23:20:58.460572+0000","last_became_peered":"2024-09-11T23:20:58.460572+0000","last_unstale":"2024-09-11T23:20:59.449844+0000","last_undegraded":"2024-09-11T23:20:59.449844+0000","last_fullsized":"2024-09-11T23:20:59.449844+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:41.170235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.448119+0000","last_change":"2024-09-11T23:20:58.448119+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.448119+0000","last_undegraded":"2024-09-11T23:20:58.448119+0000","last_fullsized":"2024-09-11T23:20:58.448119+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.459519+0000","last_change":"2024-09-11T23:20:58.460325+0000","last_active":"2024-09-11T23:20:59.459519+0000","last_peered":"2024-09-11T23:20:59.459519+0000","last_clean":"2024-09-11T23:20:59.459519+0000","last_became_active":"2024-09-11T23:20:58.459535+0000","last_became_peered":"2024-09-11T23:20:58.459535+0000","last_unstale":"2024-09-11T23:20:59.459519+0000","last_undegraded":"2024-09-11T23:20:59.459519+0000","last_fullsized":"2024-09-11T23:20:59.459519+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:15.242284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871771+0000","last_change":"2024-09-11T23:20:59.467890+0000","last_active":"2024-09-11T23:21:00.871771+0000","last_peered":"2024-09-11T23:21:00.871771+0000","last_clean":"2024-09-11T23:21:00.871771+0000","last_became_active":"2024-09-11T23:20:59.467620+0000","last_became_peered":"2024-09-11T23:20:59.467620+0000","last_unstale":"2024-09-11T23:21:00.871771+0000","last_undegraded":"2024-09-11T23:21:00.871771+0000","last_fullsized":"2024-09-11T23:21:00.871771+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:28.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.465553+0000","last_change":"2024-09-11T23:20:58.461187+0000","last_active":"2024-09-11T23:20:58.465553+0000","last_peered":"2024-09-11T23:20:58.465553+0000","last_clean":"2024-09-11T23:20:58.465553+0000","last_became_active":"2024-09-11T23:20:58.460890+0000","last_became_peered":"2024-09-11T23:20:58.460890+0000","last_unstale":"2024-09-11T23:20:58.465553+0000","last_undegraded":"2024-09-11T23:20:58.465553+0000","last_fullsized":"2024-09-11T23:20:58.465553+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:05.761153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.479500+0000","last_change":"2024-09-11T23:20:59.475905+0000","last_active":"2024-09-11T23:20:59.479500+0000","last_peered":"2024-09-11T23:20:59.479500+0000","last_clean":"2024-09-11T23:20:59.479500+0000","last_became_active":"2024-09-11T23:20:59.475545+0000","last_became_peered":"2024-09-11T23:20:59.475545+0000","last_unstale":"2024-09-11T23:20:59.479500+0000","last_undegraded":"2024-09-11T23:20:59.479500+0000","last_fullsized":"2024-09-11T23:20:59.479500+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:39.771178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.450416+0000","last_change":"2024-09-11T23:20:58.458608+0000","last_active":"2024-09-11T23:20:59.450416+0000","last_peered":"2024-09-11T23:20:59.450416+0000","last_clean":"2024-09-11T23:20:59.450416+0000","last_became_active":"2024-09-11T23:20:58.458251+0000","last_became_peered":"2024-09-11T23:20:58.458251+0000","last_unstale":"2024-09-11T23:20:59.450416+0000","last_undegraded":"2024-09-11T23:20:59.450416+0000","last_fullsized":"2024-09-11T23:20:59.450416+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:04:14.569214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.450970+0000","last_change":"2024-09-11T23:20:58.450970+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.450970+0000","last_undegraded":"2024-09-11T23:20:58.450970+0000","last_fullsized":"2024-09-11T23:20:58.450970+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.467229+0000","last_change":"2024-09-11T23:20:58.463594+0000","last_active":"2024-09-11T23:20:58.467229+0000","last_peered":"2024-09-11T23:20:58.467229+0000","last_clean":"2024-09-11T23:20:58.467229+0000","last_became_active":"2024-09-11T23:20:58.463332+0000","last_became_peered":"2024-09-11T23:20:58.463332+0000","last_unstale":"2024-09-11T23:20:58.467229+0000","last_undegraded":"2024-09-11T23:20:58.467229+0000","last_fullsized":"2024-09-11T23:20:58.467229+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:47.949664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871544+0000","last_change":"2024-09-11T23:20:59.460002+0000","last_active":"2024-09-11T23:21:00.871544+0000","last_peered":"2024-09-11T23:21:00.871544+0000","last_clean":"2024-09-11T23:21:00.871544+0000","last_became_active":"2024-09-11T23:20:59.459757+0000","last_became_peered":"2024-09-11T23:20:59.459757+0000","last_unstale":"2024-09-11T23:21:00.871544+0000","last_undegraded":"2024-09-11T23:21:00.871544+0000","last_fullsized":"2024-09-11T23:21:00.871544+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:39.798888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871522+0000","last_change":"2024-09-11T23:20:58.467356+0000","last_active":"2024-09-11T23:21:00.871522+0000","last_peered":"2024-09-11T23:21:00.871522+0000","last_clean":"2024-09-11T23:21:00.871522+0000","last_became_active":"2024-09-11T23:20:58.465829+0000","last_became_peered":"2024-09-11T23:20:58.465829+0000","last_unstale":"2024-09-11T23:21:00.871522+0000","last_undegraded":"2024-09-11T23:21:00.871522+0000","last_fullsized":"2024-09-11T23:21:00.871522+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:06.639194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871420+0000","last_change":"2024-09-11T23:20:59.474473+0000","last_active":"2024-09-11T23:21:00.871420+0000","last_peered":"2024-09-11T23:21:00.871420+0000","last_clean":"2024-09-11T23:21:00.871420+0000","last_became_active":"2024-09-11T23:20:59.474176+0000","last_became_peered":"2024-09-11T23:20:59.474176+0000","last_unstale":"2024-09-11T23:21:00.871420+0000","last_undegraded":"2024-09-11T23:21:00.871420+0000","last_fullsized":"2024-09-11T23:21:00.871420+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:03.448755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.450156+0000","last_change":"2024-09-11T23:20:58.465838+0000","last_active":"2024-09-11T23:20:59.450156+0000","last_peered":"2024-09-11T23:20:59.450156+0000","last_clean":"2024-09-11T23:20:59.450156+0000","last_became_active":"2024-09-11T23:20:58.464372+0000","last_became_peered":"2024-09-11T23:20:58.464372+0000","last_unstale":"2024-09-11T23:20:59.450156+0000","last_undegraded":"2024-09-11T23:20:59.450156+0000","last_fullsized":"2024-09-11T23:20:59.450156+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:47.949664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":236,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.457932+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:20:59.457932+0000","last_peered":"2024-09-11T23:20:59.457932+0000","last_clean":"2024-09-11T23:20:59.457932+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:20:59.457932+0000","last_undegraded":"2024-09-11T23:20:59.457932+0000","last_fullsized":"2024-09-11T23:20:59.457932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476779,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28288,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343552,"statfs":{"total":96636764160,"available":96607797248,"internally_reserved":0,"allocated":1286144,"data_stored":873616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":671744,"data_stored":276313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476777,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":692224,"data_stored":283740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476777,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":696320,"data_stored":284700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31832,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":659456,"data_stored":270046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1265664,"data_stored":866681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":704512,"data_stored":289444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":704512,"data_stored":289444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:21:03.647 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:21:03.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.833+0000 7eff77200640 1 Processor -- start 2024-09-11T23:21:03.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.834+0000 7eff77200640 1 -- start start 2024-09-11T23:21:03.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.835+0000 7eff77200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7eff7015c180 0x7eff700cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:03.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.835+0000 7eff77200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff700ce740 con 0x7eff70073120 2024-09-11T23:21:03.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.835+0000 7eff77200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff70072640 con 0x7eff700ce230 2024-09-11T23:21:03.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.835+0000 7eff77200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7eff70072920 con 0x7eff7015c180 2024-09-11T23:21:03.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.835+0000 7eff6fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7eff7015c180 0x7eff700cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:03.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.835+0000 7eff6fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7eff7015c180 0x7eff700cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53526/0 (socket says 172.21.15.144:53526) 2024-09-11T23:21:03.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.835+0000 7eff6fe00640 1 -- 172.21.15.144:0/805652193 learned_addr learned my addr 172.21.15.144:0/805652193 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:03.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.835+0000 7eff75200640 1 --1- 172.21.15.144:0/805652193 >> v1:172.21.15.144:6789/0 conn(0x7eff70073120 0x7eff7006bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34778/0 (socket says 172.21.15.144:34778) 2024-09-11T23:21:03.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.835+0000 7eff6fe00640 1 -- 172.21.15.144:0/805652193 >> v1:172.21.15.165:6789/0 conn(0x7eff700ce230 legacy=0x7eff700cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:03.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.835+0000 7eff6fe00640 1 -- 172.21.15.144:0/805652193 >> v1:172.21.15.144:6789/0 conn(0x7eff70073120 legacy=0x7eff7006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:03.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.836+0000 7eff6fe00640 1 -- 172.21.15.144:0/805652193 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff70072c00 con 0x7eff7015c180 2024-09-11T23:21:03.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.836+0000 7eff6f400640 1 -- 172.21.15.144:0/805652193 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 777390321 0 0) 0x7eff700ce740 con 0x7eff70073120 2024-09-11T23:21:03.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.836+0000 7eff6fe00640 1 --2- 172.21.15.144:0/805652193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff7015c180 0x7eff700cdcf0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7eff60009870 tx=0x7eff6002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c791e6cd5b1fc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:03.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.837+0000 7eff6f400640 1 -- 172.21.15.144:0/805652193 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff60037070 con 0x7eff7015c180 2024-09-11T23:21:03.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.837+0000 7eff6f400640 1 -- 172.21.15.144:0/805652193 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff60032440 con 0x7eff7015c180 2024-09-11T23:21:03.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.837+0000 7eff6f400640 1 -- 172.21.15.144:0/805652193 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff60032810 con 0x7eff7015c180 2024-09-11T23:21:03.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.837+0000 7eff77200640 1 -- 172.21.15.144:0/805652193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff7015c180 msgr2=0x7eff700cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:03.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.837+0000 7eff77200640 1 --2- 172.21.15.144:0/805652193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff7015c180 0x7eff700cdcf0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7eff60009870 tx=0x7eff6002a270 comp rx=0 tx=0).stop 2024-09-11T23:21:03.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.837+0000 7eff77200640 1 -- 172.21.15.144:0/805652193 shutdown_connections 2024-09-11T23:21:03.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.837+0000 7eff77200640 1 --2- 172.21.15.144:0/805652193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff7015c180 0x7eff700cdcf0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.837+0000 7eff77200640 1 -- 172.21.15.144:0/805652193 >> 172.21.15.144:0/805652193 conn(0x7eff70062cc0 msgr2=0x7eff7006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:03.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.837+0000 7eff77200640 1 -- 172.21.15.144:0/805652193 shutdown_connections 2024-09-11T23:21:03.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.838+0000 7eff77200640 1 -- 172.21.15.144:0/805652193 wait complete. 2024-09-11T23:21:03.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.839+0000 7eff77200640 1 Processor -- start 2024-09-11T23:21:03.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.839+0000 7eff77200640 1 -- start start 2024-09-11T23:21:03.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.840+0000 7eff77200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff70073120 0x7eff700cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:03.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.840+0000 7eff77200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff700ce230 0x7eff700ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:03.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.840+0000 7eff77200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff7015c180 0x7eff7014fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:03.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.840+0000 7eff77200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff700cf780 con 0x7eff7015c180 2024-09-11T23:21:03.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.840+0000 7eff77200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7eff700722f0 con 0x7eff70073120 2024-09-11T23:21:03.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.840+0000 7eff77200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7eff7015c560 con 0x7eff700ce230 2024-09-11T23:21:03.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.840+0000 7eff75200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff7015c180 0x7eff7014fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:03.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.841+0000 7eff6fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff70073120 0x7eff700cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:03.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.841+0000 7eff75200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff7015c180 0x7eff7014fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53536/0 (socket says 172.21.15.144:53536) 2024-09-11T23:21:03.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.841+0000 7eff75200640 1 -- 172.21.15.144:0/1244816480 learned_addr learned my addr 172.21.15.144:0/1244816480 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:03.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.841+0000 7eff67400640 1 --2- 172.21.15.144:0/1244816480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff700ce230 0x7eff700ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:03.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.841+0000 7eff75200640 1 -- 172.21.15.144:0/1244816480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff700ce230 msgr2=0x7eff700ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:03.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.841+0000 7eff75200640 1 --2- 172.21.15.144:0/1244816480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff700ce230 0x7eff700ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.841+0000 7eff75200640 1 -- 172.21.15.144:0/1244816480 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff70073120 msgr2=0x7eff700cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:03.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.841+0000 7eff75200640 1 --2- 172.21.15.144:0/1244816480 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff70073120 0x7eff700cbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:03.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.841+0000 7eff75200640 1 -- 172.21.15.144:0/1244816480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7015b590 con 0x7eff7015c180 2024-09-11T23:21:03.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.841+0000 7eff67400640 1 --2- 172.21.15.144:0/1244816480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff700ce230 0x7eff700ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:03.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.841+0000 7eff75200640 1 --2- 172.21.15.144:0/1244816480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff7015c180 0x7eff7014fce0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7eff6800c7a0 tx=0x7eff6800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:03.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.841+0000 7eff6cc00640 1 -- 172.21.15.144:0/1244816480 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff68018070 con 0x7eff7015c180 2024-09-11T23:21:03.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.841+0000 7eff6cc00640 1 -- 172.21.15.144:0/1244816480 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff6800a640 con 0x7eff7015c180 2024-09-11T23:21:03.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.841+0000 7eff6cc00640 1 -- 172.21.15.144:0/1244816480 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6800aab0 con 0x7eff7015c180 2024-09-11T23:21:03.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.841+0000 7eff77200640 1 -- 172.21.15.144:0/1244816480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff700cc1c0 con 0x7eff7015c180 2024-09-11T23:21:03.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.842+0000 7eff77200640 1 -- 172.21.15.144:0/1244816480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff700aef40 con 0x7eff7015c180 2024-09-11T23:21:03.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.843+0000 7eff77200640 1 -- 172.21.15.144:0/1244816480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff700cdcf0 con 0x7eff7015c180 2024-09-11T23:21:03.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.844+0000 7eff6cc00640 1 -- 172.21.15.144:0/1244816480 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7eff6800ac50 con 0x7eff7015c180 2024-09-11T23:21:03.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.845+0000 7eff6cc00640 1 --2- 172.21.15.144:0/1244816480 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7eff4c06bfe0 0x7eff4c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:03.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.845+0000 7eff6cc00640 1 -- 172.21.15.144:0/1244816480 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7eff6808a6d0 con 0x7eff7015c180 2024-09-11T23:21:03.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.845+0000 7eff6fe00640 1 --2- 172.21.15.144:0/1244816480 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7eff4c06bfe0 0x7eff4c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:03.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.846+0000 7eff6fe00640 1 --2- 172.21.15.144:0/1244816480 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7eff4c06bfe0 0x7eff4c06e4a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7eff60034000 tx=0x7eff6002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:03.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:03.850+0000 7eff6cc00640 1 -- 172.21.15.144:0/1244816480 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7eff7015b590 con 0x7eff7015c180 2024-09-11T23:21:04.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.023+0000 7eff77200640 1 -- 172.21.15.144:0/1244816480 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff7015f130 con 0x7eff4c06bfe0 2024-09-11T23:21:04.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.029+0000 7eff6cc00640 1 -- 172.21.15.144:0/1244816480 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250592 (secure 0 0 0) 0x7eff7015f130 con 0x7eff4c06bfe0 2024-09-11T23:21:04.033 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:04.034 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:21:04.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.033+0000 7eff77200640 1 -- 172.21.15.144:0/1244816480 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7eff4c06bfe0 msgr2=0x7eff4c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:04.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.033+0000 7eff77200640 1 --2- 172.21.15.144:0/1244816480 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7eff4c06bfe0 0x7eff4c06e4a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7eff60034000 tx=0x7eff6002e000 comp rx=0 tx=0).stop 2024-09-11T23:21:04.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.033+0000 7eff77200640 1 -- 172.21.15.144:0/1244816480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff7015c180 msgr2=0x7eff7014fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:04.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.033+0000 7eff77200640 1 --2- 172.21.15.144:0/1244816480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff7015c180 0x7eff7014fce0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7eff6800c7a0 tx=0x7eff6800cc60 comp rx=0 tx=0).stop 2024-09-11T23:21:04.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.034+0000 7eff77200640 1 -- 172.21.15.144:0/1244816480 shutdown_connections 2024-09-11T23:21:04.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.034+0000 7eff77200640 1 --2- 172.21.15.144:0/1244816480 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7eff4c06bfe0 0x7eff4c06e4a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.034+0000 7eff77200640 1 --2- 172.21.15.144:0/1244816480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff7015c180 0x7eff7014fce0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.034+0000 7eff77200640 1 --2- 172.21.15.144:0/1244816480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff700ce230 0x7eff700ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.034+0000 7eff77200640 1 --2- 172.21.15.144:0/1244816480 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff70073120 0x7eff700cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.034+0000 7eff77200640 1 -- 172.21.15.144:0/1244816480 >> 172.21.15.144:0/1244816480 conn(0x7eff70062cc0 msgr2=0x7eff700d0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:04.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.034+0000 7eff77200640 1 -- 172.21.15.144:0/1244816480 shutdown_connections 2024-09-11T23:21:04.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.034+0000 7eff77200640 1 -- 172.21.15.144:0/1244816480 wait complete. 2024-09-11T23:21:04.050 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-11T23:21:03.204993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":190,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231096,"kb_used_data":6524,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743624,"statfs":{"total":773094113280,"available":772857470976,"internally_reserved":0,"allocated":6680576,"data_stored":3433984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.768930"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456550+0000","last_change":"2024-09-11T23:20:59.472164+0000","last_active":"2024-09-11T23:21:00.456550+0000","last_peered":"2024-09-11T23:21:00.456550+0000","last_clean":"2024-09-11T23:21:00.456550+0000","last_became_active":"2024-09-11T23:20:59.471476+0000","last_became_peered":"2024-09-11T23:20:59.471476+0000","last_unstale":"2024-09-11T23:21:00.456550+0000","last_undegraded":"2024-09-11T23:21:00.456550+0000","last_fullsized":"2024-09-11T23:21:00.456550+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:26.417418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871704+0000","last_change":"2024-09-11T23:20:59.467559+0000","last_active":"2024-09-11T23:21:00.871704+0000","last_peered":"2024-09-11T23:21:00.871704+0000","last_clean":"2024-09-11T23:21:00.871704+0000","last_became_active":"2024-09-11T23:20:59.467289+0000","last_became_peered":"2024-09-11T23:20:59.467289+0000","last_unstale":"2024-09-11T23:21:00.871704+0000","last_undegraded":"2024-09-11T23:21:00.871704+0000","last_fullsized":"2024-09-11T23:21:00.871704+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:31.251559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.475161+0000","last_change":"2024-09-11T23:20:59.469746+0000","last_active":"2024-09-11T23:20:59.475161+0000","last_peered":"2024-09-11T23:20:59.475161+0000","last_clean":"2024-09-11T23:20:59.475161+0000","last_became_active":"2024-09-11T23:20:59.469438+0000","last_became_peered":"2024-09-11T23:20:59.469438+0000","last_unstale":"2024-09-11T23:20:59.475161+0000","last_undegraded":"2024-09-11T23:20:59.475161+0000","last_fullsized":"2024-09-11T23:20:59.475161+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:49.249112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.472552+0000","last_change":"2024-09-11T23:20:59.468119+0000","last_active":"2024-09-11T23:20:59.472552+0000","last_peered":"2024-09-11T23:20:59.472552+0000","last_clean":"2024-09-11T23:20:59.472552+0000","last_became_active":"2024-09-11T23:20:59.467847+0000","last_became_peered":"2024-09-11T23:20:59.467847+0000","last_unstale":"2024-09-11T23:20:59.472552+0000","last_undegraded":"2024-09-11T23:20:59.472552+0000","last_fullsized":"2024-09-11T23:20:59.472552+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:50.317785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456756+0000","last_change":"2024-09-11T23:20:59.462985+0000","last_active":"2024-09-11T23:21:00.456756+0000","last_peered":"2024-09-11T23:21:00.456756+0000","last_clean":"2024-09-11T23:21:00.456756+0000","last_became_active":"2024-09-11T23:20:59.462699+0000","last_became_peered":"2024-09-11T23:20:59.462699+0000","last_unstale":"2024-09-11T23:21:00.456756+0000","last_undegraded":"2024-09-11T23:21:00.456756+0000","last_fullsized":"2024-09-11T23:21:00.456756+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:58.821334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.449691+0000","last_change":"2024-09-11T23:20:58.449691+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.449691+0000","last_undegraded":"2024-09-11T23:20:58.449691+0000","last_fullsized":"2024-09-11T23:20:58.449691+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.470273+0000","last_change":"2024-09-11T23:20:59.464854+0000","last_active":"2024-09-11T23:20:59.470273+0000","last_peered":"2024-09-11T23:20:59.470273+0000","last_clean":"2024-09-11T23:20:59.470273+0000","last_became_active":"2024-09-11T23:20:59.464585+0000","last_became_peered":"2024-09-11T23:20:59.464585+0000","last_unstale":"2024-09-11T23:20:59.470273+0000","last_undegraded":"2024-09-11T23:20:59.470273+0000","last_fullsized":"2024-09-11T23:20:59.470273+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:39.929849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871393+0000","last_change":"2024-09-11T23:20:59.461801+0000","last_active":"2024-09-11T23:21:00.871393+0000","last_peered":"2024-09-11T23:21:00.871393+0000","last_clean":"2024-09-11T23:21:00.871393+0000","last_became_active":"2024-09-11T23:20:59.461531+0000","last_became_peered":"2024-09-11T23:20:59.461531+0000","last_unstale":"2024-09-11T23:21:00.871393+0000","last_undegraded":"2024-09-11T23:21:00.871393+0000","last_fullsized":"2024-09-11T23:21:00.871393+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:44.244935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.488243+0000","last_change":"2024-09-11T23:20:59.483367+0000","last_active":"2024-09-11T23:20:59.488243+0000","last_peered":"2024-09-11T23:20:59.488243+0000","last_clean":"2024-09-11T23:20:59.488243+0000","last_became_active":"2024-09-11T23:20:59.483009+0000","last_became_peered":"2024-09-11T23:20:59.483009+0000","last_unstale":"2024-09-11T23:20:59.488243+0000","last_undegraded":"2024-09-11T23:20:59.488243+0000","last_fullsized":"2024-09-11T23:20:59.488243+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:22.679717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.450117+0000","last_change":"2024-09-11T23:20:58.450117+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.450117+0000","last_undegraded":"2024-09-11T23:20:58.450117+0000","last_fullsized":"2024-09-11T23:20:58.450117+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.450382+0000","last_change":"2024-09-11T23:20:58.450382+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.450382+0000","last_undegraded":"2024-09-11T23:20:58.450382+0000","last_fullsized":"2024-09-11T23:20:58.450382+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.472531+0000","last_change":"2024-09-11T23:20:59.467528+0000","last_active":"2024-09-11T23:20:59.472531+0000","last_peered":"2024-09-11T23:20:59.472531+0000","last_clean":"2024-09-11T23:20:59.472531+0000","last_became_active":"2024-09-11T23:20:59.467148+0000","last_became_peered":"2024-09-11T23:20:59.467148+0000","last_unstale":"2024-09-11T23:20:59.472531+0000","last_undegraded":"2024-09-11T23:20:59.472531+0000","last_fullsized":"2024-09-11T23:20:59.472531+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:31.276490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.475119+0000","last_change":"2024-09-11T23:20:59.471352+0000","last_active":"2024-09-11T23:20:59.475119+0000","last_peered":"2024-09-11T23:20:59.475119+0000","last_clean":"2024-09-11T23:20:59.475119+0000","last_became_active":"2024-09-11T23:20:59.470968+0000","last_became_peered":"2024-09-11T23:20:59.470968+0000","last_unstale":"2024-09-11T23:20:59.475119+0000","last_undegraded":"2024-09-11T23:20:59.475119+0000","last_fullsized":"2024-09-11T23:20:59.475119+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:45.696532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.462287+0000","last_change":"2024-09-11T23:20:59.458141+0000","last_active":"2024-09-11T23:20:59.462287+0000","last_peered":"2024-09-11T23:20:59.462287+0000","last_clean":"2024-09-11T23:20:59.462287+0000","last_became_active":"2024-09-11T23:20:59.457853+0000","last_became_peered":"2024-09-11T23:20:59.457853+0000","last_unstale":"2024-09-11T23:20:59.462287+0000","last_undegraded":"2024-09-11T23:20:59.462287+0000","last_fullsized":"2024-09-11T23:20:59.462287+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:28.453235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.464989+0000","last_change":"2024-09-11T23:20:59.457958+0000","last_active":"2024-09-11T23:20:59.464989+0000","last_peered":"2024-09-11T23:20:59.464989+0000","last_clean":"2024-09-11T23:20:59.464989+0000","last_became_active":"2024-09-11T23:20:59.457672+0000","last_became_peered":"2024-09-11T23:20:59.457672+0000","last_unstale":"2024-09-11T23:20:59.464989+0000","last_undegraded":"2024-09-11T23:20:59.464989+0000","last_fullsized":"2024-09-11T23:20:59.464989+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:35.174888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.449499+0000","last_change":"2024-09-11T23:20:58.449499+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.449499+0000","last_undegraded":"2024-09-11T23:20:58.449499+0000","last_fullsized":"2024-09-11T23:20:58.449499+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871858+0000","last_change":"2024-09-11T23:20:59.465949+0000","last_active":"2024-09-11T23:21:00.871858+0000","last_peered":"2024-09-11T23:21:00.871858+0000","last_clean":"2024-09-11T23:21:00.871858+0000","last_became_active":"2024-09-11T23:20:59.465251+0000","last_became_peered":"2024-09-11T23:20:59.465251+0000","last_unstale":"2024-09-11T23:21:00.871858+0000","last_undegraded":"2024-09-11T23:21:00.871858+0000","last_fullsized":"2024-09-11T23:21:00.871858+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:40.463156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.473417+0000","last_change":"2024-09-11T23:20:59.469311+0000","last_active":"2024-09-11T23:20:59.473417+0000","last_peered":"2024-09-11T23:20:59.473417+0000","last_clean":"2024-09-11T23:20:59.473417+0000","last_became_active":"2024-09-11T23:20:59.468802+0000","last_became_peered":"2024-09-11T23:20:59.468802+0000","last_unstale":"2024-09-11T23:20:59.473417+0000","last_undegraded":"2024-09-11T23:20:59.473417+0000","last_fullsized":"2024-09-11T23:20:59.473417+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:50.317785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456586+0000","last_change":"2024-09-11T23:20:59.468862+0000","last_active":"2024-09-11T23:21:00.456586+0000","last_peered":"2024-09-11T23:21:00.456586+0000","last_clean":"2024-09-11T23:21:00.456586+0000","last_became_active":"2024-09-11T23:20:59.468588+0000","last_became_peered":"2024-09-11T23:20:59.468588+0000","last_unstale":"2024-09-11T23:21:00.456586+0000","last_undegraded":"2024-09-11T23:21:00.456586+0000","last_fullsized":"2024-09-11T23:21:00.456586+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:09.356677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871622+0000","last_change":"2024-09-11T23:20:59.468990+0000","last_active":"2024-09-11T23:21:00.871622+0000","last_peered":"2024-09-11T23:21:00.871622+0000","last_clean":"2024-09-11T23:21:00.871622+0000","last_became_active":"2024-09-11T23:20:59.468736+0000","last_became_peered":"2024-09-11T23:20:59.468736+0000","last_unstale":"2024-09-11T23:21:00.871622+0000","last_undegraded":"2024-09-11T23:21:00.871622+0000","last_fullsized":"2024-09-11T23:21:00.871622+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:08.951140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.480672+0000","last_change":"2024-09-11T23:20:59.477858+0000","last_active":"2024-09-11T23:20:59.480672+0000","last_peered":"2024-09-11T23:20:59.480672+0000","last_clean":"2024-09-11T23:20:59.480672+0000","last_became_active":"2024-09-11T23:20:59.477437+0000","last_became_peered":"2024-09-11T23:20:59.477437+0000","last_unstale":"2024-09-11T23:20:59.480672+0000","last_undegraded":"2024-09-11T23:20:59.480672+0000","last_fullsized":"2024-09-11T23:20:59.480672+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:27.032373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871537+0000","last_change":"2024-09-11T23:20:59.461667+0000","last_active":"2024-09-11T23:21:00.871537+0000","last_peered":"2024-09-11T23:21:00.871537+0000","last_clean":"2024-09-11T23:21:00.871537+0000","last_became_active":"2024-09-11T23:20:59.461421+0000","last_became_peered":"2024-09-11T23:20:59.461421+0000","last_unstale":"2024-09-11T23:21:00.871537+0000","last_undegraded":"2024-09-11T23:21:00.871537+0000","last_fullsized":"2024-09-11T23:21:00.871537+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:45.567676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.479809+0000","last_change":"2024-09-11T23:20:59.476578+0000","last_active":"2024-09-11T23:20:59.479809+0000","last_peered":"2024-09-11T23:20:59.479809+0000","last_clean":"2024-09-11T23:20:59.479809+0000","last_became_active":"2024-09-11T23:20:59.476300+0000","last_became_peered":"2024-09-11T23:20:59.476300+0000","last_unstale":"2024-09-11T23:20:59.479809+0000","last_undegraded":"2024-09-11T23:20:59.479809+0000","last_fullsized":"2024-09-11T23:20:59.479809+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:12.645604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.475062+0000","last_change":"2024-09-11T23:20:59.472368+0000","last_active":"2024-09-11T23:20:59.475062+0000","last_peered":"2024-09-11T23:20:59.475062+0000","last_clean":"2024-09-11T23:20:59.475062+0000","last_became_active":"2024-09-11T23:20:59.472087+0000","last_became_peered":"2024-09-11T23:20:59.472087+0000","last_unstale":"2024-09-11T23:20:59.475062+0000","last_undegraded":"2024-09-11T23:20:59.475062+0000","last_fullsized":"2024-09-11T23:20:59.475062+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:25.693967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456689+0000","last_change":"2024-09-11T23:20:59.472381+0000","last_active":"2024-09-11T23:21:00.456689+0000","last_peered":"2024-09-11T23:21:00.456689+0000","last_clean":"2024-09-11T23:21:00.456689+0000","last_became_active":"2024-09-11T23:20:59.471907+0000","last_became_peered":"2024-09-11T23:20:59.471907+0000","last_unstale":"2024-09-11T23:21:00.456689+0000","last_undegraded":"2024-09-11T23:21:00.456689+0000","last_fullsized":"2024-09-11T23:21:00.456689+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:03.162864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.478427+0000","last_change":"2024-09-11T23:20:59.472931+0000","last_active":"2024-09-11T23:20:59.478427+0000","last_peered":"2024-09-11T23:20:59.478427+0000","last_clean":"2024-09-11T23:20:59.478427+0000","last_became_active":"2024-09-11T23:20:59.472664+0000","last_became_peered":"2024-09-11T23:20:59.472664+0000","last_unstale":"2024-09-11T23:20:59.478427+0000","last_undegraded":"2024-09-11T23:20:59.478427+0000","last_fullsized":"2024-09-11T23:20:59.478427+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:39.771178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.451550+0000","last_change":"2024-09-11T23:20:58.451550+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.451550+0000","last_undegraded":"2024-09-11T23:20:58.451550+0000","last_fullsized":"2024-09-11T23:20:58.451550+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456643+0000","last_change":"2024-09-11T23:20:59.469067+0000","last_active":"2024-09-11T23:21:00.456643+0000","last_peered":"2024-09-11T23:21:00.456643+0000","last_clean":"2024-09-11T23:21:00.456643+0000","last_became_active":"2024-09-11T23:20:59.468802+0000","last_became_peered":"2024-09-11T23:20:59.468802+0000","last_unstale":"2024-09-11T23:21:00.456643+0000","last_undegraded":"2024-09-11T23:21:00.456643+0000","last_fullsized":"2024-09-11T23:21:00.456643+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:34.477242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871779+0000","last_change":"2024-09-11T23:20:59.466832+0000","last_active":"2024-09-11T23:21:00.871779+0000","last_peered":"2024-09-11T23:21:00.871779+0000","last_clean":"2024-09-11T23:21:00.871779+0000","last_became_active":"2024-09-11T23:20:59.466560+0000","last_became_peered":"2024-09-11T23:20:59.466560+0000","last_unstale":"2024-09-11T23:21:00.871779+0000","last_undegraded":"2024-09-11T23:21:00.871779+0000","last_fullsized":"2024-09-11T23:21:00.871779+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:42.410011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.475209+0000","last_change":"2024-09-11T23:20:59.470126+0000","last_active":"2024-09-11T23:20:59.475209+0000","last_peered":"2024-09-11T23:20:59.475209+0000","last_clean":"2024-09-11T23:20:59.475209+0000","last_became_active":"2024-09-11T23:20:59.469730+0000","last_became_peered":"2024-09-11T23:20:59.469730+0000","last_unstale":"2024-09-11T23:20:59.475209+0000","last_undegraded":"2024-09-11T23:20:59.475209+0000","last_fullsized":"2024-09-11T23:20:59.475209+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:39.610047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456362+0000","last_change":"2024-09-11T23:20:59.474680+0000","last_active":"2024-09-11T23:21:00.456362+0000","last_peered":"2024-09-11T23:21:00.456362+0000","last_clean":"2024-09-11T23:21:00.456362+0000","last_became_active":"2024-09-11T23:20:59.472530+0000","last_became_peered":"2024-09-11T23:20:59.472530+0000","last_unstale":"2024-09-11T23:21:00.456362+0000","last_undegraded":"2024-09-11T23:21:00.456362+0000","last_fullsized":"2024-09-11T23:21:00.456362+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:37.774651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.449099+0000","last_change":"2024-09-11T23:20:58.449099+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.449099+0000","last_undegraded":"2024-09-11T23:20:58.449099+0000","last_fullsized":"2024-09-11T23:20:58.449099+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.449131+0000","last_change":"2024-09-11T23:20:58.449131+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.449131+0000","last_undegraded":"2024-09-11T23:20:58.449131+0000","last_fullsized":"2024-09-11T23:20:58.449131+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.467758+0000","last_change":"2024-09-11T23:20:58.461846+0000","last_active":"2024-09-11T23:20:58.467758+0000","last_peered":"2024-09-11T23:20:58.467758+0000","last_clean":"2024-09-11T23:20:58.467758+0000","last_became_active":"2024-09-11T23:20:58.461591+0000","last_became_peered":"2024-09-11T23:20:58.461591+0000","last_unstale":"2024-09-11T23:20:58.467758+0000","last_undegraded":"2024-09-11T23:20:58.467758+0000","last_fullsized":"2024-09-11T23:20:58.467758+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:30.133913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.451217+0000","last_change":"2024-09-11T23:20:58.451217+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.451217+0000","last_undegraded":"2024-09-11T23:20:58.451217+0000","last_fullsized":"2024-09-11T23:20:58.451217+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871666+0000","last_change":"2024-09-11T23:20:58.465371+0000","last_active":"2024-09-11T23:21:00.871666+0000","last_peered":"2024-09-11T23:21:00.871666+0000","last_clean":"2024-09-11T23:21:00.871666+0000","last_became_active":"2024-09-11T23:20:58.465117+0000","last_became_peered":"2024-09-11T23:20:58.465117+0000","last_unstale":"2024-09-11T23:21:00.871666+0000","last_undegraded":"2024-09-11T23:21:00.871666+0000","last_fullsized":"2024-09-11T23:21:00.871666+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:38.868184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.450075+0000","last_change":"2024-09-11T23:20:58.450075+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.450075+0000","last_undegraded":"2024-09-11T23:20:58.450075+0000","last_fullsized":"2024-09-11T23:20:58.450075+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.465326+0000","last_change":"2024-09-11T23:20:58.460984+0000","last_active":"2024-09-11T23:20:58.465326+0000","last_peered":"2024-09-11T23:20:58.465326+0000","last_clean":"2024-09-11T23:20:58.465326+0000","last_became_active":"2024-09-11T23:20:58.460659+0000","last_became_peered":"2024-09-11T23:20:58.460659+0000","last_unstale":"2024-09-11T23:20:58.465326+0000","last_undegraded":"2024-09-11T23:20:58.465326+0000","last_fullsized":"2024-09-11T23:20:58.465326+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:38.922109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.450534+0000","last_change":"2024-09-11T23:20:58.450534+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.450534+0000","last_undegraded":"2024-09-11T23:20:58.450534+0000","last_fullsized":"2024-09-11T23:20:58.450534+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.480470+0000","last_change":"2024-09-11T23:20:58.462668+0000","last_active":"2024-09-11T23:20:59.480470+0000","last_peered":"2024-09-11T23:20:59.480470+0000","last_clean":"2024-09-11T23:20:59.480470+0000","last_became_active":"2024-09-11T23:20:58.462349+0000","last_became_peered":"2024-09-11T23:20:58.462349+0000","last_unstale":"2024-09-11T23:20:59.480470+0000","last_undegraded":"2024-09-11T23:20:59.480470+0000","last_fullsized":"2024-09-11T23:20:59.480470+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:16.896074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871423+0000","last_change":"2024-09-11T23:20:59.461146+0000","last_active":"2024-09-11T23:21:00.871423+0000","last_peered":"2024-09-11T23:21:00.871423+0000","last_clean":"2024-09-11T23:21:00.871423+0000","last_became_active":"2024-09-11T23:20:59.460868+0000","last_became_peered":"2024-09-11T23:20:59.460868+0000","last_unstale":"2024-09-11T23:21:00.871423+0000","last_undegraded":"2024-09-11T23:21:00.871423+0000","last_fullsized":"2024-09-11T23:21:00.871423+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:12.270988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.483394+0000","last_change":"2024-09-11T23:20:58.459200+0000","last_active":"2024-09-11T23:20:59.483394+0000","last_peered":"2024-09-11T23:20:59.483394+0000","last_clean":"2024-09-11T23:20:59.483394+0000","last_became_active":"2024-09-11T23:20:58.458940+0000","last_became_peered":"2024-09-11T23:20:58.458940+0000","last_unstale":"2024-09-11T23:20:59.483394+0000","last_undegraded":"2024-09-11T23:20:59.483394+0000","last_fullsized":"2024-09-11T23:20:59.483394+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:24.686226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871421+0000","last_change":"2024-09-11T23:20:59.471438+0000","last_active":"2024-09-11T23:21:00.871421+0000","last_peered":"2024-09-11T23:21:00.871421+0000","last_clean":"2024-09-11T23:21:00.871421+0000","last_became_active":"2024-09-11T23:20:59.471170+0000","last_became_peered":"2024-09-11T23:20:59.471170+0000","last_unstale":"2024-09-11T23:21:00.871421+0000","last_undegraded":"2024-09-11T23:21:00.871421+0000","last_fullsized":"2024-09-11T23:21:00.871421+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:52.111971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.465963+0000","last_change":"2024-09-11T23:20:58.459414+0000","last_active":"2024-09-11T23:20:58.465963+0000","last_peered":"2024-09-11T23:20:58.465963+0000","last_clean":"2024-09-11T23:20:58.465963+0000","last_became_active":"2024-09-11T23:20:58.459152+0000","last_became_peered":"2024-09-11T23:20:58.459152+0000","last_unstale":"2024-09-11T23:20:58.465963+0000","last_undegraded":"2024-09-11T23:20:58.465963+0000","last_fullsized":"2024-09-11T23:20:58.465963+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:34.167147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.470020+0000","last_change":"2024-09-11T23:20:59.464299+0000","last_active":"2024-09-11T23:20:59.470020+0000","last_peered":"2024-09-11T23:20:59.470020+0000","last_clean":"2024-09-11T23:20:59.470020+0000","last_became_active":"2024-09-11T23:20:59.463578+0000","last_became_peered":"2024-09-11T23:20:59.463578+0000","last_unstale":"2024-09-11T23:20:59.470020+0000","last_undegraded":"2024-09-11T23:20:59.470020+0000","last_fullsized":"2024-09-11T23:20:59.470020+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:37.020538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.458543+0000","last_change":"2024-09-11T23:20:58.462986+0000","last_active":"2024-09-11T23:20:59.458543+0000","last_peered":"2024-09-11T23:20:59.458543+0000","last_clean":"2024-09-11T23:20:59.458543+0000","last_became_active":"2024-09-11T23:20:58.462292+0000","last_became_peered":"2024-09-11T23:20:58.462292+0000","last_unstale":"2024-09-11T23:20:59.458543+0000","last_undegraded":"2024-09-11T23:20:59.458543+0000","last_fullsized":"2024-09-11T23:20:59.458543+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.187950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871431+0000","last_change":"2024-09-11T23:20:59.461080+0000","last_active":"2024-09-11T23:21:00.871431+0000","last_peered":"2024-09-11T23:21:00.871431+0000","last_clean":"2024-09-11T23:21:00.871431+0000","last_became_active":"2024-09-11T23:20:59.460840+0000","last_became_peered":"2024-09-11T23:20:59.460840+0000","last_unstale":"2024-09-11T23:21:00.871431+0000","last_undegraded":"2024-09-11T23:21:00.871431+0000","last_fullsized":"2024-09-11T23:21:00.871431+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:06.473547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.451422+0000","last_change":"2024-09-11T23:20:58.462888+0000","last_active":"2024-09-11T23:20:59.451422+0000","last_peered":"2024-09-11T23:20:59.451422+0000","last_clean":"2024-09-11T23:20:59.451422+0000","last_became_active":"2024-09-11T23:20:58.462609+0000","last_became_peered":"2024-09-11T23:20:58.462609+0000","last_unstale":"2024-09-11T23:20:59.451422+0000","last_undegraded":"2024-09-11T23:20:59.451422+0000","last_fullsized":"2024-09-11T23:20:59.451422+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:29.652502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.466007+0000","last_change":"2024-09-11T23:20:59.458893+0000","last_active":"2024-09-11T23:20:59.466007+0000","last_peered":"2024-09-11T23:20:59.466007+0000","last_clean":"2024-09-11T23:20:59.466007+0000","last_became_active":"2024-09-11T23:20:59.458626+0000","last_became_peered":"2024-09-11T23:20:59.458626+0000","last_unstale":"2024-09-11T23:20:59.466007+0000","last_undegraded":"2024-09-11T23:20:59.466007+0000","last_fullsized":"2024-09-11T23:20:59.466007+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:04.817794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.461256+0000","last_change":"2024-09-11T23:20:58.473089+0000","last_active":"2024-09-11T23:20:59.461256+0000","last_peered":"2024-09-11T23:20:59.461256+0000","last_clean":"2024-09-11T23:20:59.461256+0000","last_became_active":"2024-09-11T23:20:58.472866+0000","last_became_peered":"2024-09-11T23:20:58.472866+0000","last_unstale":"2024-09-11T23:20:59.461256+0000","last_undegraded":"2024-09-11T23:20:59.461256+0000","last_fullsized":"2024-09-11T23:20:59.461256+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:24.239996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.482690+0000","last_change":"2024-09-11T23:20:59.480062+0000","last_active":"2024-09-11T23:20:59.482690+0000","last_peered":"2024-09-11T23:20:59.482690+0000","last_clean":"2024-09-11T23:20:59.482690+0000","last_became_active":"2024-09-11T23:20:59.479528+0000","last_became_peered":"2024-09-11T23:20:59.479528+0000","last_unstale":"2024-09-11T23:20:59.482690+0000","last_undegraded":"2024-09-11T23:20:59.482690+0000","last_fullsized":"2024-09-11T23:20:59.482690+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:17.572628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871771+0000","last_change":"2024-09-11T23:20:58.466599+0000","last_active":"2024-09-11T23:21:00.871771+0000","last_peered":"2024-09-11T23:21:00.871771+0000","last_clean":"2024-09-11T23:21:00.871771+0000","last_became_active":"2024-09-11T23:20:58.466282+0000","last_became_peered":"2024-09-11T23:20:58.466282+0000","last_unstale":"2024-09-11T23:21:00.871771+0000","last_undegraded":"2024-09-11T23:21:00.871771+0000","last_fullsized":"2024-09-11T23:21:00.871771+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:39.888169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.449799+0000","last_change":"2024-09-11T23:20:58.449799+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.449799+0000","last_undegraded":"2024-09-11T23:20:58.449799+0000","last_fullsized":"2024-09-11T23:20:58.449799+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"58'3","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.484705+0000","last_change":"2024-09-11T23:20:58.466818+0000","last_active":"2024-09-11T23:20:59.484705+0000","last_peered":"2024-09-11T23:20:59.484705+0000","last_clean":"2024-09-11T23:20:59.484705+0000","last_became_active":"2024-09-11T23:20:58.466361+0000","last_became_peered":"2024-09-11T23:20:58.466361+0000","last_unstale":"2024-09-11T23:20:59.484705+0000","last_undegraded":"2024-09-11T23:20:59.484705+0000","last_fullsized":"2024-09-11T23:20:59.484705+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:43.819715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.488716+0000","last_change":"2024-09-11T23:20:59.483767+0000","last_active":"2024-09-11T23:20:59.488716+0000","last_peered":"2024-09-11T23:20:59.488716+0000","last_clean":"2024-09-11T23:20:59.488716+0000","last_became_active":"2024-09-11T23:20:59.483431+0000","last_became_peered":"2024-09-11T23:20:59.483431+0000","last_unstale":"2024-09-11T23:20:59.488716+0000","last_undegraded":"2024-09-11T23:20:59.488716+0000","last_fullsized":"2024-09-11T23:20:59.488716+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:29.787221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"58'6","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.488822+0000","last_change":"2024-09-11T23:20:58.456875+0000","last_active":"2024-09-11T23:20:59.488822+0000","last_peered":"2024-09-11T23:20:59.488822+0000","last_clean":"2024-09-11T23:20:59.488822+0000","last_became_active":"2024-09-11T23:20:58.456579+0000","last_became_peered":"2024-09-11T23:20:58.456579+0000","last_unstale":"2024-09-11T23:20:59.488822+0000","last_undegraded":"2024-09-11T23:20:59.488822+0000","last_fullsized":"2024-09-11T23:20:59.488822+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:39.167478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.475829+0000","last_change":"2024-09-11T23:20:59.469201+0000","last_active":"2024-09-11T23:20:59.475829+0000","last_peered":"2024-09-11T23:20:59.475829+0000","last_clean":"2024-09-11T23:20:59.475829+0000","last_became_active":"2024-09-11T23:20:59.468613+0000","last_became_peered":"2024-09-11T23:20:59.468613+0000","last_unstale":"2024-09-11T23:20:59.475829+0000","last_undegraded":"2024-09-11T23:20:59.475829+0000","last_fullsized":"2024-09-11T23:20:59.475829+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:39.610047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871362+0000","last_change":"2024-09-11T23:20:58.467171+0000","last_active":"2024-09-11T23:21:00.871362+0000","last_peered":"2024-09-11T23:21:00.871362+0000","last_clean":"2024-09-11T23:21:00.871362+0000","last_became_active":"2024-09-11T23:20:58.466901+0000","last_became_peered":"2024-09-11T23:20:58.466901+0000","last_unstale":"2024-09-11T23:21:00.871362+0000","last_undegraded":"2024-09-11T23:21:00.871362+0000","last_fullsized":"2024-09-11T23:21:00.871362+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:42.485376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.472676+0000","last_change":"2024-09-11T23:20:59.467990+0000","last_active":"2024-09-11T23:20:59.472676+0000","last_peered":"2024-09-11T23:20:59.472676+0000","last_clean":"2024-09-11T23:20:59.472676+0000","last_became_active":"2024-09-11T23:20:59.467663+0000","last_became_peered":"2024-09-11T23:20:59.467663+0000","last_unstale":"2024-09-11T23:20:59.472676+0000","last_undegraded":"2024-09-11T23:20:59.472676+0000","last_fullsized":"2024-09-11T23:20:59.472676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:31.276490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.451054+0000","last_change":"2024-09-11T23:20:58.463853+0000","last_active":"2024-09-11T23:20:59.451054+0000","last_peered":"2024-09-11T23:20:59.451054+0000","last_clean":"2024-09-11T23:20:59.451054+0000","last_became_active":"2024-09-11T23:20:58.463592+0000","last_became_peered":"2024-09-11T23:20:58.463592+0000","last_unstale":"2024-09-11T23:20:59.451054+0000","last_undegraded":"2024-09-11T23:20:59.451054+0000","last_fullsized":"2024-09-11T23:20:59.451054+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:08.131569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.469850+0000","last_change":"2024-09-11T23:20:59.465985+0000","last_active":"2024-09-11T23:20:59.469850+0000","last_peered":"2024-09-11T23:20:59.469850+0000","last_clean":"2024-09-11T23:20:59.469850+0000","last_became_active":"2024-09-11T23:20:59.465623+0000","last_became_peered":"2024-09-11T23:20:59.465623+0000","last_unstale":"2024-09-11T23:20:59.469850+0000","last_undegraded":"2024-09-11T23:20:59.469850+0000","last_fullsized":"2024-09-11T23:20:59.469850+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:31.141653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.458700+0000","last_change":"2024-09-11T23:20:58.463387+0000","last_active":"2024-09-11T23:20:59.458700+0000","last_peered":"2024-09-11T23:20:59.458700+0000","last_clean":"2024-09-11T23:20:59.458700+0000","last_became_active":"2024-09-11T23:20:58.463106+0000","last_became_peered":"2024-09-11T23:20:58.463106+0000","last_unstale":"2024-09-11T23:20:59.458700+0000","last_undegraded":"2024-09-11T23:20:59.458700+0000","last_fullsized":"2024-09-11T23:20:59.458700+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:18.406488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.479594+0000","last_change":"2024-09-11T23:20:59.476552+0000","last_active":"2024-09-11T23:20:59.479594+0000","last_peered":"2024-09-11T23:20:59.479594+0000","last_clean":"2024-09-11T23:20:59.479594+0000","last_became_active":"2024-09-11T23:20:59.476173+0000","last_became_peered":"2024-09-11T23:20:59.476173+0000","last_unstale":"2024-09-11T23:20:59.479594+0000","last_undegraded":"2024-09-11T23:20:59.479594+0000","last_fullsized":"2024-09-11T23:20:59.479594+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:50.314018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"58'8","reported_seq":20,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.482839+0000","last_change":"2024-09-11T23:20:58.467986+0000","last_active":"2024-09-11T23:20:59.482839+0000","last_peered":"2024-09-11T23:20:59.482839+0000","last_clean":"2024-09-11T23:20:59.482839+0000","last_became_active":"2024-09-11T23:20:58.466944+0000","last_became_peered":"2024-09-11T23:20:58.466944+0000","last_unstale":"2024-09-11T23:20:59.482839+0000","last_undegraded":"2024-09-11T23:20:59.482839+0000","last_fullsized":"2024-09-11T23:20:59.482839+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:06.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.478297+0000","last_change":"2024-09-11T23:20:59.472856+0000","last_active":"2024-09-11T23:20:59.478297+0000","last_peered":"2024-09-11T23:20:59.478297+0000","last_clean":"2024-09-11T23:20:59.478297+0000","last_became_active":"2024-09-11T23:20:59.471121+0000","last_became_peered":"2024-09-11T23:20:59.471121+0000","last_unstale":"2024-09-11T23:20:59.478297+0000","last_undegraded":"2024-09-11T23:20:59.478297+0000","last_fullsized":"2024-09-11T23:20:59.478297+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:34.060404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871796+0000","last_change":"2024-09-11T23:20:58.466456+0000","last_active":"2024-09-11T23:21:00.871796+0000","last_peered":"2024-09-11T23:21:00.871796+0000","last_clean":"2024-09-11T23:21:00.871796+0000","last_became_active":"2024-09-11T23:20:58.466200+0000","last_became_peered":"2024-09-11T23:20:58.466200+0000","last_unstale":"2024-09-11T23:21:00.871796+0000","last_undegraded":"2024-09-11T23:21:00.871796+0000","last_fullsized":"2024-09-11T23:21:00.871796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:23.944565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.474147+0000","last_change":"2024-09-11T23:20:59.466534+0000","last_active":"2024-09-11T23:20:59.474147+0000","last_peered":"2024-09-11T23:20:59.474147+0000","last_clean":"2024-09-11T23:20:59.474147+0000","last_became_active":"2024-09-11T23:20:59.466243+0000","last_became_peered":"2024-09-11T23:20:59.466243+0000","last_unstale":"2024-09-11T23:20:59.474147+0000","last_undegraded":"2024-09-11T23:20:59.474147+0000","last_fullsized":"2024-09-11T23:20:59.474147+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:44.827455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.472249+0000","last_change":"2024-09-11T23:20:58.468458+0000","last_active":"2024-09-11T23:20:58.472249+0000","last_peered":"2024-09-11T23:20:58.472249+0000","last_clean":"2024-09-11T23:20:58.472249+0000","last_became_active":"2024-09-11T23:20:58.468206+0000","last_became_peered":"2024-09-11T23:20:58.468206+0000","last_unstale":"2024-09-11T23:20:58.472249+0000","last_undegraded":"2024-09-11T23:20:58.472249+0000","last_fullsized":"2024-09-11T23:20:58.472249+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:29.469606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871909+0000","last_change":"2024-09-11T23:20:59.462675+0000","last_active":"2024-09-11T23:21:00.871909+0000","last_peered":"2024-09-11T23:21:00.871909+0000","last_clean":"2024-09-11T23:21:00.871909+0000","last_became_active":"2024-09-11T23:20:59.462426+0000","last_became_peered":"2024-09-11T23:20:59.462426+0000","last_unstale":"2024-09-11T23:21:00.871909+0000","last_undegraded":"2024-09-11T23:21:00.871909+0000","last_fullsized":"2024-09-11T23:21:00.871909+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:13.970806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.480288+0000","last_change":"2024-09-11T23:20:58.467884+0000","last_active":"2024-09-11T23:20:59.480288+0000","last_peered":"2024-09-11T23:20:59.480288+0000","last_clean":"2024-09-11T23:20:59.480288+0000","last_became_active":"2024-09-11T23:20:58.467589+0000","last_became_peered":"2024-09-11T23:20:58.467589+0000","last_unstale":"2024-09-11T23:20:59.480288+0000","last_undegraded":"2024-09-11T23:20:59.480288+0000","last_fullsized":"2024-09-11T23:20:59.480288+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:06.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.488729+0000","last_change":"2024-09-11T23:20:59.483962+0000","last_active":"2024-09-11T23:20:59.488729+0000","last_peered":"2024-09-11T23:20:59.488729+0000","last_clean":"2024-09-11T23:20:59.488729+0000","last_became_active":"2024-09-11T23:20:59.483698+0000","last_became_peered":"2024-09-11T23:20:59.483698+0000","last_unstale":"2024-09-11T23:20:59.488729+0000","last_undegraded":"2024-09-11T23:20:59.488729+0000","last_fullsized":"2024-09-11T23:20:59.488729+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:08.772254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.467635+0000","last_change":"2024-09-11T23:20:58.464827+0000","last_active":"2024-09-11T23:20:58.467635+0000","last_peered":"2024-09-11T23:20:58.467635+0000","last_clean":"2024-09-11T23:20:58.467635+0000","last_became_active":"2024-09-11T23:20:58.464593+0000","last_became_peered":"2024-09-11T23:20:58.464593+0000","last_unstale":"2024-09-11T23:20:58.467635+0000","last_undegraded":"2024-09-11T23:20:58.467635+0000","last_fullsized":"2024-09-11T23:20:58.467635+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:20.242907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.478418+0000","last_change":"2024-09-11T23:20:59.468489+0000","last_active":"2024-09-11T23:20:59.478418+0000","last_peered":"2024-09-11T23:20:59.478418+0000","last_clean":"2024-09-11T23:20:59.478418+0000","last_became_active":"2024-09-11T23:20:59.466325+0000","last_became_peered":"2024-09-11T23:20:59.466325+0000","last_unstale":"2024-09-11T23:20:59.478418+0000","last_undegraded":"2024-09-11T23:20:59.478418+0000","last_fullsized":"2024-09-11T23:20:59.478418+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:49.249112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871522+0000","last_change":"2024-09-11T23:20:58.461629+0000","last_active":"2024-09-11T23:21:00.871522+0000","last_peered":"2024-09-11T23:21:00.871522+0000","last_clean":"2024-09-11T23:21:00.871522+0000","last_became_active":"2024-09-11T23:20:58.461361+0000","last_became_peered":"2024-09-11T23:20:58.461361+0000","last_unstale":"2024-09-11T23:21:00.871522+0000","last_undegraded":"2024-09-11T23:21:00.871522+0000","last_fullsized":"2024-09-11T23:21:00.871522+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:39.804195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.448097+0000","last_change":"2024-09-11T23:20:58.448097+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.448097+0000","last_undegraded":"2024-09-11T23:20:58.448097+0000","last_fullsized":"2024-09-11T23:20:58.448097+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.465691+0000","last_change":"2024-09-11T23:20:58.461264+0000","last_active":"2024-09-11T23:20:58.465691+0000","last_peered":"2024-09-11T23:20:58.465691+0000","last_clean":"2024-09-11T23:20:58.465691+0000","last_became_active":"2024-09-11T23:20:58.461014+0000","last_became_peered":"2024-09-11T23:20:58.461014+0000","last_unstale":"2024-09-11T23:20:58.465691+0000","last_undegraded":"2024-09-11T23:20:58.465691+0000","last_fullsized":"2024-09-11T23:20:58.465691+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:41.170235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.450734+0000","last_change":"2024-09-11T23:20:58.450734+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.450734+0000","last_undegraded":"2024-09-11T23:20:58.450734+0000","last_fullsized":"2024-09-11T23:20:58.450734+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.461077+0000","last_change":"2024-09-11T23:20:58.465129+0000","last_active":"2024-09-11T23:20:59.461077+0000","last_peered":"2024-09-11T23:20:59.461077+0000","last_clean":"2024-09-11T23:20:59.461077+0000","last_became_active":"2024-09-11T23:20:58.464847+0000","last_became_peered":"2024-09-11T23:20:58.464847+0000","last_unstale":"2024-09-11T23:20:59.461077+0000","last_undegraded":"2024-09-11T23:20:59.461077+0000","last_fullsized":"2024-09-11T23:20:59.461077+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:58.558566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.476804+0000","last_change":"2024-09-11T23:20:59.470013+0000","last_active":"2024-09-11T23:20:59.476804+0000","last_peered":"2024-09-11T23:20:59.476804+0000","last_clean":"2024-09-11T23:20:59.476804+0000","last_became_active":"2024-09-11T23:20:59.469672+0000","last_became_peered":"2024-09-11T23:20:59.469672+0000","last_unstale":"2024-09-11T23:20:59.476804+0000","last_undegraded":"2024-09-11T23:20:59.476804+0000","last_fullsized":"2024-09-11T23:20:59.476804+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:34.060404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.465616+0000","last_change":"2024-09-11T23:20:58.461093+0000","last_active":"2024-09-11T23:20:58.465616+0000","last_peered":"2024-09-11T23:20:58.465616+0000","last_clean":"2024-09-11T23:20:58.465616+0000","last_became_active":"2024-09-11T23:20:58.460732+0000","last_became_peered":"2024-09-11T23:20:58.460732+0000","last_unstale":"2024-09-11T23:20:58.465616+0000","last_undegraded":"2024-09-11T23:20:58.465616+0000","last_fullsized":"2024-09-11T23:20:58.465616+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:13:21.428952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.474167+0000","last_change":"2024-09-11T23:20:59.467473+0000","last_active":"2024-09-11T23:20:59.474167+0000","last_peered":"2024-09-11T23:20:59.474167+0000","last_clean":"2024-09-11T23:20:59.474167+0000","last_became_active":"2024-09-11T23:20:59.467131+0000","last_became_peered":"2024-09-11T23:20:59.467131+0000","last_unstale":"2024-09-11T23:20:59.474167+0000","last_undegraded":"2024-09-11T23:20:59.474167+0000","last_fullsized":"2024-09-11T23:20:59.474167+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:25.247737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.467582+0000","last_change":"2024-09-11T23:20:58.464274+0000","last_active":"2024-09-11T23:20:58.467582+0000","last_peered":"2024-09-11T23:20:58.467582+0000","last_clean":"2024-09-11T23:20:58.467582+0000","last_became_active":"2024-09-11T23:20:58.462488+0000","last_became_peered":"2024-09-11T23:20:58.462488+0000","last_unstale":"2024-09-11T23:20:58.467582+0000","last_undegraded":"2024-09-11T23:20:58.467582+0000","last_fullsized":"2024-09-11T23:20:58.467582+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:21.671976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.449333+0000","last_change":"2024-09-11T23:20:58.449333+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.449333+0000","last_undegraded":"2024-09-11T23:20:58.449333+0000","last_fullsized":"2024-09-11T23:20:58.449333+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.449844+0000","last_change":"2024-09-11T23:20:58.461597+0000","last_active":"2024-09-11T23:20:59.449844+0000","last_peered":"2024-09-11T23:20:59.449844+0000","last_clean":"2024-09-11T23:20:59.449844+0000","last_became_active":"2024-09-11T23:20:58.460572+0000","last_became_peered":"2024-09-11T23:20:58.460572+0000","last_unstale":"2024-09-11T23:20:59.449844+0000","last_undegraded":"2024-09-11T23:20:59.449844+0000","last_fullsized":"2024-09-11T23:20:59.449844+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:41.170235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.448119+0000","last_change":"2024-09-11T23:20:58.448119+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.448119+0000","last_undegraded":"2024-09-11T23:20:58.448119+0000","last_fullsized":"2024-09-11T23:20:58.448119+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.459519+0000","last_change":"2024-09-11T23:20:58.460325+0000","last_active":"2024-09-11T23:20:59.459519+0000","last_peered":"2024-09-11T23:20:59.459519+0000","last_clean":"2024-09-11T23:20:59.459519+0000","last_became_active":"2024-09-11T23:20:58.459535+0000","last_became_peered":"2024-09-11T23:20:58.459535+0000","last_unstale":"2024-09-11T23:20:59.459519+0000","last_undegraded":"2024-09-11T23:20:59.459519+0000","last_fullsized":"2024-09-11T23:20:59.459519+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:15.242284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871771+0000","last_change":"2024-09-11T23:20:59.467890+0000","last_active":"2024-09-11T23:21:00.871771+0000","last_peered":"2024-09-11T23:21:00.871771+0000","last_clean":"2024-09-11T23:21:00.871771+0000","last_became_active":"2024-09-11T23:20:59.467620+0000","last_became_peered":"2024-09-11T23:20:59.467620+0000","last_unstale":"2024-09-11T23:21:00.871771+0000","last_undegraded":"2024-09-11T23:21:00.871771+0000","last_fullsized":"2024-09-11T23:21:00.871771+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:28.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.465553+0000","last_change":"2024-09-11T23:20:58.461187+0000","last_active":"2024-09-11T23:20:58.465553+0000","last_peered":"2024-09-11T23:20:58.465553+0000","last_clean":"2024-09-11T23:20:58.465553+0000","last_became_active":"2024-09-11T23:20:58.460890+0000","last_became_peered":"2024-09-11T23:20:58.460890+0000","last_unstale":"2024-09-11T23:20:58.465553+0000","last_undegraded":"2024-09-11T23:20:58.465553+0000","last_fullsized":"2024-09-11T23:20:58.465553+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:05.761153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.479500+0000","last_change":"2024-09-11T23:20:59.475905+0000","last_active":"2024-09-11T23:20:59.479500+0000","last_peered":"2024-09-11T23:20:59.479500+0000","last_clean":"2024-09-11T23:20:59.479500+0000","last_became_active":"2024-09-11T23:20:59.475545+0000","last_became_peered":"2024-09-11T23:20:59.475545+0000","last_unstale":"2024-09-11T23:20:59.479500+0000","last_undegraded":"2024-09-11T23:20:59.479500+0000","last_fullsized":"2024-09-11T23:20:59.479500+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:39.771178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.450416+0000","last_change":"2024-09-11T23:20:58.458608+0000","last_active":"2024-09-11T23:20:59.450416+0000","last_peered":"2024-09-11T23:20:59.450416+0000","last_clean":"2024-09-11T23:20:59.450416+0000","last_became_active":"2024-09-11T23:20:58.458251+0000","last_became_peered":"2024-09-11T23:20:58.458251+0000","last_unstale":"2024-09-11T23:20:59.450416+0000","last_undegraded":"2024-09-11T23:20:59.450416+0000","last_fullsized":"2024-09-11T23:20:59.450416+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:04:14.569214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.450970+0000","last_change":"2024-09-11T23:20:58.450970+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.450970+0000","last_undegraded":"2024-09-11T23:20:58.450970+0000","last_fullsized":"2024-09-11T23:20:58.450970+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.467229+0000","last_change":"2024-09-11T23:20:58.463594+0000","last_active":"2024-09-11T23:20:58.467229+0000","last_peered":"2024-09-11T23:20:58.467229+0000","last_clean":"2024-09-11T23:20:58.467229+0000","last_became_active":"2024-09-11T23:20:58.463332+0000","last_became_peered":"2024-09-11T23:20:58.463332+0000","last_unstale":"2024-09-11T23:20:58.467229+0000","last_undegraded":"2024-09-11T23:20:58.467229+0000","last_fullsized":"2024-09-11T23:20:58.467229+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:47.949664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871544+0000","last_change":"2024-09-11T23:20:59.460002+0000","last_active":"2024-09-11T23:21:00.871544+0000","last_peered":"2024-09-11T23:21:00.871544+0000","last_clean":"2024-09-11T23:21:00.871544+0000","last_became_active":"2024-09-11T23:20:59.459757+0000","last_became_peered":"2024-09-11T23:20:59.459757+0000","last_unstale":"2024-09-11T23:21:00.871544+0000","last_undegraded":"2024-09-11T23:21:00.871544+0000","last_fullsized":"2024-09-11T23:21:00.871544+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:39.798888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871522+0000","last_change":"2024-09-11T23:20:58.467356+0000","last_active":"2024-09-11T23:21:00.871522+0000","last_peered":"2024-09-11T23:21:00.871522+0000","last_clean":"2024-09-11T23:21:00.871522+0000","last_became_active":"2024-09-11T23:20:58.465829+0000","last_became_peered":"2024-09-11T23:20:58.465829+0000","last_unstale":"2024-09-11T23:21:00.871522+0000","last_undegraded":"2024-09-11T23:21:00.871522+0000","last_fullsized":"2024-09-11T23:21:00.871522+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:06.639194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871420+0000","last_change":"2024-09-11T23:20:59.474473+0000","last_active":"2024-09-11T23:21:00.871420+0000","last_peered":"2024-09-11T23:21:00.871420+0000","last_clean":"2024-09-11T23:21:00.871420+0000","last_became_active":"2024-09-11T23:20:59.474176+0000","last_became_peered":"2024-09-11T23:20:59.474176+0000","last_unstale":"2024-09-11T23:21:00.871420+0000","last_undegraded":"2024-09-11T23:21:00.871420+0000","last_fullsized":"2024-09-11T23:21:00.871420+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:03.448755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.450156+0000","last_change":"2024-09-11T23:20:58.465838+0000","last_active":"2024-09-11T23:20:59.450156+0000","last_peered":"2024-09-11T23:20:59.450156+0000","last_clean":"2024-09-11T23:20:59.450156+0000","last_became_active":"2024-09-11T23:20:58.464372+0000","last_became_peered":"2024-09-11T23:20:58.464372+0000","last_unstale":"2024-09-11T23:20:59.450156+0000","last_undegraded":"2024-09-11T23:20:59.450156+0000","last_fullsized":"2024-09-11T23:20:59.450156+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:47.949664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":236,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.457932+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:20:59.457932+0000","last_peered":"2024-09-11T23:20:59.457932+0000","last_clean":"2024-09-11T23:20:59.457932+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:20:59.457932+0000","last_undegraded":"2024-09-11T23:20:59.457932+0000","last_fullsized":"2024-09-11T23:20:59.457932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476779,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28288,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343552,"statfs":{"total":96636764160,"available":96607797248,"internally_reserved":0,"allocated":1286144,"data_stored":873616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":671744,"data_stored":276313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476777,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":692224,"data_stored":283740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476777,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":696320,"data_stored":284700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31832,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":659456,"data_stored":270046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1265664,"data_stored":866681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":704512,"data_stored":289444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":704512,"data_stored":289444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:21:04.113 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:21:04.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.266+0000 7f5104a00640 1 Processor -- start 2024-09-11T23:21:04.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.266+0000 7f5104a00640 1 -- start start 2024-09-11T23:21:04.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.267+0000 7f5104a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f510015e640 0x7f51000d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:04.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.267+0000 7f5104a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51000d3f60 0x7f51000b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:04.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.267+0000 7f5104a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f510006bee0 con 0x7f51000b6510 2024-09-11T23:21:04.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.267+0000 7f5104a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f510015ea20 con 0x7f51000d3f60 2024-09-11T23:21:04.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.267+0000 7f5104a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f510006caf0 con 0x7f510015e640 2024-09-11T23:21:04.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.267+0000 7f50f7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51000d3f60 0x7f51000b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:04.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.268+0000 7f50f7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51000d3f60 0x7f51000b5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53552/0 (socket says 172.21.15.144:53552) 2024-09-11T23:21:04.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.268+0000 7f50f7e00640 1 -- 172.21.15.144:0/126551844 learned_addr learned my addr 172.21.15.144:0/126551844 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:04.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.268+0000 7f50fe800640 1 --2- 172.21.15.144:0/126551844 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f510015e640 0x7f51000d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:04.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.268+0000 7f50f7e00640 1 -- 172.21.15.144:0/126551844 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f510015e640 msgr2=0x7f51000d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:04.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.268+0000 7f50f7e00640 1 --2- 172.21.15.144:0/126551844 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f510015e640 0x7f51000d3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.268+0000 7f50f7e00640 1 -- 172.21.15.144:0/126551844 >> v1:172.21.15.165:6789/0 conn(0x7f51000b6510 legacy=0x7f51000d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:04.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.268+0000 7f50f7e00640 1 -- 172.21.15.144:0/126551844 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510006c1c0 con 0x7f51000d3f60 2024-09-11T23:21:04.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.269+0000 7f50f7e00640 1 --2- 172.21.15.144:0/126551844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51000d3f60 0x7f51000b5fd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009870 tx=0x7f50e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a4b069efe40841 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:04.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.269+0000 7f50fde00640 1 -- 172.21.15.144:0/126551844 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e8037070 con 0x7f51000d3f60 2024-09-11T23:21:04.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.269+0000 7f50fde00640 1 -- 172.21.15.144:0/126551844 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50e8032440 con 0x7f51000d3f60 2024-09-11T23:21:04.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.269+0000 7f50fde00640 1 -- 172.21.15.144:0/126551844 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e8032810 con 0x7f51000d3f60 2024-09-11T23:21:04.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.270+0000 7f5104a00640 1 -- 172.21.15.144:0/126551844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51000d3f60 msgr2=0x7f51000b5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:04.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.270+0000 7f5104a00640 1 --2- 172.21.15.144:0/126551844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51000d3f60 0x7f51000b5fd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009870 tx=0x7f50e802a270 comp rx=0 tx=0).stop 2024-09-11T23:21:04.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.270+0000 7f5104a00640 1 -- 172.21.15.144:0/126551844 shutdown_connections 2024-09-11T23:21:04.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.270+0000 7f5104a00640 1 --2- 172.21.15.144:0/126551844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51000d3f60 0x7f51000b5fd0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.270+0000 7f5104a00640 1 --2- 172.21.15.144:0/126551844 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f510015e640 0x7f51000d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.270+0000 7f5104a00640 1 -- 172.21.15.144:0/126551844 >> 172.21.15.144:0/126551844 conn(0x7f51000d0fd0 msgr2=0x7f51000d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:04.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.270+0000 7f5104a00640 1 -- 172.21.15.144:0/126551844 shutdown_connections 2024-09-11T23:21:04.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.270+0000 7f5104a00640 1 -- 172.21.15.144:0/126551844 wait complete. 2024-09-11T23:21:04.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.272+0000 7f5104a00640 1 Processor -- start 2024-09-11T23:21:04.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.272+0000 7f5104a00640 1 -- start start 2024-09-11T23:21:04.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.273+0000 7f5104a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51000b6510 0x7f51001f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:04.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.273+0000 7f5104a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51000d3f60 0x7f51001f7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:04.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.273+0000 7f5104a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f510015e640 0x7f51000cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:04.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.273+0000 7f5104a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f51000b8760 con 0x7f510015e640 2024-09-11T23:21:04.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.273+0000 7f5104a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f510006c780 con 0x7f51000b6510 2024-09-11T23:21:04.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.273+0000 7f5104a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f51000b88e0 con 0x7f51000d3f60 2024-09-11T23:21:04.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.273+0000 7f50ff200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f510015e640 0x7f51000cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:04.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.273+0000 7f50ff200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f510015e640 0x7f51000cb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53560/0 (socket says 172.21.15.144:53560) 2024-09-11T23:21:04.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.273+0000 7f50ff200640 1 -- 172.21.15.144:0/2752045548 learned_addr learned my addr 172.21.15.144:0/2752045548 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:04.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.273+0000 7f50fe800640 1 --2- 172.21.15.144:0/2752045548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51000b6510 0x7f51001f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:04.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.273+0000 7f50f7e00640 1 --2- 172.21.15.144:0/2752045548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51000d3f60 0x7f51001f7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:04.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.273+0000 7f50ff200640 1 -- 172.21.15.144:0/2752045548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51000d3f60 msgr2=0x7f51001f7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:04.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.273+0000 7f50ff200640 1 --2- 172.21.15.144:0/2752045548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51000d3f60 0x7f51001f7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.273+0000 7f50ff200640 1 -- 172.21.15.144:0/2752045548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51000b6510 msgr2=0x7f51001f4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:04.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.273+0000 7f50ff200640 1 --2- 172.21.15.144:0/2752045548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51000b6510 0x7f51001f4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.273+0000 7f50ff200640 1 -- 172.21.15.144:0/2752045548 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51000cbd20 con 0x7f510015e640 2024-09-11T23:21:04.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.274+0000 7f50ff200640 1 --2- 172.21.15.144:0/2752045548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f510015e640 0x7f51000cb620 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f50f800c7a0 tx=0x7f50f800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:04.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.274+0000 7f50f6a00640 1 -- 172.21.15.144:0/2752045548 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8003b70 con 0x7f510015e640 2024-09-11T23:21:04.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.274+0000 7f50f6a00640 1 -- 172.21.15.144:0/2752045548 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f8003d30 con 0x7f510015e640 2024-09-11T23:21:04.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.274+0000 7f50f6a00640 1 -- 172.21.15.144:0/2752045548 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f800aa90 con 0x7f510015e640 2024-09-11T23:21:04.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.274+0000 7f5104a00640 1 -- 172.21.15.144:0/2752045548 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51000cc000 con 0x7f510015e640 2024-09-11T23:21:04.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.274+0000 7f5104a00640 1 -- 172.21.15.144:0/2752045548 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51000cc5c0 con 0x7f510015e640 2024-09-11T23:21:04.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.275+0000 7f5104a00640 1 -- 172.21.15.144:0/2752045548 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5100068cd0 con 0x7f510015e640 2024-09-11T23:21:04.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.276+0000 7f50f6a00640 1 -- 172.21.15.144:0/2752045548 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f50f800ac30 con 0x7f510015e640 2024-09-11T23:21:04.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.277+0000 7f50f6a00640 1 --2- 172.21.15.144:0/2752045548 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f50dc06bfe0 0x7f50dc06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:04.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.277+0000 7f50f6a00640 1 -- 172.21.15.144:0/2752045548 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f50f808afe0 con 0x7f510015e640 2024-09-11T23:21:04.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.277+0000 7f50fe800640 1 --2- 172.21.15.144:0/2752045548 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f50dc06bfe0 0x7f50dc06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:04.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.278+0000 7f50fe800640 1 --2- 172.21.15.144:0/2752045548 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f50dc06bfe0 0x7f50dc06e4a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009aa0 tx=0x7f50f0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:04.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.281+0000 7f50f6a00640 1 -- 172.21.15.144:0/2752045548 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5100068cd0 con 0x7f510015e640 2024-09-11T23:21:04.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.453+0000 7f5104a00640 1 -- 172.21.15.144:0/2752045548 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f51000b5fd0 con 0x7f50dc06bfe0 2024-09-11T23:21:04.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.460+0000 7f50f6a00640 1 -- 172.21.15.144:0/2752045548 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250592 (secure 0 0 0) 0x7f51000b5fd0 con 0x7f50dc06bfe0 2024-09-11T23:21:04.463 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:04.464 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:21:04.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.464+0000 7f5104a00640 1 -- 172.21.15.144:0/2752045548 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f50dc06bfe0 msgr2=0x7f50dc06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:04.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.464+0000 7f5104a00640 1 --2- 172.21.15.144:0/2752045548 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f50dc06bfe0 0x7f50dc06e4a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009aa0 tx=0x7f50f0009190 comp rx=0 tx=0).stop 2024-09-11T23:21:04.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.464+0000 7f5104a00640 1 -- 172.21.15.144:0/2752045548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f510015e640 msgr2=0x7f51000cb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:04.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.464+0000 7f5104a00640 1 --2- 172.21.15.144:0/2752045548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f510015e640 0x7f51000cb620 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f50f800c7a0 tx=0x7f50f800cc60 comp rx=0 tx=0).stop 2024-09-11T23:21:04.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.464+0000 7f5104a00640 1 -- 172.21.15.144:0/2752045548 shutdown_connections 2024-09-11T23:21:04.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.464+0000 7f5104a00640 1 --2- 172.21.15.144:0/2752045548 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f50dc06bfe0 0x7f50dc06e4a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.464+0000 7f5104a00640 1 --2- 172.21.15.144:0/2752045548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f510015e640 0x7f51000cb620 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.464+0000 7f5104a00640 1 --2- 172.21.15.144:0/2752045548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51000d3f60 0x7f51001f7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.464+0000 7f5104a00640 1 --2- 172.21.15.144:0/2752045548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51000b6510 0x7f51001f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.464+0000 7f5104a00640 1 -- 172.21.15.144:0/2752045548 >> 172.21.15.144:0/2752045548 conn(0x7f51000d0fd0 msgr2=0x7f51000b54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:04.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.464+0000 7f5104a00640 1 -- 172.21.15.144:0/2752045548 shutdown_connections 2024-09-11T23:21:04.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.464+0000 7f5104a00640 1 -- 172.21.15.144:0/2752045548 wait complete. 2024-09-11T23:21:04.480 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-11T23:21:03.204993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":190,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231096,"kb_used_data":6524,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743624,"statfs":{"total":773094113280,"available":772857470976,"internally_reserved":0,"allocated":6680576,"data_stored":3433984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.768930"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456550+0000","last_change":"2024-09-11T23:20:59.472164+0000","last_active":"2024-09-11T23:21:00.456550+0000","last_peered":"2024-09-11T23:21:00.456550+0000","last_clean":"2024-09-11T23:21:00.456550+0000","last_became_active":"2024-09-11T23:20:59.471476+0000","last_became_peered":"2024-09-11T23:20:59.471476+0000","last_unstale":"2024-09-11T23:21:00.456550+0000","last_undegraded":"2024-09-11T23:21:00.456550+0000","last_fullsized":"2024-09-11T23:21:00.456550+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:26.417418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871704+0000","last_change":"2024-09-11T23:20:59.467559+0000","last_active":"2024-09-11T23:21:00.871704+0000","last_peered":"2024-09-11T23:21:00.871704+0000","last_clean":"2024-09-11T23:21:00.871704+0000","last_became_active":"2024-09-11T23:20:59.467289+0000","last_became_peered":"2024-09-11T23:20:59.467289+0000","last_unstale":"2024-09-11T23:21:00.871704+0000","last_undegraded":"2024-09-11T23:21:00.871704+0000","last_fullsized":"2024-09-11T23:21:00.871704+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:31.251559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.475161+0000","last_change":"2024-09-11T23:20:59.469746+0000","last_active":"2024-09-11T23:20:59.475161+0000","last_peered":"2024-09-11T23:20:59.475161+0000","last_clean":"2024-09-11T23:20:59.475161+0000","last_became_active":"2024-09-11T23:20:59.469438+0000","last_became_peered":"2024-09-11T23:20:59.469438+0000","last_unstale":"2024-09-11T23:20:59.475161+0000","last_undegraded":"2024-09-11T23:20:59.475161+0000","last_fullsized":"2024-09-11T23:20:59.475161+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:49.249112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.472552+0000","last_change":"2024-09-11T23:20:59.468119+0000","last_active":"2024-09-11T23:20:59.472552+0000","last_peered":"2024-09-11T23:20:59.472552+0000","last_clean":"2024-09-11T23:20:59.472552+0000","last_became_active":"2024-09-11T23:20:59.467847+0000","last_became_peered":"2024-09-11T23:20:59.467847+0000","last_unstale":"2024-09-11T23:20:59.472552+0000","last_undegraded":"2024-09-11T23:20:59.472552+0000","last_fullsized":"2024-09-11T23:20:59.472552+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:50.317785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456756+0000","last_change":"2024-09-11T23:20:59.462985+0000","last_active":"2024-09-11T23:21:00.456756+0000","last_peered":"2024-09-11T23:21:00.456756+0000","last_clean":"2024-09-11T23:21:00.456756+0000","last_became_active":"2024-09-11T23:20:59.462699+0000","last_became_peered":"2024-09-11T23:20:59.462699+0000","last_unstale":"2024-09-11T23:21:00.456756+0000","last_undegraded":"2024-09-11T23:21:00.456756+0000","last_fullsized":"2024-09-11T23:21:00.456756+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:58.821334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.449691+0000","last_change":"2024-09-11T23:20:58.449691+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.449691+0000","last_undegraded":"2024-09-11T23:20:58.449691+0000","last_fullsized":"2024-09-11T23:20:58.449691+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.470273+0000","last_change":"2024-09-11T23:20:59.464854+0000","last_active":"2024-09-11T23:20:59.470273+0000","last_peered":"2024-09-11T23:20:59.470273+0000","last_clean":"2024-09-11T23:20:59.470273+0000","last_became_active":"2024-09-11T23:20:59.464585+0000","last_became_peered":"2024-09-11T23:20:59.464585+0000","last_unstale":"2024-09-11T23:20:59.470273+0000","last_undegraded":"2024-09-11T23:20:59.470273+0000","last_fullsized":"2024-09-11T23:20:59.470273+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:39.929849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871393+0000","last_change":"2024-09-11T23:20:59.461801+0000","last_active":"2024-09-11T23:21:00.871393+0000","last_peered":"2024-09-11T23:21:00.871393+0000","last_clean":"2024-09-11T23:21:00.871393+0000","last_became_active":"2024-09-11T23:20:59.461531+0000","last_became_peered":"2024-09-11T23:20:59.461531+0000","last_unstale":"2024-09-11T23:21:00.871393+0000","last_undegraded":"2024-09-11T23:21:00.871393+0000","last_fullsized":"2024-09-11T23:21:00.871393+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:44.244935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.488243+0000","last_change":"2024-09-11T23:20:59.483367+0000","last_active":"2024-09-11T23:20:59.488243+0000","last_peered":"2024-09-11T23:20:59.488243+0000","last_clean":"2024-09-11T23:20:59.488243+0000","last_became_active":"2024-09-11T23:20:59.483009+0000","last_became_peered":"2024-09-11T23:20:59.483009+0000","last_unstale":"2024-09-11T23:20:59.488243+0000","last_undegraded":"2024-09-11T23:20:59.488243+0000","last_fullsized":"2024-09-11T23:20:59.488243+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:22.679717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.450117+0000","last_change":"2024-09-11T23:20:58.450117+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.450117+0000","last_undegraded":"2024-09-11T23:20:58.450117+0000","last_fullsized":"2024-09-11T23:20:58.450117+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.450382+0000","last_change":"2024-09-11T23:20:58.450382+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.450382+0000","last_undegraded":"2024-09-11T23:20:58.450382+0000","last_fullsized":"2024-09-11T23:20:58.450382+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.472531+0000","last_change":"2024-09-11T23:20:59.467528+0000","last_active":"2024-09-11T23:20:59.472531+0000","last_peered":"2024-09-11T23:20:59.472531+0000","last_clean":"2024-09-11T23:20:59.472531+0000","last_became_active":"2024-09-11T23:20:59.467148+0000","last_became_peered":"2024-09-11T23:20:59.467148+0000","last_unstale":"2024-09-11T23:20:59.472531+0000","last_undegraded":"2024-09-11T23:20:59.472531+0000","last_fullsized":"2024-09-11T23:20:59.472531+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:31.276490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.475119+0000","last_change":"2024-09-11T23:20:59.471352+0000","last_active":"2024-09-11T23:20:59.475119+0000","last_peered":"2024-09-11T23:20:59.475119+0000","last_clean":"2024-09-11T23:20:59.475119+0000","last_became_active":"2024-09-11T23:20:59.470968+0000","last_became_peered":"2024-09-11T23:20:59.470968+0000","last_unstale":"2024-09-11T23:20:59.475119+0000","last_undegraded":"2024-09-11T23:20:59.475119+0000","last_fullsized":"2024-09-11T23:20:59.475119+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:45.696532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.462287+0000","last_change":"2024-09-11T23:20:59.458141+0000","last_active":"2024-09-11T23:20:59.462287+0000","last_peered":"2024-09-11T23:20:59.462287+0000","last_clean":"2024-09-11T23:20:59.462287+0000","last_became_active":"2024-09-11T23:20:59.457853+0000","last_became_peered":"2024-09-11T23:20:59.457853+0000","last_unstale":"2024-09-11T23:20:59.462287+0000","last_undegraded":"2024-09-11T23:20:59.462287+0000","last_fullsized":"2024-09-11T23:20:59.462287+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:28.453235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.464989+0000","last_change":"2024-09-11T23:20:59.457958+0000","last_active":"2024-09-11T23:20:59.464989+0000","last_peered":"2024-09-11T23:20:59.464989+0000","last_clean":"2024-09-11T23:20:59.464989+0000","last_became_active":"2024-09-11T23:20:59.457672+0000","last_became_peered":"2024-09-11T23:20:59.457672+0000","last_unstale":"2024-09-11T23:20:59.464989+0000","last_undegraded":"2024-09-11T23:20:59.464989+0000","last_fullsized":"2024-09-11T23:20:59.464989+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:35.174888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.449499+0000","last_change":"2024-09-11T23:20:58.449499+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.449499+0000","last_undegraded":"2024-09-11T23:20:58.449499+0000","last_fullsized":"2024-09-11T23:20:58.449499+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871858+0000","last_change":"2024-09-11T23:20:59.465949+0000","last_active":"2024-09-11T23:21:00.871858+0000","last_peered":"2024-09-11T23:21:00.871858+0000","last_clean":"2024-09-11T23:21:00.871858+0000","last_became_active":"2024-09-11T23:20:59.465251+0000","last_became_peered":"2024-09-11T23:20:59.465251+0000","last_unstale":"2024-09-11T23:21:00.871858+0000","last_undegraded":"2024-09-11T23:21:00.871858+0000","last_fullsized":"2024-09-11T23:21:00.871858+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:40.463156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.473417+0000","last_change":"2024-09-11T23:20:59.469311+0000","last_active":"2024-09-11T23:20:59.473417+0000","last_peered":"2024-09-11T23:20:59.473417+0000","last_clean":"2024-09-11T23:20:59.473417+0000","last_became_active":"2024-09-11T23:20:59.468802+0000","last_became_peered":"2024-09-11T23:20:59.468802+0000","last_unstale":"2024-09-11T23:20:59.473417+0000","last_undegraded":"2024-09-11T23:20:59.473417+0000","last_fullsized":"2024-09-11T23:20:59.473417+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:50.317785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456586+0000","last_change":"2024-09-11T23:20:59.468862+0000","last_active":"2024-09-11T23:21:00.456586+0000","last_peered":"2024-09-11T23:21:00.456586+0000","last_clean":"2024-09-11T23:21:00.456586+0000","last_became_active":"2024-09-11T23:20:59.468588+0000","last_became_peered":"2024-09-11T23:20:59.468588+0000","last_unstale":"2024-09-11T23:21:00.456586+0000","last_undegraded":"2024-09-11T23:21:00.456586+0000","last_fullsized":"2024-09-11T23:21:00.456586+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:09.356677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871622+0000","last_change":"2024-09-11T23:20:59.468990+0000","last_active":"2024-09-11T23:21:00.871622+0000","last_peered":"2024-09-11T23:21:00.871622+0000","last_clean":"2024-09-11T23:21:00.871622+0000","last_became_active":"2024-09-11T23:20:59.468736+0000","last_became_peered":"2024-09-11T23:20:59.468736+0000","last_unstale":"2024-09-11T23:21:00.871622+0000","last_undegraded":"2024-09-11T23:21:00.871622+0000","last_fullsized":"2024-09-11T23:21:00.871622+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:08.951140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.480672+0000","last_change":"2024-09-11T23:20:59.477858+0000","last_active":"2024-09-11T23:20:59.480672+0000","last_peered":"2024-09-11T23:20:59.480672+0000","last_clean":"2024-09-11T23:20:59.480672+0000","last_became_active":"2024-09-11T23:20:59.477437+0000","last_became_peered":"2024-09-11T23:20:59.477437+0000","last_unstale":"2024-09-11T23:20:59.480672+0000","last_undegraded":"2024-09-11T23:20:59.480672+0000","last_fullsized":"2024-09-11T23:20:59.480672+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:27.032373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871537+0000","last_change":"2024-09-11T23:20:59.461667+0000","last_active":"2024-09-11T23:21:00.871537+0000","last_peered":"2024-09-11T23:21:00.871537+0000","last_clean":"2024-09-11T23:21:00.871537+0000","last_became_active":"2024-09-11T23:20:59.461421+0000","last_became_peered":"2024-09-11T23:20:59.461421+0000","last_unstale":"2024-09-11T23:21:00.871537+0000","last_undegraded":"2024-09-11T23:21:00.871537+0000","last_fullsized":"2024-09-11T23:21:00.871537+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:45.567676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.479809+0000","last_change":"2024-09-11T23:20:59.476578+0000","last_active":"2024-09-11T23:20:59.479809+0000","last_peered":"2024-09-11T23:20:59.479809+0000","last_clean":"2024-09-11T23:20:59.479809+0000","last_became_active":"2024-09-11T23:20:59.476300+0000","last_became_peered":"2024-09-11T23:20:59.476300+0000","last_unstale":"2024-09-11T23:20:59.479809+0000","last_undegraded":"2024-09-11T23:20:59.479809+0000","last_fullsized":"2024-09-11T23:20:59.479809+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:12.645604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.475062+0000","last_change":"2024-09-11T23:20:59.472368+0000","last_active":"2024-09-11T23:20:59.475062+0000","last_peered":"2024-09-11T23:20:59.475062+0000","last_clean":"2024-09-11T23:20:59.475062+0000","last_became_active":"2024-09-11T23:20:59.472087+0000","last_became_peered":"2024-09-11T23:20:59.472087+0000","last_unstale":"2024-09-11T23:20:59.475062+0000","last_undegraded":"2024-09-11T23:20:59.475062+0000","last_fullsized":"2024-09-11T23:20:59.475062+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:25.693967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456689+0000","last_change":"2024-09-11T23:20:59.472381+0000","last_active":"2024-09-11T23:21:00.456689+0000","last_peered":"2024-09-11T23:21:00.456689+0000","last_clean":"2024-09-11T23:21:00.456689+0000","last_became_active":"2024-09-11T23:20:59.471907+0000","last_became_peered":"2024-09-11T23:20:59.471907+0000","last_unstale":"2024-09-11T23:21:00.456689+0000","last_undegraded":"2024-09-11T23:21:00.456689+0000","last_fullsized":"2024-09-11T23:21:00.456689+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:03.162864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.478427+0000","last_change":"2024-09-11T23:20:59.472931+0000","last_active":"2024-09-11T23:20:59.478427+0000","last_peered":"2024-09-11T23:20:59.478427+0000","last_clean":"2024-09-11T23:20:59.478427+0000","last_became_active":"2024-09-11T23:20:59.472664+0000","last_became_peered":"2024-09-11T23:20:59.472664+0000","last_unstale":"2024-09-11T23:20:59.478427+0000","last_undegraded":"2024-09-11T23:20:59.478427+0000","last_fullsized":"2024-09-11T23:20:59.478427+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:39.771178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.451550+0000","last_change":"2024-09-11T23:20:58.451550+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.451550+0000","last_undegraded":"2024-09-11T23:20:58.451550+0000","last_fullsized":"2024-09-11T23:20:58.451550+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456643+0000","last_change":"2024-09-11T23:20:59.469067+0000","last_active":"2024-09-11T23:21:00.456643+0000","last_peered":"2024-09-11T23:21:00.456643+0000","last_clean":"2024-09-11T23:21:00.456643+0000","last_became_active":"2024-09-11T23:20:59.468802+0000","last_became_peered":"2024-09-11T23:20:59.468802+0000","last_unstale":"2024-09-11T23:21:00.456643+0000","last_undegraded":"2024-09-11T23:21:00.456643+0000","last_fullsized":"2024-09-11T23:21:00.456643+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:34.477242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871779+0000","last_change":"2024-09-11T23:20:59.466832+0000","last_active":"2024-09-11T23:21:00.871779+0000","last_peered":"2024-09-11T23:21:00.871779+0000","last_clean":"2024-09-11T23:21:00.871779+0000","last_became_active":"2024-09-11T23:20:59.466560+0000","last_became_peered":"2024-09-11T23:20:59.466560+0000","last_unstale":"2024-09-11T23:21:00.871779+0000","last_undegraded":"2024-09-11T23:21:00.871779+0000","last_fullsized":"2024-09-11T23:21:00.871779+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:42.410011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.475209+0000","last_change":"2024-09-11T23:20:59.470126+0000","last_active":"2024-09-11T23:20:59.475209+0000","last_peered":"2024-09-11T23:20:59.475209+0000","last_clean":"2024-09-11T23:20:59.475209+0000","last_became_active":"2024-09-11T23:20:59.469730+0000","last_became_peered":"2024-09-11T23:20:59.469730+0000","last_unstale":"2024-09-11T23:20:59.475209+0000","last_undegraded":"2024-09-11T23:20:59.475209+0000","last_fullsized":"2024-09-11T23:20:59.475209+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:39.610047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456362+0000","last_change":"2024-09-11T23:20:59.474680+0000","last_active":"2024-09-11T23:21:00.456362+0000","last_peered":"2024-09-11T23:21:00.456362+0000","last_clean":"2024-09-11T23:21:00.456362+0000","last_became_active":"2024-09-11T23:20:59.472530+0000","last_became_peered":"2024-09-11T23:20:59.472530+0000","last_unstale":"2024-09-11T23:21:00.456362+0000","last_undegraded":"2024-09-11T23:21:00.456362+0000","last_fullsized":"2024-09-11T23:21:00.456362+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:37.774651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.449099+0000","last_change":"2024-09-11T23:20:58.449099+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.449099+0000","last_undegraded":"2024-09-11T23:20:58.449099+0000","last_fullsized":"2024-09-11T23:20:58.449099+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.449131+0000","last_change":"2024-09-11T23:20:58.449131+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.449131+0000","last_undegraded":"2024-09-11T23:20:58.449131+0000","last_fullsized":"2024-09-11T23:20:58.449131+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.467758+0000","last_change":"2024-09-11T23:20:58.461846+0000","last_active":"2024-09-11T23:20:58.467758+0000","last_peered":"2024-09-11T23:20:58.467758+0000","last_clean":"2024-09-11T23:20:58.467758+0000","last_became_active":"2024-09-11T23:20:58.461591+0000","last_became_peered":"2024-09-11T23:20:58.461591+0000","last_unstale":"2024-09-11T23:20:58.467758+0000","last_undegraded":"2024-09-11T23:20:58.467758+0000","last_fullsized":"2024-09-11T23:20:58.467758+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:30.133913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.451217+0000","last_change":"2024-09-11T23:20:58.451217+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.451217+0000","last_undegraded":"2024-09-11T23:20:58.451217+0000","last_fullsized":"2024-09-11T23:20:58.451217+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871666+0000","last_change":"2024-09-11T23:20:58.465371+0000","last_active":"2024-09-11T23:21:00.871666+0000","last_peered":"2024-09-11T23:21:00.871666+0000","last_clean":"2024-09-11T23:21:00.871666+0000","last_became_active":"2024-09-11T23:20:58.465117+0000","last_became_peered":"2024-09-11T23:20:58.465117+0000","last_unstale":"2024-09-11T23:21:00.871666+0000","last_undegraded":"2024-09-11T23:21:00.871666+0000","last_fullsized":"2024-09-11T23:21:00.871666+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:38.868184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.450075+0000","last_change":"2024-09-11T23:20:58.450075+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.450075+0000","last_undegraded":"2024-09-11T23:20:58.450075+0000","last_fullsized":"2024-09-11T23:20:58.450075+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.465326+0000","last_change":"2024-09-11T23:20:58.460984+0000","last_active":"2024-09-11T23:20:58.465326+0000","last_peered":"2024-09-11T23:20:58.465326+0000","last_clean":"2024-09-11T23:20:58.465326+0000","last_became_active":"2024-09-11T23:20:58.460659+0000","last_became_peered":"2024-09-11T23:20:58.460659+0000","last_unstale":"2024-09-11T23:20:58.465326+0000","last_undegraded":"2024-09-11T23:20:58.465326+0000","last_fullsized":"2024-09-11T23:20:58.465326+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:38.922109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.450534+0000","last_change":"2024-09-11T23:20:58.450534+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.450534+0000","last_undegraded":"2024-09-11T23:20:58.450534+0000","last_fullsized":"2024-09-11T23:20:58.450534+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"58'2","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.480470+0000","last_change":"2024-09-11T23:20:58.462668+0000","last_active":"2024-09-11T23:20:59.480470+0000","last_peered":"2024-09-11T23:20:59.480470+0000","last_clean":"2024-09-11T23:20:59.480470+0000","last_became_active":"2024-09-11T23:20:58.462349+0000","last_became_peered":"2024-09-11T23:20:58.462349+0000","last_unstale":"2024-09-11T23:20:59.480470+0000","last_undegraded":"2024-09-11T23:20:59.480470+0000","last_fullsized":"2024-09-11T23:20:59.480470+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:16.896074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871423+0000","last_change":"2024-09-11T23:20:59.461146+0000","last_active":"2024-09-11T23:21:00.871423+0000","last_peered":"2024-09-11T23:21:00.871423+0000","last_clean":"2024-09-11T23:21:00.871423+0000","last_became_active":"2024-09-11T23:20:59.460868+0000","last_became_peered":"2024-09-11T23:20:59.460868+0000","last_unstale":"2024-09-11T23:21:00.871423+0000","last_undegraded":"2024-09-11T23:21:00.871423+0000","last_fullsized":"2024-09-11T23:21:00.871423+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:12.270988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.483394+0000","last_change":"2024-09-11T23:20:58.459200+0000","last_active":"2024-09-11T23:20:59.483394+0000","last_peered":"2024-09-11T23:20:59.483394+0000","last_clean":"2024-09-11T23:20:59.483394+0000","last_became_active":"2024-09-11T23:20:58.458940+0000","last_became_peered":"2024-09-11T23:20:58.458940+0000","last_unstale":"2024-09-11T23:20:59.483394+0000","last_undegraded":"2024-09-11T23:20:59.483394+0000","last_fullsized":"2024-09-11T23:20:59.483394+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:24.686226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871421+0000","last_change":"2024-09-11T23:20:59.471438+0000","last_active":"2024-09-11T23:21:00.871421+0000","last_peered":"2024-09-11T23:21:00.871421+0000","last_clean":"2024-09-11T23:21:00.871421+0000","last_became_active":"2024-09-11T23:20:59.471170+0000","last_became_peered":"2024-09-11T23:20:59.471170+0000","last_unstale":"2024-09-11T23:21:00.871421+0000","last_undegraded":"2024-09-11T23:21:00.871421+0000","last_fullsized":"2024-09-11T23:21:00.871421+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:52.111971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.465963+0000","last_change":"2024-09-11T23:20:58.459414+0000","last_active":"2024-09-11T23:20:58.465963+0000","last_peered":"2024-09-11T23:20:58.465963+0000","last_clean":"2024-09-11T23:20:58.465963+0000","last_became_active":"2024-09-11T23:20:58.459152+0000","last_became_peered":"2024-09-11T23:20:58.459152+0000","last_unstale":"2024-09-11T23:20:58.465963+0000","last_undegraded":"2024-09-11T23:20:58.465963+0000","last_fullsized":"2024-09-11T23:20:58.465963+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:34.167147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.470020+0000","last_change":"2024-09-11T23:20:59.464299+0000","last_active":"2024-09-11T23:20:59.470020+0000","last_peered":"2024-09-11T23:20:59.470020+0000","last_clean":"2024-09-11T23:20:59.470020+0000","last_became_active":"2024-09-11T23:20:59.463578+0000","last_became_peered":"2024-09-11T23:20:59.463578+0000","last_unstale":"2024-09-11T23:20:59.470020+0000","last_undegraded":"2024-09-11T23:20:59.470020+0000","last_fullsized":"2024-09-11T23:20:59.470020+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:37.020538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.458543+0000","last_change":"2024-09-11T23:20:58.462986+0000","last_active":"2024-09-11T23:20:59.458543+0000","last_peered":"2024-09-11T23:20:59.458543+0000","last_clean":"2024-09-11T23:20:59.458543+0000","last_became_active":"2024-09-11T23:20:58.462292+0000","last_became_peered":"2024-09-11T23:20:58.462292+0000","last_unstale":"2024-09-11T23:20:59.458543+0000","last_undegraded":"2024-09-11T23:20:59.458543+0000","last_fullsized":"2024-09-11T23:20:59.458543+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.187950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871431+0000","last_change":"2024-09-11T23:20:59.461080+0000","last_active":"2024-09-11T23:21:00.871431+0000","last_peered":"2024-09-11T23:21:00.871431+0000","last_clean":"2024-09-11T23:21:00.871431+0000","last_became_active":"2024-09-11T23:20:59.460840+0000","last_became_peered":"2024-09-11T23:20:59.460840+0000","last_unstale":"2024-09-11T23:21:00.871431+0000","last_undegraded":"2024-09-11T23:21:00.871431+0000","last_fullsized":"2024-09-11T23:21:00.871431+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:06.473547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.451422+0000","last_change":"2024-09-11T23:20:58.462888+0000","last_active":"2024-09-11T23:20:59.451422+0000","last_peered":"2024-09-11T23:20:59.451422+0000","last_clean":"2024-09-11T23:20:59.451422+0000","last_became_active":"2024-09-11T23:20:58.462609+0000","last_became_peered":"2024-09-11T23:20:58.462609+0000","last_unstale":"2024-09-11T23:20:59.451422+0000","last_undegraded":"2024-09-11T23:20:59.451422+0000","last_fullsized":"2024-09-11T23:20:59.451422+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:29.652502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.466007+0000","last_change":"2024-09-11T23:20:59.458893+0000","last_active":"2024-09-11T23:20:59.466007+0000","last_peered":"2024-09-11T23:20:59.466007+0000","last_clean":"2024-09-11T23:20:59.466007+0000","last_became_active":"2024-09-11T23:20:59.458626+0000","last_became_peered":"2024-09-11T23:20:59.458626+0000","last_unstale":"2024-09-11T23:20:59.466007+0000","last_undegraded":"2024-09-11T23:20:59.466007+0000","last_fullsized":"2024-09-11T23:20:59.466007+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:04.817794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.461256+0000","last_change":"2024-09-11T23:20:58.473089+0000","last_active":"2024-09-11T23:20:59.461256+0000","last_peered":"2024-09-11T23:20:59.461256+0000","last_clean":"2024-09-11T23:20:59.461256+0000","last_became_active":"2024-09-11T23:20:58.472866+0000","last_became_peered":"2024-09-11T23:20:58.472866+0000","last_unstale":"2024-09-11T23:20:59.461256+0000","last_undegraded":"2024-09-11T23:20:59.461256+0000","last_fullsized":"2024-09-11T23:20:59.461256+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:24.239996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.482690+0000","last_change":"2024-09-11T23:20:59.480062+0000","last_active":"2024-09-11T23:20:59.482690+0000","last_peered":"2024-09-11T23:20:59.482690+0000","last_clean":"2024-09-11T23:20:59.482690+0000","last_became_active":"2024-09-11T23:20:59.479528+0000","last_became_peered":"2024-09-11T23:20:59.479528+0000","last_unstale":"2024-09-11T23:20:59.482690+0000","last_undegraded":"2024-09-11T23:20:59.482690+0000","last_fullsized":"2024-09-11T23:20:59.482690+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:17.572628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871771+0000","last_change":"2024-09-11T23:20:58.466599+0000","last_active":"2024-09-11T23:21:00.871771+0000","last_peered":"2024-09-11T23:21:00.871771+0000","last_clean":"2024-09-11T23:21:00.871771+0000","last_became_active":"2024-09-11T23:20:58.466282+0000","last_became_peered":"2024-09-11T23:20:58.466282+0000","last_unstale":"2024-09-11T23:21:00.871771+0000","last_undegraded":"2024-09-11T23:21:00.871771+0000","last_fullsized":"2024-09-11T23:21:00.871771+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:39.888169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.449799+0000","last_change":"2024-09-11T23:20:58.449799+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.449799+0000","last_undegraded":"2024-09-11T23:20:58.449799+0000","last_fullsized":"2024-09-11T23:20:58.449799+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"58'3","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.484705+0000","last_change":"2024-09-11T23:20:58.466818+0000","last_active":"2024-09-11T23:20:59.484705+0000","last_peered":"2024-09-11T23:20:59.484705+0000","last_clean":"2024-09-11T23:20:59.484705+0000","last_became_active":"2024-09-11T23:20:58.466361+0000","last_became_peered":"2024-09-11T23:20:58.466361+0000","last_unstale":"2024-09-11T23:20:59.484705+0000","last_undegraded":"2024-09-11T23:20:59.484705+0000","last_fullsized":"2024-09-11T23:20:59.484705+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:43.819715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.488716+0000","last_change":"2024-09-11T23:20:59.483767+0000","last_active":"2024-09-11T23:20:59.488716+0000","last_peered":"2024-09-11T23:20:59.488716+0000","last_clean":"2024-09-11T23:20:59.488716+0000","last_became_active":"2024-09-11T23:20:59.483431+0000","last_became_peered":"2024-09-11T23:20:59.483431+0000","last_unstale":"2024-09-11T23:20:59.488716+0000","last_undegraded":"2024-09-11T23:20:59.488716+0000","last_fullsized":"2024-09-11T23:20:59.488716+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:29.787221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"58'6","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.488822+0000","last_change":"2024-09-11T23:20:58.456875+0000","last_active":"2024-09-11T23:20:59.488822+0000","last_peered":"2024-09-11T23:20:59.488822+0000","last_clean":"2024-09-11T23:20:59.488822+0000","last_became_active":"2024-09-11T23:20:58.456579+0000","last_became_peered":"2024-09-11T23:20:58.456579+0000","last_unstale":"2024-09-11T23:20:59.488822+0000","last_undegraded":"2024-09-11T23:20:59.488822+0000","last_fullsized":"2024-09-11T23:20:59.488822+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:39.167478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.475829+0000","last_change":"2024-09-11T23:20:59.469201+0000","last_active":"2024-09-11T23:20:59.475829+0000","last_peered":"2024-09-11T23:20:59.475829+0000","last_clean":"2024-09-11T23:20:59.475829+0000","last_became_active":"2024-09-11T23:20:59.468613+0000","last_became_peered":"2024-09-11T23:20:59.468613+0000","last_unstale":"2024-09-11T23:20:59.475829+0000","last_undegraded":"2024-09-11T23:20:59.475829+0000","last_fullsized":"2024-09-11T23:20:59.475829+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:39.610047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871362+0000","last_change":"2024-09-11T23:20:58.467171+0000","last_active":"2024-09-11T23:21:00.871362+0000","last_peered":"2024-09-11T23:21:00.871362+0000","last_clean":"2024-09-11T23:21:00.871362+0000","last_became_active":"2024-09-11T23:20:58.466901+0000","last_became_peered":"2024-09-11T23:20:58.466901+0000","last_unstale":"2024-09-11T23:21:00.871362+0000","last_undegraded":"2024-09-11T23:21:00.871362+0000","last_fullsized":"2024-09-11T23:21:00.871362+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:42.485376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.472676+0000","last_change":"2024-09-11T23:20:59.467990+0000","last_active":"2024-09-11T23:20:59.472676+0000","last_peered":"2024-09-11T23:20:59.472676+0000","last_clean":"2024-09-11T23:20:59.472676+0000","last_became_active":"2024-09-11T23:20:59.467663+0000","last_became_peered":"2024-09-11T23:20:59.467663+0000","last_unstale":"2024-09-11T23:20:59.472676+0000","last_undegraded":"2024-09-11T23:20:59.472676+0000","last_fullsized":"2024-09-11T23:20:59.472676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:31.276490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.451054+0000","last_change":"2024-09-11T23:20:58.463853+0000","last_active":"2024-09-11T23:20:59.451054+0000","last_peered":"2024-09-11T23:20:59.451054+0000","last_clean":"2024-09-11T23:20:59.451054+0000","last_became_active":"2024-09-11T23:20:58.463592+0000","last_became_peered":"2024-09-11T23:20:58.463592+0000","last_unstale":"2024-09-11T23:20:59.451054+0000","last_undegraded":"2024-09-11T23:20:59.451054+0000","last_fullsized":"2024-09-11T23:20:59.451054+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:08.131569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.469850+0000","last_change":"2024-09-11T23:20:59.465985+0000","last_active":"2024-09-11T23:20:59.469850+0000","last_peered":"2024-09-11T23:20:59.469850+0000","last_clean":"2024-09-11T23:20:59.469850+0000","last_became_active":"2024-09-11T23:20:59.465623+0000","last_became_peered":"2024-09-11T23:20:59.465623+0000","last_unstale":"2024-09-11T23:20:59.469850+0000","last_undegraded":"2024-09-11T23:20:59.469850+0000","last_fullsized":"2024-09-11T23:20:59.469850+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:31.141653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.458700+0000","last_change":"2024-09-11T23:20:58.463387+0000","last_active":"2024-09-11T23:20:59.458700+0000","last_peered":"2024-09-11T23:20:59.458700+0000","last_clean":"2024-09-11T23:20:59.458700+0000","last_became_active":"2024-09-11T23:20:58.463106+0000","last_became_peered":"2024-09-11T23:20:58.463106+0000","last_unstale":"2024-09-11T23:20:59.458700+0000","last_undegraded":"2024-09-11T23:20:59.458700+0000","last_fullsized":"2024-09-11T23:20:59.458700+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:18.406488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.479594+0000","last_change":"2024-09-11T23:20:59.476552+0000","last_active":"2024-09-11T23:20:59.479594+0000","last_peered":"2024-09-11T23:20:59.479594+0000","last_clean":"2024-09-11T23:20:59.479594+0000","last_became_active":"2024-09-11T23:20:59.476173+0000","last_became_peered":"2024-09-11T23:20:59.476173+0000","last_unstale":"2024-09-11T23:20:59.479594+0000","last_undegraded":"2024-09-11T23:20:59.479594+0000","last_fullsized":"2024-09-11T23:20:59.479594+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:50.314018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"58'8","reported_seq":20,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.482839+0000","last_change":"2024-09-11T23:20:58.467986+0000","last_active":"2024-09-11T23:20:59.482839+0000","last_peered":"2024-09-11T23:20:59.482839+0000","last_clean":"2024-09-11T23:20:59.482839+0000","last_became_active":"2024-09-11T23:20:58.466944+0000","last_became_peered":"2024-09-11T23:20:58.466944+0000","last_unstale":"2024-09-11T23:20:59.482839+0000","last_undegraded":"2024-09-11T23:20:59.482839+0000","last_fullsized":"2024-09-11T23:20:59.482839+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:06.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.478297+0000","last_change":"2024-09-11T23:20:59.472856+0000","last_active":"2024-09-11T23:20:59.478297+0000","last_peered":"2024-09-11T23:20:59.478297+0000","last_clean":"2024-09-11T23:20:59.478297+0000","last_became_active":"2024-09-11T23:20:59.471121+0000","last_became_peered":"2024-09-11T23:20:59.471121+0000","last_unstale":"2024-09-11T23:20:59.478297+0000","last_undegraded":"2024-09-11T23:20:59.478297+0000","last_fullsized":"2024-09-11T23:20:59.478297+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:34.060404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871796+0000","last_change":"2024-09-11T23:20:58.466456+0000","last_active":"2024-09-11T23:21:00.871796+0000","last_peered":"2024-09-11T23:21:00.871796+0000","last_clean":"2024-09-11T23:21:00.871796+0000","last_became_active":"2024-09-11T23:20:58.466200+0000","last_became_peered":"2024-09-11T23:20:58.466200+0000","last_unstale":"2024-09-11T23:21:00.871796+0000","last_undegraded":"2024-09-11T23:21:00.871796+0000","last_fullsized":"2024-09-11T23:21:00.871796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:23.944565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.474147+0000","last_change":"2024-09-11T23:20:59.466534+0000","last_active":"2024-09-11T23:20:59.474147+0000","last_peered":"2024-09-11T23:20:59.474147+0000","last_clean":"2024-09-11T23:20:59.474147+0000","last_became_active":"2024-09-11T23:20:59.466243+0000","last_became_peered":"2024-09-11T23:20:59.466243+0000","last_unstale":"2024-09-11T23:20:59.474147+0000","last_undegraded":"2024-09-11T23:20:59.474147+0000","last_fullsized":"2024-09-11T23:20:59.474147+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:44.827455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.472249+0000","last_change":"2024-09-11T23:20:58.468458+0000","last_active":"2024-09-11T23:20:58.472249+0000","last_peered":"2024-09-11T23:20:58.472249+0000","last_clean":"2024-09-11T23:20:58.472249+0000","last_became_active":"2024-09-11T23:20:58.468206+0000","last_became_peered":"2024-09-11T23:20:58.468206+0000","last_unstale":"2024-09-11T23:20:58.472249+0000","last_undegraded":"2024-09-11T23:20:58.472249+0000","last_fullsized":"2024-09-11T23:20:58.472249+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:29.469606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871909+0000","last_change":"2024-09-11T23:20:59.462675+0000","last_active":"2024-09-11T23:21:00.871909+0000","last_peered":"2024-09-11T23:21:00.871909+0000","last_clean":"2024-09-11T23:21:00.871909+0000","last_became_active":"2024-09-11T23:20:59.462426+0000","last_became_peered":"2024-09-11T23:20:59.462426+0000","last_unstale":"2024-09-11T23:21:00.871909+0000","last_undegraded":"2024-09-11T23:21:00.871909+0000","last_fullsized":"2024-09-11T23:21:00.871909+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:13.970806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"58'1","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.480288+0000","last_change":"2024-09-11T23:20:58.467884+0000","last_active":"2024-09-11T23:20:59.480288+0000","last_peered":"2024-09-11T23:20:59.480288+0000","last_clean":"2024-09-11T23:20:59.480288+0000","last_became_active":"2024-09-11T23:20:58.467589+0000","last_became_peered":"2024-09-11T23:20:58.467589+0000","last_unstale":"2024-09-11T23:20:59.480288+0000","last_undegraded":"2024-09-11T23:20:59.480288+0000","last_fullsized":"2024-09-11T23:20:59.480288+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:06.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.488729+0000","last_change":"2024-09-11T23:20:59.483962+0000","last_active":"2024-09-11T23:20:59.488729+0000","last_peered":"2024-09-11T23:20:59.488729+0000","last_clean":"2024-09-11T23:20:59.488729+0000","last_became_active":"2024-09-11T23:20:59.483698+0000","last_became_peered":"2024-09-11T23:20:59.483698+0000","last_unstale":"2024-09-11T23:20:59.488729+0000","last_undegraded":"2024-09-11T23:20:59.488729+0000","last_fullsized":"2024-09-11T23:20:59.488729+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:08.772254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.467635+0000","last_change":"2024-09-11T23:20:58.464827+0000","last_active":"2024-09-11T23:20:58.467635+0000","last_peered":"2024-09-11T23:20:58.467635+0000","last_clean":"2024-09-11T23:20:58.467635+0000","last_became_active":"2024-09-11T23:20:58.464593+0000","last_became_peered":"2024-09-11T23:20:58.464593+0000","last_unstale":"2024-09-11T23:20:58.467635+0000","last_undegraded":"2024-09-11T23:20:58.467635+0000","last_fullsized":"2024-09-11T23:20:58.467635+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:20.242907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.478418+0000","last_change":"2024-09-11T23:20:59.468489+0000","last_active":"2024-09-11T23:20:59.478418+0000","last_peered":"2024-09-11T23:20:59.478418+0000","last_clean":"2024-09-11T23:20:59.478418+0000","last_became_active":"2024-09-11T23:20:59.466325+0000","last_became_peered":"2024-09-11T23:20:59.466325+0000","last_unstale":"2024-09-11T23:20:59.478418+0000","last_undegraded":"2024-09-11T23:20:59.478418+0000","last_fullsized":"2024-09-11T23:20:59.478418+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:49.249112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871522+0000","last_change":"2024-09-11T23:20:58.461629+0000","last_active":"2024-09-11T23:21:00.871522+0000","last_peered":"2024-09-11T23:21:00.871522+0000","last_clean":"2024-09-11T23:21:00.871522+0000","last_became_active":"2024-09-11T23:20:58.461361+0000","last_became_peered":"2024-09-11T23:20:58.461361+0000","last_unstale":"2024-09-11T23:21:00.871522+0000","last_undegraded":"2024-09-11T23:21:00.871522+0000","last_fullsized":"2024-09-11T23:21:00.871522+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:39.804195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.448097+0000","last_change":"2024-09-11T23:20:58.448097+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.448097+0000","last_undegraded":"2024-09-11T23:20:58.448097+0000","last_fullsized":"2024-09-11T23:20:58.448097+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.465691+0000","last_change":"2024-09-11T23:20:58.461264+0000","last_active":"2024-09-11T23:20:58.465691+0000","last_peered":"2024-09-11T23:20:58.465691+0000","last_clean":"2024-09-11T23:20:58.465691+0000","last_became_active":"2024-09-11T23:20:58.461014+0000","last_became_peered":"2024-09-11T23:20:58.461014+0000","last_unstale":"2024-09-11T23:20:58.465691+0000","last_undegraded":"2024-09-11T23:20:58.465691+0000","last_fullsized":"2024-09-11T23:20:58.465691+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:41.170235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.450734+0000","last_change":"2024-09-11T23:20:58.450734+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.450734+0000","last_undegraded":"2024-09-11T23:20:58.450734+0000","last_fullsized":"2024-09-11T23:20:58.450734+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.461077+0000","last_change":"2024-09-11T23:20:58.465129+0000","last_active":"2024-09-11T23:20:59.461077+0000","last_peered":"2024-09-11T23:20:59.461077+0000","last_clean":"2024-09-11T23:20:59.461077+0000","last_became_active":"2024-09-11T23:20:58.464847+0000","last_became_peered":"2024-09-11T23:20:58.464847+0000","last_unstale":"2024-09-11T23:20:59.461077+0000","last_undegraded":"2024-09-11T23:20:59.461077+0000","last_fullsized":"2024-09-11T23:20:59.461077+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:58.558566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.476804+0000","last_change":"2024-09-11T23:20:59.470013+0000","last_active":"2024-09-11T23:20:59.476804+0000","last_peered":"2024-09-11T23:20:59.476804+0000","last_clean":"2024-09-11T23:20:59.476804+0000","last_became_active":"2024-09-11T23:20:59.469672+0000","last_became_peered":"2024-09-11T23:20:59.469672+0000","last_unstale":"2024-09-11T23:20:59.476804+0000","last_undegraded":"2024-09-11T23:20:59.476804+0000","last_fullsized":"2024-09-11T23:20:59.476804+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:34.060404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.465616+0000","last_change":"2024-09-11T23:20:58.461093+0000","last_active":"2024-09-11T23:20:58.465616+0000","last_peered":"2024-09-11T23:20:58.465616+0000","last_clean":"2024-09-11T23:20:58.465616+0000","last_became_active":"2024-09-11T23:20:58.460732+0000","last_became_peered":"2024-09-11T23:20:58.460732+0000","last_unstale":"2024-09-11T23:20:58.465616+0000","last_undegraded":"2024-09-11T23:20:58.465616+0000","last_fullsized":"2024-09-11T23:20:58.465616+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:13:21.428952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.474167+0000","last_change":"2024-09-11T23:20:59.467473+0000","last_active":"2024-09-11T23:20:59.474167+0000","last_peered":"2024-09-11T23:20:59.474167+0000","last_clean":"2024-09-11T23:20:59.474167+0000","last_became_active":"2024-09-11T23:20:59.467131+0000","last_became_peered":"2024-09-11T23:20:59.467131+0000","last_unstale":"2024-09-11T23:20:59.474167+0000","last_undegraded":"2024-09-11T23:20:59.474167+0000","last_fullsized":"2024-09-11T23:20:59.474167+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:25.247737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.467582+0000","last_change":"2024-09-11T23:20:58.464274+0000","last_active":"2024-09-11T23:20:58.467582+0000","last_peered":"2024-09-11T23:20:58.467582+0000","last_clean":"2024-09-11T23:20:58.467582+0000","last_became_active":"2024-09-11T23:20:58.462488+0000","last_became_peered":"2024-09-11T23:20:58.462488+0000","last_unstale":"2024-09-11T23:20:58.467582+0000","last_undegraded":"2024-09-11T23:20:58.467582+0000","last_fullsized":"2024-09-11T23:20:58.467582+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:21.671976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.449333+0000","last_change":"2024-09-11T23:20:58.449333+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.449333+0000","last_undegraded":"2024-09-11T23:20:58.449333+0000","last_fullsized":"2024-09-11T23:20:58.449333+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.449844+0000","last_change":"2024-09-11T23:20:58.461597+0000","last_active":"2024-09-11T23:20:59.449844+0000","last_peered":"2024-09-11T23:20:59.449844+0000","last_clean":"2024-09-11T23:20:59.449844+0000","last_became_active":"2024-09-11T23:20:58.460572+0000","last_became_peered":"2024-09-11T23:20:58.460572+0000","last_unstale":"2024-09-11T23:20:59.449844+0000","last_undegraded":"2024-09-11T23:20:59.449844+0000","last_fullsized":"2024-09-11T23:20:59.449844+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:41.170235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.448119+0000","last_change":"2024-09-11T23:20:58.448119+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.448119+0000","last_undegraded":"2024-09-11T23:20:58.448119+0000","last_fullsized":"2024-09-11T23:20:58.448119+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.459519+0000","last_change":"2024-09-11T23:20:58.460325+0000","last_active":"2024-09-11T23:20:59.459519+0000","last_peered":"2024-09-11T23:20:59.459519+0000","last_clean":"2024-09-11T23:20:59.459519+0000","last_became_active":"2024-09-11T23:20:58.459535+0000","last_became_peered":"2024-09-11T23:20:58.459535+0000","last_unstale":"2024-09-11T23:20:59.459519+0000","last_undegraded":"2024-09-11T23:20:59.459519+0000","last_fullsized":"2024-09-11T23:20:59.459519+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:15.242284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871771+0000","last_change":"2024-09-11T23:20:59.467890+0000","last_active":"2024-09-11T23:21:00.871771+0000","last_peered":"2024-09-11T23:21:00.871771+0000","last_clean":"2024-09-11T23:21:00.871771+0000","last_became_active":"2024-09-11T23:20:59.467620+0000","last_became_peered":"2024-09-11T23:20:59.467620+0000","last_unstale":"2024-09-11T23:21:00.871771+0000","last_undegraded":"2024-09-11T23:21:00.871771+0000","last_fullsized":"2024-09-11T23:21:00.871771+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:28.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.465553+0000","last_change":"2024-09-11T23:20:58.461187+0000","last_active":"2024-09-11T23:20:58.465553+0000","last_peered":"2024-09-11T23:20:58.465553+0000","last_clean":"2024-09-11T23:20:58.465553+0000","last_became_active":"2024-09-11T23:20:58.460890+0000","last_became_peered":"2024-09-11T23:20:58.460890+0000","last_unstale":"2024-09-11T23:20:58.465553+0000","last_undegraded":"2024-09-11T23:20:58.465553+0000","last_fullsized":"2024-09-11T23:20:58.465553+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:05.761153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.479500+0000","last_change":"2024-09-11T23:20:59.475905+0000","last_active":"2024-09-11T23:20:59.479500+0000","last_peered":"2024-09-11T23:20:59.479500+0000","last_clean":"2024-09-11T23:20:59.479500+0000","last_became_active":"2024-09-11T23:20:59.475545+0000","last_became_peered":"2024-09-11T23:20:59.475545+0000","last_unstale":"2024-09-11T23:20:59.479500+0000","last_undegraded":"2024-09-11T23:20:59.479500+0000","last_fullsized":"2024-09-11T23:20:59.479500+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:39.771178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.450416+0000","last_change":"2024-09-11T23:20:58.458608+0000","last_active":"2024-09-11T23:20:59.450416+0000","last_peered":"2024-09-11T23:20:59.450416+0000","last_clean":"2024-09-11T23:20:59.450416+0000","last_became_active":"2024-09-11T23:20:58.458251+0000","last_became_peered":"2024-09-11T23:20:58.458251+0000","last_unstale":"2024-09-11T23:20:59.450416+0000","last_undegraded":"2024-09-11T23:20:59.450416+0000","last_fullsized":"2024-09-11T23:20:59.450416+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:04:14.569214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-09-11T23:20:58.450970+0000","last_change":"2024-09-11T23:20:58.450970+0000","last_active":"2024-09-11T23:20:58.435337+0000","last_peered":"2024-09-11T23:20:58.435337+0000","last_clean":"2024-09-11T23:20:58.435337+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:20:58.450970+0000","last_undegraded":"2024-09-11T23:20:58.450970+0000","last_fullsized":"2024-09-11T23:20:58.450970+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T23:20:58.467229+0000","last_change":"2024-09-11T23:20:58.463594+0000","last_active":"2024-09-11T23:20:58.467229+0000","last_peered":"2024-09-11T23:20:58.467229+0000","last_clean":"2024-09-11T23:20:58.467229+0000","last_became_active":"2024-09-11T23:20:58.463332+0000","last_became_peered":"2024-09-11T23:20:58.463332+0000","last_unstale":"2024-09-11T23:20:58.467229+0000","last_undegraded":"2024-09-11T23:20:58.467229+0000","last_fullsized":"2024-09-11T23:20:58.467229+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:47.949664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871544+0000","last_change":"2024-09-11T23:20:59.460002+0000","last_active":"2024-09-11T23:21:00.871544+0000","last_peered":"2024-09-11T23:21:00.871544+0000","last_clean":"2024-09-11T23:21:00.871544+0000","last_became_active":"2024-09-11T23:20:59.459757+0000","last_became_peered":"2024-09-11T23:20:59.459757+0000","last_unstale":"2024-09-11T23:21:00.871544+0000","last_undegraded":"2024-09-11T23:21:00.871544+0000","last_fullsized":"2024-09-11T23:21:00.871544+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:39.798888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871522+0000","last_change":"2024-09-11T23:20:58.467356+0000","last_active":"2024-09-11T23:21:00.871522+0000","last_peered":"2024-09-11T23:21:00.871522+0000","last_clean":"2024-09-11T23:21:00.871522+0000","last_became_active":"2024-09-11T23:20:58.465829+0000","last_became_peered":"2024-09-11T23:20:58.465829+0000","last_unstale":"2024-09-11T23:21:00.871522+0000","last_undegraded":"2024-09-11T23:21:00.871522+0000","last_fullsized":"2024-09-11T23:21:00.871522+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:06.639194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871420+0000","last_change":"2024-09-11T23:20:59.474473+0000","last_active":"2024-09-11T23:21:00.871420+0000","last_peered":"2024-09-11T23:21:00.871420+0000","last_clean":"2024-09-11T23:21:00.871420+0000","last_became_active":"2024-09-11T23:20:59.474176+0000","last_became_peered":"2024-09-11T23:20:59.474176+0000","last_unstale":"2024-09-11T23:21:00.871420+0000","last_undegraded":"2024-09-11T23:21:00.871420+0000","last_fullsized":"2024-09-11T23:21:00.871420+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:03.448755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.450156+0000","last_change":"2024-09-11T23:20:58.465838+0000","last_active":"2024-09-11T23:20:59.450156+0000","last_peered":"2024-09-11T23:20:59.450156+0000","last_clean":"2024-09-11T23:20:59.450156+0000","last_became_active":"2024-09-11T23:20:58.464372+0000","last_became_peered":"2024-09-11T23:20:58.464372+0000","last_unstale":"2024-09-11T23:20:59.450156+0000","last_undegraded":"2024-09-11T23:20:59.450156+0000","last_fullsized":"2024-09-11T23:20:59.450156+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:47.949664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":236,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-11T23:20:59.457932+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:20:59.457932+0000","last_peered":"2024-09-11T23:20:59.457932+0000","last_clean":"2024-09-11T23:20:59.457932+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:20:59.457932+0000","last_undegraded":"2024-09-11T23:20:59.457932+0000","last_fullsized":"2024-09-11T23:20:59.457932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476779,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28288,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343552,"statfs":{"total":96636764160,"available":96607797248,"internally_reserved":0,"allocated":1286144,"data_stored":873616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":671744,"data_stored":276313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476777,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":692224,"data_stored":283740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476777,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":696320,"data_stored":284700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31832,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":659456,"data_stored":270046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509481,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1265664,"data_stored":866681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":704512,"data_stored":289444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":704512,"data_stored":289444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:21:04.484 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3a is not active+clean 2024-09-11T23:21:04.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:20:58.449691+0000', 'last_change': '2024-09-11T23:20:58.449691+0000', 'last_active': '2024-09-11T23:20:58.435337+0000', 'last_peered': '2024-09-11T23:20:58.435337+0000', 'last_clean': '2024-09-11T23:20:58.435337+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:20:58.449691+0000', 'last_undegraded': '2024-09-11T23:20:58.449691+0000', 'last_fullsized': '2024-09-11T23:20:58.449691+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_clean_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:21:04.485 INFO:tasks.ceph.ceph_manager.ceph:PG 9.36 is not active+clean 2024-09-11T23:21:04.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:20:58.450117+0000', 'last_change': '2024-09-11T23:20:58.450117+0000', 'last_active': '2024-09-11T23:20:58.435337+0000', 'last_peered': '2024-09-11T23:20:58.435337+0000', 'last_clean': '2024-09-11T23:20:58.435337+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:20:58.450117+0000', 'last_undegraded': '2024-09-11T23:20:58.450117+0000', 'last_fullsized': '2024-09-11T23:20:58.450117+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_clean_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:21:04.485 INFO:tasks.ceph.ceph_manager.ceph:PG 9.35 is not active+clean 2024-09-11T23:21:04.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:20:58.450382+0000', 'last_change': '2024-09-11T23:20:58.450382+0000', 'last_active': '2024-09-11T23:20:58.435337+0000', 'last_peered': '2024-09-11T23:20:58.435337+0000', 'last_clean': '2024-09-11T23:20:58.435337+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:20:58.450382+0000', 'last_undegraded': '2024-09-11T23:20:58.450382+0000', 'last_fullsized': '2024-09-11T23:20:58.450382+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_clean_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:21:04.485 INFO:tasks.ceph.ceph_manager.ceph:PG 9.30 is not active+clean 2024-09-11T23:21:04.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:20:58.449499+0000', 'last_change': '2024-09-11T23:20:58.449499+0000', 'last_active': '2024-09-11T23:20:58.435337+0000', 'last_peered': '2024-09-11T23:20:58.435337+0000', 'last_clean': '2024-09-11T23:20:58.435337+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:20:58.449499+0000', 'last_undegraded': '2024-09-11T23:20:58.449499+0000', 'last_fullsized': '2024-09-11T23:20:58.449499+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_clean_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:21:04.485 INFO:tasks.ceph.ceph_manager.ceph:PG 9.25 is not active+clean 2024-09-11T23:21:04.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:20:58.451550+0000', 'last_change': '2024-09-11T23:20:58.451550+0000', 'last_active': '2024-09-11T23:20:58.435337+0000', 'last_peered': '2024-09-11T23:20:58.435337+0000', 'last_clean': '2024-09-11T23:20:58.435337+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:20:58.451550+0000', 'last_undegraded': '2024-09-11T23:20:58.451550+0000', 'last_fullsized': '2024-09-11T23:20:58.451550+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_clean_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:21:04.485 INFO:tasks.ceph.ceph_manager.ceph:PG 9.20 is not active+clean 2024-09-11T23:21:04.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:20:58.449099+0000', 'last_change': '2024-09-11T23:20:58.449099+0000', 'last_active': '2024-09-11T23:20:58.435337+0000', 'last_peered': '2024-09-11T23:20:58.435337+0000', 'last_clean': '2024-09-11T23:20:58.435337+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:20:58.449099+0000', 'last_undegraded': '2024-09-11T23:20:58.449099+0000', 'last_fullsized': '2024-09-11T23:20:58.449099+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_clean_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:21:04.486 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1e is not active+clean 2024-09-11T23:21:04.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:20:58.449131+0000', 'last_change': '2024-09-11T23:20:58.449131+0000', 'last_active': '2024-09-11T23:20:58.435337+0000', 'last_peered': '2024-09-11T23:20:58.435337+0000', 'last_clean': '2024-09-11T23:20:58.435337+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:20:58.449131+0000', 'last_undegraded': '2024-09-11T23:20:58.449131+0000', 'last_fullsized': '2024-09-11T23:20:58.449131+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_clean_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:21:04.486 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1f is not active+clean 2024-09-11T23:21:04.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:20:58.451217+0000', 'last_change': '2024-09-11T23:20:58.451217+0000', 'last_active': '2024-09-11T23:20:58.435337+0000', 'last_peered': '2024-09-11T23:20:58.435337+0000', 'last_clean': '2024-09-11T23:20:58.435337+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:20:58.451217+0000', 'last_undegraded': '2024-09-11T23:20:58.451217+0000', 'last_fullsized': '2024-09-11T23:20:58.451217+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_clean_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:21:04.486 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1c is not active+clean 2024-09-11T23:21:04.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:20:58.450075+0000', 'last_change': '2024-09-11T23:20:58.450075+0000', 'last_active': '2024-09-11T23:20:58.435337+0000', 'last_peered': '2024-09-11T23:20:58.435337+0000', 'last_clean': '2024-09-11T23:20:58.435337+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:20:58.450075+0000', 'last_undegraded': '2024-09-11T23:20:58.450075+0000', 'last_fullsized': '2024-09-11T23:20:58.450075+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_clean_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:21:04.486 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1d is not active+clean 2024-09-11T23:21:04.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:20:58.450534+0000', 'last_change': '2024-09-11T23:20:58.450534+0000', 'last_active': '2024-09-11T23:20:58.435337+0000', 'last_peered': '2024-09-11T23:20:58.435337+0000', 'last_clean': '2024-09-11T23:20:58.435337+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:20:58.450534+0000', 'last_undegraded': '2024-09-11T23:20:58.450534+0000', 'last_fullsized': '2024-09-11T23:20:58.450534+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_clean_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:21:04.486 INFO:tasks.ceph.ceph_manager.ceph:PG 9.14 is not active+clean 2024-09-11T23:21:04.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:20:58.449799+0000', 'last_change': '2024-09-11T23:20:58.449799+0000', 'last_active': '2024-09-11T23:20:58.435337+0000', 'last_peered': '2024-09-11T23:20:58.435337+0000', 'last_clean': '2024-09-11T23:20:58.435337+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:20:58.449799+0000', 'last_undegraded': '2024-09-11T23:20:58.449799+0000', 'last_fullsized': '2024-09-11T23:20:58.449799+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_clean_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:21:04.487 INFO:tasks.ceph.ceph_manager.ceph:PG 9.b is not active+clean 2024-09-11T23:21:04.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:20:58.448097+0000', 'last_change': '2024-09-11T23:20:58.448097+0000', 'last_active': '2024-09-11T23:20:58.435337+0000', 'last_peered': '2024-09-11T23:20:58.435337+0000', 'last_clean': '2024-09-11T23:20:58.435337+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:20:58.448097+0000', 'last_undegraded': '2024-09-11T23:20:58.448097+0000', 'last_fullsized': '2024-09-11T23:20:58.448097+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_clean_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:21:04.487 INFO:tasks.ceph.ceph_manager.ceph:PG 9.9 is not active+clean 2024-09-11T23:21:04.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:20:58.450734+0000', 'last_change': '2024-09-11T23:20:58.450734+0000', 'last_active': '2024-09-11T23:20:58.435337+0000', 'last_peered': '2024-09-11T23:20:58.435337+0000', 'last_clean': '2024-09-11T23:20:58.435337+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:20:58.450734+0000', 'last_undegraded': '2024-09-11T23:20:58.450734+0000', 'last_fullsized': '2024-09-11T23:20:58.450734+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_clean_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:21:04.487 INFO:tasks.ceph.ceph_manager.ceph:PG 9.4 is not active+clean 2024-09-11T23:21:04.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:20:58.449333+0000', 'last_change': '2024-09-11T23:20:58.449333+0000', 'last_active': '2024-09-11T23:20:58.435337+0000', 'last_peered': '2024-09-11T23:20:58.435337+0000', 'last_clean': '2024-09-11T23:20:58.435337+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:20:58.449333+0000', 'last_undegraded': '2024-09-11T23:20:58.449333+0000', 'last_fullsized': '2024-09-11T23:20:58.449333+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_clean_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:21:04.487 INFO:tasks.ceph.ceph_manager.ceph:PG 9.5 is not active+clean 2024-09-11T23:21:04.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:20:58.448119+0000', 'last_change': '2024-09-11T23:20:58.448119+0000', 'last_active': '2024-09-11T23:20:58.435337+0000', 'last_peered': '2024-09-11T23:20:58.435337+0000', 'last_clean': '2024-09-11T23:20:58.435337+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:20:58.448119+0000', 'last_undegraded': '2024-09-11T23:20:58.448119+0000', 'last_fullsized': '2024-09-11T23:20:58.448119+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_clean_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:21:04.487 INFO:tasks.ceph.ceph_manager.ceph:PG 9.0 is not active+clean 2024-09-11T23:21:04.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:20:58.450970+0000', 'last_change': '2024-09-11T23:20:58.450970+0000', 'last_active': '2024-09-11T23:20:58.435337+0000', 'last_peered': '2024-09-11T23:20:58.435337+0000', 'last_clean': '2024-09-11T23:20:58.435337+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:20:58.450970+0000', 'last_undegraded': '2024-09-11T23:20:58.450970+0000', 'last_fullsized': '2024-09-11T23:20:58.450970+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'last_clean_scrub_stamp': '2024-09-11T23:20:58.435337+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:21:04.488 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T23:21:04.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.672+0000 7f127e800640 1 Processor -- start 2024-09-11T23:21:04.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.672+0000 7f127e800640 1 -- start start 2024-09-11T23:21:04.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.673+0000 7f127e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f127815c180 0x7f12780cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:04.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.673+0000 7f127e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1278073120 0x7f1278073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:04.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.673+0000 7f127e800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12780ce740 con 0x7f12780ce230 2024-09-11T23:21:04.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.673+0000 7f127e800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1278072640 con 0x7f127815c180 2024-09-11T23:21:04.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.673+0000 7f127e800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1278072920 con 0x7f1278073120 2024-09-11T23:21:04.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.673+0000 7f1277400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f127815c180 0x7f12780cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:04.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.674+0000 7f1277400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f127815c180 0x7f12780cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38326/0 (socket says 172.21.15.144:38326) 2024-09-11T23:21:04.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.674+0000 7f1277400640 1 -- 172.21.15.144:0/2041450800 learned_addr learned my addr 172.21.15.144:0/2041450800 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:04.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.674+0000 7f1277e00640 1 --2- 172.21.15.144:0/2041450800 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1278073120 0x7f1278073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:04.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.674+0000 7f1277400640 1 -- 172.21.15.144:0/2041450800 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1278073120 msgr2=0x7f1278073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:04.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.674+0000 7f1277400640 1 --2- 172.21.15.144:0/2041450800 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1278073120 0x7f1278073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.674+0000 7f1277400640 1 -- 172.21.15.144:0/2041450800 >> v1:172.21.15.144:6789/0 conn(0x7f12780ce230 legacy=0x7f12780cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:04.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.674+0000 7f1277400640 1 -- 172.21.15.144:0/2041450800 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1278072c00 con 0x7f127815c180 2024-09-11T23:21:04.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.675+0000 7f1277400640 1 --2- 172.21.15.144:0/2041450800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f127815c180 0x7f12780cdcf0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1268009870 tx=0x7f126802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6456e90f7a63fc26 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:04.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.675+0000 7f1276000640 1 -- 172.21.15.144:0/2041450800 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1268037070 con 0x7f127815c180 2024-09-11T23:21:04.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.675+0000 7f1276000640 1 -- 172.21.15.144:0/2041450800 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1268032440 con 0x7f127815c180 2024-09-11T23:21:04.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.675+0000 7f1276000640 1 -- 172.21.15.144:0/2041450800 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1268032810 con 0x7f127815c180 2024-09-11T23:21:04.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.676+0000 7f127e800640 1 -- 172.21.15.144:0/2041450800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f127815c180 msgr2=0x7f12780cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:04.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.676+0000 7f127e800640 1 --2- 172.21.15.144:0/2041450800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f127815c180 0x7f12780cdcf0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1268009870 tx=0x7f126802a1c0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.676+0000 7f127e800640 1 -- 172.21.15.144:0/2041450800 shutdown_connections 2024-09-11T23:21:04.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.676+0000 7f127e800640 1 --2- 172.21.15.144:0/2041450800 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1278073120 0x7f1278073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.676+0000 7f127e800640 1 --2- 172.21.15.144:0/2041450800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f127815c180 0x7f12780cdcf0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.676+0000 7f127e800640 1 -- 172.21.15.144:0/2041450800 >> 172.21.15.144:0/2041450800 conn(0x7f1278062cc0 msgr2=0x7f127806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:04.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.676+0000 7f127e800640 1 -- 172.21.15.144:0/2041450800 shutdown_connections 2024-09-11T23:21:04.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.676+0000 7f127e800640 1 -- 172.21.15.144:0/2041450800 wait complete. 2024-09-11T23:21:04.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.677+0000 7f127e800640 1 Processor -- start 2024-09-11T23:21:04.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.678+0000 7f127e800640 1 -- start start 2024-09-11T23:21:04.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.678+0000 7f127e800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1278073120 0x7f12781f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:04.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.678+0000 7f127e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12780ce230 0x7f12781507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:04.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.678+0000 7f127e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f127815c180 0x7f1278151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:04.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.678+0000 7f127e800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f12780cf780 con 0x7f12780ce230 2024-09-11T23:21:04.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.678+0000 7f127e800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f12780722f0 con 0x7f1278073120 2024-09-11T23:21:04.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.678+0000 7f127e800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f127815c560 con 0x7f127815c180 2024-09-11T23:21:04.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.679+0000 7f1276a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12780ce230 0x7f12781507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:04.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.679+0000 7f1276a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12780ce230 0x7f12781507a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38336/0 (socket says 172.21.15.144:38336) 2024-09-11T23:21:04.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.679+0000 7f1276a00640 1 -- 172.21.15.144:0/80217598 learned_addr learned my addr 172.21.15.144:0/80217598 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:04.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.679+0000 7f1277400640 1 --2- 172.21.15.144:0/80217598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1278073120 0x7f12781f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:04.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.679+0000 7f1277e00640 1 --2- 172.21.15.144:0/80217598 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f127815c180 0x7f1278151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:04.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.679+0000 7f1276a00640 1 -- 172.21.15.144:0/80217598 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f127815c180 msgr2=0x7f1278151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:04.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.679+0000 7f1276a00640 1 --2- 172.21.15.144:0/80217598 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f127815c180 0x7f1278151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.679+0000 7f1276a00640 1 -- 172.21.15.144:0/80217598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1278073120 msgr2=0x7f12781f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:04.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.679+0000 7f1276a00640 1 --2- 172.21.15.144:0/80217598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1278073120 0x7f12781f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.679+0000 7f1276a00640 1 -- 172.21.15.144:0/80217598 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127815d7a0 con 0x7f12780ce230 2024-09-11T23:21:04.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.679+0000 7f1276a00640 1 --2- 172.21.15.144:0/80217598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12780ce230 0x7f12781507a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f126400c370 tx=0x7f126400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:04.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.680+0000 7f126f400640 1 -- 172.21.15.144:0/80217598 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1264017070 con 0x7f12780ce230 2024-09-11T23:21:04.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.680+0000 7f126f400640 1 -- 172.21.15.144:0/80217598 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12640052d0 con 0x7f12780ce230 2024-09-11T23:21:04.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.680+0000 7f126f400640 1 -- 172.21.15.144:0/80217598 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1264003850 con 0x7f12780ce230 2024-09-11T23:21:04.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.680+0000 7f127e800640 1 -- 172.21.15.144:0/80217598 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f127815da80 con 0x7f12780ce230 2024-09-11T23:21:04.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.680+0000 7f127e800640 1 -- 172.21.15.144:0/80217598 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f127815e040 con 0x7f12780ce230 2024-09-11T23:21:04.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.681+0000 7f127e800640 1 -- 172.21.15.144:0/80217598 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12780cdcf0 con 0x7f12780ce230 2024-09-11T23:21:04.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.682+0000 7f126f400640 1 -- 172.21.15.144:0/80217598 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f126401a070 con 0x7f12780ce230 2024-09-11T23:21:04.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.683+0000 7f126f400640 1 --2- 172.21.15.144:0/80217598 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f125806bfe0 0x7f125806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:04.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.683+0000 7f126f400640 1 -- 172.21.15.144:0/80217598 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f126408a490 con 0x7f12780ce230 2024-09-11T23:21:04.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.683+0000 7f1277400640 1 --2- 172.21.15.144:0/80217598 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f125806bfe0 0x7f125806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:04.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.684+0000 7f1277400640 1 --2- 172.21.15.144:0/80217598 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f125806bfe0 0x7f125806e4a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1268034000 tx=0x7f126802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:04.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.687+0000 7f126f400640 1 -- 172.21.15.144:0/80217598 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1264058bc0 con 0x7f12780ce230 2024-09-11T23:21:04.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.925+0000 7f127e800640 1 -- 172.21.15.144:0/80217598 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f12780cd7f0 con 0x7f12780ce230 2024-09-11T23:21:04.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.925+0000 7f126f400640 1 -- 172.21.15.144:0/80217598 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1142 (secure 0 0 0) 0x7f12640584c0 con 0x7f12780ce230 2024-09-11T23:21:04.926 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:04.926 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":211,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":59,"num_osds":8,"num_up_osds":8,"osd_up_since":1726096669,"num_in_osds":8,"osd_in_since":1726096657,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":81},{"state_name":"creating+peering","count":16}],"num_pgs":97,"num_pools":3,"num_objects":18,"data_bytes":592196,"bytes_used":236642304,"bytes_avail":772857470976,"bytes_total":773094113280,"inactive_pgs_ratio":0.16494844853878021,"write_bytes_sec":2307,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":35,"btime":"2024-09-11T23:21:02:480138+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5667}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-09-11T23:20:29.197357+0000","services":{}},"progress_events":{}} 2024-09-11T23:21:04.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.927+0000 7f127e800640 1 -- 172.21.15.144:0/80217598 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f125806bfe0 msgr2=0x7f125806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:04.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.927+0000 7f127e800640 1 --2- 172.21.15.144:0/80217598 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f125806bfe0 0x7f125806e4a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1268034000 tx=0x7f126802e000 comp rx=0 tx=0).stop 2024-09-11T23:21:04.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.928+0000 7f127e800640 1 -- 172.21.15.144:0/80217598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12780ce230 msgr2=0x7f12781507a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:04.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.928+0000 7f127e800640 1 --2- 172.21.15.144:0/80217598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12780ce230 0x7f12781507a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f126400c370 tx=0x7f126400c830 comp rx=0 tx=0).stop 2024-09-11T23:21:04.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.928+0000 7f127e800640 1 -- 172.21.15.144:0/80217598 shutdown_connections 2024-09-11T23:21:04.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.928+0000 7f127e800640 1 --2- 172.21.15.144:0/80217598 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f125806bfe0 0x7f125806e4a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.928+0000 7f127e800640 1 --2- 172.21.15.144:0/80217598 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f127815c180 0x7f1278151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.928+0000 7f127e800640 1 --2- 172.21.15.144:0/80217598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12780ce230 0x7f12781507a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.928+0000 7f127e800640 1 --2- 172.21.15.144:0/80217598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1278073120 0x7f12781f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:04.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.928+0000 7f127e800640 1 -- 172.21.15.144:0/80217598 >> 172.21.15.144:0/80217598 conn(0x7f1278062cc0 msgr2=0x7f12780cf900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:04.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.928+0000 7f127e800640 1 -- 172.21.15.144:0/80217598 shutdown_connections 2024-09-11T23:21:04.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:04.928+0000 7f127e800640 1 -- 172.21.15.144:0/80217598 wait complete. 2024-09-11T23:21:04.944 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T23:21:04.944 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:21:05.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.097+0000 7fbb3b600640 1 Processor -- start 2024-09-11T23:21:05.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.098+0000 7fbb3b600640 1 -- start start 2024-09-11T23:21:05.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.099+0000 7fbb3b600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbb340cf070 0x7fbb340cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:05.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.099+0000 7fbb3b600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbb34073120 0x7fbb34073560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:05.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.099+0000 7fbb3b600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb340ce740 con 0x7fbb3415c180 2024-09-11T23:21:05.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.099+0000 7fbb3b600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fbb34072640 con 0x7fbb34073120 2024-09-11T23:21:05.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.099+0000 7fbb3b600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fbb34072920 con 0x7fbb340cf070 2024-09-11T23:21:05.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.099+0000 7fbb39600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbb34073120 0x7fbb34073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:05.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.099+0000 7fbb39600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbb34073120 0x7fbb34073560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38342/0 (socket says 172.21.15.144:38342) 2024-09-11T23:21:05.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.099+0000 7fbb39600640 1 -- 172.21.15.144:0/3270124424 learned_addr learned my addr 172.21.15.144:0/3270124424 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:05.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.099+0000 7fbb2be00640 1 --2- 172.21.15.144:0/3270124424 >> v2:172.21.15.165:3300/0 conn(0x7fbb340cf070 0x7fbb340cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:05.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.100+0000 7fbb39600640 1 -- 172.21.15.144:0/3270124424 >> v2:172.21.15.165:3300/0 conn(0x7fbb340cf070 msgr2=0x7fbb340cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:05.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.100+0000 7fbb39600640 1 --2- 172.21.15.144:0/3270124424 >> v2:172.21.15.165:3300/0 conn(0x7fbb340cf070 0x7fbb340cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:05.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.100+0000 7fbb39600640 1 -- 172.21.15.144:0/3270124424 >> v1:172.21.15.165:6789/0 conn(0x7fbb3415c180 legacy=0x7fbb340cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:05.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.100+0000 7fbb39600640 1 -- 172.21.15.144:0/3270124424 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb34072c00 con 0x7fbb34073120 2024-09-11T23:21:05.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.100+0000 7fbb39600640 1 --2- 172.21.15.144:0/3270124424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb34073120 0x7fbb34073560 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbb3406f430 tx=0x7fbb2c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4892e47c259b3b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:05.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.101+0000 7fbb33e00640 1 -- 172.21.15.144:0/3270124424 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c036070 con 0x7fbb34073120 2024-09-11T23:21:05.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.101+0000 7fbb33e00640 1 -- 172.21.15.144:0/3270124424 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb2c031600 con 0x7fbb34073120 2024-09-11T23:21:05.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.101+0000 7fbb33e00640 1 -- 172.21.15.144:0/3270124424 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c0319d0 con 0x7fbb34073120 2024-09-11T23:21:05.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.101+0000 7fbb3b600640 1 -- 172.21.15.144:0/3270124424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb34073120 msgr2=0x7fbb34073560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:05.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.101+0000 7fbb3b600640 1 --2- 172.21.15.144:0/3270124424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb34073120 0x7fbb34073560 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbb3406f430 tx=0x7fbb2c02a6a0 comp rx=0 tx=0).stop 2024-09-11T23:21:05.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.101+0000 7fbb3b600640 1 -- 172.21.15.144:0/3270124424 shutdown_connections 2024-09-11T23:21:05.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.101+0000 7fbb3b600640 1 --2- 172.21.15.144:0/3270124424 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb34073120 0x7fbb34073560 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:05.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.101+0000 7fbb3b600640 1 --2- 172.21.15.144:0/3270124424 >> v2:172.21.15.165:3300/0 conn(0x7fbb340cf070 0x7fbb340cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:05.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.101+0000 7fbb3b600640 1 -- 172.21.15.144:0/3270124424 >> 172.21.15.144:0/3270124424 conn(0x7fbb34062cc0 msgr2=0x7fbb3406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:05.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.101+0000 7fbb3b600640 1 -- 172.21.15.144:0/3270124424 shutdown_connections 2024-09-11T23:21:05.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.101+0000 7fbb3b600640 1 -- 172.21.15.144:0/3270124424 wait complete. 2024-09-11T23:21:05.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.103+0000 7fbb3b600640 1 Processor -- start 2024-09-11T23:21:05.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.103+0000 7fbb3b600640 1 -- start start 2024-09-11T23:21:05.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.104+0000 7fbb3b600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb34073120 0x7fbb34153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:05.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.104+0000 7fbb3b600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb340cf070 0x7fbb3415e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:05.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.104+0000 7fbb3b600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb3415c180 0x7fbb3415ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:05.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.104+0000 7fbb3b600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbb340722f0 con 0x7fbb3415c180 2024-09-11T23:21:05.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.104+0000 7fbb3b600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbb340ced00 con 0x7fbb34073120 2024-09-11T23:21:05.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.104+0000 7fbb3b600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbb3415c560 con 0x7fbb340cf070 2024-09-11T23:21:05.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.104+0000 7fbb39600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb3415c180 0x7fbb3415ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:05.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.104+0000 7fbb39600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb3415c180 0x7fbb3415ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38356/0 (socket says 172.21.15.144:38356) 2024-09-11T23:21:05.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.104+0000 7fbb39600640 1 -- 172.21.15.144:0/1032371670 learned_addr learned my addr 172.21.15.144:0/1032371670 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:05.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.104+0000 7fbb2be00640 1 --2- 172.21.15.144:0/1032371670 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb340cf070 0x7fbb3415e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:05.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.104+0000 7fbb38c00640 1 --2- 172.21.15.144:0/1032371670 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb34073120 0x7fbb34153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:05.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.105+0000 7fbb39600640 1 -- 172.21.15.144:0/1032371670 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb340cf070 msgr2=0x7fbb3415e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:05.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.105+0000 7fbb39600640 1 --2- 172.21.15.144:0/1032371670 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb340cf070 0x7fbb3415e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:05.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.105+0000 7fbb39600640 1 -- 172.21.15.144:0/1032371670 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb34073120 msgr2=0x7fbb34153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:05.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.105+0000 7fbb39600640 1 --2- 172.21.15.144:0/1032371670 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb34073120 0x7fbb34153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:05.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.105+0000 7fbb39600640 1 -- 172.21.15.144:0/1032371670 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3415d3b0 con 0x7fbb3415c180 2024-09-11T23:21:05.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.105+0000 7fbb39600640 1 --2- 172.21.15.144:0/1032371670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb3415c180 0x7fbb3415ef70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c02ac90 tx=0x7fbb2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:05.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.105+0000 7fbb31600640 1 -- 172.21.15.144:0/1032371670 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c03f020 con 0x7fbb3415c180 2024-09-11T23:21:05.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.105+0000 7fbb31600640 1 -- 172.21.15.144:0/1032371670 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb2c037040 con 0x7fbb3415c180 2024-09-11T23:21:05.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.105+0000 7fbb31600640 1 -- 172.21.15.144:0/1032371670 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c036070 con 0x7fbb3415c180 2024-09-11T23:21:05.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.105+0000 7fbb3b600640 1 -- 172.21.15.144:0/1032371670 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3415d690 con 0x7fbb3415c180 2024-09-11T23:21:05.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.106+0000 7fbb3b600640 1 -- 172.21.15.144:0/1032371670 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb3415dc50 con 0x7fbb3415c180 2024-09-11T23:21:05.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.107+0000 7fbb3b600640 1 -- 172.21.15.144:0/1032371670 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb340cf4e0 con 0x7fbb3415c180 2024-09-11T23:21:05.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.107+0000 7fbb31600640 1 -- 172.21.15.144:0/1032371670 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7fbb2c042020 con 0x7fbb3415c180 2024-09-11T23:21:05.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.108+0000 7fbb31600640 1 --2- 172.21.15.144:0/1032371670 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbb1006bfe0 0x7fbb1006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:05.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.108+0000 7fbb31600640 1 -- 172.21.15.144:0/1032371670 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fbb2c0ab5e0 con 0x7fbb3415c180 2024-09-11T23:21:05.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.109+0000 7fbb38c00640 1 --2- 172.21.15.144:0/1032371670 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbb1006bfe0 0x7fbb1006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:05.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.109+0000 7fbb38c00640 1 --2- 172.21.15.144:0/1032371670 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbb1006bfe0 0x7fbb1006e4a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbb340aa5f0 tx=0x7fbb24009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:05.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.112+0000 7fbb31600640 1 -- 172.21.15.144:0/1032371670 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb2c049030 con 0x7fbb3415c180 2024-09-11T23:21:05.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.286+0000 7fbb3b600640 1 -- 172.21.15.144:0/1032371670 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbb340d0540 con 0x7fbb1006bfe0 2024-09-11T23:21:05.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.292+0000 7fbb31600640 1 -- 172.21.15.144:0/1032371670 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251955 (secure 0 0 0) 0x7fbb340d0540 con 0x7fbb1006bfe0 2024-09-11T23:21:05.296 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:05.297 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:21:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.296+0000 7fbb3b600640 1 -- 172.21.15.144:0/1032371670 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbb1006bfe0 msgr2=0x7fbb1006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.296+0000 7fbb3b600640 1 --2- 172.21.15.144:0/1032371670 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbb1006bfe0 0x7fbb1006e4a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbb340aa5f0 tx=0x7fbb24009040 comp rx=0 tx=0).stop 2024-09-11T23:21:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.296+0000 7fbb3b600640 1 -- 172.21.15.144:0/1032371670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb3415c180 msgr2=0x7fbb3415ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.296+0000 7fbb3b600640 1 --2- 172.21.15.144:0/1032371670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb3415c180 0x7fbb3415ef70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c02ac90 tx=0x7fbb2c004a40 comp rx=0 tx=0).stop 2024-09-11T23:21:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.296+0000 7fbb3b600640 1 -- 172.21.15.144:0/1032371670 shutdown_connections 2024-09-11T23:21:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.296+0000 7fbb3b600640 1 --2- 172.21.15.144:0/1032371670 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbb1006bfe0 0x7fbb1006e4a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.296+0000 7fbb3b600640 1 --2- 172.21.15.144:0/1032371670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb3415c180 0x7fbb3415ef70 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.296+0000 7fbb3b600640 1 --2- 172.21.15.144:0/1032371670 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb340cf070 0x7fbb3415e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:05.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.296+0000 7fbb3b600640 1 --2- 172.21.15.144:0/1032371670 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb34073120 0x7fbb34153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:05.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.296+0000 7fbb3b600640 1 -- 172.21.15.144:0/1032371670 >> 172.21.15.144:0/1032371670 conn(0x7fbb34062cc0 msgr2=0x7fbb34159fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:05.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.296+0000 7fbb3b600640 1 -- 172.21.15.144:0/1032371670 shutdown_connections 2024-09-11T23:21:05.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:05.296+0000 7fbb3b600640 1 -- 172.21.15.144:0/1032371670 wait complete. 2024-09-11T23:21:05.312 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-09-11T23:21:05.205489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231228,"kb_used_data":6664,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743492,"statfs":{"total":773094113280,"available":772857335808,"internally_reserved":0,"allocated":6823936,"data_stored":3500660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.760872"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456550+0000","last_change":"2024-09-11T23:20:59.472164+0000","last_active":"2024-09-11T23:21:00.456550+0000","last_peered":"2024-09-11T23:21:00.456550+0000","last_clean":"2024-09-11T23:21:00.456550+0000","last_became_active":"2024-09-11T23:20:59.471476+0000","last_became_peered":"2024-09-11T23:20:59.471476+0000","last_unstale":"2024-09-11T23:21:00.456550+0000","last_undegraded":"2024-09-11T23:21:00.456550+0000","last_fullsized":"2024-09-11T23:21:00.456550+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:26.417418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871704+0000","last_change":"2024-09-11T23:20:59.467559+0000","last_active":"2024-09-11T23:21:00.871704+0000","last_peered":"2024-09-11T23:21:00.871704+0000","last_clean":"2024-09-11T23:21:00.871704+0000","last_became_active":"2024-09-11T23:20:59.467289+0000","last_became_peered":"2024-09-11T23:20:59.467289+0000","last_unstale":"2024-09-11T23:21:00.871704+0000","last_undegraded":"2024-09-11T23:21:00.871704+0000","last_fullsized":"2024-09-11T23:21:00.871704+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:31.251559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461728+0000","last_change":"2024-09-11T23:20:59.469746+0000","last_active":"2024-09-11T23:21:00.461728+0000","last_peered":"2024-09-11T23:21:00.461728+0000","last_clean":"2024-09-11T23:21:00.461728+0000","last_became_active":"2024-09-11T23:20:59.469438+0000","last_became_peered":"2024-09-11T23:20:59.469438+0000","last_unstale":"2024-09-11T23:21:00.461728+0000","last_undegraded":"2024-09-11T23:21:00.461728+0000","last_fullsized":"2024-09-11T23:21:00.461728+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:41.299611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461079+0000","last_change":"2024-09-11T23:20:59.468119+0000","last_active":"2024-09-11T23:21:00.461079+0000","last_peered":"2024-09-11T23:21:00.461079+0000","last_clean":"2024-09-11T23:21:00.461079+0000","last_became_active":"2024-09-11T23:20:59.467847+0000","last_became_peered":"2024-09-11T23:20:59.467847+0000","last_unstale":"2024-09-11T23:21:00.461079+0000","last_undegraded":"2024-09-11T23:21:00.461079+0000","last_fullsized":"2024-09-11T23:21:00.461079+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:27.032373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456756+0000","last_change":"2024-09-11T23:20:59.462985+0000","last_active":"2024-09-11T23:21:00.456756+0000","last_peered":"2024-09-11T23:21:00.456756+0000","last_clean":"2024-09-11T23:21:00.456756+0000","last_became_active":"2024-09-11T23:20:59.462699+0000","last_became_peered":"2024-09-11T23:20:59.462699+0000","last_unstale":"2024-09-11T23:21:00.456756+0000","last_undegraded":"2024-09-11T23:21:00.456756+0000","last_fullsized":"2024-09-11T23:21:00.456756+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:58.821334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301150+0000","last_change":"2024-09-11T23:20:59.466637+0000","last_active":"2024-09-11T23:21:01.301150+0000","last_peered":"2024-09-11T23:21:01.301150+0000","last_clean":"2024-09-11T23:21:01.301150+0000","last_became_active":"2024-09-11T23:20:59.466377+0000","last_became_peered":"2024-09-11T23:20:59.466377+0000","last_unstale":"2024-09-11T23:21:01.301150+0000","last_undegraded":"2024-09-11T23:21:01.301150+0000","last_fullsized":"2024-09-11T23:21:01.301150+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:15.154690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304460+0000","last_change":"2024-09-11T23:20:59.464854+0000","last_active":"2024-09-11T23:21:01.304460+0000","last_peered":"2024-09-11T23:21:01.304460+0000","last_clean":"2024-09-11T23:21:01.304460+0000","last_became_active":"2024-09-11T23:20:59.464585+0000","last_became_peered":"2024-09-11T23:20:59.464585+0000","last_unstale":"2024-09-11T23:21:01.304460+0000","last_undegraded":"2024-09-11T23:21:01.304460+0000","last_fullsized":"2024-09-11T23:21:01.304460+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:28.604088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871393+0000","last_change":"2024-09-11T23:20:59.461801+0000","last_active":"2024-09-11T23:21:00.871393+0000","last_peered":"2024-09-11T23:21:00.871393+0000","last_clean":"2024-09-11T23:21:00.871393+0000","last_became_active":"2024-09-11T23:20:59.461531+0000","last_became_peered":"2024-09-11T23:20:59.461531+0000","last_unstale":"2024-09-11T23:21:00.871393+0000","last_undegraded":"2024-09-11T23:21:00.871393+0000","last_fullsized":"2024-09-11T23:21:00.871393+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:44.244935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304807+0000","last_change":"2024-09-11T23:20:59.483367+0000","last_active":"2024-09-11T23:21:01.304807+0000","last_peered":"2024-09-11T23:21:01.304807+0000","last_clean":"2024-09-11T23:21:01.304807+0000","last_became_active":"2024-09-11T23:20:59.483009+0000","last_became_peered":"2024-09-11T23:20:59.483009+0000","last_unstale":"2024-09-11T23:21:01.304807+0000","last_undegraded":"2024-09-11T23:21:01.304807+0000","last_fullsized":"2024-09-11T23:21:01.304807+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:19.414229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304833+0000","last_change":"2024-09-11T23:20:59.453627+0000","last_active":"2024-09-11T23:21:01.304833+0000","last_peered":"2024-09-11T23:21:01.304833+0000","last_clean":"2024-09-11T23:21:01.304833+0000","last_became_active":"2024-09-11T23:20:59.453347+0000","last_became_peered":"2024-09-11T23:20:59.453347+0000","last_unstale":"2024-09-11T23:21:01.304833+0000","last_undegraded":"2024-09-11T23:21:01.304833+0000","last_fullsized":"2024-09-11T23:21:01.304833+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:30.477347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304724+0000","last_change":"2024-09-11T23:20:59.464084+0000","last_active":"2024-09-11T23:21:01.304724+0000","last_peered":"2024-09-11T23:21:01.304724+0000","last_clean":"2024-09-11T23:21:01.304724+0000","last_became_active":"2024-09-11T23:20:59.463816+0000","last_became_peered":"2024-09-11T23:20:59.463816+0000","last_unstale":"2024-09-11T23:21:01.304724+0000","last_undegraded":"2024-09-11T23:21:01.304724+0000","last_fullsized":"2024-09-11T23:21:01.304724+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:21.250647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461221+0000","last_change":"2024-09-11T23:20:59.467528+0000","last_active":"2024-09-11T23:21:00.461221+0000","last_peered":"2024-09-11T23:21:00.461221+0000","last_clean":"2024-09-11T23:21:00.461221+0000","last_became_active":"2024-09-11T23:20:59.467148+0000","last_became_peered":"2024-09-11T23:20:59.467148+0000","last_unstale":"2024-09-11T23:21:00.461221+0000","last_undegraded":"2024-09-11T23:21:00.461221+0000","last_fullsized":"2024-09-11T23:21:00.461221+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:17.572628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.804419+0000","last_change":"2024-09-11T23:20:59.471352+0000","last_active":"2024-09-11T23:21:00.804419+0000","last_peered":"2024-09-11T23:21:00.804419+0000","last_clean":"2024-09-11T23:21:00.804419+0000","last_became_active":"2024-09-11T23:20:59.470968+0000","last_became_peered":"2024-09-11T23:20:59.470968+0000","last_unstale":"2024-09-11T23:21:00.804419+0000","last_undegraded":"2024-09-11T23:21:00.804419+0000","last_fullsized":"2024-09-11T23:21:00.804419+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:28.453235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304745+0000","last_change":"2024-09-11T23:20:59.458141+0000","last_active":"2024-09-11T23:21:01.304745+0000","last_peered":"2024-09-11T23:21:01.304745+0000","last_clean":"2024-09-11T23:21:01.304745+0000","last_became_active":"2024-09-11T23:20:59.457853+0000","last_became_peered":"2024-09-11T23:20:59.457853+0000","last_unstale":"2024-09-11T23:21:01.304745+0000","last_undegraded":"2024-09-11T23:21:01.304745+0000","last_fullsized":"2024-09-11T23:21:01.304745+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:29.318776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304800+0000","last_change":"2024-09-11T23:20:59.457958+0000","last_active":"2024-09-11T23:21:01.304800+0000","last_peered":"2024-09-11T23:21:01.304800+0000","last_clean":"2024-09-11T23:21:01.304800+0000","last_became_active":"2024-09-11T23:20:59.457672+0000","last_became_peered":"2024-09-11T23:20:59.457672+0000","last_unstale":"2024-09-11T23:21:01.304800+0000","last_undegraded":"2024-09-11T23:21:01.304800+0000","last_fullsized":"2024-09-11T23:21:01.304800+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:07.195690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.300726+0000","last_change":"2024-09-11T23:20:59.479787+0000","last_active":"2024-09-11T23:21:01.300726+0000","last_peered":"2024-09-11T23:21:01.300726+0000","last_clean":"2024-09-11T23:21:01.300726+0000","last_became_active":"2024-09-11T23:20:59.469893+0000","last_became_peered":"2024-09-11T23:20:59.469893+0000","last_unstale":"2024-09-11T23:21:01.300726+0000","last_undegraded":"2024-09-11T23:21:01.300726+0000","last_fullsized":"2024-09-11T23:21:01.300726+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:12.645604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871858+0000","last_change":"2024-09-11T23:20:59.465949+0000","last_active":"2024-09-11T23:21:00.871858+0000","last_peered":"2024-09-11T23:21:00.871858+0000","last_clean":"2024-09-11T23:21:00.871858+0000","last_became_active":"2024-09-11T23:20:59.465251+0000","last_became_peered":"2024-09-11T23:20:59.465251+0000","last_unstale":"2024-09-11T23:21:00.871858+0000","last_undegraded":"2024-09-11T23:21:00.871858+0000","last_fullsized":"2024-09-11T23:21:00.871858+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:40.463156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461818+0000","last_change":"2024-09-11T23:20:59.469311+0000","last_active":"2024-09-11T23:21:00.461818+0000","last_peered":"2024-09-11T23:21:00.461818+0000","last_clean":"2024-09-11T23:21:00.461818+0000","last_became_active":"2024-09-11T23:20:59.468802+0000","last_became_peered":"2024-09-11T23:20:59.468802+0000","last_unstale":"2024-09-11T23:21:00.461818+0000","last_undegraded":"2024-09-11T23:21:00.461818+0000","last_fullsized":"2024-09-11T23:21:00.461818+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:47.861006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456586+0000","last_change":"2024-09-11T23:20:59.468862+0000","last_active":"2024-09-11T23:21:00.456586+0000","last_peered":"2024-09-11T23:21:00.456586+0000","last_clean":"2024-09-11T23:21:00.456586+0000","last_became_active":"2024-09-11T23:20:59.468588+0000","last_became_peered":"2024-09-11T23:20:59.468588+0000","last_unstale":"2024-09-11T23:21:00.456586+0000","last_undegraded":"2024-09-11T23:21:00.456586+0000","last_fullsized":"2024-09-11T23:21:00.456586+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:09.356677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871622+0000","last_change":"2024-09-11T23:20:59.468990+0000","last_active":"2024-09-11T23:21:00.871622+0000","last_peered":"2024-09-11T23:21:00.871622+0000","last_clean":"2024-09-11T23:21:00.871622+0000","last_became_active":"2024-09-11T23:20:59.468736+0000","last_became_peered":"2024-09-11T23:20:59.468736+0000","last_unstale":"2024-09-11T23:21:00.871622+0000","last_undegraded":"2024-09-11T23:21:00.871622+0000","last_fullsized":"2024-09-11T23:21:00.871622+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:08.951140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.460634+0000","last_change":"2024-09-11T23:20:59.477858+0000","last_active":"2024-09-11T23:21:00.460634+0000","last_peered":"2024-09-11T23:21:00.460634+0000","last_clean":"2024-09-11T23:21:00.460634+0000","last_became_active":"2024-09-11T23:20:59.477437+0000","last_became_peered":"2024-09-11T23:20:59.477437+0000","last_unstale":"2024-09-11T23:21:00.460634+0000","last_undegraded":"2024-09-11T23:21:00.460634+0000","last_fullsized":"2024-09-11T23:21:00.460634+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:49.797513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871537+0000","last_change":"2024-09-11T23:20:59.461667+0000","last_active":"2024-09-11T23:21:00.871537+0000","last_peered":"2024-09-11T23:21:00.871537+0000","last_clean":"2024-09-11T23:21:00.871537+0000","last_became_active":"2024-09-11T23:20:59.461421+0000","last_became_peered":"2024-09-11T23:20:59.461421+0000","last_unstale":"2024-09-11T23:21:00.871537+0000","last_undegraded":"2024-09-11T23:21:00.871537+0000","last_fullsized":"2024-09-11T23:21:00.871537+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:45.567676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.462207+0000","last_change":"2024-09-11T23:20:59.476578+0000","last_active":"2024-09-11T23:21:00.462207+0000","last_peered":"2024-09-11T23:21:00.462207+0000","last_clean":"2024-09-11T23:21:00.462207+0000","last_became_active":"2024-09-11T23:20:59.476300+0000","last_became_peered":"2024-09-11T23:20:59.476300+0000","last_unstale":"2024-09-11T23:21:00.462207+0000","last_undegraded":"2024-09-11T23:21:00.462207+0000","last_fullsized":"2024-09-11T23:21:00.462207+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:34.998360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.804183+0000","last_change":"2024-09-11T23:20:59.472368+0000","last_active":"2024-09-11T23:21:00.804183+0000","last_peered":"2024-09-11T23:21:00.804183+0000","last_clean":"2024-09-11T23:21:00.804183+0000","last_became_active":"2024-09-11T23:20:59.472087+0000","last_became_peered":"2024-09-11T23:20:59.472087+0000","last_unstale":"2024-09-11T23:21:00.804183+0000","last_undegraded":"2024-09-11T23:21:00.804183+0000","last_fullsized":"2024-09-11T23:21:00.804183+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:40.175218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456689+0000","last_change":"2024-09-11T23:20:59.472381+0000","last_active":"2024-09-11T23:21:00.456689+0000","last_peered":"2024-09-11T23:21:00.456689+0000","last_clean":"2024-09-11T23:21:00.456689+0000","last_became_active":"2024-09-11T23:20:59.471907+0000","last_became_peered":"2024-09-11T23:20:59.471907+0000","last_unstale":"2024-09-11T23:21:00.456689+0000","last_undegraded":"2024-09-11T23:21:00.456689+0000","last_fullsized":"2024-09-11T23:21:00.456689+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:03.162864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461642+0000","last_change":"2024-09-11T23:20:59.472931+0000","last_active":"2024-09-11T23:21:00.461642+0000","last_peered":"2024-09-11T23:21:00.461642+0000","last_clean":"2024-09-11T23:21:00.461642+0000","last_became_active":"2024-09-11T23:20:59.472664+0000","last_became_peered":"2024-09-11T23:20:59.472664+0000","last_unstale":"2024-09-11T23:21:00.461642+0000","last_undegraded":"2024-09-11T23:21:00.461642+0000","last_fullsized":"2024-09-11T23:21:00.461642+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:59.805119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301015+0000","last_change":"2024-09-11T23:20:59.473772+0000","last_active":"2024-09-11T23:21:01.301015+0000","last_peered":"2024-09-11T23:21:01.301015+0000","last_clean":"2024-09-11T23:21:01.301015+0000","last_became_active":"2024-09-11T23:20:59.473228+0000","last_became_peered":"2024-09-11T23:20:59.473228+0000","last_unstale":"2024-09-11T23:21:01.301015+0000","last_undegraded":"2024-09-11T23:21:01.301015+0000","last_fullsized":"2024-09-11T23:21:01.301015+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:08.772254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456643+0000","last_change":"2024-09-11T23:20:59.469067+0000","last_active":"2024-09-11T23:21:00.456643+0000","last_peered":"2024-09-11T23:21:00.456643+0000","last_clean":"2024-09-11T23:21:00.456643+0000","last_became_active":"2024-09-11T23:20:59.468802+0000","last_became_peered":"2024-09-11T23:20:59.468802+0000","last_unstale":"2024-09-11T23:21:00.456643+0000","last_undegraded":"2024-09-11T23:21:00.456643+0000","last_fullsized":"2024-09-11T23:21:00.456643+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:34.477242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871779+0000","last_change":"2024-09-11T23:20:59.466832+0000","last_active":"2024-09-11T23:21:00.871779+0000","last_peered":"2024-09-11T23:21:00.871779+0000","last_clean":"2024-09-11T23:21:00.871779+0000","last_became_active":"2024-09-11T23:20:59.466560+0000","last_became_peered":"2024-09-11T23:20:59.466560+0000","last_unstale":"2024-09-11T23:21:00.871779+0000","last_undegraded":"2024-09-11T23:21:00.871779+0000","last_fullsized":"2024-09-11T23:21:00.871779+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:42.410011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461928+0000","last_change":"2024-09-11T23:20:59.470126+0000","last_active":"2024-09-11T23:21:00.461928+0000","last_peered":"2024-09-11T23:21:00.461928+0000","last_clean":"2024-09-11T23:21:00.461928+0000","last_became_active":"2024-09-11T23:20:59.469730+0000","last_became_peered":"2024-09-11T23:20:59.469730+0000","last_unstale":"2024-09-11T23:21:00.461928+0000","last_undegraded":"2024-09-11T23:21:00.461928+0000","last_fullsized":"2024-09-11T23:21:00.461928+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:04.114941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456362+0000","last_change":"2024-09-11T23:20:59.474680+0000","last_active":"2024-09-11T23:21:00.456362+0000","last_peered":"2024-09-11T23:21:00.456362+0000","last_clean":"2024-09-11T23:21:00.456362+0000","last_became_active":"2024-09-11T23:20:59.472530+0000","last_became_peered":"2024-09-11T23:20:59.472530+0000","last_unstale":"2024-09-11T23:21:00.456362+0000","last_undegraded":"2024-09-11T23:21:00.456362+0000","last_fullsized":"2024-09-11T23:21:00.456362+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:37.774651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.300768+0000","last_change":"2024-09-11T23:20:59.470791+0000","last_active":"2024-09-11T23:21:01.300768+0000","last_peered":"2024-09-11T23:21:01.300768+0000","last_clean":"2024-09-11T23:21:01.300768+0000","last_became_active":"2024-09-11T23:20:59.469829+0000","last_became_peered":"2024-09-11T23:20:59.469829+0000","last_unstale":"2024-09-11T23:21:01.300768+0000","last_undegraded":"2024-09-11T23:21:01.300768+0000","last_fullsized":"2024-09-11T23:21:01.300768+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:27.032373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301140+0000","last_change":"2024-09-11T23:20:59.481648+0000","last_active":"2024-09-11T23:21:01.301140+0000","last_peered":"2024-09-11T23:21:01.301140+0000","last_clean":"2024-09-11T23:21:01.301140+0000","last_became_active":"2024-09-11T23:20:59.473925+0000","last_became_peered":"2024-09-11T23:20:59.473925+0000","last_unstale":"2024-09-11T23:21:01.301140+0000","last_undegraded":"2024-09-11T23:21:01.301140+0000","last_fullsized":"2024-09-11T23:21:01.301140+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:59.805119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"58'4","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301076+0000","last_change":"2024-09-11T23:20:58.461846+0000","last_active":"2024-09-11T23:21:01.301076+0000","last_peered":"2024-09-11T23:21:01.301076+0000","last_clean":"2024-09-11T23:21:01.301076+0000","last_became_active":"2024-09-11T23:20:58.461591+0000","last_became_peered":"2024-09-11T23:20:58.461591+0000","last_unstale":"2024-09-11T23:21:01.301076+0000","last_undegraded":"2024-09-11T23:21:01.301076+0000","last_fullsized":"2024-09-11T23:21:01.301076+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:16.896074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304861+0000","last_change":"2024-09-11T23:20:59.474489+0000","last_active":"2024-09-11T23:21:01.304861+0000","last_peered":"2024-09-11T23:21:01.304861+0000","last_clean":"2024-09-11T23:21:01.304861+0000","last_became_active":"2024-09-11T23:20:59.474214+0000","last_became_peered":"2024-09-11T23:20:59.474214+0000","last_unstale":"2024-09-11T23:21:01.304861+0000","last_undegraded":"2024-09-11T23:21:01.304861+0000","last_fullsized":"2024-09-11T23:21:01.304861+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:28.604088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871666+0000","last_change":"2024-09-11T23:20:58.465371+0000","last_active":"2024-09-11T23:21:00.871666+0000","last_peered":"2024-09-11T23:21:00.871666+0000","last_clean":"2024-09-11T23:21:00.871666+0000","last_became_active":"2024-09-11T23:20:58.465117+0000","last_became_peered":"2024-09-11T23:20:58.465117+0000","last_unstale":"2024-09-11T23:21:00.871666+0000","last_undegraded":"2024-09-11T23:21:00.871666+0000","last_fullsized":"2024-09-11T23:21:00.871666+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:38.868184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.300948+0000","last_change":"2024-09-11T23:20:59.466735+0000","last_active":"2024-09-11T23:21:01.300948+0000","last_peered":"2024-09-11T23:21:01.300948+0000","last_clean":"2024-09-11T23:21:01.300948+0000","last_became_active":"2024-09-11T23:20:59.466364+0000","last_became_peered":"2024-09-11T23:20:59.466364+0000","last_unstale":"2024-09-11T23:21:01.300948+0000","last_undegraded":"2024-09-11T23:21:01.300948+0000","last_fullsized":"2024-09-11T23:21:01.300948+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:29.787221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301327+0000","last_change":"2024-09-11T23:20:58.460984+0000","last_active":"2024-09-11T23:21:01.301327+0000","last_peered":"2024-09-11T23:21:01.301327+0000","last_clean":"2024-09-11T23:21:01.301327+0000","last_became_active":"2024-09-11T23:20:58.460659+0000","last_became_peered":"2024-09-11T23:20:58.460659+0000","last_unstale":"2024-09-11T23:21:01.301327+0000","last_undegraded":"2024-09-11T23:21:01.301327+0000","last_fullsized":"2024-09-11T23:21:01.301327+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:15.242284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301226+0000","last_change":"2024-09-11T23:20:59.481098+0000","last_active":"2024-09-11T23:21:01.301226+0000","last_peered":"2024-09-11T23:21:01.301226+0000","last_clean":"2024-09-11T23:21:01.301226+0000","last_became_active":"2024-09-11T23:20:59.480821+0000","last_became_peered":"2024-09-11T23:20:59.480821+0000","last_unstale":"2024-09-11T23:21:01.301226+0000","last_undegraded":"2024-09-11T23:21:01.301226+0000","last_fullsized":"2024-09-11T23:21:01.301226+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:26.537084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461205+0000","last_change":"2024-09-11T23:20:58.462668+0000","last_active":"2024-09-11T23:21:00.461205+0000","last_peered":"2024-09-11T23:21:00.461205+0000","last_clean":"2024-09-11T23:21:00.461205+0000","last_became_active":"2024-09-11T23:20:58.462349+0000","last_became_peered":"2024-09-11T23:20:58.462349+0000","last_unstale":"2024-09-11T23:21:00.461205+0000","last_undegraded":"2024-09-11T23:21:00.461205+0000","last_fullsized":"2024-09-11T23:21:00.461205+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:16.896074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871423+0000","last_change":"2024-09-11T23:20:59.461146+0000","last_active":"2024-09-11T23:21:00.871423+0000","last_peered":"2024-09-11T23:21:00.871423+0000","last_clean":"2024-09-11T23:21:00.871423+0000","last_became_active":"2024-09-11T23:20:59.460868+0000","last_became_peered":"2024-09-11T23:20:59.460868+0000","last_unstale":"2024-09-11T23:21:00.871423+0000","last_undegraded":"2024-09-11T23:21:00.871423+0000","last_fullsized":"2024-09-11T23:21:00.871423+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:12.270988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304403+0000","last_change":"2024-09-11T23:20:58.459200+0000","last_active":"2024-09-11T23:21:01.304403+0000","last_peered":"2024-09-11T23:21:01.304403+0000","last_clean":"2024-09-11T23:21:01.304403+0000","last_became_active":"2024-09-11T23:20:58.458940+0000","last_became_peered":"2024-09-11T23:20:58.458940+0000","last_unstale":"2024-09-11T23:21:01.304403+0000","last_undegraded":"2024-09-11T23:21:01.304403+0000","last_fullsized":"2024-09-11T23:21:01.304403+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:24.686226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871421+0000","last_change":"2024-09-11T23:20:59.471438+0000","last_active":"2024-09-11T23:21:00.871421+0000","last_peered":"2024-09-11T23:21:00.871421+0000","last_clean":"2024-09-11T23:21:00.871421+0000","last_became_active":"2024-09-11T23:20:59.471170+0000","last_became_peered":"2024-09-11T23:20:59.471170+0000","last_unstale":"2024-09-11T23:21:00.871421+0000","last_undegraded":"2024-09-11T23:21:00.871421+0000","last_fullsized":"2024-09-11T23:21:00.871421+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:52.111971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.300854+0000","last_change":"2024-09-11T23:20:58.459414+0000","last_active":"2024-09-11T23:21:01.300854+0000","last_peered":"2024-09-11T23:21:01.300854+0000","last_clean":"2024-09-11T23:21:01.300854+0000","last_became_active":"2024-09-11T23:20:58.459152+0000","last_became_peered":"2024-09-11T23:20:58.459152+0000","last_unstale":"2024-09-11T23:21:01.300854+0000","last_undegraded":"2024-09-11T23:21:01.300854+0000","last_fullsized":"2024-09-11T23:21:01.300854+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:27.596347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.804234+0000","last_change":"2024-09-11T23:20:59.464299+0000","last_active":"2024-09-11T23:21:00.804234+0000","last_peered":"2024-09-11T23:21:00.804234+0000","last_clean":"2024-09-11T23:21:00.804234+0000","last_became_active":"2024-09-11T23:20:59.463578+0000","last_became_peered":"2024-09-11T23:20:59.463578+0000","last_unstale":"2024-09-11T23:21:00.804234+0000","last_undegraded":"2024-09-11T23:21:00.804234+0000","last_fullsized":"2024-09-11T23:21:00.804234+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:30.660243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.460481+0000","last_change":"2024-09-11T23:20:58.462986+0000","last_active":"2024-09-11T23:21:00.460481+0000","last_peered":"2024-09-11T23:21:00.460481+0000","last_clean":"2024-09-11T23:21:00.460481+0000","last_became_active":"2024-09-11T23:20:58.462292+0000","last_became_peered":"2024-09-11T23:20:58.462292+0000","last_unstale":"2024-09-11T23:21:00.460481+0000","last_undegraded":"2024-09-11T23:21:00.460481+0000","last_fullsized":"2024-09-11T23:21:00.460481+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.187950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871431+0000","last_change":"2024-09-11T23:20:59.461080+0000","last_active":"2024-09-11T23:21:00.871431+0000","last_peered":"2024-09-11T23:21:00.871431+0000","last_clean":"2024-09-11T23:21:00.871431+0000","last_became_active":"2024-09-11T23:20:59.460840+0000","last_became_peered":"2024-09-11T23:20:59.460840+0000","last_unstale":"2024-09-11T23:21:00.871431+0000","last_undegraded":"2024-09-11T23:21:00.871431+0000","last_fullsized":"2024-09-11T23:21:00.871431+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:06.473547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304485+0000","last_change":"2024-09-11T23:20:58.462888+0000","last_active":"2024-09-11T23:21:01.304485+0000","last_peered":"2024-09-11T23:21:01.304485+0000","last_clean":"2024-09-11T23:21:01.304485+0000","last_became_active":"2024-09-11T23:20:58.462609+0000","last_became_peered":"2024-09-11T23:20:58.462609+0000","last_unstale":"2024-09-11T23:21:01.304485+0000","last_undegraded":"2024-09-11T23:21:01.304485+0000","last_fullsized":"2024-09-11T23:21:01.304485+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:29.652502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304853+0000","last_change":"2024-09-11T23:20:59.458893+0000","last_active":"2024-09-11T23:21:01.304853+0000","last_peered":"2024-09-11T23:21:01.304853+0000","last_clean":"2024-09-11T23:21:01.304853+0000","last_became_active":"2024-09-11T23:20:59.458626+0000","last_became_peered":"2024-09-11T23:20:59.458626+0000","last_unstale":"2024-09-11T23:21:01.304853+0000","last_undegraded":"2024-09-11T23:21:01.304853+0000","last_fullsized":"2024-09-11T23:21:01.304853+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:17.903814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461762+0000","last_change":"2024-09-11T23:20:58.473089+0000","last_active":"2024-09-11T23:21:00.461762+0000","last_peered":"2024-09-11T23:21:00.461762+0000","last_clean":"2024-09-11T23:21:00.461762+0000","last_became_active":"2024-09-11T23:20:58.472866+0000","last_became_peered":"2024-09-11T23:20:58.472866+0000","last_unstale":"2024-09-11T23:21:00.461762+0000","last_undegraded":"2024-09-11T23:21:00.461762+0000","last_fullsized":"2024-09-11T23:21:00.461762+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:24.239996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461649+0000","last_change":"2024-09-11T23:20:59.480062+0000","last_active":"2024-09-11T23:21:00.461649+0000","last_peered":"2024-09-11T23:21:00.461649+0000","last_clean":"2024-09-11T23:21:00.461649+0000","last_became_active":"2024-09-11T23:20:59.479528+0000","last_became_peered":"2024-09-11T23:20:59.479528+0000","last_unstale":"2024-09-11T23:21:00.461649+0000","last_undegraded":"2024-09-11T23:21:00.461649+0000","last_fullsized":"2024-09-11T23:21:00.461649+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:26.537084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871771+0000","last_change":"2024-09-11T23:20:58.466599+0000","last_active":"2024-09-11T23:21:00.871771+0000","last_peered":"2024-09-11T23:21:00.871771+0000","last_clean":"2024-09-11T23:21:00.871771+0000","last_became_active":"2024-09-11T23:20:58.466282+0000","last_became_peered":"2024-09-11T23:20:58.466282+0000","last_unstale":"2024-09-11T23:21:00.871771+0000","last_undegraded":"2024-09-11T23:21:00.871771+0000","last_fullsized":"2024-09-11T23:21:00.871771+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:39.888169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304586+0000","last_change":"2024-09-11T23:20:59.471056+0000","last_active":"2024-09-11T23:21:01.304586+0000","last_peered":"2024-09-11T23:21:01.304586+0000","last_clean":"2024-09-11T23:21:01.304586+0000","last_became_active":"2024-09-11T23:20:59.470167+0000","last_became_peered":"2024-09-11T23:20:59.470167+0000","last_unstale":"2024-09-11T23:21:01.304586+0000","last_undegraded":"2024-09-11T23:21:01.304586+0000","last_fullsized":"2024-09-11T23:21:01.304586+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:31.141653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"58'3","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.462041+0000","last_change":"2024-09-11T23:20:58.466818+0000","last_active":"2024-09-11T23:21:00.462041+0000","last_peered":"2024-09-11T23:21:00.462041+0000","last_clean":"2024-09-11T23:21:00.462041+0000","last_became_active":"2024-09-11T23:20:58.466361+0000","last_became_peered":"2024-09-11T23:20:58.466361+0000","last_unstale":"2024-09-11T23:21:00.462041+0000","last_undegraded":"2024-09-11T23:21:00.462041+0000","last_fullsized":"2024-09-11T23:21:00.462041+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:43.819715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461940+0000","last_change":"2024-09-11T23:20:59.483767+0000","last_active":"2024-09-11T23:21:00.461940+0000","last_peered":"2024-09-11T23:21:00.461940+0000","last_clean":"2024-09-11T23:21:00.461940+0000","last_became_active":"2024-09-11T23:20:59.483431+0000","last_became_peered":"2024-09-11T23:20:59.483431+0000","last_unstale":"2024-09-11T23:21:00.461940+0000","last_undegraded":"2024-09-11T23:21:00.461940+0000","last_fullsized":"2024-09-11T23:21:00.461940+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:19.903015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"58'6","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304656+0000","last_change":"2024-09-11T23:20:58.456875+0000","last_active":"2024-09-11T23:21:01.304656+0000","last_peered":"2024-09-11T23:21:01.304656+0000","last_clean":"2024-09-11T23:21:01.304656+0000","last_became_active":"2024-09-11T23:20:58.456579+0000","last_became_peered":"2024-09-11T23:20:58.456579+0000","last_unstale":"2024-09-11T23:21:01.304656+0000","last_undegraded":"2024-09-11T23:21:01.304656+0000","last_fullsized":"2024-09-11T23:21:01.304656+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:39.167478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.460587+0000","last_change":"2024-09-11T23:20:59.469201+0000","last_active":"2024-09-11T23:21:00.460587+0000","last_peered":"2024-09-11T23:21:00.460587+0000","last_clean":"2024-09-11T23:21:00.460587+0000","last_became_active":"2024-09-11T23:20:59.468613+0000","last_became_peered":"2024-09-11T23:20:59.468613+0000","last_unstale":"2024-09-11T23:21:00.460587+0000","last_undegraded":"2024-09-11T23:21:00.460587+0000","last_fullsized":"2024-09-11T23:21:00.460587+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:50.314018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871362+0000","last_change":"2024-09-11T23:20:58.467171+0000","last_active":"2024-09-11T23:21:00.871362+0000","last_peered":"2024-09-11T23:21:00.871362+0000","last_clean":"2024-09-11T23:21:00.871362+0000","last_became_active":"2024-09-11T23:20:58.466901+0000","last_became_peered":"2024-09-11T23:20:58.466901+0000","last_unstale":"2024-09-11T23:21:00.871362+0000","last_undegraded":"2024-09-11T23:21:00.871362+0000","last_fullsized":"2024-09-11T23:21:00.871362+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:42.485376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461292+0000","last_change":"2024-09-11T23:20:59.467990+0000","last_active":"2024-09-11T23:21:00.461292+0000","last_peered":"2024-09-11T23:21:00.461292+0000","last_clean":"2024-09-11T23:21:00.461292+0000","last_became_active":"2024-09-11T23:20:59.467663+0000","last_became_peered":"2024-09-11T23:20:59.467663+0000","last_unstale":"2024-09-11T23:21:00.461292+0000","last_undegraded":"2024-09-11T23:21:00.461292+0000","last_fullsized":"2024-09-11T23:21:00.461292+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:59.805119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.804234+0000","last_change":"2024-09-11T23:20:58.463853+0000","last_active":"2024-09-11T23:21:00.804234+0000","last_peered":"2024-09-11T23:21:00.804234+0000","last_clean":"2024-09-11T23:21:00.804234+0000","last_became_active":"2024-09-11T23:20:58.463592+0000","last_became_peered":"2024-09-11T23:20:58.463592+0000","last_unstale":"2024-09-11T23:21:00.804234+0000","last_undegraded":"2024-09-11T23:21:00.804234+0000","last_fullsized":"2024-09-11T23:21:00.804234+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:08.131569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304381+0000","last_change":"2024-09-11T23:20:59.465985+0000","last_active":"2024-09-11T23:21:01.304381+0000","last_peered":"2024-09-11T23:21:01.304381+0000","last_clean":"2024-09-11T23:21:01.304381+0000","last_became_active":"2024-09-11T23:20:59.465623+0000","last_became_peered":"2024-09-11T23:20:59.465623+0000","last_unstale":"2024-09-11T23:21:01.304381+0000","last_undegraded":"2024-09-11T23:21:01.304381+0000","last_fullsized":"2024-09-11T23:21:01.304381+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:30.477347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.460595+0000","last_change":"2024-09-11T23:20:58.463387+0000","last_active":"2024-09-11T23:21:00.460595+0000","last_peered":"2024-09-11T23:21:00.460595+0000","last_clean":"2024-09-11T23:21:00.460595+0000","last_became_active":"2024-09-11T23:20:58.463106+0000","last_became_peered":"2024-09-11T23:20:58.463106+0000","last_unstale":"2024-09-11T23:21:00.460595+0000","last_undegraded":"2024-09-11T23:21:00.460595+0000","last_fullsized":"2024-09-11T23:21:00.460595+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:18.406488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.462247+0000","last_change":"2024-09-11T23:20:59.476552+0000","last_active":"2024-09-11T23:21:00.462247+0000","last_peered":"2024-09-11T23:21:00.462247+0000","last_clean":"2024-09-11T23:21:00.462247+0000","last_became_active":"2024-09-11T23:20:59.476173+0000","last_became_peered":"2024-09-11T23:20:59.476173+0000","last_unstale":"2024-09-11T23:21:00.462247+0000","last_undegraded":"2024-09-11T23:21:00.462247+0000","last_fullsized":"2024-09-11T23:21:00.462247+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:28.663368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"58'8","reported_seq":22,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.460463+0000","last_change":"2024-09-11T23:20:58.467986+0000","last_active":"2024-09-11T23:21:00.460463+0000","last_peered":"2024-09-11T23:21:00.460463+0000","last_clean":"2024-09-11T23:21:00.460463+0000","last_became_active":"2024-09-11T23:20:58.466944+0000","last_became_peered":"2024-09-11T23:20:58.466944+0000","last_unstale":"2024-09-11T23:21:00.460463+0000","last_undegraded":"2024-09-11T23:21:00.460463+0000","last_fullsized":"2024-09-11T23:21:00.460463+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:06.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461902+0000","last_change":"2024-09-11T23:20:59.472856+0000","last_active":"2024-09-11T23:21:00.461902+0000","last_peered":"2024-09-11T23:21:00.461902+0000","last_clean":"2024-09-11T23:21:00.461902+0000","last_became_active":"2024-09-11T23:20:59.471121+0000","last_became_peered":"2024-09-11T23:20:59.471121+0000","last_unstale":"2024-09-11T23:21:00.461902+0000","last_undegraded":"2024-09-11T23:21:00.461902+0000","last_fullsized":"2024-09-11T23:21:00.461902+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:50.781443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871796+0000","last_change":"2024-09-11T23:20:58.466456+0000","last_active":"2024-09-11T23:21:00.871796+0000","last_peered":"2024-09-11T23:21:00.871796+0000","last_clean":"2024-09-11T23:21:00.871796+0000","last_became_active":"2024-09-11T23:20:58.466200+0000","last_became_peered":"2024-09-11T23:20:58.466200+0000","last_unstale":"2024-09-11T23:21:00.871796+0000","last_undegraded":"2024-09-11T23:21:00.871796+0000","last_fullsized":"2024-09-11T23:21:00.871796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:23.944565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461677+0000","last_change":"2024-09-11T23:20:59.466534+0000","last_active":"2024-09-11T23:21:00.461677+0000","last_peered":"2024-09-11T23:21:00.461677+0000","last_clean":"2024-09-11T23:21:00.461677+0000","last_became_active":"2024-09-11T23:20:59.466243+0000","last_became_peered":"2024-09-11T23:20:59.466243+0000","last_unstale":"2024-09-11T23:21:00.461677+0000","last_undegraded":"2024-09-11T23:21:00.461677+0000","last_fullsized":"2024-09-11T23:21:00.461677+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:08.772254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301109+0000","last_change":"2024-09-11T23:20:58.468458+0000","last_active":"2024-09-11T23:21:01.301109+0000","last_peered":"2024-09-11T23:21:01.301109+0000","last_clean":"2024-09-11T23:21:01.301109+0000","last_became_active":"2024-09-11T23:20:58.468206+0000","last_became_peered":"2024-09-11T23:20:58.468206+0000","last_unstale":"2024-09-11T23:21:01.301109+0000","last_undegraded":"2024-09-11T23:21:01.301109+0000","last_fullsized":"2024-09-11T23:21:01.301109+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.187950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871909+0000","last_change":"2024-09-11T23:20:59.462675+0000","last_active":"2024-09-11T23:21:00.871909+0000","last_peered":"2024-09-11T23:21:00.871909+0000","last_clean":"2024-09-11T23:21:00.871909+0000","last_became_active":"2024-09-11T23:20:59.462426+0000","last_became_peered":"2024-09-11T23:20:59.462426+0000","last_unstale":"2024-09-11T23:21:00.871909+0000","last_undegraded":"2024-09-11T23:21:00.871909+0000","last_fullsized":"2024-09-11T23:21:00.871909+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:13.970806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461521+0000","last_change":"2024-09-11T23:20:58.467884+0000","last_active":"2024-09-11T23:21:00.461521+0000","last_peered":"2024-09-11T23:21:00.461521+0000","last_clean":"2024-09-11T23:21:00.461521+0000","last_became_active":"2024-09-11T23:20:58.467589+0000","last_became_peered":"2024-09-11T23:20:58.467589+0000","last_unstale":"2024-09-11T23:21:00.461521+0000","last_undegraded":"2024-09-11T23:21:00.461521+0000","last_fullsized":"2024-09-11T23:21:00.461521+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:06.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.462079+0000","last_change":"2024-09-11T23:20:59.483962+0000","last_active":"2024-09-11T23:21:00.462079+0000","last_peered":"2024-09-11T23:21:00.462079+0000","last_clean":"2024-09-11T23:21:00.462079+0000","last_became_active":"2024-09-11T23:20:59.483698+0000","last_became_peered":"2024-09-11T23:20:59.483698+0000","last_unstale":"2024-09-11T23:21:00.462079+0000","last_undegraded":"2024-09-11T23:21:00.462079+0000","last_fullsized":"2024-09-11T23:21:00.462079+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:20.950173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301131+0000","last_change":"2024-09-11T23:20:58.464827+0000","last_active":"2024-09-11T23:21:01.301131+0000","last_peered":"2024-09-11T23:21:01.301131+0000","last_clean":"2024-09-11T23:21:01.301131+0000","last_became_active":"2024-09-11T23:20:58.464593+0000","last_became_peered":"2024-09-11T23:20:58.464593+0000","last_unstale":"2024-09-11T23:21:01.301131+0000","last_undegraded":"2024-09-11T23:21:01.301131+0000","last_fullsized":"2024-09-11T23:21:01.301131+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:28.311036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.460841+0000","last_change":"2024-09-11T23:20:59.468489+0000","last_active":"2024-09-11T23:21:00.460841+0000","last_peered":"2024-09-11T23:21:00.460841+0000","last_clean":"2024-09-11T23:21:00.460841+0000","last_became_active":"2024-09-11T23:20:59.466325+0000","last_became_peered":"2024-09-11T23:20:59.466325+0000","last_unstale":"2024-09-11T23:21:00.460841+0000","last_undegraded":"2024-09-11T23:21:00.460841+0000","last_fullsized":"2024-09-11T23:21:00.460841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:12.645604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871522+0000","last_change":"2024-09-11T23:20:58.461629+0000","last_active":"2024-09-11T23:21:00.871522+0000","last_peered":"2024-09-11T23:21:00.871522+0000","last_clean":"2024-09-11T23:21:00.871522+0000","last_became_active":"2024-09-11T23:20:58.461361+0000","last_became_peered":"2024-09-11T23:20:58.461361+0000","last_unstale":"2024-09-11T23:21:00.871522+0000","last_undegraded":"2024-09-11T23:21:00.871522+0000","last_fullsized":"2024-09-11T23:21:00.871522+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:39.804195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301132+0000","last_change":"2024-09-11T23:20:59.469343+0000","last_active":"2024-09-11T23:21:01.301132+0000","last_peered":"2024-09-11T23:21:01.301132+0000","last_clean":"2024-09-11T23:21:01.301132+0000","last_became_active":"2024-09-11T23:20:59.468913+0000","last_became_peered":"2024-09-11T23:20:59.468913+0000","last_unstale":"2024-09-11T23:21:01.301132+0000","last_undegraded":"2024-09-11T23:21:01.301132+0000","last_fullsized":"2024-09-11T23:21:01.301132+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:49.797513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304448+0000","last_change":"2024-09-11T23:20:58.461264+0000","last_active":"2024-09-11T23:21:01.304448+0000","last_peered":"2024-09-11T23:21:01.304448+0000","last_clean":"2024-09-11T23:21:01.304448+0000","last_became_active":"2024-09-11T23:20:58.461014+0000","last_became_peered":"2024-09-11T23:20:58.461014+0000","last_unstale":"2024-09-11T23:21:01.304448+0000","last_undegraded":"2024-09-11T23:21:01.304448+0000","last_fullsized":"2024-09-11T23:21:01.304448+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:44.688791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.300873+0000","last_change":"2024-09-11T23:20:59.473514+0000","last_active":"2024-09-11T23:21:01.300873+0000","last_peered":"2024-09-11T23:21:01.300873+0000","last_clean":"2024-09-11T23:21:01.300873+0000","last_became_active":"2024-09-11T23:20:59.469945+0000","last_became_peered":"2024-09-11T23:20:59.469945+0000","last_unstale":"2024-09-11T23:21:01.300873+0000","last_undegraded":"2024-09-11T23:21:01.300873+0000","last_fullsized":"2024-09-11T23:21:01.300873+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:17.572628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.460213+0000","last_change":"2024-09-11T23:20:58.465129+0000","last_active":"2024-09-11T23:21:00.460213+0000","last_peered":"2024-09-11T23:21:00.460213+0000","last_clean":"2024-09-11T23:21:00.460213+0000","last_became_active":"2024-09-11T23:20:58.464847+0000","last_became_peered":"2024-09-11T23:20:58.464847+0000","last_unstale":"2024-09-11T23:21:00.460213+0000","last_undegraded":"2024-09-11T23:21:00.460213+0000","last_fullsized":"2024-09-11T23:21:00.460213+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:58.558566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461433+0000","last_change":"2024-09-11T23:20:59.470013+0000","last_active":"2024-09-11T23:21:00.461433+0000","last_peered":"2024-09-11T23:21:00.461433+0000","last_clean":"2024-09-11T23:21:00.461433+0000","last_became_active":"2024-09-11T23:20:59.469672+0000","last_became_peered":"2024-09-11T23:20:59.469672+0000","last_unstale":"2024-09-11T23:21:00.461433+0000","last_undegraded":"2024-09-11T23:21:00.461433+0000","last_fullsized":"2024-09-11T23:21:00.461433+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:29.787221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304914+0000","last_change":"2024-09-11T23:20:58.461093+0000","last_active":"2024-09-11T23:21:01.304914+0000","last_peered":"2024-09-11T23:21:01.304914+0000","last_clean":"2024-09-11T23:21:01.304914+0000","last_became_active":"2024-09-11T23:20:58.460732+0000","last_became_peered":"2024-09-11T23:20:58.460732+0000","last_unstale":"2024-09-11T23:21:01.304914+0000","last_undegraded":"2024-09-11T23:21:01.304914+0000","last_fullsized":"2024-09-11T23:21:01.304914+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:24.686226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461521+0000","last_change":"2024-09-11T23:20:59.467473+0000","last_active":"2024-09-11T23:21:00.461521+0000","last_peered":"2024-09-11T23:21:00.461521+0000","last_clean":"2024-09-11T23:21:00.461521+0000","last_became_active":"2024-09-11T23:20:59.467131+0000","last_became_peered":"2024-09-11T23:20:59.467131+0000","last_unstale":"2024-09-11T23:21:00.461521+0000","last_undegraded":"2024-09-11T23:21:00.461521+0000","last_fullsized":"2024-09-11T23:21:00.461521+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:49.797513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"59'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301302+0000","last_change":"2024-09-11T23:20:58.464274+0000","last_active":"2024-09-11T23:21:01.301302+0000","last_peered":"2024-09-11T23:21:01.301302+0000","last_clean":"2024-09-11T23:21:01.301302+0000","last_became_active":"2024-09-11T23:20:58.462488+0000","last_became_peered":"2024-09-11T23:20:58.462488+0000","last_unstale":"2024-09-11T23:21:01.301302+0000","last_undegraded":"2024-09-11T23:21:01.301302+0000","last_fullsized":"2024-09-11T23:21:01.301302+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:18.406488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304616+0000","last_change":"2024-09-11T23:20:59.458086+0000","last_active":"2024-09-11T23:21:01.304616+0000","last_peered":"2024-09-11T23:21:01.304616+0000","last_clean":"2024-09-11T23:21:01.304616+0000","last_became_active":"2024-09-11T23:20:59.457548+0000","last_became_peered":"2024-09-11T23:20:59.457548+0000","last_unstale":"2024-09-11T23:21:01.304616+0000","last_undegraded":"2024-09-11T23:21:01.304616+0000","last_fullsized":"2024-09-11T23:21:01.304616+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:22.679717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.804460+0000","last_change":"2024-09-11T23:20:58.461597+0000","last_active":"2024-09-11T23:21:00.804460+0000","last_peered":"2024-09-11T23:21:00.804460+0000","last_clean":"2024-09-11T23:21:00.804460+0000","last_became_active":"2024-09-11T23:20:58.460572+0000","last_became_peered":"2024-09-11T23:20:58.460572+0000","last_unstale":"2024-09-11T23:21:00.804460+0000","last_undegraded":"2024-09-11T23:21:00.804460+0000","last_fullsized":"2024-09-11T23:21:00.804460+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:41.170235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301291+0000","last_change":"2024-09-11T23:20:59.483140+0000","last_active":"2024-09-11T23:21:01.301291+0000","last_peered":"2024-09-11T23:21:01.301291+0000","last_clean":"2024-09-11T23:21:01.301291+0000","last_became_active":"2024-09-11T23:20:59.482447+0000","last_became_peered":"2024-09-11T23:20:59.482447+0000","last_unstale":"2024-09-11T23:21:01.301291+0000","last_undegraded":"2024-09-11T23:21:01.301291+0000","last_fullsized":"2024-09-11T23:21:01.301291+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:41.299611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461355+0000","last_change":"2024-09-11T23:20:58.460325+0000","last_active":"2024-09-11T23:21:00.461355+0000","last_peered":"2024-09-11T23:21:00.461355+0000","last_clean":"2024-09-11T23:21:00.461355+0000","last_became_active":"2024-09-11T23:20:58.459535+0000","last_became_peered":"2024-09-11T23:20:58.459535+0000","last_unstale":"2024-09-11T23:21:00.461355+0000","last_undegraded":"2024-09-11T23:21:00.461355+0000","last_fullsized":"2024-09-11T23:21:00.461355+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:15.242284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871771+0000","last_change":"2024-09-11T23:20:59.467890+0000","last_active":"2024-09-11T23:21:00.871771+0000","last_peered":"2024-09-11T23:21:00.871771+0000","last_clean":"2024-09-11T23:21:00.871771+0000","last_became_active":"2024-09-11T23:20:59.467620+0000","last_became_peered":"2024-09-11T23:20:59.467620+0000","last_unstale":"2024-09-11T23:21:00.871771+0000","last_undegraded":"2024-09-11T23:21:00.871771+0000","last_fullsized":"2024-09-11T23:21:00.871771+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:28.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304380+0000","last_change":"2024-09-11T23:20:58.461187+0000","last_active":"2024-09-11T23:21:01.304380+0000","last_peered":"2024-09-11T23:21:01.304380+0000","last_clean":"2024-09-11T23:21:01.304380+0000","last_became_active":"2024-09-11T23:20:58.460890+0000","last_became_peered":"2024-09-11T23:20:58.460890+0000","last_unstale":"2024-09-11T23:21:01.304380+0000","last_undegraded":"2024-09-11T23:21:01.304380+0000","last_fullsized":"2024-09-11T23:21:01.304380+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:08.131569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461556+0000","last_change":"2024-09-11T23:20:59.475905+0000","last_active":"2024-09-11T23:21:00.461556+0000","last_peered":"2024-09-11T23:21:00.461556+0000","last_clean":"2024-09-11T23:21:00.461556+0000","last_became_active":"2024-09-11T23:20:59.475545+0000","last_became_peered":"2024-09-11T23:20:59.475545+0000","last_unstale":"2024-09-11T23:21:00.461556+0000","last_undegraded":"2024-09-11T23:21:00.461556+0000","last_fullsized":"2024-09-11T23:21:00.461556+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:15.154690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304483+0000","last_change":"2024-09-11T23:20:58.458608+0000","last_active":"2024-09-11T23:21:01.304483+0000","last_peered":"2024-09-11T23:21:01.304483+0000","last_clean":"2024-09-11T23:21:01.304483+0000","last_became_active":"2024-09-11T23:20:58.458251+0000","last_became_peered":"2024-09-11T23:20:58.458251+0000","last_unstale":"2024-09-11T23:21:01.304483+0000","last_undegraded":"2024-09-11T23:21:01.304483+0000","last_fullsized":"2024-09-11T23:21:01.304483+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:04:14.569214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304336+0000","last_change":"2024-09-11T23:20:59.458596+0000","last_active":"2024-09-11T23:21:01.304336+0000","last_peered":"2024-09-11T23:21:01.304336+0000","last_clean":"2024-09-11T23:21:01.304336+0000","last_became_active":"2024-09-11T23:20:59.458329+0000","last_became_peered":"2024-09-11T23:20:59.458329+0000","last_unstale":"2024-09-11T23:21:01.304336+0000","last_undegraded":"2024-09-11T23:21:01.304336+0000","last_fullsized":"2024-09-11T23:21:01.304336+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:39.929849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304408+0000","last_change":"2024-09-11T23:20:58.463594+0000","last_active":"2024-09-11T23:21:01.304408+0000","last_peered":"2024-09-11T23:21:01.304408+0000","last_clean":"2024-09-11T23:21:01.304408+0000","last_became_active":"2024-09-11T23:20:58.463332+0000","last_became_peered":"2024-09-11T23:20:58.463332+0000","last_unstale":"2024-09-11T23:21:01.304408+0000","last_undegraded":"2024-09-11T23:21:01.304408+0000","last_fullsized":"2024-09-11T23:21:01.304408+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:36.012797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871544+0000","last_change":"2024-09-11T23:20:59.460002+0000","last_active":"2024-09-11T23:21:00.871544+0000","last_peered":"2024-09-11T23:21:00.871544+0000","last_clean":"2024-09-11T23:21:00.871544+0000","last_became_active":"2024-09-11T23:20:59.459757+0000","last_became_peered":"2024-09-11T23:20:59.459757+0000","last_unstale":"2024-09-11T23:21:00.871544+0000","last_undegraded":"2024-09-11T23:21:00.871544+0000","last_fullsized":"2024-09-11T23:21:00.871544+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:39.798888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871522+0000","last_change":"2024-09-11T23:20:58.467356+0000","last_active":"2024-09-11T23:21:00.871522+0000","last_peered":"2024-09-11T23:21:00.871522+0000","last_clean":"2024-09-11T23:21:00.871522+0000","last_became_active":"2024-09-11T23:20:58.465829+0000","last_became_peered":"2024-09-11T23:20:58.465829+0000","last_unstale":"2024-09-11T23:21:00.871522+0000","last_undegraded":"2024-09-11T23:21:00.871522+0000","last_fullsized":"2024-09-11T23:21:00.871522+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:06.639194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871420+0000","last_change":"2024-09-11T23:20:59.474473+0000","last_active":"2024-09-11T23:21:00.871420+0000","last_peered":"2024-09-11T23:21:00.871420+0000","last_clean":"2024-09-11T23:21:00.871420+0000","last_became_active":"2024-09-11T23:20:59.474176+0000","last_became_peered":"2024-09-11T23:20:59.474176+0000","last_unstale":"2024-09-11T23:21:00.871420+0000","last_undegraded":"2024-09-11T23:21:00.871420+0000","last_fullsized":"2024-09-11T23:21:00.871420+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:03.448755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.804183+0000","last_change":"2024-09-11T23:20:58.465838+0000","last_active":"2024-09-11T23:21:00.804183+0000","last_peered":"2024-09-11T23:21:00.804183+0000","last_clean":"2024-09-11T23:21:00.804183+0000","last_became_active":"2024-09-11T23:20:58.464372+0000","last_became_peered":"2024-09-11T23:20:58.464372+0000","last_unstale":"2024-09-11T23:21:00.804183+0000","last_undegraded":"2024-09-11T23:21:00.804183+0000","last_fullsized":"2024-09-11T23:21:00.804183+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:47.949664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":238,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.460584+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:21:00.460584+0000","last_peered":"2024-09-11T23:21:00.460584+0000","last_clean":"2024-09-11T23:21:00.460584+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:21:00.460584+0000","last_undegraded":"2024-09-11T23:21:00.460584+0000","last_fullsized":"2024-09-11T23:21:00.460584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476780,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":1298432,"data_stored":879916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476779,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":696320,"data_stored":289388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476778,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":704512,"data_stored":290040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476778,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":708608,"data_stored":291000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":700416,"data_stored":289478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509482,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1306624,"data_stored":881950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":704512,"data_stored":289444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":704512,"data_stored":289444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:21:08.318 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:21:08.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.481+0000 7f287a400640 1 Processor -- start 2024-09-11T23:21:08.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.481+0000 7f287a400640 1 -- start start 2024-09-11T23:21:08.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.482+0000 7f287a400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f287415c180 0x7f28740cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:08.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.483+0000 7f287a400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28740ce230 0x7f28740cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:08.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.483+0000 7f287a400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28740ce740 con 0x7f28740cf5b0 2024-09-11T23:21:08.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.483+0000 7f287a400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2874072640 con 0x7f287415c180 2024-09-11T23:21:08.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.483+0000 7f287a400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2874072920 con 0x7f28740ce230 2024-09-11T23:21:08.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.483+0000 7f286aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28740ce230 0x7f28740cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.483+0000 7f2873400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f287415c180 0x7f28740cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.483+0000 7f286aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28740ce230 0x7f28740cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:39388/0 (socket says 172.21.15.144:39388) 2024-09-11T23:21:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.483+0000 7f2873e00640 1 --1- 172.21.15.144:0/791092618 >> v1:172.21.15.165:6789/0 conn(0x7f28740cf5b0 0x7f2874073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:60478/0 (socket says 172.21.15.144:60478) 2024-09-11T23:21:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.483+0000 7f286aa00640 1 -- 172.21.15.144:0/791092618 learned_addr learned my addr 172.21.15.144:0/791092618 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.484+0000 7f286aa00640 1 -- 172.21.15.144:0/791092618 >> v2:172.21.15.165:3300/0 conn(0x7f287415c180 msgr2=0x7f28740cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.484+0000 7f286aa00640 1 --2- 172.21.15.144:0/791092618 >> v2:172.21.15.165:3300/0 conn(0x7f287415c180 0x7f28740cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.484+0000 7f286aa00640 1 -- 172.21.15.144:0/791092618 >> v1:172.21.15.165:6789/0 conn(0x7f28740cf5b0 legacy=0x7f2874073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.484+0000 7f286aa00640 1 -- 172.21.15.144:0/791092618 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2874072c00 con 0x7f28740ce230 2024-09-11T23:21:08.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.484+0000 7f2873400640 1 --2- 172.21.15.144:0/791092618 >> v2:172.21.15.165:3300/0 conn(0x7f287415c180 0x7f28740cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:21:08.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.485+0000 7f286aa00640 1 --2- 172.21.15.144:0/791092618 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28740ce230 0x7f28740cf070 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f285c009870 tx=0x7f285c02a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50b3a59bc1ae0c79 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:08.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.485+0000 7f2872a00640 1 -- 172.21.15.144:0/791092618 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c037070 con 0x7f28740ce230 2024-09-11T23:21:08.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.485+0000 7f2872a00640 1 -- 172.21.15.144:0/791092618 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285c032440 con 0x7f28740ce230 2024-09-11T23:21:08.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.485+0000 7f2872a00640 1 -- 172.21.15.144:0/791092618 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c032810 con 0x7f28740ce230 2024-09-11T23:21:08.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.486+0000 7f287a400640 1 -- 172.21.15.144:0/791092618 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28740ce230 msgr2=0x7f28740cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:08.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.486+0000 7f287a400640 1 --2- 172.21.15.144:0/791092618 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28740ce230 0x7f28740cf070 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f285c009870 tx=0x7f285c02a1e0 comp rx=0 tx=0).stop 2024-09-11T23:21:08.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.486+0000 7f287a400640 1 -- 172.21.15.144:0/791092618 shutdown_connections 2024-09-11T23:21:08.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.486+0000 7f287a400640 1 --2- 172.21.15.144:0/791092618 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28740ce230 0x7f28740cf070 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:08.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.486+0000 7f287a400640 1 --2- 172.21.15.144:0/791092618 >> v2:172.21.15.165:3300/0 conn(0x7f287415c180 0x7f28740cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:08.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.486+0000 7f287a400640 1 -- 172.21.15.144:0/791092618 >> 172.21.15.144:0/791092618 conn(0x7f2874062cc0 msgr2=0x7f287406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:08.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.486+0000 7f287a400640 1 -- 172.21.15.144:0/791092618 shutdown_connections 2024-09-11T23:21:08.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.486+0000 7f287a400640 1 -- 172.21.15.144:0/791092618 wait complete. 2024-09-11T23:21:08.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.487+0000 7f287a400640 1 Processor -- start 2024-09-11T23:21:08.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.488+0000 7f287a400640 1 -- start start 2024-09-11T23:21:08.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.488+0000 7f287a400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28740ce230 0x7f287414bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:08.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.488+0000 7f287a400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28740cf5b0 0x7f287415e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:08.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.488+0000 7f287a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f287415c180 0x7f28740ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:08.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.489+0000 7f287a400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f287415c560 con 0x7f287415c180 2024-09-11T23:21:08.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.489+0000 7f287a400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f28740722f0 con 0x7f28740cf5b0 2024-09-11T23:21:08.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.489+0000 7f287a400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f287415c6e0 con 0x7f28740ce230 2024-09-11T23:21:08.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.489+0000 7f2873e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f287415c180 0x7f28740ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:08.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.489+0000 7f2873e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f287415c180 0x7f28740ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38372/0 (socket says 172.21.15.144:38372) 2024-09-11T23:21:08.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.489+0000 7f2873e00640 1 -- 172.21.15.144:0/4196073791 learned_addr learned my addr 172.21.15.144:0/4196073791 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:08.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.489+0000 7f2873400640 1 --2- 172.21.15.144:0/4196073791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28740ce230 0x7f287414bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:08.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.489+0000 7f286aa00640 1 --2- 172.21.15.144:0/4196073791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28740cf5b0 0x7f287415e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:08.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.489+0000 7f2873e00640 1 -- 172.21.15.144:0/4196073791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28740ce230 msgr2=0x7f287414bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:08.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.489+0000 7f2873e00640 1 --2- 172.21.15.144:0/4196073791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28740ce230 0x7f287414bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:08.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.489+0000 7f2873e00640 1 -- 172.21.15.144:0/4196073791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28740cf5b0 msgr2=0x7f287415e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:08.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.489+0000 7f2873e00640 1 --2- 172.21.15.144:0/4196073791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28740cf5b0 0x7f287415e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:08.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.489+0000 7f2873e00640 1 -- 172.21.15.144:0/4196073791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f287415ed60 con 0x7f287415c180 2024-09-11T23:21:08.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.489+0000 7f286aa00640 1 --2- 172.21.15.144:0/4196073791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28740cf5b0 0x7f287415e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:08.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.490+0000 7f2873e00640 1 --2- 172.21.15.144:0/4196073791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f287415c180 0x7f28740ac6a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f286c00c730 tx=0x7f286c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:08.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.490+0000 7f286be00640 1 -- 172.21.15.144:0/4196073791 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c018070 con 0x7f287415c180 2024-09-11T23:21:08.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.490+0000 7f286be00640 1 -- 172.21.15.144:0/4196073791 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f286c004d60 con 0x7f287415c180 2024-09-11T23:21:08.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.490+0000 7f286be00640 1 -- 172.21.15.144:0/4196073791 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c00a860 con 0x7f287415c180 2024-09-11T23:21:08.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.490+0000 7f287a400640 1 -- 172.21.15.144:0/4196073791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f287415f040 con 0x7f287415c180 2024-09-11T23:21:08.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.490+0000 7f287a400640 1 -- 172.21.15.144:0/4196073791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28740aa8e0 con 0x7f287415c180 2024-09-11T23:21:08.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.491+0000 7f287a400640 1 -- 172.21.15.144:0/4196073791 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28740cf070 con 0x7f287415c180 2024-09-11T23:21:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.492+0000 7f286be00640 1 -- 172.21.15.144:0/4196073791 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f286c00ac10 con 0x7f287415c180 2024-09-11T23:21:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.493+0000 7f286be00640 1 --2- 172.21.15.144:0/4196073791 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f285006c010 0x7f285006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.493+0000 7f286be00640 1 -- 172.21.15.144:0/4196073791 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f286c08a7c0 con 0x7f287415c180 2024-09-11T23:21:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.493+0000 7f2873400640 1 --2- 172.21.15.144:0/4196073791 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f285006c010 0x7f285006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:08.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.493+0000 7f2873400640 1 --2- 172.21.15.144:0/4196073791 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f285006c010 0x7f285006e4d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2864009560 tx=0x7f2864008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:08.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.497+0000 7f286be00640 1 -- 172.21.15.144:0/4196073791 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f286c058ee0 con 0x7f287415c180 2024-09-11T23:21:08.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.668+0000 7f287a400640 1 -- 172.21.15.144:0/4196073791 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2874157490 con 0x7f285006c010 2024-09-11T23:21:08.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.674+0000 7f286be00640 1 -- 172.21.15.144:0/4196073791 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251955 (secure 0 0 0) 0x7f2874157490 con 0x7f285006c010 2024-09-11T23:21:08.678 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:08.679 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:21:08.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.678+0000 7f287a400640 1 -- 172.21.15.144:0/4196073791 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f285006c010 msgr2=0x7f285006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:08.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.678+0000 7f287a400640 1 --2- 172.21.15.144:0/4196073791 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f285006c010 0x7f285006e4d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2864009560 tx=0x7f2864008040 comp rx=0 tx=0).stop 2024-09-11T23:21:08.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.678+0000 7f287a400640 1 -- 172.21.15.144:0/4196073791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f287415c180 msgr2=0x7f28740ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:08.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.678+0000 7f287a400640 1 --2- 172.21.15.144:0/4196073791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f287415c180 0x7f28740ac6a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f286c00c730 tx=0x7f286c00cbf0 comp rx=0 tx=0).stop 2024-09-11T23:21:08.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.678+0000 7f287a400640 1 -- 172.21.15.144:0/4196073791 shutdown_connections 2024-09-11T23:21:08.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.678+0000 7f287a400640 1 --2- 172.21.15.144:0/4196073791 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f285006c010 0x7f285006e4d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:08.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.678+0000 7f287a400640 1 --2- 172.21.15.144:0/4196073791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f287415c180 0x7f28740ac6a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:08.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.678+0000 7f287a400640 1 --2- 172.21.15.144:0/4196073791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28740cf5b0 0x7f287415e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:08.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.678+0000 7f287a400640 1 --2- 172.21.15.144:0/4196073791 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f28740ce230 0x7f287414bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:08.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.678+0000 7f287a400640 1 -- 172.21.15.144:0/4196073791 >> 172.21.15.144:0/4196073791 conn(0x7f2874062cc0 msgr2=0x7f287406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:08.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.679+0000 7f287a400640 1 -- 172.21.15.144:0/4196073791 shutdown_connections 2024-09-11T23:21:08.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.679+0000 7f287a400640 1 -- 172.21.15.144:0/4196073791 wait complete. 2024-09-11T23:21:08.696 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-11T23:21:07.206040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231228,"kb_used_data":6664,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743492,"statfs":{"total":773094113280,"available":772857335808,"internally_reserved":0,"allocated":6823936,"data_stored":3500660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001940"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456550+0000","last_change":"2024-09-11T23:20:59.472164+0000","last_active":"2024-09-11T23:21:00.456550+0000","last_peered":"2024-09-11T23:21:00.456550+0000","last_clean":"2024-09-11T23:21:00.456550+0000","last_became_active":"2024-09-11T23:20:59.471476+0000","last_became_peered":"2024-09-11T23:20:59.471476+0000","last_unstale":"2024-09-11T23:21:00.456550+0000","last_undegraded":"2024-09-11T23:21:00.456550+0000","last_fullsized":"2024-09-11T23:21:00.456550+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:26.417418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871704+0000","last_change":"2024-09-11T23:20:59.467559+0000","last_active":"2024-09-11T23:21:00.871704+0000","last_peered":"2024-09-11T23:21:00.871704+0000","last_clean":"2024-09-11T23:21:00.871704+0000","last_became_active":"2024-09-11T23:20:59.467289+0000","last_became_peered":"2024-09-11T23:20:59.467289+0000","last_unstale":"2024-09-11T23:21:00.871704+0000","last_undegraded":"2024-09-11T23:21:00.871704+0000","last_fullsized":"2024-09-11T23:21:00.871704+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:31.251559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461728+0000","last_change":"2024-09-11T23:20:59.469746+0000","last_active":"2024-09-11T23:21:00.461728+0000","last_peered":"2024-09-11T23:21:00.461728+0000","last_clean":"2024-09-11T23:21:00.461728+0000","last_became_active":"2024-09-11T23:20:59.469438+0000","last_became_peered":"2024-09-11T23:20:59.469438+0000","last_unstale":"2024-09-11T23:21:00.461728+0000","last_undegraded":"2024-09-11T23:21:00.461728+0000","last_fullsized":"2024-09-11T23:21:00.461728+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:41.299611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461079+0000","last_change":"2024-09-11T23:20:59.468119+0000","last_active":"2024-09-11T23:21:00.461079+0000","last_peered":"2024-09-11T23:21:00.461079+0000","last_clean":"2024-09-11T23:21:00.461079+0000","last_became_active":"2024-09-11T23:20:59.467847+0000","last_became_peered":"2024-09-11T23:20:59.467847+0000","last_unstale":"2024-09-11T23:21:00.461079+0000","last_undegraded":"2024-09-11T23:21:00.461079+0000","last_fullsized":"2024-09-11T23:21:00.461079+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:27.032373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456756+0000","last_change":"2024-09-11T23:20:59.462985+0000","last_active":"2024-09-11T23:21:00.456756+0000","last_peered":"2024-09-11T23:21:00.456756+0000","last_clean":"2024-09-11T23:21:00.456756+0000","last_became_active":"2024-09-11T23:20:59.462699+0000","last_became_peered":"2024-09-11T23:20:59.462699+0000","last_unstale":"2024-09-11T23:21:00.456756+0000","last_undegraded":"2024-09-11T23:21:00.456756+0000","last_fullsized":"2024-09-11T23:21:00.456756+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:58.821334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301150+0000","last_change":"2024-09-11T23:20:59.466637+0000","last_active":"2024-09-11T23:21:01.301150+0000","last_peered":"2024-09-11T23:21:01.301150+0000","last_clean":"2024-09-11T23:21:01.301150+0000","last_became_active":"2024-09-11T23:20:59.466377+0000","last_became_peered":"2024-09-11T23:20:59.466377+0000","last_unstale":"2024-09-11T23:21:01.301150+0000","last_undegraded":"2024-09-11T23:21:01.301150+0000","last_fullsized":"2024-09-11T23:21:01.301150+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:15.154690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304460+0000","last_change":"2024-09-11T23:20:59.464854+0000","last_active":"2024-09-11T23:21:01.304460+0000","last_peered":"2024-09-11T23:21:01.304460+0000","last_clean":"2024-09-11T23:21:01.304460+0000","last_became_active":"2024-09-11T23:20:59.464585+0000","last_became_peered":"2024-09-11T23:20:59.464585+0000","last_unstale":"2024-09-11T23:21:01.304460+0000","last_undegraded":"2024-09-11T23:21:01.304460+0000","last_fullsized":"2024-09-11T23:21:01.304460+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:28.604088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871393+0000","last_change":"2024-09-11T23:20:59.461801+0000","last_active":"2024-09-11T23:21:00.871393+0000","last_peered":"2024-09-11T23:21:00.871393+0000","last_clean":"2024-09-11T23:21:00.871393+0000","last_became_active":"2024-09-11T23:20:59.461531+0000","last_became_peered":"2024-09-11T23:20:59.461531+0000","last_unstale":"2024-09-11T23:21:00.871393+0000","last_undegraded":"2024-09-11T23:21:00.871393+0000","last_fullsized":"2024-09-11T23:21:00.871393+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:44.244935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304807+0000","last_change":"2024-09-11T23:20:59.483367+0000","last_active":"2024-09-11T23:21:01.304807+0000","last_peered":"2024-09-11T23:21:01.304807+0000","last_clean":"2024-09-11T23:21:01.304807+0000","last_became_active":"2024-09-11T23:20:59.483009+0000","last_became_peered":"2024-09-11T23:20:59.483009+0000","last_unstale":"2024-09-11T23:21:01.304807+0000","last_undegraded":"2024-09-11T23:21:01.304807+0000","last_fullsized":"2024-09-11T23:21:01.304807+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:19.414229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304833+0000","last_change":"2024-09-11T23:20:59.453627+0000","last_active":"2024-09-11T23:21:01.304833+0000","last_peered":"2024-09-11T23:21:01.304833+0000","last_clean":"2024-09-11T23:21:01.304833+0000","last_became_active":"2024-09-11T23:20:59.453347+0000","last_became_peered":"2024-09-11T23:20:59.453347+0000","last_unstale":"2024-09-11T23:21:01.304833+0000","last_undegraded":"2024-09-11T23:21:01.304833+0000","last_fullsized":"2024-09-11T23:21:01.304833+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:30.477347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304724+0000","last_change":"2024-09-11T23:20:59.464084+0000","last_active":"2024-09-11T23:21:01.304724+0000","last_peered":"2024-09-11T23:21:01.304724+0000","last_clean":"2024-09-11T23:21:01.304724+0000","last_became_active":"2024-09-11T23:20:59.463816+0000","last_became_peered":"2024-09-11T23:20:59.463816+0000","last_unstale":"2024-09-11T23:21:01.304724+0000","last_undegraded":"2024-09-11T23:21:01.304724+0000","last_fullsized":"2024-09-11T23:21:01.304724+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:21.250647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461221+0000","last_change":"2024-09-11T23:20:59.467528+0000","last_active":"2024-09-11T23:21:00.461221+0000","last_peered":"2024-09-11T23:21:00.461221+0000","last_clean":"2024-09-11T23:21:00.461221+0000","last_became_active":"2024-09-11T23:20:59.467148+0000","last_became_peered":"2024-09-11T23:20:59.467148+0000","last_unstale":"2024-09-11T23:21:00.461221+0000","last_undegraded":"2024-09-11T23:21:00.461221+0000","last_fullsized":"2024-09-11T23:21:00.461221+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:17.572628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.804419+0000","last_change":"2024-09-11T23:20:59.471352+0000","last_active":"2024-09-11T23:21:00.804419+0000","last_peered":"2024-09-11T23:21:00.804419+0000","last_clean":"2024-09-11T23:21:00.804419+0000","last_became_active":"2024-09-11T23:20:59.470968+0000","last_became_peered":"2024-09-11T23:20:59.470968+0000","last_unstale":"2024-09-11T23:21:00.804419+0000","last_undegraded":"2024-09-11T23:21:00.804419+0000","last_fullsized":"2024-09-11T23:21:00.804419+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:28.453235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304745+0000","last_change":"2024-09-11T23:20:59.458141+0000","last_active":"2024-09-11T23:21:01.304745+0000","last_peered":"2024-09-11T23:21:01.304745+0000","last_clean":"2024-09-11T23:21:01.304745+0000","last_became_active":"2024-09-11T23:20:59.457853+0000","last_became_peered":"2024-09-11T23:20:59.457853+0000","last_unstale":"2024-09-11T23:21:01.304745+0000","last_undegraded":"2024-09-11T23:21:01.304745+0000","last_fullsized":"2024-09-11T23:21:01.304745+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:29.318776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304800+0000","last_change":"2024-09-11T23:20:59.457958+0000","last_active":"2024-09-11T23:21:01.304800+0000","last_peered":"2024-09-11T23:21:01.304800+0000","last_clean":"2024-09-11T23:21:01.304800+0000","last_became_active":"2024-09-11T23:20:59.457672+0000","last_became_peered":"2024-09-11T23:20:59.457672+0000","last_unstale":"2024-09-11T23:21:01.304800+0000","last_undegraded":"2024-09-11T23:21:01.304800+0000","last_fullsized":"2024-09-11T23:21:01.304800+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:07.195690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.300726+0000","last_change":"2024-09-11T23:20:59.479787+0000","last_active":"2024-09-11T23:21:01.300726+0000","last_peered":"2024-09-11T23:21:01.300726+0000","last_clean":"2024-09-11T23:21:01.300726+0000","last_became_active":"2024-09-11T23:20:59.469893+0000","last_became_peered":"2024-09-11T23:20:59.469893+0000","last_unstale":"2024-09-11T23:21:01.300726+0000","last_undegraded":"2024-09-11T23:21:01.300726+0000","last_fullsized":"2024-09-11T23:21:01.300726+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:12.645604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871858+0000","last_change":"2024-09-11T23:20:59.465949+0000","last_active":"2024-09-11T23:21:00.871858+0000","last_peered":"2024-09-11T23:21:00.871858+0000","last_clean":"2024-09-11T23:21:00.871858+0000","last_became_active":"2024-09-11T23:20:59.465251+0000","last_became_peered":"2024-09-11T23:20:59.465251+0000","last_unstale":"2024-09-11T23:21:00.871858+0000","last_undegraded":"2024-09-11T23:21:00.871858+0000","last_fullsized":"2024-09-11T23:21:00.871858+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:40.463156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461818+0000","last_change":"2024-09-11T23:20:59.469311+0000","last_active":"2024-09-11T23:21:00.461818+0000","last_peered":"2024-09-11T23:21:00.461818+0000","last_clean":"2024-09-11T23:21:00.461818+0000","last_became_active":"2024-09-11T23:20:59.468802+0000","last_became_peered":"2024-09-11T23:20:59.468802+0000","last_unstale":"2024-09-11T23:21:00.461818+0000","last_undegraded":"2024-09-11T23:21:00.461818+0000","last_fullsized":"2024-09-11T23:21:00.461818+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:47.861006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456586+0000","last_change":"2024-09-11T23:20:59.468862+0000","last_active":"2024-09-11T23:21:00.456586+0000","last_peered":"2024-09-11T23:21:00.456586+0000","last_clean":"2024-09-11T23:21:00.456586+0000","last_became_active":"2024-09-11T23:20:59.468588+0000","last_became_peered":"2024-09-11T23:20:59.468588+0000","last_unstale":"2024-09-11T23:21:00.456586+0000","last_undegraded":"2024-09-11T23:21:00.456586+0000","last_fullsized":"2024-09-11T23:21:00.456586+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:09.356677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871622+0000","last_change":"2024-09-11T23:20:59.468990+0000","last_active":"2024-09-11T23:21:00.871622+0000","last_peered":"2024-09-11T23:21:00.871622+0000","last_clean":"2024-09-11T23:21:00.871622+0000","last_became_active":"2024-09-11T23:20:59.468736+0000","last_became_peered":"2024-09-11T23:20:59.468736+0000","last_unstale":"2024-09-11T23:21:00.871622+0000","last_undegraded":"2024-09-11T23:21:00.871622+0000","last_fullsized":"2024-09-11T23:21:00.871622+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:08.951140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.460634+0000","last_change":"2024-09-11T23:20:59.477858+0000","last_active":"2024-09-11T23:21:00.460634+0000","last_peered":"2024-09-11T23:21:00.460634+0000","last_clean":"2024-09-11T23:21:00.460634+0000","last_became_active":"2024-09-11T23:20:59.477437+0000","last_became_peered":"2024-09-11T23:20:59.477437+0000","last_unstale":"2024-09-11T23:21:00.460634+0000","last_undegraded":"2024-09-11T23:21:00.460634+0000","last_fullsized":"2024-09-11T23:21:00.460634+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:49.797513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871537+0000","last_change":"2024-09-11T23:20:59.461667+0000","last_active":"2024-09-11T23:21:00.871537+0000","last_peered":"2024-09-11T23:21:00.871537+0000","last_clean":"2024-09-11T23:21:00.871537+0000","last_became_active":"2024-09-11T23:20:59.461421+0000","last_became_peered":"2024-09-11T23:20:59.461421+0000","last_unstale":"2024-09-11T23:21:00.871537+0000","last_undegraded":"2024-09-11T23:21:00.871537+0000","last_fullsized":"2024-09-11T23:21:00.871537+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:45.567676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.462207+0000","last_change":"2024-09-11T23:20:59.476578+0000","last_active":"2024-09-11T23:21:00.462207+0000","last_peered":"2024-09-11T23:21:00.462207+0000","last_clean":"2024-09-11T23:21:00.462207+0000","last_became_active":"2024-09-11T23:20:59.476300+0000","last_became_peered":"2024-09-11T23:20:59.476300+0000","last_unstale":"2024-09-11T23:21:00.462207+0000","last_undegraded":"2024-09-11T23:21:00.462207+0000","last_fullsized":"2024-09-11T23:21:00.462207+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:34.998360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.804183+0000","last_change":"2024-09-11T23:20:59.472368+0000","last_active":"2024-09-11T23:21:00.804183+0000","last_peered":"2024-09-11T23:21:00.804183+0000","last_clean":"2024-09-11T23:21:00.804183+0000","last_became_active":"2024-09-11T23:20:59.472087+0000","last_became_peered":"2024-09-11T23:20:59.472087+0000","last_unstale":"2024-09-11T23:21:00.804183+0000","last_undegraded":"2024-09-11T23:21:00.804183+0000","last_fullsized":"2024-09-11T23:21:00.804183+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:40.175218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456689+0000","last_change":"2024-09-11T23:20:59.472381+0000","last_active":"2024-09-11T23:21:00.456689+0000","last_peered":"2024-09-11T23:21:00.456689+0000","last_clean":"2024-09-11T23:21:00.456689+0000","last_became_active":"2024-09-11T23:20:59.471907+0000","last_became_peered":"2024-09-11T23:20:59.471907+0000","last_unstale":"2024-09-11T23:21:00.456689+0000","last_undegraded":"2024-09-11T23:21:00.456689+0000","last_fullsized":"2024-09-11T23:21:00.456689+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:03.162864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461642+0000","last_change":"2024-09-11T23:20:59.472931+0000","last_active":"2024-09-11T23:21:00.461642+0000","last_peered":"2024-09-11T23:21:00.461642+0000","last_clean":"2024-09-11T23:21:00.461642+0000","last_became_active":"2024-09-11T23:20:59.472664+0000","last_became_peered":"2024-09-11T23:20:59.472664+0000","last_unstale":"2024-09-11T23:21:00.461642+0000","last_undegraded":"2024-09-11T23:21:00.461642+0000","last_fullsized":"2024-09-11T23:21:00.461642+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:59.805119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301015+0000","last_change":"2024-09-11T23:20:59.473772+0000","last_active":"2024-09-11T23:21:01.301015+0000","last_peered":"2024-09-11T23:21:01.301015+0000","last_clean":"2024-09-11T23:21:01.301015+0000","last_became_active":"2024-09-11T23:20:59.473228+0000","last_became_peered":"2024-09-11T23:20:59.473228+0000","last_unstale":"2024-09-11T23:21:01.301015+0000","last_undegraded":"2024-09-11T23:21:01.301015+0000","last_fullsized":"2024-09-11T23:21:01.301015+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:08.772254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456643+0000","last_change":"2024-09-11T23:20:59.469067+0000","last_active":"2024-09-11T23:21:00.456643+0000","last_peered":"2024-09-11T23:21:00.456643+0000","last_clean":"2024-09-11T23:21:00.456643+0000","last_became_active":"2024-09-11T23:20:59.468802+0000","last_became_peered":"2024-09-11T23:20:59.468802+0000","last_unstale":"2024-09-11T23:21:00.456643+0000","last_undegraded":"2024-09-11T23:21:00.456643+0000","last_fullsized":"2024-09-11T23:21:00.456643+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:34.477242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871779+0000","last_change":"2024-09-11T23:20:59.466832+0000","last_active":"2024-09-11T23:21:00.871779+0000","last_peered":"2024-09-11T23:21:00.871779+0000","last_clean":"2024-09-11T23:21:00.871779+0000","last_became_active":"2024-09-11T23:20:59.466560+0000","last_became_peered":"2024-09-11T23:20:59.466560+0000","last_unstale":"2024-09-11T23:21:00.871779+0000","last_undegraded":"2024-09-11T23:21:00.871779+0000","last_fullsized":"2024-09-11T23:21:00.871779+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:42.410011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461928+0000","last_change":"2024-09-11T23:20:59.470126+0000","last_active":"2024-09-11T23:21:00.461928+0000","last_peered":"2024-09-11T23:21:00.461928+0000","last_clean":"2024-09-11T23:21:00.461928+0000","last_became_active":"2024-09-11T23:20:59.469730+0000","last_became_peered":"2024-09-11T23:20:59.469730+0000","last_unstale":"2024-09-11T23:21:00.461928+0000","last_undegraded":"2024-09-11T23:21:00.461928+0000","last_fullsized":"2024-09-11T23:21:00.461928+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:04.114941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.456362+0000","last_change":"2024-09-11T23:20:59.474680+0000","last_active":"2024-09-11T23:21:00.456362+0000","last_peered":"2024-09-11T23:21:00.456362+0000","last_clean":"2024-09-11T23:21:00.456362+0000","last_became_active":"2024-09-11T23:20:59.472530+0000","last_became_peered":"2024-09-11T23:20:59.472530+0000","last_unstale":"2024-09-11T23:21:00.456362+0000","last_undegraded":"2024-09-11T23:21:00.456362+0000","last_fullsized":"2024-09-11T23:21:00.456362+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:37.774651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.300768+0000","last_change":"2024-09-11T23:20:59.470791+0000","last_active":"2024-09-11T23:21:01.300768+0000","last_peered":"2024-09-11T23:21:01.300768+0000","last_clean":"2024-09-11T23:21:01.300768+0000","last_became_active":"2024-09-11T23:20:59.469829+0000","last_became_peered":"2024-09-11T23:20:59.469829+0000","last_unstale":"2024-09-11T23:21:01.300768+0000","last_undegraded":"2024-09-11T23:21:01.300768+0000","last_fullsized":"2024-09-11T23:21:01.300768+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:27.032373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301140+0000","last_change":"2024-09-11T23:20:59.481648+0000","last_active":"2024-09-11T23:21:01.301140+0000","last_peered":"2024-09-11T23:21:01.301140+0000","last_clean":"2024-09-11T23:21:01.301140+0000","last_became_active":"2024-09-11T23:20:59.473925+0000","last_became_peered":"2024-09-11T23:20:59.473925+0000","last_unstale":"2024-09-11T23:21:01.301140+0000","last_undegraded":"2024-09-11T23:21:01.301140+0000","last_fullsized":"2024-09-11T23:21:01.301140+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:59.805119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"58'4","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301076+0000","last_change":"2024-09-11T23:20:58.461846+0000","last_active":"2024-09-11T23:21:01.301076+0000","last_peered":"2024-09-11T23:21:01.301076+0000","last_clean":"2024-09-11T23:21:01.301076+0000","last_became_active":"2024-09-11T23:20:58.461591+0000","last_became_peered":"2024-09-11T23:20:58.461591+0000","last_unstale":"2024-09-11T23:21:01.301076+0000","last_undegraded":"2024-09-11T23:21:01.301076+0000","last_fullsized":"2024-09-11T23:21:01.301076+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:16.896074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304861+0000","last_change":"2024-09-11T23:20:59.474489+0000","last_active":"2024-09-11T23:21:01.304861+0000","last_peered":"2024-09-11T23:21:01.304861+0000","last_clean":"2024-09-11T23:21:01.304861+0000","last_became_active":"2024-09-11T23:20:59.474214+0000","last_became_peered":"2024-09-11T23:20:59.474214+0000","last_unstale":"2024-09-11T23:21:01.304861+0000","last_undegraded":"2024-09-11T23:21:01.304861+0000","last_fullsized":"2024-09-11T23:21:01.304861+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:28.604088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871666+0000","last_change":"2024-09-11T23:20:58.465371+0000","last_active":"2024-09-11T23:21:00.871666+0000","last_peered":"2024-09-11T23:21:00.871666+0000","last_clean":"2024-09-11T23:21:00.871666+0000","last_became_active":"2024-09-11T23:20:58.465117+0000","last_became_peered":"2024-09-11T23:20:58.465117+0000","last_unstale":"2024-09-11T23:21:00.871666+0000","last_undegraded":"2024-09-11T23:21:00.871666+0000","last_fullsized":"2024-09-11T23:21:00.871666+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:38.868184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.300948+0000","last_change":"2024-09-11T23:20:59.466735+0000","last_active":"2024-09-11T23:21:01.300948+0000","last_peered":"2024-09-11T23:21:01.300948+0000","last_clean":"2024-09-11T23:21:01.300948+0000","last_became_active":"2024-09-11T23:20:59.466364+0000","last_became_peered":"2024-09-11T23:20:59.466364+0000","last_unstale":"2024-09-11T23:21:01.300948+0000","last_undegraded":"2024-09-11T23:21:01.300948+0000","last_fullsized":"2024-09-11T23:21:01.300948+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:29.787221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301327+0000","last_change":"2024-09-11T23:20:58.460984+0000","last_active":"2024-09-11T23:21:01.301327+0000","last_peered":"2024-09-11T23:21:01.301327+0000","last_clean":"2024-09-11T23:21:01.301327+0000","last_became_active":"2024-09-11T23:20:58.460659+0000","last_became_peered":"2024-09-11T23:20:58.460659+0000","last_unstale":"2024-09-11T23:21:01.301327+0000","last_undegraded":"2024-09-11T23:21:01.301327+0000","last_fullsized":"2024-09-11T23:21:01.301327+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:15.242284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301226+0000","last_change":"2024-09-11T23:20:59.481098+0000","last_active":"2024-09-11T23:21:01.301226+0000","last_peered":"2024-09-11T23:21:01.301226+0000","last_clean":"2024-09-11T23:21:01.301226+0000","last_became_active":"2024-09-11T23:20:59.480821+0000","last_became_peered":"2024-09-11T23:20:59.480821+0000","last_unstale":"2024-09-11T23:21:01.301226+0000","last_undegraded":"2024-09-11T23:21:01.301226+0000","last_fullsized":"2024-09-11T23:21:01.301226+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:26.537084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461205+0000","last_change":"2024-09-11T23:20:58.462668+0000","last_active":"2024-09-11T23:21:00.461205+0000","last_peered":"2024-09-11T23:21:00.461205+0000","last_clean":"2024-09-11T23:21:00.461205+0000","last_became_active":"2024-09-11T23:20:58.462349+0000","last_became_peered":"2024-09-11T23:20:58.462349+0000","last_unstale":"2024-09-11T23:21:00.461205+0000","last_undegraded":"2024-09-11T23:21:00.461205+0000","last_fullsized":"2024-09-11T23:21:00.461205+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:16.896074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871423+0000","last_change":"2024-09-11T23:20:59.461146+0000","last_active":"2024-09-11T23:21:00.871423+0000","last_peered":"2024-09-11T23:21:00.871423+0000","last_clean":"2024-09-11T23:21:00.871423+0000","last_became_active":"2024-09-11T23:20:59.460868+0000","last_became_peered":"2024-09-11T23:20:59.460868+0000","last_unstale":"2024-09-11T23:21:00.871423+0000","last_undegraded":"2024-09-11T23:21:00.871423+0000","last_fullsized":"2024-09-11T23:21:00.871423+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:12.270988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304403+0000","last_change":"2024-09-11T23:20:58.459200+0000","last_active":"2024-09-11T23:21:01.304403+0000","last_peered":"2024-09-11T23:21:01.304403+0000","last_clean":"2024-09-11T23:21:01.304403+0000","last_became_active":"2024-09-11T23:20:58.458940+0000","last_became_peered":"2024-09-11T23:20:58.458940+0000","last_unstale":"2024-09-11T23:21:01.304403+0000","last_undegraded":"2024-09-11T23:21:01.304403+0000","last_fullsized":"2024-09-11T23:21:01.304403+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:24.686226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871421+0000","last_change":"2024-09-11T23:20:59.471438+0000","last_active":"2024-09-11T23:21:00.871421+0000","last_peered":"2024-09-11T23:21:00.871421+0000","last_clean":"2024-09-11T23:21:00.871421+0000","last_became_active":"2024-09-11T23:20:59.471170+0000","last_became_peered":"2024-09-11T23:20:59.471170+0000","last_unstale":"2024-09-11T23:21:00.871421+0000","last_undegraded":"2024-09-11T23:21:00.871421+0000","last_fullsized":"2024-09-11T23:21:00.871421+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:52.111971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.300854+0000","last_change":"2024-09-11T23:20:58.459414+0000","last_active":"2024-09-11T23:21:01.300854+0000","last_peered":"2024-09-11T23:21:01.300854+0000","last_clean":"2024-09-11T23:21:01.300854+0000","last_became_active":"2024-09-11T23:20:58.459152+0000","last_became_peered":"2024-09-11T23:20:58.459152+0000","last_unstale":"2024-09-11T23:21:01.300854+0000","last_undegraded":"2024-09-11T23:21:01.300854+0000","last_fullsized":"2024-09-11T23:21:01.300854+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:27.596347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.804234+0000","last_change":"2024-09-11T23:20:59.464299+0000","last_active":"2024-09-11T23:21:00.804234+0000","last_peered":"2024-09-11T23:21:00.804234+0000","last_clean":"2024-09-11T23:21:00.804234+0000","last_became_active":"2024-09-11T23:20:59.463578+0000","last_became_peered":"2024-09-11T23:20:59.463578+0000","last_unstale":"2024-09-11T23:21:00.804234+0000","last_undegraded":"2024-09-11T23:21:00.804234+0000","last_fullsized":"2024-09-11T23:21:00.804234+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:30.660243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.460481+0000","last_change":"2024-09-11T23:20:58.462986+0000","last_active":"2024-09-11T23:21:00.460481+0000","last_peered":"2024-09-11T23:21:00.460481+0000","last_clean":"2024-09-11T23:21:00.460481+0000","last_became_active":"2024-09-11T23:20:58.462292+0000","last_became_peered":"2024-09-11T23:20:58.462292+0000","last_unstale":"2024-09-11T23:21:00.460481+0000","last_undegraded":"2024-09-11T23:21:00.460481+0000","last_fullsized":"2024-09-11T23:21:00.460481+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.187950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871431+0000","last_change":"2024-09-11T23:20:59.461080+0000","last_active":"2024-09-11T23:21:00.871431+0000","last_peered":"2024-09-11T23:21:00.871431+0000","last_clean":"2024-09-11T23:21:00.871431+0000","last_became_active":"2024-09-11T23:20:59.460840+0000","last_became_peered":"2024-09-11T23:20:59.460840+0000","last_unstale":"2024-09-11T23:21:00.871431+0000","last_undegraded":"2024-09-11T23:21:00.871431+0000","last_fullsized":"2024-09-11T23:21:00.871431+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:06.473547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304485+0000","last_change":"2024-09-11T23:20:58.462888+0000","last_active":"2024-09-11T23:21:01.304485+0000","last_peered":"2024-09-11T23:21:01.304485+0000","last_clean":"2024-09-11T23:21:01.304485+0000","last_became_active":"2024-09-11T23:20:58.462609+0000","last_became_peered":"2024-09-11T23:20:58.462609+0000","last_unstale":"2024-09-11T23:21:01.304485+0000","last_undegraded":"2024-09-11T23:21:01.304485+0000","last_fullsized":"2024-09-11T23:21:01.304485+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:29.652502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304853+0000","last_change":"2024-09-11T23:20:59.458893+0000","last_active":"2024-09-11T23:21:01.304853+0000","last_peered":"2024-09-11T23:21:01.304853+0000","last_clean":"2024-09-11T23:21:01.304853+0000","last_became_active":"2024-09-11T23:20:59.458626+0000","last_became_peered":"2024-09-11T23:20:59.458626+0000","last_unstale":"2024-09-11T23:21:01.304853+0000","last_undegraded":"2024-09-11T23:21:01.304853+0000","last_fullsized":"2024-09-11T23:21:01.304853+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:17.903814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461762+0000","last_change":"2024-09-11T23:20:58.473089+0000","last_active":"2024-09-11T23:21:00.461762+0000","last_peered":"2024-09-11T23:21:00.461762+0000","last_clean":"2024-09-11T23:21:00.461762+0000","last_became_active":"2024-09-11T23:20:58.472866+0000","last_became_peered":"2024-09-11T23:20:58.472866+0000","last_unstale":"2024-09-11T23:21:00.461762+0000","last_undegraded":"2024-09-11T23:21:00.461762+0000","last_fullsized":"2024-09-11T23:21:00.461762+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:24.239996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461649+0000","last_change":"2024-09-11T23:20:59.480062+0000","last_active":"2024-09-11T23:21:00.461649+0000","last_peered":"2024-09-11T23:21:00.461649+0000","last_clean":"2024-09-11T23:21:00.461649+0000","last_became_active":"2024-09-11T23:20:59.479528+0000","last_became_peered":"2024-09-11T23:20:59.479528+0000","last_unstale":"2024-09-11T23:21:00.461649+0000","last_undegraded":"2024-09-11T23:21:00.461649+0000","last_fullsized":"2024-09-11T23:21:00.461649+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:26.537084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871771+0000","last_change":"2024-09-11T23:20:58.466599+0000","last_active":"2024-09-11T23:21:00.871771+0000","last_peered":"2024-09-11T23:21:00.871771+0000","last_clean":"2024-09-11T23:21:00.871771+0000","last_became_active":"2024-09-11T23:20:58.466282+0000","last_became_peered":"2024-09-11T23:20:58.466282+0000","last_unstale":"2024-09-11T23:21:00.871771+0000","last_undegraded":"2024-09-11T23:21:00.871771+0000","last_fullsized":"2024-09-11T23:21:00.871771+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:39.888169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304586+0000","last_change":"2024-09-11T23:20:59.471056+0000","last_active":"2024-09-11T23:21:01.304586+0000","last_peered":"2024-09-11T23:21:01.304586+0000","last_clean":"2024-09-11T23:21:01.304586+0000","last_became_active":"2024-09-11T23:20:59.470167+0000","last_became_peered":"2024-09-11T23:20:59.470167+0000","last_unstale":"2024-09-11T23:21:01.304586+0000","last_undegraded":"2024-09-11T23:21:01.304586+0000","last_fullsized":"2024-09-11T23:21:01.304586+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:31.141653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"58'3","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.462041+0000","last_change":"2024-09-11T23:20:58.466818+0000","last_active":"2024-09-11T23:21:00.462041+0000","last_peered":"2024-09-11T23:21:00.462041+0000","last_clean":"2024-09-11T23:21:00.462041+0000","last_became_active":"2024-09-11T23:20:58.466361+0000","last_became_peered":"2024-09-11T23:20:58.466361+0000","last_unstale":"2024-09-11T23:21:00.462041+0000","last_undegraded":"2024-09-11T23:21:00.462041+0000","last_fullsized":"2024-09-11T23:21:00.462041+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:43.819715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461940+0000","last_change":"2024-09-11T23:20:59.483767+0000","last_active":"2024-09-11T23:21:00.461940+0000","last_peered":"2024-09-11T23:21:00.461940+0000","last_clean":"2024-09-11T23:21:00.461940+0000","last_became_active":"2024-09-11T23:20:59.483431+0000","last_became_peered":"2024-09-11T23:20:59.483431+0000","last_unstale":"2024-09-11T23:21:00.461940+0000","last_undegraded":"2024-09-11T23:21:00.461940+0000","last_fullsized":"2024-09-11T23:21:00.461940+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:19.903015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"58'6","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304656+0000","last_change":"2024-09-11T23:20:58.456875+0000","last_active":"2024-09-11T23:21:01.304656+0000","last_peered":"2024-09-11T23:21:01.304656+0000","last_clean":"2024-09-11T23:21:01.304656+0000","last_became_active":"2024-09-11T23:20:58.456579+0000","last_became_peered":"2024-09-11T23:20:58.456579+0000","last_unstale":"2024-09-11T23:21:01.304656+0000","last_undegraded":"2024-09-11T23:21:01.304656+0000","last_fullsized":"2024-09-11T23:21:01.304656+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:39.167478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.460587+0000","last_change":"2024-09-11T23:20:59.469201+0000","last_active":"2024-09-11T23:21:00.460587+0000","last_peered":"2024-09-11T23:21:00.460587+0000","last_clean":"2024-09-11T23:21:00.460587+0000","last_became_active":"2024-09-11T23:20:59.468613+0000","last_became_peered":"2024-09-11T23:20:59.468613+0000","last_unstale":"2024-09-11T23:21:00.460587+0000","last_undegraded":"2024-09-11T23:21:00.460587+0000","last_fullsized":"2024-09-11T23:21:00.460587+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:50.314018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871362+0000","last_change":"2024-09-11T23:20:58.467171+0000","last_active":"2024-09-11T23:21:00.871362+0000","last_peered":"2024-09-11T23:21:00.871362+0000","last_clean":"2024-09-11T23:21:00.871362+0000","last_became_active":"2024-09-11T23:20:58.466901+0000","last_became_peered":"2024-09-11T23:20:58.466901+0000","last_unstale":"2024-09-11T23:21:00.871362+0000","last_undegraded":"2024-09-11T23:21:00.871362+0000","last_fullsized":"2024-09-11T23:21:00.871362+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:42.485376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461292+0000","last_change":"2024-09-11T23:20:59.467990+0000","last_active":"2024-09-11T23:21:00.461292+0000","last_peered":"2024-09-11T23:21:00.461292+0000","last_clean":"2024-09-11T23:21:00.461292+0000","last_became_active":"2024-09-11T23:20:59.467663+0000","last_became_peered":"2024-09-11T23:20:59.467663+0000","last_unstale":"2024-09-11T23:21:00.461292+0000","last_undegraded":"2024-09-11T23:21:00.461292+0000","last_fullsized":"2024-09-11T23:21:00.461292+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:59.805119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.804234+0000","last_change":"2024-09-11T23:20:58.463853+0000","last_active":"2024-09-11T23:21:00.804234+0000","last_peered":"2024-09-11T23:21:00.804234+0000","last_clean":"2024-09-11T23:21:00.804234+0000","last_became_active":"2024-09-11T23:20:58.463592+0000","last_became_peered":"2024-09-11T23:20:58.463592+0000","last_unstale":"2024-09-11T23:21:00.804234+0000","last_undegraded":"2024-09-11T23:21:00.804234+0000","last_fullsized":"2024-09-11T23:21:00.804234+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:08.131569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304381+0000","last_change":"2024-09-11T23:20:59.465985+0000","last_active":"2024-09-11T23:21:01.304381+0000","last_peered":"2024-09-11T23:21:01.304381+0000","last_clean":"2024-09-11T23:21:01.304381+0000","last_became_active":"2024-09-11T23:20:59.465623+0000","last_became_peered":"2024-09-11T23:20:59.465623+0000","last_unstale":"2024-09-11T23:21:01.304381+0000","last_undegraded":"2024-09-11T23:21:01.304381+0000","last_fullsized":"2024-09-11T23:21:01.304381+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:30.477347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.460595+0000","last_change":"2024-09-11T23:20:58.463387+0000","last_active":"2024-09-11T23:21:00.460595+0000","last_peered":"2024-09-11T23:21:00.460595+0000","last_clean":"2024-09-11T23:21:00.460595+0000","last_became_active":"2024-09-11T23:20:58.463106+0000","last_became_peered":"2024-09-11T23:20:58.463106+0000","last_unstale":"2024-09-11T23:21:00.460595+0000","last_undegraded":"2024-09-11T23:21:00.460595+0000","last_fullsized":"2024-09-11T23:21:00.460595+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:18.406488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.462247+0000","last_change":"2024-09-11T23:20:59.476552+0000","last_active":"2024-09-11T23:21:00.462247+0000","last_peered":"2024-09-11T23:21:00.462247+0000","last_clean":"2024-09-11T23:21:00.462247+0000","last_became_active":"2024-09-11T23:20:59.476173+0000","last_became_peered":"2024-09-11T23:20:59.476173+0000","last_unstale":"2024-09-11T23:21:00.462247+0000","last_undegraded":"2024-09-11T23:21:00.462247+0000","last_fullsized":"2024-09-11T23:21:00.462247+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:28.663368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"58'8","reported_seq":22,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.460463+0000","last_change":"2024-09-11T23:20:58.467986+0000","last_active":"2024-09-11T23:21:00.460463+0000","last_peered":"2024-09-11T23:21:00.460463+0000","last_clean":"2024-09-11T23:21:00.460463+0000","last_became_active":"2024-09-11T23:20:58.466944+0000","last_became_peered":"2024-09-11T23:20:58.466944+0000","last_unstale":"2024-09-11T23:21:00.460463+0000","last_undegraded":"2024-09-11T23:21:00.460463+0000","last_fullsized":"2024-09-11T23:21:00.460463+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:06.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461902+0000","last_change":"2024-09-11T23:20:59.472856+0000","last_active":"2024-09-11T23:21:00.461902+0000","last_peered":"2024-09-11T23:21:00.461902+0000","last_clean":"2024-09-11T23:21:00.461902+0000","last_became_active":"2024-09-11T23:20:59.471121+0000","last_became_peered":"2024-09-11T23:20:59.471121+0000","last_unstale":"2024-09-11T23:21:00.461902+0000","last_undegraded":"2024-09-11T23:21:00.461902+0000","last_fullsized":"2024-09-11T23:21:00.461902+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:50.781443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871796+0000","last_change":"2024-09-11T23:20:58.466456+0000","last_active":"2024-09-11T23:21:00.871796+0000","last_peered":"2024-09-11T23:21:00.871796+0000","last_clean":"2024-09-11T23:21:00.871796+0000","last_became_active":"2024-09-11T23:20:58.466200+0000","last_became_peered":"2024-09-11T23:20:58.466200+0000","last_unstale":"2024-09-11T23:21:00.871796+0000","last_undegraded":"2024-09-11T23:21:00.871796+0000","last_fullsized":"2024-09-11T23:21:00.871796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:23.944565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461677+0000","last_change":"2024-09-11T23:20:59.466534+0000","last_active":"2024-09-11T23:21:00.461677+0000","last_peered":"2024-09-11T23:21:00.461677+0000","last_clean":"2024-09-11T23:21:00.461677+0000","last_became_active":"2024-09-11T23:20:59.466243+0000","last_became_peered":"2024-09-11T23:20:59.466243+0000","last_unstale":"2024-09-11T23:21:00.461677+0000","last_undegraded":"2024-09-11T23:21:00.461677+0000","last_fullsized":"2024-09-11T23:21:00.461677+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:08.772254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301109+0000","last_change":"2024-09-11T23:20:58.468458+0000","last_active":"2024-09-11T23:21:01.301109+0000","last_peered":"2024-09-11T23:21:01.301109+0000","last_clean":"2024-09-11T23:21:01.301109+0000","last_became_active":"2024-09-11T23:20:58.468206+0000","last_became_peered":"2024-09-11T23:20:58.468206+0000","last_unstale":"2024-09-11T23:21:01.301109+0000","last_undegraded":"2024-09-11T23:21:01.301109+0000","last_fullsized":"2024-09-11T23:21:01.301109+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:06.187950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871909+0000","last_change":"2024-09-11T23:20:59.462675+0000","last_active":"2024-09-11T23:21:00.871909+0000","last_peered":"2024-09-11T23:21:00.871909+0000","last_clean":"2024-09-11T23:21:00.871909+0000","last_became_active":"2024-09-11T23:20:59.462426+0000","last_became_peered":"2024-09-11T23:20:59.462426+0000","last_unstale":"2024-09-11T23:21:00.871909+0000","last_undegraded":"2024-09-11T23:21:00.871909+0000","last_fullsized":"2024-09-11T23:21:00.871909+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:13.970806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461521+0000","last_change":"2024-09-11T23:20:58.467884+0000","last_active":"2024-09-11T23:21:00.461521+0000","last_peered":"2024-09-11T23:21:00.461521+0000","last_clean":"2024-09-11T23:21:00.461521+0000","last_became_active":"2024-09-11T23:20:58.467589+0000","last_became_peered":"2024-09-11T23:20:58.467589+0000","last_unstale":"2024-09-11T23:21:00.461521+0000","last_undegraded":"2024-09-11T23:21:00.461521+0000","last_fullsized":"2024-09-11T23:21:00.461521+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:06.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.462079+0000","last_change":"2024-09-11T23:20:59.483962+0000","last_active":"2024-09-11T23:21:00.462079+0000","last_peered":"2024-09-11T23:21:00.462079+0000","last_clean":"2024-09-11T23:21:00.462079+0000","last_became_active":"2024-09-11T23:20:59.483698+0000","last_became_peered":"2024-09-11T23:20:59.483698+0000","last_unstale":"2024-09-11T23:21:00.462079+0000","last_undegraded":"2024-09-11T23:21:00.462079+0000","last_fullsized":"2024-09-11T23:21:00.462079+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:20.950173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301131+0000","last_change":"2024-09-11T23:20:58.464827+0000","last_active":"2024-09-11T23:21:01.301131+0000","last_peered":"2024-09-11T23:21:01.301131+0000","last_clean":"2024-09-11T23:21:01.301131+0000","last_became_active":"2024-09-11T23:20:58.464593+0000","last_became_peered":"2024-09-11T23:20:58.464593+0000","last_unstale":"2024-09-11T23:21:01.301131+0000","last_undegraded":"2024-09-11T23:21:01.301131+0000","last_fullsized":"2024-09-11T23:21:01.301131+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:28.311036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.460841+0000","last_change":"2024-09-11T23:20:59.468489+0000","last_active":"2024-09-11T23:21:00.460841+0000","last_peered":"2024-09-11T23:21:00.460841+0000","last_clean":"2024-09-11T23:21:00.460841+0000","last_became_active":"2024-09-11T23:20:59.466325+0000","last_became_peered":"2024-09-11T23:20:59.466325+0000","last_unstale":"2024-09-11T23:21:00.460841+0000","last_undegraded":"2024-09-11T23:21:00.460841+0000","last_fullsized":"2024-09-11T23:21:00.460841+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:12.645604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871522+0000","last_change":"2024-09-11T23:20:58.461629+0000","last_active":"2024-09-11T23:21:00.871522+0000","last_peered":"2024-09-11T23:21:00.871522+0000","last_clean":"2024-09-11T23:21:00.871522+0000","last_became_active":"2024-09-11T23:20:58.461361+0000","last_became_peered":"2024-09-11T23:20:58.461361+0000","last_unstale":"2024-09-11T23:21:00.871522+0000","last_undegraded":"2024-09-11T23:21:00.871522+0000","last_fullsized":"2024-09-11T23:21:00.871522+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:39.804195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301132+0000","last_change":"2024-09-11T23:20:59.469343+0000","last_active":"2024-09-11T23:21:01.301132+0000","last_peered":"2024-09-11T23:21:01.301132+0000","last_clean":"2024-09-11T23:21:01.301132+0000","last_became_active":"2024-09-11T23:20:59.468913+0000","last_became_peered":"2024-09-11T23:20:59.468913+0000","last_unstale":"2024-09-11T23:21:01.301132+0000","last_undegraded":"2024-09-11T23:21:01.301132+0000","last_fullsized":"2024-09-11T23:21:01.301132+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:49.797513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304448+0000","last_change":"2024-09-11T23:20:58.461264+0000","last_active":"2024-09-11T23:21:01.304448+0000","last_peered":"2024-09-11T23:21:01.304448+0000","last_clean":"2024-09-11T23:21:01.304448+0000","last_became_active":"2024-09-11T23:20:58.461014+0000","last_became_peered":"2024-09-11T23:20:58.461014+0000","last_unstale":"2024-09-11T23:21:01.304448+0000","last_undegraded":"2024-09-11T23:21:01.304448+0000","last_fullsized":"2024-09-11T23:21:01.304448+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:44.688791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.300873+0000","last_change":"2024-09-11T23:20:59.473514+0000","last_active":"2024-09-11T23:21:01.300873+0000","last_peered":"2024-09-11T23:21:01.300873+0000","last_clean":"2024-09-11T23:21:01.300873+0000","last_became_active":"2024-09-11T23:20:59.469945+0000","last_became_peered":"2024-09-11T23:20:59.469945+0000","last_unstale":"2024-09-11T23:21:01.300873+0000","last_undegraded":"2024-09-11T23:21:01.300873+0000","last_fullsized":"2024-09-11T23:21:01.300873+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:17.572628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.460213+0000","last_change":"2024-09-11T23:20:58.465129+0000","last_active":"2024-09-11T23:21:00.460213+0000","last_peered":"2024-09-11T23:21:00.460213+0000","last_clean":"2024-09-11T23:21:00.460213+0000","last_became_active":"2024-09-11T23:20:58.464847+0000","last_became_peered":"2024-09-11T23:20:58.464847+0000","last_unstale":"2024-09-11T23:21:00.460213+0000","last_undegraded":"2024-09-11T23:21:00.460213+0000","last_fullsized":"2024-09-11T23:21:00.460213+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:58.558566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461433+0000","last_change":"2024-09-11T23:20:59.470013+0000","last_active":"2024-09-11T23:21:00.461433+0000","last_peered":"2024-09-11T23:21:00.461433+0000","last_clean":"2024-09-11T23:21:00.461433+0000","last_became_active":"2024-09-11T23:20:59.469672+0000","last_became_peered":"2024-09-11T23:20:59.469672+0000","last_unstale":"2024-09-11T23:21:00.461433+0000","last_undegraded":"2024-09-11T23:21:00.461433+0000","last_fullsized":"2024-09-11T23:21:00.461433+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:29.787221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304914+0000","last_change":"2024-09-11T23:20:58.461093+0000","last_active":"2024-09-11T23:21:01.304914+0000","last_peered":"2024-09-11T23:21:01.304914+0000","last_clean":"2024-09-11T23:21:01.304914+0000","last_became_active":"2024-09-11T23:20:58.460732+0000","last_became_peered":"2024-09-11T23:20:58.460732+0000","last_unstale":"2024-09-11T23:21:01.304914+0000","last_undegraded":"2024-09-11T23:21:01.304914+0000","last_fullsized":"2024-09-11T23:21:01.304914+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:24.686226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461521+0000","last_change":"2024-09-11T23:20:59.467473+0000","last_active":"2024-09-11T23:21:00.461521+0000","last_peered":"2024-09-11T23:21:00.461521+0000","last_clean":"2024-09-11T23:21:00.461521+0000","last_became_active":"2024-09-11T23:20:59.467131+0000","last_became_peered":"2024-09-11T23:20:59.467131+0000","last_unstale":"2024-09-11T23:21:00.461521+0000","last_undegraded":"2024-09-11T23:21:00.461521+0000","last_fullsized":"2024-09-11T23:21:00.461521+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:49.797513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"59'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301302+0000","last_change":"2024-09-11T23:20:58.464274+0000","last_active":"2024-09-11T23:21:01.301302+0000","last_peered":"2024-09-11T23:21:01.301302+0000","last_clean":"2024-09-11T23:21:01.301302+0000","last_became_active":"2024-09-11T23:20:58.462488+0000","last_became_peered":"2024-09-11T23:20:58.462488+0000","last_unstale":"2024-09-11T23:21:01.301302+0000","last_undegraded":"2024-09-11T23:21:01.301302+0000","last_fullsized":"2024-09-11T23:21:01.301302+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:18.406488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304616+0000","last_change":"2024-09-11T23:20:59.458086+0000","last_active":"2024-09-11T23:21:01.304616+0000","last_peered":"2024-09-11T23:21:01.304616+0000","last_clean":"2024-09-11T23:21:01.304616+0000","last_became_active":"2024-09-11T23:20:59.457548+0000","last_became_peered":"2024-09-11T23:20:59.457548+0000","last_unstale":"2024-09-11T23:21:01.304616+0000","last_undegraded":"2024-09-11T23:21:01.304616+0000","last_fullsized":"2024-09-11T23:21:01.304616+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:22.679717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.804460+0000","last_change":"2024-09-11T23:20:58.461597+0000","last_active":"2024-09-11T23:21:00.804460+0000","last_peered":"2024-09-11T23:21:00.804460+0000","last_clean":"2024-09-11T23:21:00.804460+0000","last_became_active":"2024-09-11T23:20:58.460572+0000","last_became_peered":"2024-09-11T23:20:58.460572+0000","last_unstale":"2024-09-11T23:21:00.804460+0000","last_undegraded":"2024-09-11T23:21:00.804460+0000","last_fullsized":"2024-09-11T23:21:00.804460+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:41.170235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.301291+0000","last_change":"2024-09-11T23:20:59.483140+0000","last_active":"2024-09-11T23:21:01.301291+0000","last_peered":"2024-09-11T23:21:01.301291+0000","last_clean":"2024-09-11T23:21:01.301291+0000","last_became_active":"2024-09-11T23:20:59.482447+0000","last_became_peered":"2024-09-11T23:20:59.482447+0000","last_unstale":"2024-09-11T23:21:01.301291+0000","last_undegraded":"2024-09-11T23:21:01.301291+0000","last_fullsized":"2024-09-11T23:21:01.301291+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:41.299611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461355+0000","last_change":"2024-09-11T23:20:58.460325+0000","last_active":"2024-09-11T23:21:00.461355+0000","last_peered":"2024-09-11T23:21:00.461355+0000","last_clean":"2024-09-11T23:21:00.461355+0000","last_became_active":"2024-09-11T23:20:58.459535+0000","last_became_peered":"2024-09-11T23:20:58.459535+0000","last_unstale":"2024-09-11T23:21:00.461355+0000","last_undegraded":"2024-09-11T23:21:00.461355+0000","last_fullsized":"2024-09-11T23:21:00.461355+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:15.242284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871771+0000","last_change":"2024-09-11T23:20:59.467890+0000","last_active":"2024-09-11T23:21:00.871771+0000","last_peered":"2024-09-11T23:21:00.871771+0000","last_clean":"2024-09-11T23:21:00.871771+0000","last_became_active":"2024-09-11T23:20:59.467620+0000","last_became_peered":"2024-09-11T23:20:59.467620+0000","last_unstale":"2024-09-11T23:21:00.871771+0000","last_undegraded":"2024-09-11T23:21:00.871771+0000","last_fullsized":"2024-09-11T23:21:00.871771+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:28.913027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304380+0000","last_change":"2024-09-11T23:20:58.461187+0000","last_active":"2024-09-11T23:21:01.304380+0000","last_peered":"2024-09-11T23:21:01.304380+0000","last_clean":"2024-09-11T23:21:01.304380+0000","last_became_active":"2024-09-11T23:20:58.460890+0000","last_became_peered":"2024-09-11T23:20:58.460890+0000","last_unstale":"2024-09-11T23:21:01.304380+0000","last_undegraded":"2024-09-11T23:21:01.304380+0000","last_fullsized":"2024-09-11T23:21:01.304380+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:08.131569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.461556+0000","last_change":"2024-09-11T23:20:59.475905+0000","last_active":"2024-09-11T23:21:00.461556+0000","last_peered":"2024-09-11T23:21:00.461556+0000","last_clean":"2024-09-11T23:21:00.461556+0000","last_became_active":"2024-09-11T23:20:59.475545+0000","last_became_peered":"2024-09-11T23:20:59.475545+0000","last_unstale":"2024-09-11T23:21:00.461556+0000","last_undegraded":"2024-09-11T23:21:00.461556+0000","last_fullsized":"2024-09-11T23:21:00.461556+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:15.154690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304483+0000","last_change":"2024-09-11T23:20:58.458608+0000","last_active":"2024-09-11T23:21:01.304483+0000","last_peered":"2024-09-11T23:21:01.304483+0000","last_clean":"2024-09-11T23:21:01.304483+0000","last_became_active":"2024-09-11T23:20:58.458251+0000","last_became_peered":"2024-09-11T23:20:58.458251+0000","last_unstale":"2024-09-11T23:21:01.304483+0000","last_undegraded":"2024-09-11T23:21:01.304483+0000","last_fullsized":"2024-09-11T23:21:01.304483+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:04:14.569214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304336+0000","last_change":"2024-09-11T23:20:59.458596+0000","last_active":"2024-09-11T23:21:01.304336+0000","last_peered":"2024-09-11T23:21:01.304336+0000","last_clean":"2024-09-11T23:21:01.304336+0000","last_became_active":"2024-09-11T23:20:59.458329+0000","last_became_peered":"2024-09-11T23:20:59.458329+0000","last_unstale":"2024-09-11T23:21:01.304336+0000","last_undegraded":"2024-09-11T23:21:01.304336+0000","last_fullsized":"2024-09-11T23:21:01.304336+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:39.929849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:01.304408+0000","last_change":"2024-09-11T23:20:58.463594+0000","last_active":"2024-09-11T23:21:01.304408+0000","last_peered":"2024-09-11T23:21:01.304408+0000","last_clean":"2024-09-11T23:21:01.304408+0000","last_became_active":"2024-09-11T23:20:58.463332+0000","last_became_peered":"2024-09-11T23:20:58.463332+0000","last_unstale":"2024-09-11T23:21:01.304408+0000","last_undegraded":"2024-09-11T23:21:01.304408+0000","last_fullsized":"2024-09-11T23:21:01.304408+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:36.012797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871544+0000","last_change":"2024-09-11T23:20:59.460002+0000","last_active":"2024-09-11T23:21:00.871544+0000","last_peered":"2024-09-11T23:21:00.871544+0000","last_clean":"2024-09-11T23:21:00.871544+0000","last_became_active":"2024-09-11T23:20:59.459757+0000","last_became_peered":"2024-09-11T23:20:59.459757+0000","last_unstale":"2024-09-11T23:21:00.871544+0000","last_undegraded":"2024-09-11T23:21:00.871544+0000","last_fullsized":"2024-09-11T23:21:00.871544+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:05:39.798888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871522+0000","last_change":"2024-09-11T23:20:58.467356+0000","last_active":"2024-09-11T23:21:00.871522+0000","last_peered":"2024-09-11T23:21:00.871522+0000","last_clean":"2024-09-11T23:21:00.871522+0000","last_became_active":"2024-09-11T23:20:58.465829+0000","last_became_peered":"2024-09-11T23:20:58.465829+0000","last_unstale":"2024-09-11T23:21:00.871522+0000","last_undegraded":"2024-09-11T23:21:00.871522+0000","last_fullsized":"2024-09-11T23:21:00.871522+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:06.639194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.871420+0000","last_change":"2024-09-11T23:20:59.474473+0000","last_active":"2024-09-11T23:21:00.871420+0000","last_peered":"2024-09-11T23:21:00.871420+0000","last_clean":"2024-09-11T23:21:00.871420+0000","last_became_active":"2024-09-11T23:20:59.474176+0000","last_became_peered":"2024-09-11T23:20:59.474176+0000","last_unstale":"2024-09-11T23:21:00.871420+0000","last_undegraded":"2024-09-11T23:21:00.871420+0000","last_fullsized":"2024-09-11T23:21:00.871420+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:58.435337+0000","last_clean_scrub_stamp":"2024-09-11T23:20:58.435337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:03.448755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.804183+0000","last_change":"2024-09-11T23:20:58.465838+0000","last_active":"2024-09-11T23:21:00.804183+0000","last_peered":"2024-09-11T23:21:00.804183+0000","last_clean":"2024-09-11T23:21:00.804183+0000","last_became_active":"2024-09-11T23:20:58.464372+0000","last_became_peered":"2024-09-11T23:20:58.464372+0000","last_unstale":"2024-09-11T23:21:00.804183+0000","last_undegraded":"2024-09-11T23:21:00.804183+0000","last_fullsized":"2024-09-11T23:21:00.804183+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:20:57.427597+0000","last_clean_scrub_stamp":"2024-09-11T23:20:57.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:47.949664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":238,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-11T23:21:00.460584+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:21:00.460584+0000","last_peered":"2024-09-11T23:21:00.460584+0000","last_clean":"2024-09-11T23:21:00.460584+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:21:00.460584+0000","last_undegraded":"2024-09-11T23:21:00.460584+0000","last_fullsized":"2024-09-11T23:21:00.460584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476780,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":1298432,"data_stored":879916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476779,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":696320,"data_stored":289388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476778,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":704512,"data_stored":290040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476778,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":708608,"data_stored":291000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":700416,"data_stored":289478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509482,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1306624,"data_stored":881950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":704512,"data_stored":289444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":704512,"data_stored":289444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:21:08.700 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:21:08.700 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:21:08.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.897+0000 7f0333600640 1 Processor -- start 2024-09-11T23:21:08.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.897+0000 7f0333600640 1 -- start start 2024-09-11T23:21:08.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.897+0000 7f0333600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f032c0ccb80 0x7f032c15bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:08.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.897+0000 7f0333600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f032c0b3570 con 0x7f032c072d10 2024-09-11T23:21:08.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.897+0000 7f0333600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f032c0b3850 con 0x7f032c0b4e20 2024-09-11T23:21:08.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.897+0000 7f0333600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f032c0b3b30 con 0x7f032c0ccb80 2024-09-11T23:21:08.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.897+0000 7f0330c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f032c0ccb80 0x7f032c15bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:08.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.897+0000 7f0330c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f032c0ccb80 0x7f032c15bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38378/0 (socket says 172.21.15.144:38378) 2024-09-11T23:21:08.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.897+0000 7f0330c00640 1 -- 172.21.15.144:0/1966883515 learned_addr learned my addr 172.21.15.144:0/1966883515 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:08.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.897+0000 7f032be00640 1 --1- 172.21.15.144:0/1966883515 >> v1:172.21.15.144:6789/0 conn(0x7f032c072d10 0x7f032c0b4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43494/0 (socket says 172.21.15.144:43494) 2024-09-11T23:21:08.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.898+0000 7f0330c00640 1 -- 172.21.15.144:0/1966883515 >> v1:172.21.15.165:6789/0 conn(0x7f032c0b4e20 legacy=0x7f032c06db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:08.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.898+0000 7f0330c00640 1 -- 172.21.15.144:0/1966883515 >> v1:172.21.15.144:6789/0 conn(0x7f032c072d10 legacy=0x7f032c0b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:08.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.898+0000 7f0330c00640 1 -- 172.21.15.144:0/1966883515 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032c0b3e10 con 0x7f032c0ccb80 2024-09-11T23:21:08.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.898+0000 7f032b400640 1 -- 172.21.15.144:0/1966883515 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3465601125 0 0) 0x7f032c0b3570 con 0x7f032c072d10 2024-09-11T23:21:08.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.899+0000 7f0330c00640 1 --2- 172.21.15.144:0/1966883515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f032c0ccb80 0x7f032c15bbd0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0320009870 tx=0x7f032002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a4e13038e936e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:08.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.899+0000 7f032b400640 1 -- 172.21.15.144:0/1966883515 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0320037070 con 0x7f032c0ccb80 2024-09-11T23:21:08.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.899+0000 7f032b400640 1 -- 172.21.15.144:0/1966883515 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0320032440 con 0x7f032c0ccb80 2024-09-11T23:21:08.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.899+0000 7f032b400640 1 -- 172.21.15.144:0/1966883515 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0320032810 con 0x7f032c0ccb80 2024-09-11T23:21:08.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.900+0000 7f0333600640 1 -- 172.21.15.144:0/1966883515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f032c0ccb80 msgr2=0x7f032c15bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:08.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.900+0000 7f0333600640 1 --2- 172.21.15.144:0/1966883515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f032c0ccb80 0x7f032c15bbd0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0320009870 tx=0x7f032002a2a0 comp rx=0 tx=0).stop 2024-09-11T23:21:08.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.900+0000 7f0333600640 1 -- 172.21.15.144:0/1966883515 shutdown_connections 2024-09-11T23:21:08.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.900+0000 7f0333600640 1 --2- 172.21.15.144:0/1966883515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f032c0ccb80 0x7f032c15bbd0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:08.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.900+0000 7f0333600640 1 -- 172.21.15.144:0/1966883515 >> 172.21.15.144:0/1966883515 conn(0x7f032c06bba0 msgr2=0x7f032c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:08.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.900+0000 7f0333600640 1 -- 172.21.15.144:0/1966883515 shutdown_connections 2024-09-11T23:21:08.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.900+0000 7f0333600640 1 -- 172.21.15.144:0/1966883515 wait complete. 2024-09-11T23:21:08.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.901+0000 7f0333600640 1 Processor -- start 2024-09-11T23:21:08.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.901+0000 7f0333600640 1 -- start start 2024-09-11T23:21:08.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.902+0000 7f0333600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f032c072d10 0x7f032c14e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:08.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.902+0000 7f0333600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f032c0b4e20 0x7f032c14ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:08.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.902+0000 7f0333600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f032c0ccb80 0x7f032c14d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:08.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.902+0000 7f0333600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f032c0ccf60 con 0x7f032c072d10 2024-09-11T23:21:08.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.902+0000 7f0333600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f032c0b43d0 con 0x7f032c0ccb80 2024-09-11T23:21:08.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.902+0000 7f0333600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f032c06d080 con 0x7f032c0b4e20 2024-09-11T23:21:08.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.903+0000 7f0330c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f032c072d10 0x7f032c14e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:08.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.903+0000 7f0330c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f032c072d10 0x7f032c14e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38382/0 (socket says 172.21.15.144:38382) 2024-09-11T23:21:08.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.903+0000 7f0330c00640 1 -- 172.21.15.144:0/1680271137 learned_addr learned my addr 172.21.15.144:0/1680271137 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:08.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.903+0000 7f032be00640 1 --2- 172.21.15.144:0/1680271137 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f032c0b4e20 0x7f032c14ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:08.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.903+0000 7f0331600640 1 --2- 172.21.15.144:0/1680271137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f032c0ccb80 0x7f032c14d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.903+0000 7f0330c00640 1 -- 172.21.15.144:0/1680271137 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f032c0b4e20 msgr2=0x7f032c14ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.903+0000 7f0330c00640 1 --2- 172.21.15.144:0/1680271137 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f032c0b4e20 0x7f032c14ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.903+0000 7f0330c00640 1 -- 172.21.15.144:0/1680271137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f032c0ccb80 msgr2=0x7f032c14d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.903+0000 7f0330c00640 1 --2- 172.21.15.144:0/1680271137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f032c0ccb80 0x7f032c14d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.903+0000 7f0330c00640 1 -- 172.21.15.144:0/1680271137 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032c14e830 con 0x7f032c072d10 2024-09-11T23:21:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.903+0000 7f0330c00640 1 --2- 172.21.15.144:0/1680271137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f032c072d10 0x7f032c14e150 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0320009870 tx=0x7f03200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.904+0000 7f0328c00640 1 -- 172.21.15.144:0/1680271137 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0320037040 con 0x7f032c072d10 2024-09-11T23:21:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.904+0000 7f0328c00640 1 -- 172.21.15.144:0/1680271137 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0320004250 con 0x7f032c072d10 2024-09-11T23:21:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.904+0000 7f0328c00640 1 -- 172.21.15.144:0/1680271137 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032003c670 con 0x7f032c072d10 2024-09-11T23:21:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.904+0000 7f0333600640 1 -- 172.21.15.144:0/1680271137 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f032c14f390 con 0x7f032c072d10 2024-09-11T23:21:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.904+0000 7f0333600640 1 -- 172.21.15.144:0/1680271137 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f032c1559d0 con 0x7f032c072d10 2024-09-11T23:21:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.905+0000 7f0333600640 1 -- 172.21.15.144:0/1680271137 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f032c06d3e0 con 0x7f032c072d10 2024-09-11T23:21:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.906+0000 7f0328c00640 1 -- 172.21.15.144:0/1680271137 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f032003a070 con 0x7f032c072d10 2024-09-11T23:21:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.906+0000 7f0328c00640 1 --2- 172.21.15.144:0/1680271137 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f030c06bfe0 0x7f030c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.907+0000 7f0328c00640 1 -- 172.21.15.144:0/1680271137 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f03200abad0 con 0x7f032c072d10 2024-09-11T23:21:08.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.907+0000 7f032be00640 1 --2- 172.21.15.144:0/1680271137 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f030c06bfe0 0x7f030c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:08.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.907+0000 7f032be00640 1 --2- 172.21.15.144:0/1680271137 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f030c06bfe0 0x7f030c06e4a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0318009fd0 tx=0x7f0318009d80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:08.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:08.912+0000 7f0328c00640 1 -- 172.21.15.144:0/1680271137 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0320041020 con 0x7f032c072d10 2024-09-11T23:21:09.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.148+0000 7f0333600640 1 -- 172.21.15.144:0/1680271137 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f032c072960 con 0x7f032c072d10 2024-09-11T23:21:09.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.153+0000 7f0328c00640 1 -- 172.21.15.144:0/1680271137 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f032007a1f0 con 0x7f032c072d10 2024-09-11T23:21:09.154 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-11T23:21:09.154 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A== 2024-09-11T23:21:09.154 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-11T23:21:09.154 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-11T23:21:09.154 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:21:09.154 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-11T23:21:09.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.155+0000 7f0333600640 1 -- 172.21.15.144:0/1680271137 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f030c06bfe0 msgr2=0x7f030c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:09.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.155+0000 7f0333600640 1 --2- 172.21.15.144:0/1680271137 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f030c06bfe0 0x7f030c06e4a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0318009fd0 tx=0x7f0318009d80 comp rx=0 tx=0).stop 2024-09-11T23:21:09.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.155+0000 7f0333600640 1 -- 172.21.15.144:0/1680271137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f032c072d10 msgr2=0x7f032c14e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:09.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.155+0000 7f0333600640 1 --2- 172.21.15.144:0/1680271137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f032c072d10 0x7f032c14e150 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0320009870 tx=0x7f03200046c0 comp rx=0 tx=0).stop 2024-09-11T23:21:09.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.155+0000 7f0333600640 1 -- 172.21.15.144:0/1680271137 shutdown_connections 2024-09-11T23:21:09.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.155+0000 7f0333600640 1 --2- 172.21.15.144:0/1680271137 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f030c06bfe0 0x7f030c06e4a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:09.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.155+0000 7f0333600640 1 --2- 172.21.15.144:0/1680271137 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f032c0ccb80 0x7f032c14d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:09.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.155+0000 7f0333600640 1 --2- 172.21.15.144:0/1680271137 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f032c0b4e20 0x7f032c14ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:09.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.155+0000 7f0333600640 1 --2- 172.21.15.144:0/1680271137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f032c072d10 0x7f032c14e150 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:09.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.155+0000 7f0333600640 1 -- 172.21.15.144:0/1680271137 >> 172.21.15.144:0/1680271137 conn(0x7f032c06bba0 msgr2=0x7f032c0b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:09.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.155+0000 7f0333600640 1 -- 172.21.15.144:0/1680271137 shutdown_connections 2024-09-11T23:21:09.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.155+0000 7f0333600640 1 -- 172.21.15.144:0/1680271137 wait complete. 2024-09-11T23:21:09.171 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:21:09.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.327+0000 7fa8d7e00640 1 Processor -- start 2024-09-11T23:21:09.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.327+0000 7fa8d7e00640 1 -- start start 2024-09-11T23:21:09.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.327+0000 7fa8d7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa8d80b4510 0x7fa8d80b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:09.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.327+0000 7fa8d7e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8d80b31d0 con 0x7fa8d815b150 2024-09-11T23:21:09.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.327+0000 7fa8d7e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8d815c0a0 con 0x7fa8d80b3ea0 2024-09-11T23:21:09.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.327+0000 7fa8d7e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa8d815c380 con 0x7fa8d80b4510 2024-09-11T23:21:09.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.327+0000 7fa8ce000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa8d80b4510 0x7fa8d80b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:09.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.327+0000 7fa8d6a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa8d815b150 0x7fa8d80ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43510/0 (socket says 172.21.15.144:43510) 2024-09-11T23:21:09.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.327+0000 7fa8d6a00640 1 -- 172.21.15.144:0/1664106577 learned_addr learned my addr 172.21.15.144:0/1664106577 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:09.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.328+0000 7fa8ce000640 1 -- 172.21.15.144:0/1664106577 >> v1:172.21.15.165:6789/0 conn(0x7fa8d80b3ea0 legacy=0x7fa8d815b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:09.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.328+0000 7fa8ce000640 1 -- 172.21.15.144:0/1664106577 >> v1:172.21.15.144:6789/0 conn(0x7fa8d815b150 legacy=0x7fa8d80ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:09.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.328+0000 7fa8ce000640 1 -- 172.21.15.144:0/1664106577 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d80b3440 con 0x7fa8d80b4510 2024-09-11T23:21:09.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.328+0000 7fa8d6000640 1 -- 172.21.15.144:0/1664106577 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3845909854 0 0) 0x7fa8d80b31d0 con 0x7fa8d815b150 2024-09-11T23:21:09.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.328+0000 7fa8ce000640 1 --2- 172.21.15.144:0/1664106577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d80b4510 0x7fa8d80b3960 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00097d0 tx=0x7fa8c002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3373ef50b2fa587e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:09.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.329+0000 7fa8d6000640 1 -- 172.21.15.144:0/1664106577 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0037070 con 0x7fa8d80b4510 2024-09-11T23:21:09.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.329+0000 7fa8d6000640 1 -- 172.21.15.144:0/1664106577 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c0032440 con 0x7fa8d80b4510 2024-09-11T23:21:09.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.329+0000 7fa8d6000640 1 -- 172.21.15.144:0/1664106577 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0032810 con 0x7fa8d80b4510 2024-09-11T23:21:09.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.329+0000 7fa8d7e00640 1 -- 172.21.15.144:0/1664106577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d80b4510 msgr2=0x7fa8d80b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:09.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.329+0000 7fa8d7e00640 1 --2- 172.21.15.144:0/1664106577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d80b4510 0x7fa8d80b3960 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00097d0 tx=0x7fa8c002a210 comp rx=0 tx=0).stop 2024-09-11T23:21:09.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.329+0000 7fa8d7e00640 1 -- 172.21.15.144:0/1664106577 shutdown_connections 2024-09-11T23:21:09.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.329+0000 7fa8d7e00640 1 --2- 172.21.15.144:0/1664106577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d80b4510 0x7fa8d80b3960 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:09.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.329+0000 7fa8d7e00640 1 -- 172.21.15.144:0/1664106577 >> 172.21.15.144:0/1664106577 conn(0x7fa8d806e910 msgr2=0x7fa8d806bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:09.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.329+0000 7fa8d7e00640 1 -- 172.21.15.144:0/1664106577 shutdown_connections 2024-09-11T23:21:09.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.329+0000 7fa8d7e00640 1 -- 172.21.15.144:0/1664106577 wait complete. 2024-09-11T23:21:09.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.331+0000 7fa8d7e00640 1 Processor -- start 2024-09-11T23:21:09.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.331+0000 7fa8d7e00640 1 -- start start 2024-09-11T23:21:09.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8d7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d80b3ea0 0x7fa8d8141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:09.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8d7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8d80b4510 0x7fa8d8140af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:09.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8d7e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa8d815b150 0x7fa8d8073360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:09.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8d7e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d80cd200 con 0x7fa8d80b3ea0 2024-09-11T23:21:09.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8d7e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d815bc40 con 0x7fa8d80b4510 2024-09-11T23:21:09.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8d7e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d81515a0 con 0x7fa8d815b150 2024-09-11T23:21:09.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8d6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d80b3ea0 0x7fa8d8141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:09.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8d6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d80b3ea0 0x7fa8d8141310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38402/0 (socket says 172.21.15.144:38402) 2024-09-11T23:21:09.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8d6a00640 1 -- 172.21.15.144:0/3752356034 learned_addr learned my addr 172.21.15.144:0/3752356034 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:09.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8ce000640 1 --2- 172.21.15.144:0/3752356034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8d80b4510 0x7fa8d8140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:09.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8d7400640 1 --2- 172.21.15.144:0/3752356034 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa8d815b150 0x7fa8d8073360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:09.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8d6a00640 1 -- 172.21.15.144:0/3752356034 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa8d815b150 msgr2=0x7fa8d8073360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:09.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8d6a00640 1 --2- 172.21.15.144:0/3752356034 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa8d815b150 0x7fa8d8073360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:09.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8d6a00640 1 -- 172.21.15.144:0/3752356034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8d80b4510 msgr2=0x7fa8d8140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:09.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8d6a00640 1 --2- 172.21.15.144:0/3752356034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8d80b4510 0x7fa8d8140af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:09.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8d6a00640 1 -- 172.21.15.144:0/3752356034 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d8141030 con 0x7fa8d80b3ea0 2024-09-11T23:21:09.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8ce000640 1 --2- 172.21.15.144:0/3752356034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8d80b4510 0x7fa8d8140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:09.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8d7400640 1 --2- 172.21.15.144:0/3752356034 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa8d815b150 0x7fa8d8073360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:09.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8d6a00640 1 --2- 172.21.15.144:0/3752356034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d80b3ea0 0x7fa8d8141310 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800c460 tx=0x7fa8c800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:09.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8cf400640 1 -- 172.21.15.144:0/3752356034 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8018070 con 0x7fa8d80b3ea0 2024-09-11T23:21:09.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8cf400640 1 -- 172.21.15.144:0/3752356034 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c8007500 con 0x7fa8d80b3ea0 2024-09-11T23:21:09.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8cf400640 1 -- 172.21.15.144:0/3752356034 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8004a20 con 0x7fa8d80b3ea0 2024-09-11T23:21:09.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8d7e00640 1 -- 172.21.15.144:0/3752356034 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d81517f0 con 0x7fa8d80b3ea0 2024-09-11T23:21:09.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.333+0000 7fa8d7e00640 1 -- 172.21.15.144:0/3752356034 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d8151db0 con 0x7fa8d80b3ea0 2024-09-11T23:21:09.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.334+0000 7fa8d7e00640 1 -- 172.21.15.144:0/3752356034 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8d80b3960 con 0x7fa8d80b3ea0 2024-09-11T23:21:09.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.335+0000 7fa8cf400640 1 -- 172.21.15.144:0/3752356034 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7fa8c801b070 con 0x7fa8d80b3ea0 2024-09-11T23:21:09.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.336+0000 7fa8cf400640 1 --2- 172.21.15.144:0/3752356034 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa8b406bfe0 0x7fa8b406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:09.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.336+0000 7fa8cf400640 1 -- 172.21.15.144:0/3752356034 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fa8c808a4c0 con 0x7fa8d80b3ea0 2024-09-11T23:21:09.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.336+0000 7fa8ce000640 1 --2- 172.21.15.144:0/3752356034 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa8b406bfe0 0x7fa8b406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:09.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.338+0000 7fa8ce000640 1 --2- 172.21.15.144:0/3752356034 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa8b406bfe0 0x7fa8b406e4a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0034000 tx=0x7fa8c002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:09.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.340+0000 7fa8cf400640 1 -- 172.21.15.144:0/3752356034 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa8d8141030 con 0x7fa8d80b3ea0 2024-09-11T23:21:09.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.554+0000 7fa8d7e00640 1 -- 172.21.15.144:0/3752356034 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8d8157c20 con 0x7fa8d80b3ea0 2024-09-11T23:21:09.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.555+0000 7fa8cf400640 1 -- 172.21.15.144:0/3752356034 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5235 (secure 0 0 0) 0x7fa8c8058b50 con 0x7fa8d80b3ea0 2024-09-11T23:21:09.555 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:09.555 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":35,"btime":"2024-09-11T23:21:02:480138+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2161458369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2161458369},{"type":"v1","addr":"172.21.15.144:6836","nonce":2161458369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5150,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/2242935376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2242935376},{"type":"v1","addr":"172.21.15.165:6833","nonce":2242935376}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5156,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3703078361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3703078361},{"type":"v1","addr":"172.21.15.165:6835","nonce":3703078361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:20:58.860267+0000","modified":"2024-09-11T23:21:01.888764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1648435689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1648435689},{"type":"v1","addr":"172.21.15.144:6837","nonce":1648435689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5667,"qdb_cluster":[5667]},"id":4}]} 2024-09-11T23:21:09.555 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 35 2024-09-11T23:21:09.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.557+0000 7fa8d7e00640 1 -- 172.21.15.144:0/3752356034 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa8b406bfe0 msgr2=0x7fa8b406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:09.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.557+0000 7fa8d7e00640 1 --2- 172.21.15.144:0/3752356034 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa8b406bfe0 0x7fa8b406e4a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0034000 tx=0x7fa8c002e000 comp rx=0 tx=0).stop 2024-09-11T23:21:09.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.557+0000 7fa8d7e00640 1 -- 172.21.15.144:0/3752356034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d80b3ea0 msgr2=0x7fa8d8141310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:09.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.557+0000 7fa8d7e00640 1 --2- 172.21.15.144:0/3752356034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d80b3ea0 0x7fa8d8141310 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800c460 tx=0x7fa8c800c920 comp rx=0 tx=0).stop 2024-09-11T23:21:09.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.557+0000 7fa8d7e00640 1 -- 172.21.15.144:0/3752356034 shutdown_connections 2024-09-11T23:21:09.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.557+0000 7fa8d7e00640 1 --2- 172.21.15.144:0/3752356034 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa8b406bfe0 0x7fa8b406e4a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:09.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.557+0000 7fa8d7e00640 1 --2- 172.21.15.144:0/3752356034 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa8d815b150 0x7fa8d8073360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:09.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.557+0000 7fa8d7e00640 1 --2- 172.21.15.144:0/3752356034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8d80b4510 0x7fa8d8140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:09.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.557+0000 7fa8d7e00640 1 --2- 172.21.15.144:0/3752356034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8d80b3ea0 0x7fa8d8141310 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:09.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.557+0000 7fa8d7e00640 1 -- 172.21.15.144:0/3752356034 >> 172.21.15.144:0/3752356034 conn(0x7fa8d806e910 msgr2=0x7fa8d80cd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:09.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.557+0000 7fa8d7e00640 1 -- 172.21.15.144:0/3752356034 shutdown_connections 2024-09-11T23:21:09.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:09.557+0000 7fa8d7e00640 1 -- 172.21.15.144:0/3752356034 wait complete. 2024-09-11T23:21:09.976 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:20:58.860267+0000', 'modified': '2024-09-11T23:21:01.888764+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5667}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5667': {'gid': 5667, 'name': 'c', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6837/1648435689', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6835', 'nonce': 1648435689}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 1648435689}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5667, 'qdb_cluster': [5667]} 2024-09-11T23:21:09.976 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:21:09.977 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-11T23:21:10.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.132+0000 7efebe400640 1 Processor -- start 2024-09-11T23:21:10.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.132+0000 7efebe400640 1 -- start start 2024-09-11T23:21:10.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.133+0000 7efebe400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efeb80d02a0 0x7efeb80d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.134+0000 7efebe400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb815ca40 0x7efeb815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.134+0000 7efebe400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeb80d0bc0 con 0x7efeb815ce80 2024-09-11T23:21:10.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.134+0000 7efebe400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efeb815d390 con 0x7efeb80d02a0 2024-09-11T23:21:10.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.134+0000 7efebe400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efeb815d670 con 0x7efeb815ca40 2024-09-11T23:21:10.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.134+0000 7efeb7400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efeb80d02a0 0x7efeb80d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.134+0000 7efeb7400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efeb80d02a0 0x7efeb80d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38414/0 (socket says 172.21.15.144:38414) 2024-09-11T23:21:10.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.134+0000 7efeb7400640 1 -- 172.21.15.144:0/2568406654 learned_addr learned my addr 172.21.15.144:0/2568406654 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:10.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.134+0000 7efeaea00640 1 --2- 172.21.15.144:0/2568406654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb815ca40 0x7efeb815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.134+0000 7efeb7400640 1 -- 172.21.15.144:0/2568406654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb815ca40 msgr2=0x7efeb815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:10.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.134+0000 7efeb7400640 1 --2- 172.21.15.144:0/2568406654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb815ca40 0x7efeb815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.134+0000 7efeb7400640 1 -- 172.21.15.144:0/2568406654 >> v1:172.21.15.165:6789/0 conn(0x7efeb815ce80 legacy=0x7efeb81594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.134+0000 7efeb7400640 1 -- 172.21.15.144:0/2568406654 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb815d950 con 0x7efeb80d02a0 2024-09-11T23:21:10.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.135+0000 7efeb7400640 1 --2- 172.21.15.144:0/2568406654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb80d02a0 0x7efeb80d0680 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efea800bb10 tx=0x7efea802c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7f17e8bbfaeb46 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:10.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.136+0000 7efeb6a00640 1 -- 172.21.15.144:0/2568406654 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8032790 con 0x7efeb80d02a0 2024-09-11T23:21:10.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.136+0000 7efeb6a00640 1 -- 172.21.15.144:0/2568406654 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea8038070 con 0x7efeb80d02a0 2024-09-11T23:21:10.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.136+0000 7efeb6a00640 1 -- 172.21.15.144:0/2568406654 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8032b50 con 0x7efeb80d02a0 2024-09-11T23:21:10.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.136+0000 7efebe400640 1 -- 172.21.15.144:0/2568406654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb80d02a0 msgr2=0x7efeb80d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.136+0000 7efebe400640 1 --2- 172.21.15.144:0/2568406654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb80d02a0 0x7efeb80d0680 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efea800bb10 tx=0x7efea802c890 comp rx=0 tx=0).stop 2024-09-11T23:21:10.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.136+0000 7efebe400640 1 -- 172.21.15.144:0/2568406654 shutdown_connections 2024-09-11T23:21:10.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.136+0000 7efebe400640 1 --2- 172.21.15.144:0/2568406654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb815ca40 0x7efeb815e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.136+0000 7efebe400640 1 --2- 172.21.15.144:0/2568406654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb80d02a0 0x7efeb80d0680 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.136+0000 7efebe400640 1 -- 172.21.15.144:0/2568406654 >> 172.21.15.144:0/2568406654 conn(0x7efeb8062cc0 msgr2=0x7efeb806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:10.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.136+0000 7efebe400640 1 -- 172.21.15.144:0/2568406654 shutdown_connections 2024-09-11T23:21:10.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.137+0000 7efebe400640 1 -- 172.21.15.144:0/2568406654 wait complete. 2024-09-11T23:21:10.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.138+0000 7efebe400640 1 Processor -- start 2024-09-11T23:21:10.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.138+0000 7efebe400640 1 -- start start 2024-09-11T23:21:10.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.139+0000 7efebe400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb80d02a0 0x7efeb80aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.139+0000 7efebe400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb815ca40 0x7efeb8073c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.139+0000 7efebe400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efeb815ce80 0x7efeb8071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.139+0000 7efebe400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8155b90 con 0x7efeb80d02a0 2024-09-11T23:21:10.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.139+0000 7efebe400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efeb815df10 con 0x7efeb815ce80 2024-09-11T23:21:10.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.139+0000 7efebe400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efeb8155d10 con 0x7efeb815ca40 2024-09-11T23:21:10.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.139+0000 7efeb7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb80d02a0 0x7efeb80aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.139+0000 7efeb7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb80d02a0 0x7efeb80aecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38428/0 (socket says 172.21.15.144:38428) 2024-09-11T23:21:10.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.139+0000 7efeb7400640 1 -- 172.21.15.144:0/2632972214 learned_addr learned my addr 172.21.15.144:0/2632972214 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:10.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.140+0000 7efeaea00640 1 --2- 172.21.15.144:0/2632972214 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb815ca40 0x7efeb8073c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.140+0000 7efeb7e00640 1 --2- 172.21.15.144:0/2632972214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efeb815ce80 0x7efeb8071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.140+0000 7efeb7400640 1 -- 172.21.15.144:0/2632972214 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb815ca40 msgr2=0x7efeb8073c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.140+0000 7efeb7400640 1 --2- 172.21.15.144:0/2632972214 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb815ca40 0x7efeb8073c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.140+0000 7efeb7400640 1 -- 172.21.15.144:0/2632972214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efeb815ce80 msgr2=0x7efeb8071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.140+0000 7efeb7400640 1 --2- 172.21.15.144:0/2632972214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efeb815ce80 0x7efeb8071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.140+0000 7efeb7400640 1 -- 172.21.15.144:0/2632972214 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb8072ba0 con 0x7efeb80d02a0 2024-09-11T23:21:10.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.140+0000 7efeb7e00640 1 --2- 172.21.15.144:0/2632972214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efeb815ce80 0x7efeb8071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:10.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.140+0000 7efeaea00640 1 --2- 172.21.15.144:0/2632972214 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb815ca40 0x7efeb8073c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:10.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.140+0000 7efeb7400640 1 --2- 172.21.15.144:0/2632972214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb80d02a0 0x7efeb80aecd0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7efea8000c00 tx=0x7efea80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:10.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.140+0000 7efeafe00640 1 -- 172.21.15.144:0/2632972214 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8033620 con 0x7efeb80d02a0 2024-09-11T23:21:10.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.140+0000 7efeafe00640 1 -- 172.21.15.144:0/2632972214 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea8033800 con 0x7efeb80d02a0 2024-09-11T23:21:10.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.140+0000 7efebe400640 1 -- 172.21.15.144:0/2632972214 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb8072e80 con 0x7efeb80d02a0 2024-09-11T23:21:10.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.140+0000 7efeafe00640 1 -- 172.21.15.144:0/2632972214 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8033bf0 con 0x7efeb80d02a0 2024-09-11T23:21:10.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.140+0000 7efebe400640 1 -- 172.21.15.144:0/2632972214 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb8073440 con 0x7efeb80d02a0 2024-09-11T23:21:10.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.142+0000 7efeafe00640 1 -- 172.21.15.144:0/2632972214 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7efea804d060 con 0x7efeb80d02a0 2024-09-11T23:21:10.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.143+0000 7efeafe00640 1 --2- 172.21.15.144:0/2632972214 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efe9406bfe0 0x7efe9406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.143+0000 7efeafe00640 1 -- 172.21.15.144:0/2632972214 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7efea80addb0 con 0x7efeb80d02a0 2024-09-11T23:21:10.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.143+0000 7efeaea00640 1 --2- 172.21.15.144:0/2632972214 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efe9406bfe0 0x7efe9406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.144+0000 7efec1203740 1 Processor -- start 2024-09-11T23:21:10.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.144+0000 7efeaea00640 1 --2- 172.21.15.144:0/2632972214 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efe9406bfe0 0x7efe9406e4a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efeb80b1730 tx=0x7efea0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:10.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.144+0000 7efec1203740 1 -- start start 2024-09-11T23:21:10.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.145+0000 7efec1203740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56003e718cf0 0x56003e75e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.145+0000 7efec1203740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e7164b0 0x56003e7190d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.145+0000 7efec1203740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56003e71a480 0x56003e713570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.145+0000 7efec1203740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56003e6773b0 con 0x56003e7164b0 2024-09-11T23:21:10.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.145+0000 7efec1203740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56003e67c410 con 0x56003e71a480 2024-09-11T23:21:10.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.145+0000 7efec1203740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56003e624620 con 0x56003e718cf0 2024-09-11T23:21:10.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.145+0000 7efeaea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e7164b0 0x56003e7190d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.145+0000 7efeaea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e7164b0 0x56003e7190d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38430/0 (socket says 172.21.15.144:38430) 2024-09-11T23:21:10.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.145+0000 7efeaea00640 1 -- 172.21.15.144:0/2712509678 learned_addr learned my addr 172.21.15.144:0/2712509678 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:10.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.146+0000 7efeb7400640 1 --2- 172.21.15.144:0/2712509678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56003e718cf0 0x56003e75e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.146+0000 7efeb7e00640 1 --2- 172.21.15.144:0/2712509678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56003e71a480 0x56003e713570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.146+0000 7efeaea00640 1 -- 172.21.15.144:0/2712509678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56003e718cf0 msgr2=0x56003e75e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.146+0000 7efeaea00640 1 --2- 172.21.15.144:0/2712509678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56003e718cf0 0x56003e75e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.146+0000 7efeaea00640 1 -- 172.21.15.144:0/2712509678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56003e71a480 msgr2=0x56003e713570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.146+0000 7efeaea00640 1 --2- 172.21.15.144:0/2712509678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56003e71a480 0x56003e713570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.146+0000 7efeaea00640 1 -- 172.21.15.144:0/2712509678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56003e38f2d0 con 0x56003e7164b0 2024-09-11T23:21:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.146+0000 7efeb7400640 1 --2- 172.21.15.144:0/2712509678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56003e718cf0 0x56003e75e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.146+0000 7efeb7e00640 1 --2- 172.21.15.144:0/2712509678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56003e71a480 0x56003e713570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.146+0000 7efeaea00640 1 --2- 172.21.15.144:0/2712509678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e7164b0 0x56003e7190d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7efea0011e60 tx=0x7efea0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5bd4e35e7c20bd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.146+0000 7efea7e00640 1 -- 172.21.15.144:0/2712509678 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0015e50 con 0x56003e7164b0 2024-09-11T23:21:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.146+0000 7efea7e00640 1 -- 172.21.15.144:0/2712509678 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea0026070 con 0x56003e7164b0 2024-09-11T23:21:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.146+0000 7efea7e00640 1 -- 172.21.15.144:0/2712509678 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0021640 con 0x56003e7164b0 2024-09-11T23:21:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.147+0000 7efec1203740 1 -- 172.21.15.144:0/2712509678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e7164b0 msgr2=0x56003e7190d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.147+0000 7efec1203740 1 --2- 172.21.15.144:0/2712509678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e7164b0 0x56003e7190d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7efea0011e60 tx=0x7efea0014000 comp rx=0 tx=0).stop 2024-09-11T23:21:10.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.147+0000 7efec1203740 1 -- 172.21.15.144:0/2712509678 shutdown_connections 2024-09-11T23:21:10.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.147+0000 7efec1203740 1 --2- 172.21.15.144:0/2712509678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56003e71a480 0x56003e713570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.147+0000 7efec1203740 1 --2- 172.21.15.144:0/2712509678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e7164b0 0x56003e7190d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.147+0000 7efec1203740 1 --2- 172.21.15.144:0/2712509678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56003e718cf0 0x56003e75e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.147+0000 7efec1203740 1 -- 172.21.15.144:0/2712509678 >> 172.21.15.144:0/2712509678 conn(0x56003e715740 msgr2=0x56003e75d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:10.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.147+0000 7efec1203740 1 -- 172.21.15.144:0/2712509678 shutdown_connections 2024-09-11T23:21:10.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.147+0000 7efec1203740 1 -- 172.21.15.144:0/2712509678 wait complete. 2024-09-11T23:21:10.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.148+0000 7efec1203740 1 -- start start 2024-09-11T23:21:10.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.148+0000 7efec1203740 1 Processor -- start 2024-09-11T23:21:10.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.149+0000 7efec1203740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56003e718cf0 0x56003e738060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.149+0000 7efec1203740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e71a480 0x56003e737130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.149+0000 7efec1203740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56003e771a90 0x56003e717250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.149+0000 7efec1203740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56003e637780 con 0x56003e71a480 2024-09-11T23:21:10.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.149+0000 7efec1203740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56003e6783d0 con 0x56003e718cf0 2024-09-11T23:21:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.149+0000 7efec1203740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56003e714be0 con 0x56003e771a90 2024-09-11T23:21:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.149+0000 7efec1203740 10 client.0 _ll_register_callbacks cb 0x56003e6755d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:21:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.149+0000 7efeaea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e71a480 0x56003e737130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.149+0000 7efeaea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e71a480 0x56003e737130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38440/0 (socket says 172.21.15.144:38440) 2024-09-11T23:21:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.149+0000 7efeaea00640 1 -- 172.21.15.144:0/4108347912 learned_addr learned my addr 172.21.15.144:0/4108347912 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.149+0000 7efeb7400640 1 --2- 172.21.15.144:0/4108347912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56003e718cf0 0x56003e738060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.150+0000 7efeb7e00640 1 --2- 172.21.15.144:0/4108347912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56003e771a90 0x56003e717250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.150+0000 7efeaea00640 1 -- 172.21.15.144:0/4108347912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56003e771a90 msgr2=0x56003e717250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.150+0000 7efeaea00640 1 --2- 172.21.15.144:0/4108347912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56003e771a90 0x56003e717250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.150+0000 7efeaea00640 1 -- 172.21.15.144:0/4108347912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56003e718cf0 msgr2=0x56003e738060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.150+0000 7efeaea00640 1 --2- 172.21.15.144:0/4108347912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56003e718cf0 0x56003e738060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.150+0000 7efeaea00640 1 -- 172.21.15.144:0/4108347912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56003e4596b0 con 0x56003e71a480 2024-09-11T23:21:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.150+0000 7efeaea00640 1 --2- 172.21.15.144:0/4108347912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e71a480 0x56003e737130 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7efea0011dd0 tx=0x7efea00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a01ef48e2171ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.150+0000 7efea4c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:21:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.150+0000 7efea4c00640 1 -- 172.21.15.144:0/4108347912 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0015e50 con 0x56003e71a480 2024-09-11T23:21:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.150+0000 7efec1203740 1 -- 172.21.15.144:0/4108347912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efea0026070 con 0x56003e71a480 2024-09-11T23:21:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.150+0000 7efea4c00640 1 -- 172.21.15.144:0/4108347912 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7efea0021a90 con 0x56003e71a480 2024-09-11T23:21:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.151+0000 7efea4c00640 1 -- 172.21.15.144:0/4108347912 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7efea003e050 con 0x56003e71a480 2024-09-11T23:21:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.151+0000 7efec1203740 10 client.5817 fetch_fsmap learned FSMap version 35 2024-09-11T23:21:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.151+0000 7efec1203740 1 -- 172.21.15.144:0/4108347912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x56003e741d00 con 0x56003e71a480 2024-09-11T23:21:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.151+0000 7efea4c00640 1 -- 172.21.15.144:0/4108347912 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea0026070 con 0x56003e71a480 2024-09-11T23:21:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.151+0000 7efea4c00640 1 -- 172.21.15.144:0/4108347912 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 35) ==== 3502+0+0 (secure 0 0 0) 0x7efea0041020 con 0x56003e71a480 2024-09-11T23:21:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.151+0000 7efec1203740 10 client.5817 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T23:21:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.151+0000 7efec1203740 10 client.5817 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:21:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.151+0000 7efec1203740 20 client.5817 populate_metadata read hostname 'smithi144' 2024-09-11T23:21:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.151+0000 7efec1203740 1 --2- 172.21.15.144:0/4108347912 >> [v2:172.21.15.144:6835/1648435689,v1:172.21.15.144:6837/1648435689] conn(0x56003e7429e0 0x56003e742dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.151+0000 7efec1203740 4 client.5817 mds_command: new command op to 5667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:21:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.151+0000 7efec1203740 1 -- 172.21.15.144:0/4108347912 --> [v2:172.21.15.144:6835/1648435689,v1:172.21.15.144:6837/1648435689] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56003e689b40 con 0x56003e7429e0 2024-09-11T23:21:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.151+0000 7efeb7400640 1 --2- 172.21.15.144:0/4108347912 >> [v2:172.21.15.144:6835/1648435689,v1:172.21.15.144:6837/1648435689] conn(0x56003e7429e0 0x56003e742dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.152+0000 7efeb7400640 1 --2- 172.21.15.144:0/4108347912 >> [v2:172.21.15.144:6835/1648435689,v1:172.21.15.144:6837/1648435689] conn(0x56003e7429e0 0x56003e742dc0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=535c2fd3452069be server_cookie=2016e842ff79ceef in_seq=0 out_seq=0 2024-09-11T23:21:10.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.152+0000 7efea4c00640 10 client.5817 ms_handle_connect on v2:172.21.15.144:6835/1648435689 2024-09-11T23:21:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.153+0000 7efea4c00640 1 -- 172.21.15.144:0/4108347912 <== mds.0 v2:172.21.15.144:6835/1648435689 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56003e689b40 con 0x56003e7429e0 2024-09-11T23:21:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.153+0000 7efea4c00640 10 client.5817 handle_command_reply: tid=0 2024-09-11T23:21:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.153+0000 7efec1203740 1 client.5817 shutdown 2024-09-11T23:21:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.153+0000 7efec1203740 1 -- 172.21.15.144:0/4108347912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e71a480 msgr2=0x56003e737130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.153+0000 7efec1203740 1 --2- 172.21.15.144:0/4108347912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e71a480 0x56003e737130 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7efea0011dd0 tx=0x7efea00046c0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.153+0000 7efec1203740 1 -- 172.21.15.144:0/4108347912 shutdown_connections 2024-09-11T23:21:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.153+0000 7efec1203740 1 --2- 172.21.15.144:0/4108347912 >> [v2:172.21.15.144:6835/1648435689,v1:172.21.15.144:6837/1648435689] conn(0x56003e7429e0 0x56003e742dc0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.153+0000 7efec1203740 1 --2- 172.21.15.144:0/4108347912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56003e771a90 0x56003e717250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.153+0000 7efec1203740 1 --2- 172.21.15.144:0/4108347912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e71a480 0x56003e737130 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.153+0000 7efea4c00640 0 client.5817 ms_handle_reset on v2:172.21.15.144:6835/1648435689 2024-09-11T23:21:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.153+0000 7efec1203740 1 --2- 172.21.15.144:0/4108347912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56003e718cf0 0x56003e738060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.153+0000 7efec1203740 1 -- 172.21.15.144:0/4108347912 >> 172.21.15.144:0/4108347912 conn(0x56003e7164b0 msgr2=0x56003e75cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.153+0000 7efec1203740 1 -- 172.21.15.144:0/4108347912 shutdown_connections 2024-09-11T23:21:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.153+0000 7efec1203740 1 -- 172.21.15.144:0/4108347912 wait complete. 2024-09-11T23:21:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.153+0000 7efec1203740 20 client.5817 trim_cache size 0 max 16384 2024-09-11T23:21:10.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.172+0000 7efec1203740 1 Processor -- start 2024-09-11T23:21:10.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.172+0000 7efec1203740 1 -- start start 2024-09-11T23:21:10.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.172+0000 7efec1203740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56003e718cf0 0x56003e742dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.172+0000 7efec1203740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56003e71a480 0x56003e743300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.172+0000 7efec1203740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e771a90 0x56003e75d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.173+0000 7efec1203740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efeb81fb700 con 0x56003e771a90 2024-09-11T23:21:10.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.173+0000 7efec1203740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8156fe0 con 0x56003e71a480 2024-09-11T23:21:10.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.173+0000 7efec1203740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efeb8157630 con 0x56003e718cf0 2024-09-11T23:21:10.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.173+0000 7efeb7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e771a90 0x56003e75d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.173+0000 7efeb7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e771a90 0x56003e75d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38454/0 (socket says 172.21.15.144:38454) 2024-09-11T23:21:10.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.173+0000 7efeb7e00640 1 -- 172.21.15.144:0/1007676752 learned_addr learned my addr 172.21.15.144:0/1007676752 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:10.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.173+0000 7efeb7e00640 1 -- 172.21.15.144:0/1007676752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56003e718cf0 msgr2=0x56003e742dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:10.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.173+0000 7efeb7e00640 1 --2- 172.21.15.144:0/1007676752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56003e718cf0 0x56003e742dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.173+0000 7efeb7e00640 1 -- 172.21.15.144:0/1007676752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56003e71a480 msgr2=0x56003e743300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:10.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.173+0000 7efeb7e00640 1 --2- 172.21.15.144:0/1007676752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56003e71a480 0x56003e743300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.173+0000 7efeb7e00640 1 -- 172.21.15.144:0/1007676752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56003e739c50 con 0x56003e771a90 2024-09-11T23:21:10.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.173+0000 7efeb7e00640 1 --2- 172.21.15.144:0/1007676752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e771a90 0x56003e75d930 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7efeb0001e40 tx=0x7efeb0011680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20004b01667ae94 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:10.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.174+0000 7efea7400640 1 -- 172.21.15.144:0/1007676752 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0018020 con 0x56003e771a90 2024-09-11T23:21:10.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.174+0000 7efea7400640 1 -- 172.21.15.144:0/1007676752 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb0003b70 con 0x56003e771a90 2024-09-11T23:21:10.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.174+0000 7efea7400640 1 -- 172.21.15.144:0/1007676752 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0011e50 con 0x56003e771a90 2024-09-11T23:21:10.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.174+0000 7efec1203740 1 -- 172.21.15.144:0/1007676752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e771a90 msgr2=0x56003e75d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.174+0000 7efec1203740 1 --2- 172.21.15.144:0/1007676752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e771a90 0x56003e75d930 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7efeb0001e40 tx=0x7efeb0011680 comp rx=0 tx=0).stop 2024-09-11T23:21:10.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.174+0000 7efec1203740 1 -- 172.21.15.144:0/1007676752 shutdown_connections 2024-09-11T23:21:10.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.174+0000 7efec1203740 1 --2- 172.21.15.144:0/1007676752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e771a90 0x56003e75d930 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.174+0000 7efec1203740 1 --2- 172.21.15.144:0/1007676752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56003e71a480 0x56003e743300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.174+0000 7efec1203740 1 --2- 172.21.15.144:0/1007676752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56003e718cf0 0x56003e742dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.174+0000 7efec1203740 1 -- 172.21.15.144:0/1007676752 >> 172.21.15.144:0/1007676752 conn(0x56003e7164b0 msgr2=0x56003e73ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:10.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.174+0000 7efec1203740 1 -- 172.21.15.144:0/1007676752 shutdown_connections 2024-09-11T23:21:10.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.174+0000 7efec1203740 1 -- 172.21.15.144:0/1007676752 wait complete. 2024-09-11T23:21:10.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.175+0000 7efec1203740 1 -- start start 2024-09-11T23:21:10.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.175+0000 7efec1203740 1 Processor -- start 2024-09-11T23:21:10.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.176+0000 7efec1203740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56003e718cf0 0x56003e718640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.176+0000 7efec1203740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56003e71a480 0x56003e775fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.176+0000 7efec1203740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e771a90 0x56003e742dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.176+0000 7efec1203740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56003e737670 con 0x56003e771a90 2024-09-11T23:21:10.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.176+0000 7efec1203740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56003e741fe0 con 0x56003e71a480 2024-09-11T23:21:10.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.176+0000 7efec1203740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56003e739a00 con 0x56003e718cf0 2024-09-11T23:21:10.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.176+0000 7efec1203740 10 client.0 _ll_register_callbacks cb 0x7efea0011cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:21:10.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.177+0000 7efeb7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e771a90 0x56003e742dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.177+0000 7efeb7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e771a90 0x56003e742dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38464/0 (socket says 172.21.15.144:38464) 2024-09-11T23:21:10.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.177+0000 7efeb7e00640 1 -- 172.21.15.144:0/2807515692 learned_addr learned my addr 172.21.15.144:0/2807515692 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:10.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.177+0000 7efeaea00640 1 --2- 172.21.15.144:0/2807515692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56003e71a480 0x56003e775fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.177+0000 7efeb7400640 1 --2- 172.21.15.144:0/2807515692 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56003e718cf0 0x56003e718640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.177+0000 7efeb7e00640 1 -- 172.21.15.144:0/2807515692 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56003e718cf0 msgr2=0x56003e718640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:10.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.177+0000 7efeb7e00640 1 --2- 172.21.15.144:0/2807515692 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56003e718cf0 0x56003e718640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.177+0000 7efeb7e00640 1 -- 172.21.15.144:0/2807515692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56003e71a480 msgr2=0x56003e775fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:10.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.177+0000 7efeb7e00640 1 --2- 172.21.15.144:0/2807515692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56003e71a480 0x56003e775fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.177+0000 7efeb7e00640 1 -- 172.21.15.144:0/2807515692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56003e781f00 con 0x56003e771a90 2024-09-11T23:21:10.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.177+0000 7efeb7e00640 1 --2- 172.21.15.144:0/2807515692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e771a90 0x56003e742dc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7efeb0011b80 tx=0x7efeb0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9513525ffc976f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:10.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.177+0000 7efea4c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:21:10.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.177+0000 7efea4c00640 1 -- 172.21.15.144:0/2807515692 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb0018030 con 0x56003e771a90 2024-09-11T23:21:10.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.178+0000 7efea4c00640 1 -- 172.21.15.144:0/2807515692 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7efeb0006b50 con 0x56003e771a90 2024-09-11T23:21:10.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.178+0000 7efec1203740 1 -- 172.21.15.144:0/2807515692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efeb0003b70 con 0x56003e771a90 2024-09-11T23:21:10.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.178+0000 7efea4c00640 1 -- 172.21.15.144:0/2807515692 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7efeb002f050 con 0x56003e771a90 2024-09-11T23:21:10.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.178+0000 7efec1203740 10 client.5823 fetch_fsmap learned FSMap version 35 2024-09-11T23:21:10.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.178+0000 7efec1203740 1 -- 172.21.15.144:0/2807515692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x56003e781c20 con 0x56003e771a90 2024-09-11T23:21:10.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.178+0000 7efea4c00640 1 -- 172.21.15.144:0/2807515692 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb0003b70 con 0x56003e771a90 2024-09-11T23:21:10.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.178+0000 7efea4c00640 1 -- 172.21.15.144:0/2807515692 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 35) ==== 3502+0+0 (secure 0 0 0) 0x7efeb0032020 con 0x56003e771a90 2024-09-11T23:21:10.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.178+0000 7efec1203740 10 client.5823 fetch_fsmap finished waiting for FSMap version 35 2024-09-11T23:21:10.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.178+0000 7efec1203740 10 client.5823 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:21:10.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.178+0000 7efec1203740 20 client.5823 populate_metadata read hostname 'smithi144' 2024-09-11T23:21:10.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.178+0000 7efec1203740 1 --2- 172.21.15.144:0/2807515692 >> [v2:172.21.15.144:6835/1648435689,v1:172.21.15.144:6837/1648435689] conn(0x56003e743420 0x56003e780280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.178+0000 7efec1203740 4 client.5823 mds_command: new command op to 5667 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:21:10.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.178+0000 7efec1203740 1 -- 172.21.15.144:0/2807515692 --> [v2:172.21.15.144:6835/1648435689,v1:172.21.15.144:6837/1648435689] -- command(tid 0: {"prefix": "status"}) -- 0x56003e75cd00 con 0x56003e743420 2024-09-11T23:21:10.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.179+0000 7efeb7400640 1 --2- 172.21.15.144:0/2807515692 >> [v2:172.21.15.144:6835/1648435689,v1:172.21.15.144:6837/1648435689] conn(0x56003e743420 0x56003e780280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.179+0000 7efeb7400640 1 --2- 172.21.15.144:0/2807515692 >> [v2:172.21.15.144:6835/1648435689,v1:172.21.15.144:6837/1648435689] conn(0x56003e743420 0x56003e780280 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeb890e0f380cb0b server_cookie=7f7f57f304d3d89 in_seq=0 out_seq=0 2024-09-11T23:21:10.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.179+0000 7efea4c00640 10 client.5823 ms_handle_connect on v2:172.21.15.144:6835/1648435689 2024-09-11T23:21:10.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.179+0000 7efea4c00640 1 -- 172.21.15.144:0/2807515692 <== mds.0 v2:172.21.15.144:6835/1648435689 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x56003e75cd00 con 0x56003e743420 2024-09-11T23:21:10.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.179+0000 7efea4c00640 10 client.5823 handle_command_reply: tid=0 2024-09-11T23:21:10.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.179+0000 7efec1203740 1 client.5823 shutdown 2024-09-11T23:21:10.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.179+0000 7efec1203740 1 -- 172.21.15.144:0/2807515692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e771a90 msgr2=0x56003e742dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.179+0000 7efec1203740 1 --2- 172.21.15.144:0/2807515692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e771a90 0x56003e742dc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7efeb0011b80 tx=0x7efeb0001250 comp rx=0 tx=0).stop 2024-09-11T23:21:10.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.179+0000 7efec1203740 1 -- 172.21.15.144:0/2807515692 shutdown_connections 2024-09-11T23:21:10.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.179+0000 7efec1203740 1 --2- 172.21.15.144:0/2807515692 >> [v2:172.21.15.144:6835/1648435689,v1:172.21.15.144:6837/1648435689] conn(0x56003e743420 0x56003e780280 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.180+0000 7efec1203740 1 --2- 172.21.15.144:0/2807515692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56003e771a90 0x56003e742dc0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.180+0000 7efea4c00640 0 client.5823 ms_handle_reset on v2:172.21.15.144:6835/1648435689 2024-09-11T23:21:10.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.180+0000 7efec1203740 1 --2- 172.21.15.144:0/2807515692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56003e71a480 0x56003e775fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.180+0000 7efec1203740 1 --2- 172.21.15.144:0/2807515692 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56003e718cf0 0x56003e718640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.180+0000 7efec1203740 1 -- 172.21.15.144:0/2807515692 >> 172.21.15.144:0/2807515692 conn(0x56003e7164b0 msgr2=0x56003e737fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:10.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.180+0000 7efec1203740 1 -- 172.21.15.144:0/2807515692 shutdown_connections 2024-09-11T23:21:10.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.180+0000 7efec1203740 1 -- 172.21.15.144:0/2807515692 wait complete. 2024-09-11T23:21:10.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.180+0000 7efec1203740 20 client.5823 trim_cache size 0 max 16384 2024-09-11T23:21:10.185 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:21:10.186 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "4b73e4b7-12f0-4e37-94bc-45e333efe84e", 2024-09-11T23:21:10.186 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-11T23:21:10.186 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 5667, 2024-09-11T23:21:10.186 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-11T23:21:10.186 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-11T23:21:10.186 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-11T23:21:10.186 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 10.724179005, 2024-09-11T23:21:10.186 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 35, 2024-09-11T23:21:10.186 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 59, 2024-09-11T23:21:10.186 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 59, 2024-09-11T23:21:10.187 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 15.451489219000001 2024-09-11T23:21:10.187 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:21:10.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.180+0000 7efebe400640 1 -- 172.21.15.144:0/2632972214 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efe9406bfe0 msgr2=0x7efe9406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.180+0000 7efebe400640 1 --2- 172.21.15.144:0/2632972214 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efe9406bfe0 0x7efe9406e4a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efeb80b1730 tx=0x7efea0008040 comp rx=0 tx=0).stop 2024-09-11T23:21:10.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.180+0000 7efebe400640 1 -- 172.21.15.144:0/2632972214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb80d02a0 msgr2=0x7efeb80aecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.180+0000 7efebe400640 1 --2- 172.21.15.144:0/2632972214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb80d02a0 0x7efeb80aecd0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7efea8000c00 tx=0x7efea80046c0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.180+0000 7efebe400640 1 -- 172.21.15.144:0/2632972214 shutdown_connections 2024-09-11T23:21:10.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.180+0000 7efebe400640 1 --2- 172.21.15.144:0/2632972214 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efe9406bfe0 0x7efe9406e4a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.180+0000 7efebe400640 1 --2- 172.21.15.144:0/2632972214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efeb815ce80 0x7efeb8071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.180+0000 7efebe400640 1 --2- 172.21.15.144:0/2632972214 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb815ca40 0x7efeb8073c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.180+0000 7efebe400640 1 --2- 172.21.15.144:0/2632972214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb80d02a0 0x7efeb80aecd0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.181+0000 7efebe400640 1 -- 172.21.15.144:0/2632972214 >> 172.21.15.144:0/2632972214 conn(0x7efeb8062cc0 msgr2=0x7efeb80b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:10.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.181+0000 7efebe400640 1 -- 172.21.15.144:0/2632972214 shutdown_connections 2024-09-11T23:21:10.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.181+0000 7efebe400640 1 -- 172.21.15.144:0/2632972214 wait complete. 2024-09-11T23:21:10.196 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:21:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.348+0000 7f1dff000640 1 Processor -- start 2024-09-11T23:21:10.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.348+0000 7f1dff000640 1 -- start start 2024-09-11T23:21:10.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.349+0000 7f1dff000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1df80d02a0 0x7f1df80d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.349+0000 7f1dff000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1df815ca40 0x7f1df815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.349+0000 7f1dff000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1df815ce80 0x7f1df81594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.349+0000 7f1dff000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1df80d0bc0 con 0x7f1df815ce80 2024-09-11T23:21:10.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.349+0000 7f1dff000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1df815d390 con 0x7f1df815ca40 2024-09-11T23:21:10.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.349+0000 7f1dff000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1df815d670 con 0x7f1df80d02a0 2024-09-11T23:21:10.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.350+0000 7f1dfd000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1df815ce80 0x7f1df81594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.350+0000 7f1dfd000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1df815ce80 0x7f1df81594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38474/0 (socket says 172.21.15.144:38474) 2024-09-11T23:21:10.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.350+0000 7f1dfd000640 1 -- 172.21.15.144:0/898718604 learned_addr learned my addr 172.21.15.144:0/898718604 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:10.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.350+0000 7f1df7400640 1 --2- 172.21.15.144:0/898718604 >> v2:172.21.15.165:3300/0 conn(0x7f1df815ca40 0x7f1df815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.350+0000 7f1df7e00640 1 --2- 172.21.15.144:0/898718604 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1df80d02a0 0x7f1df80d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.350+0000 7f1dfd000640 1 -- 172.21.15.144:0/898718604 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1df80d02a0 msgr2=0x7f1df80d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:10.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.350+0000 7f1dfd000640 1 --2- 172.21.15.144:0/898718604 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1df80d02a0 0x7f1df80d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.350+0000 7f1dfd000640 1 -- 172.21.15.144:0/898718604 >> v2:172.21.15.165:3300/0 conn(0x7f1df815ca40 msgr2=0x7f1df815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:10.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.350+0000 7f1dfd000640 1 --2- 172.21.15.144:0/898718604 >> v2:172.21.15.165:3300/0 conn(0x7f1df815ca40 0x7f1df815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.350+0000 7f1dfd000640 1 -- 172.21.15.144:0/898718604 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df815d950 con 0x7f1df815ce80 2024-09-11T23:21:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.351+0000 7f1dfd000640 1 --2- 172.21.15.144:0/898718604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df815ce80 0x7f1df81594c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1df806f400 tx=0x7f1df002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2662bd741f7dca34 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.351+0000 7f1df6a00640 1 -- 172.21.15.144:0/898718604 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df0036070 con 0x7f1df815ce80 2024-09-11T23:21:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.351+0000 7f1df6a00640 1 -- 172.21.15.144:0/898718604 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df0031600 con 0x7f1df815ce80 2024-09-11T23:21:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.351+0000 7f1df6a00640 1 -- 172.21.15.144:0/898718604 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df00319d0 con 0x7f1df815ce80 2024-09-11T23:21:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.352+0000 7f1dff000640 1 -- 172.21.15.144:0/898718604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df815ce80 msgr2=0x7f1df81594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.352+0000 7f1dff000640 1 --2- 172.21.15.144:0/898718604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df815ce80 0x7f1df81594c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1df806f400 tx=0x7f1df002a610 comp rx=0 tx=0).stop 2024-09-11T23:21:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.352+0000 7f1dff000640 1 -- 172.21.15.144:0/898718604 shutdown_connections 2024-09-11T23:21:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.352+0000 7f1dff000640 1 --2- 172.21.15.144:0/898718604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df815ce80 0x7f1df81594c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.352+0000 7f1dff000640 1 --2- 172.21.15.144:0/898718604 >> v2:172.21.15.165:3300/0 conn(0x7f1df815ca40 0x7f1df815e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.352+0000 7f1dff000640 1 --2- 172.21.15.144:0/898718604 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1df80d02a0 0x7f1df80d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.352+0000 7f1dff000640 1 -- 172.21.15.144:0/898718604 >> 172.21.15.144:0/898718604 conn(0x7f1df8062cc0 msgr2=0x7f1df806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.352+0000 7f1dff000640 1 -- 172.21.15.144:0/898718604 shutdown_connections 2024-09-11T23:21:10.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.352+0000 7f1dff000640 1 -- 172.21.15.144:0/898718604 wait complete. 2024-09-11T23:21:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.354+0000 7f1dff000640 1 Processor -- start 2024-09-11T23:21:10.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.354+0000 7f1dff000640 1 -- start start 2024-09-11T23:21:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.355+0000 7f1dff000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df80d02a0 0x7f1df814e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.355+0000 7f1dff000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1df815ca40 0x7f1df814e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.355+0000 7f1dff000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1df815ce80 0x7f1df815bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.355+0000 7f1dff000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1df8155b90 con 0x7f1df80d02a0 2024-09-11T23:21:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.355+0000 7f1dff000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1df815df10 con 0x7f1df815ca40 2024-09-11T23:21:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.355+0000 7f1dff000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1df8155d10 con 0x7f1df815ce80 2024-09-11T23:21:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.355+0000 7f1df7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df80d02a0 0x7f1df814e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.355+0000 7f1df7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df80d02a0 0x7f1df814e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38482/0 (socket says 172.21.15.144:38482) 2024-09-11T23:21:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.355+0000 7f1df7e00640 1 -- 172.21.15.144:0/1775710934 learned_addr learned my addr 172.21.15.144:0/1775710934 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:10.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.355+0000 7f1dfd000640 1 --2- 172.21.15.144:0/1775710934 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1df815ce80 0x7f1df815bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.355+0000 7f1df7400640 1 --2- 172.21.15.144:0/1775710934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1df815ca40 0x7f1df814e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.355+0000 7f1df7e00640 1 -- 172.21.15.144:0/1775710934 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1df815ce80 msgr2=0x7f1df815bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.355+0000 7f1df7e00640 1 --2- 172.21.15.144:0/1775710934 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1df815ce80 0x7f1df815bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.355+0000 7f1df7e00640 1 -- 172.21.15.144:0/1775710934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1df815ca40 msgr2=0x7f1df814e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.355+0000 7f1df7e00640 1 --2- 172.21.15.144:0/1775710934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1df815ca40 0x7f1df814e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.355+0000 7f1df7e00640 1 -- 172.21.15.144:0/1775710934 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df8159e70 con 0x7f1df80d02a0 2024-09-11T23:21:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.355+0000 7f1dfd000640 1 --2- 172.21.15.144:0/1775710934 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1df815ce80 0x7f1df815bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.356+0000 7f1df7e00640 1 --2- 172.21.15.144:0/1775710934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df80d02a0 0x7f1df814e9a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1de800e870 tx=0x7f1de800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.356+0000 7f1defe00640 1 -- 172.21.15.144:0/1775710934 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de8017070 con 0x7f1df80d02a0 2024-09-11T23:21:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.356+0000 7f1defe00640 1 -- 172.21.15.144:0/1775710934 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1de800ee60 con 0x7f1df80d02a0 2024-09-11T23:21:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.356+0000 7f1defe00640 1 -- 172.21.15.144:0/1775710934 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de800cb80 con 0x7f1df80d02a0 2024-09-11T23:21:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.356+0000 7f1dff000640 1 -- 172.21.15.144:0/1775710934 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1df8159930 con 0x7f1df80d02a0 2024-09-11T23:21:10.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.356+0000 7f1dff000640 1 -- 172.21.15.144:0/1775710934 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1df815a3c0 con 0x7f1df80d02a0 2024-09-11T23:21:10.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.357+0000 7f1dff000640 1 -- 172.21.15.144:0/1775710934 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1df80b4790 con 0x7f1df80d02a0 2024-09-11T23:21:10.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.358+0000 7f1defe00640 1 -- 172.21.15.144:0/1775710934 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f1de801a070 con 0x7f1df80d02a0 2024-09-11T23:21:10.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.359+0000 7f1defe00640 1 --2- 172.21.15.144:0/1775710934 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1dd806c010 0x7f1dd806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:10.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.359+0000 7f1defe00640 1 -- 172.21.15.144:0/1775710934 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f1de808af10 con 0x7f1df80d02a0 2024-09-11T23:21:10.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.359+0000 7f1df7400640 1 --2- 172.21.15.144:0/1775710934 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1dd806c010 0x7f1dd806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:10.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.360+0000 7f1df7400640 1 --2- 172.21.15.144:0/1775710934 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1dd806c010 0x7f1dd806e4d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1df80af8c0 tx=0x7f1de4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:10.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.364+0000 7f1defe00640 1 -- 172.21.15.144:0/1775710934 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1de80596d0 con 0x7f1df80d02a0 2024-09-11T23:21:10.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.572+0000 7f1dff000640 1 -- 172.21.15.144:0/1775710934 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1df80af950 con 0x7f1df80d02a0 2024-09-11T23:21:10.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.573+0000 7f1defe00640 1 -- 172.21.15.144:0/1775710934 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) ==== 53+0+73 (secure 0 0 0) 0x7f1de8058fd0 con 0x7f1df80d02a0 2024-09-11T23:21:10.573 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:21:10.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.575+0000 7f1dff000640 1 -- 172.21.15.144:0/1775710934 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1dd806c010 msgr2=0x7f1dd806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.575+0000 7f1dff000640 1 --2- 172.21.15.144:0/1775710934 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1dd806c010 0x7f1dd806e4d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1df80af8c0 tx=0x7f1de4008040 comp rx=0 tx=0).stop 2024-09-11T23:21:10.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.575+0000 7f1dff000640 1 -- 172.21.15.144:0/1775710934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df80d02a0 msgr2=0x7f1df814e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:10.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.575+0000 7f1dff000640 1 --2- 172.21.15.144:0/1775710934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df80d02a0 0x7f1df814e9a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1de800e870 tx=0x7f1de800ed30 comp rx=0 tx=0).stop 2024-09-11T23:21:10.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.575+0000 7f1dff000640 1 -- 172.21.15.144:0/1775710934 shutdown_connections 2024-09-11T23:21:10.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.575+0000 7f1dff000640 1 --2- 172.21.15.144:0/1775710934 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1dd806c010 0x7f1dd806e4d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.575+0000 7f1dff000640 1 --2- 172.21.15.144:0/1775710934 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1df815ce80 0x7f1df815bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.575+0000 7f1dff000640 1 --2- 172.21.15.144:0/1775710934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1df815ca40 0x7f1df814e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.575+0000 7f1dff000640 1 --2- 172.21.15.144:0/1775710934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1df80d02a0 0x7f1df814e9a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:10.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.575+0000 7f1dff000640 1 -- 172.21.15.144:0/1775710934 >> 172.21.15.144:0/1775710934 conn(0x7f1df8062cc0 msgr2=0x7f1df80b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:10.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.575+0000 7f1dff000640 1 -- 172.21.15.144:0/1775710934 shutdown_connections 2024-09-11T23:21:10.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10.575+0000 7f1dff000640 1 -- 172.21.15.144:0/1775710934 wait complete. 2024-09-11T23:21:10.591 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:21:10.592 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:21:10.592 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-11T23:21:10.592 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:21:10.592 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:21:10.592 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:21:10.592 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:21:10.592 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:21:10.592 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:21:10.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:10.592 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-11T23:21:10.628 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:21:10.628 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:21:10.628 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:21:10.628 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-11T23:21:10.629 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:21:10.630 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42492sec preferred_lft 42492sec 2024-09-11T23:21:10.630 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2024-09-11T23:21:10.630 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:21:10.630 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:21:10.630 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff 2024-09-11T23:21:10.630 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:21:10.630 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:21:10.630 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::243b:82ff:fe06:fac9/64 scope link 2024-09-11T23:21:10.630 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:21:10.630 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:21:10.630 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:21:10.630 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::74ca:30ff:fef2:cddf/64 scope link 2024-09-11T23:21:10.630 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:21:10.630 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:21:10.631 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether be:01:ec:87:34:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:21:10.631 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bc01:ecff:fe87:34e1/64 scope link 2024-09-11T23:21:10.631 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:21:10.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:10.631 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:21:10.721 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-11T23:21:10.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:10.725 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-11T23:21:10.761 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-11T23:21:10.761 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:21:10.762 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:21:10.762 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:21:10.762 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:21:10.762 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:21:10.762 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-11T23:21:10.762 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:21:10.763 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:21:10.763 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:21:10.763 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-11T23:21:10.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:21:10.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:21:10.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:10.957 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-11T23:21:10.993 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:21:10.993 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:21:10.993 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:21:10.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:10.993 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-11T23:21:11.090 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:21:11.090 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:21:11.126 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:21:11.126 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:21:11.126 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:21:11.200 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T23:21:11.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:11.200 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:21:11.330 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:21:11.330 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:21:11.358 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:21:11.358 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:21:11.358 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:21:11.358 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:21:11.358 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:21:11.360 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T23:21:11.361 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:21:11.361 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:21:11.361 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:21:11.361 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:21:11.364 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:21:11.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:11.364 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:21:11.421 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:21:11.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:21:11.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:21:11.516 INFO:teuthology.orchestra.run.smithi144.stdout:client5832 2024-09-11T23:21:11.517 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:21:11.517 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:21:11.552 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:21:11.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.745+0000 7f6bf6200640 1 Processor -- start 2024-09-11T23:21:11.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.746+0000 7f6bf6200640 1 -- start start 2024-09-11T23:21:11.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.747+0000 7f6bf6200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6bf00d02a0 0x7f6bf00d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:11.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.747+0000 7f6bf6200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6bf015ca40 0x7f6bf015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:11.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.747+0000 7f6bf6200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bf015ceb0 0x7f6bf01594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:11.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.747+0000 7f6bf6200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6bf00d0bc0 con 0x7f6bf00d02a0 2024-09-11T23:21:11.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.747+0000 7f6bf6200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6bf015d390 con 0x7f6bf015ca40 2024-09-11T23:21:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.747+0000 7f6bf6200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf015d670 con 0x7f6bf015ceb0 2024-09-11T23:21:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.747+0000 7f6bef400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6bf00d02a0 0x7f6bf00d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.747+0000 7f6bef400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6bf00d02a0 0x7f6bf00d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38496/0 (socket says 172.21.15.144:38496) 2024-09-11T23:21:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.747+0000 7f6bef400640 1 -- 172.21.15.144:0/4147746608 learned_addr learned my addr 172.21.15.144:0/4147746608 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.747+0000 7f6befe00640 1 --2- 172.21.15.144:0/4147746608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bf015ceb0 0x7f6bf01594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.747+0000 7f6be6a00640 1 --2- 172.21.15.144:0/4147746608 >> v2:172.21.15.165:3300/0 conn(0x7f6bf015ca40 0x7f6bf015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.747+0000 7f6bef400640 1 -- 172.21.15.144:0/4147746608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bf015ceb0 msgr2=0x7f6bf01594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.747+0000 7f6bef400640 1 --2- 172.21.15.144:0/4147746608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bf015ceb0 0x7f6bf01594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.748+0000 7f6bef400640 1 -- 172.21.15.144:0/4147746608 >> v2:172.21.15.165:3300/0 conn(0x7f6bf015ca40 msgr2=0x7f6bf015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.748+0000 7f6bef400640 1 --2- 172.21.15.144:0/4147746608 >> v2:172.21.15.165:3300/0 conn(0x7f6bf015ca40 0x7f6bf015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.748+0000 7f6bef400640 1 -- 172.21.15.144:0/4147746608 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf015d950 con 0x7f6bf00d02a0 2024-09-11T23:21:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.748+0000 7f6befe00640 1 --2- 172.21.15.144:0/4147746608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bf015ceb0 0x7f6bf01594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:11.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.748+0000 7f6be6a00640 1 --2- 172.21.15.144:0/4147746608 >> v2:172.21.15.165:3300/0 conn(0x7f6bf015ca40 0x7f6bf015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:11.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.748+0000 7f6bef400640 1 --2- 172.21.15.144:0/4147746608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bf00d02a0 0x7f6bf00d0680 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6bf00cf320 tx=0x7f6be002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254497b25f7498fa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:11.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.749+0000 7f6beea00640 1 -- 172.21.15.144:0/4147746608 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0037070 con 0x7f6bf00d02a0 2024-09-11T23:21:11.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.749+0000 7f6beea00640 1 -- 172.21.15.144:0/4147746608 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be0032440 con 0x7f6bf00d02a0 2024-09-11T23:21:11.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.749+0000 7f6beea00640 1 -- 172.21.15.144:0/4147746608 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0032810 con 0x7f6bf00d02a0 2024-09-11T23:21:11.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.749+0000 7f6bf6200640 1 -- 172.21.15.144:0/4147746608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bf00d02a0 msgr2=0x7f6bf00d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:11.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.749+0000 7f6bf6200640 1 --2- 172.21.15.144:0/4147746608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bf00d02a0 0x7f6bf00d0680 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6bf00cf320 tx=0x7f6be002a140 comp rx=0 tx=0).stop 2024-09-11T23:21:11.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.749+0000 7f6bf6200640 1 -- 172.21.15.144:0/4147746608 shutdown_connections 2024-09-11T23:21:11.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.749+0000 7f6bf6200640 1 --2- 172.21.15.144:0/4147746608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bf015ceb0 0x7f6bf01594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:11.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.749+0000 7f6bf6200640 1 --2- 172.21.15.144:0/4147746608 >> v2:172.21.15.165:3300/0 conn(0x7f6bf015ca40 0x7f6bf015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:11.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.749+0000 7f6bf6200640 1 --2- 172.21.15.144:0/4147746608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bf00d02a0 0x7f6bf00d0680 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:11.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.749+0000 7f6bf6200640 1 -- 172.21.15.144:0/4147746608 >> 172.21.15.144:0/4147746608 conn(0x7f6bf0062cc0 msgr2=0x7f6bf006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:11.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.749+0000 7f6bf6200640 1 -- 172.21.15.144:0/4147746608 shutdown_connections 2024-09-11T23:21:11.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.750+0000 7f6bf6200640 1 -- 172.21.15.144:0/4147746608 wait complete. 2024-09-11T23:21:11.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.751+0000 7f6bf6200640 1 Processor -- start 2024-09-11T23:21:11.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.751+0000 7f6bf6200640 1 -- start start 2024-09-11T23:21:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.752+0000 7f6bf6200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bf00d02a0 0x7f6bf014ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.752+0000 7f6bf6200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bf015ca40 0x7f6bf01570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.752+0000 7f6bf6200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bf015ceb0 0x7f6bf0073780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.752+0000 7f6bf6200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf0155b90 con 0x7f6bf00d02a0 2024-09-11T23:21:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.752+0000 7f6bf6200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf015df10 con 0x7f6bf015ca40 2024-09-11T23:21:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.752+0000 7f6bf6200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf0155d10 con 0x7f6bf015ceb0 2024-09-11T23:21:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.752+0000 7f6bef400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bf00d02a0 0x7f6bf014ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:11.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.752+0000 7f6bef400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bf00d02a0 0x7f6bf014ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38512/0 (socket says 172.21.15.144:38512) 2024-09-11T23:21:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.752+0000 7f6bef400640 1 -- 172.21.15.144:0/3366648094 learned_addr learned my addr 172.21.15.144:0/3366648094 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.753+0000 7f6be6a00640 1 --2- 172.21.15.144:0/3366648094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bf015ca40 0x7f6bf01570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.753+0000 7f6befe00640 1 --2- 172.21.15.144:0/3366648094 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bf015ceb0 0x7f6bf0073780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.753+0000 7f6bef400640 1 -- 172.21.15.144:0/3366648094 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bf015ceb0 msgr2=0x7f6bf0073780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.753+0000 7f6bef400640 1 --2- 172.21.15.144:0/3366648094 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bf015ceb0 0x7f6bf0073780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.753+0000 7f6bef400640 1 -- 172.21.15.144:0/3366648094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bf015ca40 msgr2=0x7f6bf01570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.753+0000 7f6bef400640 1 --2- 172.21.15.144:0/3366648094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bf015ca40 0x7f6bf01570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.753+0000 7f6bef400640 1 -- 172.21.15.144:0/3366648094 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf014cf60 con 0x7f6bf00d02a0 2024-09-11T23:21:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.753+0000 7f6be6a00640 1 --2- 172.21.15.144:0/3366648094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bf015ca40 0x7f6bf01570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.753+0000 7f6befe00640 1 --2- 172.21.15.144:0/3366648094 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bf015ceb0 0x7f6bf0073780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.753+0000 7f6bef400640 1 --2- 172.21.15.144:0/3366648094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bf00d02a0 0x7f6bf014ca20 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6be002a180 tx=0x7f6be00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.753+0000 7f6be7e00640 1 -- 172.21.15.144:0/3366648094 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0041020 con 0x7f6bf00d02a0 2024-09-11T23:21:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.753+0000 7f6be7e00640 1 -- 172.21.15.144:0/3366648094 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be00306c0 con 0x7f6bf00d02a0 2024-09-11T23:21:11.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.753+0000 7f6be7e00640 1 -- 172.21.15.144:0/3366648094 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0037040 con 0x7f6bf00d02a0 2024-09-11T23:21:11.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.753+0000 7f6bf6200640 1 -- 172.21.15.144:0/3366648094 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf0072400 con 0x7f6bf00d02a0 2024-09-11T23:21:11.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.753+0000 7f6bf6200640 1 -- 172.21.15.144:0/3366648094 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf00729c0 con 0x7f6bf00d02a0 2024-09-11T23:21:11.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.755+0000 7f6bf6200640 1 -- 172.21.15.144:0/3366648094 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf00b4790 con 0x7f6bf00d02a0 2024-09-11T23:21:11.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.755+0000 7f6be7e00640 1 -- 172.21.15.144:0/3366648094 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f6be0044020 con 0x7f6bf00d02a0 2024-09-11T23:21:11.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.756+0000 7f6be7e00640 1 --2- 172.21.15.144:0/3366648094 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6bcc06bfe0 0x7f6bcc06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:11.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.756+0000 7f6be7e00640 1 -- 172.21.15.144:0/3366648094 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f6be00ab9c0 con 0x7f6bf00d02a0 2024-09-11T23:21:11.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.756+0000 7f6be6a00640 1 --2- 172.21.15.144:0/3366648094 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6bcc06bfe0 0x7f6bcc06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:11.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.757+0000 7f6be6a00640 1 --2- 172.21.15.144:0/3366648094 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6bcc06bfe0 0x7f6bcc06e4a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8006fd0 tx=0x7f6bd8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:11.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.760+0000 7f6be7e00640 1 -- 172.21.15.144:0/3366648094 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6be004b030 con 0x7f6bf00d02a0 2024-09-11T23:21:11.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.966+0000 7f6bf6200640 1 -- 172.21.15.144:0/3366648094 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6bf0063470 con 0x7f6bf00d02a0 2024-09-11T23:21:11.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.967+0000 7f6be7e00640 1 -- 172.21.15.144:0/3366648094 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) ==== 53+0+73 (secure 0 0 0) 0x7f6be007a0e0 con 0x7f6bf00d02a0 2024-09-11T23:21:11.967 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:21:11.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.969+0000 7f6bf6200640 1 -- 172.21.15.144:0/3366648094 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6bcc06bfe0 msgr2=0x7f6bcc06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:11.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.969+0000 7f6bf6200640 1 --2- 172.21.15.144:0/3366648094 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6bcc06bfe0 0x7f6bcc06e4a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8006fd0 tx=0x7f6bd8008040 comp rx=0 tx=0).stop 2024-09-11T23:21:11.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.969+0000 7f6bf6200640 1 -- 172.21.15.144:0/3366648094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bf00d02a0 msgr2=0x7f6bf014ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:11.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.969+0000 7f6bf6200640 1 --2- 172.21.15.144:0/3366648094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bf00d02a0 0x7f6bf014ca20 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6be002a180 tx=0x7f6be00046c0 comp rx=0 tx=0).stop 2024-09-11T23:21:11.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.969+0000 7f6bf6200640 1 -- 172.21.15.144:0/3366648094 shutdown_connections 2024-09-11T23:21:11.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.969+0000 7f6bf6200640 1 --2- 172.21.15.144:0/3366648094 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6bcc06bfe0 0x7f6bcc06e4a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:11.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.969+0000 7f6bf6200640 1 --2- 172.21.15.144:0/3366648094 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bf015ceb0 0x7f6bf0073780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:11.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.969+0000 7f6bf6200640 1 --2- 172.21.15.144:0/3366648094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bf015ca40 0x7f6bf01570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:11.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.969+0000 7f6bf6200640 1 --2- 172.21.15.144:0/3366648094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bf00d02a0 0x7f6bf014ca20 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:11.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.969+0000 7f6bf6200640 1 -- 172.21.15.144:0/3366648094 >> 172.21.15.144:0/3366648094 conn(0x7f6bf0062cc0 msgr2=0x7f6bf006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:11.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.969+0000 7f6bf6200640 1 -- 172.21.15.144:0/3366648094 shutdown_connections 2024-09-11T23:21:11.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:11.969+0000 7f6bf6200640 1 -- 172.21.15.144:0/3366648094 wait complete. 2024-09-11T23:21:11.986 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:21:11.986 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:21:11.986 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi165.front.sepia.ceph.com 2024-09-11T23:21:11.986 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T23:21:11.986 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:21:11.986 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:21:11.986 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:21:11.986 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:21:11.986 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:21:11.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:11.987 DEBUG:teuthology.orchestra.run.smithi165:> ip addr 2024-09-11T23:21:12.028 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:21:12.028 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:21:12.028 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:21:12.028 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:21:12.028 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-11T23:21:12.028 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:21:12.028 INFO:teuthology.orchestra.run.smithi165.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:21:12.028 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:94 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:21:12.028 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f0 2024-09-11T23:21:12.029 INFO:teuthology.orchestra.run.smithi165.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:21:12.029 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:95 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:21:12.029 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f1 2024-09-11T23:21:12.029 INFO:teuthology.orchestra.run.smithi165.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:21:12.029 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:21:12.029 INFO:teuthology.orchestra.run.smithi165.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:21:12.029 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:21:12.029 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.21.15.165/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:21:12.029 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft 42494sec preferred_lft 42494sec 2024-09-11T23:21:12.029 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::ec4:7aff:fe88:7f63/64 scope link noprefixroute 2024-09-11T23:21:12.029 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:21:12.029 INFO:teuthology.orchestra.run.smithi165.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:21:12.029 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:21:12.030 INFO:teuthology.orchestra.run.smithi165.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:21:12.030 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:21:12.030 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::c063:d7ff:fec8:c56c/64 scope link 2024-09-11T23:21:12.030 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:21:12.030 INFO:teuthology.orchestra.run.smithi165.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:21:12.030 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:21:12.030 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::5478:e4ff:fecd:76c/64 scope link 2024-09-11T23:21:12.030 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:21:12.030 INFO:teuthology.orchestra.run.smithi165.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:21:12.030 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether ba:fa:43:78:5f:29 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:21:12.030 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::b8fa:43ff:fe78:5f29/64 scope link 2024-09-11T23:21:12.030 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:21:12.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:12.031 DEBUG:teuthology.orchestra.run.smithi165:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:21:12.141 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-11T23:21:12.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:12.145 DEBUG:teuthology.orchestra.run.smithi165:> route 2024-09-11T23:21:12.182 INFO:teuthology.orchestra.run.smithi165.stdout:Kernel IP routing table 2024-09-11T23:21:12.183 INFO:teuthology.orchestra.run.smithi165.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:21:12.183 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:21:12.183 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:21:12.183 INFO:teuthology.orchestra.run.smithi165.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:21:12.183 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:21:12.183 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-11T23:21:12.183 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:21:12.184 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:21:12.184 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:21:12.184 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-11T23:21:12.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:21:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:21:12.373 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:21:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:21:12.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:12.381 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-11T23:21:12.418 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-11T23:21:12.419 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-11T23:21:12.419 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:21:12.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:12.419 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set brx.0 up 2024-09-11T23:21:12.515 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:21:12.516 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T23:21:12.552 INFO:teuthology.orchestra.run.smithi165.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:21:12.553 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:21:12.553 DEBUG:teuthology.orchestra.run.smithi165:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:21:12.627 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-11T23:21:12.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:12.627 DEBUG:teuthology.orchestra.run.smithi165:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:21:12.756 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:21:12.756 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:21:12.784 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:21:12.784 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:21:12.784 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:21:12.784 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: trying mount with new device syntax: 1@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:21:12.784 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:21:12.785 INFO:teuthology.orchestra.run.smithi165.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-11T23:21:12.785 INFO:teuthology.orchestra.run.smithi165.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:21:12.785 INFO:teuthology.orchestra.run.smithi165.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:21:12.786 INFO:teuthology.orchestra.run.smithi165.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:21:12.786 INFO:teuthology.orchestra.run.smithi165.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:21:12.788 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:21:12.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:12.789 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:21:12.844 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:21:12.923 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:21:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:21:12.926 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:21:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:21:12.934 INFO:teuthology.orchestra.run.smithi165.stdout:client5267 2024-09-11T23:21:12.934 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:21:12.934 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:21:12.970 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-11T23:21:13.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.132+0000 7fe33ac00640 1 Processor -- start 2024-09-11T23:21:13.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.133+0000 7fe33ac00640 1 -- start start 2024-09-11T23:21:13.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.134+0000 7fe33ac00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe33415b370 0x7fe334072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:13.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.134+0000 7fe33ac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe33406f130 0x7fe3340ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:13.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.134+0000 7fe33ac00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe33415c970 con 0x7fe33415f9f0 2024-09-11T23:21:13.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.134+0000 7fe33ac00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe33415fef0 con 0x7fe33415b370 2024-09-11T23:21:13.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.134+0000 7fe33ac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe33415bbb0 con 0x7fe33406f130 2024-09-11T23:21:13.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.134+0000 7fe333400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe33415f9f0 0x7fe33406ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43526/0 (socket says 172.21.15.144:43526) 2024-09-11T23:21:13.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.134+0000 7fe333400640 1 -- 172.21.15.144:0/676758293 learned_addr learned my addr 172.21.15.144:0/676758293 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:13.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.134+0000 7fe333e00640 1 --2- 172.21.15.144:0/676758293 >> v2:172.21.15.165:3300/0 conn(0x7fe33415b370 0x7fe334072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:13.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.134+0000 7fe338c00640 1 --2- 172.21.15.144:0/676758293 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe33406f130 0x7fe3340ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:13.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.134+0000 7fe332a00640 1 -- 172.21.15.144:0/676758293 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1053736023 0 0) 0x7fe33415c970 con 0x7fe33415f9f0 2024-09-11T23:21:13.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.135+0000 7fe332a00640 1 -- 172.21.15.144:0/676758293 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe318003520 con 0x7fe33415f9f0 2024-09-11T23:21:13.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.135+0000 7fe333e00640 1 -- 172.21.15.144:0/676758293 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe33406f130 msgr2=0x7fe3340ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:13.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.135+0000 7fe333e00640 1 --2- 172.21.15.144:0/676758293 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe33406f130 0x7fe3340ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:13.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.135+0000 7fe333e00640 1 -- 172.21.15.144:0/676758293 >> v1:172.21.15.144:6789/0 conn(0x7fe33415f9f0 legacy=0x7fe33406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:13.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.135+0000 7fe333e00640 1 -- 172.21.15.144:0/676758293 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33415be90 con 0x7fe33415b370 2024-09-11T23:21:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.136+0000 7fe333e00640 1 --2- 172.21.15.144:0/676758293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe33415b370 0x7fe334072560 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe334160070 tx=0x7fe32402a5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d100568796658c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.136+0000 7fe332a00640 1 -- 172.21.15.144:0/676758293 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324007740 con 0x7fe33415b370 2024-09-11T23:21:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.136+0000 7fe332a00640 1 -- 172.21.15.144:0/676758293 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3240078e0 con 0x7fe33415b370 2024-09-11T23:21:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.136+0000 7fe332a00640 1 -- 172.21.15.144:0/676758293 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324007c90 con 0x7fe33415b370 2024-09-11T23:21:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.137+0000 7fe33ac00640 1 -- 172.21.15.144:0/676758293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe33415b370 msgr2=0x7fe334072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.137+0000 7fe33ac00640 1 --2- 172.21.15.144:0/676758293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe33415b370 0x7fe334072560 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe334160070 tx=0x7fe32402a5b0 comp rx=0 tx=0).stop 2024-09-11T23:21:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.137+0000 7fe33ac00640 1 -- 172.21.15.144:0/676758293 shutdown_connections 2024-09-11T23:21:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.137+0000 7fe33ac00640 1 --2- 172.21.15.144:0/676758293 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe33406f130 0x7fe3340ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.137+0000 7fe33ac00640 1 --2- 172.21.15.144:0/676758293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe33415b370 0x7fe334072560 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:13.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.137+0000 7fe33ac00640 1 -- 172.21.15.144:0/676758293 >> 172.21.15.144:0/676758293 conn(0x7fe33406bba0 msgr2=0x7fe33406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:13.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.137+0000 7fe33ac00640 1 -- 172.21.15.144:0/676758293 shutdown_connections 2024-09-11T23:21:13.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.137+0000 7fe33ac00640 1 -- 172.21.15.144:0/676758293 wait complete. 2024-09-11T23:21:13.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.139+0000 7fe33ac00640 1 Processor -- start 2024-09-11T23:21:13.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.139+0000 7fe33ac00640 1 -- start start 2024-09-11T23:21:13.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.140+0000 7fe33ac00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe33406f130 0x7fe33415a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:13.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.140+0000 7fe33ac00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe33415b370 0x7fe334147e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:13.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.140+0000 7fe33ac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe33415f9f0 0x7fe3340ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:13.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.140+0000 7fe33ac00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe3340731b0 con 0x7fe33406f130 2024-09-11T23:21:13.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.140+0000 7fe33ac00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe33415c450 con 0x7fe33415b370 2024-09-11T23:21:13.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.140+0000 7fe33ac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe33415b750 con 0x7fe33415f9f0 2024-09-11T23:21:13.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.140+0000 7fe333e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe33406f130 0x7fe33415a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:13.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.140+0000 7fe333e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe33406f130 0x7fe33415a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38524/0 (socket says 172.21.15.144:38524) 2024-09-11T23:21:13.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.140+0000 7fe333e00640 1 -- 172.21.15.144:0/493873568 learned_addr learned my addr 172.21.15.144:0/493873568 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:13.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.140+0000 7fe338c00640 1 --2- 172.21.15.144:0/493873568 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe33415f9f0 0x7fe3340ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:13.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.140+0000 7fe333400640 1 --2- 172.21.15.144:0/493873568 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe33415b370 0x7fe334147e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:13.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.140+0000 7fe333e00640 1 -- 172.21.15.144:0/493873568 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe33415f9f0 msgr2=0x7fe3340ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:13.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.140+0000 7fe333e00640 1 --2- 172.21.15.144:0/493873568 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe33415f9f0 0x7fe3340ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:13.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.140+0000 7fe333e00640 1 -- 172.21.15.144:0/493873568 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe33415b370 msgr2=0x7fe334147e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:13.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.140+0000 7fe333e00640 1 --2- 172.21.15.144:0/493873568 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe33415b370 0x7fe334147e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:13.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.140+0000 7fe333e00640 1 -- 172.21.15.144:0/493873568 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3340aed80 con 0x7fe33406f130 2024-09-11T23:21:13.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.140+0000 7fe333400640 1 --2- 172.21.15.144:0/493873568 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe33415b370 0x7fe334147e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:13.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.141+0000 7fe333e00640 1 --2- 172.21.15.144:0/493873568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe33406f130 0x7fe33415a850 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe32402a5f0 tx=0x7fe324004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:13.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.141+0000 7fe32be00640 1 -- 172.21.15.144:0/493873568 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324009450 con 0x7fe33406f130 2024-09-11T23:21:13.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.141+0000 7fe32be00640 1 -- 172.21.15.144:0/493873568 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe324004240 con 0x7fe33406f130 2024-09-11T23:21:13.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.141+0000 7fe33ac00640 1 -- 172.21.15.144:0/493873568 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3340af060 con 0x7fe33406f130 2024-09-11T23:21:13.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.141+0000 7fe32be00640 1 -- 172.21.15.144:0/493873568 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324004610 con 0x7fe33406f130 2024-09-11T23:21:13.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.141+0000 7fe33ac00640 1 -- 172.21.15.144:0/493873568 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3340af620 con 0x7fe33406f130 2024-09-11T23:21:13.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.142+0000 7fe33ac00640 1 -- 172.21.15.144:0/493873568 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe334072560 con 0x7fe33406f130 2024-09-11T23:21:13.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.143+0000 7fe32be00640 1 -- 172.21.15.144:0/493873568 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7fe324039040 con 0x7fe33406f130 2024-09-11T23:21:13.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.144+0000 7fe32be00640 1 --2- 172.21.15.144:0/493873568 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe31406bfe0 0x7fe31406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:13.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.144+0000 7fe32be00640 1 -- 172.21.15.144:0/493873568 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fe3240ac8b0 con 0x7fe33406f130 2024-09-11T23:21:13.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.144+0000 7fe333400640 1 --2- 172.21.15.144:0/493873568 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe31406bfe0 0x7fe31406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:13.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.145+0000 7fe333400640 1 --2- 172.21.15.144:0/493873568 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe31406bfe0 0x7fe31406e4a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe3340b2ea0 tx=0x7fe320009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:13.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.149+0000 7fe32be00640 1 -- 172.21.15.144:0/493873568 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe324040030 con 0x7fe33406f130 2024-09-11T23:21:13.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:13.360+0000 7fe33ac00640 1 -- 172.21.15.144:0/493873568 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fe334156c80 con 0x7fe33406f130 2024-09-11T23:21:13.650 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:21:13.654 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:21:14.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.279+0000 7fe32be00640 1 -- 172.21.15.144:0/493873568 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v36) ==== 136+0+0 (secure 0 0 0) 0x7fe32407aec0 con 0x7fe33406f130 2024-09-11T23:21:14.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.282+0000 7fe33ac00640 1 -- 172.21.15.144:0/493873568 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe31406bfe0 msgr2=0x7fe31406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:14.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.282+0000 7fe33ac00640 1 --2- 172.21.15.144:0/493873568 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe31406bfe0 0x7fe31406e4a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe3340b2ea0 tx=0x7fe320009040 comp rx=0 tx=0).stop 2024-09-11T23:21:14.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.282+0000 7fe33ac00640 1 -- 172.21.15.144:0/493873568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe33406f130 msgr2=0x7fe33415a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:14.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.282+0000 7fe33ac00640 1 --2- 172.21.15.144:0/493873568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe33406f130 0x7fe33415a850 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe32402a5f0 tx=0x7fe324004a40 comp rx=0 tx=0).stop 2024-09-11T23:21:14.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.282+0000 7fe33ac00640 1 -- 172.21.15.144:0/493873568 shutdown_connections 2024-09-11T23:21:14.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.282+0000 7fe33ac00640 1 --2- 172.21.15.144:0/493873568 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe31406bfe0 0x7fe31406e4a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.282+0000 7fe33ac00640 1 --2- 172.21.15.144:0/493873568 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe33415f9f0 0x7fe3340ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.282+0000 7fe33ac00640 1 --2- 172.21.15.144:0/493873568 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe33415b370 0x7fe334147e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.282+0000 7fe33ac00640 1 --2- 172.21.15.144:0/493873568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe33406f130 0x7fe33415a850 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.282+0000 7fe33ac00640 1 -- 172.21.15.144:0/493873568 >> 172.21.15.144:0/493873568 conn(0x7fe33406bba0 msgr2=0x7fe3340b02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:14.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.282+0000 7fe33ac00640 1 -- 172.21.15.144:0/493873568 shutdown_connections 2024-09-11T23:21:14.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.282+0000 7fe33ac00640 1 -- 172.21.15.144:0/493873568 wait complete. 2024-09-11T23:21:14.299 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-11T23:21:14.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.452+0000 7f250cc00640 1 Processor -- start 2024-09-11T23:21:14.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.453+0000 7f250cc00640 1 -- start start 2024-09-11T23:21:14.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.454+0000 7f250cc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f25080cf070 0x7f25080cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:14.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.454+0000 7f250cc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2508073120 0x7f2508073560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:14.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.454+0000 7f250cc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25080ce740 con 0x7f250815c180 2024-09-11T23:21:14.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.454+0000 7f250cc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2508072640 con 0x7f2508073120 2024-09-11T23:21:14.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.454+0000 7f250cc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2508072920 con 0x7f25080cf070 2024-09-11T23:21:14.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.454+0000 7f2505e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f250815c180 0x7f25080cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53406/0 (socket says 172.21.15.144:53406) 2024-09-11T23:21:14.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.454+0000 7f2506800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2508073120 0x7f2508073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:14.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.454+0000 7f2505e00640 1 -- 172.21.15.144:0/3991389252 learned_addr learned my addr 172.21.15.144:0/3991389252 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:14.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.454+0000 7f2505400640 1 --2- 172.21.15.144:0/3991389252 >> v2:172.21.15.165:3300/0 conn(0x7f25080cf070 0x7f25080cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:14.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.455+0000 7f2506800640 1 -- 172.21.15.144:0/3991389252 >> v2:172.21.15.165:3300/0 conn(0x7f25080cf070 msgr2=0x7f25080cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:14.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.455+0000 7f2506800640 1 --2- 172.21.15.144:0/3991389252 >> v2:172.21.15.165:3300/0 conn(0x7f25080cf070 0x7f25080cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.455+0000 7f2506800640 1 -- 172.21.15.144:0/3991389252 >> v1:172.21.15.144:6789/0 conn(0x7f250815c180 legacy=0x7f25080cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:14.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.455+0000 7f2506800640 1 -- 172.21.15.144:0/3991389252 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2508072c00 con 0x7f2508073120 2024-09-11T23:21:14.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.455+0000 7f2505400640 1 --2- 172.21.15.144:0/3991389252 >> v2:172.21.15.165:3300/0 conn(0x7f25080cf070 0x7f25080cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:14.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.455+0000 7f2504a00640 1 -- 172.21.15.144:0/3991389252 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 551389217 0 0) 0x7f25080ce740 con 0x7f250815c180 2024-09-11T23:21:14.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.456+0000 7f2506800640 1 --2- 172.21.15.144:0/3991389252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2508073120 0x7f2508073560 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f250806f430 tx=0x7f250002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8bf5c033395bca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:14.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.456+0000 7f2504a00640 1 -- 172.21.15.144:0/3991389252 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2500007740 con 0x7f2508073120 2024-09-11T23:21:14.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.456+0000 7f2504a00640 1 -- 172.21.15.144:0/3991389252 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25000078e0 con 0x7f2508073120 2024-09-11T23:21:14.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.456+0000 7f2504a00640 1 -- 172.21.15.144:0/3991389252 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2500007cb0 con 0x7f2508073120 2024-09-11T23:21:14.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.456+0000 7f250cc00640 1 -- 172.21.15.144:0/3991389252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2508073120 msgr2=0x7f2508073560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:14.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.456+0000 7f250cc00640 1 --2- 172.21.15.144:0/3991389252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2508073120 0x7f2508073560 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f250806f430 tx=0x7f250002a5f0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.456+0000 7f250cc00640 1 -- 172.21.15.144:0/3991389252 shutdown_connections 2024-09-11T23:21:14.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.456+0000 7f250cc00640 1 --2- 172.21.15.144:0/3991389252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2508073120 0x7f2508073560 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.456+0000 7f250cc00640 1 --2- 172.21.15.144:0/3991389252 >> v2:172.21.15.165:3300/0 conn(0x7f25080cf070 0x7f25080cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.456+0000 7f250cc00640 1 -- 172.21.15.144:0/3991389252 >> 172.21.15.144:0/3991389252 conn(0x7f2508062cc0 msgr2=0x7f250806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:14.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.457+0000 7f250cc00640 1 -- 172.21.15.144:0/3991389252 shutdown_connections 2024-09-11T23:21:14.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.457+0000 7f250cc00640 1 -- 172.21.15.144:0/3991389252 wait complete. 2024-09-11T23:21:14.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.458+0000 7f250cc00640 1 Processor -- start 2024-09-11T23:21:14.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.458+0000 7f250cc00640 1 -- start start 2024-09-11T23:21:14.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.459+0000 7f250cc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2508073120 0x7f2508144b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:14.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.459+0000 7f250cc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f25080cf070 0x7f25080b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:14.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.459+0000 7f250cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f250815c180 0x7f250815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:14.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.459+0000 7f250cc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f25080722f0 con 0x7f250815c180 2024-09-11T23:21:14.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.459+0000 7f250cc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f25080ced00 con 0x7f2508073120 2024-09-11T23:21:14.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.459+0000 7f250cc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f250815c560 con 0x7f25080cf070 2024-09-11T23:21:14.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.460+0000 7f2506800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f250815c180 0x7f250815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:14.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.460+0000 7f2506800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f250815c180 0x7f250815c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41538/0 (socket says 172.21.15.144:41538) 2024-09-11T23:21:14.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.460+0000 7f2506800640 1 -- 172.21.15.144:0/3642108231 learned_addr learned my addr 172.21.15.144:0/3642108231 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:14.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.460+0000 7f2505e00640 1 --2- 172.21.15.144:0/3642108231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2508073120 0x7f2508144b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:14.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.460+0000 7f2505400640 1 --2- 172.21.15.144:0/3642108231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f25080cf070 0x7f25080b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:14.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.460+0000 7f2506800640 1 -- 172.21.15.144:0/3642108231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f25080cf070 msgr2=0x7f25080b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:14.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.460+0000 7f2506800640 1 --2- 172.21.15.144:0/3642108231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f25080cf070 0x7f25080b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.460+0000 7f2506800640 1 -- 172.21.15.144:0/3642108231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2508073120 msgr2=0x7f2508144b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:14.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.460+0000 7f2506800640 1 --2- 172.21.15.144:0/3642108231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2508073120 0x7f2508144b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.460+0000 7f2506800640 1 -- 172.21.15.144:0/3642108231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250814d480 con 0x7f250815c180 2024-09-11T23:21:14.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.461+0000 7f2506800640 1 --2- 172.21.15.144:0/3642108231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f250815c180 0x7f250815c8c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2500009e80 tx=0x7f2500004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:14.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.461+0000 7f24fe000640 1 -- 172.21.15.144:0/3642108231 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2500040070 con 0x7f250815c180 2024-09-11T23:21:14.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.461+0000 7f24fe000640 1 -- 172.21.15.144:0/3642108231 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2500031c40 con 0x7f250815c180 2024-09-11T23:21:14.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.461+0000 7f24fe000640 1 -- 172.21.15.144:0/3642108231 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2500009450 con 0x7f250815c180 2024-09-11T23:21:14.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.461+0000 7f250cc00640 1 -- 172.21.15.144:0/3642108231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25080b4550 con 0x7f250815c180 2024-09-11T23:21:14.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.461+0000 7f250cc00640 1 -- 172.21.15.144:0/3642108231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25080b4b10 con 0x7f250815c180 2024-09-11T23:21:14.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.462+0000 7f250cc00640 1 -- 172.21.15.144:0/3642108231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25080cf4e0 con 0x7f250815c180 2024-09-11T23:21:14.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.463+0000 7f24fe000640 1 -- 172.21.15.144:0/3642108231 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7f2500039040 con 0x7f250815c180 2024-09-11T23:21:14.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.464+0000 7f24fe000640 1 --2- 172.21.15.144:0/3642108231 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f24e806bfe0 0x7f24e806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:14.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.464+0000 7f24fe000640 1 -- 172.21.15.144:0/3642108231 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f25000ac3d0 con 0x7f250815c180 2024-09-11T23:21:14.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.465+0000 7f2505e00640 1 --2- 172.21.15.144:0/3642108231 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f24e806bfe0 0x7f24e806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:14.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.465+0000 7f2505e00640 1 --2- 172.21.15.144:0/3642108231 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f24e806bfe0 0x7f24e806e4a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f24f8007fd0 tx=0x7f24f8007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:14.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.469+0000 7f24fe000640 1 -- 172.21.15.144:0/3642108231 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f250007a3b0 con 0x7f250815c180 2024-09-11T23:21:14.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.667+0000 7f250cc00640 1 -- 172.21.15.144:0/3642108231 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f25080b4d10 con 0x7f24e806bfe0 2024-09-11T23:21:14.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.668+0000 7f24fe000640 1 -- 172.21.15.144:0/3642108231 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f25080b4d10 con 0x7f24e806bfe0 2024-09-11T23:21:14.668 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:21:14.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:14.668 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephfs" 2024-09-11T23:21:14.668 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:14.668 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:21:14.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.670+0000 7f250cc00640 1 -- 172.21.15.144:0/3642108231 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f24e806bfe0 msgr2=0x7f24e806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:14.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.670+0000 7f250cc00640 1 --2- 172.21.15.144:0/3642108231 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f24e806bfe0 0x7f24e806e4a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f24f8007fd0 tx=0x7f24f8007de0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.670+0000 7f250cc00640 1 -- 172.21.15.144:0/3642108231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f250815c180 msgr2=0x7f250815c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:14.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.670+0000 7f250cc00640 1 --2- 172.21.15.144:0/3642108231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f250815c180 0x7f250815c8c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2500009e80 tx=0x7f2500004a40 comp rx=0 tx=0).stop 2024-09-11T23:21:14.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.670+0000 7f250cc00640 1 -- 172.21.15.144:0/3642108231 shutdown_connections 2024-09-11T23:21:14.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.670+0000 7f250cc00640 1 --2- 172.21.15.144:0/3642108231 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f24e806bfe0 0x7f24e806e4a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.670+0000 7f250cc00640 1 --2- 172.21.15.144:0/3642108231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f250815c180 0x7f250815c8c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.670+0000 7f250cc00640 1 --2- 172.21.15.144:0/3642108231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f25080cf070 0x7f25080b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.670+0000 7f250cc00640 1 --2- 172.21.15.144:0/3642108231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2508073120 0x7f2508144b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.670+0000 7f250cc00640 1 -- 172.21.15.144:0/3642108231 >> 172.21.15.144:0/3642108231 conn(0x7f2508062cc0 msgr2=0x7f25080cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:14.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.670+0000 7f250cc00640 1 -- 172.21.15.144:0/3642108231 shutdown_connections 2024-09-11T23:21:14.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.671+0000 7f250cc00640 1 -- 172.21.15.144:0/3642108231 wait complete. 2024-09-11T23:21:14.687 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:21:14.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.845+0000 7fb453e00640 1 Processor -- start 2024-09-11T23:21:14.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.845+0000 7fb453e00640 1 -- start start 2024-09-11T23:21:14.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.847+0000 7fb453e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb45415e6c0 0x7fb45406c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:14.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.847+0000 7fb453e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb45415eaa0 con 0x7fb4540cf510 2024-09-11T23:21:14.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.847+0000 7fb453e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb45406cdf0 con 0x7fb45406d610 2024-09-11T23:21:14.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.847+0000 7fb453e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb4540d34d0 con 0x7fb45415e6c0 2024-09-11T23:21:14.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.847+0000 7fb452000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb4540cf510 0x7fb4540b7670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53422/0 (socket says 172.21.15.144:53422) 2024-09-11T23:21:14.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.847+0000 7fb452000640 1 -- 172.21.15.144:0/3948245557 learned_addr learned my addr 172.21.15.144:0/3948245557 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:14.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.847+0000 7fb452a00640 1 --2- 172.21.15.144:0/3948245557 >> v2:172.21.15.165:3300/0 conn(0x7fb45415e6c0 0x7fb45406c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:14.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.847+0000 7fb451600640 1 -- 172.21.15.144:0/3948245557 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3439627177 0 0) 0x7fb45415eaa0 con 0x7fb4540cf510 2024-09-11T23:21:14.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.847+0000 7fb451600640 1 -- 172.21.15.144:0/3948245557 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb438003520 con 0x7fb4540cf510 2024-09-11T23:21:14.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb451600640 1 -- 172.21.15.144:0/3948245557 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2177798777 0 0) 0x7fb438003520 con 0x7fb4540cf510 2024-09-11T23:21:14.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb451600640 1 -- 172.21.15.144:0/3948245557 >> v2:172.21.15.165:3300/0 conn(0x7fb45415e6c0 msgr2=0x7fb45406c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:14.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb451600640 1 --2- 172.21.15.144:0/3948245557 >> v2:172.21.15.165:3300/0 conn(0x7fb45415e6c0 0x7fb45406c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb451600640 1 -- 172.21.15.144:0/3948245557 >> v1:172.21.15.165:6789/0 conn(0x7fb45406d610 legacy=0x7fb45406d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:14.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb451600640 1 -- 172.21.15.144:0/3948245557 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4540d28c0 con 0x7fb4540cf510 2024-09-11T23:21:14.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb451600640 1 -- 172.21.15.144:0/3948245557 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fb440001690 con 0x7fb4540cf510 2024-09-11T23:21:14.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb451600640 1 -- 172.21.15.144:0/3948245557 >> v1:172.21.15.144:6789/0 conn(0x7fb4540cf510 legacy=0x7fb4540b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:14.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb451600640 1 --2- 172.21.15.144:0/3948245557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438003a00 0x7fb438003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:14.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb451600640 1 --2- 172.21.15.144:0/3948245557 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb438004800 0x7fb438004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:14.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb451600640 1 --2- 172.21.15.144:0/3948245557 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4380051c0 0x7fb43800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:14.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb451600640 1 -- 172.21.15.144:0/3948245557 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb4540d34d0 con 0x7fb438003a00 2024-09-11T23:21:14.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb451600640 1 -- 172.21.15.144:0/3948245557 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb43800c0c0 con 0x7fb438004800 2024-09-11T23:21:14.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb451600640 1 -- 172.21.15.144:0/3948245557 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb43800c2c0 con 0x7fb4380051c0 2024-09-11T23:21:14.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb452a00640 1 --2- 172.21.15.144:0/3948245557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438003a00 0x7fb438003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:14.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb452000640 1 --2- 172.21.15.144:0/3948245557 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb438004800 0x7fb438004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:14.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb453400640 1 --2- 172.21.15.144:0/3948245557 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4380051c0 0x7fb43800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:14.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb452a00640 1 -- 172.21.15.144:0/3948245557 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4380051c0 msgr2=0x7fb43800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:14.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb452a00640 1 --2- 172.21.15.144:0/3948245557 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4380051c0 0x7fb43800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb452a00640 1 -- 172.21.15.144:0/3948245557 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb438004800 msgr2=0x7fb438004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:14.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb452a00640 1 --2- 172.21.15.144:0/3948245557 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb438004800 0x7fb438004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb452a00640 1 -- 172.21.15.144:0/3948245557 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb438003520 con 0x7fb438003a00 2024-09-11T23:21:14.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.848+0000 7fb453400640 1 -- 172.21.15.144:0/3948245557 reap_dead start 2024-09-11T23:21:14.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.849+0000 7fb452a00640 1 --2- 172.21.15.144:0/3948245557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438003a00 0x7fb438003e20 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb444009ac0 tx=0x7fb438005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4f2c47d28f6958 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:14.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.850+0000 7fb451600640 1 -- 172.21.15.144:0/3948245557 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444036070 con 0x7fb438003a00 2024-09-11T23:21:14.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.850+0000 7fb451600640 1 -- 172.21.15.144:0/3948245557 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb444031400 con 0x7fb438003a00 2024-09-11T23:21:14.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.850+0000 7fb451600640 1 -- 172.21.15.144:0/3948245557 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444009690 con 0x7fb438003a00 2024-09-11T23:21:14.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.850+0000 7fb453e00640 1 -- 172.21.15.144:0/3948245557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438003a00 msgr2=0x7fb438003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:14.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.850+0000 7fb453e00640 1 --2- 172.21.15.144:0/3948245557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438003a00 0x7fb438003e20 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb444009ac0 tx=0x7fb438005830 comp rx=0 tx=0).stop 2024-09-11T23:21:14.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.850+0000 7fb453e00640 1 -- 172.21.15.144:0/3948245557 shutdown_connections 2024-09-11T23:21:14.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.850+0000 7fb453e00640 1 --2- 172.21.15.144:0/3948245557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438003a00 0x7fb438003e20 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.850+0000 7fb453e00640 1 -- 172.21.15.144:0/3948245557 >> 172.21.15.144:0/3948245557 conn(0x7fb4540d4720 msgr2=0x7fb4540d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:14.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.850+0000 7fb453e00640 1 -- 172.21.15.144:0/3948245557 shutdown_connections 2024-09-11T23:21:14.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.850+0000 7fb453e00640 1 -- 172.21.15.144:0/3948245557 wait complete. 2024-09-11T23:21:14.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.852+0000 7fb453e00640 1 Processor -- start 2024-09-11T23:21:14.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.852+0000 7fb453e00640 1 -- start start 2024-09-11T23:21:14.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.853+0000 7fb453e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438003a00 0x7fb4540ab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:14.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.853+0000 7fb453e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4540cccf0 0x7fb45415b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:14.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.853+0000 7fb453e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4540b5410 0x7fb4540b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:14.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.853+0000 7fb453e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb4540d3160 con 0x7fb438003a00 2024-09-11T23:21:14.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.853+0000 7fb453e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb4540d2e80 con 0x7fb4540cccf0 2024-09-11T23:21:14.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.853+0000 7fb453e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb45406c8b0 con 0x7fb4540b5410 2024-09-11T23:21:14.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.853+0000 7fb452a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438003a00 0x7fb4540ab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:14.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.853+0000 7fb452a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438003a00 0x7fb4540ab9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41546/0 (socket says 172.21.15.144:41546) 2024-09-11T23:21:14.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.853+0000 7fb452a00640 1 -- 172.21.15.144:0/4011528647 learned_addr learned my addr 172.21.15.144:0/4011528647 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:14.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.853+0000 7fb453400640 1 --2- 172.21.15.144:0/4011528647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4540b5410 0x7fb4540b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:14.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.853+0000 7fb452000640 1 --2- 172.21.15.144:0/4011528647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4540cccf0 0x7fb45415b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:14.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.854+0000 7fb452a00640 1 -- 172.21.15.144:0/4011528647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4540b5410 msgr2=0x7fb4540b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:14.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.854+0000 7fb452a00640 1 --2- 172.21.15.144:0/4011528647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4540b5410 0x7fb4540b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.854+0000 7fb452a00640 1 -- 172.21.15.144:0/4011528647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4540cccf0 msgr2=0x7fb45415b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:14.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.854+0000 7fb452a00640 1 --2- 172.21.15.144:0/4011528647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4540cccf0 0x7fb45415b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:14.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.854+0000 7fb452a00640 1 -- 172.21.15.144:0/4011528647 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4540abfa0 con 0x7fb438003a00 2024-09-11T23:21:14.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.854+0000 7fb453400640 1 --2- 172.21.15.144:0/4011528647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4540b5410 0x7fb4540b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:14.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.854+0000 7fb452a00640 1 --2- 172.21.15.144:0/4011528647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438003a00 0x7fb4540ab9c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb444034040 tx=0x7fb444004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:14.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.854+0000 7fb44aa00640 1 -- 172.21.15.144:0/4011528647 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44403f020 con 0x7fb438003a00 2024-09-11T23:21:14.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.854+0000 7fb44aa00640 1 -- 172.21.15.144:0/4011528647 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb444037040 con 0x7fb438003a00 2024-09-11T23:21:14.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.854+0000 7fb44aa00640 1 -- 172.21.15.144:0/4011528647 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444036070 con 0x7fb438003a00 2024-09-11T23:21:14.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.854+0000 7fb453e00640 1 -- 172.21.15.144:0/4011528647 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4540ac280 con 0x7fb438003a00 2024-09-11T23:21:14.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.854+0000 7fb453e00640 1 -- 172.21.15.144:0/4011528647 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4540ac840 con 0x7fb438003a00 2024-09-11T23:21:14.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.855+0000 7fb453e00640 1 -- 172.21.15.144:0/4011528647 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb45406d9f0 con 0x7fb438003a00 2024-09-11T23:21:14.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.856+0000 7fb44aa00640 1 -- 172.21.15.144:0/4011528647 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7fb444042020 con 0x7fb438003a00 2024-09-11T23:21:14.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.857+0000 7fb44aa00640 1 --2- 172.21.15.144:0/4011528647 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb43406bfe0 0x7fb43406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:14.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.857+0000 7fb44aa00640 1 -- 172.21.15.144:0/4011528647 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fb4440ab1f0 con 0x7fb438003a00 2024-09-11T23:21:14.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.857+0000 7fb452000640 1 --2- 172.21.15.144:0/4011528647 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb43406bfe0 0x7fb43406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:14.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.858+0000 7fb452000640 1 --2- 172.21.15.144:0/4011528647 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb43406bfe0 0x7fb43406e4a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb440001050 tx=0x7fb440009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:14.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:14.861+0000 7fb44aa00640 1 -- 172.21.15.144:0/4011528647 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb444049030 con 0x7fb438003a00 2024-09-11T23:21:15.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.034+0000 7fb453e00640 1 -- 172.21.15.144:0/4011528647 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb4541f4660 con 0x7fb438003a00 2024-09-11T23:21:15.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.034+0000 7fb44aa00640 1 -- 172.21.15.144:0/4011528647 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fb444079880 con 0x7fb438003a00 2024-09-11T23:21:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.036+0000 7fb453e00640 1 -- 172.21.15.144:0/4011528647 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb43406bfe0 msgr2=0x7fb43406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.036+0000 7fb453e00640 1 --2- 172.21.15.144:0/4011528647 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb43406bfe0 0x7fb43406e4a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb440001050 tx=0x7fb440009040 comp rx=0 tx=0).stop 2024-09-11T23:21:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.036+0000 7fb453e00640 1 -- 172.21.15.144:0/4011528647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438003a00 msgr2=0x7fb4540ab9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.036+0000 7fb453e00640 1 --2- 172.21.15.144:0/4011528647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438003a00 0x7fb4540ab9c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb444034040 tx=0x7fb444004730 comp rx=0 tx=0).stop 2024-09-11T23:21:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.036+0000 7fb453e00640 1 -- 172.21.15.144:0/4011528647 shutdown_connections 2024-09-11T23:21:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.037+0000 7fb453e00640 1 --2- 172.21.15.144:0/4011528647 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb43406bfe0 0x7fb43406e4a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.037+0000 7fb453e00640 1 --2- 172.21.15.144:0/4011528647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4540b5410 0x7fb4540b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.037+0000 7fb453e00640 1 --2- 172.21.15.144:0/4011528647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4540cccf0 0x7fb45415b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.037+0000 7fb453e00640 1 --2- 172.21.15.144:0/4011528647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb438003a00 0x7fb4540ab9c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.037+0000 7fb453e00640 1 -- 172.21.15.144:0/4011528647 >> 172.21.15.144:0/4011528647 conn(0x7fb4540d4720 msgr2=0x7fb454161840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.037+0000 7fb453e00640 1 -- 172.21.15.144:0/4011528647 shutdown_connections 2024-09-11T23:21:15.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.037+0000 7fb453e00640 1 -- 172.21.15.144:0/4011528647 wait complete. 2024-09-11T23:21:15.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:15.053 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/_nogroup/subvol360) 2024-09-11T23:21:15.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:15.116 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-11T23:21:15.152 INFO:teuthology.orchestra.run.smithi144.stdout:cephfs_data 2024-09-11T23:21:15.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:15.152 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/_nogroup/subvol360) 2024-09-11T23:21:15.254 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol22361 2024-09-11T23:21:15.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.411+0000 7ffa90000640 1 Processor -- start 2024-09-11T23:21:15.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.412+0000 7ffa90000640 1 -- start start 2024-09-11T23:21:15.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.413+0000 7ffa90000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffa880b5050 0x7ffa8815c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:15.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.413+0000 7ffa90000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa880b5500 con 0x7ffa8806f130 2024-09-11T23:21:15.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.413+0000 7ffa90000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa880b43f0 con 0x7ffa88158e50 2024-09-11T23:21:15.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.413+0000 7ffa90000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ffa880b3630 con 0x7ffa880b5050 2024-09-11T23:21:15.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.413+0000 7ffa8e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffa880b5050 0x7ffa8815c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:15.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.413+0000 7ffa8cc00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ffa8806f130 0x7ffa880ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53434/0 (socket says 172.21.15.144:53434) 2024-09-11T23:21:15.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.413+0000 7ffa8cc00640 1 -- 172.21.15.144:0/3005012255 learned_addr learned my addr 172.21.15.144:0/3005012255 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:15.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.414+0000 7ffa87e00640 1 -- 172.21.15.144:0/3005012255 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1854772699 0 0) 0x7ffa74001290 con 0x7ffa8806f130 2024-09-11T23:21:15.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.414+0000 7ffa87e00640 1 -- 172.21.15.144:0/3005012255 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa70005730 con 0x7ffa8806f130 2024-09-11T23:21:15.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.414+0000 7ffa87e00640 1 -- 172.21.15.144:0/3005012255 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3729475853 0 0) 0x7ffa880b43f0 con 0x7ffa88158e50 2024-09-11T23:21:15.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.414+0000 7ffa8e000640 1 -- 172.21.15.144:0/3005012255 >> v1:172.21.15.165:6789/0 conn(0x7ffa88158e50 legacy=0x7ffa8806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:15.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.414+0000 7ffa8e000640 1 -- 172.21.15.144:0/3005012255 >> v1:172.21.15.144:6789/0 conn(0x7ffa8806f130 legacy=0x7ffa880ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:15.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.414+0000 7ffa8e000640 1 -- 172.21.15.144:0/3005012255 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa880b3910 con 0x7ffa880b5050 2024-09-11T23:21:15.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.415+0000 7ffa8e000640 1 --2- 172.21.15.144:0/3005012255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa880b5050 0x7ffa8815c370 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009d90 tx=0x7ffa8002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a644df4d4e2faaff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:15.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.415+0000 7ffa87e00640 1 -- 172.21.15.144:0/3005012255 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa80007740 con 0x7ffa880b5050 2024-09-11T23:21:15.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.415+0000 7ffa87e00640 1 -- 172.21.15.144:0/3005012255 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa800078e0 con 0x7ffa880b5050 2024-09-11T23:21:15.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.415+0000 7ffa87e00640 1 -- 172.21.15.144:0/3005012255 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa80007c90 con 0x7ffa880b5050 2024-09-11T23:21:15.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.415+0000 7ffa90000640 1 -- 172.21.15.144:0/3005012255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa880b5050 msgr2=0x7ffa8815c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:15.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.415+0000 7ffa90000640 1 --2- 172.21.15.144:0/3005012255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa880b5050 0x7ffa8815c370 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009d90 tx=0x7ffa8002a660 comp rx=0 tx=0).stop 2024-09-11T23:21:15.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.416+0000 7ffa90000640 1 -- 172.21.15.144:0/3005012255 shutdown_connections 2024-09-11T23:21:15.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.416+0000 7ffa90000640 1 --2- 172.21.15.144:0/3005012255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa880b5050 0x7ffa8815c370 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:15.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.416+0000 7ffa90000640 1 -- 172.21.15.144:0/3005012255 >> 172.21.15.144:0/3005012255 conn(0x7ffa8806bba0 msgr2=0x7ffa8806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:15.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.416+0000 7ffa90000640 1 -- 172.21.15.144:0/3005012255 shutdown_connections 2024-09-11T23:21:15.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.416+0000 7ffa90000640 1 -- 172.21.15.144:0/3005012255 wait complete. 2024-09-11T23:21:15.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.417+0000 7ffa90000640 1 Processor -- start 2024-09-11T23:21:15.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.417+0000 7ffa90000640 1 -- start start 2024-09-11T23:21:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.418+0000 7ffa90000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffa8806f130 0x7ffa881448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.418+0000 7ffa90000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa880b5050 0x7ffa88147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.418+0000 7ffa90000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffa88158e50 0x7ffa881477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.418+0000 7ffa90000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffa88159230 con 0x7ffa880b5050 2024-09-11T23:21:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.418+0000 7ffa90000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffa880b3ed0 con 0x7ffa8806f130 2024-09-11T23:21:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.418+0000 7ffa90000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffa880ce910 con 0x7ffa88158e50 2024-09-11T23:21:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.418+0000 7ffa8cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa880b5050 0x7ffa88147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.419+0000 7ffa8cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa880b5050 0x7ffa88147280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41550/0 (socket says 172.21.15.144:41550) 2024-09-11T23:21:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.419+0000 7ffa8d600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffa8806f130 0x7ffa881448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.419+0000 7ffa8cc00640 1 -- 172.21.15.144:0/1873641656 learned_addr learned my addr 172.21.15.144:0/1873641656 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.419+0000 7ffa8e000640 1 --2- 172.21.15.144:0/1873641656 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffa88158e50 0x7ffa881477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.419+0000 7ffa8cc00640 1 -- 172.21.15.144:0/1873641656 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffa88158e50 msgr2=0x7ffa881477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:15.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.419+0000 7ffa8cc00640 1 --2- 172.21.15.144:0/1873641656 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffa88158e50 0x7ffa881477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:15.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.419+0000 7ffa8cc00640 1 -- 172.21.15.144:0/1873641656 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffa8806f130 msgr2=0x7ffa881448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:15.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.419+0000 7ffa8cc00640 1 --2- 172.21.15.144:0/1873641656 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffa8806f130 0x7ffa881448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:15.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.419+0000 7ffa8cc00640 1 -- 172.21.15.144:0/1873641656 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa88145eb0 con 0x7ffa880b5050 2024-09-11T23:21:15.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.419+0000 7ffa8cc00640 1 --2- 172.21.15.144:0/1873641656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa880b5050 0x7ffa88147280 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400c500 tx=0x7ffa7400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:15.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.419+0000 7ffa85600640 1 -- 172.21.15.144:0/1873641656 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa74017070 con 0x7ffa880b5050 2024-09-11T23:21:15.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.419+0000 7ffa85600640 1 -- 172.21.15.144:0/1873641656 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa74007500 con 0x7ffa880b5050 2024-09-11T23:21:15.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.419+0000 7ffa90000640 1 -- 172.21.15.144:0/1873641656 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa88146190 con 0x7ffa880b5050 2024-09-11T23:21:15.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.419+0000 7ffa85600640 1 -- 172.21.15.144:0/1873641656 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa740059c0 con 0x7ffa880b5050 2024-09-11T23:21:15.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.420+0000 7ffa90000640 1 -- 172.21.15.144:0/1873641656 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa88146750 con 0x7ffa880b5050 2024-09-11T23:21:15.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.421+0000 7ffa90000640 1 -- 172.21.15.144:0/1873641656 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa8806ee00 con 0x7ffa880b5050 2024-09-11T23:21:15.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.421+0000 7ffa85600640 1 -- 172.21.15.144:0/1873641656 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 9) ==== 90651+0+0 (secure 0 0 0) 0x7ffa7401a070 con 0x7ffa880b5050 2024-09-11T23:21:15.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.422+0000 7ffa85600640 1 --2- 172.21.15.144:0/1873641656 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ffa6806bfe0 0x7ffa6806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:15.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.422+0000 7ffa85600640 1 -- 172.21.15.144:0/1873641656 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7ffa7408a540 con 0x7ffa880b5050 2024-09-11T23:21:15.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.423+0000 7ffa8d600640 1 --2- 172.21.15.144:0/1873641656 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ffa6806bfe0 0x7ffa6806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:15.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.423+0000 7ffa8d600640 1 --2- 172.21.15.144:0/1873641656 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ffa6806bfe0 0x7ffa6806e4a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c000f60 tx=0x7ffa7c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:15.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.426+0000 7ffa85600640 1 -- 172.21.15.144:0/1873641656 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa880b5500 con 0x7ffa880b5050 2024-09-11T23:21:15.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.628+0000 7ffa90000640 1 -- 172.21.15.144:0/1873641656 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol22361", "target": ["mon-mgr", ""]}) -- 0x7ffa8815f910 con 0x7ffa6806bfe0 2024-09-11T23:21:15.633 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:21:15.633+0000 7f9c68e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:21:15.633 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:21:15.633+0000 7f9c68e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:21:15.633 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:21:15.633+0000 7f9c68e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:21:15.633 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:21:15.633+0000 7f9c68e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:21:15.633 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:21:15.633+0000 7f9c68e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:21:15.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.667+0000 7ffa85600640 1 -- 172.21.15.144:0/1873641656 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ffa8815f910 con 0x7ffa6806bfe0 2024-09-11T23:21:15.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.669+0000 7ffa90000640 1 -- 172.21.15.144:0/1873641656 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ffa6806bfe0 msgr2=0x7ffa6806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:15.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.669+0000 7ffa90000640 1 --2- 172.21.15.144:0/1873641656 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ffa6806bfe0 0x7ffa6806e4a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c000f60 tx=0x7ffa7c009040 comp rx=0 tx=0).stop 2024-09-11T23:21:15.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.669+0000 7ffa90000640 1 -- 172.21.15.144:0/1873641656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa880b5050 msgr2=0x7ffa88147280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:15.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.669+0000 7ffa90000640 1 --2- 172.21.15.144:0/1873641656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa880b5050 0x7ffa88147280 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400c500 tx=0x7ffa7400c9c0 comp rx=0 tx=0).stop 2024-09-11T23:21:15.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.669+0000 7ffa90000640 1 -- 172.21.15.144:0/1873641656 shutdown_connections 2024-09-11T23:21:15.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.669+0000 7ffa90000640 1 --2- 172.21.15.144:0/1873641656 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ffa6806bfe0 0x7ffa6806e4a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:15.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.669+0000 7ffa90000640 1 --2- 172.21.15.144:0/1873641656 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffa88158e50 0x7ffa881477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:15.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.669+0000 7ffa90000640 1 --2- 172.21.15.144:0/1873641656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa880b5050 0x7ffa88147280 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:15.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.669+0000 7ffa90000640 1 --2- 172.21.15.144:0/1873641656 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffa8806f130 0x7ffa881448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:15.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.669+0000 7ffa90000640 1 -- 172.21.15.144:0/1873641656 >> 172.21.15.144:0/1873641656 conn(0x7ffa8806bba0 msgr2=0x7ffa88071320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:15.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.669+0000 7ffa90000640 1 -- 172.21.15.144:0/1873641656 shutdown_connections 2024-09-11T23:21:15.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:15.669+0000 7ffa90000640 1 -- 172.21.15.144:0/1873641656 wait complete. 2024-09-11T23:21:15.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:15.685 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp ./volumes/_nogroup/subvol22361/.meta ./volumes/_nogroup/subvol360) 2024-09-11T23:21:19.747 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol360 2024-09-11T23:21:19.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.909+0000 7f6fdbc00640 1 Processor -- start 2024-09-11T23:21:19.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.910+0000 7f6fdbc00640 1 -- start start 2024-09-11T23:21:19.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.911+0000 7f6fdbc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6fd415d3b0 0x7f6fd4071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:19.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.911+0000 7f6fdbc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6fd40cf320 0x7f6fd40cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:19.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.911+0000 7f6fdbc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fd40715c0 con 0x7f6fd415d790 2024-09-11T23:21:19.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.911+0000 7f6fdbc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6fd406da30 con 0x7f6fd40cf320 2024-09-11T23:21:19.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.911+0000 7f6fdbc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6fd406d700 con 0x7f6fd415d3b0 2024-09-11T23:21:19.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.911+0000 7f6fd9c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6fd40cf320 0x7f6fd40cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:19.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.911+0000 7f6fd9c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6fd40cf320 0x7f6fd40cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41586/0 (socket says 172.21.15.144:41586) 2024-09-11T23:21:19.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.911+0000 7f6fd9c00640 1 -- 172.21.15.144:0/2575669085 learned_addr learned my addr 172.21.15.144:0/2575669085 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:19.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.911+0000 7f6fd9200640 1 --2- 172.21.15.144:0/2575669085 >> v2:172.21.15.165:3300/0 conn(0x7f6fd415d3b0 0x7f6fd4071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:19.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.912+0000 7f6fd9c00640 1 -- 172.21.15.144:0/2575669085 >> v2:172.21.15.165:3300/0 conn(0x7f6fd415d3b0 msgr2=0x7f6fd4071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:19.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.912+0000 7f6fd9c00640 1 --2- 172.21.15.144:0/2575669085 >> v2:172.21.15.165:3300/0 conn(0x7f6fd415d3b0 0x7f6fd4071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:19.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.912+0000 7f6fd9c00640 1 -- 172.21.15.144:0/2575669085 >> v1:172.21.15.144:6789/0 conn(0x7f6fd415d790 legacy=0x7f6fd40cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:19.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.912+0000 7f6fd9c00640 1 -- 172.21.15.144:0/2575669085 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd40cde80 con 0x7f6fd40cf320 2024-09-11T23:21:19.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.912+0000 7f6fd9200640 1 --2- 172.21.15.144:0/2575669085 >> v2:172.21.15.165:3300/0 conn(0x7f6fd415d3b0 0x7f6fd4071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:19.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.913+0000 7f6fd9c00640 1 --2- 172.21.15.144:0/2575669085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fd40cf320 0x7f6fd40cf790 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40b5850 tx=0x7f6fcc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f49205b56b384e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:19.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.913+0000 7f6fd3400640 1 -- 172.21.15.144:0/2575669085 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc036070 con 0x7f6fd40cf320 2024-09-11T23:21:19.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.913+0000 7f6fd3400640 1 -- 172.21.15.144:0/2575669085 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fcc031600 con 0x7f6fd40cf320 2024-09-11T23:21:19.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.913+0000 7f6fd3400640 1 -- 172.21.15.144:0/2575669085 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc0319d0 con 0x7f6fd40cf320 2024-09-11T23:21:19.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.913+0000 7f6fdbc00640 1 -- 172.21.15.144:0/2575669085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fd40cf320 msgr2=0x7f6fd40cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:19.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.913+0000 7f6fdbc00640 1 --2- 172.21.15.144:0/2575669085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fd40cf320 0x7f6fd40cf790 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6fd40b5850 tx=0x7f6fcc02a730 comp rx=0 tx=0).stop 2024-09-11T23:21:19.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.914+0000 7f6fdbc00640 1 -- 172.21.15.144:0/2575669085 shutdown_connections 2024-09-11T23:21:19.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.914+0000 7f6fdbc00640 1 --2- 172.21.15.144:0/2575669085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fd40cf320 0x7f6fd40cf790 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:19.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.914+0000 7f6fdbc00640 1 --2- 172.21.15.144:0/2575669085 >> v2:172.21.15.165:3300/0 conn(0x7f6fd415d3b0 0x7f6fd4071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:19.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.914+0000 7f6fdbc00640 1 -- 172.21.15.144:0/2575669085 >> 172.21.15.144:0/2575669085 conn(0x7f6fd406bba0 msgr2=0x7f6fd406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:19.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.914+0000 7f6fdbc00640 1 -- 172.21.15.144:0/2575669085 shutdown_connections 2024-09-11T23:21:19.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.914+0000 7f6fdbc00640 1 -- 172.21.15.144:0/2575669085 wait complete. 2024-09-11T23:21:19.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.915+0000 7f6fdbc00640 1 Processor -- start 2024-09-11T23:21:19.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.915+0000 7f6fdbc00640 1 -- start start 2024-09-11T23:21:19.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.916+0000 7f6fdbc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6fd40cf320 0x7f6fd414c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:19.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.916+0000 7f6fdbc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6fd415d3b0 0x7f6fd4154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:19.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.916+0000 7f6fdbc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fd41f50c0 0x7f6fd4141b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:19.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.916+0000 7f6fdbc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd40cfcd0 con 0x7f6fd41f50c0 2024-09-11T23:21:19.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.916+0000 7f6fdbc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd40cdba0 con 0x7f6fd415d3b0 2024-09-11T23:21:19.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.916+0000 7f6fdbc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6fd40cd580 con 0x7f6fd40cf320 2024-09-11T23:21:19.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.917+0000 7f6fd9c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fd41f50c0 0x7f6fd4141b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:19.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.917+0000 7f6fd9c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fd41f50c0 0x7f6fd4141b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41588/0 (socket says 172.21.15.144:41588) 2024-09-11T23:21:19.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.917+0000 7f6fd9c00640 1 -- 172.21.15.144:0/656226964 learned_addr learned my addr 172.21.15.144:0/656226964 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:19.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.917+0000 7f6fd9200640 1 --2- 172.21.15.144:0/656226964 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6fd40cf320 0x7f6fd414c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:19.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.917+0000 7f6fd3e00640 1 --2- 172.21.15.144:0/656226964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6fd415d3b0 0x7f6fd4154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:19.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.917+0000 7f6fd9c00640 1 -- 172.21.15.144:0/656226964 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6fd40cf320 msgr2=0x7f6fd414c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:19.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.917+0000 7f6fd9c00640 1 --2- 172.21.15.144:0/656226964 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6fd40cf320 0x7f6fd414c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:19.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.917+0000 7f6fd9c00640 1 -- 172.21.15.144:0/656226964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6fd415d3b0 msgr2=0x7f6fd4154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:19.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.917+0000 7f6fd9c00640 1 --2- 172.21.15.144:0/656226964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6fd415d3b0 0x7f6fd4154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:19.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.917+0000 7f6fd9c00640 1 -- 172.21.15.144:0/656226964 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd41f5570 con 0x7f6fd41f50c0 2024-09-11T23:21:19.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.917+0000 7f6fd9200640 1 --2- 172.21.15.144:0/656226964 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6fd40cf320 0x7f6fd414c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:19.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.917+0000 7f6fd3e00640 1 --2- 172.21.15.144:0/656226964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6fd415d3b0 0x7f6fd4154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:19.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.917+0000 7f6fd9c00640 1 --2- 172.21.15.144:0/656226964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fd41f50c0 0x7f6fd4141b20 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc009f40 tx=0x7f6fcc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:19.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.917+0000 7f6fd0c00640 1 -- 172.21.15.144:0/656226964 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc03f020 con 0x7f6fd41f50c0 2024-09-11T23:21:19.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.918+0000 7f6fd0c00640 1 -- 172.21.15.144:0/656226964 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fcc037040 con 0x7f6fd41f50c0 2024-09-11T23:21:19.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.918+0000 7f6fdbc00640 1 -- 172.21.15.144:0/656226964 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd4142060 con 0x7f6fd41f50c0 2024-09-11T23:21:19.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.918+0000 7f6fd0c00640 1 -- 172.21.15.144:0/656226964 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc036070 con 0x7f6fd41f50c0 2024-09-11T23:21:19.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.918+0000 7f6fdbc00640 1 -- 172.21.15.144:0/656226964 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fd414cbb0 con 0x7f6fd41f50c0 2024-09-11T23:21:19.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.919+0000 7f6fdbc00640 1 -- 172.21.15.144:0/656226964 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fd415cbf0 con 0x7f6fd41f50c0 2024-09-11T23:21:19.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.919+0000 7f6fd0c00640 1 -- 172.21.15.144:0/656226964 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 90702+0+0 (secure 0 0 0) 0x7f6fcc042020 con 0x7f6fd41f50c0 2024-09-11T23:21:19.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.920+0000 7f6fd0c00640 1 --2- 172.21.15.144:0/656226964 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6fb406c070 0x7f6fb406e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:19.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.920+0000 7f6fd0c00640 1 -- 172.21.15.144:0/656226964 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f6fcc0aba10 con 0x7f6fd41f50c0 2024-09-11T23:21:19.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.921+0000 7f6fd9200640 1 --2- 172.21.15.144:0/656226964 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6fb406c070 0x7f6fb406e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:19.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.921+0000 7f6fd9200640 1 --2- 172.21.15.144:0/656226964 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6fb406c070 0x7f6fb406e530 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8006fd0 tx=0x7f6fc8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:19.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:19.925+0000 7f6fd0c00640 1 -- 172.21.15.144:0/656226964 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6fcc049020 con 0x7f6fd41f50c0 2024-09-11T23:21:20.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.125+0000 7f6fdbc00640 1 -- 172.21.15.144:0/656226964 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol360", "target": ["mon-mgr", ""]}) -- 0x7f6fd415f7b0 con 0x7f6fb406c070 2024-09-11T23:21:20.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.161+0000 7f6fd0c00640 1 -- 172.21.15.144:0/656226964 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f6fd415f7b0 con 0x7f6fb406c070 2024-09-11T23:21:20.161 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/_nogroup/subvol360 2024-09-11T23:21:20.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.164+0000 7f6fdbc00640 1 -- 172.21.15.144:0/656226964 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6fb406c070 msgr2=0x7f6fb406e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:20.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.164+0000 7f6fdbc00640 1 --2- 172.21.15.144:0/656226964 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6fb406c070 0x7f6fb406e530 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8006fd0 tx=0x7f6fc8008040 comp rx=0 tx=0).stop 2024-09-11T23:21:20.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.164+0000 7f6fdbc00640 1 -- 172.21.15.144:0/656226964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fd41f50c0 msgr2=0x7f6fd4141b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:20.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.164+0000 7f6fdbc00640 1 --2- 172.21.15.144:0/656226964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fd41f50c0 0x7f6fd4141b20 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc009f40 tx=0x7f6fcc004a40 comp rx=0 tx=0).stop 2024-09-11T23:21:20.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.164+0000 7f6fdbc00640 1 -- 172.21.15.144:0/656226964 shutdown_connections 2024-09-11T23:21:20.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.164+0000 7f6fdbc00640 1 --2- 172.21.15.144:0/656226964 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6fb406c070 0x7f6fb406e530 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:20.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.164+0000 7f6fdbc00640 1 --2- 172.21.15.144:0/656226964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6fd41f50c0 0x7f6fd4141b20 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:20.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.164+0000 7f6fdbc00640 1 --2- 172.21.15.144:0/656226964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6fd415d3b0 0x7f6fd4154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:20.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.164+0000 7f6fdbc00640 1 --2- 172.21.15.144:0/656226964 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6fd40cf320 0x7f6fd414c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:20.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.164+0000 7f6fdbc00640 1 -- 172.21.15.144:0/656226964 >> 172.21.15.144:0/656226964 conn(0x7f6fd406bba0 msgr2=0x7f6fd40cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:20.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.164+0000 7f6fdbc00640 1 -- 172.21.15.144:0/656226964 shutdown_connections 2024-09-11T23:21:20.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.164+0000 7f6fdbc00640 1 -- 172.21.15.144:0/656226964 wait complete. 2024-09-11T23:21:20.180 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol360 2024-09-11T23:21:20.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.338+0000 7f8252c00640 1 Processor -- start 2024-09-11T23:21:20.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.338+0000 7f8252c00640 1 -- start start 2024-09-11T23:21:20.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.339+0000 7f8252c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f824c15e6c0 0x7f824c06c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:20.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.339+0000 7f8252c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f824c15eaa0 con 0x7f824c06d610 2024-09-11T23:21:20.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.339+0000 7f8252c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f824c06cdf0 con 0x7f824c0cf510 2024-09-11T23:21:20.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.339+0000 7f8252c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f824c0d34d0 con 0x7f824c15e6c0 2024-09-11T23:21:20.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.339+0000 7f8251800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f824c15e6c0 0x7f824c06c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:20.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.339+0000 7f8251800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f824c15e6c0 0x7f824c06c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41598/0 (socket says 172.21.15.144:41598) 2024-09-11T23:21:20.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.339+0000 7f8251800640 1 -- 172.21.15.144:0/4255776921 learned_addr learned my addr 172.21.15.144:0/4255776921 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:20.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.340+0000 7f8251800640 1 -- 172.21.15.144:0/4255776921 >> v1:172.21.15.165:6789/0 conn(0x7f824c0cf510 legacy=0x7f824c0b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:20.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.340+0000 7f8251800640 1 -- 172.21.15.144:0/4255776921 >> v1:172.21.15.144:6789/0 conn(0x7f824c06d610 legacy=0x7f824c06d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:20.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.340+0000 7f8251800640 1 -- 172.21.15.144:0/4255776921 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824c0d28c0 con 0x7f824c15e6c0 2024-09-11T23:21:20.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.341+0000 7f8251800640 1 --2- 172.21.15.144:0/4255776921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c15e6c0 0x7f824c06c8b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8240009870 tx=0x7f824002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b470a067ccc0e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:20.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.341+0000 7f824be00640 1 -- 172.21.15.144:0/4255776921 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8240037070 con 0x7f824c15e6c0 2024-09-11T23:21:20.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.341+0000 7f824be00640 1 -- 172.21.15.144:0/4255776921 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824002ae50 con 0x7f824c15e6c0 2024-09-11T23:21:20.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.341+0000 7f824be00640 1 -- 172.21.15.144:0/4255776921 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8240032860 con 0x7f824c15e6c0 2024-09-11T23:21:20.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.341+0000 7f8252c00640 1 -- 172.21.15.144:0/4255776921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c15e6c0 msgr2=0x7f824c06c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:20.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.341+0000 7f8252c00640 1 --2- 172.21.15.144:0/4255776921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c15e6c0 0x7f824c06c8b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8240009870 tx=0x7f824002a300 comp rx=0 tx=0).stop 2024-09-11T23:21:20.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.342+0000 7f8252c00640 1 -- 172.21.15.144:0/4255776921 shutdown_connections 2024-09-11T23:21:20.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.342+0000 7f8252c00640 1 --2- 172.21.15.144:0/4255776921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c15e6c0 0x7f824c06c8b0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:20.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.342+0000 7f8252c00640 1 -- 172.21.15.144:0/4255776921 >> 172.21.15.144:0/4255776921 conn(0x7f824c0d4720 msgr2=0x7f824c0d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:20.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.342+0000 7f8252c00640 1 -- 172.21.15.144:0/4255776921 shutdown_connections 2024-09-11T23:21:20.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.342+0000 7f8252c00640 1 -- 172.21.15.144:0/4255776921 wait complete. 2024-09-11T23:21:20.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.343+0000 7f8252c00640 1 Processor -- start 2024-09-11T23:21:20.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.343+0000 7f8252c00640 1 -- start start 2024-09-11T23:21:20.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.344+0000 7f8252c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c06d610 0x7f824c0b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:20.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.344+0000 7f8252c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c0cf510 0x7f824c0b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:20.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.344+0000 7f8252c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c15e6c0 0x7f824c0b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:20.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.344+0000 7f8252c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f824c0d3160 con 0x7f824c15e6c0 2024-09-11T23:21:20.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.344+0000 7f8252c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f824c0d2e80 con 0x7f824c0cf510 2024-09-11T23:21:20.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.344+0000 7f8252c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f824c0b7d80 con 0x7f824c06d610 2024-09-11T23:21:20.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.344+0000 7f8252200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c15e6c0 0x7f824c0b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:20.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.345+0000 7f8252200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c15e6c0 0x7f824c0b4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41610/0 (socket says 172.21.15.144:41610) 2024-09-11T23:21:20.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.345+0000 7f8252200640 1 -- 172.21.15.144:0/2680728828 learned_addr learned my addr 172.21.15.144:0/2680728828 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:20.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.345+0000 7f8251800640 1 --2- 172.21.15.144:0/2680728828 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c06d610 0x7f824c0b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:20.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.345+0000 7f8250e00640 1 --2- 172.21.15.144:0/2680728828 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c0cf510 0x7f824c0b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:20.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.345+0000 7f8252200640 1 -- 172.21.15.144:0/2680728828 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c06d610 msgr2=0x7f824c0b67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:20.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.345+0000 7f8252200640 1 --2- 172.21.15.144:0/2680728828 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c06d610 0x7f824c0b67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:20.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.345+0000 7f8252200640 1 -- 172.21.15.144:0/2680728828 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c0cf510 msgr2=0x7f824c0b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:20.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.345+0000 7f8252200640 1 --2- 172.21.15.144:0/2680728828 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c0cf510 0x7f824c0b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:20.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.345+0000 7f8252200640 1 -- 172.21.15.144:0/2680728828 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824c0cc630 con 0x7f824c15e6c0 2024-09-11T23:21:20.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.345+0000 7f8252200640 1 --2- 172.21.15.144:0/2680728828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c15e6c0 0x7f824c0b4df0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f824400c730 tx=0x7f824400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:20.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.345+0000 7f8249600640 1 -- 172.21.15.144:0/2680728828 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8244003b90 con 0x7f824c15e6c0 2024-09-11T23:21:20.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.346+0000 7f8249600640 1 -- 172.21.15.144:0/2680728828 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8244003d30 con 0x7f824c15e6c0 2024-09-11T23:21:20.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.346+0000 7f8252c00640 1 -- 172.21.15.144:0/2680728828 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f824c0cc910 con 0x7f824c15e6c0 2024-09-11T23:21:20.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.346+0000 7f8249600640 1 -- 172.21.15.144:0/2680728828 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824400aa90 con 0x7f824c15e6c0 2024-09-11T23:21:20.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.346+0000 7f8252c00640 1 -- 172.21.15.144:0/2680728828 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f824c0cd990 con 0x7f824c15e6c0 2024-09-11T23:21:20.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.347+0000 7f8252c00640 1 -- 172.21.15.144:0/2680728828 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f824c06c8b0 con 0x7f824c15e6c0 2024-09-11T23:21:20.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.348+0000 7f8249600640 1 -- 172.21.15.144:0/2680728828 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 90702+0+0 (secure 0 0 0) 0x7f824400ac30 con 0x7f824c15e6c0 2024-09-11T23:21:20.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.348+0000 7f8249600640 1 --2- 172.21.15.144:0/2680728828 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f822c06c070 0x7f822c06e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:20.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.349+0000 7f8249600640 1 -- 172.21.15.144:0/2680728828 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f824408b0b0 con 0x7f824c15e6c0 2024-09-11T23:21:20.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.349+0000 7f8251800640 1 --2- 172.21.15.144:0/2680728828 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f822c06c070 0x7f822c06e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:20.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.349+0000 7f8251800640 1 --2- 172.21.15.144:0/2680728828 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f822c06c070 0x7f822c06e530 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8240034000 tx=0x7f824002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:20.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.353+0000 7f8249600640 1 -- 172.21.15.144:0/2680728828 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8244059010 con 0x7f824c15e6c0 2024-09-11T23:21:20.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.554+0000 7f8252c00640 1 -- 172.21.15.144:0/2680728828 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol360", "target": ["mon-mgr", ""]}) -- 0x7f824c0d2600 con 0x7f822c06c070 2024-09-11T23:21:20.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.558+0000 7f8249600640 1 -- 172.21.15.144:0/2680728828 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f824c0d2600 con 0x7f822c06c070 2024-09-11T23:21:20.558 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/_nogroup/subvol360 2024-09-11T23:21:20.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.560+0000 7f8252c00640 1 -- 172.21.15.144:0/2680728828 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f822c06c070 msgr2=0x7f822c06e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:20.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.560+0000 7f8252c00640 1 --2- 172.21.15.144:0/2680728828 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f822c06c070 0x7f822c06e530 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8240034000 tx=0x7f824002e000 comp rx=0 tx=0).stop 2024-09-11T23:21:20.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.560+0000 7f8252c00640 1 -- 172.21.15.144:0/2680728828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c15e6c0 msgr2=0x7f824c0b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:20.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.560+0000 7f8252c00640 1 --2- 172.21.15.144:0/2680728828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c15e6c0 0x7f824c0b4df0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f824400c730 tx=0x7f824400cbf0 comp rx=0 tx=0).stop 2024-09-11T23:21:20.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.560+0000 7f8252c00640 1 -- 172.21.15.144:0/2680728828 shutdown_connections 2024-09-11T23:21:20.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.560+0000 7f8252c00640 1 --2- 172.21.15.144:0/2680728828 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f822c06c070 0x7f822c06e530 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:20.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.560+0000 7f8252c00640 1 --2- 172.21.15.144:0/2680728828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f824c15e6c0 0x7f824c0b4df0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:20.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.560+0000 7f8252c00640 1 --2- 172.21.15.144:0/2680728828 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f824c0cf510 0x7f824c0b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:20.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.560+0000 7f8252c00640 1 --2- 172.21.15.144:0/2680728828 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f824c06d610 0x7f824c0b67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:20.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.560+0000 7f8252c00640 1 -- 172.21.15.144:0/2680728828 >> 172.21.15.144:0/2680728828 conn(0x7f824c0d4720 msgr2=0x7f824c15f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:20.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.561+0000 7f8252c00640 1 -- 172.21.15.144:0/2680728828 shutdown_connections 2024-09-11T23:21:20.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.561+0000 7f8252c00640 1 -- 172.21.15.144:0/2680728828 wait complete. 2024-09-11T23:21:20.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:20.577 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/fea909c0ad22c9e18461a13a0828b9ea.meta) 2024-09-11T23:21:20.637 INFO:teuthology.orchestra.run.smithi144.stdout:[GLOBAL] 2024-09-11T23:21:20.638 INFO:teuthology.orchestra.run.smithi144.stdout:version = 1 2024-09-11T23:21:20.638 INFO:teuthology.orchestra.run.smithi144.stdout:type = subvolume 2024-09-11T23:21:20.638 INFO:teuthology.orchestra.run.smithi144.stdout:path = /volumes/_nogroup/subvol360 2024-09-11T23:21:20.638 INFO:teuthology.orchestra.run.smithi144.stdout:state = complete 2024-09-11T23:21:20.638 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:20.641 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume authorize cephfs subvol360 alice 2024-09-11T23:21:20.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.799+0000 7f65c5000640 1 Processor -- start 2024-09-11T23:21:20.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.799+0000 7f65c5000640 1 -- start start 2024-09-11T23:21:20.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.800+0000 7f65c5000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65c0145d90 0x7f65c00ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:20.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.800+0000 7f65c5000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f65c00cd490 0x7f65c00cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:20.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.800+0000 7f65c5000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65c00b4240 con 0x7f65c00cfb10 2024-09-11T23:21:20.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.800+0000 7f65c5000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f65c006d080 con 0x7f65c00cd490 2024-09-11T23:21:20.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.800+0000 7f65c5000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f65c00b4520 con 0x7f65c0145d90 2024-09-11T23:21:20.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.800+0000 7f65bde00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65c0145d90 0x7f65c00ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:20.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.800+0000 7f65bde00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65c0145d90 0x7f65c00ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:49180/0 (socket says 172.21.15.144:49180) 2024-09-11T23:21:20.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.800+0000 7f65bde00640 1 -- 172.21.15.144:0/1080920147 learned_addr learned my addr 172.21.15.144:0/1080920147 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:20.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.801+0000 7f65b5400640 1 --2- 172.21.15.144:0/1080920147 >> v2:172.21.15.165:3300/0 conn(0x7f65c00cd490 0x7f65c00cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:20.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.801+0000 7f65bde00640 1 -- 172.21.15.144:0/1080920147 >> v2:172.21.15.165:3300/0 conn(0x7f65c00cd490 msgr2=0x7f65c00cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:20.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.801+0000 7f65bde00640 1 --2- 172.21.15.144:0/1080920147 >> v2:172.21.15.165:3300/0 conn(0x7f65c00cd490 0x7f65c00cf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:20.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.801+0000 7f65bde00640 1 -- 172.21.15.144:0/1080920147 >> v1:172.21.15.165:6789/0 conn(0x7f65c00cfb10 legacy=0x7f65c01601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:20.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.801+0000 7f65bd400640 1 -- 172.21.15.144:0/1080920147 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1758455733 0 0) 0x7f65c00b4240 con 0x7f65c00cfb10 2024-09-11T23:21:20.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.801+0000 7f65bde00640 1 -- 172.21.15.144:0/1080920147 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c00b4800 con 0x7f65c0145d90 2024-09-11T23:21:20.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.802+0000 7f65bde00640 1 --2- 172.21.15.144:0/1080920147 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65c0145d90 0x7f65c00ccf50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f65b0009e50 tx=0x7f65b002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53c30d7986486e23 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:20.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.802+0000 7f65bd400640 1 -- 172.21.15.144:0/1080920147 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b0036070 con 0x7f65c0145d90 2024-09-11T23:21:20.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.803+0000 7f65bd400640 1 -- 172.21.15.144:0/1080920147 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65b0031600 con 0x7f65c0145d90 2024-09-11T23:21:20.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.803+0000 7f65bd400640 1 -- 172.21.15.144:0/1080920147 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b00319d0 con 0x7f65c0145d90 2024-09-11T23:21:20.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.803+0000 7f65c5000640 1 -- 172.21.15.144:0/1080920147 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65c0145d90 msgr2=0x7f65c00ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:20.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.803+0000 7f65c5000640 1 --2- 172.21.15.144:0/1080920147 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65c0145d90 0x7f65c00ccf50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f65b0009e50 tx=0x7f65b002a710 comp rx=0 tx=0).stop 2024-09-11T23:21:20.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.803+0000 7f65c5000640 1 -- 172.21.15.144:0/1080920147 shutdown_connections 2024-09-11T23:21:20.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.803+0000 7f65c5000640 1 --2- 172.21.15.144:0/1080920147 >> v2:172.21.15.165:3300/0 conn(0x7f65c00cd490 0x7f65c00cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:20.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.803+0000 7f65c5000640 1 --2- 172.21.15.144:0/1080920147 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65c0145d90 0x7f65c00ccf50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:20.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.803+0000 7f65c5000640 1 -- 172.21.15.144:0/1080920147 >> 172.21.15.144:0/1080920147 conn(0x7f65c006bba0 msgr2=0x7f65c006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:20.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.803+0000 7f65c5000640 1 -- 172.21.15.144:0/1080920147 shutdown_connections 2024-09-11T23:21:20.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.803+0000 7f65c5000640 1 -- 172.21.15.144:0/1080920147 wait complete. 2024-09-11T23:21:20.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.805+0000 7f65c5000640 1 Processor -- start 2024-09-11T23:21:20.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.805+0000 7f65c5000640 1 -- start start 2024-09-11T23:21:20.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.806+0000 7f65c5000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f65c00cd490 0x7f65c0153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:20.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.806+0000 7f65c5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65c00cfb10 0x7f65c013d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:20.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.806+0000 7f65c5000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65c0145d90 0x7f65c0141e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:20.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.806+0000 7f65c5000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f65c00b5610 con 0x7f65c00cfb10 2024-09-11T23:21:20.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.806+0000 7f65c5000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f65c00cffc0 con 0x7f65c00cd490 2024-09-11T23:21:20.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.806+0000 7f65c5000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f65c00b5790 con 0x7f65c0145d90 2024-09-11T23:21:20.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.806+0000 7f65b5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65c00cfb10 0x7f65c013d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:20.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.806+0000 7f65b5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65c00cfb10 0x7f65c013d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41612/0 (socket says 172.21.15.144:41612) 2024-09-11T23:21:20.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.806+0000 7f65bde00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f65c00cd490 0x7f65c0153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:20.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.806+0000 7f65b5400640 1 -- 172.21.15.144:0/826747836 learned_addr learned my addr 172.21.15.144:0/826747836 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:20.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.806+0000 7f65be800640 1 --2- 172.21.15.144:0/826747836 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65c0145d90 0x7f65c0141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:20.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.807+0000 7f65b5400640 1 -- 172.21.15.144:0/826747836 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65c0145d90 msgr2=0x7f65c0141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:20.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.807+0000 7f65b5400640 1 --2- 172.21.15.144:0/826747836 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65c0145d90 0x7f65c0141e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:20.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.807+0000 7f65b5400640 1 -- 172.21.15.144:0/826747836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f65c00cd490 msgr2=0x7f65c0153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:20.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.807+0000 7f65b5400640 1 --2- 172.21.15.144:0/826747836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f65c00cd490 0x7f65c0153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:20.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.807+0000 7f65b5400640 1 -- 172.21.15.144:0/826747836 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c0154180 con 0x7f65c00cfb10 2024-09-11T23:21:20.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.807+0000 7f65b5400640 1 --2- 172.21.15.144:0/826747836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65c00cfb10 0x7f65c013d350 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f65a800e840 tx=0x7f65a800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:20.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.807+0000 7f65b6a00640 1 -- 172.21.15.144:0/826747836 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a8017070 con 0x7f65c00cfb10 2024-09-11T23:21:20.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.807+0000 7f65b6a00640 1 -- 172.21.15.144:0/826747836 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a800c940 con 0x7f65c00cfb10 2024-09-11T23:21:20.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.807+0000 7f65b6a00640 1 -- 172.21.15.144:0/826747836 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a800cd10 con 0x7f65c00cfb10 2024-09-11T23:21:20.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.807+0000 7f65c5000640 1 -- 172.21.15.144:0/826747836 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65c01411f0 con 0x7f65c00cfb10 2024-09-11T23:21:20.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.807+0000 7f65c5000640 1 -- 172.21.15.144:0/826747836 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65c015cf70 con 0x7f65c00cfb10 2024-09-11T23:21:20.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.808+0000 7f65c5000640 1 -- 172.21.15.144:0/826747836 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65c0146170 con 0x7f65c00cfb10 2024-09-11T23:21:20.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.809+0000 7f65b6a00640 1 -- 172.21.15.144:0/826747836 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 90702+0+0 (secure 0 0 0) 0x7f65a801a070 con 0x7f65c00cfb10 2024-09-11T23:21:20.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.810+0000 7f65b6a00640 1 --2- 172.21.15.144:0/826747836 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f659c06c0a0 0x7f659c06e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:20.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.810+0000 7f65b6a00640 1 -- 172.21.15.144:0/826747836 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f65a808b060 con 0x7f65c00cfb10 2024-09-11T23:21:20.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.810+0000 7f65bde00640 1 --2- 172.21.15.144:0/826747836 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f659c06c0a0 0x7f659c06e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:20.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.811+0000 7f65bde00640 1 --2- 172.21.15.144:0/826747836 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f659c06c0a0 0x7f659c06e560 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f65b0033000 tx=0x7f65b0009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:20.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:20.814+0000 7f65b6a00640 1 -- 172.21.15.144:0/826747836 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f65c0154180 con 0x7f65c00cfb10 2024-09-11T23:21:21.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.012+0000 7f65c5000640 1 -- 172.21.15.144:0/826747836 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "fs subvolume authorize", "vol_name": "cephfs", "sub_name": "subvol360", "auth_id": "alice", "target": ["mon-mgr", ""]}) -- 0x7f65c00b3bb0 con 0x7f659c06c0a0 2024-09-11T23:21:21.020 INFO:tasks.ceph.mgr.y.smithi144.stderr:Creating meta for ID alice with tenant None 2024-09-11T23:21:21.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.055+0000 7f65b6a00640 1 -- 172.21.15.144:0/826747836 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f65c00b3bb0 con 0x7f659c06c0a0 2024-09-11T23:21:21.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.057+0000 7f65c5000640 1 -- 172.21.15.144:0/826747836 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f659c06c0a0 msgr2=0x7f659c06e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:21.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.057+0000 7f65c5000640 1 --2- 172.21.15.144:0/826747836 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f659c06c0a0 0x7f659c06e560 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f65b0033000 tx=0x7f65b0009000 comp rx=0 tx=0).stop 2024-09-11T23:21:21.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.057+0000 7f65c5000640 1 -- 172.21.15.144:0/826747836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65c00cfb10 msgr2=0x7f65c013d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:21.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.057+0000 7f65c5000640 1 --2- 172.21.15.144:0/826747836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65c00cfb10 0x7f65c013d350 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f65a800e840 tx=0x7f65a800ed00 comp rx=0 tx=0).stop 2024-09-11T23:21:21.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.057+0000 7f65c5000640 1 -- 172.21.15.144:0/826747836 shutdown_connections 2024-09-11T23:21:21.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.057+0000 7f65c5000640 1 --2- 172.21.15.144:0/826747836 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f659c06c0a0 0x7f659c06e560 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.057+0000 7f65c5000640 1 --2- 172.21.15.144:0/826747836 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65c0145d90 0x7f65c0141e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.057+0000 7f65c5000640 1 --2- 172.21.15.144:0/826747836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65c00cfb10 0x7f65c013d350 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.057+0000 7f65c5000640 1 --2- 172.21.15.144:0/826747836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f65c00cd490 0x7f65c0153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.057+0000 7f65c5000640 1 -- 172.21.15.144:0/826747836 >> 172.21.15.144:0/826747836 conn(0x7f65c006bba0 msgr2=0x7f65c006d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:21.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.058+0000 7f65c5000640 1 -- 172.21.15.144:0/826747836 shutdown_connections 2024-09-11T23:21:21.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.058+0000 7f65c5000640 1 -- 172.21.15.144:0/826747836 wait complete. 2024-09-11T23:21:21.073 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.alice --format=json-pretty 2024-09-11T23:21:21.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.228+0000 7feb75200640 1 Processor -- start 2024-09-11T23:21:21.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.228+0000 7feb75200640 1 -- start start 2024-09-11T23:21:21.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.229+0000 7feb75200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feb700cf070 0x7feb700cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:21.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.230+0000 7feb75200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb700ce740 con 0x7feb70073120 2024-09-11T23:21:21.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.230+0000 7feb75200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb70072640 con 0x7feb7015c180 2024-09-11T23:21:21.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.230+0000 7feb75200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7feb70072920 con 0x7feb700cf070 2024-09-11T23:21:21.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.230+0000 7feb65400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feb700cf070 0x7feb700cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:21.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.230+0000 7feb65400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feb700cf070 0x7feb700cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41628/0 (socket says 172.21.15.144:41628) 2024-09-11T23:21:21.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.230+0000 7feb65400640 1 -- 172.21.15.144:0/1397806126 learned_addr learned my addr 172.21.15.144:0/1397806126 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:21.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.230+0000 7feb65400640 1 -- 172.21.15.144:0/1397806126 >> v1:172.21.15.165:6789/0 conn(0x7feb7015c180 legacy=0x7feb700cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:21.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.230+0000 7feb65400640 1 -- 172.21.15.144:0/1397806126 >> v1:172.21.15.144:6789/0 conn(0x7feb70073120 legacy=0x7feb7006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:21.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.230+0000 7feb65400640 1 -- 172.21.15.144:0/1397806126 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb70072c00 con 0x7feb700cf070 2024-09-11T23:21:21.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.231+0000 7feb65400640 1 --2- 172.21.15.144:0/1397806126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb700cf070 0x7feb700cf4e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7feb58009870 tx=0x7feb5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d358f23d9c3a27 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:21.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.231+0000 7feb6d400640 1 -- 172.21.15.144:0/1397806126 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb58037070 con 0x7feb700cf070 2024-09-11T23:21:21.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.231+0000 7feb6d400640 1 -- 172.21.15.144:0/1397806126 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb58032440 con 0x7feb700cf070 2024-09-11T23:21:21.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.232+0000 7feb6d400640 1 -- 172.21.15.144:0/1397806126 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb58032810 con 0x7feb700cf070 2024-09-11T23:21:21.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.232+0000 7feb75200640 1 -- 172.21.15.144:0/1397806126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb700cf070 msgr2=0x7feb700cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:21.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.232+0000 7feb75200640 1 --2- 172.21.15.144:0/1397806126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb700cf070 0x7feb700cf4e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7feb58009870 tx=0x7feb5802a270 comp rx=0 tx=0).stop 2024-09-11T23:21:21.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.232+0000 7feb75200640 1 -- 172.21.15.144:0/1397806126 shutdown_connections 2024-09-11T23:21:21.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.232+0000 7feb75200640 1 --2- 172.21.15.144:0/1397806126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb700cf070 0x7feb700cf4e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.232+0000 7feb75200640 1 -- 172.21.15.144:0/1397806126 >> 172.21.15.144:0/1397806126 conn(0x7feb70062cc0 msgr2=0x7feb7006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:21.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.232+0000 7feb75200640 1 -- 172.21.15.144:0/1397806126 shutdown_connections 2024-09-11T23:21:21.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.232+0000 7feb75200640 1 -- 172.21.15.144:0/1397806126 wait complete. 2024-09-11T23:21:21.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.234+0000 7feb75200640 1 Processor -- start 2024-09-11T23:21:21.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.234+0000 7feb75200640 1 -- start start 2024-09-11T23:21:21.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.235+0000 7feb75200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb70073120 0x7feb700b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:21.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.235+0000 7feb75200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb700cf070 0x7feb700ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:21.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.235+0000 7feb75200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb7015c180 0x7feb700aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:21.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.235+0000 7feb75200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feb700722f0 con 0x7feb7015c180 2024-09-11T23:21:21.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.235+0000 7feb75200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feb700ced00 con 0x7feb70073120 2024-09-11T23:21:21.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.235+0000 7feb75200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7feb7015c560 con 0x7feb700cf070 2024-09-11T23:21:21.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.235+0000 7feb6e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb7015c180 0x7feb700aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:21.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.235+0000 7feb6e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb7015c180 0x7feb700aee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41638/0 (socket says 172.21.15.144:41638) 2024-09-11T23:21:21.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.235+0000 7feb6e800640 1 -- 172.21.15.144:0/1912898268 learned_addr learned my addr 172.21.15.144:0/1912898268 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:21.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.235+0000 7feb6de00640 1 --2- 172.21.15.144:0/1912898268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb70073120 0x7feb700b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:21.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.235+0000 7feb65400640 1 --2- 172.21.15.144:0/1912898268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb700cf070 0x7feb700ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:21.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.235+0000 7feb6e800640 1 -- 172.21.15.144:0/1912898268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb700cf070 msgr2=0x7feb700ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:21.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.235+0000 7feb6e800640 1 --2- 172.21.15.144:0/1912898268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb700cf070 0x7feb700ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.235+0000 7feb6e800640 1 -- 172.21.15.144:0/1912898268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb70073120 msgr2=0x7feb700b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:21.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.235+0000 7feb6e800640 1 --2- 172.21.15.144:0/1912898268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb70073120 0x7feb700b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.235+0000 7feb6e800640 1 -- 172.21.15.144:0/1912898268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb700b3e20 con 0x7feb7015c180 2024-09-11T23:21:21.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.235+0000 7feb65400640 1 --2- 172.21.15.144:0/1912898268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb700cf070 0x7feb700ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:21.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.236+0000 7feb6e800640 1 --2- 172.21.15.144:0/1912898268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb7015c180 0x7feb700aee20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7feb6800c7a0 tx=0x7feb6800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:21.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.236+0000 7feb66a00640 1 -- 172.21.15.144:0/1912898268 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb68003b70 con 0x7feb7015c180 2024-09-11T23:21:21.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.236+0000 7feb66a00640 1 -- 172.21.15.144:0/1912898268 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb68003d30 con 0x7feb7015c180 2024-09-11T23:21:21.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.236+0000 7feb75200640 1 -- 172.21.15.144:0/1912898268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb700b40a0 con 0x7feb7015c180 2024-09-11T23:21:21.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.236+0000 7feb66a00640 1 -- 172.21.15.144:0/1912898268 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6800aa90 con 0x7feb7015c180 2024-09-11T23:21:21.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.236+0000 7feb75200640 1 -- 172.21.15.144:0/1912898268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb70158f10 con 0x7feb7015c180 2024-09-11T23:21:21.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.237+0000 7feb75200640 1 -- 172.21.15.144:0/1912898268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb700b45c0 con 0x7feb7015c180 2024-09-11T23:21:21.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.238+0000 7feb66a00640 1 -- 172.21.15.144:0/1912898268 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 90702+0+0 (secure 0 0 0) 0x7feb6800ac30 con 0x7feb7015c180 2024-09-11T23:21:21.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.239+0000 7feb66a00640 1 --2- 172.21.15.144:0/1912898268 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7feb4c06c070 0x7feb4c06e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:21.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.239+0000 7feb66a00640 1 -- 172.21.15.144:0/1912898268 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7feb6808b1e0 con 0x7feb7015c180 2024-09-11T23:21:21.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.239+0000 7feb6de00640 1 --2- 172.21.15.144:0/1912898268 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7feb4c06c070 0x7feb4c06e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:21.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.240+0000 7feb6de00640 1 --2- 172.21.15.144:0/1912898268 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7feb4c06c070 0x7feb4c06e530 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feb600016e0 tx=0x7feb60009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:21.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.243+0000 7feb66a00640 1 -- 172.21.15.144:0/1912898268 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feb700b45c0 con 0x7feb7015c180 2024-09-11T23:21:21.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.481+0000 7feb75200640 1 -- 172.21.15.144:0/1912898268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.alice", "format": "json-pretty"} v 0) -- 0x7feb700d0660 con 0x7feb7015c180 2024-09-11T23:21:21.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.482+0000 7feb66a00640 1 -- 172.21.15.144:0/1912898268 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.alice", "format": "json-pretty"}]=0 v12) ==== 107+0+278 (secure 0 0 0) 0x7feb700b3e20 con 0x7feb7015c180 2024-09-11T23:21:21.482 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:21.482 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:21:21.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:21.482 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.alice", 2024-09-11T23:21:21.482 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDxJeJmbWIGAhAA7tlMrQTqRIUBbuYsEW7iiw==", 2024-09-11T23:21:21.482 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:21.482 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow rw path=/volumes/_nogroup/subvol360", 2024-09-11T23:21:21.482 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-11T23:21:21.482 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw pool=cephfs_data" 2024-09-11T23:21:21.483 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:21.483 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:21.483 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:21:21.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.484+0000 7feb75200640 1 -- 172.21.15.144:0/1912898268 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7feb4c06c070 msgr2=0x7feb4c06e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:21.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.484+0000 7feb75200640 1 --2- 172.21.15.144:0/1912898268 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7feb4c06c070 0x7feb4c06e530 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feb600016e0 tx=0x7feb60009040 comp rx=0 tx=0).stop 2024-09-11T23:21:21.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.484+0000 7feb75200640 1 -- 172.21.15.144:0/1912898268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb7015c180 msgr2=0x7feb700aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:21.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.484+0000 7feb75200640 1 --2- 172.21.15.144:0/1912898268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb7015c180 0x7feb700aee20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7feb6800c7a0 tx=0x7feb6800cc60 comp rx=0 tx=0).stop 2024-09-11T23:21:21.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.484+0000 7feb75200640 1 -- 172.21.15.144:0/1912898268 shutdown_connections 2024-09-11T23:21:21.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.484+0000 7feb75200640 1 --2- 172.21.15.144:0/1912898268 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7feb4c06c070 0x7feb4c06e530 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.484+0000 7feb75200640 1 --2- 172.21.15.144:0/1912898268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb7015c180 0x7feb700aee20 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.484+0000 7feb75200640 1 --2- 172.21.15.144:0/1912898268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb700cf070 0x7feb700ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.484+0000 7feb75200640 1 --2- 172.21.15.144:0/1912898268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb70073120 0x7feb700b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.484+0000 7feb75200640 1 -- 172.21.15.144:0/1912898268 >> 172.21.15.144:0/1912898268 conn(0x7feb70062cc0 msgr2=0x7feb7015ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:21.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.485+0000 7feb75200640 1 -- 172.21.15.144:0/1912898268 shutdown_connections 2024-09-11T23:21:21.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.485+0000 7feb75200640 1 -- 172.21.15.144:0/1912898268 wait complete. 2024-09-11T23:21:21.500 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol360 2024-09-11T23:21:21.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.656+0000 7f1483200640 1 Processor -- start 2024-09-11T23:21:21.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.656+0000 7f1483200640 1 -- start start 2024-09-11T23:21:21.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.657+0000 7f1483200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f14840d2840 0x7f14840d3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:21.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.657+0000 7f1483200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f148415eb80 con 0x7f148415e7a0 2024-09-11T23:21:21.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.657+0000 7f1483200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14840d2e20 con 0x7f14840cf1f0 2024-09-11T23:21:21.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.657+0000 7f1483200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f14840d3a30 con 0x7f14840d2840 2024-09-11T23:21:21.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.657+0000 7f1481e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f148415e7a0 0x7f14840b9ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53466/0 (socket says 172.21.15.144:53466) 2024-09-11T23:21:21.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.657+0000 7f1481e00640 1 -- 172.21.15.144:0/1217869289 learned_addr learned my addr 172.21.15.144:0/1217869289 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:21.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.658+0000 7f1481400640 1 --2- 172.21.15.144:0/1217869289 >> v2:172.21.15.165:3300/0 conn(0x7f14840d2840 0x7f14840d3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:21.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.658+0000 7f1480a00640 1 -- 172.21.15.144:0/1217869289 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2090786556 0 0) 0x7f148415eb80 con 0x7f148415e7a0 2024-09-11T23:21:21.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.658+0000 7f1480a00640 1 -- 172.21.15.144:0/1217869289 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1468003520 con 0x7f148415e7a0 2024-09-11T23:21:21.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.658+0000 7f1480a00640 1 -- 172.21.15.144:0/1217869289 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3036634158 0 0) 0x7f14840d2e20 con 0x7f14840cf1f0 2024-09-11T23:21:21.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.658+0000 7f1480a00640 1 -- 172.21.15.144:0/1217869289 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f148415eb80 con 0x7f14840cf1f0 2024-09-11T23:21:21.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.658+0000 7f1480a00640 1 -- 172.21.15.144:0/1217869289 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1491512261 0 0) 0x7f1468003520 con 0x7f148415e7a0 2024-09-11T23:21:21.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.658+0000 7f1480a00640 1 -- 172.21.15.144:0/1217869289 >> v2:172.21.15.165:3300/0 conn(0x7f14840d2840 msgr2=0x7f14840d3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:21.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.658+0000 7f1480a00640 1 --2- 172.21.15.144:0/1217869289 >> v2:172.21.15.165:3300/0 conn(0x7f14840d2840 0x7f14840d3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.658+0000 7f1480a00640 1 -- 172.21.15.144:0/1217869289 >> v1:172.21.15.165:6789/0 conn(0x7f14840cf1f0 legacy=0x7f14840b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:21.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.658+0000 7f1480a00640 1 -- 172.21.15.144:0/1217869289 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14840d3100 con 0x7f148415e7a0 2024-09-11T23:21:21.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.658+0000 7f1480a00640 1 -- 172.21.15.144:0/1217869289 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f1474001690 con 0x7f148415e7a0 2024-09-11T23:21:21.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.658+0000 7f1480a00640 1 -- 172.21.15.144:0/1217869289 >> v1:172.21.15.144:6789/0 conn(0x7f148415e7a0 legacy=0x7f14840b9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:21.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.658+0000 7f1480a00640 1 --2- 172.21.15.144:0/1217869289 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1468003b40 0x7f1468003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:21.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.658+0000 7f1480a00640 1 --2- 172.21.15.144:0/1217869289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1468004800 0x7f1468004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:21.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.658+0000 7f1480a00640 1 --2- 172.21.15.144:0/1217869289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14680051c0 0x7f146800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:21.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.658+0000 7f1480a00640 1 -- 172.21.15.144:0/1217869289 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f14840d3a30 con 0x7f1468004800 2024-09-11T23:21:21.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.658+0000 7f1480a00640 1 -- 172.21.15.144:0/1217869289 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f146800bfb0 con 0x7f14680051c0 2024-09-11T23:21:21.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.658+0000 7f1480a00640 1 -- 172.21.15.144:0/1217869289 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f146800c1b0 con 0x7f1468003b40 2024-09-11T23:21:21.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.658+0000 7f1481400640 1 --2- 172.21.15.144:0/1217869289 >> v2:172.21.15.165:3300/0 conn(0x7f14840d2840 0x7f14840d3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:21:21.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.659+0000 7f1482800640 1 --2- 172.21.15.144:0/1217869289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14680051c0 0x7f146800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:21.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.659+0000 7f1481e00640 1 --2- 172.21.15.144:0/1217869289 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1468003b40 0x7f1468003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:21.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.659+0000 7f1481400640 1 --2- 172.21.15.144:0/1217869289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1468004800 0x7f1468004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:21.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.659+0000 7f1482800640 1 -- 172.21.15.144:0/1217869289 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1468003b40 msgr2=0x7f1468003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:21.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.659+0000 7f1482800640 1 --2- 172.21.15.144:0/1217869289 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1468003b40 0x7f1468003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.659+0000 7f1482800640 1 -- 172.21.15.144:0/1217869289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1468004800 msgr2=0x7f1468004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:21.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.659+0000 7f1482800640 1 --2- 172.21.15.144:0/1217869289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1468004800 0x7f1468004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.659+0000 7f1482800640 1 -- 172.21.15.144:0/1217869289 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1468003520 con 0x7f14680051c0 2024-09-11T23:21:21.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.659+0000 7f1481400640 1 --2- 172.21.15.144:0/1217869289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1468004800 0x7f1468004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:21:21.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.660+0000 7f1482800640 1 -- 172.21.15.144:0/1217869289 reap_dead start 2024-09-11T23:21:21.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.660+0000 7f1482800640 1 --2- 172.21.15.144:0/1217869289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14680051c0 0x7f146800b9c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f147c001fd0 tx=0x7f1468005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a668ab27a9fc89b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:21.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.660+0000 7f1480a00640 1 -- 172.21.15.144:0/1217869289 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1470009840 con 0x7f14680051c0 2024-09-11T23:21:21.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.660+0000 7f1480a00640 1 -- 172.21.15.144:0/1217869289 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f147c003b70 con 0x7f14680051c0 2024-09-11T23:21:21.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.660+0000 7f1480a00640 1 -- 172.21.15.144:0/1217869289 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c001bf0 con 0x7f14680051c0 2024-09-11T23:21:21.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.661+0000 7f1483200640 1 -- 172.21.15.144:0/1217869289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14680051c0 msgr2=0x7f146800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:21.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.661+0000 7f1483200640 1 --2- 172.21.15.144:0/1217869289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14680051c0 0x7f146800b9c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f147c001fd0 tx=0x7f1468005830 comp rx=0 tx=0).stop 2024-09-11T23:21:21.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.661+0000 7f1483200640 1 -- 172.21.15.144:0/1217869289 shutdown_connections 2024-09-11T23:21:21.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.661+0000 7f1483200640 1 --2- 172.21.15.144:0/1217869289 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14680051c0 0x7f146800b9c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.661+0000 7f1483200640 1 -- 172.21.15.144:0/1217869289 >> 172.21.15.144:0/1217869289 conn(0x7f14840d4700 msgr2=0x7f14840d4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:21.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.661+0000 7f1483200640 1 -- 172.21.15.144:0/1217869289 shutdown_connections 2024-09-11T23:21:21.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.661+0000 7f1483200640 1 -- 172.21.15.144:0/1217869289 wait complete. 2024-09-11T23:21:21.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.663+0000 7f1483200640 1 Processor -- start 2024-09-11T23:21:21.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.663+0000 7f1483200640 1 -- start start 2024-09-11T23:21:21.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.664+0000 7f1483200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14680051c0 0x7f14840b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:21.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.664+0000 7f1483200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14840b3f80 0x7f14841f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:21.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.664+0000 7f1483200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14840ca400 0x7f14840cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:21.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.664+0000 7f1483200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f14840d3ec0 con 0x7f14840b3f80 2024-09-11T23:21:21.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.664+0000 7f1483200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f14840d36c0 con 0x7f14840ca400 2024-09-11T23:21:21.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.664+0000 7f1483200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f14840d4040 con 0x7f14680051c0 2024-09-11T23:21:21.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.664+0000 7f1481400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14840b3f80 0x7f14841f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:21.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.664+0000 7f1481400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14840b3f80 0x7f14841f51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41642/0 (socket says 172.21.15.144:41642) 2024-09-11T23:21:21.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.664+0000 7f1481400640 1 -- 172.21.15.144:0/4139933002 learned_addr learned my addr 172.21.15.144:0/4139933002 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:21.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.664+0000 7f1481e00640 1 --2- 172.21.15.144:0/4139933002 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14680051c0 0x7f14840b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:21.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.664+0000 7f1482800640 1 --2- 172.21.15.144:0/4139933002 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14840ca400 0x7f14840cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:21.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.664+0000 7f1481400640 1 -- 172.21.15.144:0/4139933002 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14680051c0 msgr2=0x7f14840b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:21.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.664+0000 7f1481400640 1 --2- 172.21.15.144:0/4139933002 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14680051c0 0x7f14840b6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.664+0000 7f1481400640 1 -- 172.21.15.144:0/4139933002 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14840ca400 msgr2=0x7f14840cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:21.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.664+0000 7f1481400640 1 --2- 172.21.15.144:0/4139933002 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14840ca400 0x7f14840cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.664+0000 7f1481400640 1 -- 172.21.15.144:0/4139933002 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14840b4770 con 0x7f14840b3f80 2024-09-11T23:21:21.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.664+0000 7f1481e00640 1 --2- 172.21.15.144:0/4139933002 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14680051c0 0x7f14840b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:21.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.664+0000 7f1482800640 1 --2- 172.21.15.144:0/4139933002 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14840ca400 0x7f14840cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:21.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.665+0000 7f1481400640 1 --2- 172.21.15.144:0/4139933002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14840b3f80 0x7f14841f51c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1470011a70 tx=0x7f1470011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:21.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.665+0000 7f147a000640 1 -- 172.21.15.144:0/4139933002 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147000fbb0 con 0x7f14840b3f80 2024-09-11T23:21:21.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.665+0000 7f147a000640 1 -- 172.21.15.144:0/4139933002 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f147000fd50 con 0x7f14840b3f80 2024-09-11T23:21:21.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.665+0000 7f147a000640 1 -- 172.21.15.144:0/4139933002 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1470014640 con 0x7f14840b3f80 2024-09-11T23:21:21.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.665+0000 7f1483200640 1 -- 172.21.15.144:0/4139933002 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14840b4a50 con 0x7f14840b3f80 2024-09-11T23:21:21.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.665+0000 7f1483200640 1 -- 172.21.15.144:0/4139933002 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14840b5010 con 0x7f14840b3f80 2024-09-11T23:21:21.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.666+0000 7f1483200640 1 -- 172.21.15.144:0/4139933002 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14840cb8a0 con 0x7f14840b3f80 2024-09-11T23:21:21.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.667+0000 7f147a000640 1 -- 172.21.15.144:0/4139933002 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 90702+0+0 (secure 0 0 0) 0x7f1470012040 con 0x7f14840b3f80 2024-09-11T23:21:21.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.668+0000 7f147a000640 1 --2- 172.21.15.144:0/4139933002 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f146406c070 0x7f146406e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:21.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.668+0000 7f147a000640 1 -- 172.21.15.144:0/4139933002 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f147008ba90 con 0x7f14840b3f80 2024-09-11T23:21:21.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.668+0000 7f1481e00640 1 --2- 172.21.15.144:0/4139933002 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f146406c070 0x7f146406e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:21.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.669+0000 7f1481e00640 1 --2- 172.21.15.144:0/4139933002 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f146406c070 0x7f146406e530 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f14840d2320 tx=0x7f1474009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:21.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.672+0000 7f147a000640 1 -- 172.21.15.144:0/4139933002 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1470019030 con 0x7f14840b3f80 2024-09-11T23:21:21.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.868+0000 7f1483200640 1 -- 172.21.15.144:0/4139933002 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol360", "target": ["mon-mgr", ""]}) -- 0x7f14840691f0 con 0x7f146406c070 2024-09-11T23:21:21.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.893+0000 7f147a000640 1 -- 172.21.15.144:0/4139933002 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1474007d40 con 0x7f146406c070 2024-09-11T23:21:21.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.896+0000 7f1483200640 1 -- 172.21.15.144:0/4139933002 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f146406c070 msgr2=0x7f146406e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.896+0000 7f1483200640 1 --2- 172.21.15.144:0/4139933002 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f146406c070 0x7f146406e530 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f14840d2320 tx=0x7f1474009040 comp rx=0 tx=0).stop 2024-09-11T23:21:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.896+0000 7f1483200640 1 -- 172.21.15.144:0/4139933002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14840b3f80 msgr2=0x7f14841f51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.896+0000 7f1483200640 1 --2- 172.21.15.144:0/4139933002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14840b3f80 0x7f14841f51c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1470011a70 tx=0x7f1470011f30 comp rx=0 tx=0).stop 2024-09-11T23:21:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.896+0000 7f1483200640 1 -- 172.21.15.144:0/4139933002 shutdown_connections 2024-09-11T23:21:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.896+0000 7f1483200640 1 --2- 172.21.15.144:0/4139933002 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f146406c070 0x7f146406e530 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.896+0000 7f1483200640 1 --2- 172.21.15.144:0/4139933002 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14840ca400 0x7f14840cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.896+0000 7f1483200640 1 --2- 172.21.15.144:0/4139933002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14840b3f80 0x7f14841f51c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.896+0000 7f1483200640 1 --2- 172.21.15.144:0/4139933002 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14680051c0 0x7f14840b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.896+0000 7f1483200640 1 -- 172.21.15.144:0/4139933002 >> 172.21.15.144:0/4139933002 conn(0x7f14840d4700 msgr2=0x7f14841612f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.897+0000 7f1483200640 1 -- 172.21.15.144:0/4139933002 shutdown_connections 2024-09-11T23:21:21.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:21.897+0000 7f1483200640 1 -- 172.21.15.144:0/4139933002 wait complete. 2024-09-11T23:21:21.898 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:21:21.898+0000 7f9c6c000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:21:21.898 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:21:21.898+0000 7f9c6c000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:21:21.898 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:21:21.898+0000 7f9c6c000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:21:21.898 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:21:21.898+0000 7f9c6c000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:21:21.898 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:21:21.898+0000 7f9c6c000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:21:21.915 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol22361 2024-09-11T23:21:21.916 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:21:21.915+0000 7f9c6b600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:21:21.916 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:21:21.915+0000 7f9c6b600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:21:21.916 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:21:21.915+0000 7f9c6b600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:21:21.916 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:21:21.915+0000 7f9c6b600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:21:21.916 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:21:21.915+0000 7f9c6b600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:21:22.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.072+0000 7f370a200640 1 Processor -- start 2024-09-11T23:21:22.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.072+0000 7f370a200640 1 -- start start 2024-09-11T23:21:22.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.073+0000 7f370a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f370406d610 0x7f370406da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:22.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.073+0000 7f370a200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f370406df60 con 0x7f37040cf510 2024-09-11T23:21:22.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.073+0000 7f370a200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f370415eaa0 con 0x7f370415e6c0 2024-09-11T23:21:22.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.073+0000 7f370a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f37040d34d0 con 0x7f370406d610 2024-09-11T23:21:22.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.073+0000 7f3703e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f37040cf510 0x7f37040b7670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53480/0 (socket says 172.21.15.144:53480) 2024-09-11T23:21:22.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.073+0000 7f3703e00640 1 -- 172.21.15.144:0/4017591653 learned_addr learned my addr 172.21.15.144:0/4017591653 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:22.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.074+0000 7f3709800640 1 --2- 172.21.15.144:0/4017591653 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f370406d610 0x7f370406da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:22.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.074+0000 7f3703400640 1 -- 172.21.15.144:0/4017591653 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1578447241 0 0) 0x7f36f0001110 con 0x7f37040cf510 2024-09-11T23:21:22.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.074+0000 7f3703400640 1 -- 172.21.15.144:0/4017591653 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36ec003520 con 0x7f37040cf510 2024-09-11T23:21:22.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.074+0000 7f3703400640 1 -- 172.21.15.144:0/4017591653 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3931712662 0 0) 0x7f370415eaa0 con 0x7f370415e6c0 2024-09-11T23:21:22.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.074+0000 7f3703400640 1 -- 172.21.15.144:0/4017591653 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36f0001110 con 0x7f370415e6c0 2024-09-11T23:21:22.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.074+0000 7f3703400640 1 -- 172.21.15.144:0/4017591653 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2295131510 0 0) 0x7f36ec003520 con 0x7f37040cf510 2024-09-11T23:21:22.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.074+0000 7f3703400640 1 -- 172.21.15.144:0/4017591653 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f370406d610 msgr2=0x7f370406da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:22.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.074+0000 7f3703400640 1 --2- 172.21.15.144:0/4017591653 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f370406d610 0x7f370406da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:22.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.074+0000 7f3703400640 1 -- 172.21.15.144:0/4017591653 >> v1:172.21.15.165:6789/0 conn(0x7f370415e6c0 legacy=0x7f370406c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:22.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.074+0000 7f3703400640 1 -- 172.21.15.144:0/4017591653 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37040d28c0 con 0x7f37040cf510 2024-09-11T23:21:22.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.074+0000 7f3703400640 1 -- 172.21.15.144:0/4017591653 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f36f0001860 con 0x7f37040cf510 2024-09-11T23:21:22.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.074+0000 7f3703400640 1 -- 172.21.15.144:0/4017591653 >> v1:172.21.15.144:6789/0 conn(0x7f37040cf510 legacy=0x7f37040b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:22.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.074+0000 7f3703400640 1 --2- 172.21.15.144:0/4017591653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36ec003b70 0x7f36ec003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:22.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.074+0000 7f3703400640 1 --2- 172.21.15.144:0/4017591653 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f370406d610 0x7f36ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:22.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.074+0000 7f3703400640 1 --2- 172.21.15.144:0/4017591653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36ec004d40 0x7f36ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:22.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.074+0000 7f3703400640 1 -- 172.21.15.144:0/4017591653 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f37040d34d0 con 0x7f36ec003b70 2024-09-11T23:21:22.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.074+0000 7f3703400640 1 -- 172.21.15.144:0/4017591653 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec00ba70 con 0x7f36ec004d40 2024-09-11T23:21:22.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.074+0000 7f3703400640 1 -- 172.21.15.144:0/4017591653 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f36ec00bc70 con 0x7f370406d610 2024-09-11T23:21:22.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.075+0000 7f3708e00640 1 --2- 172.21.15.144:0/4017591653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36ec003b70 0x7f36ec003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:22.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.075+0000 7f3703e00640 1 --2- 172.21.15.144:0/4017591653 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f370406d610 0x7f36ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:22.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.075+0000 7f3709800640 1 --2- 172.21.15.144:0/4017591653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36ec004d40 0x7f36ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:22.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.075+0000 7f3708e00640 1 -- 172.21.15.144:0/4017591653 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f370406d610 msgr2=0x7f36ec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:22.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.075+0000 7f3708e00640 1 --2- 172.21.15.144:0/4017591653 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f370406d610 0x7f36ec004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:22.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.075+0000 7f3708e00640 1 -- 172.21.15.144:0/4017591653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36ec004d40 msgr2=0x7f36ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:22.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.075+0000 7f3708e00640 1 --2- 172.21.15.144:0/4017591653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36ec004d40 0x7f36ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:22.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.075+0000 7f3708e00640 1 -- 172.21.15.144:0/4017591653 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ec003520 con 0x7f36ec003b70 2024-09-11T23:21:22.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.075+0000 7f3703e00640 1 --2- 172.21.15.144:0/4017591653 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f370406d610 0x7f36ec004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:22.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.076+0000 7f3708e00640 1 --2- 172.21.15.144:0/4017591653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36ec003b70 0x7f36ec003f70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f36f80018d0 tx=0x7f36ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbf0562eefb9388 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:22.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.076+0000 7f3703400640 1 -- 172.21.15.144:0/4017591653 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f80014f0 con 0x7f36ec003b70 2024-09-11T23:21:22.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.076+0000 7f3703400640 1 -- 172.21.15.144:0/4017591653 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f80052d0 con 0x7f36ec003b70 2024-09-11T23:21:22.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.076+0000 7f3703400640 1 -- 172.21.15.144:0/4017591653 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f802aca0 con 0x7f36ec003b70 2024-09-11T23:21:22.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.077+0000 7f370a200640 1 -- 172.21.15.144:0/4017591653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36ec003b70 msgr2=0x7f36ec003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:22.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.077+0000 7f370a200640 1 --2- 172.21.15.144:0/4017591653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36ec003b70 0x7f36ec003f70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f36f80018d0 tx=0x7f36ec005830 comp rx=0 tx=0).stop 2024-09-11T23:21:22.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.077+0000 7f3709800640 1 -- 172.21.15.144:0/4017591653 reap_dead start 2024-09-11T23:21:22.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.077+0000 7f370a200640 1 -- 172.21.15.144:0/4017591653 shutdown_connections 2024-09-11T23:21:22.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.077+0000 7f370a200640 1 -- 172.21.15.144:0/4017591653 >> 172.21.15.144:0/4017591653 conn(0x7f37040d4720 msgr2=0x7f37040d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.077+0000 7f370a200640 1 -- 172.21.15.144:0/4017591653 shutdown_connections 2024-09-11T23:21:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.077+0000 7f370a200640 1 -- 172.21.15.144:0/4017591653 wait complete. 2024-09-11T23:21:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.079+0000 7f370a200640 1 Processor -- start 2024-09-11T23:21:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.079+0000 7f370a200640 1 -- start start 2024-09-11T23:21:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.080+0000 7f370a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36ec003b70 0x7f370415a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.080+0000 7f370a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3704160260 0x7f37041f1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.080+0000 7f370a200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37041606c0 0x7f37041f1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.080+0000 7f370a200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f37040d3160 con 0x7f36ec003b70 2024-09-11T23:21:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.080+0000 7f370a200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f37040d2e80 con 0x7f37041606c0 2024-09-11T23:21:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.080+0000 7f370a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f37040b7d80 con 0x7f3704160260 2024-09-11T23:21:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.080+0000 7f3708e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36ec003b70 0x7f370415a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.080+0000 7f3708e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36ec003b70 0x7f370415a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41702/0 (socket says 172.21.15.144:41702) 2024-09-11T23:21:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.080+0000 7f3708e00640 1 -- 172.21.15.144:0/3772833462 learned_addr learned my addr 172.21.15.144:0/3772833462 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:22.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.080+0000 7f3708e00640 1 -- 172.21.15.144:0/3772833462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3704160260 msgr2=0x7f37041f1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:22.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.080+0000 7f3708e00640 1 --2- 172.21.15.144:0/3772833462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3704160260 0x7f37041f1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:22.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.080+0000 7f3708e00640 1 -- 172.21.15.144:0/3772833462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37041606c0 msgr2=0x7f37041f1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:22.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.080+0000 7f3708e00640 1 --2- 172.21.15.144:0/3772833462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37041606c0 0x7f37041f1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:22.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.080+0000 7f3708e00640 1 -- 172.21.15.144:0/3772833462 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3704160c70 con 0x7f36ec003b70 2024-09-11T23:21:22.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.080+0000 7f3708e00640 1 --2- 172.21.15.144:0/3772833462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36ec003b70 0x7f370415a320 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f36f80018d0 tx=0x7f36f80012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.081+0000 7f3700c00640 1 -- 172.21.15.144:0/3772833462 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f8040020 con 0x7f36ec003b70 2024-09-11T23:21:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.081+0000 7f3700c00640 1 -- 172.21.15.144:0/3772833462 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f8005480 con 0x7f36ec003b70 2024-09-11T23:21:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.081+0000 7f3700c00640 1 -- 172.21.15.144:0/3772833462 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f80014f0 con 0x7f36ec003b70 2024-09-11T23:21:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.081+0000 7f370a200640 1 -- 172.21.15.144:0/3772833462 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37041f78d0 con 0x7f36ec003b70 2024-09-11T23:21:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.081+0000 7f370a200640 1 -- 172.21.15.144:0/3772833462 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37041f7e90 con 0x7f36ec003b70 2024-09-11T23:21:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.082+0000 7f370a200640 1 -- 172.21.15.144:0/3772833462 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f370406da20 con 0x7f36ec003b70 2024-09-11T23:21:22.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.083+0000 7f3700c00640 1 -- 172.21.15.144:0/3772833462 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 10) ==== 90702+0+0 (secure 0 0 0) 0x7f36f8043020 con 0x7f36ec003b70 2024-09-11T23:21:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.084+0000 7f3700c00640 1 --2- 172.21.15.144:0/3772833462 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f36e406c0a0 0x7f36e406e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.084+0000 7f3700c00640 1 -- 172.21.15.144:0/3772833462 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f36f80ab3a0 con 0x7f36ec003b70 2024-09-11T23:21:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.084+0000 7f3703e00640 1 --2- 172.21.15.144:0/3772833462 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f36e406c0a0 0x7f36e406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:22.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.085+0000 7f3703e00640 1 --2- 172.21.15.144:0/3772833462 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f36e406c0a0 0x7f36e406e560 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f36f0001e10 tx=0x7f36f0001d00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:22.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.088+0000 7f3700c00640 1 -- 172.21.15.144:0/3772833462 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f36f804a030 con 0x7f36ec003b70 2024-09-11T23:21:22.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:22.288+0000 7f370a200640 1 -- 172.21.15.144:0/3772833462 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol22361", "target": ["mon-mgr", ""]}) -- 0x7f37040d2600 con 0x7f36e406c0a0 2024-09-11T23:21:23.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:23.317+0000 7f3700c00640 1 -- 172.21.15.144:0/3772833462 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f36f803a070 con 0x7f36ec003b70 2024-09-11T23:21:29.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:29.745+0000 7f3700c00640 1 -- 172.21.15.144:0/3772833462 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f37040d2600 con 0x7f36e406c0a0 2024-09-11T23:21:29.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:29.748+0000 7f370a200640 1 -- 172.21.15.144:0/3772833462 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f36e406c0a0 msgr2=0x7f36e406e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:29.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:29.748+0000 7f370a200640 1 --2- 172.21.15.144:0/3772833462 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f36e406c0a0 0x7f36e406e560 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f36f0001e10 tx=0x7f36f0001d00 comp rx=0 tx=0).stop 2024-09-11T23:21:29.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:29.748+0000 7f370a200640 1 -- 172.21.15.144:0/3772833462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36ec003b70 msgr2=0x7f370415a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:29.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:29.748+0000 7f370a200640 1 --2- 172.21.15.144:0/3772833462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36ec003b70 0x7f370415a320 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f36f80018d0 tx=0x7f36f80012d0 comp rx=0 tx=0).stop 2024-09-11T23:21:29.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:29.748+0000 7f370a200640 1 -- 172.21.15.144:0/3772833462 shutdown_connections 2024-09-11T23:21:29.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:29.748+0000 7f370a200640 1 --2- 172.21.15.144:0/3772833462 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f36e406c0a0 0x7f36e406e560 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:29.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:29.748+0000 7f370a200640 1 --2- 172.21.15.144:0/3772833462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37041606c0 0x7f37041f1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:29.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:29.748+0000 7f370a200640 1 --2- 172.21.15.144:0/3772833462 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3704160260 0x7f37041f1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:29.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:29.748+0000 7f370a200640 1 --2- 172.21.15.144:0/3772833462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36ec003b70 0x7f370415a320 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:29.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:29.748+0000 7f370a200640 1 -- 172.21.15.144:0/3772833462 >> 172.21.15.144:0/3772833462 conn(0x7f37040d4720 msgr2=0x7f37040d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:29.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:29.748+0000 7f370a200640 1 -- 172.21.15.144:0/3772833462 shutdown_connections 2024-09-11T23:21:29.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:29.749+0000 7f370a200640 1 -- 172.21.15.144:0/3772833462 wait complete. 2024-09-11T23:21:29.769 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-11T23:21:29.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:21:29.858 INFO:teuthology.orchestra.run.smithi144.stdout:2 2024-09-11T23:21:29.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:21:29.867 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:21:29.867 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:21:29.951 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:21:30.054 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:21:30.054 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:21:30.054 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:21:30.054 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:21:30.090 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:21:30.090 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:21:30.166 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:21:30.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.361+0000 7f0551200640 1 Processor -- start 2024-09-11T23:21:30.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.362+0000 7f0551200640 1 -- start start 2024-09-11T23:21:30.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.363+0000 7f0551200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f054c0cf070 0x7f054c0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:30.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.363+0000 7f0551200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f054c073120 0x7f054c0735b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:30.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.363+0000 7f0551200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f054c0ce740 con 0x7f054c15c180 2024-09-11T23:21:30.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.363+0000 7f0551200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f054c072640 con 0x7f054c0cf070 2024-09-11T23:21:30.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.363+0000 7f0551200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f054c072920 con 0x7f054c073120 2024-09-11T23:21:30.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.363+0000 7f0541400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f054c0cf070 0x7f054c0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:30.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.363+0000 7f0549e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f054c15c180 0x7f054c0cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46822/0 (socket says 172.21.15.144:46822) 2024-09-11T23:21:30.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.363+0000 7f0549e00640 1 -- 172.21.15.144:0/3762085906 learned_addr learned my addr 172.21.15.144:0/3762085906 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:30.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.363+0000 7f054a800640 1 --2- 172.21.15.144:0/3762085906 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f054c073120 0x7f054c0735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:30.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.364+0000 7f0541400640 1 -- 172.21.15.144:0/3762085906 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f054c073120 msgr2=0x7f054c0735b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:30.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.364+0000 7f0541400640 1 --2- 172.21.15.144:0/3762085906 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f054c073120 0x7f054c0735b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:30.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.364+0000 7f0541400640 1 -- 172.21.15.144:0/3762085906 >> v1:172.21.15.144:6789/0 conn(0x7f054c15c180 legacy=0x7f054c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:30.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.364+0000 7f0541400640 1 -- 172.21.15.144:0/3762085906 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054c072c00 con 0x7f054c0cf070 2024-09-11T23:21:30.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.364+0000 7f0549400640 1 -- 172.21.15.144:0/3762085906 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2878007808 0 0) 0x7f054c0ce740 con 0x7f054c15c180 2024-09-11T23:21:30.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.365+0000 7f0541400640 1 --2- 172.21.15.144:0/3762085906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f054c0cf070 0x7f054c0cf4e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f05340097a0 tx=0x7f053402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea6e5290382fc6a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:30.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.365+0000 7f0549400640 1 -- 172.21.15.144:0/3762085906 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0534037070 con 0x7f054c0cf070 2024-09-11T23:21:30.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.365+0000 7f0549400640 1 -- 172.21.15.144:0/3762085906 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053402ae50 con 0x7f054c0cf070 2024-09-11T23:21:30.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.365+0000 7f0549400640 1 -- 172.21.15.144:0/3762085906 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0534032660 con 0x7f054c0cf070 2024-09-11T23:21:30.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.365+0000 7f0551200640 1 -- 172.21.15.144:0/3762085906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f054c0cf070 msgr2=0x7f054c0cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:30.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.365+0000 7f0551200640 1 --2- 172.21.15.144:0/3762085906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f054c0cf070 0x7f054c0cf4e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f05340097a0 tx=0x7f053402a100 comp rx=0 tx=0).stop 2024-09-11T23:21:30.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.365+0000 7f0551200640 1 -- 172.21.15.144:0/3762085906 shutdown_connections 2024-09-11T23:21:30.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.365+0000 7f0551200640 1 --2- 172.21.15.144:0/3762085906 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f054c073120 0x7f054c0735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:30.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.365+0000 7f0551200640 1 --2- 172.21.15.144:0/3762085906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f054c0cf070 0x7f054c0cf4e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:30.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.365+0000 7f0551200640 1 -- 172.21.15.144:0/3762085906 >> 172.21.15.144:0/3762085906 conn(0x7f054c062cc0 msgr2=0x7f054c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:30.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.366+0000 7f0551200640 1 -- 172.21.15.144:0/3762085906 shutdown_connections 2024-09-11T23:21:30.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.366+0000 7f0551200640 1 -- 172.21.15.144:0/3762085906 wait complete. 2024-09-11T23:21:30.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.367+0000 7f0551200640 1 Processor -- start 2024-09-11T23:21:30.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.367+0000 7f0551200640 1 -- start start 2024-09-11T23:21:30.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.368+0000 7f0551200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f054c073120 0x7f054c0b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:30.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.368+0000 7f0551200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f054c0cf070 0x7f054c0b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:30.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.368+0000 7f0551200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f054c15c180 0x7f054c15a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:30.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.368+0000 7f0551200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f054c0722f0 con 0x7f054c0cf070 2024-09-11T23:21:30.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.368+0000 7f0551200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f054c0ced00 con 0x7f054c15c180 2024-09-11T23:21:30.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.368+0000 7f0551200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f054c15c560 con 0x7f054c073120 2024-09-11T23:21:30.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.368+0000 7f0541400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f054c0cf070 0x7f054c0b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:30.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.369+0000 7f0541400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f054c0cf070 0x7f054c0b3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41832/0 (socket says 172.21.15.144:41832) 2024-09-11T23:21:30.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.369+0000 7f0541400640 1 -- 172.21.15.144:0/1706054758 learned_addr learned my addr 172.21.15.144:0/1706054758 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:30.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.369+0000 7f0549e00640 1 --2- 172.21.15.144:0/1706054758 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f054c073120 0x7f054c0b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:30.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.369+0000 7f054a800640 1 --2- 172.21.15.144:0/1706054758 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f054c15c180 0x7f054c15a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:30.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.369+0000 7f0541400640 1 -- 172.21.15.144:0/1706054758 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f054c073120 msgr2=0x7f054c0b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:30.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.369+0000 7f0541400640 1 --2- 172.21.15.144:0/1706054758 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f054c073120 0x7f054c0b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:30.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.369+0000 7f0541400640 1 -- 172.21.15.144:0/1706054758 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f054c15c180 msgr2=0x7f054c15a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:30.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.369+0000 7f0541400640 1 --2- 172.21.15.144:0/1706054758 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f054c15c180 0x7f054c15a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:30.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.369+0000 7f0541400640 1 -- 172.21.15.144:0/1706054758 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054c0b4780 con 0x7f054c0cf070 2024-09-11T23:21:30.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.369+0000 7f0541400640 1 --2- 172.21.15.144:0/1706054758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f054c0cf070 0x7f054c0b3440 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f05340098c0 tx=0x7f05340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:30.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.369+0000 7f0542a00640 1 -- 172.21.15.144:0/1706054758 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0534041030 con 0x7f054c0cf070 2024-09-11T23:21:30.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.370+0000 7f0542a00640 1 -- 172.21.15.144:0/1706054758 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053402ac50 con 0x7f054c0cf070 2024-09-11T23:21:30.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.370+0000 7f0542a00640 1 -- 172.21.15.144:0/1706054758 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0534037040 con 0x7f054c0cf070 2024-09-11T23:21:30.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.370+0000 7f0551200640 1 -- 172.21.15.144:0/1706054758 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054c0b3980 con 0x7f054c0cf070 2024-09-11T23:21:30.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.370+0000 7f0551200640 1 -- 172.21.15.144:0/1706054758 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f054c0af050 con 0x7f054c0cf070 2024-09-11T23:21:30.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.371+0000 7f0551200640 1 -- 172.21.15.144:0/1706054758 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f054c158980 con 0x7f054c0cf070 2024-09-11T23:21:30.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.372+0000 7f0542a00640 1 -- 172.21.15.144:0/1706054758 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f0534044070 con 0x7f054c0cf070 2024-09-11T23:21:30.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.372+0000 7f0542a00640 1 --2- 172.21.15.144:0/1706054758 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f052806c190 0x7f052806e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:30.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.372+0000 7f0542a00640 1 -- 172.21.15.144:0/1706054758 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f053402ae00 con 0x7f054c0cf070 2024-09-11T23:21:30.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.373+0000 7f0549e00640 1 --2- 172.21.15.144:0/1706054758 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f052806c190 0x7f052806e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:30.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.373+0000 7f0549e00640 1 --2- 172.21.15.144:0/1706054758 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f052806c190 0x7f052806e650 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f053c000f60 tx=0x7f053c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:30.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.377+0000 7f0542a00640 1 -- 172.21.15.144:0/1706054758 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f053404b070 con 0x7f054c0cf070 2024-09-11T23:21:30.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.567+0000 7f0551200640 1 -- 172.21.15.144:0/1706054758 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f054c1586a0 con 0x7f054c0cf070 2024-09-11T23:21:30.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.567+0000 7f0542a00640 1 -- 172.21.15.144:0/1706054758 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) ==== 80+0+0 (secure 0 0 0) 0x7f054c0b4780 con 0x7f054c0cf070 2024-09-11T23:21:30.567 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:21:30.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.569+0000 7f0551200640 1 -- 172.21.15.144:0/1706054758 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f052806c190 msgr2=0x7f052806e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:30.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.569+0000 7f0551200640 1 --2- 172.21.15.144:0/1706054758 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f052806c190 0x7f052806e650 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f053c000f60 tx=0x7f053c009040 comp rx=0 tx=0).stop 2024-09-11T23:21:30.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.569+0000 7f0551200640 1 -- 172.21.15.144:0/1706054758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f054c0cf070 msgr2=0x7f054c0b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:30.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.569+0000 7f0551200640 1 --2- 172.21.15.144:0/1706054758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f054c0cf070 0x7f054c0b3440 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f05340098c0 tx=0x7f05340046c0 comp rx=0 tx=0).stop 2024-09-11T23:21:30.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.569+0000 7f0551200640 1 -- 172.21.15.144:0/1706054758 shutdown_connections 2024-09-11T23:21:30.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.569+0000 7f0551200640 1 --2- 172.21.15.144:0/1706054758 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f052806c190 0x7f052806e650 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:30.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.569+0000 7f0551200640 1 --2- 172.21.15.144:0/1706054758 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f054c15c180 0x7f054c15a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:30.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.569+0000 7f0551200640 1 --2- 172.21.15.144:0/1706054758 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f054c0cf070 0x7f054c0b3440 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:30.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.570+0000 7f0551200640 1 --2- 172.21.15.144:0/1706054758 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f054c073120 0x7f054c0b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:30.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.570+0000 7f0551200640 1 -- 172.21.15.144:0/1706054758 >> 172.21.15.144:0/1706054758 conn(0x7f054c062cc0 msgr2=0x7f054c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:30.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.570+0000 7f0551200640 1 -- 172.21.15.144:0/1706054758 shutdown_connections 2024-09-11T23:21:30.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.570+0000 7f0551200640 1 -- 172.21.15.144:0/1706054758 wait complete. 2024-09-11T23:21:30.586 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T23:21:30.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:30.586 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T23:21:30.668 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:21:30.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:30.669 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:21:30.718 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:21:30.718 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:21:30.719 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:21:30.757 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:21:30.757 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:21:30.833 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:21:30.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.989+0000 7f5bb4000640 1 Processor -- start 2024-09-11T23:21:30.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.989+0000 7f5bb4000640 1 -- start start 2024-09-11T23:21:30.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.990+0000 7f5bb4000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bac0d02a0 0x7f5bac0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:30.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.990+0000 7f5bb4000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5bac15ca40 0x7f5bac15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:30.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.990+0000 7f5bb4000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5bac15ce80 0x7f5bac1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:30.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.990+0000 7f5bb4000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5bac0d0bc0 con 0x7f5bac15ce80 2024-09-11T23:21:30.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.990+0000 7f5bb4000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5bac15d390 con 0x7f5bac15ca40 2024-09-11T23:21:30.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.990+0000 7f5bb4000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5bac15d670 con 0x7f5bac0d02a0 2024-09-11T23:21:30.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.990+0000 7f5bb2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5bac15ce80 0x7f5bac1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:30.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.990+0000 7f5bb2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5bac15ce80 0x7f5bac1594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41836/0 (socket says 172.21.15.144:41836) 2024-09-11T23:21:30.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.990+0000 7f5bb2000640 1 -- 172.21.15.144:0/1763759913 learned_addr learned my addr 172.21.15.144:0/1763759913 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:30.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.990+0000 7f5bb0c00640 1 --2- 172.21.15.144:0/1763759913 >> v2:172.21.15.165:3300/0 conn(0x7f5bac15ca40 0x7f5bac15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:30.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.990+0000 7f5bb1600640 1 --2- 172.21.15.144:0/1763759913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bac0d02a0 0x7f5bac0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:30.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.991+0000 7f5bb2000640 1 -- 172.21.15.144:0/1763759913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bac0d02a0 msgr2=0x7f5bac0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:30.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.991+0000 7f5bb2000640 1 --2- 172.21.15.144:0/1763759913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bac0d02a0 0x7f5bac0d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:30.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.991+0000 7f5bb2000640 1 -- 172.21.15.144:0/1763759913 >> v2:172.21.15.165:3300/0 conn(0x7f5bac15ca40 msgr2=0x7f5bac15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:30.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.991+0000 7f5bb2000640 1 --2- 172.21.15.144:0/1763759913 >> v2:172.21.15.165:3300/0 conn(0x7f5bac15ca40 0x7f5bac15e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:30.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.991+0000 7f5bb2000640 1 -- 172.21.15.144:0/1763759913 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bac15d950 con 0x7f5bac15ce80 2024-09-11T23:21:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.992+0000 7f5bb2000640 1 --2- 172.21.15.144:0/1763759913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bac15ce80 0x7f5bac1594c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5bac06f400 tx=0x7f5ba402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42f988370d02687 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.992+0000 7f5babe00640 1 -- 172.21.15.144:0/1763759913 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4036070 con 0x7f5bac15ce80 2024-09-11T23:21:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.992+0000 7f5babe00640 1 -- 172.21.15.144:0/1763759913 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba4031600 con 0x7f5bac15ce80 2024-09-11T23:21:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.992+0000 7f5babe00640 1 -- 172.21.15.144:0/1763759913 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba40319d0 con 0x7f5bac15ce80 2024-09-11T23:21:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.992+0000 7f5bb4000640 1 -- 172.21.15.144:0/1763759913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bac15ce80 msgr2=0x7f5bac1594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.992+0000 7f5bb4000640 1 --2- 172.21.15.144:0/1763759913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bac15ce80 0x7f5bac1594c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5bac06f400 tx=0x7f5ba402a610 comp rx=0 tx=0).stop 2024-09-11T23:21:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.993+0000 7f5bb4000640 1 -- 172.21.15.144:0/1763759913 shutdown_connections 2024-09-11T23:21:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.993+0000 7f5bb4000640 1 --2- 172.21.15.144:0/1763759913 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bac15ce80 0x7f5bac1594c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.993+0000 7f5bb4000640 1 --2- 172.21.15.144:0/1763759913 >> v2:172.21.15.165:3300/0 conn(0x7f5bac15ca40 0x7f5bac15e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.993+0000 7f5bb4000640 1 --2- 172.21.15.144:0/1763759913 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bac0d02a0 0x7f5bac0d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.993+0000 7f5bb4000640 1 -- 172.21.15.144:0/1763759913 >> 172.21.15.144:0/1763759913 conn(0x7f5bac062cc0 msgr2=0x7f5bac06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.993+0000 7f5bb4000640 1 -- 172.21.15.144:0/1763759913 shutdown_connections 2024-09-11T23:21:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.993+0000 7f5bb4000640 1 -- 172.21.15.144:0/1763759913 wait complete. 2024-09-11T23:21:30.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.994+0000 7f5bb4000640 1 Processor -- start 2024-09-11T23:21:30.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.994+0000 7f5bb4000640 1 -- start start 2024-09-11T23:21:30.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.995+0000 7f5bb4000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bac0d02a0 0x7f5bac158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:30.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.995+0000 7f5bb4000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bac15ca40 0x7f5bac156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:30.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.995+0000 7f5bb4000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bac15ce80 0x7f5bac0aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:30.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.995+0000 7f5bb4000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac155b90 con 0x7f5bac0d02a0 2024-09-11T23:21:30.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.995+0000 7f5bb4000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac15df10 con 0x7f5bac15ca40 2024-09-11T23:21:30.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.995+0000 7f5bb4000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5bac155d10 con 0x7f5bac15ce80 2024-09-11T23:21:30.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.995+0000 7f5bb1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bac0d02a0 0x7f5bac158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:30.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.996+0000 7f5bb1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bac0d02a0 0x7f5bac158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41840/0 (socket says 172.21.15.144:41840) 2024-09-11T23:21:30.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.996+0000 7f5bb1600640 1 -- 172.21.15.144:0/2250158115 learned_addr learned my addr 172.21.15.144:0/2250158115 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:30.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.996+0000 7f5bb0c00640 1 --2- 172.21.15.144:0/2250158115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bac15ca40 0x7f5bac156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:30.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.996+0000 7f5bb2000640 1 --2- 172.21.15.144:0/2250158115 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bac15ce80 0x7f5bac0aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:30.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.996+0000 7f5bb1600640 1 -- 172.21.15.144:0/2250158115 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bac15ce80 msgr2=0x7f5bac0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.996+0000 7f5bb1600640 1 --2- 172.21.15.144:0/2250158115 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bac15ce80 0x7f5bac0aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.996+0000 7f5bb1600640 1 -- 172.21.15.144:0/2250158115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bac15ca40 msgr2=0x7f5bac156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.996+0000 7f5bb1600640 1 --2- 172.21.15.144:0/2250158115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bac15ca40 0x7f5bac156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.996+0000 7f5bb1600640 1 -- 172.21.15.144:0/2250158115 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bac157480 con 0x7f5bac0d02a0 2024-09-11T23:21:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.996+0000 7f5bb1600640 1 --2- 172.21.15.144:0/2250158115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bac0d02a0 0x7f5bac158900 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000e870 tx=0x7f5ba000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.996+0000 7f5ba9600640 1 -- 172.21.15.144:0/2250158115 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0017070 con 0x7f5bac0d02a0 2024-09-11T23:21:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.996+0000 7f5ba9600640 1 -- 172.21.15.144:0/2250158115 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba000ee60 con 0x7f5bac0d02a0 2024-09-11T23:21:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.996+0000 7f5ba9600640 1 -- 172.21.15.144:0/2250158115 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba000cb80 con 0x7f5bac0d02a0 2024-09-11T23:21:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.996+0000 7f5bb4000640 1 -- 172.21.15.144:0/2250158115 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bac158fe0 con 0x7f5bac0d02a0 2024-09-11T23:21:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.997+0000 7f5bb4000640 1 -- 172.21.15.144:0/2250158115 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bac0cd040 con 0x7f5bac0d02a0 2024-09-11T23:21:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.998+0000 7f5bb4000640 1 -- 172.21.15.144:0/2250158115 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bac0b4790 con 0x7f5bac0d02a0 2024-09-11T23:21:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.999+0000 7f5ba9600640 1 -- 172.21.15.144:0/2250158115 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f5ba001a070 con 0x7f5bac0d02a0 2024-09-11T23:21:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.999+0000 7f5ba9600640 1 --2- 172.21.15.144:0/2250158115 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b8c06c1c0 0x7f5b8c06e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:30.999+0000 7f5ba9600640 1 -- 172.21.15.144:0/2250158115 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f5ba008b0c0 con 0x7f5bac0d02a0 2024-09-11T23:21:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.000+0000 7f5bb0c00640 1 --2- 172.21.15.144:0/2250158115 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b8c06c1c0 0x7f5b8c06e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:31.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.000+0000 7f5bb0c00640 1 --2- 172.21.15.144:0/2250158115 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b8c06c1c0 0x7f5b8c06e680 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5bac1f7a10 tx=0x7f5b98009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:31.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.004+0000 7f5ba9600640 1 -- 172.21.15.144:0/2250158115 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ba0059060 con 0x7f5bac0d02a0 2024-09-11T23:21:31.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.187+0000 7f5bb4000640 1 -- 172.21.15.144:0/2250158115 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5bac0af950 con 0x7f5bac0d02a0 2024-09-11T23:21:31.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.187+0000 7f5ba9600640 1 -- 172.21.15.144:0/2250158115 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) ==== 80+0+0 (secure 0 0 0) 0x7f5ba005d360 con 0x7f5bac0d02a0 2024-09-11T23:21:31.187 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:21:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.189+0000 7f5bb4000640 1 -- 172.21.15.144:0/2250158115 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b8c06c1c0 msgr2=0x7f5b8c06e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.189+0000 7f5bb4000640 1 --2- 172.21.15.144:0/2250158115 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b8c06c1c0 0x7f5b8c06e680 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5bac1f7a10 tx=0x7f5b98009190 comp rx=0 tx=0).stop 2024-09-11T23:21:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.189+0000 7f5bb4000640 1 -- 172.21.15.144:0/2250158115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bac0d02a0 msgr2=0x7f5bac158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.189+0000 7f5bb4000640 1 --2- 172.21.15.144:0/2250158115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bac0d02a0 0x7f5bac158900 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000e870 tx=0x7f5ba000ed30 comp rx=0 tx=0).stop 2024-09-11T23:21:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.190+0000 7f5bb4000640 1 -- 172.21.15.144:0/2250158115 shutdown_connections 2024-09-11T23:21:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.190+0000 7f5bb4000640 1 --2- 172.21.15.144:0/2250158115 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5b8c06c1c0 0x7f5b8c06e680 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.190+0000 7f5bb4000640 1 --2- 172.21.15.144:0/2250158115 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bac15ce80 0x7f5bac0aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:31.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.190+0000 7f5bb4000640 1 --2- 172.21.15.144:0/2250158115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bac15ca40 0x7f5bac156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.190+0000 7f5bb4000640 1 --2- 172.21.15.144:0/2250158115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bac0d02a0 0x7f5bac158900 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.190+0000 7f5bb4000640 1 -- 172.21.15.144:0/2250158115 >> 172.21.15.144:0/2250158115 conn(0x7f5bac062cc0 msgr2=0x7f5bac0b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.190+0000 7f5bb4000640 1 -- 172.21.15.144:0/2250158115 shutdown_connections 2024-09-11T23:21:31.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.190+0000 7f5bb4000640 1 -- 172.21.15.144:0/2250158115 wait complete. 2024-09-11T23:21:31.206 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-11T23:21:31.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:31.206 DEBUG:teuthology.orchestra.run.smithi165:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-11T23:21:31.269 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:21:31.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:21:31.269 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:21:31.305 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:21:31.305 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:21:31.306 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:21:31.342 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:21:31.342 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:21:31.342 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:21:31.342 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:21:31.382 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:21:31.382 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:21:31.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.541+0000 7fa6b0a00640 1 Processor -- start 2024-09-11T23:21:31.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.541+0000 7fa6b0a00640 1 -- start start 2024-09-11T23:21:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.542+0000 7fa6b0a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa6ac15e640 0x7fa6ac0d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.542+0000 7fa6b0a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa6ac0b66e0 0x7fa6ac0b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.542+0000 7fa6b0a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6ac06bee0 con 0x7fa6ac0d3f60 2024-09-11T23:21:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.542+0000 7fa6b0a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa6ac15ea20 con 0x7fa6ac0b66e0 2024-09-11T23:21:31.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.542+0000 7fa6b0a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa6ac06caf0 con 0x7fa6ac15e640 2024-09-11T23:21:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.542+0000 7fa6abe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa6ac0b66e0 0x7fa6ac0b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.542+0000 7fa6aaa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa6ac0d3f60 0x7fa6ac0b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46836/0 (socket says 172.21.15.144:46836) 2024-09-11T23:21:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.542+0000 7fa6aaa00640 1 -- 172.21.15.144:0/45253162 learned_addr learned my addr 172.21.15.144:0/45253162 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.542+0000 7fa6ab400640 1 --2- 172.21.15.144:0/45253162 >> v2:172.21.15.165:3300/0 conn(0x7fa6ac15e640 0x7fa6ac0d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.543+0000 7fa6aa000640 1 -- 172.21.15.144:0/45253162 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 206729465 0 0) 0x7fa6ac06bee0 con 0x7fa6ac0d3f60 2024-09-11T23:21:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.543+0000 7fa6aa000640 1 -- 172.21.15.144:0/45253162 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa690003520 con 0x7fa6ac0d3f60 2024-09-11T23:21:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.543+0000 7fa6abe00640 1 -- 172.21.15.144:0/45253162 >> v2:172.21.15.165:3300/0 conn(0x7fa6ac15e640 msgr2=0x7fa6ac0d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:31.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.543+0000 7fa6abe00640 1 --2- 172.21.15.144:0/45253162 >> v2:172.21.15.165:3300/0 conn(0x7fa6ac15e640 0x7fa6ac0d3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:31.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.543+0000 7fa6abe00640 1 -- 172.21.15.144:0/45253162 >> v1:172.21.15.144:6789/0 conn(0x7fa6ac0d3f60 legacy=0x7fa6ac0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:31.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.543+0000 7fa6abe00640 1 -- 172.21.15.144:0/45253162 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6ac06c1c0 con 0x7fa6ac0b66e0 2024-09-11T23:21:31.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.543+0000 7fa6ab400640 1 --2- 172.21.15.144:0/45253162 >> v2:172.21.15.165:3300/0 conn(0x7fa6ac15e640 0x7fa6ac0d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:21:31.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.544+0000 7fa6abe00640 1 --2- 172.21.15.144:0/45253162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6ac0b66e0 0x7fa6ac0b7750 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac0d2030 tx=0x7fa6a402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef3ca8d13221887 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:31.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.544+0000 7fa6aa000640 1 -- 172.21.15.144:0/45253162 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4007740 con 0x7fa6ac0b66e0 2024-09-11T23:21:31.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.544+0000 7fa6aa000640 1 -- 172.21.15.144:0/45253162 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a40078e0 con 0x7fa6ac0b66e0 2024-09-11T23:21:31.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.544+0000 7fa6aa000640 1 -- 172.21.15.144:0/45253162 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4007cb0 con 0x7fa6ac0b66e0 2024-09-11T23:21:31.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.545+0000 7fa6b0a00640 1 -- 172.21.15.144:0/45253162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6ac0b66e0 msgr2=0x7fa6ac0b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:31.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.545+0000 7fa6b0a00640 1 --2- 172.21.15.144:0/45253162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6ac0b66e0 0x7fa6ac0b7750 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac0d2030 tx=0x7fa6a402a680 comp rx=0 tx=0).stop 2024-09-11T23:21:31.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.545+0000 7fa6b0a00640 1 -- 172.21.15.144:0/45253162 shutdown_connections 2024-09-11T23:21:31.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.545+0000 7fa6b0a00640 1 --2- 172.21.15.144:0/45253162 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6ac0b66e0 0x7fa6ac0b7750 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:31.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.545+0000 7fa6b0a00640 1 --2- 172.21.15.144:0/45253162 >> v2:172.21.15.165:3300/0 conn(0x7fa6ac15e640 0x7fa6ac0d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:31.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.545+0000 7fa6b0a00640 1 -- 172.21.15.144:0/45253162 >> 172.21.15.144:0/45253162 conn(0x7fa6ac0d0fd0 msgr2=0x7fa6ac0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:31.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.545+0000 7fa6b0a00640 1 -- 172.21.15.144:0/45253162 shutdown_connections 2024-09-11T23:21:31.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.545+0000 7fa6b0a00640 1 -- 172.21.15.144:0/45253162 wait complete. 2024-09-11T23:21:31.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.546+0000 7fa6b0a00640 1 Processor -- start 2024-09-11T23:21:31.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.547+0000 7fa6b0a00640 1 -- start start 2024-09-11T23:21:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.547+0000 7fa6b0a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6ac0b66e0 0x7fa6ac158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.547+0000 7fa6b0a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6ac0d3f60 0x7fa6ac0cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.547+0000 7fa6b0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6ac15e640 0x7fa6ac1f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.547+0000 7fa6b0a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac0b7c90 con 0x7fa6ac15e640 2024-09-11T23:21:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.547+0000 7fa6b0a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac06c780 con 0x7fa6ac0d3f60 2024-09-11T23:21:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.547+0000 7fa6b0a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa6ac0b7e10 con 0x7fa6ac0b66e0 2024-09-11T23:21:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.548+0000 7fa6abe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6ac15e640 0x7fa6ac1f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.548+0000 7fa6abe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6ac15e640 0x7fa6ac1f3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41860/0 (socket says 172.21.15.144:41860) 2024-09-11T23:21:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.548+0000 7fa6abe00640 1 -- 172.21.15.144:0/1019796025 learned_addr learned my addr 172.21.15.144:0/1019796025 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.548+0000 7fa6ab400640 1 --2- 172.21.15.144:0/1019796025 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6ac0b66e0 0x7fa6ac158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.548+0000 7fa6aaa00640 1 --2- 172.21.15.144:0/1019796025 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6ac0d3f60 0x7fa6ac0cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:31.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.548+0000 7fa6abe00640 1 -- 172.21.15.144:0/1019796025 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6ac0b66e0 msgr2=0x7fa6ac158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.548+0000 7fa6abe00640 1 --2- 172.21.15.144:0/1019796025 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6ac0b66e0 0x7fa6ac158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.548+0000 7fa6abe00640 1 -- 172.21.15.144:0/1019796025 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6ac0d3f60 msgr2=0x7fa6ac0cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.548+0000 7fa6abe00640 1 --2- 172.21.15.144:0/1019796025 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6ac0d3f60 0x7fa6ac0cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.548+0000 7fa6abe00640 1 -- 172.21.15.144:0/1019796025 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6ac1f4900 con 0x7fa6ac15e640 2024-09-11T23:21:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.548+0000 7fa6abe00640 1 --2- 172.21.15.144:0/1019796025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6ac15e640 0x7fa6ac1f3dd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009e50 tx=0x7fa6a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.549+0000 7fa6a3400640 1 -- 172.21.15.144:0/1019796025 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4040070 con 0x7fa6ac15e640 2024-09-11T23:21:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.549+0000 7fa6a3400640 1 -- 172.21.15.144:0/1019796025 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a4031bf0 con 0x7fa6ac15e640 2024-09-11T23:21:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.549+0000 7fa6a3400640 1 -- 172.21.15.144:0/1019796025 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4009450 con 0x7fa6ac15e640 2024-09-11T23:21:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.549+0000 7fa6b0a00640 1 -- 172.21.15.144:0/1019796025 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6ac1f4be0 con 0x7fa6ac15e640 2024-09-11T23:21:31.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.549+0000 7fa6b0a00640 1 -- 172.21.15.144:0/1019796025 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6ac15b620 con 0x7fa6ac15e640 2024-09-11T23:21:31.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.550+0000 7fa6b0a00640 1 -- 172.21.15.144:0/1019796025 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6ac0cc670 con 0x7fa6ac15e640 2024-09-11T23:21:31.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.551+0000 7fa6a3400640 1 -- 172.21.15.144:0/1019796025 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7fa6a4039040 con 0x7fa6ac15e640 2024-09-11T23:21:31.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.552+0000 7fa6a3400640 1 --2- 172.21.15.144:0/1019796025 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa68c06c1c0 0x7fa68c06e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:31.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.552+0000 7fa6a3400640 1 -- 172.21.15.144:0/1019796025 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fa6a40acaf0 con 0x7fa6ac15e640 2024-09-11T23:21:31.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.552+0000 7fa6ab400640 1 --2- 172.21.15.144:0/1019796025 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa68c06c1c0 0x7fa68c06e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:31.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.553+0000 7fa6ab400640 1 --2- 172.21.15.144:0/1019796025 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa68c06c1c0 0x7fa68c06e680 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009560 tx=0x7fa69c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:31.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.556+0000 7fa6a3400640 1 -- 172.21.15.144:0/1019796025 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa6a407a9c0 con 0x7fa6ac15e640 2024-09-11T23:21:31.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.764+0000 7fa6b0a00640 1 -- 172.21.15.144:0/1019796025 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6ac0b7750 con 0x7fa6ac15e640 2024-09-11T23:21:31.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.765+0000 7fa6a3400640 1 -- 172.21.15.144:0/1019796025 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5235 (secure 0 0 0) 0x7fa6a407ecc0 con 0x7fa6ac15e640 2024-09-11T23:21:31.764 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:31.765 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":36,"btime":"2024-09-11T23:21:14:274694+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2161458369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2161458369},{"type":"v1","addr":"172.21.15.144:6836","nonce":2161458369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5150,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/2242935376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2242935376},{"type":"v1","addr":"172.21.15.165:6833","nonce":2242935376}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5156,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3703078361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3703078361},{"type":"v1","addr":"172.21.15.165:6835","nonce":3703078361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:20:58.860267+0000","modified":"2024-09-11T23:21:01.888764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1648435689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1648435689},{"type":"v1","addr":"172.21.15.144:6837","nonce":1648435689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5667,"qdb_cluster":[5667]},"id":4}]} 2024-09-11T23:21:31.765 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 36 2024-09-11T23:21:31.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.767+0000 7fa6b0a00640 1 -- 172.21.15.144:0/1019796025 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa68c06c1c0 msgr2=0x7fa68c06e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:31.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.767+0000 7fa6b0a00640 1 --2- 172.21.15.144:0/1019796025 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa68c06c1c0 0x7fa68c06e680 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009560 tx=0x7fa69c009190 comp rx=0 tx=0).stop 2024-09-11T23:21:31.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.767+0000 7fa6b0a00640 1 -- 172.21.15.144:0/1019796025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6ac15e640 msgr2=0x7fa6ac1f3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:31.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.767+0000 7fa6b0a00640 1 --2- 172.21.15.144:0/1019796025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6ac15e640 0x7fa6ac1f3dd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009e50 tx=0x7fa6a4004a40 comp rx=0 tx=0).stop 2024-09-11T23:21:31.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.767+0000 7fa6b0a00640 1 -- 172.21.15.144:0/1019796025 shutdown_connections 2024-09-11T23:21:31.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.767+0000 7fa6b0a00640 1 --2- 172.21.15.144:0/1019796025 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa68c06c1c0 0x7fa68c06e680 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:31.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.767+0000 7fa6b0a00640 1 --2- 172.21.15.144:0/1019796025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa6ac15e640 0x7fa6ac1f3dd0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:31.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.767+0000 7fa6b0a00640 1 --2- 172.21.15.144:0/1019796025 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6ac0d3f60 0x7fa6ac0cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:31.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.767+0000 7fa6b0a00640 1 --2- 172.21.15.144:0/1019796025 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6ac0b66e0 0x7fa6ac158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:31.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.767+0000 7fa6b0a00640 1 -- 172.21.15.144:0/1019796025 >> 172.21.15.144:0/1019796025 conn(0x7fa6ac0d0fd0 msgr2=0x7fa6ac0d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:31.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.767+0000 7fa6b0a00640 1 -- 172.21.15.144:0/1019796025 shutdown_connections 2024-09-11T23:21:31.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.767+0000 7fa6b0a00640 1 -- 172.21.15.144:0/1019796025 wait complete. 2024-09-11T23:21:31.783 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:21:31.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.937+0000 7f7117200640 1 Processor -- start 2024-09-11T23:21:31.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.937+0000 7f7117200640 1 -- start start 2024-09-11T23:21:31.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.938+0000 7f7117200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f711815c010 0x7f71180b5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:31.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.938+0000 7f7117200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f711815f590 0x7f711806f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:31.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.938+0000 7f7117200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f711806fc10 con 0x7f711806f7e0 2024-09-11T23:21:31.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.938+0000 7f7117200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f71180b5bb0 con 0x7f711815f590 2024-09-11T23:21:31.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.938+0000 7f7117200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f71180b5e90 con 0x7f711815c010 2024-09-11T23:21:31.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.938+0000 7f710d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f711815f590 0x7f711806f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:31.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.938+0000 7f7116800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f711806f7e0 0x7f7118072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46848/0 (socket says 172.21.15.144:46848) 2024-09-11T23:21:31.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.938+0000 7f710d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f711815f590 0x7f711806f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41874/0 (socket says 172.21.15.144:41874) 2024-09-11T23:21:31.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.938+0000 7f7116800640 1 -- 172.21.15.144:0/2664707812 learned_addr learned my addr 172.21.15.144:0/2664707812 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:31.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.939+0000 7f7115e00640 1 --2- 172.21.15.144:0/2664707812 >> v2:172.21.15.165:3300/0 conn(0x7f711815c010 0x7f71180b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:31.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.939+0000 7f710d400640 1 -- 172.21.15.144:0/2664707812 >> v2:172.21.15.165:3300/0 conn(0x7f711815c010 msgr2=0x7f71180b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:31.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.939+0000 7f710d400640 1 --2- 172.21.15.144:0/2664707812 >> v2:172.21.15.165:3300/0 conn(0x7f711815c010 0x7f71180b5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:31.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.939+0000 7f710d400640 1 -- 172.21.15.144:0/2664707812 >> v1:172.21.15.144:6789/0 conn(0x7f711806f7e0 legacy=0x7f7118072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:31.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.939+0000 7f710d400640 1 -- 172.21.15.144:0/2664707812 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71180b6170 con 0x7f711815f590 2024-09-11T23:21:31.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.940+0000 7f710d400640 1 --2- 172.21.15.144:0/2664707812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f711815f590 0x7f711806f2a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7118063700 tx=0x7f710002a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd74a8b8f6134698 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:31.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.940+0000 7f7115400640 1 -- 172.21.15.144:0/2664707812 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100037070 con 0x7f711815f590 2024-09-11T23:21:31.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.940+0000 7f7115400640 1 -- 172.21.15.144:0/2664707812 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f710002add0 con 0x7f711815f590 2024-09-11T23:21:31.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.940+0000 7f7115400640 1 -- 172.21.15.144:0/2664707812 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100032660 con 0x7f711815f590 2024-09-11T23:21:31.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.941+0000 7f7117200640 1 -- 172.21.15.144:0/2664707812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f711815f590 msgr2=0x7f711806f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:31.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.941+0000 7f7117200640 1 --2- 172.21.15.144:0/2664707812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f711815f590 0x7f711806f2a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7118063700 tx=0x7f710002a080 comp rx=0 tx=0).stop 2024-09-11T23:21:31.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.941+0000 7f7117200640 1 -- 172.21.15.144:0/2664707812 shutdown_connections 2024-09-11T23:21:31.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.941+0000 7f7117200640 1 --2- 172.21.15.144:0/2664707812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f711815f590 0x7f711806f2a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:31.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.941+0000 7f7117200640 1 --2- 172.21.15.144:0/2664707812 >> v2:172.21.15.165:3300/0 conn(0x7f711815c010 0x7f71180b5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:31.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.941+0000 7f7117200640 1 -- 172.21.15.144:0/2664707812 >> 172.21.15.144:0/2664707812 conn(0x7f7118062630 msgr2=0x7f7118062a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:31.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.941+0000 7f7117200640 1 -- 172.21.15.144:0/2664707812 shutdown_connections 2024-09-11T23:21:31.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.941+0000 7f7117200640 1 -- 172.21.15.144:0/2664707812 wait complete. 2024-09-11T23:21:31.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.942+0000 7f7117200640 1 Processor -- start 2024-09-11T23:21:31.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.943+0000 7f7117200640 1 -- start start 2024-09-11T23:21:31.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.944+0000 7f7117200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f711806f7e0 0x7f711815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:31.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.944+0000 7f7117200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f711815c010 0x7f71181515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:31.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.944+0000 7f7117200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f711815f590 0x7f71180b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:31.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.944+0000 7f7117200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f711815c3f0 con 0x7f711806f7e0 2024-09-11T23:21:31.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.944+0000 7f7117200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f711815fa20 con 0x7f711815c010 2024-09-11T23:21:31.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.944+0000 7f7117200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f711815c570 con 0x7f711815f590 2024-09-11T23:21:31.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.944+0000 7f7115e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f711806f7e0 0x7f711815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:31.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.944+0000 7f7115e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f711806f7e0 0x7f711815ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41884/0 (socket says 172.21.15.144:41884) 2024-09-11T23:21:31.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.944+0000 7f7115e00640 1 -- 172.21.15.144:0/1615330487 learned_addr learned my addr 172.21.15.144:0/1615330487 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:31.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.944+0000 7f710d400640 1 --2- 172.21.15.144:0/1615330487 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f711815c010 0x7f71181515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:31.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.944+0000 7f7116800640 1 --2- 172.21.15.144:0/1615330487 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f711815f590 0x7f71180b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:31.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.944+0000 7f7115e00640 1 -- 172.21.15.144:0/1615330487 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f711815f590 msgr2=0x7f71180b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:31.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.944+0000 7f7115e00640 1 --2- 172.21.15.144:0/1615330487 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f711815f590 0x7f71180b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:31.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.944+0000 7f7115e00640 1 -- 172.21.15.144:0/1615330487 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f711815c010 msgr2=0x7f71181515d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:31.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.944+0000 7f7115e00640 1 --2- 172.21.15.144:0/1615330487 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f711815c010 0x7f71181515d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:31.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.944+0000 7f7115e00640 1 -- 172.21.15.144:0/1615330487 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71180cd6b0 con 0x7f711806f7e0 2024-09-11T23:21:31.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.944+0000 7f7116800640 1 --2- 172.21.15.144:0/1615330487 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f711815f590 0x7f71180b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:31.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.945+0000 7f7115e00640 1 --2- 172.21.15.144:0/1615330487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f711806f7e0 0x7f711815ab50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f710800e9e0 tx=0x7f710800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:31.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.945+0000 7f710ea00640 1 -- 172.21.15.144:0/1615330487 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7108017070 con 0x7f711806f7e0 2024-09-11T23:21:31.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.945+0000 7f710ea00640 1 -- 172.21.15.144:0/1615330487 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f710800c9d0 con 0x7f711806f7e0 2024-09-11T23:21:31.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.945+0000 7f710ea00640 1 -- 172.21.15.144:0/1615330487 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710800cdc0 con 0x7f711806f7e0 2024-09-11T23:21:31.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.945+0000 7f7117200640 1 -- 172.21.15.144:0/1615330487 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71180cd990 con 0x7f711806f7e0 2024-09-11T23:21:31.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.945+0000 7f7117200640 1 -- 172.21.15.144:0/1615330487 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71180cdf50 con 0x7f711806f7e0 2024-09-11T23:21:31.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.946+0000 7f7117200640 1 -- 172.21.15.144:0/1615330487 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71180b5590 con 0x7f711806f7e0 2024-09-11T23:21:31.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.947+0000 7f710ea00640 1 -- 172.21.15.144:0/1615330487 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f710801a070 con 0x7f711806f7e0 2024-09-11T23:21:31.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.948+0000 7f710ea00640 1 --2- 172.21.15.144:0/1615330487 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f70f406c100 0x7f70f406e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:31.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.948+0000 7f710ea00640 1 -- 172.21.15.144:0/1615330487 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f710808b6e0 con 0x7f711806f7e0 2024-09-11T23:21:31.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.948+0000 7f710d400640 1 --2- 172.21.15.144:0/1615330487 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f70f406c100 0x7f70f406e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:31.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.949+0000 7f710d400640 1 --2- 172.21.15.144:0/1615330487 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f70f406c100 0x7f70f406e5c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7100034000 tx=0x7f710002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:31.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:31.952+0000 7f710ea00640 1 -- 172.21.15.144:0/1615330487 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7108059610 con 0x7f711806f7e0 2024-09-11T23:21:32.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.159+0000 7f7117200640 1 -- 172.21.15.144:0/1615330487 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7118152430 con 0x7f711806f7e0 2024-09-11T23:21:32.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.160+0000 7f710ea00640 1 -- 172.21.15.144:0/1615330487 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5235 (secure 0 0 0) 0x7f710805d910 con 0x7f711806f7e0 2024-09-11T23:21:32.160 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:32.160 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":36,"btime":"2024-09-11T23:21:14:274694+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2161458369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2161458369},{"type":"v1","addr":"172.21.15.144:6836","nonce":2161458369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5150,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/2242935376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2242935376},{"type":"v1","addr":"172.21.15.165:6833","nonce":2242935376}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5156,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3703078361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3703078361},{"type":"v1","addr":"172.21.15.165:6835","nonce":3703078361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:20:58.860267+0000","modified":"2024-09-11T23:21:01.888764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1648435689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1648435689},{"type":"v1","addr":"172.21.15.144:6837","nonce":1648435689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5667,"qdb_cluster":[5667]},"id":4}]} 2024-09-11T23:21:32.160 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 36 2024-09-11T23:21:32.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.162+0000 7f7117200640 1 -- 172.21.15.144:0/1615330487 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f70f406c100 msgr2=0x7f70f406e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:32.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.162+0000 7f7117200640 1 --2- 172.21.15.144:0/1615330487 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f70f406c100 0x7f70f406e5c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7100034000 tx=0x7f710002e000 comp rx=0 tx=0).stop 2024-09-11T23:21:32.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.162+0000 7f7117200640 1 -- 172.21.15.144:0/1615330487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f711806f7e0 msgr2=0x7f711815ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:32.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.162+0000 7f7117200640 1 --2- 172.21.15.144:0/1615330487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f711806f7e0 0x7f711815ab50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f710800e9e0 tx=0x7f710800eea0 comp rx=0 tx=0).stop 2024-09-11T23:21:32.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.162+0000 7f7117200640 1 -- 172.21.15.144:0/1615330487 shutdown_connections 2024-09-11T23:21:32.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.162+0000 7f7117200640 1 --2- 172.21.15.144:0/1615330487 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f70f406c100 0x7f70f406e5c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:32.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.162+0000 7f7117200640 1 --2- 172.21.15.144:0/1615330487 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f711815f590 0x7f71180b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:32.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.162+0000 7f7117200640 1 --2- 172.21.15.144:0/1615330487 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f711815c010 0x7f71181515d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:32.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.162+0000 7f7117200640 1 --2- 172.21.15.144:0/1615330487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f711806f7e0 0x7f711815ab50 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:32.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.162+0000 7f7117200640 1 -- 172.21.15.144:0/1615330487 >> 172.21.15.144:0/1615330487 conn(0x7f7118062630 msgr2=0x7f711806d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:32.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.162+0000 7f7117200640 1 -- 172.21.15.144:0/1615330487 shutdown_connections 2024-09-11T23:21:32.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.162+0000 7f7117200640 1 -- 172.21.15.144:0/1615330487 wait complete. 2024-09-11T23:21:32.181 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:21:32.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.334+0000 7f8a74e00640 1 Processor -- start 2024-09-11T23:21:32.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.334+0000 7f8a74e00640 1 -- start start 2024-09-11T23:21:32.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.335+0000 7f8a74e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8a7015e960 0x7f8a700b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:32.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.336+0000 7f8a74e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a70073390 0x7f8a700cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:32.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.336+0000 7f8a74e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a7015ed40 con 0x7f8a70073cb0 2024-09-11T23:21:32.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.336+0000 7f8a74e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8a700b78a0 con 0x7f8a7015e960 2024-09-11T23:21:32.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.336+0000 7f8a74e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8a7006ce50 con 0x7f8a70073390 2024-09-11T23:21:32.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.336+0000 7f8a6e800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8a70073cb0 0x7f8a700b44c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46858/0 (socket says 172.21.15.144:46858) 2024-09-11T23:21:32.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.336+0000 7f8a6e800640 1 -- 172.21.15.144:0/2840492439 learned_addr learned my addr 172.21.15.144:0/2840492439 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:32.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.336+0000 7f8a6de00640 1 --2- 172.21.15.144:0/2840492439 >> v2:172.21.15.165:3300/0 conn(0x7f8a7015e960 0x7f8a700b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:32.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.336+0000 7f8a6d400640 1 --2- 172.21.15.144:0/2840492439 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a70073390 0x7f8a700cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:32.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.336+0000 7f8a6de00640 1 -- 172.21.15.144:0/2840492439 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a70073390 msgr2=0x7f8a700cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:32.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.336+0000 7f8a6de00640 1 --2- 172.21.15.144:0/2840492439 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a70073390 0x7f8a700cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:32.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.336+0000 7f8a6de00640 1 -- 172.21.15.144:0/2840492439 >> v1:172.21.15.144:6789/0 conn(0x7f8a70073cb0 legacy=0x7f8a700b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:32.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.336+0000 7f8a6de00640 1 -- 172.21.15.144:0/2840492439 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a700b72e0 con 0x7f8a7015e960 2024-09-11T23:21:32.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.337+0000 7f8a6de00640 1 --2- 172.21.15.144:0/2840492439 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a7015e960 0x7f8a700b6ce0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8a600097a0 tx=0x7f8a6002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87b9fa0366b4e9a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:32.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.338+0000 7f8a6ca00640 1 -- 172.21.15.144:0/2840492439 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a60037070 con 0x7f8a7015e960 2024-09-11T23:21:32.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.338+0000 7f8a6ca00640 1 -- 172.21.15.144:0/2840492439 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a60032440 con 0x7f8a7015e960 2024-09-11T23:21:32.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.338+0000 7f8a6ca00640 1 -- 172.21.15.144:0/2840492439 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a60032810 con 0x7f8a7015e960 2024-09-11T23:21:32.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.338+0000 7f8a74e00640 1 -- 172.21.15.144:0/2840492439 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a7015e960 msgr2=0x7f8a700b6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:32.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.338+0000 7f8a74e00640 1 --2- 172.21.15.144:0/2840492439 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a7015e960 0x7f8a700b6ce0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8a600097a0 tx=0x7f8a6002a180 comp rx=0 tx=0).stop 2024-09-11T23:21:32.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.338+0000 7f8a74e00640 1 -- 172.21.15.144:0/2840492439 shutdown_connections 2024-09-11T23:21:32.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.338+0000 7f8a74e00640 1 --2- 172.21.15.144:0/2840492439 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a70073390 0x7f8a700cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:32.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.338+0000 7f8a74e00640 1 --2- 172.21.15.144:0/2840492439 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a7015e960 0x7f8a700b6ce0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:32.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.338+0000 7f8a74e00640 1 -- 172.21.15.144:0/2840492439 >> 172.21.15.144:0/2840492439 conn(0x7f8a70062810 msgr2=0x7f8a70062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:32.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.339+0000 7f8a74e00640 1 -- 172.21.15.144:0/2840492439 shutdown_connections 2024-09-11T23:21:32.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.339+0000 7f8a74e00640 1 -- 172.21.15.144:0/2840492439 wait complete. 2024-09-11T23:21:32.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.340+0000 7f8a74e00640 1 Processor -- start 2024-09-11T23:21:32.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.340+0000 7f8a74e00640 1 -- start start 2024-09-11T23:21:32.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.341+0000 7f8a74e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a70073390 0x7f8a700cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:32.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.341+0000 7f8a74e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a70073cb0 0x7f8a701f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:32.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.341+0000 7f8a74e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a7015e960 0x7f8a701f4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:32.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.341+0000 7f8a74e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8a700b4bd0 con 0x7f8a70073390 2024-09-11T23:21:32.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.341+0000 7f8a74e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7006d0f0 con 0x7f8a70073cb0 2024-09-11T23:21:32.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.341+0000 7f8a74e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8a700b4d50 con 0x7f8a7015e960 2024-09-11T23:21:32.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.341+0000 7f8a6de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a70073390 0x7f8a700cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:32.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.341+0000 7f8a6de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a70073390 0x7f8a700cf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41896/0 (socket says 172.21.15.144:41896) 2024-09-11T23:21:32.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.342+0000 7f8a6de00640 1 -- 172.21.15.144:0/2783857789 learned_addr learned my addr 172.21.15.144:0/2783857789 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:32.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.342+0000 7f8a6d400640 1 --2- 172.21.15.144:0/2783857789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a70073cb0 0x7f8a701f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:32.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.342+0000 7f8a6de00640 1 -- 172.21.15.144:0/2783857789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a7015e960 msgr2=0x7f8a701f4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:32.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.342+0000 7f8a6de00640 1 --2- 172.21.15.144:0/2783857789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a7015e960 0x7f8a701f4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:32.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.342+0000 7f8a6de00640 1 -- 172.21.15.144:0/2783857789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a70073cb0 msgr2=0x7f8a701f40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:32.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.342+0000 7f8a6de00640 1 --2- 172.21.15.144:0/2783857789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a70073cb0 0x7f8a701f40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:32.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.342+0000 7f8a6de00640 1 -- 172.21.15.144:0/2783857789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a70160aa0 con 0x7f8a70073390 2024-09-11T23:21:32.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.342+0000 7f8a6de00640 1 --2- 172.21.15.144:0/2783857789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a70073390 0x7f8a700cf4b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8a60000c00 tx=0x7f8a600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:32.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.342+0000 7f8a66000640 1 -- 172.21.15.144:0/2783857789 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a60037040 con 0x7f8a70073390 2024-09-11T23:21:32.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.342+0000 7f8a66000640 1 -- 172.21.15.144:0/2783857789 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a60042070 con 0x7f8a70073390 2024-09-11T23:21:32.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.342+0000 7f8a66000640 1 -- 172.21.15.144:0/2783857789 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a60030940 con 0x7f8a70073390 2024-09-11T23:21:32.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.342+0000 7f8a74e00640 1 -- 172.21.15.144:0/2783857789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a70160d80 con 0x7f8a70073390 2024-09-11T23:21:32.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.343+0000 7f8a74e00640 1 -- 172.21.15.144:0/2783857789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a70161340 con 0x7f8a70073390 2024-09-11T23:21:32.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.344+0000 7f8a74e00640 1 -- 172.21.15.144:0/2783857789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a700b6ce0 con 0x7f8a70073390 2024-09-11T23:21:32.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.344+0000 7f8a66000640 1 -- 172.21.15.144:0/2783857789 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f8a60030ae0 con 0x7f8a70073390 2024-09-11T23:21:32.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.345+0000 7f8a66000640 1 --2- 172.21.15.144:0/2783857789 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a5006c190 0x7f8a5006e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:32.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.345+0000 7f8a66000640 1 -- 172.21.15.144:0/2783857789 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f8a600abce0 con 0x7f8a70073390 2024-09-11T23:21:32.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.345+0000 7f8a6d400640 1 --2- 172.21.15.144:0/2783857789 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a5006c190 0x7f8a5006e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:32.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.346+0000 7f8a6d400640 1 --2- 172.21.15.144:0/2783857789 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a5006c190 0x7f8a5006e650 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8a700cf440 tx=0x7f8a5c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:32.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.350+0000 7f8a66000640 1 -- 172.21.15.144:0/2783857789 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a60045360 con 0x7f8a70073390 2024-09-11T23:21:32.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.529+0000 7f8a74e00640 1 -- 172.21.15.144:0/2783857789 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a700b26c0 con 0x7f8a70073390 2024-09-11T23:21:33.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.530+0000 7f8a66000640 1 -- 172.21.15.144:0/2783857789 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16749 (secure 0 0 0) 0x7f8a6007a2d0 con 0x7f8a70073390 2024-09-11T23:21:33.505 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:33.505 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":59,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:21:00.452382+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:20:56.632085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-11T23:20:57.855096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:21:33.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.532+0000 7f8a74e00640 1 -- 172.21.15.144:0/2783857789 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a5006c190 msgr2=0x7f8a5006e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:33.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.532+0000 7f8a74e00640 1 --2- 172.21.15.144:0/2783857789 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a5006c190 0x7f8a5006e650 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8a700cf440 tx=0x7f8a5c008040 comp rx=0 tx=0).stop 2024-09-11T23:21:33.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.532+0000 7f8a74e00640 1 -- 172.21.15.144:0/2783857789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a70073390 msgr2=0x7f8a700cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:33.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.532+0000 7f8a74e00640 1 --2- 172.21.15.144:0/2783857789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a70073390 0x7f8a700cf4b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8a60000c00 tx=0x7f8a600046c0 comp rx=0 tx=0).stop 2024-09-11T23:21:33.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.532+0000 7f8a74e00640 1 -- 172.21.15.144:0/2783857789 shutdown_connections 2024-09-11T23:21:33.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.532+0000 7f8a74e00640 1 --2- 172.21.15.144:0/2783857789 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f8a5006c190 0x7f8a5006e650 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:33.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.532+0000 7f8a74e00640 1 --2- 172.21.15.144:0/2783857789 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8a7015e960 0x7f8a701f4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:33.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.532+0000 7f8a74e00640 1 --2- 172.21.15.144:0/2783857789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a70073cb0 0x7f8a701f40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:33.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.532+0000 7f8a74e00640 1 --2- 172.21.15.144:0/2783857789 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a70073390 0x7f8a700cf4b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:33.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.532+0000 7f8a74e00640 1 -- 172.21.15.144:0/2783857789 >> 172.21.15.144:0/2783857789 conn(0x7f8a70062810 msgr2=0x7f8a700b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:33.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.532+0000 7f8a74e00640 1 -- 172.21.15.144:0/2783857789 shutdown_connections 2024-09-11T23:21:33.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:32.532+0000 7f8a74e00640 1 -- 172.21.15.144:0/2783857789 wait complete. 2024-09-11T23:21:33.509 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:21:33.509 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:21:33.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.672+0000 7fa191e00640 1 Processor -- start 2024-09-11T23:21:33.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.672+0000 7fa191e00640 1 -- start start 2024-09-11T23:21:33.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.673+0000 7fa191e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa18c0b5fd0 0x7fa18c0b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:33.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.673+0000 7fa191e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa18c0b7750 0x7fa18c0b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:33.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.673+0000 7fa191e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa18c06bee0 con 0x7fa18c15e640 2024-09-11T23:21:33.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.673+0000 7fa191e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa18c15ea20 con 0x7fa18c0b7750 2024-09-11T23:21:33.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.673+0000 7fa191e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa18c06caf0 con 0x7fa18c0b5fd0 2024-09-11T23:21:33.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.674+0000 7fa191400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa18c0b7750 0x7fa18c0b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:33.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.674+0000 7fa190a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa18c15e640 0x7fa18c0d3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46874/0 (socket says 172.21.15.144:46874) 2024-09-11T23:21:33.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.674+0000 7fa190a00640 1 -- 172.21.15.144:0/3921321044 learned_addr learned my addr 172.21.15.144:0/3921321044 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:33.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.674+0000 7fa183e00640 1 --2- 172.21.15.144:0/3921321044 >> v2:172.21.15.165:3300/0 conn(0x7fa18c0b5fd0 0x7fa18c0b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:33.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.674+0000 7fa191400640 1 -- 172.21.15.144:0/3921321044 >> v2:172.21.15.165:3300/0 conn(0x7fa18c0b5fd0 msgr2=0x7fa18c0b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:33.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.674+0000 7fa191400640 1 --2- 172.21.15.144:0/3921321044 >> v2:172.21.15.165:3300/0 conn(0x7fa18c0b5fd0 0x7fa18c0b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:33.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.674+0000 7fa191400640 1 -- 172.21.15.144:0/3921321044 >> v1:172.21.15.144:6789/0 conn(0x7fa18c15e640 legacy=0x7fa18c0d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:33.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.674+0000 7fa191400640 1 -- 172.21.15.144:0/3921321044 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18c06c1c0 con 0x7fa18c0b7750 2024-09-11T23:21:33.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.674+0000 7fa18be00640 1 -- 172.21.15.144:0/3921321044 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2595294619 0 0) 0x7fa18c06bee0 con 0x7fa18c15e640 2024-09-11T23:21:33.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.674+0000 7fa183e00640 1 --2- 172.21.15.144:0/3921321044 >> v2:172.21.15.165:3300/0 conn(0x7fa18c0b5fd0 0x7fa18c0b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:33.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.675+0000 7fa191400640 1 --2- 172.21.15.144:0/3921321044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa18c0b7750 0x7fa18c0b7be0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0d0fa0 tx=0x7fa18402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a81f2ade8e6a89 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:33.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.675+0000 7fa18be00640 1 -- 172.21.15.144:0/3921321044 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184007740 con 0x7fa18c0b7750 2024-09-11T23:21:33.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.675+0000 7fa18be00640 1 -- 172.21.15.144:0/3921321044 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1840078e0 con 0x7fa18c0b7750 2024-09-11T23:21:33.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.675+0000 7fa18be00640 1 -- 172.21.15.144:0/3921321044 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184007cb0 con 0x7fa18c0b7750 2024-09-11T23:21:33.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.676+0000 7fa191e00640 1 -- 172.21.15.144:0/3921321044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa18c0b7750 msgr2=0x7fa18c0b7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:33.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.676+0000 7fa191e00640 1 --2- 172.21.15.144:0/3921321044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa18c0b7750 0x7fa18c0b7be0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0d0fa0 tx=0x7fa18402a680 comp rx=0 tx=0).stop 2024-09-11T23:21:33.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.676+0000 7fa191e00640 1 -- 172.21.15.144:0/3921321044 shutdown_connections 2024-09-11T23:21:33.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.676+0000 7fa191e00640 1 --2- 172.21.15.144:0/3921321044 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa18c0b7750 0x7fa18c0b7be0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:33.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.676+0000 7fa191e00640 1 --2- 172.21.15.144:0/3921321044 >> v2:172.21.15.165:3300/0 conn(0x7fa18c0b5fd0 0x7fa18c0b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:33.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.676+0000 7fa191e00640 1 -- 172.21.15.144:0/3921321044 >> 172.21.15.144:0/3921321044 conn(0x7fa18c0d0fd0 msgr2=0x7fa18c0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:33.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.676+0000 7fa191e00640 1 -- 172.21.15.144:0/3921321044 shutdown_connections 2024-09-11T23:21:33.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.676+0000 7fa191e00640 1 -- 172.21.15.144:0/3921321044 wait complete. 2024-09-11T23:21:33.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.678+0000 7fa191e00640 1 Processor -- start 2024-09-11T23:21:33.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.678+0000 7fa191e00640 1 -- start start 2024-09-11T23:21:33.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.679+0000 7fa191e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa18c0b5fd0 0x7fa18c155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:33.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.679+0000 7fa191e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa18c0b7750 0x7fa18c0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:33.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.679+0000 7fa191e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa18c15e640 0x7fa18c0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:33.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.679+0000 7fa191e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c06c780 con 0x7fa18c0b7750 2024-09-11T23:21:33.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.679+0000 7fa191e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c0b6950 con 0x7fa18c15e640 2024-09-11T23:21:33.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.679+0000 7fa191e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa18c0d4130 con 0x7fa18c0b5fd0 2024-09-11T23:21:33.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.679+0000 7fa183e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa18c0b7750 0x7fa18c0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:33.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.679+0000 7fa183e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa18c0b7750 0x7fa18c0b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41916/0 (socket says 172.21.15.144:41916) 2024-09-11T23:21:33.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.679+0000 7fa183e00640 1 -- 172.21.15.144:0/1749168816 learned_addr learned my addr 172.21.15.144:0/1749168816 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:33.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.679+0000 7fa190a00640 1 --2- 172.21.15.144:0/1749168816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa18c0b5fd0 0x7fa18c155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:33.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.679+0000 7fa191400640 1 --2- 172.21.15.144:0/1749168816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa18c15e640 0x7fa18c0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:33.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.679+0000 7fa183e00640 1 -- 172.21.15.144:0/1749168816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa18c0b5fd0 msgr2=0x7fa18c155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:33.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.679+0000 7fa183e00640 1 --2- 172.21.15.144:0/1749168816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa18c0b5fd0 0x7fa18c155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:33.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.679+0000 7fa183e00640 1 -- 172.21.15.144:0/1749168816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa18c15e640 msgr2=0x7fa18c0b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:33.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.679+0000 7fa183e00640 1 --2- 172.21.15.144:0/1749168816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa18c15e640 0x7fa18c0b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:33.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.679+0000 7fa183e00640 1 -- 172.21.15.144:0/1749168816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18c0cc1d0 con 0x7fa18c0b7750 2024-09-11T23:21:33.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.679+0000 7fa191400640 1 --2- 172.21.15.144:0/1749168816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa18c15e640 0x7fa18c0b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:33.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.680+0000 7fa183e00640 1 --2- 172.21.15.144:0/1749168816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa18c0b7750 0x7fa18c0b49a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa17400c7f0 tx=0x7fa17400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:33.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.680+0000 7fa189600640 1 -- 172.21.15.144:0/1749168816 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174015070 con 0x7fa18c0b7750 2024-09-11T23:21:33.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.680+0000 7fa189600640 1 -- 172.21.15.144:0/1749168816 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa174007820 con 0x7fa18c0b7750 2024-09-11T23:21:33.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.680+0000 7fa191e00640 1 -- 172.21.15.144:0/1749168816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa18c0cc4b0 con 0x7fa18c0b7750 2024-09-11T23:21:33.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.680+0000 7fa189600640 1 -- 172.21.15.144:0/1749168816 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174007bd0 con 0x7fa18c0b7750 2024-09-11T23:21:33.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.680+0000 7fa191e00640 1 -- 172.21.15.144:0/1749168816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa18c0cca70 con 0x7fa18c0b7750 2024-09-11T23:21:33.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.681+0000 7fa191e00640 1 -- 172.21.15.144:0/1749168816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa18c156d70 con 0x7fa18c0b7750 2024-09-11T23:21:33.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.682+0000 7fa189600640 1 -- 172.21.15.144:0/1749168816 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7fa174018070 con 0x7fa18c0b7750 2024-09-11T23:21:33.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.683+0000 7fa189600640 1 --2- 172.21.15.144:0/1749168816 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa16806c190 0x7fa16806e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:33.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.683+0000 7fa189600640 1 -- 172.21.15.144:0/1749168816 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fa17408b5b0 con 0x7fa18c0b7750 2024-09-11T23:21:33.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.683+0000 7fa190a00640 1 --2- 172.21.15.144:0/1749168816 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa16806c190 0x7fa16806e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:33.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.684+0000 7fa190a00640 1 --2- 172.21.15.144:0/1749168816 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa16806c190 0x7fa16806e650 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa17c000f60 tx=0x7fa17c007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:33.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.688+0000 7fa189600640 1 -- 172.21.15.144:0/1749168816 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa1740593b0 con 0x7fa18c0b7750 2024-09-11T23:21:33.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.898+0000 7fa191e00640 1 -- 172.21.15.144:0/1749168816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa18c0d3bc0 con 0x7fa18c0b7750 2024-09-11T23:21:33.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.899+0000 7fa189600640 1 -- 172.21.15.144:0/1749168816 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5235 (secure 0 0 0) 0x7fa17405d6b0 con 0x7fa18c0b7750 2024-09-11T23:21:33.899 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:33.899 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":36,"btime":"2024-09-11T23:21:14:274694+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2161458369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2161458369},{"type":"v1","addr":"172.21.15.144:6836","nonce":2161458369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5150,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/2242935376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2242935376},{"type":"v1","addr":"172.21.15.165:6833","nonce":2242935376}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5156,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3703078361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3703078361},{"type":"v1","addr":"172.21.15.165:6835","nonce":3703078361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:20:58.860267+0000","modified":"2024-09-11T23:21:01.888764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1648435689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1648435689},{"type":"v1","addr":"172.21.15.144:6837","nonce":1648435689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5667,"qdb_cluster":[5667]},"id":4}]} 2024-09-11T23:21:33.899 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 36 2024-09-11T23:21:33.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.901+0000 7fa191e00640 1 -- 172.21.15.144:0/1749168816 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa16806c190 msgr2=0x7fa16806e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:33.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.901+0000 7fa191e00640 1 --2- 172.21.15.144:0/1749168816 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa16806c190 0x7fa16806e650 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa17c000f60 tx=0x7fa17c007d50 comp rx=0 tx=0).stop 2024-09-11T23:21:33.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.901+0000 7fa191e00640 1 -- 172.21.15.144:0/1749168816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa18c0b7750 msgr2=0x7fa18c0b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:33.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.901+0000 7fa191e00640 1 --2- 172.21.15.144:0/1749168816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa18c0b7750 0x7fa18c0b49a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa17400c7f0 tx=0x7fa17400ccb0 comp rx=0 tx=0).stop 2024-09-11T23:21:33.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.901+0000 7fa191e00640 1 -- 172.21.15.144:0/1749168816 shutdown_connections 2024-09-11T23:21:33.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.901+0000 7fa191e00640 1 --2- 172.21.15.144:0/1749168816 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa16806c190 0x7fa16806e650 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:33.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.901+0000 7fa191e00640 1 --2- 172.21.15.144:0/1749168816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa18c15e640 0x7fa18c0b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:33.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.901+0000 7fa191e00640 1 --2- 172.21.15.144:0/1749168816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa18c0b7750 0x7fa18c0b49a0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:33.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.901+0000 7fa191e00640 1 --2- 172.21.15.144:0/1749168816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa18c0b5fd0 0x7fa18c155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:33.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.901+0000 7fa191e00640 1 -- 172.21.15.144:0/1749168816 >> 172.21.15.144:0/1749168816 conn(0x7fa18c0d0fd0 msgr2=0x7fa18c0cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:33.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.901+0000 7fa191e00640 1 -- 172.21.15.144:0/1749168816 shutdown_connections 2024-09-11T23:21:33.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:33.901+0000 7fa191e00640 1 -- 172.21.15.144:0/1749168816 wait complete. 2024-09-11T23:21:33.917 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:21:34.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.070+0000 7fbc1ca00640 1 Processor -- start 2024-09-11T23:21:34.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.070+0000 7fbc1ca00640 1 -- start start 2024-09-11T23:21:34.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.071+0000 7fbc1ca00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbc1815e860 0x7fbc180cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:34.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.071+0000 7fbc1ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbc180b8ab0 0x7fbc180b6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:34.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.071+0000 7fbc1ca00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc180d34d0 con 0x7fbc180b61f0 2024-09-11T23:21:34.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.071+0000 7fbc1ca00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fbc180b6b80 con 0x7fbc180b8ab0 2024-09-11T23:21:34.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.071+0000 7fbc1ca00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fbc180d3790 con 0x7fbc1815e860 2024-09-11T23:21:34.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.071+0000 7fbc15400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbc180b61f0 0x7fbc1806c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:46882/0 (socket says 172.21.15.144:46882) 2024-09-11T23:21:34.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.071+0000 7fbc15400640 1 -- 172.21.15.144:0/2686133247 learned_addr learned my addr 172.21.15.144:0/2686133247 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:34.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.071+0000 7fbc16800640 1 --2- 172.21.15.144:0/2686133247 >> v2:172.21.15.144:3300/0 conn(0x7fbc180b8ab0 0x7fbc180b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:34.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.072+0000 7fbc15e00640 1 --2- 172.21.15.144:0/2686133247 >> v2:172.21.15.165:3300/0 conn(0x7fbc1815e860 0x7fbc180cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:34.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.072+0000 7fbc16800640 1 -- 172.21.15.144:0/2686133247 >> v2:172.21.15.165:3300/0 conn(0x7fbc1815e860 msgr2=0x7fbc180cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:34.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.072+0000 7fbc16800640 1 --2- 172.21.15.144:0/2686133247 >> v2:172.21.15.165:3300/0 conn(0x7fbc1815e860 0x7fbc180cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.072+0000 7fbc16800640 1 -- 172.21.15.144:0/2686133247 >> v1:172.21.15.144:6789/0 conn(0x7fbc180b61f0 legacy=0x7fbc1806c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:34.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.072+0000 7fbc16800640 1 -- 172.21.15.144:0/2686133247 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc180d3a70 con 0x7fbc180b8ab0 2024-09-11T23:21:34.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.072+0000 7fbc14a00640 1 -- 172.21.15.144:0/2686133247 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4059173848 0 0) 0x7fbc180d34d0 con 0x7fbc180b61f0 2024-09-11T23:21:34.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.073+0000 7fbc16800640 1 --2- 172.21.15.144:0/2686133247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc180b8ab0 0x7fbc180b6640 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fbc1808d900 tx=0x7fbc1002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3ffc74beb04d6e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:34.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.073+0000 7fbc14a00640 1 -- 172.21.15.144:0/2686133247 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc10007740 con 0x7fbc180b8ab0 2024-09-11T23:21:34.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.073+0000 7fbc14a00640 1 -- 172.21.15.144:0/2686133247 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc100078e0 con 0x7fbc180b8ab0 2024-09-11T23:21:34.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.073+0000 7fbc14a00640 1 -- 172.21.15.144:0/2686133247 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc10007cb0 con 0x7fbc180b8ab0 2024-09-11T23:21:34.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.074+0000 7fbc1ca00640 1 -- 172.21.15.144:0/2686133247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc180b8ab0 msgr2=0x7fbc180b6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:34.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.074+0000 7fbc1ca00640 1 --2- 172.21.15.144:0/2686133247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc180b8ab0 0x7fbc180b6640 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fbc1808d900 tx=0x7fbc1002a710 comp rx=0 tx=0).stop 2024-09-11T23:21:34.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.074+0000 7fbc1ca00640 1 -- 172.21.15.144:0/2686133247 shutdown_connections 2024-09-11T23:21:34.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.074+0000 7fbc1ca00640 1 --2- 172.21.15.144:0/2686133247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc180b8ab0 0x7fbc180b6640 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.074+0000 7fbc1ca00640 1 --2- 172.21.15.144:0/2686133247 >> v2:172.21.15.165:3300/0 conn(0x7fbc1815e860 0x7fbc180cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.074+0000 7fbc1ca00640 1 -- 172.21.15.144:0/2686133247 >> 172.21.15.144:0/2686133247 conn(0x7fbc18062c60 msgr2=0x7fbc180d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:34.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.074+0000 7fbc1ca00640 1 -- 172.21.15.144:0/2686133247 shutdown_connections 2024-09-11T23:21:34.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.074+0000 7fbc1ca00640 1 -- 172.21.15.144:0/2686133247 wait complete. 2024-09-11T23:21:34.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.076+0000 7fbc1ca00640 1 Processor -- start 2024-09-11T23:21:34.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.076+0000 7fbc1ca00640 1 -- start start 2024-09-11T23:21:34.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.076+0000 7fbc1ca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc180b61f0 0x7fbc180cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:34.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.076+0000 7fbc1ca00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc180b8ab0 0x7fbc180b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:34.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.077+0000 7fbc1ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc1815e860 0x7fbc180b5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:34.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.077+0000 7fbc1ca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbc180d4310 con 0x7fbc1815e860 2024-09-11T23:21:34.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.077+0000 7fbc1ca00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbc180d4030 con 0x7fbc180b8ab0 2024-09-11T23:21:34.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.077+0000 7fbc1ca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbc1815ec40 con 0x7fbc180b61f0 2024-09-11T23:21:34.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.077+0000 7fbc16800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc1815e860 0x7fbc180b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:34.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.077+0000 7fbc16800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc1815e860 0x7fbc180b5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41938/0 (socket says 172.21.15.144:41938) 2024-09-11T23:21:34.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.077+0000 7fbc16800640 1 -- 172.21.15.144:0/2200298511 learned_addr learned my addr 172.21.15.144:0/2200298511 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:34.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.077+0000 7fbc15400640 1 --2- 172.21.15.144:0/2200298511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc180b8ab0 0x7fbc180b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:34.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.077+0000 7fbc15e00640 1 --2- 172.21.15.144:0/2200298511 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc180b61f0 0x7fbc180cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:34.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.077+0000 7fbc16800640 1 -- 172.21.15.144:0/2200298511 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc180b61f0 msgr2=0x7fbc180cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:34.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.077+0000 7fbc16800640 1 --2- 172.21.15.144:0/2200298511 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc180b61f0 0x7fbc180cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.077+0000 7fbc16800640 1 -- 172.21.15.144:0/2200298511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc180b8ab0 msgr2=0x7fbc180b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:34.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.077+0000 7fbc16800640 1 --2- 172.21.15.144:0/2200298511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc180b8ab0 0x7fbc180b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.077+0000 7fbc16800640 1 -- 172.21.15.144:0/2200298511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc180c85b0 con 0x7fbc1815e860 2024-09-11T23:21:34.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.077+0000 7fbc15400640 1 --2- 172.21.15.144:0/2200298511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc180b8ab0 0x7fbc180b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:34.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.077+0000 7fbc16800640 1 --2- 172.21.15.144:0/2200298511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc1815e860 0x7fbc180b5850 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fbc10009e80 tx=0x7fbc10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:34.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.078+0000 7fbc0e000640 1 -- 172.21.15.144:0/2200298511 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc10040070 con 0x7fbc1815e860 2024-09-11T23:21:34.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.078+0000 7fbc0e000640 1 -- 172.21.15.144:0/2200298511 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc10031c40 con 0x7fbc1815e860 2024-09-11T23:21:34.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.078+0000 7fbc0e000640 1 -- 172.21.15.144:0/2200298511 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc10009450 con 0x7fbc1815e860 2024-09-11T23:21:34.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.078+0000 7fbc1ca00640 1 -- 172.21.15.144:0/2200298511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc180c8890 con 0x7fbc1815e860 2024-09-11T23:21:34.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.078+0000 7fbc1ca00640 1 -- 172.21.15.144:0/2200298511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc180c8e50 con 0x7fbc1815e860 2024-09-11T23:21:34.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.079+0000 7fbc1ca00640 1 -- 172.21.15.144:0/2200298511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc180b3ad0 con 0x7fbc1815e860 2024-09-11T23:21:34.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.080+0000 7fbc0e000640 1 -- 172.21.15.144:0/2200298511 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7fbc10039040 con 0x7fbc1815e860 2024-09-11T23:21:34.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.081+0000 7fbc0e000640 1 --2- 172.21.15.144:0/2200298511 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbbf806c190 0x7fbbf806e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:34.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.081+0000 7fbc0e000640 1 -- 172.21.15.144:0/2200298511 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fbc100ac6c0 con 0x7fbc1815e860 2024-09-11T23:21:34.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.081+0000 7fbc15e00640 1 --2- 172.21.15.144:0/2200298511 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbbf806c190 0x7fbbf806e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:34.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.082+0000 7fbc15e00640 1 --2- 172.21.15.144:0/2200298511 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbbf806c190 0x7fbbf806e650 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbc08006fd0 tx=0x7fbc08008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:34.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.085+0000 7fbc0e000640 1 -- 172.21.15.144:0/2200298511 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbc1007abc0 con 0x7fbc1815e860 2024-09-11T23:21:34.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.294+0000 7fbc1ca00640 1 -- 172.21.15.144:0/2200298511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc180d2700 con 0x7fbc1815e860 2024-09-11T23:21:34.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.295+0000 7fbc0e000640 1 -- 172.21.15.144:0/2200298511 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5235 (secure 0 0 0) 0x7fbc1007a4c0 con 0x7fbc1815e860 2024-09-11T23:21:34.295 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:34.295 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":36,"btime":"2024-09-11T23:21:14:274694+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2161458369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2161458369},{"type":"v1","addr":"172.21.15.144:6836","nonce":2161458369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5150,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/2242935376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2242935376},{"type":"v1","addr":"172.21.15.165:6833","nonce":2242935376}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5156,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3703078361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3703078361},{"type":"v1","addr":"172.21.15.165:6835","nonce":3703078361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:20:58.860267+0000","modified":"2024-09-11T23:21:01.888764+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6837/1648435689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":1648435689},{"type":"v1","addr":"172.21.15.144:6837","nonce":1648435689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5667,"qdb_cluster":[5667]},"id":4}]} 2024-09-11T23:21:34.295 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 36 2024-09-11T23:21:34.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.297+0000 7fbc1ca00640 1 -- 172.21.15.144:0/2200298511 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbbf806c190 msgr2=0x7fbbf806e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:34.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.297+0000 7fbc1ca00640 1 --2- 172.21.15.144:0/2200298511 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbbf806c190 0x7fbbf806e650 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbc08006fd0 tx=0x7fbc08008040 comp rx=0 tx=0).stop 2024-09-11T23:21:34.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.297+0000 7fbc1ca00640 1 -- 172.21.15.144:0/2200298511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc1815e860 msgr2=0x7fbc180b5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:34.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.297+0000 7fbc1ca00640 1 --2- 172.21.15.144:0/2200298511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc1815e860 0x7fbc180b5850 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fbc10009e80 tx=0x7fbc10004a40 comp rx=0 tx=0).stop 2024-09-11T23:21:34.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.297+0000 7fbc1ca00640 1 -- 172.21.15.144:0/2200298511 shutdown_connections 2024-09-11T23:21:34.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.297+0000 7fbc1ca00640 1 --2- 172.21.15.144:0/2200298511 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fbbf806c190 0x7fbbf806e650 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.297+0000 7fbc1ca00640 1 --2- 172.21.15.144:0/2200298511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc1815e860 0x7fbc180b5850 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.297+0000 7fbc1ca00640 1 --2- 172.21.15.144:0/2200298511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc180b8ab0 0x7fbc180b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.297+0000 7fbc1ca00640 1 --2- 172.21.15.144:0/2200298511 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbc180b61f0 0x7fbc180cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.297+0000 7fbc1ca00640 1 -- 172.21.15.144:0/2200298511 >> 172.21.15.144:0/2200298511 conn(0x7fbc18062c60 msgr2=0x7fbc180b8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:34.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.297+0000 7fbc1ca00640 1 -- 172.21.15.144:0/2200298511 shutdown_connections 2024-09-11T23:21:34.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.298+0000 7fbc1ca00640 1 -- 172.21.15.144:0/2200298511 wait complete. 2024-09-11T23:21:34.313 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:21:34.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.468+0000 7fccdba00640 1 Processor -- start 2024-09-11T23:21:34.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.468+0000 7fccdba00640 1 -- start start 2024-09-11T23:21:34.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.470+0000 7fccdba00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fccd415c180 0x7fccd40cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:34.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.470+0000 7fccdba00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccd40ce230 0x7fccd40cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:34.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.470+0000 7fccdba00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccd40ce740 con 0x7fccd40cf5b0 2024-09-11T23:21:34.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.470+0000 7fccdba00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fccd4072640 con 0x7fccd415c180 2024-09-11T23:21:34.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.470+0000 7fccdba00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fccd4072920 con 0x7fccd40ce230 2024-09-11T23:21:34.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.470+0000 7fccd9000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fccd415c180 0x7fccd40cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:34.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.470+0000 7fccd9000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fccd415c180 0x7fccd40cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37206/0 (socket says 172.21.15.144:37206) 2024-09-11T23:21:34.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.470+0000 7fccd9000640 1 -- 172.21.15.144:0/1313264426 learned_addr learned my addr 172.21.15.144:0/1313264426 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:34.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.470+0000 7fccd9000640 1 -- 172.21.15.144:0/1313264426 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccd40ce230 msgr2=0x7fccd40cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:34.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.470+0000 7fcccbe00640 1 --2- 172.21.15.144:0/1313264426 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccd40ce230 0x7fccd40cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:34.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.470+0000 7fccd9000640 1 --2- 172.21.15.144:0/1313264426 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccd40ce230 0x7fccd40cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.470+0000 7fccd9000640 1 -- 172.21.15.144:0/1313264426 >> v1:172.21.15.165:6789/0 conn(0x7fccd40cf5b0 legacy=0x7fccd4073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:34.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.470+0000 7fccd9000640 1 -- 172.21.15.144:0/1313264426 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd4072c00 con 0x7fccd415c180 2024-09-11T23:21:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.470+0000 7fcccbe00640 1 --2- 172.21.15.144:0/1313264426 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccd40ce230 0x7fccd40cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.471+0000 7fccd9000640 1 --2- 172.21.15.144:0/1313264426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd415c180 0x7fccd40cdcf0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fccc4009870 tx=0x7fccc402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2138bc6ba33b85 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.472+0000 7fccd3e00640 1 -- 172.21.15.144:0/1313264426 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc4037070 con 0x7fccd415c180 2024-09-11T23:21:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.472+0000 7fccd3e00640 1 -- 172.21.15.144:0/1313264426 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc4032440 con 0x7fccd415c180 2024-09-11T23:21:34.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.472+0000 7fccd3e00640 1 -- 172.21.15.144:0/1313264426 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc4032810 con 0x7fccd415c180 2024-09-11T23:21:34.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.472+0000 7fccdba00640 1 -- 172.21.15.144:0/1313264426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd415c180 msgr2=0x7fccd40cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:34.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.472+0000 7fccdba00640 1 --2- 172.21.15.144:0/1313264426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd415c180 0x7fccd40cdcf0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fccc4009870 tx=0x7fccc402a180 comp rx=0 tx=0).stop 2024-09-11T23:21:34.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.472+0000 7fccdba00640 1 -- 172.21.15.144:0/1313264426 shutdown_connections 2024-09-11T23:21:34.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.472+0000 7fccdba00640 1 --2- 172.21.15.144:0/1313264426 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccd40ce230 0x7fccd40cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.472+0000 7fccdba00640 1 --2- 172.21.15.144:0/1313264426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd415c180 0x7fccd40cdcf0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.472+0000 7fccdba00640 1 -- 172.21.15.144:0/1313264426 >> 172.21.15.144:0/1313264426 conn(0x7fccd4062cc0 msgr2=0x7fccd406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:34.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.472+0000 7fccdba00640 1 -- 172.21.15.144:0/1313264426 shutdown_connections 2024-09-11T23:21:34.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.472+0000 7fccdba00640 1 -- 172.21.15.144:0/1313264426 wait complete. 2024-09-11T23:21:34.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.474+0000 7fccdba00640 1 Processor -- start 2024-09-11T23:21:34.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.474+0000 7fccdba00640 1 -- start start 2024-09-11T23:21:34.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.475+0000 7fccdba00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccd40ce230 0x7fccd4148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:34.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.475+0000 7fccdba00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd40cf5b0 0x7fccd40b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:34.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.475+0000 7fccdba00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccd415c180 0x7fccd415a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:34.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.475+0000 7fccdba00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fccd415c560 con 0x7fccd40cf5b0 2024-09-11T23:21:34.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.475+0000 7fccdba00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fccd40722f0 con 0x7fccd40ce230 2024-09-11T23:21:34.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.475+0000 7fccdba00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fccd415c6e0 con 0x7fccd415c180 2024-09-11T23:21:34.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.475+0000 7fcccbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd40cf5b0 0x7fccd40b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:34.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.475+0000 7fcccbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd40cf5b0 0x7fccd40b4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37216/0 (socket says 172.21.15.144:37216) 2024-09-11T23:21:34.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.475+0000 7fcccbe00640 1 -- 172.21.15.144:0/432446176 learned_addr learned my addr 172.21.15.144:0/432446176 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:34.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.475+0000 7fccd9000640 1 --2- 172.21.15.144:0/432446176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccd40ce230 0x7fccd4148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:34.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.475+0000 7fccd9a00640 1 --2- 172.21.15.144:0/432446176 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccd415c180 0x7fccd415a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:34.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.476+0000 7fcccbe00640 1 -- 172.21.15.144:0/432446176 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccd415c180 msgr2=0x7fccd415a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:34.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.476+0000 7fcccbe00640 1 --2- 172.21.15.144:0/432446176 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccd415c180 0x7fccd415a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.476+0000 7fcccbe00640 1 -- 172.21.15.144:0/432446176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccd40ce230 msgr2=0x7fccd4148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:34.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.476+0000 7fcccbe00640 1 --2- 172.21.15.144:0/432446176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccd40ce230 0x7fccd4148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.476+0000 7fcccbe00640 1 -- 172.21.15.144:0/432446176 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd41491b0 con 0x7fccd40cf5b0 2024-09-11T23:21:34.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.476+0000 7fcccbe00640 1 --2- 172.21.15.144:0/432446176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd40cf5b0 0x7fccd40b4ab0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fccbc00c7f0 tx=0x7fccbc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:34.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.476+0000 7fccd1600640 1 -- 172.21.15.144:0/432446176 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc015070 con 0x7fccd40cf5b0 2024-09-11T23:21:34.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.476+0000 7fccd1600640 1 -- 172.21.15.144:0/432446176 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccbc007820 con 0x7fccd40cf5b0 2024-09-11T23:21:34.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.476+0000 7fccdba00640 1 -- 172.21.15.144:0/432446176 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccd40b39b0 con 0x7fccd40cf5b0 2024-09-11T23:21:34.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.476+0000 7fccd1600640 1 -- 172.21.15.144:0/432446176 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc007c10 con 0x7fccd40cf5b0 2024-09-11T23:21:34.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.476+0000 7fccdba00640 1 -- 172.21.15.144:0/432446176 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccd40b3f70 con 0x7fccd40cf5b0 2024-09-11T23:21:34.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.477+0000 7fccdba00640 1 -- 172.21.15.144:0/432446176 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccd40cf070 con 0x7fccd40cf5b0 2024-09-11T23:21:34.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.478+0000 7fccd1600640 1 -- 172.21.15.144:0/432446176 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7fccbc018070 con 0x7fccd40cf5b0 2024-09-11T23:21:34.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.479+0000 7fccd1600640 1 --2- 172.21.15.144:0/432446176 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fccb006c190 0x7fccb006e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:34.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.479+0000 7fccd1600640 1 -- 172.21.15.144:0/432446176 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fccbc08b510 con 0x7fccd40cf5b0 2024-09-11T23:21:34.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.479+0000 7fccd9000640 1 --2- 172.21.15.144:0/432446176 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fccb006c190 0x7fccb006e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:34.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.480+0000 7fccd9000640 1 --2- 172.21.15.144:0/432446176 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fccb006c190 0x7fccb006e650 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fccc4034000 tx=0x7fccc402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:34.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.484+0000 7fccd1600640 1 -- 172.21.15.144:0/432446176 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fccbc059310 con 0x7fccd40cf5b0 2024-09-11T23:21:34.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.660+0000 7fccdba00640 1 -- 172.21.15.144:0/432446176 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fccd40aff00 con 0x7fccd40cf5b0 2024-09-11T23:21:34.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.661+0000 7fccd1600640 1 -- 172.21.15.144:0/432446176 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16749 (secure 0 0 0) 0x7fccbc089e20 con 0x7fccd40cf5b0 2024-09-11T23:21:34.661 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:34.661 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":59,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:21:00.452382+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:20:56.632085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-11T23:20:57.855096+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:21:34.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.663+0000 7fccdba00640 1 -- 172.21.15.144:0/432446176 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fccb006c190 msgr2=0x7fccb006e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:34.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.663+0000 7fccdba00640 1 --2- 172.21.15.144:0/432446176 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fccb006c190 0x7fccb006e650 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fccc4034000 tx=0x7fccc402e000 comp rx=0 tx=0).stop 2024-09-11T23:21:34.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.663+0000 7fccdba00640 1 -- 172.21.15.144:0/432446176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd40cf5b0 msgr2=0x7fccd40b4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:34.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.663+0000 7fccdba00640 1 --2- 172.21.15.144:0/432446176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd40cf5b0 0x7fccd40b4ab0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fccbc00c7f0 tx=0x7fccbc00ccb0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.663+0000 7fccdba00640 1 -- 172.21.15.144:0/432446176 shutdown_connections 2024-09-11T23:21:34.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.663+0000 7fccdba00640 1 --2- 172.21.15.144:0/432446176 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fccb006c190 0x7fccb006e650 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.663+0000 7fccdba00640 1 --2- 172.21.15.144:0/432446176 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fccd415c180 0x7fccd415a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.663+0000 7fccdba00640 1 --2- 172.21.15.144:0/432446176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd40cf5b0 0x7fccd40b4ab0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.663+0000 7fccdba00640 1 --2- 172.21.15.144:0/432446176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fccd40ce230 0x7fccd4148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.663+0000 7fccdba00640 1 -- 172.21.15.144:0/432446176 >> 172.21.15.144:0/432446176 conn(0x7fccd4062cc0 msgr2=0x7fccd40b24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:34.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.664+0000 7fccdba00640 1 -- 172.21.15.144:0/432446176 shutdown_connections 2024-09-11T23:21:34.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.664+0000 7fccdba00640 1 -- 172.21.15.144:0/432446176 wait complete. 2024-09-11T23:21:34.680 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:21:34.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.834+0000 7f6b37200640 1 Processor -- start 2024-09-11T23:21:34.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.834+0000 7f6b37200640 1 -- start start 2024-09-11T23:21:34.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.836+0000 7f6b37200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6b3815e4f0 0x7f6b380cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:34.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.836+0000 7f6b37200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6b3806e8f0 0x7f6b380b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:34.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.836+0000 7f6b37200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b380d0070 con 0x7f6b380ce740 2024-09-11T23:21:34.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.836+0000 7f6b37200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6b380d12a0 con 0x7f6b3815e4f0 2024-09-11T23:21:34.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.836+0000 7f6b37200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6b380d1580 con 0x7f6b3806e8f0 2024-09-11T23:21:34.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.836+0000 7f6b35e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6b3815e4f0 0x7f6b380cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:34.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.836+0000 7f6b35e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6b3815e4f0 0x7f6b380cdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37228/0 (socket says 172.21.15.144:37228) 2024-09-11T23:21:34.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.836+0000 7f6b35e00640 1 -- 172.21.15.144:0/2570014729 learned_addr learned my addr 172.21.15.144:0/2570014729 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:34.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.836+0000 7f6b36800640 1 --2- 172.21.15.144:0/2570014729 >> v2:172.21.15.165:3300/0 conn(0x7f6b3806e8f0 0x7f6b380b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:34.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.836+0000 7f6b35e00640 1 -- 172.21.15.144:0/2570014729 >> v2:172.21.15.165:3300/0 conn(0x7f6b3806e8f0 msgr2=0x7f6b380b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:34.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.836+0000 7f6b35e00640 1 --2- 172.21.15.144:0/2570014729 >> v2:172.21.15.165:3300/0 conn(0x7f6b3806e8f0 0x7f6b380b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.836+0000 7f6b35e00640 1 -- 172.21.15.144:0/2570014729 >> v1:172.21.15.165:6789/0 conn(0x7f6b380ce740 legacy=0x7f6b3806e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:34.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.836+0000 7f6b35e00640 1 -- 172.21.15.144:0/2570014729 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b380d1860 con 0x7f6b3815e4f0 2024-09-11T23:21:34.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.837+0000 7f6b35e00640 1 --2- 172.21.15.144:0/2570014729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3815e4f0 0x7f6b380cdb60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6b3806c2f0 tx=0x7f6b2802a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2351b58e85870e38 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:34.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.838+0000 7f6b35400640 1 -- 172.21.15.144:0/2570014729 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b28037070 con 0x7f6b3815e4f0 2024-09-11T23:21:34.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.838+0000 7f6b35400640 1 -- 172.21.15.144:0/2570014729 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b28032440 con 0x7f6b3815e4f0 2024-09-11T23:21:34.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.838+0000 7f6b35400640 1 -- 172.21.15.144:0/2570014729 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b28032810 con 0x7f6b3815e4f0 2024-09-11T23:21:34.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.838+0000 7f6b37200640 1 -- 172.21.15.144:0/2570014729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3815e4f0 msgr2=0x7f6b380cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:34.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.838+0000 7f6b37200640 1 --2- 172.21.15.144:0/2570014729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3815e4f0 0x7f6b380cdb60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6b3806c2f0 tx=0x7f6b2802a1f0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.838+0000 7f6b37200640 1 -- 172.21.15.144:0/2570014729 shutdown_connections 2024-09-11T23:21:34.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.838+0000 7f6b37200640 1 --2- 172.21.15.144:0/2570014729 >> v2:172.21.15.165:3300/0 conn(0x7f6b3806e8f0 0x7f6b380b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.838+0000 7f6b37200640 1 --2- 172.21.15.144:0/2570014729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3815e4f0 0x7f6b380cdb60 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.838+0000 7f6b37200640 1 -- 172.21.15.144:0/2570014729 >> 172.21.15.144:0/2570014729 conn(0x7f6b380b6700 msgr2=0x7f6b380b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:34.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.838+0000 7f6b37200640 1 -- 172.21.15.144:0/2570014729 shutdown_connections 2024-09-11T23:21:34.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.838+0000 7f6b37200640 1 -- 172.21.15.144:0/2570014729 wait complete. 2024-09-11T23:21:34.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.840+0000 7f6b37200640 1 Processor -- start 2024-09-11T23:21:34.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.840+0000 7f6b37200640 1 -- start start 2024-09-11T23:21:34.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.841+0000 7f6b37200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3806e8f0 0x7f6b38160a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:34.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.841+0000 7f6b37200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b380ce740 0x7f6b381f3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:34.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.841+0000 7f6b37200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b3815e4f0 0x7f6b380b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:34.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.841+0000 7f6b37200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3815e8d0 con 0x7f6b3806e8f0 2024-09-11T23:21:34.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.841+0000 7f6b37200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6b380b4dd0 con 0x7f6b3815e4f0 2024-09-11T23:21:34.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.841+0000 7f6b37200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6b380b2070 con 0x7f6b380ce740 2024-09-11T23:21:34.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.841+0000 7f6b35e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3806e8f0 0x7f6b38160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:34.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.841+0000 7f6b35e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3806e8f0 0x7f6b38160a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37236/0 (socket says 172.21.15.144:37236) 2024-09-11T23:21:34.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.841+0000 7f6b35e00640 1 -- 172.21.15.144:0/182987165 learned_addr learned my addr 172.21.15.144:0/182987165 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:34.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.841+0000 7f6b36800640 1 --2- 172.21.15.144:0/182987165 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b3815e4f0 0x7f6b380b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:34.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.841+0000 7f6b2d400640 1 --2- 172.21.15.144:0/182987165 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b380ce740 0x7f6b381f3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:34.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.842+0000 7f6b35e00640 1 -- 172.21.15.144:0/182987165 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b380ce740 msgr2=0x7f6b381f3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:34.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.842+0000 7f6b35e00640 1 --2- 172.21.15.144:0/182987165 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b380ce740 0x7f6b381f3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.842+0000 7f6b35e00640 1 -- 172.21.15.144:0/182987165 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b3815e4f0 msgr2=0x7f6b380b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:34.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.842+0000 7f6b35e00640 1 --2- 172.21.15.144:0/182987165 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b3815e4f0 0x7f6b380b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:34.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.842+0000 7f6b35e00640 1 -- 172.21.15.144:0/182987165 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b381f4680 con 0x7f6b3806e8f0 2024-09-11T23:21:34.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.842+0000 7f6b36800640 1 --2- 172.21.15.144:0/182987165 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b3815e4f0 0x7f6b380b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:34.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.842+0000 7f6b35e00640 1 --2- 172.21.15.144:0/182987165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3806e8f0 0x7f6b38160a50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6b2802a230 tx=0x7f6b280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:34.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.842+0000 7f6b2ea00640 1 -- 172.21.15.144:0/182987165 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b28041020 con 0x7f6b3806e8f0 2024-09-11T23:21:34.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.842+0000 7f6b2ea00640 1 -- 172.21.15.144:0/182987165 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b280306c0 con 0x7f6b3806e8f0 2024-09-11T23:21:34.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.842+0000 7f6b37200640 1 -- 172.21.15.144:0/182987165 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b381f4960 con 0x7f6b3806e8f0 2024-09-11T23:21:34.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.842+0000 7f6b2ea00640 1 -- 172.21.15.144:0/182987165 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b28037040 con 0x7f6b3806e8f0 2024-09-11T23:21:34.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.842+0000 7f6b37200640 1 -- 172.21.15.144:0/182987165 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b38160f90 con 0x7f6b3806e8f0 2024-09-11T23:21:34.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.843+0000 7f6b37200640 1 -- 172.21.15.144:0/182987165 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b380b4890 con 0x7f6b3806e8f0 2024-09-11T23:21:34.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.844+0000 7f6b2ea00640 1 -- 172.21.15.144:0/182987165 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f6b28044020 con 0x7f6b3806e8f0 2024-09-11T23:21:34.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.845+0000 7f6b2ea00640 1 --2- 172.21.15.144:0/182987165 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6b1406c190 0x7f6b1406e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:34.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.845+0000 7f6b2ea00640 1 -- 172.21.15.144:0/182987165 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f6b280abc20 con 0x7f6b3806e8f0 2024-09-11T23:21:34.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.845+0000 7f6b2d400640 1 --2- 172.21.15.144:0/182987165 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6b1406c190 0x7f6b1406e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:34.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.846+0000 7f6b2d400640 1 --2- 172.21.15.144:0/182987165 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6b1406c190 0x7f6b1406e650 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6b20007fd0 tx=0x7f6b20009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:34.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:34.849+0000 7f6b2ea00640 1 -- 172.21.15.144:0/182987165 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b2804b030 con 0x7f6b3806e8f0 2024-09-11T23:21:35.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.057+0000 7f6b37200640 1 -- 172.21.15.144:0/182987165 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6b381f4b30 con 0x7f6b3806e8f0 2024-09-11T23:21:35.057 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-11T23:21:35.058+0000 7f86fcc00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:21:35.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.060+0000 7f6b2ea00640 1 -- 172.21.15.144:0/182987165 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) ==== 161+0+0 (secure 0 0 0) 0x7f6b2807a180 con 0x7f6b3806e8f0 2024-09-11T23:21:35.059 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:21:35.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.062+0000 7f6b37200640 1 -- 172.21.15.144:0/182987165 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6b1406c190 msgr2=0x7f6b1406e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:35.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.062+0000 7f6b37200640 1 --2- 172.21.15.144:0/182987165 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6b1406c190 0x7f6b1406e650 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6b20007fd0 tx=0x7f6b20009040 comp rx=0 tx=0).stop 2024-09-11T23:21:35.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.062+0000 7f6b37200640 1 -- 172.21.15.144:0/182987165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3806e8f0 msgr2=0x7f6b38160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:35.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.062+0000 7f6b37200640 1 --2- 172.21.15.144:0/182987165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3806e8f0 0x7f6b38160a50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6b2802a230 tx=0x7f6b280046c0 comp rx=0 tx=0).stop 2024-09-11T23:21:35.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.062+0000 7f6b37200640 1 -- 172.21.15.144:0/182987165 shutdown_connections 2024-09-11T23:21:35.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.062+0000 7f6b37200640 1 --2- 172.21.15.144:0/182987165 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f6b1406c190 0x7f6b1406e650 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:35.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.062+0000 7f6b37200640 1 --2- 172.21.15.144:0/182987165 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b3815e4f0 0x7f6b380b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:35.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.062+0000 7f6b37200640 1 --2- 172.21.15.144:0/182987165 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6b380ce740 0x7f6b381f3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:35.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.062+0000 7f6b37200640 1 --2- 172.21.15.144:0/182987165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b3806e8f0 0x7f6b38160a50 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:35.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.062+0000 7f6b37200640 1 -- 172.21.15.144:0/182987165 >> 172.21.15.144:0/182987165 conn(0x7f6b380b6700 msgr2=0x7f6b380b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:35.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.062+0000 7f6b37200640 1 -- 172.21.15.144:0/182987165 shutdown_connections 2024-09-11T23:21:35.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.063+0000 7f6b37200640 1 -- 172.21.15.144:0/182987165 wait complete. 2024-09-11T23:21:35.080 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:21:35.127 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-11T23:21:35.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.239+0000 7f1daee00640 1 Processor -- start 2024-09-11T23:21:35.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.239+0000 7f1daee00640 1 -- start start 2024-09-11T23:21:35.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.240+0000 7f1daee00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1da806ea00 0x7f1da80b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:35.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.240+0000 7f1daee00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1da815b470 0x7f1da815b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:35.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.240+0000 7f1daee00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1da8071de0 con 0x7f1da815b090 2024-09-11T23:21:35.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.240+0000 7f1daee00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1da80720c0 con 0x7f1da815b470 2024-09-11T23:21:35.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.240+0000 7f1daee00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1da80723a0 con 0x7f1da806ea00 2024-09-11T23:21:35.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.240+0000 7f1da7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1da815b090 0x7f1da80715b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58142/0 (socket says 172.21.15.144:58142) 2024-09-11T23:21:35.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.240+0000 7f1da7e00640 1 -- 172.21.15.144:0/2160720859 learned_addr learned my addr 172.21.15.144:0/2160720859 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:35.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.241+0000 7f1dace00640 1 --2- 172.21.15.144:0/2160720859 >> v2:172.21.15.165:3300/0 conn(0x7f1da815b470 0x7f1da815b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:35.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.241+0000 7f1da7400640 1 --2- 172.21.15.144:0/2160720859 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1da806ea00 0x7f1da80b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:35.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.241+0000 7f1da6a00640 1 -- 172.21.15.144:0/2160720859 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2866279402 0 0) 0x7f1da8071de0 con 0x7f1da815b090 2024-09-11T23:21:35.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.241+0000 7f1da6a00640 1 -- 172.21.15.144:0/2160720859 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d8c003520 con 0x7f1da815b090 2024-09-11T23:21:35.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.241+0000 7f1dace00640 1 -- 172.21.15.144:0/2160720859 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1da806ea00 msgr2=0x7f1da80b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:35.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.241+0000 7f1dace00640 1 --2- 172.21.15.144:0/2160720859 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1da806ea00 0x7f1da80b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:35.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.241+0000 7f1dace00640 1 -- 172.21.15.144:0/2160720859 >> v1:172.21.15.144:6789/0 conn(0x7f1da815b090 legacy=0x7f1da80715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:35.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.241+0000 7f1dace00640 1 -- 172.21.15.144:0/2160720859 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da8072680 con 0x7f1da815b470 2024-09-11T23:21:35.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.242+0000 7f1dace00640 1 --2- 172.21.15.144:0/2160720859 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1da815b470 0x7f1da815b8e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1da0009d90 tx=0x7f1da002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c043c477c12346bf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:35.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.242+0000 7f1da6a00640 1 -- 172.21.15.144:0/2160720859 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da0007740 con 0x7f1da815b470 2024-09-11T23:21:35.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.242+0000 7f1da6a00640 1 -- 172.21.15.144:0/2160720859 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da00078e0 con 0x7f1da815b470 2024-09-11T23:21:35.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.242+0000 7f1da6a00640 1 -- 172.21.15.144:0/2160720859 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da0007cb0 con 0x7f1da815b470 2024-09-11T23:21:35.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.243+0000 7f1daee00640 1 -- 172.21.15.144:0/2160720859 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1da815b470 msgr2=0x7f1da815b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:35.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.243+0000 7f1daee00640 1 --2- 172.21.15.144:0/2160720859 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1da815b470 0x7f1da815b8e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1da0009d90 tx=0x7f1da002a660 comp rx=0 tx=0).stop 2024-09-11T23:21:35.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.243+0000 7f1daee00640 1 -- 172.21.15.144:0/2160720859 shutdown_connections 2024-09-11T23:21:35.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.243+0000 7f1daee00640 1 --2- 172.21.15.144:0/2160720859 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1da815b470 0x7f1da815b8e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:35.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.243+0000 7f1daee00640 1 --2- 172.21.15.144:0/2160720859 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1da806ea00 0x7f1da80b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:35.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.243+0000 7f1daee00640 1 -- 172.21.15.144:0/2160720859 >> 172.21.15.144:0/2160720859 conn(0x7f1da806bba0 msgr2=0x7f1da806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:35.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.243+0000 7f1daee00640 1 -- 172.21.15.144:0/2160720859 shutdown_connections 2024-09-11T23:21:35.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.243+0000 7f1daee00640 1 -- 172.21.15.144:0/2160720859 wait complete. 2024-09-11T23:21:35.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.245+0000 7f1daee00640 1 Processor -- start 2024-09-11T23:21:35.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.245+0000 7f1daee00640 1 -- start start 2024-09-11T23:21:35.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.246+0000 7f1daee00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1da806ea00 0x7f1da8148470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:35.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.246+0000 7f1daee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da815b090 0x7f1da8143010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:35.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.246+0000 7f1daee00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1da815b470 0x7f1da8143860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:35.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.246+0000 7f1daee00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1da806d080 con 0x7f1da815b090 2024-09-11T23:21:35.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.246+0000 7f1daee00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1da815be20 con 0x7f1da806ea00 2024-09-11T23:21:35.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.246+0000 7f1daee00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1da806d200 con 0x7f1da815b470 2024-09-11T23:21:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.246+0000 7f1da7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da815b090 0x7f1da8143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.246+0000 7f1da7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da815b090 0x7f1da8143010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37272/0 (socket says 172.21.15.144:37272) 2024-09-11T23:21:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.246+0000 7f1da7400640 1 -- 172.21.15.144:0/702255762 learned_addr learned my addr 172.21.15.144:0/702255762 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.246+0000 7f1da7e00640 1 --2- 172.21.15.144:0/702255762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1da806ea00 0x7f1da8148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.246+0000 7f1dace00640 1 --2- 172.21.15.144:0/702255762 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1da815b470 0x7f1da8143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.246+0000 7f1da7400640 1 -- 172.21.15.144:0/702255762 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1da815b470 msgr2=0x7f1da8143860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.246+0000 7f1da7400640 1 --2- 172.21.15.144:0/702255762 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1da815b470 0x7f1da8143860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.246+0000 7f1da7400640 1 -- 172.21.15.144:0/702255762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1da806ea00 msgr2=0x7f1da8148470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.246+0000 7f1da7400640 1 --2- 172.21.15.144:0/702255762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1da806ea00 0x7f1da8148470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.246+0000 7f1da7400640 1 -- 172.21.15.144:0/702255762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da8149b60 con 0x7f1da815b090 2024-09-11T23:21:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.246+0000 7f1da7e00640 1 --2- 172.21.15.144:0/702255762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1da806ea00 0x7f1da8148470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.247+0000 7f1da7400640 1 --2- 172.21.15.144:0/702255762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da815b090 0x7f1da8143010 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400e900 tx=0x7f1d9400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.247+0000 7f1d9fe00640 1 -- 172.21.15.144:0/702255762 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d94017070 con 0x7f1da815b090 2024-09-11T23:21:35.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.247+0000 7f1d9fe00640 1 -- 172.21.15.144:0/702255762 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d9400ca00 con 0x7f1da815b090 2024-09-11T23:21:35.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.247+0000 7f1d9fe00640 1 -- 172.21.15.144:0/702255762 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9400cdd0 con 0x7f1da815b090 2024-09-11T23:21:35.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.247+0000 7f1daee00640 1 -- 172.21.15.144:0/702255762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da8146a10 con 0x7f1da815b090 2024-09-11T23:21:35.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.247+0000 7f1daee00640 1 -- 172.21.15.144:0/702255762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da8146fd0 con 0x7f1da815b090 2024-09-11T23:21:35.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.248+0000 7f1daee00640 1 -- 172.21.15.144:0/702255762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1da8069b00 con 0x7f1da815b090 2024-09-11T23:21:35.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.249+0000 7f1d9fe00640 1 -- 172.21.15.144:0/702255762 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f1d9401a070 con 0x7f1da815b090 2024-09-11T23:21:35.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.250+0000 7f1d9fe00640 1 --2- 172.21.15.144:0/702255762 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1d8806c130 0x7f1d8806e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:35.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.250+0000 7f1d9fe00640 1 -- 172.21.15.144:0/702255762 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5795+0+0 (secure 0 0 0) 0x7f1d9408b760 con 0x7f1da815b090 2024-09-11T23:21:35.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.250+0000 7f1da7e00640 1 --2- 172.21.15.144:0/702255762 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1d8806c130 0x7f1d8806e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:35.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.251+0000 7f1da7e00640 1 --2- 172.21.15.144:0/702255762 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1d8806c130 0x7f1d8806e5f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1d98007fd0 tx=0x7f1d98009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:35.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.254+0000 7f1d9fe00640 1 -- 172.21.15.144:0/702255762 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1da8069b00 con 0x7f1da815b090 2024-09-11T23:21:35.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:35.465+0000 7f1daee00640 1 -- 172.21.15.144:0/702255762 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1da806d580 con 0x7f1da815b090 2024-09-11T23:21:36.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.067+0000 7f1d9fe00640 1 -- 172.21.15.144:0/702255762 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) ==== 104+0+0 (secure 0 0 0) 0x7f1d94059d10 con 0x7f1da815b090 2024-09-11T23:21:36.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.070+0000 7f1daee00640 1 -- 172.21.15.144:0/702255762 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1d8806c130 msgr2=0x7f1d8806e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:36.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.070+0000 7f1daee00640 1 --2- 172.21.15.144:0/702255762 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1d8806c130 0x7f1d8806e5f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1d98007fd0 tx=0x7f1d98009040 comp rx=0 tx=0).stop 2024-09-11T23:21:36.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.070+0000 7f1daee00640 1 -- 172.21.15.144:0/702255762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da815b090 msgr2=0x7f1da8143010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:36.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.070+0000 7f1daee00640 1 --2- 172.21.15.144:0/702255762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da815b090 0x7f1da8143010 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400e900 tx=0x7f1d9400edc0 comp rx=0 tx=0).stop 2024-09-11T23:21:36.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.070+0000 7f1daee00640 1 -- 172.21.15.144:0/702255762 shutdown_connections 2024-09-11T23:21:36.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.070+0000 7f1daee00640 1 --2- 172.21.15.144:0/702255762 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1d8806c130 0x7f1d8806e5f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:36.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.070+0000 7f1daee00640 1 --2- 172.21.15.144:0/702255762 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1da815b470 0x7f1da8143860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:36.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.070+0000 7f1daee00640 1 --2- 172.21.15.144:0/702255762 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1da815b090 0x7f1da8143010 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:36.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.070+0000 7f1daee00640 1 --2- 172.21.15.144:0/702255762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1da806ea00 0x7f1da8148470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:36.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.070+0000 7f1daee00640 1 -- 172.21.15.144:0/702255762 >> 172.21.15.144:0/702255762 conn(0x7f1da806bba0 msgr2=0x7f1da80b4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:36.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.070+0000 7f1daee00640 1 -- 172.21.15.144:0/702255762 shutdown_connections 2024-09-11T23:21:36.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.070+0000 7f1daee00640 1 -- 172.21.15.144:0/702255762 wait complete. 2024-09-11T23:21:36.088 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:21:36.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.247+0000 7f4738800640 1 Processor -- start 2024-09-11T23:21:36.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.247+0000 7f4738800640 1 -- start start 2024-09-11T23:21:36.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.248+0000 7f4738800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4730161d70 0x7f473015fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:36.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.248+0000 7f4738800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f47300b61d0 0x7f47300b6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:36.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.248+0000 7f4738800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f473015eeb0 0x7f473015f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:36.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.248+0000 7f4738800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f47300b6b70 con 0x7f4730161d70 2024-09-11T23:21:36.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.248+0000 7f4738800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f473015fc30 con 0x7f47300b61d0 2024-09-11T23:21:36.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.248+0000 7f4738800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f47300d28d0 con 0x7f473015eeb0 2024-09-11T23:21:36.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.248+0000 7f4735e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4730161d70 0x7f473015fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:36.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.248+0000 7f4735e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4730161d70 0x7f473015fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37274/0 (socket says 172.21.15.144:37274) 2024-09-11T23:21:36.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.248+0000 7f4735e00640 1 -- 172.21.15.144:0/321564354 learned_addr learned my addr 172.21.15.144:0/321564354 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:36.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.249+0000 7f4736800640 1 --2- 172.21.15.144:0/321564354 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f473015eeb0 0x7f473015f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:36.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.249+0000 7f4735400640 1 --2- 172.21.15.144:0/321564354 >> v2:172.21.15.165:3300/0 conn(0x7f47300b61d0 0x7f47300b6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:36.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.249+0000 7f4735e00640 1 -- 172.21.15.144:0/321564354 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f473015eeb0 msgr2=0x7f473015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:36.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.249+0000 7f4735e00640 1 --2- 172.21.15.144:0/321564354 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f473015eeb0 0x7f473015f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:36.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.249+0000 7f4735e00640 1 -- 172.21.15.144:0/321564354 >> v2:172.21.15.165:3300/0 conn(0x7f47300b61d0 msgr2=0x7f47300b6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:36.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.249+0000 7f4735e00640 1 --2- 172.21.15.144:0/321564354 >> v2:172.21.15.165:3300/0 conn(0x7f47300b61d0 0x7f47300b6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:36.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.249+0000 7f4735e00640 1 -- 172.21.15.144:0/321564354 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47300d2bb0 con 0x7f4730161d70 2024-09-11T23:21:36.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.250+0000 7f4735e00640 1 --2- 172.21.15.144:0/321564354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4730161d70 0x7f473015fe90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f473015c8c0 tx=0x7f472402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a756a82bb743cd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:36.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.250+0000 7f4734a00640 1 -- 172.21.15.144:0/321564354 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4724037070 con 0x7f4730161d70 2024-09-11T23:21:36.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.250+0000 7f4734a00640 1 -- 172.21.15.144:0/321564354 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4724032440 con 0x7f4730161d70 2024-09-11T23:21:36.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.250+0000 7f4734a00640 1 -- 172.21.15.144:0/321564354 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4724032810 con 0x7f4730161d70 2024-09-11T23:21:36.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.250+0000 7f4738800640 1 -- 172.21.15.144:0/321564354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4730161d70 msgr2=0x7f473015fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:36.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.250+0000 7f4738800640 1 --2- 172.21.15.144:0/321564354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4730161d70 0x7f473015fe90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f473015c8c0 tx=0x7f472402a1e0 comp rx=0 tx=0).stop 2024-09-11T23:21:36.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.251+0000 7f4738800640 1 -- 172.21.15.144:0/321564354 shutdown_connections 2024-09-11T23:21:36.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.251+0000 7f4738800640 1 --2- 172.21.15.144:0/321564354 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f473015eeb0 0x7f473015f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:36.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.251+0000 7f4738800640 1 --2- 172.21.15.144:0/321564354 >> v2:172.21.15.165:3300/0 conn(0x7f47300b61d0 0x7f47300b6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:36.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.251+0000 7f4738800640 1 --2- 172.21.15.144:0/321564354 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4730161d70 0x7f473015fe90 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:36.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.251+0000 7f4738800640 1 -- 172.21.15.144:0/321564354 >> 172.21.15.144:0/321564354 conn(0x7f4730062c60 msgr2=0x7f47300d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:36.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.251+0000 7f4738800640 1 -- 172.21.15.144:0/321564354 shutdown_connections 2024-09-11T23:21:36.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.251+0000 7f4738800640 1 -- 172.21.15.144:0/321564354 wait complete. 2024-09-11T23:21:36.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.252+0000 7f4738800640 1 Processor -- start 2024-09-11T23:21:36.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.252+0000 7f4738800640 1 -- start start 2024-09-11T23:21:36.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.253+0000 7f4738800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47300b61d0 0x7f47300c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:36.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.253+0000 7f4738800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f473015eeb0 0x7f473015c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:36.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.253+0000 7f4738800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4730161d70 0x7f47300cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:36.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.253+0000 7f4738800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f473015f880 con 0x7f4730161d70 2024-09-11T23:21:36.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.253+0000 7f4738800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f47300d3690 con 0x7f473015eeb0 2024-09-11T23:21:36.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.253+0000 7f4738800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f47300c8860 con 0x7f47300b61d0 2024-09-11T23:21:36.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.254+0000 7f4736800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4730161d70 0x7f47300cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:36.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.254+0000 7f4735e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47300b61d0 0x7f47300c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:36.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.254+0000 7f4736800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4730161d70 0x7f47300cad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37276/0 (socket says 172.21.15.144:37276) 2024-09-11T23:21:36.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.254+0000 7f4735e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47300b61d0 0x7f47300c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:48184/0 (socket says 172.21.15.144:48184) 2024-09-11T23:21:36.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.254+0000 7f4736800640 1 -- 172.21.15.144:0/3868559009 learned_addr learned my addr 172.21.15.144:0/3868559009 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:36.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.254+0000 7f4735400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f473015eeb0 0x7f473015c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:36.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.254+0000 7f4736800640 1 -- 172.21.15.144:0/3868559009 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47300b61d0 msgr2=0x7f47300c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:36.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.254+0000 7f4736800640 1 --2- 172.21.15.144:0/3868559009 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47300b61d0 0x7f47300c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:36.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.254+0000 7f4736800640 1 -- 172.21.15.144:0/3868559009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f473015eeb0 msgr2=0x7f473015c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:36.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.254+0000 7f4736800640 1 --2- 172.21.15.144:0/3868559009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f473015eeb0 0x7f473015c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:36.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.254+0000 7f4736800640 1 -- 172.21.15.144:0/3868559009 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47300ca270 con 0x7f4730161d70 2024-09-11T23:21:36.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.254+0000 7f4736800640 1 --2- 172.21.15.144:0/3868559009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4730161d70 0x7f47300cad50 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f472c007e40 tx=0x7f472c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:36.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.254+0000 7f472a000640 1 -- 172.21.15.144:0/3868559009 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c014620 con 0x7f4730161d70 2024-09-11T23:21:36.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.255+0000 7f472a000640 1 -- 172.21.15.144:0/3868559009 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472c019070 con 0x7f4730161d70 2024-09-11T23:21:36.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.255+0000 7f472a000640 1 -- 172.21.15.144:0/3868559009 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c014a20 con 0x7f4730161d70 2024-09-11T23:21:36.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.255+0000 7f4738800640 1 -- 172.21.15.144:0/3868559009 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47300ca550 con 0x7f4730161d70 2024-09-11T23:21:36.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.255+0000 7f4738800640 1 -- 172.21.15.144:0/3868559009 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47300c9f20 con 0x7f4730161d70 2024-09-11T23:21:36.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.256+0000 7f4738800640 1 -- 172.21.15.144:0/3868559009 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47300b6630 con 0x7f4730161d70 2024-09-11T23:21:36.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.257+0000 7f472a000640 1 -- 172.21.15.144:0/3868559009 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f472c014bc0 con 0x7f4730161d70 2024-09-11T23:21:36.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.257+0000 7f472a000640 1 --2- 172.21.15.144:0/3868559009 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f471406c190 0x7f471406e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:36.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.258+0000 7f472a000640 1 -- 172.21.15.144:0/3868559009 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5795+0+0 (secure 0 0 0) 0x7f472c08bb20 con 0x7f4730161d70 2024-09-11T23:21:36.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.258+0000 7f4735e00640 1 --2- 172.21.15.144:0/3868559009 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f471406c190 0x7f471406e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:36.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.258+0000 7f4735e00640 1 --2- 172.21.15.144:0/3868559009 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f471406c190 0x7f471406e650 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4724034000 tx=0x7f472402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:36.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.262+0000 7f472a000640 1 -- 172.21.15.144:0/3868559009 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f472c059a60 con 0x7f4730161d70 2024-09-11T23:21:36.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:36.438+0000 7f4738800640 1 -- 172.21.15.144:0/3868559009 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f47300d0020 con 0x7f4730161d70 2024-09-11T23:21:37.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.360+0000 7f472a000640 1 -- 172.21.15.144:0/3868559009 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v61) ==== 181+0+0 (secure 0 0 0) 0x7f472c05dd60 con 0x7f4730161d70 2024-09-11T23:21:37.360 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:21:37.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.364+0000 7f4738800640 1 -- 172.21.15.144:0/3868559009 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f471406c190 msgr2=0x7f471406e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:37.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.364+0000 7f4738800640 1 --2- 172.21.15.144:0/3868559009 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f471406c190 0x7f471406e650 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4724034000 tx=0x7f472402e000 comp rx=0 tx=0).stop 2024-09-11T23:21:37.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.364+0000 7f4738800640 1 -- 172.21.15.144:0/3868559009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4730161d70 msgr2=0x7f47300cad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:37.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.364+0000 7f4738800640 1 --2- 172.21.15.144:0/3868559009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4730161d70 0x7f47300cad50 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f472c007e40 tx=0x7f472c00e4b0 comp rx=0 tx=0).stop 2024-09-11T23:21:37.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.365+0000 7f4738800640 1 -- 172.21.15.144:0/3868559009 shutdown_connections 2024-09-11T23:21:37.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.365+0000 7f4738800640 1 --2- 172.21.15.144:0/3868559009 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f471406c190 0x7f471406e650 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:37.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.365+0000 7f4738800640 1 --2- 172.21.15.144:0/3868559009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4730161d70 0x7f47300cad50 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:37.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.365+0000 7f4738800640 1 --2- 172.21.15.144:0/3868559009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f473015eeb0 0x7f473015c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:37.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.365+0000 7f4738800640 1 --2- 172.21.15.144:0/3868559009 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f47300b61d0 0x7f47300c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:37.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.365+0000 7f4738800640 1 -- 172.21.15.144:0/3868559009 >> 172.21.15.144:0/3868559009 conn(0x7f4730062c60 msgr2=0x7f47300b9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:37.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.365+0000 7f4738800640 1 -- 172.21.15.144:0/3868559009 shutdown_connections 2024-09-11T23:21:37.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.365+0000 7f4738800640 1 -- 172.21.15.144:0/3868559009 wait complete. 2024-09-11T23:21:37.385 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:21:37.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.548+0000 7fdaa8200640 1 Processor -- start 2024-09-11T23:21:37.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.549+0000 7fdaa8200640 1 -- start start 2024-09-11T23:21:37.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.550+0000 7fdaa8200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdaa0145d90 0x7fdaa00ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:37.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.550+0000 7fdaa8200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa00b4240 con 0x7fdaa00cfce0 2024-09-11T23:21:37.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.550+0000 7fdaa8200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa00b4520 con 0x7fdaa00cd490 2024-09-11T23:21:37.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.550+0000 7fdaa8200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa006d080 con 0x7fdaa0145d90 2024-09-11T23:21:37.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.550+0000 7fdaa6200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdaa00cfce0 0x7fdaa006d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58146/0 (socket says 172.21.15.144:58146) 2024-09-11T23:21:37.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.550+0000 7fdaa6200640 1 -- 172.21.15.144:0/887263684 learned_addr learned my addr 172.21.15.144:0/887263684 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:37.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.550+0000 7fdaa5800640 1 --2- 172.21.15.144:0/887263684 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdaa0145d90 0x7fdaa00ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:37.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.550+0000 7fda9fe00640 1 -- 172.21.15.144:0/887263684 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2738217177 0 0) 0x7fdaa00b4240 con 0x7fdaa00cfce0 2024-09-11T23:21:37.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.551+0000 7fda9fe00640 1 -- 172.21.15.144:0/887263684 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda88003520 con 0x7fdaa00cfce0 2024-09-11T23:21:37.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.551+0000 7fda9fe00640 1 -- 172.21.15.144:0/887263684 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2361189186 0 0) 0x7fdaa00b4520 con 0x7fdaa00cd490 2024-09-11T23:21:37.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.551+0000 7fda9fe00640 1 -- 172.21.15.144:0/887263684 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdaa00b4240 con 0x7fdaa00cd490 2024-09-11T23:21:37.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.551+0000 7fdaa5800640 1 -- 172.21.15.144:0/887263684 >> v1:172.21.15.165:6789/0 conn(0x7fdaa00cd490 legacy=0x7fdaa00cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:37.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.551+0000 7fdaa5800640 1 -- 172.21.15.144:0/887263684 >> v1:172.21.15.144:6789/0 conn(0x7fdaa00cfce0 legacy=0x7fdaa006d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:37.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.551+0000 7fda9fe00640 1 -- 172.21.15.144:0/887263684 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1422322830 0 0) 0x7fda88003520 con 0x7fdaa00cfce0 2024-09-11T23:21:37.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.551+0000 7fdaa5800640 1 -- 172.21.15.144:0/887263684 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa00b4800 con 0x7fdaa0145d90 2024-09-11T23:21:37.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.552+0000 7fdaa5800640 1 --2- 172.21.15.144:0/887263684 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdaa0145d90 0x7fdaa00ccf50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fda940097d0 tx=0x7fda9402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80ac1e3ec53d0918 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:37.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.552+0000 7fda9fe00640 1 -- 172.21.15.144:0/887263684 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94037070 con 0x7fdaa0145d90 2024-09-11T23:21:37.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.552+0000 7fda9fe00640 1 -- 172.21.15.144:0/887263684 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda9402ac30 con 0x7fdaa0145d90 2024-09-11T23:21:37.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.552+0000 7fda9fe00640 1 -- 172.21.15.144:0/887263684 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda980019f0 con 0x7fdaa0145d90 2024-09-11T23:21:37.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.553+0000 7fdaa8200640 1 -- 172.21.15.144:0/887263684 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdaa0145d90 msgr2=0x7fdaa00ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:37.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.553+0000 7fdaa8200640 1 --2- 172.21.15.144:0/887263684 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdaa0145d90 0x7fdaa00ccf50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fda940097d0 tx=0x7fda9402a1a0 comp rx=0 tx=0).stop 2024-09-11T23:21:37.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.553+0000 7fdaa8200640 1 -- 172.21.15.144:0/887263684 shutdown_connections 2024-09-11T23:21:37.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.553+0000 7fdaa8200640 1 --2- 172.21.15.144:0/887263684 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdaa0145d90 0x7fdaa00ccf50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:37.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.553+0000 7fdaa8200640 1 -- 172.21.15.144:0/887263684 >> 172.21.15.144:0/887263684 conn(0x7fdaa006bba0 msgr2=0x7fdaa006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:37.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.553+0000 7fdaa8200640 1 -- 172.21.15.144:0/887263684 shutdown_connections 2024-09-11T23:21:37.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.553+0000 7fdaa8200640 1 -- 172.21.15.144:0/887263684 wait complete. 2024-09-11T23:21:37.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.555+0000 7fdaa8200640 1 Processor -- start 2024-09-11T23:21:37.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.555+0000 7fdaa8200640 1 -- start start 2024-09-11T23:21:37.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.556+0000 7fdaa8200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdaa00cd490 0x7fdaa00af660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:37.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.556+0000 7fdaa8200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdaa00cfce0 0x7fdaa01f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:37.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.556+0000 7fdaa8200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdaa0145d90 0x7fdaa01f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:37.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.556+0000 7fdaa8200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa00b5790 con 0x7fdaa0145d90 2024-09-11T23:21:37.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.556+0000 7fdaa8200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa00b5610 con 0x7fdaa00cd490 2024-09-11T23:21:37.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.556+0000 7fdaa8200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa0146170 con 0x7fdaa00cfce0 2024-09-11T23:21:37.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.556+0000 7fdaa6200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdaa0145d90 0x7fdaa01f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:37.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.556+0000 7fdaa6200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdaa0145d90 0x7fdaa01f2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37290/0 (socket says 172.21.15.144:37290) 2024-09-11T23:21:37.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.556+0000 7fdaa6200640 1 -- 172.21.15.144:0/2667813864 learned_addr learned my addr 172.21.15.144:0/2667813864 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:37.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.556+0000 7fdaa5800640 1 --2- 172.21.15.144:0/2667813864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdaa00cd490 0x7fdaa00af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:37.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.556+0000 7fdaa4e00640 1 --2- 172.21.15.144:0/2667813864 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdaa00cfce0 0x7fdaa01f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:37.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.556+0000 7fdaa6200640 1 -- 172.21.15.144:0/2667813864 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdaa00cfce0 msgr2=0x7fdaa01f1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:37.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.556+0000 7fdaa6200640 1 --2- 172.21.15.144:0/2667813864 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdaa00cfce0 0x7fdaa01f1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:37.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.556+0000 7fdaa6200640 1 -- 172.21.15.144:0/2667813864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdaa00cd490 msgr2=0x7fdaa00af660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:37.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.556+0000 7fdaa6200640 1 --2- 172.21.15.144:0/2667813864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdaa00cd490 0x7fdaa00af660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:37.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.556+0000 7fdaa6200640 1 -- 172.21.15.144:0/2667813864 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa01f2fb0 con 0x7fdaa0145d90 2024-09-11T23:21:37.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.557+0000 7fdaa6200640 1 --2- 172.21.15.144:0/2667813864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdaa0145d90 0x7fdaa01f2160 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fda98001350 tx=0x7fda9800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:37.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.557+0000 7fda9d600640 1 -- 172.21.15.144:0/2667813864 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98017070 con 0x7fdaa0145d90 2024-09-11T23:21:37.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.557+0000 7fda9d600640 1 -- 172.21.15.144:0/2667813864 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda9800ad40 con 0x7fdaa0145d90 2024-09-11T23:21:37.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.557+0000 7fdaa8200640 1 -- 172.21.15.144:0/2667813864 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa01f3290 con 0x7fdaa0145d90 2024-09-11T23:21:37.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.557+0000 7fda9d600640 1 -- 172.21.15.144:0/2667813864 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98012640 con 0x7fdaa0145d90 2024-09-11T23:21:37.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.557+0000 7fdaa8200640 1 -- 172.21.15.144:0/2667813864 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa01f3850 con 0x7fdaa0145d90 2024-09-11T23:21:37.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.558+0000 7fdaa8200640 1 -- 172.21.15.144:0/2667813864 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaa00ccf50 con 0x7fdaa0145d90 2024-09-11T23:21:37.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.559+0000 7fda9d600640 1 -- 172.21.15.144:0/2667813864 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7fda9801a070 con 0x7fdaa0145d90 2024-09-11T23:21:37.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.560+0000 7fda9d600640 1 --2- 172.21.15.144:0/2667813864 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fda8006c190 0x7fda8006e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:37.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.560+0000 7fda9d600640 1 -- 172.21.15.144:0/2667813864 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5357+0+0 (secure 0 0 0) 0x7fda9808b0e0 con 0x7fdaa0145d90 2024-09-11T23:21:37.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.560+0000 7fdaa5800640 1 --2- 172.21.15.144:0/2667813864 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fda8006c190 0x7fda8006e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:37.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.561+0000 7fdaa5800640 1 --2- 172.21.15.144:0/2667813864 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fda8006c190 0x7fda8006e650 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fda94034000 tx=0x7fda9402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:37.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.564+0000 7fda9d600640 1 -- 172.21.15.144:0/2667813864 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fda98059210 con 0x7fdaa0145d90 2024-09-11T23:21:37.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:37.741+0000 7fdaa8200640 1 -- 172.21.15.144:0/2667813864 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdaa00b38f0 con 0x7fdaa0145d90 2024-09-11T23:21:38.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.362+0000 7fda9d600640 1 -- 172.21.15.144:0/2667813864 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v62) ==== 169+0+0 (secure 0 0 0) 0x7fda9805d510 con 0x7fdaa0145d90 2024-09-11T23:21:38.362 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-11T23:21:38.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.365+0000 7fdaa8200640 1 -- 172.21.15.144:0/2667813864 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fda8006c190 msgr2=0x7fda8006e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:38.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.365+0000 7fdaa8200640 1 --2- 172.21.15.144:0/2667813864 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fda8006c190 0x7fda8006e650 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fda94034000 tx=0x7fda9402e000 comp rx=0 tx=0).stop 2024-09-11T23:21:38.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.365+0000 7fdaa8200640 1 -- 172.21.15.144:0/2667813864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdaa0145d90 msgr2=0x7fdaa01f2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:38.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.365+0000 7fdaa8200640 1 --2- 172.21.15.144:0/2667813864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdaa0145d90 0x7fdaa01f2160 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fda98001350 tx=0x7fda9800a430 comp rx=0 tx=0).stop 2024-09-11T23:21:38.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.366+0000 7fdaa8200640 1 -- 172.21.15.144:0/2667813864 shutdown_connections 2024-09-11T23:21:38.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.366+0000 7fdaa8200640 1 --2- 172.21.15.144:0/2667813864 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fda8006c190 0x7fda8006e650 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.366+0000 7fdaa8200640 1 --2- 172.21.15.144:0/2667813864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdaa0145d90 0x7fdaa01f2160 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.366+0000 7fdaa8200640 1 --2- 172.21.15.144:0/2667813864 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdaa00cfce0 0x7fdaa01f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.366+0000 7fdaa8200640 1 --2- 172.21.15.144:0/2667813864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdaa00cd490 0x7fdaa00af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.366+0000 7fdaa8200640 1 -- 172.21.15.144:0/2667813864 >> 172.21.15.144:0/2667813864 conn(0x7fdaa006bba0 msgr2=0x7fdaa00cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:38.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.366+0000 7fdaa8200640 1 -- 172.21.15.144:0/2667813864 shutdown_connections 2024-09-11T23:21:38.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.367+0000 7fdaa8200640 1 -- 172.21.15.144:0/2667813864 wait complete. 2024-09-11T23:21:38.387 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:21:38.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.544+0000 7ff744c00640 1 Processor -- start 2024-09-11T23:21:38.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.544+0000 7ff744c00640 1 -- start start 2024-09-11T23:21:38.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.545+0000 7ff744c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7400b8ee0 0x7ff740169380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:38.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.545+0000 7ff744c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff74006cd90 con 0x7ff74015e960 2024-09-11T23:21:38.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.545+0000 7ff744c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7400d4040 con 0x7ff7400cb2f0 2024-09-11T23:21:38.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.545+0000 7ff744c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff7400b7a40 con 0x7ff7400b8ee0 2024-09-11T23:21:38.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.545+0000 7ff73de00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff74015e960 0x7ff74006bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58160/0 (socket says 172.21.15.144:58160) 2024-09-11T23:21:38.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.545+0000 7ff73de00640 1 -- 172.21.15.144:0/1940984549 learned_addr learned my addr 172.21.15.144:0/1940984549 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:38.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.546+0000 7ff73e800640 1 --2- 172.21.15.144:0/1940984549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7400b8ee0 0x7ff740169380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:38.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.546+0000 7ff73ca00640 1 -- 172.21.15.144:0/1940984549 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2472415078 0 0) 0x7ff74006cd90 con 0x7ff74015e960 2024-09-11T23:21:38.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.546+0000 7ff73ca00640 1 -- 172.21.15.144:0/1940984549 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff724003520 con 0x7ff74015e960 2024-09-11T23:21:38.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.546+0000 7ff73ca00640 1 -- 172.21.15.144:0/1940984549 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 684870880 0 0) 0x7ff724003520 con 0x7ff74015e960 2024-09-11T23:21:38.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.546+0000 7ff73ca00640 1 -- 172.21.15.144:0/1940984549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7400b8ee0 msgr2=0x7ff740169380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:38.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.546+0000 7ff73ca00640 1 --2- 172.21.15.144:0/1940984549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7400b8ee0 0x7ff740169380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.546+0000 7ff73ca00640 1 -- 172.21.15.144:0/1940984549 >> v1:172.21.15.165:6789/0 conn(0x7ff7400cb2f0 legacy=0x7ff74006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:38.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.546+0000 7ff73ca00640 1 -- 172.21.15.144:0/1940984549 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7400cf750 con 0x7ff74015e960 2024-09-11T23:21:38.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.546+0000 7ff73ca00640 1 -- 172.21.15.144:0/1940984549 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7ff730001670 con 0x7ff74015e960 2024-09-11T23:21:38.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.546+0000 7ff73ca00640 1 -- 172.21.15.144:0/1940984549 >> v1:172.21.15.144:6789/0 conn(0x7ff74015e960 legacy=0x7ff74006bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:38.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.546+0000 7ff73ca00640 1 --2- 172.21.15.144:0/1940984549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7240039e0 0x7ff724003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:38.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.546+0000 7ff73ca00640 1 --2- 172.21.15.144:0/1940984549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff724004390 0x7ff724004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:38.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.546+0000 7ff73ca00640 1 --2- 172.21.15.144:0/1940984549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7400b8ee0 0x7ff7240050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:38.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.546+0000 7ff73ca00640 1 -- 172.21.15.144:0/1940984549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff7400b7a40 con 0x7ff7240039e0 2024-09-11T23:21:38.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.546+0000 7ff73ca00640 1 -- 172.21.15.144:0/1940984549 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff72400b9f0 con 0x7ff724004390 2024-09-11T23:21:38.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.546+0000 7ff73ca00640 1 -- 172.21.15.144:0/1940984549 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff72400bbf0 con 0x7ff7400b8ee0 2024-09-11T23:21:38.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.546+0000 7ff73de00640 1 --2- 172.21.15.144:0/1940984549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7240039e0 0x7ff724003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:38.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.547+0000 7ff73d400640 1 --2- 172.21.15.144:0/1940984549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff724004390 0x7ff724004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:38.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.547+0000 7ff73e800640 1 --2- 172.21.15.144:0/1940984549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7400b8ee0 0x7ff7240050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:38.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.547+0000 7ff73de00640 1 -- 172.21.15.144:0/1940984549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7400b8ee0 msgr2=0x7ff7240050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:38.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.547+0000 7ff73de00640 1 --2- 172.21.15.144:0/1940984549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7400b8ee0 0x7ff7240050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.547+0000 7ff73de00640 1 -- 172.21.15.144:0/1940984549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff724004390 msgr2=0x7ff724004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:38.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.547+0000 7ff73de00640 1 --2- 172.21.15.144:0/1940984549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff724004390 0x7ff724004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.547+0000 7ff73de00640 1 -- 172.21.15.144:0/1940984549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff724003520 con 0x7ff7240039e0 2024-09-11T23:21:38.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.548+0000 7ff73de00640 1 --2- 172.21.15.144:0/1940984549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7240039e0 0x7ff724003dc0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff73000c290 tx=0x7ff724005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2dde715c17b920 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:38.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.548+0000 7ff73ca00640 1 -- 172.21.15.144:0/1940984549 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730007d50 con 0x7ff7240039e0 2024-09-11T23:21:38.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.548+0000 7ff73ca00640 1 -- 172.21.15.144:0/1940984549 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff730005af0 con 0x7ff7240039e0 2024-09-11T23:21:38.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.548+0000 7ff73ca00640 1 -- 172.21.15.144:0/1940984549 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730007070 con 0x7ff7240039e0 2024-09-11T23:21:38.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.549+0000 7ff744c00640 1 -- 172.21.15.144:0/1940984549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7240039e0 msgr2=0x7ff724003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:38.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.549+0000 7ff744c00640 1 --2- 172.21.15.144:0/1940984549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7240039e0 0x7ff724003dc0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff73000c290 tx=0x7ff724005830 comp rx=0 tx=0).stop 2024-09-11T23:21:38.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.549+0000 7ff73e800640 1 -- 172.21.15.144:0/1940984549 reap_dead start 2024-09-11T23:21:38.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.549+0000 7ff744c00640 1 -- 172.21.15.144:0/1940984549 shutdown_connections 2024-09-11T23:21:38.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.549+0000 7ff744c00640 1 -- 172.21.15.144:0/1940984549 >> 172.21.15.144:0/1940984549 conn(0x7ff7400d46e0 msgr2=0x7ff7400d4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:38.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.549+0000 7ff744c00640 1 -- 172.21.15.144:0/1940984549 shutdown_connections 2024-09-11T23:21:38.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.549+0000 7ff744c00640 1 -- 172.21.15.144:0/1940984549 wait complete. 2024-09-11T23:21:38.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.550+0000 7ff744c00640 1 Processor -- start 2024-09-11T23:21:38.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.551+0000 7ff744c00640 1 -- start start 2024-09-11T23:21:38.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.551+0000 7ff744c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7240039e0 0x7ff74014ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:38.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.551+0000 7ff744c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff74014f420 0x7ff740159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:38.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.551+0000 7ff744c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff74015a080 0x7ff740160060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:38.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.551+0000 7ff744c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff7400d3cd0 con 0x7ff74015a080 2024-09-11T23:21:38.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.551+0000 7ff744c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff7400cfd10 con 0x7ff74014f420 2024-09-11T23:21:38.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.551+0000 7ff744c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff740167370 con 0x7ff7240039e0 2024-09-11T23:21:38.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.552+0000 7ff73e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff74015a080 0x7ff740160060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:38.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.552+0000 7ff73e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff74015a080 0x7ff740160060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37314/0 (socket says 172.21.15.144:37314) 2024-09-11T23:21:38.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.552+0000 7ff73e800640 1 -- 172.21.15.144:0/2027765190 learned_addr learned my addr 172.21.15.144:0/2027765190 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:38.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.552+0000 7ff73de00640 1 --2- 172.21.15.144:0/2027765190 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7240039e0 0x7ff74014ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:38.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.552+0000 7ff73d400640 1 --2- 172.21.15.144:0/2027765190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff74014f420 0x7ff740159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:38.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.552+0000 7ff73e800640 1 -- 172.21.15.144:0/2027765190 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7240039e0 msgr2=0x7ff74014ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:38.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.552+0000 7ff73e800640 1 --2- 172.21.15.144:0/2027765190 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7240039e0 0x7ff74014ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.552+0000 7ff73e800640 1 -- 172.21.15.144:0/2027765190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff74014f420 msgr2=0x7ff740159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:38.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.552+0000 7ff73e800640 1 --2- 172.21.15.144:0/2027765190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff74014f420 0x7ff740159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.552+0000 7ff73e800640 1 -- 172.21.15.144:0/2027765190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74015bbc0 con 0x7ff74015a080 2024-09-11T23:21:38.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.552+0000 7ff73e800640 1 --2- 172.21.15.144:0/2027765190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff74015a080 0x7ff740160060 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff7401622a0 tx=0x7ff73800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:38.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.553+0000 7ff736000640 1 -- 172.21.15.144:0/2027765190 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738015430 con 0x7ff74015a080 2024-09-11T23:21:38.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.553+0000 7ff736000640 1 -- 172.21.15.144:0/2027765190 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff73801d070 con 0x7ff74015a080 2024-09-11T23:21:38.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.553+0000 7ff736000640 1 -- 172.21.15.144:0/2027765190 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738015830 con 0x7ff74015a080 2024-09-11T23:21:38.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.553+0000 7ff744c00640 1 -- 172.21.15.144:0/2027765190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff740160d30 con 0x7ff74015a080 2024-09-11T23:21:38.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.553+0000 7ff744c00640 1 -- 172.21.15.144:0/2027765190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff74015bea0 con 0x7ff74015a080 2024-09-11T23:21:38.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.554+0000 7ff744c00640 1 -- 172.21.15.144:0/2027765190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7400d4040 con 0x7ff74015a080 2024-09-11T23:21:38.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.555+0000 7ff736000640 1 -- 172.21.15.144:0/2027765190 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7ff7380159d0 con 0x7ff74015a080 2024-09-11T23:21:38.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.555+0000 7ff736000640 1 --2- 172.21.15.144:0/2027765190 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff72006c190 0x7ff72006e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:38.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.555+0000 7ff736000640 1 -- 172.21.15.144:0/2027765190 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7ff73808b9f0 con 0x7ff74015a080 2024-09-11T23:21:38.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.556+0000 7ff73de00640 1 --2- 172.21.15.144:0/2027765190 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff72006c190 0x7ff72006e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:38.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.556+0000 7ff73de00640 1 --2- 172.21.15.144:0/2027765190 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff72006c190 0x7ff72006e650 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff730033000 tx=0x7ff73002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:38.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.560+0000 7ff736000640 1 -- 172.21.15.144:0/2027765190 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff738010040 con 0x7ff74015a080 2024-09-11T23:21:38.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.748+0000 7ff744c00640 1 -- 172.21.15.144:0/2027765190 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7ff7400cf280 con 0x7ff74015a080 2024-09-11T23:21:38.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.752+0000 7ff736000640 1 -- 172.21.15.144:0/2027765190 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7ff738059af0 con 0x7ff74015a080 2024-09-11T23:21:38.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.754+0000 7ff744c00640 1 -- 172.21.15.144:0/2027765190 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff72006c190 msgr2=0x7ff72006e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:38.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.754+0000 7ff744c00640 1 --2- 172.21.15.144:0/2027765190 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff72006c190 0x7ff72006e650 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff730033000 tx=0x7ff73002e000 comp rx=0 tx=0).stop 2024-09-11T23:21:38.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.754+0000 7ff744c00640 1 -- 172.21.15.144:0/2027765190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff74015a080 msgr2=0x7ff740160060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:38.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.754+0000 7ff744c00640 1 --2- 172.21.15.144:0/2027765190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff74015a080 0x7ff740160060 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff7401622a0 tx=0x7ff73800f580 comp rx=0 tx=0).stop 2024-09-11T23:21:38.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.754+0000 7ff744c00640 1 -- 172.21.15.144:0/2027765190 shutdown_connections 2024-09-11T23:21:38.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.754+0000 7ff744c00640 1 --2- 172.21.15.144:0/2027765190 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff72006c190 0x7ff72006e650 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.754+0000 7ff744c00640 1 --2- 172.21.15.144:0/2027765190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff74015a080 0x7ff740160060 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.754+0000 7ff744c00640 1 --2- 172.21.15.144:0/2027765190 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff74014f420 0x7ff740159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.754+0000 7ff744c00640 1 --2- 172.21.15.144:0/2027765190 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7240039e0 0x7ff74014ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.754+0000 7ff744c00640 1 -- 172.21.15.144:0/2027765190 >> 172.21.15.144:0/2027765190 conn(0x7ff7400d46e0 msgr2=0x7ff7400b46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.754+0000 7ff744c00640 1 -- 172.21.15.144:0/2027765190 shutdown_connections 2024-09-11T23:21:38.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.754+0000 7ff744c00640 1 -- 172.21.15.144:0/2027765190 wait complete. 2024-09-11T23:21:38.770 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2024-09-11T23:21:38.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.923+0000 7fa26a800640 1 Processor -- start 2024-09-11T23:21:38.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.923+0000 7fa26a800640 1 -- start start 2024-09-11T23:21:38.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.925+0000 7fa26a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa26415c180 0x7fa2640cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:38.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.925+0000 7fa26a800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa264073120 0x7fa264073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:38.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.925+0000 7fa26a800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2640ce740 con 0x7fa2640ce230 2024-09-11T23:21:38.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.925+0000 7fa26a800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa264072640 con 0x7fa26415c180 2024-09-11T23:21:38.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.925+0000 7fa26a800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa264072920 con 0x7fa264073120 2024-09-11T23:21:38.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.925+0000 7fa263400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa26415c180 0x7fa2640cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:38.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.925+0000 7fa263400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa26415c180 0x7fa2640cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37330/0 (socket says 172.21.15.144:37330) 2024-09-11T23:21:38.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.925+0000 7fa263400640 1 -- 172.21.15.144:0/1464576710 learned_addr learned my addr 172.21.15.144:0/1464576710 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:38.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.925+0000 7fa25aa00640 1 --1- 172.21.15.144:0/1464576710 >> v1:172.21.15.144:6789/0 conn(0x7fa2640ce230 0x7fa2640cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58164/0 (socket says 172.21.15.144:58164) 2024-09-11T23:21:38.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.925+0000 7fa263e00640 1 --2- 172.21.15.144:0/1464576710 >> v2:172.21.15.165:3300/0 conn(0x7fa264073120 0x7fa264073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:38.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.925+0000 7fa263400640 1 -- 172.21.15.144:0/1464576710 >> v2:172.21.15.165:3300/0 conn(0x7fa264073120 msgr2=0x7fa264073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:38.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.925+0000 7fa263400640 1 --2- 172.21.15.144:0/1464576710 >> v2:172.21.15.165:3300/0 conn(0x7fa264073120 0x7fa264073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.925+0000 7fa263400640 1 -- 172.21.15.144:0/1464576710 >> v1:172.21.15.144:6789/0 conn(0x7fa2640ce230 legacy=0x7fa2640cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:38.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.925+0000 7fa263400640 1 -- 172.21.15.144:0/1464576710 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa264072c00 con 0x7fa26415c180 2024-09-11T23:21:38.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.925+0000 7fa262a00640 1 -- 172.21.15.144:0/1464576710 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2948966183 0 0) 0x7fa2640ce740 con 0x7fa2640ce230 2024-09-11T23:21:38.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.926+0000 7fa263400640 1 --2- 172.21.15.144:0/1464576710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa26415c180 0x7fa2640cdcf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa2640cd0a0 tx=0x7fa25402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f86806b70b6847 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:38.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.927+0000 7fa262a00640 1 -- 172.21.15.144:0/1464576710 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254037070 con 0x7fa26415c180 2024-09-11T23:21:38.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.927+0000 7fa262a00640 1 -- 172.21.15.144:0/1464576710 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa254032440 con 0x7fa26415c180 2024-09-11T23:21:38.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.927+0000 7fa262a00640 1 -- 172.21.15.144:0/1464576710 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254032810 con 0x7fa26415c180 2024-09-11T23:21:38.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.927+0000 7fa26a800640 1 -- 172.21.15.144:0/1464576710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa26415c180 msgr2=0x7fa2640cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:38.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.927+0000 7fa26a800640 1 --2- 172.21.15.144:0/1464576710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa26415c180 0x7fa2640cdcf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa2640cd0a0 tx=0x7fa25402a1e0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.927+0000 7fa26a800640 1 -- 172.21.15.144:0/1464576710 shutdown_connections 2024-09-11T23:21:38.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.927+0000 7fa26a800640 1 --2- 172.21.15.144:0/1464576710 >> v2:172.21.15.165:3300/0 conn(0x7fa264073120 0x7fa264073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.927+0000 7fa26a800640 1 --2- 172.21.15.144:0/1464576710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa26415c180 0x7fa2640cdcf0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.927+0000 7fa26a800640 1 -- 172.21.15.144:0/1464576710 >> 172.21.15.144:0/1464576710 conn(0x7fa264062cc0 msgr2=0x7fa26406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:38.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.927+0000 7fa26a800640 1 -- 172.21.15.144:0/1464576710 shutdown_connections 2024-09-11T23:21:38.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.927+0000 7fa26a800640 1 -- 172.21.15.144:0/1464576710 wait complete. 2024-09-11T23:21:38.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.929+0000 7fa26a800640 1 Processor -- start 2024-09-11T23:21:38.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.929+0000 7fa26a800640 1 -- start start 2024-09-11T23:21:38.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.930+0000 7fa26a800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa264073120 0x7fa26414bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:38.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.930+0000 7fa26a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2640ce230 0x7fa2640c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:38.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.930+0000 7fa26a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa26415c180 0x7fa2640c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:38.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.930+0000 7fa26a800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa2640cf780 con 0x7fa26415c180 2024-09-11T23:21:38.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.930+0000 7fa26a800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa2640722f0 con 0x7fa264073120 2024-09-11T23:21:38.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.930+0000 7fa26a800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa26415c560 con 0x7fa2640ce230 2024-09-11T23:21:38.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.930+0000 7fa263e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa26415c180 0x7fa2640c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:38.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.930+0000 7fa263e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa26415c180 0x7fa2640c7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37338/0 (socket says 172.21.15.144:37338) 2024-09-11T23:21:38.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.930+0000 7fa263e00640 1 -- 172.21.15.144:0/130706888 learned_addr learned my addr 172.21.15.144:0/130706888 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:38.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.930+0000 7fa263400640 1 --2- 172.21.15.144:0/130706888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa264073120 0x7fa26414bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:38.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.930+0000 7fa25aa00640 1 --2- 172.21.15.144:0/130706888 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2640ce230 0x7fa2640c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:38.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.931+0000 7fa263e00640 1 -- 172.21.15.144:0/130706888 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2640ce230 msgr2=0x7fa2640c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:38.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.931+0000 7fa263e00640 1 --2- 172.21.15.144:0/130706888 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2640ce230 0x7fa2640c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.931+0000 7fa263e00640 1 -- 172.21.15.144:0/130706888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa264073120 msgr2=0x7fa26414bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:38.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.931+0000 7fa263e00640 1 --2- 172.21.15.144:0/130706888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa264073120 0x7fa26414bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:38.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.931+0000 7fa263e00640 1 -- 172.21.15.144:0/130706888 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2640c5350 con 0x7fa26415c180 2024-09-11T23:21:38.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.931+0000 7fa263e00640 1 --2- 172.21.15.144:0/130706888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa26415c180 0x7fa2640c7570 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa25c007e60 tx=0x7fa25c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:38.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.931+0000 7fa25be00640 1 -- 172.21.15.144:0/130706888 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c014420 con 0x7fa26415c180 2024-09-11T23:21:38.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.931+0000 7fa25be00640 1 -- 172.21.15.144:0/130706888 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa25c019070 con 0x7fa26415c180 2024-09-11T23:21:38.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.931+0000 7fa25be00640 1 -- 172.21.15.144:0/130706888 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25c014820 con 0x7fa26415c180 2024-09-11T23:21:38.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.931+0000 7fa26a800640 1 -- 172.21.15.144:0/130706888 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2640c5630 con 0x7fa26415c180 2024-09-11T23:21:38.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.931+0000 7fa26a800640 1 -- 172.21.15.144:0/130706888 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2640c5bf0 con 0x7fa26415c180 2024-09-11T23:21:38.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.932+0000 7fa26a800640 1 -- 172.21.15.144:0/130706888 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2640cdcf0 con 0x7fa26415c180 2024-09-11T23:21:38.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.933+0000 7fa25be00640 1 -- 172.21.15.144:0/130706888 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7fa25c0149c0 con 0x7fa26415c180 2024-09-11T23:21:38.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.934+0000 7fa25be00640 1 --2- 172.21.15.144:0/130706888 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa24006c190 0x7fa24006e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:38.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.934+0000 7fa25be00640 1 -- 172.21.15.144:0/130706888 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7fa25c08b760 con 0x7fa26415c180 2024-09-11T23:21:38.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.934+0000 7fa263400640 1 --2- 172.21.15.144:0/130706888 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa24006c190 0x7fa24006e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:38.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.935+0000 7fa263400640 1 --2- 172.21.15.144:0/130706888 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa24006c190 0x7fa24006e650 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa254034000 tx=0x7fa25402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:38.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:38.938+0000 7fa25be00640 1 -- 172.21.15.144:0/130706888 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa25c059a00 con 0x7fa26415c180 2024-09-11T23:21:39.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.178+0000 7fa26a800640 1 -- 172.21.15.144:0/130706888 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7fa2640d0120 con 0x7fa26415c180 2024-09-11T23:21:39.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.372+0000 7fa25be00640 1 -- 172.21.15.144:0/130706888 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v201) ==== 161+0+0 (secure 0 0 0) 0x7fa25c05dd00 con 0x7fa26415c180 2024-09-11T23:21:39.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.374+0000 7fa26a800640 1 -- 172.21.15.144:0/130706888 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa24006c190 msgr2=0x7fa24006e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:39.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.374+0000 7fa26a800640 1 --2- 172.21.15.144:0/130706888 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa24006c190 0x7fa24006e650 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa254034000 tx=0x7fa25402e000 comp rx=0 tx=0).stop 2024-09-11T23:21:39.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.374+0000 7fa26a800640 1 -- 172.21.15.144:0/130706888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa26415c180 msgr2=0x7fa2640c7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:39.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.374+0000 7fa26a800640 1 --2- 172.21.15.144:0/130706888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa26415c180 0x7fa2640c7570 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa25c007e60 tx=0x7fa25c00e4b0 comp rx=0 tx=0).stop 2024-09-11T23:21:39.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.374+0000 7fa26a800640 1 -- 172.21.15.144:0/130706888 shutdown_connections 2024-09-11T23:21:39.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.374+0000 7fa26a800640 1 --2- 172.21.15.144:0/130706888 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa24006c190 0x7fa24006e650 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:39.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.374+0000 7fa26a800640 1 --2- 172.21.15.144:0/130706888 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa26415c180 0x7fa2640c7570 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:39.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.374+0000 7fa26a800640 1 --2- 172.21.15.144:0/130706888 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2640ce230 0x7fa2640c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:39.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.374+0000 7fa26a800640 1 --2- 172.21.15.144:0/130706888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa264073120 0x7fa26414bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:39.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.374+0000 7fa26a800640 1 -- 172.21.15.144:0/130706888 >> 172.21.15.144:0/130706888 conn(0x7fa264062cc0 msgr2=0x7fa26406c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:39.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.375+0000 7fa26a800640 1 -- 172.21.15.144:0/130706888 shutdown_connections 2024-09-11T23:21:39.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.375+0000 7fa26a800640 1 -- 172.21.15.144:0/130706888 wait complete. 2024-09-11T23:21:39.390 INFO:tasks.cephfs_test_runner:Validate handcrafted .meta file on legacy subvol root doesn't break the system ... ok 2024-09-11T23:21:39.391 INFO:tasks.cephfs_test_runner:Starting test: test_mgr_eviction (tasks.cephfs.test_volumes.TestMisc) 2024-09-11T23:21:39.391 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:21:39.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.546+0000 7f598dc00640 1 Processor -- start 2024-09-11T23:21:39.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.546+0000 7f598dc00640 1 -- start start 2024-09-11T23:21:39.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.547+0000 7f598dc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f59880d0a50 0x7f59881620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:39.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.548+0000 7f598dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f598815fd30 0x7f59880b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:39.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.548+0000 7f598dc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59881625f0 con 0x7f59880b4930 2024-09-11T23:21:39.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.548+0000 7f598dc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f59880b52d0 con 0x7f59880d0a50 2024-09-11T23:21:39.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.548+0000 7f598dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5988162870 con 0x7f598815fd30 2024-09-11T23:21:39.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.548+0000 7f597e000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f59880b4930 0x7f598815f620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58168/0 (socket says 172.21.15.144:58168) 2024-09-11T23:21:39.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.548+0000 7f597e000640 1 -- 172.21.15.144:0/65332118 learned_addr learned my addr 172.21.15.144:0/65332118 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:39.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.548+0000 7f5986a00640 1 --2- 172.21.15.144:0/65332118 >> v2:172.21.15.165:3300/0 conn(0x7f59880d0a50 0x7f59881620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:39.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.548+0000 7f5987400640 1 --2- 172.21.15.144:0/65332118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f598815fd30 0x7f59880b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:39.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.548+0000 7f5986000640 1 -- 172.21.15.144:0/65332118 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2930511552 0 0) 0x7f5970001110 con 0x7f59880b4930 2024-09-11T23:21:39.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.548+0000 7f5986000640 1 -- 172.21.15.144:0/65332118 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f596c003520 con 0x7f59880b4930 2024-09-11T23:21:39.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f5986000640 1 -- 172.21.15.144:0/65332118 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3679294354 0 0) 0x7f596c003520 con 0x7f59880b4930 2024-09-11T23:21:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f5986000640 1 -- 172.21.15.144:0/65332118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f598815fd30 msgr2=0x7f59880b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f5986000640 1 --2- 172.21.15.144:0/65332118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f598815fd30 0x7f59880b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f5986000640 1 -- 172.21.15.144:0/65332118 >> v2:172.21.15.165:3300/0 conn(0x7f59880d0a50 msgr2=0x7f59881620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f5986000640 1 --2- 172.21.15.144:0/65332118 >> v2:172.21.15.165:3300/0 conn(0x7f59880d0a50 0x7f59881620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f5986000640 1 -- 172.21.15.144:0/65332118 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5988162b50 con 0x7f59880b4930 2024-09-11T23:21:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f5986000640 1 -- 172.21.15.144:0/65332118 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f5970001840 con 0x7f59880b4930 2024-09-11T23:21:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f5986000640 1 -- 172.21.15.144:0/65332118 >> v1:172.21.15.144:6789/0 conn(0x7f59880b4930 legacy=0x7f598815f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f5986000640 1 --2- 172.21.15.144:0/65332118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f596c0039b0 0x7f596c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f5986000640 1 --2- 172.21.15.144:0/65332118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f596c004800 0x7f596c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f5986000640 1 --2- 172.21.15.144:0/65332118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f598815fd30 0x7f596c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f5986000640 1 -- 172.21.15.144:0/65332118 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f59880b52d0 con 0x7f596c004800 2024-09-11T23:21:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f5986000640 1 -- 172.21.15.144:0/65332118 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5988162870 con 0x7f596c0039b0 2024-09-11T23:21:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f5986000640 1 -- 172.21.15.144:0/65332118 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f596c00b9c0 con 0x7f598815fd30 2024-09-11T23:21:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f597e000640 1 --2- 172.21.15.144:0/65332118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f596c004800 0x7f596c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:39.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f5986a00640 1 --2- 172.21.15.144:0/65332118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f596c0039b0 0x7f596c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f5987400640 1 --2- 172.21.15.144:0/65332118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f598815fd30 0x7f596c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f597e000640 1 -- 172.21.15.144:0/65332118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f598815fd30 msgr2=0x7f596c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f597e000640 1 --2- 172.21.15.144:0/65332118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f598815fd30 0x7f596c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f597e000640 1 -- 172.21.15.144:0/65332118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f596c0039b0 msgr2=0x7f596c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f597e000640 1 --2- 172.21.15.144:0/65332118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f596c0039b0 0x7f596c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.549+0000 7f597e000640 1 -- 172.21.15.144:0/65332118 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c003520 con 0x7f596c004800 2024-09-11T23:21:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.550+0000 7f597e000640 1 --2- 172.21.15.144:0/65332118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f596c004800 0x7f596c004c80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f597000c410 tx=0x7f596c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6a4dd5088edb51 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.551+0000 7f5986000640 1 -- 172.21.15.144:0/65332118 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970032020 con 0x7f596c004800 2024-09-11T23:21:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.551+0000 7f5986000640 1 -- 172.21.15.144:0/65332118 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5970005af0 con 0x7f596c004800 2024-09-11T23:21:39.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.551+0000 7f5986000640 1 -- 172.21.15.144:0/65332118 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597000c0e0 con 0x7f596c004800 2024-09-11T23:21:39.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.551+0000 7f598dc00640 1 -- 172.21.15.144:0/65332118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f596c004800 msgr2=0x7f596c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:39.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.551+0000 7f598dc00640 1 --2- 172.21.15.144:0/65332118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f596c004800 0x7f596c004c80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f597000c410 tx=0x7f596c005830 comp rx=0 tx=0).stop 2024-09-11T23:21:39.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.551+0000 7f5987400640 1 -- 172.21.15.144:0/65332118 reap_dead start 2024-09-11T23:21:39.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.551+0000 7f598dc00640 1 -- 172.21.15.144:0/65332118 shutdown_connections 2024-09-11T23:21:39.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.551+0000 7f598dc00640 1 -- 172.21.15.144:0/65332118 >> 172.21.15.144:0/65332118 conn(0x7f5988062cc0 msgr2=0x7f598806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:39.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.551+0000 7f598dc00640 1 -- 172.21.15.144:0/65332118 shutdown_connections 2024-09-11T23:21:39.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.551+0000 7f598dc00640 1 -- 172.21.15.144:0/65332118 wait complete. 2024-09-11T23:21:39.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.553+0000 7f598dc00640 1 Processor -- start 2024-09-11T23:21:39.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.553+0000 7f598dc00640 1 -- start start 2024-09-11T23:21:39.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.554+0000 7f598dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f596c004800 0x7f5988152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:39.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.554+0000 7f598dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5988151480 0x7f5988154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:39.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.554+0000 7f598dc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5988150d90 0x7f5988153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:39.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.554+0000 7f598dc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f59880b3620 con 0x7f5988151480 2024-09-11T23:21:39.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.554+0000 7f598dc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f59880b3340 con 0x7f5988150d90 2024-09-11T23:21:39.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.554+0000 7f598dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f59880b4d90 con 0x7f596c004800 2024-09-11T23:21:39.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.554+0000 7f597e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5988151480 0x7f5988154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:39.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.554+0000 7f597e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5988151480 0x7f5988154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37342/0 (socket says 172.21.15.144:37342) 2024-09-11T23:21:39.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.554+0000 7f597e000640 1 -- 172.21.15.144:0/1630832128 learned_addr learned my addr 172.21.15.144:0/1630832128 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:39.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.555+0000 7f597e000640 1 -- 172.21.15.144:0/1630832128 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f596c004800 msgr2=0x7f5988152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:39.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.555+0000 7f597e000640 1 --2- 172.21.15.144:0/1630832128 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f596c004800 0x7f5988152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:39.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.555+0000 7f597e000640 1 -- 172.21.15.144:0/1630832128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5988150d90 msgr2=0x7f5988153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:39.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.555+0000 7f5987400640 1 --2- 172.21.15.144:0/1630832128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5988150d90 0x7f5988153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:39.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.555+0000 7f597e000640 1 --2- 172.21.15.144:0/1630832128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5988150d90 0x7f5988153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:39.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.555+0000 7f597e000640 1 -- 172.21.15.144:0/1630832128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5988154850 con 0x7f5988151480 2024-09-11T23:21:39.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.555+0000 7f5987400640 1 --2- 172.21.15.144:0/1630832128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5988150d90 0x7f5988153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:39.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.555+0000 7f597e000640 1 --2- 172.21.15.144:0/1630832128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5988151480 0x7f5988154fe0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5970031040 tx=0x7f5970001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:39.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.555+0000 7f597f400640 1 -- 172.21.15.144:0/1630832128 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970032030 con 0x7f5988151480 2024-09-11T23:21:39.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.555+0000 7f597f400640 1 -- 172.21.15.144:0/1630832128 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5970007270 con 0x7f5988151480 2024-09-11T23:21:39.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.555+0000 7f598dc00640 1 -- 172.21.15.144:0/1630832128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59880738e0 con 0x7f5988151480 2024-09-11T23:21:39.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.555+0000 7f597f400640 1 -- 172.21.15.144:0/1630832128 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970007620 con 0x7f5988151480 2024-09-11T23:21:39.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.555+0000 7f598dc00640 1 -- 172.21.15.144:0/1630832128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5988154ac0 con 0x7f5988151480 2024-09-11T23:21:39.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.557+0000 7f598dc00640 1 -- 172.21.15.144:0/1630832128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59881620b0 con 0x7f5988151480 2024-09-11T23:21:39.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.557+0000 7f597f400640 1 -- 172.21.15.144:0/1630832128 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f5970035020 con 0x7f5988151480 2024-09-11T23:21:39.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.559+0000 7f597f400640 1 --2- 172.21.15.144:0/1630832128 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f596406c1c0 0x7f596406e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:39.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.559+0000 7f597f400640 1 -- 172.21.15.144:0/1630832128 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7f59700ab730 con 0x7f5988151480 2024-09-11T23:21:39.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.559+0000 7f5986a00640 1 --2- 172.21.15.144:0/1630832128 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f596406c1c0 0x7f596406e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:39.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.559+0000 7f5986a00640 1 --2- 172.21.15.144:0/1630832128 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f596406c1c0 0x7f596406e680 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5978009a40 tx=0x7f5978009320 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:39.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.563+0000 7f597f400640 1 -- 172.21.15.144:0/1630832128 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59881625f0 con 0x7f5988151480 2024-09-11T23:21:39.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.739+0000 7f598dc00640 1 -- 172.21.15.144:0/1630832128 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59880cfd00 con 0x7f5988151480 2024-09-11T23:21:39.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.740+0000 7f597f400640 1 -- 172.21.15.144:0/1630832128 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+13058 (secure 0 0 0) 0x7f5970079f00 con 0x7f5988151480 2024-09-11T23:21:39.740 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:39.740 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":62,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:21:38.360847+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6837/1648435689":"2024-09-12T23:21:35.058522+0000","172.21.15.144:6835/1648435689":"2024-09-12T23:21:35.058522+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:21:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.743+0000 7f598dc00640 1 -- 172.21.15.144:0/1630832128 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f596406c1c0 msgr2=0x7f596406e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.743+0000 7f598dc00640 1 --2- 172.21.15.144:0/1630832128 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f596406c1c0 0x7f596406e680 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5978009a40 tx=0x7f5978009320 comp rx=0 tx=0).stop 2024-09-11T23:21:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.743+0000 7f598dc00640 1 -- 172.21.15.144:0/1630832128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5988151480 msgr2=0x7f5988154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.743+0000 7f598dc00640 1 --2- 172.21.15.144:0/1630832128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5988151480 0x7f5988154fe0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5970031040 tx=0x7f5970001c10 comp rx=0 tx=0).stop 2024-09-11T23:21:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.743+0000 7f598dc00640 1 -- 172.21.15.144:0/1630832128 shutdown_connections 2024-09-11T23:21:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.743+0000 7f598dc00640 1 --2- 172.21.15.144:0/1630832128 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f596406c1c0 0x7f596406e680 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.743+0000 7f598dc00640 1 --2- 172.21.15.144:0/1630832128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5988150d90 0x7f5988153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.743+0000 7f598dc00640 1 --2- 172.21.15.144:0/1630832128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5988151480 0x7f5988154fe0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:39.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.743+0000 7f598dc00640 1 --2- 172.21.15.144:0/1630832128 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f596c004800 0x7f5988152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:39.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.743+0000 7f598dc00640 1 -- 172.21.15.144:0/1630832128 >> 172.21.15.144:0/1630832128 conn(0x7f5988062cc0 msgr2=0x7f598815e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:39.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.743+0000 7f598dc00640 1 -- 172.21.15.144:0/1630832128 shutdown_connections 2024-09-11T23:21:39.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.743+0000 7f598dc00640 1 -- 172.21.15.144:0/1630832128 wait complete. 2024-09-11T23:21:39.760 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:17:47.307937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:21:39.760 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:21:39.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.917+0000 7f86c4400640 1 Processor -- start 2024-09-11T23:21:39.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.917+0000 7f86c4400640 1 -- start start 2024-09-11T23:21:39.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.918+0000 7f86c4400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f86bc15d3b0 0x7f86bc071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:39.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.918+0000 7f86c4400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86bc0cf320 0x7f86bc0cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:39.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.918+0000 7f86c4400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86bc0715c0 con 0x7f86bc15d790 2024-09-11T23:21:39.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.918+0000 7f86c4400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f86bc06da30 con 0x7f86bc15d3b0 2024-09-11T23:21:39.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.918+0000 7f86c4400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f86bc06d700 con 0x7f86bc0cf320 2024-09-11T23:21:39.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.919+0000 7f86c1a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f86bc15d3b0 0x7f86bc071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:39.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.919+0000 7f86c1000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f86bc15d790 0x7f86bc0cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58176/0 (socket says 172.21.15.144:58176) 2024-09-11T23:21:39.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.919+0000 7f86c1000640 1 -- 172.21.15.144:0/1811893373 learned_addr learned my addr 172.21.15.144:0/1811893373 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:39.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.919+0000 7f86c1a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f86bc15d3b0 0x7f86bc071080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37344/0 (socket says 172.21.15.144:37344) 2024-09-11T23:21:39.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.919+0000 7f86c1a00640 1 -- 172.21.15.144:0/1811893373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86bc0cf320 msgr2=0x7f86bc0cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:39.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.919+0000 7f86c2400640 1 --2- 172.21.15.144:0/1811893373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86bc0cf320 0x7f86bc0cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:39.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.919+0000 7f86c1a00640 1 --2- 172.21.15.144:0/1811893373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86bc0cf320 0x7f86bc0cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:39.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.919+0000 7f86c1a00640 1 -- 172.21.15.144:0/1811893373 >> v1:172.21.15.144:6789/0 conn(0x7f86bc15d790 legacy=0x7f86bc0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:39.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.919+0000 7f86c1a00640 1 -- 172.21.15.144:0/1811893373 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86bc0cde80 con 0x7f86bc15d3b0 2024-09-11T23:21:39.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.919+0000 7f86bbe00640 1 -- 172.21.15.144:0/1811893373 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4109212629 0 0) 0x7f86bc0715c0 con 0x7f86bc15d790 2024-09-11T23:21:39.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.919+0000 7f86c2400640 1 --2- 172.21.15.144:0/1811893373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86bc0cf320 0x7f86bc0cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.920+0000 7f86c1a00640 1 --2- 172.21.15.144:0/1811893373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86bc15d3b0 0x7f86bc071080 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f86b00097a0 tx=0x7f86b002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f261d946227b6afe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.920+0000 7f86bbe00640 1 -- 172.21.15.144:0/1811893373 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b0037070 con 0x7f86bc15d3b0 2024-09-11T23:21:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.921+0000 7f86bbe00640 1 -- 172.21.15.144:0/1811893373 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86b0032440 con 0x7f86bc15d3b0 2024-09-11T23:21:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.921+0000 7f86bbe00640 1 -- 172.21.15.144:0/1811893373 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b0032810 con 0x7f86bc15d3b0 2024-09-11T23:21:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.921+0000 7f86c4400640 1 -- 172.21.15.144:0/1811893373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86bc15d3b0 msgr2=0x7f86bc071080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.921+0000 7f86c4400640 1 --2- 172.21.15.144:0/1811893373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86bc15d3b0 0x7f86bc071080 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f86b00097a0 tx=0x7f86b002a180 comp rx=0 tx=0).stop 2024-09-11T23:21:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.921+0000 7f86c4400640 1 -- 172.21.15.144:0/1811893373 shutdown_connections 2024-09-11T23:21:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.921+0000 7f86c4400640 1 --2- 172.21.15.144:0/1811893373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86bc0cf320 0x7f86bc0cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.921+0000 7f86c4400640 1 --2- 172.21.15.144:0/1811893373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86bc15d3b0 0x7f86bc071080 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.921+0000 7f86c4400640 1 -- 172.21.15.144:0/1811893373 >> 172.21.15.144:0/1811893373 conn(0x7f86bc06bba0 msgr2=0x7f86bc06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.921+0000 7f86c4400640 1 -- 172.21.15.144:0/1811893373 shutdown_connections 2024-09-11T23:21:39.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.921+0000 7f86c4400640 1 -- 172.21.15.144:0/1811893373 wait complete. 2024-09-11T23:21:39.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.923+0000 7f86c4400640 1 Processor -- start 2024-09-11T23:21:39.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.923+0000 7f86c4400640 1 -- start start 2024-09-11T23:21:39.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.924+0000 7f86c4400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86bc0cf320 0x7f86bc148700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:39.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.924+0000 7f86c4400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86bc15d3b0 0x7f86bc0ad530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:39.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.924+0000 7f86c4400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86bc1451f0 0x7f86bc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:39.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.924+0000 7f86c4400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f86bc0cfcd0 con 0x7f86bc1451f0 2024-09-11T23:21:39.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.924+0000 7f86c4400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f86bc0cdba0 con 0x7f86bc15d3b0 2024-09-11T23:21:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.924+0000 7f86c4400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f86bc0cd580 con 0x7f86bc0cf320 2024-09-11T23:21:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.924+0000 7f86c2400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86bc1451f0 0x7f86bc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.924+0000 7f86c2400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86bc1451f0 0x7f86bc159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37346/0 (socket says 172.21.15.144:37346) 2024-09-11T23:21:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.924+0000 7f86c2400640 1 -- 172.21.15.144:0/2813710411 learned_addr learned my addr 172.21.15.144:0/2813710411 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.924+0000 7f86c1a00640 1 --2- 172.21.15.144:0/2813710411 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86bc0cf320 0x7f86bc148700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.924+0000 7f86c1000640 1 --2- 172.21.15.144:0/2813710411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86bc15d3b0 0x7f86bc0ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.925+0000 7f86c2400640 1 -- 172.21.15.144:0/2813710411 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86bc0cf320 msgr2=0x7f86bc148700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.925+0000 7f86c2400640 1 --2- 172.21.15.144:0/2813710411 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86bc0cf320 0x7f86bc148700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.925+0000 7f86c2400640 1 -- 172.21.15.144:0/2813710411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86bc15d3b0 msgr2=0x7f86bc0ad530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.925+0000 7f86c2400640 1 --2- 172.21.15.144:0/2813710411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86bc15d3b0 0x7f86bc0ad530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.925+0000 7f86c2400640 1 -- 172.21.15.144:0/2813710411 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86bc0adca0 con 0x7f86bc1451f0 2024-09-11T23:21:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.925+0000 7f86c1a00640 1 --2- 172.21.15.144:0/2813710411 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86bc0cf320 0x7f86bc148700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.925+0000 7f86c1000640 1 --2- 172.21.15.144:0/2813710411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86bc15d3b0 0x7f86bc0ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:39.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.925+0000 7f86c2400640 1 --2- 172.21.15.144:0/2813710411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86bc1451f0 0x7f86bc159ec0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f86b400cf20 tx=0x7f86b400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:39.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.925+0000 7f86b9600640 1 -- 172.21.15.144:0/2813710411 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b401a070 con 0x7f86bc1451f0 2024-09-11T23:21:39.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.925+0000 7f86b9600640 1 -- 172.21.15.144:0/2813710411 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86b400d840 con 0x7f86bc1451f0 2024-09-11T23:21:39.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.925+0000 7f86c4400640 1 -- 172.21.15.144:0/2813710411 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86bc0adf80 con 0x7f86bc1451f0 2024-09-11T23:21:39.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.925+0000 7f86b9600640 1 -- 172.21.15.144:0/2813710411 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b400dc30 con 0x7f86bc1451f0 2024-09-11T23:21:39.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.925+0000 7f86c4400640 1 -- 172.21.15.144:0/2813710411 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86bc0ae540 con 0x7f86bc1451f0 2024-09-11T23:21:39.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.926+0000 7f86c4400640 1 -- 172.21.15.144:0/2813710411 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86bc15cbf0 con 0x7f86bc1451f0 2024-09-11T23:21:39.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.927+0000 7f86b9600640 1 -- 172.21.15.144:0/2813710411 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f86b401d070 con 0x7f86bc1451f0 2024-09-11T23:21:39.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.928+0000 7f86b9600640 1 --2- 172.21.15.144:0/2813710411 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f869c06c190 0x7f869c06e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:39.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.928+0000 7f86b9600640 1 -- 172.21.15.144:0/2813710411 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7f86b408b8b0 con 0x7f86bc1451f0 2024-09-11T23:21:39.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.928+0000 7f86c1a00640 1 --2- 172.21.15.144:0/2813710411 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f869c06c190 0x7f869c06e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:39.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.929+0000 7f86c1a00640 1 --2- 172.21.15.144:0/2813710411 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f869c06c190 0x7f869c06e650 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f86b0034000 tx=0x7f86b002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:39.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:39.933+0000 7f86b9600640 1 -- 172.21.15.144:0/2813710411 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f86b405a1e0 con 0x7f86bc1451f0 2024-09-11T23:21:40.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.105+0000 7f86c4400640 1 -- 172.21.15.144:0/2813710411 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f86bc072090 con 0x7f86bc1451f0 2024-09-11T23:21:40.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.105+0000 7f86b9600640 1 -- 172.21.15.144:0/2813710411 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) ==== 93+0+10 (secure 0 0 0) 0x7f86b4059ae0 con 0x7f86bc1451f0 2024-09-11T23:21:40.105 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-11T23:21:40.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.108+0000 7f86c4400640 1 -- 172.21.15.144:0/2813710411 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f869c06c190 msgr2=0x7f869c06e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:40.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.108+0000 7f86c4400640 1 --2- 172.21.15.144:0/2813710411 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f869c06c190 0x7f869c06e650 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f86b0034000 tx=0x7f86b002e000 comp rx=0 tx=0).stop 2024-09-11T23:21:40.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.108+0000 7f86c4400640 1 -- 172.21.15.144:0/2813710411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86bc1451f0 msgr2=0x7f86bc159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:40.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.108+0000 7f86c4400640 1 --2- 172.21.15.144:0/2813710411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86bc1451f0 0x7f86bc159ec0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f86b400cf20 tx=0x7f86b400a7d0 comp rx=0 tx=0).stop 2024-09-11T23:21:40.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.108+0000 7f86c4400640 1 -- 172.21.15.144:0/2813710411 shutdown_connections 2024-09-11T23:21:40.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.108+0000 7f86c4400640 1 --2- 172.21.15.144:0/2813710411 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f869c06c190 0x7f869c06e650 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:40.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.108+0000 7f86c4400640 1 --2- 172.21.15.144:0/2813710411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86bc1451f0 0x7f86bc159ec0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:40.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.108+0000 7f86c4400640 1 --2- 172.21.15.144:0/2813710411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86bc15d3b0 0x7f86bc0ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:40.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.108+0000 7f86c4400640 1 --2- 172.21.15.144:0/2813710411 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86bc0cf320 0x7f86bc148700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:40.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.108+0000 7f86c4400640 1 -- 172.21.15.144:0/2813710411 >> 172.21.15.144:0/2813710411 conn(0x7f86bc06bba0 msgr2=0x7f86bc15db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:40.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.108+0000 7f86c4400640 1 -- 172.21.15.144:0/2813710411 shutdown_connections 2024-09-11T23:21:40.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.108+0000 7f86c4400640 1 -- 172.21.15.144:0/2813710411 wait complete. 2024-09-11T23:21:40.123 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction' 2024-09-11T23:21:40.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.278+0000 7f829c800640 1 Processor -- start 2024-09-11T23:21:40.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.278+0000 7f829c800640 1 -- start start 2024-09-11T23:21:40.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.279+0000 7f829c800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f82940d0a50 0x7f82941620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:40.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.280+0000 7f829c800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f829415fd30 0x7f82940b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:40.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.280+0000 7f829c800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82941625f0 con 0x7f82940b4930 2024-09-11T23:21:40.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.280+0000 7f829c800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8294160180 con 0x7f82940d0a50 2024-09-11T23:21:40.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.280+0000 7f829c800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f82940b52d0 con 0x7f829415fd30 2024-09-11T23:21:40.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.280+0000 7f8299e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f82940d0a50 0x7f82941620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:40.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.280+0000 7f8299400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f82940b4930 0x7f829415f620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58182/0 (socket says 172.21.15.144:58182) 2024-09-11T23:21:40.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.280+0000 7f8299400640 1 -- 172.21.15.144:0/2449395420 learned_addr learned my addr 172.21.15.144:0/2449395420 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:40.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.280+0000 7f829a800640 1 --2- 172.21.15.144:0/2449395420 >> v2:172.21.15.165:3300/0 conn(0x7f829415fd30 0x7f82940b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:40.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.280+0000 7f8299e00640 1 -- 172.21.15.144:0/2449395420 >> v2:172.21.15.165:3300/0 conn(0x7f829415fd30 msgr2=0x7f82940b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:40.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.280+0000 7f8299e00640 1 --2- 172.21.15.144:0/2449395420 >> v2:172.21.15.165:3300/0 conn(0x7f829415fd30 0x7f82940b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:40.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.280+0000 7f8299e00640 1 -- 172.21.15.144:0/2449395420 >> v1:172.21.15.144:6789/0 conn(0x7f82940b4930 legacy=0x7f829415f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:40.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.280+0000 7f8299e00640 1 -- 172.21.15.144:0/2449395420 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8294162870 con 0x7f82940d0a50 2024-09-11T23:21:40.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.280+0000 7f829a800640 1 --2- 172.21.15.144:0/2449395420 >> v2:172.21.15.165:3300/0 conn(0x7f829415fd30 0x7f82940b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:40.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.281+0000 7f8299e00640 1 --2- 172.21.15.144:0/2449395420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82940d0a50 0x7f82941620b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f82940d13d0 tx=0x7f828802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b108fad2c8537 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:40.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.281+0000 7f8298a00640 1 -- 172.21.15.144:0/2449395420 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288037070 con 0x7f82940d0a50 2024-09-11T23:21:40.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.282+0000 7f8298a00640 1 -- 172.21.15.144:0/2449395420 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8288032440 con 0x7f82940d0a50 2024-09-11T23:21:40.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.282+0000 7f8298a00640 1 -- 172.21.15.144:0/2449395420 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828802ae60 con 0x7f82940d0a50 2024-09-11T23:21:40.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.282+0000 7f829c800640 1 -- 172.21.15.144:0/2449395420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82940d0a50 msgr2=0x7f82941620b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:40.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.282+0000 7f829c800640 1 --2- 172.21.15.144:0/2449395420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82940d0a50 0x7f82941620b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f82940d13d0 tx=0x7f828802a110 comp rx=0 tx=0).stop 2024-09-11T23:21:40.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.282+0000 7f829c800640 1 -- 172.21.15.144:0/2449395420 shutdown_connections 2024-09-11T23:21:40.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.282+0000 7f829c800640 1 --2- 172.21.15.144:0/2449395420 >> v2:172.21.15.165:3300/0 conn(0x7f829415fd30 0x7f82940b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:40.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.282+0000 7f829c800640 1 --2- 172.21.15.144:0/2449395420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82940d0a50 0x7f82941620b0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:40.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.282+0000 7f829c800640 1 -- 172.21.15.144:0/2449395420 >> 172.21.15.144:0/2449395420 conn(0x7f8294062cc0 msgr2=0x7f829406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:40.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.282+0000 7f829c800640 1 -- 172.21.15.144:0/2449395420 shutdown_connections 2024-09-11T23:21:40.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.282+0000 7f829c800640 1 -- 172.21.15.144:0/2449395420 wait complete. 2024-09-11T23:21:40.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.284+0000 7f829c800640 1 Processor -- start 2024-09-11T23:21:40.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.284+0000 7f829c800640 1 -- start start 2024-09-11T23:21:40.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.285+0000 7f829c800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82940b4930 0x7f829414ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:40.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.285+0000 7f829c800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f829415fd30 0x7f829415a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:40.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.285+0000 7f829c800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82941599f0 0x7f829415d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:40.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.285+0000 7f829c800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f82940b3340 con 0x7f82940b4930 2024-09-11T23:21:40.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.285+0000 7f829c800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8294162e30 con 0x7f82941599f0 2024-09-11T23:21:40.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.285+0000 7f829c800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f82940b3620 con 0x7f829415fd30 2024-09-11T23:21:40.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.285+0000 7f8299e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82940b4930 0x7f829414ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:40.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.285+0000 7f8299e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82940b4930 0x7f829414ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37376/0 (socket says 172.21.15.144:37376) 2024-09-11T23:21:40.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.285+0000 7f8299e00640 1 -- 172.21.15.144:0/3150994504 learned_addr learned my addr 172.21.15.144:0/3150994504 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:40.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.285+0000 7f829a800640 1 --2- 172.21.15.144:0/3150994504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82941599f0 0x7f829415d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:40.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.285+0000 7f8299400640 1 --2- 172.21.15.144:0/3150994504 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f829415fd30 0x7f829415a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:40.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.285+0000 7f8299e00640 1 -- 172.21.15.144:0/3150994504 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f829415fd30 msgr2=0x7f829415a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:40.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.285+0000 7f8299e00640 1 --2- 172.21.15.144:0/3150994504 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f829415fd30 0x7f829415a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:40.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.285+0000 7f8299e00640 1 -- 172.21.15.144:0/3150994504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82941599f0 msgr2=0x7f829415d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:40.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.285+0000 7f8299e00640 1 --2- 172.21.15.144:0/3150994504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82941599f0 0x7f829415d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:40.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.285+0000 7f8299e00640 1 -- 172.21.15.144:0/3150994504 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8294159eb0 con 0x7f82940b4930 2024-09-11T23:21:40.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.285+0000 7f829a800640 1 --2- 172.21.15.144:0/3150994504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82941599f0 0x7f829415d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:40.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.285+0000 7f8299400640 1 --2- 172.21.15.144:0/3150994504 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f829415fd30 0x7f829415a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:40.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.286+0000 7f8299e00640 1 --2- 172.21.15.144:0/3150994504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82940b4930 0x7f829414ae50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8288009890 tx=0x7f82880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:40.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.286+0000 7f828e000640 1 -- 172.21.15.144:0/3150994504 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288037040 con 0x7f82940b4930 2024-09-11T23:21:40.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.286+0000 7f828e000640 1 -- 172.21.15.144:0/3150994504 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8288042070 con 0x7f82940b4930 2024-09-11T23:21:40.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.286+0000 7f828e000640 1 -- 172.21.15.144:0/3150994504 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288030a50 con 0x7f82940b4930 2024-09-11T23:21:40.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.286+0000 7f829c800640 1 -- 172.21.15.144:0/3150994504 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8294158920 con 0x7f82940b4930 2024-09-11T23:21:40.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.286+0000 7f829c800640 1 -- 172.21.15.144:0/3150994504 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8294158ee0 con 0x7f82940b4930 2024-09-11T23:21:40.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.287+0000 7f829c800640 1 -- 172.21.15.144:0/3150994504 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f829415a8c0 con 0x7f82940b4930 2024-09-11T23:21:40.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.288+0000 7f828e000640 1 -- 172.21.15.144:0/3150994504 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f8288030bf0 con 0x7f82940b4930 2024-09-11T23:21:40.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.289+0000 7f828e000640 1 --2- 172.21.15.144:0/3150994504 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f827806c190 0x7f827806e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:40.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.290+0000 7f828e000640 1 -- 172.21.15.144:0/3150994504 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7f82880abaf0 con 0x7f82940b4930 2024-09-11T23:21:40.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.290+0000 7f8299400640 1 --2- 172.21.15.144:0/3150994504 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f827806c190 0x7f827806e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:40.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.290+0000 7f8299400640 1 --2- 172.21.15.144:0/3150994504 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f827806c190 0x7f827806e650 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8294158170 tx=0x7f8284009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:40.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.294+0000 7f828e000640 1 -- 172.21.15.144:0/3150994504 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8288045360 con 0x7f82940b4930 2024-09-11T23:21:40.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:40.531+0000 7f829c800640 1 -- 172.21.15.144:0/3150994504 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]} v 0) -- 0x7f82941620b0 con 0x7f82940b4930 2024-09-11T23:21:41.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.381+0000 7f828e000640 1 -- 172.21.15.144:0/3150994504 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]}]=0 v203) ==== 134+0+0 (secure 0 0 0) 0x7f828807a420 con 0x7f82940b4930 2024-09-11T23:21:41.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.384+0000 7f829c800640 1 -- 172.21.15.144:0/3150994504 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f827806c190 msgr2=0x7f827806e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:41.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.384+0000 7f829c800640 1 --2- 172.21.15.144:0/3150994504 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f827806c190 0x7f827806e650 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8294158170 tx=0x7f8284009040 comp rx=0 tx=0).stop 2024-09-11T23:21:41.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.384+0000 7f829c800640 1 -- 172.21.15.144:0/3150994504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82940b4930 msgr2=0x7f829414ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:41.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.384+0000 7f829c800640 1 --2- 172.21.15.144:0/3150994504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82940b4930 0x7f829414ae50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8288009890 tx=0x7f82880046c0 comp rx=0 tx=0).stop 2024-09-11T23:21:41.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.384+0000 7f829c800640 1 -- 172.21.15.144:0/3150994504 shutdown_connections 2024-09-11T23:21:41.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.384+0000 7f829c800640 1 --2- 172.21.15.144:0/3150994504 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f827806c190 0x7f827806e650 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:41.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.384+0000 7f829c800640 1 --2- 172.21.15.144:0/3150994504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f82941599f0 0x7f829415d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:41.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.384+0000 7f829c800640 1 --2- 172.21.15.144:0/3150994504 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f829415fd30 0x7f829415a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:41.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.384+0000 7f829c800640 1 --2- 172.21.15.144:0/3150994504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82940b4930 0x7f829414ae50 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:41.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.384+0000 7f829c800640 1 -- 172.21.15.144:0/3150994504 >> 172.21.15.144:0/3150994504 conn(0x7f8294062cc0 msgr2=0x7f82940cc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:41.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.384+0000 7f829c800640 1 -- 172.21.15.144:0/3150994504 shutdown_connections 2024-09-11T23:21:41.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.384+0000 7f829c800640 1 -- 172.21.15.144:0/3150994504 wait complete. 2024-09-11T23:21:41.403 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:21:41.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.562+0000 7f1fd0a00640 1 Processor -- start 2024-09-11T23:21:41.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.562+0000 7f1fd0a00640 1 -- start start 2024-09-11T23:21:41.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.563+0000 7f1fd0a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1fcc15d3b0 0x7f1fcc071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:41.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.563+0000 7f1fd0a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fcc0715c0 con 0x7f1fcc0cf320 2024-09-11T23:21:41.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.564+0000 7f1fd0a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fcc06d700 con 0x7f1fcc15d790 2024-09-11T23:21:41.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.564+0000 7f1fd0a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1fcc06da30 con 0x7f1fcc15d3b0 2024-09-11T23:21:41.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.564+0000 7f1fc9e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1fcc15d3b0 0x7f1fcc071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:41.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.564+0000 7f1fca800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1fcc0cf320 0x7f1fcc0cf790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:58184/0 (socket says 172.21.15.144:58184) 2024-09-11T23:21:41.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.564+0000 7f1fca800640 1 -- 172.21.15.144:0/4086675712 learned_addr learned my addr 172.21.15.144:0/4086675712 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:41.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.564+0000 7f1fc9e00640 1 -- 172.21.15.144:0/4086675712 >> v1:172.21.15.165:6789/0 conn(0x7f1fcc15d790 legacy=0x7f1fcc0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:41.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.564+0000 7f1fc9e00640 1 -- 172.21.15.144:0/4086675712 >> v1:172.21.15.144:6789/0 conn(0x7f1fcc0cf320 legacy=0x7f1fcc0cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:41.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.564+0000 7f1fc9e00640 1 -- 172.21.15.144:0/4086675712 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fcc0cde80 con 0x7f1fcc15d3b0 2024-09-11T23:21:41.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.564+0000 7f1fc9400640 1 -- 172.21.15.144:0/4086675712 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2089804690 0 0) 0x7f1fcc0715c0 con 0x7f1fcc0cf320 2024-09-11T23:21:41.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.565+0000 7f1fc9e00640 1 --2- 172.21.15.144:0/4086675712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fcc15d3b0 0x7f1fcc071080 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0b5850 tx=0x7f1fbc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94ac8e9d4709ce5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:41.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.565+0000 7f1fc9400640 1 -- 172.21.15.144:0/4086675712 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc037070 con 0x7f1fcc15d3b0 2024-09-11T23:21:41.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.566+0000 7f1fc9400640 1 -- 172.21.15.144:0/4086675712 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fbc032440 con 0x7f1fcc15d3b0 2024-09-11T23:21:41.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.566+0000 7f1fc9400640 1 -- 172.21.15.144:0/4086675712 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc032810 con 0x7f1fcc15d3b0 2024-09-11T23:21:41.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.566+0000 7f1fd0a00640 1 -- 172.21.15.144:0/4086675712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fcc15d3b0 msgr2=0x7f1fcc071080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:41.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.566+0000 7f1fd0a00640 1 --2- 172.21.15.144:0/4086675712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fcc15d3b0 0x7f1fcc071080 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0b5850 tx=0x7f1fbc02a1c0 comp rx=0 tx=0).stop 2024-09-11T23:21:41.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.566+0000 7f1fd0a00640 1 -- 172.21.15.144:0/4086675712 shutdown_connections 2024-09-11T23:21:41.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.566+0000 7f1fd0a00640 1 --2- 172.21.15.144:0/4086675712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fcc15d3b0 0x7f1fcc071080 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:41.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.566+0000 7f1fd0a00640 1 -- 172.21.15.144:0/4086675712 >> 172.21.15.144:0/4086675712 conn(0x7f1fcc06bba0 msgr2=0x7f1fcc06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:41.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.566+0000 7f1fd0a00640 1 -- 172.21.15.144:0/4086675712 shutdown_connections 2024-09-11T23:21:41.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.566+0000 7f1fd0a00640 1 -- 172.21.15.144:0/4086675712 wait complete. 2024-09-11T23:21:41.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.568+0000 7f1fd0a00640 1 Processor -- start 2024-09-11T23:21:41.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.568+0000 7f1fd0a00640 1 -- start start 2024-09-11T23:21:41.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.569+0000 7f1fd0a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1fcc0cf320 0x7f1fcc1567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:41.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.569+0000 7f1fd0a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1fcc15d3b0 0x7f1fcc157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:41.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.569+0000 7f1fd0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fcc158e50 0x7f1fcc0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:41.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.569+0000 7f1fd0a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc0cd580 con 0x7f1fcc158e50 2024-09-11T23:21:41.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.569+0000 7f1fd0a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc0cdba0 con 0x7f1fcc15d3b0 2024-09-11T23:21:41.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.569+0000 7f1fd0a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1fcc15cbf0 con 0x7f1fcc0cf320 2024-09-11T23:21:41.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.569+0000 7f1fca800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fcc158e50 0x7f1fcc0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:41.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.569+0000 7f1fca800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fcc158e50 0x7f1fcc0ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37388/0 (socket says 172.21.15.144:37388) 2024-09-11T23:21:41.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.569+0000 7f1fca800640 1 -- 172.21.15.144:0/2206612989 learned_addr learned my addr 172.21.15.144:0/2206612989 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:41.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.569+0000 7f1fc9e00640 1 --2- 172.21.15.144:0/2206612989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1fcc0cf320 0x7f1fcc1567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:41.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.569+0000 7f1fc1400640 1 --2- 172.21.15.144:0/2206612989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1fcc15d3b0 0x7f1fcc157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:41.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.569+0000 7f1fca800640 1 -- 172.21.15.144:0/2206612989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1fcc0cf320 msgr2=0x7f1fcc1567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:41.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.569+0000 7f1fca800640 1 --2- 172.21.15.144:0/2206612989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1fcc0cf320 0x7f1fcc1567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:41.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.569+0000 7f1fca800640 1 -- 172.21.15.144:0/2206612989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1fcc15d3b0 msgr2=0x7f1fcc157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:41.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.569+0000 7f1fca800640 1 --2- 172.21.15.144:0/2206612989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1fcc15d3b0 0x7f1fcc157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:41.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.569+0000 7f1fca800640 1 -- 172.21.15.144:0/2206612989 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fcc0b3730 con 0x7f1fcc158e50 2024-09-11T23:21:41.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.569+0000 7f1fc9e00640 1 --2- 172.21.15.144:0/2206612989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1fcc0cf320 0x7f1fcc1567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:41.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.570+0000 7f1fca800640 1 --2- 172.21.15.144:0/2206612989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fcc158e50 0x7f1fcc0ae8e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400c7a0 tx=0x7f1fc400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:41.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.570+0000 7f1fc2a00640 1 -- 172.21.15.144:0/2206612989 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4018070 con 0x7f1fcc158e50 2024-09-11T23:21:41.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.570+0000 7f1fc2a00640 1 -- 172.21.15.144:0/2206612989 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fc400a640 con 0x7f1fcc158e50 2024-09-11T23:21:41.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.570+0000 7f1fd0a00640 1 -- 172.21.15.144:0/2206612989 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fcc159310 con 0x7f1fcc158e50 2024-09-11T23:21:41.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.570+0000 7f1fc2a00640 1 -- 172.21.15.144:0/2206612989 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc400aab0 con 0x7f1fcc158e50 2024-09-11T23:21:41.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.570+0000 7f1fd0a00640 1 -- 172.21.15.144:0/2206612989 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fcc1598d0 con 0x7f1fcc158e50 2024-09-11T23:21:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.571+0000 7f1fd0a00640 1 -- 172.21.15.144:0/2206612989 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fcc0cec80 con 0x7f1fcc158e50 2024-09-11T23:21:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.572+0000 7f1fc2a00640 1 -- 172.21.15.144:0/2206612989 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f1fc401b070 con 0x7f1fcc158e50 2024-09-11T23:21:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.573+0000 7f1fc2a00640 1 --2- 172.21.15.144:0/2206612989 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1fa806c190 0x7f1fa806e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.573+0000 7f1fc2a00640 1 -- 172.21.15.144:0/2206612989 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7f1fc408a870 con 0x7f1fcc158e50 2024-09-11T23:21:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.573+0000 7f1fc9e00640 1 --2- 172.21.15.144:0/2206612989 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1fa806c190 0x7f1fa806e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:41.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.574+0000 7f1fc9e00640 1 --2- 172.21.15.144:0/2206612989 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1fa806c190 0x7f1fa806e650 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc034000 tx=0x7f1fbc02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:41.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.577+0000 7f1fc2a00640 1 -- 172.21.15.144:0/2206612989 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1fcc0cec80 con 0x7f1fcc158e50 2024-09-11T23:21:41.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.751+0000 7f1fd0a00640 1 -- 172.21.15.144:0/2206612989 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f1fcc0b3900 con 0x7f1fcc158e50 2024-09-11T23:21:41.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.756+0000 7f1fc2a00640 1 -- 172.21.15.144:0/2206612989 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f1fc4058f80 con 0x7f1fcc158e50 2024-09-11T23:21:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.759+0000 7f1fd0a00640 1 -- 172.21.15.144:0/2206612989 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1fa806c190 msgr2=0x7f1fa806e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.759+0000 7f1fd0a00640 1 --2- 172.21.15.144:0/2206612989 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1fa806c190 0x7f1fa806e650 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc034000 tx=0x7f1fbc02e000 comp rx=0 tx=0).stop 2024-09-11T23:21:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.759+0000 7f1fd0a00640 1 -- 172.21.15.144:0/2206612989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fcc158e50 msgr2=0x7f1fcc0ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.759+0000 7f1fd0a00640 1 --2- 172.21.15.144:0/2206612989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fcc158e50 0x7f1fcc0ae8e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400c7a0 tx=0x7f1fc400cc60 comp rx=0 tx=0).stop 2024-09-11T23:21:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.759+0000 7f1fd0a00640 1 -- 172.21.15.144:0/2206612989 shutdown_connections 2024-09-11T23:21:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.759+0000 7f1fd0a00640 1 --2- 172.21.15.144:0/2206612989 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1fa806c190 0x7f1fa806e650 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.759+0000 7f1fd0a00640 1 --2- 172.21.15.144:0/2206612989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fcc158e50 0x7f1fcc0ae8e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.759+0000 7f1fd0a00640 1 --2- 172.21.15.144:0/2206612989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1fcc15d3b0 0x7f1fcc157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.759+0000 7f1fd0a00640 1 --2- 172.21.15.144:0/2206612989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1fcc0cf320 0x7f1fcc1567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:41.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.759+0000 7f1fd0a00640 1 -- 172.21.15.144:0/2206612989 >> 172.21.15.144:0/2206612989 conn(0x7f1fcc06bba0 msgr2=0x7f1fcc15e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:41.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.759+0000 7f1fd0a00640 1 -- 172.21.15.144:0/2206612989 shutdown_connections 2024-09-11T23:21:41.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:41.759+0000 7f1fd0a00640 1 -- 172.21.15.144:0/2206612989 wait complete. 2024-09-11T23:21:41.775 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:21:41.775 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:21:41.859 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:21:41.953 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:21:41.954 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:21:41.954 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:21:41.990 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:21:41.990 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:21:41.990 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:21:42.026 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:21:42.027 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:21:42.027 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:21:42.065 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:21:42.065 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:21:42.065 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:21:42.103 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:21:42.103 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T23:21:42.103 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:21:42.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.258+0000 7fd66c400640 1 Processor -- start 2024-09-11T23:21:42.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.258+0000 7fd66c400640 1 -- start start 2024-09-11T23:21:42.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.260+0000 7fd66c400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd6640d0a50 0x7fd6641620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:42.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.260+0000 7fd66c400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd6640b4930 0x7fd6640b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:42.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.260+0000 7fd66c400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd66415f620 0x7fd66415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:42.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.260+0000 7fd66c400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd6640b52d0 con 0x7fd6640b4930 2024-09-11T23:21:42.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.260+0000 7fd66c400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd6641625f0 con 0x7fd6640d0a50 2024-09-11T23:21:42.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.260+0000 7fd66c400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd664162870 con 0x7fd66415f620 2024-09-11T23:21:42.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.260+0000 7fd669000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd6640b4930 0x7fd6640b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:42.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.260+0000 7fd669000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd6640b4930 0x7fd6640b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37400/0 (socket says 172.21.15.144:37400) 2024-09-11T23:21:42.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.260+0000 7fd669000640 1 -- 172.21.15.144:0/295031860 learned_addr learned my addr 172.21.15.144:0/295031860 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:42.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.260+0000 7fd66a400640 1 --2- 172.21.15.144:0/295031860 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd66415f620 0x7fd66415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:42.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.260+0000 7fd669a00640 1 --2- 172.21.15.144:0/295031860 >> v2:172.21.15.165:3300/0 conn(0x7fd6640d0a50 0x7fd6641620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:42.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.260+0000 7fd669000640 1 -- 172.21.15.144:0/295031860 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd66415f620 msgr2=0x7fd66415fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:42.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.260+0000 7fd669000640 1 --2- 172.21.15.144:0/295031860 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd66415f620 0x7fd66415fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:42.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.260+0000 7fd669000640 1 -- 172.21.15.144:0/295031860 >> v2:172.21.15.165:3300/0 conn(0x7fd6640d0a50 msgr2=0x7fd6641620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:42.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.260+0000 7fd669000640 1 --2- 172.21.15.144:0/295031860 >> v2:172.21.15.165:3300/0 conn(0x7fd6640d0a50 0x7fd6641620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:42.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.261+0000 7fd669000640 1 -- 172.21.15.144:0/295031860 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd664162b50 con 0x7fd6640b4930 2024-09-11T23:21:42.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.261+0000 7fd669a00640 1 --2- 172.21.15.144:0/295031860 >> v2:172.21.15.165:3300/0 conn(0x7fd6640d0a50 0x7fd6641620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:42.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.262+0000 7fd669000640 1 --2- 172.21.15.144:0/295031860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6640b4930 0x7fd6640b4d90 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd66406cc40 tx=0x7fd65002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd63165293140e83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:42.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.262+0000 7fd663e00640 1 -- 172.21.15.144:0/295031860 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd650037070 con 0x7fd6640b4930 2024-09-11T23:21:42.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.262+0000 7fd663e00640 1 -- 172.21.15.144:0/295031860 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd650032440 con 0x7fd6640b4930 2024-09-11T23:21:42.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.262+0000 7fd663e00640 1 -- 172.21.15.144:0/295031860 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd650032810 con 0x7fd6640b4930 2024-09-11T23:21:42.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.262+0000 7fd66c400640 1 -- 172.21.15.144:0/295031860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6640b4930 msgr2=0x7fd6640b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:42.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.262+0000 7fd66c400640 1 --2- 172.21.15.144:0/295031860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6640b4930 0x7fd6640b4d90 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd66406cc40 tx=0x7fd65002a140 comp rx=0 tx=0).stop 2024-09-11T23:21:42.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.262+0000 7fd66c400640 1 -- 172.21.15.144:0/295031860 shutdown_connections 2024-09-11T23:21:42.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.262+0000 7fd66c400640 1 --2- 172.21.15.144:0/295031860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6640b4930 0x7fd6640b4d90 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:42.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.262+0000 7fd66c400640 1 --2- 172.21.15.144:0/295031860 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd66415f620 0x7fd66415fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:42.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.262+0000 7fd66c400640 1 --2- 172.21.15.144:0/295031860 >> v2:172.21.15.165:3300/0 conn(0x7fd6640d0a50 0x7fd6641620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:42.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.262+0000 7fd66c400640 1 -- 172.21.15.144:0/295031860 >> 172.21.15.144:0/295031860 conn(0x7fd664062cc0 msgr2=0x7fd66406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:42.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.263+0000 7fd66c400640 1 -- 172.21.15.144:0/295031860 shutdown_connections 2024-09-11T23:21:42.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.263+0000 7fd66c400640 1 -- 172.21.15.144:0/295031860 wait complete. 2024-09-11T23:21:42.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.264+0000 7fd66c400640 1 Processor -- start 2024-09-11T23:21:42.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.264+0000 7fd66c400640 1 -- start start 2024-09-11T23:21:42.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.265+0000 7fd66c400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6640b4930 0x7fd6641f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:42.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.265+0000 7fd66c400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd66415f620 0x7fd664157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:42.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.265+0000 7fd66c400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd664159bc0 0x7fd66415a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:42.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.265+0000 7fd66c400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd6640b3620 con 0x7fd66415f620 2024-09-11T23:21:42.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.265+0000 7fd66c400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd6640b3340 con 0x7fd6640b4930 2024-09-11T23:21:42.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.265+0000 7fd66c400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd66415fff0 con 0x7fd664159bc0 2024-09-11T23:21:42.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.265+0000 7fd669000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd66415f620 0x7fd664157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:42.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.265+0000 7fd669000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd66415f620 0x7fd664157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37414/0 (socket says 172.21.15.144:37414) 2024-09-11T23:21:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.265+0000 7fd669000640 1 -- 172.21.15.144:0/213605923 learned_addr learned my addr 172.21.15.144:0/213605923 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.265+0000 7fd66a400640 1 --2- 172.21.15.144:0/213605923 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd664159bc0 0x7fd66415a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.265+0000 7fd669a00640 1 --2- 172.21.15.144:0/213605923 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6640b4930 0x7fd6641f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.266+0000 7fd669000640 1 -- 172.21.15.144:0/213605923 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd664159bc0 msgr2=0x7fd66415a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.266+0000 7fd669000640 1 --2- 172.21.15.144:0/213605923 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd664159bc0 0x7fd66415a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.266+0000 7fd669000640 1 -- 172.21.15.144:0/213605923 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6640b4930 msgr2=0x7fd6641f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.266+0000 7fd669000640 1 --2- 172.21.15.144:0/213605923 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6640b4930 0x7fd6641f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.266+0000 7fd669000640 1 -- 172.21.15.144:0/213605923 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6641e8070 con 0x7fd66415f620 2024-09-11T23:21:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.266+0000 7fd669000640 1 --2- 172.21.15.144:0/213605923 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd66415f620 0x7fd664157a40 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd65002a180 tx=0x7fd6500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.266+0000 7fd661600640 1 -- 172.21.15.144:0/213605923 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd650037040 con 0x7fd66415f620 2024-09-11T23:21:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.266+0000 7fd661600640 1 -- 172.21.15.144:0/213605923 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd650042070 con 0x7fd66415f620 2024-09-11T23:21:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.266+0000 7fd661600640 1 -- 172.21.15.144:0/213605923 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd650030880 con 0x7fd66415f620 2024-09-11T23:21:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.266+0000 7fd66c400640 1 -- 172.21.15.144:0/213605923 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6641e8350 con 0x7fd66415f620 2024-09-11T23:21:42.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.267+0000 7fd66c400640 1 -- 172.21.15.144:0/213605923 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6641e8910 con 0x7fd66415f620 2024-09-11T23:21:42.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.268+0000 7fd66c400640 1 -- 172.21.15.144:0/213605923 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6641620b0 con 0x7fd66415f620 2024-09-11T23:21:42.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.268+0000 7fd661600640 1 -- 172.21.15.144:0/213605923 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7fd650030a20 con 0x7fd66415f620 2024-09-11T23:21:42.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.269+0000 7fd661600640 1 --2- 172.21.15.144:0/213605923 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd64406c190 0x7fd64406e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:42.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.269+0000 7fd661600640 1 -- 172.21.15.144:0/213605923 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7fd6500ab860 con 0x7fd66415f620 2024-09-11T23:21:42.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.270+0000 7fd669a00640 1 --2- 172.21.15.144:0/213605923 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd64406c190 0x7fd64406e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:42.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.270+0000 7fd669a00640 1 --2- 172.21.15.144:0/213605923 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd64406c190 0x7fd64406e650 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd664158680 tx=0x7fd658008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:42.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.274+0000 7fd661600640 1 -- 172.21.15.144:0/213605923 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd650079a70 con 0x7fd66415f620 2024-09-11T23:21:42.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.485+0000 7fd66c400640 1 -- 172.21.15.144:0/213605923 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6640b3be0 con 0x7fd66415f620 2024-09-11T23:21:42.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.486+0000 7fd661600640 1 -- 172.21.15.144:0/213605923 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+3923 (secure 0 0 0) 0x7fd65007dd70 con 0x7fd66415f620 2024-09-11T23:21:42.486 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:42.486 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":38,"btime":"2024-09-11T23:21:36:061223+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/2161458369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2161458369},{"type":"v1","addr":"172.21.15.144:6836","nonce":2161458369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":5150,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/2242935376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2242935376},{"type":"v1","addr":"172.21.15.165:6833","nonce":2242935376}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":5156,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3703078361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":3703078361},{"type":"v1","addr":"172.21.15.165:6835","nonce":3703078361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":6000,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/2735690056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":2735690056},{"type":"v1","addr":"172.21.15.144:6837","nonce":2735690056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[]} 2024-09-11T23:21:42.486 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 38 2024-09-11T23:21:42.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.488+0000 7fd66c400640 1 -- 172.21.15.144:0/213605923 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd64406c190 msgr2=0x7fd64406e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:42.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.488+0000 7fd66c400640 1 --2- 172.21.15.144:0/213605923 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd64406c190 0x7fd64406e650 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd664158680 tx=0x7fd658008040 comp rx=0 tx=0).stop 2024-09-11T23:21:42.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.488+0000 7fd66c400640 1 -- 172.21.15.144:0/213605923 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd66415f620 msgr2=0x7fd664157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:42.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.488+0000 7fd66c400640 1 --2- 172.21.15.144:0/213605923 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd66415f620 0x7fd664157a40 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd65002a180 tx=0x7fd6500046c0 comp rx=0 tx=0).stop 2024-09-11T23:21:42.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.488+0000 7fd66c400640 1 -- 172.21.15.144:0/213605923 shutdown_connections 2024-09-11T23:21:42.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.488+0000 7fd66c400640 1 --2- 172.21.15.144:0/213605923 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fd64406c190 0x7fd64406e650 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:42.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.488+0000 7fd66c400640 1 --2- 172.21.15.144:0/213605923 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd664159bc0 0x7fd66415a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:42.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.488+0000 7fd66c400640 1 --2- 172.21.15.144:0/213605923 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd66415f620 0x7fd664157a40 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:42.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.488+0000 7fd66c400640 1 --2- 172.21.15.144:0/213605923 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6640b4930 0x7fd6641f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:42.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.488+0000 7fd66c400640 1 -- 172.21.15.144:0/213605923 >> 172.21.15.144:0/213605923 conn(0x7fd664062cc0 msgr2=0x7fd6640cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:42.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.488+0000 7fd66c400640 1 -- 172.21.15.144:0/213605923 shutdown_connections 2024-09-11T23:21:42.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:42.488+0000 7fd66c400640 1 -- 172.21.15.144:0/213605923 wait complete. 2024-09-11T23:21:42.504 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:21:42.504 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:21:42.505 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:21:42.505 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:42.505 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:21:42.505 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T23:21:42.505 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:21:42.505 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:42.506 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:21:42.506 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:21:42.506 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:21:42.506 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:42.506 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:21:42.506 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T23:21:42.506 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:21:42.507 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:21:42.519 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:21:42.520 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:21:42.520 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:21:42.521 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:21:42.523 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:21:42.523 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:21:42.564 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:21:42.564 DEBUG:teuthology.parallel:result is None 2024-09-11T23:21:42.566 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:21:42.566 DEBUG:teuthology.parallel:result is None 2024-09-11T23:21:42.568 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:21:42.568 DEBUG:teuthology.parallel:result is None 2024-09-11T23:21:42.691 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-11T23:21:42.692 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-11T23:21:42.697 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-11T23:21:43.789 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:21:43.794 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:21:45.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-11T23:21:48.523 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:21:48.523 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:21:48.528 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:21:48.528 DEBUG:teuthology.parallel:result is None 2024-09-11T23:21:48.529 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:21:48.663 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-11T23:21:48.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.695+0000 7f17f3e00640 1 Processor -- start 2024-09-11T23:21:48.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.695+0000 7f17f3e00640 1 -- start start 2024-09-11T23:21:48.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.697+0000 7f17f3e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17ec0d02a0 0x7f17ec0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:48.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.697+0000 7f17f3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f17ec15ca40 0x7f17ec15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:48.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.697+0000 7f17f3e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17ec0d0bc0 con 0x7f17ec15ce80 2024-09-11T23:21:48.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.697+0000 7f17f3e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f17ec15d390 con 0x7f17ec15ca40 2024-09-11T23:21:48.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.697+0000 7f17f3e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f17ec15d670 con 0x7f17ec0d02a0 2024-09-11T23:21:48.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.697+0000 7f17f0a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f17ec15ca40 0x7f17ec15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:48.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.697+0000 7f17f1e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f17ec15ce80 0x7f17ec1594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37488/0 (socket says 172.21.15.144:37488) 2024-09-11T23:21:48.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.697+0000 7f17f1e00640 1 -- 172.21.15.144:0/3073992925 learned_addr learned my addr 172.21.15.144:0/3073992925 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:48.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.697+0000 7f17f1400640 1 --2- 172.21.15.144:0/3073992925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17ec0d02a0 0x7f17ec0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:48.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.697+0000 7f17f0a00640 1 -- 172.21.15.144:0/3073992925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17ec0d02a0 msgr2=0x7f17ec0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:48.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.697+0000 7f17f0a00640 1 --2- 172.21.15.144:0/3073992925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17ec0d02a0 0x7f17ec0d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:48.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.697+0000 7f17f0a00640 1 -- 172.21.15.144:0/3073992925 >> v1:172.21.15.144:6789/0 conn(0x7f17ec15ce80 legacy=0x7f17ec1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:48.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.697+0000 7f17f0a00640 1 -- 172.21.15.144:0/3073992925 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ec15d950 con 0x7f17ec15ca40 2024-09-11T23:21:48.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.697+0000 7f17ebe00640 1 -- 172.21.15.144:0/3073992925 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3879067849 0 0) 0x7f17ec0d0bc0 con 0x7f17ec15ce80 2024-09-11T23:21:48.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.698+0000 7f17f0a00640 1 --2- 172.21.15.144:0/3073992925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ec15ca40 0x7f17ec15e430 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f17d80097d0 tx=0x7f17d802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908320ccdfb2c209 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:48.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.699+0000 7f17ebe00640 1 -- 172.21.15.144:0/3073992925 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d8037070 con 0x7f17ec15ca40 2024-09-11T23:21:48.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.699+0000 7f17ebe00640 1 -- 172.21.15.144:0/3073992925 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d802ae40 con 0x7f17ec15ca40 2024-09-11T23:21:48.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.699+0000 7f17ebe00640 1 -- 172.21.15.144:0/3073992925 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d8032660 con 0x7f17ec15ca40 2024-09-11T23:21:48.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.699+0000 7f17f3e00640 1 -- 172.21.15.144:0/3073992925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ec15ca40 msgr2=0x7f17ec15e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:48.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.699+0000 7f17f3e00640 1 --2- 172.21.15.144:0/3073992925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ec15ca40 0x7f17ec15e430 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f17d80097d0 tx=0x7f17d802a130 comp rx=0 tx=0).stop 2024-09-11T23:21:48.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.699+0000 7f17f3e00640 1 -- 172.21.15.144:0/3073992925 shutdown_connections 2024-09-11T23:21:48.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.699+0000 7f17f3e00640 1 --2- 172.21.15.144:0/3073992925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ec15ca40 0x7f17ec15e430 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:48.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.699+0000 7f17f3e00640 1 --2- 172.21.15.144:0/3073992925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17ec0d02a0 0x7f17ec0d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:48.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.699+0000 7f17f3e00640 1 -- 172.21.15.144:0/3073992925 >> 172.21.15.144:0/3073992925 conn(0x7f17ec062cc0 msgr2=0x7f17ec06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:48.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.699+0000 7f17f3e00640 1 -- 172.21.15.144:0/3073992925 shutdown_connections 2024-09-11T23:21:48.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.699+0000 7f17f3e00640 1 -- 172.21.15.144:0/3073992925 wait complete. 2024-09-11T23:21:48.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.701+0000 7f17f3e00640 1 Processor -- start 2024-09-11T23:21:48.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.701+0000 7f17f3e00640 1 -- start start 2024-09-11T23:21:48.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.702+0000 7f17f3e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17ec0d02a0 0x7f17ec15a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:48.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.702+0000 7f17f3e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17ec15ca40 0x7f17ec15acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:48.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.702+0000 7f17f3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ec15ce80 0x7f17ec0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:48.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.702+0000 7f17f3e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec155b90 con 0x7f17ec15ce80 2024-09-11T23:21:48.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.702+0000 7f17f3e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec15df10 con 0x7f17ec15ca40 2024-09-11T23:21:48.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.702+0000 7f17f3e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f17ec155d10 con 0x7f17ec0d02a0 2024-09-11T23:21:48.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.702+0000 7f17f1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ec15ce80 0x7f17ec0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:48.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.702+0000 7f17f1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ec15ce80 0x7f17ec0ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46300/0 (socket says 172.21.15.144:46300) 2024-09-11T23:21:48.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.702+0000 7f17f1e00640 1 -- 172.21.15.144:0/971980621 learned_addr learned my addr 172.21.15.144:0/971980621 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:48.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.702+0000 7f17f1400640 1 --2- 172.21.15.144:0/971980621 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17ec0d02a0 0x7f17ec15a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:48.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.702+0000 7f17f0a00640 1 --2- 172.21.15.144:0/971980621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17ec15ca40 0x7f17ec15acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:48.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.702+0000 7f17f1e00640 1 -- 172.21.15.144:0/971980621 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17ec0d02a0 msgr2=0x7f17ec15a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:48.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.702+0000 7f17f1e00640 1 --2- 172.21.15.144:0/971980621 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17ec0d02a0 0x7f17ec15a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:48.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.702+0000 7f17f1e00640 1 -- 172.21.15.144:0/971980621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17ec15ca40 msgr2=0x7f17ec15acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:48.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.702+0000 7f17f1e00640 1 --2- 172.21.15.144:0/971980621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17ec15ca40 0x7f17ec15acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:48.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.702+0000 7f17f1e00640 1 -- 172.21.15.144:0/971980621 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ec15b340 con 0x7f17ec15ce80 2024-09-11T23:21:48.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.703+0000 7f17f1e00640 1 --2- 172.21.15.144:0/971980621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ec15ce80 0x7f17ec0ae8e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f17e400c730 tx=0x7f17e400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:48.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.703+0000 7f17e9600640 1 -- 172.21.15.144:0/971980621 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e4018070 con 0x7f17ec15ce80 2024-09-11T23:21:48.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.703+0000 7f17e9600640 1 -- 172.21.15.144:0/971980621 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e400ce40 con 0x7f17ec15ce80 2024-09-11T23:21:48.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.703+0000 7f17e9600640 1 -- 172.21.15.144:0/971980621 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e400a860 con 0x7f17ec15ce80 2024-09-11T23:21:48.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.703+0000 7f17f3e00640 1 -- 172.21.15.144:0/971980621 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17ec15b620 con 0x7f17ec15ce80 2024-09-11T23:21:48.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.703+0000 7f17f3e00640 1 -- 172.21.15.144:0/971980621 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17ec15bbe0 con 0x7f17ec15ce80 2024-09-11T23:21:48.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.704+0000 7f17f3e00640 1 -- 172.21.15.144:0/971980621 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17ec0b4790 con 0x7f17ec15ce80 2024-09-11T23:21:48.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.705+0000 7f17e9600640 1 -- 172.21.15.144:0/971980621 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f17e401b070 con 0x7f17ec15ce80 2024-09-11T23:21:48.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.706+0000 7f17e9600640 1 --2- 172.21.15.144:0/971980621 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f17cc06c1c0 0x7f17cc06e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:48.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.706+0000 7f17e9600640 1 -- 172.21.15.144:0/971980621 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4943+0+0 (secure 0 0 0) 0x7f17e408a650 con 0x7f17ec15ce80 2024-09-11T23:21:48.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.706+0000 7f17f1400640 1 --2- 172.21.15.144:0/971980621 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f17cc06c1c0 0x7f17cc06e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:48.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.707+0000 7f17f1400640 1 --2- 172.21.15.144:0/971980621 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f17cc06c1c0 0x7f17cc06e680 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f17e0006fd0 tx=0x7f17e0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:48.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.710+0000 7f17e9600640 1 -- 172.21.15.144:0/971980621 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f17e40587f0 con 0x7f17ec15ce80 2024-09-11T23:21:48.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:48.897+0000 7f17f3e00640 1 -- 172.21.15.144:0/971980621 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f17ec166300 con 0x7f17ec15ce80 2024-09-11T23:21:50.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.415+0000 7f17e9600640 1 -- 172.21.15.144:0/971980621 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v67) ==== 97+0+0 (secure 0 0 0) 0x7f17e405caf0 con 0x7f17ec15ce80 2024-09-11T23:21:50.415 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-11T23:21:50.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.419+0000 7f17f3e00640 1 -- 172.21.15.144:0/971980621 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f17cc06c1c0 msgr2=0x7f17cc06e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:50.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.419+0000 7f17f3e00640 1 --2- 172.21.15.144:0/971980621 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f17cc06c1c0 0x7f17cc06e680 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f17e0006fd0 tx=0x7f17e0008040 comp rx=0 tx=0).stop 2024-09-11T23:21:50.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.419+0000 7f17f3e00640 1 -- 172.21.15.144:0/971980621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ec15ce80 msgr2=0x7f17ec0ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:50.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.419+0000 7f17f3e00640 1 --2- 172.21.15.144:0/971980621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ec15ce80 0x7f17ec0ae8e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f17e400c730 tx=0x7f17e400cbf0 comp rx=0 tx=0).stop 2024-09-11T23:21:50.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.419+0000 7f17f3e00640 1 -- 172.21.15.144:0/971980621 shutdown_connections 2024-09-11T23:21:50.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.419+0000 7f17f3e00640 1 --2- 172.21.15.144:0/971980621 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f17cc06c1c0 0x7f17cc06e680 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:50.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.419+0000 7f17f3e00640 1 --2- 172.21.15.144:0/971980621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ec15ce80 0x7f17ec0ae8e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:50.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.419+0000 7f17f3e00640 1 --2- 172.21.15.144:0/971980621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17ec15ca40 0x7f17ec15acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:50.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.419+0000 7f17f3e00640 1 --2- 172.21.15.144:0/971980621 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f17ec0d02a0 0x7f17ec15a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:50.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.419+0000 7f17f3e00640 1 -- 172.21.15.144:0/971980621 >> 172.21.15.144:0/971980621 conn(0x7f17ec062cc0 msgr2=0x7f17ec0b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:50.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.419+0000 7f17f3e00640 1 -- 172.21.15.144:0/971980621 shutdown_connections 2024-09-11T23:21:50.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.419+0000 7f17f3e00640 1 -- 172.21.15.144:0/971980621 wait complete. 2024-09-11T23:21:50.438 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:21:50.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.596+0000 7fb35dc00640 1 Processor -- start 2024-09-11T23:21:50.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.596+0000 7fb35dc00640 1 -- start start 2024-09-11T23:21:50.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.597+0000 7fb35dc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb35815e7b0 0x7fb358071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:50.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.597+0000 7fb35dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb3580b5600 0x7fb358073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:50.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.597+0000 7fb35dc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb358073ff0 0x7fb35806ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:50.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.597+0000 7fb35dc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb35806e680 con 0x7fb35815e7b0 2024-09-11T23:21:50.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.597+0000 7fb35dc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb358071880 con 0x7fb358073ff0 2024-09-11T23:21:50.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.597+0000 7fb35dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb35806e8d0 con 0x7fb3580b5600 2024-09-11T23:21:50.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.597+0000 7fb356a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb35815e7b0 0x7fb358071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:50.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.598+0000 7fb356a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb35815e7b0 0x7fb358071340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46314/0 (socket says 172.21.15.144:46314) 2024-09-11T23:21:50.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.598+0000 7fb356a00640 1 -- 172.21.15.144:0/864777028 learned_addr learned my addr 172.21.15.144:0/864777028 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:50.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.598+0000 7fb356000640 1 --2- 172.21.15.144:0/864777028 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb3580b5600 0x7fb358073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:50.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.598+0000 7fb357400640 1 --2- 172.21.15.144:0/864777028 >> v2:172.21.15.165:3300/0 conn(0x7fb358073ff0 0x7fb35806ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:50.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.598+0000 7fb356a00640 1 -- 172.21.15.144:0/864777028 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb3580b5600 msgr2=0x7fb358073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:50.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.598+0000 7fb356a00640 1 --2- 172.21.15.144:0/864777028 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb3580b5600 0x7fb358073ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:50.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.598+0000 7fb356a00640 1 -- 172.21.15.144:0/864777028 >> v2:172.21.15.165:3300/0 conn(0x7fb358073ff0 msgr2=0x7fb35806ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:50.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.598+0000 7fb356a00640 1 --2- 172.21.15.144:0/864777028 >> v2:172.21.15.165:3300/0 conn(0x7fb358073ff0 0x7fb35806ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:50.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.598+0000 7fb356a00640 1 -- 172.21.15.144:0/864777028 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35806ebb0 con 0x7fb35815e7b0 2024-09-11T23:21:50.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.599+0000 7fb356a00640 1 --2- 172.21.15.144:0/864777028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb35815e7b0 0x7fb358071340 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb3580b6540 tx=0x7fb34802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661b01f955d2adf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:50.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.599+0000 7fb355600640 1 -- 172.21.15.144:0/864777028 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb348037070 con 0x7fb35815e7b0 2024-09-11T23:21:50.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.599+0000 7fb355600640 1 -- 172.21.15.144:0/864777028 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb348032440 con 0x7fb35815e7b0 2024-09-11T23:21:50.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.599+0000 7fb355600640 1 -- 172.21.15.144:0/864777028 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb348032810 con 0x7fb35815e7b0 2024-09-11T23:21:50.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.600+0000 7fb35dc00640 1 -- 172.21.15.144:0/864777028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb35815e7b0 msgr2=0x7fb358071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:50.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.600+0000 7fb35dc00640 1 --2- 172.21.15.144:0/864777028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb35815e7b0 0x7fb358071340 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb3580b6540 tx=0x7fb34802a140 comp rx=0 tx=0).stop 2024-09-11T23:21:50.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.600+0000 7fb35dc00640 1 -- 172.21.15.144:0/864777028 shutdown_connections 2024-09-11T23:21:50.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.600+0000 7fb35dc00640 1 --2- 172.21.15.144:0/864777028 >> v2:172.21.15.165:3300/0 conn(0x7fb358073ff0 0x7fb35806ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:50.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.600+0000 7fb35dc00640 1 --2- 172.21.15.144:0/864777028 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb3580b5600 0x7fb358073ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:50.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.600+0000 7fb35dc00640 1 --2- 172.21.15.144:0/864777028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb35815e7b0 0x7fb358071340 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:50.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.600+0000 7fb35dc00640 1 -- 172.21.15.144:0/864777028 >> 172.21.15.144:0/864777028 conn(0x7fb3580b4300 msgr2=0x7fb3580b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:50.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.600+0000 7fb35dc00640 1 -- 172.21.15.144:0/864777028 shutdown_connections 2024-09-11T23:21:50.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.600+0000 7fb35dc00640 1 -- 172.21.15.144:0/864777028 wait complete. 2024-09-11T23:21:50.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.602+0000 7fb35dc00640 1 Processor -- start 2024-09-11T23:21:50.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.602+0000 7fb35dc00640 1 -- start start 2024-09-11T23:21:50.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.603+0000 7fb35dc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb3580b5600 0x7fb3580cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:50.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.603+0000 7fb35dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb35815e7b0 0x7fb35814b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:50.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.603+0000 7fb35dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3580ce960 0x7fb3580cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:50.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.603+0000 7fb35dc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb35806d1f0 con 0x7fb3580ce960 2024-09-11T23:21:50.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.603+0000 7fb35dc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb358073590 con 0x7fb3580b5600 2024-09-11T23:21:50.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.603+0000 7fb35dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb35806d370 con 0x7fb35815e7b0 2024-09-11T23:21:50.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.603+0000 7fb357400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3580ce960 0x7fb3580cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:50.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.603+0000 7fb357400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3580ce960 0x7fb3580cedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46324/0 (socket says 172.21.15.144:46324) 2024-09-11T23:21:50.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.603+0000 7fb357400640 1 -- 172.21.15.144:0/243090752 learned_addr learned my addr 172.21.15.144:0/243090752 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:50.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.603+0000 7fb356000640 1 --2- 172.21.15.144:0/243090752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb35815e7b0 0x7fb35814b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:50.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.603+0000 7fb356a00640 1 --2- 172.21.15.144:0/243090752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb3580b5600 0x7fb3580cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:50.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.603+0000 7fb357400640 1 -- 172.21.15.144:0/243090752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb35815e7b0 msgr2=0x7fb35814b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:50.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.603+0000 7fb357400640 1 --2- 172.21.15.144:0/243090752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb35815e7b0 0x7fb35814b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:50.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.603+0000 7fb357400640 1 -- 172.21.15.144:0/243090752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb3580b5600 msgr2=0x7fb3580cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:50.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.603+0000 7fb357400640 1 --2- 172.21.15.144:0/243090752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb3580b5600 0x7fb3580cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:50.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.603+0000 7fb357400640 1 -- 172.21.15.144:0/243090752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35815c320 con 0x7fb3580ce960 2024-09-11T23:21:50.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.604+0000 7fb357400640 1 --2- 172.21.15.144:0/243090752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3580ce960 0x7fb3580cedf0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb350007d60 tx=0x7fb35000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:50.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.604+0000 7fb34ea00640 1 -- 172.21.15.144:0/243090752 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350014420 con 0x7fb3580ce960 2024-09-11T23:21:50.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.604+0000 7fb34ea00640 1 -- 172.21.15.144:0/243090752 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb350019070 con 0x7fb3580ce960 2024-09-11T23:21:50.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.604+0000 7fb35dc00640 1 -- 172.21.15.144:0/243090752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3580d2170 con 0x7fb3580ce960 2024-09-11T23:21:50.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.604+0000 7fb34ea00640 1 -- 172.21.15.144:0/243090752 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350014820 con 0x7fb3580ce960 2024-09-11T23:21:50.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.604+0000 7fb35dc00640 1 -- 172.21.15.144:0/243090752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb35815c8c0 con 0x7fb3580ce960 2024-09-11T23:21:50.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.605+0000 7fb35dc00640 1 -- 172.21.15.144:0/243090752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb358157750 con 0x7fb3580ce960 2024-09-11T23:21:50.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.606+0000 7fb34ea00640 1 -- 172.21.15.144:0/243090752 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7fb3500149c0 con 0x7fb3580ce960 2024-09-11T23:21:50.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.607+0000 7fb34ea00640 1 --2- 172.21.15.144:0/243090752 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb33806c1c0 0x7fb33806e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:50.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.607+0000 7fb34ea00640 1 -- 172.21.15.144:0/243090752 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 4857+0+0 (secure 0 0 0) 0x7fb35008b730 con 0x7fb3580ce960 2024-09-11T23:21:50.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.607+0000 7fb356a00640 1 --2- 172.21.15.144:0/243090752 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb33806c1c0 0x7fb33806e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:50.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.608+0000 7fb356a00640 1 --2- 172.21.15.144:0/243090752 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb33806c1c0 0x7fb33806e680 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb348034000 tx=0x7fb34802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:50.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.611+0000 7fb34ea00640 1 -- 172.21.15.144:0/243090752 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb358157750 con 0x7fb3580ce960 2024-09-11T23:21:50.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.848+0000 7fb35dc00640 1 -- 172.21.15.144:0/243090752 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb358073ab0 con 0x7fb3580ce960 2024-09-11T23:21:50.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.848+0000 7fb34ea00640 1 -- 172.21.15.144:0/243090752 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5615 (secure 0 0 0) 0x7fb35005a070 con 0x7fb3580ce960 2024-09-11T23:21:50.848 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:50.849 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:21:50.849 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-11T23:21:50.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:50.849 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-11T23:21:50.849 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmQjymBhAA4BWEVNGY37RsnMGLL3Ow8A==", 2024-09-11T23:21:50.849 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:50.849 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:21:50.849 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:21:50.849 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:21:50.849 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:21:50.849 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:21:50.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:50.850 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-11T23:21:50.850 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmD0mIGhAAvug7T/kOcEmnyMyG++V+zA==", 2024-09-11T23:21:50.850 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:50.850 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:21:50.850 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:21:50.850 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:21:50.850 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:21:50.850 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:21:50.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:50.850 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-11T23:21:50.850 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmDwSZEBAAdf4eF3MrADSPzBTICzpOiA==", 2024-09-11T23:21:50.850 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:50.851 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:21:50.851 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:21:50.851 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:21:50.851 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:21:50.851 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:21:50.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:50.851 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-11T23:21:50.851 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmqYtRJBAAgpzvHNUPVnxNoflhqVIJuQ==", 2024-09-11T23:21:50.851 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:50.851 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:21:50.851 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:21:50.851 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:21:50.851 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:21:50.851 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:21:50.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:50.852 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-11T23:21:50.852 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDiJOJmzDABABAA+Qa772+Mm69pecG0QUXlyA==", 2024-09-11T23:21:50.852 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:50.852 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:21:50.852 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:21:50.852 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:21:50.852 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:21:50.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:50.852 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-11T23:21:50.852 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDlJOJmgVjJKRAAtl30JxJHurKdrn1vLUneww==", 2024-09-11T23:21:50.853 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:50.853 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:21:50.853 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:21:50.853 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:21:50.853 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:21:50.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:50.853 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-11T23:21:50.853 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDpJOJmRzO6FxAAiLDOwDlXYTj6WfEhlI+uVQ==", 2024-09-11T23:21:50.853 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:50.853 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:21:50.853 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:21:50.853 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:21:50.854 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:21:50.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:50.854 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-11T23:21:50.854 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDtJOJmVFh6EhAA7hcJn4k31nEPMcqiB7+djA==", 2024-09-11T23:21:50.854 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:50.854 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:21:50.854 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:21:50.854 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:21:50.854 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:21:50.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:50.854 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-11T23:21:50.854 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD0JOJmpIFTAhAAYQyoBrMjL6CcDDCNAOMGwQ==", 2024-09-11T23:21:50.854 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:50.855 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:21:50.855 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:21:50.855 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:21:50.855 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:21:50.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:50.855 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-11T23:21:50.855 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD4JOJmBAIIDhAA8G/usUslfQPNpFP1YZsgmg==", 2024-09-11T23:21:50.855 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:50.855 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:21:50.855 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:21:50.855 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:21:50.856 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:21:50.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:50.856 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-11T23:21:50.856 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD8JOJmDl2dCBAA5bL+2AIp0uWL4qjpI/mAdQ==", 2024-09-11T23:21:50.856 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:50.856 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:21:50.856 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:21:50.856 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:21:50.856 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:21:50.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:50.856 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-11T23:21:50.856 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAAJeJmMWX+AhAA7ABVgJPwhRZNkPNdZzmnOQ==", 2024-09-11T23:21:50.856 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:50.857 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:21:50.857 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:21:50.857 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:21:50.857 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:21:50.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:50.857 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-11T23:21:50.857 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A==", 2024-09-11T23:21:50.857 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:50.857 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:21:50.857 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-11T23:21:50.857 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T23:21:50.857 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:21:50.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:50.858 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-11T23:21:50.858 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmLFrBORAAT64lj0sWlVoTHVUZQf0JjA==", 2024-09-11T23:21:50.858 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:50.858 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:21:50.858 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:21:50.858 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:21:50.858 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:21:50.858 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:21:50.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:50.858 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-11T23:21:50.858 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJm2/dLMxAAbuKdVAbscrlF5jcBnouBOQ==", 2024-09-11T23:21:50.858 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:50.859 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:21:50.859 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:21:50.859 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:21:50.859 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:21:50.859 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:21:50.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:50.859 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-11T23:21:50.859 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDfJOJmse6UBBAAq+3afsp+2jApe9sTFmVVOw==", 2024-09-11T23:21:50.859 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:50.859 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:21:50.859 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:21:50.859 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:21:50.859 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:21:50.860 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:21:50.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:50.860 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-11T23:21:50.860 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmHmAwEhAAEGCvu0NgtyjIPcJBk6bkdA==", 2024-09-11T23:21:50.860 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:50.860 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:21:50.860 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:21:50.860 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:21:50.860 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:21:50.860 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:21:50.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:50.860 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.alice", 2024-09-11T23:21:50.861 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDxJeJmbWIGAhAA7tlMrQTqRIUBbuYsEW7iiw==", 2024-09-11T23:21:50.861 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:50.861 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow rw path=/volumes/_nogroup/subvol360", 2024-09-11T23:21:50.861 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-11T23:21:50.861 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw pool=cephfs_data" 2024-09-11T23:21:50.861 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:21:50.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:50.861 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-11T23:21:50.861 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmxMaVOxAA62zJwlyk0qdrsemalijH4Q==", 2024-09-11T23:21:50.861 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:50.861 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:21:50.861 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:21:50.861 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:21:50.862 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:21:50.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:50.862 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-11T23:21:50.862 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmWZRNNBAAwZ2GCP7mGn87ZSnsKCcDRQ==", 2024-09-11T23:21:50.862 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:21:50.862 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:21:50.862 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:21:50.862 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:21:50.862 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.862 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:50.862 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:21:50.862 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:21:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.851+0000 7fb35dc00640 1 -- 172.21.15.144:0/243090752 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb33806c1c0 msgr2=0x7fb33806e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.851+0000 7fb35dc00640 1 --2- 172.21.15.144:0/243090752 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb33806c1c0 0x7fb33806e680 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb348034000 tx=0x7fb34802e000 comp rx=0 tx=0).stop 2024-09-11T23:21:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.851+0000 7fb35dc00640 1 -- 172.21.15.144:0/243090752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3580ce960 msgr2=0x7fb3580cedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.851+0000 7fb35dc00640 1 --2- 172.21.15.144:0/243090752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3580ce960 0x7fb3580cedf0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb350007d60 tx=0x7fb35000e4b0 comp rx=0 tx=0).stop 2024-09-11T23:21:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.851+0000 7fb35dc00640 1 -- 172.21.15.144:0/243090752 shutdown_connections 2024-09-11T23:21:50.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.851+0000 7fb35dc00640 1 --2- 172.21.15.144:0/243090752 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb33806c1c0 0x7fb33806e680 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:50.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.851+0000 7fb35dc00640 1 --2- 172.21.15.144:0/243090752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb3580ce960 0x7fb3580cedf0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:50.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.851+0000 7fb35dc00640 1 --2- 172.21.15.144:0/243090752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb35815e7b0 0x7fb35814b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:50.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.851+0000 7fb35dc00640 1 --2- 172.21.15.144:0/243090752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb3580b5600 0x7fb3580cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:50.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.851+0000 7fb35dc00640 1 -- 172.21.15.144:0/243090752 >> 172.21.15.144:0/243090752 conn(0x7fb3580b4300 msgr2=0x7fb35815f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:50.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.851+0000 7fb35dc00640 1 -- 172.21.15.144:0/243090752 shutdown_connections 2024-09-11T23:21:50.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:50.851+0000 7fb35dc00640 1 -- 172.21.15.144:0/243090752 wait complete. 2024-09-11T23:21:50.867 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.alice 2024-09-11T23:21:51.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.020+0000 7feed4400640 1 Processor -- start 2024-09-11T23:21:51.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.021+0000 7feed4400640 1 -- start start 2024-09-11T23:21:51.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.022+0000 7feed4400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7feecc15c180 0x7feecc0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:51.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.022+0000 7feed4400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feecc0ce230 0x7feecc0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:51.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.022+0000 7feed4400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feecc0ce740 con 0x7feecc0cf5b0 2024-09-11T23:21:51.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.022+0000 7feed4400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7feecc072640 con 0x7feecc15c180 2024-09-11T23:21:51.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.022+0000 7feed4400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7feecc072920 con 0x7feecc0ce230 2024-09-11T23:21:51.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.022+0000 7feed1000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feecc0ce230 0x7feecc0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:51.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.022+0000 7feed1a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7feecc15c180 0x7feecc0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:51.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.022+0000 7feed1000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feecc0ce230 0x7feecc0cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:41066/0 (socket says 172.21.15.144:41066) 2024-09-11T23:21:51.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.022+0000 7feed2400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7feecc0cf5b0 0x7feecc073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:38308/0 (socket says 172.21.15.144:38308) 2024-09-11T23:21:51.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.022+0000 7feed1000640 1 -- 172.21.15.144:0/50769454 learned_addr learned my addr 172.21.15.144:0/50769454 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:51.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.022+0000 7feed1a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7feecc15c180 0x7feecc0cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:56462/0 (socket says 172.21.15.144:56462) 2024-09-11T23:21:51.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.023+0000 7feed1a00640 1 -- 172.21.15.144:0/50769454 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feecc0ce230 msgr2=0x7feecc0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:51.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.023+0000 7feed1a00640 1 --2- 172.21.15.144:0/50769454 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feecc0ce230 0x7feecc0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.023+0000 7feed1a00640 1 -- 172.21.15.144:0/50769454 >> v1:172.21.15.165:6789/0 conn(0x7feecc0cf5b0 legacy=0x7feecc073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:51.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.023+0000 7feed1a00640 1 -- 172.21.15.144:0/50769454 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feecc072c00 con 0x7feecc15c180 2024-09-11T23:21:51.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.024+0000 7feed1a00640 1 --2- 172.21.15.144:0/50769454 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feecc15c180 0x7feecc0cdcf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7feec00097a0 tx=0x7feec002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d58fbe5149f4239c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:51.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.024+0000 7feecbe00640 1 -- 172.21.15.144:0/50769454 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec0037070 con 0x7feecc15c180 2024-09-11T23:21:51.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.024+0000 7feecbe00640 1 -- 172.21.15.144:0/50769454 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feec002ae50 con 0x7feecc15c180 2024-09-11T23:21:51.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.024+0000 7feecbe00640 1 -- 172.21.15.144:0/50769454 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec0032660 con 0x7feecc15c180 2024-09-11T23:21:51.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.025+0000 7feed4400640 1 -- 172.21.15.144:0/50769454 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feecc15c180 msgr2=0x7feecc0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:51.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.025+0000 7feed4400640 1 --2- 172.21.15.144:0/50769454 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feecc15c180 0x7feecc0cdcf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7feec00097a0 tx=0x7feec002a100 comp rx=0 tx=0).stop 2024-09-11T23:21:51.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.025+0000 7feed4400640 1 -- 172.21.15.144:0/50769454 shutdown_connections 2024-09-11T23:21:51.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.025+0000 7feed4400640 1 --2- 172.21.15.144:0/50769454 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feecc0ce230 0x7feecc0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.025+0000 7feed4400640 1 --2- 172.21.15.144:0/50769454 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feecc15c180 0x7feecc0cdcf0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.025+0000 7feed4400640 1 -- 172.21.15.144:0/50769454 >> 172.21.15.144:0/50769454 conn(0x7feecc062cc0 msgr2=0x7feecc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:51.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.025+0000 7feed4400640 1 -- 172.21.15.144:0/50769454 shutdown_connections 2024-09-11T23:21:51.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.025+0000 7feed4400640 1 -- 172.21.15.144:0/50769454 wait complete. 2024-09-11T23:21:51.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.026+0000 7feed4400640 1 Processor -- start 2024-09-11T23:21:51.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.027+0000 7feed4400640 1 -- start start 2024-09-11T23:21:51.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.027+0000 7feed4400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feecc0ce230 0x7feecc1f2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:51.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.027+0000 7feed4400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feecc0cf5b0 0x7feecc150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:51.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.027+0000 7feed4400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feecc15c180 0x7feecc0b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:51.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.028+0000 7feed4400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feecc15c560 con 0x7feecc0ce230 2024-09-11T23:21:51.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.028+0000 7feed4400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feecc0722f0 con 0x7feecc0cf5b0 2024-09-11T23:21:51.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.028+0000 7feed4400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7feecc15c6e0 con 0x7feecc15c180 2024-09-11T23:21:51.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.028+0000 7feed1a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feecc0ce230 0x7feecc1f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:51.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.028+0000 7feed1a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feecc0ce230 0x7feecc1f2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46334/0 (socket says 172.21.15.144:46334) 2024-09-11T23:21:51.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.028+0000 7feed1a00640 1 -- 172.21.15.144:0/2337896775 learned_addr learned my addr 172.21.15.144:0/2337896775 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:51.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.028+0000 7feed1a00640 1 -- 172.21.15.144:0/2337896775 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feecc15c180 msgr2=0x7feecc0b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:51.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.028+0000 7feed1a00640 1 --2- 172.21.15.144:0/2337896775 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feecc15c180 0x7feecc0b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.028+0000 7feed1000640 1 --2- 172.21.15.144:0/2337896775 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feecc0cf5b0 0x7feecc150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:51.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.028+0000 7feed1a00640 1 -- 172.21.15.144:0/2337896775 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feecc0cf5b0 msgr2=0x7feecc150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:51.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.028+0000 7feed1a00640 1 --2- 172.21.15.144:0/2337896775 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feecc0cf5b0 0x7feecc150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.028+0000 7feed1a00640 1 -- 172.21.15.144:0/2337896775 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feecc153270 con 0x7feecc0ce230 2024-09-11T23:21:51.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.028+0000 7feed1000640 1 --2- 172.21.15.144:0/2337896775 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feecc0cf5b0 0x7feecc150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:51.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.029+0000 7feed1a00640 1 --2- 172.21.15.144:0/2337896775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feecc0ce230 0x7feecc1f2590 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7feec0035040 tx=0x7feec00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:51.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.029+0000 7feec9600640 1 -- 172.21.15.144:0/2337896775 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec0041070 con 0x7feecc0ce230 2024-09-11T23:21:51.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.029+0000 7feec9600640 1 -- 172.21.15.144:0/2337896775 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feec003c460 con 0x7feecc0ce230 2024-09-11T23:21:51.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.029+0000 7feed4400640 1 -- 172.21.15.144:0/2337896775 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feecc153550 con 0x7feecc0ce230 2024-09-11T23:21:51.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.029+0000 7feec9600640 1 -- 172.21.15.144:0/2337896775 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec0037040 con 0x7feecc0ce230 2024-09-11T23:21:51.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.029+0000 7feed4400640 1 -- 172.21.15.144:0/2337896775 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feecc15e030 con 0x7feecc0ce230 2024-09-11T23:21:51.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.030+0000 7feed4400640 1 -- 172.21.15.144:0/2337896775 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feecc15db40 con 0x7feecc0ce230 2024-09-11T23:21:51.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.031+0000 7feec9600640 1 -- 172.21.15.144:0/2337896775 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7feec003a070 con 0x7feecc0ce230 2024-09-11T23:21:51.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.032+0000 7feec9600640 1 --2- 172.21.15.144:0/2337896775 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7feeac06c190 0x7feeac06e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:51.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.032+0000 7feec9600640 1 -- 172.21.15.144:0/2337896775 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 4857+0+0 (secure 0 0 0) 0x7feec00ab640 con 0x7feecc0ce230 2024-09-11T23:21:51.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.032+0000 7feed1000640 1 --2- 172.21.15.144:0/2337896775 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7feeac06c190 0x7feeac06e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:51.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.033+0000 7feed1000640 1 --2- 172.21.15.144:0/2337896775 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7feeac06c190 0x7feeac06e650 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7feecc153900 tx=0x7feeb8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:51.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.036+0000 7feec9600640 1 -- 172.21.15.144:0/2337896775 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feec0079f10 con 0x7feecc0ce230 2024-09-11T23:21:51.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.277+0000 7feed4400640 1 -- 172.21.15.144:0/2337896775 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.alice"} v 0) -- 0x7feecc0cf070 con 0x7feecc0ce230 2024-09-11T23:21:51.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.280+0000 7feec9600640 1 -- 172.21.15.144:0/2337896775 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.alice"}]=0 v13) ==== 82+0+0 (secure 0 0 0) 0x7feec00800e0 con 0x7feecc0ce230 2024-09-11T23:21:51.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.282+0000 7feed4400640 1 -- 172.21.15.144:0/2337896775 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7feeac06c190 msgr2=0x7feeac06e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:51.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.282+0000 7feed4400640 1 --2- 172.21.15.144:0/2337896775 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7feeac06c190 0x7feeac06e650 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7feecc153900 tx=0x7feeb8008040 comp rx=0 tx=0).stop 2024-09-11T23:21:51.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.282+0000 7feed4400640 1 -- 172.21.15.144:0/2337896775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feecc0ce230 msgr2=0x7feecc1f2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:51.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.282+0000 7feed4400640 1 --2- 172.21.15.144:0/2337896775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feecc0ce230 0x7feecc1f2590 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7feec0035040 tx=0x7feec00046c0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.282+0000 7feed4400640 1 -- 172.21.15.144:0/2337896775 shutdown_connections 2024-09-11T23:21:51.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.282+0000 7feed4400640 1 --2- 172.21.15.144:0/2337896775 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7feeac06c190 0x7feeac06e650 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.282+0000 7feed4400640 1 --2- 172.21.15.144:0/2337896775 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feecc15c180 0x7feecc0b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.282+0000 7feed4400640 1 --2- 172.21.15.144:0/2337896775 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feecc0cf5b0 0x7feecc150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.282+0000 7feed4400640 1 --2- 172.21.15.144:0/2337896775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feecc0ce230 0x7feecc1f2590 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.282+0000 7feed4400640 1 -- 172.21.15.144:0/2337896775 >> 172.21.15.144:0/2337896775 conn(0x7feecc062cc0 msgr2=0x7feecc0b24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:51.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.282+0000 7feed4400640 1 -- 172.21.15.144:0/2337896775 shutdown_connections 2024-09-11T23:21:51.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.282+0000 7feed4400640 1 -- 172.21.15.144:0/2337896775 wait complete. 2024-09-11T23:21:51.298 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:21:51.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.453+0000 7f937cc00640 1 Processor -- start 2024-09-11T23:21:51.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.453+0000 7f937cc00640 1 -- start start 2024-09-11T23:21:51.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.454+0000 7f937cc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f937815e940 0x7f93780d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:51.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.454+0000 7f937cc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f937815ed20 0x7f93780d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:51.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.454+0000 7f937cc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f93780cef90 0x7f93780b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:51.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.454+0000 7f937cc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f93780d1ae0 con 0x7f937815ed20 2024-09-11T23:21:51.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.454+0000 7f937cc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f93780b7170 con 0x7f93780cef90 2024-09-11T23:21:51.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.454+0000 7f937cc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f93780b7aa0 con 0x7f937815e940 2024-09-11T23:21:51.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.454+0000 7f9375400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f937815ed20 0x7f93780d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:51.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.454+0000 7f9375400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f937815ed20 0x7f93780d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46350/0 (socket says 172.21.15.144:46350) 2024-09-11T23:21:51.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.455+0000 7f9375400640 1 -- 172.21.15.144:0/2541582275 learned_addr learned my addr 172.21.15.144:0/2541582275 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:51.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.455+0000 7f9376800640 1 --2- 172.21.15.144:0/2541582275 >> v2:172.21.15.165:3300/0 conn(0x7f93780cef90 0x7f93780b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:51.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.455+0000 7f9375e00640 1 --2- 172.21.15.144:0/2541582275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f937815e940 0x7f93780d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:51.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.455+0000 7f9375400640 1 -- 172.21.15.144:0/2541582275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f937815e940 msgr2=0x7f93780d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:51.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.455+0000 7f9375400640 1 --2- 172.21.15.144:0/2541582275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f937815e940 0x7f93780d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.455+0000 7f9375400640 1 -- 172.21.15.144:0/2541582275 >> v2:172.21.15.165:3300/0 conn(0x7f93780cef90 msgr2=0x7f93780b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:51.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.455+0000 7f9375400640 1 --2- 172.21.15.144:0/2541582275 >> v2:172.21.15.165:3300/0 conn(0x7f93780cef90 0x7f93780b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.455+0000 7f9375400640 1 -- 172.21.15.144:0/2541582275 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93780d3660 con 0x7f937815ed20 2024-09-11T23:21:51.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.455+0000 7f9375e00640 1 --2- 172.21.15.144:0/2541582275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f937815e940 0x7f93780d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:51.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.456+0000 7f9375400640 1 --2- 172.21.15.144:0/2541582275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f937815ed20 0x7f93780d15a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9378073e20 tx=0x7f936402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8142aca77ba1ef0d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:51.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.456+0000 7f9374a00640 1 -- 172.21.15.144:0/2541582275 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364037070 con 0x7f937815ed20 2024-09-11T23:21:51.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.456+0000 7f9374a00640 1 -- 172.21.15.144:0/2541582275 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9364032440 con 0x7f937815ed20 2024-09-11T23:21:51.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.456+0000 7f9374a00640 1 -- 172.21.15.144:0/2541582275 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364032810 con 0x7f937815ed20 2024-09-11T23:21:51.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.457+0000 7f937cc00640 1 -- 172.21.15.144:0/2541582275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f937815ed20 msgr2=0x7f93780d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:51.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.457+0000 7f937cc00640 1 --2- 172.21.15.144:0/2541582275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f937815ed20 0x7f93780d15a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9378073e20 tx=0x7f936402a270 comp rx=0 tx=0).stop 2024-09-11T23:21:51.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.457+0000 7f937cc00640 1 -- 172.21.15.144:0/2541582275 shutdown_connections 2024-09-11T23:21:51.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.457+0000 7f937cc00640 1 --2- 172.21.15.144:0/2541582275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f937815ed20 0x7f93780d15a0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.457+0000 7f937cc00640 1 --2- 172.21.15.144:0/2541582275 >> v2:172.21.15.165:3300/0 conn(0x7f93780cef90 0x7f93780b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.457+0000 7f937cc00640 1 --2- 172.21.15.144:0/2541582275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f937815e940 0x7f93780d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.457+0000 7f937cc00640 1 -- 172.21.15.144:0/2541582275 >> 172.21.15.144:0/2541582275 conn(0x7f93780b6240 msgr2=0x7f93780b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:51.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.457+0000 7f937cc00640 1 -- 172.21.15.144:0/2541582275 shutdown_connections 2024-09-11T23:21:51.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.457+0000 7f937cc00640 1 -- 172.21.15.144:0/2541582275 wait complete. 2024-09-11T23:21:51.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.459+0000 7f937cc00640 1 Processor -- start 2024-09-11T23:21:51.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.459+0000 7f937cc00640 1 -- start start 2024-09-11T23:21:51.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.459+0000 7f937cc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f93780cef90 0x7f93781f85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:51.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.460+0000 7f937cc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f937815e940 0x7f93780b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:51.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.460+0000 7f937cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f937815ed20 0x7f93780cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:51.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.460+0000 7f937cc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f93780d3f00 con 0x7f937815ed20 2024-09-11T23:21:51.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.460+0000 7f937cc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f93780d3c20 con 0x7f937815e940 2024-09-11T23:21:51.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.460+0000 7f937cc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f93780d1ef0 con 0x7f93780cef90 2024-09-11T23:21:51.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.460+0000 7f9376800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f937815ed20 0x7f93780cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:51.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.460+0000 7f9376800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f937815ed20 0x7f93780cd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46362/0 (socket says 172.21.15.144:46362) 2024-09-11T23:21:51.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.460+0000 7f9376800640 1 -- 172.21.15.144:0/3119178580 learned_addr learned my addr 172.21.15.144:0/3119178580 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:51.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.460+0000 7f9375400640 1 --2- 172.21.15.144:0/3119178580 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f937815e940 0x7f93780b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:51.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.460+0000 7f9375e00640 1 --2- 172.21.15.144:0/3119178580 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f93780cef90 0x7f93781f85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:51.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.460+0000 7f9376800640 1 -- 172.21.15.144:0/3119178580 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f93780cef90 msgr2=0x7f93781f85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:51.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.460+0000 7f9376800640 1 --2- 172.21.15.144:0/3119178580 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f93780cef90 0x7f93781f85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.460+0000 7f9376800640 1 -- 172.21.15.144:0/3119178580 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f937815e940 msgr2=0x7f93780b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:51.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.460+0000 7f9376800640 1 --2- 172.21.15.144:0/3119178580 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f937815e940 0x7f93780b4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.460+0000 7f9376800640 1 -- 172.21.15.144:0/3119178580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93780cda90 con 0x7f937815ed20 2024-09-11T23:21:51.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.460+0000 7f9375400640 1 --2- 172.21.15.144:0/3119178580 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f937815e940 0x7f93780b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:51.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.460+0000 7f9375e00640 1 --2- 172.21.15.144:0/3119178580 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f93780cef90 0x7f93781f85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:51.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.461+0000 7f9376800640 1 --2- 172.21.15.144:0/3119178580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f937815ed20 0x7f93780cd260 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f937000eed0 tx=0x7f937000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:51.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.461+0000 7f936e000640 1 -- 172.21.15.144:0/3119178580 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9370018020 con 0x7f937815ed20 2024-09-11T23:21:51.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.461+0000 7f936e000640 1 -- 172.21.15.144:0/3119178580 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9370014400 con 0x7f937815ed20 2024-09-11T23:21:51.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.461+0000 7f937cc00640 1 -- 172.21.15.144:0/3119178580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93780cdd70 con 0x7f937815ed20 2024-09-11T23:21:51.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.461+0000 7f936e000640 1 -- 172.21.15.144:0/3119178580 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93700147f0 con 0x7f937815ed20 2024-09-11T23:21:51.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.461+0000 7f937cc00640 1 -- 172.21.15.144:0/3119178580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93780ce330 con 0x7f937815ed20 2024-09-11T23:21:51.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.462+0000 7f937cc00640 1 -- 172.21.15.144:0/3119178580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93780d1060 con 0x7f937815ed20 2024-09-11T23:21:51.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.463+0000 7f936e000640 1 -- 172.21.15.144:0/3119178580 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f9370005d10 con 0x7f937815ed20 2024-09-11T23:21:51.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.464+0000 7f936e000640 1 --2- 172.21.15.144:0/3119178580 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f935806c190 0x7f935806e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:51.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.464+0000 7f936e000640 1 -- 172.21.15.144:0/3119178580 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 4857+0+0 (secure 0 0 0) 0x7f937008b7d0 con 0x7f937815ed20 2024-09-11T23:21:51.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.464+0000 7f9375e00640 1 --2- 172.21.15.144:0/3119178580 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f935806c190 0x7f935806e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:51.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.465+0000 7f9375e00640 1 --2- 172.21.15.144:0/3119178580 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f935806c190 0x7f935806e650 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9368006fd0 tx=0x7f9368008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:51.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.468+0000 7f936e000640 1 -- 172.21.15.144:0/3119178580 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9370022070 con 0x7f937815ed20 2024-09-11T23:21:51.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.643+0000 7f937cc00640 1 -- 172.21.15.144:0/3119178580 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f93780ba6b0 con 0x7f937815ed20 2024-09-11T23:21:51.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.643+0000 7f936e000640 1 -- 172.21.15.144:0/3119178580 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v67) ==== 84+0+65 (secure 0 0 0) 0x7f9370059fb0 con 0x7f937815ed20 2024-09-11T23:21:51.643 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:51.643 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:21:51.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:21:51.643 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-11T23:21:51.643 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-11T23:21:51.644 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:21:51.644 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:21:51.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.645+0000 7f937cc00640 1 -- 172.21.15.144:0/3119178580 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f935806c190 msgr2=0x7f935806e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:51.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.645+0000 7f937cc00640 1 --2- 172.21.15.144:0/3119178580 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f935806c190 0x7f935806e650 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9368006fd0 tx=0x7f9368008040 comp rx=0 tx=0).stop 2024-09-11T23:21:51.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.645+0000 7f937cc00640 1 -- 172.21.15.144:0/3119178580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f937815ed20 msgr2=0x7f93780cd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:51.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.645+0000 7f937cc00640 1 --2- 172.21.15.144:0/3119178580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f937815ed20 0x7f93780cd260 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f937000eed0 tx=0x7f937000b480 comp rx=0 tx=0).stop 2024-09-11T23:21:51.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.645+0000 7f937cc00640 1 -- 172.21.15.144:0/3119178580 shutdown_connections 2024-09-11T23:21:51.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.645+0000 7f937cc00640 1 --2- 172.21.15.144:0/3119178580 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f935806c190 0x7f935806e650 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.645+0000 7f937cc00640 1 --2- 172.21.15.144:0/3119178580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f937815ed20 0x7f93780cd260 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.645+0000 7f937cc00640 1 --2- 172.21.15.144:0/3119178580 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f937815e940 0x7f93780b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.645+0000 7f937cc00640 1 --2- 172.21.15.144:0/3119178580 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f93780cef90 0x7f93781f85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.645+0000 7f937cc00640 1 -- 172.21.15.144:0/3119178580 >> 172.21.15.144:0/3119178580 conn(0x7f93780b6240 msgr2=0x7f93780cf630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:51.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.645+0000 7f937cc00640 1 -- 172.21.15.144:0/3119178580 shutdown_connections 2024-09-11T23:21:51.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.646+0000 7f937cc00640 1 -- 172.21.15.144:0/3119178580 wait complete. 2024-09-11T23:21:51.661 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:21:51.662 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:21:51.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.818+0000 7fc674200640 1 Processor -- start 2024-09-11T23:21:51.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.818+0000 7fc674200640 1 -- start start 2024-09-11T23:21:51.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.819+0000 7fc674200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc66c15b370 0x7fc66c072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:51.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.819+0000 7fc674200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc66c15f9f0 0x7fc66c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:51.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.819+0000 7fc674200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc66c06ef60 0x7fc66c071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:51.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.819+0000 7fc674200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc66c15fef0 con 0x7fc66c15f9f0 2024-09-11T23:21:51.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.819+0000 7fc674200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc66c15c970 con 0x7fc66c06ef60 2024-09-11T23:21:51.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.819+0000 7fc674200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc66c15bbb0 con 0x7fc66c15b370 2024-09-11T23:21:51.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.820+0000 7fc670e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc66c15f9f0 0x7fc66c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:51.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.820+0000 7fc670e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc66c15f9f0 0x7fc66c06ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46372/0 (socket says 172.21.15.144:46372) 2024-09-11T23:21:51.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.820+0000 7fc670e00640 1 -- 172.21.15.144:0/128057526 learned_addr learned my addr 172.21.15.144:0/128057526 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:51.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.820+0000 7fc671800640 1 --2- 172.21.15.144:0/128057526 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc66c15b370 0x7fc66c072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:51.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.820+0000 7fc672200640 1 --2- 172.21.15.144:0/128057526 >> v2:172.21.15.165:3300/0 conn(0x7fc66c06ef60 0x7fc66c071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:51.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.820+0000 7fc670e00640 1 -- 172.21.15.144:0/128057526 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc66c15b370 msgr2=0x7fc66c072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:51.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.820+0000 7fc670e00640 1 --2- 172.21.15.144:0/128057526 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc66c15b370 0x7fc66c072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.820+0000 7fc670e00640 1 -- 172.21.15.144:0/128057526 >> v2:172.21.15.165:3300/0 conn(0x7fc66c06ef60 msgr2=0x7fc66c071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:51.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.820+0000 7fc670e00640 1 --2- 172.21.15.144:0/128057526 >> v2:172.21.15.165:3300/0 conn(0x7fc66c06ef60 0x7fc66c071040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.820+0000 7fc670e00640 1 -- 172.21.15.144:0/128057526 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66c15be90 con 0x7fc66c15f9f0 2024-09-11T23:21:51.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.821+0000 7fc670e00640 1 --2- 172.21.15.144:0/128057526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c15f9f0 0x7fc66c06ea20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc66c070fd0 tx=0x7fc65802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4555daf4f9ddf78a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:51.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.821+0000 7fc66be00640 1 -- 172.21.15.144:0/128057526 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc658037070 con 0x7fc66c15f9f0 2024-09-11T23:21:51.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.822+0000 7fc66be00640 1 -- 172.21.15.144:0/128057526 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc658032440 con 0x7fc66c15f9f0 2024-09-11T23:21:51.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.822+0000 7fc66be00640 1 -- 172.21.15.144:0/128057526 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc658032810 con 0x7fc66c15f9f0 2024-09-11T23:21:51.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.822+0000 7fc674200640 1 -- 172.21.15.144:0/128057526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c15f9f0 msgr2=0x7fc66c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:51.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.822+0000 7fc674200640 1 --2- 172.21.15.144:0/128057526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c15f9f0 0x7fc66c06ea20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc66c070fd0 tx=0x7fc65802a140 comp rx=0 tx=0).stop 2024-09-11T23:21:51.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.822+0000 7fc674200640 1 -- 172.21.15.144:0/128057526 shutdown_connections 2024-09-11T23:21:51.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.822+0000 7fc674200640 1 --2- 172.21.15.144:0/128057526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c15f9f0 0x7fc66c06ea20 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.822+0000 7fc674200640 1 --2- 172.21.15.144:0/128057526 >> v2:172.21.15.165:3300/0 conn(0x7fc66c06ef60 0x7fc66c071040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.822+0000 7fc674200640 1 --2- 172.21.15.144:0/128057526 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc66c15b370 0x7fc66c072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.822+0000 7fc674200640 1 -- 172.21.15.144:0/128057526 >> 172.21.15.144:0/128057526 conn(0x7fc66c06bba0 msgr2=0x7fc66c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:51.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.822+0000 7fc674200640 1 -- 172.21.15.144:0/128057526 shutdown_connections 2024-09-11T23:21:51.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.822+0000 7fc674200640 1 -- 172.21.15.144:0/128057526 wait complete. 2024-09-11T23:21:51.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.824+0000 7fc674200640 1 Processor -- start 2024-09-11T23:21:51.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.824+0000 7fc674200640 1 -- start start 2024-09-11T23:21:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.825+0000 7fc674200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc66c06ef60 0x7fc66c14afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.825+0000 7fc674200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c15b370 0x7fc66c14eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.825+0000 7fc674200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc66c15f9f0 0x7fc66c152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.825+0000 7fc674200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c0731b0 con 0x7fc66c15b370 2024-09-11T23:21:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.825+0000 7fc674200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c15c450 con 0x7fc66c06ef60 2024-09-11T23:21:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.825+0000 7fc674200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc66c15b750 con 0x7fc66c15f9f0 2024-09-11T23:21:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.825+0000 7fc670e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c15b370 0x7fc66c14eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.825+0000 7fc670e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c15b370 0x7fc66c14eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46386/0 (socket says 172.21.15.144:46386) 2024-09-11T23:21:51.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.825+0000 7fc670e00640 1 -- 172.21.15.144:0/890566274 learned_addr learned my addr 172.21.15.144:0/890566274 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:51.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.826+0000 7fc670e00640 1 -- 172.21.15.144:0/890566274 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc66c15f9f0 msgr2=0x7fc66c152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:51.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.826+0000 7fc670e00640 1 --2- 172.21.15.144:0/890566274 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc66c15f9f0 0x7fc66c152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.826+0000 7fc670e00640 1 -- 172.21.15.144:0/890566274 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc66c06ef60 msgr2=0x7fc66c14afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:51.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.826+0000 7fc670e00640 1 --2- 172.21.15.144:0/890566274 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc66c06ef60 0x7fc66c14afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:51.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.826+0000 7fc670e00640 1 -- 172.21.15.144:0/890566274 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66c14f780 con 0x7fc66c15b370 2024-09-11T23:21:51.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.826+0000 7fc670e00640 1 --2- 172.21.15.144:0/890566274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c15b370 0x7fc66c14eda0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc65802a180 tx=0x7fc6580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:51.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.826+0000 7fc669600640 1 -- 172.21.15.144:0/890566274 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc658041020 con 0x7fc66c15b370 2024-09-11T23:21:51.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.826+0000 7fc669600640 1 -- 172.21.15.144:0/890566274 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6580306c0 con 0x7fc66c15b370 2024-09-11T23:21:51.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.826+0000 7fc674200640 1 -- 172.21.15.144:0/890566274 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc66c14fa60 con 0x7fc66c15b370 2024-09-11T23:21:51.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.826+0000 7fc669600640 1 -- 172.21.15.144:0/890566274 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc658037040 con 0x7fc66c15b370 2024-09-11T23:21:51.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.826+0000 7fc674200640 1 -- 172.21.15.144:0/890566274 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc66c150020 con 0x7fc66c15b370 2024-09-11T23:21:51.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.828+0000 7fc674200640 1 -- 172.21.15.144:0/890566274 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc66c072560 con 0x7fc66c15b370 2024-09-11T23:21:51.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.828+0000 7fc669600640 1 -- 172.21.15.144:0/890566274 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7fc658044020 con 0x7fc66c15b370 2024-09-11T23:21:51.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.829+0000 7fc669600640 1 --2- 172.21.15.144:0/890566274 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc64c06c190 0x7fc64c06e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:51.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.829+0000 7fc669600640 1 -- 172.21.15.144:0/890566274 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 4857+0+0 (secure 0 0 0) 0x7fc6580ab8b0 con 0x7fc66c15b370 2024-09-11T23:21:51.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.829+0000 7fc671800640 1 --2- 172.21.15.144:0/890566274 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc64c06c190 0x7fc64c06e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:51.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.830+0000 7fc671800640 1 --2- 172.21.15.144:0/890566274 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc64c06c190 0x7fc64c06e650 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc6600098f0 tx=0x7fc660008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:51.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:51.834+0000 7fc669600640 1 -- 172.21.15.144:0/890566274 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc65804b030 con 0x7fc66c15b370 2024-09-11T23:21:52.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.008+0000 7fc674200640 1 -- 172.21.15.144:0/890566274 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc66c06c230 con 0x7fc66c15b370 2024-09-11T23:21:52.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-11T23:21:52.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.436+0000 7fc669600640 1 -- 172.21.15.144:0/890566274 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v68) ==== 138+0+0 (secure 0 0 0) 0x7fc65807a1a0 con 0x7fc66c15b370 2024-09-11T23:21:52.436 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-11T23:21:52.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.439+0000 7fc674200640 1 -- 172.21.15.144:0/890566274 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc64c06c190 msgr2=0x7fc64c06e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:52.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.439+0000 7fc674200640 1 --2- 172.21.15.144:0/890566274 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc64c06c190 0x7fc64c06e650 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc6600098f0 tx=0x7fc660008040 comp rx=0 tx=0).stop 2024-09-11T23:21:52.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.439+0000 7fc674200640 1 -- 172.21.15.144:0/890566274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c15b370 msgr2=0x7fc66c14eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:52.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.439+0000 7fc674200640 1 --2- 172.21.15.144:0/890566274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c15b370 0x7fc66c14eda0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc65802a180 tx=0x7fc6580046c0 comp rx=0 tx=0).stop 2024-09-11T23:21:52.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.439+0000 7fc674200640 1 -- 172.21.15.144:0/890566274 shutdown_connections 2024-09-11T23:21:52.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.439+0000 7fc674200640 1 --2- 172.21.15.144:0/890566274 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fc64c06c190 0x7fc64c06e650 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:52.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.439+0000 7fc674200640 1 --2- 172.21.15.144:0/890566274 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc66c15f9f0 0x7fc66c152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:52.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.439+0000 7fc674200640 1 --2- 172.21.15.144:0/890566274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc66c15b370 0x7fc66c14eda0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:52.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.439+0000 7fc674200640 1 --2- 172.21.15.144:0/890566274 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc66c06ef60 0x7fc66c14afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:52.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.439+0000 7fc674200640 1 -- 172.21.15.144:0/890566274 >> 172.21.15.144:0/890566274 conn(0x7fc66c06bba0 msgr2=0x7fc66c0cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:52.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.439+0000 7fc674200640 1 -- 172.21.15.144:0/890566274 shutdown_connections 2024-09-11T23:21:52.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.440+0000 7fc674200640 1 -- 172.21.15.144:0/890566274 wait complete. 2024-09-11T23:21:52.459 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:21:52.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.621+0000 7f2b8fe00640 1 Processor -- start 2024-09-11T23:21:52.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.622+0000 7f2b8fe00640 1 -- start start 2024-09-11T23:21:52.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.623+0000 7f2b8fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2b8815b370 0x7f2b88072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:52.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.623+0000 7f2b8fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2b8806f130 0x7f2b880ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:52.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.623+0000 7f2b8fe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b8815c970 con 0x7f2b8815f9f0 2024-09-11T23:21:52.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.623+0000 7f2b8fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2b8815fef0 con 0x7f2b8815b370 2024-09-11T23:21:52.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.623+0000 7f2b8fe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2b8815bbb0 con 0x7f2b8806f130 2024-09-11T23:21:52.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.623+0000 7f2b8d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2b8815b370 0x7f2b88072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:52.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.623+0000 7f2b8d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2b8815b370 0x7f2b88072560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46400/0 (socket says 172.21.15.144:46400) 2024-09-11T23:21:52.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.623+0000 7f2b8d400640 1 -- 172.21.15.144:0/4239361832 learned_addr learned my addr 172.21.15.144:0/4239361832 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:52.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.624+0000 7f2b8de00640 1 --2- 172.21.15.144:0/4239361832 >> v2:172.21.15.165:3300/0 conn(0x7f2b8806f130 0x7f2b880ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:52.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.624+0000 7f2b8d400640 1 -- 172.21.15.144:0/4239361832 >> v2:172.21.15.165:3300/0 conn(0x7f2b8806f130 msgr2=0x7f2b880ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:52.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.624+0000 7f2b8d400640 1 --2- 172.21.15.144:0/4239361832 >> v2:172.21.15.165:3300/0 conn(0x7f2b8806f130 0x7f2b880ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:52.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.624+0000 7f2b8d400640 1 -- 172.21.15.144:0/4239361832 >> v1:172.21.15.165:6789/0 conn(0x7f2b8815f9f0 legacy=0x7f2b8806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:52.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.624+0000 7f2b8d400640 1 -- 172.21.15.144:0/4239361832 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8815be90 con 0x7f2b8815b370 2024-09-11T23:21:52.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.625+0000 7f2b8d400640 1 --2- 172.21.15.144:0/4239361832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b8815b370 0x7f2b88072560 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f2b880cfff0 tx=0x7f2b7c02c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8d8628c290d54d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:52.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.625+0000 7f2b87e00640 1 -- 172.21.15.144:0/4239361832 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c032710 con 0x7f2b8815b370 2024-09-11T23:21:52.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.625+0000 7f2b87e00640 1 -- 172.21.15.144:0/4239361832 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b7c0328b0 con 0x7f2b8815b370 2024-09-11T23:21:52.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.625+0000 7f2b87e00640 1 -- 172.21.15.144:0/4239361832 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c032ca0 con 0x7f2b8815b370 2024-09-11T23:21:52.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.625+0000 7f2b8fe00640 1 -- 172.21.15.144:0/4239361832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b8815b370 msgr2=0x7f2b88072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:52.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.625+0000 7f2b8fe00640 1 --2- 172.21.15.144:0/4239361832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b8815b370 0x7f2b88072560 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f2b880cfff0 tx=0x7f2b7c02c850 comp rx=0 tx=0).stop 2024-09-11T23:21:52.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.626+0000 7f2b8fe00640 1 -- 172.21.15.144:0/4239361832 shutdown_connections 2024-09-11T23:21:52.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.626+0000 7f2b8fe00640 1 --2- 172.21.15.144:0/4239361832 >> v2:172.21.15.165:3300/0 conn(0x7f2b8806f130 0x7f2b880ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:52.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.626+0000 7f2b8fe00640 1 --2- 172.21.15.144:0/4239361832 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b8815b370 0x7f2b88072560 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:52.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.626+0000 7f2b8fe00640 1 -- 172.21.15.144:0/4239361832 >> 172.21.15.144:0/4239361832 conn(0x7f2b8806bba0 msgr2=0x7f2b8806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:52.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.626+0000 7f2b8fe00640 1 -- 172.21.15.144:0/4239361832 shutdown_connections 2024-09-11T23:21:52.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.626+0000 7f2b8fe00640 1 -- 172.21.15.144:0/4239361832 wait complete. 2024-09-11T23:21:52.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.627+0000 7f2b8fe00640 1 Processor -- start 2024-09-11T23:21:52.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.627+0000 7f2b8fe00640 1 -- start start 2024-09-11T23:21:52.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.628+0000 7f2b8fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b8806f130 0x7f2b881477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:52.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.628+0000 7f2b8fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b8815b370 0x7f2b880ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:52.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.628+0000 7f2b8fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b8815f9f0 0x7f2b880aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:52.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.628+0000 7f2b8fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2b880731b0 con 0x7f2b8815b370 2024-09-11T23:21:52.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.628+0000 7f2b8fe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8815c450 con 0x7f2b8806f130 2024-09-11T23:21:52.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.628+0000 7f2b8fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2b8815b750 con 0x7f2b8815f9f0 2024-09-11T23:21:52.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.628+0000 7f2b8ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b8815b370 0x7f2b880ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:52.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.629+0000 7f2b8ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b8815b370 0x7f2b880ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46412/0 (socket says 172.21.15.144:46412) 2024-09-11T23:21:52.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.629+0000 7f2b8ca00640 1 -- 172.21.15.144:0/1642380537 learned_addr learned my addr 172.21.15.144:0/1642380537 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:52.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.629+0000 7f2b8d400640 1 --2- 172.21.15.144:0/1642380537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b8806f130 0x7f2b881477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:52.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.629+0000 7f2b8de00640 1 --2- 172.21.15.144:0/1642380537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b8815f9f0 0x7f2b880aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:52.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.629+0000 7f2b8ca00640 1 -- 172.21.15.144:0/1642380537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b8815f9f0 msgr2=0x7f2b880aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:52.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.629+0000 7f2b8ca00640 1 --2- 172.21.15.144:0/1642380537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b8815f9f0 0x7f2b880aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:52.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.629+0000 7f2b8ca00640 1 -- 172.21.15.144:0/1642380537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b8806f130 msgr2=0x7f2b881477a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:52.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.629+0000 7f2b8ca00640 1 --2- 172.21.15.144:0/1642380537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b8806f130 0x7f2b881477a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:52.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.629+0000 7f2b8ca00640 1 -- 172.21.15.144:0/1642380537 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8814ae20 con 0x7f2b8815b370 2024-09-11T23:21:52.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.629+0000 7f2b8ca00640 1 --2- 172.21.15.144:0/1642380537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b8815b370 0x7f2b880ae8e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400b3c0 tx=0x7f2b7400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:52.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.630+0000 7f2b85600640 1 -- 172.21.15.144:0/1642380537 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74011830 con 0x7f2b8815b370 2024-09-11T23:21:52.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.630+0000 7f2b85600640 1 -- 172.21.15.144:0/1642380537 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b74016070 con 0x7f2b8815b370 2024-09-11T23:21:52.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.630+0000 7f2b85600640 1 -- 172.21.15.144:0/1642380537 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b74011c50 con 0x7f2b8815b370 2024-09-11T23:21:52.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.630+0000 7f2b8fe00640 1 -- 172.21.15.144:0/1642380537 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b8814ab40 con 0x7f2b8815b370 2024-09-11T23:21:52.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.630+0000 7f2b8fe00640 1 -- 172.21.15.144:0/1642380537 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b88148270 con 0x7f2b8815b370 2024-09-11T23:21:52.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.631+0000 7f2b8fe00640 1 -- 172.21.15.144:0/1642380537 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b88072560 con 0x7f2b8815b370 2024-09-11T23:21:52.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.632+0000 7f2b85600640 1 -- 172.21.15.144:0/1642380537 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f2b7401b460 con 0x7f2b8815b370 2024-09-11T23:21:52.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.633+0000 7f2b85600640 1 --2- 172.21.15.144:0/1642380537 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2b6806c190 0x7f2b6806e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:52.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.633+0000 7f2b85600640 1 -- 172.21.15.144:0/1642380537 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5227+0+0 (secure 0 0 0) 0x7f2b7408ab60 con 0x7f2b8815b370 2024-09-11T23:21:52.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.633+0000 7f2b8d400640 1 --2- 172.21.15.144:0/1642380537 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2b6806c190 0x7f2b6806e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:52.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.634+0000 7f2b8d400640 1 --2- 172.21.15.144:0/1642380537 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2b6806c190 0x7f2b6806e650 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c037000 tx=0x7f2b7c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:52.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.638+0000 7f2b85600640 1 -- 172.21.15.144:0/1642380537 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2b74020020 con 0x7f2b8815b370 2024-09-11T23:21:52.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:52.815+0000 7f2b8fe00640 1 -- 172.21.15.144:0/1642380537 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2b8806c300 con 0x7f2b8815b370 2024-09-11T23:21:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.442+0000 7f2b85600640 1 -- 172.21.15.144:0/1642380537 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v69) ==== 170+0+0 (secure 0 0 0) 0x7f2b74058c50 con 0x7f2b8815b370 2024-09-11T23:21:53.442 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-11T23:21:53.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.445+0000 7f2b8fe00640 1 -- 172.21.15.144:0/1642380537 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2b6806c190 msgr2=0x7f2b6806e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:53.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.445+0000 7f2b8fe00640 1 --2- 172.21.15.144:0/1642380537 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2b6806c190 0x7f2b6806e650 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c037000 tx=0x7f2b7c008040 comp rx=0 tx=0).stop 2024-09-11T23:21:53.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.445+0000 7f2b8fe00640 1 -- 172.21.15.144:0/1642380537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b8815b370 msgr2=0x7f2b880ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:53.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.445+0000 7f2b8fe00640 1 --2- 172.21.15.144:0/1642380537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b8815b370 0x7f2b880ae8e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400b3c0 tx=0x7f2b7400b880 comp rx=0 tx=0).stop 2024-09-11T23:21:53.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.445+0000 7f2b8fe00640 1 -- 172.21.15.144:0/1642380537 shutdown_connections 2024-09-11T23:21:53.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.445+0000 7f2b8fe00640 1 --2- 172.21.15.144:0/1642380537 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2b6806c190 0x7f2b6806e650 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:53.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.445+0000 7f2b8fe00640 1 --2- 172.21.15.144:0/1642380537 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b8815f9f0 0x7f2b880aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:53.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.445+0000 7f2b8fe00640 1 --2- 172.21.15.144:0/1642380537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b8815b370 0x7f2b880ae8e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:53.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.445+0000 7f2b8fe00640 1 --2- 172.21.15.144:0/1642380537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b8806f130 0x7f2b881477a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:53.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.445+0000 7f2b8fe00640 1 -- 172.21.15.144:0/1642380537 >> 172.21.15.144:0/1642380537 conn(0x7f2b8806bba0 msgr2=0x7f2b880ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:53.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.445+0000 7f2b8fe00640 1 -- 172.21.15.144:0/1642380537 shutdown_connections 2024-09-11T23:21:53.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.445+0000 7f2b8fe00640 1 -- 172.21.15.144:0/1642380537 wait complete. 2024-09-11T23:21:53.473 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:21:53.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.630+0000 7fb774e00640 1 Processor -- start 2024-09-11T23:21:53.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.630+0000 7fb774e00640 1 -- start start 2024-09-11T23:21:53.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.631+0000 7fb774e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb77015e6d0 0x7fb77006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:53.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.631+0000 7fb774e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb77006d5f0 0x7fb77006da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:53.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.631+0000 7fb774e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7700d1d40 con 0x7fb7700b6d90 2024-09-11T23:21:53.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.631+0000 7fb774e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb77006d160 con 0x7fb77015e6d0 2024-09-11T23:21:53.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.631+0000 7fb774e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb7700d2020 con 0x7fb77006d5f0 2024-09-11T23:21:53.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.631+0000 7fb76f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb77015e6d0 0x7fb77006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:53.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.631+0000 7fb76f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb77015e6d0 0x7fb77006fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46414/0 (socket says 172.21.15.144:46414) 2024-09-11T23:21:53.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.631+0000 7fb767e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb7700b6d90 0x7fb7700b7200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37496/0 (socket says 172.21.15.144:37496) 2024-09-11T23:21:53.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.631+0000 7fb76f400640 1 -- 172.21.15.144:0/3018729340 learned_addr learned my addr 172.21.15.144:0/3018729340 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:53.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.632+0000 7fb76fe00640 1 --2- 172.21.15.144:0/3018729340 >> v2:172.21.15.165:3300/0 conn(0x7fb77006d5f0 0x7fb77006da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:53.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.632+0000 7fb76f400640 1 -- 172.21.15.144:0/3018729340 >> v2:172.21.15.165:3300/0 conn(0x7fb77006d5f0 msgr2=0x7fb77006da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:53.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.632+0000 7fb76f400640 1 --2- 172.21.15.144:0/3018729340 >> v2:172.21.15.165:3300/0 conn(0x7fb77006d5f0 0x7fb77006da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:53.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.632+0000 7fb76f400640 1 -- 172.21.15.144:0/3018729340 >> v1:172.21.15.144:6789/0 conn(0x7fb7700b6d90 legacy=0x7fb7700b7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:53.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.632+0000 7fb76f400640 1 -- 172.21.15.144:0/3018729340 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77006cdf0 con 0x7fb77015e6d0 2024-09-11T23:21:53.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.632+0000 7fb76ea00640 1 -- 172.21.15.144:0/3018729340 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2897705025 0 0) 0x7fb7700d1d40 con 0x7fb7700b6d90 2024-09-11T23:21:53.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.633+0000 7fb76f400640 1 --2- 172.21.15.144:0/3018729340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb77015e6d0 0x7fb77006fc00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb77006d2e0 tx=0x7fb76002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8dd88db4d4b8d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:53.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.633+0000 7fb76ea00640 1 -- 172.21.15.144:0/3018729340 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760037070 con 0x7fb77015e6d0 2024-09-11T23:21:53.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.633+0000 7fb76ea00640 1 -- 172.21.15.144:0/3018729340 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb760032440 con 0x7fb77015e6d0 2024-09-11T23:21:53.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.633+0000 7fb76ea00640 1 -- 172.21.15.144:0/3018729340 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760032810 con 0x7fb77015e6d0 2024-09-11T23:21:53.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.634+0000 7fb774e00640 1 -- 172.21.15.144:0/3018729340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb77015e6d0 msgr2=0x7fb77006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:53.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.634+0000 7fb774e00640 1 --2- 172.21.15.144:0/3018729340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb77015e6d0 0x7fb77006fc00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb77006d2e0 tx=0x7fb76002a270 comp rx=0 tx=0).stop 2024-09-11T23:21:53.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.634+0000 7fb774e00640 1 -- 172.21.15.144:0/3018729340 shutdown_connections 2024-09-11T23:21:53.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.634+0000 7fb774e00640 1 --2- 172.21.15.144:0/3018729340 >> v2:172.21.15.165:3300/0 conn(0x7fb77006d5f0 0x7fb77006da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:53.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.634+0000 7fb774e00640 1 --2- 172.21.15.144:0/3018729340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb77015e6d0 0x7fb77006fc00 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:53.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.634+0000 7fb774e00640 1 -- 172.21.15.144:0/3018729340 >> 172.21.15.144:0/3018729340 conn(0x7fb7700b4220 msgr2=0x7fb7700b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:53.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.634+0000 7fb774e00640 1 -- 172.21.15.144:0/3018729340 shutdown_connections 2024-09-11T23:21:53.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.634+0000 7fb774e00640 1 -- 172.21.15.144:0/3018729340 wait complete. 2024-09-11T23:21:53.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.635+0000 7fb774e00640 1 Processor -- start 2024-09-11T23:21:53.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.635+0000 7fb774e00640 1 -- start start 2024-09-11T23:21:53.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.636+0000 7fb774e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb77006d5f0 0x7fb7701500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:53.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.636+0000 7fb774e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7700b6d90 0x7fb7701522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:53.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.636+0000 7fb774e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb77015e6d0 0x7fb770152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:53.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.636+0000 7fb774e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb7700b5860 con 0x7fb7700b6d90 2024-09-11T23:21:53.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.636+0000 7fb774e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb7700b56e0 con 0x7fb77006d5f0 2024-09-11T23:21:53.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.636+0000 7fb774e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb77006df80 con 0x7fb77015e6d0 2024-09-11T23:21:53.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.637+0000 7fb767e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7700b6d90 0x7fb7701522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:53.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.637+0000 7fb767e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7700b6d90 0x7fb7701522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46418/0 (socket says 172.21.15.144:46418) 2024-09-11T23:21:53.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.637+0000 7fb767e00640 1 -- 172.21.15.144:0/2178078395 learned_addr learned my addr 172.21.15.144:0/2178078395 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:53.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.637+0000 7fb76f400640 1 --2- 172.21.15.144:0/2178078395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb77006d5f0 0x7fb7701500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:53.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.637+0000 7fb76fe00640 1 --2- 172.21.15.144:0/2178078395 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb77015e6d0 0x7fb770152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:53.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.637+0000 7fb767e00640 1 -- 172.21.15.144:0/2178078395 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb77015e6d0 msgr2=0x7fb770152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:53.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.637+0000 7fb767e00640 1 --2- 172.21.15.144:0/2178078395 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb77015e6d0 0x7fb770152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:53.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.637+0000 7fb767e00640 1 -- 172.21.15.144:0/2178078395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb77006d5f0 msgr2=0x7fb7701500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:53.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.637+0000 7fb767e00640 1 --2- 172.21.15.144:0/2178078395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb77006d5f0 0x7fb7701500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:53.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.637+0000 7fb767e00640 1 -- 172.21.15.144:0/2178078395 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb770158280 con 0x7fb7700b6d90 2024-09-11T23:21:53.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.637+0000 7fb767e00640 1 --2- 172.21.15.144:0/2178078395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7700b6d90 0x7fb7701522d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb75800c500 tx=0x7fb75800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:53.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.638+0000 7fb767400640 1 -- 172.21.15.144:0/2178078395 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb758018070 con 0x7fb7700b6d90 2024-09-11T23:21:53.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.638+0000 7fb767400640 1 -- 172.21.15.144:0/2178078395 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb758007580 con 0x7fb7700b6d90 2024-09-11T23:21:53.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.638+0000 7fb767400640 1 -- 172.21.15.144:0/2178078395 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb758004a20 con 0x7fb7700b6d90 2024-09-11T23:21:53.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.638+0000 7fb774e00640 1 -- 172.21.15.144:0/2178078395 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7701514e0 con 0x7fb7700b6d90 2024-09-11T23:21:53.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.638+0000 7fb774e00640 1 -- 172.21.15.144:0/2178078395 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb770151aa0 con 0x7fb7700b6d90 2024-09-11T23:21:53.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.639+0000 7fb774e00640 1 -- 172.21.15.144:0/2178078395 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb77006da40 con 0x7fb7700b6d90 2024-09-11T23:21:53.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.640+0000 7fb767400640 1 -- 172.21.15.144:0/2178078395 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7fb758004bc0 con 0x7fb7700b6d90 2024-09-11T23:21:53.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.641+0000 7fb767400640 1 --2- 172.21.15.144:0/2178078395 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb74c06c190 0x7fb74c06e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:53.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.641+0000 7fb767400640 1 -- 172.21.15.144:0/2178078395 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5609+0+0 (secure 0 0 0) 0x7fb75808a5b0 con 0x7fb7700b6d90 2024-09-11T23:21:53.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.641+0000 7fb76f400640 1 --2- 172.21.15.144:0/2178078395 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb74c06c190 0x7fb74c06e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:53.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.642+0000 7fb76f400640 1 --2- 172.21.15.144:0/2178078395 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb74c06c190 0x7fb74c06e650 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb760034000 tx=0x7fb76002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:53.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.646+0000 7fb767400640 1 -- 172.21.15.144:0/2178078395 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7580584f0 con 0x7fb7700b6d90 2024-09-11T23:21:53.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:53.855+0000 7fb774e00640 1 -- 172.21.15.144:0/2178078395 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb7700693e0 con 0x7fb7700b6d90 2024-09-11T23:21:54.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.443+0000 7fb767400640 1 -- 172.21.15.144:0/2178078395 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v42) ==== 174+0+0 (secure 0 0 0) 0x7fb75805c7f0 con 0x7fb7700b6d90 2024-09-11T23:21:54.445 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 10 and data pool 11 2024-09-11T23:21:54.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.448+0000 7fb774e00640 1 -- 172.21.15.144:0/2178078395 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb74c06c190 msgr2=0x7fb74c06e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:54.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.448+0000 7fb774e00640 1 --2- 172.21.15.144:0/2178078395 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb74c06c190 0x7fb74c06e650 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb760034000 tx=0x7fb76002e000 comp rx=0 tx=0).stop 2024-09-11T23:21:54.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.448+0000 7fb774e00640 1 -- 172.21.15.144:0/2178078395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7700b6d90 msgr2=0x7fb7701522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:54.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.448+0000 7fb774e00640 1 --2- 172.21.15.144:0/2178078395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7700b6d90 0x7fb7701522d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb75800c500 tx=0x7fb75800c9c0 comp rx=0 tx=0).stop 2024-09-11T23:21:54.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.448+0000 7fb774e00640 1 -- 172.21.15.144:0/2178078395 shutdown_connections 2024-09-11T23:21:54.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.448+0000 7fb774e00640 1 --2- 172.21.15.144:0/2178078395 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb74c06c190 0x7fb74c06e650 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:54.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.448+0000 7fb774e00640 1 --2- 172.21.15.144:0/2178078395 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb77015e6d0 0x7fb770152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:54.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.448+0000 7fb774e00640 1 --2- 172.21.15.144:0/2178078395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb7700b6d90 0x7fb7701522d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:54.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.448+0000 7fb774e00640 1 --2- 172.21.15.144:0/2178078395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb77006d5f0 0x7fb7701500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:54.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.448+0000 7fb774e00640 1 -- 172.21.15.144:0/2178078395 >> 172.21.15.144:0/2178078395 conn(0x7fb7700b4220 msgr2=0x7fb77015c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:54.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.450+0000 7fb774e00640 1 -- 172.21.15.144:0/2178078395 shutdown_connections 2024-09-11T23:21:54.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.451+0000 7fb774e00640 1 -- 172.21.15.144:0/2178078395 wait complete. 2024-09-11T23:21:54.487 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:21:54.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.640+0000 7f5d77000640 1 Processor -- start 2024-09-11T23:21:54.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.640+0000 7f5d77000640 1 -- start start 2024-09-11T23:21:54.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.641+0000 7f5d77000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5d7015e640 0x7f5d700d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:54.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.641+0000 7f5d77000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d700d3f60 0x7f5d700b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:54.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.641+0000 7f5d77000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d7006bee0 con 0x7f5d700b6510 2024-09-11T23:21:54.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.641+0000 7f5d77000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5d7015ea20 con 0x7f5d7015e640 2024-09-11T23:21:54.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.641+0000 7f5d77000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5d7006caf0 con 0x7f5d700d3f60 2024-09-11T23:21:54.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.641+0000 7f5d75c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5d7015e640 0x7f5d700d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:54.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.641+0000 7f5d76600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5d700b6510 0x7f5d700d27c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53312/0 (socket says 172.21.15.144:53312) 2024-09-11T23:21:54.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.641+0000 7f5d75c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5d7015e640 0x7f5d700d3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33676/0 (socket says 172.21.15.144:33676) 2024-09-11T23:21:54.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.641+0000 7f5d76600640 1 -- 172.21.15.144:0/2481901064 learned_addr learned my addr 172.21.15.144:0/2481901064 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:54.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.642+0000 7f5d75200640 1 --2- 172.21.15.144:0/2481901064 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d700d3f60 0x7f5d700b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:54.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.642+0000 7f5d75c00640 1 -- 172.21.15.144:0/2481901064 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d700d3f60 msgr2=0x7f5d700b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:54.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.642+0000 7f5d75c00640 1 --2- 172.21.15.144:0/2481901064 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d700d3f60 0x7f5d700b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:54.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.642+0000 7f5d75c00640 1 -- 172.21.15.144:0/2481901064 >> v1:172.21.15.144:6789/0 conn(0x7f5d700b6510 legacy=0x7f5d700d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:54.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.642+0000 7f5d75c00640 1 -- 172.21.15.144:0/2481901064 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d7006c1c0 con 0x7f5d7015e640 2024-09-11T23:21:54.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.642+0000 7f5d6fe00640 1 -- 172.21.15.144:0/2481901064 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2652702528 0 0) 0x7f5d7006bee0 con 0x7f5d700b6510 2024-09-11T23:21:54.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.643+0000 7f5d75c00640 1 --2- 172.21.15.144:0/2481901064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d7015e640 0x7f5d700d3a20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5d640097a0 tx=0x7f5d6402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d10794154d0f77e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:54.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.643+0000 7f5d6fe00640 1 -- 172.21.15.144:0/2481901064 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64037070 con 0x7f5d7015e640 2024-09-11T23:21:54.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.643+0000 7f5d6fe00640 1 -- 172.21.15.144:0/2481901064 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d64032440 con 0x7f5d7015e640 2024-09-11T23:21:54.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.643+0000 7f5d6fe00640 1 -- 172.21.15.144:0/2481901064 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64032810 con 0x7f5d7015e640 2024-09-11T23:21:54.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.644+0000 7f5d77000640 1 -- 172.21.15.144:0/2481901064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d7015e640 msgr2=0x7f5d700d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:54.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.644+0000 7f5d77000640 1 --2- 172.21.15.144:0/2481901064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d7015e640 0x7f5d700d3a20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5d640097a0 tx=0x7f5d6402a180 comp rx=0 tx=0).stop 2024-09-11T23:21:54.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.644+0000 7f5d77000640 1 -- 172.21.15.144:0/2481901064 shutdown_connections 2024-09-11T23:21:54.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.644+0000 7f5d77000640 1 --2- 172.21.15.144:0/2481901064 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d700d3f60 0x7f5d700b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:54.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.644+0000 7f5d77000640 1 --2- 172.21.15.144:0/2481901064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d7015e640 0x7f5d700d3a20 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:54.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.644+0000 7f5d77000640 1 -- 172.21.15.144:0/2481901064 >> 172.21.15.144:0/2481901064 conn(0x7f5d700d0fd0 msgr2=0x7f5d700d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:54.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.644+0000 7f5d77000640 1 -- 172.21.15.144:0/2481901064 shutdown_connections 2024-09-11T23:21:54.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.644+0000 7f5d77000640 1 -- 172.21.15.144:0/2481901064 wait complete. 2024-09-11T23:21:54.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.645+0000 7f5d77000640 1 Processor -- start 2024-09-11T23:21:54.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.645+0000 7f5d77000640 1 -- start start 2024-09-11T23:21:54.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.646+0000 7f5d77000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d700b6510 0x7f5d7015cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:54.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.646+0000 7f5d77000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d700d3f60 0x7f5d700ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:54.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.646+0000 7f5d77000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d7015e640 0x7f5d701f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:54.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.646+0000 7f5d77000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5d700b8760 con 0x7f5d700b6510 2024-09-11T23:21:54.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.646+0000 7f5d77000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7006c780 con 0x7f5d7015e640 2024-09-11T23:21:54.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.646+0000 7f5d77000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5d700b88e0 con 0x7f5d700d3f60 2024-09-11T23:21:54.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.647+0000 7f5d75c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d700b6510 0x7f5d7015cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:54.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.647+0000 7f5d75c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d700b6510 0x7f5d7015cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33682/0 (socket says 172.21.15.144:33682) 2024-09-11T23:21:54.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.647+0000 7f5d75c00640 1 -- 172.21.15.144:0/1259034981 learned_addr learned my addr 172.21.15.144:0/1259034981 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:54.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.647+0000 7f5d75200640 1 --2- 172.21.15.144:0/1259034981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d700d3f60 0x7f5d700ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:54.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.647+0000 7f5d76600640 1 --2- 172.21.15.144:0/1259034981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d7015e640 0x7f5d701f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:54.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.647+0000 7f5d75c00640 1 -- 172.21.15.144:0/1259034981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d700d3f60 msgr2=0x7f5d700ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:54.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.647+0000 7f5d75c00640 1 --2- 172.21.15.144:0/1259034981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d700d3f60 0x7f5d700ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:54.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.647+0000 7f5d75c00640 1 -- 172.21.15.144:0/1259034981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d7015e640 msgr2=0x7f5d701f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:54.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.647+0000 7f5d75c00640 1 --2- 172.21.15.144:0/1259034981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d7015e640 0x7f5d701f4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:54.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.647+0000 7f5d75c00640 1 -- 172.21.15.144:0/1259034981 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d700ccac0 con 0x7f5d700b6510 2024-09-11T23:21:54.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.647+0000 7f5d75c00640 1 --2- 172.21.15.144:0/1259034981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d700b6510 0x7f5d7015cb70 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5d640097a0 tx=0x7f5d640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:54.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.647+0000 7f5d6d600640 1 -- 172.21.15.144:0/1259034981 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64037050 con 0x7f5d700b6510 2024-09-11T23:21:54.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.648+0000 7f5d6d600640 1 -- 172.21.15.144:0/1259034981 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d64038040 con 0x7f5d700b6510 2024-09-11T23:21:54.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.648+0000 7f5d77000640 1 -- 172.21.15.144:0/1259034981 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d700ccda0 con 0x7f5d700b6510 2024-09-11T23:21:54.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.648+0000 7f5d6d600640 1 -- 172.21.15.144:0/1259034981 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64004470 con 0x7f5d700b6510 2024-09-11T23:21:54.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.648+0000 7f5d77000640 1 -- 172.21.15.144:0/1259034981 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d700cd360 con 0x7f5d700b6510 2024-09-11T23:21:54.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.649+0000 7f5d77000640 1 -- 172.21.15.144:0/1259034981 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d700cf900 con 0x7f5d700b6510 2024-09-11T23:21:54.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.650+0000 7f5d6d600640 1 -- 172.21.15.144:0/1259034981 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f5d64030900 con 0x7f5d700b6510 2024-09-11T23:21:54.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.651+0000 7f5d6d600640 1 --2- 172.21.15.144:0/1259034981 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5d5006c190 0x7f5d5006e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:54.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.651+0000 7f5d6d600640 1 -- 172.21.15.144:0/1259034981 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7f5d640abf20 con 0x7f5d700b6510 2024-09-11T23:21:54.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.651+0000 7f5d75200640 1 --2- 172.21.15.144:0/1259034981 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5d5006c190 0x7f5d5006e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:54.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.651+0000 7f5d75200640 1 --2- 172.21.15.144:0/1259034981 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5d5006c190 0x7f5d5006e650 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5d700d33e0 tx=0x7f5d5c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:54.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.655+0000 7f5d6d600640 1 -- 172.21.15.144:0/1259034981 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d6407a530 con 0x7f5d700b6510 2024-09-11T23:21:54.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.830+0000 7f5d77000640 1 -- 172.21.15.144:0/1259034981 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d70073e00 con 0x7f5d700b6510 2024-09-11T23:21:54.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.832+0000 7f5d6d600640 1 -- 172.21.15.144:0/1259034981 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+16765 (secure 0 0 0) 0x7f5d64079e30 con 0x7f5d700b6510 2024-09-11T23:21:54.833 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:54.833 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":70,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:21:53.856162+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:21:52.048862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-11T23:21:52.855489+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:21:54.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.834+0000 7f5d77000640 1 -- 172.21.15.144:0/1259034981 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5d5006c190 msgr2=0x7f5d5006e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:54.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.834+0000 7f5d77000640 1 --2- 172.21.15.144:0/1259034981 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5d5006c190 0x7f5d5006e650 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5d700d33e0 tx=0x7f5d5c008040 comp rx=0 tx=0).stop 2024-09-11T23:21:54.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.834+0000 7f5d77000640 1 -- 172.21.15.144:0/1259034981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d700b6510 msgr2=0x7f5d7015cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:54.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.834+0000 7f5d77000640 1 --2- 172.21.15.144:0/1259034981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d700b6510 0x7f5d7015cb70 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5d640097a0 tx=0x7f5d640046c0 comp rx=0 tx=0).stop 2024-09-11T23:21:54.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.834+0000 7f5d77000640 1 -- 172.21.15.144:0/1259034981 shutdown_connections 2024-09-11T23:21:54.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.834+0000 7f5d77000640 1 --2- 172.21.15.144:0/1259034981 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5d5006c190 0x7f5d5006e650 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:54.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.834+0000 7f5d77000640 1 --2- 172.21.15.144:0/1259034981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d7015e640 0x7f5d701f4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:54.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.834+0000 7f5d77000640 1 --2- 172.21.15.144:0/1259034981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d700d3f60 0x7f5d700ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:54.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.834+0000 7f5d77000640 1 --2- 172.21.15.144:0/1259034981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d700b6510 0x7f5d7015cb70 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:54.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.834+0000 7f5d77000640 1 -- 172.21.15.144:0/1259034981 >> 172.21.15.144:0/1259034981 conn(0x7f5d700d0fd0 msgr2=0x7f5d700b57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:54.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.834+0000 7f5d77000640 1 -- 172.21.15.144:0/1259034981 shutdown_connections 2024-09-11T23:21:54.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:54.834+0000 7f5d77000640 1 -- 172.21.15.144:0/1259034981 wait complete. 2024-09-11T23:21:54.851 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:21:55.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.003+0000 7f0144400640 1 Processor -- start 2024-09-11T23:21:55.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.003+0000 7f0144400640 1 -- start start 2024-09-11T23:21:55.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.005+0000 7f0144400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013c0d02a0 0x7f013c0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:55.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.005+0000 7f0144400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f013c15ca40 0x7f013c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:55.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.005+0000 7f0144400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f013c15ce80 0x7f013c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:55.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.005+0000 7f0144400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f013c0d0bc0 con 0x7f013c15ce80 2024-09-11T23:21:55.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.005+0000 7f0144400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f013c15d390 con 0x7f013c15ca40 2024-09-11T23:21:55.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.005+0000 7f0144400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f013c15d670 con 0x7f013c0d02a0 2024-09-11T23:21:55.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.005+0000 7f0142400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f013c15ce80 0x7f013c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:55.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.005+0000 7f0142400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f013c15ce80 0x7f013c1594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33692/0 (socket says 172.21.15.144:33692) 2024-09-11T23:21:55.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.005+0000 7f0142400640 1 -- 172.21.15.144:0/2882852945 learned_addr learned my addr 172.21.15.144:0/2882852945 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:55.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.005+0000 7f0141000640 1 --2- 172.21.15.144:0/2882852945 >> v2:172.21.15.165:3300/0 conn(0x7f013c15ca40 0x7f013c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:55.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.005+0000 7f0141a00640 1 --2- 172.21.15.144:0/2882852945 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013c0d02a0 0x7f013c0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:55.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.006+0000 7f0142400640 1 -- 172.21.15.144:0/2882852945 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013c0d02a0 msgr2=0x7f013c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:55.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.006+0000 7f0142400640 1 --2- 172.21.15.144:0/2882852945 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013c0d02a0 0x7f013c0d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:55.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.006+0000 7f0142400640 1 -- 172.21.15.144:0/2882852945 >> v2:172.21.15.165:3300/0 conn(0x7f013c15ca40 msgr2=0x7f013c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:55.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.006+0000 7f0142400640 1 --2- 172.21.15.144:0/2882852945 >> v2:172.21.15.165:3300/0 conn(0x7f013c15ca40 0x7f013c15e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:55.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.006+0000 7f0142400640 1 -- 172.21.15.144:0/2882852945 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013c15d950 con 0x7f013c15ce80 2024-09-11T23:21:55.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.007+0000 7f0142400640 1 --2- 172.21.15.144:0/2882852945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c15ce80 0x7f013c1594c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f013c06f400 tx=0x7f013402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ff619e18c664c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:55.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.007+0000 7f013be00640 1 -- 172.21.15.144:0/2882852945 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0134037070 con 0x7f013c15ce80 2024-09-11T23:21:55.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.007+0000 7f013be00640 1 -- 172.21.15.144:0/2882852945 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0134032440 con 0x7f013c15ce80 2024-09-11T23:21:55.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.007+0000 7f013be00640 1 -- 172.21.15.144:0/2882852945 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0134032810 con 0x7f013c15ce80 2024-09-11T23:21:55.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.008+0000 7f0144400640 1 -- 172.21.15.144:0/2882852945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c15ce80 msgr2=0x7f013c1594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:55.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.008+0000 7f0144400640 1 --2- 172.21.15.144:0/2882852945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c15ce80 0x7f013c1594c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f013c06f400 tx=0x7f013402a140 comp rx=0 tx=0).stop 2024-09-11T23:21:55.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.008+0000 7f0144400640 1 -- 172.21.15.144:0/2882852945 shutdown_connections 2024-09-11T23:21:55.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.008+0000 7f0144400640 1 --2- 172.21.15.144:0/2882852945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c15ce80 0x7f013c1594c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:55.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.008+0000 7f0144400640 1 --2- 172.21.15.144:0/2882852945 >> v2:172.21.15.165:3300/0 conn(0x7f013c15ca40 0x7f013c15e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:55.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.008+0000 7f0144400640 1 --2- 172.21.15.144:0/2882852945 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013c0d02a0 0x7f013c0d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:55.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.008+0000 7f0144400640 1 -- 172.21.15.144:0/2882852945 >> 172.21.15.144:0/2882852945 conn(0x7f013c062cc0 msgr2=0x7f013c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:55.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.008+0000 7f0144400640 1 -- 172.21.15.144:0/2882852945 shutdown_connections 2024-09-11T23:21:55.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.008+0000 7f0144400640 1 -- 172.21.15.144:0/2882852945 wait complete. 2024-09-11T23:21:55.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.009+0000 7f0144400640 1 Processor -- start 2024-09-11T23:21:55.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.009+0000 7f0144400640 1 -- start start 2024-09-11T23:21:55.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.010+0000 7f0144400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c0d02a0 0x7f013c1f10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:55.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.010+0000 7f0144400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f013c15ca40 0x7f013c1ef8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:55.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.010+0000 7f0144400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013c15ce80 0x7f013c0713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:55.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.010+0000 7f0144400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f013c155b90 con 0x7f013c0d02a0 2024-09-11T23:21:55.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.010+0000 7f0144400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f013c15df10 con 0x7f013c15ca40 2024-09-11T23:21:55.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.010+0000 7f0144400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f013c155d10 con 0x7f013c15ce80 2024-09-11T23:21:55.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.011+0000 7f0141a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c0d02a0 0x7f013c1f10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:55.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.011+0000 7f0141a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c0d02a0 0x7f013c1f10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33702/0 (socket says 172.21.15.144:33702) 2024-09-11T23:21:55.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.011+0000 7f0141a00640 1 -- 172.21.15.144:0/29088897 learned_addr learned my addr 172.21.15.144:0/29088897 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:55.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.011+0000 7f0142400640 1 --2- 172.21.15.144:0/29088897 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013c15ce80 0x7f013c0713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:55.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.011+0000 7f0141000640 1 --2- 172.21.15.144:0/29088897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f013c15ca40 0x7f013c1ef8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:55.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.011+0000 7f0141a00640 1 -- 172.21.15.144:0/29088897 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013c15ce80 msgr2=0x7f013c0713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:55.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.011+0000 7f0141a00640 1 --2- 172.21.15.144:0/29088897 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013c15ce80 0x7f013c0713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:55.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.011+0000 7f0141a00640 1 -- 172.21.15.144:0/29088897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f013c15ca40 msgr2=0x7f013c1ef8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:55.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.011+0000 7f0141a00640 1 --2- 172.21.15.144:0/29088897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f013c15ca40 0x7f013c1ef8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:55.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.011+0000 7f0141a00640 1 -- 172.21.15.144:0/29088897 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013c1f3800 con 0x7f013c0d02a0 2024-09-11T23:21:55.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.011+0000 7f0141a00640 1 --2- 172.21.15.144:0/29088897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c0d02a0 0x7f013c1f10d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f013000f8b0 tx=0x7f013000fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:55.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.012+0000 7f0139600640 1 -- 172.21.15.144:0/29088897 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0130017070 con 0x7f013c0d02a0 2024-09-11T23:21:55.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.012+0000 7f0139600640 1 -- 172.21.15.144:0/29088897 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f013000dbd0 con 0x7f013c0d02a0 2024-09-11T23:21:55.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.012+0000 7f0139600640 1 -- 172.21.15.144:0/29088897 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013000d040 con 0x7f013c0d02a0 2024-09-11T23:21:55.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.012+0000 7f0144400640 1 -- 172.21.15.144:0/29088897 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013c1f3ae0 con 0x7f013c0d02a0 2024-09-11T23:21:55.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.012+0000 7f0144400640 1 -- 172.21.15.144:0/29088897 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f013c1f40a0 con 0x7f013c0d02a0 2024-09-11T23:21:55.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.013+0000 7f0144400640 1 -- 172.21.15.144:0/29088897 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f013c0b4790 con 0x7f013c0d02a0 2024-09-11T23:21:55.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.014+0000 7f0139600640 1 -- 172.21.15.144:0/29088897 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f013001a070 con 0x7f013c0d02a0 2024-09-11T23:21:55.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.014+0000 7f0139600640 1 --2- 172.21.15.144:0/29088897 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f011c06c190 0x7f011c06e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:55.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.015+0000 7f0139600640 1 -- 172.21.15.144:0/29088897 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7f013008b860 con 0x7f013c0d02a0 2024-09-11T23:21:55.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.015+0000 7f0141000640 1 --2- 172.21.15.144:0/29088897 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f011c06c190 0x7f011c06e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:55.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.015+0000 7f0141000640 1 --2- 172.21.15.144:0/29088897 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f011c06c190 0x7f011c06e650 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f013c14dc50 tx=0x7f012800f040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:55.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.019+0000 7f0139600640 1 -- 172.21.15.144:0/29088897 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f01300595f0 con 0x7f013c0d02a0 2024-09-11T23:21:55.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.192+0000 7f0144400640 1 -- 172.21.15.144:0/29088897 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f013c1efe10 con 0x7f013c0d02a0 2024-09-11T23:21:55.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.193+0000 7f0139600640 1 -- 172.21.15.144:0/29088897 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+16765 (secure 0 0 0) 0x7f013005d8f0 con 0x7f013c0d02a0 2024-09-11T23:21:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:55.194 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":70,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:21:53.856162+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:21:52.048862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-11T23:21:52.855489+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:21:55.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.195+0000 7f0144400640 1 -- 172.21.15.144:0/29088897 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f011c06c190 msgr2=0x7f011c06e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:55.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.195+0000 7f0144400640 1 --2- 172.21.15.144:0/29088897 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f011c06c190 0x7f011c06e650 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f013c14dc50 tx=0x7f012800f040 comp rx=0 tx=0).stop 2024-09-11T23:21:55.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.195+0000 7f0144400640 1 -- 172.21.15.144:0/29088897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c0d02a0 msgr2=0x7f013c1f10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:55.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.195+0000 7f0144400640 1 --2- 172.21.15.144:0/29088897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c0d02a0 0x7f013c1f10d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f013000f8b0 tx=0x7f013000fd70 comp rx=0 tx=0).stop 2024-09-11T23:21:55.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.195+0000 7f0144400640 1 -- 172.21.15.144:0/29088897 shutdown_connections 2024-09-11T23:21:55.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.195+0000 7f0144400640 1 --2- 172.21.15.144:0/29088897 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f011c06c190 0x7f011c06e650 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:55.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.195+0000 7f0144400640 1 --2- 172.21.15.144:0/29088897 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013c15ce80 0x7f013c0713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:55.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.195+0000 7f0144400640 1 --2- 172.21.15.144:0/29088897 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f013c15ca40 0x7f013c1ef8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:55.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.195+0000 7f0144400640 1 --2- 172.21.15.144:0/29088897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c0d02a0 0x7f013c1f10d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:55.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.195+0000 7f0144400640 1 -- 172.21.15.144:0/29088897 >> 172.21.15.144:0/29088897 conn(0x7f013c062cc0 msgr2=0x7f013c0ce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:55.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.195+0000 7f0144400640 1 -- 172.21.15.144:0/29088897 shutdown_connections 2024-09-11T23:21:55.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.195+0000 7f0144400640 1 -- 172.21.15.144:0/29088897 wait complete. 2024-09-11T23:21:55.212 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:21:55.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.367+0000 7fb8c9800640 1 Processor -- start 2024-09-11T23:21:55.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.367+0000 7fb8c9800640 1 -- start start 2024-09-11T23:21:55.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.368+0000 7fb8c9800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb8c4143d40 0x7fb8c40b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:55.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.368+0000 7fb8c9800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8c41443d0 con 0x7fb8c40b4000 2024-09-11T23:21:55.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.368+0000 7fb8c9800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8c41446b0 con 0x7fb8c415ed50 2024-09-11T23:21:55.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.368+0000 7fb8c9800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb8c4144190 con 0x7fb8c4143d40 2024-09-11T23:21:55.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.368+0000 7fb8bbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb8c4143d40 0x7fb8c40b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:55.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.368+0000 7fb8c3400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb8c40b4000 0x7fb8c40ae8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53318/0 (socket says 172.21.15.144:53318) 2024-09-11T23:21:55.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.368+0000 7fb8bbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb8c4143d40 0x7fb8c40b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33716/0 (socket says 172.21.15.144:33716) 2024-09-11T23:21:55.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.368+0000 7fb8c3400640 1 -- 172.21.15.144:0/738231660 learned_addr learned my addr 172.21.15.144:0/738231660 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:55.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.369+0000 7fb8bbe00640 1 -- 172.21.15.144:0/738231660 >> v1:172.21.15.165:6789/0 conn(0x7fb8c415ed50 legacy=0x7fb8c4071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:55.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.369+0000 7fb8bbe00640 1 -- 172.21.15.144:0/738231660 >> v1:172.21.15.144:6789/0 conn(0x7fb8c40b4000 legacy=0x7fb8c40ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:55.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.369+0000 7fb8bbe00640 1 -- 172.21.15.144:0/738231660 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c4144990 con 0x7fb8c4143d40 2024-09-11T23:21:55.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.370+0000 7fb8bbe00640 1 --2- 172.21.15.144:0/738231660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8c4143d40 0x7fb8c40b3ac0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009790 tx=0x7fb8ac02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18b00301349f4e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:55.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.370+0000 7fb8c2000640 1 -- 172.21.15.144:0/738231660 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac037070 con 0x7fb8c4143d40 2024-09-11T23:21:55.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.370+0000 7fb8c2000640 1 -- 172.21.15.144:0/738231660 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8ac032440 con 0x7fb8c4143d40 2024-09-11T23:21:55.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.370+0000 7fb8c2000640 1 -- 172.21.15.144:0/738231660 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac032810 con 0x7fb8c4143d40 2024-09-11T23:21:55.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.370+0000 7fb8c9800640 1 -- 172.21.15.144:0/738231660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8c4143d40 msgr2=0x7fb8c40b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:55.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.370+0000 7fb8c9800640 1 --2- 172.21.15.144:0/738231660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8c4143d40 0x7fb8c40b3ac0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac009790 tx=0x7fb8ac02a180 comp rx=0 tx=0).stop 2024-09-11T23:21:55.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.371+0000 7fb8c9800640 1 -- 172.21.15.144:0/738231660 shutdown_connections 2024-09-11T23:21:55.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.371+0000 7fb8c9800640 1 --2- 172.21.15.144:0/738231660 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8c4143d40 0x7fb8c40b3ac0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:55.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.371+0000 7fb8c9800640 1 -- 172.21.15.144:0/738231660 >> 172.21.15.144:0/738231660 conn(0x7fb8c406bba0 msgr2=0x7fb8c406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:55.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.371+0000 7fb8c9800640 1 -- 172.21.15.144:0/738231660 shutdown_connections 2024-09-11T23:21:55.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.371+0000 7fb8c9800640 1 -- 172.21.15.144:0/738231660 wait complete. 2024-09-11T23:21:55.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.372+0000 7fb8c9800640 1 Processor -- start 2024-09-11T23:21:55.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.372+0000 7fb8c9800640 1 -- start start 2024-09-11T23:21:55.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.373+0000 7fb8c9800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8c40b4000 0x7fb8c415fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:55.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.373+0000 7fb8c9800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8c4143d40 0x7fb8c4154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:55.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.373+0000 7fb8c9800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8c415ed50 0x7fb8c41f7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:55.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.373+0000 7fb8c9800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c4071790 con 0x7fb8c4143d40 2024-09-11T23:21:55.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.373+0000 7fb8c9800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c40aeff0 con 0x7fb8c415ed50 2024-09-11T23:21:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.373+0000 7fb8c9800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb8c4155aa0 con 0x7fb8c40b4000 2024-09-11T23:21:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.373+0000 7fb8bbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8c4143d40 0x7fb8c4154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.374+0000 7fb8bbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8c4143d40 0x7fb8c4154e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33718/0 (socket says 172.21.15.144:33718) 2024-09-11T23:21:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.374+0000 7fb8bbe00640 1 -- 172.21.15.144:0/3445835578 learned_addr learned my addr 172.21.15.144:0/3445835578 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.374+0000 7fb8c3400640 1 --2- 172.21.15.144:0/3445835578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8c415ed50 0x7fb8c41f7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.374+0000 7fb8c2a00640 1 --2- 172.21.15.144:0/3445835578 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8c40b4000 0x7fb8c415fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.374+0000 7fb8bbe00640 1 -- 172.21.15.144:0/3445835578 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8c40b4000 msgr2=0x7fb8c415fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.374+0000 7fb8bbe00640 1 --2- 172.21.15.144:0/3445835578 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8c40b4000 0x7fb8c415fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.374+0000 7fb8bbe00640 1 -- 172.21.15.144:0/3445835578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8c415ed50 msgr2=0x7fb8c41f7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.374+0000 7fb8bbe00640 1 --2- 172.21.15.144:0/3445835578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8c415ed50 0x7fb8c41f7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.374+0000 7fb8bbe00640 1 -- 172.21.15.144:0/3445835578 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c4160120 con 0x7fb8c4143d40 2024-09-11T23:21:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.374+0000 7fb8c3400640 1 --2- 172.21.15.144:0/3445835578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8c415ed50 0x7fb8c41f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:55.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.374+0000 7fb8bbe00640 1 --2- 172.21.15.144:0/3445835578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8c4143d40 0x7fb8c4154e60 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac035040 tx=0x7fb8ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.374+0000 7fb8baa00640 1 -- 172.21.15.144:0/3445835578 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac037040 con 0x7fb8c4143d40 2024-09-11T23:21:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.374+0000 7fb8baa00640 1 -- 172.21.15.144:0/3445835578 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8ac005bd0 con 0x7fb8c4143d40 2024-09-11T23:21:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.374+0000 7fb8baa00640 1 -- 172.21.15.144:0/3445835578 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac030770 con 0x7fb8c4143d40 2024-09-11T23:21:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.375+0000 7fb8c9800640 1 -- 172.21.15.144:0/3445835578 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8c4160400 con 0x7fb8c4143d40 2024-09-11T23:21:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.375+0000 7fb8c9800640 1 -- 172.21.15.144:0/3445835578 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8c4158a60 con 0x7fb8c4143d40 2024-09-11T23:21:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.376+0000 7fb8c9800640 1 -- 172.21.15.144:0/3445835578 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8c40b3ac0 con 0x7fb8c4143d40 2024-09-11T23:21:55.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.376+0000 7fb8baa00640 1 -- 172.21.15.144:0/3445835578 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7fb8ac030910 con 0x7fb8c4143d40 2024-09-11T23:21:55.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.377+0000 7fb8baa00640 1 --2- 172.21.15.144:0/3445835578 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb8a006c190 0x7fb8a006e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:55.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.377+0000 7fb8baa00640 1 -- 172.21.15.144:0/3445835578 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7fb8ac0abfa0 con 0x7fb8c4143d40 2024-09-11T23:21:55.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.378+0000 7fb8c2a00640 1 --2- 172.21.15.144:0/3445835578 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb8a006c190 0x7fb8a006e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:55.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.378+0000 7fb8c2a00640 1 --2- 172.21.15.144:0/3445835578 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb8a006c190 0x7fb8a006e650 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4007fd0 tx=0x7fb8b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:55.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.382+0000 7fb8baa00640 1 -- 172.21.15.144:0/3445835578 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb8ac032e20 con 0x7fb8c4143d40 2024-09-11T23:21:55.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:55.594+0000 7fb8c9800640 1 -- 172.21.15.144:0/3445835578 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb8c40725a0 con 0x7fb8c4143d40 2024-09-11T23:21:56.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.475+0000 7fb8baa00640 1 -- 172.21.15.144:0/3445835578 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v45) ==== 118+0+0 (secure 0 0 0) 0x7fb8ac07a490 con 0x7fb8c4143d40 2024-09-11T23:21:56.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.478+0000 7fb8c9800640 1 -- 172.21.15.144:0/3445835578 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb8a006c190 msgr2=0x7fb8a006e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:56.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.478+0000 7fb8c9800640 1 --2- 172.21.15.144:0/3445835578 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb8a006c190 0x7fb8a006e650 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4007fd0 tx=0x7fb8b4009040 comp rx=0 tx=0).stop 2024-09-11T23:21:56.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.478+0000 7fb8c9800640 1 -- 172.21.15.144:0/3445835578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8c4143d40 msgr2=0x7fb8c4154e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:56.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.478+0000 7fb8c9800640 1 --2- 172.21.15.144:0/3445835578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8c4143d40 0x7fb8c4154e60 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac035040 tx=0x7fb8ac0046c0 comp rx=0 tx=0).stop 2024-09-11T23:21:56.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.478+0000 7fb8c9800640 1 -- 172.21.15.144:0/3445835578 shutdown_connections 2024-09-11T23:21:56.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.478+0000 7fb8c9800640 1 --2- 172.21.15.144:0/3445835578 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb8a006c190 0x7fb8a006e650 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:56.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.478+0000 7fb8c9800640 1 --2- 172.21.15.144:0/3445835578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8c415ed50 0x7fb8c41f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:56.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.479+0000 7fb8c9800640 1 --2- 172.21.15.144:0/3445835578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8c4143d40 0x7fb8c4154e60 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:56.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.479+0000 7fb8c9800640 1 --2- 172.21.15.144:0/3445835578 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb8c40b4000 0x7fb8c415fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:56.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.479+0000 7fb8c9800640 1 -- 172.21.15.144:0/3445835578 >> 172.21.15.144:0/3445835578 conn(0x7fb8c406bba0 msgr2=0x7fb8c40cf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:56.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.479+0000 7fb8c9800640 1 -- 172.21.15.144:0/3445835578 shutdown_connections 2024-09-11T23:21:56.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.479+0000 7fb8c9800640 1 -- 172.21.15.144:0/3445835578 wait complete. 2024-09-11T23:21:56.498 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:21:56.498 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:21:56.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.658+0000 7f91fbe00640 1 Processor -- start 2024-09-11T23:21:56.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.658+0000 7f91fbe00640 1 -- start start 2024-09-11T23:21:56.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.659+0000 7f91fbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f91fc15e6c0 0x7f91fc06c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:56.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.659+0000 7f91fbe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f91fc06d610 0x7f91fc06d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:56.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.659+0000 7f91fbe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91fc15eaa0 con 0x7f91fc0cf510 2024-09-11T23:21:56.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.659+0000 7f91fbe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f91fc0d34d0 con 0x7f91fc15e6c0 2024-09-11T23:21:56.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.659+0000 7f91fbe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f91fc06df30 con 0x7f91fc06d610 2024-09-11T23:21:56.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.659+0000 7f91faa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f91fc15e6c0 0x7f91fc06c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:56.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.660+0000 7f91fa000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f91fc0cf510 0x7f91fc0b7670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53332/0 (socket says 172.21.15.144:53332) 2024-09-11T23:21:56.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.660+0000 7f91fa000640 1 -- 172.21.15.144:0/2853902787 learned_addr learned my addr 172.21.15.144:0/2853902787 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:56.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.660+0000 7f91fb400640 1 --2- 172.21.15.144:0/2853902787 >> v2:172.21.15.165:3300/0 conn(0x7f91fc06d610 0x7f91fc06d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:56.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.660+0000 7f91faa00640 1 -- 172.21.15.144:0/2853902787 >> v2:172.21.15.165:3300/0 conn(0x7f91fc06d610 msgr2=0x7f91fc06d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:56.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.660+0000 7f91faa00640 1 --2- 172.21.15.144:0/2853902787 >> v2:172.21.15.165:3300/0 conn(0x7f91fc06d610 0x7f91fc06d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:56.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.660+0000 7f91faa00640 1 -- 172.21.15.144:0/2853902787 >> v1:172.21.15.144:6789/0 conn(0x7f91fc0cf510 legacy=0x7f91fc0b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:56.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.660+0000 7f91faa00640 1 -- 172.21.15.144:0/2853902787 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91fc06cdf0 con 0x7f91fc15e6c0 2024-09-11T23:21:56.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.660+0000 7f91f9600640 1 -- 172.21.15.144:0/2853902787 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2803979383 0 0) 0x7f91fc15eaa0 con 0x7f91fc0cf510 2024-09-11T23:21:56.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.660+0000 7f91fb400640 1 --2- 172.21.15.144:0/2853902787 >> v2:172.21.15.165:3300/0 conn(0x7f91fc06d610 0x7f91fc06d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:56.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.661+0000 7f91faa00640 1 --2- 172.21.15.144:0/2853902787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91fc15e6c0 0x7f91fc06c8b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0cb510 tx=0x7f91ec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886ba18e02cab486 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:56.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.661+0000 7f91f9600640 1 -- 172.21.15.144:0/2853902787 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec037070 con 0x7f91fc15e6c0 2024-09-11T23:21:56.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.661+0000 7f91f9600640 1 -- 172.21.15.144:0/2853902787 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91ec032440 con 0x7f91fc15e6c0 2024-09-11T23:21:56.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.661+0000 7f91f9600640 1 -- 172.21.15.144:0/2853902787 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec032810 con 0x7f91fc15e6c0 2024-09-11T23:21:56.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.662+0000 7f91fbe00640 1 -- 172.21.15.144:0/2853902787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91fc15e6c0 msgr2=0x7f91fc06c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:56.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.662+0000 7f91fbe00640 1 --2- 172.21.15.144:0/2853902787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91fc15e6c0 0x7f91fc06c8b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0cb510 tx=0x7f91ec02a1a0 comp rx=0 tx=0).stop 2024-09-11T23:21:56.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.662+0000 7f91fbe00640 1 -- 172.21.15.144:0/2853902787 shutdown_connections 2024-09-11T23:21:56.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.662+0000 7f91fbe00640 1 --2- 172.21.15.144:0/2853902787 >> v2:172.21.15.165:3300/0 conn(0x7f91fc06d610 0x7f91fc06d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:56.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.662+0000 7f91fbe00640 1 --2- 172.21.15.144:0/2853902787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91fc15e6c0 0x7f91fc06c8b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:56.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.662+0000 7f91fbe00640 1 -- 172.21.15.144:0/2853902787 >> 172.21.15.144:0/2853902787 conn(0x7f91fc0d4720 msgr2=0x7f91fc0d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:56.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.662+0000 7f91fbe00640 1 -- 172.21.15.144:0/2853902787 shutdown_connections 2024-09-11T23:21:56.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.662+0000 7f91fbe00640 1 -- 172.21.15.144:0/2853902787 wait complete. 2024-09-11T23:21:56.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.664+0000 7f91fbe00640 1 Processor -- start 2024-09-11T23:21:56.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.664+0000 7f91fbe00640 1 -- start start 2024-09-11T23:21:56.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.665+0000 7f91fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91fc06d610 0x7f91fc0b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:56.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.665+0000 7f91fbe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91fc0cf510 0x7f91fc0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:56.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.665+0000 7f91fbe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91fc15e6c0 0x7f91fc0cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:56.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.665+0000 7f91fbe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f91fc0d2e80 con 0x7f91fc06d610 2024-09-11T23:21:56.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.665+0000 7f91fbe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f91fc0d2ba0 con 0x7f91fc15e6c0 2024-09-11T23:21:56.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.665+0000 7f91fbe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f91fc0d3160 con 0x7f91fc0cf510 2024-09-11T23:21:56.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.665+0000 7f91faa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91fc06d610 0x7f91fc0b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:56.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.665+0000 7f91faa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91fc06d610 0x7f91fc0b59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33722/0 (socket says 172.21.15.144:33722) 2024-09-11T23:21:56.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.665+0000 7f91faa00640 1 -- 172.21.15.144:0/600594400 learned_addr learned my addr 172.21.15.144:0/600594400 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:56.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.665+0000 7f91fa000640 1 --2- 172.21.15.144:0/600594400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91fc0cf510 0x7f91fc0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:56.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.665+0000 7f91fb400640 1 --2- 172.21.15.144:0/600594400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91fc15e6c0 0x7f91fc0cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:56.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.665+0000 7f91faa00640 1 -- 172.21.15.144:0/600594400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91fc0cf510 msgr2=0x7f91fc0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:56.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.665+0000 7f91faa00640 1 --2- 172.21.15.144:0/600594400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91fc0cf510 0x7f91fc0b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:56.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.665+0000 7f91faa00640 1 -- 172.21.15.144:0/600594400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91fc15e6c0 msgr2=0x7f91fc0cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:56.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.665+0000 7f91faa00640 1 --2- 172.21.15.144:0/600594400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91fc15e6c0 0x7f91fc0cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:56.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.665+0000 7f91faa00640 1 -- 172.21.15.144:0/600594400 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91fc0b4910 con 0x7f91fc06d610 2024-09-11T23:21:56.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.666+0000 7f91faa00640 1 --2- 172.21.15.144:0/600594400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91fc06d610 0x7f91fc0b59b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f91ec000c00 tx=0x7f91ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:56.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.666+0000 7f91f3400640 1 -- 172.21.15.144:0/600594400 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec037050 con 0x7f91fc06d610 2024-09-11T23:21:56.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.666+0000 7f91f3400640 1 -- 172.21.15.144:0/600594400 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91ec038040 con 0x7f91fc06d610 2024-09-11T23:21:56.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.666+0000 7f91f3400640 1 -- 172.21.15.144:0/600594400 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec004470 con 0x7f91fc06d610 2024-09-11T23:21:56.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.666+0000 7f91fbe00640 1 -- 172.21.15.144:0/600594400 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91fc0b4bf0 con 0x7f91fc06d610 2024-09-11T23:21:56.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.666+0000 7f91fbe00640 1 -- 172.21.15.144:0/600594400 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91fc0b51b0 con 0x7f91fc06d610 2024-09-11T23:21:56.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.667+0000 7f91fbe00640 1 -- 172.21.15.144:0/600594400 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91fc06d9f0 con 0x7f91fc06d610 2024-09-11T23:21:56.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.668+0000 7f91f3400640 1 -- 172.21.15.144:0/600594400 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f91ec030900 con 0x7f91fc06d610 2024-09-11T23:21:56.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.669+0000 7f91f3400640 1 --2- 172.21.15.144:0/600594400 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f91dc06c190 0x7f91dc06e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:56.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.669+0000 7f91f3400640 1 -- 172.21.15.144:0/600594400 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f91ec0abf40 con 0x7f91fc06d610 2024-09-11T23:21:56.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.669+0000 7f91fa000640 1 --2- 172.21.15.144:0/600594400 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f91dc06c190 0x7f91dc06e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:56.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.670+0000 7f91fa000640 1 --2- 172.21.15.144:0/600594400 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f91dc06c190 0x7f91dc06e650 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0b5ef0 tx=0x7f91e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:56.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.673+0000 7f91f3400640 1 -- 172.21.15.144:0/600594400 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f91ec07a470 con 0x7f91fc06d610 2024-09-11T23:21:56.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:56.883+0000 7f91fbe00640 1 -- 172.21.15.144:0/600594400 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f91fc0cdc80 con 0x7f91fc06d610 2024-09-11T23:21:57.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.483+0000 7f91f3400640 1 -- 172.21.15.144:0/600594400 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7f91ec079d70 con 0x7f91fc06d610 2024-09-11T23:21:57.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.486+0000 7f91fbe00640 1 -- 172.21.15.144:0/600594400 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f91dc06c190 msgr2=0x7f91dc06e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:57.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.486+0000 7f91fbe00640 1 --2- 172.21.15.144:0/600594400 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f91dc06c190 0x7f91dc06e650 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0b5ef0 tx=0x7f91e8009040 comp rx=0 tx=0).stop 2024-09-11T23:21:57.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.486+0000 7f91fbe00640 1 -- 172.21.15.144:0/600594400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91fc06d610 msgr2=0x7f91fc0b59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:57.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.486+0000 7f91fbe00640 1 --2- 172.21.15.144:0/600594400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91fc06d610 0x7f91fc0b59b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f91ec000c00 tx=0x7f91ec0046c0 comp rx=0 tx=0).stop 2024-09-11T23:21:57.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.487+0000 7f91fbe00640 1 -- 172.21.15.144:0/600594400 shutdown_connections 2024-09-11T23:21:57.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.487+0000 7f91fbe00640 1 --2- 172.21.15.144:0/600594400 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f91dc06c190 0x7f91dc06e650 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:57.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.487+0000 7f91fbe00640 1 --2- 172.21.15.144:0/600594400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91fc15e6c0 0x7f91fc0cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:57.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.487+0000 7f91fbe00640 1 --2- 172.21.15.144:0/600594400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91fc0cf510 0x7f91fc0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:57.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.487+0000 7f91fbe00640 1 --2- 172.21.15.144:0/600594400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91fc06d610 0x7f91fc0b59b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:57.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.487+0000 7f91fbe00640 1 -- 172.21.15.144:0/600594400 >> 172.21.15.144:0/600594400 conn(0x7f91fc0d4720 msgr2=0x7f91fc15f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:57.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.487+0000 7f91fbe00640 1 -- 172.21.15.144:0/600594400 shutdown_connections 2024-09-11T23:21:57.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.487+0000 7f91fbe00640 1 -- 172.21.15.144:0/600594400 wait complete. 2024-09-11T23:21:57.505 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:21:57.505 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:21:57.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.659+0000 7ff792000640 1 Processor -- start 2024-09-11T23:21:57.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.659+0000 7ff792000640 1 -- start start 2024-09-11T23:21:57.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.660+0000 7ff792000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff78c0d0a50 0x7ff78c1620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:57.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.660+0000 7ff792000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff78c0b4930 0x7ff78c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:57.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.661+0000 7ff792000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff78c1625f0 con 0x7ff78c15f620 2024-09-11T23:21:57.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.661+0000 7ff792000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff78c0b52d0 con 0x7ff78c0d0a50 2024-09-11T23:21:57.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.661+0000 7ff792000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff78c162870 con 0x7ff78c0b4930 2024-09-11T23:21:57.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.661+0000 7ff78b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff78c0d0a50 0x7ff78c1620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:57.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.661+0000 7ff78b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff78c0d0a50 0x7ff78c1620b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33728/0 (socket says 172.21.15.144:33728) 2024-09-11T23:21:57.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.661+0000 7ff78b400640 1 -- 172.21.15.144:0/3053959136 learned_addr learned my addr 172.21.15.144:0/3053959136 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:57.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.661+0000 7ff78aa00640 1 --2- 172.21.15.144:0/3053959136 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff78c0b4930 0x7ff78c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:57.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.661+0000 7ff78b400640 1 -- 172.21.15.144:0/3053959136 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff78c0b4930 msgr2=0x7ff78c0b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:57.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.661+0000 7ff78b400640 1 --2- 172.21.15.144:0/3053959136 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff78c0b4930 0x7ff78c0b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:57.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.661+0000 7ff78b400640 1 -- 172.21.15.144:0/3053959136 >> v1:172.21.15.165:6789/0 conn(0x7ff78c15f620 legacy=0x7ff78c15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:57.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.661+0000 7ff78b400640 1 -- 172.21.15.144:0/3053959136 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78c162b50 con 0x7ff78c0d0a50 2024-09-11T23:21:57.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.662+0000 7ff78b400640 1 --2- 172.21.15.144:0/3053959136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff78c0d0a50 0x7ff78c1620b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff77c009870 tx=0x7ff77c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7a29944a976fa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:57.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.662+0000 7ff78a000640 1 -- 172.21.15.144:0/3053959136 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c037070 con 0x7ff78c0d0a50 2024-09-11T23:21:57.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.663+0000 7ff78a000640 1 -- 172.21.15.144:0/3053959136 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff77c032440 con 0x7ff78c0d0a50 2024-09-11T23:21:57.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.663+0000 7ff78a000640 1 -- 172.21.15.144:0/3053959136 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c032810 con 0x7ff78c0d0a50 2024-09-11T23:21:57.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.663+0000 7ff792000640 1 -- 172.21.15.144:0/3053959136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff78c0d0a50 msgr2=0x7ff78c1620b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:57.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.663+0000 7ff792000640 1 --2- 172.21.15.144:0/3053959136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff78c0d0a50 0x7ff78c1620b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff77c009870 tx=0x7ff77c02a180 comp rx=0 tx=0).stop 2024-09-11T23:21:57.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.663+0000 7ff792000640 1 -- 172.21.15.144:0/3053959136 shutdown_connections 2024-09-11T23:21:57.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.663+0000 7ff792000640 1 --2- 172.21.15.144:0/3053959136 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff78c0b4930 0x7ff78c0b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:57.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.663+0000 7ff792000640 1 --2- 172.21.15.144:0/3053959136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff78c0d0a50 0x7ff78c1620b0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:57.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.663+0000 7ff792000640 1 -- 172.21.15.144:0/3053959136 >> 172.21.15.144:0/3053959136 conn(0x7ff78c062cc0 msgr2=0x7ff78c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:57.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.663+0000 7ff792000640 1 -- 172.21.15.144:0/3053959136 shutdown_connections 2024-09-11T23:21:57.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.663+0000 7ff792000640 1 -- 172.21.15.144:0/3053959136 wait complete. 2024-09-11T23:21:57.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.665+0000 7ff792000640 1 Processor -- start 2024-09-11T23:21:57.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.665+0000 7ff792000640 1 -- start start 2024-09-11T23:21:57.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.666+0000 7ff792000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff78c0b4930 0x7ff78c1e84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:57.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.666+0000 7ff792000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff78c15f620 0x7ff78c143690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:57.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.666+0000 7ff792000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff78c143bd0 0x7ff78c1f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:57.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.666+0000 7ff792000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c0b3620 con 0x7ff78c15f620 2024-09-11T23:21:57.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.666+0000 7ff792000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff78c0b3340 con 0x7ff78c143bd0 2024-09-11T23:21:57.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.666+0000 7ff792000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff78c0b3b40 con 0x7ff78c0b4930 2024-09-11T23:21:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.666+0000 7ff78aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff78c15f620 0x7ff78c143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.666+0000 7ff78aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff78c15f620 0x7ff78c143690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33732/0 (socket says 172.21.15.144:33732) 2024-09-11T23:21:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.666+0000 7ff78aa00640 1 -- 172.21.15.144:0/1987080031 learned_addr learned my addr 172.21.15.144:0/1987080031 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.666+0000 7ff78b400640 1 --2- 172.21.15.144:0/1987080031 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff78c0b4930 0x7ff78c1e84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.666+0000 7ff78be00640 1 --2- 172.21.15.144:0/1987080031 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff78c143bd0 0x7ff78c1f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.667+0000 7ff78aa00640 1 -- 172.21.15.144:0/1987080031 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff78c0b4930 msgr2=0x7ff78c1e84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.667+0000 7ff78aa00640 1 --2- 172.21.15.144:0/1987080031 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff78c0b4930 0x7ff78c1e84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.667+0000 7ff78aa00640 1 -- 172.21.15.144:0/1987080031 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff78c143bd0 msgr2=0x7ff78c1f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.667+0000 7ff78aa00640 1 --2- 172.21.15.144:0/1987080031 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff78c143bd0 0x7ff78c1f45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.667+0000 7ff78aa00640 1 -- 172.21.15.144:0/1987080031 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78c073190 con 0x7ff78c15f620 2024-09-11T23:21:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.667+0000 7ff78aa00640 1 --2- 172.21.15.144:0/1987080031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff78c15f620 0x7ff78c143690 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff77800d800 tx=0x7ff77800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:57.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.667+0000 7ff783400640 1 -- 172.21.15.144:0/1987080031 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77800b6c0 con 0x7ff78c15f620 2024-09-11T23:21:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.667+0000 7ff783400640 1 -- 172.21.15.144:0/1987080031 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff778019070 con 0x7ff78c15f620 2024-09-11T23:21:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.667+0000 7ff783400640 1 -- 172.21.15.144:0/1987080031 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77800ba80 con 0x7ff78c15f620 2024-09-11T23:21:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.667+0000 7ff792000640 1 -- 172.21.15.144:0/1987080031 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff78c073470 con 0x7ff78c15f620 2024-09-11T23:21:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.667+0000 7ff792000640 1 -- 172.21.15.144:0/1987080031 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff78c073a30 con 0x7ff78c15f620 2024-09-11T23:21:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.668+0000 7ff792000640 1 -- 172.21.15.144:0/1987080031 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff78c15e5a0 con 0x7ff78c15f620 2024-09-11T23:21:57.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.669+0000 7ff783400640 1 -- 172.21.15.144:0/1987080031 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7ff77800bc20 con 0x7ff78c15f620 2024-09-11T23:21:57.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.670+0000 7ff783400640 1 --2- 172.21.15.144:0/1987080031 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff76c06c100 0x7ff76c06e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:57.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.670+0000 7ff783400640 1 -- 172.21.15.144:0/1987080031 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7ff77808b740 con 0x7ff78c15f620 2024-09-11T23:21:57.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.670+0000 7ff78b400640 1 --2- 172.21.15.144:0/1987080031 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff76c06c100 0x7ff76c06e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:57.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.671+0000 7ff78b400640 1 --2- 172.21.15.144:0/1987080031 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff76c06c100 0x7ff76c06e5c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff77c034000 tx=0x7ff77c02e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:57.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.674+0000 7ff783400640 1 -- 172.21.15.144:0/1987080031 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff78c15e5a0 con 0x7ff78c15f620 2024-09-11T23:21:57.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.881+0000 7ff792000640 1 -- 172.21.15.144:0/1987080031 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff78c0b4d90 con 0x7ff78c15f620 2024-09-11T23:21:57.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.882+0000 7ff783400640 1 -- 172.21.15.144:0/1987080031 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5228 (secure 0 0 0) 0x7ff778059670 con 0x7ff78c15f620 2024-09-11T23:21:57.883 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:57.883 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":46,"btime":"2024-09-11T23:21:57:477637+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5417,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/494282276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":494282276},{"type":"v1","addr":"172.21.15.165:6833","nonce":494282276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5827,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1734890696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":1734890696},{"type":"v1","addr":"172.21.15.165:6835","nonce":1734890696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1671926294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1671926294},{"type":"v1","addr":"172.21.15.144:6836","nonce":1671926294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:21:53.856502+0000","modified":"2024-09-11T23:21:56.886031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6093},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6093":{"gid":6093,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6837/97031260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":97031260},{"type":"v1","addr":"172.21.15.144:6837","nonce":97031260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6093,"qdb_cluster":[6093]},"id":5}]} 2024-09-11T23:21:57.883 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 46 2024-09-11T23:21:57.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.884+0000 7ff792000640 1 -- 172.21.15.144:0/1987080031 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff76c06c100 msgr2=0x7ff76c06e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:57.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.884+0000 7ff792000640 1 --2- 172.21.15.144:0/1987080031 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff76c06c100 0x7ff76c06e5c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff77c034000 tx=0x7ff77c02e000 comp rx=0 tx=0).stop 2024-09-11T23:21:57.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.884+0000 7ff792000640 1 -- 172.21.15.144:0/1987080031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff78c15f620 msgr2=0x7ff78c143690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:57.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.884+0000 7ff792000640 1 --2- 172.21.15.144:0/1987080031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff78c15f620 0x7ff78c143690 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff77800d800 tx=0x7ff77800dcc0 comp rx=0 tx=0).stop 2024-09-11T23:21:57.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.884+0000 7ff792000640 1 -- 172.21.15.144:0/1987080031 shutdown_connections 2024-09-11T23:21:57.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.884+0000 7ff792000640 1 --2- 172.21.15.144:0/1987080031 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff76c06c100 0x7ff76c06e5c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:57.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.884+0000 7ff792000640 1 --2- 172.21.15.144:0/1987080031 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff78c143bd0 0x7ff78c1f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:57.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.884+0000 7ff792000640 1 --2- 172.21.15.144:0/1987080031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff78c15f620 0x7ff78c143690 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:57.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.884+0000 7ff792000640 1 --2- 172.21.15.144:0/1987080031 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff78c0b4930 0x7ff78c1e84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:57.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.884+0000 7ff792000640 1 -- 172.21.15.144:0/1987080031 >> 172.21.15.144:0/1987080031 conn(0x7ff78c062cc0 msgr2=0x7ff78c0ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:57.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.884+0000 7ff792000640 1 -- 172.21.15.144:0/1987080031 shutdown_connections 2024-09-11T23:21:57.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:57.884+0000 7ff792000640 1 -- 172.21.15.144:0/1987080031 wait complete. 2024-09-11T23:21:57.900 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:21:58.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.053+0000 7f7087000640 1 Processor -- start 2024-09-11T23:21:58.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.053+0000 7f7087000640 1 -- start start 2024-09-11T23:21:58.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.055+0000 7f7087000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7080073830 0x7f70800cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:58.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.055+0000 7f7087000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70800ce740 con 0x7f708015c180 2024-09-11T23:21:58.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.055+0000 7f7087000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7080072640 con 0x7f70800cf070 2024-09-11T23:21:58.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.055+0000 7f7087000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7080072920 con 0x7f7080073830 2024-09-11T23:21:58.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.055+0000 7f707fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f708015c180 0x7f70800cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53336/0 (socket says 172.21.15.144:53336) 2024-09-11T23:21:58.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.055+0000 7f707fe00640 1 -- 172.21.15.144:0/2873517943 learned_addr learned my addr 172.21.15.144:0/2873517943 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:58.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.055+0000 7f7085000640 1 --2- 172.21.15.144:0/2873517943 >> v2:172.21.15.144:3300/0 conn(0x7f7080073830 0x7f70800cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:58.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.055+0000 7f707f400640 1 -- 172.21.15.144:0/2873517943 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2305210503 0 0) 0x7f70800ce740 con 0x7f708015c180 2024-09-11T23:21:58.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.055+0000 7f707f400640 1 -- 172.21.15.144:0/2873517943 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7064003520 con 0x7f708015c180 2024-09-11T23:21:58.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.055+0000 7f7085000640 1 -- 172.21.15.144:0/2873517943 >> v1:172.21.15.165:6789/0 conn(0x7f70800cf070 legacy=0x7f7080073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:58.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.055+0000 7f7085000640 1 -- 172.21.15.144:0/2873517943 >> v1:172.21.15.144:6789/0 conn(0x7f708015c180 legacy=0x7f70800cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:58.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.055+0000 7f7085000640 1 -- 172.21.15.144:0/2873517943 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7080072c00 con 0x7f7080073830 2024-09-11T23:21:58.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.056+0000 7f7085000640 1 --2- 172.21.15.144:0/2873517943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7080073830 0x7f70800cf4e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7078009d90 tx=0x7f707802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404e0d29074d1169 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:58.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.057+0000 7f707f400640 1 -- 172.21.15.144:0/2873517943 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7078007740 con 0x7f7080073830 2024-09-11T23:21:58.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.057+0000 7f707f400640 1 -- 172.21.15.144:0/2873517943 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70780078e0 con 0x7f7080073830 2024-09-11T23:21:58.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.057+0000 7f707f400640 1 -- 172.21.15.144:0/2873517943 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7078007cb0 con 0x7f7080073830 2024-09-11T23:21:58.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.057+0000 7f7087000640 1 -- 172.21.15.144:0/2873517943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7080073830 msgr2=0x7f70800cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:58.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.057+0000 7f7087000640 1 --2- 172.21.15.144:0/2873517943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7080073830 0x7f70800cf4e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7078009d90 tx=0x7f707802a660 comp rx=0 tx=0).stop 2024-09-11T23:21:58.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.057+0000 7f7087000640 1 -- 172.21.15.144:0/2873517943 shutdown_connections 2024-09-11T23:21:58.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.057+0000 7f7087000640 1 --2- 172.21.15.144:0/2873517943 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7080073830 0x7f70800cf4e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.057+0000 7f7087000640 1 -- 172.21.15.144:0/2873517943 >> 172.21.15.144:0/2873517943 conn(0x7f7080062cc0 msgr2=0x7f708006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:58.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.057+0000 7f7087000640 1 -- 172.21.15.144:0/2873517943 shutdown_connections 2024-09-11T23:21:58.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.057+0000 7f7087000640 1 -- 172.21.15.144:0/2873517943 wait complete. 2024-09-11T23:21:58.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.059+0000 7f7087000640 1 Processor -- start 2024-09-11T23:21:58.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.059+0000 7f7087000640 1 -- start start 2024-09-11T23:21:58.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.060+0000 7f7087000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7080073830 0x7f7080146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:58.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.060+0000 7f7087000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70800cf070 0x7f70800c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:58.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.060+0000 7f7087000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f708015c180 0x7f70800c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:58.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.060+0000 7f7087000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f70800722f0 con 0x7f708015c180 2024-09-11T23:21:58.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.060+0000 7f7087000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f70800ced00 con 0x7f7080073830 2024-09-11T23:21:58.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.060+0000 7f7087000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f708015c560 con 0x7f70800cf070 2024-09-11T23:21:58.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.060+0000 7f7085000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f708015c180 0x7f70800c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:58.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.060+0000 7f7085000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f708015c180 0x7f70800c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33750/0 (socket says 172.21.15.144:33750) 2024-09-11T23:21:58.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.060+0000 7f7085000640 1 -- 172.21.15.144:0/3382822790 learned_addr learned my addr 172.21.15.144:0/3382822790 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:58.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.061+0000 7f7077400640 1 --2- 172.21.15.144:0/3382822790 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70800cf070 0x7f70800c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:58.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.061+0000 7f707fe00640 1 --2- 172.21.15.144:0/3382822790 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7080073830 0x7f7080146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:58.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.061+0000 7f7085000640 1 -- 172.21.15.144:0/3382822790 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70800cf070 msgr2=0x7f70800c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:58.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.061+0000 7f7085000640 1 --2- 172.21.15.144:0/3382822790 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70800cf070 0x7f70800c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.061+0000 7f7085000640 1 -- 172.21.15.144:0/3382822790 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7080073830 msgr2=0x7f7080146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:58.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.061+0000 7f7085000640 1 --2- 172.21.15.144:0/3382822790 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7080073830 0x7f7080146f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.061+0000 7f7085000640 1 -- 172.21.15.144:0/3382822790 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70800cb630 con 0x7f708015c180 2024-09-11T23:21:58.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.061+0000 7f7085000640 1 --2- 172.21.15.144:0/3382822790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f708015c180 0x7f70800c89a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7078009eb0 tx=0x7f7078004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:58.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.061+0000 7f707cc00640 1 -- 172.21.15.144:0/3382822790 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7078040070 con 0x7f708015c180 2024-09-11T23:21:58.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.061+0000 7f707cc00640 1 -- 172.21.15.144:0/3382822790 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7078031bc0 con 0x7f708015c180 2024-09-11T23:21:58.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.061+0000 7f7087000640 1 -- 172.21.15.144:0/3382822790 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70800cb910 con 0x7f708015c180 2024-09-11T23:21:58.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.062+0000 7f707cc00640 1 -- 172.21.15.144:0/3382822790 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7078009450 con 0x7f708015c180 2024-09-11T23:21:58.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.062+0000 7f7087000640 1 -- 172.21.15.144:0/3382822790 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70800cbed0 con 0x7f708015c180 2024-09-11T23:21:58.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.063+0000 7f7087000640 1 -- 172.21.15.144:0/3382822790 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70800ce220 con 0x7f708015c180 2024-09-11T23:21:58.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.064+0000 7f707cc00640 1 -- 172.21.15.144:0/3382822790 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f7078039040 con 0x7f708015c180 2024-09-11T23:21:58.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.064+0000 7f707cc00640 1 --2- 172.21.15.144:0/3382822790 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f705c06c190 0x7f705c06e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:58.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.065+0000 7f707cc00640 1 -- 172.21.15.144:0/3382822790 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f70780acbe0 con 0x7f708015c180 2024-09-11T23:21:58.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.065+0000 7f707fe00640 1 --2- 172.21.15.144:0/3382822790 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f705c06c190 0x7f705c06e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:58.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.065+0000 7f707fe00640 1 --2- 172.21.15.144:0/3382822790 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f705c06c190 0x7f705c06e650 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f70700011e0 tx=0x7f7070007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:58.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.068+0000 7f707cc00640 1 -- 172.21.15.144:0/3382822790 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f70800ce220 con 0x7f708015c180 2024-09-11T23:21:58.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.243+0000 7f7087000640 1 -- 172.21.15.144:0/3382822790 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70800cf4e0 con 0x7f708015c180 2024-09-11T23:21:58.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.244+0000 7f707cc00640 1 -- 172.21.15.144:0/3382822790 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+16752 (secure 0 0 0) 0x7f707807a9e0 con 0x7f708015c180 2024-09-11T23:21:58.245 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:58.246 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":71,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:21:55.457895+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:21:52.048862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-11T23:21:52.855489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:21:58.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.247+0000 7f7087000640 1 -- 172.21.15.144:0/3382822790 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f705c06c190 msgr2=0x7f705c06e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:58.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.247+0000 7f7087000640 1 --2- 172.21.15.144:0/3382822790 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f705c06c190 0x7f705c06e650 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f70700011e0 tx=0x7f7070007d30 comp rx=0 tx=0).stop 2024-09-11T23:21:58.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.247+0000 7f7087000640 1 -- 172.21.15.144:0/3382822790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f708015c180 msgr2=0x7f70800c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:58.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.247+0000 7f7087000640 1 --2- 172.21.15.144:0/3382822790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f708015c180 0x7f70800c89a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7078009eb0 tx=0x7f7078004a40 comp rx=0 tx=0).stop 2024-09-11T23:21:58.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.247+0000 7f7087000640 1 -- 172.21.15.144:0/3382822790 shutdown_connections 2024-09-11T23:21:58.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.247+0000 7f7087000640 1 --2- 172.21.15.144:0/3382822790 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f705c06c190 0x7f705c06e650 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.247+0000 7f7087000640 1 --2- 172.21.15.144:0/3382822790 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f708015c180 0x7f70800c89a0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.247+0000 7f7087000640 1 --2- 172.21.15.144:0/3382822790 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70800cf070 0x7f70800c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.247+0000 7f7087000640 1 --2- 172.21.15.144:0/3382822790 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7080073830 0x7f7080146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.247+0000 7f7087000640 1 -- 172.21.15.144:0/3382822790 >> 172.21.15.144:0/3382822790 conn(0x7f7080062cc0 msgr2=0x7f7080160650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:58.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.247+0000 7f7087000640 1 -- 172.21.15.144:0/3382822790 shutdown_connections 2024-09-11T23:21:58.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.247+0000 7f7087000640 1 -- 172.21.15.144:0/3382822790 wait complete. 2024-09-11T23:21:58.265 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:21:58.266 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:21:58.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.419+0000 7fda71a00640 1 Processor -- start 2024-09-11T23:21:58.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.419+0000 7fda71a00640 1 -- start start 2024-09-11T23:21:58.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.420+0000 7fda71a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda6c15e640 0x7fda6c0d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:58.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.420+0000 7fda71a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fda6c0b66e0 0x7fda6c0b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:58.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.420+0000 7fda71a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6c06bee0 con 0x7fda6c0d3f60 2024-09-11T23:21:58.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.420+0000 7fda71a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fda6c15ea20 con 0x7fda6c0b66e0 2024-09-11T23:21:58.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.420+0000 7fda71a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fda6c06caf0 con 0x7fda6c15e640 2024-09-11T23:21:58.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.421+0000 7fda63400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fda6c0d3f60 0x7fda6c0b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53352/0 (socket says 172.21.15.144:53352) 2024-09-11T23:21:58.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.421+0000 7fda63400640 1 -- 172.21.15.144:0/543730441 learned_addr learned my addr 172.21.15.144:0/543730441 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:58.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.421+0000 7fda71000640 1 --2- 172.21.15.144:0/543730441 >> v2:172.21.15.165:3300/0 conn(0x7fda6c0b66e0 0x7fda6c0b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:58.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.421+0000 7fda6be00640 1 --2- 172.21.15.144:0/543730441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda6c15e640 0x7fda6c0d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:58.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.421+0000 7fda6b400640 1 -- 172.21.15.144:0/543730441 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3722858821 0 0) 0x7fda6c06bee0 con 0x7fda6c0d3f60 2024-09-11T23:21:58.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.421+0000 7fda6b400640 1 -- 172.21.15.144:0/543730441 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda50003520 con 0x7fda6c0d3f60 2024-09-11T23:21:58.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.421+0000 7fda71000640 1 -- 172.21.15.144:0/543730441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda6c15e640 msgr2=0x7fda6c0d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:58.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.421+0000 7fda71000640 1 --2- 172.21.15.144:0/543730441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda6c15e640 0x7fda6c0d3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.421+0000 7fda71000640 1 -- 172.21.15.144:0/543730441 >> v1:172.21.15.144:6789/0 conn(0x7fda6c0d3f60 legacy=0x7fda6c0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:58.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.421+0000 7fda71000640 1 -- 172.21.15.144:0/543730441 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6c06c1c0 con 0x7fda6c0b66e0 2024-09-11T23:21:58.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.422+0000 7fda71000640 1 --2- 172.21.15.144:0/543730441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda6c0b66e0 0x7fda6c0b7750 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fda64009d90 tx=0x7fda6402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=580cff729a7acf83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:58.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.423+0000 7fda6b400640 1 -- 172.21.15.144:0/543730441 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64007740 con 0x7fda6c0b66e0 2024-09-11T23:21:58.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.423+0000 7fda6b400640 1 -- 172.21.15.144:0/543730441 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda640078e0 con 0x7fda6c0b66e0 2024-09-11T23:21:58.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.423+0000 7fda6b400640 1 -- 172.21.15.144:0/543730441 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64007c90 con 0x7fda6c0b66e0 2024-09-11T23:21:58.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.423+0000 7fda71a00640 1 -- 172.21.15.144:0/543730441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda6c0b66e0 msgr2=0x7fda6c0b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:58.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.423+0000 7fda71a00640 1 --2- 172.21.15.144:0/543730441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda6c0b66e0 0x7fda6c0b7750 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fda64009d90 tx=0x7fda6402a660 comp rx=0 tx=0).stop 2024-09-11T23:21:58.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.423+0000 7fda71a00640 1 -- 172.21.15.144:0/543730441 shutdown_connections 2024-09-11T23:21:58.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.423+0000 7fda71a00640 1 --2- 172.21.15.144:0/543730441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda6c0b66e0 0x7fda6c0b7750 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.423+0000 7fda71a00640 1 --2- 172.21.15.144:0/543730441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda6c15e640 0x7fda6c0d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.423+0000 7fda71a00640 1 -- 172.21.15.144:0/543730441 >> 172.21.15.144:0/543730441 conn(0x7fda6c0d0fd0 msgr2=0x7fda6c0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:58.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.423+0000 7fda71a00640 1 -- 172.21.15.144:0/543730441 shutdown_connections 2024-09-11T23:21:58.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.423+0000 7fda71a00640 1 -- 172.21.15.144:0/543730441 wait complete. 2024-09-11T23:21:58.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.425+0000 7fda71a00640 1 Processor -- start 2024-09-11T23:21:58.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.425+0000 7fda71a00640 1 -- start start 2024-09-11T23:21:58.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.426+0000 7fda71a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda6c0b66e0 0x7fda6c150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:58.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.426+0000 7fda71a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda6c0d3f60 0x7fda6c0ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:58.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.426+0000 7fda71a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda6c15e640 0x7fda6c0ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:58.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.426+0000 7fda71a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fda6c0b7c90 con 0x7fda6c0b66e0 2024-09-11T23:21:58.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.426+0000 7fda71a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fda6c06c780 con 0x7fda6c15e640 2024-09-11T23:21:58.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.426+0000 7fda71a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fda6c0b7e10 con 0x7fda6c0d3f60 2024-09-11T23:21:58.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.426+0000 7fda6be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda6c0b66e0 0x7fda6c150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:58.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.426+0000 7fda6be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda6c0b66e0 0x7fda6c150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33760/0 (socket says 172.21.15.144:33760) 2024-09-11T23:21:58.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.426+0000 7fda6be00640 1 -- 172.21.15.144:0/507199822 learned_addr learned my addr 172.21.15.144:0/507199822 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:58.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.427+0000 7fda63400640 1 --2- 172.21.15.144:0/507199822 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda6c0d3f60 0x7fda6c0ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:58.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.427+0000 7fda71000640 1 --2- 172.21.15.144:0/507199822 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda6c15e640 0x7fda6c0ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:58.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.427+0000 7fda6be00640 1 -- 172.21.15.144:0/507199822 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda6c0d3f60 msgr2=0x7fda6c0ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:58.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.427+0000 7fda6be00640 1 --2- 172.21.15.144:0/507199822 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda6c0d3f60 0x7fda6c0ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.427+0000 7fda6be00640 1 -- 172.21.15.144:0/507199822 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda6c15e640 msgr2=0x7fda6c0ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:58.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.427+0000 7fda6be00640 1 --2- 172.21.15.144:0/507199822 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda6c15e640 0x7fda6c0ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.427+0000 7fda6be00640 1 -- 172.21.15.144:0/507199822 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6c0ce4a0 con 0x7fda6c0b66e0 2024-09-11T23:21:58.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.427+0000 7fda6be00640 1 --2- 172.21.15.144:0/507199822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda6c0b66e0 0x7fda6c150860 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00e870 tx=0x7fda5c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:58.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.427+0000 7fda68c00640 1 -- 172.21.15.144:0/507199822 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c017070 con 0x7fda6c0b66e0 2024-09-11T23:21:58.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.427+0000 7fda68c00640 1 -- 172.21.15.144:0/507199822 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda5c00c940 con 0x7fda6c0b66e0 2024-09-11T23:21:58.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.428+0000 7fda71a00640 1 -- 172.21.15.144:0/507199822 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda6c0cd920 con 0x7fda6c0b66e0 2024-09-11T23:21:58.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.428+0000 7fda68c00640 1 -- 172.21.15.144:0/507199822 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c00cd30 con 0x7fda6c0b66e0 2024-09-11T23:21:58.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.428+0000 7fda71a00640 1 -- 172.21.15.144:0/507199822 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda6c0cdee0 con 0x7fda6c0b66e0 2024-09-11T23:21:58.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.429+0000 7fda71a00640 1 -- 172.21.15.144:0/507199822 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda6c0b7750 con 0x7fda6c0b66e0 2024-09-11T23:21:58.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.429+0000 7fda68c00640 1 -- 172.21.15.144:0/507199822 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7fda5c01a070 con 0x7fda6c0b66e0 2024-09-11T23:21:58.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.430+0000 7fda68c00640 1 --2- 172.21.15.144:0/507199822 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fda4806c1c0 0x7fda4806e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:58.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.430+0000 7fda68c00640 1 -- 172.21.15.144:0/507199822 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7fda5c08b150 con 0x7fda6c0b66e0 2024-09-11T23:21:58.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.430+0000 7fda63400640 1 --2- 172.21.15.144:0/507199822 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fda4806c1c0 0x7fda4806e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:58.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.431+0000 7fda63400640 1 --2- 172.21.15.144:0/507199822 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fda4806c1c0 0x7fda4806e680 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fda6c1f75e0 tx=0x7fda54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:58.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.434+0000 7fda68c00640 1 -- 172.21.15.144:0/507199822 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fda5c0590f0 con 0x7fda6c0b66e0 2024-09-11T23:21:58.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.606+0000 7fda71a00640 1 -- 172.21.15.144:0/507199822 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fda6c0d0980 con 0x7fda4806c1c0 2024-09-11T23:21:58.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.612+0000 7fda68c00640 1 -- 172.21.15.144:0/507199822 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248276 (secure 0 0 0) 0x7fda6c0d0980 con 0x7fda4806c1c0 2024-09-11T23:21:58.616 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:58.617 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:21:58.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.616+0000 7fda71a00640 1 -- 172.21.15.144:0/507199822 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fda4806c1c0 msgr2=0x7fda4806e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:58.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.616+0000 7fda71a00640 1 --2- 172.21.15.144:0/507199822 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fda4806c1c0 0x7fda4806e680 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fda6c1f75e0 tx=0x7fda54009040 comp rx=0 tx=0).stop 2024-09-11T23:21:58.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.616+0000 7fda71a00640 1 -- 172.21.15.144:0/507199822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda6c0b66e0 msgr2=0x7fda6c150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:58.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.616+0000 7fda71a00640 1 --2- 172.21.15.144:0/507199822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda6c0b66e0 0x7fda6c150860 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00e870 tx=0x7fda5c00ed30 comp rx=0 tx=0).stop 2024-09-11T23:21:58.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.616+0000 7fda71a00640 1 -- 172.21.15.144:0/507199822 shutdown_connections 2024-09-11T23:21:58.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.616+0000 7fda71a00640 1 --2- 172.21.15.144:0/507199822 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fda4806c1c0 0x7fda4806e680 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.616+0000 7fda71a00640 1 --2- 172.21.15.144:0/507199822 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda6c15e640 0x7fda6c0ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.616+0000 7fda71a00640 1 --2- 172.21.15.144:0/507199822 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fda6c0d3f60 0x7fda6c0ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.616+0000 7fda71a00640 1 --2- 172.21.15.144:0/507199822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fda6c0b66e0 0x7fda6c150860 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.616+0000 7fda71a00640 1 -- 172.21.15.144:0/507199822 >> 172.21.15.144:0/507199822 conn(0x7fda6c0d0fd0 msgr2=0x7fda6c160bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:58.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.616+0000 7fda71a00640 1 -- 172.21.15.144:0/507199822 shutdown_connections 2024-09-11T23:21:58.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.616+0000 7fda71a00640 1 -- 172.21.15.144:0/507199822 wait complete. 2024-09-11T23:21:58.633 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-09-11T23:21:57.217306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591042,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":190,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":160,"acting":160,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":59,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248872,"kb_used_data":7656,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725848,"statfs":{"total":773094113280,"available":772839268352,"internally_reserved":0,"allocated":7839744,"data_stored":3947933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":674,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.774121"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.477555+0000","last_change":"2024-09-11T23:21:54.474738+0000","last_active":"2024-09-11T23:21:54.477555+0000","last_peered":"2024-09-11T23:21:54.477555+0000","last_clean":"2024-09-11T23:21:54.477555+0000","last_became_active":"2024-09-11T23:21:54.474049+0000","last_became_peered":"2024-09-11T23:21:54.474049+0000","last_unstale":"2024-09-11T23:21:54.477555+0000","last_undegraded":"2024-09-11T23:21:54.477555+0000","last_fullsized":"2024-09-11T23:21:54.477555+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:58.260435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484862+0000","last_change":"2024-09-11T23:21:54.481578+0000","last_active":"2024-09-11T23:21:54.484862+0000","last_peered":"2024-09-11T23:21:54.484862+0000","last_clean":"2024-09-11T23:21:54.484862+0000","last_became_active":"2024-09-11T23:21:54.481187+0000","last_became_peered":"2024-09-11T23:21:54.481187+0000","last_unstale":"2024-09-11T23:21:54.484862+0000","last_undegraded":"2024-09-11T23:21:54.484862+0000","last_fullsized":"2024-09-11T23:21:54.484862+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:49.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.455319+0000","last_change":"2024-09-11T23:21:53.455319+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.455319+0000","last_undegraded":"2024-09-11T23:21:53.455319+0000","last_fullsized":"2024-09-11T23:21:53.455319+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.487121+0000","last_change":"2024-09-11T23:21:54.485019+0000","last_active":"2024-09-11T23:21:54.487121+0000","last_peered":"2024-09-11T23:21:54.487121+0000","last_clean":"2024-09-11T23:21:54.487121+0000","last_became_active":"2024-09-11T23:21:54.480801+0000","last_became_peered":"2024-09-11T23:21:54.480801+0000","last_unstale":"2024-09-11T23:21:54.487121+0000","last_undegraded":"2024-09-11T23:21:54.487121+0000","last_fullsized":"2024-09-11T23:21:54.487121+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:41.480085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.472797+0000","last_change":"2024-09-11T23:21:54.466747+0000","last_active":"2024-09-11T23:21:54.472797+0000","last_peered":"2024-09-11T23:21:54.472797+0000","last_clean":"2024-09-11T23:21:54.472797+0000","last_became_active":"2024-09-11T23:21:54.465374+0000","last_became_peered":"2024-09-11T23:21:54.465374+0000","last_unstale":"2024-09-11T23:21:54.472797+0000","last_undegraded":"2024-09-11T23:21:54.472797+0000","last_fullsized":"2024-09-11T23:21:54.472797+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:32.677344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484295+0000","last_change":"2024-09-11T23:21:54.476928+0000","last_active":"2024-09-11T23:21:54.484295+0000","last_peered":"2024-09-11T23:21:54.484295+0000","last_clean":"2024-09-11T23:21:54.484295+0000","last_became_active":"2024-09-11T23:21:54.476618+0000","last_became_peered":"2024-09-11T23:21:54.476618+0000","last_unstale":"2024-09-11T23:21:54.484295+0000","last_undegraded":"2024-09-11T23:21:54.484295+0000","last_fullsized":"2024-09-11T23:21:54.484295+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:59.116972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.475017+0000","last_change":"2024-09-11T23:21:54.464693+0000","last_active":"2024-09-11T23:21:54.475017+0000","last_peered":"2024-09-11T23:21:54.475017+0000","last_clean":"2024-09-11T23:21:54.475017+0000","last_became_active":"2024-09-11T23:21:54.462500+0000","last_became_peered":"2024-09-11T23:21:54.462500+0000","last_unstale":"2024-09-11T23:21:54.475017+0000","last_undegraded":"2024-09-11T23:21:54.475017+0000","last_fullsized":"2024-09-11T23:21:54.475017+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:36.931095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.472510+0000","last_change":"2024-09-11T23:21:54.466244+0000","last_active":"2024-09-11T23:21:54.472510+0000","last_peered":"2024-09-11T23:21:54.472510+0000","last_clean":"2024-09-11T23:21:54.472510+0000","last_became_active":"2024-09-11T23:21:54.465979+0000","last_became_peered":"2024-09-11T23:21:54.465979+0000","last_unstale":"2024-09-11T23:21:54.472510+0000","last_undegraded":"2024-09-11T23:21:54.472510+0000","last_fullsized":"2024-09-11T23:21:54.472510+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:35.745599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.454934+0000","last_change":"2024-09-11T23:21:53.454934+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.454934+0000","last_undegraded":"2024-09-11T23:21:53.454934+0000","last_fullsized":"2024-09-11T23:21:53.454934+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.452424+0000","last_change":"2024-09-11T23:21:53.452424+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.452424+0000","last_undegraded":"2024-09-11T23:21:53.452424+0000","last_fullsized":"2024-09-11T23:21:53.452424+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.451943+0000","last_change":"2024-09-11T23:21:53.451943+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.451943+0000","last_undegraded":"2024-09-11T23:21:53.451943+0000","last_fullsized":"2024-09-11T23:21:53.451943+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.477344+0000","last_change":"2024-09-11T23:21:54.470918+0000","last_active":"2024-09-11T23:21:54.477344+0000","last_peered":"2024-09-11T23:21:54.477344+0000","last_clean":"2024-09-11T23:21:54.477344+0000","last_became_active":"2024-09-11T23:21:54.470555+0000","last_became_peered":"2024-09-11T23:21:54.470555+0000","last_unstale":"2024-09-11T23:21:54.477344+0000","last_undegraded":"2024-09-11T23:21:54.477344+0000","last_fullsized":"2024-09-11T23:21:54.477344+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:41.480085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.453256+0000","last_change":"2024-09-11T23:21:53.453256+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.453256+0000","last_undegraded":"2024-09-11T23:21:53.453256+0000","last_fullsized":"2024-09-11T23:21:53.453256+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484540+0000","last_change":"2024-09-11T23:21:54.476872+0000","last_active":"2024-09-11T23:21:54.484540+0000","last_peered":"2024-09-11T23:21:54.484540+0000","last_clean":"2024-09-11T23:21:54.484540+0000","last_became_active":"2024-09-11T23:21:54.476582+0000","last_became_peered":"2024-09-11T23:21:54.476582+0000","last_unstale":"2024-09-11T23:21:54.484540+0000","last_undegraded":"2024-09-11T23:21:54.484540+0000","last_fullsized":"2024-09-11T23:21:54.484540+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:30.000391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.452708+0000","last_change":"2024-09-11T23:21:53.452708+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.452708+0000","last_undegraded":"2024-09-11T23:21:53.452708+0000","last_fullsized":"2024-09-11T23:21:53.452708+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.475117+0000","last_change":"2024-09-11T23:21:54.463114+0000","last_active":"2024-09-11T23:21:54.475117+0000","last_peered":"2024-09-11T23:21:54.475117+0000","last_clean":"2024-09-11T23:21:54.475117+0000","last_became_active":"2024-09-11T23:21:54.462251+0000","last_became_peered":"2024-09-11T23:21:54.462251+0000","last_unstale":"2024-09-11T23:21:54.475117+0000","last_undegraded":"2024-09-11T23:21:54.475117+0000","last_fullsized":"2024-09-11T23:21:54.475117+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:30.000391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.474984+0000","last_change":"2024-09-11T23:21:54.464400+0000","last_active":"2024-09-11T23:21:54.474984+0000","last_peered":"2024-09-11T23:21:54.474984+0000","last_clean":"2024-09-11T23:21:54.474984+0000","last_became_active":"2024-09-11T23:21:54.464075+0000","last_became_peered":"2024-09-11T23:21:54.464075+0000","last_unstale":"2024-09-11T23:21:54.474984+0000","last_undegraded":"2024-09-11T23:21:54.474984+0000","last_fullsized":"2024-09-11T23:21:54.474984+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:23.665399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.469554+0000","last_change":"2024-09-11T23:21:54.462809+0000","last_active":"2024-09-11T23:21:54.469554+0000","last_peered":"2024-09-11T23:21:54.469554+0000","last_clean":"2024-09-11T23:21:54.469554+0000","last_became_active":"2024-09-11T23:21:54.462548+0000","last_became_peered":"2024-09-11T23:21:54.462548+0000","last_unstale":"2024-09-11T23:21:54.469554+0000","last_undegraded":"2024-09-11T23:21:54.469554+0000","last_fullsized":"2024-09-11T23:21:54.469554+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:25.175924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.483329+0000","last_change":"2024-09-11T23:21:54.482141+0000","last_active":"2024-09-11T23:21:54.483329+0000","last_peered":"2024-09-11T23:21:54.483329+0000","last_clean":"2024-09-11T23:21:54.483329+0000","last_became_active":"2024-09-11T23:21:54.481848+0000","last_became_peered":"2024-09-11T23:21:54.481848+0000","last_unstale":"2024-09-11T23:21:54.483329+0000","last_undegraded":"2024-09-11T23:21:54.483329+0000","last_fullsized":"2024-09-11T23:21:54.483329+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:13.798720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.477131+0000","last_change":"2024-09-11T23:21:54.467818+0000","last_active":"2024-09-11T23:21:54.477131+0000","last_peered":"2024-09-11T23:21:54.477131+0000","last_clean":"2024-09-11T23:21:54.477131+0000","last_became_active":"2024-09-11T23:21:54.467486+0000","last_became_peered":"2024-09-11T23:21:54.467486+0000","last_unstale":"2024-09-11T23:21:54.477131+0000","last_undegraded":"2024-09-11T23:21:54.477131+0000","last_fullsized":"2024-09-11T23:21:54.477131+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:49.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.480935+0000","last_change":"2024-09-11T23:21:54.479693+0000","last_active":"2024-09-11T23:21:54.480935+0000","last_peered":"2024-09-11T23:21:54.480935+0000","last_clean":"2024-09-11T23:21:54.480935+0000","last_became_active":"2024-09-11T23:21:54.479390+0000","last_became_peered":"2024-09-11T23:21:54.479390+0000","last_unstale":"2024-09-11T23:21:54.480935+0000","last_undegraded":"2024-09-11T23:21:54.480935+0000","last_fullsized":"2024-09-11T23:21:54.480935+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:43.399494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.475047+0000","last_change":"2024-09-11T23:21:54.462458+0000","last_active":"2024-09-11T23:21:54.475047+0000","last_peered":"2024-09-11T23:21:54.475047+0000","last_clean":"2024-09-11T23:21:54.475047+0000","last_became_active":"2024-09-11T23:21:54.462063+0000","last_became_peered":"2024-09-11T23:21:54.462063+0000","last_unstale":"2024-09-11T23:21:54.475047+0000","last_undegraded":"2024-09-11T23:21:54.475047+0000","last_fullsized":"2024-09-11T23:21:54.475047+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:14.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.483602+0000","last_change":"2024-09-11T23:21:54.482128+0000","last_active":"2024-09-11T23:21:54.483602+0000","last_peered":"2024-09-11T23:21:54.483602+0000","last_clean":"2024-09-11T23:21:54.483602+0000","last_became_active":"2024-09-11T23:21:54.481785+0000","last_became_peered":"2024-09-11T23:21:54.481785+0000","last_unstale":"2024-09-11T23:21:54.483602+0000","last_undegraded":"2024-09-11T23:21:54.483602+0000","last_fullsized":"2024-09-11T23:21:54.483602+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:25.175924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.468892+0000","last_change":"2024-09-11T23:21:54.460206+0000","last_active":"2024-09-11T23:21:54.468892+0000","last_peered":"2024-09-11T23:21:54.468892+0000","last_clean":"2024-09-11T23:21:54.468892+0000","last_became_active":"2024-09-11T23:21:54.459460+0000","last_became_peered":"2024-09-11T23:21:54.459460+0000","last_unstale":"2024-09-11T23:21:54.468892+0000","last_undegraded":"2024-09-11T23:21:54.468892+0000","last_fullsized":"2024-09-11T23:21:54.468892+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:23.935572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484821+0000","last_change":"2024-09-11T23:21:54.480061+0000","last_active":"2024-09-11T23:21:54.484821+0000","last_peered":"2024-09-11T23:21:54.484821+0000","last_clean":"2024-09-11T23:21:54.484821+0000","last_became_active":"2024-09-11T23:21:54.478494+0000","last_became_peered":"2024-09-11T23:21:54.478494+0000","last_unstale":"2024-09-11T23:21:54.484821+0000","last_undegraded":"2024-09-11T23:21:54.484821+0000","last_fullsized":"2024-09-11T23:21:54.484821+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:36.931095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484750+0000","last_change":"2024-09-11T23:21:54.483670+0000","last_active":"2024-09-11T23:21:54.484750+0000","last_peered":"2024-09-11T23:21:54.484750+0000","last_clean":"2024-09-11T23:21:54.484750+0000","last_became_active":"2024-09-11T23:21:54.483430+0000","last_became_peered":"2024-09-11T23:21:54.483430+0000","last_unstale":"2024-09-11T23:21:54.484750+0000","last_undegraded":"2024-09-11T23:21:54.484750+0000","last_fullsized":"2024-09-11T23:21:54.484750+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:41.754162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"70'4","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.485136+0000","last_change":"2024-09-11T23:21:53.470991+0000","last_active":"2024-09-11T23:21:54.485136+0000","last_peered":"2024-09-11T23:21:54.485136+0000","last_clean":"2024-09-11T23:21:54.485136+0000","last_became_active":"2024-09-11T23:21:53.470699+0000","last_became_peered":"2024-09-11T23:21:53.470699+0000","last_unstale":"2024-09-11T23:21:54.485136+0000","last_undegraded":"2024-09-11T23:21:54.485136+0000","last_fullsized":"2024-09-11T23:21:54.485136+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:31.669192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T23:21:53.464929+0000","last_change":"2024-09-11T23:21:53.463711+0000","last_active":"2024-09-11T23:21:53.464929+0000","last_peered":"2024-09-11T23:21:53.464929+0000","last_clean":"2024-09-11T23:21:53.464929+0000","last_became_active":"2024-09-11T23:21:53.462741+0000","last_became_peered":"2024-09-11T23:21:53.462741+0000","last_unstale":"2024-09-11T23:21:53.464929+0000","last_undegraded":"2024-09-11T23:21:53.464929+0000","last_fullsized":"2024-09-11T23:21:53.464929+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:03.790130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.485009+0000","last_change":"2024-09-11T23:21:54.479264+0000","last_active":"2024-09-11T23:21:54.485009+0000","last_peered":"2024-09-11T23:21:54.485009+0000","last_clean":"2024-09-11T23:21:54.485009+0000","last_became_active":"2024-09-11T23:21:54.478939+0000","last_became_peered":"2024-09-11T23:21:54.478939+0000","last_unstale":"2024-09-11T23:21:54.485009+0000","last_undegraded":"2024-09-11T23:21:54.485009+0000","last_fullsized":"2024-09-11T23:21:54.485009+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:23.665399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.483010+0000","last_change":"2024-09-11T23:21:53.467522+0000","last_active":"2024-09-11T23:21:54.483010+0000","last_peered":"2024-09-11T23:21:54.483010+0000","last_clean":"2024-09-11T23:21:54.483010+0000","last_became_active":"2024-09-11T23:21:53.467218+0000","last_became_peered":"2024-09-11T23:21:53.467218+0000","last_unstale":"2024-09-11T23:21:54.483010+0000","last_undegraded":"2024-09-11T23:21:54.483010+0000","last_fullsized":"2024-09-11T23:21:54.483010+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:35.293491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.476547+0000","last_change":"2024-09-11T23:21:54.469492+0000","last_active":"2024-09-11T23:21:54.476547+0000","last_peered":"2024-09-11T23:21:54.476547+0000","last_clean":"2024-09-11T23:21:54.476547+0000","last_became_active":"2024-09-11T23:21:54.469040+0000","last_became_peered":"2024-09-11T23:21:54.469040+0000","last_unstale":"2024-09-11T23:21:54.476547+0000","last_undegraded":"2024-09-11T23:21:54.476547+0000","last_fullsized":"2024-09-11T23:21:54.476547+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:43.570690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.482717+0000","last_change":"2024-09-11T23:21:53.469697+0000","last_active":"2024-09-11T23:21:54.482717+0000","last_peered":"2024-09-11T23:21:54.482717+0000","last_clean":"2024-09-11T23:21:54.482717+0000","last_became_active":"2024-09-11T23:21:53.469365+0000","last_became_peered":"2024-09-11T23:21:53.469365+0000","last_unstale":"2024-09-11T23:21:54.482717+0000","last_undegraded":"2024-09-11T23:21:54.482717+0000","last_fullsized":"2024-09-11T23:21:54.482717+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:09.148570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.472886+0000","last_change":"2024-09-11T23:21:54.466699+0000","last_active":"2024-09-11T23:21:54.472886+0000","last_peered":"2024-09-11T23:21:54.472886+0000","last_clean":"2024-09-11T23:21:54.472886+0000","last_became_active":"2024-09-11T23:21:54.466400+0000","last_became_peered":"2024-09-11T23:21:54.466400+0000","last_unstale":"2024-09-11T23:21:54.472886+0000","last_undegraded":"2024-09-11T23:21:54.472886+0000","last_fullsized":"2024-09-11T23:21:54.472886+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:15.297748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-11T23:21:52.447974+0000","last_change":"2024-09-11T23:21:52.447974+0000","last_active":"2024-09-11T23:21:52.429217+0000","last_peered":"2024-09-11T23:21:52.429217+0000","last_clean":"2024-09-11T23:21:52.429217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:52.447974+0000","last_undegraded":"2024-09-11T23:21:52.447974+0000","last_fullsized":"2024-09-11T23:21:52.447974+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.475091+0000","last_change":"2024-09-11T23:21:54.462869+0000","last_active":"2024-09-11T23:21:54.475091+0000","last_peered":"2024-09-11T23:21:54.475091+0000","last_clean":"2024-09-11T23:21:54.475091+0000","last_became_active":"2024-09-11T23:21:54.461814+0000","last_became_peered":"2024-09-11T23:21:54.461814+0000","last_unstale":"2024-09-11T23:21:54.475091+0000","last_undegraded":"2024-09-11T23:21:54.475091+0000","last_fullsized":"2024-09-11T23:21:54.475091+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:15.952204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"70'1","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484899+0000","last_change":"2024-09-11T23:21:53.470378+0000","last_active":"2024-09-11T23:21:54.484899+0000","last_peered":"2024-09-11T23:21:54.484899+0000","last_clean":"2024-09-11T23:21:54.484899+0000","last_became_active":"2024-09-11T23:21:53.470047+0000","last_became_peered":"2024-09-11T23:21:53.470047+0000","last_unstale":"2024-09-11T23:21:54.484899+0000","last_undegraded":"2024-09-11T23:21:54.484899+0000","last_fullsized":"2024-09-11T23:21:54.484899+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:23.781101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T23:21:53.475259+0000","last_change":"2024-09-11T23:21:53.470324+0000","last_active":"2024-09-11T23:21:53.475259+0000","last_peered":"2024-09-11T23:21:53.475259+0000","last_clean":"2024-09-11T23:21:53.475259+0000","last_became_active":"2024-09-11T23:21:53.470034+0000","last_became_peered":"2024-09-11T23:21:53.470034+0000","last_unstale":"2024-09-11T23:21:53.475259+0000","last_undegraded":"2024-09-11T23:21:53.475259+0000","last_fullsized":"2024-09-11T23:21:53.475259+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:11.566507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.451371+0000","last_change":"2024-09-11T23:21:53.451371+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.451371+0000","last_undegraded":"2024-09-11T23:21:53.451371+0000","last_fullsized":"2024-09-11T23:21:53.451371+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-11T23:21:52.442793+0000","last_change":"2024-09-11T23:21:52.442793+0000","last_active":"2024-09-11T23:21:52.429217+0000","last_peered":"2024-09-11T23:21:52.429217+0000","last_clean":"2024-09-11T23:21:52.429217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:52.442793+0000","last_undegraded":"2024-09-11T23:21:52.442793+0000","last_fullsized":"2024-09-11T23:21:52.442793+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.471131+0000","last_change":"2024-09-11T23:21:54.461750+0000","last_active":"2024-09-11T23:21:54.471131+0000","last_peered":"2024-09-11T23:21:54.471131+0000","last_clean":"2024-09-11T23:21:54.471131+0000","last_became_active":"2024-09-11T23:21:54.461419+0000","last_became_peered":"2024-09-11T23:21:54.461419+0000","last_unstale":"2024-09-11T23:21:54.471131+0000","last_undegraded":"2024-09-11T23:21:54.471131+0000","last_fullsized":"2024-09-11T23:21:54.471131+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:15.958011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.453347+0000","last_change":"2024-09-11T23:21:53.470446+0000","last_active":"2024-09-11T23:21:54.453347+0000","last_peered":"2024-09-11T23:21:54.453347+0000","last_clean":"2024-09-11T23:21:54.453347+0000","last_became_active":"2024-09-11T23:21:53.470036+0000","last_became_peered":"2024-09-11T23:21:53.470036+0000","last_unstale":"2024-09-11T23:21:54.453347+0000","last_undegraded":"2024-09-11T23:21:54.453347+0000","last_fullsized":"2024-09-11T23:21:54.453347+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:58.108821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.487552+0000","last_change":"2024-09-11T23:21:54.486905+0000","last_active":"2024-09-11T23:21:54.487552+0000","last_peered":"2024-09-11T23:21:54.487552+0000","last_clean":"2024-09-11T23:21:54.487552+0000","last_became_active":"2024-09-11T23:21:54.486173+0000","last_became_peered":"2024-09-11T23:21:54.486173+0000","last_unstale":"2024-09-11T23:21:54.487552+0000","last_undegraded":"2024-09-11T23:21:54.487552+0000","last_fullsized":"2024-09-11T23:21:54.487552+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:01.841438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.464940+0000","last_change":"2024-09-11T23:21:53.471148+0000","last_active":"2024-09-11T23:21:54.464940+0000","last_peered":"2024-09-11T23:21:54.464940+0000","last_clean":"2024-09-11T23:21:54.464940+0000","last_became_active":"2024-09-11T23:21:53.470383+0000","last_became_peered":"2024-09-11T23:21:53.470383+0000","last_unstale":"2024-09-11T23:21:54.464940+0000","last_undegraded":"2024-09-11T23:21:54.464940+0000","last_fullsized":"2024-09-11T23:21:54.464940+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:43.791393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484467+0000","last_change":"2024-09-11T23:21:54.478635+0000","last_active":"2024-09-11T23:21:54.484467+0000","last_peered":"2024-09-11T23:21:54.484467+0000","last_clean":"2024-09-11T23:21:54.484467+0000","last_became_active":"2024-09-11T23:21:54.476093+0000","last_became_peered":"2024-09-11T23:21:54.476093+0000","last_unstale":"2024-09-11T23:21:54.484467+0000","last_undegraded":"2024-09-11T23:21:54.484467+0000","last_fullsized":"2024-09-11T23:21:54.484467+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:15.952204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-11T23:21:52.448002+0000","last_change":"2024-09-11T23:21:52.448002+0000","last_active":"2024-09-11T23:21:52.429217+0000","last_peered":"2024-09-11T23:21:52.429217+0000","last_clean":"2024-09-11T23:21:52.429217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:52.448002+0000","last_undegraded":"2024-09-11T23:21:52.448002+0000","last_fullsized":"2024-09-11T23:21:52.448002+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T23:21:53.469108+0000","last_change":"2024-09-11T23:21:53.465308+0000","last_active":"2024-09-11T23:21:53.469108+0000","last_peered":"2024-09-11T23:21:53.469108+0000","last_clean":"2024-09-11T23:21:53.469108+0000","last_became_active":"2024-09-11T23:21:53.464677+0000","last_became_peered":"2024-09-11T23:21:53.464677+0000","last_unstale":"2024-09-11T23:21:53.469108+0000","last_undegraded":"2024-09-11T23:21:53.469108+0000","last_fullsized":"2024-09-11T23:21:53.469108+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:44.307898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.472595+0000","last_change":"2024-09-11T23:21:54.466748+0000","last_active":"2024-09-11T23:21:54.472595+0000","last_peered":"2024-09-11T23:21:54.472595+0000","last_clean":"2024-09-11T23:21:54.472595+0000","last_became_active":"2024-09-11T23:21:54.466494+0000","last_became_peered":"2024-09-11T23:21:54.466494+0000","last_unstale":"2024-09-11T23:21:54.472595+0000","last_undegraded":"2024-09-11T23:21:54.472595+0000","last_fullsized":"2024-09-11T23:21:54.472595+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:30.855528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T23:21:53.470307+0000","last_change":"2024-09-11T23:21:53.467755+0000","last_active":"2024-09-11T23:21:53.470307+0000","last_peered":"2024-09-11T23:21:53.470307+0000","last_clean":"2024-09-11T23:21:53.470307+0000","last_became_active":"2024-09-11T23:21:53.467498+0000","last_became_peered":"2024-09-11T23:21:53.467498+0000","last_unstale":"2024-09-11T23:21:53.470307+0000","last_undegraded":"2024-09-11T23:21:53.470307+0000","last_fullsized":"2024-09-11T23:21:53.470307+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:06.639484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.467764+0000","last_change":"2024-09-11T23:21:54.460315+0000","last_active":"2024-09-11T23:21:54.467764+0000","last_peered":"2024-09-11T23:21:54.467764+0000","last_clean":"2024-09-11T23:21:54.467764+0000","last_became_active":"2024-09-11T23:21:54.459316+0000","last_became_peered":"2024-09-11T23:21:54.459316+0000","last_unstale":"2024-09-11T23:21:54.467764+0000","last_undegraded":"2024-09-11T23:21:54.467764+0000","last_fullsized":"2024-09-11T23:21:54.467764+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:40.941889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.465022+0000","last_change":"2024-09-11T23:21:53.470164+0000","last_active":"2024-09-11T23:21:54.465022+0000","last_peered":"2024-09-11T23:21:54.465022+0000","last_clean":"2024-09-11T23:21:54.465022+0000","last_became_active":"2024-09-11T23:21:53.469877+0000","last_became_peered":"2024-09-11T23:21:53.469877+0000","last_unstale":"2024-09-11T23:21:54.465022+0000","last_undegraded":"2024-09-11T23:21:54.465022+0000","last_fullsized":"2024-09-11T23:21:54.465022+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:53.798999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.453003+0000","last_change":"2024-09-11T23:21:53.453003+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.453003+0000","last_undegraded":"2024-09-11T23:21:53.453003+0000","last_fullsized":"2024-09-11T23:21:53.453003+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.452735+0000","last_change":"2024-09-11T23:21:53.462910+0000","last_active":"2024-09-11T23:21:54.452735+0000","last_peered":"2024-09-11T23:21:54.452735+0000","last_clean":"2024-09-11T23:21:54.452735+0000","last_became_active":"2024-09-11T23:21:53.462628+0000","last_became_peered":"2024-09-11T23:21:53.462628+0000","last_unstale":"2024-09-11T23:21:54.452735+0000","last_undegraded":"2024-09-11T23:21:54.452735+0000","last_fullsized":"2024-09-11T23:21:54.452735+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:03.790130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"70'8","reported_seq":20,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.479207+0000","last_change":"2024-09-11T23:21:53.468168+0000","last_active":"2024-09-11T23:21:54.479207+0000","last_peered":"2024-09-11T23:21:54.479207+0000","last_clean":"2024-09-11T23:21:54.479207+0000","last_became_active":"2024-09-11T23:21:53.467519+0000","last_became_peered":"2024-09-11T23:21:53.467519+0000","last_unstale":"2024-09-11T23:21:54.479207+0000","last_undegraded":"2024-09-11T23:21:54.479207+0000","last_fullsized":"2024-09-11T23:21:54.479207+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:44.775322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.477628+0000","last_change":"2024-09-11T23:21:54.472550+0000","last_active":"2024-09-11T23:21:54.477628+0000","last_peered":"2024-09-11T23:21:54.477628+0000","last_clean":"2024-09-11T23:21:54.477628+0000","last_became_active":"2024-09-11T23:21:54.468734+0000","last_became_peered":"2024-09-11T23:21:54.468734+0000","last_unstale":"2024-09-11T23:21:54.477628+0000","last_undegraded":"2024-09-11T23:21:54.477628+0000","last_fullsized":"2024-09-11T23:21:54.477628+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:38.062064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"70'1","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484606+0000","last_change":"2024-09-11T23:21:53.468403+0000","last_active":"2024-09-11T23:21:54.484606+0000","last_peered":"2024-09-11T23:21:54.484606+0000","last_clean":"2024-09-11T23:21:54.484606+0000","last_became_active":"2024-09-11T23:21:53.468047+0000","last_became_peered":"2024-09-11T23:21:53.468047+0000","last_unstale":"2024-09-11T23:21:54.484606+0000","last_undegraded":"2024-09-11T23:21:54.484606+0000","last_fullsized":"2024-09-11T23:21:54.484606+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:20.530963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.477583+0000","last_change":"2024-09-11T23:21:54.475552+0000","last_active":"2024-09-11T23:21:54.477583+0000","last_peered":"2024-09-11T23:21:54.477583+0000","last_clean":"2024-09-11T23:21:54.477583+0000","last_became_active":"2024-09-11T23:21:54.472532+0000","last_became_peered":"2024-09-11T23:21:54.472532+0000","last_unstale":"2024-09-11T23:21:54.477583+0000","last_undegraded":"2024-09-11T23:21:54.477583+0000","last_fullsized":"2024-09-11T23:21:54.477583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:07.418531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.483008+0000","last_change":"2024-09-11T23:21:53.466954+0000","last_active":"2024-09-11T23:21:54.483008+0000","last_peered":"2024-09-11T23:21:54.483008+0000","last_clean":"2024-09-11T23:21:54.483008+0000","last_became_active":"2024-09-11T23:21:53.466633+0000","last_became_peered":"2024-09-11T23:21:53.466633+0000","last_unstale":"2024-09-11T23:21:54.483008+0000","last_undegraded":"2024-09-11T23:21:54.483008+0000","last_fullsized":"2024-09-11T23:21:54.483008+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:41.854885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.453265+0000","last_change":"2024-09-11T23:21:53.453265+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.453265+0000","last_undegraded":"2024-09-11T23:21:53.453265+0000","last_fullsized":"2024-09-11T23:21:53.453265+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"70'1","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.481720+0000","last_change":"2024-09-11T23:21:53.474038+0000","last_active":"2024-09-11T23:21:54.481720+0000","last_peered":"2024-09-11T23:21:54.481720+0000","last_clean":"2024-09-11T23:21:54.481720+0000","last_became_active":"2024-09-11T23:21:53.473332+0000","last_became_peered":"2024-09-11T23:21:53.473332+0000","last_unstale":"2024-09-11T23:21:54.481720+0000","last_undegraded":"2024-09-11T23:21:54.481720+0000","last_fullsized":"2024-09-11T23:21:54.481720+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:41.854885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.458366+0000","last_change":"2024-09-11T23:21:53.473759+0000","last_active":"2024-09-11T23:21:54.458366+0000","last_peered":"2024-09-11T23:21:54.458366+0000","last_clean":"2024-09-11T23:21:54.458366+0000","last_became_active":"2024-09-11T23:21:53.473476+0000","last_became_peered":"2024-09-11T23:21:53.473476+0000","last_unstale":"2024-09-11T23:21:54.458366+0000","last_undegraded":"2024-09-11T23:21:54.458366+0000","last_fullsized":"2024-09-11T23:21:54.458366+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:42.391343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.464840+0000","last_change":"2024-09-11T23:21:53.473082+0000","last_active":"2024-09-11T23:21:54.464840+0000","last_peered":"2024-09-11T23:21:54.464840+0000","last_clean":"2024-09-11T23:21:54.464840+0000","last_became_active":"2024-09-11T23:21:53.472772+0000","last_became_peered":"2024-09-11T23:21:53.472772+0000","last_unstale":"2024-09-11T23:21:54.464840+0000","last_undegraded":"2024-09-11T23:21:54.464840+0000","last_fullsized":"2024-09-11T23:21:54.464840+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:02.766133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.452910+0000","last_change":"2024-09-11T23:21:53.454657+0000","last_active":"2024-09-11T23:21:54.452910+0000","last_peered":"2024-09-11T23:21:54.452910+0000","last_clean":"2024-09-11T23:21:54.452910+0000","last_became_active":"2024-09-11T23:21:53.454348+0000","last_became_peered":"2024-09-11T23:21:53.454348+0000","last_unstale":"2024-09-11T23:21:54.452910+0000","last_undegraded":"2024-09-11T23:21:54.452910+0000","last_fullsized":"2024-09-11T23:21:54.452910+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:08.581853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T23:21:53.464920+0000","last_change":"2024-09-11T23:21:53.463237+0000","last_active":"2024-09-11T23:21:53.464920+0000","last_peered":"2024-09-11T23:21:53.464920+0000","last_clean":"2024-09-11T23:21:53.464920+0000","last_became_active":"2024-09-11T23:21:53.462807+0000","last_became_peered":"2024-09-11T23:21:53.462807+0000","last_unstale":"2024-09-11T23:21:53.464920+0000","last_undegraded":"2024-09-11T23:21:53.464920+0000","last_fullsized":"2024-09-11T23:21:53.464920+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:36.015928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.457164+0000","last_change":"2024-09-11T23:21:53.457164+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.457164+0000","last_undegraded":"2024-09-11T23:21:53.457164+0000","last_fullsized":"2024-09-11T23:21:53.457164+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484646+0000","last_change":"2024-09-11T23:21:53.467675+0000","last_active":"2024-09-11T23:21:54.484646+0000","last_peered":"2024-09-11T23:21:54.484646+0000","last_clean":"2024-09-11T23:21:54.484646+0000","last_became_active":"2024-09-11T23:21:53.467403+0000","last_became_peered":"2024-09-11T23:21:53.467403+0000","last_unstale":"2024-09-11T23:21:54.484646+0000","last_undegraded":"2024-09-11T23:21:54.484646+0000","last_fullsized":"2024-09-11T23:21:54.484646+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:35.293491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.472859+0000","last_change":"2024-09-11T23:21:54.466727+0000","last_active":"2024-09-11T23:21:54.472859+0000","last_peered":"2024-09-11T23:21:54.472859+0000","last_clean":"2024-09-11T23:21:54.472859+0000","last_became_active":"2024-09-11T23:21:54.465666+0000","last_became_peered":"2024-09-11T23:21:54.465666+0000","last_unstale":"2024-09-11T23:21:54.472859+0000","last_undegraded":"2024-09-11T23:21:54.472859+0000","last_fullsized":"2024-09-11T23:21:54.472859+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:42.311671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.453247+0000","last_change":"2024-09-11T23:21:53.461181+0000","last_active":"2024-09-11T23:21:54.453247+0000","last_peered":"2024-09-11T23:21:54.453247+0000","last_clean":"2024-09-11T23:21:54.453247+0000","last_became_active":"2024-09-11T23:21:53.460896+0000","last_became_peered":"2024-09-11T23:21:53.460896+0000","last_unstale":"2024-09-11T23:21:54.453247+0000","last_undegraded":"2024-09-11T23:21:54.453247+0000","last_fullsized":"2024-09-11T23:21:54.453247+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:04.612943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.487237+0000","last_change":"2024-09-11T23:21:54.485658+0000","last_active":"2024-09-11T23:21:54.487237+0000","last_peered":"2024-09-11T23:21:54.487237+0000","last_clean":"2024-09-11T23:21:54.487237+0000","last_became_active":"2024-09-11T23:21:54.485358+0000","last_became_peered":"2024-09-11T23:21:54.485358+0000","last_unstale":"2024-09-11T23:21:54.487237+0000","last_undegraded":"2024-09-11T23:21:54.487237+0000","last_fullsized":"2024-09-11T23:21:54.487237+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:03.450050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-11T23:21:52.442827+0000","last_change":"2024-09-11T23:21:52.442827+0000","last_active":"2024-09-11T23:21:52.429217+0000","last_peered":"2024-09-11T23:21:52.429217+0000","last_clean":"2024-09-11T23:21:52.429217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:52.442827+0000","last_undegraded":"2024-09-11T23:21:52.442827+0000","last_fullsized":"2024-09-11T23:21:52.442827+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.470934+0000","last_change":"2024-09-11T23:21:54.463652+0000","last_active":"2024-09-11T23:21:54.470934+0000","last_peered":"2024-09-11T23:21:54.470934+0000","last_clean":"2024-09-11T23:21:54.470934+0000","last_became_active":"2024-09-11T23:21:54.463110+0000","last_became_peered":"2024-09-11T23:21:54.463110+0000","last_unstale":"2024-09-11T23:21:54.470934+0000","last_undegraded":"2024-09-11T23:21:54.470934+0000","last_fullsized":"2024-09-11T23:21:54.470934+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:22.103012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T23:21:53.468943+0000","last_change":"2024-09-11T23:21:53.466964+0000","last_active":"2024-09-11T23:21:53.468943+0000","last_peered":"2024-09-11T23:21:53.468943+0000","last_clean":"2024-09-11T23:21:53.468943+0000","last_became_active":"2024-09-11T23:21:53.466588+0000","last_became_peered":"2024-09-11T23:21:53.466588+0000","last_unstale":"2024-09-11T23:21:53.468943+0000","last_undegraded":"2024-09-11T23:21:53.468943+0000","last_fullsized":"2024-09-11T23:21:53.468943+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:08.581853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-11T23:21:52.442846+0000","last_change":"2024-09-11T23:21:52.442846+0000","last_active":"2024-09-11T23:21:52.429217+0000","last_peered":"2024-09-11T23:21:52.429217+0000","last_clean":"2024-09-11T23:21:52.429217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:52.442846+0000","last_undegraded":"2024-09-11T23:21:52.442846+0000","last_fullsized":"2024-09-11T23:21:52.442846+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.485775+0000","last_change":"2024-09-11T23:21:54.477778+0000","last_active":"2024-09-11T23:21:54.485775+0000","last_peered":"2024-09-11T23:21:54.485775+0000","last_clean":"2024-09-11T23:21:54.485775+0000","last_became_active":"2024-09-11T23:21:54.475823+0000","last_became_peered":"2024-09-11T23:21:54.475823+0000","last_unstale":"2024-09-11T23:21:54.485775+0000","last_undegraded":"2024-09-11T23:21:54.485775+0000","last_fullsized":"2024-09-11T23:21:54.485775+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:14.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T23:21:53.472471+0000","last_change":"2024-09-11T23:21:53.468442+0000","last_active":"2024-09-11T23:21:53.472471+0000","last_peered":"2024-09-11T23:21:53.472471+0000","last_clean":"2024-09-11T23:21:53.472471+0000","last_became_active":"2024-09-11T23:21:53.468181+0000","last_became_peered":"2024-09-11T23:21:53.468181+0000","last_unstale":"2024-09-11T23:21:53.472471+0000","last_undegraded":"2024-09-11T23:21:53.472471+0000","last_fullsized":"2024-09-11T23:21:53.472471+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:21.026252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.453941+0000","last_change":"2024-09-11T23:21:53.453941+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.453941+0000","last_undegraded":"2024-09-11T23:21:53.453941+0000","last_fullsized":"2024-09-11T23:21:53.453941+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.452322+0000","last_change":"2024-09-11T23:21:53.470911+0000","last_active":"2024-09-11T23:21:54.452322+0000","last_peered":"2024-09-11T23:21:54.452322+0000","last_clean":"2024-09-11T23:21:54.452322+0000","last_became_active":"2024-09-11T23:21:53.469831+0000","last_became_peered":"2024-09-11T23:21:53.469831+0000","last_unstale":"2024-09-11T23:21:54.452322+0000","last_undegraded":"2024-09-11T23:21:54.452322+0000","last_fullsized":"2024-09-11T23:21:54.452322+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:20.530963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.481482+0000","last_change":"2024-09-11T23:21:54.470830+0000","last_active":"2024-09-11T23:21:54.481482+0000","last_peered":"2024-09-11T23:21:54.481482+0000","last_clean":"2024-09-11T23:21:54.481482+0000","last_became_active":"2024-09-11T23:21:54.470522+0000","last_became_peered":"2024-09-11T23:21:54.470522+0000","last_unstale":"2024-09-11T23:21:54.481482+0000","last_undegraded":"2024-09-11T23:21:54.481482+0000","last_fullsized":"2024-09-11T23:21:54.481482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:45.783474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.456914+0000","last_change":"2024-09-11T23:21:53.472150+0000","last_active":"2024-09-11T23:21:54.456914+0000","last_peered":"2024-09-11T23:21:54.456914+0000","last_clean":"2024-09-11T23:21:54.456914+0000","last_became_active":"2024-09-11T23:21:53.471468+0000","last_became_peered":"2024-09-11T23:21:53.471468+0000","last_unstale":"2024-09-11T23:21:54.456914+0000","last_undegraded":"2024-09-11T23:21:54.456914+0000","last_fullsized":"2024-09-11T23:21:54.456914+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:21.026252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.482255+0000","last_change":"2024-09-11T23:21:53.470567+0000","last_active":"2024-09-11T23:21:54.482255+0000","last_peered":"2024-09-11T23:21:54.482255+0000","last_clean":"2024-09-11T23:21:54.482255+0000","last_became_active":"2024-09-11T23:21:53.470275+0000","last_became_peered":"2024-09-11T23:21:53.470275+0000","last_unstale":"2024-09-11T23:21:54.482255+0000","last_undegraded":"2024-09-11T23:21:54.482255+0000","last_fullsized":"2024-09-11T23:21:54.482255+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:11.566507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":261,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.460043+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:21:54.460043+0000","last_peered":"2024-09-11T23:21:54.460043+0000","last_clean":"2024-09-11T23:21:54.460043+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:21:54.460043+0000","last_undegraded":"2024-09-11T23:21:54.460043+0000","last_fullsized":"2024-09-11T23:21:54.460043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":94,"acting":94,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":674,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476790,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1441792,"data_stored":942587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476789,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":847872,"data_stored":351695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476788,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":843776,"data_stored":351693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476788,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":827392,"data_stored":344828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509492,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":827392,"data_stored":344828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1421312,"data_stored":935196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":338553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542196,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":338553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:21:58.639 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:21:58.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.827+0000 7fb824800640 1 Processor -- start 2024-09-11T23:21:58.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.827+0000 7fb824800640 1 -- start start 2024-09-11T23:21:58.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.828+0000 7fb824800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb81c0d02a0 0x7fb81c0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:58.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.828+0000 7fb824800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb81c15ca40 0x7fb81c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:58.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.828+0000 7fb824800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb81c0d0bc0 con 0x7fb81c15ceb0 2024-09-11T23:21:58.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.828+0000 7fb824800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb81c15d390 con 0x7fb81c0d02a0 2024-09-11T23:21:58.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.828+0000 7fb824800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb81c15d670 con 0x7fb81c15ca40 2024-09-11T23:21:58.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.828+0000 7fb821e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb81c0d02a0 0x7fb81c0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:58.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.828+0000 7fb822800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb81c15ceb0 0x7fb81c1594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53356/0 (socket says 172.21.15.144:53356) 2024-09-11T23:21:58.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.828+0000 7fb821e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb81c0d02a0 0x7fb81c0d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33770/0 (socket says 172.21.15.144:33770) 2024-09-11T23:21:58.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.828+0000 7fb822800640 1 -- 172.21.15.144:0/2618276144 learned_addr learned my addr 172.21.15.144:0/2618276144 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:58.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.828+0000 7fb821400640 1 --2- 172.21.15.144:0/2618276144 >> v2:172.21.15.165:3300/0 conn(0x7fb81c15ca40 0x7fb81c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:58.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.829+0000 7fb821e00640 1 -- 172.21.15.144:0/2618276144 >> v2:172.21.15.165:3300/0 conn(0x7fb81c15ca40 msgr2=0x7fb81c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:58.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.829+0000 7fb821e00640 1 --2- 172.21.15.144:0/2618276144 >> v2:172.21.15.165:3300/0 conn(0x7fb81c15ca40 0x7fb81c15e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.829+0000 7fb821e00640 1 -- 172.21.15.144:0/2618276144 >> v1:172.21.15.144:6789/0 conn(0x7fb81c15ceb0 legacy=0x7fb81c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:58.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.829+0000 7fb821e00640 1 -- 172.21.15.144:0/2618276144 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81c15d950 con 0x7fb81c0d02a0 2024-09-11T23:21:58.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.829+0000 7fb820a00640 1 -- 172.21.15.144:0/2618276144 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 777677755 0 0) 0x7fb81c0d0bc0 con 0x7fb81c15ceb0 2024-09-11T23:21:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.830+0000 7fb821e00640 1 --2- 172.21.15.144:0/2618276144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81c0d02a0 0x7fb81c0d0680 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb81c0cf320 tx=0x7fb81002c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31314d2f72c053fd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.830+0000 7fb820a00640 1 -- 172.21.15.144:0/2618276144 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb810031710 con 0x7fb81c0d02a0 2024-09-11T23:21:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.830+0000 7fb820a00640 1 -- 172.21.15.144:0/2618276144 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8100318b0 con 0x7fb81c0d02a0 2024-09-11T23:21:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.830+0000 7fb820a00640 1 -- 172.21.15.144:0/2618276144 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb810031c80 con 0x7fb81c0d02a0 2024-09-11T23:21:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.830+0000 7fb824800640 1 -- 172.21.15.144:0/2618276144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81c0d02a0 msgr2=0x7fb81c0d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.830+0000 7fb824800640 1 --2- 172.21.15.144:0/2618276144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81c0d02a0 0x7fb81c0d0680 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb81c0cf320 tx=0x7fb81002c7e0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.831+0000 7fb824800640 1 -- 172.21.15.144:0/2618276144 shutdown_connections 2024-09-11T23:21:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.831+0000 7fb824800640 1 --2- 172.21.15.144:0/2618276144 >> v2:172.21.15.165:3300/0 conn(0x7fb81c15ca40 0x7fb81c15e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.831+0000 7fb824800640 1 --2- 172.21.15.144:0/2618276144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81c0d02a0 0x7fb81c0d0680 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.831+0000 7fb824800640 1 -- 172.21.15.144:0/2618276144 >> 172.21.15.144:0/2618276144 conn(0x7fb81c062cc0 msgr2=0x7fb81c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.831+0000 7fb824800640 1 -- 172.21.15.144:0/2618276144 shutdown_connections 2024-09-11T23:21:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.831+0000 7fb824800640 1 -- 172.21.15.144:0/2618276144 wait complete. 2024-09-11T23:21:58.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.832+0000 7fb824800640 1 Processor -- start 2024-09-11T23:21:58.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.832+0000 7fb824800640 1 -- start start 2024-09-11T23:21:58.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.833+0000 7fb824800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb81c0d02a0 0x7fb81c1408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:58.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.833+0000 7fb824800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb81c15ca40 0x7fb81c155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:58.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.833+0000 7fb824800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81c15ceb0 0x7fb81c156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:58.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.833+0000 7fb824800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c155b90 con 0x7fb81c15ceb0 2024-09-11T23:21:58.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.833+0000 7fb824800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c15df10 con 0x7fb81c15ca40 2024-09-11T23:21:58.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.833+0000 7fb824800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb81c155d10 con 0x7fb81c0d02a0 2024-09-11T23:21:58.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.834+0000 7fb822800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81c15ceb0 0x7fb81c156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:58.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.834+0000 7fb822800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81c15ceb0 0x7fb81c156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33774/0 (socket says 172.21.15.144:33774) 2024-09-11T23:21:58.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.834+0000 7fb822800640 1 -- 172.21.15.144:0/677370777 learned_addr learned my addr 172.21.15.144:0/677370777 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:58.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.834+0000 7fb821e00640 1 --2- 172.21.15.144:0/677370777 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb81c0d02a0 0x7fb81c1408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:58.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.834+0000 7fb821400640 1 --2- 172.21.15.144:0/677370777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb81c15ca40 0x7fb81c155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:58.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.834+0000 7fb822800640 1 -- 172.21.15.144:0/677370777 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb81c0d02a0 msgr2=0x7fb81c1408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:58.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.834+0000 7fb822800640 1 --2- 172.21.15.144:0/677370777 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb81c0d02a0 0x7fb81c1408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.834+0000 7fb822800640 1 -- 172.21.15.144:0/677370777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb81c15ca40 msgr2=0x7fb81c155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:58.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.834+0000 7fb822800640 1 --2- 172.21.15.144:0/677370777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb81c15ca40 0x7fb81c155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:58.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.834+0000 7fb822800640 1 -- 172.21.15.144:0/677370777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81c158b80 con 0x7fb81c15ceb0 2024-09-11T23:21:58.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.834+0000 7fb821e00640 1 --2- 172.21.15.144:0/677370777 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb81c0d02a0 0x7fb81c1408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:58.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.834+0000 7fb821400640 1 --2- 172.21.15.144:0/677370777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb81c15ca40 0x7fb81c155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:21:58.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.834+0000 7fb822800640 1 --2- 172.21.15.144:0/677370777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81c15ceb0 0x7fb81c156460 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb81800c6d0 tx=0x7fb81800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:58.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.834+0000 7fb816000640 1 -- 172.21.15.144:0/677370777 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb818018070 con 0x7fb81c15ceb0 2024-09-11T23:21:58.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.834+0000 7fb816000640 1 -- 172.21.15.144:0/677370777 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb818004d60 con 0x7fb81c15ceb0 2024-09-11T23:21:58.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.834+0000 7fb816000640 1 -- 172.21.15.144:0/677370777 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81800a880 con 0x7fb81c15ceb0 2024-09-11T23:21:58.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.835+0000 7fb824800640 1 -- 172.21.15.144:0/677370777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb81c158e60 con 0x7fb81c15ceb0 2024-09-11T23:21:58.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.835+0000 7fb824800640 1 -- 172.21.15.144:0/677370777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb81c1537c0 con 0x7fb81c15ceb0 2024-09-11T23:21:58.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.836+0000 7fb824800640 1 -- 172.21.15.144:0/677370777 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb81c1532d0 con 0x7fb81c15ceb0 2024-09-11T23:21:58.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.837+0000 7fb816000640 1 -- 172.21.15.144:0/677370777 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7fb81800ac30 con 0x7fb81c15ceb0 2024-09-11T23:21:58.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.837+0000 7fb816000640 1 --2- 172.21.15.144:0/677370777 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb80006c190 0x7fb80006e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:58.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.838+0000 7fb816000640 1 -- 172.21.15.144:0/677370777 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7fb81808abe0 con 0x7fb81c15ceb0 2024-09-11T23:21:58.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.838+0000 7fb821e00640 1 --2- 172.21.15.144:0/677370777 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb80006c190 0x7fb80006e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:58.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.838+0000 7fb821e00640 1 --2- 172.21.15.144:0/677370777 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb80006c190 0x7fb80006e650 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb810036000 tx=0x7fb810031000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:58.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:58.842+0000 7fb816000640 1 -- 172.21.15.144:0/677370777 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb818059180 con 0x7fb81c15ceb0 2024-09-11T23:21:59.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.013+0000 7fb824800640 1 -- 172.21.15.144:0/677370777 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb81c0b4790 con 0x7fb80006c190 2024-09-11T23:21:59.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.019+0000 7fb816000640 1 -- 172.21.15.144:0/677370777 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248276 (secure 0 0 0) 0x7fb81c0b4790 con 0x7fb80006c190 2024-09-11T23:21:59.023 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:59.024 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:21:59.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.023+0000 7fb824800640 1 -- 172.21.15.144:0/677370777 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb80006c190 msgr2=0x7fb80006e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:59.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.023+0000 7fb824800640 1 --2- 172.21.15.144:0/677370777 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb80006c190 0x7fb80006e650 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb810036000 tx=0x7fb810031000 comp rx=0 tx=0).stop 2024-09-11T23:21:59.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.023+0000 7fb824800640 1 -- 172.21.15.144:0/677370777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81c15ceb0 msgr2=0x7fb81c156460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:59.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.023+0000 7fb824800640 1 --2- 172.21.15.144:0/677370777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81c15ceb0 0x7fb81c156460 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb81800c6d0 tx=0x7fb81800cb90 comp rx=0 tx=0).stop 2024-09-11T23:21:59.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.023+0000 7fb824800640 1 -- 172.21.15.144:0/677370777 shutdown_connections 2024-09-11T23:21:59.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.023+0000 7fb824800640 1 --2- 172.21.15.144:0/677370777 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb80006c190 0x7fb80006e650 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.023+0000 7fb824800640 1 --2- 172.21.15.144:0/677370777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb81c15ceb0 0x7fb81c156460 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.023+0000 7fb824800640 1 --2- 172.21.15.144:0/677370777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb81c15ca40 0x7fb81c155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.023+0000 7fb824800640 1 --2- 172.21.15.144:0/677370777 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb81c0d02a0 0x7fb81c1408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.023+0000 7fb824800640 1 -- 172.21.15.144:0/677370777 >> 172.21.15.144:0/677370777 conn(0x7fb81c062cc0 msgr2=0x7fb81c0b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:59.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.023+0000 7fb824800640 1 -- 172.21.15.144:0/677370777 shutdown_connections 2024-09-11T23:21:59.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.023+0000 7fb824800640 1 -- 172.21.15.144:0/677370777 wait complete. 2024-09-11T23:21:59.040 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-09-11T23:21:57.217306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591042,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":190,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":160,"acting":160,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":59,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248872,"kb_used_data":7656,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725848,"statfs":{"total":773094113280,"available":772839268352,"internally_reserved":0,"allocated":7839744,"data_stored":3947933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":674,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.774121"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.477555+0000","last_change":"2024-09-11T23:21:54.474738+0000","last_active":"2024-09-11T23:21:54.477555+0000","last_peered":"2024-09-11T23:21:54.477555+0000","last_clean":"2024-09-11T23:21:54.477555+0000","last_became_active":"2024-09-11T23:21:54.474049+0000","last_became_peered":"2024-09-11T23:21:54.474049+0000","last_unstale":"2024-09-11T23:21:54.477555+0000","last_undegraded":"2024-09-11T23:21:54.477555+0000","last_fullsized":"2024-09-11T23:21:54.477555+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:58.260435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484862+0000","last_change":"2024-09-11T23:21:54.481578+0000","last_active":"2024-09-11T23:21:54.484862+0000","last_peered":"2024-09-11T23:21:54.484862+0000","last_clean":"2024-09-11T23:21:54.484862+0000","last_became_active":"2024-09-11T23:21:54.481187+0000","last_became_peered":"2024-09-11T23:21:54.481187+0000","last_unstale":"2024-09-11T23:21:54.484862+0000","last_undegraded":"2024-09-11T23:21:54.484862+0000","last_fullsized":"2024-09-11T23:21:54.484862+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:49.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.455319+0000","last_change":"2024-09-11T23:21:53.455319+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.455319+0000","last_undegraded":"2024-09-11T23:21:53.455319+0000","last_fullsized":"2024-09-11T23:21:53.455319+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.487121+0000","last_change":"2024-09-11T23:21:54.485019+0000","last_active":"2024-09-11T23:21:54.487121+0000","last_peered":"2024-09-11T23:21:54.487121+0000","last_clean":"2024-09-11T23:21:54.487121+0000","last_became_active":"2024-09-11T23:21:54.480801+0000","last_became_peered":"2024-09-11T23:21:54.480801+0000","last_unstale":"2024-09-11T23:21:54.487121+0000","last_undegraded":"2024-09-11T23:21:54.487121+0000","last_fullsized":"2024-09-11T23:21:54.487121+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:41.480085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.472797+0000","last_change":"2024-09-11T23:21:54.466747+0000","last_active":"2024-09-11T23:21:54.472797+0000","last_peered":"2024-09-11T23:21:54.472797+0000","last_clean":"2024-09-11T23:21:54.472797+0000","last_became_active":"2024-09-11T23:21:54.465374+0000","last_became_peered":"2024-09-11T23:21:54.465374+0000","last_unstale":"2024-09-11T23:21:54.472797+0000","last_undegraded":"2024-09-11T23:21:54.472797+0000","last_fullsized":"2024-09-11T23:21:54.472797+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:32.677344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484295+0000","last_change":"2024-09-11T23:21:54.476928+0000","last_active":"2024-09-11T23:21:54.484295+0000","last_peered":"2024-09-11T23:21:54.484295+0000","last_clean":"2024-09-11T23:21:54.484295+0000","last_became_active":"2024-09-11T23:21:54.476618+0000","last_became_peered":"2024-09-11T23:21:54.476618+0000","last_unstale":"2024-09-11T23:21:54.484295+0000","last_undegraded":"2024-09-11T23:21:54.484295+0000","last_fullsized":"2024-09-11T23:21:54.484295+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:59.116972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.475017+0000","last_change":"2024-09-11T23:21:54.464693+0000","last_active":"2024-09-11T23:21:54.475017+0000","last_peered":"2024-09-11T23:21:54.475017+0000","last_clean":"2024-09-11T23:21:54.475017+0000","last_became_active":"2024-09-11T23:21:54.462500+0000","last_became_peered":"2024-09-11T23:21:54.462500+0000","last_unstale":"2024-09-11T23:21:54.475017+0000","last_undegraded":"2024-09-11T23:21:54.475017+0000","last_fullsized":"2024-09-11T23:21:54.475017+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:36.931095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.472510+0000","last_change":"2024-09-11T23:21:54.466244+0000","last_active":"2024-09-11T23:21:54.472510+0000","last_peered":"2024-09-11T23:21:54.472510+0000","last_clean":"2024-09-11T23:21:54.472510+0000","last_became_active":"2024-09-11T23:21:54.465979+0000","last_became_peered":"2024-09-11T23:21:54.465979+0000","last_unstale":"2024-09-11T23:21:54.472510+0000","last_undegraded":"2024-09-11T23:21:54.472510+0000","last_fullsized":"2024-09-11T23:21:54.472510+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:35.745599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.454934+0000","last_change":"2024-09-11T23:21:53.454934+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.454934+0000","last_undegraded":"2024-09-11T23:21:53.454934+0000","last_fullsized":"2024-09-11T23:21:53.454934+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.452424+0000","last_change":"2024-09-11T23:21:53.452424+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.452424+0000","last_undegraded":"2024-09-11T23:21:53.452424+0000","last_fullsized":"2024-09-11T23:21:53.452424+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.451943+0000","last_change":"2024-09-11T23:21:53.451943+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.451943+0000","last_undegraded":"2024-09-11T23:21:53.451943+0000","last_fullsized":"2024-09-11T23:21:53.451943+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.477344+0000","last_change":"2024-09-11T23:21:54.470918+0000","last_active":"2024-09-11T23:21:54.477344+0000","last_peered":"2024-09-11T23:21:54.477344+0000","last_clean":"2024-09-11T23:21:54.477344+0000","last_became_active":"2024-09-11T23:21:54.470555+0000","last_became_peered":"2024-09-11T23:21:54.470555+0000","last_unstale":"2024-09-11T23:21:54.477344+0000","last_undegraded":"2024-09-11T23:21:54.477344+0000","last_fullsized":"2024-09-11T23:21:54.477344+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:41.480085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.453256+0000","last_change":"2024-09-11T23:21:53.453256+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.453256+0000","last_undegraded":"2024-09-11T23:21:53.453256+0000","last_fullsized":"2024-09-11T23:21:53.453256+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484540+0000","last_change":"2024-09-11T23:21:54.476872+0000","last_active":"2024-09-11T23:21:54.484540+0000","last_peered":"2024-09-11T23:21:54.484540+0000","last_clean":"2024-09-11T23:21:54.484540+0000","last_became_active":"2024-09-11T23:21:54.476582+0000","last_became_peered":"2024-09-11T23:21:54.476582+0000","last_unstale":"2024-09-11T23:21:54.484540+0000","last_undegraded":"2024-09-11T23:21:54.484540+0000","last_fullsized":"2024-09-11T23:21:54.484540+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:30.000391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.452708+0000","last_change":"2024-09-11T23:21:53.452708+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.452708+0000","last_undegraded":"2024-09-11T23:21:53.452708+0000","last_fullsized":"2024-09-11T23:21:53.452708+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.475117+0000","last_change":"2024-09-11T23:21:54.463114+0000","last_active":"2024-09-11T23:21:54.475117+0000","last_peered":"2024-09-11T23:21:54.475117+0000","last_clean":"2024-09-11T23:21:54.475117+0000","last_became_active":"2024-09-11T23:21:54.462251+0000","last_became_peered":"2024-09-11T23:21:54.462251+0000","last_unstale":"2024-09-11T23:21:54.475117+0000","last_undegraded":"2024-09-11T23:21:54.475117+0000","last_fullsized":"2024-09-11T23:21:54.475117+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:30.000391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.474984+0000","last_change":"2024-09-11T23:21:54.464400+0000","last_active":"2024-09-11T23:21:54.474984+0000","last_peered":"2024-09-11T23:21:54.474984+0000","last_clean":"2024-09-11T23:21:54.474984+0000","last_became_active":"2024-09-11T23:21:54.464075+0000","last_became_peered":"2024-09-11T23:21:54.464075+0000","last_unstale":"2024-09-11T23:21:54.474984+0000","last_undegraded":"2024-09-11T23:21:54.474984+0000","last_fullsized":"2024-09-11T23:21:54.474984+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:23.665399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.469554+0000","last_change":"2024-09-11T23:21:54.462809+0000","last_active":"2024-09-11T23:21:54.469554+0000","last_peered":"2024-09-11T23:21:54.469554+0000","last_clean":"2024-09-11T23:21:54.469554+0000","last_became_active":"2024-09-11T23:21:54.462548+0000","last_became_peered":"2024-09-11T23:21:54.462548+0000","last_unstale":"2024-09-11T23:21:54.469554+0000","last_undegraded":"2024-09-11T23:21:54.469554+0000","last_fullsized":"2024-09-11T23:21:54.469554+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:25.175924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.483329+0000","last_change":"2024-09-11T23:21:54.482141+0000","last_active":"2024-09-11T23:21:54.483329+0000","last_peered":"2024-09-11T23:21:54.483329+0000","last_clean":"2024-09-11T23:21:54.483329+0000","last_became_active":"2024-09-11T23:21:54.481848+0000","last_became_peered":"2024-09-11T23:21:54.481848+0000","last_unstale":"2024-09-11T23:21:54.483329+0000","last_undegraded":"2024-09-11T23:21:54.483329+0000","last_fullsized":"2024-09-11T23:21:54.483329+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:13.798720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.477131+0000","last_change":"2024-09-11T23:21:54.467818+0000","last_active":"2024-09-11T23:21:54.477131+0000","last_peered":"2024-09-11T23:21:54.477131+0000","last_clean":"2024-09-11T23:21:54.477131+0000","last_became_active":"2024-09-11T23:21:54.467486+0000","last_became_peered":"2024-09-11T23:21:54.467486+0000","last_unstale":"2024-09-11T23:21:54.477131+0000","last_undegraded":"2024-09-11T23:21:54.477131+0000","last_fullsized":"2024-09-11T23:21:54.477131+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:49.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.480935+0000","last_change":"2024-09-11T23:21:54.479693+0000","last_active":"2024-09-11T23:21:54.480935+0000","last_peered":"2024-09-11T23:21:54.480935+0000","last_clean":"2024-09-11T23:21:54.480935+0000","last_became_active":"2024-09-11T23:21:54.479390+0000","last_became_peered":"2024-09-11T23:21:54.479390+0000","last_unstale":"2024-09-11T23:21:54.480935+0000","last_undegraded":"2024-09-11T23:21:54.480935+0000","last_fullsized":"2024-09-11T23:21:54.480935+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:43.399494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.475047+0000","last_change":"2024-09-11T23:21:54.462458+0000","last_active":"2024-09-11T23:21:54.475047+0000","last_peered":"2024-09-11T23:21:54.475047+0000","last_clean":"2024-09-11T23:21:54.475047+0000","last_became_active":"2024-09-11T23:21:54.462063+0000","last_became_peered":"2024-09-11T23:21:54.462063+0000","last_unstale":"2024-09-11T23:21:54.475047+0000","last_undegraded":"2024-09-11T23:21:54.475047+0000","last_fullsized":"2024-09-11T23:21:54.475047+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:14.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.483602+0000","last_change":"2024-09-11T23:21:54.482128+0000","last_active":"2024-09-11T23:21:54.483602+0000","last_peered":"2024-09-11T23:21:54.483602+0000","last_clean":"2024-09-11T23:21:54.483602+0000","last_became_active":"2024-09-11T23:21:54.481785+0000","last_became_peered":"2024-09-11T23:21:54.481785+0000","last_unstale":"2024-09-11T23:21:54.483602+0000","last_undegraded":"2024-09-11T23:21:54.483602+0000","last_fullsized":"2024-09-11T23:21:54.483602+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:25.175924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.468892+0000","last_change":"2024-09-11T23:21:54.460206+0000","last_active":"2024-09-11T23:21:54.468892+0000","last_peered":"2024-09-11T23:21:54.468892+0000","last_clean":"2024-09-11T23:21:54.468892+0000","last_became_active":"2024-09-11T23:21:54.459460+0000","last_became_peered":"2024-09-11T23:21:54.459460+0000","last_unstale":"2024-09-11T23:21:54.468892+0000","last_undegraded":"2024-09-11T23:21:54.468892+0000","last_fullsized":"2024-09-11T23:21:54.468892+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:23.935572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484821+0000","last_change":"2024-09-11T23:21:54.480061+0000","last_active":"2024-09-11T23:21:54.484821+0000","last_peered":"2024-09-11T23:21:54.484821+0000","last_clean":"2024-09-11T23:21:54.484821+0000","last_became_active":"2024-09-11T23:21:54.478494+0000","last_became_peered":"2024-09-11T23:21:54.478494+0000","last_unstale":"2024-09-11T23:21:54.484821+0000","last_undegraded":"2024-09-11T23:21:54.484821+0000","last_fullsized":"2024-09-11T23:21:54.484821+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:36.931095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484750+0000","last_change":"2024-09-11T23:21:54.483670+0000","last_active":"2024-09-11T23:21:54.484750+0000","last_peered":"2024-09-11T23:21:54.484750+0000","last_clean":"2024-09-11T23:21:54.484750+0000","last_became_active":"2024-09-11T23:21:54.483430+0000","last_became_peered":"2024-09-11T23:21:54.483430+0000","last_unstale":"2024-09-11T23:21:54.484750+0000","last_undegraded":"2024-09-11T23:21:54.484750+0000","last_fullsized":"2024-09-11T23:21:54.484750+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:41.754162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"70'4","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.485136+0000","last_change":"2024-09-11T23:21:53.470991+0000","last_active":"2024-09-11T23:21:54.485136+0000","last_peered":"2024-09-11T23:21:54.485136+0000","last_clean":"2024-09-11T23:21:54.485136+0000","last_became_active":"2024-09-11T23:21:53.470699+0000","last_became_peered":"2024-09-11T23:21:53.470699+0000","last_unstale":"2024-09-11T23:21:54.485136+0000","last_undegraded":"2024-09-11T23:21:54.485136+0000","last_fullsized":"2024-09-11T23:21:54.485136+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:31.669192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T23:21:53.464929+0000","last_change":"2024-09-11T23:21:53.463711+0000","last_active":"2024-09-11T23:21:53.464929+0000","last_peered":"2024-09-11T23:21:53.464929+0000","last_clean":"2024-09-11T23:21:53.464929+0000","last_became_active":"2024-09-11T23:21:53.462741+0000","last_became_peered":"2024-09-11T23:21:53.462741+0000","last_unstale":"2024-09-11T23:21:53.464929+0000","last_undegraded":"2024-09-11T23:21:53.464929+0000","last_fullsized":"2024-09-11T23:21:53.464929+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:03.790130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.485009+0000","last_change":"2024-09-11T23:21:54.479264+0000","last_active":"2024-09-11T23:21:54.485009+0000","last_peered":"2024-09-11T23:21:54.485009+0000","last_clean":"2024-09-11T23:21:54.485009+0000","last_became_active":"2024-09-11T23:21:54.478939+0000","last_became_peered":"2024-09-11T23:21:54.478939+0000","last_unstale":"2024-09-11T23:21:54.485009+0000","last_undegraded":"2024-09-11T23:21:54.485009+0000","last_fullsized":"2024-09-11T23:21:54.485009+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:23.665399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.483010+0000","last_change":"2024-09-11T23:21:53.467522+0000","last_active":"2024-09-11T23:21:54.483010+0000","last_peered":"2024-09-11T23:21:54.483010+0000","last_clean":"2024-09-11T23:21:54.483010+0000","last_became_active":"2024-09-11T23:21:53.467218+0000","last_became_peered":"2024-09-11T23:21:53.467218+0000","last_unstale":"2024-09-11T23:21:54.483010+0000","last_undegraded":"2024-09-11T23:21:54.483010+0000","last_fullsized":"2024-09-11T23:21:54.483010+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:35.293491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.476547+0000","last_change":"2024-09-11T23:21:54.469492+0000","last_active":"2024-09-11T23:21:54.476547+0000","last_peered":"2024-09-11T23:21:54.476547+0000","last_clean":"2024-09-11T23:21:54.476547+0000","last_became_active":"2024-09-11T23:21:54.469040+0000","last_became_peered":"2024-09-11T23:21:54.469040+0000","last_unstale":"2024-09-11T23:21:54.476547+0000","last_undegraded":"2024-09-11T23:21:54.476547+0000","last_fullsized":"2024-09-11T23:21:54.476547+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:43.570690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.482717+0000","last_change":"2024-09-11T23:21:53.469697+0000","last_active":"2024-09-11T23:21:54.482717+0000","last_peered":"2024-09-11T23:21:54.482717+0000","last_clean":"2024-09-11T23:21:54.482717+0000","last_became_active":"2024-09-11T23:21:53.469365+0000","last_became_peered":"2024-09-11T23:21:53.469365+0000","last_unstale":"2024-09-11T23:21:54.482717+0000","last_undegraded":"2024-09-11T23:21:54.482717+0000","last_fullsized":"2024-09-11T23:21:54.482717+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:09.148570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.472886+0000","last_change":"2024-09-11T23:21:54.466699+0000","last_active":"2024-09-11T23:21:54.472886+0000","last_peered":"2024-09-11T23:21:54.472886+0000","last_clean":"2024-09-11T23:21:54.472886+0000","last_became_active":"2024-09-11T23:21:54.466400+0000","last_became_peered":"2024-09-11T23:21:54.466400+0000","last_unstale":"2024-09-11T23:21:54.472886+0000","last_undegraded":"2024-09-11T23:21:54.472886+0000","last_fullsized":"2024-09-11T23:21:54.472886+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:15.297748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-11T23:21:52.447974+0000","last_change":"2024-09-11T23:21:52.447974+0000","last_active":"2024-09-11T23:21:52.429217+0000","last_peered":"2024-09-11T23:21:52.429217+0000","last_clean":"2024-09-11T23:21:52.429217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:52.447974+0000","last_undegraded":"2024-09-11T23:21:52.447974+0000","last_fullsized":"2024-09-11T23:21:52.447974+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.475091+0000","last_change":"2024-09-11T23:21:54.462869+0000","last_active":"2024-09-11T23:21:54.475091+0000","last_peered":"2024-09-11T23:21:54.475091+0000","last_clean":"2024-09-11T23:21:54.475091+0000","last_became_active":"2024-09-11T23:21:54.461814+0000","last_became_peered":"2024-09-11T23:21:54.461814+0000","last_unstale":"2024-09-11T23:21:54.475091+0000","last_undegraded":"2024-09-11T23:21:54.475091+0000","last_fullsized":"2024-09-11T23:21:54.475091+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:15.952204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"70'1","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484899+0000","last_change":"2024-09-11T23:21:53.470378+0000","last_active":"2024-09-11T23:21:54.484899+0000","last_peered":"2024-09-11T23:21:54.484899+0000","last_clean":"2024-09-11T23:21:54.484899+0000","last_became_active":"2024-09-11T23:21:53.470047+0000","last_became_peered":"2024-09-11T23:21:53.470047+0000","last_unstale":"2024-09-11T23:21:54.484899+0000","last_undegraded":"2024-09-11T23:21:54.484899+0000","last_fullsized":"2024-09-11T23:21:54.484899+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:23.781101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T23:21:53.475259+0000","last_change":"2024-09-11T23:21:53.470324+0000","last_active":"2024-09-11T23:21:53.475259+0000","last_peered":"2024-09-11T23:21:53.475259+0000","last_clean":"2024-09-11T23:21:53.475259+0000","last_became_active":"2024-09-11T23:21:53.470034+0000","last_became_peered":"2024-09-11T23:21:53.470034+0000","last_unstale":"2024-09-11T23:21:53.475259+0000","last_undegraded":"2024-09-11T23:21:53.475259+0000","last_fullsized":"2024-09-11T23:21:53.475259+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:11.566507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.451371+0000","last_change":"2024-09-11T23:21:53.451371+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.451371+0000","last_undegraded":"2024-09-11T23:21:53.451371+0000","last_fullsized":"2024-09-11T23:21:53.451371+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-11T23:21:52.442793+0000","last_change":"2024-09-11T23:21:52.442793+0000","last_active":"2024-09-11T23:21:52.429217+0000","last_peered":"2024-09-11T23:21:52.429217+0000","last_clean":"2024-09-11T23:21:52.429217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:52.442793+0000","last_undegraded":"2024-09-11T23:21:52.442793+0000","last_fullsized":"2024-09-11T23:21:52.442793+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.471131+0000","last_change":"2024-09-11T23:21:54.461750+0000","last_active":"2024-09-11T23:21:54.471131+0000","last_peered":"2024-09-11T23:21:54.471131+0000","last_clean":"2024-09-11T23:21:54.471131+0000","last_became_active":"2024-09-11T23:21:54.461419+0000","last_became_peered":"2024-09-11T23:21:54.461419+0000","last_unstale":"2024-09-11T23:21:54.471131+0000","last_undegraded":"2024-09-11T23:21:54.471131+0000","last_fullsized":"2024-09-11T23:21:54.471131+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:15.958011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.453347+0000","last_change":"2024-09-11T23:21:53.470446+0000","last_active":"2024-09-11T23:21:54.453347+0000","last_peered":"2024-09-11T23:21:54.453347+0000","last_clean":"2024-09-11T23:21:54.453347+0000","last_became_active":"2024-09-11T23:21:53.470036+0000","last_became_peered":"2024-09-11T23:21:53.470036+0000","last_unstale":"2024-09-11T23:21:54.453347+0000","last_undegraded":"2024-09-11T23:21:54.453347+0000","last_fullsized":"2024-09-11T23:21:54.453347+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:58.108821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.487552+0000","last_change":"2024-09-11T23:21:54.486905+0000","last_active":"2024-09-11T23:21:54.487552+0000","last_peered":"2024-09-11T23:21:54.487552+0000","last_clean":"2024-09-11T23:21:54.487552+0000","last_became_active":"2024-09-11T23:21:54.486173+0000","last_became_peered":"2024-09-11T23:21:54.486173+0000","last_unstale":"2024-09-11T23:21:54.487552+0000","last_undegraded":"2024-09-11T23:21:54.487552+0000","last_fullsized":"2024-09-11T23:21:54.487552+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:01.841438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.464940+0000","last_change":"2024-09-11T23:21:53.471148+0000","last_active":"2024-09-11T23:21:54.464940+0000","last_peered":"2024-09-11T23:21:54.464940+0000","last_clean":"2024-09-11T23:21:54.464940+0000","last_became_active":"2024-09-11T23:21:53.470383+0000","last_became_peered":"2024-09-11T23:21:53.470383+0000","last_unstale":"2024-09-11T23:21:54.464940+0000","last_undegraded":"2024-09-11T23:21:54.464940+0000","last_fullsized":"2024-09-11T23:21:54.464940+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:43.791393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484467+0000","last_change":"2024-09-11T23:21:54.478635+0000","last_active":"2024-09-11T23:21:54.484467+0000","last_peered":"2024-09-11T23:21:54.484467+0000","last_clean":"2024-09-11T23:21:54.484467+0000","last_became_active":"2024-09-11T23:21:54.476093+0000","last_became_peered":"2024-09-11T23:21:54.476093+0000","last_unstale":"2024-09-11T23:21:54.484467+0000","last_undegraded":"2024-09-11T23:21:54.484467+0000","last_fullsized":"2024-09-11T23:21:54.484467+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:15.952204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-11T23:21:52.448002+0000","last_change":"2024-09-11T23:21:52.448002+0000","last_active":"2024-09-11T23:21:52.429217+0000","last_peered":"2024-09-11T23:21:52.429217+0000","last_clean":"2024-09-11T23:21:52.429217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:52.448002+0000","last_undegraded":"2024-09-11T23:21:52.448002+0000","last_fullsized":"2024-09-11T23:21:52.448002+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T23:21:53.469108+0000","last_change":"2024-09-11T23:21:53.465308+0000","last_active":"2024-09-11T23:21:53.469108+0000","last_peered":"2024-09-11T23:21:53.469108+0000","last_clean":"2024-09-11T23:21:53.469108+0000","last_became_active":"2024-09-11T23:21:53.464677+0000","last_became_peered":"2024-09-11T23:21:53.464677+0000","last_unstale":"2024-09-11T23:21:53.469108+0000","last_undegraded":"2024-09-11T23:21:53.469108+0000","last_fullsized":"2024-09-11T23:21:53.469108+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:44.307898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.472595+0000","last_change":"2024-09-11T23:21:54.466748+0000","last_active":"2024-09-11T23:21:54.472595+0000","last_peered":"2024-09-11T23:21:54.472595+0000","last_clean":"2024-09-11T23:21:54.472595+0000","last_became_active":"2024-09-11T23:21:54.466494+0000","last_became_peered":"2024-09-11T23:21:54.466494+0000","last_unstale":"2024-09-11T23:21:54.472595+0000","last_undegraded":"2024-09-11T23:21:54.472595+0000","last_fullsized":"2024-09-11T23:21:54.472595+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:30.855528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T23:21:53.470307+0000","last_change":"2024-09-11T23:21:53.467755+0000","last_active":"2024-09-11T23:21:53.470307+0000","last_peered":"2024-09-11T23:21:53.470307+0000","last_clean":"2024-09-11T23:21:53.470307+0000","last_became_active":"2024-09-11T23:21:53.467498+0000","last_became_peered":"2024-09-11T23:21:53.467498+0000","last_unstale":"2024-09-11T23:21:53.470307+0000","last_undegraded":"2024-09-11T23:21:53.470307+0000","last_fullsized":"2024-09-11T23:21:53.470307+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:06.639484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.467764+0000","last_change":"2024-09-11T23:21:54.460315+0000","last_active":"2024-09-11T23:21:54.467764+0000","last_peered":"2024-09-11T23:21:54.467764+0000","last_clean":"2024-09-11T23:21:54.467764+0000","last_became_active":"2024-09-11T23:21:54.459316+0000","last_became_peered":"2024-09-11T23:21:54.459316+0000","last_unstale":"2024-09-11T23:21:54.467764+0000","last_undegraded":"2024-09-11T23:21:54.467764+0000","last_fullsized":"2024-09-11T23:21:54.467764+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:40.941889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.465022+0000","last_change":"2024-09-11T23:21:53.470164+0000","last_active":"2024-09-11T23:21:54.465022+0000","last_peered":"2024-09-11T23:21:54.465022+0000","last_clean":"2024-09-11T23:21:54.465022+0000","last_became_active":"2024-09-11T23:21:53.469877+0000","last_became_peered":"2024-09-11T23:21:53.469877+0000","last_unstale":"2024-09-11T23:21:54.465022+0000","last_undegraded":"2024-09-11T23:21:54.465022+0000","last_fullsized":"2024-09-11T23:21:54.465022+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:53.798999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.453003+0000","last_change":"2024-09-11T23:21:53.453003+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.453003+0000","last_undegraded":"2024-09-11T23:21:53.453003+0000","last_fullsized":"2024-09-11T23:21:53.453003+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.452735+0000","last_change":"2024-09-11T23:21:53.462910+0000","last_active":"2024-09-11T23:21:54.452735+0000","last_peered":"2024-09-11T23:21:54.452735+0000","last_clean":"2024-09-11T23:21:54.452735+0000","last_became_active":"2024-09-11T23:21:53.462628+0000","last_became_peered":"2024-09-11T23:21:53.462628+0000","last_unstale":"2024-09-11T23:21:54.452735+0000","last_undegraded":"2024-09-11T23:21:54.452735+0000","last_fullsized":"2024-09-11T23:21:54.452735+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:03.790130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"70'8","reported_seq":20,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.479207+0000","last_change":"2024-09-11T23:21:53.468168+0000","last_active":"2024-09-11T23:21:54.479207+0000","last_peered":"2024-09-11T23:21:54.479207+0000","last_clean":"2024-09-11T23:21:54.479207+0000","last_became_active":"2024-09-11T23:21:53.467519+0000","last_became_peered":"2024-09-11T23:21:53.467519+0000","last_unstale":"2024-09-11T23:21:54.479207+0000","last_undegraded":"2024-09-11T23:21:54.479207+0000","last_fullsized":"2024-09-11T23:21:54.479207+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:44.775322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.477628+0000","last_change":"2024-09-11T23:21:54.472550+0000","last_active":"2024-09-11T23:21:54.477628+0000","last_peered":"2024-09-11T23:21:54.477628+0000","last_clean":"2024-09-11T23:21:54.477628+0000","last_became_active":"2024-09-11T23:21:54.468734+0000","last_became_peered":"2024-09-11T23:21:54.468734+0000","last_unstale":"2024-09-11T23:21:54.477628+0000","last_undegraded":"2024-09-11T23:21:54.477628+0000","last_fullsized":"2024-09-11T23:21:54.477628+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:38.062064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"70'1","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484606+0000","last_change":"2024-09-11T23:21:53.468403+0000","last_active":"2024-09-11T23:21:54.484606+0000","last_peered":"2024-09-11T23:21:54.484606+0000","last_clean":"2024-09-11T23:21:54.484606+0000","last_became_active":"2024-09-11T23:21:53.468047+0000","last_became_peered":"2024-09-11T23:21:53.468047+0000","last_unstale":"2024-09-11T23:21:54.484606+0000","last_undegraded":"2024-09-11T23:21:54.484606+0000","last_fullsized":"2024-09-11T23:21:54.484606+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:20.530963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.477583+0000","last_change":"2024-09-11T23:21:54.475552+0000","last_active":"2024-09-11T23:21:54.477583+0000","last_peered":"2024-09-11T23:21:54.477583+0000","last_clean":"2024-09-11T23:21:54.477583+0000","last_became_active":"2024-09-11T23:21:54.472532+0000","last_became_peered":"2024-09-11T23:21:54.472532+0000","last_unstale":"2024-09-11T23:21:54.477583+0000","last_undegraded":"2024-09-11T23:21:54.477583+0000","last_fullsized":"2024-09-11T23:21:54.477583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:07.418531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.483008+0000","last_change":"2024-09-11T23:21:53.466954+0000","last_active":"2024-09-11T23:21:54.483008+0000","last_peered":"2024-09-11T23:21:54.483008+0000","last_clean":"2024-09-11T23:21:54.483008+0000","last_became_active":"2024-09-11T23:21:53.466633+0000","last_became_peered":"2024-09-11T23:21:53.466633+0000","last_unstale":"2024-09-11T23:21:54.483008+0000","last_undegraded":"2024-09-11T23:21:54.483008+0000","last_fullsized":"2024-09-11T23:21:54.483008+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:41.854885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.453265+0000","last_change":"2024-09-11T23:21:53.453265+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.453265+0000","last_undegraded":"2024-09-11T23:21:53.453265+0000","last_fullsized":"2024-09-11T23:21:53.453265+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"70'1","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.481720+0000","last_change":"2024-09-11T23:21:53.474038+0000","last_active":"2024-09-11T23:21:54.481720+0000","last_peered":"2024-09-11T23:21:54.481720+0000","last_clean":"2024-09-11T23:21:54.481720+0000","last_became_active":"2024-09-11T23:21:53.473332+0000","last_became_peered":"2024-09-11T23:21:53.473332+0000","last_unstale":"2024-09-11T23:21:54.481720+0000","last_undegraded":"2024-09-11T23:21:54.481720+0000","last_fullsized":"2024-09-11T23:21:54.481720+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:41.854885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.458366+0000","last_change":"2024-09-11T23:21:53.473759+0000","last_active":"2024-09-11T23:21:54.458366+0000","last_peered":"2024-09-11T23:21:54.458366+0000","last_clean":"2024-09-11T23:21:54.458366+0000","last_became_active":"2024-09-11T23:21:53.473476+0000","last_became_peered":"2024-09-11T23:21:53.473476+0000","last_unstale":"2024-09-11T23:21:54.458366+0000","last_undegraded":"2024-09-11T23:21:54.458366+0000","last_fullsized":"2024-09-11T23:21:54.458366+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:42.391343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.464840+0000","last_change":"2024-09-11T23:21:53.473082+0000","last_active":"2024-09-11T23:21:54.464840+0000","last_peered":"2024-09-11T23:21:54.464840+0000","last_clean":"2024-09-11T23:21:54.464840+0000","last_became_active":"2024-09-11T23:21:53.472772+0000","last_became_peered":"2024-09-11T23:21:53.472772+0000","last_unstale":"2024-09-11T23:21:54.464840+0000","last_undegraded":"2024-09-11T23:21:54.464840+0000","last_fullsized":"2024-09-11T23:21:54.464840+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:02.766133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.452910+0000","last_change":"2024-09-11T23:21:53.454657+0000","last_active":"2024-09-11T23:21:54.452910+0000","last_peered":"2024-09-11T23:21:54.452910+0000","last_clean":"2024-09-11T23:21:54.452910+0000","last_became_active":"2024-09-11T23:21:53.454348+0000","last_became_peered":"2024-09-11T23:21:53.454348+0000","last_unstale":"2024-09-11T23:21:54.452910+0000","last_undegraded":"2024-09-11T23:21:54.452910+0000","last_fullsized":"2024-09-11T23:21:54.452910+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:08.581853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T23:21:53.464920+0000","last_change":"2024-09-11T23:21:53.463237+0000","last_active":"2024-09-11T23:21:53.464920+0000","last_peered":"2024-09-11T23:21:53.464920+0000","last_clean":"2024-09-11T23:21:53.464920+0000","last_became_active":"2024-09-11T23:21:53.462807+0000","last_became_peered":"2024-09-11T23:21:53.462807+0000","last_unstale":"2024-09-11T23:21:53.464920+0000","last_undegraded":"2024-09-11T23:21:53.464920+0000","last_fullsized":"2024-09-11T23:21:53.464920+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:36.015928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.457164+0000","last_change":"2024-09-11T23:21:53.457164+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.457164+0000","last_undegraded":"2024-09-11T23:21:53.457164+0000","last_fullsized":"2024-09-11T23:21:53.457164+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484646+0000","last_change":"2024-09-11T23:21:53.467675+0000","last_active":"2024-09-11T23:21:54.484646+0000","last_peered":"2024-09-11T23:21:54.484646+0000","last_clean":"2024-09-11T23:21:54.484646+0000","last_became_active":"2024-09-11T23:21:53.467403+0000","last_became_peered":"2024-09-11T23:21:53.467403+0000","last_unstale":"2024-09-11T23:21:54.484646+0000","last_undegraded":"2024-09-11T23:21:54.484646+0000","last_fullsized":"2024-09-11T23:21:54.484646+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:35.293491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.472859+0000","last_change":"2024-09-11T23:21:54.466727+0000","last_active":"2024-09-11T23:21:54.472859+0000","last_peered":"2024-09-11T23:21:54.472859+0000","last_clean":"2024-09-11T23:21:54.472859+0000","last_became_active":"2024-09-11T23:21:54.465666+0000","last_became_peered":"2024-09-11T23:21:54.465666+0000","last_unstale":"2024-09-11T23:21:54.472859+0000","last_undegraded":"2024-09-11T23:21:54.472859+0000","last_fullsized":"2024-09-11T23:21:54.472859+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:42.311671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.453247+0000","last_change":"2024-09-11T23:21:53.461181+0000","last_active":"2024-09-11T23:21:54.453247+0000","last_peered":"2024-09-11T23:21:54.453247+0000","last_clean":"2024-09-11T23:21:54.453247+0000","last_became_active":"2024-09-11T23:21:53.460896+0000","last_became_peered":"2024-09-11T23:21:53.460896+0000","last_unstale":"2024-09-11T23:21:54.453247+0000","last_undegraded":"2024-09-11T23:21:54.453247+0000","last_fullsized":"2024-09-11T23:21:54.453247+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:04.612943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.487237+0000","last_change":"2024-09-11T23:21:54.485658+0000","last_active":"2024-09-11T23:21:54.487237+0000","last_peered":"2024-09-11T23:21:54.487237+0000","last_clean":"2024-09-11T23:21:54.487237+0000","last_became_active":"2024-09-11T23:21:54.485358+0000","last_became_peered":"2024-09-11T23:21:54.485358+0000","last_unstale":"2024-09-11T23:21:54.487237+0000","last_undegraded":"2024-09-11T23:21:54.487237+0000","last_fullsized":"2024-09-11T23:21:54.487237+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:03.450050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-11T23:21:52.442827+0000","last_change":"2024-09-11T23:21:52.442827+0000","last_active":"2024-09-11T23:21:52.429217+0000","last_peered":"2024-09-11T23:21:52.429217+0000","last_clean":"2024-09-11T23:21:52.429217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:52.442827+0000","last_undegraded":"2024-09-11T23:21:52.442827+0000","last_fullsized":"2024-09-11T23:21:52.442827+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.470934+0000","last_change":"2024-09-11T23:21:54.463652+0000","last_active":"2024-09-11T23:21:54.470934+0000","last_peered":"2024-09-11T23:21:54.470934+0000","last_clean":"2024-09-11T23:21:54.470934+0000","last_became_active":"2024-09-11T23:21:54.463110+0000","last_became_peered":"2024-09-11T23:21:54.463110+0000","last_unstale":"2024-09-11T23:21:54.470934+0000","last_undegraded":"2024-09-11T23:21:54.470934+0000","last_fullsized":"2024-09-11T23:21:54.470934+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:22.103012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T23:21:53.468943+0000","last_change":"2024-09-11T23:21:53.466964+0000","last_active":"2024-09-11T23:21:53.468943+0000","last_peered":"2024-09-11T23:21:53.468943+0000","last_clean":"2024-09-11T23:21:53.468943+0000","last_became_active":"2024-09-11T23:21:53.466588+0000","last_became_peered":"2024-09-11T23:21:53.466588+0000","last_unstale":"2024-09-11T23:21:53.468943+0000","last_undegraded":"2024-09-11T23:21:53.468943+0000","last_fullsized":"2024-09-11T23:21:53.468943+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:08.581853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-11T23:21:52.442846+0000","last_change":"2024-09-11T23:21:52.442846+0000","last_active":"2024-09-11T23:21:52.429217+0000","last_peered":"2024-09-11T23:21:52.429217+0000","last_clean":"2024-09-11T23:21:52.429217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:52.442846+0000","last_undegraded":"2024-09-11T23:21:52.442846+0000","last_fullsized":"2024-09-11T23:21:52.442846+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.485775+0000","last_change":"2024-09-11T23:21:54.477778+0000","last_active":"2024-09-11T23:21:54.485775+0000","last_peered":"2024-09-11T23:21:54.485775+0000","last_clean":"2024-09-11T23:21:54.485775+0000","last_became_active":"2024-09-11T23:21:54.475823+0000","last_became_peered":"2024-09-11T23:21:54.475823+0000","last_unstale":"2024-09-11T23:21:54.485775+0000","last_undegraded":"2024-09-11T23:21:54.485775+0000","last_fullsized":"2024-09-11T23:21:54.485775+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:14.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-11T23:21:53.472471+0000","last_change":"2024-09-11T23:21:53.468442+0000","last_active":"2024-09-11T23:21:53.472471+0000","last_peered":"2024-09-11T23:21:53.472471+0000","last_clean":"2024-09-11T23:21:53.472471+0000","last_became_active":"2024-09-11T23:21:53.468181+0000","last_became_peered":"2024-09-11T23:21:53.468181+0000","last_unstale":"2024-09-11T23:21:53.472471+0000","last_undegraded":"2024-09-11T23:21:53.472471+0000","last_fullsized":"2024-09-11T23:21:53.472471+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:21.026252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":69,"state":"creating+peering","last_fresh":"2024-09-11T23:21:53.453941+0000","last_change":"2024-09-11T23:21:53.453941+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.453941+0000","last_undegraded":"2024-09-11T23:21:53.453941+0000","last_fullsized":"2024-09-11T23:21:53.453941+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.452322+0000","last_change":"2024-09-11T23:21:53.470911+0000","last_active":"2024-09-11T23:21:54.452322+0000","last_peered":"2024-09-11T23:21:54.452322+0000","last_clean":"2024-09-11T23:21:54.452322+0000","last_became_active":"2024-09-11T23:21:53.469831+0000","last_became_peered":"2024-09-11T23:21:53.469831+0000","last_unstale":"2024-09-11T23:21:54.452322+0000","last_undegraded":"2024-09-11T23:21:54.452322+0000","last_fullsized":"2024-09-11T23:21:54.452322+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:20.530963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.481482+0000","last_change":"2024-09-11T23:21:54.470830+0000","last_active":"2024-09-11T23:21:54.481482+0000","last_peered":"2024-09-11T23:21:54.481482+0000","last_clean":"2024-09-11T23:21:54.481482+0000","last_became_active":"2024-09-11T23:21:54.470522+0000","last_became_peered":"2024-09-11T23:21:54.470522+0000","last_unstale":"2024-09-11T23:21:54.481482+0000","last_undegraded":"2024-09-11T23:21:54.481482+0000","last_fullsized":"2024-09-11T23:21:54.481482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:45.783474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.456914+0000","last_change":"2024-09-11T23:21:53.472150+0000","last_active":"2024-09-11T23:21:54.456914+0000","last_peered":"2024-09-11T23:21:54.456914+0000","last_clean":"2024-09-11T23:21:54.456914+0000","last_became_active":"2024-09-11T23:21:53.471468+0000","last_became_peered":"2024-09-11T23:21:53.471468+0000","last_unstale":"2024-09-11T23:21:54.456914+0000","last_undegraded":"2024-09-11T23:21:54.456914+0000","last_fullsized":"2024-09-11T23:21:54.456914+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:21.026252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-11T23:21:53.437368+0000","last_change":"2024-09-11T23:21:53.437368+0000","last_active":"2024-09-11T23:21:53.437368+0000","last_peered":"2024-09-11T23:21:53.437368+0000","last_clean":"2024-09-11T23:21:53.437368+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:21:53.437368+0000","last_undegraded":"2024-09-11T23:21:53.437368+0000","last_fullsized":"2024-09-11T23:21:53.437368+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.482255+0000","last_change":"2024-09-11T23:21:53.470567+0000","last_active":"2024-09-11T23:21:54.482255+0000","last_peered":"2024-09-11T23:21:54.482255+0000","last_clean":"2024-09-11T23:21:54.482255+0000","last_became_active":"2024-09-11T23:21:53.470275+0000","last_became_peered":"2024-09-11T23:21:53.470275+0000","last_unstale":"2024-09-11T23:21:54.482255+0000","last_undegraded":"2024-09-11T23:21:54.482255+0000","last_fullsized":"2024-09-11T23:21:54.482255+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:11.566507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":261,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.460043+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:21:54.460043+0000","last_peered":"2024-09-11T23:21:54.460043+0000","last_clean":"2024-09-11T23:21:54.460043+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:21:54.460043+0000","last_undegraded":"2024-09-11T23:21:54.460043+0000","last_fullsized":"2024-09-11T23:21:54.460043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":94,"acting":94,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":674,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476790,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1441792,"data_stored":942587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476789,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":847872,"data_stored":351695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476788,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":843776,"data_stored":351693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476788,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":827392,"data_stored":344828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509492,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":827392,"data_stored":344828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509492,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1421312,"data_stored":935196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":338553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542196,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":338553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:21:59.044 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:21:59.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.234+0000 7f31e6a00640 1 Processor -- start 2024-09-11T23:21:59.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.234+0000 7f31e6a00640 1 -- start start 2024-09-11T23:21:59.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.235+0000 7f31e6a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f31e015c180 0x7f31e00cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:59.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.235+0000 7f31e6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f31e00ce230 0x7f31e00cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:59.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.235+0000 7f31e6a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e00ce740 con 0x7f31e00cf5b0 2024-09-11T23:21:59.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.235+0000 7f31e6a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f31e0072640 con 0x7f31e00ce230 2024-09-11T23:21:59.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.235+0000 7f31e6a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f31e0072920 con 0x7f31e015c180 2024-09-11T23:21:59.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.235+0000 7f31df400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f31e00ce230 0x7f31e00cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:59.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.235+0000 7f31df400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f31e00ce230 0x7f31e00cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33784/0 (socket says 172.21.15.144:33784) 2024-09-11T23:21:59.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.235+0000 7f31df400640 1 -- 172.21.15.144:0/994958598 learned_addr learned my addr 172.21.15.144:0/994958598 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:59.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.235+0000 7f31e4a00640 1 --1- 172.21.15.144:0/994958598 >> v1:172.21.15.144:6789/0 conn(0x7f31e00cf5b0 0x7f31e0073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53370/0 (socket says 172.21.15.144:53370) 2024-09-11T23:21:59.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.235+0000 7f31dfe00640 1 --2- 172.21.15.144:0/994958598 >> v2:172.21.15.165:3300/0 conn(0x7f31e015c180 0x7f31e00cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:59.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.236+0000 7f31df400640 1 -- 172.21.15.144:0/994958598 >> v2:172.21.15.165:3300/0 conn(0x7f31e015c180 msgr2=0x7f31e00cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:59.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.236+0000 7f31df400640 1 --2- 172.21.15.144:0/994958598 >> v2:172.21.15.165:3300/0 conn(0x7f31e015c180 0x7f31e00cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.236+0000 7f31df400640 1 -- 172.21.15.144:0/994958598 >> v1:172.21.15.144:6789/0 conn(0x7f31e00cf5b0 legacy=0x7f31e0073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:59.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.236+0000 7f31df400640 1 -- 172.21.15.144:0/994958598 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e0072c00 con 0x7f31e00ce230 2024-09-11T23:21:59.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.237+0000 7f31df400640 1 --2- 172.21.15.144:0/994958598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31e00ce230 0x7f31e00cf070 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f31e006cc10 tx=0x7f31cc02a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998de4ab7f0a4520 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:59.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.237+0000 7f31dea00640 1 -- 172.21.15.144:0/994958598 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc037070 con 0x7f31e00ce230 2024-09-11T23:21:59.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.237+0000 7f31dea00640 1 -- 172.21.15.144:0/994958598 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31cc032440 con 0x7f31e00ce230 2024-09-11T23:21:59.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.237+0000 7f31dea00640 1 -- 172.21.15.144:0/994958598 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc032810 con 0x7f31e00ce230 2024-09-11T23:21:59.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.237+0000 7f31e6a00640 1 -- 172.21.15.144:0/994958598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31e00ce230 msgr2=0x7f31e00cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:59.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.237+0000 7f31e6a00640 1 --2- 172.21.15.144:0/994958598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31e00ce230 0x7f31e00cf070 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f31e006cc10 tx=0x7f31cc02a1f0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.238+0000 7f31e6a00640 1 -- 172.21.15.144:0/994958598 shutdown_connections 2024-09-11T23:21:59.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.238+0000 7f31e6a00640 1 --2- 172.21.15.144:0/994958598 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31e00ce230 0x7f31e00cf070 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.238+0000 7f31e6a00640 1 --2- 172.21.15.144:0/994958598 >> v2:172.21.15.165:3300/0 conn(0x7f31e015c180 0x7f31e00cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.238+0000 7f31e6a00640 1 -- 172.21.15.144:0/994958598 >> 172.21.15.144:0/994958598 conn(0x7f31e0062cc0 msgr2=0x7f31e006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:59.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.238+0000 7f31e6a00640 1 -- 172.21.15.144:0/994958598 shutdown_connections 2024-09-11T23:21:59.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.238+0000 7f31e6a00640 1 -- 172.21.15.144:0/994958598 wait complete. 2024-09-11T23:21:59.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.239+0000 7f31e6a00640 1 Processor -- start 2024-09-11T23:21:59.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.239+0000 7f31e6a00640 1 -- start start 2024-09-11T23:21:59.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.240+0000 7f31e6a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31e00ce230 0x7f31e0073bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:59.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.240+0000 7f31e6a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31e00cf5b0 0x7f31e00cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:59.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.240+0000 7f31e6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31e015c180 0x7f31e00cff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:59.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.240+0000 7f31e6a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f31e015c560 con 0x7f31e015c180 2024-09-11T23:21:59.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.240+0000 7f31e6a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f31e00722f0 con 0x7f31e00ce230 2024-09-11T23:21:59.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.240+0000 7f31e6a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f31e015c6e0 con 0x7f31e00cf5b0 2024-09-11T23:21:59.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.241+0000 7f31e4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31e015c180 0x7f31e00cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:59.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.241+0000 7f31e4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31e015c180 0x7f31e00cff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33800/0 (socket says 172.21.15.144:33800) 2024-09-11T23:21:59.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.241+0000 7f31e4a00640 1 -- 172.21.15.144:0/1553213268 learned_addr learned my addr 172.21.15.144:0/1553213268 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:59.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.241+0000 7f31df400640 1 --2- 172.21.15.144:0/1553213268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31e00cf5b0 0x7f31e00cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:59.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.241+0000 7f31dfe00640 1 --2- 172.21.15.144:0/1553213268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31e00ce230 0x7f31e0073bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:59.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.241+0000 7f31e4a00640 1 -- 172.21.15.144:0/1553213268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31e00cf5b0 msgr2=0x7f31e00cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:59.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.241+0000 7f31e4a00640 1 --2- 172.21.15.144:0/1553213268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31e00cf5b0 0x7f31e00cf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.241+0000 7f31e4a00640 1 -- 172.21.15.144:0/1553213268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31e00ce230 msgr2=0x7f31e0073bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:59.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.241+0000 7f31e4a00640 1 --2- 172.21.15.144:0/1553213268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31e00ce230 0x7f31e0073bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.241+0000 7f31e4a00640 1 -- 172.21.15.144:0/1553213268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e00ab1e0 con 0x7f31e015c180 2024-09-11T23:21:59.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.241+0000 7f31e4a00640 1 --2- 172.21.15.144:0/1553213268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31e015c180 0x7f31e00cff20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f31d800c400 tx=0x7f31d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:59.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.242+0000 7f31d7e00640 1 -- 172.21.15.144:0/1553213268 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d80074e0 con 0x7f31e015c180 2024-09-11T23:21:59.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.242+0000 7f31d7e00640 1 -- 172.21.15.144:0/1553213268 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d8007680 con 0x7f31e015c180 2024-09-11T23:21:59.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.242+0000 7f31d7e00640 1 -- 172.21.15.144:0/1553213268 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d80049e0 con 0x7f31e015c180 2024-09-11T23:21:59.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.242+0000 7f31e6a00640 1 -- 172.21.15.144:0/1553213268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e01600e0 con 0x7f31e015c180 2024-09-11T23:21:59.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.242+0000 7f31e6a00640 1 -- 172.21.15.144:0/1553213268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e0160680 con 0x7f31e015c180 2024-09-11T23:21:59.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.243+0000 7f31e6a00640 1 -- 172.21.15.144:0/1553213268 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31e00cf070 con 0x7f31e015c180 2024-09-11T23:21:59.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.244+0000 7f31d7e00640 1 -- 172.21.15.144:0/1553213268 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f31d801a020 con 0x7f31e015c180 2024-09-11T23:21:59.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.245+0000 7f31d7e00640 1 --2- 172.21.15.144:0/1553213268 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f31c006c190 0x7f31c006e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:59.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.245+0000 7f31d7e00640 1 -- 172.21.15.144:0/1553213268 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f31d808aaa0 con 0x7f31e015c180 2024-09-11T23:21:59.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.245+0000 7f31dfe00640 1 --2- 172.21.15.144:0/1553213268 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f31c006c190 0x7f31c006e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:59.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.246+0000 7f31dfe00640 1 --2- 172.21.15.144:0/1553213268 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f31c006c190 0x7f31c006e650 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f31e0156e70 tx=0x7f31d000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:59.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.249+0000 7f31d7e00640 1 -- 172.21.15.144:0/1553213268 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f31d80589b0 con 0x7f31e015c180 2024-09-11T23:21:59.407 INFO:tasks.ceph.mds.a.smithi144.stderr:2024-09-11T23:21:59.407+0000 7f98e0400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:21:59.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.419+0000 7f31e6a00640 1 -- 172.21.15.144:0/1553213268 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f31e0160b90 con 0x7f31c006c190 2024-09-11T23:21:59.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.425+0000 7f31d7e00640 1 -- 172.21.15.144:0/1553213268 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252031 (secure 0 0 0) 0x7f31e0160b90 con 0x7f31c006c190 2024-09-11T23:21:59.429 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:59.430 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:21:59.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.429+0000 7f31e6a00640 1 -- 172.21.15.144:0/1553213268 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f31c006c190 msgr2=0x7f31c006e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:59.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.429+0000 7f31e6a00640 1 --2- 172.21.15.144:0/1553213268 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f31c006c190 0x7f31c006e650 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f31e0156e70 tx=0x7f31d000b040 comp rx=0 tx=0).stop 2024-09-11T23:21:59.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.429+0000 7f31e6a00640 1 -- 172.21.15.144:0/1553213268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31e015c180 msgr2=0x7f31e00cff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:59.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.429+0000 7f31e6a00640 1 --2- 172.21.15.144:0/1553213268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31e015c180 0x7f31e00cff20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f31d800c400 tx=0x7f31d800c8c0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.430+0000 7f31e6a00640 1 -- 172.21.15.144:0/1553213268 shutdown_connections 2024-09-11T23:21:59.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.430+0000 7f31e6a00640 1 --2- 172.21.15.144:0/1553213268 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f31c006c190 0x7f31c006e650 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.430+0000 7f31e6a00640 1 --2- 172.21.15.144:0/1553213268 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31e015c180 0x7f31e00cff20 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.430+0000 7f31e6a00640 1 --2- 172.21.15.144:0/1553213268 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f31e00cf5b0 0x7f31e00cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.430+0000 7f31e6a00640 1 --2- 172.21.15.144:0/1553213268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31e00ce230 0x7f31e0073bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.430+0000 7f31e6a00640 1 -- 172.21.15.144:0/1553213268 >> 172.21.15.144:0/1553213268 conn(0x7f31e0062cc0 msgr2=0x7f31e006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:59.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.430+0000 7f31e6a00640 1 -- 172.21.15.144:0/1553213268 shutdown_connections 2024-09-11T23:21:59.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.430+0000 7f31e6a00640 1 -- 172.21.15.144:0/1553213268 wait complete. 2024-09-11T23:21:59.447 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-09-11T23:21:59.217642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249032,"kb_used_data":7816,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725688,"statfs":{"total":773094113280,"available":772839104512,"internally_reserved":0,"allocated":8003584,"data_stored":4016735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001173"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.477555+0000","last_change":"2024-09-11T23:21:54.474738+0000","last_active":"2024-09-11T23:21:54.477555+0000","last_peered":"2024-09-11T23:21:54.477555+0000","last_clean":"2024-09-11T23:21:54.477555+0000","last_became_active":"2024-09-11T23:21:54.474049+0000","last_became_peered":"2024-09-11T23:21:54.474049+0000","last_unstale":"2024-09-11T23:21:54.477555+0000","last_undegraded":"2024-09-11T23:21:54.477555+0000","last_fullsized":"2024-09-11T23:21:54.477555+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:58.260435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484862+0000","last_change":"2024-09-11T23:21:54.481578+0000","last_active":"2024-09-11T23:21:54.484862+0000","last_peered":"2024-09-11T23:21:54.484862+0000","last_clean":"2024-09-11T23:21:54.484862+0000","last_became_active":"2024-09-11T23:21:54.481187+0000","last_became_peered":"2024-09-11T23:21:54.481187+0000","last_unstale":"2024-09-11T23:21:54.484862+0000","last_undegraded":"2024-09-11T23:21:54.484862+0000","last_fullsized":"2024-09-11T23:21:54.484862+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:49.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510334+0000","last_change":"2024-09-11T23:21:54.470009+0000","last_active":"2024-09-11T23:21:55.510334+0000","last_peered":"2024-09-11T23:21:55.510334+0000","last_clean":"2024-09-11T23:21:55.510334+0000","last_became_active":"2024-09-11T23:21:54.469756+0000","last_became_peered":"2024-09-11T23:21:54.469756+0000","last_unstale":"2024-09-11T23:21:55.510334+0000","last_undegraded":"2024-09-11T23:21:55.510334+0000","last_fullsized":"2024-09-11T23:21:55.510334+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:08.754308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510890+0000","last_change":"2024-09-11T23:21:54.480235+0000","last_active":"2024-09-11T23:21:55.510890+0000","last_peered":"2024-09-11T23:21:55.510890+0000","last_clean":"2024-09-11T23:21:55.510890+0000","last_became_active":"2024-09-11T23:21:54.479917+0000","last_became_peered":"2024-09-11T23:21:54.479917+0000","last_unstale":"2024-09-11T23:21:55.510890+0000","last_undegraded":"2024-09-11T23:21:55.510890+0000","last_fullsized":"2024-09-11T23:21:55.510890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:30.000391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510498+0000","last_change":"2024-09-11T23:21:54.461649+0000","last_active":"2024-09-11T23:21:55.510498+0000","last_peered":"2024-09-11T23:21:55.510498+0000","last_clean":"2024-09-11T23:21:55.510498+0000","last_became_active":"2024-09-11T23:21:54.461362+0000","last_became_peered":"2024-09-11T23:21:54.461362+0000","last_unstale":"2024-09-11T23:21:55.510498+0000","last_undegraded":"2024-09-11T23:21:55.510498+0000","last_fullsized":"2024-09-11T23:21:55.510498+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:42.551507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.487121+0000","last_change":"2024-09-11T23:21:54.485019+0000","last_active":"2024-09-11T23:21:54.487121+0000","last_peered":"2024-09-11T23:21:54.487121+0000","last_clean":"2024-09-11T23:21:54.487121+0000","last_became_active":"2024-09-11T23:21:54.480801+0000","last_became_peered":"2024-09-11T23:21:54.480801+0000","last_unstale":"2024-09-11T23:21:54.487121+0000","last_undegraded":"2024-09-11T23:21:54.487121+0000","last_fullsized":"2024-09-11T23:21:54.487121+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:41.480085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.472797+0000","last_change":"2024-09-11T23:21:54.466747+0000","last_active":"2024-09-11T23:21:54.472797+0000","last_peered":"2024-09-11T23:21:54.472797+0000","last_clean":"2024-09-11T23:21:54.472797+0000","last_became_active":"2024-09-11T23:21:54.465374+0000","last_became_peered":"2024-09-11T23:21:54.465374+0000","last_unstale":"2024-09-11T23:21:54.472797+0000","last_undegraded":"2024-09-11T23:21:54.472797+0000","last_fullsized":"2024-09-11T23:21:54.472797+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:32.677344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484295+0000","last_change":"2024-09-11T23:21:54.476928+0000","last_active":"2024-09-11T23:21:54.484295+0000","last_peered":"2024-09-11T23:21:54.484295+0000","last_clean":"2024-09-11T23:21:54.484295+0000","last_became_active":"2024-09-11T23:21:54.476618+0000","last_became_peered":"2024-09-11T23:21:54.476618+0000","last_unstale":"2024-09-11T23:21:54.484295+0000","last_undegraded":"2024-09-11T23:21:54.484295+0000","last_fullsized":"2024-09-11T23:21:54.484295+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:59.116972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511740+0000","last_change":"2024-09-11T23:21:54.471369+0000","last_active":"2024-09-11T23:21:55.511740+0000","last_peered":"2024-09-11T23:21:55.511740+0000","last_clean":"2024-09-11T23:21:55.511740+0000","last_became_active":"2024-09-11T23:21:54.464703+0000","last_became_peered":"2024-09-11T23:21:54.464703+0000","last_unstale":"2024-09-11T23:21:55.511740+0000","last_undegraded":"2024-09-11T23:21:55.511740+0000","last_fullsized":"2024-09-11T23:21:55.511740+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:34.877955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.475017+0000","last_change":"2024-09-11T23:21:54.464693+0000","last_active":"2024-09-11T23:21:54.475017+0000","last_peered":"2024-09-11T23:21:54.475017+0000","last_clean":"2024-09-11T23:21:54.475017+0000","last_became_active":"2024-09-11T23:21:54.462500+0000","last_became_peered":"2024-09-11T23:21:54.462500+0000","last_unstale":"2024-09-11T23:21:54.475017+0000","last_undegraded":"2024-09-11T23:21:54.475017+0000","last_fullsized":"2024-09-11T23:21:54.475017+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:36.931095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.472510+0000","last_change":"2024-09-11T23:21:54.466244+0000","last_active":"2024-09-11T23:21:54.472510+0000","last_peered":"2024-09-11T23:21:54.472510+0000","last_clean":"2024-09-11T23:21:54.472510+0000","last_became_active":"2024-09-11T23:21:54.465979+0000","last_became_peered":"2024-09-11T23:21:54.465979+0000","last_unstale":"2024-09-11T23:21:54.472510+0000","last_undegraded":"2024-09-11T23:21:54.472510+0000","last_fullsized":"2024-09-11T23:21:54.472510+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:35.745599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510697+0000","last_change":"2024-09-11T23:21:54.466030+0000","last_active":"2024-09-11T23:21:55.510697+0000","last_peered":"2024-09-11T23:21:55.510697+0000","last_clean":"2024-09-11T23:21:55.510697+0000","last_became_active":"2024-09-11T23:21:54.465091+0000","last_became_peered":"2024-09-11T23:21:54.465091+0000","last_unstale":"2024-09-11T23:21:55.510697+0000","last_undegraded":"2024-09-11T23:21:55.510697+0000","last_fullsized":"2024-09-11T23:21:55.510697+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:15.952204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469152+0000","last_change":"2024-09-11T23:21:54.479207+0000","last_active":"2024-09-11T23:21:55.469152+0000","last_peered":"2024-09-11T23:21:55.469152+0000","last_clean":"2024-09-11T23:21:55.469152+0000","last_became_active":"2024-09-11T23:21:54.478793+0000","last_became_peered":"2024-09-11T23:21:54.478793+0000","last_unstale":"2024-09-11T23:21:55.469152+0000","last_undegraded":"2024-09-11T23:21:55.469152+0000","last_fullsized":"2024-09-11T23:21:55.469152+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:58.260435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511424+0000","last_change":"2024-09-11T23:21:54.457612+0000","last_active":"2024-09-11T23:21:55.511424+0000","last_peered":"2024-09-11T23:21:55.511424+0000","last_clean":"2024-09-11T23:21:55.511424+0000","last_became_active":"2024-09-11T23:21:54.457308+0000","last_became_peered":"2024-09-11T23:21:54.457308+0000","last_unstale":"2024-09-11T23:21:55.511424+0000","last_undegraded":"2024-09-11T23:21:55.511424+0000","last_fullsized":"2024-09-11T23:21:55.511424+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:38.495148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469082+0000","last_change":"2024-09-11T23:21:54.466512+0000","last_active":"2024-09-11T23:21:55.469082+0000","last_peered":"2024-09-11T23:21:55.469082+0000","last_clean":"2024-09-11T23:21:55.469082+0000","last_became_active":"2024-09-11T23:21:54.466223+0000","last_became_peered":"2024-09-11T23:21:54.466223+0000","last_unstale":"2024-09-11T23:21:55.469082+0000","last_undegraded":"2024-09-11T23:21:55.469082+0000","last_fullsized":"2024-09-11T23:21:55.469082+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:43.570690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.477344+0000","last_change":"2024-09-11T23:21:54.470918+0000","last_active":"2024-09-11T23:21:54.477344+0000","last_peered":"2024-09-11T23:21:54.477344+0000","last_clean":"2024-09-11T23:21:54.477344+0000","last_became_active":"2024-09-11T23:21:54.470555+0000","last_became_peered":"2024-09-11T23:21:54.470555+0000","last_unstale":"2024-09-11T23:21:54.477344+0000","last_undegraded":"2024-09-11T23:21:54.477344+0000","last_fullsized":"2024-09-11T23:21:54.477344+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:41.480085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511841+0000","last_change":"2024-09-11T23:21:54.469904+0000","last_active":"2024-09-11T23:21:55.511841+0000","last_peered":"2024-09-11T23:21:55.511841+0000","last_clean":"2024-09-11T23:21:55.511841+0000","last_became_active":"2024-09-11T23:21:54.463527+0000","last_became_peered":"2024-09-11T23:21:54.463527+0000","last_unstale":"2024-09-11T23:21:55.511841+0000","last_undegraded":"2024-09-11T23:21:55.511841+0000","last_fullsized":"2024-09-11T23:21:55.511841+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:35.897940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511283+0000","last_change":"2024-09-11T23:21:54.483488+0000","last_active":"2024-09-11T23:21:55.511283+0000","last_peered":"2024-09-11T23:21:55.511283+0000","last_clean":"2024-09-11T23:21:55.511283+0000","last_became_active":"2024-09-11T23:21:54.483157+0000","last_became_peered":"2024-09-11T23:21:54.483157+0000","last_unstale":"2024-09-11T23:21:55.511283+0000","last_undegraded":"2024-09-11T23:21:55.511283+0000","last_fullsized":"2024-09-11T23:21:55.511283+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:36.931095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484540+0000","last_change":"2024-09-11T23:21:54.476872+0000","last_active":"2024-09-11T23:21:54.484540+0000","last_peered":"2024-09-11T23:21:54.484540+0000","last_clean":"2024-09-11T23:21:54.484540+0000","last_became_active":"2024-09-11T23:21:54.476582+0000","last_became_peered":"2024-09-11T23:21:54.476582+0000","last_unstale":"2024-09-11T23:21:54.484540+0000","last_undegraded":"2024-09-11T23:21:54.484540+0000","last_fullsized":"2024-09-11T23:21:54.484540+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:30.000391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469196+0000","last_change":"2024-09-11T23:21:54.466500+0000","last_active":"2024-09-11T23:21:55.469196+0000","last_peered":"2024-09-11T23:21:55.469196+0000","last_clean":"2024-09-11T23:21:55.469196+0000","last_became_active":"2024-09-11T23:21:54.463536+0000","last_became_peered":"2024-09-11T23:21:54.463536+0000","last_unstale":"2024-09-11T23:21:55.469196+0000","last_undegraded":"2024-09-11T23:21:55.469196+0000","last_fullsized":"2024-09-11T23:21:55.469196+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:13.798720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.475117+0000","last_change":"2024-09-11T23:21:54.463114+0000","last_active":"2024-09-11T23:21:54.475117+0000","last_peered":"2024-09-11T23:21:54.475117+0000","last_clean":"2024-09-11T23:21:54.475117+0000","last_became_active":"2024-09-11T23:21:54.462251+0000","last_became_peered":"2024-09-11T23:21:54.462251+0000","last_unstale":"2024-09-11T23:21:54.475117+0000","last_undegraded":"2024-09-11T23:21:54.475117+0000","last_fullsized":"2024-09-11T23:21:54.475117+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:30.000391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.474984+0000","last_change":"2024-09-11T23:21:54.464400+0000","last_active":"2024-09-11T23:21:54.474984+0000","last_peered":"2024-09-11T23:21:54.474984+0000","last_clean":"2024-09-11T23:21:54.474984+0000","last_became_active":"2024-09-11T23:21:54.464075+0000","last_became_peered":"2024-09-11T23:21:54.464075+0000","last_unstale":"2024-09-11T23:21:54.474984+0000","last_undegraded":"2024-09-11T23:21:54.474984+0000","last_fullsized":"2024-09-11T23:21:54.474984+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:23.665399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.469554+0000","last_change":"2024-09-11T23:21:54.462809+0000","last_active":"2024-09-11T23:21:54.469554+0000","last_peered":"2024-09-11T23:21:54.469554+0000","last_clean":"2024-09-11T23:21:54.469554+0000","last_became_active":"2024-09-11T23:21:54.462548+0000","last_became_peered":"2024-09-11T23:21:54.462548+0000","last_unstale":"2024-09-11T23:21:54.469554+0000","last_undegraded":"2024-09-11T23:21:54.469554+0000","last_fullsized":"2024-09-11T23:21:54.469554+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:25.175924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.483329+0000","last_change":"2024-09-11T23:21:54.482141+0000","last_active":"2024-09-11T23:21:54.483329+0000","last_peered":"2024-09-11T23:21:54.483329+0000","last_clean":"2024-09-11T23:21:54.483329+0000","last_became_active":"2024-09-11T23:21:54.481848+0000","last_became_peered":"2024-09-11T23:21:54.481848+0000","last_unstale":"2024-09-11T23:21:54.483329+0000","last_undegraded":"2024-09-11T23:21:54.483329+0000","last_fullsized":"2024-09-11T23:21:54.483329+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:13.798720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.477131+0000","last_change":"2024-09-11T23:21:54.467818+0000","last_active":"2024-09-11T23:21:54.477131+0000","last_peered":"2024-09-11T23:21:54.477131+0000","last_clean":"2024-09-11T23:21:54.477131+0000","last_became_active":"2024-09-11T23:21:54.467486+0000","last_became_peered":"2024-09-11T23:21:54.467486+0000","last_unstale":"2024-09-11T23:21:54.477131+0000","last_undegraded":"2024-09-11T23:21:54.477131+0000","last_fullsized":"2024-09-11T23:21:54.477131+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:49.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.480935+0000","last_change":"2024-09-11T23:21:54.479693+0000","last_active":"2024-09-11T23:21:54.480935+0000","last_peered":"2024-09-11T23:21:54.480935+0000","last_clean":"2024-09-11T23:21:54.480935+0000","last_became_active":"2024-09-11T23:21:54.479390+0000","last_became_peered":"2024-09-11T23:21:54.479390+0000","last_unstale":"2024-09-11T23:21:54.480935+0000","last_undegraded":"2024-09-11T23:21:54.480935+0000","last_fullsized":"2024-09-11T23:21:54.480935+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:43.399494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510479+0000","last_change":"2024-09-11T23:21:54.472239+0000","last_active":"2024-09-11T23:21:55.510479+0000","last_peered":"2024-09-11T23:21:55.510479+0000","last_clean":"2024-09-11T23:21:55.510479+0000","last_became_active":"2024-09-11T23:21:54.472001+0000","last_became_peered":"2024-09-11T23:21:54.472001+0000","last_unstale":"2024-09-11T23:21:55.510479+0000","last_undegraded":"2024-09-11T23:21:55.510479+0000","last_fullsized":"2024-09-11T23:21:55.510479+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:52.276408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.475047+0000","last_change":"2024-09-11T23:21:54.462458+0000","last_active":"2024-09-11T23:21:54.475047+0000","last_peered":"2024-09-11T23:21:54.475047+0000","last_clean":"2024-09-11T23:21:54.475047+0000","last_became_active":"2024-09-11T23:21:54.462063+0000","last_became_peered":"2024-09-11T23:21:54.462063+0000","last_unstale":"2024-09-11T23:21:54.475047+0000","last_undegraded":"2024-09-11T23:21:54.475047+0000","last_fullsized":"2024-09-11T23:21:54.475047+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:14.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510385+0000","last_change":"2024-09-11T23:21:54.469786+0000","last_active":"2024-09-11T23:21:55.510385+0000","last_peered":"2024-09-11T23:21:55.510385+0000","last_clean":"2024-09-11T23:21:55.510385+0000","last_became_active":"2024-09-11T23:21:54.469466+0000","last_became_peered":"2024-09-11T23:21:54.469466+0000","last_unstale":"2024-09-11T23:21:55.510385+0000","last_undegraded":"2024-09-11T23:21:55.510385+0000","last_fullsized":"2024-09-11T23:21:55.510385+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:19.172926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.483602+0000","last_change":"2024-09-11T23:21:54.482128+0000","last_active":"2024-09-11T23:21:54.483602+0000","last_peered":"2024-09-11T23:21:54.483602+0000","last_clean":"2024-09-11T23:21:54.483602+0000","last_became_active":"2024-09-11T23:21:54.481785+0000","last_became_peered":"2024-09-11T23:21:54.481785+0000","last_unstale":"2024-09-11T23:21:54.483602+0000","last_undegraded":"2024-09-11T23:21:54.483602+0000","last_fullsized":"2024-09-11T23:21:54.483602+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:25.175924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.468892+0000","last_change":"2024-09-11T23:21:54.460206+0000","last_active":"2024-09-11T23:21:54.468892+0000","last_peered":"2024-09-11T23:21:54.468892+0000","last_clean":"2024-09-11T23:21:54.468892+0000","last_became_active":"2024-09-11T23:21:54.459460+0000","last_became_peered":"2024-09-11T23:21:54.459460+0000","last_unstale":"2024-09-11T23:21:54.468892+0000","last_undegraded":"2024-09-11T23:21:54.468892+0000","last_fullsized":"2024-09-11T23:21:54.468892+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:23.935572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484821+0000","last_change":"2024-09-11T23:21:54.480061+0000","last_active":"2024-09-11T23:21:54.484821+0000","last_peered":"2024-09-11T23:21:54.484821+0000","last_clean":"2024-09-11T23:21:54.484821+0000","last_became_active":"2024-09-11T23:21:54.478494+0000","last_became_peered":"2024-09-11T23:21:54.478494+0000","last_unstale":"2024-09-11T23:21:54.484821+0000","last_undegraded":"2024-09-11T23:21:54.484821+0000","last_fullsized":"2024-09-11T23:21:54.484821+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:36.931095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484750+0000","last_change":"2024-09-11T23:21:54.483670+0000","last_active":"2024-09-11T23:21:54.484750+0000","last_peered":"2024-09-11T23:21:54.484750+0000","last_clean":"2024-09-11T23:21:54.484750+0000","last_became_active":"2024-09-11T23:21:54.483430+0000","last_became_peered":"2024-09-11T23:21:54.483430+0000","last_unstale":"2024-09-11T23:21:54.484750+0000","last_undegraded":"2024-09-11T23:21:54.484750+0000","last_fullsized":"2024-09-11T23:21:54.484750+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:41.754162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"70'4","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.485136+0000","last_change":"2024-09-11T23:21:53.470991+0000","last_active":"2024-09-11T23:21:54.485136+0000","last_peered":"2024-09-11T23:21:54.485136+0000","last_clean":"2024-09-11T23:21:54.485136+0000","last_became_active":"2024-09-11T23:21:53.470699+0000","last_became_peered":"2024-09-11T23:21:53.470699+0000","last_unstale":"2024-09-11T23:21:54.485136+0000","last_undegraded":"2024-09-11T23:21:54.485136+0000","last_fullsized":"2024-09-11T23:21:54.485136+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:31.669192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511911+0000","last_change":"2024-09-11T23:21:54.465037+0000","last_active":"2024-09-11T23:21:55.511911+0000","last_peered":"2024-09-11T23:21:55.511911+0000","last_clean":"2024-09-11T23:21:55.511911+0000","last_became_active":"2024-09-11T23:21:54.463488+0000","last_became_peered":"2024-09-11T23:21:54.463488+0000","last_unstale":"2024-09-11T23:21:55.511911+0000","last_undegraded":"2024-09-11T23:21:55.511911+0000","last_fullsized":"2024-09-11T23:21:55.511911+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:41.375145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"70'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469489+0000","last_change":"2024-09-11T23:21:53.463711+0000","last_active":"2024-09-11T23:21:55.469489+0000","last_peered":"2024-09-11T23:21:55.469489+0000","last_clean":"2024-09-11T23:21:55.469489+0000","last_became_active":"2024-09-11T23:21:53.462741+0000","last_became_peered":"2024-09-11T23:21:53.462741+0000","last_unstale":"2024-09-11T23:21:55.469489+0000","last_undegraded":"2024-09-11T23:21:55.469489+0000","last_fullsized":"2024-09-11T23:21:55.469489+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:14.949860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.485009+0000","last_change":"2024-09-11T23:21:54.479264+0000","last_active":"2024-09-11T23:21:54.485009+0000","last_peered":"2024-09-11T23:21:54.485009+0000","last_clean":"2024-09-11T23:21:54.485009+0000","last_became_active":"2024-09-11T23:21:54.478939+0000","last_became_peered":"2024-09-11T23:21:54.478939+0000","last_unstale":"2024-09-11T23:21:54.485009+0000","last_undegraded":"2024-09-11T23:21:54.485009+0000","last_fullsized":"2024-09-11T23:21:54.485009+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:23.665399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.483010+0000","last_change":"2024-09-11T23:21:53.467522+0000","last_active":"2024-09-11T23:21:54.483010+0000","last_peered":"2024-09-11T23:21:54.483010+0000","last_clean":"2024-09-11T23:21:54.483010+0000","last_became_active":"2024-09-11T23:21:53.467218+0000","last_became_peered":"2024-09-11T23:21:53.467218+0000","last_unstale":"2024-09-11T23:21:54.483010+0000","last_undegraded":"2024-09-11T23:21:54.483010+0000","last_fullsized":"2024-09-11T23:21:54.483010+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:35.293491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.476547+0000","last_change":"2024-09-11T23:21:54.469492+0000","last_active":"2024-09-11T23:21:54.476547+0000","last_peered":"2024-09-11T23:21:54.476547+0000","last_clean":"2024-09-11T23:21:54.476547+0000","last_became_active":"2024-09-11T23:21:54.469040+0000","last_became_peered":"2024-09-11T23:21:54.469040+0000","last_unstale":"2024-09-11T23:21:54.476547+0000","last_undegraded":"2024-09-11T23:21:54.476547+0000","last_fullsized":"2024-09-11T23:21:54.476547+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:43.570690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.482717+0000","last_change":"2024-09-11T23:21:53.469697+0000","last_active":"2024-09-11T23:21:54.482717+0000","last_peered":"2024-09-11T23:21:54.482717+0000","last_clean":"2024-09-11T23:21:54.482717+0000","last_became_active":"2024-09-11T23:21:53.469365+0000","last_became_peered":"2024-09-11T23:21:53.469365+0000","last_unstale":"2024-09-11T23:21:54.482717+0000","last_undegraded":"2024-09-11T23:21:54.482717+0000","last_fullsized":"2024-09-11T23:21:54.482717+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:09.148570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.472886+0000","last_change":"2024-09-11T23:21:54.466699+0000","last_active":"2024-09-11T23:21:54.472886+0000","last_peered":"2024-09-11T23:21:54.472886+0000","last_clean":"2024-09-11T23:21:54.472886+0000","last_became_active":"2024-09-11T23:21:54.466400+0000","last_became_peered":"2024-09-11T23:21:54.466400+0000","last_unstale":"2024-09-11T23:21:54.472886+0000","last_undegraded":"2024-09-11T23:21:54.472886+0000","last_fullsized":"2024-09-11T23:21:54.472886+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:15.297748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"70'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510677+0000","last_change":"2024-09-11T23:21:53.473578+0000","last_active":"2024-09-11T23:21:55.510677+0000","last_peered":"2024-09-11T23:21:55.510677+0000","last_clean":"2024-09-11T23:21:55.510677+0000","last_became_active":"2024-09-11T23:21:53.473383+0000","last_became_peered":"2024-09-11T23:21:53.473383+0000","last_unstale":"2024-09-11T23:21:55.510677+0000","last_undegraded":"2024-09-11T23:21:55.510677+0000","last_fullsized":"2024-09-11T23:21:55.510677+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:12:49.284816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.475091+0000","last_change":"2024-09-11T23:21:54.462869+0000","last_active":"2024-09-11T23:21:54.475091+0000","last_peered":"2024-09-11T23:21:54.475091+0000","last_clean":"2024-09-11T23:21:54.475091+0000","last_became_active":"2024-09-11T23:21:54.461814+0000","last_became_peered":"2024-09-11T23:21:54.461814+0000","last_unstale":"2024-09-11T23:21:54.475091+0000","last_undegraded":"2024-09-11T23:21:54.475091+0000","last_fullsized":"2024-09-11T23:21:54.475091+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:15.952204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"70'1","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484899+0000","last_change":"2024-09-11T23:21:53.470378+0000","last_active":"2024-09-11T23:21:54.484899+0000","last_peered":"2024-09-11T23:21:54.484899+0000","last_clean":"2024-09-11T23:21:54.484899+0000","last_became_active":"2024-09-11T23:21:53.470047+0000","last_became_peered":"2024-09-11T23:21:53.470047+0000","last_unstale":"2024-09-11T23:21:54.484899+0000","last_undegraded":"2024-09-11T23:21:54.484899+0000","last_fullsized":"2024-09-11T23:21:54.484899+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:23.781101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510147+0000","last_change":"2024-09-11T23:21:54.457007+0000","last_active":"2024-09-11T23:21:55.510147+0000","last_peered":"2024-09-11T23:21:55.510147+0000","last_clean":"2024-09-11T23:21:55.510147+0000","last_became_active":"2024-09-11T23:21:54.456723+0000","last_became_peered":"2024-09-11T23:21:54.456723+0000","last_unstale":"2024-09-11T23:21:55.510147+0000","last_undegraded":"2024-09-11T23:21:55.510147+0000","last_fullsized":"2024-09-11T23:21:55.510147+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:55.914961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510634+0000","last_change":"2024-09-11T23:21:53.470324+0000","last_active":"2024-09-11T23:21:55.510634+0000","last_peered":"2024-09-11T23:21:55.510634+0000","last_clean":"2024-09-11T23:21:55.510634+0000","last_became_active":"2024-09-11T23:21:53.470034+0000","last_became_peered":"2024-09-11T23:21:53.470034+0000","last_unstale":"2024-09-11T23:21:55.510634+0000","last_undegraded":"2024-09-11T23:21:55.510634+0000","last_fullsized":"2024-09-11T23:21:55.510634+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:09.148570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469171+0000","last_change":"2024-09-11T23:21:54.472903+0000","last_active":"2024-09-11T23:21:55.469171+0000","last_peered":"2024-09-11T23:21:55.469171+0000","last_clean":"2024-09-11T23:21:55.469171+0000","last_became_active":"2024-09-11T23:21:54.472602+0000","last_became_peered":"2024-09-11T23:21:54.472602+0000","last_unstale":"2024-09-11T23:21:55.469171+0000","last_undegraded":"2024-09-11T23:21:55.469171+0000","last_fullsized":"2024-09-11T23:21:55.469171+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:07.418531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510193+0000","last_change":"2024-09-11T23:21:53.467541+0000","last_active":"2024-09-11T23:21:55.510193+0000","last_peered":"2024-09-11T23:21:55.510193+0000","last_clean":"2024-09-11T23:21:55.510193+0000","last_became_active":"2024-09-11T23:21:53.467140+0000","last_became_peered":"2024-09-11T23:21:53.467140+0000","last_unstale":"2024-09-11T23:21:55.510193+0000","last_undegraded":"2024-09-11T23:21:55.510193+0000","last_fullsized":"2024-09-11T23:21:55.510193+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:39.922294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.471131+0000","last_change":"2024-09-11T23:21:54.461750+0000","last_active":"2024-09-11T23:21:54.471131+0000","last_peered":"2024-09-11T23:21:54.471131+0000","last_clean":"2024-09-11T23:21:54.471131+0000","last_became_active":"2024-09-11T23:21:54.461419+0000","last_became_peered":"2024-09-11T23:21:54.461419+0000","last_unstale":"2024-09-11T23:21:54.471131+0000","last_undegraded":"2024-09-11T23:21:54.471131+0000","last_fullsized":"2024-09-11T23:21:54.471131+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:15.958011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.453347+0000","last_change":"2024-09-11T23:21:53.470446+0000","last_active":"2024-09-11T23:21:54.453347+0000","last_peered":"2024-09-11T23:21:54.453347+0000","last_clean":"2024-09-11T23:21:54.453347+0000","last_became_active":"2024-09-11T23:21:53.470036+0000","last_became_peered":"2024-09-11T23:21:53.470036+0000","last_unstale":"2024-09-11T23:21:54.453347+0000","last_undegraded":"2024-09-11T23:21:54.453347+0000","last_fullsized":"2024-09-11T23:21:54.453347+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:58.108821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.487552+0000","last_change":"2024-09-11T23:21:54.486905+0000","last_active":"2024-09-11T23:21:54.487552+0000","last_peered":"2024-09-11T23:21:54.487552+0000","last_clean":"2024-09-11T23:21:54.487552+0000","last_became_active":"2024-09-11T23:21:54.486173+0000","last_became_peered":"2024-09-11T23:21:54.486173+0000","last_unstale":"2024-09-11T23:21:54.487552+0000","last_undegraded":"2024-09-11T23:21:54.487552+0000","last_fullsized":"2024-09-11T23:21:54.487552+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:01.841438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.464940+0000","last_change":"2024-09-11T23:21:53.471148+0000","last_active":"2024-09-11T23:21:54.464940+0000","last_peered":"2024-09-11T23:21:54.464940+0000","last_clean":"2024-09-11T23:21:54.464940+0000","last_became_active":"2024-09-11T23:21:53.470383+0000","last_became_peered":"2024-09-11T23:21:53.470383+0000","last_unstale":"2024-09-11T23:21:54.464940+0000","last_undegraded":"2024-09-11T23:21:54.464940+0000","last_fullsized":"2024-09-11T23:21:54.464940+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:43.791393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484467+0000","last_change":"2024-09-11T23:21:54.478635+0000","last_active":"2024-09-11T23:21:54.484467+0000","last_peered":"2024-09-11T23:21:54.484467+0000","last_clean":"2024-09-11T23:21:54.484467+0000","last_became_active":"2024-09-11T23:21:54.476093+0000","last_became_peered":"2024-09-11T23:21:54.476093+0000","last_unstale":"2024-09-11T23:21:54.484467+0000","last_undegraded":"2024-09-11T23:21:54.484467+0000","last_fullsized":"2024-09-11T23:21:54.484467+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:15.952204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"70'3","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510700+0000","last_change":"2024-09-11T23:21:53.464476+0000","last_active":"2024-09-11T23:21:55.510700+0000","last_peered":"2024-09-11T23:21:55.510700+0000","last_clean":"2024-09-11T23:21:55.510700+0000","last_became_active":"2024-09-11T23:21:53.464218+0000","last_became_peered":"2024-09-11T23:21:53.464218+0000","last_unstale":"2024-09-11T23:21:55.510700+0000","last_undegraded":"2024-09-11T23:21:55.510700+0000","last_fullsized":"2024-09-11T23:21:55.510700+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:25.823473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510740+0000","last_change":"2024-09-11T23:21:54.465392+0000","last_active":"2024-09-11T23:21:55.510740+0000","last_peered":"2024-09-11T23:21:55.510740+0000","last_clean":"2024-09-11T23:21:55.510740+0000","last_became_active":"2024-09-11T23:21:54.464990+0000","last_became_peered":"2024-09-11T23:21:54.464990+0000","last_unstale":"2024-09-11T23:21:55.510740+0000","last_undegraded":"2024-09-11T23:21:55.510740+0000","last_fullsized":"2024-09-11T23:21:55.510740+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:26.896239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"70'6","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511020+0000","last_change":"2024-09-11T23:21:53.465308+0000","last_active":"2024-09-11T23:21:55.511020+0000","last_peered":"2024-09-11T23:21:55.511020+0000","last_clean":"2024-09-11T23:21:55.511020+0000","last_became_active":"2024-09-11T23:21:53.464677+0000","last_became_peered":"2024-09-11T23:21:53.464677+0000","last_unstale":"2024-09-11T23:21:55.511020+0000","last_undegraded":"2024-09-11T23:21:55.511020+0000","last_fullsized":"2024-09-11T23:21:55.511020+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:53.798999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.472595+0000","last_change":"2024-09-11T23:21:54.466748+0000","last_active":"2024-09-11T23:21:54.472595+0000","last_peered":"2024-09-11T23:21:54.472595+0000","last_clean":"2024-09-11T23:21:54.472595+0000","last_became_active":"2024-09-11T23:21:54.466494+0000","last_became_peered":"2024-09-11T23:21:54.466494+0000","last_unstale":"2024-09-11T23:21:54.472595+0000","last_undegraded":"2024-09-11T23:21:54.472595+0000","last_fullsized":"2024-09-11T23:21:54.472595+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:30.855528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"70'2","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511948+0000","last_change":"2024-09-11T23:21:53.467755+0000","last_active":"2024-09-11T23:21:55.511948+0000","last_peered":"2024-09-11T23:21:55.511948+0000","last_clean":"2024-09-11T23:21:55.511948+0000","last_became_active":"2024-09-11T23:21:53.467498+0000","last_became_peered":"2024-09-11T23:21:53.467498+0000","last_unstale":"2024-09-11T23:21:55.511948+0000","last_undegraded":"2024-09-11T23:21:55.511948+0000","last_fullsized":"2024-09-11T23:21:55.511948+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:43.791393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.467764+0000","last_change":"2024-09-11T23:21:54.460315+0000","last_active":"2024-09-11T23:21:54.467764+0000","last_peered":"2024-09-11T23:21:54.467764+0000","last_clean":"2024-09-11T23:21:54.467764+0000","last_became_active":"2024-09-11T23:21:54.459316+0000","last_became_peered":"2024-09-11T23:21:54.459316+0000","last_unstale":"2024-09-11T23:21:54.467764+0000","last_undegraded":"2024-09-11T23:21:54.467764+0000","last_fullsized":"2024-09-11T23:21:54.467764+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:40.941889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.465022+0000","last_change":"2024-09-11T23:21:53.470164+0000","last_active":"2024-09-11T23:21:54.465022+0000","last_peered":"2024-09-11T23:21:54.465022+0000","last_clean":"2024-09-11T23:21:54.465022+0000","last_became_active":"2024-09-11T23:21:53.469877+0000","last_became_peered":"2024-09-11T23:21:53.469877+0000","last_unstale":"2024-09-11T23:21:54.465022+0000","last_undegraded":"2024-09-11T23:21:54.465022+0000","last_fullsized":"2024-09-11T23:21:54.465022+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:53.798999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469000+0000","last_change":"2024-09-11T23:21:54.485032+0000","last_active":"2024-09-11T23:21:55.469000+0000","last_peered":"2024-09-11T23:21:55.469000+0000","last_clean":"2024-09-11T23:21:55.469000+0000","last_became_active":"2024-09-11T23:21:54.484723+0000","last_became_peered":"2024-09-11T23:21:54.484723+0000","last_unstale":"2024-09-11T23:21:55.469000+0000","last_undegraded":"2024-09-11T23:21:55.469000+0000","last_fullsized":"2024-09-11T23:21:55.469000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:30.855528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.452735+0000","last_change":"2024-09-11T23:21:53.462910+0000","last_active":"2024-09-11T23:21:54.452735+0000","last_peered":"2024-09-11T23:21:54.452735+0000","last_clean":"2024-09-11T23:21:54.452735+0000","last_became_active":"2024-09-11T23:21:53.462628+0000","last_became_peered":"2024-09-11T23:21:53.462628+0000","last_unstale":"2024-09-11T23:21:54.452735+0000","last_undegraded":"2024-09-11T23:21:54.452735+0000","last_fullsized":"2024-09-11T23:21:54.452735+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:03.790130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510349+0000","last_change":"2024-09-11T23:21:54.473219+0000","last_active":"2024-09-11T23:21:55.510349+0000","last_peered":"2024-09-11T23:21:55.510349+0000","last_clean":"2024-09-11T23:21:55.510349+0000","last_became_active":"2024-09-11T23:21:54.463830+0000","last_became_peered":"2024-09-11T23:21:54.463830+0000","last_unstale":"2024-09-11T23:21:55.510349+0000","last_undegraded":"2024-09-11T23:21:55.510349+0000","last_fullsized":"2024-09-11T23:21:55.510349+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:39.121272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"70'8","reported_seq":20,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.479207+0000","last_change":"2024-09-11T23:21:53.468168+0000","last_active":"2024-09-11T23:21:54.479207+0000","last_peered":"2024-09-11T23:21:54.479207+0000","last_clean":"2024-09-11T23:21:54.479207+0000","last_became_active":"2024-09-11T23:21:53.467519+0000","last_became_peered":"2024-09-11T23:21:53.467519+0000","last_unstale":"2024-09-11T23:21:54.479207+0000","last_undegraded":"2024-09-11T23:21:54.479207+0000","last_fullsized":"2024-09-11T23:21:54.479207+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:44.775322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.477628+0000","last_change":"2024-09-11T23:21:54.472550+0000","last_active":"2024-09-11T23:21:54.477628+0000","last_peered":"2024-09-11T23:21:54.477628+0000","last_clean":"2024-09-11T23:21:54.477628+0000","last_became_active":"2024-09-11T23:21:54.468734+0000","last_became_peered":"2024-09-11T23:21:54.468734+0000","last_unstale":"2024-09-11T23:21:54.477628+0000","last_undegraded":"2024-09-11T23:21:54.477628+0000","last_fullsized":"2024-09-11T23:21:54.477628+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:38.062064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"70'1","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484606+0000","last_change":"2024-09-11T23:21:53.468403+0000","last_active":"2024-09-11T23:21:54.484606+0000","last_peered":"2024-09-11T23:21:54.484606+0000","last_clean":"2024-09-11T23:21:54.484606+0000","last_became_active":"2024-09-11T23:21:53.468047+0000","last_became_peered":"2024-09-11T23:21:53.468047+0000","last_unstale":"2024-09-11T23:21:54.484606+0000","last_undegraded":"2024-09-11T23:21:54.484606+0000","last_fullsized":"2024-09-11T23:21:54.484606+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:20.530963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.477583+0000","last_change":"2024-09-11T23:21:54.475552+0000","last_active":"2024-09-11T23:21:54.477583+0000","last_peered":"2024-09-11T23:21:54.477583+0000","last_clean":"2024-09-11T23:21:54.477583+0000","last_became_active":"2024-09-11T23:21:54.472532+0000","last_became_peered":"2024-09-11T23:21:54.472532+0000","last_unstale":"2024-09-11T23:21:54.477583+0000","last_undegraded":"2024-09-11T23:21:54.477583+0000","last_fullsized":"2024-09-11T23:21:54.477583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:07.418531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.483008+0000","last_change":"2024-09-11T23:21:53.466954+0000","last_active":"2024-09-11T23:21:54.483008+0000","last_peered":"2024-09-11T23:21:54.483008+0000","last_clean":"2024-09-11T23:21:54.483008+0000","last_became_active":"2024-09-11T23:21:53.466633+0000","last_became_peered":"2024-09-11T23:21:53.466633+0000","last_unstale":"2024-09-11T23:21:54.483008+0000","last_undegraded":"2024-09-11T23:21:54.483008+0000","last_fullsized":"2024-09-11T23:21:54.483008+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:41.854885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511082+0000","last_change":"2024-09-11T23:21:54.470912+0000","last_active":"2024-09-11T23:21:55.511082+0000","last_peered":"2024-09-11T23:21:55.511082+0000","last_clean":"2024-09-11T23:21:55.511082+0000","last_became_active":"2024-09-11T23:21:54.464204+0000","last_became_peered":"2024-09-11T23:21:54.464204+0000","last_unstale":"2024-09-11T23:21:55.511082+0000","last_undegraded":"2024-09-11T23:21:55.511082+0000","last_fullsized":"2024-09-11T23:21:55.511082+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:23.665399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"70'1","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.481720+0000","last_change":"2024-09-11T23:21:53.474038+0000","last_active":"2024-09-11T23:21:54.481720+0000","last_peered":"2024-09-11T23:21:54.481720+0000","last_clean":"2024-09-11T23:21:54.481720+0000","last_became_active":"2024-09-11T23:21:53.473332+0000","last_became_peered":"2024-09-11T23:21:53.473332+0000","last_unstale":"2024-09-11T23:21:54.481720+0000","last_undegraded":"2024-09-11T23:21:54.481720+0000","last_fullsized":"2024-09-11T23:21:54.481720+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:41.854885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510906+0000","last_change":"2024-09-11T23:21:54.458222+0000","last_active":"2024-09-11T23:21:55.510906+0000","last_peered":"2024-09-11T23:21:55.510906+0000","last_clean":"2024-09-11T23:21:55.510906+0000","last_became_active":"2024-09-11T23:21:54.457957+0000","last_became_peered":"2024-09-11T23:21:54.457957+0000","last_unstale":"2024-09-11T23:21:55.510906+0000","last_undegraded":"2024-09-11T23:21:55.510906+0000","last_fullsized":"2024-09-11T23:21:55.510906+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:02.648965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.458366+0000","last_change":"2024-09-11T23:21:53.473759+0000","last_active":"2024-09-11T23:21:54.458366+0000","last_peered":"2024-09-11T23:21:54.458366+0000","last_clean":"2024-09-11T23:21:54.458366+0000","last_became_active":"2024-09-11T23:21:53.473476+0000","last_became_peered":"2024-09-11T23:21:53.473476+0000","last_unstale":"2024-09-11T23:21:54.458366+0000","last_undegraded":"2024-09-11T23:21:54.458366+0000","last_fullsized":"2024-09-11T23:21:54.458366+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:42.391343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510513+0000","last_change":"2024-09-11T23:21:54.473242+0000","last_active":"2024-09-11T23:21:55.510513+0000","last_peered":"2024-09-11T23:21:55.510513+0000","last_clean":"2024-09-11T23:21:55.510513+0000","last_became_active":"2024-09-11T23:21:54.473003+0000","last_became_peered":"2024-09-11T23:21:54.473003+0000","last_unstale":"2024-09-11T23:21:55.510513+0000","last_undegraded":"2024-09-11T23:21:55.510513+0000","last_fullsized":"2024-09-11T23:21:55.510513+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:33.461975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.464840+0000","last_change":"2024-09-11T23:21:53.473082+0000","last_active":"2024-09-11T23:21:54.464840+0000","last_peered":"2024-09-11T23:21:54.464840+0000","last_clean":"2024-09-11T23:21:54.464840+0000","last_became_active":"2024-09-11T23:21:53.472772+0000","last_became_peered":"2024-09-11T23:21:53.472772+0000","last_unstale":"2024-09-11T23:21:54.464840+0000","last_undegraded":"2024-09-11T23:21:54.464840+0000","last_fullsized":"2024-09-11T23:21:54.464840+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:02.766133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510206+0000","last_change":"2024-09-11T23:21:54.482280+0000","last_active":"2024-09-11T23:21:55.510206+0000","last_peered":"2024-09-11T23:21:55.510206+0000","last_clean":"2024-09-11T23:21:55.510206+0000","last_became_active":"2024-09-11T23:21:54.481977+0000","last_became_peered":"2024-09-11T23:21:54.481977+0000","last_unstale":"2024-09-11T23:21:55.510206+0000","last_undegraded":"2024-09-11T23:21:55.510206+0000","last_fullsized":"2024-09-11T23:21:55.510206+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:52.821654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.452910+0000","last_change":"2024-09-11T23:21:53.454657+0000","last_active":"2024-09-11T23:21:54.452910+0000","last_peered":"2024-09-11T23:21:54.452910+0000","last_clean":"2024-09-11T23:21:54.452910+0000","last_became_active":"2024-09-11T23:21:53.454348+0000","last_became_peered":"2024-09-11T23:21:53.454348+0000","last_unstale":"2024-09-11T23:21:54.452910+0000","last_undegraded":"2024-09-11T23:21:54.452910+0000","last_fullsized":"2024-09-11T23:21:54.452910+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:08.581853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510207+0000","last_change":"2024-09-11T23:21:54.482864+0000","last_active":"2024-09-11T23:21:55.510207+0000","last_peered":"2024-09-11T23:21:55.510207+0000","last_clean":"2024-09-11T23:21:55.510207+0000","last_became_active":"2024-09-11T23:21:54.482185+0000","last_became_peered":"2024-09-11T23:21:54.482185+0000","last_unstale":"2024-09-11T23:21:55.510207+0000","last_undegraded":"2024-09-11T23:21:55.510207+0000","last_fullsized":"2024-09-11T23:21:55.510207+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:28.808003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.468927+0000","last_change":"2024-09-11T23:21:53.463237+0000","last_active":"2024-09-11T23:21:55.468927+0000","last_peered":"2024-09-11T23:21:55.468927+0000","last_clean":"2024-09-11T23:21:55.468927+0000","last_became_active":"2024-09-11T23:21:53.462807+0000","last_became_peered":"2024-09-11T23:21:53.462807+0000","last_unstale":"2024-09-11T23:21:55.468927+0000","last_undegraded":"2024-09-11T23:21:55.468927+0000","last_fullsized":"2024-09-11T23:21:55.468927+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:39.933737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469402+0000","last_change":"2024-09-11T23:21:54.466743+0000","last_active":"2024-09-11T23:21:55.469402+0000","last_peered":"2024-09-11T23:21:55.469402+0000","last_clean":"2024-09-11T23:21:55.469402+0000","last_became_active":"2024-09-11T23:21:54.466490+0000","last_became_peered":"2024-09-11T23:21:54.466490+0000","last_unstale":"2024-09-11T23:21:55.469402+0000","last_undegraded":"2024-09-11T23:21:55.469402+0000","last_fullsized":"2024-09-11T23:21:55.469402+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:41.754162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484646+0000","last_change":"2024-09-11T23:21:53.467675+0000","last_active":"2024-09-11T23:21:54.484646+0000","last_peered":"2024-09-11T23:21:54.484646+0000","last_clean":"2024-09-11T23:21:54.484646+0000","last_became_active":"2024-09-11T23:21:53.467403+0000","last_became_peered":"2024-09-11T23:21:53.467403+0000","last_unstale":"2024-09-11T23:21:54.484646+0000","last_undegraded":"2024-09-11T23:21:54.484646+0000","last_fullsized":"2024-09-11T23:21:54.484646+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:35.293491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.472859+0000","last_change":"2024-09-11T23:21:54.466727+0000","last_active":"2024-09-11T23:21:54.472859+0000","last_peered":"2024-09-11T23:21:54.472859+0000","last_clean":"2024-09-11T23:21:54.472859+0000","last_became_active":"2024-09-11T23:21:54.465666+0000","last_became_peered":"2024-09-11T23:21:54.465666+0000","last_unstale":"2024-09-11T23:21:54.472859+0000","last_undegraded":"2024-09-11T23:21:54.472859+0000","last_fullsized":"2024-09-11T23:21:54.472859+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:42.311671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.453247+0000","last_change":"2024-09-11T23:21:53.461181+0000","last_active":"2024-09-11T23:21:54.453247+0000","last_peered":"2024-09-11T23:21:54.453247+0000","last_clean":"2024-09-11T23:21:54.453247+0000","last_became_active":"2024-09-11T23:21:53.460896+0000","last_became_peered":"2024-09-11T23:21:53.460896+0000","last_unstale":"2024-09-11T23:21:54.453247+0000","last_undegraded":"2024-09-11T23:21:54.453247+0000","last_fullsized":"2024-09-11T23:21:54.453247+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:04.612943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.487237+0000","last_change":"2024-09-11T23:21:54.485658+0000","last_active":"2024-09-11T23:21:54.487237+0000","last_peered":"2024-09-11T23:21:54.487237+0000","last_clean":"2024-09-11T23:21:54.487237+0000","last_became_active":"2024-09-11T23:21:54.485358+0000","last_became_peered":"2024-09-11T23:21:54.485358+0000","last_unstale":"2024-09-11T23:21:54.487237+0000","last_undegraded":"2024-09-11T23:21:54.487237+0000","last_fullsized":"2024-09-11T23:21:54.487237+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:03.450050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510956+0000","last_change":"2024-09-11T23:21:53.458342+0000","last_active":"2024-09-11T23:21:55.510956+0000","last_peered":"2024-09-11T23:21:55.510956+0000","last_clean":"2024-09-11T23:21:55.510956+0000","last_became_active":"2024-09-11T23:21:53.458058+0000","last_became_peered":"2024-09-11T23:21:53.458058+0000","last_unstale":"2024-09-11T23:21:55.510956+0000","last_undegraded":"2024-09-11T23:21:55.510956+0000","last_fullsized":"2024-09-11T23:21:55.510956+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:19.614803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.470934+0000","last_change":"2024-09-11T23:21:54.463652+0000","last_active":"2024-09-11T23:21:54.470934+0000","last_peered":"2024-09-11T23:21:54.470934+0000","last_clean":"2024-09-11T23:21:54.470934+0000","last_became_active":"2024-09-11T23:21:54.463110+0000","last_became_peered":"2024-09-11T23:21:54.463110+0000","last_unstale":"2024-09-11T23:21:54.470934+0000","last_undegraded":"2024-09-11T23:21:54.470934+0000","last_fullsized":"2024-09-11T23:21:54.470934+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:22.103012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469283+0000","last_change":"2024-09-11T23:21:53.466964+0000","last_active":"2024-09-11T23:21:55.469283+0000","last_peered":"2024-09-11T23:21:55.469283+0000","last_clean":"2024-09-11T23:21:55.469283+0000","last_became_active":"2024-09-11T23:21:53.466588+0000","last_became_peered":"2024-09-11T23:21:53.466588+0000","last_unstale":"2024-09-11T23:21:55.469283+0000","last_undegraded":"2024-09-11T23:21:55.469283+0000","last_fullsized":"2024-09-11T23:21:55.469283+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:22.927421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511492+0000","last_change":"2024-09-11T23:21:54.464965+0000","last_active":"2024-09-11T23:21:55.511492+0000","last_peered":"2024-09-11T23:21:55.511492+0000","last_clean":"2024-09-11T23:21:55.511492+0000","last_became_active":"2024-09-11T23:21:54.464691+0000","last_became_peered":"2024-09-11T23:21:54.464691+0000","last_unstale":"2024-09-11T23:21:55.511492+0000","last_undegraded":"2024-09-11T23:21:55.511492+0000","last_fullsized":"2024-09-11T23:21:55.511492+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:35.813966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510544+0000","last_change":"2024-09-11T23:21:53.455426+0000","last_active":"2024-09-11T23:21:55.510544+0000","last_peered":"2024-09-11T23:21:55.510544+0000","last_clean":"2024-09-11T23:21:55.510544+0000","last_became_active":"2024-09-11T23:21:53.454447+0000","last_became_peered":"2024-09-11T23:21:53.454447+0000","last_unstale":"2024-09-11T23:21:55.510544+0000","last_undegraded":"2024-09-11T23:21:55.510544+0000","last_fullsized":"2024-09-11T23:21:55.510544+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:24.893103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.485775+0000","last_change":"2024-09-11T23:21:54.477778+0000","last_active":"2024-09-11T23:21:54.485775+0000","last_peered":"2024-09-11T23:21:54.485775+0000","last_clean":"2024-09-11T23:21:54.485775+0000","last_became_active":"2024-09-11T23:21:54.475823+0000","last_became_peered":"2024-09-11T23:21:54.475823+0000","last_unstale":"2024-09-11T23:21:54.485775+0000","last_undegraded":"2024-09-11T23:21:54.485775+0000","last_fullsized":"2024-09-11T23:21:54.485775+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:14.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511056+0000","last_change":"2024-09-11T23:21:53.468442+0000","last_active":"2024-09-11T23:21:55.511056+0000","last_peered":"2024-09-11T23:21:55.511056+0000","last_clean":"2024-09-11T23:21:55.511056+0000","last_became_active":"2024-09-11T23:21:53.468181+0000","last_became_peered":"2024-09-11T23:21:53.468181+0000","last_unstale":"2024-09-11T23:21:55.511056+0000","last_undegraded":"2024-09-11T23:21:55.511056+0000","last_fullsized":"2024-09-11T23:21:55.511056+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:02.766133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511460+0000","last_change":"2024-09-11T23:21:54.468522+0000","last_active":"2024-09-11T23:21:55.511460+0000","last_peered":"2024-09-11T23:21:55.511460+0000","last_clean":"2024-09-11T23:21:55.511460+0000","last_became_active":"2024-09-11T23:21:54.468225+0000","last_became_peered":"2024-09-11T23:21:54.468225+0000","last_unstale":"2024-09-11T23:21:55.511460+0000","last_undegraded":"2024-09-11T23:21:55.511460+0000","last_fullsized":"2024-09-11T23:21:55.511460+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:49.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.452322+0000","last_change":"2024-09-11T23:21:53.470911+0000","last_active":"2024-09-11T23:21:54.452322+0000","last_peered":"2024-09-11T23:21:54.452322+0000","last_clean":"2024-09-11T23:21:54.452322+0000","last_became_active":"2024-09-11T23:21:53.469831+0000","last_became_peered":"2024-09-11T23:21:53.469831+0000","last_unstale":"2024-09-11T23:21:54.452322+0000","last_undegraded":"2024-09-11T23:21:54.452322+0000","last_fullsized":"2024-09-11T23:21:54.452322+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:20.530963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.481482+0000","last_change":"2024-09-11T23:21:54.470830+0000","last_active":"2024-09-11T23:21:54.481482+0000","last_peered":"2024-09-11T23:21:54.481482+0000","last_clean":"2024-09-11T23:21:54.481482+0000","last_became_active":"2024-09-11T23:21:54.470522+0000","last_became_peered":"2024-09-11T23:21:54.470522+0000","last_unstale":"2024-09-11T23:21:54.481482+0000","last_undegraded":"2024-09-11T23:21:54.481482+0000","last_fullsized":"2024-09-11T23:21:54.481482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:45.783474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.456914+0000","last_change":"2024-09-11T23:21:53.472150+0000","last_active":"2024-09-11T23:21:54.456914+0000","last_peered":"2024-09-11T23:21:54.456914+0000","last_clean":"2024-09-11T23:21:54.456914+0000","last_became_active":"2024-09-11T23:21:53.471468+0000","last_became_peered":"2024-09-11T23:21:53.471468+0000","last_unstale":"2024-09-11T23:21:54.456914+0000","last_undegraded":"2024-09-11T23:21:54.456914+0000","last_fullsized":"2024-09-11T23:21:54.456914+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:21.026252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510574+0000","last_change":"2024-09-11T23:21:54.486108+0000","last_active":"2024-09-11T23:21:55.510574+0000","last_peered":"2024-09-11T23:21:55.510574+0000","last_clean":"2024-09-11T23:21:55.510574+0000","last_became_active":"2024-09-11T23:21:54.485872+0000","last_became_peered":"2024-09-11T23:21:54.485872+0000","last_unstale":"2024-09-11T23:21:55.510574+0000","last_undegraded":"2024-09-11T23:21:55.510574+0000","last_fullsized":"2024-09-11T23:21:55.510574+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:06.750349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.482255+0000","last_change":"2024-09-11T23:21:53.470567+0000","last_active":"2024-09-11T23:21:54.482255+0000","last_peered":"2024-09-11T23:21:54.482255+0000","last_clean":"2024-09-11T23:21:54.482255+0000","last_became_active":"2024-09-11T23:21:53.470275+0000","last_became_peered":"2024-09-11T23:21:53.470275+0000","last_unstale":"2024-09-11T23:21:54.482255+0000","last_undegraded":"2024-09-11T23:21:54.482255+0000","last_fullsized":"2024-09-11T23:21:54.482255+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:11.566507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":261,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.460043+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:21:54.460043+0000","last_peered":"2024-09-11T23:21:54.460043+0000","last_clean":"2024-09-11T23:21:54.460043+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:21:54.460043+0000","last_undegraded":"2024-09-11T23:21:54.460043+0000","last_fullsized":"2024-09-11T23:21:54.460043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476790,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1441792,"data_stored":942587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476789,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":847872,"data_stored":351695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476788,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":843776,"data_stored":351693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476788,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":827392,"data_stored":344828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":872448,"data_stored":360131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509493,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1445888,"data_stored":948271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542197,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":860160,"data_stored":358015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542197,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":359515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:21:59.451 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T23:21:59.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.639+0000 7fd022a00640 1 Processor -- start 2024-09-11T23:21:59.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.639+0000 7fd022a00640 1 -- start start 2024-09-11T23:21:59.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.641+0000 7fd022a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd01c073830 0x7fd01c0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.641+0000 7fd022a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd01c0ce740 con 0x7fd01c15c180 2024-09-11T23:21:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.641+0000 7fd022a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd01c072640 con 0x7fd01c0cf070 2024-09-11T23:21:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.641+0000 7fd022a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd01c072920 con 0x7fd01c073830 2024-09-11T23:21:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.641+0000 7fd01be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd01c15c180 0x7fd01c0cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53378/0 (socket says 172.21.15.144:53378) 2024-09-11T23:21:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.641+0000 7fd01be00640 1 -- 172.21.15.144:0/3285858785 learned_addr learned my addr 172.21.15.144:0/3285858785 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:21:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.641+0000 7fd020a00640 1 --2- 172.21.15.144:0/3285858785 >> v2:172.21.15.165:3300/0 conn(0x7fd01c073830 0x7fd01c0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.641+0000 7fd01b400640 1 -- 172.21.15.144:0/3285858785 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2853426192 0 0) 0x7fd01c0ce740 con 0x7fd01c15c180 2024-09-11T23:21:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.641+0000 7fd01b400640 1 -- 172.21.15.144:0/3285858785 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd000003520 con 0x7fd01c15c180 2024-09-11T23:21:59.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.642+0000 7fd01b400640 1 -- 172.21.15.144:0/3285858785 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3170904951 0 0) 0x7fd000003520 con 0x7fd01c15c180 2024-09-11T23:21:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.642+0000 7fd01b400640 1 -- 172.21.15.144:0/3285858785 >> v2:172.21.15.165:3300/0 conn(0x7fd01c073830 msgr2=0x7fd01c0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.642+0000 7fd01b400640 1 --2- 172.21.15.144:0/3285858785 >> v2:172.21.15.165:3300/0 conn(0x7fd01c073830 0x7fd01c0cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.642+0000 7fd01b400640 1 -- 172.21.15.144:0/3285858785 >> v1:172.21.15.165:6789/0 conn(0x7fd01c0cf070 legacy=0x7fd01c073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.642+0000 7fd01b400640 1 -- 172.21.15.144:0/3285858785 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01c072c00 con 0x7fd01c15c180 2024-09-11T23:21:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.642+0000 7fd01b400640 1 -- 172.21.15.144:0/3285858785 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fd00c001670 con 0x7fd01c15c180 2024-09-11T23:21:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.642+0000 7fd01b400640 1 -- 172.21.15.144:0/3285858785 >> v1:172.21.15.144:6789/0 conn(0x7fd01c15c180 legacy=0x7fd01c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.642+0000 7fd01b400640 1 --2- 172.21.15.144:0/3285858785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0000039b0 0x7fd000003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.642+0000 7fd01b400640 1 --2- 172.21.15.144:0/3285858785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0000043b0 0x7fd000004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.642+0000 7fd01b400640 1 --2- 172.21.15.144:0/3285858785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd000005120 0x7fd00000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.642+0000 7fd01b400640 1 -- 172.21.15.144:0/3285858785 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c072920 con 0x7fd000005120 2024-09-11T23:21:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.642+0000 7fd01b400640 1 -- 172.21.15.144:0/3285858785 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd00000c060 con 0x7fd0000039b0 2024-09-11T23:21:59.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.642+0000 7fd01b400640 1 -- 172.21.15.144:0/3285858785 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd00000c260 con 0x7fd0000043b0 2024-09-11T23:21:59.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.642+0000 7fd020a00640 1 --2- 172.21.15.144:0/3285858785 >> v2:172.21.15.165:3300/0 conn(0x7fd01c073830 0x7fd01c0cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:21:59.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.642+0000 7fd020a00640 1 --2- 172.21.15.144:0/3285858785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd000005120 0x7fd00000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:59.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.642+0000 7fd01be00640 1 --2- 172.21.15.144:0/3285858785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0000039b0 0x7fd000003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:59.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.642+0000 7fd013400640 1 --2- 172.21.15.144:0/3285858785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0000043b0 0x7fd000004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:59.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.643+0000 7fd020a00640 1 -- 172.21.15.144:0/3285858785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0000043b0 msgr2=0x7fd000004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:59.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.643+0000 7fd020a00640 1 --2- 172.21.15.144:0/3285858785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd0000043b0 0x7fd000004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.643+0000 7fd020a00640 1 -- 172.21.15.144:0/3285858785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0000039b0 msgr2=0x7fd000003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:21:59.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.643+0000 7fd020a00640 1 --2- 172.21.15.144:0/3285858785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0000039b0 0x7fd000003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.643+0000 7fd020a00640 1 -- 172.21.15.144:0/3285858785 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd000003520 con 0x7fd000005120 2024-09-11T23:21:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.644+0000 7fd020a00640 1 -- 172.21.15.144:0/3285858785 reap_dead start 2024-09-11T23:21:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.644+0000 7fd020a00640 1 --2- 172.21.15.144:0/3285858785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd000005120 0x7fd00000b9c0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd01c0cfa20 tx=0x7fd000005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2abff770171c8586 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.644+0000 7fd01b400640 1 -- 172.21.15.144:0/3285858785 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd014009de0 con 0x7fd000005120 2024-09-11T23:21:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.644+0000 7fd01b400640 1 -- 172.21.15.144:0/3285858785 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd01402e610 con 0x7fd000005120 2024-09-11T23:21:59.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.644+0000 7fd01b400640 1 -- 172.21.15.144:0/3285858785 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01402ea00 con 0x7fd000005120 2024-09-11T23:21:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.644+0000 7fd022a00640 1 -- 172.21.15.144:0/3285858785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd000005120 msgr2=0x7fd00000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.644+0000 7fd022a00640 1 --2- 172.21.15.144:0/3285858785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd000005120 0x7fd00000b9c0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd01c0cfa20 tx=0x7fd000005830 comp rx=0 tx=0).stop 2024-09-11T23:21:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.644+0000 7fd022a00640 1 -- 172.21.15.144:0/3285858785 shutdown_connections 2024-09-11T23:21:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.644+0000 7fd022a00640 1 --2- 172.21.15.144:0/3285858785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd000005120 0x7fd00000b9c0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.644+0000 7fd022a00640 1 -- 172.21.15.144:0/3285858785 >> 172.21.15.144:0/3285858785 conn(0x7fd01c062cc0 msgr2=0x7fd01c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.645+0000 7fd022a00640 1 -- 172.21.15.144:0/3285858785 shutdown_connections 2024-09-11T23:21:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.645+0000 7fd022a00640 1 -- 172.21.15.144:0/3285858785 wait complete. 2024-09-11T23:21:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.646+0000 7fd022a00640 1 Processor -- start 2024-09-11T23:21:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.646+0000 7fd022a00640 1 -- start start 2024-09-11T23:21:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.647+0000 7fd022a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd000005120 0x7fd01c150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.647+0000 7fd022a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd01c0b16e0 0x7fd01c0b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.647+0000 7fd022a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd01c1537c0 0x7fd01c153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:59.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.647+0000 7fd022a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c15c560 con 0x7fd000005120 2024-09-11T23:21:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.647+0000 7fd022a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c0722f0 con 0x7fd01c0b16e0 2024-09-11T23:21:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.647+0000 7fd022a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd01c15c6e0 con 0x7fd01c1537c0 2024-09-11T23:21:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.647+0000 7fd01be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd000005120 0x7fd01c150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.647+0000 7fd01be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd000005120 0x7fd01c150230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33818/0 (socket says 172.21.15.144:33818) 2024-09-11T23:21:59.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.647+0000 7fd01be00640 1 -- 172.21.15.144:0/1846925172 learned_addr learned my addr 172.21.15.144:0/1846925172 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:21:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.648+0000 7fd020a00640 1 --2- 172.21.15.144:0/1846925172 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd01c1537c0 0x7fd01c153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.648+0000 7fd01be00640 1 -- 172.21.15.144:0/1846925172 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd01c1537c0 msgr2=0x7fd01c153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.648+0000 7fd013400640 1 --2- 172.21.15.144:0/1846925172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd01c0b16e0 0x7fd01c0b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.648+0000 7fd01be00640 1 --2- 172.21.15.144:0/1846925172 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd01c1537c0 0x7fd01c153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.648+0000 7fd01be00640 1 -- 172.21.15.144:0/1846925172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd01c0b16e0 msgr2=0x7fd01c0b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.648+0000 7fd01be00640 1 --2- 172.21.15.144:0/1846925172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd01c0b16e0 0x7fd01c0b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.648+0000 7fd01be00640 1 -- 172.21.15.144:0/1846925172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01c15e340 con 0x7fd000005120 2024-09-11T23:21:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.648+0000 7fd020a00640 1 --2- 172.21.15.144:0/1846925172 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd01c1537c0 0x7fd01c153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.648+0000 7fd013400640 1 --2- 172.21.15.144:0/1846925172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd01c0b16e0 0x7fd01c0b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:21:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.648+0000 7fd01be00640 1 --2- 172.21.15.144:0/1846925172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd000005120 0x7fd01c150230 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd00c004f70 tx=0x7fd00c0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.648+0000 7fd018c00640 1 -- 172.21.15.144:0/1846925172 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c01a070 con 0x7fd000005120 2024-09-11T23:21:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.648+0000 7fd018c00640 1 -- 172.21.15.144:0/1846925172 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd00c007740 con 0x7fd000005120 2024-09-11T23:21:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.648+0000 7fd018c00640 1 -- 172.21.15.144:0/1846925172 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c00fba0 con 0x7fd000005120 2024-09-11T23:21:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.648+0000 7fd022a00640 1 -- 172.21.15.144:0/1846925172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd01c1516c0 con 0x7fd000005120 2024-09-11T23:21:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.649+0000 7fd022a00640 1 -- 172.21.15.144:0/1846925172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd01c151f60 con 0x7fd000005120 2024-09-11T23:21:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.650+0000 7fd022a00640 1 -- 172.21.15.144:0/1846925172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd01c06d520 con 0x7fd000005120 2024-09-11T23:21:59.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.650+0000 7fd018c00640 1 -- 172.21.15.144:0/1846925172 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7fd00c01d070 con 0x7fd000005120 2024-09-11T23:21:59.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.651+0000 7fd018c00640 1 --2- 172.21.15.144:0/1846925172 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fcff806c190 0x7fcff806e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:21:59.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.651+0000 7fd018c00640 1 -- 172.21.15.144:0/1846925172 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7fd00c08abf0 con 0x7fd000005120 2024-09-11T23:21:59.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.651+0000 7fd013400640 1 --2- 172.21.15.144:0/1846925172 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fcff806c190 0x7fcff806e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:21:59.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.652+0000 7fd013400640 1 --2- 172.21.15.144:0/1846925172 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fcff806c190 0x7fcff806e650 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd01c0b2200 tx=0x7fd004009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:21:59.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.656+0000 7fd018c00640 1 -- 172.21.15.144:0/1846925172 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd01c06d520 con 0x7fd000005120 2024-09-11T23:21:59.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.898+0000 7fd022a00640 1 -- 172.21.15.144:0/1846925172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd01c0cf4e0 con 0x7fd000005120 2024-09-11T23:21:59.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.899+0000 7fd018c00640 1 -- 172.21.15.144:0/1846925172 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1475 (secure 0 0 0) 0x7fd00c059150 con 0x7fd000005120 2024-09-11T23:21:59.900 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:21:59.900 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":266,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":71,"num_osds":8,"num_up_osds":8,"osd_up_since":1726096669,"num_in_osds":8,"osd_in_since":1726096657,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":255008768,"bytes_avail":772839104512,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":46,"btime":"2024-09-11T23:21:57:477637+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":6093}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2024-09-11T23:21:35.213166+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T23:21:59.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.901+0000 7fd022a00640 1 -- 172.21.15.144:0/1846925172 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fcff806c190 msgr2=0x7fcff806e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:59.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.901+0000 7fd022a00640 1 --2- 172.21.15.144:0/1846925172 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fcff806c190 0x7fcff806e650 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd01c0b2200 tx=0x7fd004009040 comp rx=0 tx=0).stop 2024-09-11T23:21:59.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.901+0000 7fd022a00640 1 -- 172.21.15.144:0/1846925172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd000005120 msgr2=0x7fd01c150230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:21:59.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.901+0000 7fd022a00640 1 --2- 172.21.15.144:0/1846925172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd000005120 0x7fd01c150230 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd00c004f70 tx=0x7fd00c0074f0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.901+0000 7fd022a00640 1 -- 172.21.15.144:0/1846925172 shutdown_connections 2024-09-11T23:21:59.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.901+0000 7fd022a00640 1 --2- 172.21.15.144:0/1846925172 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fcff806c190 0x7fcff806e650 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.901+0000 7fd022a00640 1 --2- 172.21.15.144:0/1846925172 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd01c1537c0 0x7fd01c153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.901+0000 7fd022a00640 1 --2- 172.21.15.144:0/1846925172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd01c0b16e0 0x7fd01c0b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.901+0000 7fd022a00640 1 --2- 172.21.15.144:0/1846925172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd000005120 0x7fd01c150230 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:21:59.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.901+0000 7fd022a00640 1 -- 172.21.15.144:0/1846925172 >> 172.21.15.144:0/1846925172 conn(0x7fd01c062cc0 msgr2=0x7fd01c0cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:21:59.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.902+0000 7fd022a00640 1 -- 172.21.15.144:0/1846925172 shutdown_connections 2024-09-11T23:21:59.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:21:59.902+0000 7fd022a00640 1 -- 172.21.15.144:0/1846925172 wait complete. 2024-09-11T23:21:59.918 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T23:21:59.918 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:22:00.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.070+0000 7f18f6800640 1 Processor -- start 2024-09-11T23:22:00.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.070+0000 7f18f6800640 1 -- start start 2024-09-11T23:22:00.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.072+0000 7f18f6800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f18f00d02a0 0x7f18f00d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:00.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.072+0000 7f18f6800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18f00d0bc0 con 0x7f18f015ceb0 2024-09-11T23:22:00.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.072+0000 7f18f6800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18f015d390 con 0x7f18f015ca40 2024-09-11T23:22:00.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.072+0000 7f18f6800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f18f015d670 con 0x7f18f00d02a0 2024-09-11T23:22:00.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.072+0000 7f18efe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f18f015ceb0 0x7f18f01594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53384/0 (socket says 172.21.15.144:53384) 2024-09-11T23:22:00.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.072+0000 7f18efe00640 1 -- 172.21.15.144:0/2431717369 learned_addr learned my addr 172.21.15.144:0/2431717369 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:00.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.072+0000 7f18ef400640 1 --2- 172.21.15.144:0/2431717369 >> v2:172.21.15.165:3300/0 conn(0x7f18f00d02a0 0x7f18f00d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:00.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.072+0000 7f18eea00640 1 -- 172.21.15.144:0/2431717369 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2962084391 0 0) 0x7f18f00d0bc0 con 0x7f18f015ceb0 2024-09-11T23:22:00.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.072+0000 7f18eea00640 1 -- 172.21.15.144:0/2431717369 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18d4003520 con 0x7f18f015ceb0 2024-09-11T23:22:00.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.073+0000 7f18eea00640 1 -- 172.21.15.144:0/2431717369 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3146310143 0 0) 0x7f18d4003520 con 0x7f18f015ceb0 2024-09-11T23:22:00.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.073+0000 7f18ef400640 1 -- 172.21.15.144:0/2431717369 >> v1:172.21.15.165:6789/0 conn(0x7f18f015ca40 legacy=0x7f18f015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:00.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.073+0000 7f18ef400640 1 -- 172.21.15.144:0/2431717369 >> v1:172.21.15.144:6789/0 conn(0x7f18f015ceb0 legacy=0x7f18f01594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:00.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.073+0000 7f18ef400640 1 -- 172.21.15.144:0/2431717369 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f015d950 con 0x7f18f00d02a0 2024-09-11T23:22:00.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.074+0000 7f18ef400640 1 --2- 172.21.15.144:0/2431717369 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18f00d02a0 0x7f18f00d0680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f18e00097a0 tx=0x7f18e002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e5ec6dfe72acf9d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:00.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.074+0000 7f18eea00640 1 -- 172.21.15.144:0/2431717369 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e0037070 con 0x7f18f00d02a0 2024-09-11T23:22:00.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.074+0000 7f18eea00640 1 -- 172.21.15.144:0/2431717369 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e002abc0 con 0x7f18f00d02a0 2024-09-11T23:22:00.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.074+0000 7f18eea00640 1 -- 172.21.15.144:0/2431717369 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e80019f0 con 0x7f18f00d02a0 2024-09-11T23:22:00.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.075+0000 7f18f6800640 1 -- 172.21.15.144:0/2431717369 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18f00d02a0 msgr2=0x7f18f00d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:00.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.075+0000 7f18f6800640 1 --2- 172.21.15.144:0/2431717369 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18f00d02a0 0x7f18f00d0680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f18e00097a0 tx=0x7f18e002a130 comp rx=0 tx=0).stop 2024-09-11T23:22:00.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.075+0000 7f18f6800640 1 -- 172.21.15.144:0/2431717369 shutdown_connections 2024-09-11T23:22:00.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.075+0000 7f18f6800640 1 --2- 172.21.15.144:0/2431717369 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18f00d02a0 0x7f18f00d0680 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:00.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.075+0000 7f18f6800640 1 -- 172.21.15.144:0/2431717369 >> 172.21.15.144:0/2431717369 conn(0x7f18f0062cc0 msgr2=0x7f18f006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:00.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.075+0000 7f18f6800640 1 -- 172.21.15.144:0/2431717369 shutdown_connections 2024-09-11T23:22:00.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.075+0000 7f18f6800640 1 -- 172.21.15.144:0/2431717369 wait complete. 2024-09-11T23:22:00.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.076+0000 7f18f6800640 1 Processor -- start 2024-09-11T23:22:00.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.077+0000 7f18f6800640 1 -- start start 2024-09-11T23:22:00.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.077+0000 7f18f6800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18f00d02a0 0x7f18f0071a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:00.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.077+0000 7f18f6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18f015ca40 0x7f18f0145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:00.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.077+0000 7f18f6800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18f015ceb0 0x7f18f00cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:00.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.078+0000 7f18f6800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f18f015eb40 con 0x7f18f015ca40 2024-09-11T23:22:00.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.078+0000 7f18f6800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f18f015df10 con 0x7f18f015ceb0 2024-09-11T23:22:00.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.078+0000 7f18f6800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f18f0155b90 con 0x7f18f00d02a0 2024-09-11T23:22:00.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.078+0000 7f18e6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18f015ca40 0x7f18f0145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:00.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.078+0000 7f18e6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18f015ca40 0x7f18f0145d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33826/0 (socket says 172.21.15.144:33826) 2024-09-11T23:22:00.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.078+0000 7f18e6a00640 1 -- 172.21.15.144:0/1768855523 learned_addr learned my addr 172.21.15.144:0/1768855523 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:00.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.078+0000 7f18efe00640 1 --2- 172.21.15.144:0/1768855523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18f015ceb0 0x7f18f00cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:00.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.078+0000 7f18ef400640 1 --2- 172.21.15.144:0/1768855523 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18f00d02a0 0x7f18f0071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:00.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.078+0000 7f18e6a00640 1 -- 172.21.15.144:0/1768855523 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18f00d02a0 msgr2=0x7f18f0071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:00.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.078+0000 7f18e6a00640 1 --2- 172.21.15.144:0/1768855523 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18f00d02a0 0x7f18f0071a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.078+0000 7f18e6a00640 1 -- 172.21.15.144:0/1768855523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18f015ceb0 msgr2=0x7f18f00cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.078+0000 7f18e6a00640 1 --2- 172.21.15.144:0/1768855523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18f015ceb0 0x7f18f00cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.078+0000 7f18e6a00640 1 -- 172.21.15.144:0/1768855523 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f0072180 con 0x7f18f015ca40 2024-09-11T23:22:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.078+0000 7f18efe00640 1 --2- 172.21.15.144:0/1768855523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18f015ceb0 0x7f18f00cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.078+0000 7f18ef400640 1 --2- 172.21.15.144:0/1768855523 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18f00d02a0 0x7f18f0071a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.079+0000 7f18e6a00640 1 --2- 172.21.15.144:0/1768855523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18f015ca40 0x7f18f0145d00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f18d800c480 tx=0x7f18d800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.079+0000 7f18e7e00640 1 -- 172.21.15.144:0/1768855523 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d80052d0 con 0x7f18f015ca40 2024-09-11T23:22:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.079+0000 7f18e7e00640 1 -- 172.21.15.144:0/1768855523 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d8005470 con 0x7f18f015ca40 2024-09-11T23:22:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.079+0000 7f18e7e00640 1 -- 172.21.15.144:0/1768855523 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8012870 con 0x7f18f015ca40 2024-09-11T23:22:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.079+0000 7f18f6800640 1 -- 172.21.15.144:0/1768855523 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f0072460 con 0x7f18f015ca40 2024-09-11T23:22:00.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.079+0000 7f18f6800640 1 -- 172.21.15.144:0/1768855523 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f00b00c0 con 0x7f18f015ca40 2024-09-11T23:22:00.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.080+0000 7f18f6800640 1 -- 172.21.15.144:0/1768855523 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18f00b4790 con 0x7f18f015ca40 2024-09-11T23:22:00.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.081+0000 7f18e7e00640 1 -- 172.21.15.144:0/1768855523 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f18d8012a10 con 0x7f18f015ca40 2024-09-11T23:22:00.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.082+0000 7f18e7e00640 1 --2- 172.21.15.144:0/1768855523 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f18cc06c190 0x7f18cc06e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:00.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.082+0000 7f18e7e00640 1 -- 172.21.15.144:0/1768855523 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f18d808b190 con 0x7f18f015ca40 2024-09-11T23:22:00.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.082+0000 7f18ef400640 1 --2- 172.21.15.144:0/1768855523 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f18cc06c190 0x7f18cc06e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:00.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.083+0000 7f18ef400640 1 --2- 172.21.15.144:0/1768855523 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f18cc06c190 0x7f18cc06e650 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f18e0034000 tx=0x7f18e002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:00.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.086+0000 7f18e7e00640 1 -- 172.21.15.144:0/1768855523 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f18d80595f0 con 0x7f18f015ca40 2024-09-11T23:22:00.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.257+0000 7f18f6800640 1 -- 172.21.15.144:0/1768855523 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f18f00b5680 con 0x7f18cc06c190 2024-09-11T23:22:00.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.263+0000 7f18e7e00640 1 -- 172.21.15.144:0/1768855523 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252031 (secure 0 0 0) 0x7f18f00b5680 con 0x7f18cc06c190 2024-09-11T23:22:00.267 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:00.269 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:22:00.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.267+0000 7f18f6800640 1 -- 172.21.15.144:0/1768855523 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f18cc06c190 msgr2=0x7f18cc06e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:00.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.267+0000 7f18f6800640 1 --2- 172.21.15.144:0/1768855523 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f18cc06c190 0x7f18cc06e650 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f18e0034000 tx=0x7f18e002e000 comp rx=0 tx=0).stop 2024-09-11T23:22:00.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.267+0000 7f18f6800640 1 -- 172.21.15.144:0/1768855523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18f015ca40 msgr2=0x7f18f0145d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:00.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.267+0000 7f18f6800640 1 --2- 172.21.15.144:0/1768855523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18f015ca40 0x7f18f0145d00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f18d800c480 tx=0x7f18d800c940 comp rx=0 tx=0).stop 2024-09-11T23:22:00.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.267+0000 7f18f6800640 1 -- 172.21.15.144:0/1768855523 shutdown_connections 2024-09-11T23:22:00.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.267+0000 7f18f6800640 1 --2- 172.21.15.144:0/1768855523 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f18cc06c190 0x7f18cc06e650 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:00.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.267+0000 7f18f6800640 1 --2- 172.21.15.144:0/1768855523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18f015ceb0 0x7f18f00cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:00.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.267+0000 7f18f6800640 1 --2- 172.21.15.144:0/1768855523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18f015ca40 0x7f18f0145d00 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:00.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.267+0000 7f18f6800640 1 --2- 172.21.15.144:0/1768855523 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18f00d02a0 0x7f18f0071a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:00.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.267+0000 7f18f6800640 1 -- 172.21.15.144:0/1768855523 >> 172.21.15.144:0/1768855523 conn(0x7f18f0062cc0 msgr2=0x7f18f00b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:00.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.267+0000 7f18f6800640 1 -- 172.21.15.144:0/1768855523 shutdown_connections 2024-09-11T23:22:00.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:00.267+0000 7f18f6800640 1 -- 172.21.15.144:0/1768855523 wait complete. 2024-09-11T23:22:00.283 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-09-11T23:21:59.217642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249032,"kb_used_data":7816,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725688,"statfs":{"total":773094113280,"available":772839104512,"internally_reserved":0,"allocated":8003584,"data_stored":4016735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001173"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.477555+0000","last_change":"2024-09-11T23:21:54.474738+0000","last_active":"2024-09-11T23:21:54.477555+0000","last_peered":"2024-09-11T23:21:54.477555+0000","last_clean":"2024-09-11T23:21:54.477555+0000","last_became_active":"2024-09-11T23:21:54.474049+0000","last_became_peered":"2024-09-11T23:21:54.474049+0000","last_unstale":"2024-09-11T23:21:54.477555+0000","last_undegraded":"2024-09-11T23:21:54.477555+0000","last_fullsized":"2024-09-11T23:21:54.477555+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:58.260435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484862+0000","last_change":"2024-09-11T23:21:54.481578+0000","last_active":"2024-09-11T23:21:54.484862+0000","last_peered":"2024-09-11T23:21:54.484862+0000","last_clean":"2024-09-11T23:21:54.484862+0000","last_became_active":"2024-09-11T23:21:54.481187+0000","last_became_peered":"2024-09-11T23:21:54.481187+0000","last_unstale":"2024-09-11T23:21:54.484862+0000","last_undegraded":"2024-09-11T23:21:54.484862+0000","last_fullsized":"2024-09-11T23:21:54.484862+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:49.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510334+0000","last_change":"2024-09-11T23:21:54.470009+0000","last_active":"2024-09-11T23:21:55.510334+0000","last_peered":"2024-09-11T23:21:55.510334+0000","last_clean":"2024-09-11T23:21:55.510334+0000","last_became_active":"2024-09-11T23:21:54.469756+0000","last_became_peered":"2024-09-11T23:21:54.469756+0000","last_unstale":"2024-09-11T23:21:55.510334+0000","last_undegraded":"2024-09-11T23:21:55.510334+0000","last_fullsized":"2024-09-11T23:21:55.510334+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:08.754308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510890+0000","last_change":"2024-09-11T23:21:54.480235+0000","last_active":"2024-09-11T23:21:55.510890+0000","last_peered":"2024-09-11T23:21:55.510890+0000","last_clean":"2024-09-11T23:21:55.510890+0000","last_became_active":"2024-09-11T23:21:54.479917+0000","last_became_peered":"2024-09-11T23:21:54.479917+0000","last_unstale":"2024-09-11T23:21:55.510890+0000","last_undegraded":"2024-09-11T23:21:55.510890+0000","last_fullsized":"2024-09-11T23:21:55.510890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:30.000391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510498+0000","last_change":"2024-09-11T23:21:54.461649+0000","last_active":"2024-09-11T23:21:55.510498+0000","last_peered":"2024-09-11T23:21:55.510498+0000","last_clean":"2024-09-11T23:21:55.510498+0000","last_became_active":"2024-09-11T23:21:54.461362+0000","last_became_peered":"2024-09-11T23:21:54.461362+0000","last_unstale":"2024-09-11T23:21:55.510498+0000","last_undegraded":"2024-09-11T23:21:55.510498+0000","last_fullsized":"2024-09-11T23:21:55.510498+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:42.551507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.487121+0000","last_change":"2024-09-11T23:21:54.485019+0000","last_active":"2024-09-11T23:21:54.487121+0000","last_peered":"2024-09-11T23:21:54.487121+0000","last_clean":"2024-09-11T23:21:54.487121+0000","last_became_active":"2024-09-11T23:21:54.480801+0000","last_became_peered":"2024-09-11T23:21:54.480801+0000","last_unstale":"2024-09-11T23:21:54.487121+0000","last_undegraded":"2024-09-11T23:21:54.487121+0000","last_fullsized":"2024-09-11T23:21:54.487121+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:41.480085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.472797+0000","last_change":"2024-09-11T23:21:54.466747+0000","last_active":"2024-09-11T23:21:54.472797+0000","last_peered":"2024-09-11T23:21:54.472797+0000","last_clean":"2024-09-11T23:21:54.472797+0000","last_became_active":"2024-09-11T23:21:54.465374+0000","last_became_peered":"2024-09-11T23:21:54.465374+0000","last_unstale":"2024-09-11T23:21:54.472797+0000","last_undegraded":"2024-09-11T23:21:54.472797+0000","last_fullsized":"2024-09-11T23:21:54.472797+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:32.677344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484295+0000","last_change":"2024-09-11T23:21:54.476928+0000","last_active":"2024-09-11T23:21:54.484295+0000","last_peered":"2024-09-11T23:21:54.484295+0000","last_clean":"2024-09-11T23:21:54.484295+0000","last_became_active":"2024-09-11T23:21:54.476618+0000","last_became_peered":"2024-09-11T23:21:54.476618+0000","last_unstale":"2024-09-11T23:21:54.484295+0000","last_undegraded":"2024-09-11T23:21:54.484295+0000","last_fullsized":"2024-09-11T23:21:54.484295+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:59.116972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511740+0000","last_change":"2024-09-11T23:21:54.471369+0000","last_active":"2024-09-11T23:21:55.511740+0000","last_peered":"2024-09-11T23:21:55.511740+0000","last_clean":"2024-09-11T23:21:55.511740+0000","last_became_active":"2024-09-11T23:21:54.464703+0000","last_became_peered":"2024-09-11T23:21:54.464703+0000","last_unstale":"2024-09-11T23:21:55.511740+0000","last_undegraded":"2024-09-11T23:21:55.511740+0000","last_fullsized":"2024-09-11T23:21:55.511740+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:34.877955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.475017+0000","last_change":"2024-09-11T23:21:54.464693+0000","last_active":"2024-09-11T23:21:54.475017+0000","last_peered":"2024-09-11T23:21:54.475017+0000","last_clean":"2024-09-11T23:21:54.475017+0000","last_became_active":"2024-09-11T23:21:54.462500+0000","last_became_peered":"2024-09-11T23:21:54.462500+0000","last_unstale":"2024-09-11T23:21:54.475017+0000","last_undegraded":"2024-09-11T23:21:54.475017+0000","last_fullsized":"2024-09-11T23:21:54.475017+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:36.931095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.472510+0000","last_change":"2024-09-11T23:21:54.466244+0000","last_active":"2024-09-11T23:21:54.472510+0000","last_peered":"2024-09-11T23:21:54.472510+0000","last_clean":"2024-09-11T23:21:54.472510+0000","last_became_active":"2024-09-11T23:21:54.465979+0000","last_became_peered":"2024-09-11T23:21:54.465979+0000","last_unstale":"2024-09-11T23:21:54.472510+0000","last_undegraded":"2024-09-11T23:21:54.472510+0000","last_fullsized":"2024-09-11T23:21:54.472510+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:35.745599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510697+0000","last_change":"2024-09-11T23:21:54.466030+0000","last_active":"2024-09-11T23:21:55.510697+0000","last_peered":"2024-09-11T23:21:55.510697+0000","last_clean":"2024-09-11T23:21:55.510697+0000","last_became_active":"2024-09-11T23:21:54.465091+0000","last_became_peered":"2024-09-11T23:21:54.465091+0000","last_unstale":"2024-09-11T23:21:55.510697+0000","last_undegraded":"2024-09-11T23:21:55.510697+0000","last_fullsized":"2024-09-11T23:21:55.510697+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:15.952204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469152+0000","last_change":"2024-09-11T23:21:54.479207+0000","last_active":"2024-09-11T23:21:55.469152+0000","last_peered":"2024-09-11T23:21:55.469152+0000","last_clean":"2024-09-11T23:21:55.469152+0000","last_became_active":"2024-09-11T23:21:54.478793+0000","last_became_peered":"2024-09-11T23:21:54.478793+0000","last_unstale":"2024-09-11T23:21:55.469152+0000","last_undegraded":"2024-09-11T23:21:55.469152+0000","last_fullsized":"2024-09-11T23:21:55.469152+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:58.260435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511424+0000","last_change":"2024-09-11T23:21:54.457612+0000","last_active":"2024-09-11T23:21:55.511424+0000","last_peered":"2024-09-11T23:21:55.511424+0000","last_clean":"2024-09-11T23:21:55.511424+0000","last_became_active":"2024-09-11T23:21:54.457308+0000","last_became_peered":"2024-09-11T23:21:54.457308+0000","last_unstale":"2024-09-11T23:21:55.511424+0000","last_undegraded":"2024-09-11T23:21:55.511424+0000","last_fullsized":"2024-09-11T23:21:55.511424+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:38.495148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469082+0000","last_change":"2024-09-11T23:21:54.466512+0000","last_active":"2024-09-11T23:21:55.469082+0000","last_peered":"2024-09-11T23:21:55.469082+0000","last_clean":"2024-09-11T23:21:55.469082+0000","last_became_active":"2024-09-11T23:21:54.466223+0000","last_became_peered":"2024-09-11T23:21:54.466223+0000","last_unstale":"2024-09-11T23:21:55.469082+0000","last_undegraded":"2024-09-11T23:21:55.469082+0000","last_fullsized":"2024-09-11T23:21:55.469082+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:43.570690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.477344+0000","last_change":"2024-09-11T23:21:54.470918+0000","last_active":"2024-09-11T23:21:54.477344+0000","last_peered":"2024-09-11T23:21:54.477344+0000","last_clean":"2024-09-11T23:21:54.477344+0000","last_became_active":"2024-09-11T23:21:54.470555+0000","last_became_peered":"2024-09-11T23:21:54.470555+0000","last_unstale":"2024-09-11T23:21:54.477344+0000","last_undegraded":"2024-09-11T23:21:54.477344+0000","last_fullsized":"2024-09-11T23:21:54.477344+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:41.480085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511841+0000","last_change":"2024-09-11T23:21:54.469904+0000","last_active":"2024-09-11T23:21:55.511841+0000","last_peered":"2024-09-11T23:21:55.511841+0000","last_clean":"2024-09-11T23:21:55.511841+0000","last_became_active":"2024-09-11T23:21:54.463527+0000","last_became_peered":"2024-09-11T23:21:54.463527+0000","last_unstale":"2024-09-11T23:21:55.511841+0000","last_undegraded":"2024-09-11T23:21:55.511841+0000","last_fullsized":"2024-09-11T23:21:55.511841+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:35.897940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511283+0000","last_change":"2024-09-11T23:21:54.483488+0000","last_active":"2024-09-11T23:21:55.511283+0000","last_peered":"2024-09-11T23:21:55.511283+0000","last_clean":"2024-09-11T23:21:55.511283+0000","last_became_active":"2024-09-11T23:21:54.483157+0000","last_became_peered":"2024-09-11T23:21:54.483157+0000","last_unstale":"2024-09-11T23:21:55.511283+0000","last_undegraded":"2024-09-11T23:21:55.511283+0000","last_fullsized":"2024-09-11T23:21:55.511283+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:36.931095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484540+0000","last_change":"2024-09-11T23:21:54.476872+0000","last_active":"2024-09-11T23:21:54.484540+0000","last_peered":"2024-09-11T23:21:54.484540+0000","last_clean":"2024-09-11T23:21:54.484540+0000","last_became_active":"2024-09-11T23:21:54.476582+0000","last_became_peered":"2024-09-11T23:21:54.476582+0000","last_unstale":"2024-09-11T23:21:54.484540+0000","last_undegraded":"2024-09-11T23:21:54.484540+0000","last_fullsized":"2024-09-11T23:21:54.484540+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:30.000391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469196+0000","last_change":"2024-09-11T23:21:54.466500+0000","last_active":"2024-09-11T23:21:55.469196+0000","last_peered":"2024-09-11T23:21:55.469196+0000","last_clean":"2024-09-11T23:21:55.469196+0000","last_became_active":"2024-09-11T23:21:54.463536+0000","last_became_peered":"2024-09-11T23:21:54.463536+0000","last_unstale":"2024-09-11T23:21:55.469196+0000","last_undegraded":"2024-09-11T23:21:55.469196+0000","last_fullsized":"2024-09-11T23:21:55.469196+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:13.798720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.475117+0000","last_change":"2024-09-11T23:21:54.463114+0000","last_active":"2024-09-11T23:21:54.475117+0000","last_peered":"2024-09-11T23:21:54.475117+0000","last_clean":"2024-09-11T23:21:54.475117+0000","last_became_active":"2024-09-11T23:21:54.462251+0000","last_became_peered":"2024-09-11T23:21:54.462251+0000","last_unstale":"2024-09-11T23:21:54.475117+0000","last_undegraded":"2024-09-11T23:21:54.475117+0000","last_fullsized":"2024-09-11T23:21:54.475117+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:30.000391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.474984+0000","last_change":"2024-09-11T23:21:54.464400+0000","last_active":"2024-09-11T23:21:54.474984+0000","last_peered":"2024-09-11T23:21:54.474984+0000","last_clean":"2024-09-11T23:21:54.474984+0000","last_became_active":"2024-09-11T23:21:54.464075+0000","last_became_peered":"2024-09-11T23:21:54.464075+0000","last_unstale":"2024-09-11T23:21:54.474984+0000","last_undegraded":"2024-09-11T23:21:54.474984+0000","last_fullsized":"2024-09-11T23:21:54.474984+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:23.665399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.469554+0000","last_change":"2024-09-11T23:21:54.462809+0000","last_active":"2024-09-11T23:21:54.469554+0000","last_peered":"2024-09-11T23:21:54.469554+0000","last_clean":"2024-09-11T23:21:54.469554+0000","last_became_active":"2024-09-11T23:21:54.462548+0000","last_became_peered":"2024-09-11T23:21:54.462548+0000","last_unstale":"2024-09-11T23:21:54.469554+0000","last_undegraded":"2024-09-11T23:21:54.469554+0000","last_fullsized":"2024-09-11T23:21:54.469554+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:25.175924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.483329+0000","last_change":"2024-09-11T23:21:54.482141+0000","last_active":"2024-09-11T23:21:54.483329+0000","last_peered":"2024-09-11T23:21:54.483329+0000","last_clean":"2024-09-11T23:21:54.483329+0000","last_became_active":"2024-09-11T23:21:54.481848+0000","last_became_peered":"2024-09-11T23:21:54.481848+0000","last_unstale":"2024-09-11T23:21:54.483329+0000","last_undegraded":"2024-09-11T23:21:54.483329+0000","last_fullsized":"2024-09-11T23:21:54.483329+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:13.798720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.477131+0000","last_change":"2024-09-11T23:21:54.467818+0000","last_active":"2024-09-11T23:21:54.477131+0000","last_peered":"2024-09-11T23:21:54.477131+0000","last_clean":"2024-09-11T23:21:54.477131+0000","last_became_active":"2024-09-11T23:21:54.467486+0000","last_became_peered":"2024-09-11T23:21:54.467486+0000","last_unstale":"2024-09-11T23:21:54.477131+0000","last_undegraded":"2024-09-11T23:21:54.477131+0000","last_fullsized":"2024-09-11T23:21:54.477131+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:49.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.480935+0000","last_change":"2024-09-11T23:21:54.479693+0000","last_active":"2024-09-11T23:21:54.480935+0000","last_peered":"2024-09-11T23:21:54.480935+0000","last_clean":"2024-09-11T23:21:54.480935+0000","last_became_active":"2024-09-11T23:21:54.479390+0000","last_became_peered":"2024-09-11T23:21:54.479390+0000","last_unstale":"2024-09-11T23:21:54.480935+0000","last_undegraded":"2024-09-11T23:21:54.480935+0000","last_fullsized":"2024-09-11T23:21:54.480935+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:43.399494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510479+0000","last_change":"2024-09-11T23:21:54.472239+0000","last_active":"2024-09-11T23:21:55.510479+0000","last_peered":"2024-09-11T23:21:55.510479+0000","last_clean":"2024-09-11T23:21:55.510479+0000","last_became_active":"2024-09-11T23:21:54.472001+0000","last_became_peered":"2024-09-11T23:21:54.472001+0000","last_unstale":"2024-09-11T23:21:55.510479+0000","last_undegraded":"2024-09-11T23:21:55.510479+0000","last_fullsized":"2024-09-11T23:21:55.510479+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:52.276408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.475047+0000","last_change":"2024-09-11T23:21:54.462458+0000","last_active":"2024-09-11T23:21:54.475047+0000","last_peered":"2024-09-11T23:21:54.475047+0000","last_clean":"2024-09-11T23:21:54.475047+0000","last_became_active":"2024-09-11T23:21:54.462063+0000","last_became_peered":"2024-09-11T23:21:54.462063+0000","last_unstale":"2024-09-11T23:21:54.475047+0000","last_undegraded":"2024-09-11T23:21:54.475047+0000","last_fullsized":"2024-09-11T23:21:54.475047+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:14.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510385+0000","last_change":"2024-09-11T23:21:54.469786+0000","last_active":"2024-09-11T23:21:55.510385+0000","last_peered":"2024-09-11T23:21:55.510385+0000","last_clean":"2024-09-11T23:21:55.510385+0000","last_became_active":"2024-09-11T23:21:54.469466+0000","last_became_peered":"2024-09-11T23:21:54.469466+0000","last_unstale":"2024-09-11T23:21:55.510385+0000","last_undegraded":"2024-09-11T23:21:55.510385+0000","last_fullsized":"2024-09-11T23:21:55.510385+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:19.172926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.483602+0000","last_change":"2024-09-11T23:21:54.482128+0000","last_active":"2024-09-11T23:21:54.483602+0000","last_peered":"2024-09-11T23:21:54.483602+0000","last_clean":"2024-09-11T23:21:54.483602+0000","last_became_active":"2024-09-11T23:21:54.481785+0000","last_became_peered":"2024-09-11T23:21:54.481785+0000","last_unstale":"2024-09-11T23:21:54.483602+0000","last_undegraded":"2024-09-11T23:21:54.483602+0000","last_fullsized":"2024-09-11T23:21:54.483602+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:25.175924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.468892+0000","last_change":"2024-09-11T23:21:54.460206+0000","last_active":"2024-09-11T23:21:54.468892+0000","last_peered":"2024-09-11T23:21:54.468892+0000","last_clean":"2024-09-11T23:21:54.468892+0000","last_became_active":"2024-09-11T23:21:54.459460+0000","last_became_peered":"2024-09-11T23:21:54.459460+0000","last_unstale":"2024-09-11T23:21:54.468892+0000","last_undegraded":"2024-09-11T23:21:54.468892+0000","last_fullsized":"2024-09-11T23:21:54.468892+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:23.935572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484821+0000","last_change":"2024-09-11T23:21:54.480061+0000","last_active":"2024-09-11T23:21:54.484821+0000","last_peered":"2024-09-11T23:21:54.484821+0000","last_clean":"2024-09-11T23:21:54.484821+0000","last_became_active":"2024-09-11T23:21:54.478494+0000","last_became_peered":"2024-09-11T23:21:54.478494+0000","last_unstale":"2024-09-11T23:21:54.484821+0000","last_undegraded":"2024-09-11T23:21:54.484821+0000","last_fullsized":"2024-09-11T23:21:54.484821+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:36.931095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484750+0000","last_change":"2024-09-11T23:21:54.483670+0000","last_active":"2024-09-11T23:21:54.484750+0000","last_peered":"2024-09-11T23:21:54.484750+0000","last_clean":"2024-09-11T23:21:54.484750+0000","last_became_active":"2024-09-11T23:21:54.483430+0000","last_became_peered":"2024-09-11T23:21:54.483430+0000","last_unstale":"2024-09-11T23:21:54.484750+0000","last_undegraded":"2024-09-11T23:21:54.484750+0000","last_fullsized":"2024-09-11T23:21:54.484750+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:41.754162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"70'4","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.485136+0000","last_change":"2024-09-11T23:21:53.470991+0000","last_active":"2024-09-11T23:21:54.485136+0000","last_peered":"2024-09-11T23:21:54.485136+0000","last_clean":"2024-09-11T23:21:54.485136+0000","last_became_active":"2024-09-11T23:21:53.470699+0000","last_became_peered":"2024-09-11T23:21:53.470699+0000","last_unstale":"2024-09-11T23:21:54.485136+0000","last_undegraded":"2024-09-11T23:21:54.485136+0000","last_fullsized":"2024-09-11T23:21:54.485136+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:31.669192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511911+0000","last_change":"2024-09-11T23:21:54.465037+0000","last_active":"2024-09-11T23:21:55.511911+0000","last_peered":"2024-09-11T23:21:55.511911+0000","last_clean":"2024-09-11T23:21:55.511911+0000","last_became_active":"2024-09-11T23:21:54.463488+0000","last_became_peered":"2024-09-11T23:21:54.463488+0000","last_unstale":"2024-09-11T23:21:55.511911+0000","last_undegraded":"2024-09-11T23:21:55.511911+0000","last_fullsized":"2024-09-11T23:21:55.511911+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:41.375145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"70'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469489+0000","last_change":"2024-09-11T23:21:53.463711+0000","last_active":"2024-09-11T23:21:55.469489+0000","last_peered":"2024-09-11T23:21:55.469489+0000","last_clean":"2024-09-11T23:21:55.469489+0000","last_became_active":"2024-09-11T23:21:53.462741+0000","last_became_peered":"2024-09-11T23:21:53.462741+0000","last_unstale":"2024-09-11T23:21:55.469489+0000","last_undegraded":"2024-09-11T23:21:55.469489+0000","last_fullsized":"2024-09-11T23:21:55.469489+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:14.949860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.485009+0000","last_change":"2024-09-11T23:21:54.479264+0000","last_active":"2024-09-11T23:21:54.485009+0000","last_peered":"2024-09-11T23:21:54.485009+0000","last_clean":"2024-09-11T23:21:54.485009+0000","last_became_active":"2024-09-11T23:21:54.478939+0000","last_became_peered":"2024-09-11T23:21:54.478939+0000","last_unstale":"2024-09-11T23:21:54.485009+0000","last_undegraded":"2024-09-11T23:21:54.485009+0000","last_fullsized":"2024-09-11T23:21:54.485009+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:23.665399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.483010+0000","last_change":"2024-09-11T23:21:53.467522+0000","last_active":"2024-09-11T23:21:54.483010+0000","last_peered":"2024-09-11T23:21:54.483010+0000","last_clean":"2024-09-11T23:21:54.483010+0000","last_became_active":"2024-09-11T23:21:53.467218+0000","last_became_peered":"2024-09-11T23:21:53.467218+0000","last_unstale":"2024-09-11T23:21:54.483010+0000","last_undegraded":"2024-09-11T23:21:54.483010+0000","last_fullsized":"2024-09-11T23:21:54.483010+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:35.293491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.476547+0000","last_change":"2024-09-11T23:21:54.469492+0000","last_active":"2024-09-11T23:21:54.476547+0000","last_peered":"2024-09-11T23:21:54.476547+0000","last_clean":"2024-09-11T23:21:54.476547+0000","last_became_active":"2024-09-11T23:21:54.469040+0000","last_became_peered":"2024-09-11T23:21:54.469040+0000","last_unstale":"2024-09-11T23:21:54.476547+0000","last_undegraded":"2024-09-11T23:21:54.476547+0000","last_fullsized":"2024-09-11T23:21:54.476547+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:43.570690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.482717+0000","last_change":"2024-09-11T23:21:53.469697+0000","last_active":"2024-09-11T23:21:54.482717+0000","last_peered":"2024-09-11T23:21:54.482717+0000","last_clean":"2024-09-11T23:21:54.482717+0000","last_became_active":"2024-09-11T23:21:53.469365+0000","last_became_peered":"2024-09-11T23:21:53.469365+0000","last_unstale":"2024-09-11T23:21:54.482717+0000","last_undegraded":"2024-09-11T23:21:54.482717+0000","last_fullsized":"2024-09-11T23:21:54.482717+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:09.148570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.472886+0000","last_change":"2024-09-11T23:21:54.466699+0000","last_active":"2024-09-11T23:21:54.472886+0000","last_peered":"2024-09-11T23:21:54.472886+0000","last_clean":"2024-09-11T23:21:54.472886+0000","last_became_active":"2024-09-11T23:21:54.466400+0000","last_became_peered":"2024-09-11T23:21:54.466400+0000","last_unstale":"2024-09-11T23:21:54.472886+0000","last_undegraded":"2024-09-11T23:21:54.472886+0000","last_fullsized":"2024-09-11T23:21:54.472886+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:15.297748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"70'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510677+0000","last_change":"2024-09-11T23:21:53.473578+0000","last_active":"2024-09-11T23:21:55.510677+0000","last_peered":"2024-09-11T23:21:55.510677+0000","last_clean":"2024-09-11T23:21:55.510677+0000","last_became_active":"2024-09-11T23:21:53.473383+0000","last_became_peered":"2024-09-11T23:21:53.473383+0000","last_unstale":"2024-09-11T23:21:55.510677+0000","last_undegraded":"2024-09-11T23:21:55.510677+0000","last_fullsized":"2024-09-11T23:21:55.510677+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:12:49.284816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.475091+0000","last_change":"2024-09-11T23:21:54.462869+0000","last_active":"2024-09-11T23:21:54.475091+0000","last_peered":"2024-09-11T23:21:54.475091+0000","last_clean":"2024-09-11T23:21:54.475091+0000","last_became_active":"2024-09-11T23:21:54.461814+0000","last_became_peered":"2024-09-11T23:21:54.461814+0000","last_unstale":"2024-09-11T23:21:54.475091+0000","last_undegraded":"2024-09-11T23:21:54.475091+0000","last_fullsized":"2024-09-11T23:21:54.475091+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:15.952204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"70'1","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484899+0000","last_change":"2024-09-11T23:21:53.470378+0000","last_active":"2024-09-11T23:21:54.484899+0000","last_peered":"2024-09-11T23:21:54.484899+0000","last_clean":"2024-09-11T23:21:54.484899+0000","last_became_active":"2024-09-11T23:21:53.470047+0000","last_became_peered":"2024-09-11T23:21:53.470047+0000","last_unstale":"2024-09-11T23:21:54.484899+0000","last_undegraded":"2024-09-11T23:21:54.484899+0000","last_fullsized":"2024-09-11T23:21:54.484899+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:23.781101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510147+0000","last_change":"2024-09-11T23:21:54.457007+0000","last_active":"2024-09-11T23:21:55.510147+0000","last_peered":"2024-09-11T23:21:55.510147+0000","last_clean":"2024-09-11T23:21:55.510147+0000","last_became_active":"2024-09-11T23:21:54.456723+0000","last_became_peered":"2024-09-11T23:21:54.456723+0000","last_unstale":"2024-09-11T23:21:55.510147+0000","last_undegraded":"2024-09-11T23:21:55.510147+0000","last_fullsized":"2024-09-11T23:21:55.510147+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:55.914961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510634+0000","last_change":"2024-09-11T23:21:53.470324+0000","last_active":"2024-09-11T23:21:55.510634+0000","last_peered":"2024-09-11T23:21:55.510634+0000","last_clean":"2024-09-11T23:21:55.510634+0000","last_became_active":"2024-09-11T23:21:53.470034+0000","last_became_peered":"2024-09-11T23:21:53.470034+0000","last_unstale":"2024-09-11T23:21:55.510634+0000","last_undegraded":"2024-09-11T23:21:55.510634+0000","last_fullsized":"2024-09-11T23:21:55.510634+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:09.148570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469171+0000","last_change":"2024-09-11T23:21:54.472903+0000","last_active":"2024-09-11T23:21:55.469171+0000","last_peered":"2024-09-11T23:21:55.469171+0000","last_clean":"2024-09-11T23:21:55.469171+0000","last_became_active":"2024-09-11T23:21:54.472602+0000","last_became_peered":"2024-09-11T23:21:54.472602+0000","last_unstale":"2024-09-11T23:21:55.469171+0000","last_undegraded":"2024-09-11T23:21:55.469171+0000","last_fullsized":"2024-09-11T23:21:55.469171+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:07.418531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510193+0000","last_change":"2024-09-11T23:21:53.467541+0000","last_active":"2024-09-11T23:21:55.510193+0000","last_peered":"2024-09-11T23:21:55.510193+0000","last_clean":"2024-09-11T23:21:55.510193+0000","last_became_active":"2024-09-11T23:21:53.467140+0000","last_became_peered":"2024-09-11T23:21:53.467140+0000","last_unstale":"2024-09-11T23:21:55.510193+0000","last_undegraded":"2024-09-11T23:21:55.510193+0000","last_fullsized":"2024-09-11T23:21:55.510193+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:39.922294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.471131+0000","last_change":"2024-09-11T23:21:54.461750+0000","last_active":"2024-09-11T23:21:54.471131+0000","last_peered":"2024-09-11T23:21:54.471131+0000","last_clean":"2024-09-11T23:21:54.471131+0000","last_became_active":"2024-09-11T23:21:54.461419+0000","last_became_peered":"2024-09-11T23:21:54.461419+0000","last_unstale":"2024-09-11T23:21:54.471131+0000","last_undegraded":"2024-09-11T23:21:54.471131+0000","last_fullsized":"2024-09-11T23:21:54.471131+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:15.958011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.453347+0000","last_change":"2024-09-11T23:21:53.470446+0000","last_active":"2024-09-11T23:21:54.453347+0000","last_peered":"2024-09-11T23:21:54.453347+0000","last_clean":"2024-09-11T23:21:54.453347+0000","last_became_active":"2024-09-11T23:21:53.470036+0000","last_became_peered":"2024-09-11T23:21:53.470036+0000","last_unstale":"2024-09-11T23:21:54.453347+0000","last_undegraded":"2024-09-11T23:21:54.453347+0000","last_fullsized":"2024-09-11T23:21:54.453347+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:58.108821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.487552+0000","last_change":"2024-09-11T23:21:54.486905+0000","last_active":"2024-09-11T23:21:54.487552+0000","last_peered":"2024-09-11T23:21:54.487552+0000","last_clean":"2024-09-11T23:21:54.487552+0000","last_became_active":"2024-09-11T23:21:54.486173+0000","last_became_peered":"2024-09-11T23:21:54.486173+0000","last_unstale":"2024-09-11T23:21:54.487552+0000","last_undegraded":"2024-09-11T23:21:54.487552+0000","last_fullsized":"2024-09-11T23:21:54.487552+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:01.841438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.464940+0000","last_change":"2024-09-11T23:21:53.471148+0000","last_active":"2024-09-11T23:21:54.464940+0000","last_peered":"2024-09-11T23:21:54.464940+0000","last_clean":"2024-09-11T23:21:54.464940+0000","last_became_active":"2024-09-11T23:21:53.470383+0000","last_became_peered":"2024-09-11T23:21:53.470383+0000","last_unstale":"2024-09-11T23:21:54.464940+0000","last_undegraded":"2024-09-11T23:21:54.464940+0000","last_fullsized":"2024-09-11T23:21:54.464940+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:43.791393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484467+0000","last_change":"2024-09-11T23:21:54.478635+0000","last_active":"2024-09-11T23:21:54.484467+0000","last_peered":"2024-09-11T23:21:54.484467+0000","last_clean":"2024-09-11T23:21:54.484467+0000","last_became_active":"2024-09-11T23:21:54.476093+0000","last_became_peered":"2024-09-11T23:21:54.476093+0000","last_unstale":"2024-09-11T23:21:54.484467+0000","last_undegraded":"2024-09-11T23:21:54.484467+0000","last_fullsized":"2024-09-11T23:21:54.484467+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:15.952204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"70'3","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510700+0000","last_change":"2024-09-11T23:21:53.464476+0000","last_active":"2024-09-11T23:21:55.510700+0000","last_peered":"2024-09-11T23:21:55.510700+0000","last_clean":"2024-09-11T23:21:55.510700+0000","last_became_active":"2024-09-11T23:21:53.464218+0000","last_became_peered":"2024-09-11T23:21:53.464218+0000","last_unstale":"2024-09-11T23:21:55.510700+0000","last_undegraded":"2024-09-11T23:21:55.510700+0000","last_fullsized":"2024-09-11T23:21:55.510700+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:25.823473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510740+0000","last_change":"2024-09-11T23:21:54.465392+0000","last_active":"2024-09-11T23:21:55.510740+0000","last_peered":"2024-09-11T23:21:55.510740+0000","last_clean":"2024-09-11T23:21:55.510740+0000","last_became_active":"2024-09-11T23:21:54.464990+0000","last_became_peered":"2024-09-11T23:21:54.464990+0000","last_unstale":"2024-09-11T23:21:55.510740+0000","last_undegraded":"2024-09-11T23:21:55.510740+0000","last_fullsized":"2024-09-11T23:21:55.510740+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:26.896239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"70'6","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511020+0000","last_change":"2024-09-11T23:21:53.465308+0000","last_active":"2024-09-11T23:21:55.511020+0000","last_peered":"2024-09-11T23:21:55.511020+0000","last_clean":"2024-09-11T23:21:55.511020+0000","last_became_active":"2024-09-11T23:21:53.464677+0000","last_became_peered":"2024-09-11T23:21:53.464677+0000","last_unstale":"2024-09-11T23:21:55.511020+0000","last_undegraded":"2024-09-11T23:21:55.511020+0000","last_fullsized":"2024-09-11T23:21:55.511020+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:53.798999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.472595+0000","last_change":"2024-09-11T23:21:54.466748+0000","last_active":"2024-09-11T23:21:54.472595+0000","last_peered":"2024-09-11T23:21:54.472595+0000","last_clean":"2024-09-11T23:21:54.472595+0000","last_became_active":"2024-09-11T23:21:54.466494+0000","last_became_peered":"2024-09-11T23:21:54.466494+0000","last_unstale":"2024-09-11T23:21:54.472595+0000","last_undegraded":"2024-09-11T23:21:54.472595+0000","last_fullsized":"2024-09-11T23:21:54.472595+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:30.855528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"70'2","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511948+0000","last_change":"2024-09-11T23:21:53.467755+0000","last_active":"2024-09-11T23:21:55.511948+0000","last_peered":"2024-09-11T23:21:55.511948+0000","last_clean":"2024-09-11T23:21:55.511948+0000","last_became_active":"2024-09-11T23:21:53.467498+0000","last_became_peered":"2024-09-11T23:21:53.467498+0000","last_unstale":"2024-09-11T23:21:55.511948+0000","last_undegraded":"2024-09-11T23:21:55.511948+0000","last_fullsized":"2024-09-11T23:21:55.511948+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:43.791393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.467764+0000","last_change":"2024-09-11T23:21:54.460315+0000","last_active":"2024-09-11T23:21:54.467764+0000","last_peered":"2024-09-11T23:21:54.467764+0000","last_clean":"2024-09-11T23:21:54.467764+0000","last_became_active":"2024-09-11T23:21:54.459316+0000","last_became_peered":"2024-09-11T23:21:54.459316+0000","last_unstale":"2024-09-11T23:21:54.467764+0000","last_undegraded":"2024-09-11T23:21:54.467764+0000","last_fullsized":"2024-09-11T23:21:54.467764+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:40.941889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.465022+0000","last_change":"2024-09-11T23:21:53.470164+0000","last_active":"2024-09-11T23:21:54.465022+0000","last_peered":"2024-09-11T23:21:54.465022+0000","last_clean":"2024-09-11T23:21:54.465022+0000","last_became_active":"2024-09-11T23:21:53.469877+0000","last_became_peered":"2024-09-11T23:21:53.469877+0000","last_unstale":"2024-09-11T23:21:54.465022+0000","last_undegraded":"2024-09-11T23:21:54.465022+0000","last_fullsized":"2024-09-11T23:21:54.465022+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:53.798999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469000+0000","last_change":"2024-09-11T23:21:54.485032+0000","last_active":"2024-09-11T23:21:55.469000+0000","last_peered":"2024-09-11T23:21:55.469000+0000","last_clean":"2024-09-11T23:21:55.469000+0000","last_became_active":"2024-09-11T23:21:54.484723+0000","last_became_peered":"2024-09-11T23:21:54.484723+0000","last_unstale":"2024-09-11T23:21:55.469000+0000","last_undegraded":"2024-09-11T23:21:55.469000+0000","last_fullsized":"2024-09-11T23:21:55.469000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:30.855528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.452735+0000","last_change":"2024-09-11T23:21:53.462910+0000","last_active":"2024-09-11T23:21:54.452735+0000","last_peered":"2024-09-11T23:21:54.452735+0000","last_clean":"2024-09-11T23:21:54.452735+0000","last_became_active":"2024-09-11T23:21:53.462628+0000","last_became_peered":"2024-09-11T23:21:53.462628+0000","last_unstale":"2024-09-11T23:21:54.452735+0000","last_undegraded":"2024-09-11T23:21:54.452735+0000","last_fullsized":"2024-09-11T23:21:54.452735+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:03.790130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510349+0000","last_change":"2024-09-11T23:21:54.473219+0000","last_active":"2024-09-11T23:21:55.510349+0000","last_peered":"2024-09-11T23:21:55.510349+0000","last_clean":"2024-09-11T23:21:55.510349+0000","last_became_active":"2024-09-11T23:21:54.463830+0000","last_became_peered":"2024-09-11T23:21:54.463830+0000","last_unstale":"2024-09-11T23:21:55.510349+0000","last_undegraded":"2024-09-11T23:21:55.510349+0000","last_fullsized":"2024-09-11T23:21:55.510349+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:39.121272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"70'8","reported_seq":20,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.479207+0000","last_change":"2024-09-11T23:21:53.468168+0000","last_active":"2024-09-11T23:21:54.479207+0000","last_peered":"2024-09-11T23:21:54.479207+0000","last_clean":"2024-09-11T23:21:54.479207+0000","last_became_active":"2024-09-11T23:21:53.467519+0000","last_became_peered":"2024-09-11T23:21:53.467519+0000","last_unstale":"2024-09-11T23:21:54.479207+0000","last_undegraded":"2024-09-11T23:21:54.479207+0000","last_fullsized":"2024-09-11T23:21:54.479207+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:44.775322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.477628+0000","last_change":"2024-09-11T23:21:54.472550+0000","last_active":"2024-09-11T23:21:54.477628+0000","last_peered":"2024-09-11T23:21:54.477628+0000","last_clean":"2024-09-11T23:21:54.477628+0000","last_became_active":"2024-09-11T23:21:54.468734+0000","last_became_peered":"2024-09-11T23:21:54.468734+0000","last_unstale":"2024-09-11T23:21:54.477628+0000","last_undegraded":"2024-09-11T23:21:54.477628+0000","last_fullsized":"2024-09-11T23:21:54.477628+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:38.062064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"70'1","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484606+0000","last_change":"2024-09-11T23:21:53.468403+0000","last_active":"2024-09-11T23:21:54.484606+0000","last_peered":"2024-09-11T23:21:54.484606+0000","last_clean":"2024-09-11T23:21:54.484606+0000","last_became_active":"2024-09-11T23:21:53.468047+0000","last_became_peered":"2024-09-11T23:21:53.468047+0000","last_unstale":"2024-09-11T23:21:54.484606+0000","last_undegraded":"2024-09-11T23:21:54.484606+0000","last_fullsized":"2024-09-11T23:21:54.484606+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:20.530963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.477583+0000","last_change":"2024-09-11T23:21:54.475552+0000","last_active":"2024-09-11T23:21:54.477583+0000","last_peered":"2024-09-11T23:21:54.477583+0000","last_clean":"2024-09-11T23:21:54.477583+0000","last_became_active":"2024-09-11T23:21:54.472532+0000","last_became_peered":"2024-09-11T23:21:54.472532+0000","last_unstale":"2024-09-11T23:21:54.477583+0000","last_undegraded":"2024-09-11T23:21:54.477583+0000","last_fullsized":"2024-09-11T23:21:54.477583+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:07.418531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.483008+0000","last_change":"2024-09-11T23:21:53.466954+0000","last_active":"2024-09-11T23:21:54.483008+0000","last_peered":"2024-09-11T23:21:54.483008+0000","last_clean":"2024-09-11T23:21:54.483008+0000","last_became_active":"2024-09-11T23:21:53.466633+0000","last_became_peered":"2024-09-11T23:21:53.466633+0000","last_unstale":"2024-09-11T23:21:54.483008+0000","last_undegraded":"2024-09-11T23:21:54.483008+0000","last_fullsized":"2024-09-11T23:21:54.483008+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:41.854885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511082+0000","last_change":"2024-09-11T23:21:54.470912+0000","last_active":"2024-09-11T23:21:55.511082+0000","last_peered":"2024-09-11T23:21:55.511082+0000","last_clean":"2024-09-11T23:21:55.511082+0000","last_became_active":"2024-09-11T23:21:54.464204+0000","last_became_peered":"2024-09-11T23:21:54.464204+0000","last_unstale":"2024-09-11T23:21:55.511082+0000","last_undegraded":"2024-09-11T23:21:55.511082+0000","last_fullsized":"2024-09-11T23:21:55.511082+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:23.665399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"70'1","reported_seq":13,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.481720+0000","last_change":"2024-09-11T23:21:53.474038+0000","last_active":"2024-09-11T23:21:54.481720+0000","last_peered":"2024-09-11T23:21:54.481720+0000","last_clean":"2024-09-11T23:21:54.481720+0000","last_became_active":"2024-09-11T23:21:53.473332+0000","last_became_peered":"2024-09-11T23:21:53.473332+0000","last_unstale":"2024-09-11T23:21:54.481720+0000","last_undegraded":"2024-09-11T23:21:54.481720+0000","last_fullsized":"2024-09-11T23:21:54.481720+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:41.854885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510906+0000","last_change":"2024-09-11T23:21:54.458222+0000","last_active":"2024-09-11T23:21:55.510906+0000","last_peered":"2024-09-11T23:21:55.510906+0000","last_clean":"2024-09-11T23:21:55.510906+0000","last_became_active":"2024-09-11T23:21:54.457957+0000","last_became_peered":"2024-09-11T23:21:54.457957+0000","last_unstale":"2024-09-11T23:21:55.510906+0000","last_undegraded":"2024-09-11T23:21:55.510906+0000","last_fullsized":"2024-09-11T23:21:55.510906+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:02.648965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.458366+0000","last_change":"2024-09-11T23:21:53.473759+0000","last_active":"2024-09-11T23:21:54.458366+0000","last_peered":"2024-09-11T23:21:54.458366+0000","last_clean":"2024-09-11T23:21:54.458366+0000","last_became_active":"2024-09-11T23:21:53.473476+0000","last_became_peered":"2024-09-11T23:21:53.473476+0000","last_unstale":"2024-09-11T23:21:54.458366+0000","last_undegraded":"2024-09-11T23:21:54.458366+0000","last_fullsized":"2024-09-11T23:21:54.458366+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:42.391343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510513+0000","last_change":"2024-09-11T23:21:54.473242+0000","last_active":"2024-09-11T23:21:55.510513+0000","last_peered":"2024-09-11T23:21:55.510513+0000","last_clean":"2024-09-11T23:21:55.510513+0000","last_became_active":"2024-09-11T23:21:54.473003+0000","last_became_peered":"2024-09-11T23:21:54.473003+0000","last_unstale":"2024-09-11T23:21:55.510513+0000","last_undegraded":"2024-09-11T23:21:55.510513+0000","last_fullsized":"2024-09-11T23:21:55.510513+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:33.461975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.464840+0000","last_change":"2024-09-11T23:21:53.473082+0000","last_active":"2024-09-11T23:21:54.464840+0000","last_peered":"2024-09-11T23:21:54.464840+0000","last_clean":"2024-09-11T23:21:54.464840+0000","last_became_active":"2024-09-11T23:21:53.472772+0000","last_became_peered":"2024-09-11T23:21:53.472772+0000","last_unstale":"2024-09-11T23:21:54.464840+0000","last_undegraded":"2024-09-11T23:21:54.464840+0000","last_fullsized":"2024-09-11T23:21:54.464840+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:02.766133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510206+0000","last_change":"2024-09-11T23:21:54.482280+0000","last_active":"2024-09-11T23:21:55.510206+0000","last_peered":"2024-09-11T23:21:55.510206+0000","last_clean":"2024-09-11T23:21:55.510206+0000","last_became_active":"2024-09-11T23:21:54.481977+0000","last_became_peered":"2024-09-11T23:21:54.481977+0000","last_unstale":"2024-09-11T23:21:55.510206+0000","last_undegraded":"2024-09-11T23:21:55.510206+0000","last_fullsized":"2024-09-11T23:21:55.510206+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:52.821654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.452910+0000","last_change":"2024-09-11T23:21:53.454657+0000","last_active":"2024-09-11T23:21:54.452910+0000","last_peered":"2024-09-11T23:21:54.452910+0000","last_clean":"2024-09-11T23:21:54.452910+0000","last_became_active":"2024-09-11T23:21:53.454348+0000","last_became_peered":"2024-09-11T23:21:53.454348+0000","last_unstale":"2024-09-11T23:21:54.452910+0000","last_undegraded":"2024-09-11T23:21:54.452910+0000","last_fullsized":"2024-09-11T23:21:54.452910+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:08.581853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510207+0000","last_change":"2024-09-11T23:21:54.482864+0000","last_active":"2024-09-11T23:21:55.510207+0000","last_peered":"2024-09-11T23:21:55.510207+0000","last_clean":"2024-09-11T23:21:55.510207+0000","last_became_active":"2024-09-11T23:21:54.482185+0000","last_became_peered":"2024-09-11T23:21:54.482185+0000","last_unstale":"2024-09-11T23:21:55.510207+0000","last_undegraded":"2024-09-11T23:21:55.510207+0000","last_fullsized":"2024-09-11T23:21:55.510207+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:28.808003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.468927+0000","last_change":"2024-09-11T23:21:53.463237+0000","last_active":"2024-09-11T23:21:55.468927+0000","last_peered":"2024-09-11T23:21:55.468927+0000","last_clean":"2024-09-11T23:21:55.468927+0000","last_became_active":"2024-09-11T23:21:53.462807+0000","last_became_peered":"2024-09-11T23:21:53.462807+0000","last_unstale":"2024-09-11T23:21:55.468927+0000","last_undegraded":"2024-09-11T23:21:55.468927+0000","last_fullsized":"2024-09-11T23:21:55.468927+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:39.933737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469402+0000","last_change":"2024-09-11T23:21:54.466743+0000","last_active":"2024-09-11T23:21:55.469402+0000","last_peered":"2024-09-11T23:21:55.469402+0000","last_clean":"2024-09-11T23:21:55.469402+0000","last_became_active":"2024-09-11T23:21:54.466490+0000","last_became_peered":"2024-09-11T23:21:54.466490+0000","last_unstale":"2024-09-11T23:21:55.469402+0000","last_undegraded":"2024-09-11T23:21:55.469402+0000","last_fullsized":"2024-09-11T23:21:55.469402+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:41.754162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.484646+0000","last_change":"2024-09-11T23:21:53.467675+0000","last_active":"2024-09-11T23:21:54.484646+0000","last_peered":"2024-09-11T23:21:54.484646+0000","last_clean":"2024-09-11T23:21:54.484646+0000","last_became_active":"2024-09-11T23:21:53.467403+0000","last_became_peered":"2024-09-11T23:21:53.467403+0000","last_unstale":"2024-09-11T23:21:54.484646+0000","last_undegraded":"2024-09-11T23:21:54.484646+0000","last_fullsized":"2024-09-11T23:21:54.484646+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:35.293491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.472859+0000","last_change":"2024-09-11T23:21:54.466727+0000","last_active":"2024-09-11T23:21:54.472859+0000","last_peered":"2024-09-11T23:21:54.472859+0000","last_clean":"2024-09-11T23:21:54.472859+0000","last_became_active":"2024-09-11T23:21:54.465666+0000","last_became_peered":"2024-09-11T23:21:54.465666+0000","last_unstale":"2024-09-11T23:21:54.472859+0000","last_undegraded":"2024-09-11T23:21:54.472859+0000","last_fullsized":"2024-09-11T23:21:54.472859+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:42.311671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.453247+0000","last_change":"2024-09-11T23:21:53.461181+0000","last_active":"2024-09-11T23:21:54.453247+0000","last_peered":"2024-09-11T23:21:54.453247+0000","last_clean":"2024-09-11T23:21:54.453247+0000","last_became_active":"2024-09-11T23:21:53.460896+0000","last_became_peered":"2024-09-11T23:21:53.460896+0000","last_unstale":"2024-09-11T23:21:54.453247+0000","last_undegraded":"2024-09-11T23:21:54.453247+0000","last_fullsized":"2024-09-11T23:21:54.453247+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:04.612943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.487237+0000","last_change":"2024-09-11T23:21:54.485658+0000","last_active":"2024-09-11T23:21:54.487237+0000","last_peered":"2024-09-11T23:21:54.487237+0000","last_clean":"2024-09-11T23:21:54.487237+0000","last_became_active":"2024-09-11T23:21:54.485358+0000","last_became_peered":"2024-09-11T23:21:54.485358+0000","last_unstale":"2024-09-11T23:21:54.487237+0000","last_undegraded":"2024-09-11T23:21:54.487237+0000","last_fullsized":"2024-09-11T23:21:54.487237+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:03.450050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510956+0000","last_change":"2024-09-11T23:21:53.458342+0000","last_active":"2024-09-11T23:21:55.510956+0000","last_peered":"2024-09-11T23:21:55.510956+0000","last_clean":"2024-09-11T23:21:55.510956+0000","last_became_active":"2024-09-11T23:21:53.458058+0000","last_became_peered":"2024-09-11T23:21:53.458058+0000","last_unstale":"2024-09-11T23:21:55.510956+0000","last_undegraded":"2024-09-11T23:21:55.510956+0000","last_fullsized":"2024-09-11T23:21:55.510956+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:19.614803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.470934+0000","last_change":"2024-09-11T23:21:54.463652+0000","last_active":"2024-09-11T23:21:54.470934+0000","last_peered":"2024-09-11T23:21:54.470934+0000","last_clean":"2024-09-11T23:21:54.470934+0000","last_became_active":"2024-09-11T23:21:54.463110+0000","last_became_peered":"2024-09-11T23:21:54.463110+0000","last_unstale":"2024-09-11T23:21:54.470934+0000","last_undegraded":"2024-09-11T23:21:54.470934+0000","last_fullsized":"2024-09-11T23:21:54.470934+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:22.103012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469283+0000","last_change":"2024-09-11T23:21:53.466964+0000","last_active":"2024-09-11T23:21:55.469283+0000","last_peered":"2024-09-11T23:21:55.469283+0000","last_clean":"2024-09-11T23:21:55.469283+0000","last_became_active":"2024-09-11T23:21:53.466588+0000","last_became_peered":"2024-09-11T23:21:53.466588+0000","last_unstale":"2024-09-11T23:21:55.469283+0000","last_undegraded":"2024-09-11T23:21:55.469283+0000","last_fullsized":"2024-09-11T23:21:55.469283+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:22.927421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511492+0000","last_change":"2024-09-11T23:21:54.464965+0000","last_active":"2024-09-11T23:21:55.511492+0000","last_peered":"2024-09-11T23:21:55.511492+0000","last_clean":"2024-09-11T23:21:55.511492+0000","last_became_active":"2024-09-11T23:21:54.464691+0000","last_became_peered":"2024-09-11T23:21:54.464691+0000","last_unstale":"2024-09-11T23:21:55.511492+0000","last_undegraded":"2024-09-11T23:21:55.511492+0000","last_fullsized":"2024-09-11T23:21:55.511492+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:35.813966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510544+0000","last_change":"2024-09-11T23:21:53.455426+0000","last_active":"2024-09-11T23:21:55.510544+0000","last_peered":"2024-09-11T23:21:55.510544+0000","last_clean":"2024-09-11T23:21:55.510544+0000","last_became_active":"2024-09-11T23:21:53.454447+0000","last_became_peered":"2024-09-11T23:21:53.454447+0000","last_unstale":"2024-09-11T23:21:55.510544+0000","last_undegraded":"2024-09-11T23:21:55.510544+0000","last_fullsized":"2024-09-11T23:21:55.510544+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:24.893103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.485775+0000","last_change":"2024-09-11T23:21:54.477778+0000","last_active":"2024-09-11T23:21:54.485775+0000","last_peered":"2024-09-11T23:21:54.485775+0000","last_clean":"2024-09-11T23:21:54.485775+0000","last_became_active":"2024-09-11T23:21:54.475823+0000","last_became_peered":"2024-09-11T23:21:54.475823+0000","last_unstale":"2024-09-11T23:21:54.485775+0000","last_undegraded":"2024-09-11T23:21:54.485775+0000","last_fullsized":"2024-09-11T23:21:54.485775+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:14.905046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511056+0000","last_change":"2024-09-11T23:21:53.468442+0000","last_active":"2024-09-11T23:21:55.511056+0000","last_peered":"2024-09-11T23:21:55.511056+0000","last_clean":"2024-09-11T23:21:55.511056+0000","last_became_active":"2024-09-11T23:21:53.468181+0000","last_became_peered":"2024-09-11T23:21:53.468181+0000","last_unstale":"2024-09-11T23:21:55.511056+0000","last_undegraded":"2024-09-11T23:21:55.511056+0000","last_fullsized":"2024-09-11T23:21:55.511056+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:02.766133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511460+0000","last_change":"2024-09-11T23:21:54.468522+0000","last_active":"2024-09-11T23:21:55.511460+0000","last_peered":"2024-09-11T23:21:55.511460+0000","last_clean":"2024-09-11T23:21:55.511460+0000","last_became_active":"2024-09-11T23:21:54.468225+0000","last_became_peered":"2024-09-11T23:21:54.468225+0000","last_unstale":"2024-09-11T23:21:55.511460+0000","last_undegraded":"2024-09-11T23:21:55.511460+0000","last_fullsized":"2024-09-11T23:21:55.511460+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:49.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.452322+0000","last_change":"2024-09-11T23:21:53.470911+0000","last_active":"2024-09-11T23:21:54.452322+0000","last_peered":"2024-09-11T23:21:54.452322+0000","last_clean":"2024-09-11T23:21:54.452322+0000","last_became_active":"2024-09-11T23:21:53.469831+0000","last_became_peered":"2024-09-11T23:21:53.469831+0000","last_unstale":"2024-09-11T23:21:54.452322+0000","last_undegraded":"2024-09-11T23:21:54.452322+0000","last_fullsized":"2024-09-11T23:21:54.452322+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:20.530963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.481482+0000","last_change":"2024-09-11T23:21:54.470830+0000","last_active":"2024-09-11T23:21:54.481482+0000","last_peered":"2024-09-11T23:21:54.481482+0000","last_clean":"2024-09-11T23:21:54.481482+0000","last_became_active":"2024-09-11T23:21:54.470522+0000","last_became_peered":"2024-09-11T23:21:54.470522+0000","last_unstale":"2024-09-11T23:21:54.481482+0000","last_undegraded":"2024-09-11T23:21:54.481482+0000","last_fullsized":"2024-09-11T23:21:54.481482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:45.783474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.456914+0000","last_change":"2024-09-11T23:21:53.472150+0000","last_active":"2024-09-11T23:21:54.456914+0000","last_peered":"2024-09-11T23:21:54.456914+0000","last_clean":"2024-09-11T23:21:54.456914+0000","last_became_active":"2024-09-11T23:21:53.471468+0000","last_became_peered":"2024-09-11T23:21:53.471468+0000","last_unstale":"2024-09-11T23:21:54.456914+0000","last_undegraded":"2024-09-11T23:21:54.456914+0000","last_fullsized":"2024-09-11T23:21:54.456914+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:21.026252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510574+0000","last_change":"2024-09-11T23:21:54.486108+0000","last_active":"2024-09-11T23:21:55.510574+0000","last_peered":"2024-09-11T23:21:55.510574+0000","last_clean":"2024-09-11T23:21:55.510574+0000","last_became_active":"2024-09-11T23:21:54.485872+0000","last_became_peered":"2024-09-11T23:21:54.485872+0000","last_unstale":"2024-09-11T23:21:55.510574+0000","last_undegraded":"2024-09-11T23:21:55.510574+0000","last_fullsized":"2024-09-11T23:21:55.510574+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:06.750349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"70'2","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.482255+0000","last_change":"2024-09-11T23:21:53.470567+0000","last_active":"2024-09-11T23:21:54.482255+0000","last_peered":"2024-09-11T23:21:54.482255+0000","last_clean":"2024-09-11T23:21:54.482255+0000","last_became_active":"2024-09-11T23:21:53.470275+0000","last_became_peered":"2024-09-11T23:21:53.470275+0000","last_unstale":"2024-09-11T23:21:54.482255+0000","last_undegraded":"2024-09-11T23:21:54.482255+0000","last_fullsized":"2024-09-11T23:21:54.482255+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:11.566507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":261,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-11T23:21:54.460043+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:21:54.460043+0000","last_peered":"2024-09-11T23:21:54.460043+0000","last_clean":"2024-09-11T23:21:54.460043+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:21:54.460043+0000","last_undegraded":"2024-09-11T23:21:54.460043+0000","last_fullsized":"2024-09-11T23:21:54.460043+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476790,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1441792,"data_stored":942587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476789,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":847872,"data_stored":351695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476788,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":843776,"data_stored":351693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476788,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":827392,"data_stored":344828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":872448,"data_stored":360131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509493,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1445888,"data_stored":948271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542197,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":860160,"data_stored":358015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542197,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":359515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:22:03.288 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:22:03.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.454+0000 7f2f89800640 1 Processor -- start 2024-09-11T23:22:03.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.454+0000 7f2f89800640 1 -- start start 2024-09-11T23:22:03.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.456+0000 7f2f89800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2f8415e640 0x7f2f840d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:03.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.456+0000 7f2f89800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f840d3f60 0x7f2f840b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:03.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.456+0000 7f2f89800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2f840b6510 0x7f2f840d27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:03.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.456+0000 7f2f89800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2f8415ea20 con 0x7f2f840b6510 2024-09-11T23:22:03.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.456+0000 7f2f89800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2f8406caf0 con 0x7f2f8415e640 2024-09-11T23:22:03.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.456+0000 7f2f89800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2f8406bee0 con 0x7f2f840d3f60 2024-09-11T23:22:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.456+0000 7f2f88e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2f840b6510 0x7f2f840d27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.456+0000 7f2f88e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2f840b6510 0x7f2f840d27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33830/0 (socket says 172.21.15.144:33830) 2024-09-11T23:22:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.456+0000 7f2f88e00640 1 -- 172.21.15.144:0/3454772448 learned_addr learned my addr 172.21.15.144:0/3454772448 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.456+0000 7f2f83e00640 1 --2- 172.21.15.144:0/3454772448 >> v2:172.21.15.165:3300/0 conn(0x7f2f8415e640 0x7f2f840d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.456+0000 7f2f83400640 1 --2- 172.21.15.144:0/3454772448 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f840d3f60 0x7f2f840b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.456+0000 7f2f88e00640 1 -- 172.21.15.144:0/3454772448 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f840d3f60 msgr2=0x7f2f840b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.456+0000 7f2f88e00640 1 --2- 172.21.15.144:0/3454772448 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f840d3f60 0x7f2f840b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.456+0000 7f2f88e00640 1 -- 172.21.15.144:0/3454772448 >> v2:172.21.15.165:3300/0 conn(0x7f2f8415e640 msgr2=0x7f2f840d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.456+0000 7f2f88e00640 1 --2- 172.21.15.144:0/3454772448 >> v2:172.21.15.165:3300/0 conn(0x7f2f8415e640 0x7f2f840d3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.456+0000 7f2f88e00640 1 -- 172.21.15.144:0/3454772448 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f8406c1c0 con 0x7f2f840b6510 2024-09-11T23:22:03.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.456+0000 7f2f83400640 1 --2- 172.21.15.144:0/3454772448 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f840d3f60 0x7f2f840b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:03.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.457+0000 7f2f88e00640 1 --2- 172.21.15.144:0/3454772448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f840b6510 0x7f2f840d27c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2f840d2030 tx=0x7f2f7c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3727b800c4a46f2a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:03.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.458+0000 7f2f82a00640 1 -- 172.21.15.144:0/3454772448 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c036070 con 0x7f2f840b6510 2024-09-11T23:22:03.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.458+0000 7f2f82a00640 1 -- 172.21.15.144:0/3454772448 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f7c031600 con 0x7f2f840b6510 2024-09-11T23:22:03.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.458+0000 7f2f82a00640 1 -- 172.21.15.144:0/3454772448 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c0319d0 con 0x7f2f840b6510 2024-09-11T23:22:03.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.458+0000 7f2f89800640 1 -- 172.21.15.144:0/3454772448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f840b6510 msgr2=0x7f2f840d27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:03.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.458+0000 7f2f89800640 1 --2- 172.21.15.144:0/3454772448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f840b6510 0x7f2f840d27c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2f840d2030 tx=0x7f2f7c02a6a0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.458+0000 7f2f89800640 1 -- 172.21.15.144:0/3454772448 shutdown_connections 2024-09-11T23:22:03.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.458+0000 7f2f89800640 1 --2- 172.21.15.144:0/3454772448 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f840b6510 0x7f2f840d27c0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.458+0000 7f2f89800640 1 --2- 172.21.15.144:0/3454772448 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f840d3f60 0x7f2f840b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.458+0000 7f2f89800640 1 --2- 172.21.15.144:0/3454772448 >> v2:172.21.15.165:3300/0 conn(0x7f2f8415e640 0x7f2f840d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.458+0000 7f2f89800640 1 -- 172.21.15.144:0/3454772448 >> 172.21.15.144:0/3454772448 conn(0x7f2f840d0fd0 msgr2=0x7f2f840d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:03.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.458+0000 7f2f89800640 1 -- 172.21.15.144:0/3454772448 shutdown_connections 2024-09-11T23:22:03.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.458+0000 7f2f89800640 1 -- 172.21.15.144:0/3454772448 wait complete. 2024-09-11T23:22:03.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.460+0000 7f2f89800640 1 Processor -- start 2024-09-11T23:22:03.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.460+0000 7f2f89800640 1 -- start start 2024-09-11T23:22:03.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.461+0000 7f2f89800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f840b6510 0x7f2f8415b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:03.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.461+0000 7f2f89800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f840d3f60 0x7f2f840cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:03.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.461+0000 7f2f89800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f8415e640 0x7f2f840cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:03.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.461+0000 7f2f89800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2f840d2d00 con 0x7f2f840b6510 2024-09-11T23:22:03.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.461+0000 7f2f89800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8406c780 con 0x7f2f8415e640 2024-09-11T23:22:03.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.461+0000 7f2f89800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2f840d2e80 con 0x7f2f840d3f60 2024-09-11T23:22:03.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.461+0000 7f2f83e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f840b6510 0x7f2f8415b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:03.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.461+0000 7f2f83e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f840b6510 0x7f2f8415b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33836/0 (socket says 172.21.15.144:33836) 2024-09-11T23:22:03.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.461+0000 7f2f83e00640 1 -- 172.21.15.144:0/2941848880 learned_addr learned my addr 172.21.15.144:0/2941848880 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:03.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.462+0000 7f2f88e00640 1 --2- 172.21.15.144:0/2941848880 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f8415e640 0x7f2f840cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:03.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.462+0000 7f2f83400640 1 --2- 172.21.15.144:0/2941848880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f840d3f60 0x7f2f840cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:03.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.462+0000 7f2f83e00640 1 -- 172.21.15.144:0/2941848880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f840d3f60 msgr2=0x7f2f840cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:03.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.462+0000 7f2f83e00640 1 --2- 172.21.15.144:0/2941848880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f840d3f60 0x7f2f840cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.462+0000 7f2f83e00640 1 -- 172.21.15.144:0/2941848880 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f8415e640 msgr2=0x7f2f840cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:03.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.462+0000 7f2f83e00640 1 --2- 172.21.15.144:0/2941848880 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f8415e640 0x7f2f840cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.462+0000 7f2f83e00640 1 -- 172.21.15.144:0/2941848880 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f840ab050 con 0x7f2f840b6510 2024-09-11T23:22:03.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.462+0000 7f2f83e00640 1 --2- 172.21.15.144:0/2941848880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f840b6510 0x7f2f8415b230 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400e870 tx=0x7f2f7400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:03.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.462+0000 7f2f7be00640 1 -- 172.21.15.144:0/2941848880 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f74017070 con 0x7f2f840b6510 2024-09-11T23:22:03.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.462+0000 7f2f7be00640 1 -- 172.21.15.144:0/2941848880 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f7400c8e0 con 0x7f2f840b6510 2024-09-11T23:22:03.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.462+0000 7f2f89800640 1 -- 172.21.15.144:0/2941848880 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f840ab330 con 0x7f2f840b6510 2024-09-11T23:22:03.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.462+0000 7f2f7be00640 1 -- 172.21.15.144:0/2941848880 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7400ccd0 con 0x7f2f840b6510 2024-09-11T23:22:03.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.462+0000 7f2f89800640 1 -- 172.21.15.144:0/2941848880 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f840cd950 con 0x7f2f840b6510 2024-09-11T23:22:03.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.463+0000 7f2f89800640 1 -- 172.21.15.144:0/2941848880 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f840d32b0 con 0x7f2f840b6510 2024-09-11T23:22:03.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.465+0000 7f2f7be00640 1 -- 172.21.15.144:0/2941848880 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f2f7401a070 con 0x7f2f840b6510 2024-09-11T23:22:03.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.465+0000 7f2f7be00640 1 --2- 172.21.15.144:0/2941848880 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2f6406c190 0x7f2f6406e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:03.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.465+0000 7f2f7be00640 1 -- 172.21.15.144:0/2941848880 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f2f7408b490 con 0x7f2f840b6510 2024-09-11T23:22:03.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.466+0000 7f2f83400640 1 --2- 172.21.15.144:0/2941848880 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2f6406c190 0x7f2f6406e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:03.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.466+0000 7f2f83400640 1 --2- 172.21.15.144:0/2941848880 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2f6406c190 0x7f2f6406e650 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2f840ccf80 tx=0x7f2f70008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:03.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.470+0000 7f2f7be00640 1 -- 172.21.15.144:0/2941848880 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f74059a80 con 0x7f2f840b6510 2024-09-11T23:22:03.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.643+0000 7f2f89800640 1 -- 172.21.15.144:0/2941848880 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f840b5800 con 0x7f2f6406c190 2024-09-11T23:22:03.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.649+0000 7f2f7be00640 1 -- 172.21.15.144:0/2941848880 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252045 (secure 0 0 0) 0x7f2f840b5800 con 0x7f2f6406c190 2024-09-11T23:22:03.653 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:03.656 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:22:03.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.653+0000 7f2f89800640 1 -- 172.21.15.144:0/2941848880 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2f6406c190 msgr2=0x7f2f6406e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:03.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.653+0000 7f2f89800640 1 --2- 172.21.15.144:0/2941848880 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2f6406c190 0x7f2f6406e650 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2f840ccf80 tx=0x7f2f70008040 comp rx=0 tx=0).stop 2024-09-11T23:22:03.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.653+0000 7f2f89800640 1 -- 172.21.15.144:0/2941848880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f840b6510 msgr2=0x7f2f8415b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:03.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.653+0000 7f2f89800640 1 --2- 172.21.15.144:0/2941848880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f840b6510 0x7f2f8415b230 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400e870 tx=0x7f2f7400ed30 comp rx=0 tx=0).stop 2024-09-11T23:22:03.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.653+0000 7f2f89800640 1 -- 172.21.15.144:0/2941848880 shutdown_connections 2024-09-11T23:22:03.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.653+0000 7f2f89800640 1 --2- 172.21.15.144:0/2941848880 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f2f6406c190 0x7f2f6406e650 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.653+0000 7f2f89800640 1 --2- 172.21.15.144:0/2941848880 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2f8415e640 0x7f2f840cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.653+0000 7f2f89800640 1 --2- 172.21.15.144:0/2941848880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2f840d3f60 0x7f2f840cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.653+0000 7f2f89800640 1 --2- 172.21.15.144:0/2941848880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f840b6510 0x7f2f8415b230 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.653+0000 7f2f89800640 1 -- 172.21.15.144:0/2941848880 >> 172.21.15.144:0/2941848880 conn(0x7f2f840d0fd0 msgr2=0x7f2f840b5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:03.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.653+0000 7f2f89800640 1 -- 172.21.15.144:0/2941848880 shutdown_connections 2024-09-11T23:22:03.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.653+0000 7f2f89800640 1 -- 172.21.15.144:0/2941848880 wait complete. 2024-09-11T23:22:03.669 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-09-11T23:22:03.218600+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249104,"kb_used_data":7880,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725616,"statfs":{"total":773094113280,"available":772839030784,"internally_reserved":0,"allocated":8069120,"data_stored":4048780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.771267"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.512051+0000","last_change":"2024-09-11T23:21:54.474738+0000","last_active":"2024-09-11T23:21:55.512051+0000","last_peered":"2024-09-11T23:21:55.512051+0000","last_clean":"2024-09-11T23:21:55.512051+0000","last_became_active":"2024-09-11T23:21:54.474049+0000","last_became_peered":"2024-09-11T23:21:54.474049+0000","last_unstale":"2024-09-11T23:21:55.512051+0000","last_undegraded":"2024-09-11T23:21:55.512051+0000","last_fullsized":"2024-09-11T23:21:55.512051+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:06.706216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.512582+0000","last_change":"2024-09-11T23:21:54.481578+0000","last_active":"2024-09-11T23:21:55.512582+0000","last_peered":"2024-09-11T23:21:55.512582+0000","last_clean":"2024-09-11T23:21:55.512582+0000","last_became_active":"2024-09-11T23:21:54.481187+0000","last_became_peered":"2024-09-11T23:21:54.481187+0000","last_unstale":"2024-09-11T23:21:55.512582+0000","last_undegraded":"2024-09-11T23:21:55.512582+0000","last_fullsized":"2024-09-11T23:21:55.512582+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:55.379718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510334+0000","last_change":"2024-09-11T23:21:54.470009+0000","last_active":"2024-09-11T23:21:55.510334+0000","last_peered":"2024-09-11T23:21:55.510334+0000","last_clean":"2024-09-11T23:21:55.510334+0000","last_became_active":"2024-09-11T23:21:54.469756+0000","last_became_peered":"2024-09-11T23:21:54.469756+0000","last_unstale":"2024-09-11T23:21:55.510334+0000","last_undegraded":"2024-09-11T23:21:55.510334+0000","last_fullsized":"2024-09-11T23:21:55.510334+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:08.754308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510890+0000","last_change":"2024-09-11T23:21:54.480235+0000","last_active":"2024-09-11T23:21:55.510890+0000","last_peered":"2024-09-11T23:21:55.510890+0000","last_clean":"2024-09-11T23:21:55.510890+0000","last_became_active":"2024-09-11T23:21:54.479917+0000","last_became_peered":"2024-09-11T23:21:54.479917+0000","last_unstale":"2024-09-11T23:21:55.510890+0000","last_undegraded":"2024-09-11T23:21:55.510890+0000","last_fullsized":"2024-09-11T23:21:55.510890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:30.000391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510498+0000","last_change":"2024-09-11T23:21:54.461649+0000","last_active":"2024-09-11T23:21:55.510498+0000","last_peered":"2024-09-11T23:21:55.510498+0000","last_clean":"2024-09-11T23:21:55.510498+0000","last_became_active":"2024-09-11T23:21:54.461362+0000","last_became_peered":"2024-09-11T23:21:54.461362+0000","last_unstale":"2024-09-11T23:21:55.510498+0000","last_undegraded":"2024-09-11T23:21:55.510498+0000","last_fullsized":"2024-09-11T23:21:55.510498+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:42.551507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511562+0000","last_change":"2024-09-11T23:21:54.485019+0000","last_active":"2024-09-11T23:21:55.511562+0000","last_peered":"2024-09-11T23:21:55.511562+0000","last_clean":"2024-09-11T23:21:55.511562+0000","last_became_active":"2024-09-11T23:21:54.480801+0000","last_became_peered":"2024-09-11T23:21:54.480801+0000","last_unstale":"2024-09-11T23:21:55.511562+0000","last_undegraded":"2024-09-11T23:21:55.511562+0000","last_fullsized":"2024-09-11T23:21:55.511562+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:27.872203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.466575+0000","last_change":"2024-09-11T23:21:54.466747+0000","last_active":"2024-09-11T23:21:55.466575+0000","last_peered":"2024-09-11T23:21:55.466575+0000","last_clean":"2024-09-11T23:21:55.466575+0000","last_became_active":"2024-09-11T23:21:54.465374+0000","last_became_peered":"2024-09-11T23:21:54.465374+0000","last_unstale":"2024-09-11T23:21:55.466575+0000","last_undegraded":"2024-09-11T23:21:55.466575+0000","last_fullsized":"2024-09-11T23:21:55.466575+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:22.103012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511428+0000","last_change":"2024-09-11T23:21:54.476928+0000","last_active":"2024-09-11T23:21:55.511428+0000","last_peered":"2024-09-11T23:21:55.511428+0000","last_clean":"2024-09-11T23:21:55.511428+0000","last_became_active":"2024-09-11T23:21:54.476618+0000","last_became_peered":"2024-09-11T23:21:54.476618+0000","last_unstale":"2024-09-11T23:21:55.511428+0000","last_undegraded":"2024-09-11T23:21:55.511428+0000","last_fullsized":"2024-09-11T23:21:55.511428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:58.903758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511740+0000","last_change":"2024-09-11T23:21:54.471369+0000","last_active":"2024-09-11T23:21:55.511740+0000","last_peered":"2024-09-11T23:21:55.511740+0000","last_clean":"2024-09-11T23:21:55.511740+0000","last_became_active":"2024-09-11T23:21:54.464703+0000","last_became_peered":"2024-09-11T23:21:54.464703+0000","last_unstale":"2024-09-11T23:21:55.511740+0000","last_undegraded":"2024-09-11T23:21:55.511740+0000","last_fullsized":"2024-09-11T23:21:55.511740+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:34.877955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.467367+0000","last_change":"2024-09-11T23:21:54.464693+0000","last_active":"2024-09-11T23:21:55.467367+0000","last_peered":"2024-09-11T23:21:55.467367+0000","last_clean":"2024-09-11T23:21:55.467367+0000","last_became_active":"2024-09-11T23:21:54.462500+0000","last_became_peered":"2024-09-11T23:21:54.462500+0000","last_unstale":"2024-09-11T23:21:55.467367+0000","last_undegraded":"2024-09-11T23:21:55.467367+0000","last_fullsized":"2024-09-11T23:21:55.467367+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:31.744911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511349+0000","last_change":"2024-09-11T23:21:54.466244+0000","last_active":"2024-09-11T23:21:55.511349+0000","last_peered":"2024-09-11T23:21:55.511349+0000","last_clean":"2024-09-11T23:21:55.511349+0000","last_became_active":"2024-09-11T23:21:54.465979+0000","last_became_peered":"2024-09-11T23:21:54.465979+0000","last_unstale":"2024-09-11T23:21:55.511349+0000","last_undegraded":"2024-09-11T23:21:55.511349+0000","last_fullsized":"2024-09-11T23:21:55.511349+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:37.815933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510697+0000","last_change":"2024-09-11T23:21:54.466030+0000","last_active":"2024-09-11T23:21:55.510697+0000","last_peered":"2024-09-11T23:21:55.510697+0000","last_clean":"2024-09-11T23:21:55.510697+0000","last_became_active":"2024-09-11T23:21:54.465091+0000","last_became_peered":"2024-09-11T23:21:54.465091+0000","last_unstale":"2024-09-11T23:21:55.510697+0000","last_undegraded":"2024-09-11T23:21:55.510697+0000","last_fullsized":"2024-09-11T23:21:55.510697+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:15.952204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469152+0000","last_change":"2024-09-11T23:21:54.479207+0000","last_active":"2024-09-11T23:21:55.469152+0000","last_peered":"2024-09-11T23:21:55.469152+0000","last_clean":"2024-09-11T23:21:55.469152+0000","last_became_active":"2024-09-11T23:21:54.478793+0000","last_became_peered":"2024-09-11T23:21:54.478793+0000","last_unstale":"2024-09-11T23:21:55.469152+0000","last_undegraded":"2024-09-11T23:21:55.469152+0000","last_fullsized":"2024-09-11T23:21:55.469152+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:58.260435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511424+0000","last_change":"2024-09-11T23:21:54.457612+0000","last_active":"2024-09-11T23:21:55.511424+0000","last_peered":"2024-09-11T23:21:55.511424+0000","last_clean":"2024-09-11T23:21:55.511424+0000","last_became_active":"2024-09-11T23:21:54.457308+0000","last_became_peered":"2024-09-11T23:21:54.457308+0000","last_unstale":"2024-09-11T23:21:55.511424+0000","last_undegraded":"2024-09-11T23:21:55.511424+0000","last_fullsized":"2024-09-11T23:21:55.511424+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:38.495148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469082+0000","last_change":"2024-09-11T23:21:54.466512+0000","last_active":"2024-09-11T23:21:55.469082+0000","last_peered":"2024-09-11T23:21:55.469082+0000","last_clean":"2024-09-11T23:21:55.469082+0000","last_became_active":"2024-09-11T23:21:54.466223+0000","last_became_peered":"2024-09-11T23:21:54.466223+0000","last_unstale":"2024-09-11T23:21:55.469082+0000","last_undegraded":"2024-09-11T23:21:55.469082+0000","last_fullsized":"2024-09-11T23:21:55.469082+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:43.570690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.466567+0000","last_change":"2024-09-11T23:21:54.470918+0000","last_active":"2024-09-11T23:21:55.466567+0000","last_peered":"2024-09-11T23:21:55.466567+0000","last_clean":"2024-09-11T23:21:55.466567+0000","last_became_active":"2024-09-11T23:21:54.470555+0000","last_became_peered":"2024-09-11T23:21:54.470555+0000","last_unstale":"2024-09-11T23:21:55.466567+0000","last_undegraded":"2024-09-11T23:21:55.466567+0000","last_fullsized":"2024-09-11T23:21:55.466567+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:58.903758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511841+0000","last_change":"2024-09-11T23:21:54.469904+0000","last_active":"2024-09-11T23:21:55.511841+0000","last_peered":"2024-09-11T23:21:55.511841+0000","last_clean":"2024-09-11T23:21:55.511841+0000","last_became_active":"2024-09-11T23:21:54.463527+0000","last_became_peered":"2024-09-11T23:21:54.463527+0000","last_unstale":"2024-09-11T23:21:55.511841+0000","last_undegraded":"2024-09-11T23:21:55.511841+0000","last_fullsized":"2024-09-11T23:21:55.511841+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:35.897940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511283+0000","last_change":"2024-09-11T23:21:54.483488+0000","last_active":"2024-09-11T23:21:55.511283+0000","last_peered":"2024-09-11T23:21:55.511283+0000","last_clean":"2024-09-11T23:21:55.511283+0000","last_became_active":"2024-09-11T23:21:54.483157+0000","last_became_peered":"2024-09-11T23:21:54.483157+0000","last_unstale":"2024-09-11T23:21:55.511283+0000","last_undegraded":"2024-09-11T23:21:55.511283+0000","last_fullsized":"2024-09-11T23:21:55.511283+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:36.931095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.512443+0000","last_change":"2024-09-11T23:21:54.476872+0000","last_active":"2024-09-11T23:21:55.512443+0000","last_peered":"2024-09-11T23:21:55.512443+0000","last_clean":"2024-09-11T23:21:55.512443+0000","last_became_active":"2024-09-11T23:21:54.476582+0000","last_became_peered":"2024-09-11T23:21:54.476582+0000","last_unstale":"2024-09-11T23:21:55.512443+0000","last_undegraded":"2024-09-11T23:21:55.512443+0000","last_fullsized":"2024-09-11T23:21:55.512443+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:12.919621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469196+0000","last_change":"2024-09-11T23:21:54.466500+0000","last_active":"2024-09-11T23:21:55.469196+0000","last_peered":"2024-09-11T23:21:55.469196+0000","last_clean":"2024-09-11T23:21:55.469196+0000","last_became_active":"2024-09-11T23:21:54.463536+0000","last_became_peered":"2024-09-11T23:21:54.463536+0000","last_unstale":"2024-09-11T23:21:55.469196+0000","last_undegraded":"2024-09-11T23:21:55.469196+0000","last_fullsized":"2024-09-11T23:21:55.469196+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:13.798720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.467259+0000","last_change":"2024-09-11T23:21:54.463114+0000","last_active":"2024-09-11T23:21:55.467259+0000","last_peered":"2024-09-11T23:21:55.467259+0000","last_clean":"2024-09-11T23:21:55.467259+0000","last_became_active":"2024-09-11T23:21:54.462251+0000","last_became_peered":"2024-09-11T23:21:54.462251+0000","last_unstale":"2024-09-11T23:21:55.467259+0000","last_undegraded":"2024-09-11T23:21:55.467259+0000","last_fullsized":"2024-09-11T23:21:55.467259+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:12.919621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.467038+0000","last_change":"2024-09-11T23:21:54.464400+0000","last_active":"2024-09-11T23:21:55.467038+0000","last_peered":"2024-09-11T23:21:55.467038+0000","last_clean":"2024-09-11T23:21:55.467038+0000","last_became_active":"2024-09-11T23:21:54.464075+0000","last_became_peered":"2024-09-11T23:21:54.464075+0000","last_unstale":"2024-09-11T23:21:55.467038+0000","last_undegraded":"2024-09-11T23:21:55.467038+0000","last_fullsized":"2024-09-11T23:21:55.467038+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:27.872203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511031+0000","last_change":"2024-09-11T23:21:54.462809+0000","last_active":"2024-09-11T23:21:55.511031+0000","last_peered":"2024-09-11T23:21:55.511031+0000","last_clean":"2024-09-11T23:21:55.511031+0000","last_became_active":"2024-09-11T23:21:54.462548+0000","last_became_peered":"2024-09-11T23:21:54.462548+0000","last_unstale":"2024-09-11T23:21:55.511031+0000","last_undegraded":"2024-09-11T23:21:55.511031+0000","last_fullsized":"2024-09-11T23:21:55.511031+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:36.276273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510978+0000","last_change":"2024-09-11T23:21:54.482141+0000","last_active":"2024-09-11T23:21:55.510978+0000","last_peered":"2024-09-11T23:21:55.510978+0000","last_clean":"2024-09-11T23:21:55.510978+0000","last_became_active":"2024-09-11T23:21:54.481848+0000","last_became_peered":"2024-09-11T23:21:54.481848+0000","last_unstale":"2024-09-11T23:21:55.510978+0000","last_undegraded":"2024-09-11T23:21:55.510978+0000","last_fullsized":"2024-09-11T23:21:55.510978+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.916420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.467775+0000","last_change":"2024-09-11T23:21:54.467818+0000","last_active":"2024-09-11T23:21:55.467775+0000","last_peered":"2024-09-11T23:21:55.467775+0000","last_clean":"2024-09-11T23:21:55.467775+0000","last_became_active":"2024-09-11T23:21:54.467486+0000","last_became_peered":"2024-09-11T23:21:54.467486+0000","last_unstale":"2024-09-11T23:21:55.467775+0000","last_undegraded":"2024-09-11T23:21:55.467775+0000","last_fullsized":"2024-09-11T23:21:55.467775+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:36:55.688218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.466724+0000","last_change":"2024-09-11T23:21:54.479693+0000","last_active":"2024-09-11T23:21:55.466724+0000","last_peered":"2024-09-11T23:21:55.466724+0000","last_clean":"2024-09-11T23:21:55.466724+0000","last_became_active":"2024-09-11T23:21:54.479390+0000","last_became_peered":"2024-09-11T23:21:54.479390+0000","last_unstale":"2024-09-11T23:21:55.466724+0000","last_undegraded":"2024-09-11T23:21:55.466724+0000","last_fullsized":"2024-09-11T23:21:55.466724+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:30.855528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510479+0000","last_change":"2024-09-11T23:21:54.472239+0000","last_active":"2024-09-11T23:21:55.510479+0000","last_peered":"2024-09-11T23:21:55.510479+0000","last_clean":"2024-09-11T23:21:55.510479+0000","last_became_active":"2024-09-11T23:21:54.472001+0000","last_became_peered":"2024-09-11T23:21:54.472001+0000","last_unstale":"2024-09-11T23:21:55.510479+0000","last_undegraded":"2024-09-11T23:21:55.510479+0000","last_fullsized":"2024-09-11T23:21:55.510479+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:52.276408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.467283+0000","last_change":"2024-09-11T23:21:54.462458+0000","last_active":"2024-09-11T23:21:55.467283+0000","last_peered":"2024-09-11T23:21:55.467283+0000","last_clean":"2024-09-11T23:21:55.467283+0000","last_became_active":"2024-09-11T23:21:54.462063+0000","last_became_peered":"2024-09-11T23:21:54.462063+0000","last_unstale":"2024-09-11T23:21:55.467283+0000","last_undegraded":"2024-09-11T23:21:55.467283+0000","last_fullsized":"2024-09-11T23:21:55.467283+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:04.874464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510385+0000","last_change":"2024-09-11T23:21:54.469786+0000","last_active":"2024-09-11T23:21:55.510385+0000","last_peered":"2024-09-11T23:21:55.510385+0000","last_clean":"2024-09-11T23:21:55.510385+0000","last_became_active":"2024-09-11T23:21:54.469466+0000","last_became_peered":"2024-09-11T23:21:54.469466+0000","last_unstale":"2024-09-11T23:21:55.510385+0000","last_undegraded":"2024-09-11T23:21:55.510385+0000","last_fullsized":"2024-09-11T23:21:55.510385+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:19.172926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.466733+0000","last_change":"2024-09-11T23:21:54.482128+0000","last_active":"2024-09-11T23:21:55.466733+0000","last_peered":"2024-09-11T23:21:55.466733+0000","last_clean":"2024-09-11T23:21:55.466733+0000","last_became_active":"2024-09-11T23:21:54.481785+0000","last_became_peered":"2024-09-11T23:21:54.481785+0000","last_unstale":"2024-09-11T23:21:55.466733+0000","last_undegraded":"2024-09-11T23:21:55.466733+0000","last_fullsized":"2024-09-11T23:21:55.466733+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:58.260435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.466868+0000","last_change":"2024-09-11T23:21:54.460206+0000","last_active":"2024-09-11T23:21:55.466868+0000","last_peered":"2024-09-11T23:21:55.466868+0000","last_clean":"2024-09-11T23:21:55.466868+0000","last_became_active":"2024-09-11T23:21:54.459460+0000","last_became_peered":"2024-09-11T23:21:54.459460+0000","last_unstale":"2024-09-11T23:21:55.466868+0000","last_undegraded":"2024-09-11T23:21:55.466868+0000","last_fullsized":"2024-09-11T23:21:55.466868+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:41.754162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511618+0000","last_change":"2024-09-11T23:21:54.480061+0000","last_active":"2024-09-11T23:21:55.511618+0000","last_peered":"2024-09-11T23:21:55.511618+0000","last_clean":"2024-09-11T23:21:55.511618+0000","last_became_active":"2024-09-11T23:21:54.478494+0000","last_became_peered":"2024-09-11T23:21:54.478494+0000","last_unstale":"2024-09-11T23:21:55.511618+0000","last_undegraded":"2024-09-11T23:21:55.511618+0000","last_fullsized":"2024-09-11T23:21:55.511618+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:04.874464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511632+0000","last_change":"2024-09-11T23:21:54.483670+0000","last_active":"2024-09-11T23:21:55.511632+0000","last_peered":"2024-09-11T23:21:55.511632+0000","last_clean":"2024-09-11T23:21:55.511632+0000","last_became_active":"2024-09-11T23:21:54.483430+0000","last_became_peered":"2024-09-11T23:21:54.483430+0000","last_unstale":"2024-09-11T23:21:55.511632+0000","last_undegraded":"2024-09-11T23:21:55.511632+0000","last_fullsized":"2024-09-11T23:21:55.511632+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:02.593537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"70'4","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.512219+0000","last_change":"2024-09-11T23:21:53.470991+0000","last_active":"2024-09-11T23:21:55.512219+0000","last_peered":"2024-09-11T23:21:55.512219+0000","last_clean":"2024-09-11T23:21:55.512219+0000","last_became_active":"2024-09-11T23:21:53.470699+0000","last_became_peered":"2024-09-11T23:21:53.470699+0000","last_unstale":"2024-09-11T23:21:55.512219+0000","last_undegraded":"2024-09-11T23:21:55.512219+0000","last_fullsized":"2024-09-11T23:21:55.512219+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:31.669192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511911+0000","last_change":"2024-09-11T23:21:54.465037+0000","last_active":"2024-09-11T23:21:55.511911+0000","last_peered":"2024-09-11T23:21:55.511911+0000","last_clean":"2024-09-11T23:21:55.511911+0000","last_became_active":"2024-09-11T23:21:54.463488+0000","last_became_peered":"2024-09-11T23:21:54.463488+0000","last_unstale":"2024-09-11T23:21:55.511911+0000","last_undegraded":"2024-09-11T23:21:55.511911+0000","last_fullsized":"2024-09-11T23:21:55.511911+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:41.375145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"70'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469489+0000","last_change":"2024-09-11T23:21:53.463711+0000","last_active":"2024-09-11T23:21:55.469489+0000","last_peered":"2024-09-11T23:21:55.469489+0000","last_clean":"2024-09-11T23:21:55.469489+0000","last_became_active":"2024-09-11T23:21:53.462741+0000","last_became_peered":"2024-09-11T23:21:53.462741+0000","last_unstale":"2024-09-11T23:21:55.469489+0000","last_undegraded":"2024-09-11T23:21:55.469489+0000","last_fullsized":"2024-09-11T23:21:55.469489+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:14.949860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511739+0000","last_change":"2024-09-11T23:21:54.479264+0000","last_active":"2024-09-11T23:21:55.511739+0000","last_peered":"2024-09-11T23:21:55.511739+0000","last_clean":"2024-09-11T23:21:55.511739+0000","last_became_active":"2024-09-11T23:21:54.478939+0000","last_became_peered":"2024-09-11T23:21:54.478939+0000","last_unstale":"2024-09-11T23:21:55.511739+0000","last_undegraded":"2024-09-11T23:21:55.511739+0000","last_fullsized":"2024-09-11T23:21:55.511739+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:31.744911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"70'2","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.467254+0000","last_change":"2024-09-11T23:21:53.467522+0000","last_active":"2024-09-11T23:21:55.467254+0000","last_peered":"2024-09-11T23:21:55.467254+0000","last_clean":"2024-09-11T23:21:55.467254+0000","last_became_active":"2024-09-11T23:21:53.467218+0000","last_became_peered":"2024-09-11T23:21:53.467218+0000","last_unstale":"2024-09-11T23:21:55.467254+0000","last_undegraded":"2024-09-11T23:21:55.467254+0000","last_fullsized":"2024-09-11T23:21:55.467254+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:35.293491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511505+0000","last_change":"2024-09-11T23:21:54.469492+0000","last_active":"2024-09-11T23:21:55.511505+0000","last_peered":"2024-09-11T23:21:55.511505+0000","last_clean":"2024-09-11T23:21:55.511505+0000","last_became_active":"2024-09-11T23:21:54.469040+0000","last_became_peered":"2024-09-11T23:21:54.469040+0000","last_unstale":"2024-09-11T23:21:55.511505+0000","last_undegraded":"2024-09-11T23:21:55.511505+0000","last_fullsized":"2024-09-11T23:21:55.511505+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:47.223963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"70'2","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511998+0000","last_change":"2024-09-11T23:21:53.469697+0000","last_active":"2024-09-11T23:21:55.511998+0000","last_peered":"2024-09-11T23:21:55.511998+0000","last_clean":"2024-09-11T23:21:55.511998+0000","last_became_active":"2024-09-11T23:21:53.469365+0000","last_became_peered":"2024-09-11T23:21:53.469365+0000","last_unstale":"2024-09-11T23:21:55.511998+0000","last_undegraded":"2024-09-11T23:21:55.511998+0000","last_fullsized":"2024-09-11T23:21:55.511998+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:09.148570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.467568+0000","last_change":"2024-09-11T23:21:54.466699+0000","last_active":"2024-09-11T23:21:55.467568+0000","last_peered":"2024-09-11T23:21:55.467568+0000","last_clean":"2024-09-11T23:21:55.467568+0000","last_became_active":"2024-09-11T23:21:54.466400+0000","last_became_peered":"2024-09-11T23:21:54.466400+0000","last_unstale":"2024-09-11T23:21:55.467568+0000","last_undegraded":"2024-09-11T23:21:55.467568+0000","last_fullsized":"2024-09-11T23:21:55.467568+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:07.418531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"70'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510677+0000","last_change":"2024-09-11T23:21:53.473578+0000","last_active":"2024-09-11T23:21:55.510677+0000","last_peered":"2024-09-11T23:21:55.510677+0000","last_clean":"2024-09-11T23:21:55.510677+0000","last_became_active":"2024-09-11T23:21:53.473383+0000","last_became_peered":"2024-09-11T23:21:53.473383+0000","last_unstale":"2024-09-11T23:21:55.510677+0000","last_undegraded":"2024-09-11T23:21:55.510677+0000","last_fullsized":"2024-09-11T23:21:55.510677+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:12:49.284816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.467812+0000","last_change":"2024-09-11T23:21:54.462869+0000","last_active":"2024-09-11T23:21:55.467812+0000","last_peered":"2024-09-11T23:21:55.467812+0000","last_clean":"2024-09-11T23:21:55.467812+0000","last_became_active":"2024-09-11T23:21:54.461814+0000","last_became_peered":"2024-09-11T23:21:54.461814+0000","last_unstale":"2024-09-11T23:21:55.467812+0000","last_undegraded":"2024-09-11T23:21:55.467812+0000","last_fullsized":"2024-09-11T23:21:55.467812+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:55.379718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"70'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511631+0000","last_change":"2024-09-11T23:21:53.470378+0000","last_active":"2024-09-11T23:21:55.511631+0000","last_peered":"2024-09-11T23:21:55.511631+0000","last_clean":"2024-09-11T23:21:55.511631+0000","last_became_active":"2024-09-11T23:21:53.470047+0000","last_became_peered":"2024-09-11T23:21:53.470047+0000","last_unstale":"2024-09-11T23:21:55.511631+0000","last_undegraded":"2024-09-11T23:21:55.511631+0000","last_fullsized":"2024-09-11T23:21:55.511631+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:23.781101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510147+0000","last_change":"2024-09-11T23:21:54.457007+0000","last_active":"2024-09-11T23:21:55.510147+0000","last_peered":"2024-09-11T23:21:55.510147+0000","last_clean":"2024-09-11T23:21:55.510147+0000","last_became_active":"2024-09-11T23:21:54.456723+0000","last_became_peered":"2024-09-11T23:21:54.456723+0000","last_unstale":"2024-09-11T23:21:55.510147+0000","last_undegraded":"2024-09-11T23:21:55.510147+0000","last_fullsized":"2024-09-11T23:21:55.510147+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:55.914961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510634+0000","last_change":"2024-09-11T23:21:53.470324+0000","last_active":"2024-09-11T23:21:55.510634+0000","last_peered":"2024-09-11T23:21:55.510634+0000","last_clean":"2024-09-11T23:21:55.510634+0000","last_became_active":"2024-09-11T23:21:53.470034+0000","last_became_peered":"2024-09-11T23:21:53.470034+0000","last_unstale":"2024-09-11T23:21:55.510634+0000","last_undegraded":"2024-09-11T23:21:55.510634+0000","last_fullsized":"2024-09-11T23:21:55.510634+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:09.148570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469171+0000","last_change":"2024-09-11T23:21:54.472903+0000","last_active":"2024-09-11T23:21:55.469171+0000","last_peered":"2024-09-11T23:21:55.469171+0000","last_clean":"2024-09-11T23:21:55.469171+0000","last_became_active":"2024-09-11T23:21:54.472602+0000","last_became_peered":"2024-09-11T23:21:54.472602+0000","last_unstale":"2024-09-11T23:21:55.469171+0000","last_undegraded":"2024-09-11T23:21:55.469171+0000","last_fullsized":"2024-09-11T23:21:55.469171+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:07.418531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510193+0000","last_change":"2024-09-11T23:21:53.467541+0000","last_active":"2024-09-11T23:21:55.510193+0000","last_peered":"2024-09-11T23:21:55.510193+0000","last_clean":"2024-09-11T23:21:55.510193+0000","last_became_active":"2024-09-11T23:21:53.467140+0000","last_became_peered":"2024-09-11T23:21:53.467140+0000","last_unstale":"2024-09-11T23:21:55.510193+0000","last_undegraded":"2024-09-11T23:21:55.510193+0000","last_fullsized":"2024-09-11T23:21:55.510193+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:39.922294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.467325+0000","last_change":"2024-09-11T23:21:54.461750+0000","last_active":"2024-09-11T23:21:55.467325+0000","last_peered":"2024-09-11T23:21:55.467325+0000","last_clean":"2024-09-11T23:21:55.467325+0000","last_became_active":"2024-09-11T23:21:54.461419+0000","last_became_peered":"2024-09-11T23:21:54.461419+0000","last_unstale":"2024-09-11T23:21:55.467325+0000","last_undegraded":"2024-09-11T23:21:55.467325+0000","last_fullsized":"2024-09-11T23:21:55.467325+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:43.570690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.467482+0000","last_change":"2024-09-11T23:21:53.470446+0000","last_active":"2024-09-11T23:21:55.467482+0000","last_peered":"2024-09-11T23:21:55.467482+0000","last_clean":"2024-09-11T23:21:55.467482+0000","last_became_active":"2024-09-11T23:21:53.470036+0000","last_became_peered":"2024-09-11T23:21:53.470036+0000","last_unstale":"2024-09-11T23:21:55.467482+0000","last_undegraded":"2024-09-11T23:21:55.467482+0000","last_fullsized":"2024-09-11T23:21:55.467482+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:58.108821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.512120+0000","last_change":"2024-09-11T23:21:54.486905+0000","last_active":"2024-09-11T23:21:55.512120+0000","last_peered":"2024-09-11T23:21:55.512120+0000","last_clean":"2024-09-11T23:21:55.512120+0000","last_became_active":"2024-09-11T23:21:54.486173+0000","last_became_peered":"2024-09-11T23:21:54.486173+0000","last_unstale":"2024-09-11T23:21:55.512120+0000","last_undegraded":"2024-09-11T23:21:55.512120+0000","last_fullsized":"2024-09-11T23:21:55.512120+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:04.535906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.512589+0000","last_change":"2024-09-11T23:21:53.471148+0000","last_active":"2024-09-11T23:21:55.512589+0000","last_peered":"2024-09-11T23:21:55.512589+0000","last_clean":"2024-09-11T23:21:55.512589+0000","last_became_active":"2024-09-11T23:21:53.470383+0000","last_became_peered":"2024-09-11T23:21:53.470383+0000","last_unstale":"2024-09-11T23:21:55.512589+0000","last_undegraded":"2024-09-11T23:21:55.512589+0000","last_fullsized":"2024-09-11T23:21:55.512589+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:43.791393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511898+0000","last_change":"2024-09-11T23:21:54.478635+0000","last_active":"2024-09-11T23:21:55.511898+0000","last_peered":"2024-09-11T23:21:55.511898+0000","last_clean":"2024-09-11T23:21:55.511898+0000","last_became_active":"2024-09-11T23:21:54.476093+0000","last_became_peered":"2024-09-11T23:21:54.476093+0000","last_unstale":"2024-09-11T23:21:55.511898+0000","last_undegraded":"2024-09-11T23:21:55.511898+0000","last_fullsized":"2024-09-11T23:21:55.511898+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:19.754652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"70'3","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510700+0000","last_change":"2024-09-11T23:21:53.464476+0000","last_active":"2024-09-11T23:21:55.510700+0000","last_peered":"2024-09-11T23:21:55.510700+0000","last_clean":"2024-09-11T23:21:55.510700+0000","last_became_active":"2024-09-11T23:21:53.464218+0000","last_became_peered":"2024-09-11T23:21:53.464218+0000","last_unstale":"2024-09-11T23:21:55.510700+0000","last_undegraded":"2024-09-11T23:21:55.510700+0000","last_fullsized":"2024-09-11T23:21:55.510700+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:59:25.823473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510740+0000","last_change":"2024-09-11T23:21:54.465392+0000","last_active":"2024-09-11T23:21:55.510740+0000","last_peered":"2024-09-11T23:21:55.510740+0000","last_clean":"2024-09-11T23:21:55.510740+0000","last_became_active":"2024-09-11T23:21:54.464990+0000","last_became_peered":"2024-09-11T23:21:54.464990+0000","last_unstale":"2024-09-11T23:21:55.510740+0000","last_undegraded":"2024-09-11T23:21:55.510740+0000","last_fullsized":"2024-09-11T23:21:55.510740+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:26.896239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"70'6","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511020+0000","last_change":"2024-09-11T23:21:53.465308+0000","last_active":"2024-09-11T23:21:55.511020+0000","last_peered":"2024-09-11T23:21:55.511020+0000","last_clean":"2024-09-11T23:21:55.511020+0000","last_became_active":"2024-09-11T23:21:53.464677+0000","last_became_peered":"2024-09-11T23:21:53.464677+0000","last_unstale":"2024-09-11T23:21:55.511020+0000","last_undegraded":"2024-09-11T23:21:55.511020+0000","last_fullsized":"2024-09-11T23:21:55.511020+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:53.798999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510924+0000","last_change":"2024-09-11T23:21:54.466748+0000","last_active":"2024-09-11T23:21:55.510924+0000","last_peered":"2024-09-11T23:21:55.510924+0000","last_clean":"2024-09-11T23:21:55.510924+0000","last_became_active":"2024-09-11T23:21:54.466494+0000","last_became_peered":"2024-09-11T23:21:54.466494+0000","last_unstale":"2024-09-11T23:21:55.510924+0000","last_undegraded":"2024-09-11T23:21:55.510924+0000","last_fullsized":"2024-09-11T23:21:55.510924+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:26.378858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"70'2","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511948+0000","last_change":"2024-09-11T23:21:53.467755+0000","last_active":"2024-09-11T23:21:55.511948+0000","last_peered":"2024-09-11T23:21:55.511948+0000","last_clean":"2024-09-11T23:21:55.511948+0000","last_became_active":"2024-09-11T23:21:53.467498+0000","last_became_peered":"2024-09-11T23:21:53.467498+0000","last_unstale":"2024-09-11T23:21:55.511948+0000","last_undegraded":"2024-09-11T23:21:55.511948+0000","last_fullsized":"2024-09-11T23:21:55.511948+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:43.791393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.466645+0000","last_change":"2024-09-11T23:21:54.460315+0000","last_active":"2024-09-11T23:21:55.466645+0000","last_peered":"2024-09-11T23:21:55.466645+0000","last_clean":"2024-09-11T23:21:55.466645+0000","last_became_active":"2024-09-11T23:21:54.459316+0000","last_became_peered":"2024-09-11T23:21:54.459316+0000","last_unstale":"2024-09-11T23:21:55.466645+0000","last_undegraded":"2024-09-11T23:21:55.466645+0000","last_fullsized":"2024-09-11T23:21:55.466645+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:35.745599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511701+0000","last_change":"2024-09-11T23:21:53.470164+0000","last_active":"2024-09-11T23:21:55.511701+0000","last_peered":"2024-09-11T23:21:55.511701+0000","last_clean":"2024-09-11T23:21:55.511701+0000","last_became_active":"2024-09-11T23:21:53.469877+0000","last_became_peered":"2024-09-11T23:21:53.469877+0000","last_unstale":"2024-09-11T23:21:55.511701+0000","last_undegraded":"2024-09-11T23:21:55.511701+0000","last_fullsized":"2024-09-11T23:21:55.511701+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:53.798999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469000+0000","last_change":"2024-09-11T23:21:54.485032+0000","last_active":"2024-09-11T23:21:55.469000+0000","last_peered":"2024-09-11T23:21:55.469000+0000","last_clean":"2024-09-11T23:21:55.469000+0000","last_became_active":"2024-09-11T23:21:54.484723+0000","last_became_peered":"2024-09-11T23:21:54.484723+0000","last_unstale":"2024-09-11T23:21:55.469000+0000","last_undegraded":"2024-09-11T23:21:55.469000+0000","last_fullsized":"2024-09-11T23:21:55.469000+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:30.855528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.466688+0000","last_change":"2024-09-11T23:21:53.462910+0000","last_active":"2024-09-11T23:21:55.466688+0000","last_peered":"2024-09-11T23:21:55.466688+0000","last_clean":"2024-09-11T23:21:55.466688+0000","last_became_active":"2024-09-11T23:21:53.462628+0000","last_became_peered":"2024-09-11T23:21:53.462628+0000","last_unstale":"2024-09-11T23:21:55.466688+0000","last_undegraded":"2024-09-11T23:21:55.466688+0000","last_fullsized":"2024-09-11T23:21:55.466688+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:03.790130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510349+0000","last_change":"2024-09-11T23:21:54.473219+0000","last_active":"2024-09-11T23:21:55.510349+0000","last_peered":"2024-09-11T23:21:55.510349+0000","last_clean":"2024-09-11T23:21:55.510349+0000","last_became_active":"2024-09-11T23:21:54.463830+0000","last_became_peered":"2024-09-11T23:21:54.463830+0000","last_unstale":"2024-09-11T23:21:55.510349+0000","last_undegraded":"2024-09-11T23:21:55.510349+0000","last_fullsized":"2024-09-11T23:21:55.510349+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:39.121272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"70'8","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.466677+0000","last_change":"2024-09-11T23:21:53.468168+0000","last_active":"2024-09-11T23:21:55.466677+0000","last_peered":"2024-09-11T23:21:55.466677+0000","last_clean":"2024-09-11T23:21:55.466677+0000","last_became_active":"2024-09-11T23:21:53.467519+0000","last_became_peered":"2024-09-11T23:21:53.467519+0000","last_unstale":"2024-09-11T23:21:55.466677+0000","last_undegraded":"2024-09-11T23:21:55.466677+0000","last_fullsized":"2024-09-11T23:21:55.466677+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:44.775322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.467537+0000","last_change":"2024-09-11T23:21:54.472550+0000","last_active":"2024-09-11T23:21:55.467537+0000","last_peered":"2024-09-11T23:21:55.467537+0000","last_clean":"2024-09-11T23:21:55.467537+0000","last_became_active":"2024-09-11T23:21:54.468734+0000","last_became_peered":"2024-09-11T23:21:54.468734+0000","last_unstale":"2024-09-11T23:21:55.467537+0000","last_undegraded":"2024-09-11T23:21:55.467537+0000","last_fullsized":"2024-09-11T23:21:55.467537+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:19.754652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"70'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.512568+0000","last_change":"2024-09-11T23:21:53.468403+0000","last_active":"2024-09-11T23:21:55.512568+0000","last_peered":"2024-09-11T23:21:55.512568+0000","last_clean":"2024-09-11T23:21:55.512568+0000","last_became_active":"2024-09-11T23:21:53.468047+0000","last_became_peered":"2024-09-11T23:21:53.468047+0000","last_unstale":"2024-09-11T23:21:55.512568+0000","last_undegraded":"2024-09-11T23:21:55.512568+0000","last_fullsized":"2024-09-11T23:21:55.512568+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:20.530963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.512200+0000","last_change":"2024-09-11T23:21:54.475552+0000","last_active":"2024-09-11T23:21:55.512200+0000","last_peered":"2024-09-11T23:21:55.512200+0000","last_clean":"2024-09-11T23:21:55.512200+0000","last_became_active":"2024-09-11T23:21:54.472532+0000","last_became_peered":"2024-09-11T23:21:54.472532+0000","last_unstale":"2024-09-11T23:21:55.512200+0000","last_undegraded":"2024-09-11T23:21:55.512200+0000","last_fullsized":"2024-09-11T23:21:55.512200+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:23.653494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"70'2","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.467635+0000","last_change":"2024-09-11T23:21:53.466954+0000","last_active":"2024-09-11T23:21:55.467635+0000","last_peered":"2024-09-11T23:21:55.467635+0000","last_clean":"2024-09-11T23:21:55.467635+0000","last_became_active":"2024-09-11T23:21:53.466633+0000","last_became_peered":"2024-09-11T23:21:53.466633+0000","last_unstale":"2024-09-11T23:21:55.467635+0000","last_undegraded":"2024-09-11T23:21:55.467635+0000","last_fullsized":"2024-09-11T23:21:55.467635+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:41.854885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511082+0000","last_change":"2024-09-11T23:21:54.470912+0000","last_active":"2024-09-11T23:21:55.511082+0000","last_peered":"2024-09-11T23:21:55.511082+0000","last_clean":"2024-09-11T23:21:55.511082+0000","last_became_active":"2024-09-11T23:21:54.464204+0000","last_became_peered":"2024-09-11T23:21:54.464204+0000","last_unstale":"2024-09-11T23:21:55.511082+0000","last_undegraded":"2024-09-11T23:21:55.511082+0000","last_fullsized":"2024-09-11T23:21:55.511082+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:23.665399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"70'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.512383+0000","last_change":"2024-09-11T23:21:53.474038+0000","last_active":"2024-09-11T23:21:55.512383+0000","last_peered":"2024-09-11T23:21:55.512383+0000","last_clean":"2024-09-11T23:21:55.512383+0000","last_became_active":"2024-09-11T23:21:53.473332+0000","last_became_peered":"2024-09-11T23:21:53.473332+0000","last_unstale":"2024-09-11T23:21:55.512383+0000","last_undegraded":"2024-09-11T23:21:55.512383+0000","last_fullsized":"2024-09-11T23:21:55.512383+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:41.854885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510906+0000","last_change":"2024-09-11T23:21:54.458222+0000","last_active":"2024-09-11T23:21:55.510906+0000","last_peered":"2024-09-11T23:21:55.510906+0000","last_clean":"2024-09-11T23:21:55.510906+0000","last_became_active":"2024-09-11T23:21:54.457957+0000","last_became_peered":"2024-09-11T23:21:54.457957+0000","last_unstale":"2024-09-11T23:21:55.510906+0000","last_undegraded":"2024-09-11T23:21:55.510906+0000","last_fullsized":"2024-09-11T23:21:55.510906+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:02.648965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511099+0000","last_change":"2024-09-11T23:21:53.473759+0000","last_active":"2024-09-11T23:21:55.511099+0000","last_peered":"2024-09-11T23:21:55.511099+0000","last_clean":"2024-09-11T23:21:55.511099+0000","last_became_active":"2024-09-11T23:21:53.473476+0000","last_became_peered":"2024-09-11T23:21:53.473476+0000","last_unstale":"2024-09-11T23:21:55.511099+0000","last_undegraded":"2024-09-11T23:21:55.511099+0000","last_fullsized":"2024-09-11T23:21:55.511099+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:42.391343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510513+0000","last_change":"2024-09-11T23:21:54.473242+0000","last_active":"2024-09-11T23:21:55.510513+0000","last_peered":"2024-09-11T23:21:55.510513+0000","last_clean":"2024-09-11T23:21:55.510513+0000","last_became_active":"2024-09-11T23:21:54.473003+0000","last_became_peered":"2024-09-11T23:21:54.473003+0000","last_unstale":"2024-09-11T23:21:55.510513+0000","last_undegraded":"2024-09-11T23:21:55.510513+0000","last_fullsized":"2024-09-11T23:21:55.510513+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:33.461975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511785+0000","last_change":"2024-09-11T23:21:53.473082+0000","last_active":"2024-09-11T23:21:55.511785+0000","last_peered":"2024-09-11T23:21:55.511785+0000","last_clean":"2024-09-11T23:21:55.511785+0000","last_became_active":"2024-09-11T23:21:53.472772+0000","last_became_peered":"2024-09-11T23:21:53.472772+0000","last_unstale":"2024-09-11T23:21:55.511785+0000","last_undegraded":"2024-09-11T23:21:55.511785+0000","last_fullsized":"2024-09-11T23:21:55.511785+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:02.766133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510206+0000","last_change":"2024-09-11T23:21:54.482280+0000","last_active":"2024-09-11T23:21:55.510206+0000","last_peered":"2024-09-11T23:21:55.510206+0000","last_clean":"2024-09-11T23:21:55.510206+0000","last_became_active":"2024-09-11T23:21:54.481977+0000","last_became_peered":"2024-09-11T23:21:54.481977+0000","last_unstale":"2024-09-11T23:21:55.510206+0000","last_undegraded":"2024-09-11T23:21:55.510206+0000","last_fullsized":"2024-09-11T23:21:55.510206+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:52.821654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.467445+0000","last_change":"2024-09-11T23:21:53.454657+0000","last_active":"2024-09-11T23:21:55.467445+0000","last_peered":"2024-09-11T23:21:55.467445+0000","last_clean":"2024-09-11T23:21:55.467445+0000","last_became_active":"2024-09-11T23:21:53.454348+0000","last_became_peered":"2024-09-11T23:21:53.454348+0000","last_unstale":"2024-09-11T23:21:55.467445+0000","last_undegraded":"2024-09-11T23:21:55.467445+0000","last_fullsized":"2024-09-11T23:21:55.467445+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:08.581853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510207+0000","last_change":"2024-09-11T23:21:54.482864+0000","last_active":"2024-09-11T23:21:55.510207+0000","last_peered":"2024-09-11T23:21:55.510207+0000","last_clean":"2024-09-11T23:21:55.510207+0000","last_became_active":"2024-09-11T23:21:54.482185+0000","last_became_peered":"2024-09-11T23:21:54.482185+0000","last_unstale":"2024-09-11T23:21:55.510207+0000","last_undegraded":"2024-09-11T23:21:55.510207+0000","last_fullsized":"2024-09-11T23:21:55.510207+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:28.808003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.468927+0000","last_change":"2024-09-11T23:21:53.463237+0000","last_active":"2024-09-11T23:21:55.468927+0000","last_peered":"2024-09-11T23:21:55.468927+0000","last_clean":"2024-09-11T23:21:55.468927+0000","last_became_active":"2024-09-11T23:21:53.462807+0000","last_became_peered":"2024-09-11T23:21:53.462807+0000","last_unstale":"2024-09-11T23:21:55.468927+0000","last_undegraded":"2024-09-11T23:21:55.468927+0000","last_fullsized":"2024-09-11T23:21:55.468927+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:39.933737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469402+0000","last_change":"2024-09-11T23:21:54.466743+0000","last_active":"2024-09-11T23:21:55.469402+0000","last_peered":"2024-09-11T23:21:55.469402+0000","last_clean":"2024-09-11T23:21:55.469402+0000","last_became_active":"2024-09-11T23:21:54.466490+0000","last_became_peered":"2024-09-11T23:21:54.466490+0000","last_unstale":"2024-09-11T23:21:55.469402+0000","last_undegraded":"2024-09-11T23:21:55.469402+0000","last_fullsized":"2024-09-11T23:21:55.469402+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:41.754162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"70'2","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.512601+0000","last_change":"2024-09-11T23:21:53.467675+0000","last_active":"2024-09-11T23:21:55.512601+0000","last_peered":"2024-09-11T23:21:55.512601+0000","last_clean":"2024-09-11T23:21:55.512601+0000","last_became_active":"2024-09-11T23:21:53.467403+0000","last_became_peered":"2024-09-11T23:21:53.467403+0000","last_unstale":"2024-09-11T23:21:55.512601+0000","last_undegraded":"2024-09-11T23:21:55.512601+0000","last_fullsized":"2024-09-11T23:21:55.512601+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:35.293491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.467712+0000","last_change":"2024-09-11T23:21:54.466727+0000","last_active":"2024-09-11T23:21:55.467712+0000","last_peered":"2024-09-11T23:21:55.467712+0000","last_clean":"2024-09-11T23:21:55.467712+0000","last_became_active":"2024-09-11T23:21:54.465666+0000","last_became_peered":"2024-09-11T23:21:54.465666+0000","last_unstale":"2024-09-11T23:21:55.467712+0000","last_undegraded":"2024-09-11T23:21:55.467712+0000","last_fullsized":"2024-09-11T23:21:55.467712+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:13.798720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"71'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.467911+0000","last_change":"2024-09-11T23:21:53.461181+0000","last_active":"2024-09-11T23:21:55.467911+0000","last_peered":"2024-09-11T23:21:55.467911+0000","last_clean":"2024-09-11T23:21:55.467911+0000","last_became_active":"2024-09-11T23:21:53.460896+0000","last_became_peered":"2024-09-11T23:21:53.460896+0000","last_unstale":"2024-09-11T23:21:55.467911+0000","last_undegraded":"2024-09-11T23:21:55.467911+0000","last_fullsized":"2024-09-11T23:21:55.467911+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:04.612943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511099+0000","last_change":"2024-09-11T23:21:54.485658+0000","last_active":"2024-09-11T23:21:55.511099+0000","last_peered":"2024-09-11T23:21:55.511099+0000","last_clean":"2024-09-11T23:21:55.511099+0000","last_became_active":"2024-09-11T23:21:54.485358+0000","last_became_peered":"2024-09-11T23:21:54.485358+0000","last_unstale":"2024-09-11T23:21:55.511099+0000","last_undegraded":"2024-09-11T23:21:55.511099+0000","last_fullsized":"2024-09-11T23:21:55.511099+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:18.067109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510956+0000","last_change":"2024-09-11T23:21:53.458342+0000","last_active":"2024-09-11T23:21:55.510956+0000","last_peered":"2024-09-11T23:21:55.510956+0000","last_clean":"2024-09-11T23:21:55.510956+0000","last_became_active":"2024-09-11T23:21:53.458058+0000","last_became_peered":"2024-09-11T23:21:53.458058+0000","last_unstale":"2024-09-11T23:21:55.510956+0000","last_undegraded":"2024-09-11T23:21:55.510956+0000","last_fullsized":"2024-09-11T23:21:55.510956+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:19.614803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511656+0000","last_change":"2024-09-11T23:21:54.463652+0000","last_active":"2024-09-11T23:21:55.511656+0000","last_peered":"2024-09-11T23:21:55.511656+0000","last_clean":"2024-09-11T23:21:55.511656+0000","last_became_active":"2024-09-11T23:21:54.463110+0000","last_became_peered":"2024-09-11T23:21:54.463110+0000","last_unstale":"2024-09-11T23:21:55.511656+0000","last_undegraded":"2024-09-11T23:21:55.511656+0000","last_fullsized":"2024-09-11T23:21:55.511656+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:40.066803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.469283+0000","last_change":"2024-09-11T23:21:53.466964+0000","last_active":"2024-09-11T23:21:55.469283+0000","last_peered":"2024-09-11T23:21:55.469283+0000","last_clean":"2024-09-11T23:21:55.469283+0000","last_became_active":"2024-09-11T23:21:53.466588+0000","last_became_peered":"2024-09-11T23:21:53.466588+0000","last_unstale":"2024-09-11T23:21:55.469283+0000","last_undegraded":"2024-09-11T23:21:55.469283+0000","last_fullsized":"2024-09-11T23:21:55.469283+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:22.927421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511492+0000","last_change":"2024-09-11T23:21:54.464965+0000","last_active":"2024-09-11T23:21:55.511492+0000","last_peered":"2024-09-11T23:21:55.511492+0000","last_clean":"2024-09-11T23:21:55.511492+0000","last_became_active":"2024-09-11T23:21:54.464691+0000","last_became_peered":"2024-09-11T23:21:54.464691+0000","last_unstale":"2024-09-11T23:21:55.511492+0000","last_undegraded":"2024-09-11T23:21:55.511492+0000","last_fullsized":"2024-09-11T23:21:55.511492+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:35.813966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510544+0000","last_change":"2024-09-11T23:21:53.455426+0000","last_active":"2024-09-11T23:21:55.510544+0000","last_peered":"2024-09-11T23:21:55.510544+0000","last_clean":"2024-09-11T23:21:55.510544+0000","last_became_active":"2024-09-11T23:21:53.454447+0000","last_became_peered":"2024-09-11T23:21:53.454447+0000","last_unstale":"2024-09-11T23:21:55.510544+0000","last_undegraded":"2024-09-11T23:21:55.510544+0000","last_fullsized":"2024-09-11T23:21:55.510544+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:24.893103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511934+0000","last_change":"2024-09-11T23:21:54.477778+0000","last_active":"2024-09-11T23:21:55.511934+0000","last_peered":"2024-09-11T23:21:55.511934+0000","last_clean":"2024-09-11T23:21:55.511934+0000","last_became_active":"2024-09-11T23:21:54.475823+0000","last_became_peered":"2024-09-11T23:21:54.475823+0000","last_unstale":"2024-09-11T23:21:55.511934+0000","last_undegraded":"2024-09-11T23:21:55.511934+0000","last_fullsized":"2024-09-11T23:21:55.511934+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:36:55.688218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511056+0000","last_change":"2024-09-11T23:21:53.468442+0000","last_active":"2024-09-11T23:21:55.511056+0000","last_peered":"2024-09-11T23:21:55.511056+0000","last_clean":"2024-09-11T23:21:55.511056+0000","last_became_active":"2024-09-11T23:21:53.468181+0000","last_became_peered":"2024-09-11T23:21:53.468181+0000","last_unstale":"2024-09-11T23:21:55.511056+0000","last_undegraded":"2024-09-11T23:21:55.511056+0000","last_fullsized":"2024-09-11T23:21:55.511056+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:02.766133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511460+0000","last_change":"2024-09-11T23:21:54.468522+0000","last_active":"2024-09-11T23:21:55.511460+0000","last_peered":"2024-09-11T23:21:55.511460+0000","last_clean":"2024-09-11T23:21:55.511460+0000","last_became_active":"2024-09-11T23:21:54.468225+0000","last_became_peered":"2024-09-11T23:21:54.468225+0000","last_unstale":"2024-09-11T23:21:55.511460+0000","last_undegraded":"2024-09-11T23:21:55.511460+0000","last_fullsized":"2024-09-11T23:21:55.511460+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:49.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.466435+0000","last_change":"2024-09-11T23:21:53.470911+0000","last_active":"2024-09-11T23:21:55.466435+0000","last_peered":"2024-09-11T23:21:55.466435+0000","last_clean":"2024-09-11T23:21:55.466435+0000","last_became_active":"2024-09-11T23:21:53.469831+0000","last_became_peered":"2024-09-11T23:21:53.469831+0000","last_unstale":"2024-09-11T23:21:55.466435+0000","last_undegraded":"2024-09-11T23:21:55.466435+0000","last_fullsized":"2024-09-11T23:21:55.466435+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:20.530963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511379+0000","last_change":"2024-09-11T23:21:54.470830+0000","last_active":"2024-09-11T23:21:55.511379+0000","last_peered":"2024-09-11T23:21:55.511379+0000","last_clean":"2024-09-11T23:21:55.511379+0000","last_became_active":"2024-09-11T23:21:54.470522+0000","last_became_peered":"2024-09-11T23:21:54.470522+0000","last_unstale":"2024-09-11T23:21:55.511379+0000","last_undegraded":"2024-09-11T23:21:55.511379+0000","last_fullsized":"2024-09-11T23:21:55.511379+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:38.062064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511738+0000","last_change":"2024-09-11T23:21:53.472150+0000","last_active":"2024-09-11T23:21:55.511738+0000","last_peered":"2024-09-11T23:21:55.511738+0000","last_clean":"2024-09-11T23:21:55.511738+0000","last_became_active":"2024-09-11T23:21:53.471468+0000","last_became_peered":"2024-09-11T23:21:53.471468+0000","last_unstale":"2024-09-11T23:21:55.511738+0000","last_undegraded":"2024-09-11T23:21:55.511738+0000","last_fullsized":"2024-09-11T23:21:55.511738+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:21.026252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.510574+0000","last_change":"2024-09-11T23:21:54.486108+0000","last_active":"2024-09-11T23:21:55.510574+0000","last_peered":"2024-09-11T23:21:55.510574+0000","last_clean":"2024-09-11T23:21:55.510574+0000","last_became_active":"2024-09-11T23:21:54.485872+0000","last_became_peered":"2024-09-11T23:21:54.485872+0000","last_unstale":"2024-09-11T23:21:55.510574+0000","last_undegraded":"2024-09-11T23:21:55.510574+0000","last_fullsized":"2024-09-11T23:21:55.510574+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:53.437368+0000","last_clean_scrub_stamp":"2024-09-11T23:21:53.437368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:06.750349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"70'2","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.511917+0000","last_change":"2024-09-11T23:21:53.470567+0000","last_active":"2024-09-11T23:21:55.511917+0000","last_peered":"2024-09-11T23:21:55.511917+0000","last_clean":"2024-09-11T23:21:55.511917+0000","last_became_active":"2024-09-11T23:21:53.470275+0000","last_became_peered":"2024-09-11T23:21:53.470275+0000","last_unstale":"2024-09-11T23:21:55.511917+0000","last_undegraded":"2024-09-11T23:21:55.511917+0000","last_fullsized":"2024-09-11T23:21:55.511917+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:21:52.429217+0000","last_clean_scrub_stamp":"2024-09-11T23:21:52.429217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:11.566507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":263,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-11T23:21:55.512283+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:21:55.512283+0000","last_peered":"2024-09-11T23:21:55.512283+0000","last_clean":"2024-09-11T23:21:55.512283+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:21:55.512283+0000","last_undegraded":"2024-09-11T23:21:55.512283+0000","last_fullsized":"2024-09-11T23:21:55.512283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476791,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1454080,"data_stored":948887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476790,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":860160,"data_stored":357995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476789,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":856064,"data_stored":357993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476789,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":856064,"data_stored":357973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":872448,"data_stored":360131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509493,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1445888,"data_stored":948271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542198,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":860160,"data_stored":358015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542198,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":864256,"data_stored":359515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:22:03.674 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:22:03.674 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:22:03.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.869+0000 7efc68400640 1 Processor -- start 2024-09-11T23:22:03.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.869+0000 7efc68400640 1 -- start start 2024-09-11T23:22:03.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.871+0000 7efc68400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc6006e500 0x7efc60167310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:03.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.871+0000 7efc68400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc600b4240 con 0x7efc600cf5d0 2024-09-11T23:22:03.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.871+0000 7efc68400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc600b4520 con 0x7efc60145d90 2024-09-11T23:22:03.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.871+0000 7efc68400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efc6006d080 con 0x7efc6006e500 2024-09-11T23:22:03.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.871+0000 7efc65000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7efc600cf5d0 0x7efc600cfa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53392/0 (socket says 172.21.15.144:53392) 2024-09-11T23:22:03.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.871+0000 7efc65000640 1 -- 172.21.15.144:0/3702623784 learned_addr learned my addr 172.21.15.144:0/3702623784 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:03.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.871+0000 7efc66400640 1 --2- 172.21.15.144:0/3702623784 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc6006e500 0x7efc60167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:03.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.871+0000 7efc5fe00640 1 -- 172.21.15.144:0/3702623784 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2986699530 0 0) 0x7efc600b4240 con 0x7efc600cf5d0 2024-09-11T23:22:03.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.871+0000 7efc5fe00640 1 -- 172.21.15.144:0/3702623784 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc48003520 con 0x7efc600cf5d0 2024-09-11T23:22:03.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.871+0000 7efc5fe00640 1 -- 172.21.15.144:0/3702623784 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2320814923 0 0) 0x7efc600b4520 con 0x7efc60145d90 2024-09-11T23:22:03.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.872+0000 7efc5fe00640 1 -- 172.21.15.144:0/3702623784 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc600b4240 con 0x7efc60145d90 2024-09-11T23:22:03.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.872+0000 7efc66400640 1 -- 172.21.15.144:0/3702623784 >> v1:172.21.15.165:6789/0 conn(0x7efc60145d90 legacy=0x7efc600ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:03.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.872+0000 7efc66400640 1 -- 172.21.15.144:0/3702623784 >> v1:172.21.15.144:6789/0 conn(0x7efc600cf5d0 legacy=0x7efc600cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:03.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.872+0000 7efc66400640 1 -- 172.21.15.144:0/3702623784 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc600b4800 con 0x7efc6006e500 2024-09-11T23:22:03.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.873+0000 7efc66400640 1 --2- 172.21.15.144:0/3702623784 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc6006e500 0x7efc60167310 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efc58009dc0 tx=0x7efc5802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d03ed563d95f4101 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:03.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.873+0000 7efc5fe00640 1 -- 172.21.15.144:0/3702623784 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc58007740 con 0x7efc6006e500 2024-09-11T23:22:03.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.873+0000 7efc5fe00640 1 -- 172.21.15.144:0/3702623784 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc580078e0 con 0x7efc6006e500 2024-09-11T23:22:03.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.873+0000 7efc5fe00640 1 -- 172.21.15.144:0/3702623784 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc58007cb0 con 0x7efc6006e500 2024-09-11T23:22:03.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.873+0000 7efc68400640 1 -- 172.21.15.144:0/3702623784 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc6006e500 msgr2=0x7efc60167310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:03.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.873+0000 7efc68400640 1 --2- 172.21.15.144:0/3702623784 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc6006e500 0x7efc60167310 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efc58009dc0 tx=0x7efc5802a6d0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.874+0000 7efc68400640 1 -- 172.21.15.144:0/3702623784 shutdown_connections 2024-09-11T23:22:03.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.874+0000 7efc68400640 1 --2- 172.21.15.144:0/3702623784 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc6006e500 0x7efc60167310 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.874+0000 7efc68400640 1 -- 172.21.15.144:0/3702623784 >> 172.21.15.144:0/3702623784 conn(0x7efc6006bba0 msgr2=0x7efc6006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:03.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.874+0000 7efc68400640 1 -- 172.21.15.144:0/3702623784 shutdown_connections 2024-09-11T23:22:03.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.874+0000 7efc68400640 1 -- 172.21.15.144:0/3702623784 wait complete. 2024-09-11T23:22:03.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.875+0000 7efc68400640 1 Processor -- start 2024-09-11T23:22:03.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.875+0000 7efc68400640 1 -- start start 2024-09-11T23:22:03.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.876+0000 7efc68400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc6006e500 0x7efc60140050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:03.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.876+0000 7efc68400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc600cf5d0 0x7efc6013db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:03.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.876+0000 7efc68400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc60145d90 0x7efc6015f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:03.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.876+0000 7efc68400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efc600b5610 con 0x7efc6006e500 2024-09-11T23:22:03.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.876+0000 7efc68400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efc600cd660 con 0x7efc60145d90 2024-09-11T23:22:03.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.876+0000 7efc68400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efc600b5790 con 0x7efc600cf5d0 2024-09-11T23:22:03.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.876+0000 7efc65a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc6006e500 0x7efc60140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:03.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.876+0000 7efc65a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc6006e500 0x7efc60140050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33852/0 (socket says 172.21.15.144:33852) 2024-09-11T23:22:03.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.877+0000 7efc65a00640 1 -- 172.21.15.144:0/256690976 learned_addr learned my addr 172.21.15.144:0/256690976 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:03.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.877+0000 7efc65000640 1 --2- 172.21.15.144:0/256690976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc600cf5d0 0x7efc6013db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:03.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.877+0000 7efc66400640 1 --2- 172.21.15.144:0/256690976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc60145d90 0x7efc6015f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:03.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.877+0000 7efc65a00640 1 -- 172.21.15.144:0/256690976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc600cf5d0 msgr2=0x7efc6013db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:03.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.877+0000 7efc65a00640 1 --2- 172.21.15.144:0/256690976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc600cf5d0 0x7efc6013db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.877+0000 7efc65a00640 1 -- 172.21.15.144:0/256690976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc60145d90 msgr2=0x7efc6015f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:03.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.877+0000 7efc65a00640 1 --2- 172.21.15.144:0/256690976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc60145d90 0x7efc6015f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:03.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.877+0000 7efc65a00640 1 -- 172.21.15.144:0/256690976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc601406e0 con 0x7efc6006e500 2024-09-11T23:22:03.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.877+0000 7efc65a00640 1 --2- 172.21.15.144:0/256690976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc6006e500 0x7efc60140050 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7efc5400c430 tx=0x7efc5400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:03.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.877+0000 7efc5d600640 1 -- 172.21.15.144:0/256690976 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54017070 con 0x7efc6006e500 2024-09-11T23:22:03.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.877+0000 7efc5d600640 1 -- 172.21.15.144:0/256690976 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc540052f0 con 0x7efc6006e500 2024-09-11T23:22:03.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.877+0000 7efc68400640 1 -- 172.21.15.144:0/256690976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc601409c0 con 0x7efc6006e500 2024-09-11T23:22:03.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.877+0000 7efc5d600640 1 -- 172.21.15.144:0/256690976 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54003830 con 0x7efc6006e500 2024-09-11T23:22:03.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.878+0000 7efc68400640 1 -- 172.21.15.144:0/256690976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc60150df0 con 0x7efc6006e500 2024-09-11T23:22:03.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.878+0000 7efc68400640 1 -- 172.21.15.144:0/256690976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc60146170 con 0x7efc6006e500 2024-09-11T23:22:03.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.879+0000 7efc5d600640 1 -- 172.21.15.144:0/256690976 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7efc5401a070 con 0x7efc6006e500 2024-09-11T23:22:03.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.880+0000 7efc5d600640 1 --2- 172.21.15.144:0/256690976 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc4006c1c0 0x7efc4006e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:03.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.880+0000 7efc5d600640 1 -- 172.21.15.144:0/256690976 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7efc5408a6b0 con 0x7efc6006e500 2024-09-11T23:22:03.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.881+0000 7efc65000640 1 --2- 172.21.15.144:0/256690976 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc4006c1c0 0x7efc4006e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:03.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.881+0000 7efc65000640 1 --2- 172.21.15.144:0/256690976 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc4006c1c0 0x7efc4006e680 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efc60143c60 tx=0x7efc4c007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:03.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:03.884+0000 7efc5d600640 1 -- 172.21.15.144:0/256690976 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc540585e0 con 0x7efc6006e500 2024-09-11T23:22:04.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.121+0000 7efc68400640 1 -- 172.21.15.144:0/256690976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7efc600b0750 con 0x7efc6006e500 2024-09-11T23:22:04.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.123+0000 7efc5d600640 1 -- 172.21.15.144:0/256690976 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7efc5405c8e0 con 0x7efc6006e500 2024-09-11T23:22:04.124 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-11T23:22:04.124 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A== 2024-09-11T23:22:04.124 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-11T23:22:04.125 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-11T23:22:04.125 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:22:04.125 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-11T23:22:04.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.126+0000 7efc68400640 1 -- 172.21.15.144:0/256690976 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc4006c1c0 msgr2=0x7efc4006e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:04.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.126+0000 7efc68400640 1 --2- 172.21.15.144:0/256690976 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc4006c1c0 0x7efc4006e680 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efc60143c60 tx=0x7efc4c007d30 comp rx=0 tx=0).stop 2024-09-11T23:22:04.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.126+0000 7efc68400640 1 -- 172.21.15.144:0/256690976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc6006e500 msgr2=0x7efc60140050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:04.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.126+0000 7efc68400640 1 --2- 172.21.15.144:0/256690976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc6006e500 0x7efc60140050 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7efc5400c430 tx=0x7efc5400c8f0 comp rx=0 tx=0).stop 2024-09-11T23:22:04.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.126+0000 7efc68400640 1 -- 172.21.15.144:0/256690976 shutdown_connections 2024-09-11T23:22:04.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.126+0000 7efc68400640 1 --2- 172.21.15.144:0/256690976 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7efc4006c1c0 0x7efc4006e680 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:04.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.126+0000 7efc68400640 1 --2- 172.21.15.144:0/256690976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc60145d90 0x7efc6015f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:04.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.126+0000 7efc68400640 1 --2- 172.21.15.144:0/256690976 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efc600cf5d0 0x7efc6013db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:04.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.126+0000 7efc68400640 1 --2- 172.21.15.144:0/256690976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efc6006e500 0x7efc60140050 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:04.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.126+0000 7efc68400640 1 -- 172.21.15.144:0/256690976 >> 172.21.15.144:0/256690976 conn(0x7efc6006bba0 msgr2=0x7efc600cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:04.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.126+0000 7efc68400640 1 -- 172.21.15.144:0/256690976 shutdown_connections 2024-09-11T23:22:04.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.126+0000 7efc68400640 1 -- 172.21.15.144:0/256690976 wait complete. 2024-09-11T23:22:04.142 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:22:04.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.296+0000 7fa420800640 1 Processor -- start 2024-09-11T23:22:04.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.296+0000 7fa420800640 1 -- start start 2024-09-11T23:22:04.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.297+0000 7fa420800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4180cf070 0x7fa4180cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:04.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.297+0000 7fa420800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4180ce740 con 0x7fa418073120 2024-09-11T23:22:04.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.297+0000 7fa420800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa418072640 con 0x7fa41815c180 2024-09-11T23:22:04.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.297+0000 7fa420800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa418072920 con 0x7fa4180cf070 2024-09-11T23:22:04.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.298+0000 7fa41e800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa418073120 0x7fa41806bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:53402/0 (socket says 172.21.15.144:53402) 2024-09-11T23:22:04.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.298+0000 7fa41e800640 1 -- 172.21.15.144:0/4108341416 learned_addr learned my addr 172.21.15.144:0/4108341416 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:04.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.298+0000 7fa41d400640 1 --2- 172.21.15.144:0/4108341416 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4180cf070 0x7fa4180cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:04.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.298+0000 7fa41ca00640 1 -- 172.21.15.144:0/4108341416 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3612630190 0 0) 0x7fa4180ce740 con 0x7fa418073120 2024-09-11T23:22:04.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.298+0000 7fa41ca00640 1 -- 172.21.15.144:0/4108341416 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa400003520 con 0x7fa418073120 2024-09-11T23:22:04.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.298+0000 7fa41ca00640 1 -- 172.21.15.144:0/4108341416 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1332165756 0 0) 0x7fa418072640 con 0x7fa41815c180 2024-09-11T23:22:04.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.298+0000 7fa41ca00640 1 -- 172.21.15.144:0/4108341416 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4180ce740 con 0x7fa41815c180 2024-09-11T23:22:04.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.298+0000 7fa41d400640 1 -- 172.21.15.144:0/4108341416 >> v1:172.21.15.165:6789/0 conn(0x7fa41815c180 legacy=0x7fa4180cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:04.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.298+0000 7fa41d400640 1 -- 172.21.15.144:0/4108341416 >> v1:172.21.15.144:6789/0 conn(0x7fa418073120 legacy=0x7fa41806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:04.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.298+0000 7fa41d400640 1 -- 172.21.15.144:0/4108341416 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa418072c00 con 0x7fa4180cf070 2024-09-11T23:22:04.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.300+0000 7fa41d400640 1 --2- 172.21.15.144:0/4108341416 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4180cf070 0x7fa4180cf4b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa4080097d0 tx=0x7fa40802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b0e45541f9babed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:04.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.300+0000 7fa41ca00640 1 -- 172.21.15.144:0/4108341416 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa408037070 con 0x7fa4180cf070 2024-09-11T23:22:04.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.300+0000 7fa41ca00640 1 -- 172.21.15.144:0/4108341416 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa408032440 con 0x7fa4180cf070 2024-09-11T23:22:04.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.300+0000 7fa41ca00640 1 -- 172.21.15.144:0/4108341416 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa408032810 con 0x7fa4180cf070 2024-09-11T23:22:04.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.300+0000 7fa420800640 1 -- 172.21.15.144:0/4108341416 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4180cf070 msgr2=0x7fa4180cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:04.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.300+0000 7fa420800640 1 --2- 172.21.15.144:0/4108341416 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4180cf070 0x7fa4180cf4b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa4080097d0 tx=0x7fa40802a180 comp rx=0 tx=0).stop 2024-09-11T23:22:04.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.300+0000 7fa420800640 1 -- 172.21.15.144:0/4108341416 shutdown_connections 2024-09-11T23:22:04.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.300+0000 7fa420800640 1 --2- 172.21.15.144:0/4108341416 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4180cf070 0x7fa4180cf4b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:04.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.300+0000 7fa420800640 1 -- 172.21.15.144:0/4108341416 >> 172.21.15.144:0/4108341416 conn(0x7fa418062cc0 msgr2=0x7fa41806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:04.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.300+0000 7fa420800640 1 -- 172.21.15.144:0/4108341416 shutdown_connections 2024-09-11T23:22:04.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.301+0000 7fa420800640 1 -- 172.21.15.144:0/4108341416 wait complete. 2024-09-11T23:22:04.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.302+0000 7fa420800640 1 Processor -- start 2024-09-11T23:22:04.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.302+0000 7fa420800640 1 -- start start 2024-09-11T23:22:04.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.303+0000 7fa420800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa418073120 0x7fa418152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:04.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.303+0000 7fa420800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4180cf070 0x7fa418149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:04.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.303+0000 7fa420800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa41815c180 0x7fa4180b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:04.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.303+0000 7fa420800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4180722f0 con 0x7fa418073120 2024-09-11T23:22:04.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.303+0000 7fa420800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa4180ced00 con 0x7fa41815c180 2024-09-11T23:22:04.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.303+0000 7fa420800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa41815c560 con 0x7fa4180cf070 2024-09-11T23:22:04.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.303+0000 7fa41de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa418073120 0x7fa418152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:04.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.303+0000 7fa41de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa418073120 0x7fa418152fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:33860/0 (socket says 172.21.15.144:33860) 2024-09-11T23:22:04.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.303+0000 7fa41de00640 1 -- 172.21.15.144:0/74392664 learned_addr learned my addr 172.21.15.144:0/74392664 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:04.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.303+0000 7fa41e800640 1 --2- 172.21.15.144:0/74392664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa41815c180 0x7fa4180b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:04.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.303+0000 7fa41d400640 1 --2- 172.21.15.144:0/74392664 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4180cf070 0x7fa418149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:04.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.304+0000 7fa41de00640 1 -- 172.21.15.144:0/74392664 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4180cf070 msgr2=0x7fa418149b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:04.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.304+0000 7fa41de00640 1 --2- 172.21.15.144:0/74392664 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4180cf070 0x7fa418149b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:04.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.304+0000 7fa41de00640 1 -- 172.21.15.144:0/74392664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa41815c180 msgr2=0x7fa4180b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:04.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.304+0000 7fa41de00640 1 --2- 172.21.15.144:0/74392664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa41815c180 0x7fa4180b45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:04.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.304+0000 7fa41de00640 1 -- 172.21.15.144:0/74392664 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4180b1a90 con 0x7fa418073120 2024-09-11T23:22:04.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.304+0000 7fa41e800640 1 --2- 172.21.15.144:0/74392664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa41815c180 0x7fa4180b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:04.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.304+0000 7fa41de00640 1 --2- 172.21.15.144:0/74392664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa418073120 0x7fa418152fa0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa40c00c500 tx=0x7fa40c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:04.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.304+0000 7fa412000640 1 -- 172.21.15.144:0/74392664 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c0052d0 con 0x7fa418073120 2024-09-11T23:22:04.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.304+0000 7fa412000640 1 -- 172.21.15.144:0/74392664 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa40c005490 con 0x7fa418073120 2024-09-11T23:22:04.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.304+0000 7fa420800640 1 -- 172.21.15.144:0/74392664 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4180b1d70 con 0x7fa418073120 2024-09-11T23:22:04.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.304+0000 7fa412000640 1 -- 172.21.15.144:0/74392664 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c012870 con 0x7fa418073120 2024-09-11T23:22:04.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.305+0000 7fa420800640 1 -- 172.21.15.144:0/74392664 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa418152550 con 0x7fa418073120 2024-09-11T23:22:04.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.305+0000 7fa420800640 1 -- 172.21.15.144:0/74392664 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa418071000 con 0x7fa418073120 2024-09-11T23:22:04.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.306+0000 7fa412000640 1 -- 172.21.15.144:0/74392664 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7fa40c012a10 con 0x7fa418073120 2024-09-11T23:22:04.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.307+0000 7fa412000640 1 --2- 172.21.15.144:0/74392664 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa3fc06c190 0x7fa3fc06e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:04.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.307+0000 7fa412000640 1 -- 172.21.15.144:0/74392664 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7fa40c08b0f0 con 0x7fa418073120 2024-09-11T23:22:04.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.307+0000 7fa41d400640 1 --2- 172.21.15.144:0/74392664 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa3fc06c190 0x7fa3fc06e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:04.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.308+0000 7fa41d400640 1 --2- 172.21.15.144:0/74392664 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa3fc06c190 0x7fa3fc06e650 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa408034000 tx=0x7fa40802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:04.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.311+0000 7fa412000640 1 -- 172.21.15.144:0/74392664 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa418071000 con 0x7fa418073120 2024-09-11T23:22:04.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.522+0000 7fa420800640 1 -- 172.21.15.144:0/74392664 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4180cf4b0 con 0x7fa418073120 2024-09-11T23:22:04.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.523+0000 7fa412000640 1 -- 172.21.15.144:0/74392664 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5228 (secure 0 0 0) 0x7fa40c059560 con 0x7fa418073120 2024-09-11T23:22:04.524 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:04.524 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":46,"btime":"2024-09-11T23:21:57:477637+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5417,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/494282276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":494282276},{"type":"v1","addr":"172.21.15.165:6833","nonce":494282276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5827,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1734890696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":1734890696},{"type":"v1","addr":"172.21.15.165:6835","nonce":1734890696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1671926294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1671926294},{"type":"v1","addr":"172.21.15.144:6836","nonce":1671926294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:21:53.856502+0000","modified":"2024-09-11T23:21:56.886031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6093},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6093":{"gid":6093,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6837/97031260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":97031260},{"type":"v1","addr":"172.21.15.144:6837","nonce":97031260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6093,"qdb_cluster":[6093]},"id":5}]} 2024-09-11T23:22:04.524 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 46 2024-09-11T23:22:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.525+0000 7fa420800640 1 -- 172.21.15.144:0/74392664 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa3fc06c190 msgr2=0x7fa3fc06e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.525+0000 7fa420800640 1 --2- 172.21.15.144:0/74392664 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa3fc06c190 0x7fa3fc06e650 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa408034000 tx=0x7fa40802e000 comp rx=0 tx=0).stop 2024-09-11T23:22:04.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.525+0000 7fa420800640 1 -- 172.21.15.144:0/74392664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa418073120 msgr2=0x7fa418152fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.525+0000 7fa420800640 1 --2- 172.21.15.144:0/74392664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa418073120 0x7fa418152fa0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa40c00c500 tx=0x7fa40c00c9c0 comp rx=0 tx=0).stop 2024-09-11T23:22:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.525+0000 7fa420800640 1 -- 172.21.15.144:0/74392664 shutdown_connections 2024-09-11T23:22:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.525+0000 7fa420800640 1 --2- 172.21.15.144:0/74392664 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa3fc06c190 0x7fa3fc06e650 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.525+0000 7fa420800640 1 --2- 172.21.15.144:0/74392664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa41815c180 0x7fa4180b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.525+0000 7fa420800640 1 --2- 172.21.15.144:0/74392664 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4180cf070 0x7fa418149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.525+0000 7fa420800640 1 --2- 172.21.15.144:0/74392664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa418073120 0x7fa418152fa0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.525+0000 7fa420800640 1 -- 172.21.15.144:0/74392664 >> 172.21.15.144:0/74392664 conn(0x7fa418062cc0 msgr2=0x7fa418158790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.525+0000 7fa420800640 1 -- 172.21.15.144:0/74392664 shutdown_connections 2024-09-11T23:22:04.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:04.525+0000 7fa420800640 1 -- 172.21.15.144:0/74392664 wait complete. 2024-09-11T23:22:04.947 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:21:53.856502+0000', 'modified': '2024-09-11T23:21:56.886031+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6093}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6093': {'gid': 6093, 'name': 'a', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.144:6837/97031260', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6835', 'nonce': 97031260}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 97031260}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6093, 'qdb_cluster': [6093]} 2024-09-11T23:22:04.947 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:22:04.947 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T23:22:05.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.102+0000 7f0140a00640 1 Processor -- start 2024-09-11T23:22:05.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.102+0000 7f0140a00640 1 -- start start 2024-09-11T23:22:05.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.103+0000 7f0140a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f013c0b6410 0x7f013c0b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.103+0000 7f0140a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f013c06bee0 con 0x7f013c0b5fd0 2024-09-11T23:22:05.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.103+0000 7f0140a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f013c06c1c0 con 0x7f013c15e640 2024-09-11T23:22:05.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.103+0000 7f0140a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f013c15ea20 con 0x7f013c0b6410 2024-09-11T23:22:05.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.104+0000 7f013b200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f013c0b6410 0x7f013c0b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.104+0000 7f0139e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f013c0b5fd0 0x7f013c0b7750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:38028/0 (socket says 172.21.15.144:38028) 2024-09-11T23:22:05.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.104+0000 7f0139e00640 1 -- 172.21.15.144:0/137511781 learned_addr learned my addr 172.21.15.144:0/137511781 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:05.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.104+0000 7f013b200640 1 -- 172.21.15.144:0/137511781 >> v1:172.21.15.165:6789/0 conn(0x7f013c15e640 legacy=0x7f013c0d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:05.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.104+0000 7f013b200640 1 -- 172.21.15.144:0/137511781 >> v1:172.21.15.144:6789/0 conn(0x7f013c0b5fd0 legacy=0x7f013c0b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:05.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.104+0000 7f013b200640 1 -- 172.21.15.144:0/137511781 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013c06c4a0 con 0x7f013c0b6410 2024-09-11T23:22:05.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.105+0000 7f013b200640 1 --2- 172.21.15.144:0/137511781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c0b6410 0x7f013c0b7e60 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0134009d90 tx=0x7f013402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75ca8ea4b3b4a80 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:05.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.105+0000 7f0139400640 1 -- 172.21.15.144:0/137511781 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0134007740 con 0x7f013c0b6410 2024-09-11T23:22:05.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.105+0000 7f0139400640 1 -- 172.21.15.144:0/137511781 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01340078e0 con 0x7f013c0b6410 2024-09-11T23:22:05.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.105+0000 7f0139400640 1 -- 172.21.15.144:0/137511781 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0134007cb0 con 0x7f013c0b6410 2024-09-11T23:22:05.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.106+0000 7f0140a00640 1 -- 172.21.15.144:0/137511781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c0b6410 msgr2=0x7f013c0b7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:05.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.106+0000 7f0140a00640 1 --2- 172.21.15.144:0/137511781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c0b6410 0x7f013c0b7e60 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0134009d90 tx=0x7f013402a6f0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.106+0000 7f0140a00640 1 -- 172.21.15.144:0/137511781 shutdown_connections 2024-09-11T23:22:05.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.106+0000 7f0140a00640 1 --2- 172.21.15.144:0/137511781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c0b6410 0x7f013c0b7e60 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.106+0000 7f0140a00640 1 -- 172.21.15.144:0/137511781 >> 172.21.15.144:0/137511781 conn(0x7f013c0d0fd0 msgr2=0x7f013c0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:05.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.106+0000 7f0140a00640 1 -- 172.21.15.144:0/137511781 shutdown_connections 2024-09-11T23:22:05.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.106+0000 7f0140a00640 1 -- 172.21.15.144:0/137511781 wait complete. 2024-09-11T23:22:05.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.108+0000 7f0140a00640 1 Processor -- start 2024-09-11T23:22:05.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.108+0000 7f0140a00640 1 -- start start 2024-09-11T23:22:05.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.109+0000 7f0140a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c0b5fd0 0x7f013c1529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.109+0000 7f0140a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f013c0b6410 0x7f013c0ab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.109+0000 7f0140a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013c15e640 0x7f013c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.109+0000 7f0140a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f013c0b68a0 con 0x7f013c0b5fd0 2024-09-11T23:22:05.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.109+0000 7f0140a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f013c06caf0 con 0x7f013c0b6410 2024-09-11T23:22:05.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.109+0000 7f0140a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f013c0d4130 con 0x7f013c15e640 2024-09-11T23:22:05.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.109+0000 7f013a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c0b5fd0 0x7f013c1529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.109+0000 7f013a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c0b5fd0 0x7f013c1529b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48384/0 (socket says 172.21.15.144:48384) 2024-09-11T23:22:05.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.109+0000 7f013a800640 1 -- 172.21.15.144:0/20708912 learned_addr learned my addr 172.21.15.144:0/20708912 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:05.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.109+0000 7f013b200640 1 --2- 172.21.15.144:0/20708912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013c15e640 0x7f013c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.109+0000 7f0139e00640 1 --2- 172.21.15.144:0/20708912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f013c0b6410 0x7f013c0ab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.109+0000 7f013a800640 1 -- 172.21.15.144:0/20708912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013c15e640 msgr2=0x7f013c0b8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:05.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.109+0000 7f013a800640 1 --2- 172.21.15.144:0/20708912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013c15e640 0x7f013c0b8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.109+0000 7f013a800640 1 -- 172.21.15.144:0/20708912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f013c0b6410 msgr2=0x7f013c0ab9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:05.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.109+0000 7f013a800640 1 --2- 172.21.15.144:0/20708912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f013c0b6410 0x7f013c0ab9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.109+0000 7f013a800640 1 -- 172.21.15.144:0/20708912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013c152ef0 con 0x7f013c0b5fd0 2024-09-11T23:22:05.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.110+0000 7f013a800640 1 --2- 172.21.15.144:0/20708912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c0b5fd0 0x7f013c1529b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f012c00c450 tx=0x7f012c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:05.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.110+0000 7f0132a00640 1 -- 172.21.15.144:0/20708912 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c0052d0 con 0x7f013c0b5fd0 2024-09-11T23:22:05.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.110+0000 7f0132a00640 1 -- 172.21.15.144:0/20708912 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f012c005470 con 0x7f013c0b5fd0 2024-09-11T23:22:05.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.110+0000 7f0132a00640 1 -- 172.21.15.144:0/20708912 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c012870 con 0x7f013c0b5fd0 2024-09-11T23:22:05.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.110+0000 7f0140a00640 1 -- 172.21.15.144:0/20708912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013c0ac460 con 0x7f013c0b5fd0 2024-09-11T23:22:05.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.110+0000 7f0140a00640 1 -- 172.21.15.144:0/20708912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f013c0aca20 con 0x7f013c0b5fd0 2024-09-11T23:22:05.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.112+0000 7f0132a00640 1 -- 172.21.15.144:0/20708912 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f012c012a10 con 0x7f013c0b5fd0 2024-09-11T23:22:05.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.113+0000 7f0132a00640 1 --2- 172.21.15.144:0/20708912 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f011c06c190 0x7f011c06e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.113+0000 7f0132a00640 1 -- 172.21.15.144:0/20708912 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f012c08af90 con 0x7f013c0b5fd0 2024-09-11T23:22:05.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.113+0000 7f0139e00640 1 --2- 172.21.15.144:0/20708912 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f011c06c190 0x7f011c06e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.114+0000 7f0144410740 1 Processor -- start 2024-09-11T23:22:05.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.114+0000 7f0144410740 1 -- start start 2024-09-11T23:22:05.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.114+0000 7f0139e00640 1 --2- 172.21.15.144:0/20708912 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f011c06c190 0x7f011c06e650 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f013c15e1e0 tx=0x7f0128009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:05.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.115+0000 7f0144410740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5601789e4ea0 0x560178a2a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.115+0000 7f0144410740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601789e2660 0x5601789e5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.115+0000 7f0144410740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5601789e6630 0x5601789df720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.115+0000 7f0144410740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5601789433b0 con 0x5601789e2660 2024-09-11T23:22:05.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.115+0000 7f0144410740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560178948410 con 0x5601789e6630 2024-09-11T23:22:05.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.115+0000 7f0144410740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5601788f0620 con 0x5601789e4ea0 2024-09-11T23:22:05.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.115+0000 7f0139e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601789e2660 0x5601789e5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.115+0000 7f0139e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601789e2660 0x5601789e5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48394/0 (socket says 172.21.15.144:48394) 2024-09-11T23:22:05.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.115+0000 7f0139e00640 1 -- 172.21.15.144:0/565804078 learned_addr learned my addr 172.21.15.144:0/565804078 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:05.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.115+0000 7f013b200640 1 --2- 172.21.15.144:0/565804078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5601789e6630 0x5601789df720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.115+0000 7f013a800640 1 --2- 172.21.15.144:0/565804078 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5601789e4ea0 0x560178a2a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.115+0000 7f0139e00640 1 -- 172.21.15.144:0/565804078 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5601789e4ea0 msgr2=0x560178a2a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:05.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.115+0000 7f0139e00640 1 --2- 172.21.15.144:0/565804078 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5601789e4ea0 0x560178a2a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.115+0000 7f0139e00640 1 -- 172.21.15.144:0/565804078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5601789e6630 msgr2=0x5601789df720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:05.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.115+0000 7f0139e00640 1 --2- 172.21.15.144:0/565804078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5601789e6630 0x5601789df720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.115+0000 7f0139e00640 1 -- 172.21.15.144:0/565804078 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56017865b2d0 con 0x5601789e2660 2024-09-11T23:22:05.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.116+0000 7f0139e00640 1 --2- 172.21.15.144:0/565804078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601789e2660 0x5601789e5280 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f012800fb40 tx=0x7f0128012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53f061fc45d3e6b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:05.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.116+0000 7f0127000640 1 -- 172.21.15.144:0/565804078 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0128025070 con 0x5601789e2660 2024-09-11T23:22:05.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.116+0000 7f0127000640 1 -- 172.21.15.144:0/565804078 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f012801b050 con 0x5601789e2660 2024-09-11T23:22:05.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.116+0000 7f0127000640 1 -- 172.21.15.144:0/565804078 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0128014de0 con 0x5601789e2660 2024-09-11T23:22:05.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.116+0000 7f0144410740 1 -- 172.21.15.144:0/565804078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601789e2660 msgr2=0x5601789e5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:05.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.116+0000 7f0144410740 1 --2- 172.21.15.144:0/565804078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601789e2660 0x5601789e5280 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f012800fb40 tx=0x7f0128012000 comp rx=0 tx=0).stop 2024-09-11T23:22:05.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.117+0000 7f0144410740 1 -- 172.21.15.144:0/565804078 shutdown_connections 2024-09-11T23:22:05.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.117+0000 7f0144410740 1 --2- 172.21.15.144:0/565804078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5601789e6630 0x5601789df720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.117+0000 7f0144410740 1 --2- 172.21.15.144:0/565804078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601789e2660 0x5601789e5280 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.117+0000 7f0144410740 1 --2- 172.21.15.144:0/565804078 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5601789e4ea0 0x560178a2a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.117+0000 7f0144410740 1 -- 172.21.15.144:0/565804078 >> 172.21.15.144:0/565804078 conn(0x5601789e18f0 msgr2=0x560178a29b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:05.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.117+0000 7f0144410740 1 -- 172.21.15.144:0/565804078 shutdown_connections 2024-09-11T23:22:05.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.117+0000 7f0144410740 1 -- 172.21.15.144:0/565804078 wait complete. 2024-09-11T23:22:05.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.117+0000 7f0144410740 1 -- start start 2024-09-11T23:22:05.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.118+0000 7f0144410740 1 Processor -- start 2024-09-11T23:22:05.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.118+0000 7f0144410740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5601789e4ea0 0x560178a0ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.118+0000 7f0144410740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5601789e6630 0x5601789df190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.119+0000 7f0144410740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560178a0fec0 0x5601789df6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.119+0000 7f0144410740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560178903780 con 0x560178a0fec0 2024-09-11T23:22:05.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.119+0000 7f0144410740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5601789443d0 con 0x5601789e6630 2024-09-11T23:22:05.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.119+0000 7f0144410740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x5601789e0d90 con 0x5601789e4ea0 2024-09-11T23:22:05.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.119+0000 7f0144410740 10 client.0 _ll_register_callbacks cb 0x5601789415d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:22:05.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.119+0000 7f013b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560178a0fec0 0x5601789df6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.119+0000 7f013b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560178a0fec0 0x5601789df6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48408/0 (socket says 172.21.15.144:48408) 2024-09-11T23:22:05.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.119+0000 7f013b200640 1 -- 172.21.15.144:0/2630511012 learned_addr learned my addr 172.21.15.144:0/2630511012 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:05.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.119+0000 7f0139e00640 1 --2- 172.21.15.144:0/2630511012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5601789e6630 0x5601789df190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.119+0000 7f013a800640 1 --2- 172.21.15.144:0/2630511012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5601789e4ea0 0x560178a0ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.119+0000 7f013b200640 1 -- 172.21.15.144:0/2630511012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5601789e4ea0 msgr2=0x560178a0ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:05.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.119+0000 7f013b200640 1 --2- 172.21.15.144:0/2630511012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5601789e4ea0 0x560178a0ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.119+0000 7f013b200640 1 -- 172.21.15.144:0/2630511012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5601789e6630 msgr2=0x5601789df190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:05.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.119+0000 7f013b200640 1 --2- 172.21.15.144:0/2630511012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5601789e6630 0x5601789df190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.119+0000 7f013b200640 1 -- 172.21.15.144:0/2630511012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601787256b0 con 0x560178a0fec0 2024-09-11T23:22:05.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.120+0000 7f013b200640 1 --2- 172.21.15.144:0/2630511012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560178a0fec0 0x5601789df6d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0134009eb0 tx=0x7f0134004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40158b9e8cadbfa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:05.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.120+0000 7f011b400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:22:05.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.120+0000 7f011b400640 1 -- 172.21.15.144:0/2630511012 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013404b060 con 0x560178a0fec0 2024-09-11T23:22:05.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.120+0000 7f011b400640 1 -- 172.21.15.144:0/2630511012 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f013403c420 con 0x560178a0fec0 2024-09-11T23:22:05.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.120+0000 7f0144410740 1 -- 172.21.15.144:0/2630511012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f012801b050 con 0x560178a0fec0 2024-09-11T23:22:05.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.120+0000 7f011b400640 1 -- 172.21.15.144:0/2630511012 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f0134051050 con 0x560178a0fec0 2024-09-11T23:22:05.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.120+0000 7f0144410740 10 client.6264 fetch_fsmap learned FSMap version 46 2024-09-11T23:22:05.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.120+0000 7f0144410740 1 -- 172.21.15.144:0/2630511012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) -- 0x560178a0c920 con 0x560178a0fec0 2024-09-11T23:22:05.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.120+0000 7f011b400640 1 -- 172.21.15.144:0/2630511012 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f012801b050 con 0x560178a0fec0 2024-09-11T23:22:05.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.120+0000 7f011b400640 1 -- 172.21.15.144:0/2630511012 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 46) ==== 3502+0+0 (secure 0 0 0) 0x7f0134054020 con 0x560178a0fec0 2024-09-11T23:22:05.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.120+0000 7f0144410740 10 client.6264 fetch_fsmap finished waiting for FSMap version 46 2024-09-11T23:22:05.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.120+0000 7f0144410740 10 client.6264 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T23:22:05.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.120+0000 7f0144410740 20 client.6264 populate_metadata read hostname 'smithi144' 2024-09-11T23:22:05.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.120+0000 7f0144410740 1 --2- 172.21.15.144:0/2630511012 >> [v2:172.21.15.144:6835/97031260,v1:172.21.15.144:6837/97031260] conn(0x560178a3dfc0 0x560178a48d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.121+0000 7f0144410740 4 client.6264 mds_command: new command op to 6093 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:22:05.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.121+0000 7f0144410740 1 -- 172.21.15.144:0/2630511012 --> [v2:172.21.15.144:6835/97031260,v1:172.21.15.144:6837/97031260] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560178955b40 con 0x560178a3dfc0 2024-09-11T23:22:05.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.121+0000 7f013a800640 1 --2- 172.21.15.144:0/2630511012 >> [v2:172.21.15.144:6835/97031260,v1:172.21.15.144:6837/97031260] conn(0x560178a3dfc0 0x560178a48d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.121+0000 7f013a800640 1 --2- 172.21.15.144:0/2630511012 >> [v2:172.21.15.144:6835/97031260,v1:172.21.15.144:6837/97031260] conn(0x560178a3dfc0 0x560178a48d20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ae76db9740c63d7 server_cookie=4cc77b02c59d2b93 in_seq=0 out_seq=0 2024-09-11T23:22:05.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.121+0000 7f011b400640 10 client.6264 ms_handle_connect on v2:172.21.15.144:6835/97031260 2024-09-11T23:22:05.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.122+0000 7f011b400640 1 -- 172.21.15.144:0/2630511012 <== mds.0 v2:172.21.15.144:6835/97031260 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560178955b40 con 0x560178a3dfc0 2024-09-11T23:22:05.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.122+0000 7f011b400640 10 client.6264 handle_command_reply: tid=0 2024-09-11T23:22:05.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.122+0000 7f0144410740 1 client.6264 shutdown 2024-09-11T23:22:05.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.122+0000 7f0144410740 1 -- 172.21.15.144:0/2630511012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560178a0fec0 msgr2=0x5601789df6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:05.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.122+0000 7f0144410740 1 --2- 172.21.15.144:0/2630511012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560178a0fec0 0x5601789df6d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0134009eb0 tx=0x7f0134004ab0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.122+0000 7f0144410740 1 -- 172.21.15.144:0/2630511012 shutdown_connections 2024-09-11T23:22:05.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.122+0000 7f0144410740 1 --2- 172.21.15.144:0/2630511012 >> [v2:172.21.15.144:6835/97031260,v1:172.21.15.144:6837/97031260] conn(0x560178a3dfc0 0x560178a48d20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.122+0000 7f0144410740 1 --2- 172.21.15.144:0/2630511012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560178a0fec0 0x5601789df6d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.122+0000 7f0144410740 1 --2- 172.21.15.144:0/2630511012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5601789e6630 0x5601789df190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.122+0000 7f011b400640 0 client.6264 ms_handle_reset on v2:172.21.15.144:6835/97031260 2024-09-11T23:22:05.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.122+0000 7f0144410740 1 --2- 172.21.15.144:0/2630511012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5601789e4ea0 0x560178a0ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.122+0000 7f0144410740 1 -- 172.21.15.144:0/2630511012 >> 172.21.15.144:0/2630511012 conn(0x5601789e2660 msgr2=0x560178a27b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:05.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.123+0000 7f0144410740 1 -- 172.21.15.144:0/2630511012 shutdown_connections 2024-09-11T23:22:05.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.123+0000 7f0144410740 1 -- 172.21.15.144:0/2630511012 wait complete. 2024-09-11T23:22:05.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.123+0000 7f0144410740 20 client.6264 trim_cache size 0 max 16384 2024-09-11T23:22:05.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.141+0000 7f0144410740 1 Processor -- start 2024-09-11T23:22:05.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.141+0000 7f0144410740 1 -- start start 2024-09-11T23:22:05.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.142+0000 7f0144410740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601789e4ea0 0x560178a0d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.142+0000 7f0144410740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5601789e6630 0x560178a291e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.142+0000 7f0144410740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560178a0fec0 0x560178a29720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.142+0000 7f0144410740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f013c200b10 con 0x5601789e4ea0 2024-09-11T23:22:05.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.142+0000 7f0144410740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f013c1ffb70 con 0x560178a0fec0 2024-09-11T23:22:05.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.142+0000 7f0144410740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f013c1f4b20 con 0x5601789e6630 2024-09-11T23:22:05.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.142+0000 7f013a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601789e4ea0 0x560178a0d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.142+0000 7f013a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601789e4ea0 0x560178a0d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48420/0 (socket says 172.21.15.144:48420) 2024-09-11T23:22:05.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.142+0000 7f013a800640 1 -- 172.21.15.144:0/3981479700 learned_addr learned my addr 172.21.15.144:0/3981479700 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:05.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.142+0000 7f013a800640 1 -- 172.21.15.144:0/3981479700 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5601789e6630 msgr2=0x560178a291e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:05.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.142+0000 7f013a800640 1 --2- 172.21.15.144:0/3981479700 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5601789e6630 0x560178a291e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.142+0000 7f013a800640 1 -- 172.21.15.144:0/3981479700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560178a0fec0 msgr2=0x560178a29720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:05.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.142+0000 7f013a800640 1 --2- 172.21.15.144:0/3981479700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560178a0fec0 0x560178a29720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.142+0000 7f013a800640 1 -- 172.21.15.144:0/3981479700 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560178a28d90 con 0x5601789e4ea0 2024-09-11T23:22:05.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.143+0000 7f013a800640 1 --2- 172.21.15.144:0/3981479700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601789e4ea0 0x560178a0d350 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f012c089060 tx=0x7f012c058b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d83523b3b0a97a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:05.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.143+0000 7f0126600640 1 -- 172.21.15.144:0/3981479700 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c086020 con 0x5601789e4ea0 2024-09-11T23:22:05.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.143+0000 7f0126600640 1 -- 172.21.15.144:0/3981479700 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f012c06e040 con 0x5601789e4ea0 2024-09-11T23:22:05.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.143+0000 7f0126600640 1 -- 172.21.15.144:0/3981479700 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c0618d0 con 0x5601789e4ea0 2024-09-11T23:22:05.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.143+0000 7f0144410740 1 -- 172.21.15.144:0/3981479700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601789e4ea0 msgr2=0x560178a0d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:05.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.143+0000 7f0144410740 1 --2- 172.21.15.144:0/3981479700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601789e4ea0 0x560178a0d350 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f012c089060 tx=0x7f012c058b70 comp rx=0 tx=0).stop 2024-09-11T23:22:05.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.143+0000 7f0144410740 1 -- 172.21.15.144:0/3981479700 shutdown_connections 2024-09-11T23:22:05.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.143+0000 7f0144410740 1 --2- 172.21.15.144:0/3981479700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560178a0fec0 0x560178a29720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.143+0000 7f0144410740 1 --2- 172.21.15.144:0/3981479700 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5601789e6630 0x560178a291e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.143+0000 7f0144410740 1 --2- 172.21.15.144:0/3981479700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601789e4ea0 0x560178a0d350 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.143+0000 7f0144410740 1 -- 172.21.15.144:0/3981479700 >> 172.21.15.144:0/3981479700 conn(0x5601789e2660 msgr2=0x560178a108d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:05.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.143+0000 7f0144410740 1 -- 172.21.15.144:0/3981479700 shutdown_connections 2024-09-11T23:22:05.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.143+0000 7f0144410740 1 -- 172.21.15.144:0/3981479700 wait complete. 2024-09-11T23:22:05.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.144+0000 7f0144410740 1 -- start start 2024-09-11T23:22:05.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.144+0000 7f0144410740 1 Processor -- start 2024-09-11T23:22:05.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.145+0000 7f0144410740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5601789e4ea0 0x560178a2d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.145+0000 7f0144410740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5601789e6630 0x560178a2d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.145+0000 7f0144410740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560178a0fec0 0x560178a0ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.145+0000 7f0144410740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560178a3aeb0 con 0x560178a0fec0 2024-09-11T23:22:05.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.145+0000 7f0144410740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f013c1f5170 con 0x5601789e4ea0 2024-09-11T23:22:05.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.145+0000 7f0144410740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x560178a3b190 con 0x5601789e6630 2024-09-11T23:22:05.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.145+0000 7f0144410740 10 client.0 _ll_register_callbacks cb 0x7f0134007900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:22:05.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.145+0000 7f013b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560178a0fec0 0x560178a0ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.145+0000 7f013b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560178a0fec0 0x560178a0ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48428/0 (socket says 172.21.15.144:48428) 2024-09-11T23:22:05.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.145+0000 7f013b200640 1 -- 172.21.15.144:0/423922730 learned_addr learned my addr 172.21.15.144:0/423922730 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:05.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.145+0000 7f013a800640 1 --2- 172.21.15.144:0/423922730 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5601789e4ea0 0x560178a2d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.146+0000 7f0139e00640 1 --2- 172.21.15.144:0/423922730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5601789e6630 0x560178a2d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.146+0000 7f013b200640 1 -- 172.21.15.144:0/423922730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5601789e6630 msgr2=0x560178a2d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:05.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.146+0000 7f013b200640 1 --2- 172.21.15.144:0/423922730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5601789e6630 0x560178a2d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.146+0000 7f013b200640 1 -- 172.21.15.144:0/423922730 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5601789e4ea0 msgr2=0x560178a2d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:05.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.146+0000 7f013b200640 1 --2- 172.21.15.144:0/423922730 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5601789e4ea0 0x560178a2d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.146+0000 7f013b200640 1 -- 172.21.15.144:0/423922730 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560178a3a660 con 0x560178a0fec0 2024-09-11T23:22:05.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.146+0000 7f0139e00640 1 --2- 172.21.15.144:0/423922730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5601789e6630 0x560178a2d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:05.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.146+0000 7f013b200640 1 --2- 172.21.15.144:0/423922730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560178a0fec0 0x560178a0ebd0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f0134002230 tx=0x7f0134004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e1a6d3359aea5c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:05.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.146+0000 7f011b400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:22:05.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.146+0000 7f011b400640 1 -- 172.21.15.144:0/423922730 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013405a060 con 0x560178a0fec0 2024-09-11T23:22:05.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.146+0000 7f0144410740 1 -- 172.21.15.144:0/423922730 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f012c06e040 con 0x560178a0fec0 2024-09-11T23:22:05.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.146+0000 7f011b400640 1 -- 172.21.15.144:0/423922730 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f0134003da0 con 0x560178a0fec0 2024-09-11T23:22:05.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.147+0000 7f011b400640 1 -- 172.21.15.144:0/423922730 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f0134060050 con 0x560178a0fec0 2024-09-11T23:22:05.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.147+0000 7f0144410740 10 client.6270 fetch_fsmap learned FSMap version 46 2024-09-11T23:22:05.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.147+0000 7f0144410740 1 -- 172.21.15.144:0/423922730 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) -- 0x560178a44840 con 0x560178a0fec0 2024-09-11T23:22:05.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.147+0000 7f011b400640 1 -- 172.21.15.144:0/423922730 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f012c06e040 con 0x560178a0fec0 2024-09-11T23:22:05.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.147+0000 7f011b400640 1 -- 172.21.15.144:0/423922730 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 46) ==== 3502+0+0 (secure 0 0 0) 0x7f0134063020 con 0x560178a0fec0 2024-09-11T23:22:05.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.147+0000 7f0144410740 10 client.6270 fetch_fsmap finished waiting for FSMap version 46 2024-09-11T23:22:05.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.147+0000 7f0144410740 10 client.6270 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T23:22:05.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.147+0000 7f0144410740 20 client.6270 populate_metadata read hostname 'smithi144' 2024-09-11T23:22:05.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.147+0000 7f0144410740 1 --2- 172.21.15.144:0/423922730 >> [v2:172.21.15.144:6835/97031260,v1:172.21.15.144:6837/97031260] conn(0x560178aa8800 0x560178aa8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.147+0000 7f0144410740 4 client.6270 mds_command: new command op to 6093 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:22:05.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.147+0000 7f0144410740 1 -- 172.21.15.144:0/423922730 --> [v2:172.21.15.144:6835/97031260,v1:172.21.15.144:6837/97031260] -- command(tid 0: {"prefix": "status"}) -- 0x560178a12330 con 0x560178aa8800 2024-09-11T23:22:05.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.147+0000 7f013a800640 1 --2- 172.21.15.144:0/423922730 >> [v2:172.21.15.144:6835/97031260,v1:172.21.15.144:6837/97031260] conn(0x560178aa8800 0x560178aa8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.148+0000 7f011b400640 10 client.6270 ms_handle_connect on v2:172.21.15.144:6835/97031260 2024-09-11T23:22:05.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.148+0000 7f013a800640 1 --2- 172.21.15.144:0/423922730 >> [v2:172.21.15.144:6835/97031260,v1:172.21.15.144:6837/97031260] conn(0x560178aa8800 0x560178aa8be0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a67da5716bfd9f47 server_cookie=b5f995eed1e16bf0 in_seq=0 out_seq=0 2024-09-11T23:22:05.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.148+0000 7f011b400640 1 -- 172.21.15.144:0/423922730 <== mds.0 v2:172.21.15.144:6835/97031260 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x560178a12330 con 0x560178aa8800 2024-09-11T23:22:05.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.148+0000 7f011b400640 10 client.6270 handle_command_reply: tid=0 2024-09-11T23:22:05.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.148+0000 7f0144410740 1 client.6270 shutdown 2024-09-11T23:22:05.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.148+0000 7f0144410740 1 -- 172.21.15.144:0/423922730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560178a0fec0 msgr2=0x560178a0ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:05.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.148+0000 7f0144410740 1 --2- 172.21.15.144:0/423922730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560178a0fec0 0x560178a0ebd0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f0134002230 tx=0x7f0134004a40 comp rx=0 tx=0).stop 2024-09-11T23:22:05.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.148+0000 7f0144410740 1 -- 172.21.15.144:0/423922730 shutdown_connections 2024-09-11T23:22:05.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.148+0000 7f0144410740 1 --2- 172.21.15.144:0/423922730 >> [v2:172.21.15.144:6835/97031260,v1:172.21.15.144:6837/97031260] conn(0x560178aa8800 0x560178aa8be0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.148+0000 7f0144410740 1 --2- 172.21.15.144:0/423922730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560178a0fec0 0x560178a0ebd0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.148+0000 7f0144410740 1 --2- 172.21.15.144:0/423922730 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x5601789e6630 0x560178a2d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.148+0000 7f011b400640 0 client.6270 ms_handle_reset on v2:172.21.15.144:6835/97031260 2024-09-11T23:22:05.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.148+0000 7f0144410740 1 --2- 172.21.15.144:0/423922730 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5601789e4ea0 0x560178a2d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.148+0000 7f0144410740 1 -- 172.21.15.144:0/423922730 >> 172.21.15.144:0/423922730 conn(0x5601789e2660 msgr2=0x560178a27b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:05.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.148+0000 7f0144410740 1 -- 172.21.15.144:0/423922730 shutdown_connections 2024-09-11T23:22:05.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.148+0000 7f0144410740 1 -- 172.21.15.144:0/423922730 wait complete. 2024-09-11T23:22:05.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.149+0000 7f0144410740 20 client.6270 trim_cache size 0 max 16384 2024-09-11T23:22:05.157 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:22:05.157 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "4b73e4b7-12f0-4e37-94bc-45e333efe84e", 2024-09-11T23:22:05.157 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-11T23:22:05.157 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 6093, 2024-09-11T23:22:05.157 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-11T23:22:05.157 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-11T23:22:05.157 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-11T23:22:05.157 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 10.703794898, 2024-09-11T23:22:05.158 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 46, 2024-09-11T23:22:05.158 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 71, 2024-09-11T23:22:05.158 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 71, 2024-09-11T23:22:05.158 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 22.453663355 2024-09-11T23:22:05.158 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:22:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.149+0000 7f0140a00640 1 -- 172.21.15.144:0/20708912 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f011c06c190 msgr2=0x7f011c06e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.149+0000 7f0140a00640 1 --2- 172.21.15.144:0/20708912 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f011c06c190 0x7f011c06e650 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f013c15e1e0 tx=0x7f0128009040 comp rx=0 tx=0).stop 2024-09-11T23:22:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.149+0000 7f0140a00640 1 -- 172.21.15.144:0/20708912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c0b5fd0 msgr2=0x7f013c1529b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.149+0000 7f0140a00640 1 --2- 172.21.15.144:0/20708912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c0b5fd0 0x7f013c1529b0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f012c00c450 tx=0x7f012c00c910 comp rx=0 tx=0).stop 2024-09-11T23:22:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.149+0000 7f0140a00640 1 -- 172.21.15.144:0/20708912 shutdown_connections 2024-09-11T23:22:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.149+0000 7f0140a00640 1 --2- 172.21.15.144:0/20708912 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f011c06c190 0x7f011c06e650 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.149+0000 7f0140a00640 1 --2- 172.21.15.144:0/20708912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f013c15e640 0x7f013c0b8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.149+0000 7f0140a00640 1 --2- 172.21.15.144:0/20708912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f013c0b6410 0x7f013c0ab9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.149+0000 7f0140a00640 1 --2- 172.21.15.144:0/20708912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f013c0b5fd0 0x7f013c1529b0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.149+0000 7f0140a00640 1 -- 172.21.15.144:0/20708912 >> 172.21.15.144:0/20708912 conn(0x7f013c0d0fd0 msgr2=0x7f013c160bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.149+0000 7f0140a00640 1 -- 172.21.15.144:0/20708912 shutdown_connections 2024-09-11T23:22:05.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.149+0000 7f0140a00640 1 -- 172.21.15.144:0/20708912 wait complete. 2024-09-11T23:22:05.165 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:22:05.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.320+0000 7f4e77200640 1 Processor -- start 2024-09-11T23:22:05.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.320+0000 7f4e77200640 1 -- start start 2024-09-11T23:22:05.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.321+0000 7f4e77200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4e700d0a50 0x7f4e701620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.321+0000 7f4e77200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e700b4930 0x7f4e700b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.321+0000 7f4e77200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4e7015f620 0x7f4e7015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.321+0000 7f4e77200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f4e700b52d0 con 0x7f4e700d0a50 2024-09-11T23:22:05.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.322+0000 7f4e77200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4e701625f0 con 0x7f4e7015f620 2024-09-11T23:22:05.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.322+0000 7f4e77200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4e70162870 con 0x7f4e700b4930 2024-09-11T23:22:05.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.322+0000 7f4e6fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4e700d0a50 0x7f4e701620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.322+0000 7f4e6fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4e700d0a50 0x7f4e701620b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48430/0 (socket says 172.21.15.144:48430) 2024-09-11T23:22:05.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.322+0000 7f4e6fe00640 1 -- 172.21.15.144:0/3569039517 learned_addr learned my addr 172.21.15.144:0/3569039517 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:05.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.322+0000 7f4e75200640 1 --2- 172.21.15.144:0/3569039517 >> v2:172.21.15.165:3300/0 conn(0x7f4e7015f620 0x7f4e7015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.322+0000 7f4e6f400640 1 --2- 172.21.15.144:0/3569039517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e700b4930 0x7f4e700b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.322+0000 7f4e6fe00640 1 -- 172.21.15.144:0/3569039517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e700b4930 msgr2=0x7f4e700b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:05.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.322+0000 7f4e6fe00640 1 --2- 172.21.15.144:0/3569039517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e700b4930 0x7f4e700b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.322+0000 7f4e6fe00640 1 -- 172.21.15.144:0/3569039517 >> v2:172.21.15.165:3300/0 conn(0x7f4e7015f620 msgr2=0x7f4e7015fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:05.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.322+0000 7f4e6fe00640 1 --2- 172.21.15.144:0/3569039517 >> v2:172.21.15.165:3300/0 conn(0x7f4e7015f620 0x7f4e7015fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.322+0000 7f4e6fe00640 1 -- 172.21.15.144:0/3569039517 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e70162b50 con 0x7f4e700d0a50 2024-09-11T23:22:05.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.322+0000 7f4e6f400640 1 --2- 172.21.15.144:0/3569039517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e700b4930 0x7f4e700b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:05.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.322+0000 7f4e75200640 1 --2- 172.21.15.144:0/3569039517 >> v2:172.21.15.165:3300/0 conn(0x7f4e7015f620 0x7f4e7015fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:05.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.323+0000 7f4e6fe00640 1 --2- 172.21.15.144:0/3569039517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e700d0a50 0x7f4e701620b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4e70163110 tx=0x7f4e6002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8efdc289afe8f676 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:05.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.323+0000 7f4e6ea00640 1 -- 172.21.15.144:0/3569039517 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60037070 con 0x7f4e700d0a50 2024-09-11T23:22:05.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.324+0000 7f4e6ea00640 1 -- 172.21.15.144:0/3569039517 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e60032440 con 0x7f4e700d0a50 2024-09-11T23:22:05.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.324+0000 7f4e6ea00640 1 -- 172.21.15.144:0/3569039517 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60032810 con 0x7f4e700d0a50 2024-09-11T23:22:05.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.324+0000 7f4e77200640 1 -- 172.21.15.144:0/3569039517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e700d0a50 msgr2=0x7f4e701620b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:05.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.324+0000 7f4e77200640 1 --2- 172.21.15.144:0/3569039517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e700d0a50 0x7f4e701620b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4e70163110 tx=0x7f4e6002a140 comp rx=0 tx=0).stop 2024-09-11T23:22:05.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.324+0000 7f4e77200640 1 -- 172.21.15.144:0/3569039517 shutdown_connections 2024-09-11T23:22:05.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.324+0000 7f4e77200640 1 --2- 172.21.15.144:0/3569039517 >> v2:172.21.15.165:3300/0 conn(0x7f4e7015f620 0x7f4e7015fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.324+0000 7f4e77200640 1 --2- 172.21.15.144:0/3569039517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e700b4930 0x7f4e700b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.324+0000 7f4e77200640 1 --2- 172.21.15.144:0/3569039517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e700d0a50 0x7f4e701620b0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.324+0000 7f4e77200640 1 -- 172.21.15.144:0/3569039517 >> 172.21.15.144:0/3569039517 conn(0x7f4e70062cc0 msgr2=0x7f4e7006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:05.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.324+0000 7f4e77200640 1 -- 172.21.15.144:0/3569039517 shutdown_connections 2024-09-11T23:22:05.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.324+0000 7f4e77200640 1 -- 172.21.15.144:0/3569039517 wait complete. 2024-09-11T23:22:05.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.326+0000 7f4e77200640 1 Processor -- start 2024-09-11T23:22:05.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.326+0000 7f4e77200640 1 -- start start 2024-09-11T23:22:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.327+0000 7f4e77200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e700b4930 0x7f4e7014ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.327+0000 7f4e77200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e7015f620 0x7f4e7014d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.327+0000 7f4e77200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e700c6180 0x7f4e700c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.327+0000 7f4e77200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4e700b3620 con 0x7f4e7015f620 2024-09-11T23:22:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.327+0000 7f4e77200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4e700b3340 con 0x7f4e700b4930 2024-09-11T23:22:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.327+0000 7f4e77200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4e7015fff0 con 0x7f4e700c6180 2024-09-11T23:22:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.327+0000 7f4e6f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e7015f620 0x7f4e7014d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.327+0000 7f4e6f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e7015f620 0x7f4e7014d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48432/0 (socket says 172.21.15.144:48432) 2024-09-11T23:22:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.327+0000 7f4e6f400640 1 -- 172.21.15.144:0/267894711 learned_addr learned my addr 172.21.15.144:0/267894711 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.327+0000 7f4e6fe00640 1 --2- 172.21.15.144:0/267894711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e700b4930 0x7f4e7014ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.327+0000 7f4e75200640 1 --2- 172.21.15.144:0/267894711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e700c6180 0x7f4e700c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.327+0000 7f4e6f400640 1 -- 172.21.15.144:0/267894711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e700c6180 msgr2=0x7f4e700c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:05.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.327+0000 7f4e6f400640 1 --2- 172.21.15.144:0/267894711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e700c6180 0x7f4e700c6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.327+0000 7f4e6f400640 1 -- 172.21.15.144:0/267894711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e700b4930 msgr2=0x7f4e7014ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:05.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.327+0000 7f4e6f400640 1 --2- 172.21.15.144:0/267894711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e700b4930 0x7f4e7014ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.327+0000 7f4e6f400640 1 -- 172.21.15.144:0/267894711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e70072ac0 con 0x7f4e7015f620 2024-09-11T23:22:05.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.328+0000 7f4e6fe00640 1 --2- 172.21.15.144:0/267894711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e700b4930 0x7f4e7014ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:05.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.328+0000 7f4e6f400640 1 --2- 172.21.15.144:0/267894711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e7015f620 0x7f4e7014d950 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00d800 tx=0x7f4e5c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:05.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.328+0000 7f4e67e00640 1 -- 172.21.15.144:0/267894711 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c018070 con 0x7f4e7015f620 2024-09-11T23:22:05.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.328+0000 7f4e67e00640 1 -- 172.21.15.144:0/267894711 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e5c004030 con 0x7f4e7015f620 2024-09-11T23:22:05.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.328+0000 7f4e67e00640 1 -- 172.21.15.144:0/267894711 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c004400 con 0x7f4e7015f620 2024-09-11T23:22:05.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.328+0000 7f4e77200640 1 -- 172.21.15.144:0/267894711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e70072da0 con 0x7f4e7015f620 2024-09-11T23:22:05.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.328+0000 7f4e77200640 1 -- 172.21.15.144:0/267894711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e70073360 con 0x7f4e7015f620 2024-09-11T23:22:05.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.329+0000 7f4e77200640 1 -- 172.21.15.144:0/267894711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e701620b0 con 0x7f4e7015f620 2024-09-11T23:22:05.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.330+0000 7f4e67e00640 1 -- 172.21.15.144:0/267894711 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f4e5c009640 con 0x7f4e7015f620 2024-09-11T23:22:05.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.331+0000 7f4e67e00640 1 --2- 172.21.15.144:0/267894711 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4e5006c190 0x7f4e5006e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:05.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.331+0000 7f4e67e00640 1 -- 172.21.15.144:0/267894711 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f4e5c08b760 con 0x7f4e7015f620 2024-09-11T23:22:05.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.331+0000 7f4e6fe00640 1 --2- 172.21.15.144:0/267894711 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4e5006c190 0x7f4e5006e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:05.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.332+0000 7f4e6fe00640 1 --2- 172.21.15.144:0/267894711 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4e5006c190 0x7f4e5006e650 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4e60034000 tx=0x7f4e6002e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:05.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.335+0000 7f4e67e00640 1 -- 172.21.15.144:0/267894711 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e5c059ce0 con 0x7f4e7015f620 2024-09-11T23:22:05.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.545+0000 7f4e77200640 1 -- 172.21.15.144:0/267894711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4e700cff90 con 0x7f4e7015f620 2024-09-11T23:22:05.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.546+0000 7f4e67e00640 1 -- 172.21.15.144:0/267894711 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) ==== 53+0+73 (secure 0 0 0) 0x7f4e5c0595e0 con 0x7f4e7015f620 2024-09-11T23:22:05.546 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:22:05.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.548+0000 7f4e77200640 1 -- 172.21.15.144:0/267894711 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4e5006c190 msgr2=0x7f4e5006e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:05.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.548+0000 7f4e77200640 1 --2- 172.21.15.144:0/267894711 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4e5006c190 0x7f4e5006e650 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4e60034000 tx=0x7f4e6002e000 comp rx=0 tx=0).stop 2024-09-11T23:22:05.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.548+0000 7f4e77200640 1 -- 172.21.15.144:0/267894711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e7015f620 msgr2=0x7f4e7014d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:05.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.548+0000 7f4e77200640 1 --2- 172.21.15.144:0/267894711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e7015f620 0x7f4e7014d950 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00d800 tx=0x7f4e5c00dcc0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.548+0000 7f4e77200640 1 -- 172.21.15.144:0/267894711 shutdown_connections 2024-09-11T23:22:05.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.548+0000 7f4e77200640 1 --2- 172.21.15.144:0/267894711 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f4e5006c190 0x7f4e5006e650 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.548+0000 7f4e77200640 1 --2- 172.21.15.144:0/267894711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e700c6180 0x7f4e700c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.548+0000 7f4e77200640 1 --2- 172.21.15.144:0/267894711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e7015f620 0x7f4e7014d950 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.548+0000 7f4e77200640 1 --2- 172.21.15.144:0/267894711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e700b4930 0x7f4e7014ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:05.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.548+0000 7f4e77200640 1 -- 172.21.15.144:0/267894711 >> 172.21.15.144:0/267894711 conn(0x7f4e70062cc0 msgr2=0x7f4e7006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:05.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.548+0000 7f4e77200640 1 -- 172.21.15.144:0/267894711 shutdown_connections 2024-09-11T23:22:05.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05.548+0000 7f4e77200640 1 -- 172.21.15.144:0/267894711 wait complete. 2024-09-11T23:22:05.565 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:22:05.565 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:22:05.565 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-11T23:22:05.565 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:22:05.565 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:22:05.565 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:22:05.566 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:22:05.566 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:22:05.566 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:22:05.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:05.566 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-11T23:22:05.602 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:22:05.602 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:22:05.602 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:22:05.602 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:05.602 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-11T23:22:05.602 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:05.602 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:22:05.603 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:22:05.603 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-11T23:22:05.603 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:22:05.603 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:22:05.603 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-11T23:22:05.603 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:22:05.603 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:22:05.603 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:22:05.603 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-11T23:22:05.603 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:22:05.603 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42437sec preferred_lft 42437sec 2024-09-11T23:22:05.603 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2024-09-11T23:22:05.603 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:05.604 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:22:05.604 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff 2024-09-11T23:22:05.604 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:22:05.604 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:05.604 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::243b:82ff:fe06:fac9/64 scope link 2024-09-11T23:22:05.604 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:05.604 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:22:05.604 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:22:05.604 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::74ca:30ff:fef2:cddf/64 scope link 2024-09-11T23:22:05.604 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:05.604 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:22:05.604 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether be:01:ec:87:34:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:22:05.604 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bc01:ecff:fe87:34e1/64 scope link 2024-09-11T23:22:05.605 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:05.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:05.605 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:22:05.696 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-11T23:22:05.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:05.699 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-11T23:22:05.736 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-11T23:22:05.736 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:22:05.736 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:22:05.736 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:22:05.736 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:22:05.736 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:22:05.737 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-11T23:22:05.737 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:22:05.737 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:22:05.737 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:22:05.737 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-11T23:22:05.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:22:05.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:22:05.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:05.933 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-11T23:22:05.969 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:22:05.969 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:22:05.969 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:22:05.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:05.969 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-11T23:22:06.065 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:22:06.065 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:22:06.100 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:22:06.101 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:22:06.101 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:22:06.175 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T23:22:06.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:06.176 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:22:06.304 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:22:06.304 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:22:06.333 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:22:06.333 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:22:06.333 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:22:06.333 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:22:06.333 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:22:06.334 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T23:22:06.335 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:22:06.335 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:22:06.335 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:22:06.335 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:22:06.337 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:22:06.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:06.338 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:22:06.393 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:22:06.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:22:06.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:22:06.489 INFO:teuthology.orchestra.run.smithi144.stdout:client5531 2024-09-11T23:22:06.489 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:22:06.489 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:06.525 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:22:06.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.718+0000 7f9fa6800640 1 Processor -- start 2024-09-11T23:22:06.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.719+0000 7f9fa6800640 1 -- start start 2024-09-11T23:22:06.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.720+0000 7f9fa6800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9fa00afd10 0x7f9fa006cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:06.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.720+0000 7f9fa6800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fa015b3c0 0x7f9fa00cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:06.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.720+0000 7f9fa6800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa00b0240 con 0x7f9fa015afe0 2024-09-11T23:22:06.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.720+0000 7f9fa6800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9fa00b3940 con 0x7f9fa00afd10 2024-09-11T23:22:06.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.720+0000 7f9fa6800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa00b3b90 con 0x7f9fa015b3c0 2024-09-11T23:22:06.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.720+0000 7f9fa4a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9fa00afd10 0x7f9fa006cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:06.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.720+0000 7f9fa5e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fa015b3c0 0x7f9fa00cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:06.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.720+0000 7f9fa5e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fa015b3c0 0x7f9fa00cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:56282/0 (socket says 172.21.15.144:56282) 2024-09-11T23:22:06.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.720+0000 7f9fa5e00640 1 -- 172.21.15.144:0/1495795915 learned_addr learned my addr 172.21.15.144:0/1495795915 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:06.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.720+0000 7f9fa4a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9fa00afd10 0x7f9fa006cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:41044/0 (socket says 172.21.15.144:41044) 2024-09-11T23:22:06.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.721+0000 7f9fa5e00640 1 -- 172.21.15.144:0/1495795915 >> v2:172.21.15.165:3300/0 conn(0x7f9fa00afd10 msgr2=0x7f9fa006cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:06.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.721+0000 7f9fa5e00640 1 --2- 172.21.15.144:0/1495795915 >> v2:172.21.15.165:3300/0 conn(0x7f9fa00afd10 0x7f9fa006cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:06.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.721+0000 7f9fa5e00640 1 -- 172.21.15.144:0/1495795915 >> v1:172.21.15.165:6789/0 conn(0x7f9fa015afe0 legacy=0x7f9fa00ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:06.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.721+0000 7f9fa5e00640 1 -- 172.21.15.144:0/1495795915 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa00b3e70 con 0x7f9fa015b3c0 2024-09-11T23:22:06.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.721+0000 7f9fa4a00640 1 --2- 172.21.15.144:0/1495795915 >> v2:172.21.15.165:3300/0 conn(0x7f9fa00afd10 0x7f9fa006cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:22:06.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.722+0000 7f9fa5e00640 1 --2- 172.21.15.144:0/1495795915 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fa015b3c0 0x7f9fa00cf810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009e50 tx=0x7f9f9802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16efa75fc3ecdaee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:06.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.722+0000 7f9f9fe00640 1 -- 172.21.15.144:0/1495795915 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98036070 con 0x7f9fa015b3c0 2024-09-11T23:22:06.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.722+0000 7f9f9fe00640 1 -- 172.21.15.144:0/1495795915 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f98031600 con 0x7f9fa015b3c0 2024-09-11T23:22:06.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.722+0000 7f9f9fe00640 1 -- 172.21.15.144:0/1495795915 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f980319d0 con 0x7f9fa015b3c0 2024-09-11T23:22:06.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.723+0000 7f9fa6800640 1 -- 172.21.15.144:0/1495795915 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fa015b3c0 msgr2=0x7f9fa00cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:06.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.723+0000 7f9fa6800640 1 --2- 172.21.15.144:0/1495795915 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fa015b3c0 0x7f9fa00cf810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009e50 tx=0x7f9f9802a680 comp rx=0 tx=0).stop 2024-09-11T23:22:06.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.723+0000 7f9fa6800640 1 -- 172.21.15.144:0/1495795915 shutdown_connections 2024-09-11T23:22:06.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.723+0000 7f9fa6800640 1 --2- 172.21.15.144:0/1495795915 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fa015b3c0 0x7f9fa00cf810 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:06.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.723+0000 7f9fa6800640 1 --2- 172.21.15.144:0/1495795915 >> v2:172.21.15.165:3300/0 conn(0x7f9fa00afd10 0x7f9fa006cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:06.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.723+0000 7f9fa6800640 1 -- 172.21.15.144:0/1495795915 >> 172.21.15.144:0/1495795915 conn(0x7f9fa00d0af0 msgr2=0x7f9fa00d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:06.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.723+0000 7f9fa6800640 1 -- 172.21.15.144:0/1495795915 shutdown_connections 2024-09-11T23:22:06.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.723+0000 7f9fa6800640 1 -- 172.21.15.144:0/1495795915 wait complete. 2024-09-11T23:22:06.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.725+0000 7f9fa6800640 1 Processor -- start 2024-09-11T23:22:06.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.725+0000 7f9fa6800640 1 -- start start 2024-09-11T23:22:06.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.726+0000 7f9fa6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fa00afd10 0x7f9fa00b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:06.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.726+0000 7f9fa6800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fa015afe0 0x7f9fa01557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:06.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.726+0000 7f9fa6800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fa015b3c0 0x7f9fa00ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:06.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.726+0000 7f9fa6800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa00cfed0 con 0x7f9fa00afd10 2024-09-11T23:22:06.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.726+0000 7f9fa6800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa00cfd50 con 0x7f9fa015b3c0 2024-09-11T23:22:06.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.726+0000 7f9fa6800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa00d0050 con 0x7f9fa015afe0 2024-09-11T23:22:06.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.726+0000 7f9fa5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fa00afd10 0x7f9fa00b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:06.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.726+0000 7f9fa5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fa00afd10 0x7f9fa00b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48444/0 (socket says 172.21.15.144:48444) 2024-09-11T23:22:06.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.726+0000 7f9fa5400640 1 -- 172.21.15.144:0/1627701556 learned_addr learned my addr 172.21.15.144:0/1627701556 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:06.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.726+0000 7f9fa4a00640 1 --2- 172.21.15.144:0/1627701556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fa015afe0 0x7f9fa01557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:06.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.726+0000 7f9fa5e00640 1 --2- 172.21.15.144:0/1627701556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fa015b3c0 0x7f9fa00ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:06.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.726+0000 7f9fa5400640 1 -- 172.21.15.144:0/1627701556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fa015afe0 msgr2=0x7f9fa01557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:06.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.726+0000 7f9fa5400640 1 --2- 172.21.15.144:0/1627701556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fa015afe0 0x7f9fa01557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:06.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.726+0000 7f9fa5400640 1 -- 172.21.15.144:0/1627701556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fa015b3c0 msgr2=0x7f9fa00ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:06.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.726+0000 7f9fa5400640 1 --2- 172.21.15.144:0/1627701556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fa015b3c0 0x7f9fa00ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:06.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.726+0000 7f9fa5400640 1 -- 172.21.15.144:0/1627701556 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa006ee60 con 0x7f9fa00afd10 2024-09-11T23:22:06.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.727+0000 7f9fa5400640 1 --2- 172.21.15.144:0/1627701556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fa00afd10 0x7f9fa00b1d60 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9f9400c400 tx=0x7f9f9400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:06.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.727+0000 7f9f9d600640 1 -- 172.21.15.144:0/1627701556 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f940052d0 con 0x7f9fa00afd10 2024-09-11T23:22:06.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.727+0000 7f9f9d600640 1 -- 172.21.15.144:0/1627701556 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f94005490 con 0x7f9fa00afd10 2024-09-11T23:22:06.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.727+0000 7f9f9d600640 1 -- 172.21.15.144:0/1627701556 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f94007260 con 0x7f9fa00afd10 2024-09-11T23:22:06.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.727+0000 7f9fa6800640 1 -- 172.21.15.144:0/1627701556 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa006f140 con 0x7f9fa00afd10 2024-09-11T23:22:06.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.727+0000 7f9fa6800640 1 -- 172.21.15.144:0/1627701556 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa015c090 con 0x7f9fa00afd10 2024-09-11T23:22:06.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.728+0000 7f9fa6800640 1 -- 172.21.15.144:0/1627701556 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa00cf810 con 0x7f9fa00afd10 2024-09-11T23:22:06.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.729+0000 7f9f9d600640 1 -- 172.21.15.144:0/1627701556 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f9f94007400 con 0x7f9fa00afd10 2024-09-11T23:22:06.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.730+0000 7f9f9d600640 1 --2- 172.21.15.144:0/1627701556 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9f8006c190 0x7f9f8006e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:06.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.730+0000 7f9f9d600640 1 -- 172.21.15.144:0/1627701556 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f9f9408a7c0 con 0x7f9fa00afd10 2024-09-11T23:22:06.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.730+0000 7f9fa4a00640 1 --2- 172.21.15.144:0/1627701556 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9f8006c190 0x7f9f8006e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:06.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.731+0000 7f9fa4a00640 1 --2- 172.21.15.144:0/1627701556 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9f8006c190 0x7f9f8006e650 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009560 tx=0x7f9f8c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:06.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.734+0000 7f9f9d600640 1 -- 172.21.15.144:0/1627701556 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9f94058780 con 0x7f9fa00afd10 2024-09-11T23:22:06.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.940+0000 7f9fa6800640 1 -- 172.21.15.144:0/1627701556 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9fa006fc30 con 0x7f9fa00afd10 2024-09-11T23:22:06.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.941+0000 7f9f9d600640 1 -- 172.21.15.144:0/1627701556 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) ==== 53+0+73 (secure 0 0 0) 0x7f9f9405ca80 con 0x7f9fa00afd10 2024-09-11T23:22:06.942 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:22:06.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.943+0000 7f9fa6800640 1 -- 172.21.15.144:0/1627701556 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9f8006c190 msgr2=0x7f9f8006e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:06.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.943+0000 7f9fa6800640 1 --2- 172.21.15.144:0/1627701556 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9f8006c190 0x7f9f8006e650 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009560 tx=0x7f9f8c009190 comp rx=0 tx=0).stop 2024-09-11T23:22:06.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.943+0000 7f9fa6800640 1 -- 172.21.15.144:0/1627701556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fa00afd10 msgr2=0x7f9fa00b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:06.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.943+0000 7f9fa6800640 1 --2- 172.21.15.144:0/1627701556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fa00afd10 0x7f9fa00b1d60 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9f9400c400 tx=0x7f9f9400c8c0 comp rx=0 tx=0).stop 2024-09-11T23:22:06.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.943+0000 7f9fa6800640 1 -- 172.21.15.144:0/1627701556 shutdown_connections 2024-09-11T23:22:06.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.943+0000 7f9fa6800640 1 --2- 172.21.15.144:0/1627701556 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f9f8006c190 0x7f9f8006e650 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:06.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.943+0000 7f9fa6800640 1 --2- 172.21.15.144:0/1627701556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9fa015b3c0 0x7f9fa00ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:06.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.943+0000 7f9fa6800640 1 --2- 172.21.15.144:0/1627701556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9fa015afe0 0x7f9fa01557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:06.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.943+0000 7f9fa6800640 1 --2- 172.21.15.144:0/1627701556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fa00afd10 0x7f9fa00b1d60 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:06.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.943+0000 7f9fa6800640 1 -- 172.21.15.144:0/1627701556 >> 172.21.15.144:0/1627701556 conn(0x7f9fa00d0af0 msgr2=0x7f9fa00cd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:06.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.943+0000 7f9fa6800640 1 -- 172.21.15.144:0/1627701556 shutdown_connections 2024-09-11T23:22:06.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:06.943+0000 7f9fa6800640 1 -- 172.21.15.144:0/1627701556 wait complete. 2024-09-11T23:22:06.960 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:22:06.960 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:22:06.960 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi165.front.sepia.ceph.com 2024-09-11T23:22:06.960 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T23:22:06.960 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:22:06.960 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:22:06.960 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:22:06.960 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:22:06.961 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:22:06.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:06.961 DEBUG:teuthology.orchestra.run.smithi165:> ip addr 2024-09-11T23:22:07.002 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:22:07.002 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:22:07.002 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:22:07.002 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:07.002 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-11T23:22:07.002 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:07.002 INFO:teuthology.orchestra.run.smithi165.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:22:07.002 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:94 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:22:07.002 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f0 2024-09-11T23:22:07.002 INFO:teuthology.orchestra.run.smithi165.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:22:07.002 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:95 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:22:07.003 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f1 2024-09-11T23:22:07.003 INFO:teuthology.orchestra.run.smithi165.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:22:07.003 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:22:07.003 INFO:teuthology.orchestra.run.smithi165.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:22:07.003 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:22:07.003 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.21.15.165/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:22:07.003 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft 42439sec preferred_lft 42439sec 2024-09-11T23:22:07.003 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::ec4:7aff:fe88:7f63/64 scope link noprefixroute 2024-09-11T23:22:07.003 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:07.003 INFO:teuthology.orchestra.run.smithi165.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:22:07.003 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:22:07.003 INFO:teuthology.orchestra.run.smithi165.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:22:07.003 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:07.003 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::c063:d7ff:fec8:c56c/64 scope link 2024-09-11T23:22:07.003 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:07.004 INFO:teuthology.orchestra.run.smithi165.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:22:07.004 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:22:07.004 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::5478:e4ff:fecd:76c/64 scope link 2024-09-11T23:22:07.004 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:07.004 INFO:teuthology.orchestra.run.smithi165.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:22:07.004 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether ba:fa:43:78:5f:29 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:22:07.004 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::b8fa:43ff:fe78:5f29/64 scope link 2024-09-11T23:22:07.004 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:07.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:07.005 DEBUG:teuthology.orchestra.run.smithi165:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:22:07.099 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-11T23:22:07.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:07.102 DEBUG:teuthology.orchestra.run.smithi165:> route 2024-09-11T23:22:07.138 INFO:teuthology.orchestra.run.smithi165.stdout:Kernel IP routing table 2024-09-11T23:22:07.138 INFO:teuthology.orchestra.run.smithi165.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:22:07.139 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:22:07.139 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:22:07.139 INFO:teuthology.orchestra.run.smithi165.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:22:07.139 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:22:07.139 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-11T23:22:07.139 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:22:07.139 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:22:07.139 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:22:07.139 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-11T23:22:07.258 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:22:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:22:07.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:22:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:22:07.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:07.338 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-11T23:22:07.373 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-11T23:22:07.373 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-11T23:22:07.374 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:22:07.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:07.374 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set brx.0 up 2024-09-11T23:22:07.469 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:22:07.470 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T23:22:07.505 INFO:teuthology.orchestra.run.smithi165.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:22:07.505 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:22:07.505 DEBUG:teuthology.orchestra.run.smithi165:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:22:07.579 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-11T23:22:07.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:07.580 DEBUG:teuthology.orchestra.run.smithi165:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:22:07.708 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:22:07.709 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:22:07.735 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:22:07.735 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:22:07.735 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:22:07.735 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: trying mount with new device syntax: 1@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:22:07.735 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:22:07.736 INFO:teuthology.orchestra.run.smithi165.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-11T23:22:07.736 INFO:teuthology.orchestra.run.smithi165.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:22:07.736 INFO:teuthology.orchestra.run.smithi165.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:22:07.736 INFO:teuthology.orchestra.run.smithi165.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:22:07.737 INFO:teuthology.orchestra.run.smithi165.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:22:07.740 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:22:07.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:07.740 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:22:07.797 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:22:07.877 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:22:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:22:07.880 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:22:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:22:07.887 INFO:teuthology.orchestra.run.smithi165.stdout:client5974 2024-09-11T23:22:07.887 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:22:07.888 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:07.923 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-11T23:22:08.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.083+0000 7fa8b3200640 1 Processor -- start 2024-09-11T23:22:08.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.083+0000 7fa8b3200640 1 -- start start 2024-09-11T23:22:08.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.085+0000 7fa8b3200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa8b40cff90 0x7fa8b40715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:08.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.085+0000 7fa8b3200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa8b40cdf90 0x7fa8b40b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:08.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.085+0000 7fa8b3200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8b4072040 con 0x7fa8b4161bd0 2024-09-11T23:22:08.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.085+0000 7fa8b3200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa8b4072490 con 0x7fa8b40cdf90 2024-09-11T23:22:08.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.085+0000 7fa8b3200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa8b4072770 con 0x7fa8b40cff90 2024-09-11T23:22:08.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.085+0000 7fa8b2800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa8b40cdf90 0x7fa8b40b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:08.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.085+0000 7fa8b2800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa8b40cdf90 0x7fa8b40b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48448/0 (socket says 172.21.15.144:48448) 2024-09-11T23:22:08.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.085+0000 7fa8b2800640 1 -- 172.21.15.144:0/3577986434 learned_addr learned my addr 172.21.15.144:0/3577986434 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:08.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.085+0000 7fa8a9400640 1 --2- 172.21.15.144:0/3577986434 >> v2:172.21.15.165:3300/0 conn(0x7fa8b40cff90 0x7fa8b40715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:08.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.085+0000 7fa8b2800640 1 -- 172.21.15.144:0/3577986434 >> v2:172.21.15.165:3300/0 conn(0x7fa8b40cff90 msgr2=0x7fa8b40715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:08.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.085+0000 7fa8b2800640 1 --2- 172.21.15.144:0/3577986434 >> v2:172.21.15.165:3300/0 conn(0x7fa8b40cff90 0x7fa8b40715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:08.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.085+0000 7fa8b2800640 1 -- 172.21.15.144:0/3577986434 >> v1:172.21.15.165:6789/0 conn(0x7fa8b4161bd0 legacy=0x7fa8b40cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:08.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.085+0000 7fa8b2800640 1 -- 172.21.15.144:0/3577986434 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b4072a50 con 0x7fa8b40cdf90 2024-09-11T23:22:08.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.086+0000 7fa8b2800640 1 --2- 172.21.15.144:0/3577986434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8b40cdf90 0x7fa8b40b4720 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40b3bf0 tx=0x7fa8ac02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39dda5fb26026bdb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:08.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.087+0000 7fa8b1400640 1 -- 172.21.15.144:0/3577986434 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac036070 con 0x7fa8b40cdf90 2024-09-11T23:22:08.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.087+0000 7fa8b1400640 1 -- 172.21.15.144:0/3577986434 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8ac031600 con 0x7fa8b40cdf90 2024-09-11T23:22:08.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.087+0000 7fa8b1400640 1 -- 172.21.15.144:0/3577986434 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac0319d0 con 0x7fa8b40cdf90 2024-09-11T23:22:08.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.087+0000 7fa8b3200640 1 -- 172.21.15.144:0/3577986434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8b40cdf90 msgr2=0x7fa8b40b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:08.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.087+0000 7fa8b3200640 1 --2- 172.21.15.144:0/3577986434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8b40cdf90 0x7fa8b40b4720 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40b3bf0 tx=0x7fa8ac02a660 comp rx=0 tx=0).stop 2024-09-11T23:22:08.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.087+0000 7fa8b3200640 1 -- 172.21.15.144:0/3577986434 shutdown_connections 2024-09-11T23:22:08.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.087+0000 7fa8b3200640 1 --2- 172.21.15.144:0/3577986434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8b40cdf90 0x7fa8b40b4720 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:08.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.087+0000 7fa8b3200640 1 --2- 172.21.15.144:0/3577986434 >> v2:172.21.15.165:3300/0 conn(0x7fa8b40cff90 0x7fa8b40715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:08.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.087+0000 7fa8b3200640 1 -- 172.21.15.144:0/3577986434 >> 172.21.15.144:0/3577986434 conn(0x7fa8b40cd470 msgr2=0x7fa8b40cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:08.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.087+0000 7fa8b3200640 1 -- 172.21.15.144:0/3577986434 shutdown_connections 2024-09-11T23:22:08.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.087+0000 7fa8b3200640 1 -- 172.21.15.144:0/3577986434 wait complete. 2024-09-11T23:22:08.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.089+0000 7fa8b3200640 1 Processor -- start 2024-09-11T23:22:08.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.089+0000 7fa8b3200640 1 -- start start 2024-09-11T23:22:08.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.090+0000 7fa8b3200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8b40cdf90 0x7fa8b41e7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:08.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.090+0000 7fa8b3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8b40cff90 0x7fa8b4155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:08.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.090+0000 7fa8b3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa8b4161bd0 0x7fa8b41563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:08.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.090+0000 7fa8b3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b40b4de0 con 0x7fa8b40cff90 2024-09-11T23:22:08.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.090+0000 7fa8b3200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b40b4c60 con 0x7fa8b40cdf90 2024-09-11T23:22:08.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.090+0000 7fa8b3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa8b40b4f60 con 0x7fa8b4161bd0 2024-09-11T23:22:08.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.090+0000 7fa8a9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8b40cff90 0x7fa8b4155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:08.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.090+0000 7fa8a9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8b40cff90 0x7fa8b4155ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48454/0 (socket says 172.21.15.144:48454) 2024-09-11T23:22:08.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.090+0000 7fa8a9400640 1 -- 172.21.15.144:0/3685027759 learned_addr learned my addr 172.21.15.144:0/3685027759 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:08.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.090+0000 7fa8b1e00640 1 --2- 172.21.15.144:0/3685027759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8b40cdf90 0x7fa8b41e7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:08.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.090+0000 7fa8b2800640 1 --2- 172.21.15.144:0/3685027759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa8b4161bd0 0x7fa8b41563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:08.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.091+0000 7fa8a9400640 1 -- 172.21.15.144:0/3685027759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa8b4161bd0 msgr2=0x7fa8b41563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:08.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.091+0000 7fa8a9400640 1 --2- 172.21.15.144:0/3685027759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa8b4161bd0 0x7fa8b41563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:08.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.091+0000 7fa8a9400640 1 -- 172.21.15.144:0/3685027759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8b40cdf90 msgr2=0x7fa8b41e7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:08.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.091+0000 7fa8a9400640 1 --2- 172.21.15.144:0/3685027759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8b40cdf90 0x7fa8b41e7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:08.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.091+0000 7fa8a9400640 1 -- 172.21.15.144:0/3685027759 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b406cc90 con 0x7fa8b40cff90 2024-09-11T23:22:08.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.091+0000 7fa8a9400640 1 --2- 172.21.15.144:0/3685027759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8b40cff90 0x7fa8b4155ea0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00d800 tx=0x7fa89c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:08.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.091+0000 7fa8aaa00640 1 -- 172.21.15.144:0/3685027759 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c00b660 con 0x7fa8b40cff90 2024-09-11T23:22:08.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.091+0000 7fa8aaa00640 1 -- 172.21.15.144:0/3685027759 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa89c019070 con 0x7fa8b40cff90 2024-09-11T23:22:08.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.091+0000 7fa8aaa00640 1 -- 172.21.15.144:0/3685027759 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c00ba20 con 0x7fa8b40cff90 2024-09-11T23:22:08.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.091+0000 7fa8b3200640 1 -- 172.21.15.144:0/3685027759 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8b41f42d0 con 0x7fa8b40cff90 2024-09-11T23:22:08.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.091+0000 7fa8b3200640 1 -- 172.21.15.144:0/3685027759 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8b41e8c60 con 0x7fa8b40cff90 2024-09-11T23:22:08.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.092+0000 7fa8b3200640 1 -- 172.21.15.144:0/3685027759 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8b40b6820 con 0x7fa8b40cff90 2024-09-11T23:22:08.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.093+0000 7fa8aaa00640 1 -- 172.21.15.144:0/3685027759 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7fa89c00bbc0 con 0x7fa8b40cff90 2024-09-11T23:22:08.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.094+0000 7fa8aaa00640 1 --2- 172.21.15.144:0/3685027759 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa89006c1c0 0x7fa89006e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:08.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.094+0000 7fa8aaa00640 1 -- 172.21.15.144:0/3685027759 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7fa89c08b610 con 0x7fa8b40cff90 2024-09-11T23:22:08.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.094+0000 7fa8b1e00640 1 --2- 172.21.15.144:0/3685027759 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa89006c1c0 0x7fa89006e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:08.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.095+0000 7fa8b1e00640 1 --2- 172.21.15.144:0/3685027759 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa89006c1c0 0x7fa89006e680 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40b57a0 tx=0x7fa8a4009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:08.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.098+0000 7fa8aaa00640 1 -- 172.21.15.144:0/3685027759 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa8b40b6820 con 0x7fa8b40cff90 2024-09-11T23:22:08.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:08.306+0000 7fa8b3200640 1 -- 172.21.15.144:0/3685027759 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fa8b40cf5b0 con 0x7fa8b40cff90 2024-09-11T23:22:09.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.293+0000 7fa8aaa00640 1 -- 172.21.15.144:0/3685027759 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v47) ==== 136+0+0 (secure 0 0 0) 0x7fa89c0595b0 con 0x7fa8b40cff90 2024-09-11T23:22:09.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.296+0000 7fa8b3200640 1 -- 172.21.15.144:0/3685027759 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa89006c1c0 msgr2=0x7fa89006e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:09.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.296+0000 7fa8b3200640 1 --2- 172.21.15.144:0/3685027759 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa89006c1c0 0x7fa89006e680 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40b57a0 tx=0x7fa8a4009060 comp rx=0 tx=0).stop 2024-09-11T23:22:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.296+0000 7fa8b3200640 1 -- 172.21.15.144:0/3685027759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8b40cff90 msgr2=0x7fa8b4155ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.296+0000 7fa8b3200640 1 --2- 172.21.15.144:0/3685027759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8b40cff90 0x7fa8b4155ea0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00d800 tx=0x7fa89c00dcc0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.296+0000 7fa8b3200640 1 -- 172.21.15.144:0/3685027759 shutdown_connections 2024-09-11T23:22:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.296+0000 7fa8b3200640 1 --2- 172.21.15.144:0/3685027759 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fa89006c1c0 0x7fa89006e680 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.296+0000 7fa8b3200640 1 --2- 172.21.15.144:0/3685027759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa8b4161bd0 0x7fa8b41563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.296+0000 7fa8b3200640 1 --2- 172.21.15.144:0/3685027759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8b40cff90 0x7fa8b4155ea0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.296+0000 7fa8b3200640 1 --2- 172.21.15.144:0/3685027759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8b40cdf90 0x7fa8b41e7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.296+0000 7fa8b3200640 1 -- 172.21.15.144:0/3685027759 >> 172.21.15.144:0/3685027759 conn(0x7fa8b40cd470 msgr2=0x7fa8b40ae970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:09.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.297+0000 7fa8b3200640 1 -- 172.21.15.144:0/3685027759 shutdown_connections 2024-09-11T23:22:09.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.297+0000 7fa8b3200640 1 -- 172.21.15.144:0/3685027759 wait complete. 2024-09-11T23:22:09.317 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-11T23:22:09.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.478+0000 7f5c15c00640 1 Processor -- start 2024-09-11T23:22:09.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.478+0000 7f5c15c00640 1 -- start start 2024-09-11T23:22:09.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.478+0000 7f5c15c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5c100b5fd0 0x7f5c100b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:09.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.478+0000 7f5c15c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c1006bee0 con 0x7f5c100b7750 2024-09-11T23:22:09.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.478+0000 7f5c15c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c1006c1c0 con 0x7f5c1015e640 2024-09-11T23:22:09.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.478+0000 7f5c15c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5c1015ea20 con 0x7f5c100b5fd0 2024-09-11T23:22:09.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.478+0000 7f5c15200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5c100b7750 0x7f5c100b7be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:38030/0 (socket says 172.21.15.144:38030) 2024-09-11T23:22:09.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.478+0000 7f5c15200640 1 -- 172.21.15.144:0/3348421291 learned_addr learned my addr 172.21.15.144:0/3348421291 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:09.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.478+0000 7f5c0f400640 1 --2- 172.21.15.144:0/3348421291 >> v2:172.21.15.165:3300/0 conn(0x7f5c100b5fd0 0x7f5c100b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:09.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.479+0000 7f5c0ea00640 1 -- 172.21.15.144:0/3348421291 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3985784606 0 0) 0x7f5c1006bee0 con 0x7f5c100b7750 2024-09-11T23:22:09.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.479+0000 7f5c0ea00640 1 -- 172.21.15.144:0/3348421291 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bf4003520 con 0x7f5c100b7750 2024-09-11T23:22:09.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.479+0000 7f5c0ea00640 1 -- 172.21.15.144:0/3348421291 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2385673748 0 0) 0x7f5c1006c1c0 con 0x7f5c1015e640 2024-09-11T23:22:09.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.479+0000 7f5c0ea00640 1 -- 172.21.15.144:0/3348421291 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c1006bee0 con 0x7f5c1015e640 2024-09-11T23:22:09.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.479+0000 7f5c0ea00640 1 -- 172.21.15.144:0/3348421291 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3710520214 0 0) 0x7f5bf4003520 con 0x7f5c100b7750 2024-09-11T23:22:09.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.479+0000 7f5c0ea00640 1 -- 172.21.15.144:0/3348421291 >> v2:172.21.15.165:3300/0 conn(0x7f5c100b5fd0 msgr2=0x7f5c100b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:09.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.479+0000 7f5c0ea00640 1 --2- 172.21.15.144:0/3348421291 >> v2:172.21.15.165:3300/0 conn(0x7f5c100b5fd0 0x7f5c100b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.479+0000 7f5c0ea00640 1 -- 172.21.15.144:0/3348421291 >> v1:172.21.15.165:6789/0 conn(0x7f5c1015e640 legacy=0x7f5c100d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:09.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.479+0000 7f5c0ea00640 1 -- 172.21.15.144:0/3348421291 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1006c4a0 con 0x7f5c100b7750 2024-09-11T23:22:09.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.479+0000 7f5c0ea00640 1 -- 172.21.15.144:0/3348421291 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f5c080019f0 con 0x7f5c100b7750 2024-09-11T23:22:09.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.479+0000 7f5c0ea00640 1 -- 172.21.15.144:0/3348421291 >> v1:172.21.15.144:6789/0 conn(0x7f5c100b7750 legacy=0x7f5c100b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:09.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.479+0000 7f5c0ea00640 1 --2- 172.21.15.144:0/3348421291 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bf4003b90 0x7f5bf4003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:09.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.479+0000 7f5c0ea00640 1 --2- 172.21.15.144:0/3348421291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bf4004800 0x7f5bf4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:09.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.479+0000 7f5c0ea00640 1 --2- 172.21.15.144:0/3348421291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf40051c0 0x7f5bf400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:09.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.479+0000 7f5c0ea00640 1 -- 172.21.15.144:0/3348421291 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf400c090 con 0x7f5bf40051c0 2024-09-11T23:22:09.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.479+0000 7f5c0ea00640 1 -- 172.21.15.144:0/3348421291 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf400c210 con 0x7f5bf4004800 2024-09-11T23:22:09.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.479+0000 7f5c0ea00640 1 -- 172.21.15.144:0/3348421291 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5bf400c410 con 0x7f5bf4003b90 2024-09-11T23:22:09.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.479+0000 7f5c15200640 1 --2- 172.21.15.144:0/3348421291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf40051c0 0x7f5bf400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:09.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.479+0000 7f5c0f400640 1 --2- 172.21.15.144:0/3348421291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bf4004800 0x7f5bf4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:09.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.479+0000 7f5c0fe00640 1 --2- 172.21.15.144:0/3348421291 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bf4003b90 0x7f5bf4003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:09.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.481+0000 7f5c15200640 1 -- 172.21.15.144:0/3348421291 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bf4003b90 msgr2=0x7f5bf4003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:09.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.481+0000 7f5c15200640 1 --2- 172.21.15.144:0/3348421291 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bf4003b90 0x7f5bf4003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.481+0000 7f5c15200640 1 -- 172.21.15.144:0/3348421291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bf4004800 msgr2=0x7f5bf4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:09.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.481+0000 7f5c15200640 1 --2- 172.21.15.144:0/3348421291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bf4004800 0x7f5bf4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.481+0000 7f5c15200640 1 -- 172.21.15.144:0/3348421291 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf4003520 con 0x7f5bf40051c0 2024-09-11T23:22:09.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.481+0000 7f5c0f400640 1 --2- 172.21.15.144:0/3348421291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bf4004800 0x7f5bf4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:22:09.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.482+0000 7f5c15200640 1 -- 172.21.15.144:0/3348421291 reap_dead start 2024-09-11T23:22:09.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.482+0000 7f5c15200640 1 --2- 172.21.15.144:0/3348421291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf40051c0 0x7f5bf400b9c0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800a730 tx=0x7f5bf4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2320ff500c0193 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:09.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.482+0000 7f5c0ea00640 1 -- 172.21.15.144:0/3348421291 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc009690 con 0x7f5bf40051c0 2024-09-11T23:22:09.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.482+0000 7f5c0ea00640 1 -- 172.21.15.144:0/3348421291 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c0802f070 con 0x7f5bf40051c0 2024-09-11T23:22:09.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.482+0000 7f5c0ea00640 1 -- 172.21.15.144:0/3348421291 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0800a350 con 0x7f5bf40051c0 2024-09-11T23:22:09.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.483+0000 7f5c15c00640 1 -- 172.21.15.144:0/3348421291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf40051c0 msgr2=0x7f5bf400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:09.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.483+0000 7f5c15c00640 1 --2- 172.21.15.144:0/3348421291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf40051c0 0x7f5bf400b9c0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800a730 tx=0x7f5bf4005830 comp rx=0 tx=0).stop 2024-09-11T23:22:09.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.483+0000 7f5c15c00640 1 -- 172.21.15.144:0/3348421291 shutdown_connections 2024-09-11T23:22:09.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.483+0000 7f5c15c00640 1 --2- 172.21.15.144:0/3348421291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bf40051c0 0x7f5bf400b9c0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.483+0000 7f5c15c00640 1 -- 172.21.15.144:0/3348421291 >> 172.21.15.144:0/3348421291 conn(0x7f5c100d0fd0 msgr2=0x7f5c100d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:09.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.483+0000 7f5c15c00640 1 -- 172.21.15.144:0/3348421291 shutdown_connections 2024-09-11T23:22:09.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.483+0000 7f5c15c00640 1 -- 172.21.15.144:0/3348421291 wait complete. 2024-09-11T23:22:09.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.484+0000 7f5c15c00640 1 Processor -- start 2024-09-11T23:22:09.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.484+0000 7f5c15c00640 1 -- start start 2024-09-11T23:22:09.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.484+0000 7f5c15c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bf40051c0 0x7f5c100aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:09.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.484+0000 7f5c15c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c101e8a40 0x7f5c1015d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:09.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.484+0000 7f5c15c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c1015d6d0 0x7f5c100b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:09.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.486+0000 7f5c15c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5c100b6410 con 0x7f5c101e8a40 2024-09-11T23:22:09.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.486+0000 7f5c15c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1006caf0 con 0x7f5c1015d6d0 2024-09-11T23:22:09.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.486+0000 7f5c15c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5c100b6590 con 0x7f5bf40051c0 2024-09-11T23:22:09.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.486+0000 7f5c0f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c101e8a40 0x7f5c1015d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:09.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.486+0000 7f5c0f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c101e8a40 0x7f5c1015d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48476/0 (socket says 172.21.15.144:48476) 2024-09-11T23:22:09.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.486+0000 7f5c0f400640 1 -- 172.21.15.144:0/2499559624 learned_addr learned my addr 172.21.15.144:0/2499559624 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:09.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.486+0000 7f5c0fe00640 1 --2- 172.21.15.144:0/2499559624 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bf40051c0 0x7f5c100aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:09.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.486+0000 7f5c15200640 1 --2- 172.21.15.144:0/2499559624 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c1015d6d0 0x7f5c100b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:09.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.486+0000 7f5c0f400640 1 -- 172.21.15.144:0/2499559624 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bf40051c0 msgr2=0x7f5c100aafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:09.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.486+0000 7f5c0f400640 1 --2- 172.21.15.144:0/2499559624 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bf40051c0 0x7f5c100aafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.486+0000 7f5c0f400640 1 -- 172.21.15.144:0/2499559624 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c1015d6d0 msgr2=0x7f5c100b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:09.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.486+0000 7f5c0f400640 1 --2- 172.21.15.144:0/2499559624 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c1015d6d0 0x7f5c100b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.486+0000 7f5c0f400640 1 -- 172.21.15.144:0/2499559624 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c101e8f40 con 0x7f5c101e8a40 2024-09-11T23:22:09.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.486+0000 7f5c0f400640 1 --2- 172.21.15.144:0/2499559624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c101e8a40 0x7f5c1015d190 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc011930 tx=0x7f5bfc011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:09.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.487+0000 7f5c07e00640 1 -- 172.21.15.144:0/2499559624 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc00f9d0 con 0x7f5c101e8a40 2024-09-11T23:22:09.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.487+0000 7f5c07e00640 1 -- 172.21.15.144:0/2499559624 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bfc00fb70 con 0x7f5c101e8a40 2024-09-11T23:22:09.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.487+0000 7f5c07e00640 1 -- 172.21.15.144:0/2499559624 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc014440 con 0x7f5c101e8a40 2024-09-11T23:22:09.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.487+0000 7f5c15c00640 1 -- 172.21.15.144:0/2499559624 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c101e9220 con 0x7f5c101e8a40 2024-09-11T23:22:09.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.487+0000 7f5c15c00640 1 -- 172.21.15.144:0/2499559624 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c101e97e0 con 0x7f5c101e8a40 2024-09-11T23:22:09.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.488+0000 7f5c15c00640 1 -- 172.21.15.144:0/2499559624 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c100d41e0 con 0x7f5c101e8a40 2024-09-11T23:22:09.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.489+0000 7f5c07e00640 1 -- 172.21.15.144:0/2499559624 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f5bfc012040 con 0x7f5c101e8a40 2024-09-11T23:22:09.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.489+0000 7f5c07e00640 1 --2- 172.21.15.144:0/2499559624 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5bf006c190 0x7f5bf006e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:09.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.490+0000 7f5c07e00640 1 -- 172.21.15.144:0/2499559624 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f5bfc08b9d0 con 0x7f5c101e8a40 2024-09-11T23:22:09.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.490+0000 7f5c0fe00640 1 --2- 172.21.15.144:0/2499559624 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5bf006c190 0x7f5bf006e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:09.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.490+0000 7f5c0fe00640 1 --2- 172.21.15.144:0/2499559624 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5bf006c190 0x7f5bf006e650 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5c100b51e0 tx=0x7f5c00009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:09.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.494+0000 7f5c07e00640 1 -- 172.21.15.144:0/2499559624 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5bfc019030 con 0x7f5c101e8a40 2024-09-11T23:22:09.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.691+0000 7f5c15c00640 1 -- 172.21.15.144:0/2499559624 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f5c100691f0 con 0x7f5bf006c190 2024-09-11T23:22:09.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.692+0000 7f5c07e00640 1 -- 172.21.15.144:0/2499559624 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f5c00012890 con 0x7f5bf006c190 2024-09-11T23:22:09.692 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:22:09.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:09.692 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephfs" 2024-09-11T23:22:09.692 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:09.693 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:22:09.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.695+0000 7f5c15c00640 1 -- 172.21.15.144:0/2499559624 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5bf006c190 msgr2=0x7f5bf006e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:09.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.695+0000 7f5c15c00640 1 --2- 172.21.15.144:0/2499559624 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5bf006c190 0x7f5bf006e650 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5c100b51e0 tx=0x7f5c00009040 comp rx=0 tx=0).stop 2024-09-11T23:22:09.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.695+0000 7f5c15c00640 1 -- 172.21.15.144:0/2499559624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c101e8a40 msgr2=0x7f5c1015d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:09.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.695+0000 7f5c15c00640 1 --2- 172.21.15.144:0/2499559624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c101e8a40 0x7f5c1015d190 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc011930 tx=0x7f5bfc011d30 comp rx=0 tx=0).stop 2024-09-11T23:22:09.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.695+0000 7f5c15c00640 1 -- 172.21.15.144:0/2499559624 shutdown_connections 2024-09-11T23:22:09.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.695+0000 7f5c15c00640 1 --2- 172.21.15.144:0/2499559624 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f5bf006c190 0x7f5bf006e650 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.695+0000 7f5c15c00640 1 --2- 172.21.15.144:0/2499559624 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c1015d6d0 0x7f5c100b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.695+0000 7f5c15c00640 1 --2- 172.21.15.144:0/2499559624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5c101e8a40 0x7f5c1015d190 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.695+0000 7f5c15c00640 1 --2- 172.21.15.144:0/2499559624 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bf40051c0 0x7f5c100aafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.695+0000 7f5c15c00640 1 -- 172.21.15.144:0/2499559624 >> 172.21.15.144:0/2499559624 conn(0x7f5c100d0fd0 msgr2=0x7f5c100b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:09.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.695+0000 7f5c15c00640 1 -- 172.21.15.144:0/2499559624 shutdown_connections 2024-09-11T23:22:09.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.695+0000 7f5c15c00640 1 -- 172.21.15.144:0/2499559624 wait complete. 2024-09-11T23:22:09.710 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:22:09.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.868+0000 7fe768e00640 1 Processor -- start 2024-09-11T23:22:09.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.868+0000 7fe768e00640 1 -- start start 2024-09-11T23:22:09.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.869+0000 7fe768e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe76406c660 0x7fe7640cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:09.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.869+0000 7fe768e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe76406d080 0x7fe76406d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:09.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.869+0000 7fe768e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe76406caf0 con 0x7fe76415a750 2024-09-11T23:22:09.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.869+0000 7fe768e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe7640cde70 con 0x7fe76406d080 2024-09-11T23:22:09.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.869+0000 7fe768e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe76415e590 con 0x7fe76406c660 2024-09-11T23:22:09.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.869+0000 7fe763400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe76415a750 0x7fe76415ed50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:38032/0 (socket says 172.21.15.144:38032) 2024-09-11T23:22:09.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.869+0000 7fe763400640 1 -- 172.21.15.144:0/3336039535 learned_addr learned my addr 172.21.15.144:0/3336039535 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:09.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.869+0000 7fe763e00640 1 --2- 172.21.15.144:0/3336039535 >> v2:172.21.15.144:3300/0 conn(0x7fe76406d080 0x7fe76406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:09.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.870+0000 7fe762a00640 1 --2- 172.21.15.144:0/3336039535 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe76406c660 0x7fe7640cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:09.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.870+0000 7fe762000640 1 -- 172.21.15.144:0/3336039535 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3015461894 0 0) 0x7fe754001110 con 0x7fe76415a750 2024-09-11T23:22:09.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.870+0000 7fe762000640 1 -- 172.21.15.144:0/3336039535 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe748005730 con 0x7fe76415a750 2024-09-11T23:22:09.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.870+0000 7fe763e00640 1 -- 172.21.15.144:0/3336039535 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe76406c660 msgr2=0x7fe7640cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:09.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.870+0000 7fe763e00640 1 --2- 172.21.15.144:0/3336039535 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe76406c660 0x7fe7640cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.870+0000 7fe763e00640 1 -- 172.21.15.144:0/3336039535 >> v1:172.21.15.144:6789/0 conn(0x7fe76415a750 legacy=0x7fe76415ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:09.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.870+0000 7fe763e00640 1 -- 172.21.15.144:0/3336039535 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7640ce660 con 0x7fe76406d080 2024-09-11T23:22:09.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.871+0000 7fe763e00640 1 --2- 172.21.15.144:0/3336039535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe76406d080 0x7fe76406d510 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009dc0 tx=0x7fe75c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82039ccb6e86ce9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:09.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.871+0000 7fe762000640 1 -- 172.21.15.144:0/3336039535 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c007740 con 0x7fe76406d080 2024-09-11T23:22:09.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.871+0000 7fe762000640 1 -- 172.21.15.144:0/3336039535 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe75c0078e0 con 0x7fe76406d080 2024-09-11T23:22:09.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.871+0000 7fe762000640 1 -- 172.21.15.144:0/3336039535 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c007cb0 con 0x7fe76406d080 2024-09-11T23:22:09.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.872+0000 7fe768e00640 1 -- 172.21.15.144:0/3336039535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe76406d080 msgr2=0x7fe76406d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:09.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.872+0000 7fe768e00640 1 --2- 172.21.15.144:0/3336039535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe76406d080 0x7fe76406d510 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009dc0 tx=0x7fe75c02a5f0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.872+0000 7fe768e00640 1 -- 172.21.15.144:0/3336039535 shutdown_connections 2024-09-11T23:22:09.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.872+0000 7fe768e00640 1 --2- 172.21.15.144:0/3336039535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe76406d080 0x7fe76406d510 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.872+0000 7fe768e00640 1 --2- 172.21.15.144:0/3336039535 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe76406c660 0x7fe7640cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.872+0000 7fe768e00640 1 -- 172.21.15.144:0/3336039535 >> 172.21.15.144:0/3336039535 conn(0x7fe7640d0300 msgr2=0x7fe7640d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:09.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.872+0000 7fe768e00640 1 -- 172.21.15.144:0/3336039535 shutdown_connections 2024-09-11T23:22:09.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.872+0000 7fe768e00640 1 -- 172.21.15.144:0/3336039535 wait complete. 2024-09-11T23:22:09.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.873+0000 7fe768e00640 1 Processor -- start 2024-09-11T23:22:09.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.873+0000 7fe768e00640 1 -- start start 2024-09-11T23:22:09.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.874+0000 7fe768e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe76406c660 0x7fe7641431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:09.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.874+0000 7fe768e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe76406d080 0x7fe7640b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:09.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.874+0000 7fe768e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe76415a750 0x7fe7640b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:09.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.874+0000 7fe768e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe76415e830 con 0x7fe76406c660 2024-09-11T23:22:09.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.874+0000 7fe768e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe7640ce380 con 0x7fe76406d080 2024-09-11T23:22:09.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.874+0000 7fe768e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe76415bb40 con 0x7fe76415a750 2024-09-11T23:22:09.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.874+0000 7fe763400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe76406c660 0x7fe7641431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:09.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.875+0000 7fe763400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe76406c660 0x7fe7641431e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48500/0 (socket says 172.21.15.144:48500) 2024-09-11T23:22:09.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.875+0000 7fe763400640 1 -- 172.21.15.144:0/831903568 learned_addr learned my addr 172.21.15.144:0/831903568 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:09.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.875+0000 7fe763e00640 1 --2- 172.21.15.144:0/831903568 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe76415a750 0x7fe7640b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:09.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.875+0000 7fe762a00640 1 --2- 172.21.15.144:0/831903568 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe76406d080 0x7fe7640b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:09.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.875+0000 7fe763400640 1 -- 172.21.15.144:0/831903568 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe76415a750 msgr2=0x7fe7640b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:09.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.875+0000 7fe763400640 1 --2- 172.21.15.144:0/831903568 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe76415a750 0x7fe7640b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.875+0000 7fe763400640 1 -- 172.21.15.144:0/831903568 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe76406d080 msgr2=0x7fe7640b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:09.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.875+0000 7fe763400640 1 --2- 172.21.15.144:0/831903568 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe76406d080 0x7fe7640b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:09.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.875+0000 7fe763400640 1 -- 172.21.15.144:0/831903568 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe764156a00 con 0x7fe76406c660 2024-09-11T23:22:09.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.875+0000 7fe763400640 1 --2- 172.21.15.144:0/831903568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe76406c660 0x7fe7641431e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe75400c3a0 tx=0x7fe75400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:09.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.875+0000 7fe75b400640 1 -- 172.21.15.144:0/831903568 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754017070 con 0x7fe76406c660 2024-09-11T23:22:09.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.875+0000 7fe75b400640 1 -- 172.21.15.144:0/831903568 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe754005ce0 con 0x7fe76406c660 2024-09-11T23:22:09.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.875+0000 7fe768e00640 1 -- 172.21.15.144:0/831903568 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe764156ce0 con 0x7fe76406c660 2024-09-11T23:22:09.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.875+0000 7fe75b400640 1 -- 172.21.15.144:0/831903568 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754007310 con 0x7fe76406c660 2024-09-11T23:22:09.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.876+0000 7fe768e00640 1 -- 172.21.15.144:0/831903568 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe764141350 con 0x7fe76406c660 2024-09-11T23:22:09.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.877+0000 7fe768e00640 1 -- 172.21.15.144:0/831903568 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe764141550 con 0x7fe76406c660 2024-09-11T23:22:09.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.877+0000 7fe75b400640 1 -- 172.21.15.144:0/831903568 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7fe75401a070 con 0x7fe76406c660 2024-09-11T23:22:09.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.879+0000 7fe75b400640 1 --2- 172.21.15.144:0/831903568 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe74406c190 0x7fe74406e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:09.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.879+0000 7fe75b400640 1 -- 172.21.15.144:0/831903568 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7fe75408a810 con 0x7fe76406c660 2024-09-11T23:22:09.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.879+0000 7fe762a00640 1 --2- 172.21.15.144:0/831903568 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe74406c190 0x7fe74406e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:09.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.880+0000 7fe762a00640 1 --2- 172.21.15.144:0/831903568 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe74406c190 0x7fe74406e650 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe764151710 tx=0x7fe750008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:09.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:09.883+0000 7fe75b400640 1 -- 172.21.15.144:0/831903568 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe764141550 con 0x7fe76406c660 2024-09-11T23:22:10.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.056+0000 7fe768e00640 1 -- 172.21.15.144:0/831903568 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe7640cd930 con 0x7fe76406c660 2024-09-11T23:22:10.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.056+0000 7fe75b400640 1 -- 172.21.15.144:0/831903568 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7fe76406caf0 con 0x7fe76406c660 2024-09-11T23:22:10.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.058+0000 7fe768e00640 1 -- 172.21.15.144:0/831903568 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe74406c190 msgr2=0x7fe74406e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:10.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.058+0000 7fe768e00640 1 --2- 172.21.15.144:0/831903568 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe74406c190 0x7fe74406e650 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe764151710 tx=0x7fe750008040 comp rx=0 tx=0).stop 2024-09-11T23:22:10.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.058+0000 7fe768e00640 1 -- 172.21.15.144:0/831903568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe76406c660 msgr2=0x7fe7641431e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:10.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.058+0000 7fe768e00640 1 --2- 172.21.15.144:0/831903568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe76406c660 0x7fe7641431e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe75400c3a0 tx=0x7fe75400c860 comp rx=0 tx=0).stop 2024-09-11T23:22:10.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.059+0000 7fe768e00640 1 -- 172.21.15.144:0/831903568 shutdown_connections 2024-09-11T23:22:10.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.059+0000 7fe768e00640 1 --2- 172.21.15.144:0/831903568 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe74406c190 0x7fe74406e650 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:10.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.059+0000 7fe768e00640 1 --2- 172.21.15.144:0/831903568 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe76415a750 0x7fe7640b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:10.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.059+0000 7fe768e00640 1 --2- 172.21.15.144:0/831903568 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe76406d080 0x7fe7640b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:10.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.059+0000 7fe768e00640 1 --2- 172.21.15.144:0/831903568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe76406c660 0x7fe7641431e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:10.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.059+0000 7fe768e00640 1 -- 172.21.15.144:0/831903568 >> 172.21.15.144:0/831903568 conn(0x7fe7640d0300 msgr2=0x7fe7640cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:10.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.059+0000 7fe768e00640 1 -- 172.21.15.144:0/831903568 shutdown_connections 2024-09-11T23:22:10.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.059+0000 7fe768e00640 1 -- 172.21.15.144:0/831903568 wait complete. 2024-09-11T23:22:10.074 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:22:10.074 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:10.110 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:22:10.110 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:10.185 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:22:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.379+0000 7f7943a00640 1 Processor -- start 2024-09-11T23:22:10.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.380+0000 7f7943a00640 1 -- start start 2024-09-11T23:22:10.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.381+0000 7f7943a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f793c0d02a0 0x7f793c0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:10.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.381+0000 7f7943a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f793c15ce80 0x7f793c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:10.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.381+0000 7f7943a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f793c0d0bc0 con 0x7f793c15ca40 2024-09-11T23:22:10.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.381+0000 7f7943a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f793c15d390 con 0x7f793c15ce80 2024-09-11T23:22:10.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.381+0000 7f7943a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f793c15d670 con 0x7f793c0d02a0 2024-09-11T23:22:10.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.381+0000 7f7941a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f793c15ce80 0x7f793c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:10.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.381+0000 7f7941a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f793c15ce80 0x7f793c1594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48514/0 (socket says 172.21.15.144:48514) 2024-09-11T23:22:10.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.381+0000 7f7933e00640 1 --1- 172.21.15.144:0/2408866006 >> v1:172.21.15.144:6789/0 conn(0x7f793c15ca40 0x7f793c15e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:38038/0 (socket says 172.21.15.144:38038) 2024-09-11T23:22:10.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.381+0000 7f7941a00640 1 -- 172.21.15.144:0/2408866006 learned_addr learned my addr 172.21.15.144:0/2408866006 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:10.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.381+0000 7f7941000640 1 --2- 172.21.15.144:0/2408866006 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f793c0d02a0 0x7f793c0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.382+0000 7f7941a00640 1 -- 172.21.15.144:0/2408866006 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f793c0d02a0 msgr2=0x7f793c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.382+0000 7f7941a00640 1 --2- 172.21.15.144:0/2408866006 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f793c0d02a0 0x7f793c0d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.382+0000 7f7941a00640 1 -- 172.21.15.144:0/2408866006 >> v1:172.21.15.144:6789/0 conn(0x7f793c15ca40 legacy=0x7f793c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.382+0000 7f7941a00640 1 -- 172.21.15.144:0/2408866006 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793c15d950 con 0x7f793c15ce80 2024-09-11T23:22:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.383+0000 7f7941a00640 1 --2- 172.21.15.144:0/2408866006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f793c15ce80 0x7f793c1594c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7934009e50 tx=0x7f793402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8095880dafda8bd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.383+0000 7f793be00640 1 -- 172.21.15.144:0/2408866006 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934036070 con 0x7f793c15ce80 2024-09-11T23:22:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.383+0000 7f793be00640 1 -- 172.21.15.144:0/2408866006 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7934031600 con 0x7f793c15ce80 2024-09-11T23:22:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.383+0000 7f793be00640 1 -- 172.21.15.144:0/2408866006 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79340319d0 con 0x7f793c15ce80 2024-09-11T23:22:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.383+0000 7f7943a00640 1 -- 172.21.15.144:0/2408866006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f793c15ce80 msgr2=0x7f793c1594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.383+0000 7f7943a00640 1 --2- 172.21.15.144:0/2408866006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f793c15ce80 0x7f793c1594c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7934009e50 tx=0x7f793402a6a0 comp rx=0 tx=0).stop 2024-09-11T23:22:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.383+0000 7f7943a00640 1 -- 172.21.15.144:0/2408866006 shutdown_connections 2024-09-11T23:22:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.383+0000 7f7943a00640 1 --2- 172.21.15.144:0/2408866006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f793c15ce80 0x7f793c1594c0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:10.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.383+0000 7f7943a00640 1 --2- 172.21.15.144:0/2408866006 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f793c0d02a0 0x7f793c0d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:10.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.383+0000 7f7943a00640 1 -- 172.21.15.144:0/2408866006 >> 172.21.15.144:0/2408866006 conn(0x7f793c062cc0 msgr2=0x7f793c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:10.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.384+0000 7f7943a00640 1 -- 172.21.15.144:0/2408866006 shutdown_connections 2024-09-11T23:22:10.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.384+0000 7f7943a00640 1 -- 172.21.15.144:0/2408866006 wait complete. 2024-09-11T23:22:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.385+0000 7f7943a00640 1 Processor -- start 2024-09-11T23:22:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.385+0000 7f7943a00640 1 -- start start 2024-09-11T23:22:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.386+0000 7f7943a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f793c0d02a0 0x7f793c071350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.386+0000 7f7943a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f793c15ca40 0x7f793c073a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.386+0000 7f7943a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f793c15ce80 0x7f793c151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.386+0000 7f7943a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f793c15eb40 con 0x7f793c15ca40 2024-09-11T23:22:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.386+0000 7f7943a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f793c15df10 con 0x7f793c15ce80 2024-09-11T23:22:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.386+0000 7f7943a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f793c155b90 con 0x7f793c0d02a0 2024-09-11T23:22:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.386+0000 7f7933e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f793c15ca40 0x7f793c073a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.386+0000 7f7933e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f793c15ca40 0x7f793c073a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48528/0 (socket says 172.21.15.144:48528) 2024-09-11T23:22:10.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.386+0000 7f7933e00640 1 -- 172.21.15.144:0/2313016423 learned_addr learned my addr 172.21.15.144:0/2313016423 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.386+0000 7f7941000640 1 --2- 172.21.15.144:0/2313016423 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f793c0d02a0 0x7f793c071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.386+0000 7f7941a00640 1 --2- 172.21.15.144:0/2313016423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f793c15ce80 0x7f793c151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.387+0000 7f7933e00640 1 -- 172.21.15.144:0/2313016423 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f793c0d02a0 msgr2=0x7f793c071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.387+0000 7f7933e00640 1 --2- 172.21.15.144:0/2313016423 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f793c0d02a0 0x7f793c071350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.387+0000 7f7933e00640 1 -- 172.21.15.144:0/2313016423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f793c15ce80 msgr2=0x7f793c151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.387+0000 7f7933e00640 1 --2- 172.21.15.144:0/2313016423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f793c15ce80 0x7f793c151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.387+0000 7f7933e00640 1 -- 172.21.15.144:0/2313016423 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793c074280 con 0x7f793c15ca40 2024-09-11T23:22:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.387+0000 7f7933e00640 1 --2- 172.21.15.144:0/2313016423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f793c15ca40 0x7f793c073a30 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f792400c440 tx=0x7f792400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.387+0000 7f7939600640 1 -- 172.21.15.144:0/2313016423 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79240074e0 con 0x7f793c15ca40 2024-09-11T23:22:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.387+0000 7f7939600640 1 -- 172.21.15.144:0/2313016423 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7924007680 con 0x7f793c15ca40 2024-09-11T23:22:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.387+0000 7f7939600640 1 -- 172.21.15.144:0/2313016423 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7924004a20 con 0x7f793c15ca40 2024-09-11T23:22:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.387+0000 7f7943a00640 1 -- 172.21.15.144:0/2313016423 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f793c14aa50 con 0x7f793c15ca40 2024-09-11T23:22:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.387+0000 7f7943a00640 1 -- 172.21.15.144:0/2313016423 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f793c14b2b0 con 0x7f793c15ca40 2024-09-11T23:22:10.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.389+0000 7f7943a00640 1 -- 172.21.15.144:0/2313016423 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f793c14b4b0 con 0x7f793c15ca40 2024-09-11T23:22:10.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.390+0000 7f7939600640 1 -- 172.21.15.144:0/2313016423 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f792401a020 con 0x7f793c15ca40 2024-09-11T23:22:10.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.390+0000 7f7939600640 1 --2- 172.21.15.144:0/2313016423 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f791806c190 0x7f791806e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:10.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.390+0000 7f7939600640 1 -- 172.21.15.144:0/2313016423 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f792408a9e0 con 0x7f793c15ca40 2024-09-11T23:22:10.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.391+0000 7f7941000640 1 --2- 172.21.15.144:0/2313016423 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f791806c190 0x7f791806e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:10.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.391+0000 7f7941000640 1 --2- 172.21.15.144:0/2313016423 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f791806c190 0x7f791806e650 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f792c0079a0 tx=0x7f792c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:10.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.395+0000 7f7939600640 1 -- 172.21.15.144:0/2313016423 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f793c14b4b0 con 0x7f793c15ca40 2024-09-11T23:22:10.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.584+0000 7f7943a00640 1 -- 172.21.15.144:0/2313016423 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f793c0b4790 con 0x7f793c15ca40 2024-09-11T23:22:10.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.585+0000 7f7939600640 1 -- 172.21.15.144:0/2313016423 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v71) ==== 80+0+0 (secure 0 0 0) 0x7f7924058930 con 0x7f793c15ca40 2024-09-11T23:22:10.585 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:22:10.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.587+0000 7f7943a00640 1 -- 172.21.15.144:0/2313016423 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f791806c190 msgr2=0x7f791806e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:10.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.587+0000 7f7943a00640 1 --2- 172.21.15.144:0/2313016423 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f791806c190 0x7f791806e650 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f792c0079a0 tx=0x7f792c008040 comp rx=0 tx=0).stop 2024-09-11T23:22:10.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.587+0000 7f7943a00640 1 -- 172.21.15.144:0/2313016423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f793c15ca40 msgr2=0x7f793c073a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:10.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.587+0000 7f7943a00640 1 --2- 172.21.15.144:0/2313016423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f793c15ca40 0x7f793c073a30 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f792400c440 tx=0x7f792400c900 comp rx=0 tx=0).stop 2024-09-11T23:22:10.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.587+0000 7f7943a00640 1 -- 172.21.15.144:0/2313016423 shutdown_connections 2024-09-11T23:22:10.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.587+0000 7f7943a00640 1 --2- 172.21.15.144:0/2313016423 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f791806c190 0x7f791806e650 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:10.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.587+0000 7f7943a00640 1 --2- 172.21.15.144:0/2313016423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f793c15ce80 0x7f793c151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:10.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.587+0000 7f7943a00640 1 --2- 172.21.15.144:0/2313016423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f793c15ca40 0x7f793c073a30 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:10.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.587+0000 7f7943a00640 1 --2- 172.21.15.144:0/2313016423 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f793c0d02a0 0x7f793c071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:10.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.587+0000 7f7943a00640 1 -- 172.21.15.144:0/2313016423 >> 172.21.15.144:0/2313016423 conn(0x7f793c062cc0 msgr2=0x7f793c152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:10.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.587+0000 7f7943a00640 1 -- 172.21.15.144:0/2313016423 shutdown_connections 2024-09-11T23:22:10.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.587+0000 7f7943a00640 1 -- 172.21.15.144:0/2313016423 wait complete. 2024-09-11T23:22:10.603 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T23:22:10.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:10.603 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T23:22:10.666 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:22:10.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:10.667 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:22:10.702 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:22:10.703 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:10.743 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:22:10.743 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:10.821 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:22:10.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.975+0000 7f6453200640 1 Processor -- start 2024-09-11T23:22:10.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.975+0000 7f6453200640 1 -- start start 2024-09-11T23:22:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.977+0000 7f6453200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f644c15ca40 0x7f644c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.977+0000 7f6453200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f644c15ceb0 0x7f644c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.977+0000 7f6453200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f644c15d390 con 0x7f644c0d02a0 2024-09-11T23:22:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.977+0000 7f6453200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f644c15d670 con 0x7f644c15ca40 2024-09-11T23:22:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.977+0000 7f6453200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f644c15d950 con 0x7f644c15ceb0 2024-09-11T23:22:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.977+0000 7f6443400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f644c15ca40 0x7f644c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.977+0000 7f6443400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f644c15ca40 0x7f644c15e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48544/0 (socket says 172.21.15.144:48544) 2024-09-11T23:22:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.977+0000 7f6443400640 1 -- 172.21.15.144:0/3271605353 learned_addr learned my addr 172.21.15.144:0/3271605353 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.977+0000 7f6451200640 1 --2- 172.21.15.144:0/3271605353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f644c15ceb0 0x7f644c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:10.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.977+0000 7f6443400640 1 -- 172.21.15.144:0/3271605353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f644c15ceb0 msgr2=0x7f644c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:10.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.977+0000 7f6443400640 1 --2- 172.21.15.144:0/3271605353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f644c15ceb0 0x7f644c1594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:10.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.977+0000 7f6443400640 1 -- 172.21.15.144:0/3271605353 >> v1:172.21.15.165:6789/0 conn(0x7f644c0d02a0 legacy=0x7f644c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:10.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.977+0000 7f6443400640 1 -- 172.21.15.144:0/3271605353 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c15dc30 con 0x7f644c15ca40 2024-09-11T23:22:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.978+0000 7f6443400640 1 --2- 172.21.15.144:0/3271605353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f644c15ca40 0x7f644c15e430 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6434009870 tx=0x7f643402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443dcf95db18ce4f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.979+0000 7f644b400640 1 -- 172.21.15.144:0/3271605353 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6434037070 con 0x7f644c15ca40 2024-09-11T23:22:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.979+0000 7f644b400640 1 -- 172.21.15.144:0/3271605353 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6434032440 con 0x7f644c15ca40 2024-09-11T23:22:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.979+0000 7f644b400640 1 -- 172.21.15.144:0/3271605353 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6434032810 con 0x7f644c15ca40 2024-09-11T23:22:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.979+0000 7f6453200640 1 -- 172.21.15.144:0/3271605353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f644c15ca40 msgr2=0x7f644c15e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.979+0000 7f6453200640 1 --2- 172.21.15.144:0/3271605353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f644c15ca40 0x7f644c15e430 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6434009870 tx=0x7f643402a1c0 comp rx=0 tx=0).stop 2024-09-11T23:22:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.979+0000 7f6453200640 1 -- 172.21.15.144:0/3271605353 shutdown_connections 2024-09-11T23:22:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.979+0000 7f6453200640 1 --2- 172.21.15.144:0/3271605353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f644c15ceb0 0x7f644c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:10.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.979+0000 7f6453200640 1 --2- 172.21.15.144:0/3271605353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f644c15ca40 0x7f644c15e430 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:10.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.979+0000 7f6453200640 1 -- 172.21.15.144:0/3271605353 >> 172.21.15.144:0/3271605353 conn(0x7f644c062cc0 msgr2=0x7f644c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:10.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.979+0000 7f6453200640 1 -- 172.21.15.144:0/3271605353 shutdown_connections 2024-09-11T23:22:10.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.979+0000 7f6453200640 1 -- 172.21.15.144:0/3271605353 wait complete. 2024-09-11T23:22:10.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.981+0000 7f6453200640 1 Processor -- start 2024-09-11T23:22:10.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.981+0000 7f6453200640 1 -- start start 2024-09-11T23:22:10.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.982+0000 7f6453200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f644c0d02a0 0x7f644c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:10.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.982+0000 7f6453200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f644c15ca40 0x7f644c1f4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:10.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.982+0000 7f6453200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f644c15ceb0 0x7f644c1ee160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:10.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.982+0000 7f6453200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f644c155d10 con 0x7f644c15ceb0 2024-09-11T23:22:10.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.982+0000 7f6453200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f644c155b90 con 0x7f644c15ca40 2024-09-11T23:22:10.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.982+0000 7f6453200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f644c0b4790 con 0x7f644c0d02a0 2024-09-11T23:22:10.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.982+0000 7f6451200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f644c15ceb0 0x7f644c1ee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:10.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.982+0000 7f644be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f644c0d02a0 0x7f644c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:10.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.982+0000 7f6451200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f644c15ceb0 0x7f644c1ee160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48552/0 (socket says 172.21.15.144:48552) 2024-09-11T23:22:10.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.982+0000 7f6451200640 1 -- 172.21.15.144:0/1201137352 learned_addr learned my addr 172.21.15.144:0/1201137352 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:10.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.982+0000 7f6443400640 1 --2- 172.21.15.144:0/1201137352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f644c15ca40 0x7f644c1f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:10.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.983+0000 7f644be00640 1 -- 172.21.15.144:0/1201137352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f644c15ca40 msgr2=0x7f644c1f4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:10.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.983+0000 7f644be00640 1 --2- 172.21.15.144:0/1201137352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f644c15ca40 0x7f644c1f4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:10.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.983+0000 7f644be00640 1 -- 172.21.15.144:0/1201137352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f644c15ceb0 msgr2=0x7f644c1ee160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:10.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.983+0000 7f644be00640 1 --2- 172.21.15.144:0/1201137352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f644c15ceb0 0x7f644c1ee160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:10.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.983+0000 7f644be00640 1 -- 172.21.15.144:0/1201137352 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c1f5020 con 0x7f644c0d02a0 2024-09-11T23:22:10.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.983+0000 7f6451200640 1 --2- 172.21.15.144:0/1201137352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f644c15ceb0 0x7f644c1ee160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:22:10.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.983+0000 7f644be00640 1 --2- 172.21.15.144:0/1201137352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f644c0d02a0 0x7f644c1568c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f643c00c340 tx=0x7f643c00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:10.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.983+0000 7f6448c00640 1 -- 172.21.15.144:0/1201137352 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c0052d0 con 0x7f644c0d02a0 2024-09-11T23:22:10.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.983+0000 7f6448c00640 1 -- 172.21.15.144:0/1201137352 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f643c005490 con 0x7f644c0d02a0 2024-09-11T23:22:10.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.983+0000 7f6453200640 1 -- 172.21.15.144:0/1201137352 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644c1f5300 con 0x7f644c0d02a0 2024-09-11T23:22:10.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.983+0000 7f6448c00640 1 -- 172.21.15.144:0/1201137352 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c007260 con 0x7f644c0d02a0 2024-09-11T23:22:10.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.983+0000 7f6453200640 1 -- 172.21.15.144:0/1201137352 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f644c1563a0 con 0x7f644c0d02a0 2024-09-11T23:22:10.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.984+0000 7f6453200640 1 -- 172.21.15.144:0/1201137352 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f644c0d0680 con 0x7f644c0d02a0 2024-09-11T23:22:10.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.985+0000 7f6448c00640 1 -- 172.21.15.144:0/1201137352 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f643c007400 con 0x7f644c0d02a0 2024-09-11T23:22:10.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.986+0000 7f6448c00640 1 --2- 172.21.15.144:0/1201137352 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f642806c100 0x7f642806e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:10.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.986+0000 7f6448c00640 1 -- 172.21.15.144:0/1201137352 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f643c08a6f0 con 0x7f644c0d02a0 2024-09-11T23:22:10.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.986+0000 7f6443400640 1 --2- 172.21.15.144:0/1201137352 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f642806c100 0x7f642806e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:10.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.987+0000 7f6443400640 1 --2- 172.21.15.144:0/1201137352 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f642806c100 0x7f642806e5c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6434034000 tx=0x7f643402e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:10.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:10.992+0000 7f6448c00640 1 -- 172.21.15.144:0/1201137352 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f643c0586b0 con 0x7f644c0d02a0 2024-09-11T23:22:11.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.176+0000 7f6453200640 1 -- 172.21.15.144:0/1201137352 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f644c1f54d0 con 0x7f644c0d02a0 2024-09-11T23:22:11.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.177+0000 7f6448c00640 1 -- 172.21.15.144:0/1201137352 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v71) ==== 80+0+0 (secure 0 0 0) 0x7f643c05c9b0 con 0x7f644c0d02a0 2024-09-11T23:22:11.176 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:22:11.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.179+0000 7f6453200640 1 -- 172.21.15.144:0/1201137352 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f642806c100 msgr2=0x7f642806e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:11.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.179+0000 7f6453200640 1 --2- 172.21.15.144:0/1201137352 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f642806c100 0x7f642806e5c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6434034000 tx=0x7f643402e000 comp rx=0 tx=0).stop 2024-09-11T23:22:11.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.179+0000 7f6453200640 1 -- 172.21.15.144:0/1201137352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f644c0d02a0 msgr2=0x7f644c1568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:11.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.179+0000 7f6453200640 1 --2- 172.21.15.144:0/1201137352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f644c0d02a0 0x7f644c1568c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f643c00c340 tx=0x7f643c00c800 comp rx=0 tx=0).stop 2024-09-11T23:22:11.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.179+0000 7f6453200640 1 -- 172.21.15.144:0/1201137352 shutdown_connections 2024-09-11T23:22:11.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.179+0000 7f6453200640 1 --2- 172.21.15.144:0/1201137352 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f642806c100 0x7f642806e5c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:11.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.179+0000 7f6453200640 1 --2- 172.21.15.144:0/1201137352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f644c15ceb0 0x7f644c1ee160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:11.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.179+0000 7f6453200640 1 --2- 172.21.15.144:0/1201137352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f644c15ca40 0x7f644c1f4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:11.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.179+0000 7f6453200640 1 --2- 172.21.15.144:0/1201137352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f644c0d02a0 0x7f644c1568c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:11.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.179+0000 7f6453200640 1 -- 172.21.15.144:0/1201137352 >> 172.21.15.144:0/1201137352 conn(0x7f644c062cc0 msgr2=0x7f644c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:11.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.179+0000 7f6453200640 1 -- 172.21.15.144:0/1201137352 shutdown_connections 2024-09-11T23:22:11.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.179+0000 7f6453200640 1 -- 172.21.15.144:0/1201137352 wait complete. 2024-09-11T23:22:11.194 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-11T23:22:11.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:11.195 DEBUG:teuthology.orchestra.run.smithi165:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-11T23:22:11.263 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:22:11.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:11.263 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:22:11.302 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:22:11.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.456+0000 7f7e47200640 1 Processor -- start 2024-09-11T23:22:11.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.456+0000 7f7e47200640 1 -- start start 2024-09-11T23:22:11.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.457+0000 7f7e47200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7e4815f570 0x7f7e48071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:11.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.457+0000 7f7e47200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7e480d0370 0x7f7e480d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:11.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.457+0000 7f7e47200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e480d1d90 con 0x7f7e480b6c60 2024-09-11T23:22:11.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.457+0000 7f7e47200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7e480d2070 con 0x7f7e480d0370 2024-09-11T23:22:11.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.457+0000 7f7e47200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7e48070a60 con 0x7f7e4815f570 2024-09-11T23:22:11.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.457+0000 7f7e46800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7e480d0370 0x7f7e480d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:11.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.457+0000 7f7e46800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7e480d0370 0x7f7e480d0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48568/0 (socket says 172.21.15.144:48568) 2024-09-11T23:22:11.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.457+0000 7f7e46800640 1 -- 172.21.15.144:0/1888595682 learned_addr learned my addr 172.21.15.144:0/1888595682 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:11.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.457+0000 7f7e45400640 1 --2- 172.21.15.144:0/1888595682 >> v2:172.21.15.165:3300/0 conn(0x7f7e4815f570 0x7f7e48071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:11.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.458+0000 7f7e46800640 1 -- 172.21.15.144:0/1888595682 >> v2:172.21.15.165:3300/0 conn(0x7f7e4815f570 msgr2=0x7f7e48071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:11.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.458+0000 7f7e46800640 1 --2- 172.21.15.144:0/1888595682 >> v2:172.21.15.165:3300/0 conn(0x7f7e4815f570 0x7f7e48071260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:11.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.458+0000 7f7e46800640 1 -- 172.21.15.144:0/1888595682 >> v1:172.21.15.144:6789/0 conn(0x7f7e480b6c60 legacy=0x7f7e480b7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:11.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.458+0000 7f7e46800640 1 -- 172.21.15.144:0/1888595682 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e48070d40 con 0x7f7e480d0370 2024-09-11T23:22:11.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.459+0000 7f7e46800640 1 --2- 172.21.15.144:0/1888595682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e480d0370 0x7f7e480d0800 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7e4806c940 tx=0x7f7e4002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aaba5a2eb619d4f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:11.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.459+0000 7f7e44a00640 1 -- 172.21.15.144:0/1888595682 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40036070 con 0x7f7e480d0370 2024-09-11T23:22:11.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.459+0000 7f7e44a00640 1 -- 172.21.15.144:0/1888595682 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e40031600 con 0x7f7e480d0370 2024-09-11T23:22:11.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.459+0000 7f7e44a00640 1 -- 172.21.15.144:0/1888595682 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e400319d0 con 0x7f7e480d0370 2024-09-11T23:22:11.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.460+0000 7f7e47200640 1 -- 172.21.15.144:0/1888595682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e480d0370 msgr2=0x7f7e480d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:11.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.460+0000 7f7e47200640 1 --2- 172.21.15.144:0/1888595682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e480d0370 0x7f7e480d0800 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7e4806c940 tx=0x7f7e4002a6a0 comp rx=0 tx=0).stop 2024-09-11T23:22:11.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.460+0000 7f7e47200640 1 -- 172.21.15.144:0/1888595682 shutdown_connections 2024-09-11T23:22:11.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.460+0000 7f7e47200640 1 --2- 172.21.15.144:0/1888595682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e480d0370 0x7f7e480d0800 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:11.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.460+0000 7f7e47200640 1 --2- 172.21.15.144:0/1888595682 >> v2:172.21.15.165:3300/0 conn(0x7f7e4815f570 0x7f7e48071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:11.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.460+0000 7f7e47200640 1 -- 172.21.15.144:0/1888595682 >> 172.21.15.144:0/1888595682 conn(0x7f7e4806f390 msgr2=0x7f7e4806f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:11.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.460+0000 7f7e47200640 1 -- 172.21.15.144:0/1888595682 shutdown_connections 2024-09-11T23:22:11.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.460+0000 7f7e47200640 1 -- 172.21.15.144:0/1888595682 wait complete. 2024-09-11T23:22:11.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.461+0000 7f7e47200640 1 Processor -- start 2024-09-11T23:22:11.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.462+0000 7f7e47200640 1 -- start start 2024-09-11T23:22:11.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.462+0000 7f7e47200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e480b6c60 0x7f7e48149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:11.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.462+0000 7f7e47200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e480d0370 0x7f7e480b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:11.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.462+0000 7f7e47200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e4815f570 0x7f7e480b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:11.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.462+0000 7f7e47200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7e480d0d40 con 0x7f7e480d0370 2024-09-11T23:22:11.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.462+0000 7f7e47200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7e480d1a50 con 0x7f7e480b6c60 2024-09-11T23:22:11.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.462+0000 7f7e47200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7e48158f30 con 0x7f7e4815f570 2024-09-11T23:22:11.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.463+0000 7f7e45400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e480d0370 0x7f7e480b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:11.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.463+0000 7f7e45400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e480d0370 0x7f7e480b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48584/0 (socket says 172.21.15.144:48584) 2024-09-11T23:22:11.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.463+0000 7f7e45400640 1 -- 172.21.15.144:0/1083451165 learned_addr learned my addr 172.21.15.144:0/1083451165 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:11.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.463+0000 7f7e46800640 1 --2- 172.21.15.144:0/1083451165 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e4815f570 0x7f7e480b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:11.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.463+0000 7f7e45e00640 1 --2- 172.21.15.144:0/1083451165 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e480b6c60 0x7f7e48149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:11.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.463+0000 7f7e45400640 1 -- 172.21.15.144:0/1083451165 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e4815f570 msgr2=0x7f7e480b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:11.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.463+0000 7f7e45400640 1 --2- 172.21.15.144:0/1083451165 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e4815f570 0x7f7e480b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:11.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.463+0000 7f7e45400640 1 -- 172.21.15.144:0/1083451165 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e480b6c60 msgr2=0x7f7e48149600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:11.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.463+0000 7f7e45400640 1 --2- 172.21.15.144:0/1083451165 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e480b6c60 0x7f7e48149600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:11.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.463+0000 7f7e45400640 1 -- 172.21.15.144:0/1083451165 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e48149b40 con 0x7f7e480d0370 2024-09-11T23:22:11.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.463+0000 7f7e45400640 1 --2- 172.21.15.144:0/1083451165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e480d0370 0x7f7e480b1fc0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800e870 tx=0x7f7e3800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:11.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.464+0000 7f7e3e000640 1 -- 172.21.15.144:0/1083451165 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e38017070 con 0x7f7e480d0370 2024-09-11T23:22:11.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.464+0000 7f7e3e000640 1 -- 172.21.15.144:0/1083451165 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e3800c940 con 0x7f7e480d0370 2024-09-11T23:22:11.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.464+0000 7f7e3e000640 1 -- 172.21.15.144:0/1083451165 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3800cd30 con 0x7f7e480d0370 2024-09-11T23:22:11.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.464+0000 7f7e47200640 1 -- 172.21.15.144:0/1083451165 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e4815b320 con 0x7f7e480d0370 2024-09-11T23:22:11.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.464+0000 7f7e47200640 1 -- 172.21.15.144:0/1083451165 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e4815b8e0 con 0x7f7e480d0370 2024-09-11T23:22:11.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.465+0000 7f7e47200640 1 -- 172.21.15.144:0/1083451165 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e4815fa00 con 0x7f7e480d0370 2024-09-11T23:22:11.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.466+0000 7f7e3e000640 1 -- 172.21.15.144:0/1083451165 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f7e3801a070 con 0x7f7e480d0370 2024-09-11T23:22:11.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.466+0000 7f7e3e000640 1 --2- 172.21.15.144:0/1083451165 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7e2406c1c0 0x7f7e2406e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:11.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.467+0000 7f7e3e000640 1 -- 172.21.15.144:0/1083451165 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f7e3808b290 con 0x7f7e480d0370 2024-09-11T23:22:11.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.467+0000 7f7e45e00640 1 --2- 172.21.15.144:0/1083451165 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7e2406c1c0 0x7f7e2406e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:11.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.467+0000 7f7e45e00640 1 --2- 172.21.15.144:0/1083451165 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7e2406c1c0 0x7f7e2406e680 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7e30007fd0 tx=0x7f7e30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:11.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.471+0000 7f7e3e000640 1 -- 172.21.15.144:0/1083451165 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e380597f0 con 0x7f7e480d0370 2024-09-11T23:22:11.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.678+0000 7f7e47200640 1 -- 172.21.15.144:0/1083451165 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e48161d90 con 0x7f7e480d0370 2024-09-11T23:22:11.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.679+0000 7f7e3e000640 1 -- 172.21.15.144:0/1083451165 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5228 (secure 0 0 0) 0x7f7e380590f0 con 0x7f7e480d0370 2024-09-11T23:22:11.679 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:11.679 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":47,"btime":"2024-09-11T23:22:09:289256+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5417,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/494282276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":494282276},{"type":"v1","addr":"172.21.15.165:6833","nonce":494282276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5827,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1734890696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":1734890696},{"type":"v1","addr":"172.21.15.165:6835","nonce":1734890696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1671926294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1671926294},{"type":"v1","addr":"172.21.15.144:6836","nonce":1671926294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:21:53.856502+0000","modified":"2024-09-11T23:21:56.886031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6093},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6093":{"gid":6093,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6837/97031260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":97031260},{"type":"v1","addr":"172.21.15.144:6837","nonce":97031260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6093,"qdb_cluster":[6093]},"id":5}]} 2024-09-11T23:22:11.679 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 47 2024-09-11T23:22:11.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.681+0000 7f7e47200640 1 -- 172.21.15.144:0/1083451165 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7e2406c1c0 msgr2=0x7f7e2406e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:11.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.681+0000 7f7e47200640 1 --2- 172.21.15.144:0/1083451165 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7e2406c1c0 0x7f7e2406e680 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7e30007fd0 tx=0x7f7e30009040 comp rx=0 tx=0).stop 2024-09-11T23:22:11.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.681+0000 7f7e47200640 1 -- 172.21.15.144:0/1083451165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e480d0370 msgr2=0x7f7e480b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:11.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.681+0000 7f7e47200640 1 --2- 172.21.15.144:0/1083451165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e480d0370 0x7f7e480b1fc0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800e870 tx=0x7f7e3800ed30 comp rx=0 tx=0).stop 2024-09-11T23:22:11.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.681+0000 7f7e47200640 1 -- 172.21.15.144:0/1083451165 shutdown_connections 2024-09-11T23:22:11.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.681+0000 7f7e47200640 1 --2- 172.21.15.144:0/1083451165 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f7e2406c1c0 0x7f7e2406e680 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:11.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.681+0000 7f7e47200640 1 --2- 172.21.15.144:0/1083451165 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7e4815f570 0x7f7e480b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:11.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.681+0000 7f7e47200640 1 --2- 172.21.15.144:0/1083451165 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7e480d0370 0x7f7e480b1fc0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:11.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.681+0000 7f7e47200640 1 --2- 172.21.15.144:0/1083451165 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7e480b6c60 0x7f7e48149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:11.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.681+0000 7f7e47200640 1 -- 172.21.15.144:0/1083451165 >> 172.21.15.144:0/1083451165 conn(0x7f7e4806f390 msgr2=0x7f7e48071260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:11.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.681+0000 7f7e47200640 1 -- 172.21.15.144:0/1083451165 shutdown_connections 2024-09-11T23:22:11.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:11.681+0000 7f7e47200640 1 -- 172.21.15.144:0/1083451165 wait complete. 2024-09-11T23:22:11.698 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-11T23:22:11.870 INFO:teuthology.orchestra.run.smithi144.stdout:[] 2024-09-11T23:22:11.870 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-11T23:22:11.871 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol88250 2024-09-11T23:22:12.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.027+0000 7fb527600640 1 Processor -- start 2024-09-11T23:22:12.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.027+0000 7fb527600640 1 -- start start 2024-09-11T23:22:12.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.028+0000 7fb527600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb52015d790 0x7fb5200cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:12.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.028+0000 7fb527600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb5200cd3b0 0x7fb5200cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:12.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.028+0000 7fb527600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb52006d700 con 0x7fb52015d3b0 2024-09-11T23:22:12.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.028+0000 7fb527600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb52006da30 con 0x7fb52015d790 2024-09-11T23:22:12.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.028+0000 7fb527600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb5200cde80 con 0x7fb5200cd3b0 2024-09-11T23:22:12.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.029+0000 7fb525600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb5200cd3b0 0x7fb5200cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:12.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.029+0000 7fb525600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb5200cd3b0 0x7fb5200cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:56376/0 (socket says 172.21.15.144:56376) 2024-09-11T23:22:12.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.029+0000 7fb524c00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fb52015d3b0 0x7fb520071080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:36316/0 (socket says 172.21.15.144:36316) 2024-09-11T23:22:12.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.029+0000 7fb525600640 1 -- 172.21.15.144:0/4047486523 learned_addr learned my addr 172.21.15.144:0/4047486523 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:12.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.029+0000 7fb517e00640 1 --2- 172.21.15.144:0/4047486523 >> v2:172.21.15.165:3300/0 conn(0x7fb52015d790 0x7fb5200cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:12.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.029+0000 7fb525600640 1 -- 172.21.15.144:0/4047486523 >> v2:172.21.15.165:3300/0 conn(0x7fb52015d790 msgr2=0x7fb5200cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:12.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.029+0000 7fb525600640 1 --2- 172.21.15.144:0/4047486523 >> v2:172.21.15.165:3300/0 conn(0x7fb52015d790 0x7fb5200cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:12.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.029+0000 7fb525600640 1 -- 172.21.15.144:0/4047486523 >> v1:172.21.15.165:6789/0 conn(0x7fb52015d3b0 legacy=0x7fb520071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:12.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.029+0000 7fb525600640 1 -- 172.21.15.144:0/4047486523 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5200cd8c0 con 0x7fb5200cd3b0 2024-09-11T23:22:12.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.029+0000 7fb51fe00640 1 -- 172.21.15.144:0/4047486523 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1045832053 0 0) 0x7fb52006d700 con 0x7fb52015d3b0 2024-09-11T23:22:12.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.030+0000 7fb525600640 1 --2- 172.21.15.144:0/4047486523 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb5200cd3b0 0x7fb5200cf320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb52006dbb0 tx=0x7fb51802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4511da6c19efb4aa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:12.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.031+0000 7fb51fe00640 1 -- 172.21.15.144:0/4047486523 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb518036070 con 0x7fb5200cd3b0 2024-09-11T23:22:12.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.031+0000 7fb51fe00640 1 -- 172.21.15.144:0/4047486523 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb518031600 con 0x7fb5200cd3b0 2024-09-11T23:22:12.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.031+0000 7fb51fe00640 1 -- 172.21.15.144:0/4047486523 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5180319d0 con 0x7fb5200cd3b0 2024-09-11T23:22:12.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.031+0000 7fb527600640 1 -- 172.21.15.144:0/4047486523 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb5200cd3b0 msgr2=0x7fb5200cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:12.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.031+0000 7fb527600640 1 --2- 172.21.15.144:0/4047486523 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb5200cd3b0 0x7fb5200cf320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb52006dbb0 tx=0x7fb51802a710 comp rx=0 tx=0).stop 2024-09-11T23:22:12.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.031+0000 7fb527600640 1 -- 172.21.15.144:0/4047486523 shutdown_connections 2024-09-11T23:22:12.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.031+0000 7fb527600640 1 --2- 172.21.15.144:0/4047486523 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb5200cd3b0 0x7fb5200cf320 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:12.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.031+0000 7fb527600640 1 --2- 172.21.15.144:0/4047486523 >> v2:172.21.15.165:3300/0 conn(0x7fb52015d790 0x7fb5200cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:12.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.031+0000 7fb527600640 1 -- 172.21.15.144:0/4047486523 >> 172.21.15.144:0/4047486523 conn(0x7fb52006bba0 msgr2=0x7fb52006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:12.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.032+0000 7fb527600640 1 -- 172.21.15.144:0/4047486523 shutdown_connections 2024-09-11T23:22:12.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.032+0000 7fb527600640 1 -- 172.21.15.144:0/4047486523 wait complete. 2024-09-11T23:22:12.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.033+0000 7fb527600640 1 Processor -- start 2024-09-11T23:22:12.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.033+0000 7fb527600640 1 -- start start 2024-09-11T23:22:12.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.034+0000 7fb527600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5200cd3b0 0x7fb5200c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.034+0000 7fb527600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb52015d3b0 0x7fb5200b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.034+0000 7fb527600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5200b3ad0 0x7fb520143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.034+0000 7fb527600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb52015cd70 con 0x7fb5200cd3b0 2024-09-11T23:22:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.034+0000 7fb527600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb52015cbf0 con 0x7fb5200b3ad0 2024-09-11T23:22:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.034+0000 7fb527600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb5200cf860 con 0x7fb52015d3b0 2024-09-11T23:22:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.034+0000 7fb524c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5200cd3b0 0x7fb5200c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.034+0000 7fb524c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5200cd3b0 0x7fb5200c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48598/0 (socket says 172.21.15.144:48598) 2024-09-11T23:22:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.034+0000 7fb524c00640 1 -- 172.21.15.144:0/52943637 learned_addr learned my addr 172.21.15.144:0/52943637 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.034+0000 7fb517e00640 1 --2- 172.21.15.144:0/52943637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb52015d3b0 0x7fb5200b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.034+0000 7fb525600640 1 --2- 172.21.15.144:0/52943637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5200b3ad0 0x7fb520143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.035+0000 7fb517e00640 1 -- 172.21.15.144:0/52943637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5200b3ad0 msgr2=0x7fb520143a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.035+0000 7fb517e00640 1 --2- 172.21.15.144:0/52943637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5200b3ad0 0x7fb520143a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:12.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.035+0000 7fb517e00640 1 -- 172.21.15.144:0/52943637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5200cd3b0 msgr2=0x7fb5200c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:12.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.035+0000 7fb517e00640 1 --2- 172.21.15.144:0/52943637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5200cd3b0 0x7fb5200c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:12.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.035+0000 7fb517e00640 1 -- 172.21.15.144:0/52943637 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5200cbd90 con 0x7fb52015d3b0 2024-09-11T23:22:12.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.035+0000 7fb524c00640 1 --2- 172.21.15.144:0/52943637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5200cd3b0 0x7fb5200c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:22:12.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.035+0000 7fb517e00640 1 --2- 172.21.15.144:0/52943637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb52015d3b0 0x7fb5200b3590 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb50800e840 tx=0x7fb50800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:12.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.035+0000 7fb51d600640 1 -- 172.21.15.144:0/52943637 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508017070 con 0x7fb52015d3b0 2024-09-11T23:22:12.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.035+0000 7fb51d600640 1 -- 172.21.15.144:0/52943637 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb50800c940 con 0x7fb52015d3b0 2024-09-11T23:22:12.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.035+0000 7fb51d600640 1 -- 172.21.15.144:0/52943637 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50800ccf0 con 0x7fb52015d3b0 2024-09-11T23:22:12.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.035+0000 7fb527600640 1 -- 172.21.15.144:0/52943637 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5200b4100 con 0x7fb52015d3b0 2024-09-11T23:22:12.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.036+0000 7fb527600640 1 -- 172.21.15.144:0/52943637 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5200b46c0 con 0x7fb52015d3b0 2024-09-11T23:22:12.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.037+0000 7fb527600640 1 -- 172.21.15.144:0/52943637 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5200cfc40 con 0x7fb52015d3b0 2024-09-11T23:22:12.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.038+0000 7fb51d600640 1 -- 172.21.15.144:0/52943637 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7fb50801a070 con 0x7fb52015d3b0 2024-09-11T23:22:12.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.038+0000 7fb51d600640 1 --2- 172.21.15.144:0/52943637 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb4fc06c190 0x7fb4fc06e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:12.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.039+0000 7fb51d600640 1 -- 172.21.15.144:0/52943637 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7fb50808b220 con 0x7fb52015d3b0 2024-09-11T23:22:12.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.039+0000 7fb524c00640 1 --2- 172.21.15.144:0/52943637 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb4fc06c190 0x7fb4fc06e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:12.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.039+0000 7fb524c00640 1 --2- 172.21.15.144:0/52943637 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb4fc06c190 0x7fb4fc06e650 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb510000f60 tx=0x7fb510007e10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:12.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.043+0000 7fb51d600640 1 -- 172.21.15.144:0/52943637 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5080591c0 con 0x7fb52015d3b0 2024-09-11T23:22:12.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.241+0000 7fb527600640 1 -- 172.21.15.144:0/52943637 --> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol88250", "target": ["mon-mgr", ""]}) -- 0x7fb52015c400 con 0x7fb4fc06c190 2024-09-11T23:22:12.247 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:12.247+0000 7f9c68e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:22:12.247 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:12.247+0000 7f9c68e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:22:12.247 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:12.247+0000 7f9c68e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:22:12.247 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:12.247+0000 7f9c68e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:22:12.247 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:12.247+0000 7f9c68e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:22:12.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.283+0000 7fb51d600640 1 -- 172.21.15.144:0/52943637 <== mgr.4110 v2:172.21.15.144:6800/1711334146 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb52015c400 con 0x7fb4fc06c190 2024-09-11T23:22:12.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.285+0000 7fb527600640 1 -- 172.21.15.144:0/52943637 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb4fc06c190 msgr2=0x7fb4fc06e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:12.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.285+0000 7fb527600640 1 --2- 172.21.15.144:0/52943637 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb4fc06c190 0x7fb4fc06e650 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb510000f60 tx=0x7fb510007e10 comp rx=0 tx=0).stop 2024-09-11T23:22:12.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.286+0000 7fb527600640 1 -- 172.21.15.144:0/52943637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb52015d3b0 msgr2=0x7fb5200b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:12.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.286+0000 7fb527600640 1 --2- 172.21.15.144:0/52943637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb52015d3b0 0x7fb5200b3590 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb50800e840 tx=0x7fb50800ed00 comp rx=0 tx=0).stop 2024-09-11T23:22:12.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.286+0000 7fb527600640 1 -- 172.21.15.144:0/52943637 shutdown_connections 2024-09-11T23:22:12.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.286+0000 7fb527600640 1 --2- 172.21.15.144:0/52943637 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fb4fc06c190 0x7fb4fc06e650 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:12.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.286+0000 7fb527600640 1 --2- 172.21.15.144:0/52943637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5200b3ad0 0x7fb520143a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:12.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.286+0000 7fb527600640 1 --2- 172.21.15.144:0/52943637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb52015d3b0 0x7fb5200b3590 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:12.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.286+0000 7fb527600640 1 --2- 172.21.15.144:0/52943637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5200cd3b0 0x7fb5200c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:12.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.286+0000 7fb527600640 1 -- 172.21.15.144:0/52943637 >> 172.21.15.144:0/52943637 conn(0x7fb52006bba0 msgr2=0x7fb52015ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:12.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.286+0000 7fb527600640 1 -- 172.21.15.144:0/52943637 shutdown_connections 2024-09-11T23:22:12.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.286+0000 7fb527600640 1 -- 172.21.15.144:0/52943637 wait complete. 2024-09-11T23:22:12.301 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:22:12.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.454+0000 7ff4cb000640 1 Processor -- start 2024-09-11T23:22:12.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.454+0000 7ff4cb000640 1 -- start start 2024-09-11T23:22:12.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.455+0000 7ff4cb000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4c40d0a50 0x7ff4c41620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:12.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.455+0000 7ff4cb000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff4c40b4930 0x7ff4c40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:12.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.455+0000 7ff4cb000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff4c415f620 0x7ff4c415fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:12.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.455+0000 7ff4cb000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff4c40b52d0 con 0x7ff4c415f620 2024-09-11T23:22:12.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.456+0000 7ff4cb000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff4c41625f0 con 0x7ff4c40b4930 2024-09-11T23:22:12.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.456+0000 7ff4cb000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c4162870 con 0x7ff4c40d0a50 2024-09-11T23:22:12.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.456+0000 7ff4c9000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff4c415f620 0x7ff4c415fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:12.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.456+0000 7ff4c3400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff4c40b4930 0x7ff4c40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:12.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.456+0000 7ff4c9000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff4c415f620 0x7ff4c415fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48612/0 (socket says 172.21.15.144:48612) 2024-09-11T23:22:12.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.456+0000 7ff4c9000640 1 -- 172.21.15.144:0/1839152380 learned_addr learned my addr 172.21.15.144:0/1839152380 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:12.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.456+0000 7ff4c3e00640 1 --2- 172.21.15.144:0/1839152380 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4c40d0a50 0x7ff4c41620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:12.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.456+0000 7ff4c9000640 1 -- 172.21.15.144:0/1839152380 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4c40d0a50 msgr2=0x7ff4c41620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:12.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.456+0000 7ff4c9000640 1 --2- 172.21.15.144:0/1839152380 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4c40d0a50 0x7ff4c41620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:12.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.456+0000 7ff4c9000640 1 -- 172.21.15.144:0/1839152380 >> v2:172.21.15.165:3300/0 conn(0x7ff4c40b4930 msgr2=0x7ff4c40b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:12.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.456+0000 7ff4c9000640 1 --2- 172.21.15.144:0/1839152380 >> v2:172.21.15.165:3300/0 conn(0x7ff4c40b4930 0x7ff4c40b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:12.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.456+0000 7ff4c9000640 1 -- 172.21.15.144:0/1839152380 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c4162b50 con 0x7ff4c415f620 2024-09-11T23:22:12.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.457+0000 7ff4c9000640 1 --2- 172.21.15.144:0/1839152380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4c415f620 0x7ff4c415fad0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff4c406f320 tx=0x7ff4bc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a859a7328a82d28 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:12.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.458+0000 7ff4c2a00640 1 -- 172.21.15.144:0/1839152380 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc036070 con 0x7ff4c415f620 2024-09-11T23:22:12.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.458+0000 7ff4c2a00640 1 -- 172.21.15.144:0/1839152380 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4bc031600 con 0x7ff4c415f620 2024-09-11T23:22:12.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.458+0000 7ff4c2a00640 1 -- 172.21.15.144:0/1839152380 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc0319d0 con 0x7ff4c415f620 2024-09-11T23:22:12.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.458+0000 7ff4cb000640 1 -- 172.21.15.144:0/1839152380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4c415f620 msgr2=0x7ff4c415fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:12.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.458+0000 7ff4cb000640 1 --2- 172.21.15.144:0/1839152380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4c415f620 0x7ff4c415fad0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff4c406f320 tx=0x7ff4bc02a610 comp rx=0 tx=0).stop 2024-09-11T23:22:12.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.458+0000 7ff4cb000640 1 -- 172.21.15.144:0/1839152380 shutdown_connections 2024-09-11T23:22:12.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.458+0000 7ff4cb000640 1 --2- 172.21.15.144:0/1839152380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4c415f620 0x7ff4c415fad0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:12.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.458+0000 7ff4cb000640 1 --2- 172.21.15.144:0/1839152380 >> v2:172.21.15.165:3300/0 conn(0x7ff4c40b4930 0x7ff4c40b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:12.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.458+0000 7ff4cb000640 1 --2- 172.21.15.144:0/1839152380 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4c40d0a50 0x7ff4c41620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:12.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.458+0000 7ff4cb000640 1 -- 172.21.15.144:0/1839152380 >> 172.21.15.144:0/1839152380 conn(0x7ff4c4062cc0 msgr2=0x7ff4c406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:12.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.458+0000 7ff4cb000640 1 -- 172.21.15.144:0/1839152380 shutdown_connections 2024-09-11T23:22:12.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.458+0000 7ff4cb000640 1 -- 172.21.15.144:0/1839152380 wait complete. 2024-09-11T23:22:12.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.460+0000 7ff4cb000640 1 Processor -- start 2024-09-11T23:22:12.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.460+0000 7ff4cb000640 1 -- start start 2024-09-11T23:22:12.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.461+0000 7ff4cb000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4c40b4930 0x7ff4c41ea9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:12.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.461+0000 7ff4cb000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4c415f620 0x7ff4c4153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:12.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.461+0000 7ff4cb000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4c4153f20 0x7ff4c4070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:12.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.461+0000 7ff4cb000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c40b3620 con 0x7ff4c40b4930 2024-09-11T23:22:12.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.461+0000 7ff4cb000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c40b3340 con 0x7ff4c4153f20 2024-09-11T23:22:12.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.461+0000 7ff4cb000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c4160010 con 0x7ff4c415f620 2024-09-11T23:22:12.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.461+0000 7ff4c3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4c40b4930 0x7ff4c41ea9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:12.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.461+0000 7ff4c3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4c40b4930 0x7ff4c41ea9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48624/0 (socket says 172.21.15.144:48624) 2024-09-11T23:22:12.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.461+0000 7ff4c3e00640 1 -- 172.21.15.144:0/4173087732 learned_addr learned my addr 172.21.15.144:0/4173087732 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:12.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.462+0000 7ff4c3e00640 1 -- 172.21.15.144:0/4173087732 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4c415f620 msgr2=0x7ff4c4153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:12.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.462+0000 7ff4c3e00640 1 --2- 172.21.15.144:0/4173087732 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4c415f620 0x7ff4c4153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:12.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.462+0000 7ff4c3e00640 1 -- 172.21.15.144:0/4173087732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4c4153f20 msgr2=0x7ff4c4070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:12.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.462+0000 7ff4c3e00640 1 --2- 172.21.15.144:0/4173087732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4c4153f20 0x7ff4c4070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:12.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.462+0000 7ff4c3e00640 1 -- 172.21.15.144:0/4173087732 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c40b02e0 con 0x7ff4c40b4930 2024-09-11T23:22:12.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.462+0000 7ff4c3e00640 1 --2- 172.21.15.144:0/4173087732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4c40b4930 0x7ff4c41ea9f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400e870 tx=0x7ff4b400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:12.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.462+0000 7ff4bbe00640 1 -- 172.21.15.144:0/4173087732 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4017070 con 0x7ff4c40b4930 2024-09-11T23:22:12.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.462+0000 7ff4bbe00640 1 -- 172.21.15.144:0/4173087732 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4b400c940 con 0x7ff4c40b4930 2024-09-11T23:22:12.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.462+0000 7ff4cb000640 1 -- 172.21.15.144:0/4173087732 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c40b05c0 con 0x7ff4c40b4930 2024-09-11T23:22:12.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.462+0000 7ff4bbe00640 1 -- 172.21.15.144:0/4173087732 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b400cd30 con 0x7ff4c40b4930 2024-09-11T23:22:12.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.462+0000 7ff4cb000640 1 -- 172.21.15.144:0/4173087732 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c40b0b80 con 0x7ff4c40b4930 2024-09-11T23:22:12.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.463+0000 7ff4cb000640 1 -- 172.21.15.144:0/4173087732 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c41620b0 con 0x7ff4c40b4930 2024-09-11T23:22:12.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.464+0000 7ff4bbe00640 1 -- 172.21.15.144:0/4173087732 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7ff4b401a070 con 0x7ff4c40b4930 2024-09-11T23:22:12.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.465+0000 7ff4bbe00640 1 --2- 172.21.15.144:0/4173087732 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff4a406c190 0x7ff4a406e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:12.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.465+0000 7ff4bbe00640 1 -- 172.21.15.144:0/4173087732 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7ff4b408b1e0 con 0x7ff4c40b4930 2024-09-11T23:22:12.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.465+0000 7ff4c3400640 1 --2- 172.21.15.144:0/4173087732 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff4a406c190 0x7ff4a406e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:12.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.466+0000 7ff4c3400640 1 --2- 172.21.15.144:0/4173087732 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff4a406c190 0x7ff4a406e650 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0006a90 tx=0x7ff4b0006a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:12.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.469+0000 7ff4bbe00640 1 -- 172.21.15.144:0/4173087732 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff4b40597d0 con 0x7ff4c40b4930 2024-09-11T23:22:12.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.675+0000 7ff4cb000640 1 -- 172.21.15.144:0/4173087732 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4c40b50b0 con 0x7ff4c40b4930 2024-09-11T23:22:12.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.676+0000 7ff4bbe00640 1 -- 172.21.15.144:0/4173087732 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5228 (secure 0 0 0) 0x7ff4b40590d0 con 0x7ff4c40b4930 2024-09-11T23:22:12.676 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:12.676 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":47,"btime":"2024-09-11T23:22:09:289256+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5417,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/494282276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":494282276},{"type":"v1","addr":"172.21.15.165:6833","nonce":494282276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5827,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1734890696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":1734890696},{"type":"v1","addr":"172.21.15.165:6835","nonce":1734890696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1671926294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1671926294},{"type":"v1","addr":"172.21.15.144:6836","nonce":1671926294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:21:53.856502+0000","modified":"2024-09-11T23:21:56.886031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6093},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6093":{"gid":6093,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6837/97031260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":97031260},{"type":"v1","addr":"172.21.15.144:6837","nonce":97031260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6093,"qdb_cluster":[6093]},"id":5}]} 2024-09-11T23:22:12.676 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 47 2024-09-11T23:22:12.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.678+0000 7ff4cb000640 1 -- 172.21.15.144:0/4173087732 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff4a406c190 msgr2=0x7ff4a406e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:12.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.678+0000 7ff4cb000640 1 --2- 172.21.15.144:0/4173087732 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff4a406c190 0x7ff4a406e650 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0006a90 tx=0x7ff4b0006a20 comp rx=0 tx=0).stop 2024-09-11T23:22:12.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.678+0000 7ff4cb000640 1 -- 172.21.15.144:0/4173087732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4c40b4930 msgr2=0x7ff4c41ea9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:12.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.678+0000 7ff4cb000640 1 --2- 172.21.15.144:0/4173087732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4c40b4930 0x7ff4c41ea9f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400e870 tx=0x7ff4b400ed30 comp rx=0 tx=0).stop 2024-09-11T23:22:12.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.678+0000 7ff4cb000640 1 -- 172.21.15.144:0/4173087732 shutdown_connections 2024-09-11T23:22:12.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.678+0000 7ff4cb000640 1 --2- 172.21.15.144:0/4173087732 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7ff4a406c190 0x7ff4a406e650 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:12.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.678+0000 7ff4cb000640 1 --2- 172.21.15.144:0/4173087732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4c4153f20 0x7ff4c4070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:12.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.678+0000 7ff4cb000640 1 --2- 172.21.15.144:0/4173087732 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff4c415f620 0x7ff4c4153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:12.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.678+0000 7ff4cb000640 1 --2- 172.21.15.144:0/4173087732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4c40b4930 0x7ff4c41ea9f0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:12.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.678+0000 7ff4cb000640 1 -- 172.21.15.144:0/4173087732 >> 172.21.15.144:0/4173087732 conn(0x7ff4c4062cc0 msgr2=0x7ff4c4160d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:12.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.679+0000 7ff4cb000640 1 -- 172.21.15.144:0/4173087732 shutdown_connections 2024-09-11T23:22:12.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:12.679+0000 7ff4cb000640 1 -- 172.21.15.144:0/4173087732 wait complete. 2024-09-11T23:22:12.696 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-11T23:22:12.871 INFO:teuthology.orchestra.run.smithi144.stdout:[{"id":6333,"entity":{"name":{"type":"client","num":6333},"addr":{"type":"any","addr":"172.21.15.144:0","nonce":2886766475}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":0.608989856,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.969749277279998,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.6333 172.21.15.144:0/2886766475","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc","ceph_version":"ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)","entity_id":"y","hostname":"smithi144","pid":"35684","root":"/"}}] 2024-09-11T23:22:12.872 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi144", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35684", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.144:0", "nonce": 2886766475, "type": "any" }, "name": { "num": 6333, "type": "client" } }, "id": 6333, "inst": "client.6333 172.21.15.144:0/2886766475", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.96974927728 }, "state": "open", "uptime": 0.608989856 } ] 2024-09-11T23:22:12.872 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-11T23:22:13.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.025+0000 7f1f11a00640 1 Processor -- start 2024-09-11T23:22:13.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.025+0000 7f1f11a00640 1 -- start start 2024-09-11T23:22:13.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.027+0000 7f1f11a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1f0c0cf070 0x7f1f0c0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:13.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.027+0000 7f1f11a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1f0c073120 0x7f1f0c073560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:13.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.027+0000 7f1f11a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f0c0ce740 con 0x7f1f0c15c180 2024-09-11T23:22:13.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.027+0000 7f1f11a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1f0c072640 con 0x7f1f0c0cf070 2024-09-11T23:22:13.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.027+0000 7f1f11a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1f0c072920 con 0x7f1f0c073120 2024-09-11T23:22:13.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.027+0000 7f1f02000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1f0c0cf070 0x7f1f0c0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:13.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.027+0000 7f1f0aa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1f0c15c180 0x7f1f0c0cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:38056/0 (socket says 172.21.15.144:38056) 2024-09-11T23:22:13.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.027+0000 7f1f0aa00640 1 -- 172.21.15.144:0/482817519 learned_addr learned my addr 172.21.15.144:0/482817519 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:13.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.027+0000 7f1f0b400640 1 --2- 172.21.15.144:0/482817519 >> v2:172.21.15.165:3300/0 conn(0x7f1f0c073120 0x7f1f0c073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:13.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.027+0000 7f1f02000640 1 -- 172.21.15.144:0/482817519 >> v2:172.21.15.165:3300/0 conn(0x7f1f0c073120 msgr2=0x7f1f0c073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:13.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.027+0000 7f1f02000640 1 --2- 172.21.15.144:0/482817519 >> v2:172.21.15.165:3300/0 conn(0x7f1f0c073120 0x7f1f0c073560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:13.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.027+0000 7f1f02000640 1 -- 172.21.15.144:0/482817519 >> v1:172.21.15.144:6789/0 conn(0x7f1f0c15c180 legacy=0x7f1f0c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:13.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.028+0000 7f1f02000640 1 -- 172.21.15.144:0/482817519 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0c072c00 con 0x7f1f0c0cf070 2024-09-11T23:22:13.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.027+0000 7f1f0a000640 1 -- 172.21.15.144:0/482817519 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1090810750 0 0) 0x7f1f0c0ce740 con 0x7f1f0c15c180 2024-09-11T23:22:13.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.028+0000 7f1f02000640 1 --2- 172.21.15.144:0/482817519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f0c0cf070 0x7f1f0c0cf4e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0cd070 tx=0x7f1ef402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6d71c376dc4bad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:13.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.029+0000 7f1f0a000640 1 -- 172.21.15.144:0/482817519 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4037070 con 0x7f1f0c0cf070 2024-09-11T23:22:13.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.029+0000 7f1f0a000640 1 -- 172.21.15.144:0/482817519 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef4032440 con 0x7f1f0c0cf070 2024-09-11T23:22:13.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.029+0000 7f1f0a000640 1 -- 172.21.15.144:0/482817519 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef402ae60 con 0x7f1f0c0cf070 2024-09-11T23:22:13.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.029+0000 7f1f11a00640 1 -- 172.21.15.144:0/482817519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f0c0cf070 msgr2=0x7f1f0c0cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:13.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.029+0000 7f1f11a00640 1 --2- 172.21.15.144:0/482817519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f0c0cf070 0x7f1f0c0cf4e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0cd070 tx=0x7f1ef402a110 comp rx=0 tx=0).stop 2024-09-11T23:22:13.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.029+0000 7f1f11a00640 1 -- 172.21.15.144:0/482817519 shutdown_connections 2024-09-11T23:22:13.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.029+0000 7f1f11a00640 1 --2- 172.21.15.144:0/482817519 >> v2:172.21.15.165:3300/0 conn(0x7f1f0c073120 0x7f1f0c073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:13.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.029+0000 7f1f11a00640 1 --2- 172.21.15.144:0/482817519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f0c0cf070 0x7f1f0c0cf4e0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:13.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.029+0000 7f1f11a00640 1 -- 172.21.15.144:0/482817519 >> 172.21.15.144:0/482817519 conn(0x7f1f0c062cc0 msgr2=0x7f1f0c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:13.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.029+0000 7f1f11a00640 1 -- 172.21.15.144:0/482817519 shutdown_connections 2024-09-11T23:22:13.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.029+0000 7f1f11a00640 1 -- 172.21.15.144:0/482817519 wait complete. 2024-09-11T23:22:13.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.031+0000 7f1f11a00640 1 Processor -- start 2024-09-11T23:22:13.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.031+0000 7f1f11a00640 1 -- start start 2024-09-11T23:22:13.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.032+0000 7f1f11a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f0c073120 0x7f1f0c0b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:13.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.032+0000 7f1f11a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f0c0cf070 0x7f1f0c0b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:13.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.032+0000 7f1f11a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f0c15c180 0x7f1f0c0b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:13.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.032+0000 7f1f11a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c0722f0 con 0x7f1f0c0cf070 2024-09-11T23:22:13.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.032+0000 7f1f11a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c0ced00 con 0x7f1f0c073120 2024-09-11T23:22:13.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.032+0000 7f1f11a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1f0c15c560 con 0x7f1f0c15c180 2024-09-11T23:22:13.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.032+0000 7f1f02000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f0c0cf070 0x7f1f0c0b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:13.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.032+0000 7f1f02000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f0c0cf070 0x7f1f0c0b4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48640/0 (socket says 172.21.15.144:48640) 2024-09-11T23:22:13.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.032+0000 7f1f02000640 1 -- 172.21.15.144:0/3637285468 learned_addr learned my addr 172.21.15.144:0/3637285468 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:13.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.033+0000 7f1f0aa00640 1 --2- 172.21.15.144:0/3637285468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f0c073120 0x7f1f0c0b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:13.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.033+0000 7f1f0b400640 1 --2- 172.21.15.144:0/3637285468 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f0c15c180 0x7f1f0c0b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:13.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.033+0000 7f1f02000640 1 -- 172.21.15.144:0/3637285468 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f0c15c180 msgr2=0x7f1f0c0b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:13.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.033+0000 7f1f02000640 1 --2- 172.21.15.144:0/3637285468 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f0c15c180 0x7f1f0c0b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:13.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.033+0000 7f1f02000640 1 -- 172.21.15.144:0/3637285468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f0c073120 msgr2=0x7f1f0c0b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:13.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.033+0000 7f1f02000640 1 --2- 172.21.15.144:0/3637285468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f0c073120 0x7f1f0c0b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:13.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.033+0000 7f1f02000640 1 -- 172.21.15.144:0/3637285468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0c0b1130 con 0x7f1f0c0cf070 2024-09-11T23:22:13.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.033+0000 7f1f02000640 1 --2- 172.21.15.144:0/3637285468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f0c0cf070 0x7f1f0c0b4f50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4000c00 tx=0x7f1ef40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:13.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.033+0000 7f1f03400640 1 -- 172.21.15.144:0/3637285468 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4037050 con 0x7f1f0c0cf070 2024-09-11T23:22:13.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.033+0000 7f1f03400640 1 -- 172.21.15.144:0/3637285468 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef4038040 con 0x7f1f0c0cf070 2024-09-11T23:22:13.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.033+0000 7f1f03400640 1 -- 172.21.15.144:0/3637285468 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4004470 con 0x7f1f0c0cf070 2024-09-11T23:22:13.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.033+0000 7f1f11a00640 1 -- 172.21.15.144:0/3637285468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0c1f4380 con 0x7f1f0c0cf070 2024-09-11T23:22:13.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.033+0000 7f1f11a00640 1 -- 172.21.15.144:0/3637285468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f0c1f4940 con 0x7f1f0c0cf070 2024-09-11T23:22:13.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.034+0000 7f1f11a00640 1 -- 172.21.15.144:0/3637285468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f0c0d0660 con 0x7f1f0c0cf070 2024-09-11T23:22:13.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.035+0000 7f1f03400640 1 -- 172.21.15.144:0/3637285468 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 11) ==== 90804+0+0 (secure 0 0 0) 0x7f1ef4030900 con 0x7f1f0c0cf070 2024-09-11T23:22:13.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.036+0000 7f1f03400640 1 --2- 172.21.15.144:0/3637285468 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1ee806c190 0x7f1ee806e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:13.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.036+0000 7f1f03400640 1 -- 172.21.15.144:0/3637285468 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f1ef40abf80 con 0x7f1f0c0cf070 2024-09-11T23:22:13.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.036+0000 7f1f0aa00640 1 --2- 172.21.15.144:0/3637285468 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1ee806c190 0x7f1ee806e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:13.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.037+0000 7f1f0aa00640 1 --2- 172.21.15.144:0/3637285468 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1ee806c190 0x7f1ee806e650 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1efc000f60 tx=0x7f1efc007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:13.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.040+0000 7f1f03400640 1 -- 172.21.15.144:0/3637285468 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1ef407a470 con 0x7f1f0c0cf070 2024-09-11T23:22:13.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.261+0000 7f1f11a00640 1 -- 172.21.15.144:0/3637285468 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f1f0c15b160 con 0x7f1f0c0cf070 2024-09-11T23:22:13.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.267+0000 7f1f03400640 1 -- 172.21.15.144:0/3637285468 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v11) ==== 81+0+471946 (secure 0 0 0) 0x7f1ef4079d70 con 0x7f1f0c0cf070 2024-09-11T23:22:13.273 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:13.273 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:22:13.273 INFO:teuthology.orchestra.run.smithi144.stdout: "epoch": 11, 2024-09-11T23:22:13.273 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.273 INFO:teuthology.orchestra.run.smithi144.stdout: "active_gid": 4110, 2024-09-11T23:22:13.273 INFO:teuthology.orchestra.run.smithi144.stdout: "active_name": "y", 2024-09-11T23:22:13.273 INFO:teuthology.orchestra.run.smithi144.stdout: "active_addrs": { 2024-09-11T23:22:13.273 INFO:teuthology.orchestra.run.smithi144.stdout: "addrvec": [ 2024-09-11T23:22:13.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.273 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v2", 2024-09-11T23:22:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:6800", 2024-09-11T23:22:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 1711334146 2024-09-11T23:22:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v1", 2024-09-11T23:22:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:6801", 2024-09-11T23:22:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 1711334146 2024-09-11T23:22:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:22:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: "active_addr": "172.21.15.144:6801/1711334146", 2024-09-11T23:22:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: "active_change": "2024-09-11T23:17:39.152475+0000", 2024-09-11T23:22:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: "active_mgr_features": 4540701547738038271, 2024-09-11T23:22:13.274 INFO:teuthology.orchestra.run.smithi144.stdout: "available": true, 2024-09-11T23:22:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: "standbys": [ 2024-09-11T23:22:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 4113, 2024-09-11T23:22:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "x", 2024-09-11T23:22:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr_features": 4540701547738038271, 2024-09-11T23:22:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: "available_modules": [ 2024-09-11T23:22:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "alerts", 2024-09-11T23:22:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-11T23:22:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-11T23:22:13.275 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-11T23:22:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T23:22:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.276 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.277 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.278 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.279 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.280 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.281 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_destination": { 2024-09-11T23:22:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_destination", 2024-09-11T23:22:13.282 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.283 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.283 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.283 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.283 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.283 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.283 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.283 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Email address to send alerts to", 2024-09-11T23:22:13.283 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.284 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.284 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.284 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_from_name": { 2024-09-11T23:22:13.284 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_from_name", 2024-09-11T23:22:13.284 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.284 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "Ceph", 2024-09-11T23:22:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Email From: name", 2024-09-11T23:22:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_host": { 2024-09-11T23:22:13.285 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_host", 2024-09-11T23:22:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "SMTP server", 2024-09-11T23:22:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.287 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_password": { 2024-09-11T23:22:13.287 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_password", 2024-09-11T23:22:13.287 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.287 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Password to authenticate with", 2024-09-11T23:22:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_port": { 2024-09-11T23:22:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_port", 2024-09-11T23:22:13.288 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "465", 2024-09-11T23:22:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "SMTP port", 2024-09-11T23:22:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_sender": { 2024-09-11T23:22:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_sender", 2024-09-11T23:22:13.289 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "SMTP envelope sender", 2024-09-11T23:22:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_ssl": { 2024-09-11T23:22:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_ssl", 2024-09-11T23:22:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T23:22:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.291 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_user": { 2024-09-11T23:22:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_user", 2024-09-11T23:22:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.292 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "User to authenticate as", 2024-09-11T23:22:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "balancer", 2024-09-11T23:22:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.293 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "active": { 2024-09-11T23:22:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "active", 2024-09-11T23:22:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T23:22:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.294 INFO:teuthology.orchestra.run.smithi144.stdout: "begin_time": { 2024-09-11T23:22:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "begin_time", 2024-09-11T23:22:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0000", 2024-09-11T23:22:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T23:22:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T23:22:13.295 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.296 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.296 INFO:teuthology.orchestra.run.smithi144.stdout: "begin_weekday": { 2024-09-11T23:22:13.296 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "begin_weekday", 2024-09-11T23:22:13.296 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-11T23:22:13.296 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.296 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.296 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-11T23:22:13.296 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "0", 2024-09-11T23:22:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "6", 2024-09-11T23:22:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T23:22:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T23:22:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: "crush_compat_max_iterations": { 2024-09-11T23:22:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crush_compat_max_iterations", 2024-09-11T23:22:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-11T23:22:13.297 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "25", 2024-09-11T23:22:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1", 2024-09-11T23:22:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "250", 2024-09-11T23:22:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T23:22:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: "crush_compat_metrics": { 2024-09-11T23:22:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crush_compat_metrics", 2024-09-11T23:22:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.298 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T23:22:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T23:22:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T23:22:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: "crush_compat_step": { 2024-09-11T23:22:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crush_compat_step", 2024-09-11T23:22:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-11T23:22:13.299 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0.5", 2024-09-11T23:22:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "0.001", 2024-09-11T23:22:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "0.999", 2024-09-11T23:22:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "aggressiveness of optimization", 2024-09-11T23:22:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T23:22:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: "end_time": { 2024-09-11T23:22:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "end_time", 2024-09-11T23:22:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "2359", 2024-09-11T23:22:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T23:22:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T23:22:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.301 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: "end_weekday": { 2024-09-11T23:22:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "end_weekday", 2024-09-11T23:22:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-11T23:22:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-11T23:22:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "0", 2024-09-11T23:22:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "6", 2024-09-11T23:22:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T23:22:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T23:22:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.303 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.304 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.305 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.306 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.307 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "min_score": { 2024-09-11T23:22:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "min_score", 2024-09-11T23:22:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-11T23:22:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-11T23:22:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.308 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T23:22:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": { 2024-09-11T23:22:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mode", 2024-09-11T23:22:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "upmap", 2024-09-11T23:22:13.309 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.313 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.313 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.313 INFO:teuthology.orchestra.run.smithi144.stdout: "crush-compat", 2024-09-11T23:22:13.313 INFO:teuthology.orchestra.run.smithi144.stdout: "none", 2024-09-11T23:22:13.313 INFO:teuthology.orchestra.run.smithi144.stdout: "read", 2024-09-11T23:22:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: "upmap", 2024-09-11T23:22:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: "upmap-read" 2024-09-11T23:22:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Balancer mode", 2024-09-11T23:22:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: "pool_ids": { 2024-09-11T23:22:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "pool_ids", 2024-09-11T23:22:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.314 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T23:22:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-11T23:22:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-11T23:22:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.315 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-11T23:22:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T23:22:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: "upmap_max_deviation": { 2024-09-11T23:22:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "upmap_max_deviation", 2024-09-11T23:22:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5", 2024-09-11T23:22:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1", 2024-09-11T23:22:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T23:22:13.317 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T23:22:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "upmap_max_optimizations": { 2024-09-11T23:22:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "upmap_max_optimizations", 2024-09-11T23:22:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-11T23:22:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-11T23:22:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T23:22:13.318 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephadm", 2024-09-11T23:22:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: "agent_down_multiplier": { 2024-09-11T23:22:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "agent_down_multiplier", 2024-09-11T23:22:13.319 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-11T23:22:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "3.0", 2024-09-11T23:22:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T23:22:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: "agent_refresh_rate": { 2024-09-11T23:22:13.320 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "agent_refresh_rate", 2024-09-11T23:22:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "20", 2024-09-11T23:22:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T23:22:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.321 INFO:teuthology.orchestra.run.smithi144.stdout: "agent_starting_port": { 2024-09-11T23:22:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "agent_starting_port", 2024-09-11T23:22:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "4721", 2024-09-11T23:22:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T23:22:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.322 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.323 INFO:teuthology.orchestra.run.smithi144.stdout: "allow_ptrace": { 2024-09-11T23:22:13.323 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "allow_ptrace", 2024-09-11T23:22:13.323 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.323 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.323 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.323 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.323 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.323 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.323 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T23:22:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T23:22:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: "autotune_interval": { 2024-09-11T23:22:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "autotune_interval", 2024-09-11T23:22:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-11T23:22:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.324 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T23:22:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: "autotune_memory_target_ratio": { 2024-09-11T23:22:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T23:22:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-11T23:22:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0.7", 2024-09-11T23:22:13.325 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T23:22:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: "cephadm_log_destination": { 2024-09-11T23:22:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephadm_log_destination", 2024-09-11T23:22:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.326 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: "file", 2024-09-11T23:22:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: "file,syslog", 2024-09-11T23:22:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: "syslog" 2024-09-11T23:22:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T23:22:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.327 INFO:teuthology.orchestra.run.smithi144.stdout: "cgroups_split": { 2024-09-11T23:22:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cgroups_split", 2024-09-11T23:22:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T23:22:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.328 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: "config_checks_enabled": { 2024-09-11T23:22:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "config_checks_enabled", 2024-09-11T23:22:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T23:22:13.329 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.330 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.330 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.330 INFO:teuthology.orchestra.run.smithi144.stdout: "config_dashboard": { 2024-09-11T23:22:13.330 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "config_dashboard", 2024-09-11T23:22:13.330 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.330 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.331 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.331 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.331 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.331 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.331 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.331 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T23:22:13.332 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.332 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.332 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.332 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_alertmanager": { 2024-09-11T23:22:13.332 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_alertmanager", 2024-09-11T23:22:13.333 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.333 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.333 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.333 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-11T23:22:13.333 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.333 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.333 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.334 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Prometheus container image", 2024-09-11T23:22:13.334 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.334 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.334 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.334 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_base": { 2024-09-11T23:22:13.334 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_base", 2024-09-11T23:22:13.334 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.335 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.335 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.335 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T23:22:13.335 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.335 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.335 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.336 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Container image name, without the tag", 2024-09-11T23:22:13.336 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.336 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.336 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.336 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_elasticsearch": { 2024-09-11T23:22:13.337 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_elasticsearch", 2024-09-11T23:22:13.337 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.337 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.337 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.337 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T23:22:13.337 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.338 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.338 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.338 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "elasticsearch container image", 2024-09-11T23:22:13.338 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.338 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.338 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.339 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_grafana": { 2024-09-11T23:22:13.339 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_grafana", 2024-09-11T23:22:13.339 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.339 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.339 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.339 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-11T23:22:13.339 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.339 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.339 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.339 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Prometheus container image", 2024-09-11T23:22:13.339 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.339 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.340 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.340 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_haproxy": { 2024-09-11T23:22:13.340 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_haproxy", 2024-09-11T23:22:13.340 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.340 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.340 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.340 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T23:22:13.340 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.340 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.340 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.340 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "HAproxy container image", 2024-09-11T23:22:13.341 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.341 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.341 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.341 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_jaeger_agent": { 2024-09-11T23:22:13.341 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_jaeger_agent", 2024-09-11T23:22:13.341 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.341 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.341 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.341 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T23:22:13.341 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.342 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.342 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.342 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Jaeger agent container image", 2024-09-11T23:22:13.342 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.342 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.342 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.342 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_jaeger_collector": { 2024-09-11T23:22:13.342 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_jaeger_collector", 2024-09-11T23:22:13.342 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.342 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.342 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.342 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T23:22:13.342 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.343 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.343 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.343 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Jaeger collector container image", 2024-09-11T23:22:13.343 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.343 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.343 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.343 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_jaeger_query": { 2024-09-11T23:22:13.343 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_jaeger_query", 2024-09-11T23:22:13.343 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.343 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.343 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.343 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T23:22:13.344 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.344 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.344 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.344 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Jaeger query container image", 2024-09-11T23:22:13.344 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.344 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.345 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.345 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_keepalived": { 2024-09-11T23:22:13.345 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_keepalived", 2024-09-11T23:22:13.345 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.345 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.346 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.346 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T23:22:13.346 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.346 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.346 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.346 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Keepalived container image", 2024-09-11T23:22:13.346 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.346 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.346 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.346 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_loki": { 2024-09-11T23:22:13.346 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_loki", 2024-09-11T23:22:13.347 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.347 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.347 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.347 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T23:22:13.347 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.347 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.347 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.347 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Loki container image", 2024-09-11T23:22:13.347 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.347 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.347 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.347 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_node_exporter": { 2024-09-11T23:22:13.348 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_node_exporter", 2024-09-11T23:22:13.348 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.348 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.348 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.348 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-11T23:22:13.348 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.348 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.348 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.348 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Prometheus container image", 2024-09-11T23:22:13.348 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.348 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.349 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.349 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_nvmeof": { 2024-09-11T23:22:13.349 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_nvmeof", 2024-09-11T23:22:13.349 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.349 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.349 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.349 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-11T23:22:13.349 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.349 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.349 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.349 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Nvme-of container image", 2024-09-11T23:22:13.349 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.349 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.350 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.350 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_prometheus": { 2024-09-11T23:22:13.350 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_prometheus", 2024-09-11T23:22:13.350 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.350 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.350 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.350 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-11T23:22:13.350 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.350 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.350 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.350 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Prometheus container image", 2024-09-11T23:22:13.350 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.351 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.351 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.351 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_promtail": { 2024-09-11T23:22:13.351 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_promtail", 2024-09-11T23:22:13.351 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.351 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.351 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.351 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T23:22:13.351 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.351 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.351 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.351 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Promtail container image", 2024-09-11T23:22:13.351 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.352 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.352 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.352 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_samba": { 2024-09-11T23:22:13.352 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_samba", 2024-09-11T23:22:13.352 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.352 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.352 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.352 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T23:22:13.352 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.352 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.352 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.353 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Samba/SMB container image", 2024-09-11T23:22:13.353 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.353 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.353 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.353 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_snmp_gateway": { 2024-09-11T23:22:13.353 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_snmp_gateway", 2024-09-11T23:22:13.353 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.353 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.353 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.353 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T23:22:13.353 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.353 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.354 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.354 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "SNMP Gateway container image", 2024-09-11T23:22:13.354 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.354 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.354 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.354 INFO:teuthology.orchestra.run.smithi144.stdout: "container_init": { 2024-09-11T23:22:13.354 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_init", 2024-09-11T23:22:13.354 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.354 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.354 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.354 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.354 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.355 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.355 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.355 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T23:22:13.355 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.355 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.355 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.355 INFO:teuthology.orchestra.run.smithi144.stdout: "daemon_cache_timeout": { 2024-09-11T23:22:13.355 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "daemon_cache_timeout", 2024-09-11T23:22:13.355 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.355 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.355 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.355 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-11T23:22:13.356 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.356 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.356 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.356 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T23:22:13.356 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.356 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.356 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.356 INFO:teuthology.orchestra.run.smithi144.stdout: "default_cephadm_command_timeout": { 2024-09-11T23:22:13.356 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T23:22:13.356 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.356 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.356 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.357 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "900", 2024-09-11T23:22:13.357 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.357 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.357 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.357 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T23:22:13.357 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.357 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.357 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.357 INFO:teuthology.orchestra.run.smithi144.stdout: "default_registry": { 2024-09-11T23:22:13.357 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "default_registry", 2024-09-11T23:22:13.357 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.357 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.357 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.358 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "docker.io", 2024-09-11T23:22:13.358 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.358 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.358 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.358 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T23:22:13.358 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.358 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.358 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.358 INFO:teuthology.orchestra.run.smithi144.stdout: "device_cache_timeout": { 2024-09-11T23:22:13.358 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "device_cache_timeout", 2024-09-11T23:22:13.358 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.358 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.359 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.359 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "1800", 2024-09-11T23:22:13.359 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.359 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.359 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.359 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "seconds to cache device inventory", 2024-09-11T23:22:13.359 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.359 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.359 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.360 INFO:teuthology.orchestra.run.smithi144.stdout: "device_enhanced_scan": { 2024-09-11T23:22:13.360 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "device_enhanced_scan", 2024-09-11T23:22:13.360 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.360 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.360 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.360 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.360 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.360 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.360 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.360 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T23:22:13.360 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.360 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.360 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.361 INFO:teuthology.orchestra.run.smithi144.stdout: "facts_cache_timeout": { 2024-09-11T23:22:13.361 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "facts_cache_timeout", 2024-09-11T23:22:13.361 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.361 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.361 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.361 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-11T23:22:13.361 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.362 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.362 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.362 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "seconds to cache host facts data", 2024-09-11T23:22:13.362 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.362 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.362 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.362 INFO:teuthology.orchestra.run.smithi144.stdout: "grafana_dashboards_path": { 2024-09-11T23:22:13.362 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "grafana_dashboards_path", 2024-09-11T23:22:13.362 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.362 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.362 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.362 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T23:22:13.363 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.363 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.363 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.363 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T23:22:13.363 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.363 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.363 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.363 INFO:teuthology.orchestra.run.smithi144.stdout: "host_check_interval": { 2024-09-11T23:22:13.363 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "host_check_interval", 2024-09-11T23:22:13.363 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.363 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.363 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.363 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-11T23:22:13.364 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.364 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.364 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.364 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to perform a host check", 2024-09-11T23:22:13.364 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.364 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.364 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.364 INFO:teuthology.orchestra.run.smithi144.stdout: "hw_monitoring": { 2024-09-11T23:22:13.365 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "hw_monitoring", 2024-09-11T23:22:13.365 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.365 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.365 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.365 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.365 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.365 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.365 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.365 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T23:22:13.366 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.366 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.366 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.366 INFO:teuthology.orchestra.run.smithi144.stdout: "inventory_list_all": { 2024-09-11T23:22:13.366 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "inventory_list_all", 2024-09-11T23:22:13.366 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.366 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.366 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.367 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.367 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.367 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.367 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.367 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T23:22:13.367 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.367 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.367 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.368 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.368 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.368 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.368 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.368 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.368 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.368 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.369 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.369 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.369 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.369 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.369 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.369 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.369 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.370 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.370 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.370 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.370 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.370 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.370 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.370 INFO:teuthology.orchestra.run.smithi144.stdout: "log_refresh_metadata": { 2024-09-11T23:22:13.371 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_refresh_metadata", 2024-09-11T23:22:13.371 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.371 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.371 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.371 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.371 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.371 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.371 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.372 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T23:22:13.372 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.372 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.372 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.372 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.372 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.372 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.373 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.373 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.373 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.373 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.373 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.374 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.374 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T23:22:13.374 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.374 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.374 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.375 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.375 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.375 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.375 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.375 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.375 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.375 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.375 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.375 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.376 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.376 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.376 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.376 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.376 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.376 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.376 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.376 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.377 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.377 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.377 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.377 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.377 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.377 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.377 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.378 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.378 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.378 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.378 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.378 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.378 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.378 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.378 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.379 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.379 INFO:teuthology.orchestra.run.smithi144.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T23:22:13.379 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T23:22:13.379 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.379 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.379 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.379 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.379 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.379 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.379 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.379 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T23:22:13.379 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.380 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.380 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.380 INFO:teuthology.orchestra.run.smithi144.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T23:22:13.380 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T23:22:13.380 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.380 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.380 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.380 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "*", 2024-09-11T23:22:13.380 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.380 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.380 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.380 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T23:22:13.381 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.381 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.381 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.381 INFO:teuthology.orchestra.run.smithi144.stdout: "max_count_per_host": { 2024-09-11T23:22:13.381 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_count_per_host", 2024-09-11T23:22:13.381 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.381 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.381 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.381 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-11T23:22:13.381 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.381 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.381 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.382 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "max number of daemons per service per host", 2024-09-11T23:22:13.382 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.382 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.382 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.382 INFO:teuthology.orchestra.run.smithi144.stdout: "max_osd_draining_count": { 2024-09-11T23:22:13.382 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_osd_draining_count", 2024-09-11T23:22:13.382 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.382 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.382 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.382 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-11T23:22:13.382 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.382 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.382 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.383 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T23:22:13.383 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.383 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.383 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.383 INFO:teuthology.orchestra.run.smithi144.stdout: "migration_current": { 2024-09-11T23:22:13.383 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "migration_current", 2024-09-11T23:22:13.383 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.383 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.383 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.383 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.383 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.383 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.383 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.383 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "internal - do not modify", 2024-09-11T23:22:13.384 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.384 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.384 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.384 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": { 2024-09-11T23:22:13.384 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mode", 2024-09-11T23:22:13.384 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.384 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.384 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.384 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "root", 2024-09-11T23:22:13.384 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.384 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.384 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.385 INFO:teuthology.orchestra.run.smithi144.stdout: "cephadm-package", 2024-09-11T23:22:13.385 INFO:teuthology.orchestra.run.smithi144.stdout: "root" 2024-09-11T23:22:13.385 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.385 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T23:22:13.385 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.385 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.385 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.385 INFO:teuthology.orchestra.run.smithi144.stdout: "oob_default_addr": { 2024-09-11T23:22:13.385 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "oob_default_addr", 2024-09-11T23:22:13.386 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.386 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.386 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.386 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "169.254.1.1", 2024-09-11T23:22:13.386 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.386 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.386 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.386 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T23:22:13.386 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.386 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.386 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.386 INFO:teuthology.orchestra.run.smithi144.stdout: "prometheus_alerts_path": { 2024-09-11T23:22:13.386 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "prometheus_alerts_path", 2024-09-11T23:22:13.387 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.387 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.387 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.387 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T23:22:13.387 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.387 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.387 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.387 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T23:22:13.387 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.387 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.387 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.388 INFO:teuthology.orchestra.run.smithi144.stdout: "registry_insecure": { 2024-09-11T23:22:13.388 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "registry_insecure", 2024-09-11T23:22:13.388 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.388 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.388 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.388 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.388 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.388 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.388 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.389 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T23:22:13.389 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.389 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.389 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.389 INFO:teuthology.orchestra.run.smithi144.stdout: "registry_password": { 2024-09-11T23:22:13.389 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "registry_password", 2024-09-11T23:22:13.389 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.389 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.389 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.389 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.389 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.390 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.390 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.390 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T23:22:13.390 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.390 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.390 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.390 INFO:teuthology.orchestra.run.smithi144.stdout: "registry_url": { 2024-09-11T23:22:13.390 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "registry_url", 2024-09-11T23:22:13.390 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.390 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.390 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.390 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.391 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.391 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.391 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.391 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T23:22:13.391 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.391 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.391 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.391 INFO:teuthology.orchestra.run.smithi144.stdout: "registry_username": { 2024-09-11T23:22:13.391 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "registry_username", 2024-09-11T23:22:13.391 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.391 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.391 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.391 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.392 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.392 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.392 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.392 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T23:22:13.392 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.392 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.392 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.392 INFO:teuthology.orchestra.run.smithi144.stdout: "secure_monitoring_stack": { 2024-09-11T23:22:13.392 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "secure_monitoring_stack", 2024-09-11T23:22:13.393 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.393 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.393 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.393 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.393 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.393 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.393 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.393 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T23:22:13.393 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.393 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.394 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.394 INFO:teuthology.orchestra.run.smithi144.stdout: "service_discovery_port": { 2024-09-11T23:22:13.394 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "service_discovery_port", 2024-09-11T23:22:13.394 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.394 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.394 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.394 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8765", 2024-09-11T23:22:13.394 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.394 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.394 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.394 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "cephadm service discovery port", 2024-09-11T23:22:13.394 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.395 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.395 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.395 INFO:teuthology.orchestra.run.smithi144.stdout: "ssh_config_file": { 2024-09-11T23:22:13.395 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ssh_config_file", 2024-09-11T23:22:13.395 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.395 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.395 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.395 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.395 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.395 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.395 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.395 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T23:22:13.396 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.396 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.396 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.396 INFO:teuthology.orchestra.run.smithi144.stdout: "use_agent": { 2024-09-11T23:22:13.396 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "use_agent", 2024-09-11T23:22:13.396 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.396 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.396 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.396 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.396 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.396 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.396 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.396 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T23:22:13.397 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.397 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.397 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.397 INFO:teuthology.orchestra.run.smithi144.stdout: "use_repo_digest": { 2024-09-11T23:22:13.397 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "use_repo_digest", 2024-09-11T23:22:13.397 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.397 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.397 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.397 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.397 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.397 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.397 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.398 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T23:22:13.398 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.398 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.398 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.398 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_on_failed_host_check": { 2024-09-11T23:22:13.398 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_on_failed_host_check", 2024-09-11T23:22:13.398 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.398 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.398 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.398 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.398 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.398 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.398 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.399 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T23:22:13.399 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.399 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.399 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.399 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_on_stray_daemons": { 2024-09-11T23:22:13.399 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_on_stray_daemons", 2024-09-11T23:22:13.399 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.399 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.399 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.399 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.399 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.399 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.399 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.400 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T23:22:13.400 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.400 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.400 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.400 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_on_stray_hosts": { 2024-09-11T23:22:13.400 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_on_stray_hosts", 2024-09-11T23:22:13.400 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.400 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.400 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.400 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.400 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.400 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.400 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.401 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T23:22:13.401 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.401 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.401 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.401 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.401 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.401 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crash", 2024-09-11T23:22:13.401 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.401 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.401 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.402 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.402 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.402 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.402 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.402 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.402 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.402 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.402 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.402 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.402 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.402 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.402 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.403 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.403 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.403 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.403 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.403 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.403 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.403 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.403 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.403 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.403 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.403 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.404 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.404 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.404 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.404 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.404 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.404 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.404 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.404 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.404 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.404 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.404 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.404 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.404 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.405 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.405 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.405 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.405 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.405 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.405 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.405 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.405 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.405 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.405 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.405 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.405 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.405 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.406 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.406 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.406 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.406 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.406 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.406 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.406 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.406 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.406 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.406 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.406 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.406 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.406 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.406 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.407 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.407 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.407 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.407 INFO:teuthology.orchestra.run.smithi144.stdout: "retain_interval": { 2024-09-11T23:22:13.407 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "retain_interval", 2024-09-11T23:22:13.407 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.407 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.407 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.407 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "31536000", 2024-09-11T23:22:13.407 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.407 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.407 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.407 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T23:22:13.408 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.408 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.408 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.408 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_recent_interval": { 2024-09-11T23:22:13.408 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_recent_interval", 2024-09-11T23:22:13.408 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.408 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.408 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.408 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "1209600", 2024-09-11T23:22:13.408 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.408 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.408 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.409 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T23:22:13.409 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.409 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.409 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.409 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.409 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.409 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "dashboard", 2024-09-11T23:22:13.409 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.409 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.409 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.409 INFO:teuthology.orchestra.run.smithi144.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T23:22:13.409 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T23:22:13.409 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.410 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.410 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.410 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-11T23:22:13.410 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.410 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.410 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.410 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.410 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.410 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.410 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.410 INFO:teuthology.orchestra.run.smithi144.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T23:22:13.410 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T23:22:13.410 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.411 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.411 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.411 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.411 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.411 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.411 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.411 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.411 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.411 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.411 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.411 INFO:teuthology.orchestra.run.smithi144.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T23:22:13.411 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T23:22:13.411 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.412 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.412 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.412 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.412 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.412 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.412 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.412 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.412 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.412 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.412 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.412 INFO:teuthology.orchestra.run.smithi144.stdout: "AUDIT_API_ENABLED": { 2024-09-11T23:22:13.412 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T23:22:13.412 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.413 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.413 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.413 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.413 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.413 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.413 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.413 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.413 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.413 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.413 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.413 INFO:teuthology.orchestra.run.smithi144.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T23:22:13.413 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T23:22:13.413 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.414 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.414 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.414 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.414 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.414 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.414 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.414 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.414 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.414 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.414 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.414 INFO:teuthology.orchestra.run.smithi144.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T23:22:13.414 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T23:22:13.415 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.415 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.415 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.415 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.415 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.415 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.415 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.415 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.415 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.415 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.415 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.416 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T23:22:13.416 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T23:22:13.416 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.416 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.416 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.416 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.416 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.416 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.416 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.416 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.416 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.416 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.416 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.417 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T23:22:13.417 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T23:22:13.417 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.417 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.417 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.417 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.417 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.417 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.417 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.417 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.417 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.417 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.417 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.418 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T23:22:13.418 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T23:22:13.418 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.418 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.418 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.418 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.418 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.418 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.418 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.418 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.418 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.418 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.418 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.419 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T23:22:13.419 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T23:22:13.419 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.419 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.419 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.419 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.419 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.419 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.419 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.419 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.419 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.419 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.419 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.420 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T23:22:13.420 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T23:22:13.420 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.420 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.420 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.420 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.420 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.420 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.420 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.420 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.420 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.420 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.420 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.421 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T23:22:13.421 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T23:22:13.421 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.421 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.421 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.421 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.421 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.421 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.421 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.421 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.421 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.421 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.421 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.422 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T23:22:13.422 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T23:22:13.422 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.422 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.422 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.422 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.422 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.422 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.422 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.422 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.422 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.422 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.422 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.423 INFO:teuthology.orchestra.run.smithi144.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T23:22:13.423 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T23:22:13.423 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.423 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.423 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.423 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.423 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.423 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.423 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.423 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.423 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.423 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.423 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.424 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T23:22:13.424 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T23:22:13.424 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.424 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.424 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.424 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "admin", 2024-09-11T23:22:13.424 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.424 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.424 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.424 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.425 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.425 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.425 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.425 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T23:22:13.425 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T23:22:13.425 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.425 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.425 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.425 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.425 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.425 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.425 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.426 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.426 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.426 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.426 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.426 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_API_URL": { 2024-09-11T23:22:13.426 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_API_URL", 2024-09-11T23:22:13.426 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.426 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.426 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.426 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.426 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.426 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.426 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.427 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.427 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.427 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.427 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.427 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T23:22:13.427 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T23:22:13.427 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.427 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.427 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.427 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "admin", 2024-09-11T23:22:13.427 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.427 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.428 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.428 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.428 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.428 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.428 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.428 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T23:22:13.428 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T23:22:13.428 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.428 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.428 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.428 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.428 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.428 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.429 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.429 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.429 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.429 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.429 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.429 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T23:22:13.429 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T23:22:13.429 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.429 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.429 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.430 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.430 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.430 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.430 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.430 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.430 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.430 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.430 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.430 INFO:teuthology.orchestra.run.smithi144.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T23:22:13.430 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T23:22:13.430 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.430 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.431 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.431 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.431 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.431 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.431 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.431 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.431 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.431 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.431 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.431 INFO:teuthology.orchestra.run.smithi144.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T23:22:13.431 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T23:22:13.431 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.432 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.432 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.432 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.432 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.432 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.432 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.432 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.432 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.432 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.432 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.432 INFO:teuthology.orchestra.run.smithi144.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T23:22:13.432 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T23:22:13.432 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.433 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.433 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.433 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.433 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.433 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.433 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.433 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.433 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.433 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.433 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.433 INFO:teuthology.orchestra.run.smithi144.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T23:22:13.433 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T23:22:13.433 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.434 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.434 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.434 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.434 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.434 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.434 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.434 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.434 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.434 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.434 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.435 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T23:22:13.435 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T23:22:13.435 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.435 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.435 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.435 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.435 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.435 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.435 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.435 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.435 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.435 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.435 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.436 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T23:22:13.436 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T23:22:13.436 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.436 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.436 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.436 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.436 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.436 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.436 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.436 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.436 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.437 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.437 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.437 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T23:22:13.437 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T23:22:13.437 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.437 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.437 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.437 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.437 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.437 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.437 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.437 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.438 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.438 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.438 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.438 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T23:22:13.438 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T23:22:13.438 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.438 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.438 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.438 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.438 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.438 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.438 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.438 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.439 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.439 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.439 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.439 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T23:22:13.439 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T23:22:13.439 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.439 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.439 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.439 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.439 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.439 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.439 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.440 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.440 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.440 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.440 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.440 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T23:22:13.440 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T23:22:13.440 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.440 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.440 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.440 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.440 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.440 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.440 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.441 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.441 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.441 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.441 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.441 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T23:22:13.441 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T23:22:13.441 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.441 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.441 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.441 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.441 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.441 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.441 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.442 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.442 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.442 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.442 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.442 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T23:22:13.442 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T23:22:13.442 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.442 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.442 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.442 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.442 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.442 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.442 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.443 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.443 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.443 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.443 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.443 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T23:22:13.443 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T23:22:13.443 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.443 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.443 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.443 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T23:22:13.443 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.443 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.444 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.444 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.444 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.444 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.444 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.444 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T23:22:13.444 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T23:22:13.444 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.444 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.444 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.444 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-11T23:22:13.444 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.444 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.445 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.445 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.445 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.445 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.445 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.445 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T23:22:13.445 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T23:22:13.445 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.445 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.445 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.445 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8", 2024-09-11T23:22:13.446 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.446 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.446 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.446 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.446 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.446 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.446 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.446 INFO:teuthology.orchestra.run.smithi144.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T23:22:13.446 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T23:22:13.446 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.446 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.446 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.447 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "45", 2024-09-11T23:22:13.447 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.447 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.447 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.447 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.447 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.447 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.447 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.447 INFO:teuthology.orchestra.run.smithi144.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T23:22:13.447 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T23:22:13.447 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.447 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.447 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.448 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.448 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.448 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.448 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.448 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.448 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.448 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.448 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.448 INFO:teuthology.orchestra.run.smithi144.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T23:22:13.448 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T23:22:13.448 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.448 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.448 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.449 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "admin", 2024-09-11T23:22:13.449 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.449 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.449 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.449 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.449 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.449 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.449 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.449 INFO:teuthology.orchestra.run.smithi144.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T23:22:13.449 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T23:22:13.449 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.449 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.449 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.450 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.450 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.450 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.450 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.450 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.450 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.450 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.450 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.450 INFO:teuthology.orchestra.run.smithi144.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T23:22:13.450 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T23:22:13.450 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.450 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.450 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.451 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.451 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.451 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.451 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.451 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.451 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.451 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.451 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.451 INFO:teuthology.orchestra.run.smithi144.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T23:22:13.451 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T23:22:13.451 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.451 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.451 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.451 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-11T23:22:13.452 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.452 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.452 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.452 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.452 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.452 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.452 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.452 INFO:teuthology.orchestra.run.smithi144.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T23:22:13.452 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T23:22:13.452 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.452 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.452 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.452 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-11T23:22:13.453 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.453 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.453 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.453 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.453 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.453 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.453 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.453 INFO:teuthology.orchestra.run.smithi144.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T23:22:13.453 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T23:22:13.453 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.453 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.453 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.453 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5", 2024-09-11T23:22:13.454 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.454 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.454 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.454 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.454 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.454 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.454 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.454 INFO:teuthology.orchestra.run.smithi144.stdout: "cross_origin_url": { 2024-09-11T23:22:13.454 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cross_origin_url", 2024-09-11T23:22:13.454 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.454 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.454 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.454 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.454 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.455 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.455 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.455 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.455 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.455 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.455 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.455 INFO:teuthology.orchestra.run.smithi144.stdout: "crt_file": { 2024-09-11T23:22:13.455 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crt_file", 2024-09-11T23:22:13.455 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.455 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.455 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.455 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.455 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.456 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.456 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.456 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.456 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.456 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.456 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.456 INFO:teuthology.orchestra.run.smithi144.stdout: "debug": { 2024-09-11T23:22:13.456 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "debug", 2024-09-11T23:22:13.456 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.456 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.456 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.457 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.457 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.457 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.457 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.457 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Enable/disable debug options", 2024-09-11T23:22:13.457 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.457 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.457 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.457 INFO:teuthology.orchestra.run.smithi144.stdout: "jwt_token_ttl": { 2024-09-11T23:22:13.457 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "jwt_token_ttl", 2024-09-11T23:22:13.457 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.457 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.458 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.458 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "28800", 2024-09-11T23:22:13.458 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.458 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.458 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.458 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.458 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.458 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.458 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.458 INFO:teuthology.orchestra.run.smithi144.stdout: "key_file": { 2024-09-11T23:22:13.458 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "key_file", 2024-09-11T23:22:13.458 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.458 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.458 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.459 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.459 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.459 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.459 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.459 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.459 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.459 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.459 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.459 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.459 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.459 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.459 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.459 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.460 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.460 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.460 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.460 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.460 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.460 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.460 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.460 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.460 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.460 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.460 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.460 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.460 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.460 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.461 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.461 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.461 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.461 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.461 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.461 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.461 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.461 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.461 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.461 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.461 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.461 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.461 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.461 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.462 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.462 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.462 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.462 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.462 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.462 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.462 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.462 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.462 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.462 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.462 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.462 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.462 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.463 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.463 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.463 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.463 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.463 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.463 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.463 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.463 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.463 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.463 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.463 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.464 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.464 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.464 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.464 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.464 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.464 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.464 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.464 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.464 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.464 INFO:teuthology.orchestra.run.smithi144.stdout: "motd": { 2024-09-11T23:22:13.464 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "motd", 2024-09-11T23:22:13.464 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.464 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.465 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.465 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.465 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.465 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.465 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.465 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "The message of the day", 2024-09-11T23:22:13.465 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.465 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.465 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.465 INFO:teuthology.orchestra.run.smithi144.stdout: "redirect_resolve_ip_addr": { 2024-09-11T23:22:13.465 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T23:22:13.465 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.465 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.466 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.466 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.466 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.466 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.466 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.466 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.466 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.466 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.466 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.466 INFO:teuthology.orchestra.run.smithi144.stdout: "server_addr": { 2024-09-11T23:22:13.466 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_addr", 2024-09-11T23:22:13.466 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.466 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.467 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.467 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "::", 2024-09-11T23:22:13.467 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.467 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.467 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.467 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.467 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.467 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.467 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.467 INFO:teuthology.orchestra.run.smithi144.stdout: "server_port": { 2024-09-11T23:22:13.467 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_port", 2024-09-11T23:22:13.467 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.467 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.467 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.468 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8080", 2024-09-11T23:22:13.468 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.468 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.468 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.468 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.468 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.468 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.468 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.468 INFO:teuthology.orchestra.run.smithi144.stdout: "ssl": { 2024-09-11T23:22:13.468 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ssl", 2024-09-11T23:22:13.468 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.468 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.468 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.469 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.469 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.469 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.469 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.469 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.469 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.469 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.469 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.469 INFO:teuthology.orchestra.run.smithi144.stdout: "ssl_server_port": { 2024-09-11T23:22:13.469 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ssl_server_port", 2024-09-11T23:22:13.469 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.469 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.470 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.470 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8443", 2024-09-11T23:22:13.470 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.470 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.470 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.470 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.470 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.470 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.470 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.470 INFO:teuthology.orchestra.run.smithi144.stdout: "standby_behaviour": { 2024-09-11T23:22:13.470 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "standby_behaviour", 2024-09-11T23:22:13.470 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.471 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.471 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.471 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "redirect", 2024-09-11T23:22:13.471 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.471 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.471 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.471 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.471 INFO:teuthology.orchestra.run.smithi144.stdout: "redirect" 2024-09-11T23:22:13.471 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.471 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.471 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.471 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.471 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.472 INFO:teuthology.orchestra.run.smithi144.stdout: "standby_error_status_code": { 2024-09-11T23:22:13.472 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "standby_error_status_code", 2024-09-11T23:22:13.472 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.472 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.472 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.472 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "500", 2024-09-11T23:22:13.472 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "400", 2024-09-11T23:22:13.472 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "599", 2024-09-11T23:22:13.472 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.472 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.472 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.472 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.472 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.473 INFO:teuthology.orchestra.run.smithi144.stdout: "url_prefix": { 2024-09-11T23:22:13.473 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "url_prefix", 2024-09-11T23:22:13.473 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.473 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.473 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.473 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.473 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.473 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.473 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.473 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.474 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.474 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.474 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.474 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "devicehealth", 2024-09-11T23:22:13.474 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.474 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.474 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.474 INFO:teuthology.orchestra.run.smithi144.stdout: "enable_monitoring": { 2024-09-11T23:22:13.474 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "enable_monitoring", 2024-09-11T23:22:13.474 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.475 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.475 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.475 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.475 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.475 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.475 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.475 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "monitor device health metrics", 2024-09-11T23:22:13.475 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.475 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.475 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.475 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.475 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.475 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.476 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.476 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.476 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.476 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.476 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.476 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.476 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.476 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.476 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.476 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.477 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.477 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.477 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.477 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.477 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.477 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.477 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.477 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.477 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.477 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.477 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.477 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.477 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.478 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.478 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.478 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.478 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.478 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.478 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.478 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.478 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.478 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.478 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.478 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.478 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.478 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.479 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.479 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.479 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.479 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.479 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.479 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.479 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.479 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.479 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.479 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.479 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.479 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.479 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.479 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.480 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.480 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.480 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.480 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.480 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.480 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.480 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.480 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.480 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.480 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.480 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.480 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.481 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.481 INFO:teuthology.orchestra.run.smithi144.stdout: "mark_out_threshold": { 2024-09-11T23:22:13.481 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mark_out_threshold", 2024-09-11T23:22:13.481 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.481 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.481 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.481 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "2419200", 2024-09-11T23:22:13.481 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.481 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.481 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.481 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T23:22:13.481 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.481 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.482 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.482 INFO:teuthology.orchestra.run.smithi144.stdout: "pool_name": { 2024-09-11T23:22:13.482 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "pool_name", 2024-09-11T23:22:13.482 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.482 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.482 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.482 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "device_health_metrics", 2024-09-11T23:22:13.482 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.482 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.482 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.482 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T23:22:13.482 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.482 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.483 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.483 INFO:teuthology.orchestra.run.smithi144.stdout: "retention_period": { 2024-09-11T23:22:13.483 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "retention_period", 2024-09-11T23:22:13.483 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.483 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.483 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.483 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "15552000", 2024-09-11T23:22:13.483 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.483 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.483 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.483 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how long to retain device health metrics", 2024-09-11T23:22:13.483 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.483 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.484 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.484 INFO:teuthology.orchestra.run.smithi144.stdout: "scrape_frequency": { 2024-09-11T23:22:13.484 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "scrape_frequency", 2024-09-11T23:22:13.484 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.484 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.484 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.484 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "86400", 2024-09-11T23:22:13.484 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.484 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.484 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.484 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T23:22:13.484 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.485 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.485 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.485 INFO:teuthology.orchestra.run.smithi144.stdout: "self_heal": { 2024-09-11T23:22:13.485 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "self_heal", 2024-09-11T23:22:13.485 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.485 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.485 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.485 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.485 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.485 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.486 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.486 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T23:22:13.486 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.486 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.486 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.486 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-11T23:22:13.486 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-11T23:22:13.486 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.486 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.486 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.486 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-11T23:22:13.486 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.486 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.487 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.487 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T23:22:13.487 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.487 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.487 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.487 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_threshold": { 2024-09-11T23:22:13.487 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_threshold", 2024-09-11T23:22:13.487 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.487 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.487 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.487 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "7257600", 2024-09-11T23:22:13.487 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.488 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.488 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.488 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T23:22:13.488 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.488 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.488 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.488 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.488 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.488 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "diskprediction_local", 2024-09-11T23:22:13.488 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.488 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.489 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.489 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.489 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.489 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.489 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.489 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.489 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.489 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.489 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.489 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.489 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.489 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.489 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.490 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.490 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.490 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.490 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.490 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.490 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.490 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.490 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.490 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.490 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.491 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.491 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.491 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.491 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.491 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.491 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.491 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.491 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.491 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.491 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.491 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.491 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.491 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.492 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.492 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.492 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.492 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.492 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.492 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.492 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.492 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.492 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.492 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.492 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.493 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.493 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.493 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.493 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.493 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.493 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.493 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.493 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.493 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.493 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.493 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.494 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.494 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.494 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.494 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.494 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.494 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.494 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.494 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.494 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.494 INFO:teuthology.orchestra.run.smithi144.stdout: "predict_interval": { 2024-09-11T23:22:13.494 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "predict_interval", 2024-09-11T23:22:13.494 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.495 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.495 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.495 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "86400", 2024-09-11T23:22:13.495 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.495 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.495 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.495 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.495 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.495 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.495 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.495 INFO:teuthology.orchestra.run.smithi144.stdout: "predictor_model": { 2024-09-11T23:22:13.495 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "predictor_model", 2024-09-11T23:22:13.496 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.496 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.496 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.496 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "prophetstor", 2024-09-11T23:22:13.496 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.496 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.496 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.496 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.496 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.496 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.496 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.496 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-11T23:22:13.496 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-11T23:22:13.497 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.497 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.497 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.497 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-11T23:22:13.497 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.497 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.497 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.497 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.497 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.497 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.497 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.497 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.497 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.498 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "influx", 2024-09-11T23:22:13.498 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": false, 2024-09-11T23:22:13.498 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "influxdb python module not found", 2024-09-11T23:22:13.498 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.498 INFO:teuthology.orchestra.run.smithi144.stdout: "batch_size": { 2024-09-11T23:22:13.498 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "batch_size", 2024-09-11T23:22:13.498 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.499 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.499 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.499 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5000", 2024-09-11T23:22:13.499 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.499 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.499 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.499 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T23:22:13.499 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.499 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.500 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.500 INFO:teuthology.orchestra.run.smithi144.stdout: "database": { 2024-09-11T23:22:13.500 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "database", 2024-09-11T23:22:13.500 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.500 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.500 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.500 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "ceph", 2024-09-11T23:22:13.500 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.500 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.500 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.501 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T23:22:13.501 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.501 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.501 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.501 INFO:teuthology.orchestra.run.smithi144.stdout: "hostname": { 2024-09-11T23:22:13.501 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "hostname", 2024-09-11T23:22:13.501 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.501 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.501 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.501 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.502 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.502 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.502 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.502 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "InfluxDB server hostname", 2024-09-11T23:22:13.502 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.502 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.502 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.502 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-11T23:22:13.502 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-11T23:22:13.502 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.503 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.503 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.503 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "30", 2024-09-11T23:22:13.503 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "5", 2024-09-11T23:22:13.503 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.503 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.503 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T23:22:13.503 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.503 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.504 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.504 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.504 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.504 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.504 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.504 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.505 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.505 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.505 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.505 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.505 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.506 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.506 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.506 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.506 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.506 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.506 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.507 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.507 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.507 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.507 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.507 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.507 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.508 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.508 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.508 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.508 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.508 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.508 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.508 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.509 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.509 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.509 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.509 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.509 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.509 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.509 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.509 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.509 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.509 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.509 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.509 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.510 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.510 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.510 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.510 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.510 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.510 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.510 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.510 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.510 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.510 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.510 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.510 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.511 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.511 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.511 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.511 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.511 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.511 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.511 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.511 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.511 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.511 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.511 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.511 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.511 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.512 INFO:teuthology.orchestra.run.smithi144.stdout: "password": { 2024-09-11T23:22:13.512 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "password", 2024-09-11T23:22:13.512 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.512 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.512 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.512 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.512 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.512 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.512 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.512 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "password of InfluxDB server user", 2024-09-11T23:22:13.512 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.512 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.512 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.513 INFO:teuthology.orchestra.run.smithi144.stdout: "port": { 2024-09-11T23:22:13.513 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "port", 2024-09-11T23:22:13.513 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.513 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.513 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.513 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8086", 2024-09-11T23:22:13.513 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.513 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.513 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.513 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "InfluxDB server port", 2024-09-11T23:22:13.513 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.513 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.513 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.514 INFO:teuthology.orchestra.run.smithi144.stdout: "ssl": { 2024-09-11T23:22:13.514 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ssl", 2024-09-11T23:22:13.514 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.514 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.514 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.514 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "false", 2024-09-11T23:22:13.514 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.516 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.516 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.517 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T23:22:13.517 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.517 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.517 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.517 INFO:teuthology.orchestra.run.smithi144.stdout: "threads": { 2024-09-11T23:22:13.517 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "threads", 2024-09-11T23:22:13.517 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.517 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.517 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.517 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5", 2024-09-11T23:22:13.517 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1", 2024-09-11T23:22:13.518 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "32", 2024-09-11T23:22:13.518 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.518 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T23:22:13.518 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.518 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.518 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.518 INFO:teuthology.orchestra.run.smithi144.stdout: "username": { 2024-09-11T23:22:13.518 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "username", 2024-09-11T23:22:13.518 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.518 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.518 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.518 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.519 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.519 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.519 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.519 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "username of InfluxDB server user", 2024-09-11T23:22:13.519 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.519 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.519 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.519 INFO:teuthology.orchestra.run.smithi144.stdout: "verify_ssl": { 2024-09-11T23:22:13.519 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "verify_ssl", 2024-09-11T23:22:13.519 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.519 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.520 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.520 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "true", 2024-09-11T23:22:13.520 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.520 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.520 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.520 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T23:22:13.520 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.520 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.520 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.520 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.520 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.521 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "insights", 2024-09-11T23:22:13.521 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.521 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.521 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.521 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.521 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.522 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.522 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.522 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.522 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.522 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.523 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.523 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.523 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.523 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.523 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.523 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.524 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.524 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.524 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.524 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.524 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.525 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.525 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.525 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.525 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.526 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.526 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.526 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.526 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.526 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.526 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.527 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.527 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.527 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.527 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.527 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.528 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.528 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.528 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.528 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.529 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.529 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.529 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.529 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.529 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.530 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.530 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.530 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.530 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.530 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.531 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.531 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.531 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.531 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.531 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.531 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.532 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.532 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.532 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.532 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.533 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.533 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.533 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.533 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.533 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.534 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.534 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.534 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.534 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.534 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.534 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.535 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "iostat", 2024-09-11T23:22:13.535 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.535 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.536 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.536 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.536 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.536 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.536 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.537 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.537 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.537 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.537 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.537 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.538 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.538 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.538 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.538 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.538 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.539 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.539 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.539 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.539 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.539 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.540 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.540 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.540 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.540 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.540 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.541 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.541 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.541 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.541 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.541 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.542 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.542 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.542 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.542 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.543 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.543 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.543 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.543 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.543 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.543 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.544 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.544 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.544 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.544 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.545 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.545 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.545 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.545 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.545 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.545 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.546 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.546 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.546 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.546 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.547 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.547 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.547 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.547 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.547 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.548 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.548 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.548 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.548 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.548 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.548 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.548 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.548 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.548 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.548 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.549 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "localpool", 2024-09-11T23:22:13.549 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.549 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.549 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.549 INFO:teuthology.orchestra.run.smithi144.stdout: "failure_domain": { 2024-09-11T23:22:13.549 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "failure_domain", 2024-09-11T23:22:13.549 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.549 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.549 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.549 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "host", 2024-09-11T23:22:13.549 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.550 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.550 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.550 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "failure domain for any created local pool", 2024-09-11T23:22:13.550 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T23:22:13.550 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.550 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.550 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.550 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.550 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.550 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.550 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.550 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.550 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.551 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.551 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.551 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.551 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.551 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.551 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.551 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.551 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.551 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.551 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.551 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.552 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.552 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.552 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.552 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.552 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.552 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.552 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.552 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.552 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.552 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.552 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.552 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.553 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.553 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.553 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.553 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.553 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.553 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.553 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.553 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.553 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.553 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.553 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.553 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.553 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.554 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.554 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.554 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.554 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.554 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.554 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.554 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.554 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.554 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.554 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.554 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.554 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.555 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.555 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.555 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.555 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.555 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.555 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.555 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.555 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.555 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.555 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.555 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.555 INFO:teuthology.orchestra.run.smithi144.stdout: "min_size": { 2024-09-11T23:22:13.555 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "min_size", 2024-09-11T23:22:13.555 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.556 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.556 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.556 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.556 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.556 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.556 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.556 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "default min_size for any created local pool", 2024-09-11T23:22:13.556 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T23:22:13.556 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.556 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.556 INFO:teuthology.orchestra.run.smithi144.stdout: "num_rep": { 2024-09-11T23:22:13.556 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "num_rep", 2024-09-11T23:22:13.557 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.557 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.557 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.557 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "3", 2024-09-11T23:22:13.557 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.557 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.557 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.557 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "default replica count for any created local pool", 2024-09-11T23:22:13.557 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.557 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.557 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.557 INFO:teuthology.orchestra.run.smithi144.stdout: "pg_num": { 2024-09-11T23:22:13.558 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "pg_num", 2024-09-11T23:22:13.558 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.558 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.558 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.558 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "128", 2024-09-11T23:22:13.558 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.558 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.558 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.558 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T23:22:13.558 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.558 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.558 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.558 INFO:teuthology.orchestra.run.smithi144.stdout: "prefix": { 2024-09-11T23:22:13.559 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "prefix", 2024-09-11T23:22:13.559 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.559 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.559 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.559 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.559 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.559 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.559 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.559 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "name prefix for any created local pool", 2024-09-11T23:22:13.559 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.559 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.559 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.560 INFO:teuthology.orchestra.run.smithi144.stdout: "subtree": { 2024-09-11T23:22:13.560 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "subtree", 2024-09-11T23:22:13.560 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.560 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.560 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.560 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "rack", 2024-09-11T23:22:13.560 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.560 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.560 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.560 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T23:22:13.560 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T23:22:13.560 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.561 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.561 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.561 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.561 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mds_autoscaler", 2024-09-11T23:22:13.561 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.561 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.561 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.561 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.561 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.561 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.562 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.562 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.562 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.562 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.562 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.562 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.562 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.562 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.562 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.562 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.562 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.562 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.562 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.562 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.563 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.563 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.563 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.563 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.563 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.563 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.563 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.563 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.563 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.563 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.563 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.563 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.563 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.564 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.564 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.564 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.564 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.564 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.564 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.564 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.564 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.564 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.564 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.564 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.564 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.565 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.565 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.565 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.565 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.565 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.565 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.565 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.565 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.565 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.565 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.565 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.566 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.566 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.566 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.566 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.566 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.566 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.566 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.566 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.566 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.566 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.566 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.566 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.566 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.566 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.567 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.567 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mirroring", 2024-09-11T23:22:13.567 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.567 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.567 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.567 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.567 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.567 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.567 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.567 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.567 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.567 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.567 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.568 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.568 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.568 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.568 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.568 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.568 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.568 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.568 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.568 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.568 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.568 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.568 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.568 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.568 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.569 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.569 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.569 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.569 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.569 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.569 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.569 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.569 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.569 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.569 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.569 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.569 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.569 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.570 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.570 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.570 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.570 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.570 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.570 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.570 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.570 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.570 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.570 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.570 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.570 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.570 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.570 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.571 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.571 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.571 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.571 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.571 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.571 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.571 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.571 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.571 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.571 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.571 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.571 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.571 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.571 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.571 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.572 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.572 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.572 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.572 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.572 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "nfs", 2024-09-11T23:22:13.572 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.572 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.572 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.572 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.572 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.572 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.573 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.573 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.573 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.573 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.573 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.573 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.573 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.573 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.573 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.573 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.573 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.573 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.573 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.574 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.574 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.574 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.574 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.574 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.574 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.574 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.574 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.574 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.574 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.574 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.574 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.574 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.575 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.575 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.575 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.575 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.575 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.575 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.575 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.575 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.575 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.575 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.575 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.575 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.575 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.576 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.576 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.576 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.576 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.576 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.576 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.576 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.576 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.576 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.576 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.576 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.577 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.577 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.577 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.577 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.577 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.577 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.577 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.578 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.578 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.578 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.578 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.578 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.578 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.578 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.578 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.579 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "orchestrator", 2024-09-11T23:22:13.579 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.579 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.579 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.579 INFO:teuthology.orchestra.run.smithi144.stdout: "fail_fs": { 2024-09-11T23:22:13.579 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "fail_fs", 2024-09-11T23:22:13.579 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.580 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.580 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.580 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.580 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.580 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.580 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.580 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T23:22:13.580 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.581 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.581 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.581 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.581 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.581 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.581 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.581 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.582 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.582 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.582 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.582 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.582 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.582 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.582 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.582 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.582 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.583 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.583 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.583 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.583 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.583 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.583 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.583 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.584 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.584 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.584 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.584 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.584 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.584 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.584 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.584 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.585 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.585 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.585 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.585 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.585 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.586 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.586 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.586 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.586 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.586 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.586 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.586 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.586 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.587 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.587 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.587 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.587 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.587 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.587 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.587 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.587 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.587 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.588 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.588 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.588 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.588 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.588 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.588 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.588 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.589 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.589 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.589 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.589 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.589 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.589 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.589 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.589 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.590 INFO:teuthology.orchestra.run.smithi144.stdout: "orchestrator": { 2024-09-11T23:22:13.590 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "orchestrator", 2024-09-11T23:22:13.590 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.590 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.590 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.590 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.590 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.590 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.590 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.590 INFO:teuthology.orchestra.run.smithi144.stdout: "cephadm", 2024-09-11T23:22:13.591 INFO:teuthology.orchestra.run.smithi144.stdout: "rook", 2024-09-11T23:22:13.591 INFO:teuthology.orchestra.run.smithi144.stdout: "test_orchestrator" 2024-09-11T23:22:13.591 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.591 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Orchestrator backend", 2024-09-11T23:22:13.591 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.591 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.591 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.591 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.591 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.591 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "osd_perf_query", 2024-09-11T23:22:13.591 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.591 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.592 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.592 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.592 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.592 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.592 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.592 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.592 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.592 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.592 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.592 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.592 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.592 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.592 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.592 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.593 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.593 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.593 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.593 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.593 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.593 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.593 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.593 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.593 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.593 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.594 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.594 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.594 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.594 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.594 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.594 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.594 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.594 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.594 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.594 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.595 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.595 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.595 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.595 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.595 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.595 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.595 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.595 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.595 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.595 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.595 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.595 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.595 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.596 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.596 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.596 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.596 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.596 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.596 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.596 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.596 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.596 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.596 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.596 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.596 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.597 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.597 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.597 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.597 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.597 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.597 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.597 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.597 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.597 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.597 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.597 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "osd_support", 2024-09-11T23:22:13.597 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.598 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.598 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.598 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.598 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.598 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.598 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.598 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.598 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.598 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.598 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.598 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.598 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.598 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.599 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.599 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.599 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.599 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.599 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.599 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.599 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.599 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.599 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.599 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.599 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.599 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.599 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.600 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.600 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.600 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.600 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.600 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.600 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.600 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.600 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.600 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.601 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.601 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.601 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.601 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.601 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.601 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.601 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.601 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.601 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.601 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.601 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.601 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.602 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.602 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.602 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.602 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.602 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.602 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.602 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.602 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.602 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.603 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.603 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.603 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.603 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.603 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.603 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.603 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.603 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.603 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.603 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.603 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.603 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.603 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.604 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "pg_autoscaler", 2024-09-11T23:22:13.604 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.604 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.604 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.604 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.604 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.604 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.604 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.604 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.604 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.605 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.605 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.605 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.605 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.605 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.605 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.605 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.605 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.605 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.605 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.605 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.605 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.605 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.606 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.607 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.607 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.607 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.607 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.607 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.607 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.607 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.607 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.607 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.607 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.607 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.607 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.607 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.607 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.608 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.608 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.608 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.608 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.608 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.608 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.608 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.608 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.608 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.608 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.608 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.608 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.609 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.609 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.609 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.609 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.609 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.609 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.609 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.609 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.609 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.609 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-11T23:22:13.609 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-11T23:22:13.609 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.609 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.610 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.610 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-11T23:22:13.610 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.610 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.610 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.610 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.610 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.610 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.610 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.610 INFO:teuthology.orchestra.run.smithi144.stdout: "threshold": { 2024-09-11T23:22:13.610 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "threshold", 2024-09-11T23:22:13.610 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-11T23:22:13.610 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.610 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.611 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "3.0", 2024-09-11T23:22:13.611 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1.0", 2024-09-11T23:22:13.611 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.611 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.611 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "scaling threshold", 2024-09-11T23:22:13.611 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T23:22:13.611 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.611 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.611 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.611 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.612 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "progress", 2024-09-11T23:22:13.612 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.612 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.612 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.612 INFO:teuthology.orchestra.run.smithi144.stdout: "allow_pg_recovery_event": { 2024-09-11T23:22:13.612 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "allow_pg_recovery_event", 2024-09-11T23:22:13.612 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.612 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.612 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.612 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.612 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.612 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.612 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.612 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T23:22:13.613 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.613 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.613 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.613 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": { 2024-09-11T23:22:13.613 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "enabled", 2024-09-11T23:22:13.613 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.613 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.613 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.613 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.613 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.613 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.613 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.613 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.614 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.614 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.614 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.614 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.614 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.614 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.614 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.614 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.614 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.614 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.614 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.614 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.615 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.615 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.615 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.615 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.615 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.615 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.615 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.615 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.615 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.615 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.615 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.615 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.615 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.616 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.616 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.616 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.616 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.616 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.616 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.616 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.616 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.616 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.616 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.616 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.616 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.616 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.617 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.617 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.617 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.617 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.617 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.617 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.617 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.617 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.617 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.617 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.617 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.618 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.618 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.618 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.618 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.618 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.618 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.618 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.618 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.618 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.618 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.618 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.618 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.618 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.619 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.619 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.619 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.619 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.619 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.619 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.619 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.619 INFO:teuthology.orchestra.run.smithi144.stdout: "max_completed_events": { 2024-09-11T23:22:13.619 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_completed_events", 2024-09-11T23:22:13.619 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.619 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.619 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.620 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "50", 2024-09-11T23:22:13.620 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.620 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.620 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.620 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "number of past completed events to remember", 2024-09-11T23:22:13.620 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.620 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.620 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.620 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-11T23:22:13.620 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-11T23:22:13.620 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.620 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.620 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.621 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5", 2024-09-11T23:22:13.621 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.621 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.621 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.621 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how long the module is going to sleep", 2024-09-11T23:22:13.621 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.621 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.621 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.621 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "prometheus", 2024-09-11T23:22:13.621 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.622 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.622 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.622 INFO:teuthology.orchestra.run.smithi144.stdout: "cache": { 2024-09-11T23:22:13.622 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cache", 2024-09-11T23:22:13.622 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.622 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.622 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.622 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.622 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.622 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.622 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.622 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.623 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.623 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.623 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.623 INFO:teuthology.orchestra.run.smithi144.stdout: "exclude_perf_counters": { 2024-09-11T23:22:13.623 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "exclude_perf_counters", 2024-09-11T23:22:13.623 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.623 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.623 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.623 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.623 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.623 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.623 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.623 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T23:22:13.623 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T23:22:13.624 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.624 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.624 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.624 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.624 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.624 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.624 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.624 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.624 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.624 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.624 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.624 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.624 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.625 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.625 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.625 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.625 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.625 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.625 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.625 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.625 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.625 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.625 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.625 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.625 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.625 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.626 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.626 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.626 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.626 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.626 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.626 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.626 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.626 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.626 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.626 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.626 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.626 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.627 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.627 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.627 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.627 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.627 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.627 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.627 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.627 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.627 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.627 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.627 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.627 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.627 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.627 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.628 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.628 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.628 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.628 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.628 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.628 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.628 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.628 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.628 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.628 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.628 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.628 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.629 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.629 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.629 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.629 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.629 INFO:teuthology.orchestra.run.smithi144.stdout: "rbd_stats_pools": { 2024-09-11T23:22:13.629 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rbd_stats_pools", 2024-09-11T23:22:13.629 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.629 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.629 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.629 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.629 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.629 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.629 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.630 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.630 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.630 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.630 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.630 INFO:teuthology.orchestra.run.smithi144.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T23:22:13.630 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T23:22:13.630 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.630 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.630 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.630 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "300", 2024-09-11T23:22:13.630 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.630 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.630 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.631 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.631 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.631 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.631 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.631 INFO:teuthology.orchestra.run.smithi144.stdout: "scrape_interval": { 2024-09-11T23:22:13.631 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "scrape_interval", 2024-09-11T23:22:13.631 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-11T23:22:13.631 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.631 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.631 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "15.0", 2024-09-11T23:22:13.631 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.631 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.631 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.632 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.632 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.632 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.632 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.632 INFO:teuthology.orchestra.run.smithi144.stdout: "server_addr": { 2024-09-11T23:22:13.632 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_addr", 2024-09-11T23:22:13.632 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.632 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.632 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.632 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "::", 2024-09-11T23:22:13.632 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.632 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.632 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.633 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T23:22:13.633 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.633 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.633 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.633 INFO:teuthology.orchestra.run.smithi144.stdout: "server_port": { 2024-09-11T23:22:13.633 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_port", 2024-09-11T23:22:13.633 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.633 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.633 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.633 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "9283", 2024-09-11T23:22:13.634 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.634 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.634 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.634 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T23:22:13.634 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.634 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.634 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.634 INFO:teuthology.orchestra.run.smithi144.stdout: "stale_cache_strategy": { 2024-09-11T23:22:13.634 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "stale_cache_strategy", 2024-09-11T23:22:13.634 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.634 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.634 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.634 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "log", 2024-09-11T23:22:13.635 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.635 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.635 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.635 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.635 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.635 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.635 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.635 INFO:teuthology.orchestra.run.smithi144.stdout: "standby_behaviour": { 2024-09-11T23:22:13.635 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "standby_behaviour", 2024-09-11T23:22:13.635 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.636 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.636 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.636 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "default", 2024-09-11T23:22:13.636 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.636 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.636 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.636 INFO:teuthology.orchestra.run.smithi144.stdout: "default", 2024-09-11T23:22:13.636 INFO:teuthology.orchestra.run.smithi144.stdout: "error" 2024-09-11T23:22:13.636 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.636 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.636 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.636 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.636 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.637 INFO:teuthology.orchestra.run.smithi144.stdout: "standby_error_status_code": { 2024-09-11T23:22:13.637 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "standby_error_status_code", 2024-09-11T23:22:13.637 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.637 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.637 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.637 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "500", 2024-09-11T23:22:13.637 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "400", 2024-09-11T23:22:13.637 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "599", 2024-09-11T23:22:13.637 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.637 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.637 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.637 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.637 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.638 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.638 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.638 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rbd_support", 2024-09-11T23:22:13.638 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.638 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.638 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.638 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.638 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.638 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.639 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.639 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.639 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.639 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.639 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.639 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.639 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.639 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.639 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.639 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.639 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.639 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.639 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.639 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.640 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.640 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.640 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.640 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.640 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.640 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.640 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.640 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.640 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.640 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.640 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.640 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.640 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.641 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.641 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.641 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.641 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.641 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.641 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.641 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.641 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.641 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.641 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.641 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.641 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.641 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.641 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.642 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.642 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.642 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.642 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.642 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.642 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.642 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.642 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.642 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.642 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.642 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.642 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.643 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.643 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.643 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.643 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.643 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.643 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.643 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.643 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.643 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.643 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.643 INFO:teuthology.orchestra.run.smithi144.stdout: "max_concurrent_snap_create": { 2024-09-11T23:22:13.643 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_concurrent_snap_create", 2024-09-11T23:22:13.643 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.644 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.644 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.644 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-11T23:22:13.644 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.644 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.644 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.644 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.644 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.644 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.644 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.644 INFO:teuthology.orchestra.run.smithi144.stdout: "mirror_snapshot_schedule": { 2024-09-11T23:22:13.644 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T23:22:13.644 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.645 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.645 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.645 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.645 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.645 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.645 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.645 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.645 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.645 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.645 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.645 INFO:teuthology.orchestra.run.smithi144.stdout: "trash_purge_schedule": { 2024-09-11T23:22:13.645 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "trash_purge_schedule", 2024-09-11T23:22:13.645 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.646 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.646 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.646 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.646 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.646 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.646 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.646 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.646 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.646 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.646 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.646 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.647 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.647 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "restful", 2024-09-11T23:22:13.647 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.647 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.647 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.647 INFO:teuthology.orchestra.run.smithi144.stdout: "enable_auth": { 2024-09-11T23:22:13.647 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "enable_auth", 2024-09-11T23:22:13.647 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.647 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.647 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.647 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.648 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.648 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.648 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.648 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.648 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.648 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.648 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.648 INFO:teuthology.orchestra.run.smithi144.stdout: "key_file": { 2024-09-11T23:22:13.648 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "key_file", 2024-09-11T23:22:13.648 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.648 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.649 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.649 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.649 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.649 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.649 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.649 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.649 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.649 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.649 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.649 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.649 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.649 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.650 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.650 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.650 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.650 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.650 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.650 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.650 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.650 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.650 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.650 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.650 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.650 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.650 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.650 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.650 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.651 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.651 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.651 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.651 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.651 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.651 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.651 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.651 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.651 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.651 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.651 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.651 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.651 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.652 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.652 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.652 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.652 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.652 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.652 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.652 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.652 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.652 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.652 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.652 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.652 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.652 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.653 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.653 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.653 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.653 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.653 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.653 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.653 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.653 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.653 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.653 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.653 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.653 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.653 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.653 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.654 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.654 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.654 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.654 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.654 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.654 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.654 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.654 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.654 INFO:teuthology.orchestra.run.smithi144.stdout: "server_addr": { 2024-09-11T23:22:13.654 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_addr", 2024-09-11T23:22:13.654 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.654 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.654 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.655 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.655 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.655 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.655 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.655 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.655 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.655 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.655 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.655 INFO:teuthology.orchestra.run.smithi144.stdout: "server_port": { 2024-09-11T23:22:13.655 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_port", 2024-09-11T23:22:13.656 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.656 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.656 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.656 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.656 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.656 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.656 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.656 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.656 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.656 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.656 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.657 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rgw", 2024-09-11T23:22:13.657 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.657 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.657 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.657 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.657 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.657 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.657 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.657 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.657 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.658 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.658 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.658 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.658 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.658 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.658 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.658 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.658 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.658 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.658 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.658 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.658 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.658 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.658 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.659 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.659 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.659 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.659 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.659 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.659 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.659 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.659 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.659 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.659 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.659 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.659 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.660 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.660 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.660 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.660 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.660 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.660 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.660 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.660 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.660 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.660 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.660 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.660 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.660 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.661 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.661 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.661 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.661 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.661 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.661 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.661 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.661 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.661 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.661 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.661 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.661 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.661 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.662 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.662 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.662 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.662 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.662 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.662 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.662 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.662 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.662 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.662 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.662 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rook", 2024-09-11T23:22:13.662 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.662 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.663 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.663 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.663 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.663 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.663 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.663 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.663 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.663 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.663 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.663 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.663 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.663 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.663 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.663 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.664 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.664 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.664 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.664 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.664 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.664 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.664 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.664 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.664 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.664 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.664 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.664 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.664 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.665 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.665 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.665 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.665 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.665 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.665 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.665 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.665 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.665 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.665 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.665 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.665 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.665 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.666 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.666 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.666 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.666 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.666 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.666 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.666 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.666 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.666 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.667 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.667 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.667 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.667 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.667 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.668 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.668 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.668 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.668 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.668 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.668 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.668 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.668 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.668 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.668 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.668 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.668 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.669 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.669 INFO:teuthology.orchestra.run.smithi144.stdout: "storage_class": { 2024-09-11T23:22:13.669 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "storage_class", 2024-09-11T23:22:13.669 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.669 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.669 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.669 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "local", 2024-09-11T23:22:13.669 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.669 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.669 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.669 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T23:22:13.669 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.669 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.670 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.670 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.670 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.670 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "selftest", 2024-09-11T23:22:13.670 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.670 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.670 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.670 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.670 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.670 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.670 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.670 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.670 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.671 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.671 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.671 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.671 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.671 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.671 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.671 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.671 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.671 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.671 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.671 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.671 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.671 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.671 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.672 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.672 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.672 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.672 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.672 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.672 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.672 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.672 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.672 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.672 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.672 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.672 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.673 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.673 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.673 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.673 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.673 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.673 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.673 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.673 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.673 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.673 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.673 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.673 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.673 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.674 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.674 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.674 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.674 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.674 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.674 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.674 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.674 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.674 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.674 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.674 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.674 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.674 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.675 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.675 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.675 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.675 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.675 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.675 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.675 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.675 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.675 INFO:teuthology.orchestra.run.smithi144.stdout: "roption1": { 2024-09-11T23:22:13.675 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "roption1", 2024-09-11T23:22:13.675 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.675 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.675 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.676 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.676 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.676 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.676 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.676 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.676 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.676 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.676 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.676 INFO:teuthology.orchestra.run.smithi144.stdout: "roption2": { 2024-09-11T23:22:13.676 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "roption2", 2024-09-11T23:22:13.676 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.676 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.676 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.677 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "xyz", 2024-09-11T23:22:13.677 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.677 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.677 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.677 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.677 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.677 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.677 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.677 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption1": { 2024-09-11T23:22:13.677 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption1", 2024-09-11T23:22:13.677 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.677 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.677 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.678 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.678 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.678 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.678 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.678 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.678 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.678 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.678 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.678 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption2": { 2024-09-11T23:22:13.678 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption2", 2024-09-11T23:22:13.678 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.678 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.678 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.678 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.679 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.679 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.679 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.679 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.679 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.679 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.679 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.679 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption3": { 2024-09-11T23:22:13.679 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption3", 2024-09-11T23:22:13.679 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-11T23:22:13.679 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.679 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.680 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.680 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.680 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.680 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.680 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.680 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.680 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.680 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.680 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption4": { 2024-09-11T23:22:13.680 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption4", 2024-09-11T23:22:13.680 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.680 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.681 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.681 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.681 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.681 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.681 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.681 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.681 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.681 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.681 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.681 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption5": { 2024-09-11T23:22:13.682 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption5", 2024-09-11T23:22:13.682 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.682 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.682 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.682 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.682 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.682 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.682 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.682 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.682 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.682 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.682 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.682 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption6": { 2024-09-11T23:22:13.683 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption6", 2024-09-11T23:22:13.683 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.683 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.683 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.683 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.683 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.683 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.683 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.683 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.683 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.683 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.683 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.683 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption7": { 2024-09-11T23:22:13.684 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption7", 2024-09-11T23:22:13.684 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.684 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.684 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.684 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.684 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1", 2024-09-11T23:22:13.684 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "42", 2024-09-11T23:22:13.684 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.684 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.684 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.684 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.684 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.685 INFO:teuthology.orchestra.run.smithi144.stdout: "testkey": { 2024-09-11T23:22:13.685 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "testkey", 2024-09-11T23:22:13.685 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.685 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.685 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.685 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.685 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.685 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.685 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.685 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.685 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.685 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.686 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.686 INFO:teuthology.orchestra.run.smithi144.stdout: "testlkey": { 2024-09-11T23:22:13.686 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "testlkey", 2024-09-11T23:22:13.686 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.686 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.686 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.686 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.686 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.686 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.686 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.686 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.686 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.686 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.687 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.687 INFO:teuthology.orchestra.run.smithi144.stdout: "testnewline": { 2024-09-11T23:22:13.687 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "testnewline", 2024-09-11T23:22:13.687 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.687 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.687 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.687 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.687 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.687 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.687 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.687 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.687 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.688 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.688 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.688 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.688 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.688 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "snap_schedule", 2024-09-11T23:22:13.688 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.688 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.688 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.688 INFO:teuthology.orchestra.run.smithi144.stdout: "allow_m_granularity": { 2024-09-11T23:22:13.688 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "allow_m_granularity", 2024-09-11T23:22:13.688 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.688 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.689 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.689 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.689 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.689 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.689 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.689 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T23:22:13.689 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.689 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.689 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.690 INFO:teuthology.orchestra.run.smithi144.stdout: "dump_on_update": { 2024-09-11T23:22:13.690 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "dump_on_update", 2024-09-11T23:22:13.690 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.690 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.690 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.691 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.691 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.691 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.691 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.691 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "dump database to debug log on update", 2024-09-11T23:22:13.691 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.692 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.692 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.692 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.692 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.692 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.692 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.692 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.692 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.692 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.692 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.692 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.693 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.693 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.693 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.693 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.693 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.693 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.693 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.693 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.693 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.693 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.694 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.694 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.694 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.694 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.694 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.694 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.694 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.694 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.694 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.694 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.695 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.695 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.695 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.695 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.695 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.695 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.695 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.695 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.695 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.695 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.695 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.695 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.696 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.696 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.696 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.696 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.696 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.696 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.696 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.696 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.696 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.696 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.696 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.696 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.696 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.696 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.697 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.697 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.697 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.697 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.697 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.697 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.697 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.697 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.697 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.697 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.697 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.697 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.697 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.698 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "stats", 2024-09-11T23:22:13.698 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.698 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.698 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.698 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.698 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.698 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.698 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.698 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.698 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.698 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.699 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.699 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.699 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.699 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.699 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.699 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.699 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.699 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.699 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.699 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.699 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.699 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.699 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.699 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.699 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.700 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.700 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.700 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.700 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.700 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.700 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.700 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.700 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.700 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.700 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.700 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.700 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.701 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.701 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.701 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.701 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.701 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.701 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.701 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.701 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.701 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.701 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.701 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.701 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.702 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.702 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.702 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.702 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.702 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.702 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.702 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.702 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.702 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.702 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.703 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.703 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.703 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.703 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.703 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.703 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.703 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.703 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.703 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.703 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.703 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.703 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.704 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "status", 2024-09-11T23:22:13.704 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.704 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.704 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.704 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.704 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.704 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.704 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.704 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.704 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.704 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.704 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.704 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.704 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.705 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.705 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.705 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.705 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.705 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.705 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.705 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.705 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.705 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.705 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.705 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.706 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.706 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.706 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.706 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.706 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.706 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.706 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.706 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.706 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.706 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.706 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.706 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.707 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.707 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.707 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.707 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.707 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.707 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.707 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.707 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.707 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.708 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.708 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.708 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.708 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.708 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.708 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.708 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.708 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.708 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.708 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.708 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.708 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.709 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.709 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.709 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.709 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.709 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.709 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.709 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.709 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.709 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.709 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.709 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.709 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.710 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "telegraf", 2024-09-11T23:22:13.710 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.710 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.710 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.710 INFO:teuthology.orchestra.run.smithi144.stdout: "address": { 2024-09-11T23:22:13.710 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "address", 2024-09-11T23:22:13.710 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.710 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.710 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.710 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T23:22:13.711 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.711 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.711 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.711 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.711 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.711 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.711 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.711 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-11T23:22:13.711 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-11T23:22:13.711 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.711 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.712 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.712 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "15", 2024-09-11T23:22:13.712 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.712 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.712 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.712 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.712 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.712 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.712 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.713 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.713 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.713 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.713 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.713 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.713 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.713 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.713 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.713 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.713 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.713 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.713 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.713 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.713 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.714 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.714 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.714 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.714 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.714 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.714 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.714 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.714 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.714 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.714 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.714 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.714 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.714 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.715 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.715 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.715 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.715 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.715 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.715 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.715 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.715 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.715 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.715 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.715 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.715 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.715 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.716 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.716 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.716 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.716 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.716 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.716 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.717 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.717 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.717 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.717 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.717 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.717 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.717 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.717 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.717 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.717 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.718 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.718 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.718 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.718 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.718 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.718 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.718 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.718 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.718 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.718 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.718 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.718 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.719 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "telemetry", 2024-09-11T23:22:13.719 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.719 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.719 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.719 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_basic": { 2024-09-11T23:22:13.719 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_basic", 2024-09-11T23:22:13.719 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.719 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.720 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.720 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.720 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.720 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.720 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.720 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T23:22:13.720 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.720 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.720 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.721 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_crash": { 2024-09-11T23:22:13.721 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_crash", 2024-09-11T23:22:13.721 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.721 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.721 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.721 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.721 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.721 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.721 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.721 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T23:22:13.721 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.722 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.722 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.722 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_device": { 2024-09-11T23:22:13.722 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_device", 2024-09-11T23:22:13.722 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.722 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.722 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.722 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.722 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.722 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.722 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.722 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T23:22:13.722 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.723 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.723 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.723 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_ident": { 2024-09-11T23:22:13.723 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_ident", 2024-09-11T23:22:13.723 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.723 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.723 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.723 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.723 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.723 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.723 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.723 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T23:22:13.723 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.724 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.724 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.724 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_perf": { 2024-09-11T23:22:13.724 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_perf", 2024-09-11T23:22:13.724 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.724 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.724 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.724 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.724 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.724 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.724 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.724 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T23:22:13.725 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.725 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.725 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.725 INFO:teuthology.orchestra.run.smithi144.stdout: "contact": { 2024-09-11T23:22:13.725 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "contact", 2024-09-11T23:22:13.725 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.725 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.725 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.725 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.725 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.725 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.725 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.726 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.726 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.726 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.726 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.726 INFO:teuthology.orchestra.run.smithi144.stdout: "description": { 2024-09-11T23:22:13.726 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "description", 2024-09-11T23:22:13.726 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.726 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.726 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.726 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.726 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.726 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.727 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.727 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.727 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.727 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.727 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.727 INFO:teuthology.orchestra.run.smithi144.stdout: "device_url": { 2024-09-11T23:22:13.727 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "device_url", 2024-09-11T23:22:13.727 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.727 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.727 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.727 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T23:22:13.727 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.727 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.728 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.728 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.728 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.728 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.728 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.728 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": { 2024-09-11T23:22:13.728 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "enabled", 2024-09-11T23:22:13.728 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.728 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.728 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.728 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.728 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.729 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.729 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.729 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.729 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.729 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.729 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.729 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-11T23:22:13.729 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-11T23:22:13.729 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.729 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.729 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.729 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "24", 2024-09-11T23:22:13.730 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "8", 2024-09-11T23:22:13.730 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.730 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.730 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.730 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.730 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.730 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.730 INFO:teuthology.orchestra.run.smithi144.stdout: "last_opt_revision": { 2024-09-11T23:22:13.730 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "last_opt_revision", 2024-09-11T23:22:13.730 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.730 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.730 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.730 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "1", 2024-09-11T23:22:13.731 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.731 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.731 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.731 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.731 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.731 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.731 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.731 INFO:teuthology.orchestra.run.smithi144.stdout: "leaderboard": { 2024-09-11T23:22:13.731 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "leaderboard", 2024-09-11T23:22:13.731 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.731 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.731 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.731 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.732 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.732 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.732 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.732 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.732 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.732 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.732 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.732 INFO:teuthology.orchestra.run.smithi144.stdout: "leaderboard_description": { 2024-09-11T23:22:13.732 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "leaderboard_description", 2024-09-11T23:22:13.732 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.732 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.732 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.732 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.733 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.733 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.733 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.733 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.733 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.733 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.733 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.733 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.733 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.733 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.733 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.734 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.734 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.734 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.734 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.734 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.734 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.734 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.734 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.734 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.734 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.735 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.735 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.735 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.735 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.735 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.735 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.735 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.735 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.735 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.735 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.735 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.735 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.736 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.736 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.736 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.736 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.736 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.736 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.736 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.736 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.736 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.736 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.736 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.736 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.737 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.737 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.737 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.737 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.737 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.737 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.737 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.737 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.737 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.737 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.737 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.737 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.737 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.738 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.738 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.738 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.738 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.738 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.738 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.738 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.738 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.738 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.738 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.738 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.738 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.738 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.739 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.739 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.739 INFO:teuthology.orchestra.run.smithi144.stdout: "organization": { 2024-09-11T23:22:13.739 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "organization", 2024-09-11T23:22:13.739 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.739 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.739 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.739 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.739 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.739 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.740 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.740 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.740 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.740 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.740 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.740 INFO:teuthology.orchestra.run.smithi144.stdout: "proxy": { 2024-09-11T23:22:13.740 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "proxy", 2024-09-11T23:22:13.740 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.740 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.740 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.740 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.740 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.740 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "url": { 2024-09-11T23:22:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "url", 2024-09-11T23:22:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T23:22:13.741 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "test_orchestrator", 2024-09-11T23:22:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.742 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.743 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.744 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.745 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.746 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.748 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.749 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "volumes", 2024-09-11T23:22:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.751 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.752 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.753 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.754 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.756 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "max_concurrent_clones": { 2024-09-11T23:22:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_concurrent_clones", 2024-09-11T23:22:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "4", 2024-09-11T23:22:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.757 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T23:22:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "periodic_async_work": { 2024-09-11T23:22:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "periodic_async_work", 2024-09-11T23:22:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.758 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Periodically check for async work", 2024-09-11T23:22:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "snapshot_clone_delay": { 2024-09-11T23:22:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "snapshot_clone_delay", 2024-09-11T23:22:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-11T23:22:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.759 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T23:22:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "snapshot_clone_no_wait": { 2024-09-11T23:22:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T23:22:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.760 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T23:22:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.761 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "zabbix", 2024-09-11T23:22:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "discovery_interval": { 2024-09-11T23:22:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "discovery_interval", 2024-09-11T23:22:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-11T23:22:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.762 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "100", 2024-09-11T23:22:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "identifier": { 2024-09-11T23:22:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "identifier", 2024-09-11T23:22:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.763 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.764 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.764 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.764 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.764 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.764 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.765 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.765 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.765 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.765 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-11T23:22:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-11T23:22:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.766 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-11T23:22:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.767 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.768 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.768 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.768 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.768 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.768 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.769 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.771 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.772 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.772 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.772 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.772 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.772 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.772 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.772 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.773 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "zabbix_host": { 2024-09-11T23:22:13.774 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "zabbix_host", 2024-09-11T23:22:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.775 INFO:teuthology.orchestra.run.smithi144.stdout: "zabbix_port": { 2024-09-11T23:22:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "zabbix_port", 2024-09-11T23:22:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10051", 2024-09-11T23:22:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.776 INFO:teuthology.orchestra.run.smithi144.stdout: "zabbix_sender": { 2024-09-11T23:22:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "zabbix_sender", 2024-09-11T23:22:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T23:22:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.777 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:22:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: "modules": [ 2024-09-11T23:22:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: "iostat", 2024-09-11T23:22:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: "nfs", 2024-09-11T23:22:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: "restful" 2024-09-11T23:22:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: "available_modules": [ 2024-09-11T23:22:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "alerts", 2024-09-11T23:22:13.778 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-11T23:22:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-11T23:22:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-11T23:22:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T23:22:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.779 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.780 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.781 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.782 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.783 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.784 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_destination": { 2024-09-11T23:22:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_destination", 2024-09-11T23:22:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.785 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Email address to send alerts to", 2024-09-11T23:22:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_from_name": { 2024-09-11T23:22:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_from_name", 2024-09-11T23:22:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "Ceph", 2024-09-11T23:22:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.786 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Email From: name", 2024-09-11T23:22:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_host": { 2024-09-11T23:22:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_host", 2024-09-11T23:22:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.787 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "SMTP server", 2024-09-11T23:22:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_password": { 2024-09-11T23:22:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_password", 2024-09-11T23:22:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.788 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Password to authenticate with", 2024-09-11T23:22:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_port": { 2024-09-11T23:22:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_port", 2024-09-11T23:22:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.789 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "465", 2024-09-11T23:22:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "SMTP port", 2024-09-11T23:22:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_sender": { 2024-09-11T23:22:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_sender", 2024-09-11T23:22:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.790 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "SMTP envelope sender", 2024-09-11T23:22:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_ssl": { 2024-09-11T23:22:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_ssl", 2024-09-11T23:22:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.791 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T23:22:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "smtp_user": { 2024-09-11T23:22:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "smtp_user", 2024-09-11T23:22:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.792 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "User to authenticate as", 2024-09-11T23:22:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "balancer", 2024-09-11T23:22:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: "active": { 2024-09-11T23:22:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "active", 2024-09-11T23:22:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.794 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.795 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T23:22:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "begin_time": { 2024-09-11T23:22:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "begin_time", 2024-09-11T23:22:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.796 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0000", 2024-09-11T23:22:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T23:22:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T23:22:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "begin_weekday": { 2024-09-11T23:22:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "begin_weekday", 2024-09-11T23:22:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-11T23:22:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-11T23:22:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "0", 2024-09-11T23:22:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "6", 2024-09-11T23:22:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T23:22:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T23:22:13.798 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "crush_compat_max_iterations": { 2024-09-11T23:22:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crush_compat_max_iterations", 2024-09-11T23:22:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-11T23:22:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "25", 2024-09-11T23:22:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1", 2024-09-11T23:22:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "250", 2024-09-11T23:22:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T23:22:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.799 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "crush_compat_metrics": { 2024-09-11T23:22:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crush_compat_metrics", 2024-09-11T23:22:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T23:22:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T23:22:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T23:22:13.800 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "crush_compat_step": { 2024-09-11T23:22:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crush_compat_step", 2024-09-11T23:22:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-11T23:22:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0.5", 2024-09-11T23:22:13.801 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "0.001", 2024-09-11T23:22:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "0.999", 2024-09-11T23:22:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "aggressiveness of optimization", 2024-09-11T23:22:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T23:22:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "end_time": { 2024-09-11T23:22:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "end_time", 2024-09-11T23:22:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "2359", 2024-09-11T23:22:13.802 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T23:22:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T23:22:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "end_weekday": { 2024-09-11T23:22:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "end_weekday", 2024-09-11T23:22:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-11T23:22:13.803 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-11T23:22:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "0", 2024-09-11T23:22:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "6", 2024-09-11T23:22:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T23:22:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T23:22:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.804 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.805 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.806 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.807 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.808 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.809 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.810 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.811 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.812 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.813 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: "min_score": { 2024-09-11T23:22:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "min_score", 2024-09-11T23:22:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-11T23:22:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-11T23:22:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T23:22:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": { 2024-09-11T23:22:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mode", 2024-09-11T23:22:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "upmap", 2024-09-11T23:22:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "crush-compat", 2024-09-11T23:22:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "none", 2024-09-11T23:22:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "read", 2024-09-11T23:22:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "upmap", 2024-09-11T23:22:13.816 INFO:teuthology.orchestra.run.smithi144.stdout: "upmap-read" 2024-09-11T23:22:13.817 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.817 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Balancer mode", 2024-09-11T23:22:13.817 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.817 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.817 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.817 INFO:teuthology.orchestra.run.smithi144.stdout: "pool_ids": { 2024-09-11T23:22:13.817 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "pool_ids", 2024-09-11T23:22:13.817 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.817 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.817 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.817 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.817 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T23:22:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-11T23:22:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-11T23:22:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-11T23:22:13.818 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.819 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.819 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.819 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T23:22:13.819 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.819 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.819 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.819 INFO:teuthology.orchestra.run.smithi144.stdout: "upmap_max_deviation": { 2024-09-11T23:22:13.819 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "upmap_max_deviation", 2024-09-11T23:22:13.819 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.820 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.820 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.820 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5", 2024-09-11T23:22:13.820 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1", 2024-09-11T23:22:13.820 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.820 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.820 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T23:22:13.820 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T23:22:13.820 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.820 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.820 INFO:teuthology.orchestra.run.smithi144.stdout: "upmap_max_optimizations": { 2024-09-11T23:22:13.820 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "upmap_max_optimizations", 2024-09-11T23:22:13.821 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-11T23:22:13.821 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.821 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.821 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-11T23:22:13.821 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.821 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.821 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.821 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T23:22:13.821 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.821 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.821 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.821 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.821 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.822 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephadm", 2024-09-11T23:22:13.822 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.822 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.822 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.822 INFO:teuthology.orchestra.run.smithi144.stdout: "agent_down_multiplier": { 2024-09-11T23:22:13.822 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "agent_down_multiplier", 2024-09-11T23:22:13.822 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-11T23:22:13.822 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.822 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.822 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "3.0", 2024-09-11T23:22:13.822 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.822 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.823 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.823 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T23:22:13.823 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.823 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.823 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.823 INFO:teuthology.orchestra.run.smithi144.stdout: "agent_refresh_rate": { 2024-09-11T23:22:13.823 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "agent_refresh_rate", 2024-09-11T23:22:13.823 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.823 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.823 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.823 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "20", 2024-09-11T23:22:13.823 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.824 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.824 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.824 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T23:22:13.824 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.824 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.824 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.824 INFO:teuthology.orchestra.run.smithi144.stdout: "agent_starting_port": { 2024-09-11T23:22:13.824 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "agent_starting_port", 2024-09-11T23:22:13.824 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.824 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.824 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.825 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "4721", 2024-09-11T23:22:13.825 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.825 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.825 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.825 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T23:22:13.825 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.825 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.825 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.825 INFO:teuthology.orchestra.run.smithi144.stdout: "allow_ptrace": { 2024-09-11T23:22:13.825 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "allow_ptrace", 2024-09-11T23:22:13.825 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.825 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.826 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.826 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.826 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.826 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.826 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.826 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T23:22:13.826 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T23:22:13.826 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.826 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.826 INFO:teuthology.orchestra.run.smithi144.stdout: "autotune_interval": { 2024-09-11T23:22:13.826 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "autotune_interval", 2024-09-11T23:22:13.826 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.827 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.827 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.827 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-11T23:22:13.827 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.827 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.827 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.827 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T23:22:13.827 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.827 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.827 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.827 INFO:teuthology.orchestra.run.smithi144.stdout: "autotune_memory_target_ratio": { 2024-09-11T23:22:13.827 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T23:22:13.828 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-11T23:22:13.828 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.828 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.828 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0.7", 2024-09-11T23:22:13.828 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.828 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.828 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.828 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T23:22:13.828 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.828 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.828 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.829 INFO:teuthology.orchestra.run.smithi144.stdout: "cephadm_log_destination": { 2024-09-11T23:22:13.829 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephadm_log_destination", 2024-09-11T23:22:13.829 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.829 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.829 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.829 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.829 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.829 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.829 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.829 INFO:teuthology.orchestra.run.smithi144.stdout: "file", 2024-09-11T23:22:13.829 INFO:teuthology.orchestra.run.smithi144.stdout: "file,syslog", 2024-09-11T23:22:13.829 INFO:teuthology.orchestra.run.smithi144.stdout: "syslog" 2024-09-11T23:22:13.829 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.829 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T23:22:13.830 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.830 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.830 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.830 INFO:teuthology.orchestra.run.smithi144.stdout: "cgroups_split": { 2024-09-11T23:22:13.830 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cgroups_split", 2024-09-11T23:22:13.830 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.830 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.830 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.830 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.830 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.830 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.830 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.830 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T23:22:13.831 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.831 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.831 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.831 INFO:teuthology.orchestra.run.smithi144.stdout: "config_checks_enabled": { 2024-09-11T23:22:13.831 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "config_checks_enabled", 2024-09-11T23:22:13.831 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.831 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.831 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.831 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.832 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.832 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.832 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.832 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T23:22:13.832 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.832 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.832 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.832 INFO:teuthology.orchestra.run.smithi144.stdout: "config_dashboard": { 2024-09-11T23:22:13.832 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "config_dashboard", 2024-09-11T23:22:13.832 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.832 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.833 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.833 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.833 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.833 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.833 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.833 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T23:22:13.833 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.833 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.833 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.833 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_alertmanager": { 2024-09-11T23:22:13.833 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_alertmanager", 2024-09-11T23:22:13.833 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.833 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.834 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.834 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-11T23:22:13.834 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.834 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.834 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.834 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Prometheus container image", 2024-09-11T23:22:13.834 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.834 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.834 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.834 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_base": { 2024-09-11T23:22:13.834 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_base", 2024-09-11T23:22:13.834 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.834 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.835 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.835 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T23:22:13.835 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.835 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.835 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.835 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Container image name, without the tag", 2024-09-11T23:22:13.835 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.835 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.835 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.835 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_elasticsearch": { 2024-09-11T23:22:13.835 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_elasticsearch", 2024-09-11T23:22:13.836 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.836 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.836 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.836 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T23:22:13.836 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.836 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.836 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.836 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "elasticsearch container image", 2024-09-11T23:22:13.836 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.836 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.836 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.836 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_grafana": { 2024-09-11T23:22:13.837 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_grafana", 2024-09-11T23:22:13.837 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.837 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.837 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.837 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-11T23:22:13.837 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.837 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.837 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.837 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Prometheus container image", 2024-09-11T23:22:13.837 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.837 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.837 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.837 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_haproxy": { 2024-09-11T23:22:13.838 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_haproxy", 2024-09-11T23:22:13.838 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.838 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.838 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.838 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T23:22:13.838 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.838 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.838 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.838 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "HAproxy container image", 2024-09-11T23:22:13.838 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.838 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.838 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.838 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_jaeger_agent": { 2024-09-11T23:22:13.839 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_jaeger_agent", 2024-09-11T23:22:13.839 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.839 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.839 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.839 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T23:22:13.839 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.839 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.839 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.839 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Jaeger agent container image", 2024-09-11T23:22:13.839 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.839 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.839 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.839 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_jaeger_collector": { 2024-09-11T23:22:13.840 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_jaeger_collector", 2024-09-11T23:22:13.840 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.840 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.840 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.840 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T23:22:13.840 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.840 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.840 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.840 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Jaeger collector container image", 2024-09-11T23:22:13.840 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.840 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.840 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.841 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_jaeger_query": { 2024-09-11T23:22:13.841 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_jaeger_query", 2024-09-11T23:22:13.841 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.841 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.841 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.841 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T23:22:13.841 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.841 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.841 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.841 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Jaeger query container image", 2024-09-11T23:22:13.841 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.841 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.842 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.842 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_keepalived": { 2024-09-11T23:22:13.842 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_keepalived", 2024-09-11T23:22:13.842 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.842 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.842 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.842 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T23:22:13.842 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.842 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.842 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.842 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Keepalived container image", 2024-09-11T23:22:13.842 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.842 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.843 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.843 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_loki": { 2024-09-11T23:22:13.843 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_loki", 2024-09-11T23:22:13.843 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.843 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.843 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.843 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T23:22:13.843 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.843 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.843 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.843 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Loki container image", 2024-09-11T23:22:13.843 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.843 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.844 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.844 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_node_exporter": { 2024-09-11T23:22:13.844 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_node_exporter", 2024-09-11T23:22:13.844 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.844 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.844 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.844 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-11T23:22:13.844 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.844 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.844 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.845 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Prometheus container image", 2024-09-11T23:22:13.845 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.845 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.845 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.845 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_nvmeof": { 2024-09-11T23:22:13.845 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_nvmeof", 2024-09-11T23:22:13.845 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.845 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.845 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.845 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-11T23:22:13.845 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.846 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.846 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.846 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Nvme-of container image", 2024-09-11T23:22:13.846 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.846 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.846 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.846 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_prometheus": { 2024-09-11T23:22:13.846 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_prometheus", 2024-09-11T23:22:13.846 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.846 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.846 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.846 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-11T23:22:13.847 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.847 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.847 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.847 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Prometheus container image", 2024-09-11T23:22:13.847 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.847 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.847 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.847 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_promtail": { 2024-09-11T23:22:13.847 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_promtail", 2024-09-11T23:22:13.847 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.848 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.848 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.848 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T23:22:13.848 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.848 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.848 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.848 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Promtail container image", 2024-09-11T23:22:13.848 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.848 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.848 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.848 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_samba": { 2024-09-11T23:22:13.849 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_samba", 2024-09-11T23:22:13.849 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.849 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.849 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.849 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T23:22:13.849 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.849 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.849 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.849 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Samba/SMB container image", 2024-09-11T23:22:13.849 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.849 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.849 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.850 INFO:teuthology.orchestra.run.smithi144.stdout: "container_image_snmp_gateway": { 2024-09-11T23:22:13.850 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_image_snmp_gateway", 2024-09-11T23:22:13.850 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.850 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.850 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.850 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T23:22:13.850 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.850 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.850 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.850 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "SNMP Gateway container image", 2024-09-11T23:22:13.850 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.850 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.850 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.851 INFO:teuthology.orchestra.run.smithi144.stdout: "container_init": { 2024-09-11T23:22:13.851 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "container_init", 2024-09-11T23:22:13.851 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.851 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.851 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.851 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.851 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.851 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.851 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.851 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T23:22:13.851 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.851 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.851 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.852 INFO:teuthology.orchestra.run.smithi144.stdout: "daemon_cache_timeout": { 2024-09-11T23:22:13.852 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "daemon_cache_timeout", 2024-09-11T23:22:13.852 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.852 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.852 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.852 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-11T23:22:13.852 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.852 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.852 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.852 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T23:22:13.852 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.852 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.853 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.853 INFO:teuthology.orchestra.run.smithi144.stdout: "default_cephadm_command_timeout": { 2024-09-11T23:22:13.853 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T23:22:13.853 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.853 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.853 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.853 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "900", 2024-09-11T23:22:13.853 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.853 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.853 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.853 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T23:22:13.853 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.853 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.854 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.854 INFO:teuthology.orchestra.run.smithi144.stdout: "default_registry": { 2024-09-11T23:22:13.854 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "default_registry", 2024-09-11T23:22:13.854 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.854 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.854 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.854 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "docker.io", 2024-09-11T23:22:13.854 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.854 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.854 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.854 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T23:22:13.854 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.854 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.855 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.855 INFO:teuthology.orchestra.run.smithi144.stdout: "device_cache_timeout": { 2024-09-11T23:22:13.855 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "device_cache_timeout", 2024-09-11T23:22:13.855 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.855 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.855 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.855 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "1800", 2024-09-11T23:22:13.855 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.855 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.855 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.855 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "seconds to cache device inventory", 2024-09-11T23:22:13.855 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.855 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.856 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.856 INFO:teuthology.orchestra.run.smithi144.stdout: "device_enhanced_scan": { 2024-09-11T23:22:13.856 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "device_enhanced_scan", 2024-09-11T23:22:13.856 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.856 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.856 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.856 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.856 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.856 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.856 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.856 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T23:22:13.856 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.856 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.857 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.857 INFO:teuthology.orchestra.run.smithi144.stdout: "facts_cache_timeout": { 2024-09-11T23:22:13.857 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "facts_cache_timeout", 2024-09-11T23:22:13.857 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.857 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.857 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.857 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-11T23:22:13.857 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.857 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.857 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.858 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "seconds to cache host facts data", 2024-09-11T23:22:13.858 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.858 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.858 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.858 INFO:teuthology.orchestra.run.smithi144.stdout: "grafana_dashboards_path": { 2024-09-11T23:22:13.858 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "grafana_dashboards_path", 2024-09-11T23:22:13.858 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.858 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.858 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.858 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T23:22:13.858 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.858 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.858 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.859 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T23:22:13.859 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.859 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.859 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.859 INFO:teuthology.orchestra.run.smithi144.stdout: "host_check_interval": { 2024-09-11T23:22:13.859 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "host_check_interval", 2024-09-11T23:22:13.859 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.859 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.859 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.859 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-11T23:22:13.859 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.859 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.859 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.860 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to perform a host check", 2024-09-11T23:22:13.860 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.860 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.860 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.860 INFO:teuthology.orchestra.run.smithi144.stdout: "hw_monitoring": { 2024-09-11T23:22:13.860 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "hw_monitoring", 2024-09-11T23:22:13.860 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.860 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.860 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.860 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.860 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.860 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.861 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.861 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T23:22:13.861 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.861 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.861 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.861 INFO:teuthology.orchestra.run.smithi144.stdout: "inventory_list_all": { 2024-09-11T23:22:13.861 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "inventory_list_all", 2024-09-11T23:22:13.861 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.861 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.861 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.861 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.861 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.862 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.862 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.862 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T23:22:13.862 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.862 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.862 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.862 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.862 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.862 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.862 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.862 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.862 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.862 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.863 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.863 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.863 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.863 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.863 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.863 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.863 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.863 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.863 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.863 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.863 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.863 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.863 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.863 INFO:teuthology.orchestra.run.smithi144.stdout: "log_refresh_metadata": { 2024-09-11T23:22:13.864 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_refresh_metadata", 2024-09-11T23:22:13.864 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.864 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.864 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.864 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.864 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.864 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.864 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.864 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T23:22:13.864 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.864 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.864 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.865 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.865 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.865 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.865 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.865 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.865 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.865 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.865 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.865 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.865 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T23:22:13.865 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.865 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.865 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.866 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.866 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.866 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.866 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.866 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.866 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.866 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.866 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.866 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.866 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.866 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.866 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.866 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.866 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.866 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.867 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.867 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.867 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.867 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.867 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.867 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.867 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.867 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.867 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.867 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.867 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.867 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.867 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.868 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.868 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.868 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.868 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.868 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.868 INFO:teuthology.orchestra.run.smithi144.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T23:22:13.868 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T23:22:13.868 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.868 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.869 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.869 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.869 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.869 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.869 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.869 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T23:22:13.869 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.869 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.869 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.869 INFO:teuthology.orchestra.run.smithi144.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T23:22:13.869 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T23:22:13.870 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.870 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.870 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.870 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "*", 2024-09-11T23:22:13.870 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.870 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.870 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.870 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T23:22:13.870 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.870 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.870 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.870 INFO:teuthology.orchestra.run.smithi144.stdout: "max_count_per_host": { 2024-09-11T23:22:13.871 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_count_per_host", 2024-09-11T23:22:13.871 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.871 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.871 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.871 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-11T23:22:13.871 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.871 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.871 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.871 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "max number of daemons per service per host", 2024-09-11T23:22:13.871 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.871 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.871 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.871 INFO:teuthology.orchestra.run.smithi144.stdout: "max_osd_draining_count": { 2024-09-11T23:22:13.872 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_osd_draining_count", 2024-09-11T23:22:13.872 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.872 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.872 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.872 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-11T23:22:13.872 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.872 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.872 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.872 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T23:22:13.872 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.872 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.872 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.873 INFO:teuthology.orchestra.run.smithi144.stdout: "migration_current": { 2024-09-11T23:22:13.873 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "migration_current", 2024-09-11T23:22:13.873 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.873 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.873 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.873 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.873 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.873 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.873 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.873 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "internal - do not modify", 2024-09-11T23:22:13.873 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.874 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.874 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.874 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": { 2024-09-11T23:22:13.874 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mode", 2024-09-11T23:22:13.874 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.874 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.874 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.875 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "root", 2024-09-11T23:22:13.875 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.875 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.875 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.875 INFO:teuthology.orchestra.run.smithi144.stdout: "cephadm-package", 2024-09-11T23:22:13.875 INFO:teuthology.orchestra.run.smithi144.stdout: "root" 2024-09-11T23:22:13.875 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.875 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T23:22:13.876 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.876 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.876 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.876 INFO:teuthology.orchestra.run.smithi144.stdout: "oob_default_addr": { 2024-09-11T23:22:13.876 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "oob_default_addr", 2024-09-11T23:22:13.876 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.876 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.877 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.877 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "169.254.1.1", 2024-09-11T23:22:13.877 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.877 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.877 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.877 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T23:22:13.877 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.878 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.878 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.878 INFO:teuthology.orchestra.run.smithi144.stdout: "prometheus_alerts_path": { 2024-09-11T23:22:13.878 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "prometheus_alerts_path", 2024-09-11T23:22:13.878 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.878 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.878 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.879 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T23:22:13.879 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.879 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.879 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.879 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T23:22:13.879 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.879 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.879 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.880 INFO:teuthology.orchestra.run.smithi144.stdout: "registry_insecure": { 2024-09-11T23:22:13.880 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "registry_insecure", 2024-09-11T23:22:13.880 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.880 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.880 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.880 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.881 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.881 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.881 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.881 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T23:22:13.881 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.881 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.881 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.882 INFO:teuthology.orchestra.run.smithi144.stdout: "registry_password": { 2024-09-11T23:22:13.882 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "registry_password", 2024-09-11T23:22:13.882 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.882 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.882 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.882 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.882 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.882 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.883 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.883 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T23:22:13.883 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.883 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.883 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.883 INFO:teuthology.orchestra.run.smithi144.stdout: "registry_url": { 2024-09-11T23:22:13.883 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "registry_url", 2024-09-11T23:22:13.883 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.883 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.883 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.883 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.883 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.884 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.884 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.884 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T23:22:13.884 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.884 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.884 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.884 INFO:teuthology.orchestra.run.smithi144.stdout: "registry_username": { 2024-09-11T23:22:13.884 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "registry_username", 2024-09-11T23:22:13.884 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.884 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.884 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.884 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.885 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.885 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.885 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.885 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T23:22:13.885 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.885 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.885 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.885 INFO:teuthology.orchestra.run.smithi144.stdout: "secure_monitoring_stack": { 2024-09-11T23:22:13.885 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "secure_monitoring_stack", 2024-09-11T23:22:13.885 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.885 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.885 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.885 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.886 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.886 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.886 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.886 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T23:22:13.886 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.886 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.886 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.886 INFO:teuthology.orchestra.run.smithi144.stdout: "service_discovery_port": { 2024-09-11T23:22:13.886 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "service_discovery_port", 2024-09-11T23:22:13.886 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.886 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.886 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.886 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8765", 2024-09-11T23:22:13.887 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.887 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.887 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.887 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "cephadm service discovery port", 2024-09-11T23:22:13.887 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.887 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.887 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.887 INFO:teuthology.orchestra.run.smithi144.stdout: "ssh_config_file": { 2024-09-11T23:22:13.887 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ssh_config_file", 2024-09-11T23:22:13.887 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.887 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.887 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.887 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.888 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.888 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.888 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.888 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T23:22:13.888 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.888 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.888 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.888 INFO:teuthology.orchestra.run.smithi144.stdout: "use_agent": { 2024-09-11T23:22:13.888 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "use_agent", 2024-09-11T23:22:13.888 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.888 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.889 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.889 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.889 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.889 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.889 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.889 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T23:22:13.890 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.890 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.890 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.890 INFO:teuthology.orchestra.run.smithi144.stdout: "use_repo_digest": { 2024-09-11T23:22:13.890 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "use_repo_digest", 2024-09-11T23:22:13.890 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.890 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.890 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.890 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.890 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.890 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.891 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.891 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T23:22:13.891 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.891 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.891 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.891 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_on_failed_host_check": { 2024-09-11T23:22:13.891 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_on_failed_host_check", 2024-09-11T23:22:13.891 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.891 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.891 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.891 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.892 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.892 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.892 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.892 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T23:22:13.892 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.892 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.892 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.892 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_on_stray_daemons": { 2024-09-11T23:22:13.892 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_on_stray_daemons", 2024-09-11T23:22:13.892 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.892 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.893 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.893 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.893 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.893 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.893 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.893 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T23:22:13.893 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.893 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.893 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.893 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_on_stray_hosts": { 2024-09-11T23:22:13.893 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_on_stray_hosts", 2024-09-11T23:22:13.893 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.894 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.894 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.894 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.894 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.894 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.894 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.894 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T23:22:13.894 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.894 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.895 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.895 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crash", 2024-09-11T23:22:13.895 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.895 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.895 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.895 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.895 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.895 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.895 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.896 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.896 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.896 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.896 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.896 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.896 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.896 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.896 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.896 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.897 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.897 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.897 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.897 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.897 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.897 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.897 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.897 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.897 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.897 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.897 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.897 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.897 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.898 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.898 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.898 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.898 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.898 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.898 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.898 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.898 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.898 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.898 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.898 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.898 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.899 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.899 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.899 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.899 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.899 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.899 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.899 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.899 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.899 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.899 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.899 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.899 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.899 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.899 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.900 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.900 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.900 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.900 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.900 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.900 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.900 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.900 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.900 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.900 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.900 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.900 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.900 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.901 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.901 INFO:teuthology.orchestra.run.smithi144.stdout: "retain_interval": { 2024-09-11T23:22:13.901 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "retain_interval", 2024-09-11T23:22:13.901 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.901 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.901 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.901 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "31536000", 2024-09-11T23:22:13.901 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.901 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.901 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.902 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T23:22:13.902 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.902 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.902 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.902 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_recent_interval": { 2024-09-11T23:22:13.902 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_recent_interval", 2024-09-11T23:22:13.902 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.902 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.902 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.903 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "1209600", 2024-09-11T23:22:13.903 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.903 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.903 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.903 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T23:22:13.903 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.903 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.903 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.903 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.903 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.904 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "dashboard", 2024-09-11T23:22:13.904 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.904 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.904 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.904 INFO:teuthology.orchestra.run.smithi144.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T23:22:13.904 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T23:22:13.904 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.904 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.904 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.904 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-11T23:22:13.904 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.904 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.904 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.905 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.905 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.905 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.905 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.905 INFO:teuthology.orchestra.run.smithi144.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T23:22:13.905 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T23:22:13.905 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.905 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.905 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.905 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.905 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.905 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.906 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.906 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.906 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.906 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.906 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.906 INFO:teuthology.orchestra.run.smithi144.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T23:22:13.906 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T23:22:13.906 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.906 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.906 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.906 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.906 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.906 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.907 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.907 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.907 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.907 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.907 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.907 INFO:teuthology.orchestra.run.smithi144.stdout: "AUDIT_API_ENABLED": { 2024-09-11T23:22:13.907 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T23:22:13.907 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.907 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.907 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.907 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.907 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.907 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.908 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.908 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.908 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.908 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.908 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.908 INFO:teuthology.orchestra.run.smithi144.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T23:22:13.908 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T23:22:13.908 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.908 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.909 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.909 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.909 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.909 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.909 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.909 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.909 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.909 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.909 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.910 INFO:teuthology.orchestra.run.smithi144.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T23:22:13.910 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T23:22:13.910 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.910 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.910 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.910 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.910 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.910 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.910 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.910 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.910 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.910 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.910 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.911 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T23:22:13.911 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T23:22:13.911 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.911 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.911 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.911 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.911 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.911 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.911 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.911 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.911 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.911 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.911 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.912 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T23:22:13.912 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T23:22:13.912 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.912 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.912 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.912 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.912 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.912 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.912 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.912 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.913 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.913 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.913 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.913 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T23:22:13.913 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T23:22:13.913 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.913 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.913 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.913 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.913 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.913 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.913 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.914 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.914 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.914 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.914 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.914 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T23:22:13.914 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T23:22:13.914 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.914 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.914 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.915 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.915 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.915 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.915 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.915 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.915 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.915 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.915 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.915 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T23:22:13.915 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T23:22:13.915 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.915 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.915 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.916 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.916 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.916 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.916 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.916 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.916 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.916 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.916 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.916 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T23:22:13.916 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T23:22:13.916 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.916 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.916 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.917 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.917 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.917 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.917 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.917 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.917 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.917 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.917 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.917 INFO:teuthology.orchestra.run.smithi144.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T23:22:13.917 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T23:22:13.917 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.917 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.917 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.918 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.918 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.918 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.918 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.918 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.918 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.918 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.918 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.918 INFO:teuthology.orchestra.run.smithi144.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T23:22:13.919 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T23:22:13.919 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.919 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.919 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.919 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.919 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.919 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.919 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.919 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.919 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.919 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.919 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.920 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T23:22:13.920 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T23:22:13.920 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.920 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.920 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.920 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "admin", 2024-09-11T23:22:13.920 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.920 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.920 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.920 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.921 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.921 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.921 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.921 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T23:22:13.921 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T23:22:13.921 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.921 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.921 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.921 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.921 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.921 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.921 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.921 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.922 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.922 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.922 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.922 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_API_URL": { 2024-09-11T23:22:13.922 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_API_URL", 2024-09-11T23:22:13.922 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.922 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.922 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.922 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.922 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.922 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.922 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.922 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.922 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.923 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.923 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.923 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T23:22:13.923 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T23:22:13.923 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.923 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.923 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.923 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "admin", 2024-09-11T23:22:13.923 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.923 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.923 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.923 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.923 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.924 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.924 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.924 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T23:22:13.924 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T23:22:13.924 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.924 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.924 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.924 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.924 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.924 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.924 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.924 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.924 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.924 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.925 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.925 INFO:teuthology.orchestra.run.smithi144.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T23:22:13.925 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T23:22:13.925 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.925 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.925 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.925 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.925 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.925 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.925 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.925 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.925 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.926 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.926 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.926 INFO:teuthology.orchestra.run.smithi144.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T23:22:13.926 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T23:22:13.926 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.926 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.926 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.926 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.926 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.926 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.926 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.926 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.926 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.927 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.927 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.927 INFO:teuthology.orchestra.run.smithi144.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T23:22:13.927 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T23:22:13.927 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.927 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.927 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.927 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.927 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.927 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.927 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.927 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.928 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.928 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.928 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.928 INFO:teuthology.orchestra.run.smithi144.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T23:22:13.928 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T23:22:13.928 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.928 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.928 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.928 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.928 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.928 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.928 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.929 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.929 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.929 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.929 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.929 INFO:teuthology.orchestra.run.smithi144.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T23:22:13.929 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T23:22:13.929 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.929 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.929 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.929 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.929 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.929 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.930 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.930 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.930 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.930 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.930 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.930 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T23:22:13.930 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T23:22:13.930 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.930 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.930 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.930 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.930 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.930 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.930 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.931 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.931 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.931 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.931 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.931 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T23:22:13.931 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T23:22:13.932 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.932 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.932 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.932 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.932 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.932 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.932 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.932 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.932 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.932 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.932 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.932 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T23:22:13.932 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T23:22:13.933 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.933 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.933 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.933 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.933 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.933 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.933 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.933 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.933 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.933 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.933 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.933 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T23:22:13.934 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T23:22:13.934 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.934 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.934 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.934 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.934 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.934 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.934 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.934 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.934 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.934 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.934 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.935 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T23:22:13.935 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T23:22:13.935 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.935 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.935 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.935 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.935 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.935 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.935 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.935 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.935 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.935 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.935 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.936 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T23:22:13.936 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T23:22:13.936 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.936 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.936 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.936 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.936 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.936 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.936 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.936 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.936 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.937 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.937 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.937 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T23:22:13.937 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T23:22:13.937 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.937 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.937 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.937 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.937 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.937 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.937 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.937 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.937 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.938 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.938 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.938 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T23:22:13.938 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T23:22:13.938 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.938 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.938 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.938 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.938 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.938 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.938 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.938 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.938 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.939 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.939 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.939 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T23:22:13.939 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T23:22:13.939 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.939 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.939 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.939 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T23:22:13.939 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.939 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.939 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.939 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.939 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.939 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.940 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.940 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T23:22:13.940 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T23:22:13.940 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.940 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.940 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.940 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-11T23:22:13.940 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.940 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.940 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.940 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.941 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.941 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.941 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.941 INFO:teuthology.orchestra.run.smithi144.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T23:22:13.941 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T23:22:13.941 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.941 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.941 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.941 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8", 2024-09-11T23:22:13.941 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.941 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.942 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.942 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.942 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.942 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.942 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.942 INFO:teuthology.orchestra.run.smithi144.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T23:22:13.942 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T23:22:13.942 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.942 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.942 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.942 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "45", 2024-09-11T23:22:13.942 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.943 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.943 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.943 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.943 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.943 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.943 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.943 INFO:teuthology.orchestra.run.smithi144.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T23:22:13.943 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T23:22:13.943 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.943 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.943 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.943 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.943 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.943 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.944 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.944 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.944 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.944 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.944 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.944 INFO:teuthology.orchestra.run.smithi144.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T23:22:13.944 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T23:22:13.944 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.944 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.944 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.944 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "admin", 2024-09-11T23:22:13.944 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.945 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.945 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.945 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.945 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.945 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.945 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.945 INFO:teuthology.orchestra.run.smithi144.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T23:22:13.945 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T23:22:13.945 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.945 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.945 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.945 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.946 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.946 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.946 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.946 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.946 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.946 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.946 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.946 INFO:teuthology.orchestra.run.smithi144.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T23:22:13.946 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T23:22:13.946 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.946 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.946 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.946 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.946 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.947 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.947 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.947 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.947 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.947 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.947 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.947 INFO:teuthology.orchestra.run.smithi144.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T23:22:13.947 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T23:22:13.947 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.947 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.947 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.948 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-11T23:22:13.948 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.948 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.948 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.948 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.948 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.948 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.948 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.948 INFO:teuthology.orchestra.run.smithi144.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T23:22:13.948 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T23:22:13.949 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.949 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.949 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.949 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-11T23:22:13.949 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.949 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.949 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.949 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.949 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.949 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.949 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.950 INFO:teuthology.orchestra.run.smithi144.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T23:22:13.950 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T23:22:13.950 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.950 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.950 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.950 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5", 2024-09-11T23:22:13.950 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.950 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.950 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.950 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.950 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.950 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.950 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.951 INFO:teuthology.orchestra.run.smithi144.stdout: "cross_origin_url": { 2024-09-11T23:22:13.951 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cross_origin_url", 2024-09-11T23:22:13.951 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.951 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.951 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.951 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.951 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.951 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.951 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.951 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.951 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.951 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.951 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.951 INFO:teuthology.orchestra.run.smithi144.stdout: "crt_file": { 2024-09-11T23:22:13.952 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "crt_file", 2024-09-11T23:22:13.952 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.952 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.952 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.952 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.952 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.952 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.952 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.952 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.952 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.952 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.952 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.952 INFO:teuthology.orchestra.run.smithi144.stdout: "debug": { 2024-09-11T23:22:13.952 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "debug", 2024-09-11T23:22:13.953 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.953 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.953 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.953 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.953 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.953 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.953 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.953 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Enable/disable debug options", 2024-09-11T23:22:13.953 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.953 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.953 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.953 INFO:teuthology.orchestra.run.smithi144.stdout: "jwt_token_ttl": { 2024-09-11T23:22:13.953 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "jwt_token_ttl", 2024-09-11T23:22:13.954 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.954 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.954 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.954 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "28800", 2024-09-11T23:22:13.954 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.954 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.954 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.954 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.954 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.954 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.954 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.954 INFO:teuthology.orchestra.run.smithi144.stdout: "key_file": { 2024-09-11T23:22:13.954 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "key_file", 2024-09-11T23:22:13.955 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.955 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.955 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.955 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.955 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.955 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.955 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.955 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.955 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.955 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.955 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.955 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.956 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.956 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.956 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.956 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.956 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.956 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.956 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.956 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.956 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.956 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.956 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.956 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.956 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.957 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.957 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.957 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.957 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.957 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.957 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.957 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.957 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.957 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.957 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.957 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.957 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.958 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.958 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.958 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.958 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.958 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.958 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.958 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.958 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.958 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.958 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.959 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.959 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.959 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.959 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.959 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.959 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.959 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.959 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.959 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.959 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.959 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.959 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.959 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.959 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.959 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.959 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.960 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.960 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.960 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.960 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.960 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.960 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.960 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.960 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.960 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.960 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.960 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.960 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.961 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.961 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.961 INFO:teuthology.orchestra.run.smithi144.stdout: "motd": { 2024-09-11T23:22:13.961 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "motd", 2024-09-11T23:22:13.961 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.962 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.962 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.962 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.962 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.962 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.962 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.962 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "The message of the day", 2024-09-11T23:22:13.962 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.962 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.962 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.962 INFO:teuthology.orchestra.run.smithi144.stdout: "redirect_resolve_ip_addr": { 2024-09-11T23:22:13.962 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T23:22:13.962 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.963 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.963 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.963 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.963 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.963 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.963 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.963 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.963 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.963 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.963 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.963 INFO:teuthology.orchestra.run.smithi144.stdout: "server_addr": { 2024-09-11T23:22:13.963 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_addr", 2024-09-11T23:22:13.963 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.964 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.964 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.964 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "::", 2024-09-11T23:22:13.964 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.964 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.964 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.964 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.964 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.965 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.965 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.965 INFO:teuthology.orchestra.run.smithi144.stdout: "server_port": { 2024-09-11T23:22:13.965 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_port", 2024-09-11T23:22:13.965 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.965 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.965 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.966 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8080", 2024-09-11T23:22:13.966 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.966 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.966 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.966 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.966 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.966 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.966 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.966 INFO:teuthology.orchestra.run.smithi144.stdout: "ssl": { 2024-09-11T23:22:13.966 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ssl", 2024-09-11T23:22:13.966 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.966 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.966 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.967 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.967 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.967 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.967 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.967 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.967 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.967 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.967 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.967 INFO:teuthology.orchestra.run.smithi144.stdout: "ssl_server_port": { 2024-09-11T23:22:13.967 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ssl_server_port", 2024-09-11T23:22:13.967 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.967 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.967 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.968 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8443", 2024-09-11T23:22:13.968 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.968 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.968 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.968 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.968 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.968 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.968 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.968 INFO:teuthology.orchestra.run.smithi144.stdout: "standby_behaviour": { 2024-09-11T23:22:13.968 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "standby_behaviour", 2024-09-11T23:22:13.968 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.968 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.969 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.969 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "redirect", 2024-09-11T23:22:13.969 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.969 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.969 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.969 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.969 INFO:teuthology.orchestra.run.smithi144.stdout: "redirect" 2024-09-11T23:22:13.969 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.969 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.969 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.969 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.969 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.970 INFO:teuthology.orchestra.run.smithi144.stdout: "standby_error_status_code": { 2024-09-11T23:22:13.970 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "standby_error_status_code", 2024-09-11T23:22:13.970 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.970 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.970 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.970 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "500", 2024-09-11T23:22:13.970 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "400", 2024-09-11T23:22:13.970 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "599", 2024-09-11T23:22:13.970 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.970 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.970 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.970 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.970 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.971 INFO:teuthology.orchestra.run.smithi144.stdout: "url_prefix": { 2024-09-11T23:22:13.971 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "url_prefix", 2024-09-11T23:22:13.971 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.971 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.971 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.971 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.971 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.971 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.971 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.971 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.971 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.971 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.971 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.972 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.972 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.972 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "devicehealth", 2024-09-11T23:22:13.972 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.972 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.972 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.972 INFO:teuthology.orchestra.run.smithi144.stdout: "enable_monitoring": { 2024-09-11T23:22:13.972 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "enable_monitoring", 2024-09-11T23:22:13.972 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.972 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.972 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.972 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.973 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.973 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.973 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.973 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "monitor device health metrics", 2024-09-11T23:22:13.973 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.973 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.973 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.973 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.973 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.973 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.973 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.973 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.973 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.974 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.974 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.974 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.974 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.974 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.974 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.974 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.974 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.974 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.974 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.974 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.974 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.974 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.974 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.975 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.975 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.975 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.975 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.975 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.975 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.975 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.975 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.975 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.975 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.975 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.975 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.976 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.976 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.976 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.976 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.976 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.976 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.976 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.976 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.976 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.976 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.976 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.976 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.977 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.977 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.977 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.977 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.977 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.977 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.977 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.977 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.977 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.978 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.978 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.978 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.978 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.978 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.978 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.978 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.978 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.978 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.978 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.978 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.978 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.978 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.979 INFO:teuthology.orchestra.run.smithi144.stdout: "mark_out_threshold": { 2024-09-11T23:22:13.979 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mark_out_threshold", 2024-09-11T23:22:13.979 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.979 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.979 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.979 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "2419200", 2024-09-11T23:22:13.979 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.979 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.979 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.979 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T23:22:13.979 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.979 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.979 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.980 INFO:teuthology.orchestra.run.smithi144.stdout: "pool_name": { 2024-09-11T23:22:13.980 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "pool_name", 2024-09-11T23:22:13.980 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.980 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.980 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.980 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "device_health_metrics", 2024-09-11T23:22:13.980 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.980 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.980 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.980 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T23:22:13.980 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.980 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.980 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.981 INFO:teuthology.orchestra.run.smithi144.stdout: "retention_period": { 2024-09-11T23:22:13.981 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "retention_period", 2024-09-11T23:22:13.981 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.981 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.981 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.981 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "15552000", 2024-09-11T23:22:13.981 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.981 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.981 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.981 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how long to retain device health metrics", 2024-09-11T23:22:13.981 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.981 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.982 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.982 INFO:teuthology.orchestra.run.smithi144.stdout: "scrape_frequency": { 2024-09-11T23:22:13.982 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "scrape_frequency", 2024-09-11T23:22:13.982 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.982 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.982 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.982 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "86400", 2024-09-11T23:22:13.982 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.982 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.982 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.982 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T23:22:13.982 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.982 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.983 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.983 INFO:teuthology.orchestra.run.smithi144.stdout: "self_heal": { 2024-09-11T23:22:13.983 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "self_heal", 2024-09-11T23:22:13.983 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.983 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.983 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.983 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:13.983 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.983 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.983 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.984 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T23:22:13.984 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.984 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.984 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.984 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-11T23:22:13.984 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-11T23:22:13.984 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.984 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.984 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.984 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-11T23:22:13.984 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.984 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.985 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.985 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T23:22:13.985 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.985 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.985 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.985 INFO:teuthology.orchestra.run.smithi144.stdout: "warn_threshold": { 2024-09-11T23:22:13.985 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "warn_threshold", 2024-09-11T23:22:13.985 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:13.985 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.985 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.985 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "7257600", 2024-09-11T23:22:13.985 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.986 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.986 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.986 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T23:22:13.986 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.986 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.986 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.986 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.986 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.986 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "diskprediction_local", 2024-09-11T23:22:13.986 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:13.986 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:13.986 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.987 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:13.987 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:13.987 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.987 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.987 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.987 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:13.987 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.987 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.987 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.987 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.987 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.987 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.987 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.987 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.988 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.988 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.988 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.988 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.988 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.988 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.988 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:13.988 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:13.988 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.988 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.988 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.988 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.989 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.989 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.989 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.989 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.989 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.989 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.989 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.989 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:13.989 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:13.989 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.989 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.989 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.989 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:13.990 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.990 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.990 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:13.990 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:13.990 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:13.990 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:13.990 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:13.990 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:13.990 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:13.990 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:13.990 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.990 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.990 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.991 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.991 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:13.991 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:13.991 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:13.991 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.991 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:13.991 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:13.991 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.991 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.991 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.991 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.991 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.992 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.992 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.992 INFO:teuthology.orchestra.run.smithi144.stdout: "predict_interval": { 2024-09-11T23:22:13.992 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "predict_interval", 2024-09-11T23:22:13.992 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.992 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.992 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.992 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "86400", 2024-09-11T23:22:13.992 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.993 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.993 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.993 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.993 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.993 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.993 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.993 INFO:teuthology.orchestra.run.smithi144.stdout: "predictor_model": { 2024-09-11T23:22:13.993 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "predictor_model", 2024-09-11T23:22:13.993 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.993 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.993 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.994 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "prophetstor", 2024-09-11T23:22:13.994 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.994 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.994 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.994 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.994 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.995 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.995 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.995 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-11T23:22:13.995 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-11T23:22:13.996 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.996 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.996 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.996 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "600", 2024-09-11T23:22:13.996 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.996 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.996 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.996 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:13.996 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.996 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.996 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "influx", 2024-09-11T23:22:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": false, 2024-09-11T23:22:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "influxdb python module not found", 2024-09-11T23:22:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: "batch_size": { 2024-09-11T23:22:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "batch_size", 2024-09-11T23:22:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.997 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5000", 2024-09-11T23:22:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T23:22:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: "database": { 2024-09-11T23:22:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "database", 2024-09-11T23:22:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:13.998 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:13.999 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "ceph", 2024-09-11T23:22:13.999 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:13.999 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:13.999 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:13.999 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T23:22:13.999 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:13.999 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:13.999 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:13.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:13.999 INFO:teuthology.orchestra.run.smithi144.stdout: "hostname": { 2024-09-11T23:22:13.999 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "hostname", 2024-09-11T23:22:13.999 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:13.999 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.000 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.000 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.000 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.000 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.000 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.000 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "InfluxDB server hostname", 2024-09-11T23:22:14.001 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.001 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.001 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.001 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-11T23:22:14.001 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-11T23:22:14.002 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:14.002 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.002 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.002 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "30", 2024-09-11T23:22:14.002 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "5", 2024-09-11T23:22:14.002 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.003 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.003 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T23:22:14.003 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.003 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.003 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.004 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.004 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.004 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.004 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.004 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.004 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.005 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.005 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.005 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.005 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.005 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.005 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.006 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.006 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.006 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.006 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.006 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.006 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.007 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.007 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.007 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.007 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.007 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.007 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.008 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.008 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.008 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.008 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.008 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.008 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.009 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.009 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.009 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.009 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.010 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.010 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.010 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.010 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.010 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.010 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.011 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.011 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.011 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.011 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.011 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.011 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.011 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.012 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.012 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.012 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.012 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.012 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.013 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.013 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.013 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.013 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.014 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.014 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.014 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.014 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.014 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.015 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.015 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.015 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.015 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.015 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.015 INFO:teuthology.orchestra.run.smithi144.stdout: "password": { 2024-09-11T23:22:14.015 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "password", 2024-09-11T23:22:14.015 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.015 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.016 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.016 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.016 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.016 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.016 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.016 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "password of InfluxDB server user", 2024-09-11T23:22:14.016 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.016 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.016 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.016 INFO:teuthology.orchestra.run.smithi144.stdout: "port": { 2024-09-11T23:22:14.016 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "port", 2024-09-11T23:22:14.017 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:14.017 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.017 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.017 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "8086", 2024-09-11T23:22:14.017 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.017 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.017 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.018 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "InfluxDB server port", 2024-09-11T23:22:14.018 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.018 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.018 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.019 INFO:teuthology.orchestra.run.smithi144.stdout: "ssl": { 2024-09-11T23:22:14.019 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "ssl", 2024-09-11T23:22:14.019 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.019 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.019 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.019 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "false", 2024-09-11T23:22:14.019 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.019 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.019 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.020 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T23:22:14.020 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.020 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.020 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.020 INFO:teuthology.orchestra.run.smithi144.stdout: "threads": { 2024-09-11T23:22:14.020 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "threads", 2024-09-11T23:22:14.020 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:14.020 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.020 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.020 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5", 2024-09-11T23:22:14.020 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1", 2024-09-11T23:22:14.020 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "32", 2024-09-11T23:22:14.021 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.021 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T23:22:14.021 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.021 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.021 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.021 INFO:teuthology.orchestra.run.smithi144.stdout: "username": { 2024-09-11T23:22:14.021 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "username", 2024-09-11T23:22:14.021 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.021 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.021 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.021 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.021 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.022 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.022 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.022 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "username of InfluxDB server user", 2024-09-11T23:22:14.022 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.022 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.022 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.022 INFO:teuthology.orchestra.run.smithi144.stdout: "verify_ssl": { 2024-09-11T23:22:14.022 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "verify_ssl", 2024-09-11T23:22:14.022 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.022 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.022 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.022 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "true", 2024-09-11T23:22:14.023 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.023 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.023 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.023 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T23:22:14.023 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.023 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.023 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.023 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.023 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.023 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "insights", 2024-09-11T23:22:14.023 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.023 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.024 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.024 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.024 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.024 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.024 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.024 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.024 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.024 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.024 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.024 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.024 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.024 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.024 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.025 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.025 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.025 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.025 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.025 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.025 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.025 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.025 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.025 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.025 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.025 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.025 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.026 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.026 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.026 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.026 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.026 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.026 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.026 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.026 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.026 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.026 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.026 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.026 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.027 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.027 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.027 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.027 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.027 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.027 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.027 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.027 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.027 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.027 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.027 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.027 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.027 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.027 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.028 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.028 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.028 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.028 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.028 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.028 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.028 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.028 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.028 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.028 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.028 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.029 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.029 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.029 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.029 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.029 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.029 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.029 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.029 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "iostat", 2024-09-11T23:22:14.029 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.029 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.029 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.029 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.030 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.030 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.030 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.030 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.030 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.030 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.030 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.030 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.030 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.030 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.030 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.030 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.030 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.031 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.031 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.031 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.031 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.031 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.031 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.031 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.031 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.031 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.031 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.031 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.031 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.031 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.032 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.032 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.032 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.032 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.032 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.032 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.032 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.032 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.032 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.032 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.032 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.032 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.032 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.033 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.033 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.033 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.033 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.033 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.033 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.033 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.033 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.033 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.033 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.033 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.033 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.033 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.034 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.034 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.034 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.034 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.034 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.034 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.034 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.034 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.034 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.034 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.034 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.035 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.035 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.035 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.035 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.036 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "localpool", 2024-09-11T23:22:14.036 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.036 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.036 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.036 INFO:teuthology.orchestra.run.smithi144.stdout: "failure_domain": { 2024-09-11T23:22:14.036 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "failure_domain", 2024-09-11T23:22:14.037 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.037 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.037 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.037 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "host", 2024-09-11T23:22:14.037 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.037 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.038 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.038 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "failure domain for any created local pool", 2024-09-11T23:22:14.038 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T23:22:14.038 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.038 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.039 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.039 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.039 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.039 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.039 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.039 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.040 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.040 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.040 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.040 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.040 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.041 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.041 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.041 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.041 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.041 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.041 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.042 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.042 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.042 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.042 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.042 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.043 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.043 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.043 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.043 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.043 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.043 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.044 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.044 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.044 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.044 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.044 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.045 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.045 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.045 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.045 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.045 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.046 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.046 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.046 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.046 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.046 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.046 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.047 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.047 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.047 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.047 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.047 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.047 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.048 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.048 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.048 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.048 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.049 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.049 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.049 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.049 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.049 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.049 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.050 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.050 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.050 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.050 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.050 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.050 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.051 INFO:teuthology.orchestra.run.smithi144.stdout: "min_size": { 2024-09-11T23:22:14.051 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "min_size", 2024-09-11T23:22:14.051 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:14.051 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.051 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.051 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.052 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.052 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.052 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.052 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "default min_size for any created local pool", 2024-09-11T23:22:14.052 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T23:22:14.052 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.052 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.053 INFO:teuthology.orchestra.run.smithi144.stdout: "num_rep": { 2024-09-11T23:22:14.053 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "num_rep", 2024-09-11T23:22:14.053 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:14.053 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.053 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.053 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "3", 2024-09-11T23:22:14.053 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.053 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.053 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.054 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "default replica count for any created local pool", 2024-09-11T23:22:14.054 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.054 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.054 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.054 INFO:teuthology.orchestra.run.smithi144.stdout: "pg_num": { 2024-09-11T23:22:14.054 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "pg_num", 2024-09-11T23:22:14.054 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:14.054 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.054 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.054 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "128", 2024-09-11T23:22:14.054 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.054 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.054 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.054 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T23:22:14.055 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.055 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.055 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.055 INFO:teuthology.orchestra.run.smithi144.stdout: "prefix": { 2024-09-11T23:22:14.055 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "prefix", 2024-09-11T23:22:14.055 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.055 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.055 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.055 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.055 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.055 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.055 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.055 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "name prefix for any created local pool", 2024-09-11T23:22:14.056 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.056 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.056 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.056 INFO:teuthology.orchestra.run.smithi144.stdout: "subtree": { 2024-09-11T23:22:14.056 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "subtree", 2024-09-11T23:22:14.056 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.056 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.056 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.056 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "rack", 2024-09-11T23:22:14.056 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.056 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.056 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.057 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T23:22:14.057 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T23:22:14.057 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.057 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.057 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.057 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.057 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mds_autoscaler", 2024-09-11T23:22:14.057 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.057 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.057 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.057 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.058 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.058 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.058 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.058 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.058 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.058 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.058 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.058 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.058 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.058 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.058 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.058 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.058 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.059 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.059 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.059 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.059 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.059 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.059 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.059 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.059 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.059 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.059 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.059 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.059 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.059 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.060 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.060 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.060 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.060 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.060 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.060 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.060 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.060 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.060 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.060 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.060 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.060 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.061 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.061 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.061 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.061 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.061 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.061 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.061 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.061 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.061 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.061 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.061 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.061 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.061 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.062 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.062 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.062 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.062 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.062 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.062 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.062 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.062 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.062 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.062 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.062 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.062 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.062 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.063 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.063 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.063 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.063 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mirroring", 2024-09-11T23:22:14.063 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.063 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.063 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.063 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.063 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.063 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.063 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.063 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.064 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.064 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.064 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.064 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.064 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.064 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.064 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.064 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.064 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.064 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.064 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.064 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.064 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.065 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.065 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.065 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.065 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.065 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.065 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.065 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.065 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.065 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.065 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.065 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.065 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.065 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.066 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.066 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.066 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.066 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.066 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.066 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.066 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.066 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.066 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.066 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.066 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.066 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.066 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.067 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.067 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.067 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.067 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.067 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.067 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.067 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.067 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.067 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.067 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.067 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.067 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.067 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.068 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.068 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.068 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.068 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.068 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.068 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.068 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.068 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.068 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.068 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.068 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.068 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "nfs", 2024-09-11T23:22:14.069 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.069 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.069 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.069 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.069 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.069 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.069 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.069 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.069 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.069 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.069 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.069 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.069 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.069 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.070 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.070 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.070 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.070 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.070 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.070 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.070 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.070 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.070 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.070 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.070 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.070 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.071 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.071 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.071 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.071 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.071 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.071 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.071 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.071 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.072 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.072 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.072 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.072 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.072 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.072 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.072 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.072 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.072 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.072 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.072 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.072 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.073 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.073 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.073 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.073 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.073 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.073 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.073 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.073 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.073 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.073 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.073 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.073 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.074 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.074 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.074 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.074 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.074 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.074 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.074 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.074 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.074 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.074 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.074 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.074 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.074 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.075 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "orchestrator", 2024-09-11T23:22:14.075 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.075 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.075 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.075 INFO:teuthology.orchestra.run.smithi144.stdout: "fail_fs": { 2024-09-11T23:22:14.075 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "fail_fs", 2024-09-11T23:22:14.075 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.075 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.075 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.075 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.076 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.076 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.076 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.076 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T23:22:14.076 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.076 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.076 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.077 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.077 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.077 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.077 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.077 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.077 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.077 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.077 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.077 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.077 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.077 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.077 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.078 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.078 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.078 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.078 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.078 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.078 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.078 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.078 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.078 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.078 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.078 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.078 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.078 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.079 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.079 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.079 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.079 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.079 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.079 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.079 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.079 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.079 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.079 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.079 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.079 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.079 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.080 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.080 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.080 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.080 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.080 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.080 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.080 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.080 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.080 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.080 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.080 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.080 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.080 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.081 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.081 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.081 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.081 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.081 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.081 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.081 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.081 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.081 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.081 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.081 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.081 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.082 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.082 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.082 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.082 INFO:teuthology.orchestra.run.smithi144.stdout: "orchestrator": { 2024-09-11T23:22:14.082 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "orchestrator", 2024-09-11T23:22:14.082 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.082 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.082 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.082 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.082 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.082 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.082 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.083 INFO:teuthology.orchestra.run.smithi144.stdout: "cephadm", 2024-09-11T23:22:14.083 INFO:teuthology.orchestra.run.smithi144.stdout: "rook", 2024-09-11T23:22:14.083 INFO:teuthology.orchestra.run.smithi144.stdout: "test_orchestrator" 2024-09-11T23:22:14.083 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.083 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Orchestrator backend", 2024-09-11T23:22:14.083 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.083 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.083 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.083 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.083 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.083 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "osd_perf_query", 2024-09-11T23:22:14.083 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.084 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.084 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.084 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.084 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.084 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.084 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.084 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.084 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.084 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.084 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.084 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.084 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.084 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.085 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.085 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.085 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.085 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.085 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.085 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.085 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.085 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.085 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.085 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.085 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.086 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.086 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.086 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.086 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.086 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.086 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.086 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.086 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.086 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.086 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.086 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.086 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.086 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.087 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.087 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.087 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.087 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.087 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.087 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.087 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.087 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.087 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.087 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.087 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.087 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.087 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.087 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.088 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.088 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.088 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.088 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.088 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.088 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.088 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.088 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.088 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.088 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.088 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.089 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.089 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.089 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.089 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.089 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.089 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.089 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.089 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.089 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "osd_support", 2024-09-11T23:22:14.089 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.089 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.089 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.090 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.090 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.090 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.090 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.090 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.090 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.090 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.090 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.090 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.090 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.090 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.090 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.091 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.091 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.091 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.091 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.091 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.091 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.091 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.091 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.091 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.091 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.092 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.092 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.092 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.092 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.092 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.092 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.092 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.092 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.092 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.092 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.092 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.093 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.093 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.093 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.093 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.093 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.093 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.093 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.093 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.093 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.093 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.093 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.093 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.094 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.094 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.094 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.094 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.094 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.094 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.094 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.094 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.094 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.094 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.094 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.094 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.094 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.095 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.095 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.095 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.095 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.095 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.095 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.095 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.095 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.095 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "pg_autoscaler", 2024-09-11T23:22:14.095 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.096 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.096 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.096 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.096 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.096 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.096 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.096 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.096 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.096 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.096 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.096 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.096 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.096 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.097 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.097 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.097 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.097 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.097 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.097 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.097 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.097 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.097 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.097 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.097 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.097 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.098 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.098 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.098 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.098 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.098 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.098 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.098 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.098 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.098 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.098 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.098 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.098 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.098 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.099 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.099 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.099 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.099 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.099 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.099 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.099 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.100 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.100 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.100 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.100 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.100 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.100 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.100 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.100 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.100 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.100 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.100 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.101 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.101 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.101 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.101 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.101 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.101 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.101 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.101 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.101 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.101 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.101 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.101 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.102 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-11T23:22:14.102 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-11T23:22:14.102 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:14.102 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.102 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.102 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-11T23:22:14.102 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.102 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.102 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.102 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.102 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.102 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.102 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.103 INFO:teuthology.orchestra.run.smithi144.stdout: "threshold": { 2024-09-11T23:22:14.103 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "threshold", 2024-09-11T23:22:14.103 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-11T23:22:14.103 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.103 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.103 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "3.0", 2024-09-11T23:22:14.103 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1.0", 2024-09-11T23:22:14.103 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.103 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.103 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "scaling threshold", 2024-09-11T23:22:14.103 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T23:22:14.103 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.104 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.104 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.104 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.104 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "progress", 2024-09-11T23:22:14.104 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.104 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.104 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.104 INFO:teuthology.orchestra.run.smithi144.stdout: "allow_pg_recovery_event": { 2024-09-11T23:22:14.104 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "allow_pg_recovery_event", 2024-09-11T23:22:14.104 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.104 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.105 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.105 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.105 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.105 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.105 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.105 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T23:22:14.105 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.106 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.106 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.106 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": { 2024-09-11T23:22:14.106 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "enabled", 2024-09-11T23:22:14.106 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.106 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.106 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.106 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:14.106 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.106 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.106 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.106 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.107 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.107 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.107 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.107 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.107 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.107 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.107 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.107 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.107 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.107 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.107 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.107 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.108 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.108 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.108 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.108 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.108 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.108 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.108 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.108 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.108 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.108 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.108 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.108 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.109 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.109 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.109 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.109 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.109 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.109 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.109 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.109 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.109 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.109 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.109 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.110 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.110 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.110 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.110 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.110 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.110 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.110 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.110 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.110 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.110 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.111 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.111 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.111 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.111 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.111 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.111 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.111 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.111 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.111 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.111 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.111 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.111 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.112 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.112 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.112 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.112 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.112 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.112 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.112 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.112 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.112 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.112 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.112 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.112 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.113 INFO:teuthology.orchestra.run.smithi144.stdout: "max_completed_events": { 2024-09-11T23:22:14.113 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_completed_events", 2024-09-11T23:22:14.113 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:14.113 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.113 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.113 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "50", 2024-09-11T23:22:14.113 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.113 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.113 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.113 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "number of past completed events to remember", 2024-09-11T23:22:14.113 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.113 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.113 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.114 INFO:teuthology.orchestra.run.smithi144.stdout: "sleep_interval": { 2024-09-11T23:22:14.114 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "sleep_interval", 2024-09-11T23:22:14.114 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:14.114 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.114 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.114 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "5", 2024-09-11T23:22:14.114 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.114 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.114 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.114 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "how long the module is going to sleep", 2024-09-11T23:22:14.114 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.114 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.114 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.115 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.115 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.115 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "prometheus", 2024-09-11T23:22:14.115 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.115 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.115 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.115 INFO:teuthology.orchestra.run.smithi144.stdout: "cache": { 2024-09-11T23:22:14.115 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cache", 2024-09-11T23:22:14.115 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.115 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.115 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.115 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:14.116 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.116 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.116 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.116 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.116 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.116 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.116 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.116 INFO:teuthology.orchestra.run.smithi144.stdout: "exclude_perf_counters": { 2024-09-11T23:22:14.116 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "exclude_perf_counters", 2024-09-11T23:22:14.116 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.116 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.116 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.117 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:14.117 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.117 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.117 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.117 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T23:22:14.117 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T23:22:14.117 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.117 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.118 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.118 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.118 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.118 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.118 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.118 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.118 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.119 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.119 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.119 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.119 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.119 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.119 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.119 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.119 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.120 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.120 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.120 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.120 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.120 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.120 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.120 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.121 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.121 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.121 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.121 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.121 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.121 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.121 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.121 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.122 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.122 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.122 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.122 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.122 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.122 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.122 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.123 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.123 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.123 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.123 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.123 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.123 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.123 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.123 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.125 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.125 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.125 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.125 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.125 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.125 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.125 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.126 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.126 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.126 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.126 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.126 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.126 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.126 INFO:teuthology.orchestra.run.smithi144.stdout: "rbd_stats_pools": { 2024-09-11T23:22:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rbd_stats_pools", 2024-09-11T23:22:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.128 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.128 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.128 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.128 INFO:teuthology.orchestra.run.smithi144.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T23:22:14.128 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T23:22:14.128 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:14.128 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "300", 2024-09-11T23:22:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.130 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.130 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.130 INFO:teuthology.orchestra.run.smithi144.stdout: "scrape_interval": { 2024-09-11T23:22:14.130 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "scrape_interval", 2024-09-11T23:22:14.130 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-11T23:22:14.130 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.130 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.130 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "15.0", 2024-09-11T23:22:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: "server_addr": { 2024-09-11T23:22:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_addr", 2024-09-11T23:22:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "::", 2024-09-11T23:22:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T23:22:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "server_port": { 2024-09-11T23:22:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_port", 2024-09-11T23:22:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "9283", 2024-09-11T23:22:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T23:22:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.136 INFO:teuthology.orchestra.run.smithi144.stdout: "stale_cache_strategy": { 2024-09-11T23:22:14.136 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "stale_cache_strategy", 2024-09-11T23:22:14.136 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.136 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "log", 2024-09-11T23:22:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: "standby_behaviour": { 2024-09-11T23:22:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "standby_behaviour", 2024-09-11T23:22:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "default", 2024-09-11T23:22:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "default", 2024-09-11T23:22:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "error" 2024-09-11T23:22:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: "standby_error_status_code": { 2024-09-11T23:22:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "standby_error_status_code", 2024-09-11T23:22:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "500", 2024-09-11T23:22:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "400", 2024-09-11T23:22:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "599", 2024-09-11T23:22:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rbd_support", 2024-09-11T23:22:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.141 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.141 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.141 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.141 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.141 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.141 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.141 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.141 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.141 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.141 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.141 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.141 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.141 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.141 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.142 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.142 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.142 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.142 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.142 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.142 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.142 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.142 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.142 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.142 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.142 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.142 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.142 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.143 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.143 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.143 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.143 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.143 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.143 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.143 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.143 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.143 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.143 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.143 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.143 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.143 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.144 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.144 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.144 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.144 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.144 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.144 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.144 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.144 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.144 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.144 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.144 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.144 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.145 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.145 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.145 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.145 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.145 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.145 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.145 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.145 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.145 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.145 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.145 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.145 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.145 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.146 INFO:teuthology.orchestra.run.smithi144.stdout: "max_concurrent_snap_create": { 2024-09-11T23:22:14.146 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_concurrent_snap_create", 2024-09-11T23:22:14.146 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:14.146 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.146 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.146 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10", 2024-09-11T23:22:14.146 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.146 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.146 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.146 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.146 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.146 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.146 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.146 INFO:teuthology.orchestra.run.smithi144.stdout: "mirror_snapshot_schedule": { 2024-09-11T23:22:14.147 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T23:22:14.147 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.147 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.147 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.147 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.147 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.147 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.147 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.147 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.147 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.147 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.147 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.147 INFO:teuthology.orchestra.run.smithi144.stdout: "trash_purge_schedule": { 2024-09-11T23:22:14.147 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "trash_purge_schedule", 2024-09-11T23:22:14.148 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.148 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.148 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.148 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.148 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.148 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.148 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.148 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.148 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.148 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.148 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.148 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.148 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.149 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "restful", 2024-09-11T23:22:14.149 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.149 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.149 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.149 INFO:teuthology.orchestra.run.smithi144.stdout: "enable_auth": { 2024-09-11T23:22:14.149 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "enable_auth", 2024-09-11T23:22:14.149 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.149 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.149 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.149 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:14.149 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.149 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.149 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.150 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.150 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.150 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.150 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.150 INFO:teuthology.orchestra.run.smithi144.stdout: "key_file": { 2024-09-11T23:22:14.150 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "key_file", 2024-09-11T23:22:14.150 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.150 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.150 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.150 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.150 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.150 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.150 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.150 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.151 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.151 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.151 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.151 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.151 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.151 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.151 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.151 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.151 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.151 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.151 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.151 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.151 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.152 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.152 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.152 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.152 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.152 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.152 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.152 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.152 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.152 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.152 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.152 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.152 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.152 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.152 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.153 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.153 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.153 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.153 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.153 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.153 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.153 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.153 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.153 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.153 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.153 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.153 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.153 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.154 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.154 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.154 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.154 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.154 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.154 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.154 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.154 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.154 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.154 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.154 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.154 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.154 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.154 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.155 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.155 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.155 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.155 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.155 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.155 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.155 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.155 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.155 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.155 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.155 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.155 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.156 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.156 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.156 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.156 INFO:teuthology.orchestra.run.smithi144.stdout: "server_addr": { 2024-09-11T23:22:14.156 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_addr", 2024-09-11T23:22:14.156 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.156 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.156 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.156 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.156 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.156 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.156 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.157 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.157 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.157 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.157 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.157 INFO:teuthology.orchestra.run.smithi144.stdout: "server_port": { 2024-09-11T23:22:14.157 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "server_port", 2024-09-11T23:22:14.157 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.157 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.157 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.157 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.157 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.157 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.157 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.158 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.158 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.158 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.158 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.158 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.158 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.158 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rgw", 2024-09-11T23:22:14.158 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.158 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.158 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.158 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.158 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.159 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.159 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.159 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.159 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.159 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.159 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.159 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.159 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.159 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.159 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.159 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.159 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.159 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.159 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.159 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.160 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.160 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.160 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.160 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.160 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.160 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.160 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.160 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.160 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.160 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.160 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.160 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.160 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.161 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.161 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.161 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.161 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.161 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.161 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.161 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.161 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.161 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.161 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.161 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.161 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.161 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.161 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.162 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.162 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.162 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.162 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.162 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.162 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.162 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.162 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.162 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.162 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.162 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.162 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.162 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.162 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.163 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.163 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.163 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.163 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.163 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.163 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.163 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.163 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.163 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rook", 2024-09-11T23:22:14.163 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.163 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.164 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.164 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.164 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.164 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.164 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.164 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.164 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.164 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.164 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.164 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.164 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.164 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.164 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.164 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.164 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.165 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.165 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.165 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.165 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.165 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.165 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.165 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.165 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.165 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.165 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.165 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.165 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.165 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.165 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.166 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.166 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.166 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.166 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.166 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.166 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.166 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.166 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.166 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.166 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.166 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.166 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.166 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.166 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.167 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.167 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.167 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.167 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.167 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.167 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.167 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.167 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.167 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.167 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.167 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.167 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.167 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.167 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.168 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.168 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.168 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.168 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.168 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.168 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.168 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.168 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.168 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.168 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.168 INFO:teuthology.orchestra.run.smithi144.stdout: "storage_class": { 2024-09-11T23:22:14.168 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "storage_class", 2024-09-11T23:22:14.168 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.169 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.169 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.169 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "local", 2024-09-11T23:22:14.169 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.169 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.169 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.169 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T23:22:14.169 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.169 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.169 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.169 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.169 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "selftest", 2024-09-11T23:22:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.170 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.171 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.172 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.173 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.174 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: "roption1": { 2024-09-11T23:22:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "roption1", 2024-09-11T23:22:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.175 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: "roption2": { 2024-09-11T23:22:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "roption2", 2024-09-11T23:22:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "xyz", 2024-09-11T23:22:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.176 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption1": { 2024-09-11T23:22:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption1", 2024-09-11T23:22:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.177 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption2": { 2024-09-11T23:22:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption2", 2024-09-11T23:22:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.178 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption3": { 2024-09-11T23:22:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption3", 2024-09-11T23:22:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "float", 2024-09-11T23:22:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.179 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption4": { 2024-09-11T23:22:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption4", 2024-09-11T23:22:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.180 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption5": { 2024-09-11T23:22:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption5", 2024-09-11T23:22:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.181 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.182 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.182 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.182 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption6": { 2024-09-11T23:22:14.182 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption6", 2024-09-11T23:22:14.182 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.182 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.182 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.182 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:14.182 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.182 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.182 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.182 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.183 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.183 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.183 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.183 INFO:teuthology.orchestra.run.smithi144.stdout: "rwoption7": { 2024-09-11T23:22:14.183 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rwoption7", 2024-09-11T23:22:14.183 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:14.183 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.183 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.183 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.183 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "1", 2024-09-11T23:22:14.183 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "42", 2024-09-11T23:22:14.183 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.183 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.184 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.184 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.184 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.184 INFO:teuthology.orchestra.run.smithi144.stdout: "testkey": { 2024-09-11T23:22:14.184 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "testkey", 2024-09-11T23:22:14.184 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.184 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.184 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.184 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.184 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.184 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.184 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.185 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.185 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.185 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.185 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.185 INFO:teuthology.orchestra.run.smithi144.stdout: "testlkey": { 2024-09-11T23:22:14.185 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "testlkey", 2024-09-11T23:22:14.185 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.185 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.185 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.185 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.185 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.185 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.185 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.186 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.186 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.186 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.186 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.186 INFO:teuthology.orchestra.run.smithi144.stdout: "testnewline": { 2024-09-11T23:22:14.186 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "testnewline", 2024-09-11T23:22:14.186 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.186 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.186 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.186 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.186 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.186 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.186 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.187 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.187 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.187 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.187 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.187 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.187 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.187 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "snap_schedule", 2024-09-11T23:22:14.187 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.187 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.187 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.187 INFO:teuthology.orchestra.run.smithi144.stdout: "allow_m_granularity": { 2024-09-11T23:22:14.188 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "allow_m_granularity", 2024-09-11T23:22:14.188 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.188 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.188 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.188 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.188 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.188 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.188 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.188 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T23:22:14.188 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.188 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.188 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.189 INFO:teuthology.orchestra.run.smithi144.stdout: "dump_on_update": { 2024-09-11T23:22:14.189 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "dump_on_update", 2024-09-11T23:22:14.189 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.189 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.189 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.189 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.189 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.189 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.189 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.189 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "dump database to debug log on update", 2024-09-11T23:22:14.189 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.189 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.190 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.190 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.190 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.190 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.190 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.190 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.190 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.190 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.190 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.190 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.190 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.190 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.190 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.191 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.191 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.191 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.191 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.191 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.191 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.191 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.191 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.191 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.191 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.191 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.191 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.192 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.192 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.192 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.192 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.192 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.192 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.192 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.192 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.192 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.192 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.192 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.192 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.193 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.193 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.193 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.193 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.193 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.193 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.193 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.193 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.193 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.193 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.193 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.193 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.193 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.193 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.194 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.194 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.194 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.194 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.194 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.194 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.194 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.194 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.194 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.194 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.194 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.194 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.194 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.195 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.195 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.195 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.195 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "stats", 2024-09-11T23:22:14.195 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.195 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.195 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.195 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.195 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.195 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.195 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.196 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.196 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.196 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.196 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.196 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.196 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.196 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.196 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.196 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.196 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.196 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.196 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.196 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.196 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.197 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.197 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.197 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.197 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.197 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.197 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.197 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.197 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.197 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.197 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.197 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.197 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.197 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.197 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.198 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.198 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.198 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.198 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.198 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.198 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.198 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.198 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.198 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.198 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.198 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.198 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.198 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.198 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.199 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.199 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.199 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.199 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.199 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.199 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.199 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.199 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.199 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.199 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.199 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.199 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.199 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.199 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.200 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.200 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.200 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.200 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.200 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.200 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.200 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.200 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.200 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "status", 2024-09-11T23:22:14.200 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.200 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.200 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.200 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.201 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.201 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.201 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.201 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.201 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.201 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.201 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.201 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.201 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.201 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.201 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.201 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.201 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.201 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.201 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.202 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.202 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.202 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.202 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.202 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.202 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.202 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.202 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.202 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.202 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.202 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.202 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.202 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.202 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.203 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.203 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.203 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.203 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.203 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.203 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.203 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.203 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.203 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.203 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.203 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.203 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.203 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.204 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.204 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.204 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.204 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.204 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.204 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.204 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.204 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.204 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.204 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.204 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.204 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.204 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.205 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.205 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.205 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.205 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.205 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.205 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.205 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.205 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.205 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.205 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.205 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.205 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.205 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "telegraf", 2024-09-11T23:22:14.206 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.206 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.206 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.206 INFO:teuthology.orchestra.run.smithi144.stdout: "address": { 2024-09-11T23:22:14.206 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "address", 2024-09-11T23:22:14.206 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.206 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.206 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.206 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T23:22:14.206 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.206 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.206 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.206 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.206 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.206 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.207 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.207 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-11T23:22:14.207 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-11T23:22:14.207 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:14.207 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.207 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.207 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "15", 2024-09-11T23:22:14.207 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.207 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.207 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.207 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.207 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.207 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.208 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.208 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.208 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.208 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.208 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.208 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.208 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.208 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.208 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.208 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.208 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.208 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.208 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.209 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.209 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.209 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.209 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.209 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.209 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.209 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.209 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.209 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.209 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.209 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.210 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.210 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.210 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.210 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.210 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.210 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.210 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.210 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.210 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.210 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.210 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.210 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.210 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.210 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.210 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.211 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.211 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.211 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.211 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.211 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.211 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.211 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.211 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.211 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.211 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.211 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.211 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.211 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.211 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.211 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.212 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.212 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.212 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.212 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.212 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.212 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.212 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.212 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.212 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.212 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.212 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.212 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.212 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.212 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.212 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.213 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "telemetry", 2024-09-11T23:22:14.213 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.213 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.213 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.213 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_basic": { 2024-09-11T23:22:14.213 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_basic", 2024-09-11T23:22:14.213 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.213 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.213 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.213 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:14.213 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.213 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.213 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.213 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T23:22:14.214 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.214 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.214 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.214 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_crash": { 2024-09-11T23:22:14.214 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_crash", 2024-09-11T23:22:14.214 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.214 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.214 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.214 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:14.214 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.214 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.214 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.214 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T23:22:14.214 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.215 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.215 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.215 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_device": { 2024-09-11T23:22:14.215 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_device", 2024-09-11T23:22:14.215 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.215 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.215 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.215 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:14.215 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.215 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.215 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.215 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T23:22:14.215 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.215 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.215 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.216 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_ident": { 2024-09-11T23:22:14.216 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_ident", 2024-09-11T23:22:14.216 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.216 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.216 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.216 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.216 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.216 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.216 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.216 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T23:22:14.216 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.216 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.216 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.217 INFO:teuthology.orchestra.run.smithi144.stdout: "channel_perf": { 2024-09-11T23:22:14.217 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "channel_perf", 2024-09-11T23:22:14.217 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.217 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.217 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.217 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.217 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.217 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.217 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.217 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T23:22:14.217 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.217 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.217 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.218 INFO:teuthology.orchestra.run.smithi144.stdout: "contact": { 2024-09-11T23:22:14.218 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "contact", 2024-09-11T23:22:14.218 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.218 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.218 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.218 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.218 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.218 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.218 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.218 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.218 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.218 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.218 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.219 INFO:teuthology.orchestra.run.smithi144.stdout: "description": { 2024-09-11T23:22:14.219 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "description", 2024-09-11T23:22:14.219 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.219 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.219 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.219 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.219 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.219 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.219 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.219 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.219 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.219 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.219 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.220 INFO:teuthology.orchestra.run.smithi144.stdout: "device_url": { 2024-09-11T23:22:14.220 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "device_url", 2024-09-11T23:22:14.220 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.220 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.220 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.220 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T23:22:14.220 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.220 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.220 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.220 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.220 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.220 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.220 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.221 INFO:teuthology.orchestra.run.smithi144.stdout: "enabled": { 2024-09-11T23:22:14.221 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "enabled", 2024-09-11T23:22:14.221 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.221 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.221 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.221 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.221 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.221 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.221 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.221 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.221 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.221 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.221 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.221 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-11T23:22:14.222 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-11T23:22:14.222 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:14.222 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.222 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.222 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "24", 2024-09-11T23:22:14.222 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "8", 2024-09-11T23:22:14.222 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.222 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.222 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.222 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.222 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.222 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.222 INFO:teuthology.orchestra.run.smithi144.stdout: "last_opt_revision": { 2024-09-11T23:22:14.223 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "last_opt_revision", 2024-09-11T23:22:14.223 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:14.223 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.223 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.223 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "1", 2024-09-11T23:22:14.223 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.223 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.223 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.223 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.223 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.223 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.223 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.223 INFO:teuthology.orchestra.run.smithi144.stdout: "leaderboard": { 2024-09-11T23:22:14.223 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "leaderboard", 2024-09-11T23:22:14.224 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.224 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.224 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.224 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.224 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.224 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.224 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.224 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.224 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.224 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.224 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.224 INFO:teuthology.orchestra.run.smithi144.stdout: "leaderboard_description": { 2024-09-11T23:22:14.224 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "leaderboard_description", 2024-09-11T23:22:14.225 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.225 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.225 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.225 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.225 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.225 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.225 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.225 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.225 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.225 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.225 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.225 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.225 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.226 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.226 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.226 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.226 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.226 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.226 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.226 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.226 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.226 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.226 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.226 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.226 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.226 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.226 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.226 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.227 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.227 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.227 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.227 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.227 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.227 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.227 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.227 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.227 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.227 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.227 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.227 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.227 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.228 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.229 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "organization": { 2024-09-11T23:22:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "organization", 2024-09-11T23:22:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.230 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "proxy": { 2024-09-11T23:22:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "proxy", 2024-09-11T23:22:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.231 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "url": { 2024-09-11T23:22:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "url", 2024-09-11T23:22:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.232 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T23:22:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "test_orchestrator", 2024-09-11T23:22:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.233 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.234 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.234 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.234 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.234 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.234 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.234 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.234 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.234 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.234 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.234 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.234 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.234 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.234 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.234 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.234 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.235 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.235 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.235 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.235 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.235 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.235 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.235 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.235 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.235 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.235 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.235 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.235 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.235 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.235 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.236 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.236 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.236 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.236 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.236 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.236 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.236 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.236 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.236 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.236 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.236 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.236 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.236 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.237 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.237 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.237 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.237 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.237 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.237 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.237 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.237 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.237 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.237 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.237 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.237 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.237 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.237 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.237 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.238 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.238 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.238 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.238 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.238 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.238 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.238 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.238 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.238 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.238 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.238 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.238 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "volumes", 2024-09-11T23:22:14.238 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.239 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.239 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.239 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.239 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.239 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.239 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.239 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.239 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.239 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.239 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.239 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.239 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.239 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.240 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.240 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.240 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.240 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.240 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.240 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.240 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.240 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.240 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.240 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.240 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.240 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.240 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.241 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.241 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.241 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.241 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.241 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.241 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.241 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.241 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.241 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.241 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.241 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.241 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.241 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.242 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.242 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.242 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.242 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.242 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.242 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.242 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.242 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.242 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.242 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.242 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.242 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.242 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.243 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.243 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.243 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.243 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.243 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.243 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.243 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.243 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.243 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.243 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.243 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.243 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.243 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.244 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.244 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.244 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.244 INFO:teuthology.orchestra.run.smithi144.stdout: "max_concurrent_clones": { 2024-09-11T23:22:14.244 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "max_concurrent_clones", 2024-09-11T23:22:14.244 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:14.244 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.244 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.244 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "4", 2024-09-11T23:22:14.244 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.244 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.244 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.245 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T23:22:14.245 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.245 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.245 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.245 INFO:teuthology.orchestra.run.smithi144.stdout: "periodic_async_work": { 2024-09-11T23:22:14.245 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "periodic_async_work", 2024-09-11T23:22:14.245 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.245 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.245 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.245 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.245 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.245 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.245 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.245 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Periodically check for async work", 2024-09-11T23:22:14.245 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.246 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.246 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.246 INFO:teuthology.orchestra.run.smithi144.stdout: "snapshot_clone_delay": { 2024-09-11T23:22:14.246 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "snapshot_clone_delay", 2024-09-11T23:22:14.246 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:14.246 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.246 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.246 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "0", 2024-09-11T23:22:14.246 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.246 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.246 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.246 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T23:22:14.246 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.247 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.247 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.247 INFO:teuthology.orchestra.run.smithi144.stdout: "snapshot_clone_no_wait": { 2024-09-11T23:22:14.247 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T23:22:14.247 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.247 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.247 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.247 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "True", 2024-09-11T23:22:14.247 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.247 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.247 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.247 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T23:22:14.248 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.248 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.248 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.248 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.248 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.248 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "zabbix", 2024-09-11T23:22:14.248 INFO:teuthology.orchestra.run.smithi144.stdout: "can_run": true, 2024-09-11T23:22:14.248 INFO:teuthology.orchestra.run.smithi144.stdout: "error_string": "", 2024-09-11T23:22:14.248 INFO:teuthology.orchestra.run.smithi144.stdout: "module_options": { 2024-09-11T23:22:14.248 INFO:teuthology.orchestra.run.smithi144.stdout: "discovery_interval": { 2024-09-11T23:22:14.248 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "discovery_interval", 2024-09-11T23:22:14.248 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "uint", 2024-09-11T23:22:14.249 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.249 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.249 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "100", 2024-09-11T23:22:14.249 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.249 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.249 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.249 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.249 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.249 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.249 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.249 INFO:teuthology.orchestra.run.smithi144.stdout: "identifier": { 2024-09-11T23:22:14.249 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "identifier", 2024-09-11T23:22:14.249 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.250 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.250 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.250 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.250 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.250 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.250 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.250 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.250 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.250 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.250 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.250 INFO:teuthology.orchestra.run.smithi144.stdout: "interval": { 2024-09-11T23:22:14.250 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "interval", 2024-09-11T23:22:14.250 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "secs", 2024-09-11T23:22:14.251 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.251 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.251 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "60", 2024-09-11T23:22:14.251 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.251 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.251 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.251 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.251 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.251 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.251 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.251 INFO:teuthology.orchestra.run.smithi144.stdout: "log_level": { 2024-09-11T23:22:14.251 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_level", 2024-09-11T23:22:14.252 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.252 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.252 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.252 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.252 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.252 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.252 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.252 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.252 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.252 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.252 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.252 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.252 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.252 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.253 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.253 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.253 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.253 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.253 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster": { 2024-09-11T23:22:14.253 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster", 2024-09-11T23:22:14.253 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.253 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.253 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.253 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.253 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.253 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.254 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.254 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.254 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.254 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.254 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.254 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_cluster_level": { 2024-09-11T23:22:14.254 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_cluster_level", 2024-09-11T23:22:14.254 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.254 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.254 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.254 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "info", 2024-09-11T23:22:14.254 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.254 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.255 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [ 2024-09-11T23:22:14.255 INFO:teuthology.orchestra.run.smithi144.stdout: "", 2024-09-11T23:22:14.255 INFO:teuthology.orchestra.run.smithi144.stdout: "critical", 2024-09-11T23:22:14.255 INFO:teuthology.orchestra.run.smithi144.stdout: "debug", 2024-09-11T23:22:14.255 INFO:teuthology.orchestra.run.smithi144.stdout: "error", 2024-09-11T23:22:14.255 INFO:teuthology.orchestra.run.smithi144.stdout: "info", 2024-09-11T23:22:14.255 INFO:teuthology.orchestra.run.smithi144.stdout: "warning" 2024-09-11T23:22:14.255 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.255 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.255 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.255 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.255 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.255 INFO:teuthology.orchestra.run.smithi144.stdout: "log_to_file": { 2024-09-11T23:22:14.255 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "log_to_file", 2024-09-11T23:22:14.256 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "bool", 2024-09-11T23:22:14.256 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.256 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 1, 2024-09-11T23:22:14.256 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "False", 2024-09-11T23:22:14.256 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.256 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.256 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.256 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.256 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.256 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.256 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.256 INFO:teuthology.orchestra.run.smithi144.stdout: "zabbix_host": { 2024-09-11T23:22:14.256 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "zabbix_host", 2024-09-11T23:22:14.256 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.257 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.257 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.257 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "", 2024-09-11T23:22:14.257 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.257 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.257 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.257 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.257 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.257 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.257 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.257 INFO:teuthology.orchestra.run.smithi144.stdout: "zabbix_port": { 2024-09-11T23:22:14.257 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "zabbix_port", 2024-09-11T23:22:14.257 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "int", 2024-09-11T23:22:14.258 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.258 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.258 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "10051", 2024-09-11T23:22:14.258 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.258 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.258 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.258 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.258 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.258 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.258 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.258 INFO:teuthology.orchestra.run.smithi144.stdout: "zabbix_sender": { 2024-09-11T23:22:14.258 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "zabbix_sender", 2024-09-11T23:22:14.259 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "str", 2024-09-11T23:22:14.259 INFO:teuthology.orchestra.run.smithi144.stdout: "level": "advanced", 2024-09-11T23:22:14.259 INFO:teuthology.orchestra.run.smithi144.stdout: "flags": 0, 2024-09-11T23:22:14.259 INFO:teuthology.orchestra.run.smithi144.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T23:22:14.259 INFO:teuthology.orchestra.run.smithi144.stdout: "min": "", 2024-09-11T23:22:14.259 INFO:teuthology.orchestra.run.smithi144.stdout: "max": "", 2024-09-11T23:22:14.259 INFO:teuthology.orchestra.run.smithi144.stdout: "enum_allowed": [], 2024-09-11T23:22:14.259 INFO:teuthology.orchestra.run.smithi144.stdout: "desc": "", 2024-09-11T23:22:14.259 INFO:teuthology.orchestra.run.smithi144.stdout: "long_desc": "", 2024-09-11T23:22:14.259 INFO:teuthology.orchestra.run.smithi144.stdout: "tags": [], 2024-09-11T23:22:14.259 INFO:teuthology.orchestra.run.smithi144.stdout: "see_also": [] 2024-09-11T23:22:14.259 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.259 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.259 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.259 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.260 INFO:teuthology.orchestra.run.smithi144.stdout: "services": {}, 2024-09-11T23:22:14.260 INFO:teuthology.orchestra.run.smithi144.stdout: "always_on_modules": { 2024-09-11T23:22:14.260 INFO:teuthology.orchestra.run.smithi144.stdout: "octopus": [ 2024-09-11T23:22:14.260 INFO:teuthology.orchestra.run.smithi144.stdout: "balancer", 2024-09-11T23:22:14.260 INFO:teuthology.orchestra.run.smithi144.stdout: "crash", 2024-09-11T23:22:14.260 INFO:teuthology.orchestra.run.smithi144.stdout: "devicehealth", 2024-09-11T23:22:14.260 INFO:teuthology.orchestra.run.smithi144.stdout: "orchestrator", 2024-09-11T23:22:14.260 INFO:teuthology.orchestra.run.smithi144.stdout: "pg_autoscaler", 2024-09-11T23:22:14.260 INFO:teuthology.orchestra.run.smithi144.stdout: "progress", 2024-09-11T23:22:14.260 INFO:teuthology.orchestra.run.smithi144.stdout: "rbd_support", 2024-09-11T23:22:14.260 INFO:teuthology.orchestra.run.smithi144.stdout: "status", 2024-09-11T23:22:14.260 INFO:teuthology.orchestra.run.smithi144.stdout: "telemetry", 2024-09-11T23:22:14.260 INFO:teuthology.orchestra.run.smithi144.stdout: "volumes" 2024-09-11T23:22:14.260 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.261 INFO:teuthology.orchestra.run.smithi144.stdout: "pacific": [ 2024-09-11T23:22:14.261 INFO:teuthology.orchestra.run.smithi144.stdout: "balancer", 2024-09-11T23:22:14.261 INFO:teuthology.orchestra.run.smithi144.stdout: "crash", 2024-09-11T23:22:14.261 INFO:teuthology.orchestra.run.smithi144.stdout: "devicehealth", 2024-09-11T23:22:14.261 INFO:teuthology.orchestra.run.smithi144.stdout: "orchestrator", 2024-09-11T23:22:14.261 INFO:teuthology.orchestra.run.smithi144.stdout: "pg_autoscaler", 2024-09-11T23:22:14.261 INFO:teuthology.orchestra.run.smithi144.stdout: "progress", 2024-09-11T23:22:14.261 INFO:teuthology.orchestra.run.smithi144.stdout: "rbd_support", 2024-09-11T23:22:14.261 INFO:teuthology.orchestra.run.smithi144.stdout: "status", 2024-09-11T23:22:14.261 INFO:teuthology.orchestra.run.smithi144.stdout: "telemetry", 2024-09-11T23:22:14.261 INFO:teuthology.orchestra.run.smithi144.stdout: "volumes" 2024-09-11T23:22:14.261 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.261 INFO:teuthology.orchestra.run.smithi144.stdout: "quincy": [ 2024-09-11T23:22:14.261 INFO:teuthology.orchestra.run.smithi144.stdout: "balancer", 2024-09-11T23:22:14.261 INFO:teuthology.orchestra.run.smithi144.stdout: "crash", 2024-09-11T23:22:14.262 INFO:teuthology.orchestra.run.smithi144.stdout: "devicehealth", 2024-09-11T23:22:14.262 INFO:teuthology.orchestra.run.smithi144.stdout: "orchestrator", 2024-09-11T23:22:14.262 INFO:teuthology.orchestra.run.smithi144.stdout: "pg_autoscaler", 2024-09-11T23:22:14.262 INFO:teuthology.orchestra.run.smithi144.stdout: "progress", 2024-09-11T23:22:14.262 INFO:teuthology.orchestra.run.smithi144.stdout: "rbd_support", 2024-09-11T23:22:14.262 INFO:teuthology.orchestra.run.smithi144.stdout: "status", 2024-09-11T23:22:14.262 INFO:teuthology.orchestra.run.smithi144.stdout: "telemetry", 2024-09-11T23:22:14.262 INFO:teuthology.orchestra.run.smithi144.stdout: "volumes" 2024-09-11T23:22:14.262 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.262 INFO:teuthology.orchestra.run.smithi144.stdout: "reef": [ 2024-09-11T23:22:14.262 INFO:teuthology.orchestra.run.smithi144.stdout: "balancer", 2024-09-11T23:22:14.262 INFO:teuthology.orchestra.run.smithi144.stdout: "crash", 2024-09-11T23:22:14.262 INFO:teuthology.orchestra.run.smithi144.stdout: "devicehealth", 2024-09-11T23:22:14.262 INFO:teuthology.orchestra.run.smithi144.stdout: "orchestrator", 2024-09-11T23:22:14.262 INFO:teuthology.orchestra.run.smithi144.stdout: "pg_autoscaler", 2024-09-11T23:22:14.262 INFO:teuthology.orchestra.run.smithi144.stdout: "progress", 2024-09-11T23:22:14.263 INFO:teuthology.orchestra.run.smithi144.stdout: "rbd_support", 2024-09-11T23:22:14.263 INFO:teuthology.orchestra.run.smithi144.stdout: "status", 2024-09-11T23:22:14.263 INFO:teuthology.orchestra.run.smithi144.stdout: "telemetry", 2024-09-11T23:22:14.263 INFO:teuthology.orchestra.run.smithi144.stdout: "volumes" 2024-09-11T23:22:14.263 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:22:14.263 INFO:teuthology.orchestra.run.smithi144.stdout: "squid": [ 2024-09-11T23:22:14.263 INFO:teuthology.orchestra.run.smithi144.stdout: "balancer", 2024-09-11T23:22:14.263 INFO:teuthology.orchestra.run.smithi144.stdout: "crash", 2024-09-11T23:22:14.263 INFO:teuthology.orchestra.run.smithi144.stdout: "devicehealth", 2024-09-11T23:22:14.263 INFO:teuthology.orchestra.run.smithi144.stdout: "orchestrator", 2024-09-11T23:22:14.263 INFO:teuthology.orchestra.run.smithi144.stdout: "pg_autoscaler", 2024-09-11T23:22:14.263 INFO:teuthology.orchestra.run.smithi144.stdout: "progress", 2024-09-11T23:22:14.263 INFO:teuthology.orchestra.run.smithi144.stdout: "rbd_support", 2024-09-11T23:22:14.263 INFO:teuthology.orchestra.run.smithi144.stdout: "status", 2024-09-11T23:22:14.264 INFO:teuthology.orchestra.run.smithi144.stdout: "telemetry", 2024-09-11T23:22:14.264 INFO:teuthology.orchestra.run.smithi144.stdout: "volumes" 2024-09-11T23:22:14.264 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:22:14.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.264 INFO:teuthology.orchestra.run.smithi144.stdout: "last_failure_osd_epoch": 0, 2024-09-11T23:22:14.264 INFO:teuthology.orchestra.run.smithi144.stdout: "active_clients": [ 2024-09-11T23:22:14.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.264 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "devicehealth", 2024-09-11T23:22:14.264 INFO:teuthology.orchestra.run.smithi144.stdout: "addrvec": [ 2024-09-11T23:22:14.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.264 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v2", 2024-09-11T23:22:14.264 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:0", 2024-09-11T23:22:14.264 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 2791324222 2024-09-11T23:22:14.264 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.264 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:22:14.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.265 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "libcephsqlite", 2024-09-11T23:22:14.265 INFO:teuthology.orchestra.run.smithi144.stdout: "addrvec": [ 2024-09-11T23:22:14.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.265 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v2", 2024-09-11T23:22:14.265 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:0", 2024-09-11T23:22:14.265 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 898052131 2024-09-11T23:22:14.265 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.265 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:22:14.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.265 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "rbd_support", 2024-09-11T23:22:14.265 INFO:teuthology.orchestra.run.smithi144.stdout: "addrvec": [ 2024-09-11T23:22:14.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.266 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v2", 2024-09-11T23:22:14.266 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:0", 2024-09-11T23:22:14.266 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 4035581026 2024-09-11T23:22:14.266 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.266 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:22:14.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.266 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "volumes", 2024-09-11T23:22:14.266 INFO:teuthology.orchestra.run.smithi144.stdout: "addrvec": [ 2024-09-11T23:22:14.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.266 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v2", 2024-09-11T23:22:14.266 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:0", 2024-09-11T23:22:14.266 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 3284903152 2024-09-11T23:22:14.266 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.267 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:22:14.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.267 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "volumes", 2024-09-11T23:22:14.267 INFO:teuthology.orchestra.run.smithi144.stdout: "addrvec": [ 2024-09-11T23:22:14.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.267 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v2", 2024-09-11T23:22:14.267 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:0", 2024-09-11T23:22:14.267 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 871393845 2024-09-11T23:22:14.267 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.267 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:22:14.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.267 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "volumes", 2024-09-11T23:22:14.268 INFO:teuthology.orchestra.run.smithi144.stdout: "addrvec": [ 2024-09-11T23:22:14.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.268 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v2", 2024-09-11T23:22:14.268 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:0", 2024-09-11T23:22:14.268 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 690044521 2024-09-11T23:22:14.268 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.268 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:22:14.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.268 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "volumes", 2024-09-11T23:22:14.268 INFO:teuthology.orchestra.run.smithi144.stdout: "addrvec": [ 2024-09-11T23:22:14.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.268 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v2", 2024-09-11T23:22:14.268 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:0", 2024-09-11T23:22:14.269 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 2268096760 2024-09-11T23:22:14.269 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.269 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:22:14.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.269 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "volumes", 2024-09-11T23:22:14.269 INFO:teuthology.orchestra.run.smithi144.stdout: "addrvec": [ 2024-09-11T23:22:14.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.269 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v2", 2024-09-11T23:22:14.269 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:0", 2024-09-11T23:22:14.269 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 246653411 2024-09-11T23:22:14.269 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.269 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:22:14.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.270 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "volumes", 2024-09-11T23:22:14.270 INFO:teuthology.orchestra.run.smithi144.stdout: "addrvec": [ 2024-09-11T23:22:14.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.270 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v2", 2024-09-11T23:22:14.270 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:0", 2024-09-11T23:22:14.270 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 651214814 2024-09-11T23:22:14.270 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.270 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:22:14.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:14.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.270 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "volumes", 2024-09-11T23:22:14.270 INFO:teuthology.orchestra.run.smithi144.stdout: "addrvec": [ 2024-09-11T23:22:14.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:14.271 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "v2", 2024-09-11T23:22:14.271 INFO:teuthology.orchestra.run.smithi144.stdout: "addr": "172.21.15.144:0", 2024-09-11T23:22:14.271 INFO:teuthology.orchestra.run.smithi144.stdout: "nonce": 3549728794 2024-09-11T23:22:14.271 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.271 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:22:14.271 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:14.271 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:22:14.271 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:22:14.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.272+0000 7f1f11a00640 1 -- 172.21.15.144:0/3637285468 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1ee806c190 msgr2=0x7f1ee806e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:14.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.272+0000 7f1f11a00640 1 --2- 172.21.15.144:0/3637285468 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1ee806c190 0x7f1ee806e650 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1efc000f60 tx=0x7f1efc007c00 comp rx=0 tx=0).stop 2024-09-11T23:22:14.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.272+0000 7f1f11a00640 1 -- 172.21.15.144:0/3637285468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f0c0cf070 msgr2=0x7f1f0c0b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:14.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.272+0000 7f1f11a00640 1 --2- 172.21.15.144:0/3637285468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f0c0cf070 0x7f1f0c0b4f50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4000c00 tx=0x7f1ef40046c0 comp rx=0 tx=0).stop 2024-09-11T23:22:14.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.272+0000 7f1f11a00640 1 -- 172.21.15.144:0/3637285468 shutdown_connections 2024-09-11T23:22:14.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.272+0000 7f1f11a00640 1 --2- 172.21.15.144:0/3637285468 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7f1ee806c190 0x7f1ee806e650 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:14.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.272+0000 7f1f11a00640 1 --2- 172.21.15.144:0/3637285468 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1f0c15c180 0x7f1f0c0b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:14.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.272+0000 7f1f11a00640 1 --2- 172.21.15.144:0/3637285468 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f0c0cf070 0x7f1f0c0b4f50 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:14.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.272+0000 7f1f11a00640 1 --2- 172.21.15.144:0/3637285468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f0c073120 0x7f1f0c0b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:14.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.272+0000 7f1f11a00640 1 -- 172.21.15.144:0/3637285468 >> 172.21.15.144:0/3637285468 conn(0x7f1f0c062cc0 msgr2=0x7f1f0c159da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:14.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.272+0000 7f1f11a00640 1 -- 172.21.15.144:0/3637285468 shutdown_connections 2024-09-11T23:22:14.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:13.272+0000 7f1f11a00640 1 -- 172.21.15.144:0/3637285468 wait complete. 2024-09-11T23:22:14.278 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr fail y 2024-09-11T23:22:14.279 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:22:14.286 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:22:14.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.444+0000 7fe423e00640 1 Processor -- start 2024-09-11T23:22:14.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.445+0000 7fe423e00640 1 -- start start 2024-09-11T23:22:14.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.446+0000 7fe423e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe41c0cf070 0x7fe41c0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:14.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.446+0000 7fe423e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe41c0ce740 con 0x7fe41c073120 2024-09-11T23:22:14.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.446+0000 7fe423e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe41c072640 con 0x7fe41c15c180 2024-09-11T23:22:14.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.446+0000 7fe423e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe41c072920 con 0x7fe41c0cf070 2024-09-11T23:22:14.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.446+0000 7fe421e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe41c073120 0x7fe41c06bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43586/0 (socket says 172.21.15.144:43586) 2024-09-11T23:22:14.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.446+0000 7fe421e00640 1 -- 172.21.15.144:0/3923523510 learned_addr learned my addr 172.21.15.144:0/3923523510 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:14.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.446+0000 7fe420a00640 1 --2- 172.21.15.144:0/3923523510 >> v2:172.21.15.165:3300/0 conn(0x7fe41c0cf070 0x7fe41c0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:14.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.446+0000 7fe41be00640 1 -- 172.21.15.144:0/3923523510 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2142831152 0 0) 0x7fe41c0ce740 con 0x7fe41c073120 2024-09-11T23:22:14.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.446+0000 7fe41be00640 1 -- 172.21.15.144:0/3923523510 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe404003520 con 0x7fe41c073120 2024-09-11T23:22:14.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.447+0000 7fe420a00640 1 -- 172.21.15.144:0/3923523510 >> v1:172.21.15.165:6789/0 conn(0x7fe41c15c180 legacy=0x7fe41c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:14.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.447+0000 7fe420a00640 1 -- 172.21.15.144:0/3923523510 >> v1:172.21.15.144:6789/0 conn(0x7fe41c073120 legacy=0x7fe41c06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:14.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.447+0000 7fe420a00640 1 -- 172.21.15.144:0/3923523510 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe41c072c00 con 0x7fe41c0cf070 2024-09-11T23:22:14.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.448+0000 7fe420a00640 1 --2- 172.21.15.144:0/3923523510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe41c0cf070 0x7fe41c0cf4e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe4080097a0 tx=0x7fe40802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b7ddbef99ee23b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:14.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.448+0000 7fe41be00640 1 -- 172.21.15.144:0/3923523510 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe408037070 con 0x7fe41c0cf070 2024-09-11T23:22:14.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.448+0000 7fe41be00640 1 -- 172.21.15.144:0/3923523510 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe408032440 con 0x7fe41c0cf070 2024-09-11T23:22:14.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.448+0000 7fe41be00640 1 -- 172.21.15.144:0/3923523510 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4080327f0 con 0x7fe41c0cf070 2024-09-11T23:22:14.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.449+0000 7fe423e00640 1 -- 172.21.15.144:0/3923523510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe41c0cf070 msgr2=0x7fe41c0cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:14.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.449+0000 7fe423e00640 1 --2- 172.21.15.144:0/3923523510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe41c0cf070 0x7fe41c0cf4e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe4080097a0 tx=0x7fe40802a1a0 comp rx=0 tx=0).stop 2024-09-11T23:22:14.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.449+0000 7fe423e00640 1 -- 172.21.15.144:0/3923523510 shutdown_connections 2024-09-11T23:22:14.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.449+0000 7fe423e00640 1 --2- 172.21.15.144:0/3923523510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe41c0cf070 0x7fe41c0cf4e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:14.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.449+0000 7fe423e00640 1 -- 172.21.15.144:0/3923523510 >> 172.21.15.144:0/3923523510 conn(0x7fe41c062cc0 msgr2=0x7fe41c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:14.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.449+0000 7fe423e00640 1 -- 172.21.15.144:0/3923523510 shutdown_connections 2024-09-11T23:22:14.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.449+0000 7fe423e00640 1 -- 172.21.15.144:0/3923523510 wait complete. 2024-09-11T23:22:14.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.450+0000 7fe423e00640 1 Processor -- start 2024-09-11T23:22:14.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.450+0000 7fe423e00640 1 -- start start 2024-09-11T23:22:14.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.451+0000 7fe423e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe41c073120 0x7fe41c0b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:14.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.451+0000 7fe423e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe41c0cf070 0x7fe41c0b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:14.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.451+0000 7fe423e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe41c15c180 0x7fe41c14ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:14.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.451+0000 7fe423e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c0722f0 con 0x7fe41c073120 2024-09-11T23:22:14.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.451+0000 7fe423e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c0ced00 con 0x7fe41c0cf070 2024-09-11T23:22:14.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.451+0000 7fe423e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe41c15c560 con 0x7fe41c15c180 2024-09-11T23:22:14.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.452+0000 7fe421400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe41c073120 0x7fe41c0b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:14.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.452+0000 7fe421400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe41c073120 0x7fe41c0b0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47054/0 (socket says 172.21.15.144:47054) 2024-09-11T23:22:14.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.452+0000 7fe421400640 1 -- 172.21.15.144:0/1243946744 learned_addr learned my addr 172.21.15.144:0/1243946744 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:14.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.452+0000 7fe420a00640 1 --2- 172.21.15.144:0/1243946744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe41c0cf070 0x7fe41c0b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:14.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.452+0000 7fe421e00640 1 --2- 172.21.15.144:0/1243946744 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe41c15c180 0x7fe41c14ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:14.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.452+0000 7fe421400640 1 -- 172.21.15.144:0/1243946744 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe41c15c180 msgr2=0x7fe41c14ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:14.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.452+0000 7fe421400640 1 --2- 172.21.15.144:0/1243946744 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe41c15c180 0x7fe41c14ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:14.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.452+0000 7fe421400640 1 -- 172.21.15.144:0/1243946744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe41c0cf070 msgr2=0x7fe41c0b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:14.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.452+0000 7fe421400640 1 --2- 172.21.15.144:0/1243946744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe41c0cf070 0x7fe41c0b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:14.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.452+0000 7fe421400640 1 -- 172.21.15.144:0/1243946744 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe41c0b1e50 con 0x7fe41c073120 2024-09-11T23:22:14.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.452+0000 7fe421400640 1 --2- 172.21.15.144:0/1243946744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe41c073120 0x7fe41c0b0720 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe41000c730 tx=0x7fe41000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:14.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.452+0000 7fe419600640 1 -- 172.21.15.144:0/1243946744 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe410016020 con 0x7fe41c073120 2024-09-11T23:22:14.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.453+0000 7fe419600640 1 -- 172.21.15.144:0/1243946744 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe410006d50 con 0x7fe41c073120 2024-09-11T23:22:14.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.453+0000 7fe419600640 1 -- 172.21.15.144:0/1243946744 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe410003bb0 con 0x7fe41c073120 2024-09-11T23:22:14.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.453+0000 7fe423e00640 1 -- 172.21.15.144:0/1243946744 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe41c0b0db0 con 0x7fe41c073120 2024-09-11T23:22:14.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.453+0000 7fe423e00640 1 -- 172.21.15.144:0/1243946744 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe41c0b1370 con 0x7fe41c073120 2024-09-11T23:22:14.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.454+0000 7fe423e00640 1 -- 172.21.15.144:0/1243946744 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe41c0cf4e0 con 0x7fe41c073120 2024-09-11T23:22:14.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.455+0000 7fe419600640 1 -- 172.21.15.144:0/1243946744 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 12) ==== 90855+0+0 (secure 0 0 0) 0x7fe41000a850 con 0x7fe41c073120 2024-09-11T23:22:14.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.455+0000 7fe419600640 1 --2- 172.21.15.144:0/1243946744 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe3fc06c220 0x7fe3fc06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:14.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.455+0000 7fe419600640 1 -- 172.21.15.144:0/1243946744 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7fe41008b080 con 0x7fe41c073120 2024-09-11T23:22:14.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.456+0000 7fe420a00640 1 --2- 172.21.15.144:0/1243946744 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe3fc06c220 0x7fe3fc06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:14.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.456+0000 7fe420a00640 1 --2- 172.21.15.144:0/1243946744 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe3fc06c220 0x7fe3fc06e6e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe408034000 tx=0x7fe40802e000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:14.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.460+0000 7fe419600640 1 -- 172.21.15.144:0/1243946744 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe410020020 con 0x7fe41c073120 2024-09-11T23:22:14.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.680+0000 7fe423e00640 1 -- 172.21.15.144:0/1243946744 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "mgr fail", "who": "y"} v 0) -- 0x7fe41c1589a0 con 0x7fe41c073120 2024-09-11T23:22:14.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.685+0000 7fe419600640 1 -- 172.21.15.144:0/1243946744 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "mgr fail", "who": "y"}]=0 v13) ==== 68+0+0 (secure 0 0 0) 0x7fe410058e50 con 0x7fe41c073120 2024-09-11T23:22:14.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.688+0000 7fe419600640 1 -- 172.21.15.144:0/1243946744 <== mon.0 v2:172.21.15.144:3300/0 8 ==== mgrmap(e 13) ==== 45274+0+0 (secure 0 0 0) 0x7fe4100554c0 con 0x7fe41c073120 2024-09-11T23:22:14.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.688+0000 7fe419600640 1 -- 172.21.15.144:0/1243946744 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe3fc06c220 msgr2=0x7fe3fc06e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:14.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.688+0000 7fe419600640 1 --2- 172.21.15.144:0/1243946744 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe3fc06c220 0x7fe3fc06e6e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe408034000 tx=0x7fe40802e000 comp rx=0 tx=0).stop 2024-09-11T23:22:14.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.689+0000 7fe423e00640 1 -- 172.21.15.144:0/1243946744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe41c073120 msgr2=0x7fe41c0b0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:14.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.689+0000 7fe423e00640 1 --2- 172.21.15.144:0/1243946744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe41c073120 0x7fe41c0b0720 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe41000c730 tx=0x7fe41000cbf0 comp rx=0 tx=0).stop 2024-09-11T23:22:14.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.689+0000 7fe423e00640 1 -- 172.21.15.144:0/1243946744 shutdown_connections 2024-09-11T23:22:14.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.689+0000 7fe423e00640 1 --2- 172.21.15.144:0/1243946744 >> [v2:172.21.15.144:6800/1711334146,v1:172.21.15.144:6801/1711334146] conn(0x7fe3fc06c220 0x7fe3fc06e6e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:14.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.689+0000 7fe423e00640 1 --2- 172.21.15.144:0/1243946744 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe41c15c180 0x7fe41c14ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:14.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.689+0000 7fe423e00640 1 --2- 172.21.15.144:0/1243946744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe41c0cf070 0x7fe41c0b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:14.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.689+0000 7fe423e00640 1 --2- 172.21.15.144:0/1243946744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe41c073120 0x7fe41c0b0720 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:14.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.689+0000 7fe423e00640 1 -- 172.21.15.144:0/1243946744 >> 172.21.15.144:0/1243946744 conn(0x7fe41c062cc0 msgr2=0x7fe41c15fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:14.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.690+0000 7fe423e00640 1 -- 172.21.15.144:0/1243946744 shutdown_connections 2024-09-11T23:22:14.690 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:14.690+0000 7f9cece00640 -1 mgr handle_mgr_map I was active but no longer am 2024-09-11T23:22:14.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.690+0000 7fe423e00640 1 -- 172.21.15.144:0/1243946744 wait complete. 2024-09-11T23:22:14.724 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:22:14.801 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:22:14.802+0000 7f30e5a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:22:14.801 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:22:14.802+0000 7f30e5a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:22:14.801 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:22:14.802+0000 7f30e5a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:22:14.801 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:22:14.802+0000 7f30e5a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:22:14.801 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:22:14.802+0000 7f30e5a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:22:14.802 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:22:14.802+0000 7f30e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:22:14.802 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:22:14.802+0000 7f30e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:22:14.802 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:22:14.802+0000 7f30e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:22:14.802 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:22:14.803+0000 7f30e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:22:14.802 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:22:14.803+0000 7f30e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:22:14.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.899+0000 7f21c1a00640 1 Processor -- start 2024-09-11T23:22:14.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.899+0000 7f21c1a00640 1 -- start start 2024-09-11T23:22:14.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.900+0000 7f21c1a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f21bc073830 0x7f21bc0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:14.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.901+0000 7f21c1a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21bc0ce740 con 0x7f21bc0cf070 2024-09-11T23:22:14.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.901+0000 7f21c1a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21bc072640 con 0x7f21bc15c180 2024-09-11T23:22:14.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.901+0000 7f21c1a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f21bc072920 con 0x7f21bc073830 2024-09-11T23:22:14.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.901+0000 7f21b2000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f21bc0cf070 0x7f21bc073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43592/0 (socket says 172.21.15.144:43592) 2024-09-11T23:22:14.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.901+0000 7f21b2000640 1 -- 172.21.15.144:0/317578405 learned_addr learned my addr 172.21.15.144:0/317578405 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:14.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.901+0000 7f21bb400640 1 --2- 172.21.15.144:0/317578405 >> v2:172.21.15.165:3300/0 conn(0x7f21bc073830 0x7f21bc0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:14.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.901+0000 7f21bb400640 1 -- 172.21.15.144:0/317578405 >> v1:172.21.15.165:6789/0 conn(0x7f21bc15c180 legacy=0x7f21bc0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:14.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.901+0000 7f21bb400640 1 -- 172.21.15.144:0/317578405 >> v1:172.21.15.144:6789/0 conn(0x7f21bc0cf070 legacy=0x7f21bc073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:14.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.901+0000 7f21ba000640 1 -- 172.21.15.144:0/317578405 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1081562618 0 0) 0x7f21bc072640 con 0x7f21bc15c180 2024-09-11T23:22:14.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.901+0000 7f21bb400640 1 -- 172.21.15.144:0/317578405 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21bc072c00 con 0x7f21bc073830 2024-09-11T23:22:14.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.902+0000 7f21bb400640 1 --2- 172.21.15.144:0/317578405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21bc073830 0x7f21bc0cf4e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f21b40097a0 tx=0x7f21b402a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77dc0d3cc063cdd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:14.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.903+0000 7f21ba000640 1 -- 172.21.15.144:0/317578405 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b4037070 con 0x7f21bc073830 2024-09-11T23:22:14.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.903+0000 7f21ba000640 1 -- 172.21.15.144:0/317578405 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21b402ad30 con 0x7f21bc073830 2024-09-11T23:22:14.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.903+0000 7f21ba000640 1 -- 172.21.15.144:0/317578405 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b4032660 con 0x7f21bc073830 2024-09-11T23:22:14.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.903+0000 7f21c1a00640 1 -- 172.21.15.144:0/317578405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21bc073830 msgr2=0x7f21bc0cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:14.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.903+0000 7f21c1a00640 1 --2- 172.21.15.144:0/317578405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21bc073830 0x7f21bc0cf4e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f21b40097a0 tx=0x7f21b402a0a0 comp rx=0 tx=0).stop 2024-09-11T23:22:14.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.903+0000 7f21c1a00640 1 -- 172.21.15.144:0/317578405 shutdown_connections 2024-09-11T23:22:14.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.903+0000 7f21c1a00640 1 --2- 172.21.15.144:0/317578405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21bc073830 0x7f21bc0cf4e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:14.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.903+0000 7f21c1a00640 1 -- 172.21.15.144:0/317578405 >> 172.21.15.144:0/317578405 conn(0x7f21bc062cc0 msgr2=0x7f21bc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:14.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.903+0000 7f21c1a00640 1 -- 172.21.15.144:0/317578405 shutdown_connections 2024-09-11T23:22:14.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.903+0000 7f21c1a00640 1 -- 172.21.15.144:0/317578405 wait complete. 2024-09-11T23:22:14.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.905+0000 7f21c1a00640 1 Processor -- start 2024-09-11T23:22:14.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.905+0000 7f21c1a00640 1 -- start start 2024-09-11T23:22:14.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.906+0000 7f21c1a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21bc073830 0x7f21bc145d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:14.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.906+0000 7f21c1a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21bc0cf070 0x7f21bc1487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:14.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.906+0000 7f21c1a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21bc15c180 0x7f21bc1600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:14.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.906+0000 7f21c1a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f21bc0722f0 con 0x7f21bc073830 2024-09-11T23:22:14.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.906+0000 7f21c1a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f21bc0ced00 con 0x7f21bc0cf070 2024-09-11T23:22:14.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.906+0000 7f21c1a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f21bc15c560 con 0x7f21bc15c180 2024-09-11T23:22:14.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.906+0000 7f21baa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21bc073830 0x7f21bc145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:14.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.907+0000 7f21baa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21bc073830 0x7f21bc145d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47082/0 (socket says 172.21.15.144:47082) 2024-09-11T23:22:14.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.907+0000 7f21baa00640 1 -- 172.21.15.144:0/1070687718 learned_addr learned my addr 172.21.15.144:0/1070687718 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:14.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.907+0000 7f21b2000640 1 --2- 172.21.15.144:0/1070687718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21bc0cf070 0x7f21bc1487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:14.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.907+0000 7f21bb400640 1 --2- 172.21.15.144:0/1070687718 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21bc15c180 0x7f21bc1600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:14.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.907+0000 7f21baa00640 1 -- 172.21.15.144:0/1070687718 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21bc15c180 msgr2=0x7f21bc1600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:14.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.907+0000 7f21baa00640 1 --2- 172.21.15.144:0/1070687718 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21bc15c180 0x7f21bc1600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:14.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.907+0000 7f21baa00640 1 -- 172.21.15.144:0/1070687718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21bc0cf070 msgr2=0x7f21bc1487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:14.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.907+0000 7f21baa00640 1 --2- 172.21.15.144:0/1070687718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21bc0cf070 0x7f21bc1487c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:14.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.907+0000 7f21baa00640 1 -- 172.21.15.144:0/1070687718 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21bc148d00 con 0x7f21bc073830 2024-09-11T23:22:14.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.907+0000 7f21b2000640 1 --2- 172.21.15.144:0/1070687718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21bc0cf070 0x7f21bc1487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:22:14.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.907+0000 7f21baa00640 1 --2- 172.21.15.144:0/1070687718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21bc073830 0x7f21bc145d20 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f21ac00c7d0 tx=0x7f21ac00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:14.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.908+0000 7f21b3400640 1 -- 172.21.15.144:0/1070687718 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac003da0 con 0x7f21bc073830 2024-09-11T23:22:14.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.908+0000 7f21b3400640 1 -- 172.21.15.144:0/1070687718 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ac005070 con 0x7f21bc073830 2024-09-11T23:22:14.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.908+0000 7f21b3400640 1 -- 172.21.15.144:0/1070687718 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac005480 con 0x7f21bc073830 2024-09-11T23:22:14.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.908+0000 7f21c1a00640 1 -- 172.21.15.144:0/1070687718 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21bc0afa00 con 0x7f21bc073830 2024-09-11T23:22:14.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.908+0000 7f21c1a00640 1 -- 172.21.15.144:0/1070687718 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21bc0aff80 con 0x7f21bc073830 2024-09-11T23:22:14.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.909+0000 7f21b3400640 1 -- 172.21.15.144:0/1070687718 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 13) ==== 45274+0+0 (secure 0 0 0) 0x7f21ac005620 con 0x7f21bc073830 2024-09-11T23:22:14.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.909+0000 7f21c1a00640 1 -- 172.21.15.144:0/1070687718 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21bc0cfca0 con 0x7f21bc073830 2024-09-11T23:22:14.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.909+0000 7f21b3400640 1 -- 172.21.15.144:0/1070687718 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6268+0+0 (secure 0 0 0) 0x7f21ac04b530 con 0x7f21bc073830 2024-09-11T23:22:14.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:14.914+0000 7f21b3400640 1 -- 172.21.15.144:0/1070687718 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21bc148d00 con 0x7f21bc073830 2024-09-11T23:22:14.926 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:14.926+0000 7fefe8578040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T23:22:14.977 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:14.977+0000 7fefe8578040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T23:22:15.133 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.134+0000 7f21c1a00640 1 -- 172.21.15.144:0/1070687718 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21bc157b00 con 0x7f21bc073830 2024-09-11T23:22:15.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.134+0000 7f21b3400640 1 -- 172.21.15.144:0/1070687718 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5228 (secure 0 0 0) 0x7f21ac00a5e0 con 0x7f21bc073830 2024-09-11T23:22:15.134 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:15.134 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":47,"btime":"2024-09-11T23:22:09:289256+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5417,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/494282276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":494282276},{"type":"v1","addr":"172.21.15.165:6833","nonce":494282276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5827,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1734890696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":1734890696},{"type":"v1","addr":"172.21.15.165:6835","nonce":1734890696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1671926294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1671926294},{"type":"v1","addr":"172.21.15.144:6836","nonce":1671926294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:21:53.856502+0000","modified":"2024-09-11T23:21:56.886031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6093},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6093":{"gid":6093,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6837/97031260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":97031260},{"type":"v1","addr":"172.21.15.144:6837","nonce":97031260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6093,"qdb_cluster":[6093]},"id":5}]} 2024-09-11T23:22:15.135 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 47 2024-09-11T23:22:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.137+0000 7f21c1a00640 1 -- 172.21.15.144:0/1070687718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21bc073830 msgr2=0x7f21bc145d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.137+0000 7f21c1a00640 1 --2- 172.21.15.144:0/1070687718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21bc073830 0x7f21bc145d20 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f21ac00c7d0 tx=0x7f21ac00cc90 comp rx=0 tx=0).stop 2024-09-11T23:22:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.137+0000 7f21c1a00640 1 -- 172.21.15.144:0/1070687718 shutdown_connections 2024-09-11T23:22:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.137+0000 7f21c1a00640 1 --2- 172.21.15.144:0/1070687718 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21bc15c180 0x7f21bc1600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.137+0000 7f21c1a00640 1 --2- 172.21.15.144:0/1070687718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21bc0cf070 0x7f21bc1487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.137+0000 7f21c1a00640 1 --2- 172.21.15.144:0/1070687718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21bc073830 0x7f21bc145d20 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.137+0000 7f21c1a00640 1 -- 172.21.15.144:0/1070687718 >> 172.21.15.144:0/1070687718 conn(0x7f21bc062cc0 msgr2=0x7f21bc158490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:15.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.137+0000 7f21c1a00640 1 -- 172.21.15.144:0/1070687718 shutdown_connections 2024-09-11T23:22:15.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.137+0000 7f21c1a00640 1 -- 172.21.15.144:0/1070687718 wait complete. 2024-09-11T23:22:15.142 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:15.143+0000 7fefe8578040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T23:22:15.155 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-11T23:22:15.205 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:15.205+0000 7fefe8578040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T23:22:15.334 INFO:teuthology.orchestra.run.smithi144.stdout:[{"id":6381,"entity":{"name":{"type":"client","num":6381},"addr":{"type":"any","addr":"172.21.15.165:0","nonce":2738308570}},"state":"open","num_leases":0,"num_caps":2,"request_load_avg":2,"uptime":0.51399143899999999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":1.997649342225325,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":2,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6381 172.21.15.165:0/2738308570","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc","ceph_version":"ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)","entity_id":"x","hostname":"smithi165","pid":"35875","root":"/"}},{"id":5612,"entity":{"name":{"type":"client","num":5612},"addr":{"type":"any","addr":"172.21.15.165:0","nonce":3379837368}},"state":"open","num_leases":0,"num_caps":2,"request_load_avg":2,"uptime":0.51499142200000003,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":1.9976470344922077,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":2,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5612 172.21.15.165:0/3379837368","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc","ceph_version":"ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)","entity_id":"x","hostname":"smithi165","pid":"35875","root":"/"}}] 2024-09-11T23:22:15.334 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi165", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35875", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.165:0", "nonce": 2738308570, "type": "any" }, "name": { "num": 6381, "type": "client" } }, "id": 6381, "inst": "client.6381 172.21.15.165:0/2738308570", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 2, "num_caps": 2, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1.997649342225325 }, "state": "open", "uptime": 0.513991439 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi165", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "35875", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.165:0", "nonce": 3379837368, "type": "any" }, "name": { "num": 5612, "type": "client" } }, "id": 5612, "inst": "client.5612 172.21.15.165:0/3379837368", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 2, "num_caps": 2, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1.9976470344922077 }, "state": "open", "uptime": 0.514991422 } ] 2024-09-11T23:22:15.334 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-11T23:22:15.335 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:22:15.335 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:22:15.335 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:15.335+0000 7fefe8578040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:22:15.418 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:22:15.450 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:15.450+0000 7fefe8578040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T23:22:15.506 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:22:15.506 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:22:15.506 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:22:15.506 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:15.542 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:22:15.542 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:22:15.542 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:22:15.542 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:15.578 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:22:15.578 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:22:15.578 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:22:15.579 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:15.618 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:22:15.618 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:22:15.619 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:22:15.619 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:15.654 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:22:15.654 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:22:15.768 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:15.768+0000 7fefe8578040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T23:22:15.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.819+0000 7fe210000640 1 Processor -- start 2024-09-11T23:22:15.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.820+0000 7fe210000640 1 -- start start 2024-09-11T23:22:15.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.821+0000 7fe210000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe20815ca40 0x7fe20815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:15.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.821+0000 7fe210000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815ceb0 0x7fe2081594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:15.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.821+0000 7fe210000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe20815d390 con 0x7fe2080d02a0 2024-09-11T23:22:15.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.821+0000 7fe210000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe20815d670 con 0x7fe20815ca40 2024-09-11T23:22:15.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.821+0000 7fe210000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe20815d950 con 0x7fe20815ceb0 2024-09-11T23:22:15.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.821+0000 7fe20cc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe20815ca40 0x7fe20815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:15.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.821+0000 7fe20cc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe20815ca40 0x7fe20815e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:49144/0 (socket says 172.21.15.144:49144) 2024-09-11T23:22:15.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.821+0000 7fe20cc00640 1 -- 172.21.15.144:0/2635696385 learned_addr learned my addr 172.21.15.144:0/2635696385 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:15.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.821+0000 7fe20e000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815ceb0 0x7fe2081594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:15.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.821+0000 7fe20d600640 1 --1- 172.21.15.144:0/2635696385 >> v1:172.21.15.165:6789/0 conn(0x7fe2080d02a0 0x7fe2080d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:50926/0 (socket says 172.21.15.144:50926) 2024-09-11T23:22:15.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.822+0000 7fe20cc00640 1 -- 172.21.15.144:0/2635696385 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815ceb0 msgr2=0x7fe2081594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:15.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.822+0000 7fe20cc00640 1 --2- 172.21.15.144:0/2635696385 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815ceb0 0x7fe2081594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:15.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.822+0000 7fe20cc00640 1 -- 172.21.15.144:0/2635696385 >> v1:172.21.15.165:6789/0 conn(0x7fe2080d02a0 legacy=0x7fe2080d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:15.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.822+0000 7fe20cc00640 1 -- 172.21.15.144:0/2635696385 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe20815dc30 con 0x7fe20815ca40 2024-09-11T23:22:15.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.823+0000 7fe20cc00640 1 --2- 172.21.15.144:0/2635696385 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe20815ca40 0x7fe20815e430 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400bb10 tx=0x7fe1f402c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed2f7ab1db8652e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:15.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.823+0000 7fe207e00640 1 -- 172.21.15.144:0/2635696385 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4032790 con 0x7fe20815ca40 2024-09-11T23:22:15.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.823+0000 7fe207e00640 1 -- 172.21.15.144:0/2635696385 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f4038070 con 0x7fe20815ca40 2024-09-11T23:22:15.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.823+0000 7fe207e00640 1 -- 172.21.15.144:0/2635696385 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4032b50 con 0x7fe20815ca40 2024-09-11T23:22:15.823 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:15.823+0000 7fefe8578040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T23:22:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.823+0000 7fe210000640 1 -- 172.21.15.144:0/2635696385 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe20815ca40 msgr2=0x7fe20815e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.823+0000 7fe210000640 1 --2- 172.21.15.144:0/2635696385 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe20815ca40 0x7fe20815e430 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400bb10 tx=0x7fe1f402c890 comp rx=0 tx=0).stop 2024-09-11T23:22:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.824+0000 7fe210000640 1 -- 172.21.15.144:0/2635696385 shutdown_connections 2024-09-11T23:22:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.824+0000 7fe210000640 1 --2- 172.21.15.144:0/2635696385 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815ceb0 0x7fe2081594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.824+0000 7fe210000640 1 --2- 172.21.15.144:0/2635696385 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe20815ca40 0x7fe20815e430 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.824+0000 7fe210000640 1 -- 172.21.15.144:0/2635696385 >> 172.21.15.144:0/2635696385 conn(0x7fe208062cc0 msgr2=0x7fe20806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:15.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.824+0000 7fe210000640 1 -- 172.21.15.144:0/2635696385 shutdown_connections 2024-09-11T23:22:15.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.824+0000 7fe210000640 1 -- 172.21.15.144:0/2635696385 wait complete. 2024-09-11T23:22:15.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.825+0000 7fe210000640 1 Processor -- start 2024-09-11T23:22:15.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.825+0000 7fe210000640 1 -- start start 2024-09-11T23:22:15.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.826+0000 7fe210000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2080d02a0 0x7fe208141b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:15.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.826+0000 7fe210000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815ca40 0x7fe20815a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:15.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.826+0000 7fe210000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20815ceb0 0x7fe20815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:15.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.826+0000 7fe210000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe208155d10 con 0x7fe20815ceb0 2024-09-11T23:22:15.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.826+0000 7fe210000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe208155b90 con 0x7fe2080d02a0 2024-09-11T23:22:15.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.826+0000 7fe210000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe2080b4790 con 0x7fe20815ca40 2024-09-11T23:22:15.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.827+0000 7fe20e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20815ceb0 0x7fe20815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:15.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.827+0000 7fe20cc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815ca40 0x7fe20815a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:15.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.827+0000 7fe20d600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2080d02a0 0x7fe208141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:15.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.827+0000 7fe20e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20815ceb0 0x7fe20815aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47094/0 (socket says 172.21.15.144:47094) 2024-09-11T23:22:15.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.827+0000 7fe20e000640 1 -- 172.21.15.144:0/1374724801 learned_addr learned my addr 172.21.15.144:0/1374724801 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:15.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.827+0000 7fe20e000640 1 -- 172.21.15.144:0/1374724801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815ca40 msgr2=0x7fe20815a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:15.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.827+0000 7fe20e000640 1 --2- 172.21.15.144:0/1374724801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815ca40 0x7fe20815a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:15.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.827+0000 7fe20e000640 1 -- 172.21.15.144:0/1374724801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2080d02a0 msgr2=0x7fe208141b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.827+0000 7fe20e000640 1 --2- 172.21.15.144:0/1374724801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2080d02a0 0x7fe208141b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.827+0000 7fe20e000640 1 -- 172.21.15.144:0/1374724801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2080cd850 con 0x7fe20815ceb0 2024-09-11T23:22:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.827+0000 7fe20cc00640 1 --2- 172.21.15.144:0/1374724801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815ca40 0x7fe20815a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:22:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.827+0000 7fe20d600640 1 --2- 172.21.15.144:0/1374724801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2080d02a0 0x7fe208141b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:22:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.827+0000 7fe20e000640 1 --2- 172.21.15.144:0/1374724801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20815ceb0 0x7fe20815aa60 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe20000ef90 tx=0x7fe20000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.828+0000 7fe205600640 1 -- 172.21.15.144:0/1374724801 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe200018020 con 0x7fe20815ceb0 2024-09-11T23:22:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.828+0000 7fe205600640 1 -- 172.21.15.144:0/1374724801 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe200014480 con 0x7fe20815ceb0 2024-09-11T23:22:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.828+0000 7fe205600640 1 -- 172.21.15.144:0/1374724801 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe200014870 con 0x7fe20815ceb0 2024-09-11T23:22:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.828+0000 7fe210000640 1 -- 172.21.15.144:0/1374724801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2080cdb30 con 0x7fe20815ceb0 2024-09-11T23:22:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.828+0000 7fe210000640 1 -- 172.21.15.144:0/1374724801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2080ce0f0 con 0x7fe20815ceb0 2024-09-11T23:22:15.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.829+0000 7fe210000640 1 -- 172.21.15.144:0/1374724801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2080761a0 con 0x7fe20815ceb0 2024-09-11T23:22:15.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.829+0000 7fe205600640 1 -- 172.21.15.144:0/1374724801 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 14) ==== 45609+0+0 (secure 0 0 0) 0x7fe20001b020 con 0x7fe20815ceb0 2024-09-11T23:22:15.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.830+0000 7fe205600640 1 --2- 172.21.15.144:0/1374724801 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe1e8038200 0x7fe1e803a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:15.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.830+0000 7fe205600640 1 -- 172.21.15.144:0/1374724801 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6268+0+0 (secure 0 0 0) 0x7fe20004cbd0 con 0x7fe20815ceb0 2024-09-11T23:22:15.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.830+0000 7fe20d600640 1 --2- 172.21.15.144:0/1374724801 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe1e8038200 0x7fe1e803a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:15.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.831+0000 7fe20d600640 1 --2- 172.21.15.144:0/1374724801 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe1e8038200 0x7fe1e803a6c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc007fd0 tx=0x7fe1fc007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:15.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:15.835+0000 7fe205600640 1 -- 172.21.15.144:0/1374724801 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe200022020 con 0x7fe20815ceb0 2024-09-11T23:22:15.964 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:15.964+0000 7fefe8578040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T23:22:16.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.052+0000 7fe210000640 1 -- 172.21.15.144:0/1374724801 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2081420b0 con 0x7fe20815ceb0 2024-09-11T23:22:16.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.052+0000 7fe205600640 1 -- 172.21.15.144:0/1374724801 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5228 (secure 0 0 0) 0x7fe200010040 con 0x7fe20815ceb0 2024-09-11T23:22:16.052 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:16.052 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":47,"btime":"2024-09-11T23:22:09:289256+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5417,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/494282276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":494282276},{"type":"v1","addr":"172.21.15.165:6833","nonce":494282276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5827,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1734890696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":1734890696},{"type":"v1","addr":"172.21.15.165:6835","nonce":1734890696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1671926294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1671926294},{"type":"v1","addr":"172.21.15.144:6836","nonce":1671926294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:21:53.856502+0000","modified":"2024-09-11T23:21:56.886031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6093},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6093":{"gid":6093,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6837/97031260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":97031260},{"type":"v1","addr":"172.21.15.144:6837","nonce":97031260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6093,"qdb_cluster":[6093]},"id":5}]} 2024-09-11T23:22:16.053 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 47 2024-09-11T23:22:16.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.054+0000 7fe210000640 1 -- 172.21.15.144:0/1374724801 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe1e8038200 msgr2=0x7fe1e803a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:16.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.054+0000 7fe210000640 1 --2- 172.21.15.144:0/1374724801 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe1e8038200 0x7fe1e803a6c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc007fd0 tx=0x7fe1fc007e80 comp rx=0 tx=0).stop 2024-09-11T23:22:16.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.054+0000 7fe210000640 1 -- 172.21.15.144:0/1374724801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20815ceb0 msgr2=0x7fe20815aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:16.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.054+0000 7fe210000640 1 --2- 172.21.15.144:0/1374724801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20815ceb0 0x7fe20815aa60 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe20000ef90 tx=0x7fe20000c490 comp rx=0 tx=0).stop 2024-09-11T23:22:16.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.054+0000 7fe210000640 1 -- 172.21.15.144:0/1374724801 shutdown_connections 2024-09-11T23:22:16.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.055+0000 7fe210000640 1 --2- 172.21.15.144:0/1374724801 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe1e8038200 0x7fe1e803a6c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.055+0000 7fe210000640 1 --2- 172.21.15.144:0/1374724801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe20815ceb0 0x7fe20815aa60 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.055+0000 7fe210000640 1 --2- 172.21.15.144:0/1374724801 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe20815ca40 0x7fe20815a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.055+0000 7fe210000640 1 --2- 172.21.15.144:0/1374724801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2080d02a0 0x7fe208141b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.055+0000 7fe210000640 1 -- 172.21.15.144:0/1374724801 >> 172.21.15.144:0/1374724801 conn(0x7fe208062cc0 msgr2=0x7fe20806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:16.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.055+0000 7fe210000640 1 -- 172.21.15.144:0/1374724801 shutdown_connections 2024-09-11T23:22:16.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.055+0000 7fe210000640 1 -- 172.21.15.144:0/1374724801 wait complete. 2024-09-11T23:22:16.071 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:22:16.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.228+0000 7fa0b4200640 1 Processor -- start 2024-09-11T23:22:16.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.229+0000 7fa0b4200640 1 -- start start 2024-09-11T23:22:16.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.229+0000 7fa0b4200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0ac15e940 0x7fa0ac0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:16.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.230+0000 7fa0b4200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa0ac0cef90 0x7fa0ac0d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:16.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.230+0000 7fa0b4200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0ac0b7170 con 0x7fa0ac15ed20 2024-09-11T23:22:16.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.230+0000 7fa0b4200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa0ac0d1ae0 con 0x7fa0ac0cef90 2024-09-11T23:22:16.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.230+0000 7fa0b4200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa0ac0b7aa0 con 0x7fa0ac15e940 2024-09-11T23:22:16.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.230+0000 7fa0b2200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa0ac0cef90 0x7fa0ac0d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:16.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.230+0000 7fa0b2200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa0ac0cef90 0x7fa0ac0d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47108/0 (socket says 172.21.15.144:47108) 2024-09-11T23:22:16.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.230+0000 7fa0b1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0ac15e940 0x7fa0ac0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:16.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.230+0000 7fa0b2200640 1 -- 172.21.15.144:0/2520795891 learned_addr learned my addr 172.21.15.144:0/2520795891 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:16.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.230+0000 7fa0b1800640 1 -- 172.21.15.144:0/2520795891 >> v2:172.21.15.144:3300/0 conn(0x7fa0ac0cef90 msgr2=0x7fa0ac0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:16.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.230+0000 7fa0b1800640 1 --2- 172.21.15.144:0/2520795891 >> v2:172.21.15.144:3300/0 conn(0x7fa0ac0cef90 0x7fa0ac0d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.230+0000 7fa0b1800640 1 -- 172.21.15.144:0/2520795891 >> v1:172.21.15.165:6789/0 conn(0x7fa0ac15ed20 legacy=0x7fa0ac0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:16.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.230+0000 7fa0b1800640 1 -- 172.21.15.144:0/2520795891 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0ac0d3660 con 0x7fa0ac15e940 2024-09-11T23:22:16.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.231+0000 7fa0b1800640 1 --2- 172.21.15.144:0/2520795891 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0ac15e940 0x7fa0ac0d1060 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00097a0 tx=0x7fa0a002a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93a1d8697e88edf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:16.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.232+0000 7fa0abe00640 1 -- 172.21.15.144:0/2520795891 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0037070 con 0x7fa0ac15e940 2024-09-11T23:22:16.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.232+0000 7fa0abe00640 1 -- 172.21.15.144:0/2520795891 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a0032440 con 0x7fa0ac15e940 2024-09-11T23:22:16.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.232+0000 7fa0abe00640 1 -- 172.21.15.144:0/2520795891 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0032810 con 0x7fa0ac15e940 2024-09-11T23:22:16.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.232+0000 7fa0b4200640 1 -- 172.21.15.144:0/2520795891 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0ac15e940 msgr2=0x7fa0ac0d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:16.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.232+0000 7fa0b4200640 1 --2- 172.21.15.144:0/2520795891 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0ac15e940 0x7fa0ac0d1060 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00097a0 tx=0x7fa0a002a230 comp rx=0 tx=0).stop 2024-09-11T23:22:16.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.232+0000 7fa0b4200640 1 -- 172.21.15.144:0/2520795891 shutdown_connections 2024-09-11T23:22:16.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.232+0000 7fa0b4200640 1 --2- 172.21.15.144:0/2520795891 >> v2:172.21.15.144:3300/0 conn(0x7fa0ac0cef90 0x7fa0ac0d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.232+0000 7fa0b4200640 1 --2- 172.21.15.144:0/2520795891 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0ac15e940 0x7fa0ac0d1060 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.232+0000 7fa0b4200640 1 -- 172.21.15.144:0/2520795891 >> 172.21.15.144:0/2520795891 conn(0x7fa0ac0b6240 msgr2=0x7fa0ac0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:16.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.232+0000 7fa0b4200640 1 -- 172.21.15.144:0/2520795891 shutdown_connections 2024-09-11T23:22:16.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.233+0000 7fa0b4200640 1 -- 172.21.15.144:0/2520795891 wait complete. 2024-09-11T23:22:16.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.234+0000 7fa0b4200640 1 Processor -- start 2024-09-11T23:22:16.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.234+0000 7fa0b4200640 1 -- start start 2024-09-11T23:22:16.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.235+0000 7fa0b4200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0ac0cef90 0x7fa0ac0cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:16.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.235+0000 7fa0b4200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0ac15e940 0x7fa0ac156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:16.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.235+0000 7fa0b4200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0ac15ed20 0x7fa0ac154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:16.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.235+0000 7fa0b4200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ac0d3f00 con 0x7fa0ac15e940 2024-09-11T23:22:16.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.235+0000 7fa0b4200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ac0d3c20 con 0x7fa0ac15ed20 2024-09-11T23:22:16.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.235+0000 7fa0b4200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa0ac0d3310 con 0x7fa0ac0cef90 2024-09-11T23:22:16.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.235+0000 7fa0b0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0ac15e940 0x7fa0ac156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:16.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.235+0000 7fa0b1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0ac0cef90 0x7fa0ac0cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:16.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.235+0000 7fa0b0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0ac15e940 0x7fa0ac156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47118/0 (socket says 172.21.15.144:47118) 2024-09-11T23:22:16.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.235+0000 7fa0b0e00640 1 -- 172.21.15.144:0/2448463991 learned_addr learned my addr 172.21.15.144:0/2448463991 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:16.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.235+0000 7fa0b2200640 1 --2- 172.21.15.144:0/2448463991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0ac15ed20 0x7fa0ac154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:16.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.236+0000 7fa0b1800640 1 -- 172.21.15.144:0/2448463991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0ac15ed20 msgr2=0x7fa0ac154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:16.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.236+0000 7fa0b1800640 1 --2- 172.21.15.144:0/2448463991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0ac15ed20 0x7fa0ac154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.236+0000 7fa0b1800640 1 -- 172.21.15.144:0/2448463991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0ac15e940 msgr2=0x7fa0ac156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:16.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.236+0000 7fa0b1800640 1 --2- 172.21.15.144:0/2448463991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0ac15e940 0x7fa0ac156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.236+0000 7fa0b1800640 1 -- 172.21.15.144:0/2448463991 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0ac0cb4b0 con 0x7fa0ac0cef90 2024-09-11T23:22:16.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.236+0000 7fa0b0e00640 1 --2- 172.21.15.144:0/2448463991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0ac15e940 0x7fa0ac156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:22:16.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.236+0000 7fa0b1800640 1 --2- 172.21.15.144:0/2448463991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0ac0cef90 0x7fa0ac0cadf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0031000 tx=0x7fa0a00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:16.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.236+0000 7fa0a9600640 1 -- 172.21.15.144:0/2448463991 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0041030 con 0x7fa0ac0cef90 2024-09-11T23:22:16.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.236+0000 7fa0a9600640 1 -- 172.21.15.144:0/2448463991 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a0030500 con 0x7fa0ac0cef90 2024-09-11T23:22:16.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.236+0000 7fa0b4200640 1 -- 172.21.15.144:0/2448463991 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0ac15b400 con 0x7fa0ac0cef90 2024-09-11T23:22:16.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.237+0000 7fa0b4200640 1 -- 172.21.15.144:0/2448463991 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0ac15b9c0 con 0x7fa0ac0cef90 2024-09-11T23:22:16.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.236+0000 7fa0a9600640 1 -- 172.21.15.144:0/2448463991 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0037040 con 0x7fa0ac0cef90 2024-09-11T23:22:16.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.238+0000 7fa0a9600640 1 -- 172.21.15.144:0/2448463991 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 14) ==== 45609+0+0 (secure 0 0 0) 0x7fa0a0044070 con 0x7fa0ac0cef90 2024-09-11T23:22:16.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.238+0000 7fa0b4200640 1 -- 172.21.15.144:0/2448463991 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0ac0d1f80 con 0x7fa0ac0cef90 2024-09-11T23:22:16.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.238+0000 7fa0a9600640 1 --2- 172.21.15.144:0/2448463991 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa08c038200 0x7fa08c03a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:16.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.238+0000 7fa0a9600640 1 -- 172.21.15.144:0/2448463991 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(72..72 src has 1..72) ==== 6268+0+0 (secure 0 0 0) 0x7fa0a006c290 con 0x7fa0ac0cef90 2024-09-11T23:22:16.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.238+0000 7fa0b0e00640 1 --2- 172.21.15.144:0/2448463991 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa08c038200 0x7fa08c03a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:16.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.239+0000 7fa0b0e00640 1 --2- 172.21.15.144:0/2448463991 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa08c038200 0x7fa08c03a6c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac0cb7b0 tx=0x7fa098009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:16.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.244+0000 7fa0a9600640 1 -- 172.21.15.144:0/2448463991 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa0a00308d0 con 0x7fa0ac0cef90 2024-09-11T23:22:16.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.461+0000 7fa0b4200640 1 -- 172.21.15.144:0/2448463991 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0ac0ba6b0 con 0x7fa0ac0cef90 2024-09-11T23:22:16.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.462+0000 7fa0a9600640 1 -- 172.21.15.144:0/2448463991 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5228 (secure 0 0 0) 0x7fa0a003d420 con 0x7fa0ac0cef90 2024-09-11T23:22:16.462 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:16.463 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":47,"btime":"2024-09-11T23:22:09:289256+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5417,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/494282276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":494282276},{"type":"v1","addr":"172.21.15.165:6833","nonce":494282276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5827,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1734890696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":1734890696},{"type":"v1","addr":"172.21.15.165:6835","nonce":1734890696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1671926294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1671926294},{"type":"v1","addr":"172.21.15.144:6836","nonce":1671926294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:21:53.856502+0000","modified":"2024-09-11T23:21:56.886031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6093},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6093":{"gid":6093,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6837/97031260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":97031260},{"type":"v1","addr":"172.21.15.144:6837","nonce":97031260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6093,"qdb_cluster":[6093]},"id":5}]} 2024-09-11T23:22:16.463 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 47 2024-09-11T23:22:16.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.465+0000 7fa0b4200640 1 -- 172.21.15.144:0/2448463991 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa08c038200 msgr2=0x7fa08c03a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:16.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.465+0000 7fa0b4200640 1 --2- 172.21.15.144:0/2448463991 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa08c038200 0x7fa08c03a6c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac0cb7b0 tx=0x7fa098009040 comp rx=0 tx=0).stop 2024-09-11T23:22:16.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.465+0000 7fa0b4200640 1 -- 172.21.15.144:0/2448463991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0ac0cef90 msgr2=0x7fa0ac0cadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:16.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.465+0000 7fa0b4200640 1 --2- 172.21.15.144:0/2448463991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0ac0cef90 0x7fa0ac0cadf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0031000 tx=0x7fa0a00046c0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.465+0000 7fa0b4200640 1 -- 172.21.15.144:0/2448463991 shutdown_connections 2024-09-11T23:22:16.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.465+0000 7fa0b4200640 1 --2- 172.21.15.144:0/2448463991 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa08c038200 0x7fa08c03a6c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.465+0000 7fa0b4200640 1 --2- 172.21.15.144:0/2448463991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0ac15ed20 0x7fa0ac154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.465+0000 7fa0b4200640 1 --2- 172.21.15.144:0/2448463991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0ac15e940 0x7fa0ac156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.465+0000 7fa0b4200640 1 --2- 172.21.15.144:0/2448463991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0ac0cef90 0x7fa0ac0cadf0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.465+0000 7fa0b4200640 1 -- 172.21.15.144:0/2448463991 >> 172.21.15.144:0/2448463991 conn(0x7fa0ac0b6240 msgr2=0x7fa0ac0b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:16.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.465+0000 7fa0b4200640 1 -- 172.21.15.144:0/2448463991 shutdown_connections 2024-09-11T23:22:16.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.465+0000 7fa0b4200640 1 -- 172.21.15.144:0/2448463991 wait complete. 2024-09-11T23:22:16.481 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:22:16.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.636+0000 7ff46e800640 1 Processor -- start 2024-09-11T23:22:16.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.636+0000 7ff46e800640 1 -- start start 2024-09-11T23:22:16.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.637+0000 7ff46e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff46815e860 0x7ff4680cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:16.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.637+0000 7ff46e800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff4680b8ab0 0x7ff4680b6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:16.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.637+0000 7ff46e800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4680d34d0 con 0x7ff4680b61f0 2024-09-11T23:22:16.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.637+0000 7ff46e800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff4680b6b80 con 0x7ff46815e860 2024-09-11T23:22:16.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.637+0000 7ff46e800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff4680d3790 con 0x7ff4680b8ab0 2024-09-11T23:22:16.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.637+0000 7ff467400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff46815e860 0x7ff4680cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:16.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.637+0000 7ff467400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff46815e860 0x7ff4680cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47132/0 (socket says 172.21.15.144:47132) 2024-09-11T23:22:16.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.637+0000 7ff467400640 1 -- 172.21.15.144:0/2838589497 learned_addr learned my addr 172.21.15.144:0/2838589497 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:16.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.638+0000 7ff467400640 1 -- 172.21.15.144:0/2838589497 >> v2:172.21.15.165:3300/0 conn(0x7ff4680b8ab0 msgr2=0x7ff4680b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:16.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.638+0000 7ff467e00640 1 --2- 172.21.15.144:0/2838589497 >> v2:172.21.15.165:3300/0 conn(0x7ff4680b8ab0 0x7ff4680b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:16.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.638+0000 7ff467400640 1 --2- 172.21.15.144:0/2838589497 >> v2:172.21.15.165:3300/0 conn(0x7ff4680b8ab0 0x7ff4680b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.638+0000 7ff467400640 1 -- 172.21.15.144:0/2838589497 >> v1:172.21.15.165:6789/0 conn(0x7ff4680b61f0 legacy=0x7ff46806c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:16.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.638+0000 7ff467400640 1 -- 172.21.15.144:0/2838589497 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4680d3a70 con 0x7ff46815e860 2024-09-11T23:22:16.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.638+0000 7ff467e00640 1 --2- 172.21.15.144:0/2838589497 >> v2:172.21.15.165:3300/0 conn(0x7ff4680b8ab0 0x7ff4680b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:22:16.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.639+0000 7ff467400640 1 --2- 172.21.15.144:0/2838589497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff46815e860 0x7ff4680cf720 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff4680b38d0 tx=0x7ff45802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d016593f980270 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:16.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.639+0000 7ff466000640 1 -- 172.21.15.144:0/2838589497 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458037070 con 0x7ff46815e860 2024-09-11T23:22:16.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.639+0000 7ff466000640 1 -- 172.21.15.144:0/2838589497 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff458032440 con 0x7ff46815e860 2024-09-11T23:22:16.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.639+0000 7ff466000640 1 -- 172.21.15.144:0/2838589497 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458032810 con 0x7ff46815e860 2024-09-11T23:22:16.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.640+0000 7ff46e800640 1 -- 172.21.15.144:0/2838589497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff46815e860 msgr2=0x7ff4680cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:16.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.640+0000 7ff46e800640 1 --2- 172.21.15.144:0/2838589497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff46815e860 0x7ff4680cf720 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff4680b38d0 tx=0x7ff45802a2c0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.640+0000 7ff46e800640 1 -- 172.21.15.144:0/2838589497 shutdown_connections 2024-09-11T23:22:16.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.640+0000 7ff46e800640 1 --2- 172.21.15.144:0/2838589497 >> v2:172.21.15.165:3300/0 conn(0x7ff4680b8ab0 0x7ff4680b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.640+0000 7ff46e800640 1 --2- 172.21.15.144:0/2838589497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff46815e860 0x7ff4680cf720 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.640+0000 7ff46e800640 1 -- 172.21.15.144:0/2838589497 >> 172.21.15.144:0/2838589497 conn(0x7ff468062c60 msgr2=0x7ff4680d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:16.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.640+0000 7ff46e800640 1 -- 172.21.15.144:0/2838589497 shutdown_connections 2024-09-11T23:22:16.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.640+0000 7ff46e800640 1 -- 172.21.15.144:0/2838589497 wait complete. 2024-09-11T23:22:16.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.642+0000 7ff46e800640 1 Processor -- start 2024-09-11T23:22:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.642+0000 7ff46e800640 1 -- start start 2024-09-11T23:22:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.643+0000 7ff46e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4680b61f0 0x7ff4680cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.643+0000 7ff46e800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4680b8ab0 0x7ff4680cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.643+0000 7ff46e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff46815e860 0x7ff468151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.643+0000 7ff46e800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff4680d4310 con 0x7ff4680b61f0 2024-09-11T23:22:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.643+0000 7ff46e800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff4680d4030 con 0x7ff4680b8ab0 2024-09-11T23:22:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.643+0000 7ff46e800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff46815ec40 con 0x7ff46815e860 2024-09-11T23:22:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.643+0000 7ff467400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4680b61f0 0x7ff4680cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.643+0000 7ff467400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4680b61f0 0x7ff4680cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47140/0 (socket says 172.21.15.144:47140) 2024-09-11T23:22:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.643+0000 7ff467400640 1 -- 172.21.15.144:0/939955778 learned_addr learned my addr 172.21.15.144:0/939955778 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.643+0000 7ff466a00640 1 --2- 172.21.15.144:0/939955778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4680b8ab0 0x7ff4680cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:16.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.643+0000 7ff467e00640 1 --2- 172.21.15.144:0/939955778 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff46815e860 0x7ff468151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.643+0000 7ff467400640 1 -- 172.21.15.144:0/939955778 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff46815e860 msgr2=0x7ff468151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.643+0000 7ff467400640 1 --2- 172.21.15.144:0/939955778 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff46815e860 0x7ff468151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.643+0000 7ff467400640 1 -- 172.21.15.144:0/939955778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4680b8ab0 msgr2=0x7ff4680cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.643+0000 7ff467400640 1 --2- 172.21.15.144:0/939955778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4680b8ab0 0x7ff4680cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.643+0000 7ff467400640 1 -- 172.21.15.144:0/939955778 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4680cd960 con 0x7ff4680b61f0 2024-09-11T23:22:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.643+0000 7ff466a00640 1 --2- 172.21.15.144:0/939955778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4680b8ab0 0x7ff4680cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.643+0000 7ff467e00640 1 --2- 172.21.15.144:0/939955778 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff46815e860 0x7ff468151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.644+0000 7ff467400640 1 --2- 172.21.15.144:0/939955778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4680b61f0 0x7ff4680cd2a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff458000c00 tx=0x7ff4580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.644+0000 7ff45f400640 1 -- 172.21.15.144:0/939955778 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458041020 con 0x7ff4680b61f0 2024-09-11T23:22:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.644+0000 7ff45f400640 1 -- 172.21.15.144:0/939955778 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff458030970 con 0x7ff4680b61f0 2024-09-11T23:22:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.644+0000 7ff45f400640 1 -- 172.21.15.144:0/939955778 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458037040 con 0x7ff4680b61f0 2024-09-11T23:22:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.644+0000 7ff46e800640 1 -- 172.21.15.144:0/939955778 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4680cdc40 con 0x7ff4680b61f0 2024-09-11T23:22:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.644+0000 7ff46e800640 1 -- 172.21.15.144:0/939955778 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4680c8670 con 0x7ff4680b61f0 2024-09-11T23:22:16.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.645+0000 7ff46e800640 1 -- 172.21.15.144:0/939955778 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4680b3ad0 con 0x7ff4680b61f0 2024-09-11T23:22:16.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.646+0000 7ff45f400640 1 -- 172.21.15.144:0/939955778 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 14) ==== 45609+0+0 (secure 0 0 0) 0x7ff458044020 con 0x7ff4680b61f0 2024-09-11T23:22:16.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.646+0000 7ff45f400640 1 --2- 172.21.15.144:0/939955778 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff448038200 0x7ff44803a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:16.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.646+0000 7ff45f400640 1 -- 172.21.15.144:0/939955778 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6268+0+0 (secure 0 0 0) 0x7ff45806c580 con 0x7ff4680b61f0 2024-09-11T23:22:16.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.647+0000 7ff466a00640 1 --2- 172.21.15.144:0/939955778 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff448038200 0x7ff44803a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:16.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.647+0000 7ff466a00640 1 --2- 172.21.15.144:0/939955778 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff448038200 0x7ff44803a6c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff454006fd0 tx=0x7ff454008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:16.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.651+0000 7ff45f400640 1 -- 172.21.15.144:0/939955778 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff45804b030 con 0x7ff4680b61f0 2024-09-11T23:22:16.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.837+0000 7ff46e800640 1 -- 172.21.15.144:0/939955778 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4680d2700 con 0x7ff4680b61f0 2024-09-11T23:22:16.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.838+0000 7ff45f400640 1 -- 172.21.15.144:0/939955778 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+17571 (secure 0 0 0) 0x7ff458031e80 con 0x7ff4680b61f0 2024-09-11T23:22:16.838 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:16.838 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":72,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:22:14.682052+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:21:52.048862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-11T23:21:52.855489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:0/3284903152":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/651214814":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/246653411":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/2886766475":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/4035581026":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/690044521":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/871393845":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/2268096760":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/898052131":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/2791324222":"2024-09-12T23:22:14.682014+0000","172.21.15.144:6801/1711334146":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/3549728794":"2024-09-12T23:22:14.682014+0000","172.21.15.144:6800/1711334146":"2024-09-12T23:22:14.682014+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:22:16.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.840+0000 7ff46e800640 1 -- 172.21.15.144:0/939955778 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff448038200 msgr2=0x7ff44803a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:16.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.840+0000 7ff46e800640 1 --2- 172.21.15.144:0/939955778 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff448038200 0x7ff44803a6c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff454006fd0 tx=0x7ff454008040 comp rx=0 tx=0).stop 2024-09-11T23:22:16.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.840+0000 7ff46e800640 1 -- 172.21.15.144:0/939955778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4680b61f0 msgr2=0x7ff4680cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:16.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.840+0000 7ff46e800640 1 --2- 172.21.15.144:0/939955778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4680b61f0 0x7ff4680cd2a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff458000c00 tx=0x7ff4580046c0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.840+0000 7ff46e800640 1 -- 172.21.15.144:0/939955778 shutdown_connections 2024-09-11T23:22:16.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.840+0000 7ff46e800640 1 --2- 172.21.15.144:0/939955778 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff448038200 0x7ff44803a6c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.840+0000 7ff46e800640 1 --2- 172.21.15.144:0/939955778 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff46815e860 0x7ff468151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.840+0000 7ff46e800640 1 --2- 172.21.15.144:0/939955778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4680b8ab0 0x7ff4680cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.840+0000 7ff46e800640 1 --2- 172.21.15.144:0/939955778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4680b61f0 0x7ff4680cd2a0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:16.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.840+0000 7ff46e800640 1 -- 172.21.15.144:0/939955778 >> 172.21.15.144:0/939955778 conn(0x7ff468062c60 msgr2=0x7ff4680b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:16.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.840+0000 7ff46e800640 1 -- 172.21.15.144:0/939955778 shutdown_connections 2024-09-11T23:22:16.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:16.840+0000 7ff46e800640 1 -- 172.21.15.144:0/939955778 wait complete. 2024-09-11T23:22:16.857 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:22:16.857 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:22:16.892 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:16.893+0000 7fefe8578040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T23:22:16.948 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:16.948+0000 7fefe8578040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T23:22:17.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.015+0000 7f204e800640 1 Processor -- start 2024-09-11T23:22:17.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.015+0000 7f204e800640 1 -- start start 2024-09-11T23:22:17.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.016+0000 7f204e800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f204815e640 0x7f20480d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:17.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.017+0000 7f204e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20480b66e0 0x7f20480b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:17.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.017+0000 7f204e800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f204806bee0 con 0x7f20480d3f60 2024-09-11T23:22:17.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.017+0000 7f204e800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f204815ea20 con 0x7f20480b66e0 2024-09-11T23:22:17.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.017+0000 7f204e800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f204806caf0 con 0x7f204815e640 2024-09-11T23:22:17.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.017+0000 7f204de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20480b66e0 0x7f20480b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:17.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.017+0000 7f204de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20480b66e0 0x7f20480b7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47152/0 (socket says 172.21.15.144:47152) 2024-09-11T23:22:17.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.017+0000 7f204de00640 1 -- 172.21.15.144:0/44343630 learned_addr learned my addr 172.21.15.144:0/44343630 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:17.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.017+0000 7f204d400640 1 --2- 172.21.15.144:0/44343630 >> v2:172.21.15.165:3300/0 conn(0x7f204815e640 0x7f20480d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:17.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.017+0000 7f204de00640 1 -- 172.21.15.144:0/44343630 >> v2:172.21.15.165:3300/0 conn(0x7f204815e640 msgr2=0x7f20480d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:17.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.017+0000 7f204de00640 1 --2- 172.21.15.144:0/44343630 >> v2:172.21.15.165:3300/0 conn(0x7f204815e640 0x7f20480d3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.017+0000 7f204de00640 1 -- 172.21.15.144:0/44343630 >> v1:172.21.15.165:6789/0 conn(0x7f20480d3f60 legacy=0x7f20480b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:17.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.017+0000 7f204de00640 1 -- 172.21.15.144:0/44343630 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f204806c1c0 con 0x7f20480b66e0 2024-09-11T23:22:17.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.018+0000 7f204de00640 1 --2- 172.21.15.144:0/44343630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20480b66e0 0x7f20480b7750 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f20480d2030 tx=0x7f204002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3868ee56004ba405 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:17.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.019+0000 7f2047e00640 1 -- 172.21.15.144:0/44343630 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2040036070 con 0x7f20480b66e0 2024-09-11T23:22:17.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.019+0000 7f2047e00640 1 -- 172.21.15.144:0/44343630 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2040031600 con 0x7f20480b66e0 2024-09-11T23:22:17.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.019+0000 7f2047e00640 1 -- 172.21.15.144:0/44343630 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20400319d0 con 0x7f20480b66e0 2024-09-11T23:22:17.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.019+0000 7f204e800640 1 -- 172.21.15.144:0/44343630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20480b66e0 msgr2=0x7f20480b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:17.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.019+0000 7f204e800640 1 --2- 172.21.15.144:0/44343630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20480b66e0 0x7f20480b7750 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f20480d2030 tx=0x7f204002a730 comp rx=0 tx=0).stop 2024-09-11T23:22:17.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.019+0000 7f204e800640 1 -- 172.21.15.144:0/44343630 shutdown_connections 2024-09-11T23:22:17.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.019+0000 7f204e800640 1 --2- 172.21.15.144:0/44343630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20480b66e0 0x7f20480b7750 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.019+0000 7f204e800640 1 --2- 172.21.15.144:0/44343630 >> v2:172.21.15.165:3300/0 conn(0x7f204815e640 0x7f20480d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.019+0000 7f204e800640 1 -- 172.21.15.144:0/44343630 >> 172.21.15.144:0/44343630 conn(0x7f20480d0fd0 msgr2=0x7f20480d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:17.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.019+0000 7f204e800640 1 -- 172.21.15.144:0/44343630 shutdown_connections 2024-09-11T23:22:17.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.019+0000 7f204e800640 1 -- 172.21.15.144:0/44343630 wait complete. 2024-09-11T23:22:17.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.021+0000 7f204e800640 1 Processor -- start 2024-09-11T23:22:17.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.021+0000 7f204e800640 1 -- start start 2024-09-11T23:22:17.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.022+0000 7f204e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20480b66e0 0x7f204814c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:17.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.022+0000 7f204e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20480d3f60 0x7f20481606a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:17.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.022+0000 7f204e800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f204815e640 0x7f20480b8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:17.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.022+0000 7f204e800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f20480b7c90 con 0x7f20480b66e0 2024-09-11T23:22:17.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.022+0000 7f204e800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f204806c780 con 0x7f204815e640 2024-09-11T23:22:17.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.022+0000 7f204e800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f20480b7e10 con 0x7f20480d3f60 2024-09-11T23:22:17.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.022+0000 7f204d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20480b66e0 0x7f204814c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:17.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.022+0000 7f204d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20480b66e0 0x7f204814c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47160/0 (socket says 172.21.15.144:47160) 2024-09-11T23:22:17.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.022+0000 7f204d400640 1 -- 172.21.15.144:0/2839481698 learned_addr learned my addr 172.21.15.144:0/2839481698 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:17.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.022+0000 7f204ca00640 1 --2- 172.21.15.144:0/2839481698 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20480d3f60 0x7f20481606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:17.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.022+0000 7f204de00640 1 --2- 172.21.15.144:0/2839481698 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f204815e640 0x7f20480b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:17.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.023+0000 7f204d400640 1 -- 172.21.15.144:0/2839481698 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20480d3f60 msgr2=0x7f20481606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:17.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.023+0000 7f204d400640 1 --2- 172.21.15.144:0/2839481698 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20480d3f60 0x7f20481606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.023+0000 7f204d400640 1 -- 172.21.15.144:0/2839481698 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f204815e640 msgr2=0x7f20480b8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:17.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.023+0000 7f204d400640 1 --2- 172.21.15.144:0/2839481698 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f204815e640 0x7f20480b8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.023+0000 7f204d400640 1 -- 172.21.15.144:0/2839481698 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20480cdf40 con 0x7f20480b66e0 2024-09-11T23:22:17.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.023+0000 7f204d400640 1 --2- 172.21.15.144:0/2839481698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20480b66e0 0x7f204814c9e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f203c00e870 tx=0x7f203c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:17.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.023+0000 7f2045600640 1 -- 172.21.15.144:0/2839481698 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c017070 con 0x7f20480b66e0 2024-09-11T23:22:17.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.023+0000 7f2045600640 1 -- 172.21.15.144:0/2839481698 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f203c00c940 con 0x7f20480b66e0 2024-09-11T23:22:17.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.023+0000 7f2045600640 1 -- 172.21.15.144:0/2839481698 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203c00cd30 con 0x7f20480b66e0 2024-09-11T23:22:17.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.023+0000 7f204e800640 1 -- 172.21.15.144:0/2839481698 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20480cb620 con 0x7f20480b66e0 2024-09-11T23:22:17.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.024+0000 7f204e800640 1 -- 172.21.15.144:0/2839481698 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20480cbbe0 con 0x7f20480b66e0 2024-09-11T23:22:17.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.025+0000 7f2045600640 1 -- 172.21.15.144:0/2839481698 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 14) ==== 45609+0+0 (secure 0 0 0) 0x7f203c01a070 con 0x7f20480b66e0 2024-09-11T23:22:17.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.025+0000 7f204e800640 1 -- 172.21.15.144:0/2839481698 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20480b7750 con 0x7f20480b66e0 2024-09-11T23:22:17.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.025+0000 7f2045600640 1 --2- 172.21.15.144:0/2839481698 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2028038200 0x7f202803a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:17.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.025+0000 7f2045600640 1 -- 172.21.15.144:0/2839481698 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6268+0+0 (secure 0 0 0) 0x7f203c04ba60 con 0x7f20480b66e0 2024-09-11T23:22:17.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.025+0000 7f204ca00640 1 --2- 172.21.15.144:0/2839481698 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2028038200 0x7f202803a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:17.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.026+0000 7f204ca00640 1 --2- 172.21.15.144:0/2839481698 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2028038200 0x7f202803a6c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f20480b99d0 tx=0x7f2034009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:17.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.030+0000 7f2045600640 1 -- 172.21.15.144:0/2839481698 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f203c011350 con 0x7f20480b66e0 2024-09-11T23:22:17.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.246+0000 7f204e800640 1 -- 172.21.15.144:0/2839481698 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20480d0630 con 0x7f20480b66e0 2024-09-11T23:22:17.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.246+0000 7f2045600640 1 -- 172.21.15.144:0/2839481698 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5228 (secure 0 0 0) 0x7f203c013c70 con 0x7f20480b66e0 2024-09-11T23:22:17.247 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:17.247 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":47,"btime":"2024-09-11T23:22:09:289256+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5417,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/494282276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":494282276},{"type":"v1","addr":"172.21.15.165:6833","nonce":494282276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5827,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1734890696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":1734890696},{"type":"v1","addr":"172.21.15.165:6835","nonce":1734890696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1671926294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1671926294},{"type":"v1","addr":"172.21.15.144:6836","nonce":1671926294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:21:53.856502+0000","modified":"2024-09-11T23:21:56.886031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6093},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6093":{"gid":6093,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6837/97031260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":97031260},{"type":"v1","addr":"172.21.15.144:6837","nonce":97031260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6093,"qdb_cluster":[6093]},"id":5}]} 2024-09-11T23:22:17.247 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 47 2024-09-11T23:22:17.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.249+0000 7f204e800640 1 -- 172.21.15.144:0/2839481698 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2028038200 msgr2=0x7f202803a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:17.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.249+0000 7f204e800640 1 --2- 172.21.15.144:0/2839481698 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2028038200 0x7f202803a6c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f20480b99d0 tx=0x7f2034009040 comp rx=0 tx=0).stop 2024-09-11T23:22:17.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.249+0000 7f204e800640 1 -- 172.21.15.144:0/2839481698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20480b66e0 msgr2=0x7f204814c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:17.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.249+0000 7f204e800640 1 --2- 172.21.15.144:0/2839481698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20480b66e0 0x7f204814c9e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f203c00e870 tx=0x7f203c00ed30 comp rx=0 tx=0).stop 2024-09-11T23:22:17.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.249+0000 7f204e800640 1 -- 172.21.15.144:0/2839481698 shutdown_connections 2024-09-11T23:22:17.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.249+0000 7f204e800640 1 --2- 172.21.15.144:0/2839481698 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2028038200 0x7f202803a6c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.249+0000 7f204e800640 1 --2- 172.21.15.144:0/2839481698 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f204815e640 0x7f20480b8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.249+0000 7f204e800640 1 --2- 172.21.15.144:0/2839481698 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20480d3f60 0x7f20481606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.249+0000 7f204e800640 1 --2- 172.21.15.144:0/2839481698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20480b66e0 0x7f204814c9e0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.249+0000 7f204e800640 1 -- 172.21.15.144:0/2839481698 >> 172.21.15.144:0/2839481698 conn(0x7f20480d0fd0 msgr2=0x7f20480b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:17.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.249+0000 7f204e800640 1 -- 172.21.15.144:0/2839481698 shutdown_connections 2024-09-11T23:22:17.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.249+0000 7f204e800640 1 -- 172.21.15.144:0/2839481698 wait complete. 2024-09-11T23:22:17.266 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:22:17.350 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:17.350+0000 7fefe8578040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T23:22:17.452 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:17.452+0000 7fefe8578040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T23:22:17.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.464+0000 7f6d63400640 1 Processor -- start 2024-09-11T23:22:17.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.465+0000 7f6d63400640 1 -- start start 2024-09-11T23:22:17.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.466+0000 7f6d63400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d5c15e940 0x7f6d5c0d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:17.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.466+0000 7f6d63400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6d5c15ed20 0x7f6d5c0d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:17.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.466+0000 7f6d63400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d5c0cef90 0x7f6d5c0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:17.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.466+0000 7f6d63400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6d5c0d1ae0 con 0x7f6d5c0cef90 2024-09-11T23:22:17.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.466+0000 7f6d63400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6d5c0b7170 con 0x7f6d5c15ed20 2024-09-11T23:22:17.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.466+0000 7f6d63400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6d5c0b7aa0 con 0x7f6d5c15e940 2024-09-11T23:22:17.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.466+0000 7f6d61400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d5c0cef90 0x7f6d5c0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:17.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.466+0000 7f6d61400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d5c0cef90 0x7f6d5c0b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47162/0 (socket says 172.21.15.144:47162) 2024-09-11T23:22:17.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.466+0000 7f6d61400640 1 -- 172.21.15.144:0/2065248227 learned_addr learned my addr 172.21.15.144:0/2065248227 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:17.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.466+0000 7f6d5be00640 1 --2- 172.21.15.144:0/2065248227 >> v2:172.21.15.165:3300/0 conn(0x7f6d5c15ed20 0x7f6d5c0d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:17.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.466+0000 7f6d60a00640 1 --2- 172.21.15.144:0/2065248227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d5c15e940 0x7f6d5c0d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:17.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.467+0000 7f6d61400640 1 -- 172.21.15.144:0/2065248227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d5c15e940 msgr2=0x7f6d5c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:17.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.467+0000 7f6d61400640 1 --2- 172.21.15.144:0/2065248227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d5c15e940 0x7f6d5c0d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.467+0000 7f6d61400640 1 -- 172.21.15.144:0/2065248227 >> v2:172.21.15.165:3300/0 conn(0x7f6d5c15ed20 msgr2=0x7f6d5c0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:17.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.467+0000 7f6d61400640 1 --2- 172.21.15.144:0/2065248227 >> v2:172.21.15.165:3300/0 conn(0x7f6d5c15ed20 0x7f6d5c0d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.467+0000 7f6d61400640 1 -- 172.21.15.144:0/2065248227 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5c0d3660 con 0x7f6d5c0cef90 2024-09-11T23:22:17.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.468+0000 7f6d61400640 1 --2- 172.21.15.144:0/2065248227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d5c0cef90 0x7f6d5c0b3220 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0d5830 tx=0x7f6d5402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aded061c90cccbb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:17.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.468+0000 7f6d5b400640 1 -- 172.21.15.144:0/2065248227 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d54036070 con 0x7f6d5c0cef90 2024-09-11T23:22:17.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.468+0000 7f6d5b400640 1 -- 172.21.15.144:0/2065248227 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d54031600 con 0x7f6d5c0cef90 2024-09-11T23:22:17.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.468+0000 7f6d5b400640 1 -- 172.21.15.144:0/2065248227 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d540319d0 con 0x7f6d5c0cef90 2024-09-11T23:22:17.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.469+0000 7f6d63400640 1 -- 172.21.15.144:0/2065248227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d5c0cef90 msgr2=0x7f6d5c0b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:17.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.469+0000 7f6d63400640 1 --2- 172.21.15.144:0/2065248227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d5c0cef90 0x7f6d5c0b3220 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0d5830 tx=0x7f6d5402a730 comp rx=0 tx=0).stop 2024-09-11T23:22:17.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.469+0000 7f6d63400640 1 -- 172.21.15.144:0/2065248227 shutdown_connections 2024-09-11T23:22:17.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.469+0000 7f6d63400640 1 --2- 172.21.15.144:0/2065248227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d5c0cef90 0x7f6d5c0b3220 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.469+0000 7f6d63400640 1 --2- 172.21.15.144:0/2065248227 >> v2:172.21.15.165:3300/0 conn(0x7f6d5c15ed20 0x7f6d5c0d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.469+0000 7f6d63400640 1 --2- 172.21.15.144:0/2065248227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d5c15e940 0x7f6d5c0d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.469+0000 7f6d63400640 1 -- 172.21.15.144:0/2065248227 >> 172.21.15.144:0/2065248227 conn(0x7f6d5c0b6240 msgr2=0x7f6d5c0b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:17.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.469+0000 7f6d63400640 1 -- 172.21.15.144:0/2065248227 shutdown_connections 2024-09-11T23:22:17.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.469+0000 7f6d63400640 1 -- 172.21.15.144:0/2065248227 wait complete. 2024-09-11T23:22:17.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.471+0000 7f6d63400640 1 Processor -- start 2024-09-11T23:22:17.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.471+0000 7f6d63400640 1 -- start start 2024-09-11T23:22:17.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.472+0000 7f6d63400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d5c0cef90 0x7f6d5c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:17.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.472+0000 7f6d63400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d5c15e940 0x7f6d5c0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:17.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.472+0000 7f6d63400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d5c15ed20 0x7f6d5c15adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:17.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.472+0000 7f6d63400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5c0d3f00 con 0x7f6d5c15e940 2024-09-11T23:22:17.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.472+0000 7f6d63400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5c0d3c20 con 0x7f6d5c0cef90 2024-09-11T23:22:17.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.472+0000 7f6d63400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6d5c0d1ef0 con 0x7f6d5c15ed20 2024-09-11T23:22:17.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.472+0000 7f6d5be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d5c15e940 0x7f6d5c0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:17.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.472+0000 7f6d5be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d5c15e940 0x7f6d5c0cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47168/0 (socket says 172.21.15.144:47168) 2024-09-11T23:22:17.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.472+0000 7f6d5be00640 1 -- 172.21.15.144:0/3047285536 learned_addr learned my addr 172.21.15.144:0/3047285536 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:17.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.473+0000 7f6d60a00640 1 --2- 172.21.15.144:0/3047285536 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d5c0cef90 0x7f6d5c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:17.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.473+0000 7f6d61400640 1 --2- 172.21.15.144:0/3047285536 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d5c15ed20 0x7f6d5c15adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:17.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.473+0000 7f6d5be00640 1 -- 172.21.15.144:0/3047285536 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d5c15ed20 msgr2=0x7f6d5c15adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:17.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.473+0000 7f6d5be00640 1 --2- 172.21.15.144:0/3047285536 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d5c15ed20 0x7f6d5c15adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.473+0000 7f6d5be00640 1 -- 172.21.15.144:0/3047285536 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d5c0cef90 msgr2=0x7f6d5c0b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:17.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.473+0000 7f6d5be00640 1 --2- 172.21.15.144:0/3047285536 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d5c0cef90 0x7f6d5c0b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.473+0000 7f6d5be00640 1 -- 172.21.15.144:0/3047285536 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5c0cdc90 con 0x7f6d5c15e940 2024-09-11T23:22:17.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.473+0000 7f6d5be00640 1 --2- 172.21.15.144:0/3047285536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d5c15e940 0x7f6d5c0cd230 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800e870 tx=0x7f6d4800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:17.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.473+0000 7f6d58c00640 1 -- 172.21.15.144:0/3047285536 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d48017070 con 0x7f6d5c15e940 2024-09-11T23:22:17.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.474+0000 7f6d58c00640 1 -- 172.21.15.144:0/3047285536 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d4800c940 con 0x7f6d5c15e940 2024-09-11T23:22:17.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.474+0000 7f6d63400640 1 -- 172.21.15.144:0/3047285536 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d5c0cdf70 con 0x7f6d5c15e940 2024-09-11T23:22:17.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.474+0000 7f6d58c00640 1 -- 172.21.15.144:0/3047285536 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4800cd30 con 0x7f6d5c15e940 2024-09-11T23:22:17.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.474+0000 7f6d63400640 1 -- 172.21.15.144:0/3047285536 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d5c1487a0 con 0x7f6d5c15e940 2024-09-11T23:22:17.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.475+0000 7f6d63400640 1 -- 172.21.15.144:0/3047285536 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d5c0d1060 con 0x7f6d5c15e940 2024-09-11T23:22:17.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.475+0000 7f6d58c00640 1 -- 172.21.15.144:0/3047285536 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 14) ==== 45609+0+0 (secure 0 0 0) 0x7f6d4801a070 con 0x7f6d5c15e940 2024-09-11T23:22:17.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.475+0000 7f6d58c00640 1 --2- 172.21.15.144:0/3047285536 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6d3c038230 0x7f6d3c03a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:17.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.475+0000 7f6d58c00640 1 -- 172.21.15.144:0/3047285536 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6268+0+0 (secure 0 0 0) 0x7f6d4804bcd0 con 0x7f6d5c15e940 2024-09-11T23:22:17.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.476+0000 7f6d60a00640 1 --2- 172.21.15.144:0/3047285536 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6d3c038230 0x7f6d3c03a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:17.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.476+0000 7f6d60a00640 1 --2- 172.21.15.144:0/3047285536 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6d3c038230 0x7f6d3c03a6f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009ac0 tx=0x7f6d50009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:17.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.480+0000 7f6d58c00640 1 -- 172.21.15.144:0/3047285536 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d48024350 con 0x7f6d5c15e940 2024-09-11T23:22:17.581 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:17.581+0000 7fefe8578040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T23:22:17.631 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:17.631+0000 7fefe8578040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T23:22:17.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.692+0000 7f6d63400640 1 -- 172.21.15.144:0/3047285536 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d5c0ba6b0 con 0x7f6d5c15e940 2024-09-11T23:22:17.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.693+0000 7f6d58c00640 1 -- 172.21.15.144:0/3047285536 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5228 (secure 0 0 0) 0x7f6d48011350 con 0x7f6d5c15e940 2024-09-11T23:22:17.693 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:17.693 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":47,"btime":"2024-09-11T23:22:09:289256+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5417,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/494282276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":494282276},{"type":"v1","addr":"172.21.15.165:6833","nonce":494282276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5827,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1734890696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":1734890696},{"type":"v1","addr":"172.21.15.165:6835","nonce":1734890696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1671926294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1671926294},{"type":"v1","addr":"172.21.15.144:6836","nonce":1671926294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:21:53.856502+0000","modified":"2024-09-11T23:21:56.886031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6093},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6093":{"gid":6093,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":4,"addr":"172.21.15.144:6837/97031260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6835","nonce":97031260},{"type":"v1","addr":"172.21.15.144:6837","nonce":97031260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6093,"qdb_cluster":[6093]},"id":5}]} 2024-09-11T23:22:17.693 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 47 2024-09-11T23:22:17.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.696+0000 7f6d63400640 1 -- 172.21.15.144:0/3047285536 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6d3c038230 msgr2=0x7f6d3c03a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:17.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.696+0000 7f6d63400640 1 --2- 172.21.15.144:0/3047285536 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6d3c038230 0x7f6d3c03a6f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009ac0 tx=0x7f6d50009190 comp rx=0 tx=0).stop 2024-09-11T23:22:17.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.696+0000 7f6d63400640 1 -- 172.21.15.144:0/3047285536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d5c15e940 msgr2=0x7f6d5c0cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:17.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.696+0000 7f6d63400640 1 --2- 172.21.15.144:0/3047285536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d5c15e940 0x7f6d5c0cd230 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800e870 tx=0x7f6d4800ed30 comp rx=0 tx=0).stop 2024-09-11T23:22:17.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.696+0000 7f6d63400640 1 -- 172.21.15.144:0/3047285536 shutdown_connections 2024-09-11T23:22:17.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.696+0000 7f6d63400640 1 --2- 172.21.15.144:0/3047285536 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6d3c038230 0x7f6d3c03a6f0 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009ac0 tx=0x7f6d50009190 comp rx=0 tx=0).stop 2024-09-11T23:22:17.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.696+0000 7f6d63400640 1 --2- 172.21.15.144:0/3047285536 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d5c15ed20 0x7f6d5c15adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.696+0000 7f6d63400640 1 --2- 172.21.15.144:0/3047285536 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d5c15e940 0x7f6d5c0cd230 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.696+0000 7f6d63400640 1 --2- 172.21.15.144:0/3047285536 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d5c0cef90 0x7f6d5c0b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.696+0000 7f6d63400640 1 -- 172.21.15.144:0/3047285536 >> 172.21.15.144:0/3047285536 conn(0x7f6d5c0b6240 msgr2=0x7f6d5c0cf630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:17.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.696+0000 7f6d63400640 1 -- 172.21.15.144:0/3047285536 shutdown_connections 2024-09-11T23:22:17.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.696+0000 7f6d63400640 1 -- 172.21.15.144:0/3047285536 wait complete. 2024-09-11T23:22:17.720 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:22:17.770 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:17.770+0000 7fefe8578040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T23:22:17.834 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:17.835+0000 7fefe8578040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T23:22:17.885 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:17.885+0000 7fefe8578040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T23:22:17.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.918+0000 7f3536c00640 1 Processor -- start 2024-09-11T23:22:17.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.918+0000 7f3536c00640 1 -- start start 2024-09-11T23:22:17.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.919+0000 7f3536c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f353015c180 0x7f35300cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:17.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.919+0000 7f3536c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3530073120 0x7f3530073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:17.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.919+0000 7f3536c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35300ce740 con 0x7f35300ce230 2024-09-11T23:22:17.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.919+0000 7f3536c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3530072640 con 0x7f353015c180 2024-09-11T23:22:17.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.919+0000 7f3536c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3530072920 con 0x7f3530073120 2024-09-11T23:22:17.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.920+0000 7f352fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f353015c180 0x7f35300cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:17.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.920+0000 7f3534c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3530073120 0x7f3530073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:17.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.920+0000 7f352fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f353015c180 0x7f35300cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:49234/0 (socket says 172.21.15.144:49234) 2024-09-11T23:22:17.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.920+0000 7f3534c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3530073120 0x7f3530073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:36576/0 (socket says 172.21.15.144:36576) 2024-09-11T23:22:17.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.920+0000 7f352fe00640 1 -- 172.21.15.144:0/3540879738 learned_addr learned my addr 172.21.15.144:0/3540879738 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:17.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.920+0000 7f352f400640 1 --1- 172.21.15.144:0/3540879738 >> v1:172.21.15.165:6789/0 conn(0x7f35300ce230 0x7f35300cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:50958/0 (socket says 172.21.15.144:50958) 2024-09-11T23:22:17.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.920+0000 7f352fe00640 1 -- 172.21.15.144:0/3540879738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3530073120 msgr2=0x7f3530073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:17.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.920+0000 7f352fe00640 1 --2- 172.21.15.144:0/3540879738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3530073120 0x7f3530073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.920+0000 7f352fe00640 1 -- 172.21.15.144:0/3540879738 >> v1:172.21.15.165:6789/0 conn(0x7f35300ce230 legacy=0x7f35300cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:17.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.920+0000 7f352fe00640 1 -- 172.21.15.144:0/3540879738 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3530072c00 con 0x7f353015c180 2024-09-11T23:22:17.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.921+0000 7f352fe00640 1 --2- 172.21.15.144:0/3540879738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f353015c180 0x7f35300cdcf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3520009870 tx=0x7f352002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dde347f571ad8d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:17.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.921+0000 7f352ea00640 1 -- 172.21.15.144:0/3540879738 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3520037070 con 0x7f353015c180 2024-09-11T23:22:17.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.922+0000 7f352ea00640 1 -- 172.21.15.144:0/3540879738 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3520032440 con 0x7f353015c180 2024-09-11T23:22:17.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.922+0000 7f352ea00640 1 -- 172.21.15.144:0/3540879738 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3520032810 con 0x7f353015c180 2024-09-11T23:22:17.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.922+0000 7f3536c00640 1 -- 172.21.15.144:0/3540879738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f353015c180 msgr2=0x7f35300cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:17.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.922+0000 7f3536c00640 1 --2- 172.21.15.144:0/3540879738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f353015c180 0x7f35300cdcf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3520009870 tx=0x7f352002a1c0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.922+0000 7f3536c00640 1 -- 172.21.15.144:0/3540879738 shutdown_connections 2024-09-11T23:22:17.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.922+0000 7f3536c00640 1 --2- 172.21.15.144:0/3540879738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3530073120 0x7f3530073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.922+0000 7f3536c00640 1 --2- 172.21.15.144:0/3540879738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f353015c180 0x7f35300cdcf0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.922+0000 7f3536c00640 1 -- 172.21.15.144:0/3540879738 >> 172.21.15.144:0/3540879738 conn(0x7f3530062cc0 msgr2=0x7f353006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.922+0000 7f3536c00640 1 -- 172.21.15.144:0/3540879738 shutdown_connections 2024-09-11T23:22:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.922+0000 7f3536c00640 1 -- 172.21.15.144:0/3540879738 wait complete. 2024-09-11T23:22:17.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.924+0000 7f3536c00640 1 Processor -- start 2024-09-11T23:22:17.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.924+0000 7f3536c00640 1 -- start start 2024-09-11T23:22:17.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.925+0000 7f3536c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3530073120 0x7f35301432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:17.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.925+0000 7f3536c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35300ce230 0x7f353015eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:17.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.925+0000 7f3536c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f353015c180 0x7f353015efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:17.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.925+0000 7f3536c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f35300cf780 con 0x7f3530073120 2024-09-11T23:22:17.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.925+0000 7f3536c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f35300722f0 con 0x7f353015c180 2024-09-11T23:22:17.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.925+0000 7f3536c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f353015c560 con 0x7f35300ce230 2024-09-11T23:22:17.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.925+0000 7f352fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3530073120 0x7f35301432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:17.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.925+0000 7f352fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3530073120 0x7f35301432c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47184/0 (socket says 172.21.15.144:47184) 2024-09-11T23:22:17.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.925+0000 7f352fe00640 1 -- 172.21.15.144:0/2139146227 learned_addr learned my addr 172.21.15.144:0/2139146227 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:17.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.925+0000 7f352f400640 1 --2- 172.21.15.144:0/2139146227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35300ce230 0x7f353015eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:17.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.925+0000 7f3534c00640 1 --2- 172.21.15.144:0/2139146227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f353015c180 0x7f353015efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:17.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.926+0000 7f352fe00640 1 -- 172.21.15.144:0/2139146227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35300ce230 msgr2=0x7f353015eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:17.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.926+0000 7f352fe00640 1 --2- 172.21.15.144:0/2139146227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35300ce230 0x7f353015eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.926+0000 7f352fe00640 1 -- 172.21.15.144:0/2139146227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f353015c180 msgr2=0x7f353015efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:17.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.926+0000 7f352fe00640 1 --2- 172.21.15.144:0/2139146227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f353015c180 0x7f353015efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:17.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.926+0000 7f352fe00640 1 -- 172.21.15.144:0/2139146227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353015a630 con 0x7f3530073120 2024-09-11T23:22:17.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.926+0000 7f352fe00640 1 --2- 172.21.15.144:0/2139146227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3530073120 0x7f35301432c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3520000c00 tx=0x7f35200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:17.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.926+0000 7f3527e00640 1 -- 172.21.15.144:0/2139146227 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3520037040 con 0x7f3530073120 2024-09-11T23:22:17.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.926+0000 7f3527e00640 1 -- 172.21.15.144:0/2139146227 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3520042070 con 0x7f3530073120 2024-09-11T23:22:17.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.926+0000 7f3536c00640 1 -- 172.21.15.144:0/2139146227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f353015a8d0 con 0x7f3530073120 2024-09-11T23:22:17.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.926+0000 7f3527e00640 1 -- 172.21.15.144:0/2139146227 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3520030880 con 0x7f3530073120 2024-09-11T23:22:17.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.927+0000 7f3536c00640 1 -- 172.21.15.144:0/2139146227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f353015ae90 con 0x7f3530073120 2024-09-11T23:22:17.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.928+0000 7f3527e00640 1 -- 172.21.15.144:0/2139146227 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 15) ==== 45665+0+0 (secure 0 0 0) 0x7f352002ad10 con 0x7f3530073120 2024-09-11T23:22:17.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.928+0000 7f3527e00640 1 --2- 172.21.15.144:0/2139146227 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3510038290 0x7f351003a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:17.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.928+0000 7f3527e00640 1 -- 172.21.15.144:0/2139146227 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6268+0+0 (secure 0 0 0) 0x7f352006c240 con 0x7f3530073120 2024-09-11T23:22:17.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.928+0000 7f3536c00640 1 -- 172.21.15.144:0/2139146227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35300cdcf0 con 0x7f3530073120 2024-09-11T23:22:17.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.928+0000 7f352f400640 1 --2- 172.21.15.144:0/2139146227 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3510038290 0x7f351003a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:17.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.929+0000 7f352f400640 1 --2- 172.21.15.144:0/2139146227 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3510038290 0x7f351003a750 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f353015a400 tx=0x7f351c007e20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:17.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:17.933+0000 7f3527e00640 1 -- 172.21.15.144:0/2139146227 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3520030a20 con 0x7f3530073120 2024-09-11T23:22:18.035 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:18.035+0000 7fefe8578040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T23:22:18.093 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:18.094+0000 7fefe8578040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T23:22:18.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.130+0000 7f3536c00640 1 -- 172.21.15.144:0/2139146227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35300b0940 con 0x7f3530073120 2024-09-11T23:22:18.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.131+0000 7f3527e00640 1 -- 172.21.15.144:0/2139146227 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+17571 (secure 0 0 0) 0x7f3520046c90 con 0x7f3530073120 2024-09-11T23:22:18.131 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:18.131 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":72,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:22:14.682052+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:21:52.048862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-11T23:21:52.855489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:0/3284903152":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/651214814":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/246653411":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/2886766475":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/4035581026":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/690044521":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/871393845":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/2268096760":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/898052131":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/2791324222":"2024-09-12T23:22:14.682014+0000","172.21.15.144:6801/1711334146":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/3549728794":"2024-09-12T23:22:14.682014+0000","172.21.15.144:6800/1711334146":"2024-09-12T23:22:14.682014+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:22:18.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.135+0000 7f3536c00640 1 -- 172.21.15.144:0/2139146227 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3510038290 msgr2=0x7f351003a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:18.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.135+0000 7f3536c00640 1 --2- 172.21.15.144:0/2139146227 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3510038290 0x7f351003a750 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f353015a400 tx=0x7f351c007e20 comp rx=0 tx=0).stop 2024-09-11T23:22:18.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.135+0000 7f3536c00640 1 -- 172.21.15.144:0/2139146227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3530073120 msgr2=0x7f35301432c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:18.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.135+0000 7f3536c00640 1 --2- 172.21.15.144:0/2139146227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3530073120 0x7f35301432c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3520000c00 tx=0x7f35200046c0 comp rx=0 tx=0).stop 2024-09-11T23:22:18.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.135+0000 7f3536c00640 1 -- 172.21.15.144:0/2139146227 shutdown_connections 2024-09-11T23:22:18.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.135+0000 7f3536c00640 1 --2- 172.21.15.144:0/2139146227 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3510038290 0x7f351003a750 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:18.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.135+0000 7f3536c00640 1 --2- 172.21.15.144:0/2139146227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f353015c180 0x7f353015efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:18.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.135+0000 7f3536c00640 1 --2- 172.21.15.144:0/2139146227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35300ce230 0x7f353015eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:18.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.135+0000 7f3536c00640 1 --2- 172.21.15.144:0/2139146227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3530073120 0x7f35301432c0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:18.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.135+0000 7f3536c00640 1 -- 172.21.15.144:0/2139146227 >> 172.21.15.144:0/2139146227 conn(0x7f3530062cc0 msgr2=0x7f353006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:18.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.135+0000 7f3536c00640 1 -- 172.21.15.144:0/2139146227 shutdown_connections 2024-09-11T23:22:18.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.135+0000 7f3536c00640 1 -- 172.21.15.144:0/2139146227 wait complete. 2024-09-11T23:22:18.157 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:22:18.161 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:18.161+0000 7fefe8578040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T23:22:18.230 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:18.230+0000 7fefe8578040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T23:22:18.283 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:18.283+0000 7fefe8578040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T23:22:18.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.322+0000 7f3297200640 1 Processor -- start 2024-09-11T23:22:18.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.322+0000 7f3297200640 1 -- start start 2024-09-11T23:22:18.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.323+0000 7f3297200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f329815e640 0x7f32980d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:18.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.323+0000 7f3297200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32980b66e0 0x7f32980b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:18.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.323+0000 7f3297200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f329806bee0 con 0x7f32980d3f60 2024-09-11T23:22:18.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.323+0000 7f3297200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f329815ea20 con 0x7f329815e640 2024-09-11T23:22:18.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.323+0000 7f3297200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f329806caf0 con 0x7f32980b66e0 2024-09-11T23:22:18.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.324+0000 7f3295e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f329815e640 0x7f32980d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:18.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.324+0000 7f3295e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f329815e640 0x7f32980d3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47196/0 (socket says 172.21.15.144:47196) 2024-09-11T23:22:18.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.324+0000 7f3295e00640 1 -- 172.21.15.144:0/3805765967 learned_addr learned my addr 172.21.15.144:0/3805765967 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:18.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.324+0000 7f328fe00640 1 --1- 172.21.15.144:0/3805765967 >> v1:172.21.15.144:6789/0 conn(0x7f32980d3f60 0x7f32980b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43600/0 (socket says 172.21.15.144:43600) 2024-09-11T23:22:18.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.324+0000 7f3296800640 1 --2- 172.21.15.144:0/3805765967 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32980b66e0 0x7f32980b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:18.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.324+0000 7f3295e00640 1 -- 172.21.15.144:0/3805765967 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32980b66e0 msgr2=0x7f32980b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:18.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.324+0000 7f3295e00640 1 --2- 172.21.15.144:0/3805765967 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32980b66e0 0x7f32980b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:18.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.324+0000 7f3295e00640 1 -- 172.21.15.144:0/3805765967 >> v1:172.21.15.144:6789/0 conn(0x7f32980d3f60 legacy=0x7f32980b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:18.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.324+0000 7f3295e00640 1 -- 172.21.15.144:0/3805765967 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329806c1c0 con 0x7f329815e640 2024-09-11T23:22:18.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.325+0000 7f3295e00640 1 --2- 172.21.15.144:0/3805765967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f329815e640 0x7f32980d3a20 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3288009870 tx=0x7f328802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a5f4a7442c80e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:18.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.325+0000 7f3295400640 1 -- 172.21.15.144:0/3805765967 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288037070 con 0x7f329815e640 2024-09-11T23:22:18.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.325+0000 7f3295400640 1 -- 172.21.15.144:0/3805765967 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3288032440 con 0x7f329815e640 2024-09-11T23:22:18.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.325+0000 7f3295400640 1 -- 172.21.15.144:0/3805765967 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288032810 con 0x7f329815e640 2024-09-11T23:22:18.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.326+0000 7f3297200640 1 -- 172.21.15.144:0/3805765967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f329815e640 msgr2=0x7f32980d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:18.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.326+0000 7f3297200640 1 --2- 172.21.15.144:0/3805765967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f329815e640 0x7f32980d3a20 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3288009870 tx=0x7f328802a250 comp rx=0 tx=0).stop 2024-09-11T23:22:18.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.326+0000 7f3297200640 1 -- 172.21.15.144:0/3805765967 shutdown_connections 2024-09-11T23:22:18.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.326+0000 7f3297200640 1 --2- 172.21.15.144:0/3805765967 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32980b66e0 0x7f32980b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:18.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.326+0000 7f3297200640 1 --2- 172.21.15.144:0/3805765967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f329815e640 0x7f32980d3a20 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:18.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.326+0000 7f3297200640 1 -- 172.21.15.144:0/3805765967 >> 172.21.15.144:0/3805765967 conn(0x7f32980d0fd0 msgr2=0x7f32980d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:18.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.326+0000 7f3297200640 1 -- 172.21.15.144:0/3805765967 shutdown_connections 2024-09-11T23:22:18.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.326+0000 7f3297200640 1 -- 172.21.15.144:0/3805765967 wait complete. 2024-09-11T23:22:18.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.329+0000 7f3297200640 1 Processor -- start 2024-09-11T23:22:18.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.329+0000 7f3297200640 1 -- start start 2024-09-11T23:22:18.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.330+0000 7f3297200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32980b66e0 0x7f329815d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:18.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.330+0000 7f3297200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32980d3f60 0x7f32980ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:18.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.330+0000 7f3297200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f329815e640 0x7f32980acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:18.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.330+0000 7f3297200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f32980b7c90 con 0x7f329815e640 2024-09-11T23:22:18.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.330+0000 7f3297200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f329806c780 con 0x7f32980b66e0 2024-09-11T23:22:18.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.330+0000 7f3297200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f32980b7e10 con 0x7f32980d3f60 2024-09-11T23:22:18.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.331+0000 7f3296800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f329815e640 0x7f32980acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:18.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.331+0000 7f3296800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f329815e640 0x7f32980acec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47202/0 (socket says 172.21.15.144:47202) 2024-09-11T23:22:18.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.331+0000 7f3296800640 1 -- 172.21.15.144:0/869065037 learned_addr learned my addr 172.21.15.144:0/869065037 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:18.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.331+0000 7f328fe00640 1 --2- 172.21.15.144:0/869065037 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32980d3f60 0x7f32980ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:18.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.331+0000 7f3295e00640 1 --2- 172.21.15.144:0/869065037 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32980b66e0 0x7f329815d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:18.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.331+0000 7f3296800640 1 -- 172.21.15.144:0/869065037 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32980d3f60 msgr2=0x7f32980ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:18.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.331+0000 7f3296800640 1 --2- 172.21.15.144:0/869065037 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32980d3f60 0x7f32980ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:18.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.331+0000 7f3296800640 1 -- 172.21.15.144:0/869065037 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32980b66e0 msgr2=0x7f329815d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:18.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.331+0000 7f3296800640 1 --2- 172.21.15.144:0/869065037 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32980b66e0 0x7f329815d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:18.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.331+0000 7f3296800640 1 -- 172.21.15.144:0/869065037 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32980cc280 con 0x7f329815e640 2024-09-11T23:22:18.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.331+0000 7f3295e00640 1 --2- 172.21.15.144:0/869065037 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32980b66e0 0x7f329815d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:18.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.332+0000 7f3296800640 1 --2- 172.21.15.144:0/869065037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f329815e640 0x7f32980acec0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3290007e40 tx=0x7f329000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:18.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.332+0000 7f328e000640 1 -- 172.21.15.144:0/869065037 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3290014620 con 0x7f329815e640 2024-09-11T23:22:18.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.332+0000 7f328e000640 1 -- 172.21.15.144:0/869065037 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3290019070 con 0x7f329815e640 2024-09-11T23:22:18.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.332+0000 7f328e000640 1 -- 172.21.15.144:0/869065037 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3290014a20 con 0x7f329815e640 2024-09-11T23:22:18.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.332+0000 7f3297200640 1 -- 172.21.15.144:0/869065037 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32980cc560 con 0x7f329815e640 2024-09-11T23:22:18.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.332+0000 7f3297200640 1 -- 172.21.15.144:0/869065037 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32980ce630 con 0x7f329815e640 2024-09-11T23:22:18.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.333+0000 7f328e000640 1 -- 172.21.15.144:0/869065037 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 15) ==== 45665+0+0 (secure 0 0 0) 0x7f3290014bc0 con 0x7f329815e640 2024-09-11T23:22:18.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.333+0000 7f3297200640 1 -- 172.21.15.144:0/869065037 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32980b7750 con 0x7f329815e640 2024-09-11T23:22:18.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.333+0000 7f328e000640 1 --2- 172.21.15.144:0/869065037 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3274038290 0x7f327403a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:18.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.333+0000 7f328e000640 1 -- 172.21.15.144:0/869065037 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6268+0+0 (secure 0 0 0) 0x7f329004c620 con 0x7f329815e640 2024-09-11T23:22:18.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.334+0000 7f3295e00640 1 --2- 172.21.15.144:0/869065037 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3274038290 0x7f327403a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:18.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.335+0000 7f3295e00640 1 --2- 172.21.15.144:0/869065037 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3274038290 0x7f327403a750 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3288034000 tx=0x7f328802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:18.338 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:18.338+0000 7fefe8578040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T23:22:18.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.338+0000 7f328e000640 1 -- 172.21.15.144:0/869065037 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3290011260 con 0x7f329815e640 2024-09-11T23:22:18.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.558+0000 7f3297200640 1 -- 172.21.15.144:0/869065037 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f32980d3c00 con 0x7f329815e640 2024-09-11T23:22:18.559 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-11T23:22:18.559+0000 7f86fcc00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:22:18.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.561+0000 7f328e000640 1 -- 172.21.15.144:0/869065037 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) ==== 161+0+0 (secure 0 0 0) 0x7f329001c360 con 0x7f329815e640 2024-09-11T23:22:18.561 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:22:18.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.564+0000 7f3297200640 1 -- 172.21.15.144:0/869065037 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3274038290 msgr2=0x7f327403a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:18.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.564+0000 7f3297200640 1 --2- 172.21.15.144:0/869065037 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3274038290 0x7f327403a750 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3288034000 tx=0x7f328802e000 comp rx=0 tx=0).stop 2024-09-11T23:22:18.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.564+0000 7f3297200640 1 -- 172.21.15.144:0/869065037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f329815e640 msgr2=0x7f32980acec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:18.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.564+0000 7f3297200640 1 --2- 172.21.15.144:0/869065037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f329815e640 0x7f32980acec0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3290007e40 tx=0x7f329000e4b0 comp rx=0 tx=0).stop 2024-09-11T23:22:18.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.564+0000 7f3297200640 1 -- 172.21.15.144:0/869065037 shutdown_connections 2024-09-11T23:22:18.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.564+0000 7f3297200640 1 --2- 172.21.15.144:0/869065037 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3274038290 0x7f327403a750 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:18.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.564+0000 7f3297200640 1 --2- 172.21.15.144:0/869065037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f329815e640 0x7f32980acec0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:18.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.564+0000 7f3297200640 1 --2- 172.21.15.144:0/869065037 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32980d3f60 0x7f32980ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:18.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.564+0000 7f3297200640 1 --2- 172.21.15.144:0/869065037 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32980b66e0 0x7f329815d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:18.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.564+0000 7f3297200640 1 -- 172.21.15.144:0/869065037 >> 172.21.15.144:0/869065037 conn(0x7f32980d0fd0 msgr2=0x7f32980cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:18.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.565+0000 7f3297200640 1 -- 172.21.15.144:0/869065037 shutdown_connections 2024-09-11T23:22:18.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.565+0000 7f3297200640 1 -- 172.21.15.144:0/869065037 wait complete. 2024-09-11T23:22:18.575 INFO:tasks.ceph.mds.a.smithi144.stderr: -7984> 2024-09-11T23:21:59.407+0000 7f98e0400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:22:18.581 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:22:18.627 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-11T23:22:18.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.743+0000 7fe4d0a00640 1 Processor -- start 2024-09-11T23:22:18.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.744+0000 7fe4d0a00640 1 -- start start 2024-09-11T23:22:18.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.745+0000 7fe4d0a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe4cc06d6e0 0x7fe4cc0d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:18.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.745+0000 7fe4d0a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4cc15e6f0 0x7fe4cc06dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:18.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.745+0000 7fe4d0a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4cc06e000 con 0x7fe4cc0b73c0 2024-09-11T23:22:18.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.745+0000 7fe4d0a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe4cc0b7930 con 0x7fe4cc06d6e0 2024-09-11T23:22:18.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.745+0000 7fe4d0a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe4cc0b90a0 con 0x7fe4cc15e6f0 2024-09-11T23:22:18.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.745+0000 7fe4ca800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe4cc06d6e0 0x7fe4cc0d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:18.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.745+0000 7fe4cb200640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fe4cc0b73c0 0x7fe4cc161ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:50968/0 (socket says 172.21.15.144:50968) 2024-09-11T23:22:18.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.745+0000 7fe4cb200640 1 -- 172.21.15.144:0/3644396927 learned_addr learned my addr 172.21.15.144:0/3644396927 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:18.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.745+0000 7fe4c9e00640 1 --2- 172.21.15.144:0/3644396927 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4cc15e6f0 0x7fe4cc06dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:18.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.746+0000 7fe4ca800640 1 -- 172.21.15.144:0/3644396927 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4cc15e6f0 msgr2=0x7fe4cc06dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:18.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.746+0000 7fe4ca800640 1 --2- 172.21.15.144:0/3644396927 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4cc15e6f0 0x7fe4cc06dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:18.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.746+0000 7fe4ca800640 1 -- 172.21.15.144:0/3644396927 >> v1:172.21.15.165:6789/0 conn(0x7fe4cc0b73c0 legacy=0x7fe4cc161ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:18.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.746+0000 7fe4ca800640 1 -- 172.21.15.144:0/3644396927 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4cc0b9380 con 0x7fe4cc06d6e0 2024-09-11T23:22:18.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.747+0000 7fe4ca800640 1 --2- 172.21.15.144:0/3644396927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4cc06d6e0 0x7fe4cc0d1930 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0097a0 tx=0x7fe4bc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60cbed56d5678a09 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:18.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.747+0000 7fe4c9400640 1 -- 172.21.15.144:0/3644396927 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc037070 con 0x7fe4cc06d6e0 2024-09-11T23:22:18.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.747+0000 7fe4c9400640 1 -- 172.21.15.144:0/3644396927 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4bc032440 con 0x7fe4cc06d6e0 2024-09-11T23:22:18.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.747+0000 7fe4c9400640 1 -- 172.21.15.144:0/3644396927 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc032810 con 0x7fe4cc06d6e0 2024-09-11T23:22:18.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.748+0000 7fe4d0a00640 1 -- 172.21.15.144:0/3644396927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4cc06d6e0 msgr2=0x7fe4cc0d1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:18.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.748+0000 7fe4d0a00640 1 --2- 172.21.15.144:0/3644396927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4cc06d6e0 0x7fe4cc0d1930 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0097a0 tx=0x7fe4bc02a180 comp rx=0 tx=0).stop 2024-09-11T23:22:18.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.748+0000 7fe4d0a00640 1 -- 172.21.15.144:0/3644396927 shutdown_connections 2024-09-11T23:22:18.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.748+0000 7fe4d0a00640 1 --2- 172.21.15.144:0/3644396927 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4cc15e6f0 0x7fe4cc06dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:18.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.748+0000 7fe4d0a00640 1 --2- 172.21.15.144:0/3644396927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4cc06d6e0 0x7fe4cc0d1930 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:18.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.748+0000 7fe4d0a00640 1 -- 172.21.15.144:0/3644396927 >> 172.21.15.144:0/3644396927 conn(0x7fe4cc0d4970 msgr2=0x7fe4cc0d4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:18.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.748+0000 7fe4d0a00640 1 -- 172.21.15.144:0/3644396927 shutdown_connections 2024-09-11T23:22:18.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.748+0000 7fe4d0a00640 1 -- 172.21.15.144:0/3644396927 wait complete. 2024-09-11T23:22:18.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.750+0000 7fe4d0a00640 1 Processor -- start 2024-09-11T23:22:18.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.750+0000 7fe4d0a00640 1 -- start start 2024-09-11T23:22:18.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.751+0000 7fe4d0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4cc06d6e0 0x7fe4cc1e9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:18.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.751+0000 7fe4d0a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4cc0b73c0 0x7fe4cc152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:18.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.751+0000 7fe4d0a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4cc15e6f0 0x7fe4cc1f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:18.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.751+0000 7fe4d0a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc0d3a20 con 0x7fe4cc06d6e0 2024-09-11T23:22:18.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.751+0000 7fe4d0a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc0b9660 con 0x7fe4cc15e6f0 2024-09-11T23:22:18.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.751+0000 7fe4d0a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe4cc0d3ba0 con 0x7fe4cc0b73c0 2024-09-11T23:22:18.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.751+0000 7fe4ca800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4cc06d6e0 0x7fe4cc1e9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:18.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.751+0000 7fe4ca800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4cc06d6e0 0x7fe4cc1e9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47222/0 (socket says 172.21.15.144:47222) 2024-09-11T23:22:18.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.751+0000 7fe4ca800640 1 -- 172.21.15.144:0/1977328746 learned_addr learned my addr 172.21.15.144:0/1977328746 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:18.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.751+0000 7fe4cb200640 1 --2- 172.21.15.144:0/1977328746 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4cc15e6f0 0x7fe4cc1f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:18.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.751+0000 7fe4c9e00640 1 --2- 172.21.15.144:0/1977328746 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4cc0b73c0 0x7fe4cc152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:18.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.751+0000 7fe4ca800640 1 -- 172.21.15.144:0/1977328746 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4cc0b73c0 msgr2=0x7fe4cc152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:18.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.751+0000 7fe4ca800640 1 --2- 172.21.15.144:0/1977328746 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4cc0b73c0 0x7fe4cc152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:18.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.751+0000 7fe4ca800640 1 -- 172.21.15.144:0/1977328746 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4cc15e6f0 msgr2=0x7fe4cc1f5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:18.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.751+0000 7fe4ca800640 1 --2- 172.21.15.144:0/1977328746 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4cc15e6f0 0x7fe4cc1f5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:18.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.751+0000 7fe4ca800640 1 -- 172.21.15.144:0/1977328746 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4cc1e85c0 con 0x7fe4cc06d6e0 2024-09-11T23:22:18.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.751+0000 7fe4cb200640 1 --2- 172.21.15.144:0/1977328746 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4cc15e6f0 0x7fe4cc1f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:18.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.752+0000 7fe4ca800640 1 --2- 172.21.15.144:0/1977328746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4cc06d6e0 0x7fe4cc1e9660 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0098c0 tx=0x7fe4bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:18.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.752+0000 7fe4c2a00640 1 -- 172.21.15.144:0/1977328746 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc037040 con 0x7fe4cc06d6e0 2024-09-11T23:22:18.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.752+0000 7fe4c2a00640 1 -- 172.21.15.144:0/1977328746 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4bc042070 con 0x7fe4cc06d6e0 2024-09-11T23:22:18.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.752+0000 7fe4c2a00640 1 -- 172.21.15.144:0/1977328746 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc030940 con 0x7fe4cc06d6e0 2024-09-11T23:22:18.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.752+0000 7fe4d0a00640 1 -- 172.21.15.144:0/1977328746 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4cc1e88a0 con 0x7fe4cc06d6e0 2024-09-11T23:22:18.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.752+0000 7fe4d0a00640 1 -- 172.21.15.144:0/1977328746 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4cc1e8e60 con 0x7fe4cc06d6e0 2024-09-11T23:22:18.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.753+0000 7fe4c2a00640 1 -- 172.21.15.144:0/1977328746 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 15) ==== 45665+0+0 (secure 0 0 0) 0x7fe4bc030ae0 con 0x7fe4cc06d6e0 2024-09-11T23:22:18.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.753+0000 7fe4d0a00640 1 -- 172.21.15.144:0/1977328746 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4cc06dac0 con 0x7fe4cc06d6e0 2024-09-11T23:22:18.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.754+0000 7fe4c2a00640 1 --2- 172.21.15.144:0/1977328746 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe4ac038290 0x7fe4ac03a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:18.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.754+0000 7fe4c2a00640 1 -- 172.21.15.144:0/1977328746 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6354+0+0 (secure 0 0 0) 0x7fe4bc06c670 con 0x7fe4cc06d6e0 2024-09-11T23:22:18.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.754+0000 7fe4c9e00640 1 --2- 172.21.15.144:0/1977328746 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe4ac038290 0x7fe4ac03a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:18.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.755+0000 7fe4c9e00640 1 --2- 172.21.15.144:0/1977328746 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe4ac038290 0x7fe4ac03a750 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc1ea0e0 tx=0x7fe4b8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:18.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.759+0000 7fe4c2a00640 1 -- 172.21.15.144:0/1977328746 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe4bc03dc90 con 0x7fe4cc06d6e0 2024-09-11T23:22:18.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:18.977+0000 7fe4d0a00640 1 -- 172.21.15.144:0/1977328746 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe4cc0b3950 con 0x7fe4cc06d6e0 2024-09-11T23:22:19.027 INFO:tasks.ceph.mgr.y.smithi144.stderr:2024-09-11T23:22:19.027+0000 7fefe8578040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T23:22:19.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.564+0000 7fe4c2a00640 1 -- 172.21.15.144:0/1977328746 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) ==== 104+0+0 (secure 0 0 0) 0x7fe4bc047980 con 0x7fe4cc06d6e0 2024-09-11T23:22:19.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.566+0000 7fe4d0a00640 1 -- 172.21.15.144:0/1977328746 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe4ac038290 msgr2=0x7fe4ac03a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:19.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.566+0000 7fe4d0a00640 1 --2- 172.21.15.144:0/1977328746 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe4ac038290 0x7fe4ac03a750 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc1ea0e0 tx=0x7fe4b8008040 comp rx=0 tx=0).stop 2024-09-11T23:22:19.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.566+0000 7fe4d0a00640 1 -- 172.21.15.144:0/1977328746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4cc06d6e0 msgr2=0x7fe4cc1e9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:19.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.566+0000 7fe4d0a00640 1 --2- 172.21.15.144:0/1977328746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4cc06d6e0 0x7fe4cc1e9660 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0098c0 tx=0x7fe4bc0046c0 comp rx=0 tx=0).stop 2024-09-11T23:22:19.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.566+0000 7fe4d0a00640 1 -- 172.21.15.144:0/1977328746 shutdown_connections 2024-09-11T23:22:19.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.566+0000 7fe4d0a00640 1 --2- 172.21.15.144:0/1977328746 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe4ac038290 0x7fe4ac03a750 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:19.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.566+0000 7fe4d0a00640 1 --2- 172.21.15.144:0/1977328746 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4cc15e6f0 0x7fe4cc1f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:19.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.566+0000 7fe4d0a00640 1 --2- 172.21.15.144:0/1977328746 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4cc0b73c0 0x7fe4cc152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:19.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.566+0000 7fe4d0a00640 1 --2- 172.21.15.144:0/1977328746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4cc06d6e0 0x7fe4cc1e9660 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:19.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.566+0000 7fe4d0a00640 1 -- 172.21.15.144:0/1977328746 >> 172.21.15.144:0/1977328746 conn(0x7fe4cc0d4970 msgr2=0x7fe4cc0b57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:19.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.567+0000 7fe4d0a00640 1 -- 172.21.15.144:0/1977328746 shutdown_connections 2024-09-11T23:22:19.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.567+0000 7fe4d0a00640 1 -- 172.21.15.144:0/1977328746 wait complete. 2024-09-11T23:22:19.583 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:22:19.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.746+0000 7fea1c000640 1 Processor -- start 2024-09-11T23:22:19.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.746+0000 7fea1c000640 1 -- start start 2024-09-11T23:22:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.747+0000 7fea1c000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fea140b50c0 0x7fea1415e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.747+0000 7fea1c000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fea1415ece0 0x7fea141610d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.747+0000 7fea1c000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea14072f10 con 0x7fea14161610 2024-09-11T23:22:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.747+0000 7fea1c000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fea140b4020 con 0x7fea140b50c0 2024-09-11T23:22:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.747+0000 7fea1c000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fea140b4300 con 0x7fea1415ece0 2024-09-11T23:22:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.747+0000 7fea19600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fea140b50c0 0x7fea1415e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.747+0000 7fea1a000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fea14161610 0x7fea14163a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43612/0 (socket says 172.21.15.144:43612) 2024-09-11T23:22:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.747+0000 7fea19600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fea140b50c0 0x7fea1415e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47224/0 (socket says 172.21.15.144:47224) 2024-09-11T23:22:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.747+0000 7fea1a000640 1 -- 172.21.15.144:0/179260801 learned_addr learned my addr 172.21.15.144:0/179260801 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.747+0000 7fea18c00640 1 --2- 172.21.15.144:0/179260801 >> v2:172.21.15.165:3300/0 conn(0x7fea1415ece0 0x7fea141610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:19.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.748+0000 7fea19600640 1 -- 172.21.15.144:0/179260801 >> v2:172.21.15.165:3300/0 conn(0x7fea1415ece0 msgr2=0x7fea141610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:19.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.748+0000 7fea19600640 1 --2- 172.21.15.144:0/179260801 >> v2:172.21.15.165:3300/0 conn(0x7fea1415ece0 0x7fea141610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:19.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.748+0000 7fea19600640 1 -- 172.21.15.144:0/179260801 >> v1:172.21.15.144:6789/0 conn(0x7fea14161610 legacy=0x7fea14163a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:19.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.748+0000 7fea19600640 1 -- 172.21.15.144:0/179260801 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea140b45e0 con 0x7fea140b50c0 2024-09-11T23:22:19.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.748+0000 7fea13e00640 1 -- 172.21.15.144:0/179260801 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2369293019 0 0) 0x7fea14072f10 con 0x7fea14161610 2024-09-11T23:22:19.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.749+0000 7fea19600640 1 --2- 172.21.15.144:0/179260801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea140b50c0 0x7fea1415e7a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fea140cd440 tx=0x7fea0802c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab9532bcf245b71 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:19.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.749+0000 7fea13e00640 1 -- 172.21.15.144:0/179260801 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea08031710 con 0x7fea140b50c0 2024-09-11T23:22:19.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.749+0000 7fea13e00640 1 -- 172.21.15.144:0/179260801 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea080318b0 con 0x7fea140b50c0 2024-09-11T23:22:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.749+0000 7fea13e00640 1 -- 172.21.15.144:0/179260801 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea08031c80 con 0x7fea140b50c0 2024-09-11T23:22:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.750+0000 7fea1c000640 1 -- 172.21.15.144:0/179260801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea140b50c0 msgr2=0x7fea1415e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.750+0000 7fea1c000640 1 --2- 172.21.15.144:0/179260801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea140b50c0 0x7fea1415e7a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fea140cd440 tx=0x7fea0802c7e0 comp rx=0 tx=0).stop 2024-09-11T23:22:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.750+0000 7fea1c000640 1 -- 172.21.15.144:0/179260801 shutdown_connections 2024-09-11T23:22:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.750+0000 7fea1c000640 1 --2- 172.21.15.144:0/179260801 >> v2:172.21.15.165:3300/0 conn(0x7fea1415ece0 0x7fea141610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.750+0000 7fea1c000640 1 --2- 172.21.15.144:0/179260801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea140b50c0 0x7fea1415e7a0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.750+0000 7fea1c000640 1 -- 172.21.15.144:0/179260801 >> 172.21.15.144:0/179260801 conn(0x7fea1406bba0 msgr2=0x7fea1406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.750+0000 7fea1c000640 1 -- 172.21.15.144:0/179260801 shutdown_connections 2024-09-11T23:22:19.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.750+0000 7fea1c000640 1 -- 172.21.15.144:0/179260801 wait complete. 2024-09-11T23:22:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.751+0000 7fea1c000640 1 Processor -- start 2024-09-11T23:22:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.751+0000 7fea1c000640 1 -- start start 2024-09-11T23:22:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.752+0000 7fea1c000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea140b50c0 0x7fea140cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.752+0000 7fea1c000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fea1415ece0 0x7fea140cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.752+0000 7fea1c000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea14161610 0x7fea14159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.752+0000 7fea1c000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fea1415af50 con 0x7fea14161610 2024-09-11T23:22:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.752+0000 7fea1c000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fea140b4ba0 con 0x7fea140b50c0 2024-09-11T23:22:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.752+0000 7fea1c000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fea1406f090 con 0x7fea1415ece0 2024-09-11T23:22:19.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.753+0000 7fea1a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea14161610 0x7fea14159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:19.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.753+0000 7fea1a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea14161610 0x7fea14159130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47240/0 (socket says 172.21.15.144:47240) 2024-09-11T23:22:19.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.753+0000 7fea1a000640 1 -- 172.21.15.144:0/412951203 learned_addr learned my addr 172.21.15.144:0/412951203 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:19.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.753+0000 7fea19600640 1 --2- 172.21.15.144:0/412951203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea140b50c0 0x7fea140cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:19.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.753+0000 7fea18c00640 1 --2- 172.21.15.144:0/412951203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fea1415ece0 0x7fea140cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:19.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.753+0000 7fea1a000640 1 -- 172.21.15.144:0/412951203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fea1415ece0 msgr2=0x7fea140cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:19.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.753+0000 7fea1a000640 1 --2- 172.21.15.144:0/412951203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fea1415ece0 0x7fea140cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:19.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.753+0000 7fea1a000640 1 -- 172.21.15.144:0/412951203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea140b50c0 msgr2=0x7fea140cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:19.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.753+0000 7fea1a000640 1 --2- 172.21.15.144:0/412951203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea140b50c0 0x7fea140cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:19.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.753+0000 7fea1a000640 1 -- 172.21.15.144:0/412951203 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea141f4920 con 0x7fea14161610 2024-09-11T23:22:19.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.753+0000 7fea1a000640 1 --2- 172.21.15.144:0/412951203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea14161610 0x7fea14159130 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00c730 tx=0x7fea0c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:19.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.754+0000 7fea11600640 1 -- 172.21.15.144:0/412951203 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c018070 con 0x7fea14161610 2024-09-11T23:22:19.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.754+0000 7fea11600640 1 -- 172.21.15.144:0/412951203 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea0c00ce40 con 0x7fea14161610 2024-09-11T23:22:19.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.754+0000 7fea1c000640 1 -- 172.21.15.144:0/412951203 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea141f4c00 con 0x7fea14161610 2024-09-11T23:22:19.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.754+0000 7fea11600640 1 -- 172.21.15.144:0/412951203 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0c00a860 con 0x7fea14161610 2024-09-11T23:22:19.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.754+0000 7fea1c000640 1 -- 172.21.15.144:0/412951203 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea141f51c0 con 0x7fea14161610 2024-09-11T23:22:19.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.755+0000 7fea1c000640 1 -- 172.21.15.144:0/412951203 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea141f5400 con 0x7fea14161610 2024-09-11T23:22:19.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.756+0000 7fea11600640 1 -- 172.21.15.144:0/412951203 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fea0c01b070 con 0x7fea14161610 2024-09-11T23:22:19.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.756+0000 7fea11600640 1 --2- 172.21.15.144:0/412951203 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe9f406bf50 0x7fe9f406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:19.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.757+0000 7fea11600640 1 -- 172.21.15.144:0/412951203 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6354+0+0 (secure 0 0 0) 0x7fea0c08a870 con 0x7fea14161610 2024-09-11T23:22:19.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.757+0000 7fea19600640 1 --2- 172.21.15.144:0/412951203 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe9f406bf50 0x7fe9f406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:19.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.758+0000 7fea19600640 1 --2- 172.21.15.144:0/412951203 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe9f406bf50 0x7fe9f406e410 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fea08036000 tx=0x7fea08031000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:19.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.761+0000 7fea11600640 1 -- 172.21.15.144:0/412951203 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fea0c058790 con 0x7fea14161610 2024-09-11T23:22:19.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:19.937+0000 7fea1c000640 1 -- 172.21.15.144:0/412951203 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fea1415e7a0 con 0x7fea14161610 2024-09-11T23:22:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.716+0000 7fea11600640 1 -- 172.21.15.144:0/412951203 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v74) ==== 181+0+0 (secure 0 0 0) 0x7fea0c05ca90 con 0x7fea14161610 2024-09-11T23:22:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:22:20.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.719+0000 7fea1c000640 1 -- 172.21.15.144:0/412951203 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe9f406bf50 msgr2=0x7fe9f406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:20.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.720+0000 7fea1c000640 1 --2- 172.21.15.144:0/412951203 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe9f406bf50 0x7fe9f406e410 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fea08036000 tx=0x7fea08031000 comp rx=0 tx=0).stop 2024-09-11T23:22:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.720+0000 7fea1c000640 1 -- 172.21.15.144:0/412951203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea14161610 msgr2=0x7fea14159130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.720+0000 7fea1c000640 1 --2- 172.21.15.144:0/412951203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea14161610 0x7fea14159130 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00c730 tx=0x7fea0c00cbf0 comp rx=0 tx=0).stop 2024-09-11T23:22:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.720+0000 7fea1c000640 1 -- 172.21.15.144:0/412951203 shutdown_connections 2024-09-11T23:22:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.720+0000 7fea1c000640 1 --2- 172.21.15.144:0/412951203 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe9f406bf50 0x7fe9f406e410 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.720+0000 7fea1c000640 1 --2- 172.21.15.144:0/412951203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fea14161610 0x7fea14159130 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.720+0000 7fea1c000640 1 --2- 172.21.15.144:0/412951203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fea1415ece0 0x7fea140cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.720+0000 7fea1c000640 1 --2- 172.21.15.144:0/412951203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea140b50c0 0x7fea140cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.720+0000 7fea1c000640 1 -- 172.21.15.144:0/412951203 >> 172.21.15.144:0/412951203 conn(0x7fea1406bba0 msgr2=0x7fea14160ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.720+0000 7fea1c000640 1 -- 172.21.15.144:0/412951203 shutdown_connections 2024-09-11T23:22:20.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.720+0000 7fea1c000640 1 -- 172.21.15.144:0/412951203 wait complete. 2024-09-11T23:22:20.739 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:22:20.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.904+0000 7f3477e00640 1 Processor -- start 2024-09-11T23:22:20.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.904+0000 7f3477e00640 1 -- start start 2024-09-11T23:22:20.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.905+0000 7f3477e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f34700b61e0 0x7f34700b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:20.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.905+0000 7f3477e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34701633f0 con 0x7f34700d3990 2024-09-11T23:22:20.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.905+0000 7f3477e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34700b6b00 con 0x7f34700b3b00 2024-09-11T23:22:20.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.905+0000 7f3477e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f34700d24f0 con 0x7f34700b61e0 2024-09-11T23:22:20.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.906+0000 7f3475e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f34700d3990 0x7f3470162ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43624/0 (socket says 172.21.15.144:43624) 2024-09-11T23:22:20.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.906+0000 7f3475e00640 1 -- 172.21.15.144:0/1780061964 learned_addr learned my addr 172.21.15.144:0/1780061964 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:20.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.906+0000 7f3475400640 1 --2- 172.21.15.144:0/1780061964 >> v2:172.21.15.165:3300/0 conn(0x7f34700b61e0 0x7f34700b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:20.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.906+0000 7f346fe00640 1 -- 172.21.15.144:0/1780061964 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1245042834 0 0) 0x7f34701633f0 con 0x7f34700d3990 2024-09-11T23:22:20.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.906+0000 7f346fe00640 1 -- 172.21.15.144:0/1780061964 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3458003520 con 0x7f34700d3990 2024-09-11T23:22:20.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.906+0000 7f346fe00640 1 -- 172.21.15.144:0/1780061964 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 36407207 0 0) 0x7f3458003520 con 0x7f34700d3990 2024-09-11T23:22:20.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.906+0000 7f346fe00640 1 -- 172.21.15.144:0/1780061964 >> v2:172.21.15.165:3300/0 conn(0x7f34700b61e0 msgr2=0x7f34700b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:20.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.906+0000 7f346fe00640 1 --2- 172.21.15.144:0/1780061964 >> v2:172.21.15.165:3300/0 conn(0x7f34700b61e0 0x7f34700b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:20.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.906+0000 7f346fe00640 1 -- 172.21.15.144:0/1780061964 >> v1:172.21.15.165:6789/0 conn(0x7f34700b3b00 legacy=0x7f34701625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.906+0000 7f346fe00640 1 -- 172.21.15.144:0/1780061964 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34700d20e0 con 0x7f34700d3990 2024-09-11T23:22:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.906+0000 7f346fe00640 1 -- 172.21.15.144:0/1780061964 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f34680019f0 con 0x7f34700d3990 2024-09-11T23:22:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.907+0000 7f346fe00640 1 -- 172.21.15.144:0/1780061964 >> v1:172.21.15.144:6789/0 conn(0x7f34700d3990 legacy=0x7f3470162ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.907+0000 7f346fe00640 1 --2- 172.21.15.144:0/1780061964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34580039b0 0x7f3458003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.907+0000 7f346fe00640 1 --2- 172.21.15.144:0/1780061964 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3458004800 0x7f3458004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.907+0000 7f346fe00640 1 --2- 172.21.15.144:0/1780061964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34580052e0 0x7f345800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.907+0000 7f346fe00640 1 -- 172.21.15.144:0/1780061964 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f34700d24f0 con 0x7f34580052e0 2024-09-11T23:22:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.907+0000 7f346fe00640 1 -- 172.21.15.144:0/1780061964 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f345800c1b0 con 0x7f34580039b0 2024-09-11T23:22:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.907+0000 7f346fe00640 1 -- 172.21.15.144:0/1780061964 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f345800c3b0 con 0x7f3458004800 2024-09-11T23:22:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.907+0000 7f3475e00640 1 --2- 172.21.15.144:0/1780061964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34580052e0 0x7f345800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.907+0000 7f3475400640 1 --2- 172.21.15.144:0/1780061964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34580039b0 0x7f3458003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.907+0000 7f3474a00640 1 --2- 172.21.15.144:0/1780061964 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3458004800 0x7f3458004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:20.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.907+0000 7f3475e00640 1 -- 172.21.15.144:0/1780061964 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3458004800 msgr2=0x7f3458004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.907+0000 7f3475e00640 1 --2- 172.21.15.144:0/1780061964 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3458004800 0x7f3458004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.907+0000 7f3475e00640 1 -- 172.21.15.144:0/1780061964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34580039b0 msgr2=0x7f3458003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.907+0000 7f3475e00640 1 --2- 172.21.15.144:0/1780061964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34580039b0 0x7f3458003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.907+0000 7f3475e00640 1 -- 172.21.15.144:0/1780061964 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3458003520 con 0x7f34580052e0 2024-09-11T23:22:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.908+0000 7f3475e00640 1 -- 172.21.15.144:0/1780061964 reap_dead start 2024-09-11T23:22:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.908+0000 7f3475e00640 1 --2- 172.21.15.144:0/1780061964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34580052e0 0x7f345800b9c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3468002230 tx=0x7f3458005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0e9f788dd78f65 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.908+0000 7f346fe00640 1 -- 172.21.15.144:0/1780061964 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346800a4a0 con 0x7f34580052e0 2024-09-11T23:22:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.909+0000 7f346fe00640 1 -- 172.21.15.144:0/1780061964 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f346802f070 con 0x7f34580052e0 2024-09-11T23:22:20.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.909+0000 7f346fe00640 1 -- 172.21.15.144:0/1780061964 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346802bcb0 con 0x7f34580052e0 2024-09-11T23:22:20.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.909+0000 7f3477e00640 1 -- 172.21.15.144:0/1780061964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34580052e0 msgr2=0x7f345800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:20.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.909+0000 7f3477e00640 1 --2- 172.21.15.144:0/1780061964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34580052e0 0x7f345800b9c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3468002230 tx=0x7f3458005830 comp rx=0 tx=0).stop 2024-09-11T23:22:20.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.909+0000 7f3477e00640 1 -- 172.21.15.144:0/1780061964 shutdown_connections 2024-09-11T23:22:20.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.909+0000 7f3477e00640 1 --2- 172.21.15.144:0/1780061964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34580052e0 0x7f345800b9c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:20.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.909+0000 7f3477e00640 1 -- 172.21.15.144:0/1780061964 >> 172.21.15.144:0/1780061964 conn(0x7f34700d11e0 msgr2=0x7f34700d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:20.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.909+0000 7f3477e00640 1 -- 172.21.15.144:0/1780061964 shutdown_connections 2024-09-11T23:22:20.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.909+0000 7f3477e00640 1 -- 172.21.15.144:0/1780061964 wait complete. 2024-09-11T23:22:20.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.911+0000 7f3477e00640 1 Processor -- start 2024-09-11T23:22:20.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.911+0000 7f3477e00640 1 -- start start 2024-09-11T23:22:20.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.912+0000 7f3477e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34580052e0 0x7f3470152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:20.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.912+0000 7f3477e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f34700ad100 0x7f34700b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:20.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.912+0000 7f3477e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34700b52d0 0x7f34700ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:20.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.912+0000 7f3477e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f34700d0030 con 0x7f34580052e0 2024-09-11T23:22:20.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.912+0000 7f3477e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f34700cfd50 con 0x7f34700b52d0 2024-09-11T23:22:20.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.912+0000 7f3477e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f347015edc0 con 0x7f34700ad100 2024-09-11T23:22:20.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.912+0000 7f3475400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34580052e0 0x7f3470152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:20.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.912+0000 7f3475400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34580052e0 0x7f3470152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47260/0 (socket says 172.21.15.144:47260) 2024-09-11T23:22:20.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.912+0000 7f3475400640 1 -- 172.21.15.144:0/2843553959 learned_addr learned my addr 172.21.15.144:0/2843553959 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:20.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.912+0000 7f3474a00640 1 --2- 172.21.15.144:0/2843553959 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f34700ad100 0x7f34700b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:20.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.912+0000 7f3475e00640 1 --2- 172.21.15.144:0/2843553959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34700b52d0 0x7f34700ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:20.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.913+0000 7f3475400640 1 -- 172.21.15.144:0/2843553959 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f34700ad100 msgr2=0x7f34700b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:20.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.913+0000 7f3475400640 1 --2- 172.21.15.144:0/2843553959 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f34700ad100 0x7f34700b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:20.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.913+0000 7f3475400640 1 -- 172.21.15.144:0/2843553959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34700b52d0 msgr2=0x7f34700ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:20.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.913+0000 7f3475400640 1 --2- 172.21.15.144:0/2843553959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34700b52d0 0x7f34700ab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:20.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.913+0000 7f3475400640 1 -- 172.21.15.144:0/2843553959 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34700ac060 con 0x7f34580052e0 2024-09-11T23:22:20.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.913+0000 7f3475400640 1 --2- 172.21.15.144:0/2843553959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34580052e0 0x7f3470152ab0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f34640118e0 tx=0x7f3464011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:20.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.913+0000 7f346d600640 1 -- 172.21.15.144:0/2843553959 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346400faf0 con 0x7f34580052e0 2024-09-11T23:22:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.913+0000 7f346d600640 1 -- 172.21.15.144:0/2843553959 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f346400fc90 con 0x7f34580052e0 2024-09-11T23:22:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.913+0000 7f346d600640 1 -- 172.21.15.144:0/2843553959 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464014440 con 0x7f34580052e0 2024-09-11T23:22:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.913+0000 7f3477e00640 1 -- 172.21.15.144:0/2843553959 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34700ac340 con 0x7f34580052e0 2024-09-11T23:22:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.913+0000 7f3477e00640 1 -- 172.21.15.144:0/2843553959 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34700ac900 con 0x7f34580052e0 2024-09-11T23:22:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.914+0000 7f3477e00640 1 -- 172.21.15.144:0/2843553959 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34700d1d00 con 0x7f34580052e0 2024-09-11T23:22:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.915+0000 7f346d600640 1 -- 172.21.15.144:0/2843553959 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f3464012040 con 0x7f34580052e0 2024-09-11T23:22:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.916+0000 7f346d600640 1 --2- 172.21.15.144:0/2843553959 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f345006bf80 0x7f345006e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.916+0000 7f346d600640 1 -- 172.21.15.144:0/2843553959 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5916+0+0 (secure 0 0 0) 0x7f346408b7c0 con 0x7f34580052e0 2024-09-11T23:22:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.916+0000 7f3474a00640 1 --2- 172.21.15.144:0/2843553959 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f345006bf80 0x7f345006e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.917+0000 7f3474a00640 1 --2- 172.21.15.144:0/2843553959 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f345006bf80 0x7f345006e440 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f34700cf580 tx=0x7f345c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:20.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:20.920+0000 7f346d600640 1 -- 172.21.15.144:0/2843553959 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3464019030 con 0x7f34580052e0 2024-09-11T23:22:21.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.095+0000 7f3477e00640 1 -- 172.21.15.144:0/2843553959 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f34700b37d0 con 0x7f34580052e0 2024-09-11T23:22:21.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.723+0000 7f346d600640 1 -- 172.21.15.144:0/2843553959 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v75) ==== 169+0+0 (secure 0 0 0) 0x7f346401b300 con 0x7f34580052e0 2024-09-11T23:22:21.723 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-11T23:22:21.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.727+0000 7f3477e00640 1 -- 172.21.15.144:0/2843553959 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f345006bf80 msgr2=0x7f345006e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:21.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.727+0000 7f3477e00640 1 --2- 172.21.15.144:0/2843553959 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f345006bf80 0x7f345006e440 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f34700cf580 tx=0x7f345c009040 comp rx=0 tx=0).stop 2024-09-11T23:22:21.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.727+0000 7f3477e00640 1 -- 172.21.15.144:0/2843553959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34580052e0 msgr2=0x7f3470152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:21.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.727+0000 7f3477e00640 1 --2- 172.21.15.144:0/2843553959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34580052e0 0x7f3470152ab0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f34640118e0 tx=0x7f3464011da0 comp rx=0 tx=0).stop 2024-09-11T23:22:21.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.727+0000 7f3477e00640 1 -- 172.21.15.144:0/2843553959 shutdown_connections 2024-09-11T23:22:21.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.727+0000 7f3477e00640 1 --2- 172.21.15.144:0/2843553959 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f345006bf80 0x7f345006e440 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:21.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.727+0000 7f3477e00640 1 --2- 172.21.15.144:0/2843553959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34700b52d0 0x7f34700ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:21.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.727+0000 7f3477e00640 1 --2- 172.21.15.144:0/2843553959 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f34700ad100 0x7f34700b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:21.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.727+0000 7f3477e00640 1 --2- 172.21.15.144:0/2843553959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34580052e0 0x7f3470152ab0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:21.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.727+0000 7f3477e00640 1 -- 172.21.15.144:0/2843553959 >> 172.21.15.144:0/2843553959 conn(0x7f34700d11e0 msgr2=0x7f34700b7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:21.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.727+0000 7f3477e00640 1 -- 172.21.15.144:0/2843553959 shutdown_connections 2024-09-11T23:22:21.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.727+0000 7f3477e00640 1 -- 172.21.15.144:0/2843553959 wait complete. 2024-09-11T23:22:21.745 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:22:21.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.901+0000 7f4ca0400640 1 Processor -- start 2024-09-11T23:22:21.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.901+0000 7f4ca0400640 1 -- start start 2024-09-11T23:22:21.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.903+0000 7f4ca0400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c980cf320 0x7f4c980cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:21.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.903+0000 7f4ca0400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c9806d700 con 0x7f4c9815d790 2024-09-11T23:22:21.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.903+0000 7f4ca0400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c980cde80 con 0x7f4c9815d3b0 2024-09-11T23:22:21.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.903+0000 7f4ca0400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4c9806da30 con 0x7f4c980cf320 2024-09-11T23:22:21.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.903+0000 7f4c9d000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4c9815d790 0x7f4c980cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43632/0 (socket says 172.21.15.144:43632) 2024-09-11T23:22:21.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.903+0000 7f4c9d000640 1 -- 172.21.15.144:0/2503756153 learned_addr learned my addr 172.21.15.144:0/2503756153 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:21.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.903+0000 7f4c9e400640 1 --2- 172.21.15.144:0/2503756153 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c980cf320 0x7f4c980cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:21.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.903+0000 7f4c97e00640 1 -- 172.21.15.144:0/2503756153 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3500454292 0 0) 0x7f4c9806d700 con 0x7f4c9815d790 2024-09-11T23:22:21.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.903+0000 7f4c97e00640 1 -- 172.21.15.144:0/2503756153 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c80003520 con 0x7f4c9815d790 2024-09-11T23:22:21.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.904+0000 7f4c97e00640 1 -- 172.21.15.144:0/2503756153 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1487529162 0 0) 0x7f4c80003520 con 0x7f4c9815d790 2024-09-11T23:22:21.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.904+0000 7f4c97e00640 1 -- 172.21.15.144:0/2503756153 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c980cf320 msgr2=0x7f4c980cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:21.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.904+0000 7f4c97e00640 1 --2- 172.21.15.144:0/2503756153 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c980cf320 0x7f4c980cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:21.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.904+0000 7f4c97e00640 1 -- 172.21.15.144:0/2503756153 >> v1:172.21.15.165:6789/0 conn(0x7f4c9815d3b0 legacy=0x7f4c98071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:21.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.904+0000 7f4c97e00640 1 -- 172.21.15.144:0/2503756153 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c980cd8c0 con 0x7f4c9815d790 2024-09-11T23:22:21.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.904+0000 7f4c97e00640 1 -- 172.21.15.144:0/2503756153 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f4c840017f0 con 0x7f4c9815d790 2024-09-11T23:22:21.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.904+0000 7f4c97e00640 1 -- 172.21.15.144:0/2503756153 >> v1:172.21.15.144:6789/0 conn(0x7f4c9815d790 legacy=0x7f4c980cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:21.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.904+0000 7f4c97e00640 1 --2- 172.21.15.144:0/2503756153 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c800039e0 0x7f4c80003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:21.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.904+0000 7f4c97e00640 1 --2- 172.21.15.144:0/2503756153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c80004800 0x7f4c80004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:21.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.904+0000 7f4c97e00640 1 --2- 172.21.15.144:0/2503756153 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c980cf320 0x7f4c800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:21.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.904+0000 7f4c97e00640 1 -- 172.21.15.144:0/2503756153 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9806da30 con 0x7f4c80004800 2024-09-11T23:22:21.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.904+0000 7f4c97e00640 1 -- 172.21.15.144:0/2503756153 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8000bac0 con 0x7f4c800039e0 2024-09-11T23:22:21.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.904+0000 7f4c97e00640 1 -- 172.21.15.144:0/2503756153 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4c8000bcc0 con 0x7f4c980cf320 2024-09-11T23:22:21.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.904+0000 7f4c9d000640 1 --2- 172.21.15.144:0/2503756153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c80004800 0x7f4c80004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:21.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.904+0000 7f4c9e400640 1 --2- 172.21.15.144:0/2503756153 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c980cf320 0x7f4c800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:21.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.904+0000 7f4c9da00640 1 --2- 172.21.15.144:0/2503756153 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c800039e0 0x7f4c80003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:21.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.905+0000 7f4c9d000640 1 -- 172.21.15.144:0/2503756153 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c980cf320 msgr2=0x7f4c800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:21.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.905+0000 7f4c9d000640 1 --2- 172.21.15.144:0/2503756153 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c980cf320 0x7f4c800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.905+0000 7f4c9d000640 1 -- 172.21.15.144:0/2503756153 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c800039e0 msgr2=0x7f4c80003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.905+0000 7f4c9d000640 1 --2- 172.21.15.144:0/2503756153 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c800039e0 0x7f4c80003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.905+0000 7f4c9d000640 1 -- 172.21.15.144:0/2503756153 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c80003520 con 0x7f4c80004800 2024-09-11T23:22:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.906+0000 7f4c9d000640 1 --2- 172.21.15.144:0/2503756153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c80004800 0x7f4c80004c80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f4c84007fd0 tx=0x7f4c80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c139d5c2f31da869 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.906+0000 7f4c97e00640 1 -- 172.21.15.144:0/2503756153 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c84007c20 con 0x7f4c80004800 2024-09-11T23:22:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.906+0000 7f4c97e00640 1 -- 172.21.15.144:0/2503756153 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c84007290 con 0x7f4c80004800 2024-09-11T23:22:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.906+0000 7f4c97e00640 1 -- 172.21.15.144:0/2503756153 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c840057a0 con 0x7f4c80004800 2024-09-11T23:22:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.906+0000 7f4ca0400640 1 -- 172.21.15.144:0/2503756153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c80004800 msgr2=0x7f4c80004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.906+0000 7f4ca0400640 1 --2- 172.21.15.144:0/2503756153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c80004800 0x7f4c80004c80 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f4c84007fd0 tx=0x7f4c80005830 comp rx=0 tx=0).stop 2024-09-11T23:22:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.906+0000 7f4c9e400640 1 -- 172.21.15.144:0/2503756153 reap_dead start 2024-09-11T23:22:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.906+0000 7f4ca0400640 1 -- 172.21.15.144:0/2503756153 shutdown_connections 2024-09-11T23:22:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.906+0000 7f4ca0400640 1 -- 172.21.15.144:0/2503756153 >> 172.21.15.144:0/2503756153 conn(0x7f4c9806bba0 msgr2=0x7f4c9806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.906+0000 7f4ca0400640 1 -- 172.21.15.144:0/2503756153 shutdown_connections 2024-09-11T23:22:21.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.906+0000 7f4ca0400640 1 -- 172.21.15.144:0/2503756153 wait complete. 2024-09-11T23:22:21.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.908+0000 7f4ca0400640 1 Processor -- start 2024-09-11T23:22:21.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.908+0000 7f4ca0400640 1 -- start start 2024-09-11T23:22:21.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.909+0000 7f4ca0400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c80004800 0x7f4c98158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:21.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.909+0000 7f4ca0400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c98149e60 0x7f4c980ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:21.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.909+0000 7f4ca0400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c98157bb0 0x7f4c98158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:21.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.909+0000 7f4ca0400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9815cbf0 con 0x7f4c98149e60 2024-09-11T23:22:21.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.909+0000 7f4ca0400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4c980cd580 con 0x7f4c98157bb0 2024-09-11T23:22:21.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.909+0000 7f4ca0400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4c9815cd70 con 0x7f4c80004800 2024-09-11T23:22:21.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.909+0000 7f4c9d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c98149e60 0x7f4c980ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:21.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.909+0000 7f4c9d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c98149e60 0x7f4c980ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47280/0 (socket says 172.21.15.144:47280) 2024-09-11T23:22:21.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.909+0000 7f4c9d000640 1 -- 172.21.15.144:0/2425171952 learned_addr learned my addr 172.21.15.144:0/2425171952 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:21.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.910+0000 7f4c9e400640 1 --2- 172.21.15.144:0/2425171952 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c98157bb0 0x7f4c98158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.910+0000 7f4c9da00640 1 --2- 172.21.15.144:0/2425171952 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c80004800 0x7f4c98158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.910+0000 7f4c9d000640 1 -- 172.21.15.144:0/2425171952 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c80004800 msgr2=0x7f4c98158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.910+0000 7f4c9d000640 1 --2- 172.21.15.144:0/2425171952 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c80004800 0x7f4c98158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.910+0000 7f4c9d000640 1 -- 172.21.15.144:0/2425171952 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c98157bb0 msgr2=0x7f4c98158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.910+0000 7f4c9d000640 1 --2- 172.21.15.144:0/2425171952 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c98157bb0 0x7f4c98158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.910+0000 7f4c9d000640 1 -- 172.21.15.144:0/2425171952 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c980af580 con 0x7f4c98149e60 2024-09-11T23:22:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.910+0000 7f4c9d000640 1 --2- 172.21.15.144:0/2425171952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c98149e60 0x7f4c980ae6b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4c8400c250 tx=0x7f4c980cda90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.910+0000 7f4c95600640 1 -- 172.21.15.144:0/2425171952 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c84040020 con 0x7f4c98149e60 2024-09-11T23:22:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.910+0000 7f4c95600640 1 -- 172.21.15.144:0/2425171952 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c84001530 con 0x7f4c98149e60 2024-09-11T23:22:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.910+0000 7f4ca0400640 1 -- 172.21.15.144:0/2425171952 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c980aefc0 con 0x7f4c98149e60 2024-09-11T23:22:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.910+0000 7f4c95600640 1 -- 172.21.15.144:0/2425171952 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c84037040 con 0x7f4c98149e60 2024-09-11T23:22:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.911+0000 7f4ca0400640 1 -- 172.21.15.144:0/2425171952 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c980ab650 con 0x7f4c98149e60 2024-09-11T23:22:21.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.911+0000 7f4ca0400640 1 -- 172.21.15.144:0/2425171952 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c9815e750 con 0x7f4c98149e60 2024-09-11T23:22:21.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.912+0000 7f4c95600640 1 -- 172.21.15.144:0/2425171952 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f4c84043020 con 0x7f4c98149e60 2024-09-11T23:22:21.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.913+0000 7f4c95600640 1 --2- 172.21.15.144:0/2425171952 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c7806bf50 0x7f4c7806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:21.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.913+0000 7f4c95600640 1 -- 172.21.15.144:0/2425171952 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5502+0+0 (secure 0 0 0) 0x7f4c840aa910 con 0x7f4c98149e60 2024-09-11T23:22:21.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.914+0000 7f4c9da00640 1 --2- 172.21.15.144:0/2425171952 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c7806bf50 0x7f4c7806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:21.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.914+0000 7f4c9da00640 1 --2- 172.21.15.144:0/2425171952 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c7806bf50 0x7f4c7806e410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c000c00 tx=0x7f4c8c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:21.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:21.917+0000 7f4c95600640 1 -- 172.21.15.144:0/2425171952 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c8404a070 con 0x7f4c98149e60 2024-09-11T23:22:22.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.089+0000 7f4ca0400640 1 -- 172.21.15.144:0/2425171952 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f4c980b2da0 con 0x7f4c98149e60 2024-09-11T23:22:22.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.093+0000 7f4c95600640 1 -- 172.21.15.144:0/2425171952 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f4c8403b370 con 0x7f4c98149e60 2024-09-11T23:22:22.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.095+0000 7f4ca0400640 1 -- 172.21.15.144:0/2425171952 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c7806bf50 msgr2=0x7f4c7806e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.095+0000 7f4ca0400640 1 --2- 172.21.15.144:0/2425171952 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c7806bf50 0x7f4c7806e410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c000c00 tx=0x7f4c8c009040 comp rx=0 tx=0).stop 2024-09-11T23:22:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.095+0000 7f4ca0400640 1 -- 172.21.15.144:0/2425171952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c98149e60 msgr2=0x7f4c980ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.095+0000 7f4ca0400640 1 --2- 172.21.15.144:0/2425171952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c98149e60 0x7f4c980ae6b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4c8400c250 tx=0x7f4c980cda90 comp rx=0 tx=0).stop 2024-09-11T23:22:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.095+0000 7f4ca0400640 1 -- 172.21.15.144:0/2425171952 shutdown_connections 2024-09-11T23:22:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.095+0000 7f4ca0400640 1 --2- 172.21.15.144:0/2425171952 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c7806bf50 0x7f4c7806e410 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.095+0000 7f4ca0400640 1 --2- 172.21.15.144:0/2425171952 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c98157bb0 0x7f4c98158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.095+0000 7f4ca0400640 1 --2- 172.21.15.144:0/2425171952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c98149e60 0x7f4c980ae6b0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.095+0000 7f4ca0400640 1 --2- 172.21.15.144:0/2425171952 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c80004800 0x7f4c98158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:22.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.095+0000 7f4ca0400640 1 -- 172.21.15.144:0/2425171952 >> 172.21.15.144:0/2425171952 conn(0x7f4c9806bba0 msgr2=0x7f4c9815ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:22.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.095+0000 7f4ca0400640 1 -- 172.21.15.144:0/2425171952 shutdown_connections 2024-09-11T23:22:22.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.096+0000 7f4ca0400640 1 -- 172.21.15.144:0/2425171952 wait complete. 2024-09-11T23:22:22.111 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction' 2024-09-11T23:22:22.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.265+0000 7f5924c00640 1 Processor -- start 2024-09-11T23:22:22.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.265+0000 7f5924c00640 1 -- start start 2024-09-11T23:22:22.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.266+0000 7f5924c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59200b5fd0 0x7f59200b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:22.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.266+0000 7f5924c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f59200b7750 0x7f59200b7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:22.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.266+0000 7f5924c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f592006bee0 con 0x7f592015e640 2024-09-11T23:22:22.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.266+0000 7f5924c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f592015ea20 con 0x7f59200b7750 2024-09-11T23:22:22.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.266+0000 7f5924c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f592006caf0 con 0x7f59200b5fd0 2024-09-11T23:22:22.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.266+0000 7f591f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f592015e640 0x7f59200d3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43636/0 (socket says 172.21.15.144:43636) 2024-09-11T23:22:22.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.266+0000 7f591f400640 1 -- 172.21.15.144:0/2096197928 learned_addr learned my addr 172.21.15.144:0/2096197928 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:22.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.267+0000 7f591fe00640 1 --2- 172.21.15.144:0/2096197928 >> v2:172.21.15.144:3300/0 conn(0x7f59200b7750 0x7f59200b7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:22.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.267+0000 7f591ea00640 1 --2- 172.21.15.144:0/2096197928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59200b5fd0 0x7f59200b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:22.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.267+0000 7f591e000640 1 -- 172.21.15.144:0/2096197928 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2653482953 0 0) 0x7f592006bee0 con 0x7f592015e640 2024-09-11T23:22:22.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.267+0000 7f591e000640 1 -- 172.21.15.144:0/2096197928 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5904003520 con 0x7f592015e640 2024-09-11T23:22:22.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.267+0000 7f591fe00640 1 -- 172.21.15.144:0/2096197928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59200b5fd0 msgr2=0x7f59200b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:22.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.267+0000 7f591fe00640 1 --2- 172.21.15.144:0/2096197928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59200b5fd0 0x7f59200b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:22.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.267+0000 7f591fe00640 1 -- 172.21.15.144:0/2096197928 >> v1:172.21.15.144:6789/0 conn(0x7f592015e640 legacy=0x7f59200d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:22.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.267+0000 7f591fe00640 1 -- 172.21.15.144:0/2096197928 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592006c1c0 con 0x7f59200b7750 2024-09-11T23:22:22.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.268+0000 7f591fe00640 1 --2- 172.21.15.144:0/2096197928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59200b7750 0x7f59200b7c00 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5918009d90 tx=0x7f591802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84ffe1f762d01fa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:22.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.268+0000 7f591e000640 1 -- 172.21.15.144:0/2096197928 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5918007740 con 0x7f59200b7750 2024-09-11T23:22:22.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.268+0000 7f591e000640 1 -- 172.21.15.144:0/2096197928 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59180078e0 con 0x7f59200b7750 2024-09-11T23:22:22.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.268+0000 7f591e000640 1 -- 172.21.15.144:0/2096197928 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5918007c90 con 0x7f59200b7750 2024-09-11T23:22:22.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.269+0000 7f5924c00640 1 -- 172.21.15.144:0/2096197928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59200b7750 msgr2=0x7f59200b7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:22.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.269+0000 7f5924c00640 1 --2- 172.21.15.144:0/2096197928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59200b7750 0x7f59200b7c00 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5918009d90 tx=0x7f591802a660 comp rx=0 tx=0).stop 2024-09-11T23:22:22.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.269+0000 7f5924c00640 1 -- 172.21.15.144:0/2096197928 shutdown_connections 2024-09-11T23:22:22.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.269+0000 7f5924c00640 1 --2- 172.21.15.144:0/2096197928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59200b7750 0x7f59200b7c00 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:22.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.269+0000 7f5924c00640 1 --2- 172.21.15.144:0/2096197928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59200b5fd0 0x7f59200b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:22.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.269+0000 7f5924c00640 1 -- 172.21.15.144:0/2096197928 >> 172.21.15.144:0/2096197928 conn(0x7f59200d0fd0 msgr2=0x7f59200d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:22.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.269+0000 7f5924c00640 1 -- 172.21.15.144:0/2096197928 shutdown_connections 2024-09-11T23:22:22.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.269+0000 7f5924c00640 1 -- 172.21.15.144:0/2096197928 wait complete. 2024-09-11T23:22:22.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.271+0000 7f5924c00640 1 Processor -- start 2024-09-11T23:22:22.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.271+0000 7f5924c00640 1 -- start start 2024-09-11T23:22:22.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.272+0000 7f5924c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59200b5fd0 0x7f59201e7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:22.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.272+0000 7f5924c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59200b7750 0x7f5920160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:22.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.272+0000 7f5924c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f592015e640 0x7f59201e6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:22.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.272+0000 7f5924c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f592006c780 con 0x7f59200b5fd0 2024-09-11T23:22:22.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.272+0000 7f5924c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f59200b6950 con 0x7f592015e640 2024-09-11T23:22:22.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.272+0000 7f5924c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f59200d4130 con 0x7f59200b7750 2024-09-11T23:22:22.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.272+0000 7f591f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59200b5fd0 0x7f59201e7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:22.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.272+0000 7f591f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59200b5fd0 0x7f59201e7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47296/0 (socket says 172.21.15.144:47296) 2024-09-11T23:22:22.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.272+0000 7f591f400640 1 -- 172.21.15.144:0/413447623 learned_addr learned my addr 172.21.15.144:0/413447623 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:22.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.272+0000 7f591f400640 1 -- 172.21.15.144:0/413447623 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59200b7750 msgr2=0x7f5920160bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:22.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.272+0000 7f591f400640 1 --2- 172.21.15.144:0/413447623 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59200b7750 0x7f5920160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:22.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.272+0000 7f591f400640 1 -- 172.21.15.144:0/413447623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f592015e640 msgr2=0x7f59201e6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:22.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.272+0000 7f591f400640 1 --2- 172.21.15.144:0/413447623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f592015e640 0x7f59201e6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:22.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.272+0000 7f591f400640 1 -- 172.21.15.144:0/413447623 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59201e8470 con 0x7f59200b5fd0 2024-09-11T23:22:22.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.272+0000 7f591f400640 1 --2- 172.21.15.144:0/413447623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59200b5fd0 0x7f59201e7d20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f591000c430 tx=0x7f591000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:22.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.273+0000 7f5917400640 1 -- 172.21.15.144:0/413447623 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910017070 con 0x7f59200b5fd0 2024-09-11T23:22:22.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.273+0000 7f5917400640 1 -- 172.21.15.144:0/413447623 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5910005ce0 con 0x7f59200b5fd0 2024-09-11T23:22:22.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.273+0000 7f5924c00640 1 -- 172.21.15.144:0/413447623 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59201e8750 con 0x7f59200b5fd0 2024-09-11T23:22:22.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.273+0000 7f5917400640 1 -- 172.21.15.144:0/413447623 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59100072f0 con 0x7f59200b5fd0 2024-09-11T23:22:22.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.273+0000 7f5924c00640 1 -- 172.21.15.144:0/413447623 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59201e8d10 con 0x7f59200b5fd0 2024-09-11T23:22:22.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.274+0000 7f5924c00640 1 -- 172.21.15.144:0/413447623 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59200b6410 con 0x7f59200b5fd0 2024-09-11T23:22:22.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.275+0000 7f5917400640 1 -- 172.21.15.144:0/413447623 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f591001a070 con 0x7f59200b5fd0 2024-09-11T23:22:22.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.276+0000 7f5917400640 1 --2- 172.21.15.144:0/413447623 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f590006bf50 0x7f590006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:22.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.276+0000 7f5917400640 1 -- 172.21.15.144:0/413447623 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5502+0+0 (secure 0 0 0) 0x7f591008a400 con 0x7f59200b5fd0 2024-09-11T23:22:22.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.276+0000 7f591ea00640 1 --2- 172.21.15.144:0/413447623 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f590006bf50 0x7f590006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:22.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.277+0000 7f591ea00640 1 --2- 172.21.15.144:0/413447623 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f590006bf50 0x7f590006e410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f59201609c0 tx=0x7f590c009500 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:22.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.280+0000 7f5917400640 1 -- 172.21.15.144:0/413447623 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5910058d70 con 0x7f59200b5fd0 2024-09-11T23:22:22.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.514+0000 7f5924c00640 1 -- 172.21.15.144:0/413447623 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]} v 0) -- 0x7f59200b5b70 con 0x7f59200b5fd0 2024-09-11T23:22:22.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.725+0000 7f5917400640 1 -- 172.21.15.144:0/413447623 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]}]=0 v241) ==== 131+0+0 (secure 0 0 0) 0x7f5910088e20 con 0x7f59200b5fd0 2024-09-11T23:22:22.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.727+0000 7f5924c00640 1 -- 172.21.15.144:0/413447623 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f590006bf50 msgr2=0x7f590006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:22.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.727+0000 7f5924c00640 1 --2- 172.21.15.144:0/413447623 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f590006bf50 0x7f590006e410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f59201609c0 tx=0x7f590c009500 comp rx=0 tx=0).stop 2024-09-11T23:22:22.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.727+0000 7f5924c00640 1 -- 172.21.15.144:0/413447623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59200b5fd0 msgr2=0x7f59201e7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:22.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.727+0000 7f5924c00640 1 --2- 172.21.15.144:0/413447623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59200b5fd0 0x7f59201e7d20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f591000c430 tx=0x7f591000c8f0 comp rx=0 tx=0).stop 2024-09-11T23:22:22.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.728+0000 7f5924c00640 1 -- 172.21.15.144:0/413447623 shutdown_connections 2024-09-11T23:22:22.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.728+0000 7f5924c00640 1 --2- 172.21.15.144:0/413447623 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f590006bf50 0x7f590006e410 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:22.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.728+0000 7f5924c00640 1 --2- 172.21.15.144:0/413447623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f592015e640 0x7f59201e6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:22.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.728+0000 7f5924c00640 1 --2- 172.21.15.144:0/413447623 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59200b7750 0x7f5920160bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:22.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.728+0000 7f5924c00640 1 --2- 172.21.15.144:0/413447623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59200b5fd0 0x7f59201e7d20 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:22.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.728+0000 7f5924c00640 1 -- 172.21.15.144:0/413447623 >> 172.21.15.144:0/413447623 conn(0x7f59200d0fd0 msgr2=0x7f59200b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:22.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.728+0000 7f5924c00640 1 -- 172.21.15.144:0/413447623 shutdown_connections 2024-09-11T23:22:22.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.728+0000 7f5924c00640 1 -- 172.21.15.144:0/413447623 wait complete. 2024-09-11T23:22:22.743 INFO:tasks.cephfs_test_runner:test_mgr_eviction (tasks.cephfs.test_volumes.TestMisc) ... ok 2024-09-11T23:22:22.743 INFO:tasks.cephfs_test_runner:Starting test: test_names_can_only_be_goodchars (tasks.cephfs.test_volumes.TestMisc) Test the creating vols, subvols subvolgroups fails when their names uses 2024-09-11T23:22:22.743 INFO:tasks.cephfs_test_runner:test_names_can_only_be_goodchars (tasks.cephfs.test_volumes.TestMisc) 2024-09-11T23:22:22.744 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:22:22.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.898+0000 7f5ffe200640 1 Processor -- start 2024-09-11T23:22:22.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.898+0000 7f5ffe200640 1 -- start start 2024-09-11T23:22:22.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.899+0000 7f5ffe200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ff815e640 0x7f5ff80d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:22.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.899+0000 7f5ffe200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff806bee0 con 0x7f5ff80d3f60 2024-09-11T23:22:22.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.899+0000 7f5ffe200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff806c1c0 con 0x7f5ff80b66e0 2024-09-11T23:22:22.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.899+0000 7f5ffe200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff815ea20 con 0x7f5ff815e640 2024-09-11T23:22:22.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.899+0000 7f5ff7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5ff80d3f60 0x7f5ff80b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43638/0 (socket says 172.21.15.144:43638) 2024-09-11T23:22:22.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.899+0000 7f5ff7e00640 1 -- 172.21.15.144:0/2458271042 learned_addr learned my addr 172.21.15.144:0/2458271042 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:22.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.900+0000 7f5ffce00640 1 --2- 172.21.15.144:0/2458271042 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ff815e640 0x7f5ff80d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:22.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.900+0000 7f5ff7400640 1 -- 172.21.15.144:0/2458271042 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1056197608 0 0) 0x7f5ff806bee0 con 0x7f5ff80d3f60 2024-09-11T23:22:22.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.900+0000 7f5ff7400640 1 -- 172.21.15.144:0/2458271042 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fe0003520 con 0x7f5ff80d3f60 2024-09-11T23:22:22.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.900+0000 7f5ff7400640 1 -- 172.21.15.144:0/2458271042 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3763243637 0 0) 0x7f5ff806c1c0 con 0x7f5ff80b66e0 2024-09-11T23:22:22.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.900+0000 7f5ff7400640 1 -- 172.21.15.144:0/2458271042 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ff806bee0 con 0x7f5ff80b66e0 2024-09-11T23:22:22.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.900+0000 7f5ff7400640 1 -- 172.21.15.144:0/2458271042 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2888536140 0 0) 0x7f5fe0003520 con 0x7f5ff80d3f60 2024-09-11T23:22:22.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.900+0000 7f5ff7400640 1 -- 172.21.15.144:0/2458271042 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ff815e640 msgr2=0x7f5ff80d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.900+0000 7f5ff7400640 1 --2- 172.21.15.144:0/2458271042 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ff815e640 0x7f5ff80d3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.900+0000 7f5ff7400640 1 -- 172.21.15.144:0/2458271042 >> v1:172.21.15.165:6789/0 conn(0x7f5ff80b66e0 legacy=0x7f5ff80b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.900+0000 7f5ff7400640 1 -- 172.21.15.144:0/2458271042 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff806c4a0 con 0x7f5ff80d3f60 2024-09-11T23:22:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.900+0000 7f5ff7400640 1 -- 172.21.15.144:0/2458271042 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f5fe4001670 con 0x7f5ff80d3f60 2024-09-11T23:22:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.900+0000 7f5ff7400640 1 -- 172.21.15.144:0/2458271042 >> v1:172.21.15.144:6789/0 conn(0x7f5ff80d3f60 legacy=0x7f5ff80b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.900+0000 7f5ff7400640 1 --2- 172.21.15.144:0/2458271042 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ff815e640 0x7f5fe0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.900+0000 7f5ff7400640 1 --2- 172.21.15.144:0/2458271042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fe0004120 0x7f5fe0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.900+0000 7f5ff7400640 1 --2- 172.21.15.144:0/2458271042 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fe0004d40 0x7f5fe00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.900+0000 7f5ff7400640 1 -- 172.21.15.144:0/2458271042 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe000bad0 con 0x7f5fe0004120 2024-09-11T23:22:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.900+0000 7f5ff7400640 1 -- 172.21.15.144:0/2458271042 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe000bc80 con 0x7f5fe0004d40 2024-09-11T23:22:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.900+0000 7f5ff7400640 1 -- 172.21.15.144:0/2458271042 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5fe000be80 con 0x7f5ff815e640 2024-09-11T23:22:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.901+0000 7f5ff7e00640 1 --2- 172.21.15.144:0/2458271042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fe0004120 0x7f5fe0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.901+0000 7f5ffce00640 1 --2- 172.21.15.144:0/2458271042 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ff815e640 0x7f5fe0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:22.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.901+0000 7f5ffd800640 1 --2- 172.21.15.144:0/2458271042 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fe0004d40 0x7f5fe00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:22.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.901+0000 7f5ff7e00640 1 -- 172.21.15.144:0/2458271042 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ff815e640 msgr2=0x7f5fe0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:22.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.901+0000 7f5ff7e00640 1 --2- 172.21.15.144:0/2458271042 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ff815e640 0x7f5fe0003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:22.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.901+0000 7f5ff7e00640 1 -- 172.21.15.144:0/2458271042 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fe0004d40 msgr2=0x7f5fe00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:22.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.901+0000 7f5ff7e00640 1 --2- 172.21.15.144:0/2458271042 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fe0004d40 0x7f5fe00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:22.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.901+0000 7f5ff7e00640 1 -- 172.21.15.144:0/2458271042 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe0003520 con 0x7f5fe0004120 2024-09-11T23:22:22.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.902+0000 7f5ff7e00640 1 --2- 172.21.15.144:0/2458271042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fe0004120 0x7f5fe0004800 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80d0fa0 tx=0x7f5fe0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05a077cebde97c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:22.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.902+0000 7f5ff7400640 1 -- 172.21.15.144:0/2458271042 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4007c00 con 0x7f5fe0004120 2024-09-11T23:22:22.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.902+0000 7f5ff7400640 1 -- 172.21.15.144:0/2458271042 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe40058d0 con 0x7f5fe0004120 2024-09-11T23:22:22.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.902+0000 7f5ff7400640 1 -- 172.21.15.144:0/2458271042 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4005d20 con 0x7f5fe0004120 2024-09-11T23:22:22.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.903+0000 7f5ffe200640 1 -- 172.21.15.144:0/2458271042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fe0004120 msgr2=0x7f5fe0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:22.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.903+0000 7f5ffe200640 1 --2- 172.21.15.144:0/2458271042 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fe0004120 0x7f5fe0004800 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5ff80d0fa0 tx=0x7f5fe0005830 comp rx=0 tx=0).stop 2024-09-11T23:22:22.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.903+0000 7f5ffd800640 1 -- 172.21.15.144:0/2458271042 reap_dead start 2024-09-11T23:22:22.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.903+0000 7f5ffe200640 1 -- 172.21.15.144:0/2458271042 shutdown_connections 2024-09-11T23:22:22.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.903+0000 7f5ffe200640 1 -- 172.21.15.144:0/2458271042 >> 172.21.15.144:0/2458271042 conn(0x7f5ff80d0fd0 msgr2=0x7f5ff80d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:22.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.903+0000 7f5ffe200640 1 -- 172.21.15.144:0/2458271042 shutdown_connections 2024-09-11T23:22:22.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.903+0000 7f5ffe200640 1 -- 172.21.15.144:0/2458271042 wait complete. 2024-09-11T23:22:22.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.905+0000 7f5ffe200640 1 Processor -- start 2024-09-11T23:22:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.905+0000 7f5ffe200640 1 -- start start 2024-09-11T23:22:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.906+0000 7f5ffe200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fe0004120 0x7f5ff815d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.906+0000 7f5ffe200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ff81f3fb0 0x7f5ff8150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.906+0000 7f5ffe200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ff80cbde0 0x7f5ff80cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.906+0000 7f5ffe200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff80d3a20 con 0x7f5fe0004120 2024-09-11T23:22:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.906+0000 7f5ffe200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff806caf0 con 0x7f5ff80cbde0 2024-09-11T23:22:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.906+0000 7f5ffe200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff80d3ba0 con 0x7f5ff81f3fb0 2024-09-11T23:22:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.906+0000 7f5ffce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fe0004120 0x7f5ff815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.906+0000 7f5ffce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fe0004120 0x7f5ff815d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47314/0 (socket says 172.21.15.144:47314) 2024-09-11T23:22:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.906+0000 7f5ffce00640 1 -- 172.21.15.144:0/905103196 learned_addr learned my addr 172.21.15.144:0/905103196 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:22.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.906+0000 7f5ffd800640 1 --2- 172.21.15.144:0/905103196 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ff80cbde0 0x7f5ff80cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:22.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.906+0000 7f5ff7e00640 1 --2- 172.21.15.144:0/905103196 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ff81f3fb0 0x7f5ff8150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:22.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.906+0000 7f5ffce00640 1 -- 172.21.15.144:0/905103196 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ff81f3fb0 msgr2=0x7f5ff8150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:22.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.906+0000 7f5ffce00640 1 --2- 172.21.15.144:0/905103196 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ff81f3fb0 0x7f5ff8150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:22.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.906+0000 7f5ffce00640 1 -- 172.21.15.144:0/905103196 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ff80cbde0 msgr2=0x7f5ff80cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:22.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.906+0000 7f5ffce00640 1 --2- 172.21.15.144:0/905103196 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ff80cbde0 0x7f5ff80cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:22.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.906+0000 7f5ffce00640 1 -- 172.21.15.144:0/905103196 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff80cb620 con 0x7f5fe0004120 2024-09-11T23:22:22.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.907+0000 7f5ffce00640 1 --2- 172.21.15.144:0/905103196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fe0004120 0x7f5ff815d860 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f5fec0119d0 tx=0x7f5fec011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:22.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.907+0000 7f5ff4c00640 1 -- 172.21.15.144:0/905103196 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec00fb50 con 0x7f5fe0004120 2024-09-11T23:22:22.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.907+0000 7f5ff4c00640 1 -- 172.21.15.144:0/905103196 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fec00fcf0 con 0x7f5fe0004120 2024-09-11T23:22:22.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.907+0000 7f5ff4c00640 1 -- 172.21.15.144:0/905103196 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec00fea0 con 0x7f5fe0004120 2024-09-11T23:22:22.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.907+0000 7f5ffe200640 1 -- 172.21.15.144:0/905103196 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff81f4870 con 0x7f5fe0004120 2024-09-11T23:22:22.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.907+0000 7f5ffe200640 1 -- 172.21.15.144:0/905103196 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff81f4e30 con 0x7f5fe0004120 2024-09-11T23:22:22.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.908+0000 7f5ffe200640 1 -- 172.21.15.144:0/905103196 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff80cba20 con 0x7f5fe0004120 2024-09-11T23:22:22.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.909+0000 7f5ff4c00640 1 -- 172.21.15.144:0/905103196 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f5fec012040 con 0x7f5fe0004120 2024-09-11T23:22:22.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.909+0000 7f5ff4c00640 1 --2- 172.21.15.144:0/905103196 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5fd806bf80 0x7f5fd806e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:22.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.910+0000 7f5ff4c00640 1 -- 172.21.15.144:0/905103196 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5502+0+0 (secure 0 0 0) 0x7f5fec08b500 con 0x7f5fe0004120 2024-09-11T23:22:22.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.910+0000 7f5ff7e00640 1 --2- 172.21.15.144:0/905103196 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5fd806bf80 0x7f5fd806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:22.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.911+0000 7f5ff7e00640 1 --2- 172.21.15.144:0/905103196 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5fd806bf80 0x7f5fd806e440 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4032000 tx=0x7f5fe402d000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:22.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:22.914+0000 7f5ff4c00640 1 -- 172.21.15.144:0/905103196 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5fec019030 con 0x7f5fe0004120 2024-09-11T23:22:23.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.087+0000 7f5ffe200640 1 -- 172.21.15.144:0/905103196 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ff80b5fd0 con 0x7f5fe0004120 2024-09-11T23:22:23.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.088+0000 7f5ff4c00640 1 -- 172.21.15.144:0/905103196 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+13875 (secure 0 0 0) 0x7f5fec059dd0 con 0x7f5fe0004120 2024-09-11T23:22:23.088 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:23.088 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":75,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:22:21.717059+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6800/1711334146":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/3549728794":"2024-09-12T23:22:14.682014+0000","172.21.15.144:6837/97031260":"2024-09-12T23:22:18.559983+0000","172.21.15.144:0/2791324222":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/898052131":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/871393845":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/690044521":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/4035581026":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/2886766475":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/2268096760":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/246653411":"2024-09-12T23:22:14.682014+0000","172.21.15.144:6801/1711334146":"2024-09-12T23:22:14.682014+0000","172.21.15.144:0/651214814":"2024-09-12T23:22:14.682014+0000","172.21.15.144:6835/97031260":"2024-09-12T23:22:18.559983+0000","172.21.15.144:0/3284903152":"2024-09-12T23:22:14.682014+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:22:23.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.091+0000 7f5ffe200640 1 -- 172.21.15.144:0/905103196 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5fd806bf80 msgr2=0x7f5fd806e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:23.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.091+0000 7f5ffe200640 1 --2- 172.21.15.144:0/905103196 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5fd806bf80 0x7f5fd806e440 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4032000 tx=0x7f5fe402d000 comp rx=0 tx=0).stop 2024-09-11T23:22:23.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.091+0000 7f5ffe200640 1 -- 172.21.15.144:0/905103196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fe0004120 msgr2=0x7f5ff815d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:23.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.091+0000 7f5ffe200640 1 --2- 172.21.15.144:0/905103196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fe0004120 0x7f5ff815d860 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f5fec0119d0 tx=0x7f5fec011e90 comp rx=0 tx=0).stop 2024-09-11T23:22:23.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.091+0000 7f5ffe200640 1 -- 172.21.15.144:0/905103196 shutdown_connections 2024-09-11T23:22:23.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.091+0000 7f5ffe200640 1 --2- 172.21.15.144:0/905103196 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5fd806bf80 0x7f5fd806e440 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:23.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.091+0000 7f5ffe200640 1 --2- 172.21.15.144:0/905103196 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ff80cbde0 0x7f5ff80cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:23.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.091+0000 7f5ffe200640 1 --2- 172.21.15.144:0/905103196 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5ff81f3fb0 0x7f5ff8150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:23.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.091+0000 7f5ffe200640 1 --2- 172.21.15.144:0/905103196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5fe0004120 0x7f5ff815d860 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:23.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.091+0000 7f5ffe200640 1 -- 172.21.15.144:0/905103196 >> 172.21.15.144:0/905103196 conn(0x7f5ff80d0fd0 msgr2=0x7f5ff80d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:23.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.091+0000 7f5ffe200640 1 -- 172.21.15.144:0/905103196 shutdown_connections 2024-09-11T23:22:23.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.091+0000 7f5ffe200640 1 -- 172.21.15.144:0/905103196 wait complete. 2024-09-11T23:22:23.107 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:17:47.307937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:22:23.107 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:22:23.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.262+0000 7f7065200640 1 Processor -- start 2024-09-11T23:22:23.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.263+0000 7f7065200640 1 -- start start 2024-09-11T23:22:23.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.264+0000 7f7065200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f706015d790 0x7f70600cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:23.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.264+0000 7f7065200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f706006d700 con 0x7f70600cd3b0 2024-09-11T23:22:23.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.264+0000 7f7065200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70600cde80 con 0x7f706015d3b0 2024-09-11T23:22:23.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.264+0000 7f7065200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f706006da30 con 0x7f706015d790 2024-09-11T23:22:23.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.264+0000 7f705e800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f70600cd3b0 0x7f70600cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43654/0 (socket says 172.21.15.144:43654) 2024-09-11T23:22:23.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.264+0000 7f705e800640 1 -- 172.21.15.144:0/648364577 learned_addr learned my addr 172.21.15.144:0/648364577 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:23.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.264+0000 7f705d400640 1 --2- 172.21.15.144:0/648364577 >> v2:172.21.15.165:3300/0 conn(0x7f706015d790 0x7f70600cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:23.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.265+0000 7f705ca00640 1 -- 172.21.15.144:0/648364577 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1401225763 0 0) 0x7f706006d700 con 0x7f70600cd3b0 2024-09-11T23:22:23.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.265+0000 7f705ca00640 1 -- 172.21.15.144:0/648364577 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7044003520 con 0x7f70600cd3b0 2024-09-11T23:22:23.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.265+0000 7f705d400640 1 -- 172.21.15.144:0/648364577 >> v1:172.21.15.165:6789/0 conn(0x7f706015d3b0 legacy=0x7f7060071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:23.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.265+0000 7f705d400640 1 -- 172.21.15.144:0/648364577 >> v1:172.21.15.144:6789/0 conn(0x7f70600cd3b0 legacy=0x7f70600cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:23.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.265+0000 7f705d400640 1 -- 172.21.15.144:0/648364577 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70600cd8c0 con 0x7f706015d790 2024-09-11T23:22:23.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.266+0000 7f705d400640 1 --2- 172.21.15.144:0/648364577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f706015d790 0x7f70600cce70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f704c009790 tx=0x7f704c02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1bb2d0c882c24cb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:23.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.266+0000 7f705ca00640 1 -- 172.21.15.144:0/648364577 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c037070 con 0x7f706015d790 2024-09-11T23:22:23.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.266+0000 7f705ca00640 1 -- 172.21.15.144:0/648364577 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f704c032440 con 0x7f706015d790 2024-09-11T23:22:23.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.266+0000 7f705ca00640 1 -- 172.21.15.144:0/648364577 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c032810 con 0x7f706015d790 2024-09-11T23:22:23.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.267+0000 7f7065200640 1 -- 172.21.15.144:0/648364577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f706015d790 msgr2=0x7f70600cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:23.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.267+0000 7f7065200640 1 --2- 172.21.15.144:0/648364577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f706015d790 0x7f70600cce70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f704c009790 tx=0x7f704c02a210 comp rx=0 tx=0).stop 2024-09-11T23:22:23.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.267+0000 7f7065200640 1 -- 172.21.15.144:0/648364577 shutdown_connections 2024-09-11T23:22:23.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.267+0000 7f7065200640 1 --2- 172.21.15.144:0/648364577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f706015d790 0x7f70600cce70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:23.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.267+0000 7f7065200640 1 -- 172.21.15.144:0/648364577 >> 172.21.15.144:0/648364577 conn(0x7f706006bba0 msgr2=0x7f706006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:23.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.267+0000 7f7065200640 1 -- 172.21.15.144:0/648364577 shutdown_connections 2024-09-11T23:22:23.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.267+0000 7f7065200640 1 -- 172.21.15.144:0/648364577 wait complete. 2024-09-11T23:22:23.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.269+0000 7f7065200640 1 Processor -- start 2024-09-11T23:22:23.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.269+0000 7f7065200640 1 -- start start 2024-09-11T23:22:23.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.270+0000 7f7065200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70600cd3b0 0x7f70601e7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:23.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.270+0000 7f7065200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f706015d3b0 0x7f70600b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:23.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.270+0000 7f7065200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f70601f3ef0 0x7f70601e7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:23.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.270+0000 7f7065200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f706015cd70 con 0x7f70600cd3b0 2024-09-11T23:22:23.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.270+0000 7f7065200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f706015cbf0 con 0x7f70601f3ef0 2024-09-11T23:22:23.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.270+0000 7f7065200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f70600cfa30 con 0x7f706015d3b0 2024-09-11T23:22:23.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.270+0000 7f705de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70600cd3b0 0x7f70601e7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:23.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.270+0000 7f705de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70600cd3b0 0x7f70601e7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47328/0 (socket says 172.21.15.144:47328) 2024-09-11T23:22:23.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.270+0000 7f705de00640 1 -- 172.21.15.144:0/1749542427 learned_addr learned my addr 172.21.15.144:0/1749542427 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:23.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.270+0000 7f705d400640 1 --2- 172.21.15.144:0/1749542427 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f706015d3b0 0x7f70600b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:23.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.270+0000 7f705e800640 1 --2- 172.21.15.144:0/1749542427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f70601f3ef0 0x7f70601e7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:23.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.270+0000 7f705de00640 1 -- 172.21.15.144:0/1749542427 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f706015d3b0 msgr2=0x7f70600b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:23.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.270+0000 7f705de00640 1 --2- 172.21.15.144:0/1749542427 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f706015d3b0 0x7f70600b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:23.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.270+0000 7f705de00640 1 -- 172.21.15.144:0/1749542427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f70601f3ef0 msgr2=0x7f70601e7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:23.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.270+0000 7f705de00640 1 --2- 172.21.15.144:0/1749542427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f70601f3ef0 0x7f70601e7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:23.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.270+0000 7f705de00640 1 -- 172.21.15.144:0/1749542427 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70601f4370 con 0x7f70600cd3b0 2024-09-11T23:22:23.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.270+0000 7f705d400640 1 --2- 172.21.15.144:0/1749542427 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f706015d3b0 0x7f70600b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:23.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.271+0000 7f705de00640 1 --2- 172.21.15.144:0/1749542427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70600cd3b0 0x7f70601e7520 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f705000c870 tx=0x7f705000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:23.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.271+0000 7f7056000640 1 -- 172.21.15.144:0/1749542427 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7050003b70 con 0x7f70600cd3b0 2024-09-11T23:22:23.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.271+0000 7f7056000640 1 -- 172.21.15.144:0/1749542427 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7050003d30 con 0x7f70600cd3b0 2024-09-11T23:22:23.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.271+0000 7f7065200640 1 -- 172.21.15.144:0/1749542427 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70601f4650 con 0x7f70600cd3b0 2024-09-11T23:22:23.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.271+0000 7f7056000640 1 -- 172.21.15.144:0/1749542427 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705000aa90 con 0x7f70600cd3b0 2024-09-11T23:22:23.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.271+0000 7f7065200640 1 -- 172.21.15.144:0/1749542427 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70601f4c10 con 0x7f70600cd3b0 2024-09-11T23:22:23.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.272+0000 7f7065200640 1 -- 172.21.15.144:0/1749542427 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70601f4e50 con 0x7f70600cd3b0 2024-09-11T23:22:23.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.273+0000 7f7056000640 1 -- 172.21.15.144:0/1749542427 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f705000ac30 con 0x7f70600cd3b0 2024-09-11T23:22:23.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.274+0000 7f7056000640 1 --2- 172.21.15.144:0/1749542427 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f704006bf50 0x7f704006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:23.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.274+0000 7f7056000640 1 -- 172.21.15.144:0/1749542427 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5502+0+0 (secure 0 0 0) 0x7f705008af70 con 0x7f70600cd3b0 2024-09-11T23:22:23.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.274+0000 7f705d400640 1 --2- 172.21.15.144:0/1749542427 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f704006bf50 0x7f704006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:23.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.275+0000 7f705d400640 1 --2- 172.21.15.144:0/1749542427 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f704006bf50 0x7f704006e410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f704c034000 tx=0x7f704c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:23.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.278+0000 7f7056000640 1 -- 172.21.15.144:0/1749542427 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7050059840 con 0x7f70600cd3b0 2024-09-11T23:22:23.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.454+0000 7f7065200640 1 -- 172.21.15.144:0/1749542427 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f706006f060 con 0x7f70600cd3b0 2024-09-11T23:22:23.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.455+0000 7f7056000640 1 -- 172.21.15.144:0/1749542427 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f7050059140 con 0x7f70600cd3b0 2024-09-11T23:22:23.455 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-11T23:22:23.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.457+0000 7f7065200640 1 -- 172.21.15.144:0/1749542427 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f704006bf50 msgr2=0x7f704006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:23.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.457+0000 7f7065200640 1 --2- 172.21.15.144:0/1749542427 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f704006bf50 0x7f704006e410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f704c034000 tx=0x7f704c02e000 comp rx=0 tx=0).stop 2024-09-11T23:22:23.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.457+0000 7f7065200640 1 -- 172.21.15.144:0/1749542427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70600cd3b0 msgr2=0x7f70601e7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:23.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.457+0000 7f7065200640 1 --2- 172.21.15.144:0/1749542427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70600cd3b0 0x7f70601e7520 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f705000c870 tx=0x7f705000cd30 comp rx=0 tx=0).stop 2024-09-11T23:22:23.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.457+0000 7f7065200640 1 -- 172.21.15.144:0/1749542427 shutdown_connections 2024-09-11T23:22:23.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.457+0000 7f7065200640 1 --2- 172.21.15.144:0/1749542427 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f704006bf50 0x7f704006e410 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:23.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.457+0000 7f7065200640 1 --2- 172.21.15.144:0/1749542427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f70601f3ef0 0x7f70601e7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:23.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.457+0000 7f7065200640 1 --2- 172.21.15.144:0/1749542427 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f706015d3b0 0x7f70600b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:23.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.457+0000 7f7065200640 1 --2- 172.21.15.144:0/1749542427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70600cd3b0 0x7f70601e7520 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:23.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.457+0000 7f7065200640 1 -- 172.21.15.144:0/1749542427 >> 172.21.15.144:0/1749542427 conn(0x7f706006bba0 msgr2=0x7f70601567e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:23.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.457+0000 7f7065200640 1 -- 172.21.15.144:0/1749542427 shutdown_connections 2024-09-11T23:22:23.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.458+0000 7f7065200640 1 -- 172.21.15.144:0/1749542427 wait complete. 2024-09-11T23:22:23.473 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars' 2024-09-11T23:22:23.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.626+0000 7ff9f1400640 1 Processor -- start 2024-09-11T23:22:23.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.626+0000 7ff9f1400640 1 -- start start 2024-09-11T23:22:23.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.627+0000 7ff9f1400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9ec15e640 0x7ff9ec0d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:23.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.627+0000 7ff9f1400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff9ec0d3f60 0x7ff9ec0b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:23.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.627+0000 7ff9f1400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff9ec0b6510 0x7ff9ec0d27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:23.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.627+0000 7ff9f1400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff9ec15ea20 con 0x7ff9ec0d3f60 2024-09-11T23:22:23.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.627+0000 7ff9f1400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff9ec06caf0 con 0x7ff9ec0b6510 2024-09-11T23:22:23.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.627+0000 7ff9f1400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ec06bee0 con 0x7ff9ec15e640 2024-09-11T23:22:23.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.627+0000 7ff9eb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff9ec0d3f60 0x7ff9ec0b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:23.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.628+0000 7ff9eb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff9ec0d3f60 0x7ff9ec0b5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47336/0 (socket says 172.21.15.144:47336) 2024-09-11T23:22:23.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.628+0000 7ff9eb400640 1 -- 172.21.15.144:0/2186463607 learned_addr learned my addr 172.21.15.144:0/2186463607 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:23.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.628+0000 7ff9f0a00640 1 --2- 172.21.15.144:0/2186463607 >> v2:172.21.15.165:3300/0 conn(0x7ff9ec0b6510 0x7ff9ec0d27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:23.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.628+0000 7ff9ebe00640 1 --2- 172.21.15.144:0/2186463607 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9ec15e640 0x7ff9ec0d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:23.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.628+0000 7ff9eb400640 1 -- 172.21.15.144:0/2186463607 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9ec15e640 msgr2=0x7ff9ec0d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:23.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.628+0000 7ff9eb400640 1 --2- 172.21.15.144:0/2186463607 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9ec15e640 0x7ff9ec0d3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:23.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.628+0000 7ff9eb400640 1 -- 172.21.15.144:0/2186463607 >> v2:172.21.15.165:3300/0 conn(0x7ff9ec0b6510 msgr2=0x7ff9ec0d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:23.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.628+0000 7ff9eb400640 1 --2- 172.21.15.144:0/2186463607 >> v2:172.21.15.165:3300/0 conn(0x7ff9ec0b6510 0x7ff9ec0d27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:23.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.628+0000 7ff9eb400640 1 -- 172.21.15.144:0/2186463607 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ec06c1c0 con 0x7ff9ec0d3f60 2024-09-11T23:22:23.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.628+0000 7ff9ebe00640 1 --2- 172.21.15.144:0/2186463607 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9ec15e640 0x7ff9ec0d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:23.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.629+0000 7ff9eb400640 1 --2- 172.21.15.144:0/2186463607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9ec0d3f60 0x7ff9ec0b5fd0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec06e6c0 tx=0x7ff9d802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e168179b6c2edd26 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:23.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.629+0000 7ff9eaa00640 1 -- 172.21.15.144:0/2186463607 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8037070 con 0x7ff9ec0d3f60 2024-09-11T23:22:23.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.629+0000 7ff9eaa00640 1 -- 172.21.15.144:0/2186463607 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d8032440 con 0x7ff9ec0d3f60 2024-09-11T23:22:23.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.629+0000 7ff9eaa00640 1 -- 172.21.15.144:0/2186463607 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8032810 con 0x7ff9ec0d3f60 2024-09-11T23:22:23.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.630+0000 7ff9f1400640 1 -- 172.21.15.144:0/2186463607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9ec0d3f60 msgr2=0x7ff9ec0b5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:23.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.630+0000 7ff9f1400640 1 --2- 172.21.15.144:0/2186463607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9ec0d3f60 0x7ff9ec0b5fd0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec06e6c0 tx=0x7ff9d802a1e0 comp rx=0 tx=0).stop 2024-09-11T23:22:23.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.630+0000 7ff9f1400640 1 -- 172.21.15.144:0/2186463607 shutdown_connections 2024-09-11T23:22:23.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.630+0000 7ff9f1400640 1 --2- 172.21.15.144:0/2186463607 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9ec0d3f60 0x7ff9ec0b5fd0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:23.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.630+0000 7ff9f1400640 1 --2- 172.21.15.144:0/2186463607 >> v2:172.21.15.165:3300/0 conn(0x7ff9ec0b6510 0x7ff9ec0d27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:23.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.630+0000 7ff9f1400640 1 --2- 172.21.15.144:0/2186463607 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9ec15e640 0x7ff9ec0d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:23.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.630+0000 7ff9f1400640 1 -- 172.21.15.144:0/2186463607 >> 172.21.15.144:0/2186463607 conn(0x7ff9ec0d0fd0 msgr2=0x7ff9ec0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:23.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.630+0000 7ff9f1400640 1 -- 172.21.15.144:0/2186463607 shutdown_connections 2024-09-11T23:22:23.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.630+0000 7ff9f1400640 1 -- 172.21.15.144:0/2186463607 wait complete. 2024-09-11T23:22:23.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.631+0000 7ff9f1400640 1 Processor -- start 2024-09-11T23:22:23.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.632+0000 7ff9f1400640 1 -- start start 2024-09-11T23:22:23.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.632+0000 7ff9f1400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff9ec0b6510 0x7ff9ec157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:23.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.632+0000 7ff9f1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9ec0d3f60 0x7ff9ec0cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:23.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.633+0000 7ff9f1400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9ec15e640 0x7ff9ec0c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:23.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.633+0000 7ff9f1400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ec0d2d00 con 0x7ff9ec0d3f60 2024-09-11T23:22:23.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.633+0000 7ff9f1400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ec06c780 con 0x7ff9ec0b6510 2024-09-11T23:22:23.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.633+0000 7ff9f1400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ec0d2e80 con 0x7ff9ec15e640 2024-09-11T23:22:23.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.633+0000 7ff9eb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9ec0d3f60 0x7ff9ec0cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:23.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.633+0000 7ff9eb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9ec0d3f60 0x7ff9ec0cabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47348/0 (socket says 172.21.15.144:47348) 2024-09-11T23:22:23.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.633+0000 7ff9eb400640 1 -- 172.21.15.144:0/4082086548 learned_addr learned my addr 172.21.15.144:0/4082086548 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:23.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.633+0000 7ff9ebe00640 1 --2- 172.21.15.144:0/4082086548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff9ec0b6510 0x7ff9ec157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:23.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.633+0000 7ff9f0a00640 1 --2- 172.21.15.144:0/4082086548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9ec15e640 0x7ff9ec0c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:23.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.633+0000 7ff9eb400640 1 -- 172.21.15.144:0/4082086548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9ec15e640 msgr2=0x7ff9ec0c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:23.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.633+0000 7ff9eb400640 1 --2- 172.21.15.144:0/4082086548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9ec15e640 0x7ff9ec0c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:23.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.633+0000 7ff9eb400640 1 -- 172.21.15.144:0/4082086548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff9ec0b6510 msgr2=0x7ff9ec157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:23.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.633+0000 7ff9eb400640 1 --2- 172.21.15.144:0/4082086548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff9ec0b6510 0x7ff9ec157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:23.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.633+0000 7ff9eb400640 1 -- 172.21.15.144:0/4082086548 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ec0cb100 con 0x7ff9ec0d3f60 2024-09-11T23:22:23.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.633+0000 7ff9eb400640 1 --2- 172.21.15.144:0/4082086548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9ec0d3f60 0x7ff9ec0cabc0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff9d802a220 tx=0x7ff9d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:23.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.634+0000 7ff9e3e00640 1 -- 172.21.15.144:0/4082086548 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8037040 con 0x7ff9ec0d3f60 2024-09-11T23:22:23.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.634+0000 7ff9e3e00640 1 -- 172.21.15.144:0/4082086548 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d8042070 con 0x7ff9ec0d3f60 2024-09-11T23:22:23.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.634+0000 7ff9e3e00640 1 -- 172.21.15.144:0/4082086548 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8030880 con 0x7ff9ec0d3f60 2024-09-11T23:22:23.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.634+0000 7ff9f1400640 1 -- 172.21.15.144:0/4082086548 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ec0c9b20 con 0x7ff9ec0d3f60 2024-09-11T23:22:23.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.634+0000 7ff9f1400640 1 -- 172.21.15.144:0/4082086548 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9ec0ca0e0 con 0x7ff9ec0d3f60 2024-09-11T23:22:23.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.635+0000 7ff9f1400640 1 -- 172.21.15.144:0/4082086548 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9ec0d32b0 con 0x7ff9ec0d3f60 2024-09-11T23:22:23.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.636+0000 7ff9e3e00640 1 -- 172.21.15.144:0/4082086548 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7ff9d8030a20 con 0x7ff9ec0d3f60 2024-09-11T23:22:23.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.637+0000 7ff9e3e00640 1 --2- 172.21.15.144:0/4082086548 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff9cc06bf50 0x7ff9cc06e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:23.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.637+0000 7ff9e3e00640 1 -- 172.21.15.144:0/4082086548 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5502+0+0 (secure 0 0 0) 0x7ff9d80ab760 con 0x7ff9ec0d3f60 2024-09-11T23:22:23.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.637+0000 7ff9ebe00640 1 --2- 172.21.15.144:0/4082086548 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff9cc06bf50 0x7ff9cc06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:23.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.638+0000 7ff9ebe00640 1 --2- 172.21.15.144:0/4082086548 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff9cc06bf50 0x7ff9cc06e410 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc006fd0 tx=0x7ff9dc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:23.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.642+0000 7ff9e3e00640 1 -- 172.21.15.144:0/4082086548 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff9ec0cb100 con 0x7ff9ec0d3f60 2024-09-11T23:22:23.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:23.879+0000 7ff9f1400640 1 -- 172.21.15.144:0/4082086548 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]} v 0) -- 0x7ff9ec0b8330 con 0x7ff9ec0d3f60 2024-09-11T23:22:24.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.735+0000 7ff9e3e00640 1 -- 172.21.15.144:0/4082086548 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]}]=0 v243) ==== 149+0+0 (secure 0 0 0) 0x7ff9d807a0d0 con 0x7ff9ec0d3f60 2024-09-11T23:22:24.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.738+0000 7ff9f1400640 1 -- 172.21.15.144:0/4082086548 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff9cc06bf50 msgr2=0x7ff9cc06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:24.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.738+0000 7ff9f1400640 1 --2- 172.21.15.144:0/4082086548 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff9cc06bf50 0x7ff9cc06e410 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc006fd0 tx=0x7ff9dc008040 comp rx=0 tx=0).stop 2024-09-11T23:22:24.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.738+0000 7ff9f1400640 1 -- 172.21.15.144:0/4082086548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9ec0d3f60 msgr2=0x7ff9ec0cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:24.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.738+0000 7ff9f1400640 1 --2- 172.21.15.144:0/4082086548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9ec0d3f60 0x7ff9ec0cabc0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff9d802a220 tx=0x7ff9d80046c0 comp rx=0 tx=0).stop 2024-09-11T23:22:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.738+0000 7ff9f1400640 1 -- 172.21.15.144:0/4082086548 shutdown_connections 2024-09-11T23:22:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.738+0000 7ff9f1400640 1 --2- 172.21.15.144:0/4082086548 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff9cc06bf50 0x7ff9cc06e410 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.738+0000 7ff9f1400640 1 --2- 172.21.15.144:0/4082086548 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff9ec15e640 0x7ff9ec0c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.738+0000 7ff9f1400640 1 --2- 172.21.15.144:0/4082086548 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9ec0d3f60 0x7ff9ec0cabc0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.738+0000 7ff9f1400640 1 --2- 172.21.15.144:0/4082086548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff9ec0b6510 0x7ff9ec157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.738+0000 7ff9f1400640 1 -- 172.21.15.144:0/4082086548 >> 172.21.15.144:0/4082086548 conn(0x7ff9ec0d0fd0 msgr2=0x7ff9ec0b7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.738+0000 7ff9f1400640 1 -- 172.21.15.144:0/4082086548 shutdown_connections 2024-09-11T23:22:24.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.738+0000 7ff9f1400640 1 -- 172.21.15.144:0/4082086548 wait complete. 2024-09-11T23:22:24.756 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:22:24.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.917+0000 7f0e05c00640 1 Processor -- start 2024-09-11T23:22:24.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.917+0000 7f0e05c00640 1 -- start start 2024-09-11T23:22:24.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.918+0000 7f0e05c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0e0015d790 0x7f0e000cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:24.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.918+0000 7f0e05c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0e000cd3b0 0x7f0e000cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:24.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.918+0000 7f0e05c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e0006d700 con 0x7f0e0015d3b0 2024-09-11T23:22:24.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.918+0000 7f0e05c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0e0006da30 con 0x7f0e000cd3b0 2024-09-11T23:22:24.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.918+0000 7f0e05c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0e000cde80 con 0x7f0e0015d790 2024-09-11T23:22:24.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.919+0000 7f0dff400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0e000cd3b0 0x7f0e000cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:24.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.919+0000 7f0dff400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0e000cd3b0 0x7f0e000cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47204/0 (socket says 172.21.15.144:47204) 2024-09-11T23:22:24.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.919+0000 7f0dff400640 1 -- 172.21.15.144:0/3696472608 learned_addr learned my addr 172.21.15.144:0/3696472608 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:24.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.919+0000 7f0dfe000640 1 --2- 172.21.15.144:0/3696472608 >> v2:172.21.15.165:3300/0 conn(0x7f0e0015d790 0x7f0e000cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:24.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.919+0000 7f0dff400640 1 -- 172.21.15.144:0/3696472608 >> v2:172.21.15.165:3300/0 conn(0x7f0e0015d790 msgr2=0x7f0e000cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:24.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.919+0000 7f0dff400640 1 --2- 172.21.15.144:0/3696472608 >> v2:172.21.15.165:3300/0 conn(0x7f0e0015d790 0x7f0e000cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:24.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.919+0000 7f0dff400640 1 -- 172.21.15.144:0/3696472608 >> v1:172.21.15.165:6789/0 conn(0x7f0e0015d3b0 legacy=0x7f0e00071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:24.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.919+0000 7f0dff400640 1 -- 172.21.15.144:0/3696472608 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e000cd8c0 con 0x7f0e000cd3b0 2024-09-11T23:22:24.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.920+0000 7f0dff400640 1 --2- 172.21.15.144:0/3696472608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000cd3b0 0x7f0e000cf320 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0e0006dbb0 tx=0x7f0df802a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cff0b54c4879e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:24.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.920+0000 7f0dfd600640 1 -- 172.21.15.144:0/3696472608 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df8036070 con 0x7f0e000cd3b0 2024-09-11T23:22:24.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.920+0000 7f0dfd600640 1 -- 172.21.15.144:0/3696472608 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df8031600 con 0x7f0e000cd3b0 2024-09-11T23:22:24.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.920+0000 7f0dfd600640 1 -- 172.21.15.144:0/3696472608 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df80319d0 con 0x7f0e000cd3b0 2024-09-11T23:22:24.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.921+0000 7f0e05c00640 1 -- 172.21.15.144:0/3696472608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000cd3b0 msgr2=0x7f0e000cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:24.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.921+0000 7f0e05c00640 1 --2- 172.21.15.144:0/3696472608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000cd3b0 0x7f0e000cf320 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0e0006dbb0 tx=0x7f0df802a6d0 comp rx=0 tx=0).stop 2024-09-11T23:22:24.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.921+0000 7f0e05c00640 1 -- 172.21.15.144:0/3696472608 shutdown_connections 2024-09-11T23:22:24.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.921+0000 7f0e05c00640 1 --2- 172.21.15.144:0/3696472608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000cd3b0 0x7f0e000cf320 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:24.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.921+0000 7f0e05c00640 1 --2- 172.21.15.144:0/3696472608 >> v2:172.21.15.165:3300/0 conn(0x7f0e0015d790 0x7f0e000cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:24.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.921+0000 7f0e05c00640 1 -- 172.21.15.144:0/3696472608 >> 172.21.15.144:0/3696472608 conn(0x7f0e0006bba0 msgr2=0x7f0e0006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:24.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.921+0000 7f0e05c00640 1 -- 172.21.15.144:0/3696472608 shutdown_connections 2024-09-11T23:22:24.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.921+0000 7f0e05c00640 1 -- 172.21.15.144:0/3696472608 wait complete. 2024-09-11T23:22:24.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.923+0000 7f0e05c00640 1 Processor -- start 2024-09-11T23:22:24.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.923+0000 7f0e05c00640 1 -- start start 2024-09-11T23:22:24.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.923+0000 7f0e05c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000cd3b0 0x7f0e001544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:24.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.923+0000 7f0e05c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e0015d3b0 0x7f0e000aa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:24.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.923+0000 7f0e05c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e000aaef0 0x7f0e000ab3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:24.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.923+0000 7f0e05c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0015cd70 con 0x7f0e000cd3b0 2024-09-11T23:22:24.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.923+0000 7f0e05c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0015cbf0 con 0x7f0e0015d3b0 2024-09-11T23:22:24.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.923+0000 7f0e05c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0e000cf860 con 0x7f0e000aaef0 2024-09-11T23:22:24.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.924+0000 7f0dfea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000cd3b0 0x7f0e001544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:24.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.924+0000 7f0dfea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000cd3b0 0x7f0e001544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47216/0 (socket says 172.21.15.144:47216) 2024-09-11T23:22:24.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.924+0000 7f0dfea00640 1 -- 172.21.15.144:0/4001341009 learned_addr learned my addr 172.21.15.144:0/4001341009 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:24.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.924+0000 7f0dfe000640 1 --2- 172.21.15.144:0/4001341009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e0015d3b0 0x7f0e000aa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:24.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.924+0000 7f0dff400640 1 --2- 172.21.15.144:0/4001341009 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e000aaef0 0x7f0e000ab3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:24.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.924+0000 7f0dfea00640 1 -- 172.21.15.144:0/4001341009 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e000aaef0 msgr2=0x7f0e000ab3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:24.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.924+0000 7f0dfea00640 1 --2- 172.21.15.144:0/4001341009 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e000aaef0 0x7f0e000ab3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:24.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.924+0000 7f0dfea00640 1 -- 172.21.15.144:0/4001341009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e0015d3b0 msgr2=0x7f0e000aa9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:24.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.924+0000 7f0dfea00640 1 --2- 172.21.15.144:0/4001341009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e0015d3b0 0x7f0e000aa9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:24.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.924+0000 7f0dfea00640 1 -- 172.21.15.144:0/4001341009 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e000aa4d0 con 0x7f0e000cd3b0 2024-09-11T23:22:24.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.925+0000 7f0dfea00640 1 --2- 172.21.15.144:0/4001341009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000cd3b0 0x7f0e001544f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f0df000c430 tx=0x7f0df000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:24.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.925+0000 7f0df6a00640 1 -- 172.21.15.144:0/4001341009 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df0011790 con 0x7f0e000cd3b0 2024-09-11T23:22:24.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.925+0000 7f0df6a00640 1 -- 172.21.15.144:0/4001341009 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df0017070 con 0x7f0e000cd3b0 2024-09-11T23:22:24.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.925+0000 7f0e05c00640 1 -- 172.21.15.144:0/4001341009 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e00154ad0 con 0x7f0e000cd3b0 2024-09-11T23:22:24.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.925+0000 7f0df6a00640 1 -- 172.21.15.144:0/4001341009 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df0011bb0 con 0x7f0e000cd3b0 2024-09-11T23:22:24.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.925+0000 7f0e05c00640 1 -- 172.21.15.144:0/4001341009 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e00155370 con 0x7f0e000cd3b0 2024-09-11T23:22:24.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.926+0000 7f0e05c00640 1 -- 172.21.15.144:0/4001341009 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e000cfc50 con 0x7f0e000cd3b0 2024-09-11T23:22:24.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.927+0000 7f0df6a00640 1 -- 172.21.15.144:0/4001341009 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f0df001c460 con 0x7f0e000cd3b0 2024-09-11T23:22:24.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.928+0000 7f0df6a00640 1 --2- 172.21.15.144:0/4001341009 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0de006bf50 0x7f0de006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:24.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.928+0000 7f0df6a00640 1 -- 172.21.15.144:0/4001341009 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5502+0+0 (secure 0 0 0) 0x7f0df008ad40 con 0x7f0e000cd3b0 2024-09-11T23:22:24.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.928+0000 7f0dfe000640 1 --2- 172.21.15.144:0/4001341009 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0de006bf50 0x7f0de006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:24.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.929+0000 7f0dfe000640 1 --2- 172.21.15.144:0/4001341009 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0de006bf50 0x7f0de006e410 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0e000695e0 tx=0x7f0dec008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:24.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:24.932+0000 7f0df6a00640 1 -- 172.21.15.144:0/4001341009 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0df0058fc0 con 0x7f0e000cd3b0 2024-09-11T23:22:25.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.105+0000 7f0e05c00640 1 -- 172.21.15.144:0/4001341009 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0e000aa6a0 con 0x7f0e000cd3b0 2024-09-11T23:22:25.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.109+0000 7f0df6a00640 1 -- 172.21.15.144:0/4001341009 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f0df005d2c0 con 0x7f0e000cd3b0 2024-09-11T23:22:25.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.111+0000 7f0e05c00640 1 -- 172.21.15.144:0/4001341009 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0de006bf50 msgr2=0x7f0de006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:25.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.111+0000 7f0e05c00640 1 --2- 172.21.15.144:0/4001341009 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0de006bf50 0x7f0de006e410 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0e000695e0 tx=0x7f0dec008040 comp rx=0 tx=0).stop 2024-09-11T23:22:25.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.111+0000 7f0e05c00640 1 -- 172.21.15.144:0/4001341009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000cd3b0 msgr2=0x7f0e001544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:25.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.111+0000 7f0e05c00640 1 --2- 172.21.15.144:0/4001341009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000cd3b0 0x7f0e001544f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f0df000c430 tx=0x7f0df000c8f0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.111+0000 7f0e05c00640 1 -- 172.21.15.144:0/4001341009 shutdown_connections 2024-09-11T23:22:25.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.111+0000 7f0e05c00640 1 --2- 172.21.15.144:0/4001341009 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0de006bf50 0x7f0de006e410 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.111+0000 7f0e05c00640 1 --2- 172.21.15.144:0/4001341009 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0e000aaef0 0x7f0e000ab3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.111+0000 7f0e05c00640 1 --2- 172.21.15.144:0/4001341009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0e0015d3b0 0x7f0e000aa9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.111+0000 7f0e05c00640 1 --2- 172.21.15.144:0/4001341009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0e000cd3b0 0x7f0e001544f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.111+0000 7f0e05c00640 1 -- 172.21.15.144:0/4001341009 >> 172.21.15.144:0/4001341009 conn(0x7f0e0006bba0 msgr2=0x7f0e0015f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:25.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.111+0000 7f0e05c00640 1 -- 172.21.15.144:0/4001341009 shutdown_connections 2024-09-11T23:22:25.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.111+0000 7f0e05c00640 1 -- 172.21.15.144:0/4001341009 wait complete. 2024-09-11T23:22:25.127 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:22:25.127 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:22:25.222 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:22:25.326 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:22:25.326 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:22:25.327 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:25.362 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:22:25.363 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:22:25.363 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:25.399 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:22:25.400 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:22:25.400 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:25.439 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:22:25.439 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:22:25.439 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:25.476 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:22:25.476 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T23:22:25.477 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:22:25.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.635+0000 7f2d11600640 1 Processor -- start 2024-09-11T23:22:25.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.635+0000 7f2d11600640 1 -- start start 2024-09-11T23:22:25.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.636+0000 7f2d11600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2d0c15c180 0x7f2d0c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:25.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.636+0000 7f2d11600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2d0c0ce230 0x7f2d0c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:25.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.636+0000 7f2d11600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2d0c0cf5b0 0x7f2d0c073120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:25.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.636+0000 7f2d11600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2d0c0ce740 con 0x7f2d0c0cf5b0 2024-09-11T23:22:25.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.636+0000 7f2d11600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2d0c072640 con 0x7f2d0c0ce230 2024-09-11T23:22:25.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.636+0000 7f2d11600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2d0c072920 con 0x7f2d0c15c180 2024-09-11T23:22:25.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.637+0000 7f2d0b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2d0c0cf5b0 0x7f2d0c073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:25.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.637+0000 7f2d0b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2d0c0cf5b0 0x7f2d0c073120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47226/0 (socket says 172.21.15.144:47226) 2024-09-11T23:22:25.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.637+0000 7f2d0b400640 1 -- 172.21.15.144:0/2410521810 learned_addr learned my addr 172.21.15.144:0/2410521810 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:25.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.637+0000 7f2d0aa00640 1 --2- 172.21.15.144:0/2410521810 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2d0c15c180 0x7f2d0c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:25.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.637+0000 7f2d0a000640 1 --2- 172.21.15.144:0/2410521810 >> v2:172.21.15.165:3300/0 conn(0x7f2d0c0ce230 0x7f2d0c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:25.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.637+0000 7f2d0b400640 1 -- 172.21.15.144:0/2410521810 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2d0c15c180 msgr2=0x7f2d0c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:25.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.637+0000 7f2d0b400640 1 --2- 172.21.15.144:0/2410521810 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2d0c15c180 0x7f2d0c0cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.637+0000 7f2d0b400640 1 -- 172.21.15.144:0/2410521810 >> v2:172.21.15.165:3300/0 conn(0x7f2d0c0ce230 msgr2=0x7f2d0c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:25.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.637+0000 7f2d0b400640 1 --2- 172.21.15.144:0/2410521810 >> v2:172.21.15.165:3300/0 conn(0x7f2d0c0ce230 0x7f2d0c0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.637+0000 7f2d0b400640 1 -- 172.21.15.144:0/2410521810 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0c072c00 con 0x7f2d0c0cf5b0 2024-09-11T23:22:25.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.638+0000 7f2d0b400640 1 --2- 172.21.15.144:0/2410521810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d0c0cf5b0 0x7f2d0c073120 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0b5940 tx=0x7f2d0402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a80171055549 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:25.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.638+0000 7f2d09600640 1 -- 172.21.15.144:0/2410521810 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04036070 con 0x7f2d0c0cf5b0 2024-09-11T23:22:25.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.638+0000 7f2d09600640 1 -- 172.21.15.144:0/2410521810 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d04031600 con 0x7f2d0c0cf5b0 2024-09-11T23:22:25.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.638+0000 7f2d09600640 1 -- 172.21.15.144:0/2410521810 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d040319d0 con 0x7f2d0c0cf5b0 2024-09-11T23:22:25.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.639+0000 7f2d11600640 1 -- 172.21.15.144:0/2410521810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d0c0cf5b0 msgr2=0x7f2d0c073120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:25.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.639+0000 7f2d11600640 1 --2- 172.21.15.144:0/2410521810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d0c0cf5b0 0x7f2d0c073120 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0b5940 tx=0x7f2d0402a610 comp rx=0 tx=0).stop 2024-09-11T23:22:25.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.639+0000 7f2d11600640 1 -- 172.21.15.144:0/2410521810 shutdown_connections 2024-09-11T23:22:25.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.639+0000 7f2d11600640 1 --2- 172.21.15.144:0/2410521810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d0c0cf5b0 0x7f2d0c073120 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.639+0000 7f2d11600640 1 --2- 172.21.15.144:0/2410521810 >> v2:172.21.15.165:3300/0 conn(0x7f2d0c0ce230 0x7f2d0c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.639+0000 7f2d11600640 1 --2- 172.21.15.144:0/2410521810 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2d0c15c180 0x7f2d0c0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.639+0000 7f2d11600640 1 -- 172.21.15.144:0/2410521810 >> 172.21.15.144:0/2410521810 conn(0x7f2d0c062cc0 msgr2=0x7f2d0c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:25.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.639+0000 7f2d11600640 1 -- 172.21.15.144:0/2410521810 shutdown_connections 2024-09-11T23:22:25.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.639+0000 7f2d11600640 1 -- 172.21.15.144:0/2410521810 wait complete. 2024-09-11T23:22:25.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.641+0000 7f2d11600640 1 Processor -- start 2024-09-11T23:22:25.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.641+0000 7f2d11600640 1 -- start start 2024-09-11T23:22:25.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.642+0000 7f2d11600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2d0c0ce230 0x7f2d0c14b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:25.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.642+0000 7f2d11600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d0c0cf5b0 0x7f2d0c0b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:25.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.642+0000 7f2d11600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d0c15c180 0x7f2d0c14fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:25.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.642+0000 7f2d11600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c15c560 con 0x7f2d0c15c180 2024-09-11T23:22:25.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.642+0000 7f2d11600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c0722f0 con 0x7f2d0c0cf5b0 2024-09-11T23:22:25.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.642+0000 7f2d11600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2d0c15c6e0 con 0x7f2d0c0ce230 2024-09-11T23:22:25.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.642+0000 7f2d0b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d0c15c180 0x7f2d0c14fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:25.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.642+0000 7f2d0b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d0c15c180 0x7f2d0c14fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47234/0 (socket says 172.21.15.144:47234) 2024-09-11T23:22:25.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.642+0000 7f2d0b400640 1 -- 172.21.15.144:0/3465968628 learned_addr learned my addr 172.21.15.144:0/3465968628 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:25.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.642+0000 7f2d0aa00640 1 --2- 172.21.15.144:0/3465968628 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2d0c0ce230 0x7f2d0c14b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:25.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.642+0000 7f2d0a000640 1 --2- 172.21.15.144:0/3465968628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d0c0cf5b0 0x7f2d0c0b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:25.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.642+0000 7f2d0b400640 1 -- 172.21.15.144:0/3465968628 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2d0c0ce230 msgr2=0x7f2d0c14b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:25.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.642+0000 7f2d0b400640 1 --2- 172.21.15.144:0/3465968628 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2d0c0ce230 0x7f2d0c14b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.642+0000 7f2d0b400640 1 -- 172.21.15.144:0/3465968628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d0c0cf5b0 msgr2=0x7f2d0c0b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:25.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.642+0000 7f2d0b400640 1 --2- 172.21.15.144:0/3465968628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d0c0cf5b0 0x7f2d0c0b0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.642+0000 7f2d0b400640 1 -- 172.21.15.144:0/3465968628 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0c14f630 con 0x7f2d0c15c180 2024-09-11T23:22:25.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.643+0000 7f2d0b400640 1 --2- 172.21.15.144:0/3465968628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d0c15c180 0x7f2d0c14fae0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f2d04009f40 tx=0x7f2d04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:25.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.643+0000 7f2d02a00640 1 -- 172.21.15.144:0/3465968628 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04036050 con 0x7f2d0c15c180 2024-09-11T23:22:25.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.643+0000 7f2d02a00640 1 -- 172.21.15.144:0/3465968628 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d04042070 con 0x7f2d0c15c180 2024-09-11T23:22:25.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.643+0000 7f2d11600640 1 -- 172.21.15.144:0/3465968628 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d0c14bbe0 con 0x7f2d0c15c180 2024-09-11T23:22:25.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.643+0000 7f2d02a00640 1 -- 172.21.15.144:0/3465968628 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04009510 con 0x7f2d0c15c180 2024-09-11T23:22:25.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.643+0000 7f2d11600640 1 -- 172.21.15.144:0/3465968628 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d0c0b0670 con 0x7f2d0c15c180 2024-09-11T23:22:25.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.644+0000 7f2d11600640 1 -- 172.21.15.144:0/3465968628 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d0c0d0cf0 con 0x7f2d0c15c180 2024-09-11T23:22:25.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.645+0000 7f2d02a00640 1 -- 172.21.15.144:0/3465968628 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f2d04007bf0 con 0x7f2d0c15c180 2024-09-11T23:22:25.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.646+0000 7f2d02a00640 1 --2- 172.21.15.144:0/3465968628 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2cec06bf50 0x7f2cec06e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:25.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.646+0000 7f2d02a00640 1 -- 172.21.15.144:0/3465968628 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5502+0+0 (secure 0 0 0) 0x7f2d040abcb0 con 0x7f2d0c15c180 2024-09-11T23:22:25.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.646+0000 7f2d0aa00640 1 --2- 172.21.15.144:0/3465968628 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2cec06bf50 0x7f2cec06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:25.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.647+0000 7f2d0aa00640 1 --2- 172.21.15.144:0/3465968628 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2cec06bf50 0x7f2cec06e410 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c14b5b0 tx=0x7f2cfc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:25.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.650+0000 7f2d02a00640 1 -- 172.21.15.144:0/3465968628 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2d0c0d0cf0 con 0x7f2d0c15c180 2024-09-11T23:22:25.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.857+0000 7f2d11600640 1 -- 172.21.15.144:0/3465968628 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d0c0cf070 con 0x7f2d0c15c180 2024-09-11T23:22:25.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.858+0000 7f2d02a00640 1 -- 172.21.15.144:0/3465968628 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+3917 (secure 0 0 0) 0x7f2d04079e20 con 0x7f2d0c15c180 2024-09-11T23:22:25.857 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:25.858 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":49,"btime":"2024-09-11T23:22:19:562299+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5417,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/494282276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":494282276},{"type":"v1","addr":"172.21.15.165:6833","nonce":494282276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5827,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1734890696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":1734890696},{"type":"v1","addr":"172.21.15.165:6835","nonce":1734890696}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6090,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6836/1671926294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1671926294},{"type":"v1","addr":"172.21.15.144:6836","nonce":1671926294}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6444,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/598249997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":598249997},{"type":"v1","addr":"172.21.15.144:6801","nonce":598249997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[]} 2024-09-11T23:22:25.858 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 49 2024-09-11T23:22:25.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.860+0000 7f2d11600640 1 -- 172.21.15.144:0/3465968628 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2cec06bf50 msgr2=0x7f2cec06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:25.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.860+0000 7f2d11600640 1 --2- 172.21.15.144:0/3465968628 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2cec06bf50 0x7f2cec06e410 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c14b5b0 tx=0x7f2cfc009190 comp rx=0 tx=0).stop 2024-09-11T23:22:25.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.860+0000 7f2d11600640 1 -- 172.21.15.144:0/3465968628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d0c15c180 msgr2=0x7f2d0c14fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:25.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.860+0000 7f2d11600640 1 --2- 172.21.15.144:0/3465968628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d0c15c180 0x7f2d0c14fae0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f2d04009f40 tx=0x7f2d04004a40 comp rx=0 tx=0).stop 2024-09-11T23:22:25.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.860+0000 7f2d11600640 1 -- 172.21.15.144:0/3465968628 shutdown_connections 2024-09-11T23:22:25.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.860+0000 7f2d11600640 1 --2- 172.21.15.144:0/3465968628 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2cec06bf50 0x7f2cec06e410 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.860+0000 7f2d11600640 1 --2- 172.21.15.144:0/3465968628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d0c15c180 0x7f2d0c14fae0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.860+0000 7f2d11600640 1 --2- 172.21.15.144:0/3465968628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d0c0cf5b0 0x7f2d0c0b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.860+0000 7f2d11600640 1 --2- 172.21.15.144:0/3465968628 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2d0c0ce230 0x7f2d0c14b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:25.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.860+0000 7f2d11600640 1 -- 172.21.15.144:0/3465968628 >> 172.21.15.144:0/3465968628 conn(0x7f2d0c062cc0 msgr2=0x7f2d0c15ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:25.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.860+0000 7f2d11600640 1 -- 172.21.15.144:0/3465968628 shutdown_connections 2024-09-11T23:22:25.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:25.860+0000 7f2d11600640 1 -- 172.21.15.144:0/3465968628 wait complete. 2024-09-11T23:22:25.876 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:22:25.877 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:22:25.877 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:22:25.877 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:22:25.877 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:22:25.877 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T23:22:25.877 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:22:25.877 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:22:25.878 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:22:25.878 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:22:25.878 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:22:25.878 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:22:25.878 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:22:25.878 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T23:22:25.878 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:22:25.878 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:22:25.890 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:22:25.890 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:22:25.894 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:22:25.894 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:22:25.895 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:22:25.895 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:22:25.896 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:22:25.896 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:22:25.938 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:22:25.939 DEBUG:teuthology.parallel:result is None 2024-09-11T23:22:25.939 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:22:25.939 DEBUG:teuthology.parallel:result is None 2024-09-11T23:22:25.941 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:22:25.941 DEBUG:teuthology.parallel:result is None 2024-09-11T23:22:25.942 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:22:25.942 DEBUG:teuthology.parallel:result is None 2024-09-11T23:22:25.942 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:22:26.069 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-11T23:22:26.069 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-11T23:22:26.069 INFO:tasks.ceph.mds.a.smithi144.stderr:2024-09-11T23:22:26.069+0000 7fe5ea200640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-09-11T23:22:26.070 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-11T23:22:26.070 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-11T23:22:26.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.105+0000 7fa02f200640 1 Processor -- start 2024-09-11T23:22:26.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.105+0000 7fa02f200640 1 -- start start 2024-09-11T23:22:26.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.106+0000 7fa02f200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa0300b5fd0 0x7fa0300b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:26.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.106+0000 7fa02f200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa0300b7750 0x7fa0300b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:26.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.106+0000 7fa02f200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa03006bee0 con 0x7fa03015e640 2024-09-11T23:22:26.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.106+0000 7fa02f200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa03015ea20 con 0x7fa0300b5fd0 2024-09-11T23:22:26.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.106+0000 7fa02f200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa03006caf0 con 0x7fa0300b7750 2024-09-11T23:22:26.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.106+0000 7fa02d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa0300b5fd0 0x7fa0300b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:26.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.106+0000 7fa02d400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa0300b5fd0 0x7fa0300b6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47292/0 (socket says 172.21.15.144:47292) 2024-09-11T23:22:26.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.106+0000 7fa02d400640 1 -- 172.21.15.144:0/37549993 learned_addr learned my addr 172.21.15.144:0/37549993 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:26.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.106+0000 7fa02e800640 1 --2- 172.21.15.144:0/37549993 >> v2:172.21.15.165:3300/0 conn(0x7fa0300b7750 0x7fa0300b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:26.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.107+0000 7fa02d400640 1 -- 172.21.15.144:0/37549993 >> v2:172.21.15.165:3300/0 conn(0x7fa0300b7750 msgr2=0x7fa0300b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:26.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.107+0000 7fa02d400640 1 --2- 172.21.15.144:0/37549993 >> v2:172.21.15.165:3300/0 conn(0x7fa0300b7750 0x7fa0300b7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:26.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.107+0000 7fa02d400640 1 -- 172.21.15.144:0/37549993 >> v1:172.21.15.165:6789/0 conn(0x7fa03015e640 legacy=0x7fa0300d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:26.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.107+0000 7fa02d400640 1 -- 172.21.15.144:0/37549993 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa03006c1c0 con 0x7fa0300b5fd0 2024-09-11T23:22:26.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.107+0000 7fa02e800640 1 --2- 172.21.15.144:0/37549993 >> v2:172.21.15.165:3300/0 conn(0x7fa0300b7750 0x7fa0300b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:22:26.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.108+0000 7fa02d400640 1 --2- 172.21.15.144:0/37549993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0300b5fd0 0x7fa0300b6410 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa03008d350 tx=0x7fa01c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b15c5e4f8c8f04 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:26.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.108+0000 7fa02ca00640 1 -- 172.21.15.144:0/37549993 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01c037070 con 0x7fa0300b5fd0 2024-09-11T23:22:26.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.108+0000 7fa02ca00640 1 -- 172.21.15.144:0/37549993 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa01c032440 con 0x7fa0300b5fd0 2024-09-11T23:22:26.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.108+0000 7fa02ca00640 1 -- 172.21.15.144:0/37549993 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01c032810 con 0x7fa0300b5fd0 2024-09-11T23:22:26.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.109+0000 7fa02f200640 1 -- 172.21.15.144:0/37549993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0300b5fd0 msgr2=0x7fa0300b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:26.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.109+0000 7fa02f200640 1 --2- 172.21.15.144:0/37549993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0300b5fd0 0x7fa0300b6410 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fa03008d350 tx=0x7fa01c02a270 comp rx=0 tx=0).stop 2024-09-11T23:22:26.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.109+0000 7fa02f200640 1 -- 172.21.15.144:0/37549993 shutdown_connections 2024-09-11T23:22:26.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.109+0000 7fa02f200640 1 --2- 172.21.15.144:0/37549993 >> v2:172.21.15.165:3300/0 conn(0x7fa0300b7750 0x7fa0300b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:26.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.109+0000 7fa02f200640 1 --2- 172.21.15.144:0/37549993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0300b5fd0 0x7fa0300b6410 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:26.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.109+0000 7fa02f200640 1 -- 172.21.15.144:0/37549993 >> 172.21.15.144:0/37549993 conn(0x7fa0300d0fd0 msgr2=0x7fa0300d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:26.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.109+0000 7fa02f200640 1 -- 172.21.15.144:0/37549993 shutdown_connections 2024-09-11T23:22:26.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.109+0000 7fa02f200640 1 -- 172.21.15.144:0/37549993 wait complete. 2024-09-11T23:22:26.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.111+0000 7fa02f200640 1 Processor -- start 2024-09-11T23:22:26.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.111+0000 7fa02f200640 1 -- start start 2024-09-11T23:22:26.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.112+0000 7fa02f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0300b5fd0 0x7fa0300cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:26.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.112+0000 7fa02f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0300b7750 0x7fa0301f74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:26.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.112+0000 7fa02f200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa03015e640 0x7fa0301f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:26.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.112+0000 7fa02f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa03006c780 con 0x7fa0300b7750 2024-09-11T23:22:26.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.112+0000 7fa02f200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa0300b6950 con 0x7fa03015e640 2024-09-11T23:22:26.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.112+0000 7fa02f200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa0300d4130 con 0x7fa0300b5fd0 2024-09-11T23:22:26.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.112+0000 7fa02d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0300b7750 0x7fa0301f74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:26.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.112+0000 7fa02d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0300b7750 0x7fa0301f74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47308/0 (socket says 172.21.15.144:47308) 2024-09-11T23:22:26.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.112+0000 7fa02d400640 1 -- 172.21.15.144:0/6728115 learned_addr learned my addr 172.21.15.144:0/6728115 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:26.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.112+0000 7fa02d400640 1 -- 172.21.15.144:0/6728115 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0300b5fd0 msgr2=0x7fa0300cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:26.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.112+0000 7fa02d400640 1 --2- 172.21.15.144:0/6728115 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0300b5fd0 0x7fa0300cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:26.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.112+0000 7fa02d400640 1 -- 172.21.15.144:0/6728115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa03015e640 msgr2=0x7fa0301f4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:26.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.112+0000 7fa02d400640 1 --2- 172.21.15.144:0/6728115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa03015e640 0x7fa0301f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:26.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.112+0000 7fa02d400640 1 -- 172.21.15.144:0/6728115 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0301f7bd0 con 0x7fa0300b7750 2024-09-11T23:22:26.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.113+0000 7fa02d400640 1 --2- 172.21.15.144:0/6728115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0300b7750 0x7fa0301f74d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa01c02a2b0 tx=0x7fa01c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:26.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.113+0000 7fa026000640 1 -- 172.21.15.144:0/6728115 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01c037040 con 0x7fa0300b7750 2024-09-11T23:22:26.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.113+0000 7fa026000640 1 -- 172.21.15.144:0/6728115 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa01c042070 con 0x7fa0300b7750 2024-09-11T23:22:26.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.113+0000 7fa026000640 1 -- 172.21.15.144:0/6728115 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01c03b870 con 0x7fa0300b7750 2024-09-11T23:22:26.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.113+0000 7fa02f200640 1 -- 172.21.15.144:0/6728115 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0301f7eb0 con 0x7fa0300b7750 2024-09-11T23:22:26.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.113+0000 7fa02f200640 1 -- 172.21.15.144:0/6728115 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa030155cb0 con 0x7fa0300b7750 2024-09-11T23:22:26.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.114+0000 7fa02f200640 1 -- 172.21.15.144:0/6728115 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0300b6410 con 0x7fa0300b7750 2024-09-11T23:22:26.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.115+0000 7fa026000640 1 -- 172.21.15.144:0/6728115 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fa01c03ba10 con 0x7fa0300b7750 2024-09-11T23:22:26.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.116+0000 7fa026000640 1 --2- 172.21.15.144:0/6728115 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa01006bf50 0x7fa01006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:26.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.116+0000 7fa026000640 1 -- 172.21.15.144:0/6728115 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5502+0+0 (secure 0 0 0) 0x7fa01c0ab700 con 0x7fa0300b7750 2024-09-11T23:22:26.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.116+0000 7fa02de00640 1 --2- 172.21.15.144:0/6728115 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa01006bf50 0x7fa01006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:26.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.117+0000 7fa02de00640 1 --2- 172.21.15.144:0/6728115 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa01006bf50 0x7fa01006e410 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa020000f60 tx=0x7fa0200079d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:26.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.120+0000 7fa026000640 1 -- 172.21.15.144:0/6728115 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa01c07a070 con 0x7fa0300b7750 2024-09-11T23:22:26.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.304+0000 7fa02f200640 1 -- 172.21.15.144:0/6728115 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa0300b5950 con 0x7fa0300b7750 2024-09-11T23:22:26.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.754+0000 7fa026000640 1 -- 172.21.15.144:0/6728115 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v77) ==== 97+0+0 (secure 0 0 0) 0x7fa01c079970 con 0x7fa0300b7750 2024-09-11T23:22:26.754 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-11T23:22:26.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.757+0000 7fa02f200640 1 -- 172.21.15.144:0/6728115 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa01006bf50 msgr2=0x7fa01006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:26.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.757+0000 7fa02f200640 1 --2- 172.21.15.144:0/6728115 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa01006bf50 0x7fa01006e410 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa020000f60 tx=0x7fa0200079d0 comp rx=0 tx=0).stop 2024-09-11T23:22:26.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.757+0000 7fa02f200640 1 -- 172.21.15.144:0/6728115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0300b7750 msgr2=0x7fa0301f74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.757+0000 7fa02f200640 1 --2- 172.21.15.144:0/6728115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0300b7750 0x7fa0301f74d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa01c02a2b0 tx=0x7fa01c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:22:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.757+0000 7fa02f200640 1 -- 172.21.15.144:0/6728115 shutdown_connections 2024-09-11T23:22:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.757+0000 7fa02f200640 1 --2- 172.21.15.144:0/6728115 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa01006bf50 0x7fa01006e410 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.757+0000 7fa02f200640 1 --2- 172.21.15.144:0/6728115 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa03015e640 0x7fa0301f4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.757+0000 7fa02f200640 1 --2- 172.21.15.144:0/6728115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0300b7750 0x7fa0301f74d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.757+0000 7fa02f200640 1 --2- 172.21.15.144:0/6728115 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0300b5fd0 0x7fa0300cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.757+0000 7fa02f200640 1 -- 172.21.15.144:0/6728115 >> 172.21.15.144:0/6728115 conn(0x7fa0300d0fd0 msgr2=0x7fa0300cae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.757+0000 7fa02f200640 1 -- 172.21.15.144:0/6728115 shutdown_connections 2024-09-11T23:22:26.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.757+0000 7fa02f200640 1 -- 172.21.15.144:0/6728115 wait complete. 2024-09-11T23:22:26.774 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:22:26.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.930+0000 7f59a5400640 1 Processor -- start 2024-09-11T23:22:26.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.930+0000 7f59a5400640 1 -- start start 2024-09-11T23:22:26.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.931+0000 7f59a5400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f59a015ed20 0x7f59a00b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:26.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.931+0000 7f59a5400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a00b7170 con 0x7f59a015e940 2024-09-11T23:22:26.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.931+0000 7f59a5400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a00b7aa0 con 0x7f59a00cef90 2024-09-11T23:22:26.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.931+0000 7f59a5400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f59a00d3660 con 0x7f59a015ed20 2024-09-11T23:22:26.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.931+0000 7f599e800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f59a015e940 0x7f59a00d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37848/0 (socket says 172.21.15.144:37848) 2024-09-11T23:22:26.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.931+0000 7f599e800640 1 -- 172.21.15.144:0/488236327 learned_addr learned my addr 172.21.15.144:0/488236327 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:26.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.932+0000 7f599de00640 1 -- 172.21.15.144:0/488236327 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3369556911 0 0) 0x7f5990001110 con 0x7f59a015e940 2024-09-11T23:22:26.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.932+0000 7f599de00640 1 -- 172.21.15.144:0/488236327 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5984003520 con 0x7f59a015e940 2024-09-11T23:22:26.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.932+0000 7f5995e00640 1 --2- 172.21.15.144:0/488236327 >> v2:172.21.15.165:3300/0 conn(0x7f59a015ed20 0x7f59a00b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:26.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.932+0000 7f599de00640 1 -- 172.21.15.144:0/488236327 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1555722504 0 0) 0x7f5984003520 con 0x7f59a015e940 2024-09-11T23:22:26.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.932+0000 7f599de00640 1 -- 172.21.15.144:0/488236327 >> v2:172.21.15.165:3300/0 conn(0x7f59a015ed20 msgr2=0x7f59a00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:26.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.932+0000 7f599de00640 1 --2- 172.21.15.144:0/488236327 >> v2:172.21.15.165:3300/0 conn(0x7f59a015ed20 0x7f59a00b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:26.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.932+0000 7f599de00640 1 -- 172.21.15.144:0/488236327 >> v1:172.21.15.165:6789/0 conn(0x7f59a00cef90 legacy=0x7f59a00b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:26.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.932+0000 7f599de00640 1 -- 172.21.15.144:0/488236327 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a00d3940 con 0x7f59a015e940 2024-09-11T23:22:26.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.932+0000 7f599de00640 1 -- 172.21.15.144:0/488236327 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f5990001840 con 0x7f59a015e940 2024-09-11T23:22:26.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.932+0000 7f599de00640 1 -- 172.21.15.144:0/488236327 >> v1:172.21.15.144:6789/0 conn(0x7f59a015e940 legacy=0x7f59a00d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:26.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.932+0000 7f599de00640 1 --2- 172.21.15.144:0/488236327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5984003a00 0x7f5984003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:26.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.932+0000 7f599de00640 1 --2- 172.21.15.144:0/488236327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5984004800 0x7f5984004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:26.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.932+0000 7f599de00640 1 --2- 172.21.15.144:0/488236327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59840051c0 0x7f598400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:26.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.932+0000 7f599de00640 1 -- 172.21.15.144:0/488236327 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f59a00d3660 con 0x7f5984003a00 2024-09-11T23:22:26.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.932+0000 7f599de00640 1 -- 172.21.15.144:0/488236327 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f598400c0a0 con 0x7f59840051c0 2024-09-11T23:22:26.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.932+0000 7f599de00640 1 -- 172.21.15.144:0/488236327 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f598400c2a0 con 0x7f5984004800 2024-09-11T23:22:26.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.932+0000 7f599e800640 1 --2- 172.21.15.144:0/488236327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5984003a00 0x7f5984003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:26.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.932+0000 7f5995e00640 1 --2- 172.21.15.144:0/488236327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5984004800 0x7f5984004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:26.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.933+0000 7f599f200640 1 --2- 172.21.15.144:0/488236327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59840051c0 0x7f598400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:26.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.933+0000 7f599e800640 1 -- 172.21.15.144:0/488236327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5984004800 msgr2=0x7f5984004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:26.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.933+0000 7f599e800640 1 --2- 172.21.15.144:0/488236327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5984004800 0x7f5984004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:26.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.933+0000 7f599e800640 1 -- 172.21.15.144:0/488236327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59840051c0 msgr2=0x7f598400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:26.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.933+0000 7f599e800640 1 --2- 172.21.15.144:0/488236327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59840051c0 0x7f598400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:26.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.933+0000 7f599e800640 1 -- 172.21.15.144:0/488236327 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5984003520 con 0x7f5984003a00 2024-09-11T23:22:26.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.933+0000 7f599f200640 1 -- 172.21.15.144:0/488236327 reap_dead start 2024-09-11T23:22:26.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.934+0000 7f599e800640 1 --2- 172.21.15.144:0/488236327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5984003a00 0x7f5984003e20 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f599000c320 tx=0x7f5984005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250368b0718f3dc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:26.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.934+0000 7f599de00640 1 -- 172.21.15.144:0/488236327 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5990007e10 con 0x7f5984003a00 2024-09-11T23:22:26.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.934+0000 7f599de00640 1 -- 172.21.15.144:0/488236327 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5990005ad0 con 0x7f5984003a00 2024-09-11T23:22:26.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.934+0000 7f599de00640 1 -- 172.21.15.144:0/488236327 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5990007070 con 0x7f5984003a00 2024-09-11T23:22:26.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.935+0000 7f59a5400640 1 -- 172.21.15.144:0/488236327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5984003a00 msgr2=0x7f5984003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:26.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.935+0000 7f59a5400640 1 --2- 172.21.15.144:0/488236327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5984003a00 0x7f5984003e20 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f599000c320 tx=0x7f5984005830 comp rx=0 tx=0).stop 2024-09-11T23:22:26.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.935+0000 7f59a5400640 1 -- 172.21.15.144:0/488236327 shutdown_connections 2024-09-11T23:22:26.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.935+0000 7f59a5400640 1 --2- 172.21.15.144:0/488236327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5984003a00 0x7f5984003e20 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:26.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.935+0000 7f59a5400640 1 -- 172.21.15.144:0/488236327 >> 172.21.15.144:0/488236327 conn(0x7f59a00b6240 msgr2=0x7f59a00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:26.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.935+0000 7f59a5400640 1 -- 172.21.15.144:0/488236327 shutdown_connections 2024-09-11T23:22:26.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.935+0000 7f59a5400640 1 -- 172.21.15.144:0/488236327 wait complete. 2024-09-11T23:22:26.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.936+0000 7f59a5400640 1 Processor -- start 2024-09-11T23:22:26.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.937+0000 7f59a5400640 1 -- start start 2024-09-11T23:22:26.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.937+0000 7f59a5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5984003a00 0x7f59a01f4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:26.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.937+0000 7f59a5400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59a0159de0 0x7f59a0154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:26.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.937+0000 7f59a5400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59a0154ac0 0x7f59a00b8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:26.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.937+0000 7f59a5400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f59a00d1ef0 con 0x7f5984003a00 2024-09-11T23:22:26.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.937+0000 7f59a5400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f59a00d3f00 con 0x7f59a0154ac0 2024-09-11T23:22:26.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.937+0000 7f59a5400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f59a00d2070 con 0x7f59a0159de0 2024-09-11T23:22:26.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.938+0000 7f599e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5984003a00 0x7f59a01f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:26.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.938+0000 7f599e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5984003a00 0x7f59a01f4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47332/0 (socket says 172.21.15.144:47332) 2024-09-11T23:22:26.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.938+0000 7f599e800640 1 -- 172.21.15.144:0/3466256326 learned_addr learned my addr 172.21.15.144:0/3466256326 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:26.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.938+0000 7f5995e00640 1 --2- 172.21.15.144:0/3466256326 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59a0159de0 0x7f59a0154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:26.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.938+0000 7f599f200640 1 --2- 172.21.15.144:0/3466256326 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59a0154ac0 0x7f59a00b8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:26.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.938+0000 7f599e800640 1 -- 172.21.15.144:0/3466256326 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59a0159de0 msgr2=0x7f59a0154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:26.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.938+0000 7f599e800640 1 --2- 172.21.15.144:0/3466256326 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59a0159de0 0x7f59a0154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:26.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.938+0000 7f599e800640 1 -- 172.21.15.144:0/3466256326 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59a0154ac0 msgr2=0x7f59a00b8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:26.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.938+0000 7f599e800640 1 --2- 172.21.15.144:0/3466256326 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59a0154ac0 0x7f59a00b8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:26.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.938+0000 7f599e800640 1 -- 172.21.15.144:0/3466256326 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a0158d40 con 0x7f5984003a00 2024-09-11T23:22:26.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.938+0000 7f599e800640 1 --2- 172.21.15.144:0/3466256326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5984003a00 0x7f59a01f4660 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f599000c440 tx=0x7f59a00d3b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:26.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.939+0000 7f5997400640 1 -- 172.21.15.144:0/3466256326 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5990007e10 con 0x7f5984003a00 2024-09-11T23:22:26.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.939+0000 7f5997400640 1 -- 172.21.15.144:0/3466256326 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5990007480 con 0x7f5984003a00 2024-09-11T23:22:26.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.939+0000 7f5997400640 1 -- 172.21.15.144:0/3466256326 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5990001110 con 0x7f5984003a00 2024-09-11T23:22:26.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.939+0000 7f59a5400640 1 -- 172.21.15.144:0/3466256326 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a0159020 con 0x7f5984003a00 2024-09-11T23:22:26.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.939+0000 7f59a5400640 1 -- 172.21.15.144:0/3466256326 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a01595e0 con 0x7f5984003a00 2024-09-11T23:22:26.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.940+0000 7f59a5400640 1 -- 172.21.15.144:0/3466256326 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a0154ed0 con 0x7f5984003a00 2024-09-11T23:22:26.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.941+0000 7f5997400640 1 -- 172.21.15.144:0/3466256326 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f599003c430 con 0x7f5984003a00 2024-09-11T23:22:26.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.942+0000 7f5997400640 1 --2- 172.21.15.144:0/3466256326 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f597c06bf50 0x7f597c06e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:26.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.942+0000 7f5997400640 1 -- 172.21.15.144:0/3466256326 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 4857+0+0 (secure 0 0 0) 0x7f59900abc90 con 0x7f5984003a00 2024-09-11T23:22:26.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.942+0000 7f5995e00640 1 --2- 172.21.15.144:0/3466256326 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f597c06bf50 0x7f597c06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:26.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.943+0000 7f5995e00640 1 --2- 172.21.15.144:0/3466256326 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f597c06bf50 0x7f597c06e410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f59a01f8320 tx=0x7f5988009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:26.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:26.946+0000 7f5997400640 1 -- 172.21.15.144:0/3466256326 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59a0154ed0 con 0x7f5984003a00 2024-09-11T23:22:27.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.184+0000 7f59a5400640 1 -- 172.21.15.144:0/3466256326 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f59a00d10f0 con 0x7f5984003a00 2024-09-11T23:22:27.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.185+0000 7f5997400640 1 -- 172.21.15.144:0/3466256326 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7f5990040030 con 0x7f5984003a00 2024-09-11T23:22:27.185 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:27.185 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:22:27.185 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-11T23:22:27.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:27.185 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-11T23:22:27.185 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmQjymBhAA4BWEVNGY37RsnMGLL3Ow8A==", 2024-09-11T23:22:27.186 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:22:27.186 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:22:27.186 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:22:27.186 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:22:27.186 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:22:27.186 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:27.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:27.186 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-11T23:22:27.186 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmD0mIGhAAvug7T/kOcEmnyMyG++V+zA==", 2024-09-11T23:22:27.186 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:22:27.186 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:22:27.187 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:22:27.187 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:22:27.187 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:22:27.187 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:27.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:27.187 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-11T23:22:27.187 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmDwSZEBAAdf4eF3MrADSPzBTICzpOiA==", 2024-09-11T23:22:27.187 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:22:27.187 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:22:27.187 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:22:27.187 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:22:27.187 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:22:27.187 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:27.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:27.188 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-11T23:22:27.188 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmqYtRJBAAgpzvHNUPVnxNoflhqVIJuQ==", 2024-09-11T23:22:27.188 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:22:27.188 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:22:27.188 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:22:27.188 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:22:27.188 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:22:27.188 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:27.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:27.188 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-11T23:22:27.189 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDiJOJmzDABABAA+Qa772+Mm69pecG0QUXlyA==", 2024-09-11T23:22:27.189 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:22:27.189 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:22:27.189 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:22:27.189 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:22:27.189 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:27.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:27.189 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-11T23:22:27.189 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDlJOJmgVjJKRAAtl30JxJHurKdrn1vLUneww==", 2024-09-11T23:22:27.189 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:22:27.189 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:22:27.190 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:22:27.190 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:22:27.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:27.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:27.190 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-11T23:22:27.190 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDpJOJmRzO6FxAAiLDOwDlXYTj6WfEhlI+uVQ==", 2024-09-11T23:22:27.190 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:22:27.190 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:22:27.190 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:22:27.190 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:22:27.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:27.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:27.191 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-11T23:22:27.191 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDtJOJmVFh6EhAA7hcJn4k31nEPMcqiB7+djA==", 2024-09-11T23:22:27.191 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:22:27.191 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:22:27.191 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:22:27.191 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:22:27.191 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:27.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:27.191 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-11T23:22:27.191 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD0JOJmpIFTAhAAYQyoBrMjL6CcDDCNAOMGwQ==", 2024-09-11T23:22:27.192 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:22:27.192 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:22:27.192 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:22:27.192 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:22:27.192 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:27.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:27.192 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-11T23:22:27.192 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD4JOJmBAIIDhAA8G/usUslfQPNpFP1YZsgmg==", 2024-09-11T23:22:27.192 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:22:27.192 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:22:27.192 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:22:27.193 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:22:27.193 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:27.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:27.193 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-11T23:22:27.193 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD8JOJmDl2dCBAA5bL+2AIp0uWL4qjpI/mAdQ==", 2024-09-11T23:22:27.193 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:22:27.193 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:22:27.193 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:22:27.193 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:22:27.193 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:27.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:27.193 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-11T23:22:27.194 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAAJeJmMWX+AhAA7ABVgJPwhRZNkPNdZzmnOQ==", 2024-09-11T23:22:27.194 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:22:27.194 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:22:27.194 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:22:27.194 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:22:27.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:27.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:27.194 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-11T23:22:27.194 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A==", 2024-09-11T23:22:27.194 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:22:27.194 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:22:27.194 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-11T23:22:27.194 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T23:22:27.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:27.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:27.195 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-11T23:22:27.195 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmLFrBORAAT64lj0sWlVoTHVUZQf0JjA==", 2024-09-11T23:22:27.195 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:22:27.195 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:22:27.195 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:22:27.195 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:22:27.195 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:22:27.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:27.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:27.195 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-11T23:22:27.196 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJm2/dLMxAAbuKdVAbscrlF5jcBnouBOQ==", 2024-09-11T23:22:27.196 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:22:27.196 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:22:27.196 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:22:27.196 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:22:27.196 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:22:27.196 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:27.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:27.196 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-11T23:22:27.196 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDfJOJmse6UBBAAq+3afsp+2jApe9sTFmVVOw==", 2024-09-11T23:22:27.196 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:22:27.196 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:22:27.197 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:22:27.197 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:22:27.197 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:22:27.197 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:27.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:27.197 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-11T23:22:27.197 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmHmAwEhAAEGCvu0NgtyjIPcJBk6bkdA==", 2024-09-11T23:22:27.197 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:22:27.197 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:22:27.197 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:22:27.197 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:22:27.197 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:22:27.197 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:27.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:27.198 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-11T23:22:27.198 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmxMaVOxAA62zJwlyk0qdrsemalijH4Q==", 2024-09-11T23:22:27.198 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:22:27.198 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:22:27.198 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:22:27.198 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:22:27.198 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:22:27.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:27.198 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-11T23:22:27.198 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmWZRNNBAAwZ2GCP7mGn87ZSnsKCcDRQ==", 2024-09-11T23:22:27.198 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:22:27.199 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:22:27.199 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:22:27.199 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:22:27.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.199 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:22:27.199 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:22:27.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.187+0000 7f59a5400640 1 -- 172.21.15.144:0/3466256326 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f597c06bf50 msgr2=0x7f597c06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:27.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.187+0000 7f59a5400640 1 --2- 172.21.15.144:0/3466256326 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f597c06bf50 0x7f597c06e410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f59a01f8320 tx=0x7f5988009190 comp rx=0 tx=0).stop 2024-09-11T23:22:27.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.187+0000 7f59a5400640 1 -- 172.21.15.144:0/3466256326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5984003a00 msgr2=0x7f59a01f4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:27.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.187+0000 7f59a5400640 1 --2- 172.21.15.144:0/3466256326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5984003a00 0x7f59a01f4660 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f599000c440 tx=0x7f59a00d3b10 comp rx=0 tx=0).stop 2024-09-11T23:22:27.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.187+0000 7f59a5400640 1 -- 172.21.15.144:0/3466256326 shutdown_connections 2024-09-11T23:22:27.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.187+0000 7f59a5400640 1 --2- 172.21.15.144:0/3466256326 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f597c06bf50 0x7f597c06e410 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:27.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.187+0000 7f59a5400640 1 --2- 172.21.15.144:0/3466256326 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59a0154ac0 0x7f59a00b8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:27.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.187+0000 7f59a5400640 1 --2- 172.21.15.144:0/3466256326 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59a0159de0 0x7f59a0154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:27.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.187+0000 7f59a5400640 1 --2- 172.21.15.144:0/3466256326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5984003a00 0x7f59a01f4660 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:27.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.187+0000 7f59a5400640 1 -- 172.21.15.144:0/3466256326 >> 172.21.15.144:0/3466256326 conn(0x7f59a00b6240 msgr2=0x7f59a015f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:27.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.187+0000 7f59a5400640 1 -- 172.21.15.144:0/3466256326 shutdown_connections 2024-09-11T23:22:27.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.187+0000 7f59a5400640 1 -- 172.21.15.144:0/3466256326 wait complete. 2024-09-11T23:22:27.203 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:22:27.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.356+0000 7fa4df200640 1 Processor -- start 2024-09-11T23:22:27.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.356+0000 7fa4df200640 1 -- start start 2024-09-11T23:22:27.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.357+0000 7fa4df200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa4e015e610 0x7fa4e00b9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:27.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.357+0000 7fa4df200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e00cf1f0 0x7fa4e00cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:27.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.357+0000 7fa4df200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4e00d29c0 con 0x7fa4e00d2500 2024-09-11T23:22:27.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.357+0000 7fa4df200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa4e00cfb80 con 0x7fa4e015e610 2024-09-11T23:22:27.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.357+0000 7fa4df200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa4e00d2ca0 con 0x7fa4e00cf1f0 2024-09-11T23:22:27.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.358+0000 7fa4dde00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa4e015e610 0x7fa4e00b9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:27.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.358+0000 7fa4de800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e00cf1f0 0x7fa4e00cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:27.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.358+0000 7fa4dde00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa4e015e610 0x7fa4e00b9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:46930/0 (socket says 172.21.15.144:46930) 2024-09-11T23:22:27.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.358+0000 7fa4dde00640 1 -- 172.21.15.144:0/2878927463 learned_addr learned my addr 172.21.15.144:0/2878927463 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:27.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.358+0000 7fa4dd400640 1 --1- 172.21.15.144:0/2878927463 >> v1:172.21.15.165:6789/0 conn(0x7fa4e00d2500 0x7fa4e00d3a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:37860/0 (socket says 172.21.15.144:37860) 2024-09-11T23:22:27.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.358+0000 7fa4de800640 1 -- 172.21.15.144:0/2878927463 >> v2:172.21.15.165:3300/0 conn(0x7fa4e015e610 msgr2=0x7fa4e00b9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:27.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.358+0000 7fa4de800640 1 --2- 172.21.15.144:0/2878927463 >> v2:172.21.15.165:3300/0 conn(0x7fa4e015e610 0x7fa4e00b9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:27.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.358+0000 7fa4de800640 1 -- 172.21.15.144:0/2878927463 >> v1:172.21.15.165:6789/0 conn(0x7fa4e00d2500 legacy=0x7fa4e00d3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:27.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.358+0000 7fa4de800640 1 -- 172.21.15.144:0/2878927463 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e00d2f80 con 0x7fa4e00cf1f0 2024-09-11T23:22:27.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.359+0000 7fa4de800640 1 --2- 172.21.15.144:0/2878927463 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e00cf1f0 0x7fa4e00cf640 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009d90 tx=0x7fa4d802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9c24d66ffc9d6b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:27.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.360+0000 7fa4dca00640 1 -- 172.21.15.144:0/2878927463 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8007740 con 0x7fa4e00cf1f0 2024-09-11T23:22:27.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.360+0000 7fa4dca00640 1 -- 172.21.15.144:0/2878927463 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d80078e0 con 0x7fa4e00cf1f0 2024-09-11T23:22:27.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.360+0000 7fa4dca00640 1 -- 172.21.15.144:0/2878927463 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8007cb0 con 0x7fa4e00cf1f0 2024-09-11T23:22:27.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.360+0000 7fa4df200640 1 -- 172.21.15.144:0/2878927463 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e00cf1f0 msgr2=0x7fa4e00cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:27.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.360+0000 7fa4df200640 1 --2- 172.21.15.144:0/2878927463 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e00cf1f0 0x7fa4e00cf640 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009d90 tx=0x7fa4d802a660 comp rx=0 tx=0).stop 2024-09-11T23:22:27.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.361+0000 7fa4df200640 1 -- 172.21.15.144:0/2878927463 shutdown_connections 2024-09-11T23:22:27.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.361+0000 7fa4df200640 1 --2- 172.21.15.144:0/2878927463 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e00cf1f0 0x7fa4e00cf640 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:27.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.361+0000 7fa4df200640 1 --2- 172.21.15.144:0/2878927463 >> v2:172.21.15.165:3300/0 conn(0x7fa4e015e610 0x7fa4e00b9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:27.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.361+0000 7fa4df200640 1 -- 172.21.15.144:0/2878927463 >> 172.21.15.144:0/2878927463 conn(0x7fa4e00d4700 msgr2=0x7fa4e00d4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:27.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.361+0000 7fa4df200640 1 -- 172.21.15.144:0/2878927463 shutdown_connections 2024-09-11T23:22:27.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.361+0000 7fa4df200640 1 -- 172.21.15.144:0/2878927463 wait complete. 2024-09-11T23:22:27.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.362+0000 7fa4df200640 1 Processor -- start 2024-09-11T23:22:27.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.362+0000 7fa4df200640 1 -- start start 2024-09-11T23:22:27.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.363+0000 7fa4df200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e00cf1f0 0x7fa4e00b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:27.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.363+0000 7fa4df200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e00d2500 0x7fa4e0158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:27.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.363+0000 7fa4df200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4e015e610 0x7fa4e00ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:27.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.363+0000 7fa4df200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e00d4170 con 0x7fa4e00cf1f0 2024-09-11T23:22:27.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.363+0000 7fa4df200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e00d3540 con 0x7fa4e015e610 2024-09-11T23:22:27.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.363+0000 7fa4df200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa4e015e9f0 con 0x7fa4e00d2500 2024-09-11T23:22:27.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.363+0000 7fa4dde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e00cf1f0 0x7fa4e00b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:27.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.364+0000 7fa4dde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e00cf1f0 0x7fa4e00b69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47340/0 (socket says 172.21.15.144:47340) 2024-09-11T23:22:27.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.364+0000 7fa4dde00640 1 -- 172.21.15.144:0/2505167334 learned_addr learned my addr 172.21.15.144:0/2505167334 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:27.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.364+0000 7fa4dd400640 1 --2- 172.21.15.144:0/2505167334 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e00d2500 0x7fa4e0158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:27.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.364+0000 7fa4de800640 1 --2- 172.21.15.144:0/2505167334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4e015e610 0x7fa4e00ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:27.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.364+0000 7fa4dde00640 1 -- 172.21.15.144:0/2505167334 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e00d2500 msgr2=0x7fa4e0158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:27.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.364+0000 7fa4dde00640 1 --2- 172.21.15.144:0/2505167334 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e00d2500 0x7fa4e0158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:27.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.364+0000 7fa4dde00640 1 -- 172.21.15.144:0/2505167334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4e015e610 msgr2=0x7fa4e00ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:27.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.364+0000 7fa4dde00640 1 --2- 172.21.15.144:0/2505167334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4e015e610 0x7fa4e00ccd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:27.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.364+0000 7fa4dde00640 1 -- 172.21.15.144:0/2505167334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e0158ca0 con 0x7fa4e00cf1f0 2024-09-11T23:22:27.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.364+0000 7fa4dde00640 1 --2- 172.21.15.144:0/2505167334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e00cf1f0 0x7fa4e00b69a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009fd0 tx=0x7fa4d000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:27.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.364+0000 7fa4d6000640 1 -- 172.21.15.144:0/2505167334 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0017070 con 0x7fa4e00cf1f0 2024-09-11T23:22:27.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.365+0000 7fa4d6000640 1 -- 172.21.15.144:0/2505167334 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d000c940 con 0x7fa4e00cf1f0 2024-09-11T23:22:27.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.365+0000 7fa4df200640 1 -- 172.21.15.144:0/2505167334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4e01f4580 con 0x7fa4e00cf1f0 2024-09-11T23:22:27.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.365+0000 7fa4d6000640 1 -- 172.21.15.144:0/2505167334 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d000cd10 con 0x7fa4e00cf1f0 2024-09-11T23:22:27.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.365+0000 7fa4df200640 1 -- 172.21.15.144:0/2505167334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4e01f4b40 con 0x7fa4e00cf1f0 2024-09-11T23:22:27.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.366+0000 7fa4df200640 1 -- 172.21.15.144:0/2505167334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4e00cf640 con 0x7fa4e00cf1f0 2024-09-11T23:22:27.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.367+0000 7fa4d6000640 1 -- 172.21.15.144:0/2505167334 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fa4d001a070 con 0x7fa4e00cf1f0 2024-09-11T23:22:27.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.367+0000 7fa4d6000640 1 --2- 172.21.15.144:0/2505167334 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa4c006bf80 0x7fa4c006e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:27.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.367+0000 7fa4d6000640 1 -- 172.21.15.144:0/2505167334 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 4857+0+0 (secure 0 0 0) 0x7fa4d008aeb0 con 0x7fa4e00cf1f0 2024-09-11T23:22:27.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.368+0000 7fa4dd400640 1 --2- 172.21.15.144:0/2505167334 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa4c006bf80 0x7fa4c006e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:27.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.369+0000 7fa4dd400640 1 --2- 172.21.15.144:0/2505167334 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa4c006bf80 0x7fa4c006e440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00b8fb0 tx=0x7fa4cc007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:27.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.372+0000 7fa4d6000640 1 -- 172.21.15.144:0/2505167334 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa4d0059440 con 0x7fa4e00cf1f0 2024-09-11T23:22:27.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.549+0000 7fa4df200640 1 -- 172.21.15.144:0/2505167334 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa4e006dca0 con 0x7fa4e00cf1f0 2024-09-11T23:22:27.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.549+0000 7fa4d6000640 1 -- 172.21.15.144:0/2505167334 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) ==== 84+0+65 (secure 0 0 0) 0x7fa4d005d740 con 0x7fa4e00cf1f0 2024-09-11T23:22:27.549 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:27.549 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:22:27.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:27.550 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-11T23:22:27.550 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-11T23:22:27.550 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:27.550 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:22:27.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.551+0000 7fa4df200640 1 -- 172.21.15.144:0/2505167334 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa4c006bf80 msgr2=0x7fa4c006e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:27.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.551+0000 7fa4df200640 1 --2- 172.21.15.144:0/2505167334 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa4c006bf80 0x7fa4c006e440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00b8fb0 tx=0x7fa4cc007e80 comp rx=0 tx=0).stop 2024-09-11T23:22:27.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.551+0000 7fa4df200640 1 -- 172.21.15.144:0/2505167334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e00cf1f0 msgr2=0x7fa4e00b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:27.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.551+0000 7fa4df200640 1 --2- 172.21.15.144:0/2505167334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e00cf1f0 0x7fa4e00b69a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009fd0 tx=0x7fa4d000ed40 comp rx=0 tx=0).stop 2024-09-11T23:22:27.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.551+0000 7fa4df200640 1 -- 172.21.15.144:0/2505167334 shutdown_connections 2024-09-11T23:22:27.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.551+0000 7fa4df200640 1 --2- 172.21.15.144:0/2505167334 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa4c006bf80 0x7fa4c006e440 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:27.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.551+0000 7fa4df200640 1 --2- 172.21.15.144:0/2505167334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4e015e610 0x7fa4e00ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:27.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.551+0000 7fa4df200640 1 --2- 172.21.15.144:0/2505167334 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4e00d2500 0x7fa4e0158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:27.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.551+0000 7fa4df200640 1 --2- 172.21.15.144:0/2505167334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4e00cf1f0 0x7fa4e00b69a0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:27.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.551+0000 7fa4df200640 1 -- 172.21.15.144:0/2505167334 >> 172.21.15.144:0/2505167334 conn(0x7fa4e00d4700 msgr2=0x7fa4e00c8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:27.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.552+0000 7fa4df200640 1 -- 172.21.15.144:0/2505167334 shutdown_connections 2024-09-11T23:22:27.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.552+0000 7fa4df200640 1 -- 172.21.15.144:0/2505167334 wait complete. 2024-09-11T23:22:27.567 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:22:27.567 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:22:27.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.725+0000 7fd97fe00640 1 Processor -- start 2024-09-11T23:22:27.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.725+0000 7fd97fe00640 1 -- start start 2024-09-11T23:22:27.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.726+0000 7fd97fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd98015e650 0x7fd9800cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:27.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.726+0000 7fd97fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd9800d32d0 0x7fd98006d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:27.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.726+0000 7fd97fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd98006db50 0x7fd98006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:27.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.726+0000 7fd97fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd98015ea30 con 0x7fd98006db50 2024-09-11T23:22:27.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.726+0000 7fd97fe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd9800d3890 con 0x7fd98015e650 2024-09-11T23:22:27.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.726+0000 7fd97fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd9800d3b70 con 0x7fd9800d32d0 2024-09-11T23:22:27.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.726+0000 7fd97f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd98006db50 0x7fd98006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:27.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.727+0000 7fd97f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd98006db50 0x7fd98006bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47350/0 (socket says 172.21.15.144:47350) 2024-09-11T23:22:27.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.727+0000 7fd97f400640 1 -- 172.21.15.144:0/3407552515 learned_addr learned my addr 172.21.15.144:0/3407552515 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:27.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.727+0000 7fd97ea00640 1 --2- 172.21.15.144:0/3407552515 >> v2:172.21.15.165:3300/0 conn(0x7fd98015e650 0x7fd9800cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:27.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.727+0000 7fd976000640 1 --2- 172.21.15.144:0/3407552515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd9800d32d0 0x7fd98006d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:27.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.727+0000 7fd97f400640 1 -- 172.21.15.144:0/3407552515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd9800d32d0 msgr2=0x7fd98006d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:27.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.727+0000 7fd97f400640 1 --2- 172.21.15.144:0/3407552515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd9800d32d0 0x7fd98006d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:27.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.727+0000 7fd97f400640 1 -- 172.21.15.144:0/3407552515 >> v2:172.21.15.165:3300/0 conn(0x7fd98015e650 msgr2=0x7fd9800cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:27.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.727+0000 7fd97f400640 1 --2- 172.21.15.144:0/3407552515 >> v2:172.21.15.165:3300/0 conn(0x7fd98015e650 0x7fd9800cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:27.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.727+0000 7fd97f400640 1 -- 172.21.15.144:0/3407552515 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9800d3e50 con 0x7fd98006db50 2024-09-11T23:22:27.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.728+0000 7fd97f400640 1 --2- 172.21.15.144:0/3407552515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd98006db50 0x7fd98006bed0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd980069b80 tx=0x7fd97802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7db85b25b08b11 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:27.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.728+0000 7fd97e000640 1 -- 172.21.15.144:0/3407552515 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd978036070 con 0x7fd98006db50 2024-09-11T23:22:27.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.728+0000 7fd97e000640 1 -- 172.21.15.144:0/3407552515 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd978031600 con 0x7fd98006db50 2024-09-11T23:22:27.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.728+0000 7fd97e000640 1 -- 172.21.15.144:0/3407552515 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9780319d0 con 0x7fd98006db50 2024-09-11T23:22:27.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.729+0000 7fd97fe00640 1 -- 172.21.15.144:0/3407552515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd98006db50 msgr2=0x7fd98006bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:27.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.729+0000 7fd97fe00640 1 --2- 172.21.15.144:0/3407552515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd98006db50 0x7fd98006bed0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd980069b80 tx=0x7fd97802a730 comp rx=0 tx=0).stop 2024-09-11T23:22:27.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.729+0000 7fd97fe00640 1 -- 172.21.15.144:0/3407552515 shutdown_connections 2024-09-11T23:22:27.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.729+0000 7fd97fe00640 1 --2- 172.21.15.144:0/3407552515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd98006db50 0x7fd98006bed0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:27.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.729+0000 7fd97fe00640 1 --2- 172.21.15.144:0/3407552515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd9800d32d0 0x7fd98006d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:27.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.729+0000 7fd97fe00640 1 --2- 172.21.15.144:0/3407552515 >> v2:172.21.15.165:3300/0 conn(0x7fd98015e650 0x7fd9800cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:27.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.729+0000 7fd97fe00640 1 -- 172.21.15.144:0/3407552515 >> 172.21.15.144:0/3407552515 conn(0x7fd9800d4740 msgr2=0x7fd9800d4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:27.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.729+0000 7fd97fe00640 1 -- 172.21.15.144:0/3407552515 shutdown_connections 2024-09-11T23:22:27.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.729+0000 7fd97fe00640 1 -- 172.21.15.144:0/3407552515 wait complete. 2024-09-11T23:22:27.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.730+0000 7fd97fe00640 1 Processor -- start 2024-09-11T23:22:27.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.731+0000 7fd97fe00640 1 -- start start 2024-09-11T23:22:27.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.731+0000 7fd97fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd98006db50 0x7fd9801f7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:27.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.731+0000 7fd97fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9800d32d0 0x7fd9800cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.732+0000 7fd97fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd98015e650 0x7fd9801e94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.732+0000 7fd97fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd9800cfd90 con 0x7fd9800d32d0 2024-09-11T23:22:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.732+0000 7fd97fe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd9800cfc10 con 0x7fd98006db50 2024-09-11T23:22:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.732+0000 7fd97fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd9800b7690 con 0x7fd98015e650 2024-09-11T23:22:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.732+0000 7fd976000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9800d32d0 0x7fd9800cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.732+0000 7fd976000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9800d32d0 0x7fd9800cf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47362/0 (socket says 172.21.15.144:47362) 2024-09-11T23:22:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.732+0000 7fd976000640 1 -- 172.21.15.144:0/2385217641 learned_addr learned my addr 172.21.15.144:0/2385217641 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.732+0000 7fd97ea00640 1 --2- 172.21.15.144:0/2385217641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd98006db50 0x7fd9801f7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.732+0000 7fd976000640 1 -- 172.21.15.144:0/2385217641 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd98015e650 msgr2=0x7fd9801e94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.732+0000 7fd976000640 1 --2- 172.21.15.144:0/2385217641 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd98015e650 0x7fd9801e94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.732+0000 7fd976000640 1 -- 172.21.15.144:0/2385217641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd98006db50 msgr2=0x7fd9801f7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.732+0000 7fd976000640 1 --2- 172.21.15.144:0/2385217641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd98006db50 0x7fd9801f7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.732+0000 7fd976000640 1 -- 172.21.15.144:0/2385217641 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9800cdcc0 con 0x7fd9800d32d0 2024-09-11T23:22:27.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.732+0000 7fd97ea00640 1 --2- 172.21.15.144:0/2385217641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd98006db50 0x7fd9801f7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:22:27.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.732+0000 7fd976000640 1 --2- 172.21.15.144:0/2385217641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9800d32d0 0x7fd9800cf4b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd96800d830 tx=0x7fd96800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:27.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.733+0000 7fd977400640 1 -- 172.21.15.144:0/2385217641 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96800b6c0 con 0x7fd9800d32d0 2024-09-11T23:22:27.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.733+0000 7fd977400640 1 -- 172.21.15.144:0/2385217641 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd968019070 con 0x7fd9800d32d0 2024-09-11T23:22:27.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.733+0000 7fd977400640 1 -- 172.21.15.144:0/2385217641 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96800ba80 con 0x7fd9800d32d0 2024-09-11T23:22:27.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.733+0000 7fd97fe00640 1 -- 172.21.15.144:0/2385217641 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9800cdfa0 con 0x7fd9800d32d0 2024-09-11T23:22:27.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.733+0000 7fd97fe00640 1 -- 172.21.15.144:0/2385217641 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9800ce560 con 0x7fd9800d32d0 2024-09-11T23:22:27.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.734+0000 7fd97fe00640 1 -- 172.21.15.144:0/2385217641 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd98006d610 con 0x7fd9800d32d0 2024-09-11T23:22:27.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.735+0000 7fd977400640 1 -- 172.21.15.144:0/2385217641 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fd96801e460 con 0x7fd9800d32d0 2024-09-11T23:22:27.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.736+0000 7fd977400640 1 --2- 172.21.15.144:0/2385217641 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd95c06bf50 0x7fd95c06e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:27.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.736+0000 7fd977400640 1 -- 172.21.15.144:0/2385217641 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 4857+0+0 (secure 0 0 0) 0x7fd96808b450 con 0x7fd9800d32d0 2024-09-11T23:22:27.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.736+0000 7fd97ea00640 1 --2- 172.21.15.144:0/2385217641 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd95c06bf50 0x7fd95c06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:27.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.737+0000 7fd97ea00640 1 --2- 172.21.15.144:0/2385217641 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd95c06bf50 0x7fd95c06e410 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd9801ea320 tx=0x7fd970008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:27.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.740+0000 7fd977400640 1 -- 172.21.15.144:0/2385217641 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd968059fa0 con 0x7fd9800d32d0 2024-09-11T23:22:27.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:27.918+0000 7fd97fe00640 1 -- 172.21.15.144:0/2385217641 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd9800ba3d0 con 0x7fd9800d32d0 2024-09-11T23:22:28.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.764+0000 7fd977400640 1 -- 172.21.15.144:0/2385217641 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) ==== 138+0+0 (secure 0 0 0) 0x7fd9680598a0 con 0x7fd9800d32d0 2024-09-11T23:22:28.765 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-11T23:22:28.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.767+0000 7fd97fe00640 1 -- 172.21.15.144:0/2385217641 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd95c06bf50 msgr2=0x7fd95c06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:28.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.767+0000 7fd97fe00640 1 --2- 172.21.15.144:0/2385217641 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd95c06bf50 0x7fd95c06e410 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd9801ea320 tx=0x7fd970008040 comp rx=0 tx=0).stop 2024-09-11T23:22:28.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.767+0000 7fd97fe00640 1 -- 172.21.15.144:0/2385217641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9800d32d0 msgr2=0x7fd9800cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:28.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.767+0000 7fd97fe00640 1 --2- 172.21.15.144:0/2385217641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9800d32d0 0x7fd9800cf4b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd96800d830 tx=0x7fd96800dcf0 comp rx=0 tx=0).stop 2024-09-11T23:22:28.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.767+0000 7fd97fe00640 1 -- 172.21.15.144:0/2385217641 shutdown_connections 2024-09-11T23:22:28.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.767+0000 7fd97fe00640 1 --2- 172.21.15.144:0/2385217641 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd95c06bf50 0x7fd95c06e410 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:28.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.767+0000 7fd97fe00640 1 --2- 172.21.15.144:0/2385217641 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd98015e650 0x7fd9801e94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:28.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.767+0000 7fd97fe00640 1 --2- 172.21.15.144:0/2385217641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9800d32d0 0x7fd9800cf4b0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:28.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.767+0000 7fd97fe00640 1 --2- 172.21.15.144:0/2385217641 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd98006db50 0x7fd9801f7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:28.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.767+0000 7fd97fe00640 1 -- 172.21.15.144:0/2385217641 >> 172.21.15.144:0/2385217641 conn(0x7fd9800d4740 msgr2=0x7fd98015ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:28.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.767+0000 7fd97fe00640 1 -- 172.21.15.144:0/2385217641 shutdown_connections 2024-09-11T23:22:28.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.767+0000 7fd97fe00640 1 -- 172.21.15.144:0/2385217641 wait complete. 2024-09-11T23:22:28.790 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:22:28.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.952+0000 7f270fc00640 1 Processor -- start 2024-09-11T23:22:28.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.952+0000 7f270fc00640 1 -- start start 2024-09-11T23:22:28.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.953+0000 7f270fc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f27080b61e0 0x7f27080b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:28.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.953+0000 7f270fc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27080b3b00 0x7f27081625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:28.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.953+0000 7f270fc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27080b6b00 con 0x7f27080b3540 2024-09-11T23:22:28.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.953+0000 7f270fc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f27080d24f0 con 0x7f27080b61e0 2024-09-11T23:22:28.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.953+0000 7f270fc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f27080d20e0 con 0x7f27080b3b00 2024-09-11T23:22:28.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.953+0000 7f26ffe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27080b3b00 0x7f27081625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:28.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.953+0000 7f270d200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f27080b61e0 0x7f27080b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:28.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.953+0000 7f26ffe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27080b3b00 0x7f27081625d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:35578/0 (socket says 172.21.15.144:35578) 2024-09-11T23:22:28.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.953+0000 7f26ffe00640 1 -- 172.21.15.144:0/3476720752 learned_addr learned my addr 172.21.15.144:0/3476720752 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:28.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.954+0000 7f270d200640 1 -- 172.21.15.144:0/3476720752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27080b3b00 msgr2=0x7f27081625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:28.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.954+0000 7f270d200640 1 --2- 172.21.15.144:0/3476720752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27080b3b00 0x7f27081625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:28.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.954+0000 7f270d200640 1 -- 172.21.15.144:0/3476720752 >> v1:172.21.15.165:6789/0 conn(0x7f27080b3540 legacy=0x7f2708162b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:28.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.954+0000 7f270d200640 1 -- 172.21.15.144:0/3476720752 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27080cfa70 con 0x7f27080b61e0 2024-09-11T23:22:28.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.954+0000 7f26ffe00640 1 --2- 172.21.15.144:0/3476720752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27080b3b00 0x7f27081625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:22:28.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.955+0000 7f270d200640 1 --2- 172.21.15.144:0/3476720752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27080b61e0 0x7f27080b65c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f26f80097a0 tx=0x7f26f802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed30397c3d5ed746 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:28.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.955+0000 7f2707e00640 1 -- 172.21.15.144:0/3476720752 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8037070 con 0x7f27080b61e0 2024-09-11T23:22:28.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.955+0000 7f2707e00640 1 -- 172.21.15.144:0/3476720752 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f802adb0 con 0x7f27080b61e0 2024-09-11T23:22:28.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.955+0000 7f2707e00640 1 -- 172.21.15.144:0/3476720752 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8032660 con 0x7f27080b61e0 2024-09-11T23:22:28.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.956+0000 7f270fc00640 1 -- 172.21.15.144:0/3476720752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27080b61e0 msgr2=0x7f27080b65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:28.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.956+0000 7f270fc00640 1 --2- 172.21.15.144:0/3476720752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27080b61e0 0x7f27080b65c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f26f80097a0 tx=0x7f26f802a060 comp rx=0 tx=0).stop 2024-09-11T23:22:28.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.956+0000 7f270fc00640 1 -- 172.21.15.144:0/3476720752 shutdown_connections 2024-09-11T23:22:28.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.956+0000 7f270fc00640 1 --2- 172.21.15.144:0/3476720752 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27080b3b00 0x7f27081625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:28.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.956+0000 7f270fc00640 1 --2- 172.21.15.144:0/3476720752 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27080b61e0 0x7f27080b65c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:28.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.956+0000 7f270fc00640 1 -- 172.21.15.144:0/3476720752 >> 172.21.15.144:0/3476720752 conn(0x7f27080d11e0 msgr2=0x7f27080d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:28.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.956+0000 7f270fc00640 1 -- 172.21.15.144:0/3476720752 shutdown_connections 2024-09-11T23:22:28.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.956+0000 7f270fc00640 1 -- 172.21.15.144:0/3476720752 wait complete. 2024-09-11T23:22:28.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.958+0000 7f270fc00640 1 Processor -- start 2024-09-11T23:22:28.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.958+0000 7f270fc00640 1 -- start start 2024-09-11T23:22:28.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.959+0000 7f270fc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27080b3540 0x7f27080ab450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:28.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.959+0000 7f270fc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27080b3b00 0x7f2708150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:28.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.959+0000 7f270fc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27080b61e0 0x7f27080ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:28.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.959+0000 7f270fc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f270815edc0 con 0x7f27080b3b00 2024-09-11T23:22:28.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.959+0000 7f270fc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f27080d0030 con 0x7f27080b3540 2024-09-11T23:22:28.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.959+0000 7f270fc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f27080cc610 con 0x7f27080b61e0 2024-09-11T23:22:28.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.959+0000 7f26ffe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27080b3b00 0x7f2708150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:28.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.959+0000 7f26ffe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27080b3b00 0x7f2708150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47374/0 (socket says 172.21.15.144:47374) 2024-09-11T23:22:28.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.959+0000 7f26ffe00640 1 -- 172.21.15.144:0/4096181310 learned_addr learned my addr 172.21.15.144:0/4096181310 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:28.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.959+0000 7f270d200640 1 --2- 172.21.15.144:0/4096181310 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27080b3540 0x7f27080ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:28.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.959+0000 7f270dc00640 1 --2- 172.21.15.144:0/4096181310 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27080b61e0 0x7f27080ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:28.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.959+0000 7f26ffe00640 1 -- 172.21.15.144:0/4096181310 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27080b61e0 msgr2=0x7f27080ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:28.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.959+0000 7f26ffe00640 1 --2- 172.21.15.144:0/4096181310 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27080b61e0 0x7f27080ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:28.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.959+0000 7f26ffe00640 1 -- 172.21.15.144:0/4096181310 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27080b3540 msgr2=0x7f27080ab450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:28.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.959+0000 7f26ffe00640 1 --2- 172.21.15.144:0/4096181310 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27080b3540 0x7f27080ab450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:28.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.959+0000 7f26ffe00640 1 -- 172.21.15.144:0/4096181310 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27080cc890 con 0x7f27080b3b00 2024-09-11T23:22:28.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.959+0000 7f270dc00640 1 --2- 172.21.15.144:0/4096181310 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27080b61e0 0x7f27080ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:28.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.960+0000 7f26ffe00640 1 --2- 172.21.15.144:0/4096181310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27080b3b00 0x7f2708150b50 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f26f000e900 tx=0x7f26f000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:28.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.960+0000 7f2705600640 1 -- 172.21.15.144:0/4096181310 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f0017070 con 0x7f27080b3b00 2024-09-11T23:22:28.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.960+0000 7f2705600640 1 -- 172.21.15.144:0/4096181310 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f000c9a0 con 0x7f27080b3b00 2024-09-11T23:22:28.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.960+0000 7f2705600640 1 -- 172.21.15.144:0/4096181310 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f000cd90 con 0x7f27080b3b00 2024-09-11T23:22:28.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.960+0000 7f270fc00640 1 -- 172.21.15.144:0/4096181310 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27080ccb70 con 0x7f27080b3b00 2024-09-11T23:22:28.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.960+0000 7f270fc00640 1 -- 172.21.15.144:0/4096181310 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27080cd130 con 0x7f27080b3b00 2024-09-11T23:22:28.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.961+0000 7f270fc00640 1 -- 172.21.15.144:0/4096181310 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27080d1d00 con 0x7f27080b3b00 2024-09-11T23:22:28.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.963+0000 7f2705600640 1 -- 172.21.15.144:0/4096181310 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f26f001a070 con 0x7f27080b3b00 2024-09-11T23:22:28.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.963+0000 7f2705600640 1 --2- 172.21.15.144:0/4096181310 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f26e406bf50 0x7f26e406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:28.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.964+0000 7f2705600640 1 -- 172.21.15.144:0/4096181310 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5227+0+0 (secure 0 0 0) 0x7f26f008b340 con 0x7f27080b3b00 2024-09-11T23:22:28.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.964+0000 7f270d200640 1 --2- 172.21.15.144:0/4096181310 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f26e406bf50 0x7f26e406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:28.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.965+0000 7f270d200640 1 --2- 172.21.15.144:0/4096181310 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f26e406bf50 0x7f26e406e410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f26f8034000 tx=0x7f26f802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:28.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:28.968+0000 7f2705600640 1 -- 172.21.15.144:0/4096181310 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26f00597e0 con 0x7f27080b3b00 2024-09-11T23:22:29.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.149+0000 7f270fc00640 1 -- 172.21.15.144:0/4096181310 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f27080ba6e0 con 0x7f27080b3b00 2024-09-11T23:22:29.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.773+0000 7f2705600640 1 -- 172.21.15.144:0/4096181310 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) ==== 170+0+0 (secure 0 0 0) 0x7f26f008b120 con 0x7f27080b3b00 2024-09-11T23:22:29.773 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-11T23:22:29.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.776+0000 7f270fc00640 1 -- 172.21.15.144:0/4096181310 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f26e406bf50 msgr2=0x7f26e406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:29.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.776+0000 7f270fc00640 1 --2- 172.21.15.144:0/4096181310 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f26e406bf50 0x7f26e406e410 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f26f8034000 tx=0x7f26f802e000 comp rx=0 tx=0).stop 2024-09-11T23:22:29.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.776+0000 7f270fc00640 1 -- 172.21.15.144:0/4096181310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27080b3b00 msgr2=0x7f2708150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:29.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.776+0000 7f270fc00640 1 --2- 172.21.15.144:0/4096181310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27080b3b00 0x7f2708150b50 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f26f000e900 tx=0x7f26f000edc0 comp rx=0 tx=0).stop 2024-09-11T23:22:29.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.777+0000 7f270fc00640 1 -- 172.21.15.144:0/4096181310 shutdown_connections 2024-09-11T23:22:29.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.777+0000 7f270fc00640 1 --2- 172.21.15.144:0/4096181310 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f26e406bf50 0x7f26e406e410 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:29.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.777+0000 7f270fc00640 1 --2- 172.21.15.144:0/4096181310 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27080b61e0 0x7f27080ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:29.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.777+0000 7f270fc00640 1 --2- 172.21.15.144:0/4096181310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27080b3b00 0x7f2708150b50 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:29.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.777+0000 7f270fc00640 1 --2- 172.21.15.144:0/4096181310 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27080b3540 0x7f27080ab450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:29.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.777+0000 7f270fc00640 1 -- 172.21.15.144:0/4096181310 >> 172.21.15.144:0/4096181310 conn(0x7f27080d11e0 msgr2=0x7f27080cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:29.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.778+0000 7f270fc00640 1 -- 172.21.15.144:0/4096181310 shutdown_connections 2024-09-11T23:22:29.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.778+0000 7f270fc00640 1 -- 172.21.15.144:0/4096181310 wait complete. 2024-09-11T23:22:29.807 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:22:29.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.964+0000 7fe2d8a00640 1 Processor -- start 2024-09-11T23:22:29.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.964+0000 7fe2d8a00640 1 -- start start 2024-09-11T23:22:29.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.965+0000 7fe2d8a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe2d40d2ac0 0x7fe2d406dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:29.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.965+0000 7fe2d8a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2d415ed30 con 0x7fe2d40b5590 2024-09-11T23:22:29.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.965+0000 7fe2d8a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2d40d0f40 con 0x7fe2d415e950 2024-09-11T23:22:29.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.965+0000 7fe2d8a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe2d40d1220 con 0x7fe2d40d2ac0 2024-09-11T23:22:29.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.965+0000 7fe2c9400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe2d40b5590 0x7fe2d40d23b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37858/0 (socket says 172.21.15.144:37858) 2024-09-11T23:22:29.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.965+0000 7fe2c9400640 1 -- 172.21.15.144:0/795868247 learned_addr learned my addr 172.21.15.144:0/795868247 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:29.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.966+0000 7fe2d2800640 1 --2- 172.21.15.144:0/795868247 >> v2:172.21.15.165:3300/0 conn(0x7fe2d40d2ac0 0x7fe2d406dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:29.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.966+0000 7fe2d1400640 1 -- 172.21.15.144:0/795868247 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4217864263 0 0) 0x7fe2d415ed30 con 0x7fe2d40b5590 2024-09-11T23:22:29.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.966+0000 7fe2d1400640 1 -- 172.21.15.144:0/795868247 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2b8003520 con 0x7fe2d40b5590 2024-09-11T23:22:29.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.966+0000 7fe2d1400640 1 -- 172.21.15.144:0/795868247 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1552614410 0 0) 0x7fe2b8003520 con 0x7fe2d40b5590 2024-09-11T23:22:29.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.966+0000 7fe2d1400640 1 -- 172.21.15.144:0/795868247 >> v2:172.21.15.165:3300/0 conn(0x7fe2d40d2ac0 msgr2=0x7fe2d406dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:29.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.966+0000 7fe2d1400640 1 --2- 172.21.15.144:0/795868247 >> v2:172.21.15.165:3300/0 conn(0x7fe2d40d2ac0 0x7fe2d406dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:29.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.966+0000 7fe2d1400640 1 -- 172.21.15.144:0/795868247 >> v1:172.21.15.165:6789/0 conn(0x7fe2d415e950 legacy=0x7fe2d40d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:29.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.966+0000 7fe2d1400640 1 -- 172.21.15.144:0/795868247 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d406d420 con 0x7fe2d40b5590 2024-09-11T23:22:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.966+0000 7fe2d1400640 1 -- 172.21.15.144:0/795868247 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fe2bc001670 con 0x7fe2d40b5590 2024-09-11T23:22:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.966+0000 7fe2d1400640 1 -- 172.21.15.144:0/795868247 >> v1:172.21.15.144:6789/0 conn(0x7fe2d40b5590 legacy=0x7fe2d40d23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.966+0000 7fe2d1400640 1 --2- 172.21.15.144:0/795868247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2b80039b0 0x7fe2b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.966+0000 7fe2d1400640 1 --2- 172.21.15.144:0/795868247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b8004800 0x7fe2b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.966+0000 7fe2d1400640 1 --2- 172.21.15.144:0/795868247 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2b80051c0 0x7fe2b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.966+0000 7fe2d1400640 1 -- 172.21.15.144:0/795868247 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d40d1220 con 0x7fe2b8004800 2024-09-11T23:22:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.966+0000 7fe2d1400640 1 -- 172.21.15.144:0/795868247 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b800c060 con 0x7fe2b80039b0 2024-09-11T23:22:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.966+0000 7fe2d1400640 1 -- 172.21.15.144:0/795868247 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b800c260 con 0x7fe2b80051c0 2024-09-11T23:22:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.967+0000 7fe2c9400640 1 --2- 172.21.15.144:0/795868247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b8004800 0x7fe2b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.967+0000 7fe2d1e00640 1 --2- 172.21.15.144:0/795868247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2b80039b0 0x7fe2b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.967+0000 7fe2d2800640 1 --2- 172.21.15.144:0/795868247 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2b80051c0 0x7fe2b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.967+0000 7fe2c9400640 1 -- 172.21.15.144:0/795868247 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2b80051c0 msgr2=0x7fe2b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:29.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.967+0000 7fe2c9400640 1 --2- 172.21.15.144:0/795868247 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2b80051c0 0x7fe2b800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.967+0000 7fe2c9400640 1 -- 172.21.15.144:0/795868247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2b80039b0 msgr2=0x7fe2b8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.967+0000 7fe2c9400640 1 --2- 172.21.15.144:0/795868247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2b80039b0 0x7fe2b8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.967+0000 7fe2c9400640 1 -- 172.21.15.144:0/795868247 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b8003520 con 0x7fe2b8004800 2024-09-11T23:22:29.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.967+0000 7fe2d2800640 1 -- 172.21.15.144:0/795868247 reap_dead start 2024-09-11T23:22:29.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.968+0000 7fe2c9400640 1 --2- 172.21.15.144:0/795868247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b8004800 0x7fe2b8004c80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00c240 tx=0x7fe2b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45018fefbf73ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:29.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.968+0000 7fe2d1400640 1 -- 172.21.15.144:0/795868247 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc007cf0 con 0x7fe2b8004800 2024-09-11T23:22:29.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.968+0000 7fe2d1400640 1 -- 172.21.15.144:0/795868247 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2bc005af0 con 0x7fe2b8004800 2024-09-11T23:22:29.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.968+0000 7fe2d1400640 1 -- 172.21.15.144:0/795868247 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc007070 con 0x7fe2b8004800 2024-09-11T23:22:29.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.969+0000 7fe2d8a00640 1 -- 172.21.15.144:0/795868247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b8004800 msgr2=0x7fe2b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:29.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.969+0000 7fe2d8a00640 1 --2- 172.21.15.144:0/795868247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b8004800 0x7fe2b8004c80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00c240 tx=0x7fe2b8005830 comp rx=0 tx=0).stop 2024-09-11T23:22:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.969+0000 7fe2d8a00640 1 -- 172.21.15.144:0/795868247 shutdown_connections 2024-09-11T23:22:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.969+0000 7fe2d8a00640 1 --2- 172.21.15.144:0/795868247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b8004800 0x7fe2b8004c80 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.969+0000 7fe2d8a00640 1 -- 172.21.15.144:0/795868247 >> 172.21.15.144:0/795868247 conn(0x7fe2d406f310 msgr2=0x7fe2d406f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.969+0000 7fe2d8a00640 1 -- 172.21.15.144:0/795868247 shutdown_connections 2024-09-11T23:22:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.969+0000 7fe2d8a00640 1 -- 172.21.15.144:0/795868247 wait complete. 2024-09-11T23:22:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.971+0000 7fe2d8a00640 1 Processor -- start 2024-09-11T23:22:29.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.971+0000 7fe2d8a00640 1 -- start start 2024-09-11T23:22:29.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.972+0000 7fe2d8a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2b8004800 0x7fe2d40b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:29.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.972+0000 7fe2d8a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2d414e390 0x7fe2d414c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:29.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.972+0000 7fe2d8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d4152e00 0x7fe2d4153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:29.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.972+0000 7fe2d8a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d40cf410 con 0x7fe2d4152e00 2024-09-11T23:22:29.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.972+0000 7fe2d8a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d40b59b0 con 0x7fe2b8004800 2024-09-11T23:22:29.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.972+0000 7fe2d8a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe2d406d040 con 0x7fe2d414e390 2024-09-11T23:22:29.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.972+0000 7fe2d2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d4152e00 0x7fe2d4153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:29.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.972+0000 7fe2d2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d4152e00 0x7fe2d4153280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47380/0 (socket says 172.21.15.144:47380) 2024-09-11T23:22:29.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.972+0000 7fe2d2800640 1 -- 172.21.15.144:0/1333065034 learned_addr learned my addr 172.21.15.144:0/1333065034 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.972+0000 7fe2d1e00640 1 --2- 172.21.15.144:0/1333065034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2b8004800 0x7fe2d40b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.972+0000 7fe2c9400640 1 --2- 172.21.15.144:0/1333065034 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2d414e390 0x7fe2d414c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.972+0000 7fe2d2800640 1 -- 172.21.15.144:0/1333065034 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2d414e390 msgr2=0x7fe2d414c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.972+0000 7fe2d2800640 1 --2- 172.21.15.144:0/1333065034 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2d414e390 0x7fe2d414c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.972+0000 7fe2d2800640 1 -- 172.21.15.144:0/1333065034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2b8004800 msgr2=0x7fe2d40b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.972+0000 7fe2d2800640 1 --2- 172.21.15.144:0/1333065034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2b8004800 0x7fe2d40b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.972+0000 7fe2d2800640 1 -- 172.21.15.144:0/1333065034 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d4150f30 con 0x7fe2d4152e00 2024-09-11T23:22:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.972+0000 7fe2d1e00640 1 --2- 172.21.15.144:0/1333065034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2b8004800 0x7fe2d40b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.973+0000 7fe2d2800640 1 --2- 172.21.15.144:0/1333065034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d4152e00 0x7fe2d4153280 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe2d40742a0 tx=0x7fe2cc00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.973+0000 7fe2caa00640 1 -- 172.21.15.144:0/1333065034 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc00fc80 con 0x7fe2d4152e00 2024-09-11T23:22:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.973+0000 7fe2caa00640 1 -- 172.21.15.144:0/1333065034 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2cc00fe20 con 0x7fe2d4152e00 2024-09-11T23:22:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.973+0000 7fe2d8a00640 1 -- 172.21.15.144:0/1333065034 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d4151210 con 0x7fe2d4152e00 2024-09-11T23:22:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.973+0000 7fe2caa00640 1 -- 172.21.15.144:0/1333065034 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc015670 con 0x7fe2d4152e00 2024-09-11T23:22:29.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.973+0000 7fe2d8a00640 1 -- 172.21.15.144:0/1333065034 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d41517d0 con 0x7fe2d4152e00 2024-09-11T23:22:29.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.974+0000 7fe2d8a00640 1 -- 172.21.15.144:0/1333065034 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2d40d36f0 con 0x7fe2d4152e00 2024-09-11T23:22:29.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.975+0000 7fe2caa00640 1 -- 172.21.15.144:0/1333065034 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fe2cc015810 con 0x7fe2d4152e00 2024-09-11T23:22:29.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.976+0000 7fe2caa00640 1 --2- 172.21.15.144:0/1333065034 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe2b006bf80 0x7fe2b006e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:29.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.976+0000 7fe2caa00640 1 -- 172.21.15.144:0/1333065034 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5609+0+0 (secure 0 0 0) 0x7fe2cc08bfc0 con 0x7fe2d4152e00 2024-09-11T23:22:29.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.976+0000 7fe2d1e00640 1 --2- 172.21.15.144:0/1333065034 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe2b006bf80 0x7fe2b006e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:29.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.977+0000 7fe2d1e00640 1 --2- 172.21.15.144:0/1333065034 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe2b006bf80 0x7fe2b006e440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4000c00 tx=0x7fe2c4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:29.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:29.981+0000 7fe2caa00640 1 -- 172.21.15.144:0/1333065034 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe2cc019030 con 0x7fe2d4152e00 2024-09-11T23:22:30.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.192+0000 7fe2d8a00640 1 -- 172.21.15.144:0/1333065034 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe2d415ed30 con 0x7fe2d4152e00 2024-09-11T23:22:30.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.786+0000 7fe2caa00640 1 -- 172.21.15.144:0/1333065034 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v52) ==== 174+0+0 (secure 0 0 0) 0x7fe2cc010040 con 0x7fe2d4152e00 2024-09-11T23:22:30.791 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 12 and data pool 13 2024-09-11T23:22:30.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.794+0000 7fe2d8a00640 1 -- 172.21.15.144:0/1333065034 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe2b006bf80 msgr2=0x7fe2b006e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:30.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.794+0000 7fe2d8a00640 1 --2- 172.21.15.144:0/1333065034 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe2b006bf80 0x7fe2b006e440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4000c00 tx=0x7fe2c4009040 comp rx=0 tx=0).stop 2024-09-11T23:22:30.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.794+0000 7fe2d8a00640 1 -- 172.21.15.144:0/1333065034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d4152e00 msgr2=0x7fe2d4153280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:30.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.794+0000 7fe2d8a00640 1 --2- 172.21.15.144:0/1333065034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d4152e00 0x7fe2d4153280 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe2d40742a0 tx=0x7fe2cc00f1b0 comp rx=0 tx=0).stop 2024-09-11T23:22:30.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.795+0000 7fe2d8a00640 1 -- 172.21.15.144:0/1333065034 shutdown_connections 2024-09-11T23:22:30.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.795+0000 7fe2d8a00640 1 --2- 172.21.15.144:0/1333065034 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe2b006bf80 0x7fe2b006e440 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:30.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.795+0000 7fe2d8a00640 1 --2- 172.21.15.144:0/1333065034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2d4152e00 0x7fe2d4153280 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:30.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.795+0000 7fe2d8a00640 1 --2- 172.21.15.144:0/1333065034 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2d414e390 0x7fe2d414c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:30.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.795+0000 7fe2d8a00640 1 --2- 172.21.15.144:0/1333065034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2b8004800 0x7fe2d40b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:30.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.795+0000 7fe2d8a00640 1 -- 172.21.15.144:0/1333065034 >> 172.21.15.144:0/1333065034 conn(0x7fe2d406f310 msgr2=0x7fe2d40b6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:30.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.795+0000 7fe2d8a00640 1 -- 172.21.15.144:0/1333065034 shutdown_connections 2024-09-11T23:22:30.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.796+0000 7fe2d8a00640 1 -- 172.21.15.144:0/1333065034 wait complete. 2024-09-11T23:22:30.824 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:22:30.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.978+0000 7f755d400640 1 Processor -- start 2024-09-11T23:22:30.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.978+0000 7f755d400640 1 -- start start 2024-09-11T23:22:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.979+0000 7f755d400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f755815ca40 0x7f755815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.979+0000 7f755d400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f755815ce80 0x7f75581594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.980+0000 7f755d400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f755815d390 con 0x7f75580d02a0 2024-09-11T23:22:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.980+0000 7f755d400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f755815d670 con 0x7f755815ce80 2024-09-11T23:22:30.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.980+0000 7f755d400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f755815d950 con 0x7f755815ca40 2024-09-11T23:22:30.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.980+0000 7f754fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f755815ca40 0x7f755815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:30.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.980+0000 7f7557200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f755815ce80 0x7f75581594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:30.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.980+0000 7f754fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f755815ca40 0x7f755815e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:35626/0 (socket says 172.21.15.144:35626) 2024-09-11T23:22:30.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.980+0000 7f754fe00640 1 -- 172.21.15.144:0/3829029382 learned_addr learned my addr 172.21.15.144:0/3829029382 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:30.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.980+0000 7f754fe00640 1 -- 172.21.15.144:0/3829029382 >> v2:172.21.15.165:3300/0 conn(0x7f755815ce80 msgr2=0x7f75581594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:30.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.980+0000 7f754fe00640 1 --2- 172.21.15.144:0/3829029382 >> v2:172.21.15.165:3300/0 conn(0x7f755815ce80 0x7f75581594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:30.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.980+0000 7f754fe00640 1 -- 172.21.15.144:0/3829029382 >> v1:172.21.15.165:6789/0 conn(0x7f75580d02a0 legacy=0x7f75580d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:30.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.980+0000 7f754fe00640 1 -- 172.21.15.144:0/3829029382 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f755815dc30 con 0x7f755815ca40 2024-09-11T23:22:30.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.981+0000 7f754fe00640 1 --2- 172.21.15.144:0/3829029382 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f755815ca40 0x7f755815e430 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f754000bb10 tx=0x7f754002c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66b1f282be8c1cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:30.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.982+0000 7f7555e00640 1 -- 172.21.15.144:0/3829029382 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7540032790 con 0x7f755815ca40 2024-09-11T23:22:30.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.982+0000 7f7555e00640 1 -- 172.21.15.144:0/3829029382 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7540038070 con 0x7f755815ca40 2024-09-11T23:22:30.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.982+0000 7f7555e00640 1 -- 172.21.15.144:0/3829029382 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7540032b50 con 0x7f755815ca40 2024-09-11T23:22:30.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.982+0000 7f755d400640 1 -- 172.21.15.144:0/3829029382 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f755815ca40 msgr2=0x7f755815e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:30.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.982+0000 7f755d400640 1 --2- 172.21.15.144:0/3829029382 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f755815ca40 0x7f755815e430 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f754000bb10 tx=0x7f754002c890 comp rx=0 tx=0).stop 2024-09-11T23:22:30.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.982+0000 7f755d400640 1 -- 172.21.15.144:0/3829029382 shutdown_connections 2024-09-11T23:22:30.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.982+0000 7f755d400640 1 --2- 172.21.15.144:0/3829029382 >> v2:172.21.15.165:3300/0 conn(0x7f755815ce80 0x7f75581594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:30.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.982+0000 7f755d400640 1 --2- 172.21.15.144:0/3829029382 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f755815ca40 0x7f755815e430 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:30.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.982+0000 7f755d400640 1 -- 172.21.15.144:0/3829029382 >> 172.21.15.144:0/3829029382 conn(0x7f7558062cc0 msgr2=0x7f755806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:30.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.982+0000 7f755d400640 1 -- 172.21.15.144:0/3829029382 shutdown_connections 2024-09-11T23:22:30.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.983+0000 7f755d400640 1 -- 172.21.15.144:0/3829029382 wait complete. 2024-09-11T23:22:30.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.984+0000 7f755d400640 1 Processor -- start 2024-09-11T23:22:30.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.984+0000 7f755d400640 1 -- start start 2024-09-11T23:22:30.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.985+0000 7f755d400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75580d02a0 0x7f75581f4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:30.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.985+0000 7f755d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f755815ca40 0x7f7558157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:30.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.985+0000 7f755d400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f755815ce80 0x7f755815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:30.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.985+0000 7f755d400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7558155d10 con 0x7f755815ca40 2024-09-11T23:22:30.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.985+0000 7f755d400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7558155b90 con 0x7f75580d02a0 2024-09-11T23:22:30.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.985+0000 7f755d400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f75580b4790 con 0x7f755815ce80 2024-09-11T23:22:30.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.985+0000 7f754fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f755815ca40 0x7f7558157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:30.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.985+0000 7f754fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f755815ca40 0x7f7558157700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47392/0 (socket says 172.21.15.144:47392) 2024-09-11T23:22:30.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.985+0000 7f754fe00640 1 -- 172.21.15.144:0/3368758496 learned_addr learned my addr 172.21.15.144:0/3368758496 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:30.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.986+0000 7f7557200640 1 --2- 172.21.15.144:0/3368758496 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f755815ce80 0x7f755815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:30.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.986+0000 7f7556800640 1 --2- 172.21.15.144:0/3368758496 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75580d02a0 0x7f75581f4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:30.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.986+0000 7f754fe00640 1 -- 172.21.15.144:0/3368758496 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f755815ce80 msgr2=0x7f755815a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:30.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.986+0000 7f754fe00640 1 --2- 172.21.15.144:0/3368758496 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f755815ce80 0x7f755815a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:30.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.986+0000 7f754fe00640 1 -- 172.21.15.144:0/3368758496 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75580d02a0 msgr2=0x7f75581f4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:30.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.986+0000 7f754fe00640 1 --2- 172.21.15.144:0/3368758496 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75580d02a0 0x7f75581f4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:30.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.986+0000 7f754fe00640 1 -- 172.21.15.144:0/3368758496 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75581f4d90 con 0x7f755815ca40 2024-09-11T23:22:30.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.986+0000 7f754fe00640 1 --2- 172.21.15.144:0/3368758496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f755815ca40 0x7f7558157700 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f754000b2c0 tx=0x7f7540004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:30.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.987+0000 7f754ea00640 1 -- 172.21.15.144:0/3368758496 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7540043070 con 0x7f755815ca40 2024-09-11T23:22:30.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.987+0000 7f754ea00640 1 -- 172.21.15.144:0/3368758496 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f754003c660 con 0x7f755815ca40 2024-09-11T23:22:30.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.987+0000 7f754ea00640 1 -- 172.21.15.144:0/3368758496 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754003ca50 con 0x7f755815ca40 2024-09-11T23:22:30.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.987+0000 7f755d400640 1 -- 172.21.15.144:0/3368758496 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7558153390 con 0x7f755815ca40 2024-09-11T23:22:30.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.987+0000 7f755d400640 1 -- 172.21.15.144:0/3368758496 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7558153950 con 0x7f755815ca40 2024-09-11T23:22:30.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.988+0000 7f755d400640 1 -- 172.21.15.144:0/3368758496 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75580d0680 con 0x7f755815ca40 2024-09-11T23:22:30.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.989+0000 7f754ea00640 1 -- 172.21.15.144:0/3368758496 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f7540046070 con 0x7f755815ca40 2024-09-11T23:22:30.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.990+0000 7f754ea00640 1 --2- 172.21.15.144:0/3368758496 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f753406bf50 0x7f753406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:30.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.990+0000 7f754ea00640 1 -- 172.21.15.144:0/3368758496 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f75400ab970 con 0x7f755815ca40 2024-09-11T23:22:30.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.990+0000 7f7556800640 1 --2- 172.21.15.144:0/3368758496 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f753406bf50 0x7f753406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:30.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.991+0000 7f7556800640 1 --2- 172.21.15.144:0/3368758496 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f753406bf50 0x7f753406e410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f75581f7320 tx=0x7f7548009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:30.994+0000 7f754ea00640 1 -- 172.21.15.144:0/3368758496 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f75581f4d90 con 0x7f755815ca40 2024-09-11T23:22:31.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.169+0000 7f755d400640 1 -- 172.21.15.144:0/3368758496 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75580008d0 con 0x7f755815ca40 2024-09-11T23:22:31.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.170+0000 7f754ea00640 1 -- 172.21.15.144:0/3368758496 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+16757 (secure 0 0 0) 0x7f7540079aa0 con 0x7f755815ca40 2024-09-11T23:22:31.170 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:31.171 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":82,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:22:30.193613+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:22:27.959542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-11T23:22:29.190371+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:22:31.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.172+0000 7f755d400640 1 -- 172.21.15.144:0/3368758496 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f753406bf50 msgr2=0x7f753406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.172+0000 7f755d400640 1 --2- 172.21.15.144:0/3368758496 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f753406bf50 0x7f753406e410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f75581f7320 tx=0x7f7548009040 comp rx=0 tx=0).stop 2024-09-11T23:22:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.172+0000 7f755d400640 1 -- 172.21.15.144:0/3368758496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f755815ca40 msgr2=0x7f7558157700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.172+0000 7f755d400640 1 --2- 172.21.15.144:0/3368758496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f755815ca40 0x7f7558157700 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f754000b2c0 tx=0x7f7540004730 comp rx=0 tx=0).stop 2024-09-11T23:22:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.172+0000 7f755d400640 1 -- 172.21.15.144:0/3368758496 shutdown_connections 2024-09-11T23:22:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.172+0000 7f755d400640 1 --2- 172.21.15.144:0/3368758496 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f753406bf50 0x7f753406e410 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.172+0000 7f755d400640 1 --2- 172.21.15.144:0/3368758496 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f755815ce80 0x7f755815a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.173+0000 7f755d400640 1 --2- 172.21.15.144:0/3368758496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f755815ca40 0x7f7558157700 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.173+0000 7f755d400640 1 --2- 172.21.15.144:0/3368758496 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75580d02a0 0x7f75581f4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.173+0000 7f755d400640 1 -- 172.21.15.144:0/3368758496 >> 172.21.15.144:0/3368758496 conn(0x7f7558062cc0 msgr2=0x7f75580af380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.173+0000 7f755d400640 1 -- 172.21.15.144:0/3368758496 shutdown_connections 2024-09-11T23:22:31.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.173+0000 7f755d400640 1 -- 172.21.15.144:0/3368758496 wait complete. 2024-09-11T23:22:31.188 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:22:31.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.342+0000 7fdd48800640 1 Processor -- start 2024-09-11T23:22:31.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.342+0000 7fdd48800640 1 -- start start 2024-09-11T23:22:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.343+0000 7fdd48800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdd400cf070 0x7fdd400cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.343+0000 7fdd48800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fdd40073120 0x7fdd40073560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.343+0000 7fdd48800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd400ce740 con 0x7fdd4015c180 2024-09-11T23:22:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.343+0000 7fdd48800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fdd40072640 con 0x7fdd400cf070 2024-09-11T23:22:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.343+0000 7fdd48800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fdd40072920 con 0x7fdd40073120 2024-09-11T23:22:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.343+0000 7fdd45400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdd400cf070 0x7fdd400cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.343+0000 7fdd45400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdd400cf070 0x7fdd400cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47406/0 (socket says 172.21.15.144:47406) 2024-09-11T23:22:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.343+0000 7fdd45400640 1 -- 172.21.15.144:0/16026605 learned_addr learned my addr 172.21.15.144:0/16026605 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:31.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.343+0000 7fdd45e00640 1 --1- 172.21.15.144:0/16026605 >> v1:172.21.15.144:6789/0 conn(0x7fdd4015c180 0x7fdd400cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37866/0 (socket says 172.21.15.144:37866) 2024-09-11T23:22:31.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.344+0000 7fdd46800640 1 --2- 172.21.15.144:0/16026605 >> v2:172.21.15.165:3300/0 conn(0x7fdd40073120 0x7fdd40073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:31.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.344+0000 7fdd45400640 1 -- 172.21.15.144:0/16026605 >> v2:172.21.15.165:3300/0 conn(0x7fdd40073120 msgr2=0x7fdd40073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:31.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.344+0000 7fdd45400640 1 --2- 172.21.15.144:0/16026605 >> v2:172.21.15.165:3300/0 conn(0x7fdd40073120 0x7fdd40073560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.344+0000 7fdd45400640 1 -- 172.21.15.144:0/16026605 >> v1:172.21.15.144:6789/0 conn(0x7fdd4015c180 legacy=0x7fdd400cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:31.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.344+0000 7fdd45400640 1 -- 172.21.15.144:0/16026605 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd40072c00 con 0x7fdd400cf070 2024-09-11T23:22:31.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.345+0000 7fdd45400640 1 --2- 172.21.15.144:0/16026605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd400cf070 0x7fdd400cf4e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fdd400cd070 tx=0x7fdd3002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed357588ec9cda0e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:31.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.345+0000 7fdd44a00640 1 -- 172.21.15.144:0/16026605 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30037070 con 0x7fdd400cf070 2024-09-11T23:22:31.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.345+0000 7fdd44a00640 1 -- 172.21.15.144:0/16026605 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd30032440 con 0x7fdd400cf070 2024-09-11T23:22:31.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.345+0000 7fdd44a00640 1 -- 172.21.15.144:0/16026605 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30032810 con 0x7fdd400cf070 2024-09-11T23:22:31.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.345+0000 7fdd48800640 1 -- 172.21.15.144:0/16026605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd400cf070 msgr2=0x7fdd400cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:31.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.345+0000 7fdd48800640 1 --2- 172.21.15.144:0/16026605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd400cf070 0x7fdd400cf4e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fdd400cd070 tx=0x7fdd3002a1e0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.346+0000 7fdd48800640 1 -- 172.21.15.144:0/16026605 shutdown_connections 2024-09-11T23:22:31.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.346+0000 7fdd48800640 1 --2- 172.21.15.144:0/16026605 >> v2:172.21.15.165:3300/0 conn(0x7fdd40073120 0x7fdd40073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.346+0000 7fdd48800640 1 --2- 172.21.15.144:0/16026605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd400cf070 0x7fdd400cf4e0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.346+0000 7fdd48800640 1 -- 172.21.15.144:0/16026605 >> 172.21.15.144:0/16026605 conn(0x7fdd40062cc0 msgr2=0x7fdd4006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:31.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.346+0000 7fdd48800640 1 -- 172.21.15.144:0/16026605 shutdown_connections 2024-09-11T23:22:31.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.346+0000 7fdd48800640 1 -- 172.21.15.144:0/16026605 wait complete. 2024-09-11T23:22:31.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.347+0000 7fdd48800640 1 Processor -- start 2024-09-11T23:22:31.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.347+0000 7fdd48800640 1 -- start start 2024-09-11T23:22:31.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.348+0000 7fdd48800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd40073120 0x7fdd40148e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:31.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.348+0000 7fdd48800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd400cf070 0x7fdd40158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:31.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.348+0000 7fdd48800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd4015c180 0x7fdd40158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:31.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.348+0000 7fdd48800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdd400722f0 con 0x7fdd40073120 2024-09-11T23:22:31.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.348+0000 7fdd48800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdd400ced00 con 0x7fdd400cf070 2024-09-11T23:22:31.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.348+0000 7fdd48800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4015c560 con 0x7fdd4015c180 2024-09-11T23:22:31.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.348+0000 7fdd45e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd40073120 0x7fdd40148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:31.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.349+0000 7fdd45e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd40073120 0x7fdd40148e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47412/0 (socket says 172.21.15.144:47412) 2024-09-11T23:22:31.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.349+0000 7fdd45e00640 1 -- 172.21.15.144:0/3175407437 learned_addr learned my addr 172.21.15.144:0/3175407437 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:31.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.349+0000 7fdd46800640 1 --2- 172.21.15.144:0/3175407437 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd4015c180 0x7fdd40158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:31.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.349+0000 7fdd45400640 1 --2- 172.21.15.144:0/3175407437 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd400cf070 0x7fdd40158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:31.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.349+0000 7fdd45e00640 1 -- 172.21.15.144:0/3175407437 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd4015c180 msgr2=0x7fdd40158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:31.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.349+0000 7fdd45e00640 1 --2- 172.21.15.144:0/3175407437 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd4015c180 0x7fdd40158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.349+0000 7fdd45e00640 1 -- 172.21.15.144:0/3175407437 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd400cf070 msgr2=0x7fdd40158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:31.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.349+0000 7fdd45e00640 1 --2- 172.21.15.144:0/3175407437 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd400cf070 0x7fdd40158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.349+0000 7fdd45e00640 1 -- 172.21.15.144:0/3175407437 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd40154670 con 0x7fdd40073120 2024-09-11T23:22:31.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.349+0000 7fdd45400640 1 --2- 172.21.15.144:0/3175407437 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd400cf070 0x7fdd40158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:31.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.349+0000 7fdd45e00640 1 --2- 172.21.15.144:0/3175407437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd40073120 0x7fdd40148e10 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400c3c0 tx=0x7fdd3400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:31.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.350+0000 7fdd3a000640 1 -- 172.21.15.144:0/3175407437 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd340074e0 con 0x7fdd40073120 2024-09-11T23:22:31.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.350+0000 7fdd3a000640 1 -- 172.21.15.144:0/3175407437 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd34007680 con 0x7fdd40073120 2024-09-11T23:22:31.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.350+0000 7fdd48800640 1 -- 172.21.15.144:0/3175407437 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd400b4a30 con 0x7fdd40073120 2024-09-11T23:22:31.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.350+0000 7fdd3a000640 1 -- 172.21.15.144:0/3175407437 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34004a00 con 0x7fdd40073120 2024-09-11T23:22:31.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.350+0000 7fdd48800640 1 -- 172.21.15.144:0/3175407437 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd400b4ff0 con 0x7fdd40073120 2024-09-11T23:22:31.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.351+0000 7fdd48800640 1 -- 172.21.15.144:0/3175407437 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd400cf4e0 con 0x7fdd40073120 2024-09-11T23:22:31.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.352+0000 7fdd3a000640 1 -- 172.21.15.144:0/3175407437 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fdd3401a020 con 0x7fdd40073120 2024-09-11T23:22:31.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.352+0000 7fdd3a000640 1 --2- 172.21.15.144:0/3175407437 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdd2406bf50 0x7fdd2406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:31.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.353+0000 7fdd3a000640 1 -- 172.21.15.144:0/3175407437 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fdd3408a6c0 con 0x7fdd40073120 2024-09-11T23:22:31.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.353+0000 7fdd45400640 1 --2- 172.21.15.144:0/3175407437 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdd2406bf50 0x7fdd2406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:31.354 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.354+0000 7fdd45400640 1 --2- 172.21.15.144:0/3175407437 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdd2406bf50 0x7fdd2406e410 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdd30034000 tx=0x7fdd3002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:31.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.357+0000 7fdd3a000640 1 -- 172.21.15.144:0/3175407437 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd34058f50 con 0x7fdd40073120 2024-09-11T23:22:31.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.532+0000 7fdd48800640 1 -- 172.21.15.144:0/3175407437 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd4015b760 con 0x7fdd40073120 2024-09-11T23:22:31.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.534+0000 7fdd3a000640 1 -- 172.21.15.144:0/3175407437 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+16757 (secure 0 0 0) 0x7fdd34058850 con 0x7fdd40073120 2024-09-11T23:22:31.534 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:31.534 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":82,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:22:30.193613+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:22:27.959542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-11T23:22:29.190371+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:22:31.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.536+0000 7fdd48800640 1 -- 172.21.15.144:0/3175407437 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdd2406bf50 msgr2=0x7fdd2406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:31.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.536+0000 7fdd48800640 1 --2- 172.21.15.144:0/3175407437 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdd2406bf50 0x7fdd2406e410 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdd30034000 tx=0x7fdd3002e000 comp rx=0 tx=0).stop 2024-09-11T23:22:31.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.536+0000 7fdd48800640 1 -- 172.21.15.144:0/3175407437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd40073120 msgr2=0x7fdd40148e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:31.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.536+0000 7fdd48800640 1 --2- 172.21.15.144:0/3175407437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd40073120 0x7fdd40148e10 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400c3c0 tx=0x7fdd3400c880 comp rx=0 tx=0).stop 2024-09-11T23:22:31.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.536+0000 7fdd48800640 1 -- 172.21.15.144:0/3175407437 shutdown_connections 2024-09-11T23:22:31.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.536+0000 7fdd48800640 1 --2- 172.21.15.144:0/3175407437 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdd2406bf50 0x7fdd2406e410 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.536+0000 7fdd48800640 1 --2- 172.21.15.144:0/3175407437 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd4015c180 0x7fdd40158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.536+0000 7fdd48800640 1 --2- 172.21.15.144:0/3175407437 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd400cf070 0x7fdd40158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.536+0000 7fdd48800640 1 --2- 172.21.15.144:0/3175407437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd40073120 0x7fdd40148e10 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.536+0000 7fdd48800640 1 -- 172.21.15.144:0/3175407437 >> 172.21.15.144:0/3175407437 conn(0x7fdd40062cc0 msgr2=0x7fdd400cf920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:31.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.536+0000 7fdd48800640 1 -- 172.21.15.144:0/3175407437 shutdown_connections 2024-09-11T23:22:31.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.536+0000 7fdd48800640 1 -- 172.21.15.144:0/3175407437 wait complete. 2024-09-11T23:22:31.552 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:22:31.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.709+0000 7f9900800640 1 Processor -- start 2024-09-11T23:22:31.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.709+0000 7f9900800640 1 -- start start 2024-09-11T23:22:31.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.711+0000 7f9900800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98f8158e50 0x7f98f80b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:31.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.711+0000 7f9900800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f98f815c370 0x7f98f806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:31.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.711+0000 7f9900800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f98f806ef60 0x7f98f815ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.711+0000 7f9900800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f98f806f3d0 con 0x7f98f806ef60 2024-09-11T23:22:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.711+0000 7f9900800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f98f80b43f0 con 0x7f98f815c370 2024-09-11T23:22:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.711+0000 7f9900800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f98f815c7d0 con 0x7f98f8158e50 2024-09-11T23:22:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.711+0000 7f98fe800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f98f806ef60 0x7f98f815ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.711+0000 7f98fe800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f98f806ef60 0x7f98f815ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47424/0 (socket says 172.21.15.144:47424) 2024-09-11T23:22:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.711+0000 7f98fe800640 1 -- 172.21.15.144:0/3888411578 learned_addr learned my addr 172.21.15.144:0/3888411578 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.711+0000 7f98fd400640 1 --2- 172.21.15.144:0/3888411578 >> v2:172.21.15.165:3300/0 conn(0x7f98f815c370 0x7f98f806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.711+0000 7f98fde00640 1 --2- 172.21.15.144:0/3888411578 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98f8158e50 0x7f98f80b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.711+0000 7f98fe800640 1 -- 172.21.15.144:0/3888411578 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98f8158e50 msgr2=0x7f98f80b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:31.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.711+0000 7f98fe800640 1 --2- 172.21.15.144:0/3888411578 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98f8158e50 0x7f98f80b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.711+0000 7f98fe800640 1 -- 172.21.15.144:0/3888411578 >> v2:172.21.15.165:3300/0 conn(0x7f98f815c370 msgr2=0x7f98f806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:31.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.711+0000 7f98fe800640 1 --2- 172.21.15.144:0/3888411578 >> v2:172.21.15.165:3300/0 conn(0x7f98f815c370 0x7f98f806ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.711+0000 7f98fe800640 1 -- 172.21.15.144:0/3888411578 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f80b3630 con 0x7f98f806ef60 2024-09-11T23:22:31.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.711+0000 7f98fde00640 1 --2- 172.21.15.144:0/3888411578 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98f8158e50 0x7f98f80b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:31.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.712+0000 7f98fe800640 1 --2- 172.21.15.144:0/3888411578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98f806ef60 0x7f98f815ee50 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f98f8069770 tx=0x7f98f402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc6ecf3fac4d08f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:31.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.713+0000 7f98fca00640 1 -- 172.21.15.144:0/3888411578 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f4036070 con 0x7f98f806ef60 2024-09-11T23:22:31.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.713+0000 7f98fca00640 1 -- 172.21.15.144:0/3888411578 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f4031600 con 0x7f98f806ef60 2024-09-11T23:22:31.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.713+0000 7f98fca00640 1 -- 172.21.15.144:0/3888411578 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f40319d0 con 0x7f98f806ef60 2024-09-11T23:22:31.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.713+0000 7f9900800640 1 -- 172.21.15.144:0/3888411578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98f806ef60 msgr2=0x7f98f815ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:31.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.713+0000 7f9900800640 1 --2- 172.21.15.144:0/3888411578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98f806ef60 0x7f98f815ee50 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f98f8069770 tx=0x7f98f402a6a0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.713+0000 7f9900800640 1 -- 172.21.15.144:0/3888411578 shutdown_connections 2024-09-11T23:22:31.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.713+0000 7f9900800640 1 --2- 172.21.15.144:0/3888411578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98f806ef60 0x7f98f815ee50 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.713+0000 7f9900800640 1 --2- 172.21.15.144:0/3888411578 >> v2:172.21.15.165:3300/0 conn(0x7f98f815c370 0x7f98f806ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.713+0000 7f9900800640 1 --2- 172.21.15.144:0/3888411578 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98f8158e50 0x7f98f80b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.713+0000 7f9900800640 1 -- 172.21.15.144:0/3888411578 >> 172.21.15.144:0/3888411578 conn(0x7f98f806bba0 msgr2=0x7f98f806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:31.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.713+0000 7f9900800640 1 -- 172.21.15.144:0/3888411578 shutdown_connections 2024-09-11T23:22:31.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.713+0000 7f9900800640 1 -- 172.21.15.144:0/3888411578 wait complete. 2024-09-11T23:22:31.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.715+0000 7f9900800640 1 Processor -- start 2024-09-11T23:22:31.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.715+0000 7f9900800640 1 -- start start 2024-09-11T23:22:31.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.716+0000 7f9900800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98f806ef60 0x7f98f8148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:31.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.716+0000 7f9900800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98f8158e50 0x7f98f80c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:31.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.716+0000 7f9900800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98f815c370 0x7f98f814e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:31.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.716+0000 7f9900800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f98f80b3ed0 con 0x7f98f806ef60 2024-09-11T23:22:31.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.716+0000 7f9900800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f98f80b3bf0 con 0x7f98f8158e50 2024-09-11T23:22:31.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.716+0000 7f9900800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f98f8159230 con 0x7f98f815c370 2024-09-11T23:22:31.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.716+0000 7f98fde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98f806ef60 0x7f98f8148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:31.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.716+0000 7f98fde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98f806ef60 0x7f98f8148ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47428/0 (socket says 172.21.15.144:47428) 2024-09-11T23:22:31.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.716+0000 7f98fde00640 1 -- 172.21.15.144:0/1905908368 learned_addr learned my addr 172.21.15.144:0/1905908368 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:31.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.716+0000 7f98fe800640 1 --2- 172.21.15.144:0/1905908368 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98f815c370 0x7f98f814e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:31.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.716+0000 7f98fd400640 1 --2- 172.21.15.144:0/1905908368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98f8158e50 0x7f98f80c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:31.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.717+0000 7f98fde00640 1 -- 172.21.15.144:0/1905908368 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98f815c370 msgr2=0x7f98f814e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:31.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.717+0000 7f98fde00640 1 --2- 172.21.15.144:0/1905908368 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98f815c370 0x7f98f814e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.717+0000 7f98fde00640 1 -- 172.21.15.144:0/1905908368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98f8158e50 msgr2=0x7f98f80c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:31.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.717+0000 7f98fde00640 1 --2- 172.21.15.144:0/1905908368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98f8158e50 0x7f98f80c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:31.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.717+0000 7f98fde00640 1 -- 172.21.15.144:0/1905908368 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f81f7c90 con 0x7f98f806ef60 2024-09-11T23:22:31.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.717+0000 7f98fe800640 1 --2- 172.21.15.144:0/1905908368 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98f815c370 0x7f98f814e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:31.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.717+0000 7f98fde00640 1 --2- 172.21.15.144:0/1905908368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98f806ef60 0x7f98f8148ad0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f98ec00e840 tx=0x7f98ec00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:31.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.717+0000 7f98f2000640 1 -- 172.21.15.144:0/1905908368 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ec00f040 con 0x7f98f806ef60 2024-09-11T23:22:31.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.717+0000 7f98f2000640 1 -- 172.21.15.144:0/1905908368 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98ec004030 con 0x7f98f806ef60 2024-09-11T23:22:31.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.717+0000 7f98f2000640 1 -- 172.21.15.144:0/1905908368 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ec004400 con 0x7f98f806ef60 2024-09-11T23:22:31.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.717+0000 7f9900800640 1 -- 172.21.15.144:0/1905908368 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f81f7f70 con 0x7f98f806ef60 2024-09-11T23:22:31.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.717+0000 7f9900800640 1 -- 172.21.15.144:0/1905908368 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f81f8530 con 0x7f98f806ef60 2024-09-11T23:22:31.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.719+0000 7f9900800640 1 -- 172.21.15.144:0/1905908368 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98f806ea20 con 0x7f98f806ef60 2024-09-11T23:22:31.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.719+0000 7f98f2000640 1 -- 172.21.15.144:0/1905908368 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f98ec00c6d0 con 0x7f98f806ef60 2024-09-11T23:22:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.720+0000 7f98f2000640 1 --2- 172.21.15.144:0/1905908368 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f98dc06bf50 0x7f98dc06e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.720+0000 7f98f2000640 1 -- 172.21.15.144:0/1905908368 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f98ec08adb0 con 0x7f98f806ef60 2024-09-11T23:22:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.721+0000 7f98fd400640 1 --2- 172.21.15.144:0/1905908368 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f98dc06bf50 0x7f98dc06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:31.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.721+0000 7f98fd400640 1 --2- 172.21.15.144:0/1905908368 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f98dc06bf50 0x7f98dc06e410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f98f8155f10 tx=0x7f98e8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:31.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.724+0000 7f98f2000640 1 -- 172.21.15.144:0/1905908368 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f98ec017020 con 0x7f98f806ef60 2024-09-11T23:22:31.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:31.936+0000 7f9900800640 1 -- 172.21.15.144:0/1905908368 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f98f81f8b80 con 0x7f98f806ef60 2024-09-11T23:22:32.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.800+0000 7f98f2000640 1 -- 172.21.15.144:0/1905908368 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v55) ==== 118+0+0 (secure 0 0 0) 0x7f98ec059540 con 0x7f98f806ef60 2024-09-11T23:22:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.803+0000 7f9900800640 1 -- 172.21.15.144:0/1905908368 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f98dc06bf50 msgr2=0x7f98dc06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.803+0000 7f9900800640 1 --2- 172.21.15.144:0/1905908368 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f98dc06bf50 0x7f98dc06e410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f98f8155f10 tx=0x7f98e8008040 comp rx=0 tx=0).stop 2024-09-11T23:22:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.803+0000 7f9900800640 1 -- 172.21.15.144:0/1905908368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98f806ef60 msgr2=0x7f98f8148ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.803+0000 7f9900800640 1 --2- 172.21.15.144:0/1905908368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98f806ef60 0x7f98f8148ad0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f98ec00e840 tx=0x7f98ec00ed00 comp rx=0 tx=0).stop 2024-09-11T23:22:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.803+0000 7f9900800640 1 -- 172.21.15.144:0/1905908368 shutdown_connections 2024-09-11T23:22:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.803+0000 7f9900800640 1 --2- 172.21.15.144:0/1905908368 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f98dc06bf50 0x7f98dc06e410 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.803+0000 7f9900800640 1 --2- 172.21.15.144:0/1905908368 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98f815c370 0x7f98f814e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.803+0000 7f9900800640 1 --2- 172.21.15.144:0/1905908368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98f8158e50 0x7f98f80c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.803+0000 7f9900800640 1 --2- 172.21.15.144:0/1905908368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98f806ef60 0x7f98f8148ad0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.803+0000 7f9900800640 1 -- 172.21.15.144:0/1905908368 >> 172.21.15.144:0/1905908368 conn(0x7f98f806bba0 msgr2=0x7f98f8072b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.803+0000 7f9900800640 1 -- 172.21.15.144:0/1905908368 shutdown_connections 2024-09-11T23:22:32.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.803+0000 7f9900800640 1 -- 172.21.15.144:0/1905908368 wait complete. 2024-09-11T23:22:32.822 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:22:32.822 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:22:32.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.983+0000 7fe8cd800640 1 Processor -- start 2024-09-11T23:22:32.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.983+0000 7fe8cd800640 1 -- start start 2024-09-11T23:22:32.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.984+0000 7fe8cd800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe8c815c560 0x7fe8c80716b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:32.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.985+0000 7fe8cd800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8c80cfcb0 0x7fe8c8160390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:32.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.985+0000 7fe8cd800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8c8073320 con 0x7fe8c806cbb0 2024-09-11T23:22:32.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.985+0000 7fe8cd800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe8c80700f0 con 0x7fe8c815c560 2024-09-11T23:22:32.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.985+0000 7fe8cd800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c815ff00 con 0x7fe8c80cfcb0 2024-09-11T23:22:32.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.985+0000 7fe8c7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe8c806cbb0 0x7fe8c806cf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37868/0 (socket says 172.21.15.144:37868) 2024-09-11T23:22:32.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.985+0000 7fe8c7e00640 1 -- 172.21.15.144:0/269677827 learned_addr learned my addr 172.21.15.144:0/269677827 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:32.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.985+0000 7fe8cce00640 1 --2- 172.21.15.144:0/269677827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8c80cfcb0 0x7fe8c8160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:32.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.985+0000 7fe8c7400640 1 --2- 172.21.15.144:0/269677827 >> v2:172.21.15.165:3300/0 conn(0x7fe8c815c560 0x7fe8c80716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:32.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.985+0000 7fe8c6a00640 1 -- 172.21.15.144:0/269677827 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3747661827 0 0) 0x7fe8c8073320 con 0x7fe8c806cbb0 2024-09-11T23:22:32.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.985+0000 7fe8c6a00640 1 -- 172.21.15.144:0/269677827 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8ac003520 con 0x7fe8c806cbb0 2024-09-11T23:22:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.986+0000 7fe8c6a00640 1 -- 172.21.15.144:0/269677827 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3409027190 0 0) 0x7fe8ac003520 con 0x7fe8c806cbb0 2024-09-11T23:22:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.986+0000 7fe8c6a00640 1 -- 172.21.15.144:0/269677827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8c80cfcb0 msgr2=0x7fe8c8160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.986+0000 7fe8c6a00640 1 --2- 172.21.15.144:0/269677827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8c80cfcb0 0x7fe8c8160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.986+0000 7fe8c6a00640 1 -- 172.21.15.144:0/269677827 >> v2:172.21.15.165:3300/0 conn(0x7fe8c815c560 msgr2=0x7fe8c80716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.986+0000 7fe8c6a00640 1 --2- 172.21.15.144:0/269677827 >> v2:172.21.15.165:3300/0 conn(0x7fe8c815c560 0x7fe8c80716b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.986+0000 7fe8c6a00640 1 -- 172.21.15.144:0/269677827 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c8073600 con 0x7fe8c806cbb0 2024-09-11T23:22:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.986+0000 7fe8c6a00640 1 -- 172.21.15.144:0/269677827 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fe8b8001670 con 0x7fe8c806cbb0 2024-09-11T23:22:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.986+0000 7fe8cce00640 1 --2- 172.21.15.144:0/269677827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8c80cfcb0 0x7fe8c8160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:22:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.986+0000 7fe8c6a00640 1 -- 172.21.15.144:0/269677827 >> v1:172.21.15.144:6789/0 conn(0x7fe8c806cbb0 legacy=0x7fe8c806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.986+0000 7fe8c6a00640 1 --2- 172.21.15.144:0/269677827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8ac0039b0 0x7fe8ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.986+0000 7fe8c6a00640 1 --2- 172.21.15.144:0/269677827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8ac0043a0 0x7fe8ac004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.986+0000 7fe8c6a00640 1 --2- 172.21.15.144:0/269677827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8ac004ef0 0x7fe8ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.986+0000 7fe8c6a00640 1 -- 172.21.15.144:0/269677827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c80700f0 con 0x7fe8ac004ef0 2024-09-11T23:22:32.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.986+0000 7fe8c6a00640 1 -- 172.21.15.144:0/269677827 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c815ff00 con 0x7fe8ac0043a0 2024-09-11T23:22:32.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.986+0000 7fe8c6a00640 1 -- 172.21.15.144:0/269677827 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8ac00bf00 con 0x7fe8ac0039b0 2024-09-11T23:22:32.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.986+0000 7fe8cce00640 1 --2- 172.21.15.144:0/269677827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8ac004ef0 0x7fe8ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:32.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.986+0000 7fe8c7e00640 1 --2- 172.21.15.144:0/269677827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8ac0039b0 0x7fe8ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:32.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.986+0000 7fe8c7400640 1 --2- 172.21.15.144:0/269677827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8ac0043a0 0x7fe8ac004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:32.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.986+0000 7fe8cce00640 1 -- 172.21.15.144:0/269677827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8ac0039b0 msgr2=0x7fe8ac003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:32.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.986+0000 7fe8cce00640 1 --2- 172.21.15.144:0/269677827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8ac0039b0 0x7fe8ac003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:32.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.987+0000 7fe8cce00640 1 -- 172.21.15.144:0/269677827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8ac0043a0 msgr2=0x7fe8ac004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:32.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.987+0000 7fe8cce00640 1 --2- 172.21.15.144:0/269677827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8ac0043a0 0x7fe8ac004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:32.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.987+0000 7fe8cce00640 1 -- 172.21.15.144:0/269677827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ac003520 con 0x7fe8ac004ef0 2024-09-11T23:22:32.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.987+0000 7fe8cce00640 1 --2- 172.21.15.144:0/269677827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8ac004ef0 0x7fe8ac00b9c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80d0090 tx=0x7fe8ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba02b1aba5b52bb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:32.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.988+0000 7fe8c6a00640 1 -- 172.21.15.144:0/269677827 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0009d60 con 0x7fe8ac004ef0 2024-09-11T23:22:32.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.988+0000 7fe8c6a00640 1 -- 172.21.15.144:0/269677827 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c0003c50 con 0x7fe8ac004ef0 2024-09-11T23:22:32.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.988+0000 7fe8c6a00640 1 -- 172.21.15.144:0/269677827 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0004030 con 0x7fe8ac004ef0 2024-09-11T23:22:32.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.988+0000 7fe8cd800640 1 -- 172.21.15.144:0/269677827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8ac004ef0 msgr2=0x7fe8ac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:32.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.988+0000 7fe8cd800640 1 --2- 172.21.15.144:0/269677827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8ac004ef0 0x7fe8ac00b9c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80d0090 tx=0x7fe8ac005830 comp rx=0 tx=0).stop 2024-09-11T23:22:32.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.988+0000 7fe8cce00640 1 -- 172.21.15.144:0/269677827 reap_dead start 2024-09-11T23:22:32.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.988+0000 7fe8cd800640 1 -- 172.21.15.144:0/269677827 shutdown_connections 2024-09-11T23:22:32.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.988+0000 7fe8cd800640 1 -- 172.21.15.144:0/269677827 >> 172.21.15.144:0/269677827 conn(0x7fe8c80cd780 msgr2=0x7fe8c80cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:32.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.988+0000 7fe8cd800640 1 -- 172.21.15.144:0/269677827 shutdown_connections 2024-09-11T23:22:32.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.988+0000 7fe8cd800640 1 -- 172.21.15.144:0/269677827 wait complete. 2024-09-11T23:22:32.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.990+0000 7fe8cd800640 1 Processor -- start 2024-09-11T23:22:32.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.990+0000 7fe8cd800640 1 -- start start 2024-09-11T23:22:32.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.991+0000 7fe8cd800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8ac004ef0 0x7fe8c8149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:32.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.991+0000 7fe8cd800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8c80b0a80 0x7fe8c8146290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:32.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.991+0000 7fe8cd800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8c80b2090 0x7fe8c80ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:32.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.991+0000 7fe8cd800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c806fe90 con 0x7fe8c80b2090 2024-09-11T23:22:32.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.991+0000 7fe8cd800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c806fd10 con 0x7fe8c80b0a80 2024-09-11T23:22:32.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.991+0000 7fe8cd800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c8071bf0 con 0x7fe8ac004ef0 2024-09-11T23:22:32.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.991+0000 7fe8cce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8c80b2090 0x7fe8c80ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:32.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.991+0000 7fe8cce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8c80b2090 0x7fe8c80ad690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47454/0 (socket says 172.21.15.144:47454) 2024-09-11T23:22:32.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.991+0000 7fe8cce00640 1 -- 172.21.15.144:0/3395525605 learned_addr learned my addr 172.21.15.144:0/3395525605 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:32.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.991+0000 7fe8c7e00640 1 --2- 172.21.15.144:0/3395525605 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8ac004ef0 0x7fe8c8149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:32.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.991+0000 7fe8c7400640 1 --2- 172.21.15.144:0/3395525605 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8c80b0a80 0x7fe8c8146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:32.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.992+0000 7fe8cce00640 1 -- 172.21.15.144:0/3395525605 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8ac004ef0 msgr2=0x7fe8c8149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:32.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.992+0000 7fe8cce00640 1 --2- 172.21.15.144:0/3395525605 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8ac004ef0 0x7fe8c8149590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:32.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.992+0000 7fe8cce00640 1 -- 172.21.15.144:0/3395525605 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8c80b0a80 msgr2=0x7fe8c8146290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:32.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.992+0000 7fe8cce00640 1 --2- 172.21.15.144:0/3395525605 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8c80b0a80 0x7fe8c8146290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:32.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.992+0000 7fe8cce00640 1 -- 172.21.15.144:0/3395525605 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c80b0ff0 con 0x7fe8c80b2090 2024-09-11T23:22:32.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.992+0000 7fe8cce00640 1 --2- 172.21.15.144:0/3395525605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8c80b2090 0x7fe8c80ad690 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000e2b0 tx=0x7fe8c0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:32.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.992+0000 7fe8bfe00640 1 -- 172.21.15.144:0/3395525605 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0009d60 con 0x7fe8c80b2090 2024-09-11T23:22:32.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.992+0000 7fe8bfe00640 1 -- 172.21.15.144:0/3395525605 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c0049070 con 0x7fe8c80b2090 2024-09-11T23:22:32.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.992+0000 7fe8cd800640 1 -- 172.21.15.144:0/3395525605 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c80b12d0 con 0x7fe8c80b2090 2024-09-11T23:22:32.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.992+0000 7fe8bfe00640 1 -- 172.21.15.144:0/3395525605 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0004240 con 0x7fe8c80b2090 2024-09-11T23:22:32.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.993+0000 7fe8cd800640 1 -- 172.21.15.144:0/3395525605 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c80b1890 con 0x7fe8c80b2090 2024-09-11T23:22:32.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.994+0000 7fe8cd800640 1 -- 172.21.15.144:0/3395525605 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c815a160 con 0x7fe8c80b2090 2024-09-11T23:22:32.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.994+0000 7fe8bfe00640 1 -- 172.21.15.144:0/3395525605 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fe8c0040040 con 0x7fe8c80b2090 2024-09-11T23:22:32.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.995+0000 7fe8bfe00640 1 --2- 172.21.15.144:0/3395525605 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe8a806bf50 0x7fe8a806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:32.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.995+0000 7fe8bfe00640 1 -- 172.21.15.144:0/3395525605 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fe8c0003a50 con 0x7fe8c80b2090 2024-09-11T23:22:32.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.996+0000 7fe8c7e00640 1 --2- 172.21.15.144:0/3395525605 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe8a806bf50 0x7fe8a806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:32.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.997+0000 7fe8c7e00640 1 --2- 172.21.15.144:0/3395525605 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe8a806bf50 0x7fe8a806e410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8000c00 tx=0x7fe8b80078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:32.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:32.999+0000 7fe8bfe00640 1 -- 172.21.15.144:0/3395525605 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe8c815a160 con 0x7fe8c80b2090 2024-09-11T23:22:33.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.208+0000 7fe8cd800640 1 -- 172.21.15.144:0/3395525605 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe8c80b00a0 con 0x7fe8c80b2090 2024-09-11T23:22:33.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.801+0000 7fe8bfe00640 1 -- 172.21.15.144:0/3395525605 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v56) ==== 122+0+0 (secure 0 0 0) 0x7fe8c007ecc0 con 0x7fe8c80b2090 2024-09-11T23:22:33.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.804+0000 7fe8cd800640 1 -- 172.21.15.144:0/3395525605 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe8a806bf50 msgr2=0x7fe8a806e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:33.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.804+0000 7fe8cd800640 1 --2- 172.21.15.144:0/3395525605 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe8a806bf50 0x7fe8a806e410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8000c00 tx=0x7fe8b80078f0 comp rx=0 tx=0).stop 2024-09-11T23:22:33.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.804+0000 7fe8cd800640 1 -- 172.21.15.144:0/3395525605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8c80b2090 msgr2=0x7fe8c80ad690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.804+0000 7fe8cd800640 1 --2- 172.21.15.144:0/3395525605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8c80b2090 0x7fe8c80ad690 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000e2b0 tx=0x7fe8c0009750 comp rx=0 tx=0).stop 2024-09-11T23:22:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.804+0000 7fe8cd800640 1 -- 172.21.15.144:0/3395525605 shutdown_connections 2024-09-11T23:22:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.804+0000 7fe8cd800640 1 --2- 172.21.15.144:0/3395525605 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe8a806bf50 0x7fe8a806e410 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.804+0000 7fe8cd800640 1 --2- 172.21.15.144:0/3395525605 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8c80b2090 0x7fe8c80ad690 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.804+0000 7fe8cd800640 1 --2- 172.21.15.144:0/3395525605 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8c80b0a80 0x7fe8c8146290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.804+0000 7fe8cd800640 1 --2- 172.21.15.144:0/3395525605 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8ac004ef0 0x7fe8c8149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.804+0000 7fe8cd800640 1 -- 172.21.15.144:0/3395525605 >> 172.21.15.144:0/3395525605 conn(0x7fe8c80cd780 msgr2=0x7fe8c8159a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.804+0000 7fe8cd800640 1 -- 172.21.15.144:0/3395525605 shutdown_connections 2024-09-11T23:22:33.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.805+0000 7fe8cd800640 1 -- 172.21.15.144:0/3395525605 wait complete. 2024-09-11T23:22:33.823 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:22:33.823 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:22:33.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.979+0000 7f4dfe200640 1 Processor -- start 2024-09-11T23:22:33.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.980+0000 7f4dfe200640 1 -- start start 2024-09-11T23:22:33.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.981+0000 7f4dfe200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df806e8f0 0x7f4df80cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:33.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.981+0000 7f4dfe200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4df80ce740 0x7f4df80b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:33.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.981+0000 7f4dfe200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4df80d0070 con 0x7f4df815e4f0 2024-09-11T23:22:33.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.981+0000 7f4dfe200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f4df80d12a0 con 0x7f4df80ce740 2024-09-11T23:22:33.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.981+0000 7f4dfe200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4df80d1580 con 0x7f4df806e8f0 2024-09-11T23:22:33.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.981+0000 7f4dfce00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4df815e4f0 0x7f4df806e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37874/0 (socket says 172.21.15.144:37874) 2024-09-11T23:22:33.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.981+0000 7f4dfce00640 1 -- 172.21.15.144:0/4152884524 learned_addr learned my addr 172.21.15.144:0/4152884524 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:33.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.981+0000 7f4dfd800640 1 --2- 172.21.15.144:0/4152884524 >> v2:172.21.15.144:3300/0 conn(0x7f4df80ce740 0x7f4df80b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:33.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.981+0000 7f4defe00640 1 --2- 172.21.15.144:0/4152884524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df806e8f0 0x7f4df80cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:33.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.982+0000 7f4dfd800640 1 -- 172.21.15.144:0/4152884524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df806e8f0 msgr2=0x7f4df80cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:33.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.982+0000 7f4df7e00640 1 -- 172.21.15.144:0/4152884524 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3525259575 0 0) 0x7f4df80d0070 con 0x7f4df815e4f0 2024-09-11T23:22:33.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.982+0000 7f4dfd800640 1 --2- 172.21.15.144:0/4152884524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df806e8f0 0x7f4df80cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:33.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.982+0000 7f4dfd800640 1 -- 172.21.15.144:0/4152884524 >> v1:172.21.15.144:6789/0 conn(0x7f4df815e4f0 legacy=0x7f4df806e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:33.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.982+0000 7f4dfd800640 1 -- 172.21.15.144:0/4152884524 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df80d1860 con 0x7f4df80ce740 2024-09-11T23:22:33.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.982+0000 7f4defe00640 1 --2- 172.21.15.144:0/4152884524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df806e8f0 0x7f4df80cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:33.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.983+0000 7f4dfd800640 1 --2- 172.21.15.144:0/4152884524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df80ce740 0x7f4df80b4890 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009d90 tx=0x7f4df002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48084e12125b17b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:33.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.983+0000 7f4df7e00640 1 -- 172.21.15.144:0/4152884524 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df0031600 con 0x7f4df80ce740 2024-09-11T23:22:33.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.983+0000 7f4df7e00640 1 -- 172.21.15.144:0/4152884524 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df00317a0 con 0x7f4df80ce740 2024-09-11T23:22:33.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.983+0000 7f4df7e00640 1 -- 172.21.15.144:0/4152884524 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df0031b70 con 0x7f4df80ce740 2024-09-11T23:22:33.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.983+0000 7f4dfe200640 1 -- 172.21.15.144:0/4152884524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df80ce740 msgr2=0x7f4df80b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:33.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.983+0000 7f4dfe200640 1 --2- 172.21.15.144:0/4152884524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df80ce740 0x7f4df80b4890 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009d90 tx=0x7f4df002a5d0 comp rx=0 tx=0).stop 2024-09-11T23:22:33.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.984+0000 7f4dfe200640 1 -- 172.21.15.144:0/4152884524 shutdown_connections 2024-09-11T23:22:33.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.984+0000 7f4dfe200640 1 --2- 172.21.15.144:0/4152884524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df80ce740 0x7f4df80b4890 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:33.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.984+0000 7f4dfe200640 1 --2- 172.21.15.144:0/4152884524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df806e8f0 0x7f4df80cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:33.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.984+0000 7f4dfe200640 1 -- 172.21.15.144:0/4152884524 >> 172.21.15.144:0/4152884524 conn(0x7f4df80b6700 msgr2=0x7f4df80b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:33.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.984+0000 7f4dfe200640 1 -- 172.21.15.144:0/4152884524 shutdown_connections 2024-09-11T23:22:33.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.984+0000 7f4dfe200640 1 -- 172.21.15.144:0/4152884524 wait complete. 2024-09-11T23:22:33.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.985+0000 7f4dfe200640 1 Processor -- start 2024-09-11T23:22:33.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.985+0000 7f4dfe200640 1 -- start start 2024-09-11T23:22:33.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.986+0000 7f4dfe200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df806e8f0 0x7f4df8073320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:33.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.986+0000 7f4dfe200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4df80ce740 0x7f4df81f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:33.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.986+0000 7f4dfe200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df815e4f0 0x7f4df81f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:33.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.986+0000 7f4dfe200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4df815e8d0 con 0x7f4df806e8f0 2024-09-11T23:22:33.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.986+0000 7f4dfe200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4df80b4dd0 con 0x7f4df80ce740 2024-09-11T23:22:33.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.986+0000 7f4dfe200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4df8072e90 con 0x7f4df815e4f0 2024-09-11T23:22:33.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.986+0000 7f4dfce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df806e8f0 0x7f4df8073320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:33.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.987+0000 7f4dfce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df806e8f0 0x7f4df8073320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:47472/0 (socket says 172.21.15.144:47472) 2024-09-11T23:22:33.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.987+0000 7f4dfce00640 1 -- 172.21.15.144:0/888759107 learned_addr learned my addr 172.21.15.144:0/888759107 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:33.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.987+0000 7f4defe00640 1 --2- 172.21.15.144:0/888759107 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4df80ce740 0x7f4df81f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:33.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.987+0000 7f4dfd800640 1 --2- 172.21.15.144:0/888759107 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df815e4f0 0x7f4df81f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:33.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.987+0000 7f4dfce00640 1 -- 172.21.15.144:0/888759107 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df815e4f0 msgr2=0x7f4df81f75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:33.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.987+0000 7f4dfce00640 1 --2- 172.21.15.144:0/888759107 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df815e4f0 0x7f4df81f75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:33.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.987+0000 7f4dfce00640 1 -- 172.21.15.144:0/888759107 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4df80ce740 msgr2=0x7f4df81f49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:33.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.987+0000 7f4dfce00640 1 --2- 172.21.15.144:0/888759107 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4df80ce740 0x7f4df81f49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:33.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.987+0000 7f4dfce00640 1 -- 172.21.15.144:0/888759107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df81f4f20 con 0x7f4df806e8f0 2024-09-11T23:22:33.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.987+0000 7f4dfce00640 1 --2- 172.21.15.144:0/888759107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df806e8f0 0x7f4df8073320 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f4de800c430 tx=0x7f4de800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:33.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.987+0000 7f4df5600640 1 -- 172.21.15.144:0/888759107 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de80074e0 con 0x7f4df806e8f0 2024-09-11T23:22:33.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.988+0000 7f4df5600640 1 -- 172.21.15.144:0/888759107 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de80047e0 con 0x7f4df806e8f0 2024-09-11T23:22:33.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.988+0000 7f4dfe200640 1 -- 172.21.15.144:0/888759107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df8072280 con 0x7f4df806e8f0 2024-09-11T23:22:33.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.988+0000 7f4df5600640 1 -- 172.21.15.144:0/888759107 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de8004bd0 con 0x7f4df806e8f0 2024-09-11T23:22:33.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.988+0000 7f4dfe200640 1 -- 172.21.15.144:0/888759107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df8072840 con 0x7f4df806e8f0 2024-09-11T23:22:33.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.989+0000 7f4dfe200640 1 -- 172.21.15.144:0/888759107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4df80b5cd0 con 0x7f4df806e8f0 2024-09-11T23:22:33.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.990+0000 7f4df5600640 1 -- 172.21.15.144:0/888759107 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f4de8011070 con 0x7f4df806e8f0 2024-09-11T23:22:33.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.990+0000 7f4df5600640 1 --2- 172.21.15.144:0/888759107 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4dd406bf50 0x7f4dd406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:33.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.990+0000 7f4df5600640 1 -- 172.21.15.144:0/888759107 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f4de808ac50 con 0x7f4df806e8f0 2024-09-11T23:22:33.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.991+0000 7f4defe00640 1 --2- 172.21.15.144:0/888759107 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4dd406bf50 0x7f4dd406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:33.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.992+0000 7f4defe00640 1 --2- 172.21.15.144:0/888759107 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4dd406bf50 0x7f4dd406e410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4df80ce680 tx=0x7f4de0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:33.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:33.995+0000 7f4df5600640 1 -- 172.21.15.144:0/888759107 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4de80594e0 con 0x7f4df806e8f0 2024-09-11T23:22:34.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.205+0000 7f4dfe200640 1 -- 172.21.15.144:0/888759107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4df80b49a0 con 0x7f4df806e8f0 2024-09-11T23:22:34.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.205+0000 7f4df5600640 1 -- 172.21.15.144:0/888759107 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5237 (secure 0 0 0) 0x7f4de8058de0 con 0x7f4df806e8f0 2024-09-11T23:22:34.206 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:34.206 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":56,"btime":"2024-09-11T23:22:33:800694+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/1166956695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1166956695},{"type":"v1","addr":"172.21.15.165:6834","nonce":1166956695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1078454545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1078454545},{"type":"v1","addr":"172.21.15.144:6834","nonce":1078454545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3966608439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3966608439},{"type":"v1","addr":"172.21.15.165:6835","nonce":3966608439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:22:30.193961+0000","modified":"2024-09-11T23:22:33.209255+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6522":{"gid":6522,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1018187462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":1018187462},{"type":"v1","addr":"172.21.15.144:6835","nonce":1018187462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6522,"qdb_cluster":[6522]},"id":6}]} 2024-09-11T23:22:34.206 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 56 2024-09-11T23:22:34.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.208+0000 7f4dfe200640 1 -- 172.21.15.144:0/888759107 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4dd406bf50 msgr2=0x7f4dd406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:34.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.208+0000 7f4dfe200640 1 --2- 172.21.15.144:0/888759107 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4dd406bf50 0x7f4dd406e410 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4df80ce680 tx=0x7f4de0008040 comp rx=0 tx=0).stop 2024-09-11T23:22:34.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.208+0000 7f4dfe200640 1 -- 172.21.15.144:0/888759107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df806e8f0 msgr2=0x7f4df8073320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:34.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.208+0000 7f4dfe200640 1 --2- 172.21.15.144:0/888759107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df806e8f0 0x7f4df8073320 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f4de800c430 tx=0x7f4de800c8f0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.208+0000 7f4dfe200640 1 -- 172.21.15.144:0/888759107 shutdown_connections 2024-09-11T23:22:34.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.208+0000 7f4dfe200640 1 --2- 172.21.15.144:0/888759107 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4dd406bf50 0x7f4dd406e410 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.208+0000 7f4dfe200640 1 --2- 172.21.15.144:0/888759107 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4df815e4f0 0x7f4df81f75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.208+0000 7f4dfe200640 1 --2- 172.21.15.144:0/888759107 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4df80ce740 0x7f4df81f49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.208+0000 7f4dfe200640 1 --2- 172.21.15.144:0/888759107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4df806e8f0 0x7f4df8073320 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.208+0000 7f4dfe200640 1 -- 172.21.15.144:0/888759107 >> 172.21.15.144:0/888759107 conn(0x7f4df80b6700 msgr2=0x7f4df815d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:34.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.208+0000 7f4dfe200640 1 -- 172.21.15.144:0/888759107 shutdown_connections 2024-09-11T23:22:34.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.208+0000 7f4dfe200640 1 -- 172.21.15.144:0/888759107 wait complete. 2024-09-11T23:22:34.223 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:22:34.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.376+0000 7f5431400640 1 Processor -- start 2024-09-11T23:22:34.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.377+0000 7f5431400640 1 -- start start 2024-09-11T23:22:34.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.378+0000 7f5431400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f542c0d02a0 0x7f542c0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:34.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.378+0000 7f5431400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f542c15ce80 0x7f542c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:34.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.378+0000 7f5431400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f542c0d0bc0 con 0x7f542c15ca40 2024-09-11T23:22:34.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.378+0000 7f5431400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f542c15d390 con 0x7f542c15ce80 2024-09-11T23:22:34.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.378+0000 7f5431400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f542c15d670 con 0x7f542c0d02a0 2024-09-11T23:22:34.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.378+0000 7f542a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f542c0d02a0 0x7f542c0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:34.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.378+0000 7f542b200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f542c15ce80 0x7f542c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:34.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.378+0000 7f542a800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f542c0d02a0 0x7f542c0d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:49522/0 (socket says 172.21.15.144:49522) 2024-09-11T23:22:34.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.378+0000 7f542a800640 1 -- 172.21.15.144:0/2301890118 learned_addr learned my addr 172.21.15.144:0/2301890118 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:34.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.378+0000 7f5421e00640 1 --1- 172.21.15.144:0/2301890118 >> v1:172.21.15.165:6789/0 conn(0x7f542c15ca40 0x7f542c15e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:59018/0 (socket says 172.21.15.144:59018) 2024-09-11T23:22:34.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.379+0000 7f542a800640 1 -- 172.21.15.144:0/2301890118 >> v2:172.21.15.165:3300/0 conn(0x7f542c15ce80 msgr2=0x7f542c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:34.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.379+0000 7f542a800640 1 --2- 172.21.15.144:0/2301890118 >> v2:172.21.15.165:3300/0 conn(0x7f542c15ce80 0x7f542c1594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.379+0000 7f542a800640 1 -- 172.21.15.144:0/2301890118 >> v1:172.21.15.165:6789/0 conn(0x7f542c15ca40 legacy=0x7f542c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:34.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.379+0000 7f542a800640 1 -- 172.21.15.144:0/2301890118 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542c15d950 con 0x7f542c0d02a0 2024-09-11T23:22:34.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.379+0000 7f5429e00640 1 -- 172.21.15.144:0/2301890118 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 720177098 0 0) 0x7f542c0d0bc0 con 0x7f542c15ca40 2024-09-11T23:22:34.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.379+0000 7f542b200640 1 --2- 172.21.15.144:0/2301890118 >> v2:172.21.15.165:3300/0 conn(0x7f542c15ce80 0x7f542c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:22:34.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.380+0000 7f542a800640 1 --2- 172.21.15.144:0/2301890118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f542c0d02a0 0x7f542c0d0680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f541c009870 tx=0x7f541c02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7a61ab175b04b8f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:34.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.380+0000 7f5429e00640 1 -- 172.21.15.144:0/2301890118 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c037070 con 0x7f542c0d02a0 2024-09-11T23:22:34.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.380+0000 7f5429e00640 1 -- 172.21.15.144:0/2301890118 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f541c032440 con 0x7f542c0d02a0 2024-09-11T23:22:34.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.380+0000 7f5429e00640 1 -- 172.21.15.144:0/2301890118 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c032810 con 0x7f542c0d02a0 2024-09-11T23:22:34.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.381+0000 7f5431400640 1 -- 172.21.15.144:0/2301890118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f542c0d02a0 msgr2=0x7f542c0d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:34.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.381+0000 7f5431400640 1 --2- 172.21.15.144:0/2301890118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f542c0d02a0 0x7f542c0d0680 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f541c009870 tx=0x7f541c02a1c0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.381+0000 7f5431400640 1 -- 172.21.15.144:0/2301890118 shutdown_connections 2024-09-11T23:22:34.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.381+0000 7f5431400640 1 --2- 172.21.15.144:0/2301890118 >> v2:172.21.15.165:3300/0 conn(0x7f542c15ce80 0x7f542c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.381+0000 7f5431400640 1 --2- 172.21.15.144:0/2301890118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f542c0d02a0 0x7f542c0d0680 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.381+0000 7f5431400640 1 -- 172.21.15.144:0/2301890118 >> 172.21.15.144:0/2301890118 conn(0x7f542c062cc0 msgr2=0x7f542c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:34.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.381+0000 7f5431400640 1 -- 172.21.15.144:0/2301890118 shutdown_connections 2024-09-11T23:22:34.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.381+0000 7f5431400640 1 -- 172.21.15.144:0/2301890118 wait complete. 2024-09-11T23:22:34.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.383+0000 7f5431400640 1 Processor -- start 2024-09-11T23:22:34.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.383+0000 7f5431400640 1 -- start start 2024-09-11T23:22:34.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.384+0000 7f5431400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f542c0d02a0 0x7f542c146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:34.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.384+0000 7f5431400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f542c15ca40 0x7f542c15bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:34.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.384+0000 7f5431400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f542c15ce80 0x7f542c1587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:34.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.384+0000 7f5431400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f542c15eb40 con 0x7f542c15ce80 2024-09-11T23:22:34.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.384+0000 7f5431400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f542c15df10 con 0x7f542c15ca40 2024-09-11T23:22:34.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.384+0000 7f5431400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f542c155b90 con 0x7f542c0d02a0 2024-09-11T23:22:34.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.384+0000 7f542b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f542c15ce80 0x7f542c1587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:34.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.384+0000 7f542b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f542c15ce80 0x7f542c1587b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59064/0 (socket says 172.21.15.144:59064) 2024-09-11T23:22:34.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.384+0000 7f542b200640 1 -- 172.21.15.144:0/2103923668 learned_addr learned my addr 172.21.15.144:0/2103923668 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:34.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.384+0000 7f542a800640 1 --2- 172.21.15.144:0/2103923668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f542c0d02a0 0x7f542c146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:34.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.384+0000 7f5421e00640 1 --2- 172.21.15.144:0/2103923668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f542c15ca40 0x7f542c15bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:34.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.384+0000 7f542b200640 1 -- 172.21.15.144:0/2103923668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f542c0d02a0 msgr2=0x7f542c146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:34.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.384+0000 7f542b200640 1 --2- 172.21.15.144:0/2103923668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f542c0d02a0 0x7f542c146c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.384+0000 7f542b200640 1 -- 172.21.15.144:0/2103923668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f542c15ca40 msgr2=0x7f542c15bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:34.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.384+0000 7f542b200640 1 --2- 172.21.15.144:0/2103923668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f542c15ca40 0x7f542c15bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.384+0000 7f542b200640 1 -- 172.21.15.144:0/2103923668 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542c157710 con 0x7f542c15ce80 2024-09-11T23:22:34.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.385+0000 7f542b200640 1 --2- 172.21.15.144:0/2103923668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f542c15ce80 0x7f542c1587b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f542400efc0 tx=0x7f5424009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:34.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.385+0000 7f5423400640 1 -- 172.21.15.144:0/2103923668 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5424018030 con 0x7f542c15ce80 2024-09-11T23:22:34.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.385+0000 7f5423400640 1 -- 172.21.15.144:0/2103923668 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f542400cde0 con 0x7f542c15ce80 2024-09-11T23:22:34.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.385+0000 7f5423400640 1 -- 172.21.15.144:0/2103923668 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5424003bb0 con 0x7f542c15ce80 2024-09-11T23:22:34.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.385+0000 7f5431400640 1 -- 172.21.15.144:0/2103923668 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f542c1579f0 con 0x7f542c15ce80 2024-09-11T23:22:34.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.385+0000 7f5431400640 1 -- 172.21.15.144:0/2103923668 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f542c157fb0 con 0x7f542c15ce80 2024-09-11T23:22:34.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.386+0000 7f5431400640 1 -- 172.21.15.144:0/2103923668 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f542c0b4790 con 0x7f542c15ce80 2024-09-11T23:22:34.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.387+0000 7f5423400640 1 -- 172.21.15.144:0/2103923668 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f542401b070 con 0x7f542c15ce80 2024-09-11T23:22:34.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.388+0000 7f5423400640 1 --2- 172.21.15.144:0/2103923668 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f540806bf50 0x7f540806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:34.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.388+0000 7f5423400640 1 -- 172.21.15.144:0/2103923668 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f542408bad0 con 0x7f542c15ce80 2024-09-11T23:22:34.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.388+0000 7f542a800640 1 --2- 172.21.15.144:0/2103923668 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f540806bf50 0x7f540806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:34.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.389+0000 7f542a800640 1 --2- 172.21.15.144:0/2103923668 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f540806bf50 0x7f540806e410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f541c034000 tx=0x7f541c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:34.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.392+0000 7f5423400640 1 -- 172.21.15.144:0/2103923668 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5424010040 con 0x7f542c15ce80 2024-09-11T23:22:34.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.567+0000 7f5431400640 1 -- 172.21.15.144:0/2103923668 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f542c158440 con 0x7f542c15ce80 2024-09-11T23:22:34.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.568+0000 7f5423400640 1 -- 172.21.15.144:0/2103923668 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+16744 (secure 0 0 0) 0x7f5424059b80 con 0x7f542c15ce80 2024-09-11T23:22:34.568 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:34.568 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":83,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:22:31.786522+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:22:27.959542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-11T23:22:29.190371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:22:34.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.570+0000 7f5431400640 1 -- 172.21.15.144:0/2103923668 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f540806bf50 msgr2=0x7f540806e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:34.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.570+0000 7f5431400640 1 --2- 172.21.15.144:0/2103923668 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f540806bf50 0x7f540806e410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f541c034000 tx=0x7f541c02e000 comp rx=0 tx=0).stop 2024-09-11T23:22:34.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.571+0000 7f5431400640 1 -- 172.21.15.144:0/2103923668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f542c15ce80 msgr2=0x7f542c1587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:34.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.571+0000 7f5431400640 1 --2- 172.21.15.144:0/2103923668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f542c15ce80 0x7f542c1587b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f542400efc0 tx=0x7f5424009f90 comp rx=0 tx=0).stop 2024-09-11T23:22:34.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.571+0000 7f5431400640 1 -- 172.21.15.144:0/2103923668 shutdown_connections 2024-09-11T23:22:34.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.571+0000 7f5431400640 1 --2- 172.21.15.144:0/2103923668 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f540806bf50 0x7f540806e410 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.571+0000 7f5431400640 1 --2- 172.21.15.144:0/2103923668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f542c15ce80 0x7f542c1587b0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.571+0000 7f5431400640 1 --2- 172.21.15.144:0/2103923668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f542c15ca40 0x7f542c15bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.571+0000 7f5431400640 1 --2- 172.21.15.144:0/2103923668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f542c0d02a0 0x7f542c146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.571+0000 7f5431400640 1 -- 172.21.15.144:0/2103923668 >> 172.21.15.144:0/2103923668 conn(0x7f542c062cc0 msgr2=0x7f542c0ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:34.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.571+0000 7f5431400640 1 -- 172.21.15.144:0/2103923668 shutdown_connections 2024-09-11T23:22:34.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.571+0000 7f5431400640 1 -- 172.21.15.144:0/2103923668 wait complete. 2024-09-11T23:22:34.587 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:22:34.587 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:22:34.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.740+0000 7f49c3800640 1 Processor -- start 2024-09-11T23:22:34.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.740+0000 7f49c3800640 1 -- start start 2024-09-11T23:22:34.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.741+0000 7f49c3800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f49bc162ad0 0x7f49bc06bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:34.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.741+0000 7f49c3800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f49bc06c0e0 0x7f49bc0b0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:34.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.741+0000 7f49c3800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49bc0b0380 con 0x7f49bc15e3f0 2024-09-11T23:22:34.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.741+0000 7f49c3800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f49bc0b30d0 con 0x7f49bc06c0e0 2024-09-11T23:22:34.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.741+0000 7f49c3800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f49bc06c540 con 0x7f49bc162ad0 2024-09-11T23:22:34.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.741+0000 7f49c0e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f49bc15e3f0 0x7f49bc15e7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49502/0 (socket says 172.21.15.144:49502) 2024-09-11T23:22:34.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.741+0000 7f49c0e00640 1 -- 172.21.15.144:0/2126701703 learned_addr learned my addr 172.21.15.144:0/2126701703 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:34.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.742+0000 7f49bbe00640 1 --2- 172.21.15.144:0/2126701703 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f49bc162ad0 0x7f49bc06bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:34.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.742+0000 7f49c1800640 1 --2- 172.21.15.144:0/2126701703 >> v2:172.21.15.165:3300/0 conn(0x7f49bc06c0e0 0x7f49bc0b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:34.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.742+0000 7f49bb400640 1 -- 172.21.15.144:0/2126701703 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1472234627 0 0) 0x7f49bc0b0380 con 0x7f49bc15e3f0 2024-09-11T23:22:34.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.742+0000 7f49bb400640 1 -- 172.21.15.144:0/2126701703 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49a4003520 con 0x7f49bc15e3f0 2024-09-11T23:22:34.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.742+0000 7f49bbe00640 1 -- 172.21.15.144:0/2126701703 >> v2:172.21.15.165:3300/0 conn(0x7f49bc06c0e0 msgr2=0x7f49bc0b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:34.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.742+0000 7f49bbe00640 1 --2- 172.21.15.144:0/2126701703 >> v2:172.21.15.165:3300/0 conn(0x7f49bc06c0e0 0x7f49bc0b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.742+0000 7f49bbe00640 1 -- 172.21.15.144:0/2126701703 >> v1:172.21.15.144:6789/0 conn(0x7f49bc15e3f0 legacy=0x7f49bc15e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:34.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.742+0000 7f49bbe00640 1 -- 172.21.15.144:0/2126701703 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49bc15f0e0 con 0x7f49bc162ad0 2024-09-11T23:22:34.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.742+0000 7f49c1800640 1 --2- 172.21.15.144:0/2126701703 >> v2:172.21.15.165:3300/0 conn(0x7f49bc06c0e0 0x7f49bc0b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:22:34.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.743+0000 7f49bbe00640 1 --2- 172.21.15.144:0/2126701703 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f49bc162ad0 0x7f49bc06bba0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f49a80097a0 tx=0x7f49a802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1287dc736115288c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:34.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.743+0000 7f49bb400640 1 -- 172.21.15.144:0/2126701703 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a8037070 con 0x7f49bc162ad0 2024-09-11T23:22:34.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.743+0000 7f49bb400640 1 -- 172.21.15.144:0/2126701703 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49a8032440 con 0x7f49bc162ad0 2024-09-11T23:22:34.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.743+0000 7f49bb400640 1 -- 172.21.15.144:0/2126701703 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a8032810 con 0x7f49bc162ad0 2024-09-11T23:22:34.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.744+0000 7f49c3800640 1 -- 172.21.15.144:0/2126701703 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f49bc162ad0 msgr2=0x7f49bc06bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:34.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.744+0000 7f49c3800640 1 --2- 172.21.15.144:0/2126701703 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f49bc162ad0 0x7f49bc06bba0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f49a80097a0 tx=0x7f49a802a180 comp rx=0 tx=0).stop 2024-09-11T23:22:34.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.744+0000 7f49c3800640 1 -- 172.21.15.144:0/2126701703 shutdown_connections 2024-09-11T23:22:34.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.744+0000 7f49c3800640 1 --2- 172.21.15.144:0/2126701703 >> v2:172.21.15.165:3300/0 conn(0x7f49bc06c0e0 0x7f49bc0b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.744+0000 7f49c3800640 1 --2- 172.21.15.144:0/2126701703 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f49bc162ad0 0x7f49bc06bba0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.744+0000 7f49c3800640 1 -- 172.21.15.144:0/2126701703 >> 172.21.15.144:0/2126701703 conn(0x7f49bc06ce90 msgr2=0x7f49bc06d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:34.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.744+0000 7f49c3800640 1 -- 172.21.15.144:0/2126701703 shutdown_connections 2024-09-11T23:22:34.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.744+0000 7f49c3800640 1 -- 172.21.15.144:0/2126701703 wait complete. 2024-09-11T23:22:34.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.746+0000 7f49c3800640 1 Processor -- start 2024-09-11T23:22:34.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.746+0000 7f49c3800640 1 -- start start 2024-09-11T23:22:34.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.747+0000 7f49c3800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f49bc06c0e0 0x7f49bc0cec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:34.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.747+0000 7f49c3800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49bc15e3f0 0x7f49bc1f4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:34.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.747+0000 7f49c3800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49bc162ad0 0x7f49bc0d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:34.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.747+0000 7f49c3800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f49bc162f40 con 0x7f49bc162ad0 2024-09-11T23:22:34.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.747+0000 7f49c3800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f49bc15f6a0 con 0x7f49bc15e3f0 2024-09-11T23:22:34.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.747+0000 7f49c3800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f49bc15f980 con 0x7f49bc06c0e0 2024-09-11T23:22:34.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.747+0000 7f49c1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49bc162ad0 0x7f49bc0d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:34.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.747+0000 7f49c1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49bc162ad0 0x7f49bc0d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59076/0 (socket says 172.21.15.144:59076) 2024-09-11T23:22:34.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.747+0000 7f49c1800640 1 -- 172.21.15.144:0/811093701 learned_addr learned my addr 172.21.15.144:0/811093701 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:34.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.747+0000 7f49c0e00640 1 --2- 172.21.15.144:0/811093701 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f49bc06c0e0 0x7f49bc0cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:34.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.747+0000 7f49bbe00640 1 --2- 172.21.15.144:0/811093701 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49bc15e3f0 0x7f49bc1f4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:34.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.747+0000 7f49c1800640 1 -- 172.21.15.144:0/811093701 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f49bc06c0e0 msgr2=0x7f49bc0cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:34.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.747+0000 7f49c1800640 1 --2- 172.21.15.144:0/811093701 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f49bc06c0e0 0x7f49bc0cec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.747+0000 7f49c1800640 1 -- 172.21.15.144:0/811093701 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49bc15e3f0 msgr2=0x7f49bc1f4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:34.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.747+0000 7f49c1800640 1 --2- 172.21.15.144:0/811093701 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49bc15e3f0 0x7f49bc1f4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.747+0000 7f49c1800640 1 -- 172.21.15.144:0/811093701 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49bc0d08e0 con 0x7f49bc162ad0 2024-09-11T23:22:34.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.748+0000 7f49c1800640 1 --2- 172.21.15.144:0/811093701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49bc162ad0 0x7f49bc0d03a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009f00 tx=0x7f49b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:34.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.748+0000 7f49b8c00640 1 -- 172.21.15.144:0/811093701 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b4018030 con 0x7f49bc162ad0 2024-09-11T23:22:34.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.748+0000 7f49b8c00640 1 -- 172.21.15.144:0/811093701 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b400ce50 con 0x7f49bc162ad0 2024-09-11T23:22:34.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.748+0000 7f49b8c00640 1 -- 172.21.15.144:0/811093701 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b4003bb0 con 0x7f49bc162ad0 2024-09-11T23:22:34.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.748+0000 7f49c3800640 1 -- 172.21.15.144:0/811093701 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49bc0cf300 con 0x7f49bc162ad0 2024-09-11T23:22:34.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.748+0000 7f49c3800640 1 -- 172.21.15.144:0/811093701 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49bc0cf8c0 con 0x7f49bc162ad0 2024-09-11T23:22:34.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.749+0000 7f49c3800640 1 -- 172.21.15.144:0/811093701 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49bc0b4890 con 0x7f49bc162ad0 2024-09-11T23:22:34.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.750+0000 7f49b8c00640 1 -- 172.21.15.144:0/811093701 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f49b4005d10 con 0x7f49bc162ad0 2024-09-11T23:22:34.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.751+0000 7f49b8c00640 1 --2- 172.21.15.144:0/811093701 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f499c06bf50 0x7f499c06e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:34.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.751+0000 7f49b8c00640 1 -- 172.21.15.144:0/811093701 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f49b408ba80 con 0x7f49bc162ad0 2024-09-11T23:22:34.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.751+0000 7f49c0e00640 1 --2- 172.21.15.144:0/811093701 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f499c06bf50 0x7f499c06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:34.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.752+0000 7f49c0e00640 1 --2- 172.21.15.144:0/811093701 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f499c06bf50 0x7f499c06e410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f49b0005880 tx=0x7f49b0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:34.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.755+0000 7f49b8c00640 1 -- 172.21.15.144:0/811093701 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f49bc0b4890 con 0x7f49bc162ad0 2024-09-11T23:22:34.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.929+0000 7f49c3800640 1 -- 172.21.15.144:0/811093701 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f49bc06bba0 con 0x7f499c06bf50 2024-09-11T23:22:34.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.937+0000 7f49b8c00640 1 -- 172.21.15.144:0/811093701 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246755 (secure 0 0 0) 0x7f49bc06bba0 con 0x7f499c06bf50 2024-09-11T23:22:34.939 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:34.941 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:22:34.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.941+0000 7f49c3800640 1 -- 172.21.15.144:0/811093701 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f499c06bf50 msgr2=0x7f499c06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:34.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.941+0000 7f49c3800640 1 --2- 172.21.15.144:0/811093701 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f499c06bf50 0x7f499c06e410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f49b0005880 tx=0x7f49b0009040 comp rx=0 tx=0).stop 2024-09-11T23:22:34.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.941+0000 7f49c3800640 1 -- 172.21.15.144:0/811093701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49bc162ad0 msgr2=0x7f49bc0d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:34.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.941+0000 7f49c3800640 1 --2- 172.21.15.144:0/811093701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49bc162ad0 0x7f49bc0d03a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009f00 tx=0x7f49b400c490 comp rx=0 tx=0).stop 2024-09-11T23:22:34.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.941+0000 7f49c3800640 1 -- 172.21.15.144:0/811093701 shutdown_connections 2024-09-11T23:22:34.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.941+0000 7f49c3800640 1 --2- 172.21.15.144:0/811093701 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f499c06bf50 0x7f499c06e410 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.941+0000 7f49c3800640 1 --2- 172.21.15.144:0/811093701 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49bc162ad0 0x7f49bc0d03a0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.941+0000 7f49c3800640 1 --2- 172.21.15.144:0/811093701 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49bc15e3f0 0x7f49bc1f4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.941+0000 7f49c3800640 1 --2- 172.21.15.144:0/811093701 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f49bc06c0e0 0x7f49bc0cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:34.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.941+0000 7f49c3800640 1 -- 172.21.15.144:0/811093701 >> 172.21.15.144:0/811093701 conn(0x7f49bc06ce90 msgr2=0x7f49bc0b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:34.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.941+0000 7f49c3800640 1 -- 172.21.15.144:0/811093701 shutdown_connections 2024-09-11T23:22:34.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:34.941+0000 7f49c3800640 1 -- 172.21.15.144:0/811093701 wait complete. 2024-09-11T23:22:34.957 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-11T23:22:34.715087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258356,"kb_used_data":8828,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716364,"statfs":{"total":773094113280,"available":772829556736,"internally_reserved":0,"allocated":9039872,"data_stored":4516429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.948157"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.788382+0000","last_change":"2024-09-11T23:22:29.788382+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.788382+0000","last_undegraded":"2024-09-11T23:22:29.788382+0000","last_fullsized":"2024-09-11T23:22:29.788382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.786400+0000","last_change":"2024-09-11T23:22:29.786400+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.786400+0000","last_undegraded":"2024-09-11T23:22:29.786400+0000","last_fullsized":"2024-09-11T23:22:29.786400+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.785377+0000","last_change":"2024-09-11T23:22:29.785377+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.785377+0000","last_undegraded":"2024-09-11T23:22:29.785377+0000","last_fullsized":"2024-09-11T23:22:29.785377+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783871+0000","last_change":"2024-09-11T23:22:29.783871+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783871+0000","last_undegraded":"2024-09-11T23:22:29.783871+0000","last_fullsized":"2024-09-11T23:22:29.783871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782095+0000","last_change":"2024-09-11T23:22:29.782095+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782095+0000","last_undegraded":"2024-09-11T23:22:29.782095+0000","last_fullsized":"2024-09-11T23:22:29.782095+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.779411+0000","last_change":"2024-09-11T23:22:29.779411+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.779411+0000","last_undegraded":"2024-09-11T23:22:29.779411+0000","last_fullsized":"2024-09-11T23:22:29.779411+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781715+0000","last_change":"2024-09-11T23:22:29.781715+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781715+0000","last_undegraded":"2024-09-11T23:22:29.781715+0000","last_fullsized":"2024-09-11T23:22:29.781715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.777866+0000","last_change":"2024-09-11T23:22:29.777866+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.777866+0000","last_undegraded":"2024-09-11T23:22:29.777866+0000","last_fullsized":"2024-09-11T23:22:29.777866+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.779067+0000","last_change":"2024-09-11T23:22:29.779067+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.779067+0000","last_undegraded":"2024-09-11T23:22:29.779067+0000","last_fullsized":"2024-09-11T23:22:29.779067+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.784817+0000","last_change":"2024-09-11T23:22:29.784817+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.784817+0000","last_undegraded":"2024-09-11T23:22:29.784817+0000","last_fullsized":"2024-09-11T23:22:29.784817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.786000+0000","last_change":"2024-09-11T23:22:29.786000+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.786000+0000","last_undegraded":"2024-09-11T23:22:29.786000+0000","last_fullsized":"2024-09-11T23:22:29.786000+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.790174+0000","last_change":"2024-09-11T23:22:29.790174+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.790174+0000","last_undegraded":"2024-09-11T23:22:29.790174+0000","last_fullsized":"2024-09-11T23:22:29.790174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.785141+0000","last_change":"2024-09-11T23:22:29.785141+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.785141+0000","last_undegraded":"2024-09-11T23:22:29.785141+0000","last_fullsized":"2024-09-11T23:22:29.785141+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.784120+0000","last_change":"2024-09-11T23:22:29.784120+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.784120+0000","last_undegraded":"2024-09-11T23:22:29.784120+0000","last_fullsized":"2024-09-11T23:22:29.784120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.786586+0000","last_change":"2024-09-11T23:22:29.786586+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.786586+0000","last_undegraded":"2024-09-11T23:22:29.786586+0000","last_fullsized":"2024-09-11T23:22:29.786586+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783492+0000","last_change":"2024-09-11T23:22:29.783492+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783492+0000","last_undegraded":"2024-09-11T23:22:29.783492+0000","last_fullsized":"2024-09-11T23:22:29.783492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781621+0000","last_change":"2024-09-11T23:22:29.781621+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781621+0000","last_undegraded":"2024-09-11T23:22:29.781621+0000","last_fullsized":"2024-09-11T23:22:29.781621+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783714+0000","last_change":"2024-09-11T23:22:29.783714+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783714+0000","last_undegraded":"2024-09-11T23:22:29.783714+0000","last_fullsized":"2024-09-11T23:22:29.783714+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780149+0000","last_change":"2024-09-11T23:22:29.780149+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780149+0000","last_undegraded":"2024-09-11T23:22:29.780149+0000","last_fullsized":"2024-09-11T23:22:29.780149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783439+0000","last_change":"2024-09-11T23:22:29.783439+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783439+0000","last_undegraded":"2024-09-11T23:22:29.783439+0000","last_fullsized":"2024-09-11T23:22:29.783439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782157+0000","last_change":"2024-09-11T23:22:29.782157+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782157+0000","last_undegraded":"2024-09-11T23:22:29.782157+0000","last_fullsized":"2024-09-11T23:22:29.782157+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.784771+0000","last_change":"2024-09-11T23:22:29.784771+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.784771+0000","last_undegraded":"2024-09-11T23:22:29.784771+0000","last_fullsized":"2024-09-11T23:22:29.784771+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783276+0000","last_change":"2024-09-11T23:22:29.783276+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783276+0000","last_undegraded":"2024-09-11T23:22:29.783276+0000","last_fullsized":"2024-09-11T23:22:29.783276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782348+0000","last_change":"2024-09-11T23:22:29.782348+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782348+0000","last_undegraded":"2024-09-11T23:22:29.782348+0000","last_fullsized":"2024-09-11T23:22:29.782348+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781742+0000","last_change":"2024-09-11T23:22:29.781742+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781742+0000","last_undegraded":"2024-09-11T23:22:29.781742+0000","last_fullsized":"2024-09-11T23:22:29.781742+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.788359+0000","last_change":"2024-09-11T23:22:29.788359+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.788359+0000","last_undegraded":"2024-09-11T23:22:29.788359+0000","last_fullsized":"2024-09-11T23:22:29.788359+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783819+0000","last_change":"2024-09-11T23:22:29.783819+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783819+0000","last_undegraded":"2024-09-11T23:22:29.783819+0000","last_fullsized":"2024-09-11T23:22:29.783819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.789270+0000","last_change":"2024-09-11T23:22:29.789270+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.789270+0000","last_undegraded":"2024-09-11T23:22:29.789270+0000","last_fullsized":"2024-09-11T23:22:29.789270+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781384+0000","last_change":"2024-09-11T23:22:29.781384+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781384+0000","last_undegraded":"2024-09-11T23:22:29.781384+0000","last_fullsized":"2024-09-11T23:22:29.781384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781243+0000","last_change":"2024-09-11T23:22:29.781243+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781243+0000","last_undegraded":"2024-09-11T23:22:29.781243+0000","last_fullsized":"2024-09-11T23:22:29.781243+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780707+0000","last_change":"2024-09-11T23:22:29.780707+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780707+0000","last_undegraded":"2024-09-11T23:22:29.780707+0000","last_fullsized":"2024-09-11T23:22:29.780707+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782038+0000","last_change":"2024-09-11T23:22:29.782038+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782038+0000","last_undegraded":"2024-09-11T23:22:29.782038+0000","last_fullsized":"2024-09-11T23:22:29.782038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782012+0000","last_change":"2024-09-11T23:22:29.782012+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782012+0000","last_undegraded":"2024-09-11T23:22:29.782012+0000","last_fullsized":"2024-09-11T23:22:29.782012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.802180+0000","last_change":"2024-09-11T23:22:29.801202+0000","last_active":"2024-09-11T23:22:29.802180+0000","last_peered":"2024-09-11T23:22:29.802180+0000","last_clean":"2024-09-11T23:22:29.802180+0000","last_became_active":"2024-09-11T23:22:29.800931+0000","last_became_peered":"2024-09-11T23:22:29.800931+0000","last_unstale":"2024-09-11T23:22:29.802180+0000","last_undegraded":"2024-09-11T23:22:29.802180+0000","last_fullsized":"2024-09-11T23:22:29.802180+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:33.581201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.787990+0000","last_change":"2024-09-11T23:22:29.787990+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.787990+0000","last_undegraded":"2024-09-11T23:22:29.787990+0000","last_fullsized":"2024-09-11T23:22:29.787990+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.795398+0000","last_change":"2024-09-11T23:22:29.791510+0000","last_active":"2024-09-11T23:22:29.795398+0000","last_peered":"2024-09-11T23:22:29.795398+0000","last_clean":"2024-09-11T23:22:29.795398+0000","last_became_active":"2024-09-11T23:22:29.791216+0000","last_became_peered":"2024-09-11T23:22:29.791216+0000","last_unstale":"2024-09-11T23:22:29.795398+0000","last_undegraded":"2024-09-11T23:22:29.795398+0000","last_fullsized":"2024-09-11T23:22:29.795398+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:04:07.998110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.787174+0000","last_change":"2024-09-11T23:22:29.787174+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.787174+0000","last_undegraded":"2024-09-11T23:22:29.787174+0000","last_fullsized":"2024-09-11T23:22:29.787174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801045+0000","last_change":"2024-09-11T23:22:29.797262+0000","last_active":"2024-09-11T23:22:29.801045+0000","last_peered":"2024-09-11T23:22:29.801045+0000","last_clean":"2024-09-11T23:22:29.801045+0000","last_became_active":"2024-09-11T23:22:29.796852+0000","last_became_peered":"2024-09-11T23:22:29.796852+0000","last_unstale":"2024-09-11T23:22:29.801045+0000","last_undegraded":"2024-09-11T23:22:29.801045+0000","last_fullsized":"2024-09-11T23:22:29.801045+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:45.746458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.784903+0000","last_change":"2024-09-11T23:22:29.784903+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.784903+0000","last_undegraded":"2024-09-11T23:22:29.784903+0000","last_fullsized":"2024-09-11T23:22:29.784903+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801050+0000","last_change":"2024-09-11T23:22:29.798952+0000","last_active":"2024-09-11T23:22:29.801050+0000","last_peered":"2024-09-11T23:22:29.801050+0000","last_clean":"2024-09-11T23:22:29.801050+0000","last_became_active":"2024-09-11T23:22:29.798584+0000","last_became_peered":"2024-09-11T23:22:29.798584+0000","last_unstale":"2024-09-11T23:22:29.801050+0000","last_undegraded":"2024-09-11T23:22:29.801050+0000","last_fullsized":"2024-09-11T23:22:29.801050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:32.388072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780839+0000","last_change":"2024-09-11T23:22:29.780839+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780839+0000","last_undegraded":"2024-09-11T23:22:29.780839+0000","last_fullsized":"2024-09-11T23:22:29.780839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.795695+0000","last_change":"2024-09-11T23:22:29.791619+0000","last_active":"2024-09-11T23:22:29.795695+0000","last_peered":"2024-09-11T23:22:29.795695+0000","last_clean":"2024-09-11T23:22:29.795695+0000","last_became_active":"2024-09-11T23:22:29.791285+0000","last_became_peered":"2024-09-11T23:22:29.791285+0000","last_unstale":"2024-09-11T23:22:29.795695+0000","last_undegraded":"2024-09-11T23:22:29.795695+0000","last_fullsized":"2024-09-11T23:22:29.795695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:18.720260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781627+0000","last_change":"2024-09-11T23:22:29.781627+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781627+0000","last_undegraded":"2024-09-11T23:22:29.781627+0000","last_fullsized":"2024-09-11T23:22:29.781627+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800715+0000","last_change":"2024-09-11T23:22:29.799472+0000","last_active":"2024-09-11T23:22:29.800715+0000","last_peered":"2024-09-11T23:22:29.800715+0000","last_clean":"2024-09-11T23:22:29.800715+0000","last_became_active":"2024-09-11T23:22:29.799108+0000","last_became_peered":"2024-09-11T23:22:29.799108+0000","last_unstale":"2024-09-11T23:22:29.800715+0000","last_undegraded":"2024-09-11T23:22:29.800715+0000","last_fullsized":"2024-09-11T23:22:29.800715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:11.066365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.788039+0000","last_change":"2024-09-11T23:22:29.788039+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.788039+0000","last_undegraded":"2024-09-11T23:22:29.788039+0000","last_fullsized":"2024-09-11T23:22:29.788039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800415+0000","last_change":"2024-09-11T23:22:29.794917+0000","last_active":"2024-09-11T23:22:29.800415+0000","last_peered":"2024-09-11T23:22:29.800415+0000","last_clean":"2024-09-11T23:22:29.800415+0000","last_became_active":"2024-09-11T23:22:29.794644+0000","last_became_peered":"2024-09-11T23:22:29.794644+0000","last_unstale":"2024-09-11T23:22:29.800415+0000","last_undegraded":"2024-09-11T23:22:29.800415+0000","last_fullsized":"2024-09-11T23:22:29.800415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:11.157987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783457+0000","last_change":"2024-09-11T23:22:29.783457+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783457+0000","last_undegraded":"2024-09-11T23:22:29.783457+0000","last_fullsized":"2024-09-11T23:22:29.783457+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.795631+0000","last_change":"2024-09-11T23:22:29.791904+0000","last_active":"2024-09-11T23:22:29.795631+0000","last_peered":"2024-09-11T23:22:29.795631+0000","last_clean":"2024-09-11T23:22:29.795631+0000","last_became_active":"2024-09-11T23:22:29.791075+0000","last_became_peered":"2024-09-11T23:22:29.791075+0000","last_unstale":"2024-09-11T23:22:29.795631+0000","last_undegraded":"2024-09-11T23:22:29.795631+0000","last_fullsized":"2024-09-11T23:22:29.795631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:16.262655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.785519+0000","last_change":"2024-09-11T23:22:29.785519+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.785519+0000","last_undegraded":"2024-09-11T23:22:29.785519+0000","last_fullsized":"2024-09-11T23:22:29.785519+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801364+0000","last_change":"2024-09-11T23:22:29.800033+0000","last_active":"2024-09-11T23:22:29.801364+0000","last_peered":"2024-09-11T23:22:29.801364+0000","last_clean":"2024-09-11T23:22:29.801364+0000","last_became_active":"2024-09-11T23:22:29.799648+0000","last_became_peered":"2024-09-11T23:22:29.799648+0000","last_unstale":"2024-09-11T23:22:29.801364+0000","last_undegraded":"2024-09-11T23:22:29.801364+0000","last_fullsized":"2024-09-11T23:22:29.801364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:18.891456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.777915+0000","last_change":"2024-09-11T23:22:29.777915+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.777915+0000","last_undegraded":"2024-09-11T23:22:29.777915+0000","last_fullsized":"2024-09-11T23:22:29.777915+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.799704+0000","last_change":"2024-09-11T23:22:29.797980+0000","last_active":"2024-09-11T23:22:29.799704+0000","last_peered":"2024-09-11T23:22:29.799704+0000","last_clean":"2024-09-11T23:22:29.799704+0000","last_became_active":"2024-09-11T23:22:29.797613+0000","last_became_peered":"2024-09-11T23:22:29.797613+0000","last_unstale":"2024-09-11T23:22:29.799704+0000","last_undegraded":"2024-09-11T23:22:29.799704+0000","last_fullsized":"2024-09-11T23:22:29.799704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:57.423778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780370+0000","last_change":"2024-09-11T23:22:29.780370+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780370+0000","last_undegraded":"2024-09-11T23:22:29.780370+0000","last_fullsized":"2024-09-11T23:22:29.780370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.798784+0000","last_change":"2024-09-11T23:22:29.796274+0000","last_active":"2024-09-11T23:22:29.798784+0000","last_peered":"2024-09-11T23:22:29.798784+0000","last_clean":"2024-09-11T23:22:29.798784+0000","last_became_active":"2024-09-11T23:22:29.796007+0000","last_became_peered":"2024-09-11T23:22:29.796007+0000","last_unstale":"2024-09-11T23:22:29.798784+0000","last_undegraded":"2024-09-11T23:22:29.798784+0000","last_fullsized":"2024-09-11T23:22:29.798784+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:00.496690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783358+0000","last_change":"2024-09-11T23:22:29.783358+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783358+0000","last_undegraded":"2024-09-11T23:22:29.783358+0000","last_fullsized":"2024-09-11T23:22:29.783358+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.795958+0000","last_change":"2024-09-11T23:22:29.794370+0000","last_active":"2024-09-11T23:22:29.795958+0000","last_peered":"2024-09-11T23:22:29.795958+0000","last_clean":"2024-09-11T23:22:29.795958+0000","last_became_active":"2024-09-11T23:22:29.794076+0000","last_became_peered":"2024-09-11T23:22:29.794076+0000","last_unstale":"2024-09-11T23:22:29.795958+0000","last_undegraded":"2024-09-11T23:22:29.795958+0000","last_fullsized":"2024-09-11T23:22:29.795958+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:56.009289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780157+0000","last_change":"2024-09-11T23:22:29.780157+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780157+0000","last_undegraded":"2024-09-11T23:22:29.780157+0000","last_fullsized":"2024-09-11T23:22:29.780157+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.790304+0000","last_change":"2024-09-11T23:22:29.788351+0000","last_active":"2024-09-11T23:22:29.790304+0000","last_peered":"2024-09-11T23:22:29.790304+0000","last_clean":"2024-09-11T23:22:29.790304+0000","last_became_active":"2024-09-11T23:22:29.788085+0000","last_became_peered":"2024-09-11T23:22:29.788085+0000","last_unstale":"2024-09-11T23:22:29.790304+0000","last_undegraded":"2024-09-11T23:22:29.790304+0000","last_fullsized":"2024-09-11T23:22:29.790304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:59.256338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.784634+0000","last_change":"2024-09-11T23:22:29.784634+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.784634+0000","last_undegraded":"2024-09-11T23:22:29.784634+0000","last_fullsized":"2024-09-11T23:22:29.784634+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801471+0000","last_change":"2024-09-11T23:22:29.793974+0000","last_active":"2024-09-11T23:22:29.801471+0000","last_peered":"2024-09-11T23:22:29.801471+0000","last_clean":"2024-09-11T23:22:29.801471+0000","last_became_active":"2024-09-11T23:22:29.793537+0000","last_became_peered":"2024-09-11T23:22:29.793537+0000","last_unstale":"2024-09-11T23:22:29.801471+0000","last_undegraded":"2024-09-11T23:22:29.801471+0000","last_fullsized":"2024-09-11T23:22:29.801471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:29.665243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.779771+0000","last_change":"2024-09-11T23:22:29.779771+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.779771+0000","last_undegraded":"2024-09-11T23:22:29.779771+0000","last_fullsized":"2024-09-11T23:22:29.779771+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.793226+0000","last_change":"2024-09-11T23:22:29.786056+0000","last_active":"2024-09-11T23:22:29.793226+0000","last_peered":"2024-09-11T23:22:29.793226+0000","last_clean":"2024-09-11T23:22:29.793226+0000","last_became_active":"2024-09-11T23:22:29.785767+0000","last_became_peered":"2024-09-11T23:22:29.785767+0000","last_unstale":"2024-09-11T23:22:29.793226+0000","last_undegraded":"2024-09-11T23:22:29.793226+0000","last_fullsized":"2024-09-11T23:22:29.793226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:53.387875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780406+0000","last_change":"2024-09-11T23:22:29.780406+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780406+0000","last_undegraded":"2024-09-11T23:22:29.780406+0000","last_fullsized":"2024-09-11T23:22:29.780406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800328+0000","last_change":"2024-09-11T23:22:29.795359+0000","last_active":"2024-09-11T23:22:29.800328+0000","last_peered":"2024-09-11T23:22:29.800328+0000","last_clean":"2024-09-11T23:22:29.800328+0000","last_became_active":"2024-09-11T23:22:29.794120+0000","last_became_peered":"2024-09-11T23:22:29.794120+0000","last_unstale":"2024-09-11T23:22:29.800328+0000","last_undegraded":"2024-09-11T23:22:29.800328+0000","last_fullsized":"2024-09-11T23:22:29.800328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:43.513789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.787891+0000","last_change":"2024-09-11T23:22:29.787891+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.787891+0000","last_undegraded":"2024-09-11T23:22:29.787891+0000","last_fullsized":"2024-09-11T23:22:29.787891+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.798059+0000","last_change":"2024-09-11T23:22:29.795929+0000","last_active":"2024-09-11T23:22:29.798059+0000","last_peered":"2024-09-11T23:22:29.798059+0000","last_clean":"2024-09-11T23:22:29.798059+0000","last_became_active":"2024-09-11T23:22:29.795634+0000","last_became_peered":"2024-09-11T23:22:29.795634+0000","last_unstale":"2024-09-11T23:22:29.798059+0000","last_undegraded":"2024-09-11T23:22:29.798059+0000","last_fullsized":"2024-09-11T23:22:29.798059+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:18.720260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.787577+0000","last_change":"2024-09-11T23:22:29.787577+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.787577+0000","last_undegraded":"2024-09-11T23:22:29.787577+0000","last_fullsized":"2024-09-11T23:22:29.787577+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.795140+0000","last_change":"2024-09-11T23:22:29.793636+0000","last_active":"2024-09-11T23:22:29.795140+0000","last_peered":"2024-09-11T23:22:29.795140+0000","last_clean":"2024-09-11T23:22:29.795140+0000","last_became_active":"2024-09-11T23:22:29.793346+0000","last_became_peered":"2024-09-11T23:22:29.793346+0000","last_unstale":"2024-09-11T23:22:29.795140+0000","last_undegraded":"2024-09-11T23:22:29.795140+0000","last_fullsized":"2024-09-11T23:22:29.795140+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:56.009289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782650+0000","last_change":"2024-09-11T23:22:29.782650+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782650+0000","last_undegraded":"2024-09-11T23:22:29.782650+0000","last_fullsized":"2024-09-11T23:22:29.782650+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800356+0000","last_change":"2024-09-11T23:22:29.795529+0000","last_active":"2024-09-11T23:22:29.800356+0000","last_peered":"2024-09-11T23:22:29.800356+0000","last_clean":"2024-09-11T23:22:29.800356+0000","last_became_active":"2024-09-11T23:22:29.794606+0000","last_became_peered":"2024-09-11T23:22:29.794606+0000","last_unstale":"2024-09-11T23:22:29.800356+0000","last_undegraded":"2024-09-11T23:22:29.800356+0000","last_fullsized":"2024-09-11T23:22:29.800356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:33.678630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783064+0000","last_change":"2024-09-11T23:22:29.783064+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783064+0000","last_undegraded":"2024-09-11T23:22:29.783064+0000","last_fullsized":"2024-09-11T23:22:29.783064+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.806279+0000","last_change":"2024-09-11T23:22:29.801734+0000","last_active":"2024-09-11T23:22:29.806279+0000","last_peered":"2024-09-11T23:22:29.806279+0000","last_clean":"2024-09-11T23:22:29.806279+0000","last_became_active":"2024-09-11T23:22:29.800988+0000","last_became_peered":"2024-09-11T23:22:29.800988+0000","last_unstale":"2024-09-11T23:22:29.806279+0000","last_undegraded":"2024-09-11T23:22:29.806279+0000","last_fullsized":"2024-09-11T23:22:29.806279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:15.181135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.778271+0000","last_change":"2024-09-11T23:22:29.778271+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.778271+0000","last_undegraded":"2024-09-11T23:22:29.778271+0000","last_fullsized":"2024-09-11T23:22:29.778271+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800477+0000","last_change":"2024-09-11T23:22:29.790559+0000","last_active":"2024-09-11T23:22:29.800477+0000","last_peered":"2024-09-11T23:22:29.800477+0000","last_clean":"2024-09-11T23:22:29.800477+0000","last_became_active":"2024-09-11T23:22:29.790290+0000","last_became_peered":"2024-09-11T23:22:29.790290+0000","last_unstale":"2024-09-11T23:22:29.800477+0000","last_undegraded":"2024-09-11T23:22:29.800477+0000","last_fullsized":"2024-09-11T23:22:29.800477+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:04.100862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781929+0000","last_change":"2024-09-11T23:22:29.781929+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781929+0000","last_undegraded":"2024-09-11T23:22:29.781929+0000","last_fullsized":"2024-09-11T23:22:29.781929+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.803052+0000","last_change":"2024-09-11T23:22:29.797708+0000","last_active":"2024-09-11T23:22:29.803052+0000","last_peered":"2024-09-11T23:22:29.803052+0000","last_clean":"2024-09-11T23:22:29.803052+0000","last_became_active":"2024-09-11T23:22:29.796870+0000","last_became_peered":"2024-09-11T23:22:29.796870+0000","last_unstale":"2024-09-11T23:22:29.803052+0000","last_undegraded":"2024-09-11T23:22:29.803052+0000","last_fullsized":"2024-09-11T23:22:29.803052+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:14.567731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.777997+0000","last_change":"2024-09-11T23:22:29.777997+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.777997+0000","last_undegraded":"2024-09-11T23:22:29.777997+0000","last_fullsized":"2024-09-11T23:22:29.777997+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.809100+0000","last_change":"2024-09-11T23:22:29.803838+0000","last_active":"2024-09-11T23:22:29.809100+0000","last_peered":"2024-09-11T23:22:29.809100+0000","last_clean":"2024-09-11T23:22:29.809100+0000","last_became_active":"2024-09-11T23:22:29.803457+0000","last_became_peered":"2024-09-11T23:22:29.803457+0000","last_unstale":"2024-09-11T23:22:29.809100+0000","last_undegraded":"2024-09-11T23:22:29.809100+0000","last_fullsized":"2024-09-11T23:22:29.809100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:30.624506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781127+0000","last_change":"2024-09-11T23:22:29.781127+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781127+0000","last_undegraded":"2024-09-11T23:22:29.781127+0000","last_fullsized":"2024-09-11T23:22:29.781127+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801544+0000","last_change":"2024-09-11T23:22:29.796232+0000","last_active":"2024-09-11T23:22:29.801544+0000","last_peered":"2024-09-11T23:22:29.801544+0000","last_clean":"2024-09-11T23:22:29.801544+0000","last_became_active":"2024-09-11T23:22:29.795936+0000","last_became_peered":"2024-09-11T23:22:29.795936+0000","last_unstale":"2024-09-11T23:22:29.801544+0000","last_undegraded":"2024-09-11T23:22:29.801544+0000","last_fullsized":"2024-09-11T23:22:29.801544+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:51.278777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.789036+0000","last_change":"2024-09-11T23:22:29.789036+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.789036+0000","last_undegraded":"2024-09-11T23:22:29.789036+0000","last_fullsized":"2024-09-11T23:22:29.789036+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.791258+0000","last_change":"2024-09-11T23:22:29.787519+0000","last_active":"2024-09-11T23:22:29.791258+0000","last_peered":"2024-09-11T23:22:29.791258+0000","last_clean":"2024-09-11T23:22:29.791258+0000","last_became_active":"2024-09-11T23:22:29.787222+0000","last_became_peered":"2024-09-11T23:22:29.787222+0000","last_unstale":"2024-09-11T23:22:29.791258+0000","last_undegraded":"2024-09-11T23:22:29.791258+0000","last_fullsized":"2024-09-11T23:22:29.791258+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:40.941861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.786702+0000","last_change":"2024-09-11T23:22:29.786702+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.786702+0000","last_undegraded":"2024-09-11T23:22:29.786702+0000","last_fullsized":"2024-09-11T23:22:29.786702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800628+0000","last_change":"2024-09-11T23:22:29.798913+0000","last_active":"2024-09-11T23:22:29.800628+0000","last_peered":"2024-09-11T23:22:29.800628+0000","last_clean":"2024-09-11T23:22:29.800628+0000","last_became_active":"2024-09-11T23:22:29.798524+0000","last_became_peered":"2024-09-11T23:22:29.798524+0000","last_unstale":"2024-09-11T23:22:29.800628+0000","last_undegraded":"2024-09-11T23:22:29.800628+0000","last_fullsized":"2024-09-11T23:22:29.800628+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:11.066365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780298+0000","last_change":"2024-09-11T23:22:29.780298+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780298+0000","last_undegraded":"2024-09-11T23:22:29.780298+0000","last_fullsized":"2024-09-11T23:22:29.780298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.798015+0000","last_change":"2024-09-11T23:22:29.795594+0000","last_active":"2024-09-11T23:22:29.798015+0000","last_peered":"2024-09-11T23:22:29.798015+0000","last_clean":"2024-09-11T23:22:29.798015+0000","last_became_active":"2024-09-11T23:22:29.795192+0000","last_became_peered":"2024-09-11T23:22:29.795192+0000","last_unstale":"2024-09-11T23:22:29.798015+0000","last_undegraded":"2024-09-11T23:22:29.798015+0000","last_fullsized":"2024-09-11T23:22:29.798015+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:04:07.998110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.778714+0000","last_change":"2024-09-11T23:22:29.778714+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.778714+0000","last_undegraded":"2024-09-11T23:22:29.778714+0000","last_fullsized":"2024-09-11T23:22:29.778714+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800276+0000","last_change":"2024-09-11T23:22:29.795182+0000","last_active":"2024-09-11T23:22:29.800276+0000","last_peered":"2024-09-11T23:22:29.800276+0000","last_clean":"2024-09-11T23:22:29.800276+0000","last_became_active":"2024-09-11T23:22:29.794863+0000","last_became_peered":"2024-09-11T23:22:29.794863+0000","last_unstale":"2024-09-11T23:22:29.800276+0000","last_undegraded":"2024-09-11T23:22:29.800276+0000","last_fullsized":"2024-09-11T23:22:29.800276+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:23.886099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780002+0000","last_change":"2024-09-11T23:22:29.780002+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780002+0000","last_undegraded":"2024-09-11T23:22:29.780002+0000","last_fullsized":"2024-09-11T23:22:29.780002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.797531+0000","last_change":"2024-09-11T23:22:29.793776+0000","last_active":"2024-09-11T23:22:29.797531+0000","last_peered":"2024-09-11T23:22:29.797531+0000","last_clean":"2024-09-11T23:22:29.797531+0000","last_became_active":"2024-09-11T23:22:29.793426+0000","last_became_peered":"2024-09-11T23:22:29.793426+0000","last_unstale":"2024-09-11T23:22:29.797531+0000","last_undegraded":"2024-09-11T23:22:29.797531+0000","last_fullsized":"2024-09-11T23:22:29.797531+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:00.496690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.785567+0000","last_change":"2024-09-11T23:22:29.785567+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.785567+0000","last_undegraded":"2024-09-11T23:22:29.785567+0000","last_fullsized":"2024-09-11T23:22:29.785567+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801184+0000","last_change":"2024-09-11T23:22:29.800003+0000","last_active":"2024-09-11T23:22:29.801184+0000","last_peered":"2024-09-11T23:22:29.801184+0000","last_clean":"2024-09-11T23:22:29.801184+0000","last_became_active":"2024-09-11T23:22:29.799292+0000","last_became_peered":"2024-09-11T23:22:29.799292+0000","last_unstale":"2024-09-11T23:22:29.801184+0000","last_undegraded":"2024-09-11T23:22:29.801184+0000","last_fullsized":"2024-09-11T23:22:29.801184+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:06.176294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782668+0000","last_change":"2024-09-11T23:22:29.782668+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782668+0000","last_undegraded":"2024-09-11T23:22:29.782668+0000","last_fullsized":"2024-09-11T23:22:29.782668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.798925+0000","last_change":"2024-09-11T23:22:29.794909+0000","last_active":"2024-09-11T23:22:29.798925+0000","last_peered":"2024-09-11T23:22:29.798925+0000","last_clean":"2024-09-11T23:22:29.798925+0000","last_became_active":"2024-09-11T23:22:29.794633+0000","last_became_peered":"2024-09-11T23:22:29.794633+0000","last_unstale":"2024-09-11T23:22:29.798925+0000","last_undegraded":"2024-09-11T23:22:29.798925+0000","last_fullsized":"2024-09-11T23:22:29.798925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:57.423778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.778998+0000","last_change":"2024-09-11T23:22:29.778998+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.778998+0000","last_undegraded":"2024-09-11T23:22:29.778998+0000","last_fullsized":"2024-09-11T23:22:29.778998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.797333+0000","last_change":"2024-09-11T23:22:29.794603+0000","last_active":"2024-09-11T23:22:29.797333+0000","last_peered":"2024-09-11T23:22:29.797333+0000","last_clean":"2024-09-11T23:22:29.797333+0000","last_became_active":"2024-09-11T23:22:29.794225+0000","last_became_peered":"2024-09-11T23:22:29.794225+0000","last_unstale":"2024-09-11T23:22:29.797333+0000","last_undegraded":"2024-09-11T23:22:29.797333+0000","last_fullsized":"2024-09-11T23:22:29.797333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:35.708584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":320,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.788260+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:22:29.788260+0000","last_peered":"2024-09-11T23:22:29.788260+0000","last_clean":"2024-09-11T23:22:29.788260+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:22:29.788260+0000","last_undegraded":"2024-09-11T23:22:29.788260+0000","last_fullsized":"2024-09-11T23:22:29.788260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476797,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1576960,"data_stored":1008114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476796,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":417746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476795,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":417746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476795,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":983040,"data_stored":417746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542204,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":417746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542204,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":417746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509500,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":970752,"data_stored":411471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509500,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1576960,"data_stored":1008114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:22:34.962 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:22:35.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.153+0000 7fdf8fe00640 1 Processor -- start 2024-09-11T23:22:35.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.153+0000 7fdf8fe00640 1 -- start start 2024-09-11T23:22:35.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.154+0000 7fdf8fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fdf900b4b10 0x7fdf900b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:35.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.154+0000 7fdf8fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdf90162bb0 0x7fdf9015eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:35.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.154+0000 7fdf8fe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf90163040 con 0x7fdf900ae8e0 2024-09-11T23:22:35.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.154+0000 7fdf8fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fdf9015f040 con 0x7fdf90162bb0 2024-09-11T23:22:35.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.154+0000 7fdf8fe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fdf9015f2a0 con 0x7fdf900b4b10 2024-09-11T23:22:35.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.154+0000 7fdf8e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdf90162bb0 0x7fdf9015eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:35.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.155+0000 7fdf8e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdf90162bb0 0x7fdf9015eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59084/0 (socket says 172.21.15.144:59084) 2024-09-11T23:22:35.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.155+0000 7fdf8e000640 1 -- 172.21.15.144:0/3746639776 learned_addr learned my addr 172.21.15.144:0/3746639776 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:35.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.155+0000 7fdf8f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdf900ae8e0 0x7fdf900b37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49514/0 (socket says 172.21.15.144:49514) 2024-09-11T23:22:35.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.155+0000 7fdf8ea00640 1 --2- 172.21.15.144:0/3746639776 >> v2:172.21.15.165:3300/0 conn(0x7fdf900b4b10 0x7fdf900b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:35.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.155+0000 7fdf8e000640 1 -- 172.21.15.144:0/3746639776 >> v2:172.21.15.165:3300/0 conn(0x7fdf900b4b10 msgr2=0x7fdf900b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:35.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.155+0000 7fdf8e000640 1 --2- 172.21.15.144:0/3746639776 >> v2:172.21.15.165:3300/0 conn(0x7fdf900b4b10 0x7fdf900b4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.155+0000 7fdf8e000640 1 -- 172.21.15.144:0/3746639776 >> v1:172.21.15.144:6789/0 conn(0x7fdf900ae8e0 legacy=0x7fdf900b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:35.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.155+0000 7fdf8e000640 1 -- 172.21.15.144:0/3746639776 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9015f580 con 0x7fdf90162bb0 2024-09-11T23:22:35.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.155+0000 7fdf8ea00640 1 --2- 172.21.15.144:0/3746639776 >> v2:172.21.15.165:3300/0 conn(0x7fdf900b4b10 0x7fdf900b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:35.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.155+0000 7fdf8d600640 1 -- 172.21.15.144:0/3746639776 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 774149592 0 0) 0x7fdf88001490 con 0x7fdf900ae8e0 2024-09-11T23:22:35.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.156+0000 7fdf8e000640 1 --2- 172.21.15.144:0/3746639776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf90162bb0 0x7fdf9015eb00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fdf900d10a0 tx=0x7fdf7c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63eeea98252018e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:35.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.156+0000 7fdf8d600640 1 -- 172.21.15.144:0/3746639776 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c037070 con 0x7fdf90162bb0 2024-09-11T23:22:35.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.156+0000 7fdf8d600640 1 -- 172.21.15.144:0/3746639776 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf7c032440 con 0x7fdf90162bb0 2024-09-11T23:22:35.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.156+0000 7fdf8d600640 1 -- 172.21.15.144:0/3746639776 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c032810 con 0x7fdf90162bb0 2024-09-11T23:22:35.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.157+0000 7fdf8fe00640 1 -- 172.21.15.144:0/3746639776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf90162bb0 msgr2=0x7fdf9015eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:35.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.157+0000 7fdf8fe00640 1 --2- 172.21.15.144:0/3746639776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf90162bb0 0x7fdf9015eb00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fdf900d10a0 tx=0x7fdf7c02a1e0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.157+0000 7fdf8fe00640 1 -- 172.21.15.144:0/3746639776 shutdown_connections 2024-09-11T23:22:35.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.157+0000 7fdf8fe00640 1 --2- 172.21.15.144:0/3746639776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf90162bb0 0x7fdf9015eb00 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.157+0000 7fdf8fe00640 1 --2- 172.21.15.144:0/3746639776 >> v2:172.21.15.165:3300/0 conn(0x7fdf900b4b10 0x7fdf900b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.157+0000 7fdf8fe00640 1 -- 172.21.15.144:0/3746639776 >> 172.21.15.144:0/3746639776 conn(0x7fdf9006e910 msgr2=0x7fdf9006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:35.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.157+0000 7fdf8fe00640 1 -- 172.21.15.144:0/3746639776 shutdown_connections 2024-09-11T23:22:35.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.157+0000 7fdf8fe00640 1 -- 172.21.15.144:0/3746639776 wait complete. 2024-09-11T23:22:35.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.159+0000 7fdf8fe00640 1 Processor -- start 2024-09-11T23:22:35.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.159+0000 7fdf8fe00640 1 -- start start 2024-09-11T23:22:35.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.160+0000 7fdf8fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf900ae8e0 0x7fdf900b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:35.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.160+0000 7fdf8fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf900b4b10 0x7fdf900c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:35.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.160+0000 7fdf8fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf90162bb0 0x7fdf900c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:35.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.160+0000 7fdf8fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdf900b3ee0 con 0x7fdf90162bb0 2024-09-11T23:22:35.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.160+0000 7fdf8fe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdf900b32b0 con 0x7fdf900b4b10 2024-09-11T23:22:35.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.160+0000 7fdf8fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdf900b4060 con 0x7fdf900ae8e0 2024-09-11T23:22:35.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.160+0000 7fdf8f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf90162bb0 0x7fdf900c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:35.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.160+0000 7fdf8f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf90162bb0 0x7fdf900c50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59094/0 (socket says 172.21.15.144:59094) 2024-09-11T23:22:35.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.160+0000 7fdf8f400640 1 -- 172.21.15.144:0/3922145147 learned_addr learned my addr 172.21.15.144:0/3922145147 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:35.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.160+0000 7fdf8ea00640 1 --2- 172.21.15.144:0/3922145147 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf900ae8e0 0x7fdf900b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:35.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.160+0000 7fdf8e000640 1 --2- 172.21.15.144:0/3922145147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf900b4b10 0x7fdf900c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:35.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.160+0000 7fdf8f400640 1 -- 172.21.15.144:0/3922145147 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf900ae8e0 msgr2=0x7fdf900b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:35.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.160+0000 7fdf8f400640 1 --2- 172.21.15.144:0/3922145147 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf900ae8e0 0x7fdf900b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.160+0000 7fdf8f400640 1 -- 172.21.15.144:0/3922145147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf900b4b10 msgr2=0x7fdf900c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:35.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.160+0000 7fdf8f400640 1 --2- 172.21.15.144:0/3922145147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf900b4b10 0x7fdf900c7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.160+0000 7fdf8f400640 1 -- 172.21.15.144:0/3922145147 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf900b0dc0 con 0x7fdf90162bb0 2024-09-11T23:22:35.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.160+0000 7fdf8ea00640 1 --2- 172.21.15.144:0/3922145147 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf900ae8e0 0x7fdf900b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:22:35.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.161+0000 7fdf8f400640 1 --2- 172.21.15.144:0/3922145147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf90162bb0 0x7fdf900c50a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fdf8800c700 tx=0x7fdf8800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:35.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.161+0000 7fdf86a00640 1 -- 172.21.15.144:0/3922145147 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf88018070 con 0x7fdf90162bb0 2024-09-11T23:22:35.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.161+0000 7fdf86a00640 1 -- 172.21.15.144:0/3922145147 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf8800ce10 con 0x7fdf90162bb0 2024-09-11T23:22:35.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.161+0000 7fdf8fe00640 1 -- 172.21.15.144:0/3922145147 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf900b1350 con 0x7fdf90162bb0 2024-09-11T23:22:35.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.161+0000 7fdf86a00640 1 -- 172.21.15.144:0/3922145147 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8800a860 con 0x7fdf90162bb0 2024-09-11T23:22:35.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.161+0000 7fdf8fe00640 1 -- 172.21.15.144:0/3922145147 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf900b1910 con 0x7fdf90162bb0 2024-09-11T23:22:35.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.162+0000 7fdf8fe00640 1 -- 172.21.15.144:0/3922145147 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf9015eb00 con 0x7fdf90162bb0 2024-09-11T23:22:35.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.163+0000 7fdf86a00640 1 -- 172.21.15.144:0/3922145147 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fdf8801b070 con 0x7fdf90162bb0 2024-09-11T23:22:35.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.164+0000 7fdf86a00640 1 --2- 172.21.15.144:0/3922145147 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdf7006bf50 0x7fdf7006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:35.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.164+0000 7fdf86a00640 1 -- 172.21.15.144:0/3922145147 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fdf8808a5f0 con 0x7fdf90162bb0 2024-09-11T23:22:35.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.164+0000 7fdf8ea00640 1 --2- 172.21.15.144:0/3922145147 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdf7006bf50 0x7fdf7006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:35.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.165+0000 7fdf8ea00640 1 --2- 172.21.15.144:0/3922145147 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdf7006bf50 0x7fdf7006e410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdf901f7470 tx=0x7fdf80008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:35.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.168+0000 7fdf86a00640 1 -- 172.21.15.144:0/3922145147 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdf90163040 con 0x7fdf90162bb0 2024-09-11T23:22:35.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.340+0000 7fdf8fe00640 1 -- 172.21.15.144:0/3922145147 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdf900b1190 con 0x7fdf7006bf50 2024-09-11T23:22:35.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.347+0000 7fdf86a00640 1 -- 172.21.15.144:0/3922145147 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246755 (secure 0 0 0) 0x7fdf80009100 con 0x7fdf7006bf50 2024-09-11T23:22:35.349 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:35.351 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:22:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.351+0000 7fdf8fe00640 1 -- 172.21.15.144:0/3922145147 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdf7006bf50 msgr2=0x7fdf7006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.351+0000 7fdf8fe00640 1 --2- 172.21.15.144:0/3922145147 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdf7006bf50 0x7fdf7006e410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdf901f7470 tx=0x7fdf80008040 comp rx=0 tx=0).stop 2024-09-11T23:22:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.351+0000 7fdf8fe00640 1 -- 172.21.15.144:0/3922145147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf90162bb0 msgr2=0x7fdf900c50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.351+0000 7fdf8fe00640 1 --2- 172.21.15.144:0/3922145147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf90162bb0 0x7fdf900c50a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fdf8800c700 tx=0x7fdf8800cbc0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.351+0000 7fdf8fe00640 1 -- 172.21.15.144:0/3922145147 shutdown_connections 2024-09-11T23:22:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.351+0000 7fdf8fe00640 1 --2- 172.21.15.144:0/3922145147 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdf7006bf50 0x7fdf7006e410 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.351+0000 7fdf8fe00640 1 --2- 172.21.15.144:0/3922145147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf90162bb0 0x7fdf900c50a0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.352 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.351+0000 7fdf8fe00640 1 --2- 172.21.15.144:0/3922145147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf900b4b10 0x7fdf900c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.351+0000 7fdf8fe00640 1 --2- 172.21.15.144:0/3922145147 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf900ae8e0 0x7fdf900b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.351+0000 7fdf8fe00640 1 -- 172.21.15.144:0/3922145147 >> 172.21.15.144:0/3922145147 conn(0x7fdf9006e910 msgr2=0x7fdf901613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:35.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.351+0000 7fdf8fe00640 1 -- 172.21.15.144:0/3922145147 shutdown_connections 2024-09-11T23:22:35.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.351+0000 7fdf8fe00640 1 -- 172.21.15.144:0/3922145147 wait complete. 2024-09-11T23:22:35.366 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-11T23:22:34.715087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258356,"kb_used_data":8828,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716364,"statfs":{"total":773094113280,"available":772829556736,"internally_reserved":0,"allocated":9039872,"data_stored":4516429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.948157"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.788382+0000","last_change":"2024-09-11T23:22:29.788382+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.788382+0000","last_undegraded":"2024-09-11T23:22:29.788382+0000","last_fullsized":"2024-09-11T23:22:29.788382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.786400+0000","last_change":"2024-09-11T23:22:29.786400+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.786400+0000","last_undegraded":"2024-09-11T23:22:29.786400+0000","last_fullsized":"2024-09-11T23:22:29.786400+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.785377+0000","last_change":"2024-09-11T23:22:29.785377+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.785377+0000","last_undegraded":"2024-09-11T23:22:29.785377+0000","last_fullsized":"2024-09-11T23:22:29.785377+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783871+0000","last_change":"2024-09-11T23:22:29.783871+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783871+0000","last_undegraded":"2024-09-11T23:22:29.783871+0000","last_fullsized":"2024-09-11T23:22:29.783871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782095+0000","last_change":"2024-09-11T23:22:29.782095+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782095+0000","last_undegraded":"2024-09-11T23:22:29.782095+0000","last_fullsized":"2024-09-11T23:22:29.782095+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.779411+0000","last_change":"2024-09-11T23:22:29.779411+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.779411+0000","last_undegraded":"2024-09-11T23:22:29.779411+0000","last_fullsized":"2024-09-11T23:22:29.779411+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781715+0000","last_change":"2024-09-11T23:22:29.781715+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781715+0000","last_undegraded":"2024-09-11T23:22:29.781715+0000","last_fullsized":"2024-09-11T23:22:29.781715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.777866+0000","last_change":"2024-09-11T23:22:29.777866+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.777866+0000","last_undegraded":"2024-09-11T23:22:29.777866+0000","last_fullsized":"2024-09-11T23:22:29.777866+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.779067+0000","last_change":"2024-09-11T23:22:29.779067+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.779067+0000","last_undegraded":"2024-09-11T23:22:29.779067+0000","last_fullsized":"2024-09-11T23:22:29.779067+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.784817+0000","last_change":"2024-09-11T23:22:29.784817+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.784817+0000","last_undegraded":"2024-09-11T23:22:29.784817+0000","last_fullsized":"2024-09-11T23:22:29.784817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.786000+0000","last_change":"2024-09-11T23:22:29.786000+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.786000+0000","last_undegraded":"2024-09-11T23:22:29.786000+0000","last_fullsized":"2024-09-11T23:22:29.786000+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.790174+0000","last_change":"2024-09-11T23:22:29.790174+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.790174+0000","last_undegraded":"2024-09-11T23:22:29.790174+0000","last_fullsized":"2024-09-11T23:22:29.790174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.785141+0000","last_change":"2024-09-11T23:22:29.785141+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.785141+0000","last_undegraded":"2024-09-11T23:22:29.785141+0000","last_fullsized":"2024-09-11T23:22:29.785141+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.784120+0000","last_change":"2024-09-11T23:22:29.784120+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.784120+0000","last_undegraded":"2024-09-11T23:22:29.784120+0000","last_fullsized":"2024-09-11T23:22:29.784120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.786586+0000","last_change":"2024-09-11T23:22:29.786586+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.786586+0000","last_undegraded":"2024-09-11T23:22:29.786586+0000","last_fullsized":"2024-09-11T23:22:29.786586+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783492+0000","last_change":"2024-09-11T23:22:29.783492+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783492+0000","last_undegraded":"2024-09-11T23:22:29.783492+0000","last_fullsized":"2024-09-11T23:22:29.783492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781621+0000","last_change":"2024-09-11T23:22:29.781621+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781621+0000","last_undegraded":"2024-09-11T23:22:29.781621+0000","last_fullsized":"2024-09-11T23:22:29.781621+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783714+0000","last_change":"2024-09-11T23:22:29.783714+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783714+0000","last_undegraded":"2024-09-11T23:22:29.783714+0000","last_fullsized":"2024-09-11T23:22:29.783714+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780149+0000","last_change":"2024-09-11T23:22:29.780149+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780149+0000","last_undegraded":"2024-09-11T23:22:29.780149+0000","last_fullsized":"2024-09-11T23:22:29.780149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783439+0000","last_change":"2024-09-11T23:22:29.783439+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783439+0000","last_undegraded":"2024-09-11T23:22:29.783439+0000","last_fullsized":"2024-09-11T23:22:29.783439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782157+0000","last_change":"2024-09-11T23:22:29.782157+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782157+0000","last_undegraded":"2024-09-11T23:22:29.782157+0000","last_fullsized":"2024-09-11T23:22:29.782157+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.784771+0000","last_change":"2024-09-11T23:22:29.784771+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.784771+0000","last_undegraded":"2024-09-11T23:22:29.784771+0000","last_fullsized":"2024-09-11T23:22:29.784771+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783276+0000","last_change":"2024-09-11T23:22:29.783276+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783276+0000","last_undegraded":"2024-09-11T23:22:29.783276+0000","last_fullsized":"2024-09-11T23:22:29.783276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782348+0000","last_change":"2024-09-11T23:22:29.782348+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782348+0000","last_undegraded":"2024-09-11T23:22:29.782348+0000","last_fullsized":"2024-09-11T23:22:29.782348+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781742+0000","last_change":"2024-09-11T23:22:29.781742+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781742+0000","last_undegraded":"2024-09-11T23:22:29.781742+0000","last_fullsized":"2024-09-11T23:22:29.781742+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.788359+0000","last_change":"2024-09-11T23:22:29.788359+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.788359+0000","last_undegraded":"2024-09-11T23:22:29.788359+0000","last_fullsized":"2024-09-11T23:22:29.788359+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783819+0000","last_change":"2024-09-11T23:22:29.783819+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783819+0000","last_undegraded":"2024-09-11T23:22:29.783819+0000","last_fullsized":"2024-09-11T23:22:29.783819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.789270+0000","last_change":"2024-09-11T23:22:29.789270+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.789270+0000","last_undegraded":"2024-09-11T23:22:29.789270+0000","last_fullsized":"2024-09-11T23:22:29.789270+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781384+0000","last_change":"2024-09-11T23:22:29.781384+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781384+0000","last_undegraded":"2024-09-11T23:22:29.781384+0000","last_fullsized":"2024-09-11T23:22:29.781384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781243+0000","last_change":"2024-09-11T23:22:29.781243+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781243+0000","last_undegraded":"2024-09-11T23:22:29.781243+0000","last_fullsized":"2024-09-11T23:22:29.781243+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780707+0000","last_change":"2024-09-11T23:22:29.780707+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780707+0000","last_undegraded":"2024-09-11T23:22:29.780707+0000","last_fullsized":"2024-09-11T23:22:29.780707+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782038+0000","last_change":"2024-09-11T23:22:29.782038+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782038+0000","last_undegraded":"2024-09-11T23:22:29.782038+0000","last_fullsized":"2024-09-11T23:22:29.782038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782012+0000","last_change":"2024-09-11T23:22:29.782012+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782012+0000","last_undegraded":"2024-09-11T23:22:29.782012+0000","last_fullsized":"2024-09-11T23:22:29.782012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.802180+0000","last_change":"2024-09-11T23:22:29.801202+0000","last_active":"2024-09-11T23:22:29.802180+0000","last_peered":"2024-09-11T23:22:29.802180+0000","last_clean":"2024-09-11T23:22:29.802180+0000","last_became_active":"2024-09-11T23:22:29.800931+0000","last_became_peered":"2024-09-11T23:22:29.800931+0000","last_unstale":"2024-09-11T23:22:29.802180+0000","last_undegraded":"2024-09-11T23:22:29.802180+0000","last_fullsized":"2024-09-11T23:22:29.802180+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:33.581201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.787990+0000","last_change":"2024-09-11T23:22:29.787990+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.787990+0000","last_undegraded":"2024-09-11T23:22:29.787990+0000","last_fullsized":"2024-09-11T23:22:29.787990+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.795398+0000","last_change":"2024-09-11T23:22:29.791510+0000","last_active":"2024-09-11T23:22:29.795398+0000","last_peered":"2024-09-11T23:22:29.795398+0000","last_clean":"2024-09-11T23:22:29.795398+0000","last_became_active":"2024-09-11T23:22:29.791216+0000","last_became_peered":"2024-09-11T23:22:29.791216+0000","last_unstale":"2024-09-11T23:22:29.795398+0000","last_undegraded":"2024-09-11T23:22:29.795398+0000","last_fullsized":"2024-09-11T23:22:29.795398+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:04:07.998110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.787174+0000","last_change":"2024-09-11T23:22:29.787174+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.787174+0000","last_undegraded":"2024-09-11T23:22:29.787174+0000","last_fullsized":"2024-09-11T23:22:29.787174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801045+0000","last_change":"2024-09-11T23:22:29.797262+0000","last_active":"2024-09-11T23:22:29.801045+0000","last_peered":"2024-09-11T23:22:29.801045+0000","last_clean":"2024-09-11T23:22:29.801045+0000","last_became_active":"2024-09-11T23:22:29.796852+0000","last_became_peered":"2024-09-11T23:22:29.796852+0000","last_unstale":"2024-09-11T23:22:29.801045+0000","last_undegraded":"2024-09-11T23:22:29.801045+0000","last_fullsized":"2024-09-11T23:22:29.801045+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:45.746458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.784903+0000","last_change":"2024-09-11T23:22:29.784903+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.784903+0000","last_undegraded":"2024-09-11T23:22:29.784903+0000","last_fullsized":"2024-09-11T23:22:29.784903+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801050+0000","last_change":"2024-09-11T23:22:29.798952+0000","last_active":"2024-09-11T23:22:29.801050+0000","last_peered":"2024-09-11T23:22:29.801050+0000","last_clean":"2024-09-11T23:22:29.801050+0000","last_became_active":"2024-09-11T23:22:29.798584+0000","last_became_peered":"2024-09-11T23:22:29.798584+0000","last_unstale":"2024-09-11T23:22:29.801050+0000","last_undegraded":"2024-09-11T23:22:29.801050+0000","last_fullsized":"2024-09-11T23:22:29.801050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:32.388072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780839+0000","last_change":"2024-09-11T23:22:29.780839+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780839+0000","last_undegraded":"2024-09-11T23:22:29.780839+0000","last_fullsized":"2024-09-11T23:22:29.780839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.795695+0000","last_change":"2024-09-11T23:22:29.791619+0000","last_active":"2024-09-11T23:22:29.795695+0000","last_peered":"2024-09-11T23:22:29.795695+0000","last_clean":"2024-09-11T23:22:29.795695+0000","last_became_active":"2024-09-11T23:22:29.791285+0000","last_became_peered":"2024-09-11T23:22:29.791285+0000","last_unstale":"2024-09-11T23:22:29.795695+0000","last_undegraded":"2024-09-11T23:22:29.795695+0000","last_fullsized":"2024-09-11T23:22:29.795695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:18.720260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781627+0000","last_change":"2024-09-11T23:22:29.781627+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781627+0000","last_undegraded":"2024-09-11T23:22:29.781627+0000","last_fullsized":"2024-09-11T23:22:29.781627+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800715+0000","last_change":"2024-09-11T23:22:29.799472+0000","last_active":"2024-09-11T23:22:29.800715+0000","last_peered":"2024-09-11T23:22:29.800715+0000","last_clean":"2024-09-11T23:22:29.800715+0000","last_became_active":"2024-09-11T23:22:29.799108+0000","last_became_peered":"2024-09-11T23:22:29.799108+0000","last_unstale":"2024-09-11T23:22:29.800715+0000","last_undegraded":"2024-09-11T23:22:29.800715+0000","last_fullsized":"2024-09-11T23:22:29.800715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:11.066365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.788039+0000","last_change":"2024-09-11T23:22:29.788039+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.788039+0000","last_undegraded":"2024-09-11T23:22:29.788039+0000","last_fullsized":"2024-09-11T23:22:29.788039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800415+0000","last_change":"2024-09-11T23:22:29.794917+0000","last_active":"2024-09-11T23:22:29.800415+0000","last_peered":"2024-09-11T23:22:29.800415+0000","last_clean":"2024-09-11T23:22:29.800415+0000","last_became_active":"2024-09-11T23:22:29.794644+0000","last_became_peered":"2024-09-11T23:22:29.794644+0000","last_unstale":"2024-09-11T23:22:29.800415+0000","last_undegraded":"2024-09-11T23:22:29.800415+0000","last_fullsized":"2024-09-11T23:22:29.800415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:11.157987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783457+0000","last_change":"2024-09-11T23:22:29.783457+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783457+0000","last_undegraded":"2024-09-11T23:22:29.783457+0000","last_fullsized":"2024-09-11T23:22:29.783457+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.795631+0000","last_change":"2024-09-11T23:22:29.791904+0000","last_active":"2024-09-11T23:22:29.795631+0000","last_peered":"2024-09-11T23:22:29.795631+0000","last_clean":"2024-09-11T23:22:29.795631+0000","last_became_active":"2024-09-11T23:22:29.791075+0000","last_became_peered":"2024-09-11T23:22:29.791075+0000","last_unstale":"2024-09-11T23:22:29.795631+0000","last_undegraded":"2024-09-11T23:22:29.795631+0000","last_fullsized":"2024-09-11T23:22:29.795631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:16.262655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.785519+0000","last_change":"2024-09-11T23:22:29.785519+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.785519+0000","last_undegraded":"2024-09-11T23:22:29.785519+0000","last_fullsized":"2024-09-11T23:22:29.785519+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801364+0000","last_change":"2024-09-11T23:22:29.800033+0000","last_active":"2024-09-11T23:22:29.801364+0000","last_peered":"2024-09-11T23:22:29.801364+0000","last_clean":"2024-09-11T23:22:29.801364+0000","last_became_active":"2024-09-11T23:22:29.799648+0000","last_became_peered":"2024-09-11T23:22:29.799648+0000","last_unstale":"2024-09-11T23:22:29.801364+0000","last_undegraded":"2024-09-11T23:22:29.801364+0000","last_fullsized":"2024-09-11T23:22:29.801364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:18.891456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.777915+0000","last_change":"2024-09-11T23:22:29.777915+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.777915+0000","last_undegraded":"2024-09-11T23:22:29.777915+0000","last_fullsized":"2024-09-11T23:22:29.777915+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.799704+0000","last_change":"2024-09-11T23:22:29.797980+0000","last_active":"2024-09-11T23:22:29.799704+0000","last_peered":"2024-09-11T23:22:29.799704+0000","last_clean":"2024-09-11T23:22:29.799704+0000","last_became_active":"2024-09-11T23:22:29.797613+0000","last_became_peered":"2024-09-11T23:22:29.797613+0000","last_unstale":"2024-09-11T23:22:29.799704+0000","last_undegraded":"2024-09-11T23:22:29.799704+0000","last_fullsized":"2024-09-11T23:22:29.799704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:57.423778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780370+0000","last_change":"2024-09-11T23:22:29.780370+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780370+0000","last_undegraded":"2024-09-11T23:22:29.780370+0000","last_fullsized":"2024-09-11T23:22:29.780370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.798784+0000","last_change":"2024-09-11T23:22:29.796274+0000","last_active":"2024-09-11T23:22:29.798784+0000","last_peered":"2024-09-11T23:22:29.798784+0000","last_clean":"2024-09-11T23:22:29.798784+0000","last_became_active":"2024-09-11T23:22:29.796007+0000","last_became_peered":"2024-09-11T23:22:29.796007+0000","last_unstale":"2024-09-11T23:22:29.798784+0000","last_undegraded":"2024-09-11T23:22:29.798784+0000","last_fullsized":"2024-09-11T23:22:29.798784+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:00.496690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783358+0000","last_change":"2024-09-11T23:22:29.783358+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783358+0000","last_undegraded":"2024-09-11T23:22:29.783358+0000","last_fullsized":"2024-09-11T23:22:29.783358+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.795958+0000","last_change":"2024-09-11T23:22:29.794370+0000","last_active":"2024-09-11T23:22:29.795958+0000","last_peered":"2024-09-11T23:22:29.795958+0000","last_clean":"2024-09-11T23:22:29.795958+0000","last_became_active":"2024-09-11T23:22:29.794076+0000","last_became_peered":"2024-09-11T23:22:29.794076+0000","last_unstale":"2024-09-11T23:22:29.795958+0000","last_undegraded":"2024-09-11T23:22:29.795958+0000","last_fullsized":"2024-09-11T23:22:29.795958+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:56.009289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780157+0000","last_change":"2024-09-11T23:22:29.780157+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780157+0000","last_undegraded":"2024-09-11T23:22:29.780157+0000","last_fullsized":"2024-09-11T23:22:29.780157+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.790304+0000","last_change":"2024-09-11T23:22:29.788351+0000","last_active":"2024-09-11T23:22:29.790304+0000","last_peered":"2024-09-11T23:22:29.790304+0000","last_clean":"2024-09-11T23:22:29.790304+0000","last_became_active":"2024-09-11T23:22:29.788085+0000","last_became_peered":"2024-09-11T23:22:29.788085+0000","last_unstale":"2024-09-11T23:22:29.790304+0000","last_undegraded":"2024-09-11T23:22:29.790304+0000","last_fullsized":"2024-09-11T23:22:29.790304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:59.256338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.784634+0000","last_change":"2024-09-11T23:22:29.784634+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.784634+0000","last_undegraded":"2024-09-11T23:22:29.784634+0000","last_fullsized":"2024-09-11T23:22:29.784634+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801471+0000","last_change":"2024-09-11T23:22:29.793974+0000","last_active":"2024-09-11T23:22:29.801471+0000","last_peered":"2024-09-11T23:22:29.801471+0000","last_clean":"2024-09-11T23:22:29.801471+0000","last_became_active":"2024-09-11T23:22:29.793537+0000","last_became_peered":"2024-09-11T23:22:29.793537+0000","last_unstale":"2024-09-11T23:22:29.801471+0000","last_undegraded":"2024-09-11T23:22:29.801471+0000","last_fullsized":"2024-09-11T23:22:29.801471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:29.665243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.779771+0000","last_change":"2024-09-11T23:22:29.779771+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.779771+0000","last_undegraded":"2024-09-11T23:22:29.779771+0000","last_fullsized":"2024-09-11T23:22:29.779771+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.793226+0000","last_change":"2024-09-11T23:22:29.786056+0000","last_active":"2024-09-11T23:22:29.793226+0000","last_peered":"2024-09-11T23:22:29.793226+0000","last_clean":"2024-09-11T23:22:29.793226+0000","last_became_active":"2024-09-11T23:22:29.785767+0000","last_became_peered":"2024-09-11T23:22:29.785767+0000","last_unstale":"2024-09-11T23:22:29.793226+0000","last_undegraded":"2024-09-11T23:22:29.793226+0000","last_fullsized":"2024-09-11T23:22:29.793226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:53.387875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780406+0000","last_change":"2024-09-11T23:22:29.780406+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780406+0000","last_undegraded":"2024-09-11T23:22:29.780406+0000","last_fullsized":"2024-09-11T23:22:29.780406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800328+0000","last_change":"2024-09-11T23:22:29.795359+0000","last_active":"2024-09-11T23:22:29.800328+0000","last_peered":"2024-09-11T23:22:29.800328+0000","last_clean":"2024-09-11T23:22:29.800328+0000","last_became_active":"2024-09-11T23:22:29.794120+0000","last_became_peered":"2024-09-11T23:22:29.794120+0000","last_unstale":"2024-09-11T23:22:29.800328+0000","last_undegraded":"2024-09-11T23:22:29.800328+0000","last_fullsized":"2024-09-11T23:22:29.800328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:43.513789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.787891+0000","last_change":"2024-09-11T23:22:29.787891+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.787891+0000","last_undegraded":"2024-09-11T23:22:29.787891+0000","last_fullsized":"2024-09-11T23:22:29.787891+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.798059+0000","last_change":"2024-09-11T23:22:29.795929+0000","last_active":"2024-09-11T23:22:29.798059+0000","last_peered":"2024-09-11T23:22:29.798059+0000","last_clean":"2024-09-11T23:22:29.798059+0000","last_became_active":"2024-09-11T23:22:29.795634+0000","last_became_peered":"2024-09-11T23:22:29.795634+0000","last_unstale":"2024-09-11T23:22:29.798059+0000","last_undegraded":"2024-09-11T23:22:29.798059+0000","last_fullsized":"2024-09-11T23:22:29.798059+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:18.720260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.787577+0000","last_change":"2024-09-11T23:22:29.787577+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.787577+0000","last_undegraded":"2024-09-11T23:22:29.787577+0000","last_fullsized":"2024-09-11T23:22:29.787577+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.795140+0000","last_change":"2024-09-11T23:22:29.793636+0000","last_active":"2024-09-11T23:22:29.795140+0000","last_peered":"2024-09-11T23:22:29.795140+0000","last_clean":"2024-09-11T23:22:29.795140+0000","last_became_active":"2024-09-11T23:22:29.793346+0000","last_became_peered":"2024-09-11T23:22:29.793346+0000","last_unstale":"2024-09-11T23:22:29.795140+0000","last_undegraded":"2024-09-11T23:22:29.795140+0000","last_fullsized":"2024-09-11T23:22:29.795140+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:56.009289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782650+0000","last_change":"2024-09-11T23:22:29.782650+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782650+0000","last_undegraded":"2024-09-11T23:22:29.782650+0000","last_fullsized":"2024-09-11T23:22:29.782650+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800356+0000","last_change":"2024-09-11T23:22:29.795529+0000","last_active":"2024-09-11T23:22:29.800356+0000","last_peered":"2024-09-11T23:22:29.800356+0000","last_clean":"2024-09-11T23:22:29.800356+0000","last_became_active":"2024-09-11T23:22:29.794606+0000","last_became_peered":"2024-09-11T23:22:29.794606+0000","last_unstale":"2024-09-11T23:22:29.800356+0000","last_undegraded":"2024-09-11T23:22:29.800356+0000","last_fullsized":"2024-09-11T23:22:29.800356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:33.678630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783064+0000","last_change":"2024-09-11T23:22:29.783064+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783064+0000","last_undegraded":"2024-09-11T23:22:29.783064+0000","last_fullsized":"2024-09-11T23:22:29.783064+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.806279+0000","last_change":"2024-09-11T23:22:29.801734+0000","last_active":"2024-09-11T23:22:29.806279+0000","last_peered":"2024-09-11T23:22:29.806279+0000","last_clean":"2024-09-11T23:22:29.806279+0000","last_became_active":"2024-09-11T23:22:29.800988+0000","last_became_peered":"2024-09-11T23:22:29.800988+0000","last_unstale":"2024-09-11T23:22:29.806279+0000","last_undegraded":"2024-09-11T23:22:29.806279+0000","last_fullsized":"2024-09-11T23:22:29.806279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:15.181135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.778271+0000","last_change":"2024-09-11T23:22:29.778271+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.778271+0000","last_undegraded":"2024-09-11T23:22:29.778271+0000","last_fullsized":"2024-09-11T23:22:29.778271+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800477+0000","last_change":"2024-09-11T23:22:29.790559+0000","last_active":"2024-09-11T23:22:29.800477+0000","last_peered":"2024-09-11T23:22:29.800477+0000","last_clean":"2024-09-11T23:22:29.800477+0000","last_became_active":"2024-09-11T23:22:29.790290+0000","last_became_peered":"2024-09-11T23:22:29.790290+0000","last_unstale":"2024-09-11T23:22:29.800477+0000","last_undegraded":"2024-09-11T23:22:29.800477+0000","last_fullsized":"2024-09-11T23:22:29.800477+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:04.100862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781929+0000","last_change":"2024-09-11T23:22:29.781929+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781929+0000","last_undegraded":"2024-09-11T23:22:29.781929+0000","last_fullsized":"2024-09-11T23:22:29.781929+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.803052+0000","last_change":"2024-09-11T23:22:29.797708+0000","last_active":"2024-09-11T23:22:29.803052+0000","last_peered":"2024-09-11T23:22:29.803052+0000","last_clean":"2024-09-11T23:22:29.803052+0000","last_became_active":"2024-09-11T23:22:29.796870+0000","last_became_peered":"2024-09-11T23:22:29.796870+0000","last_unstale":"2024-09-11T23:22:29.803052+0000","last_undegraded":"2024-09-11T23:22:29.803052+0000","last_fullsized":"2024-09-11T23:22:29.803052+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:14.567731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.777997+0000","last_change":"2024-09-11T23:22:29.777997+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.777997+0000","last_undegraded":"2024-09-11T23:22:29.777997+0000","last_fullsized":"2024-09-11T23:22:29.777997+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.809100+0000","last_change":"2024-09-11T23:22:29.803838+0000","last_active":"2024-09-11T23:22:29.809100+0000","last_peered":"2024-09-11T23:22:29.809100+0000","last_clean":"2024-09-11T23:22:29.809100+0000","last_became_active":"2024-09-11T23:22:29.803457+0000","last_became_peered":"2024-09-11T23:22:29.803457+0000","last_unstale":"2024-09-11T23:22:29.809100+0000","last_undegraded":"2024-09-11T23:22:29.809100+0000","last_fullsized":"2024-09-11T23:22:29.809100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:30.624506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781127+0000","last_change":"2024-09-11T23:22:29.781127+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781127+0000","last_undegraded":"2024-09-11T23:22:29.781127+0000","last_fullsized":"2024-09-11T23:22:29.781127+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801544+0000","last_change":"2024-09-11T23:22:29.796232+0000","last_active":"2024-09-11T23:22:29.801544+0000","last_peered":"2024-09-11T23:22:29.801544+0000","last_clean":"2024-09-11T23:22:29.801544+0000","last_became_active":"2024-09-11T23:22:29.795936+0000","last_became_peered":"2024-09-11T23:22:29.795936+0000","last_unstale":"2024-09-11T23:22:29.801544+0000","last_undegraded":"2024-09-11T23:22:29.801544+0000","last_fullsized":"2024-09-11T23:22:29.801544+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:51.278777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.789036+0000","last_change":"2024-09-11T23:22:29.789036+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.789036+0000","last_undegraded":"2024-09-11T23:22:29.789036+0000","last_fullsized":"2024-09-11T23:22:29.789036+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.791258+0000","last_change":"2024-09-11T23:22:29.787519+0000","last_active":"2024-09-11T23:22:29.791258+0000","last_peered":"2024-09-11T23:22:29.791258+0000","last_clean":"2024-09-11T23:22:29.791258+0000","last_became_active":"2024-09-11T23:22:29.787222+0000","last_became_peered":"2024-09-11T23:22:29.787222+0000","last_unstale":"2024-09-11T23:22:29.791258+0000","last_undegraded":"2024-09-11T23:22:29.791258+0000","last_fullsized":"2024-09-11T23:22:29.791258+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:40.941861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.786702+0000","last_change":"2024-09-11T23:22:29.786702+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.786702+0000","last_undegraded":"2024-09-11T23:22:29.786702+0000","last_fullsized":"2024-09-11T23:22:29.786702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800628+0000","last_change":"2024-09-11T23:22:29.798913+0000","last_active":"2024-09-11T23:22:29.800628+0000","last_peered":"2024-09-11T23:22:29.800628+0000","last_clean":"2024-09-11T23:22:29.800628+0000","last_became_active":"2024-09-11T23:22:29.798524+0000","last_became_peered":"2024-09-11T23:22:29.798524+0000","last_unstale":"2024-09-11T23:22:29.800628+0000","last_undegraded":"2024-09-11T23:22:29.800628+0000","last_fullsized":"2024-09-11T23:22:29.800628+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:11.066365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780298+0000","last_change":"2024-09-11T23:22:29.780298+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780298+0000","last_undegraded":"2024-09-11T23:22:29.780298+0000","last_fullsized":"2024-09-11T23:22:29.780298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.798015+0000","last_change":"2024-09-11T23:22:29.795594+0000","last_active":"2024-09-11T23:22:29.798015+0000","last_peered":"2024-09-11T23:22:29.798015+0000","last_clean":"2024-09-11T23:22:29.798015+0000","last_became_active":"2024-09-11T23:22:29.795192+0000","last_became_peered":"2024-09-11T23:22:29.795192+0000","last_unstale":"2024-09-11T23:22:29.798015+0000","last_undegraded":"2024-09-11T23:22:29.798015+0000","last_fullsized":"2024-09-11T23:22:29.798015+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:04:07.998110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.778714+0000","last_change":"2024-09-11T23:22:29.778714+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.778714+0000","last_undegraded":"2024-09-11T23:22:29.778714+0000","last_fullsized":"2024-09-11T23:22:29.778714+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800276+0000","last_change":"2024-09-11T23:22:29.795182+0000","last_active":"2024-09-11T23:22:29.800276+0000","last_peered":"2024-09-11T23:22:29.800276+0000","last_clean":"2024-09-11T23:22:29.800276+0000","last_became_active":"2024-09-11T23:22:29.794863+0000","last_became_peered":"2024-09-11T23:22:29.794863+0000","last_unstale":"2024-09-11T23:22:29.800276+0000","last_undegraded":"2024-09-11T23:22:29.800276+0000","last_fullsized":"2024-09-11T23:22:29.800276+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:23.886099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780002+0000","last_change":"2024-09-11T23:22:29.780002+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780002+0000","last_undegraded":"2024-09-11T23:22:29.780002+0000","last_fullsized":"2024-09-11T23:22:29.780002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.797531+0000","last_change":"2024-09-11T23:22:29.793776+0000","last_active":"2024-09-11T23:22:29.797531+0000","last_peered":"2024-09-11T23:22:29.797531+0000","last_clean":"2024-09-11T23:22:29.797531+0000","last_became_active":"2024-09-11T23:22:29.793426+0000","last_became_peered":"2024-09-11T23:22:29.793426+0000","last_unstale":"2024-09-11T23:22:29.797531+0000","last_undegraded":"2024-09-11T23:22:29.797531+0000","last_fullsized":"2024-09-11T23:22:29.797531+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:00.496690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.785567+0000","last_change":"2024-09-11T23:22:29.785567+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.785567+0000","last_undegraded":"2024-09-11T23:22:29.785567+0000","last_fullsized":"2024-09-11T23:22:29.785567+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801184+0000","last_change":"2024-09-11T23:22:29.800003+0000","last_active":"2024-09-11T23:22:29.801184+0000","last_peered":"2024-09-11T23:22:29.801184+0000","last_clean":"2024-09-11T23:22:29.801184+0000","last_became_active":"2024-09-11T23:22:29.799292+0000","last_became_peered":"2024-09-11T23:22:29.799292+0000","last_unstale":"2024-09-11T23:22:29.801184+0000","last_undegraded":"2024-09-11T23:22:29.801184+0000","last_fullsized":"2024-09-11T23:22:29.801184+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:06.176294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782668+0000","last_change":"2024-09-11T23:22:29.782668+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782668+0000","last_undegraded":"2024-09-11T23:22:29.782668+0000","last_fullsized":"2024-09-11T23:22:29.782668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.798925+0000","last_change":"2024-09-11T23:22:29.794909+0000","last_active":"2024-09-11T23:22:29.798925+0000","last_peered":"2024-09-11T23:22:29.798925+0000","last_clean":"2024-09-11T23:22:29.798925+0000","last_became_active":"2024-09-11T23:22:29.794633+0000","last_became_peered":"2024-09-11T23:22:29.794633+0000","last_unstale":"2024-09-11T23:22:29.798925+0000","last_undegraded":"2024-09-11T23:22:29.798925+0000","last_fullsized":"2024-09-11T23:22:29.798925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:57.423778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.778998+0000","last_change":"2024-09-11T23:22:29.778998+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.778998+0000","last_undegraded":"2024-09-11T23:22:29.778998+0000","last_fullsized":"2024-09-11T23:22:29.778998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.797333+0000","last_change":"2024-09-11T23:22:29.794603+0000","last_active":"2024-09-11T23:22:29.797333+0000","last_peered":"2024-09-11T23:22:29.797333+0000","last_clean":"2024-09-11T23:22:29.797333+0000","last_became_active":"2024-09-11T23:22:29.794225+0000","last_became_peered":"2024-09-11T23:22:29.794225+0000","last_unstale":"2024-09-11T23:22:29.797333+0000","last_undegraded":"2024-09-11T23:22:29.797333+0000","last_fullsized":"2024-09-11T23:22:29.797333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:35.708584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":320,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.788260+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:22:29.788260+0000","last_peered":"2024-09-11T23:22:29.788260+0000","last_clean":"2024-09-11T23:22:29.788260+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:22:29.788260+0000","last_undegraded":"2024-09-11T23:22:29.788260+0000","last_fullsized":"2024-09-11T23:22:29.788260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476797,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1576960,"data_stored":1008114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476796,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":417746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476795,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":417746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476795,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":983040,"data_stored":417746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542204,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":417746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542204,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":417746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509500,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":970752,"data_stored":411471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509500,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1576960,"data_stored":1008114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:22:35.370 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:22:35.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.560+0000 7f8ac5c00640 1 Processor -- start 2024-09-11T23:22:35.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.560+0000 7f8ac5c00640 1 -- start start 2024-09-11T23:22:35.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.561+0000 7f8ac5c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8ac015e940 0x7f8ac00d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:35.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.561+0000 7f8ac5c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ac015ed20 0x7f8ac00d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:35.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.561+0000 7f8ac5c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac00b7170 con 0x7f8ac00cef90 2024-09-11T23:22:35.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.561+0000 7f8ac5c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8ac00d1ae0 con 0x7f8ac015e940 2024-09-11T23:22:35.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.561+0000 7f8ac5c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac00b7aa0 con 0x7f8ac015ed20 2024-09-11T23:22:35.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.561+0000 7f8abea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8ac015e940 0x7f8ac00d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:35.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.562+0000 7f8abf400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8ac00cef90 0x7f8ac00b3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49530/0 (socket says 172.21.15.144:49530) 2024-09-11T23:22:35.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.562+0000 7f8abf400640 1 -- 172.21.15.144:0/1837196569 learned_addr learned my addr 172.21.15.144:0/1837196569 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:35.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.562+0000 7f8abea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8ac015e940 0x7f8ac00d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59108/0 (socket says 172.21.15.144:59108) 2024-09-11T23:22:35.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.562+0000 7f8abe000640 1 --2- 172.21.15.144:0/1837196569 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ac015ed20 0x7f8ac00d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:35.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.562+0000 7f8abea00640 1 -- 172.21.15.144:0/1837196569 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ac015ed20 msgr2=0x7f8ac00d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:35.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.562+0000 7f8abea00640 1 --2- 172.21.15.144:0/1837196569 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ac015ed20 0x7f8ac00d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.562+0000 7f8abd600640 1 -- 172.21.15.144:0/1837196569 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3825880695 0 0) 0x7f8ab8001490 con 0x7f8ac00cef90 2024-09-11T23:22:35.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.562+0000 7f8abea00640 1 -- 172.21.15.144:0/1837196569 >> v1:172.21.15.144:6789/0 conn(0x7f8ac00cef90 legacy=0x7f8ac00b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:35.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.562+0000 7f8abea00640 1 -- 172.21.15.144:0/1837196569 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac00d3660 con 0x7f8ac015e940 2024-09-11T23:22:35.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.562+0000 7f8abe000640 1 --2- 172.21.15.144:0/1837196569 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ac015ed20 0x7f8ac00d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:22:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.563+0000 7f8abea00640 1 --2- 172.21.15.144:0/1837196569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ac015e940 0x7f8ac00d1060 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00097a0 tx=0x7f8ab002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1f21d97954d424 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.563+0000 7f8abd600640 1 -- 172.21.15.144:0/1837196569 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0037070 con 0x7f8ac015e940 2024-09-11T23:22:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.563+0000 7f8abd600640 1 -- 172.21.15.144:0/1837196569 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab0032440 con 0x7f8ac015e940 2024-09-11T23:22:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.563+0000 7f8abd600640 1 -- 172.21.15.144:0/1837196569 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0032810 con 0x7f8ac015e940 2024-09-11T23:22:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.564+0000 7f8ac5c00640 1 -- 172.21.15.144:0/1837196569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ac015e940 msgr2=0x7f8ac00d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.564+0000 7f8ac5c00640 1 --2- 172.21.15.144:0/1837196569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ac015e940 0x7f8ac00d1060 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00097a0 tx=0x7f8ab002a210 comp rx=0 tx=0).stop 2024-09-11T23:22:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.564+0000 7f8ac5c00640 1 -- 172.21.15.144:0/1837196569 shutdown_connections 2024-09-11T23:22:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.564+0000 7f8ac5c00640 1 --2- 172.21.15.144:0/1837196569 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ac015ed20 0x7f8ac00d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.564+0000 7f8ac5c00640 1 --2- 172.21.15.144:0/1837196569 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ac015e940 0x7f8ac00d1060 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.564+0000 7f8ac5c00640 1 -- 172.21.15.144:0/1837196569 >> 172.21.15.144:0/1837196569 conn(0x7f8ac00b6240 msgr2=0x7f8ac00b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:35.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.564+0000 7f8ac5c00640 1 -- 172.21.15.144:0/1837196569 shutdown_connections 2024-09-11T23:22:35.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.564+0000 7f8ac5c00640 1 -- 172.21.15.144:0/1837196569 wait complete. 2024-09-11T23:22:35.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.566+0000 7f8ac5c00640 1 Processor -- start 2024-09-11T23:22:35.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.566+0000 7f8ac5c00640 1 -- start start 2024-09-11T23:22:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.567+0000 7f8ac5c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ac00cef90 0x7f8ac01e8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.567+0000 7f8ac5c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ac015e940 0x7f8ac015b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.567+0000 7f8ac5c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ac015ed20 0x7f8ac00cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.567+0000 7f8ac5c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac00d3f00 con 0x7f8ac015ed20 2024-09-11T23:22:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.567+0000 7f8ac5c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac00d3c20 con 0x7f8ac00cef90 2024-09-11T23:22:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.567+0000 7f8ac5c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac00d3310 con 0x7f8ac015e940 2024-09-11T23:22:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.567+0000 7f8abf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ac015ed20 0x7f8ac00cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:35.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.567+0000 7f8abf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ac015ed20 0x7f8ac00cd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59114/0 (socket says 172.21.15.144:59114) 2024-09-11T23:22:35.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.567+0000 7f8abf400640 1 -- 172.21.15.144:0/4077644909 learned_addr learned my addr 172.21.15.144:0/4077644909 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:35.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.567+0000 7f8abea00640 1 --2- 172.21.15.144:0/4077644909 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ac00cef90 0x7f8ac01e8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:35.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.567+0000 7f8abe000640 1 --2- 172.21.15.144:0/4077644909 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ac015e940 0x7f8ac015b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:35.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.567+0000 7f8abf400640 1 -- 172.21.15.144:0/4077644909 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ac015e940 msgr2=0x7f8ac015b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:35.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.567+0000 7f8abf400640 1 --2- 172.21.15.144:0/4077644909 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ac015e940 0x7f8ac015b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.567+0000 7f8abf400640 1 -- 172.21.15.144:0/4077644909 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ac00cef90 msgr2=0x7f8ac01e8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:35.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.567+0000 7f8abf400640 1 --2- 172.21.15.144:0/4077644909 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ac00cef90 0x7f8ac01e8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.567+0000 7f8abf400640 1 -- 172.21.15.144:0/4077644909 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac01e7740 con 0x7f8ac015ed20 2024-09-11T23:22:35.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.568+0000 7f8abf400640 1 --2- 172.21.15.144:0/4077644909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ac015ed20 0x7f8ac00cd9d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800c700 tx=0x7f8ab800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.568+0000 7f8ab6a00640 1 -- 172.21.15.144:0/4077644909 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8018070 con 0x7f8ac015ed20 2024-09-11T23:22:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.568+0000 7f8ab6a00640 1 -- 172.21.15.144:0/4077644909 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab800ce10 con 0x7f8ac015ed20 2024-09-11T23:22:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.568+0000 7f8ab6a00640 1 -- 172.21.15.144:0/4077644909 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab800a860 con 0x7f8ac015ed20 2024-09-11T23:22:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.568+0000 7f8ac5c00640 1 -- 172.21.15.144:0/4077644909 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac01e79b0 con 0x7f8ac015ed20 2024-09-11T23:22:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.568+0000 7f8ac5c00640 1 -- 172.21.15.144:0/4077644909 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac01f60d0 con 0x7f8ac015ed20 2024-09-11T23:22:35.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.569+0000 7f8ac5c00640 1 -- 172.21.15.144:0/4077644909 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ac00d1f80 con 0x7f8ac015ed20 2024-09-11T23:22:35.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.570+0000 7f8ab6a00640 1 -- 172.21.15.144:0/4077644909 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f8ab800aa00 con 0x7f8ac015ed20 2024-09-11T23:22:35.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.571+0000 7f8ab6a00640 1 --2- 172.21.15.144:0/4077644909 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8aa006bf80 0x7f8aa006e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:35.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.572+0000 7f8ab6a00640 1 -- 172.21.15.144:0/4077644909 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f8ab808a390 con 0x7f8ac015ed20 2024-09-11T23:22:35.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.572+0000 7f8abea00640 1 --2- 172.21.15.144:0/4077644909 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8aa006bf80 0x7f8aa006e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:35.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.573+0000 7f8abea00640 1 --2- 172.21.15.144:0/4077644909 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8aa006bf80 0x7f8aa006e440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0034000 tx=0x7f8ab002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:35.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.576+0000 7f8ab6a00640 1 -- 172.21.15.144:0/4077644909 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ac00b7170 con 0x7f8ac015ed20 2024-09-11T23:22:35.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.747+0000 7f8ac5c00640 1 -- 172.21.15.144:0/4077644909 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8ac015e260 con 0x7f8aa006bf80 2024-09-11T23:22:35.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.754+0000 7f8ab6a00640 1 -- 172.21.15.144:0/4077644909 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246755 (secure 0 0 0) 0x7f8ac015e260 con 0x7f8aa006bf80 2024-09-11T23:22:35.757 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:35.758 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:22:35.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.758+0000 7f8ac5c00640 1 -- 172.21.15.144:0/4077644909 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8aa006bf80 msgr2=0x7f8aa006e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:35.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.758+0000 7f8ac5c00640 1 --2- 172.21.15.144:0/4077644909 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8aa006bf80 0x7f8aa006e440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0034000 tx=0x7f8ab002e000 comp rx=0 tx=0).stop 2024-09-11T23:22:35.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.758+0000 7f8ac5c00640 1 -- 172.21.15.144:0/4077644909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ac015ed20 msgr2=0x7f8ac00cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:35.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.758+0000 7f8ac5c00640 1 --2- 172.21.15.144:0/4077644909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ac015ed20 0x7f8ac00cd9d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800c700 tx=0x7f8ab800cbc0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.758+0000 7f8ac5c00640 1 -- 172.21.15.144:0/4077644909 shutdown_connections 2024-09-11T23:22:35.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.758+0000 7f8ac5c00640 1 --2- 172.21.15.144:0/4077644909 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8aa006bf80 0x7f8aa006e440 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.758+0000 7f8ac5c00640 1 --2- 172.21.15.144:0/4077644909 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ac015ed20 0x7f8ac00cd9d0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.758+0000 7f8ac5c00640 1 --2- 172.21.15.144:0/4077644909 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ac015e940 0x7f8ac015b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.758+0000 7f8ac5c00640 1 --2- 172.21.15.144:0/4077644909 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ac00cef90 0x7f8ac01e8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.758+0000 7f8ac5c00640 1 -- 172.21.15.144:0/4077644909 >> 172.21.15.144:0/4077644909 conn(0x7f8ac00b6240 msgr2=0x7f8ac00b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:35.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.758+0000 7f8ac5c00640 1 -- 172.21.15.144:0/4077644909 shutdown_connections 2024-09-11T23:22:35.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.758+0000 7f8ac5c00640 1 -- 172.21.15.144:0/4077644909 wait complete. 2024-09-11T23:22:35.774 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-11T23:22:34.715087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258356,"kb_used_data":8828,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716364,"statfs":{"total":773094113280,"available":772829556736,"internally_reserved":0,"allocated":9039872,"data_stored":4516429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.948157"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.788382+0000","last_change":"2024-09-11T23:22:29.788382+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.788382+0000","last_undegraded":"2024-09-11T23:22:29.788382+0000","last_fullsized":"2024-09-11T23:22:29.788382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.786400+0000","last_change":"2024-09-11T23:22:29.786400+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.786400+0000","last_undegraded":"2024-09-11T23:22:29.786400+0000","last_fullsized":"2024-09-11T23:22:29.786400+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.785377+0000","last_change":"2024-09-11T23:22:29.785377+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.785377+0000","last_undegraded":"2024-09-11T23:22:29.785377+0000","last_fullsized":"2024-09-11T23:22:29.785377+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783871+0000","last_change":"2024-09-11T23:22:29.783871+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783871+0000","last_undegraded":"2024-09-11T23:22:29.783871+0000","last_fullsized":"2024-09-11T23:22:29.783871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782095+0000","last_change":"2024-09-11T23:22:29.782095+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782095+0000","last_undegraded":"2024-09-11T23:22:29.782095+0000","last_fullsized":"2024-09-11T23:22:29.782095+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.779411+0000","last_change":"2024-09-11T23:22:29.779411+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.779411+0000","last_undegraded":"2024-09-11T23:22:29.779411+0000","last_fullsized":"2024-09-11T23:22:29.779411+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781715+0000","last_change":"2024-09-11T23:22:29.781715+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781715+0000","last_undegraded":"2024-09-11T23:22:29.781715+0000","last_fullsized":"2024-09-11T23:22:29.781715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.777866+0000","last_change":"2024-09-11T23:22:29.777866+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.777866+0000","last_undegraded":"2024-09-11T23:22:29.777866+0000","last_fullsized":"2024-09-11T23:22:29.777866+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.779067+0000","last_change":"2024-09-11T23:22:29.779067+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.779067+0000","last_undegraded":"2024-09-11T23:22:29.779067+0000","last_fullsized":"2024-09-11T23:22:29.779067+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.784817+0000","last_change":"2024-09-11T23:22:29.784817+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.784817+0000","last_undegraded":"2024-09-11T23:22:29.784817+0000","last_fullsized":"2024-09-11T23:22:29.784817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.786000+0000","last_change":"2024-09-11T23:22:29.786000+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.786000+0000","last_undegraded":"2024-09-11T23:22:29.786000+0000","last_fullsized":"2024-09-11T23:22:29.786000+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.790174+0000","last_change":"2024-09-11T23:22:29.790174+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.790174+0000","last_undegraded":"2024-09-11T23:22:29.790174+0000","last_fullsized":"2024-09-11T23:22:29.790174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.785141+0000","last_change":"2024-09-11T23:22:29.785141+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.785141+0000","last_undegraded":"2024-09-11T23:22:29.785141+0000","last_fullsized":"2024-09-11T23:22:29.785141+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.784120+0000","last_change":"2024-09-11T23:22:29.784120+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.784120+0000","last_undegraded":"2024-09-11T23:22:29.784120+0000","last_fullsized":"2024-09-11T23:22:29.784120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.786586+0000","last_change":"2024-09-11T23:22:29.786586+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.786586+0000","last_undegraded":"2024-09-11T23:22:29.786586+0000","last_fullsized":"2024-09-11T23:22:29.786586+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783492+0000","last_change":"2024-09-11T23:22:29.783492+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783492+0000","last_undegraded":"2024-09-11T23:22:29.783492+0000","last_fullsized":"2024-09-11T23:22:29.783492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781621+0000","last_change":"2024-09-11T23:22:29.781621+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781621+0000","last_undegraded":"2024-09-11T23:22:29.781621+0000","last_fullsized":"2024-09-11T23:22:29.781621+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783714+0000","last_change":"2024-09-11T23:22:29.783714+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783714+0000","last_undegraded":"2024-09-11T23:22:29.783714+0000","last_fullsized":"2024-09-11T23:22:29.783714+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780149+0000","last_change":"2024-09-11T23:22:29.780149+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780149+0000","last_undegraded":"2024-09-11T23:22:29.780149+0000","last_fullsized":"2024-09-11T23:22:29.780149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783439+0000","last_change":"2024-09-11T23:22:29.783439+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783439+0000","last_undegraded":"2024-09-11T23:22:29.783439+0000","last_fullsized":"2024-09-11T23:22:29.783439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782157+0000","last_change":"2024-09-11T23:22:29.782157+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782157+0000","last_undegraded":"2024-09-11T23:22:29.782157+0000","last_fullsized":"2024-09-11T23:22:29.782157+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.784771+0000","last_change":"2024-09-11T23:22:29.784771+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.784771+0000","last_undegraded":"2024-09-11T23:22:29.784771+0000","last_fullsized":"2024-09-11T23:22:29.784771+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783276+0000","last_change":"2024-09-11T23:22:29.783276+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783276+0000","last_undegraded":"2024-09-11T23:22:29.783276+0000","last_fullsized":"2024-09-11T23:22:29.783276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782348+0000","last_change":"2024-09-11T23:22:29.782348+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782348+0000","last_undegraded":"2024-09-11T23:22:29.782348+0000","last_fullsized":"2024-09-11T23:22:29.782348+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781742+0000","last_change":"2024-09-11T23:22:29.781742+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781742+0000","last_undegraded":"2024-09-11T23:22:29.781742+0000","last_fullsized":"2024-09-11T23:22:29.781742+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.788359+0000","last_change":"2024-09-11T23:22:29.788359+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.788359+0000","last_undegraded":"2024-09-11T23:22:29.788359+0000","last_fullsized":"2024-09-11T23:22:29.788359+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783819+0000","last_change":"2024-09-11T23:22:29.783819+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783819+0000","last_undegraded":"2024-09-11T23:22:29.783819+0000","last_fullsized":"2024-09-11T23:22:29.783819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.789270+0000","last_change":"2024-09-11T23:22:29.789270+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.789270+0000","last_undegraded":"2024-09-11T23:22:29.789270+0000","last_fullsized":"2024-09-11T23:22:29.789270+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781384+0000","last_change":"2024-09-11T23:22:29.781384+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781384+0000","last_undegraded":"2024-09-11T23:22:29.781384+0000","last_fullsized":"2024-09-11T23:22:29.781384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781243+0000","last_change":"2024-09-11T23:22:29.781243+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781243+0000","last_undegraded":"2024-09-11T23:22:29.781243+0000","last_fullsized":"2024-09-11T23:22:29.781243+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780707+0000","last_change":"2024-09-11T23:22:29.780707+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780707+0000","last_undegraded":"2024-09-11T23:22:29.780707+0000","last_fullsized":"2024-09-11T23:22:29.780707+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782038+0000","last_change":"2024-09-11T23:22:29.782038+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782038+0000","last_undegraded":"2024-09-11T23:22:29.782038+0000","last_fullsized":"2024-09-11T23:22:29.782038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782012+0000","last_change":"2024-09-11T23:22:29.782012+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782012+0000","last_undegraded":"2024-09-11T23:22:29.782012+0000","last_fullsized":"2024-09-11T23:22:29.782012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.802180+0000","last_change":"2024-09-11T23:22:29.801202+0000","last_active":"2024-09-11T23:22:29.802180+0000","last_peered":"2024-09-11T23:22:29.802180+0000","last_clean":"2024-09-11T23:22:29.802180+0000","last_became_active":"2024-09-11T23:22:29.800931+0000","last_became_peered":"2024-09-11T23:22:29.800931+0000","last_unstale":"2024-09-11T23:22:29.802180+0000","last_undegraded":"2024-09-11T23:22:29.802180+0000","last_fullsized":"2024-09-11T23:22:29.802180+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:33.581201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.787990+0000","last_change":"2024-09-11T23:22:29.787990+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.787990+0000","last_undegraded":"2024-09-11T23:22:29.787990+0000","last_fullsized":"2024-09-11T23:22:29.787990+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.795398+0000","last_change":"2024-09-11T23:22:29.791510+0000","last_active":"2024-09-11T23:22:29.795398+0000","last_peered":"2024-09-11T23:22:29.795398+0000","last_clean":"2024-09-11T23:22:29.795398+0000","last_became_active":"2024-09-11T23:22:29.791216+0000","last_became_peered":"2024-09-11T23:22:29.791216+0000","last_unstale":"2024-09-11T23:22:29.795398+0000","last_undegraded":"2024-09-11T23:22:29.795398+0000","last_fullsized":"2024-09-11T23:22:29.795398+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:04:07.998110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.787174+0000","last_change":"2024-09-11T23:22:29.787174+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.787174+0000","last_undegraded":"2024-09-11T23:22:29.787174+0000","last_fullsized":"2024-09-11T23:22:29.787174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801045+0000","last_change":"2024-09-11T23:22:29.797262+0000","last_active":"2024-09-11T23:22:29.801045+0000","last_peered":"2024-09-11T23:22:29.801045+0000","last_clean":"2024-09-11T23:22:29.801045+0000","last_became_active":"2024-09-11T23:22:29.796852+0000","last_became_peered":"2024-09-11T23:22:29.796852+0000","last_unstale":"2024-09-11T23:22:29.801045+0000","last_undegraded":"2024-09-11T23:22:29.801045+0000","last_fullsized":"2024-09-11T23:22:29.801045+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:45.746458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.784903+0000","last_change":"2024-09-11T23:22:29.784903+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.784903+0000","last_undegraded":"2024-09-11T23:22:29.784903+0000","last_fullsized":"2024-09-11T23:22:29.784903+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801050+0000","last_change":"2024-09-11T23:22:29.798952+0000","last_active":"2024-09-11T23:22:29.801050+0000","last_peered":"2024-09-11T23:22:29.801050+0000","last_clean":"2024-09-11T23:22:29.801050+0000","last_became_active":"2024-09-11T23:22:29.798584+0000","last_became_peered":"2024-09-11T23:22:29.798584+0000","last_unstale":"2024-09-11T23:22:29.801050+0000","last_undegraded":"2024-09-11T23:22:29.801050+0000","last_fullsized":"2024-09-11T23:22:29.801050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:32.388072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780839+0000","last_change":"2024-09-11T23:22:29.780839+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780839+0000","last_undegraded":"2024-09-11T23:22:29.780839+0000","last_fullsized":"2024-09-11T23:22:29.780839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.795695+0000","last_change":"2024-09-11T23:22:29.791619+0000","last_active":"2024-09-11T23:22:29.795695+0000","last_peered":"2024-09-11T23:22:29.795695+0000","last_clean":"2024-09-11T23:22:29.795695+0000","last_became_active":"2024-09-11T23:22:29.791285+0000","last_became_peered":"2024-09-11T23:22:29.791285+0000","last_unstale":"2024-09-11T23:22:29.795695+0000","last_undegraded":"2024-09-11T23:22:29.795695+0000","last_fullsized":"2024-09-11T23:22:29.795695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:18.720260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781627+0000","last_change":"2024-09-11T23:22:29.781627+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781627+0000","last_undegraded":"2024-09-11T23:22:29.781627+0000","last_fullsized":"2024-09-11T23:22:29.781627+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800715+0000","last_change":"2024-09-11T23:22:29.799472+0000","last_active":"2024-09-11T23:22:29.800715+0000","last_peered":"2024-09-11T23:22:29.800715+0000","last_clean":"2024-09-11T23:22:29.800715+0000","last_became_active":"2024-09-11T23:22:29.799108+0000","last_became_peered":"2024-09-11T23:22:29.799108+0000","last_unstale":"2024-09-11T23:22:29.800715+0000","last_undegraded":"2024-09-11T23:22:29.800715+0000","last_fullsized":"2024-09-11T23:22:29.800715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:11.066365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.788039+0000","last_change":"2024-09-11T23:22:29.788039+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.788039+0000","last_undegraded":"2024-09-11T23:22:29.788039+0000","last_fullsized":"2024-09-11T23:22:29.788039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800415+0000","last_change":"2024-09-11T23:22:29.794917+0000","last_active":"2024-09-11T23:22:29.800415+0000","last_peered":"2024-09-11T23:22:29.800415+0000","last_clean":"2024-09-11T23:22:29.800415+0000","last_became_active":"2024-09-11T23:22:29.794644+0000","last_became_peered":"2024-09-11T23:22:29.794644+0000","last_unstale":"2024-09-11T23:22:29.800415+0000","last_undegraded":"2024-09-11T23:22:29.800415+0000","last_fullsized":"2024-09-11T23:22:29.800415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:11.157987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783457+0000","last_change":"2024-09-11T23:22:29.783457+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783457+0000","last_undegraded":"2024-09-11T23:22:29.783457+0000","last_fullsized":"2024-09-11T23:22:29.783457+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.795631+0000","last_change":"2024-09-11T23:22:29.791904+0000","last_active":"2024-09-11T23:22:29.795631+0000","last_peered":"2024-09-11T23:22:29.795631+0000","last_clean":"2024-09-11T23:22:29.795631+0000","last_became_active":"2024-09-11T23:22:29.791075+0000","last_became_peered":"2024-09-11T23:22:29.791075+0000","last_unstale":"2024-09-11T23:22:29.795631+0000","last_undegraded":"2024-09-11T23:22:29.795631+0000","last_fullsized":"2024-09-11T23:22:29.795631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:16.262655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.785519+0000","last_change":"2024-09-11T23:22:29.785519+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.785519+0000","last_undegraded":"2024-09-11T23:22:29.785519+0000","last_fullsized":"2024-09-11T23:22:29.785519+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801364+0000","last_change":"2024-09-11T23:22:29.800033+0000","last_active":"2024-09-11T23:22:29.801364+0000","last_peered":"2024-09-11T23:22:29.801364+0000","last_clean":"2024-09-11T23:22:29.801364+0000","last_became_active":"2024-09-11T23:22:29.799648+0000","last_became_peered":"2024-09-11T23:22:29.799648+0000","last_unstale":"2024-09-11T23:22:29.801364+0000","last_undegraded":"2024-09-11T23:22:29.801364+0000","last_fullsized":"2024-09-11T23:22:29.801364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:18.891456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.777915+0000","last_change":"2024-09-11T23:22:29.777915+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.777915+0000","last_undegraded":"2024-09-11T23:22:29.777915+0000","last_fullsized":"2024-09-11T23:22:29.777915+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.799704+0000","last_change":"2024-09-11T23:22:29.797980+0000","last_active":"2024-09-11T23:22:29.799704+0000","last_peered":"2024-09-11T23:22:29.799704+0000","last_clean":"2024-09-11T23:22:29.799704+0000","last_became_active":"2024-09-11T23:22:29.797613+0000","last_became_peered":"2024-09-11T23:22:29.797613+0000","last_unstale":"2024-09-11T23:22:29.799704+0000","last_undegraded":"2024-09-11T23:22:29.799704+0000","last_fullsized":"2024-09-11T23:22:29.799704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:57.423778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780370+0000","last_change":"2024-09-11T23:22:29.780370+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780370+0000","last_undegraded":"2024-09-11T23:22:29.780370+0000","last_fullsized":"2024-09-11T23:22:29.780370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.798784+0000","last_change":"2024-09-11T23:22:29.796274+0000","last_active":"2024-09-11T23:22:29.798784+0000","last_peered":"2024-09-11T23:22:29.798784+0000","last_clean":"2024-09-11T23:22:29.798784+0000","last_became_active":"2024-09-11T23:22:29.796007+0000","last_became_peered":"2024-09-11T23:22:29.796007+0000","last_unstale":"2024-09-11T23:22:29.798784+0000","last_undegraded":"2024-09-11T23:22:29.798784+0000","last_fullsized":"2024-09-11T23:22:29.798784+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:00.496690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783358+0000","last_change":"2024-09-11T23:22:29.783358+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783358+0000","last_undegraded":"2024-09-11T23:22:29.783358+0000","last_fullsized":"2024-09-11T23:22:29.783358+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.795958+0000","last_change":"2024-09-11T23:22:29.794370+0000","last_active":"2024-09-11T23:22:29.795958+0000","last_peered":"2024-09-11T23:22:29.795958+0000","last_clean":"2024-09-11T23:22:29.795958+0000","last_became_active":"2024-09-11T23:22:29.794076+0000","last_became_peered":"2024-09-11T23:22:29.794076+0000","last_unstale":"2024-09-11T23:22:29.795958+0000","last_undegraded":"2024-09-11T23:22:29.795958+0000","last_fullsized":"2024-09-11T23:22:29.795958+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:56.009289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780157+0000","last_change":"2024-09-11T23:22:29.780157+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780157+0000","last_undegraded":"2024-09-11T23:22:29.780157+0000","last_fullsized":"2024-09-11T23:22:29.780157+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.790304+0000","last_change":"2024-09-11T23:22:29.788351+0000","last_active":"2024-09-11T23:22:29.790304+0000","last_peered":"2024-09-11T23:22:29.790304+0000","last_clean":"2024-09-11T23:22:29.790304+0000","last_became_active":"2024-09-11T23:22:29.788085+0000","last_became_peered":"2024-09-11T23:22:29.788085+0000","last_unstale":"2024-09-11T23:22:29.790304+0000","last_undegraded":"2024-09-11T23:22:29.790304+0000","last_fullsized":"2024-09-11T23:22:29.790304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:59.256338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.784634+0000","last_change":"2024-09-11T23:22:29.784634+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.784634+0000","last_undegraded":"2024-09-11T23:22:29.784634+0000","last_fullsized":"2024-09-11T23:22:29.784634+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801471+0000","last_change":"2024-09-11T23:22:29.793974+0000","last_active":"2024-09-11T23:22:29.801471+0000","last_peered":"2024-09-11T23:22:29.801471+0000","last_clean":"2024-09-11T23:22:29.801471+0000","last_became_active":"2024-09-11T23:22:29.793537+0000","last_became_peered":"2024-09-11T23:22:29.793537+0000","last_unstale":"2024-09-11T23:22:29.801471+0000","last_undegraded":"2024-09-11T23:22:29.801471+0000","last_fullsized":"2024-09-11T23:22:29.801471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:29.665243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.779771+0000","last_change":"2024-09-11T23:22:29.779771+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.779771+0000","last_undegraded":"2024-09-11T23:22:29.779771+0000","last_fullsized":"2024-09-11T23:22:29.779771+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.793226+0000","last_change":"2024-09-11T23:22:29.786056+0000","last_active":"2024-09-11T23:22:29.793226+0000","last_peered":"2024-09-11T23:22:29.793226+0000","last_clean":"2024-09-11T23:22:29.793226+0000","last_became_active":"2024-09-11T23:22:29.785767+0000","last_became_peered":"2024-09-11T23:22:29.785767+0000","last_unstale":"2024-09-11T23:22:29.793226+0000","last_undegraded":"2024-09-11T23:22:29.793226+0000","last_fullsized":"2024-09-11T23:22:29.793226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:53.387875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780406+0000","last_change":"2024-09-11T23:22:29.780406+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780406+0000","last_undegraded":"2024-09-11T23:22:29.780406+0000","last_fullsized":"2024-09-11T23:22:29.780406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800328+0000","last_change":"2024-09-11T23:22:29.795359+0000","last_active":"2024-09-11T23:22:29.800328+0000","last_peered":"2024-09-11T23:22:29.800328+0000","last_clean":"2024-09-11T23:22:29.800328+0000","last_became_active":"2024-09-11T23:22:29.794120+0000","last_became_peered":"2024-09-11T23:22:29.794120+0000","last_unstale":"2024-09-11T23:22:29.800328+0000","last_undegraded":"2024-09-11T23:22:29.800328+0000","last_fullsized":"2024-09-11T23:22:29.800328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:43.513789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.787891+0000","last_change":"2024-09-11T23:22:29.787891+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.787891+0000","last_undegraded":"2024-09-11T23:22:29.787891+0000","last_fullsized":"2024-09-11T23:22:29.787891+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.798059+0000","last_change":"2024-09-11T23:22:29.795929+0000","last_active":"2024-09-11T23:22:29.798059+0000","last_peered":"2024-09-11T23:22:29.798059+0000","last_clean":"2024-09-11T23:22:29.798059+0000","last_became_active":"2024-09-11T23:22:29.795634+0000","last_became_peered":"2024-09-11T23:22:29.795634+0000","last_unstale":"2024-09-11T23:22:29.798059+0000","last_undegraded":"2024-09-11T23:22:29.798059+0000","last_fullsized":"2024-09-11T23:22:29.798059+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:18.720260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.787577+0000","last_change":"2024-09-11T23:22:29.787577+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.787577+0000","last_undegraded":"2024-09-11T23:22:29.787577+0000","last_fullsized":"2024-09-11T23:22:29.787577+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.795140+0000","last_change":"2024-09-11T23:22:29.793636+0000","last_active":"2024-09-11T23:22:29.795140+0000","last_peered":"2024-09-11T23:22:29.795140+0000","last_clean":"2024-09-11T23:22:29.795140+0000","last_became_active":"2024-09-11T23:22:29.793346+0000","last_became_peered":"2024-09-11T23:22:29.793346+0000","last_unstale":"2024-09-11T23:22:29.795140+0000","last_undegraded":"2024-09-11T23:22:29.795140+0000","last_fullsized":"2024-09-11T23:22:29.795140+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:56.009289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782650+0000","last_change":"2024-09-11T23:22:29.782650+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782650+0000","last_undegraded":"2024-09-11T23:22:29.782650+0000","last_fullsized":"2024-09-11T23:22:29.782650+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800356+0000","last_change":"2024-09-11T23:22:29.795529+0000","last_active":"2024-09-11T23:22:29.800356+0000","last_peered":"2024-09-11T23:22:29.800356+0000","last_clean":"2024-09-11T23:22:29.800356+0000","last_became_active":"2024-09-11T23:22:29.794606+0000","last_became_peered":"2024-09-11T23:22:29.794606+0000","last_unstale":"2024-09-11T23:22:29.800356+0000","last_undegraded":"2024-09-11T23:22:29.800356+0000","last_fullsized":"2024-09-11T23:22:29.800356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:33.678630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783064+0000","last_change":"2024-09-11T23:22:29.783064+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783064+0000","last_undegraded":"2024-09-11T23:22:29.783064+0000","last_fullsized":"2024-09-11T23:22:29.783064+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.806279+0000","last_change":"2024-09-11T23:22:29.801734+0000","last_active":"2024-09-11T23:22:29.806279+0000","last_peered":"2024-09-11T23:22:29.806279+0000","last_clean":"2024-09-11T23:22:29.806279+0000","last_became_active":"2024-09-11T23:22:29.800988+0000","last_became_peered":"2024-09-11T23:22:29.800988+0000","last_unstale":"2024-09-11T23:22:29.806279+0000","last_undegraded":"2024-09-11T23:22:29.806279+0000","last_fullsized":"2024-09-11T23:22:29.806279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:15.181135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.778271+0000","last_change":"2024-09-11T23:22:29.778271+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.778271+0000","last_undegraded":"2024-09-11T23:22:29.778271+0000","last_fullsized":"2024-09-11T23:22:29.778271+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800477+0000","last_change":"2024-09-11T23:22:29.790559+0000","last_active":"2024-09-11T23:22:29.800477+0000","last_peered":"2024-09-11T23:22:29.800477+0000","last_clean":"2024-09-11T23:22:29.800477+0000","last_became_active":"2024-09-11T23:22:29.790290+0000","last_became_peered":"2024-09-11T23:22:29.790290+0000","last_unstale":"2024-09-11T23:22:29.800477+0000","last_undegraded":"2024-09-11T23:22:29.800477+0000","last_fullsized":"2024-09-11T23:22:29.800477+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:04.100862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781929+0000","last_change":"2024-09-11T23:22:29.781929+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781929+0000","last_undegraded":"2024-09-11T23:22:29.781929+0000","last_fullsized":"2024-09-11T23:22:29.781929+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.803052+0000","last_change":"2024-09-11T23:22:29.797708+0000","last_active":"2024-09-11T23:22:29.803052+0000","last_peered":"2024-09-11T23:22:29.803052+0000","last_clean":"2024-09-11T23:22:29.803052+0000","last_became_active":"2024-09-11T23:22:29.796870+0000","last_became_peered":"2024-09-11T23:22:29.796870+0000","last_unstale":"2024-09-11T23:22:29.803052+0000","last_undegraded":"2024-09-11T23:22:29.803052+0000","last_fullsized":"2024-09-11T23:22:29.803052+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:14.567731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.777997+0000","last_change":"2024-09-11T23:22:29.777997+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.777997+0000","last_undegraded":"2024-09-11T23:22:29.777997+0000","last_fullsized":"2024-09-11T23:22:29.777997+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.809100+0000","last_change":"2024-09-11T23:22:29.803838+0000","last_active":"2024-09-11T23:22:29.809100+0000","last_peered":"2024-09-11T23:22:29.809100+0000","last_clean":"2024-09-11T23:22:29.809100+0000","last_became_active":"2024-09-11T23:22:29.803457+0000","last_became_peered":"2024-09-11T23:22:29.803457+0000","last_unstale":"2024-09-11T23:22:29.809100+0000","last_undegraded":"2024-09-11T23:22:29.809100+0000","last_fullsized":"2024-09-11T23:22:29.809100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:30.624506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781127+0000","last_change":"2024-09-11T23:22:29.781127+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781127+0000","last_undegraded":"2024-09-11T23:22:29.781127+0000","last_fullsized":"2024-09-11T23:22:29.781127+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801544+0000","last_change":"2024-09-11T23:22:29.796232+0000","last_active":"2024-09-11T23:22:29.801544+0000","last_peered":"2024-09-11T23:22:29.801544+0000","last_clean":"2024-09-11T23:22:29.801544+0000","last_became_active":"2024-09-11T23:22:29.795936+0000","last_became_peered":"2024-09-11T23:22:29.795936+0000","last_unstale":"2024-09-11T23:22:29.801544+0000","last_undegraded":"2024-09-11T23:22:29.801544+0000","last_fullsized":"2024-09-11T23:22:29.801544+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:51.278777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.789036+0000","last_change":"2024-09-11T23:22:29.789036+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.789036+0000","last_undegraded":"2024-09-11T23:22:29.789036+0000","last_fullsized":"2024-09-11T23:22:29.789036+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.791258+0000","last_change":"2024-09-11T23:22:29.787519+0000","last_active":"2024-09-11T23:22:29.791258+0000","last_peered":"2024-09-11T23:22:29.791258+0000","last_clean":"2024-09-11T23:22:29.791258+0000","last_became_active":"2024-09-11T23:22:29.787222+0000","last_became_peered":"2024-09-11T23:22:29.787222+0000","last_unstale":"2024-09-11T23:22:29.791258+0000","last_undegraded":"2024-09-11T23:22:29.791258+0000","last_fullsized":"2024-09-11T23:22:29.791258+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:40.941861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.786702+0000","last_change":"2024-09-11T23:22:29.786702+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.786702+0000","last_undegraded":"2024-09-11T23:22:29.786702+0000","last_fullsized":"2024-09-11T23:22:29.786702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800628+0000","last_change":"2024-09-11T23:22:29.798913+0000","last_active":"2024-09-11T23:22:29.800628+0000","last_peered":"2024-09-11T23:22:29.800628+0000","last_clean":"2024-09-11T23:22:29.800628+0000","last_became_active":"2024-09-11T23:22:29.798524+0000","last_became_peered":"2024-09-11T23:22:29.798524+0000","last_unstale":"2024-09-11T23:22:29.800628+0000","last_undegraded":"2024-09-11T23:22:29.800628+0000","last_fullsized":"2024-09-11T23:22:29.800628+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:11.066365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780298+0000","last_change":"2024-09-11T23:22:29.780298+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780298+0000","last_undegraded":"2024-09-11T23:22:29.780298+0000","last_fullsized":"2024-09-11T23:22:29.780298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.798015+0000","last_change":"2024-09-11T23:22:29.795594+0000","last_active":"2024-09-11T23:22:29.798015+0000","last_peered":"2024-09-11T23:22:29.798015+0000","last_clean":"2024-09-11T23:22:29.798015+0000","last_became_active":"2024-09-11T23:22:29.795192+0000","last_became_peered":"2024-09-11T23:22:29.795192+0000","last_unstale":"2024-09-11T23:22:29.798015+0000","last_undegraded":"2024-09-11T23:22:29.798015+0000","last_fullsized":"2024-09-11T23:22:29.798015+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:04:07.998110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.778714+0000","last_change":"2024-09-11T23:22:29.778714+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.778714+0000","last_undegraded":"2024-09-11T23:22:29.778714+0000","last_fullsized":"2024-09-11T23:22:29.778714+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800276+0000","last_change":"2024-09-11T23:22:29.795182+0000","last_active":"2024-09-11T23:22:29.800276+0000","last_peered":"2024-09-11T23:22:29.800276+0000","last_clean":"2024-09-11T23:22:29.800276+0000","last_became_active":"2024-09-11T23:22:29.794863+0000","last_became_peered":"2024-09-11T23:22:29.794863+0000","last_unstale":"2024-09-11T23:22:29.800276+0000","last_undegraded":"2024-09-11T23:22:29.800276+0000","last_fullsized":"2024-09-11T23:22:29.800276+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:23.886099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780002+0000","last_change":"2024-09-11T23:22:29.780002+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780002+0000","last_undegraded":"2024-09-11T23:22:29.780002+0000","last_fullsized":"2024-09-11T23:22:29.780002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.797531+0000","last_change":"2024-09-11T23:22:29.793776+0000","last_active":"2024-09-11T23:22:29.797531+0000","last_peered":"2024-09-11T23:22:29.797531+0000","last_clean":"2024-09-11T23:22:29.797531+0000","last_became_active":"2024-09-11T23:22:29.793426+0000","last_became_peered":"2024-09-11T23:22:29.793426+0000","last_unstale":"2024-09-11T23:22:29.797531+0000","last_undegraded":"2024-09-11T23:22:29.797531+0000","last_fullsized":"2024-09-11T23:22:29.797531+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:00.496690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.785567+0000","last_change":"2024-09-11T23:22:29.785567+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.785567+0000","last_undegraded":"2024-09-11T23:22:29.785567+0000","last_fullsized":"2024-09-11T23:22:29.785567+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801184+0000","last_change":"2024-09-11T23:22:29.800003+0000","last_active":"2024-09-11T23:22:29.801184+0000","last_peered":"2024-09-11T23:22:29.801184+0000","last_clean":"2024-09-11T23:22:29.801184+0000","last_became_active":"2024-09-11T23:22:29.799292+0000","last_became_peered":"2024-09-11T23:22:29.799292+0000","last_unstale":"2024-09-11T23:22:29.801184+0000","last_undegraded":"2024-09-11T23:22:29.801184+0000","last_fullsized":"2024-09-11T23:22:29.801184+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:06.176294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782668+0000","last_change":"2024-09-11T23:22:29.782668+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782668+0000","last_undegraded":"2024-09-11T23:22:29.782668+0000","last_fullsized":"2024-09-11T23:22:29.782668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.798925+0000","last_change":"2024-09-11T23:22:29.794909+0000","last_active":"2024-09-11T23:22:29.798925+0000","last_peered":"2024-09-11T23:22:29.798925+0000","last_clean":"2024-09-11T23:22:29.798925+0000","last_became_active":"2024-09-11T23:22:29.794633+0000","last_became_peered":"2024-09-11T23:22:29.794633+0000","last_unstale":"2024-09-11T23:22:29.798925+0000","last_undegraded":"2024-09-11T23:22:29.798925+0000","last_fullsized":"2024-09-11T23:22:29.798925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:57.423778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.778998+0000","last_change":"2024-09-11T23:22:29.778998+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.778998+0000","last_undegraded":"2024-09-11T23:22:29.778998+0000","last_fullsized":"2024-09-11T23:22:29.778998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.797333+0000","last_change":"2024-09-11T23:22:29.794603+0000","last_active":"2024-09-11T23:22:29.797333+0000","last_peered":"2024-09-11T23:22:29.797333+0000","last_clean":"2024-09-11T23:22:29.797333+0000","last_became_active":"2024-09-11T23:22:29.794225+0000","last_became_peered":"2024-09-11T23:22:29.794225+0000","last_unstale":"2024-09-11T23:22:29.797333+0000","last_undegraded":"2024-09-11T23:22:29.797333+0000","last_fullsized":"2024-09-11T23:22:29.797333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:35.708584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":320,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.788260+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:22:29.788260+0000","last_peered":"2024-09-11T23:22:29.788260+0000","last_clean":"2024-09-11T23:22:29.788260+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:22:29.788260+0000","last_undegraded":"2024-09-11T23:22:29.788260+0000","last_fullsized":"2024-09-11T23:22:29.788260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476797,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1576960,"data_stored":1008114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476796,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":417746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476795,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":417746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476795,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":983040,"data_stored":417746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542204,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":417746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542204,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":417746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509500,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":970752,"data_stored":411471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509500,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1576960,"data_stored":1008114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:22:35.778 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3f is not active+clean 2024-09-11T23:22:35.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.788382+0000', 'last_change': '2024-09-11T23:22:29.788382+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.788382+0000', 'last_undegraded': '2024-09-11T23:22:29.788382+0000', 'last_fullsized': '2024-09-11T23:22:29.788382+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T23:22:35.778 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3e is not active+clean 2024-09-11T23:22:35.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.786400+0000', 'last_change': '2024-09-11T23:22:29.786400+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.786400+0000', 'last_undegraded': '2024-09-11T23:22:29.786400+0000', 'last_fullsized': '2024-09-11T23:22:29.786400+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:22:35.778 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3d is not active+clean 2024-09-11T23:22:35.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.785377+0000', 'last_change': '2024-09-11T23:22:29.785377+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.785377+0000', 'last_undegraded': '2024-09-11T23:22:29.785377+0000', 'last_fullsized': '2024-09-11T23:22:29.785377+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T23:22:35.778 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3c is not active+clean 2024-09-11T23:22:35.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.783871+0000', 'last_change': '2024-09-11T23:22:29.783871+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.783871+0000', 'last_undegraded': '2024-09-11T23:22:29.783871+0000', 'last_fullsized': '2024-09-11T23:22:29.783871+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:22:35.779 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3b is not active+clean 2024-09-11T23:22:35.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.782095+0000', 'last_change': '2024-09-11T23:22:29.782095+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.782095+0000', 'last_undegraded': '2024-09-11T23:22:29.782095+0000', 'last_fullsized': '2024-09-11T23:22:29.782095+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T23:22:35.779 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3a is not active+clean 2024-09-11T23:22:35.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.779411+0000', 'last_change': '2024-09-11T23:22:29.779411+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.779411+0000', 'last_undegraded': '2024-09-11T23:22:29.779411+0000', 'last_fullsized': '2024-09-11T23:22:29.779411+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T23:22:35.779 INFO:tasks.ceph.ceph_manager.ceph:PG 13.39 is not active+clean 2024-09-11T23:22:35.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.781715+0000', 'last_change': '2024-09-11T23:22:29.781715+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.781715+0000', 'last_undegraded': '2024-09-11T23:22:29.781715+0000', 'last_fullsized': '2024-09-11T23:22:29.781715+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:22:35.779 INFO:tasks.ceph.ceph_manager.ceph:PG 13.38 is not active+clean 2024-09-11T23:22:35.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.777866+0000', 'last_change': '2024-09-11T23:22:29.777866+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.777866+0000', 'last_undegraded': '2024-09-11T23:22:29.777866+0000', 'last_fullsized': '2024-09-11T23:22:29.777866+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T23:22:35.779 INFO:tasks.ceph.ceph_manager.ceph:PG 13.37 is not active+clean 2024-09-11T23:22:35.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.779067+0000', 'last_change': '2024-09-11T23:22:29.779067+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.779067+0000', 'last_undegraded': '2024-09-11T23:22:29.779067+0000', 'last_fullsized': '2024-09-11T23:22:29.779067+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T23:22:35.779 INFO:tasks.ceph.ceph_manager.ceph:PG 13.36 is not active+clean 2024-09-11T23:22:35.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.784817+0000', 'last_change': '2024-09-11T23:22:29.784817+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.784817+0000', 'last_undegraded': '2024-09-11T23:22:29.784817+0000', 'last_fullsized': '2024-09-11T23:22:29.784817+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T23:22:35.780 INFO:tasks.ceph.ceph_manager.ceph:PG 13.35 is not active+clean 2024-09-11T23:22:35.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.786000+0000', 'last_change': '2024-09-11T23:22:29.786000+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.786000+0000', 'last_undegraded': '2024-09-11T23:22:29.786000+0000', 'last_fullsized': '2024-09-11T23:22:29.786000+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:22:35.780 INFO:tasks.ceph.ceph_manager.ceph:PG 13.34 is not active+clean 2024-09-11T23:22:35.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.790174+0000', 'last_change': '2024-09-11T23:22:29.790174+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.790174+0000', 'last_undegraded': '2024-09-11T23:22:29.790174+0000', 'last_fullsized': '2024-09-11T23:22:29.790174+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T23:22:35.780 INFO:tasks.ceph.ceph_manager.ceph:PG 13.33 is not active+clean 2024-09-11T23:22:35.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.785141+0000', 'last_change': '2024-09-11T23:22:29.785141+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.785141+0000', 'last_undegraded': '2024-09-11T23:22:29.785141+0000', 'last_fullsized': '2024-09-11T23:22:29.785141+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T23:22:35.780 INFO:tasks.ceph.ceph_manager.ceph:PG 13.32 is not active+clean 2024-09-11T23:22:35.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.784120+0000', 'last_change': '2024-09-11T23:22:29.784120+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.784120+0000', 'last_undegraded': '2024-09-11T23:22:29.784120+0000', 'last_fullsized': '2024-09-11T23:22:29.784120+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:22:35.780 INFO:tasks.ceph.ceph_manager.ceph:PG 13.31 is not active+clean 2024-09-11T23:22:35.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.786586+0000', 'last_change': '2024-09-11T23:22:29.786586+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.786586+0000', 'last_undegraded': '2024-09-11T23:22:29.786586+0000', 'last_fullsized': '2024-09-11T23:22:29.786586+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T23:22:35.781 INFO:tasks.ceph.ceph_manager.ceph:PG 13.30 is not active+clean 2024-09-11T23:22:35.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.783492+0000', 'last_change': '2024-09-11T23:22:29.783492+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.783492+0000', 'last_undegraded': '2024-09-11T23:22:29.783492+0000', 'last_fullsized': '2024-09-11T23:22:29.783492+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T23:22:35.781 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2f is not active+clean 2024-09-11T23:22:35.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.781621+0000', 'last_change': '2024-09-11T23:22:29.781621+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.781621+0000', 'last_undegraded': '2024-09-11T23:22:29.781621+0000', 'last_fullsized': '2024-09-11T23:22:29.781621+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T23:22:35.781 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2e is not active+clean 2024-09-11T23:22:35.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.783714+0000', 'last_change': '2024-09-11T23:22:29.783714+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.783714+0000', 'last_undegraded': '2024-09-11T23:22:29.783714+0000', 'last_fullsized': '2024-09-11T23:22:29.783714+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:22:35.781 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2d is not active+clean 2024-09-11T23:22:35.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.780149+0000', 'last_change': '2024-09-11T23:22:29.780149+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.780149+0000', 'last_undegraded': '2024-09-11T23:22:29.780149+0000', 'last_fullsized': '2024-09-11T23:22:29.780149+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:22:35.782 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2c is not active+clean 2024-09-11T23:22:35.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.783439+0000', 'last_change': '2024-09-11T23:22:29.783439+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.783439+0000', 'last_undegraded': '2024-09-11T23:22:29.783439+0000', 'last_fullsized': '2024-09-11T23:22:29.783439+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:22:35.782 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2b is not active+clean 2024-09-11T23:22:35.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.782157+0000', 'last_change': '2024-09-11T23:22:29.782157+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.782157+0000', 'last_undegraded': '2024-09-11T23:22:29.782157+0000', 'last_fullsized': '2024-09-11T23:22:29.782157+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:22:35.782 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2a is not active+clean 2024-09-11T23:22:35.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.784771+0000', 'last_change': '2024-09-11T23:22:29.784771+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.784771+0000', 'last_undegraded': '2024-09-11T23:22:29.784771+0000', 'last_fullsized': '2024-09-11T23:22:29.784771+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:22:35.782 INFO:tasks.ceph.ceph_manager.ceph:PG 13.29 is not active+clean 2024-09-11T23:22:35.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.783276+0000', 'last_change': '2024-09-11T23:22:29.783276+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.783276+0000', 'last_undegraded': '2024-09-11T23:22:29.783276+0000', 'last_fullsized': '2024-09-11T23:22:29.783276+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T23:22:35.782 INFO:tasks.ceph.ceph_manager.ceph:PG 13.28 is not active+clean 2024-09-11T23:22:35.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.782348+0000', 'last_change': '2024-09-11T23:22:29.782348+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.782348+0000', 'last_undegraded': '2024-09-11T23:22:29.782348+0000', 'last_fullsized': '2024-09-11T23:22:29.782348+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:22:35.782 INFO:tasks.ceph.ceph_manager.ceph:PG 13.27 is not active+clean 2024-09-11T23:22:35.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.781742+0000', 'last_change': '2024-09-11T23:22:29.781742+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.781742+0000', 'last_undegraded': '2024-09-11T23:22:29.781742+0000', 'last_fullsized': '2024-09-11T23:22:29.781742+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:22:35.783 INFO:tasks.ceph.ceph_manager.ceph:PG 13.26 is not active+clean 2024-09-11T23:22:35.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.788359+0000', 'last_change': '2024-09-11T23:22:29.788359+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.788359+0000', 'last_undegraded': '2024-09-11T23:22:29.788359+0000', 'last_fullsized': '2024-09-11T23:22:29.788359+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T23:22:35.783 INFO:tasks.ceph.ceph_manager.ceph:PG 13.25 is not active+clean 2024-09-11T23:22:35.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.783819+0000', 'last_change': '2024-09-11T23:22:29.783819+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.783819+0000', 'last_undegraded': '2024-09-11T23:22:29.783819+0000', 'last_fullsized': '2024-09-11T23:22:29.783819+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T23:22:35.783 INFO:tasks.ceph.ceph_manager.ceph:PG 13.24 is not active+clean 2024-09-11T23:22:35.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.789270+0000', 'last_change': '2024-09-11T23:22:29.789270+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.789270+0000', 'last_undegraded': '2024-09-11T23:22:29.789270+0000', 'last_fullsized': '2024-09-11T23:22:29.789270+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T23:22:35.783 INFO:tasks.ceph.ceph_manager.ceph:PG 13.23 is not active+clean 2024-09-11T23:22:35.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.781384+0000', 'last_change': '2024-09-11T23:22:29.781384+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.781384+0000', 'last_undegraded': '2024-09-11T23:22:29.781384+0000', 'last_fullsized': '2024-09-11T23:22:29.781384+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:22:35.783 INFO:tasks.ceph.ceph_manager.ceph:PG 13.22 is not active+clean 2024-09-11T23:22:35.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.781243+0000', 'last_change': '2024-09-11T23:22:29.781243+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.781243+0000', 'last_undegraded': '2024-09-11T23:22:29.781243+0000', 'last_fullsized': '2024-09-11T23:22:29.781243+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:22:35.784 INFO:tasks.ceph.ceph_manager.ceph:PG 13.21 is not active+clean 2024-09-11T23:22:35.784 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.780707+0000', 'last_change': '2024-09-11T23:22:29.780707+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.780707+0000', 'last_undegraded': '2024-09-11T23:22:29.780707+0000', 'last_fullsized': '2024-09-11T23:22:29.780707+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T23:22:35.784 INFO:tasks.ceph.ceph_manager.ceph:PG 13.20 is not active+clean 2024-09-11T23:22:35.784 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.782038+0000', 'last_change': '2024-09-11T23:22:29.782038+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.782038+0000', 'last_undegraded': '2024-09-11T23:22:29.782038+0000', 'last_fullsized': '2024-09-11T23:22:29.782038+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T23:22:35.784 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1e is not active+clean 2024-09-11T23:22:35.784 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.782012+0000', 'last_change': '2024-09-11T23:22:29.782012+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.782012+0000', 'last_undegraded': '2024-09-11T23:22:29.782012+0000', 'last_fullsized': '2024-09-11T23:22:29.782012+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T23:22:35.784 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1f is not active+clean 2024-09-11T23:22:35.784 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.787990+0000', 'last_change': '2024-09-11T23:22:29.787990+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.787990+0000', 'last_undegraded': '2024-09-11T23:22:29.787990+0000', 'last_fullsized': '2024-09-11T23:22:29.787990+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T23:22:35.784 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1c is not active+clean 2024-09-11T23:22:35.784 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.787174+0000', 'last_change': '2024-09-11T23:22:29.787174+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.787174+0000', 'last_undegraded': '2024-09-11T23:22:29.787174+0000', 'last_fullsized': '2024-09-11T23:22:29.787174+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T23:22:35.784 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1d is not active+clean 2024-09-11T23:22:35.785 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.784903+0000', 'last_change': '2024-09-11T23:22:29.784903+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.784903+0000', 'last_undegraded': '2024-09-11T23:22:29.784903+0000', 'last_fullsized': '2024-09-11T23:22:29.784903+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T23:22:35.785 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1a is not active+clean 2024-09-11T23:22:35.785 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.780839+0000', 'last_change': '2024-09-11T23:22:29.780839+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.780839+0000', 'last_undegraded': '2024-09-11T23:22:29.780839+0000', 'last_fullsized': '2024-09-11T23:22:29.780839+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:22:35.785 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1b is not active+clean 2024-09-11T23:22:35.785 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.781627+0000', 'last_change': '2024-09-11T23:22:29.781627+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.781627+0000', 'last_undegraded': '2024-09-11T23:22:29.781627+0000', 'last_fullsized': '2024-09-11T23:22:29.781627+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T23:22:35.785 INFO:tasks.ceph.ceph_manager.ceph:PG 13.18 is not active+clean 2024-09-11T23:22:35.785 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.788039+0000', 'last_change': '2024-09-11T23:22:29.788039+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.788039+0000', 'last_undegraded': '2024-09-11T23:22:29.788039+0000', 'last_fullsized': '2024-09-11T23:22:29.788039+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T23:22:35.785 INFO:tasks.ceph.ceph_manager.ceph:PG 13.19 is not active+clean 2024-09-11T23:22:35.785 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.783457+0000', 'last_change': '2024-09-11T23:22:29.783457+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.783457+0000', 'last_undegraded': '2024-09-11T23:22:29.783457+0000', 'last_fullsized': '2024-09-11T23:22:29.783457+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T23:22:35.785 INFO:tasks.ceph.ceph_manager.ceph:PG 13.16 is not active+clean 2024-09-11T23:22:35.786 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.785519+0000', 'last_change': '2024-09-11T23:22:29.785519+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.785519+0000', 'last_undegraded': '2024-09-11T23:22:29.785519+0000', 'last_fullsized': '2024-09-11T23:22:29.785519+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-11T23:22:35.786 INFO:tasks.ceph.ceph_manager.ceph:PG 13.17 is not active+clean 2024-09-11T23:22:35.786 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.777915+0000', 'last_change': '2024-09-11T23:22:29.777915+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.777915+0000', 'last_undegraded': '2024-09-11T23:22:29.777915+0000', 'last_fullsized': '2024-09-11T23:22:29.777915+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T23:22:35.786 INFO:tasks.ceph.ceph_manager.ceph:PG 13.14 is not active+clean 2024-09-11T23:22:35.786 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.780370+0000', 'last_change': '2024-09-11T23:22:29.780370+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.780370+0000', 'last_undegraded': '2024-09-11T23:22:29.780370+0000', 'last_fullsized': '2024-09-11T23:22:29.780370+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:22:35.786 INFO:tasks.ceph.ceph_manager.ceph:PG 13.15 is not active+clean 2024-09-11T23:22:35.786 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.783358+0000', 'last_change': '2024-09-11T23:22:29.783358+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.783358+0000', 'last_undegraded': '2024-09-11T23:22:29.783358+0000', 'last_fullsized': '2024-09-11T23:22:29.783358+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T23:22:35.786 INFO:tasks.ceph.ceph_manager.ceph:PG 13.12 is not active+clean 2024-09-11T23:22:35.786 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.780157+0000', 'last_change': '2024-09-11T23:22:29.780157+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.780157+0000', 'last_undegraded': '2024-09-11T23:22:29.780157+0000', 'last_fullsized': '2024-09-11T23:22:29.780157+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:22:35.786 INFO:tasks.ceph.ceph_manager.ceph:PG 13.13 is not active+clean 2024-09-11T23:22:35.786 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.784634+0000', 'last_change': '2024-09-11T23:22:29.784634+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.784634+0000', 'last_undegraded': '2024-09-11T23:22:29.784634+0000', 'last_fullsized': '2024-09-11T23:22:29.784634+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T23:22:35.786 INFO:tasks.ceph.ceph_manager.ceph:PG 13.10 is not active+clean 2024-09-11T23:22:35.787 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.779771+0000', 'last_change': '2024-09-11T23:22:29.779771+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.779771+0000', 'last_undegraded': '2024-09-11T23:22:29.779771+0000', 'last_fullsized': '2024-09-11T23:22:29.779771+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:22:35.787 INFO:tasks.ceph.ceph_manager.ceph:PG 13.11 is not active+clean 2024-09-11T23:22:35.787 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.780406+0000', 'last_change': '2024-09-11T23:22:29.780406+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.780406+0000', 'last_undegraded': '2024-09-11T23:22:29.780406+0000', 'last_fullsized': '2024-09-11T23:22:29.780406+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:22:35.787 INFO:tasks.ceph.ceph_manager.ceph:PG 13.e is not active+clean 2024-09-11T23:22:35.787 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.787891+0000', 'last_change': '2024-09-11T23:22:29.787891+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.787891+0000', 'last_undegraded': '2024-09-11T23:22:29.787891+0000', 'last_fullsized': '2024-09-11T23:22:29.787891+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T23:22:35.787 INFO:tasks.ceph.ceph_manager.ceph:PG 13.f is not active+clean 2024-09-11T23:22:35.787 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.787577+0000', 'last_change': '2024-09-11T23:22:29.787577+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.787577+0000', 'last_undegraded': '2024-09-11T23:22:29.787577+0000', 'last_fullsized': '2024-09-11T23:22:29.787577+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T23:22:35.787 INFO:tasks.ceph.ceph_manager.ceph:PG 13.d is not active+clean 2024-09-11T23:22:35.787 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.782650+0000', 'last_change': '2024-09-11T23:22:29.782650+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.782650+0000', 'last_undegraded': '2024-09-11T23:22:29.782650+0000', 'last_fullsized': '2024-09-11T23:22:29.782650+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T23:22:35.787 INFO:tasks.ceph.ceph_manager.ceph:PG 13.a is not active+clean 2024-09-11T23:22:35.787 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.783064+0000', 'last_change': '2024-09-11T23:22:29.783064+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.783064+0000', 'last_undegraded': '2024-09-11T23:22:29.783064+0000', 'last_fullsized': '2024-09-11T23:22:29.783064+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:22:35.788 INFO:tasks.ceph.ceph_manager.ceph:PG 13.b is not active+clean 2024-09-11T23:22:35.788 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.778271+0000', 'last_change': '2024-09-11T23:22:29.778271+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.778271+0000', 'last_undegraded': '2024-09-11T23:22:29.778271+0000', 'last_fullsized': '2024-09-11T23:22:29.778271+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T23:22:35.788 INFO:tasks.ceph.ceph_manager.ceph:PG 13.8 is not active+clean 2024-09-11T23:22:35.788 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.781929+0000', 'last_change': '2024-09-11T23:22:29.781929+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.781929+0000', 'last_undegraded': '2024-09-11T23:22:29.781929+0000', 'last_fullsized': '2024-09-11T23:22:29.781929+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T23:22:35.788 INFO:tasks.ceph.ceph_manager.ceph:PG 13.9 is not active+clean 2024-09-11T23:22:35.788 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.777997+0000', 'last_change': '2024-09-11T23:22:29.777997+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.777997+0000', 'last_undegraded': '2024-09-11T23:22:29.777997+0000', 'last_fullsized': '2024-09-11T23:22:29.777997+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T23:22:35.788 INFO:tasks.ceph.ceph_manager.ceph:PG 13.6 is not active+clean 2024-09-11T23:22:35.788 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.781127+0000', 'last_change': '2024-09-11T23:22:29.781127+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.781127+0000', 'last_undegraded': '2024-09-11T23:22:29.781127+0000', 'last_fullsized': '2024-09-11T23:22:29.781127+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T23:22:35.788 INFO:tasks.ceph.ceph_manager.ceph:PG 13.7 is not active+clean 2024-09-11T23:22:35.788 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.789036+0000', 'last_change': '2024-09-11T23:22:29.789036+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.789036+0000', 'last_undegraded': '2024-09-11T23:22:29.789036+0000', 'last_fullsized': '2024-09-11T23:22:29.789036+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T23:22:35.788 INFO:tasks.ceph.ceph_manager.ceph:PG 13.4 is not active+clean 2024-09-11T23:22:35.789 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.786702+0000', 'last_change': '2024-09-11T23:22:29.786702+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.786702+0000', 'last_undegraded': '2024-09-11T23:22:29.786702+0000', 'last_fullsized': '2024-09-11T23:22:29.786702+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T23:22:35.789 INFO:tasks.ceph.ceph_manager.ceph:PG 13.5 is not active+clean 2024-09-11T23:22:35.789 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.780298+0000', 'last_change': '2024-09-11T23:22:29.780298+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.780298+0000', 'last_undegraded': '2024-09-11T23:22:29.780298+0000', 'last_fullsized': '2024-09-11T23:22:29.780298+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-11T23:22:35.789 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2 is not active+clean 2024-09-11T23:22:35.789 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.778714+0000', 'last_change': '2024-09-11T23:22:29.778714+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.778714+0000', 'last_undegraded': '2024-09-11T23:22:29.778714+0000', 'last_fullsized': '2024-09-11T23:22:29.778714+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-11T23:22:35.789 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3 is not active+clean 2024-09-11T23:22:35.789 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.780002+0000', 'last_change': '2024-09-11T23:22:29.780002+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.780002+0000', 'last_undegraded': '2024-09-11T23:22:29.780002+0000', 'last_fullsized': '2024-09-11T23:22:29.780002+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T23:22:35.789 INFO:tasks.ceph.ceph_manager.ceph:PG 13.0 is not active+clean 2024-09-11T23:22:35.789 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.785567+0000', 'last_change': '2024-09-11T23:22:29.785567+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.785567+0000', 'last_undegraded': '2024-09-11T23:22:29.785567+0000', 'last_fullsized': '2024-09-11T23:22:29.785567+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-11T23:22:35.789 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1 is not active+clean 2024-09-11T23:22:35.789 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.782668+0000', 'last_change': '2024-09-11T23:22:29.782668+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.782668+0000', 'last_undegraded': '2024-09-11T23:22:29.782668+0000', 'last_fullsized': '2024-09-11T23:22:29.782668+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-11T23:22:35.790 INFO:tasks.ceph.ceph_manager.ceph:PG 13.c is not active+clean 2024-09-11T23:22:35.790 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 81, 'state': 'creating+peering', 'last_fresh': '2024-09-11T23:22:29.778998+0000', 'last_change': '2024-09-11T23:22:29.778998+0000', 'last_active': '2024-09-11T23:22:29.765943+0000', 'last_peered': '2024-09-11T23:22:29.765943+0000', 'last_clean': '2024-09-11T23:22:29.765943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T23:22:29.778998+0000', 'last_undegraded': '2024-09-11T23:22:29.778998+0000', 'last_fullsized': '2024-09-11T23:22:29.778998+0000', 'mapping_epoch': 81, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 81, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'last_clean_scrub_stamp': '2024-09-11T23:22:29.765943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-11T23:22:35.790 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T23:22:35.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.967+0000 7f19ed800640 1 Processor -- start 2024-09-11T23:22:35.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.967+0000 7f19ed800640 1 -- start start 2024-09-11T23:22:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.968+0000 7f19ed800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f19e80b4930 0x7f19e80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.968+0000 7f19ed800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f19e815f620 0x7f19e815fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.968+0000 7f19ed800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19e8162870 con 0x7f19e80d0a50 2024-09-11T23:22:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.968+0000 7f19ed800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f19e80b52d0 con 0x7f19e80b4930 2024-09-11T23:22:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.968+0000 7f19ed800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f19e8162b50 con 0x7f19e815f620 2024-09-11T23:22:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.969+0000 7f19de000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f19e80b4930 0x7f19e80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.969+0000 7f19de000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f19e80b4930 0x7f19e80b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59120/0 (socket says 172.21.15.144:59120) 2024-09-11T23:22:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.969+0000 7f19e6a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f19e80d0a50 0x7f19e81620b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49546/0 (socket says 172.21.15.144:49546) 2024-09-11T23:22:35.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.969+0000 7f19de000640 1 -- 172.21.15.144:0/3752499154 learned_addr learned my addr 172.21.15.144:0/3752499154 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:35.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.969+0000 7f19e7400640 1 --2- 172.21.15.144:0/3752499154 >> v2:172.21.15.165:3300/0 conn(0x7f19e815f620 0x7f19e815fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:35.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.969+0000 7f19de000640 1 -- 172.21.15.144:0/3752499154 >> v2:172.21.15.165:3300/0 conn(0x7f19e815f620 msgr2=0x7f19e815fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:35.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.969+0000 7f19de000640 1 --2- 172.21.15.144:0/3752499154 >> v2:172.21.15.165:3300/0 conn(0x7f19e815f620 0x7f19e815fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.969+0000 7f19de000640 1 -- 172.21.15.144:0/3752499154 >> v1:172.21.15.144:6789/0 conn(0x7f19e80d0a50 legacy=0x7f19e81620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:35.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.969+0000 7f19de000640 1 -- 172.21.15.144:0/3752499154 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e8162e30 con 0x7f19e80b4930 2024-09-11T23:22:35.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.969+0000 7f19e6000640 1 -- 172.21.15.144:0/3752499154 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3164125050 0 0) 0x7f19e8162870 con 0x7f19e80d0a50 2024-09-11T23:22:35.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.970+0000 7f19de000640 1 --2- 172.21.15.144:0/3752499154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19e80b4930 0x7f19e80b4d90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f19e80d13d0 tx=0x7f19d002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1457cd5b4f778578 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:35.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.971+0000 7f19e6000640 1 -- 172.21.15.144:0/3752499154 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d0037070 con 0x7f19e80b4930 2024-09-11T23:22:35.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.971+0000 7f19e6000640 1 -- 172.21.15.144:0/3752499154 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d0032440 con 0x7f19e80b4930 2024-09-11T23:22:35.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.971+0000 7f19e6000640 1 -- 172.21.15.144:0/3752499154 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d0032810 con 0x7f19e80b4930 2024-09-11T23:22:35.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.971+0000 7f19ed800640 1 -- 172.21.15.144:0/3752499154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19e80b4930 msgr2=0x7f19e80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:35.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.971+0000 7f19ed800640 1 --2- 172.21.15.144:0/3752499154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19e80b4930 0x7f19e80b4d90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f19e80d13d0 tx=0x7f19d002a1e0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.971+0000 7f19ed800640 1 -- 172.21.15.144:0/3752499154 shutdown_connections 2024-09-11T23:22:35.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.971+0000 7f19ed800640 1 --2- 172.21.15.144:0/3752499154 >> v2:172.21.15.165:3300/0 conn(0x7f19e815f620 0x7f19e815fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.971+0000 7f19ed800640 1 --2- 172.21.15.144:0/3752499154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19e80b4930 0x7f19e80b4d90 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.971+0000 7f19ed800640 1 -- 172.21.15.144:0/3752499154 >> 172.21.15.144:0/3752499154 conn(0x7f19e8062cc0 msgr2=0x7f19e806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:35.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.971+0000 7f19ed800640 1 -- 172.21.15.144:0/3752499154 shutdown_connections 2024-09-11T23:22:35.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.971+0000 7f19ed800640 1 -- 172.21.15.144:0/3752499154 wait complete. 2024-09-11T23:22:35.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.973+0000 7f19ed800640 1 Processor -- start 2024-09-11T23:22:35.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.973+0000 7f19ed800640 1 -- start start 2024-09-11T23:22:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.974+0000 7f19ed800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19e80b4930 0x7f19e80cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.974+0000 7f19ed800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19e815f620 0x7f19e8157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.974+0000 7f19ed800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19e8158040 0x7f19e80ce630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.974+0000 7f19ed800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f19e815ffb0 con 0x7f19e8158040 2024-09-11T23:22:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.974+0000 7f19ed800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f19e80b3620 con 0x7f19e815f620 2024-09-11T23:22:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.974+0000 7f19ed800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f19e8160130 con 0x7f19e80b4930 2024-09-11T23:22:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.974+0000 7f19e7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19e8158040 0x7f19e80ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.974+0000 7f19e7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19e8158040 0x7f19e80ce630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59136/0 (socket says 172.21.15.144:59136) 2024-09-11T23:22:35.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.974+0000 7f19e7400640 1 -- 172.21.15.144:0/60008514 learned_addr learned my addr 172.21.15.144:0/60008514 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:35.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.974+0000 7f19e6a00640 1 --2- 172.21.15.144:0/60008514 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19e80b4930 0x7f19e80cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:35.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.974+0000 7f19de000640 1 --2- 172.21.15.144:0/60008514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19e815f620 0x7f19e8157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:35.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.974+0000 7f19e7400640 1 -- 172.21.15.144:0/60008514 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19e80b4930 msgr2=0x7f19e80cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:35.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.974+0000 7f19e7400640 1 --2- 172.21.15.144:0/60008514 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19e80b4930 0x7f19e80cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.974+0000 7f19e7400640 1 -- 172.21.15.144:0/60008514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19e815f620 msgr2=0x7f19e8157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:35.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.974+0000 7f19e7400640 1 --2- 172.21.15.144:0/60008514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19e815f620 0x7f19e8157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:35.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.974+0000 7f19e7400640 1 -- 172.21.15.144:0/60008514 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e80cc170 con 0x7f19e8158040 2024-09-11T23:22:35.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.975+0000 7f19e7400640 1 --2- 172.21.15.144:0/60008514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19e8158040 0x7f19e80ce630 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f19e0007e60 tx=0x7f19e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:35.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.975+0000 7f19df400640 1 -- 172.21.15.144:0/60008514 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e0014420 con 0x7f19e8158040 2024-09-11T23:22:35.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.975+0000 7f19df400640 1 -- 172.21.15.144:0/60008514 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19e0019070 con 0x7f19e8158040 2024-09-11T23:22:35.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.975+0000 7f19df400640 1 -- 172.21.15.144:0/60008514 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e0014820 con 0x7f19e8158040 2024-09-11T23:22:35.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.975+0000 7f19ed800640 1 -- 172.21.15.144:0/60008514 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e8071070 con 0x7f19e8158040 2024-09-11T23:22:35.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.975+0000 7f19ed800640 1 -- 172.21.15.144:0/60008514 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e8071630 con 0x7f19e8158040 2024-09-11T23:22:35.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.976+0000 7f19ed800640 1 -- 172.21.15.144:0/60008514 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19e80b4d90 con 0x7f19e8158040 2024-09-11T23:22:35.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.977+0000 7f19df400640 1 -- 172.21.15.144:0/60008514 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f19e00149c0 con 0x7f19e8158040 2024-09-11T23:22:35.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.978+0000 7f19df400640 1 --2- 172.21.15.144:0/60008514 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f19c406bf50 0x7f19c406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:35.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.978+0000 7f19df400640 1 -- 172.21.15.144:0/60008514 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f19e008b820 con 0x7f19e8158040 2024-09-11T23:22:35.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.978+0000 7f19e6a00640 1 --2- 172.21.15.144:0/60008514 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f19c406bf50 0x7f19c406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:35.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.979+0000 7f19e6a00640 1 --2- 172.21.15.144:0/60008514 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f19c406bf50 0x7f19c406e410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f19d8000f60 tx=0x7f19d8007b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:35.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:35.982+0000 7f19df400640 1 -- 172.21.15.144:0/60008514 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f19e005a0b0 con 0x7f19e8158040 2024-09-11T23:22:36.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.217+0000 7f19ed800640 1 -- 172.21.15.144:0/60008514 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f19e8157dd0 con 0x7f19e8158040 2024-09-11T23:22:36.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.218+0000 7f19df400640 1 -- 172.21.15.144:0/60008514 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+3144 (secure 0 0 0) 0x7f19e00599b0 con 0x7f19e8158040 2024-09-11T23:22:36.218 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:36.218 INFO:teuthology.orchestra.run.smithi144.stdout:{"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":302,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":83,"num_osds":8,"num_up_osds":8,"osd_up_since":1726096669,"num_in_osds":8,"osd_in_since":1726096657,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":264556544,"bytes_avail":772829556736,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":56,"btime":"2024-09-11T23:22:33:800694+0000","id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":6522}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-09-11T23:22:18.711183+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T23:22:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.220+0000 7f19ed800640 1 -- 172.21.15.144:0/60008514 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f19c406bf50 msgr2=0x7f19c406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.220+0000 7f19ed800640 1 --2- 172.21.15.144:0/60008514 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f19c406bf50 0x7f19c406e410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f19d8000f60 tx=0x7f19d8007b50 comp rx=0 tx=0).stop 2024-09-11T23:22:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.220+0000 7f19ed800640 1 -- 172.21.15.144:0/60008514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19e8158040 msgr2=0x7f19e80ce630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.220+0000 7f19ed800640 1 --2- 172.21.15.144:0/60008514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19e8158040 0x7f19e80ce630 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f19e0007e60 tx=0x7f19e000e4b0 comp rx=0 tx=0).stop 2024-09-11T23:22:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.220+0000 7f19ed800640 1 -- 172.21.15.144:0/60008514 shutdown_connections 2024-09-11T23:22:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.220+0000 7f19ed800640 1 --2- 172.21.15.144:0/60008514 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f19c406bf50 0x7f19c406e410 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.220+0000 7f19ed800640 1 --2- 172.21.15.144:0/60008514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19e8158040 0x7f19e80ce630 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.220+0000 7f19ed800640 1 --2- 172.21.15.144:0/60008514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19e815f620 0x7f19e8157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.220+0000 7f19ed800640 1 --2- 172.21.15.144:0/60008514 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19e80b4930 0x7f19e80cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.220+0000 7f19ed800640 1 -- 172.21.15.144:0/60008514 >> 172.21.15.144:0/60008514 conn(0x7f19e8062cc0 msgr2=0x7f19e80b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.220+0000 7f19ed800640 1 -- 172.21.15.144:0/60008514 shutdown_connections 2024-09-11T23:22:36.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.221+0000 7f19ed800640 1 -- 172.21.15.144:0/60008514 wait complete. 2024-09-11T23:22:36.236 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-11T23:22:36.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:22:36.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.390+0000 7effa3000640 1 Processor -- start 2024-09-11T23:22:36.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.390+0000 7effa3000640 1 -- start start 2024-09-11T23:22:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.391+0000 7effa3000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7eff9c15b150 0x7eff9c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.391+0000 7effa3000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7eff9c0b4510 0x7eff9c0b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.392+0000 7effa3000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff9c0b31d0 con 0x7eff9c0cd030 2024-09-11T23:22:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.392+0000 7effa3000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7eff9c15c0a0 con 0x7eff9c15b150 2024-09-11T23:22:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.392+0000 7effa3000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7eff9c15c380 con 0x7eff9c0b4510 2024-09-11T23:22:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.392+0000 7effa1c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7eff9c15b150 0x7eff9c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.392+0000 7effa1c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7eff9c15b150 0x7eff9c0ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59152/0 (socket says 172.21.15.144:59152) 2024-09-11T23:22:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.392+0000 7effa1c00640 1 -- 172.21.15.144:0/1804130483 learned_addr learned my addr 172.21.15.144:0/1804130483 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.392+0000 7effa1200640 1 --2- 172.21.15.144:0/1804130483 >> v2:172.21.15.165:3300/0 conn(0x7eff9c0b4510 0x7eff9c0b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.392+0000 7effa1c00640 1 -- 172.21.15.144:0/1804130483 >> v2:172.21.15.165:3300/0 conn(0x7eff9c0b4510 msgr2=0x7eff9c0b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:36.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.392+0000 7effa1c00640 1 --2- 172.21.15.144:0/1804130483 >> v2:172.21.15.165:3300/0 conn(0x7eff9c0b4510 0x7eff9c0b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.392+0000 7effa1c00640 1 -- 172.21.15.144:0/1804130483 >> v1:172.21.15.165:6789/0 conn(0x7eff9c0cd030 legacy=0x7eff9c15b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:36.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.392+0000 7effa1c00640 1 -- 172.21.15.144:0/1804130483 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9c0b3440 con 0x7eff9c15b150 2024-09-11T23:22:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.393+0000 7effa1c00640 1 --2- 172.21.15.144:0/1804130483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff9c15b150 0x7eff9c0ccaf0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7eff90009870 tx=0x7eff9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c35549ab1b686dd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.393+0000 7eff9be00640 1 -- 172.21.15.144:0/1804130483 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff90037070 con 0x7eff9c15b150 2024-09-11T23:22:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.393+0000 7eff9be00640 1 -- 172.21.15.144:0/1804130483 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff90032440 con 0x7eff9c15b150 2024-09-11T23:22:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.393+0000 7eff9be00640 1 -- 172.21.15.144:0/1804130483 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff90032810 con 0x7eff9c15b150 2024-09-11T23:22:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.394+0000 7effa3000640 1 -- 172.21.15.144:0/1804130483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff9c15b150 msgr2=0x7eff9c0ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.394+0000 7effa3000640 1 --2- 172.21.15.144:0/1804130483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff9c15b150 0x7eff9c0ccaf0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7eff90009870 tx=0x7eff9002a270 comp rx=0 tx=0).stop 2024-09-11T23:22:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.394+0000 7effa3000640 1 -- 172.21.15.144:0/1804130483 shutdown_connections 2024-09-11T23:22:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.394+0000 7effa3000640 1 --2- 172.21.15.144:0/1804130483 >> v2:172.21.15.165:3300/0 conn(0x7eff9c0b4510 0x7eff9c0b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.394+0000 7effa3000640 1 --2- 172.21.15.144:0/1804130483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff9c15b150 0x7eff9c0ccaf0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.394+0000 7effa3000640 1 -- 172.21.15.144:0/1804130483 >> 172.21.15.144:0/1804130483 conn(0x7eff9c06e910 msgr2=0x7eff9c06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:36.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.394+0000 7effa3000640 1 -- 172.21.15.144:0/1804130483 shutdown_connections 2024-09-11T23:22:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.394+0000 7effa3000640 1 -- 172.21.15.144:0/1804130483 wait complete. 2024-09-11T23:22:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.396+0000 7effa3000640 1 Processor -- start 2024-09-11T23:22:36.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.396+0000 7effa3000640 1 -- start start 2024-09-11T23:22:36.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.397+0000 7effa3000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff9c0b4510 0x7eff9c14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:36.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.397+0000 7effa3000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff9c0cd030 0x7eff9c1523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:36.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.397+0000 7effa3000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff9c15b150 0x7eff9c1e4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:36.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.397+0000 7effa3000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff9c15bdc0 con 0x7eff9c15b150 2024-09-11T23:22:36.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.397+0000 7effa3000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7eff9c15bc40 con 0x7eff9c0b4510 2024-09-11T23:22:36.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.397+0000 7effa3000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7eff9c0b3ea0 con 0x7eff9c0cd030 2024-09-11T23:22:36.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.397+0000 7effa2600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff9c15b150 0x7eff9c1e4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:36.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.397+0000 7effa2600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff9c15b150 0x7eff9c1e4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59154/0 (socket says 172.21.15.144:59154) 2024-09-11T23:22:36.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.397+0000 7effa2600640 1 -- 172.21.15.144:0/715203751 learned_addr learned my addr 172.21.15.144:0/715203751 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:36.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.397+0000 7effa2600640 1 -- 172.21.15.144:0/715203751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff9c0cd030 msgr2=0x7eff9c1523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:36.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.397+0000 7effa2600640 1 --2- 172.21.15.144:0/715203751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff9c0cd030 0x7eff9c1523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:36.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.397+0000 7effa2600640 1 -- 172.21.15.144:0/715203751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff9c0b4510 msgr2=0x7eff9c14fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:36.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.397+0000 7effa1c00640 1 --2- 172.21.15.144:0/715203751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff9c0b4510 0x7eff9c14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:36.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.397+0000 7effa2600640 1 --2- 172.21.15.144:0/715203751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff9c0b4510 0x7eff9c14fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:36.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.397+0000 7effa2600640 1 -- 172.21.15.144:0/715203751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9c151650 con 0x7eff9c15b150 2024-09-11T23:22:36.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.397+0000 7effa1c00640 1 --2- 172.21.15.144:0/715203751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff9c0b4510 0x7eff9c14fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:22:36.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.398+0000 7effa2600640 1 --2- 172.21.15.144:0/715203751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff9c15b150 0x7eff9c1e4e70 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7eff9400c780 tx=0x7eff9400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:36.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.398+0000 7eff99600640 1 -- 172.21.15.144:0/715203751 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94004b60 con 0x7eff9c15b150 2024-09-11T23:22:36.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.398+0000 7eff99600640 1 -- 172.21.15.144:0/715203751 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff94004d00 con 0x7eff9c15b150 2024-09-11T23:22:36.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.398+0000 7eff99600640 1 -- 172.21.15.144:0/715203751 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9400aa90 con 0x7eff9c15b150 2024-09-11T23:22:36.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.398+0000 7effa3000640 1 -- 172.21.15.144:0/715203751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff9c1435a0 con 0x7eff9c15b150 2024-09-11T23:22:36.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.398+0000 7effa3000640 1 -- 172.21.15.144:0/715203751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff9c151bd0 con 0x7eff9c15b150 2024-09-11T23:22:36.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.399+0000 7effa3000640 1 -- 172.21.15.144:0/715203751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff9c0b4200 con 0x7eff9c15b150 2024-09-11T23:22:36.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.400+0000 7eff99600640 1 -- 172.21.15.144:0/715203751 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7eff9400ac30 con 0x7eff9c15b150 2024-09-11T23:22:36.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.401+0000 7eff99600640 1 --2- 172.21.15.144:0/715203751 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff7c06bf50 0x7eff7c06e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:36.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.401+0000 7eff99600640 1 -- 172.21.15.144:0/715203751 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7eff9408b300 con 0x7eff9c15b150 2024-09-11T23:22:36.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.402+0000 7effa1c00640 1 --2- 172.21.15.144:0/715203751 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff7c06bf50 0x7eff7c06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:36.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.402+0000 7effa1c00640 1 --2- 172.21.15.144:0/715203751 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff7c06bf50 0x7eff7c06e410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7eff90034000 tx=0x7eff9002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:36.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.406+0000 7eff99600640 1 -- 172.21.15.144:0/715203751 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7eff94020070 con 0x7eff9c15b150 2024-09-11T23:22:36.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.574+0000 7effa3000640 1 -- 172.21.15.144:0/715203751 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff9c150220 con 0x7eff7c06bf50 2024-09-11T23:22:36.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.581+0000 7eff99600640 1 -- 172.21.15.144:0/715203751 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246755 (secure 0 0 0) 0x7eff9c150220 con 0x7eff7c06bf50 2024-09-11T23:22:36.586 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:36.588 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:22:36.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.585+0000 7effa3000640 1 -- 172.21.15.144:0/715203751 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff7c06bf50 msgr2=0x7eff7c06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:36.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.585+0000 7effa3000640 1 --2- 172.21.15.144:0/715203751 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff7c06bf50 0x7eff7c06e410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7eff90034000 tx=0x7eff9002e000 comp rx=0 tx=0).stop 2024-09-11T23:22:36.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.585+0000 7effa3000640 1 -- 172.21.15.144:0/715203751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff9c15b150 msgr2=0x7eff9c1e4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:36.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.585+0000 7effa3000640 1 --2- 172.21.15.144:0/715203751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff9c15b150 0x7eff9c1e4e70 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7eff9400c780 tx=0x7eff9400cc40 comp rx=0 tx=0).stop 2024-09-11T23:22:36.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.585+0000 7effa3000640 1 -- 172.21.15.144:0/715203751 shutdown_connections 2024-09-11T23:22:36.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.585+0000 7effa3000640 1 --2- 172.21.15.144:0/715203751 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff7c06bf50 0x7eff7c06e410 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:36.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.585+0000 7effa3000640 1 --2- 172.21.15.144:0/715203751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff9c15b150 0x7eff9c1e4e70 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:36.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.585+0000 7effa3000640 1 --2- 172.21.15.144:0/715203751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff9c0cd030 0x7eff9c1523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:36.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.585+0000 7effa3000640 1 --2- 172.21.15.144:0/715203751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff9c0b4510 0x7eff9c14fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:36.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.585+0000 7effa3000640 1 -- 172.21.15.144:0/715203751 >> 172.21.15.144:0/715203751 conn(0x7eff9c06e910 msgr2=0x7eff9c15d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:36.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.585+0000 7effa3000640 1 -- 172.21.15.144:0/715203751 shutdown_connections 2024-09-11T23:22:36.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:36.585+0000 7effa3000640 1 -- 172.21.15.144:0/715203751 wait complete. 2024-09-11T23:22:36.601 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-11T23:22:34.715087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258356,"kb_used_data":8828,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716364,"statfs":{"total":773094113280,"available":772829556736,"internally_reserved":0,"allocated":9039872,"data_stored":4516429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.948157"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.788382+0000","last_change":"2024-09-11T23:22:29.788382+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.788382+0000","last_undegraded":"2024-09-11T23:22:29.788382+0000","last_fullsized":"2024-09-11T23:22:29.788382+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.786400+0000","last_change":"2024-09-11T23:22:29.786400+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.786400+0000","last_undegraded":"2024-09-11T23:22:29.786400+0000","last_fullsized":"2024-09-11T23:22:29.786400+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.785377+0000","last_change":"2024-09-11T23:22:29.785377+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.785377+0000","last_undegraded":"2024-09-11T23:22:29.785377+0000","last_fullsized":"2024-09-11T23:22:29.785377+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783871+0000","last_change":"2024-09-11T23:22:29.783871+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783871+0000","last_undegraded":"2024-09-11T23:22:29.783871+0000","last_fullsized":"2024-09-11T23:22:29.783871+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782095+0000","last_change":"2024-09-11T23:22:29.782095+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782095+0000","last_undegraded":"2024-09-11T23:22:29.782095+0000","last_fullsized":"2024-09-11T23:22:29.782095+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.779411+0000","last_change":"2024-09-11T23:22:29.779411+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.779411+0000","last_undegraded":"2024-09-11T23:22:29.779411+0000","last_fullsized":"2024-09-11T23:22:29.779411+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781715+0000","last_change":"2024-09-11T23:22:29.781715+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781715+0000","last_undegraded":"2024-09-11T23:22:29.781715+0000","last_fullsized":"2024-09-11T23:22:29.781715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.777866+0000","last_change":"2024-09-11T23:22:29.777866+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.777866+0000","last_undegraded":"2024-09-11T23:22:29.777866+0000","last_fullsized":"2024-09-11T23:22:29.777866+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.779067+0000","last_change":"2024-09-11T23:22:29.779067+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.779067+0000","last_undegraded":"2024-09-11T23:22:29.779067+0000","last_fullsized":"2024-09-11T23:22:29.779067+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.784817+0000","last_change":"2024-09-11T23:22:29.784817+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.784817+0000","last_undegraded":"2024-09-11T23:22:29.784817+0000","last_fullsized":"2024-09-11T23:22:29.784817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.786000+0000","last_change":"2024-09-11T23:22:29.786000+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.786000+0000","last_undegraded":"2024-09-11T23:22:29.786000+0000","last_fullsized":"2024-09-11T23:22:29.786000+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.790174+0000","last_change":"2024-09-11T23:22:29.790174+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.790174+0000","last_undegraded":"2024-09-11T23:22:29.790174+0000","last_fullsized":"2024-09-11T23:22:29.790174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.785141+0000","last_change":"2024-09-11T23:22:29.785141+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.785141+0000","last_undegraded":"2024-09-11T23:22:29.785141+0000","last_fullsized":"2024-09-11T23:22:29.785141+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.784120+0000","last_change":"2024-09-11T23:22:29.784120+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.784120+0000","last_undegraded":"2024-09-11T23:22:29.784120+0000","last_fullsized":"2024-09-11T23:22:29.784120+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.786586+0000","last_change":"2024-09-11T23:22:29.786586+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.786586+0000","last_undegraded":"2024-09-11T23:22:29.786586+0000","last_fullsized":"2024-09-11T23:22:29.786586+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783492+0000","last_change":"2024-09-11T23:22:29.783492+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783492+0000","last_undegraded":"2024-09-11T23:22:29.783492+0000","last_fullsized":"2024-09-11T23:22:29.783492+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781621+0000","last_change":"2024-09-11T23:22:29.781621+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781621+0000","last_undegraded":"2024-09-11T23:22:29.781621+0000","last_fullsized":"2024-09-11T23:22:29.781621+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783714+0000","last_change":"2024-09-11T23:22:29.783714+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783714+0000","last_undegraded":"2024-09-11T23:22:29.783714+0000","last_fullsized":"2024-09-11T23:22:29.783714+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780149+0000","last_change":"2024-09-11T23:22:29.780149+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780149+0000","last_undegraded":"2024-09-11T23:22:29.780149+0000","last_fullsized":"2024-09-11T23:22:29.780149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783439+0000","last_change":"2024-09-11T23:22:29.783439+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783439+0000","last_undegraded":"2024-09-11T23:22:29.783439+0000","last_fullsized":"2024-09-11T23:22:29.783439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782157+0000","last_change":"2024-09-11T23:22:29.782157+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782157+0000","last_undegraded":"2024-09-11T23:22:29.782157+0000","last_fullsized":"2024-09-11T23:22:29.782157+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.784771+0000","last_change":"2024-09-11T23:22:29.784771+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.784771+0000","last_undegraded":"2024-09-11T23:22:29.784771+0000","last_fullsized":"2024-09-11T23:22:29.784771+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783276+0000","last_change":"2024-09-11T23:22:29.783276+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783276+0000","last_undegraded":"2024-09-11T23:22:29.783276+0000","last_fullsized":"2024-09-11T23:22:29.783276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782348+0000","last_change":"2024-09-11T23:22:29.782348+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782348+0000","last_undegraded":"2024-09-11T23:22:29.782348+0000","last_fullsized":"2024-09-11T23:22:29.782348+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781742+0000","last_change":"2024-09-11T23:22:29.781742+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781742+0000","last_undegraded":"2024-09-11T23:22:29.781742+0000","last_fullsized":"2024-09-11T23:22:29.781742+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.788359+0000","last_change":"2024-09-11T23:22:29.788359+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.788359+0000","last_undegraded":"2024-09-11T23:22:29.788359+0000","last_fullsized":"2024-09-11T23:22:29.788359+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783819+0000","last_change":"2024-09-11T23:22:29.783819+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783819+0000","last_undegraded":"2024-09-11T23:22:29.783819+0000","last_fullsized":"2024-09-11T23:22:29.783819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.789270+0000","last_change":"2024-09-11T23:22:29.789270+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.789270+0000","last_undegraded":"2024-09-11T23:22:29.789270+0000","last_fullsized":"2024-09-11T23:22:29.789270+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781384+0000","last_change":"2024-09-11T23:22:29.781384+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781384+0000","last_undegraded":"2024-09-11T23:22:29.781384+0000","last_fullsized":"2024-09-11T23:22:29.781384+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781243+0000","last_change":"2024-09-11T23:22:29.781243+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781243+0000","last_undegraded":"2024-09-11T23:22:29.781243+0000","last_fullsized":"2024-09-11T23:22:29.781243+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780707+0000","last_change":"2024-09-11T23:22:29.780707+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780707+0000","last_undegraded":"2024-09-11T23:22:29.780707+0000","last_fullsized":"2024-09-11T23:22:29.780707+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782038+0000","last_change":"2024-09-11T23:22:29.782038+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782038+0000","last_undegraded":"2024-09-11T23:22:29.782038+0000","last_fullsized":"2024-09-11T23:22:29.782038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782012+0000","last_change":"2024-09-11T23:22:29.782012+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782012+0000","last_undegraded":"2024-09-11T23:22:29.782012+0000","last_fullsized":"2024-09-11T23:22:29.782012+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.802180+0000","last_change":"2024-09-11T23:22:29.801202+0000","last_active":"2024-09-11T23:22:29.802180+0000","last_peered":"2024-09-11T23:22:29.802180+0000","last_clean":"2024-09-11T23:22:29.802180+0000","last_became_active":"2024-09-11T23:22:29.800931+0000","last_became_peered":"2024-09-11T23:22:29.800931+0000","last_unstale":"2024-09-11T23:22:29.802180+0000","last_undegraded":"2024-09-11T23:22:29.802180+0000","last_fullsized":"2024-09-11T23:22:29.802180+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:33.581201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.787990+0000","last_change":"2024-09-11T23:22:29.787990+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.787990+0000","last_undegraded":"2024-09-11T23:22:29.787990+0000","last_fullsized":"2024-09-11T23:22:29.787990+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.795398+0000","last_change":"2024-09-11T23:22:29.791510+0000","last_active":"2024-09-11T23:22:29.795398+0000","last_peered":"2024-09-11T23:22:29.795398+0000","last_clean":"2024-09-11T23:22:29.795398+0000","last_became_active":"2024-09-11T23:22:29.791216+0000","last_became_peered":"2024-09-11T23:22:29.791216+0000","last_unstale":"2024-09-11T23:22:29.795398+0000","last_undegraded":"2024-09-11T23:22:29.795398+0000","last_fullsized":"2024-09-11T23:22:29.795398+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:04:07.998110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.787174+0000","last_change":"2024-09-11T23:22:29.787174+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.787174+0000","last_undegraded":"2024-09-11T23:22:29.787174+0000","last_fullsized":"2024-09-11T23:22:29.787174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801045+0000","last_change":"2024-09-11T23:22:29.797262+0000","last_active":"2024-09-11T23:22:29.801045+0000","last_peered":"2024-09-11T23:22:29.801045+0000","last_clean":"2024-09-11T23:22:29.801045+0000","last_became_active":"2024-09-11T23:22:29.796852+0000","last_became_peered":"2024-09-11T23:22:29.796852+0000","last_unstale":"2024-09-11T23:22:29.801045+0000","last_undegraded":"2024-09-11T23:22:29.801045+0000","last_fullsized":"2024-09-11T23:22:29.801045+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:45.746458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.784903+0000","last_change":"2024-09-11T23:22:29.784903+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.784903+0000","last_undegraded":"2024-09-11T23:22:29.784903+0000","last_fullsized":"2024-09-11T23:22:29.784903+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801050+0000","last_change":"2024-09-11T23:22:29.798952+0000","last_active":"2024-09-11T23:22:29.801050+0000","last_peered":"2024-09-11T23:22:29.801050+0000","last_clean":"2024-09-11T23:22:29.801050+0000","last_became_active":"2024-09-11T23:22:29.798584+0000","last_became_peered":"2024-09-11T23:22:29.798584+0000","last_unstale":"2024-09-11T23:22:29.801050+0000","last_undegraded":"2024-09-11T23:22:29.801050+0000","last_fullsized":"2024-09-11T23:22:29.801050+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:32.388072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780839+0000","last_change":"2024-09-11T23:22:29.780839+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780839+0000","last_undegraded":"2024-09-11T23:22:29.780839+0000","last_fullsized":"2024-09-11T23:22:29.780839+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.795695+0000","last_change":"2024-09-11T23:22:29.791619+0000","last_active":"2024-09-11T23:22:29.795695+0000","last_peered":"2024-09-11T23:22:29.795695+0000","last_clean":"2024-09-11T23:22:29.795695+0000","last_became_active":"2024-09-11T23:22:29.791285+0000","last_became_peered":"2024-09-11T23:22:29.791285+0000","last_unstale":"2024-09-11T23:22:29.795695+0000","last_undegraded":"2024-09-11T23:22:29.795695+0000","last_fullsized":"2024-09-11T23:22:29.795695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:18.720260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781627+0000","last_change":"2024-09-11T23:22:29.781627+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781627+0000","last_undegraded":"2024-09-11T23:22:29.781627+0000","last_fullsized":"2024-09-11T23:22:29.781627+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800715+0000","last_change":"2024-09-11T23:22:29.799472+0000","last_active":"2024-09-11T23:22:29.800715+0000","last_peered":"2024-09-11T23:22:29.800715+0000","last_clean":"2024-09-11T23:22:29.800715+0000","last_became_active":"2024-09-11T23:22:29.799108+0000","last_became_peered":"2024-09-11T23:22:29.799108+0000","last_unstale":"2024-09-11T23:22:29.800715+0000","last_undegraded":"2024-09-11T23:22:29.800715+0000","last_fullsized":"2024-09-11T23:22:29.800715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:11.066365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.788039+0000","last_change":"2024-09-11T23:22:29.788039+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.788039+0000","last_undegraded":"2024-09-11T23:22:29.788039+0000","last_fullsized":"2024-09-11T23:22:29.788039+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800415+0000","last_change":"2024-09-11T23:22:29.794917+0000","last_active":"2024-09-11T23:22:29.800415+0000","last_peered":"2024-09-11T23:22:29.800415+0000","last_clean":"2024-09-11T23:22:29.800415+0000","last_became_active":"2024-09-11T23:22:29.794644+0000","last_became_peered":"2024-09-11T23:22:29.794644+0000","last_unstale":"2024-09-11T23:22:29.800415+0000","last_undegraded":"2024-09-11T23:22:29.800415+0000","last_fullsized":"2024-09-11T23:22:29.800415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:11.157987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783457+0000","last_change":"2024-09-11T23:22:29.783457+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783457+0000","last_undegraded":"2024-09-11T23:22:29.783457+0000","last_fullsized":"2024-09-11T23:22:29.783457+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.795631+0000","last_change":"2024-09-11T23:22:29.791904+0000","last_active":"2024-09-11T23:22:29.795631+0000","last_peered":"2024-09-11T23:22:29.795631+0000","last_clean":"2024-09-11T23:22:29.795631+0000","last_became_active":"2024-09-11T23:22:29.791075+0000","last_became_peered":"2024-09-11T23:22:29.791075+0000","last_unstale":"2024-09-11T23:22:29.795631+0000","last_undegraded":"2024-09-11T23:22:29.795631+0000","last_fullsized":"2024-09-11T23:22:29.795631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:16.262655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.785519+0000","last_change":"2024-09-11T23:22:29.785519+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.785519+0000","last_undegraded":"2024-09-11T23:22:29.785519+0000","last_fullsized":"2024-09-11T23:22:29.785519+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801364+0000","last_change":"2024-09-11T23:22:29.800033+0000","last_active":"2024-09-11T23:22:29.801364+0000","last_peered":"2024-09-11T23:22:29.801364+0000","last_clean":"2024-09-11T23:22:29.801364+0000","last_became_active":"2024-09-11T23:22:29.799648+0000","last_became_peered":"2024-09-11T23:22:29.799648+0000","last_unstale":"2024-09-11T23:22:29.801364+0000","last_undegraded":"2024-09-11T23:22:29.801364+0000","last_fullsized":"2024-09-11T23:22:29.801364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:18.891456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.777915+0000","last_change":"2024-09-11T23:22:29.777915+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.777915+0000","last_undegraded":"2024-09-11T23:22:29.777915+0000","last_fullsized":"2024-09-11T23:22:29.777915+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.799704+0000","last_change":"2024-09-11T23:22:29.797980+0000","last_active":"2024-09-11T23:22:29.799704+0000","last_peered":"2024-09-11T23:22:29.799704+0000","last_clean":"2024-09-11T23:22:29.799704+0000","last_became_active":"2024-09-11T23:22:29.797613+0000","last_became_peered":"2024-09-11T23:22:29.797613+0000","last_unstale":"2024-09-11T23:22:29.799704+0000","last_undegraded":"2024-09-11T23:22:29.799704+0000","last_fullsized":"2024-09-11T23:22:29.799704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:57.423778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780370+0000","last_change":"2024-09-11T23:22:29.780370+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780370+0000","last_undegraded":"2024-09-11T23:22:29.780370+0000","last_fullsized":"2024-09-11T23:22:29.780370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.798784+0000","last_change":"2024-09-11T23:22:29.796274+0000","last_active":"2024-09-11T23:22:29.798784+0000","last_peered":"2024-09-11T23:22:29.798784+0000","last_clean":"2024-09-11T23:22:29.798784+0000","last_became_active":"2024-09-11T23:22:29.796007+0000","last_became_peered":"2024-09-11T23:22:29.796007+0000","last_unstale":"2024-09-11T23:22:29.798784+0000","last_undegraded":"2024-09-11T23:22:29.798784+0000","last_fullsized":"2024-09-11T23:22:29.798784+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:00.496690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783358+0000","last_change":"2024-09-11T23:22:29.783358+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783358+0000","last_undegraded":"2024-09-11T23:22:29.783358+0000","last_fullsized":"2024-09-11T23:22:29.783358+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.795958+0000","last_change":"2024-09-11T23:22:29.794370+0000","last_active":"2024-09-11T23:22:29.795958+0000","last_peered":"2024-09-11T23:22:29.795958+0000","last_clean":"2024-09-11T23:22:29.795958+0000","last_became_active":"2024-09-11T23:22:29.794076+0000","last_became_peered":"2024-09-11T23:22:29.794076+0000","last_unstale":"2024-09-11T23:22:29.795958+0000","last_undegraded":"2024-09-11T23:22:29.795958+0000","last_fullsized":"2024-09-11T23:22:29.795958+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:56.009289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780157+0000","last_change":"2024-09-11T23:22:29.780157+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780157+0000","last_undegraded":"2024-09-11T23:22:29.780157+0000","last_fullsized":"2024-09-11T23:22:29.780157+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.790304+0000","last_change":"2024-09-11T23:22:29.788351+0000","last_active":"2024-09-11T23:22:29.790304+0000","last_peered":"2024-09-11T23:22:29.790304+0000","last_clean":"2024-09-11T23:22:29.790304+0000","last_became_active":"2024-09-11T23:22:29.788085+0000","last_became_peered":"2024-09-11T23:22:29.788085+0000","last_unstale":"2024-09-11T23:22:29.790304+0000","last_undegraded":"2024-09-11T23:22:29.790304+0000","last_fullsized":"2024-09-11T23:22:29.790304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:59.256338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.784634+0000","last_change":"2024-09-11T23:22:29.784634+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.784634+0000","last_undegraded":"2024-09-11T23:22:29.784634+0000","last_fullsized":"2024-09-11T23:22:29.784634+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801471+0000","last_change":"2024-09-11T23:22:29.793974+0000","last_active":"2024-09-11T23:22:29.801471+0000","last_peered":"2024-09-11T23:22:29.801471+0000","last_clean":"2024-09-11T23:22:29.801471+0000","last_became_active":"2024-09-11T23:22:29.793537+0000","last_became_peered":"2024-09-11T23:22:29.793537+0000","last_unstale":"2024-09-11T23:22:29.801471+0000","last_undegraded":"2024-09-11T23:22:29.801471+0000","last_fullsized":"2024-09-11T23:22:29.801471+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:29.665243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.779771+0000","last_change":"2024-09-11T23:22:29.779771+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.779771+0000","last_undegraded":"2024-09-11T23:22:29.779771+0000","last_fullsized":"2024-09-11T23:22:29.779771+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.793226+0000","last_change":"2024-09-11T23:22:29.786056+0000","last_active":"2024-09-11T23:22:29.793226+0000","last_peered":"2024-09-11T23:22:29.793226+0000","last_clean":"2024-09-11T23:22:29.793226+0000","last_became_active":"2024-09-11T23:22:29.785767+0000","last_became_peered":"2024-09-11T23:22:29.785767+0000","last_unstale":"2024-09-11T23:22:29.793226+0000","last_undegraded":"2024-09-11T23:22:29.793226+0000","last_fullsized":"2024-09-11T23:22:29.793226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:53.387875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780406+0000","last_change":"2024-09-11T23:22:29.780406+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780406+0000","last_undegraded":"2024-09-11T23:22:29.780406+0000","last_fullsized":"2024-09-11T23:22:29.780406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800328+0000","last_change":"2024-09-11T23:22:29.795359+0000","last_active":"2024-09-11T23:22:29.800328+0000","last_peered":"2024-09-11T23:22:29.800328+0000","last_clean":"2024-09-11T23:22:29.800328+0000","last_became_active":"2024-09-11T23:22:29.794120+0000","last_became_peered":"2024-09-11T23:22:29.794120+0000","last_unstale":"2024-09-11T23:22:29.800328+0000","last_undegraded":"2024-09-11T23:22:29.800328+0000","last_fullsized":"2024-09-11T23:22:29.800328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:43.513789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.787891+0000","last_change":"2024-09-11T23:22:29.787891+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.787891+0000","last_undegraded":"2024-09-11T23:22:29.787891+0000","last_fullsized":"2024-09-11T23:22:29.787891+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.798059+0000","last_change":"2024-09-11T23:22:29.795929+0000","last_active":"2024-09-11T23:22:29.798059+0000","last_peered":"2024-09-11T23:22:29.798059+0000","last_clean":"2024-09-11T23:22:29.798059+0000","last_became_active":"2024-09-11T23:22:29.795634+0000","last_became_peered":"2024-09-11T23:22:29.795634+0000","last_unstale":"2024-09-11T23:22:29.798059+0000","last_undegraded":"2024-09-11T23:22:29.798059+0000","last_fullsized":"2024-09-11T23:22:29.798059+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:18.720260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.787577+0000","last_change":"2024-09-11T23:22:29.787577+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.787577+0000","last_undegraded":"2024-09-11T23:22:29.787577+0000","last_fullsized":"2024-09-11T23:22:29.787577+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.795140+0000","last_change":"2024-09-11T23:22:29.793636+0000","last_active":"2024-09-11T23:22:29.795140+0000","last_peered":"2024-09-11T23:22:29.795140+0000","last_clean":"2024-09-11T23:22:29.795140+0000","last_became_active":"2024-09-11T23:22:29.793346+0000","last_became_peered":"2024-09-11T23:22:29.793346+0000","last_unstale":"2024-09-11T23:22:29.795140+0000","last_undegraded":"2024-09-11T23:22:29.795140+0000","last_fullsized":"2024-09-11T23:22:29.795140+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:56.009289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782650+0000","last_change":"2024-09-11T23:22:29.782650+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782650+0000","last_undegraded":"2024-09-11T23:22:29.782650+0000","last_fullsized":"2024-09-11T23:22:29.782650+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800356+0000","last_change":"2024-09-11T23:22:29.795529+0000","last_active":"2024-09-11T23:22:29.800356+0000","last_peered":"2024-09-11T23:22:29.800356+0000","last_clean":"2024-09-11T23:22:29.800356+0000","last_became_active":"2024-09-11T23:22:29.794606+0000","last_became_peered":"2024-09-11T23:22:29.794606+0000","last_unstale":"2024-09-11T23:22:29.800356+0000","last_undegraded":"2024-09-11T23:22:29.800356+0000","last_fullsized":"2024-09-11T23:22:29.800356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:33.678630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.783064+0000","last_change":"2024-09-11T23:22:29.783064+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.783064+0000","last_undegraded":"2024-09-11T23:22:29.783064+0000","last_fullsized":"2024-09-11T23:22:29.783064+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.806279+0000","last_change":"2024-09-11T23:22:29.801734+0000","last_active":"2024-09-11T23:22:29.806279+0000","last_peered":"2024-09-11T23:22:29.806279+0000","last_clean":"2024-09-11T23:22:29.806279+0000","last_became_active":"2024-09-11T23:22:29.800988+0000","last_became_peered":"2024-09-11T23:22:29.800988+0000","last_unstale":"2024-09-11T23:22:29.806279+0000","last_undegraded":"2024-09-11T23:22:29.806279+0000","last_fullsized":"2024-09-11T23:22:29.806279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:15.181135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.778271+0000","last_change":"2024-09-11T23:22:29.778271+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.778271+0000","last_undegraded":"2024-09-11T23:22:29.778271+0000","last_fullsized":"2024-09-11T23:22:29.778271+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800477+0000","last_change":"2024-09-11T23:22:29.790559+0000","last_active":"2024-09-11T23:22:29.800477+0000","last_peered":"2024-09-11T23:22:29.800477+0000","last_clean":"2024-09-11T23:22:29.800477+0000","last_became_active":"2024-09-11T23:22:29.790290+0000","last_became_peered":"2024-09-11T23:22:29.790290+0000","last_unstale":"2024-09-11T23:22:29.800477+0000","last_undegraded":"2024-09-11T23:22:29.800477+0000","last_fullsized":"2024-09-11T23:22:29.800477+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:04.100862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781929+0000","last_change":"2024-09-11T23:22:29.781929+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781929+0000","last_undegraded":"2024-09-11T23:22:29.781929+0000","last_fullsized":"2024-09-11T23:22:29.781929+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.803052+0000","last_change":"2024-09-11T23:22:29.797708+0000","last_active":"2024-09-11T23:22:29.803052+0000","last_peered":"2024-09-11T23:22:29.803052+0000","last_clean":"2024-09-11T23:22:29.803052+0000","last_became_active":"2024-09-11T23:22:29.796870+0000","last_became_peered":"2024-09-11T23:22:29.796870+0000","last_unstale":"2024-09-11T23:22:29.803052+0000","last_undegraded":"2024-09-11T23:22:29.803052+0000","last_fullsized":"2024-09-11T23:22:29.803052+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:14.567731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.777997+0000","last_change":"2024-09-11T23:22:29.777997+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.777997+0000","last_undegraded":"2024-09-11T23:22:29.777997+0000","last_fullsized":"2024-09-11T23:22:29.777997+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.809100+0000","last_change":"2024-09-11T23:22:29.803838+0000","last_active":"2024-09-11T23:22:29.809100+0000","last_peered":"2024-09-11T23:22:29.809100+0000","last_clean":"2024-09-11T23:22:29.809100+0000","last_became_active":"2024-09-11T23:22:29.803457+0000","last_became_peered":"2024-09-11T23:22:29.803457+0000","last_unstale":"2024-09-11T23:22:29.809100+0000","last_undegraded":"2024-09-11T23:22:29.809100+0000","last_fullsized":"2024-09-11T23:22:29.809100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:30.624506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.781127+0000","last_change":"2024-09-11T23:22:29.781127+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.781127+0000","last_undegraded":"2024-09-11T23:22:29.781127+0000","last_fullsized":"2024-09-11T23:22:29.781127+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801544+0000","last_change":"2024-09-11T23:22:29.796232+0000","last_active":"2024-09-11T23:22:29.801544+0000","last_peered":"2024-09-11T23:22:29.801544+0000","last_clean":"2024-09-11T23:22:29.801544+0000","last_became_active":"2024-09-11T23:22:29.795936+0000","last_became_peered":"2024-09-11T23:22:29.795936+0000","last_unstale":"2024-09-11T23:22:29.801544+0000","last_undegraded":"2024-09-11T23:22:29.801544+0000","last_fullsized":"2024-09-11T23:22:29.801544+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:51.278777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.789036+0000","last_change":"2024-09-11T23:22:29.789036+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.789036+0000","last_undegraded":"2024-09-11T23:22:29.789036+0000","last_fullsized":"2024-09-11T23:22:29.789036+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.791258+0000","last_change":"2024-09-11T23:22:29.787519+0000","last_active":"2024-09-11T23:22:29.791258+0000","last_peered":"2024-09-11T23:22:29.791258+0000","last_clean":"2024-09-11T23:22:29.791258+0000","last_became_active":"2024-09-11T23:22:29.787222+0000","last_became_peered":"2024-09-11T23:22:29.787222+0000","last_unstale":"2024-09-11T23:22:29.791258+0000","last_undegraded":"2024-09-11T23:22:29.791258+0000","last_fullsized":"2024-09-11T23:22:29.791258+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:40.941861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.786702+0000","last_change":"2024-09-11T23:22:29.786702+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.786702+0000","last_undegraded":"2024-09-11T23:22:29.786702+0000","last_fullsized":"2024-09-11T23:22:29.786702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800628+0000","last_change":"2024-09-11T23:22:29.798913+0000","last_active":"2024-09-11T23:22:29.800628+0000","last_peered":"2024-09-11T23:22:29.800628+0000","last_clean":"2024-09-11T23:22:29.800628+0000","last_became_active":"2024-09-11T23:22:29.798524+0000","last_became_peered":"2024-09-11T23:22:29.798524+0000","last_unstale":"2024-09-11T23:22:29.800628+0000","last_undegraded":"2024-09-11T23:22:29.800628+0000","last_fullsized":"2024-09-11T23:22:29.800628+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:11.066365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780298+0000","last_change":"2024-09-11T23:22:29.780298+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780298+0000","last_undegraded":"2024-09-11T23:22:29.780298+0000","last_fullsized":"2024-09-11T23:22:29.780298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.798015+0000","last_change":"2024-09-11T23:22:29.795594+0000","last_active":"2024-09-11T23:22:29.798015+0000","last_peered":"2024-09-11T23:22:29.798015+0000","last_clean":"2024-09-11T23:22:29.798015+0000","last_became_active":"2024-09-11T23:22:29.795192+0000","last_became_peered":"2024-09-11T23:22:29.795192+0000","last_unstale":"2024-09-11T23:22:29.798015+0000","last_undegraded":"2024-09-11T23:22:29.798015+0000","last_fullsized":"2024-09-11T23:22:29.798015+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:04:07.998110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.778714+0000","last_change":"2024-09-11T23:22:29.778714+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.778714+0000","last_undegraded":"2024-09-11T23:22:29.778714+0000","last_fullsized":"2024-09-11T23:22:29.778714+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.800276+0000","last_change":"2024-09-11T23:22:29.795182+0000","last_active":"2024-09-11T23:22:29.800276+0000","last_peered":"2024-09-11T23:22:29.800276+0000","last_clean":"2024-09-11T23:22:29.800276+0000","last_became_active":"2024-09-11T23:22:29.794863+0000","last_became_peered":"2024-09-11T23:22:29.794863+0000","last_unstale":"2024-09-11T23:22:29.800276+0000","last_undegraded":"2024-09-11T23:22:29.800276+0000","last_fullsized":"2024-09-11T23:22:29.800276+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:23.886099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.780002+0000","last_change":"2024-09-11T23:22:29.780002+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.780002+0000","last_undegraded":"2024-09-11T23:22:29.780002+0000","last_fullsized":"2024-09-11T23:22:29.780002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.797531+0000","last_change":"2024-09-11T23:22:29.793776+0000","last_active":"2024-09-11T23:22:29.797531+0000","last_peered":"2024-09-11T23:22:29.797531+0000","last_clean":"2024-09-11T23:22:29.797531+0000","last_became_active":"2024-09-11T23:22:29.793426+0000","last_became_peered":"2024-09-11T23:22:29.793426+0000","last_unstale":"2024-09-11T23:22:29.797531+0000","last_undegraded":"2024-09-11T23:22:29.797531+0000","last_fullsized":"2024-09-11T23:22:29.797531+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:00.496690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.785567+0000","last_change":"2024-09-11T23:22:29.785567+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.785567+0000","last_undegraded":"2024-09-11T23:22:29.785567+0000","last_fullsized":"2024-09-11T23:22:29.785567+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.801184+0000","last_change":"2024-09-11T23:22:29.800003+0000","last_active":"2024-09-11T23:22:29.801184+0000","last_peered":"2024-09-11T23:22:29.801184+0000","last_clean":"2024-09-11T23:22:29.801184+0000","last_became_active":"2024-09-11T23:22:29.799292+0000","last_became_peered":"2024-09-11T23:22:29.799292+0000","last_unstale":"2024-09-11T23:22:29.801184+0000","last_undegraded":"2024-09-11T23:22:29.801184+0000","last_fullsized":"2024-09-11T23:22:29.801184+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:06.176294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.782668+0000","last_change":"2024-09-11T23:22:29.782668+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.782668+0000","last_undegraded":"2024-09-11T23:22:29.782668+0000","last_fullsized":"2024-09-11T23:22:29.782668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.798925+0000","last_change":"2024-09-11T23:22:29.794909+0000","last_active":"2024-09-11T23:22:29.798925+0000","last_peered":"2024-09-11T23:22:29.798925+0000","last_clean":"2024-09-11T23:22:29.798925+0000","last_became_active":"2024-09-11T23:22:29.794633+0000","last_became_peered":"2024-09-11T23:22:29.794633+0000","last_unstale":"2024-09-11T23:22:29.798925+0000","last_undegraded":"2024-09-11T23:22:29.798925+0000","last_fullsized":"2024-09-11T23:22:29.798925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:57.423778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":81,"state":"creating+peering","last_fresh":"2024-09-11T23:22:29.778998+0000","last_change":"2024-09-11T23:22:29.778998+0000","last_active":"2024-09-11T23:22:29.765943+0000","last_peered":"2024-09-11T23:22:29.765943+0000","last_clean":"2024-09-11T23:22:29.765943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T23:22:29.778998+0000","last_undegraded":"2024-09-11T23:22:29.778998+0000","last_fullsized":"2024-09-11T23:22:29.778998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.797333+0000","last_change":"2024-09-11T23:22:29.794603+0000","last_active":"2024-09-11T23:22:29.797333+0000","last_peered":"2024-09-11T23:22:29.797333+0000","last_clean":"2024-09-11T23:22:29.797333+0000","last_became_active":"2024-09-11T23:22:29.794225+0000","last_became_peered":"2024-09-11T23:22:29.794225+0000","last_unstale":"2024-09-11T23:22:29.797333+0000","last_undegraded":"2024-09-11T23:22:29.797333+0000","last_fullsized":"2024-09-11T23:22:29.797333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:35.708584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":320,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-11T23:22:29.788260+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:22:29.788260+0000","last_peered":"2024-09-11T23:22:29.788260+0000","last_clean":"2024-09-11T23:22:29.788260+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:22:29.788260+0000","last_undegraded":"2024-09-11T23:22:29.788260+0000","last_fullsized":"2024-09-11T23:22:29.788260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476797,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1576960,"data_stored":1008114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476796,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":417746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476795,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":417746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476795,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":983040,"data_stored":417746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542204,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":417746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542204,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":417746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509500,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":970752,"data_stored":411471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509500,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1576960,"data_stored":1008114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:22:36.757 INFO:tasks.ceph.mds.a.smithi144.stderr:2024-09-11T23:22:36.757+0000 7fe5e2a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:22:39.608 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:22:39.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.773+0000 7fac00e00640 1 Processor -- start 2024-09-11T23:22:39.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.773+0000 7fac00e00640 1 -- start start 2024-09-11T23:22:39.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.774+0000 7fac00e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fabfc15c180 0x7fabfc0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:39.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.774+0000 7fac00e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fabfc0ce230 0x7fabfc0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:39.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.775+0000 7fac00e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabfc0ce740 con 0x7fabfc0cf5b0 2024-09-11T23:22:39.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.775+0000 7fac00e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fabfc072640 con 0x7fabfc15c180 2024-09-11T23:22:39.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.775+0000 7fac00e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fabfc072920 con 0x7fabfc0ce230 2024-09-11T23:22:39.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.775+0000 7fabf9e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fabfc15c180 0x7fabfc0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:39.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.775+0000 7fabf9e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fabfc15c180 0x7fabfc0cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59160/0 (socket says 172.21.15.144:59160) 2024-09-11T23:22:39.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.775+0000 7fabf9e00640 1 -- 172.21.15.144:0/3150538636 learned_addr learned my addr 172.21.15.144:0/3150538636 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:39.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.775+0000 7fabf9e00640 1 -- 172.21.15.144:0/3150538636 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fabfc0ce230 msgr2=0x7fabfc0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:39.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.775+0000 7fabf1400640 1 --2- 172.21.15.144:0/3150538636 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fabfc0ce230 0x7fabfc0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:39.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.775+0000 7fabf9e00640 1 --2- 172.21.15.144:0/3150538636 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fabfc0ce230 0x7fabfc0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:39.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.775+0000 7fabf9e00640 1 -- 172.21.15.144:0/3150538636 >> v1:172.21.15.165:6789/0 conn(0x7fabfc0cf5b0 legacy=0x7fabfc073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:39.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.775+0000 7fabf9e00640 1 -- 172.21.15.144:0/3150538636 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabfc072c00 con 0x7fabfc15c180 2024-09-11T23:22:39.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.775+0000 7fabf1400640 1 --2- 172.21.15.144:0/3150538636 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fabfc0ce230 0x7fabfc0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:22:39.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.776+0000 7fabf9e00640 1 --2- 172.21.15.144:0/3150538636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabfc15c180 0x7fabfc0cdcf0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fabec009870 tx=0x7fabec02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31edbe431715fee1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.776+0000 7fabf9400640 1 -- 172.21.15.144:0/3150538636 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec037070 con 0x7fabfc15c180 2024-09-11T23:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.777+0000 7fabf9400640 1 -- 172.21.15.144:0/3150538636 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabec032440 con 0x7fabfc15c180 2024-09-11T23:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.777+0000 7fabf9400640 1 -- 172.21.15.144:0/3150538636 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec032810 con 0x7fabfc15c180 2024-09-11T23:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.777+0000 7fac00e00640 1 -- 172.21.15.144:0/3150538636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabfc15c180 msgr2=0x7fabfc0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.777+0000 7fac00e00640 1 --2- 172.21.15.144:0/3150538636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabfc15c180 0x7fabfc0cdcf0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fabec009870 tx=0x7fabec02a180 comp rx=0 tx=0).stop 2024-09-11T23:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.777+0000 7fac00e00640 1 -- 172.21.15.144:0/3150538636 shutdown_connections 2024-09-11T23:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.777+0000 7fac00e00640 1 --2- 172.21.15.144:0/3150538636 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fabfc0ce230 0x7fabfc0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.777+0000 7fac00e00640 1 --2- 172.21.15.144:0/3150538636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabfc15c180 0x7fabfc0cdcf0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.777+0000 7fac00e00640 1 -- 172.21.15.144:0/3150538636 >> 172.21.15.144:0/3150538636 conn(0x7fabfc062cc0 msgr2=0x7fabfc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:39.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.777+0000 7fac00e00640 1 -- 172.21.15.144:0/3150538636 shutdown_connections 2024-09-11T23:22:39.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.777+0000 7fac00e00640 1 -- 172.21.15.144:0/3150538636 wait complete. 2024-09-11T23:22:39.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.779+0000 7fac00e00640 1 Processor -- start 2024-09-11T23:22:39.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.779+0000 7fac00e00640 1 -- start start 2024-09-11T23:22:39.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.780+0000 7fac00e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabfc0ce230 0x7fabfc146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:39.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.780+0000 7fac00e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fabfc0cf5b0 0x7fabfc15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:39.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.780+0000 7fac00e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fabfc15c180 0x7fabfc15aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:39.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.780+0000 7fac00e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fabfc15c560 con 0x7fabfc0ce230 2024-09-11T23:22:39.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.780+0000 7fac00e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fabfc0722f0 con 0x7fabfc0cf5b0 2024-09-11T23:22:39.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.780+0000 7fac00e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fabfc15c6e0 con 0x7fabfc15c180 2024-09-11T23:22:39.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.780+0000 7fabf9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabfc0ce230 0x7fabfc146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:39.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.780+0000 7fabf9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabfc0ce230 0x7fabfc146d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59172/0 (socket says 172.21.15.144:59172) 2024-09-11T23:22:39.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.780+0000 7fabf9e00640 1 -- 172.21.15.144:0/3932089731 learned_addr learned my addr 172.21.15.144:0/3932089731 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:39.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.780+0000 7fabf9e00640 1 -- 172.21.15.144:0/3932089731 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fabfc15c180 msgr2=0x7fabfc15aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:39.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.780+0000 7fabf9e00640 1 --2- 172.21.15.144:0/3932089731 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fabfc15c180 0x7fabfc15aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:39.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.780+0000 7fabf9e00640 1 -- 172.21.15.144:0/3932089731 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fabfc0cf5b0 msgr2=0x7fabfc15a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:39.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.780+0000 7fabf9e00640 1 --2- 172.21.15.144:0/3932089731 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fabfc0cf5b0 0x7fabfc15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:39.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.780+0000 7fabf9e00640 1 -- 172.21.15.144:0/3932089731 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabfc1472c0 con 0x7fabfc0ce230 2024-09-11T23:22:39.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.781+0000 7fabf9e00640 1 --2- 172.21.15.144:0/3932089731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabfc0ce230 0x7fabfc146d80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fabec009870 tx=0x7fabec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:39.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.781+0000 7fabf2a00640 1 -- 172.21.15.144:0/3932089731 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec041020 con 0x7fabfc0ce230 2024-09-11T23:22:39.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.781+0000 7fabf2a00640 1 -- 172.21.15.144:0/3932089731 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabec030970 con 0x7fabfc0ce230 2024-09-11T23:22:39.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.781+0000 7fabf2a00640 1 -- 172.21.15.144:0/3932089731 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec037040 con 0x7fabfc0ce230 2024-09-11T23:22:39.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.781+0000 7fac00e00640 1 -- 172.21.15.144:0/3932089731 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabfc160190 con 0x7fabfc0ce230 2024-09-11T23:22:39.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.781+0000 7fac00e00640 1 -- 172.21.15.144:0/3932089731 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabfc160430 con 0x7fabfc0ce230 2024-09-11T23:22:39.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.782+0000 7fac00e00640 1 -- 172.21.15.144:0/3932089731 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabfc0cf070 con 0x7fabfc0ce230 2024-09-11T23:22:39.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.783+0000 7fabf2a00640 1 -- 172.21.15.144:0/3932089731 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fabec044020 con 0x7fabfc0ce230 2024-09-11T23:22:39.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.784+0000 7fabf2a00640 1 --2- 172.21.15.144:0/3932089731 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fabd806bf50 0x7fabd806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:39.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.785+0000 7fabf2a00640 1 -- 172.21.15.144:0/3932089731 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fabec0aba30 con 0x7fabfc0ce230 2024-09-11T23:22:39.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.785+0000 7fabf1400640 1 --2- 172.21.15.144:0/3932089731 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fabd806bf50 0x7fabd806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:39.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.786+0000 7fabf1400640 1 --2- 172.21.15.144:0/3932089731 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fabd806bf50 0x7fabd806e410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fabe4006fd0 tx=0x7fabe4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:39.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.789+0000 7fabf2a00640 1 -- 172.21.15.144:0/3932089731 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fabec04b030 con 0x7fabfc0ce230 2024-09-11T23:22:39.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.964+0000 7fac00e00640 1 -- 172.21.15.144:0/3932089731 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fabfc0aff00 con 0x7fabd806bf50 2024-09-11T23:22:39.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.971+0000 7fabf2a00640 1 -- 172.21.15.144:0/3932089731 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252080 (secure 0 0 0) 0x7fabfc0aff00 con 0x7fabd806bf50 2024-09-11T23:22:39.974 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:39.975 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:22:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.975+0000 7fac00e00640 1 -- 172.21.15.144:0/3932089731 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fabd806bf50 msgr2=0x7fabd806e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.975+0000 7fac00e00640 1 --2- 172.21.15.144:0/3932089731 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fabd806bf50 0x7fabd806e410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fabe4006fd0 tx=0x7fabe4008040 comp rx=0 tx=0).stop 2024-09-11T23:22:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.975+0000 7fac00e00640 1 -- 172.21.15.144:0/3932089731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabfc0ce230 msgr2=0x7fabfc146d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.975+0000 7fac00e00640 1 --2- 172.21.15.144:0/3932089731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabfc0ce230 0x7fabfc146d80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fabec009870 tx=0x7fabec0046c0 comp rx=0 tx=0).stop 2024-09-11T23:22:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.975+0000 7fac00e00640 1 -- 172.21.15.144:0/3932089731 shutdown_connections 2024-09-11T23:22:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.975+0000 7fac00e00640 1 --2- 172.21.15.144:0/3932089731 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fabd806bf50 0x7fabd806e410 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.975+0000 7fac00e00640 1 --2- 172.21.15.144:0/3932089731 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fabfc15c180 0x7fabfc15aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.975+0000 7fac00e00640 1 --2- 172.21.15.144:0/3932089731 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fabfc0cf5b0 0x7fabfc15a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.975+0000 7fac00e00640 1 --2- 172.21.15.144:0/3932089731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fabfc0ce230 0x7fabfc146d80 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.975+0000 7fac00e00640 1 -- 172.21.15.144:0/3932089731 >> 172.21.15.144:0/3932089731 conn(0x7fabfc062cc0 msgr2=0x7fabfc0b24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.975+0000 7fac00e00640 1 -- 172.21.15.144:0/3932089731 shutdown_connections 2024-09-11T23:22:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:39.975+0000 7fac00e00640 1 -- 172.21.15.144:0/3932089731 wait complete. 2024-09-11T23:22:39.991 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-11T23:22:38.716217+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258624,"kb_used_data":9096,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716096,"statfs":{"total":773094113280,"available":772829282304,"internally_reserved":0,"allocated":9314304,"data_stored":4632124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002174"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720741+0000","last_change":"2024-09-11T23:22:30.800408+0000","last_active":"2024-09-11T23:22:32.720741+0000","last_peered":"2024-09-11T23:22:32.720741+0000","last_clean":"2024-09-11T23:22:32.720741+0000","last_became_active":"2024-09-11T23:22:30.800128+0000","last_became_peered":"2024-09-11T23:22:30.800128+0000","last_unstale":"2024-09-11T23:22:32.720741+0000","last_undegraded":"2024-09-11T23:22:32.720741+0000","last_fullsized":"2024-09-11T23:22:32.720741+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:05.134457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.802593+0000","last_change":"2024-09-11T23:22:30.801190+0000","last_active":"2024-09-11T23:22:31.802593+0000","last_peered":"2024-09-11T23:22:31.802593+0000","last_clean":"2024-09-11T23:22:31.802593+0000","last_became_active":"2024-09-11T23:22:30.800841+0000","last_became_peered":"2024-09-11T23:22:30.800841+0000","last_unstale":"2024-09-11T23:22:31.802593+0000","last_undegraded":"2024-09-11T23:22:31.802593+0000","last_fullsized":"2024-09-11T23:22:31.802593+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:43.034790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720309+0000","last_change":"2024-09-11T23:22:30.805838+0000","last_active":"2024-09-11T23:22:32.720309+0000","last_peered":"2024-09-11T23:22:32.720309+0000","last_clean":"2024-09-11T23:22:32.720309+0000","last_became_active":"2024-09-11T23:22:30.804939+0000","last_became_peered":"2024-09-11T23:22:30.804939+0000","last_unstale":"2024-09-11T23:22:32.720309+0000","last_undegraded":"2024-09-11T23:22:32.720309+0000","last_fullsized":"2024-09-11T23:22:32.720309+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:29.484500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720619+0000","last_change":"2024-09-11T23:22:30.807083+0000","last_active":"2024-09-11T23:22:32.720619+0000","last_peered":"2024-09-11T23:22:32.720619+0000","last_clean":"2024-09-11T23:22:32.720619+0000","last_became_active":"2024-09-11T23:22:30.806822+0000","last_became_peered":"2024-09-11T23:22:30.806822+0000","last_unstale":"2024-09-11T23:22:32.720619+0000","last_undegraded":"2024-09-11T23:22:32.720619+0000","last_fullsized":"2024-09-11T23:22:32.720619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:42:44.054972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800655+0000","last_change":"2024-09-11T23:22:30.798014+0000","last_active":"2024-09-11T23:22:31.800655+0000","last_peered":"2024-09-11T23:22:31.800655+0000","last_clean":"2024-09-11T23:22:31.800655+0000","last_became_active":"2024-09-11T23:22:30.797690+0000","last_became_peered":"2024-09-11T23:22:30.797690+0000","last_unstale":"2024-09-11T23:22:31.800655+0000","last_undegraded":"2024-09-11T23:22:31.800655+0000","last_fullsized":"2024-09-11T23:22:31.800655+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:12.165796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800415+0000","last_change":"2024-09-11T23:22:30.797054+0000","last_active":"2024-09-11T23:22:31.800415+0000","last_peered":"2024-09-11T23:22:31.800415+0000","last_clean":"2024-09-11T23:22:31.800415+0000","last_became_active":"2024-09-11T23:22:30.796767+0000","last_became_peered":"2024-09-11T23:22:30.796767+0000","last_unstale":"2024-09-11T23:22:31.800415+0000","last_undegraded":"2024-09-11T23:22:31.800415+0000","last_fullsized":"2024-09-11T23:22:31.800415+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:19.024604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720298+0000","last_change":"2024-09-11T23:22:30.806045+0000","last_active":"2024-09-11T23:22:32.720298+0000","last_peered":"2024-09-11T23:22:32.720298+0000","last_clean":"2024-09-11T23:22:32.720298+0000","last_became_active":"2024-09-11T23:22:30.805762+0000","last_became_peered":"2024-09-11T23:22:30.805762+0000","last_unstale":"2024-09-11T23:22:32.720298+0000","last_undegraded":"2024-09-11T23:22:32.720298+0000","last_fullsized":"2024-09-11T23:22:32.720298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:56.117215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800858+0000","last_change":"2024-09-11T23:22:30.791000+0000","last_active":"2024-09-11T23:22:31.800858+0000","last_peered":"2024-09-11T23:22:31.800858+0000","last_clean":"2024-09-11T23:22:31.800858+0000","last_became_active":"2024-09-11T23:22:30.790721+0000","last_became_peered":"2024-09-11T23:22:30.790721+0000","last_unstale":"2024-09-11T23:22:31.800858+0000","last_undegraded":"2024-09-11T23:22:31.800858+0000","last_fullsized":"2024-09-11T23:22:31.800858+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:23.847671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.801286+0000","last_change":"2024-09-11T23:22:30.796706+0000","last_active":"2024-09-11T23:22:31.801286+0000","last_peered":"2024-09-11T23:22:31.801286+0000","last_clean":"2024-09-11T23:22:31.801286+0000","last_became_active":"2024-09-11T23:22:30.796257+0000","last_became_peered":"2024-09-11T23:22:30.796257+0000","last_unstale":"2024-09-11T23:22:31.801286+0000","last_undegraded":"2024-09-11T23:22:31.801286+0000","last_fullsized":"2024-09-11T23:22:31.801286+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:56.533779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720794+0000","last_change":"2024-09-11T23:22:30.795055+0000","last_active":"2024-09-11T23:22:32.720794+0000","last_peered":"2024-09-11T23:22:32.720794+0000","last_clean":"2024-09-11T23:22:32.720794+0000","last_became_active":"2024-09-11T23:22:30.794772+0000","last_became_peered":"2024-09-11T23:22:30.794772+0000","last_unstale":"2024-09-11T23:22:32.720794+0000","last_undegraded":"2024-09-11T23:22:32.720794+0000","last_fullsized":"2024-09-11T23:22:32.720794+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:42.592058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.802688+0000","last_change":"2024-09-11T23:22:30.795375+0000","last_active":"2024-09-11T23:22:31.802688+0000","last_peered":"2024-09-11T23:22:31.802688+0000","last_clean":"2024-09-11T23:22:31.802688+0000","last_became_active":"2024-09-11T23:22:30.795136+0000","last_became_peered":"2024-09-11T23:22:30.795136+0000","last_unstale":"2024-09-11T23:22:31.802688+0000","last_undegraded":"2024-09-11T23:22:31.802688+0000","last_fullsized":"2024-09-11T23:22:31.802688+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:40.864481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720390+0000","last_change":"2024-09-11T23:22:30.800948+0000","last_active":"2024-09-11T23:22:32.720390+0000","last_peered":"2024-09-11T23:22:32.720390+0000","last_clean":"2024-09-11T23:22:32.720390+0000","last_became_active":"2024-09-11T23:22:30.799063+0000","last_became_peered":"2024-09-11T23:22:30.799063+0000","last_unstale":"2024-09-11T23:22:32.720390+0000","last_undegraded":"2024-09-11T23:22:32.720390+0000","last_fullsized":"2024-09-11T23:22:32.720390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:36.716393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720165+0000","last_change":"2024-09-11T23:22:30.802762+0000","last_active":"2024-09-11T23:22:32.720165+0000","last_peered":"2024-09-11T23:22:32.720165+0000","last_clean":"2024-09-11T23:22:32.720165+0000","last_became_active":"2024-09-11T23:22:30.801424+0000","last_became_peered":"2024-09-11T23:22:30.801424+0000","last_unstale":"2024-09-11T23:22:32.720165+0000","last_undegraded":"2024-09-11T23:22:32.720165+0000","last_fullsized":"2024-09-11T23:22:32.720165+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:22.025493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720794+0000","last_change":"2024-09-11T23:22:30.805357+0000","last_active":"2024-09-11T23:22:32.720794+0000","last_peered":"2024-09-11T23:22:32.720794+0000","last_clean":"2024-09-11T23:22:32.720794+0000","last_became_active":"2024-09-11T23:22:30.804506+0000","last_became_peered":"2024-09-11T23:22:30.804506+0000","last_unstale":"2024-09-11T23:22:32.720794+0000","last_undegraded":"2024-09-11T23:22:32.720794+0000","last_fullsized":"2024-09-11T23:22:32.720794+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:55.444210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.799974+0000","last_change":"2024-09-11T23:22:30.798623+0000","last_active":"2024-09-11T23:22:31.799974+0000","last_peered":"2024-09-11T23:22:31.799974+0000","last_clean":"2024-09-11T23:22:31.799974+0000","last_became_active":"2024-09-11T23:22:30.798262+0000","last_became_peered":"2024-09-11T23:22:30.798262+0000","last_unstale":"2024-09-11T23:22:31.799974+0000","last_undegraded":"2024-09-11T23:22:31.799974+0000","last_fullsized":"2024-09-11T23:22:31.799974+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:00.591135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.799853+0000","last_change":"2024-09-11T23:22:30.795820+0000","last_active":"2024-09-11T23:22:31.799853+0000","last_peered":"2024-09-11T23:22:31.799853+0000","last_clean":"2024-09-11T23:22:31.799853+0000","last_became_active":"2024-09-11T23:22:30.795543+0000","last_became_peered":"2024-09-11T23:22:30.795543+0000","last_unstale":"2024-09-11T23:22:31.799853+0000","last_undegraded":"2024-09-11T23:22:31.799853+0000","last_fullsized":"2024-09-11T23:22:31.799853+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:33:54.395684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.801547+0000","last_change":"2024-09-11T23:22:30.795804+0000","last_active":"2024-09-11T23:22:31.801547+0000","last_peered":"2024-09-11T23:22:31.801547+0000","last_clean":"2024-09-11T23:22:31.801547+0000","last_became_active":"2024-09-11T23:22:30.795509+0000","last_became_peered":"2024-09-11T23:22:30.795509+0000","last_unstale":"2024-09-11T23:22:31.801547+0000","last_undegraded":"2024-09-11T23:22:31.801547+0000","last_fullsized":"2024-09-11T23:22:31.801547+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:36.716393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720649+0000","last_change":"2024-09-11T23:22:30.800840+0000","last_active":"2024-09-11T23:22:32.720649+0000","last_peered":"2024-09-11T23:22:32.720649+0000","last_clean":"2024-09-11T23:22:32.720649+0000","last_became_active":"2024-09-11T23:22:30.800575+0000","last_became_peered":"2024-09-11T23:22:30.800575+0000","last_unstale":"2024-09-11T23:22:32.720649+0000","last_undegraded":"2024-09-11T23:22:32.720649+0000","last_fullsized":"2024-09-11T23:22:32.720649+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:28.912881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800558+0000","last_change":"2024-09-11T23:22:30.790562+0000","last_active":"2024-09-11T23:22:31.800558+0000","last_peered":"2024-09-11T23:22:31.800558+0000","last_clean":"2024-09-11T23:22:31.800558+0000","last_became_active":"2024-09-11T23:22:30.790289+0000","last_became_peered":"2024-09-11T23:22:30.790289+0000","last_unstale":"2024-09-11T23:22:31.800558+0000","last_undegraded":"2024-09-11T23:22:31.800558+0000","last_fullsized":"2024-09-11T23:22:31.800558+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:22.025493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720671+0000","last_change":"2024-09-11T23:22:30.796369+0000","last_active":"2024-09-11T23:22:32.720671+0000","last_peered":"2024-09-11T23:22:32.720671+0000","last_clean":"2024-09-11T23:22:32.720671+0000","last_became_active":"2024-09-11T23:22:30.796101+0000","last_became_peered":"2024-09-11T23:22:30.796101+0000","last_unstale":"2024-09-11T23:22:32.720671+0000","last_undegraded":"2024-09-11T23:22:32.720671+0000","last_fullsized":"2024-09-11T23:22:32.720671+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:36.281318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720535+0000","last_change":"2024-09-11T23:22:30.806468+0000","last_active":"2024-09-11T23:22:32.720535+0000","last_peered":"2024-09-11T23:22:32.720535+0000","last_clean":"2024-09-11T23:22:32.720535+0000","last_became_active":"2024-09-11T23:22:30.806225+0000","last_became_peered":"2024-09-11T23:22:30.806225+0000","last_unstale":"2024-09-11T23:22:32.720535+0000","last_undegraded":"2024-09-11T23:22:32.720535+0000","last_fullsized":"2024-09-11T23:22:32.720535+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:27.761984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.802314+0000","last_change":"2024-09-11T23:22:30.786314+0000","last_active":"2024-09-11T23:22:31.802314+0000","last_peered":"2024-09-11T23:22:31.802314+0000","last_clean":"2024-09-11T23:22:31.802314+0000","last_became_active":"2024-09-11T23:22:30.786056+0000","last_became_peered":"2024-09-11T23:22:30.786056+0000","last_unstale":"2024-09-11T23:22:31.802314+0000","last_undegraded":"2024-09-11T23:22:31.802314+0000","last_fullsized":"2024-09-11T23:22:31.802314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:12.604848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.719979+0000","last_change":"2024-09-11T23:22:30.796659+0000","last_active":"2024-09-11T23:22:32.719979+0000","last_peered":"2024-09-11T23:22:32.719979+0000","last_clean":"2024-09-11T23:22:32.719979+0000","last_became_active":"2024-09-11T23:22:30.796389+0000","last_became_peered":"2024-09-11T23:22:30.796389+0000","last_unstale":"2024-09-11T23:22:32.719979+0000","last_undegraded":"2024-09-11T23:22:32.719979+0000","last_fullsized":"2024-09-11T23:22:32.719979+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:33.395881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720336+0000","last_change":"2024-09-11T23:22:30.797617+0000","last_active":"2024-09-11T23:22:32.720336+0000","last_peered":"2024-09-11T23:22:32.720336+0000","last_clean":"2024-09-11T23:22:32.720336+0000","last_became_active":"2024-09-11T23:22:30.797108+0000","last_became_peered":"2024-09-11T23:22:30.797108+0000","last_unstale":"2024-09-11T23:22:32.720336+0000","last_undegraded":"2024-09-11T23:22:32.720336+0000","last_fullsized":"2024-09-11T23:22:32.720336+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:53.234368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.802390+0000","last_change":"2024-09-11T23:22:30.807404+0000","last_active":"2024-09-11T23:22:31.802390+0000","last_peered":"2024-09-11T23:22:31.802390+0000","last_clean":"2024-09-11T23:22:31.802390+0000","last_became_active":"2024-09-11T23:22:30.803863+0000","last_became_peered":"2024-09-11T23:22:30.803863+0000","last_unstale":"2024-09-11T23:22:31.802390+0000","last_undegraded":"2024-09-11T23:22:31.802390+0000","last_fullsized":"2024-09-11T23:22:31.802390+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:23.552538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720645+0000","last_change":"2024-09-11T23:22:30.806807+0000","last_active":"2024-09-11T23:22:32.720645+0000","last_peered":"2024-09-11T23:22:32.720645+0000","last_clean":"2024-09-11T23:22:32.720645+0000","last_became_active":"2024-09-11T23:22:30.806524+0000","last_became_peered":"2024-09-11T23:22:30.806524+0000","last_unstale":"2024-09-11T23:22:32.720645+0000","last_undegraded":"2024-09-11T23:22:32.720645+0000","last_fullsized":"2024-09-11T23:22:32.720645+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:15.812108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800569+0000","last_change":"2024-09-11T23:22:30.789332+0000","last_active":"2024-09-11T23:22:31.800569+0000","last_peered":"2024-09-11T23:22:31.800569+0000","last_clean":"2024-09-11T23:22:31.800569+0000","last_became_active":"2024-09-11T23:22:30.789067+0000","last_became_peered":"2024-09-11T23:22:30.789067+0000","last_unstale":"2024-09-11T23:22:31.800569+0000","last_undegraded":"2024-09-11T23:22:31.800569+0000","last_fullsized":"2024-09-11T23:22:31.800569+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:57.017098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720587+0000","last_change":"2024-09-11T23:22:30.798376+0000","last_active":"2024-09-11T23:22:32.720587+0000","last_peered":"2024-09-11T23:22:32.720587+0000","last_clean":"2024-09-11T23:22:32.720587+0000","last_became_active":"2024-09-11T23:22:30.798030+0000","last_became_peered":"2024-09-11T23:22:30.798030+0000","last_unstale":"2024-09-11T23:22:32.720587+0000","last_undegraded":"2024-09-11T23:22:32.720587+0000","last_fullsized":"2024-09-11T23:22:32.720587+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:19.024604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.802711+0000","last_change":"2024-09-11T23:22:30.787671+0000","last_active":"2024-09-11T23:22:31.802711+0000","last_peered":"2024-09-11T23:22:31.802711+0000","last_clean":"2024-09-11T23:22:31.802711+0000","last_became_active":"2024-09-11T23:22:30.787417+0000","last_became_peered":"2024-09-11T23:22:30.787417+0000","last_unstale":"2024-09-11T23:22:31.802711+0000","last_undegraded":"2024-09-11T23:22:31.802711+0000","last_fullsized":"2024-09-11T23:22:31.802711+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:59.982069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.802360+0000","last_change":"2024-09-11T23:22:30.799974+0000","last_active":"2024-09-11T23:22:31.802360+0000","last_peered":"2024-09-11T23:22:31.802360+0000","last_clean":"2024-09-11T23:22:31.802360+0000","last_became_active":"2024-09-11T23:22:30.799649+0000","last_became_peered":"2024-09-11T23:22:30.799649+0000","last_unstale":"2024-09-11T23:22:31.802360+0000","last_undegraded":"2024-09-11T23:22:31.802360+0000","last_fullsized":"2024-09-11T23:22:31.802360+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.144508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.799853+0000","last_change":"2024-09-11T23:22:30.792752+0000","last_active":"2024-09-11T23:22:31.799853+0000","last_peered":"2024-09-11T23:22:31.799853+0000","last_clean":"2024-09-11T23:22:31.799853+0000","last_became_active":"2024-09-11T23:22:30.792453+0000","last_became_peered":"2024-09-11T23:22:30.792453+0000","last_unstale":"2024-09-11T23:22:31.799853+0000","last_undegraded":"2024-09-11T23:22:31.799853+0000","last_fullsized":"2024-09-11T23:22:31.799853+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:59.982069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.719955+0000","last_change":"2024-09-11T23:22:30.803871+0000","last_active":"2024-09-11T23:22:32.719955+0000","last_peered":"2024-09-11T23:22:32.719955+0000","last_clean":"2024-09-11T23:22:32.719955+0000","last_became_active":"2024-09-11T23:22:30.803585+0000","last_became_peered":"2024-09-11T23:22:30.803585+0000","last_unstale":"2024-09-11T23:22:32.719955+0000","last_undegraded":"2024-09-11T23:22:32.719955+0000","last_fullsized":"2024-09-11T23:22:32.719955+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:46.754267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.801167+0000","last_change":"2024-09-11T23:22:30.800755+0000","last_active":"2024-09-11T23:22:31.801167+0000","last_peered":"2024-09-11T23:22:31.801167+0000","last_clean":"2024-09-11T23:22:31.801167+0000","last_became_active":"2024-09-11T23:22:30.800502+0000","last_became_peered":"2024-09-11T23:22:30.800502+0000","last_unstale":"2024-09-11T23:22:31.801167+0000","last_undegraded":"2024-09-11T23:22:31.801167+0000","last_fullsized":"2024-09-11T23:22:31.801167+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:33.395881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"82'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.721088+0000","last_change":"2024-09-11T23:22:29.801202+0000","last_active":"2024-09-11T23:22:32.721088+0000","last_peered":"2024-09-11T23:22:32.721088+0000","last_clean":"2024-09-11T23:22:32.721088+0000","last_became_active":"2024-09-11T23:22:29.800931+0000","last_became_peered":"2024-09-11T23:22:29.800931+0000","last_unstale":"2024-09-11T23:22:32.721088+0000","last_undegraded":"2024-09-11T23:22:32.721088+0000","last_fullsized":"2024-09-11T23:22:32.721088+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:11.597039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.721053+0000","last_change":"2024-09-11T23:22:30.801186+0000","last_active":"2024-09-11T23:22:32.721053+0000","last_peered":"2024-09-11T23:22:32.721053+0000","last_clean":"2024-09-11T23:22:32.721053+0000","last_became_active":"2024-09-11T23:22:30.799898+0000","last_became_peered":"2024-09-11T23:22:30.799898+0000","last_unstale":"2024-09-11T23:22:32.721053+0000","last_undegraded":"2024-09-11T23:22:32.721053+0000","last_fullsized":"2024-09-11T23:22:32.721053+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:23.847671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.801456+0000","last_change":"2024-09-11T23:22:29.791510+0000","last_active":"2024-09-11T23:22:31.801456+0000","last_peered":"2024-09-11T23:22:31.801456+0000","last_clean":"2024-09-11T23:22:31.801456+0000","last_became_active":"2024-09-11T23:22:29.791216+0000","last_became_peered":"2024-09-11T23:22:29.791216+0000","last_unstale":"2024-09-11T23:22:31.801456+0000","last_undegraded":"2024-09-11T23:22:31.801456+0000","last_fullsized":"2024-09-11T23:22:31.801456+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:17.074928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720954+0000","last_change":"2024-09-11T23:22:30.795001+0000","last_active":"2024-09-11T23:22:32.720954+0000","last_peered":"2024-09-11T23:22:32.720954+0000","last_clean":"2024-09-11T23:22:32.720954+0000","last_became_active":"2024-09-11T23:22:30.794538+0000","last_became_peered":"2024-09-11T23:22:30.794538+0000","last_unstale":"2024-09-11T23:22:32.720954+0000","last_undegraded":"2024-09-11T23:22:32.720954+0000","last_fullsized":"2024-09-11T23:22:32.720954+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:42.552597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800489+0000","last_change":"2024-09-11T23:22:29.797262+0000","last_active":"2024-09-11T23:22:31.800489+0000","last_peered":"2024-09-11T23:22:31.800489+0000","last_clean":"2024-09-11T23:22:31.800489+0000","last_became_active":"2024-09-11T23:22:29.796852+0000","last_became_peered":"2024-09-11T23:22:29.796852+0000","last_unstale":"2024-09-11T23:22:31.800489+0000","last_undegraded":"2024-09-11T23:22:31.800489+0000","last_fullsized":"2024-09-11T23:22:31.800489+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:41.544788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720483+0000","last_change":"2024-09-11T23:22:30.803428+0000","last_active":"2024-09-11T23:22:32.720483+0000","last_peered":"2024-09-11T23:22:32.720483+0000","last_clean":"2024-09-11T23:22:32.720483+0000","last_became_active":"2024-09-11T23:22:30.802951+0000","last_became_peered":"2024-09-11T23:22:30.802951+0000","last_unstale":"2024-09-11T23:22:32.720483+0000","last_undegraded":"2024-09-11T23:22:32.720483+0000","last_fullsized":"2024-09-11T23:22:32.720483+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:16.113915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800284+0000","last_change":"2024-09-11T23:22:29.798952+0000","last_active":"2024-09-11T23:22:31.800284+0000","last_peered":"2024-09-11T23:22:31.800284+0000","last_clean":"2024-09-11T23:22:31.800284+0000","last_became_active":"2024-09-11T23:22:29.798584+0000","last_became_peered":"2024-09-11T23:22:29.798584+0000","last_unstale":"2024-09-11T23:22:31.800284+0000","last_undegraded":"2024-09-11T23:22:31.800284+0000","last_fullsized":"2024-09-11T23:22:31.800284+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:04.126648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.802465+0000","last_change":"2024-09-11T23:22:30.799580+0000","last_active":"2024-09-11T23:22:31.802465+0000","last_peered":"2024-09-11T23:22:31.802465+0000","last_clean":"2024-09-11T23:22:31.802465+0000","last_became_active":"2024-09-11T23:22:30.799333+0000","last_became_peered":"2024-09-11T23:22:30.799333+0000","last_unstale":"2024-09-11T23:22:31.802465+0000","last_undegraded":"2024-09-11T23:22:31.802465+0000","last_fullsized":"2024-09-11T23:22:31.802465+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:16.395378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800990+0000","last_change":"2024-09-11T23:22:29.791619+0000","last_active":"2024-09-11T23:22:31.800990+0000","last_peered":"2024-09-11T23:22:31.800990+0000","last_clean":"2024-09-11T23:22:31.800990+0000","last_became_active":"2024-09-11T23:22:29.791285+0000","last_became_peered":"2024-09-11T23:22:29.791285+0000","last_unstale":"2024-09-11T23:22:31.800990+0000","last_undegraded":"2024-09-11T23:22:31.800990+0000","last_fullsized":"2024-09-11T23:22:31.800990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:49.119486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800815+0000","last_change":"2024-09-11T23:22:30.798234+0000","last_active":"2024-09-11T23:22:31.800815+0000","last_peered":"2024-09-11T23:22:31.800815+0000","last_clean":"2024-09-11T23:22:31.800815+0000","last_became_active":"2024-09-11T23:22:30.797953+0000","last_became_peered":"2024-09-11T23:22:30.797953+0000","last_unstale":"2024-09-11T23:22:31.800815+0000","last_undegraded":"2024-09-11T23:22:31.800815+0000","last_fullsized":"2024-09-11T23:22:31.800815+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:44.521598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800320+0000","last_change":"2024-09-11T23:22:29.799472+0000","last_active":"2024-09-11T23:22:31.800320+0000","last_peered":"2024-09-11T23:22:31.800320+0000","last_clean":"2024-09-11T23:22:31.800320+0000","last_became_active":"2024-09-11T23:22:29.799108+0000","last_became_peered":"2024-09-11T23:22:29.799108+0000","last_unstale":"2024-09-11T23:22:31.800320+0000","last_undegraded":"2024-09-11T23:22:31.800320+0000","last_fullsized":"2024-09-11T23:22:31.800320+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:18.891456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.719897+0000","last_change":"2024-09-11T23:22:30.804657+0000","last_active":"2024-09-11T23:22:32.719897+0000","last_peered":"2024-09-11T23:22:32.719897+0000","last_clean":"2024-09-11T23:22:32.719897+0000","last_became_active":"2024-09-11T23:22:30.801946+0000","last_became_peered":"2024-09-11T23:22:30.801946+0000","last_unstale":"2024-09-11T23:22:32.719897+0000","last_undegraded":"2024-09-11T23:22:32.719897+0000","last_fullsized":"2024-09-11T23:22:32.719897+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:01.490782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.798984+0000","last_change":"2024-09-11T23:22:29.794917+0000","last_active":"2024-09-11T23:22:31.798984+0000","last_peered":"2024-09-11T23:22:31.798984+0000","last_clean":"2024-09-11T23:22:31.798984+0000","last_became_active":"2024-09-11T23:22:29.794644+0000","last_became_peered":"2024-09-11T23:22:29.794644+0000","last_unstale":"2024-09-11T23:22:31.798984+0000","last_undegraded":"2024-09-11T23:22:31.798984+0000","last_fullsized":"2024-09-11T23:22:31.798984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:35.708584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.798897+0000","last_change":"2024-09-11T23:22:30.798458+0000","last_active":"2024-09-11T23:22:31.798897+0000","last_peered":"2024-09-11T23:22:31.798897+0000","last_clean":"2024-09-11T23:22:31.798897+0000","last_became_active":"2024-09-11T23:22:30.798197+0000","last_became_peered":"2024-09-11T23:22:30.798197+0000","last_unstale":"2024-09-11T23:22:31.798897+0000","last_undegraded":"2024-09-11T23:22:31.798897+0000","last_fullsized":"2024-09-11T23:22:31.798897+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:19.913078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.802323+0000","last_change":"2024-09-11T23:22:29.791904+0000","last_active":"2024-09-11T23:22:31.802323+0000","last_peered":"2024-09-11T23:22:31.802323+0000","last_clean":"2024-09-11T23:22:31.802323+0000","last_became_active":"2024-09-11T23:22:29.791075+0000","last_became_peered":"2024-09-11T23:22:29.791075+0000","last_unstale":"2024-09-11T23:22:31.802323+0000","last_undegraded":"2024-09-11T23:22:31.802323+0000","last_fullsized":"2024-09-11T23:22:31.802323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:17.632437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.799161+0000","last_change":"2024-09-11T23:22:30.794057+0000","last_active":"2024-09-11T23:22:31.799161+0000","last_peered":"2024-09-11T23:22:31.799161+0000","last_clean":"2024-09-11T23:22:31.799161+0000","last_became_active":"2024-09-11T23:22:30.793788+0000","last_became_peered":"2024-09-11T23:22:30.793788+0000","last_unstale":"2024-09-11T23:22:31.799161+0000","last_undegraded":"2024-09-11T23:22:31.799161+0000","last_fullsized":"2024-09-11T23:22:31.799161+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:12.161750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.721167+0000","last_change":"2024-09-11T23:22:29.800033+0000","last_active":"2024-09-11T23:22:32.721167+0000","last_peered":"2024-09-11T23:22:32.721167+0000","last_clean":"2024-09-11T23:22:32.721167+0000","last_became_active":"2024-09-11T23:22:29.799648+0000","last_became_peered":"2024-09-11T23:22:29.799648+0000","last_unstale":"2024-09-11T23:22:32.721167+0000","last_undegraded":"2024-09-11T23:22:32.721167+0000","last_fullsized":"2024-09-11T23:22:32.721167+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:13.136699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.801463+0000","last_change":"2024-09-11T23:22:30.797451+0000","last_active":"2024-09-11T23:22:31.801463+0000","last_peered":"2024-09-11T23:22:31.801463+0000","last_clean":"2024-09-11T23:22:31.801463+0000","last_became_active":"2024-09-11T23:22:30.796748+0000","last_became_peered":"2024-09-11T23:22:30.796748+0000","last_unstale":"2024-09-11T23:22:31.801463+0000","last_undegraded":"2024-09-11T23:22:31.801463+0000","last_fullsized":"2024-09-11T23:22:31.801463+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:53.086733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720863+0000","last_change":"2024-09-11T23:22:29.797980+0000","last_active":"2024-09-11T23:22:32.720863+0000","last_peered":"2024-09-11T23:22:32.720863+0000","last_clean":"2024-09-11T23:22:32.720863+0000","last_became_active":"2024-09-11T23:22:29.797613+0000","last_became_peered":"2024-09-11T23:22:29.797613+0000","last_unstale":"2024-09-11T23:22:32.720863+0000","last_undegraded":"2024-09-11T23:22:32.720863+0000","last_fullsized":"2024-09-11T23:22:32.720863+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:44.237186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800163+0000","last_change":"2024-09-11T23:22:30.798401+0000","last_active":"2024-09-11T23:22:31.800163+0000","last_peered":"2024-09-11T23:22:31.800163+0000","last_clean":"2024-09-11T23:22:31.800163+0000","last_became_active":"2024-09-11T23:22:30.797728+0000","last_became_peered":"2024-09-11T23:22:30.797728+0000","last_unstale":"2024-09-11T23:22:31.800163+0000","last_undegraded":"2024-09-11T23:22:31.800163+0000","last_fullsized":"2024-09-11T23:22:31.800163+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:45.105915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"82'3","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720466+0000","last_change":"2024-09-11T23:22:29.796274+0000","last_active":"2024-09-11T23:22:32.720466+0000","last_peered":"2024-09-11T23:22:32.720466+0000","last_clean":"2024-09-11T23:22:32.720466+0000","last_became_active":"2024-09-11T23:22:29.796007+0000","last_became_peered":"2024-09-11T23:22:29.796007+0000","last_unstale":"2024-09-11T23:22:32.720466+0000","last_undegraded":"2024-09-11T23:22:32.720466+0000","last_fullsized":"2024-09-11T23:22:32.720466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:37.162204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800824+0000","last_change":"2024-09-11T23:22:30.800781+0000","last_active":"2024-09-11T23:22:31.800824+0000","last_peered":"2024-09-11T23:22:31.800824+0000","last_clean":"2024-09-11T23:22:31.800824+0000","last_became_active":"2024-09-11T23:22:30.800024+0000","last_became_peered":"2024-09-11T23:22:30.800024+0000","last_unstale":"2024-09-11T23:22:31.800824+0000","last_undegraded":"2024-09-11T23:22:31.800824+0000","last_fullsized":"2024-09-11T23:22:31.800824+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:34.686439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"82'6","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800329+0000","last_change":"2024-09-11T23:22:29.794370+0000","last_active":"2024-09-11T23:22:31.800329+0000","last_peered":"2024-09-11T23:22:31.800329+0000","last_clean":"2024-09-11T23:22:31.800329+0000","last_became_active":"2024-09-11T23:22:29.794076+0000","last_became_peered":"2024-09-11T23:22:29.794076+0000","last_unstale":"2024-09-11T23:22:31.800329+0000","last_undegraded":"2024-09-11T23:22:31.800329+0000","last_fullsized":"2024-09-11T23:22:31.800329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:11.157987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.799176+0000","last_change":"2024-09-11T23:22:30.794617+0000","last_active":"2024-09-11T23:22:31.799176+0000","last_peered":"2024-09-11T23:22:31.799176+0000","last_clean":"2024-09-11T23:22:31.799176+0000","last_became_active":"2024-09-11T23:22:30.794321+0000","last_became_peered":"2024-09-11T23:22:30.794321+0000","last_unstale":"2024-09-11T23:22:31.799176+0000","last_undegraded":"2024-09-11T23:22:31.799176+0000","last_fullsized":"2024-09-11T23:22:31.799176+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:06.546441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.802656+0000","last_change":"2024-09-11T23:22:29.788351+0000","last_active":"2024-09-11T23:22:31.802656+0000","last_peered":"2024-09-11T23:22:31.802656+0000","last_clean":"2024-09-11T23:22:31.802656+0000","last_became_active":"2024-09-11T23:22:29.788085+0000","last_became_peered":"2024-09-11T23:22:29.788085+0000","last_unstale":"2024-09-11T23:22:31.802656+0000","last_undegraded":"2024-09-11T23:22:31.802656+0000","last_fullsized":"2024-09-11T23:22:31.802656+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:04:07.998110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720232+0000","last_change":"2024-09-11T23:22:30.804325+0000","last_active":"2024-09-11T23:22:32.720232+0000","last_peered":"2024-09-11T23:22:32.720232+0000","last_clean":"2024-09-11T23:22:32.720232+0000","last_became_active":"2024-09-11T23:22:30.804054+0000","last_became_peered":"2024-09-11T23:22:30.804054+0000","last_unstale":"2024-09-11T23:22:32.720232+0000","last_undegraded":"2024-09-11T23:22:32.720232+0000","last_fullsized":"2024-09-11T23:22:32.720232+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:44.329687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.799801+0000","last_change":"2024-09-11T23:22:29.793974+0000","last_active":"2024-09-11T23:22:31.799801+0000","last_peered":"2024-09-11T23:22:31.799801+0000","last_clean":"2024-09-11T23:22:31.799801+0000","last_became_active":"2024-09-11T23:22:29.793537+0000","last_became_peered":"2024-09-11T23:22:29.793537+0000","last_unstale":"2024-09-11T23:22:31.799801+0000","last_undegraded":"2024-09-11T23:22:31.799801+0000","last_fullsized":"2024-09-11T23:22:31.799801+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:46.034118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.802228+0000","last_change":"2024-09-11T23:22:30.797907+0000","last_active":"2024-09-11T23:22:31.802228+0000","last_peered":"2024-09-11T23:22:31.802228+0000","last_clean":"2024-09-11T23:22:31.802228+0000","last_became_active":"2024-09-11T23:22:30.797646+0000","last_became_peered":"2024-09-11T23:22:30.797646+0000","last_unstale":"2024-09-11T23:22:31.802228+0000","last_undegraded":"2024-09-11T23:22:31.802228+0000","last_fullsized":"2024-09-11T23:22:31.802228+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:45.244995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800660+0000","last_change":"2024-09-11T23:22:29.786056+0000","last_active":"2024-09-11T23:22:31.800660+0000","last_peered":"2024-09-11T23:22:31.800660+0000","last_clean":"2024-09-11T23:22:31.800660+0000","last_became_active":"2024-09-11T23:22:29.785767+0000","last_became_peered":"2024-09-11T23:22:29.785767+0000","last_unstale":"2024-09-11T23:22:31.800660+0000","last_undegraded":"2024-09-11T23:22:31.800660+0000","last_fullsized":"2024-09-11T23:22:31.800660+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:23.886099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.802190+0000","last_change":"2024-09-11T23:22:30.803492+0000","last_active":"2024-09-11T23:22:31.802190+0000","last_peered":"2024-09-11T23:22:31.802190+0000","last_clean":"2024-09-11T23:22:31.802190+0000","last_became_active":"2024-09-11T23:22:30.803224+0000","last_became_peered":"2024-09-11T23:22:30.803224+0000","last_unstale":"2024-09-11T23:22:31.802190+0000","last_undegraded":"2024-09-11T23:22:31.802190+0000","last_fullsized":"2024-09-11T23:22:31.802190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:02.707433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"82'8","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.798872+0000","last_change":"2024-09-11T23:22:29.795359+0000","last_active":"2024-09-11T23:22:31.798872+0000","last_peered":"2024-09-11T23:22:31.798872+0000","last_clean":"2024-09-11T23:22:31.798872+0000","last_became_active":"2024-09-11T23:22:29.794120+0000","last_became_peered":"2024-09-11T23:22:29.794120+0000","last_unstale":"2024-09-11T23:22:31.798872+0000","last_undegraded":"2024-09-11T23:22:31.798872+0000","last_fullsized":"2024-09-11T23:22:31.798872+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:12.918605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720802+0000","last_change":"2024-09-11T23:22:30.803127+0000","last_active":"2024-09-11T23:22:32.720802+0000","last_peered":"2024-09-11T23:22:32.720802+0000","last_clean":"2024-09-11T23:22:32.720802+0000","last_became_active":"2024-09-11T23:22:30.801944+0000","last_became_peered":"2024-09-11T23:22:30.801944+0000","last_unstale":"2024-09-11T23:22:32.720802+0000","last_undegraded":"2024-09-11T23:22:32.720802+0000","last_fullsized":"2024-09-11T23:22:32.720802+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:29.080935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.721238+0000","last_change":"2024-09-11T23:22:29.795929+0000","last_active":"2024-09-11T23:22:32.721238+0000","last_peered":"2024-09-11T23:22:32.721238+0000","last_clean":"2024-09-11T23:22:32.721238+0000","last_became_active":"2024-09-11T23:22:29.795634+0000","last_became_peered":"2024-09-11T23:22:29.795634+0000","last_unstale":"2024-09-11T23:22:32.721238+0000","last_undegraded":"2024-09-11T23:22:32.721238+0000","last_fullsized":"2024-09-11T23:22:32.721238+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:22.544729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.721017+0000","last_change":"2024-09-11T23:22:30.807539+0000","last_active":"2024-09-11T23:22:32.721017+0000","last_peered":"2024-09-11T23:22:32.721017+0000","last_clean":"2024-09-11T23:22:32.721017+0000","last_became_active":"2024-09-11T23:22:30.805266+0000","last_became_peered":"2024-09-11T23:22:30.805266+0000","last_unstale":"2024-09-11T23:22:32.721017+0000","last_undegraded":"2024-09-11T23:22:32.721017+0000","last_fullsized":"2024-09-11T23:22:32.721017+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:32.725380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.799343+0000","last_change":"2024-09-11T23:22:29.793636+0000","last_active":"2024-09-11T23:22:31.799343+0000","last_peered":"2024-09-11T23:22:31.799343+0000","last_clean":"2024-09-11T23:22:31.799343+0000","last_became_active":"2024-09-11T23:22:29.793346+0000","last_became_peered":"2024-09-11T23:22:29.793346+0000","last_unstale":"2024-09-11T23:22:31.799343+0000","last_undegraded":"2024-09-11T23:22:31.799343+0000","last_fullsized":"2024-09-11T23:22:31.799343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:31.717572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800724+0000","last_change":"2024-09-11T23:22:30.798160+0000","last_active":"2024-09-11T23:22:31.800724+0000","last_peered":"2024-09-11T23:22:31.800724+0000","last_clean":"2024-09-11T23:22:31.800724+0000","last_became_active":"2024-09-11T23:22:30.797869+0000","last_became_peered":"2024-09-11T23:22:30.797869+0000","last_unstale":"2024-09-11T23:22:31.800724+0000","last_undegraded":"2024-09-11T23:22:31.800724+0000","last_fullsized":"2024-09-11T23:22:31.800724+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:24.893908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800288+0000","last_change":"2024-09-11T23:22:29.795529+0000","last_active":"2024-09-11T23:22:31.800288+0000","last_peered":"2024-09-11T23:22:31.800288+0000","last_clean":"2024-09-11T23:22:31.800288+0000","last_became_active":"2024-09-11T23:22:29.794606+0000","last_became_peered":"2024-09-11T23:22:29.794606+0000","last_unstale":"2024-09-11T23:22:31.800288+0000","last_undegraded":"2024-09-11T23:22:31.800288+0000","last_fullsized":"2024-09-11T23:22:31.800288+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:41.584250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720850+0000","last_change":"2024-09-11T23:22:30.807103+0000","last_active":"2024-09-11T23:22:32.720850+0000","last_peered":"2024-09-11T23:22:32.720850+0000","last_clean":"2024-09-11T23:22:32.720850+0000","last_became_active":"2024-09-11T23:22:30.806810+0000","last_became_peered":"2024-09-11T23:22:30.806810+0000","last_unstale":"2024-09-11T23:22:32.720850+0000","last_undegraded":"2024-09-11T23:22:32.720850+0000","last_fullsized":"2024-09-11T23:22:32.720850+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:46.695842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.799378+0000","last_change":"2024-09-11T23:22:29.801734+0000","last_active":"2024-09-11T23:22:31.799378+0000","last_peered":"2024-09-11T23:22:31.799378+0000","last_clean":"2024-09-11T23:22:31.799378+0000","last_became_active":"2024-09-11T23:22:29.800988+0000","last_became_peered":"2024-09-11T23:22:29.800988+0000","last_unstale":"2024-09-11T23:22:31.799378+0000","last_undegraded":"2024-09-11T23:22:31.799378+0000","last_fullsized":"2024-09-11T23:22:31.799378+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:44.484916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800127+0000","last_change":"2024-09-11T23:22:30.788477+0000","last_active":"2024-09-11T23:22:31.800127+0000","last_peered":"2024-09-11T23:22:31.800127+0000","last_clean":"2024-09-11T23:22:31.800127+0000","last_became_active":"2024-09-11T23:22:30.788165+0000","last_became_peered":"2024-09-11T23:22:30.788165+0000","last_unstale":"2024-09-11T23:22:31.800127+0000","last_undegraded":"2024-09-11T23:22:31.800127+0000","last_fullsized":"2024-09-11T23:22:31.800127+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:42.592058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720907+0000","last_change":"2024-09-11T23:22:29.790559+0000","last_active":"2024-09-11T23:22:32.720907+0000","last_peered":"2024-09-11T23:22:32.720907+0000","last_clean":"2024-09-11T23:22:32.720907+0000","last_became_active":"2024-09-11T23:22:29.790290+0000","last_became_peered":"2024-09-11T23:22:29.790290+0000","last_unstale":"2024-09-11T23:22:32.720907+0000","last_undegraded":"2024-09-11T23:22:32.720907+0000","last_fullsized":"2024-09-11T23:22:32.720907+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:22.434768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720513+0000","last_change":"2024-09-11T23:22:30.797534+0000","last_active":"2024-09-11T23:22:32.720513+0000","last_peered":"2024-09-11T23:22:32.720513+0000","last_clean":"2024-09-11T23:22:32.720513+0000","last_became_active":"2024-09-11T23:22:30.797179+0000","last_became_peered":"2024-09-11T23:22:30.797179+0000","last_unstale":"2024-09-11T23:22:32.720513+0000","last_undegraded":"2024-09-11T23:22:32.720513+0000","last_fullsized":"2024-09-11T23:22:32.720513+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:10.571940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720291+0000","last_change":"2024-09-11T23:22:29.797708+0000","last_active":"2024-09-11T23:22:32.720291+0000","last_peered":"2024-09-11T23:22:32.720291+0000","last_clean":"2024-09-11T23:22:32.720291+0000","last_became_active":"2024-09-11T23:22:29.796870+0000","last_became_peered":"2024-09-11T23:22:29.796870+0000","last_unstale":"2024-09-11T23:22:32.720291+0000","last_undegraded":"2024-09-11T23:22:32.720291+0000","last_fullsized":"2024-09-11T23:22:32.720291+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:42.593785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800558+0000","last_change":"2024-09-11T23:22:30.797223+0000","last_active":"2024-09-11T23:22:31.800558+0000","last_peered":"2024-09-11T23:22:31.800558+0000","last_clean":"2024-09-11T23:22:31.800558+0000","last_became_active":"2024-09-11T23:22:30.796457+0000","last_became_peered":"2024-09-11T23:22:30.796457+0000","last_unstale":"2024-09-11T23:22:31.800558+0000","last_undegraded":"2024-09-11T23:22:31.800558+0000","last_fullsized":"2024-09-11T23:22:31.800558+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:42.552597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.798691+0000","last_change":"2024-09-11T23:22:29.803838+0000","last_active":"2024-09-11T23:22:31.798691+0000","last_peered":"2024-09-11T23:22:31.798691+0000","last_clean":"2024-09-11T23:22:31.798691+0000","last_became_active":"2024-09-11T23:22:29.803457+0000","last_became_peered":"2024-09-11T23:22:29.803457+0000","last_unstale":"2024-09-11T23:22:31.798691+0000","last_undegraded":"2024-09-11T23:22:31.798691+0000","last_fullsized":"2024-09-11T23:22:31.798691+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:50.191817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.801359+0000","last_change":"2024-09-11T23:22:30.788645+0000","last_active":"2024-09-11T23:22:31.801359+0000","last_peered":"2024-09-11T23:22:31.801359+0000","last_clean":"2024-09-11T23:22:31.801359+0000","last_became_active":"2024-09-11T23:22:30.788376+0000","last_became_peered":"2024-09-11T23:22:30.788376+0000","last_unstale":"2024-09-11T23:22:31.801359+0000","last_undegraded":"2024-09-11T23:22:31.801359+0000","last_fullsized":"2024-09-11T23:22:31.801359+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:13.926414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"82'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.802574+0000","last_change":"2024-09-11T23:22:29.796232+0000","last_active":"2024-09-11T23:22:31.802574+0000","last_peered":"2024-09-11T23:22:31.802574+0000","last_clean":"2024-09-11T23:22:31.802574+0000","last_became_active":"2024-09-11T23:22:29.795936+0000","last_became_peered":"2024-09-11T23:22:29.795936+0000","last_unstale":"2024-09-11T23:22:31.802574+0000","last_undegraded":"2024-09-11T23:22:31.802574+0000","last_fullsized":"2024-09-11T23:22:31.802574+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:39:00.496690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720741+0000","last_change":"2024-09-11T23:22:30.809671+0000","last_active":"2024-09-11T23:22:32.720741+0000","last_peered":"2024-09-11T23:22:32.720741+0000","last_clean":"2024-09-11T23:22:32.720741+0000","last_became_active":"2024-09-11T23:22:30.808968+0000","last_became_peered":"2024-09-11T23:22:30.808968+0000","last_unstale":"2024-09-11T23:22:32.720741+0000","last_undegraded":"2024-09-11T23:22:32.720741+0000","last_fullsized":"2024-09-11T23:22:32.720741+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:53.485856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"83'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.802598+0000","last_change":"2024-09-11T23:22:29.787519+0000","last_active":"2024-09-11T23:22:31.802598+0000","last_peered":"2024-09-11T23:22:31.802598+0000","last_clean":"2024-09-11T23:22:31.802598+0000","last_became_active":"2024-09-11T23:22:29.787222+0000","last_became_peered":"2024-09-11T23:22:29.787222+0000","last_unstale":"2024-09-11T23:22:31.802598+0000","last_undegraded":"2024-09-11T23:22:31.802598+0000","last_fullsized":"2024-09-11T23:22:31.802598+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:18.720260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.721102+0000","last_change":"2024-09-11T23:22:30.798389+0000","last_active":"2024-09-11T23:22:32.721102+0000","last_peered":"2024-09-11T23:22:32.721102+0000","last_clean":"2024-09-11T23:22:32.721102+0000","last_became_active":"2024-09-11T23:22:30.798091+0000","last_became_peered":"2024-09-11T23:22:30.798091+0000","last_unstale":"2024-09-11T23:22:32.721102+0000","last_undegraded":"2024-09-11T23:22:32.721102+0000","last_fullsized":"2024-09-11T23:22:32.721102+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:56.533779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720586+0000","last_change":"2024-09-11T23:22:29.798913+0000","last_active":"2024-09-11T23:22:32.720586+0000","last_peered":"2024-09-11T23:22:32.720586+0000","last_clean":"2024-09-11T23:22:32.720586+0000","last_became_active":"2024-09-11T23:22:29.798524+0000","last_became_peered":"2024-09-11T23:22:29.798524+0000","last_unstale":"2024-09-11T23:22:32.720586+0000","last_undegraded":"2024-09-11T23:22:32.720586+0000","last_fullsized":"2024-09-11T23:22:32.720586+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:01.699624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800864+0000","last_change":"2024-09-11T23:22:30.800166+0000","last_active":"2024-09-11T23:22:31.800864+0000","last_peered":"2024-09-11T23:22:31.800864+0000","last_clean":"2024-09-11T23:22:31.800864+0000","last_became_active":"2024-09-11T23:22:30.799574+0000","last_became_peered":"2024-09-11T23:22:30.799574+0000","last_unstale":"2024-09-11T23:22:31.800864+0000","last_undegraded":"2024-09-11T23:22:31.800864+0000","last_fullsized":"2024-09-11T23:22:31.800864+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:46.754267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.721090+0000","last_change":"2024-09-11T23:22:29.795594+0000","last_active":"2024-09-11T23:22:32.721090+0000","last_peered":"2024-09-11T23:22:32.721090+0000","last_clean":"2024-09-11T23:22:32.721090+0000","last_became_active":"2024-09-11T23:22:29.795192+0000","last_became_peered":"2024-09-11T23:22:29.795192+0000","last_unstale":"2024-09-11T23:22:32.721090+0000","last_undegraded":"2024-09-11T23:22:32.721090+0000","last_fullsized":"2024-09-11T23:22:32.721090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:38.770816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800618+0000","last_change":"2024-09-11T23:22:30.789748+0000","last_active":"2024-09-11T23:22:31.800618+0000","last_peered":"2024-09-11T23:22:31.800618+0000","last_clean":"2024-09-11T23:22:31.800618+0000","last_became_active":"2024-09-11T23:22:30.789472+0000","last_became_peered":"2024-09-11T23:22:30.789472+0000","last_unstale":"2024-09-11T23:22:31.800618+0000","last_undegraded":"2024-09-11T23:22:31.800618+0000","last_fullsized":"2024-09-11T23:22:31.800618+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:32.725380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.799559+0000","last_change":"2024-09-11T23:22:29.795182+0000","last_active":"2024-09-11T23:22:31.799559+0000","last_peered":"2024-09-11T23:22:31.799559+0000","last_clean":"2024-09-11T23:22:31.799559+0000","last_became_active":"2024-09-11T23:22:29.794863+0000","last_became_peered":"2024-09-11T23:22:29.794863+0000","last_unstale":"2024-09-11T23:22:31.799559+0000","last_undegraded":"2024-09-11T23:22:31.799559+0000","last_fullsized":"2024-09-11T23:22:31.799559+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:18.016795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.799444+0000","last_change":"2024-09-11T23:22:30.799848+0000","last_active":"2024-09-11T23:22:31.799444+0000","last_peered":"2024-09-11T23:22:31.799444+0000","last_clean":"2024-09-11T23:22:31.799444+0000","last_became_active":"2024-09-11T23:22:30.796117+0000","last_became_peered":"2024-09-11T23:22:30.796117+0000","last_unstale":"2024-09-11T23:22:31.799444+0000","last_undegraded":"2024-09-11T23:22:31.799444+0000","last_fullsized":"2024-09-11T23:22:31.799444+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:01.490782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.800172+0000","last_change":"2024-09-11T23:22:29.793776+0000","last_active":"2024-09-11T23:22:31.800172+0000","last_peered":"2024-09-11T23:22:31.800172+0000","last_clean":"2024-09-11T23:22:31.800172+0000","last_became_active":"2024-09-11T23:22:29.793426+0000","last_became_peered":"2024-09-11T23:22:29.793426+0000","last_unstale":"2024-09-11T23:22:31.800172+0000","last_undegraded":"2024-09-11T23:22:31.800172+0000","last_fullsized":"2024-09-11T23:22:31.800172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:33.581201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720058+0000","last_change":"2024-09-11T23:22:30.806704+0000","last_active":"2024-09-11T23:22:32.720058+0000","last_peered":"2024-09-11T23:22:32.720058+0000","last_clean":"2024-09-11T23:22:32.720058+0000","last_became_active":"2024-09-11T23:22:30.806425+0000","last_became_peered":"2024-09-11T23:22:30.806425+0000","last_unstale":"2024-09-11T23:22:32.720058+0000","last_undegraded":"2024-09-11T23:22:32.720058+0000","last_fullsized":"2024-09-11T23:22:32.720058+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:45.105915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720326+0000","last_change":"2024-09-11T23:22:29.800003+0000","last_active":"2024-09-11T23:22:32.720326+0000","last_peered":"2024-09-11T23:22:32.720326+0000","last_clean":"2024-09-11T23:22:32.720326+0000","last_became_active":"2024-09-11T23:22:29.799292+0000","last_became_peered":"2024-09-11T23:22:29.799292+0000","last_unstale":"2024-09-11T23:22:32.720326+0000","last_undegraded":"2024-09-11T23:22:32.720326+0000","last_fullsized":"2024-09-11T23:22:32.720326+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:17.074928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720218+0000","last_change":"2024-09-11T23:22:30.795178+0000","last_active":"2024-09-11T23:22:32.720218+0000","last_peered":"2024-09-11T23:22:32.720218+0000","last_clean":"2024-09-11T23:22:32.720218+0000","last_became_active":"2024-09-11T23:22:30.793984+0000","last_became_peered":"2024-09-11T23:22:30.793984+0000","last_unstale":"2024-09-11T23:22:32.720218+0000","last_undegraded":"2024-09-11T23:22:32.720218+0000","last_fullsized":"2024-09-11T23:22:32.720218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:13.926414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.799802+0000","last_change":"2024-09-11T23:22:29.794909+0000","last_active":"2024-09-11T23:22:31.799802+0000","last_peered":"2024-09-11T23:22:31.799802+0000","last_clean":"2024-09-11T23:22:31.799802+0000","last_became_active":"2024-09-11T23:22:29.794633+0000","last_became_peered":"2024-09-11T23:22:29.794633+0000","last_unstale":"2024-09-11T23:22:31.799802+0000","last_undegraded":"2024-09-11T23:22:31.799802+0000","last_fullsized":"2024-09-11T23:22:31.799802+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:42.739297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:31.802421+0000","last_change":"2024-09-11T23:22:30.786485+0000","last_active":"2024-09-11T23:22:31.802421+0000","last_peered":"2024-09-11T23:22:31.802421+0000","last_clean":"2024-09-11T23:22:31.802421+0000","last_became_active":"2024-09-11T23:22:30.785678+0000","last_became_peered":"2024-09-11T23:22:30.785678+0000","last_unstale":"2024-09-11T23:22:31.802421+0000","last_undegraded":"2024-09-11T23:22:31.802421+0000","last_fullsized":"2024-09-11T23:22:31.802421+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:29.765943+0000","last_clean_scrub_stamp":"2024-09-11T23:22:29.765943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:38.922111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720863+0000","last_change":"2024-09-11T23:22:29.794603+0000","last_active":"2024-09-11T23:22:32.720863+0000","last_peered":"2024-09-11T23:22:32.720863+0000","last_clean":"2024-09-11T23:22:32.720863+0000","last_became_active":"2024-09-11T23:22:29.794225+0000","last_became_peered":"2024-09-11T23:22:29.794225+0000","last_unstale":"2024-09-11T23:22:32.720863+0000","last_undegraded":"2024-09-11T23:22:32.720863+0000","last_fullsized":"2024-09-11T23:22:32.720863+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:22:28.758134+0000","last_clean_scrub_stamp":"2024-09-11T23:22:28.758134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:04.126648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":324,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-11T23:22:32.720105+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:22:32.720105+0000","last_peered":"2024-09-11T23:22:32.720105+0000","last_clean":"2024-09-11T23:22:32.720105+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:22:32.720105+0000","last_undegraded":"2024-09-11T23:22:32.720105+0000","last_fullsized":"2024-09-11T23:22:32.720105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476798,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32756,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339084,"statfs":{"total":96636764160,"available":96603222016,"internally_reserved":0,"allocated":1605632,"data_stored":1021259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476797,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1019904,"data_stored":431515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476796,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1024000,"data_stored":432455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476796,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1007616,"data_stored":430821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542205,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1019904,"data_stored":432433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542205,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1011712,"data_stored":431403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509501,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1019904,"data_stored":431015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509501,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32760,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339080,"statfs":{"total":96636764160,"available":96603217920,"internally_reserved":0,"allocated":1605632,"data_stored":1021223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:22:39.995 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:22:39.996 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:22:40.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.195+0000 7fa456a00640 1 Processor -- start 2024-09-11T23:22:40.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.195+0000 7fa456a00640 1 -- start start 2024-09-11T23:22:40.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.196+0000 7fa456a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4500b2570 0x7fa450166e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:40.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.196+0000 7fa456a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa450072870 con 0x7fa45015c030 2024-09-11T23:22:40.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.196+0000 7fa456a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa450072b50 con 0x7fa45015c410 2024-09-11T23:22:40.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.196+0000 7fa456a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa450072e30 con 0x7fa4500b2570 2024-09-11T23:22:40.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.197+0000 7fa456000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4500b2570 0x7fa450166e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:40.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.197+0000 7fa455600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa45015c030 0x7fa450071f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49548/0 (socket says 172.21.15.144:49548) 2024-09-11T23:22:40.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.197+0000 7fa455600640 1 -- 172.21.15.144:0/815845061 learned_addr learned my addr 172.21.15.144:0/815845061 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:40.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.197+0000 7fa44fe00640 1 -- 172.21.15.144:0/815845061 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 10444855 0 0) 0x7fa450072870 con 0x7fa45015c030 2024-09-11T23:22:40.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.197+0000 7fa456000640 1 -- 172.21.15.144:0/815845061 >> v1:172.21.15.165:6789/0 conn(0x7fa45015c410 legacy=0x7fa4500b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:40.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.197+0000 7fa456000640 1 -- 172.21.15.144:0/815845061 >> v1:172.21.15.144:6789/0 conn(0x7fa45015c030 legacy=0x7fa450071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:40.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.197+0000 7fa456000640 1 -- 172.21.15.144:0/815845061 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa450073110 con 0x7fa4500b2570 2024-09-11T23:22:40.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.198+0000 7fa456000640 1 --2- 172.21.15.144:0/815845061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4500b2570 0x7fa450166e30 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa448009dc0 tx=0x7fa44802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0d325f1c993599 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:40.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.198+0000 7fa44fe00640 1 -- 172.21.15.144:0/815845061 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448007740 con 0x7fa4500b2570 2024-09-11T23:22:40.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.198+0000 7fa44fe00640 1 -- 172.21.15.144:0/815845061 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4480078e0 con 0x7fa4500b2570 2024-09-11T23:22:40.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.198+0000 7fa44fe00640 1 -- 172.21.15.144:0/815845061 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448007cb0 con 0x7fa4500b2570 2024-09-11T23:22:40.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.199+0000 7fa456a00640 1 -- 172.21.15.144:0/815845061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4500b2570 msgr2=0x7fa450166e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:40.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.199+0000 7fa456a00640 1 --2- 172.21.15.144:0/815845061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4500b2570 0x7fa450166e30 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa448009dc0 tx=0x7fa44802a6a0 comp rx=0 tx=0).stop 2024-09-11T23:22:40.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.199+0000 7fa456a00640 1 -- 172.21.15.144:0/815845061 shutdown_connections 2024-09-11T23:22:40.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.199+0000 7fa456a00640 1 --2- 172.21.15.144:0/815845061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4500b2570 0x7fa450166e30 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:40.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.199+0000 7fa456a00640 1 -- 172.21.15.144:0/815845061 >> 172.21.15.144:0/815845061 conn(0x7fa45006bba0 msgr2=0x7fa45006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:40.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.199+0000 7fa456a00640 1 -- 172.21.15.144:0/815845061 shutdown_connections 2024-09-11T23:22:40.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.199+0000 7fa456a00640 1 -- 172.21.15.144:0/815845061 wait complete. 2024-09-11T23:22:40.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.200+0000 7fa456a00640 1 Processor -- start 2024-09-11T23:22:40.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.201+0000 7fa456a00640 1 -- start start 2024-09-11T23:22:40.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.201+0000 7fa456a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4500b2570 0x7fa45014bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:40.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.201+0000 7fa456a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa45015c030 0x7fa4500b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:40.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.202+0000 7fa456a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa45015c410 0x7fa4500b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:40.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.202+0000 7fa456a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4500ce280 con 0x7fa45015c030 2024-09-11T23:22:40.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.202+0000 7fa456a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa4500ce100 con 0x7fa45015c410 2024-09-11T23:22:40.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.202+0000 7fa456a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa4500ce400 con 0x7fa4500b2570 2024-09-11T23:22:40.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.202+0000 7fa454c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa45015c030 0x7fa4500b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:40.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.202+0000 7fa454c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa45015c030 0x7fa4500b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59194/0 (socket says 172.21.15.144:59194) 2024-09-11T23:22:40.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.202+0000 7fa454c00640 1 -- 172.21.15.144:0/3806555312 learned_addr learned my addr 172.21.15.144:0/3806555312 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:40.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.202+0000 7fa454c00640 1 -- 172.21.15.144:0/3806555312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4500b2570 msgr2=0x7fa45014bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:40.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.202+0000 7fa454c00640 1 --2- 172.21.15.144:0/3806555312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4500b2570 0x7fa45014bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:40.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.202+0000 7fa454c00640 1 -- 172.21.15.144:0/3806555312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa45015c410 msgr2=0x7fa4500b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:40.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.202+0000 7fa454c00640 1 --2- 172.21.15.144:0/3806555312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa45015c410 0x7fa4500b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:40.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.202+0000 7fa454c00640 1 -- 172.21.15.144:0/3806555312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4501e5cb0 con 0x7fa45015c030 2024-09-11T23:22:40.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.202+0000 7fa454c00640 1 --2- 172.21.15.144:0/3806555312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa45015c030 0x7fa4500b33b0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00c400 tx=0x7fa43c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:40.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.203+0000 7fa44d600640 1 -- 172.21.15.144:0/3806555312 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c017070 con 0x7fa45015c030 2024-09-11T23:22:40.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.203+0000 7fa44d600640 1 -- 172.21.15.144:0/3806555312 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa43c0052d0 con 0x7fa45015c030 2024-09-11T23:22:40.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.203+0000 7fa456a00640 1 -- 172.21.15.144:0/3806555312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4501e4c10 con 0x7fa45015c030 2024-09-11T23:22:40.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.203+0000 7fa44d600640 1 -- 172.21.15.144:0/3806555312 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c003830 con 0x7fa45015c030 2024-09-11T23:22:40.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.203+0000 7fa456a00640 1 -- 172.21.15.144:0/3806555312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4501e51d0 con 0x7fa45015c030 2024-09-11T23:22:40.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.204+0000 7fa456a00640 1 -- 172.21.15.144:0/3806555312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4500b2c60 con 0x7fa45015c030 2024-09-11T23:22:40.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.205+0000 7fa44d600640 1 -- 172.21.15.144:0/3806555312 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fa43c01a070 con 0x7fa45015c030 2024-09-11T23:22:40.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.205+0000 7fa44d600640 1 --2- 172.21.15.144:0/3806555312 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa43006bf80 0x7fa43006e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:40.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.206+0000 7fa44d600640 1 -- 172.21.15.144:0/3806555312 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fa43c08a3c0 con 0x7fa45015c030 2024-09-11T23:22:40.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.206+0000 7fa455600640 1 --2- 172.21.15.144:0/3806555312 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa43006bf80 0x7fa43006e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:40.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.207+0000 7fa455600640 1 --2- 172.21.15.144:0/3806555312 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa43006bf80 0x7fa43006e440 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa444007fd0 tx=0x7fa444007900 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:40.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.210+0000 7fa44d600640 1 -- 172.21.15.144:0/3806555312 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa43c058c50 con 0x7fa45015c030 2024-09-11T23:22:40.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.449+0000 7fa456a00640 1 -- 172.21.15.144:0/3806555312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa450073a20 con 0x7fa45015c030 2024-09-11T23:22:40.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.452+0000 7fa44d600640 1 -- 172.21.15.144:0/3806555312 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7fa43c08a1c0 con 0x7fa45015c030 2024-09-11T23:22:40.452 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-11T23:22:40.452 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A== 2024-09-11T23:22:40.452 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-11T23:22:40.452 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-11T23:22:40.452 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:22:40.452 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-11T23:22:40.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.454+0000 7fa456a00640 1 -- 172.21.15.144:0/3806555312 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa43006bf80 msgr2=0x7fa43006e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:40.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.455+0000 7fa456a00640 1 --2- 172.21.15.144:0/3806555312 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa43006bf80 0x7fa43006e440 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa444007fd0 tx=0x7fa444007900 comp rx=0 tx=0).stop 2024-09-11T23:22:40.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.455+0000 7fa456a00640 1 -- 172.21.15.144:0/3806555312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa45015c030 msgr2=0x7fa4500b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:40.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.455+0000 7fa456a00640 1 --2- 172.21.15.144:0/3806555312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa45015c030 0x7fa4500b33b0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00c400 tx=0x7fa43c00c8c0 comp rx=0 tx=0).stop 2024-09-11T23:22:40.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.455+0000 7fa456a00640 1 -- 172.21.15.144:0/3806555312 shutdown_connections 2024-09-11T23:22:40.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.455+0000 7fa456a00640 1 --2- 172.21.15.144:0/3806555312 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa43006bf80 0x7fa43006e440 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:40.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.455+0000 7fa456a00640 1 --2- 172.21.15.144:0/3806555312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa45015c410 0x7fa4500b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:40.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.455+0000 7fa456a00640 1 --2- 172.21.15.144:0/3806555312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa45015c030 0x7fa4500b33b0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:40.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.455+0000 7fa456a00640 1 --2- 172.21.15.144:0/3806555312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4500b2570 0x7fa45014bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:40.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.455+0000 7fa456a00640 1 -- 172.21.15.144:0/3806555312 >> 172.21.15.144:0/3806555312 conn(0x7fa45006bba0 msgr2=0x7fa4500ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:40.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.455+0000 7fa456a00640 1 -- 172.21.15.144:0/3806555312 shutdown_connections 2024-09-11T23:22:40.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.455+0000 7fa456a00640 1 -- 172.21.15.144:0/3806555312 wait complete. 2024-09-11T23:22:40.471 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:22:40.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.623+0000 7f7158000640 1 Processor -- start 2024-09-11T23:22:40.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.623+0000 7f7158000640 1 -- start start 2024-09-11T23:22:40.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.624+0000 7f7158000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f715015ca40 0x7f715015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:40.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.624+0000 7f7158000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f715015ce80 0x7f71501594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:40.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.624+0000 7f7158000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715015d390 con 0x7f71500d02a0 2024-09-11T23:22:40.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.624+0000 7f7158000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f715015d670 con 0x7f715015ce80 2024-09-11T23:22:40.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.624+0000 7f7158000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f715015d950 con 0x7f715015ca40 2024-09-11T23:22:40.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.625+0000 7f7154c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f715015ca40 0x7f715015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:40.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.625+0000 7f7156000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f715015ce80 0x7f71501594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:40.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.625+0000 7f7154c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f715015ca40 0x7f715015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:49626/0 (socket says 172.21.15.144:49626) 2024-09-11T23:22:40.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.625+0000 7f7154c00640 1 -- 172.21.15.144:0/3400943333 learned_addr learned my addr 172.21.15.144:0/3400943333 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:40.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.625+0000 7f7155600640 1 --1- 172.21.15.144:0/3400943333 >> v1:172.21.15.165:6789/0 conn(0x7f71500d02a0 0x7f71500d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:59054/0 (socket says 172.21.15.144:59054) 2024-09-11T23:22:40.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.625+0000 7f7156000640 1 -- 172.21.15.144:0/3400943333 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f715015ca40 msgr2=0x7f715015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:40.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.625+0000 7f7156000640 1 --2- 172.21.15.144:0/3400943333 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f715015ca40 0x7f715015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:40.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.625+0000 7f7156000640 1 -- 172.21.15.144:0/3400943333 >> v1:172.21.15.165:6789/0 conn(0x7f71500d02a0 legacy=0x7f71500d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:40.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.625+0000 7f7156000640 1 -- 172.21.15.144:0/3400943333 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715015dc30 con 0x7f715015ce80 2024-09-11T23:22:40.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.626+0000 7f7156000640 1 --2- 172.21.15.144:0/3400943333 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f715015ce80 0x7f71501594c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7148009d90 tx=0x7f714802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edec703a43c9e4f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:40.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.627+0000 7f714fe00640 1 -- 172.21.15.144:0/3400943333 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148031600 con 0x7f715015ce80 2024-09-11T23:22:40.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.627+0000 7f714fe00640 1 -- 172.21.15.144:0/3400943333 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71480317a0 con 0x7f715015ce80 2024-09-11T23:22:40.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.627+0000 7f714fe00640 1 -- 172.21.15.144:0/3400943333 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148031b70 con 0x7f715015ce80 2024-09-11T23:22:40.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.627+0000 7f7158000640 1 -- 172.21.15.144:0/3400943333 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f715015ce80 msgr2=0x7f71501594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:40.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.627+0000 7f7158000640 1 --2- 172.21.15.144:0/3400943333 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f715015ce80 0x7f71501594c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7148009d90 tx=0x7f714802a5d0 comp rx=0 tx=0).stop 2024-09-11T23:22:40.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.627+0000 7f7158000640 1 -- 172.21.15.144:0/3400943333 shutdown_connections 2024-09-11T23:22:40.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.627+0000 7f7158000640 1 --2- 172.21.15.144:0/3400943333 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f715015ce80 0x7f71501594c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:40.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.627+0000 7f7158000640 1 --2- 172.21.15.144:0/3400943333 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f715015ca40 0x7f715015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:40.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.627+0000 7f7158000640 1 -- 172.21.15.144:0/3400943333 >> 172.21.15.144:0/3400943333 conn(0x7f7150062cc0 msgr2=0x7f715006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:40.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.628+0000 7f7158000640 1 -- 172.21.15.144:0/3400943333 shutdown_connections 2024-09-11T23:22:40.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.628+0000 7f7158000640 1 -- 172.21.15.144:0/3400943333 wait complete. 2024-09-11T23:22:40.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.629+0000 7f7158000640 1 Processor -- start 2024-09-11T23:22:40.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.629+0000 7f7158000640 1 -- start start 2024-09-11T23:22:40.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.630+0000 7f7158000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71500d02a0 0x7f71500aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:40.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.630+0000 7f7158000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f715015ca40 0x7f715015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:40.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.630+0000 7f7158000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f715015ce80 0x7f7150145b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:40.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.630+0000 7f7158000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7150155d10 con 0x7f71500d02a0 2024-09-11T23:22:40.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.630+0000 7f7158000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7150155b90 con 0x7f715015ca40 2024-09-11T23:22:40.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.630+0000 7f7158000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f71500b4790 con 0x7f715015ce80 2024-09-11T23:22:40.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.630+0000 7f7155600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71500d02a0 0x7f71500aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:40.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.631+0000 7f7155600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71500d02a0 0x7f71500aeb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59208/0 (socket says 172.21.15.144:59208) 2024-09-11T23:22:40.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.631+0000 7f7155600640 1 -- 172.21.15.144:0/1212115690 learned_addr learned my addr 172.21.15.144:0/1212115690 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:40.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.631+0000 7f7154c00640 1 --2- 172.21.15.144:0/1212115690 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f715015ca40 0x7f715015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:40.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.631+0000 7f7156000640 1 --2- 172.21.15.144:0/1212115690 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f715015ce80 0x7f7150145b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:40.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.631+0000 7f7155600640 1 -- 172.21.15.144:0/1212115690 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f715015ce80 msgr2=0x7f7150145b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:40.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.631+0000 7f7155600640 1 --2- 172.21.15.144:0/1212115690 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f715015ce80 0x7f7150145b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:40.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.631+0000 7f7155600640 1 -- 172.21.15.144:0/1212115690 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f715015ca40 msgr2=0x7f715015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:40.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.631+0000 7f7155600640 1 --2- 172.21.15.144:0/1212115690 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f715015ca40 0x7f715015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:40.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.631+0000 7f7155600640 1 -- 172.21.15.144:0/1212115690 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71500b2440 con 0x7f71500d02a0 2024-09-11T23:22:40.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.631+0000 7f7155600640 1 --2- 172.21.15.144:0/1212115690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71500d02a0 0x7f71500aeb50 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f714400c3c0 tx=0x7f714400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:40.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.631+0000 7f714d600640 1 -- 172.21.15.144:0/1212115690 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71440074e0 con 0x7f71500d02a0 2024-09-11T23:22:40.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.631+0000 7f714d600640 1 -- 172.21.15.144:0/1212115690 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7144007680 con 0x7f71500d02a0 2024-09-11T23:22:40.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.632+0000 7f714d600640 1 -- 172.21.15.144:0/1212115690 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144004a00 con 0x7f71500d02a0 2024-09-11T23:22:40.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.632+0000 7f7158000640 1 -- 172.21.15.144:0/1212115690 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71500b2720 con 0x7f71500d02a0 2024-09-11T23:22:40.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.632+0000 7f7158000640 1 -- 172.21.15.144:0/1212115690 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71500b2ce0 con 0x7f71500d02a0 2024-09-11T23:22:40.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.633+0000 7f7158000640 1 -- 172.21.15.144:0/1212115690 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71500d0680 con 0x7f71500d02a0 2024-09-11T23:22:40.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.633+0000 7f714d600640 1 -- 172.21.15.144:0/1212115690 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f714401a020 con 0x7f71500d02a0 2024-09-11T23:22:40.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.634+0000 7f714d600640 1 --2- 172.21.15.144:0/1212115690 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f713006bf50 0x7f713006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:40.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.634+0000 7f714d600640 1 -- 172.21.15.144:0/1212115690 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f714408a610 con 0x7f71500d02a0 2024-09-11T23:22:40.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.635+0000 7f7154c00640 1 --2- 172.21.15.144:0/1212115690 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f713006bf50 0x7f713006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:40.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.636+0000 7f7154c00640 1 --2- 172.21.15.144:0/1212115690 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f713006bf50 0x7f713006e410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f715015b5d0 tx=0x7f713c009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:40.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.638+0000 7f714d600640 1 -- 172.21.15.144:0/1212115690 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7144058850 con 0x7f71500d02a0 2024-09-11T23:22:40.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.848+0000 7f7158000640 1 -- 172.21.15.144:0/1212115690 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71500cffa0 con 0x7f71500d02a0 2024-09-11T23:22:40.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.849+0000 7f714d600640 1 -- 172.21.15.144:0/1212115690 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5237 (secure 0 0 0) 0x7f714405cb50 con 0x7f71500d02a0 2024-09-11T23:22:40.849 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:40.849 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":56,"btime":"2024-09-11T23:22:33:800694+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/1166956695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1166956695},{"type":"v1","addr":"172.21.15.165:6834","nonce":1166956695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1078454545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1078454545},{"type":"v1","addr":"172.21.15.144:6834","nonce":1078454545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3966608439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3966608439},{"type":"v1","addr":"172.21.15.165:6835","nonce":3966608439}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:22:30.193961+0000","modified":"2024-09-11T23:22:33.209255+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6522":{"gid":6522,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1018187462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":1018187462},{"type":"v1","addr":"172.21.15.144:6835","nonce":1018187462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6522,"qdb_cluster":[6522]},"id":6}]} 2024-09-11T23:22:40.850 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 56 2024-09-11T23:22:40.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.851+0000 7f7158000640 1 -- 172.21.15.144:0/1212115690 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f713006bf50 msgr2=0x7f713006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:40.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.851+0000 7f7158000640 1 --2- 172.21.15.144:0/1212115690 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f713006bf50 0x7f713006e410 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f715015b5d0 tx=0x7f713c009240 comp rx=0 tx=0).stop 2024-09-11T23:22:40.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.851+0000 7f7158000640 1 -- 172.21.15.144:0/1212115690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71500d02a0 msgr2=0x7f71500aeb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:40.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.851+0000 7f7158000640 1 --2- 172.21.15.144:0/1212115690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71500d02a0 0x7f71500aeb50 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f714400c3c0 tx=0x7f714400c880 comp rx=0 tx=0).stop 2024-09-11T23:22:40.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.851+0000 7f7158000640 1 -- 172.21.15.144:0/1212115690 shutdown_connections 2024-09-11T23:22:40.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.851+0000 7f7158000640 1 --2- 172.21.15.144:0/1212115690 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f713006bf50 0x7f713006e410 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:40.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.851+0000 7f7158000640 1 --2- 172.21.15.144:0/1212115690 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f715015ce80 0x7f7150145b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:40.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.851+0000 7f7158000640 1 --2- 172.21.15.144:0/1212115690 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f715015ca40 0x7f715015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:40.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.851+0000 7f7158000640 1 --2- 172.21.15.144:0/1212115690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71500d02a0 0x7f71500aeb50 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:40.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.851+0000 7f7158000640 1 -- 172.21.15.144:0/1212115690 >> 172.21.15.144:0/1212115690 conn(0x7f7150062cc0 msgr2=0x7f71500cccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:40.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.851+0000 7f7158000640 1 -- 172.21.15.144:0/1212115690 shutdown_connections 2024-09-11T23:22:40.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:40.851+0000 7f7158000640 1 -- 172.21.15.144:0/1212115690 wait complete. 2024-09-11T23:22:41.271 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:22:30.193961+0000', 'modified': '2024-09-11T23:22:33.209255+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6522}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6522': {'gid': 6522, 'name': 'a', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6835/1018187462', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6801', 'nonce': 1018187462}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 1018187462}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6522, 'qdb_cluster': [6522]} 2024-09-11T23:22:41.271 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:22:41.271 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T23:22:41.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.426+0000 7ff0a1c00640 1 Processor -- start 2024-09-11T23:22:41.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.426+0000 7ff0a1c00640 1 -- start start 2024-09-11T23:22:41.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.427+0000 7ff0a1c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff09c15c180 0x7ff09c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.427+0000 7ff0a1c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff09c0ce230 0x7ff09c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.428+0000 7ff0a1c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c0ce740 con 0x7ff09c0cf5b0 2024-09-11T23:22:41.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.428+0000 7ff0a1c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff09c072640 con 0x7ff09c15c180 2024-09-11T23:22:41.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.428+0000 7ff0a1c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff09c072920 con 0x7ff09c0ce230 2024-09-11T23:22:41.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.428+0000 7ff09b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff09c0cf5b0 0x7ff09c073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49564/0 (socket says 172.21.15.144:49564) 2024-09-11T23:22:41.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.428+0000 7ff09b400640 1 -- 172.21.15.144:0/2447947299 learned_addr learned my addr 172.21.15.144:0/2447947299 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.428+0000 7ff09a000640 1 --2- 172.21.15.144:0/2447947299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff09c0ce230 0x7ff09c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.428+0000 7ff09aa00640 1 --2- 172.21.15.144:0/2447947299 >> v2:172.21.15.165:3300/0 conn(0x7ff09c15c180 0x7ff09c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.428+0000 7ff099600640 1 -- 172.21.15.144:0/2447947299 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1162052350 0 0) 0x7ff09c0ce740 con 0x7ff09c0cf5b0 2024-09-11T23:22:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.428+0000 7ff099600640 1 -- 172.21.15.144:0/2447947299 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff080003520 con 0x7ff09c0cf5b0 2024-09-11T23:22:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.429+0000 7ff099600640 1 -- 172.21.15.144:0/2447947299 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 659617749 0 0) 0x7ff080003520 con 0x7ff09c0cf5b0 2024-09-11T23:22:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.429+0000 7ff09a000640 1 -- 172.21.15.144:0/2447947299 >> v2:172.21.15.165:3300/0 conn(0x7ff09c15c180 msgr2=0x7ff09c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.429+0000 7ff09a000640 1 --2- 172.21.15.144:0/2447947299 >> v2:172.21.15.165:3300/0 conn(0x7ff09c15c180 0x7ff09c0cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.429+0000 7ff09a000640 1 -- 172.21.15.144:0/2447947299 >> v1:172.21.15.144:6789/0 conn(0x7ff09c0cf5b0 legacy=0x7ff09c073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.429+0000 7ff09a000640 1 -- 172.21.15.144:0/2447947299 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c072c00 con 0x7ff09c0ce230 2024-09-11T23:22:41.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.429+0000 7ff09aa00640 1 --2- 172.21.15.144:0/2447947299 >> v2:172.21.15.165:3300/0 conn(0x7ff09c15c180 0x7ff09c0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:22:41.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.430+0000 7ff09a000640 1 --2- 172.21.15.144:0/2447947299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff09c0ce230 0x7ff09c0cf070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff0880097a0 tx=0x7ff08802a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c62078a9e324f936 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:41.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.430+0000 7ff099600640 1 -- 172.21.15.144:0/2447947299 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff088037070 con 0x7ff09c0ce230 2024-09-11T23:22:41.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.430+0000 7ff099600640 1 -- 172.21.15.144:0/2447947299 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08802ab10 con 0x7ff09c0ce230 2024-09-11T23:22:41.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.430+0000 7ff099600640 1 -- 172.21.15.144:0/2447947299 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff094001670 con 0x7ff09c0ce230 2024-09-11T23:22:41.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.430+0000 7ff0a1c00640 1 -- 172.21.15.144:0/2447947299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff09c0ce230 msgr2=0x7ff09c0cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:41.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.430+0000 7ff0a1c00640 1 --2- 172.21.15.144:0/2447947299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff09c0ce230 0x7ff09c0cf070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff0880097a0 tx=0x7ff08802a080 comp rx=0 tx=0).stop 2024-09-11T23:22:41.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.431+0000 7ff0a1c00640 1 -- 172.21.15.144:0/2447947299 shutdown_connections 2024-09-11T23:22:41.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.431+0000 7ff0a1c00640 1 --2- 172.21.15.144:0/2447947299 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff09c0ce230 0x7ff09c0cf070 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.431+0000 7ff0a1c00640 1 --2- 172.21.15.144:0/2447947299 >> v2:172.21.15.165:3300/0 conn(0x7ff09c15c180 0x7ff09c0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.431+0000 7ff0a1c00640 1 -- 172.21.15.144:0/2447947299 >> 172.21.15.144:0/2447947299 conn(0x7ff09c062cc0 msgr2=0x7ff09c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:41.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.431+0000 7ff0a1c00640 1 -- 172.21.15.144:0/2447947299 shutdown_connections 2024-09-11T23:22:41.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.431+0000 7ff0a1c00640 1 -- 172.21.15.144:0/2447947299 wait complete. 2024-09-11T23:22:41.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.432+0000 7ff0a1c00640 1 Processor -- start 2024-09-11T23:22:41.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.432+0000 7ff0a1c00640 1 -- start start 2024-09-11T23:22:41.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.433+0000 7ff0a1c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff09c0ce230 0x7ff09c156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.433+0000 7ff0a1c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff09c0cf5b0 0x7ff09c154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.433+0000 7ff0a1c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff09c15c180 0x7ff09c15e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.433+0000 7ff0a1c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c15c560 con 0x7ff09c0cf5b0 2024-09-11T23:22:41.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.433+0000 7ff0a1c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c0722f0 con 0x7ff09c15c180 2024-09-11T23:22:41.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.433+0000 7ff0a1c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff09c15c6e0 con 0x7ff09c0ce230 2024-09-11T23:22:41.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.433+0000 7ff09a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff09c0cf5b0 0x7ff09c154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.434+0000 7ff09a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff09c0cf5b0 0x7ff09c154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59218/0 (socket says 172.21.15.144:59218) 2024-09-11T23:22:41.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.434+0000 7ff09a000640 1 -- 172.21.15.144:0/45748102 learned_addr learned my addr 172.21.15.144:0/45748102 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:41.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.434+0000 7ff09aa00640 1 --2- 172.21.15.144:0/45748102 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff09c0ce230 0x7ff09c156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.434+0000 7ff09b400640 1 --2- 172.21.15.144:0/45748102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff09c15c180 0x7ff09c15e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.434+0000 7ff09a000640 1 -- 172.21.15.144:0/45748102 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff09c0ce230 msgr2=0x7ff09c156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:41.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.434+0000 7ff09a000640 1 --2- 172.21.15.144:0/45748102 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff09c0ce230 0x7ff09c156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.434+0000 7ff09a000640 1 -- 172.21.15.144:0/45748102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff09c15c180 msgr2=0x7ff09c15e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:41.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.434+0000 7ff09a000640 1 --2- 172.21.15.144:0/45748102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff09c15c180 0x7ff09c15e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.434+0000 7ff09a000640 1 -- 172.21.15.144:0/45748102 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c154ad0 con 0x7ff09c0cf5b0 2024-09-11T23:22:41.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.434+0000 7ff09a000640 1 --2- 172.21.15.144:0/45748102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff09c0cf5b0 0x7ff09c154270 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff088035040 tx=0x7ff0880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:41.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.434+0000 7ff092a00640 1 -- 172.21.15.144:0/45748102 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff088041020 con 0x7ff09c0cf5b0 2024-09-11T23:22:41.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.434+0000 7ff092a00640 1 -- 172.21.15.144:0/45748102 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08803d620 con 0x7ff09c0cf5b0 2024-09-11T23:22:41.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.435+0000 7ff092a00640 1 -- 172.21.15.144:0/45748102 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff088037040 con 0x7ff09c0cf5b0 2024-09-11T23:22:41.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.435+0000 7ff0a1c00640 1 -- 172.21.15.144:0/45748102 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff09c1574b0 con 0x7ff09c0cf5b0 2024-09-11T23:22:41.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.435+0000 7ff0a1c00640 1 -- 172.21.15.144:0/45748102 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff09c15d7b0 con 0x7ff09c0cf5b0 2024-09-11T23:22:41.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.437+0000 7ff092a00640 1 -- 172.21.15.144:0/45748102 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7ff088044020 con 0x7ff09c0cf5b0 2024-09-11T23:22:41.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.437+0000 7ff092a00640 1 --2- 172.21.15.144:0/45748102 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff07c06bf50 0x7ff07c06e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.438+0000 7ff092a00640 1 -- 172.21.15.144:0/45748102 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7ff0880ab390 con 0x7ff09c0cf5b0 2024-09-11T23:22:41.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.438+0000 7ff09aa00640 1 --2- 172.21.15.144:0/45748102 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff07c06bf50 0x7ff07c06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.438+0000 7ff0a4c7b740 1 Processor -- start 2024-09-11T23:22:41.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.438+0000 7ff0a4c7b740 1 -- start start 2024-09-11T23:22:41.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.439+0000 7ff09aa00640 1 --2- 172.21.15.144:0/45748102 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff07c06bf50 0x7ff07c06e410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff09c15a2c0 tx=0x7ff08c00b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:41.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.439+0000 7ff0a4c7b740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec43cf0 0x55ee6ec89490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.439+0000 7ff0a4c7b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec414b0 0x55ee6ec440d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.439+0000 7ff0a4c7b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ee6ec45480 0x55ee6ec3e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.439+0000 7ff0a4c7b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ee6eba23b0 con 0x55ee6ec414b0 2024-09-11T23:22:41.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.439+0000 7ff0a4c7b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ee6eba7410 con 0x55ee6ec45480 2024-09-11T23:22:41.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.439+0000 7ff0a4c7b740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ee6eb4f620 con 0x55ee6ec43cf0 2024-09-11T23:22:41.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.439+0000 7ff09a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec414b0 0x55ee6ec440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.439+0000 7ff09a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec414b0 0x55ee6ec440d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59234/0 (socket says 172.21.15.144:59234) 2024-09-11T23:22:41.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.440+0000 7ff09a000640 1 -- 172.21.15.144:0/982094111 learned_addr learned my addr 172.21.15.144:0/982094111 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:41.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.440+0000 7ff09aa00640 1 --2- 172.21.15.144:0/982094111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec43cf0 0x55ee6ec89490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.440+0000 7ff09b400640 1 --2- 172.21.15.144:0/982094111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ee6ec45480 0x55ee6ec3e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.440+0000 7ff09a000640 1 -- 172.21.15.144:0/982094111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec43cf0 msgr2=0x55ee6ec89490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:41.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.440+0000 7ff09a000640 1 --2- 172.21.15.144:0/982094111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec43cf0 0x55ee6ec89490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.440+0000 7ff09a000640 1 -- 172.21.15.144:0/982094111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ee6ec45480 msgr2=0x55ee6ec3e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:41.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.440+0000 7ff09a000640 1 --2- 172.21.15.144:0/982094111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ee6ec45480 0x55ee6ec3e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.440+0000 7ff09a000640 1 -- 172.21.15.144:0/982094111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee6e8ba2d0 con 0x55ee6ec414b0 2024-09-11T23:22:41.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.440+0000 7ff09a000640 1 --2- 172.21.15.144:0/982094111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec414b0 0x55ee6ec440d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7ff0880792d0 tx=0x7ff088078ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e15b0bf0bcc1b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:41.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.440+0000 7ff087400640 1 -- 172.21.15.144:0/982094111 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08807d8d0 con 0x55ee6ec414b0 2024-09-11T23:22:41.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.440+0000 7ff087400640 1 -- 172.21.15.144:0/982094111 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff088082100 con 0x55ee6ec414b0 2024-09-11T23:22:41.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.440+0000 7ff087400640 1 -- 172.21.15.144:0/982094111 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff088075c40 con 0x55ee6ec414b0 2024-09-11T23:22:41.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.441+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/982094111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec414b0 msgr2=0x55ee6ec440d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:41.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.441+0000 7ff0a4c7b740 1 --2- 172.21.15.144:0/982094111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec414b0 0x55ee6ec440d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7ff0880792d0 tx=0x7ff088078ff0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.441+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/982094111 shutdown_connections 2024-09-11T23:22:41.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.441+0000 7ff0a4c7b740 1 --2- 172.21.15.144:0/982094111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ee6ec45480 0x55ee6ec3e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.441+0000 7ff0a4c7b740 1 --2- 172.21.15.144:0/982094111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec414b0 0x55ee6ec440d0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.441+0000 7ff0a4c7b740 1 --2- 172.21.15.144:0/982094111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec43cf0 0x55ee6ec89490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.441+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/982094111 >> 172.21.15.144:0/982094111 conn(0x55ee6ec40740 msgr2=0x55ee6ec88960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:41.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.441+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/982094111 shutdown_connections 2024-09-11T23:22:41.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.441+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/982094111 wait complete. 2024-09-11T23:22:41.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.442+0000 7ff0a4c7b740 1 -- start start 2024-09-11T23:22:41.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.442+0000 7ff0a4c7b740 1 Processor -- start 2024-09-11T23:22:41.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.443+0000 7ff0a4c7b740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec43cf0 0x55ee6ec6e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.443+0000 7ff0a4c7b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ee6ec45480 0x55ee6ec62630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.443+0000 7ff0a4c7b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec6d3f0 0x55ee6ec42130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.443+0000 7ff0a4c7b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ee6eb62780 con 0x55ee6ec6d3f0 2024-09-11T23:22:41.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.443+0000 7ff0a4c7b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ee6eba33d0 con 0x55ee6ec45480 2024-09-11T23:22:41.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.443+0000 7ff0a4c7b740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ee6eba23b0 con 0x55ee6ec43cf0 2024-09-11T23:22:41.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.443+0000 7ff0a4c7b740 10 client.0 _ll_register_callbacks cb 0x55ee6eba05d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:22:41.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.443+0000 7ff09b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec6d3f0 0x55ee6ec42130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.443+0000 7ff09aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec43cf0 0x55ee6ec6e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.443+0000 7ff09a000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ee6ec45480 0x55ee6ec62630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.443+0000 7ff09b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec6d3f0 0x55ee6ec42130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59246/0 (socket says 172.21.15.144:59246) 2024-09-11T23:22:41.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.443+0000 7ff09b400640 1 -- 172.21.15.144:0/885610252 learned_addr learned my addr 172.21.15.144:0/885610252 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:41.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.444+0000 7ff09aa00640 1 -- 172.21.15.144:0/885610252 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ee6ec45480 msgr2=0x55ee6ec62630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:41.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.444+0000 7ff09aa00640 1 --2- 172.21.15.144:0/885610252 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ee6ec45480 0x55ee6ec62630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.444+0000 7ff09aa00640 1 -- 172.21.15.144:0/885610252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec6d3f0 msgr2=0x55ee6ec42130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:41.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.444+0000 7ff09aa00640 1 --2- 172.21.15.144:0/885610252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec6d3f0 0x55ee6ec42130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.444+0000 7ff09aa00640 1 -- 172.21.15.144:0/885610252 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55ee6e9846b0 con 0x55ee6ec43cf0 2024-09-11T23:22:41.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.444+0000 7ff09b400640 1 --2- 172.21.15.144:0/885610252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec6d3f0 0x55ee6ec42130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:22:41.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.444+0000 7ff09aa00640 1 --2- 172.21.15.144:0/885610252 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec43cf0 0x55ee6ec6e440 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009fd0 tx=0x7ff08c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcec4bd1471d9229 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:41.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.444+0000 7ff07be00640 10 client.0 ms_handle_connect on v2:172.21.15.165:3301/0 2024-09-11T23:22:41.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.444+0000 7ff07be00640 1 -- 172.21.15.144:0/885610252 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c023420 con 0x55ee6ec43cf0 2024-09-11T23:22:41.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.444+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/885610252 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff088082100 con 0x55ee6ec43cf0 2024-09-11T23:22:41.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.444+0000 7ff07be00640 1 -- 172.21.15.144:0/885610252 <== mon.2 v2:172.21.15.165:3301/0 2 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7ff08c0235c0 con 0x55ee6ec43cf0 2024-09-11T23:22:41.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.445+0000 7ff07be00640 1 -- 172.21.15.144:0/885610252 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7ff08c031050 con 0x55ee6ec43cf0 2024-09-11T23:22:41.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.445+0000 7ff0a4c7b740 10 client.5816 fetch_fsmap learned FSMap version 56 2024-09-11T23:22:41.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.445+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/885610252 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x55ee6ec63490 con 0x55ee6ec43cf0 2024-09-11T23:22:41.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.445+0000 7ff07be00640 1 -- 172.21.15.144:0/885610252 <== mon.2 v2:172.21.15.165:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff088082100 con 0x55ee6ec43cf0 2024-09-11T23:22:41.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.445+0000 7ff07be00640 1 -- 172.21.15.144:0/885610252 <== mon.2 v2:172.21.15.165:3301/0 5 ==== fsmap(e 56) ==== 3502+0+0 (secure 0 0 0) 0x7ff08c034020 con 0x55ee6ec43cf0 2024-09-11T23:22:41.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.445+0000 7ff0a4c7b740 10 client.5816 fetch_fsmap finished waiting for FSMap version 56 2024-09-11T23:22:41.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.445+0000 7ff0a4c7b740 10 client.5816 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T23:22:41.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.445+0000 7ff0a4c7b740 20 client.5816 populate_metadata read hostname 'smithi144' 2024-09-11T23:22:41.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.445+0000 7ff0a4c7b740 1 --2- 172.21.15.144:0/885610252 >> [v2:172.21.15.144:6801/1018187462,v1:172.21.15.144:6835/1018187462] conn(0x55ee6ec990a0 0x55ee6eca70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.445+0000 7ff0a4c7b740 4 client.5816 mds_command: new command op to 6522 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:22:41.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.445+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/885610252 --> [v2:172.21.15.144:6801/1018187462,v1:172.21.15.144:6835/1018187462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee6ebb4b40 con 0x55ee6ec990a0 2024-09-11T23:22:41.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.445+0000 7ff09a000640 1 --2- 172.21.15.144:0/885610252 >> [v2:172.21.15.144:6801/1018187462,v1:172.21.15.144:6835/1018187462] conn(0x55ee6ec990a0 0x55ee6eca70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.446+0000 7ff07be00640 10 client.5816 ms_handle_connect on v2:172.21.15.144:6801/1018187462 2024-09-11T23:22:41.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.446+0000 7ff09a000640 1 --2- 172.21.15.144:0/885610252 >> [v2:172.21.15.144:6801/1018187462,v1:172.21.15.144:6835/1018187462] conn(0x55ee6ec990a0 0x55ee6eca70c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b66b5867a96b753 server_cookie=743a06daca49cbc5 in_seq=0 out_seq=0 2024-09-11T23:22:41.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.447+0000 7ff07be00640 1 -- 172.21.15.144:0/885610252 <== mds.0 v2:172.21.15.144:6801/1018187462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee6ebb4b40 con 0x55ee6ec990a0 2024-09-11T23:22:41.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.447+0000 7ff07be00640 10 client.5816 handle_command_reply: tid=0 2024-09-11T23:22:41.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.447+0000 7ff0a4c7b740 1 client.5816 shutdown 2024-09-11T23:22:41.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.447+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/885610252 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec43cf0 msgr2=0x55ee6ec6e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:41.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.447+0000 7ff0a4c7b740 1 --2- 172.21.15.144:0/885610252 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec43cf0 0x55ee6ec6e440 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009fd0 tx=0x7ff08c004a40 comp rx=0 tx=0).stop 2024-09-11T23:22:41.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.447+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/885610252 shutdown_connections 2024-09-11T23:22:41.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.447+0000 7ff0a4c7b740 1 --2- 172.21.15.144:0/885610252 >> [v2:172.21.15.144:6801/1018187462,v1:172.21.15.144:6835/1018187462] conn(0x55ee6ec990a0 0x55ee6eca70c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.447+0000 7ff0a4c7b740 1 --2- 172.21.15.144:0/885610252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec6d3f0 0x55ee6ec42130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.447+0000 7ff0a4c7b740 1 --2- 172.21.15.144:0/885610252 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ee6ec45480 0x55ee6ec62630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.447+0000 7ff0a4c7b740 1 --2- 172.21.15.144:0/885610252 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec43cf0 0x55ee6ec6e440 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.447+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/885610252 >> 172.21.15.144:0/885610252 conn(0x55ee6ec414b0 msgr2=0x55ee6ec87f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:41.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.447+0000 7ff07be00640 0 client.5816 ms_handle_reset on v2:172.21.15.144:6801/1018187462 2024-09-11T23:22:41.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.447+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/885610252 shutdown_connections 2024-09-11T23:22:41.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.447+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/885610252 wait complete. 2024-09-11T23:22:41.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.448+0000 7ff0a4c7b740 20 client.5816 trim_cache size 0 max 16384 2024-09-11T23:22:41.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.466+0000 7ff0a4c7b740 1 Processor -- start 2024-09-11T23:22:41.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.466+0000 7ff0a4c7b740 1 -- start start 2024-09-11T23:22:41.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.467+0000 7ff0a4c7b740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec43cf0 0x55ee6ec8a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.467+0000 7ff0a4c7b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ee6ec45480 0x55ee6ec41a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.467+0000 7ff0a4c7b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec6d3f0 0x55ee6ec41f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.467+0000 7ff0a4c7b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c1fb560 con 0x55ee6ec6d3f0 2024-09-11T23:22:41.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.467+0000 7ff0a4c7b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c155ba0 con 0x55ee6ec45480 2024-09-11T23:22:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.467+0000 7ff0a4c7b740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff09c1561f0 con 0x55ee6ec43cf0 2024-09-11T23:22:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.468+0000 7ff09b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec6d3f0 0x55ee6ec41f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.468+0000 7ff09aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec43cf0 0x55ee6ec8a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.468+0000 7ff09a000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ee6ec45480 0x55ee6ec41a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.468+0000 7ff09aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec43cf0 0x55ee6ec8a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:49706/0 (socket says 172.21.15.144:49706) 2024-09-11T23:22:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.468+0000 7ff09aa00640 1 -- 172.21.15.144:0/1982543362 learned_addr learned my addr 172.21.15.144:0/1982543362 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.468+0000 7ff09b400640 1 -- 172.21.15.144:0/1982543362 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec43cf0 msgr2=0x55ee6ec8a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.468+0000 7ff09b400640 1 --2- 172.21.15.144:0/1982543362 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec43cf0 0x55ee6ec8a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.468+0000 7ff09b400640 1 -- 172.21.15.144:0/1982543362 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ee6ec45480 msgr2=0x55ee6ec41a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.468+0000 7ff09b400640 1 --2- 172.21.15.144:0/1982543362 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ee6ec45480 0x55ee6ec41a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.468+0000 7ff09b400640 1 -- 172.21.15.144:0/1982543362 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee6ec3d5d0 con 0x55ee6ec6d3f0 2024-09-11T23:22:41.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.468+0000 7ff09b400640 1 --2- 172.21.15.144:0/1982543362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec6d3f0 0x55ee6ec41f90 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff09c06f450 tx=0x7ff094015780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72eb1666846cab40 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:41.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.468+0000 7ff086a00640 1 -- 172.21.15.144:0/1982543362 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09401f470 con 0x55ee6ec6d3f0 2024-09-11T23:22:41.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.468+0000 7ff086a00640 1 -- 172.21.15.144:0/1982543362 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff09401a070 con 0x55ee6ec6d3f0 2024-09-11T23:22:41.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.468+0000 7ff086a00640 1 -- 172.21.15.144:0/1982543362 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09401f830 con 0x55ee6ec6d3f0 2024-09-11T23:22:41.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.469+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/1982543362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec6d3f0 msgr2=0x55ee6ec41f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:41.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.469+0000 7ff0a4c7b740 1 --2- 172.21.15.144:0/1982543362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec6d3f0 0x55ee6ec41f90 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff09c06f450 tx=0x7ff094015780 comp rx=0 tx=0).stop 2024-09-11T23:22:41.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.469+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/1982543362 shutdown_connections 2024-09-11T23:22:41.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.469+0000 7ff0a4c7b740 1 --2- 172.21.15.144:0/1982543362 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec6d3f0 0x55ee6ec41f90 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.469+0000 7ff0a4c7b740 1 --2- 172.21.15.144:0/1982543362 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ee6ec45480 0x55ee6ec41a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.469+0000 7ff0a4c7b740 1 --2- 172.21.15.144:0/1982543362 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec43cf0 0x55ee6ec8a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.469+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/1982543362 >> 172.21.15.144:0/1982543362 conn(0x55ee6ec414b0 msgr2=0x55ee6ec869e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:41.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.469+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/1982543362 shutdown_connections 2024-09-11T23:22:41.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.469+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/1982543362 wait complete. 2024-09-11T23:22:41.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.470+0000 7ff0a4c7b740 1 -- start start 2024-09-11T23:22:41.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.470+0000 7ff0a4c7b740 1 Processor -- start 2024-09-11T23:22:41.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.471+0000 7ff0a4c7b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec43cf0 0x55ee6ec62610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.471+0000 7ff0a4c7b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ee6ec45480 0x55ee6ecefee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.471+0000 7ff0a4c7b740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec6d3f0 0x55ee6ec84bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.471+0000 7ff0a4c7b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ee6ec64160 con 0x55ee6ec43cf0 2024-09-11T23:22:41.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.471+0000 7ff0a4c7b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ee6ec3d860 con 0x55ee6ec45480 2024-09-11T23:22:41.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.471+0000 7ff0a4c7b740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55ee6ec647b0 con 0x55ee6ec6d3f0 2024-09-11T23:22:41.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.471+0000 7ff0a4c7b740 10 client.0 _ll_register_callbacks cb 0x7ff08c003990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:22:41.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.471+0000 7ff09aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec43cf0 0x55ee6ec62610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.471+0000 7ff09aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec43cf0 0x55ee6ec62610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59278/0 (socket says 172.21.15.144:59278) 2024-09-11T23:22:41.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.471+0000 7ff09aa00640 1 -- 172.21.15.144:0/4054873896 learned_addr learned my addr 172.21.15.144:0/4054873896 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:41.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.472+0000 7ff09b400640 1 --2- 172.21.15.144:0/4054873896 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec6d3f0 0x55ee6ec84bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.472+0000 7ff09a000640 1 --2- 172.21.15.144:0/4054873896 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ee6ec45480 0x55ee6ecefee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.472+0000 7ff09aa00640 1 -- 172.21.15.144:0/4054873896 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec6d3f0 msgr2=0x55ee6ec84bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:41.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.472+0000 7ff09aa00640 1 --2- 172.21.15.144:0/4054873896 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec6d3f0 0x55ee6ec84bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.472+0000 7ff09aa00640 1 -- 172.21.15.144:0/4054873896 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ee6ec45480 msgr2=0x55ee6ecefee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:41.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.472+0000 7ff09aa00640 1 --2- 172.21.15.144:0/4054873896 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ee6ec45480 0x55ee6ecefee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.472+0000 7ff09aa00640 1 -- 172.21.15.144:0/4054873896 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee6ec98000 con 0x55ee6ec43cf0 2024-09-11T23:22:41.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.472+0000 7ff09aa00640 1 --2- 172.21.15.144:0/4054873896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec43cf0 0x55ee6ec62610 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff08c02cba0 tx=0x7ff08c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfbc08a0a4dfce6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:41.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.472+0000 7ff07be00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:22:41.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.472+0000 7ff07be00640 1 -- 172.21.15.144:0/4054873896 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c017810 con 0x55ee6ec43cf0 2024-09-11T23:22:41.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.472+0000 7ff07be00640 1 -- 172.21.15.144:0/4054873896 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7ff08c023630 con 0x55ee6ec43cf0 2024-09-11T23:22:41.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.472+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/4054873896 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff09401a070 con 0x55ee6ec43cf0 2024-09-11T23:22:41.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.472+0000 7ff07be00640 1 -- 172.21.15.144:0/4054873896 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7ff08c047050 con 0x55ee6ec43cf0 2024-09-11T23:22:41.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.473+0000 7ff0a4c7b740 10 client.6672 fetch_fsmap learned FSMap version 56 2024-09-11T23:22:41.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.473+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/4054873896 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x55ee6ec69b40 con 0x55ee6ec43cf0 2024-09-11T23:22:41.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.473+0000 7ff07be00640 1 -- 172.21.15.144:0/4054873896 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff09401a070 con 0x55ee6ec43cf0 2024-09-11T23:22:41.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.473+0000 7ff07be00640 1 -- 172.21.15.144:0/4054873896 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 56) ==== 3502+0+0 (secure 0 0 0) 0x7ff08c04a020 con 0x55ee6ec43cf0 2024-09-11T23:22:41.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.473+0000 7ff0a4c7b740 10 client.6672 fetch_fsmap finished waiting for FSMap version 56 2024-09-11T23:22:41.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.473+0000 7ff0a4c7b740 10 client.6672 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T23:22:41.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.473+0000 7ff0a4c7b740 20 client.6672 populate_metadata read hostname 'smithi144' 2024-09-11T23:22:41.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.473+0000 7ff0a4c7b740 1 --2- 172.21.15.144:0/4054873896 >> [v2:172.21.15.144:6801/1018187462,v1:172.21.15.144:6835/1018187462] conn(0x55ee6ed0af80 0x55ee6ec6a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.473+0000 7ff0a4c7b740 4 client.6672 mds_command: new command op to 6522 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:22:41.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.473+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/4054873896 --> [v2:172.21.15.144:6801/1018187462,v1:172.21.15.144:6835/1018187462] -- command(tid 0: {"prefix": "status"}) -- 0x55ee6ebaee90 con 0x55ee6ed0af80 2024-09-11T23:22:41.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.473+0000 7ff09a000640 1 --2- 172.21.15.144:0/4054873896 >> [v2:172.21.15.144:6801/1018187462,v1:172.21.15.144:6835/1018187462] conn(0x55ee6ed0af80 0x55ee6ec6a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.474+0000 7ff07be00640 10 client.6672 ms_handle_connect on v2:172.21.15.144:6801/1018187462 2024-09-11T23:22:41.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.474+0000 7ff09a000640 1 --2- 172.21.15.144:0/4054873896 >> [v2:172.21.15.144:6801/1018187462,v1:172.21.15.144:6835/1018187462] conn(0x55ee6ed0af80 0x55ee6ec6a000 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a1821f1e45a08f7 server_cookie=24b14b77d4de9ffa in_seq=0 out_seq=0 2024-09-11T23:22:41.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.474+0000 7ff07be00640 1 -- 172.21.15.144:0/4054873896 <== mds.0 v2:172.21.15.144:6801/1018187462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55ee6ebaee90 con 0x55ee6ed0af80 2024-09-11T23:22:41.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.474+0000 7ff07be00640 10 client.6672 handle_command_reply: tid=0 2024-09-11T23:22:41.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.474+0000 7ff0a4c7b740 1 client.6672 shutdown 2024-09-11T23:22:41.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.474+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/4054873896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec43cf0 msgr2=0x55ee6ec62610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:41.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.474+0000 7ff0a4c7b740 1 --2- 172.21.15.144:0/4054873896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec43cf0 0x55ee6ec62610 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff08c02cba0 tx=0x7ff08c019000 comp rx=0 tx=0).stop 2024-09-11T23:22:41.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.474+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/4054873896 shutdown_connections 2024-09-11T23:22:41.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.474+0000 7ff0a4c7b740 1 --2- 172.21.15.144:0/4054873896 >> [v2:172.21.15.144:6801/1018187462,v1:172.21.15.144:6835/1018187462] conn(0x55ee6ed0af80 0x55ee6ec6a000 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.474+0000 7ff0a4c7b740 1 --2- 172.21.15.144:0/4054873896 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55ee6ec6d3f0 0x55ee6ec84bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.474+0000 7ff0a4c7b740 1 --2- 172.21.15.144:0/4054873896 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ee6ec45480 0x55ee6ecefee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.474+0000 7ff0a4c7b740 1 --2- 172.21.15.144:0/4054873896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ee6ec43cf0 0x55ee6ec62610 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.474+0000 7ff07be00640 0 client.6672 ms_handle_reset on v2:172.21.15.144:6801/1018187462 2024-09-11T23:22:41.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.474+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/4054873896 >> 172.21.15.144:0/4054873896 conn(0x55ee6ec414b0 msgr2=0x55ee6ec6e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:41.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.474+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/4054873896 shutdown_connections 2024-09-11T23:22:41.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.474+0000 7ff0a4c7b740 1 -- 172.21.15.144:0/4054873896 wait complete. 2024-09-11T23:22:41.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.474+0000 7ff0a4c7b740 20 client.6672 trim_cache size 0 max 16384 2024-09-11T23:22:41.480 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:22:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "4b73e4b7-12f0-4e37-94bc-45e333efe84e", 2024-09-11T23:22:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-11T23:22:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 6522, 2024-09-11T23:22:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-11T23:22:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-11T23:22:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-11T23:22:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 10.687032459999999, 2024-09-11T23:22:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 56, 2024-09-11T23:22:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 83, 2024-09-11T23:22:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 83, 2024-09-11T23:22:41.481 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 15.402628451 2024-09-11T23:22:41.481 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:22:41.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.475+0000 7ff0a1c00640 1 -- 172.21.15.144:0/45748102 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff07c06bf50 msgr2=0x7ff07c06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:41.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.475+0000 7ff0a1c00640 1 --2- 172.21.15.144:0/45748102 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff07c06bf50 0x7ff07c06e410 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff09c15a2c0 tx=0x7ff08c00b040 comp rx=0 tx=0).stop 2024-09-11T23:22:41.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.475+0000 7ff0a1c00640 1 -- 172.21.15.144:0/45748102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff09c0cf5b0 msgr2=0x7ff09c154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:41.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.475+0000 7ff0a1c00640 1 --2- 172.21.15.144:0/45748102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff09c0cf5b0 0x7ff09c154270 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff088035040 tx=0x7ff0880046c0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.475+0000 7ff0a1c00640 1 -- 172.21.15.144:0/45748102 shutdown_connections 2024-09-11T23:22:41.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.475+0000 7ff0a1c00640 1 --2- 172.21.15.144:0/45748102 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff07c06bf50 0x7ff07c06e410 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.475+0000 7ff0a1c00640 1 --2- 172.21.15.144:0/45748102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff09c15c180 0x7ff09c15e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.475+0000 7ff0a1c00640 1 --2- 172.21.15.144:0/45748102 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff09c0cf5b0 0x7ff09c154270 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.475+0000 7ff0a1c00640 1 --2- 172.21.15.144:0/45748102 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff09c0ce230 0x7ff09c156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.475+0000 7ff0a1c00640 1 -- 172.21.15.144:0/45748102 >> 172.21.15.144:0/45748102 conn(0x7ff09c062cc0 msgr2=0x7ff09c15acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:41.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.475+0000 7ff0a1c00640 1 -- 172.21.15.144:0/45748102 shutdown_connections 2024-09-11T23:22:41.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.475+0000 7ff0a1c00640 1 -- 172.21.15.144:0/45748102 wait complete. 2024-09-11T23:22:41.491 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:22:41.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.646+0000 7f45f3000640 1 Processor -- start 2024-09-11T23:22:41.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.646+0000 7f45f3000640 1 -- start start 2024-09-11T23:22:41.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.647+0000 7f45f3000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f45ec06be10 0x7f45ec0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.647+0000 7f45f3000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45ec06c1f0 0x7f45ec15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.648+0000 7f45f3000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45ec0cd5f0 con 0x7f45ec151540 2024-09-11T23:22:41.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.648+0000 7f45f3000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f45ec0cd8d0 con 0x7f45ec06be10 2024-09-11T23:22:41.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.648+0000 7f45f3000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f45ec0cdbb0 con 0x7f45ec06c1f0 2024-09-11T23:22:41.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.648+0000 7f45eb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45ec06c1f0 0x7f45ec15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.648+0000 7f45eb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45ec06c1f0 0x7f45ec15baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:49728/0 (socket says 172.21.15.144:49728) 2024-09-11T23:22:41.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.648+0000 7f45eb400640 1 -- 172.21.15.144:0/770771851 learned_addr learned my addr 172.21.15.144:0/770771851 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:41.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.648+0000 7f45ebe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f45ec06be10 0x7f45ec0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.648+0000 7f45eb400640 1 -- 172.21.15.144:0/770771851 >> v2:172.21.15.165:3300/0 conn(0x7f45ec06be10 msgr2=0x7f45ec0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:41.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.648+0000 7f45eb400640 1 --2- 172.21.15.144:0/770771851 >> v2:172.21.15.165:3300/0 conn(0x7f45ec06be10 0x7f45ec0cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.648+0000 7f45eb400640 1 -- 172.21.15.144:0/770771851 >> v1:172.21.15.165:6789/0 conn(0x7f45ec151540 legacy=0x7f45ec15e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:41.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.648+0000 7f45eb400640 1 -- 172.21.15.144:0/770771851 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45ec0cde90 con 0x7f45ec06c1f0 2024-09-11T23:22:41.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.649+0000 7f45eb400640 1 --2- 172.21.15.144:0/770771851 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45ec06c1f0 0x7f45ec15baa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f45d800bb10 tx=0x7f45d802c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b464e167c49cc49 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:41.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.650+0000 7f45eaa00640 1 -- 172.21.15.144:0/770771851 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d8036020 con 0x7f45ec06c1f0 2024-09-11T23:22:41.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.650+0000 7f45eaa00640 1 -- 172.21.15.144:0/770771851 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45d8032820 con 0x7f45ec06c1f0 2024-09-11T23:22:41.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.650+0000 7f45eaa00640 1 -- 172.21.15.144:0/770771851 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d8032bf0 con 0x7f45ec06c1f0 2024-09-11T23:22:41.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.650+0000 7f45f3000640 1 -- 172.21.15.144:0/770771851 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45ec06c1f0 msgr2=0x7f45ec15baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:41.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.650+0000 7f45f3000640 1 --2- 172.21.15.144:0/770771851 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45ec06c1f0 0x7f45ec15baa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f45d800bb10 tx=0x7f45d802c920 comp rx=0 tx=0).stop 2024-09-11T23:22:41.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.650+0000 7f45f3000640 1 -- 172.21.15.144:0/770771851 shutdown_connections 2024-09-11T23:22:41.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.650+0000 7f45f3000640 1 --2- 172.21.15.144:0/770771851 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45ec06c1f0 0x7f45ec15baa0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.650+0000 7f45f3000640 1 --2- 172.21.15.144:0/770771851 >> v2:172.21.15.165:3300/0 conn(0x7f45ec06be10 0x7f45ec0cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.651+0000 7f45f3000640 1 -- 172.21.15.144:0/770771851 >> 172.21.15.144:0/770771851 conn(0x7f45ec062cc0 msgr2=0x7f45ec06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:41.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.651+0000 7f45f3000640 1 -- 172.21.15.144:0/770771851 shutdown_connections 2024-09-11T23:22:41.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.651+0000 7f45f3000640 1 -- 172.21.15.144:0/770771851 wait complete. 2024-09-11T23:22:41.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.652+0000 7f45f3000640 1 Processor -- start 2024-09-11T23:22:41.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.652+0000 7f45f3000640 1 -- start start 2024-09-11T23:22:41.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.653+0000 7f45f3000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec06be10 0x7f45ec14e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.653+0000 7f45f3000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45ec06c1f0 0x7f45ec152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.653+0000 7f45f3000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45ec151540 0x7f45ec0b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.653+0000 7f45f3000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f45ec1519b0 con 0x7f45ec06be10 2024-09-11T23:22:41.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.653+0000 7f45f3000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f45ec0ce690 con 0x7f45ec06c1f0 2024-09-11T23:22:41.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.653+0000 7f45f3000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f45ec151b30 con 0x7f45ec151540 2024-09-11T23:22:41.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.653+0000 7f45ebe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec06be10 0x7f45ec14e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.653+0000 7f45ebe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec06be10 0x7f45ec14e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59290/0 (socket says 172.21.15.144:59290) 2024-09-11T23:22:41.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.653+0000 7f45ebe00640 1 -- 172.21.15.144:0/649627771 learned_addr learned my addr 172.21.15.144:0/649627771 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:41.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.654+0000 7f45eb400640 1 --2- 172.21.15.144:0/649627771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45ec06c1f0 0x7f45ec152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.654+0000 7f45f1000640 1 --2- 172.21.15.144:0/649627771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45ec151540 0x7f45ec0b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.654+0000 7f45ebe00640 1 -- 172.21.15.144:0/649627771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45ec151540 msgr2=0x7f45ec0b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:41.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.654+0000 7f45ebe00640 1 --2- 172.21.15.144:0/649627771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45ec151540 0x7f45ec0b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.654+0000 7f45ebe00640 1 -- 172.21.15.144:0/649627771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45ec06c1f0 msgr2=0x7f45ec152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:41.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.654+0000 7f45ebe00640 1 --2- 172.21.15.144:0/649627771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45ec06c1f0 0x7f45ec152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.654+0000 7f45ebe00640 1 -- 172.21.15.144:0/649627771 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45ec15e410 con 0x7f45ec06be10 2024-09-11T23:22:41.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.654+0000 7f45ebe00640 1 --2- 172.21.15.144:0/649627771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec06be10 0x7f45ec14e0a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f45dc00e9b0 tx=0x7f45dc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:41.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.654+0000 7f45e3e00640 1 -- 172.21.15.144:0/649627771 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc017070 con 0x7f45ec06be10 2024-09-11T23:22:41.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.654+0000 7f45e3e00640 1 -- 172.21.15.144:0/649627771 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45dc00c9a0 con 0x7f45ec06be10 2024-09-11T23:22:41.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.654+0000 7f45e3e00640 1 -- 172.21.15.144:0/649627771 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc00cd90 con 0x7f45ec06be10 2024-09-11T23:22:41.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.654+0000 7f45f3000640 1 -- 172.21.15.144:0/649627771 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45ec152090 con 0x7f45ec06be10 2024-09-11T23:22:41.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.655+0000 7f45f3000640 1 -- 172.21.15.144:0/649627771 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45ec152610 con 0x7f45ec06be10 2024-09-11T23:22:41.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.656+0000 7f45f3000640 1 -- 172.21.15.144:0/649627771 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45ec0cd010 con 0x7f45ec06be10 2024-09-11T23:22:41.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.657+0000 7f45e3e00640 1 -- 172.21.15.144:0/649627771 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f45dc01a070 con 0x7f45ec06be10 2024-09-11T23:22:41.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.657+0000 7f45e3e00640 1 --2- 172.21.15.144:0/649627771 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f45cc06bf50 0x7f45cc06e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:41.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.658+0000 7f45e3e00640 1 -- 172.21.15.144:0/649627771 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f45dc08af60 con 0x7f45ec06be10 2024-09-11T23:22:41.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.658+0000 7f45eb400640 1 --2- 172.21.15.144:0/649627771 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f45cc06bf50 0x7f45cc06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:41.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.659+0000 7f45eb400640 1 --2- 172.21.15.144:0/649627771 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f45cc06bf50 0x7f45cc06e410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f45d8037000 tx=0x7f45d8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:41.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.662+0000 7f45e3e00640 1 -- 172.21.15.144:0/649627771 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f45dc0591a0 con 0x7f45ec06be10 2024-09-11T23:22:41.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.872+0000 7f45f3000640 1 -- 172.21.15.144:0/649627771 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f45ec15aa60 con 0x7f45ec06be10 2024-09-11T23:22:41.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.872+0000 7f45e3e00640 1 -- 172.21.15.144:0/649627771 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) ==== 53+0+73 (secure 0 0 0) 0x7f45dc05d4a0 con 0x7f45ec06be10 2024-09-11T23:22:41.872 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:22:41.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.874+0000 7f45f3000640 1 -- 172.21.15.144:0/649627771 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f45cc06bf50 msgr2=0x7f45cc06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:41.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.874+0000 7f45f3000640 1 --2- 172.21.15.144:0/649627771 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f45cc06bf50 0x7f45cc06e410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f45d8037000 tx=0x7f45d8008040 comp rx=0 tx=0).stop 2024-09-11T23:22:41.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.874+0000 7f45f3000640 1 -- 172.21.15.144:0/649627771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec06be10 msgr2=0x7f45ec14e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:41.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.874+0000 7f45f3000640 1 --2- 172.21.15.144:0/649627771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec06be10 0x7f45ec14e0a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f45dc00e9b0 tx=0x7f45dc00ee70 comp rx=0 tx=0).stop 2024-09-11T23:22:41.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.874+0000 7f45f3000640 1 -- 172.21.15.144:0/649627771 shutdown_connections 2024-09-11T23:22:41.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.874+0000 7f45f3000640 1 --2- 172.21.15.144:0/649627771 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f45cc06bf50 0x7f45cc06e410 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.874+0000 7f45f3000640 1 --2- 172.21.15.144:0/649627771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f45ec151540 0x7f45ec0b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.874+0000 7f45f3000640 1 --2- 172.21.15.144:0/649627771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45ec06c1f0 0x7f45ec152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.874+0000 7f45f3000640 1 --2- 172.21.15.144:0/649627771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f45ec06be10 0x7f45ec14e0a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:41.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.874+0000 7f45f3000640 1 -- 172.21.15.144:0/649627771 >> 172.21.15.144:0/649627771 conn(0x7f45ec062cc0 msgr2=0x7f45ec15efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:41.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.875+0000 7f45f3000640 1 -- 172.21.15.144:0/649627771 shutdown_connections 2024-09-11T23:22:41.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:41.875+0000 7f45f3000640 1 -- 172.21.15.144:0/649627771 wait complete. 2024-09-11T23:22:41.890 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:22:41.891 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:22:41.891 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-11T23:22:41.891 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:22:41.891 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:22:41.891 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:22:41.891 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:22:41.891 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:22:41.891 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:22:41.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:41.891 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-11T23:22:41.927 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:22:41.927 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:22:41.927 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:22:41.927 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-11T23:22:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:41.928 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:22:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:22:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-11T23:22:41.928 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:22:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:22:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-11T23:22:41.928 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:22:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:22:41.928 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:22:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-11T23:22:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:22:41.928 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42401sec preferred_lft 42401sec 2024-09-11T23:22:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2024-09-11T23:22:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:41.929 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:22:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff 2024-09-11T23:22:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:22:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::243b:82ff:fe06:fac9/64 scope link 2024-09-11T23:22:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:41.929 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:22:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:22:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::74ca:30ff:fef2:cddf/64 scope link 2024-09-11T23:22:41.929 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:41.929 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:22:41.930 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether be:01:ec:87:34:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:22:41.930 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bc01:ecff:fe87:34e1/64 scope link 2024-09-11T23:22:41.930 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:41.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:41.930 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:22:42.021 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-11T23:22:42.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:42.024 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-11T23:22:42.060 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-11T23:22:42.061 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:22:42.061 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:22:42.061 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:22:42.061 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:22:42.061 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:22:42.061 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-11T23:22:42.061 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:22:42.061 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:22:42.062 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:22:42.062 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-11T23:22:42.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:22:42.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:22:42.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:42.257 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-11T23:22:42.293 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:22:42.293 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:22:42.293 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:22:42.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:42.294 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-11T23:22:42.390 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:22:42.391 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:22:42.426 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:22:42.426 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:22:42.427 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:22:42.502 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T23:22:42.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:42.502 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:22:42.630 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:22:42.631 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:22:42.658 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:22:42.658 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:22:42.658 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:22:42.658 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:22:42.659 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:22:42.661 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T23:22:42.661 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:22:42.661 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:22:42.661 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:22:42.661 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:22:42.664 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:22:42.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:42.664 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:22:42.721 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:22:42.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:22:42.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:22:42.817 INFO:teuthology.orchestra.run.smithi144.stdout:client6678 2024-09-11T23:22:42.818 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:22:42.818 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:42.854 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:22:43.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.047+0000 7efeb8400640 1 Processor -- start 2024-09-11T23:22:43.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.048+0000 7efeb8400640 1 -- start start 2024-09-11T23:22:43.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.049+0000 7efeb8400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb00cf070 0x7efeb00cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:43.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.049+0000 7efeb8400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efeb0073120 0x7efeb0073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:43.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.049+0000 7efeb8400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeb00ce740 con 0x7efeb015c180 2024-09-11T23:22:43.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.049+0000 7efeb8400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efeb0072640 con 0x7efeb0073120 2024-09-11T23:22:43.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.049+0000 7efeb8400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efeb0072920 con 0x7efeb00cf070 2024-09-11T23:22:43.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.049+0000 7efeb6400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efeb0073120 0x7efeb0073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:43.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.049+0000 7efeb5a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7efeb015c180 0x7efeb00cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49570/0 (socket says 172.21.15.144:49570) 2024-09-11T23:22:43.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.049+0000 7efeb5a00640 1 -- 172.21.15.144:0/1065454067 learned_addr learned my addr 172.21.15.144:0/1065454067 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:43.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.049+0000 7efeb5000640 1 --2- 172.21.15.144:0/1065454067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb00cf070 0x7efeb00cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:43.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.050+0000 7efeb6400640 1 -- 172.21.15.144:0/1065454067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb00cf070 msgr2=0x7efeb00cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:43.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.050+0000 7efeb6400640 1 --2- 172.21.15.144:0/1065454067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb00cf070 0x7efeb00cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:43.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.050+0000 7efeb6400640 1 -- 172.21.15.144:0/1065454067 >> v1:172.21.15.144:6789/0 conn(0x7efeb015c180 legacy=0x7efeb00cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:43.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.050+0000 7efeb6400640 1 -- 172.21.15.144:0/1065454067 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb0072c00 con 0x7efeb0073120 2024-09-11T23:22:43.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.050+0000 7efeafe00640 1 -- 172.21.15.144:0/1065454067 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1017758440 0 0) 0x7efeb00ce740 con 0x7efeb015c180 2024-09-11T23:22:43.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.051+0000 7efeb6400640 1 --2- 172.21.15.144:0/1065454067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb0073120 0x7efeb0073590 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efea8009d90 tx=0x7efea802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67ad173f8b19f7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:43.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.051+0000 7efeafe00640 1 -- 172.21.15.144:0/1065454067 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8031600 con 0x7efeb0073120 2024-09-11T23:22:43.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.051+0000 7efeafe00640 1 -- 172.21.15.144:0/1065454067 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea80317a0 con 0x7efeb0073120 2024-09-11T23:22:43.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.051+0000 7efeafe00640 1 -- 172.21.15.144:0/1065454067 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8031b70 con 0x7efeb0073120 2024-09-11T23:22:43.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.051+0000 7efeb8400640 1 -- 172.21.15.144:0/1065454067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb0073120 msgr2=0x7efeb0073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:43.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.051+0000 7efeb8400640 1 --2- 172.21.15.144:0/1065454067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb0073120 0x7efeb0073590 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efea8009d90 tx=0x7efea802a5d0 comp rx=0 tx=0).stop 2024-09-11T23:22:43.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.051+0000 7efeb8400640 1 -- 172.21.15.144:0/1065454067 shutdown_connections 2024-09-11T23:22:43.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.051+0000 7efeb8400640 1 --2- 172.21.15.144:0/1065454067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb0073120 0x7efeb0073590 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:43.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.051+0000 7efeb8400640 1 --2- 172.21.15.144:0/1065454067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb00cf070 0x7efeb00cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:43.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.051+0000 7efeb8400640 1 -- 172.21.15.144:0/1065454067 >> 172.21.15.144:0/1065454067 conn(0x7efeb0062cc0 msgr2=0x7efeb006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:43.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.052+0000 7efeb8400640 1 -- 172.21.15.144:0/1065454067 shutdown_connections 2024-09-11T23:22:43.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.052+0000 7efeb8400640 1 -- 172.21.15.144:0/1065454067 wait complete. 2024-09-11T23:22:43.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.053+0000 7efeb8400640 1 Processor -- start 2024-09-11T23:22:43.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.053+0000 7efeb8400640 1 -- start start 2024-09-11T23:22:43.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.054+0000 7efeb8400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb0073120 0x7efeb00ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:43.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.054+0000 7efeb8400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efeb00cf070 0x7efeb00aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:43.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.054+0000 7efeb8400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb015c180 0x7efeb00b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:43.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.054+0000 7efeb8400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efeb00722f0 con 0x7efeb015c180 2024-09-11T23:22:43.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.054+0000 7efeb8400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efeb00ced00 con 0x7efeb00cf070 2024-09-11T23:22:43.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.054+0000 7efeb8400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efeb015c560 con 0x7efeb0073120 2024-09-11T23:22:43.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.055+0000 7efeb6400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb015c180 0x7efeb00b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:43.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.055+0000 7efeb6400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb015c180 0x7efeb00b3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59314/0 (socket says 172.21.15.144:59314) 2024-09-11T23:22:43.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.055+0000 7efeb6400640 1 -- 172.21.15.144:0/2246078030 learned_addr learned my addr 172.21.15.144:0/2246078030 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:43.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.055+0000 7efeb5a00640 1 --2- 172.21.15.144:0/2246078030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb0073120 0x7efeb00ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:43.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.055+0000 7efeb5000640 1 --2- 172.21.15.144:0/2246078030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efeb00cf070 0x7efeb00aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:43.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.055+0000 7efeb6400640 1 -- 172.21.15.144:0/2246078030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb0073120 msgr2=0x7efeb00ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:43.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.055+0000 7efeb6400640 1 --2- 172.21.15.144:0/2246078030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb0073120 0x7efeb00ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:43.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.055+0000 7efeb6400640 1 -- 172.21.15.144:0/2246078030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efeb00cf070 msgr2=0x7efeb00aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:43.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.055+0000 7efeb6400640 1 --2- 172.21.15.144:0/2246078030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efeb00cf070 0x7efeb00aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:43.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.055+0000 7efeb6400640 1 -- 172.21.15.144:0/2246078030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb0151290 con 0x7efeb015c180 2024-09-11T23:22:43.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.055+0000 7efeb5000640 1 --2- 172.21.15.144:0/2246078030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efeb00cf070 0x7efeb00aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:43.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.055+0000 7efeb6400640 1 --2- 172.21.15.144:0/2246078030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb015c180 0x7efeb00b3440 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7efea8009eb0 tx=0x7efea8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:43.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.055+0000 7efead600640 1 -- 172.21.15.144:0/2246078030 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8040070 con 0x7efeb015c180 2024-09-11T23:22:43.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.056+0000 7efead600640 1 -- 172.21.15.144:0/2246078030 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea8030b60 con 0x7efeb015c180 2024-09-11T23:22:43.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.056+0000 7efead600640 1 -- 172.21.15.144:0/2246078030 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8009450 con 0x7efeb015c180 2024-09-11T23:22:43.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.056+0000 7efeb8400640 1 -- 172.21.15.144:0/2246078030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb0151570 con 0x7efeb015c180 2024-09-11T23:22:43.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.056+0000 7efeb8400640 1 -- 172.21.15.144:0/2246078030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb0151b30 con 0x7efeb015c180 2024-09-11T23:22:43.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.057+0000 7efeb8400640 1 -- 172.21.15.144:0/2246078030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb00cf4b0 con 0x7efeb015c180 2024-09-11T23:22:43.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.058+0000 7efead600640 1 -- 172.21.15.144:0/2246078030 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7efea8039040 con 0x7efeb015c180 2024-09-11T23:22:43.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.058+0000 7efead600640 1 --2- 172.21.15.144:0/2246078030 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efe9006bf50 0x7efe9006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:43.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.058+0000 7efead600640 1 -- 172.21.15.144:0/2246078030 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7efea80ac790 con 0x7efeb015c180 2024-09-11T23:22:43.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.059+0000 7efeb5a00640 1 --2- 172.21.15.144:0/2246078030 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efe9006bf50 0x7efe9006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:43.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.060+0000 7efeb5a00640 1 --2- 172.21.15.144:0/2246078030 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efe9006bf50 0x7efe9006e410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efea4000f60 tx=0x7efea4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:43.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.063+0000 7efead600640 1 -- 172.21.15.144:0/2246078030 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efea807af10 con 0x7efeb015c180 2024-09-11T23:22:43.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.270+0000 7efeb8400640 1 -- 172.21.15.144:0/2246078030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efeb01572b0 con 0x7efeb015c180 2024-09-11T23:22:43.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.271+0000 7efead600640 1 -- 172.21.15.144:0/2246078030 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) ==== 53+0+73 (secure 0 0 0) 0x7efea807a810 con 0x7efeb015c180 2024-09-11T23:22:43.271 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:22:43.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.273+0000 7efeb8400640 1 -- 172.21.15.144:0/2246078030 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efe9006bf50 msgr2=0x7efe9006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:43.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.273+0000 7efeb8400640 1 --2- 172.21.15.144:0/2246078030 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efe9006bf50 0x7efe9006e410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efea4000f60 tx=0x7efea4009040 comp rx=0 tx=0).stop 2024-09-11T23:22:43.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.273+0000 7efeb8400640 1 -- 172.21.15.144:0/2246078030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb015c180 msgr2=0x7efeb00b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:43.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.273+0000 7efeb8400640 1 --2- 172.21.15.144:0/2246078030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb015c180 0x7efeb00b3440 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7efea8009eb0 tx=0x7efea8004a40 comp rx=0 tx=0).stop 2024-09-11T23:22:43.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.273+0000 7efeb8400640 1 -- 172.21.15.144:0/2246078030 shutdown_connections 2024-09-11T23:22:43.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.273+0000 7efeb8400640 1 --2- 172.21.15.144:0/2246078030 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efe9006bf50 0x7efe9006e410 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:43.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.273+0000 7efeb8400640 1 --2- 172.21.15.144:0/2246078030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efeb015c180 0x7efeb00b3440 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:43.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.273+0000 7efeb8400640 1 --2- 172.21.15.144:0/2246078030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efeb00cf070 0x7efeb00aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:43.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.273+0000 7efeb8400640 1 --2- 172.21.15.144:0/2246078030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efeb0073120 0x7efeb00ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:43.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.273+0000 7efeb8400640 1 -- 172.21.15.144:0/2246078030 >> 172.21.15.144:0/2246078030 conn(0x7efeb0062cc0 msgr2=0x7efeb00cc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:43.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.273+0000 7efeb8400640 1 -- 172.21.15.144:0/2246078030 shutdown_connections 2024-09-11T23:22:43.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:43.273+0000 7efeb8400640 1 -- 172.21.15.144:0/2246078030 wait complete. 2024-09-11T23:22:43.288 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:22:43.289 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:22:43.289 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi165.front.sepia.ceph.com 2024-09-11T23:22:43.289 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T23:22:43.289 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:22:43.289 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:22:43.289 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:22:43.289 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:22:43.289 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:22:43.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:43.290 DEBUG:teuthology.orchestra.run.smithi165:> ip addr 2024-09-11T23:22:43.330 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:22:43.330 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:22:43.330 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:22:43.330 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:43.330 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-11T23:22:43.330 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:43.331 INFO:teuthology.orchestra.run.smithi165.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:22:43.331 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:94 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:22:43.331 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f0 2024-09-11T23:22:43.331 INFO:teuthology.orchestra.run.smithi165.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:22:43.331 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:95 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:22:43.331 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f1 2024-09-11T23:22:43.331 INFO:teuthology.orchestra.run.smithi165.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:22:43.331 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:22:43.331 INFO:teuthology.orchestra.run.smithi165.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:22:43.331 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:22:43.331 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.21.15.165/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:22:43.331 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft 42402sec preferred_lft 42402sec 2024-09-11T23:22:43.331 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::ec4:7aff:fe88:7f63/64 scope link noprefixroute 2024-09-11T23:22:43.332 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:43.332 INFO:teuthology.orchestra.run.smithi165.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:22:43.332 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:22:43.332 INFO:teuthology.orchestra.run.smithi165.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:22:43.332 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:43.332 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::c063:d7ff:fec8:c56c/64 scope link 2024-09-11T23:22:43.332 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:43.332 INFO:teuthology.orchestra.run.smithi165.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:22:43.332 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:22:43.332 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::5478:e4ff:fecd:76c/64 scope link 2024-09-11T23:22:43.332 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:43.332 INFO:teuthology.orchestra.run.smithi165.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:22:43.332 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether ba:fa:43:78:5f:29 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:22:43.332 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::b8fa:43ff:fe78:5f29/64 scope link 2024-09-11T23:22:43.333 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:22:43.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:43.333 DEBUG:teuthology.orchestra.run.smithi165:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:22:43.430 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-11T23:22:43.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:43.434 DEBUG:teuthology.orchestra.run.smithi165:> route 2024-09-11T23:22:43.471 INFO:teuthology.orchestra.run.smithi165.stdout:Kernel IP routing table 2024-09-11T23:22:43.471 INFO:teuthology.orchestra.run.smithi165.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:22:43.471 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:22:43.471 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:22:43.471 INFO:teuthology.orchestra.run.smithi165.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:22:43.472 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:22:43.472 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-11T23:22:43.472 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:22:43.472 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:22:43.472 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:22:43.472 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-11T23:22:43.589 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:22:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:22:43.660 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:22:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:22:43.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:43.669 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-11T23:22:43.704 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-11T23:22:43.704 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-11T23:22:43.704 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:22:43.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:43.705 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set brx.0 up 2024-09-11T23:22:43.801 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:22:43.801 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T23:22:43.837 INFO:teuthology.orchestra.run.smithi165.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:22:43.837 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:22:43.837 DEBUG:teuthology.orchestra.run.smithi165:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:22:43.912 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-11T23:22:43.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:43.913 DEBUG:teuthology.orchestra.run.smithi165:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:22:44.041 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:22:44.041 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:22:44.069 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:22:44.069 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:22:44.069 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:22:44.069 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: trying mount with new device syntax: 1@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:22:44.070 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:22:44.072 INFO:teuthology.orchestra.run.smithi165.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-11T23:22:44.072 INFO:teuthology.orchestra.run.smithi165.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:22:44.072 INFO:teuthology.orchestra.run.smithi165.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:22:44.072 INFO:teuthology.orchestra.run.smithi165.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:22:44.072 INFO:teuthology.orchestra.run.smithi165.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:22:44.075 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:22:44.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:44.075 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:22:44.130 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:22:44.209 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:22:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:22:44.212 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:22:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:22:44.220 INFO:teuthology.orchestra.run.smithi165.stdout:client6373 2024-09-11T23:22:44.220 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:22:44.220 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:44.256 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-11T23:22:44.383 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:22:44.387 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:22:44.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.424+0000 7fad3b000640 1 Processor -- start 2024-09-11T23:22:44.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.424+0000 7fad3b000640 1 -- start start 2024-09-11T23:22:44.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.425+0000 7fad3b000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fad340b61e0 0x7fad340b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:44.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.425+0000 7fad3b000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad340b3b00 0x7fad341625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:44.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.425+0000 7fad3b000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad340b3540 0x7fad34162b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:44.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.425+0000 7fad3b000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fad340d24f0 con 0x7fad340b3b00 2024-09-11T23:22:44.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.425+0000 7fad3b000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fad340b6b00 con 0x7fad340b61e0 2024-09-11T23:22:44.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.425+0000 7fad3b000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fad340d20e0 con 0x7fad340b3540 2024-09-11T23:22:44.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.426+0000 7fad33400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad340b3b00 0x7fad341625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:44.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.426+0000 7fad33400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad340b3b00 0x7fad341625d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43364/0 (socket says 172.21.15.144:43364) 2024-09-11T23:22:44.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.426+0000 7fad33400640 1 -- 172.21.15.144:0/4216614347 learned_addr learned my addr 172.21.15.144:0/4216614347 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:44.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.426+0000 7fad33e00640 1 --2- 172.21.15.144:0/4216614347 >> v2:172.21.15.165:3300/0 conn(0x7fad340b61e0 0x7fad340b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:44.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.426+0000 7fad39000640 1 --2- 172.21.15.144:0/4216614347 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad340b3540 0x7fad34162b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:44.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.426+0000 7fad33400640 1 -- 172.21.15.144:0/4216614347 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad340b3540 msgr2=0x7fad34162b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:44.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.426+0000 7fad33400640 1 --2- 172.21.15.144:0/4216614347 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad340b3540 0x7fad34162b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:44.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.426+0000 7fad33400640 1 -- 172.21.15.144:0/4216614347 >> v2:172.21.15.165:3300/0 conn(0x7fad340b61e0 msgr2=0x7fad340b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:44.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.426+0000 7fad33400640 1 --2- 172.21.15.144:0/4216614347 >> v2:172.21.15.165:3300/0 conn(0x7fad340b61e0 0x7fad340b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:44.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.426+0000 7fad33400640 1 -- 172.21.15.144:0/4216614347 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad340cfa70 con 0x7fad340b3b00 2024-09-11T23:22:44.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.427+0000 7fad33400640 1 --2- 172.21.15.144:0/4216614347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad340b3b00 0x7fad341625d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fad3406be00 tx=0x7fad2002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a9d67617d7bc86 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:44.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.428+0000 7fad32a00640 1 -- 172.21.15.144:0/4216614347 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20037070 con 0x7fad340b3b00 2024-09-11T23:22:44.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.428+0000 7fad32a00640 1 -- 172.21.15.144:0/4216614347 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2002ae00 con 0x7fad340b3b00 2024-09-11T23:22:44.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.428+0000 7fad32a00640 1 -- 172.21.15.144:0/4216614347 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20032660 con 0x7fad340b3b00 2024-09-11T23:22:44.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.428+0000 7fad3b000640 1 -- 172.21.15.144:0/4216614347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad340b3b00 msgr2=0x7fad341625d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:44.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.428+0000 7fad3b000640 1 --2- 172.21.15.144:0/4216614347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad340b3b00 0x7fad341625d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fad3406be00 tx=0x7fad2002a0b0 comp rx=0 tx=0).stop 2024-09-11T23:22:44.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.428+0000 7fad3b000640 1 -- 172.21.15.144:0/4216614347 shutdown_connections 2024-09-11T23:22:44.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.428+0000 7fad3b000640 1 --2- 172.21.15.144:0/4216614347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad340b3b00 0x7fad341625d0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:44.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.428+0000 7fad3b000640 1 --2- 172.21.15.144:0/4216614347 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad340b3540 0x7fad34162b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:44.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.428+0000 7fad3b000640 1 --2- 172.21.15.144:0/4216614347 >> v2:172.21.15.165:3300/0 conn(0x7fad340b61e0 0x7fad340b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:44.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.428+0000 7fad3b000640 1 -- 172.21.15.144:0/4216614347 >> 172.21.15.144:0/4216614347 conn(0x7fad340d11e0 msgr2=0x7fad340d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:44.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.428+0000 7fad3b000640 1 -- 172.21.15.144:0/4216614347 shutdown_connections 2024-09-11T23:22:44.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.428+0000 7fad3b000640 1 -- 172.21.15.144:0/4216614347 wait complete. 2024-09-11T23:22:44.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.430+0000 7fad3b000640 1 Processor -- start 2024-09-11T23:22:44.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.430+0000 7fad3b000640 1 -- start start 2024-09-11T23:22:44.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.431+0000 7fad3b000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad340b3540 0x7fad34160620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:44.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.431+0000 7fad3b000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad340b3b00 0x7fad340acc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:44.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.431+0000 7fad3b000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad340b61e0 0x7fad341527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:44.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.431+0000 7fad3b000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fad3415edc0 con 0x7fad340b3b00 2024-09-11T23:22:44.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.431+0000 7fad3b000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fad340d0030 con 0x7fad340b3540 2024-09-11T23:22:44.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.431+0000 7fad3b000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fad3415cf50 con 0x7fad340b61e0 2024-09-11T23:22:44.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.431+0000 7fad33400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad340b3b00 0x7fad340acc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:44.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.431+0000 7fad33e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad340b3540 0x7fad34160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:44.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.431+0000 7fad33e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad340b3540 0x7fad34160620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:60626/0 (socket says 172.21.15.144:60626) 2024-09-11T23:22:44.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.431+0000 7fad33e00640 1 -- 172.21.15.144:0/1989422784 learned_addr learned my addr 172.21.15.144:0/1989422784 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:44.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.431+0000 7fad39000640 1 --2- 172.21.15.144:0/1989422784 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad340b61e0 0x7fad341527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:44.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.432+0000 7fad33e00640 1 -- 172.21.15.144:0/1989422784 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad340b61e0 msgr2=0x7fad341527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:44.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.432+0000 7fad33e00640 1 --2- 172.21.15.144:0/1989422784 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad340b61e0 0x7fad341527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:44.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.432+0000 7fad33e00640 1 -- 172.21.15.144:0/1989422784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad340b3b00 msgr2=0x7fad340acc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:44.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.432+0000 7fad33e00640 1 --2- 172.21.15.144:0/1989422784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad340b3b00 0x7fad340acc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:44.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.432+0000 7fad33e00640 1 -- 172.21.15.144:0/1989422784 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3415fb80 con 0x7fad340b3540 2024-09-11T23:22:44.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.432+0000 7fad33e00640 1 --2- 172.21.15.144:0/1989422784 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad340b3540 0x7fad34160620 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fad2400e870 tx=0x7fad2400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:44.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.432+0000 7fad2be00640 1 -- 172.21.15.144:0/1989422784 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad24017070 con 0x7fad340b3540 2024-09-11T23:22:44.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.432+0000 7fad2be00640 1 -- 172.21.15.144:0/1989422784 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2400c940 con 0x7fad340b3540 2024-09-11T23:22:44.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.432+0000 7fad3b000640 1 -- 172.21.15.144:0/1989422784 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad34161d90 con 0x7fad340b3540 2024-09-11T23:22:44.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.433+0000 7fad2be00640 1 -- 172.21.15.144:0/1989422784 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2400cd30 con 0x7fad340b3540 2024-09-11T23:22:44.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.433+0000 7fad3b000640 1 -- 172.21.15.144:0/1989422784 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad34162070 con 0x7fad340b3540 2024-09-11T23:22:44.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.434+0000 7fad3b000640 1 -- 172.21.15.144:0/1989422784 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad340d1d00 con 0x7fad340b3540 2024-09-11T23:22:44.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.436+0000 7fad2be00640 1 -- 172.21.15.144:0/1989422784 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fad2401a070 con 0x7fad340b3540 2024-09-11T23:22:44.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.436+0000 7fad2be00640 1 --2- 172.21.15.144:0/1989422784 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fad1406bf50 0x7fad1406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:44.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.436+0000 7fad2be00640 1 -- 172.21.15.144:0/1989422784 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fad2408aec0 con 0x7fad340b3540 2024-09-11T23:22:44.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.437+0000 7fad33400640 1 --2- 172.21.15.144:0/1989422784 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fad1406bf50 0x7fad1406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:44.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.437+0000 7fad33400640 1 --2- 172.21.15.144:0/1989422784 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fad1406bf50 0x7fad1406e410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fad20034000 tx=0x7fad2002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:44.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.440+0000 7fad2be00640 1 -- 172.21.15.144:0/1989422784 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad240590f0 con 0x7fad340b3540 2024-09-11T23:22:44.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.651+0000 7fad3b000640 1 -- 172.21.15.144:0/1989422784 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fad340ba6e0 con 0x7fad340b3540 2024-09-11T23:22:44.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.845+0000 7fad2be00640 1 -- 172.21.15.144:0/1989422784 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v57) ==== 136+0+0 (secure 0 0 0) 0x7fad2405d3f0 con 0x7fad340b3540 2024-09-11T23:22:44.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.847+0000 7fad3b000640 1 -- 172.21.15.144:0/1989422784 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fad1406bf50 msgr2=0x7fad1406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:44.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.847+0000 7fad3b000640 1 --2- 172.21.15.144:0/1989422784 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fad1406bf50 0x7fad1406e410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fad20034000 tx=0x7fad2002e000 comp rx=0 tx=0).stop 2024-09-11T23:22:44.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.847+0000 7fad3b000640 1 -- 172.21.15.144:0/1989422784 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad340b3540 msgr2=0x7fad34160620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:44.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.847+0000 7fad3b000640 1 --2- 172.21.15.144:0/1989422784 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad340b3540 0x7fad34160620 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fad2400e870 tx=0x7fad2400ed30 comp rx=0 tx=0).stop 2024-09-11T23:22:44.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.847+0000 7fad3b000640 1 -- 172.21.15.144:0/1989422784 shutdown_connections 2024-09-11T23:22:44.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.847+0000 7fad3b000640 1 --2- 172.21.15.144:0/1989422784 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fad1406bf50 0x7fad1406e410 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:44.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.847+0000 7fad3b000640 1 --2- 172.21.15.144:0/1989422784 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad340b61e0 0x7fad341527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:44.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.847+0000 7fad3b000640 1 --2- 172.21.15.144:0/1989422784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad340b3b00 0x7fad340acc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:44.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.847+0000 7fad3b000640 1 --2- 172.21.15.144:0/1989422784 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad340b3540 0x7fad34160620 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:44.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.847+0000 7fad3b000640 1 -- 172.21.15.144:0/1989422784 >> 172.21.15.144:0/1989422784 conn(0x7fad340d11e0 msgr2=0x7fad340b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:44.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.847+0000 7fad3b000640 1 -- 172.21.15.144:0/1989422784 shutdown_connections 2024-09-11T23:22:44.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:44.847+0000 7fad3b000640 1 -- 172.21.15.144:0/1989422784 wait complete. 2024-09-11T23:22:44.863 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-11T23:22:45.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.017+0000 7f6281800640 1 Processor -- start 2024-09-11T23:22:45.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.017+0000 7f6281800640 1 -- start start 2024-09-11T23:22:45.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.019+0000 7f6281800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f627c15c180 0x7f627c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:45.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.019+0000 7f6281800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f627c073120 0x7f627c073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:45.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.019+0000 7f6281800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f627c0ce740 con 0x7f627c0ce230 2024-09-11T23:22:45.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.019+0000 7f6281800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f627c072640 con 0x7f627c073120 2024-09-11T23:22:45.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.019+0000 7f6281800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f627c072920 con 0x7f627c15c180 2024-09-11T23:22:45.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.019+0000 7f627b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f627c073120 0x7f627c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:45.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.019+0000 7f627b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f627c073120 0x7f627c073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43372/0 (socket says 172.21.15.144:43372) 2024-09-11T23:22:45.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.019+0000 7f627b400640 1 -- 172.21.15.144:0/3086845058 learned_addr learned my addr 172.21.15.144:0/3086845058 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:45.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.019+0000 7f627aa00640 1 --2- 172.21.15.144:0/3086845058 >> v2:172.21.15.165:3300/0 conn(0x7f627c15c180 0x7f627c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:45.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.019+0000 7f627b400640 1 -- 172.21.15.144:0/3086845058 >> v2:172.21.15.165:3300/0 conn(0x7f627c15c180 msgr2=0x7f627c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:45.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.019+0000 7f627b400640 1 --2- 172.21.15.144:0/3086845058 >> v2:172.21.15.165:3300/0 conn(0x7f627c15c180 0x7f627c0cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.019+0000 7f627b400640 1 -- 172.21.15.144:0/3086845058 >> v1:172.21.15.165:6789/0 conn(0x7f627c0ce230 legacy=0x7f627c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:45.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.019+0000 7f627b400640 1 -- 172.21.15.144:0/3086845058 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f627c072c00 con 0x7f627c073120 2024-09-11T23:22:45.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.019+0000 7f627aa00640 1 --2- 172.21.15.144:0/3086845058 >> v2:172.21.15.165:3300/0 conn(0x7f627c15c180 0x7f627c0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:45.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.020+0000 7f627b400640 1 --2- 172.21.15.144:0/3086845058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f627c073120 0x7f627c073570 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f627c06cc10 tx=0x7f627402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8bdaefa7778e4a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:45.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.021+0000 7f6279600640 1 -- 172.21.15.144:0/3086845058 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6274037070 con 0x7f627c073120 2024-09-11T23:22:45.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.021+0000 7f6279600640 1 -- 172.21.15.144:0/3086845058 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6274032440 con 0x7f627c073120 2024-09-11T23:22:45.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.021+0000 7f6279600640 1 -- 172.21.15.144:0/3086845058 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6274032810 con 0x7f627c073120 2024-09-11T23:22:45.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.021+0000 7f6281800640 1 -- 172.21.15.144:0/3086845058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f627c073120 msgr2=0x7f627c073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:45.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.021+0000 7f6281800640 1 --2- 172.21.15.144:0/3086845058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f627c073120 0x7f627c073570 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f627c06cc10 tx=0x7f627402a200 comp rx=0 tx=0).stop 2024-09-11T23:22:45.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.021+0000 7f6281800640 1 -- 172.21.15.144:0/3086845058 shutdown_connections 2024-09-11T23:22:45.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.021+0000 7f6281800640 1 --2- 172.21.15.144:0/3086845058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f627c073120 0x7f627c073570 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.021+0000 7f6281800640 1 --2- 172.21.15.144:0/3086845058 >> v2:172.21.15.165:3300/0 conn(0x7f627c15c180 0x7f627c0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.021+0000 7f6281800640 1 -- 172.21.15.144:0/3086845058 >> 172.21.15.144:0/3086845058 conn(0x7f627c062cc0 msgr2=0x7f627c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:45.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.021+0000 7f6281800640 1 -- 172.21.15.144:0/3086845058 shutdown_connections 2024-09-11T23:22:45.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.021+0000 7f6281800640 1 -- 172.21.15.144:0/3086845058 wait complete. 2024-09-11T23:22:45.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.023+0000 7f6281800640 1 Processor -- start 2024-09-11T23:22:45.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.023+0000 7f6281800640 1 -- start start 2024-09-11T23:22:45.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.024+0000 7f6281800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f627c073120 0x7f627c0b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:45.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.024+0000 7f6281800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f627c0ce230 0x7f627c1505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:45.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.024+0000 7f6281800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f627c15c180 0x7f627c150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:45.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.024+0000 7f6281800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f627c0cf780 con 0x7f627c073120 2024-09-11T23:22:45.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.024+0000 7f6281800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f627c0722f0 con 0x7f627c15c180 2024-09-11T23:22:45.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.024+0000 7f6281800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f627c15c560 con 0x7f627c0ce230 2024-09-11T23:22:45.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.024+0000 7f627aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f627c073120 0x7f627c0b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:45.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.024+0000 7f627aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f627c073120 0x7f627c0b3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43374/0 (socket says 172.21.15.144:43374) 2024-09-11T23:22:45.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.024+0000 7f627aa00640 1 -- 172.21.15.144:0/702224534 learned_addr learned my addr 172.21.15.144:0/702224534 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:45.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.024+0000 7f627b400640 1 --2- 172.21.15.144:0/702224534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f627c15c180 0x7f627c150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:45.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.024+0000 7f627a000640 1 --2- 172.21.15.144:0/702224534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f627c0ce230 0x7f627c1505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:45.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.024+0000 7f627aa00640 1 -- 172.21.15.144:0/702224534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f627c0ce230 msgr2=0x7f627c1505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:45.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.024+0000 7f627aa00640 1 --2- 172.21.15.144:0/702224534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f627c0ce230 0x7f627c1505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.024+0000 7f627aa00640 1 -- 172.21.15.144:0/702224534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f627c15c180 msgr2=0x7f627c150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:45.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.024+0000 7f627aa00640 1 --2- 172.21.15.144:0/702224534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f627c15c180 0x7f627c150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.024+0000 7f627aa00640 1 -- 172.21.15.144:0/702224534 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f627c0af780 con 0x7f627c073120 2024-09-11T23:22:45.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.024+0000 7f627a000640 1 --2- 172.21.15.144:0/702224534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f627c0ce230 0x7f627c1505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:22:45.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.025+0000 7f627aa00640 1 --2- 172.21.15.144:0/702224534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f627c073120 0x7f627c0b3c70 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f626c009fc0 tx=0x7f626c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:45.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.025+0000 7f6272a00640 1 -- 172.21.15.144:0/702224534 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c01a070 con 0x7f627c073120 2024-09-11T23:22:45.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.025+0000 7f6272a00640 1 -- 172.21.15.144:0/702224534 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f626c003b90 con 0x7f627c073120 2024-09-11T23:22:45.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.025+0000 7f6281800640 1 -- 172.21.15.144:0/702224534 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f627c15eb20 con 0x7f627c073120 2024-09-11T23:22:45.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.025+0000 7f6272a00640 1 -- 172.21.15.144:0/702224534 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c004030 con 0x7f627c073120 2024-09-11T23:22:45.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.025+0000 7f6281800640 1 -- 172.21.15.144:0/702224534 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f627c15f0e0 con 0x7f627c073120 2024-09-11T23:22:45.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.026+0000 7f6281800640 1 -- 172.21.15.144:0/702224534 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f627c06f0c0 con 0x7f627c073120 2024-09-11T23:22:45.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.027+0000 7f6272a00640 1 -- 172.21.15.144:0/702224534 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f626c01d070 con 0x7f627c073120 2024-09-11T23:22:45.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.028+0000 7f6272a00640 1 --2- 172.21.15.144:0/702224534 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f625c06bf50 0x7f625c06e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:45.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.028+0000 7f6272a00640 1 -- 172.21.15.144:0/702224534 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f626c08b380 con 0x7f627c073120 2024-09-11T23:22:45.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.029+0000 7f627a000640 1 --2- 172.21.15.144:0/702224534 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f625c06bf50 0x7f625c06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:45.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.029+0000 7f627a000640 1 --2- 172.21.15.144:0/702224534 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f625c06bf50 0x7f625c06e410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f627c1573e0 tx=0x7f6268009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:45.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.033+0000 7f6272a00640 1 -- 172.21.15.144:0/702224534 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f627c06f0c0 con 0x7f627c073120 2024-09-11T23:22:45.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.226+0000 7f6281800640 1 -- 172.21.15.144:0/702224534 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f627c15e8d0 con 0x7f625c06bf50 2024-09-11T23:22:45.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.228+0000 7f6272a00640 1 -- 172.21.15.144:0/702224534 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f627c15e8d0 con 0x7f625c06bf50 2024-09-11T23:22:45.228 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:22:45.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:22:45.228 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephfs" 2024-09-11T23:22:45.228 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:22:45.228 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:22:45.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.230+0000 7f6281800640 1 -- 172.21.15.144:0/702224534 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f625c06bf50 msgr2=0x7f625c06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:45.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.230+0000 7f6281800640 1 --2- 172.21.15.144:0/702224534 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f625c06bf50 0x7f625c06e410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f627c1573e0 tx=0x7f6268009040 comp rx=0 tx=0).stop 2024-09-11T23:22:45.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.230+0000 7f6281800640 1 -- 172.21.15.144:0/702224534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f627c073120 msgr2=0x7f627c0b3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:45.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.230+0000 7f6281800640 1 --2- 172.21.15.144:0/702224534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f627c073120 0x7f627c0b3c70 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f626c009fc0 tx=0x7f626c00d560 comp rx=0 tx=0).stop 2024-09-11T23:22:45.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.230+0000 7f6281800640 1 -- 172.21.15.144:0/702224534 shutdown_connections 2024-09-11T23:22:45.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.230+0000 7f6281800640 1 --2- 172.21.15.144:0/702224534 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f625c06bf50 0x7f625c06e410 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.230+0000 7f6281800640 1 --2- 172.21.15.144:0/702224534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f627c15c180 0x7f627c150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.230+0000 7f6281800640 1 --2- 172.21.15.144:0/702224534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f627c0ce230 0x7f627c1505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.230+0000 7f6281800640 1 --2- 172.21.15.144:0/702224534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f627c073120 0x7f627c0b3c70 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.230+0000 7f6281800640 1 -- 172.21.15.144:0/702224534 >> 172.21.15.144:0/702224534 conn(0x7f627c062cc0 msgr2=0x7f627c159be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:45.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.230+0000 7f6281800640 1 -- 172.21.15.144:0/702224534 shutdown_connections 2024-09-11T23:22:45.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.230+0000 7f6281800640 1 -- 172.21.15.144:0/702224534 wait complete. 2024-09-11T23:22:45.246 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:22:45.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.404+0000 7f0ebb400640 1 Processor -- start 2024-09-11T23:22:45.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.404+0000 7f0ebb400640 1 -- start start 2024-09-11T23:22:45.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.405+0000 7f0ebb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0eb40b5590 0x7f0eb40d23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:45.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.405+0000 7f0ebb400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0eb40d28f0 0x7f0eb406dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:45.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.405+0000 7f0ebb400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eb40d2d80 con 0x7f0eb415e950 2024-09-11T23:22:45.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.405+0000 7f0ebb400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0eb415ed30 con 0x7f0eb40d28f0 2024-09-11T23:22:45.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.405+0000 7f0ebb400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0eb40d0f40 con 0x7f0eb40b5590 2024-09-11T23:22:45.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.405+0000 7f0eb8a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0eb415e950 0x7f0eb40d04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41050/0 (socket says 172.21.15.144:41050) 2024-09-11T23:22:45.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.405+0000 7f0eb8a00640 1 -- 172.21.15.144:0/2987403911 learned_addr learned my addr 172.21.15.144:0/2987403911 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:45.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.406+0000 7f0eb9400640 1 --2- 172.21.15.144:0/2987403911 >> v2:172.21.15.165:3300/0 conn(0x7f0eb40d28f0 0x7f0eb406dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:45.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.406+0000 7f0eabe00640 1 --2- 172.21.15.144:0/2987403911 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0eb40b5590 0x7f0eb40d23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:45.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.406+0000 7f0eb3e00640 1 -- 172.21.15.144:0/2987403911 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1802175147 0 0) 0x7f0eb40d2d80 con 0x7f0eb415e950 2024-09-11T23:22:45.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.406+0000 7f0eb3e00640 1 -- 172.21.15.144:0/2987403911 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e98003520 con 0x7f0eb415e950 2024-09-11T23:22:45.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.406+0000 7f0eb9400640 1 -- 172.21.15.144:0/2987403911 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0eb40b5590 msgr2=0x7f0eb40d23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:45.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.406+0000 7f0eb9400640 1 --2- 172.21.15.144:0/2987403911 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0eb40b5590 0x7f0eb40d23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.406+0000 7f0eb9400640 1 -- 172.21.15.144:0/2987403911 >> v1:172.21.15.144:6789/0 conn(0x7f0eb415e950 legacy=0x7f0eb40d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:45.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.406+0000 7f0eb9400640 1 -- 172.21.15.144:0/2987403911 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb40d1220 con 0x7f0eb40d28f0 2024-09-11T23:22:45.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.407+0000 7f0eb9400640 1 --2- 172.21.15.144:0/2987403911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0eb40d28f0 0x7f0eb406dc20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0eac009d90 tx=0x7f0eac02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7de477364d38bae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:45.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.408+0000 7f0eb3e00640 1 -- 172.21.15.144:0/2987403911 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eac035020 con 0x7f0eb40d28f0 2024-09-11T23:22:45.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.408+0000 7f0eb3e00640 1 -- 172.21.15.144:0/2987403911 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eac007540 con 0x7f0eb40d28f0 2024-09-11T23:22:45.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.408+0000 7f0eb3e00640 1 -- 172.21.15.144:0/2987403911 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4001670 con 0x7f0eb40d28f0 2024-09-11T23:22:45.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.408+0000 7f0ebb400640 1 -- 172.21.15.144:0/2987403911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0eb40d28f0 msgr2=0x7f0eb406dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:45.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.408+0000 7f0ebb400640 1 --2- 172.21.15.144:0/2987403911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0eb40d28f0 0x7f0eb406dc20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0eac009d90 tx=0x7f0eac02a5d0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.408+0000 7f0ebb400640 1 -- 172.21.15.144:0/2987403911 shutdown_connections 2024-09-11T23:22:45.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.408+0000 7f0ebb400640 1 --2- 172.21.15.144:0/2987403911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0eb40d28f0 0x7f0eb406dc20 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.408+0000 7f0ebb400640 1 --2- 172.21.15.144:0/2987403911 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0eb40b5590 0x7f0eb40d23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.408+0000 7f0ebb400640 1 -- 172.21.15.144:0/2987403911 >> 172.21.15.144:0/2987403911 conn(0x7f0eb406f310 msgr2=0x7f0eb406f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:45.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.408+0000 7f0ebb400640 1 -- 172.21.15.144:0/2987403911 shutdown_connections 2024-09-11T23:22:45.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.408+0000 7f0ebb400640 1 -- 172.21.15.144:0/2987403911 wait complete. 2024-09-11T23:22:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.410+0000 7f0ebb400640 1 Processor -- start 2024-09-11T23:22:45.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.410+0000 7f0ebb400640 1 -- start start 2024-09-11T23:22:45.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.411+0000 7f0ebb400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0eb40b5590 0x7f0eb415fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:45.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.411+0000 7f0ebb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0eb40d28f0 0x7f0eb414c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:45.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.411+0000 7f0ebb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0eb415e950 0x7f0eb415aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:45.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.411+0000 7f0ebb400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb40b59b0 con 0x7f0eb40d28f0 2024-09-11T23:22:45.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.411+0000 7f0ebb400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb406d700 con 0x7f0eb40b5590 2024-09-11T23:22:45.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.411+0000 7f0ebb400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0eb40cf410 con 0x7f0eb415e950 2024-09-11T23:22:45.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.411+0000 7f0eabe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0eb40d28f0 0x7f0eb414c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:45.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.411+0000 7f0eabe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0eb40d28f0 0x7f0eb414c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43378/0 (socket says 172.21.15.144:43378) 2024-09-11T23:22:45.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.411+0000 7f0eabe00640 1 -- 172.21.15.144:0/2403856395 learned_addr learned my addr 172.21.15.144:0/2403856395 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:45.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.411+0000 7f0eb9400640 1 --2- 172.21.15.144:0/2403856395 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0eb415e950 0x7f0eb415aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:45.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.411+0000 7f0eb8a00640 1 --2- 172.21.15.144:0/2403856395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0eb40b5590 0x7f0eb415fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:45.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.411+0000 7f0eabe00640 1 -- 172.21.15.144:0/2403856395 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0eb415e950 msgr2=0x7f0eb415aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:45.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.411+0000 7f0eabe00640 1 --2- 172.21.15.144:0/2403856395 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0eb415e950 0x7f0eb415aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.412+0000 7f0eabe00640 1 -- 172.21.15.144:0/2403856395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0eb40b5590 msgr2=0x7f0eb415fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:45.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.412+0000 7f0eabe00640 1 --2- 172.21.15.144:0/2403856395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0eb40b5590 0x7f0eb415fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.412+0000 7f0eabe00640 1 -- 172.21.15.144:0/2403856395 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb414fb80 con 0x7f0eb40d28f0 2024-09-11T23:22:45.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.412+0000 7f0eabe00640 1 --2- 172.21.15.144:0/2403856395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0eb40d28f0 0x7f0eb414c200 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00e870 tx=0x7f0e9c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:45.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.412+0000 7f0eb1600640 1 -- 172.21.15.144:0/2403856395 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c017070 con 0x7f0eb40d28f0 2024-09-11T23:22:45.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.412+0000 7f0eb1600640 1 -- 172.21.15.144:0/2403856395 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e9c00c940 con 0x7f0eb40d28f0 2024-09-11T23:22:45.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.412+0000 7f0eb1600640 1 -- 172.21.15.144:0/2403856395 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c00cd30 con 0x7f0eb40d28f0 2024-09-11T23:22:45.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.412+0000 7f0ebb400640 1 -- 172.21.15.144:0/2403856395 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eb415f090 con 0x7f0eb40d28f0 2024-09-11T23:22:45.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.412+0000 7f0ebb400640 1 -- 172.21.15.144:0/2403856395 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eb414f830 con 0x7f0eb40d28f0 2024-09-11T23:22:45.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.413+0000 7f0ebb400640 1 -- 172.21.15.144:0/2403856395 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eb40d3350 con 0x7f0eb40d28f0 2024-09-11T23:22:45.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.414+0000 7f0eb1600640 1 -- 172.21.15.144:0/2403856395 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f0e9c01a070 con 0x7f0eb40d28f0 2024-09-11T23:22:45.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.415+0000 7f0eb1600640 1 --2- 172.21.15.144:0/2403856395 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0e9006bf50 0x7f0e9006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:45.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.415+0000 7f0eb1600640 1 -- 172.21.15.144:0/2403856395 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f0e9c08b2d0 con 0x7f0eb40d28f0 2024-09-11T23:22:45.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.416+0000 7f0eb8a00640 1 --2- 172.21.15.144:0/2403856395 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0e9006bf50 0x7f0e9006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:45.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.416+0000 7f0eb8a00640 1 --2- 172.21.15.144:0/2403856395 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0e9006bf50 0x7f0e9006e410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4001eb0 tx=0x7f0ea4001710 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:45.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.419+0000 7f0eb1600640 1 -- 172.21.15.144:0/2403856395 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0eb40d3350 con 0x7f0eb40d28f0 2024-09-11T23:22:45.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.595+0000 7f0ebb400640 1 -- 172.21.15.144:0/2403856395 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0eb415c570 con 0x7f0eb40d28f0 2024-09-11T23:22:45.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.595+0000 7f0eb1600640 1 -- 172.21.15.144:0/2403856395 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f0eb415c570 con 0x7f0eb40d28f0 2024-09-11T23:22:45.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.597+0000 7f0ebb400640 1 -- 172.21.15.144:0/2403856395 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0e9006bf50 msgr2=0x7f0e9006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:45.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.597+0000 7f0ebb400640 1 --2- 172.21.15.144:0/2403856395 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0e9006bf50 0x7f0e9006e410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4001eb0 tx=0x7f0ea4001710 comp rx=0 tx=0).stop 2024-09-11T23:22:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.597+0000 7f0ebb400640 1 -- 172.21.15.144:0/2403856395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0eb40d28f0 msgr2=0x7f0eb414c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.597+0000 7f0ebb400640 1 --2- 172.21.15.144:0/2403856395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0eb40d28f0 0x7f0eb414c200 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00e870 tx=0x7f0e9c00ed30 comp rx=0 tx=0).stop 2024-09-11T23:22:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.598+0000 7f0ebb400640 1 -- 172.21.15.144:0/2403856395 shutdown_connections 2024-09-11T23:22:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.598+0000 7f0ebb400640 1 --2- 172.21.15.144:0/2403856395 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0e9006bf50 0x7f0e9006e410 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.598+0000 7f0ebb400640 1 --2- 172.21.15.144:0/2403856395 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0eb415e950 0x7f0eb415aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.598+0000 7f0ebb400640 1 --2- 172.21.15.144:0/2403856395 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0eb40d28f0 0x7f0eb414c200 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.598+0000 7f0ebb400640 1 --2- 172.21.15.144:0/2403856395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0eb40b5590 0x7f0eb415fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.598+0000 7f0ebb400640 1 -- 172.21.15.144:0/2403856395 >> 172.21.15.144:0/2403856395 conn(0x7f0eb406f310 msgr2=0x7f0eb415dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.598+0000 7f0ebb400640 1 -- 172.21.15.144:0/2403856395 shutdown_connections 2024-09-11T23:22:45.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.598+0000 7f0ebb400640 1 -- 172.21.15.144:0/2403856395 wait complete. 2024-09-11T23:22:45.614 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create 'abcd@#' 2024-09-11T23:22:45.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.771+0000 7f813ea00640 1 Processor -- start 2024-09-11T23:22:45.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.771+0000 7f813ea00640 1 -- start start 2024-09-11T23:22:45.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.772+0000 7f813ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f813815e660 0x7f81380d3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:45.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.772+0000 7f813ea00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f81380b9550 0x7f81380d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:45.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.772+0000 7f813ea00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81380d0ea0 con 0x7f81380d40e0 2024-09-11T23:22:45.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.772+0000 7f813ea00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f81380d1180 con 0x7f813815e660 2024-09-11T23:22:45.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.772+0000 7f813ea00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f81380d1460 con 0x7f81380b9550 2024-09-11T23:22:45.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.772+0000 7f813d600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f813815e660 0x7f81380d3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:45.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.773+0000 7f813d600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f813815e660 0x7f81380d3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43388/0 (socket says 172.21.15.144:43388) 2024-09-11T23:22:45.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.773+0000 7f813d600640 1 -- 172.21.15.144:0/4013193064 learned_addr learned my addr 172.21.15.144:0/4013193064 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:45.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.773+0000 7f813cc00640 1 --2- 172.21.15.144:0/4013193064 >> v2:172.21.15.165:3300/0 conn(0x7f81380b9550 0x7f81380d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:45.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.773+0000 7f813d600640 1 -- 172.21.15.144:0/4013193064 >> v2:172.21.15.165:3300/0 conn(0x7f81380b9550 msgr2=0x7f81380d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:45.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.773+0000 7f813d600640 1 --2- 172.21.15.144:0/4013193064 >> v2:172.21.15.165:3300/0 conn(0x7f81380b9550 0x7f81380d1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.773+0000 7f813d600640 1 -- 172.21.15.144:0/4013193064 >> v1:172.21.15.144:6789/0 conn(0x7f81380d40e0 legacy=0x7f813806d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:45.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.773+0000 7f813d600640 1 -- 172.21.15.144:0/4013193064 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81380d1740 con 0x7f813815e660 2024-09-11T23:22:45.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.773+0000 7f8137e00640 1 -- 172.21.15.144:0/4013193064 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 237008942 0 0) 0x7f81380d0ea0 con 0x7f81380d40e0 2024-09-11T23:22:45.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.773+0000 7f813cc00640 1 --2- 172.21.15.144:0/4013193064 >> v2:172.21.15.165:3300/0 conn(0x7f81380b9550 0x7f81380d1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:45.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.774+0000 7f813d600640 1 --2- 172.21.15.144:0/4013193064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f813815e660 0x7f81380d3ba0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f813808da30 tx=0x7f812c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759b3fc77085470c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.774+0000 7f8137e00640 1 -- 172.21.15.144:0/4013193064 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c037070 con 0x7f813815e660 2024-09-11T23:22:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.774+0000 7f8137e00640 1 -- 172.21.15.144:0/4013193064 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f812c032440 con 0x7f813815e660 2024-09-11T23:22:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.774+0000 7f8137e00640 1 -- 172.21.15.144:0/4013193064 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c032810 con 0x7f813815e660 2024-09-11T23:22:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.775+0000 7f813ea00640 1 -- 172.21.15.144:0/4013193064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f813815e660 msgr2=0x7f81380d3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.775+0000 7f813ea00640 1 --2- 172.21.15.144:0/4013193064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f813815e660 0x7f81380d3ba0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f813808da30 tx=0x7f812c02a1e0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.775+0000 7f813ea00640 1 -- 172.21.15.144:0/4013193064 shutdown_connections 2024-09-11T23:22:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.775+0000 7f813ea00640 1 --2- 172.21.15.144:0/4013193064 >> v2:172.21.15.165:3300/0 conn(0x7f81380b9550 0x7f81380d1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.775+0000 7f813ea00640 1 --2- 172.21.15.144:0/4013193064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f813815e660 0x7f81380d3ba0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.775+0000 7f813ea00640 1 -- 172.21.15.144:0/4013193064 >> 172.21.15.144:0/4013193064 conn(0x7f81380d47a0 msgr2=0x7f81380d4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.775+0000 7f813ea00640 1 -- 172.21.15.144:0/4013193064 shutdown_connections 2024-09-11T23:22:45.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.775+0000 7f813ea00640 1 -- 172.21.15.144:0/4013193064 wait complete. 2024-09-11T23:22:45.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.776+0000 7f813ea00640 1 Processor -- start 2024-09-11T23:22:45.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.777+0000 7f813ea00640 1 -- start start 2024-09-11T23:22:45.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.777+0000 7f813ea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81380b9550 0x7f81381559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.777+0000 7f813ea00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81380d40e0 0x7f8138147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.777+0000 7f813ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f813815e660 0x7f8138158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.777+0000 7f813ea00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f813806dd80 con 0x7f813815e660 2024-09-11T23:22:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.777+0000 7f813ea00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f813806dc00 con 0x7f81380d40e0 2024-09-11T23:22:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.777+0000 7f813ea00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f81380d2480 con 0x7f81380b9550 2024-09-11T23:22:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.778+0000 7f813e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f813815e660 0x7f8138158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.778+0000 7f813e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f813815e660 0x7f8138158390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43398/0 (socket says 172.21.15.144:43398) 2024-09-11T23:22:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.778+0000 7f813e000640 1 -- 172.21.15.144:0/4005820114 learned_addr learned my addr 172.21.15.144:0/4005820114 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.778+0000 7f813cc00640 1 --2- 172.21.15.144:0/4005820114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81380d40e0 0x7f8138147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.778+0000 7f813d600640 1 --2- 172.21.15.144:0/4005820114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81380b9550 0x7f81381559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.778+0000 7f813e000640 1 -- 172.21.15.144:0/4005820114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81380b9550 msgr2=0x7f81381559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.778+0000 7f813e000640 1 --2- 172.21.15.144:0/4005820114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81380b9550 0x7f81381559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.778+0000 7f813e000640 1 -- 172.21.15.144:0/4005820114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81380d40e0 msgr2=0x7f8138147cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:45.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.778+0000 7f813e000640 1 --2- 172.21.15.144:0/4005820114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81380d40e0 0x7f8138147cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:45.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.778+0000 7f813e000640 1 -- 172.21.15.144:0/4005820114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8138153920 con 0x7f813815e660 2024-09-11T23:22:45.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.778+0000 7f813d600640 1 --2- 172.21.15.144:0/4005820114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81380b9550 0x7f81381559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:45.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.778+0000 7f813e000640 1 --2- 172.21.15.144:0/4005820114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f813815e660 0x7f8138158390 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f813000c730 tx=0x7f813000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:45.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.779+0000 7f8135600640 1 -- 172.21.15.144:0/4005820114 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130003da0 con 0x7f813815e660 2024-09-11T23:22:45.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.779+0000 7f8135600640 1 -- 172.21.15.144:0/4005820114 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f813000ce40 con 0x7f813815e660 2024-09-11T23:22:45.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.779+0000 7f8135600640 1 -- 172.21.15.144:0/4005820114 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81300052b0 con 0x7f813815e660 2024-09-11T23:22:45.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.779+0000 7f813ea00640 1 -- 172.21.15.144:0/4005820114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8138153c00 con 0x7f813815e660 2024-09-11T23:22:45.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.779+0000 7f813ea00640 1 -- 172.21.15.144:0/4005820114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81381541c0 con 0x7f813815e660 2024-09-11T23:22:45.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.780+0000 7f813ea00640 1 -- 172.21.15.144:0/4005820114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81380d1f40 con 0x7f813815e660 2024-09-11T23:22:45.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.781+0000 7f8135600640 1 -- 172.21.15.144:0/4005820114 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f8130005450 con 0x7f813815e660 2024-09-11T23:22:45.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.782+0000 7f8135600640 1 --2- 172.21.15.144:0/4005820114 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f811806bf80 0x7f811806e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:45.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.782+0000 7f8135600640 1 -- 172.21.15.144:0/4005820114 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f813008aef0 con 0x7f813815e660 2024-09-11T23:22:45.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.783+0000 7f813d600640 1 --2- 172.21.15.144:0/4005820114 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f811806bf80 0x7f811806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:45.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.783+0000 7f813d600640 1 --2- 172.21.15.144:0/4005820114 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f811806bf80 0x7f811806e440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f812c034000 tx=0x7f812c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:45.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:45.786+0000 7f8135600640 1 -- 172.21.15.144:0/4005820114 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f81300596f0 con 0x7f813815e660 2024-09-11T23:22:45.990 INFO:teuthology.orchestra.run.smithi144.stderr:Invalid command: invalid chars @# in abcd@# 2024-09-11T23:22:45.990 INFO:teuthology.orchestra.run.smithi144.stderr:fs volume create [] : Create a CephFS volume 2024-09-11T23:22:45.990 INFO:teuthology.orchestra.run.smithi144.stderr:Error EINVAL: invalid command 2024-09-11T23:22:45.997 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T23:22:45.998 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create testvol 2024-09-11T23:22:46.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.154+0000 7fd501a00640 1 Processor -- start 2024-09-11T23:22:46.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.154+0000 7fd501a00640 1 -- start start 2024-09-11T23:22:46.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.155+0000 7fd501a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd4fc0ccd90 0x7fd4fc06cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:46.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.155+0000 7fd501a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4fc0cd250 con 0x7fd4fc06d4f0 2024-09-11T23:22:46.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.155+0000 7fd501a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4fc0cd530 con 0x7fd4fc158e00 2024-09-11T23:22:46.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.155+0000 7fd501a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd4fc1591e0 con 0x7fd4fc0ccd90 2024-09-11T23:22:46.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.156+0000 7fd4fb400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd4fc06d4f0 0x7fd4fc0aecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41060/0 (socket says 172.21.15.144:41060) 2024-09-11T23:22:46.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.156+0000 7fd4fb400640 1 -- 172.21.15.144:0/2861551438 learned_addr learned my addr 172.21.15.144:0/2861551438 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:46.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.156+0000 7fd4fa000640 1 --2- 172.21.15.144:0/2861551438 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd4fc0ccd90 0x7fd4fc06cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:46.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.156+0000 7fd4f9600640 1 -- 172.21.15.144:0/2861551438 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 660467405 0 0) 0x7fd4fc0cd250 con 0x7fd4fc06d4f0 2024-09-11T23:22:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.156+0000 7fd4f9600640 1 -- 172.21.15.144:0/2861551438 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4e0003520 con 0x7fd4fc06d4f0 2024-09-11T23:22:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.156+0000 7fd4f9600640 1 -- 172.21.15.144:0/2861551438 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 412875567 0 0) 0x7fd4fc0cd530 con 0x7fd4fc158e00 2024-09-11T23:22:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.156+0000 7fd4f9600640 1 -- 172.21.15.144:0/2861551438 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4fc0cd250 con 0x7fd4fc158e00 2024-09-11T23:22:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.156+0000 7fd4fa000640 1 -- 172.21.15.144:0/2861551438 >> v1:172.21.15.165:6789/0 conn(0x7fd4fc158e00 legacy=0x7fd4fc15f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.156+0000 7fd4fa000640 1 -- 172.21.15.144:0/2861551438 >> v1:172.21.15.144:6789/0 conn(0x7fd4fc06d4f0 legacy=0x7fd4fc0aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:46.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.156+0000 7fd4fa000640 1 -- 172.21.15.144:0/2861551438 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4fc0cd810 con 0x7fd4fc0ccd90 2024-09-11T23:22:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.157+0000 7fd4fa000640 1 --2- 172.21.15.144:0/2861551438 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd4fc0ccd90 0x7fd4fc06cfb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80097d0 tx=0x7fd4e802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3758e5c27d47fcb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.158+0000 7fd4f9600640 1 -- 172.21.15.144:0/2861551438 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8037070 con 0x7fd4fc0ccd90 2024-09-11T23:22:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.158+0000 7fd4f9600640 1 -- 172.21.15.144:0/2861551438 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e8032440 con 0x7fd4fc0ccd90 2024-09-11T23:22:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.158+0000 7fd4f9600640 1 -- 172.21.15.144:0/2861551438 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8032810 con 0x7fd4fc0ccd90 2024-09-11T23:22:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.158+0000 7fd501a00640 1 -- 172.21.15.144:0/2861551438 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd4fc0ccd90 msgr2=0x7fd4fc06cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.158+0000 7fd501a00640 1 --2- 172.21.15.144:0/2861551438 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd4fc0ccd90 0x7fd4fc06cfb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80097d0 tx=0x7fd4e802a210 comp rx=0 tx=0).stop 2024-09-11T23:22:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.158+0000 7fd501a00640 1 -- 172.21.15.144:0/2861551438 shutdown_connections 2024-09-11T23:22:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.158+0000 7fd501a00640 1 --2- 172.21.15.144:0/2861551438 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd4fc0ccd90 0x7fd4fc06cfb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:46.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.158+0000 7fd501a00640 1 -- 172.21.15.144:0/2861551438 >> 172.21.15.144:0/2861551438 conn(0x7fd4fc062c60 msgr2=0x7fd4fc06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:46.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.158+0000 7fd501a00640 1 -- 172.21.15.144:0/2861551438 shutdown_connections 2024-09-11T23:22:46.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.158+0000 7fd501a00640 1 -- 172.21.15.144:0/2861551438 wait complete. 2024-09-11T23:22:46.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.160+0000 7fd501a00640 1 Processor -- start 2024-09-11T23:22:46.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.160+0000 7fd501a00640 1 -- start start 2024-09-11T23:22:46.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.161+0000 7fd501a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd4fc06d4f0 0x7fd4fc14c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:46.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.161+0000 7fd501a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4fc0ccd90 0x7fd4fc14cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:46.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.161+0000 7fd501a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd4fc158e00 0x7fd4fc1e8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:46.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.161+0000 7fd501a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd4fc0b36b0 con 0x7fd4fc0ccd90 2024-09-11T23:22:46.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.161+0000 7fd501a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd4fc0af3d0 con 0x7fd4fc06d4f0 2024-09-11T23:22:46.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.161+0000 7fd501a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd4fc155000 con 0x7fd4fc158e00 2024-09-11T23:22:46.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.161+0000 7fd4fa000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4fc0ccd90 0x7fd4fc14cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:46.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.161+0000 7fd4fa000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4fc0ccd90 0x7fd4fc14cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43406/0 (socket says 172.21.15.144:43406) 2024-09-11T23:22:46.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.161+0000 7fd4fa000640 1 -- 172.21.15.144:0/3766726521 learned_addr learned my addr 172.21.15.144:0/3766726521 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:46.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.162+0000 7fd4faa00640 1 --2- 172.21.15.144:0/3766726521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd4fc06d4f0 0x7fd4fc14c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:46.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.162+0000 7fd4fb400640 1 --2- 172.21.15.144:0/3766726521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd4fc158e00 0x7fd4fc1e8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:46.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.162+0000 7fd4fa000640 1 -- 172.21.15.144:0/3766726521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd4fc158e00 msgr2=0x7fd4fc1e8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:46.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.162+0000 7fd4fa000640 1 --2- 172.21.15.144:0/3766726521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd4fc158e00 0x7fd4fc1e8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:46.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.162+0000 7fd4fa000640 1 -- 172.21.15.144:0/3766726521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd4fc06d4f0 msgr2=0x7fd4fc14c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:46.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.162+0000 7fd4fa000640 1 --2- 172.21.15.144:0/3766726521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd4fc06d4f0 0x7fd4fc14c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:46.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.162+0000 7fd4fa000640 1 -- 172.21.15.144:0/3766726521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4fc14e2c0 con 0x7fd4fc0ccd90 2024-09-11T23:22:46.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.162+0000 7fd4faa00640 1 --2- 172.21.15.144:0/3766726521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd4fc06d4f0 0x7fd4fc14c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:22:46.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.162+0000 7fd4fb400640 1 --2- 172.21.15.144:0/3766726521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd4fc158e00 0x7fd4fc1e8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:22:46.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.162+0000 7fd4fa000640 1 --2- 172.21.15.144:0/3766726521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4fc0ccd90 0x7fd4fc14cfa0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80098f0 tx=0x7fd4e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:46.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.162+0000 7fd4f2a00640 1 -- 172.21.15.144:0/3766726521 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8041020 con 0x7fd4fc0ccd90 2024-09-11T23:22:46.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.162+0000 7fd4f2a00640 1 -- 172.21.15.144:0/3766726521 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e803d6e0 con 0x7fd4fc0ccd90 2024-09-11T23:22:46.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.162+0000 7fd4f2a00640 1 -- 172.21.15.144:0/3766726521 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8037040 con 0x7fd4fc0ccd90 2024-09-11T23:22:46.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.162+0000 7fd501a00640 1 -- 172.21.15.144:0/3766726521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4fc14da20 con 0x7fd4fc0ccd90 2024-09-11T23:22:46.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.162+0000 7fd501a00640 1 -- 172.21.15.144:0/3766726521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4fc14dfe0 con 0x7fd4fc0ccd90 2024-09-11T23:22:46.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.163+0000 7fd501a00640 1 -- 172.21.15.144:0/3766726521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4fc06cfb0 con 0x7fd4fc0ccd90 2024-09-11T23:22:46.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.164+0000 7fd4f2a00640 1 -- 172.21.15.144:0/3766726521 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fd4e8044020 con 0x7fd4fc0ccd90 2024-09-11T23:22:46.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.165+0000 7fd4f2a00640 1 --2- 172.21.15.144:0/3766726521 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd4dc06bf50 0x7fd4dc06e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:46.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.165+0000 7fd4f2a00640 1 -- 172.21.15.144:0/3766726521 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fd4e80ab710 con 0x7fd4fc0ccd90 2024-09-11T23:22:46.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.166+0000 7fd4faa00640 1 --2- 172.21.15.144:0/3766726521 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd4dc06bf50 0x7fd4dc06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:46.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.166+0000 7fd4faa00640 1 --2- 172.21.15.144:0/3766726521 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd4dc06bf50 0x7fd4dc06e410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0011e0 tx=0x7fd4ec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:46.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.169+0000 7fd4f2a00640 1 -- 172.21.15.144:0/3766726521 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd4e804b030 con 0x7fd4fc0ccd90 2024-09-11T23:22:46.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:46.364+0000 7fd501a00640 1 -- 172.21.15.144:0/3766726521 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "testvol", "target": ["mon-mgr", ""]}) -- 0x7fd4fc1551b0 con 0x7fd4dc06bf50 2024-09-11T23:22:48.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:48.880+0000 7fd4f2a00640 1 -- 172.21.15.144:0/3766726521 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) ==== 60+0+0 (secure 0 0 0) 0x7fd4ec001c40 con 0x7fd4dc06bf50 2024-09-11T23:22:48.880 INFO:teuthology.orchestra.run.smithi144.stderr:Volume created successfully (no MDS daemons created) 2024-09-11T23:22:48.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:48.883+0000 7fd501a00640 1 -- 172.21.15.144:0/3766726521 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd4dc06bf50 msgr2=0x7fd4dc06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:48.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:48.883+0000 7fd501a00640 1 --2- 172.21.15.144:0/3766726521 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd4dc06bf50 0x7fd4dc06e410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0011e0 tx=0x7fd4ec009040 comp rx=0 tx=0).stop 2024-09-11T23:22:48.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:48.883+0000 7fd501a00640 1 -- 172.21.15.144:0/3766726521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4fc0ccd90 msgr2=0x7fd4fc14cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:48.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:48.883+0000 7fd501a00640 1 --2- 172.21.15.144:0/3766726521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4fc0ccd90 0x7fd4fc14cfa0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80098f0 tx=0x7fd4e80046c0 comp rx=0 tx=0).stop 2024-09-11T23:22:48.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:48.883+0000 7fd501a00640 1 -- 172.21.15.144:0/3766726521 shutdown_connections 2024-09-11T23:22:48.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:48.883+0000 7fd501a00640 1 --2- 172.21.15.144:0/3766726521 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd4dc06bf50 0x7fd4dc06e410 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:48.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:48.883+0000 7fd501a00640 1 --2- 172.21.15.144:0/3766726521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd4fc158e00 0x7fd4fc1e8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:48.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:48.883+0000 7fd501a00640 1 --2- 172.21.15.144:0/3766726521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4fc0ccd90 0x7fd4fc14cfa0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:48.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:48.883+0000 7fd501a00640 1 --2- 172.21.15.144:0/3766726521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd4fc06d4f0 0x7fd4fc14c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:48.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:48.883+0000 7fd501a00640 1 -- 172.21.15.144:0/3766726521 >> 172.21.15.144:0/3766726521 conn(0x7fd4fc062c60 msgr2=0x7fd4fc0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:48.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:48.883+0000 7fd501a00640 1 -- 172.21.15.144:0/3766726521 shutdown_connections 2024-09-11T23:22:48.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:48.883+0000 7fd501a00640 1 -- 172.21.15.144:0/3766726521 wait complete. 2024-09-11T23:22:48.907 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create testvol 'abcd@#' 2024-09-11T23:22:49.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.064+0000 7f05b0c00640 1 Processor -- start 2024-09-11T23:22:49.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.064+0000 7f05b0c00640 1 -- start start 2024-09-11T23:22:49.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.065+0000 7f05b0c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05ac0cf510 0x7f05ac0b7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:49.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.065+0000 7f05b0c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f05ac0b7bb0 0x7f05ac06d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:49.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.065+0000 7f05b0c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05ac15eaa0 con 0x7f05ac15e6c0 2024-09-11T23:22:49.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.065+0000 7f05b0c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f05ac0d34d0 con 0x7f05ac0b7bb0 2024-09-11T23:22:49.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.065+0000 7f05b0c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f05ac0d28c0 con 0x7f05ac0cf510 2024-09-11T23:22:49.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.065+0000 7f05abe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f05ac0b7bb0 0x7f05ac06d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:49.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.065+0000 7f05abe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f05ac0b7bb0 0x7f05ac06d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43408/0 (socket says 172.21.15.144:43408) 2024-09-11T23:22:49.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.065+0000 7f05abe00640 1 -- 172.21.15.144:0/1669240076 learned_addr learned my addr 172.21.15.144:0/1669240076 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:49.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.066+0000 7f05aaa00640 1 --2- 172.21.15.144:0/1669240076 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05ac0cf510 0x7f05ac0b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:49.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.066+0000 7f05abe00640 1 -- 172.21.15.144:0/1669240076 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05ac0cf510 msgr2=0x7f05ac0b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:49.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.066+0000 7f05abe00640 1 --2- 172.21.15.144:0/1669240076 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05ac0cf510 0x7f05ac0b7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:49.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.066+0000 7f05abe00640 1 -- 172.21.15.144:0/1669240076 >> v1:172.21.15.144:6789/0 conn(0x7f05ac15e6c0 legacy=0x7f05ac06c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:49.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.066+0000 7f05abe00640 1 -- 172.21.15.144:0/1669240076 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ac0d2ba0 con 0x7f05ac0b7bb0 2024-09-11T23:22:49.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.067+0000 7f05abe00640 1 --2- 172.21.15.144:0/1669240076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05ac0b7bb0 0x7f05ac06d610 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009e50 tx=0x7f05a402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21a8c3df172b5be server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:49.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.067+0000 7f05aa000640 1 -- 172.21.15.144:0/1669240076 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4036070 con 0x7f05ac0b7bb0 2024-09-11T23:22:49.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.067+0000 7f05aa000640 1 -- 172.21.15.144:0/1669240076 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05a4031600 con 0x7f05ac0b7bb0 2024-09-11T23:22:49.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.067+0000 7f05aa000640 1 -- 172.21.15.144:0/1669240076 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a40319d0 con 0x7f05ac0b7bb0 2024-09-11T23:22:49.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.067+0000 7f05b0c00640 1 -- 172.21.15.144:0/1669240076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05ac0b7bb0 msgr2=0x7f05ac06d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:49.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.067+0000 7f05b0c00640 1 --2- 172.21.15.144:0/1669240076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05ac0b7bb0 0x7f05ac06d610 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009e50 tx=0x7f05a402a7a0 comp rx=0 tx=0).stop 2024-09-11T23:22:49.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.068+0000 7f05b0c00640 1 -- 172.21.15.144:0/1669240076 shutdown_connections 2024-09-11T23:22:49.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.068+0000 7f05b0c00640 1 --2- 172.21.15.144:0/1669240076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05ac0b7bb0 0x7f05ac06d610 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:49.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.068+0000 7f05b0c00640 1 --2- 172.21.15.144:0/1669240076 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05ac0cf510 0x7f05ac0b7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:49.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.068+0000 7f05b0c00640 1 -- 172.21.15.144:0/1669240076 >> 172.21.15.144:0/1669240076 conn(0x7f05ac0d4720 msgr2=0x7f05ac0d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:49.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.068+0000 7f05b0c00640 1 -- 172.21.15.144:0/1669240076 shutdown_connections 2024-09-11T23:22:49.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.068+0000 7f05b0c00640 1 -- 172.21.15.144:0/1669240076 wait complete. 2024-09-11T23:22:49.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.069+0000 7f05b0c00640 1 Processor -- start 2024-09-11T23:22:49.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.069+0000 7f05b0c00640 1 -- start start 2024-09-11T23:22:49.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.070+0000 7f05b0c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05ac0b7bb0 0x7f05ac155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:49.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.070+0000 7f05b0c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05ac0cf510 0x7f05ac155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:49.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.070+0000 7f05b0c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05ac15e6c0 0x7f05ac0cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:49.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.070+0000 7f05b0c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac06db50 con 0x7f05ac0cf510 2024-09-11T23:22:49.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.070+0000 7f05b0c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac0d3160 con 0x7f05ac15e6c0 2024-09-11T23:22:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.070+0000 7f05b0c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f05ac06dcd0 con 0x7f05ac0b7bb0 2024-09-11T23:22:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.071+0000 7f05aaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05ac0cf510 0x7f05ac155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.071+0000 7f05aaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05ac0cf510 0x7f05ac155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43424/0 (socket says 172.21.15.144:43424) 2024-09-11T23:22:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.071+0000 7f05aaa00640 1 -- 172.21.15.144:0/1864804454 learned_addr learned my addr 172.21.15.144:0/1864804454 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.071+0000 7f05abe00640 1 --2- 172.21.15.144:0/1864804454 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05ac15e6c0 0x7f05ac0cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.071+0000 7f05ab400640 1 --2- 172.21.15.144:0/1864804454 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05ac0b7bb0 0x7f05ac155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.071+0000 7f05aaa00640 1 -- 172.21.15.144:0/1864804454 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05ac0b7bb0 msgr2=0x7f05ac155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.071+0000 7f05aaa00640 1 --2- 172.21.15.144:0/1864804454 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f05ac0b7bb0 0x7f05ac155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.071+0000 7f05aaa00640 1 -- 172.21.15.144:0/1864804454 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05ac15e6c0 msgr2=0x7f05ac0cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.071+0000 7f05aaa00640 1 --2- 172.21.15.144:0/1864804454 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05ac15e6c0 0x7f05ac0cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.071+0000 7f05aaa00640 1 -- 172.21.15.144:0/1864804454 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ac1558b0 con 0x7f05ac0cf510 2024-09-11T23:22:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.071+0000 7f05aaa00640 1 --2- 172.21.15.144:0/1864804454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05ac0cf510 0x7f05ac155b00 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f059800d830 tx=0x7f059800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:49.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.072+0000 7f05a3400640 1 -- 172.21.15.144:0/1864804454 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059800b6c0 con 0x7f05ac0cf510 2024-09-11T23:22:49.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.072+0000 7f05a3400640 1 -- 172.21.15.144:0/1864804454 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0598019070 con 0x7f05ac0cf510 2024-09-11T23:22:49.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.072+0000 7f05a3400640 1 -- 172.21.15.144:0/1864804454 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059800ba80 con 0x7f05ac0cf510 2024-09-11T23:22:49.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.072+0000 7f05b0c00640 1 -- 172.21.15.144:0/1864804454 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05ac1564e0 con 0x7f05ac0cf510 2024-09-11T23:22:49.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.072+0000 7f05b0c00640 1 -- 172.21.15.144:0/1864804454 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05ac156aa0 con 0x7f05ac0cf510 2024-09-11T23:22:49.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.073+0000 7f05b0c00640 1 -- 172.21.15.144:0/1864804454 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05ac06d610 con 0x7f05ac0cf510 2024-09-11T23:22:49.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.074+0000 7f05a3400640 1 -- 172.21.15.144:0/1864804454 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f059801e460 con 0x7f05ac0cf510 2024-09-11T23:22:49.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.075+0000 7f05a3400640 1 --2- 172.21.15.144:0/1864804454 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f058c06bf80 0x7f058c06e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:49.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.075+0000 7f05a3400640 1 -- 172.21.15.144:0/1864804454 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6543+0+0 (secure 0 0 0) 0x7f059808b8f0 con 0x7f05ac0cf510 2024-09-11T23:22:49.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.075+0000 7f05ab400640 1 --2- 172.21.15.144:0/1864804454 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f058c06bf80 0x7f058c06e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:49.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.076+0000 7f05ab400640 1 --2- 172.21.15.144:0/1864804454 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f058c06bf80 0x7f058c06e440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f059c0016e0 tx=0x7f059c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:49.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.080+0000 7f05a3400640 1 -- 172.21.15.144:0/1864804454 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0598059760 con 0x7f05ac0cf510 2024-09-11T23:22:49.275 INFO:teuthology.orchestra.run.smithi144.stderr:Invalid command: invalid chars #@ in abcd@# 2024-09-11T23:22:49.276 INFO:teuthology.orchestra.run.smithi144.stderr:fs subvolumegroup create [] [] [] [] [] : Create a CephFS subvolume group in a volume, and optionally, with a specific data pool layout, and a specific numeric mode 2024-09-11T23:22:49.276 INFO:teuthology.orchestra.run.smithi144.stderr:Error EINVAL: invalid command 2024-09-11T23:22:49.284 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T23:22:49.285 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create testvol 'abcd@#' 2024-09-11T23:22:49.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.441+0000 7faf5de00640 1 Processor -- start 2024-09-11T23:22:49.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.442+0000 7faf5de00640 1 -- start start 2024-09-11T23:22:49.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.443+0000 7faf5de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf5806f130 0x7faf580b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:49.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.443+0000 7faf5de00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf5815c820 con 0x7faf5815c370 2024-09-11T23:22:49.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.443+0000 7faf5de00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf580b43f0 con 0x7faf58158e50 2024-09-11T23:22:49.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.443+0000 7faf5de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faf580b3630 con 0x7faf5806f130 2024-09-11T23:22:49.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.443+0000 7faf57400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7faf5815c370 0x7faf580ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41086/0 (socket says 172.21.15.144:41086) 2024-09-11T23:22:49.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.443+0000 7faf57400640 1 -- 172.21.15.144:0/3982022771 learned_addr learned my addr 172.21.15.144:0/3982022771 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:49.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.443+0000 7faf4e000640 1 --2- 172.21.15.144:0/3982022771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf5806f130 0x7faf580b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:49.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.444+0000 7faf56000640 1 -- 172.21.15.144:0/3982022771 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 576502772 0 0) 0x7faf50001490 con 0x7faf5815c370 2024-09-11T23:22:49.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.444+0000 7faf56000640 1 -- 172.21.15.144:0/3982022771 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf3c003520 con 0x7faf5815c370 2024-09-11T23:22:49.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.444+0000 7faf56000640 1 -- 172.21.15.144:0/3982022771 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3803707773 0 0) 0x7faf3c003520 con 0x7faf5815c370 2024-09-11T23:22:49.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.444+0000 7faf56000640 1 -- 172.21.15.144:0/3982022771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf5806f130 msgr2=0x7faf580b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:49.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.444+0000 7faf56000640 1 --2- 172.21.15.144:0/3982022771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf5806f130 0x7faf580b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:49.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.444+0000 7faf56000640 1 -- 172.21.15.144:0/3982022771 >> v1:172.21.15.165:6789/0 conn(0x7faf58158e50 legacy=0x7faf5806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:49.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.444+0000 7faf56000640 1 -- 172.21.15.144:0/3982022771 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf580b3910 con 0x7faf5815c370 2024-09-11T23:22:49.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.444+0000 7faf56000640 1 -- 172.21.15.144:0/3982022771 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7faf50001bc0 con 0x7faf5815c370 2024-09-11T23:22:49.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.444+0000 7faf56000640 1 -- 172.21.15.144:0/3982022771 >> v1:172.21.15.144:6789/0 conn(0x7faf5815c370 legacy=0x7faf580ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:49.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.444+0000 7faf56000640 1 --2- 172.21.15.144:0/3982022771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf3c0039e0 0x7faf3c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:49.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.444+0000 7faf56000640 1 --2- 172.21.15.144:0/3982022771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf5806f130 0x7faf3c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:49.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.444+0000 7faf56000640 1 --2- 172.21.15.144:0/3982022771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf3c004d40 0x7faf3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:49.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.444+0000 7faf56000640 1 -- 172.21.15.144:0/3982022771 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faf580b3630 con 0x7faf3c004d40 2024-09-11T23:22:49.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.444+0000 7faf56000640 1 -- 172.21.15.144:0/3982022771 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c00b9f0 con 0x7faf3c0039e0 2024-09-11T23:22:49.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.444+0000 7faf56000640 1 -- 172.21.15.144:0/3982022771 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faf3c00bbf0 con 0x7faf5806f130 2024-09-11T23:22:49.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.444+0000 7faf57400640 1 --2- 172.21.15.144:0/3982022771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf3c004d40 0x7faf3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:49.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.444+0000 7faf4e000640 1 --2- 172.21.15.144:0/3982022771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf5806f130 0x7faf3c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:49.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.444+0000 7faf56a00640 1 --2- 172.21.15.144:0/3982022771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf3c0039e0 0x7faf3c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:49.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.445+0000 7faf57400640 1 -- 172.21.15.144:0/3982022771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf5806f130 msgr2=0x7faf3c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:49.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.445+0000 7faf57400640 1 --2- 172.21.15.144:0/3982022771 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf5806f130 0x7faf3c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:49.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.445+0000 7faf57400640 1 -- 172.21.15.144:0/3982022771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf3c0039e0 msgr2=0x7faf3c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:49.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.445+0000 7faf57400640 1 --2- 172.21.15.144:0/3982022771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf3c0039e0 0x7faf3c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:49.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.445+0000 7faf57400640 1 -- 172.21.15.144:0/3982022771 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3c003520 con 0x7faf3c004d40 2024-09-11T23:22:49.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.445+0000 7faf56a00640 1 --2- 172.21.15.144:0/3982022771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf3c0039e0 0x7faf3c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:49.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.446+0000 7faf57400640 1 --2- 172.21.15.144:0/3982022771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf3c004d40 0x7faf3c0051c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7faf5000a9e0 tx=0x7faf3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89acbad72fb62ca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:49.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.446+0000 7faf56000640 1 -- 172.21.15.144:0/3982022771 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5000a600 con 0x7faf3c004d40 2024-09-11T23:22:49.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.446+0000 7faf56000640 1 -- 172.21.15.144:0/3982022771 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf5002f070 con 0x7faf3c004d40 2024-09-11T23:22:49.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.446+0000 7faf56000640 1 -- 172.21.15.144:0/3982022771 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5002be30 con 0x7faf3c004d40 2024-09-11T23:22:49.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.446+0000 7faf5de00640 1 -- 172.21.15.144:0/3982022771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf3c004d40 msgr2=0x7faf3c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:49.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.446+0000 7faf5de00640 1 --2- 172.21.15.144:0/3982022771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf3c004d40 0x7faf3c0051c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7faf5000a9e0 tx=0x7faf3c005830 comp rx=0 tx=0).stop 2024-09-11T23:22:49.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.446+0000 7faf57400640 1 -- 172.21.15.144:0/3982022771 reap_dead start 2024-09-11T23:22:49.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.446+0000 7faf5de00640 1 -- 172.21.15.144:0/3982022771 shutdown_connections 2024-09-11T23:22:49.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.446+0000 7faf5de00640 1 -- 172.21.15.144:0/3982022771 >> 172.21.15.144:0/3982022771 conn(0x7faf5806bba0 msgr2=0x7faf5806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:49.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.446+0000 7faf5de00640 1 -- 172.21.15.144:0/3982022771 shutdown_connections 2024-09-11T23:22:49.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.446+0000 7faf5de00640 1 -- 172.21.15.144:0/3982022771 wait complete. 2024-09-11T23:22:49.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.448+0000 7faf5de00640 1 Processor -- start 2024-09-11T23:22:49.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.448+0000 7faf5de00640 1 -- start start 2024-09-11T23:22:49.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.449+0000 7faf5de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf3c004d40 0x7faf5815b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:49.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.449+0000 7faf5de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf581593b0 0x7faf58146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:49.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.449+0000 7faf5de00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf580ae8e0 0x7faf580aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:49.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.449+0000 7faf5de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faf58159230 con 0x7faf581593b0 2024-09-11T23:22:49.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.449+0000 7faf5de00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faf580b3ed0 con 0x7faf580ae8e0 2024-09-11T23:22:49.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.449+0000 7faf5de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faf580b5050 con 0x7faf3c004d40 2024-09-11T23:22:49.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.449+0000 7faf4e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf581593b0 0x7faf58146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:49.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.449+0000 7faf4e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf581593b0 0x7faf58146d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43442/0 (socket says 172.21.15.144:43442) 2024-09-11T23:22:49.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.449+0000 7faf4e000640 1 -- 172.21.15.144:0/3966386685 learned_addr learned my addr 172.21.15.144:0/3966386685 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:49.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.449+0000 7faf56a00640 1 --2- 172.21.15.144:0/3966386685 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf3c004d40 0x7faf5815b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:49.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.449+0000 7faf57400640 1 --2- 172.21.15.144:0/3966386685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf580ae8e0 0x7faf580aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:49.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.450+0000 7faf4e000640 1 -- 172.21.15.144:0/3966386685 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf3c004d40 msgr2=0x7faf5815b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:49.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.450+0000 7faf4e000640 1 --2- 172.21.15.144:0/3966386685 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faf3c004d40 0x7faf5815b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:49.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.450+0000 7faf4e000640 1 -- 172.21.15.144:0/3966386685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf580ae8e0 msgr2=0x7faf580aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:49.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.450+0000 7faf4e000640 1 --2- 172.21.15.144:0/3966386685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf580ae8e0 0x7faf580aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:49.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.450+0000 7faf4e000640 1 -- 172.21.15.144:0/3966386685 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf58147270 con 0x7faf581593b0 2024-09-11T23:22:49.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.450+0000 7faf57400640 1 --2- 172.21.15.144:0/3966386685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf580ae8e0 0x7faf580aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:49.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.450+0000 7faf4e000640 1 --2- 172.21.15.144:0/3966386685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faf581593b0 0x7faf58146d30 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7faf40011990 tx=0x7faf40011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:49.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.450+0000 7faf4fe00640 1 -- 172.21.15.144:0/3966386685 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf40005ba0 con 0x7faf581593b0 2024-09-11T23:22:49.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.450+0000 7faf4fe00640 1 -- 172.21.15.144:0/3966386685 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf40005d40 con 0x7faf581593b0 2024-09-11T23:22:49.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.450+0000 7faf4fe00640 1 -- 172.21.15.144:0/3966386685 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4000fa80 con 0x7faf581593b0 2024-09-11T23:22:49.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.450+0000 7faf5de00640 1 -- 172.21.15.144:0/3966386685 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf58159b70 con 0x7faf581593b0 2024-09-11T23:22:49.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.450+0000 7faf5de00640 1 -- 172.21.15.144:0/3966386685 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf5815a130 con 0x7faf581593b0 2024-09-11T23:22:49.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.451+0000 7faf5de00640 1 -- 172.21.15.144:0/3966386685 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf580b5420 con 0x7faf581593b0 2024-09-11T23:22:49.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.452+0000 7faf4fe00640 1 -- 172.21.15.144:0/3966386685 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7faf40012040 con 0x7faf581593b0 2024-09-11T23:22:49.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.453+0000 7faf4fe00640 1 --2- 172.21.15.144:0/3966386685 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7faf3406bf50 0x7faf3406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:49.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.453+0000 7faf4fe00640 1 -- 172.21.15.144:0/3966386685 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6543+0+0 (secure 0 0 0) 0x7faf4008b820 con 0x7faf581593b0 2024-09-11T23:22:49.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.453+0000 7faf56a00640 1 --2- 172.21.15.144:0/3966386685 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7faf3406bf50 0x7faf3406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:49.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.454+0000 7faf56a00640 1 --2- 172.21.15.144:0/3966386685 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7faf3406bf50 0x7faf3406e410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faf480011a0 tx=0x7faf48009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:49.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.457+0000 7faf4fe00640 1 -- 172.21.15.144:0/3966386685 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faf58147270 con 0x7faf581593b0 2024-09-11T23:22:49.657 INFO:teuthology.orchestra.run.smithi144.stderr:Invalid command: invalid chars @# in abcd@# 2024-09-11T23:22:49.657 INFO:teuthology.orchestra.run.smithi144.stderr:fs subvolume create [] [] [] [] [] [] [--namespace-isolated] : Create a CephFS subvolume in a volume, and optionally, with a specific size (in bytes), a specific data pool layout, a specific mode, in a specific subvolume group and in separate RADOS namespace 2024-09-11T23:22:49.657 INFO:teuthology.orchestra.run.smithi144.stderr:Error EINVAL: invalid command 2024-09-11T23:22:49.665 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T23:22:49.666 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm testvol --yes-i-really-mean-it 2024-09-11T23:22:49.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.824+0000 7fd956200640 1 Processor -- start 2024-09-11T23:22:49.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.824+0000 7fd956200640 1 -- start start 2024-09-11T23:22:49.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.825+0000 7fd956200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd95015e6c0 0x7fd95006c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:49.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.825+0000 7fd956200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd95006d610 0x7fd95006da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:49.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.825+0000 7fd956200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd95006df60 con 0x7fd9500cf510 2024-09-11T23:22:49.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.825+0000 7fd956200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd9500d34d0 con 0x7fd95015e6c0 2024-09-11T23:22:49.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.825+0000 7fd956200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd95015eaa0 con 0x7fd95006d610 2024-09-11T23:22:49.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.825+0000 7fd954e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd95015e6c0 0x7fd95006c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:49.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.825+0000 7fd954e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd95015e6c0 0x7fd95006c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43454/0 (socket says 172.21.15.144:43454) 2024-09-11T23:22:49.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.825+0000 7fd954e00640 1 -- 172.21.15.144:0/2849061112 learned_addr learned my addr 172.21.15.144:0/2849061112 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:49.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.826+0000 7fd955800640 1 --2- 172.21.15.144:0/2849061112 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd95006d610 0x7fd95006da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:49.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.826+0000 7fd954e00640 1 -- 172.21.15.144:0/2849061112 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd95006d610 msgr2=0x7fd95006da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:49.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.826+0000 7fd954e00640 1 --2- 172.21.15.144:0/2849061112 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd95006d610 0x7fd95006da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:49.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.826+0000 7fd954e00640 1 -- 172.21.15.144:0/2849061112 >> v1:172.21.15.165:6789/0 conn(0x7fd9500cf510 legacy=0x7fd9500b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:49.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.826+0000 7fd954e00640 1 -- 172.21.15.144:0/2849061112 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95006cdf0 con 0x7fd95015e6c0 2024-09-11T23:22:49.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.827+0000 7fd954e00640 1 --2- 172.21.15.144:0/2849061112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd95015e6c0 0x7fd95006c8b0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd950069df0 tx=0x7fd94402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dbe6e9aaba5ba61 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:49.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.827+0000 7fd94f400640 1 -- 172.21.15.144:0/2849061112 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd944037070 con 0x7fd95015e6c0 2024-09-11T23:22:49.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.827+0000 7fd94f400640 1 -- 172.21.15.144:0/2849061112 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd944032440 con 0x7fd95015e6c0 2024-09-11T23:22:49.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.827+0000 7fd94f400640 1 -- 172.21.15.144:0/2849061112 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd944032810 con 0x7fd95015e6c0 2024-09-11T23:22:49.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.828+0000 7fd956200640 1 -- 172.21.15.144:0/2849061112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd95015e6c0 msgr2=0x7fd95006c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:49.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.828+0000 7fd956200640 1 --2- 172.21.15.144:0/2849061112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd95015e6c0 0x7fd95006c8b0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd950069df0 tx=0x7fd94402a1e0 comp rx=0 tx=0).stop 2024-09-11T23:22:49.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.828+0000 7fd956200640 1 -- 172.21.15.144:0/2849061112 shutdown_connections 2024-09-11T23:22:49.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.828+0000 7fd956200640 1 --2- 172.21.15.144:0/2849061112 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd95006d610 0x7fd95006da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:49.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.828+0000 7fd956200640 1 --2- 172.21.15.144:0/2849061112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd95015e6c0 0x7fd95006c8b0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:49.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.828+0000 7fd956200640 1 -- 172.21.15.144:0/2849061112 >> 172.21.15.144:0/2849061112 conn(0x7fd9500d4720 msgr2=0x7fd9500d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:49.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.828+0000 7fd956200640 1 -- 172.21.15.144:0/2849061112 shutdown_connections 2024-09-11T23:22:49.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.828+0000 7fd956200640 1 -- 172.21.15.144:0/2849061112 wait complete. 2024-09-11T23:22:49.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.829+0000 7fd956200640 1 Processor -- start 2024-09-11T23:22:49.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.830+0000 7fd956200640 1 -- start start 2024-09-11T23:22:49.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.830+0000 7fd956200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd95006d610 0x7fd9501f53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:49.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.830+0000 7fd956200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9500cf510 0x7fd9501536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:49.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.830+0000 7fd956200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd95015e6c0 0x7fd95015ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:49.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.830+0000 7fd956200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd9500d2e80 con 0x7fd9500cf510 2024-09-11T23:22:49.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.830+0000 7fd956200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd9500d2ba0 con 0x7fd95015e6c0 2024-09-11T23:22:49.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.830+0000 7fd956200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd9500d3160 con 0x7fd95006d610 2024-09-11T23:22:49.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.831+0000 7fd94fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9500cf510 0x7fd9501536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:49.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.831+0000 7fd94fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9500cf510 0x7fd9501536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43470/0 (socket says 172.21.15.144:43470) 2024-09-11T23:22:49.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.831+0000 7fd94fe00640 1 -- 172.21.15.144:0/2473943727 learned_addr learned my addr 172.21.15.144:0/2473943727 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.831+0000 7fd954e00640 1 --2- 172.21.15.144:0/2473943727 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd95006d610 0x7fd9501f53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.831+0000 7fd955800640 1 --2- 172.21.15.144:0/2473943727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd95015e6c0 0x7fd95015ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.831+0000 7fd94fe00640 1 -- 172.21.15.144:0/2473943727 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd95006d610 msgr2=0x7fd9501f53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.831+0000 7fd94fe00640 1 --2- 172.21.15.144:0/2473943727 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd95006d610 0x7fd9501f53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.831+0000 7fd94fe00640 1 -- 172.21.15.144:0/2473943727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd95015e6c0 msgr2=0x7fd95015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.831+0000 7fd94fe00640 1 --2- 172.21.15.144:0/2473943727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd95015e6c0 0x7fd95015ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.831+0000 7fd94fe00640 1 -- 172.21.15.144:0/2473943727 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95015fab0 con 0x7fd9500cf510 2024-09-11T23:22:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.831+0000 7fd955800640 1 --2- 172.21.15.144:0/2473943727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd95015e6c0 0x7fd95015ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.831+0000 7fd94fe00640 1 --2- 172.21.15.144:0/2473943727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9500cf510 0x7fd9501536a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00c430 tx=0x7fd93c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.832+0000 7fd94cc00640 1 -- 172.21.15.144:0/2473943727 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c011790 con 0x7fd9500cf510 2024-09-11T23:22:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.832+0000 7fd94cc00640 1 -- 172.21.15.144:0/2473943727 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd93c017070 con 0x7fd9500cf510 2024-09-11T23:22:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.832+0000 7fd956200640 1 -- 172.21.15.144:0/2473943727 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd950153be0 con 0x7fd9500cf510 2024-09-11T23:22:49.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.832+0000 7fd94cc00640 1 -- 172.21.15.144:0/2473943727 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c011bb0 con 0x7fd9500cf510 2024-09-11T23:22:49.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.832+0000 7fd956200640 1 -- 172.21.15.144:0/2473943727 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd950160520 con 0x7fd9500cf510 2024-09-11T23:22:49.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.833+0000 7fd956200640 1 -- 172.21.15.144:0/2473943727 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd95006da20 con 0x7fd9500cf510 2024-09-11T23:22:49.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.834+0000 7fd94cc00640 1 -- 172.21.15.144:0/2473943727 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fd93c01c460 con 0x7fd9500cf510 2024-09-11T23:22:49.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.835+0000 7fd94cc00640 1 --2- 172.21.15.144:0/2473943727 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd93006bf50 0x7fd93006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:49.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.835+0000 7fd94cc00640 1 -- 172.21.15.144:0/2473943727 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6543+0+0 (secure 0 0 0) 0x7fd93c08b170 con 0x7fd9500cf510 2024-09-11T23:22:49.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.836+0000 7fd954e00640 1 --2- 172.21.15.144:0/2473943727 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd93006bf50 0x7fd93006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:49.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.837+0000 7fd954e00640 1 --2- 172.21.15.144:0/2473943727 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd93006bf50 0x7fd93006e410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd944034000 tx=0x7fd94402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:49.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:49.840+0000 7fd94cc00640 1 -- 172.21.15.144:0/2473943727 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd95015fab0 con 0x7fd9500cf510 2024-09-11T23:22:50.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:50.049+0000 7fd956200640 1 -- 172.21.15.144:0/2473943727 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "testvol", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) -- 0x7fd9500d2600 con 0x7fd93006bf50 2024-09-11T23:22:50.054 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-11T23:22:50.055+0000 7f86fcc00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:22:50.107 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-11T23:22:53.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.081+0000 7fd94cc00640 1 -- 172.21.15.144:0/2473943727 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+78 (secure 0 0 0) 0x7fd9500d2600 con 0x7fd93006bf50 2024-09-11T23:22:53.081 INFO:teuthology.orchestra.run.smithi144.stdout:metadata pool: cephfs.testvol.meta data pool: ['cephfs.testvol.data'] removed 2024-09-11T23:22:53.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.084+0000 7fd956200640 1 -- 172.21.15.144:0/2473943727 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd93006bf50 msgr2=0x7fd93006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:53.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.084+0000 7fd956200640 1 --2- 172.21.15.144:0/2473943727 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd93006bf50 0x7fd93006e410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd944034000 tx=0x7fd94402e000 comp rx=0 tx=0).stop 2024-09-11T23:22:53.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.084+0000 7fd956200640 1 -- 172.21.15.144:0/2473943727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9500cf510 msgr2=0x7fd9501536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:53.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.084+0000 7fd956200640 1 --2- 172.21.15.144:0/2473943727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9500cf510 0x7fd9501536a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00c430 tx=0x7fd93c00c8f0 comp rx=0 tx=0).stop 2024-09-11T23:22:53.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.084+0000 7fd956200640 1 -- 172.21.15.144:0/2473943727 shutdown_connections 2024-09-11T23:22:53.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.084+0000 7fd956200640 1 --2- 172.21.15.144:0/2473943727 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd93006bf50 0x7fd93006e410 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:53.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.084+0000 7fd956200640 1 --2- 172.21.15.144:0/2473943727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd95015e6c0 0x7fd95015ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:53.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.084+0000 7fd956200640 1 --2- 172.21.15.144:0/2473943727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9500cf510 0x7fd9501536a0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:53.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.084+0000 7fd956200640 1 --2- 172.21.15.144:0/2473943727 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd95006d610 0x7fd9501f53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:53.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.084+0000 7fd956200640 1 -- 172.21.15.144:0/2473943727 >> 172.21.15.144:0/2473943727 conn(0x7fd9500d4720 msgr2=0x7fd9500d4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:53.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.084+0000 7fd956200640 1 -- 172.21.15.144:0/2473943727 shutdown_connections 2024-09-11T23:22:53.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.084+0000 7fd956200640 1 -- 172.21.15.144:0/2473943727 wait complete. 2024-09-11T23:22:53.103 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:22:53.104 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:22:53.196 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:22:53.291 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:22:53.291 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:22:53.291 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:22:53.292 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:53.328 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:22:53.328 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:53.406 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:22:53.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.600+0000 7f0b9b200640 1 Processor -- start 2024-09-11T23:22:53.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.601+0000 7f0b9b200640 1 -- start start 2024-09-11T23:22:53.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.602+0000 7f0b9b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b9415ceb0 0x7f0b941594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:53.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.602+0000 7f0b9b200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b9415d390 con 0x7f0b9415ca40 2024-09-11T23:22:53.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.602+0000 7f0b9b200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b9415d670 con 0x7f0b940d02a0 2024-09-11T23:22:53.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.602+0000 7f0b9b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0b9415d950 con 0x7f0b9415ceb0 2024-09-11T23:22:53.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.602+0000 7f0b93400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0b9415ca40 0x7f0b9415e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41096/0 (socket says 172.21.15.144:41096) 2024-09-11T23:22:53.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.602+0000 7f0b93400640 1 -- 172.21.15.144:0/3938238647 learned_addr learned my addr 172.21.15.144:0/3938238647 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:53.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.602+0000 7f0b99200640 1 --2- 172.21.15.144:0/3938238647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b9415ceb0 0x7f0b941594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:53.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.602+0000 7f0b92a00640 1 -- 172.21.15.144:0/3938238647 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 705739245 0 0) 0x7f0b9415d390 con 0x7f0b9415ca40 2024-09-11T23:22:53.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.603+0000 7f0b92a00640 1 -- 172.21.15.144:0/3938238647 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b78003520 con 0x7f0b9415ca40 2024-09-11T23:22:53.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.603+0000 7f0b92a00640 1 -- 172.21.15.144:0/3938238647 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3897879427 0 0) 0x7f0b9415d670 con 0x7f0b940d02a0 2024-09-11T23:22:53.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.603+0000 7f0b92a00640 1 -- 172.21.15.144:0/3938238647 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b9415d390 con 0x7f0b940d02a0 2024-09-11T23:22:53.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.603+0000 7f0b99200640 1 -- 172.21.15.144:0/3938238647 >> v1:172.21.15.165:6789/0 conn(0x7f0b940d02a0 legacy=0x7f0b940d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:53.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.603+0000 7f0b99200640 1 -- 172.21.15.144:0/3938238647 >> v1:172.21.15.144:6789/0 conn(0x7f0b9415ca40 legacy=0x7f0b9415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:53.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.603+0000 7f0b99200640 1 -- 172.21.15.144:0/3938238647 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9415dc30 con 0x7f0b9415ceb0 2024-09-11T23:22:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.604+0000 7f0b99200640 1 --2- 172.21.15.144:0/3938238647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b9415ceb0 0x7f0b941594c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c009dc0 tx=0x7f0b8c02a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c679fb5f4ae7a289 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.604+0000 7f0b92a00640 1 -- 172.21.15.144:0/3938238647 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c02ae60 con 0x7f0b9415ceb0 2024-09-11T23:22:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.604+0000 7f0b92a00640 1 -- 172.21.15.144:0/3938238647 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b8c007740 con 0x7f0b9415ceb0 2024-09-11T23:22:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.604+0000 7f0b92a00640 1 -- 172.21.15.144:0/3938238647 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c007af0 con 0x7f0b9415ceb0 2024-09-11T23:22:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.605+0000 7f0b9b200640 1 -- 172.21.15.144:0/3938238647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b9415ceb0 msgr2=0x7f0b941594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.605+0000 7f0b9b200640 1 --2- 172.21.15.144:0/3938238647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b9415ceb0 0x7f0b941594c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c009dc0 tx=0x7f0b8c02a640 comp rx=0 tx=0).stop 2024-09-11T23:22:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.605+0000 7f0b9b200640 1 -- 172.21.15.144:0/3938238647 shutdown_connections 2024-09-11T23:22:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.605+0000 7f0b9b200640 1 --2- 172.21.15.144:0/3938238647 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b9415ceb0 0x7f0b941594c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.605+0000 7f0b9b200640 1 -- 172.21.15.144:0/3938238647 >> 172.21.15.144:0/3938238647 conn(0x7f0b94062cc0 msgr2=0x7f0b9406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.605+0000 7f0b9b200640 1 -- 172.21.15.144:0/3938238647 shutdown_connections 2024-09-11T23:22:53.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.605+0000 7f0b9b200640 1 -- 172.21.15.144:0/3938238647 wait complete. 2024-09-11T23:22:53.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.606+0000 7f0b9b200640 1 Processor -- start 2024-09-11T23:22:53.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.607+0000 7f0b9b200640 1 -- start start 2024-09-11T23:22:53.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.607+0000 7f0b9b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b940d02a0 0x7f0b9414ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:53.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.607+0000 7f0b9b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b9415ca40 0x7f0b9414fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:53.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.607+0000 7f0b9b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b9415ceb0 0x7f0b94071a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:53.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.607+0000 7f0b9b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0b94155b90 con 0x7f0b9415ceb0 2024-09-11T23:22:53.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.607+0000 7f0b9b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9415eb40 con 0x7f0b940d02a0 2024-09-11T23:22:53.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.607+0000 7f0b9b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0b94155d10 con 0x7f0b9415ca40 2024-09-11T23:22:53.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.608+0000 7f0b99200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b9415ceb0 0x7f0b94071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:53.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.608+0000 7f0b99200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b9415ceb0 0x7f0b94071a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43476/0 (socket says 172.21.15.144:43476) 2024-09-11T23:22:53.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.608+0000 7f0b99200640 1 -- 172.21.15.144:0/410842625 learned_addr learned my addr 172.21.15.144:0/410842625 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:53.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.608+0000 7f0b93e00640 1 --2- 172.21.15.144:0/410842625 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b940d02a0 0x7f0b9414ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:53.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.608+0000 7f0b93400640 1 --2- 172.21.15.144:0/410842625 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b9415ca40 0x7f0b9414fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:53.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.608+0000 7f0b99200640 1 -- 172.21.15.144:0/410842625 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b9415ca40 msgr2=0x7f0b9414fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:53.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.608+0000 7f0b99200640 1 --2- 172.21.15.144:0/410842625 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b9415ca40 0x7f0b9414fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:53.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.608+0000 7f0b99200640 1 -- 172.21.15.144:0/410842625 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b940d02a0 msgr2=0x7f0b9414ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:53.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.608+0000 7f0b99200640 1 --2- 172.21.15.144:0/410842625 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b940d02a0 0x7f0b9414ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:53.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.608+0000 7f0b99200640 1 -- 172.21.15.144:0/410842625 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b94149c80 con 0x7f0b9415ceb0 2024-09-11T23:22:53.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.608+0000 7f0b99200640 1 --2- 172.21.15.144:0/410842625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b9415ceb0 0x7f0b94071a80 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c02ac30 tx=0x7f0b8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:53.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.609+0000 7f0b8be00640 1 -- 172.21.15.144:0/410842625 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c03f070 con 0x7f0b9415ceb0 2024-09-11T23:22:53.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.609+0000 7f0b8be00640 1 -- 172.21.15.144:0/410842625 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b8c031a40 con 0x7f0b9415ceb0 2024-09-11T23:22:53.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.609+0000 7f0b8be00640 1 -- 172.21.15.144:0/410842625 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c009450 con 0x7f0b9415ceb0 2024-09-11T23:22:53.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.609+0000 7f0b9b200640 1 -- 172.21.15.144:0/410842625 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b94149f60 con 0x7f0b9415ceb0 2024-09-11T23:22:53.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.609+0000 7f0b9b200640 1 -- 172.21.15.144:0/410842625 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b9414a520 con 0x7f0b9415ceb0 2024-09-11T23:22:53.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.610+0000 7f0b9b200640 1 -- 172.21.15.144:0/410842625 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b940b4790 con 0x7f0b9415ceb0 2024-09-11T23:22:53.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.611+0000 7f0b8be00640 1 -- 172.21.15.144:0/410842625 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f0b8c031c30 con 0x7f0b9415ceb0 2024-09-11T23:22:53.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.612+0000 7f0b8be00640 1 --2- 172.21.15.144:0/410842625 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0b7406bf50 0x7f0b7406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:53.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.612+0000 7f0b8be00640 1 -- 172.21.15.144:0/410842625 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5795+0+0 (secure 0 0 0) 0x7f0b8c0ac4b0 con 0x7f0b9415ceb0 2024-09-11T23:22:53.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.612+0000 7f0b93e00640 1 --2- 172.21.15.144:0/410842625 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0b7406bf50 0x7f0b7406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:53.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.613+0000 7f0b93e00640 1 --2- 172.21.15.144:0/410842625 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0b7406bf50 0x7f0b7406e410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0b840011e0 tx=0x7f0b84009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:53.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.616+0000 7f0b8be00640 1 -- 172.21.15.144:0/410842625 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0b8c07a6a0 con 0x7f0b9415ceb0 2024-09-11T23:22:53.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.802+0000 7f0b9b200640 1 -- 172.21.15.144:0/410842625 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0b9406d280 con 0x7f0b9415ceb0 2024-09-11T23:22:53.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.803+0000 7f0b8be00640 1 -- 172.21.15.144:0/410842625 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v90) ==== 80+0+124 (secure 0 0 0) 0x7f0b8c07e9a0 con 0x7f0b9415ceb0 2024-09-11T23:22:53.803 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.165:6835/3966608439 2024-09-12T23:22:50.055731+0000 2024-09-11T23:22:53.803 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.165:6833/3966608439 2024-09-12T23:22:50.055731+0000 2024-09-11T23:22:53.803 INFO:teuthology.orchestra.run.smithi144.stderr:listed 2 entries 2024-09-11T23:22:53.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.805+0000 7f0b9b200640 1 -- 172.21.15.144:0/410842625 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0b7406bf50 msgr2=0x7f0b7406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:53.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.805+0000 7f0b9b200640 1 --2- 172.21.15.144:0/410842625 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0b7406bf50 0x7f0b7406e410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0b840011e0 tx=0x7f0b84009040 comp rx=0 tx=0).stop 2024-09-11T23:22:53.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.805+0000 7f0b9b200640 1 -- 172.21.15.144:0/410842625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b9415ceb0 msgr2=0x7f0b94071a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:53.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.805+0000 7f0b9b200640 1 --2- 172.21.15.144:0/410842625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b9415ceb0 0x7f0b94071a80 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c02ac30 tx=0x7f0b8c004a40 comp rx=0 tx=0).stop 2024-09-11T23:22:53.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.805+0000 7f0b9b200640 1 -- 172.21.15.144:0/410842625 shutdown_connections 2024-09-11T23:22:53.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.805+0000 7f0b9b200640 1 --2- 172.21.15.144:0/410842625 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0b7406bf50 0x7f0b7406e410 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:53.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.805+0000 7f0b9b200640 1 --2- 172.21.15.144:0/410842625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b9415ceb0 0x7f0b94071a80 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:53.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.805+0000 7f0b9b200640 1 --2- 172.21.15.144:0/410842625 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b9415ca40 0x7f0b9414fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:53.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.805+0000 7f0b9b200640 1 --2- 172.21.15.144:0/410842625 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b940d02a0 0x7f0b9414ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:53.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.805+0000 7f0b9b200640 1 -- 172.21.15.144:0/410842625 >> 172.21.15.144:0/410842625 conn(0x7f0b94062cc0 msgr2=0x7f0b94154300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:53.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.805+0000 7f0b9b200640 1 -- 172.21.15.144:0/410842625 shutdown_connections 2024-09-11T23:22:53.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:53.805+0000 7f0b9b200640 1 -- 172.21.15.144:0/410842625 wait complete. 2024-09-11T23:22:53.821 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T23:22:53.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:53.822 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T23:22:53.886 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:22:53.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:53.887 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:22:53.927 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:22:53.927 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:22:53.927 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:53.967 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:22:53.967 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:54.047 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:22:54.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.203+0000 7faafbe00640 1 Processor -- start 2024-09-11T23:22:54.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.203+0000 7faafbe00640 1 -- start start 2024-09-11T23:22:54.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.204+0000 7faafbe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7faafc0ce480 0x7faafc0ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:54.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.204+0000 7faafbe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faafc072100 con 0x7faafc0b1dc0 2024-09-11T23:22:54.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.204+0000 7faafbe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faafc073890 con 0x7faafc15a0a0 2024-09-11T23:22:54.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.204+0000 7faafbe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7faafc0723c0 con 0x7faafc0ce480 2024-09-11T23:22:54.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.204+0000 7faafb400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7faafc0b1dc0 0x7faafc0cf240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:41112/0 (socket says 172.21.15.144:41112) 2024-09-11T23:22:54.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.204+0000 7faafb400640 1 -- 172.21.15.144:0/724306987 learned_addr learned my addr 172.21.15.144:0/724306987 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:54.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.205+0000 7faaf2000640 1 --2- 172.21.15.144:0/724306987 >> v2:172.21.15.165:3300/0 conn(0x7faafc0ce480 0x7faafc0ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:54.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.205+0000 7faafa000640 1 -- 172.21.15.144:0/724306987 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3880622498 0 0) 0x7faafc072100 con 0x7faafc0b1dc0 2024-09-11T23:22:54.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.205+0000 7faafa000640 1 -- 172.21.15.144:0/724306987 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faae0003520 con 0x7faafc0b1dc0 2024-09-11T23:22:54.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.205+0000 7faafa000640 1 -- 172.21.15.144:0/724306987 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3502452121 0 0) 0x7faafc073890 con 0x7faafc15a0a0 2024-09-11T23:22:54.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.205+0000 7faafa000640 1 -- 172.21.15.144:0/724306987 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faafc072100 con 0x7faafc15a0a0 2024-09-11T23:22:54.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.205+0000 7faaf2000640 1 -- 172.21.15.144:0/724306987 >> v1:172.21.15.165:6789/0 conn(0x7faafc15a0a0 legacy=0x7faafc073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:54.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.205+0000 7faaf2000640 1 -- 172.21.15.144:0/724306987 >> v1:172.21.15.144:6789/0 conn(0x7faafc0b1dc0 legacy=0x7faafc0cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:54.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.205+0000 7faaf2000640 1 -- 172.21.15.144:0/724306987 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faafc0726a0 con 0x7faafc0ce480 2024-09-11T23:22:54.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.206+0000 7faaf2000640 1 --2- 172.21.15.144:0/724306987 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faafc0ce480 0x7faafc0ce910 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7faae40097a0 tx=0x7faae402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8fdaeeca9db56fd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:54.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.206+0000 7faafa000640 1 -- 172.21.15.144:0/724306987 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae4037070 con 0x7faafc0ce480 2024-09-11T23:22:54.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.206+0000 7faafa000640 1 -- 172.21.15.144:0/724306987 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae4032440 con 0x7faafc0ce480 2024-09-11T23:22:54.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.206+0000 7faafa000640 1 -- 172.21.15.144:0/724306987 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae40327f0 con 0x7faafc0ce480 2024-09-11T23:22:54.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.207+0000 7faafbe00640 1 -- 172.21.15.144:0/724306987 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faafc0ce480 msgr2=0x7faafc0ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:54.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.207+0000 7faafbe00640 1 --2- 172.21.15.144:0/724306987 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faafc0ce480 0x7faafc0ce910 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7faae40097a0 tx=0x7faae402a230 comp rx=0 tx=0).stop 2024-09-11T23:22:54.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.207+0000 7faafbe00640 1 -- 172.21.15.144:0/724306987 shutdown_connections 2024-09-11T23:22:54.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.207+0000 7faafbe00640 1 --2- 172.21.15.144:0/724306987 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faafc0ce480 0x7faafc0ce910 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:54.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.207+0000 7faafbe00640 1 -- 172.21.15.144:0/724306987 >> 172.21.15.144:0/724306987 conn(0x7faafc06e910 msgr2=0x7faafc06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:54.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.207+0000 7faafbe00640 1 -- 172.21.15.144:0/724306987 shutdown_connections 2024-09-11T23:22:54.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.207+0000 7faafbe00640 1 -- 172.21.15.144:0/724306987 wait complete. 2024-09-11T23:22:54.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.209+0000 7faafbe00640 1 Processor -- start 2024-09-11T23:22:54.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.209+0000 7faafbe00640 1 -- start start 2024-09-11T23:22:54.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.210+0000 7faafbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faafc0b1dc0 0x7faafc157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:54.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.210+0000 7faafbe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faafc0ce480 0x7faafc1439f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:54.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.210+0000 7faafbe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faafc15a0a0 0x7faafc1e5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:54.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.210+0000 7faafbe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faafc0cfad0 con 0x7faafc0b1dc0 2024-09-11T23:22:54.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.210+0000 7faafbe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faafc0cf950 con 0x7faafc0ce480 2024-09-11T23:22:54.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.210+0000 7faafbe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faafc1564e0 con 0x7faafc15a0a0 2024-09-11T23:22:54.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.210+0000 7faafaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faafc0b1dc0 0x7faafc157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:54.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.210+0000 7faafaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faafc0b1dc0 0x7faafc157580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43482/0 (socket says 172.21.15.144:43482) 2024-09-11T23:22:54.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.210+0000 7faafaa00640 1 -- 172.21.15.144:0/3274146821 learned_addr learned my addr 172.21.15.144:0/3274146821 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:54.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.210+0000 7faaf2000640 1 --2- 172.21.15.144:0/3274146821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faafc0ce480 0x7faafc1439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:54.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.210+0000 7faafb400640 1 --2- 172.21.15.144:0/3274146821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faafc15a0a0 0x7faafc1e5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:54.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.210+0000 7faafaa00640 1 -- 172.21.15.144:0/3274146821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faafc15a0a0 msgr2=0x7faafc1e5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:54.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.210+0000 7faafaa00640 1 --2- 172.21.15.144:0/3274146821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faafc15a0a0 0x7faafc1e5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:54.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.210+0000 7faafaa00640 1 -- 172.21.15.144:0/3274146821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faafc0ce480 msgr2=0x7faafc1439f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:54.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.210+0000 7faafaa00640 1 --2- 172.21.15.144:0/3274146821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faafc0ce480 0x7faafc1439f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:54.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.210+0000 7faafaa00640 1 -- 172.21.15.144:0/3274146821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faafc1567c0 con 0x7faafc0b1dc0 2024-09-11T23:22:54.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.210+0000 7faafb400640 1 --2- 172.21.15.144:0/3274146821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faafc15a0a0 0x7faafc1e5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:54.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.211+0000 7faafaa00640 1 --2- 172.21.15.144:0/3274146821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faafc0b1dc0 0x7faafc157580 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7faaec00c430 tx=0x7faaec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:54.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.211+0000 7faaf3400640 1 -- 172.21.15.144:0/3274146821 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec017070 con 0x7faafc0b1dc0 2024-09-11T23:22:54.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.211+0000 7faaf3400640 1 -- 172.21.15.144:0/3274146821 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaec0052f0 con 0x7faafc0b1dc0 2024-09-11T23:22:54.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.211+0000 7faafbe00640 1 -- 172.21.15.144:0/3274146821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faafc156aa0 con 0x7faafc0b1dc0 2024-09-11T23:22:54.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.211+0000 7faaf3400640 1 -- 172.21.15.144:0/3274146821 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec003830 con 0x7faafc0b1dc0 2024-09-11T23:22:54.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.211+0000 7faafbe00640 1 -- 172.21.15.144:0/3274146821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faafc157ac0 con 0x7faafc0b1dc0 2024-09-11T23:22:54.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.212+0000 7faafbe00640 1 -- 172.21.15.144:0/3274146821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faafc0ce910 con 0x7faafc0b1dc0 2024-09-11T23:22:54.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.213+0000 7faaf3400640 1 -- 172.21.15.144:0/3274146821 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7faaec01a070 con 0x7faafc0b1dc0 2024-09-11T23:22:54.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.214+0000 7faaf3400640 1 --2- 172.21.15.144:0/3274146821 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7faad806bf50 0x7faad806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:54.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.214+0000 7faaf3400640 1 -- 172.21.15.144:0/3274146821 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5795+0+0 (secure 0 0 0) 0x7faaec08a3e0 con 0x7faafc0b1dc0 2024-09-11T23:22:54.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.214+0000 7faaf2000640 1 --2- 172.21.15.144:0/3274146821 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7faad806bf50 0x7faad806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:54.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.215+0000 7faaf2000640 1 --2- 172.21.15.144:0/3274146821 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7faad806bf50 0x7faad806e410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faae4034000 tx=0x7faae402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:54.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.218+0000 7faaf3400640 1 -- 172.21.15.144:0/3274146821 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faaec0585c0 con 0x7faafc0b1dc0 2024-09-11T23:22:54.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.404+0000 7faafbe00640 1 -- 172.21.15.144:0/3274146821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7faafc0cf020 con 0x7faafc0b1dc0 2024-09-11T23:22:54.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.404+0000 7faaf3400640 1 -- 172.21.15.144:0/3274146821 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v90) ==== 80+0+124 (secure 0 0 0) 0x7faaec05c8c0 con 0x7faafc0b1dc0 2024-09-11T23:22:54.405 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.165:6835/3966608439 2024-09-12T23:22:50.055731+0000 2024-09-11T23:22:54.405 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.165:6833/3966608439 2024-09-12T23:22:50.055731+0000 2024-09-11T23:22:54.406 INFO:teuthology.orchestra.run.smithi144.stderr:listed 2 entries 2024-09-11T23:22:54.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.406+0000 7faafbe00640 1 -- 172.21.15.144:0/3274146821 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7faad806bf50 msgr2=0x7faad806e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:54.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.406+0000 7faafbe00640 1 --2- 172.21.15.144:0/3274146821 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7faad806bf50 0x7faad806e410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faae4034000 tx=0x7faae402e000 comp rx=0 tx=0).stop 2024-09-11T23:22:54.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.406+0000 7faafbe00640 1 -- 172.21.15.144:0/3274146821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faafc0b1dc0 msgr2=0x7faafc157580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:54.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.406+0000 7faafbe00640 1 --2- 172.21.15.144:0/3274146821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faafc0b1dc0 0x7faafc157580 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7faaec00c430 tx=0x7faaec00c8f0 comp rx=0 tx=0).stop 2024-09-11T23:22:54.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.406+0000 7faafbe00640 1 -- 172.21.15.144:0/3274146821 shutdown_connections 2024-09-11T23:22:54.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.406+0000 7faafbe00640 1 --2- 172.21.15.144:0/3274146821 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7faad806bf50 0x7faad806e410 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:54.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.406+0000 7faafbe00640 1 --2- 172.21.15.144:0/3274146821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faafc15a0a0 0x7faafc1e5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:54.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.406+0000 7faafbe00640 1 --2- 172.21.15.144:0/3274146821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faafc0ce480 0x7faafc1439f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:54.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.406+0000 7faafbe00640 1 --2- 172.21.15.144:0/3274146821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faafc0b1dc0 0x7faafc157580 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:54.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.406+0000 7faafbe00640 1 -- 172.21.15.144:0/3274146821 >> 172.21.15.144:0/3274146821 conn(0x7faafc06e910 msgr2=0x7faafc06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:54.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.407+0000 7faafbe00640 1 -- 172.21.15.144:0/3274146821 shutdown_connections 2024-09-11T23:22:54.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.407+0000 7faafbe00640 1 -- 172.21.15.144:0/3274146821 wait complete. 2024-09-11T23:22:54.424 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-11T23:22:54.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:54.424 DEBUG:teuthology.orchestra.run.smithi165:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-11T23:22:54.490 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:22:54.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:22:54.491 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:22:54.527 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:22:54.527 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:22:54.528 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:54.563 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:22:54.563 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:22:54.563 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:22:54.563 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:22:54.603 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:22:54.604 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:22:54.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.759+0000 7f27e9200640 1 Processor -- start 2024-09-11T23:22:54.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.759+0000 7f27e9200640 1 -- start start 2024-09-11T23:22:54.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.760+0000 7f27e9200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f27e415ceb0 0x7f27e41594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:54.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.760+0000 7f27e9200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e415d390 con 0x7f27e40d02a0 2024-09-11T23:22:54.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.760+0000 7f27e9200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e415d670 con 0x7f27e415ca40 2024-09-11T23:22:54.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.760+0000 7f27e9200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f27e415d950 con 0x7f27e415ceb0 2024-09-11T23:22:54.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.760+0000 7f27e1e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f27e40d02a0 0x7f27e40d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47298/0 (socket says 172.21.15.144:47298) 2024-09-11T23:22:54.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.760+0000 7f27e1e00640 1 -- 172.21.15.144:0/340276112 learned_addr learned my addr 172.21.15.144:0/340276112 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:54.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.760+0000 7f27e2800640 1 --2- 172.21.15.144:0/340276112 >> v2:172.21.15.165:3300/0 conn(0x7f27e415ceb0 0x7f27e41594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:54.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.760+0000 7f27e1400640 1 -- 172.21.15.144:0/340276112 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1264148265 0 0) 0x7f27e415d390 con 0x7f27e40d02a0 2024-09-11T23:22:54.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.761+0000 7f27e1400640 1 -- 172.21.15.144:0/340276112 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27c8003520 con 0x7f27e40d02a0 2024-09-11T23:22:54.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.761+0000 7f27e1400640 1 -- 172.21.15.144:0/340276112 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1522428754 0 0) 0x7f27e415d670 con 0x7f27e415ca40 2024-09-11T23:22:54.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.761+0000 7f27e1400640 1 -- 172.21.15.144:0/340276112 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27e415d390 con 0x7f27e415ca40 2024-09-11T23:22:54.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.761+0000 7f27e2800640 1 -- 172.21.15.144:0/340276112 >> v1:172.21.15.165:6789/0 conn(0x7f27e415ca40 legacy=0x7f27e415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.761+0000 7f27e1400640 1 -- 172.21.15.144:0/340276112 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1877806447 0 0) 0x7f27c8003520 con 0x7f27e40d02a0 2024-09-11T23:22:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.761+0000 7f27e2800640 1 -- 172.21.15.144:0/340276112 >> v1:172.21.15.144:6789/0 conn(0x7f27e40d02a0 legacy=0x7f27e40d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:54.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.761+0000 7f27e2800640 1 -- 172.21.15.144:0/340276112 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e415dc30 con 0x7f27e415ceb0 2024-09-11T23:22:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.762+0000 7f27e2800640 1 --2- 172.21.15.144:0/340276112 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27e415ceb0 0x7f27e41594c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009d90 tx=0x7f27dc02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6464f8eb3091e427 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.762+0000 7f27e1400640 1 -- 172.21.15.144:0/340276112 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d4001670 con 0x7f27e415ceb0 2024-09-11T23:22:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.762+0000 7f27e1400640 1 -- 172.21.15.144:0/340276112 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27dc007540 con 0x7f27e415ceb0 2024-09-11T23:22:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.762+0000 7f27e1400640 1 -- 172.21.15.144:0/340276112 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc0078f0 con 0x7f27e415ceb0 2024-09-11T23:22:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.763+0000 7f27e9200640 1 -- 172.21.15.144:0/340276112 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27e415ceb0 msgr2=0x7f27e41594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.763+0000 7f27e9200640 1 --2- 172.21.15.144:0/340276112 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27e415ceb0 0x7f27e41594c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009d90 tx=0x7f27dc02a5f0 comp rx=0 tx=0).stop 2024-09-11T23:22:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.763+0000 7f27e9200640 1 -- 172.21.15.144:0/340276112 shutdown_connections 2024-09-11T23:22:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.763+0000 7f27e9200640 1 --2- 172.21.15.144:0/340276112 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27e415ceb0 0x7f27e41594c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.763+0000 7f27e9200640 1 -- 172.21.15.144:0/340276112 >> 172.21.15.144:0/340276112 conn(0x7f27e4062cc0 msgr2=0x7f27e406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.763+0000 7f27e9200640 1 -- 172.21.15.144:0/340276112 shutdown_connections 2024-09-11T23:22:54.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.763+0000 7f27e9200640 1 -- 172.21.15.144:0/340276112 wait complete. 2024-09-11T23:22:54.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.764+0000 7f27e9200640 1 Processor -- start 2024-09-11T23:22:54.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.765+0000 7f27e9200640 1 -- start start 2024-09-11T23:22:54.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.765+0000 7f27e9200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27e40d02a0 0x7f27e414b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:54.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.765+0000 7f27e9200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27e415ca40 0x7f27e4158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:54.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.765+0000 7f27e9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27e415ceb0 0x7f27e4073b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:54.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.766+0000 7f27e9200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f27e4155b90 con 0x7f27e415ceb0 2024-09-11T23:22:54.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.766+0000 7f27e9200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f27e415eb40 con 0x7f27e415ca40 2024-09-11T23:22:54.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.766+0000 7f27e9200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f27e4155d10 con 0x7f27e40d02a0 2024-09-11T23:22:54.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.766+0000 7f27e2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27e415ceb0 0x7f27e4073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:54.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.766+0000 7f27e2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27e415ceb0 0x7f27e4073b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59718/0 (socket says 172.21.15.144:59718) 2024-09-11T23:22:54.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.766+0000 7f27e2800640 1 -- 172.21.15.144:0/3049779025 learned_addr learned my addr 172.21.15.144:0/3049779025 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:54.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.766+0000 7f27e1e00640 1 --2- 172.21.15.144:0/3049779025 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27e40d02a0 0x7f27e414b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:54.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.766+0000 7f27d9400640 1 --2- 172.21.15.144:0/3049779025 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27e415ca40 0x7f27e4158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:54.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.766+0000 7f27e2800640 1 -- 172.21.15.144:0/3049779025 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27e40d02a0 msgr2=0x7f27e414b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.766+0000 7f27e2800640 1 --2- 172.21.15.144:0/3049779025 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27e40d02a0 0x7f27e414b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.766+0000 7f27e2800640 1 -- 172.21.15.144:0/3049779025 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27e415ca40 msgr2=0x7f27e4158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.766+0000 7f27e2800640 1 --2- 172.21.15.144:0/3049779025 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27e415ca40 0x7f27e4158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.766+0000 7f27e2800640 1 -- 172.21.15.144:0/3049779025 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e4072a90 con 0x7f27e415ceb0 2024-09-11T23:22:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.766+0000 7f27e1e00640 1 --2- 172.21.15.144:0/3049779025 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27e40d02a0 0x7f27e414b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:22:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.766+0000 7f27d9400640 1 --2- 172.21.15.144:0/3049779025 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27e415ca40 0x7f27e4158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:22:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.767+0000 7f27e2800640 1 --2- 172.21.15.144:0/3049779025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27e415ceb0 0x7f27e4073b30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009eb0 tx=0x7f27dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.767+0000 7f27daa00640 1 -- 172.21.15.144:0/3049779025 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc03f070 con 0x7f27e415ceb0 2024-09-11T23:22:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.767+0000 7f27daa00640 1 -- 172.21.15.144:0/3049779025 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27dc031c40 con 0x7f27e415ceb0 2024-09-11T23:22:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.767+0000 7f27daa00640 1 -- 172.21.15.144:0/3049779025 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc009450 con 0x7f27e415ceb0 2024-09-11T23:22:54.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.767+0000 7f27e9200640 1 -- 172.21.15.144:0/3049779025 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e4072d70 con 0x7f27e415ceb0 2024-09-11T23:22:54.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.767+0000 7f27e9200640 1 -- 172.21.15.144:0/3049779025 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e4073330 con 0x7f27e415ceb0 2024-09-11T23:22:54.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.768+0000 7f27e9200640 1 -- 172.21.15.144:0/3049779025 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27e40b4790 con 0x7f27e415ceb0 2024-09-11T23:22:54.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.769+0000 7f27daa00640 1 -- 172.21.15.144:0/3049779025 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f27dc043410 con 0x7f27e415ceb0 2024-09-11T23:22:54.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.770+0000 7f27daa00640 1 --2- 172.21.15.144:0/3049779025 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f27c006bf50 0x7f27c006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:54.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.770+0000 7f27daa00640 1 -- 172.21.15.144:0/3049779025 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5795+0+0 (secure 0 0 0) 0x7f27dc0ac480 con 0x7f27e415ceb0 2024-09-11T23:22:54.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.770+0000 7f27e1e00640 1 --2- 172.21.15.144:0/3049779025 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f27c006bf50 0x7f27c006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:54.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.771+0000 7f27e1e00640 1 --2- 172.21.15.144:0/3049779025 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f27c006bf50 0x7f27c006e410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f27d4001380 tx=0x7f27d4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:54.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.774+0000 7f27daa00640 1 -- 172.21.15.144:0/3049779025 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f27dc07aba0 con 0x7f27e415ceb0 2024-09-11T23:22:54.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.987+0000 7f27e9200640 1 -- 172.21.15.144:0/3049779025 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27e406d240 con 0x7f27e415ceb0 2024-09-11T23:22:54.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.987+0000 7f27daa00640 1 -- 172.21.15.144:0/3049779025 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5234 (secure 0 0 0) 0x7f27dc07a4a0 con 0x7f27e415ceb0 2024-09-11T23:22:54.988 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:54.988 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":62,"btime":"2024-09-11T23:22:51:058577+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/1166956695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1166956695},{"type":"v1","addr":"172.21.15.165:6834","nonce":1166956695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1078454545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1078454545},{"type":"v1","addr":"172.21.15.144:6834","nonce":1078454545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6421,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/214118062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":214118062},{"type":"v1","addr":"172.21.15.165:6835","nonce":214118062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:22:30.193961+0000","modified":"2024-09-11T23:22:33.209255+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6522":{"gid":6522,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1018187462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":1018187462},{"type":"v1","addr":"172.21.15.144:6835","nonce":1018187462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6522,"qdb_cluster":[6522]},"id":6}]} 2024-09-11T23:22:54.989 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 62 2024-09-11T23:22:54.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.989+0000 7f27e9200640 1 -- 172.21.15.144:0/3049779025 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f27c006bf50 msgr2=0x7f27c006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:54.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.989+0000 7f27e9200640 1 --2- 172.21.15.144:0/3049779025 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f27c006bf50 0x7f27c006e410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f27d4001380 tx=0x7f27d4009040 comp rx=0 tx=0).stop 2024-09-11T23:22:54.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.989+0000 7f27e9200640 1 -- 172.21.15.144:0/3049779025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27e415ceb0 msgr2=0x7f27e4073b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:54.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.989+0000 7f27e9200640 1 --2- 172.21.15.144:0/3049779025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27e415ceb0 0x7f27e4073b30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009eb0 tx=0x7f27dc004a40 comp rx=0 tx=0).stop 2024-09-11T23:22:54.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.990+0000 7f27e9200640 1 -- 172.21.15.144:0/3049779025 shutdown_connections 2024-09-11T23:22:54.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.990+0000 7f27e9200640 1 --2- 172.21.15.144:0/3049779025 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f27c006bf50 0x7f27c006e410 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:54.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.990+0000 7f27e9200640 1 --2- 172.21.15.144:0/3049779025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27e415ceb0 0x7f27e4073b30 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:54.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.990+0000 7f27e9200640 1 --2- 172.21.15.144:0/3049779025 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27e415ca40 0x7f27e4158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:54.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.990+0000 7f27e9200640 1 --2- 172.21.15.144:0/3049779025 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27e40d02a0 0x7f27e414b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:54.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.990+0000 7f27e9200640 1 -- 172.21.15.144:0/3049779025 >> 172.21.15.144:0/3049779025 conn(0x7f27e4062cc0 msgr2=0x7f27e406c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:54.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.990+0000 7f27e9200640 1 -- 172.21.15.144:0/3049779025 shutdown_connections 2024-09-11T23:22:54.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:54.990+0000 7f27e9200640 1 -- 172.21.15.144:0/3049779025 wait complete. 2024-09-11T23:22:55.007 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:22:55.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.161+0000 7f8c2b200640 1 Processor -- start 2024-09-11T23:22:55.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.161+0000 7f8c2b200640 1 -- start start 2024-09-11T23:22:55.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.162+0000 7f8c2b200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8c2c15a0a0 0x7f8c2c073180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:55.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.162+0000 7f8c2b200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c2c072100 con 0x7f8c2c0736c0 2024-09-11T23:22:55.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.162+0000 7f8c2b200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c2c0723c0 con 0x7f8c2c0ceb90 2024-09-11T23:22:55.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.162+0000 7f8c2b200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8c2c0726a0 con 0x7f8c2c15a0a0 2024-09-11T23:22:55.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.162+0000 7f8c21400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8c2c0736c0 0x7f8c2c0ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47300/0 (socket says 172.21.15.144:47300) 2024-09-11T23:22:55.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.162+0000 7f8c21400640 1 -- 172.21.15.144:0/326685368 learned_addr learned my addr 172.21.15.144:0/326685368 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:55.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.162+0000 7f8c29e00640 1 --2- 172.21.15.144:0/326685368 >> v2:172.21.15.165:3300/0 conn(0x7f8c2c15a0a0 0x7f8c2c073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:55.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.163+0000 7f8c29400640 1 -- 172.21.15.144:0/326685368 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1696601037 0 0) 0x7f8c2c072100 con 0x7f8c2c0736c0 2024-09-11T23:22:55.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.163+0000 7f8c29400640 1 -- 172.21.15.144:0/326685368 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c10003520 con 0x7f8c2c0736c0 2024-09-11T23:22:55.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.163+0000 7f8c29e00640 1 -- 172.21.15.144:0/326685368 >> v1:172.21.15.165:6789/0 conn(0x7f8c2c0ceb90 legacy=0x7f8c2c0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.163+0000 7f8c29e00640 1 -- 172.21.15.144:0/326685368 >> v1:172.21.15.144:6789/0 conn(0x7f8c2c0736c0 legacy=0x7f8c2c0ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.163+0000 7f8c29e00640 1 -- 172.21.15.144:0/326685368 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2c072980 con 0x7f8c2c15a0a0 2024-09-11T23:22:55.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.164+0000 7f8c29e00640 1 --2- 172.21.15.144:0/326685368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c2c15a0a0 0x7f8c2c073180 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0097a0 tx=0x7f8c1c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bfca643401eb380 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:55.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.164+0000 7f8c29400640 1 -- 172.21.15.144:0/326685368 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c037070 con 0x7f8c2c15a0a0 2024-09-11T23:22:55.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.164+0000 7f8c29400640 1 -- 172.21.15.144:0/326685368 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c1c032440 con 0x7f8c2c15a0a0 2024-09-11T23:22:55.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.164+0000 7f8c29400640 1 -- 172.21.15.144:0/326685368 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c032810 con 0x7f8c2c15a0a0 2024-09-11T23:22:55.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.165+0000 7f8c2b200640 1 -- 172.21.15.144:0/326685368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c2c15a0a0 msgr2=0x7f8c2c073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.165+0000 7f8c2b200640 1 --2- 172.21.15.144:0/326685368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c2c15a0a0 0x7f8c2c073180 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0097a0 tx=0x7f8c1c02a230 comp rx=0 tx=0).stop 2024-09-11T23:22:55.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.165+0000 7f8c2b200640 1 -- 172.21.15.144:0/326685368 shutdown_connections 2024-09-11T23:22:55.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.165+0000 7f8c2b200640 1 --2- 172.21.15.144:0/326685368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c2c15a0a0 0x7f8c2c073180 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.165+0000 7f8c2b200640 1 -- 172.21.15.144:0/326685368 >> 172.21.15.144:0/326685368 conn(0x7f8c2c06e910 msgr2=0x7f8c2c06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:55.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.165+0000 7f8c2b200640 1 -- 172.21.15.144:0/326685368 shutdown_connections 2024-09-11T23:22:55.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.165+0000 7f8c2b200640 1 -- 172.21.15.144:0/326685368 wait complete. 2024-09-11T23:22:55.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.166+0000 7f8c2b200640 1 Processor -- start 2024-09-11T23:22:55.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.167+0000 7f8c2b200640 1 -- start start 2024-09-11T23:22:55.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.167+0000 7f8c2b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c2c0ceb90 0x7f8c2c0ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:55.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.167+0000 7f8c2b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c2c15a0a0 0x7f8c2c15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:55.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.167+0000 7f8c2b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c2c0aee50 0x7f8c2c0abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:55.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.167+0000 7f8c2b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c0cf240 con 0x7f8c2c15a0a0 2024-09-11T23:22:55.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.167+0000 7f8c2b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c0b2720 con 0x7f8c2c0aee50 2024-09-11T23:22:55.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.167+0000 7f8c2b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8c2c0cf3c0 con 0x7f8c2c0ceb90 2024-09-11T23:22:55.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.168+0000 7f8c21400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c2c15a0a0 0x7f8c2c15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:55.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.168+0000 7f8c21400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c2c15a0a0 0x7f8c2c15efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59720/0 (socket says 172.21.15.144:59720) 2024-09-11T23:22:55.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.168+0000 7f8c21400640 1 -- 172.21.15.144:0/4173838700 learned_addr learned my addr 172.21.15.144:0/4173838700 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:55.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.168+0000 7f8c21400640 1 -- 172.21.15.144:0/4173838700 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c2c0ceb90 msgr2=0x7f8c2c0ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.168+0000 7f8c21400640 1 --2- 172.21.15.144:0/4173838700 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c2c0ceb90 0x7f8c2c0ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.168+0000 7f8c21400640 1 -- 172.21.15.144:0/4173838700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c2c0aee50 msgr2=0x7f8c2c0abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.168+0000 7f8c21400640 1 --2- 172.21.15.144:0/4173838700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c2c0aee50 0x7f8c2c0abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.168+0000 7f8c21400640 1 -- 172.21.15.144:0/4173838700 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2c0addb0 con 0x7f8c2c15a0a0 2024-09-11T23:22:55.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.168+0000 7f8c21400640 1 --2- 172.21.15.144:0/4173838700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c2c15a0a0 0x7f8c2c15efc0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400c500 tx=0x7f8c1400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:55.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.168+0000 7f8c22a00640 1 -- 172.21.15.144:0/4173838700 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c14017070 con 0x7f8c2c15a0a0 2024-09-11T23:22:55.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.169+0000 7f8c22a00640 1 -- 172.21.15.144:0/4173838700 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c14005ce0 con 0x7f8c2c15a0a0 2024-09-11T23:22:55.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.169+0000 7f8c22a00640 1 -- 172.21.15.144:0/4173838700 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c14007330 con 0x7f8c2c15a0a0 2024-09-11T23:22:55.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.169+0000 7f8c2b200640 1 -- 172.21.15.144:0/4173838700 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c2c0ae090 con 0x7f8c2c15a0a0 2024-09-11T23:22:55.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.169+0000 7f8c2b200640 1 -- 172.21.15.144:0/4173838700 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c2c0ae930 con 0x7f8c2c15a0a0 2024-09-11T23:22:55.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.170+0000 7f8c2b200640 1 -- 172.21.15.144:0/4173838700 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c2c0ae260 con 0x7f8c2c15a0a0 2024-09-11T23:22:55.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.171+0000 7f8c22a00640 1 -- 172.21.15.144:0/4173838700 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f8c1401a070 con 0x7f8c2c15a0a0 2024-09-11T23:22:55.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.172+0000 7f8c22a00640 1 --2- 172.21.15.144:0/4173838700 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8c0806bf50 0x7f8c0806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:55.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.172+0000 7f8c22a00640 1 -- 172.21.15.144:0/4173838700 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5795+0+0 (secure 0 0 0) 0x7f8c1408a4b0 con 0x7f8c2c15a0a0 2024-09-11T23:22:55.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.172+0000 7f8c29e00640 1 --2- 172.21.15.144:0/4173838700 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8c0806bf50 0x7f8c0806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:55.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.173+0000 7f8c29e00640 1 --2- 172.21.15.144:0/4173838700 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8c0806bf50 0x7f8c0806e410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c034000 tx=0x7f8c1c02c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:55.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.176+0000 7f8c22a00640 1 -- 172.21.15.144:0/4173838700 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8c14058da0 con 0x7f8c2c15a0a0 2024-09-11T23:22:55.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.385+0000 7f8c2b200640 1 -- 172.21.15.144:0/4173838700 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c2c0aeb30 con 0x7f8c2c15a0a0 2024-09-11T23:22:55.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.386+0000 7f8c22a00640 1 -- 172.21.15.144:0/4173838700 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5234 (secure 0 0 0) 0x7f8c2c0aeb30 con 0x7f8c2c15a0a0 2024-09-11T23:22:55.387 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:55.387 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":62,"btime":"2024-09-11T23:22:51:058577+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/1166956695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1166956695},{"type":"v1","addr":"172.21.15.165:6834","nonce":1166956695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1078454545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1078454545},{"type":"v1","addr":"172.21.15.144:6834","nonce":1078454545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6421,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/214118062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":214118062},{"type":"v1","addr":"172.21.15.165:6835","nonce":214118062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:22:30.193961+0000","modified":"2024-09-11T23:22:33.209255+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6522":{"gid":6522,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1018187462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":1018187462},{"type":"v1","addr":"172.21.15.144:6835","nonce":1018187462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6522,"qdb_cluster":[6522]},"id":6}]} 2024-09-11T23:22:55.387 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 62 2024-09-11T23:22:55.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.388+0000 7f8c2b200640 1 -- 172.21.15.144:0/4173838700 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8c0806bf50 msgr2=0x7f8c0806e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.388+0000 7f8c2b200640 1 --2- 172.21.15.144:0/4173838700 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8c0806bf50 0x7f8c0806e410 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c034000 tx=0x7f8c1c02c000 comp rx=0 tx=0).stop 2024-09-11T23:22:55.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.388+0000 7f8c2b200640 1 -- 172.21.15.144:0/4173838700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c2c15a0a0 msgr2=0x7f8c2c15efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.388+0000 7f8c2b200640 1 --2- 172.21.15.144:0/4173838700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c2c15a0a0 0x7f8c2c15efc0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400c500 tx=0x7f8c1400c9c0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.388+0000 7f8c2b200640 1 -- 172.21.15.144:0/4173838700 shutdown_connections 2024-09-11T23:22:55.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.388+0000 7f8c2b200640 1 --2- 172.21.15.144:0/4173838700 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8c0806bf50 0x7f8c0806e410 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.388+0000 7f8c2b200640 1 --2- 172.21.15.144:0/4173838700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c2c0aee50 0x7f8c2c0abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.388+0000 7f8c2b200640 1 --2- 172.21.15.144:0/4173838700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c2c15a0a0 0x7f8c2c15efc0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.388+0000 7f8c2b200640 1 --2- 172.21.15.144:0/4173838700 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8c2c0ceb90 0x7f8c2c0ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.388+0000 7f8c2b200640 1 -- 172.21.15.144:0/4173838700 >> 172.21.15.144:0/4173838700 conn(0x7f8c2c06e910 msgr2=0x7f8c2c0cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:55.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.388+0000 7f8c2b200640 1 -- 172.21.15.144:0/4173838700 shutdown_connections 2024-09-11T23:22:55.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.388+0000 7f8c2b200640 1 -- 172.21.15.144:0/4173838700 wait complete. 2024-09-11T23:22:55.406 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:22:55.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.558+0000 7ff26e400640 1 Processor -- start 2024-09-11T23:22:55.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.558+0000 7ff26e400640 1 -- start start 2024-09-11T23:22:55.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.559+0000 7ff26e400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff268073830 0x7ff2680cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:55.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.559+0000 7ff26e400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2680ce740 con 0x7ff2680cf070 2024-09-11T23:22:55.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.559+0000 7ff26e400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff268072640 con 0x7ff26815c180 2024-09-11T23:22:55.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.559+0000 7ff26e400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff268072920 con 0x7ff268073830 2024-09-11T23:22:55.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.560+0000 7ff25ea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff2680cf070 0x7ff268073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47308/0 (socket says 172.21.15.144:47308) 2024-09-11T23:22:55.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.560+0000 7ff25ea00640 1 -- 172.21.15.144:0/2322735549 learned_addr learned my addr 172.21.15.144:0/2322735549 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.560+0000 7ff267e00640 1 --2- 172.21.15.144:0/2322735549 >> v2:172.21.15.165:3300/0 conn(0x7ff268073830 0x7ff2680cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.560+0000 7ff266a00640 1 -- 172.21.15.144:0/2322735549 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2515243648 0 0) 0x7ff2680ce740 con 0x7ff2680cf070 2024-09-11T23:22:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.560+0000 7ff266a00640 1 -- 172.21.15.144:0/2322735549 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff24c003520 con 0x7ff2680cf070 2024-09-11T23:22:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.560+0000 7ff267e00640 1 -- 172.21.15.144:0/2322735549 >> v1:172.21.15.165:6789/0 conn(0x7ff26815c180 legacy=0x7ff2680cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.560+0000 7ff267e00640 1 -- 172.21.15.144:0/2322735549 >> v1:172.21.15.144:6789/0 conn(0x7ff2680cf070 legacy=0x7ff268073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.560+0000 7ff267e00640 1 -- 172.21.15.144:0/2322735549 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff268072c00 con 0x7ff268073830 2024-09-11T23:22:55.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.561+0000 7ff267e00640 1 --2- 172.21.15.144:0/2322735549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff268073830 0x7ff2680cf4e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff260009d90 tx=0x7ff26002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66c724ce9d6800dc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:55.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.562+0000 7ff266a00640 1 -- 172.21.15.144:0/2322735549 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260007740 con 0x7ff268073830 2024-09-11T23:22:55.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.562+0000 7ff266a00640 1 -- 172.21.15.144:0/2322735549 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2600078e0 con 0x7ff268073830 2024-09-11T23:22:55.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.562+0000 7ff266a00640 1 -- 172.21.15.144:0/2322735549 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260007cb0 con 0x7ff268073830 2024-09-11T23:22:55.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.562+0000 7ff26e400640 1 -- 172.21.15.144:0/2322735549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff268073830 msgr2=0x7ff2680cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.562+0000 7ff26e400640 1 --2- 172.21.15.144:0/2322735549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff268073830 0x7ff2680cf4e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff260009d90 tx=0x7ff26002a660 comp rx=0 tx=0).stop 2024-09-11T23:22:55.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.562+0000 7ff26e400640 1 -- 172.21.15.144:0/2322735549 shutdown_connections 2024-09-11T23:22:55.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.562+0000 7ff26e400640 1 --2- 172.21.15.144:0/2322735549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff268073830 0x7ff2680cf4e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.562+0000 7ff26e400640 1 -- 172.21.15.144:0/2322735549 >> 172.21.15.144:0/2322735549 conn(0x7ff268062cc0 msgr2=0x7ff26806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:55.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.562+0000 7ff26e400640 1 -- 172.21.15.144:0/2322735549 shutdown_connections 2024-09-11T23:22:55.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.562+0000 7ff26e400640 1 -- 172.21.15.144:0/2322735549 wait complete. 2024-09-11T23:22:55.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.564+0000 7ff26e400640 1 Processor -- start 2024-09-11T23:22:55.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.564+0000 7ff26e400640 1 -- start start 2024-09-11T23:22:55.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.565+0000 7ff26e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff268073830 0x7ff26815f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:55.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.565+0000 7ff26e400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2680cf070 0x7ff26815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:55.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.565+0000 7ff26e400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff26815c180 0x7ff26815ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:55.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.565+0000 7ff26e400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff2680722f0 con 0x7ff268073830 2024-09-11T23:22:55.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.565+0000 7ff26e400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff2680ced00 con 0x7ff26815c180 2024-09-11T23:22:55.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.565+0000 7ff26e400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff26815c560 con 0x7ff2680cf070 2024-09-11T23:22:55.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.565+0000 7ff267400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff268073830 0x7ff26815f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:55.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.565+0000 7ff267400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff268073830 0x7ff26815f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59736/0 (socket says 172.21.15.144:59736) 2024-09-11T23:22:55.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.565+0000 7ff267400640 1 -- 172.21.15.144:0/687085608 learned_addr learned my addr 172.21.15.144:0/687085608 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:55.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.565+0000 7ff267e00640 1 --2- 172.21.15.144:0/687085608 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff26815c180 0x7ff26815ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:55.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.565+0000 7ff25ea00640 1 --2- 172.21.15.144:0/687085608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2680cf070 0x7ff26815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:55.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.566+0000 7ff267400640 1 -- 172.21.15.144:0/687085608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2680cf070 msgr2=0x7ff26815c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.566+0000 7ff267400640 1 --2- 172.21.15.144:0/687085608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2680cf070 0x7ff26815c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.566+0000 7ff267400640 1 -- 172.21.15.144:0/687085608 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff26815c180 msgr2=0x7ff26815ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.566+0000 7ff267400640 1 --2- 172.21.15.144:0/687085608 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff26815c180 0x7ff26815ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.566+0000 7ff267400640 1 -- 172.21.15.144:0/687085608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26815d510 con 0x7ff268073830 2024-09-11T23:22:55.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.566+0000 7ff25ea00640 1 --2- 172.21.15.144:0/687085608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2680cf070 0x7ff26815c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:55.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.566+0000 7ff267400640 1 --2- 172.21.15.144:0/687085608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff268073830 0x7ff26815f340 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ff25800c3c0 tx=0x7ff25800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:55.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.566+0000 7ff25fe00640 1 -- 172.21.15.144:0/687085608 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2580052d0 con 0x7ff268073830 2024-09-11T23:22:55.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.566+0000 7ff25fe00640 1 -- 172.21.15.144:0/687085608 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff258005490 con 0x7ff268073830 2024-09-11T23:22:55.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.566+0000 7ff25fe00640 1 -- 172.21.15.144:0/687085608 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258007260 con 0x7ff268073830 2024-09-11T23:22:55.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.566+0000 7ff26e400640 1 -- 172.21.15.144:0/687085608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff26815d7f0 con 0x7ff268073830 2024-09-11T23:22:55.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.566+0000 7ff26e400640 1 -- 172.21.15.144:0/687085608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff26815ddb0 con 0x7ff268073830 2024-09-11T23:22:55.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.567+0000 7ff26e400640 1 -- 172.21.15.144:0/687085608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2680cf4e0 con 0x7ff268073830 2024-09-11T23:22:55.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.568+0000 7ff25fe00640 1 -- 172.21.15.144:0/687085608 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7ff258007400 con 0x7ff268073830 2024-09-11T23:22:55.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.569+0000 7ff25fe00640 1 --2- 172.21.15.144:0/687085608 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff24406bf80 0x7ff24406e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:55.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.569+0000 7ff25fe00640 1 -- 172.21.15.144:0/687085608 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5795+0+0 (secure 0 0 0) 0x7ff25808a4a0 con 0x7ff268073830 2024-09-11T23:22:55.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.570+0000 7ff25ea00640 1 --2- 172.21.15.144:0/687085608 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff24406bf80 0x7ff24406e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:55.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.570+0000 7ff25ea00640 1 --2- 172.21.15.144:0/687085608 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff24406bf80 0x7ff24406e440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff26815ae50 tx=0x7ff250009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:55.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.574+0000 7ff25fe00640 1 -- 172.21.15.144:0/687085608 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff2580585f0 con 0x7ff268073830 2024-09-11T23:22:55.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.748+0000 7ff26e400640 1 -- 172.21.15.144:0/687085608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2680d0560 con 0x7ff268073830 2024-09-11T23:22:55.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.749+0000 7ff25fe00640 1 -- 172.21.15.144:0/687085608 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+16875 (secure 0 0 0) 0x7ff25805c8f0 con 0x7ff268073830 2024-09-11T23:22:55.750 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:55.751 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":90,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:22:53.067148+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:22:27.959542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-11T23:22:29.190371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.165:6835/3966608439":"2024-09-12T23:22:50.055731+0000","172.21.15.165:6833/3966608439":"2024-09-12T23:22:50.055731+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:22:55.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.752+0000 7ff26e400640 1 -- 172.21.15.144:0/687085608 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff24406bf80 msgr2=0x7ff24406e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.752+0000 7ff26e400640 1 --2- 172.21.15.144:0/687085608 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff24406bf80 0x7ff24406e440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff26815ae50 tx=0x7ff250009040 comp rx=0 tx=0).stop 2024-09-11T23:22:55.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.752+0000 7ff26e400640 1 -- 172.21.15.144:0/687085608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff268073830 msgr2=0x7ff26815f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.752+0000 7ff26e400640 1 --2- 172.21.15.144:0/687085608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff268073830 0x7ff26815f340 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ff25800c3c0 tx=0x7ff25800c880 comp rx=0 tx=0).stop 2024-09-11T23:22:55.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.752+0000 7ff26e400640 1 -- 172.21.15.144:0/687085608 shutdown_connections 2024-09-11T23:22:55.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.752+0000 7ff26e400640 1 --2- 172.21.15.144:0/687085608 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff24406bf80 0x7ff24406e440 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.752+0000 7ff26e400640 1 --2- 172.21.15.144:0/687085608 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff26815c180 0x7ff26815ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.752+0000 7ff26e400640 1 --2- 172.21.15.144:0/687085608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2680cf070 0x7ff26815c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.752+0000 7ff26e400640 1 --2- 172.21.15.144:0/687085608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff268073830 0x7ff26815f340 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.752+0000 7ff26e400640 1 -- 172.21.15.144:0/687085608 >> 172.21.15.144:0/687085608 conn(0x7ff268062cc0 msgr2=0x7ff2680cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:55.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.752+0000 7ff26e400640 1 -- 172.21.15.144:0/687085608 shutdown_connections 2024-09-11T23:22:55.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.752+0000 7ff26e400640 1 -- 172.21.15.144:0/687085608 wait complete. 2024-09-11T23:22:55.769 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:22:55.769 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:22:55.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.922+0000 7fbe58400640 1 Processor -- start 2024-09-11T23:22:55.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.922+0000 7fbe58400640 1 -- start start 2024-09-11T23:22:55.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.923+0000 7fbe58400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbe50151c50 0x7fbe500cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:55.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.923+0000 7fbe58400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe5006c1f0 0x7fbe5015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:55.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.923+0000 7fbe58400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe500cd5f0 con 0x7fbe5006be10 2024-09-11T23:22:55.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.923+0000 7fbe58400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fbe500cd8d0 con 0x7fbe50151c50 2024-09-11T23:22:55.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.923+0000 7fbe58400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbe500cdbb0 con 0x7fbe5006c1f0 2024-09-11T23:22:55.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.924+0000 7fbe56400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe5006c1f0 0x7fbe5015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:55.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.924+0000 7fbe55000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbe50151c50 0x7fbe500cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:55.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.924+0000 7fbe56400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe5006c1f0 0x7fbe5015baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50960/0 (socket says 172.21.15.144:50960) 2024-09-11T23:22:55.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.924+0000 7fbe56400640 1 -- 172.21.15.144:0/1781795067 learned_addr learned my addr 172.21.15.144:0/1781795067 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:55.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.924+0000 7fbe55000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbe50151c50 0x7fbe500cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:33982/0 (socket says 172.21.15.144:33982) 2024-09-11T23:22:55.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.925+0000 7fbe56400640 1 -- 172.21.15.144:0/1781795067 >> v2:172.21.15.165:3300/0 conn(0x7fbe50151c50 msgr2=0x7fbe500cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:55.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.925+0000 7fbe56400640 1 --2- 172.21.15.144:0/1781795067 >> v2:172.21.15.165:3300/0 conn(0x7fbe50151c50 0x7fbe500cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.925+0000 7fbe56400640 1 -- 172.21.15.144:0/1781795067 >> v1:172.21.15.165:6789/0 conn(0x7fbe5006be10 legacy=0x7fbe50151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.925+0000 7fbe56400640 1 -- 172.21.15.144:0/1781795067 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe500cde90 con 0x7fbe5006c1f0 2024-09-11T23:22:55.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.925+0000 7fbe55000640 1 --2- 172.21.15.144:0/1781795067 >> v2:172.21.15.165:3300/0 conn(0x7fbe50151c50 0x7fbe500cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:22:55.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.926+0000 7fbe56400640 1 --2- 172.21.15.144:0/1781795067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe5006c1f0 0x7fbe5015baa0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbe48009e50 tx=0x7fbe4802a730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6703e1ce43ad6175 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:55.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.926+0000 7fbe4fe00640 1 -- 172.21.15.144:0/1781795067 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe48036070 con 0x7fbe5006c1f0 2024-09-11T23:22:55.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.926+0000 7fbe4fe00640 1 -- 172.21.15.144:0/1781795067 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe48031600 con 0x7fbe5006c1f0 2024-09-11T23:22:55.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.926+0000 7fbe4fe00640 1 -- 172.21.15.144:0/1781795067 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe480319d0 con 0x7fbe5006c1f0 2024-09-11T23:22:55.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.927+0000 7fbe58400640 1 -- 172.21.15.144:0/1781795067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe5006c1f0 msgr2=0x7fbe5015baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.927+0000 7fbe58400640 1 --2- 172.21.15.144:0/1781795067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe5006c1f0 0x7fbe5015baa0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbe48009e50 tx=0x7fbe4802a730 comp rx=0 tx=0).stop 2024-09-11T23:22:55.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.927+0000 7fbe58400640 1 -- 172.21.15.144:0/1781795067 shutdown_connections 2024-09-11T23:22:55.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.927+0000 7fbe58400640 1 --2- 172.21.15.144:0/1781795067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe5006c1f0 0x7fbe5015baa0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.927+0000 7fbe58400640 1 --2- 172.21.15.144:0/1781795067 >> v2:172.21.15.165:3300/0 conn(0x7fbe50151c50 0x7fbe500cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.927+0000 7fbe58400640 1 -- 172.21.15.144:0/1781795067 >> 172.21.15.144:0/1781795067 conn(0x7fbe50062cc0 msgr2=0x7fbe5006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:55.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.927+0000 7fbe58400640 1 -- 172.21.15.144:0/1781795067 shutdown_connections 2024-09-11T23:22:55.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.927+0000 7fbe58400640 1 -- 172.21.15.144:0/1781795067 wait complete. 2024-09-11T23:22:55.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.928+0000 7fbe58400640 1 Processor -- start 2024-09-11T23:22:55.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.929+0000 7fbe58400640 1 -- start start 2024-09-11T23:22:55.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.929+0000 7fbe58400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe5006be10 0x7fbe501596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:55.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.929+0000 7fbe58400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe5006c1f0 0x7fbe50159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:55.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.929+0000 7fbe58400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe50151c50 0x7fbe500ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:55.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.929+0000 7fbe58400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbe500d0310 con 0x7fbe5006be10 2024-09-11T23:22:55.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.929+0000 7fbe58400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbe500ce690 con 0x7fbe5006c1f0 2024-09-11T23:22:55.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.929+0000 7fbe58400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbe500d0490 con 0x7fbe50151c50 2024-09-11T23:22:55.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.930+0000 7fbe55a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe5006be10 0x7fbe501596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:55.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.930+0000 7fbe55a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe5006be10 0x7fbe501596d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59740/0 (socket says 172.21.15.144:59740) 2024-09-11T23:22:55.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.930+0000 7fbe55a00640 1 -- 172.21.15.144:0/279178455 learned_addr learned my addr 172.21.15.144:0/279178455 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:55.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.930+0000 7fbe55000640 1 --2- 172.21.15.144:0/279178455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe5006c1f0 0x7fbe50159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:55.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.930+0000 7fbe56400640 1 --2- 172.21.15.144:0/279178455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe50151c50 0x7fbe500ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:55.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.930+0000 7fbe55a00640 1 -- 172.21.15.144:0/279178455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe50151c50 msgr2=0x7fbe500ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.930+0000 7fbe55a00640 1 --2- 172.21.15.144:0/279178455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe50151c50 0x7fbe500ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.930+0000 7fbe55a00640 1 -- 172.21.15.144:0/279178455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe5006c1f0 msgr2=0x7fbe50159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:55.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.930+0000 7fbe55a00640 1 --2- 172.21.15.144:0/279178455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe5006c1f0 0x7fbe50159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:55.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.930+0000 7fbe55a00640 1 -- 172.21.15.144:0/279178455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe50152150 con 0x7fbe5006be10 2024-09-11T23:22:55.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.930+0000 7fbe55a00640 1 --2- 172.21.15.144:0/279178455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe5006be10 0x7fbe501596d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400c430 tx=0x7fbe4400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:55.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.931+0000 7fbe4d600640 1 -- 172.21.15.144:0/279178455 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe440052d0 con 0x7fbe5006be10 2024-09-11T23:22:55.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.931+0000 7fbe4d600640 1 -- 172.21.15.144:0/279178455 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe44005490 con 0x7fbe5006be10 2024-09-11T23:22:55.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.931+0000 7fbe58400640 1 -- 172.21.15.144:0/279178455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe50152430 con 0x7fbe5006be10 2024-09-11T23:22:55.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.931+0000 7fbe4d600640 1 -- 172.21.15.144:0/279178455 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe44007260 con 0x7fbe5006be10 2024-09-11T23:22:55.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.931+0000 7fbe58400640 1 -- 172.21.15.144:0/279178455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe501529f0 con 0x7fbe5006be10 2024-09-11T23:22:55.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.932+0000 7fbe58400640 1 -- 172.21.15.144:0/279178455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe500d08c0 con 0x7fbe5006be10 2024-09-11T23:22:55.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.933+0000 7fbe4d600640 1 -- 172.21.15.144:0/279178455 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fbe44007400 con 0x7fbe5006be10 2024-09-11T23:22:55.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.933+0000 7fbe4d600640 1 --2- 172.21.15.144:0/279178455 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe3006bf80 0x7fbe3006e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:55.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.934+0000 7fbe4d600640 1 -- 172.21.15.144:0/279178455 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5795+0+0 (secure 0 0 0) 0x7fbe4408a510 con 0x7fbe5006be10 2024-09-11T23:22:55.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.934+0000 7fbe55000640 1 --2- 172.21.15.144:0/279178455 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe3006bf80 0x7fbe3006e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:55.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.935+0000 7fbe55000640 1 --2- 172.21.15.144:0/279178455 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe3006bf80 0x7fbe3006e440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbe500afb40 tx=0x7fbe3c00a2a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:55.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:55.937+0000 7fbe4d600640 1 -- 172.21.15.144:0/279178455 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe440586f0 con 0x7fbe5006be10 2024-09-11T23:22:56.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.147+0000 7fbe58400640 1 -- 172.21.15.144:0/279178455 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe501513b0 con 0x7fbe5006be10 2024-09-11T23:22:56.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.148+0000 7fbe4d600640 1 -- 172.21.15.144:0/279178455 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5234 (secure 0 0 0) 0x7fbe4405c9f0 con 0x7fbe5006be10 2024-09-11T23:22:56.149 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:56.149 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":62,"btime":"2024-09-11T23:22:51:058577+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/1166956695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1166956695},{"type":"v1","addr":"172.21.15.165:6834","nonce":1166956695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1078454545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1078454545},{"type":"v1","addr":"172.21.15.144:6834","nonce":1078454545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6421,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/214118062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":214118062},{"type":"v1","addr":"172.21.15.165:6835","nonce":214118062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:22:30.193961+0000","modified":"2024-09-11T23:22:33.209255+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6522":{"gid":6522,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1018187462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":1018187462},{"type":"v1","addr":"172.21.15.144:6835","nonce":1018187462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6522,"qdb_cluster":[6522]},"id":6}]} 2024-09-11T23:22:56.150 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 62 2024-09-11T23:22:56.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.150+0000 7fbe58400640 1 -- 172.21.15.144:0/279178455 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe3006bf80 msgr2=0x7fbe3006e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:56.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.150+0000 7fbe58400640 1 --2- 172.21.15.144:0/279178455 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe3006bf80 0x7fbe3006e440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbe500afb40 tx=0x7fbe3c00a2a0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.150+0000 7fbe58400640 1 -- 172.21.15.144:0/279178455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe5006be10 msgr2=0x7fbe501596d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:56.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.150+0000 7fbe58400640 1 --2- 172.21.15.144:0/279178455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe5006be10 0x7fbe501596d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400c430 tx=0x7fbe4400c8f0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.150+0000 7fbe58400640 1 -- 172.21.15.144:0/279178455 shutdown_connections 2024-09-11T23:22:56.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.151+0000 7fbe58400640 1 --2- 172.21.15.144:0/279178455 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe3006bf80 0x7fbe3006e440 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.151+0000 7fbe58400640 1 --2- 172.21.15.144:0/279178455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe50151c50 0x7fbe500ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.151+0000 7fbe58400640 1 --2- 172.21.15.144:0/279178455 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe5006c1f0 0x7fbe50159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.151+0000 7fbe58400640 1 --2- 172.21.15.144:0/279178455 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe5006be10 0x7fbe501596d0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.151+0000 7fbe58400640 1 -- 172.21.15.144:0/279178455 >> 172.21.15.144:0/279178455 conn(0x7fbe50062cc0 msgr2=0x7fbe500b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:56.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.151+0000 7fbe58400640 1 -- 172.21.15.144:0/279178455 shutdown_connections 2024-09-11T23:22:56.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.151+0000 7fbe58400640 1 -- 172.21.15.144:0/279178455 wait complete. 2024-09-11T23:22:56.167 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:22:56.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.319+0000 7fa04ba00640 1 Processor -- start 2024-09-11T23:22:56.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.319+0000 7fa04ba00640 1 -- start start 2024-09-11T23:22:56.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.320+0000 7fa04ba00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0440d02a0 0x7fa0440d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:56.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.320+0000 7fa04ba00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa04415ce80 0x7fa0441594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:56.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.320+0000 7fa04ba00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0440d0bc0 con 0x7fa04415ca40 2024-09-11T23:22:56.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.320+0000 7fa04ba00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa04415d390 con 0x7fa04415ce80 2024-09-11T23:22:56.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.320+0000 7fa04ba00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa04415d670 con 0x7fa0440d02a0 2024-09-11T23:22:56.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.321+0000 7fa049a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa04415ce80 0x7fa0441594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:56.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.321+0000 7fa049a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa04415ce80 0x7fa0441594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59750/0 (socket says 172.21.15.144:59750) 2024-09-11T23:22:56.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.321+0000 7fa049a00640 1 -- 172.21.15.144:0/3979374000 learned_addr learned my addr 172.21.15.144:0/3979374000 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:56.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.321+0000 7fa049000640 1 --2- 172.21.15.144:0/3979374000 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0440d02a0 0x7fa0440d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:56.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.321+0000 7fa049a00640 1 -- 172.21.15.144:0/3979374000 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0440d02a0 msgr2=0x7fa0440d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:56.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.321+0000 7fa049a00640 1 --2- 172.21.15.144:0/3979374000 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0440d02a0 0x7fa0440d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.321+0000 7fa049a00640 1 -- 172.21.15.144:0/3979374000 >> v1:172.21.15.165:6789/0 conn(0x7fa04415ca40 legacy=0x7fa04415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:56.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.321+0000 7fa049a00640 1 -- 172.21.15.144:0/3979374000 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04415d950 con 0x7fa04415ce80 2024-09-11T23:22:56.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.322+0000 7fa049a00640 1 --2- 172.21.15.144:0/3979374000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa04415ce80 0x7fa0441594c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009e50 tx=0x7fa03c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d67e95fccb1847 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:56.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.322+0000 7fa043400640 1 -- 172.21.15.144:0/3979374000 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c036070 con 0x7fa04415ce80 2024-09-11T23:22:56.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.322+0000 7fa043400640 1 -- 172.21.15.144:0/3979374000 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa03c031600 con 0x7fa04415ce80 2024-09-11T23:22:56.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.322+0000 7fa043400640 1 -- 172.21.15.144:0/3979374000 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c0319d0 con 0x7fa04415ce80 2024-09-11T23:22:56.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.323+0000 7fa04ba00640 1 -- 172.21.15.144:0/3979374000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa04415ce80 msgr2=0x7fa0441594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:56.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.323+0000 7fa04ba00640 1 --2- 172.21.15.144:0/3979374000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa04415ce80 0x7fa0441594c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009e50 tx=0x7fa03c02a680 comp rx=0 tx=0).stop 2024-09-11T23:22:56.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.323+0000 7fa04ba00640 1 -- 172.21.15.144:0/3979374000 shutdown_connections 2024-09-11T23:22:56.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.323+0000 7fa04ba00640 1 --2- 172.21.15.144:0/3979374000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa04415ce80 0x7fa0441594c0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.323+0000 7fa04ba00640 1 --2- 172.21.15.144:0/3979374000 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0440d02a0 0x7fa0440d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.323+0000 7fa04ba00640 1 -- 172.21.15.144:0/3979374000 >> 172.21.15.144:0/3979374000 conn(0x7fa044062cc0 msgr2=0x7fa04406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:56.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.323+0000 7fa04ba00640 1 -- 172.21.15.144:0/3979374000 shutdown_connections 2024-09-11T23:22:56.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.323+0000 7fa04ba00640 1 -- 172.21.15.144:0/3979374000 wait complete. 2024-09-11T23:22:56.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.325+0000 7fa04ba00640 1 Processor -- start 2024-09-11T23:22:56.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.325+0000 7fa04ba00640 1 -- start start 2024-09-11T23:22:56.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.326+0000 7fa04ba00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0440d02a0 0x7fa044159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:56.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.326+0000 7fa04ba00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa04415ca40 0x7fa04414ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:56.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.326+0000 7fa04ba00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa04415ce80 0x7fa044071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:56.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.326+0000 7fa04ba00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa04415eb40 con 0x7fa04415ce80 2024-09-11T23:22:56.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.326+0000 7fa04ba00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa04415df10 con 0x7fa0440d02a0 2024-09-11T23:22:56.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.326+0000 7fa04ba00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa044155b90 con 0x7fa04415ca40 2024-09-11T23:22:56.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.326+0000 7fa049a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa04415ce80 0x7fa044071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:56.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.326+0000 7fa049a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa04415ce80 0x7fa044071070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59760/0 (socket says 172.21.15.144:59760) 2024-09-11T23:22:56.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.326+0000 7fa049a00640 1 -- 172.21.15.144:0/2823625314 learned_addr learned my addr 172.21.15.144:0/2823625314 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:56.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.326+0000 7fa049000640 1 --2- 172.21.15.144:0/2823625314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0440d02a0 0x7fa044159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:56.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.326+0000 7fa043e00640 1 --2- 172.21.15.144:0/2823625314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa04415ca40 0x7fa04414ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:56.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.326+0000 7fa049a00640 1 -- 172.21.15.144:0/2823625314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa04415ca40 msgr2=0x7fa04414ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:56.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.326+0000 7fa049a00640 1 --2- 172.21.15.144:0/2823625314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa04415ca40 0x7fa04414ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.326+0000 7fa049a00640 1 -- 172.21.15.144:0/2823625314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0440d02a0 msgr2=0x7fa044159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:56.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.326+0000 7fa049a00640 1 --2- 172.21.15.144:0/2823625314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0440d02a0 0x7fa044159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.326+0000 7fa049a00640 1 -- 172.21.15.144:0/2823625314 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04415a700 con 0x7fa04415ce80 2024-09-11T23:22:56.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.327+0000 7fa049a00640 1 --2- 172.21.15.144:0/2823625314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa04415ce80 0x7fa044071070 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa03c034040 tx=0x7fa03c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:56.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.327+0000 7fa040c00640 1 -- 172.21.15.144:0/2823625314 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c03f020 con 0x7fa04415ce80 2024-09-11T23:22:56.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.327+0000 7fa040c00640 1 -- 172.21.15.144:0/2823625314 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa03c037040 con 0x7fa04415ce80 2024-09-11T23:22:56.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.327+0000 7fa04ba00640 1 -- 172.21.15.144:0/2823625314 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa04415a9e0 con 0x7fa04415ce80 2024-09-11T23:22:56.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.327+0000 7fa040c00640 1 -- 172.21.15.144:0/2823625314 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c036070 con 0x7fa04415ce80 2024-09-11T23:22:56.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.327+0000 7fa04ba00640 1 -- 172.21.15.144:0/2823625314 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa04415afa0 con 0x7fa04415ce80 2024-09-11T23:22:56.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.328+0000 7fa04ba00640 1 -- 172.21.15.144:0/2823625314 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa044069b00 con 0x7fa04415ce80 2024-09-11T23:22:56.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.329+0000 7fa040c00640 1 -- 172.21.15.144:0/2823625314 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fa03c042020 con 0x7fa04415ce80 2024-09-11T23:22:56.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.330+0000 7fa040c00640 1 --2- 172.21.15.144:0/2823625314 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa02406bf50 0x7fa02406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:56.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.330+0000 7fa040c00640 1 -- 172.21.15.144:0/2823625314 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5795+0+0 (secure 0 0 0) 0x7fa03c0ab630 con 0x7fa04415ce80 2024-09-11T23:22:56.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.330+0000 7fa049000640 1 --2- 172.21.15.144:0/2823625314 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa02406bf50 0x7fa02406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:56.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.331+0000 7fa049000640 1 --2- 172.21.15.144:0/2823625314 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa02406bf50 0x7fa02406e410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa0440cc7e0 tx=0x7fa038008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:56.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.334+0000 7fa040c00640 1 -- 172.21.15.144:0/2823625314 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa044069b00 con 0x7fa04415ce80 2024-09-11T23:22:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.542+0000 7fa04ba00640 1 -- 172.21.15.144:0/2823625314 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0440b4790 con 0x7fa04415ce80 2024-09-11T23:22:56.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.543+0000 7fa040c00640 1 -- 172.21.15.144:0/2823625314 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5234 (secure 0 0 0) 0x7fa03c049030 con 0x7fa04415ce80 2024-09-11T23:22:56.543 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:56.544 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":62,"btime":"2024-09-11T23:22:51:058577+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/1166956695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1166956695},{"type":"v1","addr":"172.21.15.165:6834","nonce":1166956695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1078454545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1078454545},{"type":"v1","addr":"172.21.15.144:6834","nonce":1078454545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6421,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/214118062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":214118062},{"type":"v1","addr":"172.21.15.165:6835","nonce":214118062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:22:30.193961+0000","modified":"2024-09-11T23:22:33.209255+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6522":{"gid":6522,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1018187462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":1018187462},{"type":"v1","addr":"172.21.15.144:6835","nonce":1018187462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6522,"qdb_cluster":[6522]},"id":6}]} 2024-09-11T23:22:56.544 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 62 2024-09-11T23:22:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.545+0000 7fa04ba00640 1 -- 172.21.15.144:0/2823625314 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa02406bf50 msgr2=0x7fa02406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.545+0000 7fa04ba00640 1 --2- 172.21.15.144:0/2823625314 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa02406bf50 0x7fa02406e410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa0440cc7e0 tx=0x7fa038008040 comp rx=0 tx=0).stop 2024-09-11T23:22:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.545+0000 7fa04ba00640 1 -- 172.21.15.144:0/2823625314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa04415ce80 msgr2=0x7fa044071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.545+0000 7fa04ba00640 1 --2- 172.21.15.144:0/2823625314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa04415ce80 0x7fa044071070 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa03c034040 tx=0x7fa03c004a40 comp rx=0 tx=0).stop 2024-09-11T23:22:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.545+0000 7fa04ba00640 1 -- 172.21.15.144:0/2823625314 shutdown_connections 2024-09-11T23:22:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.545+0000 7fa04ba00640 1 --2- 172.21.15.144:0/2823625314 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa02406bf50 0x7fa02406e410 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.545+0000 7fa04ba00640 1 --2- 172.21.15.144:0/2823625314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa04415ce80 0x7fa044071070 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.545+0000 7fa04ba00640 1 --2- 172.21.15.144:0/2823625314 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa04415ca40 0x7fa04414ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.545+0000 7fa04ba00640 1 --2- 172.21.15.144:0/2823625314 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa0440d02a0 0x7fa044159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.545+0000 7fa04ba00640 1 -- 172.21.15.144:0/2823625314 >> 172.21.15.144:0/2823625314 conn(0x7fa044062cc0 msgr2=0x7fa044152280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.545+0000 7fa04ba00640 1 -- 172.21.15.144:0/2823625314 shutdown_connections 2024-09-11T23:22:56.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.545+0000 7fa04ba00640 1 -- 172.21.15.144:0/2823625314 wait complete. 2024-09-11T23:22:56.562 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:22:56.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.716+0000 7ff2b5800640 1 Processor -- start 2024-09-11T23:22:56.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.716+0000 7ff2b5800640 1 -- start start 2024-09-11T23:22:56.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.717+0000 7ff2b5800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff2b00d02a0 0x7ff2b00d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:56.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.717+0000 7ff2b5800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b015ca40 0x7ff2b015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:56.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.717+0000 7ff2b5800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2b00d0bc0 con 0x7ff2b015ce80 2024-09-11T23:22:56.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.717+0000 7ff2b5800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff2b015d390 con 0x7ff2b00d02a0 2024-09-11T23:22:56.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.717+0000 7ff2b5800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b015d670 con 0x7ff2b015ca40 2024-09-11T23:22:56.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.717+0000 7ff2af400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff2b015ce80 0x7ff2b01594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47324/0 (socket says 172.21.15.144:47324) 2024-09-11T23:22:56.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.717+0000 7ff2af400640 1 -- 172.21.15.144:0/1150574799 learned_addr learned my addr 172.21.15.144:0/1150574799 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:56.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.718+0000 7ff2ae000640 1 --2- 172.21.15.144:0/1150574799 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b015ca40 0x7ff2b015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:56.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.718+0000 7ff2aea00640 1 --2- 172.21.15.144:0/1150574799 >> v2:172.21.15.165:3300/0 conn(0x7ff2b00d02a0 0x7ff2b00d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:56.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.718+0000 7ff2ad600640 1 -- 172.21.15.144:0/1150574799 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4284928066 0 0) 0x7ff2b00d0bc0 con 0x7ff2b015ce80 2024-09-11T23:22:56.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.718+0000 7ff2ad600640 1 -- 172.21.15.144:0/1150574799 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff294005730 con 0x7ff2b015ce80 2024-09-11T23:22:56.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.718+0000 7ff2ad600640 1 -- 172.21.15.144:0/1150574799 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1307318804 0 0) 0x7ff294005730 con 0x7ff2b015ce80 2024-09-11T23:22:56.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.718+0000 7ff2ad600640 1 -- 172.21.15.144:0/1150574799 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b015ca40 msgr2=0x7ff2b015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:56.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.718+0000 7ff2ad600640 1 --2- 172.21.15.144:0/1150574799 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b015ca40 0x7ff2b015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.718+0000 7ff2ad600640 1 -- 172.21.15.144:0/1150574799 >> v2:172.21.15.165:3300/0 conn(0x7ff2b00d02a0 msgr2=0x7ff2b00d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:56.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.718+0000 7ff2ad600640 1 --2- 172.21.15.144:0/1150574799 >> v2:172.21.15.165:3300/0 conn(0x7ff2b00d02a0 0x7ff2b00d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.718+0000 7ff2ad600640 1 -- 172.21.15.144:0/1150574799 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b015d950 con 0x7ff2b015ce80 2024-09-11T23:22:56.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.718+0000 7ff2ad600640 1 -- 172.21.15.144:0/1150574799 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7ff2a80019f0 con 0x7ff2b015ce80 2024-09-11T23:22:56.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.718+0000 7ff2aea00640 1 --2- 172.21.15.144:0/1150574799 >> v2:172.21.15.165:3300/0 conn(0x7ff2b00d02a0 0x7ff2b00d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:22:56.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.718+0000 7ff2ad600640 1 -- 172.21.15.144:0/1150574799 >> v1:172.21.15.144:6789/0 conn(0x7ff2b015ce80 legacy=0x7ff2b01594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:56.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.718+0000 7ff2ad600640 1 --2- 172.21.15.144:0/1150574799 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b015ca40 0x7ff294005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:56.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.718+0000 7ff2ad600640 1 --2- 172.21.15.144:0/1150574799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff294006140 0x7ff294006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:56.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.718+0000 7ff2ad600640 1 --2- 172.21.15.144:0/1150574799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff294006f50 0x7ff2940073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:56.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.718+0000 7ff2ad600640 1 -- 172.21.15.144:0/1150574799 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b015d390 con 0x7ff294006140 2024-09-11T23:22:56.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.718+0000 7ff2ad600640 1 -- 172.21.15.144:0/1150574799 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b015d670 con 0x7ff294006f50 2024-09-11T23:22:56.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.718+0000 7ff2ad600640 1 -- 172.21.15.144:0/1150574799 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff29400dc20 con 0x7ff2b015ca40 2024-09-11T23:22:56.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.719+0000 7ff2ae000640 1 --2- 172.21.15.144:0/1150574799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff294006140 0x7ff294006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:56.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.719+0000 7ff2aea00640 1 --2- 172.21.15.144:0/1150574799 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b015ca40 0x7ff294005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:56.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.719+0000 7ff2af400640 1 --2- 172.21.15.144:0/1150574799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff294006f50 0x7ff2940073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:56.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.719+0000 7ff2ae000640 1 -- 172.21.15.144:0/1150574799 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b015ca40 msgr2=0x7ff294005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:56.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.719+0000 7ff2ae000640 1 --2- 172.21.15.144:0/1150574799 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b015ca40 0x7ff294005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.719+0000 7ff2ae000640 1 -- 172.21.15.144:0/1150574799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff294006f50 msgr2=0x7ff2940073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:56.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.719+0000 7ff2ae000640 1 --2- 172.21.15.144:0/1150574799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff294006f50 0x7ff2940073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.719+0000 7ff2ae000640 1 -- 172.21.15.144:0/1150574799 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff294005730 con 0x7ff294006140 2024-09-11T23:22:56.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.720+0000 7ff2ae000640 1 --2- 172.21.15.144:0/1150574799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff294006140 0x7ff294006a10 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009af0 tx=0x7ff294007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da509d825c01926 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:56.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.720+0000 7ff2ad600640 1 -- 172.21.15.144:0/1150574799 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c036070 con 0x7ff294006140 2024-09-11T23:22:56.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.720+0000 7ff2ad600640 1 -- 172.21.15.144:0/1150574799 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff29c031400 con 0x7ff294006140 2024-09-11T23:22:56.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.720+0000 7ff2ad600640 1 -- 172.21.15.144:0/1150574799 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c009690 con 0x7ff294006140 2024-09-11T23:22:56.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.721+0000 7ff2b5800640 1 -- 172.21.15.144:0/1150574799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff294006140 msgr2=0x7ff294006a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:56.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.721+0000 7ff2b5800640 1 --2- 172.21.15.144:0/1150574799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff294006140 0x7ff294006a10 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009af0 tx=0x7ff294007a40 comp rx=0 tx=0).stop 2024-09-11T23:22:56.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.721+0000 7ff2af400640 1 -- 172.21.15.144:0/1150574799 reap_dead start 2024-09-11T23:22:56.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.721+0000 7ff2b5800640 1 -- 172.21.15.144:0/1150574799 shutdown_connections 2024-09-11T23:22:56.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.721+0000 7ff2b5800640 1 -- 172.21.15.144:0/1150574799 >> 172.21.15.144:0/1150574799 conn(0x7ff2b0062cc0 msgr2=0x7ff2b006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:56.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.721+0000 7ff2b5800640 1 -- 172.21.15.144:0/1150574799 shutdown_connections 2024-09-11T23:22:56.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.721+0000 7ff2b5800640 1 -- 172.21.15.144:0/1150574799 wait complete. 2024-09-11T23:22:56.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.723+0000 7ff2b5800640 1 Processor -- start 2024-09-11T23:22:56.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.723+0000 7ff2b5800640 1 -- start start 2024-09-11T23:22:56.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.724+0000 7ff2b5800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff294006140 0x7ff2b0154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:56.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.724+0000 7ff2b5800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2b0072040 0x7ff2b0156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:56.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.724+0000 7ff2b5800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b0073d70 0x7ff2b0158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:56.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.724+0000 7ff2b5800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b0155b90 con 0x7ff294006140 2024-09-11T23:22:56.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.724+0000 7ff2b5800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b015df10 con 0x7ff2b0072040 2024-09-11T23:22:56.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.724+0000 7ff2b5800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b0155d10 con 0x7ff2b0073d70 2024-09-11T23:22:56.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.724+0000 7ff2aea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff294006140 0x7ff2b0154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:56.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.724+0000 7ff2aea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff294006140 0x7ff2b0154f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59776/0 (socket says 172.21.15.144:59776) 2024-09-11T23:22:56.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.724+0000 7ff2aea00640 1 -- 172.21.15.144:0/2425381098 learned_addr learned my addr 172.21.15.144:0/2425381098 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:56.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.724+0000 7ff2af400640 1 --2- 172.21.15.144:0/2425381098 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b0073d70 0x7ff2b0158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:56.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.724+0000 7ff2ae000640 1 --2- 172.21.15.144:0/2425381098 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2b0072040 0x7ff2b0156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:56.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.724+0000 7ff2aea00640 1 -- 172.21.15.144:0/2425381098 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b0073d70 msgr2=0x7ff2b0158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:56.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.724+0000 7ff2aea00640 1 --2- 172.21.15.144:0/2425381098 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b0073d70 0x7ff2b0158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.724+0000 7ff2aea00640 1 -- 172.21.15.144:0/2425381098 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2b0072040 msgr2=0x7ff2b0156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:56.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.724+0000 7ff2aea00640 1 --2- 172.21.15.144:0/2425381098 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2b0072040 0x7ff2b0156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.724+0000 7ff2aea00640 1 -- 172.21.15.144:0/2425381098 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b01570c0 con 0x7ff294006140 2024-09-11T23:22:56.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.724+0000 7ff2af400640 1 --2- 172.21.15.144:0/2425381098 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b0073d70 0x7ff2b0158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:22:56.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.724+0000 7ff2ae000640 1 --2- 172.21.15.144:0/2425381098 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2b0072040 0x7ff2b0156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:22:56.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.725+0000 7ff2aea00640 1 --2- 172.21.15.144:0/2425381098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff294006140 0x7ff2b0154f70 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0011cd0 tx=0x7ff2a000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:56.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.725+0000 7ff2a6a00640 1 -- 172.21.15.144:0/2425381098 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a000fd20 con 0x7ff294006140 2024-09-11T23:22:56.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.725+0000 7ff2a6a00640 1 -- 172.21.15.144:0/2425381098 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a0004020 con 0x7ff294006140 2024-09-11T23:22:56.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.725+0000 7ff2a6a00640 1 -- 172.21.15.144:0/2425381098 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0004410 con 0x7ff294006140 2024-09-11T23:22:56.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.725+0000 7ff2b5800640 1 -- 172.21.15.144:0/2425381098 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b0152b90 con 0x7ff294006140 2024-09-11T23:22:56.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.725+0000 7ff2b5800640 1 -- 172.21.15.144:0/2425381098 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b0153150 con 0x7ff294006140 2024-09-11T23:22:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.726+0000 7ff2b5800640 1 -- 172.21.15.144:0/2425381098 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2b00cced0 con 0x7ff294006140 2024-09-11T23:22:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.727+0000 7ff2a6a00640 1 -- 172.21.15.144:0/2425381098 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7ff2a0012040 con 0x7ff294006140 2024-09-11T23:22:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.728+0000 7ff2a6a00640 1 --2- 172.21.15.144:0/2425381098 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff29006bef0 0x7ff29006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.728+0000 7ff2a6a00640 1 -- 172.21.15.144:0/2425381098 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5795+0+0 (secure 0 0 0) 0x7ff2a008b740 con 0x7ff294006140 2024-09-11T23:22:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.729+0000 7ff2ae000640 1 --2- 172.21.15.144:0/2425381098 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff29006bef0 0x7ff29006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:56.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.729+0000 7ff2ae000640 1 --2- 172.21.15.144:0/2425381098 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff29006bef0 0x7ff29006e3b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff29c033000 tx=0x7ff29c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:56.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.733+0000 7ff2a6a00640 1 -- 172.21.15.144:0/2425381098 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff2b00cced0 con 0x7ff294006140 2024-09-11T23:22:56.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.908+0000 7ff2b5800640 1 -- 172.21.15.144:0/2425381098 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2b00b4790 con 0x7ff294006140 2024-09-11T23:22:56.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.909+0000 7ff2a6a00640 1 -- 172.21.15.144:0/2425381098 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+16875 (secure 0 0 0) 0x7ff2a0019030 con 0x7ff294006140 2024-09-11T23:22:56.910 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:22:56.911 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":90,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:22:53.067148+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:22:27.959542+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-11T23:22:29.190371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.165:6835/3966608439":"2024-09-12T23:22:50.055731+0000","172.21.15.165:6833/3966608439":"2024-09-12T23:22:50.055731+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:22:56.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.911+0000 7ff2b5800640 1 -- 172.21.15.144:0/2425381098 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff29006bef0 msgr2=0x7ff29006e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:56.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.911+0000 7ff2b5800640 1 --2- 172.21.15.144:0/2425381098 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff29006bef0 0x7ff29006e3b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff29c033000 tx=0x7ff29c008030 comp rx=0 tx=0).stop 2024-09-11T23:22:56.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.911+0000 7ff2b5800640 1 -- 172.21.15.144:0/2425381098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff294006140 msgr2=0x7ff2b0154f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:56.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.911+0000 7ff2b5800640 1 --2- 172.21.15.144:0/2425381098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff294006140 0x7ff2b0154f70 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0011cd0 tx=0x7ff2a000f610 comp rx=0 tx=0).stop 2024-09-11T23:22:56.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.912+0000 7ff2b5800640 1 -- 172.21.15.144:0/2425381098 shutdown_connections 2024-09-11T23:22:56.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.912+0000 7ff2b5800640 1 --2- 172.21.15.144:0/2425381098 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff29006bef0 0x7ff29006e3b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.912+0000 7ff2b5800640 1 --2- 172.21.15.144:0/2425381098 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2b0073d70 0x7ff2b0158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.912+0000 7ff2b5800640 1 --2- 172.21.15.144:0/2425381098 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2b0072040 0x7ff2b0156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.912+0000 7ff2b5800640 1 --2- 172.21.15.144:0/2425381098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff294006140 0x7ff2b0154f70 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:56.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.912+0000 7ff2b5800640 1 -- 172.21.15.144:0/2425381098 >> 172.21.15.144:0/2425381098 conn(0x7ff2b0062cc0 msgr2=0x7ff2b00b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:56.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.912+0000 7ff2b5800640 1 -- 172.21.15.144:0/2425381098 shutdown_connections 2024-09-11T23:22:56.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:56.912+0000 7ff2b5800640 1 -- 172.21.15.144:0/2425381098 wait complete. 2024-09-11T23:22:56.929 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:22:57.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.083+0000 7f2b5f200640 1 Processor -- start 2024-09-11T23:22:57.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.083+0000 7f2b5f200640 1 -- start start 2024-09-11T23:22:57.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.084+0000 7f2b5f200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2b6015e640 0x7f2b600d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:57.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.084+0000 7f2b5f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b600b66e0 0x7f2b600b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:57.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.084+0000 7f2b5f200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b6006bee0 con 0x7f2b600d3f60 2024-09-11T23:22:57.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.084+0000 7f2b5f200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2b6015ea20 con 0x7f2b6015e640 2024-09-11T23:22:57.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.084+0000 7f2b5f200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2b6006caf0 con 0x7f2b600b66e0 2024-09-11T23:22:57.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.084+0000 7f2b5de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2b6015e640 0x7f2b600d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:57.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.085+0000 7f2b5de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2b6015e640 0x7f2b600d3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59784/0 (socket says 172.21.15.144:59784) 2024-09-11T23:22:57.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.085+0000 7f2b5de00640 1 -- 172.21.15.144:0/263623712 learned_addr learned my addr 172.21.15.144:0/263623712 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:57.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.085+0000 7f2b5e800640 1 --2- 172.21.15.144:0/263623712 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b600b66e0 0x7f2b600b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:57.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.085+0000 7f2b5de00640 1 -- 172.21.15.144:0/263623712 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b600b66e0 msgr2=0x7f2b600b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:57.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.085+0000 7f2b5de00640 1 --2- 172.21.15.144:0/263623712 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b600b66e0 0x7f2b600b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:57.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.085+0000 7f2b5de00640 1 -- 172.21.15.144:0/263623712 >> v1:172.21.15.165:6789/0 conn(0x7f2b600d3f60 legacy=0x7f2b600b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:57.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.085+0000 7f2b5de00640 1 -- 172.21.15.144:0/263623712 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6006c1c0 con 0x7f2b6015e640 2024-09-11T23:22:57.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.086+0000 7f2b5de00640 1 --2- 172.21.15.144:0/263623712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b6015e640 0x7f2b600d3a20 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009870 tx=0x7f2b5002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435604effb65890b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:57.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.086+0000 7f2b5ca00640 1 -- 172.21.15.144:0/263623712 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b50037070 con 0x7f2b6015e640 2024-09-11T23:22:57.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.087+0000 7f2b5ca00640 1 -- 172.21.15.144:0/263623712 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b50032440 con 0x7f2b6015e640 2024-09-11T23:22:57.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.087+0000 7f2b5ca00640 1 -- 172.21.15.144:0/263623712 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b50032810 con 0x7f2b6015e640 2024-09-11T23:22:57.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.087+0000 7f2b5f200640 1 -- 172.21.15.144:0/263623712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b6015e640 msgr2=0x7f2b600d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:57.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.087+0000 7f2b5f200640 1 --2- 172.21.15.144:0/263623712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b6015e640 0x7f2b600d3a20 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009870 tx=0x7f2b5002a250 comp rx=0 tx=0).stop 2024-09-11T23:22:57.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.087+0000 7f2b5f200640 1 -- 172.21.15.144:0/263623712 shutdown_connections 2024-09-11T23:22:57.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.087+0000 7f2b5f200640 1 --2- 172.21.15.144:0/263623712 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b600b66e0 0x7f2b600b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:57.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.087+0000 7f2b5f200640 1 --2- 172.21.15.144:0/263623712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b6015e640 0x7f2b600d3a20 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:57.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.087+0000 7f2b5f200640 1 -- 172.21.15.144:0/263623712 >> 172.21.15.144:0/263623712 conn(0x7f2b600d0fd0 msgr2=0x7f2b600d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:57.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.087+0000 7f2b5f200640 1 -- 172.21.15.144:0/263623712 shutdown_connections 2024-09-11T23:22:57.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.087+0000 7f2b5f200640 1 -- 172.21.15.144:0/263623712 wait complete. 2024-09-11T23:22:57.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.089+0000 7f2b5f200640 1 Processor -- start 2024-09-11T23:22:57.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.089+0000 7f2b5f200640 1 -- start start 2024-09-11T23:22:57.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.090+0000 7f2b5f200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b600b66e0 0x7f2b6015d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:57.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.090+0000 7f2b5f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b600d3f60 0x7f2b600ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:57.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.090+0000 7f2b5f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b6015e640 0x7f2b600acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:57.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.090+0000 7f2b5f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2b600b7c90 con 0x7f2b600d3f60 2024-09-11T23:22:57.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.090+0000 7f2b5f200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6006c780 con 0x7f2b600b66e0 2024-09-11T23:22:57.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.090+0000 7f2b5f200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2b600b7e10 con 0x7f2b6015e640 2024-09-11T23:22:57.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.090+0000 7f2b5d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b600d3f60 0x7f2b600ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:57.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.090+0000 7f2b5d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b600d3f60 0x7f2b600ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59786/0 (socket says 172.21.15.144:59786) 2024-09-11T23:22:57.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.090+0000 7f2b5de00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b600b66e0 0x7f2b6015d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:57.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.090+0000 7f2b5d400640 1 -- 172.21.15.144:0/3386999792 learned_addr learned my addr 172.21.15.144:0/3386999792 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:57.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.090+0000 7f2b5e800640 1 --2- 172.21.15.144:0/3386999792 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b6015e640 0x7f2b600acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:57.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.091+0000 7f2b5d400640 1 -- 172.21.15.144:0/3386999792 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b6015e640 msgr2=0x7f2b600acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:57.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.091+0000 7f2b5d400640 1 --2- 172.21.15.144:0/3386999792 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b6015e640 0x7f2b600acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:57.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.091+0000 7f2b5d400640 1 -- 172.21.15.144:0/3386999792 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b600b66e0 msgr2=0x7f2b6015d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:57.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.091+0000 7f2b5d400640 1 --2- 172.21.15.144:0/3386999792 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b600b66e0 0x7f2b6015d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:57.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.091+0000 7f2b5d400640 1 -- 172.21.15.144:0/3386999792 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b600cc280 con 0x7f2b600d3f60 2024-09-11T23:22:57.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.091+0000 7f2b5d400640 1 --2- 172.21.15.144:0/3386999792 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b600d3f60 0x7f2b600ce0f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00c400 tx=0x7f2b4c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:57.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.093+0000 7f2b56000640 1 -- 172.21.15.144:0/3386999792 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c0052d0 con 0x7f2b600d3f60 2024-09-11T23:22:57.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.093+0000 7f2b56000640 1 -- 172.21.15.144:0/3386999792 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b4c005490 con 0x7f2b600d3f60 2024-09-11T23:22:57.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.093+0000 7f2b56000640 1 -- 172.21.15.144:0/3386999792 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c007260 con 0x7f2b600d3f60 2024-09-11T23:22:57.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.093+0000 7f2b5f200640 1 -- 172.21.15.144:0/3386999792 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b600cc560 con 0x7f2b600d3f60 2024-09-11T23:22:57.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.093+0000 7f2b5f200640 1 -- 172.21.15.144:0/3386999792 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b600ce630 con 0x7f2b600d3f60 2024-09-11T23:22:57.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.094+0000 7f2b5f200640 1 -- 172.21.15.144:0/3386999792 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b600b7750 con 0x7f2b600d3f60 2024-09-11T23:22:57.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.095+0000 7f2b56000640 1 -- 172.21.15.144:0/3386999792 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f2b4c007400 con 0x7f2b600d3f60 2024-09-11T23:22:57.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.096+0000 7f2b56000640 1 --2- 172.21.15.144:0/3386999792 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2b4006bf50 0x7f2b4006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:57.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.096+0000 7f2b56000640 1 -- 172.21.15.144:0/3386999792 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5795+0+0 (secure 0 0 0) 0x7f2b4c08a560 con 0x7f2b600d3f60 2024-09-11T23:22:57.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.096+0000 7f2b5de00640 1 --2- 172.21.15.144:0/3386999792 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2b4006bf50 0x7f2b4006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:57.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.097+0000 7f2b5de00640 1 --2- 172.21.15.144:0/3386999792 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2b4006bf50 0x7f2b4006e410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2b50034000 tx=0x7f2b5002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:57.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.100+0000 7f2b56000640 1 -- 172.21.15.144:0/3386999792 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2b4c0586b0 con 0x7f2b600d3f60 2024-09-11T23:22:57.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.306+0000 7f2b5f200640 1 -- 172.21.15.144:0/3386999792 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2b600d3c00 con 0x7f2b600d3f60 2024-09-11T23:22:57.307 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-11T23:22:57.307+0000 7f86fcc00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:22:57.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.311+0000 7f2b56000640 1 -- 172.21.15.144:0/3386999792 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) ==== 161+0+0 (secure 0 0 0) 0x7f2b4c05c9b0 con 0x7f2b600d3f60 2024-09-11T23:22:57.311 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:22:57.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.313+0000 7f2b5f200640 1 -- 172.21.15.144:0/3386999792 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2b4006bf50 msgr2=0x7f2b4006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:57.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.313+0000 7f2b5f200640 1 --2- 172.21.15.144:0/3386999792 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2b4006bf50 0x7f2b4006e410 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2b50034000 tx=0x7f2b5002e000 comp rx=0 tx=0).stop 2024-09-11T23:22:57.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.313+0000 7f2b5f200640 1 -- 172.21.15.144:0/3386999792 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b600d3f60 msgr2=0x7f2b600ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:57.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.313+0000 7f2b5f200640 1 --2- 172.21.15.144:0/3386999792 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b600d3f60 0x7f2b600ce0f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00c400 tx=0x7f2b4c00c8c0 comp rx=0 tx=0).stop 2024-09-11T23:22:57.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.313+0000 7f2b5f200640 1 -- 172.21.15.144:0/3386999792 shutdown_connections 2024-09-11T23:22:57.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.313+0000 7f2b5f200640 1 --2- 172.21.15.144:0/3386999792 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2b4006bf50 0x7f2b4006e410 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:57.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.313+0000 7f2b5f200640 1 --2- 172.21.15.144:0/3386999792 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2b6015e640 0x7f2b600acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:57.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.313+0000 7f2b5f200640 1 --2- 172.21.15.144:0/3386999792 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b600d3f60 0x7f2b600ce0f0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:57.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.313+0000 7f2b5f200640 1 --2- 172.21.15.144:0/3386999792 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2b600b66e0 0x7f2b6015d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:57.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.313+0000 7f2b5f200640 1 -- 172.21.15.144:0/3386999792 >> 172.21.15.144:0/3386999792 conn(0x7f2b600d0fd0 msgr2=0x7f2b600cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:57.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.313+0000 7f2b5f200640 1 -- 172.21.15.144:0/3386999792 shutdown_connections 2024-09-11T23:22:57.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.313+0000 7f2b5f200640 1 -- 172.21.15.144:0/3386999792 wait complete. 2024-09-11T23:22:57.317 INFO:tasks.ceph.mds.a.smithi144.stderr: -3970> 2024-09-11T23:22:26.069+0000 7fe5ea200640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-09-11T23:22:57.320 INFO:tasks.ceph.mds.a.smithi144.stderr: -2653> 2024-09-11T23:22:36.757+0000 7fe5e2a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:22:57.331 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:22:57.370 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-11T23:22:57.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.491+0000 7ffabb400640 1 Processor -- start 2024-09-11T23:22:57.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.491+0000 7ffabb400640 1 -- start start 2024-09-11T23:22:57.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.493+0000 7ffabb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffab415b090 0x7ffab40b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:57.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.493+0000 7ffabb400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ffab406ea00 0x7ffab4164640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:57.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.493+0000 7ffabb400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab4071de0 con 0x7ffab40715b0 2024-09-11T23:22:57.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.493+0000 7ffabb400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ffab40720c0 con 0x7ffab415b090 2024-09-11T23:22:57.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.493+0000 7ffabb400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ffab40723a0 con 0x7ffab406ea00 2024-09-11T23:22:57.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.493+0000 7ffab8a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffab415b090 0x7ffab40b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:57.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.493+0000 7ffab8a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffab415b090 0x7ffab40b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59814/0 (socket says 172.21.15.144:59814) 2024-09-11T23:22:57.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.493+0000 7ffab8a00640 1 -- 172.21.15.144:0/3317999615 learned_addr learned my addr 172.21.15.144:0/3317999615 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:57.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.493+0000 7ffab9400640 1 --2- 172.21.15.144:0/3317999615 >> v2:172.21.15.165:3300/0 conn(0x7ffab406ea00 0x7ffab4164640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:57.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.493+0000 7ffab8a00640 1 -- 172.21.15.144:0/3317999615 >> v2:172.21.15.165:3300/0 conn(0x7ffab406ea00 msgr2=0x7ffab4164640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:57.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.493+0000 7ffab8a00640 1 --2- 172.21.15.144:0/3317999615 >> v2:172.21.15.165:3300/0 conn(0x7ffab406ea00 0x7ffab4164640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:57.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.493+0000 7ffab8a00640 1 -- 172.21.15.144:0/3317999615 >> v1:172.21.15.165:6789/0 conn(0x7ffab40715b0 legacy=0x7ffab415b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:57.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.493+0000 7ffab8a00640 1 -- 172.21.15.144:0/3317999615 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab4072680 con 0x7ffab415b090 2024-09-11T23:22:57.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.494+0000 7ffab8a00640 1 --2- 172.21.15.144:0/3317999615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffab415b090 0x7ffab40b5420 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ffab406cb80 tx=0x7ffaa402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61df1c11761007f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:57.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.495+0000 7ffab3e00640 1 -- 172.21.15.144:0/3317999615 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4037070 con 0x7ffab415b090 2024-09-11T23:22:57.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.495+0000 7ffab3e00640 1 -- 172.21.15.144:0/3317999615 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaa4032440 con 0x7ffab415b090 2024-09-11T23:22:57.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.495+0000 7ffab3e00640 1 -- 172.21.15.144:0/3317999615 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4032810 con 0x7ffab415b090 2024-09-11T23:22:57.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.495+0000 7ffabb400640 1 -- 172.21.15.144:0/3317999615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffab415b090 msgr2=0x7ffab40b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:57.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.495+0000 7ffabb400640 1 --2- 172.21.15.144:0/3317999615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffab415b090 0x7ffab40b5420 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ffab406cb80 tx=0x7ffaa402a230 comp rx=0 tx=0).stop 2024-09-11T23:22:57.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.495+0000 7ffabb400640 1 -- 172.21.15.144:0/3317999615 shutdown_connections 2024-09-11T23:22:57.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.495+0000 7ffabb400640 1 --2- 172.21.15.144:0/3317999615 >> v2:172.21.15.165:3300/0 conn(0x7ffab406ea00 0x7ffab4164640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:57.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.495+0000 7ffabb400640 1 --2- 172.21.15.144:0/3317999615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffab415b090 0x7ffab40b5420 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:57.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.495+0000 7ffabb400640 1 -- 172.21.15.144:0/3317999615 >> 172.21.15.144:0/3317999615 conn(0x7ffab406bba0 msgr2=0x7ffab406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:57.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.495+0000 7ffabb400640 1 -- 172.21.15.144:0/3317999615 shutdown_connections 2024-09-11T23:22:57.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.495+0000 7ffabb400640 1 -- 172.21.15.144:0/3317999615 wait complete. 2024-09-11T23:22:57.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.497+0000 7ffabb400640 1 Processor -- start 2024-09-11T23:22:57.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.497+0000 7ffabb400640 1 -- start start 2024-09-11T23:22:57.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.498+0000 7ffabb400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffab406ea00 0x7ffab414c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:57.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.498+0000 7ffabb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffab40715b0 0x7ffab41f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:57.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.498+0000 7ffabb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffab415b090 0x7ffab414edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:57.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.498+0000 7ffabb400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffab4071ba0 con 0x7ffab40715b0 2024-09-11T23:22:57.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.498+0000 7ffabb400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffab4071a20 con 0x7ffab406ea00 2024-09-11T23:22:57.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.498+0000 7ffabb400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffab415bb80 con 0x7ffab415b090 2024-09-11T23:22:57.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.498+0000 7ffaabe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffab40715b0 0x7ffab41f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:57.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.498+0000 7ffaabe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffab40715b0 0x7ffab41f1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59824/0 (socket says 172.21.15.144:59824) 2024-09-11T23:22:57.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.498+0000 7ffaabe00640 1 -- 172.21.15.144:0/1720115883 learned_addr learned my addr 172.21.15.144:0/1720115883 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:57.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.498+0000 7ffab8a00640 1 --2- 172.21.15.144:0/1720115883 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffab406ea00 0x7ffab414c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:57.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.498+0000 7ffab9400640 1 --2- 172.21.15.144:0/1720115883 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffab415b090 0x7ffab414edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:57.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.499+0000 7ffaabe00640 1 -- 172.21.15.144:0/1720115883 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffab415b090 msgr2=0x7ffab414edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:57.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.499+0000 7ffaabe00640 1 --2- 172.21.15.144:0/1720115883 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffab415b090 0x7ffab414edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:57.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.499+0000 7ffaabe00640 1 -- 172.21.15.144:0/1720115883 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffab406ea00 msgr2=0x7ffab414c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:57.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.499+0000 7ffaabe00640 1 --2- 172.21.15.144:0/1720115883 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffab406ea00 0x7ffab414c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:57.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.499+0000 7ffaabe00640 1 -- 172.21.15.144:0/1720115883 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab4155860 con 0x7ffab40715b0 2024-09-11T23:22:57.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.499+0000 7ffab9400640 1 --2- 172.21.15.144:0/1720115883 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffab415b090 0x7ffab414edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:57.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.499+0000 7ffaabe00640 1 --2- 172.21.15.144:0/1720115883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffab40715b0 0x7ffab41f1c50 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c004640 tx=0x7ffa9c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:57.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.499+0000 7ffab1600640 1 -- 172.21.15.144:0/1720115883 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c011790 con 0x7ffab40715b0 2024-09-11T23:22:57.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.499+0000 7ffab1600640 1 -- 172.21.15.144:0/1720115883 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa9c017070 con 0x7ffab40715b0 2024-09-11T23:22:57.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.499+0000 7ffab1600640 1 -- 172.21.15.144:0/1720115883 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c011bb0 con 0x7ffab40715b0 2024-09-11T23:22:57.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.499+0000 7ffabb400640 1 -- 172.21.15.144:0/1720115883 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab4155b40 con 0x7ffab40715b0 2024-09-11T23:22:57.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.499+0000 7ffabb400640 1 -- 172.21.15.144:0/1720115883 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab4156100 con 0x7ffab40715b0 2024-09-11T23:22:57.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.500+0000 7ffabb400640 1 -- 172.21.15.144:0/1720115883 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab4156300 con 0x7ffab40715b0 2024-09-11T23:22:57.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.501+0000 7ffab1600640 1 -- 172.21.15.144:0/1720115883 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7ffa9c011d50 con 0x7ffab40715b0 2024-09-11T23:22:57.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.502+0000 7ffab1600640 1 --2- 172.21.15.144:0/1720115883 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ffa9006bf80 0x7ffa9006e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:57.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.502+0000 7ffab1600640 1 -- 172.21.15.144:0/1720115883 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5881+0+0 (secure 0 0 0) 0x7ffa9c08ab90 con 0x7ffab40715b0 2024-09-11T23:22:57.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.503+0000 7ffab8a00640 1 --2- 172.21.15.144:0/1720115883 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ffa9006bf80 0x7ffa9006e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:57.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.503+0000 7ffab8a00640 1 --2- 172.21.15.144:0/1720115883 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ffa9006bf80 0x7ffa9006e440 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4034000 tx=0x7ffaa402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:57.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.506+0000 7ffab1600640 1 -- 172.21.15.144:0/1720115883 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffab4156300 con 0x7ffab40715b0 2024-09-11T23:22:57.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:57.715+0000 7ffabb400640 1 -- 172.21.15.144:0/1720115883 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ffab40b5420 con 0x7ffab40715b0 2024-09-11T23:22:58.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.312+0000 7ffab1600640 1 -- 172.21.15.144:0/1720115883 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) ==== 104+0+0 (secure 0 0 0) 0x7ffa9c0592e0 con 0x7ffab40715b0 2024-09-11T23:22:58.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.315+0000 7ffabb400640 1 -- 172.21.15.144:0/1720115883 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ffa9006bf80 msgr2=0x7ffa9006e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:58.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.315+0000 7ffabb400640 1 --2- 172.21.15.144:0/1720115883 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ffa9006bf80 0x7ffa9006e440 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4034000 tx=0x7ffaa402e000 comp rx=0 tx=0).stop 2024-09-11T23:22:58.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.315+0000 7ffabb400640 1 -- 172.21.15.144:0/1720115883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffab40715b0 msgr2=0x7ffab41f1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:58.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.315+0000 7ffabb400640 1 --2- 172.21.15.144:0/1720115883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffab40715b0 0x7ffab41f1c50 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c004640 tx=0x7ffa9c00c8e0 comp rx=0 tx=0).stop 2024-09-11T23:22:58.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.315+0000 7ffabb400640 1 -- 172.21.15.144:0/1720115883 shutdown_connections 2024-09-11T23:22:58.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.315+0000 7ffabb400640 1 --2- 172.21.15.144:0/1720115883 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ffa9006bf80 0x7ffa9006e440 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:58.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.315+0000 7ffabb400640 1 --2- 172.21.15.144:0/1720115883 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffab415b090 0x7ffab414edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:58.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.315+0000 7ffabb400640 1 --2- 172.21.15.144:0/1720115883 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffab40715b0 0x7ffab41f1c50 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:58.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.315+0000 7ffabb400640 1 --2- 172.21.15.144:0/1720115883 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffab406ea00 0x7ffab414c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:58.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.315+0000 7ffabb400640 1 -- 172.21.15.144:0/1720115883 >> 172.21.15.144:0/1720115883 conn(0x7ffab406bba0 msgr2=0x7ffab415b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:58.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.315+0000 7ffabb400640 1 -- 172.21.15.144:0/1720115883 shutdown_connections 2024-09-11T23:22:58.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.315+0000 7ffabb400640 1 -- 172.21.15.144:0/1720115883 wait complete. 2024-09-11T23:22:58.333 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:22:58.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.531+0000 7feb9f200640 1 Processor -- start 2024-09-11T23:22:58.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.531+0000 7feb9f200640 1 -- start start 2024-09-11T23:22:58.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.532+0000 7feb9f200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feba006dd20 0x7feba0169130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:58.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.532+0000 7feb9f200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba00d38d0 con 0x7feba015e6a0 2024-09-11T23:22:58.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.532+0000 7feb9f200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba00d3bb0 con 0x7feba00d3160 2024-09-11T23:22:58.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.532+0000 7feb9f200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7feba00d3e90 con 0x7feba006dd20 2024-09-11T23:22:58.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.532+0000 7feb9e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feba006dd20 0x7feba0169130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:58.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.532+0000 7feb9de00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7feba015e6a0 0x7feba00cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47334/0 (socket says 172.21.15.144:47334) 2024-09-11T23:22:58.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.533+0000 7feb9de00640 1 -- 172.21.15.144:0/1472808204 learned_addr learned my addr 172.21.15.144:0/1472808204 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:58.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.533+0000 7feb9e800640 1 -- 172.21.15.144:0/1472808204 >> v1:172.21.15.165:6789/0 conn(0x7feba00d3160 legacy=0x7feba006d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:58.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.533+0000 7feb9e800640 1 -- 172.21.15.144:0/1472808204 >> v1:172.21.15.144:6789/0 conn(0x7feba015e6a0 legacy=0x7feba00cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:58.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.533+0000 7feb9ca00640 1 -- 172.21.15.144:0/1472808204 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3545598556 0 0) 0x7feba00d38d0 con 0x7feba015e6a0 2024-09-11T23:22:58.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.533+0000 7feb9e800640 1 -- 172.21.15.144:0/1472808204 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba00d4170 con 0x7feba006dd20 2024-09-11T23:22:58.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.534+0000 7feb9e800640 1 --2- 172.21.15.144:0/1472808204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feba006dd20 0x7feba0169130 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7feb98009d90 tx=0x7feb9802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839048ebdd07e911 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:58.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.534+0000 7feb9ca00640 1 -- 172.21.15.144:0/1472808204 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb98037070 con 0x7feba006dd20 2024-09-11T23:22:58.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.534+0000 7feb9ca00640 1 -- 172.21.15.144:0/1472808204 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb98007740 con 0x7feba006dd20 2024-09-11T23:22:58.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.534+0000 7feb9ca00640 1 -- 172.21.15.144:0/1472808204 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb98007b10 con 0x7feba006dd20 2024-09-11T23:22:58.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.535+0000 7feb9f200640 1 -- 172.21.15.144:0/1472808204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feba006dd20 msgr2=0x7feba0169130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:58.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.535+0000 7feb9f200640 1 --2- 172.21.15.144:0/1472808204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feba006dd20 0x7feba0169130 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7feb98009d90 tx=0x7feb9802a780 comp rx=0 tx=0).stop 2024-09-11T23:22:58.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.535+0000 7feb9f200640 1 -- 172.21.15.144:0/1472808204 shutdown_connections 2024-09-11T23:22:58.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.535+0000 7feb9f200640 1 --2- 172.21.15.144:0/1472808204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feba006dd20 0x7feba0169130 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:58.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.535+0000 7feb9f200640 1 -- 172.21.15.144:0/1472808204 >> 172.21.15.144:0/1472808204 conn(0x7feba00d4700 msgr2=0x7feba00d4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:58.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.535+0000 7feb9f200640 1 -- 172.21.15.144:0/1472808204 shutdown_connections 2024-09-11T23:22:58.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.535+0000 7feb9f200640 1 -- 172.21.15.144:0/1472808204 wait complete. 2024-09-11T23:22:58.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.536+0000 7feb9f200640 1 Processor -- start 2024-09-11T23:22:58.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.537+0000 7feb9f200640 1 -- start start 2024-09-11T23:22:58.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.537+0000 7feb9f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feba006dd20 0x7feba00ce090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:58.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.538+0000 7feb9f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feba00d3160 0x7feba00c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:58.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.538+0000 7feb9f200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feba015e6a0 0x7feba014f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:58.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.538+0000 7feb9f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feba00b8bb0 con 0x7feba00d3160 2024-09-11T23:22:58.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.538+0000 7feb9f200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feba00d3580 con 0x7feba015e6a0 2024-09-11T23:22:58.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.538+0000 7feb9f200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7feba00b8d30 con 0x7feba006dd20 2024-09-11T23:22:58.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.538+0000 7feb9d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feba00d3160 0x7feba00c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:58.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.538+0000 7feb9d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feba00d3160 0x7feba00c8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59846/0 (socket says 172.21.15.144:59846) 2024-09-11T23:22:58.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.538+0000 7feb9d400640 1 -- 172.21.15.144:0/4254758441 learned_addr learned my addr 172.21.15.144:0/4254758441 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:58.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.538+0000 7feb9de00640 1 --2- 172.21.15.144:0/4254758441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feba006dd20 0x7feba00ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:58.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.538+0000 7feb9e800640 1 --2- 172.21.15.144:0/4254758441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feba015e6a0 0x7feba014f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:58.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.538+0000 7feb9d400640 1 -- 172.21.15.144:0/4254758441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feba006dd20 msgr2=0x7feba00ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:58.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.538+0000 7feb9d400640 1 --2- 172.21.15.144:0/4254758441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feba006dd20 0x7feba00ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:58.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.538+0000 7feb9d400640 1 -- 172.21.15.144:0/4254758441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feba015e6a0 msgr2=0x7feba014f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:58.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.538+0000 7feb9d400640 1 --2- 172.21.15.144:0/4254758441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feba015e6a0 0x7feba014f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:58.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.538+0000 7feb9d400640 1 -- 172.21.15.144:0/4254758441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba00c8dd0 con 0x7feba00d3160 2024-09-11T23:22:58.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.538+0000 7feb9e800640 1 --2- 172.21.15.144:0/4254758441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feba015e6a0 0x7feba014f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:22:58.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.538+0000 7feb9d400640 1 --2- 172.21.15.144:0/4254758441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feba00d3160 0x7feba00c8890 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00c450 tx=0x7feb8c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:58.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.539+0000 7feb96000640 1 -- 172.21.15.144:0/4254758441 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c0052d0 con 0x7feba00d3160 2024-09-11T23:22:58.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.539+0000 7feb96000640 1 -- 172.21.15.144:0/4254758441 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb8c005470 con 0x7feba00d3160 2024-09-11T23:22:58.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.539+0000 7feb96000640 1 -- 172.21.15.144:0/4254758441 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c012870 con 0x7feba00d3160 2024-09-11T23:22:58.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.539+0000 7feb9f200640 1 -- 172.21.15.144:0/4254758441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba00c9070 con 0x7feba00d3160 2024-09-11T23:22:58.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.539+0000 7feb9f200640 1 -- 172.21.15.144:0/4254758441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba00cb840 con 0x7feba00d3160 2024-09-11T23:22:58.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.540+0000 7feb9f200640 1 -- 172.21.15.144:0/4254758441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba006d610 con 0x7feba00d3160 2024-09-11T23:22:58.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.541+0000 7feb96000640 1 -- 172.21.15.144:0/4254758441 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7feb8c012a10 con 0x7feba00d3160 2024-09-11T23:22:58.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.542+0000 7feb96000640 1 --2- 172.21.15.144:0/4254758441 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7feb8006bf50 0x7feb8006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:58.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.542+0000 7feb96000640 1 -- 172.21.15.144:0/4254758441 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5881+0+0 (secure 0 0 0) 0x7feb8c08ac10 con 0x7feba00d3160 2024-09-11T23:22:58.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.542+0000 7feb9de00640 1 --2- 172.21.15.144:0/4254758441 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7feb8006bf50 0x7feb8006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:58.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.543+0000 7feb9de00640 1 --2- 172.21.15.144:0/4254758441 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7feb8006bf50 0x7feb8006e410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7feb90007f70 tx=0x7feb90007f00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:58.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.546+0000 7feb96000640 1 -- 172.21.15.144:0/4254758441 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feb8c0593f0 con 0x7feba00d3160 2024-09-11T23:22:58.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:58.719+0000 7feb9f200640 1 -- 172.21.15.144:0/4254758441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7feba006cf90 con 0x7feba00d3160 2024-09-11T23:22:59.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.318+0000 7feb96000640 1 -- 172.21.15.144:0/4254758441 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v92) ==== 181+0+0 (secure 0 0 0) 0x7feb8c058cf0 con 0x7feba00d3160 2024-09-11T23:22:59.320 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:22:59.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.321+0000 7feb9f200640 1 -- 172.21.15.144:0/4254758441 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7feb8006bf50 msgr2=0x7feb8006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:59.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.321+0000 7feb9f200640 1 --2- 172.21.15.144:0/4254758441 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7feb8006bf50 0x7feb8006e410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7feb90007f70 tx=0x7feb90007f00 comp rx=0 tx=0).stop 2024-09-11T23:22:59.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.321+0000 7feb9f200640 1 -- 172.21.15.144:0/4254758441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feba00d3160 msgr2=0x7feba00c8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:59.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.321+0000 7feb9f200640 1 --2- 172.21.15.144:0/4254758441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feba00d3160 0x7feba00c8890 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00c450 tx=0x7feb8c00c910 comp rx=0 tx=0).stop 2024-09-11T23:22:59.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.321+0000 7feb9f200640 1 -- 172.21.15.144:0/4254758441 shutdown_connections 2024-09-11T23:22:59.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.321+0000 7feb9f200640 1 --2- 172.21.15.144:0/4254758441 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7feb8006bf50 0x7feb8006e410 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:59.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.321+0000 7feb9f200640 1 --2- 172.21.15.144:0/4254758441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feba015e6a0 0x7feba014f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:59.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.321+0000 7feb9f200640 1 --2- 172.21.15.144:0/4254758441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feba00d3160 0x7feba00c8890 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:59.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.321+0000 7feb9f200640 1 --2- 172.21.15.144:0/4254758441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feba006dd20 0x7feba00ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:59.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.322+0000 7feb9f200640 1 -- 172.21.15.144:0/4254758441 >> 172.21.15.144:0/4254758441 conn(0x7feba00d4700 msgr2=0x7feba00b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:59.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.322+0000 7feb9f200640 1 -- 172.21.15.144:0/4254758441 shutdown_connections 2024-09-11T23:22:59.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.322+0000 7feb9f200640 1 -- 172.21.15.144:0/4254758441 wait complete. 2024-09-11T23:22:59.341 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:22:59.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.501+0000 7f5b8a200640 1 Processor -- start 2024-09-11T23:22:59.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.501+0000 7f5b8a200640 1 -- start start 2024-09-11T23:22:59.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.503+0000 7f5b8a200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5b8415f170 0x7f5b840b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:59.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.503+0000 7f5b8a200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b8415fa00 con 0x7f5b84158cd0 2024-09-11T23:22:59.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.503+0000 7f5b8a200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b8415f720 con 0x7f5b840b1e60 2024-09-11T23:22:59.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.503+0000 7f5b8a200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5b840b2810 con 0x7f5b8415f170 2024-09-11T23:22:59.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.503+0000 7f5b88e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5b84158cd0 0x7f5b840b3de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47336/0 (socket says 172.21.15.144:47336) 2024-09-11T23:22:59.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.503+0000 7f5b88e00640 1 -- 172.21.15.144:0/2538653929 learned_addr learned my addr 172.21.15.144:0/2538653929 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:22:59.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.503+0000 7f5b89800640 1 --2- 172.21.15.144:0/2538653929 >> v2:172.21.15.144:3300/0 conn(0x7f5b8415f170 0x7f5b840b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:59.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.503+0000 7f5b83400640 1 -- 172.21.15.144:0/2538653929 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3428269764 0 0) 0x7f5b8415fa00 con 0x7f5b84158cd0 2024-09-11T23:22:59.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.503+0000 7f5b89800640 1 -- 172.21.15.144:0/2538653929 >> v1:172.21.15.165:6789/0 conn(0x7f5b840b1e60 legacy=0x7f5b8415ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:22:59.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.503+0000 7f5b89800640 1 -- 172.21.15.144:0/2538653929 >> v1:172.21.15.144:6789/0 conn(0x7f5b84158cd0 legacy=0x7f5b840b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:59.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.503+0000 7f5b89800640 1 -- 172.21.15.144:0/2538653929 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b840b3300 con 0x7f5b8415f170 2024-09-11T23:22:59.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.504+0000 7f5b89800640 1 --2- 172.21.15.144:0/2538653929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b8415f170 0x7f5b840b22d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009d90 tx=0x7f5b7c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234c31bb3179b88f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:59.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.505+0000 7f5b83400640 1 -- 172.21.15.144:0/2538653929 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c007740 con 0x7f5b8415f170 2024-09-11T23:22:59.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.505+0000 7f5b83400640 1 -- 172.21.15.144:0/2538653929 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7c0078e0 con 0x7f5b8415f170 2024-09-11T23:22:59.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.505+0000 7f5b83400640 1 -- 172.21.15.144:0/2538653929 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c007cb0 con 0x7f5b8415f170 2024-09-11T23:22:59.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.505+0000 7f5b8a200640 1 -- 172.21.15.144:0/2538653929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b8415f170 msgr2=0x7f5b840b22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:59.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.505+0000 7f5b8a200640 1 --2- 172.21.15.144:0/2538653929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b8415f170 0x7f5b840b22d0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009d90 tx=0x7f5b7c02a660 comp rx=0 tx=0).stop 2024-09-11T23:22:59.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.505+0000 7f5b8a200640 1 -- 172.21.15.144:0/2538653929 shutdown_connections 2024-09-11T23:22:59.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.505+0000 7f5b8a200640 1 --2- 172.21.15.144:0/2538653929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b8415f170 0x7f5b840b22d0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:59.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.505+0000 7f5b8a200640 1 -- 172.21.15.144:0/2538653929 >> 172.21.15.144:0/2538653929 conn(0x7f5b8406bba0 msgr2=0x7f5b8406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:22:59.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.505+0000 7f5b8a200640 1 -- 172.21.15.144:0/2538653929 shutdown_connections 2024-09-11T23:22:59.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.505+0000 7f5b8a200640 1 -- 172.21.15.144:0/2538653929 wait complete. 2024-09-11T23:22:59.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.507+0000 7f5b8a200640 1 Processor -- start 2024-09-11T23:22:59.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.507+0000 7f5b8a200640 1 -- start start 2024-09-11T23:22:59.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.508+0000 7f5b8a200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b840b1e60 0x7f5b841f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:59.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.508+0000 7f5b8a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5b84158cd0 0x7f5b8415d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:59.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.508+0000 7f5b8a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b8415f170 0x7f5b8415de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:59.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.508+0000 7f5b8a200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8415fc20 con 0x7f5b8415f170 2024-09-11T23:22:59.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.508+0000 7f5b8a200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5b840b38c0 con 0x7f5b840b1e60 2024-09-11T23:22:59.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.508+0000 7f5b8a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5b8415fda0 con 0x7f5b84158cd0 2024-09-11T23:22:59.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.508+0000 7f5b89800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b8415f170 0x7f5b8415de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:59.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.508+0000 7f5b88e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b840b1e60 0x7f5b841f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:59.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.508+0000 7f5b89800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b8415f170 0x7f5b8415de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59860/0 (socket says 172.21.15.144:59860) 2024-09-11T23:22:59.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.508+0000 7f5b89800640 1 -- 172.21.15.144:0/1400317107 learned_addr learned my addr 172.21.15.144:0/1400317107 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:22:59.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.508+0000 7f5b83e00640 1 --2- 172.21.15.144:0/1400317107 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5b84158cd0 0x7f5b8415d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:59.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.509+0000 7f5b89800640 1 -- 172.21.15.144:0/1400317107 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5b84158cd0 msgr2=0x7f5b8415d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:59.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.509+0000 7f5b89800640 1 --2- 172.21.15.144:0/1400317107 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5b84158cd0 0x7f5b8415d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:59.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.509+0000 7f5b89800640 1 -- 172.21.15.144:0/1400317107 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b840b1e60 msgr2=0x7f5b841f36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:22:59.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.509+0000 7f5b89800640 1 --2- 172.21.15.144:0/1400317107 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b840b1e60 0x7f5b841f36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:22:59.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.509+0000 7f5b89800640 1 -- 172.21.15.144:0/1400317107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b84072c80 con 0x7f5b8415f170 2024-09-11T23:22:59.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.509+0000 7f5b89800640 1 --2- 172.21.15.144:0/1400317107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b8415f170 0x7f5b8415de00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009d90 tx=0x7f5b7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:59.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.509+0000 7f5b80c00640 1 -- 172.21.15.144:0/1400317107 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c03f070 con 0x7f5b8415f170 2024-09-11T23:22:59.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.509+0000 7f5b80c00640 1 -- 172.21.15.144:0/1400317107 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7c031c90 con 0x7f5b8415f170 2024-09-11T23:22:59.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.509+0000 7f5b8a200640 1 -- 172.21.15.144:0/1400317107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b84072f60 con 0x7f5b8415f170 2024-09-11T23:22:59.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.509+0000 7f5b80c00640 1 -- 172.21.15.144:0/1400317107 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c043630 con 0x7f5b8415f170 2024-09-11T23:22:59.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.509+0000 7f5b8a200640 1 -- 172.21.15.144:0/1400317107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b84073520 con 0x7f5b8415f170 2024-09-11T23:22:59.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.511+0000 7f5b8a200640 1 -- 172.21.15.144:0/1400317107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b840b22d0 con 0x7f5b8415f170 2024-09-11T23:22:59.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.511+0000 7f5b80c00640 1 -- 172.21.15.144:0/1400317107 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f5b7c03b410 con 0x7f5b8415f170 2024-09-11T23:22:59.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.512+0000 7f5b80c00640 1 --2- 172.21.15.144:0/1400317107 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5b6406bf50 0x7f5b6406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:22:59.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.512+0000 7f5b80c00640 1 -- 172.21.15.144:0/1400317107 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5443+0+0 (secure 0 0 0) 0x7f5b7c0ac4c0 con 0x7f5b8415f170 2024-09-11T23:22:59.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.513+0000 7f5b88e00640 1 --2- 172.21.15.144:0/1400317107 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5b6406bf50 0x7f5b6406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:22:59.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.513+0000 7f5b88e00640 1 --2- 172.21.15.144:0/1400317107 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5b6406bf50 0x7f5b6406e410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b780011e0 tx=0x7f5b78001130 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:22:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.516+0000 7f5b80c00640 1 -- 172.21.15.144:0/1400317107 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5b7c07a720 con 0x7f5b8415f170 2024-09-11T23:22:59.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:22:59.691+0000 7f5b8a200640 1 -- 172.21.15.144:0/1400317107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5b84073890 con 0x7f5b8415f170 2024-09-11T23:23:00.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.326+0000 7f5b80c00640 1 -- 172.21.15.144:0/1400317107 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v93) ==== 169+0+0 (secure 0 0 0) 0x7f5b7c07ea20 con 0x7f5b8415f170 2024-09-11T23:23:00.327 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-11T23:23:00.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.330+0000 7f5b8a200640 1 -- 172.21.15.144:0/1400317107 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5b6406bf50 msgr2=0x7f5b6406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:00.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.330+0000 7f5b8a200640 1 --2- 172.21.15.144:0/1400317107 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5b6406bf50 0x7f5b6406e410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5b780011e0 tx=0x7f5b78001130 comp rx=0 tx=0).stop 2024-09-11T23:23:00.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.330+0000 7f5b8a200640 1 -- 172.21.15.144:0/1400317107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b8415f170 msgr2=0x7f5b8415de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:00.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.330+0000 7f5b8a200640 1 --2- 172.21.15.144:0/1400317107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b8415f170 0x7f5b8415de00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009d90 tx=0x7f5b7c004a40 comp rx=0 tx=0).stop 2024-09-11T23:23:00.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.331+0000 7f5b8a200640 1 -- 172.21.15.144:0/1400317107 shutdown_connections 2024-09-11T23:23:00.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.331+0000 7f5b8a200640 1 --2- 172.21.15.144:0/1400317107 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5b6406bf50 0x7f5b6406e410 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.331+0000 7f5b8a200640 1 --2- 172.21.15.144:0/1400317107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b8415f170 0x7f5b8415de00 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.331+0000 7f5b8a200640 1 --2- 172.21.15.144:0/1400317107 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5b84158cd0 0x7f5b8415d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.331+0000 7f5b8a200640 1 --2- 172.21.15.144:0/1400317107 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5b840b1e60 0x7f5b841f36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.331+0000 7f5b8a200640 1 -- 172.21.15.144:0/1400317107 >> 172.21.15.144:0/1400317107 conn(0x7f5b8406bba0 msgr2=0x7f5b840afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:00.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.331+0000 7f5b8a200640 1 -- 172.21.15.144:0/1400317107 shutdown_connections 2024-09-11T23:23:00.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.331+0000 7f5b8a200640 1 -- 172.21.15.144:0/1400317107 wait complete. 2024-09-11T23:23:00.350 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:23:00.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.505+0000 7f3cb4e00640 1 Processor -- start 2024-09-11T23:23:00.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.505+0000 7f3cb4e00640 1 -- start start 2024-09-11T23:23:00.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.506+0000 7f3cb4e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cb015d3b0 0x7f3cb0071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:00.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.506+0000 7f3cb4e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3cb015d790 0x7f3cb00cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:00.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.506+0000 7f3cb4e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3cb00cd3b0 0x7f3cb00cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:00.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.506+0000 7f3cb4e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3cb006da30 con 0x7f3cb015d790 2024-09-11T23:23:00.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.506+0000 7f3cb4e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3cb00715c0 con 0x7f3cb00cd3b0 2024-09-11T23:23:00.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.506+0000 7f3cb4e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb006d700 con 0x7f3cb015d3b0 2024-09-11T23:23:00.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.506+0000 7f3ca5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3cb015d790 0x7f3cb00cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:00.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.506+0000 7f3ca5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3cb015d790 0x7f3cb00cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59868/0 (socket says 172.21.15.144:59868) 2024-09-11T23:23:00.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.506+0000 7f3ca5400640 1 -- 172.21.15.144:0/1391573327 learned_addr learned my addr 172.21.15.144:0/1391573327 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:00.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.506+0000 7f3cae800640 1 --2- 172.21.15.144:0/1391573327 >> v2:172.21.15.165:3300/0 conn(0x7f3cb00cd3b0 0x7f3cb00cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:00.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.506+0000 7f3cade00640 1 --2- 172.21.15.144:0/1391573327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cb015d3b0 0x7f3cb0071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:00.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.507+0000 7f3ca5400640 1 -- 172.21.15.144:0/1391573327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cb015d3b0 msgr2=0x7f3cb0071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:00.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.507+0000 7f3ca5400640 1 --2- 172.21.15.144:0/1391573327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cb015d3b0 0x7f3cb0071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.507+0000 7f3ca5400640 1 -- 172.21.15.144:0/1391573327 >> v2:172.21.15.165:3300/0 conn(0x7f3cb00cd3b0 msgr2=0x7f3cb00cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:00.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.507+0000 7f3ca5400640 1 --2- 172.21.15.144:0/1391573327 >> v2:172.21.15.165:3300/0 conn(0x7f3cb00cd3b0 0x7f3cb00cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.507+0000 7f3ca5400640 1 -- 172.21.15.144:0/1391573327 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb00cde80 con 0x7f3cb015d790 2024-09-11T23:23:00.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.507+0000 7f3cae800640 1 --2- 172.21.15.144:0/1391573327 >> v2:172.21.15.165:3300/0 conn(0x7f3cb00cd3b0 0x7f3cb00cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:23:00.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.507+0000 7f3cade00640 1 --2- 172.21.15.144:0/1391573327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cb015d3b0 0x7f3cb0071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:23:00.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.508+0000 7f3ca5400640 1 --2- 172.21.15.144:0/1391573327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cb015d790 0x7f3cb00cce70 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f3cb015fef0 tx=0x7f3c9802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ea756c2fdf90b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:00.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.508+0000 7f3cad400640 1 -- 172.21.15.144:0/1391573327 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c98004030 con 0x7f3cb015d790 2024-09-11T23:23:00.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.508+0000 7f3cad400640 1 -- 172.21.15.144:0/1391573327 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c980041d0 con 0x7f3cb015d790 2024-09-11T23:23:00.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.508+0000 7f3cad400640 1 -- 172.21.15.144:0/1391573327 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c98003610 con 0x7f3cb015d790 2024-09-11T23:23:00.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.508+0000 7f3cb4e00640 1 -- 172.21.15.144:0/1391573327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cb015d790 msgr2=0x7f3cb00cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:00.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.508+0000 7f3cb4e00640 1 --2- 172.21.15.144:0/1391573327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cb015d790 0x7f3cb00cce70 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f3cb015fef0 tx=0x7f3c9802a1c0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.509+0000 7f3cb4e00640 1 -- 172.21.15.144:0/1391573327 shutdown_connections 2024-09-11T23:23:00.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.509+0000 7f3cb4e00640 1 --2- 172.21.15.144:0/1391573327 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cb015d790 0x7f3cb00cce70 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.509+0000 7f3cb4e00640 1 --2- 172.21.15.144:0/1391573327 >> v2:172.21.15.165:3300/0 conn(0x7f3cb00cd3b0 0x7f3cb00cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.509+0000 7f3cb4e00640 1 --2- 172.21.15.144:0/1391573327 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cb015d3b0 0x7f3cb0071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.509+0000 7f3cb4e00640 1 -- 172.21.15.144:0/1391573327 >> 172.21.15.144:0/1391573327 conn(0x7f3cb006bba0 msgr2=0x7f3cb006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:00.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.509+0000 7f3cb4e00640 1 -- 172.21.15.144:0/1391573327 shutdown_connections 2024-09-11T23:23:00.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.509+0000 7f3cb4e00640 1 -- 172.21.15.144:0/1391573327 wait complete. 2024-09-11T23:23:00.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.510+0000 7f3cb4e00640 1 Processor -- start 2024-09-11T23:23:00.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.510+0000 7f3cb4e00640 1 -- start start 2024-09-11T23:23:00.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.511+0000 7f3cb4e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cb00cd3b0 0x7f3cb00aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:00.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.511+0000 7f3cb4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cb015d3b0 0x7f3cb0157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:00.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.511+0000 7f3cb4e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cb015ba60 0x7f3cb015bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:00.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.511+0000 7f3cb4e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb015cbf0 con 0x7f3cb015d3b0 2024-09-11T23:23:00.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.511+0000 7f3cb4e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb00cdba0 con 0x7f3cb015ba60 2024-09-11T23:23:00.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.511+0000 7f3cb4e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb015cd70 con 0x7f3cb00cd3b0 2024-09-11T23:23:00.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.512+0000 7f3ca5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cb015d3b0 0x7f3cb0157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:00.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.512+0000 7f3ca5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cb015d3b0 0x7f3cb0157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59870/0 (socket says 172.21.15.144:59870) 2024-09-11T23:23:00.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.512+0000 7f3ca5400640 1 -- 172.21.15.144:0/1657362383 learned_addr learned my addr 172.21.15.144:0/1657362383 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:00.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.512+0000 7f3cade00640 1 --2- 172.21.15.144:0/1657362383 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cb00cd3b0 0x7f3cb00aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:00.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.512+0000 7f3cae800640 1 --2- 172.21.15.144:0/1657362383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cb015ba60 0x7f3cb015bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:00.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.512+0000 7f3ca5400640 1 -- 172.21.15.144:0/1657362383 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cb00cd3b0 msgr2=0x7f3cb00aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:00.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.512+0000 7f3ca5400640 1 --2- 172.21.15.144:0/1657362383 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cb00cd3b0 0x7f3cb00aee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.512+0000 7f3ca5400640 1 -- 172.21.15.144:0/1657362383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cb015ba60 msgr2=0x7f3cb015bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:00.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.512+0000 7f3ca5400640 1 --2- 172.21.15.144:0/1657362383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cb015ba60 0x7f3cb015bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.512+0000 7f3ca5400640 1 -- 172.21.15.144:0/1657362383 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb0148840 con 0x7f3cb015d3b0 2024-09-11T23:23:00.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.512+0000 7f3ca5400640 1 --2- 172.21.15.144:0/1657362383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cb015d3b0 0x7f3cb0157040 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3c9802a200 tx=0x7f3c980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:00.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.513+0000 7f3ca6a00640 1 -- 172.21.15.144:0/1657362383 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c98041020 con 0x7f3cb015d3b0 2024-09-11T23:23:00.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.513+0000 7f3ca6a00640 1 -- 172.21.15.144:0/1657362383 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c98003c50 con 0x7f3cb015d3b0 2024-09-11T23:23:00.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.513+0000 7f3cb4e00640 1 -- 172.21.15.144:0/1657362383 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb01f6060 con 0x7f3cb015d3b0 2024-09-11T23:23:00.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.513+0000 7f3ca6a00640 1 -- 172.21.15.144:0/1657362383 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c98004030 con 0x7f3cb015d3b0 2024-09-11T23:23:00.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.513+0000 7f3cb4e00640 1 -- 172.21.15.144:0/1657362383 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb01f62d0 con 0x7f3cb015d3b0 2024-09-11T23:23:00.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.514+0000 7f3cb4e00640 1 -- 172.21.15.144:0/1657362383 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb0071080 con 0x7f3cb015d3b0 2024-09-11T23:23:00.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.515+0000 7f3ca6a00640 1 -- 172.21.15.144:0/1657362383 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f3c98044020 con 0x7f3cb015d3b0 2024-09-11T23:23:00.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.516+0000 7f3ca6a00640 1 --2- 172.21.15.144:0/1657362383 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3c8c06bf50 0x7f3c8c06e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:00.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.516+0000 7f3ca6a00640 1 -- 172.21.15.144:0/1657362383 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5029+0+0 (secure 0 0 0) 0x7f3c980ab970 con 0x7f3cb015d3b0 2024-09-11T23:23:00.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.516+0000 7f3cade00640 1 --2- 172.21.15.144:0/1657362383 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3c8c06bf50 0x7f3c8c06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:00.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.517+0000 7f3cade00640 1 --2- 172.21.15.144:0/1657362383 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3c8c06bf50 0x7f3c8c06e410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0006e80 tx=0x7f3ca0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:00.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.520+0000 7f3ca6a00640 1 -- 172.21.15.144:0/1657362383 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3c9804b030 con 0x7f3cb015d3b0 2024-09-11T23:23:00.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.705+0000 7f3cb4e00640 1 -- 172.21.15.144:0/1657362383 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f3cb006f930 con 0x7f3cb015d3b0 2024-09-11T23:23:00.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.709+0000 7f3ca6a00640 1 -- 172.21.15.144:0/1657362383 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f3c98079dc0 con 0x7f3cb015d3b0 2024-09-11T23:23:00.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.711+0000 7f3cb4e00640 1 -- 172.21.15.144:0/1657362383 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3c8c06bf50 msgr2=0x7f3c8c06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:00.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.711+0000 7f3cb4e00640 1 --2- 172.21.15.144:0/1657362383 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3c8c06bf50 0x7f3c8c06e410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0006e80 tx=0x7f3ca0008040 comp rx=0 tx=0).stop 2024-09-11T23:23:00.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.711+0000 7f3cb4e00640 1 -- 172.21.15.144:0/1657362383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cb015d3b0 msgr2=0x7f3cb0157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:00.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.711+0000 7f3cb4e00640 1 --2- 172.21.15.144:0/1657362383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cb015d3b0 0x7f3cb0157040 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3c9802a200 tx=0x7f3c980046c0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.711+0000 7f3cb4e00640 1 -- 172.21.15.144:0/1657362383 shutdown_connections 2024-09-11T23:23:00.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.711+0000 7f3cb4e00640 1 --2- 172.21.15.144:0/1657362383 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3c8c06bf50 0x7f3c8c06e410 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.711+0000 7f3cb4e00640 1 --2- 172.21.15.144:0/1657362383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cb015ba60 0x7f3cb015bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.711+0000 7f3cb4e00640 1 --2- 172.21.15.144:0/1657362383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cb015d3b0 0x7f3cb0157040 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.711+0000 7f3cb4e00640 1 --2- 172.21.15.144:0/1657362383 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3cb00cd3b0 0x7f3cb00aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.711+0000 7f3cb4e00640 1 -- 172.21.15.144:0/1657362383 >> 172.21.15.144:0/1657362383 conn(0x7f3cb006bba0 msgr2=0x7f3cb006dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:00.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.711+0000 7f3cb4e00640 1 -- 172.21.15.144:0/1657362383 shutdown_connections 2024-09-11T23:23:00.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.711+0000 7f3cb4e00640 1 -- 172.21.15.144:0/1657362383 wait complete. 2024-09-11T23:23:00.728 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars' 2024-09-11T23:23:00.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.879+0000 7fc804c00640 1 Processor -- start 2024-09-11T23:23:00.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.880+0000 7fc804c00640 1 -- start start 2024-09-11T23:23:00.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.881+0000 7fc804c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc8000d02a0 0x7fc8000d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:00.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.881+0000 7fc804c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc80015ceb0 0x7fc8001594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:00.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.881+0000 7fc804c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8000d0bc0 con 0x7fc80015ca40 2024-09-11T23:23:00.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.881+0000 7fc804c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc80015d390 con 0x7fc80015ceb0 2024-09-11T23:23:00.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.881+0000 7fc804c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc80015d670 con 0x7fc8000d02a0 2024-09-11T23:23:00.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.881+0000 7fc7fe800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc80015ceb0 0x7fc8001594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:00.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.881+0000 7fc7fe800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc80015ceb0 0x7fc8001594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59882/0 (socket says 172.21.15.144:59882) 2024-09-11T23:23:00.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.881+0000 7fc7fe800640 1 -- 172.21.15.144:0/517381666 learned_addr learned my addr 172.21.15.144:0/517381666 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:00.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.881+0000 7fc7fde00640 1 --2- 172.21.15.144:0/517381666 >> v2:172.21.15.165:3300/0 conn(0x7fc8000d02a0 0x7fc8000d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:00.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.882+0000 7fc7fe800640 1 -- 172.21.15.144:0/517381666 >> v2:172.21.15.165:3300/0 conn(0x7fc8000d02a0 msgr2=0x7fc8000d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:00.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.882+0000 7fc7fe800640 1 --2- 172.21.15.144:0/517381666 >> v2:172.21.15.165:3300/0 conn(0x7fc8000d02a0 0x7fc8000d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.882+0000 7fc7fe800640 1 -- 172.21.15.144:0/517381666 >> v1:172.21.15.165:6789/0 conn(0x7fc80015ca40 legacy=0x7fc80015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:00.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.882+0000 7fc7fe800640 1 -- 172.21.15.144:0/517381666 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc80015d950 con 0x7fc80015ceb0 2024-09-11T23:23:00.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.883+0000 7fc7fe800640 1 --2- 172.21.15.144:0/517381666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc80015ceb0 0x7fc8001594c0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc80006f030 tx=0x7fc7f802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16005080857e328 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:00.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.883+0000 7fc7fd400640 1 -- 172.21.15.144:0/517381666 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8033640 con 0x7fc80015ceb0 2024-09-11T23:23:00.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.883+0000 7fc7fd400640 1 -- 172.21.15.144:0/517381666 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f8038070 con 0x7fc80015ceb0 2024-09-11T23:23:00.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.883+0000 7fc7fd400640 1 -- 172.21.15.144:0/517381666 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8033a00 con 0x7fc80015ceb0 2024-09-11T23:23:00.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.884+0000 7fc804c00640 1 -- 172.21.15.144:0/517381666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc80015ceb0 msgr2=0x7fc8001594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:00.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.884+0000 7fc804c00640 1 --2- 172.21.15.144:0/517381666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc80015ceb0 0x7fc8001594c0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc80006f030 tx=0x7fc7f802c8b0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.884+0000 7fc804c00640 1 -- 172.21.15.144:0/517381666 shutdown_connections 2024-09-11T23:23:00.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.884+0000 7fc804c00640 1 --2- 172.21.15.144:0/517381666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc80015ceb0 0x7fc8001594c0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.884+0000 7fc804c00640 1 --2- 172.21.15.144:0/517381666 >> v2:172.21.15.165:3300/0 conn(0x7fc8000d02a0 0x7fc8000d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.884+0000 7fc804c00640 1 -- 172.21.15.144:0/517381666 >> 172.21.15.144:0/517381666 conn(0x7fc800062cc0 msgr2=0x7fc80006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:00.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.884+0000 7fc804c00640 1 -- 172.21.15.144:0/517381666 shutdown_connections 2024-09-11T23:23:00.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.884+0000 7fc804c00640 1 -- 172.21.15.144:0/517381666 wait complete. 2024-09-11T23:23:00.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.885+0000 7fc804c00640 1 Processor -- start 2024-09-11T23:23:00.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.885+0000 7fc804c00640 1 -- start start 2024-09-11T23:23:00.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.886+0000 7fc804c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc8000d02a0 0x7fc8000b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:00.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.886+0000 7fc804c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc80015ca40 0x7fc800147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:00.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.886+0000 7fc804c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc80015ceb0 0x7fc8000cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:00.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.886+0000 7fc804c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc80015eb40 con 0x7fc80015ceb0 2024-09-11T23:23:00.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.886+0000 7fc804c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc80015df10 con 0x7fc80015ca40 2024-09-11T23:23:00.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.886+0000 7fc804c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc800155b90 con 0x7fc8000d02a0 2024-09-11T23:23:00.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.887+0000 7fc7fe800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc80015ceb0 0x7fc8000cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:00.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.887+0000 7fc7fe800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc80015ceb0 0x7fc8000cdf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59896/0 (socket says 172.21.15.144:59896) 2024-09-11T23:23:00.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.887+0000 7fc7fe800640 1 -- 172.21.15.144:0/4036581738 learned_addr learned my addr 172.21.15.144:0/4036581738 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:00.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.887+0000 7fc7f5400640 1 --2- 172.21.15.144:0/4036581738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc80015ca40 0x7fc800147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:00.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.887+0000 7fc7fde00640 1 --2- 172.21.15.144:0/4036581738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc8000d02a0 0x7fc8000b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:00.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.887+0000 7fc7fe800640 1 -- 172.21.15.144:0/4036581738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc8000d02a0 msgr2=0x7fc8000b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:00.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.887+0000 7fc7fe800640 1 --2- 172.21.15.144:0/4036581738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc8000d02a0 0x7fc8000b1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.887+0000 7fc7fe800640 1 -- 172.21.15.144:0/4036581738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc80015ca40 msgr2=0x7fc800147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:00.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.887+0000 7fc7fe800640 1 --2- 172.21.15.144:0/4036581738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc80015ca40 0x7fc800147030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:00.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.887+0000 7fc7fe800640 1 -- 172.21.15.144:0/4036581738 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc80014b050 con 0x7fc80015ceb0 2024-09-11T23:23:00.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.887+0000 7fc7fe800640 1 --2- 172.21.15.144:0/4036581738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc80015ceb0 0x7fc8000cdf10 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fc7f802c8f0 tx=0x7fc7f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:00.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.888+0000 7fc7f6a00640 1 -- 172.21.15.144:0/4036581738 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8043070 con 0x7fc80015ceb0 2024-09-11T23:23:00.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.888+0000 7fc7f6a00640 1 -- 172.21.15.144:0/4036581738 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f803c850 con 0x7fc80015ceb0 2024-09-11T23:23:00.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.888+0000 7fc7f6a00640 1 -- 172.21.15.144:0/4036581738 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f803cc40 con 0x7fc80015ceb0 2024-09-11T23:23:00.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.888+0000 7fc804c00640 1 -- 172.21.15.144:0/4036581738 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc80014b330 con 0x7fc80015ceb0 2024-09-11T23:23:00.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.888+0000 7fc804c00640 1 -- 172.21.15.144:0/4036581738 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc80014b8f0 con 0x7fc80015ceb0 2024-09-11T23:23:00.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.889+0000 7fc804c00640 1 -- 172.21.15.144:0/4036581738 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8000b4790 con 0x7fc80015ceb0 2024-09-11T23:23:00.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.890+0000 7fc7f6a00640 1 -- 172.21.15.144:0/4036581738 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fc7f8046070 con 0x7fc80015ceb0 2024-09-11T23:23:00.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.891+0000 7fc7f6a00640 1 --2- 172.21.15.144:0/4036581738 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7dc06bf80 0x7fc7dc06e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:00.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.891+0000 7fc7f6a00640 1 -- 172.21.15.144:0/4036581738 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5029+0+0 (secure 0 0 0) 0x7fc7f80ab5b0 con 0x7fc80015ceb0 2024-09-11T23:23:00.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.891+0000 7fc7fde00640 1 --2- 172.21.15.144:0/4036581738 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7dc06bf80 0x7fc7dc06e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:00.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.892+0000 7fc7fde00640 1 --2- 172.21.15.144:0/4036581738 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7dc06bf80 0x7fc7dc06e440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00113e0 tx=0x7fc7f000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:00.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:00.895+0000 7fc7f6a00640 1 -- 172.21.15.144:0/4036581738 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc7f8079aa0 con 0x7fc80015ceb0 2024-09-11T23:23:01.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.133+0000 7fc804c00640 1 -- 172.21.15.144:0/4036581738 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]} v 0) -- 0x7fc800074250 con 0x7fc80015ceb0 2024-09-11T23:23:01.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.328+0000 7fc7f6a00640 1 -- 172.21.15.144:0/4036581738 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]}]=0 v278) ==== 146+0+0 (secure 0 0 0) 0x7fc7f807dda0 con 0x7fc80015ceb0 2024-09-11T23:23:01.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.330+0000 7fc804c00640 1 -- 172.21.15.144:0/4036581738 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7dc06bf80 msgr2=0x7fc7dc06e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:01.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.330+0000 7fc804c00640 1 --2- 172.21.15.144:0/4036581738 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7dc06bf80 0x7fc7dc06e440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00113e0 tx=0x7fc7f000b040 comp rx=0 tx=0).stop 2024-09-11T23:23:01.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.330+0000 7fc804c00640 1 -- 172.21.15.144:0/4036581738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc80015ceb0 msgr2=0x7fc8000cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:01.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.330+0000 7fc804c00640 1 --2- 172.21.15.144:0/4036581738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc80015ceb0 0x7fc8000cdf10 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fc7f802c8f0 tx=0x7fc7f8004730 comp rx=0 tx=0).stop 2024-09-11T23:23:01.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.330+0000 7fc804c00640 1 -- 172.21.15.144:0/4036581738 shutdown_connections 2024-09-11T23:23:01.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.330+0000 7fc804c00640 1 --2- 172.21.15.144:0/4036581738 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7dc06bf80 0x7fc7dc06e440 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:01.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.330+0000 7fc804c00640 1 --2- 172.21.15.144:0/4036581738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc80015ceb0 0x7fc8000cdf10 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:01.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.330+0000 7fc804c00640 1 --2- 172.21.15.144:0/4036581738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc80015ca40 0x7fc800147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:01.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.330+0000 7fc804c00640 1 --2- 172.21.15.144:0/4036581738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc8000d02a0 0x7fc8000b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:01.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.330+0000 7fc804c00640 1 -- 172.21.15.144:0/4036581738 >> 172.21.15.144:0/4036581738 conn(0x7fc800062cc0 msgr2=0x7fc80014f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:01.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.331+0000 7fc804c00640 1 -- 172.21.15.144:0/4036581738 shutdown_connections 2024-09-11T23:23:01.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.331+0000 7fc804c00640 1 -- 172.21.15.144:0/4036581738 wait complete. 2024-09-11T23:23:01.348 INFO:tasks.cephfs_test_runner:Test the creating vols, subvols subvolgroups fails when their names uses ... ok 2024-09-11T23:23:01.349 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_no_upgrade_v1_sanity (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- theme continues... 2024-09-11T23:23:01.349 INFO:tasks.cephfs_test_runner:test_subvolume_no_upgrade_v1_sanity (tasks.cephfs.test_volumes.TestMisc) 2024-09-11T23:23:01.349 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:23:01.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.501+0000 7f0b83c00640 1 Processor -- start 2024-09-11T23:23:01.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.501+0000 7f0b83c00640 1 -- start start 2024-09-11T23:23:01.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.503+0000 7f0b83c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0b7c15c180 0x7f0b7c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:01.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.503+0000 7f0b83c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0b7c073120 0x7f0b7c073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:01.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.503+0000 7f0b83c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b7c0ce740 con 0x7f0b7c0ce230 2024-09-11T23:23:01.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.503+0000 7f0b83c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0b7c072640 con 0x7f0b7c15c180 2024-09-11T23:23:01.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.503+0000 7f0b83c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0b7c072920 con 0x7f0b7c073120 2024-09-11T23:23:01.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.503+0000 7f0b81200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0b7c15c180 0x7f0b7c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:01.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.503+0000 7f0b73e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0b7c0ce230 0x7f0b7c0cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47338/0 (socket says 172.21.15.144:47338) 2024-09-11T23:23:01.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.503+0000 7f0b73e00640 1 -- 172.21.15.144:0/528966038 learned_addr learned my addr 172.21.15.144:0/528966038 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:01.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.503+0000 7f0b81200640 1 --2- 172.21.15.144:0/528966038 >> v2:172.21.15.144:3300/0 conn(0x7f0b7c15c180 0x7f0b7c0cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59900/0 (socket says 172.21.15.144:59900) 2024-09-11T23:23:01.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.503+0000 7f0b81c00640 1 --2- 172.21.15.144:0/528966038 >> v2:172.21.15.165:3300/0 conn(0x7f0b7c073120 0x7f0b7c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:01.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.503+0000 7f0b81200640 1 -- 172.21.15.144:0/528966038 >> v2:172.21.15.165:3300/0 conn(0x7f0b7c073120 msgr2=0x7f0b7c073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:01.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.503+0000 7f0b81200640 1 --2- 172.21.15.144:0/528966038 >> v2:172.21.15.165:3300/0 conn(0x7f0b7c073120 0x7f0b7c073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:01.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.503+0000 7f0b81200640 1 -- 172.21.15.144:0/528966038 >> v1:172.21.15.144:6789/0 conn(0x7f0b7c0ce230 legacy=0x7f0b7c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:01.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.503+0000 7f0b81200640 1 -- 172.21.15.144:0/528966038 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7c072c00 con 0x7f0b7c15c180 2024-09-11T23:23:01.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.503+0000 7f0b7be00640 1 -- 172.21.15.144:0/528966038 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1968616437 0 0) 0x7f0b7c0ce740 con 0x7f0b7c0ce230 2024-09-11T23:23:01.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.504+0000 7f0b81200640 1 --2- 172.21.15.144:0/528966038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b7c15c180 0x7f0b7c0cdcf0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c0cd0a0 tx=0x7f0b6c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7137b038b9479635 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:01.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.505+0000 7f0b7be00640 1 -- 172.21.15.144:0/528966038 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c037070 con 0x7f0b7c15c180 2024-09-11T23:23:01.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.505+0000 7f0b7be00640 1 -- 172.21.15.144:0/528966038 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b6c032440 con 0x7f0b7c15c180 2024-09-11T23:23:01.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.505+0000 7f0b7be00640 1 -- 172.21.15.144:0/528966038 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c02ae60 con 0x7f0b7c15c180 2024-09-11T23:23:01.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.505+0000 7f0b83c00640 1 -- 172.21.15.144:0/528966038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b7c15c180 msgr2=0x7f0b7c0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:01.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.505+0000 7f0b83c00640 1 --2- 172.21.15.144:0/528966038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b7c15c180 0x7f0b7c0cdcf0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c0cd0a0 tx=0x7f0b6c02a110 comp rx=0 tx=0).stop 2024-09-11T23:23:01.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.505+0000 7f0b83c00640 1 -- 172.21.15.144:0/528966038 shutdown_connections 2024-09-11T23:23:01.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.505+0000 7f0b83c00640 1 --2- 172.21.15.144:0/528966038 >> v2:172.21.15.165:3300/0 conn(0x7f0b7c073120 0x7f0b7c073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:01.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.505+0000 7f0b83c00640 1 --2- 172.21.15.144:0/528966038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b7c15c180 0x7f0b7c0cdcf0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:01.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.505+0000 7f0b83c00640 1 -- 172.21.15.144:0/528966038 >> 172.21.15.144:0/528966038 conn(0x7f0b7c062cc0 msgr2=0x7f0b7c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:01.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.505+0000 7f0b83c00640 1 -- 172.21.15.144:0/528966038 shutdown_connections 2024-09-11T23:23:01.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.505+0000 7f0b83c00640 1 -- 172.21.15.144:0/528966038 wait complete. 2024-09-11T23:23:01.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.507+0000 7f0b83c00640 1 Processor -- start 2024-09-11T23:23:01.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.507+0000 7f0b83c00640 1 -- start start 2024-09-11T23:23:01.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.508+0000 7f0b83c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b7c073120 0x7f0b7c1f53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:01.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.508+0000 7f0b83c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b7c0ce230 0x7f0b7c0cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:01.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.508+0000 7f0b83c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b7c15c180 0x7f0b7c15ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:01.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.508+0000 7f0b83c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c0cf780 con 0x7f0b7c0ce230 2024-09-11T23:23:01.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.508+0000 7f0b83c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c0722f0 con 0x7f0b7c15c180 2024-09-11T23:23:01.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.508+0000 7f0b83c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0b7c15c560 con 0x7f0b7c073120 2024-09-11T23:23:01.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.508+0000 7f0b73e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b7c0ce230 0x7f0b7c0cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:01.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.508+0000 7f0b73e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b7c0ce230 0x7f0b7c0cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59904/0 (socket says 172.21.15.144:59904) 2024-09-11T23:23:01.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.508+0000 7f0b73e00640 1 -- 172.21.15.144:0/1755814570 learned_addr learned my addr 172.21.15.144:0/1755814570 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:01.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.508+0000 7f0b81200640 1 --2- 172.21.15.144:0/1755814570 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b7c073120 0x7f0b7c1f53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:01.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.508+0000 7f0b81c00640 1 --2- 172.21.15.144:0/1755814570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b7c15c180 0x7f0b7c15ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:01.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.509+0000 7f0b73e00640 1 -- 172.21.15.144:0/1755814570 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b7c073120 msgr2=0x7f0b7c1f53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:01.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.509+0000 7f0b73e00640 1 --2- 172.21.15.144:0/1755814570 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b7c073120 0x7f0b7c1f53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:01.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.509+0000 7f0b73e00640 1 -- 172.21.15.144:0/1755814570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b7c15c180 msgr2=0x7f0b7c15ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:01.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.509+0000 7f0b73e00640 1 --2- 172.21.15.144:0/1755814570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b7c15c180 0x7f0b7c15ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:01.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.509+0000 7f0b73e00640 1 -- 172.21.15.144:0/1755814570 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7c0cc890 con 0x7f0b7c0ce230 2024-09-11T23:23:01.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.509+0000 7f0b73e00640 1 --2- 172.21.15.144:0/1755814570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b7c0ce230 0x7f0b7c0cc350 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400c430 tx=0x7f0b6400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:01.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.509+0000 7f0b79600640 1 -- 172.21.15.144:0/1755814570 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b640074e0 con 0x7f0b7c0ce230 2024-09-11T23:23:01.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.509+0000 7f0b79600640 1 -- 172.21.15.144:0/1755814570 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b640047e0 con 0x7f0b7c0ce230 2024-09-11T23:23:01.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.509+0000 7f0b79600640 1 -- 172.21.15.144:0/1755814570 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b64004bd0 con 0x7f0b7c0ce230 2024-09-11T23:23:01.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.509+0000 7f0b83c00640 1 -- 172.21.15.144:0/1755814570 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b7c1f5a60 con 0x7f0b7c0ce230 2024-09-11T23:23:01.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.509+0000 7f0b83c00640 1 -- 172.21.15.144:0/1755814570 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b7c1f6020 con 0x7f0b7c0ce230 2024-09-11T23:23:01.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.510+0000 7f0b83c00640 1 -- 172.21.15.144:0/1755814570 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b7c0cdcf0 con 0x7f0b7c0ce230 2024-09-11T23:23:01.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.511+0000 7f0b79600640 1 -- 172.21.15.144:0/1755814570 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f0b64011070 con 0x7f0b7c0ce230 2024-09-11T23:23:01.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.512+0000 7f0b79600640 1 --2- 172.21.15.144:0/1755814570 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0b5806bf50 0x7f0b5806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:01.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.512+0000 7f0b79600640 1 -- 172.21.15.144:0/1755814570 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5029+0+0 (secure 0 0 0) 0x7f0b6408a820 con 0x7f0b7c0ce230 2024-09-11T23:23:01.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.513+0000 7f0b81200640 1 --2- 172.21.15.144:0/1755814570 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0b5806bf50 0x7f0b5806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:01.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.513+0000 7f0b81200640 1 --2- 172.21.15.144:0/1755814570 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0b5806bf50 0x7f0b5806e410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c034000 tx=0x7f0b6c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:01.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.516+0000 7f0b79600640 1 -- 172.21.15.144:0/1755814570 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0b64058d00 con 0x7f0b7c0ce230 2024-09-11T23:23:01.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.693+0000 7f0b83c00640 1 -- 172.21.15.144:0/1755814570 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b7c156e90 con 0x7f0b7c0ce230 2024-09-11T23:23:01.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.694+0000 7f0b79600640 1 -- 172.21.15.144:0/1755814570 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+13191 (secure 0 0 0) 0x7f0b6405d000 con 0x7f0b7c0ce230 2024-09-11T23:23:01.695 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:01.695 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":93,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:23:00.320611+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6835/1018187462":"2024-09-12T23:22:57.308737+0000","172.21.15.144:6801/1018187462":"2024-09-12T23:22:57.308737+0000","172.21.15.165:6835/3966608439":"2024-09-12T23:22:50.055731+0000","172.21.15.165:6833/3966608439":"2024-09-12T23:22:50.055731+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:23:01.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.696+0000 7f0b83c00640 1 -- 172.21.15.144:0/1755814570 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0b5806bf50 msgr2=0x7f0b5806e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:01.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.696+0000 7f0b83c00640 1 --2- 172.21.15.144:0/1755814570 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0b5806bf50 0x7f0b5806e410 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c034000 tx=0x7f0b6c02e000 comp rx=0 tx=0).stop 2024-09-11T23:23:01.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.696+0000 7f0b83c00640 1 -- 172.21.15.144:0/1755814570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b7c0ce230 msgr2=0x7f0b7c0cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:01.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.696+0000 7f0b83c00640 1 --2- 172.21.15.144:0/1755814570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b7c0ce230 0x7f0b7c0cc350 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f0b6400c430 tx=0x7f0b6400c8f0 comp rx=0 tx=0).stop 2024-09-11T23:23:01.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.697+0000 7f0b83c00640 1 -- 172.21.15.144:0/1755814570 shutdown_connections 2024-09-11T23:23:01.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.697+0000 7f0b83c00640 1 --2- 172.21.15.144:0/1755814570 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0b5806bf50 0x7f0b5806e410 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:01.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.697+0000 7f0b83c00640 1 --2- 172.21.15.144:0/1755814570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b7c15c180 0x7f0b7c15ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:01.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.697+0000 7f0b83c00640 1 --2- 172.21.15.144:0/1755814570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0b7c0ce230 0x7f0b7c0cc350 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:01.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.697+0000 7f0b83c00640 1 --2- 172.21.15.144:0/1755814570 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0b7c073120 0x7f0b7c1f53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:01.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.697+0000 7f0b83c00640 1 -- 172.21.15.144:0/1755814570 >> 172.21.15.144:0/1755814570 conn(0x7f0b7c062cc0 msgr2=0x7f0b7c06c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:01.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.697+0000 7f0b83c00640 1 -- 172.21.15.144:0/1755814570 shutdown_connections 2024-09-11T23:23:01.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.697+0000 7f0b83c00640 1 -- 172.21.15.144:0/1755814570 wait complete. 2024-09-11T23:23:01.714 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:17:47.307937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:23:01.715 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:23:01.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.870+0000 7f6668200640 1 Processor -- start 2024-09-11T23:23:01.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.870+0000 7f6668200640 1 -- start start 2024-09-11T23:23:01.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.871+0000 7f6668200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f666015d790 0x7f66600cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:01.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.872+0000 7f6668200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f666006d700 con 0x7f66600cd3b0 2024-09-11T23:23:01.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.872+0000 7f6668200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66600cde80 con 0x7f666015d3b0 2024-09-11T23:23:01.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.872+0000 7f6668200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f666006da30 con 0x7f666015d790 2024-09-11T23:23:01.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.872+0000 7f6664e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f666015d790 0x7f66600cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:01.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.872+0000 7f6664e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f666015d790 0x7f66600cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59916/0 (socket says 172.21.15.144:59916) 2024-09-11T23:23:01.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.872+0000 7f6664e00640 1 -- 172.21.15.144:0/3807247000 learned_addr learned my addr 172.21.15.144:0/3807247000 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:01.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.872+0000 7f6666200640 1 --1- 172.21.15.144:0/3807247000 >> v1:172.21.15.144:6789/0 conn(0x7f66600cd3b0 0x7f66600cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47342/0 (socket says 172.21.15.144:47342) 2024-09-11T23:23:01.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.872+0000 7f6664e00640 1 -- 172.21.15.144:0/3807247000 >> v1:172.21.15.165:6789/0 conn(0x7f666015d3b0 legacy=0x7f6660071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:01.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.872+0000 7f6664e00640 1 -- 172.21.15.144:0/3807247000 >> v1:172.21.15.144:6789/0 conn(0x7f66600cd3b0 legacy=0x7f66600cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:01.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.872+0000 7f6664e00640 1 -- 172.21.15.144:0/3807247000 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66600cd8c0 con 0x7f666015d790 2024-09-11T23:23:01.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.872+0000 7f665fe00640 1 -- 172.21.15.144:0/3807247000 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2184238833 0 0) 0x7f666006d700 con 0x7f66600cd3b0 2024-09-11T23:23:01.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.873+0000 7f6664e00640 1 --2- 172.21.15.144:0/3807247000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f666015d790 0x7f66600cce70 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f664c009850 tx=0x7f664c02a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c57029f377ebf54 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:01.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.873+0000 7f665fe00640 1 -- 172.21.15.144:0/3807247000 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c004230 con 0x7f666015d790 2024-09-11T23:23:01.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.874+0000 7f665fe00640 1 -- 172.21.15.144:0/3807247000 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664c0043d0 con 0x7f666015d790 2024-09-11T23:23:01.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.874+0000 7f665fe00640 1 -- 172.21.15.144:0/3807247000 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c003810 con 0x7f666015d790 2024-09-11T23:23:01.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.874+0000 7f6668200640 1 -- 172.21.15.144:0/3807247000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f666015d790 msgr2=0x7f66600cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:01.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.874+0000 7f6668200640 1 --2- 172.21.15.144:0/3807247000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f666015d790 0x7f66600cce70 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f664c009850 tx=0x7f664c02a2e0 comp rx=0 tx=0).stop 2024-09-11T23:23:01.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.874+0000 7f6668200640 1 -- 172.21.15.144:0/3807247000 shutdown_connections 2024-09-11T23:23:01.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.874+0000 7f6668200640 1 --2- 172.21.15.144:0/3807247000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f666015d790 0x7f66600cce70 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:01.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.874+0000 7f6668200640 1 -- 172.21.15.144:0/3807247000 >> 172.21.15.144:0/3807247000 conn(0x7f666006bba0 msgr2=0x7f666006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:01.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.874+0000 7f6668200640 1 -- 172.21.15.144:0/3807247000 shutdown_connections 2024-09-11T23:23:01.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.874+0000 7f6668200640 1 -- 172.21.15.144:0/3807247000 wait complete. 2024-09-11T23:23:01.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.876+0000 7f6668200640 1 Processor -- start 2024-09-11T23:23:01.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.876+0000 7f6668200640 1 -- start start 2024-09-11T23:23:01.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.877+0000 7f6668200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66600cd3b0 0x7f6660156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:01.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.877+0000 7f6668200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f666015d3b0 0x7f6660156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:01.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.877+0000 7f6668200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66601441c0 0x7f66601447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:01.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.877+0000 7f6668200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f666015cd70 con 0x7f66601441c0 2024-09-11T23:23:01.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.877+0000 7f6668200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f666015cbf0 con 0x7f666015d3b0 2024-09-11T23:23:01.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.877+0000 7f6668200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f66600cfa30 con 0x7f66600cd3b0 2024-09-11T23:23:01.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.877+0000 7f6666200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66601441c0 0x7f66601447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:01.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.877+0000 7f6666200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66601441c0 0x7f66601447c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59922/0 (socket says 172.21.15.144:59922) 2024-09-11T23:23:01.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.877+0000 7f6666200640 1 -- 172.21.15.144:0/825102443 learned_addr learned my addr 172.21.15.144:0/825102443 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:01.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.877+0000 7f6664e00640 1 --2- 172.21.15.144:0/825102443 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f666015d3b0 0x7f6660156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:01.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.877+0000 7f6665800640 1 --2- 172.21.15.144:0/825102443 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66600cd3b0 0x7f6660156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:01.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.878+0000 7f6666200640 1 -- 172.21.15.144:0/825102443 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66600cd3b0 msgr2=0x7f6660156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:01.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.878+0000 7f6666200640 1 --2- 172.21.15.144:0/825102443 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66600cd3b0 0x7f6660156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:01.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.878+0000 7f6666200640 1 -- 172.21.15.144:0/825102443 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f666015d3b0 msgr2=0x7f6660156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:01.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.878+0000 7f6666200640 1 --2- 172.21.15.144:0/825102443 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f666015d3b0 0x7f6660156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:01.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.878+0000 7f6666200640 1 -- 172.21.15.144:0/825102443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66601453a0 con 0x7f66601441c0 2024-09-11T23:23:01.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.878+0000 7f6666200640 1 --2- 172.21.15.144:0/825102443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66601441c0 0x7f66601447c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f665800c7a0 tx=0x7f665800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:01.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.878+0000 7f665d600640 1 -- 172.21.15.144:0/825102443 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658018070 con 0x7f66601441c0 2024-09-11T23:23:01.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.878+0000 7f665d600640 1 -- 172.21.15.144:0/825102443 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f665800ce50 con 0x7f66601441c0 2024-09-11T23:23:01.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.878+0000 7f6668200640 1 -- 172.21.15.144:0/825102443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6660145680 con 0x7f66601441c0 2024-09-11T23:23:01.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.878+0000 7f665d600640 1 -- 172.21.15.144:0/825102443 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665800a820 con 0x7f66601441c0 2024-09-11T23:23:01.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.878+0000 7f6668200640 1 -- 172.21.15.144:0/825102443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6660145c40 con 0x7f66601441c0 2024-09-11T23:23:01.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.879+0000 7f6668200640 1 -- 172.21.15.144:0/825102443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f666006c260 con 0x7f66601441c0 2024-09-11T23:23:01.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.880+0000 7f665d600640 1 -- 172.21.15.144:0/825102443 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f665801b070 con 0x7f66601441c0 2024-09-11T23:23:01.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.881+0000 7f665d600640 1 --2- 172.21.15.144:0/825102443 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f664006bf80 0x7f664006e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:01.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.881+0000 7f665d600640 1 -- 172.21.15.144:0/825102443 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5029+0+0 (secure 0 0 0) 0x7f665808a1f0 con 0x7f66601441c0 2024-09-11T23:23:01.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.881+0000 7f6665800640 1 --2- 172.21.15.144:0/825102443 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f664006bf80 0x7f664006e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:01.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.882+0000 7f6665800640 1 --2- 172.21.15.144:0/825102443 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f664006bf80 0x7f664006e440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6654000f60 tx=0x7f6654009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:01.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:01.885+0000 7f665d600640 1 -- 172.21.15.144:0/825102443 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6658058640 con 0x7f66601441c0 2024-09-11T23:23:02.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.060+0000 7f6668200640 1 -- 172.21.15.144:0/825102443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f666006bf80 con 0x7f66601441c0 2024-09-11T23:23:02.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.061+0000 7f665d600640 1 -- 172.21.15.144:0/825102443 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7f665805c940 con 0x7f66601441c0 2024-09-11T23:23:02.062 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-11T23:23:02.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.063+0000 7f6668200640 1 -- 172.21.15.144:0/825102443 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f664006bf80 msgr2=0x7f664006e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:02.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.063+0000 7f6668200640 1 --2- 172.21.15.144:0/825102443 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f664006bf80 0x7f664006e440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6654000f60 tx=0x7f6654009040 comp rx=0 tx=0).stop 2024-09-11T23:23:02.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.063+0000 7f6668200640 1 -- 172.21.15.144:0/825102443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66601441c0 msgr2=0x7f66601447c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:02.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.063+0000 7f6668200640 1 --2- 172.21.15.144:0/825102443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66601441c0 0x7f66601447c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f665800c7a0 tx=0x7f665800cc60 comp rx=0 tx=0).stop 2024-09-11T23:23:02.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.063+0000 7f6668200640 1 -- 172.21.15.144:0/825102443 shutdown_connections 2024-09-11T23:23:02.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.063+0000 7f6668200640 1 --2- 172.21.15.144:0/825102443 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f664006bf80 0x7f664006e440 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:02.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.063+0000 7f6668200640 1 --2- 172.21.15.144:0/825102443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66601441c0 0x7f66601447c0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:02.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.063+0000 7f6668200640 1 --2- 172.21.15.144:0/825102443 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f666015d3b0 0x7f6660156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:02.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.063+0000 7f6668200640 1 --2- 172.21.15.144:0/825102443 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f66600cd3b0 0x7f6660156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:02.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.063+0000 7f6668200640 1 -- 172.21.15.144:0/825102443 >> 172.21.15.144:0/825102443 conn(0x7f666006bba0 msgr2=0x7f666006dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:02.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.063+0000 7f6668200640 1 -- 172.21.15.144:0/825102443 shutdown_connections 2024-09-11T23:23:02.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.063+0000 7f6668200640 1 -- 172.21.15.144:0/825102443 wait complete. 2024-09-11T23:23:02.081 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity' 2024-09-11T23:23:02.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.234+0000 7f89c3e00640 1 Processor -- start 2024-09-11T23:23:02.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.234+0000 7f89c3e00640 1 -- start start 2024-09-11T23:23:02.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.235+0000 7f89c3e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f89c40b5fd0 0x7f89c40b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:02.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.235+0000 7f89c3e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89c40b7750 0x7f89c40b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:02.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.235+0000 7f89c3e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c406bee0 con 0x7f89c415e640 2024-09-11T23:23:02.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.235+0000 7f89c3e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f89c415ea20 con 0x7f89c40b5fd0 2024-09-11T23:23:02.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.235+0000 7f89c3e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f89c406caf0 con 0x7f89c40b7750 2024-09-11T23:23:02.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.235+0000 7f89c2a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f89c415e640 0x7f89c40d3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47358/0 (socket says 172.21.15.144:47358) 2024-09-11T23:23:02.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.235+0000 7f89c2a00640 1 -- 172.21.15.144:0/1451128199 learned_addr learned my addr 172.21.15.144:0/1451128199 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:02.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.236+0000 7f89ba000640 1 --2- 172.21.15.144:0/1451128199 >> v2:172.21.15.165:3300/0 conn(0x7f89c40b5fd0 0x7f89c40b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:02.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.236+0000 7f89c3400640 1 --2- 172.21.15.144:0/1451128199 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89c40b7750 0x7f89c40b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:02.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.236+0000 7f89c2000640 1 -- 172.21.15.144:0/1451128199 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1489503512 0 0) 0x7f89c406bee0 con 0x7f89c415e640 2024-09-11T23:23:02.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.236+0000 7f89c2000640 1 -- 172.21.15.144:0/1451128199 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89a8003520 con 0x7f89c415e640 2024-09-11T23:23:02.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.236+0000 7f89ba000640 1 -- 172.21.15.144:0/1451128199 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89c40b7750 msgr2=0x7f89c40b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:02.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.236+0000 7f89ba000640 1 --2- 172.21.15.144:0/1451128199 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89c40b7750 0x7f89c40b7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:02.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.236+0000 7f89ba000640 1 -- 172.21.15.144:0/1451128199 >> v1:172.21.15.144:6789/0 conn(0x7f89c415e640 legacy=0x7f89c40d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:02.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.236+0000 7f89ba000640 1 -- 172.21.15.144:0/1451128199 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c406c1c0 con 0x7f89c40b5fd0 2024-09-11T23:23:02.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.237+0000 7f89ba000640 1 --2- 172.21.15.144:0/1451128199 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89c40b5fd0 0x7f89c40b6410 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0097a0 tx=0x7f89ac02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea31ea1a3d3cbbe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:02.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.237+0000 7f89c2000640 1 -- 172.21.15.144:0/1451128199 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac037070 con 0x7f89c40b5fd0 2024-09-11T23:23:02.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.238+0000 7f89c2000640 1 -- 172.21.15.144:0/1451128199 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89ac032440 con 0x7f89c40b5fd0 2024-09-11T23:23:02.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.238+0000 7f89c2000640 1 -- 172.21.15.144:0/1451128199 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac0327f0 con 0x7f89c40b5fd0 2024-09-11T23:23:02.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.238+0000 7f89c3e00640 1 -- 172.21.15.144:0/1451128199 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89c40b5fd0 msgr2=0x7f89c40b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:02.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.238+0000 7f89c3e00640 1 --2- 172.21.15.144:0/1451128199 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89c40b5fd0 0x7f89c40b6410 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0097a0 tx=0x7f89ac02a180 comp rx=0 tx=0).stop 2024-09-11T23:23:02.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.238+0000 7f89c3e00640 1 -- 172.21.15.144:0/1451128199 shutdown_connections 2024-09-11T23:23:02.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.238+0000 7f89c3e00640 1 --2- 172.21.15.144:0/1451128199 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89c40b7750 0x7f89c40b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:02.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.238+0000 7f89c3e00640 1 --2- 172.21.15.144:0/1451128199 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89c40b5fd0 0x7f89c40b6410 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:02.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.238+0000 7f89c3e00640 1 -- 172.21.15.144:0/1451128199 >> 172.21.15.144:0/1451128199 conn(0x7f89c40d0fd0 msgr2=0x7f89c40d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:02.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.238+0000 7f89c3e00640 1 -- 172.21.15.144:0/1451128199 shutdown_connections 2024-09-11T23:23:02.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.238+0000 7f89c3e00640 1 -- 172.21.15.144:0/1451128199 wait complete. 2024-09-11T23:23:02.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.240+0000 7f89c3e00640 1 Processor -- start 2024-09-11T23:23:02.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.240+0000 7f89c3e00640 1 -- start start 2024-09-11T23:23:02.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.241+0000 7f89c3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89c40b5fd0 0x7f89c41f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:02.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.241+0000 7f89c3e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89c40b7750 0x7f89c41589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:02.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.241+0000 7f89c3e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89c415e640 0x7f89c4159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:02.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.241+0000 7f89c3e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f89c406c780 con 0x7f89c40b5fd0 2024-09-11T23:23:02.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.241+0000 7f89c3e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f89c40b6950 con 0x7f89c40b7750 2024-09-11T23:23:02.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.241+0000 7f89c3e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f89c40d4130 con 0x7f89c415e640 2024-09-11T23:23:02.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.241+0000 7f89c2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89c40b5fd0 0x7f89c41f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:02.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.241+0000 7f89c2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89c40b5fd0 0x7f89c41f3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59926/0 (socket says 172.21.15.144:59926) 2024-09-11T23:23:02.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.241+0000 7f89c2a00640 1 -- 172.21.15.144:0/1804922747 learned_addr learned my addr 172.21.15.144:0/1804922747 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:02.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.241+0000 7f89ba000640 1 --2- 172.21.15.144:0/1804922747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89c40b7750 0x7f89c41589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:02.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.241+0000 7f89c3400640 1 --2- 172.21.15.144:0/1804922747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89c415e640 0x7f89c4159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:02.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.241+0000 7f89c2a00640 1 -- 172.21.15.144:0/1804922747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89c415e640 msgr2=0x7f89c4159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:02.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.241+0000 7f89c2a00640 1 --2- 172.21.15.144:0/1804922747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89c415e640 0x7f89c4159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:02.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.241+0000 7f89c2a00640 1 -- 172.21.15.144:0/1804922747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89c40b7750 msgr2=0x7f89c41589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:02.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.241+0000 7f89c2a00640 1 --2- 172.21.15.144:0/1804922747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89c40b7750 0x7f89c41589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:02.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.241+0000 7f89c2a00640 1 -- 172.21.15.144:0/1804922747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c40ce690 con 0x7f89c40b5fd0 2024-09-11T23:23:02.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.242+0000 7f89c2a00640 1 --2- 172.21.15.144:0/1804922747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89c40b5fd0 0x7f89c41f3cd0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f89b400c430 tx=0x7f89b400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:02.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.242+0000 7f89bb400640 1 -- 172.21.15.144:0/1804922747 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b4017070 con 0x7f89c40b5fd0 2024-09-11T23:23:02.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.242+0000 7f89bb400640 1 -- 172.21.15.144:0/1804922747 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89b4005ce0 con 0x7f89c40b5fd0 2024-09-11T23:23:02.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.242+0000 7f89bb400640 1 -- 172.21.15.144:0/1804922747 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b40072f0 con 0x7f89c40b5fd0 2024-09-11T23:23:02.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.242+0000 7f89c3e00640 1 -- 172.21.15.144:0/1804922747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89c41f4420 con 0x7f89c40b5fd0 2024-09-11T23:23:02.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.242+0000 7f89c3e00640 1 -- 172.21.15.144:0/1804922747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89c41f49e0 con 0x7f89c40b5fd0 2024-09-11T23:23:02.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.243+0000 7f89c3e00640 1 -- 172.21.15.144:0/1804922747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89c40b6410 con 0x7f89c40b5fd0 2024-09-11T23:23:02.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.244+0000 7f89bb400640 1 -- 172.21.15.144:0/1804922747 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f89b401a070 con 0x7f89c40b5fd0 2024-09-11T23:23:02.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.245+0000 7f89bb400640 1 --2- 172.21.15.144:0/1804922747 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f89a006bf50 0x7f89a006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:02.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.245+0000 7f89bb400640 1 -- 172.21.15.144:0/1804922747 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5029+0+0 (secure 0 0 0) 0x7f89b408a110 con 0x7f89c40b5fd0 2024-09-11T23:23:02.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.245+0000 7f89ba000640 1 --2- 172.21.15.144:0/1804922747 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f89a006bf50 0x7f89a006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:02.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.246+0000 7f89ba000640 1 --2- 172.21.15.144:0/1804922747 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f89a006bf50 0x7f89a006e410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89ac034000 tx=0x7f89ac02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:02.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.249+0000 7f89bb400640 1 -- 172.21.15.144:0/1804922747 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f89b40585f0 con 0x7f89c40b5fd0 2024-09-11T23:23:02.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:02.488+0000 7f89c3e00640 1 -- 172.21.15.144:0/1804922747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]} v 0) -- 0x7f89c40d3e50 con 0x7f89c40b5fd0 2024-09-11T23:23:03.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.336+0000 7f89bb400640 1 -- 172.21.15.144:0/1804922747 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]}]=0 v280) ==== 152+0+0 (secure 0 0 0) 0x7f89b405c8f0 con 0x7f89c40b5fd0 2024-09-11T23:23:03.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.339+0000 7f89c3e00640 1 -- 172.21.15.144:0/1804922747 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f89a006bf50 msgr2=0x7f89a006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:03.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.339+0000 7f89c3e00640 1 --2- 172.21.15.144:0/1804922747 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f89a006bf50 0x7f89a006e410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89ac034000 tx=0x7f89ac02e000 comp rx=0 tx=0).stop 2024-09-11T23:23:03.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.339+0000 7f89c3e00640 1 -- 172.21.15.144:0/1804922747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89c40b5fd0 msgr2=0x7f89c41f3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:03.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.339+0000 7f89c3e00640 1 --2- 172.21.15.144:0/1804922747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89c40b5fd0 0x7f89c41f3cd0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f89b400c430 tx=0x7f89b400c8f0 comp rx=0 tx=0).stop 2024-09-11T23:23:03.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.339+0000 7f89c3e00640 1 -- 172.21.15.144:0/1804922747 shutdown_connections 2024-09-11T23:23:03.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.339+0000 7f89c3e00640 1 --2- 172.21.15.144:0/1804922747 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f89a006bf50 0x7f89a006e410 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:03.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.339+0000 7f89c3e00640 1 --2- 172.21.15.144:0/1804922747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89c415e640 0x7f89c4159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:03.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.339+0000 7f89c3e00640 1 --2- 172.21.15.144:0/1804922747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89c40b7750 0x7f89c41589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:03.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.339+0000 7f89c3e00640 1 --2- 172.21.15.144:0/1804922747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89c40b5fd0 0x7f89c41f3cd0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:03.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.339+0000 7f89c3e00640 1 -- 172.21.15.144:0/1804922747 >> 172.21.15.144:0/1804922747 conn(0x7f89c40d0fd0 msgr2=0x7f89c40d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:03.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.339+0000 7f89c3e00640 1 -- 172.21.15.144:0/1804922747 shutdown_connections 2024-09-11T23:23:03.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.339+0000 7f89c3e00640 1 -- 172.21.15.144:0/1804922747 wait complete. 2024-09-11T23:23:03.358 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:23:03.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.517+0000 7f833d000640 1 Processor -- start 2024-09-11T23:23:03.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.517+0000 7f833d000640 1 -- start start 2024-09-11T23:23:03.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.518+0000 7f833d000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83380b3430 0x7f83380cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:03.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.518+0000 7f833d000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f833806c2d0 0x7f83380b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:03.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.518+0000 7f833d000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83380b3d50 con 0x7f833806d8c0 2024-09-11T23:23:03.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.518+0000 7f833d000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f83380d22c0 con 0x7f833806c2d0 2024-09-11T23:23:03.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.518+0000 7f833d000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f833815e9d0 con 0x7f83380b3430 2024-09-11T23:23:03.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.519+0000 7f8335e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83380b3430 0x7f83380cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:03.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.519+0000 7f8335e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83380b3430 0x7f83380cf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:51142/0 (socket says 172.21.15.144:51142) 2024-09-11T23:23:03.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.519+0000 7f8335e00640 1 -- 172.21.15.144:0/10709365 learned_addr learned my addr 172.21.15.144:0/10709365 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:03.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.519+0000 7f8335400640 1 --2- 172.21.15.144:0/10709365 >> v2:172.21.15.165:3300/0 conn(0x7f833806c2d0 0x7f83380b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:03.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.519+0000 7f8335e00640 1 -- 172.21.15.144:0/10709365 >> v2:172.21.15.165:3300/0 conn(0x7f833806c2d0 msgr2=0x7f83380b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:03.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.519+0000 7f8335e00640 1 --2- 172.21.15.144:0/10709365 >> v2:172.21.15.165:3300/0 conn(0x7f833806c2d0 0x7f83380b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:03.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.519+0000 7f8335e00640 1 -- 172.21.15.144:0/10709365 >> v1:172.21.15.165:6789/0 conn(0x7f833806d8c0 legacy=0x7f833806dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:03.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.519+0000 7f8335e00640 1 -- 172.21.15.144:0/10709365 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833806ca70 con 0x7f83380b3430 2024-09-11T23:23:03.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.520+0000 7f8335e00640 1 --2- 172.21.15.144:0/10709365 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83380b3430 0x7f83380cf750 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8328009870 tx=0x7f832802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f42be57b0b47c58 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:03.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.520+0000 7f8334a00640 1 -- 172.21.15.144:0/10709365 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8328037070 con 0x7f83380b3430 2024-09-11T23:23:03.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.521+0000 7f8334a00640 1 -- 172.21.15.144:0/10709365 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8328032440 con 0x7f83380b3430 2024-09-11T23:23:03.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.521+0000 7f8334a00640 1 -- 172.21.15.144:0/10709365 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8328032810 con 0x7f83380b3430 2024-09-11T23:23:03.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.521+0000 7f833d000640 1 -- 172.21.15.144:0/10709365 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83380b3430 msgr2=0x7f83380cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:03.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.521+0000 7f833d000640 1 --2- 172.21.15.144:0/10709365 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83380b3430 0x7f83380cf750 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8328009870 tx=0x7f832802a1c0 comp rx=0 tx=0).stop 2024-09-11T23:23:03.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.521+0000 7f833d000640 1 -- 172.21.15.144:0/10709365 shutdown_connections 2024-09-11T23:23:03.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.521+0000 7f833d000640 1 --2- 172.21.15.144:0/10709365 >> v2:172.21.15.165:3300/0 conn(0x7f833806c2d0 0x7f83380b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:03.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.521+0000 7f833d000640 1 --2- 172.21.15.144:0/10709365 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f83380b3430 0x7f83380cf750 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:03.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.521+0000 7f833d000640 1 -- 172.21.15.144:0/10709365 >> 172.21.15.144:0/10709365 conn(0x7f83380d4b10 msgr2=0x7f83380d4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:03.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.521+0000 7f833d000640 1 -- 172.21.15.144:0/10709365 shutdown_connections 2024-09-11T23:23:03.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.521+0000 7f833d000640 1 -- 172.21.15.144:0/10709365 wait complete. 2024-09-11T23:23:03.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.523+0000 7f833d000640 1 Processor -- start 2024-09-11T23:23:03.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.523+0000 7f833d000640 1 -- start start 2024-09-11T23:23:03.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.524+0000 7f833d000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f833806c2d0 0x7f83380c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:03.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.524+0000 7f833d000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f833806d8c0 0x7f8338150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:03.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.524+0000 7f833d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83380b3430 0x7f83380cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:03.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.524+0000 7f833d000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f83380d27f0 con 0x7f83380b3430 2024-09-11T23:23:03.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.524+0000 7f833d000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f83380d2510 con 0x7f833806d8c0 2024-09-11T23:23:03.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.524+0000 7f833d000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f833806c710 con 0x7f833806c2d0 2024-09-11T23:23:03.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.524+0000 7f8336800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83380b3430 0x7f83380cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:03.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.524+0000 7f8336800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83380b3430 0x7f83380cd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59942/0 (socket says 172.21.15.144:59942) 2024-09-11T23:23:03.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.524+0000 7f8336800640 1 -- 172.21.15.144:0/3559877806 learned_addr learned my addr 172.21.15.144:0/3559877806 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:03.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.524+0000 7f8335400640 1 --2- 172.21.15.144:0/3559877806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f833806d8c0 0x7f8338150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:03.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.524+0000 7f8335e00640 1 --2- 172.21.15.144:0/3559877806 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f833806c2d0 0x7f83380c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:03.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.525+0000 7f8336800640 1 -- 172.21.15.144:0/3559877806 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f833806c2d0 msgr2=0x7f83380c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:03.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.525+0000 7f8336800640 1 --2- 172.21.15.144:0/3559877806 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f833806c2d0 0x7f83380c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:03.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.525+0000 7f8336800640 1 -- 172.21.15.144:0/3559877806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f833806d8c0 msgr2=0x7f8338150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:03.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.525+0000 7f8336800640 1 --2- 172.21.15.144:0/3559877806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f833806d8c0 0x7f8338150690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:03.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.525+0000 7f8336800640 1 -- 172.21.15.144:0/3559877806 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83380ca5e0 con 0x7f83380b3430 2024-09-11T23:23:03.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.525+0000 7f8336800640 1 --2- 172.21.15.144:0/3559877806 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83380b3430 0x7f83380cd330 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f833000c730 tx=0x7f833000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:03.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.525+0000 7f832e000640 1 -- 172.21.15.144:0/3559877806 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8330003b70 con 0x7f83380b3430 2024-09-11T23:23:03.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.525+0000 7f832e000640 1 -- 172.21.15.144:0/3559877806 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8330003d30 con 0x7f83380b3430 2024-09-11T23:23:03.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.525+0000 7f833d000640 1 -- 172.21.15.144:0/3559877806 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83380ca8c0 con 0x7f83380b3430 2024-09-11T23:23:03.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.525+0000 7f832e000640 1 -- 172.21.15.144:0/3559877806 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8330005310 con 0x7f83380b3430 2024-09-11T23:23:03.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.525+0000 7f833d000640 1 -- 172.21.15.144:0/3559877806 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83380cae80 con 0x7f83380b3430 2024-09-11T23:23:03.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.526+0000 7f833d000640 1 -- 172.21.15.144:0/3559877806 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83380b3810 con 0x7f83380b3430 2024-09-11T23:23:03.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.527+0000 7f832e000640 1 -- 172.21.15.144:0/3559877806 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f83300056c0 con 0x7f83380b3430 2024-09-11T23:23:03.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.528+0000 7f832e000640 1 --2- 172.21.15.144:0/3559877806 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f831806bf50 0x7f831806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:03.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.528+0000 7f832e000640 1 -- 172.21.15.144:0/3559877806 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5029+0+0 (secure 0 0 0) 0x7f833008ad90 con 0x7f83380b3430 2024-09-11T23:23:03.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.529+0000 7f8335e00640 1 --2- 172.21.15.144:0/3559877806 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f831806bf50 0x7f831806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:03.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.529+0000 7f8335e00640 1 --2- 172.21.15.144:0/3559877806 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f831806bf50 0x7f831806e410 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8328034000 tx=0x7f832802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:03.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.533+0000 7f832e000640 1 -- 172.21.15.144:0/3559877806 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f83300591e0 con 0x7f83380b3430 2024-09-11T23:23:03.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.706+0000 7f833d000640 1 -- 172.21.15.144:0/3559877806 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f83380b4660 con 0x7f83380b3430 2024-09-11T23:23:03.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.710+0000 7f832e000640 1 -- 172.21.15.144:0/3559877806 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f833005d4e0 con 0x7f83380b3430 2024-09-11T23:23:03.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.712+0000 7f833d000640 1 -- 172.21.15.144:0/3559877806 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f831806bf50 msgr2=0x7f831806e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:03.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.712+0000 7f833d000640 1 --2- 172.21.15.144:0/3559877806 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f831806bf50 0x7f831806e410 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8328034000 tx=0x7f832802e000 comp rx=0 tx=0).stop 2024-09-11T23:23:03.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.713+0000 7f833d000640 1 -- 172.21.15.144:0/3559877806 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83380b3430 msgr2=0x7f83380cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:03.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.713+0000 7f833d000640 1 --2- 172.21.15.144:0/3559877806 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83380b3430 0x7f83380cd330 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f833000c730 tx=0x7f833000cbf0 comp rx=0 tx=0).stop 2024-09-11T23:23:03.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.713+0000 7f833d000640 1 -- 172.21.15.144:0/3559877806 shutdown_connections 2024-09-11T23:23:03.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.713+0000 7f833d000640 1 --2- 172.21.15.144:0/3559877806 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f831806bf50 0x7f831806e410 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:03.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.713+0000 7f833d000640 1 --2- 172.21.15.144:0/3559877806 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83380b3430 0x7f83380cd330 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:03.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.713+0000 7f833d000640 1 --2- 172.21.15.144:0/3559877806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f833806d8c0 0x7f8338150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:03.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.713+0000 7f833d000640 1 --2- 172.21.15.144:0/3559877806 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f833806c2d0 0x7f83380c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:03.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.713+0000 7f833d000640 1 -- 172.21.15.144:0/3559877806 >> 172.21.15.144:0/3559877806 conn(0x7f83380d4b10 msgr2=0x7f83380b9770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:03.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.713+0000 7f833d000640 1 -- 172.21.15.144:0/3559877806 shutdown_connections 2024-09-11T23:23:03.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:03.713+0000 7f833d000640 1 -- 172.21.15.144:0/3559877806 wait complete. 2024-09-11T23:23:03.729 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:23:03.730 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:23:03.825 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:23:03.914 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:23:03.915 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:23:03.915 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:03.950 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:23:03.951 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:23:03.951 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:03.987 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:23:03.987 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:23:03.987 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:04.026 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:23:04.027 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:23:04.027 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:04.062 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:23:04.063 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T23:23:04.063 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:23:04.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.218+0000 7fdde2000640 1 Processor -- start 2024-09-11T23:23:04.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.219+0000 7fdde2000640 1 -- start start 2024-09-11T23:23:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.220+0000 7fdde2000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdddc0d0a50 0x7fdddc1620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.220+0000 7fdde2000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdddc0b4930 0x7fdddc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.220+0000 7fdde2000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdddc1625f0 con 0x7fdddc15f620 2024-09-11T23:23:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.220+0000 7fdde2000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fdddc0b52d0 con 0x7fdddc0b4930 2024-09-11T23:23:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.220+0000 7fdde2000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdddc162870 con 0x7fdddc0d0a50 2024-09-11T23:23:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.220+0000 7fdddaa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdddc0b4930 0x7fdddc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.220+0000 7fdddaa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdddc0b4930 0x7fdddc0b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59946/0 (socket says 172.21.15.144:59946) 2024-09-11T23:23:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.220+0000 7fdddaa00640 1 -- 172.21.15.144:0/2639258389 learned_addr learned my addr 172.21.15.144:0/2639258389 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.220+0000 7fdddbe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdddc15f620 0x7fdddc15fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47370/0 (socket says 172.21.15.144:47370) 2024-09-11T23:23:04.221 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.220+0000 7fdddb400640 1 --2- 172.21.15.144:0/2639258389 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdddc0d0a50 0x7fdddc1620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:04.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.220+0000 7fdddaa00640 1 -- 172.21.15.144:0/2639258389 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdddc0d0a50 msgr2=0x7fdddc1620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:04.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.220+0000 7fdddaa00640 1 --2- 172.21.15.144:0/2639258389 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdddc0d0a50 0x7fdddc1620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:04.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.220+0000 7fdddaa00640 1 -- 172.21.15.144:0/2639258389 >> v1:172.21.15.144:6789/0 conn(0x7fdddc15f620 legacy=0x7fdddc15fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:04.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.220+0000 7fddda000640 1 -- 172.21.15.144:0/2639258389 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1684399260 0 0) 0x7fddd4001490 con 0x7fdddc15f620 2024-09-11T23:23:04.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.221+0000 7fdddaa00640 1 -- 172.21.15.144:0/2639258389 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdddc162b50 con 0x7fdddc0b4930 2024-09-11T23:23:04.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.221+0000 7fdddaa00640 1 --2- 172.21.15.144:0/2639258389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdddc0b4930 0x7fdddc0b4d90 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009870 tx=0x7fddc802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cb3b1181fb6bba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:04.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.222+0000 7fddda000640 1 -- 172.21.15.144:0/2639258389 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8037070 con 0x7fdddc0b4930 2024-09-11T23:23:04.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.222+0000 7fddda000640 1 -- 172.21.15.144:0/2639258389 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc8032440 con 0x7fdddc0b4930 2024-09-11T23:23:04.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.222+0000 7fddda000640 1 -- 172.21.15.144:0/2639258389 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8032810 con 0x7fdddc0b4930 2024-09-11T23:23:04.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.222+0000 7fdde2000640 1 -- 172.21.15.144:0/2639258389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdddc0b4930 msgr2=0x7fdddc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:04.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.222+0000 7fdde2000640 1 --2- 172.21.15.144:0/2639258389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdddc0b4930 0x7fdddc0b4d90 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009870 tx=0x7fddc802a1c0 comp rx=0 tx=0).stop 2024-09-11T23:23:04.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.222+0000 7fdde2000640 1 -- 172.21.15.144:0/2639258389 shutdown_connections 2024-09-11T23:23:04.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.222+0000 7fdde2000640 1 --2- 172.21.15.144:0/2639258389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdddc0b4930 0x7fdddc0b4d90 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:04.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.222+0000 7fdde2000640 1 --2- 172.21.15.144:0/2639258389 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdddc0d0a50 0x7fdddc1620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:04.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.222+0000 7fdde2000640 1 -- 172.21.15.144:0/2639258389 >> 172.21.15.144:0/2639258389 conn(0x7fdddc062cc0 msgr2=0x7fdddc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:04.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.222+0000 7fdde2000640 1 -- 172.21.15.144:0/2639258389 shutdown_connections 2024-09-11T23:23:04.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.223+0000 7fdde2000640 1 -- 172.21.15.144:0/2639258389 wait complete. 2024-09-11T23:23:04.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.224+0000 7fdde2000640 1 Processor -- start 2024-09-11T23:23:04.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.224+0000 7fdde2000640 1 -- start start 2024-09-11T23:23:04.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.225+0000 7fdde2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdddc0b4930 0x7fdddc14bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:04.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.225+0000 7fdde2000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdddc15f620 0x7fdddc1570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:04.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.225+0000 7fdde2000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdddc157c00 0x7fdddc073890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:04.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.225+0000 7fdde2000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdddc0b3620 con 0x7fdddc0b4930 2024-09-11T23:23:04.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.225+0000 7fdde2000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdddc0b3340 con 0x7fdddc157c00 2024-09-11T23:23:04.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.225+0000 7fdde2000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdddc0b3b40 con 0x7fdddc15f620 2024-09-11T23:23:04.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.225+0000 7fdddb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdddc0b4930 0x7fdddc14bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:04.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.225+0000 7fdddb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdddc0b4930 0x7fdddc14bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59948/0 (socket says 172.21.15.144:59948) 2024-09-11T23:23:04.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.225+0000 7fdddb400640 1 -- 172.21.15.144:0/186942939 learned_addr learned my addr 172.21.15.144:0/186942939 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:04.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.225+0000 7fdddaa00640 1 --2- 172.21.15.144:0/186942939 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdddc15f620 0x7fdddc1570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:04.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.225+0000 7fdddbe00640 1 --2- 172.21.15.144:0/186942939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdddc157c00 0x7fdddc073890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:04.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.226+0000 7fdddb400640 1 -- 172.21.15.144:0/186942939 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdddc15f620 msgr2=0x7fdddc1570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:04.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.226+0000 7fdddb400640 1 --2- 172.21.15.144:0/186942939 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdddc15f620 0x7fdddc1570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:04.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.226+0000 7fdddb400640 1 -- 172.21.15.144:0/186942939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdddc157c00 msgr2=0x7fdddc073890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:04.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.226+0000 7fdddb400640 1 --2- 172.21.15.144:0/186942939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdddc157c00 0x7fdddc073890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:04.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.226+0000 7fdddb400640 1 -- 172.21.15.144:0/186942939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdddc072550 con 0x7fdddc0b4930 2024-09-11T23:23:04.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.226+0000 7fdddb400640 1 --2- 172.21.15.144:0/186942939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdddc0b4930 0x7fdddc14bca0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00e930 tx=0x7fddcc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:04.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.226+0000 7fddd3400640 1 -- 172.21.15.144:0/186942939 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc017070 con 0x7fdddc0b4930 2024-09-11T23:23:04.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.226+0000 7fddd3400640 1 -- 172.21.15.144:0/186942939 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddcc00ca00 con 0x7fdddc0b4930 2024-09-11T23:23:04.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.226+0000 7fddd3400640 1 -- 172.21.15.144:0/186942939 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc00cdf0 con 0x7fdddc0b4930 2024-09-11T23:23:04.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.226+0000 7fdde2000640 1 -- 172.21.15.144:0/186942939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdddc14c1e0 con 0x7fdddc0b4930 2024-09-11T23:23:04.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.226+0000 7fdde2000640 1 -- 172.21.15.144:0/186942939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdddc072ad0 con 0x7fdddc0b4930 2024-09-11T23:23:04.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.227+0000 7fdde2000640 1 -- 172.21.15.144:0/186942939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdddc0b4d90 con 0x7fdddc0b4930 2024-09-11T23:23:04.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.228+0000 7fddd3400640 1 -- 172.21.15.144:0/186942939 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fddcc01a070 con 0x7fdddc0b4930 2024-09-11T23:23:04.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.229+0000 7fddd3400640 1 --2- 172.21.15.144:0/186942939 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fddbc06bf50 0x7fddbc06e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:04.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.229+0000 7fddd3400640 1 -- 172.21.15.144:0/186942939 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5029+0+0 (secure 0 0 0) 0x7fddcc08ad90 con 0x7fdddc0b4930 2024-09-11T23:23:04.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.229+0000 7fdddaa00640 1 --2- 172.21.15.144:0/186942939 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fddbc06bf50 0x7fddbc06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:04.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.230+0000 7fdddaa00640 1 --2- 172.21.15.144:0/186942939 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fddbc06bf50 0x7fddbc06e410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fddc8034000 tx=0x7fddc802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:04.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.233+0000 7fddd3400640 1 -- 172.21.15.144:0/186942939 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fddcc0592a0 con 0x7fdddc0b4930 2024-09-11T23:23:04.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.440+0000 7fdde2000640 1 -- 172.21.15.144:0/186942939 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdddc1607a0 con 0x7fdddc0b4930 2024-09-11T23:23:04.441 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.440+0000 7fddd3400640 1 -- 172.21.15.144:0/186942939 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+3920 (secure 0 0 0) 0x7fddcc05d5a0 con 0x7fdddc0b4930 2024-09-11T23:23:04.442 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:04.442 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":64,"btime":"2024-09-11T23:22:58:312389+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5729,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/1166956695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":1166956695},{"type":"v1","addr":"172.21.15.165:6834","nonce":1166956695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6834/1078454545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1078454545},{"type":"v1","addr":"172.21.15.144:6834","nonce":1078454545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6421,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/214118062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":214118062},{"type":"v1","addr":"172.21.15.165:6835","nonce":214118062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6807,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2962664312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6801","nonce":2962664312},{"type":"v1","addr":"172.21.15.144:6835","nonce":2962664312}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[]} 2024-09-11T23:23:04.442 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 64 2024-09-11T23:23:04.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.443+0000 7fdde2000640 1 -- 172.21.15.144:0/186942939 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fddbc06bf50 msgr2=0x7fddbc06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:04.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.443+0000 7fdde2000640 1 --2- 172.21.15.144:0/186942939 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fddbc06bf50 0x7fddbc06e410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fddc8034000 tx=0x7fddc802e000 comp rx=0 tx=0).stop 2024-09-11T23:23:04.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.443+0000 7fdde2000640 1 -- 172.21.15.144:0/186942939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdddc0b4930 msgr2=0x7fdddc14bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:04.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.443+0000 7fdde2000640 1 --2- 172.21.15.144:0/186942939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdddc0b4930 0x7fdddc14bca0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00e930 tx=0x7fddcc00edf0 comp rx=0 tx=0).stop 2024-09-11T23:23:04.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.443+0000 7fdde2000640 1 -- 172.21.15.144:0/186942939 shutdown_connections 2024-09-11T23:23:04.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.443+0000 7fdde2000640 1 --2- 172.21.15.144:0/186942939 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fddbc06bf50 0x7fddbc06e410 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:04.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.443+0000 7fdde2000640 1 --2- 172.21.15.144:0/186942939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdddc157c00 0x7fdddc073890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:04.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.443+0000 7fdde2000640 1 --2- 172.21.15.144:0/186942939 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdddc15f620 0x7fdddc1570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:04.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.443+0000 7fdde2000640 1 --2- 172.21.15.144:0/186942939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdddc0b4930 0x7fdddc14bca0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:04.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.443+0000 7fdde2000640 1 -- 172.21.15.144:0/186942939 >> 172.21.15.144:0/186942939 conn(0x7fdddc062cc0 msgr2=0x7fdddc160cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:04.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.443+0000 7fdde2000640 1 -- 172.21.15.144:0/186942939 shutdown_connections 2024-09-11T23:23:04.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.443+0000 7fdde2000640 1 -- 172.21.15.144:0/186942939 wait complete. 2024-09-11T23:23:04.460 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:23:04.460 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:23:04.460 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:23:04.461 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:23:04.461 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:23:04.461 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T23:23:04.461 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:23:04.461 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:23:04.461 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:23:04.461 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:23:04.461 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:23:04.462 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:23:04.462 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:23:04.462 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T23:23:04.462 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:23:04.462 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:23:04.475 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:23:04.475 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:23:04.476 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:23:04.476 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:23:04.477 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:23:04.477 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:23:04.478 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:23:04.478 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:23:04.520 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:23:04.520 DEBUG:teuthology.parallel:result is None 2024-09-11T23:23:04.522 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:23:04.522 DEBUG:teuthology.parallel:result is None 2024-09-11T23:23:04.524 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:23:04.524 DEBUG:teuthology.parallel:result is None 2024-09-11T23:23:04.526 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:23:04.526 DEBUG:teuthology.parallel:result is None 2024-09-11T23:23:04.526 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:23:04.651 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-11T23:23:04.653 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-11T23:23:04.654 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-11T23:23:04.656 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-11T23:23:04.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.686+0000 7fb220a00640 1 Processor -- start 2024-09-11T23:23:04.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.686+0000 7fb220a00640 1 -- start start 2024-09-11T23:23:04.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.687+0000 7fb220a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb21c0d02a0 0x7fb21c0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:04.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.687+0000 7fb220a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb21c0d0bc0 con 0x7fb21c15ce80 2024-09-11T23:23:04.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.687+0000 7fb220a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb21c15d390 con 0x7fb21c15ca40 2024-09-11T23:23:04.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.687+0000 7fb220a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb21c15d670 con 0x7fb21c0d02a0 2024-09-11T23:23:04.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.688+0000 7fb21a800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb21c15ce80 0x7fb21c1594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56538/0 (socket says 172.21.15.144:56538) 2024-09-11T23:23:04.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.688+0000 7fb21a800640 1 -- 172.21.15.144:0/2037480658 learned_addr learned my addr 172.21.15.144:0/2037480658 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:04.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.688+0000 7fb219e00640 1 --2- 172.21.15.144:0/2037480658 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb21c0d02a0 0x7fb21c0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:04.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.688+0000 7fb218a00640 1 -- 172.21.15.144:0/2037480658 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1715416531 0 0) 0x7fb21c0d0bc0 con 0x7fb21c15ce80 2024-09-11T23:23:04.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.688+0000 7fb218a00640 1 -- 172.21.15.144:0/2037480658 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb200003520 con 0x7fb21c15ce80 2024-09-11T23:23:04.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.688+0000 7fb219e00640 1 -- 172.21.15.144:0/2037480658 >> v1:172.21.15.165:6789/0 conn(0x7fb21c15ca40 legacy=0x7fb21c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:04.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.688+0000 7fb218a00640 1 -- 172.21.15.144:0/2037480658 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3284337792 0 0) 0x7fb21c15d390 con 0x7fb21c15ca40 2024-09-11T23:23:04.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.689+0000 7fb219e00640 1 -- 172.21.15.144:0/2037480658 >> v1:172.21.15.144:6789/0 conn(0x7fb21c15ce80 legacy=0x7fb21c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:04.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.689+0000 7fb219e00640 1 -- 172.21.15.144:0/2037480658 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21c15d950 con 0x7fb21c0d02a0 2024-09-11T23:23:04.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.690+0000 7fb219e00640 1 --2- 172.21.15.144:0/2037480658 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb21c0d02a0 0x7fb21c0d0680 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009dc0 tx=0x7fb20c02a5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d171aac6b5425834 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:04.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.690+0000 7fb218a00640 1 -- 172.21.15.144:0/2037480658 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c035020 con 0x7fb21c0d02a0 2024-09-11T23:23:04.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.690+0000 7fb218a00640 1 -- 172.21.15.144:0/2037480658 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb20c007540 con 0x7fb21c0d02a0 2024-09-11T23:23:04.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.690+0000 7fb218a00640 1 -- 172.21.15.144:0/2037480658 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb214001670 con 0x7fb21c0d02a0 2024-09-11T23:23:04.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.690+0000 7fb220a00640 1 -- 172.21.15.144:0/2037480658 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb21c0d02a0 msgr2=0x7fb21c0d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:04.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.690+0000 7fb220a00640 1 --2- 172.21.15.144:0/2037480658 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb21c0d02a0 0x7fb21c0d0680 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009dc0 tx=0x7fb20c02a5b0 comp rx=0 tx=0).stop 2024-09-11T23:23:04.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.690+0000 7fb220a00640 1 -- 172.21.15.144:0/2037480658 shutdown_connections 2024-09-11T23:23:04.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.690+0000 7fb220a00640 1 --2- 172.21.15.144:0/2037480658 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb21c0d02a0 0x7fb21c0d0680 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:04.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.690+0000 7fb220a00640 1 -- 172.21.15.144:0/2037480658 >> 172.21.15.144:0/2037480658 conn(0x7fb21c062cc0 msgr2=0x7fb21c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:04.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.691+0000 7fb220a00640 1 -- 172.21.15.144:0/2037480658 shutdown_connections 2024-09-11T23:23:04.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.691+0000 7fb220a00640 1 -- 172.21.15.144:0/2037480658 wait complete. 2024-09-11T23:23:04.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.692+0000 7fb220a00640 1 Processor -- start 2024-09-11T23:23:04.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.692+0000 7fb220a00640 1 -- start start 2024-09-11T23:23:04.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.693+0000 7fb220a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb21c0d02a0 0x7fb21c151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:04.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.693+0000 7fb220a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb21c15ca40 0x7fb21c0aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:04.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.693+0000 7fb220a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb21c15ce80 0x7fb21c0affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:04.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.693+0000 7fb220a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c15eb40 con 0x7fb21c15ca40 2024-09-11T23:23:04.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.693+0000 7fb220a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c15df10 con 0x7fb21c0d02a0 2024-09-11T23:23:04.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.693+0000 7fb220a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb21c155b90 con 0x7fb21c15ce80 2024-09-11T23:23:04.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.693+0000 7fb219400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb21c15ca40 0x7fb21c0aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:04.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.693+0000 7fb219400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb21c15ca40 0x7fb21c0aa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42942/0 (socket says 172.21.15.144:42942) 2024-09-11T23:23:04.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.693+0000 7fb219400640 1 -- 172.21.15.144:0/3962294280 learned_addr learned my addr 172.21.15.144:0/3962294280 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:04.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.693+0000 7fb21a800640 1 --2- 172.21.15.144:0/3962294280 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb21c15ce80 0x7fb21c0affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.693+0000 7fb219e00640 1 --2- 172.21.15.144:0/3962294280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb21c0d02a0 0x7fb21c151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.694+0000 7fb219400640 1 -- 172.21.15.144:0/3962294280 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb21c15ce80 msgr2=0x7fb21c0affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.694+0000 7fb219400640 1 --2- 172.21.15.144:0/3962294280 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb21c15ce80 0x7fb21c0affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.694+0000 7fb219400640 1 -- 172.21.15.144:0/3962294280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb21c0d02a0 msgr2=0x7fb21c151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.694+0000 7fb219400640 1 --2- 172.21.15.144:0/3962294280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb21c0d02a0 0x7fb21c151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.694+0000 7fb219400640 1 -- 172.21.15.144:0/3962294280 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21c15af60 con 0x7fb21c15ca40 2024-09-11T23:23:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.694+0000 7fb219e00640 1 --2- 172.21.15.144:0/3962294280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb21c0d02a0 0x7fb21c151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:23:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.694+0000 7fb219400640 1 --2- 172.21.15.144:0/3962294280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb21c15ca40 0x7fb21c0aa4d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb20800c550 tx=0x7fb20800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.694+0000 7fb212000640 1 -- 172.21.15.144:0/3962294280 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb208017070 con 0x7fb21c15ca40 2024-09-11T23:23:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.694+0000 7fb212000640 1 -- 172.21.15.144:0/3962294280 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2080035f0 con 0x7fb21c15ca40 2024-09-11T23:23:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.694+0000 7fb212000640 1 -- 172.21.15.144:0/3962294280 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2080039e0 con 0x7fb21c15ca40 2024-09-11T23:23:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.694+0000 7fb220a00640 1 -- 172.21.15.144:0/3962294280 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21c15b1d0 con 0x7fb21c15ca40 2024-09-11T23:23:04.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.694+0000 7fb220a00640 1 -- 172.21.15.144:0/3962294280 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb21c15b790 con 0x7fb21c15ca40 2024-09-11T23:23:04.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.695+0000 7fb220a00640 1 -- 172.21.15.144:0/3962294280 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb21c0b4790 con 0x7fb21c15ca40 2024-09-11T23:23:04.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.696+0000 7fb212000640 1 -- 172.21.15.144:0/3962294280 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fb20801a070 con 0x7fb21c15ca40 2024-09-11T23:23:04.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.698+0000 7fb212000640 1 --2- 172.21.15.144:0/3962294280 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb1fc070390 0x7fb1fc072850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:04.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.698+0000 7fb212000640 1 -- 172.21.15.144:0/3962294280 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5029+0+0 (secure 0 0 0) 0x7fb208089ff0 con 0x7fb21c15ca40 2024-09-11T23:23:04.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.698+0000 7fb219e00640 1 --2- 172.21.15.144:0/3962294280 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb1fc070390 0x7fb1fc072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:04.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.699+0000 7fb219e00640 1 --2- 172.21.15.144:0/3962294280 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb1fc070390 0x7fb1fc072850 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb20c033000 tx=0x7fb20c02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:04.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.702+0000 7fb212000640 1 -- 172.21.15.144:0/3962294280 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb2080584f0 con 0x7fb21c15ca40 2024-09-11T23:23:04.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:04.893+0000 7fb220a00640 1 -- 172.21.15.144:0/3962294280 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fb21c0b2af0 con 0x7fb21c15ca40 2024-09-11T23:23:05.355 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.354+0000 7fb212000640 1 -- 172.21.15.144:0/3962294280 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v95) ==== 97+0+0 (secure 0 0 0) 0x7fb20805c7f0 con 0x7fb21c15ca40 2024-09-11T23:23:05.355 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-11T23:23:05.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.357+0000 7fb220a00640 1 -- 172.21.15.144:0/3962294280 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb1fc070390 msgr2=0x7fb1fc072850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:05.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.357+0000 7fb220a00640 1 --2- 172.21.15.144:0/3962294280 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb1fc070390 0x7fb1fc072850 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb20c033000 tx=0x7fb20c02f000 comp rx=0 tx=0).stop 2024-09-11T23:23:05.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.357+0000 7fb220a00640 1 -- 172.21.15.144:0/3962294280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb21c15ca40 msgr2=0x7fb21c0aa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:05.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.357+0000 7fb220a00640 1 --2- 172.21.15.144:0/3962294280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb21c15ca40 0x7fb21c0aa4d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb20800c550 tx=0x7fb20800ca10 comp rx=0 tx=0).stop 2024-09-11T23:23:05.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.358+0000 7fb220a00640 1 -- 172.21.15.144:0/3962294280 shutdown_connections 2024-09-11T23:23:05.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.358+0000 7fb220a00640 1 --2- 172.21.15.144:0/3962294280 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb1fc070390 0x7fb1fc072850 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:05.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.358+0000 7fb220a00640 1 --2- 172.21.15.144:0/3962294280 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb21c15ce80 0x7fb21c0affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:05.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.358+0000 7fb220a00640 1 --2- 172.21.15.144:0/3962294280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb21c15ca40 0x7fb21c0aa4d0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:05.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.358+0000 7fb220a00640 1 --2- 172.21.15.144:0/3962294280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb21c0d02a0 0x7fb21c151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:05.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.358+0000 7fb220a00640 1 -- 172.21.15.144:0/3962294280 >> 172.21.15.144:0/3962294280 conn(0x7fb21c062cc0 msgr2=0x7fb21c15e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:05.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.358+0000 7fb220a00640 1 -- 172.21.15.144:0/3962294280 shutdown_connections 2024-09-11T23:23:05.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.358+0000 7fb220a00640 1 -- 172.21.15.144:0/3962294280 wait complete. 2024-09-11T23:23:05.377 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:23:05.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.531+0000 7f571de00640 1 Processor -- start 2024-09-11T23:23:05.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.531+0000 7f571de00640 1 -- start start 2024-09-11T23:23:05.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.532+0000 7f571de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f571815a0a0 0x7f5718073180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:05.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.532+0000 7f571de00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f57180736c0 0x7f57180ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:05.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.532+0000 7f571de00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5718072100 con 0x7f57180ce9c0 2024-09-11T23:23:05.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.532+0000 7f571de00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f57180cee30 con 0x7f571815a0a0 2024-09-11T23:23:05.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.532+0000 7f571de00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f57180723c0 con 0x7f57180736c0 2024-09-11T23:23:05.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.532+0000 7f571ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f571815a0a0 0x7f5718073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:05.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.532+0000 7f571ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f571815a0a0 0x7f5718073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42956/0 (socket says 172.21.15.144:42956) 2024-09-11T23:23:05.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.532+0000 7f571ca00640 1 -- 172.21.15.144:0/2682706261 learned_addr learned my addr 172.21.15.144:0/2682706261 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:05.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.532+0000 7f5717e00640 1 --2- 172.21.15.144:0/2682706261 >> v2:172.21.15.165:3300/0 conn(0x7f57180736c0 0x7f57180ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:05.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.533+0000 7f571ca00640 1 -- 172.21.15.144:0/2682706261 >> v2:172.21.15.165:3300/0 conn(0x7f57180736c0 msgr2=0x7f57180ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:05.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.533+0000 7f571ca00640 1 --2- 172.21.15.144:0/2682706261 >> v2:172.21.15.165:3300/0 conn(0x7f57180736c0 0x7f57180ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:05.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.533+0000 7f571ca00640 1 -- 172.21.15.144:0/2682706261 >> v1:172.21.15.165:6789/0 conn(0x7f57180ce9c0 legacy=0x7f57180b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:05.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.533+0000 7f571ca00640 1 -- 172.21.15.144:0/2682706261 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57180726a0 con 0x7f571815a0a0 2024-09-11T23:23:05.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.533+0000 7f5717e00640 1 --2- 172.21.15.144:0/2682706261 >> v2:172.21.15.165:3300/0 conn(0x7f57180736c0 0x7f57180ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:23:05.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.534+0000 7f571ca00640 1 --2- 172.21.15.144:0/2682706261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f571815a0a0 0x7f5718073180 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f57180ccab0 tx=0x7f570c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68e5fec60412c6f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:05.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.534+0000 7f5717400640 1 -- 172.21.15.144:0/2682706261 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c037070 con 0x7f571815a0a0 2024-09-11T23:23:05.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.534+0000 7f5717400640 1 -- 172.21.15.144:0/2682706261 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f570c032440 con 0x7f571815a0a0 2024-09-11T23:23:05.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.534+0000 7f5717400640 1 -- 172.21.15.144:0/2682706261 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c032810 con 0x7f571815a0a0 2024-09-11T23:23:05.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.535+0000 7f571de00640 1 -- 172.21.15.144:0/2682706261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f571815a0a0 msgr2=0x7f5718073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:05.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.535+0000 7f571de00640 1 --2- 172.21.15.144:0/2682706261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f571815a0a0 0x7f5718073180 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f57180ccab0 tx=0x7f570c02a270 comp rx=0 tx=0).stop 2024-09-11T23:23:05.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.535+0000 7f571de00640 1 -- 172.21.15.144:0/2682706261 shutdown_connections 2024-09-11T23:23:05.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.535+0000 7f571de00640 1 --2- 172.21.15.144:0/2682706261 >> v2:172.21.15.165:3300/0 conn(0x7f57180736c0 0x7f57180ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:05.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.535+0000 7f571de00640 1 --2- 172.21.15.144:0/2682706261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f571815a0a0 0x7f5718073180 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:05.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.535+0000 7f571de00640 1 -- 172.21.15.144:0/2682706261 >> 172.21.15.144:0/2682706261 conn(0x7f571806e910 msgr2=0x7f571806bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:05.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.535+0000 7f571de00640 1 -- 172.21.15.144:0/2682706261 shutdown_connections 2024-09-11T23:23:05.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.535+0000 7f571de00640 1 -- 172.21.15.144:0/2682706261 wait complete. 2024-09-11T23:23:05.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.536+0000 7f571de00640 1 Processor -- start 2024-09-11T23:23:05.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.536+0000 7f571de00640 1 -- start start 2024-09-11T23:23:05.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.537+0000 7f571de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57180ce9c0 0x7f571815cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:05.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.537+0000 7f571de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f571815a0a0 0x7f57180cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:05.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.537+0000 7f571de00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5718158fc0 0x7f57180cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:05.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.537+0000 7f571de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f57180b2650 con 0x7f571815a0a0 2024-09-11T23:23:05.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.537+0000 7f571de00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f57180b24d0 con 0x7f5718158fc0 2024-09-11T23:23:05.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.537+0000 7f571de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f57180cf240 con 0x7f57180ce9c0 2024-09-11T23:23:05.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.538+0000 7f5717e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f571815a0a0 0x7f57180cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:05.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.538+0000 7f5717e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f571815a0a0 0x7f57180cb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42970/0 (socket says 172.21.15.144:42970) 2024-09-11T23:23:05.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.538+0000 7f5717e00640 1 -- 172.21.15.144:0/3156352678 learned_addr learned my addr 172.21.15.144:0/3156352678 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:05.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.538+0000 7f571d400640 1 --2- 172.21.15.144:0/3156352678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5718158fc0 0x7f57180cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:05.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.538+0000 7f571ca00640 1 --2- 172.21.15.144:0/3156352678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57180ce9c0 0x7f571815cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:05.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.538+0000 7f5717e00640 1 -- 172.21.15.144:0/3156352678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57180ce9c0 msgr2=0x7f571815cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:05.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.538+0000 7f5717e00640 1 --2- 172.21.15.144:0/3156352678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57180ce9c0 0x7f571815cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:05.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.538+0000 7f5717e00640 1 -- 172.21.15.144:0/3156352678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5718158fc0 msgr2=0x7f57180cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:05.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.538+0000 7f5717e00640 1 --2- 172.21.15.144:0/3156352678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5718158fc0 0x7f57180cbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:05.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.538+0000 7f5717e00640 1 -- 172.21.15.144:0/3156352678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571815d880 con 0x7f571815a0a0 2024-09-11T23:23:05.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.538+0000 7f5717e00640 1 --2- 172.21.15.144:0/3156352678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f571815a0a0 0x7f57180cb990 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f570400e7e0 tx=0x7f570400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:05.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.538+0000 7f5714c00640 1 -- 172.21.15.144:0/3156352678 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570400f040 con 0x7f571815a0a0 2024-09-11T23:23:05.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.538+0000 7f5714c00640 1 -- 172.21.15.144:0/3156352678 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5704004030 con 0x7f571815a0a0 2024-09-11T23:23:05.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.538+0000 7f5714c00640 1 -- 172.21.15.144:0/3156352678 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5704004400 con 0x7f571815a0a0 2024-09-11T23:23:05.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.539+0000 7f571de00640 1 -- 172.21.15.144:0/3156352678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571815db60 con 0x7f571815a0a0 2024-09-11T23:23:05.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.539+0000 7f571de00640 1 -- 172.21.15.144:0/3156352678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f571814be00 con 0x7f571815a0a0 2024-09-11T23:23:05.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.540+0000 7f571de00640 1 -- 172.21.15.144:0/3156352678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57180ce480 con 0x7f571815a0a0 2024-09-11T23:23:05.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.541+0000 7f5714c00640 1 -- 172.21.15.144:0/3156352678 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f570400c6d0 con 0x7f571815a0a0 2024-09-11T23:23:05.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.541+0000 7f5714c00640 1 --2- 172.21.15.144:0/3156352678 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f56f806bf50 0x7f56f806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:05.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.541+0000 7f5714c00640 1 -- 172.21.15.144:0/3156352678 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 4857+0+0 (secure 0 0 0) 0x7f570408abb0 con 0x7f571815a0a0 2024-09-11T23:23:05.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.542+0000 7f571ca00640 1 --2- 172.21.15.144:0/3156352678 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f56f806bf50 0x7f56f806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:05.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.543+0000 7f571ca00640 1 --2- 172.21.15.144:0/3156352678 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f56f806bf50 0x7f56f806e410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f570c034000 tx=0x7f570c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:05.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.546+0000 7f5714c00640 1 -- 172.21.15.144:0/3156352678 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5704017020 con 0x7f571815a0a0 2024-09-11T23:23:05.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.785+0000 7f571de00640 1 -- 172.21.15.144:0/3156352678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f57180cf020 con 0x7f571815a0a0 2024-09-11T23:23:05.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.785+0000 7f5714c00640 1 -- 172.21.15.144:0/3156352678 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7f5704058fa0 con 0x7f571815a0a0 2024-09-11T23:23:05.786 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:05.786 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:23:05.786 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-11T23:23:05.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:05.786 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-11T23:23:05.786 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmQjymBhAA4BWEVNGY37RsnMGLL3Ow8A==", 2024-09-11T23:23:05.787 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:23:05.787 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:23:05.787 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:23:05.787 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:23:05.787 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:23:05.787 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:05.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:05.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:05.787 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-11T23:23:05.787 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmD0mIGhAAvug7T/kOcEmnyMyG++V+zA==", 2024-09-11T23:23:05.787 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:23:05.787 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:23:05.787 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:23:05.787 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:23:05.788 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:23:05.788 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:05.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:05.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:05.788 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-11T23:23:05.788 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmDwSZEBAAdf4eF3MrADSPzBTICzpOiA==", 2024-09-11T23:23:05.788 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:23:05.788 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:23:05.788 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:23:05.788 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:23:05.788 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:23:05.788 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:05.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:05.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:05.789 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-11T23:23:05.789 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmqYtRJBAAgpzvHNUPVnxNoflhqVIJuQ==", 2024-09-11T23:23:05.789 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:23:05.789 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:23:05.789 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:23:05.789 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:23:05.789 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:23:05.789 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:05.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:05.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:05.789 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-11T23:23:05.789 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDiJOJmzDABABAA+Qa772+Mm69pecG0QUXlyA==", 2024-09-11T23:23:05.790 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:23:05.790 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:23:05.790 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:23:05.790 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:23:05.790 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:05.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:05.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:05.790 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-11T23:23:05.790 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDlJOJmgVjJKRAAtl30JxJHurKdrn1vLUneww==", 2024-09-11T23:23:05.790 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:23:05.790 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:23:05.790 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:23:05.790 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:23:05.790 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:05.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:05.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:05.791 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-11T23:23:05.791 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDpJOJmRzO6FxAAiLDOwDlXYTj6WfEhlI+uVQ==", 2024-09-11T23:23:05.791 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:23:05.791 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:23:05.791 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:23:05.791 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:23:05.791 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:05.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:05.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:05.791 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-11T23:23:05.791 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDtJOJmVFh6EhAA7hcJn4k31nEPMcqiB7+djA==", 2024-09-11T23:23:05.792 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:23:05.792 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:23:05.792 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:23:05.792 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:23:05.792 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:05.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:05.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:05.792 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-11T23:23:05.792 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD0JOJmpIFTAhAAYQyoBrMjL6CcDDCNAOMGwQ==", 2024-09-11T23:23:05.792 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:23:05.792 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:23:05.792 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:23:05.792 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:23:05.792 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:05.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:05.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:05.793 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-11T23:23:05.793 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD4JOJmBAIIDhAA8G/usUslfQPNpFP1YZsgmg==", 2024-09-11T23:23:05.793 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:23:05.793 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:23:05.793 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:23:05.793 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:23:05.793 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:05.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:05.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:05.793 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-11T23:23:05.793 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD8JOJmDl2dCBAA5bL+2AIp0uWL4qjpI/mAdQ==", 2024-09-11T23:23:05.793 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:23:05.794 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:23:05.794 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:23:05.794 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:23:05.794 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:05.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:05.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:05.794 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-11T23:23:05.794 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAAJeJmMWX+AhAA7ABVgJPwhRZNkPNdZzmnOQ==", 2024-09-11T23:23:05.794 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:23:05.794 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:23:05.794 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:23:05.795 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:23:05.795 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:05.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:05.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:05.795 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-11T23:23:05.795 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A==", 2024-09-11T23:23:05.795 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:23:05.795 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:23:05.795 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-11T23:23:05.795 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T23:23:05.795 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:05.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:05.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:05.796 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-11T23:23:05.796 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmLFrBORAAT64lj0sWlVoTHVUZQf0JjA==", 2024-09-11T23:23:05.796 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:23:05.796 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:23:05.796 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:23:05.796 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:23:05.796 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:23:05.796 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:05.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:05.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:05.796 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-11T23:23:05.796 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJm2/dLMxAAbuKdVAbscrlF5jcBnouBOQ==", 2024-09-11T23:23:05.796 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:23:05.797 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:23:05.797 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:23:05.797 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:23:05.797 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:23:05.797 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:05.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:05.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:05.797 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-11T23:23:05.797 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDfJOJmse6UBBAAq+3afsp+2jApe9sTFmVVOw==", 2024-09-11T23:23:05.797 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:23:05.797 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:23:05.798 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:23:05.798 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:23:05.798 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:23:05.798 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:05.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:05.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:05.798 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-11T23:23:05.798 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmHmAwEhAAEGCvu0NgtyjIPcJBk6bkdA==", 2024-09-11T23:23:05.798 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:23:05.798 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:23:05.798 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:23:05.798 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:23:05.798 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:23:05.798 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:05.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:05.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:05.799 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-11T23:23:05.799 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmxMaVOxAA62zJwlyk0qdrsemalijH4Q==", 2024-09-11T23:23:05.799 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:23:05.799 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:23:05.799 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:23:05.799 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:23:05.799 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:05.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:05.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:05.799 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-11T23:23:05.799 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmWZRNNBAAwZ2GCP7mGn87ZSnsKCcDRQ==", 2024-09-11T23:23:05.799 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:23:05.799 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:23:05.799 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:23:05.800 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:23:05.800 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:05.800 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:05.800 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:23:05.800 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:23:05.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.787+0000 7f571de00640 1 -- 172.21.15.144:0/3156352678 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f56f806bf50 msgr2=0x7f56f806e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:05.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.787+0000 7f571de00640 1 --2- 172.21.15.144:0/3156352678 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f56f806bf50 0x7f56f806e410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f570c034000 tx=0x7f570c02e000 comp rx=0 tx=0).stop 2024-09-11T23:23:05.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.787+0000 7f571de00640 1 -- 172.21.15.144:0/3156352678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f571815a0a0 msgr2=0x7f57180cb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:05.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.787+0000 7f571de00640 1 --2- 172.21.15.144:0/3156352678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f571815a0a0 0x7f57180cb990 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f570400e7e0 tx=0x7f570400eca0 comp rx=0 tx=0).stop 2024-09-11T23:23:05.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.787+0000 7f571de00640 1 -- 172.21.15.144:0/3156352678 shutdown_connections 2024-09-11T23:23:05.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.787+0000 7f571de00640 1 --2- 172.21.15.144:0/3156352678 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f56f806bf50 0x7f56f806e410 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:05.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.787+0000 7f571de00640 1 --2- 172.21.15.144:0/3156352678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5718158fc0 0x7f57180cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:05.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.787+0000 7f571de00640 1 --2- 172.21.15.144:0/3156352678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f571815a0a0 0x7f57180cb990 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:05.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.787+0000 7f571de00640 1 --2- 172.21.15.144:0/3156352678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57180ce9c0 0x7f571815cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:05.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.787+0000 7f571de00640 1 -- 172.21.15.144:0/3156352678 >> 172.21.15.144:0/3156352678 conn(0x7f571806e910 msgr2=0x7f571815a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:05.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.787+0000 7f571de00640 1 -- 172.21.15.144:0/3156352678 shutdown_connections 2024-09-11T23:23:05.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.787+0000 7f571de00640 1 -- 172.21.15.144:0/3156352678 wait complete. 2024-09-11T23:23:05.804 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:23:05.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.956+0000 7f24d1a00640 1 Processor -- start 2024-09-11T23:23:05.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.957+0000 7f24d1a00640 1 -- start start 2024-09-11T23:23:05.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.958+0000 7f24d1a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f24cc15c180 0x7f24cc0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:05.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.958+0000 7f24d1a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f24cc0ce230 0x7f24cc0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:05.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.958+0000 7f24d1a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24cc0ce740 con 0x7f24cc0cf5b0 2024-09-11T23:23:05.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.958+0000 7f24d1a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f24cc072640 con 0x7f24cc0ce230 2024-09-11T23:23:05.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.958+0000 7f24d1a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f24cc072920 con 0x7f24cc15c180 2024-09-11T23:23:05.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.958+0000 7f24ca000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f24cc0ce230 0x7f24cc0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:05.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.958+0000 7f24cb400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f24cc0cf5b0 0x7f24cc073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56542/0 (socket says 172.21.15.144:56542) 2024-09-11T23:23:05.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.958+0000 7f24cb400640 1 -- 172.21.15.144:0/367711622 learned_addr learned my addr 172.21.15.144:0/367711622 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:05.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.958+0000 7f24caa00640 1 --2- 172.21.15.144:0/367711622 >> v2:172.21.15.165:3300/0 conn(0x7f24cc15c180 0x7f24cc0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:05.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.958+0000 7f24ca000640 1 -- 172.21.15.144:0/367711622 >> v2:172.21.15.165:3300/0 conn(0x7f24cc15c180 msgr2=0x7f24cc0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:05.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.959+0000 7f24ca000640 1 --2- 172.21.15.144:0/367711622 >> v2:172.21.15.165:3300/0 conn(0x7f24cc15c180 0x7f24cc0cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:05.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.959+0000 7f24ca000640 1 -- 172.21.15.144:0/367711622 >> v1:172.21.15.144:6789/0 conn(0x7f24cc0cf5b0 legacy=0x7f24cc073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:05.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.959+0000 7f24ca000640 1 -- 172.21.15.144:0/367711622 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24cc072c00 con 0x7f24cc0ce230 2024-09-11T23:23:05.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.959+0000 7f24c9600640 1 -- 172.21.15.144:0/367711622 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2180679151 0 0) 0x7f24cc0ce740 con 0x7f24cc0cf5b0 2024-09-11T23:23:05.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.960+0000 7f24ca000640 1 --2- 172.21.15.144:0/367711622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24cc0ce230 0x7f24cc0cf070 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f24cc06cc10 tx=0x7f24b802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc1f3ae6dc31e2b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:05.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.960+0000 7f24c9600640 1 -- 172.21.15.144:0/367711622 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b8037070 con 0x7f24cc0ce230 2024-09-11T23:23:05.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.960+0000 7f24c9600640 1 -- 172.21.15.144:0/367711622 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b8032440 con 0x7f24cc0ce230 2024-09-11T23:23:05.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.960+0000 7f24c9600640 1 -- 172.21.15.144:0/367711622 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b802ae60 con 0x7f24cc0ce230 2024-09-11T23:23:05.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.960+0000 7f24d1a00640 1 -- 172.21.15.144:0/367711622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24cc0ce230 msgr2=0x7f24cc0cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:05.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.960+0000 7f24d1a00640 1 --2- 172.21.15.144:0/367711622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24cc0ce230 0x7f24cc0cf070 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f24cc06cc10 tx=0x7f24b802a110 comp rx=0 tx=0).stop 2024-09-11T23:23:05.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.960+0000 7f24d1a00640 1 -- 172.21.15.144:0/367711622 shutdown_connections 2024-09-11T23:23:05.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.960+0000 7f24d1a00640 1 --2- 172.21.15.144:0/367711622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24cc0ce230 0x7f24cc0cf070 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:05.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.960+0000 7f24d1a00640 1 --2- 172.21.15.144:0/367711622 >> v2:172.21.15.165:3300/0 conn(0x7f24cc15c180 0x7f24cc0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:05.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.960+0000 7f24d1a00640 1 -- 172.21.15.144:0/367711622 >> 172.21.15.144:0/367711622 conn(0x7f24cc062cc0 msgr2=0x7f24cc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:05.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.960+0000 7f24d1a00640 1 -- 172.21.15.144:0/367711622 shutdown_connections 2024-09-11T23:23:05.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.961+0000 7f24d1a00640 1 -- 172.21.15.144:0/367711622 wait complete. 2024-09-11T23:23:05.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.962+0000 7f24d1a00640 1 Processor -- start 2024-09-11T23:23:05.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.962+0000 7f24d1a00640 1 -- start start 2024-09-11T23:23:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.963+0000 7f24d1a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24cc0ce230 0x7f24cc1406a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.963+0000 7f24d1a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24cc0cf5b0 0x7f24cc0b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.963+0000 7f24d1a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24cc15c180 0x7f24cc156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.963+0000 7f24d1a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f24cc15c560 con 0x7f24cc0ce230 2024-09-11T23:23:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.963+0000 7f24d1a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f24cc0722f0 con 0x7f24cc0cf5b0 2024-09-11T23:23:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.963+0000 7f24d1a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f24cc15c6e0 con 0x7f24cc15c180 2024-09-11T23:23:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.963+0000 7f24caa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24cc0ce230 0x7f24cc1406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.963+0000 7f24caa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24cc0ce230 0x7f24cc1406a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42986/0 (socket says 172.21.15.144:42986) 2024-09-11T23:23:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.963+0000 7f24caa00640 1 -- 172.21.15.144:0/2849562654 learned_addr learned my addr 172.21.15.144:0/2849562654 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.964+0000 7f24cb400640 1 --2- 172.21.15.144:0/2849562654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24cc15c180 0x7f24cc156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.964+0000 7f24ca000640 1 --2- 172.21.15.144:0/2849562654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24cc0cf5b0 0x7f24cc0b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.964+0000 7f24caa00640 1 -- 172.21.15.144:0/2849562654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24cc15c180 msgr2=0x7f24cc156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.964+0000 7f24caa00640 1 --2- 172.21.15.144:0/2849562654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24cc15c180 0x7f24cc156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.964+0000 7f24caa00640 1 -- 172.21.15.144:0/2849562654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24cc0cf5b0 msgr2=0x7f24cc0b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.964+0000 7f24caa00640 1 --2- 172.21.15.144:0/2849562654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24cc0cf5b0 0x7f24cc0b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.964+0000 7f24caa00640 1 -- 172.21.15.144:0/2849562654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24cc0b1580 con 0x7f24cc0ce230 2024-09-11T23:23:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.964+0000 7f24cb400640 1 --2- 172.21.15.144:0/2849562654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24cc15c180 0x7f24cc156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:23:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.964+0000 7f24caa00640 1 --2- 172.21.15.144:0/2849562654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24cc0ce230 0x7f24cc1406a0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00e9e0 tx=0x7f24bc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.964+0000 7f24c2a00640 1 -- 172.21.15.144:0/2849562654 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc017070 con 0x7f24cc0ce230 2024-09-11T23:23:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.964+0000 7f24c2a00640 1 -- 172.21.15.144:0/2849562654 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24bc00c9d0 con 0x7f24cc0ce230 2024-09-11T23:23:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.964+0000 7f24c2a00640 1 -- 172.21.15.144:0/2849562654 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc00cdc0 con 0x7f24cc0ce230 2024-09-11T23:23:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.964+0000 7f24d1a00640 1 -- 172.21.15.144:0/2849562654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24cc0b1860 con 0x7f24cc0ce230 2024-09-11T23:23:05.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.965+0000 7f24d1a00640 1 -- 172.21.15.144:0/2849562654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24cc0b1e20 con 0x7f24cc0ce230 2024-09-11T23:23:05.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.966+0000 7f24d1a00640 1 -- 172.21.15.144:0/2849562654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24cc0cf070 con 0x7f24cc0ce230 2024-09-11T23:23:05.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.967+0000 7f24c2a00640 1 -- 172.21.15.144:0/2849562654 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f24bc01a070 con 0x7f24cc0ce230 2024-09-11T23:23:05.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.967+0000 7f24c2a00640 1 --2- 172.21.15.144:0/2849562654 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f24ac06bf80 0x7f24ac06e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:05.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.968+0000 7f24c2a00640 1 -- 172.21.15.144:0/2849562654 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 4857+0+0 (secure 0 0 0) 0x7f24bc08aec0 con 0x7f24cc0ce230 2024-09-11T23:23:05.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.968+0000 7f24ca000640 1 --2- 172.21.15.144:0/2849562654 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f24ac06bf80 0x7f24ac06e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.969+0000 7f24ca000640 1 --2- 172.21.15.144:0/2849562654 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f24ac06bf80 0x7f24ac06e440 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f24b8034000 tx=0x7f24b802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:05.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:05.972+0000 7f24c2a00640 1 -- 172.21.15.144:0/2849562654 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f24bc0594f0 con 0x7f24cc0ce230 2024-09-11T23:23:06.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.146+0000 7f24d1a00640 1 -- 172.21.15.144:0/2849562654 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f24cc0d0780 con 0x7f24cc0ce230 2024-09-11T23:23:06.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.147+0000 7f24c2a00640 1 -- 172.21.15.144:0/2849562654 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v97) ==== 84+0+65 (secure 0 0 0) 0x7f24bc05d7f0 con 0x7f24cc0ce230 2024-09-11T23:23:06.148 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:06.148 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:23:06.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:06.148 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-11T23:23:06.148 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-11T23:23:06.148 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:06.148 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:23:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.149+0000 7f24d1a00640 1 -- 172.21.15.144:0/2849562654 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f24ac06bf80 msgr2=0x7f24ac06e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.149+0000 7f24d1a00640 1 --2- 172.21.15.144:0/2849562654 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f24ac06bf80 0x7f24ac06e440 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f24b8034000 tx=0x7f24b802e000 comp rx=0 tx=0).stop 2024-09-11T23:23:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.149+0000 7f24d1a00640 1 -- 172.21.15.144:0/2849562654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24cc0ce230 msgr2=0x7f24cc1406a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.149+0000 7f24d1a00640 1 --2- 172.21.15.144:0/2849562654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24cc0ce230 0x7f24cc1406a0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00e9e0 tx=0x7f24bc00eea0 comp rx=0 tx=0).stop 2024-09-11T23:23:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.149+0000 7f24d1a00640 1 -- 172.21.15.144:0/2849562654 shutdown_connections 2024-09-11T23:23:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.149+0000 7f24d1a00640 1 --2- 172.21.15.144:0/2849562654 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f24ac06bf80 0x7f24ac06e440 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.149+0000 7f24d1a00640 1 --2- 172.21.15.144:0/2849562654 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f24cc15c180 0x7f24cc156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.149+0000 7f24d1a00640 1 --2- 172.21.15.144:0/2849562654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24cc0cf5b0 0x7f24cc0b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.149+0000 7f24d1a00640 1 --2- 172.21.15.144:0/2849562654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24cc0ce230 0x7f24cc1406a0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:06.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.149+0000 7f24d1a00640 1 -- 172.21.15.144:0/2849562654 >> 172.21.15.144:0/2849562654 conn(0x7f24cc062cc0 msgr2=0x7f24cc0736c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:06.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.149+0000 7f24d1a00640 1 -- 172.21.15.144:0/2849562654 shutdown_connections 2024-09-11T23:23:06.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.149+0000 7f24d1a00640 1 -- 172.21.15.144:0/2849562654 wait complete. 2024-09-11T23:23:06.166 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:23:06.166 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:23:06.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.322+0000 7fe741e00640 1 Processor -- start 2024-09-11T23:23:06.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.322+0000 7fe741e00640 1 -- start start 2024-09-11T23:23:06.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.323+0000 7fe741e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe73c147d70 0x7fe73c071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:06.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.324+0000 7fe741e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe73c0710e0 con 0x7fe73c148150 2024-09-11T23:23:06.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.324+0000 7fe741e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe73c0b5700 con 0x7fe73c072090 2024-09-11T23:23:06.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.324+0000 7fe741e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe73c071350 con 0x7fe73c147d70 2024-09-11T23:23:06.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.324+0000 7fe732000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe73c148150 0x7fe73c06d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56558/0 (socket says 172.21.15.144:56558) 2024-09-11T23:23:06.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.324+0000 7fe732000640 1 -- 172.21.15.144:0/98521200 learned_addr learned my addr 172.21.15.144:0/98521200 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:06.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.324+0000 7fe73a000640 1 -- 172.21.15.144:0/98521200 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3943172092 0 0) 0x7fe73c0710e0 con 0x7fe73c148150 2024-09-11T23:23:06.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.324+0000 7fe73aa00640 1 --2- 172.21.15.144:0/98521200 >> v2:172.21.15.165:3300/0 conn(0x7fe73c147d70 0x7fe73c071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:06.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.324+0000 7fe73a000640 1 -- 172.21.15.144:0/98521200 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe720003520 con 0x7fe73c148150 2024-09-11T23:23:06.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe73a000640 1 -- 172.21.15.144:0/98521200 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2538860735 0 0) 0x7fe720003520 con 0x7fe73c148150 2024-09-11T23:23:06.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe73a000640 1 -- 172.21.15.144:0/98521200 >> v2:172.21.15.165:3300/0 conn(0x7fe73c147d70 msgr2=0x7fe73c071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:06.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe73a000640 1 --2- 172.21.15.144:0/98521200 >> v2:172.21.15.165:3300/0 conn(0x7fe73c147d70 0x7fe73c071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:06.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe73a000640 1 -- 172.21.15.144:0/98521200 >> v1:172.21.15.165:6789/0 conn(0x7fe73c072090 legacy=0x7fe73c0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:06.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe73a000640 1 -- 172.21.15.144:0/98521200 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73c071630 con 0x7fe73c148150 2024-09-11T23:23:06.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe73a000640 1 -- 172.21.15.144:0/98521200 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fe724001670 con 0x7fe73c148150 2024-09-11T23:23:06.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe73a000640 1 -- 172.21.15.144:0/98521200 >> v1:172.21.15.144:6789/0 conn(0x7fe73c148150 legacy=0x7fe73c06d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:06.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe73a000640 1 --2- 172.21.15.144:0/98521200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe720003a00 0x7fe720003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:06.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe73a000640 1 --2- 172.21.15.144:0/98521200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe720004800 0x7fe720004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:06.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe73a000640 1 --2- 172.21.15.144:0/98521200 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe720005210 0x7fe72000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:06.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe73a000640 1 -- 172.21.15.144:0/98521200 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c071350 con 0x7fe720004800 2024-09-11T23:23:06.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe73a000640 1 -- 172.21.15.144:0/98521200 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe72000c160 con 0x7fe720003a00 2024-09-11T23:23:06.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe73a000640 1 -- 172.21.15.144:0/98521200 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe72000c360 con 0x7fe720005210 2024-09-11T23:23:06.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe732000640 1 --2- 172.21.15.144:0/98521200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe720004800 0x7fe720004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:06.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe73aa00640 1 --2- 172.21.15.144:0/98521200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe720003a00 0x7fe720003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:06.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe73b400640 1 --2- 172.21.15.144:0/98521200 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe720005210 0x7fe72000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:06.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe732000640 1 -- 172.21.15.144:0/98521200 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe720005210 msgr2=0x7fe72000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:06.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe732000640 1 --2- 172.21.15.144:0/98521200 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe720005210 0x7fe72000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:06.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe732000640 1 -- 172.21.15.144:0/98521200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe720003a00 msgr2=0x7fe720003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:06.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe732000640 1 --2- 172.21.15.144:0/98521200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe720003a00 0x7fe720003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:06.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe732000640 1 -- 172.21.15.144:0/98521200 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe720003520 con 0x7fe720004800 2024-09-11T23:23:06.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe73aa00640 1 --2- 172.21.15.144:0/98521200 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe720003a00 0x7fe720003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:23:06.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.325+0000 7fe73b400640 1 -- 172.21.15.144:0/98521200 reap_dead start 2024-09-11T23:23:06.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.326+0000 7fe732000640 1 --2- 172.21.15.144:0/98521200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe720004800 0x7fe720004c80 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fe73c148580 tx=0x7fe720005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd530b7eb920555 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:06.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.327+0000 7fe73a000640 1 -- 172.21.15.144:0/98521200 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe724007c40 con 0x7fe720004800 2024-09-11T23:23:06.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.327+0000 7fe73a000640 1 -- 172.21.15.144:0/98521200 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe724005af0 con 0x7fe720004800 2024-09-11T23:23:06.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.327+0000 7fe73a000640 1 -- 172.21.15.144:0/98521200 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe724007070 con 0x7fe720004800 2024-09-11T23:23:06.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.327+0000 7fe741e00640 1 -- 172.21.15.144:0/98521200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe720004800 msgr2=0x7fe720004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:06.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.327+0000 7fe741e00640 1 --2- 172.21.15.144:0/98521200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe720004800 0x7fe720004c80 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fe73c148580 tx=0x7fe720005830 comp rx=0 tx=0).stop 2024-09-11T23:23:06.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.327+0000 7fe741e00640 1 -- 172.21.15.144:0/98521200 shutdown_connections 2024-09-11T23:23:06.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.327+0000 7fe741e00640 1 --2- 172.21.15.144:0/98521200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe720004800 0x7fe720004c80 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:06.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.327+0000 7fe741e00640 1 -- 172.21.15.144:0/98521200 >> 172.21.15.144:0/98521200 conn(0x7fe73c06bba0 msgr2=0x7fe73c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:06.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.327+0000 7fe741e00640 1 -- 172.21.15.144:0/98521200 shutdown_connections 2024-09-11T23:23:06.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.327+0000 7fe741e00640 1 -- 172.21.15.144:0/98521200 wait complete. 2024-09-11T23:23:06.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.329+0000 7fe741e00640 1 Processor -- start 2024-09-11T23:23:06.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.329+0000 7fe741e00640 1 -- start start 2024-09-11T23:23:06.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.330+0000 7fe741e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe720004800 0x7fe73c160dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:06.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.330+0000 7fe741e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe73c146c90 0x7fe73c15b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:06.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.330+0000 7fe741e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73c15be40 0x7fe73c13ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:06.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.330+0000 7fe741e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c071cd0 con 0x7fe73c15be40 2024-09-11T23:23:06.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.330+0000 7fe741e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c071b50 con 0x7fe73c146c90 2024-09-11T23:23:06.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.330+0000 7fe741e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe73c071e50 con 0x7fe720004800 2024-09-11T23:23:06.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.330+0000 7fe73b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73c15be40 0x7fe73c13ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:06.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.330+0000 7fe73aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe720004800 0x7fe73c160dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:06.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.330+0000 7fe73b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73c15be40 0x7fe73c13ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43006/0 (socket says 172.21.15.144:43006) 2024-09-11T23:23:06.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.330+0000 7fe73b400640 1 -- 172.21.15.144:0/528650606 learned_addr learned my addr 172.21.15.144:0/528650606 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:06.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.330+0000 7fe732000640 1 --2- 172.21.15.144:0/528650606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe73c146c90 0x7fe73c15b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:06.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.331+0000 7fe73b400640 1 -- 172.21.15.144:0/528650606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe720004800 msgr2=0x7fe73c160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:06.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.331+0000 7fe73b400640 1 --2- 172.21.15.144:0/528650606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe720004800 0x7fe73c160dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:06.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.331+0000 7fe73b400640 1 -- 172.21.15.144:0/528650606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe73c146c90 msgr2=0x7fe73c15b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:06.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.331+0000 7fe73b400640 1 --2- 172.21.15.144:0/528650606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe73c146c90 0x7fe73c15b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:06.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.331+0000 7fe73b400640 1 -- 172.21.15.144:0/528650606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73c145150 con 0x7fe73c15be40 2024-09-11T23:23:06.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.331+0000 7fe73b400640 1 --2- 172.21.15.144:0/528650606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73c15be40 0x7fe73c13ce20 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe734007fd0 tx=0x7fe73400e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:06.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.331+0000 7fe733e00640 1 -- 172.21.15.144:0/528650606 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe734019070 con 0x7fe73c15be40 2024-09-11T23:23:06.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.331+0000 7fe733e00640 1 -- 172.21.15.144:0/528650606 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe734003b80 con 0x7fe73c15be40 2024-09-11T23:23:06.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.331+0000 7fe733e00640 1 -- 172.21.15.144:0/528650606 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7340050d0 con 0x7fe73c15be40 2024-09-11T23:23:06.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.331+0000 7fe741e00640 1 -- 172.21.15.144:0/528650606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe73c145430 con 0x7fe73c15be40 2024-09-11T23:23:06.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.331+0000 7fe741e00640 1 -- 172.21.15.144:0/528650606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe73c161300 con 0x7fe73c15be40 2024-09-11T23:23:06.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.332+0000 7fe741e00640 1 -- 172.21.15.144:0/528650606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe73c06d110 con 0x7fe73c15be40 2024-09-11T23:23:06.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.333+0000 7fe733e00640 1 -- 172.21.15.144:0/528650606 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fe73401c070 con 0x7fe73c15be40 2024-09-11T23:23:06.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.334+0000 7fe733e00640 1 --2- 172.21.15.144:0/528650606 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe71806bf80 0x7fe71806e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:06.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.334+0000 7fe733e00640 1 -- 172.21.15.144:0/528650606 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 4857+0+0 (secure 0 0 0) 0x7fe73408a1b0 con 0x7fe73c15be40 2024-09-11T23:23:06.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.335+0000 7fe73aa00640 1 --2- 172.21.15.144:0/528650606 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe71806bf80 0x7fe71806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:06.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.335+0000 7fe73aa00640 1 --2- 172.21.15.144:0/528650606 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe71806bf80 0x7fe71806e440 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0cc8d0 tx=0x7fe72c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:06.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.338+0000 7fe733e00640 1 -- 172.21.15.144:0/528650606 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe734058740 con 0x7fe73c15be40 2024-09-11T23:23:06.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:06.517+0000 7fe741e00640 1 -- 172.21.15.144:0/528650606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe73c0b0650 con 0x7fe73c15be40 2024-09-11T23:23:07.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.364+0000 7fe733e00640 1 -- 172.21.15.144:0/528650606 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v98) ==== 138+0+0 (secure 0 0 0) 0x7fe73405ca40 con 0x7fe73c15be40 2024-09-11T23:23:07.364 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-11T23:23:07.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.366+0000 7fe741e00640 1 -- 172.21.15.144:0/528650606 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe71806bf80 msgr2=0x7fe71806e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:07.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.366+0000 7fe741e00640 1 --2- 172.21.15.144:0/528650606 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe71806bf80 0x7fe71806e440 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0cc8d0 tx=0x7fe72c008040 comp rx=0 tx=0).stop 2024-09-11T23:23:07.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.366+0000 7fe741e00640 1 -- 172.21.15.144:0/528650606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73c15be40 msgr2=0x7fe73c13ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:07.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.366+0000 7fe741e00640 1 --2- 172.21.15.144:0/528650606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73c15be40 0x7fe73c13ce20 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe734007fd0 tx=0x7fe73400e960 comp rx=0 tx=0).stop 2024-09-11T23:23:07.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.366+0000 7fe741e00640 1 -- 172.21.15.144:0/528650606 shutdown_connections 2024-09-11T23:23:07.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.366+0000 7fe741e00640 1 --2- 172.21.15.144:0/528650606 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe71806bf80 0x7fe71806e440 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:07.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.366+0000 7fe741e00640 1 --2- 172.21.15.144:0/528650606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe73c15be40 0x7fe73c13ce20 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:07.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.366+0000 7fe741e00640 1 --2- 172.21.15.144:0/528650606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe73c146c90 0x7fe73c15b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:07.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.366+0000 7fe741e00640 1 --2- 172.21.15.144:0/528650606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe720004800 0x7fe73c160dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:07.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.366+0000 7fe741e00640 1 -- 172.21.15.144:0/528650606 >> 172.21.15.144:0/528650606 conn(0x7fe73c06bba0 msgr2=0x7fe73c0b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:07.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.366+0000 7fe741e00640 1 -- 172.21.15.144:0/528650606 shutdown_connections 2024-09-11T23:23:07.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.367+0000 7fe741e00640 1 -- 172.21.15.144:0/528650606 wait complete. 2024-09-11T23:23:07.390 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:23:07.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.550+0000 7f008ec00640 1 Processor -- start 2024-09-11T23:23:07.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.550+0000 7f008ec00640 1 -- start start 2024-09-11T23:23:07.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.551+0000 7f008ec00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0088147d70 0x7f0088071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:07.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.551+0000 7f008ec00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0088148150 0x7f008806d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:07.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.551+0000 7f008ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0088072090 0x7f008806d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:07.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.551+0000 7f008ec00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f00880710e0 con 0x7f0088147d70 2024-09-11T23:23:07.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.552+0000 7f008ec00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f00880b5700 con 0x7f0088148150 2024-09-11T23:23:07.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.552+0000 7f008ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0088071350 con 0x7f0088072090 2024-09-11T23:23:07.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.552+0000 7f0087e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0088147d70 0x7f0088071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:07.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.552+0000 7f0087e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0088147d70 0x7f0088071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43008/0 (socket says 172.21.15.144:43008) 2024-09-11T23:23:07.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.552+0000 7f0087e00640 1 -- 172.21.15.144:0/3621782132 learned_addr learned my addr 172.21.15.144:0/3621782132 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:07.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.552+0000 7f008cc00640 1 --2- 172.21.15.144:0/3621782132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0088072090 0x7f008806d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:07.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.552+0000 7f007f400640 1 --2- 172.21.15.144:0/3621782132 >> v2:172.21.15.165:3300/0 conn(0x7f0088148150 0x7f008806d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:07.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.552+0000 7f0087e00640 1 -- 172.21.15.144:0/3621782132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0088072090 msgr2=0x7f008806d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:07.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.552+0000 7f0087e00640 1 --2- 172.21.15.144:0/3621782132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0088072090 0x7f008806d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:07.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.552+0000 7f0087e00640 1 -- 172.21.15.144:0/3621782132 >> v2:172.21.15.165:3300/0 conn(0x7f0088148150 msgr2=0x7f008806d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:07.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.552+0000 7f0087e00640 1 --2- 172.21.15.144:0/3621782132 >> v2:172.21.15.165:3300/0 conn(0x7f0088148150 0x7f008806d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:07.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.552+0000 7f0087e00640 1 -- 172.21.15.144:0/3621782132 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0088071630 con 0x7f0088147d70 2024-09-11T23:23:07.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.553+0000 7f0087e00640 1 --2- 172.21.15.144:0/3621782132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0088147d70 0x7f0088071b50 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f00880b45b0 tx=0x7f007802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf248c2ef472c76 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.554+0000 7f0087400640 1 -- 172.21.15.144:0/3621782132 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0078037070 con 0x7f0088147d70 2024-09-11T23:23:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.554+0000 7f0087400640 1 -- 172.21.15.144:0/3621782132 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0078032440 con 0x7f0088147d70 2024-09-11T23:23:07.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.554+0000 7f0087400640 1 -- 172.21.15.144:0/3621782132 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0078032810 con 0x7f0088147d70 2024-09-11T23:23:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.554+0000 7f008ec00640 1 -- 172.21.15.144:0/3621782132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0088147d70 msgr2=0x7f0088071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.554+0000 7f008ec00640 1 --2- 172.21.15.144:0/3621782132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0088147d70 0x7f0088071b50 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f00880b45b0 tx=0x7f007802a140 comp rx=0 tx=0).stop 2024-09-11T23:23:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.554+0000 7f008ec00640 1 -- 172.21.15.144:0/3621782132 shutdown_connections 2024-09-11T23:23:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.554+0000 7f008ec00640 1 --2- 172.21.15.144:0/3621782132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0088072090 0x7f008806d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.554+0000 7f008ec00640 1 --2- 172.21.15.144:0/3621782132 >> v2:172.21.15.165:3300/0 conn(0x7f0088148150 0x7f008806d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.554+0000 7f008ec00640 1 --2- 172.21.15.144:0/3621782132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0088147d70 0x7f0088071b50 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.554+0000 7f008ec00640 1 -- 172.21.15.144:0/3621782132 >> 172.21.15.144:0/3621782132 conn(0x7f008806bba0 msgr2=0x7f008806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.554+0000 7f008ec00640 1 -- 172.21.15.144:0/3621782132 shutdown_connections 2024-09-11T23:23:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.554+0000 7f008ec00640 1 -- 172.21.15.144:0/3621782132 wait complete. 2024-09-11T23:23:07.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.556+0000 7f008ec00640 1 Processor -- start 2024-09-11T23:23:07.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.556+0000 7f008ec00640 1 -- start start 2024-09-11T23:23:07.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.557+0000 7f008ec00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0088072090 0x7f008813e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:07.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.557+0000 7f008ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0088147d70 0x7f00881f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:07.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.557+0000 7f008ec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0088148150 0x7f00880b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:07.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.557+0000 7f008ec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f00880aea60 con 0x7f0088148150 2024-09-11T23:23:07.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.557+0000 7f008ec00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f00880ae8e0 con 0x7f0088072090 2024-09-11T23:23:07.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.557+0000 7f008ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f00880aebe0 con 0x7f0088147d70 2024-09-11T23:23:07.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.557+0000 7f008cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0088148150 0x7f00880b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:07.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.557+0000 7f008cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0088148150 0x7f00880b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43014/0 (socket says 172.21.15.144:43014) 2024-09-11T23:23:07.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.557+0000 7f008cc00640 1 -- 172.21.15.144:0/984440480 learned_addr learned my addr 172.21.15.144:0/984440480 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:07.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.558+0000 7f007f400640 1 --2- 172.21.15.144:0/984440480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0088147d70 0x7f00881f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:07.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.558+0000 7f0087e00640 1 --2- 172.21.15.144:0/984440480 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0088072090 0x7f008813e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:07.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.558+0000 7f008cc00640 1 -- 172.21.15.144:0/984440480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0088147d70 msgr2=0x7f00881f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:07.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.558+0000 7f008cc00640 1 --2- 172.21.15.144:0/984440480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0088147d70 0x7f00881f4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:07.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.558+0000 7f008cc00640 1 -- 172.21.15.144:0/984440480 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0088072090 msgr2=0x7f008813e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:07.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.558+0000 7f008cc00640 1 --2- 172.21.15.144:0/984440480 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0088072090 0x7f008813e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:07.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.558+0000 7f008cc00640 1 -- 172.21.15.144:0/984440480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008813a210 con 0x7f0088148150 2024-09-11T23:23:07.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.558+0000 7f008cc00640 1 --2- 172.21.15.144:0/984440480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0088148150 0x7f00880b37e0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f008000eed0 tx=0x7f008000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:07.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.558+0000 7f0084c00640 1 -- 172.21.15.144:0/984440480 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0080018020 con 0x7f0088148150 2024-09-11T23:23:07.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.558+0000 7f0084c00640 1 -- 172.21.15.144:0/984440480 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f008000bd10 con 0x7f0088148150 2024-09-11T23:23:07.560 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.558+0000 7f0084c00640 1 -- 172.21.15.144:0/984440480 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0080014640 con 0x7f0088148150 2024-09-11T23:23:07.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.558+0000 7f008ec00640 1 -- 172.21.15.144:0/984440480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0088139c90 con 0x7f0088148150 2024-09-11T23:23:07.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.558+0000 7f008ec00640 1 -- 172.21.15.144:0/984440480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0088139f30 con 0x7f0088148150 2024-09-11T23:23:07.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.559+0000 7f008ec00640 1 -- 172.21.15.144:0/984440480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00880af010 con 0x7f0088148150 2024-09-11T23:23:07.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.561+0000 7f0084c00640 1 -- 172.21.15.144:0/984440480 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f0080005d10 con 0x7f0088148150 2024-09-11T23:23:07.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.561+0000 7f0084c00640 1 --2- 172.21.15.144:0/984440480 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f006406bf50 0x7f006406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:07.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.562+0000 7f0084c00640 1 -- 172.21.15.144:0/984440480 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5227+0+0 (secure 0 0 0) 0x7f008008bca0 con 0x7f0088148150 2024-09-11T23:23:07.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.562+0000 7f0087e00640 1 --2- 172.21.15.144:0/984440480 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f006406bf50 0x7f006406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:07.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.563+0000 7f0087e00640 1 --2- 172.21.15.144:0/984440480 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f006406bf50 0x7f006406e410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0078034000 tx=0x7f007802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:07.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.565+0000 7f0084c00640 1 -- 172.21.15.144:0/984440480 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0080022070 con 0x7f0088148150 2024-09-11T23:23:07.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:07.742+0000 7f008ec00640 1 -- 172.21.15.144:0/984440480 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f00880634e0 con 0x7f0088148150 2024-09-11T23:23:08.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.366+0000 7f0084c00640 1 -- 172.21.15.144:0/984440480 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v99) ==== 170+0+0 (secure 0 0 0) 0x7f008005a680 con 0x7f0088148150 2024-09-11T23:23:08.367 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-11T23:23:08.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.369+0000 7f008ec00640 1 -- 172.21.15.144:0/984440480 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f006406bf50 msgr2=0x7f006406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.369+0000 7f008ec00640 1 --2- 172.21.15.144:0/984440480 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f006406bf50 0x7f006406e410 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0078034000 tx=0x7f007802e000 comp rx=0 tx=0).stop 2024-09-11T23:23:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.369+0000 7f008ec00640 1 -- 172.21.15.144:0/984440480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0088148150 msgr2=0x7f00880b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.369+0000 7f008ec00640 1 --2- 172.21.15.144:0/984440480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0088148150 0x7f00880b37e0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f008000eed0 tx=0x7f008000b480 comp rx=0 tx=0).stop 2024-09-11T23:23:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.370+0000 7f008ec00640 1 -- 172.21.15.144:0/984440480 shutdown_connections 2024-09-11T23:23:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.370+0000 7f008ec00640 1 --2- 172.21.15.144:0/984440480 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f006406bf50 0x7f006406e410 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.370+0000 7f008ec00640 1 --2- 172.21.15.144:0/984440480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0088148150 0x7f00880b37e0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.370+0000 7f008ec00640 1 --2- 172.21.15.144:0/984440480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0088147d70 0x7f00881f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.370+0000 7f008ec00640 1 --2- 172.21.15.144:0/984440480 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0088072090 0x7f008813e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.370+0000 7f008ec00640 1 -- 172.21.15.144:0/984440480 >> 172.21.15.144:0/984440480 conn(0x7f008806bba0 msgr2=0x7f0088162150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.370+0000 7f008ec00640 1 -- 172.21.15.144:0/984440480 shutdown_connections 2024-09-11T23:23:08.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.370+0000 7f008ec00640 1 -- 172.21.15.144:0/984440480 wait complete. 2024-09-11T23:23:08.405 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:23:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.562+0000 7fe0e7e00640 1 Processor -- start 2024-09-11T23:23:08.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.562+0000 7fe0e7e00640 1 -- start start 2024-09-11T23:23:08.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.563+0000 7fe0e7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe0e8159dd0 0x7fe0e80cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:08.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.564+0000 7fe0e7e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0e80cf260 0x7fe0e80cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:08.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.564+0000 7fe0e7e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe0e806bba0 0x7fe0e806c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:08.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.564+0000 7fe0e7e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e806c550 con 0x7fe0e8159dd0 2024-09-11T23:23:08.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.564+0000 7fe0e7e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e80cfd20 con 0x7fe0e806bba0 2024-09-11T23:23:08.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.564+0000 7fe0e7e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e80cd4e0 con 0x7fe0e80cf260 2024-09-11T23:23:08.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.564+0000 7fe0e6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe0e8159dd0 0x7fe0e80cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:08.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.564+0000 7fe0e6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe0e8159dd0 0x7fe0e80cdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43022/0 (socket says 172.21.15.144:43022) 2024-09-11T23:23:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.564+0000 7fe0e6a00640 1 -- 172.21.15.144:0/179722018 learned_addr learned my addr 172.21.15.144:0/179722018 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.564+0000 7fe0de000640 1 --2- 172.21.15.144:0/179722018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0e80cf260 0x7fe0e80cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.564+0000 7fe0e7400640 1 --2- 172.21.15.144:0/179722018 >> v2:172.21.15.165:3300/0 conn(0x7fe0e806bba0 0x7fe0e806c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.564+0000 7fe0e6a00640 1 -- 172.21.15.144:0/179722018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0e80cf260 msgr2=0x7fe0e80cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.564+0000 7fe0e6a00640 1 --2- 172.21.15.144:0/179722018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0e80cf260 0x7fe0e80cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.564+0000 7fe0e6a00640 1 -- 172.21.15.144:0/179722018 >> v2:172.21.15.165:3300/0 conn(0x7fe0e806bba0 msgr2=0x7fe0e806c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.564+0000 7fe0e6a00640 1 --2- 172.21.15.144:0/179722018 >> v2:172.21.15.165:3300/0 conn(0x7fe0e806bba0 0x7fe0e806c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:08.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.564+0000 7fe0e6a00640 1 -- 172.21.15.144:0/179722018 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e80cd7c0 con 0x7fe0e8159dd0 2024-09-11T23:23:08.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.565+0000 7fe0e6a00640 1 --2- 172.21.15.144:0/179722018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e8159dd0 0x7fe0e80cdfc0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8069d90 tx=0x7fe0d802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5e615e4b1e9f3d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:08.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.566+0000 7fe0e6000640 1 -- 172.21.15.144:0/179722018 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8037070 con 0x7fe0e8159dd0 2024-09-11T23:23:08.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.566+0000 7fe0e6000640 1 -- 172.21.15.144:0/179722018 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d8032440 con 0x7fe0e8159dd0 2024-09-11T23:23:08.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.566+0000 7fe0e6000640 1 -- 172.21.15.144:0/179722018 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8032810 con 0x7fe0e8159dd0 2024-09-11T23:23:08.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.566+0000 7fe0e7e00640 1 -- 172.21.15.144:0/179722018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e8159dd0 msgr2=0x7fe0e80cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:08.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.566+0000 7fe0e7e00640 1 --2- 172.21.15.144:0/179722018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e8159dd0 0x7fe0e80cdfc0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8069d90 tx=0x7fe0d802a1e0 comp rx=0 tx=0).stop 2024-09-11T23:23:08.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.566+0000 7fe0e7e00640 1 -- 172.21.15.144:0/179722018 shutdown_connections 2024-09-11T23:23:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.566+0000 7fe0e7e00640 1 --2- 172.21.15.144:0/179722018 >> v2:172.21.15.165:3300/0 conn(0x7fe0e806bba0 0x7fe0e806c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.566+0000 7fe0e7e00640 1 --2- 172.21.15.144:0/179722018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0e80cf260 0x7fe0e80cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.566+0000 7fe0e7e00640 1 --2- 172.21.15.144:0/179722018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e8159dd0 0x7fe0e80cdfc0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.566+0000 7fe0e7e00640 1 -- 172.21.15.144:0/179722018 >> 172.21.15.144:0/179722018 conn(0x7fe0e80d0300 msgr2=0x7fe0e80d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.566+0000 7fe0e7e00640 1 -- 172.21.15.144:0/179722018 shutdown_connections 2024-09-11T23:23:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.566+0000 7fe0e7e00640 1 -- 172.21.15.144:0/179722018 wait complete. 2024-09-11T23:23:08.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.568+0000 7fe0e7e00640 1 Processor -- start 2024-09-11T23:23:08.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.568+0000 7fe0e7e00640 1 -- start start 2024-09-11T23:23:08.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.569+0000 7fe0e7e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0e806bba0 0x7fe0e814e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:08.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.569+0000 7fe0e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e80cf260 0x7fe0e814bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:08.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.569+0000 7fe0e7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0e8159dd0 0x7fe0e814c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:08.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.569+0000 7fe0e7e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e815d6d0 con 0x7fe0e80cf260 2024-09-11T23:23:08.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.569+0000 7fe0e7e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e815a1b0 con 0x7fe0e8159dd0 2024-09-11T23:23:08.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.569+0000 7fe0e7e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e815d9e0 con 0x7fe0e806bba0 2024-09-11T23:23:08.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.569+0000 7fe0de000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e80cf260 0x7fe0e814bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:08.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.569+0000 7fe0e6a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0e806bba0 0x7fe0e814e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:08.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.569+0000 7fe0de000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e80cf260 0x7fe0e814bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43026/0 (socket says 172.21.15.144:43026) 2024-09-11T23:23:08.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.569+0000 7fe0de000640 1 -- 172.21.15.144:0/3351848827 learned_addr learned my addr 172.21.15.144:0/3351848827 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:08.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.569+0000 7fe0e7400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0e8159dd0 0x7fe0e814c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:08.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.570+0000 7fe0de000640 1 -- 172.21.15.144:0/3351848827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0e806bba0 msgr2=0x7fe0e814e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:08.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.570+0000 7fe0de000640 1 --2- 172.21.15.144:0/3351848827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0e806bba0 0x7fe0e814e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:08.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.570+0000 7fe0de000640 1 -- 172.21.15.144:0/3351848827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0e8159dd0 msgr2=0x7fe0e814c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:08.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.570+0000 7fe0de000640 1 --2- 172.21.15.144:0/3351848827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0e8159dd0 0x7fe0e814c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:08.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.570+0000 7fe0de000640 1 -- 172.21.15.144:0/3351848827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e814ebf0 con 0x7fe0e80cf260 2024-09-11T23:23:08.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.570+0000 7fe0de000640 1 --2- 172.21.15.144:0/3351848827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e80cf260 0x7fe0e814bd70 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000d800 tx=0x7fe0d000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:08.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.570+0000 7fe0df400640 1 -- 172.21.15.144:0/3351848827 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d000b6c0 con 0x7fe0e80cf260 2024-09-11T23:23:08.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.570+0000 7fe0df400640 1 -- 172.21.15.144:0/3351848827 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d0019070 con 0x7fe0e80cf260 2024-09-11T23:23:08.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.570+0000 7fe0df400640 1 -- 172.21.15.144:0/3351848827 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d000ba80 con 0x7fe0e80cf260 2024-09-11T23:23:08.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.571+0000 7fe0e7e00640 1 -- 172.21.15.144:0/3351848827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e814ee60 con 0x7fe0e80cf260 2024-09-11T23:23:08.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.571+0000 7fe0e7e00640 1 -- 172.21.15.144:0/3351848827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e8155110 con 0x7fe0e80cf260 2024-09-11T23:23:08.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.572+0000 7fe0e7e00640 1 -- 172.21.15.144:0/3351848827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e806c010 con 0x7fe0e80cf260 2024-09-11T23:23:08.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.573+0000 7fe0df400640 1 -- 172.21.15.144:0/3351848827 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fe0d000bc20 con 0x7fe0e80cf260 2024-09-11T23:23:08.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.574+0000 7fe0df400640 1 --2- 172.21.15.144:0/3351848827 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe0c406bf50 0x7fe0c406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:08.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.574+0000 7fe0df400640 1 -- 172.21.15.144:0/3351848827 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5609+0+0 (secure 0 0 0) 0x7fe0d008b2d0 con 0x7fe0e80cf260 2024-09-11T23:23:08.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.574+0000 7fe0e6a00640 1 --2- 172.21.15.144:0/3351848827 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe0c406bf50 0x7fe0c406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:08.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.575+0000 7fe0e6a00640 1 --2- 172.21.15.144:0/3351848827 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe0c406bf50 0x7fe0c406e410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8034000 tx=0x7fe0d802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:08.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.579+0000 7fe0df400640 1 -- 172.21.15.144:0/3351848827 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe0d00594e0 con 0x7fe0e80cf260 2024-09-11T23:23:08.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:08.787+0000 7fe0e7e00640 1 -- 172.21.15.144:0/3351848827 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe0e815b300 con 0x7fe0e80cf260 2024-09-11T23:23:09.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.393+0000 7fe0df400640 1 -- 172.21.15.144:0/3351848827 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v67) ==== 174+0+0 (secure 0 0 0) 0x7fe0d005d7e0 con 0x7fe0e80cf260 2024-09-11T23:23:09.398 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 16 and data pool 17 2024-09-11T23:23:09.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.400+0000 7fe0e7e00640 1 -- 172.21.15.144:0/3351848827 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe0c406bf50 msgr2=0x7fe0c406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:09.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.400+0000 7fe0e7e00640 1 --2- 172.21.15.144:0/3351848827 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe0c406bf50 0x7fe0c406e410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8034000 tx=0x7fe0d802e000 comp rx=0 tx=0).stop 2024-09-11T23:23:09.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.400+0000 7fe0e7e00640 1 -- 172.21.15.144:0/3351848827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e80cf260 msgr2=0x7fe0e814bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:09.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.400+0000 7fe0e7e00640 1 --2- 172.21.15.144:0/3351848827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e80cf260 0x7fe0e814bd70 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000d800 tx=0x7fe0d000dcc0 comp rx=0 tx=0).stop 2024-09-11T23:23:09.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.401+0000 7fe0e7e00640 1 -- 172.21.15.144:0/3351848827 shutdown_connections 2024-09-11T23:23:09.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.401+0000 7fe0e7e00640 1 --2- 172.21.15.144:0/3351848827 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe0c406bf50 0x7fe0c406e410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:09.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.401+0000 7fe0e7e00640 1 --2- 172.21.15.144:0/3351848827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0e8159dd0 0x7fe0e814c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:09.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.401+0000 7fe0e7e00640 1 --2- 172.21.15.144:0/3351848827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0e80cf260 0x7fe0e814bd70 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:09.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.401+0000 7fe0e7e00640 1 --2- 172.21.15.144:0/3351848827 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0e806bba0 0x7fe0e814e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:09.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.401+0000 7fe0e7e00640 1 -- 172.21.15.144:0/3351848827 >> 172.21.15.144:0/3351848827 conn(0x7fe0e80d0300 msgr2=0x7fe0e815a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:09.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.401+0000 7fe0e7e00640 1 -- 172.21.15.144:0/3351848827 shutdown_connections 2024-09-11T23:23:09.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.401+0000 7fe0e7e00640 1 -- 172.21.15.144:0/3351848827 wait complete. 2024-09-11T23:23:09.434 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:23:09.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.589+0000 7f8903800640 1 Processor -- start 2024-09-11T23:23:09.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.589+0000 7f8903800640 1 -- start start 2024-09-11T23:23:09.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.590+0000 7f8903800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f88fc15c180 0x7f88fc0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:09.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.590+0000 7f8903800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f88fc073120 0x7f88fc073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:09.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.590+0000 7f8903800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88fc0ce740 con 0x7f88fc0ce230 2024-09-11T23:23:09.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.590+0000 7f8903800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f88fc072640 con 0x7f88fc15c180 2024-09-11T23:23:09.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.590+0000 7f8903800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f88fc072920 con 0x7f88fc073120 2024-09-11T23:23:09.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.591+0000 7f88fbe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f88fc0ce230 0x7f88fc0cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56568/0 (socket says 172.21.15.144:56568) 2024-09-11T23:23:09.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.591+0000 7f88fbe00640 1 -- 172.21.15.144:0/3194063457 learned_addr learned my addr 172.21.15.144:0/3194063457 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:09.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.591+0000 7f8900e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f88fc15c180 0x7f88fc0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:09.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.591+0000 7f8901800640 1 --2- 172.21.15.144:0/3194063457 >> v2:172.21.15.165:3300/0 conn(0x7f88fc073120 0x7f88fc073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:09.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.591+0000 7f8900e00640 1 -- 172.21.15.144:0/3194063457 >> v2:172.21.15.165:3300/0 conn(0x7f88fc073120 msgr2=0x7f88fc073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:09.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.591+0000 7f8900e00640 1 --2- 172.21.15.144:0/3194063457 >> v2:172.21.15.165:3300/0 conn(0x7f88fc073120 0x7f88fc073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:09.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.591+0000 7f8900e00640 1 -- 172.21.15.144:0/3194063457 >> v1:172.21.15.144:6789/0 conn(0x7f88fc0ce230 legacy=0x7f88fc0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:09.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.591+0000 7f8900e00640 1 -- 172.21.15.144:0/3194063457 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88fc072c00 con 0x7f88fc15c180 2024-09-11T23:23:09.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.591+0000 7f88fb400640 1 -- 172.21.15.144:0/3194063457 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3902516510 0 0) 0x7f88fc0ce740 con 0x7f88fc0ce230 2024-09-11T23:23:09.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.592+0000 7f8900e00640 1 --2- 172.21.15.144:0/3194063457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88fc15c180 0x7f88fc0cdcf0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f88fc0cd0a0 tx=0x7f88f002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf1219c01e8537f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:09.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.592+0000 7f88fb400640 1 -- 172.21.15.144:0/3194063457 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0037070 con 0x7f88fc15c180 2024-09-11T23:23:09.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.592+0000 7f88fb400640 1 -- 172.21.15.144:0/3194063457 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f0032440 con 0x7f88fc15c180 2024-09-11T23:23:09.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.592+0000 7f88fb400640 1 -- 172.21.15.144:0/3194063457 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f002ae60 con 0x7f88fc15c180 2024-09-11T23:23:09.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.593+0000 7f8903800640 1 -- 172.21.15.144:0/3194063457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88fc15c180 msgr2=0x7f88fc0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:09.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.593+0000 7f8903800640 1 --2- 172.21.15.144:0/3194063457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88fc15c180 0x7f88fc0cdcf0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f88fc0cd0a0 tx=0x7f88f002a110 comp rx=0 tx=0).stop 2024-09-11T23:23:09.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.593+0000 7f8903800640 1 -- 172.21.15.144:0/3194063457 shutdown_connections 2024-09-11T23:23:09.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.593+0000 7f8903800640 1 --2- 172.21.15.144:0/3194063457 >> v2:172.21.15.165:3300/0 conn(0x7f88fc073120 0x7f88fc073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:09.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.593+0000 7f8903800640 1 --2- 172.21.15.144:0/3194063457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88fc15c180 0x7f88fc0cdcf0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:09.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.593+0000 7f8903800640 1 -- 172.21.15.144:0/3194063457 >> 172.21.15.144:0/3194063457 conn(0x7f88fc062cc0 msgr2=0x7f88fc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:09.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.593+0000 7f8903800640 1 -- 172.21.15.144:0/3194063457 shutdown_connections 2024-09-11T23:23:09.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.593+0000 7f8903800640 1 -- 172.21.15.144:0/3194063457 wait complete. 2024-09-11T23:23:09.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.595+0000 7f8903800640 1 Processor -- start 2024-09-11T23:23:09.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.595+0000 7f8903800640 1 -- start start 2024-09-11T23:23:09.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.596+0000 7f8903800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88fc073120 0x7f88fc149960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:09.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.596+0000 7f8903800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88fc0ce230 0x7f88fc0aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:09.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.596+0000 7f8903800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88fc15c180 0x7f88fc14c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:09.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.596+0000 7f8903800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc0cf780 con 0x7f88fc073120 2024-09-11T23:23:09.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.596+0000 7f8903800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc0722f0 con 0x7f88fc0ce230 2024-09-11T23:23:09.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.596+0000 7f8903800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f88fc15c560 con 0x7f88fc15c180 2024-09-11T23:23:09.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.596+0000 7f8900e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88fc073120 0x7f88fc149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:09.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.596+0000 7f8900e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88fc073120 0x7f88fc149960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43050/0 (socket says 172.21.15.144:43050) 2024-09-11T23:23:09.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.596+0000 7f8900e00640 1 -- 172.21.15.144:0/582076933 learned_addr learned my addr 172.21.15.144:0/582076933 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:09.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.596+0000 7f8900e00640 1 -- 172.21.15.144:0/582076933 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88fc15c180 msgr2=0x7f88fc14c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:09.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.596+0000 7f8900e00640 1 --2- 172.21.15.144:0/582076933 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88fc15c180 0x7f88fc14c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:09.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.596+0000 7f8900e00640 1 -- 172.21.15.144:0/582076933 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88fc0ce230 msgr2=0x7f88fc0aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:09.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.596+0000 7f8900e00640 1 --2- 172.21.15.144:0/582076933 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88fc0ce230 0x7f88fc0aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:09.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.596+0000 7f8900e00640 1 -- 172.21.15.144:0/582076933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88fc149ea0 con 0x7f88fc073120 2024-09-11T23:23:09.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.596+0000 7f8900e00640 1 --2- 172.21.15.144:0/582076933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88fc073120 0x7f88fc149960 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f88f0000c00 tx=0x7f88f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:09.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.597+0000 7f88f8c00640 1 -- 172.21.15.144:0/582076933 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0037050 con 0x7f88fc073120 2024-09-11T23:23:09.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.597+0000 7f88f8c00640 1 -- 172.21.15.144:0/582076933 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f0038040 con 0x7f88fc073120 2024-09-11T23:23:09.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.597+0000 7f88f8c00640 1 -- 172.21.15.144:0/582076933 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0004490 con 0x7f88fc073120 2024-09-11T23:23:09.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.597+0000 7f8903800640 1 -- 172.21.15.144:0/582076933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88fc1e69d0 con 0x7f88fc073120 2024-09-11T23:23:09.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.597+0000 7f8903800640 1 -- 172.21.15.144:0/582076933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88fc1e6f90 con 0x7f88fc073120 2024-09-11T23:23:09.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.598+0000 7f8903800640 1 -- 172.21.15.144:0/582076933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88fc0cdcf0 con 0x7f88fc073120 2024-09-11T23:23:09.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.599+0000 7f88f8c00640 1 -- 172.21.15.144:0/582076933 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f88f003c6d0 con 0x7f88fc073120 2024-09-11T23:23:09.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.599+0000 7f88f8c00640 1 --2- 172.21.15.144:0/582076933 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f88dc06bf50 0x7f88dc06e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:09.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.599+0000 7f88f8c00640 1 -- 172.21.15.144:0/582076933 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5709+0+0 (secure 0 0 0) 0x7f88f00aba30 con 0x7f88fc073120 2024-09-11T23:23:09.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.600+0000 7f88fbe00640 1 --2- 172.21.15.144:0/582076933 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f88dc06bf50 0x7f88dc06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:09.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.601+0000 7f88fbe00640 1 --2- 172.21.15.144:0/582076933 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f88dc06bf50 0x7f88dc06e410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f88e8007fd0 tx=0x7f88e8007960 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:09.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.604+0000 7f88f8c00640 1 -- 172.21.15.144:0/582076933 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88fc149ea0 con 0x7f88fc073120 2024-09-11T23:23:09.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.778+0000 7f8903800640 1 -- 172.21.15.144:0/582076933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88fc0cbda0 con 0x7f88fc073120 2024-09-11T23:23:09.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.779+0000 7f88f8c00640 1 -- 172.21.15.144:0/582076933 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+16716 (secure 0 0 0) 0x7f88f007a230 con 0x7f88fc073120 2024-09-11T23:23:09.782 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:09.782 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":100,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:23:08.789990+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:23:06.559198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-11T23:23:07.784853+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:23:09.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.782+0000 7f8903800640 1 -- 172.21.15.144:0/582076933 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f88dc06bf50 msgr2=0x7f88dc06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:09.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.782+0000 7f8903800640 1 --2- 172.21.15.144:0/582076933 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f88dc06bf50 0x7f88dc06e410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f88e8007fd0 tx=0x7f88e8007960 comp rx=0 tx=0).stop 2024-09-11T23:23:09.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.782+0000 7f8903800640 1 -- 172.21.15.144:0/582076933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88fc073120 msgr2=0x7f88fc149960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:09.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.782+0000 7f8903800640 1 --2- 172.21.15.144:0/582076933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88fc073120 0x7f88fc149960 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f88f0000c00 tx=0x7f88f00046c0 comp rx=0 tx=0).stop 2024-09-11T23:23:09.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.782+0000 7f8903800640 1 -- 172.21.15.144:0/582076933 shutdown_connections 2024-09-11T23:23:09.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.782+0000 7f8903800640 1 --2- 172.21.15.144:0/582076933 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f88dc06bf50 0x7f88dc06e410 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:09.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.782+0000 7f8903800640 1 --2- 172.21.15.144:0/582076933 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88fc15c180 0x7f88fc14c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:09.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.782+0000 7f8903800640 1 --2- 172.21.15.144:0/582076933 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88fc0ce230 0x7f88fc0aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:09.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.782+0000 7f8903800640 1 --2- 172.21.15.144:0/582076933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88fc073120 0x7f88fc149960 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:09.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.782+0000 7f8903800640 1 -- 172.21.15.144:0/582076933 >> 172.21.15.144:0/582076933 conn(0x7f88fc062cc0 msgr2=0x7f88fc06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:09.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.782+0000 7f8903800640 1 -- 172.21.15.144:0/582076933 shutdown_connections 2024-09-11T23:23:09.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.782+0000 7f8903800640 1 -- 172.21.15.144:0/582076933 wait complete. 2024-09-11T23:23:09.798 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:23:09.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.952+0000 7fe809600640 1 Processor -- start 2024-09-11T23:23:09.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.952+0000 7fe809600640 1 -- start start 2024-09-11T23:23:09.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.954+0000 7fe809600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe80415ca40 0x7fe80415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:09.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.954+0000 7fe809600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80415d390 con 0x7fe8040d02a0 2024-09-11T23:23:09.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.954+0000 7fe809600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80415d670 con 0x7fe80415ceb0 2024-09-11T23:23:09.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.954+0000 7fe809600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe80415d950 con 0x7fe80415ca40 2024-09-11T23:23:09.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.954+0000 7fe7fa000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe80415ca40 0x7fe80415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:09.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.954+0000 7fe802a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe8040d02a0 0x7fe8040d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56574/0 (socket says 172.21.15.144:56574) 2024-09-11T23:23:09.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.954+0000 7fe802a00640 1 -- 172.21.15.144:0/2427962216 learned_addr learned my addr 172.21.15.144:0/2427962216 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:09.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.954+0000 7fe7fa000640 1 -- 172.21.15.144:0/2427962216 >> v1:172.21.15.165:6789/0 conn(0x7fe80415ceb0 legacy=0x7fe8041594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:09.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.954+0000 7fe7fa000640 1 -- 172.21.15.144:0/2427962216 >> v1:172.21.15.144:6789/0 conn(0x7fe8040d02a0 legacy=0x7fe8040d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:09.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.954+0000 7fe802000640 1 -- 172.21.15.144:0/2427962216 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1076986055 0 0) 0x7fe80415d390 con 0x7fe8040d02a0 2024-09-11T23:23:09.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.954+0000 7fe7fa000640 1 -- 172.21.15.144:0/2427962216 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80415dc30 con 0x7fe80415ca40 2024-09-11T23:23:09.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.955+0000 7fe7fa000640 1 --2- 172.21.15.144:0/2427962216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe80415ca40 0x7fe80415e430 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0097a0 tx=0x7fe7ec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d702770569a1a520 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:09.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.956+0000 7fe802000640 1 -- 172.21.15.144:0/2427962216 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec037070 con 0x7fe80415ca40 2024-09-11T23:23:09.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.956+0000 7fe802000640 1 -- 172.21.15.144:0/2427962216 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7ec032440 con 0x7fe80415ca40 2024-09-11T23:23:09.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.956+0000 7fe802000640 1 -- 172.21.15.144:0/2427962216 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec032810 con 0x7fe80415ca40 2024-09-11T23:23:09.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.956+0000 7fe809600640 1 -- 172.21.15.144:0/2427962216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe80415ca40 msgr2=0x7fe80415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:09.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.956+0000 7fe809600640 1 --2- 172.21.15.144:0/2427962216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe80415ca40 0x7fe80415e430 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0097a0 tx=0x7fe7ec02a1a0 comp rx=0 tx=0).stop 2024-09-11T23:23:09.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.956+0000 7fe809600640 1 -- 172.21.15.144:0/2427962216 shutdown_connections 2024-09-11T23:23:09.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.956+0000 7fe809600640 1 --2- 172.21.15.144:0/2427962216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe80415ca40 0x7fe80415e430 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:09.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.956+0000 7fe809600640 1 -- 172.21.15.144:0/2427962216 >> 172.21.15.144:0/2427962216 conn(0x7fe804062cc0 msgr2=0x7fe80406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:09.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.956+0000 7fe809600640 1 -- 172.21.15.144:0/2427962216 shutdown_connections 2024-09-11T23:23:09.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.956+0000 7fe809600640 1 -- 172.21.15.144:0/2427962216 wait complete. 2024-09-11T23:23:09.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.958+0000 7fe809600640 1 Processor -- start 2024-09-11T23:23:09.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.958+0000 7fe809600640 1 -- start start 2024-09-11T23:23:09.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.959+0000 7fe809600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8040d02a0 0x7fe80414c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:09.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.959+0000 7fe809600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe80415ca40 0x7fe80415af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:09.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.959+0000 7fe809600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe80415ceb0 0x7fe804072350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:09.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.959+0000 7fe809600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe804155d10 con 0x7fe8040d02a0 2024-09-11T23:23:09.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.959+0000 7fe809600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe804155b90 con 0x7fe80415ca40 2024-09-11T23:23:09.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.959+0000 7fe809600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8040b4790 con 0x7fe80415ceb0 2024-09-11T23:23:09.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.959+0000 7fe802a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8040d02a0 0x7fe80414c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:09.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.959+0000 7fe802a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8040d02a0 0x7fe80414c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43066/0 (socket says 172.21.15.144:43066) 2024-09-11T23:23:09.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.959+0000 7fe802a00640 1 -- 172.21.15.144:0/2595898861 learned_addr learned my addr 172.21.15.144:0/2595898861 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:09.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.960+0000 7fe7fa000640 1 --2- 172.21.15.144:0/2595898861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe80415ca40 0x7fe80415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:09.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.960+0000 7fe803400640 1 --2- 172.21.15.144:0/2595898861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe80415ceb0 0x7fe804072350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:09.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.960+0000 7fe802a00640 1 -- 172.21.15.144:0/2595898861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe80415ceb0 msgr2=0x7fe804072350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:09.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.960+0000 7fe802a00640 1 --2- 172.21.15.144:0/2595898861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe80415ceb0 0x7fe804072350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:09.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.960+0000 7fe802a00640 1 -- 172.21.15.144:0/2595898861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe80415ca40 msgr2=0x7fe80415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:09.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.960+0000 7fe802a00640 1 --2- 172.21.15.144:0/2595898861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe80415ca40 0x7fe80415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:09.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.960+0000 7fe802a00640 1 -- 172.21.15.144:0/2595898861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80414e480 con 0x7fe8040d02a0 2024-09-11T23:23:09.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.960+0000 7fe802a00640 1 --2- 172.21.15.144:0/2595898861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8040d02a0 0x7fe80414c2b0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400c4a0 tx=0x7fe7f400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:09.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.960+0000 7fe7fb400640 1 -- 172.21.15.144:0/2595898861 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4018070 con 0x7fe8040d02a0 2024-09-11T23:23:09.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.960+0000 7fe7fb400640 1 -- 172.21.15.144:0/2595898861 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7f40074e0 con 0x7fe8040d02a0 2024-09-11T23:23:09.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.960+0000 7fe7fb400640 1 -- 172.21.15.144:0/2595898861 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4004a20 con 0x7fe8040d02a0 2024-09-11T23:23:09.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.960+0000 7fe809600640 1 -- 172.21.15.144:0/2595898861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe80414e760 con 0x7fe8040d02a0 2024-09-11T23:23:09.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.961+0000 7fe809600640 1 -- 172.21.15.144:0/2595898861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe80414f4f0 con 0x7fe8040d02a0 2024-09-11T23:23:09.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.962+0000 7fe809600640 1 -- 172.21.15.144:0/2595898861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe804152e00 con 0x7fe8040d02a0 2024-09-11T23:23:09.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.963+0000 7fe7fb400640 1 -- 172.21.15.144:0/2595898861 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fe7f401b070 con 0x7fe8040d02a0 2024-09-11T23:23:09.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.963+0000 7fe7fb400640 1 --2- 172.21.15.144:0/2595898861 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe7e006bf50 0x7fe7e006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:09.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.964+0000 7fe7fb400640 1 -- 172.21.15.144:0/2595898861 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5709+0+0 (secure 0 0 0) 0x7fe7f408a2c0 con 0x7fe8040d02a0 2024-09-11T23:23:09.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.964+0000 7fe7fa000640 1 --2- 172.21.15.144:0/2595898861 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe7e006bf50 0x7fe7e006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:09.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.965+0000 7fe7fa000640 1 --2- 172.21.15.144:0/2595898861 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe7e006bf50 0x7fe7e006e410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec034000 tx=0x7fe7ec02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:09.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:09.968+0000 7fe7fb400640 1 -- 172.21.15.144:0/2595898861 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe7f4058470 con 0x7fe8040d02a0 2024-09-11T23:23:10.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.140+0000 7fe809600640 1 -- 172.21.15.144:0/2595898861 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8040d0680 con 0x7fe8040d02a0 2024-09-11T23:23:10.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.142+0000 7fe7fb400640 1 -- 172.21.15.144:0/2595898861 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+16716 (secure 0 0 0) 0x7fe7f405c770 con 0x7fe8040d02a0 2024-09-11T23:23:10.142 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:10.142 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":100,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:23:08.789990+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:23:06.559198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-11T23:23:07.784853+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:23:10.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.144+0000 7fe809600640 1 -- 172.21.15.144:0/2595898861 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe7e006bf50 msgr2=0x7fe7e006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:10.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.144+0000 7fe809600640 1 --2- 172.21.15.144:0/2595898861 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe7e006bf50 0x7fe7e006e410 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec034000 tx=0x7fe7ec02e000 comp rx=0 tx=0).stop 2024-09-11T23:23:10.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.144+0000 7fe809600640 1 -- 172.21.15.144:0/2595898861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8040d02a0 msgr2=0x7fe80414c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:10.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.144+0000 7fe809600640 1 --2- 172.21.15.144:0/2595898861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8040d02a0 0x7fe80414c2b0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400c4a0 tx=0x7fe7f400c960 comp rx=0 tx=0).stop 2024-09-11T23:23:10.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.144+0000 7fe809600640 1 -- 172.21.15.144:0/2595898861 shutdown_connections 2024-09-11T23:23:10.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.144+0000 7fe809600640 1 --2- 172.21.15.144:0/2595898861 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe7e006bf50 0x7fe7e006e410 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:10.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.144+0000 7fe809600640 1 --2- 172.21.15.144:0/2595898861 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe80415ceb0 0x7fe804072350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:10.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.144+0000 7fe809600640 1 --2- 172.21.15.144:0/2595898861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe80415ca40 0x7fe80415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:10.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.144+0000 7fe809600640 1 --2- 172.21.15.144:0/2595898861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8040d02a0 0x7fe80414c2b0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:10.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.144+0000 7fe809600640 1 -- 172.21.15.144:0/2595898861 >> 172.21.15.144:0/2595898861 conn(0x7fe804062cc0 msgr2=0x7fe80406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:10.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.144+0000 7fe809600640 1 -- 172.21.15.144:0/2595898861 shutdown_connections 2024-09-11T23:23:10.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.144+0000 7fe809600640 1 -- 172.21.15.144:0/2595898861 wait complete. 2024-09-11T23:23:10.160 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:23:10.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.315+0000 7f1723200640 1 Processor -- start 2024-09-11T23:23:10.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.316+0000 7f1723200640 1 -- start start 2024-09-11T23:23:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.317+0000 7f1723200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1724147820 0x7f172406d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.317+0000 7f1723200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1724147c00 con 0x7f1724073cf0 2024-09-11T23:23:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.317+0000 7f1723200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17240741d0 con 0x7f17240b63b0 2024-09-11T23:23:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.317+0000 7f1723200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1724162160 con 0x7f1724147820 2024-09-11T23:23:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.317+0000 7f1719400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1724073cf0 0x7f17240b5ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56588/0 (socket says 172.21.15.144:56588) 2024-09-11T23:23:10.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.317+0000 7f1719400640 1 -- 172.21.15.144:0/2819260532 learned_addr learned my addr 172.21.15.144:0/2819260532 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.317+0000 7f1721e00640 1 --2- 172.21.15.144:0/2819260532 >> v2:172.21.15.165:3300/0 conn(0x7f1724147820 0x7f172406d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.317+0000 7f1721400640 1 -- 172.21.15.144:0/2819260532 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2685804915 0 0) 0x7f1724147c00 con 0x7f1724073cf0 2024-09-11T23:23:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.318+0000 7f1721400640 1 -- 172.21.15.144:0/2819260532 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1708003520 con 0x7f1724073cf0 2024-09-11T23:23:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.318+0000 7f1721400640 1 -- 172.21.15.144:0/2819260532 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 97118700 0 0) 0x7f17240741d0 con 0x7f17240b63b0 2024-09-11T23:23:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.318+0000 7f1721400640 1 -- 172.21.15.144:0/2819260532 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1724147c00 con 0x7f17240b63b0 2024-09-11T23:23:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.318+0000 7f1721e00640 1 -- 172.21.15.144:0/2819260532 >> v1:172.21.15.165:6789/0 conn(0x7f17240b63b0 legacy=0x7f172406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:10.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.318+0000 7f1721400640 1 -- 172.21.15.144:0/2819260532 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2396337158 0 0) 0x7f1708003520 con 0x7f1724073cf0 2024-09-11T23:23:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.318+0000 7f1721e00640 1 -- 172.21.15.144:0/2819260532 >> v1:172.21.15.144:6789/0 conn(0x7f1724073cf0 legacy=0x7f17240b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:10.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.318+0000 7f1721e00640 1 -- 172.21.15.144:0/2819260532 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1724162440 con 0x7f1724147820 2024-09-11T23:23:10.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.319+0000 7f1721e00640 1 --2- 172.21.15.144:0/2819260532 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1724147820 0x7f172406d7a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f17140097a0 tx=0x7f171402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f39655f8d77710f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:10.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.319+0000 7f1721400640 1 -- 172.21.15.144:0/2819260532 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1714037070 con 0x7f1724147820 2024-09-11T23:23:10.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.319+0000 7f1721400640 1 -- 172.21.15.144:0/2819260532 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f171402ac50 con 0x7f1724147820 2024-09-11T23:23:10.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.319+0000 7f1721400640 1 -- 172.21.15.144:0/2819260532 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c001670 con 0x7f1724147820 2024-09-11T23:23:10.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.320+0000 7f1723200640 1 -- 172.21.15.144:0/2819260532 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1724147820 msgr2=0x7f172406d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:10.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.320+0000 7f1723200640 1 --2- 172.21.15.144:0/2819260532 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1724147820 0x7f172406d7a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f17140097a0 tx=0x7f171402a1c0 comp rx=0 tx=0).stop 2024-09-11T23:23:10.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.320+0000 7f1723200640 1 -- 172.21.15.144:0/2819260532 shutdown_connections 2024-09-11T23:23:10.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.320+0000 7f1723200640 1 --2- 172.21.15.144:0/2819260532 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1724147820 0x7f172406d7a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:10.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.320+0000 7f1723200640 1 -- 172.21.15.144:0/2819260532 >> 172.21.15.144:0/2819260532 conn(0x7f172406ccb0 msgr2=0x7f172406d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:10.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.320+0000 7f1723200640 1 -- 172.21.15.144:0/2819260532 shutdown_connections 2024-09-11T23:23:10.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.320+0000 7f1723200640 1 -- 172.21.15.144:0/2819260532 wait complete. 2024-09-11T23:23:10.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.321+0000 7f1723200640 1 Processor -- start 2024-09-11T23:23:10.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.322+0000 7f1723200640 1 -- start start 2024-09-11T23:23:10.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.322+0000 7f1723200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1724073cf0 0x7f17241f5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.322+0000 7f1723200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17240b63b0 0x7f172413fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.323+0000 7f1723200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1724147820 0x7f1724160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.323+0000 7f1723200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1724162f20 con 0x7f17240b63b0 2024-09-11T23:23:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.323+0000 7f1723200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1724162a00 con 0x7f1724073cf0 2024-09-11T23:23:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.323+0000 7f1723200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1724148280 con 0x7f1724147820 2024-09-11T23:23:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.323+0000 7f1719400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17240b63b0 0x7f172413fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.323+0000 7f1721e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1724073cf0 0x7f17241f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.323+0000 7f1719400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17240b63b0 0x7f172413fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43080/0 (socket says 172.21.15.144:43080) 2024-09-11T23:23:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.323+0000 7f1719400640 1 -- 172.21.15.144:0/166532135 learned_addr learned my addr 172.21.15.144:0/166532135 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.323+0000 7f1722800640 1 --2- 172.21.15.144:0/166532135 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1724147820 0x7f1724160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:10.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.323+0000 7f1721e00640 1 -- 172.21.15.144:0/166532135 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1724147820 msgr2=0x7f1724160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:10.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.323+0000 7f1721e00640 1 --2- 172.21.15.144:0/166532135 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1724147820 0x7f1724160070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:10.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.323+0000 7f1721e00640 1 -- 172.21.15.144:0/166532135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17240b63b0 msgr2=0x7f172413fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:10.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.323+0000 7f1721e00640 1 --2- 172.21.15.144:0/166532135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17240b63b0 0x7f172413fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:10.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.323+0000 7f1721e00640 1 -- 172.21.15.144:0/166532135 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1724140430 con 0x7f1724073cf0 2024-09-11T23:23:10.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.323+0000 7f1719400640 1 --2- 172.21.15.144:0/166532135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17240b63b0 0x7f172413fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:23:10.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.324+0000 7f1721e00640 1 --2- 172.21.15.144:0/166532135 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1724073cf0 0x7f17241f5660 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1714031000 tx=0x7f17140046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:10.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.324+0000 7f171aa00640 1 -- 172.21.15.144:0/166532135 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1714041020 con 0x7f1724073cf0 2024-09-11T23:23:10.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.324+0000 7f171aa00640 1 -- 172.21.15.144:0/166532135 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f171403d420 con 0x7f1724073cf0 2024-09-11T23:23:10.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.324+0000 7f171aa00640 1 -- 172.21.15.144:0/166532135 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1714037040 con 0x7f1724073cf0 2024-09-11T23:23:10.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.324+0000 7f1723200640 1 -- 172.21.15.144:0/166532135 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1724146b40 con 0x7f1724073cf0 2024-09-11T23:23:10.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.324+0000 7f1723200640 1 -- 172.21.15.144:0/166532135 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17241f4e60 con 0x7f1724073cf0 2024-09-11T23:23:10.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.325+0000 7f1723200640 1 -- 172.21.15.144:0/166532135 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f172406d7a0 con 0x7f1724073cf0 2024-09-11T23:23:10.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.326+0000 7f171aa00640 1 -- 172.21.15.144:0/166532135 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f1714044020 con 0x7f1724073cf0 2024-09-11T23:23:10.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.327+0000 7f171aa00640 1 --2- 172.21.15.144:0/166532135 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f170006bf50 0x7f170006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:10.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.327+0000 7f171aa00640 1 -- 172.21.15.144:0/166532135 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5709+0+0 (secure 0 0 0) 0x7f17140ab430 con 0x7f1724073cf0 2024-09-11T23:23:10.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.328+0000 7f1719400640 1 --2- 172.21.15.144:0/166532135 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f170006bf50 0x7f170006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:10.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.328+0000 7f1719400640 1 --2- 172.21.15.144:0/166532135 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f170006bf50 0x7f170006e410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f17240b3070 tx=0x7f170c0016b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:10.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.333+0000 7f171aa00640 1 -- 172.21.15.144:0/166532135 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f171404b030 con 0x7f1724073cf0 2024-09-11T23:23:10.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:10.542+0000 7f1723200640 1 -- 172.21.15.144:0/166532135 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f17240706d0 con 0x7f1724073cf0 2024-09-11T23:23:11.362 INFO:tasks.ceph.mds.a.smithi144.stderr:2024-09-11T23:23:11.362+0000 7f9a07600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:23:11.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.405+0000 7f171aa00640 1 -- 172.21.15.144:0/166532135 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v70) ==== 118+0+0 (secure 0 0 0) 0x7f17140797f0 con 0x7f1724073cf0 2024-09-11T23:23:11.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.408+0000 7f1723200640 1 -- 172.21.15.144:0/166532135 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f170006bf50 msgr2=0x7f170006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:11.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.408+0000 7f1723200640 1 --2- 172.21.15.144:0/166532135 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f170006bf50 0x7f170006e410 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f17240b3070 tx=0x7f170c0016b0 comp rx=0 tx=0).stop 2024-09-11T23:23:11.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.408+0000 7f1723200640 1 -- 172.21.15.144:0/166532135 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1724073cf0 msgr2=0x7f17241f5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:11.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.408+0000 7f1723200640 1 --2- 172.21.15.144:0/166532135 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1724073cf0 0x7f17241f5660 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1714031000 tx=0x7f17140046c0 comp rx=0 tx=0).stop 2024-09-11T23:23:11.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.408+0000 7f1723200640 1 -- 172.21.15.144:0/166532135 shutdown_connections 2024-09-11T23:23:11.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.408+0000 7f1723200640 1 --2- 172.21.15.144:0/166532135 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f170006bf50 0x7f170006e410 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:11.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.408+0000 7f1723200640 1 --2- 172.21.15.144:0/166532135 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1724147820 0x7f1724160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:11.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.408+0000 7f1723200640 1 --2- 172.21.15.144:0/166532135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17240b63b0 0x7f172413fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:11.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.408+0000 7f1723200640 1 --2- 172.21.15.144:0/166532135 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1724073cf0 0x7f17241f5660 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:11.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.408+0000 7f1723200640 1 -- 172.21.15.144:0/166532135 >> 172.21.15.144:0/166532135 conn(0x7f172406ccb0 msgr2=0x7f17240cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:11.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.408+0000 7f1723200640 1 -- 172.21.15.144:0/166532135 shutdown_connections 2024-09-11T23:23:11.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.408+0000 7f1723200640 1 -- 172.21.15.144:0/166532135 wait complete. 2024-09-11T23:23:11.425 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:23:11.426 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:23:11.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.584+0000 7f3e90000640 1 Processor -- start 2024-09-11T23:23:11.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.584+0000 7f3e90000640 1 -- start start 2024-09-11T23:23:11.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.586+0000 7f3e90000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e880ae8e0 0x7f3e880aed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:11.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.586+0000 7f3e90000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e881443d0 con 0x7f3e88143d40 2024-09-11T23:23:11.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.586+0000 7f3e90000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e881446b0 con 0x7f3e8815ed50 2024-09-11T23:23:11.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.586+0000 7f3e90000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3e88144190 con 0x7f3e880ae8e0 2024-09-11T23:23:11.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.586+0000 7f3e8e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e880ae8e0 0x7f3e880aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:11.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.586+0000 7f3e8cc00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3e88143d40 0x7f3e880b3ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56598/0 (socket says 172.21.15.144:56598) 2024-09-11T23:23:11.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.586+0000 7f3e8cc00640 1 -- 172.21.15.144:0/1353611176 learned_addr learned my addr 172.21.15.144:0/1353611176 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:11.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.586+0000 7f3e8e000640 1 -- 172.21.15.144:0/1353611176 >> v1:172.21.15.165:6789/0 conn(0x7f3e8815ed50 legacy=0x7f3e88071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:11.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.586+0000 7f3e8e000640 1 -- 172.21.15.144:0/1353611176 >> v1:172.21.15.144:6789/0 conn(0x7f3e88143d40 legacy=0x7f3e880b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:11.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.587+0000 7f3e8e000640 1 -- 172.21.15.144:0/1353611176 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e88144990 con 0x7f3e880ae8e0 2024-09-11T23:23:11.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.587+0000 7f3e87e00640 1 -- 172.21.15.144:0/1353611176 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1445397133 0 0) 0x7f3e881443d0 con 0x7f3e88143d40 2024-09-11T23:23:11.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.587+0000 7f3e8e000640 1 --2- 172.21.15.144:0/1353611176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e880ae8e0 0x7f3e880aed70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f3e80009d90 tx=0x7f3e8002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0afbb265f933cff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:11.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.588+0000 7f3e87e00640 1 -- 172.21.15.144:0/1353611176 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e80031600 con 0x7f3e880ae8e0 2024-09-11T23:23:11.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.588+0000 7f3e87e00640 1 -- 172.21.15.144:0/1353611176 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e800317a0 con 0x7f3e880ae8e0 2024-09-11T23:23:11.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.588+0000 7f3e87e00640 1 -- 172.21.15.144:0/1353611176 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e80031b70 con 0x7f3e880ae8e0 2024-09-11T23:23:11.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.588+0000 7f3e90000640 1 -- 172.21.15.144:0/1353611176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e880ae8e0 msgr2=0x7f3e880aed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:11.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.588+0000 7f3e90000640 1 --2- 172.21.15.144:0/1353611176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e880ae8e0 0x7f3e880aed70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f3e80009d90 tx=0x7f3e8002a610 comp rx=0 tx=0).stop 2024-09-11T23:23:11.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.588+0000 7f3e90000640 1 -- 172.21.15.144:0/1353611176 shutdown_connections 2024-09-11T23:23:11.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.588+0000 7f3e90000640 1 --2- 172.21.15.144:0/1353611176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e880ae8e0 0x7f3e880aed70 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:11.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.588+0000 7f3e90000640 1 -- 172.21.15.144:0/1353611176 >> 172.21.15.144:0/1353611176 conn(0x7f3e8806bba0 msgr2=0x7f3e8806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:11.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.588+0000 7f3e90000640 1 -- 172.21.15.144:0/1353611176 shutdown_connections 2024-09-11T23:23:11.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.588+0000 7f3e90000640 1 -- 172.21.15.144:0/1353611176 wait complete. 2024-09-11T23:23:11.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.590+0000 7f3e90000640 1 Processor -- start 2024-09-11T23:23:11.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.590+0000 7f3e90000640 1 -- start start 2024-09-11T23:23:11.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.591+0000 7f3e90000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e880ae8e0 0x7f3e88140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:11.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.591+0000 7f3e90000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e88143d40 0x7f3e880b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:11.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.591+0000 7f3e90000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e8815ed50 0x7f3e880b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:11.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.591+0000 7f3e90000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3e88071790 con 0x7f3e880ae8e0 2024-09-11T23:23:11.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.591+0000 7f3e90000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3e880b41d0 con 0x7f3e8815ed50 2024-09-11T23:23:11.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.591+0000 7f3e90000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3e8815c350 con 0x7f3e88143d40 2024-09-11T23:23:11.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.591+0000 7f3e8d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e880ae8e0 0x7f3e88140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:11.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.591+0000 7f3e8d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e880ae8e0 0x7f3e88140880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43096/0 (socket says 172.21.15.144:43096) 2024-09-11T23:23:11.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.591+0000 7f3e8d600640 1 -- 172.21.15.144:0/4225882603 learned_addr learned my addr 172.21.15.144:0/4225882603 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:11.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.592+0000 7f3e8cc00640 1 --2- 172.21.15.144:0/4225882603 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e88143d40 0x7f3e880b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:11.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.592+0000 7f3e8e000640 1 --2- 172.21.15.144:0/4225882603 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e8815ed50 0x7f3e880b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:11.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.592+0000 7f3e8d600640 1 -- 172.21.15.144:0/4225882603 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e88143d40 msgr2=0x7f3e880b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:11.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.592+0000 7f3e8d600640 1 --2- 172.21.15.144:0/4225882603 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e88143d40 0x7f3e880b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:11.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.592+0000 7f3e8d600640 1 -- 172.21.15.144:0/4225882603 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e8815ed50 msgr2=0x7f3e880b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:11.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.592+0000 7f3e8d600640 1 --2- 172.21.15.144:0/4225882603 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e8815ed50 0x7f3e880b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:11.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.592+0000 7f3e8d600640 1 -- 172.21.15.144:0/4225882603 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e88159ee0 con 0x7f3e880ae8e0 2024-09-11T23:23:11.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.592+0000 7f3e8d600640 1 --2- 172.21.15.144:0/4225882603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e880ae8e0 0x7f3e88140880 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c00b3f0 tx=0x7f3e7c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:11.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.592+0000 7f3e85600640 1 -- 172.21.15.144:0/4225882603 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c015020 con 0x7f3e880ae8e0 2024-09-11T23:23:11.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.592+0000 7f3e85600640 1 -- 172.21.15.144:0/4225882603 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e7c011830 con 0x7f3e880ae8e0 2024-09-11T23:23:11.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.592+0000 7f3e90000640 1 -- 172.21.15.144:0/4225882603 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e8815a1c0 con 0x7f3e880ae8e0 2024-09-11T23:23:11.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.592+0000 7f3e85600640 1 -- 172.21.15.144:0/4225882603 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c011c20 con 0x7f3e880ae8e0 2024-09-11T23:23:11.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.593+0000 7f3e90000640 1 -- 172.21.15.144:0/4225882603 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e8815c890 con 0x7f3e880ae8e0 2024-09-11T23:23:11.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.593+0000 7f3e90000640 1 -- 172.21.15.144:0/4225882603 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e880aed70 con 0x7f3e880ae8e0 2024-09-11T23:23:11.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.595+0000 7f3e85600640 1 -- 172.21.15.144:0/4225882603 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f3e7c018020 con 0x7f3e880ae8e0 2024-09-11T23:23:11.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.595+0000 7f3e85600640 1 --2- 172.21.15.144:0/4225882603 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e6806bf50 0x7f3e6806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:11.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.596+0000 7f3e85600640 1 -- 172.21.15.144:0/4225882603 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f3e7c08acf0 con 0x7f3e880ae8e0 2024-09-11T23:23:11.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.596+0000 7f3e8cc00640 1 --2- 172.21.15.144:0/4225882603 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e6806bf50 0x7f3e6806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:11.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.597+0000 7f3e8cc00640 1 --2- 172.21.15.144:0/4225882603 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e6806bf50 0x7f3e6806e410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3e881596a0 tx=0x7f3e74009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:11.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.600+0000 7f3e85600640 1 -- 172.21.15.144:0/4225882603 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e7c01f030 con 0x7f3e880ae8e0 2024-09-11T23:23:11.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:11.809+0000 7f3e90000640 1 -- 172.21.15.144:0/4225882603 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3e880725a0 con 0x7f3e880ae8e0 2024-09-11T23:23:12.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.404+0000 7f3e85600640 1 -- 172.21.15.144:0/4225882603 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v71) ==== 122+0+0 (secure 0 0 0) 0x7f3e7c0594f0 con 0x7f3e880ae8e0 2024-09-11T23:23:12.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.407+0000 7f3e90000640 1 -- 172.21.15.144:0/4225882603 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e6806bf50 msgr2=0x7f3e6806e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:12.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.407+0000 7f3e90000640 1 --2- 172.21.15.144:0/4225882603 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e6806bf50 0x7f3e6806e410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3e881596a0 tx=0x7f3e74009040 comp rx=0 tx=0).stop 2024-09-11T23:23:12.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.407+0000 7f3e90000640 1 -- 172.21.15.144:0/4225882603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e880ae8e0 msgr2=0x7f3e88140880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:12.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.407+0000 7f3e90000640 1 --2- 172.21.15.144:0/4225882603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e880ae8e0 0x7f3e88140880 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c00b3f0 tx=0x7f3e7c00b8b0 comp rx=0 tx=0).stop 2024-09-11T23:23:12.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.407+0000 7f3e90000640 1 -- 172.21.15.144:0/4225882603 shutdown_connections 2024-09-11T23:23:12.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.407+0000 7f3e90000640 1 --2- 172.21.15.144:0/4225882603 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e6806bf50 0x7f3e6806e410 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:12.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.407+0000 7f3e90000640 1 --2- 172.21.15.144:0/4225882603 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e8815ed50 0x7f3e880b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:12.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.407+0000 7f3e90000640 1 --2- 172.21.15.144:0/4225882603 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e88143d40 0x7f3e880b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:12.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.407+0000 7f3e90000640 1 --2- 172.21.15.144:0/4225882603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e880ae8e0 0x7f3e88140880 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:12.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.407+0000 7f3e90000640 1 -- 172.21.15.144:0/4225882603 >> 172.21.15.144:0/4225882603 conn(0x7f3e8806bba0 msgr2=0x7f3e8815f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:12.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.407+0000 7f3e90000640 1 -- 172.21.15.144:0/4225882603 shutdown_connections 2024-09-11T23:23:12.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.407+0000 7f3e90000640 1 -- 172.21.15.144:0/4225882603 wait complete. 2024-09-11T23:23:12.424 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:23:12.424 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:23:12.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.577+0000 7fd637a00640 1 Processor -- start 2024-09-11T23:23:12.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.577+0000 7fd637a00640 1 -- start start 2024-09-11T23:23:12.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.579+0000 7fd637a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd630073320 0x7fd6300d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:12.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.579+0000 7fd637a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd63015ec00 0x7fd63015f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:12.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.579+0000 7fd637a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd630073cd0 con 0x7fd6300b44e0 2024-09-11T23:23:12.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.579+0000 7fd637a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd63006ccb0 con 0x7fd630073320 2024-09-11T23:23:12.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.579+0000 7fd637a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd6300b6c70 con 0x7fd63015ec00 2024-09-11T23:23:12.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.579+0000 7fd627e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd630073320 0x7fd6300d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:12.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.579+0000 7fd627e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd630073320 0x7fd6300d1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43102/0 (socket says 172.21.15.144:43102) 2024-09-11T23:23:12.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.579+0000 7fd627e00640 1 -- 172.21.15.144:0/2657391791 learned_addr learned my addr 172.21.15.144:0/2657391791 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:12.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.579+0000 7fd627e00640 1 -- 172.21.15.144:0/2657391791 >> v2:172.21.15.165:3300/0 conn(0x7fd63015ec00 msgr2=0x7fd63015f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:12.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.579+0000 7fd627e00640 1 --2- 172.21.15.144:0/2657391791 >> v2:172.21.15.165:3300/0 conn(0x7fd63015ec00 0x7fd63015f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:12.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.579+0000 7fd627e00640 1 -- 172.21.15.144:0/2657391791 >> v1:172.21.15.165:6789/0 conn(0x7fd6300b44e0 legacy=0x7fd6300b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:12.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.579+0000 7fd627e00640 1 -- 172.21.15.144:0/2657391791 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd630073fb0 con 0x7fd630073320 2024-09-11T23:23:12.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.580+0000 7fd627e00640 1 --2- 172.21.15.144:0/2657391791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd630073320 0x7fd6300d1e20 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd6300730e0 tx=0x7fd61802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160f3dbaacfee156 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:12.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.581+0000 7fd62fe00640 1 -- 172.21.15.144:0/2657391791 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd618037070 con 0x7fd630073320 2024-09-11T23:23:12.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.581+0000 7fd62fe00640 1 -- 172.21.15.144:0/2657391791 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd618032440 con 0x7fd630073320 2024-09-11T23:23:12.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.581+0000 7fd62fe00640 1 -- 172.21.15.144:0/2657391791 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd618032810 con 0x7fd630073320 2024-09-11T23:23:12.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.581+0000 7fd637a00640 1 -- 172.21.15.144:0/2657391791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd630073320 msgr2=0x7fd6300d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:12.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.581+0000 7fd637a00640 1 --2- 172.21.15.144:0/2657391791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd630073320 0x7fd6300d1e20 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd6300730e0 tx=0x7fd61802a230 comp rx=0 tx=0).stop 2024-09-11T23:23:12.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.581+0000 7fd637a00640 1 -- 172.21.15.144:0/2657391791 shutdown_connections 2024-09-11T23:23:12.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.581+0000 7fd637a00640 1 --2- 172.21.15.144:0/2657391791 >> v2:172.21.15.165:3300/0 conn(0x7fd63015ec00 0x7fd63015f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:12.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.581+0000 7fd637a00640 1 --2- 172.21.15.144:0/2657391791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd630073320 0x7fd6300d1e20 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:12.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.581+0000 7fd637a00640 1 -- 172.21.15.144:0/2657391791 >> 172.21.15.144:0/2657391791 conn(0x7fd630062810 msgr2=0x7fd630062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:12.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.581+0000 7fd637a00640 1 -- 172.21.15.144:0/2657391791 shutdown_connections 2024-09-11T23:23:12.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.581+0000 7fd637a00640 1 -- 172.21.15.144:0/2657391791 wait complete. 2024-09-11T23:23:12.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.583+0000 7fd637a00640 1 Processor -- start 2024-09-11T23:23:12.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.583+0000 7fd637a00640 1 -- start start 2024-09-11T23:23:12.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.584+0000 7fd637a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd630073320 0x7fd6300cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:12.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.584+0000 7fd637a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6300b44e0 0x7fd63014ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:12.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.584+0000 7fd637a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd63015ec00 0x7fd6300ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:12.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.584+0000 7fd637a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd6300b7180 con 0x7fd63015ec00 2024-09-11T23:23:12.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.584+0000 7fd637a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd630074290 con 0x7fd6300b44e0 2024-09-11T23:23:12.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.584+0000 7fd637a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd6300b7460 con 0x7fd630073320 2024-09-11T23:23:12.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.584+0000 7fd635a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd63015ec00 0x7fd6300ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:12.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.584+0000 7fd635a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd63015ec00 0x7fd6300ccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43114/0 (socket says 172.21.15.144:43114) 2024-09-11T23:23:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.584+0000 7fd635a00640 1 -- 172.21.15.144:0/1939949695 learned_addr learned my addr 172.21.15.144:0/1939949695 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.584+0000 7fd627e00640 1 --2- 172.21.15.144:0/1939949695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6300b44e0 0x7fd63014ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.584+0000 7fd635000640 1 --2- 172.21.15.144:0/1939949695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd630073320 0x7fd6300cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.585+0000 7fd635a00640 1 -- 172.21.15.144:0/1939949695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd630073320 msgr2=0x7fd6300cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.585+0000 7fd635a00640 1 --2- 172.21.15.144:0/1939949695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd630073320 0x7fd6300cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.585+0000 7fd635a00640 1 -- 172.21.15.144:0/1939949695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6300b44e0 msgr2=0x7fd63014ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.585+0000 7fd635a00640 1 --2- 172.21.15.144:0/1939949695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6300b44e0 0x7fd63014ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.585+0000 7fd635a00640 1 -- 172.21.15.144:0/1939949695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd63014d520 con 0x7fd63015ec00 2024-09-11T23:23:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.585+0000 7fd635a00640 1 --2- 172.21.15.144:0/1939949695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd63015ec00 0x7fd6300ccfd0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd62800b970 tx=0x7fd62800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.585+0000 7fd62d600640 1 -- 172.21.15.144:0/1939949695 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628019070 con 0x7fd63015ec00 2024-09-11T23:23:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.585+0000 7fd62d600640 1 -- 172.21.15.144:0/1939949695 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd62800cb60 con 0x7fd63015ec00 2024-09-11T23:23:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.585+0000 7fd637a00640 1 -- 172.21.15.144:0/1939949695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6300cbf30 con 0x7fd63015ec00 2024-09-11T23:23:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.585+0000 7fd62d600640 1 -- 172.21.15.144:0/1939949695 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628014440 con 0x7fd63015ec00 2024-09-11T23:23:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.585+0000 7fd637a00640 1 -- 172.21.15.144:0/1939949695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6300cc4f0 con 0x7fd63015ec00 2024-09-11T23:23:12.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.586+0000 7fd637a00640 1 -- 172.21.15.144:0/1939949695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6300d1e20 con 0x7fd63015ec00 2024-09-11T23:23:12.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.587+0000 7fd62d600640 1 -- 172.21.15.144:0/1939949695 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fd62801c070 con 0x7fd63015ec00 2024-09-11T23:23:12.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.588+0000 7fd62d600640 1 --2- 172.21.15.144:0/1939949695 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd60c06bf50 0x7fd60c06e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:12.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.588+0000 7fd62d600640 1 -- 172.21.15.144:0/1939949695 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7fd62808acf0 con 0x7fd63015ec00 2024-09-11T23:23:12.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.588+0000 7fd635000640 1 --2- 172.21.15.144:0/1939949695 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd60c06bf50 0x7fd60c06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:12.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.589+0000 7fd635000640 1 --2- 172.21.15.144:0/1939949695 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd60c06bf50 0x7fd60c06e410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd630156620 tx=0x7fd620009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:12.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.592+0000 7fd62d600640 1 -- 172.21.15.144:0/1939949695 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd628058ea0 con 0x7fd63015ec00 2024-09-11T23:23:12.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.802+0000 7fd637a00640 1 -- 172.21.15.144:0/1939949695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd630069160 con 0x7fd63015ec00 2024-09-11T23:23:12.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.803+0000 7fd62d600640 1 -- 172.21.15.144:0/1939949695 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5234 (secure 0 0 0) 0x7fd62805d1a0 con 0x7fd63015ec00 2024-09-11T23:23:12.803 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:12.803 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":71,"btime":"2024-09-11T23:23:12:403951+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2463021219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2463021219},{"type":"v1","addr":"172.21.15.165:6835","nonce":2463021219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6900,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/2687483394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2687483394},{"type":"v1","addr":"172.21.15.144:6801","nonce":2687483394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2256829982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2256829982},{"type":"v1","addr":"172.21.15.165:6834","nonce":2256829982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:23:08.790322+0000","modified":"2024-09-11T23:23:11.810403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6909},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6909":{"gid":6909,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/419371779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":419371779},{"type":"v1","addr":"172.21.15.144:6835","nonce":419371779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6909,"qdb_cluster":[6909]},"id":8}]} 2024-09-11T23:23:12.803 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 71 2024-09-11T23:23:12.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.805+0000 7fd637a00640 1 -- 172.21.15.144:0/1939949695 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd60c06bf50 msgr2=0x7fd60c06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:12.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.805+0000 7fd637a00640 1 --2- 172.21.15.144:0/1939949695 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd60c06bf50 0x7fd60c06e410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd630156620 tx=0x7fd620009060 comp rx=0 tx=0).stop 2024-09-11T23:23:12.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.805+0000 7fd637a00640 1 -- 172.21.15.144:0/1939949695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd63015ec00 msgr2=0x7fd6300ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:12.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.805+0000 7fd637a00640 1 --2- 172.21.15.144:0/1939949695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd63015ec00 0x7fd6300ccfd0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd62800b970 tx=0x7fd62800be30 comp rx=0 tx=0).stop 2024-09-11T23:23:12.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.805+0000 7fd637a00640 1 -- 172.21.15.144:0/1939949695 shutdown_connections 2024-09-11T23:23:12.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.805+0000 7fd637a00640 1 --2- 172.21.15.144:0/1939949695 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd60c06bf50 0x7fd60c06e410 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:12.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.805+0000 7fd637a00640 1 --2- 172.21.15.144:0/1939949695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd63015ec00 0x7fd6300ccfd0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:12.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.805+0000 7fd637a00640 1 --2- 172.21.15.144:0/1939949695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6300b44e0 0x7fd63014ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:12.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.805+0000 7fd637a00640 1 --2- 172.21.15.144:0/1939949695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd630073320 0x7fd6300cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:12.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.805+0000 7fd637a00640 1 -- 172.21.15.144:0/1939949695 >> 172.21.15.144:0/1939949695 conn(0x7fd630062810 msgr2=0x7fd63006f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:12.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.805+0000 7fd637a00640 1 -- 172.21.15.144:0/1939949695 shutdown_connections 2024-09-11T23:23:12.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.805+0000 7fd637a00640 1 -- 172.21.15.144:0/1939949695 wait complete. 2024-09-11T23:23:12.822 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:23:12.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.974+0000 7f77b6600640 1 Processor -- start 2024-09-11T23:23:12.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.974+0000 7f77b6600640 1 -- start start 2024-09-11T23:23:12.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.976+0000 7f77b6600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f77b00b4930 0x7f77b00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:12.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.976+0000 7f77b6600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f77b015f620 0x7f77b015fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:12.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.976+0000 7f77b6600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77b0162870 con 0x7f77b00d0a50 2024-09-11T23:23:12.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.976+0000 7f77b6600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f77b00b52d0 con 0x7f77b015f620 2024-09-11T23:23:12.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.976+0000 7f77b6600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f77b0162b50 con 0x7f77b00b4930 2024-09-11T23:23:12.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.976+0000 7f77afe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f77b015f620 0x7f77b015fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:12.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.976+0000 7f77afe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f77b015f620 0x7f77b015fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43122/0 (socket says 172.21.15.144:43122) 2024-09-11T23:23:12.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.976+0000 7f77afe00640 1 -- 172.21.15.144:0/4176598136 learned_addr learned my addr 172.21.15.144:0/4176598136 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:12.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.976+0000 7f77a6a00640 1 --2- 172.21.15.144:0/4176598136 >> v2:172.21.15.165:3300/0 conn(0x7f77b00b4930 0x7f77b00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:12.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.976+0000 7f77afe00640 1 -- 172.21.15.144:0/4176598136 >> v2:172.21.15.165:3300/0 conn(0x7f77b00b4930 msgr2=0x7f77b00b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:12.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.976+0000 7f77afe00640 1 --2- 172.21.15.144:0/4176598136 >> v2:172.21.15.165:3300/0 conn(0x7f77b00b4930 0x7f77b00b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:12.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.976+0000 7f77afe00640 1 -- 172.21.15.144:0/4176598136 >> v1:172.21.15.165:6789/0 conn(0x7f77b00d0a50 legacy=0x7f77b01620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:12.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.976+0000 7f77afe00640 1 -- 172.21.15.144:0/4176598136 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b0162e30 con 0x7f77b015f620 2024-09-11T23:23:12.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.977+0000 7f77afe00640 1 --2- 172.21.15.144:0/4176598136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77b015f620 0x7f77b015fa70 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f77b0070ef0 tx=0x7f77a802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816692b6e4bc1c87 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:12.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.978+0000 7f77aea00640 1 -- 172.21.15.144:0/4176598136 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a8036070 con 0x7f77b015f620 2024-09-11T23:23:12.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.978+0000 7f77aea00640 1 -- 172.21.15.144:0/4176598136 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a8031600 con 0x7f77b015f620 2024-09-11T23:23:12.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.978+0000 7f77aea00640 1 -- 172.21.15.144:0/4176598136 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a80319d0 con 0x7f77b015f620 2024-09-11T23:23:12.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.978+0000 7f77b6600640 1 -- 172.21.15.144:0/4176598136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77b015f620 msgr2=0x7f77b015fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:12.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.978+0000 7f77b6600640 1 --2- 172.21.15.144:0/4176598136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77b015f620 0x7f77b015fa70 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f77b0070ef0 tx=0x7f77a802a6a0 comp rx=0 tx=0).stop 2024-09-11T23:23:12.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.978+0000 7f77b6600640 1 -- 172.21.15.144:0/4176598136 shutdown_connections 2024-09-11T23:23:12.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.978+0000 7f77b6600640 1 --2- 172.21.15.144:0/4176598136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77b015f620 0x7f77b015fa70 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:12.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.978+0000 7f77b6600640 1 --2- 172.21.15.144:0/4176598136 >> v2:172.21.15.165:3300/0 conn(0x7f77b00b4930 0x7f77b00b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:12.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.978+0000 7f77b6600640 1 -- 172.21.15.144:0/4176598136 >> 172.21.15.144:0/4176598136 conn(0x7f77b0062cc0 msgr2=0x7f77b006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:12.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.978+0000 7f77b6600640 1 -- 172.21.15.144:0/4176598136 shutdown_connections 2024-09-11T23:23:12.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.978+0000 7f77b6600640 1 -- 172.21.15.144:0/4176598136 wait complete. 2024-09-11T23:23:12.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.980+0000 7f77b6600640 1 Processor -- start 2024-09-11T23:23:12.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.980+0000 7f77b6600640 1 -- start start 2024-09-11T23:23:12.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.981+0000 7f77b6600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77b00b4930 0x7f77b0147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:12.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.981+0000 7f77b6600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77b015f620 0x7f77b00b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:12.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.981+0000 7f77b6600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77b00b1a20 0x7f77b015a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:12.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.981+0000 7f77b6600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f77b015ffb0 con 0x7f77b00b4930 2024-09-11T23:23:12.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.981+0000 7f77b6600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f77b00b3620 con 0x7f77b00b1a20 2024-09-11T23:23:12.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.981+0000 7f77b6600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f77b0160130 con 0x7f77b015f620 2024-09-11T23:23:12.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.981+0000 7f77af400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77b00b4930 0x7f77b0147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:12.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.981+0000 7f77af400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77b00b4930 0x7f77b0147d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43128/0 (socket says 172.21.15.144:43128) 2024-09-11T23:23:12.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.981+0000 7f77af400640 1 -- 172.21.15.144:0/1927098940 learned_addr learned my addr 172.21.15.144:0/1927098940 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:12.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.981+0000 7f77afe00640 1 --2- 172.21.15.144:0/1927098940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77b00b1a20 0x7f77b015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:12.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.981+0000 7f77a6a00640 1 --2- 172.21.15.144:0/1927098940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77b015f620 0x7f77b00b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:12.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.982+0000 7f77af400640 1 -- 172.21.15.144:0/1927098940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77b015f620 msgr2=0x7f77b00b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:12.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.982+0000 7f77af400640 1 --2- 172.21.15.144:0/1927098940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77b015f620 0x7f77b00b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:12.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.982+0000 7f77af400640 1 -- 172.21.15.144:0/1927098940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77b00b1a20 msgr2=0x7f77b015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:12.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.982+0000 7f77af400640 1 --2- 172.21.15.144:0/1927098940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77b00b1a20 0x7f77b015a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:12.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.982+0000 7f77af400640 1 -- 172.21.15.144:0/1927098940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b01e7ed0 con 0x7f77b00b4930 2024-09-11T23:23:12.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.982+0000 7f77af400640 1 --2- 172.21.15.144:0/1927098940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77b00b4930 0x7f77b0147d00 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f77a000c430 tx=0x7f77a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:12.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.982+0000 7f77a7e00640 1 -- 172.21.15.144:0/1927098940 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a00052d0 con 0x7f77b00b4930 2024-09-11T23:23:12.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.982+0000 7f77a7e00640 1 -- 172.21.15.144:0/1927098940 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a0005490 con 0x7f77b00b4930 2024-09-11T23:23:12.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.982+0000 7f77a7e00640 1 -- 172.21.15.144:0/1927098940 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a0007260 con 0x7f77b00b4930 2024-09-11T23:23:12.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.982+0000 7f77b6600640 1 -- 172.21.15.144:0/1927098940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77b01e81b0 con 0x7f77b00b4930 2024-09-11T23:23:12.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.982+0000 7f77b6600640 1 -- 172.21.15.144:0/1927098940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77b01e8770 con 0x7f77b00b4930 2024-09-11T23:23:12.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.983+0000 7f77b6600640 1 -- 172.21.15.144:0/1927098940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77b00b4d90 con 0x7f77b00b4930 2024-09-11T23:23:12.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.984+0000 7f77a7e00640 1 -- 172.21.15.144:0/1927098940 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f77a0007400 con 0x7f77b00b4930 2024-09-11T23:23:12.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.985+0000 7f77a7e00640 1 --2- 172.21.15.144:0/1927098940 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f778c06bf50 0x7f778c06e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:12.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.985+0000 7f77a7e00640 1 -- 172.21.15.144:0/1927098940 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f77a008a4e0 con 0x7f77b00b4930 2024-09-11T23:23:12.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.985+0000 7f77a6a00640 1 --2- 172.21.15.144:0/1927098940 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f778c06bf50 0x7f778c06e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:12.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.986+0000 7f77a6a00640 1 --2- 172.21.15.144:0/1927098940 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f778c06bf50 0x7f778c06e410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f77b00b1070 tx=0x7f7798008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:12.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:12.989+0000 7f77a7e00640 1 -- 172.21.15.144:0/1927098940 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f77a0058690 con 0x7f77b00b4930 2024-09-11T23:23:13.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.163+0000 7f77b6600640 1 -- 172.21.15.144:0/1927098940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f77b015b7f0 con 0x7f77b00b4930 2024-09-11T23:23:13.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.164+0000 7f77a7e00640 1 -- 172.21.15.144:0/1927098940 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16703 (secure 0 0 0) 0x7f77a005c990 con 0x7f77b00b4930 2024-09-11T23:23:13.164 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:13.164 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":101,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:23:10.391477+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:23:06.559198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-11T23:23:07.784853+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:23:13.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.166+0000 7f77b6600640 1 -- 172.21.15.144:0/1927098940 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f778c06bf50 msgr2=0x7f778c06e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:13.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.166+0000 7f77b6600640 1 --2- 172.21.15.144:0/1927098940 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f778c06bf50 0x7f778c06e410 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f77b00b1070 tx=0x7f7798008040 comp rx=0 tx=0).stop 2024-09-11T23:23:13.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.166+0000 7f77b6600640 1 -- 172.21.15.144:0/1927098940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77b00b4930 msgr2=0x7f77b0147d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:13.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.166+0000 7f77b6600640 1 --2- 172.21.15.144:0/1927098940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77b00b4930 0x7f77b0147d00 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f77a000c430 tx=0x7f77a000c8f0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.166+0000 7f77b6600640 1 -- 172.21.15.144:0/1927098940 shutdown_connections 2024-09-11T23:23:13.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.166+0000 7f77b6600640 1 --2- 172.21.15.144:0/1927098940 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f778c06bf50 0x7f778c06e410 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.166+0000 7f77b6600640 1 --2- 172.21.15.144:0/1927098940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77b00b1a20 0x7f77b015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.166+0000 7f77b6600640 1 --2- 172.21.15.144:0/1927098940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77b015f620 0x7f77b00b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.166+0000 7f77b6600640 1 --2- 172.21.15.144:0/1927098940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77b00b4930 0x7f77b0147d00 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.166+0000 7f77b6600640 1 -- 172.21.15.144:0/1927098940 >> 172.21.15.144:0/1927098940 conn(0x7f77b0062cc0 msgr2=0x7f77b0160c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:13.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.166+0000 7f77b6600640 1 -- 172.21.15.144:0/1927098940 shutdown_connections 2024-09-11T23:23:13.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.166+0000 7f77b6600640 1 -- 172.21.15.144:0/1927098940 wait complete. 2024-09-11T23:23:13.183 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:23:13.183 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:23:13.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.336+0000 7fd43d800640 1 Processor -- start 2024-09-11T23:23:13.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.336+0000 7fd43d800640 1 -- start start 2024-09-11T23:23:13.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.337+0000 7fd43d800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd438073320 0x7fd4380d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:13.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.337+0000 7fd43d800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd438073cd0 con 0x7fd4380b44e0 2024-09-11T23:23:13.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.337+0000 7fd43d800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd438073fb0 con 0x7fd43815ec00 2024-09-11T23:23:13.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.337+0000 7fd43d800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd43806ccb0 con 0x7fd438073320 2024-09-11T23:23:13.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.337+0000 7fd436a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd4380b44e0 0x7fd4380b48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56610/0 (socket says 172.21.15.144:56610) 2024-09-11T23:23:13.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.337+0000 7fd436a00640 1 -- 172.21.15.144:0/2187832999 learned_addr learned my addr 172.21.15.144:0/2187832999 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:13.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.338+0000 7fd436000640 1 --2- 172.21.15.144:0/2187832999 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd438073320 0x7fd4380d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:13.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.338+0000 7fd435600640 1 -- 172.21.15.144:0/2187832999 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1465058641 0 0) 0x7fd438073cd0 con 0x7fd4380b44e0 2024-09-11T23:23:13.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.338+0000 7fd435600640 1 -- 172.21.15.144:0/2187832999 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd41c003520 con 0x7fd4380b44e0 2024-09-11T23:23:13.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.338+0000 7fd435600640 1 -- 172.21.15.144:0/2187832999 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1949164337 0 0) 0x7fd438073fb0 con 0x7fd43815ec00 2024-09-11T23:23:13.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.338+0000 7fd435600640 1 -- 172.21.15.144:0/2187832999 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd438073cd0 con 0x7fd43815ec00 2024-09-11T23:23:13.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.338+0000 7fd436000640 1 -- 172.21.15.144:0/2187832999 >> v1:172.21.15.165:6789/0 conn(0x7fd43815ec00 legacy=0x7fd43815f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:13.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.338+0000 7fd436000640 1 -- 172.21.15.144:0/2187832999 >> v1:172.21.15.144:6789/0 conn(0x7fd4380b44e0 legacy=0x7fd4380b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:13.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.338+0000 7fd436000640 1 -- 172.21.15.144:0/2187832999 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4380b6ea0 con 0x7fd438073320 2024-09-11T23:23:13.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.339+0000 7fd436000640 1 --2- 172.21.15.144:0/2187832999 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd438073320 0x7fd4380d1e20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd4240097d0 tx=0x7fd42402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=865080ee0541641d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:13.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.340+0000 7fd435600640 1 -- 172.21.15.144:0/2187832999 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424037070 con 0x7fd438073320 2024-09-11T23:23:13.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.340+0000 7fd435600640 1 -- 172.21.15.144:0/2187832999 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd424032440 con 0x7fd438073320 2024-09-11T23:23:13.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.340+0000 7fd435600640 1 -- 172.21.15.144:0/2187832999 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4240327f0 con 0x7fd438073320 2024-09-11T23:23:13.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.340+0000 7fd43d800640 1 -- 172.21.15.144:0/2187832999 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd438073320 msgr2=0x7fd4380d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:13.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.340+0000 7fd43d800640 1 --2- 172.21.15.144:0/2187832999 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd438073320 0x7fd4380d1e20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd4240097d0 tx=0x7fd42402a210 comp rx=0 tx=0).stop 2024-09-11T23:23:13.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.340+0000 7fd43d800640 1 -- 172.21.15.144:0/2187832999 shutdown_connections 2024-09-11T23:23:13.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.340+0000 7fd43d800640 1 --2- 172.21.15.144:0/2187832999 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd438073320 0x7fd4380d1e20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.340+0000 7fd43d800640 1 -- 172.21.15.144:0/2187832999 >> 172.21.15.144:0/2187832999 conn(0x7fd438062810 msgr2=0x7fd438062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:13.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.340+0000 7fd43d800640 1 -- 172.21.15.144:0/2187832999 shutdown_connections 2024-09-11T23:23:13.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.340+0000 7fd43d800640 1 -- 172.21.15.144:0/2187832999 wait complete. 2024-09-11T23:23:13.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.342+0000 7fd43d800640 1 Processor -- start 2024-09-11T23:23:13.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.342+0000 7fd43d800640 1 -- start start 2024-09-11T23:23:13.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.343+0000 7fd43d800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd438073320 0x7fd438159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:13.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.343+0000 7fd43d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4380b44e0 0x7fd43814a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:13.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.343+0000 7fd43d800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd43815ec00 0x7fd4380d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:13.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.343+0000 7fd43d800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd438074290 con 0x7fd4380b44e0 2024-09-11T23:23:13.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.343+0000 7fd43d800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd4380b7460 con 0x7fd438073320 2024-09-11T23:23:13.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.343+0000 7fd43d800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd43815f7c0 con 0x7fd43815ec00 2024-09-11T23:23:13.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.343+0000 7fd436000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4380b44e0 0x7fd43814a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:13.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.343+0000 7fd436000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4380b44e0 0x7fd43814a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43130/0 (socket says 172.21.15.144:43130) 2024-09-11T23:23:13.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.343+0000 7fd436000640 1 -- 172.21.15.144:0/1780443383 learned_addr learned my addr 172.21.15.144:0/1780443383 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:13.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.343+0000 7fd436a00640 1 --2- 172.21.15.144:0/1780443383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd438073320 0x7fd438159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:13.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.344+0000 7fd437400640 1 --2- 172.21.15.144:0/1780443383 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd43815ec00 0x7fd4380d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:13.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.344+0000 7fd436000640 1 -- 172.21.15.144:0/1780443383 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd43815ec00 msgr2=0x7fd4380d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:13.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.344+0000 7fd436000640 1 --2- 172.21.15.144:0/1780443383 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd43815ec00 0x7fd4380d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.344+0000 7fd436000640 1 -- 172.21.15.144:0/1780443383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd438073320 msgr2=0x7fd438159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:13.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.344+0000 7fd436000640 1 --2- 172.21.15.144:0/1780443383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd438073320 0x7fd438159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.344+0000 7fd436000640 1 -- 172.21.15.144:0/1780443383 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43814a560 con 0x7fd4380b44e0 2024-09-11T23:23:13.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.344+0000 7fd437400640 1 --2- 172.21.15.144:0/1780443383 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd43815ec00 0x7fd4380d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:23:13.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.344+0000 7fd436000640 1 --2- 172.21.15.144:0/1780443383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4380b44e0 0x7fd43814a020 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fd42402a250 tx=0x7fd4240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:13.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.344+0000 7fd42ea00640 1 -- 172.21.15.144:0/1780443383 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424037040 con 0x7fd4380b44e0 2024-09-11T23:23:13.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.344+0000 7fd42ea00640 1 -- 172.21.15.144:0/1780443383 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd424042070 con 0x7fd4380b44e0 2024-09-11T23:23:13.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.344+0000 7fd43d800640 1 -- 172.21.15.144:0/1780443383 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd43815a280 con 0x7fd4380b44e0 2024-09-11T23:23:13.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.344+0000 7fd42ea00640 1 -- 172.21.15.144:0/1780443383 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424032830 con 0x7fd4380b44e0 2024-09-11T23:23:13.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.345+0000 7fd43d800640 1 -- 172.21.15.144:0/1780443383 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd43815a840 con 0x7fd4380b44e0 2024-09-11T23:23:13.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.346+0000 7fd43d800640 1 -- 172.21.15.144:0/1780443383 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd438073fb0 con 0x7fd4380b44e0 2024-09-11T23:23:13.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.346+0000 7fd42ea00640 1 -- 172.21.15.144:0/1780443383 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fd4240329d0 con 0x7fd4380b44e0 2024-09-11T23:23:13.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.347+0000 7fd42ea00640 1 --2- 172.21.15.144:0/1780443383 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd41806bf50 0x7fd41806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:13.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.347+0000 7fd42ea00640 1 -- 172.21.15.144:0/1780443383 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7fd4240ab860 con 0x7fd4380b44e0 2024-09-11T23:23:13.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.348+0000 7fd436a00640 1 --2- 172.21.15.144:0/1780443383 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd41806bf50 0x7fd41806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:13.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.348+0000 7fd436a00640 1 --2- 172.21.15.144:0/1780443383 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd41806bf50 0x7fd41806e410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd428000f60 tx=0x7fd428007d70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:13.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.352+0000 7fd42ea00640 1 -- 172.21.15.144:0/1780443383 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd42407a060 con 0x7fd4380b44e0 2024-09-11T23:23:13.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.526+0000 7fd43d800640 1 -- 172.21.15.144:0/1780443383 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd438069160 con 0x7fd41806bf50 2024-09-11T23:23:13.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.534+0000 7fd42ea00640 1 -- 172.21.15.144:0/1780443383 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252216 (secure 0 0 0) 0x7fd438069160 con 0x7fd41806bf50 2024-09-11T23:23:13.536 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:13.538 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:23:13.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.537+0000 7fd43d800640 1 -- 172.21.15.144:0/1780443383 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd41806bf50 msgr2=0x7fd41806e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:13.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.538+0000 7fd43d800640 1 --2- 172.21.15.144:0/1780443383 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd41806bf50 0x7fd41806e410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd428000f60 tx=0x7fd428007d70 comp rx=0 tx=0).stop 2024-09-11T23:23:13.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.538+0000 7fd43d800640 1 -- 172.21.15.144:0/1780443383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4380b44e0 msgr2=0x7fd43814a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:13.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.538+0000 7fd43d800640 1 --2- 172.21.15.144:0/1780443383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4380b44e0 0x7fd43814a020 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fd42402a250 tx=0x7fd4240046c0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.538+0000 7fd43d800640 1 -- 172.21.15.144:0/1780443383 shutdown_connections 2024-09-11T23:23:13.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.538+0000 7fd43d800640 1 --2- 172.21.15.144:0/1780443383 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd41806bf50 0x7fd41806e410 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.538+0000 7fd43d800640 1 --2- 172.21.15.144:0/1780443383 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd43815ec00 0x7fd4380d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.538+0000 7fd43d800640 1 --2- 172.21.15.144:0/1780443383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4380b44e0 0x7fd43814a020 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.538+0000 7fd43d800640 1 --2- 172.21.15.144:0/1780443383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd438073320 0x7fd438159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.538+0000 7fd43d800640 1 -- 172.21.15.144:0/1780443383 >> 172.21.15.144:0/1780443383 conn(0x7fd438062810 msgr2=0x7fd4380d23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:13.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.538+0000 7fd43d800640 1 -- 172.21.15.144:0/1780443383 shutdown_connections 2024-09-11T23:23:13.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.538+0000 7fd43d800640 1 -- 172.21.15.144:0/1780443383 wait complete. 2024-09-11T23:23:13.553 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-09-11T23:23:12.724932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260388,"kb_used_data":10868,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714332,"statfs":{"total":773094113280,"available":772827475968,"internally_reserved":0,"allocated":11128832,"data_stored":5488552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.358187"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.417792+0000","last_change":"2024-09-11T23:23:09.404670+0000","last_active":"2024-09-11T23:23:09.417792+0000","last_peered":"2024-09-11T23:23:09.417792+0000","last_clean":"2024-09-11T23:23:09.417792+0000","last_became_active":"2024-09-11T23:23:09.404415+0000","last_became_peered":"2024-09-11T23:23:09.404415+0000","last_unstale":"2024-09-11T23:23:09.417792+0000","last_undegraded":"2024-09-11T23:23:09.417792+0000","last_fullsized":"2024-09-11T23:23:09.417792+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:31.697199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.402553+0000","last_change":"2024-09-11T23:23:09.405999+0000","last_active":"2024-09-11T23:23:10.402553+0000","last_peered":"2024-09-11T23:23:10.402553+0000","last_clean":"2024-09-11T23:23:10.402553+0000","last_became_active":"2024-09-11T23:23:09.405551+0000","last_became_peered":"2024-09-11T23:23:09.405551+0000","last_unstale":"2024-09-11T23:23:10.402553+0000","last_undegraded":"2024-09-11T23:23:10.402553+0000","last_fullsized":"2024-09-11T23:23:10.402553+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:41.162208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.415187+0000","last_change":"2024-09-11T23:23:09.411960+0000","last_active":"2024-09-11T23:23:09.415187+0000","last_peered":"2024-09-11T23:23:09.415187+0000","last_clean":"2024-09-11T23:23:09.415187+0000","last_became_active":"2024-09-11T23:23:09.410281+0000","last_became_peered":"2024-09-11T23:23:09.410281+0000","last_unstale":"2024-09-11T23:23:09.415187+0000","last_undegraded":"2024-09-11T23:23:09.415187+0000","last_fullsized":"2024-09-11T23:23:09.415187+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:41.162208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.416077+0000","last_change":"2024-09-11T23:23:09.406575+0000","last_active":"2024-09-11T23:23:09.416077+0000","last_peered":"2024-09-11T23:23:09.416077+0000","last_clean":"2024-09-11T23:23:09.416077+0000","last_became_active":"2024-09-11T23:23:09.406258+0000","last_became_peered":"2024-09-11T23:23:09.406258+0000","last_unstale":"2024-09-11T23:23:09.416077+0000","last_undegraded":"2024-09-11T23:23:09.416077+0000","last_fullsized":"2024-09-11T23:23:09.416077+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:10.147781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.399584+0000","last_change":"2024-09-11T23:23:09.406890+0000","last_active":"2024-09-11T23:23:10.399584+0000","last_peered":"2024-09-11T23:23:10.399584+0000","last_clean":"2024-09-11T23:23:10.399584+0000","last_became_active":"2024-09-11T23:23:09.406225+0000","last_became_peered":"2024-09-11T23:23:09.406225+0000","last_unstale":"2024-09-11T23:23:10.399584+0000","last_undegraded":"2024-09-11T23:23:10.399584+0000","last_fullsized":"2024-09-11T23:23:10.399584+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:51.616365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.417071+0000","last_change":"2024-09-11T23:23:09.413671+0000","last_active":"2024-09-11T23:23:09.417071+0000","last_peered":"2024-09-11T23:23:09.417071+0000","last_clean":"2024-09-11T23:23:09.417071+0000","last_became_active":"2024-09-11T23:23:09.413336+0000","last_became_peered":"2024-09-11T23:23:09.413336+0000","last_unstale":"2024-09-11T23:23:09.417071+0000","last_undegraded":"2024-09-11T23:23:09.417071+0000","last_fullsized":"2024-09-11T23:23:09.417071+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:04.189080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401019+0000","last_change":"2024-09-11T23:23:09.402362+0000","last_active":"2024-09-11T23:23:10.401019+0000","last_peered":"2024-09-11T23:23:10.401019+0000","last_clean":"2024-09-11T23:23:10.401019+0000","last_became_active":"2024-09-11T23:23:09.402071+0000","last_became_peered":"2024-09-11T23:23:09.402071+0000","last_unstale":"2024-09-11T23:23:10.401019+0000","last_undegraded":"2024-09-11T23:23:10.401019+0000","last_fullsized":"2024-09-11T23:23:10.401019+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:20.343496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.412973+0000","last_change":"2024-09-11T23:23:09.410027+0000","last_active":"2024-09-11T23:23:09.412973+0000","last_peered":"2024-09-11T23:23:09.412973+0000","last_clean":"2024-09-11T23:23:09.412973+0000","last_became_active":"2024-09-11T23:23:09.409459+0000","last_became_peered":"2024-09-11T23:23:09.409459+0000","last_unstale":"2024-09-11T23:23:09.412973+0000","last_undegraded":"2024-09-11T23:23:09.412973+0000","last_fullsized":"2024-09-11T23:23:09.412973+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:20.343496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.417813+0000","last_change":"2024-09-11T23:23:09.407820+0000","last_active":"2024-09-11T23:23:09.417813+0000","last_peered":"2024-09-11T23:23:09.417813+0000","last_clean":"2024-09-11T23:23:09.417813+0000","last_became_active":"2024-09-11T23:23:09.406447+0000","last_became_peered":"2024-09-11T23:23:09.406447+0000","last_unstale":"2024-09-11T23:23:09.417813+0000","last_undegraded":"2024-09-11T23:23:09.417813+0000","last_fullsized":"2024-09-11T23:23:09.417813+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:55.506032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.421300+0000","last_change":"2024-09-11T23:23:09.415593+0000","last_active":"2024-09-11T23:23:09.421300+0000","last_peered":"2024-09-11T23:23:09.421300+0000","last_clean":"2024-09-11T23:23:09.421300+0000","last_became_active":"2024-09-11T23:23:09.415336+0000","last_became_peered":"2024-09-11T23:23:09.415336+0000","last_unstale":"2024-09-11T23:23:09.421300+0000","last_undegraded":"2024-09-11T23:23:09.421300+0000","last_fullsized":"2024-09-11T23:23:09.421300+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:36.326466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.402395+0000","last_change":"2024-09-11T23:23:09.399636+0000","last_active":"2024-09-11T23:23:10.402395+0000","last_peered":"2024-09-11T23:23:10.402395+0000","last_clean":"2024-09-11T23:23:10.402395+0000","last_became_active":"2024-09-11T23:23:09.399326+0000","last_became_peered":"2024-09-11T23:23:09.399326+0000","last_unstale":"2024-09-11T23:23:10.402395+0000","last_undegraded":"2024-09-11T23:23:10.402395+0000","last_fullsized":"2024-09-11T23:23:10.402395+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:34.050183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.422878+0000","last_change":"2024-09-11T23:23:09.414482+0000","last_active":"2024-09-11T23:23:09.422878+0000","last_peered":"2024-09-11T23:23:09.422878+0000","last_clean":"2024-09-11T23:23:09.422878+0000","last_became_active":"2024-09-11T23:23:09.414082+0000","last_became_peered":"2024-09-11T23:23:09.414082+0000","last_unstale":"2024-09-11T23:23:09.422878+0000","last_undegraded":"2024-09-11T23:23:09.422878+0000","last_fullsized":"2024-09-11T23:23:09.422878+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:05.662838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.408647+0000","last_change":"2024-09-11T23:23:09.406388+0000","last_active":"2024-09-11T23:23:09.408647+0000","last_peered":"2024-09-11T23:23:09.408647+0000","last_clean":"2024-09-11T23:23:09.408647+0000","last_became_active":"2024-09-11T23:23:09.406052+0000","last_became_peered":"2024-09-11T23:23:09.406052+0000","last_unstale":"2024-09-11T23:23:09.408647+0000","last_undegraded":"2024-09-11T23:23:09.408647+0000","last_fullsized":"2024-09-11T23:23:09.408647+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:58.144776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.415361+0000","last_change":"2024-09-11T23:23:09.411678+0000","last_active":"2024-09-11T23:23:09.415361+0000","last_peered":"2024-09-11T23:23:09.415361+0000","last_clean":"2024-09-11T23:23:09.415361+0000","last_became_active":"2024-09-11T23:23:09.410615+0000","last_became_peered":"2024-09-11T23:23:09.410615+0000","last_unstale":"2024-09-11T23:23:09.415361+0000","last_undegraded":"2024-09-11T23:23:09.415361+0000","last_fullsized":"2024-09-11T23:23:09.415361+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:34.050183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.420647+0000","last_change":"2024-09-11T23:23:09.412197+0000","last_active":"2024-09-11T23:23:09.420647+0000","last_peered":"2024-09-11T23:23:09.420647+0000","last_clean":"2024-09-11T23:23:09.420647+0000","last_became_active":"2024-09-11T23:23:09.411865+0000","last_became_peered":"2024-09-11T23:23:09.411865+0000","last_unstale":"2024-09-11T23:23:09.420647+0000","last_undegraded":"2024-09-11T23:23:09.420647+0000","last_fullsized":"2024-09-11T23:23:09.420647+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:56.410266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.426585+0000","last_change":"2024-09-11T23:23:09.425150+0000","last_active":"2024-09-11T23:23:09.426585+0000","last_peered":"2024-09-11T23:23:09.426585+0000","last_clean":"2024-09-11T23:23:09.426585+0000","last_became_active":"2024-09-11T23:23:09.421469+0000","last_became_peered":"2024-09-11T23:23:09.421469+0000","last_unstale":"2024-09-11T23:23:09.426585+0000","last_undegraded":"2024-09-11T23:23:09.426585+0000","last_fullsized":"2024-09-11T23:23:09.426585+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:50.050588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.402551+0000","last_change":"2024-09-11T23:23:09.400761+0000","last_active":"2024-09-11T23:23:10.402551+0000","last_peered":"2024-09-11T23:23:10.402551+0000","last_clean":"2024-09-11T23:23:10.402551+0000","last_became_active":"2024-09-11T23:23:09.400480+0000","last_became_peered":"2024-09-11T23:23:09.400480+0000","last_unstale":"2024-09-11T23:23:10.402551+0000","last_undegraded":"2024-09-11T23:23:10.402551+0000","last_fullsized":"2024-09-11T23:23:10.402551+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:39.238324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.405037+0000","last_change":"2024-09-11T23:23:09.408611+0000","last_active":"2024-09-11T23:23:10.405037+0000","last_peered":"2024-09-11T23:23:10.405037+0000","last_clean":"2024-09-11T23:23:10.405037+0000","last_became_active":"2024-09-11T23:23:09.408353+0000","last_became_peered":"2024-09-11T23:23:09.408353+0000","last_unstale":"2024-09-11T23:23:10.405037+0000","last_undegraded":"2024-09-11T23:23:10.405037+0000","last_fullsized":"2024-09-11T23:23:10.405037+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:20.343496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.415694+0000","last_change":"2024-09-11T23:23:09.412561+0000","last_active":"2024-09-11T23:23:09.415694+0000","last_peered":"2024-09-11T23:23:09.415694+0000","last_clean":"2024-09-11T23:23:09.415694+0000","last_became_active":"2024-09-11T23:23:09.412280+0000","last_became_peered":"2024-09-11T23:23:09.412280+0000","last_unstale":"2024-09-11T23:23:09.415694+0000","last_undegraded":"2024-09-11T23:23:09.415694+0000","last_fullsized":"2024-09-11T23:23:09.415694+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:39.238324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.402334+0000","last_change":"2024-09-11T23:23:09.408745+0000","last_active":"2024-09-11T23:23:10.402334+0000","last_peered":"2024-09-11T23:23:10.402334+0000","last_clean":"2024-09-11T23:23:10.402334+0000","last_became_active":"2024-09-11T23:23:09.408467+0000","last_became_peered":"2024-09-11T23:23:09.408467+0000","last_unstale":"2024-09-11T23:23:10.402334+0000","last_undegraded":"2024-09-11T23:23:10.402334+0000","last_fullsized":"2024-09-11T23:23:10.402334+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:22.413082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.402245+0000","last_change":"2024-09-11T23:23:09.400568+0000","last_active":"2024-09-11T23:23:10.402245+0000","last_peered":"2024-09-11T23:23:10.402245+0000","last_clean":"2024-09-11T23:23:10.402245+0000","last_became_active":"2024-09-11T23:23:09.400267+0000","last_became_peered":"2024-09-11T23:23:09.400267+0000","last_unstale":"2024-09-11T23:23:10.402245+0000","last_undegraded":"2024-09-11T23:23:10.402245+0000","last_fullsized":"2024-09-11T23:23:10.402245+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:22.089509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.405709+0000","last_change":"2024-09-11T23:23:09.399850+0000","last_active":"2024-09-11T23:23:09.405709+0000","last_peered":"2024-09-11T23:23:09.405709+0000","last_clean":"2024-09-11T23:23:09.405709+0000","last_became_active":"2024-09-11T23:23:09.399558+0000","last_became_peered":"2024-09-11T23:23:09.399558+0000","last_unstale":"2024-09-11T23:23:09.405709+0000","last_undegraded":"2024-09-11T23:23:09.405709+0000","last_fullsized":"2024-09-11T23:23:09.405709+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:37.642266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.400708+0000","last_change":"2024-09-11T23:23:09.394788+0000","last_active":"2024-09-11T23:23:10.400708+0000","last_peered":"2024-09-11T23:23:10.400708+0000","last_clean":"2024-09-11T23:23:10.400708+0000","last_became_active":"2024-09-11T23:23:09.394527+0000","last_became_peered":"2024-09-11T23:23:09.394527+0000","last_unstale":"2024-09-11T23:23:10.400708+0000","last_undegraded":"2024-09-11T23:23:10.400708+0000","last_fullsized":"2024-09-11T23:23:10.400708+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:45.525065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.415559+0000","last_change":"2024-09-11T23:23:09.410179+0000","last_active":"2024-09-11T23:23:09.415559+0000","last_peered":"2024-09-11T23:23:09.415559+0000","last_clean":"2024-09-11T23:23:09.415559+0000","last_became_active":"2024-09-11T23:23:09.409953+0000","last_became_peered":"2024-09-11T23:23:09.409953+0000","last_unstale":"2024-09-11T23:23:09.415559+0000","last_undegraded":"2024-09-11T23:23:09.415559+0000","last_fullsized":"2024-09-11T23:23:09.415559+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:54.522583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.402614+0000","last_change":"2024-09-11T23:23:09.402167+0000","last_active":"2024-09-11T23:23:10.402614+0000","last_peered":"2024-09-11T23:23:10.402614+0000","last_clean":"2024-09-11T23:23:10.402614+0000","last_became_active":"2024-09-11T23:23:09.400710+0000","last_became_peered":"2024-09-11T23:23:09.400710+0000","last_unstale":"2024-09-11T23:23:10.402614+0000","last_undegraded":"2024-09-11T23:23:10.402614+0000","last_fullsized":"2024-09-11T23:23:10.402614+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:37.934590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.421340+0000","last_change":"2024-09-11T23:23:09.420438+0000","last_active":"2024-09-11T23:23:09.421340+0000","last_peered":"2024-09-11T23:23:09.421340+0000","last_clean":"2024-09-11T23:23:09.421340+0000","last_became_active":"2024-09-11T23:23:09.420050+0000","last_became_peered":"2024-09-11T23:23:09.420050+0000","last_unstale":"2024-09-11T23:23:09.421340+0000","last_undegraded":"2024-09-11T23:23:09.421340+0000","last_fullsized":"2024-09-11T23:23:09.421340+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:59.285549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.421531+0000","last_change":"2024-09-11T23:23:09.416225+0000","last_active":"2024-09-11T23:23:09.421531+0000","last_peered":"2024-09-11T23:23:09.421531+0000","last_clean":"2024-09-11T23:23:09.421531+0000","last_became_active":"2024-09-11T23:23:09.416048+0000","last_became_peered":"2024-09-11T23:23:09.416048+0000","last_unstale":"2024-09-11T23:23:09.421531+0000","last_undegraded":"2024-09-11T23:23:09.421531+0000","last_fullsized":"2024-09-11T23:23:09.421531+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:09.236361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.415873+0000","last_change":"2024-09-11T23:23:09.407776+0000","last_active":"2024-09-11T23:23:09.415873+0000","last_peered":"2024-09-11T23:23:09.415873+0000","last_clean":"2024-09-11T23:23:09.415873+0000","last_became_active":"2024-09-11T23:23:09.407402+0000","last_became_peered":"2024-09-11T23:23:09.407402+0000","last_unstale":"2024-09-11T23:23:09.415873+0000","last_undegraded":"2024-09-11T23:23:09.415873+0000","last_fullsized":"2024-09-11T23:23:09.415873+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:42.105321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.400983+0000","last_change":"2024-09-11T23:23:09.408523+0000","last_active":"2024-09-11T23:23:10.400983+0000","last_peered":"2024-09-11T23:23:10.400983+0000","last_clean":"2024-09-11T23:23:10.400983+0000","last_became_active":"2024-09-11T23:23:09.407397+0000","last_became_peered":"2024-09-11T23:23:09.407397+0000","last_unstale":"2024-09-11T23:23:10.400983+0000","last_undegraded":"2024-09-11T23:23:10.400983+0000","last_fullsized":"2024-09-11T23:23:10.400983+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:18.522193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401082+0000","last_change":"2024-09-11T23:23:09.395351+0000","last_active":"2024-09-11T23:23:10.401082+0000","last_peered":"2024-09-11T23:23:10.401082+0000","last_clean":"2024-09-11T23:23:10.401082+0000","last_became_active":"2024-09-11T23:23:09.393958+0000","last_became_peered":"2024-09-11T23:23:09.393958+0000","last_unstale":"2024-09-11T23:23:10.401082+0000","last_undegraded":"2024-09-11T23:23:10.401082+0000","last_fullsized":"2024-09-11T23:23:10.401082+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:35.086272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.408310+0000","last_change":"2024-09-11T23:23:09.398939+0000","last_active":"2024-09-11T23:23:09.408310+0000","last_peered":"2024-09-11T23:23:09.408310+0000","last_clean":"2024-09-11T23:23:09.408310+0000","last_became_active":"2024-09-11T23:23:09.398664+0000","last_became_peered":"2024-09-11T23:23:09.398664+0000","last_unstale":"2024-09-11T23:23:09.408310+0000","last_undegraded":"2024-09-11T23:23:09.408310+0000","last_fullsized":"2024-09-11T23:23:09.408310+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:57.832016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.416594+0000","last_change":"2024-09-11T23:23:09.412882+0000","last_active":"2024-09-11T23:23:09.416594+0000","last_peered":"2024-09-11T23:23:09.416594+0000","last_clean":"2024-09-11T23:23:09.416594+0000","last_became_active":"2024-09-11T23:23:09.411919+0000","last_became_peered":"2024-09-11T23:23:09.411919+0000","last_unstale":"2024-09-11T23:23:09.416594+0000","last_undegraded":"2024-09-11T23:23:09.416594+0000","last_fullsized":"2024-09-11T23:23:09.416594+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:51.376840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.408675+0000","last_change":"2024-09-11T23:23:09.403977+0000","last_active":"2024-09-11T23:23:09.408675+0000","last_peered":"2024-09-11T23:23:09.408675+0000","last_clean":"2024-09-11T23:23:09.408675+0000","last_became_active":"2024-09-11T23:23:09.403711+0000","last_became_peered":"2024-09-11T23:23:09.403711+0000","last_unstale":"2024-09-11T23:23:09.408675+0000","last_undegraded":"2024-09-11T23:23:09.408675+0000","last_fullsized":"2024-09-11T23:23:09.408675+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:44.426410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"100'4","reported_seq":18,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401159+0000","last_change":"2024-09-11T23:23:08.385819+0000","last_active":"2024-09-11T23:23:10.401159+0000","last_peered":"2024-09-11T23:23:10.401159+0000","last_clean":"2024-09-11T23:23:10.401159+0000","last_became_active":"2024-09-11T23:23:08.384712+0000","last_became_peered":"2024-09-11T23:23:08.384712+0000","last_unstale":"2024-09-11T23:23:10.401159+0000","last_undegraded":"2024-09-11T23:23:10.401159+0000","last_fullsized":"2024-09-11T23:23:10.401159+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:06.233990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.405191+0000","last_change":"2024-09-11T23:23:09.409850+0000","last_active":"2024-09-11T23:23:10.405191+0000","last_peered":"2024-09-11T23:23:10.405191+0000","last_clean":"2024-09-11T23:23:10.405191+0000","last_became_active":"2024-09-11T23:23:09.409489+0000","last_became_peered":"2024-09-11T23:23:09.409489+0000","last_unstale":"2024-09-11T23:23:10.405191+0000","last_undegraded":"2024-09-11T23:23:10.405191+0000","last_fullsized":"2024-09-11T23:23:10.405191+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:22.413082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"100'1","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.417907+0000","last_change":"2024-09-11T23:23:08.390546+0000","last_active":"2024-09-11T23:23:09.417907+0000","last_peered":"2024-09-11T23:23:09.417907+0000","last_clean":"2024-09-11T23:23:09.417907+0000","last_became_active":"2024-09-11T23:23:08.390201+0000","last_became_peered":"2024-09-11T23:23:08.390201+0000","last_unstale":"2024-09-11T23:23:09.417907+0000","last_undegraded":"2024-09-11T23:23:09.417907+0000","last_fullsized":"2024-09-11T23:23:09.417907+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:44.517647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.415720+0000","last_change":"2024-09-11T23:23:09.410915+0000","last_active":"2024-09-11T23:23:09.415720+0000","last_peered":"2024-09-11T23:23:09.415720+0000","last_clean":"2024-09-11T23:23:09.415720+0000","last_became_active":"2024-09-11T23:23:09.410566+0000","last_became_peered":"2024-09-11T23:23:09.410566+0000","last_unstale":"2024-09-11T23:23:09.415720+0000","last_undegraded":"2024-09-11T23:23:09.415720+0000","last_fullsized":"2024-09-11T23:23:09.415720+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:28.820566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.399533+0000","last_change":"2024-09-11T23:23:08.392793+0000","last_active":"2024-09-11T23:23:10.399533+0000","last_peered":"2024-09-11T23:23:10.399533+0000","last_clean":"2024-09-11T23:23:10.399533+0000","last_became_active":"2024-09-11T23:23:08.392533+0000","last_became_peered":"2024-09-11T23:23:08.392533+0000","last_unstale":"2024-09-11T23:23:10.399533+0000","last_undegraded":"2024-09-11T23:23:10.399533+0000","last_fullsized":"2024-09-11T23:23:10.399533+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:22.866202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.414895+0000","last_change":"2024-09-11T23:23:09.410909+0000","last_active":"2024-09-11T23:23:09.414895+0000","last_peered":"2024-09-11T23:23:09.414895+0000","last_clean":"2024-09-11T23:23:09.414895+0000","last_became_active":"2024-09-11T23:23:09.409616+0000","last_became_peered":"2024-09-11T23:23:09.409616+0000","last_unstale":"2024-09-11T23:23:09.414895+0000","last_undegraded":"2024-09-11T23:23:09.414895+0000","last_fullsized":"2024-09-11T23:23:09.414895+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:22.089509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.399618+0000","last_change":"2024-09-11T23:23:08.392513+0000","last_active":"2024-09-11T23:23:10.399618+0000","last_peered":"2024-09-11T23:23:10.399618+0000","last_clean":"2024-09-11T23:23:10.399618+0000","last_became_active":"2024-09-11T23:23:08.392254+0000","last_became_peered":"2024-09-11T23:23:08.392254+0000","last_unstale":"2024-09-11T23:23:10.399618+0000","last_undegraded":"2024-09-11T23:23:10.399618+0000","last_fullsized":"2024-09-11T23:23:10.399618+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:49.753777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.408273+0000","last_change":"2024-09-11T23:23:09.400497+0000","last_active":"2024-09-11T23:23:09.408273+0000","last_peered":"2024-09-11T23:23:09.408273+0000","last_clean":"2024-09-11T23:23:09.408273+0000","last_became_active":"2024-09-11T23:23:09.400223+0000","last_became_peered":"2024-09-11T23:23:09.400223+0000","last_unstale":"2024-09-11T23:23:09.408273+0000","last_undegraded":"2024-09-11T23:23:09.408273+0000","last_fullsized":"2024-09-11T23:23:09.408273+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:51.664449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401256+0000","last_change":"2024-09-11T23:23:08.388218+0000","last_active":"2024-09-11T23:23:10.401256+0000","last_peered":"2024-09-11T23:23:10.401256+0000","last_clean":"2024-09-11T23:23:10.401256+0000","last_became_active":"2024-09-11T23:23:08.387878+0000","last_became_peered":"2024-09-11T23:23:08.387878+0000","last_unstale":"2024-09-11T23:23:10.401256+0000","last_undegraded":"2024-09-11T23:23:10.401256+0000","last_fullsized":"2024-09-11T23:23:10.401256+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:31.448265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401132+0000","last_change":"2024-09-11T23:23:09.404698+0000","last_active":"2024-09-11T23:23:10.401132+0000","last_peered":"2024-09-11T23:23:10.401132+0000","last_clean":"2024-09-11T23:23:10.401132+0000","last_became_active":"2024-09-11T23:23:09.403698+0000","last_became_peered":"2024-09-11T23:23:09.403698+0000","last_unstale":"2024-09-11T23:23:10.401132+0000","last_undegraded":"2024-09-11T23:23:10.401132+0000","last_fullsized":"2024-09-11T23:23:10.401132+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:58.144776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"100'1","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.421767+0000","last_change":"2024-09-11T23:23:08.391778+0000","last_active":"2024-09-11T23:23:09.421767+0000","last_peered":"2024-09-11T23:23:09.421767+0000","last_clean":"2024-09-11T23:23:09.421767+0000","last_became_active":"2024-09-11T23:23:08.391483+0000","last_became_peered":"2024-09-11T23:23:08.391483+0000","last_unstale":"2024-09-11T23:23:09.421767+0000","last_undegraded":"2024-09-11T23:23:09.421767+0000","last_fullsized":"2024-09-11T23:23:09.421767+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:51.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.412488+0000","last_change":"2024-09-11T23:23:09.408662+0000","last_active":"2024-09-11T23:23:09.412488+0000","last_peered":"2024-09-11T23:23:09.412488+0000","last_clean":"2024-09-11T23:23:09.412488+0000","last_became_active":"2024-09-11T23:23:09.401546+0000","last_became_peered":"2024-09-11T23:23:09.401546+0000","last_unstale":"2024-09-11T23:23:09.412488+0000","last_undegraded":"2024-09-11T23:23:09.412488+0000","last_fullsized":"2024-09-11T23:23:09.412488+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:46.547077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.400914+0000","last_change":"2024-09-11T23:23:08.383017+0000","last_active":"2024-09-11T23:23:10.400914+0000","last_peered":"2024-09-11T23:23:10.400914+0000","last_clean":"2024-09-11T23:23:10.400914+0000","last_became_active":"2024-09-11T23:23:08.382707+0000","last_became_peered":"2024-09-11T23:23:08.382707+0000","last_unstale":"2024-09-11T23:23:10.400914+0000","last_undegraded":"2024-09-11T23:23:10.400914+0000","last_fullsized":"2024-09-11T23:23:10.400914+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:15.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.400841+0000","last_change":"2024-09-11T23:23:09.402569+0000","last_active":"2024-09-11T23:23:10.400841+0000","last_peered":"2024-09-11T23:23:10.400841+0000","last_clean":"2024-09-11T23:23:10.400841+0000","last_became_active":"2024-09-11T23:23:09.402288+0000","last_became_peered":"2024-09-11T23:23:09.402288+0000","last_unstale":"2024-09-11T23:23:10.400841+0000","last_undegraded":"2024-09-11T23:23:10.400841+0000","last_fullsized":"2024-09-11T23:23:10.400841+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:58.144776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.392956+0000","last_change":"2024-09-11T23:23:08.391034+0000","last_active":"2024-09-11T23:23:09.392956+0000","last_peered":"2024-09-11T23:23:09.392956+0000","last_clean":"2024-09-11T23:23:09.392956+0000","last_became_active":"2024-09-11T23:23:08.390674+0000","last_became_peered":"2024-09-11T23:23:08.390674+0000","last_unstale":"2024-09-11T23:23:09.392956+0000","last_undegraded":"2024-09-11T23:23:09.392956+0000","last_fullsized":"2024-09-11T23:23:09.392956+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:25.843025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401279+0000","last_change":"2024-09-11T23:23:09.403790+0000","last_active":"2024-09-11T23:23:10.401279+0000","last_peered":"2024-09-11T23:23:10.401279+0000","last_clean":"2024-09-11T23:23:10.401279+0000","last_became_active":"2024-09-11T23:23:09.403066+0000","last_became_peered":"2024-09-11T23:23:09.403066+0000","last_unstale":"2024-09-11T23:23:10.401279+0000","last_undegraded":"2024-09-11T23:23:10.401279+0000","last_fullsized":"2024-09-11T23:23:10.401279+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:22.089509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.399685+0000","last_change":"2024-09-11T23:23:08.391533+0000","last_active":"2024-09-11T23:23:10.399685+0000","last_peered":"2024-09-11T23:23:10.399685+0000","last_clean":"2024-09-11T23:23:10.399685+0000","last_became_active":"2024-09-11T23:23:08.391254+0000","last_became_peered":"2024-09-11T23:23:08.391254+0000","last_unstale":"2024-09-11T23:23:10.399685+0000","last_undegraded":"2024-09-11T23:23:10.399685+0000","last_fullsized":"2024-09-11T23:23:10.399685+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:56.344144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.405230+0000","last_change":"2024-09-11T23:23:09.406394+0000","last_active":"2024-09-11T23:23:10.405230+0000","last_peered":"2024-09-11T23:23:10.405230+0000","last_clean":"2024-09-11T23:23:10.405230+0000","last_became_active":"2024-09-11T23:23:09.406090+0000","last_became_peered":"2024-09-11T23:23:09.406090+0000","last_unstale":"2024-09-11T23:23:10.405230+0000","last_undegraded":"2024-09-11T23:23:10.405230+0000","last_fullsized":"2024-09-11T23:23:10.405230+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:34.050183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.386577+0000","last_change":"2024-09-11T23:23:08.394424+0000","last_active":"2024-09-11T23:23:09.386577+0000","last_peered":"2024-09-11T23:23:09.386577+0000","last_clean":"2024-09-11T23:23:09.386577+0000","last_became_active":"2024-09-11T23:23:08.394122+0000","last_became_peered":"2024-09-11T23:23:08.394122+0000","last_unstale":"2024-09-11T23:23:09.386577+0000","last_undegraded":"2024-09-11T23:23:09.386577+0000","last_fullsized":"2024-09-11T23:23:09.386577+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:50.510840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.405572+0000","last_change":"2024-09-11T23:23:09.397206+0000","last_active":"2024-09-11T23:23:09.405572+0000","last_peered":"2024-09-11T23:23:09.405572+0000","last_clean":"2024-09-11T23:23:09.405572+0000","last_became_active":"2024-09-11T23:23:09.396892+0000","last_became_peered":"2024-09-11T23:23:09.396892+0000","last_unstale":"2024-09-11T23:23:09.405572+0000","last_undegraded":"2024-09-11T23:23:09.405572+0000","last_fullsized":"2024-09-11T23:23:09.405572+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:04.508401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"100'3","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.430247+0000","last_change":"2024-09-11T23:23:08.398678+0000","last_active":"2024-09-11T23:23:09.430247+0000","last_peered":"2024-09-11T23:23:09.430247+0000","last_clean":"2024-09-11T23:23:09.430247+0000","last_became_active":"2024-09-11T23:23:08.398241+0000","last_became_peered":"2024-09-11T23:23:08.398241+0000","last_unstale":"2024-09-11T23:23:09.430247+0000","last_undegraded":"2024-09-11T23:23:09.430247+0000","last_fullsized":"2024-09-11T23:23:09.430247+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:57.849160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401389+0000","last_change":"2024-09-11T23:23:09.408227+0000","last_active":"2024-09-11T23:23:10.401389+0000","last_peered":"2024-09-11T23:23:10.401389+0000","last_clean":"2024-09-11T23:23:10.401389+0000","last_became_active":"2024-09-11T23:23:09.407964+0000","last_became_peered":"2024-09-11T23:23:09.407964+0000","last_unstale":"2024-09-11T23:23:10.401389+0000","last_undegraded":"2024-09-11T23:23:10.401389+0000","last_fullsized":"2024-09-11T23:23:10.401389+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:22.413082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"100'6","reported_seq":18,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.432929+0000","last_change":"2024-09-11T23:23:08.400397+0000","last_active":"2024-09-11T23:23:09.432929+0000","last_peered":"2024-09-11T23:23:09.432929+0000","last_clean":"2024-09-11T23:23:09.432929+0000","last_became_active":"2024-09-11T23:23:08.400169+0000","last_became_peered":"2024-09-11T23:23:08.400169+0000","last_unstale":"2024-09-11T23:23:09.432929+0000","last_undegraded":"2024-09-11T23:23:09.432929+0000","last_fullsized":"2024-09-11T23:23:09.432929+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:29.673416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.405686+0000","last_change":"2024-09-11T23:23:09.398297+0000","last_active":"2024-09-11T23:23:09.405686+0000","last_peered":"2024-09-11T23:23:09.405686+0000","last_clean":"2024-09-11T23:23:09.405686+0000","last_became_active":"2024-09-11T23:23:09.396798+0000","last_became_peered":"2024-09-11T23:23:09.396798+0000","last_unstale":"2024-09-11T23:23:09.405686+0000","last_undegraded":"2024-09-11T23:23:09.405686+0000","last_fullsized":"2024-09-11T23:23:09.405686+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:02.154638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"100'2","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.425508+0000","last_change":"2024-09-11T23:23:08.389027+0000","last_active":"2024-09-11T23:23:09.425508+0000","last_peered":"2024-09-11T23:23:09.425508+0000","last_clean":"2024-09-11T23:23:09.425508+0000","last_became_active":"2024-09-11T23:23:08.388782+0000","last_became_peered":"2024-09-11T23:23:08.388782+0000","last_unstale":"2024-09-11T23:23:09.425508+0000","last_undegraded":"2024-09-11T23:23:09.425508+0000","last_fullsized":"2024-09-11T23:23:09.425508+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:26.430667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.416979+0000","last_change":"2024-09-11T23:23:09.410005+0000","last_active":"2024-09-11T23:23:09.416979+0000","last_peered":"2024-09-11T23:23:09.416979+0000","last_clean":"2024-09-11T23:23:09.416979+0000","last_became_active":"2024-09-11T23:23:09.409765+0000","last_became_peered":"2024-09-11T23:23:09.409765+0000","last_unstale":"2024-09-11T23:23:09.416979+0000","last_undegraded":"2024-09-11T23:23:09.416979+0000","last_fullsized":"2024-09-11T23:23:09.416979+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:04.247286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.404901+0000","last_change":"2024-09-11T23:23:08.394944+0000","last_active":"2024-09-11T23:23:10.404901+0000","last_peered":"2024-09-11T23:23:10.404901+0000","last_clean":"2024-09-11T23:23:10.404901+0000","last_became_active":"2024-09-11T23:23:08.394718+0000","last_became_peered":"2024-09-11T23:23:08.394718+0000","last_unstale":"2024-09-11T23:23:10.404901+0000","last_undegraded":"2024-09-11T23:23:10.404901+0000","last_fullsized":"2024-09-11T23:23:10.404901+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:31.448265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.405856+0000","last_change":"2024-09-11T23:23:09.401028+0000","last_active":"2024-09-11T23:23:09.405856+0000","last_peered":"2024-09-11T23:23:09.405856+0000","last_clean":"2024-09-11T23:23:09.405856+0000","last_became_active":"2024-09-11T23:23:09.399529+0000","last_became_peered":"2024-09-11T23:23:09.399529+0000","last_unstale":"2024-09-11T23:23:09.405856+0000","last_undegraded":"2024-09-11T23:23:09.405856+0000","last_fullsized":"2024-09-11T23:23:09.405856+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:29.063561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"100'8","reported_seq":22,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.399318+0000","last_change":"2024-09-11T23:23:08.396609+0000","last_active":"2024-09-11T23:23:10.399318+0000","last_peered":"2024-09-11T23:23:10.399318+0000","last_clean":"2024-09-11T23:23:10.399318+0000","last_became_active":"2024-09-11T23:23:08.396326+0000","last_became_peered":"2024-09-11T23:23:08.396326+0000","last_unstale":"2024-09-11T23:23:10.399318+0000","last_undegraded":"2024-09-11T23:23:10.399318+0000","last_fullsized":"2024-09-11T23:23:10.399318+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:38.183162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.399781+0000","last_change":"2024-09-11T23:23:09.419168+0000","last_active":"2024-09-11T23:23:10.399781+0000","last_peered":"2024-09-11T23:23:10.399781+0000","last_clean":"2024-09-11T23:23:10.399781+0000","last_became_active":"2024-09-11T23:23:09.418877+0000","last_became_peered":"2024-09-11T23:23:09.418877+0000","last_unstale":"2024-09-11T23:23:10.399781+0000","last_undegraded":"2024-09-11T23:23:10.399781+0000","last_fullsized":"2024-09-11T23:23:10.399781+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:19.001787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"100'1","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.429848+0000","last_change":"2024-09-11T23:23:08.398543+0000","last_active":"2024-09-11T23:23:09.429848+0000","last_peered":"2024-09-11T23:23:09.429848+0000","last_clean":"2024-09-11T23:23:09.429848+0000","last_became_active":"2024-09-11T23:23:08.398275+0000","last_became_peered":"2024-09-11T23:23:08.398275+0000","last_unstale":"2024-09-11T23:23:09.429848+0000","last_undegraded":"2024-09-11T23:23:09.429848+0000","last_fullsized":"2024-09-11T23:23:09.429848+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:06.599485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.422456+0000","last_change":"2024-09-11T23:23:09.417528+0000","last_active":"2024-09-11T23:23:09.422456+0000","last_peered":"2024-09-11T23:23:09.422456+0000","last_clean":"2024-09-11T23:23:09.422456+0000","last_became_active":"2024-09-11T23:23:09.417282+0000","last_became_peered":"2024-09-11T23:23:09.417282+0000","last_unstale":"2024-09-11T23:23:09.422456+0000","last_undegraded":"2024-09-11T23:23:09.422456+0000","last_fullsized":"2024-09-11T23:23:09.422456+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:40.635481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.399756+0000","last_change":"2024-09-11T23:23:08.388611+0000","last_active":"2024-09-11T23:23:10.399756+0000","last_peered":"2024-09-11T23:23:10.399756+0000","last_clean":"2024-09-11T23:23:10.399756+0000","last_became_active":"2024-09-11T23:23:08.388321+0000","last_became_peered":"2024-09-11T23:23:08.388321+0000","last_unstale":"2024-09-11T23:23:10.399756+0000","last_undegraded":"2024-09-11T23:23:10.399756+0000","last_fullsized":"2024-09-11T23:23:10.399756+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:51.496122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.423827+0000","last_change":"2024-09-11T23:23:09.422676+0000","last_active":"2024-09-11T23:23:09.423827+0000","last_peered":"2024-09-11T23:23:09.423827+0000","last_clean":"2024-09-11T23:23:09.423827+0000","last_became_active":"2024-09-11T23:23:09.422266+0000","last_became_peered":"2024-09-11T23:23:09.422266+0000","last_unstale":"2024-09-11T23:23:09.423827+0000","last_undegraded":"2024-09-11T23:23:09.423827+0000","last_fullsized":"2024-09-11T23:23:09.423827+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:17.223210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.405029+0000","last_change":"2024-09-11T23:23:08.390543+0000","last_active":"2024-09-11T23:23:10.405029+0000","last_peered":"2024-09-11T23:23:10.405029+0000","last_clean":"2024-09-11T23:23:10.405029+0000","last_became_active":"2024-09-11T23:23:08.389804+0000","last_became_peered":"2024-09-11T23:23:08.389804+0000","last_unstale":"2024-09-11T23:23:10.405029+0000","last_undegraded":"2024-09-11T23:23:10.405029+0000","last_fullsized":"2024-09-11T23:23:10.405029+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:11.776200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.415092+0000","last_change":"2024-09-11T23:23:09.411190+0000","last_active":"2024-09-11T23:23:09.415092+0000","last_peered":"2024-09-11T23:23:09.415092+0000","last_clean":"2024-09-11T23:23:09.415092+0000","last_became_active":"2024-09-11T23:23:09.409956+0000","last_became_peered":"2024-09-11T23:23:09.409956+0000","last_unstale":"2024-09-11T23:23:09.415092+0000","last_undegraded":"2024-09-11T23:23:09.415092+0000","last_fullsized":"2024-09-11T23:23:09.415092+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:22.413082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.400779+0000","last_change":"2024-09-11T23:23:08.398642+0000","last_active":"2024-09-11T23:23:10.400779+0000","last_peered":"2024-09-11T23:23:10.400779+0000","last_clean":"2024-09-11T23:23:10.400779+0000","last_became_active":"2024-09-11T23:23:08.398362+0000","last_became_peered":"2024-09-11T23:23:08.398362+0000","last_unstale":"2024-09-11T23:23:10.400779+0000","last_undegraded":"2024-09-11T23:23:10.400779+0000","last_fullsized":"2024-09-11T23:23:10.400779+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:19.516671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.408165+0000","last_change":"2024-09-11T23:23:09.406331+0000","last_active":"2024-09-11T23:23:09.408165+0000","last_peered":"2024-09-11T23:23:09.408165+0000","last_clean":"2024-09-11T23:23:09.408165+0000","last_became_active":"2024-09-11T23:23:09.405966+0000","last_became_peered":"2024-09-11T23:23:09.405966+0000","last_unstale":"2024-09-11T23:23:09.408165+0000","last_undegraded":"2024-09-11T23:23:09.408165+0000","last_fullsized":"2024-09-11T23:23:09.408165+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:18.522193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"100'2","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.424877+0000","last_change":"2024-09-11T23:23:08.393149+0000","last_active":"2024-09-11T23:23:09.424877+0000","last_peered":"2024-09-11T23:23:09.424877+0000","last_clean":"2024-09-11T23:23:09.424877+0000","last_became_active":"2024-09-11T23:23:08.392893+0000","last_became_peered":"2024-09-11T23:23:08.392893+0000","last_unstale":"2024-09-11T23:23:09.424877+0000","last_undegraded":"2024-09-11T23:23:09.424877+0000","last_fullsized":"2024-09-11T23:23:09.424877+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:24.183231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.424486+0000","last_change":"2024-09-11T23:23:09.422801+0000","last_active":"2024-09-11T23:23:09.424486+0000","last_peered":"2024-09-11T23:23:09.424486+0000","last_clean":"2024-09-11T23:23:09.424486+0000","last_became_active":"2024-09-11T23:23:09.422553+0000","last_became_peered":"2024-09-11T23:23:09.422553+0000","last_unstale":"2024-09-11T23:23:09.424486+0000","last_undegraded":"2024-09-11T23:23:09.424486+0000","last_fullsized":"2024-09-11T23:23:09.424486+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:32.383703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.399297+0000","last_change":"2024-09-11T23:23:08.393237+0000","last_active":"2024-09-11T23:23:10.399297+0000","last_peered":"2024-09-11T23:23:10.399297+0000","last_clean":"2024-09-11T23:23:10.399297+0000","last_became_active":"2024-09-11T23:23:08.392972+0000","last_became_peered":"2024-09-11T23:23:08.392972+0000","last_unstale":"2024-09-11T23:23:10.399297+0000","last_undegraded":"2024-09-11T23:23:10.399297+0000","last_fullsized":"2024-09-11T23:23:10.399297+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:57.505104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.414824+0000","last_change":"2024-09-11T23:23:09.410239+0000","last_active":"2024-09-11T23:23:09.414824+0000","last_peered":"2024-09-11T23:23:09.414824+0000","last_clean":"2024-09-11T23:23:09.414824+0000","last_became_active":"2024-09-11T23:23:09.409766+0000","last_became_peered":"2024-09-11T23:23:09.409766+0000","last_unstale":"2024-09-11T23:23:09.414824+0000","last_undegraded":"2024-09-11T23:23:09.414824+0000","last_fullsized":"2024-09-11T23:23:09.414824+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:35.086272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.399335+0000","last_change":"2024-09-11T23:23:08.388912+0000","last_active":"2024-09-11T23:23:09.399335+0000","last_peered":"2024-09-11T23:23:09.399335+0000","last_clean":"2024-09-11T23:23:09.399335+0000","last_became_active":"2024-09-11T23:23:08.388225+0000","last_became_peered":"2024-09-11T23:23:08.388225+0000","last_unstale":"2024-09-11T23:23:09.399335+0000","last_undegraded":"2024-09-11T23:23:09.399335+0000","last_fullsized":"2024-09-11T23:23:09.399335+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:11.242376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.405725+0000","last_change":"2024-09-11T23:23:09.400433+0000","last_active":"2024-09-11T23:23:09.405725+0000","last_peered":"2024-09-11T23:23:09.405725+0000","last_clean":"2024-09-11T23:23:09.405725+0000","last_became_active":"2024-09-11T23:23:09.400190+0000","last_became_peered":"2024-09-11T23:23:09.400190+0000","last_unstale":"2024-09-11T23:23:09.405725+0000","last_undegraded":"2024-09-11T23:23:09.405725+0000","last_fullsized":"2024-09-11T23:23:09.405725+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:18.005772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.394538+0000","last_change":"2024-09-11T23:23:08.393546+0000","last_active":"2024-09-11T23:23:09.394538+0000","last_peered":"2024-09-11T23:23:09.394538+0000","last_clean":"2024-09-11T23:23:09.394538+0000","last_became_active":"2024-09-11T23:23:08.393235+0000","last_became_peered":"2024-09-11T23:23:08.393235+0000","last_unstale":"2024-09-11T23:23:09.394538+0000","last_undegraded":"2024-09-11T23:23:09.394538+0000","last_fullsized":"2024-09-11T23:23:09.394538+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:03.120146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.405060+0000","last_change":"2024-09-11T23:23:09.413697+0000","last_active":"2024-09-11T23:23:10.405060+0000","last_peered":"2024-09-11T23:23:10.405060+0000","last_clean":"2024-09-11T23:23:10.405060+0000","last_became_active":"2024-09-11T23:23:09.413243+0000","last_became_peered":"2024-09-11T23:23:09.413243+0000","last_unstale":"2024-09-11T23:23:10.405060+0000","last_undegraded":"2024-09-11T23:23:10.405060+0000","last_fullsized":"2024-09-11T23:23:10.405060+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:22.089509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"100'2","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.430546+0000","last_change":"2024-09-11T23:23:08.399475+0000","last_active":"2024-09-11T23:23:09.430546+0000","last_peered":"2024-09-11T23:23:09.430546+0000","last_clean":"2024-09-11T23:23:09.430546+0000","last_became_active":"2024-09-11T23:23:08.399221+0000","last_became_peered":"2024-09-11T23:23:08.399221+0000","last_unstale":"2024-09-11T23:23:09.430546+0000","last_undegraded":"2024-09-11T23:23:09.430546+0000","last_fullsized":"2024-09-11T23:23:09.430546+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:55.910144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.417830+0000","last_change":"2024-09-11T23:23:09.409198+0000","last_active":"2024-09-11T23:23:09.417830+0000","last_peered":"2024-09-11T23:23:09.417830+0000","last_clean":"2024-09-11T23:23:09.417830+0000","last_became_active":"2024-09-11T23:23:09.408928+0000","last_became_peered":"2024-09-11T23:23:09.408928+0000","last_unstale":"2024-09-11T23:23:09.417830+0000","last_undegraded":"2024-09-11T23:23:09.417830+0000","last_fullsized":"2024-09-11T23:23:09.417830+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:47.307459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"101'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.406687+0000","last_change":"2024-09-11T23:23:08.391407+0000","last_active":"2024-09-11T23:23:10.406687+0000","last_peered":"2024-09-11T23:23:10.406687+0000","last_clean":"2024-09-11T23:23:10.406687+0000","last_became_active":"2024-09-11T23:23:08.391086+0000","last_became_peered":"2024-09-11T23:23:08.391086+0000","last_unstale":"2024-09-11T23:23:10.406687+0000","last_undegraded":"2024-09-11T23:23:10.406687+0000","last_fullsized":"2024-09-11T23:23:10.406687+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:20.797734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.416055+0000","last_change":"2024-09-11T23:23:09.405902+0000","last_active":"2024-09-11T23:23:09.416055+0000","last_peered":"2024-09-11T23:23:09.416055+0000","last_clean":"2024-09-11T23:23:09.416055+0000","last_became_active":"2024-09-11T23:23:09.402931+0000","last_became_peered":"2024-09-11T23:23:09.402931+0000","last_unstale":"2024-09-11T23:23:09.416055+0000","last_undegraded":"2024-09-11T23:23:09.416055+0000","last_fullsized":"2024-09-11T23:23:09.416055+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:56.082680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.396349+0000","last_change":"2024-09-11T23:23:08.391837+0000","last_active":"2024-09-11T23:23:09.396349+0000","last_peered":"2024-09-11T23:23:09.396349+0000","last_clean":"2024-09-11T23:23:09.396349+0000","last_became_active":"2024-09-11T23:23:08.391558+0000","last_became_peered":"2024-09-11T23:23:08.391558+0000","last_unstale":"2024-09-11T23:23:09.396349+0000","last_undegraded":"2024-09-11T23:23:09.396349+0000","last_fullsized":"2024-09-11T23:23:09.396349+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:38.498349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.405053+0000","last_change":"2024-09-11T23:23:09.406948+0000","last_active":"2024-09-11T23:23:10.405053+0000","last_peered":"2024-09-11T23:23:10.405053+0000","last_clean":"2024-09-11T23:23:10.405053+0000","last_became_active":"2024-09-11T23:23:09.406606+0000","last_became_peered":"2024-09-11T23:23:09.406606+0000","last_unstale":"2024-09-11T23:23:10.405053+0000","last_undegraded":"2024-09-11T23:23:10.405053+0000","last_fullsized":"2024-09-11T23:23:10.405053+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:35.086272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.386311+0000","last_change":"2024-09-11T23:23:08.389556+0000","last_active":"2024-09-11T23:23:09.386311+0000","last_peered":"2024-09-11T23:23:09.386311+0000","last_clean":"2024-09-11T23:23:09.386311+0000","last_became_active":"2024-09-11T23:23:08.389266+0000","last_became_peered":"2024-09-11T23:23:08.389266+0000","last_unstale":"2024-09-11T23:23:09.386311+0000","last_undegraded":"2024-09-11T23:23:09.386311+0000","last_fullsized":"2024-09-11T23:23:09.386311+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:20.250006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401306+0000","last_change":"2024-09-11T23:23:09.399569+0000","last_active":"2024-09-11T23:23:10.401306+0000","last_peered":"2024-09-11T23:23:10.401306+0000","last_clean":"2024-09-11T23:23:10.401306+0000","last_became_active":"2024-09-11T23:23:09.399263+0000","last_became_peered":"2024-09-11T23:23:09.399263+0000","last_unstale":"2024-09-11T23:23:10.401306+0000","last_undegraded":"2024-09-11T23:23:10.401306+0000","last_fullsized":"2024-09-11T23:23:10.401306+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:20.343496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401401+0000","last_change":"2024-09-11T23:23:08.386515+0000","last_active":"2024-09-11T23:23:10.401401+0000","last_peered":"2024-09-11T23:23:10.401401+0000","last_clean":"2024-09-11T23:23:10.401401+0000","last_became_active":"2024-09-11T23:23:08.386167+0000","last_became_peered":"2024-09-11T23:23:08.386167+0000","last_unstale":"2024-09-11T23:23:10.401401+0000","last_undegraded":"2024-09-11T23:23:10.401401+0000","last_fullsized":"2024-09-11T23:23:10.401401+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:16.108293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.402106+0000","last_change":"2024-09-11T23:23:09.401753+0000","last_active":"2024-09-11T23:23:10.402106+0000","last_peered":"2024-09-11T23:23:10.402106+0000","last_clean":"2024-09-11T23:23:10.402106+0000","last_became_active":"2024-09-11T23:23:09.401460+0000","last_became_peered":"2024-09-11T23:23:09.401460+0000","last_unstale":"2024-09-11T23:23:10.402106+0000","last_undegraded":"2024-09-11T23:23:10.402106+0000","last_fullsized":"2024-09-11T23:23:10.402106+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:35.086272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401428+0000","last_change":"2024-09-11T23:23:08.390027+0000","last_active":"2024-09-11T23:23:10.401428+0000","last_peered":"2024-09-11T23:23:10.401428+0000","last_clean":"2024-09-11T23:23:10.401428+0000","last_became_active":"2024-09-11T23:23:08.389711+0000","last_became_peered":"2024-09-11T23:23:08.389711+0000","last_unstale":"2024-09-11T23:23:10.401428+0000","last_undegraded":"2024-09-11T23:23:10.401428+0000","last_fullsized":"2024-09-11T23:23:10.401428+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:11.188381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.415749+0000","last_change":"2024-09-11T23:23:09.413070+0000","last_active":"2024-09-11T23:23:09.415749+0000","last_peered":"2024-09-11T23:23:09.415749+0000","last_clean":"2024-09-11T23:23:09.415749+0000","last_became_active":"2024-09-11T23:23:09.411671+0000","last_became_peered":"2024-09-11T23:23:09.411671+0000","last_unstale":"2024-09-11T23:23:09.415749+0000","last_undegraded":"2024-09-11T23:23:09.415749+0000","last_fullsized":"2024-09-11T23:23:09.415749+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:37.934590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.399354+0000","last_change":"2024-09-11T23:23:08.390564+0000","last_active":"2024-09-11T23:23:10.399354+0000","last_peered":"2024-09-11T23:23:10.399354+0000","last_clean":"2024-09-11T23:23:10.399354+0000","last_became_active":"2024-09-11T23:23:08.390291+0000","last_became_peered":"2024-09-11T23:23:08.390291+0000","last_unstale":"2024-09-11T23:23:10.399354+0000","last_undegraded":"2024-09-11T23:23:10.399354+0000","last_fullsized":"2024-09-11T23:23:10.399354+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:24.018239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.408332+0000","last_change":"2024-09-11T23:23:09.401803+0000","last_active":"2024-09-11T23:23:09.408332+0000","last_peered":"2024-09-11T23:23:09.408332+0000","last_clean":"2024-09-11T23:23:09.408332+0000","last_became_active":"2024-09-11T23:23:09.401507+0000","last_became_peered":"2024-09-11T23:23:09.401507+0000","last_unstale":"2024-09-11T23:23:09.408332+0000","last_undegraded":"2024-09-11T23:23:09.408332+0000","last_fullsized":"2024-09-11T23:23:09.408332+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:56.708016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.394429+0000","last_change":"2024-09-11T23:23:08.392903+0000","last_active":"2024-09-11T23:23:09.394429+0000","last_peered":"2024-09-11T23:23:09.394429+0000","last_clean":"2024-09-11T23:23:09.394429+0000","last_became_active":"2024-09-11T23:23:08.392642+0000","last_became_peered":"2024-09-11T23:23:08.392642+0000","last_unstale":"2024-09-11T23:23:09.394429+0000","last_undegraded":"2024-09-11T23:23:09.394429+0000","last_fullsized":"2024-09-11T23:23:09.394429+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:31.497338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.415535+0000","last_change":"2024-09-11T23:23:09.409669+0000","last_active":"2024-09-11T23:23:09.415535+0000","last_peered":"2024-09-11T23:23:09.415535+0000","last_clean":"2024-09-11T23:23:09.415535+0000","last_became_active":"2024-09-11T23:23:09.409415+0000","last_became_peered":"2024-09-11T23:23:09.409415+0000","last_unstale":"2024-09-11T23:23:09.415535+0000","last_undegraded":"2024-09-11T23:23:09.415535+0000","last_fullsized":"2024-09-11T23:23:09.415535+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:27.268255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401125+0000","last_change":"2024-09-11T23:23:08.391755+0000","last_active":"2024-09-11T23:23:10.401125+0000","last_peered":"2024-09-11T23:23:10.401125+0000","last_clean":"2024-09-11T23:23:10.401125+0000","last_became_active":"2024-09-11T23:23:08.391472+0000","last_became_peered":"2024-09-11T23:23:08.391472+0000","last_unstale":"2024-09-11T23:23:10.401125+0000","last_undegraded":"2024-09-11T23:23:10.401125+0000","last_fullsized":"2024-09-11T23:23:10.401125+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:34.509150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":356,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.398083+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:23:09.398083+0000","last_peered":"2024-09-11T23:23:09.398083+0000","last_clean":"2024-09-11T23:23:09.398083+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:23:09.398083+0000","last_undegraded":"2024-09-11T23:23:09.398083+0000","last_fullsized":"2024-09-11T23:23:09.398083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476805,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32984,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338856,"statfs":{"total":96636764160,"available":96602988544,"internally_reserved":0,"allocated":1835008,"data_stored":1128071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476804,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1236992,"data_stored":537157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476803,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1253376,"data_stored":543991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476803,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1232896,"data_stored":537087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542212,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1249280,"data_stored":538769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542212,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1232896,"data_stored":537087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1241088,"data_stored":537211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509508,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32992,"kb_used_data":1804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338848,"statfs":{"total":96636764160,"available":96602980352,"internally_reserved":0,"allocated":1847296,"data_stored":1129179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:23:13.558 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:23:13.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.747+0000 7f81d9600640 1 Processor -- start 2024-09-11T23:23:13.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.747+0000 7f81d9600640 1 -- start start 2024-09-11T23:23:13.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.748+0000 7f81d9600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f81d406be10 0x7f81d40cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:13.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.748+0000 7f81d9600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81d406c1f0 0x7f81d415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:13.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.749+0000 7f81d9600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81d40cd5f0 con 0x7f81d4151540 2024-09-11T23:23:13.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.749+0000 7f81d9600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f81d40cd8d0 con 0x7f81d406be10 2024-09-11T23:23:13.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.749+0000 7f81d9600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f81d40cdbb0 con 0x7f81d406c1f0 2024-09-11T23:23:13.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.749+0000 7f81d2000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81d406c1f0 0x7f81d415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:13.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.749+0000 7f81d2000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81d406c1f0 0x7f81d415baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:40126/0 (socket says 172.21.15.144:40126) 2024-09-11T23:23:13.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.749+0000 7f81d2000640 1 -- 172.21.15.144:0/2214122033 learned_addr learned my addr 172.21.15.144:0/2214122033 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:13.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.749+0000 7f81d2a00640 1 --2- 172.21.15.144:0/2214122033 >> v2:172.21.15.165:3300/0 conn(0x7f81d406be10 0x7f81d40cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:13.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.749+0000 7f81d2000640 1 -- 172.21.15.144:0/2214122033 >> v2:172.21.15.165:3300/0 conn(0x7f81d406be10 msgr2=0x7f81d40cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:13.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.749+0000 7f81d2000640 1 --2- 172.21.15.144:0/2214122033 >> v2:172.21.15.165:3300/0 conn(0x7f81d406be10 0x7f81d40cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.749+0000 7f81d2000640 1 -- 172.21.15.144:0/2214122033 >> v1:172.21.15.165:6789/0 conn(0x7f81d4151540 legacy=0x7f81d415e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:13.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.750+0000 7f81d2000640 1 -- 172.21.15.144:0/2214122033 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d40cde90 con 0x7f81d406c1f0 2024-09-11T23:23:13.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.750+0000 7f81d1600640 1 -- 172.21.15.144:0/2214122033 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2814892405 0 0) 0x7f81d40cd5f0 con 0x7f81d4151540 2024-09-11T23:23:13.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.750+0000 7f81d2000640 1 --2- 172.21.15.144:0/2214122033 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81d406c1f0 0x7f81d415baa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009870 tx=0x7f81c002b380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b65dffa350ff5804 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:13.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.751+0000 7f81d1600640 1 -- 172.21.15.144:0/2214122033 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c0038070 con 0x7f81d406c1f0 2024-09-11T23:23:13.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.751+0000 7f81d1600640 1 -- 172.21.15.144:0/2214122033 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c0033640 con 0x7f81d406c1f0 2024-09-11T23:23:13.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.751+0000 7f81d1600640 1 -- 172.21.15.144:0/2214122033 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c0033a10 con 0x7f81d406c1f0 2024-09-11T23:23:13.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.751+0000 7f81d9600640 1 -- 172.21.15.144:0/2214122033 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81d406c1f0 msgr2=0x7f81d415baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:13.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.751+0000 7f81d9600640 1 --2- 172.21.15.144:0/2214122033 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81d406c1f0 0x7f81d415baa0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009870 tx=0x7f81c002b380 comp rx=0 tx=0).stop 2024-09-11T23:23:13.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.751+0000 7f81d9600640 1 -- 172.21.15.144:0/2214122033 shutdown_connections 2024-09-11T23:23:13.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.751+0000 7f81d9600640 1 --2- 172.21.15.144:0/2214122033 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81d406c1f0 0x7f81d415baa0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.751+0000 7f81d9600640 1 --2- 172.21.15.144:0/2214122033 >> v2:172.21.15.165:3300/0 conn(0x7f81d406be10 0x7f81d40cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.751+0000 7f81d9600640 1 -- 172.21.15.144:0/2214122033 >> 172.21.15.144:0/2214122033 conn(0x7f81d4062cc0 msgr2=0x7f81d406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:13.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.751+0000 7f81d9600640 1 -- 172.21.15.144:0/2214122033 shutdown_connections 2024-09-11T23:23:13.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.751+0000 7f81d9600640 1 -- 172.21.15.144:0/2214122033 wait complete. 2024-09-11T23:23:13.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.753+0000 7f81d9600640 1 Processor -- start 2024-09-11T23:23:13.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.753+0000 7f81d9600640 1 -- start start 2024-09-11T23:23:13.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.754+0000 7f81d9600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81d406be10 0x7f81d414fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:13.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.754+0000 7f81d9600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81d406c1f0 0x7f81d41f4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:13.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.754+0000 7f81d9600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81d4151540 0x7f81d41568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:13.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.754+0000 7f81d9600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f81d41519b0 con 0x7f81d406be10 2024-09-11T23:23:13.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.754+0000 7f81d9600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f81d40ce690 con 0x7f81d406c1f0 2024-09-11T23:23:13.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.754+0000 7f81d9600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f81d4151b30 con 0x7f81d4151540 2024-09-11T23:23:13.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.754+0000 7f81d2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81d406be10 0x7f81d414fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:13.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.754+0000 7f81d2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81d406be10 0x7f81d414fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43136/0 (socket says 172.21.15.144:43136) 2024-09-11T23:23:13.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.754+0000 7f81d2a00640 1 -- 172.21.15.144:0/1316141936 learned_addr learned my addr 172.21.15.144:0/1316141936 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.755+0000 7f81d2000640 1 --2- 172.21.15.144:0/1316141936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81d406c1f0 0x7f81d41f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.755+0000 7f81d3400640 1 --2- 172.21.15.144:0/1316141936 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81d4151540 0x7f81d41568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.755+0000 7f81d2a00640 1 -- 172.21.15.144:0/1316141936 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81d4151540 msgr2=0x7f81d41568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.755+0000 7f81d2a00640 1 --2- 172.21.15.144:0/1316141936 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81d4151540 0x7f81d41568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.755+0000 7f81d2a00640 1 -- 172.21.15.144:0/1316141936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81d406c1f0 msgr2=0x7f81d41f4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.755+0000 7f81d2a00640 1 --2- 172.21.15.144:0/1316141936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81d406c1f0 0x7f81d41f4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.755+0000 7f81d2a00640 1 -- 172.21.15.144:0/1316141936 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d4151f60 con 0x7f81d406be10 2024-09-11T23:23:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.755+0000 7f81d3400640 1 --2- 172.21.15.144:0/1316141936 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81d4151540 0x7f81d41568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:23:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.755+0000 7f81d2a00640 1 --2- 172.21.15.144:0/1316141936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81d406be10 0x7f81d414fea0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f81c400efc0 tx=0x7f81c400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.755+0000 7f81caa00640 1 -- 172.21.15.144:0/1316141936 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c4018020 con 0x7f81d406be10 2024-09-11T23:23:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.755+0000 7f81caa00640 1 -- 172.21.15.144:0/1316141936 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c4014480 con 0x7f81d406be10 2024-09-11T23:23:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.755+0000 7f81caa00640 1 -- 172.21.15.144:0/1316141936 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c4014850 con 0x7f81d406be10 2024-09-11T23:23:13.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.755+0000 7f81d9600640 1 -- 172.21.15.144:0/1316141936 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81d4152240 con 0x7f81d406be10 2024-09-11T23:23:13.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.756+0000 7f81d9600640 1 -- 172.21.15.144:0/1316141936 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81d4152800 con 0x7f81d406be10 2024-09-11T23:23:13.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.757+0000 7f81d9600640 1 -- 172.21.15.144:0/1316141936 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81d40cd010 con 0x7f81d406be10 2024-09-11T23:23:13.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.758+0000 7f81caa00640 1 -- 172.21.15.144:0/1316141936 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f81c4005d10 con 0x7f81d406be10 2024-09-11T23:23:13.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.758+0000 7f81caa00640 1 --2- 172.21.15.144:0/1316141936 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f81b406bf50 0x7f81b406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:13.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.759+0000 7f81caa00640 1 -- 172.21.15.144:0/1316141936 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f81c408bd10 con 0x7f81d406be10 2024-09-11T23:23:13.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.759+0000 7f81d2000640 1 --2- 172.21.15.144:0/1316141936 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f81b406bf50 0x7f81b406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:13.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.759+0000 7f81d2000640 1 --2- 172.21.15.144:0/1316141936 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f81b406bf50 0x7f81b406e410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f81c0035000 tx=0x7f81c002f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:13.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.763+0000 7f81caa00640 1 -- 172.21.15.144:0/1316141936 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f81c4091020 con 0x7f81d406be10 2024-09-11T23:23:13.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.934+0000 7f81d9600640 1 -- 172.21.15.144:0/1316141936 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81d40afd70 con 0x7f81b406bf50 2024-09-11T23:23:13.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.941+0000 7f81caa00640 1 -- 172.21.15.144:0/1316141936 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252216 (secure 0 0 0) 0x7f81d40afd70 con 0x7f81b406bf50 2024-09-11T23:23:13.943 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:13.944 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:23:13.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.944+0000 7f81d9600640 1 -- 172.21.15.144:0/1316141936 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f81b406bf50 msgr2=0x7f81b406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:13.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.944+0000 7f81d9600640 1 --2- 172.21.15.144:0/1316141936 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f81b406bf50 0x7f81b406e410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f81c0035000 tx=0x7f81c002f000 comp rx=0 tx=0).stop 2024-09-11T23:23:13.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.944+0000 7f81d9600640 1 -- 172.21.15.144:0/1316141936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81d406be10 msgr2=0x7f81d414fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:13.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.944+0000 7f81d9600640 1 --2- 172.21.15.144:0/1316141936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81d406be10 0x7f81d414fea0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f81c400efc0 tx=0x7f81c400c490 comp rx=0 tx=0).stop 2024-09-11T23:23:13.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.944+0000 7f81d9600640 1 -- 172.21.15.144:0/1316141936 shutdown_connections 2024-09-11T23:23:13.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.944+0000 7f81d9600640 1 --2- 172.21.15.144:0/1316141936 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f81b406bf50 0x7f81b406e410 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.944+0000 7f81d9600640 1 --2- 172.21.15.144:0/1316141936 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f81d4151540 0x7f81d41568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.944+0000 7f81d9600640 1 --2- 172.21.15.144:0/1316141936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81d406c1f0 0x7f81d41f4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.944+0000 7f81d9600640 1 --2- 172.21.15.144:0/1316141936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81d406be10 0x7f81d414fea0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:13.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.945+0000 7f81d9600640 1 -- 172.21.15.144:0/1316141936 >> 172.21.15.144:0/1316141936 conn(0x7f81d4062cc0 msgr2=0x7f81d415ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:13.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.945+0000 7f81d9600640 1 -- 172.21.15.144:0/1316141936 shutdown_connections 2024-09-11T23:23:13.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:13.945+0000 7f81d9600640 1 -- 172.21.15.144:0/1316141936 wait complete. 2024-09-11T23:23:13.960 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-09-11T23:23:12.724932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260388,"kb_used_data":10868,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714332,"statfs":{"total":773094113280,"available":772827475968,"internally_reserved":0,"allocated":11128832,"data_stored":5488552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.358187"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.417792+0000","last_change":"2024-09-11T23:23:09.404670+0000","last_active":"2024-09-11T23:23:09.417792+0000","last_peered":"2024-09-11T23:23:09.417792+0000","last_clean":"2024-09-11T23:23:09.417792+0000","last_became_active":"2024-09-11T23:23:09.404415+0000","last_became_peered":"2024-09-11T23:23:09.404415+0000","last_unstale":"2024-09-11T23:23:09.417792+0000","last_undegraded":"2024-09-11T23:23:09.417792+0000","last_fullsized":"2024-09-11T23:23:09.417792+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:31.697199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.402553+0000","last_change":"2024-09-11T23:23:09.405999+0000","last_active":"2024-09-11T23:23:10.402553+0000","last_peered":"2024-09-11T23:23:10.402553+0000","last_clean":"2024-09-11T23:23:10.402553+0000","last_became_active":"2024-09-11T23:23:09.405551+0000","last_became_peered":"2024-09-11T23:23:09.405551+0000","last_unstale":"2024-09-11T23:23:10.402553+0000","last_undegraded":"2024-09-11T23:23:10.402553+0000","last_fullsized":"2024-09-11T23:23:10.402553+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:41.162208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.415187+0000","last_change":"2024-09-11T23:23:09.411960+0000","last_active":"2024-09-11T23:23:09.415187+0000","last_peered":"2024-09-11T23:23:09.415187+0000","last_clean":"2024-09-11T23:23:09.415187+0000","last_became_active":"2024-09-11T23:23:09.410281+0000","last_became_peered":"2024-09-11T23:23:09.410281+0000","last_unstale":"2024-09-11T23:23:09.415187+0000","last_undegraded":"2024-09-11T23:23:09.415187+0000","last_fullsized":"2024-09-11T23:23:09.415187+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:41.162208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.416077+0000","last_change":"2024-09-11T23:23:09.406575+0000","last_active":"2024-09-11T23:23:09.416077+0000","last_peered":"2024-09-11T23:23:09.416077+0000","last_clean":"2024-09-11T23:23:09.416077+0000","last_became_active":"2024-09-11T23:23:09.406258+0000","last_became_peered":"2024-09-11T23:23:09.406258+0000","last_unstale":"2024-09-11T23:23:09.416077+0000","last_undegraded":"2024-09-11T23:23:09.416077+0000","last_fullsized":"2024-09-11T23:23:09.416077+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:01:10.147781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.399584+0000","last_change":"2024-09-11T23:23:09.406890+0000","last_active":"2024-09-11T23:23:10.399584+0000","last_peered":"2024-09-11T23:23:10.399584+0000","last_clean":"2024-09-11T23:23:10.399584+0000","last_became_active":"2024-09-11T23:23:09.406225+0000","last_became_peered":"2024-09-11T23:23:09.406225+0000","last_unstale":"2024-09-11T23:23:10.399584+0000","last_undegraded":"2024-09-11T23:23:10.399584+0000","last_fullsized":"2024-09-11T23:23:10.399584+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:51.616365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.417071+0000","last_change":"2024-09-11T23:23:09.413671+0000","last_active":"2024-09-11T23:23:09.417071+0000","last_peered":"2024-09-11T23:23:09.417071+0000","last_clean":"2024-09-11T23:23:09.417071+0000","last_became_active":"2024-09-11T23:23:09.413336+0000","last_became_peered":"2024-09-11T23:23:09.413336+0000","last_unstale":"2024-09-11T23:23:09.417071+0000","last_undegraded":"2024-09-11T23:23:09.417071+0000","last_fullsized":"2024-09-11T23:23:09.417071+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:04.189080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401019+0000","last_change":"2024-09-11T23:23:09.402362+0000","last_active":"2024-09-11T23:23:10.401019+0000","last_peered":"2024-09-11T23:23:10.401019+0000","last_clean":"2024-09-11T23:23:10.401019+0000","last_became_active":"2024-09-11T23:23:09.402071+0000","last_became_peered":"2024-09-11T23:23:09.402071+0000","last_unstale":"2024-09-11T23:23:10.401019+0000","last_undegraded":"2024-09-11T23:23:10.401019+0000","last_fullsized":"2024-09-11T23:23:10.401019+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:20.343496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.412973+0000","last_change":"2024-09-11T23:23:09.410027+0000","last_active":"2024-09-11T23:23:09.412973+0000","last_peered":"2024-09-11T23:23:09.412973+0000","last_clean":"2024-09-11T23:23:09.412973+0000","last_became_active":"2024-09-11T23:23:09.409459+0000","last_became_peered":"2024-09-11T23:23:09.409459+0000","last_unstale":"2024-09-11T23:23:09.412973+0000","last_undegraded":"2024-09-11T23:23:09.412973+0000","last_fullsized":"2024-09-11T23:23:09.412973+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:20.343496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.417813+0000","last_change":"2024-09-11T23:23:09.407820+0000","last_active":"2024-09-11T23:23:09.417813+0000","last_peered":"2024-09-11T23:23:09.417813+0000","last_clean":"2024-09-11T23:23:09.417813+0000","last_became_active":"2024-09-11T23:23:09.406447+0000","last_became_peered":"2024-09-11T23:23:09.406447+0000","last_unstale":"2024-09-11T23:23:09.417813+0000","last_undegraded":"2024-09-11T23:23:09.417813+0000","last_fullsized":"2024-09-11T23:23:09.417813+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:55.506032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.421300+0000","last_change":"2024-09-11T23:23:09.415593+0000","last_active":"2024-09-11T23:23:09.421300+0000","last_peered":"2024-09-11T23:23:09.421300+0000","last_clean":"2024-09-11T23:23:09.421300+0000","last_became_active":"2024-09-11T23:23:09.415336+0000","last_became_peered":"2024-09-11T23:23:09.415336+0000","last_unstale":"2024-09-11T23:23:09.421300+0000","last_undegraded":"2024-09-11T23:23:09.421300+0000","last_fullsized":"2024-09-11T23:23:09.421300+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:36.326466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.402395+0000","last_change":"2024-09-11T23:23:09.399636+0000","last_active":"2024-09-11T23:23:10.402395+0000","last_peered":"2024-09-11T23:23:10.402395+0000","last_clean":"2024-09-11T23:23:10.402395+0000","last_became_active":"2024-09-11T23:23:09.399326+0000","last_became_peered":"2024-09-11T23:23:09.399326+0000","last_unstale":"2024-09-11T23:23:10.402395+0000","last_undegraded":"2024-09-11T23:23:10.402395+0000","last_fullsized":"2024-09-11T23:23:10.402395+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:34.050183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.422878+0000","last_change":"2024-09-11T23:23:09.414482+0000","last_active":"2024-09-11T23:23:09.422878+0000","last_peered":"2024-09-11T23:23:09.422878+0000","last_clean":"2024-09-11T23:23:09.422878+0000","last_became_active":"2024-09-11T23:23:09.414082+0000","last_became_peered":"2024-09-11T23:23:09.414082+0000","last_unstale":"2024-09-11T23:23:09.422878+0000","last_undegraded":"2024-09-11T23:23:09.422878+0000","last_fullsized":"2024-09-11T23:23:09.422878+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:05.662838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.408647+0000","last_change":"2024-09-11T23:23:09.406388+0000","last_active":"2024-09-11T23:23:09.408647+0000","last_peered":"2024-09-11T23:23:09.408647+0000","last_clean":"2024-09-11T23:23:09.408647+0000","last_became_active":"2024-09-11T23:23:09.406052+0000","last_became_peered":"2024-09-11T23:23:09.406052+0000","last_unstale":"2024-09-11T23:23:09.408647+0000","last_undegraded":"2024-09-11T23:23:09.408647+0000","last_fullsized":"2024-09-11T23:23:09.408647+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:58.144776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.415361+0000","last_change":"2024-09-11T23:23:09.411678+0000","last_active":"2024-09-11T23:23:09.415361+0000","last_peered":"2024-09-11T23:23:09.415361+0000","last_clean":"2024-09-11T23:23:09.415361+0000","last_became_active":"2024-09-11T23:23:09.410615+0000","last_became_peered":"2024-09-11T23:23:09.410615+0000","last_unstale":"2024-09-11T23:23:09.415361+0000","last_undegraded":"2024-09-11T23:23:09.415361+0000","last_fullsized":"2024-09-11T23:23:09.415361+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:34.050183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.420647+0000","last_change":"2024-09-11T23:23:09.412197+0000","last_active":"2024-09-11T23:23:09.420647+0000","last_peered":"2024-09-11T23:23:09.420647+0000","last_clean":"2024-09-11T23:23:09.420647+0000","last_became_active":"2024-09-11T23:23:09.411865+0000","last_became_peered":"2024-09-11T23:23:09.411865+0000","last_unstale":"2024-09-11T23:23:09.420647+0000","last_undegraded":"2024-09-11T23:23:09.420647+0000","last_fullsized":"2024-09-11T23:23:09.420647+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:56.410266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.426585+0000","last_change":"2024-09-11T23:23:09.425150+0000","last_active":"2024-09-11T23:23:09.426585+0000","last_peered":"2024-09-11T23:23:09.426585+0000","last_clean":"2024-09-11T23:23:09.426585+0000","last_became_active":"2024-09-11T23:23:09.421469+0000","last_became_peered":"2024-09-11T23:23:09.421469+0000","last_unstale":"2024-09-11T23:23:09.426585+0000","last_undegraded":"2024-09-11T23:23:09.426585+0000","last_fullsized":"2024-09-11T23:23:09.426585+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:50.050588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.402551+0000","last_change":"2024-09-11T23:23:09.400761+0000","last_active":"2024-09-11T23:23:10.402551+0000","last_peered":"2024-09-11T23:23:10.402551+0000","last_clean":"2024-09-11T23:23:10.402551+0000","last_became_active":"2024-09-11T23:23:09.400480+0000","last_became_peered":"2024-09-11T23:23:09.400480+0000","last_unstale":"2024-09-11T23:23:10.402551+0000","last_undegraded":"2024-09-11T23:23:10.402551+0000","last_fullsized":"2024-09-11T23:23:10.402551+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:39.238324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.405037+0000","last_change":"2024-09-11T23:23:09.408611+0000","last_active":"2024-09-11T23:23:10.405037+0000","last_peered":"2024-09-11T23:23:10.405037+0000","last_clean":"2024-09-11T23:23:10.405037+0000","last_became_active":"2024-09-11T23:23:09.408353+0000","last_became_peered":"2024-09-11T23:23:09.408353+0000","last_unstale":"2024-09-11T23:23:10.405037+0000","last_undegraded":"2024-09-11T23:23:10.405037+0000","last_fullsized":"2024-09-11T23:23:10.405037+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:20.343496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.415694+0000","last_change":"2024-09-11T23:23:09.412561+0000","last_active":"2024-09-11T23:23:09.415694+0000","last_peered":"2024-09-11T23:23:09.415694+0000","last_clean":"2024-09-11T23:23:09.415694+0000","last_became_active":"2024-09-11T23:23:09.412280+0000","last_became_peered":"2024-09-11T23:23:09.412280+0000","last_unstale":"2024-09-11T23:23:09.415694+0000","last_undegraded":"2024-09-11T23:23:09.415694+0000","last_fullsized":"2024-09-11T23:23:09.415694+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:39.238324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.402334+0000","last_change":"2024-09-11T23:23:09.408745+0000","last_active":"2024-09-11T23:23:10.402334+0000","last_peered":"2024-09-11T23:23:10.402334+0000","last_clean":"2024-09-11T23:23:10.402334+0000","last_became_active":"2024-09-11T23:23:09.408467+0000","last_became_peered":"2024-09-11T23:23:09.408467+0000","last_unstale":"2024-09-11T23:23:10.402334+0000","last_undegraded":"2024-09-11T23:23:10.402334+0000","last_fullsized":"2024-09-11T23:23:10.402334+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:22.413082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.402245+0000","last_change":"2024-09-11T23:23:09.400568+0000","last_active":"2024-09-11T23:23:10.402245+0000","last_peered":"2024-09-11T23:23:10.402245+0000","last_clean":"2024-09-11T23:23:10.402245+0000","last_became_active":"2024-09-11T23:23:09.400267+0000","last_became_peered":"2024-09-11T23:23:09.400267+0000","last_unstale":"2024-09-11T23:23:10.402245+0000","last_undegraded":"2024-09-11T23:23:10.402245+0000","last_fullsized":"2024-09-11T23:23:10.402245+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:22.089509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.405709+0000","last_change":"2024-09-11T23:23:09.399850+0000","last_active":"2024-09-11T23:23:09.405709+0000","last_peered":"2024-09-11T23:23:09.405709+0000","last_clean":"2024-09-11T23:23:09.405709+0000","last_became_active":"2024-09-11T23:23:09.399558+0000","last_became_peered":"2024-09-11T23:23:09.399558+0000","last_unstale":"2024-09-11T23:23:09.405709+0000","last_undegraded":"2024-09-11T23:23:09.405709+0000","last_fullsized":"2024-09-11T23:23:09.405709+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:37.642266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.400708+0000","last_change":"2024-09-11T23:23:09.394788+0000","last_active":"2024-09-11T23:23:10.400708+0000","last_peered":"2024-09-11T23:23:10.400708+0000","last_clean":"2024-09-11T23:23:10.400708+0000","last_became_active":"2024-09-11T23:23:09.394527+0000","last_became_peered":"2024-09-11T23:23:09.394527+0000","last_unstale":"2024-09-11T23:23:10.400708+0000","last_undegraded":"2024-09-11T23:23:10.400708+0000","last_fullsized":"2024-09-11T23:23:10.400708+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:45.525065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.415559+0000","last_change":"2024-09-11T23:23:09.410179+0000","last_active":"2024-09-11T23:23:09.415559+0000","last_peered":"2024-09-11T23:23:09.415559+0000","last_clean":"2024-09-11T23:23:09.415559+0000","last_became_active":"2024-09-11T23:23:09.409953+0000","last_became_peered":"2024-09-11T23:23:09.409953+0000","last_unstale":"2024-09-11T23:23:09.415559+0000","last_undegraded":"2024-09-11T23:23:09.415559+0000","last_fullsized":"2024-09-11T23:23:09.415559+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:54.522583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.402614+0000","last_change":"2024-09-11T23:23:09.402167+0000","last_active":"2024-09-11T23:23:10.402614+0000","last_peered":"2024-09-11T23:23:10.402614+0000","last_clean":"2024-09-11T23:23:10.402614+0000","last_became_active":"2024-09-11T23:23:09.400710+0000","last_became_peered":"2024-09-11T23:23:09.400710+0000","last_unstale":"2024-09-11T23:23:10.402614+0000","last_undegraded":"2024-09-11T23:23:10.402614+0000","last_fullsized":"2024-09-11T23:23:10.402614+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:37.934590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.421340+0000","last_change":"2024-09-11T23:23:09.420438+0000","last_active":"2024-09-11T23:23:09.421340+0000","last_peered":"2024-09-11T23:23:09.421340+0000","last_clean":"2024-09-11T23:23:09.421340+0000","last_became_active":"2024-09-11T23:23:09.420050+0000","last_became_peered":"2024-09-11T23:23:09.420050+0000","last_unstale":"2024-09-11T23:23:09.421340+0000","last_undegraded":"2024-09-11T23:23:09.421340+0000","last_fullsized":"2024-09-11T23:23:09.421340+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:59.285549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.421531+0000","last_change":"2024-09-11T23:23:09.416225+0000","last_active":"2024-09-11T23:23:09.421531+0000","last_peered":"2024-09-11T23:23:09.421531+0000","last_clean":"2024-09-11T23:23:09.421531+0000","last_became_active":"2024-09-11T23:23:09.416048+0000","last_became_peered":"2024-09-11T23:23:09.416048+0000","last_unstale":"2024-09-11T23:23:09.421531+0000","last_undegraded":"2024-09-11T23:23:09.421531+0000","last_fullsized":"2024-09-11T23:23:09.421531+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:09.236361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.415873+0000","last_change":"2024-09-11T23:23:09.407776+0000","last_active":"2024-09-11T23:23:09.415873+0000","last_peered":"2024-09-11T23:23:09.415873+0000","last_clean":"2024-09-11T23:23:09.415873+0000","last_became_active":"2024-09-11T23:23:09.407402+0000","last_became_peered":"2024-09-11T23:23:09.407402+0000","last_unstale":"2024-09-11T23:23:09.415873+0000","last_undegraded":"2024-09-11T23:23:09.415873+0000","last_fullsized":"2024-09-11T23:23:09.415873+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:42.105321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.400983+0000","last_change":"2024-09-11T23:23:09.408523+0000","last_active":"2024-09-11T23:23:10.400983+0000","last_peered":"2024-09-11T23:23:10.400983+0000","last_clean":"2024-09-11T23:23:10.400983+0000","last_became_active":"2024-09-11T23:23:09.407397+0000","last_became_peered":"2024-09-11T23:23:09.407397+0000","last_unstale":"2024-09-11T23:23:10.400983+0000","last_undegraded":"2024-09-11T23:23:10.400983+0000","last_fullsized":"2024-09-11T23:23:10.400983+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:18.522193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401082+0000","last_change":"2024-09-11T23:23:09.395351+0000","last_active":"2024-09-11T23:23:10.401082+0000","last_peered":"2024-09-11T23:23:10.401082+0000","last_clean":"2024-09-11T23:23:10.401082+0000","last_became_active":"2024-09-11T23:23:09.393958+0000","last_became_peered":"2024-09-11T23:23:09.393958+0000","last_unstale":"2024-09-11T23:23:10.401082+0000","last_undegraded":"2024-09-11T23:23:10.401082+0000","last_fullsized":"2024-09-11T23:23:10.401082+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:35.086272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.408310+0000","last_change":"2024-09-11T23:23:09.398939+0000","last_active":"2024-09-11T23:23:09.408310+0000","last_peered":"2024-09-11T23:23:09.408310+0000","last_clean":"2024-09-11T23:23:09.408310+0000","last_became_active":"2024-09-11T23:23:09.398664+0000","last_became_peered":"2024-09-11T23:23:09.398664+0000","last_unstale":"2024-09-11T23:23:09.408310+0000","last_undegraded":"2024-09-11T23:23:09.408310+0000","last_fullsized":"2024-09-11T23:23:09.408310+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:57.832016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.416594+0000","last_change":"2024-09-11T23:23:09.412882+0000","last_active":"2024-09-11T23:23:09.416594+0000","last_peered":"2024-09-11T23:23:09.416594+0000","last_clean":"2024-09-11T23:23:09.416594+0000","last_became_active":"2024-09-11T23:23:09.411919+0000","last_became_peered":"2024-09-11T23:23:09.411919+0000","last_unstale":"2024-09-11T23:23:09.416594+0000","last_undegraded":"2024-09-11T23:23:09.416594+0000","last_fullsized":"2024-09-11T23:23:09.416594+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:51.376840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.408675+0000","last_change":"2024-09-11T23:23:09.403977+0000","last_active":"2024-09-11T23:23:09.408675+0000","last_peered":"2024-09-11T23:23:09.408675+0000","last_clean":"2024-09-11T23:23:09.408675+0000","last_became_active":"2024-09-11T23:23:09.403711+0000","last_became_peered":"2024-09-11T23:23:09.403711+0000","last_unstale":"2024-09-11T23:23:09.408675+0000","last_undegraded":"2024-09-11T23:23:09.408675+0000","last_fullsized":"2024-09-11T23:23:09.408675+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:44.426410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"100'4","reported_seq":18,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401159+0000","last_change":"2024-09-11T23:23:08.385819+0000","last_active":"2024-09-11T23:23:10.401159+0000","last_peered":"2024-09-11T23:23:10.401159+0000","last_clean":"2024-09-11T23:23:10.401159+0000","last_became_active":"2024-09-11T23:23:08.384712+0000","last_became_peered":"2024-09-11T23:23:08.384712+0000","last_unstale":"2024-09-11T23:23:10.401159+0000","last_undegraded":"2024-09-11T23:23:10.401159+0000","last_fullsized":"2024-09-11T23:23:10.401159+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:06.233990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.405191+0000","last_change":"2024-09-11T23:23:09.409850+0000","last_active":"2024-09-11T23:23:10.405191+0000","last_peered":"2024-09-11T23:23:10.405191+0000","last_clean":"2024-09-11T23:23:10.405191+0000","last_became_active":"2024-09-11T23:23:09.409489+0000","last_became_peered":"2024-09-11T23:23:09.409489+0000","last_unstale":"2024-09-11T23:23:10.405191+0000","last_undegraded":"2024-09-11T23:23:10.405191+0000","last_fullsized":"2024-09-11T23:23:10.405191+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:22.413082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"100'1","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.417907+0000","last_change":"2024-09-11T23:23:08.390546+0000","last_active":"2024-09-11T23:23:09.417907+0000","last_peered":"2024-09-11T23:23:09.417907+0000","last_clean":"2024-09-11T23:23:09.417907+0000","last_became_active":"2024-09-11T23:23:08.390201+0000","last_became_peered":"2024-09-11T23:23:08.390201+0000","last_unstale":"2024-09-11T23:23:09.417907+0000","last_undegraded":"2024-09-11T23:23:09.417907+0000","last_fullsized":"2024-09-11T23:23:09.417907+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:44.517647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.415720+0000","last_change":"2024-09-11T23:23:09.410915+0000","last_active":"2024-09-11T23:23:09.415720+0000","last_peered":"2024-09-11T23:23:09.415720+0000","last_clean":"2024-09-11T23:23:09.415720+0000","last_became_active":"2024-09-11T23:23:09.410566+0000","last_became_peered":"2024-09-11T23:23:09.410566+0000","last_unstale":"2024-09-11T23:23:09.415720+0000","last_undegraded":"2024-09-11T23:23:09.415720+0000","last_fullsized":"2024-09-11T23:23:09.415720+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:28.820566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.399533+0000","last_change":"2024-09-11T23:23:08.392793+0000","last_active":"2024-09-11T23:23:10.399533+0000","last_peered":"2024-09-11T23:23:10.399533+0000","last_clean":"2024-09-11T23:23:10.399533+0000","last_became_active":"2024-09-11T23:23:08.392533+0000","last_became_peered":"2024-09-11T23:23:08.392533+0000","last_unstale":"2024-09-11T23:23:10.399533+0000","last_undegraded":"2024-09-11T23:23:10.399533+0000","last_fullsized":"2024-09-11T23:23:10.399533+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:22.866202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.414895+0000","last_change":"2024-09-11T23:23:09.410909+0000","last_active":"2024-09-11T23:23:09.414895+0000","last_peered":"2024-09-11T23:23:09.414895+0000","last_clean":"2024-09-11T23:23:09.414895+0000","last_became_active":"2024-09-11T23:23:09.409616+0000","last_became_peered":"2024-09-11T23:23:09.409616+0000","last_unstale":"2024-09-11T23:23:09.414895+0000","last_undegraded":"2024-09-11T23:23:09.414895+0000","last_fullsized":"2024-09-11T23:23:09.414895+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:22.089509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.399618+0000","last_change":"2024-09-11T23:23:08.392513+0000","last_active":"2024-09-11T23:23:10.399618+0000","last_peered":"2024-09-11T23:23:10.399618+0000","last_clean":"2024-09-11T23:23:10.399618+0000","last_became_active":"2024-09-11T23:23:08.392254+0000","last_became_peered":"2024-09-11T23:23:08.392254+0000","last_unstale":"2024-09-11T23:23:10.399618+0000","last_undegraded":"2024-09-11T23:23:10.399618+0000","last_fullsized":"2024-09-11T23:23:10.399618+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:49.753777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.408273+0000","last_change":"2024-09-11T23:23:09.400497+0000","last_active":"2024-09-11T23:23:09.408273+0000","last_peered":"2024-09-11T23:23:09.408273+0000","last_clean":"2024-09-11T23:23:09.408273+0000","last_became_active":"2024-09-11T23:23:09.400223+0000","last_became_peered":"2024-09-11T23:23:09.400223+0000","last_unstale":"2024-09-11T23:23:09.408273+0000","last_undegraded":"2024-09-11T23:23:09.408273+0000","last_fullsized":"2024-09-11T23:23:09.408273+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:51.664449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401256+0000","last_change":"2024-09-11T23:23:08.388218+0000","last_active":"2024-09-11T23:23:10.401256+0000","last_peered":"2024-09-11T23:23:10.401256+0000","last_clean":"2024-09-11T23:23:10.401256+0000","last_became_active":"2024-09-11T23:23:08.387878+0000","last_became_peered":"2024-09-11T23:23:08.387878+0000","last_unstale":"2024-09-11T23:23:10.401256+0000","last_undegraded":"2024-09-11T23:23:10.401256+0000","last_fullsized":"2024-09-11T23:23:10.401256+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:31.448265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401132+0000","last_change":"2024-09-11T23:23:09.404698+0000","last_active":"2024-09-11T23:23:10.401132+0000","last_peered":"2024-09-11T23:23:10.401132+0000","last_clean":"2024-09-11T23:23:10.401132+0000","last_became_active":"2024-09-11T23:23:09.403698+0000","last_became_peered":"2024-09-11T23:23:09.403698+0000","last_unstale":"2024-09-11T23:23:10.401132+0000","last_undegraded":"2024-09-11T23:23:10.401132+0000","last_fullsized":"2024-09-11T23:23:10.401132+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:58.144776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"100'1","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.421767+0000","last_change":"2024-09-11T23:23:08.391778+0000","last_active":"2024-09-11T23:23:09.421767+0000","last_peered":"2024-09-11T23:23:09.421767+0000","last_clean":"2024-09-11T23:23:09.421767+0000","last_became_active":"2024-09-11T23:23:08.391483+0000","last_became_peered":"2024-09-11T23:23:08.391483+0000","last_unstale":"2024-09-11T23:23:09.421767+0000","last_undegraded":"2024-09-11T23:23:09.421767+0000","last_fullsized":"2024-09-11T23:23:09.421767+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:51.943654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.412488+0000","last_change":"2024-09-11T23:23:09.408662+0000","last_active":"2024-09-11T23:23:09.412488+0000","last_peered":"2024-09-11T23:23:09.412488+0000","last_clean":"2024-09-11T23:23:09.412488+0000","last_became_active":"2024-09-11T23:23:09.401546+0000","last_became_peered":"2024-09-11T23:23:09.401546+0000","last_unstale":"2024-09-11T23:23:09.412488+0000","last_undegraded":"2024-09-11T23:23:09.412488+0000","last_fullsized":"2024-09-11T23:23:09.412488+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:46.547077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.400914+0000","last_change":"2024-09-11T23:23:08.383017+0000","last_active":"2024-09-11T23:23:10.400914+0000","last_peered":"2024-09-11T23:23:10.400914+0000","last_clean":"2024-09-11T23:23:10.400914+0000","last_became_active":"2024-09-11T23:23:08.382707+0000","last_became_peered":"2024-09-11T23:23:08.382707+0000","last_unstale":"2024-09-11T23:23:10.400914+0000","last_undegraded":"2024-09-11T23:23:10.400914+0000","last_fullsized":"2024-09-11T23:23:10.400914+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:15.968336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.400841+0000","last_change":"2024-09-11T23:23:09.402569+0000","last_active":"2024-09-11T23:23:10.400841+0000","last_peered":"2024-09-11T23:23:10.400841+0000","last_clean":"2024-09-11T23:23:10.400841+0000","last_became_active":"2024-09-11T23:23:09.402288+0000","last_became_peered":"2024-09-11T23:23:09.402288+0000","last_unstale":"2024-09-11T23:23:10.400841+0000","last_undegraded":"2024-09-11T23:23:10.400841+0000","last_fullsized":"2024-09-11T23:23:10.400841+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:58.144776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.392956+0000","last_change":"2024-09-11T23:23:08.391034+0000","last_active":"2024-09-11T23:23:09.392956+0000","last_peered":"2024-09-11T23:23:09.392956+0000","last_clean":"2024-09-11T23:23:09.392956+0000","last_became_active":"2024-09-11T23:23:08.390674+0000","last_became_peered":"2024-09-11T23:23:08.390674+0000","last_unstale":"2024-09-11T23:23:09.392956+0000","last_undegraded":"2024-09-11T23:23:09.392956+0000","last_fullsized":"2024-09-11T23:23:09.392956+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:25.843025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401279+0000","last_change":"2024-09-11T23:23:09.403790+0000","last_active":"2024-09-11T23:23:10.401279+0000","last_peered":"2024-09-11T23:23:10.401279+0000","last_clean":"2024-09-11T23:23:10.401279+0000","last_became_active":"2024-09-11T23:23:09.403066+0000","last_became_peered":"2024-09-11T23:23:09.403066+0000","last_unstale":"2024-09-11T23:23:10.401279+0000","last_undegraded":"2024-09-11T23:23:10.401279+0000","last_fullsized":"2024-09-11T23:23:10.401279+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:22.089509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.399685+0000","last_change":"2024-09-11T23:23:08.391533+0000","last_active":"2024-09-11T23:23:10.399685+0000","last_peered":"2024-09-11T23:23:10.399685+0000","last_clean":"2024-09-11T23:23:10.399685+0000","last_became_active":"2024-09-11T23:23:08.391254+0000","last_became_peered":"2024-09-11T23:23:08.391254+0000","last_unstale":"2024-09-11T23:23:10.399685+0000","last_undegraded":"2024-09-11T23:23:10.399685+0000","last_fullsized":"2024-09-11T23:23:10.399685+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:56.344144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.405230+0000","last_change":"2024-09-11T23:23:09.406394+0000","last_active":"2024-09-11T23:23:10.405230+0000","last_peered":"2024-09-11T23:23:10.405230+0000","last_clean":"2024-09-11T23:23:10.405230+0000","last_became_active":"2024-09-11T23:23:09.406090+0000","last_became_peered":"2024-09-11T23:23:09.406090+0000","last_unstale":"2024-09-11T23:23:10.405230+0000","last_undegraded":"2024-09-11T23:23:10.405230+0000","last_fullsized":"2024-09-11T23:23:10.405230+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:34.050183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.386577+0000","last_change":"2024-09-11T23:23:08.394424+0000","last_active":"2024-09-11T23:23:09.386577+0000","last_peered":"2024-09-11T23:23:09.386577+0000","last_clean":"2024-09-11T23:23:09.386577+0000","last_became_active":"2024-09-11T23:23:08.394122+0000","last_became_peered":"2024-09-11T23:23:08.394122+0000","last_unstale":"2024-09-11T23:23:09.386577+0000","last_undegraded":"2024-09-11T23:23:09.386577+0000","last_fullsized":"2024-09-11T23:23:09.386577+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:50.510840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.405572+0000","last_change":"2024-09-11T23:23:09.397206+0000","last_active":"2024-09-11T23:23:09.405572+0000","last_peered":"2024-09-11T23:23:09.405572+0000","last_clean":"2024-09-11T23:23:09.405572+0000","last_became_active":"2024-09-11T23:23:09.396892+0000","last_became_peered":"2024-09-11T23:23:09.396892+0000","last_unstale":"2024-09-11T23:23:09.405572+0000","last_undegraded":"2024-09-11T23:23:09.405572+0000","last_fullsized":"2024-09-11T23:23:09.405572+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:04.508401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"100'3","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.430247+0000","last_change":"2024-09-11T23:23:08.398678+0000","last_active":"2024-09-11T23:23:09.430247+0000","last_peered":"2024-09-11T23:23:09.430247+0000","last_clean":"2024-09-11T23:23:09.430247+0000","last_became_active":"2024-09-11T23:23:08.398241+0000","last_became_peered":"2024-09-11T23:23:08.398241+0000","last_unstale":"2024-09-11T23:23:09.430247+0000","last_undegraded":"2024-09-11T23:23:09.430247+0000","last_fullsized":"2024-09-11T23:23:09.430247+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:57.849160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401389+0000","last_change":"2024-09-11T23:23:09.408227+0000","last_active":"2024-09-11T23:23:10.401389+0000","last_peered":"2024-09-11T23:23:10.401389+0000","last_clean":"2024-09-11T23:23:10.401389+0000","last_became_active":"2024-09-11T23:23:09.407964+0000","last_became_peered":"2024-09-11T23:23:09.407964+0000","last_unstale":"2024-09-11T23:23:10.401389+0000","last_undegraded":"2024-09-11T23:23:10.401389+0000","last_fullsized":"2024-09-11T23:23:10.401389+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:22.413082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"100'6","reported_seq":18,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.432929+0000","last_change":"2024-09-11T23:23:08.400397+0000","last_active":"2024-09-11T23:23:09.432929+0000","last_peered":"2024-09-11T23:23:09.432929+0000","last_clean":"2024-09-11T23:23:09.432929+0000","last_became_active":"2024-09-11T23:23:08.400169+0000","last_became_peered":"2024-09-11T23:23:08.400169+0000","last_unstale":"2024-09-11T23:23:09.432929+0000","last_undegraded":"2024-09-11T23:23:09.432929+0000","last_fullsized":"2024-09-11T23:23:09.432929+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:29.673416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.405686+0000","last_change":"2024-09-11T23:23:09.398297+0000","last_active":"2024-09-11T23:23:09.405686+0000","last_peered":"2024-09-11T23:23:09.405686+0000","last_clean":"2024-09-11T23:23:09.405686+0000","last_became_active":"2024-09-11T23:23:09.396798+0000","last_became_peered":"2024-09-11T23:23:09.396798+0000","last_unstale":"2024-09-11T23:23:09.405686+0000","last_undegraded":"2024-09-11T23:23:09.405686+0000","last_fullsized":"2024-09-11T23:23:09.405686+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:02.154638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"100'2","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.425508+0000","last_change":"2024-09-11T23:23:08.389027+0000","last_active":"2024-09-11T23:23:09.425508+0000","last_peered":"2024-09-11T23:23:09.425508+0000","last_clean":"2024-09-11T23:23:09.425508+0000","last_became_active":"2024-09-11T23:23:08.388782+0000","last_became_peered":"2024-09-11T23:23:08.388782+0000","last_unstale":"2024-09-11T23:23:09.425508+0000","last_undegraded":"2024-09-11T23:23:09.425508+0000","last_fullsized":"2024-09-11T23:23:09.425508+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:26.430667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.416979+0000","last_change":"2024-09-11T23:23:09.410005+0000","last_active":"2024-09-11T23:23:09.416979+0000","last_peered":"2024-09-11T23:23:09.416979+0000","last_clean":"2024-09-11T23:23:09.416979+0000","last_became_active":"2024-09-11T23:23:09.409765+0000","last_became_peered":"2024-09-11T23:23:09.409765+0000","last_unstale":"2024-09-11T23:23:09.416979+0000","last_undegraded":"2024-09-11T23:23:09.416979+0000","last_fullsized":"2024-09-11T23:23:09.416979+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:04.247286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.404901+0000","last_change":"2024-09-11T23:23:08.394944+0000","last_active":"2024-09-11T23:23:10.404901+0000","last_peered":"2024-09-11T23:23:10.404901+0000","last_clean":"2024-09-11T23:23:10.404901+0000","last_became_active":"2024-09-11T23:23:08.394718+0000","last_became_peered":"2024-09-11T23:23:08.394718+0000","last_unstale":"2024-09-11T23:23:10.404901+0000","last_undegraded":"2024-09-11T23:23:10.404901+0000","last_fullsized":"2024-09-11T23:23:10.404901+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:31.448265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.405856+0000","last_change":"2024-09-11T23:23:09.401028+0000","last_active":"2024-09-11T23:23:09.405856+0000","last_peered":"2024-09-11T23:23:09.405856+0000","last_clean":"2024-09-11T23:23:09.405856+0000","last_became_active":"2024-09-11T23:23:09.399529+0000","last_became_peered":"2024-09-11T23:23:09.399529+0000","last_unstale":"2024-09-11T23:23:09.405856+0000","last_undegraded":"2024-09-11T23:23:09.405856+0000","last_fullsized":"2024-09-11T23:23:09.405856+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:29.063561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"100'8","reported_seq":22,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.399318+0000","last_change":"2024-09-11T23:23:08.396609+0000","last_active":"2024-09-11T23:23:10.399318+0000","last_peered":"2024-09-11T23:23:10.399318+0000","last_clean":"2024-09-11T23:23:10.399318+0000","last_became_active":"2024-09-11T23:23:08.396326+0000","last_became_peered":"2024-09-11T23:23:08.396326+0000","last_unstale":"2024-09-11T23:23:10.399318+0000","last_undegraded":"2024-09-11T23:23:10.399318+0000","last_fullsized":"2024-09-11T23:23:10.399318+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:38.183162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.399781+0000","last_change":"2024-09-11T23:23:09.419168+0000","last_active":"2024-09-11T23:23:10.399781+0000","last_peered":"2024-09-11T23:23:10.399781+0000","last_clean":"2024-09-11T23:23:10.399781+0000","last_became_active":"2024-09-11T23:23:09.418877+0000","last_became_peered":"2024-09-11T23:23:09.418877+0000","last_unstale":"2024-09-11T23:23:10.399781+0000","last_undegraded":"2024-09-11T23:23:10.399781+0000","last_fullsized":"2024-09-11T23:23:10.399781+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:19.001787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"100'1","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.429848+0000","last_change":"2024-09-11T23:23:08.398543+0000","last_active":"2024-09-11T23:23:09.429848+0000","last_peered":"2024-09-11T23:23:09.429848+0000","last_clean":"2024-09-11T23:23:09.429848+0000","last_became_active":"2024-09-11T23:23:08.398275+0000","last_became_peered":"2024-09-11T23:23:08.398275+0000","last_unstale":"2024-09-11T23:23:09.429848+0000","last_undegraded":"2024-09-11T23:23:09.429848+0000","last_fullsized":"2024-09-11T23:23:09.429848+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:06.599485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.422456+0000","last_change":"2024-09-11T23:23:09.417528+0000","last_active":"2024-09-11T23:23:09.422456+0000","last_peered":"2024-09-11T23:23:09.422456+0000","last_clean":"2024-09-11T23:23:09.422456+0000","last_became_active":"2024-09-11T23:23:09.417282+0000","last_became_peered":"2024-09-11T23:23:09.417282+0000","last_unstale":"2024-09-11T23:23:09.422456+0000","last_undegraded":"2024-09-11T23:23:09.422456+0000","last_fullsized":"2024-09-11T23:23:09.422456+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:40.635481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.399756+0000","last_change":"2024-09-11T23:23:08.388611+0000","last_active":"2024-09-11T23:23:10.399756+0000","last_peered":"2024-09-11T23:23:10.399756+0000","last_clean":"2024-09-11T23:23:10.399756+0000","last_became_active":"2024-09-11T23:23:08.388321+0000","last_became_peered":"2024-09-11T23:23:08.388321+0000","last_unstale":"2024-09-11T23:23:10.399756+0000","last_undegraded":"2024-09-11T23:23:10.399756+0000","last_fullsized":"2024-09-11T23:23:10.399756+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:51.496122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.423827+0000","last_change":"2024-09-11T23:23:09.422676+0000","last_active":"2024-09-11T23:23:09.423827+0000","last_peered":"2024-09-11T23:23:09.423827+0000","last_clean":"2024-09-11T23:23:09.423827+0000","last_became_active":"2024-09-11T23:23:09.422266+0000","last_became_peered":"2024-09-11T23:23:09.422266+0000","last_unstale":"2024-09-11T23:23:09.423827+0000","last_undegraded":"2024-09-11T23:23:09.423827+0000","last_fullsized":"2024-09-11T23:23:09.423827+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:17.223210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.405029+0000","last_change":"2024-09-11T23:23:08.390543+0000","last_active":"2024-09-11T23:23:10.405029+0000","last_peered":"2024-09-11T23:23:10.405029+0000","last_clean":"2024-09-11T23:23:10.405029+0000","last_became_active":"2024-09-11T23:23:08.389804+0000","last_became_peered":"2024-09-11T23:23:08.389804+0000","last_unstale":"2024-09-11T23:23:10.405029+0000","last_undegraded":"2024-09-11T23:23:10.405029+0000","last_fullsized":"2024-09-11T23:23:10.405029+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:11.776200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.415092+0000","last_change":"2024-09-11T23:23:09.411190+0000","last_active":"2024-09-11T23:23:09.415092+0000","last_peered":"2024-09-11T23:23:09.415092+0000","last_clean":"2024-09-11T23:23:09.415092+0000","last_became_active":"2024-09-11T23:23:09.409956+0000","last_became_peered":"2024-09-11T23:23:09.409956+0000","last_unstale":"2024-09-11T23:23:09.415092+0000","last_undegraded":"2024-09-11T23:23:09.415092+0000","last_fullsized":"2024-09-11T23:23:09.415092+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:22.413082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.400779+0000","last_change":"2024-09-11T23:23:08.398642+0000","last_active":"2024-09-11T23:23:10.400779+0000","last_peered":"2024-09-11T23:23:10.400779+0000","last_clean":"2024-09-11T23:23:10.400779+0000","last_became_active":"2024-09-11T23:23:08.398362+0000","last_became_peered":"2024-09-11T23:23:08.398362+0000","last_unstale":"2024-09-11T23:23:10.400779+0000","last_undegraded":"2024-09-11T23:23:10.400779+0000","last_fullsized":"2024-09-11T23:23:10.400779+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:19.516671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.408165+0000","last_change":"2024-09-11T23:23:09.406331+0000","last_active":"2024-09-11T23:23:09.408165+0000","last_peered":"2024-09-11T23:23:09.408165+0000","last_clean":"2024-09-11T23:23:09.408165+0000","last_became_active":"2024-09-11T23:23:09.405966+0000","last_became_peered":"2024-09-11T23:23:09.405966+0000","last_unstale":"2024-09-11T23:23:09.408165+0000","last_undegraded":"2024-09-11T23:23:09.408165+0000","last_fullsized":"2024-09-11T23:23:09.408165+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:18.522193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"100'2","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.424877+0000","last_change":"2024-09-11T23:23:08.393149+0000","last_active":"2024-09-11T23:23:09.424877+0000","last_peered":"2024-09-11T23:23:09.424877+0000","last_clean":"2024-09-11T23:23:09.424877+0000","last_became_active":"2024-09-11T23:23:08.392893+0000","last_became_peered":"2024-09-11T23:23:08.392893+0000","last_unstale":"2024-09-11T23:23:09.424877+0000","last_undegraded":"2024-09-11T23:23:09.424877+0000","last_fullsized":"2024-09-11T23:23:09.424877+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:24.183231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.424486+0000","last_change":"2024-09-11T23:23:09.422801+0000","last_active":"2024-09-11T23:23:09.424486+0000","last_peered":"2024-09-11T23:23:09.424486+0000","last_clean":"2024-09-11T23:23:09.424486+0000","last_became_active":"2024-09-11T23:23:09.422553+0000","last_became_peered":"2024-09-11T23:23:09.422553+0000","last_unstale":"2024-09-11T23:23:09.424486+0000","last_undegraded":"2024-09-11T23:23:09.424486+0000","last_fullsized":"2024-09-11T23:23:09.424486+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:32.383703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.399297+0000","last_change":"2024-09-11T23:23:08.393237+0000","last_active":"2024-09-11T23:23:10.399297+0000","last_peered":"2024-09-11T23:23:10.399297+0000","last_clean":"2024-09-11T23:23:10.399297+0000","last_became_active":"2024-09-11T23:23:08.392972+0000","last_became_peered":"2024-09-11T23:23:08.392972+0000","last_unstale":"2024-09-11T23:23:10.399297+0000","last_undegraded":"2024-09-11T23:23:10.399297+0000","last_fullsized":"2024-09-11T23:23:10.399297+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:57.505104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.414824+0000","last_change":"2024-09-11T23:23:09.410239+0000","last_active":"2024-09-11T23:23:09.414824+0000","last_peered":"2024-09-11T23:23:09.414824+0000","last_clean":"2024-09-11T23:23:09.414824+0000","last_became_active":"2024-09-11T23:23:09.409766+0000","last_became_peered":"2024-09-11T23:23:09.409766+0000","last_unstale":"2024-09-11T23:23:09.414824+0000","last_undegraded":"2024-09-11T23:23:09.414824+0000","last_fullsized":"2024-09-11T23:23:09.414824+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:35.086272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.399335+0000","last_change":"2024-09-11T23:23:08.388912+0000","last_active":"2024-09-11T23:23:09.399335+0000","last_peered":"2024-09-11T23:23:09.399335+0000","last_clean":"2024-09-11T23:23:09.399335+0000","last_became_active":"2024-09-11T23:23:08.388225+0000","last_became_peered":"2024-09-11T23:23:08.388225+0000","last_unstale":"2024-09-11T23:23:09.399335+0000","last_undegraded":"2024-09-11T23:23:09.399335+0000","last_fullsized":"2024-09-11T23:23:09.399335+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:11.242376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.405725+0000","last_change":"2024-09-11T23:23:09.400433+0000","last_active":"2024-09-11T23:23:09.405725+0000","last_peered":"2024-09-11T23:23:09.405725+0000","last_clean":"2024-09-11T23:23:09.405725+0000","last_became_active":"2024-09-11T23:23:09.400190+0000","last_became_peered":"2024-09-11T23:23:09.400190+0000","last_unstale":"2024-09-11T23:23:09.405725+0000","last_undegraded":"2024-09-11T23:23:09.405725+0000","last_fullsized":"2024-09-11T23:23:09.405725+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:18.005772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.394538+0000","last_change":"2024-09-11T23:23:08.393546+0000","last_active":"2024-09-11T23:23:09.394538+0000","last_peered":"2024-09-11T23:23:09.394538+0000","last_clean":"2024-09-11T23:23:09.394538+0000","last_became_active":"2024-09-11T23:23:08.393235+0000","last_became_peered":"2024-09-11T23:23:08.393235+0000","last_unstale":"2024-09-11T23:23:09.394538+0000","last_undegraded":"2024-09-11T23:23:09.394538+0000","last_fullsized":"2024-09-11T23:23:09.394538+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:03.120146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.405060+0000","last_change":"2024-09-11T23:23:09.413697+0000","last_active":"2024-09-11T23:23:10.405060+0000","last_peered":"2024-09-11T23:23:10.405060+0000","last_clean":"2024-09-11T23:23:10.405060+0000","last_became_active":"2024-09-11T23:23:09.413243+0000","last_became_peered":"2024-09-11T23:23:09.413243+0000","last_unstale":"2024-09-11T23:23:10.405060+0000","last_undegraded":"2024-09-11T23:23:10.405060+0000","last_fullsized":"2024-09-11T23:23:10.405060+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:24:22.089509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"100'2","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.430546+0000","last_change":"2024-09-11T23:23:08.399475+0000","last_active":"2024-09-11T23:23:09.430546+0000","last_peered":"2024-09-11T23:23:09.430546+0000","last_clean":"2024-09-11T23:23:09.430546+0000","last_became_active":"2024-09-11T23:23:08.399221+0000","last_became_peered":"2024-09-11T23:23:08.399221+0000","last_unstale":"2024-09-11T23:23:09.430546+0000","last_undegraded":"2024-09-11T23:23:09.430546+0000","last_fullsized":"2024-09-11T23:23:09.430546+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:55.910144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.417830+0000","last_change":"2024-09-11T23:23:09.409198+0000","last_active":"2024-09-11T23:23:09.417830+0000","last_peered":"2024-09-11T23:23:09.417830+0000","last_clean":"2024-09-11T23:23:09.417830+0000","last_became_active":"2024-09-11T23:23:09.408928+0000","last_became_peered":"2024-09-11T23:23:09.408928+0000","last_unstale":"2024-09-11T23:23:09.417830+0000","last_undegraded":"2024-09-11T23:23:09.417830+0000","last_fullsized":"2024-09-11T23:23:09.417830+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:47.307459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"101'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.406687+0000","last_change":"2024-09-11T23:23:08.391407+0000","last_active":"2024-09-11T23:23:10.406687+0000","last_peered":"2024-09-11T23:23:10.406687+0000","last_clean":"2024-09-11T23:23:10.406687+0000","last_became_active":"2024-09-11T23:23:08.391086+0000","last_became_peered":"2024-09-11T23:23:08.391086+0000","last_unstale":"2024-09-11T23:23:10.406687+0000","last_undegraded":"2024-09-11T23:23:10.406687+0000","last_fullsized":"2024-09-11T23:23:10.406687+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:20.797734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.416055+0000","last_change":"2024-09-11T23:23:09.405902+0000","last_active":"2024-09-11T23:23:09.416055+0000","last_peered":"2024-09-11T23:23:09.416055+0000","last_clean":"2024-09-11T23:23:09.416055+0000","last_became_active":"2024-09-11T23:23:09.402931+0000","last_became_peered":"2024-09-11T23:23:09.402931+0000","last_unstale":"2024-09-11T23:23:09.416055+0000","last_undegraded":"2024-09-11T23:23:09.416055+0000","last_fullsized":"2024-09-11T23:23:09.416055+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:56.082680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.396349+0000","last_change":"2024-09-11T23:23:08.391837+0000","last_active":"2024-09-11T23:23:09.396349+0000","last_peered":"2024-09-11T23:23:09.396349+0000","last_clean":"2024-09-11T23:23:09.396349+0000","last_became_active":"2024-09-11T23:23:08.391558+0000","last_became_peered":"2024-09-11T23:23:08.391558+0000","last_unstale":"2024-09-11T23:23:09.396349+0000","last_undegraded":"2024-09-11T23:23:09.396349+0000","last_fullsized":"2024-09-11T23:23:09.396349+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:38.498349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.405053+0000","last_change":"2024-09-11T23:23:09.406948+0000","last_active":"2024-09-11T23:23:10.405053+0000","last_peered":"2024-09-11T23:23:10.405053+0000","last_clean":"2024-09-11T23:23:10.405053+0000","last_became_active":"2024-09-11T23:23:09.406606+0000","last_became_peered":"2024-09-11T23:23:09.406606+0000","last_unstale":"2024-09-11T23:23:10.405053+0000","last_undegraded":"2024-09-11T23:23:10.405053+0000","last_fullsized":"2024-09-11T23:23:10.405053+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:35.086272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.386311+0000","last_change":"2024-09-11T23:23:08.389556+0000","last_active":"2024-09-11T23:23:09.386311+0000","last_peered":"2024-09-11T23:23:09.386311+0000","last_clean":"2024-09-11T23:23:09.386311+0000","last_became_active":"2024-09-11T23:23:08.389266+0000","last_became_peered":"2024-09-11T23:23:08.389266+0000","last_unstale":"2024-09-11T23:23:09.386311+0000","last_undegraded":"2024-09-11T23:23:09.386311+0000","last_fullsized":"2024-09-11T23:23:09.386311+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:20.250006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401306+0000","last_change":"2024-09-11T23:23:09.399569+0000","last_active":"2024-09-11T23:23:10.401306+0000","last_peered":"2024-09-11T23:23:10.401306+0000","last_clean":"2024-09-11T23:23:10.401306+0000","last_became_active":"2024-09-11T23:23:09.399263+0000","last_became_peered":"2024-09-11T23:23:09.399263+0000","last_unstale":"2024-09-11T23:23:10.401306+0000","last_undegraded":"2024-09-11T23:23:10.401306+0000","last_fullsized":"2024-09-11T23:23:10.401306+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:20.343496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401401+0000","last_change":"2024-09-11T23:23:08.386515+0000","last_active":"2024-09-11T23:23:10.401401+0000","last_peered":"2024-09-11T23:23:10.401401+0000","last_clean":"2024-09-11T23:23:10.401401+0000","last_became_active":"2024-09-11T23:23:08.386167+0000","last_became_peered":"2024-09-11T23:23:08.386167+0000","last_unstale":"2024-09-11T23:23:10.401401+0000","last_undegraded":"2024-09-11T23:23:10.401401+0000","last_fullsized":"2024-09-11T23:23:10.401401+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:16.108293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.402106+0000","last_change":"2024-09-11T23:23:09.401753+0000","last_active":"2024-09-11T23:23:10.402106+0000","last_peered":"2024-09-11T23:23:10.402106+0000","last_clean":"2024-09-11T23:23:10.402106+0000","last_became_active":"2024-09-11T23:23:09.401460+0000","last_became_peered":"2024-09-11T23:23:09.401460+0000","last_unstale":"2024-09-11T23:23:10.402106+0000","last_undegraded":"2024-09-11T23:23:10.402106+0000","last_fullsized":"2024-09-11T23:23:10.402106+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:35.086272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401428+0000","last_change":"2024-09-11T23:23:08.390027+0000","last_active":"2024-09-11T23:23:10.401428+0000","last_peered":"2024-09-11T23:23:10.401428+0000","last_clean":"2024-09-11T23:23:10.401428+0000","last_became_active":"2024-09-11T23:23:08.389711+0000","last_became_peered":"2024-09-11T23:23:08.389711+0000","last_unstale":"2024-09-11T23:23:10.401428+0000","last_undegraded":"2024-09-11T23:23:10.401428+0000","last_fullsized":"2024-09-11T23:23:10.401428+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:11.188381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.415749+0000","last_change":"2024-09-11T23:23:09.413070+0000","last_active":"2024-09-11T23:23:09.415749+0000","last_peered":"2024-09-11T23:23:09.415749+0000","last_clean":"2024-09-11T23:23:09.415749+0000","last_became_active":"2024-09-11T23:23:09.411671+0000","last_became_peered":"2024-09-11T23:23:09.411671+0000","last_unstale":"2024-09-11T23:23:09.415749+0000","last_undegraded":"2024-09-11T23:23:09.415749+0000","last_fullsized":"2024-09-11T23:23:09.415749+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:37.934590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.399354+0000","last_change":"2024-09-11T23:23:08.390564+0000","last_active":"2024-09-11T23:23:10.399354+0000","last_peered":"2024-09-11T23:23:10.399354+0000","last_clean":"2024-09-11T23:23:10.399354+0000","last_became_active":"2024-09-11T23:23:08.390291+0000","last_became_peered":"2024-09-11T23:23:08.390291+0000","last_unstale":"2024-09-11T23:23:10.399354+0000","last_undegraded":"2024-09-11T23:23:10.399354+0000","last_fullsized":"2024-09-11T23:23:10.399354+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:24.018239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.408332+0000","last_change":"2024-09-11T23:23:09.401803+0000","last_active":"2024-09-11T23:23:09.408332+0000","last_peered":"2024-09-11T23:23:09.408332+0000","last_clean":"2024-09-11T23:23:09.408332+0000","last_became_active":"2024-09-11T23:23:09.401507+0000","last_became_peered":"2024-09-11T23:23:09.401507+0000","last_unstale":"2024-09-11T23:23:09.408332+0000","last_undegraded":"2024-09-11T23:23:09.408332+0000","last_fullsized":"2024-09-11T23:23:09.408332+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:56.708016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.394429+0000","last_change":"2024-09-11T23:23:08.392903+0000","last_active":"2024-09-11T23:23:09.394429+0000","last_peered":"2024-09-11T23:23:09.394429+0000","last_clean":"2024-09-11T23:23:09.394429+0000","last_became_active":"2024-09-11T23:23:08.392642+0000","last_became_peered":"2024-09-11T23:23:08.392642+0000","last_unstale":"2024-09-11T23:23:09.394429+0000","last_undegraded":"2024-09-11T23:23:09.394429+0000","last_fullsized":"2024-09-11T23:23:09.394429+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:31.497338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.415535+0000","last_change":"2024-09-11T23:23:09.409669+0000","last_active":"2024-09-11T23:23:09.415535+0000","last_peered":"2024-09-11T23:23:09.415535+0000","last_clean":"2024-09-11T23:23:09.415535+0000","last_became_active":"2024-09-11T23:23:09.409415+0000","last_became_peered":"2024-09-11T23:23:09.409415+0000","last_unstale":"2024-09-11T23:23:09.415535+0000","last_undegraded":"2024-09-11T23:23:09.415535+0000","last_fullsized":"2024-09-11T23:23:09.415535+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:08.365387+0000","last_clean_scrub_stamp":"2024-09-11T23:23:08.365387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:27.268255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-11T23:23:10.401125+0000","last_change":"2024-09-11T23:23:08.391755+0000","last_active":"2024-09-11T23:23:10.401125+0000","last_peered":"2024-09-11T23:23:10.401125+0000","last_clean":"2024-09-11T23:23:10.401125+0000","last_became_active":"2024-09-11T23:23:08.391472+0000","last_became_peered":"2024-09-11T23:23:08.391472+0000","last_unstale":"2024-09-11T23:23:10.401125+0000","last_undegraded":"2024-09-11T23:23:10.401125+0000","last_fullsized":"2024-09-11T23:23:10.401125+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:23:07.357969+0000","last_clean_scrub_stamp":"2024-09-11T23:23:07.357969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:34.509150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":356,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-11T23:23:09.398083+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:23:09.398083+0000","last_peered":"2024-09-11T23:23:09.398083+0000","last_clean":"2024-09-11T23:23:09.398083+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:23:09.398083+0000","last_undegraded":"2024-09-11T23:23:09.398083+0000","last_fullsized":"2024-09-11T23:23:09.398083+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476805,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32984,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338856,"statfs":{"total":96636764160,"available":96602988544,"internally_reserved":0,"allocated":1835008,"data_stored":1128071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476804,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1236992,"data_stored":537157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476803,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1253376,"data_stored":543991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476803,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1232896,"data_stored":537087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542212,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1249280,"data_stored":538769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542212,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1232896,"data_stored":537087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1241088,"data_stored":537211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509508,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32992,"kb_used_data":1804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338848,"statfs":{"total":96636764160,"available":96602980352,"internally_reserved":0,"allocated":1847296,"data_stored":1129179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:23:13.964 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:23:13.964 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:23:14.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.161+0000 7fa247000640 1 Processor -- start 2024-09-11T23:23:14.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.161+0000 7fa247000640 1 -- start start 2024-09-11T23:23:14.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.162+0000 7fa247000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa24015b1d0 0x7fa2400b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:14.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.162+0000 7fa247000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa24015fb80 con 0x7fa240071ec0 2024-09-11T23:23:14.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.162+0000 7fa247000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa24015b5b0 con 0x7fa2400ce090 2024-09-11T23:23:14.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.162+0000 7fa247000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa2400b21b0 con 0x7fa24015b1d0 2024-09-11T23:23:14.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.162+0000 7fa246600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa240071ec0 0x7fa24015f470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56626/0 (socket says 172.21.15.144:56626) 2024-09-11T23:23:14.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.162+0000 7fa246600640 1 -- 172.21.15.144:0/1290477060 learned_addr learned my addr 172.21.15.144:0/1290477060 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:14.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.162+0000 7fa245c00640 1 --2- 172.21.15.144:0/1290477060 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa24015b1d0 0x7fa2400b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:14.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.163+0000 7fa23fe00640 1 -- 172.21.15.144:0/1290477060 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2543982703 0 0) 0x7fa24015fb80 con 0x7fa240071ec0 2024-09-11T23:23:14.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.163+0000 7fa23fe00640 1 -- 172.21.15.144:0/1290477060 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa228003520 con 0x7fa240071ec0 2024-09-11T23:23:14.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.163+0000 7fa23fe00640 1 -- 172.21.15.144:0/1290477060 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1103370403 0 0) 0x7fa24015b5b0 con 0x7fa2400ce090 2024-09-11T23:23:14.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.163+0000 7fa23fe00640 1 -- 172.21.15.144:0/1290477060 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa24015fb80 con 0x7fa2400ce090 2024-09-11T23:23:14.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.163+0000 7fa23fe00640 1 -- 172.21.15.144:0/1290477060 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2616078732 0 0) 0x7fa228003520 con 0x7fa240071ec0 2024-09-11T23:23:14.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.163+0000 7fa245c00640 1 -- 172.21.15.144:0/1290477060 >> v1:172.21.15.165:6789/0 conn(0x7fa2400ce090 legacy=0x7fa24015ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:14.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.163+0000 7fa245c00640 1 -- 172.21.15.144:0/1290477060 >> v1:172.21.15.144:6789/0 conn(0x7fa240071ec0 legacy=0x7fa24015f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:14.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.163+0000 7fa245c00640 1 -- 172.21.15.144:0/1290477060 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2400b4800 con 0x7fa24015b1d0 2024-09-11T23:23:14.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.164+0000 7fa245c00640 1 --2- 172.21.15.144:0/1290477060 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa24015b1d0 0x7fa2400b3be0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa2340097d0 tx=0x7fa23402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a0d97bcfc95fd32 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:14.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.164+0000 7fa23fe00640 1 -- 172.21.15.144:0/1290477060 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234037070 con 0x7fa24015b1d0 2024-09-11T23:23:14.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.164+0000 7fa23fe00640 1 -- 172.21.15.144:0/1290477060 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa23402ab90 con 0x7fa24015b1d0 2024-09-11T23:23:14.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.164+0000 7fa23fe00640 1 -- 172.21.15.144:0/1290477060 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2380019f0 con 0x7fa24015b1d0 2024-09-11T23:23:14.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.165+0000 7fa247000640 1 -- 172.21.15.144:0/1290477060 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa24015b1d0 msgr2=0x7fa2400b3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:14.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.165+0000 7fa247000640 1 --2- 172.21.15.144:0/1290477060 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa24015b1d0 0x7fa2400b3be0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa2340097d0 tx=0x7fa23402a100 comp rx=0 tx=0).stop 2024-09-11T23:23:14.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.165+0000 7fa247000640 1 -- 172.21.15.144:0/1290477060 shutdown_connections 2024-09-11T23:23:14.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.165+0000 7fa247000640 1 --2- 172.21.15.144:0/1290477060 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa24015b1d0 0x7fa2400b3be0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:14.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.165+0000 7fa247000640 1 -- 172.21.15.144:0/1290477060 >> 172.21.15.144:0/1290477060 conn(0x7fa24006bba0 msgr2=0x7fa24006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:14.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.165+0000 7fa247000640 1 -- 172.21.15.144:0/1290477060 shutdown_connections 2024-09-11T23:23:14.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.165+0000 7fa247000640 1 -- 172.21.15.144:0/1290477060 wait complete. 2024-09-11T23:23:14.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.167+0000 7fa247000640 1 Processor -- start 2024-09-11T23:23:14.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.167+0000 7fa247000640 1 -- start start 2024-09-11T23:23:14.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.168+0000 7fa247000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa240071ec0 0x7fa2401f7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:14.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.168+0000 7fa247000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2400ce090 0x7fa24014ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:14.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.168+0000 7fa247000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa24015b1d0 0x7fa240156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:14.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.168+0000 7fa247000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa2400b50a0 con 0x7fa240071ec0 2024-09-11T23:23:14.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.168+0000 7fa247000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa2400b4dc0 con 0x7fa24015b1d0 2024-09-11T23:23:14.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.168+0000 7fa247000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa2400b5380 con 0x7fa2400ce090 2024-09-11T23:23:14.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.168+0000 7fa245c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa240071ec0 0x7fa2401f7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:14.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.168+0000 7fa245c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa240071ec0 0x7fa2401f7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:43138/0 (socket says 172.21.15.144:43138) 2024-09-11T23:23:14.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.168+0000 7fa245c00640 1 -- 172.21.15.144:0/848128658 learned_addr learned my addr 172.21.15.144:0/848128658 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:14.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.168+0000 7fa245200640 1 --2- 172.21.15.144:0/848128658 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2400ce090 0x7fa24014ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:14.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.168+0000 7fa246600640 1 --2- 172.21.15.144:0/848128658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa24015b1d0 0x7fa240156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:14.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.168+0000 7fa245c00640 1 -- 172.21.15.144:0/848128658 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2400ce090 msgr2=0x7fa24014ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:14.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.168+0000 7fa245c00640 1 --2- 172.21.15.144:0/848128658 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2400ce090 0x7fa24014ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:14.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.168+0000 7fa245c00640 1 -- 172.21.15.144:0/848128658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa24015b1d0 msgr2=0x7fa240156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:14.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.168+0000 7fa245c00640 1 --2- 172.21.15.144:0/848128658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa24015b1d0 0x7fa240156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:14.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.168+0000 7fa245c00640 1 -- 172.21.15.144:0/848128658 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2401f78d0 con 0x7fa240071ec0 2024-09-11T23:23:14.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.168+0000 7fa246600640 1 --2- 172.21.15.144:0/848128658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa24015b1d0 0x7fa240156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:23:14.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.168+0000 7fa245200640 1 --2- 172.21.15.144:0/848128658 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2400ce090 0x7fa24014ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:23:14.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.169+0000 7fa245c00640 1 --2- 172.21.15.144:0/848128658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa240071ec0 0x7fa2401f7390 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fa2340097d0 tx=0x7fa2340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:14.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.169+0000 7fa23d600640 1 -- 172.21.15.144:0/848128658 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234037050 con 0x7fa240071ec0 2024-09-11T23:23:14.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.169+0000 7fa23d600640 1 -- 172.21.15.144:0/848128658 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa234043070 con 0x7fa240071ec0 2024-09-11T23:23:14.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.169+0000 7fa23d600640 1 -- 172.21.15.144:0/848128658 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23403ca50 con 0x7fa240071ec0 2024-09-11T23:23:14.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.169+0000 7fa247000640 1 -- 172.21.15.144:0/848128658 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa24014ffb0 con 0x7fa240071ec0 2024-09-11T23:23:14.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.169+0000 7fa247000640 1 -- 172.21.15.144:0/848128658 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa240150570 con 0x7fa240071ec0 2024-09-11T23:23:14.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.170+0000 7fa247000640 1 -- 172.21.15.144:0/848128658 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2400b4440 con 0x7fa240071ec0 2024-09-11T23:23:14.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.171+0000 7fa23d600640 1 -- 172.21.15.144:0/848128658 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fa23403cbf0 con 0x7fa240071ec0 2024-09-11T23:23:14.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.172+0000 7fa23d600640 1 --2- 172.21.15.144:0/848128658 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa22006bf50 0x7fa22006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:14.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.172+0000 7fa23d600640 1 -- 172.21.15.144:0/848128658 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7fa2340abb20 con 0x7fa240071ec0 2024-09-11T23:23:14.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.173+0000 7fa245200640 1 --2- 172.21.15.144:0/848128658 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa22006bf50 0x7fa22006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:14.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.173+0000 7fa245200640 1 --2- 172.21.15.144:0/848128658 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa22006bf50 0x7fa22006e410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa240144b10 tx=0x7fa22c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:14.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.177+0000 7fa23d600640 1 -- 172.21.15.144:0/848128658 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa234046360 con 0x7fa240071ec0 2024-09-11T23:23:14.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.413+0000 7fa247000640 1 -- 172.21.15.144:0/848128658 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa2400b39a0 con 0x7fa240071ec0 2024-09-11T23:23:14.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.417+0000 7fa23d600640 1 -- 172.21.15.144:0/848128658 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7fa23407a570 con 0x7fa240071ec0 2024-09-11T23:23:14.417 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-11T23:23:14.417 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A== 2024-09-11T23:23:14.417 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-11T23:23:14.417 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-11T23:23:14.417 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:23:14.417 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-11T23:23:14.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.419+0000 7fa247000640 1 -- 172.21.15.144:0/848128658 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa22006bf50 msgr2=0x7fa22006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:14.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.419+0000 7fa247000640 1 --2- 172.21.15.144:0/848128658 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa22006bf50 0x7fa22006e410 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa240144b10 tx=0x7fa22c009040 comp rx=0 tx=0).stop 2024-09-11T23:23:14.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.419+0000 7fa247000640 1 -- 172.21.15.144:0/848128658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa240071ec0 msgr2=0x7fa2401f7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:14.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.419+0000 7fa247000640 1 --2- 172.21.15.144:0/848128658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa240071ec0 0x7fa2401f7390 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fa2340097d0 tx=0x7fa2340046c0 comp rx=0 tx=0).stop 2024-09-11T23:23:14.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.419+0000 7fa247000640 1 -- 172.21.15.144:0/848128658 shutdown_connections 2024-09-11T23:23:14.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.419+0000 7fa247000640 1 --2- 172.21.15.144:0/848128658 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa22006bf50 0x7fa22006e410 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:14.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.419+0000 7fa247000640 1 --2- 172.21.15.144:0/848128658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa24015b1d0 0x7fa240156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:14.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.419+0000 7fa247000640 1 --2- 172.21.15.144:0/848128658 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2400ce090 0x7fa24014ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:14.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.419+0000 7fa247000640 1 --2- 172.21.15.144:0/848128658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa240071ec0 0x7fa2401f7390 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:14.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.419+0000 7fa247000640 1 -- 172.21.15.144:0/848128658 >> 172.21.15.144:0/848128658 conn(0x7fa24006bba0 msgr2=0x7fa240073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:14.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.420+0000 7fa247000640 1 -- 172.21.15.144:0/848128658 shutdown_connections 2024-09-11T23:23:14.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.420+0000 7fa247000640 1 -- 172.21.15.144:0/848128658 wait complete. 2024-09-11T23:23:14.436 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:23:14.507 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:23:14.512 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:23:14.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.593+0000 7fd1be000640 1 Processor -- start 2024-09-11T23:23:14.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.594+0000 7fd1be000640 1 -- start start 2024-09-11T23:23:14.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.595+0000 7fd1be000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1b815f570 0x7fd1b8071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:14.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.595+0000 7fd1be000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1b80d1d90 con 0x7fd1b80b6c60 2024-09-11T23:23:14.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.595+0000 7fd1be000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1b80d2070 con 0x7fd1b80d0370 2024-09-11T23:23:14.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.595+0000 7fd1be000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd1b8070a60 con 0x7fd1b815f570 2024-09-11T23:23:14.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.595+0000 7fd1bcc00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd1b80b6c60 0x7fd1b80b7040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50018/0 (socket says 172.21.15.144:50018) 2024-09-11T23:23:14.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.595+0000 7fd1bcc00640 1 -- 172.21.15.144:0/2775353618 learned_addr learned my addr 172.21.15.144:0/2775353618 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:14.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.595+0000 7fd1b7e00640 1 --2- 172.21.15.144:0/2775353618 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1b815f570 0x7fd1b8071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:14.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.595+0000 7fd1b7400640 1 -- 172.21.15.144:0/2775353618 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3460151561 0 0) 0x7fd1b80d1d90 con 0x7fd1b80b6c60 2024-09-11T23:23:14.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.595+0000 7fd1b7400640 1 -- 172.21.15.144:0/2775353618 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1a0003520 con 0x7fd1b80b6c60 2024-09-11T23:23:14.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.596+0000 7fd1b7400640 1 -- 172.21.15.144:0/2775353618 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1338022929 0 0) 0x7fd1b80d2070 con 0x7fd1b80d0370 2024-09-11T23:23:14.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.596+0000 7fd1b7400640 1 -- 172.21.15.144:0/2775353618 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1b80d1d90 con 0x7fd1b80d0370 2024-09-11T23:23:14.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.596+0000 7fd1b7400640 1 -- 172.21.15.144:0/2775353618 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 529334845 0 0) 0x7fd1a0003520 con 0x7fd1b80b6c60 2024-09-11T23:23:14.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.596+0000 7fd1b7e00640 1 -- 172.21.15.144:0/2775353618 >> v1:172.21.15.165:6789/0 conn(0x7fd1b80d0370 legacy=0x7fd1b80d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:14.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.596+0000 7fd1b7e00640 1 -- 172.21.15.144:0/2775353618 >> v1:172.21.15.144:6789/0 conn(0x7fd1b80b6c60 legacy=0x7fd1b80b7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:14.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.596+0000 7fd1b7e00640 1 -- 172.21.15.144:0/2775353618 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b8070d40 con 0x7fd1b815f570 2024-09-11T23:23:14.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.597+0000 7fd1b7e00640 1 --2- 172.21.15.144:0/2775353618 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1b815f570 0x7fd1b8071260 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40097d0 tx=0x7fd1a402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1a2e648d4f10191 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:14.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.597+0000 7fd1b7400640 1 -- 172.21.15.144:0/2775353618 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4037070 con 0x7fd1b815f570 2024-09-11T23:23:14.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.597+0000 7fd1b7400640 1 -- 172.21.15.144:0/2775353618 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1a402ab90 con 0x7fd1b815f570 2024-09-11T23:23:14.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.597+0000 7fd1b7400640 1 -- 172.21.15.144:0/2775353618 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac001670 con 0x7fd1b815f570 2024-09-11T23:23:14.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.598+0000 7fd1be000640 1 -- 172.21.15.144:0/2775353618 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1b815f570 msgr2=0x7fd1b8071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:14.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.598+0000 7fd1be000640 1 --2- 172.21.15.144:0/2775353618 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1b815f570 0x7fd1b8071260 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40097d0 tx=0x7fd1a402a100 comp rx=0 tx=0).stop 2024-09-11T23:23:14.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.598+0000 7fd1be000640 1 -- 172.21.15.144:0/2775353618 shutdown_connections 2024-09-11T23:23:14.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.598+0000 7fd1be000640 1 --2- 172.21.15.144:0/2775353618 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1b815f570 0x7fd1b8071260 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:14.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.598+0000 7fd1be000640 1 -- 172.21.15.144:0/2775353618 >> 172.21.15.144:0/2775353618 conn(0x7fd1b806f390 msgr2=0x7fd1b806f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:14.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.598+0000 7fd1be000640 1 -- 172.21.15.144:0/2775353618 shutdown_connections 2024-09-11T23:23:14.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.598+0000 7fd1be000640 1 -- 172.21.15.144:0/2775353618 wait complete. 2024-09-11T23:23:14.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.599+0000 7fd1be000640 1 Processor -- start 2024-09-11T23:23:14.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.600+0000 7fd1be000640 1 -- start start 2024-09-11T23:23:14.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.600+0000 7fd1be000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1b80b6c60 0x7fd1b814ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:14.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.600+0000 7fd1be000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1b80d0370 0x7fd1b80cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:14.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.600+0000 7fd1be000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1b815f570 0x7fd1b80ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:14.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.601+0000 7fd1be000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b8158f30 con 0x7fd1b80b6c60 2024-09-11T23:23:14.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.601+0000 7fd1be000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b80d1a50 con 0x7fd1b80d0370 2024-09-11T23:23:14.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.601+0000 7fd1be000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd1b815f9d0 con 0x7fd1b815f570 2024-09-11T23:23:14.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.601+0000 7fd1bcc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1b80b6c60 0x7fd1b814ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:14.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.601+0000 7fd1bcc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1b80b6c60 0x7fd1b814ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49886/0 (socket says 172.21.15.144:49886) 2024-09-11T23:23:14.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.601+0000 7fd1bcc00640 1 -- 172.21.15.144:0/3579377007 learned_addr learned my addr 172.21.15.144:0/3579377007 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:14.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.601+0000 7fd1b7e00640 1 --2- 172.21.15.144:0/3579377007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1b80d0370 0x7fd1b80cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:14.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.601+0000 7fd1bd600640 1 --2- 172.21.15.144:0/3579377007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1b815f570 0x7fd1b80ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:14.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.601+0000 7fd1bcc00640 1 -- 172.21.15.144:0/3579377007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1b815f570 msgr2=0x7fd1b80ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:14.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.601+0000 7fd1bcc00640 1 --2- 172.21.15.144:0/3579377007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1b815f570 0x7fd1b80ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:14.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.601+0000 7fd1bcc00640 1 -- 172.21.15.144:0/3579377007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1b80d0370 msgr2=0x7fd1b80cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:14.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.601+0000 7fd1bcc00640 1 --2- 172.21.15.144:0/3579377007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1b80d0370 0x7fd1b80cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:14.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.601+0000 7fd1bcc00640 1 -- 172.21.15.144:0/3579377007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b815aa00 con 0x7fd1b80b6c60 2024-09-11T23:23:14.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.601+0000 7fd1bcc00640 1 --2- 172.21.15.144:0/3579377007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1b80b6c60 0x7fd1b814ec60 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00c4f0 tx=0x7fd1ac00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:14.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.602+0000 7fd1b4c00640 1 -- 172.21.15.144:0/3579377007 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac017070 con 0x7fd1b80b6c60 2024-09-11T23:23:14.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.602+0000 7fd1b4c00640 1 -- 172.21.15.144:0/3579377007 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1ac005ce0 con 0x7fd1b80b6c60 2024-09-11T23:23:14.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.602+0000 7fd1be000640 1 -- 172.21.15.144:0/3579377007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1b80cb9d0 con 0x7fd1b80b6c60 2024-09-11T23:23:14.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.602+0000 7fd1b4c00640 1 -- 172.21.15.144:0/3579377007 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac007290 con 0x7fd1b80b6c60 2024-09-11T23:23:14.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.602+0000 7fd1be000640 1 -- 172.21.15.144:0/3579377007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1b815a720 con 0x7fd1b80b6c60 2024-09-11T23:23:14.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.603+0000 7fd1be000640 1 -- 172.21.15.144:0/3579377007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1b80d2070 con 0x7fd1b80b6c60 2024-09-11T23:23:14.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.604+0000 7fd1b4c00640 1 -- 172.21.15.144:0/3579377007 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fd1ac01a070 con 0x7fd1b80b6c60 2024-09-11T23:23:14.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.605+0000 7fd1b4c00640 1 --2- 172.21.15.144:0/3579377007 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd19806bf50 0x7fd19806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:14.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.605+0000 7fd1b4c00640 1 -- 172.21.15.144:0/3579377007 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7fd1ac08a340 con 0x7fd1b80b6c60 2024-09-11T23:23:14.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.605+0000 7fd1b7e00640 1 --2- 172.21.15.144:0/3579377007 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd19806bf50 0x7fd19806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:14.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.606+0000 7fd1b7e00640 1 --2- 172.21.15.144:0/3579377007 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd19806bf50 0x7fd19806e410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4034000 tx=0x7fd1a402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:14.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.609+0000 7fd1b4c00640 1 -- 172.21.15.144:0/3579377007 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd1ac058620 con 0x7fd1b80b6c60 2024-09-11T23:23:14.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.818+0000 7fd1be000640 1 -- 172.21.15.144:0/3579377007 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd1b80b2e30 con 0x7fd1b80b6c60 2024-09-11T23:23:14.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.818+0000 7fd1b4c00640 1 -- 172.21.15.144:0/3579377007 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5234 (secure 0 0 0) 0x7fd1ac05c920 con 0x7fd1b80b6c60 2024-09-11T23:23:14.819 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:14.819 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":71,"btime":"2024-09-11T23:23:12:403951+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2463021219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2463021219},{"type":"v1","addr":"172.21.15.165:6835","nonce":2463021219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6900,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/2687483394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2687483394},{"type":"v1","addr":"172.21.15.144:6801","nonce":2687483394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2256829982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2256829982},{"type":"v1","addr":"172.21.15.165:6834","nonce":2256829982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:23:08.790322+0000","modified":"2024-09-11T23:23:11.810403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6909},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6909":{"gid":6909,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/419371779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":419371779},{"type":"v1","addr":"172.21.15.144:6835","nonce":419371779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6909,"qdb_cluster":[6909]},"id":8}]} 2024-09-11T23:23:14.819 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 71 2024-09-11T23:23:14.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.821+0000 7fd1be000640 1 -- 172.21.15.144:0/3579377007 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd19806bf50 msgr2=0x7fd19806e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:14.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.821+0000 7fd1be000640 1 --2- 172.21.15.144:0/3579377007 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd19806bf50 0x7fd19806e410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4034000 tx=0x7fd1a402e000 comp rx=0 tx=0).stop 2024-09-11T23:23:14.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.821+0000 7fd1be000640 1 -- 172.21.15.144:0/3579377007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1b80b6c60 msgr2=0x7fd1b814ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:14.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.821+0000 7fd1be000640 1 --2- 172.21.15.144:0/3579377007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1b80b6c60 0x7fd1b814ec60 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00c4f0 tx=0x7fd1ac00c9b0 comp rx=0 tx=0).stop 2024-09-11T23:23:14.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.821+0000 7fd1be000640 1 -- 172.21.15.144:0/3579377007 shutdown_connections 2024-09-11T23:23:14.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.821+0000 7fd1be000640 1 --2- 172.21.15.144:0/3579377007 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd19806bf50 0x7fd19806e410 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:14.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.821+0000 7fd1be000640 1 --2- 172.21.15.144:0/3579377007 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1b815f570 0x7fd1b80ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:14.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.821+0000 7fd1be000640 1 --2- 172.21.15.144:0/3579377007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1b80d0370 0x7fd1b80cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:14.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.821+0000 7fd1be000640 1 --2- 172.21.15.144:0/3579377007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1b80b6c60 0x7fd1b814ec60 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:14.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.821+0000 7fd1be000640 1 -- 172.21.15.144:0/3579377007 >> 172.21.15.144:0/3579377007 conn(0x7fd1b806f390 msgr2=0x7fd1b8161500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:14.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.821+0000 7fd1be000640 1 -- 172.21.15.144:0/3579377007 shutdown_connections 2024-09-11T23:23:14.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:14.821+0000 7fd1be000640 1 -- 172.21.15.144:0/3579377007 wait complete. 2024-09-11T23:23:15.239 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:23:08.790322+0000', 'modified': '2024-09-11T23:23:11.810403+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6909}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6909': {'gid': 6909, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6835/419371779', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 419371779}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 419371779}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6909, 'qdb_cluster': [6909]} 2024-09-11T23:23:15.239 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:23:15.239 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T23:23:15.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.396+0000 7f21e3200640 1 Processor -- start 2024-09-11T23:23:15.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.396+0000 7f21e3200640 1 -- start start 2024-09-11T23:23:15.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.397+0000 7f21e3200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f21e406feb0 0x7f21e415c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.397+0000 7f21e3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21e40708a0 0x7f21e4073530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.397+0000 7f21e3200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21e415ce80 con 0x7f21e40b6bb0 2024-09-11T23:23:15.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.397+0000 7f21e3200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f21e415d160 con 0x7f21e406feb0 2024-09-11T23:23:15.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.397+0000 7f21e3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f21e415d440 con 0x7f21e40708a0 2024-09-11T23:23:15.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.398+0000 7f21e2800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21e40708a0 0x7f21e4073530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.398+0000 7f21e1400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f21e406feb0 0x7f21e415c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.398+0000 7f21e1e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f21e40b6bb0 0x7f21e40b6f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:48970/0 (socket says 172.21.15.144:48970) 2024-09-11T23:23:15.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.398+0000 7f21e1e00640 1 -- 172.21.15.144:0/152968233 learned_addr learned my addr 172.21.15.144:0/152968233 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:15.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.399+0000 7f21e1400640 1 -- 172.21.15.144:0/152968233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21e40708a0 msgr2=0x7f21e4073530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:15.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.399+0000 7f21e1400640 1 --2- 172.21.15.144:0/152968233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21e40708a0 0x7f21e4073530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.399+0000 7f21e1400640 1 -- 172.21.15.144:0/152968233 >> v1:172.21.15.165:6789/0 conn(0x7f21e40b6bb0 legacy=0x7f21e40b6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:15.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.399+0000 7f21e1400640 1 -- 172.21.15.144:0/152968233 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e415d720 con 0x7f21e406feb0 2024-09-11T23:23:15.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.400+0000 7f21e1400640 1 --2- 172.21.15.144:0/152968233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21e406feb0 0x7f21e415c860 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f21d00097a0 tx=0x7f21d002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cdf795913b2f42d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:15.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.400+0000 7f21e0a00640 1 -- 172.21.15.144:0/152968233 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d0037070 con 0x7f21e406feb0 2024-09-11T23:23:15.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.400+0000 7f21e0a00640 1 -- 172.21.15.144:0/152968233 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d0032440 con 0x7f21e406feb0 2024-09-11T23:23:15.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.400+0000 7f21e0a00640 1 -- 172.21.15.144:0/152968233 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d0032810 con 0x7f21e406feb0 2024-09-11T23:23:15.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.401+0000 7f21e3200640 1 -- 172.21.15.144:0/152968233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21e406feb0 msgr2=0x7f21e415c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:15.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.401+0000 7f21e3200640 1 --2- 172.21.15.144:0/152968233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21e406feb0 0x7f21e415c860 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f21d00097a0 tx=0x7f21d002a180 comp rx=0 tx=0).stop 2024-09-11T23:23:15.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.401+0000 7f21e3200640 1 -- 172.21.15.144:0/152968233 shutdown_connections 2024-09-11T23:23:15.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.401+0000 7f21e3200640 1 --2- 172.21.15.144:0/152968233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21e40708a0 0x7f21e4073530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.401+0000 7f21e3200640 1 --2- 172.21.15.144:0/152968233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21e406feb0 0x7f21e415c860 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.401+0000 7f21e3200640 1 -- 172.21.15.144:0/152968233 >> 172.21.15.144:0/152968233 conn(0x7f21e406f390 msgr2=0x7f21e406f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:15.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.401+0000 7f21e3200640 1 -- 172.21.15.144:0/152968233 shutdown_connections 2024-09-11T23:23:15.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.401+0000 7f21e3200640 1 -- 172.21.15.144:0/152968233 wait complete. 2024-09-11T23:23:15.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.402+0000 7f21e3200640 1 Processor -- start 2024-09-11T23:23:15.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.403+0000 7f21e3200640 1 -- start start 2024-09-11T23:23:15.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.403+0000 7f21e3200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21e406feb0 0x7f21e4160480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.403+0000 7f21e3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21e40708a0 0x7f21e4157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.403+0000 7f21e3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21e40b6bb0 0x7f21e41f1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.403+0000 7f21e3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f21e415a2d0 con 0x7f21e40708a0 2024-09-11T23:23:15.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.403+0000 7f21e3200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f21e415a150 con 0x7f21e406feb0 2024-09-11T23:23:15.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.403+0000 7f21e3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f21e40b1de0 con 0x7f21e40b6bb0 2024-09-11T23:23:15.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.404+0000 7f21e1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21e40708a0 0x7f21e4157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.404+0000 7f21e1400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21e40708a0 0x7f21e4157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49896/0 (socket says 172.21.15.144:49896) 2024-09-11T23:23:15.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.404+0000 7f21e1400640 1 -- 172.21.15.144:0/485255280 learned_addr learned my addr 172.21.15.144:0/485255280 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:15.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.404+0000 7f21e2800640 1 --2- 172.21.15.144:0/485255280 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21e40b6bb0 0x7f21e41f1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.404+0000 7f21e1e00640 1 --2- 172.21.15.144:0/485255280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21e406feb0 0x7f21e4160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.404+0000 7f21e1400640 1 -- 172.21.15.144:0/485255280 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21e40b6bb0 msgr2=0x7f21e41f1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:15.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.404+0000 7f21e1400640 1 --2- 172.21.15.144:0/485255280 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21e40b6bb0 0x7f21e41f1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.404+0000 7f21e1400640 1 -- 172.21.15.144:0/485255280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21e406feb0 msgr2=0x7f21e4160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:15.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.404+0000 7f21e1400640 1 --2- 172.21.15.144:0/485255280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21e406feb0 0x7f21e4160480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.404+0000 7f21e1400640 1 -- 172.21.15.144:0/485255280 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e414b000 con 0x7f21e40708a0 2024-09-11T23:23:15.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.404+0000 7f21e1400640 1 --2- 172.21.15.144:0/485255280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21e40708a0 0x7f21e4157c60 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f21d0035040 tx=0x7f21d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:15.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.405+0000 7f21da000640 1 -- 172.21.15.144:0/485255280 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d0041020 con 0x7f21e40708a0 2024-09-11T23:23:15.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.405+0000 7f21da000640 1 -- 172.21.15.144:0/485255280 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d0030700 con 0x7f21e40708a0 2024-09-11T23:23:15.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.405+0000 7f21e3200640 1 -- 172.21.15.144:0/485255280 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e414b2e0 con 0x7f21e40708a0 2024-09-11T23:23:15.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.405+0000 7f21da000640 1 -- 172.21.15.144:0/485255280 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d0037040 con 0x7f21e40708a0 2024-09-11T23:23:15.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.405+0000 7f21e3200640 1 -- 172.21.15.144:0/485255280 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e414b8a0 con 0x7f21e40708a0 2024-09-11T23:23:15.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.407+0000 7f21da000640 1 -- 172.21.15.144:0/485255280 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f21d0044020 con 0x7f21e40708a0 2024-09-11T23:23:15.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.408+0000 7f21da000640 1 --2- 172.21.15.144:0/485255280 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f21c406bf50 0x7f21c406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.408+0000 7f21da000640 1 -- 172.21.15.144:0/485255280 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f21d00ab860 con 0x7f21e40708a0 2024-09-11T23:23:15.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.408+0000 7f21ec262740 1 Processor -- start 2024-09-11T23:23:15.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.408+0000 7f21e1e00640 1 --2- 172.21.15.144:0/485255280 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f21c406bf50 0x7f21c406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.409+0000 7f21ec262740 1 -- start start 2024-09-11T23:23:15.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.409+0000 7f21e1e00640 1 --2- 172.21.15.144:0/485255280 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f21c406bf50 0x7f21c406e410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f21d40012e0 tx=0x7f21d4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:15.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.409+0000 7f21ec262740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557e28105ea0 0x557e2814b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.409+0000 7f21ec262740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557e28103660 0x557e28106280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.409+0000 7f21ec262740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28107630 0x557e28100720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.409+0000 7f21ec262740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557e280643b0 con 0x557e28107630 2024-09-11T23:23:15.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.409+0000 7f21ec262740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557e28069410 con 0x557e28103660 2024-09-11T23:23:15.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.409+0000 7f21ec262740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557e28011620 con 0x557e28105ea0 2024-09-11T23:23:15.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.410+0000 7f21e2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28107630 0x557e28100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.410+0000 7f21e2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28107630 0x557e28100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49906/0 (socket says 172.21.15.144:49906) 2024-09-11T23:23:15.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.410+0000 7f21e2800640 1 -- 172.21.15.144:0/3416981149 learned_addr learned my addr 172.21.15.144:0/3416981149 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:15.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.410+0000 7f21e1e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557e28105ea0 0x557e2814b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.410+0000 7f21e1400640 1 --2- 172.21.15.144:0/3416981149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557e28103660 0x557e28106280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.410+0000 7f21e2800640 1 -- 172.21.15.144:0/3416981149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557e28105ea0 msgr2=0x557e2814b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:15.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.410+0000 7f21e2800640 1 --2- 172.21.15.144:0/3416981149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557e28105ea0 0x557e2814b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.410+0000 7f21e2800640 1 -- 172.21.15.144:0/3416981149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557e28103660 msgr2=0x557e28106280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:15.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.410+0000 7f21e2800640 1 --2- 172.21.15.144:0/3416981149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557e28103660 0x557e28106280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.410+0000 7f21e2800640 1 -- 172.21.15.144:0/3416981149 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e27d7c2d0 con 0x557e28107630 2024-09-11T23:23:15.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.410+0000 7f21e2800640 1 --2- 172.21.15.144:0/3416981149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28107630 0x557e28100720 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009b60 tx=0x7f21dc009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1ea3ccceafabf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:15.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.411+0000 7f21cea00640 1 -- 172.21.15.144:0/3416981149 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc019070 con 0x557e28107630 2024-09-11T23:23:15.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.411+0000 7f21cea00640 1 -- 172.21.15.144:0/3416981149 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21dc009c50 con 0x557e28107630 2024-09-11T23:23:15.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.411+0000 7f21cea00640 1 -- 172.21.15.144:0/3416981149 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc015460 con 0x557e28107630 2024-09-11T23:23:15.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.411+0000 7f21ec262740 1 -- 172.21.15.144:0/3416981149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28107630 msgr2=0x557e28100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:15.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.411+0000 7f21ec262740 1 --2- 172.21.15.144:0/3416981149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28107630 0x557e28100720 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009b60 tx=0x7f21dc009190 comp rx=0 tx=0).stop 2024-09-11T23:23:15.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.411+0000 7f21ec262740 1 -- 172.21.15.144:0/3416981149 shutdown_connections 2024-09-11T23:23:15.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.411+0000 7f21ec262740 1 --2- 172.21.15.144:0/3416981149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28107630 0x557e28100720 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.411+0000 7f21ec262740 1 --2- 172.21.15.144:0/3416981149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557e28103660 0x557e28106280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.411+0000 7f21ec262740 1 --2- 172.21.15.144:0/3416981149 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557e28105ea0 0x557e2814b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.411+0000 7f21ec262740 1 -- 172.21.15.144:0/3416981149 >> 172.21.15.144:0/3416981149 conn(0x557e281028f0 msgr2=0x557e2814ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:15.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.411+0000 7f21ec262740 1 -- 172.21.15.144:0/3416981149 shutdown_connections 2024-09-11T23:23:15.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.411+0000 7f21ec262740 1 -- 172.21.15.144:0/3416981149 wait complete. 2024-09-11T23:23:15.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.412+0000 7f21ec262740 1 -- start start 2024-09-11T23:23:15.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.412+0000 7f21ec262740 1 Processor -- start 2024-09-11T23:23:15.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.413+0000 7f21ec262740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28105ea0 0x557e28120060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.413+0000 7f21ec262740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557e28107630 0x557e28122a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.413+0000 7f21ec262740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557e28122fd0 0x557e281208e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.413+0000 7f21ec262740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557e28024780 con 0x557e28105ea0 2024-09-11T23:23:15.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.413+0000 7f21ec262740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557e280653d0 con 0x557e28107630 2024-09-11T23:23:15.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.413+0000 7f21ec262740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557e28101d90 con 0x557e28122fd0 2024-09-11T23:23:15.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.414+0000 7f21ec262740 10 client.0 _ll_register_callbacks cb 0x557e280625d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:23:15.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.414+0000 7f21e1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28105ea0 0x557e28120060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.414+0000 7f21e1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28105ea0 0x557e28120060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49914/0 (socket says 172.21.15.144:49914) 2024-09-11T23:23:15.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.414+0000 7f21e1e00640 1 -- 172.21.15.144:0/2103797959 learned_addr learned my addr 172.21.15.144:0/2103797959 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.414+0000 7f21e2800640 1 --2- 172.21.15.144:0/2103797959 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557e28122fd0 0x557e281208e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.414+0000 7f21e1400640 1 --2- 172.21.15.144:0/2103797959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557e28107630 0x557e28122a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.414+0000 7f21e1e00640 1 -- 172.21.15.144:0/2103797959 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557e28122fd0 msgr2=0x557e281208e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.414+0000 7f21e1e00640 1 --2- 172.21.15.144:0/2103797959 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557e28122fd0 0x557e281208e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.414+0000 7f21e1e00640 1 -- 172.21.15.144:0/2103797959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557e28107630 msgr2=0x557e28122a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.414+0000 7f21e1e00640 1 --2- 172.21.15.144:0/2103797959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557e28107630 0x557e28122a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.414+0000 7f21e1e00640 1 -- 172.21.15.144:0/2103797959 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e27e466b0 con 0x557e28105ea0 2024-09-11T23:23:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.414+0000 7f21e1e00640 1 --2- 172.21.15.144:0/2103797959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28105ea0 0x557e28120060 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f21d40076b0 tx=0x7f21d4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e991fd6138dfa2c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.414+0000 7f21c3400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:23:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.415+0000 7f21c3400640 1 -- 172.21.15.144:0/2103797959 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4027060 con 0x557e28105ea0 2024-09-11T23:23:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.416+0000 7f21ec262740 1 -- 172.21.15.144:0/2103797959 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21dc009c50 con 0x557e28105ea0 2024-09-11T23:23:15.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.416+0000 7f21c3400640 1 -- 172.21.15.144:0/2103797959 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f21d4010040 con 0x557e28105ea0 2024-09-11T23:23:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.416+0000 7f21c3400640 1 -- 172.21.15.144:0/2103797959 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f21d402d050 con 0x557e28105ea0 2024-09-11T23:23:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.416+0000 7f21ec262740 10 client.7023 fetch_fsmap learned FSMap version 71 2024-09-11T23:23:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.416+0000 7f21ec262740 1 -- 172.21.15.144:0/2103797959 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) -- 0x557e281212f0 con 0x557e28105ea0 2024-09-11T23:23:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.416+0000 7f21c3400640 1 -- 172.21.15.144:0/2103797959 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21dc009c50 con 0x557e28105ea0 2024-09-11T23:23:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.416+0000 7f21c3400640 1 -- 172.21.15.144:0/2103797959 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 71) ==== 3502+0+0 (secure 0 0 0) 0x7f21d4030020 con 0x557e28105ea0 2024-09-11T23:23:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.416+0000 7f21ec262740 10 client.7023 fetch_fsmap finished waiting for FSMap version 71 2024-09-11T23:23:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.416+0000 7f21ec262740 10 client.7023 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T23:23:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.416+0000 7f21ec262740 20 client.7023 populate_metadata read hostname 'smithi144' 2024-09-11T23:23:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.416+0000 7f21ec262740 1 --2- 172.21.15.144:0/2103797959 >> [v2:172.21.15.144:6834/419371779,v1:172.21.15.144:6835/419371779] conn(0x557e28162c20 0x557e28163000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.416+0000 7f21ec262740 4 client.7023 mds_command: new command op to 6909 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:23:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.416+0000 7f21ec262740 1 -- 172.21.15.144:0/2103797959 --> [v2:172.21.15.144:6834/419371779,v1:172.21.15.144:6835/419371779] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e28076b40 con 0x557e28162c20 2024-09-11T23:23:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.417+0000 7f21e1400640 1 --2- 172.21.15.144:0/2103797959 >> [v2:172.21.15.144:6834/419371779,v1:172.21.15.144:6835/419371779] conn(0x557e28162c20 0x557e28163000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.417+0000 7f21e1400640 1 --2- 172.21.15.144:0/2103797959 >> [v2:172.21.15.144:6834/419371779,v1:172.21.15.144:6835/419371779] conn(0x557e28162c20 0x557e28163000 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b2657bc17fb3fe7 server_cookie=330dbb4648cded8c in_seq=0 out_seq=0 2024-09-11T23:23:15.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.417+0000 7f21c3400640 10 client.7023 ms_handle_connect on v2:172.21.15.144:6834/419371779 2024-09-11T23:23:15.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.418+0000 7f21c3400640 1 -- 172.21.15.144:0/2103797959 <== mds.0 v2:172.21.15.144:6834/419371779 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557e28076b40 con 0x557e28162c20 2024-09-11T23:23:15.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.418+0000 7f21c3400640 10 client.7023 handle_command_reply: tid=0 2024-09-11T23:23:15.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.418+0000 7f21ec262740 1 client.7023 shutdown 2024-09-11T23:23:15.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.418+0000 7f21ec262740 1 -- 172.21.15.144:0/2103797959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28105ea0 msgr2=0x557e28120060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:15.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.418+0000 7f21ec262740 1 --2- 172.21.15.144:0/2103797959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28105ea0 0x557e28120060 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f21d40076b0 tx=0x7f21d4001250 comp rx=0 tx=0).stop 2024-09-11T23:23:15.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.418+0000 7f21ec262740 1 -- 172.21.15.144:0/2103797959 shutdown_connections 2024-09-11T23:23:15.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.418+0000 7f21ec262740 1 --2- 172.21.15.144:0/2103797959 >> [v2:172.21.15.144:6834/419371779,v1:172.21.15.144:6835/419371779] conn(0x557e28162c20 0x557e28163000 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.418+0000 7f21ec262740 1 --2- 172.21.15.144:0/2103797959 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557e28122fd0 0x557e281208e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.418+0000 7f21ec262740 1 --2- 172.21.15.144:0/2103797959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557e28107630 0x557e28122a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.418+0000 7f21ec262740 1 --2- 172.21.15.144:0/2103797959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28105ea0 0x557e28120060 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.418+0000 7f21ec262740 1 -- 172.21.15.144:0/2103797959 >> 172.21.15.144:0/2103797959 conn(0x557e28103660 msgr2=0x557e28148b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:15.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.418+0000 7f21c3400640 0 client.7023 ms_handle_reset on v2:172.21.15.144:6834/419371779 2024-09-11T23:23:15.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.418+0000 7f21ec262740 1 -- 172.21.15.144:0/2103797959 shutdown_connections 2024-09-11T23:23:15.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.418+0000 7f21ec262740 1 -- 172.21.15.144:0/2103797959 wait complete. 2024-09-11T23:23:15.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.419+0000 7f21ec262740 20 client.7023 trim_cache size 0 max 16384 2024-09-11T23:23:15.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.441+0000 7f21ec262740 1 Processor -- start 2024-09-11T23:23:15.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.441+0000 7f21ec262740 1 -- start start 2024-09-11T23:23:15.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.442+0000 7f21ec262740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557e28105ea0 0x557e2812de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.442+0000 7f21ec262740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557e28107630 0x557e2812e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.442+0000 7f21ec262740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28122fd0 0x557e281731b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.442+0000 7f21ec262740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f21e406d660 con 0x557e28122fd0 2024-09-11T23:23:15.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.442+0000 7f21ec262740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f21e41f6bb0 con 0x557e28107630 2024-09-11T23:23:15.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.442+0000 7f21ec262740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f21e406d010 con 0x557e28105ea0 2024-09-11T23:23:15.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.442+0000 7f21e2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28122fd0 0x557e281731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.442+0000 7f21e2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28122fd0 0x557e281731b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49928/0 (socket says 172.21.15.144:49928) 2024-09-11T23:23:15.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.442+0000 7f21e2800640 1 -- 172.21.15.144:0/2859996740 learned_addr learned my addr 172.21.15.144:0/2859996740 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:15.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.442+0000 7f21e1400640 1 --2- 172.21.15.144:0/2859996740 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557e28107630 0x557e2812e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.442+0000 7f21e1e00640 1 --2- 172.21.15.144:0/2859996740 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557e28105ea0 0x557e2812de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.442+0000 7f21e2800640 1 -- 172.21.15.144:0/2859996740 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557e28105ea0 msgr2=0x557e2812de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:15.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.442+0000 7f21e2800640 1 --2- 172.21.15.144:0/2859996740 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557e28105ea0 0x557e2812de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.442+0000 7f21e2800640 1 -- 172.21.15.144:0/2859996740 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557e28107630 msgr2=0x557e2812e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:15.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.442+0000 7f21e2800640 1 --2- 172.21.15.144:0/2859996740 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557e28107630 0x557e2812e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.442+0000 7f21e2800640 1 -- 172.21.15.144:0/2859996740 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e2812dbf0 con 0x557e28122fd0 2024-09-11T23:23:15.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.443+0000 7f21e2800640 1 --2- 172.21.15.144:0/2859996740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28122fd0 0x557e281731b0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009b30 tx=0x7f21dc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bbf59df704fc468 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:15.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.443+0000 7f21ce000640 1 -- 172.21.15.144:0/2859996740 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc019040 con 0x557e28122fd0 2024-09-11T23:23:15.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.443+0000 7f21ce000640 1 -- 172.21.15.144:0/2859996740 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21dc0095a0 con 0x557e28122fd0 2024-09-11T23:23:15.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.443+0000 7f21ce000640 1 -- 172.21.15.144:0/2859996740 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc009e90 con 0x557e28122fd0 2024-09-11T23:23:15.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.444+0000 7f21ec262740 1 -- 172.21.15.144:0/2859996740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28122fd0 msgr2=0x557e281731b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:15.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.444+0000 7f21ec262740 1 --2- 172.21.15.144:0/2859996740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28122fd0 0x557e281731b0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009b30 tx=0x7f21dc016000 comp rx=0 tx=0).stop 2024-09-11T23:23:15.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.444+0000 7f21ec262740 1 -- 172.21.15.144:0/2859996740 shutdown_connections 2024-09-11T23:23:15.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.444+0000 7f21ec262740 1 --2- 172.21.15.144:0/2859996740 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28122fd0 0x557e281731b0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.444+0000 7f21ec262740 1 --2- 172.21.15.144:0/2859996740 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557e28107630 0x557e2812e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.444+0000 7f21ec262740 1 --2- 172.21.15.144:0/2859996740 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557e28105ea0 0x557e2812de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.444+0000 7f21ec262740 1 -- 172.21.15.144:0/2859996740 >> 172.21.15.144:0/2859996740 conn(0x557e28103660 msgr2=0x557e2812ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:15.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.444+0000 7f21ec262740 1 -- 172.21.15.144:0/2859996740 shutdown_connections 2024-09-11T23:23:15.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.444+0000 7f21ec262740 1 -- 172.21.15.144:0/2859996740 wait complete. 2024-09-11T23:23:15.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.444+0000 7f21ec262740 1 -- start start 2024-09-11T23:23:15.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.445+0000 7f21ec262740 1 Processor -- start 2024-09-11T23:23:15.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.445+0000 7f21ec262740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28105ea0 0x557e281ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.445+0000 7f21ec262740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557e28107630 0x557e28146f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.446+0000 7f21ec262740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557e28122fd0 0x557e281474b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.446+0000 7f21ec262740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557e281238d0 con 0x557e28105ea0 2024-09-11T23:23:15.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.446+0000 7f21ec262740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557e2812f2f0 con 0x557e28122fd0 2024-09-11T23:23:15.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.446+0000 7f21ec262740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557e2811e6f0 con 0x557e28107630 2024-09-11T23:23:15.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.446+0000 7f21ec262740 10 client.0 _ll_register_callbacks cb 0x7f21d400ec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:23:15.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.446+0000 7f21e1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28105ea0 0x557e281ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.446+0000 7f21e1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28105ea0 0x557e281ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49942/0 (socket says 172.21.15.144:49942) 2024-09-11T23:23:15.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.446+0000 7f21e1e00640 1 -- 172.21.15.144:0/1917243628 learned_addr learned my addr 172.21.15.144:0/1917243628 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:15.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.446+0000 7f21e1e00640 1 -- 172.21.15.144:0/1917243628 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557e28107630 msgr2=0x557e28146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:15.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.446+0000 7f21e1e00640 1 --2- 172.21.15.144:0/1917243628 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557e28107630 0x557e28146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.446+0000 7f21e1e00640 1 -- 172.21.15.144:0/1917243628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557e28122fd0 msgr2=0x557e281474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:15.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.446+0000 7f21e1e00640 1 --2- 172.21.15.144:0/1917243628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557e28122fd0 0x557e281474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.446+0000 7f21e1e00640 1 -- 172.21.15.144:0/1917243628 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e281721a0 con 0x557e28105ea0 2024-09-11T23:23:15.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.446+0000 7f21e1e00640 1 --2- 172.21.15.144:0/1917243628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28105ea0 0x557e281ccae0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f21d4009010 tx=0x7f21d4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e562b28d4fe9812f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:15.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.446+0000 7f21c3400640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:23:15.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.447+0000 7f21c3400640 1 -- 172.21.15.144:0/1917243628 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4027020 con 0x557e28105ea0 2024-09-11T23:23:15.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.447+0000 7f21c3400640 1 -- 172.21.15.144:0/1917243628 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f21d4010070 con 0x557e28105ea0 2024-09-11T23:23:15.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.447+0000 7f21ec262740 1 -- 172.21.15.144:0/1917243628 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21dc0095a0 con 0x557e28105ea0 2024-09-11T23:23:15.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.447+0000 7f21c3400640 1 -- 172.21.15.144:0/1917243628 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f21d4014bc0 con 0x557e28105ea0 2024-09-11T23:23:15.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.447+0000 7f21ec262740 10 client.7029 fetch_fsmap learned FSMap version 71 2024-09-11T23:23:15.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.447+0000 7f21ec262740 1 -- 172.21.15.144:0/1917243628 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) -- 0x557e2811a930 con 0x557e28105ea0 2024-09-11T23:23:15.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.447+0000 7f21c3400640 1 -- 172.21.15.144:0/1917243628 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21dc0095a0 con 0x557e28105ea0 2024-09-11T23:23:15.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.447+0000 7f21c3400640 1 -- 172.21.15.144:0/1917243628 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 71) ==== 3502+0+0 (secure 0 0 0) 0x7f21d4030070 con 0x557e28105ea0 2024-09-11T23:23:15.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.447+0000 7f21ec262740 10 client.7029 fetch_fsmap finished waiting for FSMap version 71 2024-09-11T23:23:15.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.447+0000 7f21ec262740 10 client.7029 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T23:23:15.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.447+0000 7f21ec262740 20 client.7029 populate_metadata read hostname 'smithi144' 2024-09-11T23:23:15.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.447+0000 7f21ec262740 1 --2- 172.21.15.144:0/1917243628 >> [v2:172.21.15.144:6834/419371779,v1:172.21.15.144:6835/419371779] conn(0x557e281479f0 0x557e28123a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.447+0000 7f21ec262740 4 client.7029 mds_command: new command op to 6909 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:23:15.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.447+0000 7f21ec262740 1 -- 172.21.15.144:0/1917243628 --> [v2:172.21.15.144:6834/419371779,v1:172.21.15.144:6835/419371779] -- command(tid 0: {"prefix": "status"}) -- 0x557e28070e90 con 0x557e281479f0 2024-09-11T23:23:15.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.448+0000 7f21e1400640 1 --2- 172.21.15.144:0/1917243628 >> [v2:172.21.15.144:6834/419371779,v1:172.21.15.144:6835/419371779] conn(0x557e281479f0 0x557e28123a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.448+0000 7f21e1400640 1 --2- 172.21.15.144:0/1917243628 >> [v2:172.21.15.144:6834/419371779,v1:172.21.15.144:6835/419371779] conn(0x557e281479f0 0x557e28123a50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=685aca1d9fad3850 server_cookie=4944099b7e96ab33 in_seq=0 out_seq=0 2024-09-11T23:23:15.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.448+0000 7f21c3400640 10 client.7029 ms_handle_connect on v2:172.21.15.144:6834/419371779 2024-09-11T23:23:15.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.448+0000 7f21c3400640 1 -- 172.21.15.144:0/1917243628 <== mds.0 v2:172.21.15.144:6834/419371779 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x557e28070e90 con 0x557e281479f0 2024-09-11T23:23:15.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.448+0000 7f21c3400640 10 client.7029 handle_command_reply: tid=0 2024-09-11T23:23:15.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.448+0000 7f21ec262740 1 client.7029 shutdown 2024-09-11T23:23:15.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.448+0000 7f21ec262740 1 -- 172.21.15.144:0/1917243628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28105ea0 msgr2=0x557e281ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:15.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.448+0000 7f21ec262740 1 --2- 172.21.15.144:0/1917243628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28105ea0 0x557e281ccae0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f21d4009010 tx=0x7f21d4013000 comp rx=0 tx=0).stop 2024-09-11T23:23:15.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.449+0000 7f21ec262740 1 -- 172.21.15.144:0/1917243628 shutdown_connections 2024-09-11T23:23:15.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.449+0000 7f21ec262740 1 --2- 172.21.15.144:0/1917243628 >> [v2:172.21.15.144:6834/419371779,v1:172.21.15.144:6835/419371779] conn(0x557e281479f0 0x557e28123a50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.449+0000 7f21ec262740 1 --2- 172.21.15.144:0/1917243628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557e28122fd0 0x557e281474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.449+0000 7f21ec262740 1 --2- 172.21.15.144:0/1917243628 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557e28107630 0x557e28146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.449+0000 7f21c3400640 0 client.7029 ms_handle_reset on v2:172.21.15.144:6834/419371779 2024-09-11T23:23:15.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.449+0000 7f21ec262740 1 --2- 172.21.15.144:0/1917243628 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557e28105ea0 0x557e281ccae0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.449+0000 7f21ec262740 1 -- 172.21.15.144:0/1917243628 >> 172.21.15.144:0/1917243628 conn(0x557e28103660 msgr2=0x557e2812ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:15.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.449+0000 7f21ec262740 1 -- 172.21.15.144:0/1917243628 shutdown_connections 2024-09-11T23:23:15.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.449+0000 7f21ec262740 1 -- 172.21.15.144:0/1917243628 wait complete. 2024-09-11T23:23:15.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.449+0000 7f21ec262740 20 client.7029 trim_cache size 0 max 16384 2024-09-11T23:23:15.454 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:23:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "4b73e4b7-12f0-4e37-94bc-45e333efe84e", 2024-09-11T23:23:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-11T23:23:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 6909, 2024-09-11T23:23:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-11T23:23:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-11T23:23:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-11T23:23:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 6.0570759399999998, 2024-09-11T23:23:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 71, 2024-09-11T23:23:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 102, 2024-09-11T23:23:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 101, 2024-09-11T23:23:15.454 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 10.791057937 2024-09-11T23:23:15.454 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:23:15.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.449+0000 7f21e3200640 1 -- 172.21.15.144:0/485255280 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f21c406bf50 msgr2=0x7f21c406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:15.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.449+0000 7f21e3200640 1 --2- 172.21.15.144:0/485255280 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f21c406bf50 0x7f21c406e410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f21d40012e0 tx=0x7f21d4009040 comp rx=0 tx=0).stop 2024-09-11T23:23:15.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.449+0000 7f21e3200640 1 -- 172.21.15.144:0/485255280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21e40708a0 msgr2=0x7f21e4157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:15.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.449+0000 7f21e3200640 1 --2- 172.21.15.144:0/485255280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21e40708a0 0x7f21e4157c60 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f21d0035040 tx=0x7f21d00046c0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.450+0000 7f21e3200640 1 -- 172.21.15.144:0/485255280 shutdown_connections 2024-09-11T23:23:15.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.450+0000 7f21e3200640 1 --2- 172.21.15.144:0/485255280 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f21c406bf50 0x7f21c406e410 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.450+0000 7f21e3200640 1 --2- 172.21.15.144:0/485255280 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f21e40b6bb0 0x7f21e41f1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.450+0000 7f21e3200640 1 --2- 172.21.15.144:0/485255280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21e40708a0 0x7f21e4157c60 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.450+0000 7f21e3200640 1 --2- 172.21.15.144:0/485255280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f21e406feb0 0x7f21e4160480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.450+0000 7f21e3200640 1 -- 172.21.15.144:0/485255280 >> 172.21.15.144:0/485255280 conn(0x7f21e406f390 msgr2=0x7f21e415a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:15.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.450+0000 7f21e3200640 1 -- 172.21.15.144:0/485255280 shutdown_connections 2024-09-11T23:23:15.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.450+0000 7f21e3200640 1 -- 172.21.15.144:0/485255280 wait complete. 2024-09-11T23:23:15.465 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:23:15.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.617+0000 7ff7f5000640 1 Processor -- start 2024-09-11T23:23:15.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.618+0000 7ff7f5000640 1 -- start start 2024-09-11T23:23:15.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.619+0000 7ff7f5000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f015c180 0x7ff7f00cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.619+0000 7ff7f5000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff7f00ce230 0x7ff7f00cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.619+0000 7ff7f5000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7f00ce740 con 0x7ff7f00cf5b0 2024-09-11T23:23:15.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.619+0000 7ff7f5000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff7f0072640 con 0x7ff7f00ce230 2024-09-11T23:23:15.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.619+0000 7ff7f5000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff7f0072920 con 0x7ff7f015c180 2024-09-11T23:23:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.619+0000 7ff7ee800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff7f00cf5b0 0x7ff7f0073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50034/0 (socket says 172.21.15.144:50034) 2024-09-11T23:23:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.619+0000 7ff7ee800640 1 -- 172.21.15.144:0/616995716 learned_addr learned my addr 172.21.15.144:0/616995716 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.619+0000 7ff7ede00640 1 --2- 172.21.15.144:0/616995716 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f015c180 0x7ff7f00cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.619+0000 7ff7ed400640 1 --2- 172.21.15.144:0/616995716 >> v2:172.21.15.165:3300/0 conn(0x7ff7f00ce230 0x7ff7f00cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.619+0000 7ff7eca00640 1 -- 172.21.15.144:0/616995716 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1914952861 0 0) 0x7ff7f00ce740 con 0x7ff7f00cf5b0 2024-09-11T23:23:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.619+0000 7ff7eca00640 1 -- 172.21.15.144:0/616995716 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7d4003520 con 0x7ff7f00cf5b0 2024-09-11T23:23:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.620+0000 7ff7ede00640 1 -- 172.21.15.144:0/616995716 >> v2:172.21.15.165:3300/0 conn(0x7ff7f00ce230 msgr2=0x7ff7f00cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.620+0000 7ff7ede00640 1 --2- 172.21.15.144:0/616995716 >> v2:172.21.15.165:3300/0 conn(0x7ff7f00ce230 0x7ff7f00cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.620+0000 7ff7ede00640 1 -- 172.21.15.144:0/616995716 >> v1:172.21.15.144:6789/0 conn(0x7ff7f00cf5b0 legacy=0x7ff7f0073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:15.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.620+0000 7ff7ede00640 1 -- 172.21.15.144:0/616995716 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f0072c00 con 0x7ff7f015c180 2024-09-11T23:23:15.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.620+0000 7ff7ed400640 1 --2- 172.21.15.144:0/616995716 >> v2:172.21.15.165:3300/0 conn(0x7ff7f00ce230 0x7ff7f00cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:23:15.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.621+0000 7ff7ede00640 1 --2- 172.21.15.144:0/616995716 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f015c180 0x7ff7f00cdcf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009d90 tx=0x7ff7e002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=977c5b1b6c93cf61 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:15.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.621+0000 7ff7eca00640 1 -- 172.21.15.144:0/616995716 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0031600 con 0x7ff7f015c180 2024-09-11T23:23:15.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.621+0000 7ff7eca00640 1 -- 172.21.15.144:0/616995716 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7e00317a0 con 0x7ff7f015c180 2024-09-11T23:23:15.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.621+0000 7ff7eca00640 1 -- 172.21.15.144:0/616995716 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0031b70 con 0x7ff7f015c180 2024-09-11T23:23:15.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.621+0000 7ff7f5000640 1 -- 172.21.15.144:0/616995716 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f015c180 msgr2=0x7ff7f00cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:15.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.621+0000 7ff7f5000640 1 --2- 172.21.15.144:0/616995716 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f015c180 0x7ff7f00cdcf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009d90 tx=0x7ff7e002a5d0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.622+0000 7ff7f5000640 1 -- 172.21.15.144:0/616995716 shutdown_connections 2024-09-11T23:23:15.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.622+0000 7ff7f5000640 1 --2- 172.21.15.144:0/616995716 >> v2:172.21.15.165:3300/0 conn(0x7ff7f00ce230 0x7ff7f00cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.622+0000 7ff7f5000640 1 --2- 172.21.15.144:0/616995716 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f015c180 0x7ff7f00cdcf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.622+0000 7ff7f5000640 1 -- 172.21.15.144:0/616995716 >> 172.21.15.144:0/616995716 conn(0x7ff7f0062cc0 msgr2=0x7ff7f006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:15.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.622+0000 7ff7f5000640 1 -- 172.21.15.144:0/616995716 shutdown_connections 2024-09-11T23:23:15.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.622+0000 7ff7f5000640 1 -- 172.21.15.144:0/616995716 wait complete. 2024-09-11T23:23:15.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.623+0000 7ff7f5000640 1 Processor -- start 2024-09-11T23:23:15.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.623+0000 7ff7f5000640 1 -- start start 2024-09-11T23:23:15.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.624+0000 7ff7f5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7f00ce230 0x7ff7f0153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.624+0000 7ff7f5000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7f00cf5b0 0x7ff7f014ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.624+0000 7ff7f5000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f015c180 0x7ff7f015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.624+0000 7ff7f5000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f015c560 con 0x7ff7f00ce230 2024-09-11T23:23:15.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.624+0000 7ff7f5000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f00722f0 con 0x7ff7f00cf5b0 2024-09-11T23:23:15.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.624+0000 7ff7f5000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff7f015c6e0 con 0x7ff7f015c180 2024-09-11T23:23:15.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.624+0000 7ff7ede00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7f00ce230 0x7ff7f0153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.624+0000 7ff7ede00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7f00ce230 0x7ff7f0153b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49956/0 (socket says 172.21.15.144:49956) 2024-09-11T23:23:15.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.624+0000 7ff7ede00640 1 -- 172.21.15.144:0/4253493637 learned_addr learned my addr 172.21.15.144:0/4253493637 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:15.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.625+0000 7ff7ed400640 1 --2- 172.21.15.144:0/4253493637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7f00cf5b0 0x7ff7f014ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.625+0000 7ff7ee800640 1 --2- 172.21.15.144:0/4253493637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f015c180 0x7ff7f015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.625+0000 7ff7ede00640 1 -- 172.21.15.144:0/4253493637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f015c180 msgr2=0x7ff7f015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.625+0000 7ff7ede00640 1 --2- 172.21.15.144:0/4253493637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f015c180 0x7ff7f015a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.625+0000 7ff7ede00640 1 -- 172.21.15.144:0/4253493637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7f00cf5b0 msgr2=0x7ff7f014ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.625+0000 7ff7ede00640 1 --2- 172.21.15.144:0/4253493637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7f00cf5b0 0x7ff7f014ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.625+0000 7ff7ede00640 1 -- 172.21.15.144:0/4253493637 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f00b3730 con 0x7ff7f00ce230 2024-09-11T23:23:15.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.625+0000 7ff7ede00640 1 --2- 172.21.15.144:0/4253493637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7f00ce230 0x7ff7f0153b20 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009d90 tx=0x7ff7e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.625+0000 7ff7e6000640 1 -- 172.21.15.144:0/4253493637 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0040070 con 0x7ff7f00ce230 2024-09-11T23:23:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.626+0000 7ff7e6000640 1 -- 172.21.15.144:0/4253493637 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7e003c830 con 0x7ff7f00ce230 2024-09-11T23:23:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.626+0000 7ff7e6000640 1 -- 172.21.15.144:0/4253493637 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e003cc20 con 0x7ff7f00ce230 2024-09-11T23:23:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.626+0000 7ff7f5000640 1 -- 172.21.15.144:0/4253493637 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f015ac40 con 0x7ff7f00ce230 2024-09-11T23:23:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.626+0000 7ff7f5000640 1 -- 172.21.15.144:0/4253493637 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f015b200 con 0x7ff7f00ce230 2024-09-11T23:23:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.627+0000 7ff7f5000640 1 -- 172.21.15.144:0/4253493637 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f00cf070 con 0x7ff7f00ce230 2024-09-11T23:23:15.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.628+0000 7ff7e6000640 1 -- 172.21.15.144:0/4253493637 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7ff7e0039040 con 0x7ff7f00ce230 2024-09-11T23:23:15.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.628+0000 7ff7e6000640 1 --2- 172.21.15.144:0/4253493637 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff7d006bf50 0x7ff7d006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:15.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.628+0000 7ff7e6000640 1 -- 172.21.15.144:0/4253493637 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7ff7e00ac620 con 0x7ff7f00ce230 2024-09-11T23:23:15.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.629+0000 7ff7ed400640 1 --2- 172.21.15.144:0/4253493637 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff7d006bf50 0x7ff7d006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:15.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.629+0000 7ff7ed400640 1 --2- 172.21.15.144:0/4253493637 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff7d006bf50 0x7ff7d006e410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009560 tx=0x7ff7dc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:15.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.632+0000 7ff7e6000640 1 -- 172.21.15.144:0/4253493637 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff7e007a710 con 0x7ff7f00ce230 2024-09-11T23:23:15.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.843+0000 7ff7f5000640 1 -- 172.21.15.144:0/4253493637 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff7f00b0bf0 con 0x7ff7f00ce230 2024-09-11T23:23:15.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.843+0000 7ff7e6000640 1 -- 172.21.15.144:0/4253493637 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v71) ==== 53+0+73 (secure 0 0 0) 0x7ff7e007ea10 con 0x7ff7f00ce230 2024-09-11T23:23:15.843 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:23:15.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.846+0000 7ff7f5000640 1 -- 172.21.15.144:0/4253493637 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff7d006bf50 msgr2=0x7ff7d006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:15.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.846+0000 7ff7f5000640 1 --2- 172.21.15.144:0/4253493637 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff7d006bf50 0x7ff7d006e410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009560 tx=0x7ff7dc009190 comp rx=0 tx=0).stop 2024-09-11T23:23:15.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.846+0000 7ff7f5000640 1 -- 172.21.15.144:0/4253493637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7f00ce230 msgr2=0x7ff7f0153b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:15.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.846+0000 7ff7f5000640 1 --2- 172.21.15.144:0/4253493637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7f00ce230 0x7ff7f0153b20 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009d90 tx=0x7ff7e0004a40 comp rx=0 tx=0).stop 2024-09-11T23:23:15.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.846+0000 7ff7f5000640 1 -- 172.21.15.144:0/4253493637 shutdown_connections 2024-09-11T23:23:15.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.846+0000 7ff7f5000640 1 --2- 172.21.15.144:0/4253493637 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff7d006bf50 0x7ff7d006e410 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.846+0000 7ff7f5000640 1 --2- 172.21.15.144:0/4253493637 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff7f015c180 0x7ff7f015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.846+0000 7ff7f5000640 1 --2- 172.21.15.144:0/4253493637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff7f00cf5b0 0x7ff7f014ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.846+0000 7ff7f5000640 1 --2- 172.21.15.144:0/4253493637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7f00ce230 0x7ff7f0153b20 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:15.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.846+0000 7ff7f5000640 1 -- 172.21.15.144:0/4253493637 >> 172.21.15.144:0/4253493637 conn(0x7ff7f0062cc0 msgr2=0x7ff7f00afe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:15.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.846+0000 7ff7f5000640 1 -- 172.21.15.144:0/4253493637 shutdown_connections 2024-09-11T23:23:15.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:15.846+0000 7ff7f5000640 1 -- 172.21.15.144:0/4253493637 wait complete. 2024-09-11T23:23:15.861 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:23:15.861 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:23:15.862 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-11T23:23:15.862 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:23:15.862 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:23:15.862 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:23:15.862 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:23:15.862 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:23:15.862 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:23:15.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:15.862 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-11T23:23:15.898 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:23:15.898 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:23:15.898 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:23:15.898 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:23:15.898 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-11T23:23:15.898 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:23:15.898 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:23:15.898 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:23:15.898 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-11T23:23:15.898 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:23:15.899 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:23:15.899 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-11T23:23:15.899 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:23:15.899 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:23:15.899 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:23:15.899 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-11T23:23:15.899 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:23:15.899 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42367sec preferred_lft 42367sec 2024-09-11T23:23:15.899 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2024-09-11T23:23:15.899 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:23:15.900 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:23:15.900 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff 2024-09-11T23:23:15.900 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:23:15.900 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:23:15.900 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::243b:82ff:fe06:fac9/64 scope link 2024-09-11T23:23:15.900 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:23:15.900 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:23:15.900 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:23:15.900 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::74ca:30ff:fef2:cddf/64 scope link 2024-09-11T23:23:15.900 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:23:15.900 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:23:15.900 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether be:01:ec:87:34:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:23:15.900 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bc01:ecff:fe87:34e1/64 scope link 2024-09-11T23:23:15.900 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:23:15.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:15.904 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:23:15.992 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-11T23:23:15.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:15.995 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-11T23:23:16.031 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-11T23:23:16.032 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:23:16.032 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:23:16.032 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:23:16.032 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:23:16.032 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:23:16.032 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-11T23:23:16.032 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:23:16.032 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:23:16.032 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:23:16.032 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-11T23:23:16.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:23:16.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:23:16.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:16.228 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-11T23:23:16.264 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:23:16.264 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:23:16.264 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:23:16.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:16.265 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-11T23:23:16.361 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:23:16.361 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:23:16.397 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:23:16.397 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:23:16.397 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:23:16.472 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T23:23:16.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:16.473 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:23:16.600 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:23:16.600 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:23:16.628 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:23:16.628 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:23:16.628 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:23:16.628 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:23:16.629 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:23:16.630 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T23:23:16.630 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:23:16.630 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:23:16.630 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:23:16.630 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:23:16.633 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:23:16.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:16.633 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:23:16.689 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:23:16.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:23:16.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:23:16.784 INFO:teuthology.orchestra.run.smithi144.stdout:client6056 2024-09-11T23:23:16.785 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:23:16.785 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:16.821 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:23:17.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.014+0000 7fab90000640 1 Processor -- start 2024-09-11T23:23:17.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.014+0000 7fab90000640 1 -- start start 2024-09-11T23:23:17.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.016+0000 7fab90000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fab8806be10 0x7fab880cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:17.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.016+0000 7fab90000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fab88151c50 0x7fab8815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:17.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.016+0000 7fab90000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab880cd5f0 con 0x7fab8806c1f0 2024-09-11T23:23:17.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.016+0000 7fab90000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fab880cd8d0 con 0x7fab8806be10 2024-09-11T23:23:17.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.016+0000 7fab90000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fab880cdbb0 con 0x7fab88151c50 2024-09-11T23:23:17.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.016+0000 7fab8cc00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fab8806c1f0 0x7fab88151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50036/0 (socket says 172.21.15.144:50036) 2024-09-11T23:23:17.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.016+0000 7fab8cc00640 1 -- 172.21.15.144:0/1187021901 learned_addr learned my addr 172.21.15.144:0/1187021901 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:17.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.016+0000 7fab8d600640 1 --2- 172.21.15.144:0/1187021901 >> v2:172.21.15.144:3300/0 conn(0x7fab8806be10 0x7fab880cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:17.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.016+0000 7fab8e000640 1 --2- 172.21.15.144:0/1187021901 >> v2:172.21.15.165:3300/0 conn(0x7fab88151c50 0x7fab8815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:17.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.016+0000 7fab8d600640 1 -- 172.21.15.144:0/1187021901 >> v2:172.21.15.165:3300/0 conn(0x7fab88151c50 msgr2=0x7fab8815baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:17.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.016+0000 7fab8d600640 1 --2- 172.21.15.144:0/1187021901 >> v2:172.21.15.165:3300/0 conn(0x7fab88151c50 0x7fab8815baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:17.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.016+0000 7fab8d600640 1 -- 172.21.15.144:0/1187021901 >> v1:172.21.15.144:6789/0 conn(0x7fab8806c1f0 legacy=0x7fab88151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:17.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.016+0000 7fab8d600640 1 -- 172.21.15.144:0/1187021901 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab880cde90 con 0x7fab8806be10 2024-09-11T23:23:17.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.017+0000 7fab8d600640 1 --2- 172.21.15.144:0/1187021901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab8806be10 0x7fab880cd010 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fab880b5980 tx=0x7fab7c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8efe1ccd5f5edd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:17.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.018+0000 7fab87e00640 1 -- 172.21.15.144:0/1187021901 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c037070 con 0x7fab8806be10 2024-09-11T23:23:17.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.018+0000 7fab87e00640 1 -- 172.21.15.144:0/1187021901 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab7c032440 con 0x7fab8806be10 2024-09-11T23:23:17.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.018+0000 7fab87e00640 1 -- 172.21.15.144:0/1187021901 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c032810 con 0x7fab8806be10 2024-09-11T23:23:17.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.018+0000 7fab90000640 1 -- 172.21.15.144:0/1187021901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab8806be10 msgr2=0x7fab880cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:17.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.018+0000 7fab90000640 1 --2- 172.21.15.144:0/1187021901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab8806be10 0x7fab880cd010 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fab880b5980 tx=0x7fab7c02a1a0 comp rx=0 tx=0).stop 2024-09-11T23:23:17.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.018+0000 7fab90000640 1 -- 172.21.15.144:0/1187021901 shutdown_connections 2024-09-11T23:23:17.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.018+0000 7fab90000640 1 --2- 172.21.15.144:0/1187021901 >> v2:172.21.15.165:3300/0 conn(0x7fab88151c50 0x7fab8815baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:17.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.018+0000 7fab90000640 1 --2- 172.21.15.144:0/1187021901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab8806be10 0x7fab880cd010 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:17.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.018+0000 7fab90000640 1 -- 172.21.15.144:0/1187021901 >> 172.21.15.144:0/1187021901 conn(0x7fab88062cc0 msgr2=0x7fab8806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:17.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.018+0000 7fab90000640 1 -- 172.21.15.144:0/1187021901 shutdown_connections 2024-09-11T23:23:17.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.018+0000 7fab90000640 1 -- 172.21.15.144:0/1187021901 wait complete. 2024-09-11T23:23:17.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.020+0000 7fab90000640 1 Processor -- start 2024-09-11T23:23:17.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.020+0000 7fab90000640 1 -- start start 2024-09-11T23:23:17.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.021+0000 7fab90000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab8806be10 0x7fab8815b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:17.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.021+0000 7fab90000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab8806c1f0 0x7fab88072660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:17.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.021+0000 7fab90000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab88151c50 0x7fab8813c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:17.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.021+0000 7fab90000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fab880d0310 con 0x7fab8806c1f0 2024-09-11T23:23:17.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.021+0000 7fab90000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fab880ce690 con 0x7fab8806be10 2024-09-11T23:23:17.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.021+0000 7fab90000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fab880d0490 con 0x7fab88151c50 2024-09-11T23:23:17.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.021+0000 7fab8cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab8806c1f0 0x7fab88072660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:17.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.021+0000 7fab8cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab8806c1f0 0x7fab88072660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49976/0 (socket says 172.21.15.144:49976) 2024-09-11T23:23:17.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.021+0000 7fab8cc00640 1 -- 172.21.15.144:0/862456531 learned_addr learned my addr 172.21.15.144:0/862456531 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:17.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.021+0000 7fab8e000640 1 --2- 172.21.15.144:0/862456531 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab88151c50 0x7fab8813c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:17.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.021+0000 7fab8cc00640 1 -- 172.21.15.144:0/862456531 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab88151c50 msgr2=0x7fab8813c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:17.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.021+0000 7fab8cc00640 1 --2- 172.21.15.144:0/862456531 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab88151c50 0x7fab8813c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:17.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.021+0000 7fab8cc00640 1 -- 172.21.15.144:0/862456531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab8806be10 msgr2=0x7fab8815b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:17.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.021+0000 7fab8d600640 1 --2- 172.21.15.144:0/862456531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab8806be10 0x7fab8815b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:17.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.021+0000 7fab8cc00640 1 --2- 172.21.15.144:0/862456531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab8806be10 0x7fab8815b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:17.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.022+0000 7fab8cc00640 1 -- 172.21.15.144:0/862456531 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8815bb80 con 0x7fab8806c1f0 2024-09-11T23:23:17.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.022+0000 7fab8e000640 1 --2- 172.21.15.144:0/862456531 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab88151c50 0x7fab8813c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:23:17.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.022+0000 7fab8d600640 1 --2- 172.21.15.144:0/862456531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab8806be10 0x7fab8815b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:23:17.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.022+0000 7fab8cc00640 1 --2- 172.21.15.144:0/862456531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab8806c1f0 0x7fab88072660 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fab7400c430 tx=0x7fab7400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:17.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.022+0000 7fab85600640 1 -- 172.21.15.144:0/862456531 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74017070 con 0x7fab8806c1f0 2024-09-11T23:23:17.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.022+0000 7fab85600640 1 -- 172.21.15.144:0/862456531 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab74005ce0 con 0x7fab8806c1f0 2024-09-11T23:23:17.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.022+0000 7fab85600640 1 -- 172.21.15.144:0/862456531 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab740072f0 con 0x7fab8806c1f0 2024-09-11T23:23:17.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.022+0000 7fab90000640 1 -- 172.21.15.144:0/862456531 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8815e670 con 0x7fab8806c1f0 2024-09-11T23:23:17.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.022+0000 7fab90000640 1 -- 172.21.15.144:0/862456531 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab8815ec30 con 0x7fab8806c1f0 2024-09-11T23:23:17.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.023+0000 7fab90000640 1 -- 172.21.15.144:0/862456531 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab880d0850 con 0x7fab8806c1f0 2024-09-11T23:23:17.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.024+0000 7fab85600640 1 -- 172.21.15.144:0/862456531 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7fab7401a070 con 0x7fab8806c1f0 2024-09-11T23:23:17.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.025+0000 7fab85600640 1 --2- 172.21.15.144:0/862456531 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fab6806bf50 0x7fab6806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:17.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.025+0000 7fab85600640 1 -- 172.21.15.144:0/862456531 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7fab7408a380 con 0x7fab8806c1f0 2024-09-11T23:23:17.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.025+0000 7fab8d600640 1 --2- 172.21.15.144:0/862456531 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fab6806bf50 0x7fab6806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:17.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.026+0000 7fab8d600640 1 --2- 172.21.15.144:0/862456531 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fab6806bf50 0x7fab6806e410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fab7c034000 tx=0x7fab7c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:17.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.029+0000 7fab85600640 1 -- 172.21.15.144:0/862456531 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab74058c70 con 0x7fab8806c1f0 2024-09-11T23:23:17.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.239+0000 7fab90000640 1 -- 172.21.15.144:0/862456531 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fab8815af60 con 0x7fab8806c1f0 2024-09-11T23:23:17.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.239+0000 7fab85600640 1 -- 172.21.15.144:0/862456531 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v71) ==== 53+0+73 (secure 0 0 0) 0x7fab74058570 con 0x7fab8806c1f0 2024-09-11T23:23:17.239 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:23:17.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.242+0000 7fab90000640 1 -- 172.21.15.144:0/862456531 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fab6806bf50 msgr2=0x7fab6806e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:17.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.242+0000 7fab90000640 1 --2- 172.21.15.144:0/862456531 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fab6806bf50 0x7fab6806e410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fab7c034000 tx=0x7fab7c02e000 comp rx=0 tx=0).stop 2024-09-11T23:23:17.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.242+0000 7fab90000640 1 -- 172.21.15.144:0/862456531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab8806c1f0 msgr2=0x7fab88072660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:17.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.242+0000 7fab90000640 1 --2- 172.21.15.144:0/862456531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab8806c1f0 0x7fab88072660 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fab7400c430 tx=0x7fab7400c8f0 comp rx=0 tx=0).stop 2024-09-11T23:23:17.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.242+0000 7fab90000640 1 -- 172.21.15.144:0/862456531 shutdown_connections 2024-09-11T23:23:17.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.242+0000 7fab90000640 1 --2- 172.21.15.144:0/862456531 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fab6806bf50 0x7fab6806e410 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:17.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.242+0000 7fab90000640 1 --2- 172.21.15.144:0/862456531 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab88151c50 0x7fab8813c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:17.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.242+0000 7fab90000640 1 --2- 172.21.15.144:0/862456531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab8806c1f0 0x7fab88072660 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:17.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.242+0000 7fab90000640 1 --2- 172.21.15.144:0/862456531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab8806be10 0x7fab8815b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:17.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.242+0000 7fab90000640 1 -- 172.21.15.144:0/862456531 >> 172.21.15.144:0/862456531 conn(0x7fab88062cc0 msgr2=0x7fab880affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:17.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.242+0000 7fab90000640 1 -- 172.21.15.144:0/862456531 shutdown_connections 2024-09-11T23:23:17.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:17.242+0000 7fab90000640 1 -- 172.21.15.144:0/862456531 wait complete. 2024-09-11T23:23:17.258 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:23:17.258 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:23:17.258 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi165.front.sepia.ceph.com 2024-09-11T23:23:17.258 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T23:23:17.258 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:23:17.258 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:23:17.258 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:23:17.258 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:23:17.258 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:23:17.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:17.258 DEBUG:teuthology.orchestra.run.smithi165:> ip addr 2024-09-11T23:23:17.300 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:23:17.300 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:23:17.300 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:23:17.300 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:23:17.300 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-11T23:23:17.300 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:23:17.300 INFO:teuthology.orchestra.run.smithi165.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:23:17.300 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:94 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:23:17.301 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f0 2024-09-11T23:23:17.301 INFO:teuthology.orchestra.run.smithi165.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:23:17.301 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:95 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:23:17.301 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f1 2024-09-11T23:23:17.301 INFO:teuthology.orchestra.run.smithi165.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:23:17.301 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:23:17.301 INFO:teuthology.orchestra.run.smithi165.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:23:17.301 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:23:17.301 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.21.15.165/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:23:17.301 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft 42368sec preferred_lft 42368sec 2024-09-11T23:23:17.301 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::ec4:7aff:fe88:7f63/64 scope link noprefixroute 2024-09-11T23:23:17.301 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:23:17.301 INFO:teuthology.orchestra.run.smithi165.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:23:17.301 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:23:17.302 INFO:teuthology.orchestra.run.smithi165.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:23:17.302 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:23:17.302 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::c063:d7ff:fec8:c56c/64 scope link 2024-09-11T23:23:17.302 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:23:17.302 INFO:teuthology.orchestra.run.smithi165.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:23:17.302 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:23:17.302 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::5478:e4ff:fecd:76c/64 scope link 2024-09-11T23:23:17.302 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:23:17.302 INFO:teuthology.orchestra.run.smithi165.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:23:17.302 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether ba:fa:43:78:5f:29 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:23:17.302 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::b8fa:43ff:fe78:5f29/64 scope link 2024-09-11T23:23:17.302 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:23:17.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:17.303 DEBUG:teuthology.orchestra.run.smithi165:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:23:17.400 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-11T23:23:17.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:17.403 DEBUG:teuthology.orchestra.run.smithi165:> route 2024-09-11T23:23:17.442 INFO:teuthology.orchestra.run.smithi165.stdout:Kernel IP routing table 2024-09-11T23:23:17.442 INFO:teuthology.orchestra.run.smithi165.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:23:17.442 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:23:17.443 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:23:17.443 INFO:teuthology.orchestra.run.smithi165.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:23:17.443 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:23:17.443 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-11T23:23:17.443 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:23:17.443 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:23:17.443 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:23:17.443 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-11T23:23:17.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:23:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:23:17.633 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:23:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:23:17.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:17.641 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-11T23:23:17.676 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-11T23:23:17.677 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-11T23:23:17.677 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:23:17.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:17.677 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set brx.0 up 2024-09-11T23:23:17.774 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:23:17.774 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T23:23:17.809 INFO:teuthology.orchestra.run.smithi165.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:23:17.809 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:23:17.809 DEBUG:teuthology.orchestra.run.smithi165:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:23:17.883 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-11T23:23:17.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:17.884 DEBUG:teuthology.orchestra.run.smithi165:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:23:18.012 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:23:18.012 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:23:18.038 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:23:18.038 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:23:18.038 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:23:18.039 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: trying mount with new device syntax: 1@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:23:18.039 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:23:18.040 INFO:teuthology.orchestra.run.smithi165.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-11T23:23:18.040 INFO:teuthology.orchestra.run.smithi165.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:23:18.040 INFO:teuthology.orchestra.run.smithi165.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:23:18.040 INFO:teuthology.orchestra.run.smithi165.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:23:18.040 INFO:teuthology.orchestra.run.smithi165.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:23:18.043 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:23:18.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:18.043 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:23:18.099 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:23:18.176 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:23:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:23:18.179 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:23:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:23:18.188 INFO:teuthology.orchestra.run.smithi165.stdout:client6059 2024-09-11T23:23:18.188 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:23:18.188 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:18.224 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-11T23:23:18.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.390+0000 7f3677200640 1 Processor -- start 2024-09-11T23:23:18.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.391+0000 7f3677200640 1 -- start start 2024-09-11T23:23:18.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.392+0000 7f3677200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f367815c410 0x7f36780b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.392+0000 7f3677200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3678072870 con 0x7f367815c030 2024-09-11T23:23:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.392+0000 7f3677200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3678072b50 con 0x7f36780b2ab0 2024-09-11T23:23:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.392+0000 7f3677200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3678072e30 con 0x7f367815c410 2024-09-11T23:23:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.392+0000 7f3675e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f367815c030 0x7f3678071f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50044/0 (socket says 172.21.15.144:50044) 2024-09-11T23:23:18.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.392+0000 7f3675e00640 1 -- 172.21.15.144:0/1450946955 learned_addr learned my addr 172.21.15.144:0/1450946955 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.392+0000 7f366d400640 1 --2- 172.21.15.144:0/1450946955 >> v2:172.21.15.165:3300/0 conn(0x7f367815c410 0x7f36780b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.393+0000 7f3675400640 1 -- 172.21.15.144:0/1450946955 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2804198987 0 0) 0x7f3678072870 con 0x7f367815c030 2024-09-11T23:23:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.393+0000 7f3675400640 1 -- 172.21.15.144:0/1450946955 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f365c003520 con 0x7f367815c030 2024-09-11T23:23:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.393+0000 7f3675400640 1 -- 172.21.15.144:0/1450946955 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2674741248 0 0) 0x7f3678072b50 con 0x7f36780b2ab0 2024-09-11T23:23:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.393+0000 7f366d400640 1 -- 172.21.15.144:0/1450946955 >> v1:172.21.15.165:6789/0 conn(0x7f36780b2ab0 legacy=0x7f36780cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.393+0000 7f366d400640 1 -- 172.21.15.144:0/1450946955 >> v1:172.21.15.144:6789/0 conn(0x7f367815c030 legacy=0x7f3678071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:18.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.393+0000 7f366d400640 1 -- 172.21.15.144:0/1450946955 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3678073110 con 0x7f367815c410 2024-09-11T23:23:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.394+0000 7f366d400640 1 --2- 172.21.15.144:0/1450946955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f367815c410 0x7f36780b1e60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f36600097d0 tx=0x7f366002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18282b4c89c5040b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.394+0000 7f3675400640 1 -- 172.21.15.144:0/1450946955 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3660037070 con 0x7f367815c410 2024-09-11T23:23:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.394+0000 7f3675400640 1 -- 172.21.15.144:0/1450946955 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3660032440 con 0x7f367815c410 2024-09-11T23:23:18.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.394+0000 7f3675400640 1 -- 172.21.15.144:0/1450946955 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3660032810 con 0x7f367815c410 2024-09-11T23:23:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.395+0000 7f3677200640 1 -- 172.21.15.144:0/1450946955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f367815c410 msgr2=0x7f36780b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.395+0000 7f3677200640 1 --2- 172.21.15.144:0/1450946955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f367815c410 0x7f36780b1e60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f36600097d0 tx=0x7f366002a1c0 comp rx=0 tx=0).stop 2024-09-11T23:23:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.395+0000 7f3677200640 1 -- 172.21.15.144:0/1450946955 shutdown_connections 2024-09-11T23:23:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.395+0000 7f3677200640 1 --2- 172.21.15.144:0/1450946955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f367815c410 0x7f36780b1e60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.395+0000 7f3677200640 1 -- 172.21.15.144:0/1450946955 >> 172.21.15.144:0/1450946955 conn(0x7f367806bba0 msgr2=0x7f367806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.395+0000 7f3677200640 1 -- 172.21.15.144:0/1450946955 shutdown_connections 2024-09-11T23:23:18.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.395+0000 7f3677200640 1 -- 172.21.15.144:0/1450946955 wait complete. 2024-09-11T23:23:18.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.397+0000 7f3677200640 1 Processor -- start 2024-09-11T23:23:18.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.397+0000 7f3677200640 1 -- start start 2024-09-11T23:23:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.398+0000 7f3677200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36780b2ab0 0x7f367815ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.398+0000 7f3677200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f367815c030 0x7f3678140ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.398+0000 7f3677200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f367815c410 0x7f36781411e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.398+0000 7f3677200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f36780b2520 con 0x7f367815c030 2024-09-11T23:23:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.398+0000 7f3677200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f36780b23a0 con 0x7f36780b2ab0 2024-09-11T23:23:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.398+0000 7f3677200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f36780b26a0 con 0x7f367815c410 2024-09-11T23:23:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.398+0000 7f366d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f367815c030 0x7f3678140ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.398+0000 7f366d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f367815c030 0x7f3678140ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:49988/0 (socket says 172.21.15.144:49988) 2024-09-11T23:23:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.398+0000 7f366d400640 1 -- 172.21.15.144:0/2381599811 learned_addr learned my addr 172.21.15.144:0/2381599811 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.398+0000 7f3676800640 1 --2- 172.21.15.144:0/2381599811 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f367815c410 0x7f36781411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:18.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.398+0000 7f3675e00640 1 --2- 172.21.15.144:0/2381599811 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36780b2ab0 0x7f367815ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.398+0000 7f366d400640 1 -- 172.21.15.144:0/2381599811 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f367815c410 msgr2=0x7f36781411e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.398+0000 7f366d400640 1 --2- 172.21.15.144:0/2381599811 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f367815c410 0x7f36781411e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.398+0000 7f366d400640 1 -- 172.21.15.144:0/2381599811 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36780b2ab0 msgr2=0x7f367815ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.398+0000 7f366d400640 1 --2- 172.21.15.144:0/2381599811 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36780b2ab0 0x7f367815ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.398+0000 7f366d400640 1 -- 172.21.15.144:0/2381599811 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367815d980 con 0x7f367815c030 2024-09-11T23:23:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.398+0000 7f3675e00640 1 --2- 172.21.15.144:0/2381599811 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36780b2ab0 0x7f367815ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:23:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.399+0000 7f366d400640 1 --2- 172.21.15.144:0/2381599811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f367815c030 0x7f3678140ca0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f36600097d0 tx=0x7f36600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.399+0000 7f366ea00640 1 -- 172.21.15.144:0/2381599811 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3660037040 con 0x7f367815c030 2024-09-11T23:23:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.399+0000 7f366ea00640 1 -- 172.21.15.144:0/2381599811 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3660042070 con 0x7f367815c030 2024-09-11T23:23:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.399+0000 7f3677200640 1 -- 172.21.15.144:0/2381599811 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f367815dc60 con 0x7f367815c030 2024-09-11T23:23:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.399+0000 7f366ea00640 1 -- 172.21.15.144:0/2381599811 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3660030960 con 0x7f367815c030 2024-09-11T23:23:18.400 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.399+0000 7f3677200640 1 -- 172.21.15.144:0/2381599811 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f367815e220 con 0x7f367815c030 2024-09-11T23:23:18.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.400+0000 7f3677200640 1 -- 172.21.15.144:0/2381599811 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36780b1e60 con 0x7f367815c030 2024-09-11T23:23:18.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.401+0000 7f366ea00640 1 -- 172.21.15.144:0/2381599811 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f3660030b00 con 0x7f367815c030 2024-09-11T23:23:18.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.402+0000 7f366ea00640 1 --2- 172.21.15.144:0/2381599811 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f365406bf50 0x7f365406e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:18.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.402+0000 7f366ea00640 1 -- 172.21.15.144:0/2381599811 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f36600ab960 con 0x7f367815c030 2024-09-11T23:23:18.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.403+0000 7f3675e00640 1 --2- 172.21.15.144:0/2381599811 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f365406bf50 0x7f365406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:18.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.403+0000 7f3675e00640 1 --2- 172.21.15.144:0/2381599811 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f365406bf50 0x7f365406e410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3668007fd0 tx=0x7f3668009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:18.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.406+0000 7f366ea00640 1 -- 172.21.15.144:0/2381599811 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f366007a120 con 0x7f367815c030 2024-09-11T23:23:18.616 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:18.617+0000 7f3677200640 1 -- 172.21.15.144:0/2381599811 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f36780cdd50 con 0x7f367815c030 2024-09-11T23:23:19.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.447+0000 7f366ea00640 1 -- 172.21.15.144:0/2381599811 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v72) ==== 136+0+0 (secure 0 0 0) 0x7f3660079a20 con 0x7f367815c030 2024-09-11T23:23:19.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.450+0000 7f3677200640 1 -- 172.21.15.144:0/2381599811 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f365406bf50 msgr2=0x7f365406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:19.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.450+0000 7f3677200640 1 --2- 172.21.15.144:0/2381599811 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f365406bf50 0x7f365406e410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3668007fd0 tx=0x7f3668009040 comp rx=0 tx=0).stop 2024-09-11T23:23:19.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.450+0000 7f3677200640 1 -- 172.21.15.144:0/2381599811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f367815c030 msgr2=0x7f3678140ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:19.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.450+0000 7f3677200640 1 --2- 172.21.15.144:0/2381599811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f367815c030 0x7f3678140ca0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f36600097d0 tx=0x7f36600046c0 comp rx=0 tx=0).stop 2024-09-11T23:23:19.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.451+0000 7f3677200640 1 -- 172.21.15.144:0/2381599811 shutdown_connections 2024-09-11T23:23:19.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.451+0000 7f3677200640 1 --2- 172.21.15.144:0/2381599811 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f365406bf50 0x7f365406e410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:19.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.451+0000 7f3677200640 1 --2- 172.21.15.144:0/2381599811 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f367815c410 0x7f36781411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:19.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.451+0000 7f3677200640 1 --2- 172.21.15.144:0/2381599811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f367815c030 0x7f3678140ca0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:19.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.451+0000 7f3677200640 1 --2- 172.21.15.144:0/2381599811 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36780b2ab0 0x7f367815ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:19.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.451+0000 7f3677200640 1 -- 172.21.15.144:0/2381599811 >> 172.21.15.144:0/2381599811 conn(0x7f367806bba0 msgr2=0x7f36780af900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:19.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.451+0000 7f3677200640 1 -- 172.21.15.144:0/2381599811 shutdown_connections 2024-09-11T23:23:19.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.451+0000 7f3677200640 1 -- 172.21.15.144:0/2381599811 wait complete. 2024-09-11T23:23:19.468 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-11T23:23:19.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.625+0000 7f16fce00640 1 Processor -- start 2024-09-11T23:23:19.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.626+0000 7f16fce00640 1 -- start start 2024-09-11T23:23:19.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.627+0000 7f16fce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16f815e7b0 0x7f16f8071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:19.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.627+0000 7f16fce00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f16f80b5600 0x7f16f8073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:19.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.627+0000 7f16fce00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f8071880 con 0x7f16f8073ff0 2024-09-11T23:23:19.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.627+0000 7f16fce00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f16f806e680 con 0x7f16f80b5600 2024-09-11T23:23:19.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.627+0000 7f16fce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f16f806e8d0 con 0x7f16f815e7b0 2024-09-11T23:23:19.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.627+0000 7f16f6800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f16f8073ff0 0x7f16f806ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50060/0 (socket says 172.21.15.144:50060) 2024-09-11T23:23:19.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.627+0000 7f16f6800640 1 -- 172.21.15.144:0/3016392894 learned_addr learned my addr 172.21.15.144:0/3016392894 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:19.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.627+0000 7f16f5400640 1 --2- 172.21.15.144:0/3016392894 >> v2:172.21.15.165:3300/0 conn(0x7f16f80b5600 0x7f16f8073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:19.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.627+0000 7f16f5e00640 1 --2- 172.21.15.144:0/3016392894 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16f815e7b0 0x7f16f8071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:19.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.627+0000 7f16f4a00640 1 -- 172.21.15.144:0/3016392894 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 371773054 0 0) 0x7f16f0001110 con 0x7f16f8073ff0 2024-09-11T23:23:19.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.628+0000 7f16f4a00640 1 -- 172.21.15.144:0/3016392894 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16dc003520 con 0x7f16f8073ff0 2024-09-11T23:23:19.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.628+0000 7f16f5400640 1 -- 172.21.15.144:0/3016392894 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16f815e7b0 msgr2=0x7f16f8071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:19.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.628+0000 7f16f5400640 1 --2- 172.21.15.144:0/3016392894 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16f815e7b0 0x7f16f8071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:19.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.628+0000 7f16f4a00640 1 -- 172.21.15.144:0/3016392894 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1923934618 0 0) 0x7f16dc003520 con 0x7f16f8073ff0 2024-09-11T23:23:19.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.628+0000 7f16f5400640 1 -- 172.21.15.144:0/3016392894 >> v1:172.21.15.144:6789/0 conn(0x7f16f8073ff0 legacy=0x7f16f806ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:19.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.628+0000 7f16f5400640 1 -- 172.21.15.144:0/3016392894 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f806ebb0 con 0x7f16f80b5600 2024-09-11T23:23:19.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.628+0000 7f16f5e00640 1 --2- 172.21.15.144:0/3016392894 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16f815e7b0 0x7f16f8071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:23:19.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.629+0000 7f16f5400640 1 --2- 172.21.15.144:0/3016392894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16f80b5600 0x7f16f8073ab0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f16e40097a0 tx=0x7f16e402a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7808f5f44874f98c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:19.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.629+0000 7f16f4a00640 1 -- 172.21.15.144:0/3016392894 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4037070 con 0x7f16f80b5600 2024-09-11T23:23:19.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.629+0000 7f16f4a00640 1 -- 172.21.15.144:0/3016392894 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e402ab10 con 0x7f16f80b5600 2024-09-11T23:23:19.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.629+0000 7f16f4a00640 1 -- 172.21.15.144:0/3016392894 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0001840 con 0x7f16f80b5600 2024-09-11T23:23:19.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.630+0000 7f16fce00640 1 -- 172.21.15.144:0/3016392894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16f80b5600 msgr2=0x7f16f8073ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:19.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.630+0000 7f16fce00640 1 --2- 172.21.15.144:0/3016392894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16f80b5600 0x7f16f8073ab0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f16e40097a0 tx=0x7f16e402a080 comp rx=0 tx=0).stop 2024-09-11T23:23:19.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.630+0000 7f16fce00640 1 -- 172.21.15.144:0/3016392894 shutdown_connections 2024-09-11T23:23:19.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.630+0000 7f16fce00640 1 --2- 172.21.15.144:0/3016392894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16f80b5600 0x7f16f8073ab0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:19.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.630+0000 7f16fce00640 1 --2- 172.21.15.144:0/3016392894 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16f815e7b0 0x7f16f8071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:19.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.630+0000 7f16fce00640 1 -- 172.21.15.144:0/3016392894 >> 172.21.15.144:0/3016392894 conn(0x7f16f80b4300 msgr2=0x7f16f80b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:19.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.630+0000 7f16fce00640 1 -- 172.21.15.144:0/3016392894 shutdown_connections 2024-09-11T23:23:19.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.630+0000 7f16fce00640 1 -- 172.21.15.144:0/3016392894 wait complete. 2024-09-11T23:23:19.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.632+0000 7f16fce00640 1 Processor -- start 2024-09-11T23:23:19.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.632+0000 7f16fce00640 1 -- start start 2024-09-11T23:23:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.633+0000 7f16fce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16f80b5600 0x7f16f814cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.633+0000 7f16fce00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16f815e7b0 0x7f16f81e7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.633+0000 7f16fce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16f81e83c0 0x7f16f80cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.633+0000 7f16fce00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f16f806d3c0 con 0x7f16f80b5600 2024-09-11T23:23:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.633+0000 7f16fce00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f16f8073590 con 0x7f16f815e7b0 2024-09-11T23:23:19.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.633+0000 7f16fce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f16f806d540 con 0x7f16f81e83c0 2024-09-11T23:23:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.633+0000 7f16f5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16f80b5600 0x7f16f814cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.633+0000 7f16f5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16f80b5600 0x7f16f814cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50004/0 (socket says 172.21.15.144:50004) 2024-09-11T23:23:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.633+0000 7f16f5e00640 1 -- 172.21.15.144:0/962058840 learned_addr learned my addr 172.21.15.144:0/962058840 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.633+0000 7f16f5400640 1 --2- 172.21.15.144:0/962058840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16f815e7b0 0x7f16f81e7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.633+0000 7f16f5e00640 1 -- 172.21.15.144:0/962058840 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16f81e83c0 msgr2=0x7f16f80cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.633+0000 7f16f5e00640 1 --2- 172.21.15.144:0/962058840 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16f81e83c0 0x7f16f80cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.633+0000 7f16f5e00640 1 -- 172.21.15.144:0/962058840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16f815e7b0 msgr2=0x7f16f81e7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.633+0000 7f16f5e00640 1 --2- 172.21.15.144:0/962058840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16f815e7b0 0x7f16f81e7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.633+0000 7f16f5e00640 1 -- 172.21.15.144:0/962058840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f80cf700 con 0x7f16f80b5600 2024-09-11T23:23:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.633+0000 7f16f5400640 1 --2- 172.21.15.144:0/962058840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16f815e7b0 0x7f16f81e7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:23:19.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.634+0000 7f16f5e00640 1 --2- 172.21.15.144:0/962058840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16f80b5600 0x7f16f814cf90 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f16e8009ec0 tx=0x7f16e800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:19.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.634+0000 7f16ee000640 1 -- 172.21.15.144:0/962058840 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8018020 con 0x7f16f80b5600 2024-09-11T23:23:19.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.634+0000 7f16ee000640 1 -- 172.21.15.144:0/962058840 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e8014680 con 0x7f16f80b5600 2024-09-11T23:23:19.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.634+0000 7f16ee000640 1 -- 172.21.15.144:0/962058840 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8014a50 con 0x7f16f80b5600 2024-09-11T23:23:19.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.634+0000 7f16fce00640 1 -- 172.21.15.144:0/962058840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f80cf970 con 0x7f16f80b5600 2024-09-11T23:23:19.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.634+0000 7f16fce00640 1 -- 172.21.15.144:0/962058840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f80cff30 con 0x7f16f80b5600 2024-09-11T23:23:19.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.635+0000 7f16fce00640 1 -- 172.21.15.144:0/962058840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f8073ab0 con 0x7f16f80b5600 2024-09-11T23:23:19.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.636+0000 7f16ee000640 1 -- 172.21.15.144:0/962058840 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f16e8005d10 con 0x7f16f80b5600 2024-09-11T23:23:19.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.637+0000 7f16ee000640 1 --2- 172.21.15.144:0/962058840 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f16d806bf50 0x7f16d806e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:19.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.637+0000 7f16ee000640 1 -- 172.21.15.144:0/962058840 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f16e808bf70 con 0x7f16f80b5600 2024-09-11T23:23:19.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.637+0000 7f16f5400640 1 --2- 172.21.15.144:0/962058840 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f16d806bf50 0x7f16d806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:19.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.638+0000 7f16f5400640 1 --2- 172.21.15.144:0/962058840 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f16d806bf50 0x7f16d806e410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f16e4034000 tx=0x7f16e402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:19.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.642+0000 7f16ee000640 1 -- 172.21.15.144:0/962058840 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f16e8022030 con 0x7f16f80b5600 2024-09-11T23:23:19.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.840+0000 7f16fce00640 1 -- 172.21.15.144:0/962058840 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f16f80b1a90 con 0x7f16d806bf50 2024-09-11T23:23:19.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.842+0000 7f16ee000640 1 -- 172.21.15.144:0/962058840 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f16f80b1a90 con 0x7f16d806bf50 2024-09-11T23:23:19.841 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:23:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephfs" 2024-09-11T23:23:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:19.842 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:23:19.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.844+0000 7f16fce00640 1 -- 172.21.15.144:0/962058840 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f16d806bf50 msgr2=0x7f16d806e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:19.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.844+0000 7f16fce00640 1 --2- 172.21.15.144:0/962058840 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f16d806bf50 0x7f16d806e410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f16e4034000 tx=0x7f16e402e000 comp rx=0 tx=0).stop 2024-09-11T23:23:19.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.844+0000 7f16fce00640 1 -- 172.21.15.144:0/962058840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16f80b5600 msgr2=0x7f16f814cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:19.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.844+0000 7f16fce00640 1 --2- 172.21.15.144:0/962058840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16f80b5600 0x7f16f814cf90 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f16e8009ec0 tx=0x7f16e800c490 comp rx=0 tx=0).stop 2024-09-11T23:23:19.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.844+0000 7f16fce00640 1 -- 172.21.15.144:0/962058840 shutdown_connections 2024-09-11T23:23:19.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.844+0000 7f16fce00640 1 --2- 172.21.15.144:0/962058840 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f16d806bf50 0x7f16d806e410 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:19.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.844+0000 7f16fce00640 1 --2- 172.21.15.144:0/962058840 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f16f81e83c0 0x7f16f80cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:19.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.844+0000 7f16fce00640 1 --2- 172.21.15.144:0/962058840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f16f815e7b0 0x7f16f81e7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:19.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.844+0000 7f16fce00640 1 --2- 172.21.15.144:0/962058840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f16f80b5600 0x7f16f814cf90 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:19.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.844+0000 7f16fce00640 1 -- 172.21.15.144:0/962058840 >> 172.21.15.144:0/962058840 conn(0x7f16f80b4300 msgr2=0x7f16f815b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:19.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.844+0000 7f16fce00640 1 -- 172.21.15.144:0/962058840 shutdown_connections 2024-09-11T23:23:19.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:19.844+0000 7f16fce00640 1 -- 172.21.15.144:0/962058840 wait complete. 2024-09-11T23:23:19.860 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:23:20.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.016+0000 7f907ba00640 1 Processor -- start 2024-09-11T23:23:20.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.016+0000 7f907ba00640 1 -- start start 2024-09-11T23:23:20.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.018+0000 7f907ba00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9074160530 0x7f907406d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:20.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.018+0000 7f907ba00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9074160910 0x7f9074071b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:20.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.018+0000 7f907ba00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f907406d5c0 con 0x7f9074072070 2024-09-11T23:23:20.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.018+0000 7f907ba00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9074072980 con 0x7f9074160530 2024-09-11T23:23:20.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.018+0000 7f907ba00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f90740731c0 con 0x7f9074160910 2024-09-11T23:23:20.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.018+0000 7f906be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9074160910 0x7f9074071b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:20.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.018+0000 7f9079000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9074160530 0x7f907406d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:20.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.018+0000 7f9079a00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f9074072070 0x7f90741666f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:48984/0 (socket says 172.21.15.144:48984) 2024-09-11T23:23:20.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.018+0000 7f906be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9074160910 0x7f9074071b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50802/0 (socket says 172.21.15.144:50802) 2024-09-11T23:23:20.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.018+0000 7f9079a00640 1 -- 172.21.15.144:0/1585347248 learned_addr learned my addr 172.21.15.144:0/1585347248 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:20.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.019+0000 7f9079000640 1 -- 172.21.15.144:0/1585347248 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9074160910 msgr2=0x7f9074071b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:20.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.019+0000 7f9079000640 1 --2- 172.21.15.144:0/1585347248 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9074160910 0x7f9074071b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:20.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.019+0000 7f9079000640 1 -- 172.21.15.144:0/1585347248 >> v1:172.21.15.165:6789/0 conn(0x7f9074072070 legacy=0x7f90741666f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:20.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.019+0000 7f9079000640 1 -- 172.21.15.144:0/1585347248 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90741633c0 con 0x7f9074160530 2024-09-11T23:23:20.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.020+0000 7f9079000640 1 --2- 172.21.15.144:0/1585347248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9074160530 0x7f907406d080 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f90640097a0 tx=0x7f906402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=780c9efaa90228f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:20.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.020+0000 7f9073e00640 1 -- 172.21.15.144:0/1585347248 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064037070 con 0x7f9074160530 2024-09-11T23:23:20.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.020+0000 7f9073e00640 1 -- 172.21.15.144:0/1585347248 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9064032440 con 0x7f9074160530 2024-09-11T23:23:20.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.020+0000 7f9073e00640 1 -- 172.21.15.144:0/1585347248 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064032810 con 0x7f9074160530 2024-09-11T23:23:20.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.021+0000 7f907ba00640 1 -- 172.21.15.144:0/1585347248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9074160530 msgr2=0x7f907406d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:20.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.021+0000 7f907ba00640 1 --2- 172.21.15.144:0/1585347248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9074160530 0x7f907406d080 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f90640097a0 tx=0x7f906402a180 comp rx=0 tx=0).stop 2024-09-11T23:23:20.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.021+0000 7f907ba00640 1 -- 172.21.15.144:0/1585347248 shutdown_connections 2024-09-11T23:23:20.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.021+0000 7f907ba00640 1 --2- 172.21.15.144:0/1585347248 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9074160910 0x7f9074071b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:20.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.021+0000 7f907ba00640 1 --2- 172.21.15.144:0/1585347248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9074160530 0x7f907406d080 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:20.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.021+0000 7f907ba00640 1 -- 172.21.15.144:0/1585347248 >> 172.21.15.144:0/1585347248 conn(0x7f907406bba0 msgr2=0x7f907406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:20.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.021+0000 7f907ba00640 1 -- 172.21.15.144:0/1585347248 shutdown_connections 2024-09-11T23:23:20.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.021+0000 7f907ba00640 1 -- 172.21.15.144:0/1585347248 wait complete. 2024-09-11T23:23:20.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.023+0000 7f907ba00640 1 Processor -- start 2024-09-11T23:23:20.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.023+0000 7f907ba00640 1 -- start start 2024-09-11T23:23:20.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.024+0000 7f907ba00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9074072070 0x7f90740af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:20.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.024+0000 7f907ba00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9074160530 0x7f90741463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:20.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.024+0000 7f907ba00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9074160910 0x7f9074147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:20.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.024+0000 7f907ba00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f90741630b0 con 0x7f9074160910 2024-09-11T23:23:20.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.024+0000 7f907ba00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9074163980 con 0x7f9074072070 2024-09-11T23:23:20.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.024+0000 7f907ba00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9074072d90 con 0x7f9074160530 2024-09-11T23:23:20.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.024+0000 7f9079a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9074160910 0x7f9074147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:20.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.024+0000 7f9079000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9074072070 0x7f90740af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:20.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.024+0000 7f9079a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9074160910 0x7f9074147c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50008/0 (socket says 172.21.15.144:50008) 2024-09-11T23:23:20.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.024+0000 7f9079a00640 1 -- 172.21.15.144:0/1298881015 learned_addr learned my addr 172.21.15.144:0/1298881015 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:20.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.024+0000 7f906be00640 1 --2- 172.21.15.144:0/1298881015 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9074160530 0x7f90741463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:20.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.025+0000 7f906be00640 1 -- 172.21.15.144:0/1298881015 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9074072070 msgr2=0x7f90740af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:20.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.025+0000 7f906be00640 1 --2- 172.21.15.144:0/1298881015 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9074072070 0x7f90740af0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:20.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.025+0000 7f906be00640 1 -- 172.21.15.144:0/1298881015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9074160910 msgr2=0x7f9074147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:20.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.025+0000 7f906be00640 1 --2- 172.21.15.144:0/1298881015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9074160910 0x7f9074147c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:20.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.025+0000 7f906be00640 1 -- 172.21.15.144:0/1298881015 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9074146b60 con 0x7f9074160530 2024-09-11T23:23:20.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.025+0000 7f9079a00640 1 --2- 172.21.15.144:0/1298881015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9074160910 0x7f9074147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:23:20.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.025+0000 7f9079000640 1 --2- 172.21.15.144:0/1298881015 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9074072070 0x7f90740af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:23:20.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.025+0000 7f906be00640 1 --2- 172.21.15.144:0/1298881015 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9074160530 0x7f90741463f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f905c00e840 tx=0x7f905c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:20.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.025+0000 7f9071600640 1 -- 172.21.15.144:0/1298881015 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905c017070 con 0x7f9074160530 2024-09-11T23:23:20.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.025+0000 7f9071600640 1 -- 172.21.15.144:0/1298881015 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f905c00c940 con 0x7f9074160530 2024-09-11T23:23:20.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.025+0000 7f907ba00640 1 -- 172.21.15.144:0/1298881015 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9074146e40 con 0x7f9074160530 2024-09-11T23:23:20.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.025+0000 7f9071600640 1 -- 172.21.15.144:0/1298881015 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905c00ccf0 con 0x7f9074160530 2024-09-11T23:23:20.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.025+0000 7f907ba00640 1 -- 172.21.15.144:0/1298881015 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9074147400 con 0x7f9074160530 2024-09-11T23:23:20.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.026+0000 7f907ba00640 1 -- 172.21.15.144:0/1298881015 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9074163ea0 con 0x7f9074160530 2024-09-11T23:23:20.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.027+0000 7f9071600640 1 -- 172.21.15.144:0/1298881015 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f905c01a070 con 0x7f9074160530 2024-09-11T23:23:20.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.028+0000 7f9071600640 1 --2- 172.21.15.144:0/1298881015 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f905006bf50 0x7f905006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:20.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.028+0000 7f9071600640 1 -- 172.21.15.144:0/1298881015 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f905c08af50 con 0x7f9074160530 2024-09-11T23:23:20.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.029+0000 7f9079000640 1 --2- 172.21.15.144:0/1298881015 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f905006bf50 0x7f905006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:20.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.029+0000 7f9079000640 1 --2- 172.21.15.144:0/1298881015 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f905006bf50 0x7f905006e410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9064034000 tx=0x7f906402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:20.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.034+0000 7f9071600640 1 -- 172.21.15.144:0/1298881015 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f905c0590c0 con 0x7f9074160530 2024-09-11T23:23:20.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.208+0000 7f907ba00640 1 -- 172.21.15.144:0/1298881015 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f90740b4a20 con 0x7f9074160530 2024-09-11T23:23:20.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.209+0000 7f9071600640 1 -- 172.21.15.144:0/1298881015 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f905c05d3c0 con 0x7f9074160530 2024-09-11T23:23:20.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.211+0000 7f907ba00640 1 -- 172.21.15.144:0/1298881015 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f905006bf50 msgr2=0x7f905006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:20.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.211+0000 7f907ba00640 1 --2- 172.21.15.144:0/1298881015 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f905006bf50 0x7f905006e410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9064034000 tx=0x7f906402e000 comp rx=0 tx=0).stop 2024-09-11T23:23:20.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.211+0000 7f907ba00640 1 -- 172.21.15.144:0/1298881015 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9074160530 msgr2=0x7f90741463f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:20.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.211+0000 7f907ba00640 1 --2- 172.21.15.144:0/1298881015 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9074160530 0x7f90741463f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f905c00e840 tx=0x7f905c00ed00 comp rx=0 tx=0).stop 2024-09-11T23:23:20.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.212+0000 7f907ba00640 1 -- 172.21.15.144:0/1298881015 shutdown_connections 2024-09-11T23:23:20.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.212+0000 7f907ba00640 1 --2- 172.21.15.144:0/1298881015 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f905006bf50 0x7f905006e410 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:20.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.212+0000 7f907ba00640 1 --2- 172.21.15.144:0/1298881015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9074160910 0x7f9074147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:20.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.212+0000 7f907ba00640 1 --2- 172.21.15.144:0/1298881015 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9074160530 0x7f90741463f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:20.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.212+0000 7f907ba00640 1 --2- 172.21.15.144:0/1298881015 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9074072070 0x7f90740af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:20.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.212+0000 7f907ba00640 1 -- 172.21.15.144:0/1298881015 >> 172.21.15.144:0/1298881015 conn(0x7f907406bba0 msgr2=0x7f90741627e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:20.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.212+0000 7f907ba00640 1 -- 172.21.15.144:0/1298881015 shutdown_connections 2024-09-11T23:23:20.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.212+0000 7f907ba00640 1 -- 172.21.15.144:0/1298881015 wait complete. 2024-09-11T23:23:20.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:20.227 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee) 2024-09-11T23:23:20.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:20.291 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/fake) 2024-09-11T23:23:20.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:20.376 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-11T23:23:20.412 INFO:teuthology.orchestra.run.smithi144.stdout:cephfs_data 2024-09-11T23:23:20.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:20.413 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee) 2024-09-11T23:23:20.513 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:23:20.513 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol38500/.meta 2024-09-11T23:23:20.573 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol38500 2024-09-11T23:23:20.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.771+0000 7f1ef7e00640 1 Processor -- start 2024-09-11T23:23:20.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.771+0000 7f1ef7e00640 1 -- start start 2024-09-11T23:23:20.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.772+0000 7f1ef7e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1ef815e240 0x7f1ef80b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:20.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.773+0000 7f1ef7e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ef80b3ac0 con 0x7f1ef806bba0 2024-09-11T23:23:20.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.773+0000 7f1ef7e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ef80b3d50 con 0x7f1ef815e620 2024-09-11T23:23:20.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.773+0000 7f1ef7e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1ef80b4030 con 0x7f1ef815e240 2024-09-11T23:23:20.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.773+0000 7f1ef7400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1ef806bba0 0x7f1ef80cdc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50066/0 (socket says 172.21.15.144:50066) 2024-09-11T23:23:20.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.773+0000 7f1ef7400640 1 -- 172.21.15.144:0/1634290404 learned_addr learned my addr 172.21.15.144:0/1634290404 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:20.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.773+0000 7f1ef6a00640 1 --2- 172.21.15.144:0/1634290404 >> v2:172.21.15.165:3300/0 conn(0x7f1ef815e240 0x7f1ef80b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:20.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.773+0000 7f1ef5600640 1 -- 172.21.15.144:0/1634290404 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 799878511 0 0) 0x7f1ef80b3ac0 con 0x7f1ef806bba0 2024-09-11T23:23:20.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.773+0000 7f1ef5600640 1 -- 172.21.15.144:0/1634290404 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1edc003520 con 0x7f1ef806bba0 2024-09-11T23:23:20.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef5600640 1 -- 172.21.15.144:0/1634290404 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4130854470 0 0) 0x7f1edc003520 con 0x7f1ef806bba0 2024-09-11T23:23:20.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef5600640 1 -- 172.21.15.144:0/1634290404 >> v2:172.21.15.165:3300/0 conn(0x7f1ef815e240 msgr2=0x7f1ef80b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:20.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef5600640 1 --2- 172.21.15.144:0/1634290404 >> v2:172.21.15.165:3300/0 conn(0x7f1ef815e240 0x7f1ef80b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:20.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef5600640 1 -- 172.21.15.144:0/1634290404 >> v1:172.21.15.165:6789/0 conn(0x7f1ef815e620 legacy=0x7f1ef80b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:20.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef5600640 1 -- 172.21.15.144:0/1634290404 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef80b4310 con 0x7f1ef806bba0 2024-09-11T23:23:20.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef5600640 1 -- 172.21.15.144:0/1634290404 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f1ef0001670 con 0x7f1ef806bba0 2024-09-11T23:23:20.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef5600640 1 -- 172.21.15.144:0/1634290404 >> v1:172.21.15.144:6789/0 conn(0x7f1ef806bba0 legacy=0x7f1ef80cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:20.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef5600640 1 --2- 172.21.15.144:0/1634290404 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1edc0039b0 0x7f1edc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:20.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef5600640 1 --2- 172.21.15.144:0/1634290404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1edc0043b0 0x7f1edc004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:20.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef5600640 1 --2- 172.21.15.144:0/1634290404 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1edc005120 0x7f1edc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:20.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef5600640 1 -- 172.21.15.144:0/1634290404 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef80b4030 con 0x7f1edc0043b0 2024-09-11T23:23:20.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef5600640 1 -- 172.21.15.144:0/1634290404 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc00c060 con 0x7f1edc0039b0 2024-09-11T23:23:20.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef5600640 1 -- 172.21.15.144:0/1634290404 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1edc00c260 con 0x7f1edc005120 2024-09-11T23:23:20.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef6000640 1 --2- 172.21.15.144:0/1634290404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1edc0043b0 0x7f1edc004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:20.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef6a00640 1 --2- 172.21.15.144:0/1634290404 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1edc0039b0 0x7f1edc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:20.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef7400640 1 --2- 172.21.15.144:0/1634290404 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1edc005120 0x7f1edc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:20.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef6000640 1 -- 172.21.15.144:0/1634290404 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1edc005120 msgr2=0x7f1edc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:20.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef6000640 1 --2- 172.21.15.144:0/1634290404 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1edc005120 0x7f1edc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:20.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef6000640 1 -- 172.21.15.144:0/1634290404 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1edc0039b0 msgr2=0x7f1edc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:20.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef6000640 1 --2- 172.21.15.144:0/1634290404 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1edc0039b0 0x7f1edc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:20.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef6000640 1 -- 172.21.15.144:0/1634290404 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1edc003520 con 0x7f1edc0043b0 2024-09-11T23:23:20.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.774+0000 7f1ef7400640 1 -- 172.21.15.144:0/1634290404 reap_dead start 2024-09-11T23:23:20.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.775+0000 7f1ef6000640 1 --2- 172.21.15.144:0/1634290404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1edc0043b0 0x7f1edc004880 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4001910 tx=0x7f1edc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa964b62b807ee24 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:20.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.776+0000 7f1ef5600640 1 -- 172.21.15.144:0/1634290404 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4037070 con 0x7f1edc0043b0 2024-09-11T23:23:20.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.776+0000 7f1ef5600640 1 -- 172.21.15.144:0/1634290404 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee402ac40 con 0x7f1edc0043b0 2024-09-11T23:23:20.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.776+0000 7f1ef5600640 1 -- 172.21.15.144:0/1634290404 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee40014e0 con 0x7f1edc0043b0 2024-09-11T23:23:20.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.776+0000 7f1ef7e00640 1 -- 172.21.15.144:0/1634290404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1edc0043b0 msgr2=0x7f1edc004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:20.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.776+0000 7f1ef7e00640 1 --2- 172.21.15.144:0/1634290404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1edc0043b0 0x7f1edc004880 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4001910 tx=0x7f1edc005830 comp rx=0 tx=0).stop 2024-09-11T23:23:20.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.776+0000 7f1ef7e00640 1 -- 172.21.15.144:0/1634290404 shutdown_connections 2024-09-11T23:23:20.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.776+0000 7f1ef7e00640 1 --2- 172.21.15.144:0/1634290404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1edc0043b0 0x7f1edc004880 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:20.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.776+0000 7f1ef7e00640 1 -- 172.21.15.144:0/1634290404 >> 172.21.15.144:0/1634290404 conn(0x7f1ef80d0300 msgr2=0x7f1ef80d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:20.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.776+0000 7f1ef7e00640 1 -- 172.21.15.144:0/1634290404 shutdown_connections 2024-09-11T23:23:20.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.776+0000 7f1ef7e00640 1 -- 172.21.15.144:0/1634290404 wait complete. 2024-09-11T23:23:20.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.778+0000 7f1ef7e00640 1 Processor -- start 2024-09-11T23:23:20.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.778+0000 7f1ef7e00640 1 -- start start 2024-09-11T23:23:20.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.779+0000 7f1ef7e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1edc0043b0 0x7f1ef8151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:20.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.779+0000 7f1ef7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ef8152810 0x7f1ef81520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.779+0000 7f1ef7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ef81f7880 0x7f1ef81f7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.779+0000 7f1ef7e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef8162d50 con 0x7f1ef81f7880 2024-09-11T23:23:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.779+0000 7f1ef7e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef80b48d0 con 0x7f1ef8152810 2024-09-11T23:23:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.779+0000 7f1ef7e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef8162ed0 con 0x7f1edc0043b0 2024-09-11T23:23:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.779+0000 7f1ef7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ef81f7880 0x7f1ef81f7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.779+0000 7f1ef7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ef81f7880 0x7f1ef81f7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50020/0 (socket says 172.21.15.144:50020) 2024-09-11T23:23:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.779+0000 7f1ef7400640 1 -- 172.21.15.144:0/1495070632 learned_addr learned my addr 172.21.15.144:0/1495070632 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.779+0000 7f1ef6000640 1 --2- 172.21.15.144:0/1495070632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ef8152810 0x7f1ef81520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.779+0000 7f1ef6a00640 1 --2- 172.21.15.144:0/1495070632 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1edc0043b0 0x7f1ef8151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.780+0000 7f1ef7400640 1 -- 172.21.15.144:0/1495070632 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1edc0043b0 msgr2=0x7f1ef8151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.780+0000 7f1ef7400640 1 --2- 172.21.15.144:0/1495070632 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1edc0043b0 0x7f1ef8151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.780+0000 7f1ef7400640 1 -- 172.21.15.144:0/1495070632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ef8152810 msgr2=0x7f1ef81520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.780+0000 7f1ef7400640 1 --2- 172.21.15.144:0/1495070632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ef8152810 0x7f1ef81520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:20.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.780+0000 7f1ef7400640 1 -- 172.21.15.144:0/1495070632 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef80717c0 con 0x7f1ef81f7880 2024-09-11T23:23:20.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.780+0000 7f1ef7400640 1 --2- 172.21.15.144:0/1495070632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ef81f7880 0x7f1ef81f7d30 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f1ef80afff0 tx=0x7f1ef0007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:20.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.780+0000 7f1eeea00640 1 -- 172.21.15.144:0/1495070632 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef000f5a0 con 0x7f1ef81f7880 2024-09-11T23:23:20.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.780+0000 7f1eeea00640 1 -- 172.21.15.144:0/1495070632 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef0018070 con 0x7f1ef81f7880 2024-09-11T23:23:20.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.780+0000 7f1eeea00640 1 -- 172.21.15.144:0/1495070632 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef000f9a0 con 0x7f1ef81f7880 2024-09-11T23:23:20.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.780+0000 7f1ef7e00640 1 -- 172.21.15.144:0/1495070632 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef8159190 con 0x7f1ef81f7880 2024-09-11T23:23:20.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.780+0000 7f1ef7e00640 1 -- 172.21.15.144:0/1495070632 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef8071a60 con 0x7f1ef81f7880 2024-09-11T23:23:20.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.781+0000 7f1ef7e00640 1 -- 172.21.15.144:0/1495070632 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ef80b3b70 con 0x7f1ef81f7880 2024-09-11T23:23:20.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.782+0000 7f1eeea00640 1 -- 172.21.15.144:0/1495070632 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f1ef000fb40 con 0x7f1ef81f7880 2024-09-11T23:23:20.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.783+0000 7f1eeea00640 1 --2- 172.21.15.144:0/1495070632 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ed806bf80 0x7f1ed806e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:20.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.783+0000 7f1eeea00640 1 -- 172.21.15.144:0/1495070632 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f1ef008ac60 con 0x7f1ef81f7880 2024-09-11T23:23:20.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.784+0000 7f1ef6a00640 1 --2- 172.21.15.144:0/1495070632 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ed806bf80 0x7f1ed806e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:20.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.784+0000 7f1ef6a00640 1 --2- 172.21.15.144:0/1495070632 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ed806bf80 0x7f1ed806e440 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1ef81582d0 tx=0x7f1ee800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:20.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.787+0000 7f1eeea00640 1 -- 172.21.15.144:0/1495070632 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1ef80b3b70 con 0x7f1ef81f7880 2024-09-11T23:23:20.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:20.986+0000 7f1ef7e00640 1 -- 172.21.15.144:0/1495070632 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol38500", "target": ["mon-mgr", ""]}) -- 0x7f1ef80b4df0 con 0x7f1ed806bf80 2024-09-11T23:23:20.992 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:20.993+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:20.992 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:20.993+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:20.993 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:20.993+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:20.993 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:20.993+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:20.993 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:20.993+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:21.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.041+0000 7f1eeea00640 1 -- 172.21.15.144:0/1495070632 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7f1ef80b4df0 con 0x7f1ed806bf80 2024-09-11T23:23:21.041 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee 2024-09-11T23:23:21.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.043+0000 7f1ef7e00640 1 -- 172.21.15.144:0/1495070632 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ed806bf80 msgr2=0x7f1ed806e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:21.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.043+0000 7f1ef7e00640 1 --2- 172.21.15.144:0/1495070632 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ed806bf80 0x7f1ed806e440 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1ef81582d0 tx=0x7f1ee800b040 comp rx=0 tx=0).stop 2024-09-11T23:23:21.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.043+0000 7f1ef7e00640 1 -- 172.21.15.144:0/1495070632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ef81f7880 msgr2=0x7f1ef81f7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:21.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.043+0000 7f1ef7e00640 1 --2- 172.21.15.144:0/1495070632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ef81f7880 0x7f1ef81f7d30 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f1ef80afff0 tx=0x7f1ef0007430 comp rx=0 tx=0).stop 2024-09-11T23:23:21.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.044+0000 7f1ef7e00640 1 -- 172.21.15.144:0/1495070632 shutdown_connections 2024-09-11T23:23:21.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.044+0000 7f1ef7e00640 1 --2- 172.21.15.144:0/1495070632 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ed806bf80 0x7f1ed806e440 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.044+0000 7f1ef7e00640 1 --2- 172.21.15.144:0/1495070632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ef81f7880 0x7f1ef81f7d30 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.044+0000 7f1ef7e00640 1 --2- 172.21.15.144:0/1495070632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ef8152810 0x7f1ef81520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.044+0000 7f1ef7e00640 1 --2- 172.21.15.144:0/1495070632 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1edc0043b0 0x7f1ef8151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.044+0000 7f1ef7e00640 1 -- 172.21.15.144:0/1495070632 >> 172.21.15.144:0/1495070632 conn(0x7f1ef80d0300 msgr2=0x7f1ef815d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:21.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.044+0000 7f1ef7e00640 1 -- 172.21.15.144:0/1495070632 shutdown_connections 2024-09-11T23:23:21.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.044+0000 7f1ef7e00640 1 -- 172.21.15.144:0/1495070632 wait complete. 2024-09-11T23:23:21.059 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs 2024-09-11T23:23:21.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.215+0000 7f90b7600640 1 Processor -- start 2024-09-11T23:23:21.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.215+0000 7f90b7600640 1 -- start start 2024-09-11T23:23:21.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.216+0000 7f90b7600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f90b0158e50 0x7f90b00b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:21.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.216+0000 7f90b7600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90b015c370 0x7f90b006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:21.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.216+0000 7f90b7600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90b015c800 con 0x7f90b006ef60 2024-09-11T23:23:21.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.216+0000 7f90b7600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f90b006f3d0 con 0x7f90b0158e50 2024-09-11T23:23:21.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.216+0000 7f90b7600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f90b00b43f0 con 0x7f90b015c370 2024-09-11T23:23:21.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.216+0000 7f90b4c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f90b0158e50 0x7f90b00b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:21.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.216+0000 7f90b5600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f90b006ef60 0x7f90b015ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50078/0 (socket says 172.21.15.144:50078) 2024-09-11T23:23:21.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.216+0000 7f90b5600640 1 -- 172.21.15.144:0/251033469 learned_addr learned my addr 172.21.15.144:0/251033469 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:21.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.217+0000 7f90afe00640 1 --2- 172.21.15.144:0/251033469 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90b015c370 0x7f90b006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:21.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.217+0000 7f90b4c00640 1 -- 172.21.15.144:0/251033469 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90b015c370 msgr2=0x7f90b006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:21.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.217+0000 7f90b4c00640 1 --2- 172.21.15.144:0/251033469 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90b015c370 0x7f90b006ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.217+0000 7f90b4c00640 1 -- 172.21.15.144:0/251033469 >> v1:172.21.15.144:6789/0 conn(0x7f90b006ef60 legacy=0x7f90b015ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:21.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.217+0000 7f90b4c00640 1 -- 172.21.15.144:0/251033469 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b00b3630 con 0x7f90b0158e50 2024-09-11T23:23:21.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.218+0000 7f90b4c00640 1 --2- 172.21.15.144:0/251033469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b0158e50 0x7f90b00b5050 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f90a00097a0 tx=0x7f90a002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1da2ca00e1dda3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:21.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.218+0000 7f90af400640 1 -- 172.21.15.144:0/251033469 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0037070 con 0x7f90b0158e50 2024-09-11T23:23:21.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.218+0000 7f90af400640 1 -- 172.21.15.144:0/251033469 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a0032440 con 0x7f90b0158e50 2024-09-11T23:23:21.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.218+0000 7f90af400640 1 -- 172.21.15.144:0/251033469 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0032810 con 0x7f90b0158e50 2024-09-11T23:23:21.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.218+0000 7f90b7600640 1 -- 172.21.15.144:0/251033469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b0158e50 msgr2=0x7f90b00b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:21.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.218+0000 7f90b7600640 1 --2- 172.21.15.144:0/251033469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b0158e50 0x7f90b00b5050 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f90a00097a0 tx=0x7f90a002a180 comp rx=0 tx=0).stop 2024-09-11T23:23:21.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.219+0000 7f90b7600640 1 -- 172.21.15.144:0/251033469 shutdown_connections 2024-09-11T23:23:21.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.219+0000 7f90b7600640 1 --2- 172.21.15.144:0/251033469 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90b015c370 0x7f90b006ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.219+0000 7f90b7600640 1 --2- 172.21.15.144:0/251033469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b0158e50 0x7f90b00b5050 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.219+0000 7f90b7600640 1 -- 172.21.15.144:0/251033469 >> 172.21.15.144:0/251033469 conn(0x7f90b006bba0 msgr2=0x7f90b006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:21.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.219+0000 7f90b7600640 1 -- 172.21.15.144:0/251033469 shutdown_connections 2024-09-11T23:23:21.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.219+0000 7f90b7600640 1 -- 172.21.15.144:0/251033469 wait complete. 2024-09-11T23:23:21.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.220+0000 7f90b7600640 1 Processor -- start 2024-09-11T23:23:21.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.220+0000 7f90b7600640 1 -- start start 2024-09-11T23:23:21.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.221+0000 7f90b7600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b006ef60 0x7f90b014b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:21.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.221+0000 7f90b7600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90b0158e50 0x7f90b014bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:21.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.221+0000 7f90b7600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90b015c370 0x7f90b00af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:21.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.221+0000 7f90b7600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f90b00b3ed0 con 0x7f90b006ef60 2024-09-11T23:23:21.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.221+0000 7f90b7600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f90b00b3bf0 con 0x7f90b015c370 2024-09-11T23:23:21.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.221+0000 7f90b7600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f90b0159230 con 0x7f90b0158e50 2024-09-11T23:23:21.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.221+0000 7f90b4c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b006ef60 0x7f90b014b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:21.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.221+0000 7f90b4c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b006ef60 0x7f90b014b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50034/0 (socket says 172.21.15.144:50034) 2024-09-11T23:23:21.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.221+0000 7f90b4c00640 1 -- 172.21.15.144:0/2831204000 learned_addr learned my addr 172.21.15.144:0/2831204000 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:21.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.222+0000 7f90afe00640 1 --2- 172.21.15.144:0/2831204000 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90b0158e50 0x7f90b014bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:21.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.222+0000 7f90b4c00640 1 -- 172.21.15.144:0/2831204000 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90b0158e50 msgr2=0x7f90b014bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:21.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.222+0000 7f90b4c00640 1 --2- 172.21.15.144:0/2831204000 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90b0158e50 0x7f90b014bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.222+0000 7f90b4c00640 1 -- 172.21.15.144:0/2831204000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90b015c370 msgr2=0x7f90b00af120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:21.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.222+0000 7f90b5600640 1 --2- 172.21.15.144:0/2831204000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90b015c370 0x7f90b00af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:21.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.222+0000 7f90b4c00640 1 --2- 172.21.15.144:0/2831204000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90b015c370 0x7f90b00af120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.222+0000 7f90b4c00640 1 -- 172.21.15.144:0/2831204000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b01e6fb0 con 0x7f90b006ef60 2024-09-11T23:23:21.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.222+0000 7f90afe00640 1 --2- 172.21.15.144:0/2831204000 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90b0158e50 0x7f90b014bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:23:21.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.222+0000 7f90b4c00640 1 --2- 172.21.15.144:0/2831204000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b006ef60 0x7f90b014b930 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f90a00098c0 tx=0x7f90a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:21.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.222+0000 7f90acc00640 1 -- 172.21.15.144:0/2831204000 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0037040 con 0x7f90b006ef60 2024-09-11T23:23:21.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.222+0000 7f90acc00640 1 -- 172.21.15.144:0/2831204000 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a0030770 con 0x7f90b006ef60 2024-09-11T23:23:21.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.222+0000 7f90acc00640 1 -- 172.21.15.144:0/2831204000 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0030b40 con 0x7f90b006ef60 2024-09-11T23:23:21.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.222+0000 7f90b7600640 1 -- 172.21.15.144:0/2831204000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b01e7290 con 0x7f90b006ef60 2024-09-11T23:23:21.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.223+0000 7f90b7600640 1 -- 172.21.15.144:0/2831204000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b01e7850 con 0x7f90b006ef60 2024-09-11T23:23:21.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.224+0000 7f90b7600640 1 -- 172.21.15.144:0/2831204000 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b01e7a90 con 0x7f90b006ef60 2024-09-11T23:23:21.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.224+0000 7f90acc00640 1 -- 172.21.15.144:0/2831204000 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 16) ==== 90600+0+0 (secure 0 0 0) 0x7f90a0044020 con 0x7f90b006ef60 2024-09-11T23:23:21.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.226+0000 7f90acc00640 1 --2- 172.21.15.144:0/2831204000 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f909006bf50 0x7f909006e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:21.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.226+0000 7f90acc00640 1 -- 172.21.15.144:0/2831204000 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f90a00ab530 con 0x7f90b006ef60 2024-09-11T23:23:21.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.226+0000 7f90afe00640 1 --2- 172.21.15.144:0/2831204000 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f909006bf50 0x7f909006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:21.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.227+0000 7f90afe00640 1 --2- 172.21.15.144:0/2831204000 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f909006bf50 0x7f909006e410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f90b00b00e0 tx=0x7f909c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:21.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.230+0000 7f90acc00640 1 -- 172.21.15.144:0/2831204000 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f90b01e7a90 con 0x7f90b006ef60 2024-09-11T23:23:21.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.427+0000 7f90b7600640 1 -- 172.21.15.144:0/2831204000 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) -- 0x7f90b00af660 con 0x7f909006bf50 2024-09-11T23:23:21.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.432+0000 7f90acc00640 1 -- 172.21.15.144:0/2831204000 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7f909c004040 con 0x7f909006bf50 2024-09-11T23:23:21.432 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:23:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "subvol38500" 2024-09-11T23:23:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:21.432 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:23:21.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.435+0000 7f90b7600640 1 -- 172.21.15.144:0/2831204000 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f909006bf50 msgr2=0x7f909006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:21.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.435+0000 7f90b7600640 1 --2- 172.21.15.144:0/2831204000 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f909006bf50 0x7f909006e410 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f90b00b00e0 tx=0x7f909c008040 comp rx=0 tx=0).stop 2024-09-11T23:23:21.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.435+0000 7f90b7600640 1 -- 172.21.15.144:0/2831204000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b006ef60 msgr2=0x7f90b014b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:21.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.435+0000 7f90b7600640 1 --2- 172.21.15.144:0/2831204000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b006ef60 0x7f90b014b930 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f90a00098c0 tx=0x7f90a00046c0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.435+0000 7f90b7600640 1 -- 172.21.15.144:0/2831204000 shutdown_connections 2024-09-11T23:23:21.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.435+0000 7f90b7600640 1 --2- 172.21.15.144:0/2831204000 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f909006bf50 0x7f909006e410 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.435+0000 7f90b7600640 1 --2- 172.21.15.144:0/2831204000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90b015c370 0x7f90b00af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.435+0000 7f90b7600640 1 --2- 172.21.15.144:0/2831204000 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f90b0158e50 0x7f90b014bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.435+0000 7f90b7600640 1 --2- 172.21.15.144:0/2831204000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f90b006ef60 0x7f90b014b930 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.435+0000 7f90b7600640 1 -- 172.21.15.144:0/2831204000 >> 172.21.15.144:0/2831204000 conn(0x7f90b006bba0 msgr2=0x7f90b0071180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:21.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.435+0000 7f90b7600640 1 -- 172.21.15.144:0/2831204000 shutdown_connections 2024-09-11T23:23:21.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.435+0000 7f90b7600640 1 -- 172.21.15.144:0/2831204000 wait complete. 2024-09-11T23:23:21.450 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvol38500 2024-09-11T23:23:21.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.608+0000 7fe8faa00640 1 Processor -- start 2024-09-11T23:23:21.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.608+0000 7fe8faa00640 1 -- start start 2024-09-11T23:23:21.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.609+0000 7fe8faa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8f415e6c0 0x7fe8f406c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:21.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.609+0000 7fe8faa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe8f406d610 0x7fe8f406da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:21.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.609+0000 7fe8faa00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8f415eaa0 con 0x7fe8f40cf510 2024-09-11T23:23:21.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.609+0000 7fe8faa00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe8f40d34d0 con 0x7fe8f406d610 2024-09-11T23:23:21.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.609+0000 7fe8faa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f406df80 con 0x7fe8f415e6c0 2024-09-11T23:23:21.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.610+0000 7fe8f9600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8f415e6c0 0x7fe8f406c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:21.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.610+0000 7fe8f8c00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fe8f40cf510 0x7fe8f40b7670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:49004/0 (socket says 172.21.15.144:49004) 2024-09-11T23:23:21.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.610+0000 7fe8f8c00640 1 -- 172.21.15.144:0/822074029 learned_addr learned my addr 172.21.15.144:0/822074029 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:21.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.610+0000 7fe8f9600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8f415e6c0 0x7fe8f406c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50864/0 (socket says 172.21.15.144:50864) 2024-09-11T23:23:21.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.610+0000 7fe8fa000640 1 --2- 172.21.15.144:0/822074029 >> v2:172.21.15.165:3300/0 conn(0x7fe8f406d610 0x7fe8f406da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:21.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.610+0000 7fe8f3e00640 1 -- 172.21.15.144:0/822074029 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2781712670 0 0) 0x7fe8f415eaa0 con 0x7fe8f40cf510 2024-09-11T23:23:21.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.610+0000 7fe8f3e00640 1 -- 172.21.15.144:0/822074029 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8dc003520 con 0x7fe8f40cf510 2024-09-11T23:23:21.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.610+0000 7fe8f9600640 1 -- 172.21.15.144:0/822074029 >> v2:172.21.15.165:3300/0 conn(0x7fe8f406d610 msgr2=0x7fe8f406da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:21.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.610+0000 7fe8f9600640 1 --2- 172.21.15.144:0/822074029 >> v2:172.21.15.165:3300/0 conn(0x7fe8f406d610 0x7fe8f406da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.610+0000 7fe8f9600640 1 -- 172.21.15.144:0/822074029 >> v1:172.21.15.165:6789/0 conn(0x7fe8f40cf510 legacy=0x7fe8f40b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:21.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.610+0000 7fe8f9600640 1 -- 172.21.15.144:0/822074029 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f406cdf0 con 0x7fe8f415e6c0 2024-09-11T23:23:21.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.610+0000 7fe8fa000640 1 --2- 172.21.15.144:0/822074029 >> v2:172.21.15.165:3300/0 conn(0x7fe8f406d610 0x7fe8f406da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:23:21.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.611+0000 7fe8f9600640 1 --2- 172.21.15.144:0/822074029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8f415e6c0 0x7fe8f406c8b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80097a0 tx=0x7fe8e802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12376b98a01477eb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:21.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.612+0000 7fe8f3e00640 1 -- 172.21.15.144:0/822074029 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8037070 con 0x7fe8f415e6c0 2024-09-11T23:23:21.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.612+0000 7fe8f3e00640 1 -- 172.21.15.144:0/822074029 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e8032440 con 0x7fe8f415e6c0 2024-09-11T23:23:21.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.612+0000 7fe8f3e00640 1 -- 172.21.15.144:0/822074029 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e80327f0 con 0x7fe8f415e6c0 2024-09-11T23:23:21.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.612+0000 7fe8faa00640 1 -- 172.21.15.144:0/822074029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8f415e6c0 msgr2=0x7fe8f406c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:21.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.612+0000 7fe8faa00640 1 --2- 172.21.15.144:0/822074029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8f415e6c0 0x7fe8f406c8b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80097a0 tx=0x7fe8e802a210 comp rx=0 tx=0).stop 2024-09-11T23:23:21.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.612+0000 7fe8faa00640 1 -- 172.21.15.144:0/822074029 shutdown_connections 2024-09-11T23:23:21.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.612+0000 7fe8faa00640 1 --2- 172.21.15.144:0/822074029 >> v2:172.21.15.165:3300/0 conn(0x7fe8f406d610 0x7fe8f406da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.612+0000 7fe8faa00640 1 --2- 172.21.15.144:0/822074029 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8f415e6c0 0x7fe8f406c8b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.612+0000 7fe8faa00640 1 -- 172.21.15.144:0/822074029 >> 172.21.15.144:0/822074029 conn(0x7fe8f40d4720 msgr2=0x7fe8f40d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:21.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.612+0000 7fe8faa00640 1 -- 172.21.15.144:0/822074029 shutdown_connections 2024-09-11T23:23:21.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.612+0000 7fe8faa00640 1 -- 172.21.15.144:0/822074029 wait complete. 2024-09-11T23:23:21.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.614+0000 7fe8faa00640 1 Processor -- start 2024-09-11T23:23:21.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.614+0000 7fe8faa00640 1 -- start start 2024-09-11T23:23:21.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.615+0000 7fe8faa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8f406d610 0x7fe8f41f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:21.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.615+0000 7fe8faa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8f40cf510 0x7fe8f40b8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:21.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.615+0000 7fe8faa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8f415e6c0 0x7fe8f40b7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:21.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.615+0000 7fe8faa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f40d2e80 con 0x7fe8f415e6c0 2024-09-11T23:23:21.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.615+0000 7fe8faa00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f40d2ba0 con 0x7fe8f406d610 2024-09-11T23:23:21.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.615+0000 7fe8faa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f40d3160 con 0x7fe8f40cf510 2024-09-11T23:23:21.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.615+0000 7fe8fa000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8f415e6c0 0x7fe8f40b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:21.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.615+0000 7fe8fa000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8f415e6c0 0x7fe8f40b7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50044/0 (socket says 172.21.15.144:50044) 2024-09-11T23:23:21.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.615+0000 7fe8fa000640 1 -- 172.21.15.144:0/2087868609 learned_addr learned my addr 172.21.15.144:0/2087868609 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:21.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.615+0000 7fe8f8c00640 1 --2- 172.21.15.144:0/2087868609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8f40cf510 0x7fe8f40b8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:21.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.615+0000 7fe8f9600640 1 --2- 172.21.15.144:0/2087868609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8f406d610 0x7fe8f41f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:21.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.616+0000 7fe8fa000640 1 -- 172.21.15.144:0/2087868609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8f40cf510 msgr2=0x7fe8f40b8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:21.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.616+0000 7fe8fa000640 1 --2- 172.21.15.144:0/2087868609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8f40cf510 0x7fe8f40b8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.616+0000 7fe8fa000640 1 -- 172.21.15.144:0/2087868609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8f406d610 msgr2=0x7fe8f41f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:21.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.616+0000 7fe8fa000640 1 --2- 172.21.15.144:0/2087868609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8f406d610 0x7fe8f41f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.616+0000 7fe8fa000640 1 -- 172.21.15.144:0/2087868609 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f40b8e80 con 0x7fe8f415e6c0 2024-09-11T23:23:21.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.616+0000 7fe8f8c00640 1 --2- 172.21.15.144:0/2087868609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8f40cf510 0x7fe8f40b8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:23:21.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.616+0000 7fe8f9600640 1 --2- 172.21.15.144:0/2087868609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8f406d610 0x7fe8f41f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:23:21.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.616+0000 7fe8fa000640 1 --2- 172.21.15.144:0/2087868609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8f415e6c0 0x7fe8f40b7530 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00efc0 tx=0x7fe8ec009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:21.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.616+0000 7fe8f1600640 1 -- 172.21.15.144:0/2087868609 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec018030 con 0x7fe8f415e6c0 2024-09-11T23:23:21.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.616+0000 7fe8f1600640 1 -- 172.21.15.144:0/2087868609 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ec00cde0 con 0x7fe8f415e6c0 2024-09-11T23:23:21.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.616+0000 7fe8faa00640 1 -- 172.21.15.144:0/2087868609 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f4157340 con 0x7fe8f415e6c0 2024-09-11T23:23:21.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.617+0000 7fe8f1600640 1 -- 172.21.15.144:0/2087868609 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec003bb0 con 0x7fe8f415e6c0 2024-09-11T23:23:21.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.617+0000 7fe8faa00640 1 -- 172.21.15.144:0/2087868609 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f4157600 con 0x7fe8f415e6c0 2024-09-11T23:23:21.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.618+0000 7fe8faa00640 1 -- 172.21.15.144:0/2087868609 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8f406da40 con 0x7fe8f415e6c0 2024-09-11T23:23:21.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.619+0000 7fe8f1600640 1 -- 172.21.15.144:0/2087868609 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 90651+0+0 (secure 0 0 0) 0x7fe8ec005d10 con 0x7fe8f415e6c0 2024-09-11T23:23:21.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.620+0000 7fe8f1600640 1 --2- 172.21.15.144:0/2087868609 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe8d406bfe0 0x7fe8d406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:21.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.620+0000 7fe8f1600640 1 -- 172.21.15.144:0/2087868609 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7fe8ec08bc80 con 0x7fe8f415e6c0 2024-09-11T23:23:21.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.620+0000 7fe8f9600640 1 --2- 172.21.15.144:0/2087868609 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe8d406bfe0 0x7fe8d406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:21.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.621+0000 7fe8f9600640 1 --2- 172.21.15.144:0/2087868609 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe8d406bfe0 0x7fe8d406e4a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8034000 tx=0x7fe8e802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:21.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.624+0000 7fe8f1600640 1 -- 172.21.15.144:0/2087868609 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe8ec022070 con 0x7fe8f415e6c0 2024-09-11T23:23:21.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.826+0000 7fe8faa00640 1 -- 172.21.15.144:0/2087868609 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvol38500", "target": ["mon-mgr", ""]}) -- 0x7fe8f40d2600 con 0x7fe8d406bfe0 2024-09-11T23:23:21.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.853+0000 7fe8f1600640 1 -- 172.21.15.144:0/2087868609 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+687 (secure 0 0 0) 0x7fe8f40d2600 con 0x7fe8d406bfe0 2024-09-11T23:23:21.853 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:23:21.853 INFO:teuthology.orchestra.run.smithi144.stdout: "atime": "2024-09-11 23:23:20", 2024-09-11T23:23:21.853 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_pcent": "undefined", 2024-09-11T23:23:21.854 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_quota": "infinite", 2024-09-11T23:23:21.854 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 0, 2024-09-11T23:23:21.854 INFO:teuthology.orchestra.run.smithi144.stdout: "created_at": "2024-09-11 23:23:20", 2024-09-11T23:23:21.854 INFO:teuthology.orchestra.run.smithi144.stdout: "ctime": "2024-09-11 23:23:21", 2024-09-11T23:23:21.854 INFO:teuthology.orchestra.run.smithi144.stdout: "data_pool": "cephfs_data", 2024-09-11T23:23:21.854 INFO:teuthology.orchestra.run.smithi144.stdout: "features": [ 2024-09-11T23:23:21.854 INFO:teuthology.orchestra.run.smithi144.stdout: "snapshot-clone", 2024-09-11T23:23:21.854 INFO:teuthology.orchestra.run.smithi144.stdout: "snapshot-autoprotect" 2024-09-11T23:23:21.854 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:23:21.854 INFO:teuthology.orchestra.run.smithi144.stdout: "flavor": 1, 2024-09-11T23:23:21.854 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 0, 2024-09-11T23:23:21.854 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": 16877, 2024-09-11T23:23:21.854 INFO:teuthology.orchestra.run.smithi144.stdout: "mon_addrs": [ 2024-09-11T23:23:21.855 INFO:teuthology.orchestra.run.smithi144.stdout: "172.21.15.144:6789", 2024-09-11T23:23:21.855 INFO:teuthology.orchestra.run.smithi144.stdout: "172.21.15.165:6789", 2024-09-11T23:23:21.855 INFO:teuthology.orchestra.run.smithi144.stdout: "172.21.15.165:6790" 2024-09-11T23:23:21.855 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:23:21.855 INFO:teuthology.orchestra.run.smithi144.stdout: "mtime": "2024-09-11 23:23:20", 2024-09-11T23:23:21.855 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee", 2024-09-11T23:23:21.855 INFO:teuthology.orchestra.run.smithi144.stdout: "pool_namespace": "", 2024-09-11T23:23:21.855 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "complete", 2024-09-11T23:23:21.855 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "subvolume", 2024-09-11T23:23:21.855 INFO:teuthology.orchestra.run.smithi144.stdout: "uid": 0 2024-09-11T23:23:21.855 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:23:21.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.856+0000 7fe8faa00640 1 -- 172.21.15.144:0/2087868609 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe8d406bfe0 msgr2=0x7fe8d406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:21.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.856+0000 7fe8faa00640 1 --2- 172.21.15.144:0/2087868609 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe8d406bfe0 0x7fe8d406e4a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8034000 tx=0x7fe8e802e000 comp rx=0 tx=0).stop 2024-09-11T23:23:21.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.856+0000 7fe8faa00640 1 -- 172.21.15.144:0/2087868609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8f415e6c0 msgr2=0x7fe8f40b7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:21.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.856+0000 7fe8faa00640 1 --2- 172.21.15.144:0/2087868609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8f415e6c0 0x7fe8f40b7530 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00efc0 tx=0x7fe8ec009f90 comp rx=0 tx=0).stop 2024-09-11T23:23:21.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.856+0000 7fe8faa00640 1 -- 172.21.15.144:0/2087868609 shutdown_connections 2024-09-11T23:23:21.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.856+0000 7fe8faa00640 1 --2- 172.21.15.144:0/2087868609 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe8d406bfe0 0x7fe8d406e4a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.856+0000 7fe8faa00640 1 --2- 172.21.15.144:0/2087868609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8f415e6c0 0x7fe8f40b7530 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.856+0000 7fe8faa00640 1 --2- 172.21.15.144:0/2087868609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe8f40cf510 0x7fe8f40b8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.856+0000 7fe8faa00640 1 --2- 172.21.15.144:0/2087868609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8f406d610 0x7fe8f41f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:21.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.856+0000 7fe8faa00640 1 -- 172.21.15.144:0/2087868609 >> 172.21.15.144:0/2087868609 conn(0x7fe8f40d4720 msgr2=0x7fe8f40d4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:21.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.856+0000 7fe8faa00640 1 -- 172.21.15.144:0/2087868609 shutdown_connections 2024-09-11T23:23:21.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:21.856+0000 7fe8faa00640 1 -- 172.21.15.144:0/2087868609 wait complete. 2024-09-11T23:23:21.872 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume resize cephfs subvol38500 10485760 2024-09-11T23:23:22.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.029+0000 7f2335400640 1 Processor -- start 2024-09-11T23:23:22.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.029+0000 7f2335400640 1 -- start start 2024-09-11T23:23:22.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.031+0000 7f2335400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2330145d90 0x7f23300ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:22.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.031+0000 7f2335400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f23300cfce0 0x7f233006d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:22.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.031+0000 7f2335400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23300b4240 con 0x7f23300cd490 2024-09-11T23:23:22.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.031+0000 7f2335400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f233006d080 con 0x7f23300cfce0 2024-09-11T23:23:22.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.031+0000 7f2335400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f23300b4520 con 0x7f2330145d90 2024-09-11T23:23:22.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.031+0000 7f232e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2330145d90 0x7f23300ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:22.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.031+0000 7f232e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2330145d90 0x7f23300ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50892/0 (socket says 172.21.15.144:50892) 2024-09-11T23:23:22.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.031+0000 7f232e800640 1 -- 172.21.15.144:0/2924517532 learned_addr learned my addr 172.21.15.144:0/2924517532 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:22.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.031+0000 7f2325e00640 1 --1- 172.21.15.144:0/2924517532 >> v1:172.21.15.165:6789/0 conn(0x7f23300cd490 0x7f23300cf5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:49008/0 (socket says 172.21.15.144:49008) 2024-09-11T23:23:22.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.031+0000 7f232f200640 1 --2- 172.21.15.144:0/2924517532 >> v2:172.21.15.165:3300/0 conn(0x7f23300cfce0 0x7f233006d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:22.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.032+0000 7f232e800640 1 -- 172.21.15.144:0/2924517532 >> v2:172.21.15.165:3300/0 conn(0x7f23300cfce0 msgr2=0x7f233006d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:22.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.032+0000 7f232e800640 1 --2- 172.21.15.144:0/2924517532 >> v2:172.21.15.165:3300/0 conn(0x7f23300cfce0 0x7f233006d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.032+0000 7f232e800640 1 -- 172.21.15.144:0/2924517532 >> v1:172.21.15.165:6789/0 conn(0x7f23300cd490 legacy=0x7f23300cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:22.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.032+0000 7f232e800640 1 -- 172.21.15.144:0/2924517532 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23300b4800 con 0x7f2330145d90 2024-09-11T23:23:22.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.032+0000 7f232de00640 1 -- 172.21.15.144:0/2924517532 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 873394133 0 0) 0x7f23300b4240 con 0x7f23300cd490 2024-09-11T23:23:22.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.033+0000 7f232e800640 1 --2- 172.21.15.144:0/2924517532 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2330145d90 0x7f23300ccf50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2320009870 tx=0x7f232002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=552dc06208ad204c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.033+0000 7f232de00640 1 -- 172.21.15.144:0/2924517532 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2320037070 con 0x7f2330145d90 2024-09-11T23:23:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.033+0000 7f232de00640 1 -- 172.21.15.144:0/2924517532 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2320032440 con 0x7f2330145d90 2024-09-11T23:23:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.033+0000 7f232de00640 1 -- 172.21.15.144:0/2924517532 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2320032810 con 0x7f2330145d90 2024-09-11T23:23:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.034+0000 7f2335400640 1 -- 172.21.15.144:0/2924517532 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2330145d90 msgr2=0x7f23300ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.034+0000 7f2335400640 1 --2- 172.21.15.144:0/2924517532 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2330145d90 0x7f23300ccf50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2320009870 tx=0x7f232002a270 comp rx=0 tx=0).stop 2024-09-11T23:23:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.034+0000 7f2335400640 1 -- 172.21.15.144:0/2924517532 shutdown_connections 2024-09-11T23:23:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.034+0000 7f2335400640 1 --2- 172.21.15.144:0/2924517532 >> v2:172.21.15.165:3300/0 conn(0x7f23300cfce0 0x7f233006d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.034+0000 7f2335400640 1 --2- 172.21.15.144:0/2924517532 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2330145d90 0x7f23300ccf50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.034+0000 7f2335400640 1 -- 172.21.15.144:0/2924517532 >> 172.21.15.144:0/2924517532 conn(0x7f233006bba0 msgr2=0x7f233006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.034+0000 7f2335400640 1 -- 172.21.15.144:0/2924517532 shutdown_connections 2024-09-11T23:23:22.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.034+0000 7f2335400640 1 -- 172.21.15.144:0/2924517532 wait complete. 2024-09-11T23:23:22.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.035+0000 7f2335400640 1 Processor -- start 2024-09-11T23:23:22.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.036+0000 7f2335400640 1 -- start start 2024-09-11T23:23:22.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.036+0000 7f2335400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23300cd490 0x7f2330155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:22.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.036+0000 7f2335400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23300cfce0 0x7f233013efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:22.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.036+0000 7f2335400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2330145d90 0x7f23301f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:22.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.036+0000 7f2335400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f23300b5790 con 0x7f23300cfce0 2024-09-11T23:23:22.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.036+0000 7f2335400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f23300b5610 con 0x7f23300cd490 2024-09-11T23:23:22.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.036+0000 7f2335400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2330146170 con 0x7f2330145d90 2024-09-11T23:23:22.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.037+0000 7f2325e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23300cfce0 0x7f233013efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:22.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.037+0000 7f2325e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23300cfce0 0x7f233013efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50052/0 (socket says 172.21.15.144:50052) 2024-09-11T23:23:22.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.037+0000 7f2325e00640 1 -- 172.21.15.144:0/3790453456 learned_addr learned my addr 172.21.15.144:0/3790453456 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:22.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.037+0000 7f232e800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23300cd490 0x7f2330155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:22.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.037+0000 7f232f200640 1 --2- 172.21.15.144:0/3790453456 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2330145d90 0x7f23301f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:22.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.037+0000 7f2325e00640 1 -- 172.21.15.144:0/3790453456 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2330145d90 msgr2=0x7f23301f40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:22.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.037+0000 7f2325e00640 1 --2- 172.21.15.144:0/3790453456 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2330145d90 0x7f23301f40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.037+0000 7f2325e00640 1 -- 172.21.15.144:0/3790453456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23300cd490 msgr2=0x7f2330155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:22.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.037+0000 7f2325e00640 1 --2- 172.21.15.144:0/3790453456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23300cd490 0x7f2330155fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.037+0000 7f2325e00640 1 -- 172.21.15.144:0/3790453456 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23300715b0 con 0x7f23300cfce0 2024-09-11T23:23:22.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.038+0000 7f2325e00640 1 --2- 172.21.15.144:0/3790453456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23300cfce0 0x7f233013efb0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f231800c410 tx=0x7f231800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:22.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.038+0000 7f2327400640 1 -- 172.21.15.144:0/3790453456 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23180074e0 con 0x7f23300cfce0 2024-09-11T23:23:22.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.038+0000 7f2327400640 1 -- 172.21.15.144:0/3790453456 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23180047e0 con 0x7f23300cfce0 2024-09-11T23:23:22.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.038+0000 7f2327400640 1 -- 172.21.15.144:0/3790453456 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2318004bd0 con 0x7f23300cfce0 2024-09-11T23:23:22.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.038+0000 7f2335400640 1 -- 172.21.15.144:0/3790453456 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2330071890 con 0x7f23300cfce0 2024-09-11T23:23:22.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.038+0000 7f2335400640 1 -- 172.21.15.144:0/3790453456 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2330071e50 con 0x7f23300cfce0 2024-09-11T23:23:22.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.039+0000 7f2335400640 1 -- 172.21.15.144:0/3790453456 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23300ccf50 con 0x7f23300cfce0 2024-09-11T23:23:22.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.040+0000 7f2327400640 1 -- 172.21.15.144:0/3790453456 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 90651+0+0 (secure 0 0 0) 0x7f2318011070 con 0x7f23300cfce0 2024-09-11T23:23:22.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.041+0000 7f2327400640 1 --2- 172.21.15.144:0/3790453456 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f230c06bfe0 0x7f230c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:22.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.041+0000 7f2327400640 1 -- 172.21.15.144:0/3790453456 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f231808adb0 con 0x7f23300cfce0 2024-09-11T23:23:22.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.042+0000 7f232e800640 1 --2- 172.21.15.144:0/3790453456 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f230c06bfe0 0x7f230c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:22.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.042+0000 7f232e800640 1 --2- 172.21.15.144:0/3790453456 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f230c06bfe0 0x7f230c06e4a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2320034000 tx=0x7f232002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:22.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.046+0000 7f2327400640 1 -- 172.21.15.144:0/3790453456 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f231808f070 con 0x7f23300cfce0 2024-09-11T23:23:22.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.248+0000 7f2335400640 1 -- 172.21.15.144:0/3790453456 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume resize", "vol_name": "cephfs", "sub_name": "subvol38500", "new_size": "10485760", "target": ["mon-mgr", ""]}) -- 0x7f233006e2a0 con 0x7f230c06bfe0 2024-09-11T23:23:22.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.278+0000 7f2327400640 1 -- 172.21.15.144:0/3790453456 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+128 (secure 0 0 0) 0x7f233006e2a0 con 0x7f230c06bfe0 2024-09-11T23:23:22.278 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:23:22.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:22.278 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 0 2024-09-11T23:23:22.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:22.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:22.279 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_quota": 10485760 2024-09-11T23:23:22.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:22.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:22.279 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_pcent": "0.00" 2024-09-11T23:23:22.279 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:22.279 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:23:22.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.280+0000 7f2335400640 1 -- 172.21.15.144:0/3790453456 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f230c06bfe0 msgr2=0x7f230c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:22.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.280+0000 7f2335400640 1 --2- 172.21.15.144:0/3790453456 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f230c06bfe0 0x7f230c06e4a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2320034000 tx=0x7f232002e000 comp rx=0 tx=0).stop 2024-09-11T23:23:22.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.280+0000 7f2335400640 1 -- 172.21.15.144:0/3790453456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23300cfce0 msgr2=0x7f233013efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:22.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.280+0000 7f2335400640 1 --2- 172.21.15.144:0/3790453456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23300cfce0 0x7f233013efb0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f231800c410 tx=0x7f231800c8d0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.280+0000 7f2335400640 1 -- 172.21.15.144:0/3790453456 shutdown_connections 2024-09-11T23:23:22.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.280+0000 7f2335400640 1 --2- 172.21.15.144:0/3790453456 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f230c06bfe0 0x7f230c06e4a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.280+0000 7f2335400640 1 --2- 172.21.15.144:0/3790453456 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2330145d90 0x7f23301f40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.280+0000 7f2335400640 1 --2- 172.21.15.144:0/3790453456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23300cfce0 0x7f233013efb0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.280+0000 7f2335400640 1 --2- 172.21.15.144:0/3790453456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23300cd490 0x7f2330155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.280+0000 7f2335400640 1 -- 172.21.15.144:0/3790453456 >> 172.21.15.144:0/3790453456 conn(0x7f233006bba0 msgr2=0x7f23300cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:22.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.280+0000 7f2335400640 1 -- 172.21.15.144:0/3790453456 shutdown_connections 2024-09-11T23:23:22.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.280+0000 7f2335400640 1 -- 172.21.15.144:0/3790453456 wait complete. 2024-09-11T23:23:22.296 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvol38500 2024-09-11T23:23:22.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.454+0000 7faa0ae00640 1 Processor -- start 2024-09-11T23:23:22.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.454+0000 7faa0ae00640 1 -- start start 2024-09-11T23:23:22.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.455+0000 7faa0ae00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7faa04147820 0x7faa0406d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:22.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.455+0000 7faa0ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa040b63b0 0x7faa0406bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:22.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.455+0000 7faa0ae00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa04147c00 con 0x7faa04073cf0 2024-09-11T23:23:22.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.455+0000 7faa0ae00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7faa040741d0 con 0x7faa04147820 2024-09-11T23:23:22.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.455+0000 7faa0ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faa04162160 con 0x7faa040b63b0 2024-09-11T23:23:22.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.455+0000 7faa09000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7faa04073cf0 0x7faa040b5ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50088/0 (socket says 172.21.15.144:50088) 2024-09-11T23:23:22.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.455+0000 7faa09000640 1 -- 172.21.15.144:0/437218287 learned_addr learned my addr 172.21.15.144:0/437218287 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:22.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.456+0000 7faa0a400640 1 --2- 172.21.15.144:0/437218287 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa040b63b0 0x7faa0406bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:22.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.456+0000 7faa09a00640 1 --2- 172.21.15.144:0/437218287 >> v2:172.21.15.165:3300/0 conn(0x7faa04147820 0x7faa0406d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:22.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.456+0000 7faa03e00640 1 -- 172.21.15.144:0/437218287 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2659958115 0 0) 0x7faa04147c00 con 0x7faa04073cf0 2024-09-11T23:23:22.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.456+0000 7faa03e00640 1 -- 172.21.15.144:0/437218287 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9ec003520 con 0x7faa04073cf0 2024-09-11T23:23:22.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.456+0000 7faa0a400640 1 -- 172.21.15.144:0/437218287 >> v2:172.21.15.165:3300/0 conn(0x7faa04147820 msgr2=0x7faa0406d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:22.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.456+0000 7faa0a400640 1 --2- 172.21.15.144:0/437218287 >> v2:172.21.15.165:3300/0 conn(0x7faa04147820 0x7faa0406d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.456+0000 7faa0a400640 1 -- 172.21.15.144:0/437218287 >> v1:172.21.15.144:6789/0 conn(0x7faa04073cf0 legacy=0x7faa040b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:22.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.456+0000 7faa0a400640 1 -- 172.21.15.144:0/437218287 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa04162440 con 0x7faa040b63b0 2024-09-11T23:23:22.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.456+0000 7faa09a00640 1 --2- 172.21.15.144:0/437218287 >> v2:172.21.15.165:3300/0 conn(0x7faa04147820 0x7faa0406d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:23:22.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.457+0000 7faa0a400640 1 --2- 172.21.15.144:0/437218287 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa040b63b0 0x7faa0406bba0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc009d90 tx=0x7fa9fc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48df2943c2a0c95b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:22.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.460+0000 7faa03e00640 1 -- 172.21.15.144:0/437218287 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc007740 con 0x7faa040b63b0 2024-09-11T23:23:22.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.460+0000 7faa03e00640 1 -- 172.21.15.144:0/437218287 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9fc0078e0 con 0x7faa040b63b0 2024-09-11T23:23:22.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.461+0000 7faa03e00640 1 -- 172.21.15.144:0/437218287 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc007cb0 con 0x7faa040b63b0 2024-09-11T23:23:22.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.461+0000 7faa0ae00640 1 -- 172.21.15.144:0/437218287 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa040b63b0 msgr2=0x7faa0406bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:22.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.461+0000 7faa0ae00640 1 --2- 172.21.15.144:0/437218287 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa040b63b0 0x7faa0406bba0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc009d90 tx=0x7fa9fc02a660 comp rx=0 tx=0).stop 2024-09-11T23:23:22.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.461+0000 7faa0ae00640 1 -- 172.21.15.144:0/437218287 shutdown_connections 2024-09-11T23:23:22.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.461+0000 7faa0ae00640 1 --2- 172.21.15.144:0/437218287 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa040b63b0 0x7faa0406bba0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.461+0000 7faa0ae00640 1 --2- 172.21.15.144:0/437218287 >> v2:172.21.15.165:3300/0 conn(0x7faa04147820 0x7faa0406d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.461+0000 7faa0ae00640 1 -- 172.21.15.144:0/437218287 >> 172.21.15.144:0/437218287 conn(0x7faa0406ccb0 msgr2=0x7faa0406d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:22.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.461+0000 7faa0ae00640 1 -- 172.21.15.144:0/437218287 shutdown_connections 2024-09-11T23:23:22.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.461+0000 7faa0ae00640 1 -- 172.21.15.144:0/437218287 wait complete. 2024-09-11T23:23:22.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.463+0000 7faa0ae00640 1 Processor -- start 2024-09-11T23:23:22.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.463+0000 7faa0ae00640 1 -- start start 2024-09-11T23:23:22.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.464+0000 7faa0ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa04073cf0 0x7faa04160110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:22.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.464+0000 7faa0ae00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa040b63b0 0x7faa040cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:22.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.464+0000 7faa0ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa04147820 0x7faa040ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:22.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.464+0000 7faa0ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faa04162f20 con 0x7faa04147820 2024-09-11T23:23:22.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.464+0000 7faa0ae00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faa04162a00 con 0x7faa040b63b0 2024-09-11T23:23:22.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.464+0000 7faa0ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faa04148280 con 0x7faa04073cf0 2024-09-11T23:23:22.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.464+0000 7faa0a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa04147820 0x7faa040ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:22.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.464+0000 7faa0a400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa04147820 0x7faa040ce2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50066/0 (socket says 172.21.15.144:50066) 2024-09-11T23:23:22.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.464+0000 7faa0a400640 1 -- 172.21.15.144:0/1707950275 learned_addr learned my addr 172.21.15.144:0/1707950275 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:22.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.464+0000 7faa09a00640 1 --2- 172.21.15.144:0/1707950275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa04073cf0 0x7faa04160110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:22.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.464+0000 7faa09000640 1 --2- 172.21.15.144:0/1707950275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa040b63b0 0x7faa040cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:22.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.465+0000 7faa0a400640 1 -- 172.21.15.144:0/1707950275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa04073cf0 msgr2=0x7faa04160110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:22.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.465+0000 7faa0a400640 1 --2- 172.21.15.144:0/1707950275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa04073cf0 0x7faa04160110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.465+0000 7faa0a400640 1 -- 172.21.15.144:0/1707950275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa040b63b0 msgr2=0x7faa040cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:22.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.465+0000 7faa0a400640 1 --2- 172.21.15.144:0/1707950275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa040b63b0 0x7faa040cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.465+0000 7faa0a400640 1 -- 172.21.15.144:0/1707950275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa041f4550 con 0x7faa04147820 2024-09-11T23:23:22.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.465+0000 7faa0a400640 1 --2- 172.21.15.144:0/1707950275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa04147820 0x7faa040ce2e0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc02ac50 tx=0x7fa9fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:22.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.465+0000 7faa01600640 1 -- 172.21.15.144:0/1707950275 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc040070 con 0x7faa04147820 2024-09-11T23:23:22.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.465+0000 7faa01600640 1 -- 172.21.15.144:0/1707950275 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9fc031b40 con 0x7faa04147820 2024-09-11T23:23:22.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.465+0000 7faa01600640 1 -- 172.21.15.144:0/1707950275 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc045460 con 0x7faa04147820 2024-09-11T23:23:22.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.465+0000 7faa0ae00640 1 -- 172.21.15.144:0/1707950275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0413fab0 con 0x7faa04147820 2024-09-11T23:23:22.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.465+0000 7faa0ae00640 1 -- 172.21.15.144:0/1707950275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa04140070 con 0x7faa04147820 2024-09-11T23:23:22.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.466+0000 7faa0ae00640 1 -- 172.21.15.144:0/1707950275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa0406d7a0 con 0x7faa04147820 2024-09-11T23:23:22.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.467+0000 7faa01600640 1 -- 172.21.15.144:0/1707950275 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 90651+0+0 (secure 0 0 0) 0x7fa9fc039040 con 0x7faa04147820 2024-09-11T23:23:22.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.468+0000 7faa01600640 1 --2- 172.21.15.144:0/1707950275 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa9e406bfe0 0x7fa9e406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:22.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.468+0000 7faa01600640 1 -- 172.21.15.144:0/1707950275 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7fa9fc0ac9b0 con 0x7faa04147820 2024-09-11T23:23:22.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.468+0000 7faa09a00640 1 --2- 172.21.15.144:0/1707950275 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa9e406bfe0 0x7fa9e406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:22.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.469+0000 7faa09a00640 1 --2- 172.21.15.144:0/1707950275 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa9e406bfe0 0x7fa9e406e4a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faa04146a40 tx=0x7fa9f8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:22.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.472+0000 7faa01600640 1 -- 172.21.15.144:0/1707950275 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa9fc07aa60 con 0x7faa04147820 2024-09-11T23:23:22.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.673+0000 7faa0ae00640 1 -- 172.21.15.144:0/1707950275 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvol38500", "target": ["mon-mgr", ""]}) -- 0x7faa040cd8d0 con 0x7fa9e406bfe0 2024-09-11T23:23:22.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.700+0000 7faa01600640 1 -- 172.21.15.144:0/1707950275 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+680 (secure 0 0 0) 0x7faa040cd8d0 con 0x7fa9e406bfe0 2024-09-11T23:23:22.700 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:23:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "atime": "2024-09-11 23:23:20", 2024-09-11T23:23:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_pcent": "0.00", 2024-09-11T23:23:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_quota": 10485760, 2024-09-11T23:23:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 0, 2024-09-11T23:23:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "created_at": "2024-09-11 23:23:20", 2024-09-11T23:23:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "ctime": "2024-09-11 23:23:22", 2024-09-11T23:23:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "data_pool": "cephfs_data", 2024-09-11T23:23:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "features": [ 2024-09-11T23:23:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "snapshot-clone", 2024-09-11T23:23:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: "snapshot-autoprotect" 2024-09-11T23:23:22.701 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:23:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: "flavor": 1, 2024-09-11T23:23:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 0, 2024-09-11T23:23:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": 16877, 2024-09-11T23:23:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: "mon_addrs": [ 2024-09-11T23:23:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: "172.21.15.144:6789", 2024-09-11T23:23:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: "172.21.15.165:6789", 2024-09-11T23:23:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: "172.21.15.165:6790" 2024-09-11T23:23:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:23:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: "mtime": "2024-09-11 23:23:20", 2024-09-11T23:23:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee", 2024-09-11T23:23:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: "pool_namespace": "", 2024-09-11T23:23:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "complete", 2024-09-11T23:23:22.702 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "subvolume", 2024-09-11T23:23:22.703 INFO:teuthology.orchestra.run.smithi144.stdout: "uid": 0 2024-09-11T23:23:22.703 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:23:22.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.703+0000 7faa0ae00640 1 -- 172.21.15.144:0/1707950275 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa9e406bfe0 msgr2=0x7fa9e406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:22.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.703+0000 7faa0ae00640 1 --2- 172.21.15.144:0/1707950275 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa9e406bfe0 0x7fa9e406e4a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faa04146a40 tx=0x7fa9f8009190 comp rx=0 tx=0).stop 2024-09-11T23:23:22.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.703+0000 7faa0ae00640 1 -- 172.21.15.144:0/1707950275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa04147820 msgr2=0x7faa040ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:22.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.703+0000 7faa0ae00640 1 --2- 172.21.15.144:0/1707950275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa04147820 0x7faa040ce2e0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc02ac50 tx=0x7fa9fc004a40 comp rx=0 tx=0).stop 2024-09-11T23:23:22.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.703+0000 7faa0ae00640 1 -- 172.21.15.144:0/1707950275 shutdown_connections 2024-09-11T23:23:22.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.703+0000 7faa0ae00640 1 --2- 172.21.15.144:0/1707950275 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa9e406bfe0 0x7fa9e406e4a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.703+0000 7faa0ae00640 1 --2- 172.21.15.144:0/1707950275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa04147820 0x7faa040ce2e0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.703+0000 7faa0ae00640 1 --2- 172.21.15.144:0/1707950275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa040b63b0 0x7faa040cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.703+0000 7faa0ae00640 1 --2- 172.21.15.144:0/1707950275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faa04073cf0 0x7faa04160110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.703+0000 7faa0ae00640 1 -- 172.21.15.144:0/1707950275 >> 172.21.15.144:0/1707950275 conn(0x7faa0406ccb0 msgr2=0x7faa040b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:22.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.703+0000 7faa0ae00640 1 -- 172.21.15.144:0/1707950275 shutdown_connections 2024-09-11T23:23:22.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.703+0000 7faa0ae00640 1 -- 172.21.15.144:0/1707950275 wait complete. 2024-09-11T23:23:22.719 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol38500 --mode 777 --uid 1000 --gid 1000 2024-09-11T23:23:22.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.883+0000 7f330ec00640 1 Processor -- start 2024-09-11T23:23:22.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.883+0000 7f330ec00640 1 -- start start 2024-09-11T23:23:22.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.884+0000 7f330ec00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f33080cf9c0 0x7f330815c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:22.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.884+0000 7f330ec00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33080cdb70 con 0x7f3308155a20 2024-09-11T23:23:22.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.884+0000 7f330ec00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33080cde50 con 0x7f33080cd400 2024-09-11T23:23:22.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.884+0000 7f330ec00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f33080ce130 con 0x7f33080cf9c0 2024-09-11T23:23:22.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.885+0000 7f3307e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3308155a20 0x7f33080cf2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50104/0 (socket says 172.21.15.144:50104) 2024-09-11T23:23:22.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.885+0000 7f3307e00640 1 -- 172.21.15.144:0/3174912898 learned_addr learned my addr 172.21.15.144:0/3174912898 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:22.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.885+0000 7f3307400640 1 --2- 172.21.15.144:0/3174912898 >> v2:172.21.15.144:3300/0 conn(0x7f33080cf9c0 0x7f330815c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:22.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.885+0000 7f3307400640 1 -- 172.21.15.144:0/3174912898 >> v1:172.21.15.165:6789/0 conn(0x7f33080cd400 legacy=0x7f3308072410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:22.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.885+0000 7f3307400640 1 -- 172.21.15.144:0/3174912898 >> v1:172.21.15.144:6789/0 conn(0x7f3308155a20 legacy=0x7f33080cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:22.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.885+0000 7f3307400640 1 -- 172.21.15.144:0/3174912898 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33080ce410 con 0x7f33080cf9c0 2024-09-11T23:23:22.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.885+0000 7f3306a00640 1 -- 172.21.15.144:0/3174912898 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 662661212 0 0) 0x7f33080cdb70 con 0x7f3308155a20 2024-09-11T23:23:22.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.886+0000 7f3307400640 1 --2- 172.21.15.144:0/3174912898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33080cf9c0 0x7f330815c450 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f32f40097a0 tx=0x7f32f402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef5fca9f368c7cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:22.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.886+0000 7f3306a00640 1 -- 172.21.15.144:0/3174912898 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4037070 con 0x7f33080cf9c0 2024-09-11T23:23:22.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.886+0000 7f3306a00640 1 -- 172.21.15.144:0/3174912898 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f4032440 con 0x7f33080cf9c0 2024-09-11T23:23:22.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.886+0000 7f3306a00640 1 -- 172.21.15.144:0/3174912898 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4032810 con 0x7f33080cf9c0 2024-09-11T23:23:22.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.887+0000 7f330ec00640 1 -- 172.21.15.144:0/3174912898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33080cf9c0 msgr2=0x7f330815c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:22.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.887+0000 7f330ec00640 1 --2- 172.21.15.144:0/3174912898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33080cf9c0 0x7f330815c450 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f32f40097a0 tx=0x7f32f402a230 comp rx=0 tx=0).stop 2024-09-11T23:23:22.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.887+0000 7f330ec00640 1 -- 172.21.15.144:0/3174912898 shutdown_connections 2024-09-11T23:23:22.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.887+0000 7f330ec00640 1 --2- 172.21.15.144:0/3174912898 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33080cf9c0 0x7f330815c450 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.887+0000 7f330ec00640 1 -- 172.21.15.144:0/3174912898 >> 172.21.15.144:0/3174912898 conn(0x7f3308062a80 msgr2=0x7f330806bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:22.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.887+0000 7f330ec00640 1 -- 172.21.15.144:0/3174912898 shutdown_connections 2024-09-11T23:23:22.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.887+0000 7f330ec00640 1 -- 172.21.15.144:0/3174912898 wait complete. 2024-09-11T23:23:22.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.889+0000 7f330ec00640 1 Processor -- start 2024-09-11T23:23:22.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.889+0000 7f330ec00640 1 -- start start 2024-09-11T23:23:22.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.890+0000 7f330ec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33080cd400 0x7f3308150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:22.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.890+0000 7f330ec00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33080cf9c0 0x7f330814a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:22.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.890+0000 7f330ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3308155a20 0x7f3308152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:22.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.890+0000 7f330ec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3308072ca0 con 0x7f33080cd400 2024-09-11T23:23:22.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.890+0000 7f330ec00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3308072b20 con 0x7f33080cf9c0 2024-09-11T23:23:22.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.890+0000 7f330ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3308072e20 con 0x7f3308155a20 2024-09-11T23:23:22.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.890+0000 7f3307e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33080cd400 0x7f3308150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:22.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.890+0000 7f3307e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33080cd400 0x7f3308150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50088/0 (socket says 172.21.15.144:50088) 2024-09-11T23:23:22.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.890+0000 7f3307e00640 1 -- 172.21.15.144:0/1553159004 learned_addr learned my addr 172.21.15.144:0/1553159004 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:22.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.890+0000 7f3307400640 1 --2- 172.21.15.144:0/1553159004 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33080cf9c0 0x7f330814a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:22.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.890+0000 7f330cc00640 1 --2- 172.21.15.144:0/1553159004 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3308155a20 0x7f3308152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:22.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.890+0000 7f3307e00640 1 -- 172.21.15.144:0/1553159004 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3308155a20 msgr2=0x7f3308152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:22.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.890+0000 7f3307e00640 1 --2- 172.21.15.144:0/1553159004 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3308155a20 0x7f3308152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.890+0000 7f3307e00640 1 -- 172.21.15.144:0/1553159004 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33080cf9c0 msgr2=0x7f330814a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:22.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.890+0000 7f3307e00640 1 --2- 172.21.15.144:0/1553159004 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33080cf9c0 0x7f330814a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:22.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.890+0000 7f3307e00640 1 -- 172.21.15.144:0/1553159004 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3308151100 con 0x7f33080cd400 2024-09-11T23:23:22.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.890+0000 7f3307400640 1 --2- 172.21.15.144:0/1553159004 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33080cf9c0 0x7f330814a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:23:22.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.890+0000 7f330cc00640 1 --2- 172.21.15.144:0/1553159004 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3308155a20 0x7f3308152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:23:22.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.891+0000 7f3307e00640 1 --2- 172.21.15.144:0/1553159004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33080cd400 0x7f3308150af0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f32f800c3f0 tx=0x7f32f800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:22.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.891+0000 7f32ffe00640 1 -- 172.21.15.144:0/1553159004 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f80074e0 con 0x7f33080cd400 2024-09-11T23:23:22.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.891+0000 7f32ffe00640 1 -- 172.21.15.144:0/1553159004 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f80047e0 con 0x7f33080cd400 2024-09-11T23:23:22.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.891+0000 7f330ec00640 1 -- 172.21.15.144:0/1553159004 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33081513e0 con 0x7f33080cd400 2024-09-11T23:23:22.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.891+0000 7f32ffe00640 1 -- 172.21.15.144:0/1553159004 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f8004c10 con 0x7f33080cd400 2024-09-11T23:23:22.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.891+0000 7f330ec00640 1 -- 172.21.15.144:0/1553159004 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33081519a0 con 0x7f33080cd400 2024-09-11T23:23:22.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.892+0000 7f330ec00640 1 -- 172.21.15.144:0/1553159004 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f330815c450 con 0x7f33080cd400 2024-09-11T23:23:22.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.893+0000 7f32ffe00640 1 -- 172.21.15.144:0/1553159004 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 90651+0+0 (secure 0 0 0) 0x7f32f8011070 con 0x7f33080cd400 2024-09-11T23:23:22.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.894+0000 7f32ffe00640 1 --2- 172.21.15.144:0/1553159004 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f32e806c010 0x7f32e806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:22.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.894+0000 7f32ffe00640 1 -- 172.21.15.144:0/1553159004 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f32f808ae10 con 0x7f33080cd400 2024-09-11T23:23:22.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.894+0000 7f3307400640 1 --2- 172.21.15.144:0/1553159004 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f32e806c010 0x7f32e806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:22.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.895+0000 7f3307400640 1 --2- 172.21.15.144:0/1553159004 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f32e806c010 0x7f32e806e4d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f32f4034000 tx=0x7f32f402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:22.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:22.898+0000 7f32ffe00640 1 -- 172.21.15.144:0/1553159004 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32f808e030 con 0x7f33080cd400 2024-09-11T23:23:23.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.099+0000 7f330ec00640 1 -- 172.21.15.144:0/1553159004 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol38500", "mode": "777", "uid": 1000, "gid": 1000, "target": ["mon-mgr", ""]}) -- 0x7f330815f590 con 0x7f32e806c010 2024-09-11T23:23:23.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.127+0000 7f32ffe00640 1 -- 172.21.15.144:0/1553159004 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f330815f590 con 0x7f32e806c010 2024-09-11T23:23:23.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.130+0000 7f330ec00640 1 -- 172.21.15.144:0/1553159004 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f32e806c010 msgr2=0x7f32e806e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:23.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.130+0000 7f330ec00640 1 --2- 172.21.15.144:0/1553159004 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f32e806c010 0x7f32e806e4d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f32f4034000 tx=0x7f32f402e000 comp rx=0 tx=0).stop 2024-09-11T23:23:23.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.130+0000 7f330ec00640 1 -- 172.21.15.144:0/1553159004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33080cd400 msgr2=0x7f3308150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:23.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.130+0000 7f330ec00640 1 --2- 172.21.15.144:0/1553159004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33080cd400 0x7f3308150af0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f32f800c3f0 tx=0x7f32f800c8b0 comp rx=0 tx=0).stop 2024-09-11T23:23:23.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.130+0000 7f330ec00640 1 -- 172.21.15.144:0/1553159004 shutdown_connections 2024-09-11T23:23:23.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.130+0000 7f330ec00640 1 --2- 172.21.15.144:0/1553159004 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f32e806c010 0x7f32e806e4d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:23.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.130+0000 7f330ec00640 1 --2- 172.21.15.144:0/1553159004 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3308155a20 0x7f3308152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:23.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.130+0000 7f330ec00640 1 --2- 172.21.15.144:0/1553159004 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33080cf9c0 0x7f330814a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:23.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.130+0000 7f330ec00640 1 --2- 172.21.15.144:0/1553159004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f33080cd400 0x7f3308150af0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:23.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.130+0000 7f330ec00640 1 -- 172.21.15.144:0/1553159004 >> 172.21.15.144:0/1553159004 conn(0x7f3308062a80 msgr2=0x7f33080b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:23.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.130+0000 7f330ec00640 1 -- 172.21.15.144:0/1553159004 shutdown_connections 2024-09-11T23:23:23.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.130+0000 7f330ec00640 1 -- 172.21.15.144:0/1553159004 wait complete. 2024-09-11T23:23:23.145 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol38500 2024-09-11T23:23:23.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.302+0000 7f2633c00640 1 Processor -- start 2024-09-11T23:23:23.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.302+0000 7f2633c00640 1 -- start start 2024-09-11T23:23:23.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.303+0000 7f2633c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f262c15ed50 0x7f262c143d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:23.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.303+0000 7f2633c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f262c0714d0 0x7f262c0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:23.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.303+0000 7f2633c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f262c1443d0 con 0x7f262c071080 2024-09-11T23:23:23.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.303+0000 7f2633c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f262c1446b0 con 0x7f262c0714d0 2024-09-11T23:23:23.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.303+0000 7f2633c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f262c144990 con 0x7f262c15ed50 2024-09-11T23:23:23.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.304+0000 7f2631200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f262c15ed50 0x7f262c143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:23.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.304+0000 7f2631c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f262c0714d0 0x7f262c0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:23.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.304+0000 7f2631200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f262c15ed50 0x7f262c143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:50950/0 (socket says 172.21.15.144:50950) 2024-09-11T23:23:23.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.304+0000 7f2631200640 1 -- 172.21.15.144:0/2772857062 learned_addr learned my addr 172.21.15.144:0/2772857062 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:23.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.305+0000 7f2631200640 1 -- 172.21.15.144:0/2772857062 >> v2:172.21.15.165:3300/0 conn(0x7f262c0714d0 msgr2=0x7f262c0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:23.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.305+0000 7f2631200640 1 --2- 172.21.15.144:0/2772857062 >> v2:172.21.15.165:3300/0 conn(0x7f262c0714d0 0x7f262c0ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:23.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.305+0000 7f2631200640 1 -- 172.21.15.144:0/2772857062 >> v1:172.21.15.165:6789/0 conn(0x7f262c071080 legacy=0x7f262c0b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:23.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.305+0000 7f2631200640 1 -- 172.21.15.144:0/2772857062 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f262c0b35c0 con 0x7f262c15ed50 2024-09-11T23:23:23.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.306+0000 7f2631200640 1 --2- 172.21.15.144:0/2772857062 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f262c15ed50 0x7f262c143d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f261c009870 tx=0x7f261c02a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7559dd2ee85f4f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:23.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.306+0000 7f262be00640 1 -- 172.21.15.144:0/2772857062 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261c037070 con 0x7f262c15ed50 2024-09-11T23:23:23.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.306+0000 7f262be00640 1 -- 172.21.15.144:0/2772857062 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f261c032440 con 0x7f262c15ed50 2024-09-11T23:23:23.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.306+0000 7f262be00640 1 -- 172.21.15.144:0/2772857062 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261c032810 con 0x7f262c15ed50 2024-09-11T23:23:23.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.307+0000 7f2633c00640 1 -- 172.21.15.144:0/2772857062 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f262c15ed50 msgr2=0x7f262c143d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:23.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.307+0000 7f2633c00640 1 --2- 172.21.15.144:0/2772857062 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f262c15ed50 0x7f262c143d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f261c009870 tx=0x7f261c02a1e0 comp rx=0 tx=0).stop 2024-09-11T23:23:23.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.307+0000 7f2633c00640 1 -- 172.21.15.144:0/2772857062 shutdown_connections 2024-09-11T23:23:23.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.307+0000 7f2633c00640 1 --2- 172.21.15.144:0/2772857062 >> v2:172.21.15.165:3300/0 conn(0x7f262c0714d0 0x7f262c0ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:23.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.307+0000 7f2633c00640 1 --2- 172.21.15.144:0/2772857062 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f262c15ed50 0x7f262c143d40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:23.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.307+0000 7f2633c00640 1 -- 172.21.15.144:0/2772857062 >> 172.21.15.144:0/2772857062 conn(0x7f262c06bba0 msgr2=0x7f262c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:23.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.307+0000 7f2633c00640 1 -- 172.21.15.144:0/2772857062 shutdown_connections 2024-09-11T23:23:23.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.307+0000 7f2633c00640 1 -- 172.21.15.144:0/2772857062 wait complete. 2024-09-11T23:23:23.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.309+0000 7f2633c00640 1 Processor -- start 2024-09-11T23:23:23.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.309+0000 7f2633c00640 1 -- start start 2024-09-11T23:23:23.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.310+0000 7f2633c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f262c071080 0x7f262c15e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:23.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.310+0000 7f2633c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f262c0714d0 0x7f262c0b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:23.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.310+0000 7f2633c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f262c15ed50 0x7f262c0b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:23.310 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.310+0000 7f2633c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f262c0aee20 con 0x7f262c15ed50 2024-09-11T23:23:23.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.310+0000 7f2633c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f262c0b4420 con 0x7f262c0714d0 2024-09-11T23:23:23.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.310+0000 7f2633c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f262c0aefa0 con 0x7f262c071080 2024-09-11T23:23:23.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.310+0000 7f2631c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f262c15ed50 0x7f262c0b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:23.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.310+0000 7f2631c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f262c15ed50 0x7f262c0b1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50098/0 (socket says 172.21.15.144:50098) 2024-09-11T23:23:23.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.310+0000 7f2631c00640 1 -- 172.21.15.144:0/2576231534 learned_addr learned my addr 172.21.15.144:0/2576231534 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:23.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.310+0000 7f2623e00640 1 --2- 172.21.15.144:0/2576231534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f262c0714d0 0x7f262c0b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:23.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.310+0000 7f2631200640 1 --2- 172.21.15.144:0/2576231534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f262c071080 0x7f262c15e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:23.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.310+0000 7f2631c00640 1 -- 172.21.15.144:0/2576231534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f262c071080 msgr2=0x7f262c15e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:23.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.310+0000 7f2631c00640 1 --2- 172.21.15.144:0/2576231534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f262c071080 0x7f262c15e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:23.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.310+0000 7f2631c00640 1 -- 172.21.15.144:0/2576231534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f262c0714d0 msgr2=0x7f262c0b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:23.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.310+0000 7f2631c00640 1 --2- 172.21.15.144:0/2576231534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f262c0714d0 0x7f262c0b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:23.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.311+0000 7f2631c00640 1 -- 172.21.15.144:0/2576231534 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f262c158c40 con 0x7f262c15ed50 2024-09-11T23:23:23.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.311+0000 7f2631c00640 1 --2- 172.21.15.144:0/2576231534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f262c15ed50 0x7f262c0b1180 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f2624009dd0 tx=0x7f262400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:23.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.311+0000 7f2629600640 1 -- 172.21.15.144:0/2576231534 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2624018020 con 0x7f262c15ed50 2024-09-11T23:23:23.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.311+0000 7f2629600640 1 -- 172.21.15.144:0/2576231534 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2624014480 con 0x7f262c15ed50 2024-09-11T23:23:23.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.311+0000 7f2629600640 1 -- 172.21.15.144:0/2576231534 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2624014870 con 0x7f262c15ed50 2024-09-11T23:23:23.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.311+0000 7f2633c00640 1 -- 172.21.15.144:0/2576231534 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f262c158ee0 con 0x7f262c15ed50 2024-09-11T23:23:23.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.311+0000 7f2633c00640 1 -- 172.21.15.144:0/2576231534 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f262c12f970 con 0x7f262c15ed50 2024-09-11T23:23:23.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.312+0000 7f2633c00640 1 -- 172.21.15.144:0/2576231534 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f262c0ae8e0 con 0x7f262c15ed50 2024-09-11T23:23:23.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.313+0000 7f2629600640 1 -- 172.21.15.144:0/2576231534 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 90651+0+0 (secure 0 0 0) 0x7f2624005d10 con 0x7f262c15ed50 2024-09-11T23:23:23.313 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.314+0000 7f2629600640 1 --2- 172.21.15.144:0/2576231534 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f260806bfe0 0x7f260806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:23.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.314+0000 7f2629600640 1 -- 172.21.15.144:0/2576231534 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f262408bd30 con 0x7f262c15ed50 2024-09-11T23:23:23.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.315+0000 7f2631200640 1 --2- 172.21.15.144:0/2576231534 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f260806bfe0 0x7f260806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:23.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.315+0000 7f2631200640 1 --2- 172.21.15.144:0/2576231534 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f260806bfe0 0x7f260806e4a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f261c034000 tx=0x7f261c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:23.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.318+0000 7f2629600640 1 -- 172.21.15.144:0/2576231534 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2624022070 con 0x7f262c15ed50 2024-09-11T23:23:23.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.520+0000 7f2633c00640 1 -- 172.21.15.144:0/2576231534 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol38500", "target": ["mon-mgr", ""]}) -- 0x7f262c0725a0 con 0x7f260806bfe0 2024-09-11T23:23:23.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.561+0000 7f2629600640 1 -- 172.21.15.144:0/2576231534 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7f262c0725a0 con 0x7f260806bfe0 2024-09-11T23:23:23.561 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee 2024-09-11T23:23:23.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.563+0000 7f2633c00640 1 -- 172.21.15.144:0/2576231534 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f260806bfe0 msgr2=0x7f260806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:23.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.563+0000 7f2633c00640 1 --2- 172.21.15.144:0/2576231534 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f260806bfe0 0x7f260806e4a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f261c034000 tx=0x7f261c02e000 comp rx=0 tx=0).stop 2024-09-11T23:23:23.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.563+0000 7f2633c00640 1 -- 172.21.15.144:0/2576231534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f262c15ed50 msgr2=0x7f262c0b1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:23.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.563+0000 7f2633c00640 1 --2- 172.21.15.144:0/2576231534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f262c15ed50 0x7f262c0b1180 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f2624009dd0 tx=0x7f262400c490 comp rx=0 tx=0).stop 2024-09-11T23:23:23.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.564+0000 7f2633c00640 1 -- 172.21.15.144:0/2576231534 shutdown_connections 2024-09-11T23:23:23.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.564+0000 7f2633c00640 1 --2- 172.21.15.144:0/2576231534 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f260806bfe0 0x7f260806e4a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:23.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.564+0000 7f2633c00640 1 --2- 172.21.15.144:0/2576231534 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f262c15ed50 0x7f262c0b1180 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:23.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.564+0000 7f2633c00640 1 --2- 172.21.15.144:0/2576231534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f262c0714d0 0x7f262c0b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:23.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.564+0000 7f2633c00640 1 --2- 172.21.15.144:0/2576231534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f262c071080 0x7f262c15e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:23.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.564+0000 7f2633c00640 1 -- 172.21.15.144:0/2576231534 >> 172.21.15.144:0/2576231534 conn(0x7f262c06bba0 msgr2=0x7f262c1e7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:23.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.564+0000 7f2633c00640 1 -- 172.21.15.144:0/2576231534 shutdown_connections 2024-09-11T23:23:23.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:23.564+0000 7f2633c00640 1 -- 172.21.15.144:0/2576231534 wait complete. 2024-09-11T23:23:23.579 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol38500 with 8 files each 1MB size under directory volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee 2024-09-11T23:23:23.579 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:23:23.579 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:23.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:23.615 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2024-09-11T23:23:23.712 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-11T23:23:23.712 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-11T23:23:23.713 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184622 s, 56.8 MB/s 2024-09-11T23:23:23.714 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:23:23.714 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:23.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:23.749 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2024-09-11T23:23:23.847 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-11T23:23:23.847 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-11T23:23:23.847 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213224 s, 49.2 MB/s 2024-09-11T23:23:23.848 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:23:23.848 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:23.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:23.884 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2024-09-11T23:23:23.980 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-11T23:23:23.980 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-11T23:23:23.980 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195796 s, 53.6 MB/s 2024-09-11T23:23:23.981 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:23:23.981 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:24.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:24.017 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2024-09-11T23:23:24.112 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-11T23:23:24.113 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-11T23:23:24.113 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203863 s, 51.4 MB/s 2024-09-11T23:23:24.114 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:23:24.114 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:24.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:24.150 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2024-09-11T23:23:24.242 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-11T23:23:24.242 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-11T23:23:24.242 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162377 s, 64.6 MB/s 2024-09-11T23:23:24.243 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:23:24.243 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:24.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:24.279 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2024-09-11T23:23:24.372 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-11T23:23:24.372 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-11T23:23:24.372 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017001 s, 61.7 MB/s 2024-09-11T23:23:24.373 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:23:24.373 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:24.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:24.410 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2024-09-11T23:23:24.504 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-11T23:23:24.504 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-11T23:23:24.505 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178001 s, 58.9 MB/s 2024-09-11T23:23:24.506 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:23:24.506 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:24.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:24.542 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2024-09-11T23:23:24.638 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-11T23:23:24.638 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-11T23:23:24.638 INFO:teuthology.orchestra.run.smithi144.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206609 s, 50.8 MB/s 2024-09-11T23:23:24.639 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol38500 subvol_snap87730 2024-09-11T23:23:24.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.799+0000 7f8debe00640 1 Processor -- start 2024-09-11T23:23:24.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.799+0000 7f8debe00640 1 -- start start 2024-09-11T23:23:24.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.800+0000 7f8debe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dec15c410 0x7f8dec0b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:24.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.800+0000 7f8debe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8dec0b2ab0 0x7f8dec0b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:24.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.800+0000 7f8debe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dec072870 con 0x7f8dec15c030 2024-09-11T23:23:24.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.800+0000 7f8debe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8dec072b50 con 0x7f8dec0b2ab0 2024-09-11T23:23:24.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.800+0000 7f8debe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8dec072e30 con 0x7f8dec15c410 2024-09-11T23:23:24.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.801+0000 7f8de2000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dec15c410 0x7f8dec0b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:24.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.801+0000 7f8deb400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8dec0b2ab0 0x7f8dec0b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:24.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.801+0000 7f8deaa00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f8dec15c030 0x7f8dec071f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:58706/0 (socket says 172.21.15.144:58706) 2024-09-11T23:23:24.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.801+0000 7f8deaa00640 1 -- 172.21.15.144:0/514505534 learned_addr learned my addr 172.21.15.144:0/514505534 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:24.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.801+0000 7f8de2000640 1 -- 172.21.15.144:0/514505534 >> v2:172.21.15.165:3300/0 conn(0x7f8dec0b2ab0 msgr2=0x7f8dec0b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:24.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.801+0000 7f8de2000640 1 --2- 172.21.15.144:0/514505534 >> v2:172.21.15.165:3300/0 conn(0x7f8dec0b2ab0 0x7f8dec0b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:24.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.801+0000 7f8de2000640 1 -- 172.21.15.144:0/514505534 >> v1:172.21.15.165:6789/0 conn(0x7f8dec15c030 legacy=0x7f8dec071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:24.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.801+0000 7f8de2000640 1 -- 172.21.15.144:0/514505534 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dec073110 con 0x7f8dec15c410 2024-09-11T23:23:24.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.801+0000 7f8dea000640 1 -- 172.21.15.144:0/514505534 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3184957016 0 0) 0x7f8dec072870 con 0x7f8dec15c030 2024-09-11T23:23:24.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.801+0000 7f8deb400640 1 --2- 172.21.15.144:0/514505534 >> v2:172.21.15.165:3300/0 conn(0x7f8dec0b2ab0 0x7f8dec0b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:23:24.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.802+0000 7f8de2000640 1 --2- 172.21.15.144:0/514505534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dec15c410 0x7f8dec0b1e60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8dd40097a0 tx=0x7f8dd402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0c60e23127f5558 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:24.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.803+0000 7f8dea000640 1 -- 172.21.15.144:0/514505534 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4037070 con 0x7f8dec15c410 2024-09-11T23:23:24.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.803+0000 7f8dea000640 1 -- 172.21.15.144:0/514505534 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd4032440 con 0x7f8dec15c410 2024-09-11T23:23:24.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.803+0000 7f8dea000640 1 -- 172.21.15.144:0/514505534 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4032810 con 0x7f8dec15c410 2024-09-11T23:23:24.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.803+0000 7f8debe00640 1 -- 172.21.15.144:0/514505534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dec15c410 msgr2=0x7f8dec0b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:24.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.803+0000 7f8debe00640 1 --2- 172.21.15.144:0/514505534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dec15c410 0x7f8dec0b1e60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8dd40097a0 tx=0x7f8dd402a180 comp rx=0 tx=0).stop 2024-09-11T23:23:24.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.803+0000 7f8debe00640 1 -- 172.21.15.144:0/514505534 shutdown_connections 2024-09-11T23:23:24.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.803+0000 7f8debe00640 1 --2- 172.21.15.144:0/514505534 >> v2:172.21.15.165:3300/0 conn(0x7f8dec0b2ab0 0x7f8dec0b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:24.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.803+0000 7f8debe00640 1 --2- 172.21.15.144:0/514505534 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dec15c410 0x7f8dec0b1e60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:24.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.803+0000 7f8debe00640 1 -- 172.21.15.144:0/514505534 >> 172.21.15.144:0/514505534 conn(0x7f8dec06bba0 msgr2=0x7f8dec06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:24.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.803+0000 7f8debe00640 1 -- 172.21.15.144:0/514505534 shutdown_connections 2024-09-11T23:23:24.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.803+0000 7f8debe00640 1 -- 172.21.15.144:0/514505534 wait complete. 2024-09-11T23:23:24.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.805+0000 7f8debe00640 1 Processor -- start 2024-09-11T23:23:24.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.805+0000 7f8debe00640 1 -- start start 2024-09-11T23:23:24.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.806+0000 7f8debe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dec0b2ab0 0x7f8dec1f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:24.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.806+0000 7f8debe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dec15c030 0x7f8dec0cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:24.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.806+0000 7f8debe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dec15c410 0x7f8dec0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:24.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.806+0000 7f8debe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec0cd270 con 0x7f8dec15c030 2024-09-11T23:23:24.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.806+0000 7f8debe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec0cd0f0 con 0x7f8dec0b2ab0 2024-09-11T23:23:24.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.806+0000 7f8debe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8dec0cd3f0 con 0x7f8dec15c410 2024-09-11T23:23:24.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.806+0000 7f8de2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dec15c030 0x7f8dec0cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:24.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.806+0000 7f8de2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dec15c030 0x7f8dec0cbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40378/0 (socket says 172.21.15.144:40378) 2024-09-11T23:23:24.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.806+0000 7f8de2000640 1 -- 172.21.15.144:0/548823153 learned_addr learned my addr 172.21.15.144:0/548823153 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:24.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.806+0000 7f8deaa00640 1 --2- 172.21.15.144:0/548823153 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dec0b2ab0 0x7f8dec1f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:24.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.806+0000 7f8deb400640 1 --2- 172.21.15.144:0/548823153 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dec15c410 0x7f8dec0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:24.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.807+0000 7f8de2000640 1 -- 172.21.15.144:0/548823153 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dec15c410 msgr2=0x7f8dec0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:24.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.807+0000 7f8de2000640 1 --2- 172.21.15.144:0/548823153 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dec15c410 0x7f8dec0ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:24.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.807+0000 7f8de2000640 1 -- 172.21.15.144:0/548823153 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dec0b2ab0 msgr2=0x7f8dec1f4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:24.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.807+0000 7f8de2000640 1 --2- 172.21.15.144:0/548823153 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dec0b2ab0 0x7f8dec1f4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:24.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.807+0000 7f8de2000640 1 -- 172.21.15.144:0/548823153 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dec1f4cc0 con 0x7f8dec15c030 2024-09-11T23:23:24.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.807+0000 7f8de2000640 1 --2- 172.21.15.144:0/548823153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dec15c030 0x7f8dec0cbad0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f8dd40097a0 tx=0x7f8dd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:24.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.807+0000 7f8de3400640 1 -- 172.21.15.144:0/548823153 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4037050 con 0x7f8dec15c030 2024-09-11T23:23:24.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.807+0000 7f8de3400640 1 -- 172.21.15.144:0/548823153 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd4038040 con 0x7f8dec15c030 2024-09-11T23:23:24.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.807+0000 7f8debe00640 1 -- 172.21.15.144:0/548823153 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dec0cc010 con 0x7f8dec15c030 2024-09-11T23:23:24.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.807+0000 7f8de3400640 1 -- 172.21.15.144:0/548823153 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4004490 con 0x7f8dec15c030 2024-09-11T23:23:24.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.807+0000 7f8debe00640 1 -- 172.21.15.144:0/548823153 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dec0b3730 con 0x7f8dec15c030 2024-09-11T23:23:24.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.808+0000 7f8debe00640 1 -- 172.21.15.144:0/548823153 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dec071f60 con 0x7f8dec15c030 2024-09-11T23:23:24.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.809+0000 7f8de3400640 1 -- 172.21.15.144:0/548823153 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 90651+0+0 (secure 0 0 0) 0x7f8dd4003610 con 0x7f8dec15c030 2024-09-11T23:23:24.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.810+0000 7f8de3400640 1 --2- 172.21.15.144:0/548823153 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8dc806bfe0 0x7f8dc806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:24.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.810+0000 7f8de3400640 1 -- 172.21.15.144:0/548823153 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f8dd40abb00 con 0x7f8dec15c030 2024-09-11T23:23:24.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.811+0000 7f8deaa00640 1 --2- 172.21.15.144:0/548823153 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8dc806bfe0 0x7f8dc806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:24.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.811+0000 7f8deaa00640 1 --2- 172.21.15.144:0/548823153 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8dc806bfe0 0x7f8dc806e4a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc000f60 tx=0x7f8ddc007d50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:24.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:24.815+0000 7f8de3400640 1 -- 172.21.15.144:0/548823153 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8dec1f4cc0 con 0x7f8dec15c030 2024-09-11T23:23:25.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.016+0000 7f8debe00640 1 -- 172.21.15.144:0/548823153 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol38500", "snap_name": "subvol_snap87730", "target": ["mon-mgr", ""]}) -- 0x7f8dec0ce6f0 con 0x7f8dc806bfe0 2024-09-11T23:23:25.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.050+0000 7f8de3400640 1 -- 172.21.15.144:0/548823153 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8dec0ce6f0 con 0x7f8dc806bfe0 2024-09-11T23:23:25.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.053+0000 7f8debe00640 1 -- 172.21.15.144:0/548823153 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8dc806bfe0 msgr2=0x7f8dc806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:25.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.053+0000 7f8debe00640 1 --2- 172.21.15.144:0/548823153 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8dc806bfe0 0x7f8dc806e4a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc000f60 tx=0x7f8ddc007d50 comp rx=0 tx=0).stop 2024-09-11T23:23:25.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.053+0000 7f8debe00640 1 -- 172.21.15.144:0/548823153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dec15c030 msgr2=0x7f8dec0cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:25.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.053+0000 7f8debe00640 1 --2- 172.21.15.144:0/548823153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dec15c030 0x7f8dec0cbad0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f8dd40097a0 tx=0x7f8dd40046c0 comp rx=0 tx=0).stop 2024-09-11T23:23:25.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.053+0000 7f8debe00640 1 -- 172.21.15.144:0/548823153 shutdown_connections 2024-09-11T23:23:25.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.053+0000 7f8debe00640 1 --2- 172.21.15.144:0/548823153 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8dc806bfe0 0x7f8dc806e4a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:25.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.053+0000 7f8debe00640 1 --2- 172.21.15.144:0/548823153 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dec15c410 0x7f8dec0ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:25.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.053+0000 7f8debe00640 1 --2- 172.21.15.144:0/548823153 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dec15c030 0x7f8dec0cbad0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:25.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.053+0000 7f8debe00640 1 --2- 172.21.15.144:0/548823153 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dec0b2ab0 0x7f8dec1f4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:25.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.053+0000 7f8debe00640 1 -- 172.21.15.144:0/548823153 >> 172.21.15.144:0/548823153 conn(0x7f8dec06bba0 msgr2=0x7f8dec0cd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:25.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.053+0000 7f8debe00640 1 -- 172.21.15.144:0/548823153 shutdown_connections 2024-09-11T23:23:25.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.053+0000 7f8debe00640 1 -- 172.21.15.144:0/548823153 wait complete. 2024-09-11T23:23:25.069 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol38500 subvol_snap87730 subvol_clone9810 2024-09-11T23:23:25.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.231+0000 7fdcad000640 1 Processor -- start 2024-09-11T23:23:25.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.231+0000 7fdcad000640 1 -- start start 2024-09-11T23:23:25.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.232+0000 7fdcad000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdca815eb10 0x7fdca806ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:25.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.232+0000 7fdcad000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdca8070d30 0x7fdca80b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:25.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.232+0000 7fdcad000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdca8071170 con 0x7fdca80d24f0 2024-09-11T23:23:25.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.232+0000 7fdcad000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fdca80b5be0 con 0x7fdca8070d30 2024-09-11T23:23:25.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.232+0000 7fdcad000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdca806e5d0 con 0x7fdca815eb10 2024-09-11T23:23:25.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.232+0000 7fdca5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdca8070d30 0x7fdca80b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:25.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.232+0000 7fdca5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdca8070d30 0x7fdca80b56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40392/0 (socket says 172.21.15.144:40392) 2024-09-11T23:23:25.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.232+0000 7fdca5400640 1 -- 172.21.15.144:0/192224931 learned_addr learned my addr 172.21.15.144:0/192224931 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:25.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.233+0000 7fdca5e00640 1 --2- 172.21.15.144:0/192224931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdca815eb10 0x7fdca806ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:25.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.233+0000 7fdca5400640 1 -- 172.21.15.144:0/192224931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdca815eb10 msgr2=0x7fdca806ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:25.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.233+0000 7fdca5400640 1 --2- 172.21.15.144:0/192224931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdca815eb10 0x7fdca806ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:25.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.233+0000 7fdca5400640 1 -- 172.21.15.144:0/192224931 >> v1:172.21.15.165:6789/0 conn(0x7fdca80d24f0 legacy=0x7fdca80d2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:25.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.233+0000 7fdca5400640 1 -- 172.21.15.144:0/192224931 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca8071760 con 0x7fdca8070d30 2024-09-11T23:23:25.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.233+0000 7fdca5e00640 1 --2- 172.21.15.144:0/192224931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdca815eb10 0x7fdca806ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:23:25.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.234+0000 7fdca5400640 1 --2- 172.21.15.144:0/192224931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdca8070d30 0x7fdca80b56a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fdca8071340 tx=0x7fdc9402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572f0501432896f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:25.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.234+0000 7fdca4a00640 1 -- 172.21.15.144:0/192224931 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94037070 con 0x7fdca8070d30 2024-09-11T23:23:25.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.234+0000 7fdca4a00640 1 -- 172.21.15.144:0/192224931 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc94032440 con 0x7fdca8070d30 2024-09-11T23:23:25.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.234+0000 7fdca4a00640 1 -- 172.21.15.144:0/192224931 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94032810 con 0x7fdca8070d30 2024-09-11T23:23:25.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.235+0000 7fdcad000640 1 -- 172.21.15.144:0/192224931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdca8070d30 msgr2=0x7fdca80b56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:25.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.235+0000 7fdcad000640 1 --2- 172.21.15.144:0/192224931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdca8070d30 0x7fdca80b56a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fdca8071340 tx=0x7fdc9402a250 comp rx=0 tx=0).stop 2024-09-11T23:23:25.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.235+0000 7fdcad000640 1 -- 172.21.15.144:0/192224931 shutdown_connections 2024-09-11T23:23:25.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.235+0000 7fdcad000640 1 --2- 172.21.15.144:0/192224931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdca8070d30 0x7fdca80b56a0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:25.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.235+0000 7fdcad000640 1 --2- 172.21.15.144:0/192224931 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdca815eb10 0x7fdca806ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:25.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.235+0000 7fdcad000640 1 -- 172.21.15.144:0/192224931 >> 172.21.15.144:0/192224931 conn(0x7fdca806f370 msgr2=0x7fdca806f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:25.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.235+0000 7fdcad000640 1 -- 172.21.15.144:0/192224931 shutdown_connections 2024-09-11T23:23:25.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.235+0000 7fdcad000640 1 -- 172.21.15.144:0/192224931 wait complete. 2024-09-11T23:23:25.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.236+0000 7fdcad000640 1 Processor -- start 2024-09-11T23:23:25.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.237+0000 7fdcad000640 1 -- start start 2024-09-11T23:23:25.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.237+0000 7fdcad000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdca8070d30 0x7fdca815abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:25.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.237+0000 7fdcad000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdca80d24f0 0x7fdca8141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:25.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.237+0000 7fdcad000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdca815eb10 0x7fdca8144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:25.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.237+0000 7fdcad000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdca806eb00 con 0x7fdca815eb10 2024-09-11T23:23:25.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.237+0000 7fdcad000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdca806e820 con 0x7fdca80d24f0 2024-09-11T23:23:25.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.237+0000 7fdcad000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdca815f210 con 0x7fdca8070d30 2024-09-11T23:23:25.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.238+0000 7fdca6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdca815eb10 0x7fdca8144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:25.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.238+0000 7fdca6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdca815eb10 0x7fdca8144370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40400/0 (socket says 172.21.15.144:40400) 2024-09-11T23:23:25.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.238+0000 7fdca6800640 1 -- 172.21.15.144:0/2457035732 learned_addr learned my addr 172.21.15.144:0/2457035732 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:25.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.238+0000 7fdca5e00640 1 --2- 172.21.15.144:0/2457035732 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdca8070d30 0x7fdca815abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:25.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.238+0000 7fdca5400640 1 --2- 172.21.15.144:0/2457035732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdca80d24f0 0x7fdca8141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:25.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.238+0000 7fdca6800640 1 -- 172.21.15.144:0/2457035732 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdca8070d30 msgr2=0x7fdca815abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:25.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.238+0000 7fdca6800640 1 --2- 172.21.15.144:0/2457035732 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdca8070d30 0x7fdca815abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:25.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.238+0000 7fdca6800640 1 -- 172.21.15.144:0/2457035732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdca80d24f0 msgr2=0x7fdca8141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:25.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.238+0000 7fdca6800640 1 --2- 172.21.15.144:0/2457035732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdca80d24f0 0x7fdca8141910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:25.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.238+0000 7fdca6800640 1 -- 172.21.15.144:0/2457035732 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca815b250 con 0x7fdca815eb10 2024-09-11T23:23:25.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.238+0000 7fdca6800640 1 --2- 172.21.15.144:0/2457035732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdca815eb10 0x7fdca8144370 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fdca000c7a0 tx=0x7fdca000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:25.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.239+0000 7fdc9e000640 1 -- 172.21.15.144:0/2457035732 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca0003b70 con 0x7fdca815eb10 2024-09-11T23:23:25.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.239+0000 7fdc9e000640 1 -- 172.21.15.144:0/2457035732 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdca0003d30 con 0x7fdca815eb10 2024-09-11T23:23:25.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.239+0000 7fdcad000640 1 -- 172.21.15.144:0/2457035732 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca815b530 con 0x7fdca815eb10 2024-09-11T23:23:25.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.239+0000 7fdc9e000640 1 -- 172.21.15.144:0/2457035732 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca000aa90 con 0x7fdca815eb10 2024-09-11T23:23:25.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.239+0000 7fdcad000640 1 -- 172.21.15.144:0/2457035732 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca815baf0 con 0x7fdca815eb10 2024-09-11T23:23:25.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.240+0000 7fdcad000640 1 -- 172.21.15.144:0/2457035732 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdca80b56a0 con 0x7fdca815eb10 2024-09-11T23:23:25.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.241+0000 7fdc9e000640 1 -- 172.21.15.144:0/2457035732 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 17) ==== 90651+0+0 (secure 0 0 0) 0x7fdca000ac30 con 0x7fdca815eb10 2024-09-11T23:23:25.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.241+0000 7fdc9e000640 1 --2- 172.21.15.144:0/2457035732 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdc8806bfe0 0x7fdc8806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:25.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.242+0000 7fdc9e000640 1 -- 172.21.15.144:0/2457035732 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7fdca008afd0 con 0x7fdca815eb10 2024-09-11T23:23:25.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.242+0000 7fdca5e00640 1 --2- 172.21.15.144:0/2457035732 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdc8806bfe0 0x7fdc8806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:25.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.243+0000 7fdca5e00640 1 --2- 172.21.15.144:0/2457035732 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdc8806bfe0 0x7fdc8806e4a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdc98006fd0 tx=0x7fdc98008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:25.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.246+0000 7fdc9e000640 1 -- 172.21.15.144:0/2457035732 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdca0059060 con 0x7fdca815eb10 2024-09-11T23:23:25.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.454+0000 7fdcad000640 1 -- 172.21.15.144:0/2457035732 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol38500", "snap_name": "subvol_snap87730", "target_sub_name": "subvol_clone9810", "target": ["mon-mgr", ""]}) -- 0x7fdca8069160 con 0x7fdc8806bfe0 2024-09-11T23:23:25.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.542+0000 7fdc9e000640 1 -- 172.21.15.144:0/2457035732 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdca8069160 con 0x7fdc8806bfe0 2024-09-11T23:23:25.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.544+0000 7fdcad000640 1 -- 172.21.15.144:0/2457035732 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdc8806bfe0 msgr2=0x7fdc8806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:25.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.544+0000 7fdcad000640 1 --2- 172.21.15.144:0/2457035732 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdc8806bfe0 0x7fdc8806e4a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdc98006fd0 tx=0x7fdc98008040 comp rx=0 tx=0).stop 2024-09-11T23:23:25.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.544+0000 7fdcad000640 1 -- 172.21.15.144:0/2457035732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdca815eb10 msgr2=0x7fdca8144370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.544+0000 7fdcad000640 1 --2- 172.21.15.144:0/2457035732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdca815eb10 0x7fdca8144370 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fdca000c7a0 tx=0x7fdca000cc60 comp rx=0 tx=0).stop 2024-09-11T23:23:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.544+0000 7fdcad000640 1 -- 172.21.15.144:0/2457035732 shutdown_connections 2024-09-11T23:23:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.544+0000 7fdcad000640 1 --2- 172.21.15.144:0/2457035732 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdc8806bfe0 0x7fdc8806e4a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.544+0000 7fdcad000640 1 --2- 172.21.15.144:0/2457035732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdca815eb10 0x7fdca8144370 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.544+0000 7fdcad000640 1 --2- 172.21.15.144:0/2457035732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdca80d24f0 0x7fdca8141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.544+0000 7fdcad000640 1 --2- 172.21.15.144:0/2457035732 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdca8070d30 0x7fdca815abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.544+0000 7fdcad000640 1 -- 172.21.15.144:0/2457035732 >> 172.21.15.144:0/2457035732 conn(0x7fdca806f370 msgr2=0x7fdca8161680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.545+0000 7fdcad000640 1 -- 172.21.15.144:0/2457035732 shutdown_connections 2024-09-11T23:23:25.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.545+0000 7fdcad000640 1 -- 172.21.15.144:0/2457035732 wait complete. 2024-09-11T23:23:25.548 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:25.549+0000 7f30e5a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:25.548 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:25.549+0000 7f30e5a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:25.548 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:25.549+0000 7f30e5a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:25.548 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:25.549+0000 7f30e5a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:25.548 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:25.549+0000 7f30e5a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:25.562 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone9810 2024-09-11T23:23:25.566 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:25.567+0000 7f30e5000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:25.566 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:25.567+0000 7f30e5000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:25.566 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:25.567+0000 7f30e5000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:25.566 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:25.567+0000 7f30e5000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:25.567 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:25.567+0000 7f30e5000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:25.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.743+0000 7f42d7200640 1 Processor -- start 2024-09-11T23:23:25.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.743+0000 7f42d7200640 1 -- start start 2024-09-11T23:23:25.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.745+0000 7f42d7200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f42d815e6c0 0x7f42d806c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:25.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.745+0000 7f42d7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d806d610 0x7f42d806da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:25.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.745+0000 7f42d7200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d806df60 con 0x7f42d80cf510 2024-09-11T23:23:25.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.745+0000 7f42d7200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f42d80d34d0 con 0x7f42d815e6c0 2024-09-11T23:23:25.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.745+0000 7f42d7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f42d815eaa0 con 0x7f42d806d610 2024-09-11T23:23:25.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.745+0000 7f42d5400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f42d80cf510 0x7f42d80b7670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60184/0 (socket says 172.21.15.144:60184) 2024-09-11T23:23:25.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.745+0000 7f42d5400640 1 -- 172.21.15.144:0/4184927707 learned_addr learned my addr 172.21.15.144:0/4184927707 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:25.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.745+0000 7f42d6800640 1 --2- 172.21.15.144:0/4184927707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d806d610 0x7f42d806da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:25.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.746+0000 7f42d5e00640 1 --2- 172.21.15.144:0/4184927707 >> v2:172.21.15.144:3300/0 conn(0x7f42d815e6c0 0x7f42d806c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:25.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.746+0000 7f42d4a00640 1 -- 172.21.15.144:0/4184927707 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1345736331 0 0) 0x7f42c4001110 con 0x7f42d80cf510 2024-09-11T23:23:25.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.746+0000 7f42d4a00640 1 -- 172.21.15.144:0/4184927707 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42bc003520 con 0x7f42d80cf510 2024-09-11T23:23:25.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.746+0000 7f42d6800640 1 -- 172.21.15.144:0/4184927707 >> v2:172.21.15.144:3300/0 conn(0x7f42d815e6c0 msgr2=0x7f42d806c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:25.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.746+0000 7f42d6800640 1 --2- 172.21.15.144:0/4184927707 >> v2:172.21.15.144:3300/0 conn(0x7f42d815e6c0 0x7f42d806c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:25.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.746+0000 7f42d6800640 1 -- 172.21.15.144:0/4184927707 >> v1:172.21.15.144:6789/0 conn(0x7f42d80cf510 legacy=0x7f42d80b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:25.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.746+0000 7f42d6800640 1 -- 172.21.15.144:0/4184927707 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d806cdf0 con 0x7f42d806d610 2024-09-11T23:23:25.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.746+0000 7f42d5e00640 1 --2- 172.21.15.144:0/4184927707 >> v2:172.21.15.144:3300/0 conn(0x7f42d815e6c0 0x7f42d806c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:23:25.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.747+0000 7f42d6800640 1 --2- 172.21.15.144:0/4184927707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d806d610 0x7f42d806da20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f42d0009d90 tx=0x7f42d002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81c5690487cff975 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:25.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.748+0000 7f42d4a00640 1 -- 172.21.15.144:0/4184927707 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d0007740 con 0x7f42d806d610 2024-09-11T23:23:25.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.748+0000 7f42d4a00640 1 -- 172.21.15.144:0/4184927707 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d00078e0 con 0x7f42d806d610 2024-09-11T23:23:25.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.748+0000 7f42d4a00640 1 -- 172.21.15.144:0/4184927707 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d0007cb0 con 0x7f42d806d610 2024-09-11T23:23:25.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.748+0000 7f42d7200640 1 -- 172.21.15.144:0/4184927707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d806d610 msgr2=0x7f42d806da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:25.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.748+0000 7f42d7200640 1 --2- 172.21.15.144:0/4184927707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d806d610 0x7f42d806da20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f42d0009d90 tx=0x7f42d002a660 comp rx=0 tx=0).stop 2024-09-11T23:23:25.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.748+0000 7f42d7200640 1 -- 172.21.15.144:0/4184927707 shutdown_connections 2024-09-11T23:23:25.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.748+0000 7f42d7200640 1 --2- 172.21.15.144:0/4184927707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d806d610 0x7f42d806da20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:25.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.748+0000 7f42d7200640 1 --2- 172.21.15.144:0/4184927707 >> v2:172.21.15.144:3300/0 conn(0x7f42d815e6c0 0x7f42d806c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:25.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.748+0000 7f42d7200640 1 -- 172.21.15.144:0/4184927707 >> 172.21.15.144:0/4184927707 conn(0x7f42d80d4720 msgr2=0x7f42d80d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:25.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.748+0000 7f42d7200640 1 -- 172.21.15.144:0/4184927707 shutdown_connections 2024-09-11T23:23:25.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.748+0000 7f42d7200640 1 -- 172.21.15.144:0/4184927707 wait complete. 2024-09-11T23:23:25.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.750+0000 7f42d7200640 1 Processor -- start 2024-09-11T23:23:25.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.750+0000 7f42d7200640 1 -- start start 2024-09-11T23:23:25.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.751+0000 7f42d7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d806d610 0x7f42d814c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:25.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.751+0000 7f42d7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42d80cf510 0x7f42d80cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:25.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.751+0000 7f42d7200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42d815e6c0 0x7f42d80cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:25.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.751+0000 7f42d7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f42d80d2e80 con 0x7f42d80cf510 2024-09-11T23:23:25.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.751+0000 7f42d7200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f42d80d2ba0 con 0x7f42d815e6c0 2024-09-11T23:23:25.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.751+0000 7f42d7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f42d80d3160 con 0x7f42d806d610 2024-09-11T23:23:25.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.751+0000 7f42d5e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d806d610 0x7f42d814c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:25.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.751+0000 7f42d6800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42d815e6c0 0x7f42d80cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:25.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.751+0000 7f42d5e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d806d610 0x7f42d814c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:56100/0 (socket says 172.21.15.144:56100) 2024-09-11T23:23:25.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.751+0000 7f42d5e00640 1 -- 172.21.15.144:0/1070871267 learned_addr learned my addr 172.21.15.144:0/1070871267 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:25.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.752+0000 7f42d5400640 1 --2- 172.21.15.144:0/1070871267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42d80cf510 0x7f42d80cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:25.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.752+0000 7f42d5e00640 1 -- 172.21.15.144:0/1070871267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42d815e6c0 msgr2=0x7f42d80cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:25.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.752+0000 7f42d5e00640 1 --2- 172.21.15.144:0/1070871267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42d815e6c0 0x7f42d80cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:25.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.752+0000 7f42d5e00640 1 -- 172.21.15.144:0/1070871267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42d80cf510 msgr2=0x7f42d80cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:25.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.752+0000 7f42d5e00640 1 --2- 172.21.15.144:0/1070871267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42d80cf510 0x7f42d80cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:25.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.752+0000 7f42d5e00640 1 -- 172.21.15.144:0/1070871267 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d8159d80 con 0x7f42d806d610 2024-09-11T23:23:25.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.752+0000 7f42d6800640 1 --2- 172.21.15.144:0/1070871267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42d815e6c0 0x7f42d80cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:23:25.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.752+0000 7f42d5e00640 1 --2- 172.21.15.144:0/1070871267 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d806d610 0x7f42d814c960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f42c800ec10 tx=0x7f42c800c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:25.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.752+0000 7f42ce000640 1 -- 172.21.15.144:0/1070871267 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8017070 con 0x7f42d806d610 2024-09-11T23:23:25.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.753+0000 7f42ce000640 1 -- 172.21.15.144:0/1070871267 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c800cc30 con 0x7f42d806d610 2024-09-11T23:23:25.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.753+0000 7f42ce000640 1 -- 172.21.15.144:0/1070871267 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8013470 con 0x7f42d806d610 2024-09-11T23:23:25.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.753+0000 7f42d7200640 1 -- 172.21.15.144:0/1070871267 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d815eeb0 con 0x7f42d806d610 2024-09-11T23:23:25.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.753+0000 7f42d7200640 1 -- 172.21.15.144:0/1070871267 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d815f470 con 0x7f42d806d610 2024-09-11T23:23:25.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.754+0000 7f42d7200640 1 -- 172.21.15.144:0/1070871267 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d806da20 con 0x7f42d806d610 2024-09-11T23:23:25.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.755+0000 7f42ce000640 1 -- 172.21.15.144:0/1070871267 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 17) ==== 90651+0+0 (secure 0 0 0) 0x7f42c801a070 con 0x7f42d806d610 2024-09-11T23:23:25.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.756+0000 7f42ce000640 1 --2- 172.21.15.144:0/1070871267 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f42b806bfe0 0x7f42b806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:25.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.756+0000 7f42ce000640 1 -- 172.21.15.144:0/1070871267 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f42c808b480 con 0x7f42d806d610 2024-09-11T23:23:25.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.756+0000 7f42d5400640 1 --2- 172.21.15.144:0/1070871267 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f42b806bfe0 0x7f42b806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:25.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.757+0000 7f42d5400640 1 --2- 172.21.15.144:0/1070871267 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f42b806bfe0 0x7f42b806e4a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f42d815a330 tx=0x7f42c4007b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:25.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.761+0000 7f42ce000640 1 -- 172.21.15.144:0/1070871267 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42c80594a0 con 0x7f42d806d610 2024-09-11T23:23:25.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:25.983+0000 7f42d7200640 1 -- 172.21.15.144:0/1070871267 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone9810", "target": ["mon-mgr", ""]}) -- 0x7f42d80d2600 con 0x7f42b806bfe0 2024-09-11T23:23:27.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:27.489+0000 7f42ce000640 1 -- 172.21.15.144:0/1070871267 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mgrmap(e 18) ==== 90753+0+0 (secure 0 0 0) 0x7f42c8055b10 con 0x7f42d806d610 2024-09-11T23:23:29.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.674+0000 7f42ce000640 1 -- 172.21.15.144:0/1070871267 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7f42d80d2600 con 0x7f42b806bfe0 2024-09-11T23:23:29.674 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:23:29.674 INFO:teuthology.orchestra.run.smithi144.stdout: "status": { 2024-09-11T23:23:29.674 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "complete" 2024-09-11T23:23:29.674 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:29.674 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:23:29.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.677+0000 7f42d7200640 1 -- 172.21.15.144:0/1070871267 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f42b806bfe0 msgr2=0x7f42b806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:29.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.677+0000 7f42d7200640 1 --2- 172.21.15.144:0/1070871267 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f42b806bfe0 0x7f42b806e4a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f42d815a330 tx=0x7f42c4007b50 comp rx=0 tx=0).stop 2024-09-11T23:23:29.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.677+0000 7f42d7200640 1 -- 172.21.15.144:0/1070871267 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d806d610 msgr2=0x7f42d814c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:29.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.677+0000 7f42d7200640 1 --2- 172.21.15.144:0/1070871267 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d806d610 0x7f42d814c960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f42c800ec10 tx=0x7f42c800c520 comp rx=0 tx=0).stop 2024-09-11T23:23:29.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.677+0000 7f42d7200640 1 -- 172.21.15.144:0/1070871267 shutdown_connections 2024-09-11T23:23:29.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.677+0000 7f42d7200640 1 --2- 172.21.15.144:0/1070871267 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f42b806bfe0 0x7f42b806e4a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:29.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.677+0000 7f42d7200640 1 --2- 172.21.15.144:0/1070871267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42d815e6c0 0x7f42d80cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:29.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.677+0000 7f42d7200640 1 --2- 172.21.15.144:0/1070871267 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42d80cf510 0x7f42d80cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:29.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.677+0000 7f42d7200640 1 --2- 172.21.15.144:0/1070871267 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d806d610 0x7f42d814c960 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:29.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.677+0000 7f42d7200640 1 -- 172.21.15.144:0/1070871267 >> 172.21.15.144:0/1070871267 conn(0x7f42d80d4720 msgr2=0x7f42d80b5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:29.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.677+0000 7f42d7200640 1 -- 172.21.15.144:0/1070871267 shutdown_connections 2024-09-11T23:23:29.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.677+0000 7f42d7200640 1 -- 172.21.15.144:0/1070871267 wait complete. 2024-09-11T23:23:29.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:29.696 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol_clone9810/.meta) 2024-09-11T23:23:29.756 INFO:teuthology.orchestra.run.smithi144.stdout:[GLOBAL] 2024-09-11T23:23:29.757 INFO:teuthology.orchestra.run.smithi144.stdout:version = 2 2024-09-11T23:23:29.757 INFO:teuthology.orchestra.run.smithi144.stdout:type = clone 2024-09-11T23:23:29.757 INFO:teuthology.orchestra.run.smithi144.stdout:path = /volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79 2024-09-11T23:23:29.757 INFO:teuthology.orchestra.run.smithi144.stdout:state = complete 2024-09-11T23:23:29.757 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:29.760 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol38500 2024-09-11T23:23:29.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.916+0000 7f3e77400640 1 Processor -- start 2024-09-11T23:23:29.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.917+0000 7f3e77400640 1 -- start start 2024-09-11T23:23:29.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.918+0000 7f3e77400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3e70158e50 0x7f3e700b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:29.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.918+0000 7f3e77400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e7006f130 0x7f3e700ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:29.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.918+0000 7f3e77400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e7015c800 con 0x7f3e7015c370 2024-09-11T23:23:29.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.918+0000 7f3e77400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3e700b43f0 con 0x7f3e7006f130 2024-09-11T23:23:29.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.918+0000 7f3e77400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3e700b3630 con 0x7f3e70158e50 2024-09-11T23:23:29.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.918+0000 7f3e75400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e7006f130 0x7f3e700ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:29.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.918+0000 7f3e67e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3e7015c370 0x7f3e7006ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60200/0 (socket says 172.21.15.144:60200) 2024-09-11T23:23:29.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.918+0000 7f3e67e00640 1 -- 172.21.15.144:0/206847168 learned_addr learned my addr 172.21.15.144:0/206847168 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:29.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.918+0000 7f3e74a00640 1 --2- 172.21.15.144:0/206847168 >> v2:172.21.15.165:3300/0 conn(0x7f3e70158e50 0x7f3e700b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:29.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.919+0000 7f3e75400640 1 -- 172.21.15.144:0/206847168 >> v2:172.21.15.165:3300/0 conn(0x7f3e70158e50 msgr2=0x7f3e700b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:29.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.919+0000 7f3e75400640 1 --2- 172.21.15.144:0/206847168 >> v2:172.21.15.165:3300/0 conn(0x7f3e70158e50 0x7f3e700b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:29.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.919+0000 7f3e75400640 1 -- 172.21.15.144:0/206847168 >> v1:172.21.15.144:6789/0 conn(0x7f3e7015c370 legacy=0x7f3e7006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:29.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.919+0000 7f3e75400640 1 -- 172.21.15.144:0/206847168 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e700b3910 con 0x7f3e7006f130 2024-09-11T23:23:29.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.920+0000 7f3e75400640 1 --2- 172.21.15.144:0/206847168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e7006f130 0x7f3e700ce200 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f3e70069580 tx=0x7f3e6802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2224637e7d6f2463 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:29.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.920+0000 7f3e6fe00640 1 -- 172.21.15.144:0/206847168 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e68007740 con 0x7f3e7006f130 2024-09-11T23:23:29.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.920+0000 7f3e6fe00640 1 -- 172.21.15.144:0/206847168 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e680078e0 con 0x7f3e7006f130 2024-09-11T23:23:29.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.920+0000 7f3e6fe00640 1 -- 172.21.15.144:0/206847168 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e68007cb0 con 0x7f3e7006f130 2024-09-11T23:23:29.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.921+0000 7f3e77400640 1 -- 172.21.15.144:0/206847168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e7006f130 msgr2=0x7f3e700ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:29.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.921+0000 7f3e77400640 1 --2- 172.21.15.144:0/206847168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e7006f130 0x7f3e700ce200 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f3e70069580 tx=0x7f3e6802a5f0 comp rx=0 tx=0).stop 2024-09-11T23:23:29.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.921+0000 7f3e77400640 1 -- 172.21.15.144:0/206847168 shutdown_connections 2024-09-11T23:23:29.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.921+0000 7f3e77400640 1 --2- 172.21.15.144:0/206847168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e7006f130 0x7f3e700ce200 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:29.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.921+0000 7f3e77400640 1 --2- 172.21.15.144:0/206847168 >> v2:172.21.15.165:3300/0 conn(0x7f3e70158e50 0x7f3e700b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:29.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.921+0000 7f3e77400640 1 -- 172.21.15.144:0/206847168 >> 172.21.15.144:0/206847168 conn(0x7f3e7006bba0 msgr2=0x7f3e7006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:29.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.921+0000 7f3e77400640 1 -- 172.21.15.144:0/206847168 shutdown_connections 2024-09-11T23:23:29.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.921+0000 7f3e77400640 1 -- 172.21.15.144:0/206847168 wait complete. 2024-09-11T23:23:29.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.922+0000 7f3e77400640 1 Processor -- start 2024-09-11T23:23:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.922+0000 7f3e77400640 1 -- start start 2024-09-11T23:23:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.923+0000 7f3e77400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e7006f130 0x7f3e70150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.923+0000 7f3e77400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e70158e50 0x7f3e70071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.923+0000 7f3e77400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e7015c370 0x7f3e701f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.923+0000 7f3e77400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3e70159230 con 0x7f3e7015c370 2024-09-11T23:23:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.923+0000 7f3e77400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3e700b3ed0 con 0x7f3e70158e50 2024-09-11T23:23:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.923+0000 7f3e77400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3e700ce740 con 0x7f3e7006f130 2024-09-11T23:23:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.924+0000 7f3e75400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e7015c370 0x7f3e701f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.924+0000 7f3e75400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e7015c370 0x7f3e701f5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40436/0 (socket says 172.21.15.144:40436) 2024-09-11T23:23:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.924+0000 7f3e75400640 1 -- 172.21.15.144:0/2868859415 learned_addr learned my addr 172.21.15.144:0/2868859415 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:29.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.924+0000 7f3e67e00640 1 --2- 172.21.15.144:0/2868859415 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e70158e50 0x7f3e70071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:29.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.924+0000 7f3e74a00640 1 --2- 172.21.15.144:0/2868859415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e7006f130 0x7f3e70150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:29.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.924+0000 7f3e75400640 1 -- 172.21.15.144:0/2868859415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e7006f130 msgr2=0x7f3e70150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:29.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.924+0000 7f3e75400640 1 --2- 172.21.15.144:0/2868859415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e7006f130 0x7f3e70150320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:29.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.924+0000 7f3e75400640 1 -- 172.21.15.144:0/2868859415 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e70158e50 msgr2=0x7f3e70071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:29.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.924+0000 7f3e75400640 1 --2- 172.21.15.144:0/2868859415 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e70158e50 0x7f3e70071f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:29.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.924+0000 7f3e75400640 1 -- 172.21.15.144:0/2868859415 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e70157330 con 0x7f3e7015c370 2024-09-11T23:23:29.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.924+0000 7f3e75400640 1 --2- 172.21.15.144:0/2868859415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e7015c370 0x7f3e701f5f60 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009e50 tx=0x7f3e68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:29.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.925+0000 7f3e6d600640 1 -- 172.21.15.144:0/2868859415 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e68040070 con 0x7f3e7015c370 2024-09-11T23:23:29.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.925+0000 7f3e6d600640 1 -- 172.21.15.144:0/2868859415 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e68031bf0 con 0x7f3e7015c370 2024-09-11T23:23:29.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.925+0000 7f3e6d600640 1 -- 172.21.15.144:0/2868859415 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e68009450 con 0x7f3e7015c370 2024-09-11T23:23:29.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.925+0000 7f3e77400640 1 -- 172.21.15.144:0/2868859415 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e70154f00 con 0x7f3e7015c370 2024-09-11T23:23:29.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.925+0000 7f3e77400640 1 -- 172.21.15.144:0/2868859415 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e701578b0 con 0x7f3e7015c370 2024-09-11T23:23:29.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.926+0000 7f3e77400640 1 -- 172.21.15.144:0/2868859415 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e700ce200 con 0x7f3e7015c370 2024-09-11T23:23:29.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.927+0000 7f3e6d600640 1 -- 172.21.15.144:0/2868859415 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 90753+0+0 (secure 0 0 0) 0x7f3e68039040 con 0x7f3e7015c370 2024-09-11T23:23:29.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.927+0000 7f3e6d600640 1 --2- 172.21.15.144:0/2868859415 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e4c06c130 0x7f3e4c06e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:29.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.928+0000 7f3e6d600640 1 -- 172.21.15.144:0/2868859415 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f3e680acb10 con 0x7f3e7015c370 2024-09-11T23:23:29.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.928+0000 7f3e74a00640 1 --2- 172.21.15.144:0/2868859415 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e4c06c130 0x7f3e4c06e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:29.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.929+0000 7f3e74a00640 1 --2- 172.21.15.144:0/2868859415 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e4c06c130 0x7f3e4c06e5f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3e70166250 tx=0x7f3e60009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:29.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:29.932+0000 7f3e6d600640 1 -- 172.21.15.144:0/2868859415 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e6807ab40 con 0x7f3e7015c370 2024-09-11T23:23:30.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.132+0000 7f3e77400640 1 -- 172.21.15.144:0/2868859415 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol38500", "target": ["mon-mgr", ""]}) -- 0x7f3e700afd70 con 0x7f3e4c06c130 2024-09-11T23:23:30.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.150+0000 7f3e6d600640 1 -- 172.21.15.144:0/2868859415 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7f3e700afd70 con 0x7f3e4c06c130 2024-09-11T23:23:30.150 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee 2024-09-11T23:23:30.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.152+0000 7f3e77400640 1 -- 172.21.15.144:0/2868859415 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e4c06c130 msgr2=0x7f3e4c06e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:30.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.152+0000 7f3e77400640 1 --2- 172.21.15.144:0/2868859415 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e4c06c130 0x7f3e4c06e5f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3e70166250 tx=0x7f3e60009190 comp rx=0 tx=0).stop 2024-09-11T23:23:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.152+0000 7f3e77400640 1 -- 172.21.15.144:0/2868859415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e7015c370 msgr2=0x7f3e701f5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.152+0000 7f3e77400640 1 --2- 172.21.15.144:0/2868859415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e7015c370 0x7f3e701f5f60 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009e50 tx=0x7f3e68004a40 comp rx=0 tx=0).stop 2024-09-11T23:23:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.152+0000 7f3e77400640 1 -- 172.21.15.144:0/2868859415 shutdown_connections 2024-09-11T23:23:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.152+0000 7f3e77400640 1 --2- 172.21.15.144:0/2868859415 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e4c06c130 0x7f3e4c06e5f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.152+0000 7f3e77400640 1 --2- 172.21.15.144:0/2868859415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e7015c370 0x7f3e701f5f60 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.152+0000 7f3e77400640 1 --2- 172.21.15.144:0/2868859415 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e70158e50 0x7f3e70071f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.152+0000 7f3e77400640 1 --2- 172.21.15.144:0/2868859415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e7006f130 0x7f3e70150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.152+0000 7f3e77400640 1 -- 172.21.15.144:0/2868859415 >> 172.21.15.144:0/2868859415 conn(0x7f3e7006bba0 msgr2=0x7f3e700b0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.152+0000 7f3e77400640 1 -- 172.21.15.144:0/2868859415 shutdown_connections 2024-09-11T23:23:30.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.152+0000 7f3e77400640 1 -- 172.21.15.144:0/2868859415 wait complete. 2024-09-11T23:23:30.168 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol_clone9810 2024-09-11T23:23:30.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.325+0000 7f8e03000640 1 Processor -- start 2024-09-11T23:23:30.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.325+0000 7f8e03000640 1 -- start start 2024-09-11T23:23:30.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.326+0000 7f8e03000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8dfc0cdfc0 0x7f8dfc06bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:30.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.326+0000 7f8e03000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dfc0ce430 con 0x7f8dfc06c0e0 2024-09-11T23:23:30.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.326+0000 7f8e03000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dfc0cfd20 con 0x7f8dfc159dd0 2024-09-11T23:23:30.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.326+0000 7f8e03000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8dfc06c520 con 0x7f8dfc0cdfc0 2024-09-11T23:23:30.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.326+0000 7f8e01200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8dfc0cdfc0 0x7f8dfc06bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:30.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.326+0000 7f8e02600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8dfc06c0e0 0x7f8dfc15d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60210/0 (socket says 172.21.15.144:60210) 2024-09-11T23:23:30.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.326+0000 7f8e02600640 1 -- 172.21.15.144:0/3270630621 learned_addr learned my addr 172.21.15.144:0/3270630621 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:30.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.327+0000 7f8e01200640 1 -- 172.21.15.144:0/3270630621 >> v1:172.21.15.165:6789/0 conn(0x7f8dfc159dd0 legacy=0x7f8dfc0cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:30.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.327+0000 7f8e01200640 1 -- 172.21.15.144:0/3270630621 >> v1:172.21.15.144:6789/0 conn(0x7f8dfc06c0e0 legacy=0x7f8dfc15d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:30.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.327+0000 7f8e01200640 1 -- 172.21.15.144:0/3270630621 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dfc0cd4e0 con 0x7f8dfc0cdfc0 2024-09-11T23:23:30.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.328+0000 7f8e01200640 1 --2- 172.21.15.144:0/3270630621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dfc0cdfc0 0x7f8dfc06bba0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8de80097a0 tx=0x7f8de802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fcf0c35a51a927c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:30.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.328+0000 7f8dfbe00640 1 -- 172.21.15.144:0/3270630621 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de8037070 con 0x7f8dfc0cdfc0 2024-09-11T23:23:30.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.328+0000 7f8dfbe00640 1 -- 172.21.15.144:0/3270630621 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8de8032440 con 0x7f8dfc0cdfc0 2024-09-11T23:23:30.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.328+0000 7f8dfbe00640 1 -- 172.21.15.144:0/3270630621 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de8032810 con 0x7f8dfc0cdfc0 2024-09-11T23:23:30.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.329+0000 7f8e03000640 1 -- 172.21.15.144:0/3270630621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dfc0cdfc0 msgr2=0x7f8dfc06bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:30.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.329+0000 7f8e03000640 1 --2- 172.21.15.144:0/3270630621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dfc0cdfc0 0x7f8dfc06bba0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8de80097a0 tx=0x7f8de802a230 comp rx=0 tx=0).stop 2024-09-11T23:23:30.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.329+0000 7f8e03000640 1 -- 172.21.15.144:0/3270630621 shutdown_connections 2024-09-11T23:23:30.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.329+0000 7f8e03000640 1 --2- 172.21.15.144:0/3270630621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dfc0cdfc0 0x7f8dfc06bba0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:30.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.329+0000 7f8e03000640 1 -- 172.21.15.144:0/3270630621 >> 172.21.15.144:0/3270630621 conn(0x7f8dfc0d0300 msgr2=0x7f8dfc0d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:30.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.329+0000 7f8e03000640 1 -- 172.21.15.144:0/3270630621 shutdown_connections 2024-09-11T23:23:30.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.329+0000 7f8e03000640 1 -- 172.21.15.144:0/3270630621 wait complete. 2024-09-11T23:23:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.330+0000 7f8e03000640 1 Processor -- start 2024-09-11T23:23:30.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.330+0000 7f8e03000640 1 -- start start 2024-09-11T23:23:30.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.331+0000 7f8e03000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dfc06c0e0 0x7f8dfc1f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:30.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.331+0000 7f8e03000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dfc0cdfc0 0x7f8dfc1f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:30.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.331+0000 7f8e03000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dfc159dd0 0x7f8dfc143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:30.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.331+0000 7f8e03000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc15a1b0 con 0x7f8dfc06c0e0 2024-09-11T23:23:30.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.331+0000 7f8e03000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc0cdaa0 con 0x7f8dfc0cdfc0 2024-09-11T23:23:30.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.331+0000 7f8e03000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8dfc15d6d0 con 0x7f8dfc159dd0 2024-09-11T23:23:30.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.332+0000 7f8e01c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dfc06c0e0 0x7f8dfc1f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:30.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.332+0000 7f8e01c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dfc06c0e0 0x7f8dfc1f2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40464/0 (socket says 172.21.15.144:40464) 2024-09-11T23:23:30.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.332+0000 7f8e01c00640 1 -- 172.21.15.144:0/3924669776 learned_addr learned my addr 172.21.15.144:0/3924669776 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:30.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.332+0000 7f8e01200640 1 --2- 172.21.15.144:0/3924669776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dfc0cdfc0 0x7f8dfc1f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:30.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.332+0000 7f8e02600640 1 --2- 172.21.15.144:0/3924669776 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dfc159dd0 0x7f8dfc143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:30.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.332+0000 7f8e01c00640 1 -- 172.21.15.144:0/3924669776 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dfc159dd0 msgr2=0x7f8dfc143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:30.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.332+0000 7f8e01c00640 1 --2- 172.21.15.144:0/3924669776 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dfc159dd0 0x7f8dfc143de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:30.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.332+0000 7f8e01c00640 1 -- 172.21.15.144:0/3924669776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dfc0cdfc0 msgr2=0x7f8dfc1f5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:30.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.332+0000 7f8e01c00640 1 --2- 172.21.15.144:0/3924669776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dfc0cdfc0 0x7f8dfc1f5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:30.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.332+0000 7f8e01c00640 1 -- 172.21.15.144:0/3924669776 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dfc1f5500 con 0x7f8dfc06c0e0 2024-09-11T23:23:30.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.332+0000 7f8e02600640 1 --2- 172.21.15.144:0/3924669776 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dfc159dd0 0x7f8dfc143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:23:30.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.332+0000 7f8e01c00640 1 --2- 172.21.15.144:0/3924669776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dfc06c0e0 0x7f8dfc1f2830 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8df000c3c0 tx=0x7f8df000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:30.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.333+0000 7f8df9600640 1 -- 172.21.15.144:0/3924669776 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df00052d0 con 0x7f8dfc06c0e0 2024-09-11T23:23:30.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.333+0000 7f8df9600640 1 -- 172.21.15.144:0/3924669776 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8df0005490 con 0x7f8dfc06c0e0 2024-09-11T23:23:30.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.333+0000 7f8df9600640 1 -- 172.21.15.144:0/3924669776 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df0007260 con 0x7f8dfc06c0e0 2024-09-11T23:23:30.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.333+0000 7f8e03000640 1 -- 172.21.15.144:0/3924669776 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dfc1e5710 con 0x7f8dfc06c0e0 2024-09-11T23:23:30.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.333+0000 7f8e03000640 1 -- 172.21.15.144:0/3924669776 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dfc1f57c0 con 0x7f8dfc06c0e0 2024-09-11T23:23:30.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.334+0000 7f8e03000640 1 -- 172.21.15.144:0/3924669776 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dfc06bba0 con 0x7f8dfc06c0e0 2024-09-11T23:23:30.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.335+0000 7f8df9600640 1 -- 172.21.15.144:0/3924669776 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 90753+0+0 (secure 0 0 0) 0x7f8df0007400 con 0x7f8dfc06c0e0 2024-09-11T23:23:30.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.336+0000 7f8df9600640 1 --2- 172.21.15.144:0/3924669776 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8ddc06c100 0x7f8ddc06e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:30.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.336+0000 7f8df9600640 1 -- 172.21.15.144:0/3924669776 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f8df008a760 con 0x7f8dfc06c0e0 2024-09-11T23:23:30.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.336+0000 7f8e01200640 1 --2- 172.21.15.144:0/3924669776 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8ddc06c100 0x7f8ddc06e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:30.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.337+0000 7f8e01200640 1 --2- 172.21.15.144:0/3924669776 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8ddc06c100 0x7f8ddc06e5c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8de8034000 tx=0x7f8de802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:30.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.340+0000 7f8df9600640 1 -- 172.21.15.144:0/3924669776 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8df0058dd0 con 0x7f8dfc06c0e0 2024-09-11T23:23:30.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.541+0000 7f8e03000640 1 -- 172.21.15.144:0/3924669776 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol_clone9810", "target": ["mon-mgr", ""]}) -- 0x7f8dfc1e54c0 con 0x7f8ddc06c100 2024-09-11T23:23:30.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.548+0000 7f8df9600640 1 -- 172.21.15.144:0/3924669776 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+72 (secure 0 0 0) 0x7f8dfc1e54c0 con 0x7f8ddc06c100 2024-09-11T23:23:30.548 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79 2024-09-11T23:23:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.550+0000 7f8e03000640 1 -- 172.21.15.144:0/3924669776 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8ddc06c100 msgr2=0x7f8ddc06e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.551+0000 7f8e03000640 1 --2- 172.21.15.144:0/3924669776 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8ddc06c100 0x7f8ddc06e5c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8de8034000 tx=0x7f8de802e000 comp rx=0 tx=0).stop 2024-09-11T23:23:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.551+0000 7f8e03000640 1 -- 172.21.15.144:0/3924669776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dfc06c0e0 msgr2=0x7f8dfc1f2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.551+0000 7f8e03000640 1 --2- 172.21.15.144:0/3924669776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dfc06c0e0 0x7f8dfc1f2830 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8df000c3c0 tx=0x7f8df000c880 comp rx=0 tx=0).stop 2024-09-11T23:23:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.551+0000 7f8e03000640 1 -- 172.21.15.144:0/3924669776 shutdown_connections 2024-09-11T23:23:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.551+0000 7f8e03000640 1 --2- 172.21.15.144:0/3924669776 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8ddc06c100 0x7f8ddc06e5c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.551+0000 7f8e03000640 1 --2- 172.21.15.144:0/3924669776 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8dfc159dd0 0x7f8dfc143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.551+0000 7f8e03000640 1 --2- 172.21.15.144:0/3924669776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8dfc0cdfc0 0x7f8dfc1f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.551+0000 7f8e03000640 1 --2- 172.21.15.144:0/3924669776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dfc06c0e0 0x7f8dfc1f2830 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.551+0000 7f8e03000640 1 -- 172.21.15.144:0/3924669776 >> 172.21.15.144:0/3924669776 conn(0x7f8dfc0d0300 msgr2=0x7f8dfc15d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:30.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.551+0000 7f8e03000640 1 -- 172.21.15.144:0/3924669776 shutdown_connections 2024-09-11T23:23:30.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.551+0000 7f8e03000640 1 -- 172.21.15.144:0/3924669776 wait complete. 2024-09-11T23:23:30.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:30.567 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730) 2024-09-11T23:23:30.608 INFO:teuthology.orchestra.run.smithi144.stdout:9 2024-09-11T23:23:30.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:30.609 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79) 2024-09-11T23:23:30.686 INFO:teuthology.orchestra.run.smithi144.stdout:9 2024-09-11T23:23:30.686 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvol_clone9810 2024-09-11T23:23:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.881+0000 7fd8a3e00640 1 Processor -- start 2024-09-11T23:23:30.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.881+0000 7fd8a3e00640 1 -- start start 2024-09-11T23:23:30.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.882+0000 7fd8a3e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8a40cc6e0 0x7fd8a40cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:30.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.882+0000 7fd8a3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd8a4070eb0 0x7fd8a4071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:30.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.882+0000 7fd8a3e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8a40cdea0 con 0x7fd8a406bba0 2024-09-11T23:23:30.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.882+0000 7fd8a3e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd8a40ce180 con 0x7fd8a4070eb0 2024-09-11T23:23:30.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.882+0000 7fd8a3e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd8a40ce460 con 0x7fd8a40cc6e0 2024-09-11T23:23:30.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.882+0000 7fd8a3400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd8a4070eb0 0x7fd8a4071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:30.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.883+0000 7fd8a3400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd8a4070eb0 0x7fd8a4071340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40476/0 (socket says 172.21.15.144:40476) 2024-09-11T23:23:30.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.883+0000 7fd8a3400640 1 -- 172.21.15.144:0/771002786 learned_addr learned my addr 172.21.15.144:0/771002786 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:30.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.883+0000 7fd8a2000640 1 --2- 172.21.15.144:0/771002786 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8a40cc6e0 0x7fd8a40cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.883+0000 7fd8a3400640 1 -- 172.21.15.144:0/771002786 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8a40cc6e0 msgr2=0x7fd8a40cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.883+0000 7fd8a3400640 1 --2- 172.21.15.144:0/771002786 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8a40cc6e0 0x7fd8a40cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.883+0000 7fd8a3400640 1 -- 172.21.15.144:0/771002786 >> v1:172.21.15.165:6789/0 conn(0x7fd8a406bba0 legacy=0x7fd8a406bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.883+0000 7fd8a3400640 1 -- 172.21.15.144:0/771002786 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a40ce740 con 0x7fd8a4070eb0 2024-09-11T23:23:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.883+0000 7fd8a2000640 1 --2- 172.21.15.144:0/771002786 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8a40cc6e0 0x7fd8a40cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:23:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.884+0000 7fd8a3400640 1 --2- 172.21.15.144:0/771002786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a4070eb0 0x7fd8a4071340 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009e50 tx=0x7fd89c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd5949c4acb67c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.884+0000 7fd8a1600640 1 -- 172.21.15.144:0/771002786 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c036070 con 0x7fd8a4070eb0 2024-09-11T23:23:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.884+0000 7fd8a1600640 1 -- 172.21.15.144:0/771002786 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd89c031600 con 0x7fd8a4070eb0 2024-09-11T23:23:30.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.884+0000 7fd8a1600640 1 -- 172.21.15.144:0/771002786 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c0319d0 con 0x7fd8a4070eb0 2024-09-11T23:23:30.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.885+0000 7fd8a3e00640 1 -- 172.21.15.144:0/771002786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a4070eb0 msgr2=0x7fd8a4071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:30.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.885+0000 7fd8a3e00640 1 --2- 172.21.15.144:0/771002786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a4070eb0 0x7fd8a4071340 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009e50 tx=0x7fd89c02a7a0 comp rx=0 tx=0).stop 2024-09-11T23:23:30.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.885+0000 7fd8a3e00640 1 -- 172.21.15.144:0/771002786 shutdown_connections 2024-09-11T23:23:30.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.885+0000 7fd8a3e00640 1 --2- 172.21.15.144:0/771002786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a4070eb0 0x7fd8a4071340 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:30.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.885+0000 7fd8a3e00640 1 --2- 172.21.15.144:0/771002786 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8a40cc6e0 0x7fd8a40cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:30.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.885+0000 7fd8a3e00640 1 -- 172.21.15.144:0/771002786 >> 172.21.15.144:0/771002786 conn(0x7fd8a40d0300 msgr2=0x7fd8a40d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:30.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.885+0000 7fd8a3e00640 1 -- 172.21.15.144:0/771002786 shutdown_connections 2024-09-11T23:23:30.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.885+0000 7fd8a3e00640 1 -- 172.21.15.144:0/771002786 wait complete. 2024-09-11T23:23:30.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.886+0000 7fd8a3e00640 1 Processor -- start 2024-09-11T23:23:30.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.887+0000 7fd8a3e00640 1 -- start start 2024-09-11T23:23:30.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.887+0000 7fd8a3e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8a406bba0 0x7fd8a40b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:30.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.887+0000 7fd8a3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a4070eb0 0x7fd8a41e8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:30.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.887+0000 7fd8a3e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8a40cc6e0 0x7fd8a41e6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:30.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.887+0000 7fd8a3e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a40cdc30 con 0x7fd8a4070eb0 2024-09-11T23:23:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.887+0000 7fd8a3e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a40cdab0 con 0x7fd8a40cc6e0 2024-09-11T23:23:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.887+0000 7fd8a3e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd8a415b410 con 0x7fd8a406bba0 2024-09-11T23:23:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.888+0000 7fd8a2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a4070eb0 0x7fd8a41e8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.888+0000 7fd8a2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a4070eb0 0x7fd8a41e8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40486/0 (socket says 172.21.15.144:40486) 2024-09-11T23:23:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.888+0000 7fd8a2000640 1 -- 172.21.15.144:0/37769104 learned_addr learned my addr 172.21.15.144:0/37769104 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.888+0000 7fd8a2a00640 1 --2- 172.21.15.144:0/37769104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8a406bba0 0x7fd8a40b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.888+0000 7fd8a3400640 1 --2- 172.21.15.144:0/37769104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8a40cc6e0 0x7fd8a41e6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.888+0000 7fd8a2000640 1 -- 172.21.15.144:0/37769104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8a406bba0 msgr2=0x7fd8a40b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.888+0000 7fd8a2000640 1 --2- 172.21.15.144:0/37769104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8a406bba0 0x7fd8a40b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.888+0000 7fd8a2000640 1 -- 172.21.15.144:0/37769104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8a40cc6e0 msgr2=0x7fd8a41e6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.888+0000 7fd8a2000640 1 --2- 172.21.15.144:0/37769104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8a40cc6e0 0x7fd8a41e6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.888+0000 7fd8a2000640 1 -- 172.21.15.144:0/37769104 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a41e7d90 con 0x7fd8a4070eb0 2024-09-11T23:23:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.888+0000 7fd8a2000640 1 --2- 172.21.15.144:0/37769104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a4070eb0 0x7fd8a41e8e30 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fd89000d7d0 tx=0x7fd89000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:30.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.889+0000 7fd89aa00640 1 -- 172.21.15.144:0/37769104 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd890004030 con 0x7fd8a4070eb0 2024-09-11T23:23:30.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.889+0000 7fd89aa00640 1 -- 172.21.15.144:0/37769104 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8900041d0 con 0x7fd8a4070eb0 2024-09-11T23:23:30.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.889+0000 7fd89aa00640 1 -- 172.21.15.144:0/37769104 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89000b660 con 0x7fd8a4070eb0 2024-09-11T23:23:30.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.889+0000 7fd8a3e00640 1 -- 172.21.15.144:0/37769104 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a41e8070 con 0x7fd8a4070eb0 2024-09-11T23:23:30.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.889+0000 7fd8a3e00640 1 -- 172.21.15.144:0/37769104 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a41e8630 con 0x7fd8a4070eb0 2024-09-11T23:23:30.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.890+0000 7fd8a3e00640 1 -- 172.21.15.144:0/37769104 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8a40cd570 con 0x7fd8a4070eb0 2024-09-11T23:23:30.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.891+0000 7fd89aa00640 1 -- 172.21.15.144:0/37769104 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 90753+0+0 (secure 0 0 0) 0x7fd89000b800 con 0x7fd8a4070eb0 2024-09-11T23:23:30.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.891+0000 7fd89aa00640 1 --2- 172.21.15.144:0/37769104 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd88406c100 0x7fd88406e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:30.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.892+0000 7fd89aa00640 1 -- 172.21.15.144:0/37769104 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7fd89008b440 con 0x7fd8a4070eb0 2024-09-11T23:23:30.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.892+0000 7fd8a2a00640 1 --2- 172.21.15.144:0/37769104 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd88406c100 0x7fd88406e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:30.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.893+0000 7fd8a2a00640 1 --2- 172.21.15.144:0/37769104 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd88406c100 0x7fd88406e5c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd894001780 tx=0x7fd894009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:30.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:30.896+0000 7fd89aa00640 1 -- 172.21.15.144:0/37769104 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd8900593d0 con 0x7fd8a4070eb0 2024-09-11T23:23:31.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:31.098+0000 7fd8a3e00640 1 -- 172.21.15.144:0/37769104 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvol_clone9810", "target": ["mon-mgr", ""]}) -- 0x7fd8a4074250 con 0x7fd88406c100 2024-09-11T23:23:31.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:31.109+0000 7fd89aa00640 1 -- 172.21.15.144:0/37769104 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+724 (secure 0 0 0) 0x7fd8a4074250 con 0x7fd88406c100 2024-09-11T23:23:31.109 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:23:31.109 INFO:teuthology.orchestra.run.smithi144.stdout: "atime": "2024-09-11 23:23:20", 2024-09-11T23:23:31.109 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_pcent": "80.00", 2024-09-11T23:23:31.109 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_quota": 10485760, 2024-09-11T23:23:31.109 INFO:teuthology.orchestra.run.smithi144.stdout: "bytes_used": 8388608, 2024-09-11T23:23:31.109 INFO:teuthology.orchestra.run.smithi144.stdout: "created_at": "2024-09-11 23:23:25", 2024-09-11T23:23:31.109 INFO:teuthology.orchestra.run.smithi144.stdout: "ctime": "2024-09-11 23:23:25", 2024-09-11T23:23:31.109 INFO:teuthology.orchestra.run.smithi144.stdout: "data_pool": "cephfs_data", 2024-09-11T23:23:31.109 INFO:teuthology.orchestra.run.smithi144.stdout: "features": [ 2024-09-11T23:23:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: "snapshot-clone", 2024-09-11T23:23:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: "snapshot-autoprotect", 2024-09-11T23:23:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: "snapshot-retention" 2024-09-11T23:23:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:23:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: "flavor": 2, 2024-09-11T23:23:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: "gid": 1000, 2024-09-11T23:23:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: "mode": 16895, 2024-09-11T23:23:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: "mon_addrs": [ 2024-09-11T23:23:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: "172.21.15.144:6789", 2024-09-11T23:23:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: "172.21.15.165:6789", 2024-09-11T23:23:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: "172.21.15.165:6790" 2024-09-11T23:23:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-09-11T23:23:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: "mtime": "2024-09-11 23:23:24", 2024-09-11T23:23:31.110 INFO:teuthology.orchestra.run.smithi144.stdout: "path": "/volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79", 2024-09-11T23:23:31.111 INFO:teuthology.orchestra.run.smithi144.stdout: "pool_namespace": "", 2024-09-11T23:23:31.111 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "complete", 2024-09-11T23:23:31.111 INFO:teuthology.orchestra.run.smithi144.stdout: "type": "clone", 2024-09-11T23:23:31.111 INFO:teuthology.orchestra.run.smithi144.stdout: "uid": 1000 2024-09-11T23:23:31.111 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:23:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:31.111+0000 7fd8a3e00640 1 -- 172.21.15.144:0/37769104 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd88406c100 msgr2=0x7fd88406e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:31.111+0000 7fd8a3e00640 1 --2- 172.21.15.144:0/37769104 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd88406c100 0x7fd88406e5c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd894001780 tx=0x7fd894009040 comp rx=0 tx=0).stop 2024-09-11T23:23:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:31.111+0000 7fd8a3e00640 1 -- 172.21.15.144:0/37769104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a4070eb0 msgr2=0x7fd8a41e8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:31.111+0000 7fd8a3e00640 1 --2- 172.21.15.144:0/37769104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a4070eb0 0x7fd8a41e8e30 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fd89000d7d0 tx=0x7fd89000dc90 comp rx=0 tx=0).stop 2024-09-11T23:23:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:31.111+0000 7fd8a3e00640 1 -- 172.21.15.144:0/37769104 shutdown_connections 2024-09-11T23:23:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:31.111+0000 7fd8a3e00640 1 --2- 172.21.15.144:0/37769104 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd88406c100 0x7fd88406e5c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:31.111+0000 7fd8a3e00640 1 --2- 172.21.15.144:0/37769104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd8a40cc6e0 0x7fd8a41e6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:31.111+0000 7fd8a3e00640 1 --2- 172.21.15.144:0/37769104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd8a4070eb0 0x7fd8a41e8e30 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:31.111+0000 7fd8a3e00640 1 --2- 172.21.15.144:0/37769104 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd8a406bba0 0x7fd8a40b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:31.112+0000 7fd8a3e00640 1 -- 172.21.15.144:0/37769104 >> 172.21.15.144:0/37769104 conn(0x7fd8a40d0300 msgr2=0x7fd8a406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:31.112+0000 7fd8a3e00640 1 -- 172.21.15.144:0/37769104 shutdown_connections 2024-09-11T23:23:31.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:31.112+0000 7fd8a3e00640 1 -- 172.21.15.144:0/37769104 wait complete. 2024-09-11T23:23:31.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:31.127 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730) 2024-09-11T23:23:31.163 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:23:31.163 INFO:teuthology.orchestra.run.smithi144.stderr:volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730: ceph.quota.max_bytes: No such attribute 2024-09-11T23:23:31.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:31.163 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730) 2024-09-11T23:23:31.240 INFO:teuthology.orchestra.run.smithi144.stdout:cephfs_data 2024-09-11T23:23:31.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:31.241 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool_namespace volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730) 2024-09-11T23:23:31.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:31.317 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec find volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730) 2024-09-11T23:23:31.396 INFO:teuthology.orchestra.run.smithi144.stdout:volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730 2024-09-11T23:23:31.396 INFO:teuthology.orchestra.run.smithi144.stdout:volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.2 2024-09-11T23:23:31.396 INFO:teuthology.orchestra.run.smithi144.stdout:volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.5 2024-09-11T23:23:31.396 INFO:teuthology.orchestra.run.smithi144.stdout:volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.4 2024-09-11T23:23:31.396 INFO:teuthology.orchestra.run.smithi144.stdout:volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.7 2024-09-11T23:23:31.396 INFO:teuthology.orchestra.run.smithi144.stdout:volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.6 2024-09-11T23:23:31.396 INFO:teuthology.orchestra.run.smithi144.stdout:volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.0 2024-09-11T23:23:31.397 INFO:teuthology.orchestra.run.smithi144.stdout:volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.3 2024-09-11T23:23:31.397 INFO:teuthology.orchestra.run.smithi144.stdout:volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.1 2024-09-11T23:23:31.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:31.398 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730) 2024-09-11T23:23:31.473 INFO:teuthology.orchestra.run.smithi144.stdout:41ff 2024-09-11T23:23:31.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:31.474 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/) 2024-09-11T23:23:31.550 INFO:teuthology.orchestra.run.smithi144.stdout:41ff 2024-09-11T23:23:31.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:31.551 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730) 2024-09-11T23:23:31.629 INFO:teuthology.orchestra.run.smithi144.stdout:1000 2024-09-11T23:23:31.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:31.630 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/) 2024-09-11T23:23:31.704 INFO:teuthology.orchestra.run.smithi144.stdout:1000 2024-09-11T23:23:31.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:31.706 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730) 2024-09-11T23:23:31.781 INFO:teuthology.orchestra.run.smithi144.stdout:1000 2024-09-11T23:23:31.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:31.783 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/) 2024-09-11T23:23:31.857 INFO:teuthology.orchestra.run.smithi144.stdout:1000 2024-09-11T23:23:31.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:31.859 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730) 2024-09-11T23:23:31.933 INFO:teuthology.orchestra.run.smithi144.stdout:1726097004 2024-09-11T23:23:31.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:31.934 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/) 2024-09-11T23:23:32.010 INFO:teuthology.orchestra.run.smithi144.stdout:1726097004 2024-09-11T23:23:32.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:32.011 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.2) 2024-09-11T23:23:32.087 INFO:teuthology.orchestra.run.smithi144.stdout:81a4 2024-09-11T23:23:32.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:32.088 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.2) 2024-09-11T23:23:32.166 INFO:teuthology.orchestra.run.smithi144.stdout:81a4 2024-09-11T23:23:32.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:32.168 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.2) 2024-09-11T23:23:32.243 INFO:teuthology.orchestra.run.smithi144.stdout:1000 2024-09-11T23:23:32.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:32.245 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.2) 2024-09-11T23:23:32.319 INFO:teuthology.orchestra.run.smithi144.stdout:1000 2024-09-11T23:23:32.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:32.320 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.2) 2024-09-11T23:23:32.397 INFO:teuthology.orchestra.run.smithi144.stdout:1333 2024-09-11T23:23:32.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:32.398 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.2) 2024-09-11T23:23:32.473 INFO:teuthology.orchestra.run.smithi144.stdout:1333 2024-09-11T23:23:32.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:32.474 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.2) 2024-09-11T23:23:32.551 INFO:teuthology.orchestra.run.smithi144.stdout:1726097003 2024-09-11T23:23:32.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:32.552 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.2) 2024-09-11T23:23:32.627 INFO:teuthology.orchestra.run.smithi144.stdout:1726097003 2024-09-11T23:23:32.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:32.628 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.5) 2024-09-11T23:23:32.705 INFO:teuthology.orchestra.run.smithi144.stdout:81a4 2024-09-11T23:23:32.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:32.706 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.5) 2024-09-11T23:23:32.782 INFO:teuthology.orchestra.run.smithi144.stdout:81a4 2024-09-11T23:23:32.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:32.783 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.5) 2024-09-11T23:23:32.859 INFO:teuthology.orchestra.run.smithi144.stdout:1000 2024-09-11T23:23:32.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:32.860 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.5) 2024-09-11T23:23:32.934 INFO:teuthology.orchestra.run.smithi144.stdout:1000 2024-09-11T23:23:32.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:32.935 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.5) 2024-09-11T23:23:33.011 INFO:teuthology.orchestra.run.smithi144.stdout:1333 2024-09-11T23:23:33.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:33.012 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.5) 2024-09-11T23:23:33.087 INFO:teuthology.orchestra.run.smithi144.stdout:1333 2024-09-11T23:23:33.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:33.089 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.5) 2024-09-11T23:23:33.166 INFO:teuthology.orchestra.run.smithi144.stdout:1726097004 2024-09-11T23:23:33.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:33.167 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.5) 2024-09-11T23:23:33.242 INFO:teuthology.orchestra.run.smithi144.stdout:1726097004 2024-09-11T23:23:33.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:33.244 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.4) 2024-09-11T23:23:33.320 INFO:teuthology.orchestra.run.smithi144.stdout:81a4 2024-09-11T23:23:33.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:33.321 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.4) 2024-09-11T23:23:33.398 INFO:teuthology.orchestra.run.smithi144.stdout:81a4 2024-09-11T23:23:33.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:33.399 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.4) 2024-09-11T23:23:33.474 INFO:teuthology.orchestra.run.smithi144.stdout:1000 2024-09-11T23:23:33.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:33.475 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.4) 2024-09-11T23:23:33.551 INFO:teuthology.orchestra.run.smithi144.stdout:1000 2024-09-11T23:23:33.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:33.553 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.4) 2024-09-11T23:23:33.628 INFO:teuthology.orchestra.run.smithi144.stdout:1333 2024-09-11T23:23:33.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:33.630 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.4) 2024-09-11T23:23:33.704 INFO:teuthology.orchestra.run.smithi144.stdout:1333 2024-09-11T23:23:33.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:33.705 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.4) 2024-09-11T23:23:33.785 INFO:teuthology.orchestra.run.smithi144.stdout:1726097004 2024-09-11T23:23:33.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:33.786 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.4) 2024-09-11T23:23:33.861 INFO:teuthology.orchestra.run.smithi144.stdout:1726097004 2024-09-11T23:23:33.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:33.863 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.7) 2024-09-11T23:23:33.939 INFO:teuthology.orchestra.run.smithi144.stdout:81a4 2024-09-11T23:23:33.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:33.940 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.7) 2024-09-11T23:23:34.017 INFO:teuthology.orchestra.run.smithi144.stdout:81a4 2024-09-11T23:23:34.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:34.018 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.7) 2024-09-11T23:23:34.092 INFO:teuthology.orchestra.run.smithi144.stdout:1000 2024-09-11T23:23:34.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:34.093 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.7) 2024-09-11T23:23:34.168 INFO:teuthology.orchestra.run.smithi144.stdout:1000 2024-09-11T23:23:34.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:34.169 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.7) 2024-09-11T23:23:34.245 INFO:teuthology.orchestra.run.smithi144.stdout:1333 2024-09-11T23:23:34.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:34.246 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.7) 2024-09-11T23:23:34.322 INFO:teuthology.orchestra.run.smithi144.stdout:1333 2024-09-11T23:23:34.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:34.323 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.7) 2024-09-11T23:23:34.402 INFO:teuthology.orchestra.run.smithi144.stdout:1726097004 2024-09-11T23:23:34.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:34.403 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.7) 2024-09-11T23:23:34.478 INFO:teuthology.orchestra.run.smithi144.stdout:1726097004 2024-09-11T23:23:34.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:34.479 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.6) 2024-09-11T23:23:34.558 INFO:teuthology.orchestra.run.smithi144.stdout:81a4 2024-09-11T23:23:34.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:34.559 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.6) 2024-09-11T23:23:34.635 INFO:teuthology.orchestra.run.smithi144.stdout:81a4 2024-09-11T23:23:34.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:34.637 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.6) 2024-09-11T23:23:34.711 INFO:teuthology.orchestra.run.smithi144.stdout:1000 2024-09-11T23:23:34.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:34.713 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.6) 2024-09-11T23:23:34.789 INFO:teuthology.orchestra.run.smithi144.stdout:1000 2024-09-11T23:23:34.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:34.790 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.6) 2024-09-11T23:23:34.865 INFO:teuthology.orchestra.run.smithi144.stdout:1333 2024-09-11T23:23:34.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:34.866 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.6) 2024-09-11T23:23:34.942 INFO:teuthology.orchestra.run.smithi144.stdout:1333 2024-09-11T23:23:34.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:34.943 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.6) 2024-09-11T23:23:35.019 INFO:teuthology.orchestra.run.smithi144.stdout:1726097004 2024-09-11T23:23:35.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:35.021 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.6) 2024-09-11T23:23:35.096 INFO:teuthology.orchestra.run.smithi144.stdout:1726097004 2024-09-11T23:23:35.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:35.097 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.0) 2024-09-11T23:23:35.173 INFO:teuthology.orchestra.run.smithi144.stdout:81a4 2024-09-11T23:23:35.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:35.174 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.0) 2024-09-11T23:23:35.250 INFO:teuthology.orchestra.run.smithi144.stdout:81a4 2024-09-11T23:23:35.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:35.252 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.0) 2024-09-11T23:23:35.327 INFO:teuthology.orchestra.run.smithi144.stdout:1000 2024-09-11T23:23:35.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:35.329 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.0) 2024-09-11T23:23:35.404 INFO:teuthology.orchestra.run.smithi144.stdout:1000 2024-09-11T23:23:35.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:35.405 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.0) 2024-09-11T23:23:35.480 INFO:teuthology.orchestra.run.smithi144.stdout:1333 2024-09-11T23:23:35.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:35.482 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.0) 2024-09-11T23:23:35.558 INFO:teuthology.orchestra.run.smithi144.stdout:1333 2024-09-11T23:23:35.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:35.559 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.0) 2024-09-11T23:23:35.637 INFO:teuthology.orchestra.run.smithi144.stdout:1726097003 2024-09-11T23:23:35.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:35.639 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.0) 2024-09-11T23:23:35.715 INFO:teuthology.orchestra.run.smithi144.stdout:1726097003 2024-09-11T23:23:35.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:35.717 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.3) 2024-09-11T23:23:35.794 INFO:teuthology.orchestra.run.smithi144.stdout:81a4 2024-09-11T23:23:35.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:35.795 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.3) 2024-09-11T23:23:35.872 INFO:teuthology.orchestra.run.smithi144.stdout:81a4 2024-09-11T23:23:35.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:35.873 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.3) 2024-09-11T23:23:35.948 INFO:teuthology.orchestra.run.smithi144.stdout:1000 2024-09-11T23:23:35.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:35.949 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.3) 2024-09-11T23:23:36.023 INFO:teuthology.orchestra.run.smithi144.stdout:1000 2024-09-11T23:23:36.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:36.024 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.3) 2024-09-11T23:23:36.099 INFO:teuthology.orchestra.run.smithi144.stdout:1333 2024-09-11T23:23:36.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:36.101 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.3) 2024-09-11T23:23:36.175 INFO:teuthology.orchestra.run.smithi144.stdout:1333 2024-09-11T23:23:36.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:36.176 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.3) 2024-09-11T23:23:36.254 INFO:teuthology.orchestra.run.smithi144.stdout:1726097004 2024-09-11T23:23:36.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:36.256 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.3) 2024-09-11T23:23:36.331 INFO:teuthology.orchestra.run.smithi144.stdout:1726097004 2024-09-11T23:23:36.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:36.332 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.1) 2024-09-11T23:23:36.411 INFO:teuthology.orchestra.run.smithi144.stdout:81a4 2024-09-11T23:23:36.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:36.535 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.1) 2024-09-11T23:23:36.571 INFO:teuthology.orchestra.run.smithi144.stdout:81a4 2024-09-11T23:23:36.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:36.572 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.1) 2024-09-11T23:23:36.648 INFO:teuthology.orchestra.run.smithi144.stdout:1000 2024-09-11T23:23:36.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:36.649 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.1) 2024-09-11T23:23:36.726 INFO:teuthology.orchestra.run.smithi144.stdout:1000 2024-09-11T23:23:36.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:36.727 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.1) 2024-09-11T23:23:36.803 INFO:teuthology.orchestra.run.smithi144.stdout:1333 2024-09-11T23:23:36.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:36.805 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.1) 2024-09-11T23:23:36.881 INFO:teuthology.orchestra.run.smithi144.stdout:1333 2024-09-11T23:23:36.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:36.882 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee/.snap/subvol_snap87730/subvolume_file.1) 2024-09-11T23:23:36.960 INFO:teuthology.orchestra.run.smithi144.stdout:1726097003 2024-09-11T23:23:36.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:36.961 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone9810/6b5625ce-a3a2-46f7-a922-177e60d77d79/subvolume_file.1) 2024-09-11T23:23:37.036 INFO:teuthology.orchestra.run.smithi144.stdout:1726097003 2024-09-11T23:23:37.038 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol38500 fake subvol_clone12571 2024-09-11T23:23:37.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.238+0000 7f35ee200640 1 Processor -- start 2024-09-11T23:23:37.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.238+0000 7f35ee200640 1 -- start start 2024-09-11T23:23:37.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.240+0000 7f35ee200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f35e80ccb80 0x7f35e815bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:37.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.240+0000 7f35ee200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e8072d10 0x7f35e80b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:37.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.240+0000 7f35ee200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e80b3570 con 0x7f35e80b4c50 2024-09-11T23:23:37.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.240+0000 7f35ee200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f35e80b50a0 con 0x7f35e80ccb80 2024-09-11T23:23:37.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.240+0000 7f35ee200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f35e80b3850 con 0x7f35e8072d10 2024-09-11T23:23:37.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.240+0000 7f35e7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f35e80b4c50 0x7f35e815e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49730/0 (socket says 172.21.15.144:49730) 2024-09-11T23:23:37.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.240+0000 7f35e7e00640 1 -- 172.21.15.144:0/4188549008 learned_addr learned my addr 172.21.15.144:0/4188549008 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.240+0000 7f35e6a00640 1 -- 172.21.15.144:0/4188549008 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2282591864 0 0) 0x7f35e80b3570 con 0x7f35e80b4c50 2024-09-11T23:23:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.240+0000 7f35e7400640 1 --2- 172.21.15.144:0/4188549008 >> v2:172.21.15.165:3300/0 conn(0x7f35e80ccb80 0x7f35e815bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.240+0000 7f35e6a00640 1 -- 172.21.15.144:0/4188549008 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35cc003520 con 0x7f35e80b4c50 2024-09-11T23:23:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.240+0000 7f35dea00640 1 --2- 172.21.15.144:0/4188549008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e8072d10 0x7f35e80b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.241+0000 7f35e6a00640 1 -- 172.21.15.144:0/4188549008 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2697552271 0 0) 0x7f35cc003520 con 0x7f35e80b4c50 2024-09-11T23:23:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.241+0000 7f35e6a00640 1 -- 172.21.15.144:0/4188549008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e8072d10 msgr2=0x7f35e80b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.241+0000 7f35e6a00640 1 --2- 172.21.15.144:0/4188549008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e8072d10 0x7f35e80b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.241+0000 7f35e6a00640 1 -- 172.21.15.144:0/4188549008 >> v2:172.21.15.165:3300/0 conn(0x7f35e80ccb80 msgr2=0x7f35e815bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.241+0000 7f35e6a00640 1 --2- 172.21.15.144:0/4188549008 >> v2:172.21.15.165:3300/0 conn(0x7f35e80ccb80 0x7f35e815bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.241+0000 7f35e6a00640 1 -- 172.21.15.144:0/4188549008 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e80b3b30 con 0x7f35e80b4c50 2024-09-11T23:23:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.241+0000 7f35e6a00640 1 -- 172.21.15.144:0/4188549008 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f35e0001670 con 0x7f35e80b4c50 2024-09-11T23:23:37.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.241+0000 7f35e6a00640 1 -- 172.21.15.144:0/4188549008 >> v1:172.21.15.144:6789/0 conn(0x7f35e80b4c50 legacy=0x7f35e815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.241+0000 7f35e6a00640 1 --2- 172.21.15.144:0/4188549008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35cc0039b0 0x7f35cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.241+0000 7f35e6a00640 1 --2- 172.21.15.144:0/4188549008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35cc004800 0x7f35cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.241+0000 7f35e6a00640 1 --2- 172.21.15.144:0/4188549008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e8072d10 0x7f35cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.241+0000 7f35e6a00640 1 -- 172.21.15.144:0/4188549008 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f35e80b50a0 con 0x7f35cc004800 2024-09-11T23:23:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.241+0000 7f35e6a00640 1 -- 172.21.15.144:0/4188549008 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f35e80b3850 con 0x7f35cc0039b0 2024-09-11T23:23:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.241+0000 7f35e6a00640 1 -- 172.21.15.144:0/4188549008 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f35cc00dbd0 con 0x7f35e8072d10 2024-09-11T23:23:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.241+0000 7f35dea00640 1 --2- 172.21.15.144:0/4188549008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35cc004800 0x7f35cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.241+0000 7f35e7400640 1 --2- 172.21.15.144:0/4188549008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35cc0039b0 0x7f35cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.241+0000 7f35e7e00640 1 --2- 172.21.15.144:0/4188549008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e8072d10 0x7f35cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.242+0000 7f35dea00640 1 -- 172.21.15.144:0/4188549008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e8072d10 msgr2=0x7f35cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.242+0000 7f35dea00640 1 --2- 172.21.15.144:0/4188549008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e8072d10 0x7f35cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.242+0000 7f35dea00640 1 -- 172.21.15.144:0/4188549008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35cc0039b0 msgr2=0x7f35cc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.242+0000 7f35dea00640 1 --2- 172.21.15.144:0/4188549008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35cc0039b0 0x7f35cc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:37.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.242+0000 7f35dea00640 1 -- 172.21.15.144:0/4188549008 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35cc003520 con 0x7f35cc004800 2024-09-11T23:23:37.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.242+0000 7f35e7e00640 1 --2- 172.21.15.144:0/4188549008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e8072d10 0x7f35cc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:23:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.243+0000 7f35dea00640 1 --2- 172.21.15.144:0/4188549008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35cc004800 0x7f35cc004c80 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009a90 tx=0x7f35cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a042a1d96c17854d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.243+0000 7f35e6a00640 1 -- 172.21.15.144:0/4188549008 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d0036070 con 0x7f35cc004800 2024-09-11T23:23:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.243+0000 7f35e6a00640 1 -- 172.21.15.144:0/4188549008 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d0031400 con 0x7f35cc004800 2024-09-11T23:23:37.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.243+0000 7f35e6a00640 1 -- 172.21.15.144:0/4188549008 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d0009690 con 0x7f35cc004800 2024-09-11T23:23:37.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.243+0000 7f35ee200640 1 -- 172.21.15.144:0/4188549008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35cc004800 msgr2=0x7f35cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:37.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.243+0000 7f35ee200640 1 --2- 172.21.15.144:0/4188549008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35cc004800 0x7f35cc004c80 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009a90 tx=0x7f35cc005830 comp rx=0 tx=0).stop 2024-09-11T23:23:37.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.243+0000 7f35e7e00640 1 -- 172.21.15.144:0/4188549008 reap_dead start 2024-09-11T23:23:37.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.243+0000 7f35ee200640 1 -- 172.21.15.144:0/4188549008 shutdown_connections 2024-09-11T23:23:37.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.243+0000 7f35ee200640 1 -- 172.21.15.144:0/4188549008 >> 172.21.15.144:0/4188549008 conn(0x7f35e806bba0 msgr2=0x7f35e806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:37.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.243+0000 7f35ee200640 1 -- 172.21.15.144:0/4188549008 shutdown_connections 2024-09-11T23:23:37.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.244+0000 7f35ee200640 1 -- 172.21.15.144:0/4188549008 wait complete. 2024-09-11T23:23:37.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.245+0000 7f35ee200640 1 Processor -- start 2024-09-11T23:23:37.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.245+0000 7f35ee200640 1 -- start start 2024-09-11T23:23:37.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.246+0000 7f35ee200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35cc004800 0x7f35e80b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:37.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.246+0000 7f35ee200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35e80cae80 0x7f35e81f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:37.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.246+0000 7f35ee200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e80ae990 0x7f35e80aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:37.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.246+0000 7f35ee200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f35e80b43d0 con 0x7f35e80cae80 2024-09-11T23:23:37.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.246+0000 7f35ee200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f35e80b40f0 con 0x7f35cc004800 2024-09-11T23:23:37.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.246+0000 7f35ee200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f35e80ccf60 con 0x7f35e80ae990 2024-09-11T23:23:37.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.246+0000 7f35dea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35e80cae80 0x7f35e81f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:37.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.246+0000 7f35dea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35e80cae80 0x7f35e81f3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41742/0 (socket says 172.21.15.144:41742) 2024-09-11T23:23:37.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.246+0000 7f35dea00640 1 -- 172.21.15.144:0/972189130 learned_addr learned my addr 172.21.15.144:0/972189130 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:37.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.247+0000 7f35e7e00640 1 --2- 172.21.15.144:0/972189130 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e80ae990 0x7f35e80aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:37.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.247+0000 7f35e7400640 1 --2- 172.21.15.144:0/972189130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35cc004800 0x7f35e80b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:37.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.247+0000 7f35dea00640 1 -- 172.21.15.144:0/972189130 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e80ae990 msgr2=0x7f35e80aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:37.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.247+0000 7f35dea00640 1 --2- 172.21.15.144:0/972189130 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e80ae990 0x7f35e80aee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:37.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.247+0000 7f35dea00640 1 -- 172.21.15.144:0/972189130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35cc004800 msgr2=0x7f35e80b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:37.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.247+0000 7f35dea00640 1 --2- 172.21.15.144:0/972189130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35cc004800 0x7f35e80b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:37.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.247+0000 7f35dea00640 1 -- 172.21.15.144:0/972189130 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e80cb660 con 0x7f35e80cae80 2024-09-11T23:23:37.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.247+0000 7f35dea00640 1 --2- 172.21.15.144:0/972189130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35e80cae80 0x7f35e81f3eb0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009a90 tx=0x7f35d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:37.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.247+0000 7f35dfe00640 1 -- 172.21.15.144:0/972189130 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d0040020 con 0x7f35e80cae80 2024-09-11T23:23:37.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.247+0000 7f35dfe00640 1 -- 172.21.15.144:0/972189130 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d0003b40 con 0x7f35e80cae80 2024-09-11T23:23:37.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.247+0000 7f35ee200640 1 -- 172.21.15.144:0/972189130 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e80cb940 con 0x7f35e80cae80 2024-09-11T23:23:37.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.247+0000 7f35dfe00640 1 -- 172.21.15.144:0/972189130 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d0036040 con 0x7f35e80cae80 2024-09-11T23:23:37.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.248+0000 7f35ee200640 1 -- 172.21.15.144:0/972189130 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e80cbf00 con 0x7f35e80cae80 2024-09-11T23:23:37.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.248+0000 7f35ee200640 1 -- 172.21.15.144:0/972189130 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e80711a0 con 0x7f35e80cae80 2024-09-11T23:23:37.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.249+0000 7f35dfe00640 1 -- 172.21.15.144:0/972189130 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 90753+0+0 (secure 0 0 0) 0x7f35d0043020 con 0x7f35e80cae80 2024-09-11T23:23:37.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.250+0000 7f35dfe00640 1 --2- 172.21.15.144:0/972189130 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f35c406c100 0x7f35c406e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:37.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.250+0000 7f35dfe00640 1 -- 172.21.15.144:0/972189130 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f35d00ab4b0 con 0x7f35e80cae80 2024-09-11T23:23:37.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.251+0000 7f35e7400640 1 --2- 172.21.15.144:0/972189130 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f35c406c100 0x7f35c406e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:37.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.251+0000 7f35e7400640 1 --2- 172.21.15.144:0/972189130 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f35c406c100 0x7f35c406e5c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f35e80c7850 tx=0x7f35d800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:37.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.255+0000 7f35dfe00640 1 -- 172.21.15.144:0/972189130 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f35e80711a0 con 0x7f35e80cae80 2024-09-11T23:23:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.461+0000 7f35ee200640 1 -- 172.21.15.144:0/972189130 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol38500", "snap_name": "fake", "target_sub_name": "subvol_clone12571", "target": ["mon-mgr", ""]}) -- 0x7f35e8155810 con 0x7f35c406c100 2024-09-11T23:23:37.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.545+0000 7f35dfe00640 1 -- 172.21.15.144:0/972189130 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f35e8155810 con 0x7f35c406c100 2024-09-11T23:23:37.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.547+0000 7f35ee200640 1 -- 172.21.15.144:0/972189130 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f35c406c100 msgr2=0x7f35c406e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:37.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.547+0000 7f35ee200640 1 --2- 172.21.15.144:0/972189130 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f35c406c100 0x7f35c406e5c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f35e80c7850 tx=0x7f35d800b040 comp rx=0 tx=0).stop 2024-09-11T23:23:37.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.548+0000 7f35ee200640 1 -- 172.21.15.144:0/972189130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35e80cae80 msgr2=0x7f35e81f3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:37.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.548+0000 7f35ee200640 1 --2- 172.21.15.144:0/972189130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35e80cae80 0x7f35e81f3eb0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009a90 tx=0x7f35d0004730 comp rx=0 tx=0).stop 2024-09-11T23:23:37.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.548+0000 7f35ee200640 1 -- 172.21.15.144:0/972189130 shutdown_connections 2024-09-11T23:23:37.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.548+0000 7f35ee200640 1 --2- 172.21.15.144:0/972189130 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f35c406c100 0x7f35c406e5c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:37.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.548+0000 7f35ee200640 1 --2- 172.21.15.144:0/972189130 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f35e80ae990 0x7f35e80aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:37.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.548+0000 7f35ee200640 1 --2- 172.21.15.144:0/972189130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f35e80cae80 0x7f35e81f3eb0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:37.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.548+0000 7f35ee200640 1 --2- 172.21.15.144:0/972189130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35cc004800 0x7f35e80b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:37.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.548+0000 7f35ee200640 1 -- 172.21.15.144:0/972189130 >> 172.21.15.144:0/972189130 conn(0x7f35e806bba0 msgr2=0x7f35e80725e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:37.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.548+0000 7f35ee200640 1 -- 172.21.15.144:0/972189130 shutdown_connections 2024-09-11T23:23:37.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.548+0000 7f35ee200640 1 -- 172.21.15.144:0/972189130 wait complete. 2024-09-11T23:23:37.565 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone12571 2024-09-11T23:23:37.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.723+0000 7fbe4f600640 1 Processor -- start 2024-09-11T23:23:37.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.723+0000 7fbe4f600640 1 -- start start 2024-09-11T23:23:37.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.724+0000 7fbe4f600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe480b3430 0x7fbe480cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:37.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.724+0000 7fbe4f600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe4806c2d0 0x7fbe480b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:37.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.724+0000 7fbe4f600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbe4806d8c0 0x7fbe4806dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:37.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.724+0000 7fbe4f600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fbe480d22c0 con 0x7fbe4806c2d0 2024-09-11T23:23:37.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.724+0000 7fbe4f600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fbe480b3d50 con 0x7fbe4806d8c0 2024-09-11T23:23:37.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.724+0000 7fbe4f600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbe4815e9d0 con 0x7fbe480b3430 2024-09-11T23:23:37.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.724+0000 7fbe3fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe4806c2d0 0x7fbe480b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:37.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.724+0000 7fbe3fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe4806c2d0 0x7fbe480b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41746/0 (socket says 172.21.15.144:41746) 2024-09-11T23:23:37.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.724+0000 7fbe3fe00640 1 -- 172.21.15.144:0/1896763368 learned_addr learned my addr 172.21.15.144:0/1896763368 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:37.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.725+0000 7fbe4d600640 1 --2- 172.21.15.144:0/1896763368 >> v2:172.21.15.165:3300/0 conn(0x7fbe4806d8c0 0x7fbe4806dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:37.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.725+0000 7fbe4cc00640 1 --2- 172.21.15.144:0/1896763368 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe480b3430 0x7fbe480cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:37.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.725+0000 7fbe3fe00640 1 -- 172.21.15.144:0/1896763368 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe480b3430 msgr2=0x7fbe480cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:37.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.725+0000 7fbe3fe00640 1 --2- 172.21.15.144:0/1896763368 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe480b3430 0x7fbe480cf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:37.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.725+0000 7fbe3fe00640 1 -- 172.21.15.144:0/1896763368 >> v2:172.21.15.165:3300/0 conn(0x7fbe4806d8c0 msgr2=0x7fbe4806dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:37.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.725+0000 7fbe3fe00640 1 --2- 172.21.15.144:0/1896763368 >> v2:172.21.15.165:3300/0 conn(0x7fbe4806d8c0 0x7fbe4806dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:37.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.725+0000 7fbe3fe00640 1 -- 172.21.15.144:0/1896763368 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe4806ca70 con 0x7fbe4806c2d0 2024-09-11T23:23:37.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.726+0000 7fbe3fe00640 1 --2- 172.21.15.144:0/1896763368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe4806c2d0 0x7fbe480b3810 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fbe48074320 tx=0x7fbe3002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4eb183cd95fa386 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:37.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.726+0000 7fbe47e00640 1 -- 172.21.15.144:0/1896763368 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe30037070 con 0x7fbe4806c2d0 2024-09-11T23:23:37.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.726+0000 7fbe47e00640 1 -- 172.21.15.144:0/1896763368 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe30032440 con 0x7fbe4806c2d0 2024-09-11T23:23:37.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.726+0000 7fbe47e00640 1 -- 172.21.15.144:0/1896763368 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe30032810 con 0x7fbe4806c2d0 2024-09-11T23:23:37.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.727+0000 7fbe4f600640 1 -- 172.21.15.144:0/1896763368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe4806c2d0 msgr2=0x7fbe480b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:37.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.727+0000 7fbe4f600640 1 --2- 172.21.15.144:0/1896763368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe4806c2d0 0x7fbe480b3810 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fbe48074320 tx=0x7fbe3002a140 comp rx=0 tx=0).stop 2024-09-11T23:23:37.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.727+0000 7fbe4f600640 1 -- 172.21.15.144:0/1896763368 shutdown_connections 2024-09-11T23:23:37.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.727+0000 7fbe4f600640 1 --2- 172.21.15.144:0/1896763368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe4806c2d0 0x7fbe480b3810 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:37.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.727+0000 7fbe4f600640 1 --2- 172.21.15.144:0/1896763368 >> v2:172.21.15.165:3300/0 conn(0x7fbe4806d8c0 0x7fbe4806dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:37.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.727+0000 7fbe4f600640 1 --2- 172.21.15.144:0/1896763368 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe480b3430 0x7fbe480cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:37.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.727+0000 7fbe4f600640 1 -- 172.21.15.144:0/1896763368 >> 172.21.15.144:0/1896763368 conn(0x7fbe480d4b10 msgr2=0x7fbe480d4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:37.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.727+0000 7fbe4f600640 1 -- 172.21.15.144:0/1896763368 shutdown_connections 2024-09-11T23:23:37.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.727+0000 7fbe4f600640 1 -- 172.21.15.144:0/1896763368 wait complete. 2024-09-11T23:23:37.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.728+0000 7fbe4f600640 1 Processor -- start 2024-09-11T23:23:37.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.729+0000 7fbe4f600640 1 -- start start 2024-09-11T23:23:37.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.729+0000 7fbe4f600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe4806c2d0 0x7fbe481f8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:37.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.729+0000 7fbe4f600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe4806d8c0 0x7fbe48150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:37.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.730+0000 7fbe4f600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe480b3430 0x7fbe480ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:37.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.730+0000 7fbe4f600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbe480d27f0 con 0x7fbe480b3430 2024-09-11T23:23:37.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.730+0000 7fbe4f600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbe480d2510 con 0x7fbe4806d8c0 2024-09-11T23:23:37.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.730+0000 7fbe4f600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbe4806c710 con 0x7fbe4806c2d0 2024-09-11T23:23:37.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.730+0000 7fbe4d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe480b3430 0x7fbe480ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:37.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.730+0000 7fbe4d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe480b3430 0x7fbe480ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41758/0 (socket says 172.21.15.144:41758) 2024-09-11T23:23:37.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.730+0000 7fbe4d600640 1 -- 172.21.15.144:0/571851971 learned_addr learned my addr 172.21.15.144:0/571851971 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:37.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.730+0000 7fbe4cc00640 1 --2- 172.21.15.144:0/571851971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe4806c2d0 0x7fbe481f8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:37.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.730+0000 7fbe3fe00640 1 --2- 172.21.15.144:0/571851971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe4806d8c0 0x7fbe48150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:37.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.730+0000 7fbe4d600640 1 -- 172.21.15.144:0/571851971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe4806c2d0 msgr2=0x7fbe481f8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:37.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.730+0000 7fbe4d600640 1 --2- 172.21.15.144:0/571851971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe4806c2d0 0x7fbe481f8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:37.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.730+0000 7fbe4d600640 1 -- 172.21.15.144:0/571851971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe4806d8c0 msgr2=0x7fbe48150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:37.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.730+0000 7fbe4d600640 1 --2- 172.21.15.144:0/571851971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe4806d8c0 0x7fbe48150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:37.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.730+0000 7fbe4d600640 1 -- 172.21.15.144:0/571851971 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe480c8730 con 0x7fbe480b3430 2024-09-11T23:23:37.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.731+0000 7fbe4d600640 1 --2- 172.21.15.144:0/571851971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe480b3430 0x7fbe480ceb20 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000eed0 tx=0x7fbe4000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:37.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.731+0000 7fbe45600640 1 -- 172.21.15.144:0/571851971 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe40018020 con 0x7fbe480b3430 2024-09-11T23:23:37.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.731+0000 7fbe45600640 1 -- 172.21.15.144:0/571851971 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe4000bd10 con 0x7fbe480b3430 2024-09-11T23:23:37.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.731+0000 7fbe4f600640 1 -- 172.21.15.144:0/571851971 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe480c8a10 con 0x7fbe480b3430 2024-09-11T23:23:37.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.731+0000 7fbe45600640 1 -- 172.21.15.144:0/571851971 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe40014640 con 0x7fbe480b3430 2024-09-11T23:23:37.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.731+0000 7fbe4f600640 1 -- 172.21.15.144:0/571851971 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe480c8fd0 con 0x7fbe480b3430 2024-09-11T23:23:37.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.732+0000 7fbe4f600640 1 -- 172.21.15.144:0/571851971 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe480b9870 con 0x7fbe480b3430 2024-09-11T23:23:37.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.733+0000 7fbe45600640 1 -- 172.21.15.144:0/571851971 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 90753+0+0 (secure 0 0 0) 0x7fbe40005d10 con 0x7fbe480b3430 2024-09-11T23:23:37.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.734+0000 7fbe45600640 1 --2- 172.21.15.144:0/571851971 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe2406c100 0x7fbe2406e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:37.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.734+0000 7fbe45600640 1 -- 172.21.15.144:0/571851971 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7fbe4008bc30 con 0x7fbe480b3430 2024-09-11T23:23:37.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.734+0000 7fbe4cc00640 1 --2- 172.21.15.144:0/571851971 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe2406c100 0x7fbe2406e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:37.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.735+0000 7fbe4cc00640 1 --2- 172.21.15.144:0/571851971 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe2406c100 0x7fbe2406e5c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbe38009b40 tx=0x7fbe38009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:37.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.738+0000 7fbe45600640 1 -- 172.21.15.144:0/571851971 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe480b9870 con 0x7fbe480b3430 2024-09-11T23:23:37.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:37.950+0000 7fbe4f600640 1 -- 172.21.15.144:0/571851971 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone12571", "target": ["mon-mgr", ""]}) -- 0x7fbe480b3810 con 0x7fbe2406c100 2024-09-11T23:23:39.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:39.684+0000 7fbe45600640 1 -- 172.21.15.144:0/571851971 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+153 (secure 0 0 0) 0x7fbe480b3810 con 0x7fbe2406c100 2024-09-11T23:23:39.684 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:23:39.684 INFO:teuthology.orchestra.run.smithi144.stdout: "status": { 2024-09-11T23:23:39.684 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "pending", 2024-09-11T23:23:39.684 INFO:teuthology.orchestra.run.smithi144.stdout: "source": { 2024-09-11T23:23:39.684 INFO:teuthology.orchestra.run.smithi144.stdout: "volume": "cephfs", 2024-09-11T23:23:39.684 INFO:teuthology.orchestra.run.smithi144.stdout: "subvolume": "subvol38500", 2024-09-11T23:23:39.684 INFO:teuthology.orchestra.run.smithi144.stdout: "snapshot": "fake" 2024-09-11T23:23:39.684 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:39.685 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:39.685 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:23:39.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:39.687+0000 7fbe4f600640 1 -- 172.21.15.144:0/571851971 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe2406c100 msgr2=0x7fbe2406e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:39.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:39.687+0000 7fbe4f600640 1 --2- 172.21.15.144:0/571851971 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe2406c100 0x7fbe2406e5c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbe38009b40 tx=0x7fbe38009190 comp rx=0 tx=0).stop 2024-09-11T23:23:39.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:39.687+0000 7fbe4f600640 1 -- 172.21.15.144:0/571851971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe480b3430 msgr2=0x7fbe480ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:39.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:39.687+0000 7fbe4f600640 1 --2- 172.21.15.144:0/571851971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe480b3430 0x7fbe480ceb20 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000eed0 tx=0x7fbe4000b480 comp rx=0 tx=0).stop 2024-09-11T23:23:39.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:39.687+0000 7fbe4f600640 1 -- 172.21.15.144:0/571851971 shutdown_connections 2024-09-11T23:23:39.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:39.687+0000 7fbe4f600640 1 --2- 172.21.15.144:0/571851971 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe2406c100 0x7fbe2406e5c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:39.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:39.687+0000 7fbe4f600640 1 --2- 172.21.15.144:0/571851971 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe480b3430 0x7fbe480ceb20 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:39.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:39.687+0000 7fbe4f600640 1 --2- 172.21.15.144:0/571851971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe4806d8c0 0x7fbe48150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:39.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:39.687+0000 7fbe4f600640 1 --2- 172.21.15.144:0/571851971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe4806c2d0 0x7fbe481f8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:39.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:39.687+0000 7fbe4f600640 1 -- 172.21.15.144:0/571851971 >> 172.21.15.144:0/571851971 conn(0x7fbe480d4b10 msgr2=0x7fbe480b7520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:39.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:39.687+0000 7fbe4f600640 1 -- 172.21.15.144:0/571851971 shutdown_connections 2024-09-11T23:23:39.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:39.687+0000 7fbe4f600640 1 -- 172.21.15.144:0/571851971 wait complete. 2024-09-11T23:23:40.708 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone12571 2024-09-11T23:23:40.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.876+0000 7f732f200640 1 Processor -- start 2024-09-11T23:23:40.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.876+0000 7f732f200640 1 -- start start 2024-09-11T23:23:40.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.877+0000 7f732f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f733015e6c0 0x7f733006c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:40.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.877+0000 7f732f200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f73300cf510 0x7f73300b7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:40.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.877+0000 7f732f200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f733015eaa0 con 0x7f73300b7bb0 2024-09-11T23:23:40.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.877+0000 7f732f200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f73300d34d0 con 0x7f73300cf510 2024-09-11T23:23:40.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.877+0000 7f732f200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f733006cdf0 con 0x7f733015e6c0 2024-09-11T23:23:40.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.878+0000 7f7325400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f73300cf510 0x7f73300b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:40.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.878+0000 7f732de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f733015e6c0 0x7f733006c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:40.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.878+0000 7f732de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f733015e6c0 0x7f733006c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:35614/0 (socket says 172.21.15.144:35614) 2024-09-11T23:23:40.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.878+0000 7f7325400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f73300cf510 0x7f73300b7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:41582/0 (socket says 172.21.15.144:41582) 2024-09-11T23:23:40.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.878+0000 7f732de00640 1 -- 172.21.15.144:0/205610211 learned_addr learned my addr 172.21.15.144:0/205610211 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:40.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.878+0000 7f732de00640 1 -- 172.21.15.144:0/205610211 >> v2:172.21.15.165:3300/0 conn(0x7f73300cf510 msgr2=0x7f73300b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:40.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.878+0000 7f732de00640 1 --2- 172.21.15.144:0/205610211 >> v2:172.21.15.165:3300/0 conn(0x7f73300cf510 0x7f73300b7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:40.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.878+0000 7f732de00640 1 -- 172.21.15.144:0/205610211 >> v1:172.21.15.165:6789/0 conn(0x7f73300b7bb0 legacy=0x7f733006d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:40.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.878+0000 7f732de00640 1 -- 172.21.15.144:0/205610211 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73300d28c0 con 0x7f733015e6c0 2024-09-11T23:23:40.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.878+0000 7f7325400640 1 --2- 172.21.15.144:0/205610211 >> v2:172.21.15.165:3300/0 conn(0x7f73300cf510 0x7f73300b7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:23:40.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.879+0000 7f732de00640 1 --2- 172.21.15.144:0/205610211 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f733015e6c0 0x7f733006c8b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7320009870 tx=0x7f732002a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=200297e7147bc1e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:40.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.880+0000 7f732d400640 1 -- 172.21.15.144:0/205610211 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320037070 con 0x7f733015e6c0 2024-09-11T23:23:40.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.880+0000 7f732d400640 1 -- 172.21.15.144:0/205610211 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f732002ae50 con 0x7f733015e6c0 2024-09-11T23:23:40.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.880+0000 7f732d400640 1 -- 172.21.15.144:0/205610211 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320032860 con 0x7f733015e6c0 2024-09-11T23:23:40.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.880+0000 7f732f200640 1 -- 172.21.15.144:0/205610211 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f733015e6c0 msgr2=0x7f733006c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:40.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.880+0000 7f732f200640 1 --2- 172.21.15.144:0/205610211 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f733015e6c0 0x7f733006c8b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7320009870 tx=0x7f732002a300 comp rx=0 tx=0).stop 2024-09-11T23:23:40.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.880+0000 7f732f200640 1 -- 172.21.15.144:0/205610211 shutdown_connections 2024-09-11T23:23:40.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.880+0000 7f732f200640 1 --2- 172.21.15.144:0/205610211 >> v2:172.21.15.165:3300/0 conn(0x7f73300cf510 0x7f73300b7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:40.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.880+0000 7f732f200640 1 --2- 172.21.15.144:0/205610211 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f733015e6c0 0x7f733006c8b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:40.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.880+0000 7f732f200640 1 -- 172.21.15.144:0/205610211 >> 172.21.15.144:0/205610211 conn(0x7f73300d4720 msgr2=0x7f73300d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:40.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.880+0000 7f732f200640 1 -- 172.21.15.144:0/205610211 shutdown_connections 2024-09-11T23:23:40.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.880+0000 7f732f200640 1 -- 172.21.15.144:0/205610211 wait complete. 2024-09-11T23:23:40.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.882+0000 7f732f200640 1 Processor -- start 2024-09-11T23:23:40.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.882+0000 7f732f200640 1 -- start start 2024-09-11T23:23:40.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.883+0000 7f732f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73300b7bb0 0x7f7330158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:40.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.883+0000 7f732f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73300cf510 0x7f73301568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:40.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.883+0000 7f732f200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f733015e6c0 0x7f73300ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:40.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.883+0000 7f732f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f73300d3160 con 0x7f73300b7bb0 2024-09-11T23:23:40.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.883+0000 7f732f200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f73300d2e80 con 0x7f733015e6c0 2024-09-11T23:23:40.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.883+0000 7f732f200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f733006dd20 con 0x7f73300cf510 2024-09-11T23:23:40.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.883+0000 7f732de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73300b7bb0 0x7f7330158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:40.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.883+0000 7f732de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73300b7bb0 0x7f7330158a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41774/0 (socket says 172.21.15.144:41774) 2024-09-11T23:23:40.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.883+0000 7f732de00640 1 -- 172.21.15.144:0/371923868 learned_addr learned my addr 172.21.15.144:0/371923868 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:40.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.883+0000 7f7325400640 1 --2- 172.21.15.144:0/371923868 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73300cf510 0x7f73301568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:40.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.883+0000 7f732e800640 1 --2- 172.21.15.144:0/371923868 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f733015e6c0 0x7f73300ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:40.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.884+0000 7f732de00640 1 -- 172.21.15.144:0/371923868 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73300cf510 msgr2=0x7f73301568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:40.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.884+0000 7f732de00640 1 --2- 172.21.15.144:0/371923868 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73300cf510 0x7f73301568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:40.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.884+0000 7f732de00640 1 -- 172.21.15.144:0/371923868 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f733015e6c0 msgr2=0x7f73300ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:40.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.884+0000 7f732de00640 1 --2- 172.21.15.144:0/371923868 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f733015e6c0 0x7f73300ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:40.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.884+0000 7f732de00640 1 -- 172.21.15.144:0/371923868 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73301f4ce0 con 0x7f73300b7bb0 2024-09-11T23:23:40.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.884+0000 7f732e800640 1 --2- 172.21.15.144:0/371923868 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f733015e6c0 0x7f73300ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:23:40.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.884+0000 7f732de00640 1 --2- 172.21.15.144:0/371923868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73300b7bb0 0x7f7330158a40 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f7320000c00 tx=0x7f73200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:40.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.884+0000 7f7326a00640 1 -- 172.21.15.144:0/371923868 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320041070 con 0x7f73300b7bb0 2024-09-11T23:23:40.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.884+0000 7f7326a00640 1 -- 172.21.15.144:0/371923868 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f732003c660 con 0x7f73300b7bb0 2024-09-11T23:23:40.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.884+0000 7f7326a00640 1 -- 172.21.15.144:0/371923868 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320037040 con 0x7f73300b7bb0 2024-09-11T23:23:40.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.884+0000 7f732f200640 1 -- 172.21.15.144:0/371923868 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73301f4fc0 con 0x7f73300b7bb0 2024-09-11T23:23:40.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.885+0000 7f732f200640 1 -- 172.21.15.144:0/371923868 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73301f5580 con 0x7f73300b7bb0 2024-09-11T23:23:40.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.886+0000 7f732f200640 1 -- 172.21.15.144:0/371923868 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73300b7670 con 0x7f73300b7bb0 2024-09-11T23:23:40.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.886+0000 7f7326a00640 1 -- 172.21.15.144:0/371923868 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 90753+0+0 (secure 0 0 0) 0x7f7320044070 con 0x7f73300b7bb0 2024-09-11T23:23:40.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.887+0000 7f7326a00640 1 --2- 172.21.15.144:0/371923868 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f730c06c100 0x7f730c06e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:40.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.887+0000 7f7326a00640 1 -- 172.21.15.144:0/371923868 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f73200aba30 con 0x7f73300b7bb0 2024-09-11T23:23:40.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.888+0000 7f7325400640 1 --2- 172.21.15.144:0/371923868 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f730c06c100 0x7f730c06e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:40.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.888+0000 7f7325400640 1 --2- 172.21.15.144:0/371923868 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f730c06c100 0x7f730c06e5c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7318009560 tx=0x7f7318009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:40.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:40.892+0000 7f7326a00640 1 -- 172.21.15.144:0/371923868 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7320079ae0 con 0x7f73300b7bb0 2024-09-11T23:23:41.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:41.097+0000 7f732f200640 1 -- 172.21.15.144:0/371923868 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone12571", "target": ["mon-mgr", ""]}) -- 0x7f73300d2600 con 0x7f730c06c100 2024-09-11T23:23:44.632 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:23:44.637 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:23:44.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.670+0000 7f7326a00640 1 -- 172.21.15.144:0/371923868 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7f73300d2600 con 0x7f730c06c100 2024-09-11T23:23:44.670 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:23:44.670 INFO:teuthology.orchestra.run.smithi144.stdout: "status": { 2024-09-11T23:23:44.670 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "complete" 2024-09-11T23:23:44.670 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:44.670 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:23:44.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.673+0000 7f732f200640 1 -- 172.21.15.144:0/371923868 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f730c06c100 msgr2=0x7f730c06e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:44.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.673+0000 7f732f200640 1 --2- 172.21.15.144:0/371923868 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f730c06c100 0x7f730c06e5c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7318009560 tx=0x7f7318009190 comp rx=0 tx=0).stop 2024-09-11T23:23:44.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.673+0000 7f732f200640 1 -- 172.21.15.144:0/371923868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73300b7bb0 msgr2=0x7f7330158a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:44.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.673+0000 7f732f200640 1 --2- 172.21.15.144:0/371923868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73300b7bb0 0x7f7330158a40 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f7320000c00 tx=0x7f73200046c0 comp rx=0 tx=0).stop 2024-09-11T23:23:44.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.673+0000 7f732f200640 1 -- 172.21.15.144:0/371923868 shutdown_connections 2024-09-11T23:23:44.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.673+0000 7f732f200640 1 --2- 172.21.15.144:0/371923868 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f730c06c100 0x7f730c06e5c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:44.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.673+0000 7f732f200640 1 --2- 172.21.15.144:0/371923868 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f733015e6c0 0x7f73300ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:44.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.673+0000 7f732f200640 1 --2- 172.21.15.144:0/371923868 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73300cf510 0x7f73301568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:44.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.673+0000 7f732f200640 1 --2- 172.21.15.144:0/371923868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73300b7bb0 0x7f7330158a40 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:44.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.673+0000 7f732f200640 1 -- 172.21.15.144:0/371923868 >> 172.21.15.144:0/371923868 conn(0x7f73300d4720 msgr2=0x7f73300b9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:44.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.673+0000 7f732f200640 1 -- 172.21.15.144:0/371923868 shutdown_connections 2024-09-11T23:23:44.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.673+0000 7f732f200640 1 -- 172.21.15.144:0/371923868 wait complete. 2024-09-11T23:23:44.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:44.693 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol_clone12571/.meta) 2024-09-11T23:23:44.791 INFO:teuthology.orchestra.run.smithi144.stdout:[GLOBAL] 2024-09-11T23:23:44.791 INFO:teuthology.orchestra.run.smithi144.stdout:version = 2 2024-09-11T23:23:44.791 INFO:teuthology.orchestra.run.smithi144.stdout:type = clone 2024-09-11T23:23:44.792 INFO:teuthology.orchestra.run.smithi144.stdout:path = /volumes/_nogroup/subvol_clone12571/b601cac2-27be-403d-ab78-4f6e23905ea7 2024-09-11T23:23:44.792 INFO:teuthology.orchestra.run.smithi144.stdout:state = complete 2024-09-11T23:23:44.792 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:44.794 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot info cephfs subvol38500 subvol_snap87730 2024-09-11T23:23:44.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.994+0000 7f42c4c00640 1 Processor -- start 2024-09-11T23:23:44.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.994+0000 7f42c4c00640 1 -- start start 2024-09-11T23:23:44.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.995+0000 7f42c4c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42c015b370 0x7f42c0072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:44.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.995+0000 7f42c4c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f42c006f130 0x7f42c00ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:44.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.995+0000 7f42c4c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c015c970 con 0x7f42c015f9f0 2024-09-11T23:23:44.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.995+0000 7f42c4c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f42c015fef0 con 0x7f42c006f130 2024-09-11T23:23:44.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.995+0000 7f42c4c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f42c015bbb0 con 0x7f42c015b370 2024-09-11T23:23:44.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.995+0000 7f42bd400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f42c015f9f0 0x7f42c006ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52278/0 (socket says 172.21.15.144:52278) 2024-09-11T23:23:44.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.995+0000 7f42bd400640 1 -- 172.21.15.144:0/3581412346 learned_addr learned my addr 172.21.15.144:0/3581412346 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:44.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.996+0000 7f42be800640 1 --2- 172.21.15.144:0/3581412346 >> v2:172.21.15.165:3300/0 conn(0x7f42c006f130 0x7f42c00ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:44.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.996+0000 7f42bde00640 1 --2- 172.21.15.144:0/3581412346 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42c015b370 0x7f42c0072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:44.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.996+0000 7f42bca00640 1 -- 172.21.15.144:0/3581412346 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3992719185 0 0) 0x7f42c015c970 con 0x7f42c015f9f0 2024-09-11T23:23:44.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.996+0000 7f42bca00640 1 -- 172.21.15.144:0/3581412346 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42a4003520 con 0x7f42c015f9f0 2024-09-11T23:23:44.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.996+0000 7f42be800640 1 -- 172.21.15.144:0/3581412346 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42c015b370 msgr2=0x7f42c0072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:44.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.996+0000 7f42be800640 1 --2- 172.21.15.144:0/3581412346 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42c015b370 0x7f42c0072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:44.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.996+0000 7f42be800640 1 -- 172.21.15.144:0/3581412346 >> v1:172.21.15.144:6789/0 conn(0x7f42c015f9f0 legacy=0x7f42c006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:44.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.996+0000 7f42be800640 1 -- 172.21.15.144:0/3581412346 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c015be90 con 0x7f42c006f130 2024-09-11T23:23:44.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.997+0000 7f42be800640 1 --2- 172.21.15.144:0/3581412346 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42c006f130 0x7f42c00ce490 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009d90 tx=0x7f42b802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f0fe47cdc84c71e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:44.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.998+0000 7f42bca00640 1 -- 172.21.15.144:0/3581412346 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b8031600 con 0x7f42c006f130 2024-09-11T23:23:44.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.998+0000 7f42bca00640 1 -- 172.21.15.144:0/3581412346 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b80317a0 con 0x7f42c006f130 2024-09-11T23:23:44.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.998+0000 7f42bca00640 1 -- 172.21.15.144:0/3581412346 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b8031b70 con 0x7f42c006f130 2024-09-11T23:23:44.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.998+0000 7f42c4c00640 1 -- 172.21.15.144:0/3581412346 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42c006f130 msgr2=0x7f42c00ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:44.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.998+0000 7f42c4c00640 1 --2- 172.21.15.144:0/3581412346 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42c006f130 0x7f42c00ce490 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009d90 tx=0x7f42b802a5d0 comp rx=0 tx=0).stop 2024-09-11T23:23:44.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.998+0000 7f42c4c00640 1 -- 172.21.15.144:0/3581412346 shutdown_connections 2024-09-11T23:23:44.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.998+0000 7f42c4c00640 1 --2- 172.21.15.144:0/3581412346 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42c006f130 0x7f42c00ce490 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:44.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.998+0000 7f42c4c00640 1 --2- 172.21.15.144:0/3581412346 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42c015b370 0x7f42c0072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:44.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.998+0000 7f42c4c00640 1 -- 172.21.15.144:0/3581412346 >> 172.21.15.144:0/3581412346 conn(0x7f42c006bba0 msgr2=0x7f42c006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:44.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.998+0000 7f42c4c00640 1 -- 172.21.15.144:0/3581412346 shutdown_connections 2024-09-11T23:23:44.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:44.998+0000 7f42c4c00640 1 -- 172.21.15.144:0/3581412346 wait complete. 2024-09-11T23:23:44.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.000+0000 7f42c4c00640 1 Processor -- start 2024-09-11T23:23:44.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.000+0000 7f42c4c00640 1 -- start start 2024-09-11T23:23:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.001+0000 7f42c4c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42c006f130 0x7f42c01f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.001+0000 7f42c4c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42c015b370 0x7f42c00b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.001+0000 7f42c4c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42c015f9f0 0x7f42c0159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.001+0000 7f42c4c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f42c00731b0 con 0x7f42c006f130 2024-09-11T23:23:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.001+0000 7f42c4c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f42c015c450 con 0x7f42c015b370 2024-09-11T23:23:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.001+0000 7f42c4c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f42c015b750 con 0x7f42c015f9f0 2024-09-11T23:23:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.001+0000 7f42bde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42c006f130 0x7f42c01f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.001+0000 7f42bde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42c006f130 0x7f42c01f2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53080/0 (socket says 172.21.15.144:53080) 2024-09-11T23:23:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.001+0000 7f42bde00640 1 -- 172.21.15.144:0/1033341201 learned_addr learned my addr 172.21.15.144:0/1033341201 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.001+0000 7f42bd400640 1 --2- 172.21.15.144:0/1033341201 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42c015b370 0x7f42c00b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:45.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.001+0000 7f42be800640 1 --2- 172.21.15.144:0/1033341201 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42c015f9f0 0x7f42c0159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:45.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.001+0000 7f42bde00640 1 -- 172.21.15.144:0/1033341201 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42c015f9f0 msgr2=0x7f42c0159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:45.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.002+0000 7f42bde00640 1 --2- 172.21.15.144:0/1033341201 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42c015f9f0 0x7f42c0159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.002+0000 7f42bde00640 1 -- 172.21.15.144:0/1033341201 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42c015b370 msgr2=0x7f42c00b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:45.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.002+0000 7f42bde00640 1 --2- 172.21.15.144:0/1033341201 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42c015b370 0x7f42c00b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.002+0000 7f42bde00640 1 -- 172.21.15.144:0/1033341201 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c00b3ee0 con 0x7f42c006f130 2024-09-11T23:23:45.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.002+0000 7f42bd400640 1 --2- 172.21.15.144:0/1033341201 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42c015b370 0x7f42c00b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:23:45.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.002+0000 7f42bde00640 1 --2- 172.21.15.144:0/1033341201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42c006f130 0x7f42c01f2860 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f42b000e9e0 tx=0x7f42b000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:45.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.002+0000 7f42b6000640 1 -- 172.21.15.144:0/1033341201 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0017070 con 0x7f42c006f130 2024-09-11T23:23:45.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.002+0000 7f42b6000640 1 -- 172.21.15.144:0/1033341201 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b000c9d0 con 0x7f42c006f130 2024-09-11T23:23:45.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.002+0000 7f42c4c00640 1 -- 172.21.15.144:0/1033341201 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c00b41c0 con 0x7f42c006f130 2024-09-11T23:23:45.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.002+0000 7f42b6000640 1 -- 172.21.15.144:0/1033341201 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b000cdc0 con 0x7f42c006f130 2024-09-11T23:23:45.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.002+0000 7f42c4c00640 1 -- 172.21.15.144:0/1033341201 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c00b4780 con 0x7f42c006f130 2024-09-11T23:23:45.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.003+0000 7f42c4c00640 1 -- 172.21.15.144:0/1033341201 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42c0072560 con 0x7f42c006f130 2024-09-11T23:23:45.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.004+0000 7f42b6000640 1 -- 172.21.15.144:0/1033341201 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 90753+0+0 (secure 0 0 0) 0x7f42b001a070 con 0x7f42c006f130 2024-09-11T23:23:45.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.005+0000 7f42b6000640 1 --2- 172.21.15.144:0/1033341201 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f42a006c100 0x7f42a006e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:45.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.005+0000 7f42b6000640 1 -- 172.21.15.144:0/1033341201 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f42b008b700 con 0x7f42c006f130 2024-09-11T23:23:45.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.005+0000 7f42bd400640 1 --2- 172.21.15.144:0/1033341201 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f42a006c100 0x7f42a006e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:45.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.006+0000 7f42bd400640 1 --2- 172.21.15.144:0/1033341201 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f42a006c100 0x7f42a006e5c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f42ac007fd0 tx=0x7f42ac009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:45.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.010+0000 7f42b6000640 1 -- 172.21.15.144:0/1033341201 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42b0059ce0 con 0x7f42c006f130 2024-09-11T23:23:45.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.212+0000 7f42c4c00640 1 -- 172.21.15.144:0/1033341201 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot info", "vol_name": "cephfs", "sub_name": "subvol38500", "snap_name": "subvol_snap87730", "target": ["mon-mgr", ""]}) -- 0x7f42c01584f0 con 0x7f42a006c100 2024-09-11T23:23:45.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.234+0000 7f42b6000640 1 -- 172.21.15.144:0/1033341201 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+115 (secure 0 0 0) 0x7f42c01584f0 con 0x7f42a006c100 2024-09-11T23:23:45.234 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:23:45.234 INFO:teuthology.orchestra.run.smithi144.stdout: "created_at": "2024-09-11 23:23:25.045500", 2024-09-11T23:23:45.234 INFO:teuthology.orchestra.run.smithi144.stdout: "data_pool": "cephfs_data", 2024-09-11T23:23:45.234 INFO:teuthology.orchestra.run.smithi144.stdout: "has_pending_clones": "no" 2024-09-11T23:23:45.234 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:23:45.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.236+0000 7f42c4c00640 1 -- 172.21.15.144:0/1033341201 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f42a006c100 msgr2=0x7f42a006e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:45.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.236+0000 7f42c4c00640 1 --2- 172.21.15.144:0/1033341201 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f42a006c100 0x7f42a006e5c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f42ac007fd0 tx=0x7f42ac009040 comp rx=0 tx=0).stop 2024-09-11T23:23:45.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.236+0000 7f42c4c00640 1 -- 172.21.15.144:0/1033341201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42c006f130 msgr2=0x7f42c01f2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:45.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.236+0000 7f42c4c00640 1 --2- 172.21.15.144:0/1033341201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42c006f130 0x7f42c01f2860 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f42b000e9e0 tx=0x7f42b000eea0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.236+0000 7f42c4c00640 1 -- 172.21.15.144:0/1033341201 shutdown_connections 2024-09-11T23:23:45.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.236+0000 7f42c4c00640 1 --2- 172.21.15.144:0/1033341201 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f42a006c100 0x7f42a006e5c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.236+0000 7f42c4c00640 1 --2- 172.21.15.144:0/1033341201 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42c015f9f0 0x7f42c0159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.236+0000 7f42c4c00640 1 --2- 172.21.15.144:0/1033341201 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42c015b370 0x7f42c00b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.236+0000 7f42c4c00640 1 --2- 172.21.15.144:0/1033341201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42c006f130 0x7f42c01f2860 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.236+0000 7f42c4c00640 1 -- 172.21.15.144:0/1033341201 >> 172.21.15.144:0/1033341201 conn(0x7f42c006bba0 msgr2=0x7f42c00ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:45.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.236+0000 7f42c4c00640 1 -- 172.21.15.144:0/1033341201 shutdown_connections 2024-09-11T23:23:45.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.236+0000 7f42c4c00640 1 -- 172.21.15.144:0/1033341201 wait complete. 2024-09-11T23:23:45.252 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs subvol38500 2024-09-11T23:23:45.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.410+0000 7fbb32600640 1 Processor -- start 2024-09-11T23:23:45.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.410+0000 7fbb32600640 1 -- start start 2024-09-11T23:23:45.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.411+0000 7fbb32600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbb2c06fa30 0x7fbb2c06fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:45.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.411+0000 7fbb32600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb2c0d1fe0 con 0x7fbb2c0ce980 2024-09-11T23:23:45.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.411+0000 7fbb32600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb2c0d0830 con 0x7fbb2c15e5b0 2024-09-11T23:23:45.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.411+0000 7fbb32600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fbb2c0703c0 con 0x7fbb2c06fa30 2024-09-11T23:23:45.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.411+0000 7fbb2be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbb2c0ce980 0x7fbb2c0d18d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52294/0 (socket says 172.21.15.144:52294) 2024-09-11T23:23:45.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.412+0000 7fbb2be00640 1 -- 172.21.15.144:0/95851359 learned_addr learned my addr 172.21.15.144:0/95851359 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:45.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.412+0000 7fbb31c00640 1 --2- 172.21.15.144:0/95851359 >> v2:172.21.15.144:3300/0 conn(0x7fbb2c06fa30 0x7fbb2c06fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:45.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.412+0000 7fbb31c00640 1 -- 172.21.15.144:0/95851359 >> v1:172.21.15.165:6789/0 conn(0x7fbb2c15e5b0 legacy=0x7fbb2c0d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:45.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.412+0000 7fbb31c00640 1 -- 172.21.15.144:0/95851359 >> v1:172.21.15.144:6789/0 conn(0x7fbb2c0ce980 legacy=0x7fbb2c0d18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:45.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.412+0000 7fbb2b400640 1 -- 172.21.15.144:0/95851359 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 129324717 0 0) 0x7fbb2c0d0830 con 0x7fbb2c15e5b0 2024-09-11T23:23:45.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.412+0000 7fbb31c00640 1 -- 172.21.15.144:0/95851359 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb2c0d0b10 con 0x7fbb2c06fa30 2024-09-11T23:23:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.413+0000 7fbb31c00640 1 --2- 172.21.15.144:0/95851359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb2c06fa30 0x7fbb2c06fe80 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009d90 tx=0x7fbb2402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b971f284ed6f36 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.413+0000 7fbb2b400640 1 -- 172.21.15.144:0/95851359 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb24007740 con 0x7fbb2c06fa30 2024-09-11T23:23:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.413+0000 7fbb2b400640 1 -- 172.21.15.144:0/95851359 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb240078e0 con 0x7fbb2c06fa30 2024-09-11T23:23:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.413+0000 7fbb2b400640 1 -- 172.21.15.144:0/95851359 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb24007cb0 con 0x7fbb2c06fa30 2024-09-11T23:23:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.414+0000 7fbb32600640 1 -- 172.21.15.144:0/95851359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb2c06fa30 msgr2=0x7fbb2c06fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.414+0000 7fbb32600640 1 --2- 172.21.15.144:0/95851359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb2c06fa30 0x7fbb2c06fe80 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009d90 tx=0x7fbb2402a6f0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.414+0000 7fbb32600640 1 -- 172.21.15.144:0/95851359 shutdown_connections 2024-09-11T23:23:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.414+0000 7fbb32600640 1 --2- 172.21.15.144:0/95851359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb2c06fa30 0x7fbb2c06fe80 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.414+0000 7fbb32600640 1 -- 172.21.15.144:0/95851359 >> 172.21.15.144:0/95851359 conn(0x7fbb2c06e190 msgr2=0x7fbb2c06e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:45.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.414+0000 7fbb32600640 1 -- 172.21.15.144:0/95851359 shutdown_connections 2024-09-11T23:23:45.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.414+0000 7fbb32600640 1 -- 172.21.15.144:0/95851359 wait complete. 2024-09-11T23:23:45.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.415+0000 7fbb32600640 1 Processor -- start 2024-09-11T23:23:45.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.416+0000 7fbb32600640 1 -- start start 2024-09-11T23:23:45.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.416+0000 7fbb32600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb2c06fa30 0x7fbb2c14bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:45.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.416+0000 7fbb32600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb2c0ce980 0x7fbb2c15d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:45.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.416+0000 7fbb32600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb2c15e5b0 0x7fbb2c15d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:45.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.416+0000 7fbb32600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2c0d1440 con 0x7fbb2c15e5b0 2024-09-11T23:23:45.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.416+0000 7fbb32600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2c0cb8c0 con 0x7fbb2c06fa30 2024-09-11T23:23:45.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.416+0000 7fbb32600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbb2c0d10d0 con 0x7fbb2c0ce980 2024-09-11T23:23:45.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.417+0000 7fbb31c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb2c15e5b0 0x7fbb2c15d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:45.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.417+0000 7fbb31c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb2c15e5b0 0x7fbb2c15d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53096/0 (socket says 172.21.15.144:53096) 2024-09-11T23:23:45.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.417+0000 7fbb31c00640 1 -- 172.21.15.144:0/524891132 learned_addr learned my addr 172.21.15.144:0/524891132 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:45.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.417+0000 7fbb2be00640 1 --2- 172.21.15.144:0/524891132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb2c0ce980 0x7fbb2c15d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:45.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.417+0000 7fbb31c00640 1 -- 172.21.15.144:0/524891132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb2c0ce980 msgr2=0x7fbb2c15d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:45.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.417+0000 7fbb31200640 1 --2- 172.21.15.144:0/524891132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb2c06fa30 0x7fbb2c14bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:45.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.417+0000 7fbb31c00640 1 --2- 172.21.15.144:0/524891132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb2c0ce980 0x7fbb2c15d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.417+0000 7fbb31c00640 1 -- 172.21.15.144:0/524891132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb2c06fa30 msgr2=0x7fbb2c14bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:45.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.417+0000 7fbb31c00640 1 --2- 172.21.15.144:0/524891132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb2c06fa30 0x7fbb2c14bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.417+0000 7fbb31c00640 1 -- 172.21.15.144:0/524891132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb2c15b660 con 0x7fbb2c15e5b0 2024-09-11T23:23:45.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.417+0000 7fbb31200640 1 --2- 172.21.15.144:0/524891132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb2c06fa30 0x7fbb2c14bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:23:45.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.417+0000 7fbb31c00640 1 --2- 172.21.15.144:0/524891132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb2c15e5b0 0x7fbb2c15d580 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009eb0 tx=0x7fbb24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:45.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.418+0000 7fbb28c00640 1 -- 172.21.15.144:0/524891132 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2403f070 con 0x7fbb2c15e5b0 2024-09-11T23:23:45.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.418+0000 7fbb28c00640 1 -- 172.21.15.144:0/524891132 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb24031c90 con 0x7fbb2c15e5b0 2024-09-11T23:23:45.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.418+0000 7fbb32600640 1 -- 172.21.15.144:0/524891132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb2c15b940 con 0x7fbb2c15e5b0 2024-09-11T23:23:45.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.418+0000 7fbb28c00640 1 -- 172.21.15.144:0/524891132 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb24043630 con 0x7fbb2c15e5b0 2024-09-11T23:23:45.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.418+0000 7fbb32600640 1 -- 172.21.15.144:0/524891132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb2c15bf00 con 0x7fbb2c15e5b0 2024-09-11T23:23:45.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.419+0000 7fbb32600640 1 -- 172.21.15.144:0/524891132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb2c0cbd80 con 0x7fbb2c15e5b0 2024-09-11T23:23:45.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.420+0000 7fbb28c00640 1 -- 172.21.15.144:0/524891132 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 90753+0+0 (secure 0 0 0) 0x7fbb2403b410 con 0x7fbb2c15e5b0 2024-09-11T23:23:45.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.420+0000 7fbb28c00640 1 --2- 172.21.15.144:0/524891132 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbb0c06c100 0x7fbb0c06e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:45.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.421+0000 7fbb28c00640 1 -- 172.21.15.144:0/524891132 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7fbb240aca20 con 0x7fbb2c15e5b0 2024-09-11T23:23:45.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.421+0000 7fbb31200640 1 --2- 172.21.15.144:0/524891132 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbb0c06c100 0x7fbb0c06e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:45.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.422+0000 7fbb31200640 1 --2- 172.21.15.144:0/524891132 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbb0c06c100 0x7fbb0c06e5c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbb20000f60 tx=0x7fbb20009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:45.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.425+0000 7fbb28c00640 1 -- 172.21.15.144:0/524891132 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb2407af60 con 0x7fbb2c15e5b0 2024-09-11T23:23:45.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.625+0000 7fbb32600640 1 -- 172.21.15.144:0/524891132 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "subvol38500", "target": ["mon-mgr", ""]}) -- 0x7fbb2c073c70 con 0x7fbb0c06c100 2024-09-11T23:23:45.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.640+0000 7fbb28c00640 1 -- 172.21.15.144:0/524891132 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+87 (secure 0 0 0) 0x7fbb2c073c70 con 0x7fbb0c06c100 2024-09-11T23:23:45.641 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:23:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "fake" 2024-09-11T23:23:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:23:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:23:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "subvol_snap87730" 2024-09-11T23:23:45.641 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:23:45.641 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:23:45.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.643+0000 7fbb32600640 1 -- 172.21.15.144:0/524891132 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbb0c06c100 msgr2=0x7fbb0c06e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:45.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.643+0000 7fbb32600640 1 --2- 172.21.15.144:0/524891132 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbb0c06c100 0x7fbb0c06e5c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbb20000f60 tx=0x7fbb20009040 comp rx=0 tx=0).stop 2024-09-11T23:23:45.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.643+0000 7fbb32600640 1 -- 172.21.15.144:0/524891132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb2c15e5b0 msgr2=0x7fbb2c15d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:45.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.643+0000 7fbb32600640 1 --2- 172.21.15.144:0/524891132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb2c15e5b0 0x7fbb2c15d580 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009eb0 tx=0x7fbb24004a40 comp rx=0 tx=0).stop 2024-09-11T23:23:45.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.643+0000 7fbb32600640 1 -- 172.21.15.144:0/524891132 shutdown_connections 2024-09-11T23:23:45.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.643+0000 7fbb32600640 1 --2- 172.21.15.144:0/524891132 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbb0c06c100 0x7fbb0c06e5c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.643+0000 7fbb32600640 1 --2- 172.21.15.144:0/524891132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb2c15e5b0 0x7fbb2c15d580 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.643+0000 7fbb32600640 1 --2- 172.21.15.144:0/524891132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb2c0ce980 0x7fbb2c15d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.643+0000 7fbb32600640 1 --2- 172.21.15.144:0/524891132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb2c06fa30 0x7fbb2c14bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.643+0000 7fbb32600640 1 -- 172.21.15.144:0/524891132 >> 172.21.15.144:0/524891132 conn(0x7fbb2c06e190 msgr2=0x7fbb2c0d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:45.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.643+0000 7fbb32600640 1 -- 172.21.15.144:0/524891132 shutdown_connections 2024-09-11T23:23:45.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.643+0000 7fbb32600640 1 -- 172.21.15.144:0/524891132 wait complete. 2024-09-11T23:23:45.659 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol38500 subvol_snap87730 2024-09-11T23:23:45.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.819+0000 7f0fe5600640 1 Processor -- start 2024-09-11T23:23:45.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.820+0000 7f0fe5600640 1 -- start start 2024-09-11T23:23:45.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.821+0000 7f0fe5600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0fe00d32d0 0x7f0fe006d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:45.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.821+0000 7f0fe5600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0fe006db50 0x7f0fe00b7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:45.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.821+0000 7f0fe5600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fe00d3890 con 0x7f0fe015e650 2024-09-11T23:23:45.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.821+0000 7f0fe5600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0fe015ea30 con 0x7f0fe00d32d0 2024-09-11T23:23:45.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.821+0000 7f0fe5600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0fe00d3b70 con 0x7f0fe006db50 2024-09-11T23:23:45.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.821+0000 7f0fdfe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0fe015e650 0x7f0fe00cf6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52304/0 (socket says 172.21.15.144:52304) 2024-09-11T23:23:45.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.821+0000 7f0fdfe00640 1 -- 172.21.15.144:0/2276371134 learned_addr learned my addr 172.21.15.144:0/2276371134 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:45.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.822+0000 7f0fe4c00640 1 --2- 172.21.15.144:0/2276371134 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0fe006db50 0x7f0fe00b7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:45.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.822+0000 7f0fdf400640 1 --2- 172.21.15.144:0/2276371134 >> v2:172.21.15.165:3300/0 conn(0x7f0fe00d32d0 0x7f0fe006d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:45.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.822+0000 7f0fdea00640 1 -- 172.21.15.144:0/2276371134 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328763016 0 0) 0x7f0fe00d3890 con 0x7f0fe015e650 2024-09-11T23:23:45.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.822+0000 7f0fdea00640 1 -- 172.21.15.144:0/2276371134 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fc4003520 con 0x7f0fe015e650 2024-09-11T23:23:45.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.822+0000 7f0fdea00640 1 -- 172.21.15.144:0/2276371134 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2708586268 0 0) 0x7f0fc4003520 con 0x7f0fe015e650 2024-09-11T23:23:45.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.822+0000 7f0fe4c00640 1 -- 172.21.15.144:0/2276371134 >> v2:172.21.15.165:3300/0 conn(0x7f0fe00d32d0 msgr2=0x7f0fe006d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:45.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.822+0000 7f0fe4c00640 1 --2- 172.21.15.144:0/2276371134 >> v2:172.21.15.165:3300/0 conn(0x7f0fe00d32d0 0x7f0fe006d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.822+0000 7f0fe4c00640 1 -- 172.21.15.144:0/2276371134 >> v1:172.21.15.144:6789/0 conn(0x7f0fe015e650 legacy=0x7f0fe00cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:45.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.822+0000 7f0fe4c00640 1 -- 172.21.15.144:0/2276371134 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe00d3e50 con 0x7f0fe006db50 2024-09-11T23:23:45.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.823+0000 7f0fe4c00640 1 --2- 172.21.15.144:0/2276371134 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0fe006db50 0x7f0fe00b7cb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0fd80097a0 tx=0x7f0fd802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e0461d7cb572710 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:45.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.823+0000 7f0fdea00640 1 -- 172.21.15.144:0/2276371134 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd8037070 con 0x7f0fe006db50 2024-09-11T23:23:45.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.824+0000 7f0fdea00640 1 -- 172.21.15.144:0/2276371134 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fd802ac30 con 0x7f0fe006db50 2024-09-11T23:23:45.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.824+0000 7f0fdea00640 1 -- 172.21.15.144:0/2276371134 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0001a10 con 0x7f0fe006db50 2024-09-11T23:23:45.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.824+0000 7f0fe5600640 1 -- 172.21.15.144:0/2276371134 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0fe006db50 msgr2=0x7f0fe00b7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:45.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.824+0000 7f0fe5600640 1 --2- 172.21.15.144:0/2276371134 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0fe006db50 0x7f0fe00b7cb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0fd80097a0 tx=0x7f0fd802a1a0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.824+0000 7f0fe5600640 1 -- 172.21.15.144:0/2276371134 shutdown_connections 2024-09-11T23:23:45.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.824+0000 7f0fe5600640 1 --2- 172.21.15.144:0/2276371134 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0fe006db50 0x7f0fe00b7cb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.824+0000 7f0fe5600640 1 --2- 172.21.15.144:0/2276371134 >> v2:172.21.15.165:3300/0 conn(0x7f0fe00d32d0 0x7f0fe006d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.824+0000 7f0fe5600640 1 -- 172.21.15.144:0/2276371134 >> 172.21.15.144:0/2276371134 conn(0x7f0fe00d4740 msgr2=0x7f0fe00d4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:45.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.824+0000 7f0fe5600640 1 -- 172.21.15.144:0/2276371134 shutdown_connections 2024-09-11T23:23:45.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.824+0000 7f0fe5600640 1 -- 172.21.15.144:0/2276371134 wait complete. 2024-09-11T23:23:45.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.826+0000 7f0fe5600640 1 Processor -- start 2024-09-11T23:23:45.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.826+0000 7f0fe5600640 1 -- start start 2024-09-11T23:23:45.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.827+0000 7f0fe5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fe006db50 0x7f0fe015d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:45.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.827+0000 7f0fe5600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0fe00d32d0 0x7f0fe00ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:45.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.827+0000 7f0fe5600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0fe015e650 0x7f0fe00cec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:45.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.827+0000 7f0fe5600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe00b7810 con 0x7f0fe006db50 2024-09-11T23:23:45.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.827+0000 7f0fe5600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe00b7690 con 0x7f0fe015e650 2024-09-11T23:23:45.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.827+0000 7f0fe5600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0fe00b81f0 con 0x7f0fe00d32d0 2024-09-11T23:23:45.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.827+0000 7f0fdfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fe006db50 0x7f0fe015d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:45.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.827+0000 7f0fdfe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fe006db50 0x7f0fe015d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53104/0 (socket says 172.21.15.144:53104) 2024-09-11T23:23:45.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.827+0000 7f0fdfe00640 1 -- 172.21.15.144:0/4138728307 learned_addr learned my addr 172.21.15.144:0/4138728307 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:45.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.827+0000 7f0fe4c00640 1 --2- 172.21.15.144:0/4138728307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0fe015e650 0x7f0fe00cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:45.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.827+0000 7f0fdf400640 1 --2- 172.21.15.144:0/4138728307 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0fe00d32d0 0x7f0fe00ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:45.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.828+0000 7f0fdfe00640 1 -- 172.21.15.144:0/4138728307 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0fe00d32d0 msgr2=0x7f0fe00ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:45.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.828+0000 7f0fdfe00640 1 --2- 172.21.15.144:0/4138728307 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0fe00d32d0 0x7f0fe00ce6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.828+0000 7f0fdfe00640 1 -- 172.21.15.144:0/4138728307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0fe015e650 msgr2=0x7f0fe00cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:45.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.828+0000 7f0fdfe00640 1 --2- 172.21.15.144:0/4138728307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0fe015e650 0x7f0fe00cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:45.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.828+0000 7f0fdfe00640 1 -- 172.21.15.144:0/4138728307 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe00cd140 con 0x7f0fe006db50 2024-09-11T23:23:45.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.828+0000 7f0fdfe00640 1 --2- 172.21.15.144:0/4138728307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fe006db50 0x7f0fe015d970 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000cac0 tx=0x7f0fd000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:45.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.828+0000 7f0fd7e00640 1 -- 172.21.15.144:0/4138728307 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0018070 con 0x7f0fe006db50 2024-09-11T23:23:45.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.828+0000 7f0fd7e00640 1 -- 172.21.15.144:0/4138728307 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fd000a6a0 con 0x7f0fe006db50 2024-09-11T23:23:45.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.828+0000 7f0fd7e00640 1 -- 172.21.15.144:0/4138728307 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd000aa90 con 0x7f0fe006db50 2024-09-11T23:23:45.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.828+0000 7f0fe5600640 1 -- 172.21.15.144:0/4138728307 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fe00cd420 con 0x7f0fe006db50 2024-09-11T23:23:45.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.828+0000 7f0fe5600640 1 -- 172.21.15.144:0/4138728307 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fe00cd9e0 con 0x7f0fe006db50 2024-09-11T23:23:45.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.830+0000 7f0fe5600640 1 -- 172.21.15.144:0/4138728307 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fe00b7cb0 con 0x7f0fe006db50 2024-09-11T23:23:45.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.830+0000 7f0fd7e00640 1 -- 172.21.15.144:0/4138728307 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 90753+0+0 (secure 0 0 0) 0x7f0fd001b070 con 0x7f0fe006db50 2024-09-11T23:23:45.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.831+0000 7f0fd7e00640 1 --2- 172.21.15.144:0/4138728307 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0fc006c100 0x7f0fc006e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:45.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.831+0000 7f0fd7e00640 1 -- 172.21.15.144:0/4138728307 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f0fd008aa80 con 0x7f0fe006db50 2024-09-11T23:23:45.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.832+0000 7f0fdf400640 1 --2- 172.21.15.144:0/4138728307 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0fc006c100 0x7f0fc006e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:45.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.833+0000 7f0fdf400640 1 --2- 172.21.15.144:0/4138728307 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0fc006c100 0x7f0fc006e5c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00cae60 tx=0x7f0fcc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:45.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:45.836+0000 7f0fd7e00640 1 -- 172.21.15.144:0/4138728307 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0fd008ce20 con 0x7f0fe006db50 2024-09-11T23:23:46.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.041+0000 7f0fe5600640 1 -- 172.21.15.144:0/4138728307 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol38500", "snap_name": "subvol_snap87730", "target": ["mon-mgr", ""]}) -- 0x7f0fe0073e00 con 0x7f0fc006c100 2024-09-11T23:23:46.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.073+0000 7f0fd7e00640 1 -- 172.21.15.144:0/4138728307 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0fe0073e00 con 0x7f0fc006c100 2024-09-11T23:23:46.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.075+0000 7f0fe5600640 1 -- 172.21.15.144:0/4138728307 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0fc006c100 msgr2=0x7f0fc006e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:46.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.075+0000 7f0fe5600640 1 --2- 172.21.15.144:0/4138728307 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0fc006c100 0x7f0fc006e5c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00cae60 tx=0x7f0fcc009190 comp rx=0 tx=0).stop 2024-09-11T23:23:46.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.075+0000 7f0fe5600640 1 -- 172.21.15.144:0/4138728307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fe006db50 msgr2=0x7f0fe015d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:46.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.075+0000 7f0fe5600640 1 --2- 172.21.15.144:0/4138728307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fe006db50 0x7f0fe015d970 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000cac0 tx=0x7f0fd000cf80 comp rx=0 tx=0).stop 2024-09-11T23:23:46.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.076+0000 7f0fe5600640 1 -- 172.21.15.144:0/4138728307 shutdown_connections 2024-09-11T23:23:46.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.076+0000 7f0fe5600640 1 --2- 172.21.15.144:0/4138728307 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0fc006c100 0x7f0fc006e5c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:46.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.076+0000 7f0fe5600640 1 --2- 172.21.15.144:0/4138728307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0fe015e650 0x7f0fe00cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:46.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.076+0000 7f0fe5600640 1 --2- 172.21.15.144:0/4138728307 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0fe00d32d0 0x7f0fe00ce6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:46.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.076+0000 7f0fe5600640 1 --2- 172.21.15.144:0/4138728307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0fe006db50 0x7f0fe015d970 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:46.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.076+0000 7f0fe5600640 1 -- 172.21.15.144:0/4138728307 >> 172.21.15.144:0/4138728307 conn(0x7f0fe00d4740 msgr2=0x7f0fe00b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:46.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.076+0000 7f0fe5600640 1 -- 172.21.15.144:0/4138728307 shutdown_connections 2024-09-11T23:23:46.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.076+0000 7f0fe5600640 1 -- 172.21.15.144:0/4138728307 wait complete. 2024-09-11T23:23:46.499 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol38500 fake 2024-09-11T23:23:46.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.660+0000 7fafcce00640 1 Processor -- start 2024-09-11T23:23:46.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.660+0000 7fafcce00640 1 -- start start 2024-09-11T23:23:46.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.661+0000 7fafcce00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fafc80cf5d0 0x7fafc80cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:46.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.661+0000 7fafcce00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fafc806d4f0 0x7fafc806d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:46.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.661+0000 7fafcce00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafc80b4240 con 0x7fafc8145d90 2024-09-11T23:23:46.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.661+0000 7fafcce00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fafc806d080 con 0x7fafc806d4f0 2024-09-11T23:23:46.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.661+0000 7fafcce00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fafc80b4520 con 0x7fafc80cf5d0 2024-09-11T23:23:46.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.661+0000 7fafc6800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fafc806d4f0 0x7fafc806d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:46.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.662+0000 7fafc6800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fafc806d4f0 0x7fafc806d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53106/0 (socket says 172.21.15.144:53106) 2024-09-11T23:23:46.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.662+0000 7fafc6800640 1 -- 172.21.15.144:0/1858505776 learned_addr learned my addr 172.21.15.144:0/1858505776 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:46.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.662+0000 7fafc5400640 1 --2- 172.21.15.144:0/1858505776 >> v2:172.21.15.165:3300/0 conn(0x7fafc80cf5d0 0x7fafc80cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:46.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.662+0000 7fafc6800640 1 -- 172.21.15.144:0/1858505776 >> v2:172.21.15.165:3300/0 conn(0x7fafc80cf5d0 msgr2=0x7fafc80cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:46.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.662+0000 7fafc6800640 1 --2- 172.21.15.144:0/1858505776 >> v2:172.21.15.165:3300/0 conn(0x7fafc80cf5d0 0x7fafc80cfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:46.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.662+0000 7fafc6800640 1 -- 172.21.15.144:0/1858505776 >> v1:172.21.15.165:6789/0 conn(0x7fafc8145d90 legacy=0x7fafc80ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:46.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.662+0000 7fafc6800640 1 -- 172.21.15.144:0/1858505776 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc80b4800 con 0x7fafc806d4f0 2024-09-11T23:23:46.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.663+0000 7fafc6800640 1 --2- 172.21.15.144:0/1858505776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafc806d4f0 0x7fafc806d960 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fafc806ef20 tx=0x7fafc002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8986f61fd49976 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:46.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.663+0000 7fafc4a00640 1 -- 172.21.15.144:0/1858505776 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0036070 con 0x7fafc806d4f0 2024-09-11T23:23:46.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.663+0000 7fafc4a00640 1 -- 172.21.15.144:0/1858505776 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc0031600 con 0x7fafc806d4f0 2024-09-11T23:23:46.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.663+0000 7fafc4a00640 1 -- 172.21.15.144:0/1858505776 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc00319d0 con 0x7fafc806d4f0 2024-09-11T23:23:46.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.664+0000 7fafcce00640 1 -- 172.21.15.144:0/1858505776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafc806d4f0 msgr2=0x7fafc806d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:46.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.664+0000 7fafcce00640 1 --2- 172.21.15.144:0/1858505776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafc806d4f0 0x7fafc806d960 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fafc806ef20 tx=0x7fafc002a730 comp rx=0 tx=0).stop 2024-09-11T23:23:46.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.664+0000 7fafcce00640 1 -- 172.21.15.144:0/1858505776 shutdown_connections 2024-09-11T23:23:46.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.664+0000 7fafcce00640 1 --2- 172.21.15.144:0/1858505776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafc806d4f0 0x7fafc806d960 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:46.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.664+0000 7fafcce00640 1 --2- 172.21.15.144:0/1858505776 >> v2:172.21.15.165:3300/0 conn(0x7fafc80cf5d0 0x7fafc80cfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:46.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.664+0000 7fafcce00640 1 -- 172.21.15.144:0/1858505776 >> 172.21.15.144:0/1858505776 conn(0x7fafc806bba0 msgr2=0x7fafc806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:46.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.664+0000 7fafcce00640 1 -- 172.21.15.144:0/1858505776 shutdown_connections 2024-09-11T23:23:46.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.664+0000 7fafcce00640 1 -- 172.21.15.144:0/1858505776 wait complete. 2024-09-11T23:23:46.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.666+0000 7fafcce00640 1 Processor -- start 2024-09-11T23:23:46.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.666+0000 7fafcce00640 1 -- start start 2024-09-11T23:23:46.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.667+0000 7fafcce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafc806d4f0 0x7fafc80c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:46.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.667+0000 7fafcce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafc80cf5d0 0x7fafc80aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:46.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.667+0000 7fafcce00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafc8145d90 0x7fafc8140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:46.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.667+0000 7fafcce00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fafc80cd660 con 0x7fafc80cf5d0 2024-09-11T23:23:46.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.667+0000 7fafcce00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fafc80cff80 con 0x7fafc8145d90 2024-09-11T23:23:46.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.667+0000 7fafcce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fafc80b5610 con 0x7fafc806d4f0 2024-09-11T23:23:46.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.667+0000 7fafc5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafc80cf5d0 0x7fafc80aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:46.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.667+0000 7fafc5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafc80cf5d0 0x7fafc80aeb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53118/0 (socket says 172.21.15.144:53118) 2024-09-11T23:23:46.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.667+0000 7fafc5400640 1 -- 172.21.15.144:0/830159188 learned_addr learned my addr 172.21.15.144:0/830159188 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:46.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.667+0000 7fafc5e00640 1 --2- 172.21.15.144:0/830159188 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafc806d4f0 0x7fafc80c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:46.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.667+0000 7fafc6800640 1 --2- 172.21.15.144:0/830159188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafc8145d90 0x7fafc8140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:46.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.667+0000 7fafc5400640 1 -- 172.21.15.144:0/830159188 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafc806d4f0 msgr2=0x7fafc80c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:46.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.667+0000 7fafc5400640 1 --2- 172.21.15.144:0/830159188 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafc806d4f0 0x7fafc80c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:46.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.667+0000 7fafc5400640 1 -- 172.21.15.144:0/830159188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafc8145d90 msgr2=0x7fafc8140a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:46.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.667+0000 7fafc5400640 1 --2- 172.21.15.144:0/830159188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafc8145d90 0x7fafc8140a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:46.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.667+0000 7fafc5400640 1 -- 172.21.15.144:0/830159188 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc815dc70 con 0x7fafc80cf5d0 2024-09-11T23:23:46.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.668+0000 7fafc5400640 1 --2- 172.21.15.144:0/830159188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafc80cf5d0 0x7fafc80aeb50 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fafb400d5f0 tx=0x7fafb400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:46.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.668+0000 7fafbe000640 1 -- 172.21.15.144:0/830159188 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb40125f0 con 0x7fafc80cf5d0 2024-09-11T23:23:46.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.668+0000 7fafbe000640 1 -- 172.21.15.144:0/830159188 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb4019070 con 0x7fafc80cf5d0 2024-09-11T23:23:46.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.668+0000 7fafbe000640 1 -- 172.21.15.144:0/830159188 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb40129d0 con 0x7fafc80cf5d0 2024-09-11T23:23:46.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.668+0000 7fafcce00640 1 -- 172.21.15.144:0/830159188 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafc815df00 con 0x7fafc80cf5d0 2024-09-11T23:23:46.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.668+0000 7fafcce00640 1 -- 172.21.15.144:0/830159188 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafc815e4c0 con 0x7fafc80cf5d0 2024-09-11T23:23:46.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.669+0000 7fafcce00640 1 -- 172.21.15.144:0/830159188 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafc8146170 con 0x7fafc80cf5d0 2024-09-11T23:23:46.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.670+0000 7fafbe000640 1 -- 172.21.15.144:0/830159188 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 90753+0+0 (secure 0 0 0) 0x7fafb4012b70 con 0x7fafc80cf5d0 2024-09-11T23:23:46.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.671+0000 7fafbe000640 1 --2- 172.21.15.144:0/830159188 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fafa806c100 0x7fafa806e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:46.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.671+0000 7fafbe000640 1 -- 172.21.15.144:0/830159188 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7fafb408b510 con 0x7fafc80cf5d0 2024-09-11T23:23:46.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.671+0000 7fafc5e00640 1 --2- 172.21.15.144:0/830159188 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fafa806c100 0x7fafa806e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:46.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.672+0000 7fafc5e00640 1 --2- 172.21.15.144:0/830159188 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fafa806c100 0x7fafa806e5c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fafb8001780 tx=0x7fafb8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:46.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.675+0000 7fafbe000640 1 -- 172.21.15.144:0/830159188 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fafb4059530 con 0x7fafc80cf5d0 2024-09-11T23:23:46.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.878+0000 7fafcce00640 1 -- 172.21.15.144:0/830159188 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol38500", "snap_name": "fake", "target": ["mon-mgr", ""]}) -- 0x7fafc806c300 con 0x7fafa806c100 2024-09-11T23:23:46.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.910+0000 7fafbe000640 1 -- 172.21.15.144:0/830159188 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fafc806c300 con 0x7fafa806c100 2024-09-11T23:23:46.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.913+0000 7fafcce00640 1 -- 172.21.15.144:0/830159188 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fafa806c100 msgr2=0x7fafa806e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:46.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.913+0000 7fafcce00640 1 --2- 172.21.15.144:0/830159188 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fafa806c100 0x7fafa806e5c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fafb8001780 tx=0x7fafb8009040 comp rx=0 tx=0).stop 2024-09-11T23:23:46.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.913+0000 7fafcce00640 1 -- 172.21.15.144:0/830159188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafc80cf5d0 msgr2=0x7fafc80aeb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:46.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.913+0000 7fafcce00640 1 --2- 172.21.15.144:0/830159188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafc80cf5d0 0x7fafc80aeb50 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fafb400d5f0 tx=0x7fafb400dab0 comp rx=0 tx=0).stop 2024-09-11T23:23:46.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.913+0000 7fafcce00640 1 -- 172.21.15.144:0/830159188 shutdown_connections 2024-09-11T23:23:46.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.913+0000 7fafcce00640 1 --2- 172.21.15.144:0/830159188 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fafa806c100 0x7fafa806e5c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.913+0000 7fafcce00640 1 --2- 172.21.15.144:0/830159188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafc8145d90 0x7fafc8140a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.913+0000 7fafcce00640 1 --2- 172.21.15.144:0/830159188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafc80cf5d0 0x7fafc80aeb50 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.913+0000 7fafcce00640 1 --2- 172.21.15.144:0/830159188 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafc806d4f0 0x7fafc80c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.913+0000 7fafcce00640 1 -- 172.21.15.144:0/830159188 >> 172.21.15.144:0/830159188 conn(0x7fafc806bba0 msgr2=0x7fafc80b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.913+0000 7fafcce00640 1 -- 172.21.15.144:0/830159188 shutdown_connections 2024-09-11T23:23:46.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:46.913+0000 7fafcce00640 1 -- 172.21.15.144:0/830159188 wait complete. 2024-09-11T23:23:46.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:46.929 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol38500/.meta) 2024-09-11T23:23:46.985 INFO:teuthology.orchestra.run.smithi144.stdout:[GLOBAL] 2024-09-11T23:23:46.986 INFO:teuthology.orchestra.run.smithi144.stdout:version = 1 2024-09-11T23:23:46.986 INFO:teuthology.orchestra.run.smithi144.stdout:type = subvolume 2024-09-11T23:23:46.986 INFO:teuthology.orchestra.run.smithi144.stdout:path = /volumes/_nogroup/subvol38500/87febd14-a8f2-493e-97c6-81df4805bfee 2024-09-11T23:23:46.986 INFO:teuthology.orchestra.run.smithi144.stdout:state = complete 2024-09-11T23:23:46.986 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:46.989 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol38500 2024-09-11T23:23:47.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.147+0000 7fc2cda00640 1 Processor -- start 2024-09-11T23:23:47.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.147+0000 7fc2cda00640 1 -- start start 2024-09-11T23:23:47.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.148+0000 7fc2cda00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc2c8158e50 0x7fc2c80b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:47.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.148+0000 7fc2cda00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc2c815c370 0x7fc2c806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:47.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.148+0000 7fc2cda00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2c815c800 con 0x7fc2c806ef60 2024-09-11T23:23:47.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.148+0000 7fc2cda00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc2c80b43f0 con 0x7fc2c8158e50 2024-09-11T23:23:47.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.148+0000 7fc2cda00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc2c80b3630 con 0x7fc2c815c370 2024-09-11T23:23:47.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.148+0000 7fc2c6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc2c8158e50 0x7fc2c80b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:47.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.149+0000 7fc2c6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc2c8158e50 0x7fc2c80b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53130/0 (socket says 172.21.15.144:53130) 2024-09-11T23:23:47.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.149+0000 7fc2c6a00640 1 -- 172.21.15.144:0/2841429684 learned_addr learned my addr 172.21.15.144:0/2841429684 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:47.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.149+0000 7fc2c6000640 1 --2- 172.21.15.144:0/2841429684 >> v2:172.21.15.165:3300/0 conn(0x7fc2c815c370 0x7fc2c806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:47.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.149+0000 7fc2c6a00640 1 -- 172.21.15.144:0/2841429684 >> v2:172.21.15.165:3300/0 conn(0x7fc2c815c370 msgr2=0x7fc2c806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:47.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.149+0000 7fc2c6a00640 1 --2- 172.21.15.144:0/2841429684 >> v2:172.21.15.165:3300/0 conn(0x7fc2c815c370 0x7fc2c806ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:47.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.149+0000 7fc2c6a00640 1 -- 172.21.15.144:0/2841429684 >> v1:172.21.15.144:6789/0 conn(0x7fc2c806ef60 legacy=0x7fc2c815ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:47.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.149+0000 7fc2c6a00640 1 -- 172.21.15.144:0/2841429684 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c80b3910 con 0x7fc2c8158e50 2024-09-11T23:23:47.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.149+0000 7fc2c6000640 1 --2- 172.21.15.144:0/2841429684 >> v2:172.21.15.165:3300/0 conn(0x7fc2c815c370 0x7fc2c806ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:23:47.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.150+0000 7fc2c6a00640 1 --2- 172.21.15.144:0/2841429684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2c8158e50 0x7fc2c80b5050 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80cdd40 tx=0x7fc2b802a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e11136f0de21da3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:47.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.150+0000 7fc2c5600640 1 -- 172.21.15.144:0/2841429684 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8037070 con 0x7fc2c8158e50 2024-09-11T23:23:47.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.150+0000 7fc2c5600640 1 -- 172.21.15.144:0/2841429684 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b8032440 con 0x7fc2c8158e50 2024-09-11T23:23:47.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.150+0000 7fc2c5600640 1 -- 172.21.15.144:0/2841429684 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8032810 con 0x7fc2c8158e50 2024-09-11T23:23:47.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.151+0000 7fc2cda00640 1 -- 172.21.15.144:0/2841429684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2c8158e50 msgr2=0x7fc2c80b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:47.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.151+0000 7fc2cda00640 1 --2- 172.21.15.144:0/2841429684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2c8158e50 0x7fc2c80b5050 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80cdd40 tx=0x7fc2b802a280 comp rx=0 tx=0).stop 2024-09-11T23:23:47.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.151+0000 7fc2cda00640 1 -- 172.21.15.144:0/2841429684 shutdown_connections 2024-09-11T23:23:47.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.151+0000 7fc2cda00640 1 --2- 172.21.15.144:0/2841429684 >> v2:172.21.15.165:3300/0 conn(0x7fc2c815c370 0x7fc2c806ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:47.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.151+0000 7fc2cda00640 1 --2- 172.21.15.144:0/2841429684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2c8158e50 0x7fc2c80b5050 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:47.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.151+0000 7fc2cda00640 1 -- 172.21.15.144:0/2841429684 >> 172.21.15.144:0/2841429684 conn(0x7fc2c806bba0 msgr2=0x7fc2c806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:47.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.151+0000 7fc2cda00640 1 -- 172.21.15.144:0/2841429684 shutdown_connections 2024-09-11T23:23:47.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.151+0000 7fc2cda00640 1 -- 172.21.15.144:0/2841429684 wait complete. 2024-09-11T23:23:47.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.152+0000 7fc2cda00640 1 Processor -- start 2024-09-11T23:23:47.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.152+0000 7fc2cda00640 1 -- start start 2024-09-11T23:23:47.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.153+0000 7fc2cda00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2c806ef60 0x7fc2c81557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:47.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.153+0000 7fc2cda00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2c8158e50 0x7fc2c81574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:47.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.153+0000 7fc2cda00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2c815c370 0x7fc2c80b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:47.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.153+0000 7fc2cda00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c8159230 con 0x7fc2c806ef60 2024-09-11T23:23:47.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.153+0000 7fc2cda00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c80b3ed0 con 0x7fc2c8158e50 2024-09-11T23:23:47.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.153+0000 7fc2cda00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc2c80cf210 con 0x7fc2c815c370 2024-09-11T23:23:47.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.154+0000 7fc2c6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2c806ef60 0x7fc2c81557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:47.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.154+0000 7fc2c6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2c806ef60 0x7fc2c81557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53146/0 (socket says 172.21.15.144:53146) 2024-09-11T23:23:47.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.154+0000 7fc2c6a00640 1 -- 172.21.15.144:0/1682910557 learned_addr learned my addr 172.21.15.144:0/1682910557 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:47.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.154+0000 7fc2c6000640 1 --2- 172.21.15.144:0/1682910557 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2c8158e50 0x7fc2c81574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:47.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.154+0000 7fc2c7400640 1 --2- 172.21.15.144:0/1682910557 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2c815c370 0x7fc2c80b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:47.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.154+0000 7fc2c6a00640 1 -- 172.21.15.144:0/1682910557 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2c815c370 msgr2=0x7fc2c80b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:47.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.154+0000 7fc2c6a00640 1 --2- 172.21.15.144:0/1682910557 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2c815c370 0x7fc2c80b0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:47.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.154+0000 7fc2c6a00640 1 -- 172.21.15.144:0/1682910557 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2c8158e50 msgr2=0x7fc2c81574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:47.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.154+0000 7fc2c6a00640 1 --2- 172.21.15.144:0/1682910557 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2c8158e50 0x7fc2c81574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:47.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.154+0000 7fc2c6a00640 1 -- 172.21.15.144:0/1682910557 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c80af230 con 0x7fc2c806ef60 2024-09-11T23:23:47.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.154+0000 7fc2c6000640 1 --2- 172.21.15.144:0/1682910557 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2c8158e50 0x7fc2c81574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:23:47.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.154+0000 7fc2c6a00640 1 --2- 172.21.15.144:0/1682910557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2c806ef60 0x7fc2c81557a0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fc2b802a2c0 tx=0x7fc2b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:47.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.154+0000 7fc2bea00640 1 -- 172.21.15.144:0/1682910557 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8037040 con 0x7fc2c806ef60 2024-09-11T23:23:47.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.154+0000 7fc2bea00640 1 -- 172.21.15.144:0/1682910557 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b8042070 con 0x7fc2c806ef60 2024-09-11T23:23:47.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.154+0000 7fc2bea00640 1 -- 172.21.15.144:0/1682910557 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8030bb0 con 0x7fc2c806ef60 2024-09-11T23:23:47.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.155+0000 7fc2cda00640 1 -- 172.21.15.144:0/1682910557 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c80af510 con 0x7fc2c806ef60 2024-09-11T23:23:47.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.155+0000 7fc2cda00640 1 -- 172.21.15.144:0/1682910557 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c8152330 con 0x7fc2c806ef60 2024-09-11T23:23:47.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.156+0000 7fc2cda00640 1 -- 172.21.15.144:0/1682910557 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2c80b4970 con 0x7fc2c806ef60 2024-09-11T23:23:47.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.157+0000 7fc2bea00640 1 -- 172.21.15.144:0/1682910557 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 90753+0+0 (secure 0 0 0) 0x7fc2b8047460 con 0x7fc2c806ef60 2024-09-11T23:23:47.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.157+0000 7fc2bea00640 1 --2- 172.21.15.144:0/1682910557 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc2a806c130 0x7fc2a806e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:47.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.158+0000 7fc2bea00640 1 -- 172.21.15.144:0/1682910557 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7fc2b80abf40 con 0x7fc2c806ef60 2024-09-11T23:23:47.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.158+0000 7fc2c6000640 1 --2- 172.21.15.144:0/1682910557 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc2a806c130 0x7fc2a806e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:47.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.159+0000 7fc2c6000640 1 --2- 172.21.15.144:0/1682910557 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc2a806c130 0x7fc2a806e5f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4006fd0 tx=0x7fc2b4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:47.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.162+0000 7fc2bea00640 1 -- 172.21.15.144:0/1682910557 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc2b8045360 con 0x7fc2c806ef60 2024-09-11T23:23:47.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.360+0000 7fc2cda00640 1 -- 172.21.15.144:0/1682910557 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol38500", "target": ["mon-mgr", ""]}) -- 0x7fc2c8153000 con 0x7fc2a806c130 2024-09-11T23:23:47.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.402+0000 7fc2bea00640 1 -- 172.21.15.144:0/1682910557 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc2c8153000 con 0x7fc2a806c130 2024-09-11T23:23:47.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.404+0000 7fc2cda00640 1 -- 172.21.15.144:0/1682910557 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc2a806c130 msgr2=0x7fc2a806e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:47.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.404+0000 7fc2cda00640 1 --2- 172.21.15.144:0/1682910557 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc2a806c130 0x7fc2a806e5f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4006fd0 tx=0x7fc2b4008040 comp rx=0 tx=0).stop 2024-09-11T23:23:47.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.404+0000 7fc2cda00640 1 -- 172.21.15.144:0/1682910557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2c806ef60 msgr2=0x7fc2c81557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:47.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.404+0000 7fc2cda00640 1 --2- 172.21.15.144:0/1682910557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2c806ef60 0x7fc2c81557a0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fc2b802a2c0 tx=0x7fc2b80046c0 comp rx=0 tx=0).stop 2024-09-11T23:23:47.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.404+0000 7fc2cda00640 1 -- 172.21.15.144:0/1682910557 shutdown_connections 2024-09-11T23:23:47.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.404+0000 7fc2cda00640 1 --2- 172.21.15.144:0/1682910557 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc2a806c130 0x7fc2a806e5f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:47.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.404+0000 7fc2cda00640 1 --2- 172.21.15.144:0/1682910557 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc2c815c370 0x7fc2c80b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:47.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.404+0000 7fc2cda00640 1 --2- 172.21.15.144:0/1682910557 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2c8158e50 0x7fc2c81574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:47.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.404+0000 7fc2cda00640 1 --2- 172.21.15.144:0/1682910557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc2c806ef60 0x7fc2c81557a0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:47.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.404+0000 7fc2cda00640 1 -- 172.21.15.144:0/1682910557 >> 172.21.15.144:0/1682910557 conn(0x7fc2c806bba0 msgr2=0x7fc2c80cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:47.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.404+0000 7fc2cda00640 1 -- 172.21.15.144:0/1682910557 shutdown_connections 2024-09-11T23:23:47.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.404+0000 7fc2cda00640 1 -- 172.21.15.144:0/1682910557 wait complete. 2024-09-11T23:23:47.407 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:47.407+0000 7f30e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:47.407 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:47.407+0000 7f30e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:47.407 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:47.407+0000 7f30e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:47.407 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:47.407+0000 7f30e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:47.407 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:47.407+0000 7f30e1e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:47.421 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone9810 2024-09-11T23:23:47.426 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:47.426+0000 7f30e0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:47.427 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:47.426+0000 7f30e0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:47.427 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:47.426+0000 7f30e0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:47.427 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:47.426+0000 7f30e0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:47.427 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:23:47.426+0000 7f30e0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:23:47.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.584+0000 7fde37e00640 1 Processor -- start 2024-09-11T23:23:47.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.584+0000 7fde37e00640 1 -- start start 2024-09-11T23:23:47.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.585+0000 7fde37e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde380cf510 0x7fde380b7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:47.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.585+0000 7fde37e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde3815eaa0 con 0x7fde380b7bb0 2024-09-11T23:23:47.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.585+0000 7fde37e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde380d28c0 con 0x7fde3815e6c0 2024-09-11T23:23:47.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.585+0000 7fde37e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fde380d34d0 con 0x7fde380cf510 2024-09-11T23:23:47.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.585+0000 7fde37400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fde380b7bb0 0x7fde3806d610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52332/0 (socket says 172.21.15.144:52332) 2024-09-11T23:23:47.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.585+0000 7fde37400640 1 -- 172.21.15.144:0/241875668 learned_addr learned my addr 172.21.15.144:0/241875668 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:47.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.585+0000 7fde36000640 1 --2- 172.21.15.144:0/241875668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde380cf510 0x7fde380b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:47.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.586+0000 7fde35600640 1 -- 172.21.15.144:0/241875668 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1434818770 0 0) 0x7fde3815eaa0 con 0x7fde380b7bb0 2024-09-11T23:23:47.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.586+0000 7fde35600640 1 -- 172.21.15.144:0/241875668 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde1c003520 con 0x7fde380b7bb0 2024-09-11T23:23:47.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.586+0000 7fde35600640 1 -- 172.21.15.144:0/241875668 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2490964470 0 0) 0x7fde380d28c0 con 0x7fde3815e6c0 2024-09-11T23:23:47.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.586+0000 7fde35600640 1 -- 172.21.15.144:0/241875668 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde3815eaa0 con 0x7fde3815e6c0 2024-09-11T23:23:47.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.586+0000 7fde36000640 1 -- 172.21.15.144:0/241875668 >> v1:172.21.15.165:6789/0 conn(0x7fde3815e6c0 legacy=0x7fde3806c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:47.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.586+0000 7fde36000640 1 -- 172.21.15.144:0/241875668 >> v1:172.21.15.144:6789/0 conn(0x7fde380b7bb0 legacy=0x7fde3806d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:47.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.586+0000 7fde36000640 1 -- 172.21.15.144:0/241875668 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde380d2ba0 con 0x7fde380cf510 2024-09-11T23:23:47.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.587+0000 7fde36000640 1 --2- 172.21.15.144:0/241875668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde380cf510 0x7fde380b7670 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fde240097d0 tx=0x7fde2402a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3e15088cb5b2ee6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:47.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.587+0000 7fde35600640 1 -- 172.21.15.144:0/241875668 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde24037070 con 0x7fde380cf510 2024-09-11T23:23:47.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.588+0000 7fde35600640 1 -- 172.21.15.144:0/241875668 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde24032440 con 0x7fde380cf510 2024-09-11T23:23:47.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.588+0000 7fde35600640 1 -- 172.21.15.144:0/241875668 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde240327f0 con 0x7fde380cf510 2024-09-11T23:23:47.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.588+0000 7fde37e00640 1 -- 172.21.15.144:0/241875668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde380cf510 msgr2=0x7fde380b7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:47.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.588+0000 7fde37e00640 1 --2- 172.21.15.144:0/241875668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde380cf510 0x7fde380b7670 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fde240097d0 tx=0x7fde2402a290 comp rx=0 tx=0).stop 2024-09-11T23:23:47.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.588+0000 7fde37e00640 1 -- 172.21.15.144:0/241875668 shutdown_connections 2024-09-11T23:23:47.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.588+0000 7fde37e00640 1 --2- 172.21.15.144:0/241875668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde380cf510 0x7fde380b7670 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:47.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.588+0000 7fde37e00640 1 -- 172.21.15.144:0/241875668 >> 172.21.15.144:0/241875668 conn(0x7fde380d4720 msgr2=0x7fde380d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:47.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.588+0000 7fde37e00640 1 -- 172.21.15.144:0/241875668 shutdown_connections 2024-09-11T23:23:47.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.588+0000 7fde37e00640 1 -- 172.21.15.144:0/241875668 wait complete. 2024-09-11T23:23:47.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.590+0000 7fde37e00640 1 Processor -- start 2024-09-11T23:23:47.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.590+0000 7fde37e00640 1 -- start start 2024-09-11T23:23:47.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.591+0000 7fde37e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde380b7bb0 0x7fde3815f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:47.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.591+0000 7fde37e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde380cf510 0x7fde3815af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:47.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.591+0000 7fde37e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde3815e6c0 0x7fde380cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:47.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.591+0000 7fde37e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fde3806dd20 con 0x7fde3815e6c0 2024-09-11T23:23:47.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.591+0000 7fde37e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fde380d3160 con 0x7fde380cf510 2024-09-11T23:23:47.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.591+0000 7fde37e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fde3806dea0 con 0x7fde380b7bb0 2024-09-11T23:23:47.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.591+0000 7fde37400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde3815e6c0 0x7fde380cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:47.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.591+0000 7fde37400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde3815e6c0 0x7fde380cdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53160/0 (socket says 172.21.15.144:53160) 2024-09-11T23:23:47.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.591+0000 7fde37400640 1 -- 172.21.15.144:0/2732140974 learned_addr learned my addr 172.21.15.144:0/2732140974 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:47.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.591+0000 7fde36000640 1 --2- 172.21.15.144:0/2732140974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde380cf510 0x7fde3815af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:47.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.591+0000 7fde36a00640 1 --2- 172.21.15.144:0/2732140974 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde380b7bb0 0x7fde3815f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:47.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.591+0000 7fde37400640 1 -- 172.21.15.144:0/2732140974 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde380b7bb0 msgr2=0x7fde3815f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:47.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.591+0000 7fde37400640 1 --2- 172.21.15.144:0/2732140974 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde380b7bb0 0x7fde3815f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:47.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.591+0000 7fde37400640 1 -- 172.21.15.144:0/2732140974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde380cf510 msgr2=0x7fde3815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:47.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.591+0000 7fde37400640 1 --2- 172.21.15.144:0/2732140974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde380cf510 0x7fde3815af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:47.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.591+0000 7fde37400640 1 -- 172.21.15.144:0/2732140974 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde381f52d0 con 0x7fde3815e6c0 2024-09-11T23:23:47.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.592+0000 7fde37400640 1 --2- 172.21.15.144:0/2732140974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde3815e6c0 0x7fde380cdd70 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fde3000cbd0 tx=0x7fde3000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:47.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.592+0000 7fde2f400640 1 -- 172.21.15.144:0/2732140974 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde30017070 con 0x7fde3815e6c0 2024-09-11T23:23:47.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.592+0000 7fde2f400640 1 -- 172.21.15.144:0/2732140974 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde3000ace0 con 0x7fde3815e6c0 2024-09-11T23:23:47.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.592+0000 7fde37e00640 1 -- 172.21.15.144:0/2732140974 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde3815eeb0 con 0x7fde3815e6c0 2024-09-11T23:23:47.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.592+0000 7fde2f400640 1 -- 172.21.15.144:0/2732140974 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde30012620 con 0x7fde3815e6c0 2024-09-11T23:23:47.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.592+0000 7fde37e00640 1 -- 172.21.15.144:0/2732140974 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde3815f470 con 0x7fde3815e6c0 2024-09-11T23:23:47.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.593+0000 7fde37e00640 1 -- 172.21.15.144:0/2732140974 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde380d0470 con 0x7fde3815e6c0 2024-09-11T23:23:47.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.594+0000 7fde2f400640 1 -- 172.21.15.144:0/2732140974 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 18) ==== 90753+0+0 (secure 0 0 0) 0x7fde3001a070 con 0x7fde3815e6c0 2024-09-11T23:23:47.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.595+0000 7fde2f400640 1 --2- 172.21.15.144:0/2732140974 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fde1806c100 0x7fde1806e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:47.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.595+0000 7fde2f400640 1 -- 172.21.15.144:0/2732140974 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7fde3008b2b0 con 0x7fde3815e6c0 2024-09-11T23:23:47.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.595+0000 7fde36a00640 1 --2- 172.21.15.144:0/2732140974 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fde1806c100 0x7fde1806e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:47.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.596+0000 7fde36a00640 1 --2- 172.21.15.144:0/2732140974 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fde1806c100 0x7fde1806e5c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fde28000f60 tx=0x7fde28009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:47.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.599+0000 7fde2f400640 1 -- 172.21.15.144:0/2732140974 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fde380d0470 con 0x7fde3815e6c0 2024-09-11T23:23:47.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.799+0000 7fde37e00640 1 -- 172.21.15.144:0/2732140974 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone9810", "target": ["mon-mgr", ""]}) -- 0x7fde3815b4d0 con 0x7fde1806c100 2024-09-11T23:23:47.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.820+0000 7fde2f400640 1 -- 172.21.15.144:0/2732140974 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fde28001450 con 0x7fde1806c100 2024-09-11T23:23:47.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.824+0000 7fde37e00640 1 -- 172.21.15.144:0/2732140974 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fde1806c100 msgr2=0x7fde1806e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:47.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.824+0000 7fde37e00640 1 --2- 172.21.15.144:0/2732140974 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fde1806c100 0x7fde1806e5c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fde28000f60 tx=0x7fde28009040 comp rx=0 tx=0).stop 2024-09-11T23:23:47.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.824+0000 7fde37e00640 1 -- 172.21.15.144:0/2732140974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde3815e6c0 msgr2=0x7fde380cdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:47.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.824+0000 7fde37e00640 1 --2- 172.21.15.144:0/2732140974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde3815e6c0 0x7fde380cdd70 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fde3000cbd0 tx=0x7fde3000a430 comp rx=0 tx=0).stop 2024-09-11T23:23:47.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.824+0000 7fde37e00640 1 -- 172.21.15.144:0/2732140974 shutdown_connections 2024-09-11T23:23:47.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.824+0000 7fde37e00640 1 --2- 172.21.15.144:0/2732140974 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fde1806c100 0x7fde1806e5c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:47.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.824+0000 7fde37e00640 1 --2- 172.21.15.144:0/2732140974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde3815e6c0 0x7fde380cdd70 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:47.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.824+0000 7fde37e00640 1 --2- 172.21.15.144:0/2732140974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde380cf510 0x7fde3815af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:47.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.824+0000 7fde37e00640 1 --2- 172.21.15.144:0/2732140974 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde380b7bb0 0x7fde3815f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:47.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.824+0000 7fde37e00640 1 -- 172.21.15.144:0/2732140974 >> 172.21.15.144:0/2732140974 conn(0x7fde380d4720 msgr2=0x7fde3815d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:47.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.824+0000 7fde37e00640 1 -- 172.21.15.144:0/2732140974 shutdown_connections 2024-09-11T23:23:47.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:47.824+0000 7fde37e00640 1 -- 172.21.15.144:0/2732140974 wait complete. 2024-09-11T23:23:47.845 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone12571 2024-09-11T23:23:48.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.007+0000 7f5d6a200640 1 Processor -- start 2024-09-11T23:23:48.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.007+0000 7f5d6a200640 1 -- start start 2024-09-11T23:23:48.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.008+0000 7f5d6a200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5d6415d790 0x7f5d640cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:48.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.008+0000 7f5d6a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d640cd3b0 0x7f5d640cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:48.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.008+0000 7f5d6a200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d6406d700 con 0x7f5d6415d3b0 2024-09-11T23:23:48.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.008+0000 7f5d6a200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5d6406da30 con 0x7f5d6415d790 2024-09-11T23:23:48.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.008+0000 7f5d6a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5d640cde80 con 0x7f5d640cd3b0 2024-09-11T23:23:48.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.009+0000 7f5d62a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5d6415d790 0x7f5d640cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:48.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.009+0000 7f5d63400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5d6415d3b0 0x7f5d64071080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52340/0 (socket says 172.21.15.144:52340) 2024-09-11T23:23:48.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.009+0000 7f5d63400640 1 -- 172.21.15.144:0/2829539822 learned_addr learned my addr 172.21.15.144:0/2829539822 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:48.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.009+0000 7f5d63e00640 1 --2- 172.21.15.144:0/2829539822 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d640cd3b0 0x7f5d640cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:48.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.009+0000 7f5d62a00640 1 -- 172.21.15.144:0/2829539822 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d640cd3b0 msgr2=0x7f5d640cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:48.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.009+0000 7f5d62a00640 1 --2- 172.21.15.144:0/2829539822 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d640cd3b0 0x7f5d640cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:48.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.009+0000 7f5d62a00640 1 -- 172.21.15.144:0/2829539822 >> v1:172.21.15.144:6789/0 conn(0x7f5d6415d3b0 legacy=0x7f5d64071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:48.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.009+0000 7f5d62a00640 1 -- 172.21.15.144:0/2829539822 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d640cd8c0 con 0x7f5d6415d790 2024-09-11T23:23:48.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.009+0000 7f5d62000640 1 -- 172.21.15.144:0/2829539822 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1917953483 0 0) 0x7f5d6406d700 con 0x7f5d6415d3b0 2024-09-11T23:23:48.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.010+0000 7f5d62a00640 1 --2- 172.21.15.144:0/2829539822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d6415d790 0x7f5d640cce70 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f5d6406dbb0 tx=0x7f5d5002a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24229411a3c469ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:48.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.010+0000 7f5d62000640 1 -- 172.21.15.144:0/2829539822 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d50037070 con 0x7f5d6415d790 2024-09-11T23:23:48.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.010+0000 7f5d62000640 1 -- 172.21.15.144:0/2829539822 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d50032440 con 0x7f5d6415d790 2024-09-11T23:23:48.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.010+0000 7f5d62000640 1 -- 172.21.15.144:0/2829539822 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d50032810 con 0x7f5d6415d790 2024-09-11T23:23:48.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.011+0000 7f5d6a200640 1 -- 172.21.15.144:0/2829539822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d6415d790 msgr2=0x7f5d640cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:48.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.011+0000 7f5d6a200640 1 --2- 172.21.15.144:0/2829539822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d6415d790 0x7f5d640cce70 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f5d6406dbb0 tx=0x7f5d5002a160 comp rx=0 tx=0).stop 2024-09-11T23:23:48.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.011+0000 7f5d6a200640 1 -- 172.21.15.144:0/2829539822 shutdown_connections 2024-09-11T23:23:48.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.011+0000 7f5d6a200640 1 --2- 172.21.15.144:0/2829539822 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d640cd3b0 0x7f5d640cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:48.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.011+0000 7f5d6a200640 1 --2- 172.21.15.144:0/2829539822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d6415d790 0x7f5d640cce70 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:48.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.011+0000 7f5d6a200640 1 -- 172.21.15.144:0/2829539822 >> 172.21.15.144:0/2829539822 conn(0x7f5d6406bba0 msgr2=0x7f5d6406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:48.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.011+0000 7f5d6a200640 1 -- 172.21.15.144:0/2829539822 shutdown_connections 2024-09-11T23:23:48.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.011+0000 7f5d6a200640 1 -- 172.21.15.144:0/2829539822 wait complete. 2024-09-11T23:23:48.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.013+0000 7f5d6a200640 1 Processor -- start 2024-09-11T23:23:48.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.013+0000 7f5d6a200640 1 -- start start 2024-09-11T23:23:48.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.014+0000 7f5d6a200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d640cd3b0 0x7f5d64152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:48.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.014+0000 7f5d6a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d6415d3b0 0x7f5d641568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:48.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.014+0000 7f5d6a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d640ad450 0x7f5d6415b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:48.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.014+0000 7f5d6a200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6415cd70 con 0x7f5d6415d3b0 2024-09-11T23:23:48.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.014+0000 7f5d6a200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5d6415cbf0 con 0x7f5d640cd3b0 2024-09-11T23:23:48.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.014+0000 7f5d6a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5d640cf860 con 0x7f5d640ad450 2024-09-11T23:23:48.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.014+0000 7f5d62a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d6415d3b0 0x7f5d641568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:48.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.014+0000 7f5d62a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d6415d3b0 0x7f5d641568b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53176/0 (socket says 172.21.15.144:53176) 2024-09-11T23:23:48.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.014+0000 7f5d62a00640 1 -- 172.21.15.144:0/761876361 learned_addr learned my addr 172.21.15.144:0/761876361 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:48.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.014+0000 7f5d63400640 1 --2- 172.21.15.144:0/761876361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d640cd3b0 0x7f5d64152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:48.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.014+0000 7f5d63e00640 1 --2- 172.21.15.144:0/761876361 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d640ad450 0x7f5d6415b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:48.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.014+0000 7f5d62a00640 1 -- 172.21.15.144:0/761876361 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d640ad450 msgr2=0x7f5d6415b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:48.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.014+0000 7f5d62a00640 1 --2- 172.21.15.144:0/761876361 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d640ad450 0x7f5d6415b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:48.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.014+0000 7f5d62a00640 1 -- 172.21.15.144:0/761876361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d640cd3b0 msgr2=0x7f5d64152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:48.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.014+0000 7f5d62a00640 1 --2- 172.21.15.144:0/761876361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d640cd3b0 0x7f5d64152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:48.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.014+0000 7f5d62a00640 1 -- 172.21.15.144:0/761876361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d64156df0 con 0x7f5d6415d3b0 2024-09-11T23:23:48.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.014+0000 7f5d62a00640 1 --2- 172.21.15.144:0/761876361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d6415d3b0 0x7f5d641568b0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f5d50000c00 tx=0x7f5d500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:48.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.015+0000 7f5d5b400640 1 -- 172.21.15.144:0/761876361 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d50037040 con 0x7f5d6415d3b0 2024-09-11T23:23:48.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.015+0000 7f5d5b400640 1 -- 172.21.15.144:0/761876361 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d50042070 con 0x7f5d6415d3b0 2024-09-11T23:23:48.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.015+0000 7f5d6a200640 1 -- 172.21.15.144:0/761876361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d640ad930 con 0x7f5d6415d3b0 2024-09-11T23:23:48.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.015+0000 7f5d5b400640 1 -- 172.21.15.144:0/761876361 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d50030960 con 0x7f5d6415d3b0 2024-09-11T23:23:48.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.015+0000 7f5d6a200640 1 -- 172.21.15.144:0/761876361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d640adef0 con 0x7f5d6415d3b0 2024-09-11T23:23:48.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.016+0000 7f5d6a200640 1 -- 172.21.15.144:0/761876361 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d640cfc90 con 0x7f5d6415d3b0 2024-09-11T23:23:48.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.017+0000 7f5d5b400640 1 -- 172.21.15.144:0/761876361 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 90804+0+0 (secure 0 0 0) 0x7f5d50030b00 con 0x7f5d6415d3b0 2024-09-11T23:23:48.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.018+0000 7f5d5b400640 1 --2- 172.21.15.144:0/761876361 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5d4406c1c0 0x7f5d4406e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:48.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.018+0000 7f5d5b400640 1 -- 172.21.15.144:0/761876361 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f5d500abce0 con 0x7f5d6415d3b0 2024-09-11T23:23:48.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.018+0000 7f5d63400640 1 --2- 172.21.15.144:0/761876361 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5d4406c1c0 0x7f5d4406e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:48.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.019+0000 7f5d63400640 1 --2- 172.21.15.144:0/761876361 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5d4406c1c0 0x7f5d4406e680 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5d540012e0 tx=0x7f5d54007ef0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:48.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.022+0000 7f5d5b400640 1 -- 172.21.15.144:0/761876361 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d5007a3b0 con 0x7f5d6415d3b0 2024-09-11T23:23:48.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.219+0000 7f5d6a200640 1 -- 172.21.15.144:0/761876361 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone12571", "target": ["mon-mgr", ""]}) -- 0x7f5d640634e0 con 0x7f5d4406c1c0 2024-09-11T23:23:48.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.238+0000 7f5d5b400640 1 -- 172.21.15.144:0/761876361 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5d640634e0 con 0x7f5d4406c1c0 2024-09-11T23:23:48.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.240+0000 7f5d6a200640 1 -- 172.21.15.144:0/761876361 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5d4406c1c0 msgr2=0x7f5d4406e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:48.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.240+0000 7f5d6a200640 1 --2- 172.21.15.144:0/761876361 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5d4406c1c0 0x7f5d4406e680 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5d540012e0 tx=0x7f5d54007ef0 comp rx=0 tx=0).stop 2024-09-11T23:23:48.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.240+0000 7f5d6a200640 1 -- 172.21.15.144:0/761876361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d6415d3b0 msgr2=0x7f5d641568b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:48.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.240+0000 7f5d6a200640 1 --2- 172.21.15.144:0/761876361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d6415d3b0 0x7f5d641568b0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f5d50000c00 tx=0x7f5d500046c0 comp rx=0 tx=0).stop 2024-09-11T23:23:48.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.240+0000 7f5d6a200640 1 -- 172.21.15.144:0/761876361 shutdown_connections 2024-09-11T23:23:48.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.240+0000 7f5d6a200640 1 --2- 172.21.15.144:0/761876361 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5d4406c1c0 0x7f5d4406e680 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:48.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.240+0000 7f5d6a200640 1 --2- 172.21.15.144:0/761876361 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d640ad450 0x7f5d6415b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:48.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.240+0000 7f5d6a200640 1 --2- 172.21.15.144:0/761876361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d6415d3b0 0x7f5d641568b0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:48.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.240+0000 7f5d6a200640 1 --2- 172.21.15.144:0/761876361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d640cd3b0 0x7f5d64152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:48.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.240+0000 7f5d6a200640 1 -- 172.21.15.144:0/761876361 >> 172.21.15.144:0/761876361 conn(0x7f5d6406bba0 msgr2=0x7f5d6415f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:48.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.240+0000 7f5d6a200640 1 -- 172.21.15.144:0/761876361 shutdown_connections 2024-09-11T23:23:48.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.240+0000 7f5d6a200640 1 -- 172.21.15.144:0/761876361 wait complete. 2024-09-11T23:23:48.257 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-11T23:23:48.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:23:48.342 INFO:teuthology.orchestra.run.smithi144.stdout:2 2024-09-11T23:23:48.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:23:48.351 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:23:48.351 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:23:48.436 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:23:48.534 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:23:48.535 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:23:48.535 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:23:48.535 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:48.571 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:23:48.571 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:48.647 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:23:48.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.843+0000 7f39a8400640 1 Processor -- start 2024-09-11T23:23:48.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.843+0000 7f39a8400640 1 -- start start 2024-09-11T23:23:48.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.845+0000 7f39a8400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f39a00d02a0 0x7f39a00d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:48.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.845+0000 7f39a8400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f39a015ca40 0x7f39a015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:48.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.845+0000 7f39a8400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39a00d0bc0 con 0x7f39a015ce80 2024-09-11T23:23:48.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.845+0000 7f39a8400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f39a015d390 con 0x7f39a015ca40 2024-09-11T23:23:48.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.845+0000 7f39a8400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f39a015d670 con 0x7f39a00d02a0 2024-09-11T23:23:48.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.845+0000 7f39a5000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f39a015ca40 0x7f39a015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:48.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.845+0000 7f39a5a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f39a00d02a0 0x7f39a00d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:48.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.845+0000 7f39a5000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f39a015ca40 0x7f39a015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:56040/0 (socket says 172.21.15.144:56040) 2024-09-11T23:23:48.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.845+0000 7f39a5a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f39a00d02a0 0x7f39a00d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:60292/0 (socket says 172.21.15.144:60292) 2024-09-11T23:23:48.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.845+0000 7f39a6400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f39a015ce80 0x7f39a01594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:34460/0 (socket says 172.21.15.144:34460) 2024-09-11T23:23:48.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.845+0000 7f39a5000640 1 -- 172.21.15.144:0/1416784303 learned_addr learned my addr 172.21.15.144:0/1416784303 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:48.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.846+0000 7f399fe00640 1 -- 172.21.15.144:0/1416784303 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3238907403 0 0) 0x7f39a00d0bc0 con 0x7f39a015ce80 2024-09-11T23:23:48.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.846+0000 7f399fe00640 1 -- 172.21.15.144:0/1416784303 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3988005730 con 0x7f39a015ce80 2024-09-11T23:23:48.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.846+0000 7f39a5a00640 1 -- 172.21.15.144:0/1416784303 >> v2:172.21.15.165:3300/0 conn(0x7f39a015ca40 msgr2=0x7f39a015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:48.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.846+0000 7f39a5a00640 1 --2- 172.21.15.144:0/1416784303 >> v2:172.21.15.165:3300/0 conn(0x7f39a015ca40 0x7f39a015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:48.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.846+0000 7f39a5a00640 1 -- 172.21.15.144:0/1416784303 >> v1:172.21.15.165:6789/0 conn(0x7f39a015ce80 legacy=0x7f39a01594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:48.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.846+0000 7f39a5a00640 1 -- 172.21.15.144:0/1416784303 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a015d950 con 0x7f39a00d02a0 2024-09-11T23:23:48.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.846+0000 7f39a5000640 1 --2- 172.21.15.144:0/1416784303 >> v2:172.21.15.165:3300/0 conn(0x7f39a015ca40 0x7f39a015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:23:48.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.847+0000 7f39a5a00640 1 --2- 172.21.15.144:0/1416784303 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f39a00d02a0 0x7f39a00d0680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f39940097a0 tx=0x7f399402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f8b7e48dff43ae3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:48.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.847+0000 7f399fe00640 1 -- 172.21.15.144:0/1416784303 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3994037070 con 0x7f39a00d02a0 2024-09-11T23:23:48.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.847+0000 7f399fe00640 1 -- 172.21.15.144:0/1416784303 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f399402ae50 con 0x7f39a00d02a0 2024-09-11T23:23:48.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.847+0000 7f399fe00640 1 -- 172.21.15.144:0/1416784303 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3994032660 con 0x7f39a00d02a0 2024-09-11T23:23:48.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.848+0000 7f39a8400640 1 -- 172.21.15.144:0/1416784303 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f39a00d02a0 msgr2=0x7f39a00d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:48.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.848+0000 7f39a8400640 1 --2- 172.21.15.144:0/1416784303 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f39a00d02a0 0x7f39a00d0680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f39940097a0 tx=0x7f399402a100 comp rx=0 tx=0).stop 2024-09-11T23:23:48.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.848+0000 7f39a8400640 1 -- 172.21.15.144:0/1416784303 shutdown_connections 2024-09-11T23:23:48.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.848+0000 7f39a8400640 1 --2- 172.21.15.144:0/1416784303 >> v2:172.21.15.165:3300/0 conn(0x7f39a015ca40 0x7f39a015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:48.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.848+0000 7f39a8400640 1 --2- 172.21.15.144:0/1416784303 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f39a00d02a0 0x7f39a00d0680 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:48.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.848+0000 7f39a8400640 1 -- 172.21.15.144:0/1416784303 >> 172.21.15.144:0/1416784303 conn(0x7f39a0062cc0 msgr2=0x7f39a006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:48.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.848+0000 7f39a8400640 1 -- 172.21.15.144:0/1416784303 shutdown_connections 2024-09-11T23:23:48.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.848+0000 7f39a8400640 1 -- 172.21.15.144:0/1416784303 wait complete. 2024-09-11T23:23:48.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.849+0000 7f39a8400640 1 Processor -- start 2024-09-11T23:23:48.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.850+0000 7f39a8400640 1 -- start start 2024-09-11T23:23:48.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.850+0000 7f39a8400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f39a00d02a0 0x7f39a0143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:48.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.850+0000 7f39a8400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39a015ca40 0x7f39a015b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:48.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.850+0000 7f39a8400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f39a015ce80 0x7f39a015ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:48.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.850+0000 7f39a8400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f39a0155b90 con 0x7f39a015ca40 2024-09-11T23:23:48.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.850+0000 7f39a8400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f39a015df10 con 0x7f39a015ce80 2024-09-11T23:23:48.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.850+0000 7f39a8400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f39a0155d10 con 0x7f39a00d02a0 2024-09-11T23:23:48.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.851+0000 7f39a5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39a015ca40 0x7f39a015b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:48.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.851+0000 7f39a5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39a015ca40 0x7f39a015b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53184/0 (socket says 172.21.15.144:53184) 2024-09-11T23:23:48.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.851+0000 7f39a5000640 1 -- 172.21.15.144:0/414737856 learned_addr learned my addr 172.21.15.144:0/414737856 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:48.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.851+0000 7f39a6400640 1 --2- 172.21.15.144:0/414737856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f39a015ce80 0x7f39a015ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:48.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.851+0000 7f39a5a00640 1 --2- 172.21.15.144:0/414737856 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f39a00d02a0 0x7f39a0143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:48.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.851+0000 7f39a5000640 1 -- 172.21.15.144:0/414737856 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f39a00d02a0 msgr2=0x7f39a0143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:48.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.851+0000 7f39a5000640 1 --2- 172.21.15.144:0/414737856 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f39a00d02a0 0x7f39a0143de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:48.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.851+0000 7f39a5000640 1 -- 172.21.15.144:0/414737856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f39a015ce80 msgr2=0x7f39a015ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:48.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.851+0000 7f39a5000640 1 --2- 172.21.15.144:0/414737856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f39a015ce80 0x7f39a015ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:48.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.851+0000 7f39a5000640 1 -- 172.21.15.144:0/414737856 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a0158eb0 con 0x7f39a015ca40 2024-09-11T23:23:48.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.851+0000 7f39a5000640 1 --2- 172.21.15.144:0/414737856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39a015ca40 0x7f39a015b4e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f398c00e9b0 tx=0x7f398c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:48.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.852+0000 7f399d600640 1 -- 172.21.15.144:0/414737856 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c017070 con 0x7f39a015ca40 2024-09-11T23:23:48.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.852+0000 7f399d600640 1 -- 172.21.15.144:0/414737856 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398c00ca00 con 0x7f39a015ca40 2024-09-11T23:23:48.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.852+0000 7f399d600640 1 -- 172.21.15.144:0/414737856 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c00cdf0 con 0x7f39a015ca40 2024-09-11T23:23:48.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.852+0000 7f39a8400640 1 -- 172.21.15.144:0/414737856 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a0156a40 con 0x7f39a015ca40 2024-09-11T23:23:48.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.852+0000 7f39a8400640 1 -- 172.21.15.144:0/414737856 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a0157000 con 0x7f39a015ca40 2024-09-11T23:23:48.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.853+0000 7f39a8400640 1 -- 172.21.15.144:0/414737856 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a00b4790 con 0x7f39a015ca40 2024-09-11T23:23:48.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.854+0000 7f399d600640 1 -- 172.21.15.144:0/414737856 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 90804+0+0 (secure 0 0 0) 0x7f398c01a070 con 0x7f39a015ca40 2024-09-11T23:23:48.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.855+0000 7f399d600640 1 --2- 172.21.15.144:0/414737856 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f398006c190 0x7f398006e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:48.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.855+0000 7f399d600640 1 -- 172.21.15.144:0/414737856 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f398c08b360 con 0x7f39a015ca40 2024-09-11T23:23:48.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.855+0000 7f39a5a00640 1 --2- 172.21.15.144:0/414737856 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f398006c190 0x7f398006e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:48.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.856+0000 7f39a5a00640 1 --2- 172.21.15.144:0/414737856 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f398006c190 0x7f398006e650 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3994034000 tx=0x7f399402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:48.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:48.859+0000 7f399d600640 1 -- 172.21.15.144:0/414737856 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f398c0591b0 con 0x7f39a015ca40 2024-09-11T23:23:49.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.043+0000 7f39a8400640 1 -- 172.21.15.144:0/414737856 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f39a006d4e0 con 0x7f39a015ca40 2024-09-11T23:23:49.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.043+0000 7f399d600640 1 -- 172.21.15.144:0/414737856 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v103) ==== 80+0+0 (secure 0 0 0) 0x7f398c05d4b0 con 0x7f39a015ca40 2024-09-11T23:23:49.044 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:23:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.045+0000 7f39a8400640 1 -- 172.21.15.144:0/414737856 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f398006c190 msgr2=0x7f398006e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.045+0000 7f39a8400640 1 --2- 172.21.15.144:0/414737856 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f398006c190 0x7f398006e650 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3994034000 tx=0x7f399402e000 comp rx=0 tx=0).stop 2024-09-11T23:23:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.045+0000 7f39a8400640 1 -- 172.21.15.144:0/414737856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39a015ca40 msgr2=0x7f39a015b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:49.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.045+0000 7f39a8400640 1 --2- 172.21.15.144:0/414737856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39a015ca40 0x7f39a015b4e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f398c00e9b0 tx=0x7f398c00ee70 comp rx=0 tx=0).stop 2024-09-11T23:23:49.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.046+0000 7f39a8400640 1 -- 172.21.15.144:0/414737856 shutdown_connections 2024-09-11T23:23:49.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.046+0000 7f39a8400640 1 --2- 172.21.15.144:0/414737856 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f398006c190 0x7f398006e650 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:49.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.046+0000 7f39a8400640 1 --2- 172.21.15.144:0/414737856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f39a015ce80 0x7f39a015ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:49.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.046+0000 7f39a8400640 1 --2- 172.21.15.144:0/414737856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f39a015ca40 0x7f39a015b4e0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:49.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.046+0000 7f39a8400640 1 --2- 172.21.15.144:0/414737856 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f39a00d02a0 0x7f39a0143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:49.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.046+0000 7f39a8400640 1 -- 172.21.15.144:0/414737856 >> 172.21.15.144:0/414737856 conn(0x7f39a0062cc0 msgr2=0x7f39a01548f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:49.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.046+0000 7f39a8400640 1 -- 172.21.15.144:0/414737856 shutdown_connections 2024-09-11T23:23:49.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.046+0000 7f39a8400640 1 -- 172.21.15.144:0/414737856 wait complete. 2024-09-11T23:23:49.062 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T23:23:49.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:49.062 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T23:23:49.149 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:23:49.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:49.150 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:23:49.197 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:23:49.197 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:23:49.197 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:49.235 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:23:49.235 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:49.313 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:23:49.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.473+0000 7fe23e800640 1 Processor -- start 2024-09-11T23:23:49.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.473+0000 7fe23e800640 1 -- start start 2024-09-11T23:23:49.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.475+0000 7fe23e800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe2380d02a0 0x7fe2380d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:49.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.475+0000 7fe23e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe23815ceb0 0x7fe2381594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:49.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.475+0000 7fe23e800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2380d0bc0 con 0x7fe23815ca40 2024-09-11T23:23:49.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.475+0000 7fe23e800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe23815d390 con 0x7fe2380d02a0 2024-09-11T23:23:49.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.475+0000 7fe23e800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe23815d670 con 0x7fe23815ceb0 2024-09-11T23:23:49.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.475+0000 7fe236a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe23815ca40 0x7fe23815e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52348/0 (socket says 172.21.15.144:52348) 2024-09-11T23:23:49.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.475+0000 7fe236a00640 1 -- 172.21.15.144:0/272501919 learned_addr learned my addr 172.21.15.144:0/272501919 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:49.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.475+0000 7fe237e00640 1 --2- 172.21.15.144:0/272501919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe23815ceb0 0x7fe2381594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:49.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.475+0000 7fe237400640 1 --2- 172.21.15.144:0/272501919 >> v2:172.21.15.165:3300/0 conn(0x7fe2380d02a0 0x7fe2380d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:49.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.475+0000 7fe236000640 1 -- 172.21.15.144:0/272501919 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1639216376 0 0) 0x7fe2380d0bc0 con 0x7fe23815ca40 2024-09-11T23:23:49.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.475+0000 7fe236000640 1 -- 172.21.15.144:0/272501919 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe21c003520 con 0x7fe23815ca40 2024-09-11T23:23:49.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.476+0000 7fe237e00640 1 -- 172.21.15.144:0/272501919 >> v2:172.21.15.165:3300/0 conn(0x7fe2380d02a0 msgr2=0x7fe2380d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:49.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.476+0000 7fe237e00640 1 --2- 172.21.15.144:0/272501919 >> v2:172.21.15.165:3300/0 conn(0x7fe2380d02a0 0x7fe2380d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:49.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.476+0000 7fe237e00640 1 -- 172.21.15.144:0/272501919 >> v1:172.21.15.144:6789/0 conn(0x7fe23815ca40 legacy=0x7fe23815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:49.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.476+0000 7fe237e00640 1 -- 172.21.15.144:0/272501919 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe23815d950 con 0x7fe23815ceb0 2024-09-11T23:23:49.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.476+0000 7fe237400640 1 --2- 172.21.15.144:0/272501919 >> v2:172.21.15.165:3300/0 conn(0x7fe2380d02a0 0x7fe2380d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:23:49.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.477+0000 7fe237e00640 1 --2- 172.21.15.144:0/272501919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe23815ceb0 0x7fe2381594c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe230009d90 tx=0x7fe23002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d9f715807192840 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:49.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.477+0000 7fe236000640 1 -- 172.21.15.144:0/272501919 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe230031600 con 0x7fe23815ceb0 2024-09-11T23:23:49.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.477+0000 7fe236000640 1 -- 172.21.15.144:0/272501919 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2300317a0 con 0x7fe23815ceb0 2024-09-11T23:23:49.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.477+0000 7fe236000640 1 -- 172.21.15.144:0/272501919 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe230031b50 con 0x7fe23815ceb0 2024-09-11T23:23:49.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.477+0000 7fe23e800640 1 -- 172.21.15.144:0/272501919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe23815ceb0 msgr2=0x7fe2381594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:49.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.477+0000 7fe23e800640 1 --2- 172.21.15.144:0/272501919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe23815ceb0 0x7fe2381594c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe230009d90 tx=0x7fe23002a5d0 comp rx=0 tx=0).stop 2024-09-11T23:23:49.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.478+0000 7fe23e800640 1 -- 172.21.15.144:0/272501919 shutdown_connections 2024-09-11T23:23:49.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.478+0000 7fe23e800640 1 --2- 172.21.15.144:0/272501919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe23815ceb0 0x7fe2381594c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:49.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.478+0000 7fe23e800640 1 --2- 172.21.15.144:0/272501919 >> v2:172.21.15.165:3300/0 conn(0x7fe2380d02a0 0x7fe2380d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:49.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.478+0000 7fe23e800640 1 -- 172.21.15.144:0/272501919 >> 172.21.15.144:0/272501919 conn(0x7fe238062cc0 msgr2=0x7fe23806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:49.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.478+0000 7fe23e800640 1 -- 172.21.15.144:0/272501919 shutdown_connections 2024-09-11T23:23:49.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.478+0000 7fe23e800640 1 -- 172.21.15.144:0/272501919 wait complete. 2024-09-11T23:23:49.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.479+0000 7fe23e800640 1 Processor -- start 2024-09-11T23:23:49.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.479+0000 7fe23e800640 1 -- start start 2024-09-11T23:23:49.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.480+0000 7fe23e800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2380d02a0 0x7fe23814d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:49.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.480+0000 7fe23e800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe23815ca40 0x7fe2381480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:49.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.480+0000 7fe23e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe23815ceb0 0x7fe2381580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:49.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.480+0000 7fe23e800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe23815eb40 con 0x7fe23815ceb0 2024-09-11T23:23:49.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.480+0000 7fe23e800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe23815df10 con 0x7fe23815ca40 2024-09-11T23:23:49.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.480+0000 7fe23e800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe238155b90 con 0x7fe2380d02a0 2024-09-11T23:23:49.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.481+0000 7fe237e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe23815ceb0 0x7fe2381580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:49.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.481+0000 7fe237e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe23815ceb0 0x7fe2381580f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53188/0 (socket says 172.21.15.144:53188) 2024-09-11T23:23:49.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.481+0000 7fe237e00640 1 -- 172.21.15.144:0/1534817510 learned_addr learned my addr 172.21.15.144:0/1534817510 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:49.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.481+0000 7fe237400640 1 --2- 172.21.15.144:0/1534817510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2380d02a0 0x7fe23814d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:49.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.481+0000 7fe236a00640 1 --2- 172.21.15.144:0/1534817510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe23815ca40 0x7fe2381480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:49.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.481+0000 7fe237e00640 1 -- 172.21.15.144:0/1534817510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2380d02a0 msgr2=0x7fe23814d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:49.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.481+0000 7fe237e00640 1 --2- 172.21.15.144:0/1534817510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2380d02a0 0x7fe23814d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:49.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.481+0000 7fe237e00640 1 -- 172.21.15.144:0/1534817510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe23815ca40 msgr2=0x7fe2381480b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:49.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.481+0000 7fe237e00640 1 --2- 172.21.15.144:0/1534817510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe23815ca40 0x7fe2381480b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:49.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.481+0000 7fe237e00640 1 -- 172.21.15.144:0/1534817510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe238073cf0 con 0x7fe23815ceb0 2024-09-11T23:23:49.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.481+0000 7fe236a00640 1 --2- 172.21.15.144:0/1534817510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe23815ca40 0x7fe2381480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:23:49.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.481+0000 7fe237e00640 1 --2- 172.21.15.144:0/1534817510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe23815ceb0 0x7fe2381580f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fe230009d90 tx=0x7fe230004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:49.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.481+0000 7fe22f400640 1 -- 172.21.15.144:0/1534817510 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe230009450 con 0x7fe23815ceb0 2024-09-11T23:23:49.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.482+0000 7fe22f400640 1 -- 172.21.15.144:0/1534817510 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe230031b50 con 0x7fe23815ceb0 2024-09-11T23:23:49.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.482+0000 7fe22f400640 1 -- 172.21.15.144:0/1534817510 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe230003e10 con 0x7fe23815ceb0 2024-09-11T23:23:49.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.482+0000 7fe23e800640 1 -- 172.21.15.144:0/1534817510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2380b1160 con 0x7fe23815ceb0 2024-09-11T23:23:49.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.482+0000 7fe23e800640 1 -- 172.21.15.144:0/1534817510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2380b1720 con 0x7fe23815ceb0 2024-09-11T23:23:49.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.483+0000 7fe23e800640 1 -- 172.21.15.144:0/1534817510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2380b4790 con 0x7fe23815ceb0 2024-09-11T23:23:49.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.483+0000 7fe22f400640 1 -- 172.21.15.144:0/1534817510 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 90804+0+0 (secure 0 0 0) 0x7fe230033070 con 0x7fe23815ceb0 2024-09-11T23:23:49.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.484+0000 7fe22f400640 1 --2- 172.21.15.144:0/1534817510 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe21806c190 0x7fe21806e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:49.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.484+0000 7fe22f400640 1 -- 172.21.15.144:0/1534817510 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7fe2300ac6a0 con 0x7fe23815ceb0 2024-09-11T23:23:49.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.485+0000 7fe237400640 1 --2- 172.21.15.144:0/1534817510 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe21806c190 0x7fe21806e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:49.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.485+0000 7fe237400640 1 --2- 172.21.15.144:0/1534817510 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe21806c190 0x7fe21806e650 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe228009a30 tx=0x7fe228008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:49.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.489+0000 7fe22f400640 1 -- 172.21.15.144:0/1534817510 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe23003f030 con 0x7fe23815ceb0 2024-09-11T23:23:49.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.679+0000 7fe23e800640 1 -- 172.21.15.144:0/1534817510 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe23806c980 con 0x7fe23815ceb0 2024-09-11T23:23:49.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.679+0000 7fe22f400640 1 -- 172.21.15.144:0/1534817510 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v103) ==== 80+0+0 (secure 0 0 0) 0x7fe23007aa70 con 0x7fe23815ceb0 2024-09-11T23:23:49.679 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:23:49.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.682+0000 7fe23e800640 1 -- 172.21.15.144:0/1534817510 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe21806c190 msgr2=0x7fe21806e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:49.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.682+0000 7fe23e800640 1 --2- 172.21.15.144:0/1534817510 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe21806c190 0x7fe21806e650 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe228009a30 tx=0x7fe228008040 comp rx=0 tx=0).stop 2024-09-11T23:23:49.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.682+0000 7fe23e800640 1 -- 172.21.15.144:0/1534817510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe23815ceb0 msgr2=0x7fe2381580f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:49.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.682+0000 7fe23e800640 1 --2- 172.21.15.144:0/1534817510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe23815ceb0 0x7fe2381580f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fe230009d90 tx=0x7fe230004a40 comp rx=0 tx=0).stop 2024-09-11T23:23:49.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.682+0000 7fe23e800640 1 -- 172.21.15.144:0/1534817510 shutdown_connections 2024-09-11T23:23:49.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.682+0000 7fe23e800640 1 --2- 172.21.15.144:0/1534817510 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe21806c190 0x7fe21806e650 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:49.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.682+0000 7fe23e800640 1 --2- 172.21.15.144:0/1534817510 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe23815ceb0 0x7fe2381580f0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:49.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.682+0000 7fe23e800640 1 --2- 172.21.15.144:0/1534817510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe23815ca40 0x7fe2381480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:49.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.682+0000 7fe23e800640 1 --2- 172.21.15.144:0/1534817510 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe2380d02a0 0x7fe23814d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:49.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.682+0000 7fe23e800640 1 -- 172.21.15.144:0/1534817510 >> 172.21.15.144:0/1534817510 conn(0x7fe238062cc0 msgr2=0x7fe23815aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:49.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.682+0000 7fe23e800640 1 -- 172.21.15.144:0/1534817510 shutdown_connections 2024-09-11T23:23:49.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:49.682+0000 7fe23e800640 1 -- 172.21.15.144:0/1534817510 wait complete. 2024-09-11T23:23:49.697 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-11T23:23:49.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:49.697 DEBUG:teuthology.orchestra.run.smithi165:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-11T23:23:49.759 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:23:49.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:23:49.759 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:23:49.795 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:23:49.795 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:23:49.795 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:49.832 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:23:49.832 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:23:49.832 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:23:49.832 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:49.879 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:23:49.880 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:23:50.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.040+0000 7f99e2a00640 1 Processor -- start 2024-09-11T23:23:50.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.040+0000 7f99e2a00640 1 -- start start 2024-09-11T23:23:50.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.042+0000 7f99e2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f99dc15c180 0x7f99dc0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:50.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.042+0000 7f99e2a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f99dc0ce230 0x7f99dc0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:50.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.042+0000 7f99e2a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99dc0ce740 con 0x7f99dc0cf5b0 2024-09-11T23:23:50.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.042+0000 7f99e2a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f99dc072640 con 0x7f99dc15c180 2024-09-11T23:23:50.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.042+0000 7f99e2a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f99dc072920 con 0x7f99dc0ce230 2024-09-11T23:23:50.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.042+0000 7f99dbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f99dc15c180 0x7f99dc0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:50.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.042+0000 7f99e0a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f99dc0cf5b0 0x7f99dc073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52350/0 (socket says 172.21.15.144:52350) 2024-09-11T23:23:50.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.042+0000 7f99e0a00640 1 -- 172.21.15.144:0/3579811824 learned_addr learned my addr 172.21.15.144:0/3579811824 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:50.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.042+0000 7f99d3400640 1 --2- 172.21.15.144:0/3579811824 >> v2:172.21.15.165:3300/0 conn(0x7f99dc0ce230 0x7f99dc0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:50.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.042+0000 7f99dbe00640 1 -- 172.21.15.144:0/3579811824 >> v2:172.21.15.165:3300/0 conn(0x7f99dc0ce230 msgr2=0x7f99dc0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:50.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.042+0000 7f99dbe00640 1 --2- 172.21.15.144:0/3579811824 >> v2:172.21.15.165:3300/0 conn(0x7f99dc0ce230 0x7f99dc0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.042+0000 7f99dbe00640 1 -- 172.21.15.144:0/3579811824 >> v1:172.21.15.144:6789/0 conn(0x7f99dc0cf5b0 legacy=0x7f99dc073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:50.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.042+0000 7f99dbe00640 1 -- 172.21.15.144:0/3579811824 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99dc072c00 con 0x7f99dc15c180 2024-09-11T23:23:50.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.043+0000 7f99dbe00640 1 --2- 172.21.15.144:0/3579811824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99dc15c180 0x7f99dc0cdcf0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f99dc071d60 tx=0x7f99cc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87cc3e9fc5180f71 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:50.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.044+0000 7f99db400640 1 -- 172.21.15.144:0/3579811824 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc037070 con 0x7f99dc15c180 2024-09-11T23:23:50.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.044+0000 7f99db400640 1 -- 172.21.15.144:0/3579811824 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99cc032440 con 0x7f99dc15c180 2024-09-11T23:23:50.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.044+0000 7f99db400640 1 -- 172.21.15.144:0/3579811824 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc02ae60 con 0x7f99dc15c180 2024-09-11T23:23:50.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.044+0000 7f99e2a00640 1 -- 172.21.15.144:0/3579811824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99dc15c180 msgr2=0x7f99dc0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:50.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.044+0000 7f99e2a00640 1 --2- 172.21.15.144:0/3579811824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99dc15c180 0x7f99dc0cdcf0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f99dc071d60 tx=0x7f99cc02a110 comp rx=0 tx=0).stop 2024-09-11T23:23:50.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.044+0000 7f99e2a00640 1 -- 172.21.15.144:0/3579811824 shutdown_connections 2024-09-11T23:23:50.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.044+0000 7f99e2a00640 1 --2- 172.21.15.144:0/3579811824 >> v2:172.21.15.165:3300/0 conn(0x7f99dc0ce230 0x7f99dc0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.044+0000 7f99e2a00640 1 --2- 172.21.15.144:0/3579811824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99dc15c180 0x7f99dc0cdcf0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.044+0000 7f99e2a00640 1 -- 172.21.15.144:0/3579811824 >> 172.21.15.144:0/3579811824 conn(0x7f99dc062cc0 msgr2=0x7f99dc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:50.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.044+0000 7f99e2a00640 1 -- 172.21.15.144:0/3579811824 shutdown_connections 2024-09-11T23:23:50.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.044+0000 7f99e2a00640 1 -- 172.21.15.144:0/3579811824 wait complete. 2024-09-11T23:23:50.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.046+0000 7f99e2a00640 1 Processor -- start 2024-09-11T23:23:50.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.046+0000 7f99e2a00640 1 -- start start 2024-09-11T23:23:50.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.047+0000 7f99e2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99dc0ce230 0x7f99dc153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:50.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.047+0000 7f99e2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99dc0cf5b0 0x7f99dc1f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:50.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.047+0000 7f99e2a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99dc15c180 0x7f99dc150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:50.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.047+0000 7f99e2a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc15c560 con 0x7f99dc0cf5b0 2024-09-11T23:23:50.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.047+0000 7f99e2a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc0722f0 con 0x7f99dc15c180 2024-09-11T23:23:50.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.047+0000 7f99e2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f99dc15c6e0 con 0x7f99dc0ce230 2024-09-11T23:23:50.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.047+0000 7f99d3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99dc0cf5b0 0x7f99dc1f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:50.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.047+0000 7f99e0a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99dc15c180 0x7f99dc150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:50.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.047+0000 7f99d3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99dc0cf5b0 0x7f99dc1f1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53196/0 (socket says 172.21.15.144:53196) 2024-09-11T23:23:50.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.047+0000 7f99dbe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99dc0ce230 0x7f99dc153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:50.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.047+0000 7f99d3400640 1 -- 172.21.15.144:0/3396083103 learned_addr learned my addr 172.21.15.144:0/3396083103 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:50.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.048+0000 7f99d3400640 1 -- 172.21.15.144:0/3396083103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99dc0ce230 msgr2=0x7f99dc153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:50.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.048+0000 7f99d3400640 1 --2- 172.21.15.144:0/3396083103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99dc0ce230 0x7f99dc153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.048+0000 7f99d3400640 1 -- 172.21.15.144:0/3396083103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99dc15c180 msgr2=0x7f99dc150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:50.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.048+0000 7f99d3400640 1 --2- 172.21.15.144:0/3396083103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99dc15c180 0x7f99dc150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.048+0000 7f99d3400640 1 -- 172.21.15.144:0/3396083103 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99dc153c50 con 0x7f99dc0cf5b0 2024-09-11T23:23:50.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.048+0000 7f99d3400640 1 --2- 172.21.15.144:0/3396083103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99dc0cf5b0 0x7f99dc1f1e50 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f99c400e870 tx=0x7f99c400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:50.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.048+0000 7f99d8c00640 1 -- 172.21.15.144:0/3396083103 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c4017070 con 0x7f99dc0cf5b0 2024-09-11T23:23:50.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.048+0000 7f99d8c00640 1 -- 172.21.15.144:0/3396083103 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c400c940 con 0x7f99dc0cf5b0 2024-09-11T23:23:50.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.048+0000 7f99d8c00640 1 -- 172.21.15.144:0/3396083103 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c400cd30 con 0x7f99dc0cf5b0 2024-09-11T23:23:50.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.048+0000 7f99e2a00640 1 -- 172.21.15.144:0/3396083103 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99dc15d1c0 con 0x7f99dc0cf5b0 2024-09-11T23:23:50.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.048+0000 7f99e2a00640 1 -- 172.21.15.144:0/3396083103 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99dc15d780 con 0x7f99dc0cf5b0 2024-09-11T23:23:50.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.049+0000 7f99e2a00640 1 -- 172.21.15.144:0/3396083103 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99dc0cf070 con 0x7f99dc0cf5b0 2024-09-11T23:23:50.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.050+0000 7f99d8c00640 1 -- 172.21.15.144:0/3396083103 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f99c401a070 con 0x7f99dc0cf5b0 2024-09-11T23:23:50.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.051+0000 7f99d8c00640 1 --2- 172.21.15.144:0/3396083103 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f99b806c220 0x7f99b806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:50.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.051+0000 7f99d8c00640 1 -- 172.21.15.144:0/3396083103 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5823+0+0 (secure 0 0 0) 0x7f99c408b380 con 0x7f99dc0cf5b0 2024-09-11T23:23:50.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.051+0000 7f99dbe00640 1 --2- 172.21.15.144:0/3396083103 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f99b806c220 0x7f99b806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:50.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.052+0000 7f99dbe00640 1 --2- 172.21.15.144:0/3396083103 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f99b806c220 0x7f99b806e6e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f99cc034000 tx=0x7f99cc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:50.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.056+0000 7f99d8c00640 1 -- 172.21.15.144:0/3396083103 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f99c4059120 con 0x7f99dc0cf5b0 2024-09-11T23:23:50.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.267+0000 7f99e2a00640 1 -- 172.21.15.144:0/3396083103 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99dc157cf0 con 0x7f99dc0cf5b0 2024-09-11T23:23:50.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.267+0000 7f99d8c00640 1 -- 172.21.15.144:0/3396083103 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5234 (secure 0 0 0) 0x7f99c405d420 con 0x7f99dc0cf5b0 2024-09-11T23:23:50.267 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:50.267 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":72,"btime":"2024-09-11T23:23:19:441038+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2463021219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2463021219},{"type":"v1","addr":"172.21.15.165:6835","nonce":2463021219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6900,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/2687483394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2687483394},{"type":"v1","addr":"172.21.15.144:6801","nonce":2687483394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2256829982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2256829982},{"type":"v1","addr":"172.21.15.165:6834","nonce":2256829982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:23:08.790322+0000","modified":"2024-09-11T23:23:11.810403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6909},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6909":{"gid":6909,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/419371779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":419371779},{"type":"v1","addr":"172.21.15.144:6835","nonce":419371779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6909,"qdb_cluster":[6909]},"id":8}]} 2024-09-11T23:23:50.268 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 72 2024-09-11T23:23:50.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.270+0000 7f99e2a00640 1 -- 172.21.15.144:0/3396083103 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f99b806c220 msgr2=0x7f99b806e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:50.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.270+0000 7f99e2a00640 1 --2- 172.21.15.144:0/3396083103 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f99b806c220 0x7f99b806e6e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f99cc034000 tx=0x7f99cc02e000 comp rx=0 tx=0).stop 2024-09-11T23:23:50.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.270+0000 7f99e2a00640 1 -- 172.21.15.144:0/3396083103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99dc0cf5b0 msgr2=0x7f99dc1f1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:50.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.270+0000 7f99e2a00640 1 --2- 172.21.15.144:0/3396083103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99dc0cf5b0 0x7f99dc1f1e50 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f99c400e870 tx=0x7f99c400ed30 comp rx=0 tx=0).stop 2024-09-11T23:23:50.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.270+0000 7f99e2a00640 1 -- 172.21.15.144:0/3396083103 shutdown_connections 2024-09-11T23:23:50.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.270+0000 7f99e2a00640 1 --2- 172.21.15.144:0/3396083103 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f99b806c220 0x7f99b806e6e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.270+0000 7f99e2a00640 1 --2- 172.21.15.144:0/3396083103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99dc15c180 0x7f99dc150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.270+0000 7f99e2a00640 1 --2- 172.21.15.144:0/3396083103 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99dc0cf5b0 0x7f99dc1f1e50 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.270+0000 7f99e2a00640 1 --2- 172.21.15.144:0/3396083103 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99dc0ce230 0x7f99dc153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.270+0000 7f99e2a00640 1 -- 172.21.15.144:0/3396083103 >> 172.21.15.144:0/3396083103 conn(0x7f99dc062cc0 msgr2=0x7f99dc0b2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:50.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.270+0000 7f99e2a00640 1 -- 172.21.15.144:0/3396083103 shutdown_connections 2024-09-11T23:23:50.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.270+0000 7f99e2a00640 1 -- 172.21.15.144:0/3396083103 wait complete. 2024-09-11T23:23:50.286 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:23:50.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.443+0000 7fb42f000640 1 Processor -- start 2024-09-11T23:23:50.443 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.443+0000 7fb42f000640 1 -- start start 2024-09-11T23:23:50.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.444+0000 7fb42f000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb42806be10 0x7fb4280cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:50.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.444+0000 7fb42f000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb428151c50 0x7fb42815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:50.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.444+0000 7fb42f000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4280cd5f0 con 0x7fb42806c1f0 2024-09-11T23:23:50.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.444+0000 7fb42f000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb4280cd8d0 con 0x7fb42806be10 2024-09-11T23:23:50.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.444+0000 7fb42f000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb4280cdbb0 con 0x7fb428151c50 2024-09-11T23:23:50.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.444+0000 7fb427e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb42806be10 0x7fb4280cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:50.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.444+0000 7fb427400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb42806c1f0 0x7fb428151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52366/0 (socket says 172.21.15.144:52366) 2024-09-11T23:23:50.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.444+0000 7fb427400640 1 -- 172.21.15.144:0/3449927092 learned_addr learned my addr 172.21.15.144:0/3449927092 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:50.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.445+0000 7fb42d000640 1 --2- 172.21.15.144:0/3449927092 >> v2:172.21.15.165:3300/0 conn(0x7fb428151c50 0x7fb42815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:50.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.445+0000 7fb427e00640 1 -- 172.21.15.144:0/3449927092 >> v2:172.21.15.165:3300/0 conn(0x7fb428151c50 msgr2=0x7fb42815baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:50.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.445+0000 7fb427e00640 1 --2- 172.21.15.144:0/3449927092 >> v2:172.21.15.165:3300/0 conn(0x7fb428151c50 0x7fb42815baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.445+0000 7fb427e00640 1 -- 172.21.15.144:0/3449927092 >> v1:172.21.15.144:6789/0 conn(0x7fb42806c1f0 legacy=0x7fb428151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:50.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.445+0000 7fb427e00640 1 -- 172.21.15.144:0/3449927092 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4280cde90 con 0x7fb42806be10 2024-09-11T23:23:50.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.445+0000 7fb426a00640 1 -- 172.21.15.144:0/3449927092 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1793076168 0 0) 0x7fb4280cd5f0 con 0x7fb42806c1f0 2024-09-11T23:23:50.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.446+0000 7fb427e00640 1 --2- 172.21.15.144:0/3449927092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb42806be10 0x7fb4280cd010 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fb4280b5980 tx=0x7fb41802b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df398c5e797a6447 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:50.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.446+0000 7fb426a00640 1 -- 172.21.15.144:0/3449927092 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41800b040 con 0x7fb42806be10 2024-09-11T23:23:50.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.446+0000 7fb426a00640 1 -- 172.21.15.144:0/3449927092 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb418030710 con 0x7fb42806be10 2024-09-11T23:23:50.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.446+0000 7fb426a00640 1 -- 172.21.15.144:0/3449927092 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb418030ae0 con 0x7fb42806be10 2024-09-11T23:23:50.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.447+0000 7fb42f000640 1 -- 172.21.15.144:0/3449927092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb42806be10 msgr2=0x7fb4280cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:50.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.447+0000 7fb42f000640 1 --2- 172.21.15.144:0/3449927092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb42806be10 0x7fb4280cd010 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fb4280b5980 tx=0x7fb41802b560 comp rx=0 tx=0).stop 2024-09-11T23:23:50.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.447+0000 7fb42f000640 1 -- 172.21.15.144:0/3449927092 shutdown_connections 2024-09-11T23:23:50.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.447+0000 7fb42f000640 1 --2- 172.21.15.144:0/3449927092 >> v2:172.21.15.165:3300/0 conn(0x7fb428151c50 0x7fb42815baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.447+0000 7fb42f000640 1 --2- 172.21.15.144:0/3449927092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb42806be10 0x7fb4280cd010 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.447+0000 7fb42f000640 1 -- 172.21.15.144:0/3449927092 >> 172.21.15.144:0/3449927092 conn(0x7fb428062cc0 msgr2=0x7fb42806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:50.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.447+0000 7fb42f000640 1 -- 172.21.15.144:0/3449927092 shutdown_connections 2024-09-11T23:23:50.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.447+0000 7fb42f000640 1 -- 172.21.15.144:0/3449927092 wait complete. 2024-09-11T23:23:50.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.448+0000 7fb42f000640 1 Processor -- start 2024-09-11T23:23:50.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.449+0000 7fb42f000640 1 -- start start 2024-09-11T23:23:50.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.449+0000 7fb42f000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb42806be10 0x7fb428149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:50.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.449+0000 7fb42f000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb42806c1f0 0x7fb428154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:50.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.449+0000 7fb42f000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb428151c50 0x7fb4281547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:50.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.449+0000 7fb42f000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb4280d0310 con 0x7fb42806c1f0 2024-09-11T23:23:50.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.449+0000 7fb42f000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb4280ce690 con 0x7fb428151c50 2024-09-11T23:23:50.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.449+0000 7fb42f000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb4280d0490 con 0x7fb42806be10 2024-09-11T23:23:50.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.450+0000 7fb427400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb42806c1f0 0x7fb428154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:50.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.450+0000 7fb427400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb42806c1f0 0x7fb428154260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53220/0 (socket says 172.21.15.144:53220) 2024-09-11T23:23:50.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.450+0000 7fb427400640 1 -- 172.21.15.144:0/1311676114 learned_addr learned my addr 172.21.15.144:0/1311676114 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:50.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.450+0000 7fb42d000640 1 --2- 172.21.15.144:0/1311676114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb428151c50 0x7fb4281547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:50.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.450+0000 7fb427e00640 1 --2- 172.21.15.144:0/1311676114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb42806be10 0x7fb428149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:50.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.450+0000 7fb427400640 1 -- 172.21.15.144:0/1311676114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb42806be10 msgr2=0x7fb428149e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:50.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.450+0000 7fb427400640 1 --2- 172.21.15.144:0/1311676114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb42806be10 0x7fb428149e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.450+0000 7fb427400640 1 -- 172.21.15.144:0/1311676114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb428151c50 msgr2=0x7fb4281547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:50.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.450+0000 7fb427400640 1 --2- 172.21.15.144:0/1311676114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb428151c50 0x7fb4281547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.450+0000 7fb427400640 1 -- 172.21.15.144:0/1311676114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4281f4580 con 0x7fb42806c1f0 2024-09-11T23:23:50.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.450+0000 7fb427400640 1 --2- 172.21.15.144:0/1311676114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb42806c1f0 0x7fb428154260 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fb41400c4d0 tx=0x7fb41400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:50.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.451+0000 7fb41fe00640 1 -- 172.21.15.144:0/1311676114 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb414018070 con 0x7fb42806c1f0 2024-09-11T23:23:50.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.451+0000 7fb41fe00640 1 -- 172.21.15.144:0/1311676114 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb414007500 con 0x7fb42806c1f0 2024-09-11T23:23:50.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.451+0000 7fb42f000640 1 -- 172.21.15.144:0/1311676114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4281f4860 con 0x7fb42806c1f0 2024-09-11T23:23:50.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.451+0000 7fb41fe00640 1 -- 172.21.15.144:0/1311676114 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb414004a20 con 0x7fb42806c1f0 2024-09-11T23:23:50.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.451+0000 7fb42f000640 1 -- 172.21.15.144:0/1311676114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4281f4e20 con 0x7fb42806c1f0 2024-09-11T23:23:50.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.452+0000 7fb42f000640 1 -- 172.21.15.144:0/1311676114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4281f5020 con 0x7fb42806c1f0 2024-09-11T23:23:50.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.453+0000 7fb41fe00640 1 -- 172.21.15.144:0/1311676114 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7fb41401b070 con 0x7fb42806c1f0 2024-09-11T23:23:50.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.453+0000 7fb41fe00640 1 --2- 172.21.15.144:0/1311676114 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb40806c220 0x7fb40806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:50.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.453+0000 7fb41fe00640 1 -- 172.21.15.144:0/1311676114 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5823+0+0 (secure 0 0 0) 0x7fb41408a9d0 con 0x7fb42806c1f0 2024-09-11T23:23:50.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.454+0000 7fb427e00640 1 --2- 172.21.15.144:0/1311676114 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb40806c220 0x7fb40806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:50.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.454+0000 7fb427e00640 1 --2- 172.21.15.144:0/1311676114 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb40806c220 0x7fb40806e6e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb418035000 tx=0x7fb41800c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:50.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.458+0000 7fb41fe00640 1 -- 172.21.15.144:0/1311676114 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb4281f5020 con 0x7fb42806c1f0 2024-09-11T23:23:50.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.664+0000 7fb42f000640 1 -- 172.21.15.144:0/1311676114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4280d0850 con 0x7fb42806c1f0 2024-09-11T23:23:50.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.665+0000 7fb41fe00640 1 -- 172.21.15.144:0/1311676114 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5234 (secure 0 0 0) 0x7fb414058cf0 con 0x7fb42806c1f0 2024-09-11T23:23:50.665 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:50.665 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":72,"btime":"2024-09-11T23:23:19:441038+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2463021219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2463021219},{"type":"v1","addr":"172.21.15.165:6835","nonce":2463021219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6900,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/2687483394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2687483394},{"type":"v1","addr":"172.21.15.144:6801","nonce":2687483394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2256829982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2256829982},{"type":"v1","addr":"172.21.15.165:6834","nonce":2256829982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:23:08.790322+0000","modified":"2024-09-11T23:23:11.810403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6909},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6909":{"gid":6909,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/419371779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":419371779},{"type":"v1","addr":"172.21.15.144:6835","nonce":419371779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6909,"qdb_cluster":[6909]},"id":8}]} 2024-09-11T23:23:50.665 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 72 2024-09-11T23:23:50.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.667+0000 7fb42f000640 1 -- 172.21.15.144:0/1311676114 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb40806c220 msgr2=0x7fb40806e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:50.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.667+0000 7fb42f000640 1 --2- 172.21.15.144:0/1311676114 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb40806c220 0x7fb40806e6e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb418035000 tx=0x7fb41800c040 comp rx=0 tx=0).stop 2024-09-11T23:23:50.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.667+0000 7fb42f000640 1 -- 172.21.15.144:0/1311676114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb42806c1f0 msgr2=0x7fb428154260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:50.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.667+0000 7fb42f000640 1 --2- 172.21.15.144:0/1311676114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb42806c1f0 0x7fb428154260 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fb41400c4d0 tx=0x7fb41400c990 comp rx=0 tx=0).stop 2024-09-11T23:23:50.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.667+0000 7fb42f000640 1 -- 172.21.15.144:0/1311676114 shutdown_connections 2024-09-11T23:23:50.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.667+0000 7fb42f000640 1 --2- 172.21.15.144:0/1311676114 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb40806c220 0x7fb40806e6e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.667+0000 7fb42f000640 1 --2- 172.21.15.144:0/1311676114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb428151c50 0x7fb4281547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.667+0000 7fb42f000640 1 --2- 172.21.15.144:0/1311676114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb42806c1f0 0x7fb428154260 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.667+0000 7fb42f000640 1 --2- 172.21.15.144:0/1311676114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb42806be10 0x7fb428149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.667+0000 7fb42f000640 1 -- 172.21.15.144:0/1311676114 >> 172.21.15.144:0/1311676114 conn(0x7fb428062cc0 msgr2=0x7fb4280b16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:50.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.667+0000 7fb42f000640 1 -- 172.21.15.144:0/1311676114 shutdown_connections 2024-09-11T23:23:50.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.667+0000 7fb42f000640 1 -- 172.21.15.144:0/1311676114 wait complete. 2024-09-11T23:23:50.683 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:23:50.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.837+0000 7f76d8c00640 1 Processor -- start 2024-09-11T23:23:50.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.837+0000 7f76d8c00640 1 -- start start 2024-09-11T23:23:50.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.839+0000 7f76d8c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76d40cf070 0x7f76d40cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:50.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.839+0000 7f76d8c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76d40ce740 con 0x7f76d4073120 2024-09-11T23:23:50.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.839+0000 7f76d8c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76d4072640 con 0x7f76d415c180 2024-09-11T23:23:50.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.839+0000 7f76d8c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f76d4072920 con 0x7f76d40cf070 2024-09-11T23:23:50.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.839+0000 7f76d2800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f76d4073120 0x7f76d406bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52376/0 (socket says 172.21.15.144:52376) 2024-09-11T23:23:50.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.839+0000 7f76d2800640 1 -- 172.21.15.144:0/1432463866 learned_addr learned my addr 172.21.15.144:0/1432463866 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:50.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.839+0000 7f76c9400640 1 --2- 172.21.15.144:0/1432463866 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76d40cf070 0x7f76d40cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:50.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.839+0000 7f76d1400640 1 -- 172.21.15.144:0/1432463866 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 988410187 0 0) 0x7f76d40ce740 con 0x7f76d4073120 2024-09-11T23:23:50.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.840+0000 7f76d1400640 1 -- 172.21.15.144:0/1432463866 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76b8003520 con 0x7f76d4073120 2024-09-11T23:23:50.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.840+0000 7f76d1400640 1 -- 172.21.15.144:0/1432463866 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1830653200 0 0) 0x7f76d4072640 con 0x7f76d415c180 2024-09-11T23:23:50.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.840+0000 7f76d1400640 1 -- 172.21.15.144:0/1432463866 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76d40ce740 con 0x7f76d415c180 2024-09-11T23:23:50.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.840+0000 7f76c9400640 1 -- 172.21.15.144:0/1432463866 >> v1:172.21.15.165:6789/0 conn(0x7f76d415c180 legacy=0x7f76d40cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:50.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.840+0000 7f76c9400640 1 -- 172.21.15.144:0/1432463866 >> v1:172.21.15.144:6789/0 conn(0x7f76d4073120 legacy=0x7f76d406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:50.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.840+0000 7f76c9400640 1 -- 172.21.15.144:0/1432463866 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d4072c00 con 0x7f76d40cf070 2024-09-11T23:23:50.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.841+0000 7f76c9400640 1 --2- 172.21.15.144:0/1432463866 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76d40cf070 0x7f76d40cf4b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0097d0 tx=0x7f76bc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69587101b566233c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:50.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.841+0000 7f76d1400640 1 -- 172.21.15.144:0/1432463866 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76bc037070 con 0x7f76d40cf070 2024-09-11T23:23:50.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.841+0000 7f76d1400640 1 -- 172.21.15.144:0/1432463866 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76bc032440 con 0x7f76d40cf070 2024-09-11T23:23:50.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.841+0000 7f76d1400640 1 -- 172.21.15.144:0/1432463866 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76bc032810 con 0x7f76d40cf070 2024-09-11T23:23:50.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.842+0000 7f76d8c00640 1 -- 172.21.15.144:0/1432463866 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76d40cf070 msgr2=0x7f76d40cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:50.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.842+0000 7f76d8c00640 1 --2- 172.21.15.144:0/1432463866 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76d40cf070 0x7f76d40cf4b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0097d0 tx=0x7f76bc02a180 comp rx=0 tx=0).stop 2024-09-11T23:23:50.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.842+0000 7f76d8c00640 1 -- 172.21.15.144:0/1432463866 shutdown_connections 2024-09-11T23:23:50.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.842+0000 7f76d8c00640 1 --2- 172.21.15.144:0/1432463866 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76d40cf070 0x7f76d40cf4b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.842+0000 7f76d8c00640 1 -- 172.21.15.144:0/1432463866 >> 172.21.15.144:0/1432463866 conn(0x7f76d4062cc0 msgr2=0x7f76d406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:50.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.842+0000 7f76d8c00640 1 -- 172.21.15.144:0/1432463866 shutdown_connections 2024-09-11T23:23:50.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.842+0000 7f76d8c00640 1 -- 172.21.15.144:0/1432463866 wait complete. 2024-09-11T23:23:50.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.843+0000 7f76d8c00640 1 Processor -- start 2024-09-11T23:23:50.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.844+0000 7f76d8c00640 1 -- start start 2024-09-11T23:23:50.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.844+0000 7f76d8c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76d4073120 0x7f76d406be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:50.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.844+0000 7f76d8c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76d40cf070 0x7f76d41519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:50.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.844+0000 7f76d8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76d415c180 0x7f76d4151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:50.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.844+0000 7f76d8c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f76d40722f0 con 0x7f76d415c180 2024-09-11T23:23:50.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.844+0000 7f76d8c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f76d40ced00 con 0x7f76d4073120 2024-09-11T23:23:50.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.844+0000 7f76d8c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f76d415c560 con 0x7f76d40cf070 2024-09-11T23:23:50.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.845+0000 7f76d1e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76d4073120 0x7f76d406be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:50.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.845+0000 7f76c9400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76d40cf070 0x7f76d41519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:50.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.845+0000 7f76d2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76d415c180 0x7f76d4151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:50.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.845+0000 7f76c9400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76d40cf070 0x7f76d41519f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:60374/0 (socket says 172.21.15.144:60374) 2024-09-11T23:23:50.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.845+0000 7f76c9400640 1 -- 172.21.15.144:0/3555377517 learned_addr learned my addr 172.21.15.144:0/3555377517 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:50.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.845+0000 7f76d2800640 1 -- 172.21.15.144:0/3555377517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76d40cf070 msgr2=0x7f76d41519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:50.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.845+0000 7f76d2800640 1 --2- 172.21.15.144:0/3555377517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76d40cf070 0x7f76d41519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.845+0000 7f76d2800640 1 -- 172.21.15.144:0/3555377517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76d4073120 msgr2=0x7f76d406be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:50.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.845+0000 7f76d2800640 1 --2- 172.21.15.144:0/3555377517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76d4073120 0x7f76d406be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:50.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.845+0000 7f76d2800640 1 -- 172.21.15.144:0/3555377517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d40b00a0 con 0x7f76d415c180 2024-09-11T23:23:50.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.846+0000 7f76d2800640 1 --2- 172.21.15.144:0/3555377517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76d415c180 0x7f76d4151f30 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f76cc001580 tx=0x7f76cc00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:50.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.847+0000 7f76caa00640 1 -- 172.21.15.144:0/3555377517 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc017070 con 0x7f76d415c180 2024-09-11T23:23:50.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.847+0000 7f76caa00640 1 -- 172.21.15.144:0/3555377517 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76cc00aba0 con 0x7f76d415c180 2024-09-11T23:23:50.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.847+0000 7f76caa00640 1 -- 172.21.15.144:0/3555377517 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc012400 con 0x7f76d415c180 2024-09-11T23:23:50.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.847+0000 7f76d8c00640 1 -- 172.21.15.144:0/3555377517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d40b0380 con 0x7f76d415c180 2024-09-11T23:23:50.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.847+0000 7f76d8c00640 1 -- 172.21.15.144:0/3555377517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d40b0940 con 0x7f76d415c180 2024-09-11T23:23:50.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.848+0000 7f76d8c00640 1 -- 172.21.15.144:0/3555377517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d40cf4b0 con 0x7f76d415c180 2024-09-11T23:23:50.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.849+0000 7f76caa00640 1 -- 172.21.15.144:0/3555377517 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f76cc01a070 con 0x7f76d415c180 2024-09-11T23:23:50.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.850+0000 7f76caa00640 1 --2- 172.21.15.144:0/3555377517 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f76b006c220 0x7f76b006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:50.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.850+0000 7f76caa00640 1 -- 172.21.15.144:0/3555377517 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5823+0+0 (secure 0 0 0) 0x7f76cc08b230 con 0x7f76d415c180 2024-09-11T23:23:50.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.851+0000 7f76d1e00640 1 --2- 172.21.15.144:0/3555377517 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f76b006c220 0x7f76b006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:50.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.851+0000 7f76d1e00640 1 --2- 172.21.15.144:0/3555377517 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f76b006c220 0x7f76b006e6e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f76c40011e0 tx=0x7f76c4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:50.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:50.855+0000 7f76caa00640 1 -- 172.21.15.144:0/3555377517 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76cc058f40 con 0x7f76d415c180 2024-09-11T23:23:51.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.030+0000 7f76d8c00640 1 -- 172.21.15.144:0/3555377517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76d40ccb90 con 0x7f76d415c180 2024-09-11T23:23:51.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.031+0000 7f76caa00640 1 -- 172.21.15.144:0/3555377517 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+16970 (secure 0 0 0) 0x7f76cc05d240 con 0x7f76d415c180 2024-09-11T23:23:51.032 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:51.032 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":104,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:23:49.835187+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:23:06.559198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-11T23:23:07.784853+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.25","mappings":[{"from":0,"to":2}]},{"pgid":"17.30","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:23:51.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.033+0000 7f76d8c00640 1 -- 172.21.15.144:0/3555377517 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f76b006c220 msgr2=0x7f76b006e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:51.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.033+0000 7f76d8c00640 1 --2- 172.21.15.144:0/3555377517 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f76b006c220 0x7f76b006e6e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f76c40011e0 tx=0x7f76c4009040 comp rx=0 tx=0).stop 2024-09-11T23:23:51.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.033+0000 7f76d8c00640 1 -- 172.21.15.144:0/3555377517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76d415c180 msgr2=0x7f76d4151f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:51.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.033+0000 7f76d8c00640 1 --2- 172.21.15.144:0/3555377517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76d415c180 0x7f76d4151f30 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f76cc001580 tx=0x7f76cc00cee0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.034+0000 7f76d8c00640 1 -- 172.21.15.144:0/3555377517 shutdown_connections 2024-09-11T23:23:51.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.034+0000 7f76d8c00640 1 --2- 172.21.15.144:0/3555377517 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f76b006c220 0x7f76b006e6e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.034+0000 7f76d8c00640 1 --2- 172.21.15.144:0/3555377517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76d415c180 0x7f76d4151f30 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.034+0000 7f76d8c00640 1 --2- 172.21.15.144:0/3555377517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76d40cf070 0x7f76d41519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.034+0000 7f76d8c00640 1 --2- 172.21.15.144:0/3555377517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76d4073120 0x7f76d406be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.034+0000 7f76d8c00640 1 -- 172.21.15.144:0/3555377517 >> 172.21.15.144:0/3555377517 conn(0x7f76d4062cc0 msgr2=0x7f76d41576f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:51.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.034+0000 7f76d8c00640 1 -- 172.21.15.144:0/3555377517 shutdown_connections 2024-09-11T23:23:51.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.034+0000 7f76d8c00640 1 -- 172.21.15.144:0/3555377517 wait complete. 2024-09-11T23:23:51.049 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:23:51.050 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:23:51.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.203+0000 7fbde3400640 1 Processor -- start 2024-09-11T23:23:51.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.203+0000 7fbde3400640 1 -- start start 2024-09-11T23:23:51.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.205+0000 7fbde3400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbddc15ca40 0x7fbddc15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:51.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.205+0000 7fbde3400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbddc15d390 con 0x7fbddc0d02a0 2024-09-11T23:23:51.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.205+0000 7fbde3400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbddc15d670 con 0x7fbddc15ce80 2024-09-11T23:23:51.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.205+0000 7fbde3400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbddc15d950 con 0x7fbddc15ca40 2024-09-11T23:23:51.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.205+0000 7fbde0a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbddc0d02a0 0x7fbddc0d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52388/0 (socket says 172.21.15.144:52388) 2024-09-11T23:23:51.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.205+0000 7fbde0a00640 1 -- 172.21.15.144:0/1377332826 learned_addr learned my addr 172.21.15.144:0/1377332826 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:51.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.205+0000 7fbdd3e00640 1 --2- 172.21.15.144:0/1377332826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbddc15ca40 0x7fbddc15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:51.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.205+0000 7fbddbe00640 1 -- 172.21.15.144:0/1377332826 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2213703659 0 0) 0x7fbddc15d390 con 0x7fbddc0d02a0 2024-09-11T23:23:51.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.205+0000 7fbddbe00640 1 -- 172.21.15.144:0/1377332826 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdc0003520 con 0x7fbddc0d02a0 2024-09-11T23:23:51.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.206+0000 7fbdd3e00640 1 -- 172.21.15.144:0/1377332826 >> v1:172.21.15.165:6789/0 conn(0x7fbddc15ce80 legacy=0x7fbddc1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:51.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.206+0000 7fbddbe00640 1 -- 172.21.15.144:0/1377332826 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3846338483 0 0) 0x7fbddc15d670 con 0x7fbddc15ce80 2024-09-11T23:23:51.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.206+0000 7fbdd3e00640 1 -- 172.21.15.144:0/1377332826 >> v1:172.21.15.144:6789/0 conn(0x7fbddc0d02a0 legacy=0x7fbddc0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:51.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.206+0000 7fbdd3e00640 1 -- 172.21.15.144:0/1377332826 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbddc15dc30 con 0x7fbddc15ca40 2024-09-11T23:23:51.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.207+0000 7fbdd3e00640 1 --2- 172.21.15.144:0/1377332826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbddc15ca40 0x7fbddc15e430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40097d0 tx=0x7fbdc402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=267e765ed7213d99 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:51.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.207+0000 7fbddbe00640 1 -- 172.21.15.144:0/1377332826 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4037070 con 0x7fbddc15ca40 2024-09-11T23:23:51.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.207+0000 7fbddbe00640 1 -- 172.21.15.144:0/1377332826 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc4032440 con 0x7fbddc15ca40 2024-09-11T23:23:51.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.207+0000 7fbddbe00640 1 -- 172.21.15.144:0/1377332826 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40327f0 con 0x7fbddc15ca40 2024-09-11T23:23:51.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.207+0000 7fbde3400640 1 -- 172.21.15.144:0/1377332826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbddc15ca40 msgr2=0x7fbddc15e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:51.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.207+0000 7fbde3400640 1 --2- 172.21.15.144:0/1377332826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbddc15ca40 0x7fbddc15e430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40097d0 tx=0x7fbdc402a180 comp rx=0 tx=0).stop 2024-09-11T23:23:51.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.208+0000 7fbde3400640 1 -- 172.21.15.144:0/1377332826 shutdown_connections 2024-09-11T23:23:51.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.208+0000 7fbde3400640 1 --2- 172.21.15.144:0/1377332826 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbddc15ca40 0x7fbddc15e430 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.208+0000 7fbde3400640 1 -- 172.21.15.144:0/1377332826 >> 172.21.15.144:0/1377332826 conn(0x7fbddc062cc0 msgr2=0x7fbddc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:51.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.208+0000 7fbde3400640 1 -- 172.21.15.144:0/1377332826 shutdown_connections 2024-09-11T23:23:51.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.208+0000 7fbde3400640 1 -- 172.21.15.144:0/1377332826 wait complete. 2024-09-11T23:23:51.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.209+0000 7fbde3400640 1 Processor -- start 2024-09-11T23:23:51.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.209+0000 7fbde3400640 1 -- start start 2024-09-11T23:23:51.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.210+0000 7fbde3400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbddc0d02a0 0x7fbddc1f3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:51.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.210+0000 7fbde3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbddc15ca40 0x7fbddc14d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:51.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.210+0000 7fbde3400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbddc15ce80 0x7fbddc145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:51.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.210+0000 7fbde3400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc155d10 con 0x7fbddc15ca40 2024-09-11T23:23:51.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.210+0000 7fbde3400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc155b90 con 0x7fbddc15ce80 2024-09-11T23:23:51.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.210+0000 7fbde3400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbddc0b4790 con 0x7fbddc0d02a0 2024-09-11T23:23:51.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.211+0000 7fbdd3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbddc15ca40 0x7fbddc14d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:51.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.211+0000 7fbdd3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbddc15ca40 0x7fbddc14d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53228/0 (socket says 172.21.15.144:53228) 2024-09-11T23:23:51.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.211+0000 7fbdd3e00640 1 -- 172.21.15.144:0/1009936614 learned_addr learned my addr 172.21.15.144:0/1009936614 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:51.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.211+0000 7fbde0a00640 1 --2- 172.21.15.144:0/1009936614 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbddc0d02a0 0x7fbddc1f3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:51.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.211+0000 7fbde1400640 1 --2- 172.21.15.144:0/1009936614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbddc15ce80 0x7fbddc145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:51.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.211+0000 7fbdd3e00640 1 -- 172.21.15.144:0/1009936614 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbddc0d02a0 msgr2=0x7fbddc1f3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:51.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.211+0000 7fbdd3e00640 1 --2- 172.21.15.144:0/1009936614 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbddc0d02a0 0x7fbddc1f3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.211+0000 7fbdd3e00640 1 -- 172.21.15.144:0/1009936614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbddc15ce80 msgr2=0x7fbddc145560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:51.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.211+0000 7fbdd3e00640 1 --2- 172.21.15.144:0/1009936614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbddc15ce80 0x7fbddc145560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.211+0000 7fbdd3e00640 1 -- 172.21.15.144:0/1009936614 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbddc14de00 con 0x7fbddc15ca40 2024-09-11T23:23:51.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.211+0000 7fbdd3e00640 1 --2- 172.21.15.144:0/1009936614 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbddc15ca40 0x7fbddc14d690 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4000c00 tx=0x7fbdc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:51.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.212+0000 7fbdd9600640 1 -- 172.21.15.144:0/1009936614 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4037040 con 0x7fbddc15ca40 2024-09-11T23:23:51.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.212+0000 7fbdd9600640 1 -- 172.21.15.144:0/1009936614 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc4042070 con 0x7fbddc15ca40 2024-09-11T23:23:51.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.212+0000 7fbdd9600640 1 -- 172.21.15.144:0/1009936614 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4030900 con 0x7fbddc15ca40 2024-09-11T23:23:51.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.212+0000 7fbde3400640 1 -- 172.21.15.144:0/1009936614 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbddc141bc0 con 0x7fbddc15ca40 2024-09-11T23:23:51.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.212+0000 7fbde3400640 1 -- 172.21.15.144:0/1009936614 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbddc142180 con 0x7fbddc15ca40 2024-09-11T23:23:51.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.213+0000 7fbde3400640 1 -- 172.21.15.144:0/1009936614 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbddc0d0680 con 0x7fbddc15ca40 2024-09-11T23:23:51.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.214+0000 7fbdd9600640 1 -- 172.21.15.144:0/1009936614 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7fbdc4030aa0 con 0x7fbddc15ca40 2024-09-11T23:23:51.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.215+0000 7fbdd9600640 1 --2- 172.21.15.144:0/1009936614 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbdb806c250 0x7fbdb806e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:51.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.215+0000 7fbdd9600640 1 -- 172.21.15.144:0/1009936614 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5823+0+0 (secure 0 0 0) 0x7fbdc40ab730 con 0x7fbddc15ca40 2024-09-11T23:23:51.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.215+0000 7fbde0a00640 1 --2- 172.21.15.144:0/1009936614 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbdb806c250 0x7fbdb806e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:51.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.216+0000 7fbde0a00640 1 --2- 172.21.15.144:0/1009936614 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbdb806c250 0x7fbdb806e710 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc005880 tx=0x7fbdcc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:51.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.219+0000 7fbdd9600640 1 -- 172.21.15.144:0/1009936614 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbdc404b020 con 0x7fbddc15ca40 2024-09-11T23:23:51.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.426+0000 7fbde3400640 1 -- 172.21.15.144:0/1009936614 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbddc06c870 con 0x7fbddc15ca40 2024-09-11T23:23:51.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.427+0000 7fbdd9600640 1 -- 172.21.15.144:0/1009936614 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5234 (secure 0 0 0) 0x7fbdc4079570 con 0x7fbddc15ca40 2024-09-11T23:23:51.427 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:51.427 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":72,"btime":"2024-09-11T23:23:19:441038+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2463021219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2463021219},{"type":"v1","addr":"172.21.15.165:6835","nonce":2463021219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6900,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/2687483394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2687483394},{"type":"v1","addr":"172.21.15.144:6801","nonce":2687483394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2256829982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2256829982},{"type":"v1","addr":"172.21.15.165:6834","nonce":2256829982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:23:08.790322+0000","modified":"2024-09-11T23:23:11.810403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6909},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6909":{"gid":6909,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/419371779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":419371779},{"type":"v1","addr":"172.21.15.144:6835","nonce":419371779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6909,"qdb_cluster":[6909]},"id":8}]} 2024-09-11T23:23:51.427 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 72 2024-09-11T23:23:51.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.429+0000 7fbde3400640 1 -- 172.21.15.144:0/1009936614 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbdb806c250 msgr2=0x7fbdb806e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:51.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.429+0000 7fbde3400640 1 --2- 172.21.15.144:0/1009936614 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbdb806c250 0x7fbdb806e710 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc005880 tx=0x7fbdcc009040 comp rx=0 tx=0).stop 2024-09-11T23:23:51.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.429+0000 7fbde3400640 1 -- 172.21.15.144:0/1009936614 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbddc15ca40 msgr2=0x7fbddc14d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:51.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.429+0000 7fbde3400640 1 --2- 172.21.15.144:0/1009936614 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbddc15ca40 0x7fbddc14d690 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4000c00 tx=0x7fbdc40046c0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.429+0000 7fbde3400640 1 -- 172.21.15.144:0/1009936614 shutdown_connections 2024-09-11T23:23:51.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.429+0000 7fbde3400640 1 --2- 172.21.15.144:0/1009936614 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbdb806c250 0x7fbdb806e710 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.429+0000 7fbde3400640 1 --2- 172.21.15.144:0/1009936614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbddc15ce80 0x7fbddc145560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.429+0000 7fbde3400640 1 --2- 172.21.15.144:0/1009936614 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbddc15ca40 0x7fbddc14d690 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.429+0000 7fbde3400640 1 --2- 172.21.15.144:0/1009936614 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbddc0d02a0 0x7fbddc1f3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.429+0000 7fbde3400640 1 -- 172.21.15.144:0/1009936614 >> 172.21.15.144:0/1009936614 conn(0x7fbddc062cc0 msgr2=0x7fbddc06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:51.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.429+0000 7fbde3400640 1 -- 172.21.15.144:0/1009936614 shutdown_connections 2024-09-11T23:23:51.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.429+0000 7fbde3400640 1 -- 172.21.15.144:0/1009936614 wait complete. 2024-09-11T23:23:51.445 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:23:51.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.617+0000 7f6696800640 1 Processor -- start 2024-09-11T23:23:51.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.617+0000 7f6696800640 1 -- start start 2024-09-11T23:23:51.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.618+0000 7f6696800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f669015ca40 0x7f669015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:51.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.618+0000 7f6696800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669015d390 con 0x7f66900d02a0 2024-09-11T23:23:51.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.618+0000 7f6696800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669015d670 con 0x7f669015ce80 2024-09-11T23:23:51.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.619+0000 7f6696800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f669015d950 con 0x7f669015ca40 2024-09-11T23:23:51.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.619+0000 7f668f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f66900d02a0 0x7f66900d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52402/0 (socket says 172.21.15.144:52402) 2024-09-11T23:23:51.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.619+0000 7f668f400640 1 -- 172.21.15.144:0/2705907055 learned_addr learned my addr 172.21.15.144:0/2705907055 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:51.619 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.619+0000 7f6686a00640 1 --2- 172.21.15.144:0/2705907055 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f669015ca40 0x7f669015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:51.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.619+0000 7f668ea00640 1 -- 172.21.15.144:0/2705907055 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1618289575 0 0) 0x7f669015d390 con 0x7f66900d02a0 2024-09-11T23:23:51.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.619+0000 7f668ea00640 1 -- 172.21.15.144:0/2705907055 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6674003520 con 0x7f66900d02a0 2024-09-11T23:23:51.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.619+0000 7f668ea00640 1 -- 172.21.15.144:0/2705907055 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2687273481 0 0) 0x7f669015d670 con 0x7f669015ce80 2024-09-11T23:23:51.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.619+0000 7f668ea00640 1 -- 172.21.15.144:0/2705907055 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f669015d390 con 0x7f669015ce80 2024-09-11T23:23:51.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.619+0000 7f6686a00640 1 -- 172.21.15.144:0/2705907055 >> v1:172.21.15.165:6789/0 conn(0x7f669015ce80 legacy=0x7f66901594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:51.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.619+0000 7f6686a00640 1 -- 172.21.15.144:0/2705907055 >> v1:172.21.15.144:6789/0 conn(0x7f66900d02a0 legacy=0x7f66900d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:51.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.619+0000 7f6686a00640 1 -- 172.21.15.144:0/2705907055 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669015dc30 con 0x7f669015ca40 2024-09-11T23:23:51.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.620+0000 7f6686a00640 1 --2- 172.21.15.144:0/2705907055 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f669015ca40 0x7f669015e430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f66780097d0 tx=0x7f667802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96854673b5961f79 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:51.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.621+0000 7f668ea00640 1 -- 172.21.15.144:0/2705907055 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6678037070 con 0x7f669015ca40 2024-09-11T23:23:51.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.621+0000 7f668ea00640 1 -- 172.21.15.144:0/2705907055 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6678032440 con 0x7f669015ca40 2024-09-11T23:23:51.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.621+0000 7f668ea00640 1 -- 172.21.15.144:0/2705907055 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6678032810 con 0x7f669015ca40 2024-09-11T23:23:51.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.621+0000 7f6696800640 1 -- 172.21.15.144:0/2705907055 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f669015ca40 msgr2=0x7f669015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:51.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.621+0000 7f6696800640 1 --2- 172.21.15.144:0/2705907055 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f669015ca40 0x7f669015e430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f66780097d0 tx=0x7f667802a180 comp rx=0 tx=0).stop 2024-09-11T23:23:51.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.621+0000 7f6696800640 1 -- 172.21.15.144:0/2705907055 shutdown_connections 2024-09-11T23:23:51.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.621+0000 7f6696800640 1 --2- 172.21.15.144:0/2705907055 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f669015ca40 0x7f669015e430 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.621+0000 7f6696800640 1 -- 172.21.15.144:0/2705907055 >> 172.21.15.144:0/2705907055 conn(0x7f6690062cc0 msgr2=0x7f669006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:51.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.622+0000 7f6696800640 1 -- 172.21.15.144:0/2705907055 shutdown_connections 2024-09-11T23:23:51.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.622+0000 7f6696800640 1 -- 172.21.15.144:0/2705907055 wait complete. 2024-09-11T23:23:51.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.623+0000 7f6696800640 1 Processor -- start 2024-09-11T23:23:51.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.623+0000 7f6696800640 1 -- start start 2024-09-11T23:23:51.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.624+0000 7f6696800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66900d02a0 0x7f66900aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:51.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.624+0000 7f6696800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f669015ca40 0x7f66900b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:51.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.624+0000 7f6696800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f669015ce80 0x7f66900b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:51.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.624+0000 7f6696800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6690155d10 con 0x7f66900d02a0 2024-09-11T23:23:51.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.624+0000 7f6696800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6690155b90 con 0x7f669015ce80 2024-09-11T23:23:51.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.624+0000 7f6696800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f66900b4790 con 0x7f669015ca40 2024-09-11T23:23:51.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.624+0000 7f668f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66900d02a0 0x7f66900aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:51.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.624+0000 7f668f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66900d02a0 0x7f66900aeb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53236/0 (socket says 172.21.15.144:53236) 2024-09-11T23:23:51.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.624+0000 7f668f400640 1 -- 172.21.15.144:0/3841866854 learned_addr learned my addr 172.21.15.144:0/3841866854 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:51.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.625+0000 7f668fe00640 1 --2- 172.21.15.144:0/3841866854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f669015ce80 0x7f66900b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:51.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.625+0000 7f6686a00640 1 --2- 172.21.15.144:0/3841866854 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f669015ca40 0x7f66900b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:51.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.625+0000 7f668f400640 1 -- 172.21.15.144:0/3841866854 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f669015ca40 msgr2=0x7f66900b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:51.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.625+0000 7f668f400640 1 --2- 172.21.15.144:0/3841866854 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f669015ca40 0x7f66900b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.625+0000 7f668f400640 1 -- 172.21.15.144:0/3841866854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f669015ce80 msgr2=0x7f66900b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:51.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.625+0000 7f668f400640 1 --2- 172.21.15.144:0/3841866854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f669015ce80 0x7f66900b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.625+0000 7f668f400640 1 -- 172.21.15.144:0/3841866854 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66900b1f20 con 0x7f66900d02a0 2024-09-11T23:23:51.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.625+0000 7f668f400640 1 --2- 172.21.15.144:0/3841866854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66900d02a0 0x7f66900aeb50 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f668000c410 tx=0x7f668000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:51.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.625+0000 7f6687e00640 1 -- 172.21.15.144:0/3841866854 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680017070 con 0x7f66900d02a0 2024-09-11T23:23:51.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.625+0000 7f6687e00640 1 -- 172.21.15.144:0/3841866854 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6680005ce0 con 0x7f66900d02a0 2024-09-11T23:23:51.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.625+0000 7f6696800640 1 -- 172.21.15.144:0/3841866854 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66900b2200 con 0x7f66900d02a0 2024-09-11T23:23:51.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.626+0000 7f6687e00640 1 -- 172.21.15.144:0/3841866854 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66800072f0 con 0x7f66900d02a0 2024-09-11T23:23:51.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.626+0000 7f6696800640 1 -- 172.21.15.144:0/3841866854 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66900b27c0 con 0x7f66900d02a0 2024-09-11T23:23:51.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.627+0000 7f6696800640 1 -- 172.21.15.144:0/3841866854 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66900d0680 con 0x7f66900d02a0 2024-09-11T23:23:51.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.627+0000 7f6687e00640 1 -- 172.21.15.144:0/3841866854 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f668001a070 con 0x7f66900d02a0 2024-09-11T23:23:51.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.628+0000 7f6687e00640 1 --2- 172.21.15.144:0/3841866854 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f666c06c250 0x7f666c06e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:51.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.628+0000 7f6687e00640 1 -- 172.21.15.144:0/3841866854 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5823+0+0 (secure 0 0 0) 0x7f668008a980 con 0x7f66900d02a0 2024-09-11T23:23:51.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.629+0000 7f6686a00640 1 --2- 172.21.15.144:0/3841866854 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f666c06c250 0x7f666c06e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:51.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.629+0000 7f6686a00640 1 --2- 172.21.15.144:0/3841866854 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f666c06c250 0x7f666c06e710 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6678034000 tx=0x7f667802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:51.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.632+0000 7f6687e00640 1 -- 172.21.15.144:0/3841866854 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f66800587a0 con 0x7f66900d02a0 2024-09-11T23:23:51.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.841+0000 7f6696800640 1 -- 172.21.15.144:0/3841866854 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f669015b250 con 0x7f66900d02a0 2024-09-11T23:23:51.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.842+0000 7f6687e00640 1 -- 172.21.15.144:0/3841866854 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5234 (secure 0 0 0) 0x7f668005caa0 con 0x7f66900d02a0 2024-09-11T23:23:51.842 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:51.842 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":72,"btime":"2024-09-11T23:23:19:441038+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2463021219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2463021219},{"type":"v1","addr":"172.21.15.165:6835","nonce":2463021219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6900,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/2687483394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2687483394},{"type":"v1","addr":"172.21.15.144:6801","nonce":2687483394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2256829982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2256829982},{"type":"v1","addr":"172.21.15.165:6834","nonce":2256829982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:23:08.790322+0000","modified":"2024-09-11T23:23:11.810403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6909},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6909":{"gid":6909,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/419371779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":419371779},{"type":"v1","addr":"172.21.15.144:6835","nonce":419371779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6909,"qdb_cluster":[6909]},"id":8}]} 2024-09-11T23:23:51.842 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 72 2024-09-11T23:23:51.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.844+0000 7f6696800640 1 -- 172.21.15.144:0/3841866854 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f666c06c250 msgr2=0x7f666c06e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:51.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.844+0000 7f6696800640 1 --2- 172.21.15.144:0/3841866854 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f666c06c250 0x7f666c06e710 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6678034000 tx=0x7f667802e000 comp rx=0 tx=0).stop 2024-09-11T23:23:51.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.844+0000 7f6696800640 1 -- 172.21.15.144:0/3841866854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66900d02a0 msgr2=0x7f66900aeb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:51.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.844+0000 7f6696800640 1 --2- 172.21.15.144:0/3841866854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66900d02a0 0x7f66900aeb50 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f668000c410 tx=0x7f668000c8d0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.844+0000 7f6696800640 1 -- 172.21.15.144:0/3841866854 shutdown_connections 2024-09-11T23:23:51.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.844+0000 7f6696800640 1 --2- 172.21.15.144:0/3841866854 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f666c06c250 0x7f666c06e710 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.844+0000 7f6696800640 1 --2- 172.21.15.144:0/3841866854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f669015ce80 0x7f66900b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.844+0000 7f6696800640 1 --2- 172.21.15.144:0/3841866854 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f669015ca40 0x7f66900b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.844+0000 7f6696800640 1 --2- 172.21.15.144:0/3841866854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f66900d02a0 0x7f66900aeb50 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:51.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.844+0000 7f6696800640 1 -- 172.21.15.144:0/3841866854 >> 172.21.15.144:0/3841866854 conn(0x7f6690062cc0 msgr2=0x7f66900ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:51.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.844+0000 7f6696800640 1 -- 172.21.15.144:0/3841866854 shutdown_connections 2024-09-11T23:23:51.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:51.844+0000 7f6696800640 1 -- 172.21.15.144:0/3841866854 wait complete. 2024-09-11T23:23:51.860 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:23:52.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.014+0000 7f862f200640 1 Processor -- start 2024-09-11T23:23:52.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.014+0000 7f862f200640 1 -- start start 2024-09-11T23:23:52.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.015+0000 7f862f200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f86300b6410 0x7f86300b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:52.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.015+0000 7f862f200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f863006bee0 con 0x7f86300b5fd0 2024-09-11T23:23:52.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.015+0000 7f862f200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f863006c1c0 con 0x7f863015e640 2024-09-11T23:23:52.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.015+0000 7f862f200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f863015ea20 con 0x7f86300b6410 2024-09-11T23:23:52.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.015+0000 7f862d400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f86300b5fd0 0x7f86300b7750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52410/0 (socket says 172.21.15.144:52410) 2024-09-11T23:23:52.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.015+0000 7f862d400640 1 -- 172.21.15.144:0/755283556 learned_addr learned my addr 172.21.15.144:0/755283556 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:52.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.016+0000 7f862e800640 1 --2- 172.21.15.144:0/755283556 >> v2:172.21.15.165:3300/0 conn(0x7f86300b6410 0x7f86300b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:52.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.016+0000 7f862ca00640 1 -- 172.21.15.144:0/755283556 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 756863253 0 0) 0x7f863006bee0 con 0x7f86300b5fd0 2024-09-11T23:23:52.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.016+0000 7f862ca00640 1 -- 172.21.15.144:0/755283556 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8614003520 con 0x7f86300b5fd0 2024-09-11T23:23:52.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.016+0000 7f862ca00640 1 -- 172.21.15.144:0/755283556 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1556917754 0 0) 0x7f8614003520 con 0x7f86300b5fd0 2024-09-11T23:23:52.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.016+0000 7f862ca00640 1 -- 172.21.15.144:0/755283556 >> v2:172.21.15.165:3300/0 conn(0x7f86300b6410 msgr2=0x7f86300b7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:52.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.016+0000 7f862ca00640 1 --2- 172.21.15.144:0/755283556 >> v2:172.21.15.165:3300/0 conn(0x7f86300b6410 0x7f86300b7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.016+0000 7f862ca00640 1 -- 172.21.15.144:0/755283556 >> v1:172.21.15.165:6789/0 conn(0x7f863015e640 legacy=0x7f86300d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:52.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.016+0000 7f862ca00640 1 -- 172.21.15.144:0/755283556 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863006c4a0 con 0x7f86300b5fd0 2024-09-11T23:23:52.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.016+0000 7f862ca00640 1 -- 172.21.15.144:0/755283556 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f861c001670 con 0x7f86300b5fd0 2024-09-11T23:23:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.016+0000 7f862e800640 1 --2- 172.21.15.144:0/755283556 >> v2:172.21.15.165:3300/0 conn(0x7f86300b6410 0x7f86300b7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:23:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.016+0000 7f862ca00640 1 -- 172.21.15.144:0/755283556 >> v1:172.21.15.144:6789/0 conn(0x7f86300b5fd0 legacy=0x7f86300b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.016+0000 7f862ca00640 1 --2- 172.21.15.144:0/755283556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86140039b0 0x7f8614003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.017+0000 7f862ca00640 1 --2- 172.21.15.144:0/755283556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86140043b0 0x7f8614004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.017+0000 7f862ca00640 1 --2- 172.21.15.144:0/755283556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8614005080 0x7f861400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.017+0000 7f862ca00640 1 -- 172.21.15.144:0/755283556 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f861400bfb0 con 0x7f86140043b0 2024-09-11T23:23:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.017+0000 7f862ca00640 1 -- 172.21.15.144:0/755283556 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f861400c160 con 0x7f8614005080 2024-09-11T23:23:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.017+0000 7f862ca00640 1 -- 172.21.15.144:0/755283556 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f861400c360 con 0x7f86140039b0 2024-09-11T23:23:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.017+0000 7f862d400640 1 --2- 172.21.15.144:0/755283556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86140043b0 0x7f8614004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:52.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.017+0000 7f862de00640 1 --2- 172.21.15.144:0/755283556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86140039b0 0x7f8614003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:52.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.017+0000 7f862e800640 1 --2- 172.21.15.144:0/755283556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8614005080 0x7f861400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:52.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.017+0000 7f862d400640 1 -- 172.21.15.144:0/755283556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86140039b0 msgr2=0x7f8614003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:52.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.017+0000 7f862d400640 1 --2- 172.21.15.144:0/755283556 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86140039b0 0x7f8614003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.017+0000 7f862d400640 1 -- 172.21.15.144:0/755283556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8614005080 msgr2=0x7f861400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:52.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.017+0000 7f862d400640 1 --2- 172.21.15.144:0/755283556 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8614005080 0x7f861400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.017+0000 7f862d400640 1 -- 172.21.15.144:0/755283556 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8614003520 con 0x7f86140043b0 2024-09-11T23:23:52.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.017+0000 7f862e800640 1 -- 172.21.15.144:0/755283556 reap_dead start 2024-09-11T23:23:52.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.018+0000 7f862d400640 1 --2- 172.21.15.144:0/755283556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86140043b0 0x7f8614004880 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f861c00c240 tx=0x7f8614005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4963ee315cbbbe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:52.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.018+0000 7f862ca00640 1 -- 172.21.15.144:0/755283556 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f861c007d30 con 0x7f86140043b0 2024-09-11T23:23:52.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.019+0000 7f862ca00640 1 -- 172.21.15.144:0/755283556 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f861c005af0 con 0x7f86140043b0 2024-09-11T23:23:52.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.019+0000 7f862ca00640 1 -- 172.21.15.144:0/755283556 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f861c007070 con 0x7f86140043b0 2024-09-11T23:23:52.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.019+0000 7f862f200640 1 -- 172.21.15.144:0/755283556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86140043b0 msgr2=0x7f8614004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:52.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.019+0000 7f862f200640 1 --2- 172.21.15.144:0/755283556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86140043b0 0x7f8614004880 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f861c00c240 tx=0x7f8614005830 comp rx=0 tx=0).stop 2024-09-11T23:23:52.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.019+0000 7f862f200640 1 -- 172.21.15.144:0/755283556 shutdown_connections 2024-09-11T23:23:52.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.019+0000 7f862f200640 1 --2- 172.21.15.144:0/755283556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86140043b0 0x7f8614004880 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.019+0000 7f862f200640 1 -- 172.21.15.144:0/755283556 >> 172.21.15.144:0/755283556 conn(0x7f86300d0fd0 msgr2=0x7f86300d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:52.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.019+0000 7f862f200640 1 -- 172.21.15.144:0/755283556 shutdown_connections 2024-09-11T23:23:52.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.019+0000 7f862f200640 1 -- 172.21.15.144:0/755283556 wait complete. 2024-09-11T23:23:52.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.021+0000 7f862f200640 1 Processor -- start 2024-09-11T23:23:52.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.021+0000 7f862f200640 1 -- start start 2024-09-11T23:23:52.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.022+0000 7f862f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86140043b0 0x7f863015f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:52.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.022+0000 7f862f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f863015adf0 0x7f86300c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:52.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.022+0000 7f862f200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8630157680 0x7f8630157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:52.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.022+0000 7f862f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f86300b68a0 con 0x7f863015adf0 2024-09-11T23:23:52.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.022+0000 7f862f200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f863006caf0 con 0x7f8630157680 2024-09-11T23:23:52.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.022+0000 7f862f200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f86300d3a20 con 0x7f86140043b0 2024-09-11T23:23:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.022+0000 7f862d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f863015adf0 0x7f86300c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.022+0000 7f862d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f863015adf0 0x7f86300c9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53252/0 (socket says 172.21.15.144:53252) 2024-09-11T23:23:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.022+0000 7f862d400640 1 -- 172.21.15.144:0/839136039 learned_addr learned my addr 172.21.15.144:0/839136039 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.022+0000 7f862de00640 1 --2- 172.21.15.144:0/839136039 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86140043b0 0x7f863015f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:52.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.022+0000 7f862e800640 1 --2- 172.21.15.144:0/839136039 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8630157680 0x7f8630157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:52.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.023+0000 7f862d400640 1 -- 172.21.15.144:0/839136039 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86140043b0 msgr2=0x7f863015f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:52.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.023+0000 7f862d400640 1 --2- 172.21.15.144:0/839136039 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86140043b0 0x7f863015f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.023+0000 7f862d400640 1 -- 172.21.15.144:0/839136039 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8630157680 msgr2=0x7f8630157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:52.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.023+0000 7f862d400640 1 --2- 172.21.15.144:0/839136039 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8630157680 0x7f8630157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.023+0000 7f862d400640 1 -- 172.21.15.144:0/839136039 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8630160760 con 0x7f863015adf0 2024-09-11T23:23:52.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.023+0000 7f862d400640 1 --2- 172.21.15.144:0/839136039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f863015adf0 0x7f86300c9a90 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f861c00c240 tx=0x7f86300d0e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:52.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.023+0000 7f8626000640 1 -- 172.21.15.144:0/839136039 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f861c040030 con 0x7f863015adf0 2024-09-11T23:23:52.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.023+0000 7f8626000640 1 -- 172.21.15.144:0/839136039 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f861c001470 con 0x7f863015adf0 2024-09-11T23:23:52.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.023+0000 7f8626000640 1 -- 172.21.15.144:0/839136039 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f861c037040 con 0x7f863015adf0 2024-09-11T23:23:52.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.023+0000 7f862f200640 1 -- 172.21.15.144:0/839136039 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8630160a40 con 0x7f863015adf0 2024-09-11T23:23:52.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.023+0000 7f862f200640 1 -- 172.21.15.144:0/839136039 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86300c9fd0 con 0x7f863015adf0 2024-09-11T23:23:52.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.025+0000 7f862f200640 1 -- 172.21.15.144:0/839136039 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86300d3db0 con 0x7f863015adf0 2024-09-11T23:23:52.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.025+0000 7f8626000640 1 -- 172.21.15.144:0/839136039 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f861c043070 con 0x7f863015adf0 2024-09-11T23:23:52.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.026+0000 7f8626000640 1 --2- 172.21.15.144:0/839136039 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f861006c220 0x7f861006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:52.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.026+0000 7f8626000640 1 -- 172.21.15.144:0/839136039 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5823+0+0 (secure 0 0 0) 0x7f861c0aac40 con 0x7f863015adf0 2024-09-11T23:23:52.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.027+0000 7f862de00640 1 --2- 172.21.15.144:0/839136039 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f861006c220 0x7f861006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:52.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.027+0000 7f862de00640 1 --2- 172.21.15.144:0/839136039 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f861006c220 0x7f861006e6e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f863015b2f0 tx=0x7f8620009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:52.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.030+0000 7f8626000640 1 -- 172.21.15.144:0/839136039 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f861c0788c0 con 0x7f863015adf0 2024-09-11T23:23:52.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.206+0000 7f862f200640 1 -- 172.21.15.144:0/839136039 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86300cf130 con 0x7f863015adf0 2024-09-11T23:23:52.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.207+0000 7f8626000640 1 -- 172.21.15.144:0/839136039 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+16970 (secure 0 0 0) 0x7f861c07cbc0 con 0x7f863015adf0 2024-09-11T23:23:52.207 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:52.207 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":104,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:23:49.835187+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:23:06.559198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-11T23:23:07.784853+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.25","mappings":[{"from":0,"to":2}]},{"pgid":"17.30","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:23:52.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.210+0000 7f862f200640 1 -- 172.21.15.144:0/839136039 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f861006c220 msgr2=0x7f861006e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:52.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.210+0000 7f862f200640 1 --2- 172.21.15.144:0/839136039 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f861006c220 0x7f861006e6e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f863015b2f0 tx=0x7f8620009040 comp rx=0 tx=0).stop 2024-09-11T23:23:52.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.210+0000 7f862f200640 1 -- 172.21.15.144:0/839136039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f863015adf0 msgr2=0x7f86300c9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:52.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.210+0000 7f862f200640 1 --2- 172.21.15.144:0/839136039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f863015adf0 0x7f86300c9a90 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f861c00c240 tx=0x7f86300d0e00 comp rx=0 tx=0).stop 2024-09-11T23:23:52.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.210+0000 7f862f200640 1 -- 172.21.15.144:0/839136039 shutdown_connections 2024-09-11T23:23:52.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.210+0000 7f862f200640 1 --2- 172.21.15.144:0/839136039 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f861006c220 0x7f861006e6e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.210+0000 7f862f200640 1 --2- 172.21.15.144:0/839136039 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8630157680 0x7f8630157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.210+0000 7f862f200640 1 --2- 172.21.15.144:0/839136039 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f863015adf0 0x7f86300c9a90 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.210+0000 7f862f200640 1 --2- 172.21.15.144:0/839136039 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86140043b0 0x7f863015f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.210+0000 7f862f200640 1 -- 172.21.15.144:0/839136039 >> 172.21.15.144:0/839136039 conn(0x7f86300d0fd0 msgr2=0x7f86300b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:52.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.210+0000 7f862f200640 1 -- 172.21.15.144:0/839136039 shutdown_connections 2024-09-11T23:23:52.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.210+0000 7f862f200640 1 -- 172.21.15.144:0/839136039 wait complete. 2024-09-11T23:23:52.226 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:23:52.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.380+0000 7f5df3200640 1 Processor -- start 2024-09-11T23:23:52.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.380+0000 7f5df3200640 1 -- start start 2024-09-11T23:23:52.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.382+0000 7f5df3200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5dec0cd130 0x7f5dec15ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.382+0000 7f5df3200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dec0cd5c0 con 0x7f5dec0b4ed0 2024-09-11T23:23:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.382+0000 7f5df3200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dec0cd8a0 con 0x7f5dec06c2b0 2024-09-11T23:23:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.382+0000 7f5df3200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5dec0b52b0 con 0x7f5dec0cd130 2024-09-11T23:23:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.382+0000 7f5debe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5dec0b4ed0 0x7f5dec06bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:52426/0 (socket says 172.21.15.144:52426) 2024-09-11T23:23:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.382+0000 7f5debe00640 1 -- 172.21.15.144:0/3925705123 learned_addr learned my addr 172.21.15.144:0/3925705123 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.382+0000 7f5deb400640 1 --2- 172.21.15.144:0/3925705123 >> v2:172.21.15.144:3300/0 conn(0x7f5dec0cd130 0x7f5dec15ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.383+0000 7f5deaa00640 1 -- 172.21.15.144:0/3925705123 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1490523988 0 0) 0x7f5dec0cd5c0 con 0x7f5dec0b4ed0 2024-09-11T23:23:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.383+0000 7f5deaa00640 1 -- 172.21.15.144:0/3925705123 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dd0003520 con 0x7f5dec0b4ed0 2024-09-11T23:23:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.383+0000 7f5deb400640 1 -- 172.21.15.144:0/3925705123 >> v1:172.21.15.165:6789/0 conn(0x7f5dec06c2b0 legacy=0x7f5dec0b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.383+0000 7f5deb400640 1 -- 172.21.15.144:0/3925705123 >> v1:172.21.15.144:6789/0 conn(0x7f5dec0b4ed0 legacy=0x7f5dec06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:52.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.383+0000 7f5deb400640 1 -- 172.21.15.144:0/3925705123 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dec0cdb80 con 0x7f5dec0cd130 2024-09-11T23:23:52.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.384+0000 7f5deb400640 1 --2- 172.21.15.144:0/3925705123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dec0cd130 0x7f5dec15ba50 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800a940 tx=0x7f5dd802b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5bf07a0ea22f2de server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:52.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.384+0000 7f5deaa00640 1 -- 172.21.15.144:0/3925705123 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd800b040 con 0x7f5dec0cd130 2024-09-11T23:23:52.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.384+0000 7f5deaa00640 1 -- 172.21.15.144:0/3925705123 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd8030710 con 0x7f5dec0cd130 2024-09-11T23:23:52.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.384+0000 7f5deaa00640 1 -- 172.21.15.144:0/3925705123 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8030ac0 con 0x7f5dec0cd130 2024-09-11T23:23:52.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.385+0000 7f5df3200640 1 -- 172.21.15.144:0/3925705123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dec0cd130 msgr2=0x7f5dec15ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:52.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.385+0000 7f5df3200640 1 --2- 172.21.15.144:0/3925705123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dec0cd130 0x7f5dec15ba50 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800a940 tx=0x7f5dd802b550 comp rx=0 tx=0).stop 2024-09-11T23:23:52.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.385+0000 7f5df3200640 1 -- 172.21.15.144:0/3925705123 shutdown_connections 2024-09-11T23:23:52.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.385+0000 7f5df3200640 1 --2- 172.21.15.144:0/3925705123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dec0cd130 0x7f5dec15ba50 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.385+0000 7f5df3200640 1 -- 172.21.15.144:0/3925705123 >> 172.21.15.144:0/3925705123 conn(0x7f5dec062cc0 msgr2=0x7f5dec06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:52.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.385+0000 7f5df3200640 1 -- 172.21.15.144:0/3925705123 shutdown_connections 2024-09-11T23:23:52.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.385+0000 7f5df3200640 1 -- 172.21.15.144:0/3925705123 wait complete. 2024-09-11T23:23:52.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.386+0000 7f5df3200640 1 Processor -- start 2024-09-11T23:23:52.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.387+0000 7f5df3200640 1 -- start start 2024-09-11T23:23:52.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.387+0000 7f5df3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dec06c2b0 0x7f5dec153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:52.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.387+0000 7f5df3200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dec0b4ed0 0x7f5dec0affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:52.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.387+0000 7f5df3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dec154290 0x7f5dec154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:52.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.387+0000 7f5df3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec0ce140 con 0x7f5dec06c2b0 2024-09-11T23:23:52.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.387+0000 7f5df3200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec15bf90 con 0x7f5dec0b4ed0 2024-09-11T23:23:52.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.387+0000 7f5df3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5dec0ce660 con 0x7f5dec154290 2024-09-11T23:23:52.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.388+0000 7f5debe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dec06c2b0 0x7f5dec153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:52.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.388+0000 7f5debe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dec06c2b0 0x7f5dec153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53280/0 (socket says 172.21.15.144:53280) 2024-09-11T23:23:52.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.388+0000 7f5debe00640 1 -- 172.21.15.144:0/466911037 learned_addr learned my addr 172.21.15.144:0/466911037 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:52.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.388+0000 7f5deb400640 1 --2- 172.21.15.144:0/466911037 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dec0b4ed0 0x7f5dec0affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:52.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.388+0000 7f5df1200640 1 --2- 172.21.15.144:0/466911037 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dec154290 0x7f5dec154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:52.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.388+0000 7f5debe00640 1 -- 172.21.15.144:0/466911037 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dec154290 msgr2=0x7f5dec154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:52.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.388+0000 7f5debe00640 1 --2- 172.21.15.144:0/466911037 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dec154290 0x7f5dec154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.388+0000 7f5debe00640 1 -- 172.21.15.144:0/466911037 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dec0b4ed0 msgr2=0x7f5dec0affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:52.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.388+0000 7f5debe00640 1 --2- 172.21.15.144:0/466911037 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dec0b4ed0 0x7f5dec0affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.388+0000 7f5debe00640 1 -- 172.21.15.144:0/466911037 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dec0b0720 con 0x7f5dec06c2b0 2024-09-11T23:23:52.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.388+0000 7f5df1200640 1 --2- 172.21.15.144:0/466911037 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dec154290 0x7f5dec154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:23:52.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.388+0000 7f5debe00640 1 --2- 172.21.15.144:0/466911037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dec06c2b0 0x7f5dec153c20 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00cbc0 tx=0x7f5ddc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:52.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.389+0000 7f5de3e00640 1 -- 172.21.15.144:0/466911037 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc017070 con 0x7f5dec06c2b0 2024-09-11T23:23:52.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.389+0000 7f5de3e00640 1 -- 172.21.15.144:0/466911037 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ddc00ad40 con 0x7f5dec06c2b0 2024-09-11T23:23:52.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.389+0000 7f5de3e00640 1 -- 172.21.15.144:0/466911037 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc012600 con 0x7f5dec06c2b0 2024-09-11T23:23:52.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.389+0000 7f5df3200640 1 -- 172.21.15.144:0/466911037 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dec159b00 con 0x7f5dec06c2b0 2024-09-11T23:23:52.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.389+0000 7f5df3200640 1 -- 172.21.15.144:0/466911037 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dec15a0c0 con 0x7f5dec06c2b0 2024-09-11T23:23:52.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.390+0000 7f5df3200640 1 -- 172.21.15.144:0/466911037 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dec0d0f70 con 0x7f5dec06c2b0 2024-09-11T23:23:52.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.391+0000 7f5de3e00640 1 -- 172.21.15.144:0/466911037 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f5ddc01a070 con 0x7f5dec06c2b0 2024-09-11T23:23:52.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.391+0000 7f5de3e00640 1 --2- 172.21.15.144:0/466911037 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5dcc06c220 0x7f5dcc06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:52.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.391+0000 7f5de3e00640 1 -- 172.21.15.144:0/466911037 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5823+0+0 (secure 0 0 0) 0x7f5ddc08b4d0 con 0x7f5dec06c2b0 2024-09-11T23:23:52.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.392+0000 7f5deb400640 1 --2- 172.21.15.144:0/466911037 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5dcc06c220 0x7f5dcc06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:52.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.392+0000 7f5deb400640 1 --2- 172.21.15.144:0/466911037 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5dcc06c220 0x7f5dcc06e6e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8035000 tx=0x7f5dd800c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:52.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.395+0000 7f5de3e00640 1 -- 172.21.15.144:0/466911037 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ddc059110 con 0x7f5dec06c2b0 2024-09-11T23:23:52.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.601+0000 7f5df3200640 1 -- 172.21.15.144:0/466911037 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5dec076030 con 0x7f5dec06c2b0 2024-09-11T23:23:52.601 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-11T23:23:52.601+0000 7f86fcc00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:23:52.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.604+0000 7f5de3e00640 1 -- 172.21.15.144:0/466911037 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v73) ==== 161+0+0 (secure 0 0 0) 0x7f5ddc05d410 con 0x7f5dec06c2b0 2024-09-11T23:23:52.603 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:23:52.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.606+0000 7f5df3200640 1 -- 172.21.15.144:0/466911037 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5dcc06c220 msgr2=0x7f5dcc06e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:52.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.606+0000 7f5df3200640 1 --2- 172.21.15.144:0/466911037 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5dcc06c220 0x7f5dcc06e6e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8035000 tx=0x7f5dd800c040 comp rx=0 tx=0).stop 2024-09-11T23:23:52.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.606+0000 7f5df3200640 1 -- 172.21.15.144:0/466911037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dec06c2b0 msgr2=0x7f5dec153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:52.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.606+0000 7f5df3200640 1 --2- 172.21.15.144:0/466911037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dec06c2b0 0x7f5dec153c20 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00cbc0 tx=0x7f5ddc00a430 comp rx=0 tx=0).stop 2024-09-11T23:23:52.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.606+0000 7f5df3200640 1 -- 172.21.15.144:0/466911037 shutdown_connections 2024-09-11T23:23:52.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.606+0000 7f5df3200640 1 --2- 172.21.15.144:0/466911037 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5dcc06c220 0x7f5dcc06e6e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.606+0000 7f5df3200640 1 --2- 172.21.15.144:0/466911037 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5dec154290 0x7f5dec154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.606+0000 7f5df3200640 1 --2- 172.21.15.144:0/466911037 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dec0b4ed0 0x7f5dec0affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.606+0000 7f5df3200640 1 --2- 172.21.15.144:0/466911037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5dec06c2b0 0x7f5dec153c20 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.606+0000 7f5df3200640 1 -- 172.21.15.144:0/466911037 >> 172.21.15.144:0/466911037 conn(0x7f5dec062cc0 msgr2=0x7f5dec1e8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:52.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.607+0000 7f5df3200640 1 -- 172.21.15.144:0/466911037 shutdown_connections 2024-09-11T23:23:52.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.607+0000 7f5df3200640 1 -- 172.21.15.144:0/466911037 wait complete. 2024-09-11T23:23:52.623 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:23:52.673 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-11T23:23:52.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.783+0000 7f32cc200640 1 Processor -- start 2024-09-11T23:23:52.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.784+0000 7f32cc200640 1 -- start start 2024-09-11T23:23:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.785+0000 7f32cc200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f32c4158e50 0x7f32c40b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.785+0000 7f32cc200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f32c415c370 0x7f32c406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.785+0000 7f32cc200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32c415c800 con 0x7f32c406ef60 2024-09-11T23:23:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.785+0000 7f32cc200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f32c40b43f0 con 0x7f32c4158e50 2024-09-11T23:23:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.785+0000 7f32cc200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f32c40b3630 con 0x7f32c415c370 2024-09-11T23:23:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.785+0000 7f32c9800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f32c4158e50 0x7f32c40b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.785+0000 7f32c9800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f32c4158e50 0x7f32c40b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53304/0 (socket says 172.21.15.144:53304) 2024-09-11T23:23:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.785+0000 7f32c9800640 1 -- 172.21.15.144:0/995167788 learned_addr learned my addr 172.21.15.144:0/995167788 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.785+0000 7f32c9800640 1 -- 172.21.15.144:0/995167788 >> v2:172.21.15.165:3300/0 conn(0x7f32c415c370 msgr2=0x7f32c406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:52.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.785+0000 7f32c9800640 1 --2- 172.21.15.144:0/995167788 >> v2:172.21.15.165:3300/0 conn(0x7f32c415c370 0x7f32c406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.785+0000 7f32c9800640 1 -- 172.21.15.144:0/995167788 >> v1:172.21.15.165:6789/0 conn(0x7f32c406ef60 legacy=0x7f32c415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:52.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.785+0000 7f32c9800640 1 -- 172.21.15.144:0/995167788 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c40b3910 con 0x7f32c4158e50 2024-09-11T23:23:52.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.786+0000 7f32c9800640 1 --2- 172.21.15.144:0/995167788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c4158e50 0x7f32c40b5050 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f32c40cdd40 tx=0x7f32b802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df51c46065239af4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:52.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.787+0000 7f32c3e00640 1 -- 172.21.15.144:0/995167788 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b8037070 con 0x7f32c4158e50 2024-09-11T23:23:52.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.787+0000 7f32c3e00640 1 -- 172.21.15.144:0/995167788 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b8032440 con 0x7f32c4158e50 2024-09-11T23:23:52.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.787+0000 7f32c3e00640 1 -- 172.21.15.144:0/995167788 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b8032810 con 0x7f32c4158e50 2024-09-11T23:23:52.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.787+0000 7f32cc200640 1 -- 172.21.15.144:0/995167788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c4158e50 msgr2=0x7f32c40b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:52.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.787+0000 7f32cc200640 1 --2- 172.21.15.144:0/995167788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c4158e50 0x7f32c40b5050 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f32c40cdd40 tx=0x7f32b802a230 comp rx=0 tx=0).stop 2024-09-11T23:23:52.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.787+0000 7f32cc200640 1 -- 172.21.15.144:0/995167788 shutdown_connections 2024-09-11T23:23:52.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.787+0000 7f32cc200640 1 --2- 172.21.15.144:0/995167788 >> v2:172.21.15.165:3300/0 conn(0x7f32c415c370 0x7f32c406ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.787+0000 7f32cc200640 1 --2- 172.21.15.144:0/995167788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c4158e50 0x7f32c40b5050 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.787+0000 7f32cc200640 1 -- 172.21.15.144:0/995167788 >> 172.21.15.144:0/995167788 conn(0x7f32c406bba0 msgr2=0x7f32c406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:52.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.787+0000 7f32cc200640 1 -- 172.21.15.144:0/995167788 shutdown_connections 2024-09-11T23:23:52.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.787+0000 7f32cc200640 1 -- 172.21.15.144:0/995167788 wait complete. 2024-09-11T23:23:52.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.789+0000 7f32cc200640 1 Processor -- start 2024-09-11T23:23:52.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.789+0000 7f32cc200640 1 -- start start 2024-09-11T23:23:52.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.790+0000 7f32cc200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32c406ef60 0x7f32c4147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:52.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.790+0000 7f32cc200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32c4158e50 0x7f32c4150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:52.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.790+0000 7f32cc200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c415c370 0x7f32c4072050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:52.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.790+0000 7f32cc200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f32c4159230 con 0x7f32c415c370 2024-09-11T23:23:52.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.790+0000 7f32cc200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f32c40b3ed0 con 0x7f32c4158e50 2024-09-11T23:23:52.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.790+0000 7f32cc200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f32c40cf210 con 0x7f32c406ef60 2024-09-11T23:23:52.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.790+0000 7f32ca200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c415c370 0x7f32c4072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:52.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.790+0000 7f32ca200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c415c370 0x7f32c4072050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53306/0 (socket says 172.21.15.144:53306) 2024-09-11T23:23:52.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.790+0000 7f32ca200640 1 -- 172.21.15.144:0/3390120506 learned_addr learned my addr 172.21.15.144:0/3390120506 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:52.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.790+0000 7f32c9800640 1 --2- 172.21.15.144:0/3390120506 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32c406ef60 0x7f32c4147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:52.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.790+0000 7f32c8e00640 1 --2- 172.21.15.144:0/3390120506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32c4158e50 0x7f32c4150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:52.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.790+0000 7f32ca200640 1 -- 172.21.15.144:0/3390120506 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32c406ef60 msgr2=0x7f32c4147aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:52.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.790+0000 7f32ca200640 1 --2- 172.21.15.144:0/3390120506 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32c406ef60 0x7f32c4147aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.790+0000 7f32ca200640 1 -- 172.21.15.144:0/3390120506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32c4158e50 msgr2=0x7f32c4150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:52.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.790+0000 7f32ca200640 1 --2- 172.21.15.144:0/3390120506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32c4158e50 0x7f32c4150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:52.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.790+0000 7f32ca200640 1 -- 172.21.15.144:0/3390120506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c41507c0 con 0x7f32c415c370 2024-09-11T23:23:52.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.791+0000 7f32ca200640 1 --2- 172.21.15.144:0/3390120506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c415c370 0x7f32c4072050 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00c780 tx=0x7f32bc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:52.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.791+0000 7f32c1600640 1 -- 172.21.15.144:0/3390120506 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc017070 con 0x7f32c415c370 2024-09-11T23:23:52.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.791+0000 7f32c1600640 1 -- 172.21.15.144:0/3390120506 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32bc003da0 con 0x7f32c415c370 2024-09-11T23:23:52.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.791+0000 7f32c1600640 1 -- 172.21.15.144:0/3390120506 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32bc0052b0 con 0x7f32c415c370 2024-09-11T23:23:52.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.791+0000 7f32cc200640 1 -- 172.21.15.144:0/3390120506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c40728a0 con 0x7f32c415c370 2024-09-11T23:23:52.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.791+0000 7f32cc200640 1 -- 172.21.15.144:0/3390120506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c414f7a0 con 0x7f32c415c370 2024-09-11T23:23:52.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.792+0000 7f32cc200640 1 -- 172.21.15.144:0/3390120506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32c4152140 con 0x7f32c415c370 2024-09-11T23:23:52.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.793+0000 7f32c1600640 1 -- 172.21.15.144:0/3390120506 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f32bc005450 con 0x7f32c415c370 2024-09-11T23:23:52.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.794+0000 7f32c1600640 1 --2- 172.21.15.144:0/3390120506 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f32a406c220 0x7f32a406e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:52.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.794+0000 7f32c1600640 1 -- 172.21.15.144:0/3390120506 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5881+0+0 (secure 0 0 0) 0x7f32bc08abb0 con 0x7f32c415c370 2024-09-11T23:23:52.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.794+0000 7f32c9800640 1 --2- 172.21.15.144:0/3390120506 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f32a406c220 0x7f32a406e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:52.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.795+0000 7f32c9800640 1 --2- 172.21.15.144:0/3390120506 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f32a406c220 0x7f32a406e6e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f32b8034000 tx=0x7f32b802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:52.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:52.798+0000 7f32c1600640 1 -- 172.21.15.144:0/3390120506 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32bc058e90 con 0x7f32c415c370 2024-09-11T23:23:53.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.008+0000 7f32cc200640 1 -- 172.21.15.144:0/3390120506 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f32c4151e60 con 0x7f32c415c370 2024-09-11T23:23:53.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.610+0000 7f32c1600640 1 -- 172.21.15.144:0/3390120506 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v74) ==== 104+0+0 (secure 0 0 0) 0x7f32bc058790 con 0x7f32c415c370 2024-09-11T23:23:53.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.613+0000 7f32cc200640 1 -- 172.21.15.144:0/3390120506 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f32a406c220 msgr2=0x7f32a406e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:53.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.613+0000 7f32cc200640 1 --2- 172.21.15.144:0/3390120506 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f32a406c220 0x7f32a406e6e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f32b8034000 tx=0x7f32b802e000 comp rx=0 tx=0).stop 2024-09-11T23:23:53.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.613+0000 7f32cc200640 1 -- 172.21.15.144:0/3390120506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c415c370 msgr2=0x7f32c4072050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:53.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.613+0000 7f32cc200640 1 --2- 172.21.15.144:0/3390120506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c415c370 0x7f32c4072050 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00c780 tx=0x7f32bc00cc40 comp rx=0 tx=0).stop 2024-09-11T23:23:53.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.613+0000 7f32cc200640 1 -- 172.21.15.144:0/3390120506 shutdown_connections 2024-09-11T23:23:53.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.613+0000 7f32cc200640 1 --2- 172.21.15.144:0/3390120506 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f32a406c220 0x7f32a406e6e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:53.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.613+0000 7f32cc200640 1 --2- 172.21.15.144:0/3390120506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32c415c370 0x7f32c4072050 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:53.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.613+0000 7f32cc200640 1 --2- 172.21.15.144:0/3390120506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32c4158e50 0x7f32c4150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:53.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.613+0000 7f32cc200640 1 --2- 172.21.15.144:0/3390120506 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f32c406ef60 0x7f32c4147aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:53.613 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.613+0000 7f32cc200640 1 -- 172.21.15.144:0/3390120506 >> 172.21.15.144:0/3390120506 conn(0x7f32c406bba0 msgr2=0x7f32c4154ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:53.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.613+0000 7f32cc200640 1 -- 172.21.15.144:0/3390120506 shutdown_connections 2024-09-11T23:23:53.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.613+0000 7f32cc200640 1 -- 172.21.15.144:0/3390120506 wait complete. 2024-09-11T23:23:53.632 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:23:53.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.792+0000 7f49a5200640 1 Processor -- start 2024-09-11T23:23:53.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.792+0000 7f49a5200640 1 -- start start 2024-09-11T23:23:53.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.793+0000 7f49a5200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f49a015ea00 0x7f49a00b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:53.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.793+0000 7f49a5200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f49a00d39e0 0x7f49a00b6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:53.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.793+0000 7f49a5200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49a00cf860 con 0x7f49a00b3970 2024-09-11T23:23:53.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.793+0000 7f49a5200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f49a015ede0 con 0x7f49a00d39e0 2024-09-11T23:23:53.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.793+0000 7f49a5200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f49a00d0100 con 0x7f49a015ea00 2024-09-11T23:23:53.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.793+0000 7f499e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f49a00d39e0 0x7f49a00b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:53.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.793+0000 7f499e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f49a00d39e0 0x7f49a00b6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53308/0 (socket says 172.21.15.144:53308) 2024-09-11T23:23:53.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.793+0000 7f499e800640 1 -- 172.21.15.144:0/1692535542 learned_addr learned my addr 172.21.15.144:0/1692535542 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:53.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.794+0000 7f499de00640 1 --2- 172.21.15.144:0/1692535542 >> v2:172.21.15.165:3300/0 conn(0x7f49a015ea00 0x7f49a00b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:53.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.794+0000 7f499e800640 1 -- 172.21.15.144:0/1692535542 >> v2:172.21.15.165:3300/0 conn(0x7f49a015ea00 msgr2=0x7f49a00b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:53.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.794+0000 7f499e800640 1 --2- 172.21.15.144:0/1692535542 >> v2:172.21.15.165:3300/0 conn(0x7f49a015ea00 0x7f49a00b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:53.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.794+0000 7f499e800640 1 -- 172.21.15.144:0/1692535542 >> v1:172.21.15.165:6789/0 conn(0x7f49a00b3970 legacy=0x7f49a0162460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:53.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.794+0000 7f499e800640 1 -- 172.21.15.144:0/1692535542 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a00cfb40 con 0x7f49a00d39e0 2024-09-11T23:23:53.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.794+0000 7f499de00640 1 --2- 172.21.15.144:0/1692535542 >> v2:172.21.15.165:3300/0 conn(0x7f49a015ea00 0x7f49a00b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:23:53.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.795+0000 7f499e800640 1 --2- 172.21.15.144:0/1692535542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49a00d39e0 0x7f49a00b6720 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f49a0076110 tx=0x7f499802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff105df61ad42486 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:53.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.795+0000 7f499ca00640 1 -- 172.21.15.144:0/1692535542 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4998036070 con 0x7f49a00d39e0 2024-09-11T23:23:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.795+0000 7f499ca00640 1 -- 172.21.15.144:0/1692535542 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4998031600 con 0x7f49a00d39e0 2024-09-11T23:23:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.795+0000 7f499ca00640 1 -- 172.21.15.144:0/1692535542 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49980319d0 con 0x7f49a00d39e0 2024-09-11T23:23:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.796+0000 7f49a5200640 1 -- 172.21.15.144:0/1692535542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49a00d39e0 msgr2=0x7f49a00b6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.796+0000 7f49a5200640 1 --2- 172.21.15.144:0/1692535542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49a00d39e0 0x7f49a00b6720 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f49a0076110 tx=0x7f499802a6f0 comp rx=0 tx=0).stop 2024-09-11T23:23:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.796+0000 7f49a5200640 1 -- 172.21.15.144:0/1692535542 shutdown_connections 2024-09-11T23:23:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.796+0000 7f49a5200640 1 --2- 172.21.15.144:0/1692535542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49a00d39e0 0x7f49a00b6720 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.796+0000 7f49a5200640 1 --2- 172.21.15.144:0/1692535542 >> v2:172.21.15.165:3300/0 conn(0x7f49a015ea00 0x7f49a00b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.796+0000 7f49a5200640 1 -- 172.21.15.144:0/1692535542 >> 172.21.15.144:0/1692535542 conn(0x7f49a00d11e0 msgr2=0x7f49a00d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.796+0000 7f49a5200640 1 -- 172.21.15.144:0/1692535542 shutdown_connections 2024-09-11T23:23:53.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.796+0000 7f49a5200640 1 -- 172.21.15.144:0/1692535542 wait complete. 2024-09-11T23:23:53.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.797+0000 7f49a5200640 1 Processor -- start 2024-09-11T23:23:53.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.797+0000 7f49a5200640 1 -- start start 2024-09-11T23:23:53.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.798+0000 7f49a5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49a00b3970 0x7f49a00b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:53.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.798+0000 7f49a5200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f49a00d39e0 0x7f49a00c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:53.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.798+0000 7f49a5200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49a015ea00 0x7f49a00b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:53.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.798+0000 7f49a5200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f49a00d1f00 con 0x7f49a00b3970 2024-09-11T23:23:53.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.798+0000 7f49a5200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f49a00d24b0 con 0x7f49a015ea00 2024-09-11T23:23:53.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.798+0000 7f49a5200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f49a00b3420 con 0x7f49a00d39e0 2024-09-11T23:23:53.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.799+0000 7f499de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49a00b3970 0x7f49a00b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:53.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.799+0000 7f499de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49a00b3970 0x7f49a00b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53322/0 (socket says 172.21.15.144:53322) 2024-09-11T23:23:53.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.799+0000 7f499de00640 1 -- 172.21.15.144:0/2159989013 learned_addr learned my addr 172.21.15.144:0/2159989013 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:53.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.799+0000 7f499d400640 1 --2- 172.21.15.144:0/2159989013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f49a00d39e0 0x7f49a00c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:53.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.799+0000 7f499e800640 1 --2- 172.21.15.144:0/2159989013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49a015ea00 0x7f49a00b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:53.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.799+0000 7f499de00640 1 -- 172.21.15.144:0/2159989013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f49a00d39e0 msgr2=0x7f49a00c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:53.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.799+0000 7f499de00640 1 --2- 172.21.15.144:0/2159989013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f49a00d39e0 0x7f49a00c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:53.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.799+0000 7f499de00640 1 -- 172.21.15.144:0/2159989013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49a015ea00 msgr2=0x7f49a00b82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:53.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.799+0000 7f499de00640 1 --2- 172.21.15.144:0/2159989013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49a015ea00 0x7f49a00b82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:53.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.799+0000 7f499de00640 1 -- 172.21.15.144:0/2159989013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a00ca130 con 0x7f49a00b3970 2024-09-11T23:23:53.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.799+0000 7f499e800640 1 --2- 172.21.15.144:0/2159989013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49a015ea00 0x7f49a00b82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:23:53.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.799+0000 7f499de00640 1 --2- 172.21.15.144:0/2159989013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49a00b3970 0x7f49a00b2cb0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f499000c7f0 tx=0x7f499000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:53.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.800+0000 7f4996000640 1 -- 172.21.15.144:0/2159989013 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990015070 con 0x7f49a00b3970 2024-09-11T23:23:53.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.800+0000 7f4996000640 1 -- 172.21.15.144:0/2159989013 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4990007820 con 0x7f49a00b3970 2024-09-11T23:23:53.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.800+0000 7f49a5200640 1 -- 172.21.15.144:0/2159989013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49a00ca410 con 0x7f49a00b3970 2024-09-11T23:23:53.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.800+0000 7f4996000640 1 -- 172.21.15.144:0/2159989013 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990007bd0 con 0x7f49a00b3970 2024-09-11T23:23:53.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.800+0000 7f49a5200640 1 -- 172.21.15.144:0/2159989013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49a00ca9d0 con 0x7f49a00b3970 2024-09-11T23:23:53.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.801+0000 7f49a5200640 1 -- 172.21.15.144:0/2159989013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49a00ba470 con 0x7f49a00b3970 2024-09-11T23:23:53.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.802+0000 7f4996000640 1 -- 172.21.15.144:0/2159989013 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f4990018070 con 0x7f49a00b3970 2024-09-11T23:23:53.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.802+0000 7f4996000640 1 --2- 172.21.15.144:0/2159989013 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f498006c250 0x7f498006e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:53.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.803+0000 7f4996000640 1 -- 172.21.15.144:0/2159989013 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5881+0+0 (secure 0 0 0) 0x7f499008b720 con 0x7f49a00b3970 2024-09-11T23:23:53.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.803+0000 7f499d400640 1 --2- 172.21.15.144:0/2159989013 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f498006c250 0x7f498006e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:53.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.803+0000 7f499d400640 1 --2- 172.21.15.144:0/2159989013 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f498006c250 0x7f498006e710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f49a0161650 tx=0x7f498c007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:53.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.807+0000 7f4996000640 1 -- 172.21.15.144:0/2159989013 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4990059370 con 0x7f49a00b3970 2024-09-11T23:23:53.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:53.984+0000 7f49a5200640 1 -- 172.21.15.144:0/2159989013 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f49a00b6e50 con 0x7f49a00b3970 2024-09-11T23:23:54.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:54.856+0000 7f4996000640 1 -- 172.21.15.144:0/2159989013 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v107) ==== 181+0+0 (secure 0 0 0) 0x7f499005d670 con 0x7f49a00b3970 2024-09-11T23:23:54.858 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:23:54.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:54.860+0000 7f49a5200640 1 -- 172.21.15.144:0/2159989013 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f498006c250 msgr2=0x7f498006e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:54.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:54.860+0000 7f49a5200640 1 --2- 172.21.15.144:0/2159989013 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f498006c250 0x7f498006e710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f49a0161650 tx=0x7f498c007e30 comp rx=0 tx=0).stop 2024-09-11T23:23:54.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:54.860+0000 7f49a5200640 1 -- 172.21.15.144:0/2159989013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49a00b3970 msgr2=0x7f49a00b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:54.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:54.860+0000 7f49a5200640 1 --2- 172.21.15.144:0/2159989013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49a00b3970 0x7f49a00b2cb0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f499000c7f0 tx=0x7f499000ccb0 comp rx=0 tx=0).stop 2024-09-11T23:23:54.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:54.860+0000 7f49a5200640 1 -- 172.21.15.144:0/2159989013 shutdown_connections 2024-09-11T23:23:54.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:54.860+0000 7f49a5200640 1 --2- 172.21.15.144:0/2159989013 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f498006c250 0x7f498006e710 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:54.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:54.860+0000 7f49a5200640 1 --2- 172.21.15.144:0/2159989013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49a015ea00 0x7f49a00b82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:54.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:54.860+0000 7f49a5200640 1 --2- 172.21.15.144:0/2159989013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f49a00d39e0 0x7f49a00c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:54.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:54.861+0000 7f49a5200640 1 --2- 172.21.15.144:0/2159989013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49a00b3970 0x7f49a00b2cb0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:54.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:54.861+0000 7f49a5200640 1 -- 172.21.15.144:0/2159989013 >> 172.21.15.144:0/2159989013 conn(0x7f49a00d11e0 msgr2=0x7f49a00d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:54.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:54.861+0000 7f49a5200640 1 -- 172.21.15.144:0/2159989013 shutdown_connections 2024-09-11T23:23:54.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:54.861+0000 7f49a5200640 1 -- 172.21.15.144:0/2159989013 wait complete. 2024-09-11T23:23:54.889 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:23:55.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.049+0000 7ff2e3600640 1 Processor -- start 2024-09-11T23:23:55.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.050+0000 7ff2e3600640 1 -- start start 2024-09-11T23:23:55.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.051+0000 7ff2e3600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff2dc0cf5d0 0x7ff2dc0cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:55.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.051+0000 7ff2e3600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2dc0b4240 con 0x7ff2dc145d90 2024-09-11T23:23:55.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.051+0000 7ff2e3600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2dc0b4520 con 0x7ff2dc06d4f0 2024-09-11T23:23:55.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.051+0000 7ff2e3600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff2dc06d080 con 0x7ff2dc0cf5d0 2024-09-11T23:23:55.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.051+0000 7ff2e0c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff2dc145d90 0x7ff2dc0ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37438/0 (socket says 172.21.15.144:37438) 2024-09-11T23:23:55.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.051+0000 7ff2e0c00640 1 -- 172.21.15.144:0/245466316 learned_addr learned my addr 172.21.15.144:0/245466316 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:55.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.051+0000 7ff2dbe00640 1 -- 172.21.15.144:0/245466316 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1943560394 0 0) 0x7ff2dc0b4240 con 0x7ff2dc145d90 2024-09-11T23:23:55.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.051+0000 7ff2dbe00640 1 -- 172.21.15.144:0/245466316 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2c0003520 con 0x7ff2dc145d90 2024-09-11T23:23:55.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.051+0000 7ff2d3e00640 1 --2- 172.21.15.144:0/245466316 >> v2:172.21.15.165:3300/0 conn(0x7ff2dc0cf5d0 0x7ff2dc0cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:55.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.052+0000 7ff2dbe00640 1 -- 172.21.15.144:0/245466316 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2451239148 0 0) 0x7ff2c0003520 con 0x7ff2dc145d90 2024-09-11T23:23:55.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.052+0000 7ff2dbe00640 1 -- 172.21.15.144:0/245466316 >> v2:172.21.15.165:3300/0 conn(0x7ff2dc0cf5d0 msgr2=0x7ff2dc0cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:55.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.052+0000 7ff2dbe00640 1 --2- 172.21.15.144:0/245466316 >> v2:172.21.15.165:3300/0 conn(0x7ff2dc0cf5d0 0x7ff2dc0cfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:55.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.052+0000 7ff2dbe00640 1 -- 172.21.15.144:0/245466316 >> v1:172.21.15.165:6789/0 conn(0x7ff2dc06d4f0 legacy=0x7ff2dc06d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:55.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.052+0000 7ff2dbe00640 1 -- 172.21.15.144:0/245466316 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2dc0b4800 con 0x7ff2dc145d90 2024-09-11T23:23:55.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.052+0000 7ff2dbe00640 1 -- 172.21.15.144:0/245466316 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7ff2cc001670 con 0x7ff2dc145d90 2024-09-11T23:23:55.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.052+0000 7ff2dbe00640 1 -- 172.21.15.144:0/245466316 >> v1:172.21.15.144:6789/0 conn(0x7ff2dc145d90 legacy=0x7ff2dc0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:55.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.052+0000 7ff2dbe00640 1 --2- 172.21.15.144:0/245466316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2c0003a00 0x7ff2c0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:55.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.052+0000 7ff2dbe00640 1 --2- 172.21.15.144:0/245466316 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2c0004800 0x7ff2c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:55.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.052+0000 7ff2dbe00640 1 --2- 172.21.15.144:0/245466316 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2c00051c0 0x7ff2c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:55.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.052+0000 7ff2dbe00640 1 -- 172.21.15.144:0/245466316 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c000c090 con 0x7ff2c0003a00 2024-09-11T23:23:55.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.052+0000 7ff2dbe00640 1 -- 172.21.15.144:0/245466316 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c000c240 con 0x7ff2c0004800 2024-09-11T23:23:55.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.052+0000 7ff2dbe00640 1 -- 172.21.15.144:0/245466316 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c000c440 con 0x7ff2c00051c0 2024-09-11T23:23:55.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.052+0000 7ff2e0c00640 1 --2- 172.21.15.144:0/245466316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2c0003a00 0x7ff2c0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:55.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.052+0000 7ff2d3e00640 1 --2- 172.21.15.144:0/245466316 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2c0004800 0x7ff2c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:55.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.052+0000 7ff2e1600640 1 --2- 172.21.15.144:0/245466316 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2c00051c0 0x7ff2c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:55.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.053+0000 7ff2e0c00640 1 -- 172.21.15.144:0/245466316 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2c00051c0 msgr2=0x7ff2c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:55.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.053+0000 7ff2e0c00640 1 --2- 172.21.15.144:0/245466316 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2c00051c0 0x7ff2c000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:55.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.053+0000 7ff2e0c00640 1 -- 172.21.15.144:0/245466316 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2c0004800 msgr2=0x7ff2c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:55.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.053+0000 7ff2e0c00640 1 --2- 172.21.15.144:0/245466316 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2c0004800 0x7ff2c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:55.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.053+0000 7ff2e0c00640 1 -- 172.21.15.144:0/245466316 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c0003520 con 0x7ff2c0003a00 2024-09-11T23:23:55.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.053+0000 7ff2e1600640 1 -- 172.21.15.144:0/245466316 reap_dead start 2024-09-11T23:23:55.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.054+0000 7ff2e0c00640 1 --2- 172.21.15.144:0/245466316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2c0003a00 0x7ff2c0003e20 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00c110 tx=0x7ff2c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13a757f65099c76 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:55.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.054+0000 7ff2dbe00640 1 -- 172.21.15.144:0/245466316 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc007c40 con 0x7ff2c0003a00 2024-09-11T23:23:55.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.054+0000 7ff2dbe00640 1 -- 172.21.15.144:0/245466316 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2cc005af0 con 0x7ff2c0003a00 2024-09-11T23:23:55.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.054+0000 7ff2dbe00640 1 -- 172.21.15.144:0/245466316 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc007070 con 0x7ff2c0003a00 2024-09-11T23:23:55.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.054+0000 7ff2e3600640 1 -- 172.21.15.144:0/245466316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2c0003a00 msgr2=0x7ff2c0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:55.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.054+0000 7ff2e3600640 1 --2- 172.21.15.144:0/245466316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2c0003a00 0x7ff2c0003e20 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00c110 tx=0x7ff2c0005830 comp rx=0 tx=0).stop 2024-09-11T23:23:55.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.054+0000 7ff2e3600640 1 -- 172.21.15.144:0/245466316 shutdown_connections 2024-09-11T23:23:55.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.054+0000 7ff2e3600640 1 --2- 172.21.15.144:0/245466316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2c0003a00 0x7ff2c0003e20 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:55.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.054+0000 7ff2e3600640 1 -- 172.21.15.144:0/245466316 >> 172.21.15.144:0/245466316 conn(0x7ff2dc06bba0 msgr2=0x7ff2dc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:55.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.055+0000 7ff2e3600640 1 -- 172.21.15.144:0/245466316 shutdown_connections 2024-09-11T23:23:55.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.055+0000 7ff2e3600640 1 -- 172.21.15.144:0/245466316 wait complete. 2024-09-11T23:23:55.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.056+0000 7ff2e3600640 1 Processor -- start 2024-09-11T23:23:55.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.056+0000 7ff2e3600640 1 -- start start 2024-09-11T23:23:55.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.057+0000 7ff2e3600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2c0003a00 0x7ff2dc1449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:55.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.057+0000 7ff2e3600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2dc0cacf0 0x7ff2dc0cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:55.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.057+0000 7ff2e3600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2dc071d60 0x7ff2dc0721c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.057+0000 7ff2e3600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc0b5790 con 0x7ff2c0003a00 2024-09-11T23:23:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.057+0000 7ff2e3600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc0b5610 con 0x7ff2dc0cacf0 2024-09-11T23:23:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.057+0000 7ff2e3600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff2dc146170 con 0x7ff2dc071d60 2024-09-11T23:23:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.057+0000 7ff2e0c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2c0003a00 0x7ff2dc1449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.058+0000 7ff2e0c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2c0003a00 0x7ff2dc1449a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56092/0 (socket says 172.21.15.144:56092) 2024-09-11T23:23:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.058+0000 7ff2e0c00640 1 -- 172.21.15.144:0/548845094 learned_addr learned my addr 172.21.15.144:0/548845094 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.058+0000 7ff2d3e00640 1 --2- 172.21.15.144:0/548845094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2dc0cacf0 0x7ff2dc0cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.058+0000 7ff2e0c00640 1 -- 172.21.15.144:0/548845094 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2dc071d60 msgr2=0x7ff2dc0721c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.058+0000 7ff2e1600640 1 --2- 172.21.15.144:0/548845094 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2dc071d60 0x7ff2dc0721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.058+0000 7ff2e0c00640 1 --2- 172.21.15.144:0/548845094 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2dc071d60 0x7ff2dc0721c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:55.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.058+0000 7ff2e0c00640 1 -- 172.21.15.144:0/548845094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2dc0cacf0 msgr2=0x7ff2dc0cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:55.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.058+0000 7ff2e0c00640 1 --2- 172.21.15.144:0/548845094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2dc0cacf0 0x7ff2dc0cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:55.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.058+0000 7ff2e0c00640 1 -- 172.21.15.144:0/548845094 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2dc144ee0 con 0x7ff2c0003a00 2024-09-11T23:23:55.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.058+0000 7ff2e1600640 1 --2- 172.21.15.144:0/548845094 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2dc071d60 0x7ff2dc0721c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:23:55.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.058+0000 7ff2d3e00640 1 --2- 172.21.15.144:0/548845094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2dc0cacf0 0x7ff2dc0cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:23:55.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.058+0000 7ff2e0c00640 1 --2- 172.21.15.144:0/548845094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2c0003a00 0x7ff2dc1449a0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc02ad60 tx=0x7ff2dc0b46f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:55.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.058+0000 7ff2d9600640 1 -- 172.21.15.144:0/548845094 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc001670 con 0x7ff2c0003a00 2024-09-11T23:23:55.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.059+0000 7ff2d9600640 1 -- 172.21.15.144:0/548845094 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2cc042070 con 0x7ff2c0003a00 2024-09-11T23:23:55.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.059+0000 7ff2d9600640 1 -- 172.21.15.144:0/548845094 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc007290 con 0x7ff2c0003a00 2024-09-11T23:23:55.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.059+0000 7ff2e3600640 1 -- 172.21.15.144:0/548845094 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2dc0ae280 con 0x7ff2c0003a00 2024-09-11T23:23:55.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.059+0000 7ff2e3600640 1 -- 172.21.15.144:0/548845094 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2dc0ae840 con 0x7ff2c0003a00 2024-09-11T23:23:55.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.060+0000 7ff2e3600640 1 -- 172.21.15.144:0/548845094 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2dc0cfa40 con 0x7ff2c0003a00 2024-09-11T23:23:55.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.061+0000 7ff2d9600640 1 -- 172.21.15.144:0/548845094 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7ff2cc007430 con 0x7ff2c0003a00 2024-09-11T23:23:55.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.061+0000 7ff2d9600640 1 --2- 172.21.15.144:0/548845094 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff2b806c250 0x7ff2b806e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:55.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.062+0000 7ff2d9600640 1 -- 172.21.15.144:0/548845094 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5415+0+0 (secure 0 0 0) 0x7ff2cc0ab5d0 con 0x7ff2c0003a00 2024-09-11T23:23:55.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.062+0000 7ff2d3e00640 1 --2- 172.21.15.144:0/548845094 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff2b806c250 0x7ff2b806e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:55.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.063+0000 7ff2d3e00640 1 --2- 172.21.15.144:0/548845094 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff2b806c250 0x7ff2b806e710 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0712f0 tx=0x7ff2c4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:55.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.066+0000 7ff2d9600640 1 -- 172.21.15.144:0/548845094 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff2cc079ae0 con 0x7ff2c0003a00 2024-09-11T23:23:55.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.242+0000 7ff2e3600640 1 -- 172.21.15.144:0/548845094 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff2dc15e970 con 0x7ff2c0003a00 2024-09-11T23:23:55.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.858+0000 7ff2d9600640 1 -- 172.21.15.144:0/548845094 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v108) ==== 169+0+0 (secure 0 0 0) 0x7ff2cc0793e0 con 0x7ff2c0003a00 2024-09-11T23:23:55.859 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-11T23:23:55.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.862+0000 7ff2e3600640 1 -- 172.21.15.144:0/548845094 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff2b806c250 msgr2=0x7ff2b806e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:55.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.862+0000 7ff2e3600640 1 --2- 172.21.15.144:0/548845094 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff2b806c250 0x7ff2b806e710 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0712f0 tx=0x7ff2c4008040 comp rx=0 tx=0).stop 2024-09-11T23:23:55.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.862+0000 7ff2e3600640 1 -- 172.21.15.144:0/548845094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2c0003a00 msgr2=0x7ff2dc1449a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:55.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.862+0000 7ff2e3600640 1 --2- 172.21.15.144:0/548845094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2c0003a00 0x7ff2dc1449a0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc02ad60 tx=0x7ff2dc0b46f0 comp rx=0 tx=0).stop 2024-09-11T23:23:55.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.863+0000 7ff2e3600640 1 -- 172.21.15.144:0/548845094 shutdown_connections 2024-09-11T23:23:55.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.863+0000 7ff2e3600640 1 --2- 172.21.15.144:0/548845094 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff2b806c250 0x7ff2b806e710 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:55.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.863+0000 7ff2e3600640 1 --2- 172.21.15.144:0/548845094 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff2dc071d60 0x7ff2dc0721c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:55.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.863+0000 7ff2e3600640 1 --2- 172.21.15.144:0/548845094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2dc0cacf0 0x7ff2dc0cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:55.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.863+0000 7ff2e3600640 1 --2- 172.21.15.144:0/548845094 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2c0003a00 0x7ff2dc1449a0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:55.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.863+0000 7ff2e3600640 1 -- 172.21.15.144:0/548845094 >> 172.21.15.144:0/548845094 conn(0x7ff2dc06bba0 msgr2=0x7ff2dc0cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:55.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.864+0000 7ff2e3600640 1 -- 172.21.15.144:0/548845094 shutdown_connections 2024-09-11T23:23:55.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:55.864+0000 7ff2e3600640 1 -- 172.21.15.144:0/548845094 wait complete. 2024-09-11T23:23:55.885 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:23:56.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.040+0000 7f4c7b200640 1 Processor -- start 2024-09-11T23:23:56.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.040+0000 7f4c7b200640 1 -- start start 2024-09-11T23:23:56.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.042+0000 7f4c7b200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4c7c06c2b0 0x7f4c7c15d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:56.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.042+0000 7f4c7b200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7c0ce430 con 0x7f4c7c159dd0 2024-09-11T23:23:56.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.042+0000 7f4c7b200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7c0cfd20 con 0x7f4c7c0cdfc0 2024-09-11T23:23:56.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.042+0000 7f4c7b200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4c7c0cd4e0 con 0x7f4c7c06c2b0 2024-09-11T23:23:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.042+0000 7f4c79e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4c7c159dd0 0x7f4c7c0cf260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37444/0 (socket says 172.21.15.144:37444) 2024-09-11T23:23:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.042+0000 7f4c79e00640 1 -- 172.21.15.144:0/80196187 learned_addr learned my addr 172.21.15.144:0/80196187 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.042+0000 7f4c7a800640 1 --2- 172.21.15.144:0/80196187 >> v2:172.21.15.165:3300/0 conn(0x7f4c7c06c2b0 0x7f4c7c15d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.042+0000 7f4c78a00640 1 -- 172.21.15.144:0/80196187 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2490807180 0 0) 0x7f4c7c0ce430 con 0x7f4c7c159dd0 2024-09-11T23:23:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.042+0000 7f4c78a00640 1 -- 172.21.15.144:0/80196187 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c60003520 con 0x7f4c7c159dd0 2024-09-11T23:23:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.042+0000 7f4c78a00640 1 -- 172.21.15.144:0/80196187 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2703076375 0 0) 0x7f4c7c0cfd20 con 0x7f4c7c0cdfc0 2024-09-11T23:23:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.043+0000 7f4c78a00640 1 -- 172.21.15.144:0/80196187 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c7c0ce430 con 0x7f4c7c0cdfc0 2024-09-11T23:23:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.043+0000 7f4c7a800640 1 -- 172.21.15.144:0/80196187 >> v1:172.21.15.165:6789/0 conn(0x7f4c7c0cdfc0 legacy=0x7f4c7c06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.043+0000 7f4c7a800640 1 -- 172.21.15.144:0/80196187 >> v1:172.21.15.144:6789/0 conn(0x7f4c7c159dd0 legacy=0x7f4c7c0cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:56.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.043+0000 7f4c7a800640 1 -- 172.21.15.144:0/80196187 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7c0cd7c0 con 0x7f4c7c06c2b0 2024-09-11T23:23:56.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.044+0000 7f4c7a800640 1 --2- 172.21.15.144:0/80196187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c7c06c2b0 0x7f4c7c15d9e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009d90 tx=0x7f4c7402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=432762d310f5d579 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.044+0000 7f4c78a00640 1 -- 172.21.15.144:0/80196187 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c74007740 con 0x7f4c7c06c2b0 2024-09-11T23:23:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.044+0000 7f4c78a00640 1 -- 172.21.15.144:0/80196187 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c740078e0 con 0x7f4c7c06c2b0 2024-09-11T23:23:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.044+0000 7f4c78a00640 1 -- 172.21.15.144:0/80196187 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c74007cb0 con 0x7f4c7c06c2b0 2024-09-11T23:23:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.044+0000 7f4c7b200640 1 -- 172.21.15.144:0/80196187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c7c06c2b0 msgr2=0x7f4c7c15d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.044+0000 7f4c7b200640 1 --2- 172.21.15.144:0/80196187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c7c06c2b0 0x7f4c7c15d9e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009d90 tx=0x7f4c7402a6f0 comp rx=0 tx=0).stop 2024-09-11T23:23:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.045+0000 7f4c7b200640 1 -- 172.21.15.144:0/80196187 shutdown_connections 2024-09-11T23:23:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.045+0000 7f4c7b200640 1 --2- 172.21.15.144:0/80196187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c7c06c2b0 0x7f4c7c15d9e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.045+0000 7f4c7b200640 1 -- 172.21.15.144:0/80196187 >> 172.21.15.144:0/80196187 conn(0x7f4c7c0d0300 msgr2=0x7f4c7c0d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.045+0000 7f4c7b200640 1 -- 172.21.15.144:0/80196187 shutdown_connections 2024-09-11T23:23:56.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.045+0000 7f4c7b200640 1 -- 172.21.15.144:0/80196187 wait complete. 2024-09-11T23:23:56.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.046+0000 7f4c7b200640 1 Processor -- start 2024-09-11T23:23:56.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.046+0000 7f4c7b200640 1 -- start start 2024-09-11T23:23:56.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.047+0000 7f4c7b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c7c06c2b0 0x7f4c7c14cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:56.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.047+0000 7f4c7b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c7c0cdfc0 0x7f4c7c1e4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.047+0000 7f4c7b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c7c159dd0 0x7f4c7c072ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.047+0000 7f4c7b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c15d6d0 con 0x7f4c7c0cdfc0 2024-09-11T23:23:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.047+0000 7f4c7b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c15a1b0 con 0x7f4c7c159dd0 2024-09-11T23:23:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.047+0000 7f4c7b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7c0cf970 con 0x7f4c7c06c2b0 2024-09-11T23:23:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.048+0000 7f4c79400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c7c0cdfc0 0x7f4c7c1e4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.048+0000 7f4c79400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c7c0cdfc0 0x7f4c7c1e4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56104/0 (socket says 172.21.15.144:56104) 2024-09-11T23:23:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.048+0000 7f4c79400640 1 -- 172.21.15.144:0/2064467981 learned_addr learned my addr 172.21.15.144:0/2064467981 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.048+0000 7f4c79e00640 1 --2- 172.21.15.144:0/2064467981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c7c06c2b0 0x7f4c7c14cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.048+0000 7f4c7a800640 1 --2- 172.21.15.144:0/2064467981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c7c159dd0 0x7f4c7c072ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.048+0000 7f4c79400640 1 -- 172.21.15.144:0/2064467981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c7c06c2b0 msgr2=0x7f4c7c14cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.048+0000 7f4c79400640 1 --2- 172.21.15.144:0/2064467981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c7c06c2b0 0x7f4c7c14cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:56.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.048+0000 7f4c79400640 1 -- 172.21.15.144:0/2064467981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c7c159dd0 msgr2=0x7f4c7c072ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:56.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.048+0000 7f4c79400640 1 --2- 172.21.15.144:0/2064467981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c7c159dd0 0x7f4c7c072ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:56.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.048+0000 7f4c79400640 1 -- 172.21.15.144:0/2064467981 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7c14d4e0 con 0x7f4c7c0cdfc0 2024-09-11T23:23:56.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.048+0000 7f4c79400640 1 --2- 172.21.15.144:0/2064467981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c7c0cdfc0 0x7f4c7c1e4800 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800c500 tx=0x7f4c6800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:56.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.049+0000 7f4c72000640 1 -- 172.21.15.144:0/2064467981 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c680052d0 con 0x7f4c7c0cdfc0 2024-09-11T23:23:56.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.049+0000 7f4c72000640 1 -- 172.21.15.144:0/2064467981 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c68005490 con 0x7f4c7c0cdfc0 2024-09-11T23:23:56.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.049+0000 7f4c72000640 1 -- 172.21.15.144:0/2064467981 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68012870 con 0x7f4c7c0cdfc0 2024-09-11T23:23:56.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.049+0000 7f4c7b200640 1 -- 172.21.15.144:0/2064467981 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7c1e5230 con 0x7f4c7c0cdfc0 2024-09-11T23:23:56.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.049+0000 7f4c7b200640 1 -- 172.21.15.144:0/2064467981 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c7c1e57f0 con 0x7f4c7c0cdfc0 2024-09-11T23:23:56.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.050+0000 7f4c7b200640 1 -- 172.21.15.144:0/2064467981 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c7c06bba0 con 0x7f4c7c0cdfc0 2024-09-11T23:23:56.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.051+0000 7f4c72000640 1 -- 172.21.15.144:0/2064467981 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f4c68012a10 con 0x7f4c7c0cdfc0 2024-09-11T23:23:56.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.051+0000 7f4c72000640 1 --2- 172.21.15.144:0/2064467981 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c5c06c220 0x7f4c5c06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:56.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.052+0000 7f4c72000640 1 -- 172.21.15.144:0/2064467981 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 4943+0+0 (secure 0 0 0) 0x7f4c6808b020 con 0x7f4c7c0cdfc0 2024-09-11T23:23:56.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.052+0000 7f4c79e00640 1 --2- 172.21.15.144:0/2064467981 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c5c06c220 0x7f4c5c06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:56.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.053+0000 7f4c79e00640 1 --2- 172.21.15.144:0/2064467981 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c5c06c220 0x7f4c5c06e6e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0011e0 tx=0x7f4c6c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:56.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.056+0000 7f4c72000640 1 -- 172.21.15.144:0/2064467981 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c7c14d4e0 con 0x7f4c7c0cdfc0 2024-09-11T23:23:56.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.234+0000 7f4c7b200640 1 -- 172.21.15.144:0/2064467981 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f4c7c073dc0 con 0x7f4c7c0cdfc0 2024-09-11T23:23:56.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.237+0000 7f4c72000640 1 -- 172.21.15.144:0/2064467981 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f4c680596c0 con 0x7f4c7c0cdfc0 2024-09-11T23:23:56.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.240+0000 7f4c7b200640 1 -- 172.21.15.144:0/2064467981 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c5c06c220 msgr2=0x7f4c5c06e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:56.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.240+0000 7f4c7b200640 1 --2- 172.21.15.144:0/2064467981 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c5c06c220 0x7f4c5c06e6e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0011e0 tx=0x7f4c6c009040 comp rx=0 tx=0).stop 2024-09-11T23:23:56.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.240+0000 7f4c7b200640 1 -- 172.21.15.144:0/2064467981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c7c0cdfc0 msgr2=0x7f4c7c1e4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:56.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.240+0000 7f4c7b200640 1 --2- 172.21.15.144:0/2064467981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c7c0cdfc0 0x7f4c7c1e4800 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800c500 tx=0x7f4c6800c9c0 comp rx=0 tx=0).stop 2024-09-11T23:23:56.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.240+0000 7f4c7b200640 1 -- 172.21.15.144:0/2064467981 shutdown_connections 2024-09-11T23:23:56.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.240+0000 7f4c7b200640 1 --2- 172.21.15.144:0/2064467981 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c5c06c220 0x7f4c5c06e6e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:56.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.240+0000 7f4c7b200640 1 --2- 172.21.15.144:0/2064467981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c7c159dd0 0x7f4c7c072ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:56.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.240+0000 7f4c7b200640 1 --2- 172.21.15.144:0/2064467981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c7c0cdfc0 0x7f4c7c1e4800 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.240+0000 7f4c7b200640 1 --2- 172.21.15.144:0/2064467981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c7c06c2b0 0x7f4c7c14cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.240+0000 7f4c7b200640 1 -- 172.21.15.144:0/2064467981 >> 172.21.15.144:0/2064467981 conn(0x7f4c7c0d0300 msgr2=0x7f4c7c0b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.240+0000 7f4c7b200640 1 -- 172.21.15.144:0/2064467981 shutdown_connections 2024-09-11T23:23:56.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.240+0000 7f4c7b200640 1 -- 172.21.15.144:0/2064467981 wait complete. 2024-09-11T23:23:56.256 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity' 2024-09-11T23:23:56.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.409+0000 7f37f1000640 1 Processor -- start 2024-09-11T23:23:56.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.409+0000 7f37f1000640 1 -- start start 2024-09-11T23:23:56.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.411+0000 7f37f1000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f37ec15c180 0x7f37ec0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:56.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.411+0000 7f37f1000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37ec0ce230 0x7f37ec0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:56.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.411+0000 7f37f1000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37ec0ce740 con 0x7f37ec0cf5b0 2024-09-11T23:23:56.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.411+0000 7f37f1000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f37ec072640 con 0x7f37ec15c180 2024-09-11T23:23:56.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.411+0000 7f37f1000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f37ec072920 con 0x7f37ec0ce230 2024-09-11T23:23:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.411+0000 7f37e9e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f37ec15c180 0x7f37ec0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.411+0000 7f37e9e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f37ec15c180 0x7f37ec0cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:33236/0 (socket says 172.21.15.144:33236) 2024-09-11T23:23:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.411+0000 7f37e9e00640 1 -- 172.21.15.144:0/1358204526 learned_addr learned my addr 172.21.15.144:0/1358204526 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.411+0000 7f37e9400640 1 --2- 172.21.15.144:0/1358204526 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37ec0ce230 0x7f37ec0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.412+0000 7f37e9e00640 1 -- 172.21.15.144:0/1358204526 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37ec0ce230 msgr2=0x7f37ec0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.412+0000 7f37e9e00640 1 --2- 172.21.15.144:0/1358204526 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37ec0ce230 0x7f37ec0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.412+0000 7f37e9e00640 1 -- 172.21.15.144:0/1358204526 >> v1:172.21.15.165:6789/0 conn(0x7f37ec0cf5b0 legacy=0x7f37ec073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:56.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.412+0000 7f37e9e00640 1 -- 172.21.15.144:0/1358204526 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37ec072c00 con 0x7f37ec15c180 2024-09-11T23:23:56.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.413+0000 7f37e9e00640 1 --2- 172.21.15.144:0/1358204526 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37ec15c180 0x7f37ec0cdcf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f37dc009870 tx=0x7f37dc02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6da51d9f301f60 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:56.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.413+0000 7f37e8a00640 1 -- 172.21.15.144:0/1358204526 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc037070 con 0x7f37ec15c180 2024-09-11T23:23:56.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.413+0000 7f37e8a00640 1 -- 172.21.15.144:0/1358204526 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37dc032440 con 0x7f37ec15c180 2024-09-11T23:23:56.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.413+0000 7f37e8a00640 1 -- 172.21.15.144:0/1358204526 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc032810 con 0x7f37ec15c180 2024-09-11T23:23:56.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.414+0000 7f37f1000640 1 -- 172.21.15.144:0/1358204526 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37ec15c180 msgr2=0x7f37ec0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:56.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.414+0000 7f37f1000640 1 --2- 172.21.15.144:0/1358204526 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37ec15c180 0x7f37ec0cdcf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f37dc009870 tx=0x7f37dc02a1e0 comp rx=0 tx=0).stop 2024-09-11T23:23:56.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.414+0000 7f37f1000640 1 -- 172.21.15.144:0/1358204526 shutdown_connections 2024-09-11T23:23:56.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.414+0000 7f37f1000640 1 --2- 172.21.15.144:0/1358204526 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37ec0ce230 0x7f37ec0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:56.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.414+0000 7f37f1000640 1 --2- 172.21.15.144:0/1358204526 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37ec15c180 0x7f37ec0cdcf0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:56.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.414+0000 7f37f1000640 1 -- 172.21.15.144:0/1358204526 >> 172.21.15.144:0/1358204526 conn(0x7f37ec062cc0 msgr2=0x7f37ec06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:56.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.414+0000 7f37f1000640 1 -- 172.21.15.144:0/1358204526 shutdown_connections 2024-09-11T23:23:56.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.414+0000 7f37f1000640 1 -- 172.21.15.144:0/1358204526 wait complete. 2024-09-11T23:23:56.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.415+0000 7f37f1000640 1 Processor -- start 2024-09-11T23:23:56.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.416+0000 7f37f1000640 1 -- start start 2024-09-11T23:23:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.416+0000 7f37f1000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37ec0ce230 0x7f37ec152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.416+0000 7f37f1000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37ec0cf5b0 0x7f37ec0ab960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.417+0000 7f37f1000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37ec15c180 0x7f37ec157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.417+0000 7f37f1000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec15c560 con 0x7f37ec0ce230 2024-09-11T23:23:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.417+0000 7f37f1000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec0722f0 con 0x7f37ec0cf5b0 2024-09-11T23:23:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.417+0000 7f37f1000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f37ec15c6e0 con 0x7f37ec15c180 2024-09-11T23:23:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.417+0000 7f37e9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37ec0ce230 0x7f37ec152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.417+0000 7f37e9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37ec0ce230 0x7f37ec152ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56120/0 (socket says 172.21.15.144:56120) 2024-09-11T23:23:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.417+0000 7f37e9e00640 1 -- 172.21.15.144:0/2467366940 learned_addr learned my addr 172.21.15.144:0/2467366940 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.417+0000 7f37e9400640 1 --2- 172.21.15.144:0/2467366940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37ec0cf5b0 0x7f37ec0ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:56.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.417+0000 7f37ea800640 1 --2- 172.21.15.144:0/2467366940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37ec15c180 0x7f37ec157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.417+0000 7f37e9e00640 1 -- 172.21.15.144:0/2467366940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37ec15c180 msgr2=0x7f37ec157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.417+0000 7f37e9e00640 1 --2- 172.21.15.144:0/2467366940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37ec15c180 0x7f37ec157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.417+0000 7f37e9e00640 1 -- 172.21.15.144:0/2467366940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37ec0cf5b0 msgr2=0x7f37ec0ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.417+0000 7f37e9e00640 1 --2- 172.21.15.144:0/2467366940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37ec0cf5b0 0x7f37ec0ab960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.417+0000 7f37e9e00640 1 -- 172.21.15.144:0/2467366940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37ec0ae4d0 con 0x7f37ec0ce230 2024-09-11T23:23:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.418+0000 7f37e9e00640 1 --2- 172.21.15.144:0/2467366940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37ec0ce230 0x7f37ec152ca0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f37dc009990 tx=0x7f37dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.418+0000 7f37e2000640 1 -- 172.21.15.144:0/2467366940 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc037040 con 0x7f37ec0ce230 2024-09-11T23:23:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.418+0000 7f37e2000640 1 -- 172.21.15.144:0/2467366940 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37dc042070 con 0x7f37ec0ce230 2024-09-11T23:23:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.418+0000 7f37e2000640 1 -- 172.21.15.144:0/2467366940 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc030940 con 0x7f37ec0ce230 2024-09-11T23:23:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.418+0000 7f37f1000640 1 -- 172.21.15.144:0/2467366940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37ec0ae7b0 con 0x7f37ec0ce230 2024-09-11T23:23:56.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.418+0000 7f37f1000640 1 -- 172.21.15.144:0/2467366940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37ec0aed70 con 0x7f37ec0ce230 2024-09-11T23:23:56.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.419+0000 7f37f1000640 1 -- 172.21.15.144:0/2467366940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37ec0aefb0 con 0x7f37ec0ce230 2024-09-11T23:23:56.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.420+0000 7f37e2000640 1 -- 172.21.15.144:0/2467366940 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f37dc030ae0 con 0x7f37ec0ce230 2024-09-11T23:23:56.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.421+0000 7f37e2000640 1 --2- 172.21.15.144:0/2467366940 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f37cc06c220 0x7f37cc06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:56.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.421+0000 7f37e2000640 1 -- 172.21.15.144:0/2467366940 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 4943+0+0 (secure 0 0 0) 0x7f37dc0ab970 con 0x7f37ec0ce230 2024-09-11T23:23:56.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.422+0000 7f37e9400640 1 --2- 172.21.15.144:0/2467366940 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f37cc06c220 0x7f37cc06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:56.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.422+0000 7f37e9400640 1 --2- 172.21.15.144:0/2467366940 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f37cc06c220 0x7f37cc06e6e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f37ec0d1240 tx=0x7f37d8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:56.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.426+0000 7f37e2000640 1 -- 172.21.15.144:0/2467366940 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f37ec0aefb0 con 0x7f37ec0ce230 2024-09-11T23:23:56.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.671+0000 7f37f1000640 1 -- 172.21.15.144:0/2467366940 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]} v 0) -- 0x7f37ec0cf070 con 0x7f37ec0ce230 2024-09-11T23:23:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.873+0000 7f37e2000640 1 -- 172.21.15.144:0/2467366940 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]}]=0 v327) ==== 149+0+0 (secure 0 0 0) 0x7f37dc07a1e0 con 0x7f37ec0ce230 2024-09-11T23:23:56.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.876+0000 7f37f1000640 1 -- 172.21.15.144:0/2467366940 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f37cc06c220 msgr2=0x7f37cc06e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:56.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.876+0000 7f37f1000640 1 --2- 172.21.15.144:0/2467366940 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f37cc06c220 0x7f37cc06e6e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f37ec0d1240 tx=0x7f37d8008040 comp rx=0 tx=0).stop 2024-09-11T23:23:56.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.876+0000 7f37f1000640 1 -- 172.21.15.144:0/2467366940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37ec0ce230 msgr2=0x7f37ec152ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:56.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.876+0000 7f37f1000640 1 --2- 172.21.15.144:0/2467366940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37ec0ce230 0x7f37ec152ca0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f37dc009990 tx=0x7f37dc0046c0 comp rx=0 tx=0).stop 2024-09-11T23:23:56.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.876+0000 7f37f1000640 1 -- 172.21.15.144:0/2467366940 shutdown_connections 2024-09-11T23:23:56.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.876+0000 7f37f1000640 1 --2- 172.21.15.144:0/2467366940 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f37cc06c220 0x7f37cc06e6e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:56.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.876+0000 7f37f1000640 1 --2- 172.21.15.144:0/2467366940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f37ec15c180 0x7f37ec157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:56.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.876+0000 7f37f1000640 1 --2- 172.21.15.144:0/2467366940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37ec0cf5b0 0x7f37ec0ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:56.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.876+0000 7f37f1000640 1 --2- 172.21.15.144:0/2467366940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37ec0ce230 0x7f37ec152ca0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:56.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.876+0000 7f37f1000640 1 -- 172.21.15.144:0/2467366940 >> 172.21.15.144:0/2467366940 conn(0x7f37ec062cc0 msgr2=0x7f37ec0b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:56.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.876+0000 7f37f1000640 1 -- 172.21.15.144:0/2467366940 shutdown_connections 2024-09-11T23:23:56.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:56.876+0000 7f37f1000640 1 -- 172.21.15.144:0/2467366940 wait complete. 2024-09-11T23:23:56.892 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- theme continues... ... ok 2024-09-11T23:23:56.893 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_no_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- theme continues... 2024-09-11T23:23:56.893 INFO:tasks.cephfs_test_runner:test_subvolume_no_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) 2024-09-11T23:23:56.893 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:23:57.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.045+0000 7f6bd6000640 1 Processor -- start 2024-09-11T23:23:57.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.045+0000 7f6bd6000640 1 -- start start 2024-09-11T23:23:57.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.046+0000 7f6bd6000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00cf070 0x7f6bd00cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:57.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.047+0000 7f6bd6000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bd00ce740 con 0x7f6bd0073120 2024-09-11T23:23:57.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.047+0000 7f6bd6000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bd0072640 con 0x7f6bd015c180 2024-09-11T23:23:57.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.047+0000 7f6bd6000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd0072920 con 0x7f6bd00cf070 2024-09-11T23:23:57.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.047+0000 7f6bcfe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6bd0073120 0x7f6bd006bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37446/0 (socket says 172.21.15.144:37446) 2024-09-11T23:23:57.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.047+0000 7f6bcfe00640 1 -- 172.21.15.144:0/4269073938 learned_addr learned my addr 172.21.15.144:0/4269073938 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:57.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.047+0000 7f6bc6a00640 1 --2- 172.21.15.144:0/4269073938 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00cf070 0x7f6bd00cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:57.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.047+0000 7f6bcea00640 1 -- 172.21.15.144:0/4269073938 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1778140256 0 0) 0x7f6bd00ce740 con 0x7f6bd0073120 2024-09-11T23:23:57.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.047+0000 7f6bcea00640 1 -- 172.21.15.144:0/4269073938 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bb4003520 con 0x7f6bd0073120 2024-09-11T23:23:57.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.047+0000 7f6bcea00640 1 -- 172.21.15.144:0/4269073938 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1793410728 0 0) 0x7f6bd0072640 con 0x7f6bd015c180 2024-09-11T23:23:57.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.047+0000 7f6bcea00640 1 -- 172.21.15.144:0/4269073938 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bd00ce740 con 0x7f6bd015c180 2024-09-11T23:23:57.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.048+0000 7f6bc6a00640 1 -- 172.21.15.144:0/4269073938 >> v1:172.21.15.165:6789/0 conn(0x7f6bd015c180 legacy=0x7f6bd00cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:57.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.048+0000 7f6bc6a00640 1 -- 172.21.15.144:0/4269073938 >> v1:172.21.15.144:6789/0 conn(0x7f6bd0073120 legacy=0x7f6bd006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:57.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.048+0000 7f6bcea00640 1 -- 172.21.15.144:0/4269073938 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1315247749 0 0) 0x7f6bb4003520 con 0x7f6bd0073120 2024-09-11T23:23:57.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.048+0000 7f6bc6a00640 1 -- 172.21.15.144:0/4269073938 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd0072c00 con 0x7f6bd00cf070 2024-09-11T23:23:57.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.049+0000 7f6bc6a00640 1 --2- 172.21.15.144:0/4269073938 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00cf070 0x7f6bd00cf4b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80097d0 tx=0x7f6bb802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3bf7c0cd1d7fcdc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:57.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.049+0000 7f6bcea00640 1 -- 172.21.15.144:0/4269073938 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8037070 con 0x7f6bd00cf070 2024-09-11T23:23:57.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.049+0000 7f6bcea00640 1 -- 172.21.15.144:0/4269073938 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb802ab90 con 0x7f6bd00cf070 2024-09-11T23:23:57.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.049+0000 7f6bcea00640 1 -- 172.21.15.144:0/4269073938 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8001a10 con 0x7f6bd00cf070 2024-09-11T23:23:57.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.049+0000 7f6bd6000640 1 -- 172.21.15.144:0/4269073938 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00cf070 msgr2=0x7f6bd00cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:57.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.049+0000 7f6bd6000640 1 --2- 172.21.15.144:0/4269073938 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00cf070 0x7f6bd00cf4b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80097d0 tx=0x7f6bb802a100 comp rx=0 tx=0).stop 2024-09-11T23:23:57.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.050+0000 7f6bd6000640 1 -- 172.21.15.144:0/4269073938 shutdown_connections 2024-09-11T23:23:57.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.050+0000 7f6bd6000640 1 --2- 172.21.15.144:0/4269073938 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00cf070 0x7f6bd00cf4b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.050+0000 7f6bd6000640 1 -- 172.21.15.144:0/4269073938 >> 172.21.15.144:0/4269073938 conn(0x7f6bd0062cc0 msgr2=0x7f6bd006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:57.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.050+0000 7f6bd6000640 1 -- 172.21.15.144:0/4269073938 shutdown_connections 2024-09-11T23:23:57.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.050+0000 7f6bd6000640 1 -- 172.21.15.144:0/4269073938 wait complete. 2024-09-11T23:23:57.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.051+0000 7f6bd6000640 1 Processor -- start 2024-09-11T23:23:57.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.051+0000 7f6bd6000640 1 -- start start 2024-09-11T23:23:57.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.052+0000 7f6bd6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bd0073120 0x7f6bd015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:57.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.052+0000 7f6bd6000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00cf070 0x7f6bd01527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:57.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.052+0000 7f6bd6000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bd015c180 0x7f6bd0152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:57.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.052+0000 7f6bd6000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd00722f0 con 0x7f6bd0073120 2024-09-11T23:23:57.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.052+0000 7f6bd6000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd00ced00 con 0x7f6bd015c180 2024-09-11T23:23:57.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.052+0000 7f6bd6000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd015c560 con 0x7f6bd00cf070 2024-09-11T23:23:57.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.052+0000 7f6bcf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bd0073120 0x7f6bd015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:57.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.053+0000 7f6bcf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bd0073120 0x7f6bd015d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56128/0 (socket says 172.21.15.144:56128) 2024-09-11T23:23:57.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.053+0000 7f6bcf400640 1 -- 172.21.15.144:0/2330558269 learned_addr learned my addr 172.21.15.144:0/2330558269 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:57.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.053+0000 7f6bcfe00640 1 --2- 172.21.15.144:0/2330558269 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bd015c180 0x7f6bd0152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:57.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.053+0000 7f6bc6a00640 1 --2- 172.21.15.144:0/2330558269 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00cf070 0x7f6bd01527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:57.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.053+0000 7f6bcf400640 1 -- 172.21.15.144:0/2330558269 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00cf070 msgr2=0x7f6bd01527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:57.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.053+0000 7f6bcf400640 1 --2- 172.21.15.144:0/2330558269 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00cf070 0x7f6bd01527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.053+0000 7f6bcf400640 1 -- 172.21.15.144:0/2330558269 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bd015c180 msgr2=0x7f6bd0152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:57.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.053+0000 7f6bcf400640 1 --2- 172.21.15.144:0/2330558269 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bd015c180 0x7f6bd0152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.053+0000 7f6bcf400640 1 -- 172.21.15.144:0/2330558269 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd015d8f0 con 0x7f6bd0073120 2024-09-11T23:23:57.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.053+0000 7f6bcf400640 1 --2- 172.21.15.144:0/2330558269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bd0073120 0x7f6bd015d3b0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000c490 tx=0x7f6bc000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:57.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.053+0000 7f6bc7e00640 1 -- 172.21.15.144:0/2330558269 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00052d0 con 0x7f6bd0073120 2024-09-11T23:23:57.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.053+0000 7f6bc7e00640 1 -- 172.21.15.144:0/2330558269 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc0005470 con 0x7f6bd0073120 2024-09-11T23:23:57.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.053+0000 7f6bc7e00640 1 -- 172.21.15.144:0/2330558269 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0012850 con 0x7f6bd0073120 2024-09-11T23:23:57.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.053+0000 7f6bd6000640 1 -- 172.21.15.144:0/2330558269 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bd015e130 con 0x7f6bd0073120 2024-09-11T23:23:57.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.054+0000 7f6bd6000640 1 -- 172.21.15.144:0/2330558269 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bd015de50 con 0x7f6bd0073120 2024-09-11T23:23:57.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.055+0000 7f6bd6000640 1 -- 172.21.15.144:0/2330558269 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bd00ccb90 con 0x7f6bd0073120 2024-09-11T23:23:57.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.056+0000 7f6bc7e00640 1 -- 172.21.15.144:0/2330558269 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f6bc00129f0 con 0x7f6bd0073120 2024-09-11T23:23:57.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.057+0000 7f6bc7e00640 1 --2- 172.21.15.144:0/2330558269 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6bac06c220 0x7f6bac06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:57.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.057+0000 7f6bc7e00640 1 -- 172.21.15.144:0/2330558269 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 4943+0+0 (secure 0 0 0) 0x7f6bc008ae00 con 0x7f6bd0073120 2024-09-11T23:23:57.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.057+0000 7f6bc6a00640 1 --2- 172.21.15.144:0/2330558269 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6bac06c220 0x7f6bac06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.058+0000 7f6bc6a00640 1 --2- 172.21.15.144:0/2330558269 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6bac06c220 0x7f6bac06e6e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8034000 tx=0x7f6bb802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:57.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.061+0000 7f6bc7e00640 1 -- 172.21.15.144:0/2330558269 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6bd015d8f0 con 0x7f6bd0073120 2024-09-11T23:23:57.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.238+0000 7f6bd6000640 1 -- 172.21.15.144:0/2330558269 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6bd0157900 con 0x7f6bd0073120 2024-09-11T23:23:57.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.240+0000 7f6bc7e00640 1 -- 172.21.15.144:0/2330558269 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) ==== 74+0+13060 (secure 0 0 0) 0x7f6bc0058e80 con 0x7f6bd0073120 2024-09-11T23:23:57.241 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:57.241 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":108,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:23:55.858462+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6835/419371779":"2024-09-12T23:23:52.602254+0000","172.21.15.144:6834/419371779":"2024-09-12T23:23:52.602254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:23:57.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.242+0000 7f6bd6000640 1 -- 172.21.15.144:0/2330558269 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6bac06c220 msgr2=0x7f6bac06e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:57.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.242+0000 7f6bd6000640 1 --2- 172.21.15.144:0/2330558269 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6bac06c220 0x7f6bac06e6e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8034000 tx=0x7f6bb802e000 comp rx=0 tx=0).stop 2024-09-11T23:23:57.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.242+0000 7f6bd6000640 1 -- 172.21.15.144:0/2330558269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bd0073120 msgr2=0x7f6bd015d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:57.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.242+0000 7f6bd6000640 1 --2- 172.21.15.144:0/2330558269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bd0073120 0x7f6bd015d3b0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000c490 tx=0x7f6bc000c950 comp rx=0 tx=0).stop 2024-09-11T23:23:57.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.242+0000 7f6bd6000640 1 -- 172.21.15.144:0/2330558269 shutdown_connections 2024-09-11T23:23:57.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.242+0000 7f6bd6000640 1 --2- 172.21.15.144:0/2330558269 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6bac06c220 0x7f6bac06e6e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.242+0000 7f6bd6000640 1 --2- 172.21.15.144:0/2330558269 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bd015c180 0x7f6bd0152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.242+0000 7f6bd6000640 1 --2- 172.21.15.144:0/2330558269 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6bd00cf070 0x7f6bd01527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.242+0000 7f6bd6000640 1 --2- 172.21.15.144:0/2330558269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6bd0073120 0x7f6bd015d3b0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.242+0000 7f6bd6000640 1 -- 172.21.15.144:0/2330558269 >> 172.21.15.144:0/2330558269 conn(0x7f6bd0062cc0 msgr2=0x7f6bd01586b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:57.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.242+0000 7f6bd6000640 1 -- 172.21.15.144:0/2330558269 shutdown_connections 2024-09-11T23:23:57.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.242+0000 7f6bd6000640 1 -- 172.21.15.144:0/2330558269 wait complete. 2024-09-11T23:23:57.259 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:17:47.307937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:23:57.260 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:23:57.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.418+0000 7f468f200640 1 Processor -- start 2024-09-11T23:23:57.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.418+0000 7f468f200640 1 -- start start 2024-09-11T23:23:57.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.419+0000 7f468f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f468806f130 0x7f46880b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:57.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.419+0000 7f468f200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f468815c370 0x7f46880ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:57.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.419+0000 7f468f200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f468815c820 con 0x7f4688158e50 2024-09-11T23:23:57.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.419+0000 7f468f200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f46880b43f0 con 0x7f468815c370 2024-09-11T23:23:57.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.419+0000 7f468f200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f46880b3630 con 0x7f468806f130 2024-09-11T23:23:57.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.420+0000 7f468d200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f468815c370 0x7f46880ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:57.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.420+0000 7f468d200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f468815c370 0x7f46880ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56144/0 (socket says 172.21.15.144:56144) 2024-09-11T23:23:57.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.420+0000 7f468d200640 1 -- 172.21.15.144:0/259802021 learned_addr learned my addr 172.21.15.144:0/259802021 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:57.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.420+0000 7f4687400640 1 --2- 172.21.15.144:0/259802021 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f468806f130 0x7f46880b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:57.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.420+0000 7f468d200640 1 -- 172.21.15.144:0/259802021 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f468806f130 msgr2=0x7f46880b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:57.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.420+0000 7f468d200640 1 --2- 172.21.15.144:0/259802021 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f468806f130 0x7f46880b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.420+0000 7f468d200640 1 -- 172.21.15.144:0/259802021 >> v1:172.21.15.165:6789/0 conn(0x7f4688158e50 legacy=0x7f468806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:57.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.420+0000 7f468d200640 1 -- 172.21.15.144:0/259802021 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46880b3910 con 0x7f468815c370 2024-09-11T23:23:57.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.421+0000 7f468d200640 1 --2- 172.21.15.144:0/259802021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f468815c370 0x7f46880ce200 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f4680009e50 tx=0x7f468002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2037f7e7f788ff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:57.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.421+0000 7f4686a00640 1 -- 172.21.15.144:0/259802021 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4680036070 con 0x7f468815c370 2024-09-11T23:23:57.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.421+0000 7f4686a00640 1 -- 172.21.15.144:0/259802021 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4680031600 con 0x7f468815c370 2024-09-11T23:23:57.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.421+0000 7f4686a00640 1 -- 172.21.15.144:0/259802021 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46800319d0 con 0x7f468815c370 2024-09-11T23:23:57.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.422+0000 7f468f200640 1 -- 172.21.15.144:0/259802021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f468815c370 msgr2=0x7f46880ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:57.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.422+0000 7f468f200640 1 --2- 172.21.15.144:0/259802021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f468815c370 0x7f46880ce200 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f4680009e50 tx=0x7f468002a710 comp rx=0 tx=0).stop 2024-09-11T23:23:57.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.422+0000 7f468f200640 1 -- 172.21.15.144:0/259802021 shutdown_connections 2024-09-11T23:23:57.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.422+0000 7f468f200640 1 --2- 172.21.15.144:0/259802021 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f468815c370 0x7f46880ce200 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.422+0000 7f468f200640 1 --2- 172.21.15.144:0/259802021 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f468806f130 0x7f46880b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.422+0000 7f468f200640 1 -- 172.21.15.144:0/259802021 >> 172.21.15.144:0/259802021 conn(0x7f468806bba0 msgr2=0x7f468806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:57.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.422+0000 7f468f200640 1 -- 172.21.15.144:0/259802021 shutdown_connections 2024-09-11T23:23:57.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.422+0000 7f468f200640 1 -- 172.21.15.144:0/259802021 wait complete. 2024-09-11T23:23:57.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.424+0000 7f468f200640 1 Processor -- start 2024-09-11T23:23:57.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.424+0000 7f468f200640 1 -- start start 2024-09-11T23:23:57.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.425+0000 7f468f200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f468806f130 0x7f468814f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:57.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.425+0000 7f468f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4688158e50 0x7f468815ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:57.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.425+0000 7f468f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f468815c370 0x7f468815cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:57.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.425+0000 7f468f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4688159230 con 0x7f468815c370 2024-09-11T23:23:57.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.425+0000 7f468f200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f46880b3ed0 con 0x7f468806f130 2024-09-11T23:23:57.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.425+0000 7f468f200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f46880ce740 con 0x7f4688158e50 2024-09-11T23:23:57.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.425+0000 7f468d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f468815c370 0x7f468815cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:57.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.425+0000 7f468d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f468815c370 0x7f468815cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56150/0 (socket says 172.21.15.144:56150) 2024-09-11T23:23:57.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.425+0000 7f468d200640 1 -- 172.21.15.144:0/2590190156 learned_addr learned my addr 172.21.15.144:0/2590190156 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:57.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.425+0000 7f468d200640 1 -- 172.21.15.144:0/2590190156 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4688158e50 msgr2=0x7f468815ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:57.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.425+0000 7f4687e00640 1 --2- 172.21.15.144:0/2590190156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f468806f130 0x7f468814f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:57.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.425+0000 7f468d200640 1 --2- 172.21.15.144:0/2590190156 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4688158e50 0x7f468815ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.425+0000 7f468d200640 1 -- 172.21.15.144:0/2590190156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f468806f130 msgr2=0x7f468814f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:57.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.425+0000 7f468d200640 1 --2- 172.21.15.144:0/2590190156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f468806f130 0x7f468814f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.425+0000 7f468d200640 1 -- 172.21.15.144:0/2590190156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4688159ab0 con 0x7f468815c370 2024-09-11T23:23:57.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.425+0000 7f4687e00640 1 --2- 172.21.15.144:0/2590190156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f468806f130 0x7f468814f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:23:57.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.426+0000 7f468d200640 1 --2- 172.21.15.144:0/2590190156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f468815c370 0x7f468815cf40 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f4680009e50 tx=0x7f4680004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:57.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.426+0000 7f467fe00640 1 -- 172.21.15.144:0/2590190156 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4680036050 con 0x7f468815c370 2024-09-11T23:23:57.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.426+0000 7f467fe00640 1 -- 172.21.15.144:0/2590190156 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4680042070 con 0x7f468815c370 2024-09-11T23:23:57.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.426+0000 7f468f200640 1 -- 172.21.15.144:0/2590190156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46881547c0 con 0x7f468815c370 2024-09-11T23:23:57.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.426+0000 7f467fe00640 1 -- 172.21.15.144:0/2590190156 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4680009510 con 0x7f468815c370 2024-09-11T23:23:57.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.426+0000 7f468f200640 1 -- 172.21.15.144:0/2590190156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f468815a030 con 0x7f468815c370 2024-09-11T23:23:57.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.427+0000 7f468f200640 1 -- 172.21.15.144:0/2590190156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46880ce200 con 0x7f468815c370 2024-09-11T23:23:57.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.428+0000 7f467fe00640 1 -- 172.21.15.144:0/2590190156 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f4680007bf0 con 0x7f468815c370 2024-09-11T23:23:57.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.429+0000 7f467fe00640 1 --2- 172.21.15.144:0/2590190156 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f466806c220 0x7f466806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:57.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.429+0000 7f467fe00640 1 -- 172.21.15.144:0/2590190156 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 4943+0+0 (secure 0 0 0) 0x7f46800ac130 con 0x7f468815c370 2024-09-11T23:23:57.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.429+0000 7f4687e00640 1 --2- 172.21.15.144:0/2590190156 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f466806c220 0x7f466806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:57.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.430+0000 7f4687e00640 1 --2- 172.21.15.144:0/2590190156 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f466806c220 0x7f466806e6e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4678001680 tx=0x7f4678009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:57.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.433+0000 7f467fe00640 1 -- 172.21.15.144:0/2590190156 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f468007a740 con 0x7f468815c370 2024-09-11T23:23:57.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.607+0000 7f468f200640 1 -- 172.21.15.144:0/2590190156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4688158060 con 0x7f468815c370 2024-09-11T23:23:57.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.607+0000 7f467fe00640 1 -- 172.21.15.144:0/2590190156 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v108) ==== 93+0+10 (secure 0 0 0) 0x7f468007a040 con 0x7f468815c370 2024-09-11T23:23:57.608 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-11T23:23:57.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.610+0000 7f468f200640 1 -- 172.21.15.144:0/2590190156 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f466806c220 msgr2=0x7f466806e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:57.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.610+0000 7f468f200640 1 --2- 172.21.15.144:0/2590190156 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f466806c220 0x7f466806e6e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4678001680 tx=0x7f4678009040 comp rx=0 tx=0).stop 2024-09-11T23:23:57.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.610+0000 7f468f200640 1 -- 172.21.15.144:0/2590190156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f468815c370 msgr2=0x7f468815cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:57.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.610+0000 7f468f200640 1 --2- 172.21.15.144:0/2590190156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f468815c370 0x7f468815cf40 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f4680009e50 tx=0x7f4680004a40 comp rx=0 tx=0).stop 2024-09-11T23:23:57.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.610+0000 7f468f200640 1 -- 172.21.15.144:0/2590190156 shutdown_connections 2024-09-11T23:23:57.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.610+0000 7f468f200640 1 --2- 172.21.15.144:0/2590190156 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f466806c220 0x7f466806e6e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.610+0000 7f468f200640 1 --2- 172.21.15.144:0/2590190156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f468815c370 0x7f468815cf40 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.610+0000 7f468f200640 1 --2- 172.21.15.144:0/2590190156 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4688158e50 0x7f468815ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.610+0000 7f468f200640 1 --2- 172.21.15.144:0/2590190156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f468806f130 0x7f468814f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.610+0000 7f468f200640 1 -- 172.21.15.144:0/2590190156 >> 172.21.15.144:0/2590190156 conn(0x7f468806bba0 msgr2=0x7f468806dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:57.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.610+0000 7f468f200640 1 -- 172.21.15.144:0/2590190156 shutdown_connections 2024-09-11T23:23:57.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.610+0000 7f468f200640 1 -- 172.21.15.144:0/2590190156 wait complete. 2024-09-11T23:23:57.627 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2' 2024-09-11T23:23:57.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.779+0000 7fa45d600640 1 Processor -- start 2024-09-11T23:23:57.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.779+0000 7fa45d600640 1 -- start start 2024-09-11T23:23:57.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.780+0000 7fa45d600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa4580b61f0 0x7fa4580b6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:57.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.780+0000 7fa45d600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4580b7aa0 0x7fa4580b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:57.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.780+0000 7fa45d600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4580d34d0 con 0x7fa45815e860 2024-09-11T23:23:57.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.780+0000 7fa45d600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa4580b6b80 con 0x7fa4580b61f0 2024-09-11T23:23:57.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.780+0000 7fa45d600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa4580d3790 con 0x7fa4580b7aa0 2024-09-11T23:23:57.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.780+0000 7fa456a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa45815e860 0x7fa4580cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37460/0 (socket says 172.21.15.144:37460) 2024-09-11T23:23:57.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.780+0000 7fa456a00640 1 -- 172.21.15.144:0/2124671488 learned_addr learned my addr 172.21.15.144:0/2124671488 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:23:57.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.781+0000 7fa457400640 1 --2- 172.21.15.144:0/2124671488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4580b7aa0 0x7fa4580b7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:57.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.781+0000 7fa456000640 1 --2- 172.21.15.144:0/2124671488 >> v2:172.21.15.165:3300/0 conn(0x7fa4580b61f0 0x7fa4580b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:57.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.781+0000 7fa455600640 1 -- 172.21.15.144:0/2124671488 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2671354243 0 0) 0x7fa4580d34d0 con 0x7fa45815e860 2024-09-11T23:23:57.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.781+0000 7fa455600640 1 -- 172.21.15.144:0/2124671488 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa43c003520 con 0x7fa45815e860 2024-09-11T23:23:57.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.781+0000 7fa455600640 1 -- 172.21.15.144:0/2124671488 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3662304527 0 0) 0x7fa43c003520 con 0x7fa45815e860 2024-09-11T23:23:57.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.781+0000 7fa455600640 1 -- 172.21.15.144:0/2124671488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4580b7aa0 msgr2=0x7fa4580b7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:57.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.781+0000 7fa455600640 1 --2- 172.21.15.144:0/2124671488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4580b7aa0 0x7fa4580b7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.781+0000 7fa455600640 1 -- 172.21.15.144:0/2124671488 >> v2:172.21.15.165:3300/0 conn(0x7fa4580b61f0 msgr2=0x7fa4580b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:57.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.781+0000 7fa455600640 1 --2- 172.21.15.144:0/2124671488 >> v2:172.21.15.165:3300/0 conn(0x7fa4580b61f0 0x7fa4580b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.781+0000 7fa455600640 1 -- 172.21.15.144:0/2124671488 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4580d3a70 con 0x7fa45815e860 2024-09-11T23:23:57.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.781+0000 7fa455600640 1 -- 172.21.15.144:0/2124671488 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fa448001690 con 0x7fa45815e860 2024-09-11T23:23:57.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.781+0000 7fa455600640 1 -- 172.21.15.144:0/2124671488 >> v1:172.21.15.144:6789/0 conn(0x7fa45815e860 legacy=0x7fa4580cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:57.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.781+0000 7fa455600640 1 --2- 172.21.15.144:0/2124671488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4580b7aa0 0x7fa43c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:57.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.781+0000 7fa455600640 1 --2- 172.21.15.144:0/2124671488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa43c003f30 0x7fa43c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:57.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.781+0000 7fa455600640 1 --2- 172.21.15.144:0/2124671488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43c004d40 0x7fa43c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:57.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.781+0000 7fa455600640 1 -- 172.21.15.144:0/2124671488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4580b6b80 con 0x7fa43c004d40 2024-09-11T23:23:57.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.781+0000 7fa455600640 1 -- 172.21.15.144:0/2124671488 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa4580d3790 con 0x7fa43c003f30 2024-09-11T23:23:57.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.781+0000 7fa455600640 1 -- 172.21.15.144:0/2124671488 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa43c00b9f0 con 0x7fa4580b7aa0 2024-09-11T23:23:57.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.782+0000 7fa457400640 1 --2- 172.21.15.144:0/2124671488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43c004d40 0x7fa43c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:57.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.782+0000 7fa456a00640 1 --2- 172.21.15.144:0/2124671488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4580b7aa0 0x7fa43c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:57.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.782+0000 7fa456000640 1 --2- 172.21.15.144:0/2124671488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa43c003f30 0x7fa43c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:57.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.782+0000 7fa457400640 1 -- 172.21.15.144:0/2124671488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4580b7aa0 msgr2=0x7fa43c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:57.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.782+0000 7fa457400640 1 --2- 172.21.15.144:0/2124671488 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4580b7aa0 0x7fa43c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.782+0000 7fa457400640 1 -- 172.21.15.144:0/2124671488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa43c003f30 msgr2=0x7fa43c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:57.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.782+0000 7fa457400640 1 --2- 172.21.15.144:0/2124671488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa43c003f30 0x7fa43c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.782+0000 7fa457400640 1 -- 172.21.15.144:0/2124671488 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43c003520 con 0x7fa43c004d40 2024-09-11T23:23:57.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.782+0000 7fa456000640 1 --2- 172.21.15.144:0/2124671488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa43c003f30 0x7fa43c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:23:57.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.783+0000 7fa457400640 1 --2- 172.21.15.144:0/2124671488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43c004d40 0x7fa43c0051c0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fa450009fc0 tx=0x7fa43c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51fa0994a52f1d1c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:57.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.783+0000 7fa455600640 1 -- 172.21.15.144:0/2124671488 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450009c10 con 0x7fa43c004d40 2024-09-11T23:23:57.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.783+0000 7fa455600640 1 -- 172.21.15.144:0/2124671488 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa450036070 con 0x7fa43c004d40 2024-09-11T23:23:57.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.783+0000 7fa455600640 1 -- 172.21.15.144:0/2124671488 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450031880 con 0x7fa43c004d40 2024-09-11T23:23:57.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.784+0000 7fa45d600640 1 -- 172.21.15.144:0/2124671488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43c004d40 msgr2=0x7fa43c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:57.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.784+0000 7fa45d600640 1 --2- 172.21.15.144:0/2124671488 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43c004d40 0x7fa43c0051c0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fa450009fc0 tx=0x7fa43c005830 comp rx=0 tx=0).stop 2024-09-11T23:23:57.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.784+0000 7fa457400640 1 -- 172.21.15.144:0/2124671488 reap_dead start 2024-09-11T23:23:57.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.784+0000 7fa45d600640 1 -- 172.21.15.144:0/2124671488 shutdown_connections 2024-09-11T23:23:57.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.784+0000 7fa45d600640 1 -- 172.21.15.144:0/2124671488 >> 172.21.15.144:0/2124671488 conn(0x7fa458062c60 msgr2=0x7fa4580d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:57.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.784+0000 7fa45d600640 1 -- 172.21.15.144:0/2124671488 shutdown_connections 2024-09-11T23:23:57.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.784+0000 7fa45d600640 1 -- 172.21.15.144:0/2124671488 wait complete. 2024-09-11T23:23:57.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.785+0000 7fa45d600640 1 Processor -- start 2024-09-11T23:23:57.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.786+0000 7fa45d600640 1 -- start start 2024-09-11T23:23:57.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.786+0000 7fa45d600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa43c004d40 0x7fa458158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:57.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.786+0000 7fa45d600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa45815ad80 0x7fa4580cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:57.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.786+0000 7fa45d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa458153a70 0x7fa458153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:57.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.786+0000 7fa45d600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4580d4310 con 0x7fa458153a70 2024-09-11T23:23:57.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.786+0000 7fa45d600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa4580d4030 con 0x7fa43c004d40 2024-09-11T23:23:57.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.786+0000 7fa45d600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa45815ec40 con 0x7fa45815ad80 2024-09-11T23:23:57.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.787+0000 7fa457400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa458153a70 0x7fa458153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:57.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.787+0000 7fa457400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa458153a70 0x7fa458153ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56164/0 (socket says 172.21.15.144:56164) 2024-09-11T23:23:57.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.787+0000 7fa457400640 1 -- 172.21.15.144:0/3635233376 learned_addr learned my addr 172.21.15.144:0/3635233376 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:57.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.787+0000 7fa456a00640 1 --2- 172.21.15.144:0/3635233376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa43c004d40 0x7fa458158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:57.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.787+0000 7fa456000640 1 --2- 172.21.15.144:0/3635233376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa45815ad80 0x7fa4580cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:57.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.787+0000 7fa457400640 1 -- 172.21.15.144:0/3635233376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa45815ad80 msgr2=0x7fa4580cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:57.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.787+0000 7fa457400640 1 --2- 172.21.15.144:0/3635233376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa45815ad80 0x7fa4580cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.787+0000 7fa457400640 1 -- 172.21.15.144:0/3635233376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa43c004d40 msgr2=0x7fa458158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:57.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.787+0000 7fa457400640 1 --2- 172.21.15.144:0/3635233376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa43c004d40 0x7fa458158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:57.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.787+0000 7fa457400640 1 -- 172.21.15.144:0/3635233376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa458155820 con 0x7fa458153a70 2024-09-11T23:23:57.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.787+0000 7fa457400640 1 --2- 172.21.15.144:0/3635233376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa458153a70 0x7fa458153ef0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fa450033040 tx=0x7fa450009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:57.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.788+0000 7fa44ea00640 1 -- 172.21.15.144:0/3635233376 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450009c10 con 0x7fa458153a70 2024-09-11T23:23:57.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.788+0000 7fa44ea00640 1 -- 172.21.15.144:0/3635233376 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa450031dd0 con 0x7fa458153a70 2024-09-11T23:23:57.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.788+0000 7fa44ea00640 1 -- 172.21.15.144:0/3635233376 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450003bd0 con 0x7fa458153a70 2024-09-11T23:23:57.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.788+0000 7fa45d600640 1 -- 172.21.15.144:0/3635233376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa458155b00 con 0x7fa458153a70 2024-09-11T23:23:57.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.788+0000 7fa45d600640 1 -- 172.21.15.144:0/3635233376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa458158750 con 0x7fa458153a70 2024-09-11T23:23:57.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.789+0000 7fa45d600640 1 -- 172.21.15.144:0/3635233376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4580b3ad0 con 0x7fa458153a70 2024-09-11T23:23:57.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.790+0000 7fa44ea00640 1 -- 172.21.15.144:0/3635233376 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7fa450005d10 con 0x7fa458153a70 2024-09-11T23:23:57.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.791+0000 7fa44ea00640 1 --2- 172.21.15.144:0/3635233376 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa43806c220 0x7fa43806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:57.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.791+0000 7fa44ea00640 1 -- 172.21.15.144:0/3635233376 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 4943+0+0 (secure 0 0 0) 0x7fa4500ac380 con 0x7fa458153a70 2024-09-11T23:23:57.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.791+0000 7fa456a00640 1 --2- 172.21.15.144:0/3635233376 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa43806c220 0x7fa43806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:57.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.792+0000 7fa456a00640 1 --2- 172.21.15.144:0/3635233376 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa43806c220 0x7fa43806e6e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa4580ba8e0 tx=0x7fa448009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:57.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:57.795+0000 7fa44ea00640 1 -- 172.21.15.144:0/3635233376 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa45007aa50 con 0x7fa458153a70 2024-09-11T23:23:58.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:58.031+0000 7fa45d600640 1 -- 172.21.15.144:0/3635233376 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]} v 0) -- 0x7fa4580d2700 con 0x7fa458153a70 2024-09-11T23:23:58.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:58.881+0000 7fa44ea00640 1 -- 172.21.15.144:0/3635233376 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]}]=0 v329) ==== 151+0+0 (secure 0 0 0) 0x7fa45007a350 con 0x7fa458153a70 2024-09-11T23:23:58.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:58.884+0000 7fa45d600640 1 -- 172.21.15.144:0/3635233376 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa43806c220 msgr2=0x7fa43806e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:58.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:58.884+0000 7fa45d600640 1 --2- 172.21.15.144:0/3635233376 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa43806c220 0x7fa43806e6e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa4580ba8e0 tx=0x7fa448009040 comp rx=0 tx=0).stop 2024-09-11T23:23:58.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:58.884+0000 7fa45d600640 1 -- 172.21.15.144:0/3635233376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa458153a70 msgr2=0x7fa458153ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:58.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:58.884+0000 7fa45d600640 1 --2- 172.21.15.144:0/3635233376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa458153a70 0x7fa458153ef0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fa450033040 tx=0x7fa450009750 comp rx=0 tx=0).stop 2024-09-11T23:23:58.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:58.884+0000 7fa45d600640 1 -- 172.21.15.144:0/3635233376 shutdown_connections 2024-09-11T23:23:58.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:58.884+0000 7fa45d600640 1 --2- 172.21.15.144:0/3635233376 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa43806c220 0x7fa43806e6e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:58.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:58.884+0000 7fa45d600640 1 --2- 172.21.15.144:0/3635233376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa458153a70 0x7fa458153ef0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:58.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:58.884+0000 7fa45d600640 1 --2- 172.21.15.144:0/3635233376 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa45815ad80 0x7fa4580cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:58.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:58.884+0000 7fa45d600640 1 --2- 172.21.15.144:0/3635233376 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa43c004d40 0x7fa458158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:58.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:58.884+0000 7fa45d600640 1 -- 172.21.15.144:0/3635233376 >> 172.21.15.144:0/3635233376 conn(0x7fa458062c60 msgr2=0x7fa4580b7eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:58.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:58.884+0000 7fa45d600640 1 -- 172.21.15.144:0/3635233376 shutdown_connections 2024-09-11T23:23:58.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:58.884+0000 7fa45d600640 1 -- 172.21.15.144:0/3635233376 wait complete. 2024-09-11T23:23:58.904 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:23:59.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.062+0000 7fbe2ee00640 1 Processor -- start 2024-09-11T23:23:59.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.062+0000 7fbe2ee00640 1 -- start start 2024-09-11T23:23:59.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.063+0000 7fbe2ee00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe2815e6c0 0x7fbe2806c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:59.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.063+0000 7fbe2ee00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe2806d610 0x7fbe2806da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:59.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.063+0000 7fbe2ee00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe2806df60 con 0x7fbe280cf510 2024-09-11T23:23:59.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.063+0000 7fbe2ee00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fbe280d34d0 con 0x7fbe2815e6c0 2024-09-11T23:23:59.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.063+0000 7fbe2ee00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbe2815eaa0 con 0x7fbe2806d610 2024-09-11T23:23:59.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.063+0000 7fbe2da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe2815e6c0 0x7fbe2806c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:59.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.064+0000 7fbe2da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe2815e6c0 0x7fbe2806c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56172/0 (socket says 172.21.15.144:56172) 2024-09-11T23:23:59.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.064+0000 7fbe2da00640 1 -- 172.21.15.144:0/77119624 learned_addr learned my addr 172.21.15.144:0/77119624 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:59.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.064+0000 7fbe2da00640 1 -- 172.21.15.144:0/77119624 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe2806d610 msgr2=0x7fbe2806da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:59.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.064+0000 7fbe2da00640 1 --2- 172.21.15.144:0/77119624 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe2806d610 0x7fbe2806da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.064+0000 7fbe2da00640 1 -- 172.21.15.144:0/77119624 >> v1:172.21.15.165:6789/0 conn(0x7fbe280cf510 legacy=0x7fbe280b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:59.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.064+0000 7fbe2da00640 1 -- 172.21.15.144:0/77119624 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2806cdf0 con 0x7fbe2815e6c0 2024-09-11T23:23:59.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.065+0000 7fbe2da00640 1 --2- 172.21.15.144:0/77119624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe2815e6c0 0x7fbe2806c8b0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fbe28069df0 tx=0x7fbe1c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c9ec74ce61afe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:59.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.065+0000 7fbe27e00640 1 -- 172.21.15.144:0/77119624 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c037070 con 0x7fbe2815e6c0 2024-09-11T23:23:59.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.065+0000 7fbe27e00640 1 -- 172.21.15.144:0/77119624 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe1c032440 con 0x7fbe2815e6c0 2024-09-11T23:23:59.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.065+0000 7fbe27e00640 1 -- 172.21.15.144:0/77119624 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c032810 con 0x7fbe2815e6c0 2024-09-11T23:23:59.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.066+0000 7fbe2ee00640 1 -- 172.21.15.144:0/77119624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe2815e6c0 msgr2=0x7fbe2806c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:59.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.066+0000 7fbe2ee00640 1 --2- 172.21.15.144:0/77119624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe2815e6c0 0x7fbe2806c8b0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fbe28069df0 tx=0x7fbe1c02a1e0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.066+0000 7fbe2ee00640 1 -- 172.21.15.144:0/77119624 shutdown_connections 2024-09-11T23:23:59.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.066+0000 7fbe2ee00640 1 --2- 172.21.15.144:0/77119624 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe2806d610 0x7fbe2806da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.066+0000 7fbe2ee00640 1 --2- 172.21.15.144:0/77119624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe2815e6c0 0x7fbe2806c8b0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.066+0000 7fbe2ee00640 1 -- 172.21.15.144:0/77119624 >> 172.21.15.144:0/77119624 conn(0x7fbe280d4720 msgr2=0x7fbe280d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:59.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.066+0000 7fbe2ee00640 1 -- 172.21.15.144:0/77119624 shutdown_connections 2024-09-11T23:23:59.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.066+0000 7fbe2ee00640 1 -- 172.21.15.144:0/77119624 wait complete. 2024-09-11T23:23:59.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.067+0000 7fbe2ee00640 1 Processor -- start 2024-09-11T23:23:59.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.068+0000 7fbe2ee00640 1 -- start start 2024-09-11T23:23:59.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.068+0000 7fbe2ee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe2806d610 0x7fbe280b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:59.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.068+0000 7fbe2ee00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe280cf510 0x7fbe280cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:59.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.068+0000 7fbe2ee00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe2815e6c0 0x7fbe280cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:59.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.068+0000 7fbe2ee00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbe280d2e80 con 0x7fbe2806d610 2024-09-11T23:23:59.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.068+0000 7fbe2ee00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbe280d2ba0 con 0x7fbe2815e6c0 2024-09-11T23:23:59.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.068+0000 7fbe2ee00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbe280d3160 con 0x7fbe280cf510 2024-09-11T23:23:59.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.069+0000 7fbe2da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe2806d610 0x7fbe280b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:59.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.069+0000 7fbe2da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe2806d610 0x7fbe280b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56174/0 (socket says 172.21.15.144:56174) 2024-09-11T23:23:59.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.069+0000 7fbe2da00640 1 -- 172.21.15.144:0/1110701369 learned_addr learned my addr 172.21.15.144:0/1110701369 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:59.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.069+0000 7fbe2d000640 1 --2- 172.21.15.144:0/1110701369 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe280cf510 0x7fbe280cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:59.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.069+0000 7fbe2e400640 1 --2- 172.21.15.144:0/1110701369 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe2815e6c0 0x7fbe280cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:59.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.069+0000 7fbe2da00640 1 -- 172.21.15.144:0/1110701369 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe280cf510 msgr2=0x7fbe280cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:59.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.069+0000 7fbe2da00640 1 --2- 172.21.15.144:0/1110701369 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe280cf510 0x7fbe280cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.069+0000 7fbe2da00640 1 -- 172.21.15.144:0/1110701369 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe2815e6c0 msgr2=0x7fbe280cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:59.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.069+0000 7fbe2da00640 1 --2- 172.21.15.144:0/1110701369 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe2815e6c0 0x7fbe280cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.069+0000 7fbe2da00640 1 -- 172.21.15.144:0/1110701369 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe280cea70 con 0x7fbe2806d610 2024-09-11T23:23:59.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.069+0000 7fbe2da00640 1 --2- 172.21.15.144:0/1110701369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe2806d610 0x7fbe280b34d0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c000c00 tx=0x7fbe1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:59.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.070+0000 7fbe25600640 1 -- 172.21.15.144:0/1110701369 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c041070 con 0x7fbe2806d610 2024-09-11T23:23:59.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.070+0000 7fbe25600640 1 -- 172.21.15.144:0/1110701369 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe1c03c870 con 0x7fbe2806d610 2024-09-11T23:23:59.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.070+0000 7fbe25600640 1 -- 172.21.15.144:0/1110701369 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c037040 con 0x7fbe2806d610 2024-09-11T23:23:59.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.070+0000 7fbe2ee00640 1 -- 172.21.15.144:0/1110701369 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe280b3a10 con 0x7fbe2806d610 2024-09-11T23:23:59.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.070+0000 7fbe2ee00640 1 -- 172.21.15.144:0/1110701369 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe280ce4b0 con 0x7fbe2806d610 2024-09-11T23:23:59.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.071+0000 7fbe2ee00640 1 -- 172.21.15.144:0/1110701369 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe2806da20 con 0x7fbe2806d610 2024-09-11T23:23:59.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.072+0000 7fbe25600640 1 -- 172.21.15.144:0/1110701369 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7fbe1c044070 con 0x7fbe2806d610 2024-09-11T23:23:59.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.073+0000 7fbe25600640 1 --2- 172.21.15.144:0/1110701369 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe0806c220 0x7fbe0806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:59.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.073+0000 7fbe25600640 1 -- 172.21.15.144:0/1110701369 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 4943+0+0 (secure 0 0 0) 0x7fbe1c0abeb0 con 0x7fbe2806d610 2024-09-11T23:23:59.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.073+0000 7fbe2d000640 1 --2- 172.21.15.144:0/1110701369 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe0806c220 0x7fbe0806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:59.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.074+0000 7fbe2d000640 1 --2- 172.21.15.144:0/1110701369 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe0806c220 0x7fbe0806e6e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbe14004f60 tx=0x7fbe14007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:59.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.078+0000 7fbe25600640 1 -- 172.21.15.144:0/1110701369 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe2806df60 con 0x7fbe2806d610 2024-09-11T23:23:59.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.249+0000 7fbe2ee00640 1 -- 172.21.15.144:0/1110701369 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fbe280d2600 con 0x7fbe2806d610 2024-09-11T23:23:59.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.253+0000 7fbe25600640 1 -- 172.21.15.144:0/1110701369 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7fbe1c07a1b0 con 0x7fbe2806d610 2024-09-11T23:23:59.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.256+0000 7fbe2ee00640 1 -- 172.21.15.144:0/1110701369 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe0806c220 msgr2=0x7fbe0806e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:59.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.256+0000 7fbe2ee00640 1 --2- 172.21.15.144:0/1110701369 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe0806c220 0x7fbe0806e6e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbe14004f60 tx=0x7fbe14007e30 comp rx=0 tx=0).stop 2024-09-11T23:23:59.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.256+0000 7fbe2ee00640 1 -- 172.21.15.144:0/1110701369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe2806d610 msgr2=0x7fbe280b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:59.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.256+0000 7fbe2ee00640 1 --2- 172.21.15.144:0/1110701369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe2806d610 0x7fbe280b34d0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c000c00 tx=0x7fbe1c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.256+0000 7fbe2ee00640 1 -- 172.21.15.144:0/1110701369 shutdown_connections 2024-09-11T23:23:59.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.256+0000 7fbe2ee00640 1 --2- 172.21.15.144:0/1110701369 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe0806c220 0x7fbe0806e6e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.256+0000 7fbe2ee00640 1 --2- 172.21.15.144:0/1110701369 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe2815e6c0 0x7fbe280cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.256+0000 7fbe2ee00640 1 --2- 172.21.15.144:0/1110701369 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe280cf510 0x7fbe280cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.256+0000 7fbe2ee00640 1 --2- 172.21.15.144:0/1110701369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe2806d610 0x7fbe280b34d0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.256+0000 7fbe2ee00640 1 -- 172.21.15.144:0/1110701369 >> 172.21.15.144:0/1110701369 conn(0x7fbe280d4720 msgr2=0x7fbe2815ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:59.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.256+0000 7fbe2ee00640 1 -- 172.21.15.144:0/1110701369 shutdown_connections 2024-09-11T23:23:59.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.256+0000 7fbe2ee00640 1 -- 172.21.15.144:0/1110701369 wait complete. 2024-09-11T23:23:59.274 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:23:59.274 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:23:59.360 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:23:59.456 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:23:59.456 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:23:59.456 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:59.492 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:23:59.492 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:23:59.492 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:59.529 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:23:59.529 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:23:59.529 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:59.566 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:23:59.566 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:23:59.567 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:23:59.606 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:23:59.606 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T23:23:59.606 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:23:59.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.759+0000 7fcea2a00640 1 Processor -- start 2024-09-11T23:23:59.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.759+0000 7fcea2a00640 1 -- start start 2024-09-11T23:23:59.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.760+0000 7fcea2a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fce9c15a0a0 0x7fce9c073180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:59.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.760+0000 7fcea2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fce9c0736c0 0x7fce9c0ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:59.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.760+0000 7fcea2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce9c0ce9c0 0x7fce9c0b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:59.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.760+0000 7fcea2a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fce9c0cee00 con 0x7fce9c0736c0 2024-09-11T23:23:59.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.760+0000 7fcea2a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fce9c072100 con 0x7fce9c15a0a0 2024-09-11T23:23:59.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.760+0000 7fcea2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fce9c0723c0 con 0x7fce9c0ce9c0 2024-09-11T23:23:59.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.760+0000 7fcea0c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fce9c0736c0 0x7fce9c0ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:59.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.760+0000 7fcea0c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fce9c0736c0 0x7fce9c0ce480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56182/0 (socket says 172.21.15.144:56182) 2024-09-11T23:23:59.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.760+0000 7fcea0c00640 1 -- 172.21.15.144:0/3065398060 learned_addr learned my addr 172.21.15.144:0/3065398060 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:59.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.761+0000 7fcea1600640 1 --2- 172.21.15.144:0/3065398060 >> v2:172.21.15.165:3300/0 conn(0x7fce9c15a0a0 0x7fce9c073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:59.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.761+0000 7fcea2000640 1 --2- 172.21.15.144:0/3065398060 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce9c0ce9c0 0x7fce9c0b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:59.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.761+0000 7fcea0c00640 1 -- 172.21.15.144:0/3065398060 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce9c0ce9c0 msgr2=0x7fce9c0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:59.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.761+0000 7fcea0c00640 1 --2- 172.21.15.144:0/3065398060 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce9c0ce9c0 0x7fce9c0b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.761+0000 7fcea0c00640 1 -- 172.21.15.144:0/3065398060 >> v2:172.21.15.165:3300/0 conn(0x7fce9c15a0a0 msgr2=0x7fce9c073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:23:59.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.761+0000 7fcea0c00640 1 --2- 172.21.15.144:0/3065398060 >> v2:172.21.15.165:3300/0 conn(0x7fce9c15a0a0 0x7fce9c073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.761+0000 7fcea0c00640 1 -- 172.21.15.144:0/3065398060 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c0726a0 con 0x7fce9c0736c0 2024-09-11T23:23:59.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.761+0000 7fcea2000640 1 --2- 172.21.15.144:0/3065398060 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce9c0ce9c0 0x7fce9c0b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:23:59.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.762+0000 7fcea0c00640 1 --2- 172.21.15.144:0/3065398060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce9c0736c0 0x7fce9c0ce480 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0d1160 tx=0x7fce8802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4be255d6c181a0e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:59.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.762+0000 7fce9be00640 1 -- 172.21.15.144:0/3065398060 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce88037070 con 0x7fce9c0736c0 2024-09-11T23:23:59.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.762+0000 7fce9be00640 1 -- 172.21.15.144:0/3065398060 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce88032440 con 0x7fce9c0736c0 2024-09-11T23:23:59.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.762+0000 7fce9be00640 1 -- 172.21.15.144:0/3065398060 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce88032810 con 0x7fce9c0736c0 2024-09-11T23:23:59.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.763+0000 7fcea2a00640 1 -- 172.21.15.144:0/3065398060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce9c0736c0 msgr2=0x7fce9c0ce480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:59.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.763+0000 7fcea2a00640 1 --2- 172.21.15.144:0/3065398060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce9c0736c0 0x7fce9c0ce480 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0d1160 tx=0x7fce8802a1e0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.763+0000 7fcea2a00640 1 -- 172.21.15.144:0/3065398060 shutdown_connections 2024-09-11T23:23:59.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.763+0000 7fcea2a00640 1 --2- 172.21.15.144:0/3065398060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce9c0736c0 0x7fce9c0ce480 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.763+0000 7fcea2a00640 1 --2- 172.21.15.144:0/3065398060 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce9c0ce9c0 0x7fce9c0b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.763+0000 7fcea2a00640 1 --2- 172.21.15.144:0/3065398060 >> v2:172.21.15.165:3300/0 conn(0x7fce9c15a0a0 0x7fce9c073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.763+0000 7fcea2a00640 1 -- 172.21.15.144:0/3065398060 >> 172.21.15.144:0/3065398060 conn(0x7fce9c06e910 msgr2=0x7fce9c06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:59.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.763+0000 7fcea2a00640 1 -- 172.21.15.144:0/3065398060 shutdown_connections 2024-09-11T23:23:59.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.763+0000 7fcea2a00640 1 -- 172.21.15.144:0/3065398060 wait complete. 2024-09-11T23:23:59.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.764+0000 7fcea2a00640 1 Processor -- start 2024-09-11T23:23:59.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.764+0000 7fcea2a00640 1 -- start start 2024-09-11T23:23:59.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.765+0000 7fcea2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce9c0ce9c0 0x7fce9c15b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:59.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.765+0000 7fcea2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce9c15a0a0 0x7fce9c1f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:59.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.765+0000 7fcea2a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce9c1f5ae0 0x7fce9c0aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:59.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.765+0000 7fcea2a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c0b2480 con 0x7fce9c0ce9c0 2024-09-11T23:23:59.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.765+0000 7fcea2a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c0b2300 con 0x7fce9c1f5ae0 2024-09-11T23:23:59.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.765+0000 7fcea2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fce9c0b2600 con 0x7fce9c15a0a0 2024-09-11T23:23:59.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.766+0000 7fcea1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce9c0ce9c0 0x7fce9c15b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:59.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.766+0000 7fcea1600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce9c0ce9c0 0x7fce9c15b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56198/0 (socket says 172.21.15.144:56198) 2024-09-11T23:23:59.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.766+0000 7fcea1600640 1 -- 172.21.15.144:0/2717538096 learned_addr learned my addr 172.21.15.144:0/2717538096 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:23:59.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.766+0000 7fcea0c00640 1 --2- 172.21.15.144:0/2717538096 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce9c15a0a0 0x7fce9c1f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:59.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.766+0000 7fcea2000640 1 --2- 172.21.15.144:0/2717538096 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce9c1f5ae0 0x7fce9c0aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:59.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.766+0000 7fcea1600640 1 -- 172.21.15.144:0/2717538096 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce9c15a0a0 msgr2=0x7fce9c1f55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:59.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.766+0000 7fcea1600640 1 --2- 172.21.15.144:0/2717538096 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce9c15a0a0 0x7fce9c1f55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.766+0000 7fcea1600640 1 -- 172.21.15.144:0/2717538096 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce9c1f5ae0 msgr2=0x7fce9c0aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:59.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.766+0000 7fcea1600640 1 --2- 172.21.15.144:0/2717538096 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce9c1f5ae0 0x7fce9c0aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.766+0000 7fcea1600640 1 -- 172.21.15.144:0/2717538096 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c1f6080 con 0x7fce9c0ce9c0 2024-09-11T23:23:59.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.766+0000 7fcea1600640 1 --2- 172.21.15.144:0/2717538096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce9c0ce9c0 0x7fce9c15b940 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fce9000e9b0 tx=0x7fce9000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:59.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.767+0000 7fce99600640 1 -- 172.21.15.144:0/2717538096 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce90017070 con 0x7fce9c0ce9c0 2024-09-11T23:23:59.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.767+0000 7fce99600640 1 -- 172.21.15.144:0/2717538096 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce9000c9a0 con 0x7fce9c0ce9c0 2024-09-11T23:23:59.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.767+0000 7fce99600640 1 -- 172.21.15.144:0/2717538096 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9000cd90 con 0x7fce9c0ce9c0 2024-09-11T23:23:59.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.767+0000 7fcea2a00640 1 -- 172.21.15.144:0/2717538096 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce9c1f6360 con 0x7fce9c0ce9c0 2024-09-11T23:23:59.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.767+0000 7fcea2a00640 1 -- 172.21.15.144:0/2717538096 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce9c14c1e0 con 0x7fce9c0ce9c0 2024-09-11T23:23:59.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.768+0000 7fcea2a00640 1 -- 172.21.15.144:0/2717538096 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce9c0aab60 con 0x7fce9c0ce9c0 2024-09-11T23:23:59.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.769+0000 7fce99600640 1 -- 172.21.15.144:0/2717538096 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7fce9001a070 con 0x7fce9c0ce9c0 2024-09-11T23:23:59.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.770+0000 7fce99600640 1 --2- 172.21.15.144:0/2717538096 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fce7c06c220 0x7fce7c06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:23:59.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.770+0000 7fce99600640 1 -- 172.21.15.144:0/2717538096 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 4943+0+0 (secure 0 0 0) 0x7fce9008b5a0 con 0x7fce9c0ce9c0 2024-09-11T23:23:59.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.770+0000 7fcea0c00640 1 --2- 172.21.15.144:0/2717538096 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fce7c06c220 0x7fce7c06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:23:59.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.771+0000 7fcea0c00640 1 --2- 172.21.15.144:0/2717538096 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fce7c06c220 0x7fce7c06e6e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fce88034000 tx=0x7fce8802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:23:59.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.774+0000 7fce99600640 1 -- 172.21.15.144:0/2717538096 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce90059670 con 0x7fce9c0ce9c0 2024-09-11T23:23:59.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.983+0000 7fcea2a00640 1 -- 172.21.15.144:0/2717538096 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce9c0b1dc0 con 0x7fce9c0ce9c0 2024-09-11T23:23:59.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.983+0000 7fce99600640 1 -- 172.21.15.144:0/2717538096 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+3923 (secure 0 0 0) 0x7fce9008b030 con 0x7fce9c0ce9c0 2024-09-11T23:23:59.984 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:23:59.984 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":74,"btime":"2024-09-11T23:23:53:605229+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2463021219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2463021219},{"type":"v1","addr":"172.21.15.165:6835","nonce":2463021219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6900,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/2687483394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2687483394},{"type":"v1","addr":"172.21.15.144:6801","nonce":2687483394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6903,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2256829982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2256829982},{"type":"v1","addr":"172.21.15.165:6834","nonce":2256829982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7302,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/2030884107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":2030884107},{"type":"v1","addr":"172.21.15.144:6835","nonce":2030884107}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[]} 2024-09-11T23:23:59.985 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 74 2024-09-11T23:23:59.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.985+0000 7fcea2a00640 1 -- 172.21.15.144:0/2717538096 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fce7c06c220 msgr2=0x7fce7c06e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:59.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.986+0000 7fcea2a00640 1 --2- 172.21.15.144:0/2717538096 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fce7c06c220 0x7fce7c06e6e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fce88034000 tx=0x7fce8802e000 comp rx=0 tx=0).stop 2024-09-11T23:23:59.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.986+0000 7fcea2a00640 1 -- 172.21.15.144:0/2717538096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce9c0ce9c0 msgr2=0x7fce9c15b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:23:59.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.986+0000 7fcea2a00640 1 --2- 172.21.15.144:0/2717538096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce9c0ce9c0 0x7fce9c15b940 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fce9000e9b0 tx=0x7fce9000ee70 comp rx=0 tx=0).stop 2024-09-11T23:23:59.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.986+0000 7fcea2a00640 1 -- 172.21.15.144:0/2717538096 shutdown_connections 2024-09-11T23:23:59.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.986+0000 7fcea2a00640 1 --2- 172.21.15.144:0/2717538096 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fce7c06c220 0x7fce7c06e6e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.986+0000 7fcea2a00640 1 --2- 172.21.15.144:0/2717538096 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce9c1f5ae0 0x7fce9c0aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.986+0000 7fcea2a00640 1 --2- 172.21.15.144:0/2717538096 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce9c15a0a0 0x7fce9c1f55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.986+0000 7fcea2a00640 1 --2- 172.21.15.144:0/2717538096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce9c0ce9c0 0x7fce9c15b940 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:23:59.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.986+0000 7fcea2a00640 1 -- 172.21.15.144:0/2717538096 >> 172.21.15.144:0/2717538096 conn(0x7fce9c06e910 msgr2=0x7fce9c0b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:23:59.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.986+0000 7fcea2a00640 1 -- 172.21.15.144:0/2717538096 shutdown_connections 2024-09-11T23:23:59.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:23:59.986+0000 7fcea2a00640 1 -- 172.21.15.144:0/2717538096 wait complete. 2024-09-11T23:24:00.002 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:24:00.003 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:24:00.003 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:24:00.003 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:24:00.003 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:24:00.003 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T23:24:00.003 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:24:00.003 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:24:00.004 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:24:00.004 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:24:00.004 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:24:00.004 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:24:00.004 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:24:00.004 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T23:24:00.004 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:24:00.004 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:24:00.019 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:24:00.019 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:24:00.020 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:24:00.020 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:24:00.021 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:24:00.021 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:24:00.022 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:24:00.022 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:24:00.064 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:24:00.064 DEBUG:teuthology.parallel:result is None 2024-09-11T23:24:00.065 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:24:00.066 DEBUG:teuthology.parallel:result is None 2024-09-11T23:24:00.068 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:24:00.069 DEBUG:teuthology.parallel:result is None 2024-09-11T23:24:00.071 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:24:00.071 DEBUG:teuthology.parallel:result is None 2024-09-11T23:24:00.071 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:24:00.193 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-11T23:24:00.193 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-11T23:24:00.201 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-11T23:24:00.201 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-11T23:24:00.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.232+0000 7f0c3ac00640 1 Processor -- start 2024-09-11T23:24:00.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.232+0000 7f0c3ac00640 1 -- start start 2024-09-11T23:24:00.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.233+0000 7f0c3ac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c340b61f0 0x7f0c340b6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:00.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.233+0000 7f0c3ac00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c340b6b50 con 0x7f0c340b7aa0 2024-09-11T23:24:00.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.233+0000 7f0c3ac00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c340d34d0 con 0x7f0c3415e860 2024-09-11T23:24:00.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.233+0000 7f0c3ac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0c340d3790 con 0x7f0c340b61f0 2024-09-11T23:24:00.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.233+0000 7f0c38c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0c340b7aa0 0x7f0c340b7ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37470/0 (socket says 172.21.15.144:37470) 2024-09-11T23:24:00.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.233+0000 7f0c38c00640 1 -- 172.21.15.144:0/3785250925 learned_addr learned my addr 172.21.15.144:0/3785250925 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:00.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.233+0000 7f0c2be00640 1 --2- 172.21.15.144:0/3785250925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c340b61f0 0x7f0c340b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:00.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.234+0000 7f0c33400640 1 -- 172.21.15.144:0/3785250925 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3237723345 0 0) 0x7f0c340b6b50 con 0x7f0c340b7aa0 2024-09-11T23:24:00.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.234+0000 7f0c33400640 1 -- 172.21.15.144:0/3785250925 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c18003520 con 0x7f0c340b7aa0 2024-09-11T23:24:00.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.234+0000 7f0c33400640 1 -- 172.21.15.144:0/3785250925 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 387300786 0 0) 0x7f0c340d34d0 con 0x7f0c3415e860 2024-09-11T23:24:00.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.234+0000 7f0c2be00640 1 -- 172.21.15.144:0/3785250925 >> v1:172.21.15.165:6789/0 conn(0x7f0c3415e860 legacy=0x7f0c340cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:00.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.234+0000 7f0c2be00640 1 -- 172.21.15.144:0/3785250925 >> v1:172.21.15.144:6789/0 conn(0x7f0c340b7aa0 legacy=0x7f0c340b7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:00.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.234+0000 7f0c2be00640 1 -- 172.21.15.144:0/3785250925 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c340d3a70 con 0x7f0c340b61f0 2024-09-11T23:24:00.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.235+0000 7f0c2be00640 1 --2- 172.21.15.144:0/3785250925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c340b61f0 0x7f0c340b6610 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c0097d0 tx=0x7f0c1c02a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ded12ea8f35b6ce5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:00.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.235+0000 7f0c33400640 1 -- 172.21.15.144:0/3785250925 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c037070 con 0x7f0c340b61f0 2024-09-11T23:24:00.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.235+0000 7f0c33400640 1 -- 172.21.15.144:0/3785250925 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1c032440 con 0x7f0c340b61f0 2024-09-11T23:24:00.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.235+0000 7f0c33400640 1 -- 172.21.15.144:0/3785250925 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0327f0 con 0x7f0c340b61f0 2024-09-11T23:24:00.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.236+0000 7f0c3ac00640 1 -- 172.21.15.144:0/3785250925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c340b61f0 msgr2=0x7f0c340b6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:00.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.236+0000 7f0c3ac00640 1 --2- 172.21.15.144:0/3785250925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c340b61f0 0x7f0c340b6610 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c0097d0 tx=0x7f0c1c02a290 comp rx=0 tx=0).stop 2024-09-11T23:24:00.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.236+0000 7f0c3ac00640 1 -- 172.21.15.144:0/3785250925 shutdown_connections 2024-09-11T23:24:00.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.236+0000 7f0c3ac00640 1 --2- 172.21.15.144:0/3785250925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c340b61f0 0x7f0c340b6610 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:00.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.236+0000 7f0c3ac00640 1 -- 172.21.15.144:0/3785250925 >> 172.21.15.144:0/3785250925 conn(0x7f0c34062c60 msgr2=0x7f0c340d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:00.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.236+0000 7f0c3ac00640 1 -- 172.21.15.144:0/3785250925 shutdown_connections 2024-09-11T23:24:00.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.236+0000 7f0c3ac00640 1 -- 172.21.15.144:0/3785250925 wait complete. 2024-09-11T23:24:00.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.237+0000 7f0c3ac00640 1 Processor -- start 2024-09-11T23:24:00.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.238+0000 7f0c3ac00640 1 -- start start 2024-09-11T23:24:00.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.238+0000 7f0c3ac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c340b61f0 0x7f0c3415a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:00.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.239+0000 7f0c3ac00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c340b7aa0 0x7f0c34157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:00.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.239+0000 7f0c3ac00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c3415e860 0x7f0c34157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:00.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.239+0000 7f0c3ac00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0c340d4310 con 0x7f0c3415e860 2024-09-11T23:24:00.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.239+0000 7f0c3ac00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0c340d4030 con 0x7f0c340b7aa0 2024-09-11T23:24:00.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.239+0000 7f0c3ac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0c3415ec40 con 0x7f0c340b61f0 2024-09-11T23:24:00.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.239+0000 7f0c38c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c3415e860 0x7f0c34157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:00.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.239+0000 7f0c38c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c3415e860 0x7f0c34157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56236/0 (socket says 172.21.15.144:56236) 2024-09-11T23:24:00.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.239+0000 7f0c38c00640 1 -- 172.21.15.144:0/992167531 learned_addr learned my addr 172.21.15.144:0/992167531 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:00.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.239+0000 7f0c33e00640 1 --2- 172.21.15.144:0/992167531 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c340b61f0 0x7f0c3415a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:00.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.239+0000 7f0c2be00640 1 --2- 172.21.15.144:0/992167531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c340b7aa0 0x7f0c34157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:00.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.239+0000 7f0c38c00640 1 -- 172.21.15.144:0/992167531 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c340b61f0 msgr2=0x7f0c3415a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:00.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.239+0000 7f0c38c00640 1 --2- 172.21.15.144:0/992167531 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c340b61f0 0x7f0c3415a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:00.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.239+0000 7f0c38c00640 1 -- 172.21.15.144:0/992167531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c340b7aa0 msgr2=0x7f0c34157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:00.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.239+0000 7f0c38c00640 1 --2- 172.21.15.144:0/992167531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c340b7aa0 0x7f0c34157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:00.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.239+0000 7f0c38c00640 1 -- 172.21.15.144:0/992167531 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c3415a910 con 0x7f0c3415e860 2024-09-11T23:24:00.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.240+0000 7f0c38c00640 1 --2- 172.21.15.144:0/992167531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c3415e860 0x7f0c34157b40 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c00cb40 tx=0x7f0c2c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:00.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.240+0000 7f0c30c00640 1 -- 172.21.15.144:0/992167531 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c017070 con 0x7f0c3415e860 2024-09-11T23:24:00.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.240+0000 7f0c30c00640 1 -- 172.21.15.144:0/992167531 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c2c00aca0 con 0x7f0c3415e860 2024-09-11T23:24:00.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.240+0000 7f0c3ac00640 1 -- 172.21.15.144:0/992167531 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c3415abf0 con 0x7f0c3415e860 2024-09-11T23:24:00.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.240+0000 7f0c30c00640 1 -- 172.21.15.144:0/992167531 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c012620 con 0x7f0c3415e860 2024-09-11T23:24:00.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.240+0000 7f0c3ac00640 1 -- 172.21.15.144:0/992167531 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c340cba00 con 0x7f0c3415e860 2024-09-11T23:24:00.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.241+0000 7f0c3ac00640 1 -- 172.21.15.144:0/992167531 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c340b3ad0 con 0x7f0c3415e860 2024-09-11T23:24:00.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.242+0000 7f0c30c00640 1 -- 172.21.15.144:0/992167531 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f0c2c01a070 con 0x7f0c3415e860 2024-09-11T23:24:00.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.243+0000 7f0c30c00640 1 --2- 172.21.15.144:0/992167531 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0c1006c220 0x7f0c1006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:00.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.243+0000 7f0c30c00640 1 -- 172.21.15.144:0/992167531 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 4943+0+0 (secure 0 0 0) 0x7f0c2c08afd0 con 0x7f0c3415e860 2024-09-11T23:24:00.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.243+0000 7f0c33e00640 1 --2- 172.21.15.144:0/992167531 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0c1006c220 0x7f0c1006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:00.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.244+0000 7f0c33e00640 1 --2- 172.21.15.144:0/992167531 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0c1006c220 0x7f0c1006e6e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0c24000f60 tx=0x7f0c24009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:00.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.247+0000 7f0c30c00640 1 -- 172.21.15.144:0/992167531 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c2c0590e0 con 0x7f0c3415e860 2024-09-11T23:24:00.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.432+0000 7f0c3ac00640 1 -- 172.21.15.144:0/992167531 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f0c340d2700 con 0x7f0c3415e860 2024-09-11T23:24:00.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.896+0000 7f0c30c00640 1 -- 172.21.15.144:0/992167531 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v110) ==== 97+0+0 (secure 0 0 0) 0x7f0c2c05d3e0 con 0x7f0c3415e860 2024-09-11T23:24:00.897 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-11T23:24:00.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.898+0000 7f0c3ac00640 1 -- 172.21.15.144:0/992167531 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0c1006c220 msgr2=0x7f0c1006e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:00.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.898+0000 7f0c3ac00640 1 --2- 172.21.15.144:0/992167531 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0c1006c220 0x7f0c1006e6e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0c24000f60 tx=0x7f0c24009040 comp rx=0 tx=0).stop 2024-09-11T23:24:00.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.898+0000 7f0c3ac00640 1 -- 172.21.15.144:0/992167531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c3415e860 msgr2=0x7f0c34157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:00.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.898+0000 7f0c3ac00640 1 --2- 172.21.15.144:0/992167531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c3415e860 0x7f0c34157b40 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c00cb40 tx=0x7f0c2c00a060 comp rx=0 tx=0).stop 2024-09-11T23:24:00.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.898+0000 7f0c3ac00640 1 -- 172.21.15.144:0/992167531 shutdown_connections 2024-09-11T23:24:00.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.898+0000 7f0c3ac00640 1 --2- 172.21.15.144:0/992167531 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0c1006c220 0x7f0c1006e6e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:00.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.898+0000 7f0c3ac00640 1 --2- 172.21.15.144:0/992167531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c3415e860 0x7f0c34157b40 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:00.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.898+0000 7f0c3ac00640 1 --2- 172.21.15.144:0/992167531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c340b7aa0 0x7f0c34157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:00.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.898+0000 7f0c3ac00640 1 --2- 172.21.15.144:0/992167531 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0c340b61f0 0x7f0c3415a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:00.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.898+0000 7f0c3ac00640 1 -- 172.21.15.144:0/992167531 >> 172.21.15.144:0/992167531 conn(0x7f0c34062c60 msgr2=0x7f0c340b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:00.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.898+0000 7f0c3ac00640 1 -- 172.21.15.144:0/992167531 shutdown_connections 2024-09-11T23:24:00.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:00.898+0000 7f0c3ac00640 1 -- 172.21.15.144:0/992167531 wait complete. 2024-09-11T23:24:00.916 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:24:01.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.069+0000 7ffaa5400640 1 Processor -- start 2024-09-11T23:24:01.070 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.069+0000 7ffaa5400640 1 -- start start 2024-09-11T23:24:01.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.070+0000 7ffaa5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffaa00b5fd0 0x7ffaa00b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:01.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.070+0000 7ffaa5400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffaa00b7750 0x7ffaa00b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:01.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.070+0000 7ffaa5400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaa006bee0 con 0x7ffaa015e640 2024-09-11T23:24:01.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.070+0000 7ffaa5400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ffaa015ea20 con 0x7ffaa00b5fd0 2024-09-11T23:24:01.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.070+0000 7ffaa5400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa006caf0 con 0x7ffaa00b7750 2024-09-11T23:24:01.071 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.070+0000 7ffa9fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ffaa015e640 0x7ffaa00d3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37486/0 (socket says 172.21.15.144:37486) 2024-09-11T23:24:01.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.070+0000 7ffa9fe00640 1 -- 172.21.15.144:0/733265374 learned_addr learned my addr 172.21.15.144:0/733265374 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:01.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.070+0000 7ffa9f400640 1 --2- 172.21.15.144:0/733265374 >> v2:172.21.15.144:3300/0 conn(0x7ffaa00b5fd0 0x7ffaa00b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:01.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.071+0000 7ffaa4a00640 1 --2- 172.21.15.144:0/733265374 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffaa00b7750 0x7ffaa00b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:01.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.071+0000 7ffa9f400640 1 -- 172.21.15.144:0/733265374 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffaa00b7750 msgr2=0x7ffaa00b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:01.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.071+0000 7ffa9f400640 1 --2- 172.21.15.144:0/733265374 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffaa00b7750 0x7ffaa00b7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.071+0000 7ffa9f400640 1 -- 172.21.15.144:0/733265374 >> v1:172.21.15.144:6789/0 conn(0x7ffaa015e640 legacy=0x7ffaa00d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:01.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.071+0000 7ffa9f400640 1 -- 172.21.15.144:0/733265374 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa006c1c0 con 0x7ffaa00b5fd0 2024-09-11T23:24:01.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.071+0000 7ffa9ea00640 1 -- 172.21.15.144:0/733265374 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2938231256 0 0) 0x7ffaa006bee0 con 0x7ffaa015e640 2024-09-11T23:24:01.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.072+0000 7ffa9f400640 1 --2- 172.21.15.144:0/733265374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaa00b5fd0 0x7ffaa00b6410 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c0097a0 tx=0x7ffa8c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2aca68d9f25e594 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:01.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.072+0000 7ffa9ea00640 1 -- 172.21.15.144:0/733265374 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c037070 con 0x7ffaa00b5fd0 2024-09-11T23:24:01.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.072+0000 7ffa9ea00640 1 -- 172.21.15.144:0/733265374 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa8c032440 con 0x7ffaa00b5fd0 2024-09-11T23:24:01.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.072+0000 7ffa9ea00640 1 -- 172.21.15.144:0/733265374 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c032810 con 0x7ffaa00b5fd0 2024-09-11T23:24:01.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.073+0000 7ffaa5400640 1 -- 172.21.15.144:0/733265374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaa00b5fd0 msgr2=0x7ffaa00b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:01.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.073+0000 7ffaa5400640 1 --2- 172.21.15.144:0/733265374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaa00b5fd0 0x7ffaa00b6410 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c0097a0 tx=0x7ffa8c02a180 comp rx=0 tx=0).stop 2024-09-11T23:24:01.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.073+0000 7ffaa5400640 1 -- 172.21.15.144:0/733265374 shutdown_connections 2024-09-11T23:24:01.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.073+0000 7ffaa5400640 1 --2- 172.21.15.144:0/733265374 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffaa00b7750 0x7ffaa00b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.073+0000 7ffaa5400640 1 --2- 172.21.15.144:0/733265374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaa00b5fd0 0x7ffaa00b6410 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.073+0000 7ffaa5400640 1 -- 172.21.15.144:0/733265374 >> 172.21.15.144:0/733265374 conn(0x7ffaa00d0fd0 msgr2=0x7ffaa00d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:01.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.073+0000 7ffaa5400640 1 -- 172.21.15.144:0/733265374 shutdown_connections 2024-09-11T23:24:01.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.073+0000 7ffaa5400640 1 -- 172.21.15.144:0/733265374 wait complete. 2024-09-11T23:24:01.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.075+0000 7ffaa5400640 1 Processor -- start 2024-09-11T23:24:01.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.075+0000 7ffaa5400640 1 -- start start 2024-09-11T23:24:01.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.075+0000 7ffaa5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaa00b5fd0 0x7ffaa01f4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:01.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.076+0000 7ffaa5400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffaa00b7750 0x7ffaa0155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:01.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.076+0000 7ffaa5400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffaa015e640 0x7ffaa015d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:01.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.076+0000 7ffaa5400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa006c780 con 0x7ffaa00b5fd0 2024-09-11T23:24:01.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.076+0000 7ffaa5400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa00b6950 con 0x7ffaa015e640 2024-09-11T23:24:01.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.076+0000 7ffaa5400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa00d4130 con 0x7ffaa00b7750 2024-09-11T23:24:01.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.076+0000 7ffa9fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaa00b5fd0 0x7ffaa01f4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:01.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.076+0000 7ffa9fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaa00b5fd0 0x7ffaa01f4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56250/0 (socket says 172.21.15.144:56250) 2024-09-11T23:24:01.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.076+0000 7ffa9fe00640 1 -- 172.21.15.144:0/3478232717 learned_addr learned my addr 172.21.15.144:0/3478232717 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:01.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.076+0000 7ffa9f400640 1 --2- 172.21.15.144:0/3478232717 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffaa00b7750 0x7ffaa0155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:01.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.076+0000 7ffaa4a00640 1 --2- 172.21.15.144:0/3478232717 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffaa015e640 0x7ffaa015d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:01.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.076+0000 7ffa9fe00640 1 -- 172.21.15.144:0/3478232717 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffaa00b7750 msgr2=0x7ffaa0155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:01.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.076+0000 7ffa9fe00640 1 --2- 172.21.15.144:0/3478232717 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffaa00b7750 0x7ffaa0155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.076+0000 7ffa9fe00640 1 -- 172.21.15.144:0/3478232717 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffaa015e640 msgr2=0x7ffaa015d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:01.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.076+0000 7ffa9fe00640 1 --2- 172.21.15.144:0/3478232717 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffaa015e640 0x7ffaa015d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.076+0000 7ffa9fe00640 1 -- 172.21.15.144:0/3478232717 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa01e7000 con 0x7ffaa00b5fd0 2024-09-11T23:24:01.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.076+0000 7ffa9f400640 1 --2- 172.21.15.144:0/3478232717 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffaa00b7750 0x7ffaa0155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:01.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.076+0000 7ffa9fe00640 1 --2- 172.21.15.144:0/3478232717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaa00b5fd0 0x7ffaa01f4c70 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000c430 tx=0x7ffa9000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:01.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.077+0000 7ffa97e00640 1 -- 172.21.15.144:0/3478232717 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa900074e0 con 0x7ffaa00b5fd0 2024-09-11T23:24:01.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.077+0000 7ffa97e00640 1 -- 172.21.15.144:0/3478232717 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa900047e0 con 0x7ffaa00b5fd0 2024-09-11T23:24:01.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.077+0000 7ffa97e00640 1 -- 172.21.15.144:0/3478232717 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90004bd0 con 0x7ffaa00b5fd0 2024-09-11T23:24:01.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.077+0000 7ffaa5400640 1 -- 172.21.15.144:0/3478232717 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa01e72e0 con 0x7ffaa00b5fd0 2024-09-11T23:24:01.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.077+0000 7ffaa5400640 1 -- 172.21.15.144:0/3478232717 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa01e78a0 con 0x7ffaa00b5fd0 2024-09-11T23:24:01.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.078+0000 7ffaa5400640 1 -- 172.21.15.144:0/3478232717 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa00cae00 con 0x7ffaa00b5fd0 2024-09-11T23:24:01.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.079+0000 7ffa97e00640 1 -- 172.21.15.144:0/3478232717 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7ffa90011070 con 0x7ffaa00b5fd0 2024-09-11T23:24:01.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.080+0000 7ffa97e00640 1 --2- 172.21.15.144:0/3478232717 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ffa8006c220 0x7ffa8006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:01.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.080+0000 7ffa97e00640 1 -- 172.21.15.144:0/3478232717 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4857+0+0 (secure 0 0 0) 0x7ffa9008ae20 con 0x7ffaa00b5fd0 2024-09-11T23:24:01.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.080+0000 7ffa9f400640 1 --2- 172.21.15.144:0/3478232717 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ffa8006c220 0x7ffa8006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:01.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.080+0000 7ffa9f400640 1 --2- 172.21.15.144:0/3478232717 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ffa8006c220 0x7ffa8006e6e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c034000 tx=0x7ffa8c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:01.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.084+0000 7ffa97e00640 1 -- 172.21.15.144:0/3478232717 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffaa00cae00 con 0x7ffaa00b5fd0 2024-09-11T23:24:01.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.325+0000 7ffaa5400640 1 -- 172.21.15.144:0/3478232717 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ffaa00b6410 con 0x7ffaa00b5fd0 2024-09-11T23:24:01.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.326+0000 7ffa97e00640 1 -- 172.21.15.144:0/3478232717 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7ffa90059610 con 0x7ffaa00b5fd0 2024-09-11T23:24:01.327 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:01.328 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:24:01.328 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-11T23:24:01.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:01.328 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-11T23:24:01.328 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmQjymBhAA4BWEVNGY37RsnMGLL3Ow8A==", 2024-09-11T23:24:01.329 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:01.329 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:24:01.329 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:24:01.329 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:24:01.329 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:01.329 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:01.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:01.330 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-11T23:24:01.330 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmD0mIGhAAvug7T/kOcEmnyMyG++V+zA==", 2024-09-11T23:24:01.330 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:01.330 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:24:01.331 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:24:01.331 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:24:01.331 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:01.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:01.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:01.332 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-11T23:24:01.332 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmDwSZEBAAdf4eF3MrADSPzBTICzpOiA==", 2024-09-11T23:24:01.332 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:01.332 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:24:01.332 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:24:01.333 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:24:01.333 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:01.333 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:01.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:01.333 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-11T23:24:01.334 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmqYtRJBAAgpzvHNUPVnxNoflhqVIJuQ==", 2024-09-11T23:24:01.334 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:01.334 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:24:01.334 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:24:01.334 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:24:01.334 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:01.335 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:01.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:01.335 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-11T23:24:01.335 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDiJOJmzDABABAA+Qa772+Mm69pecG0QUXlyA==", 2024-09-11T23:24:01.335 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:01.335 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:24:01.336 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:24:01.336 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:01.336 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:01.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:01.336 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-11T23:24:01.336 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDlJOJmgVjJKRAAtl30JxJHurKdrn1vLUneww==", 2024-09-11T23:24:01.336 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:01.336 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:24:01.336 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:24:01.336 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:01.337 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:01.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:01.337 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-11T23:24:01.337 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDpJOJmRzO6FxAAiLDOwDlXYTj6WfEhlI+uVQ==", 2024-09-11T23:24:01.337 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:01.337 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:24:01.337 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:24:01.338 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:01.338 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:01.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:01.338 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-11T23:24:01.338 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDtJOJmVFh6EhAA7hcJn4k31nEPMcqiB7+djA==", 2024-09-11T23:24:01.338 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:01.338 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:24:01.338 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:24:01.338 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:01.338 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:01.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:01.338 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-11T23:24:01.339 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD0JOJmpIFTAhAAYQyoBrMjL6CcDDCNAOMGwQ==", 2024-09-11T23:24:01.339 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:01.339 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:24:01.339 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:24:01.339 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:01.339 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:01.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:01.339 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-11T23:24:01.339 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD4JOJmBAIIDhAA8G/usUslfQPNpFP1YZsgmg==", 2024-09-11T23:24:01.339 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:01.339 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:24:01.339 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:24:01.340 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:01.340 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:01.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:01.340 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-11T23:24:01.340 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD8JOJmDl2dCBAA5bL+2AIp0uWL4qjpI/mAdQ==", 2024-09-11T23:24:01.340 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:01.340 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:24:01.340 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:24:01.340 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:01.340 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:01.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:01.341 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-11T23:24:01.341 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAAJeJmMWX+AhAA7ABVgJPwhRZNkPNdZzmnOQ==", 2024-09-11T23:24:01.341 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:01.341 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:24:01.341 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:24:01.341 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:01.341 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:01.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:01.341 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-11T23:24:01.341 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A==", 2024-09-11T23:24:01.341 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:01.341 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:24:01.341 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-11T23:24:01.341 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T23:24:01.342 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:01.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:01.342 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-11T23:24:01.342 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmLFrBORAAT64lj0sWlVoTHVUZQf0JjA==", 2024-09-11T23:24:01.342 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:01.342 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:24:01.342 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:24:01.342 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:24:01.342 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:24:01.342 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:01.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:01.342 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-11T23:24:01.343 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJm2/dLMxAAbuKdVAbscrlF5jcBnouBOQ==", 2024-09-11T23:24:01.343 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:01.343 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:24:01.343 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:24:01.343 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:24:01.343 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:24:01.343 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:01.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:01.343 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-11T23:24:01.343 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDfJOJmse6UBBAAq+3afsp+2jApe9sTFmVVOw==", 2024-09-11T23:24:01.343 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:01.343 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:24:01.343 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:24:01.344 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:24:01.344 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:24:01.344 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:01.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:01.344 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-11T23:24:01.344 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmHmAwEhAAEGCvu0NgtyjIPcJBk6bkdA==", 2024-09-11T23:24:01.344 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:01.344 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:24:01.344 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:24:01.344 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:24:01.344 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:01.344 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:01.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:01.345 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-11T23:24:01.345 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmxMaVOxAA62zJwlyk0qdrsemalijH4Q==", 2024-09-11T23:24:01.345 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:01.345 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:24:01.345 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:24:01.345 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:01.345 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:01.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:01.345 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-11T23:24:01.346 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmWZRNNBAAwZ2GCP7mGn87ZSnsKCcDRQ==", 2024-09-11T23:24:01.346 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:01.346 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:24:01.346 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:24:01.346 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:01.346 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.346 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.346 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:24:01.346 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:24:01.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.328+0000 7ffaa5400640 1 -- 172.21.15.144:0/3478232717 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ffa8006c220 msgr2=0x7ffa8006e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:01.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.328+0000 7ffaa5400640 1 --2- 172.21.15.144:0/3478232717 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ffa8006c220 0x7ffa8006e6e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c034000 tx=0x7ffa8c02e000 comp rx=0 tx=0).stop 2024-09-11T23:24:01.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.328+0000 7ffaa5400640 1 -- 172.21.15.144:0/3478232717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaa00b5fd0 msgr2=0x7ffaa01f4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:01.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.328+0000 7ffaa5400640 1 --2- 172.21.15.144:0/3478232717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaa00b5fd0 0x7ffaa01f4c70 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000c430 tx=0x7ffa9000c8f0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.328+0000 7ffaa5400640 1 -- 172.21.15.144:0/3478232717 shutdown_connections 2024-09-11T23:24:01.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.328+0000 7ffaa5400640 1 --2- 172.21.15.144:0/3478232717 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ffa8006c220 0x7ffa8006e6e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.328+0000 7ffaa5400640 1 --2- 172.21.15.144:0/3478232717 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffaa015e640 0x7ffaa015d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.328+0000 7ffaa5400640 1 --2- 172.21.15.144:0/3478232717 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffaa00b7750 0x7ffaa0155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.328+0000 7ffaa5400640 1 --2- 172.21.15.144:0/3478232717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffaa00b5fd0 0x7ffaa01f4c70 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.328+0000 7ffaa5400640 1 -- 172.21.15.144:0/3478232717 >> 172.21.15.144:0/3478232717 conn(0x7ffaa00d0fd0 msgr2=0x7ffaa00d3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:01.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.329+0000 7ffaa5400640 1 -- 172.21.15.144:0/3478232717 shutdown_connections 2024-09-11T23:24:01.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.329+0000 7ffaa5400640 1 -- 172.21.15.144:0/3478232717 wait complete. 2024-09-11T23:24:01.349 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:24:01.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.505+0000 7fd797200640 1 Processor -- start 2024-09-11T23:24:01.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.506+0000 7fd797200640 1 -- start start 2024-09-11T23:24:01.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.507+0000 7fd797200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd79015ca40 0x7fd79015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:01.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.507+0000 7fd797200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd79015d390 con 0x7fd79015ceb0 2024-09-11T23:24:01.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.507+0000 7fd797200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd79015d670 con 0x7fd7900d02a0 2024-09-11T23:24:01.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.507+0000 7fd797200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd79015d950 con 0x7fd79015ca40 2024-09-11T23:24:01.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.507+0000 7fd78f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd79015ca40 0x7fd79015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:01.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.507+0000 7fd78f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd79015ca40 0x7fd79015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56258/0 (socket says 172.21.15.144:56258) 2024-09-11T23:24:01.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.507+0000 7fd78f400640 1 -- 172.21.15.144:0/556185717 learned_addr learned my addr 172.21.15.144:0/556185717 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:01.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.507+0000 7fd78f400640 1 -- 172.21.15.144:0/556185717 >> v1:172.21.15.165:6789/0 conn(0x7fd7900d02a0 legacy=0x7fd7900d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:01.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.507+0000 7fd78f400640 1 -- 172.21.15.144:0/556185717 >> v1:172.21.15.144:6789/0 conn(0x7fd79015ceb0 legacy=0x7fd7901594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:01.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.507+0000 7fd78f400640 1 -- 172.21.15.144:0/556185717 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79015dc30 con 0x7fd79015ca40 2024-09-11T23:24:01.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.508+0000 7fd78f400640 1 --2- 172.21.15.144:0/556185717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79015ca40 0x7fd79015e430 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009870 tx=0x7fd77c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2871958d505d0e8a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:01.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.509+0000 7fd78ea00640 1 -- 172.21.15.144:0/556185717 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c037070 con 0x7fd79015ca40 2024-09-11T23:24:01.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.509+0000 7fd78ea00640 1 -- 172.21.15.144:0/556185717 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77c032440 con 0x7fd79015ca40 2024-09-11T23:24:01.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.509+0000 7fd78ea00640 1 -- 172.21.15.144:0/556185717 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c032810 con 0x7fd79015ca40 2024-09-11T23:24:01.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.509+0000 7fd797200640 1 -- 172.21.15.144:0/556185717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79015ca40 msgr2=0x7fd79015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:01.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.509+0000 7fd797200640 1 --2- 172.21.15.144:0/556185717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79015ca40 0x7fd79015e430 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009870 tx=0x7fd77c02a270 comp rx=0 tx=0).stop 2024-09-11T23:24:01.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.509+0000 7fd797200640 1 -- 172.21.15.144:0/556185717 shutdown_connections 2024-09-11T23:24:01.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.509+0000 7fd797200640 1 --2- 172.21.15.144:0/556185717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79015ca40 0x7fd79015e430 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.509+0000 7fd797200640 1 -- 172.21.15.144:0/556185717 >> 172.21.15.144:0/556185717 conn(0x7fd790062cc0 msgr2=0x7fd79006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:01.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.509+0000 7fd797200640 1 -- 172.21.15.144:0/556185717 shutdown_connections 2024-09-11T23:24:01.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.510+0000 7fd797200640 1 -- 172.21.15.144:0/556185717 wait complete. 2024-09-11T23:24:01.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.511+0000 7fd797200640 1 Processor -- start 2024-09-11T23:24:01.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.511+0000 7fd797200640 1 -- start start 2024-09-11T23:24:01.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.512+0000 7fd797200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7900d02a0 0x7fd79014cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:01.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.512+0000 7fd797200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79015ca40 0x7fd790153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:01.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.512+0000 7fd797200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd79015ceb0 0x7fd7901f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:01.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.512+0000 7fd797200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd790155d10 con 0x7fd79015ca40 2024-09-11T23:24:01.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.512+0000 7fd797200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd790155b90 con 0x7fd7900d02a0 2024-09-11T23:24:01.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.512+0000 7fd797200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd7900b4790 con 0x7fd79015ceb0 2024-09-11T23:24:01.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.512+0000 7fd78f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79015ca40 0x7fd790153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:01.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.512+0000 7fd78f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79015ca40 0x7fd790153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56270/0 (socket says 172.21.15.144:56270) 2024-09-11T23:24:01.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.512+0000 7fd78f400640 1 -- 172.21.15.144:0/1298848182 learned_addr learned my addr 172.21.15.144:0/1298848182 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:01.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.512+0000 7fd78fe00640 1 --2- 172.21.15.144:0/1298848182 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7900d02a0 0x7fd79014cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:01.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.512+0000 7fd795200640 1 --2- 172.21.15.144:0/1298848182 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd79015ceb0 0x7fd7901f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:01.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.513+0000 7fd78f400640 1 -- 172.21.15.144:0/1298848182 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd79015ceb0 msgr2=0x7fd7901f45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:01.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.513+0000 7fd78f400640 1 --2- 172.21.15.144:0/1298848182 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd79015ceb0 0x7fd7901f45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.513+0000 7fd78f400640 1 -- 172.21.15.144:0/1298848182 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7900d02a0 msgr2=0x7fd79014cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:01.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.513+0000 7fd78f400640 1 --2- 172.21.15.144:0/1298848182 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7900d02a0 0x7fd79014cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.513+0000 7fd78f400640 1 -- 172.21.15.144:0/1298848182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7900721f0 con 0x7fd79015ca40 2024-09-11T23:24:01.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.513+0000 7fd78f400640 1 --2- 172.21.15.144:0/1298848182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79015ca40 0x7fd790153870 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fd77c000c00 tx=0x7fd77c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:01.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.513+0000 7fd787e00640 1 -- 172.21.15.144:0/1298848182 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c037040 con 0x7fd79015ca40 2024-09-11T23:24:01.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.513+0000 7fd787e00640 1 -- 172.21.15.144:0/1298848182 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77c042070 con 0x7fd79015ca40 2024-09-11T23:24:01.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.513+0000 7fd797200640 1 -- 172.21.15.144:0/1298848182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7900724d0 con 0x7fd79015ca40 2024-09-11T23:24:01.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.513+0000 7fd787e00640 1 -- 172.21.15.144:0/1298848182 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c030bd0 con 0x7fd79015ca40 2024-09-11T23:24:01.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.513+0000 7fd797200640 1 -- 172.21.15.144:0/1298848182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd790072a90 con 0x7fd79015ca40 2024-09-11T23:24:01.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.515+0000 7fd797200640 1 -- 172.21.15.144:0/1298848182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7900d0680 con 0x7fd79015ca40 2024-09-11T23:24:01.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.515+0000 7fd787e00640 1 -- 172.21.15.144:0/1298848182 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7fd77c047460 con 0x7fd79015ca40 2024-09-11T23:24:01.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.517+0000 7fd787e00640 1 --2- 172.21.15.144:0/1298848182 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd77006c220 0x7fd77006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:01.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.517+0000 7fd787e00640 1 -- 172.21.15.144:0/1298848182 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4857+0+0 (secure 0 0 0) 0x7fd77c0abcf0 con 0x7fd79015ca40 2024-09-11T23:24:01.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.517+0000 7fd78fe00640 1 --2- 172.21.15.144:0/1298848182 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd77006c220 0x7fd77006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:01.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.518+0000 7fd78fe00640 1 --2- 172.21.15.144:0/1298848182 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd77006c220 0x7fd77006e6e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd7900d0be0 tx=0x7fd780009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:01.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.521+0000 7fd787e00640 1 -- 172.21.15.144:0/1298848182 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd77c045360 con 0x7fd79015ca40 2024-09-11T23:24:01.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.697+0000 7fd797200640 1 -- 172.21.15.144:0/1298848182 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd790153f30 con 0x7fd79015ca40 2024-09-11T23:24:01.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.698+0000 7fd787e00640 1 -- 172.21.15.144:0/1298848182 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v112) ==== 84+0+65 (secure 0 0 0) 0x7fd77c07a5b0 con 0x7fd79015ca40 2024-09-11T23:24:01.699 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:01.699 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:24:01.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:01.699 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-11T23:24:01.699 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-11T23:24:01.699 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:01.699 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:24:01.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.700+0000 7fd797200640 1 -- 172.21.15.144:0/1298848182 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd77006c220 msgr2=0x7fd77006e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:01.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.700+0000 7fd797200640 1 --2- 172.21.15.144:0/1298848182 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd77006c220 0x7fd77006e6e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd7900d0be0 tx=0x7fd780009040 comp rx=0 tx=0).stop 2024-09-11T23:24:01.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.700+0000 7fd797200640 1 -- 172.21.15.144:0/1298848182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79015ca40 msgr2=0x7fd790153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:01.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.700+0000 7fd797200640 1 --2- 172.21.15.144:0/1298848182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79015ca40 0x7fd790153870 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fd77c000c00 tx=0x7fd77c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.700+0000 7fd797200640 1 -- 172.21.15.144:0/1298848182 shutdown_connections 2024-09-11T23:24:01.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.700+0000 7fd797200640 1 --2- 172.21.15.144:0/1298848182 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd77006c220 0x7fd77006e6e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.700+0000 7fd797200640 1 --2- 172.21.15.144:0/1298848182 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd79015ceb0 0x7fd7901f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.700+0000 7fd797200640 1 --2- 172.21.15.144:0/1298848182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd79015ca40 0x7fd790153870 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.700+0000 7fd797200640 1 --2- 172.21.15.144:0/1298848182 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7900d02a0 0x7fd79014cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.700+0000 7fd797200640 1 -- 172.21.15.144:0/1298848182 >> 172.21.15.144:0/1298848182 conn(0x7fd790062cc0 msgr2=0x7fd79015b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:01.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.701+0000 7fd797200640 1 -- 172.21.15.144:0/1298848182 shutdown_connections 2024-09-11T23:24:01.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.701+0000 7fd797200640 1 -- 172.21.15.144:0/1298848182 wait complete. 2024-09-11T23:24:01.717 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:24:01.718 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:24:01.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.876+0000 7f72cca00640 1 Processor -- start 2024-09-11T23:24:01.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.877+0000 7f72cca00640 1 -- start start 2024-09-11T23:24:01.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.878+0000 7f72cca00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f72c80cf5d0 0x7f72c80cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:01.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.878+0000 7f72cca00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72c80b4240 con 0x7f72c806d4f0 2024-09-11T23:24:01.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.878+0000 7f72cca00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72c80b4520 con 0x7f72c8145d90 2024-09-11T23:24:01.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.878+0000 7f72cca00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f72c806d080 con 0x7f72c80cf5d0 2024-09-11T23:24:01.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.878+0000 7f72c6800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f72c806d4f0 0x7f72c806d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37502/0 (socket says 172.21.15.144:37502) 2024-09-11T23:24:01.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.878+0000 7f72c6800640 1 -- 172.21.15.144:0/99328021 learned_addr learned my addr 172.21.15.144:0/99328021 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:01.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.878+0000 7f72bd400640 1 --2- 172.21.15.144:0/99328021 >> v2:172.21.15.165:3300/0 conn(0x7f72c80cf5d0 0x7f72c80cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:01.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.879+0000 7f72c5400640 1 -- 172.21.15.144:0/99328021 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1681650447 0 0) 0x7f72c80b4240 con 0x7f72c806d4f0 2024-09-11T23:24:01.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.879+0000 7f72c5400640 1 -- 172.21.15.144:0/99328021 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72ac003520 con 0x7f72c806d4f0 2024-09-11T23:24:01.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.879+0000 7f72bd400640 1 -- 172.21.15.144:0/99328021 >> v1:172.21.15.165:6789/0 conn(0x7f72c8145d90 legacy=0x7f72c80ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:01.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.879+0000 7f72bd400640 1 -- 172.21.15.144:0/99328021 >> v1:172.21.15.144:6789/0 conn(0x7f72c806d4f0 legacy=0x7f72c806d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:01.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.879+0000 7f72bd400640 1 -- 172.21.15.144:0/99328021 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c80b4800 con 0x7f72c80cf5d0 2024-09-11T23:24:01.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.880+0000 7f72bd400640 1 --2- 172.21.15.144:0/99328021 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72c80cf5d0 0x7f72c80cfa40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f72b00097a0 tx=0x7f72b002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ff9eb4e21a99fd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:01.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.880+0000 7f72c5400640 1 -- 172.21.15.144:0/99328021 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0037070 con 0x7f72c80cf5d0 2024-09-11T23:24:01.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.880+0000 7f72c5400640 1 -- 172.21.15.144:0/99328021 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b0032440 con 0x7f72c80cf5d0 2024-09-11T23:24:01.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.880+0000 7f72c5400640 1 -- 172.21.15.144:0/99328021 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0032810 con 0x7f72c80cf5d0 2024-09-11T23:24:01.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.881+0000 7f72cca00640 1 -- 172.21.15.144:0/99328021 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72c80cf5d0 msgr2=0x7f72c80cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:01.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.881+0000 7f72cca00640 1 --2- 172.21.15.144:0/99328021 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72c80cf5d0 0x7f72c80cfa40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f72b00097a0 tx=0x7f72b002a230 comp rx=0 tx=0).stop 2024-09-11T23:24:01.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.881+0000 7f72cca00640 1 -- 172.21.15.144:0/99328021 shutdown_connections 2024-09-11T23:24:01.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.881+0000 7f72cca00640 1 --2- 172.21.15.144:0/99328021 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72c80cf5d0 0x7f72c80cfa40 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.881+0000 7f72cca00640 1 -- 172.21.15.144:0/99328021 >> 172.21.15.144:0/99328021 conn(0x7f72c806bba0 msgr2=0x7f72c806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:01.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.881+0000 7f72cca00640 1 -- 172.21.15.144:0/99328021 shutdown_connections 2024-09-11T23:24:01.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.881+0000 7f72cca00640 1 -- 172.21.15.144:0/99328021 wait complete. 2024-09-11T23:24:01.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.883+0000 7f72cca00640 1 Processor -- start 2024-09-11T23:24:01.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.883+0000 7f72cca00640 1 -- start start 2024-09-11T23:24:01.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.884+0000 7f72cca00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72c806d4f0 0x7f72c81f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:01.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.884+0000 7f72cca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72c80cf5d0 0x7f72c806dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:01.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.884+0000 7f72cca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72c8145d90 0x7f72c813bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:01.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.884+0000 7f72cca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f72c80cd660 con 0x7f72c8145d90 2024-09-11T23:24:01.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.884+0000 7f72cca00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f72c80cff80 con 0x7f72c806d4f0 2024-09-11T23:24:01.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.884+0000 7f72cca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f72c80b5610 con 0x7f72c80cf5d0 2024-09-11T23:24:01.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.884+0000 7f72c6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72c8145d90 0x7f72c813bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:01.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.884+0000 7f72c6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72c8145d90 0x7f72c813bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56276/0 (socket says 172.21.15.144:56276) 2024-09-11T23:24:01.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.884+0000 7f72c6800640 1 -- 172.21.15.144:0/1716890381 learned_addr learned my addr 172.21.15.144:0/1716890381 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:01.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.884+0000 7f72bd400640 1 --2- 172.21.15.144:0/1716890381 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72c80cf5d0 0x7f72c806dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:01.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.884+0000 7f72c5e00640 1 --2- 172.21.15.144:0/1716890381 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72c806d4f0 0x7f72c81f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:01.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.884+0000 7f72c6800640 1 -- 172.21.15.144:0/1716890381 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72c80cf5d0 msgr2=0x7f72c806dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:01.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.884+0000 7f72c6800640 1 --2- 172.21.15.144:0/1716890381 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72c80cf5d0 0x7f72c806dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.884+0000 7f72c6800640 1 -- 172.21.15.144:0/1716890381 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72c806d4f0 msgr2=0x7f72c81f2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:01.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.884+0000 7f72c6800640 1 --2- 172.21.15.144:0/1716890381 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72c806d4f0 0x7f72c81f2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:01.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.884+0000 7f72c6800640 1 -- 172.21.15.144:0/1716890381 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c813d930 con 0x7f72c8145d90 2024-09-11T23:24:01.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.885+0000 7f72c6800640 1 --2- 172.21.15.144:0/1716890381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72c8145d90 0x7f72c813bf10 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f72c000ca20 tx=0x7f72c000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:01.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.885+0000 7f72bea00640 1 -- 172.21.15.144:0/1716890381 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0017070 con 0x7f72c8145d90 2024-09-11T23:24:01.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.885+0000 7f72bea00640 1 -- 172.21.15.144:0/1716890381 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c000abd0 con 0x7f72c8145d90 2024-09-11T23:24:01.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.885+0000 7f72cca00640 1 -- 172.21.15.144:0/1716890381 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c813d090 con 0x7f72c8145d90 2024-09-11T23:24:01.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.885+0000 7f72bea00640 1 -- 172.21.15.144:0/1716890381 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0012400 con 0x7f72c8145d90 2024-09-11T23:24:01.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.885+0000 7f72cca00640 1 -- 172.21.15.144:0/1716890381 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c813d650 con 0x7f72c8145d90 2024-09-11T23:24:01.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.886+0000 7f72cca00640 1 -- 172.21.15.144:0/1716890381 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c80ce910 con 0x7f72c8145d90 2024-09-11T23:24:01.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.887+0000 7f72bea00640 1 -- 172.21.15.144:0/1716890381 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f72c001a070 con 0x7f72c8145d90 2024-09-11T23:24:01.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.888+0000 7f72bea00640 1 --2- 172.21.15.144:0/1716890381 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f72a406c220 0x7f72a406e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:01.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.888+0000 7f72bea00640 1 -- 172.21.15.144:0/1716890381 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 4857+0+0 (secure 0 0 0) 0x7f72c008aed0 con 0x7f72c8145d90 2024-09-11T23:24:01.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.889+0000 7f72c5e00640 1 --2- 172.21.15.144:0/1716890381 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f72a406c220 0x7f72a406e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:01.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.889+0000 7f72c5e00640 1 --2- 172.21.15.144:0/1716890381 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f72a406c220 0x7f72a406e6e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f72b8000f60 tx=0x7f72b8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:01.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:01.892+0000 7f72bea00640 1 -- 172.21.15.144:0/1716890381 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72c80ce910 con 0x7f72c8145d90 2024-09-11T23:24:02.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:02.067+0000 7f72cca00640 1 -- 172.21.15.144:0/1716890381 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f72c8146170 con 0x7f72c8145d90 2024-09-11T23:24:02.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:02.909+0000 7f72bea00640 1 -- 172.21.15.144:0/1716890381 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v113) ==== 138+0+0 (secure 0 0 0) 0x7f72c813d930 con 0x7f72c8145d90 2024-09-11T23:24:02.910 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-11T23:24:02.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:02.911+0000 7f72cca00640 1 -- 172.21.15.144:0/1716890381 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f72a406c220 msgr2=0x7f72a406e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:02.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:02.912+0000 7f72cca00640 1 --2- 172.21.15.144:0/1716890381 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f72a406c220 0x7f72a406e6e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f72b8000f60 tx=0x7f72b8009040 comp rx=0 tx=0).stop 2024-09-11T23:24:02.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:02.912+0000 7f72cca00640 1 -- 172.21.15.144:0/1716890381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72c8145d90 msgr2=0x7f72c813bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:02.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:02.912+0000 7f72cca00640 1 --2- 172.21.15.144:0/1716890381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72c8145d90 0x7f72c813bf10 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f72c000ca20 tx=0x7f72c000cee0 comp rx=0 tx=0).stop 2024-09-11T23:24:02.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:02.912+0000 7f72cca00640 1 -- 172.21.15.144:0/1716890381 shutdown_connections 2024-09-11T23:24:02.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:02.912+0000 7f72cca00640 1 --2- 172.21.15.144:0/1716890381 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f72a406c220 0x7f72a406e6e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:02.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:02.912+0000 7f72cca00640 1 --2- 172.21.15.144:0/1716890381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72c8145d90 0x7f72c813bf10 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:02.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:02.912+0000 7f72cca00640 1 --2- 172.21.15.144:0/1716890381 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f72c80cf5d0 0x7f72c806dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:02.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:02.912+0000 7f72cca00640 1 --2- 172.21.15.144:0/1716890381 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72c806d4f0 0x7f72c81f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:02.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:02.912+0000 7f72cca00640 1 -- 172.21.15.144:0/1716890381 >> 172.21.15.144:0/1716890381 conn(0x7f72c806bba0 msgr2=0x7f72c806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:02.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:02.912+0000 7f72cca00640 1 -- 172.21.15.144:0/1716890381 shutdown_connections 2024-09-11T23:24:02.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:02.912+0000 7f72cca00640 1 -- 172.21.15.144:0/1716890381 wait complete. 2024-09-11T23:24:02.935 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:24:03.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.097+0000 7f6d1b200640 1 Processor -- start 2024-09-11T23:24:03.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.098+0000 7f6d1b200640 1 -- start start 2024-09-11T23:24:03.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.099+0000 7f6d1b200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d1c15f0d0 0x7f6d1c15f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:03.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.099+0000 7f6d1b200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6d1c06d890 0x7f6d1c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:03.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.099+0000 7f6d1b200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d1c162440 con 0x7f6d1c070710 2024-09-11T23:24:03.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.099+0000 7f6d1b200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6d1c06d400 con 0x7f6d1c15f0d0 2024-09-11T23:24:03.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.099+0000 7f6d1b200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6d1c162720 con 0x7f6d1c06d890 2024-09-11T23:24:03.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.099+0000 7f6d11400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d1c15f0d0 0x7f6d1c15f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:03.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.099+0000 7f6d11400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d1c15f0d0 0x7f6d1c15f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56290/0 (socket says 172.21.15.144:56290) 2024-09-11T23:24:03.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.099+0000 7f6d11400640 1 -- 172.21.15.144:0/1527886530 learned_addr learned my addr 172.21.15.144:0/1527886530 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:03.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.099+0000 7f6d1a800640 1 --2- 172.21.15.144:0/1527886530 >> v2:172.21.15.165:3300/0 conn(0x7f6d1c06d890 0x7f6d1c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:03.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.100+0000 7f6d11400640 1 -- 172.21.15.144:0/1527886530 >> v2:172.21.15.165:3300/0 conn(0x7f6d1c06d890 msgr2=0x7f6d1c06dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:03.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.100+0000 7f6d11400640 1 --2- 172.21.15.144:0/1527886530 >> v2:172.21.15.165:3300/0 conn(0x7f6d1c06d890 0x7f6d1c06dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:03.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.100+0000 7f6d11400640 1 -- 172.21.15.144:0/1527886530 >> v1:172.21.15.165:6789/0 conn(0x7f6d1c070710 legacy=0x7f6d1c070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:03.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.100+0000 7f6d11400640 1 -- 172.21.15.144:0/1527886530 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1c162a00 con 0x7f6d1c15f0d0 2024-09-11T23:24:03.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.101+0000 7f6d11400640 1 --2- 172.21.15.144:0/1527886530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c15f0d0 0x7f6d1c15f530 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c072c30 tx=0x7f6d0402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312f6dc3fce1bc68 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:03.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.101+0000 7f6d19400640 1 -- 172.21.15.144:0/1527886530 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04037070 con 0x7f6d1c15f0d0 2024-09-11T23:24:03.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.101+0000 7f6d19400640 1 -- 172.21.15.144:0/1527886530 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d04032440 con 0x7f6d1c15f0d0 2024-09-11T23:24:03.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.101+0000 7f6d19400640 1 -- 172.21.15.144:0/1527886530 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04032810 con 0x7f6d1c15f0d0 2024-09-11T23:24:03.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.101+0000 7f6d1b200640 1 -- 172.21.15.144:0/1527886530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c15f0d0 msgr2=0x7f6d1c15f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:03.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.101+0000 7f6d1b200640 1 --2- 172.21.15.144:0/1527886530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c15f0d0 0x7f6d1c15f530 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c072c30 tx=0x7f6d0402a2c0 comp rx=0 tx=0).stop 2024-09-11T23:24:03.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.102+0000 7f6d1b200640 1 -- 172.21.15.144:0/1527886530 shutdown_connections 2024-09-11T23:24:03.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.102+0000 7f6d1b200640 1 --2- 172.21.15.144:0/1527886530 >> v2:172.21.15.165:3300/0 conn(0x7f6d1c06d890 0x7f6d1c06dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:03.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.102+0000 7f6d1b200640 1 --2- 172.21.15.144:0/1527886530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c15f0d0 0x7f6d1c15f530 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:03.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.102+0000 7f6d1b200640 1 -- 172.21.15.144:0/1527886530 >> 172.21.15.144:0/1527886530 conn(0x7f6d1c0b40d0 msgr2=0x7f6d1c0b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:03.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.102+0000 7f6d1b200640 1 -- 172.21.15.144:0/1527886530 shutdown_connections 2024-09-11T23:24:03.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.102+0000 7f6d1b200640 1 -- 172.21.15.144:0/1527886530 wait complete. 2024-09-11T23:24:03.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.103+0000 7f6d1b200640 1 Processor -- start 2024-09-11T23:24:03.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.104+0000 7f6d1b200640 1 -- start start 2024-09-11T23:24:03.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.104+0000 7f6d1b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d1c06d890 0x7f6d1c0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:03.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.104+0000 7f6d1b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c070710 0x7f6d1c157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:03.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.104+0000 7f6d1b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d1c15f0d0 0x7f6d1c1e7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:03.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.104+0000 7f6d1b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c0b6250 con 0x7f6d1c070710 2024-09-11T23:24:03.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.104+0000 7f6d1b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c0b60d0 con 0x7f6d1c06d890 2024-09-11T23:24:03.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.104+0000 7f6d1b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6d1c161ff0 con 0x7f6d1c15f0d0 2024-09-11T23:24:03.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.105+0000 7f6d11400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c070710 0x7f6d1c157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:03.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.105+0000 7f6d11400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c070710 0x7f6d1c157f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56294/0 (socket says 172.21.15.144:56294) 2024-09-11T23:24:03.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.105+0000 7f6d11400640 1 -- 172.21.15.144:0/2295796823 learned_addr learned my addr 172.21.15.144:0/2295796823 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:03.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.105+0000 7f6d19e00640 1 --2- 172.21.15.144:0/2295796823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d1c06d890 0x7f6d1c0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:03.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.105+0000 7f6d1a800640 1 --2- 172.21.15.144:0/2295796823 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d1c15f0d0 0x7f6d1c1e7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:03.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.105+0000 7f6d11400640 1 -- 172.21.15.144:0/2295796823 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d1c15f0d0 msgr2=0x7f6d1c1e7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:03.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.105+0000 7f6d11400640 1 --2- 172.21.15.144:0/2295796823 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d1c15f0d0 0x7f6d1c1e7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:03.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.105+0000 7f6d11400640 1 -- 172.21.15.144:0/2295796823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d1c06d890 msgr2=0x7f6d1c0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:03.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.105+0000 7f6d11400640 1 --2- 172.21.15.144:0/2295796823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d1c06d890 0x7f6d1c0d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:03.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.105+0000 7f6d11400640 1 -- 172.21.15.144:0/2295796823 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1c156e80 con 0x7f6d1c070710 2024-09-11T23:24:03.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.105+0000 7f6d11400640 1 --2- 172.21.15.144:0/2295796823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c070710 0x7f6d1c157f20 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f6d0402a300 tx=0x7f6d040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:03.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.106+0000 7f6d12a00640 1 -- 172.21.15.144:0/2295796823 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04041020 con 0x7f6d1c070710 2024-09-11T23:24:03.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.106+0000 7f6d12a00640 1 -- 172.21.15.144:0/2295796823 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d040306c0 con 0x7f6d1c070710 2024-09-11T23:24:03.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.106+0000 7f6d12a00640 1 -- 172.21.15.144:0/2295796823 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04037040 con 0x7f6d1c070710 2024-09-11T23:24:03.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.106+0000 7f6d1b200640 1 -- 172.21.15.144:0/2295796823 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d1c157160 con 0x7f6d1c070710 2024-09-11T23:24:03.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.106+0000 7f6d1b200640 1 -- 172.21.15.144:0/2295796823 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d1c157720 con 0x7f6d1c070710 2024-09-11T23:24:03.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.107+0000 7f6d1b200640 1 -- 172.21.15.144:0/2295796823 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d1c0b63d0 con 0x7f6d1c070710 2024-09-11T23:24:03.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.108+0000 7f6d12a00640 1 -- 172.21.15.144:0/2295796823 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f6d04044020 con 0x7f6d1c070710 2024-09-11T23:24:03.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.110+0000 7f6d12a00640 1 --2- 172.21.15.144:0/2295796823 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6cf806c220 0x7f6cf806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:03.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.110+0000 7f6d12a00640 1 -- 172.21.15.144:0/2295796823 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5227+0+0 (secure 0 0 0) 0x7f6d040abe80 con 0x7f6d1c070710 2024-09-11T23:24:03.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.110+0000 7f6d19e00640 1 --2- 172.21.15.144:0/2295796823 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6cf806c220 0x7f6cf806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:03.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.111+0000 7f6d19e00640 1 --2- 172.21.15.144:0/2295796823 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6cf806c220 0x7f6cf806e6e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c004ea0 tx=0x7f6d0c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:03.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.114+0000 7f6d12a00640 1 -- 172.21.15.144:0/2295796823 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d1c0b63d0 con 0x7f6d1c070710 2024-09-11T23:24:03.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.288+0000 7f6d1b200640 1 -- 172.21.15.144:0/2295796823 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f6d1c15f530 con 0x7f6d1c070710 2024-09-11T23:24:03.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.912+0000 7f6d12a00640 1 -- 172.21.15.144:0/2295796823 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v114) ==== 170+0+0 (secure 0 0 0) 0x7f6d0404b030 con 0x7f6d1c070710 2024-09-11T23:24:03.913 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-11T23:24:03.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.915+0000 7f6d1b200640 1 -- 172.21.15.144:0/2295796823 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6cf806c220 msgr2=0x7f6cf806e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:03.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.915+0000 7f6d1b200640 1 --2- 172.21.15.144:0/2295796823 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6cf806c220 0x7f6cf806e6e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c004ea0 tx=0x7f6d0c009040 comp rx=0 tx=0).stop 2024-09-11T23:24:03.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.915+0000 7f6d1b200640 1 -- 172.21.15.144:0/2295796823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c070710 msgr2=0x7f6d1c157f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:03.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.915+0000 7f6d1b200640 1 --2- 172.21.15.144:0/2295796823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c070710 0x7f6d1c157f20 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f6d0402a300 tx=0x7f6d040046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:03.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.915+0000 7f6d1b200640 1 -- 172.21.15.144:0/2295796823 shutdown_connections 2024-09-11T23:24:03.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.915+0000 7f6d1b200640 1 --2- 172.21.15.144:0/2295796823 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6cf806c220 0x7f6cf806e6e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:03.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.915+0000 7f6d1b200640 1 --2- 172.21.15.144:0/2295796823 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d1c15f0d0 0x7f6d1c1e7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:03.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.915+0000 7f6d1b200640 1 --2- 172.21.15.144:0/2295796823 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c070710 0x7f6d1c157f20 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:03.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.915+0000 7f6d1b200640 1 --2- 172.21.15.144:0/2295796823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d1c06d890 0x7f6d1c0d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:03.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.915+0000 7f6d1b200640 1 -- 172.21.15.144:0/2295796823 >> 172.21.15.144:0/2295796823 conn(0x7f6d1c0b40d0 msgr2=0x7f6d1c070af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:03.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.915+0000 7f6d1b200640 1 -- 172.21.15.144:0/2295796823 shutdown_connections 2024-09-11T23:24:03.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:03.915+0000 7f6d1b200640 1 -- 172.21.15.144:0/2295796823 wait complete. 2024-09-11T23:24:03.947 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:24:04.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.103+0000 7f4ba2e00640 1 Processor -- start 2024-09-11T23:24:04.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.103+0000 7f4ba2e00640 1 -- start start 2024-09-11T23:24:04.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.105+0000 7f4ba2e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4b9c0b5050 0x7f4b9c15c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:04.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.105+0000 7f4ba2e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b9c0b5500 con 0x7f4b9c06f130 2024-09-11T23:24:04.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.105+0000 7f4ba2e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b9c0b43f0 con 0x7f4b9c158e50 2024-09-11T23:24:04.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.105+0000 7f4ba2e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4b9c0b3630 con 0x7f4b9c0b5050 2024-09-11T23:24:04.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.105+0000 7f4b93400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4b9c06f130 0x7f4b9c0ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37508/0 (socket says 172.21.15.144:37508) 2024-09-11T23:24:04.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.105+0000 7f4b93400640 1 -- 172.21.15.144:0/533704071 learned_addr learned my addr 172.21.15.144:0/533704071 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:04.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.105+0000 7f4ba0e00640 1 --2- 172.21.15.144:0/533704071 >> v2:172.21.15.165:3300/0 conn(0x7f4b9c0b5050 0x7f4b9c15c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:04.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.105+0000 7f4b9b400640 1 -- 172.21.15.144:0/533704071 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 155789406 0 0) 0x7f4b84001290 con 0x7f4b9c06f130 2024-09-11T23:24:04.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.106+0000 7f4b9b400640 1 -- 172.21.15.144:0/533704071 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b80003520 con 0x7f4b9c06f130 2024-09-11T23:24:04.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.106+0000 7f4b9b400640 1 -- 172.21.15.144:0/533704071 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3230151813 0 0) 0x7f4b9c0b43f0 con 0x7f4b9c158e50 2024-09-11T23:24:04.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.106+0000 7f4b9b400640 1 -- 172.21.15.144:0/533704071 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b84001290 con 0x7f4b9c158e50 2024-09-11T23:24:04.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.106+0000 7f4b9b400640 1 -- 172.21.15.144:0/533704071 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1013909337 0 0) 0x7f4b80003520 con 0x7f4b9c06f130 2024-09-11T23:24:04.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.106+0000 7f4ba0e00640 1 -- 172.21.15.144:0/533704071 >> v1:172.21.15.165:6789/0 conn(0x7f4b9c158e50 legacy=0x7f4b9c06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:04.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.106+0000 7f4ba0e00640 1 -- 172.21.15.144:0/533704071 >> v1:172.21.15.144:6789/0 conn(0x7f4b9c06f130 legacy=0x7f4b9c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:04.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.106+0000 7f4ba0e00640 1 -- 172.21.15.144:0/533704071 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9c0b3910 con 0x7f4b9c0b5050 2024-09-11T23:24:04.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.107+0000 7f4ba0e00640 1 --2- 172.21.15.144:0/533704071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b9c0b5050 0x7f4b9c15c370 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009d90 tx=0x7f4b9402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afe6d9e67a3eb1c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:04.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.107+0000 7f4b9b400640 1 -- 172.21.15.144:0/533704071 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b840019c0 con 0x7f4b9c0b5050 2024-09-11T23:24:04.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.107+0000 7f4b9b400640 1 -- 172.21.15.144:0/533704071 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b94007540 con 0x7f4b9c0b5050 2024-09-11T23:24:04.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.107+0000 7f4b9b400640 1 -- 172.21.15.144:0/533704071 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b940078f0 con 0x7f4b9c0b5050 2024-09-11T23:24:04.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.108+0000 7f4ba2e00640 1 -- 172.21.15.144:0/533704071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b9c0b5050 msgr2=0x7f4b9c15c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:04.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.108+0000 7f4ba2e00640 1 --2- 172.21.15.144:0/533704071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b9c0b5050 0x7f4b9c15c370 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009d90 tx=0x7f4b9402a5f0 comp rx=0 tx=0).stop 2024-09-11T23:24:04.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.108+0000 7f4ba2e00640 1 -- 172.21.15.144:0/533704071 shutdown_connections 2024-09-11T23:24:04.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.108+0000 7f4ba2e00640 1 --2- 172.21.15.144:0/533704071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b9c0b5050 0x7f4b9c15c370 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:04.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.108+0000 7f4ba2e00640 1 -- 172.21.15.144:0/533704071 >> 172.21.15.144:0/533704071 conn(0x7f4b9c06bba0 msgr2=0x7f4b9c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:04.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.108+0000 7f4ba2e00640 1 -- 172.21.15.144:0/533704071 shutdown_connections 2024-09-11T23:24:04.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.108+0000 7f4ba2e00640 1 -- 172.21.15.144:0/533704071 wait complete. 2024-09-11T23:24:04.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.109+0000 7f4ba2e00640 1 Processor -- start 2024-09-11T23:24:04.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.110+0000 7f4ba2e00640 1 -- start start 2024-09-11T23:24:04.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.110+0000 7f4ba2e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b9c06f130 0x7f4b9c0aae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:04.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.110+0000 7f4ba2e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b9c0b5050 0x7f4b9c14af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:04.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.110+0000 7f4ba2e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b9c158e50 0x7f4b9c0aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:04.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.110+0000 7f4ba2e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9c159230 con 0x7f4b9c0b5050 2024-09-11T23:24:04.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.110+0000 7f4ba2e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9c0b3ed0 con 0x7f4b9c158e50 2024-09-11T23:24:04.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.110+0000 7f4ba2e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4b9c0ce910 con 0x7f4b9c06f130 2024-09-11T23:24:04.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.111+0000 7f4b93400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b9c0b5050 0x7f4b9c14af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:04.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.111+0000 7f4b93400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b9c0b5050 0x7f4b9c14af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:56308/0 (socket says 172.21.15.144:56308) 2024-09-11T23:24:04.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.111+0000 7f4b93400640 1 -- 172.21.15.144:0/29088198 learned_addr learned my addr 172.21.15.144:0/29088198 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:04.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.111+0000 7f4ba0e00640 1 --2- 172.21.15.144:0/29088198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b9c158e50 0x7f4b9c0aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:04.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.111+0000 7f4b9be00640 1 --2- 172.21.15.144:0/29088198 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b9c06f130 0x7f4b9c0aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:04.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.111+0000 7f4b93400640 1 -- 172.21.15.144:0/29088198 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b9c06f130 msgr2=0x7f4b9c0aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:04.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.111+0000 7f4b93400640 1 --2- 172.21.15.144:0/29088198 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b9c06f130 0x7f4b9c0aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:04.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.111+0000 7f4b93400640 1 -- 172.21.15.144:0/29088198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b9c158e50 msgr2=0x7f4b9c0aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:04.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.111+0000 7f4b93400640 1 --2- 172.21.15.144:0/29088198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b9c158e50 0x7f4b9c0aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:04.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.111+0000 7f4b93400640 1 -- 172.21.15.144:0/29088198 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9c0ab4c0 con 0x7f4b9c0b5050 2024-09-11T23:24:04.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.111+0000 7f4ba0e00640 1 --2- 172.21.15.144:0/29088198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b9c158e50 0x7f4b9c0aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:24:04.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.111+0000 7f4b9be00640 1 --2- 172.21.15.144:0/29088198 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b9c06f130 0x7f4b9c0aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:24:04.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.112+0000 7f4b93400640 1 --2- 172.21.15.144:0/29088198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b9c0b5050 0x7f4b9c14af50 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f4b84001150 tx=0x7f4b8400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:04.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.112+0000 7f4b98c00640 1 -- 172.21.15.144:0/29088198 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b84017070 con 0x7f4b9c0b5050 2024-09-11T23:24:04.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.112+0000 7f4b98c00640 1 -- 172.21.15.144:0/29088198 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b84007480 con 0x7f4b9c0b5050 2024-09-11T23:24:04.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.112+0000 7f4b98c00640 1 -- 172.21.15.144:0/29088198 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b840059e0 con 0x7f4b9c0b5050 2024-09-11T23:24:04.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.112+0000 7f4ba2e00640 1 -- 172.21.15.144:0/29088198 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b9c1e5300 con 0x7f4b9c0b5050 2024-09-11T23:24:04.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.112+0000 7f4ba2e00640 1 -- 172.21.15.144:0/29088198 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b9c1e58c0 con 0x7f4b9c0b5050 2024-09-11T23:24:04.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.113+0000 7f4ba2e00640 1 -- 172.21.15.144:0/29088198 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b9c1e50f0 con 0x7f4b9c0b5050 2024-09-11T23:24:04.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.115+0000 7f4b98c00640 1 -- 172.21.15.144:0/29088198 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f4b8401a070 con 0x7f4b9c0b5050 2024-09-11T23:24:04.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.116+0000 7f4b98c00640 1 --2- 172.21.15.144:0/29088198 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4b7806c220 0x7f4b7806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:04.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.116+0000 7f4b98c00640 1 -- 172.21.15.144:0/29088198 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5609+0+0 (secure 0 0 0) 0x7f4b8408b2f0 con 0x7f4b9c0b5050 2024-09-11T23:24:04.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.117+0000 7f4b9be00640 1 --2- 172.21.15.144:0/29088198 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4b7806c220 0x7f4b7806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:04.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.117+0000 7f4b9be00640 1 --2- 172.21.15.144:0/29088198 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4b7806c220 0x7f4b7806e6e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0011e0 tx=0x7f4b8c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:04.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.120+0000 7f4b98c00640 1 -- 172.21.15.144:0/29088198 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4b9c0b5500 con 0x7f4b9c0b5050 2024-09-11T23:24:04.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.327+0000 7f4ba2e00640 1 -- 172.21.15.144:0/29088198 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4b9c1e85a0 con 0x7f4b9c0b5050 2024-09-11T23:24:04.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.937+0000 7f4b98c00640 1 -- 172.21.15.144:0/29088198 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v77) ==== 174+0+0 (secure 0 0 0) 0x7f4b84059110 con 0x7f4b9c0b5050 2024-09-11T23:24:04.939 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 18 and data pool 19 2024-09-11T23:24:04.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.947+0000 7f4ba2e00640 1 -- 172.21.15.144:0/29088198 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4b7806c220 msgr2=0x7f4b7806e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:04.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.947+0000 7f4ba2e00640 1 --2- 172.21.15.144:0/29088198 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4b7806c220 0x7f4b7806e6e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0011e0 tx=0x7f4b8c009040 comp rx=0 tx=0).stop 2024-09-11T23:24:04.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.947+0000 7f4ba2e00640 1 -- 172.21.15.144:0/29088198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b9c0b5050 msgr2=0x7f4b9c14af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:04.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.947+0000 7f4ba2e00640 1 --2- 172.21.15.144:0/29088198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b9c0b5050 0x7f4b9c14af50 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f4b84001150 tx=0x7f4b8400cbe0 comp rx=0 tx=0).stop 2024-09-11T23:24:04.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.947+0000 7f4ba2e00640 1 -- 172.21.15.144:0/29088198 shutdown_connections 2024-09-11T23:24:04.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.947+0000 7f4ba2e00640 1 --2- 172.21.15.144:0/29088198 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4b7806c220 0x7f4b7806e6e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:04.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.947+0000 7f4ba2e00640 1 --2- 172.21.15.144:0/29088198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b9c158e50 0x7f4b9c0aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:04.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.947+0000 7f4ba2e00640 1 --2- 172.21.15.144:0/29088198 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b9c0b5050 0x7f4b9c14af50 secure :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f4b84001150 tx=0x7f4b8400cbe0 comp rx=0 tx=0).stop 2024-09-11T23:24:04.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.947+0000 7f4ba2e00640 1 --2- 172.21.15.144:0/29088198 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b9c06f130 0x7f4b9c0aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:04.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.947+0000 7f4ba2e00640 1 -- 172.21.15.144:0/29088198 >> 172.21.15.144:0/29088198 conn(0x7f4b9c06bba0 msgr2=0x7f4b9c15e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:04.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.948+0000 7f4ba2e00640 1 -- 172.21.15.144:0/29088198 shutdown_connections 2024-09-11T23:24:04.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:04.949+0000 7f4ba2e00640 1 -- 172.21.15.144:0/29088198 wait complete. 2024-09-11T23:24:04.976 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:24:05.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.129+0000 7fb830e00640 1 Processor -- start 2024-09-11T23:24:05.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.129+0000 7fb830e00640 1 -- start start 2024-09-11T23:24:05.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.130+0000 7fb830e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb82c0b5fd0 0x7fb82c0b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:05.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.130+0000 7fb830e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb82c06bee0 con 0x7fb82c0b7750 2024-09-11T23:24:05.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.130+0000 7fb830e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb82c06c1c0 con 0x7fb82c15e640 2024-09-11T23:24:05.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.130+0000 7fb830e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb82c15ea20 con 0x7fb82c0b5fd0 2024-09-11T23:24:05.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.130+0000 7fb82be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb82c0b7750 0x7fb82c0b7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57502/0 (socket says 172.21.15.144:57502) 2024-09-11T23:24:05.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.130+0000 7fb82be00640 1 -- 172.21.15.144:0/1746699634 learned_addr learned my addr 172.21.15.144:0/1746699634 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:05.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.131+0000 7fb822a00640 1 --2- 172.21.15.144:0/1746699634 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb82c0b5fd0 0x7fb82c0b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:05.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.131+0000 7fb82aa00640 1 -- 172.21.15.144:0/1746699634 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1763436893 0 0) 0x7fb82c06bee0 con 0x7fb82c0b7750 2024-09-11T23:24:05.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.131+0000 7fb82aa00640 1 -- 172.21.15.144:0/1746699634 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb810003520 con 0x7fb82c0b7750 2024-09-11T23:24:05.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.131+0000 7fb82aa00640 1 -- 172.21.15.144:0/1746699634 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2263208648 0 0) 0x7fb82c06c1c0 con 0x7fb82c15e640 2024-09-11T23:24:05.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.131+0000 7fb82aa00640 1 -- 172.21.15.144:0/1746699634 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb82c06bee0 con 0x7fb82c15e640 2024-09-11T23:24:05.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.131+0000 7fb822a00640 1 -- 172.21.15.144:0/1746699634 >> v1:172.21.15.165:6789/0 conn(0x7fb82c15e640 legacy=0x7fb82c0d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:05.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.131+0000 7fb822a00640 1 -- 172.21.15.144:0/1746699634 >> v1:172.21.15.144:6789/0 conn(0x7fb82c0b7750 legacy=0x7fb82c0b7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:05.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.131+0000 7fb822a00640 1 -- 172.21.15.144:0/1746699634 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82c06c4a0 con 0x7fb82c0b5fd0 2024-09-11T23:24:05.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.132+0000 7fb822a00640 1 --2- 172.21.15.144:0/1746699634 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb82c0b5fd0 0x7fb82c0b6410 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb8140097d0 tx=0x7fb81402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4bc307f8b3b1087 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:05.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.132+0000 7fb82aa00640 1 -- 172.21.15.144:0/1746699634 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814037070 con 0x7fb82c0b5fd0 2024-09-11T23:24:05.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.132+0000 7fb82aa00640 1 -- 172.21.15.144:0/1746699634 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb814032440 con 0x7fb82c0b5fd0 2024-09-11T23:24:05.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.132+0000 7fb82aa00640 1 -- 172.21.15.144:0/1746699634 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814032810 con 0x7fb82c0b5fd0 2024-09-11T23:24:05.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.133+0000 7fb830e00640 1 -- 172.21.15.144:0/1746699634 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb82c0b5fd0 msgr2=0x7fb82c0b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:05.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.133+0000 7fb830e00640 1 --2- 172.21.15.144:0/1746699634 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb82c0b5fd0 0x7fb82c0b6410 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb8140097d0 tx=0x7fb81402a210 comp rx=0 tx=0).stop 2024-09-11T23:24:05.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.133+0000 7fb830e00640 1 -- 172.21.15.144:0/1746699634 shutdown_connections 2024-09-11T23:24:05.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.133+0000 7fb830e00640 1 --2- 172.21.15.144:0/1746699634 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb82c0b5fd0 0x7fb82c0b6410 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.133+0000 7fb830e00640 1 -- 172.21.15.144:0/1746699634 >> 172.21.15.144:0/1746699634 conn(0x7fb82c0d0fd0 msgr2=0x7fb82c0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:05.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.133+0000 7fb830e00640 1 -- 172.21.15.144:0/1746699634 shutdown_connections 2024-09-11T23:24:05.136 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.133+0000 7fb830e00640 1 -- 172.21.15.144:0/1746699634 wait complete. 2024-09-11T23:24:05.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.135+0000 7fb830e00640 1 Processor -- start 2024-09-11T23:24:05.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.135+0000 7fb830e00640 1 -- start start 2024-09-11T23:24:05.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.136+0000 7fb830e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb82c0b5fd0 0x7fb82c158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:05.137 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.136+0000 7fb830e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb82c0b7750 0x7fb82c0b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:05.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.136+0000 7fb830e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb82c15e640 0x7fb82c0b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:05.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.136+0000 7fb830e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c0b6950 con 0x7fb82c0b7750 2024-09-11T23:24:05.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.136+0000 7fb830e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c06caf0 con 0x7fb82c15e640 2024-09-11T23:24:05.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.136+0000 7fb830e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb82c0d4130 con 0x7fb82c0b5fd0 2024-09-11T23:24:05.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.136+0000 7fb822a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb82c0b7750 0x7fb82c0b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:05.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.136+0000 7fb822a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb82c0b7750 0x7fb82c0b5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50056/0 (socket says 172.21.15.144:50056) 2024-09-11T23:24:05.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.136+0000 7fb822a00640 1 -- 172.21.15.144:0/2609849699 learned_addr learned my addr 172.21.15.144:0/2609849699 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:05.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.136+0000 7fb82b400640 1 --2- 172.21.15.144:0/2609849699 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb82c0b5fd0 0x7fb82c158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:05.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.136+0000 7fb82be00640 1 --2- 172.21.15.144:0/2609849699 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb82c15e640 0x7fb82c0b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:05.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.137+0000 7fb822a00640 1 -- 172.21.15.144:0/2609849699 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb82c0b5fd0 msgr2=0x7fb82c158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:05.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.137+0000 7fb822a00640 1 --2- 172.21.15.144:0/2609849699 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb82c0b5fd0 0x7fb82c158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.137+0000 7fb822a00640 1 -- 172.21.15.144:0/2609849699 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb82c15e640 msgr2=0x7fb82c0b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:05.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.137+0000 7fb822a00640 1 --2- 172.21.15.144:0/2609849699 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb82c15e640 0x7fb82c0b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.137+0000 7fb822a00640 1 -- 172.21.15.144:0/2609849699 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82c1e9350 con 0x7fb82c0b7750 2024-09-11T23:24:05.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.137+0000 7fb822a00640 1 --2- 172.21.15.144:0/2609849699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb82c0b7750 0x7fb82c0b5600 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fb8140098f0 tx=0x7fb8140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:05.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.137+0000 7fb823e00640 1 -- 172.21.15.144:0/2609849699 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814041020 con 0x7fb82c0b7750 2024-09-11T23:24:05.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.137+0000 7fb823e00640 1 -- 172.21.15.144:0/2609849699 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb81403d620 con 0x7fb82c0b7750 2024-09-11T23:24:05.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.137+0000 7fb830e00640 1 -- 172.21.15.144:0/2609849699 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb82c1e8ab0 con 0x7fb82c0b7750 2024-09-11T23:24:05.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.138+0000 7fb823e00640 1 -- 172.21.15.144:0/2609849699 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814037040 con 0x7fb82c0b7750 2024-09-11T23:24:05.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.138+0000 7fb830e00640 1 -- 172.21.15.144:0/2609849699 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb82c1e9070 con 0x7fb82c0b7750 2024-09-11T23:24:05.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.139+0000 7fb830e00640 1 -- 172.21.15.144:0/2609849699 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb82c0b6410 con 0x7fb82c0b7750 2024-09-11T23:24:05.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.140+0000 7fb823e00640 1 -- 172.21.15.144:0/2609849699 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7fb814044020 con 0x7fb82c0b7750 2024-09-11T23:24:05.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.141+0000 7fb823e00640 1 --2- 172.21.15.144:0/2609849699 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb80806c250 0x7fb80806e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:05.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.141+0000 7fb823e00640 1 -- 172.21.15.144:0/2609849699 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7fb8140ab9b0 con 0x7fb82c0b7750 2024-09-11T23:24:05.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.141+0000 7fb82b400640 1 --2- 172.21.15.144:0/2609849699 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb80806c250 0x7fb80806e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:05.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.142+0000 7fb82b400640 1 --2- 172.21.15.144:0/2609849699 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb80806c250 0x7fb80806e710 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb81c001560 tx=0x7fb81c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:05.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.145+0000 7fb823e00640 1 -- 172.21.15.144:0/2609849699 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb81404b030 con 0x7fb82c0b7750 2024-09-11T23:24:05.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.322+0000 7fb830e00640 1 -- 172.21.15.144:0/2609849699 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb82c0d37e0 con 0x7fb82c0b7750 2024-09-11T23:24:05.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.323+0000 7fb823e00640 1 -- 172.21.15.144:0/2609849699 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+16776 (secure 0 0 0) 0x7fb82c1e9350 con 0x7fb82c0b7750 2024-09-11T23:24:05.324 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:05.325 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":115,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:24:04.329350+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:24:02.109644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-11T23:24:03.330949+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:24:05.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.326+0000 7fb830e00640 1 -- 172.21.15.144:0/2609849699 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb80806c250 msgr2=0x7fb80806e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:05.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.326+0000 7fb830e00640 1 --2- 172.21.15.144:0/2609849699 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb80806c250 0x7fb80806e710 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb81c001560 tx=0x7fb81c009040 comp rx=0 tx=0).stop 2024-09-11T23:24:05.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.326+0000 7fb830e00640 1 -- 172.21.15.144:0/2609849699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb82c0b7750 msgr2=0x7fb82c0b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:05.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.326+0000 7fb830e00640 1 --2- 172.21.15.144:0/2609849699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb82c0b7750 0x7fb82c0b5600 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fb8140098f0 tx=0x7fb8140046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.326+0000 7fb830e00640 1 -- 172.21.15.144:0/2609849699 shutdown_connections 2024-09-11T23:24:05.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.326+0000 7fb830e00640 1 --2- 172.21.15.144:0/2609849699 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb80806c250 0x7fb80806e710 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.326+0000 7fb830e00640 1 --2- 172.21.15.144:0/2609849699 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb82c15e640 0x7fb82c0b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.326+0000 7fb830e00640 1 --2- 172.21.15.144:0/2609849699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb82c0b7750 0x7fb82c0b5600 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.326+0000 7fb830e00640 1 --2- 172.21.15.144:0/2609849699 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb82c0b5fd0 0x7fb82c158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.326+0000 7fb830e00640 1 -- 172.21.15.144:0/2609849699 >> 172.21.15.144:0/2609849699 conn(0x7fb82c0d0fd0 msgr2=0x7fb82c0d2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:05.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.326+0000 7fb830e00640 1 -- 172.21.15.144:0/2609849699 shutdown_connections 2024-09-11T23:24:05.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.326+0000 7fb830e00640 1 -- 172.21.15.144:0/2609849699 wait complete. 2024-09-11T23:24:05.344 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:24:05.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.496+0000 7faec5000640 1 Processor -- start 2024-09-11T23:24:05.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.496+0000 7faec5000640 1 -- start start 2024-09-11T23:24:05.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.497+0000 7faec5000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faec015c180 0x7faec00cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:05.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.497+0000 7faec5000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faec00ce740 con 0x7faec00ce230 2024-09-11T23:24:05.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.497+0000 7faec5000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faec0072640 con 0x7faec0073120 2024-09-11T23:24:05.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.497+0000 7faec5000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faec0072920 con 0x7faec015c180 2024-09-11T23:24:05.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.498+0000 7faebd400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7faec00ce230 0x7faec00cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57512/0 (socket says 172.21.15.144:57512) 2024-09-11T23:24:05.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.498+0000 7faebd400640 1 -- 172.21.15.144:0/1608492167 learned_addr learned my addr 172.21.15.144:0/1608492167 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:05.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.498+0000 7faebde00640 1 --2- 172.21.15.144:0/1608492167 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faec015c180 0x7faec00cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:05.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.498+0000 7faebca00640 1 -- 172.21.15.144:0/1608492167 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4206066276 0 0) 0x7faec00ce740 con 0x7faec00ce230 2024-09-11T23:24:05.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.498+0000 7faebca00640 1 -- 172.21.15.144:0/1608492167 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faea4003520 con 0x7faec00ce230 2024-09-11T23:24:05.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.498+0000 7faebca00640 1 -- 172.21.15.144:0/1608492167 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2254563494 0 0) 0x7faec0072640 con 0x7faec0073120 2024-09-11T23:24:05.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.498+0000 7faebca00640 1 -- 172.21.15.144:0/1608492167 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faec00ce740 con 0x7faec0073120 2024-09-11T23:24:05.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.498+0000 7faebca00640 1 -- 172.21.15.144:0/1608492167 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3321574973 0 0) 0x7faea4003520 con 0x7faec00ce230 2024-09-11T23:24:05.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.498+0000 7faebde00640 1 -- 172.21.15.144:0/1608492167 >> v1:172.21.15.165:6789/0 conn(0x7faec0073120 legacy=0x7faec006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:05.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.498+0000 7faebde00640 1 -- 172.21.15.144:0/1608492167 >> v1:172.21.15.144:6789/0 conn(0x7faec00ce230 legacy=0x7faec00cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:05.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.498+0000 7faebde00640 1 -- 172.21.15.144:0/1608492167 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec0072c00 con 0x7faec015c180 2024-09-11T23:24:05.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.500+0000 7faebde00640 1 --2- 172.21.15.144:0/1608492167 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faec015c180 0x7faec00cdcf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009dc0 tx=0x7faeb002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf82fce26347d29b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:05.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.500+0000 7faebca00640 1 -- 172.21.15.144:0/1608492167 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea8001670 con 0x7faec015c180 2024-09-11T23:24:05.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.500+0000 7faebca00640 1 -- 172.21.15.144:0/1608492167 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb0007540 con 0x7faec015c180 2024-09-11T23:24:05.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.500+0000 7faebca00640 1 -- 172.21.15.144:0/1608492167 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb0007910 con 0x7faec015c180 2024-09-11T23:24:05.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.500+0000 7faec5000640 1 -- 172.21.15.144:0/1608492167 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faec015c180 msgr2=0x7faec00cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:05.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.500+0000 7faec5000640 1 --2- 172.21.15.144:0/1608492167 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faec015c180 0x7faec00cdcf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009dc0 tx=0x7faeb002a5d0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.501+0000 7faec5000640 1 -- 172.21.15.144:0/1608492167 shutdown_connections 2024-09-11T23:24:05.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.501+0000 7faec5000640 1 --2- 172.21.15.144:0/1608492167 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faec015c180 0x7faec00cdcf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.501+0000 7faec5000640 1 -- 172.21.15.144:0/1608492167 >> 172.21.15.144:0/1608492167 conn(0x7faec0062cc0 msgr2=0x7faec006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:05.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.501+0000 7faec5000640 1 -- 172.21.15.144:0/1608492167 shutdown_connections 2024-09-11T23:24:05.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.501+0000 7faec5000640 1 -- 172.21.15.144:0/1608492167 wait complete. 2024-09-11T23:24:05.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.502+0000 7faec5000640 1 Processor -- start 2024-09-11T23:24:05.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.502+0000 7faec5000640 1 -- start start 2024-09-11T23:24:05.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.503+0000 7faec5000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faec0073120 0x7faec015f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:05.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.503+0000 7faec5000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faec00ce230 0x7faec01f4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:05.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.503+0000 7faec5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faec015c180 0x7faec015cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:05.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.503+0000 7faec5000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faec00cf780 con 0x7faec015c180 2024-09-11T23:24:05.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.503+0000 7faec5000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faec00722f0 con 0x7faec0073120 2024-09-11T23:24:05.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.503+0000 7faec5000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faec015c560 con 0x7faec00ce230 2024-09-11T23:24:05.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.503+0000 7faebe800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faec015c180 0x7faec015cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:05.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.503+0000 7faebe800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faec015c180 0x7faec015cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50060/0 (socket says 172.21.15.144:50060) 2024-09-11T23:24:05.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.504+0000 7faebe800640 1 -- 172.21.15.144:0/630875490 learned_addr learned my addr 172.21.15.144:0/630875490 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:05.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.504+0000 7faebde00640 1 --2- 172.21.15.144:0/630875490 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faec0073120 0x7faec015f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:05.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.504+0000 7faebd400640 1 --2- 172.21.15.144:0/630875490 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faec00ce230 0x7faec01f4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:05.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.504+0000 7faebe800640 1 -- 172.21.15.144:0/630875490 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faec00ce230 msgr2=0x7faec01f4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:05.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.504+0000 7faebe800640 1 --2- 172.21.15.144:0/630875490 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faec00ce230 0x7faec01f4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.504+0000 7faebe800640 1 -- 172.21.15.144:0/630875490 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faec0073120 msgr2=0x7faec015f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:05.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.504+0000 7faebe800640 1 --2- 172.21.15.144:0/630875490 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faec0073120 0x7faec015f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.504+0000 7faebe800640 1 -- 172.21.15.144:0/630875490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec01f4920 con 0x7faec015c180 2024-09-11T23:24:05.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.504+0000 7faebe800640 1 --2- 172.21.15.144:0/630875490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faec015c180 0x7faec015cd10 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7faeb800c400 tx=0x7faeb800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:05.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.504+0000 7faeb6000640 1 -- 172.21.15.144:0/630875490 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb8017070 con 0x7faec015c180 2024-09-11T23:24:05.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.505+0000 7faeb6000640 1 -- 172.21.15.144:0/630875490 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb80052d0 con 0x7faec015c180 2024-09-11T23:24:05.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.505+0000 7faec5000640 1 -- 172.21.15.144:0/630875490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec01f4c00 con 0x7faec015c180 2024-09-11T23:24:05.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.505+0000 7faeb6000640 1 -- 172.21.15.144:0/630875490 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb80037f0 con 0x7faec015c180 2024-09-11T23:24:05.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.505+0000 7faec5000640 1 -- 172.21.15.144:0/630875490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec00b3570 con 0x7faec015c180 2024-09-11T23:24:05.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.506+0000 7faec5000640 1 -- 172.21.15.144:0/630875490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec00cdcf0 con 0x7faec015c180 2024-09-11T23:24:05.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.507+0000 7faeb6000640 1 -- 172.21.15.144:0/630875490 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7faeb801a070 con 0x7faec015c180 2024-09-11T23:24:05.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.508+0000 7faeb6000640 1 --2- 172.21.15.144:0/630875490 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fae9c06c220 0x7fae9c06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:05.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.508+0000 7faeb6000640 1 -- 172.21.15.144:0/630875490 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7faeb808a840 con 0x7faec015c180 2024-09-11T23:24:05.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.508+0000 7faebde00640 1 --2- 172.21.15.144:0/630875490 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fae9c06c220 0x7fae9c06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:05.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.509+0000 7faebde00640 1 --2- 172.21.15.144:0/630875490 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fae9c06c220 0x7fae9c06e6e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faeb0034000 tx=0x7faeb002f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:05.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.512+0000 7faeb6000640 1 -- 172.21.15.144:0/630875490 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faeb8058650 con 0x7faec015c180 2024-09-11T23:24:05.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.686+0000 7faec5000640 1 -- 172.21.15.144:0/630875490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faec00cd6b0 con 0x7faec015c180 2024-09-11T23:24:05.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.688+0000 7faeb6000640 1 -- 172.21.15.144:0/630875490 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+16776 (secure 0 0 0) 0x7faeb805c950 con 0x7faec015c180 2024-09-11T23:24:05.688 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:05.689 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":115,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:24:04.329350+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:24:02.109644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-11T23:24:03.330949+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:24:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.690+0000 7faec5000640 1 -- 172.21.15.144:0/630875490 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fae9c06c220 msgr2=0x7fae9c06e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.690+0000 7faec5000640 1 --2- 172.21.15.144:0/630875490 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fae9c06c220 0x7fae9c06e6e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faeb0034000 tx=0x7faeb002f000 comp rx=0 tx=0).stop 2024-09-11T23:24:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.690+0000 7faec5000640 1 -- 172.21.15.144:0/630875490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faec015c180 msgr2=0x7faec015cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.690+0000 7faec5000640 1 --2- 172.21.15.144:0/630875490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faec015c180 0x7faec015cd10 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7faeb800c400 tx=0x7faeb800c8c0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.690+0000 7faec5000640 1 -- 172.21.15.144:0/630875490 shutdown_connections 2024-09-11T23:24:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.690+0000 7faec5000640 1 --2- 172.21.15.144:0/630875490 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fae9c06c220 0x7fae9c06e6e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.690+0000 7faec5000640 1 --2- 172.21.15.144:0/630875490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faec015c180 0x7faec015cd10 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.690+0000 7faec5000640 1 --2- 172.21.15.144:0/630875490 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faec00ce230 0x7faec01f4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.690+0000 7faec5000640 1 --2- 172.21.15.144:0/630875490 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faec0073120 0x7faec015f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.690+0000 7faec5000640 1 -- 172.21.15.144:0/630875490 >> 172.21.15.144:0/630875490 conn(0x7faec0062cc0 msgr2=0x7faec0074c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:05.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.690+0000 7faec5000640 1 -- 172.21.15.144:0/630875490 shutdown_connections 2024-09-11T23:24:05.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.690+0000 7faec5000640 1 -- 172.21.15.144:0/630875490 wait complete. 2024-09-11T23:24:05.708 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:24:05.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.864+0000 7f2115800640 1 Processor -- start 2024-09-11T23:24:05.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.865+0000 7f2115800640 1 -- start start 2024-09-11T23:24:05.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.866+0000 7f2115800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2110158e50 0x7f21100b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:05.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.866+0000 7f2115800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f211015c370 0x7f211006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:05.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.866+0000 7f2115800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f211015c800 con 0x7f211006ef60 2024-09-11T23:24:05.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.866+0000 7f2115800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f21100b43f0 con 0x7f2110158e50 2024-09-11T23:24:05.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.866+0000 7f2115800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f21100b3630 con 0x7f211015c370 2024-09-11T23:24:05.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.866+0000 7f210ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2110158e50 0x7f21100b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:05.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.866+0000 7f210ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2110158e50 0x7f21100b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50076/0 (socket says 172.21.15.144:50076) 2024-09-11T23:24:05.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.866+0000 7f210ea00640 1 -- 172.21.15.144:0/863587269 learned_addr learned my addr 172.21.15.144:0/863587269 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:05.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.866+0000 7f2106000640 1 --2- 172.21.15.144:0/863587269 >> v2:172.21.15.165:3300/0 conn(0x7f211015c370 0x7f211006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:05.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.866+0000 7f210ea00640 1 -- 172.21.15.144:0/863587269 >> v2:172.21.15.165:3300/0 conn(0x7f211015c370 msgr2=0x7f211006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:05.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.866+0000 7f210ea00640 1 --2- 172.21.15.144:0/863587269 >> v2:172.21.15.165:3300/0 conn(0x7f211015c370 0x7f211006ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.866+0000 7f210ea00640 1 -- 172.21.15.144:0/863587269 >> v1:172.21.15.165:6789/0 conn(0x7f211006ef60 legacy=0x7f211015ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:05.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.866+0000 7f210ea00640 1 -- 172.21.15.144:0/863587269 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21100b3910 con 0x7f2110158e50 2024-09-11T23:24:05.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.867+0000 7f2106000640 1 --2- 172.21.15.144:0/863587269 >> v2:172.21.15.165:3300/0 conn(0x7f211015c370 0x7f211006ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:24:05.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.867+0000 7f210ea00640 1 --2- 172.21.15.144:0/863587269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2110158e50 0x7f21100b5050 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f21100cdd40 tx=0x7f210002c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a36add6ceeafec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:05.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.868+0000 7f210e000640 1 -- 172.21.15.144:0/863587269 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21000325a0 con 0x7f2110158e50 2024-09-11T23:24:05.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.868+0000 7f210e000640 1 -- 172.21.15.144:0/863587269 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2100038070 con 0x7f2110158e50 2024-09-11T23:24:05.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.868+0000 7f210e000640 1 -- 172.21.15.144:0/863587269 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2100032960 con 0x7f2110158e50 2024-09-11T23:24:05.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.868+0000 7f2115800640 1 -- 172.21.15.144:0/863587269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2110158e50 msgr2=0x7f21100b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:05.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.868+0000 7f2115800640 1 --2- 172.21.15.144:0/863587269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2110158e50 0x7f21100b5050 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f21100cdd40 tx=0x7f210002c8e0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.868+0000 7f2115800640 1 -- 172.21.15.144:0/863587269 shutdown_connections 2024-09-11T23:24:05.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.868+0000 7f2115800640 1 --2- 172.21.15.144:0/863587269 >> v2:172.21.15.165:3300/0 conn(0x7f211015c370 0x7f211006ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.868+0000 7f2115800640 1 --2- 172.21.15.144:0/863587269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2110158e50 0x7f21100b5050 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.868+0000 7f2115800640 1 -- 172.21.15.144:0/863587269 >> 172.21.15.144:0/863587269 conn(0x7f211006bba0 msgr2=0x7f211006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:05.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.868+0000 7f2115800640 1 -- 172.21.15.144:0/863587269 shutdown_connections 2024-09-11T23:24:05.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.868+0000 7f2115800640 1 -- 172.21.15.144:0/863587269 wait complete. 2024-09-11T23:24:05.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.870+0000 7f2115800640 1 Processor -- start 2024-09-11T23:24:05.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.870+0000 7f2115800640 1 -- start start 2024-09-11T23:24:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.871+0000 7f2115800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f211006ef60 0x7f211014f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.871+0000 7f2115800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2110158e50 0x7f211015ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.871+0000 7f2115800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f211015c370 0x7f21101533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.871+0000 7f2115800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2110159230 con 0x7f211006ef60 2024-09-11T23:24:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.871+0000 7f2115800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f21100b3ed0 con 0x7f211015c370 2024-09-11T23:24:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.871+0000 7f2115800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f21100cf210 con 0x7f2110158e50 2024-09-11T23:24:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.871+0000 7f210ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f211006ef60 0x7f211014f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.871+0000 7f210ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f211006ef60 0x7f211014f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50078/0 (socket says 172.21.15.144:50078) 2024-09-11T23:24:05.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.871+0000 7f210ea00640 1 -- 172.21.15.144:0/2416054795 learned_addr learned my addr 172.21.15.144:0/2416054795 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.871+0000 7f2106000640 1 --2- 172.21.15.144:0/2416054795 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2110158e50 0x7f211015ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.871+0000 7f210f400640 1 --2- 172.21.15.144:0/2416054795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f211015c370 0x7f21101533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.872+0000 7f210ea00640 1 -- 172.21.15.144:0/2416054795 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2110158e50 msgr2=0x7f211015ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.872+0000 7f210ea00640 1 --2- 172.21.15.144:0/2416054795 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2110158e50 0x7f211015ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.872+0000 7f210ea00640 1 -- 172.21.15.144:0/2416054795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f211015c370 msgr2=0x7f21101533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.872+0000 7f210ea00640 1 --2- 172.21.15.144:0/2416054795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f211015c370 0x7f21101533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.872+0000 7f210ea00640 1 -- 172.21.15.144:0/2416054795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211015cd50 con 0x7f211006ef60 2024-09-11T23:24:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.872+0000 7f210ea00640 1 --2- 172.21.15.144:0/2416054795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f211006ef60 0x7f211014f970 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f210000b2c0 tx=0x7f2100004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.872+0000 7f2107400640 1 -- 172.21.15.144:0/2416054795 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2100043070 con 0x7f211006ef60 2024-09-11T23:24:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.872+0000 7f2107400640 1 -- 172.21.15.144:0/2416054795 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2100033c70 con 0x7f211006ef60 2024-09-11T23:24:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.872+0000 7f2115800640 1 -- 172.21.15.144:0/2416054795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f211015d030 con 0x7f211006ef60 2024-09-11T23:24:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.872+0000 7f2107400640 1 -- 172.21.15.144:0/2416054795 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210003c660 con 0x7f211006ef60 2024-09-11T23:24:05.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.872+0000 7f2115800640 1 -- 172.21.15.144:0/2416054795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f211015d5f0 con 0x7f211006ef60 2024-09-11T23:24:05.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.873+0000 7f2115800640 1 -- 172.21.15.144:0/2416054795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2110071ee0 con 0x7f211006ef60 2024-09-11T23:24:05.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.874+0000 7f2107400640 1 -- 172.21.15.144:0/2416054795 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f2100046070 con 0x7f211006ef60 2024-09-11T23:24:05.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.876+0000 7f2107400640 1 --2- 172.21.15.144:0/2416054795 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f20ec06c220 0x7f20ec06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:05.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.876+0000 7f2107400640 1 -- 172.21.15.144:0/2416054795 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f2100030020 con 0x7f211006ef60 2024-09-11T23:24:05.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.876+0000 7f2106000640 1 --2- 172.21.15.144:0/2416054795 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f20ec06c220 0x7f20ec06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:05.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.877+0000 7f2106000640 1 --2- 172.21.15.144:0/2416054795 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f20ec06c220 0x7f20ec06e6e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f20f8006fd0 tx=0x7f20f8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:05.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:05.880+0000 7f2107400640 1 -- 172.21.15.144:0/2416054795 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f210004d030 con 0x7f211006ef60 2024-09-11T23:24:06.095 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:06.094+0000 7f2115800640 1 -- 172.21.15.144:0/2416054795 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2110071c00 con 0x7f211006ef60 2024-09-11T23:24:06.909 INFO:tasks.ceph.mds.c.smithi144.stderr:2024-09-11T23:24:06.909+0000 7fc232a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:24:06.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:06.962+0000 7f2107400640 1 -- 172.21.15.144:0/2416054795 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v80) ==== 118+0+0 (secure 0 0 0) 0x7f2100033e20 con 0x7f211006ef60 2024-09-11T23:24:06.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:06.965+0000 7f2115800640 1 -- 172.21.15.144:0/2416054795 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f20ec06c220 msgr2=0x7f20ec06e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:06.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:06.965+0000 7f2115800640 1 --2- 172.21.15.144:0/2416054795 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f20ec06c220 0x7f20ec06e6e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f20f8006fd0 tx=0x7f20f8008040 comp rx=0 tx=0).stop 2024-09-11T23:24:06.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:06.965+0000 7f2115800640 1 -- 172.21.15.144:0/2416054795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f211006ef60 msgr2=0x7f211014f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:06.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:06.965+0000 7f2115800640 1 --2- 172.21.15.144:0/2416054795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f211006ef60 0x7f211014f970 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f210000b2c0 tx=0x7f2100004730 comp rx=0 tx=0).stop 2024-09-11T23:24:06.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:06.965+0000 7f2115800640 1 -- 172.21.15.144:0/2416054795 shutdown_connections 2024-09-11T23:24:06.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:06.965+0000 7f2115800640 1 --2- 172.21.15.144:0/2416054795 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f20ec06c220 0x7f20ec06e6e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:06.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:06.965+0000 7f2115800640 1 --2- 172.21.15.144:0/2416054795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f211015c370 0x7f21101533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:06.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:06.965+0000 7f2115800640 1 --2- 172.21.15.144:0/2416054795 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2110158e50 0x7f211015ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:06.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:06.965+0000 7f2115800640 1 --2- 172.21.15.144:0/2416054795 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f211006ef60 0x7f211014f970 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:06.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:06.965+0000 7f2115800640 1 -- 172.21.15.144:0/2416054795 >> 172.21.15.144:0/2416054795 conn(0x7f211006bba0 msgr2=0x7f21100af620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:06.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:06.965+0000 7f2115800640 1 -- 172.21.15.144:0/2416054795 shutdown_connections 2024-09-11T23:24:06.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:06.965+0000 7f2115800640 1 -- 172.21.15.144:0/2416054795 wait complete. 2024-09-11T23:24:06.983 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:24:06.984 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:24:07.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.140+0000 7f6fa2200640 1 Processor -- start 2024-09-11T23:24:07.141 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.141+0000 7f6fa2200640 1 -- start start 2024-09-11T23:24:07.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.142+0000 7f6fa2200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6f9c15d3b0 0x7f6f9c071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:07.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.142+0000 7f6fa2200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f9c15d790 0x7f6f9c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:07.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.142+0000 7f6fa2200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f9c0715c0 con 0x7f6f9c0cd3b0 2024-09-11T23:24:07.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.142+0000 7f6fa2200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6f9c06da30 con 0x7f6f9c15d3b0 2024-09-11T23:24:07.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.142+0000 7f6fa2200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9c06d700 con 0x7f6f9c15d790 2024-09-11T23:24:07.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.142+0000 7f6f92a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f9c15d790 0x7f6f9c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:07.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.142+0000 7f6f9b400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6f9c15d3b0 0x7f6f9c071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:07.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.142+0000 7f6f92a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f9c15d790 0x7f6f9c0cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:58560/0 (socket says 172.21.15.144:58560) 2024-09-11T23:24:07.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.142+0000 7f6f92a00640 1 -- 172.21.15.144:0/3157122620 learned_addr learned my addr 172.21.15.144:0/3157122620 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:07.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.143+0000 7f6f92a00640 1 -- 172.21.15.144:0/3157122620 >> v2:172.21.15.165:3300/0 conn(0x7f6f9c15d3b0 msgr2=0x7f6f9c071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:07.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.143+0000 7f6f92a00640 1 --2- 172.21.15.144:0/3157122620 >> v2:172.21.15.165:3300/0 conn(0x7f6f9c15d3b0 0x7f6f9c071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:07.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.143+0000 7f6f92a00640 1 -- 172.21.15.144:0/3157122620 >> v1:172.21.15.165:6789/0 conn(0x7f6f9c0cd3b0 legacy=0x7f6f9c0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:07.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.143+0000 7f6f92a00640 1 -- 172.21.15.144:0/3157122620 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9c0cde80 con 0x7f6f9c15d790 2024-09-11T23:24:07.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.144+0000 7f6f92a00640 1 --2- 172.21.15.144:0/3157122620 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f9c15d790 0x7f6f9c0cce70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009850 tx=0x7f6f8402a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a151ae67edde1314 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:07.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.144+0000 7f6f9aa00640 1 -- 172.21.15.144:0/3157122620 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f84004030 con 0x7f6f9c15d790 2024-09-11T23:24:07.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.144+0000 7f6f9aa00640 1 -- 172.21.15.144:0/3157122620 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f840041d0 con 0x7f6f9c15d790 2024-09-11T23:24:07.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.144+0000 7f6f9aa00640 1 -- 172.21.15.144:0/3157122620 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f84003610 con 0x7f6f9c15d790 2024-09-11T23:24:07.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.144+0000 7f6fa2200640 1 -- 172.21.15.144:0/3157122620 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f9c15d790 msgr2=0x7f6f9c0cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:07.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.144+0000 7f6fa2200640 1 --2- 172.21.15.144:0/3157122620 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f9c15d790 0x7f6f9c0cce70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009850 tx=0x7f6f8402a230 comp rx=0 tx=0).stop 2024-09-11T23:24:07.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.145+0000 7f6fa2200640 1 -- 172.21.15.144:0/3157122620 shutdown_connections 2024-09-11T23:24:07.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.145+0000 7f6fa2200640 1 --2- 172.21.15.144:0/3157122620 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f9c15d790 0x7f6f9c0cce70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:07.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.145+0000 7f6fa2200640 1 --2- 172.21.15.144:0/3157122620 >> v2:172.21.15.165:3300/0 conn(0x7f6f9c15d3b0 0x7f6f9c071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:07.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.145+0000 7f6fa2200640 1 -- 172.21.15.144:0/3157122620 >> 172.21.15.144:0/3157122620 conn(0x7f6f9c06bba0 msgr2=0x7f6f9c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:07.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.145+0000 7f6fa2200640 1 -- 172.21.15.144:0/3157122620 shutdown_connections 2024-09-11T23:24:07.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.145+0000 7f6fa2200640 1 -- 172.21.15.144:0/3157122620 wait complete. 2024-09-11T23:24:07.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.146+0000 7f6fa2200640 1 Processor -- start 2024-09-11T23:24:07.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.146+0000 7f6fa2200640 1 -- start start 2024-09-11T23:24:07.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.147+0000 7f6fa2200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f9c0cd3b0 0x7f6f9c155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:07.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.147+0000 7f6fa2200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f9c15d3b0 0x7f6f9c1f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:07.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.147+0000 7f6fa2200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f9c156150 0x7f6f9c0ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:07.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.147+0000 7f6fa2200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c15cbf0 con 0x7f6f9c15d3b0 2024-09-11T23:24:07.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.147+0000 7f6fa2200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c0cdba0 con 0x7f6f9c156150 2024-09-11T23:24:07.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.147+0000 7f6fa2200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9c15cd70 con 0x7f6f9c0cd3b0 2024-09-11T23:24:07.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.148+0000 7f6f92a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f9c15d3b0 0x7f6f9c1f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:07.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.148+0000 7f6f92a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f9c15d3b0 0x7f6f9c1f2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50082/0 (socket says 172.21.15.144:50082) 2024-09-11T23:24:07.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.148+0000 7f6f92a00640 1 -- 172.21.15.144:0/392278508 learned_addr learned my addr 172.21.15.144:0/392278508 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:07.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.148+0000 7f6f9b400640 1 --2- 172.21.15.144:0/392278508 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f9c0cd3b0 0x7f6f9c155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:07.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.148+0000 7f6f9be00640 1 --2- 172.21.15.144:0/392278508 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f9c156150 0x7f6f9c0ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:07.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.148+0000 7f6f92a00640 1 -- 172.21.15.144:0/392278508 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f9c0cd3b0 msgr2=0x7f6f9c155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:07.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.148+0000 7f6f92a00640 1 --2- 172.21.15.144:0/392278508 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f9c0cd3b0 0x7f6f9c155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:07.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.148+0000 7f6f92a00640 1 -- 172.21.15.144:0/392278508 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f9c156150 msgr2=0x7f6f9c0ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:07.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.148+0000 7f6f92a00640 1 --2- 172.21.15.144:0/392278508 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f9c156150 0x7f6f9c0ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:07.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.148+0000 7f6f92a00640 1 -- 172.21.15.144:0/392278508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9c0acfd0 con 0x7f6f9c15d3b0 2024-09-11T23:24:07.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.148+0000 7f6f92a00640 1 --2- 172.21.15.144:0/392278508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f9c15d3b0 0x7f6f9c1f2d00 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f6f8402a270 tx=0x7f6f840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:07.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.149+0000 7f6f93e00640 1 -- 172.21.15.144:0/392278508 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f84041020 con 0x7f6f9c15d3b0 2024-09-11T23:24:07.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.149+0000 7f6f93e00640 1 -- 172.21.15.144:0/392278508 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f84003c50 con 0x7f6f9c15d3b0 2024-09-11T23:24:07.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.149+0000 7f6f93e00640 1 -- 172.21.15.144:0/392278508 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f84004030 con 0x7f6f9c15d3b0 2024-09-11T23:24:07.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.149+0000 7f6fa2200640 1 -- 172.21.15.144:0/392278508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f9c1f3240 con 0x7f6f9c15d3b0 2024-09-11T23:24:07.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.149+0000 7f6fa2200640 1 -- 172.21.15.144:0/392278508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f9c0ad530 con 0x7f6f9c15d3b0 2024-09-11T23:24:07.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.150+0000 7f6fa2200640 1 -- 172.21.15.144:0/392278508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f9c0cfba0 con 0x7f6f9c15d3b0 2024-09-11T23:24:07.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.151+0000 7f6f93e00640 1 -- 172.21.15.144:0/392278508 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f6f84044020 con 0x7f6f9c15d3b0 2024-09-11T23:24:07.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.152+0000 7f6f93e00640 1 --2- 172.21.15.144:0/392278508 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6f7806c220 0x7f6f7806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:07.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.152+0000 7f6f93e00640 1 -- 172.21.15.144:0/392278508 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f6f840abf30 con 0x7f6f9c15d3b0 2024-09-11T23:24:07.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.152+0000 7f6f9b400640 1 --2- 172.21.15.144:0/392278508 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6f7806c220 0x7f6f7806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:07.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.153+0000 7f6f9b400640 1 --2- 172.21.15.144:0/392278508 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6f7806c220 0x7f6f7806e6e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c1576a0 tx=0x7f6f8c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:07.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.156+0000 7f6f93e00640 1 -- 172.21.15.144:0/392278508 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f8404b030 con 0x7f6f9c15d3b0 2024-09-11T23:24:07.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.362+0000 7f6fa2200640 1 -- 172.21.15.144:0/392278508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f6f9c06edc0 con 0x7f6f9c15d3b0 2024-09-11T23:24:07.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.964+0000 7f6f93e00640 1 -- 172.21.15.144:0/392278508 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v81) ==== 122+0+0 (secure 0 0 0) 0x7f6f9c1f3240 con 0x7f6f9c15d3b0 2024-09-11T23:24:07.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.966+0000 7f6fa2200640 1 -- 172.21.15.144:0/392278508 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6f7806c220 msgr2=0x7f6f7806e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:07.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.966+0000 7f6fa2200640 1 --2- 172.21.15.144:0/392278508 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6f7806c220 0x7f6f7806e6e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c1576a0 tx=0x7f6f8c009190 comp rx=0 tx=0).stop 2024-09-11T23:24:07.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.966+0000 7f6fa2200640 1 -- 172.21.15.144:0/392278508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f9c15d3b0 msgr2=0x7f6f9c1f2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:07.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.966+0000 7f6fa2200640 1 --2- 172.21.15.144:0/392278508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f9c15d3b0 0x7f6f9c1f2d00 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f6f8402a270 tx=0x7f6f840046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:07.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.966+0000 7f6fa2200640 1 -- 172.21.15.144:0/392278508 shutdown_connections 2024-09-11T23:24:07.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.966+0000 7f6fa2200640 1 --2- 172.21.15.144:0/392278508 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6f7806c220 0x7f6f7806e6e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:07.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.966+0000 7f6fa2200640 1 --2- 172.21.15.144:0/392278508 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6f9c156150 0x7f6f9c0ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:07.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.966+0000 7f6fa2200640 1 --2- 172.21.15.144:0/392278508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f9c15d3b0 0x7f6f9c1f2d00 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:07.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.966+0000 7f6fa2200640 1 --2- 172.21.15.144:0/392278508 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6f9c0cd3b0 0x7f6f9c155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:07.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.966+0000 7f6fa2200640 1 -- 172.21.15.144:0/392278508 >> 172.21.15.144:0/392278508 conn(0x7f6f9c06bba0 msgr2=0x7f6f9c1566d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:07.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.966+0000 7f6fa2200640 1 -- 172.21.15.144:0/392278508 shutdown_connections 2024-09-11T23:24:07.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:07.967+0000 7f6fa2200640 1 -- 172.21.15.144:0/392278508 wait complete. 2024-09-11T23:24:07.985 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:24:07.985 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:24:08.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.138+0000 7f6a7be00640 1 Processor -- start 2024-09-11T23:24:08.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.138+0000 7f6a7be00640 1 -- start start 2024-09-11T23:24:08.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.139+0000 7f6a7be00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6a7c0b6d00 0x7f6a7c071490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:08.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.139+0000 7f6a7be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a7c0d1b00 0x7f6a7c15f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:08.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.139+0000 7f6a7be00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a7c0d22a0 con 0x7f6a7c0b70e0 2024-09-11T23:24:08.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.139+0000 7f6a7be00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6a7c0b5720 con 0x7f6a7c0b6d00 2024-09-11T23:24:08.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.139+0000 7f6a7be00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6a7c071000 con 0x7f6a7c0d1b00 2024-09-11T23:24:08.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.140+0000 7f6a7b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6a7c0b70e0 0x7f6a7c0d0370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57524/0 (socket says 172.21.15.144:57524) 2024-09-11T23:24:08.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.140+0000 7f6a7b400640 1 -- 172.21.15.144:0/2200040238 learned_addr learned my addr 172.21.15.144:0/2200040238 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:08.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.140+0000 7f6a7aa00640 1 --2- 172.21.15.144:0/2200040238 >> v2:172.21.15.165:3300/0 conn(0x7f6a7c0b6d00 0x7f6a7c071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:08.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.140+0000 7f6a7a000640 1 --2- 172.21.15.144:0/2200040238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a7c0d1b00 0x7f6a7c15f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:08.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.140+0000 7f6a79600640 1 -- 172.21.15.144:0/2200040238 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3511593759 0 0) 0x7f6a7c0d22a0 con 0x7f6a7c0b70e0 2024-09-11T23:24:08.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.140+0000 7f6a79600640 1 -- 172.21.15.144:0/2200040238 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a60003520 con 0x7f6a7c0b70e0 2024-09-11T23:24:08.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.140+0000 7f6a7aa00640 1 -- 172.21.15.144:0/2200040238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a7c0d1b00 msgr2=0x7f6a7c15f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:08.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.140+0000 7f6a7aa00640 1 --2- 172.21.15.144:0/2200040238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a7c0d1b00 0x7f6a7c15f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.140+0000 7f6a7aa00640 1 -- 172.21.15.144:0/2200040238 >> v1:172.21.15.144:6789/0 conn(0x7f6a7c0b70e0 legacy=0x7f6a7c0d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:08.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.140+0000 7f6a7aa00640 1 -- 172.21.15.144:0/2200040238 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a7c15fb40 con 0x7f6a7c0b6d00 2024-09-11T23:24:08.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.140+0000 7f6a7a000640 1 --2- 172.21.15.144:0/2200040238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a7c0d1b00 0x7f6a7c15f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:24:08.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.141+0000 7f6a7aa00640 1 --2- 172.21.15.144:0/2200040238 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a7c0b6d00 0x7f6a7c071490 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0097a0 tx=0x7f6a6c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22dcb9f206f53d03 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:08.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.142+0000 7f6a79600640 1 -- 172.21.15.144:0/2200040238 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c037070 con 0x7f6a7c0b6d00 2024-09-11T23:24:08.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.142+0000 7f6a79600640 1 -- 172.21.15.144:0/2200040238 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a6c032440 con 0x7f6a7c0b6d00 2024-09-11T23:24:08.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.142+0000 7f6a79600640 1 -- 172.21.15.144:0/2200040238 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c0327f0 con 0x7f6a7c0b6d00 2024-09-11T23:24:08.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.142+0000 7f6a7be00640 1 -- 172.21.15.144:0/2200040238 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a7c0b6d00 msgr2=0x7f6a7c071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:08.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.142+0000 7f6a7be00640 1 --2- 172.21.15.144:0/2200040238 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a7c0b6d00 0x7f6a7c071490 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0097a0 tx=0x7f6a6c02a180 comp rx=0 tx=0).stop 2024-09-11T23:24:08.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.142+0000 7f6a7be00640 1 -- 172.21.15.144:0/2200040238 shutdown_connections 2024-09-11T23:24:08.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.142+0000 7f6a7be00640 1 --2- 172.21.15.144:0/2200040238 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a7c0d1b00 0x7f6a7c15f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.142+0000 7f6a7be00640 1 --2- 172.21.15.144:0/2200040238 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a7c0b6d00 0x7f6a7c071490 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.142+0000 7f6a7be00640 1 -- 172.21.15.144:0/2200040238 >> 172.21.15.144:0/2200040238 conn(0x7f6a7c06f390 msgr2=0x7f6a7c06f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:08.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.142+0000 7f6a7be00640 1 -- 172.21.15.144:0/2200040238 shutdown_connections 2024-09-11T23:24:08.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.142+0000 7f6a7be00640 1 -- 172.21.15.144:0/2200040238 wait complete. 2024-09-11T23:24:08.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.144+0000 7f6a7be00640 1 Processor -- start 2024-09-11T23:24:08.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.144+0000 7f6a7be00640 1 -- start start 2024-09-11T23:24:08.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.145+0000 7f6a7be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a7c0b6d00 0x7f6a7c1f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:08.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.145+0000 7f6a7be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a7c0b70e0 0x7f6a7c0cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:08.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.145+0000 7f6a7be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a7c0d1b00 0x7f6a7c0ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:08.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.145+0000 7f6a7be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7c070c90 con 0x7f6a7c0b6d00 2024-09-11T23:24:08.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.145+0000 7f6a7be00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7c0709b0 con 0x7f6a7c0b70e0 2024-09-11T23:24:08.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.145+0000 7f6a7be00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6a7c0b7590 con 0x7f6a7c0d1b00 2024-09-11T23:24:08.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.145+0000 7f6a7aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a7c0b6d00 0x7f6a7c1f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:08.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.145+0000 7f6a7aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a7c0b6d00 0x7f6a7c1f80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50094/0 (socket says 172.21.15.144:50094) 2024-09-11T23:24:08.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.145+0000 7f6a7aa00640 1 -- 172.21.15.144:0/2882772722 learned_addr learned my addr 172.21.15.144:0/2882772722 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:08.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.145+0000 7f6a7aa00640 1 -- 172.21.15.144:0/2882772722 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a7c0d1b00 msgr2=0x7f6a7c0ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:08.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.145+0000 7f6a7aa00640 1 --2- 172.21.15.144:0/2882772722 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a7c0d1b00 0x7f6a7c0ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.145+0000 7f6a7aa00640 1 -- 172.21.15.144:0/2882772722 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a7c0b70e0 msgr2=0x7f6a7c0cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:08.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.145+0000 7f6a7aa00640 1 --2- 172.21.15.144:0/2882772722 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a7c0b70e0 0x7f6a7c0cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.145+0000 7f6a7aa00640 1 -- 172.21.15.144:0/2882772722 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a7c0cc8e0 con 0x7f6a7c0b6d00 2024-09-11T23:24:08.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.146+0000 7f6a7aa00640 1 --2- 172.21.15.144:0/2882772722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a7c0b6d00 0x7f6a7c1f80d0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c035040 tx=0x7f6a6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:08.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.146+0000 7f6a73400640 1 -- 172.21.15.144:0/2882772722 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c037040 con 0x7f6a7c0b6d00 2024-09-11T23:24:08.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.146+0000 7f6a73400640 1 -- 172.21.15.144:0/2882772722 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a6c0044c0 con 0x7f6a7c0b6d00 2024-09-11T23:24:08.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.146+0000 7f6a7be00640 1 -- 172.21.15.144:0/2882772722 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a7c0cc040 con 0x7f6a7c0b6d00 2024-09-11T23:24:08.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.146+0000 7f6a73400640 1 -- 172.21.15.144:0/2882772722 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c0325f0 con 0x7f6a7c0b6d00 2024-09-11T23:24:08.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.146+0000 7f6a7be00640 1 -- 172.21.15.144:0/2882772722 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a7c0cc600 con 0x7f6a7c0b6d00 2024-09-11T23:24:08.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.147+0000 7f6a7be00640 1 -- 172.21.15.144:0/2882772722 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a7c158f50 con 0x7f6a7c0b6d00 2024-09-11T23:24:08.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.148+0000 7f6a73400640 1 -- 172.21.15.144:0/2882772722 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f6a6c044020 con 0x7f6a7c0b6d00 2024-09-11T23:24:08.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.149+0000 7f6a73400640 1 --2- 172.21.15.144:0/2882772722 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6a5c06c220 0x7f6a5c06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:08.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.149+0000 7f6a73400640 1 -- 172.21.15.144:0/2882772722 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f6a6c0ab540 con 0x7f6a7c0b6d00 2024-09-11T23:24:08.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.149+0000 7f6a7a000640 1 --2- 172.21.15.144:0/2882772722 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6a5c06c220 0x7f6a5c06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:08.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.150+0000 7f6a7a000640 1 --2- 172.21.15.144:0/2882772722 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6a5c06c220 0x7f6a5c06e6e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6a68006e80 tx=0x7f6a68006dd0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:08.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.154+0000 7f6a73400640 1 -- 172.21.15.144:0/2882772722 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a7c15fb40 con 0x7f6a7c0b6d00 2024-09-11T23:24:08.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.365+0000 7f6a7be00640 1 -- 172.21.15.144:0/2882772722 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a7c0cd0a0 con 0x7f6a7c0b6d00 2024-09-11T23:24:08.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.365+0000 7f6a73400640 1 -- 172.21.15.144:0/2882772722 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5237 (secure 0 0 0) 0x7f6a6c079ab0 con 0x7f6a7c0b6d00 2024-09-11T23:24:08.366 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:08.367 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":81,"btime":"2024-09-11T23:24:07:964174+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6997,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1218671521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1218671521},{"type":"v1","addr":"172.21.15.165:6835","nonce":1218671521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7000,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/4243031268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":4243031268},{"type":"v1","addr":"172.21.15.165:6834","nonce":4243031268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/1613796839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1613796839},{"type":"v1","addr":"172.21.15.144:6801","nonce":1613796839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:24:04.329682+0000","modified":"2024-09-11T23:24:07.364254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7389":{"gid":7389,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1311760947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1311760947},{"type":"v1","addr":"172.21.15.144:6835","nonce":1311760947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7389,"qdb_cluster":[7389]},"id":9}]} 2024-09-11T23:24:08.367 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 81 2024-09-11T23:24:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.367+0000 7f6a7be00640 1 -- 172.21.15.144:0/2882772722 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6a5c06c220 msgr2=0x7f6a5c06e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.367+0000 7f6a7be00640 1 --2- 172.21.15.144:0/2882772722 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6a5c06c220 0x7f6a5c06e6e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6a68006e80 tx=0x7f6a68006dd0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.367+0000 7f6a7be00640 1 -- 172.21.15.144:0/2882772722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a7c0b6d00 msgr2=0x7f6a7c1f80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.367+0000 7f6a7be00640 1 --2- 172.21.15.144:0/2882772722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a7c0b6d00 0x7f6a7c1f80d0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c035040 tx=0x7f6a6c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.367+0000 7f6a7be00640 1 -- 172.21.15.144:0/2882772722 shutdown_connections 2024-09-11T23:24:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.367+0000 7f6a7be00640 1 --2- 172.21.15.144:0/2882772722 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6a5c06c220 0x7f6a5c06e6e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.367+0000 7f6a7be00640 1 --2- 172.21.15.144:0/2882772722 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a7c0d1b00 0x7f6a7c0ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.367+0000 7f6a7be00640 1 --2- 172.21.15.144:0/2882772722 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a7c0b70e0 0x7f6a7c0cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.368+0000 7f6a7be00640 1 --2- 172.21.15.144:0/2882772722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a7c0b6d00 0x7f6a7c1f80d0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.368+0000 7f6a7be00640 1 -- 172.21.15.144:0/2882772722 >> 172.21.15.144:0/2882772722 conn(0x7f6a7c06f390 msgr2=0x7f6a7c074c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.368+0000 7f6a7be00640 1 -- 172.21.15.144:0/2882772722 shutdown_connections 2024-09-11T23:24:08.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.368+0000 7f6a7be00640 1 -- 172.21.15.144:0/2882772722 wait complete. 2024-09-11T23:24:08.385 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:24:08.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.537+0000 7f57c9200640 1 Processor -- start 2024-09-11T23:24:08.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.537+0000 7f57c9200640 1 -- start start 2024-09-11T23:24:08.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.538+0000 7f57c9200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f57c4151c50 0x7f57c40cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:08.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.538+0000 7f57c9200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f57c406c1f0 0x7f57c415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:08.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.538+0000 7f57c9200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57c40cd5f0 con 0x7f57c406be10 2024-09-11T23:24:08.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.538+0000 7f57c9200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f57c40cd8d0 con 0x7f57c406c1f0 2024-09-11T23:24:08.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.538+0000 7f57c9200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f57c40cdbb0 con 0x7f57c4151c50 2024-09-11T23:24:08.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.539+0000 7f57c2800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f57c406c1f0 0x7f57c415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:08.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.539+0000 7f57c2800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f57c406c1f0 0x7f57c415baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50106/0 (socket says 172.21.15.144:50106) 2024-09-11T23:24:08.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.539+0000 7f57c2800640 1 -- 172.21.15.144:0/3206033855 learned_addr learned my addr 172.21.15.144:0/3206033855 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:08.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.539+0000 7f57b9400640 1 --2- 172.21.15.144:0/3206033855 >> v2:172.21.15.165:3300/0 conn(0x7f57c4151c50 0x7f57c40cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:08.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.539+0000 7f57c2800640 1 -- 172.21.15.144:0/3206033855 >> v2:172.21.15.165:3300/0 conn(0x7f57c4151c50 msgr2=0x7f57c40cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:08.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.539+0000 7f57c2800640 1 --2- 172.21.15.144:0/3206033855 >> v2:172.21.15.165:3300/0 conn(0x7f57c4151c50 0x7f57c40cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.539+0000 7f57c2800640 1 -- 172.21.15.144:0/3206033855 >> v1:172.21.15.165:6789/0 conn(0x7f57c406be10 legacy=0x7f57c4151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:08.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.539+0000 7f57c2800640 1 -- 172.21.15.144:0/3206033855 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c40cde90 con 0x7f57c406c1f0 2024-09-11T23:24:08.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.540+0000 7f57c2800640 1 --2- 172.21.15.144:0/3206033855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57c406c1f0 0x7f57c415baa0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f57c406ca50 tx=0x7f57bc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4daafdc0f38267a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:08.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.540+0000 7f57c1400640 1 -- 172.21.15.144:0/3206033855 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57bc036070 con 0x7f57c406c1f0 2024-09-11T23:24:08.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.540+0000 7f57c1400640 1 -- 172.21.15.144:0/3206033855 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57bc031600 con 0x7f57c406c1f0 2024-09-11T23:24:08.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.541+0000 7f57c1400640 1 -- 172.21.15.144:0/3206033855 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57bc0319d0 con 0x7f57c406c1f0 2024-09-11T23:24:08.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.541+0000 7f57c9200640 1 -- 172.21.15.144:0/3206033855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57c406c1f0 msgr2=0x7f57c415baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:08.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.541+0000 7f57c9200640 1 --2- 172.21.15.144:0/3206033855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57c406c1f0 0x7f57c415baa0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f57c406ca50 tx=0x7f57bc02a6f0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.541+0000 7f57c9200640 1 -- 172.21.15.144:0/3206033855 shutdown_connections 2024-09-11T23:24:08.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.541+0000 7f57c9200640 1 --2- 172.21.15.144:0/3206033855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57c406c1f0 0x7f57c415baa0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.541+0000 7f57c9200640 1 --2- 172.21.15.144:0/3206033855 >> v2:172.21.15.165:3300/0 conn(0x7f57c4151c50 0x7f57c40cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.541+0000 7f57c9200640 1 -- 172.21.15.144:0/3206033855 >> 172.21.15.144:0/3206033855 conn(0x7f57c4062cc0 msgr2=0x7f57c406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:08.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.541+0000 7f57c9200640 1 -- 172.21.15.144:0/3206033855 shutdown_connections 2024-09-11T23:24:08.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.541+0000 7f57c9200640 1 -- 172.21.15.144:0/3206033855 wait complete. 2024-09-11T23:24:08.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.543+0000 7f57c9200640 1 Processor -- start 2024-09-11T23:24:08.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.543+0000 7f57c9200640 1 -- start start 2024-09-11T23:24:08.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.544+0000 7f57c9200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57c406be10 0x7f57c414d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:08.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.544+0000 7f57c9200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57c406c1f0 0x7f57c40b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:08.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.544+0000 7f57c9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57c4151c50 0x7f57c40b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:08.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.544+0000 7f57c9200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f57c40d0310 con 0x7f57c4151c50 2024-09-11T23:24:08.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.544+0000 7f57c9200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f57c40ce690 con 0x7f57c406be10 2024-09-11T23:24:08.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.544+0000 7f57c9200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f57c40d0490 con 0x7f57c406c1f0 2024-09-11T23:24:08.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.544+0000 7f57c2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57c4151c50 0x7f57c40b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:08.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.544+0000 7f57c2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57c4151c50 0x7f57c40b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50108/0 (socket says 172.21.15.144:50108) 2024-09-11T23:24:08.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.544+0000 7f57c2800640 1 -- 172.21.15.144:0/1473650925 learned_addr learned my addr 172.21.15.144:0/1473650925 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:08.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.544+0000 7f57b9400640 1 --2- 172.21.15.144:0/1473650925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57c406c1f0 0x7f57c40b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:08.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.544+0000 7f57c1e00640 1 --2- 172.21.15.144:0/1473650925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57c406be10 0x7f57c414d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:08.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.545+0000 7f57c2800640 1 -- 172.21.15.144:0/1473650925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57c406c1f0 msgr2=0x7f57c40b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:08.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.545+0000 7f57c2800640 1 --2- 172.21.15.144:0/1473650925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57c406c1f0 0x7f57c40b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.545+0000 7f57c2800640 1 -- 172.21.15.144:0/1473650925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57c406be10 msgr2=0x7f57c414d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:08.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.545+0000 7f57c2800640 1 --2- 172.21.15.144:0/1473650925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57c406be10 0x7f57c414d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.545+0000 7f57c2800640 1 -- 172.21.15.144:0/1473650925 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c4153280 con 0x7f57c4151c50 2024-09-11T23:24:08.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.545+0000 7f57c2800640 1 --2- 172.21.15.144:0/1473650925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57c4151c50 0x7f57c40b1670 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f57bc009f40 tx=0x7f57bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:08.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.545+0000 7f57baa00640 1 -- 172.21.15.144:0/1473650925 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57bc036050 con 0x7f57c4151c50 2024-09-11T23:24:08.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.545+0000 7f57baa00640 1 -- 172.21.15.144:0/1473650925 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57bc042070 con 0x7f57c4151c50 2024-09-11T23:24:08.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.545+0000 7f57baa00640 1 -- 172.21.15.144:0/1473650925 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57bc009510 con 0x7f57c4151c50 2024-09-11T23:24:08.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.545+0000 7f57c9200640 1 -- 172.21.15.144:0/1473650925 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57c41521e0 con 0x7f57c4151c50 2024-09-11T23:24:08.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.545+0000 7f57c9200640 1 -- 172.21.15.144:0/1473650925 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57c41527a0 con 0x7f57c4151c50 2024-09-11T23:24:08.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.546+0000 7f57c9200640 1 -- 172.21.15.144:0/1473650925 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57c40d0850 con 0x7f57c4151c50 2024-09-11T23:24:08.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.547+0000 7f57baa00640 1 -- 172.21.15.144:0/1473650925 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f57bc007bd0 con 0x7f57c4151c50 2024-09-11T23:24:08.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.548+0000 7f57baa00640 1 --2- 172.21.15.144:0/1473650925 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f57a006c220 0x7f57a006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:08.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.548+0000 7f57baa00640 1 -- 172.21.15.144:0/1473650925 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f57bc0ac3c0 con 0x7f57c4151c50 2024-09-11T23:24:08.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.549+0000 7f57c1e00640 1 --2- 172.21.15.144:0/1473650925 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f57a006c220 0x7f57a006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:08.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.549+0000 7f57c1e00640 1 --2- 172.21.15.144:0/1473650925 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f57a006c220 0x7f57a006e6e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f57c4151c20 tx=0x7f57b4007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:08.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.553+0000 7f57baa00640 1 -- 172.21.15.144:0/1473650925 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f57bc07a0c0 con 0x7f57c4151c50 2024-09-11T23:24:08.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.729+0000 7f57c9200640 1 -- 172.21.15.144:0/1473650925 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f57c40ceb30 con 0x7f57c4151c50 2024-09-11T23:24:08.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.731+0000 7f57baa00640 1 -- 172.21.15.144:0/1473650925 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+16763 (secure 0 0 0) 0x7f57bc07e3c0 con 0x7f57c4151c50 2024-09-11T23:24:08.731 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:08.731 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":116,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:24:05.939198+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:24:02.109644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-11T23:24:03.330949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:24:08.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.732+0000 7f57c9200640 1 -- 172.21.15.144:0/1473650925 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f57a006c220 msgr2=0x7f57a006e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:08.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.732+0000 7f57c9200640 1 --2- 172.21.15.144:0/1473650925 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f57a006c220 0x7f57a006e6e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f57c4151c20 tx=0x7f57b4007e30 comp rx=0 tx=0).stop 2024-09-11T23:24:08.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.732+0000 7f57c9200640 1 -- 172.21.15.144:0/1473650925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57c4151c50 msgr2=0x7f57c40b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:08.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.732+0000 7f57c9200640 1 --2- 172.21.15.144:0/1473650925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57c4151c50 0x7f57c40b1670 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f57bc009f40 tx=0x7f57bc004a40 comp rx=0 tx=0).stop 2024-09-11T23:24:08.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.733+0000 7f57c9200640 1 -- 172.21.15.144:0/1473650925 shutdown_connections 2024-09-11T23:24:08.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.733+0000 7f57c9200640 1 --2- 172.21.15.144:0/1473650925 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f57a006c220 0x7f57a006e6e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.733+0000 7f57c9200640 1 --2- 172.21.15.144:0/1473650925 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57c4151c50 0x7f57c40b1670 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.733+0000 7f57c9200640 1 --2- 172.21.15.144:0/1473650925 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f57c406c1f0 0x7f57c40b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.733+0000 7f57c9200640 1 --2- 172.21.15.144:0/1473650925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57c406be10 0x7f57c414d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.733+0000 7f57c9200640 1 -- 172.21.15.144:0/1473650925 >> 172.21.15.144:0/1473650925 conn(0x7f57c4062cc0 msgr2=0x7f57c4157f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:08.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.733+0000 7f57c9200640 1 -- 172.21.15.144:0/1473650925 shutdown_connections 2024-09-11T23:24:08.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.733+0000 7f57c9200640 1 -- 172.21.15.144:0/1473650925 wait complete. 2024-09-11T23:24:08.750 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:24:08.750 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:24:08.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.904+0000 7fb176200640 1 Processor -- start 2024-09-11T23:24:08.904 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.904+0000 7fb176200640 1 -- start start 2024-09-11T23:24:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.904+0000 7fb176200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb17015e960 0x7fb1700b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.904+0000 7fb176200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb170073390 0x7fb1700cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.904+0000 7fb176200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb170073cb0 0x7fb1700b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.904+0000 7fb176200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb1700b78a0 con 0x7fb17015e960 2024-09-11T23:24:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.904+0000 7fb176200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb17015ed40 con 0x7fb170073cb0 2024-09-11T23:24:08.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.904+0000 7fb176200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb17006ce50 con 0x7fb170073390 2024-09-11T23:24:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.904+0000 7fb16f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb17015e960 0x7fb1700b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.905+0000 7fb16f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb17015e960 0x7fb1700b6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50112/0 (socket says 172.21.15.144:50112) 2024-09-11T23:24:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.905+0000 7fb16f400640 1 -- 172.21.15.144:0/3345037100 learned_addr learned my addr 172.21.15.144:0/3345037100 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.905+0000 7fb16fe00640 1 --2- 172.21.15.144:0/3345037100 >> v2:172.21.15.165:3300/0 conn(0x7fb170073cb0 0x7fb1700b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.905+0000 7fb16ea00640 1 --2- 172.21.15.144:0/3345037100 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb170073390 0x7fb1700cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.905+0000 7fb16f400640 1 -- 172.21.15.144:0/3345037100 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb170073390 msgr2=0x7fb1700cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.905+0000 7fb16f400640 1 --2- 172.21.15.144:0/3345037100 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb170073390 0x7fb1700cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.905+0000 7fb16f400640 1 -- 172.21.15.144:0/3345037100 >> v2:172.21.15.165:3300/0 conn(0x7fb170073cb0 msgr2=0x7fb1700b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.905+0000 7fb16f400640 1 --2- 172.21.15.144:0/3345037100 >> v2:172.21.15.165:3300/0 conn(0x7fb170073cb0 0x7fb1700b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.905+0000 7fb16f400640 1 -- 172.21.15.144:0/3345037100 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1700b72e0 con 0x7fb17015e960 2024-09-11T23:24:08.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.905+0000 7fb16fe00640 1 --2- 172.21.15.144:0/3345037100 >> v2:172.21.15.165:3300/0 conn(0x7fb170073cb0 0x7fb1700b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:08.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.906+0000 7fb16f400640 1 --2- 172.21.15.144:0/3345037100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb17015e960 0x7fb1700b6ce0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fb170073270 tx=0x7fb16002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1978fafb45679afb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:08.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.906+0000 7fb16e000640 1 -- 172.21.15.144:0/3345037100 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160037070 con 0x7fb17015e960 2024-09-11T23:24:08.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.906+0000 7fb16e000640 1 -- 172.21.15.144:0/3345037100 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb160032440 con 0x7fb17015e960 2024-09-11T23:24:08.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.906+0000 7fb16e000640 1 -- 172.21.15.144:0/3345037100 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160032810 con 0x7fb17015e960 2024-09-11T23:24:08.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.907+0000 7fb176200640 1 -- 172.21.15.144:0/3345037100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb17015e960 msgr2=0x7fb1700b6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:08.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.907+0000 7fb176200640 1 --2- 172.21.15.144:0/3345037100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb17015e960 0x7fb1700b6ce0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fb170073270 tx=0x7fb16002a1e0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.907+0000 7fb176200640 1 -- 172.21.15.144:0/3345037100 shutdown_connections 2024-09-11T23:24:08.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.907+0000 7fb176200640 1 --2- 172.21.15.144:0/3345037100 >> v2:172.21.15.165:3300/0 conn(0x7fb170073cb0 0x7fb1700b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.907+0000 7fb176200640 1 --2- 172.21.15.144:0/3345037100 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb170073390 0x7fb1700cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.907+0000 7fb176200640 1 --2- 172.21.15.144:0/3345037100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb17015e960 0x7fb1700b6ce0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.907+0000 7fb176200640 1 -- 172.21.15.144:0/3345037100 >> 172.21.15.144:0/3345037100 conn(0x7fb170062810 msgr2=0x7fb170062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:08.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.907+0000 7fb176200640 1 -- 172.21.15.144:0/3345037100 shutdown_connections 2024-09-11T23:24:08.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.907+0000 7fb176200640 1 -- 172.21.15.144:0/3345037100 wait complete. 2024-09-11T23:24:08.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.909+0000 7fb176200640 1 Processor -- start 2024-09-11T23:24:08.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.909+0000 7fb176200640 1 -- start start 2024-09-11T23:24:08.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.910+0000 7fb176200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb170073390 0x7fb170156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:08.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.910+0000 7fb176200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb170073cb0 0x7fb1701613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:08.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.910+0000 7fb176200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb17015e960 0x7fb1700d0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:08.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.910+0000 7fb176200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb1700b4a00 con 0x7fb170073390 2024-09-11T23:24:08.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.910+0000 7fb176200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb17006d0f0 con 0x7fb170073cb0 2024-09-11T23:24:08.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.910+0000 7fb176200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb1700b4b80 con 0x7fb17015e960 2024-09-11T23:24:08.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.910+0000 7fb16f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb170073390 0x7fb170156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:08.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.910+0000 7fb16f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb170073390 0x7fb170156070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50120/0 (socket says 172.21.15.144:50120) 2024-09-11T23:24:08.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.910+0000 7fb16f400640 1 -- 172.21.15.144:0/2757236377 learned_addr learned my addr 172.21.15.144:0/2757236377 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:08.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.910+0000 7fb16ea00640 1 --2- 172.21.15.144:0/2757236377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb170073cb0 0x7fb1701613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:08.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.910+0000 7fb16fe00640 1 --2- 172.21.15.144:0/2757236377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb17015e960 0x7fb1700d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:08.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.910+0000 7fb16f400640 1 -- 172.21.15.144:0/2757236377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb17015e960 msgr2=0x7fb1700d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:08.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.910+0000 7fb16f400640 1 --2- 172.21.15.144:0/2757236377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb17015e960 0x7fb1700d0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.910+0000 7fb16f400640 1 -- 172.21.15.144:0/2757236377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb170073cb0 msgr2=0x7fb1701613f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:08.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.910+0000 7fb16f400640 1 --2- 172.21.15.144:0/2757236377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb170073cb0 0x7fb1701613f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:08.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.910+0000 7fb16f400640 1 -- 172.21.15.144:0/2757236377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb170161d60 con 0x7fb170073390 2024-09-11T23:24:08.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.911+0000 7fb16f400640 1 --2- 172.21.15.144:0/2757236377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb170073390 0x7fb170156070 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fb160000c00 tx=0x7fb1600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:08.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.911+0000 7fb167400640 1 -- 172.21.15.144:0/2757236377 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160041020 con 0x7fb170073390 2024-09-11T23:24:08.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.911+0000 7fb167400640 1 -- 172.21.15.144:0/2757236377 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1600306c0 con 0x7fb170073390 2024-09-11T23:24:08.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.911+0000 7fb167400640 1 -- 172.21.15.144:0/2757236377 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160037040 con 0x7fb170073390 2024-09-11T23:24:08.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.911+0000 7fb176200640 1 -- 172.21.15.144:0/2757236377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1700cf110 con 0x7fb170073390 2024-09-11T23:24:08.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.911+0000 7fb176200640 1 -- 172.21.15.144:0/2757236377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1701565b0 con 0x7fb170073390 2024-09-11T23:24:08.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.912+0000 7fb176200640 1 -- 172.21.15.144:0/2757236377 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1700cef00 con 0x7fb170073390 2024-09-11T23:24:08.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.913+0000 7fb167400640 1 -- 172.21.15.144:0/2757236377 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7fb160044020 con 0x7fb170073390 2024-09-11T23:24:08.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.914+0000 7fb167400640 1 --2- 172.21.15.144:0/2757236377 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb15006c220 0x7fb15006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:08.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.914+0000 7fb167400640 1 -- 172.21.15.144:0/2757236377 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7fb1600abc40 con 0x7fb170073390 2024-09-11T23:24:08.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.915+0000 7fb16ea00640 1 --2- 172.21.15.144:0/2757236377 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb15006c220 0x7fb15006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:08.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.915+0000 7fb16ea00640 1 --2- 172.21.15.144:0/2757236377 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb15006c220 0x7fb15006e6e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb15c006fd0 tx=0x7fb15c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:08.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:08.919+0000 7fb167400640 1 -- 172.21.15.144:0/2757236377 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb16004b030 con 0x7fb170073390 2024-09-11T23:24:09.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.091+0000 7fb176200640 1 -- 172.21.15.144:0/2757236377 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb1700b44c0 con 0x7fb15006c220 2024-09-11T23:24:09.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.099+0000 7fb167400640 1 -- 172.21.15.144:0/2757236377 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252413 (secure 0 0 0) 0x7fb1700b44c0 con 0x7fb15006c220 2024-09-11T23:24:09.102 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:09.104 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:24:09.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.103+0000 7fb176200640 1 -- 172.21.15.144:0/2757236377 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb15006c220 msgr2=0x7fb15006e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:09.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.103+0000 7fb176200640 1 --2- 172.21.15.144:0/2757236377 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb15006c220 0x7fb15006e6e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb15c006fd0 tx=0x7fb15c008040 comp rx=0 tx=0).stop 2024-09-11T23:24:09.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.103+0000 7fb176200640 1 -- 172.21.15.144:0/2757236377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb170073390 msgr2=0x7fb170156070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:09.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.103+0000 7fb176200640 1 --2- 172.21.15.144:0/2757236377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb170073390 0x7fb170156070 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fb160000c00 tx=0x7fb1600046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.103+0000 7fb176200640 1 -- 172.21.15.144:0/2757236377 shutdown_connections 2024-09-11T23:24:09.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.103+0000 7fb176200640 1 --2- 172.21.15.144:0/2757236377 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb15006c220 0x7fb15006e6e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.103+0000 7fb176200640 1 --2- 172.21.15.144:0/2757236377 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb17015e960 0x7fb1700d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.103+0000 7fb176200640 1 --2- 172.21.15.144:0/2757236377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb170073cb0 0x7fb1701613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.103+0000 7fb176200640 1 --2- 172.21.15.144:0/2757236377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb170073390 0x7fb170156070 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.103+0000 7fb176200640 1 -- 172.21.15.144:0/2757236377 >> 172.21.15.144:0/2757236377 conn(0x7fb170062810 msgr2=0x7fb1700d2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:09.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.103+0000 7fb176200640 1 -- 172.21.15.144:0/2757236377 shutdown_connections 2024-09-11T23:24:09.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.103+0000 7fb176200640 1 -- 172.21.15.144:0/2757236377 wait complete. 2024-09-11T23:24:09.119 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2024-09-11T23:24:08.739472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":223,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261872,"kb_used_data":12340,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712848,"statfs":{"total":773094113280,"available":772825956352,"internally_reserved":0,"allocated":12636160,"data_stored":6178813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.827390"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.959436+0000","last_change":"2024-09-11T23:24:04.956158+0000","last_active":"2024-09-11T23:24:04.959436+0000","last_peered":"2024-09-11T23:24:04.959436+0000","last_clean":"2024-09-11T23:24:04.959436+0000","last_became_active":"2024-09-11T23:24:04.954399+0000","last_became_peered":"2024-09-11T23:24:04.954399+0000","last_unstale":"2024-09-11T23:24:04.959436+0000","last_undegraded":"2024-09-11T23:24:04.959436+0000","last_fullsized":"2024-09-11T23:24:04.959436+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:37.650729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960023+0000","last_change":"2024-09-11T23:24:04.948584+0000","last_active":"2024-09-11T23:24:04.960023+0000","last_peered":"2024-09-11T23:24:04.960023+0000","last_clean":"2024-09-11T23:24:04.960023+0000","last_became_active":"2024-09-11T23:24:04.945971+0000","last_became_peered":"2024-09-11T23:24:04.945971+0000","last_unstale":"2024-09-11T23:24:04.960023+0000","last_undegraded":"2024-09-11T23:24:04.960023+0000","last_fullsized":"2024-09-11T23:24:04.960023+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:54.830956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.956600+0000","last_change":"2024-09-11T23:24:04.948596+0000","last_active":"2024-09-11T23:24:04.956600+0000","last_peered":"2024-09-11T23:24:04.956600+0000","last_clean":"2024-09-11T23:24:04.956600+0000","last_became_active":"2024-09-11T23:24:04.947736+0000","last_became_peered":"2024-09-11T23:24:04.947736+0000","last_unstale":"2024-09-11T23:24:04.956600+0000","last_undegraded":"2024-09-11T23:24:04.956600+0000","last_fullsized":"2024-09-11T23:24:04.956600+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:45.595996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.958648+0000","last_change":"2024-09-11T23:24:04.955035+0000","last_active":"2024-09-11T23:24:04.958648+0000","last_peered":"2024-09-11T23:24:04.958648+0000","last_clean":"2024-09-11T23:24:04.958648+0000","last_became_active":"2024-09-11T23:24:04.953671+0000","last_became_peered":"2024-09-11T23:24:04.953671+0000","last_unstale":"2024-09-11T23:24:04.958648+0000","last_undegraded":"2024-09-11T23:24:04.958648+0000","last_fullsized":"2024-09-11T23:24:04.958648+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:24.608969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.969363+0000","last_change":"2024-09-11T23:24:04.965349+0000","last_active":"2024-09-11T23:24:04.969363+0000","last_peered":"2024-09-11T23:24:04.969363+0000","last_clean":"2024-09-11T23:24:04.969363+0000","last_became_active":"2024-09-11T23:24:04.964846+0000","last_became_peered":"2024-09-11T23:24:04.964846+0000","last_unstale":"2024-09-11T23:24:04.969363+0000","last_undegraded":"2024-09-11T23:24:04.969363+0000","last_fullsized":"2024-09-11T23:24:04.969363+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:40.761839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.962569+0000","last_change":"2024-09-11T23:24:04.958210+0000","last_active":"2024-09-11T23:24:04.962569+0000","last_peered":"2024-09-11T23:24:04.962569+0000","last_clean":"2024-09-11T23:24:04.962569+0000","last_became_active":"2024-09-11T23:24:04.957941+0000","last_became_peered":"2024-09-11T23:24:04.957941+0000","last_unstale":"2024-09-11T23:24:04.962569+0000","last_undegraded":"2024-09-11T23:24:04.962569+0000","last_fullsized":"2024-09-11T23:24:04.962569+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:21.597655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960850+0000","last_change":"2024-09-11T23:24:04.950615+0000","last_active":"2024-09-11T23:24:04.960850+0000","last_peered":"2024-09-11T23:24:04.960850+0000","last_clean":"2024-09-11T23:24:04.960850+0000","last_became_active":"2024-09-11T23:24:04.950313+0000","last_became_peered":"2024-09-11T23:24:04.950313+0000","last_unstale":"2024-09-11T23:24:04.960850+0000","last_undegraded":"2024-09-11T23:24:04.960850+0000","last_fullsized":"2024-09-11T23:24:04.960850+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:43.259244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.951827+0000","last_change":"2024-09-11T23:24:04.946848+0000","last_active":"2024-09-11T23:24:04.951827+0000","last_peered":"2024-09-11T23:24:04.951827+0000","last_clean":"2024-09-11T23:24:04.951827+0000","last_became_active":"2024-09-11T23:24:04.946565+0000","last_became_peered":"2024-09-11T23:24:04.946565+0000","last_unstale":"2024-09-11T23:24:04.951827+0000","last_undegraded":"2024-09-11T23:24:04.951827+0000","last_fullsized":"2024-09-11T23:24:04.951827+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:27.929111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960321+0000","last_change":"2024-09-11T23:24:04.954556+0000","last_active":"2024-09-11T23:24:04.960321+0000","last_peered":"2024-09-11T23:24:04.960321+0000","last_clean":"2024-09-11T23:24:04.960321+0000","last_became_active":"2024-09-11T23:24:04.954255+0000","last_became_peered":"2024-09-11T23:24:04.954255+0000","last_unstale":"2024-09-11T23:24:04.960321+0000","last_undegraded":"2024-09-11T23:24:04.960321+0000","last_fullsized":"2024-09-11T23:24:04.960321+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:39.751589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960044+0000","last_change":"2024-09-11T23:24:04.952412+0000","last_active":"2024-09-11T23:24:04.960044+0000","last_peered":"2024-09-11T23:24:04.960044+0000","last_clean":"2024-09-11T23:24:04.960044+0000","last_became_active":"2024-09-11T23:24:04.945614+0000","last_became_peered":"2024-09-11T23:24:04.945614+0000","last_unstale":"2024-09-11T23:24:04.960044+0000","last_undegraded":"2024-09-11T23:24:04.960044+0000","last_fullsized":"2024-09-11T23:24:04.960044+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:45.595996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.955473+0000","last_change":"2024-09-11T23:24:04.949123+0000","last_active":"2024-09-11T23:24:04.955473+0000","last_peered":"2024-09-11T23:24:04.955473+0000","last_clean":"2024-09-11T23:24:04.955473+0000","last_became_active":"2024-09-11T23:24:04.945722+0000","last_became_peered":"2024-09-11T23:24:04.945722+0000","last_unstale":"2024-09-11T23:24:04.955473+0000","last_undegraded":"2024-09-11T23:24:04.955473+0000","last_fullsized":"2024-09-11T23:24:04.955473+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:44.096054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.951221+0000","last_change":"2024-09-11T23:24:04.946137+0000","last_active":"2024-09-11T23:24:04.951221+0000","last_peered":"2024-09-11T23:24:04.951221+0000","last_clean":"2024-09-11T23:24:04.951221+0000","last_became_active":"2024-09-11T23:24:04.945810+0000","last_became_peered":"2024-09-11T23:24:04.945810+0000","last_unstale":"2024-09-11T23:24:04.951221+0000","last_undegraded":"2024-09-11T23:24:04.951221+0000","last_fullsized":"2024-09-11T23:24:04.951221+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:54.830956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.959635+0000","last_change":"2024-09-11T23:24:04.956313+0000","last_active":"2024-09-11T23:24:04.959635+0000","last_peered":"2024-09-11T23:24:04.959635+0000","last_clean":"2024-09-11T23:24:04.959635+0000","last_became_active":"2024-09-11T23:24:04.954430+0000","last_became_peered":"2024-09-11T23:24:04.954430+0000","last_unstale":"2024-09-11T23:24:04.959635+0000","last_undegraded":"2024-09-11T23:24:04.959635+0000","last_fullsized":"2024-09-11T23:24:04.959635+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:22.813663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960478+0000","last_change":"2024-09-11T23:24:04.951813+0000","last_active":"2024-09-11T23:24:04.960478+0000","last_peered":"2024-09-11T23:24:04.960478+0000","last_clean":"2024-09-11T23:24:04.960478+0000","last_became_active":"2024-09-11T23:24:04.944718+0000","last_became_peered":"2024-09-11T23:24:04.944718+0000","last_unstale":"2024-09-11T23:24:04.960478+0000","last_undegraded":"2024-09-11T23:24:04.960478+0000","last_fullsized":"2024-09-11T23:24:04.960478+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:27.929111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.958280+0000","last_change":"2024-09-11T23:24:04.950855+0000","last_active":"2024-09-11T23:24:04.958280+0000","last_peered":"2024-09-11T23:24:04.958280+0000","last_clean":"2024-09-11T23:24:04.958280+0000","last_became_active":"2024-09-11T23:24:04.950551+0000","last_became_peered":"2024-09-11T23:24:04.950551+0000","last_unstale":"2024-09-11T23:24:04.958280+0000","last_undegraded":"2024-09-11T23:24:04.958280+0000","last_fullsized":"2024-09-11T23:24:04.958280+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:00.053809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.956414+0000","last_change":"2024-09-11T23:24:04.952591+0000","last_active":"2024-09-11T23:24:04.956414+0000","last_peered":"2024-09-11T23:24:04.956414+0000","last_clean":"2024-09-11T23:24:04.956414+0000","last_became_active":"2024-09-11T23:24:04.951978+0000","last_became_peered":"2024-09-11T23:24:04.951978+0000","last_unstale":"2024-09-11T23:24:04.956414+0000","last_undegraded":"2024-09-11T23:24:04.956414+0000","last_fullsized":"2024-09-11T23:24:04.956414+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:53.391511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960166+0000","last_change":"2024-09-11T23:24:04.952219+0000","last_active":"2024-09-11T23:24:04.960166+0000","last_peered":"2024-09-11T23:24:04.960166+0000","last_clean":"2024-09-11T23:24:04.960166+0000","last_became_active":"2024-09-11T23:24:04.948927+0000","last_became_peered":"2024-09-11T23:24:04.948927+0000","last_unstale":"2024-09-11T23:24:04.960166+0000","last_undegraded":"2024-09-11T23:24:04.960166+0000","last_fullsized":"2024-09-11T23:24:04.960166+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:13.993691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.955218+0000","last_change":"2024-09-11T23:24:04.950535+0000","last_active":"2024-09-11T23:24:04.955218+0000","last_peered":"2024-09-11T23:24:04.955218+0000","last_clean":"2024-09-11T23:24:04.955218+0000","last_became_active":"2024-09-11T23:24:04.949570+0000","last_became_peered":"2024-09-11T23:24:04.949570+0000","last_unstale":"2024-09-11T23:24:04.955218+0000","last_undegraded":"2024-09-11T23:24:04.955218+0000","last_fullsized":"2024-09-11T23:24:04.955218+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:12.941055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.955497+0000","last_change":"2024-09-11T23:24:04.949195+0000","last_active":"2024-09-11T23:24:04.955497+0000","last_peered":"2024-09-11T23:24:04.955497+0000","last_clean":"2024-09-11T23:24:04.955497+0000","last_became_active":"2024-09-11T23:24:04.948939+0000","last_became_peered":"2024-09-11T23:24:04.948939+0000","last_unstale":"2024-09-11T23:24:04.955497+0000","last_undegraded":"2024-09-11T23:24:04.955497+0000","last_fullsized":"2024-09-11T23:24:04.955497+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:30.221462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.947332+0000","last_change":"2024-09-11T23:24:04.941274+0000","last_active":"2024-09-11T23:24:04.947332+0000","last_peered":"2024-09-11T23:24:04.947332+0000","last_clean":"2024-09-11T23:24:04.947332+0000","last_became_active":"2024-09-11T23:24:04.941000+0000","last_became_peered":"2024-09-11T23:24:04.941000+0000","last_unstale":"2024-09-11T23:24:04.947332+0000","last_undegraded":"2024-09-11T23:24:04.947332+0000","last_fullsized":"2024-09-11T23:24:04.947332+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:45.382617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.969332+0000","last_change":"2024-09-11T23:24:04.965113+0000","last_active":"2024-09-11T23:24:04.969332+0000","last_peered":"2024-09-11T23:24:04.969332+0000","last_clean":"2024-09-11T23:24:04.969332+0000","last_became_active":"2024-09-11T23:24:04.961957+0000","last_became_peered":"2024-09-11T23:24:04.961957+0000","last_unstale":"2024-09-11T23:24:04.969332+0000","last_undegraded":"2024-09-11T23:24:04.969332+0000","last_fullsized":"2024-09-11T23:24:04.969332+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:40.131359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.967253+0000","last_change":"2024-09-11T23:24:04.960923+0000","last_active":"2024-09-11T23:24:04.967253+0000","last_peered":"2024-09-11T23:24:04.967253+0000","last_clean":"2024-09-11T23:24:04.967253+0000","last_became_active":"2024-09-11T23:24:04.959688+0000","last_became_peered":"2024-09-11T23:24:04.959688+0000","last_unstale":"2024-09-11T23:24:04.967253+0000","last_undegraded":"2024-09-11T23:24:04.967253+0000","last_fullsized":"2024-09-11T23:24:04.967253+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:06.989579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960046+0000","last_change":"2024-09-11T23:24:04.953926+0000","last_active":"2024-09-11T23:24:04.960046+0000","last_peered":"2024-09-11T23:24:04.960046+0000","last_clean":"2024-09-11T23:24:04.960046+0000","last_became_active":"2024-09-11T23:24:04.952915+0000","last_became_peered":"2024-09-11T23:24:04.952915+0000","last_unstale":"2024-09-11T23:24:04.960046+0000","last_undegraded":"2024-09-11T23:24:04.960046+0000","last_fullsized":"2024-09-11T23:24:04.960046+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:53.613907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.953375+0000","last_change":"2024-09-11T23:24:04.947166+0000","last_active":"2024-09-11T23:24:04.953375+0000","last_peered":"2024-09-11T23:24:04.953375+0000","last_clean":"2024-09-11T23:24:04.953375+0000","last_became_active":"2024-09-11T23:24:04.946899+0000","last_became_peered":"2024-09-11T23:24:04.946899+0000","last_unstale":"2024-09-11T23:24:04.953375+0000","last_undegraded":"2024-09-11T23:24:04.953375+0000","last_fullsized":"2024-09-11T23:24:04.953375+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:39.848874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960104+0000","last_change":"2024-09-11T23:24:04.953810+0000","last_active":"2024-09-11T23:24:04.960104+0000","last_peered":"2024-09-11T23:24:04.960104+0000","last_clean":"2024-09-11T23:24:04.960104+0000","last_became_active":"2024-09-11T23:24:04.953588+0000","last_became_peered":"2024-09-11T23:24:04.953588+0000","last_unstale":"2024-09-11T23:24:04.960104+0000","last_undegraded":"2024-09-11T23:24:04.960104+0000","last_fullsized":"2024-09-11T23:24:04.960104+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:53.613907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.955196+0000","last_change":"2024-09-11T23:24:04.950597+0000","last_active":"2024-09-11T23:24:04.955196+0000","last_peered":"2024-09-11T23:24:04.955196+0000","last_clean":"2024-09-11T23:24:04.955196+0000","last_became_active":"2024-09-11T23:24:04.950350+0000","last_became_peered":"2024-09-11T23:24:04.950350+0000","last_unstale":"2024-09-11T23:24:04.955196+0000","last_undegraded":"2024-09-11T23:24:04.955196+0000","last_fullsized":"2024-09-11T23:24:04.955196+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:04.648612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.958950+0000","last_change":"2024-09-11T23:24:04.954075+0000","last_active":"2024-09-11T23:24:04.958950+0000","last_peered":"2024-09-11T23:24:04.958950+0000","last_clean":"2024-09-11T23:24:04.958950+0000","last_became_active":"2024-09-11T23:24:04.953794+0000","last_became_peered":"2024-09-11T23:24:04.953794+0000","last_unstale":"2024-09-11T23:24:04.958950+0000","last_undegraded":"2024-09-11T23:24:04.958950+0000","last_fullsized":"2024-09-11T23:24:04.958950+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:33.187674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960712+0000","last_change":"2024-09-11T23:24:04.949811+0000","last_active":"2024-09-11T23:24:04.960712+0000","last_peered":"2024-09-11T23:24:04.960712+0000","last_clean":"2024-09-11T23:24:04.960712+0000","last_became_active":"2024-09-11T23:24:04.949527+0000","last_became_peered":"2024-09-11T23:24:04.949527+0000","last_unstale":"2024-09-11T23:24:04.960712+0000","last_undegraded":"2024-09-11T23:24:04.960712+0000","last_fullsized":"2024-09-11T23:24:04.960712+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:31.079705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.966670+0000","last_change":"2024-09-11T23:24:04.958792+0000","last_active":"2024-09-11T23:24:04.966670+0000","last_peered":"2024-09-11T23:24:04.966670+0000","last_clean":"2024-09-11T23:24:04.966670+0000","last_became_active":"2024-09-11T23:24:04.954149+0000","last_became_peered":"2024-09-11T23:24:04.954149+0000","last_unstale":"2024-09-11T23:24:04.966670+0000","last_undegraded":"2024-09-11T23:24:04.966670+0000","last_fullsized":"2024-09-11T23:24:04.966670+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:36.295298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.958030+0000","last_change":"2024-09-11T23:24:04.947687+0000","last_active":"2024-09-11T23:24:04.958030+0000","last_peered":"2024-09-11T23:24:04.958030+0000","last_clean":"2024-09-11T23:24:04.958030+0000","last_became_active":"2024-09-11T23:24:04.946825+0000","last_became_peered":"2024-09-11T23:24:04.946825+0000","last_unstale":"2024-09-11T23:24:04.958030+0000","last_undegraded":"2024-09-11T23:24:04.958030+0000","last_fullsized":"2024-09-11T23:24:04.958030+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:52.462969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.969325+0000","last_change":"2024-09-11T23:24:04.967293+0000","last_active":"2024-09-11T23:24:04.969325+0000","last_peered":"2024-09-11T23:24:04.969325+0000","last_clean":"2024-09-11T23:24:04.969325+0000","last_became_active":"2024-09-11T23:24:04.965930+0000","last_became_peered":"2024-09-11T23:24:04.965930+0000","last_unstale":"2024-09-11T23:24:04.969325+0000","last_undegraded":"2024-09-11T23:24:04.969325+0000","last_fullsized":"2024-09-11T23:24:04.969325+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:22.293134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.947862+0000","last_change":"2024-09-11T23:24:04.942915+0000","last_active":"2024-09-11T23:24:04.947862+0000","last_peered":"2024-09-11T23:24:04.947862+0000","last_clean":"2024-09-11T23:24:04.947862+0000","last_became_active":"2024-09-11T23:24:04.942625+0000","last_became_peered":"2024-09-11T23:24:04.942625+0000","last_unstale":"2024-09-11T23:24:04.947862+0000","last_undegraded":"2024-09-11T23:24:04.947862+0000","last_fullsized":"2024-09-11T23:24:04.947862+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:27:19.119875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.942092+0000","last_change":"2024-09-11T23:24:04.939309+0000","last_active":"2024-09-11T23:24:04.942092+0000","last_peered":"2024-09-11T23:24:04.942092+0000","last_clean":"2024-09-11T23:24:04.942092+0000","last_became_active":"2024-09-11T23:24:04.939031+0000","last_became_peered":"2024-09-11T23:24:04.939031+0000","last_unstale":"2024-09-11T23:24:04.942092+0000","last_undegraded":"2024-09-11T23:24:04.942092+0000","last_fullsized":"2024-09-11T23:24:04.942092+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:31.840176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"115'4","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.970081+0000","last_change":"2024-09-11T23:24:03.936698+0000","last_active":"2024-09-11T23:24:04.970081+0000","last_peered":"2024-09-11T23:24:04.970081+0000","last_clean":"2024-09-11T23:24:04.970081+0000","last_became_active":"2024-09-11T23:24:03.934978+0000","last_became_peered":"2024-09-11T23:24:03.934978+0000","last_unstale":"2024-09-11T23:24:04.970081+0000","last_undegraded":"2024-09-11T23:24:04.970081+0000","last_fullsized":"2024-09-11T23:24:04.970081+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:10.057949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960359+0000","last_change":"2024-09-11T23:24:04.957947+0000","last_active":"2024-09-11T23:24:04.960359+0000","last_peered":"2024-09-11T23:24:04.960359+0000","last_clean":"2024-09-11T23:24:04.960359+0000","last_became_active":"2024-09-11T23:24:04.957681+0000","last_became_peered":"2024-09-11T23:24:04.957681+0000","last_unstale":"2024-09-11T23:24:04.960359+0000","last_undegraded":"2024-09-11T23:24:04.960359+0000","last_fullsized":"2024-09-11T23:24:04.960359+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:23.183110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"115'1","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.968327+0000","last_change":"2024-09-11T23:24:03.938446+0000","last_active":"2024-09-11T23:24:04.968327+0000","last_peered":"2024-09-11T23:24:04.968327+0000","last_clean":"2024-09-11T23:24:04.968327+0000","last_became_active":"2024-09-11T23:24:03.936288+0000","last_became_peered":"2024-09-11T23:24:03.936288+0000","last_unstale":"2024-09-11T23:24:04.968327+0000","last_undegraded":"2024-09-11T23:24:04.968327+0000","last_fullsized":"2024-09-11T23:24:04.968327+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:07.872337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.959026+0000","last_change":"2024-09-11T23:24:04.953469+0000","last_active":"2024-09-11T23:24:04.959026+0000","last_peered":"2024-09-11T23:24:04.959026+0000","last_clean":"2024-09-11T23:24:04.959026+0000","last_became_active":"2024-09-11T23:24:04.951873+0000","last_became_peered":"2024-09-11T23:24:04.951873+0000","last_unstale":"2024-09-11T23:24:04.959026+0000","last_undegraded":"2024-09-11T23:24:04.959026+0000","last_fullsized":"2024-09-11T23:24:04.959026+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:56.323763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"115'2","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.969289+0000","last_change":"2024-09-11T23:24:03.937291+0000","last_active":"2024-09-11T23:24:04.969289+0000","last_peered":"2024-09-11T23:24:04.969289+0000","last_clean":"2024-09-11T23:24:04.969289+0000","last_became_active":"2024-09-11T23:24:03.936974+0000","last_became_peered":"2024-09-11T23:24:03.936974+0000","last_unstale":"2024-09-11T23:24:04.969289+0000","last_undegraded":"2024-09-11T23:24:04.969289+0000","last_fullsized":"2024-09-11T23:24:04.969289+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:26.685102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.964513+0000","last_change":"2024-09-11T23:24:04.958496+0000","last_active":"2024-09-11T23:24:04.964513+0000","last_peered":"2024-09-11T23:24:04.964513+0000","last_clean":"2024-09-11T23:24:04.964513+0000","last_became_active":"2024-09-11T23:24:04.957909+0000","last_became_peered":"2024-09-11T23:24:04.957909+0000","last_unstale":"2024-09-11T23:24:04.964513+0000","last_undegraded":"2024-09-11T23:24:04.964513+0000","last_fullsized":"2024-09-11T23:24:04.964513+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:01.189307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"115'2","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.969418+0000","last_change":"2024-09-11T23:24:03.941887+0000","last_active":"2024-09-11T23:24:04.969418+0000","last_peered":"2024-09-11T23:24:04.969418+0000","last_clean":"2024-09-11T23:24:04.969418+0000","last_became_active":"2024-09-11T23:24:03.941376+0000","last_became_peered":"2024-09-11T23:24:03.941376+0000","last_unstale":"2024-09-11T23:24:04.969418+0000","last_undegraded":"2024-09-11T23:24:04.969418+0000","last_fullsized":"2024-09-11T23:24:04.969418+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:50.045125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.954783+0000","last_change":"2024-09-11T23:24:04.949113+0000","last_active":"2024-09-11T23:24:04.954783+0000","last_peered":"2024-09-11T23:24:04.954783+0000","last_clean":"2024-09-11T23:24:04.954783+0000","last_became_active":"2024-09-11T23:24:04.948730+0000","last_became_peered":"2024-09-11T23:24:04.948730+0000","last_unstale":"2024-09-11T23:24:04.954783+0000","last_undegraded":"2024-09-11T23:24:04.954783+0000","last_fullsized":"2024-09-11T23:24:04.954783+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:58.760445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"115'1","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.969238+0000","last_change":"2024-09-11T23:24:03.938158+0000","last_active":"2024-09-11T23:24:04.969238+0000","last_peered":"2024-09-11T23:24:04.969238+0000","last_clean":"2024-09-11T23:24:04.969238+0000","last_became_active":"2024-09-11T23:24:03.937831+0000","last_became_peered":"2024-09-11T23:24:03.937831+0000","last_unstale":"2024-09-11T23:24:04.969238+0000","last_undegraded":"2024-09-11T23:24:04.969238+0000","last_fullsized":"2024-09-11T23:24:04.969238+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.621773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.968281+0000","last_change":"2024-09-11T23:24:04.963131+0000","last_active":"2024-09-11T23:24:04.968281+0000","last_peered":"2024-09-11T23:24:04.968281+0000","last_clean":"2024-09-11T23:24:04.968281+0000","last_became_active":"2024-09-11T23:24:04.962928+0000","last_became_peered":"2024-09-11T23:24:04.962928+0000","last_unstale":"2024-09-11T23:24:04.968281+0000","last_undegraded":"2024-09-11T23:24:04.968281+0000","last_fullsized":"2024-09-11T23:24:04.968281+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:33.750436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"115'1","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.968313+0000","last_change":"2024-09-11T23:24:03.939035+0000","last_active":"2024-09-11T23:24:04.968313+0000","last_peered":"2024-09-11T23:24:04.968313+0000","last_clean":"2024-09-11T23:24:04.968313+0000","last_became_active":"2024-09-11T23:24:03.938543+0000","last_became_peered":"2024-09-11T23:24:03.938543+0000","last_unstale":"2024-09-11T23:24:04.968313+0000","last_undegraded":"2024-09-11T23:24:04.968313+0000","last_fullsized":"2024-09-11T23:24:04.968313+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:07.289505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.957041+0000","last_change":"2024-09-11T23:24:04.949845+0000","last_active":"2024-09-11T23:24:04.957041+0000","last_peered":"2024-09-11T23:24:04.957041+0000","last_clean":"2024-09-11T23:24:04.957041+0000","last_became_active":"2024-09-11T23:24:04.949589+0000","last_became_peered":"2024-09-11T23:24:04.949589+0000","last_unstale":"2024-09-11T23:24:04.957041+0000","last_undegraded":"2024-09-11T23:24:04.957041+0000","last_fullsized":"2024-09-11T23:24:04.957041+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:08.878652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.935674+0000","last_change":"2024-09-11T23:24:03.938145+0000","last_active":"2024-09-11T23:24:04.935674+0000","last_peered":"2024-09-11T23:24:04.935674+0000","last_clean":"2024-09-11T23:24:04.935674+0000","last_became_active":"2024-09-11T23:24:03.937857+0000","last_became_peered":"2024-09-11T23:24:03.937857+0000","last_unstale":"2024-09-11T23:24:04.935674+0000","last_undegraded":"2024-09-11T23:24:04.935674+0000","last_fullsized":"2024-09-11T23:24:04.935674+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:30.073390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.955787+0000","last_change":"2024-09-11T23:24:04.945273+0000","last_active":"2024-09-11T23:24:04.955787+0000","last_peered":"2024-09-11T23:24:04.955787+0000","last_clean":"2024-09-11T23:24:04.955787+0000","last_became_active":"2024-09-11T23:24:04.944339+0000","last_became_peered":"2024-09-11T23:24:04.944339+0000","last_unstale":"2024-09-11T23:24:04.955787+0000","last_undegraded":"2024-09-11T23:24:04.955787+0000","last_fullsized":"2024-09-11T23:24:04.955787+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:01.208246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.934461+0000","last_change":"2024-09-11T23:24:03.934796+0000","last_active":"2024-09-11T23:24:04.934461+0000","last_peered":"2024-09-11T23:24:04.934461+0000","last_clean":"2024-09-11T23:24:04.934461+0000","last_became_active":"2024-09-11T23:24:03.934356+0000","last_became_peered":"2024-09-11T23:24:03.934356+0000","last_unstale":"2024-09-11T23:24:04.934461+0000","last_undegraded":"2024-09-11T23:24:04.934461+0000","last_fullsized":"2024-09-11T23:24:04.934461+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:51.247109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.959944+0000","last_change":"2024-09-11T23:24:04.957730+0000","last_active":"2024-09-11T23:24:04.959944+0000","last_peered":"2024-09-11T23:24:04.959944+0000","last_clean":"2024-09-11T23:24:04.959944+0000","last_became_active":"2024-09-11T23:24:04.957473+0000","last_became_peered":"2024-09-11T23:24:04.957473+0000","last_unstale":"2024-09-11T23:24:04.959944+0000","last_undegraded":"2024-09-11T23:24:04.959944+0000","last_fullsized":"2024-09-11T23:24:04.959944+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:50.067991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.934078+0000","last_change":"2024-09-11T23:24:03.932077+0000","last_active":"2024-09-11T23:24:04.934078+0000","last_peered":"2024-09-11T23:24:04.934078+0000","last_clean":"2024-09-11T23:24:04.934078+0000","last_became_active":"2024-09-11T23:24:03.931822+0000","last_became_peered":"2024-09-11T23:24:03.931822+0000","last_unstale":"2024-09-11T23:24:04.934078+0000","last_undegraded":"2024-09-11T23:24:04.934078+0000","last_fullsized":"2024-09-11T23:24:04.934078+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:52.607592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.954531+0000","last_change":"2024-09-11T23:24:04.947787+0000","last_active":"2024-09-11T23:24:04.954531+0000","last_peered":"2024-09-11T23:24:04.954531+0000","last_clean":"2024-09-11T23:24:04.954531+0000","last_became_active":"2024-09-11T23:24:04.945574+0000","last_became_peered":"2024-09-11T23:24:04.945574+0000","last_unstale":"2024-09-11T23:24:04.954531+0000","last_undegraded":"2024-09-11T23:24:04.954531+0000","last_fullsized":"2024-09-11T23:24:04.954531+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:23.183110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.934723+0000","last_change":"2024-09-11T23:24:03.935910+0000","last_active":"2024-09-11T23:24:04.934723+0000","last_peered":"2024-09-11T23:24:04.934723+0000","last_clean":"2024-09-11T23:24:04.934723+0000","last_became_active":"2024-09-11T23:24:03.935345+0000","last_became_peered":"2024-09-11T23:24:03.935345+0000","last_unstale":"2024-09-11T23:24:04.934723+0000","last_undegraded":"2024-09-11T23:24:04.934723+0000","last_fullsized":"2024-09-11T23:24:04.934723+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:04.361164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.959248+0000","last_change":"2024-09-11T23:24:04.956173+0000","last_active":"2024-09-11T23:24:04.959248+0000","last_peered":"2024-09-11T23:24:04.959248+0000","last_clean":"2024-09-11T23:24:04.959248+0000","last_became_active":"2024-09-11T23:24:04.955797+0000","last_became_peered":"2024-09-11T23:24:04.955797+0000","last_unstale":"2024-09-11T23:24:04.959248+0000","last_undegraded":"2024-09-11T23:24:04.959248+0000","last_fullsized":"2024-09-11T23:24:04.959248+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:16.150386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"115'3","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.968482+0000","last_change":"2024-09-11T23:24:03.933449+0000","last_active":"2024-09-11T23:24:04.968482+0000","last_peered":"2024-09-11T23:24:04.968482+0000","last_clean":"2024-09-11T23:24:04.968482+0000","last_became_active":"2024-09-11T23:24:03.933072+0000","last_became_peered":"2024-09-11T23:24:03.933072+0000","last_unstale":"2024-09-11T23:24:04.968482+0000","last_undegraded":"2024-09-11T23:24:04.968482+0000","last_fullsized":"2024-09-11T23:24:04.968482+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:26.922796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.956947+0000","last_change":"2024-09-11T23:24:04.952816+0000","last_active":"2024-09-11T23:24:04.956947+0000","last_peered":"2024-09-11T23:24:04.956947+0000","last_clean":"2024-09-11T23:24:04.956947+0000","last_became_active":"2024-09-11T23:24:04.950922+0000","last_became_peered":"2024-09-11T23:24:04.950922+0000","last_unstale":"2024-09-11T23:24:04.956947+0000","last_undegraded":"2024-09-11T23:24:04.956947+0000","last_fullsized":"2024-09-11T23:24:04.956947+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:59.406912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"115'6","reported_seq":18,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.971866+0000","last_change":"2024-09-11T23:24:03.939273+0000","last_active":"2024-09-11T23:24:04.971866+0000","last_peered":"2024-09-11T23:24:04.971866+0000","last_clean":"2024-09-11T23:24:04.971866+0000","last_became_active":"2024-09-11T23:24:03.938960+0000","last_became_peered":"2024-09-11T23:24:03.938960+0000","last_unstale":"2024-09-11T23:24:04.971866+0000","last_undegraded":"2024-09-11T23:24:04.971866+0000","last_fullsized":"2024-09-11T23:24:04.971866+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:30.865559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.959732+0000","last_change":"2024-09-11T23:24:04.956879+0000","last_active":"2024-09-11T23:24:04.959732+0000","last_peered":"2024-09-11T23:24:04.959732+0000","last_clean":"2024-09-11T23:24:04.959732+0000","last_became_active":"2024-09-11T23:24:04.956623+0000","last_became_peered":"2024-09-11T23:24:04.956623+0000","last_unstale":"2024-09-11T23:24:04.959732+0000","last_undegraded":"2024-09-11T23:24:04.959732+0000","last_fullsized":"2024-09-11T23:24:04.959732+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:59.792694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.930969+0000","last_change":"2024-09-11T23:24:03.925452+0000","last_active":"2024-09-11T23:24:04.930969+0000","last_peered":"2024-09-11T23:24:04.930969+0000","last_clean":"2024-09-11T23:24:04.930969+0000","last_became_active":"2024-09-11T23:24:03.924996+0000","last_became_peered":"2024-09-11T23:24:03.924996+0000","last_unstale":"2024-09-11T23:24:04.930969+0000","last_undegraded":"2024-09-11T23:24:04.930969+0000","last_fullsized":"2024-09-11T23:24:04.930969+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:15.796517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.955914+0000","last_change":"2024-09-11T23:24:04.948227+0000","last_active":"2024-09-11T23:24:04.955914+0000","last_peered":"2024-09-11T23:24:04.955914+0000","last_clean":"2024-09-11T23:24:04.955914+0000","last_became_active":"2024-09-11T23:24:04.947942+0000","last_became_peered":"2024-09-11T23:24:04.947942+0000","last_unstale":"2024-09-11T23:24:04.955914+0000","last_undegraded":"2024-09-11T23:24:04.955914+0000","last_fullsized":"2024-09-11T23:24:04.955914+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:31.871874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.936395+0000","last_change":"2024-09-11T23:24:03.940462+0000","last_active":"2024-09-11T23:24:04.936395+0000","last_peered":"2024-09-11T23:24:04.936395+0000","last_clean":"2024-09-11T23:24:04.936395+0000","last_became_active":"2024-09-11T23:24:03.940207+0000","last_became_peered":"2024-09-11T23:24:03.940207+0000","last_unstale":"2024-09-11T23:24:04.936395+0000","last_undegraded":"2024-09-11T23:24:04.936395+0000","last_fullsized":"2024-09-11T23:24:04.936395+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:26.236292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.958763+0000","last_change":"2024-09-11T23:24:04.954115+0000","last_active":"2024-09-11T23:24:04.958763+0000","last_peered":"2024-09-11T23:24:04.958763+0000","last_clean":"2024-09-11T23:24:04.958763+0000","last_became_active":"2024-09-11T23:24:04.953131+0000","last_became_peered":"2024-09-11T23:24:04.953131+0000","last_unstale":"2024-09-11T23:24:04.958763+0000","last_undegraded":"2024-09-11T23:24:04.958763+0000","last_fullsized":"2024-09-11T23:24:04.958763+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:18.392796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"115'8","reported_seq":20,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.970261+0000","last_change":"2024-09-11T23:24:03.932786+0000","last_active":"2024-09-11T23:24:04.970261+0000","last_peered":"2024-09-11T23:24:04.970261+0000","last_clean":"2024-09-11T23:24:04.970261+0000","last_became_active":"2024-09-11T23:24:03.932467+0000","last_became_peered":"2024-09-11T23:24:03.932467+0000","last_unstale":"2024-09-11T23:24:04.970261+0000","last_undegraded":"2024-09-11T23:24:04.970261+0000","last_fullsized":"2024-09-11T23:24:04.970261+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:00.201931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.966506+0000","last_change":"2024-09-11T23:24:04.960846+0000","last_active":"2024-09-11T23:24:04.966506+0000","last_peered":"2024-09-11T23:24:04.966506+0000","last_clean":"2024-09-11T23:24:04.966506+0000","last_became_active":"2024-09-11T23:24:04.960059+0000","last_became_peered":"2024-09-11T23:24:04.960059+0000","last_unstale":"2024-09-11T23:24:04.966506+0000","last_undegraded":"2024-09-11T23:24:04.966506+0000","last_fullsized":"2024-09-11T23:24:04.966506+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:27.250619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"115'1","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.966654+0000","last_change":"2024-09-11T23:24:03.931885+0000","last_active":"2024-09-11T23:24:04.966654+0000","last_peered":"2024-09-11T23:24:04.966654+0000","last_clean":"2024-09-11T23:24:04.966654+0000","last_became_active":"2024-09-11T23:24:03.931600+0000","last_became_peered":"2024-09-11T23:24:03.931600+0000","last_unstale":"2024-09-11T23:24:04.966654+0000","last_undegraded":"2024-09-11T23:24:04.966654+0000","last_fullsized":"2024-09-11T23:24:04.966654+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:17.386482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.961934+0000","last_change":"2024-09-11T23:24:04.951776+0000","last_active":"2024-09-11T23:24:04.961934+0000","last_peered":"2024-09-11T23:24:04.961934+0000","last_clean":"2024-09-11T23:24:04.961934+0000","last_became_active":"2024-09-11T23:24:04.951349+0000","last_became_peered":"2024-09-11T23:24:04.951349+0000","last_unstale":"2024-09-11T23:24:04.961934+0000","last_undegraded":"2024-09-11T23:24:04.961934+0000","last_fullsized":"2024-09-11T23:24:04.961934+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:40.797172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"115'2","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.970004+0000","last_change":"2024-09-11T23:24:03.930575+0000","last_active":"2024-09-11T23:24:04.970004+0000","last_peered":"2024-09-11T23:24:04.970004+0000","last_clean":"2024-09-11T23:24:04.970004+0000","last_became_active":"2024-09-11T23:24:03.930256+0000","last_became_peered":"2024-09-11T23:24:03.930256+0000","last_unstale":"2024-09-11T23:24:04.970004+0000","last_undegraded":"2024-09-11T23:24:04.970004+0000","last_fullsized":"2024-09-11T23:24:04.970004+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:10.832788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.948807+0000","last_change":"2024-09-11T23:24:04.945169+0000","last_active":"2024-09-11T23:24:04.948807+0000","last_peered":"2024-09-11T23:24:04.948807+0000","last_clean":"2024-09-11T23:24:04.948807+0000","last_became_active":"2024-09-11T23:24:04.941072+0000","last_became_peered":"2024-09-11T23:24:04.941072+0000","last_unstale":"2024-09-11T23:24:04.948807+0000","last_undegraded":"2024-09-11T23:24:04.948807+0000","last_fullsized":"2024-09-11T23:24:04.948807+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:35.030483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"115'1","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.967926+0000","last_change":"2024-09-11T23:24:03.932005+0000","last_active":"2024-09-11T23:24:04.967926+0000","last_peered":"2024-09-11T23:24:04.967926+0000","last_clean":"2024-09-11T23:24:04.967926+0000","last_became_active":"2024-09-11T23:24:03.931648+0000","last_became_peered":"2024-09-11T23:24:03.931648+0000","last_unstale":"2024-09-11T23:24:04.967926+0000","last_undegraded":"2024-09-11T23:24:04.967926+0000","last_fullsized":"2024-09-11T23:24:04.967926+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:39.790857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.955725+0000","last_change":"2024-09-11T23:24:04.944680+0000","last_active":"2024-09-11T23:24:04.955725+0000","last_peered":"2024-09-11T23:24:04.955725+0000","last_clean":"2024-09-11T23:24:04.955725+0000","last_became_active":"2024-09-11T23:24:04.944388+0000","last_became_peered":"2024-09-11T23:24:04.944388+0000","last_unstale":"2024-09-11T23:24:04.955725+0000","last_undegraded":"2024-09-11T23:24:04.955725+0000","last_fullsized":"2024-09-11T23:24:04.955725+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:42.852867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.933764+0000","last_change":"2024-09-11T23:24:03.935128+0000","last_active":"2024-09-11T23:24:04.933764+0000","last_peered":"2024-09-11T23:24:04.933764+0000","last_clean":"2024-09-11T23:24:04.933764+0000","last_became_active":"2024-09-11T23:24:03.934857+0000","last_became_peered":"2024-09-11T23:24:03.934857+0000","last_unstale":"2024-09-11T23:24:04.933764+0000","last_undegraded":"2024-09-11T23:24:04.933764+0000","last_fullsized":"2024-09-11T23:24:04.933764+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:44.589681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.958895+0000","last_change":"2024-09-11T23:24:04.952228+0000","last_active":"2024-09-11T23:24:04.958895+0000","last_peered":"2024-09-11T23:24:04.958895+0000","last_clean":"2024-09-11T23:24:04.958895+0000","last_became_active":"2024-09-11T23:24:04.951928+0000","last_became_peered":"2024-09-11T23:24:04.951928+0000","last_unstale":"2024-09-11T23:24:04.958895+0000","last_undegraded":"2024-09-11T23:24:04.958895+0000","last_fullsized":"2024-09-11T23:24:04.958895+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:57.700045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"115'2","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.967608+0000","last_change":"2024-09-11T23:24:03.931151+0000","last_active":"2024-09-11T23:24:04.967608+0000","last_peered":"2024-09-11T23:24:04.967608+0000","last_clean":"2024-09-11T23:24:04.967608+0000","last_became_active":"2024-09-11T23:24:03.930827+0000","last_became_peered":"2024-09-11T23:24:03.930827+0000","last_unstale":"2024-09-11T23:24:04.967608+0000","last_undegraded":"2024-09-11T23:24:04.967608+0000","last_fullsized":"2024-09-11T23:24:04.967608+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:38.745274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.956243+0000","last_change":"2024-09-11T23:24:04.950247+0000","last_active":"2024-09-11T23:24:04.956243+0000","last_peered":"2024-09-11T23:24:04.956243+0000","last_clean":"2024-09-11T23:24:04.956243+0000","last_became_active":"2024-09-11T23:24:04.949263+0000","last_became_peered":"2024-09-11T23:24:04.949263+0000","last_unstale":"2024-09-11T23:24:04.956243+0000","last_undegraded":"2024-09-11T23:24:04.956243+0000","last_fullsized":"2024-09-11T23:24:04.956243+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:59.282208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.934910+0000","last_change":"2024-09-11T23:24:03.938826+0000","last_active":"2024-09-11T23:24:04.934910+0000","last_peered":"2024-09-11T23:24:04.934910+0000","last_clean":"2024-09-11T23:24:04.934910+0000","last_became_active":"2024-09-11T23:24:03.938210+0000","last_became_peered":"2024-09-11T23:24:03.938210+0000","last_unstale":"2024-09-11T23:24:04.934910+0000","last_undegraded":"2024-09-11T23:24:04.934910+0000","last_fullsized":"2024-09-11T23:24:04.934910+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:13:00.586737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.961344+0000","last_change":"2024-09-11T23:24:04.959286+0000","last_active":"2024-09-11T23:24:04.961344+0000","last_peered":"2024-09-11T23:24:04.961344+0000","last_clean":"2024-09-11T23:24:04.961344+0000","last_became_active":"2024-09-11T23:24:04.959041+0000","last_became_peered":"2024-09-11T23:24:04.959041+0000","last_unstale":"2024-09-11T23:24:04.961344+0000","last_undegraded":"2024-09-11T23:24:04.961344+0000","last_fullsized":"2024-09-11T23:24:04.961344+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:39.751589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.933672+0000","last_change":"2024-09-11T23:24:03.930315+0000","last_active":"2024-09-11T23:24:04.933672+0000","last_peered":"2024-09-11T23:24:04.933672+0000","last_clean":"2024-09-11T23:24:04.933672+0000","last_became_active":"2024-09-11T23:24:03.929154+0000","last_became_peered":"2024-09-11T23:24:03.929154+0000","last_unstale":"2024-09-11T23:24:04.933672+0000","last_undegraded":"2024-09-11T23:24:04.933672+0000","last_fullsized":"2024-09-11T23:24:04.933672+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:38.278544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.968248+0000","last_change":"2024-09-11T23:24:04.963751+0000","last_active":"2024-09-11T23:24:04.968248+0000","last_peered":"2024-09-11T23:24:04.968248+0000","last_clean":"2024-09-11T23:24:04.968248+0000","last_became_active":"2024-09-11T23:24:04.961564+0000","last_became_peered":"2024-09-11T23:24:04.961564+0000","last_unstale":"2024-09-11T23:24:04.968248+0000","last_undegraded":"2024-09-11T23:24:04.968248+0000","last_fullsized":"2024-09-11T23:24:04.968248+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:54.332075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.941767+0000","last_change":"2024-09-11T23:24:03.932182+0000","last_active":"2024-09-11T23:24:04.941767+0000","last_peered":"2024-09-11T23:24:04.941767+0000","last_clean":"2024-09-11T23:24:04.941767+0000","last_became_active":"2024-09-11T23:24:03.931897+0000","last_became_peered":"2024-09-11T23:24:03.931897+0000","last_unstale":"2024-09-11T23:24:04.941767+0000","last_undegraded":"2024-09-11T23:24:04.941767+0000","last_fullsized":"2024-09-11T23:24:04.941767+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:02.621995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.947396+0000","last_change":"2024-09-11T23:24:04.944019+0000","last_active":"2024-09-11T23:24:04.947396+0000","last_peered":"2024-09-11T23:24:04.947396+0000","last_clean":"2024-09-11T23:24:04.947396+0000","last_became_active":"2024-09-11T23:24:04.943762+0000","last_became_peered":"2024-09-11T23:24:04.943762+0000","last_unstale":"2024-09-11T23:24:04.947396+0000","last_undegraded":"2024-09-11T23:24:04.947396+0000","last_fullsized":"2024-09-11T23:24:04.947396+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:18.231514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"115'2","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.969553+0000","last_change":"2024-09-11T23:24:03.926623+0000","last_active":"2024-09-11T23:24:04.969553+0000","last_peered":"2024-09-11T23:24:04.969553+0000","last_clean":"2024-09-11T23:24:04.969553+0000","last_became_active":"2024-09-11T23:24:03.926167+0000","last_became_peered":"2024-09-11T23:24:03.926167+0000","last_unstale":"2024-09-11T23:24:04.969553+0000","last_undegraded":"2024-09-11T23:24:04.969553+0000","last_fullsized":"2024-09-11T23:24:04.969553+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:46.057351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.958986+0000","last_change":"2024-09-11T23:24:04.954367+0000","last_active":"2024-09-11T23:24:04.958986+0000","last_peered":"2024-09-11T23:24:04.958986+0000","last_clean":"2024-09-11T23:24:04.958986+0000","last_became_active":"2024-09-11T23:24:04.954074+0000","last_became_peered":"2024-09-11T23:24:04.954074+0000","last_unstale":"2024-09-11T23:24:04.958986+0000","last_undegraded":"2024-09-11T23:24:04.958986+0000","last_fullsized":"2024-09-11T23:24:04.958986+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:13.551180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.944037+0000","last_change":"2024-09-11T23:24:03.938554+0000","last_active":"2024-09-11T23:24:04.944037+0000","last_peered":"2024-09-11T23:24:04.944037+0000","last_clean":"2024-09-11T23:24:04.944037+0000","last_became_active":"2024-09-11T23:24:03.938181+0000","last_became_peered":"2024-09-11T23:24:03.938181+0000","last_unstale":"2024-09-11T23:24:04.944037+0000","last_undegraded":"2024-09-11T23:24:04.944037+0000","last_fullsized":"2024-09-11T23:24:04.944037+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:44.127736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960145+0000","last_change":"2024-09-11T23:24:04.953070+0000","last_active":"2024-09-11T23:24:04.960145+0000","last_peered":"2024-09-11T23:24:04.960145+0000","last_clean":"2024-09-11T23:24:04.960145+0000","last_became_active":"2024-09-11T23:24:04.952811+0000","last_became_peered":"2024-09-11T23:24:04.952811+0000","last_unstale":"2024-09-11T23:24:04.960145+0000","last_undegraded":"2024-09-11T23:24:04.960145+0000","last_fullsized":"2024-09-11T23:24:04.960145+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:08.878652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.937652+0000","last_change":"2024-09-11T23:24:03.934976+0000","last_active":"2024-09-11T23:24:04.937652+0000","last_peered":"2024-09-11T23:24:04.937652+0000","last_clean":"2024-09-11T23:24:04.937652+0000","last_became_active":"2024-09-11T23:24:03.934357+0000","last_became_peered":"2024-09-11T23:24:03.934357+0000","last_unstale":"2024-09-11T23:24:04.937652+0000","last_undegraded":"2024-09-11T23:24:04.937652+0000","last_fullsized":"2024-09-11T23:24:04.937652+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:41.086170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.968070+0000","last_change":"2024-09-11T23:24:04.963193+0000","last_active":"2024-09-11T23:24:04.968070+0000","last_peered":"2024-09-11T23:24:04.968070+0000","last_clean":"2024-09-11T23:24:04.968070+0000","last_became_active":"2024-09-11T23:24:04.961286+0000","last_became_peered":"2024-09-11T23:24:04.961286+0000","last_unstale":"2024-09-11T23:24:04.968070+0000","last_undegraded":"2024-09-11T23:24:04.968070+0000","last_fullsized":"2024-09-11T23:24:04.968070+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:45.134051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.941697+0000","last_change":"2024-09-11T23:24:03.940615+0000","last_active":"2024-09-11T23:24:04.941697+0000","last_peered":"2024-09-11T23:24:04.941697+0000","last_clean":"2024-09-11T23:24:04.941697+0000","last_became_active":"2024-09-11T23:24:03.940362+0000","last_became_peered":"2024-09-11T23:24:03.940362+0000","last_unstale":"2024-09-11T23:24:04.941697+0000","last_undegraded":"2024-09-11T23:24:04.941697+0000","last_fullsized":"2024-09-11T23:24:04.941697+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:20.411527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.969287+0000","last_change":"2024-09-11T23:24:04.967391+0000","last_active":"2024-09-11T23:24:04.969287+0000","last_peered":"2024-09-11T23:24:04.969287+0000","last_clean":"2024-09-11T23:24:04.969287+0000","last_became_active":"2024-09-11T23:24:04.965981+0000","last_became_peered":"2024-09-11T23:24:04.965981+0000","last_unstale":"2024-09-11T23:24:04.969287+0000","last_undegraded":"2024-09-11T23:24:04.969287+0000","last_fullsized":"2024-09-11T23:24:04.969287+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:31.051520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.936920+0000","last_change":"2024-09-11T23:24:03.940487+0000","last_active":"2024-09-11T23:24:04.936920+0000","last_peered":"2024-09-11T23:24:04.936920+0000","last_clean":"2024-09-11T23:24:04.936920+0000","last_became_active":"2024-09-11T23:24:03.940223+0000","last_became_peered":"2024-09-11T23:24:03.940223+0000","last_unstale":"2024-09-11T23:24:04.936920+0000","last_undegraded":"2024-09-11T23:24:04.936920+0000","last_fullsized":"2024-09-11T23:24:04.936920+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:04.686874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.954487+0000","last_change":"2024-09-11T23:24:04.948156+0000","last_active":"2024-09-11T23:24:04.954487+0000","last_peered":"2024-09-11T23:24:04.954487+0000","last_clean":"2024-09-11T23:24:04.954487+0000","last_became_active":"2024-09-11T23:24:04.947832+0000","last_became_peered":"2024-09-11T23:24:04.947832+0000","last_unstale":"2024-09-11T23:24:04.954487+0000","last_undegraded":"2024-09-11T23:24:04.954487+0000","last_fullsized":"2024-09-11T23:24:04.954487+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:27.250619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.946585+0000","last_change":"2024-09-11T23:24:03.942095+0000","last_active":"2024-09-11T23:24:04.946585+0000","last_peered":"2024-09-11T23:24:04.946585+0000","last_clean":"2024-09-11T23:24:04.946585+0000","last_became_active":"2024-09-11T23:24:03.941801+0000","last_became_peered":"2024-09-11T23:24:03.941801+0000","last_unstale":"2024-09-11T23:24:04.946585+0000","last_undegraded":"2024-09-11T23:24:04.946585+0000","last_fullsized":"2024-09-11T23:24:04.946585+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:31.985637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.956393+0000","last_change":"2024-09-11T23:24:04.952391+0000","last_active":"2024-09-11T23:24:04.956393+0000","last_peered":"2024-09-11T23:24:04.956393+0000","last_clean":"2024-09-11T23:24:04.956393+0000","last_became_active":"2024-09-11T23:24:04.951541+0000","last_became_peered":"2024-09-11T23:24:04.951541+0000","last_unstale":"2024-09-11T23:24:04.956393+0000","last_undegraded":"2024-09-11T23:24:04.956393+0000","last_fullsized":"2024-09-11T23:24:04.956393+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:10.266380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.933850+0000","last_change":"2024-09-11T23:24:03.933892+0000","last_active":"2024-09-11T23:24:04.933850+0000","last_peered":"2024-09-11T23:24:04.933850+0000","last_clean":"2024-09-11T23:24:04.933850+0000","last_became_active":"2024-09-11T23:24:03.933629+0000","last_became_peered":"2024-09-11T23:24:03.933629+0000","last_unstale":"2024-09-11T23:24:04.933850+0000","last_undegraded":"2024-09-11T23:24:04.933850+0000","last_fullsized":"2024-09-11T23:24:04.933850+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:34.343887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960125+0000","last_change":"2024-09-11T23:24:04.954601+0000","last_active":"2024-09-11T23:24:04.960125+0000","last_peered":"2024-09-11T23:24:04.960125+0000","last_clean":"2024-09-11T23:24:04.960125+0000","last_became_active":"2024-09-11T23:24:04.954350+0000","last_became_peered":"2024-09-11T23:24:04.954350+0000","last_unstale":"2024-09-11T23:24:04.960125+0000","last_undegraded":"2024-09-11T23:24:04.960125+0000","last_fullsized":"2024-09-11T23:24:04.960125+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:18.392796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.941774+0000","last_change":"2024-09-11T23:24:03.936099+0000","last_active":"2024-09-11T23:24:04.941774+0000","last_peered":"2024-09-11T23:24:04.941774+0000","last_clean":"2024-09-11T23:24:04.941774+0000","last_became_active":"2024-09-11T23:24:03.935846+0000","last_became_peered":"2024-09-11T23:24:03.935846+0000","last_unstale":"2024-09-11T23:24:04.941774+0000","last_undegraded":"2024-09-11T23:24:04.941774+0000","last_fullsized":"2024-09-11T23:24:04.941774+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:06.238695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.967268+0000","last_change":"2024-09-11T23:24:04.959788+0000","last_active":"2024-09-11T23:24:04.967268+0000","last_peered":"2024-09-11T23:24:04.967268+0000","last_clean":"2024-09-11T23:24:04.967268+0000","last_became_active":"2024-09-11T23:24:04.959500+0000","last_became_peered":"2024-09-11T23:24:04.959500+0000","last_unstale":"2024-09-11T23:24:04.967268+0000","last_undegraded":"2024-09-11T23:24:04.967268+0000","last_fullsized":"2024-09-11T23:24:04.967268+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:43.464408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"115'2","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.968752+0000","last_change":"2024-09-11T23:24:03.938151+0000","last_active":"2024-09-11T23:24:04.968752+0000","last_peered":"2024-09-11T23:24:04.968752+0000","last_clean":"2024-09-11T23:24:04.968752+0000","last_became_active":"2024-09-11T23:24:03.937844+0000","last_became_peered":"2024-09-11T23:24:03.937844+0000","last_unstale":"2024-09-11T23:24:04.968752+0000","last_undegraded":"2024-09-11T23:24:04.968752+0000","last_fullsized":"2024-09-11T23:24:04.968752+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:27.426798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":384,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.941998+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:24:04.941998+0000","last_peered":"2024-09-11T23:24:04.941998+0000","last_clean":"2024-09-11T23:24:04.941998+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:24:04.941998+0000","last_undegraded":"2024-09-11T23:24:04.941998+0000","last_fullsized":"2024-09-11T23:24:04.941998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476816,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33184,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338656,"statfs":{"total":96636764160,"available":96602783744,"internally_reserved":0,"allocated":2043904,"data_stored":1217642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476815,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32596,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339244,"statfs":{"total":96636764160,"available":96603385856,"internally_reserved":0,"allocated":1437696,"data_stored":626636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1433600,"data_stored":625136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476814,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1429504,"data_stored":625094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542223,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1413120,"data_stored":618249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542223,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1433600,"data_stored":625640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509519,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1425408,"data_stored":625024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509519,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33168,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338672,"statfs":{"total":96636764160,"available":96602800128,"internally_reserved":0,"allocated":2019328,"data_stored":1215392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:24:09.126 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:24:09.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.314+0000 7fd3ca000640 1 Processor -- start 2024-09-11T23:24:09.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.314+0000 7fd3ca000640 1 -- start start 2024-09-11T23:24:09.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.315+0000 7fd3ca000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3c415e640 0x7fd3c40d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:09.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.315+0000 7fd3ca000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd3c40d3f60 0x7fd3c40b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:09.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.315+0000 7fd3ca000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3c406bee0 con 0x7fd3c40b6510 2024-09-11T23:24:09.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.315+0000 7fd3ca000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd3c415ea20 con 0x7fd3c40d3f60 2024-09-11T23:24:09.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.315+0000 7fd3ca000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c406caf0 con 0x7fd3c415e640 2024-09-11T23:24:09.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.316+0000 7fd3c8c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3c415e640 0x7fd3c40d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:09.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.316+0000 7fd3bbe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd3c40d3f60 0x7fd3c40b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:09.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.316+0000 7fd3c8c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3c415e640 0x7fd3c40d3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:58636/0 (socket says 172.21.15.144:58636) 2024-09-11T23:24:09.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.316+0000 7fd3c8c00640 1 -- 172.21.15.144:0/1176285960 learned_addr learned my addr 172.21.15.144:0/1176285960 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:09.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.316+0000 7fd3c8c00640 1 -- 172.21.15.144:0/1176285960 >> v2:172.21.15.165:3300/0 conn(0x7fd3c40d3f60 msgr2=0x7fd3c40b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:09.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.316+0000 7fd3c8c00640 1 --2- 172.21.15.144:0/1176285960 >> v2:172.21.15.165:3300/0 conn(0x7fd3c40d3f60 0x7fd3c40b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.316+0000 7fd3c8c00640 1 -- 172.21.15.144:0/1176285960 >> v1:172.21.15.165:6789/0 conn(0x7fd3c40b6510 legacy=0x7fd3c40d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:09.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.316+0000 7fd3c8c00640 1 -- 172.21.15.144:0/1176285960 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c406c1c0 con 0x7fd3c415e640 2024-09-11T23:24:09.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.316+0000 7fd3bbe00640 1 --2- 172.21.15.144:0/1176285960 >> v2:172.21.15.165:3300/0 conn(0x7fd3c40d3f60 0x7fd3c40b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:24:09.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.317+0000 7fd3c8c00640 1 --2- 172.21.15.144:0/1176285960 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3c415e640 0x7fd3c40d3a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4009870 tx=0x7fd3b402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f53ba51c68bf1d6c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:09.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.318+0000 7fd3c3e00640 1 -- 172.21.15.144:0/1176285960 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4037070 con 0x7fd3c415e640 2024-09-11T23:24:09.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.318+0000 7fd3c3e00640 1 -- 172.21.15.144:0/1176285960 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b4032440 con 0x7fd3c415e640 2024-09-11T23:24:09.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.318+0000 7fd3c3e00640 1 -- 172.21.15.144:0/1176285960 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4032810 con 0x7fd3c415e640 2024-09-11T23:24:09.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.318+0000 7fd3ca000640 1 -- 172.21.15.144:0/1176285960 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3c415e640 msgr2=0x7fd3c40d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:09.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.318+0000 7fd3ca000640 1 --2- 172.21.15.144:0/1176285960 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3c415e640 0x7fd3c40d3a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4009870 tx=0x7fd3b402a270 comp rx=0 tx=0).stop 2024-09-11T23:24:09.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.318+0000 7fd3ca000640 1 -- 172.21.15.144:0/1176285960 shutdown_connections 2024-09-11T23:24:09.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.318+0000 7fd3ca000640 1 --2- 172.21.15.144:0/1176285960 >> v2:172.21.15.165:3300/0 conn(0x7fd3c40d3f60 0x7fd3c40b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.318+0000 7fd3ca000640 1 --2- 172.21.15.144:0/1176285960 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3c415e640 0x7fd3c40d3a20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.318+0000 7fd3ca000640 1 -- 172.21.15.144:0/1176285960 >> 172.21.15.144:0/1176285960 conn(0x7fd3c40d0fd0 msgr2=0x7fd3c40d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:09.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.318+0000 7fd3ca000640 1 -- 172.21.15.144:0/1176285960 shutdown_connections 2024-09-11T23:24:09.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.318+0000 7fd3ca000640 1 -- 172.21.15.144:0/1176285960 wait complete. 2024-09-11T23:24:09.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.320+0000 7fd3ca000640 1 Processor -- start 2024-09-11T23:24:09.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.320+0000 7fd3ca000640 1 -- start start 2024-09-11T23:24:09.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.321+0000 7fd3ca000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3c40b6510 0x7fd3c41523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:09.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.321+0000 7fd3ca000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3c40d3f60 0x7fd3c41528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:09.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.321+0000 7fd3ca000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3c415e640 0x7fd3c414c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:09.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.321+0000 7fd3ca000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c40b8760 con 0x7fd3c40d3f60 2024-09-11T23:24:09.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.321+0000 7fd3ca000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c406c780 con 0x7fd3c40b6510 2024-09-11T23:24:09.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.321+0000 7fd3ca000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c40b88e0 con 0x7fd3c415e640 2024-09-11T23:24:09.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.321+0000 7fd3bbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3c40d3f60 0x7fd3c41528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.321+0000 7fd3bbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3c40d3f60 0x7fd3c41528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50136/0 (socket says 172.21.15.144:50136) 2024-09-11T23:24:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.321+0000 7fd3bbe00640 1 -- 172.21.15.144:0/2717988524 learned_addr learned my addr 172.21.15.144:0/2717988524 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.321+0000 7fd3c8c00640 1 --2- 172.21.15.144:0/2717988524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3c40b6510 0x7fd3c41523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.321+0000 7fd3c9600640 1 --2- 172.21.15.144:0/2717988524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3c415e640 0x7fd3c414c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.322+0000 7fd3bbe00640 1 -- 172.21.15.144:0/2717988524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3c415e640 msgr2=0x7fd3c414c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.322+0000 7fd3bbe00640 1 --2- 172.21.15.144:0/2717988524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3c415e640 0x7fd3c414c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.322+0000 7fd3bbe00640 1 -- 172.21.15.144:0/2717988524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3c40b6510 msgr2=0x7fd3c41523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.322+0000 7fd3bbe00640 1 --2- 172.21.15.144:0/2717988524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3c40b6510 0x7fd3c41523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.322+0000 7fd3bbe00640 1 -- 172.21.15.144:0/2717988524 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c40ca3c0 con 0x7fd3c40d3f60 2024-09-11T23:24:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.322+0000 7fd3bbe00640 1 --2- 172.21.15.144:0/2717988524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3c40d3f60 0x7fd3c41528e0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00ebb0 tx=0x7fd3ac00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.322+0000 7fd3c1600640 1 -- 172.21.15.144:0/2717988524 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac017070 con 0x7fd3c40d3f60 2024-09-11T23:24:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.322+0000 7fd3c1600640 1 -- 172.21.15.144:0/2717988524 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ac00cc30 con 0x7fd3c40d3f60 2024-09-11T23:24:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.322+0000 7fd3ca000640 1 -- 172.21.15.144:0/2717988524 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c40ca6a0 con 0x7fd3c40d3f60 2024-09-11T23:24:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.322+0000 7fd3c1600640 1 -- 172.21.15.144:0/2717988524 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac013470 con 0x7fd3c40d3f60 2024-09-11T23:24:09.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.322+0000 7fd3ca000640 1 -- 172.21.15.144:0/2717988524 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c414ce90 con 0x7fd3c40d3f60 2024-09-11T23:24:09.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.323+0000 7fd3ca000640 1 -- 172.21.15.144:0/2717988524 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3c4068cd0 con 0x7fd3c40d3f60 2024-09-11T23:24:09.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.324+0000 7fd3c1600640 1 -- 172.21.15.144:0/2717988524 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7fd3ac01a070 con 0x7fd3c40d3f60 2024-09-11T23:24:09.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.325+0000 7fd3c1600640 1 --2- 172.21.15.144:0/2717988524 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd3a006c220 0x7fd3a006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:09.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.325+0000 7fd3c1600640 1 -- 172.21.15.144:0/2717988524 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7fd3ac08b7f0 con 0x7fd3c40d3f60 2024-09-11T23:24:09.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.326+0000 7fd3c8c00640 1 --2- 172.21.15.144:0/2717988524 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd3a006c220 0x7fd3a006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:09.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.326+0000 7fd3c8c00640 1 --2- 172.21.15.144:0/2717988524 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd3a006c220 0x7fd3a006e6e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4034000 tx=0x7fd3b402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:09.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.329+0000 7fd3c1600640 1 -- 172.21.15.144:0/2717988524 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3c4068cd0 con 0x7fd3c40d3f60 2024-09-11T23:24:09.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.499+0000 7fd3ca000640 1 -- 172.21.15.144:0/2717988524 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd3c40d3630 con 0x7fd3a006c220 2024-09-11T23:24:09.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.506+0000 7fd3c1600640 1 -- 172.21.15.144:0/2717988524 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252413 (secure 0 0 0) 0x7fd3c40d3630 con 0x7fd3a006c220 2024-09-11T23:24:09.509 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:09.510 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:24:09.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.510+0000 7fd3ca000640 1 -- 172.21.15.144:0/2717988524 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd3a006c220 msgr2=0x7fd3a006e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:09.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.510+0000 7fd3ca000640 1 --2- 172.21.15.144:0/2717988524 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd3a006c220 0x7fd3a006e6e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4034000 tx=0x7fd3b402e000 comp rx=0 tx=0).stop 2024-09-11T23:24:09.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.510+0000 7fd3ca000640 1 -- 172.21.15.144:0/2717988524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3c40d3f60 msgr2=0x7fd3c41528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:09.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.510+0000 7fd3ca000640 1 --2- 172.21.15.144:0/2717988524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3c40d3f60 0x7fd3c41528e0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00ebb0 tx=0x7fd3ac00c520 comp rx=0 tx=0).stop 2024-09-11T23:24:09.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.510+0000 7fd3ca000640 1 -- 172.21.15.144:0/2717988524 shutdown_connections 2024-09-11T23:24:09.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.510+0000 7fd3ca000640 1 --2- 172.21.15.144:0/2717988524 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd3a006c220 0x7fd3a006e6e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.510+0000 7fd3ca000640 1 --2- 172.21.15.144:0/2717988524 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3c415e640 0x7fd3c414c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.510+0000 7fd3ca000640 1 --2- 172.21.15.144:0/2717988524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3c40d3f60 0x7fd3c41528e0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.510+0000 7fd3ca000640 1 --2- 172.21.15.144:0/2717988524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3c40b6510 0x7fd3c41523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.510+0000 7fd3ca000640 1 -- 172.21.15.144:0/2717988524 >> 172.21.15.144:0/2717988524 conn(0x7fd3c40d0fd0 msgr2=0x7fd3c415daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:09.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.510+0000 7fd3ca000640 1 -- 172.21.15.144:0/2717988524 shutdown_connections 2024-09-11T23:24:09.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.510+0000 7fd3ca000640 1 -- 172.21.15.144:0/2717988524 wait complete. 2024-09-11T23:24:09.525 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2024-09-11T23:24:08.739472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":223,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261872,"kb_used_data":12340,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712848,"statfs":{"total":773094113280,"available":772825956352,"internally_reserved":0,"allocated":12636160,"data_stored":6178813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.827390"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.959436+0000","last_change":"2024-09-11T23:24:04.956158+0000","last_active":"2024-09-11T23:24:04.959436+0000","last_peered":"2024-09-11T23:24:04.959436+0000","last_clean":"2024-09-11T23:24:04.959436+0000","last_became_active":"2024-09-11T23:24:04.954399+0000","last_became_peered":"2024-09-11T23:24:04.954399+0000","last_unstale":"2024-09-11T23:24:04.959436+0000","last_undegraded":"2024-09-11T23:24:04.959436+0000","last_fullsized":"2024-09-11T23:24:04.959436+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:37.650729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960023+0000","last_change":"2024-09-11T23:24:04.948584+0000","last_active":"2024-09-11T23:24:04.960023+0000","last_peered":"2024-09-11T23:24:04.960023+0000","last_clean":"2024-09-11T23:24:04.960023+0000","last_became_active":"2024-09-11T23:24:04.945971+0000","last_became_peered":"2024-09-11T23:24:04.945971+0000","last_unstale":"2024-09-11T23:24:04.960023+0000","last_undegraded":"2024-09-11T23:24:04.960023+0000","last_fullsized":"2024-09-11T23:24:04.960023+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:54.830956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.956600+0000","last_change":"2024-09-11T23:24:04.948596+0000","last_active":"2024-09-11T23:24:04.956600+0000","last_peered":"2024-09-11T23:24:04.956600+0000","last_clean":"2024-09-11T23:24:04.956600+0000","last_became_active":"2024-09-11T23:24:04.947736+0000","last_became_peered":"2024-09-11T23:24:04.947736+0000","last_unstale":"2024-09-11T23:24:04.956600+0000","last_undegraded":"2024-09-11T23:24:04.956600+0000","last_fullsized":"2024-09-11T23:24:04.956600+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:45.595996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.958648+0000","last_change":"2024-09-11T23:24:04.955035+0000","last_active":"2024-09-11T23:24:04.958648+0000","last_peered":"2024-09-11T23:24:04.958648+0000","last_clean":"2024-09-11T23:24:04.958648+0000","last_became_active":"2024-09-11T23:24:04.953671+0000","last_became_peered":"2024-09-11T23:24:04.953671+0000","last_unstale":"2024-09-11T23:24:04.958648+0000","last_undegraded":"2024-09-11T23:24:04.958648+0000","last_fullsized":"2024-09-11T23:24:04.958648+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:24.608969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.969363+0000","last_change":"2024-09-11T23:24:04.965349+0000","last_active":"2024-09-11T23:24:04.969363+0000","last_peered":"2024-09-11T23:24:04.969363+0000","last_clean":"2024-09-11T23:24:04.969363+0000","last_became_active":"2024-09-11T23:24:04.964846+0000","last_became_peered":"2024-09-11T23:24:04.964846+0000","last_unstale":"2024-09-11T23:24:04.969363+0000","last_undegraded":"2024-09-11T23:24:04.969363+0000","last_fullsized":"2024-09-11T23:24:04.969363+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:40.761839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.962569+0000","last_change":"2024-09-11T23:24:04.958210+0000","last_active":"2024-09-11T23:24:04.962569+0000","last_peered":"2024-09-11T23:24:04.962569+0000","last_clean":"2024-09-11T23:24:04.962569+0000","last_became_active":"2024-09-11T23:24:04.957941+0000","last_became_peered":"2024-09-11T23:24:04.957941+0000","last_unstale":"2024-09-11T23:24:04.962569+0000","last_undegraded":"2024-09-11T23:24:04.962569+0000","last_fullsized":"2024-09-11T23:24:04.962569+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:21.597655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960850+0000","last_change":"2024-09-11T23:24:04.950615+0000","last_active":"2024-09-11T23:24:04.960850+0000","last_peered":"2024-09-11T23:24:04.960850+0000","last_clean":"2024-09-11T23:24:04.960850+0000","last_became_active":"2024-09-11T23:24:04.950313+0000","last_became_peered":"2024-09-11T23:24:04.950313+0000","last_unstale":"2024-09-11T23:24:04.960850+0000","last_undegraded":"2024-09-11T23:24:04.960850+0000","last_fullsized":"2024-09-11T23:24:04.960850+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:43.259244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.951827+0000","last_change":"2024-09-11T23:24:04.946848+0000","last_active":"2024-09-11T23:24:04.951827+0000","last_peered":"2024-09-11T23:24:04.951827+0000","last_clean":"2024-09-11T23:24:04.951827+0000","last_became_active":"2024-09-11T23:24:04.946565+0000","last_became_peered":"2024-09-11T23:24:04.946565+0000","last_unstale":"2024-09-11T23:24:04.951827+0000","last_undegraded":"2024-09-11T23:24:04.951827+0000","last_fullsized":"2024-09-11T23:24:04.951827+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:27.929111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960321+0000","last_change":"2024-09-11T23:24:04.954556+0000","last_active":"2024-09-11T23:24:04.960321+0000","last_peered":"2024-09-11T23:24:04.960321+0000","last_clean":"2024-09-11T23:24:04.960321+0000","last_became_active":"2024-09-11T23:24:04.954255+0000","last_became_peered":"2024-09-11T23:24:04.954255+0000","last_unstale":"2024-09-11T23:24:04.960321+0000","last_undegraded":"2024-09-11T23:24:04.960321+0000","last_fullsized":"2024-09-11T23:24:04.960321+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:39.751589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960044+0000","last_change":"2024-09-11T23:24:04.952412+0000","last_active":"2024-09-11T23:24:04.960044+0000","last_peered":"2024-09-11T23:24:04.960044+0000","last_clean":"2024-09-11T23:24:04.960044+0000","last_became_active":"2024-09-11T23:24:04.945614+0000","last_became_peered":"2024-09-11T23:24:04.945614+0000","last_unstale":"2024-09-11T23:24:04.960044+0000","last_undegraded":"2024-09-11T23:24:04.960044+0000","last_fullsized":"2024-09-11T23:24:04.960044+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:45.595996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.955473+0000","last_change":"2024-09-11T23:24:04.949123+0000","last_active":"2024-09-11T23:24:04.955473+0000","last_peered":"2024-09-11T23:24:04.955473+0000","last_clean":"2024-09-11T23:24:04.955473+0000","last_became_active":"2024-09-11T23:24:04.945722+0000","last_became_peered":"2024-09-11T23:24:04.945722+0000","last_unstale":"2024-09-11T23:24:04.955473+0000","last_undegraded":"2024-09-11T23:24:04.955473+0000","last_fullsized":"2024-09-11T23:24:04.955473+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:44.096054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.951221+0000","last_change":"2024-09-11T23:24:04.946137+0000","last_active":"2024-09-11T23:24:04.951221+0000","last_peered":"2024-09-11T23:24:04.951221+0000","last_clean":"2024-09-11T23:24:04.951221+0000","last_became_active":"2024-09-11T23:24:04.945810+0000","last_became_peered":"2024-09-11T23:24:04.945810+0000","last_unstale":"2024-09-11T23:24:04.951221+0000","last_undegraded":"2024-09-11T23:24:04.951221+0000","last_fullsized":"2024-09-11T23:24:04.951221+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:54.830956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.959635+0000","last_change":"2024-09-11T23:24:04.956313+0000","last_active":"2024-09-11T23:24:04.959635+0000","last_peered":"2024-09-11T23:24:04.959635+0000","last_clean":"2024-09-11T23:24:04.959635+0000","last_became_active":"2024-09-11T23:24:04.954430+0000","last_became_peered":"2024-09-11T23:24:04.954430+0000","last_unstale":"2024-09-11T23:24:04.959635+0000","last_undegraded":"2024-09-11T23:24:04.959635+0000","last_fullsized":"2024-09-11T23:24:04.959635+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:22.813663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960478+0000","last_change":"2024-09-11T23:24:04.951813+0000","last_active":"2024-09-11T23:24:04.960478+0000","last_peered":"2024-09-11T23:24:04.960478+0000","last_clean":"2024-09-11T23:24:04.960478+0000","last_became_active":"2024-09-11T23:24:04.944718+0000","last_became_peered":"2024-09-11T23:24:04.944718+0000","last_unstale":"2024-09-11T23:24:04.960478+0000","last_undegraded":"2024-09-11T23:24:04.960478+0000","last_fullsized":"2024-09-11T23:24:04.960478+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:27.929111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.958280+0000","last_change":"2024-09-11T23:24:04.950855+0000","last_active":"2024-09-11T23:24:04.958280+0000","last_peered":"2024-09-11T23:24:04.958280+0000","last_clean":"2024-09-11T23:24:04.958280+0000","last_became_active":"2024-09-11T23:24:04.950551+0000","last_became_peered":"2024-09-11T23:24:04.950551+0000","last_unstale":"2024-09-11T23:24:04.958280+0000","last_undegraded":"2024-09-11T23:24:04.958280+0000","last_fullsized":"2024-09-11T23:24:04.958280+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:00.053809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.956414+0000","last_change":"2024-09-11T23:24:04.952591+0000","last_active":"2024-09-11T23:24:04.956414+0000","last_peered":"2024-09-11T23:24:04.956414+0000","last_clean":"2024-09-11T23:24:04.956414+0000","last_became_active":"2024-09-11T23:24:04.951978+0000","last_became_peered":"2024-09-11T23:24:04.951978+0000","last_unstale":"2024-09-11T23:24:04.956414+0000","last_undegraded":"2024-09-11T23:24:04.956414+0000","last_fullsized":"2024-09-11T23:24:04.956414+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:53.391511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960166+0000","last_change":"2024-09-11T23:24:04.952219+0000","last_active":"2024-09-11T23:24:04.960166+0000","last_peered":"2024-09-11T23:24:04.960166+0000","last_clean":"2024-09-11T23:24:04.960166+0000","last_became_active":"2024-09-11T23:24:04.948927+0000","last_became_peered":"2024-09-11T23:24:04.948927+0000","last_unstale":"2024-09-11T23:24:04.960166+0000","last_undegraded":"2024-09-11T23:24:04.960166+0000","last_fullsized":"2024-09-11T23:24:04.960166+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:13.993691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.955218+0000","last_change":"2024-09-11T23:24:04.950535+0000","last_active":"2024-09-11T23:24:04.955218+0000","last_peered":"2024-09-11T23:24:04.955218+0000","last_clean":"2024-09-11T23:24:04.955218+0000","last_became_active":"2024-09-11T23:24:04.949570+0000","last_became_peered":"2024-09-11T23:24:04.949570+0000","last_unstale":"2024-09-11T23:24:04.955218+0000","last_undegraded":"2024-09-11T23:24:04.955218+0000","last_fullsized":"2024-09-11T23:24:04.955218+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:12.941055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.955497+0000","last_change":"2024-09-11T23:24:04.949195+0000","last_active":"2024-09-11T23:24:04.955497+0000","last_peered":"2024-09-11T23:24:04.955497+0000","last_clean":"2024-09-11T23:24:04.955497+0000","last_became_active":"2024-09-11T23:24:04.948939+0000","last_became_peered":"2024-09-11T23:24:04.948939+0000","last_unstale":"2024-09-11T23:24:04.955497+0000","last_undegraded":"2024-09-11T23:24:04.955497+0000","last_fullsized":"2024-09-11T23:24:04.955497+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:30.221462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.947332+0000","last_change":"2024-09-11T23:24:04.941274+0000","last_active":"2024-09-11T23:24:04.947332+0000","last_peered":"2024-09-11T23:24:04.947332+0000","last_clean":"2024-09-11T23:24:04.947332+0000","last_became_active":"2024-09-11T23:24:04.941000+0000","last_became_peered":"2024-09-11T23:24:04.941000+0000","last_unstale":"2024-09-11T23:24:04.947332+0000","last_undegraded":"2024-09-11T23:24:04.947332+0000","last_fullsized":"2024-09-11T23:24:04.947332+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:45.382617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.969332+0000","last_change":"2024-09-11T23:24:04.965113+0000","last_active":"2024-09-11T23:24:04.969332+0000","last_peered":"2024-09-11T23:24:04.969332+0000","last_clean":"2024-09-11T23:24:04.969332+0000","last_became_active":"2024-09-11T23:24:04.961957+0000","last_became_peered":"2024-09-11T23:24:04.961957+0000","last_unstale":"2024-09-11T23:24:04.969332+0000","last_undegraded":"2024-09-11T23:24:04.969332+0000","last_fullsized":"2024-09-11T23:24:04.969332+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:40.131359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.967253+0000","last_change":"2024-09-11T23:24:04.960923+0000","last_active":"2024-09-11T23:24:04.967253+0000","last_peered":"2024-09-11T23:24:04.967253+0000","last_clean":"2024-09-11T23:24:04.967253+0000","last_became_active":"2024-09-11T23:24:04.959688+0000","last_became_peered":"2024-09-11T23:24:04.959688+0000","last_unstale":"2024-09-11T23:24:04.967253+0000","last_undegraded":"2024-09-11T23:24:04.967253+0000","last_fullsized":"2024-09-11T23:24:04.967253+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:06.989579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960046+0000","last_change":"2024-09-11T23:24:04.953926+0000","last_active":"2024-09-11T23:24:04.960046+0000","last_peered":"2024-09-11T23:24:04.960046+0000","last_clean":"2024-09-11T23:24:04.960046+0000","last_became_active":"2024-09-11T23:24:04.952915+0000","last_became_peered":"2024-09-11T23:24:04.952915+0000","last_unstale":"2024-09-11T23:24:04.960046+0000","last_undegraded":"2024-09-11T23:24:04.960046+0000","last_fullsized":"2024-09-11T23:24:04.960046+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:53.613907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.953375+0000","last_change":"2024-09-11T23:24:04.947166+0000","last_active":"2024-09-11T23:24:04.953375+0000","last_peered":"2024-09-11T23:24:04.953375+0000","last_clean":"2024-09-11T23:24:04.953375+0000","last_became_active":"2024-09-11T23:24:04.946899+0000","last_became_peered":"2024-09-11T23:24:04.946899+0000","last_unstale":"2024-09-11T23:24:04.953375+0000","last_undegraded":"2024-09-11T23:24:04.953375+0000","last_fullsized":"2024-09-11T23:24:04.953375+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:39.848874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960104+0000","last_change":"2024-09-11T23:24:04.953810+0000","last_active":"2024-09-11T23:24:04.960104+0000","last_peered":"2024-09-11T23:24:04.960104+0000","last_clean":"2024-09-11T23:24:04.960104+0000","last_became_active":"2024-09-11T23:24:04.953588+0000","last_became_peered":"2024-09-11T23:24:04.953588+0000","last_unstale":"2024-09-11T23:24:04.960104+0000","last_undegraded":"2024-09-11T23:24:04.960104+0000","last_fullsized":"2024-09-11T23:24:04.960104+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:53.613907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.955196+0000","last_change":"2024-09-11T23:24:04.950597+0000","last_active":"2024-09-11T23:24:04.955196+0000","last_peered":"2024-09-11T23:24:04.955196+0000","last_clean":"2024-09-11T23:24:04.955196+0000","last_became_active":"2024-09-11T23:24:04.950350+0000","last_became_peered":"2024-09-11T23:24:04.950350+0000","last_unstale":"2024-09-11T23:24:04.955196+0000","last_undegraded":"2024-09-11T23:24:04.955196+0000","last_fullsized":"2024-09-11T23:24:04.955196+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:04.648612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.958950+0000","last_change":"2024-09-11T23:24:04.954075+0000","last_active":"2024-09-11T23:24:04.958950+0000","last_peered":"2024-09-11T23:24:04.958950+0000","last_clean":"2024-09-11T23:24:04.958950+0000","last_became_active":"2024-09-11T23:24:04.953794+0000","last_became_peered":"2024-09-11T23:24:04.953794+0000","last_unstale":"2024-09-11T23:24:04.958950+0000","last_undegraded":"2024-09-11T23:24:04.958950+0000","last_fullsized":"2024-09-11T23:24:04.958950+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:33.187674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960712+0000","last_change":"2024-09-11T23:24:04.949811+0000","last_active":"2024-09-11T23:24:04.960712+0000","last_peered":"2024-09-11T23:24:04.960712+0000","last_clean":"2024-09-11T23:24:04.960712+0000","last_became_active":"2024-09-11T23:24:04.949527+0000","last_became_peered":"2024-09-11T23:24:04.949527+0000","last_unstale":"2024-09-11T23:24:04.960712+0000","last_undegraded":"2024-09-11T23:24:04.960712+0000","last_fullsized":"2024-09-11T23:24:04.960712+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:31.079705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.966670+0000","last_change":"2024-09-11T23:24:04.958792+0000","last_active":"2024-09-11T23:24:04.966670+0000","last_peered":"2024-09-11T23:24:04.966670+0000","last_clean":"2024-09-11T23:24:04.966670+0000","last_became_active":"2024-09-11T23:24:04.954149+0000","last_became_peered":"2024-09-11T23:24:04.954149+0000","last_unstale":"2024-09-11T23:24:04.966670+0000","last_undegraded":"2024-09-11T23:24:04.966670+0000","last_fullsized":"2024-09-11T23:24:04.966670+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:36.295298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.958030+0000","last_change":"2024-09-11T23:24:04.947687+0000","last_active":"2024-09-11T23:24:04.958030+0000","last_peered":"2024-09-11T23:24:04.958030+0000","last_clean":"2024-09-11T23:24:04.958030+0000","last_became_active":"2024-09-11T23:24:04.946825+0000","last_became_peered":"2024-09-11T23:24:04.946825+0000","last_unstale":"2024-09-11T23:24:04.958030+0000","last_undegraded":"2024-09-11T23:24:04.958030+0000","last_fullsized":"2024-09-11T23:24:04.958030+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:52.462969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.969325+0000","last_change":"2024-09-11T23:24:04.967293+0000","last_active":"2024-09-11T23:24:04.969325+0000","last_peered":"2024-09-11T23:24:04.969325+0000","last_clean":"2024-09-11T23:24:04.969325+0000","last_became_active":"2024-09-11T23:24:04.965930+0000","last_became_peered":"2024-09-11T23:24:04.965930+0000","last_unstale":"2024-09-11T23:24:04.969325+0000","last_undegraded":"2024-09-11T23:24:04.969325+0000","last_fullsized":"2024-09-11T23:24:04.969325+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:22.293134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.947862+0000","last_change":"2024-09-11T23:24:04.942915+0000","last_active":"2024-09-11T23:24:04.947862+0000","last_peered":"2024-09-11T23:24:04.947862+0000","last_clean":"2024-09-11T23:24:04.947862+0000","last_became_active":"2024-09-11T23:24:04.942625+0000","last_became_peered":"2024-09-11T23:24:04.942625+0000","last_unstale":"2024-09-11T23:24:04.947862+0000","last_undegraded":"2024-09-11T23:24:04.947862+0000","last_fullsized":"2024-09-11T23:24:04.947862+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:27:19.119875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.942092+0000","last_change":"2024-09-11T23:24:04.939309+0000","last_active":"2024-09-11T23:24:04.942092+0000","last_peered":"2024-09-11T23:24:04.942092+0000","last_clean":"2024-09-11T23:24:04.942092+0000","last_became_active":"2024-09-11T23:24:04.939031+0000","last_became_peered":"2024-09-11T23:24:04.939031+0000","last_unstale":"2024-09-11T23:24:04.942092+0000","last_undegraded":"2024-09-11T23:24:04.942092+0000","last_fullsized":"2024-09-11T23:24:04.942092+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:31.840176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"115'4","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.970081+0000","last_change":"2024-09-11T23:24:03.936698+0000","last_active":"2024-09-11T23:24:04.970081+0000","last_peered":"2024-09-11T23:24:04.970081+0000","last_clean":"2024-09-11T23:24:04.970081+0000","last_became_active":"2024-09-11T23:24:03.934978+0000","last_became_peered":"2024-09-11T23:24:03.934978+0000","last_unstale":"2024-09-11T23:24:04.970081+0000","last_undegraded":"2024-09-11T23:24:04.970081+0000","last_fullsized":"2024-09-11T23:24:04.970081+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:10.057949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960359+0000","last_change":"2024-09-11T23:24:04.957947+0000","last_active":"2024-09-11T23:24:04.960359+0000","last_peered":"2024-09-11T23:24:04.960359+0000","last_clean":"2024-09-11T23:24:04.960359+0000","last_became_active":"2024-09-11T23:24:04.957681+0000","last_became_peered":"2024-09-11T23:24:04.957681+0000","last_unstale":"2024-09-11T23:24:04.960359+0000","last_undegraded":"2024-09-11T23:24:04.960359+0000","last_fullsized":"2024-09-11T23:24:04.960359+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:23.183110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"115'1","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.968327+0000","last_change":"2024-09-11T23:24:03.938446+0000","last_active":"2024-09-11T23:24:04.968327+0000","last_peered":"2024-09-11T23:24:04.968327+0000","last_clean":"2024-09-11T23:24:04.968327+0000","last_became_active":"2024-09-11T23:24:03.936288+0000","last_became_peered":"2024-09-11T23:24:03.936288+0000","last_unstale":"2024-09-11T23:24:04.968327+0000","last_undegraded":"2024-09-11T23:24:04.968327+0000","last_fullsized":"2024-09-11T23:24:04.968327+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:07.872337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.959026+0000","last_change":"2024-09-11T23:24:04.953469+0000","last_active":"2024-09-11T23:24:04.959026+0000","last_peered":"2024-09-11T23:24:04.959026+0000","last_clean":"2024-09-11T23:24:04.959026+0000","last_became_active":"2024-09-11T23:24:04.951873+0000","last_became_peered":"2024-09-11T23:24:04.951873+0000","last_unstale":"2024-09-11T23:24:04.959026+0000","last_undegraded":"2024-09-11T23:24:04.959026+0000","last_fullsized":"2024-09-11T23:24:04.959026+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:56.323763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"115'2","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.969289+0000","last_change":"2024-09-11T23:24:03.937291+0000","last_active":"2024-09-11T23:24:04.969289+0000","last_peered":"2024-09-11T23:24:04.969289+0000","last_clean":"2024-09-11T23:24:04.969289+0000","last_became_active":"2024-09-11T23:24:03.936974+0000","last_became_peered":"2024-09-11T23:24:03.936974+0000","last_unstale":"2024-09-11T23:24:04.969289+0000","last_undegraded":"2024-09-11T23:24:04.969289+0000","last_fullsized":"2024-09-11T23:24:04.969289+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:26.685102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.964513+0000","last_change":"2024-09-11T23:24:04.958496+0000","last_active":"2024-09-11T23:24:04.964513+0000","last_peered":"2024-09-11T23:24:04.964513+0000","last_clean":"2024-09-11T23:24:04.964513+0000","last_became_active":"2024-09-11T23:24:04.957909+0000","last_became_peered":"2024-09-11T23:24:04.957909+0000","last_unstale":"2024-09-11T23:24:04.964513+0000","last_undegraded":"2024-09-11T23:24:04.964513+0000","last_fullsized":"2024-09-11T23:24:04.964513+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:01.189307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"115'2","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.969418+0000","last_change":"2024-09-11T23:24:03.941887+0000","last_active":"2024-09-11T23:24:04.969418+0000","last_peered":"2024-09-11T23:24:04.969418+0000","last_clean":"2024-09-11T23:24:04.969418+0000","last_became_active":"2024-09-11T23:24:03.941376+0000","last_became_peered":"2024-09-11T23:24:03.941376+0000","last_unstale":"2024-09-11T23:24:04.969418+0000","last_undegraded":"2024-09-11T23:24:04.969418+0000","last_fullsized":"2024-09-11T23:24:04.969418+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:50.045125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.954783+0000","last_change":"2024-09-11T23:24:04.949113+0000","last_active":"2024-09-11T23:24:04.954783+0000","last_peered":"2024-09-11T23:24:04.954783+0000","last_clean":"2024-09-11T23:24:04.954783+0000","last_became_active":"2024-09-11T23:24:04.948730+0000","last_became_peered":"2024-09-11T23:24:04.948730+0000","last_unstale":"2024-09-11T23:24:04.954783+0000","last_undegraded":"2024-09-11T23:24:04.954783+0000","last_fullsized":"2024-09-11T23:24:04.954783+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:58.760445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"115'1","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.969238+0000","last_change":"2024-09-11T23:24:03.938158+0000","last_active":"2024-09-11T23:24:04.969238+0000","last_peered":"2024-09-11T23:24:04.969238+0000","last_clean":"2024-09-11T23:24:04.969238+0000","last_became_active":"2024-09-11T23:24:03.937831+0000","last_became_peered":"2024-09-11T23:24:03.937831+0000","last_unstale":"2024-09-11T23:24:04.969238+0000","last_undegraded":"2024-09-11T23:24:04.969238+0000","last_fullsized":"2024-09-11T23:24:04.969238+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:50.621773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.968281+0000","last_change":"2024-09-11T23:24:04.963131+0000","last_active":"2024-09-11T23:24:04.968281+0000","last_peered":"2024-09-11T23:24:04.968281+0000","last_clean":"2024-09-11T23:24:04.968281+0000","last_became_active":"2024-09-11T23:24:04.962928+0000","last_became_peered":"2024-09-11T23:24:04.962928+0000","last_unstale":"2024-09-11T23:24:04.968281+0000","last_undegraded":"2024-09-11T23:24:04.968281+0000","last_fullsized":"2024-09-11T23:24:04.968281+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:33.750436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"115'1","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.968313+0000","last_change":"2024-09-11T23:24:03.939035+0000","last_active":"2024-09-11T23:24:04.968313+0000","last_peered":"2024-09-11T23:24:04.968313+0000","last_clean":"2024-09-11T23:24:04.968313+0000","last_became_active":"2024-09-11T23:24:03.938543+0000","last_became_peered":"2024-09-11T23:24:03.938543+0000","last_unstale":"2024-09-11T23:24:04.968313+0000","last_undegraded":"2024-09-11T23:24:04.968313+0000","last_fullsized":"2024-09-11T23:24:04.968313+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:07.289505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.957041+0000","last_change":"2024-09-11T23:24:04.949845+0000","last_active":"2024-09-11T23:24:04.957041+0000","last_peered":"2024-09-11T23:24:04.957041+0000","last_clean":"2024-09-11T23:24:04.957041+0000","last_became_active":"2024-09-11T23:24:04.949589+0000","last_became_peered":"2024-09-11T23:24:04.949589+0000","last_unstale":"2024-09-11T23:24:04.957041+0000","last_undegraded":"2024-09-11T23:24:04.957041+0000","last_fullsized":"2024-09-11T23:24:04.957041+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:08.878652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.935674+0000","last_change":"2024-09-11T23:24:03.938145+0000","last_active":"2024-09-11T23:24:04.935674+0000","last_peered":"2024-09-11T23:24:04.935674+0000","last_clean":"2024-09-11T23:24:04.935674+0000","last_became_active":"2024-09-11T23:24:03.937857+0000","last_became_peered":"2024-09-11T23:24:03.937857+0000","last_unstale":"2024-09-11T23:24:04.935674+0000","last_undegraded":"2024-09-11T23:24:04.935674+0000","last_fullsized":"2024-09-11T23:24:04.935674+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:30.073390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.955787+0000","last_change":"2024-09-11T23:24:04.945273+0000","last_active":"2024-09-11T23:24:04.955787+0000","last_peered":"2024-09-11T23:24:04.955787+0000","last_clean":"2024-09-11T23:24:04.955787+0000","last_became_active":"2024-09-11T23:24:04.944339+0000","last_became_peered":"2024-09-11T23:24:04.944339+0000","last_unstale":"2024-09-11T23:24:04.955787+0000","last_undegraded":"2024-09-11T23:24:04.955787+0000","last_fullsized":"2024-09-11T23:24:04.955787+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:01.208246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.934461+0000","last_change":"2024-09-11T23:24:03.934796+0000","last_active":"2024-09-11T23:24:04.934461+0000","last_peered":"2024-09-11T23:24:04.934461+0000","last_clean":"2024-09-11T23:24:04.934461+0000","last_became_active":"2024-09-11T23:24:03.934356+0000","last_became_peered":"2024-09-11T23:24:03.934356+0000","last_unstale":"2024-09-11T23:24:04.934461+0000","last_undegraded":"2024-09-11T23:24:04.934461+0000","last_fullsized":"2024-09-11T23:24:04.934461+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:51.247109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.959944+0000","last_change":"2024-09-11T23:24:04.957730+0000","last_active":"2024-09-11T23:24:04.959944+0000","last_peered":"2024-09-11T23:24:04.959944+0000","last_clean":"2024-09-11T23:24:04.959944+0000","last_became_active":"2024-09-11T23:24:04.957473+0000","last_became_peered":"2024-09-11T23:24:04.957473+0000","last_unstale":"2024-09-11T23:24:04.959944+0000","last_undegraded":"2024-09-11T23:24:04.959944+0000","last_fullsized":"2024-09-11T23:24:04.959944+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:50.067991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.934078+0000","last_change":"2024-09-11T23:24:03.932077+0000","last_active":"2024-09-11T23:24:04.934078+0000","last_peered":"2024-09-11T23:24:04.934078+0000","last_clean":"2024-09-11T23:24:04.934078+0000","last_became_active":"2024-09-11T23:24:03.931822+0000","last_became_peered":"2024-09-11T23:24:03.931822+0000","last_unstale":"2024-09-11T23:24:04.934078+0000","last_undegraded":"2024-09-11T23:24:04.934078+0000","last_fullsized":"2024-09-11T23:24:04.934078+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:52.607592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.954531+0000","last_change":"2024-09-11T23:24:04.947787+0000","last_active":"2024-09-11T23:24:04.954531+0000","last_peered":"2024-09-11T23:24:04.954531+0000","last_clean":"2024-09-11T23:24:04.954531+0000","last_became_active":"2024-09-11T23:24:04.945574+0000","last_became_peered":"2024-09-11T23:24:04.945574+0000","last_unstale":"2024-09-11T23:24:04.954531+0000","last_undegraded":"2024-09-11T23:24:04.954531+0000","last_fullsized":"2024-09-11T23:24:04.954531+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:23.183110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.934723+0000","last_change":"2024-09-11T23:24:03.935910+0000","last_active":"2024-09-11T23:24:04.934723+0000","last_peered":"2024-09-11T23:24:04.934723+0000","last_clean":"2024-09-11T23:24:04.934723+0000","last_became_active":"2024-09-11T23:24:03.935345+0000","last_became_peered":"2024-09-11T23:24:03.935345+0000","last_unstale":"2024-09-11T23:24:04.934723+0000","last_undegraded":"2024-09-11T23:24:04.934723+0000","last_fullsized":"2024-09-11T23:24:04.934723+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:04.361164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.959248+0000","last_change":"2024-09-11T23:24:04.956173+0000","last_active":"2024-09-11T23:24:04.959248+0000","last_peered":"2024-09-11T23:24:04.959248+0000","last_clean":"2024-09-11T23:24:04.959248+0000","last_became_active":"2024-09-11T23:24:04.955797+0000","last_became_peered":"2024-09-11T23:24:04.955797+0000","last_unstale":"2024-09-11T23:24:04.959248+0000","last_undegraded":"2024-09-11T23:24:04.959248+0000","last_fullsized":"2024-09-11T23:24:04.959248+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:16.150386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"115'3","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.968482+0000","last_change":"2024-09-11T23:24:03.933449+0000","last_active":"2024-09-11T23:24:04.968482+0000","last_peered":"2024-09-11T23:24:04.968482+0000","last_clean":"2024-09-11T23:24:04.968482+0000","last_became_active":"2024-09-11T23:24:03.933072+0000","last_became_peered":"2024-09-11T23:24:03.933072+0000","last_unstale":"2024-09-11T23:24:04.968482+0000","last_undegraded":"2024-09-11T23:24:04.968482+0000","last_fullsized":"2024-09-11T23:24:04.968482+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:26.922796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.956947+0000","last_change":"2024-09-11T23:24:04.952816+0000","last_active":"2024-09-11T23:24:04.956947+0000","last_peered":"2024-09-11T23:24:04.956947+0000","last_clean":"2024-09-11T23:24:04.956947+0000","last_became_active":"2024-09-11T23:24:04.950922+0000","last_became_peered":"2024-09-11T23:24:04.950922+0000","last_unstale":"2024-09-11T23:24:04.956947+0000","last_undegraded":"2024-09-11T23:24:04.956947+0000","last_fullsized":"2024-09-11T23:24:04.956947+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:59.406912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"115'6","reported_seq":18,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.971866+0000","last_change":"2024-09-11T23:24:03.939273+0000","last_active":"2024-09-11T23:24:04.971866+0000","last_peered":"2024-09-11T23:24:04.971866+0000","last_clean":"2024-09-11T23:24:04.971866+0000","last_became_active":"2024-09-11T23:24:03.938960+0000","last_became_peered":"2024-09-11T23:24:03.938960+0000","last_unstale":"2024-09-11T23:24:04.971866+0000","last_undegraded":"2024-09-11T23:24:04.971866+0000","last_fullsized":"2024-09-11T23:24:04.971866+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:30.865559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.959732+0000","last_change":"2024-09-11T23:24:04.956879+0000","last_active":"2024-09-11T23:24:04.959732+0000","last_peered":"2024-09-11T23:24:04.959732+0000","last_clean":"2024-09-11T23:24:04.959732+0000","last_became_active":"2024-09-11T23:24:04.956623+0000","last_became_peered":"2024-09-11T23:24:04.956623+0000","last_unstale":"2024-09-11T23:24:04.959732+0000","last_undegraded":"2024-09-11T23:24:04.959732+0000","last_fullsized":"2024-09-11T23:24:04.959732+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:59.792694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.930969+0000","last_change":"2024-09-11T23:24:03.925452+0000","last_active":"2024-09-11T23:24:04.930969+0000","last_peered":"2024-09-11T23:24:04.930969+0000","last_clean":"2024-09-11T23:24:04.930969+0000","last_became_active":"2024-09-11T23:24:03.924996+0000","last_became_peered":"2024-09-11T23:24:03.924996+0000","last_unstale":"2024-09-11T23:24:04.930969+0000","last_undegraded":"2024-09-11T23:24:04.930969+0000","last_fullsized":"2024-09-11T23:24:04.930969+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:15.796517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.955914+0000","last_change":"2024-09-11T23:24:04.948227+0000","last_active":"2024-09-11T23:24:04.955914+0000","last_peered":"2024-09-11T23:24:04.955914+0000","last_clean":"2024-09-11T23:24:04.955914+0000","last_became_active":"2024-09-11T23:24:04.947942+0000","last_became_peered":"2024-09-11T23:24:04.947942+0000","last_unstale":"2024-09-11T23:24:04.955914+0000","last_undegraded":"2024-09-11T23:24:04.955914+0000","last_fullsized":"2024-09-11T23:24:04.955914+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:31.871874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.936395+0000","last_change":"2024-09-11T23:24:03.940462+0000","last_active":"2024-09-11T23:24:04.936395+0000","last_peered":"2024-09-11T23:24:04.936395+0000","last_clean":"2024-09-11T23:24:04.936395+0000","last_became_active":"2024-09-11T23:24:03.940207+0000","last_became_peered":"2024-09-11T23:24:03.940207+0000","last_unstale":"2024-09-11T23:24:04.936395+0000","last_undegraded":"2024-09-11T23:24:04.936395+0000","last_fullsized":"2024-09-11T23:24:04.936395+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:26.236292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.958763+0000","last_change":"2024-09-11T23:24:04.954115+0000","last_active":"2024-09-11T23:24:04.958763+0000","last_peered":"2024-09-11T23:24:04.958763+0000","last_clean":"2024-09-11T23:24:04.958763+0000","last_became_active":"2024-09-11T23:24:04.953131+0000","last_became_peered":"2024-09-11T23:24:04.953131+0000","last_unstale":"2024-09-11T23:24:04.958763+0000","last_undegraded":"2024-09-11T23:24:04.958763+0000","last_fullsized":"2024-09-11T23:24:04.958763+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:18.392796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"115'8","reported_seq":20,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.970261+0000","last_change":"2024-09-11T23:24:03.932786+0000","last_active":"2024-09-11T23:24:04.970261+0000","last_peered":"2024-09-11T23:24:04.970261+0000","last_clean":"2024-09-11T23:24:04.970261+0000","last_became_active":"2024-09-11T23:24:03.932467+0000","last_became_peered":"2024-09-11T23:24:03.932467+0000","last_unstale":"2024-09-11T23:24:04.970261+0000","last_undegraded":"2024-09-11T23:24:04.970261+0000","last_fullsized":"2024-09-11T23:24:04.970261+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:00.201931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.966506+0000","last_change":"2024-09-11T23:24:04.960846+0000","last_active":"2024-09-11T23:24:04.966506+0000","last_peered":"2024-09-11T23:24:04.966506+0000","last_clean":"2024-09-11T23:24:04.966506+0000","last_became_active":"2024-09-11T23:24:04.960059+0000","last_became_peered":"2024-09-11T23:24:04.960059+0000","last_unstale":"2024-09-11T23:24:04.966506+0000","last_undegraded":"2024-09-11T23:24:04.966506+0000","last_fullsized":"2024-09-11T23:24:04.966506+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:27.250619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"115'1","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.966654+0000","last_change":"2024-09-11T23:24:03.931885+0000","last_active":"2024-09-11T23:24:04.966654+0000","last_peered":"2024-09-11T23:24:04.966654+0000","last_clean":"2024-09-11T23:24:04.966654+0000","last_became_active":"2024-09-11T23:24:03.931600+0000","last_became_peered":"2024-09-11T23:24:03.931600+0000","last_unstale":"2024-09-11T23:24:04.966654+0000","last_undegraded":"2024-09-11T23:24:04.966654+0000","last_fullsized":"2024-09-11T23:24:04.966654+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:17.386482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.961934+0000","last_change":"2024-09-11T23:24:04.951776+0000","last_active":"2024-09-11T23:24:04.961934+0000","last_peered":"2024-09-11T23:24:04.961934+0000","last_clean":"2024-09-11T23:24:04.961934+0000","last_became_active":"2024-09-11T23:24:04.951349+0000","last_became_peered":"2024-09-11T23:24:04.951349+0000","last_unstale":"2024-09-11T23:24:04.961934+0000","last_undegraded":"2024-09-11T23:24:04.961934+0000","last_fullsized":"2024-09-11T23:24:04.961934+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:40.797172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"115'2","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.970004+0000","last_change":"2024-09-11T23:24:03.930575+0000","last_active":"2024-09-11T23:24:04.970004+0000","last_peered":"2024-09-11T23:24:04.970004+0000","last_clean":"2024-09-11T23:24:04.970004+0000","last_became_active":"2024-09-11T23:24:03.930256+0000","last_became_peered":"2024-09-11T23:24:03.930256+0000","last_unstale":"2024-09-11T23:24:04.970004+0000","last_undegraded":"2024-09-11T23:24:04.970004+0000","last_fullsized":"2024-09-11T23:24:04.970004+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:10.832788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.948807+0000","last_change":"2024-09-11T23:24:04.945169+0000","last_active":"2024-09-11T23:24:04.948807+0000","last_peered":"2024-09-11T23:24:04.948807+0000","last_clean":"2024-09-11T23:24:04.948807+0000","last_became_active":"2024-09-11T23:24:04.941072+0000","last_became_peered":"2024-09-11T23:24:04.941072+0000","last_unstale":"2024-09-11T23:24:04.948807+0000","last_undegraded":"2024-09-11T23:24:04.948807+0000","last_fullsized":"2024-09-11T23:24:04.948807+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:35.030483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"115'1","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.967926+0000","last_change":"2024-09-11T23:24:03.932005+0000","last_active":"2024-09-11T23:24:04.967926+0000","last_peered":"2024-09-11T23:24:04.967926+0000","last_clean":"2024-09-11T23:24:04.967926+0000","last_became_active":"2024-09-11T23:24:03.931648+0000","last_became_peered":"2024-09-11T23:24:03.931648+0000","last_unstale":"2024-09-11T23:24:04.967926+0000","last_undegraded":"2024-09-11T23:24:04.967926+0000","last_fullsized":"2024-09-11T23:24:04.967926+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:39.790857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.955725+0000","last_change":"2024-09-11T23:24:04.944680+0000","last_active":"2024-09-11T23:24:04.955725+0000","last_peered":"2024-09-11T23:24:04.955725+0000","last_clean":"2024-09-11T23:24:04.955725+0000","last_became_active":"2024-09-11T23:24:04.944388+0000","last_became_peered":"2024-09-11T23:24:04.944388+0000","last_unstale":"2024-09-11T23:24:04.955725+0000","last_undegraded":"2024-09-11T23:24:04.955725+0000","last_fullsized":"2024-09-11T23:24:04.955725+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:42.852867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.933764+0000","last_change":"2024-09-11T23:24:03.935128+0000","last_active":"2024-09-11T23:24:04.933764+0000","last_peered":"2024-09-11T23:24:04.933764+0000","last_clean":"2024-09-11T23:24:04.933764+0000","last_became_active":"2024-09-11T23:24:03.934857+0000","last_became_peered":"2024-09-11T23:24:03.934857+0000","last_unstale":"2024-09-11T23:24:04.933764+0000","last_undegraded":"2024-09-11T23:24:04.933764+0000","last_fullsized":"2024-09-11T23:24:04.933764+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:44.589681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.958895+0000","last_change":"2024-09-11T23:24:04.952228+0000","last_active":"2024-09-11T23:24:04.958895+0000","last_peered":"2024-09-11T23:24:04.958895+0000","last_clean":"2024-09-11T23:24:04.958895+0000","last_became_active":"2024-09-11T23:24:04.951928+0000","last_became_peered":"2024-09-11T23:24:04.951928+0000","last_unstale":"2024-09-11T23:24:04.958895+0000","last_undegraded":"2024-09-11T23:24:04.958895+0000","last_fullsized":"2024-09-11T23:24:04.958895+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:57.700045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"115'2","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.967608+0000","last_change":"2024-09-11T23:24:03.931151+0000","last_active":"2024-09-11T23:24:04.967608+0000","last_peered":"2024-09-11T23:24:04.967608+0000","last_clean":"2024-09-11T23:24:04.967608+0000","last_became_active":"2024-09-11T23:24:03.930827+0000","last_became_peered":"2024-09-11T23:24:03.930827+0000","last_unstale":"2024-09-11T23:24:04.967608+0000","last_undegraded":"2024-09-11T23:24:04.967608+0000","last_fullsized":"2024-09-11T23:24:04.967608+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:38.745274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.956243+0000","last_change":"2024-09-11T23:24:04.950247+0000","last_active":"2024-09-11T23:24:04.956243+0000","last_peered":"2024-09-11T23:24:04.956243+0000","last_clean":"2024-09-11T23:24:04.956243+0000","last_became_active":"2024-09-11T23:24:04.949263+0000","last_became_peered":"2024-09-11T23:24:04.949263+0000","last_unstale":"2024-09-11T23:24:04.956243+0000","last_undegraded":"2024-09-11T23:24:04.956243+0000","last_fullsized":"2024-09-11T23:24:04.956243+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:59.282208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.934910+0000","last_change":"2024-09-11T23:24:03.938826+0000","last_active":"2024-09-11T23:24:04.934910+0000","last_peered":"2024-09-11T23:24:04.934910+0000","last_clean":"2024-09-11T23:24:04.934910+0000","last_became_active":"2024-09-11T23:24:03.938210+0000","last_became_peered":"2024-09-11T23:24:03.938210+0000","last_unstale":"2024-09-11T23:24:04.934910+0000","last_undegraded":"2024-09-11T23:24:04.934910+0000","last_fullsized":"2024-09-11T23:24:04.934910+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:13:00.586737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.961344+0000","last_change":"2024-09-11T23:24:04.959286+0000","last_active":"2024-09-11T23:24:04.961344+0000","last_peered":"2024-09-11T23:24:04.961344+0000","last_clean":"2024-09-11T23:24:04.961344+0000","last_became_active":"2024-09-11T23:24:04.959041+0000","last_became_peered":"2024-09-11T23:24:04.959041+0000","last_unstale":"2024-09-11T23:24:04.961344+0000","last_undegraded":"2024-09-11T23:24:04.961344+0000","last_fullsized":"2024-09-11T23:24:04.961344+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:39.751589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.933672+0000","last_change":"2024-09-11T23:24:03.930315+0000","last_active":"2024-09-11T23:24:04.933672+0000","last_peered":"2024-09-11T23:24:04.933672+0000","last_clean":"2024-09-11T23:24:04.933672+0000","last_became_active":"2024-09-11T23:24:03.929154+0000","last_became_peered":"2024-09-11T23:24:03.929154+0000","last_unstale":"2024-09-11T23:24:04.933672+0000","last_undegraded":"2024-09-11T23:24:04.933672+0000","last_fullsized":"2024-09-11T23:24:04.933672+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:38.278544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.968248+0000","last_change":"2024-09-11T23:24:04.963751+0000","last_active":"2024-09-11T23:24:04.968248+0000","last_peered":"2024-09-11T23:24:04.968248+0000","last_clean":"2024-09-11T23:24:04.968248+0000","last_became_active":"2024-09-11T23:24:04.961564+0000","last_became_peered":"2024-09-11T23:24:04.961564+0000","last_unstale":"2024-09-11T23:24:04.968248+0000","last_undegraded":"2024-09-11T23:24:04.968248+0000","last_fullsized":"2024-09-11T23:24:04.968248+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:54.332075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.941767+0000","last_change":"2024-09-11T23:24:03.932182+0000","last_active":"2024-09-11T23:24:04.941767+0000","last_peered":"2024-09-11T23:24:04.941767+0000","last_clean":"2024-09-11T23:24:04.941767+0000","last_became_active":"2024-09-11T23:24:03.931897+0000","last_became_peered":"2024-09-11T23:24:03.931897+0000","last_unstale":"2024-09-11T23:24:04.941767+0000","last_undegraded":"2024-09-11T23:24:04.941767+0000","last_fullsized":"2024-09-11T23:24:04.941767+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:02.621995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.947396+0000","last_change":"2024-09-11T23:24:04.944019+0000","last_active":"2024-09-11T23:24:04.947396+0000","last_peered":"2024-09-11T23:24:04.947396+0000","last_clean":"2024-09-11T23:24:04.947396+0000","last_became_active":"2024-09-11T23:24:04.943762+0000","last_became_peered":"2024-09-11T23:24:04.943762+0000","last_unstale":"2024-09-11T23:24:04.947396+0000","last_undegraded":"2024-09-11T23:24:04.947396+0000","last_fullsized":"2024-09-11T23:24:04.947396+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:18.231514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"115'2","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.969553+0000","last_change":"2024-09-11T23:24:03.926623+0000","last_active":"2024-09-11T23:24:04.969553+0000","last_peered":"2024-09-11T23:24:04.969553+0000","last_clean":"2024-09-11T23:24:04.969553+0000","last_became_active":"2024-09-11T23:24:03.926167+0000","last_became_peered":"2024-09-11T23:24:03.926167+0000","last_unstale":"2024-09-11T23:24:04.969553+0000","last_undegraded":"2024-09-11T23:24:04.969553+0000","last_fullsized":"2024-09-11T23:24:04.969553+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:46.057351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.958986+0000","last_change":"2024-09-11T23:24:04.954367+0000","last_active":"2024-09-11T23:24:04.958986+0000","last_peered":"2024-09-11T23:24:04.958986+0000","last_clean":"2024-09-11T23:24:04.958986+0000","last_became_active":"2024-09-11T23:24:04.954074+0000","last_became_peered":"2024-09-11T23:24:04.954074+0000","last_unstale":"2024-09-11T23:24:04.958986+0000","last_undegraded":"2024-09-11T23:24:04.958986+0000","last_fullsized":"2024-09-11T23:24:04.958986+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:13.551180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.944037+0000","last_change":"2024-09-11T23:24:03.938554+0000","last_active":"2024-09-11T23:24:04.944037+0000","last_peered":"2024-09-11T23:24:04.944037+0000","last_clean":"2024-09-11T23:24:04.944037+0000","last_became_active":"2024-09-11T23:24:03.938181+0000","last_became_peered":"2024-09-11T23:24:03.938181+0000","last_unstale":"2024-09-11T23:24:04.944037+0000","last_undegraded":"2024-09-11T23:24:04.944037+0000","last_fullsized":"2024-09-11T23:24:04.944037+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:44.127736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960145+0000","last_change":"2024-09-11T23:24:04.953070+0000","last_active":"2024-09-11T23:24:04.960145+0000","last_peered":"2024-09-11T23:24:04.960145+0000","last_clean":"2024-09-11T23:24:04.960145+0000","last_became_active":"2024-09-11T23:24:04.952811+0000","last_became_peered":"2024-09-11T23:24:04.952811+0000","last_unstale":"2024-09-11T23:24:04.960145+0000","last_undegraded":"2024-09-11T23:24:04.960145+0000","last_fullsized":"2024-09-11T23:24:04.960145+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:08.878652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.937652+0000","last_change":"2024-09-11T23:24:03.934976+0000","last_active":"2024-09-11T23:24:04.937652+0000","last_peered":"2024-09-11T23:24:04.937652+0000","last_clean":"2024-09-11T23:24:04.937652+0000","last_became_active":"2024-09-11T23:24:03.934357+0000","last_became_peered":"2024-09-11T23:24:03.934357+0000","last_unstale":"2024-09-11T23:24:04.937652+0000","last_undegraded":"2024-09-11T23:24:04.937652+0000","last_fullsized":"2024-09-11T23:24:04.937652+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:41.086170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.968070+0000","last_change":"2024-09-11T23:24:04.963193+0000","last_active":"2024-09-11T23:24:04.968070+0000","last_peered":"2024-09-11T23:24:04.968070+0000","last_clean":"2024-09-11T23:24:04.968070+0000","last_became_active":"2024-09-11T23:24:04.961286+0000","last_became_peered":"2024-09-11T23:24:04.961286+0000","last_unstale":"2024-09-11T23:24:04.968070+0000","last_undegraded":"2024-09-11T23:24:04.968070+0000","last_fullsized":"2024-09-11T23:24:04.968070+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:57:45.134051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.941697+0000","last_change":"2024-09-11T23:24:03.940615+0000","last_active":"2024-09-11T23:24:04.941697+0000","last_peered":"2024-09-11T23:24:04.941697+0000","last_clean":"2024-09-11T23:24:04.941697+0000","last_became_active":"2024-09-11T23:24:03.940362+0000","last_became_peered":"2024-09-11T23:24:03.940362+0000","last_unstale":"2024-09-11T23:24:04.941697+0000","last_undegraded":"2024-09-11T23:24:04.941697+0000","last_fullsized":"2024-09-11T23:24:04.941697+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:20.411527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.969287+0000","last_change":"2024-09-11T23:24:04.967391+0000","last_active":"2024-09-11T23:24:04.969287+0000","last_peered":"2024-09-11T23:24:04.969287+0000","last_clean":"2024-09-11T23:24:04.969287+0000","last_became_active":"2024-09-11T23:24:04.965981+0000","last_became_peered":"2024-09-11T23:24:04.965981+0000","last_unstale":"2024-09-11T23:24:04.969287+0000","last_undegraded":"2024-09-11T23:24:04.969287+0000","last_fullsized":"2024-09-11T23:24:04.969287+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:31.051520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.936920+0000","last_change":"2024-09-11T23:24:03.940487+0000","last_active":"2024-09-11T23:24:04.936920+0000","last_peered":"2024-09-11T23:24:04.936920+0000","last_clean":"2024-09-11T23:24:04.936920+0000","last_became_active":"2024-09-11T23:24:03.940223+0000","last_became_peered":"2024-09-11T23:24:03.940223+0000","last_unstale":"2024-09-11T23:24:04.936920+0000","last_undegraded":"2024-09-11T23:24:04.936920+0000","last_fullsized":"2024-09-11T23:24:04.936920+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:02:04.686874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.954487+0000","last_change":"2024-09-11T23:24:04.948156+0000","last_active":"2024-09-11T23:24:04.954487+0000","last_peered":"2024-09-11T23:24:04.954487+0000","last_clean":"2024-09-11T23:24:04.954487+0000","last_became_active":"2024-09-11T23:24:04.947832+0000","last_became_peered":"2024-09-11T23:24:04.947832+0000","last_unstale":"2024-09-11T23:24:04.954487+0000","last_undegraded":"2024-09-11T23:24:04.954487+0000","last_fullsized":"2024-09-11T23:24:04.954487+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:27.250619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.946585+0000","last_change":"2024-09-11T23:24:03.942095+0000","last_active":"2024-09-11T23:24:04.946585+0000","last_peered":"2024-09-11T23:24:04.946585+0000","last_clean":"2024-09-11T23:24:04.946585+0000","last_became_active":"2024-09-11T23:24:03.941801+0000","last_became_peered":"2024-09-11T23:24:03.941801+0000","last_unstale":"2024-09-11T23:24:04.946585+0000","last_undegraded":"2024-09-11T23:24:04.946585+0000","last_fullsized":"2024-09-11T23:24:04.946585+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:31.985637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.956393+0000","last_change":"2024-09-11T23:24:04.952391+0000","last_active":"2024-09-11T23:24:04.956393+0000","last_peered":"2024-09-11T23:24:04.956393+0000","last_clean":"2024-09-11T23:24:04.956393+0000","last_became_active":"2024-09-11T23:24:04.951541+0000","last_became_peered":"2024-09-11T23:24:04.951541+0000","last_unstale":"2024-09-11T23:24:04.956393+0000","last_undegraded":"2024-09-11T23:24:04.956393+0000","last_fullsized":"2024-09-11T23:24:04.956393+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:10.266380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.933850+0000","last_change":"2024-09-11T23:24:03.933892+0000","last_active":"2024-09-11T23:24:04.933850+0000","last_peered":"2024-09-11T23:24:04.933850+0000","last_clean":"2024-09-11T23:24:04.933850+0000","last_became_active":"2024-09-11T23:24:03.933629+0000","last_became_peered":"2024-09-11T23:24:03.933629+0000","last_unstale":"2024-09-11T23:24:04.933850+0000","last_undegraded":"2024-09-11T23:24:04.933850+0000","last_fullsized":"2024-09-11T23:24:04.933850+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:34.343887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.960125+0000","last_change":"2024-09-11T23:24:04.954601+0000","last_active":"2024-09-11T23:24:04.960125+0000","last_peered":"2024-09-11T23:24:04.960125+0000","last_clean":"2024-09-11T23:24:04.960125+0000","last_became_active":"2024-09-11T23:24:04.954350+0000","last_became_peered":"2024-09-11T23:24:04.954350+0000","last_unstale":"2024-09-11T23:24:04.960125+0000","last_undegraded":"2024-09-11T23:24:04.960125+0000","last_fullsized":"2024-09-11T23:24:04.960125+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:18.392796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.941774+0000","last_change":"2024-09-11T23:24:03.936099+0000","last_active":"2024-09-11T23:24:04.941774+0000","last_peered":"2024-09-11T23:24:04.941774+0000","last_clean":"2024-09-11T23:24:04.941774+0000","last_became_active":"2024-09-11T23:24:03.935846+0000","last_became_peered":"2024-09-11T23:24:03.935846+0000","last_unstale":"2024-09-11T23:24:04.941774+0000","last_undegraded":"2024-09-11T23:24:04.941774+0000","last_fullsized":"2024-09-11T23:24:04.941774+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:06.238695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.967268+0000","last_change":"2024-09-11T23:24:04.959788+0000","last_active":"2024-09-11T23:24:04.967268+0000","last_peered":"2024-09-11T23:24:04.967268+0000","last_clean":"2024-09-11T23:24:04.967268+0000","last_became_active":"2024-09-11T23:24:04.959500+0000","last_became_peered":"2024-09-11T23:24:04.959500+0000","last_unstale":"2024-09-11T23:24:04.967268+0000","last_undegraded":"2024-09-11T23:24:04.967268+0000","last_fullsized":"2024-09-11T23:24:04.967268+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:03.910795+0000","last_clean_scrub_stamp":"2024-09-11T23:24:03.910795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:43.464408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"115'2","reported_seq":14,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.968752+0000","last_change":"2024-09-11T23:24:03.938151+0000","last_active":"2024-09-11T23:24:04.968752+0000","last_peered":"2024-09-11T23:24:04.968752+0000","last_clean":"2024-09-11T23:24:04.968752+0000","last_became_active":"2024-09-11T23:24:03.937844+0000","last_became_peered":"2024-09-11T23:24:03.937844+0000","last_unstale":"2024-09-11T23:24:04.968752+0000","last_undegraded":"2024-09-11T23:24:04.968752+0000","last_fullsized":"2024-09-11T23:24:04.968752+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:02.904480+0000","last_clean_scrub_stamp":"2024-09-11T23:24:02.904480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:27.426798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":384,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-11T23:24:04.941998+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:24:04.941998+0000","last_peered":"2024-09-11T23:24:04.941998+0000","last_clean":"2024-09-11T23:24:04.941998+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:24:04.941998+0000","last_undegraded":"2024-09-11T23:24:04.941998+0000","last_fullsized":"2024-09-11T23:24:04.941998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476816,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33184,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338656,"statfs":{"total":96636764160,"available":96602783744,"internally_reserved":0,"allocated":2043904,"data_stored":1217642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476815,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32596,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339244,"statfs":{"total":96636764160,"available":96603385856,"internally_reserved":0,"allocated":1437696,"data_stored":626636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476814,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1433600,"data_stored":625136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476814,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1429504,"data_stored":625094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542223,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1413120,"data_stored":618249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542223,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1433600,"data_stored":625640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509519,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":1425408,"data_stored":625024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509519,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33168,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338672,"statfs":{"total":96636764160,"available":96602800128,"internally_reserved":0,"allocated":2019328,"data_stored":1215392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:24:09.530 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:24:09.530 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:24:09.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.727+0000 7f9d06e00640 1 Processor -- start 2024-09-11T23:24:09.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.727+0000 7f9d06e00640 1 -- start start 2024-09-11T23:24:09.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.728+0000 7f9d06e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d00147d70 0x7f9d00071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:09.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.728+0000 7f9d06e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9d00148150 0x7f9d0006d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:09.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.728+0000 7f9d06e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d00072090 0x7f9d0006d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:09.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.728+0000 7f9d06e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9d000710e0 con 0x7f9d00147d70 2024-09-11T23:24:09.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.728+0000 7f9d06e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9d000b5700 con 0x7f9d00148150 2024-09-11T23:24:09.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.728+0000 7f9d06e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9d00071350 con 0x7f9d00072090 2024-09-11T23:24:09.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.728+0000 7f9cffe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d00147d70 0x7f9d00071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:09.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.728+0000 7f9cffe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d00147d70 0x7f9d00071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50152/0 (socket says 172.21.15.144:50152) 2024-09-11T23:24:09.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.728+0000 7f9cffe00640 1 -- 172.21.15.144:0/4122276008 learned_addr learned my addr 172.21.15.144:0/4122276008 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:09.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.728+0000 7f9cf7400640 1 --2- 172.21.15.144:0/4122276008 >> v2:172.21.15.165:3300/0 conn(0x7f9d00148150 0x7f9d0006d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:09.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.728+0000 7f9d04e00640 1 --2- 172.21.15.144:0/4122276008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d00072090 0x7f9d0006d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:09.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.729+0000 7f9cffe00640 1 -- 172.21.15.144:0/4122276008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d00072090 msgr2=0x7f9d0006d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:09.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.729+0000 7f9cffe00640 1 --2- 172.21.15.144:0/4122276008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d00072090 0x7f9d0006d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.729+0000 7f9cffe00640 1 -- 172.21.15.144:0/4122276008 >> v2:172.21.15.165:3300/0 conn(0x7f9d00148150 msgr2=0x7f9d0006d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:09.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.729+0000 7f9cffe00640 1 --2- 172.21.15.144:0/4122276008 >> v2:172.21.15.165:3300/0 conn(0x7f9d00148150 0x7f9d0006d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.729+0000 7f9cffe00640 1 -- 172.21.15.144:0/4122276008 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d00071630 con 0x7f9d00147d70 2024-09-11T23:24:09.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.730+0000 7f9cffe00640 1 --2- 172.21.15.144:0/4122276008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d00147d70 0x7f9d00071b50 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f9d000b45b0 tx=0x7f9cf002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b586a95de19ad690 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:09.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.730+0000 7f9cff400640 1 -- 172.21.15.144:0/4122276008 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0037070 con 0x7f9d00147d70 2024-09-11T23:24:09.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.730+0000 7f9cff400640 1 -- 172.21.15.144:0/4122276008 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cf0032440 con 0x7f9d00147d70 2024-09-11T23:24:09.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.730+0000 7f9cff400640 1 -- 172.21.15.144:0/4122276008 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0032810 con 0x7f9d00147d70 2024-09-11T23:24:09.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.730+0000 7f9d06e00640 1 -- 172.21.15.144:0/4122276008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d00147d70 msgr2=0x7f9d00071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:09.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.730+0000 7f9d06e00640 1 --2- 172.21.15.144:0/4122276008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d00147d70 0x7f9d00071b50 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f9d000b45b0 tx=0x7f9cf002a140 comp rx=0 tx=0).stop 2024-09-11T23:24:09.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.731+0000 7f9d06e00640 1 -- 172.21.15.144:0/4122276008 shutdown_connections 2024-09-11T23:24:09.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.731+0000 7f9d06e00640 1 --2- 172.21.15.144:0/4122276008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d00072090 0x7f9d0006d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.731+0000 7f9d06e00640 1 --2- 172.21.15.144:0/4122276008 >> v2:172.21.15.165:3300/0 conn(0x7f9d00148150 0x7f9d0006d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.731+0000 7f9d06e00640 1 --2- 172.21.15.144:0/4122276008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d00147d70 0x7f9d00071b50 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.731+0000 7f9d06e00640 1 -- 172.21.15.144:0/4122276008 >> 172.21.15.144:0/4122276008 conn(0x7f9d0006bba0 msgr2=0x7f9d0006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:09.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.731+0000 7f9d06e00640 1 -- 172.21.15.144:0/4122276008 shutdown_connections 2024-09-11T23:24:09.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.731+0000 7f9d06e00640 1 -- 172.21.15.144:0/4122276008 wait complete. 2024-09-11T23:24:09.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.732+0000 7f9d06e00640 1 Processor -- start 2024-09-11T23:24:09.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.732+0000 7f9d06e00640 1 -- start start 2024-09-11T23:24:09.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.733+0000 7f9d06e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d00072090 0x7f9d0015dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:09.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.733+0000 7f9d06e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d00147d70 0x7f9d0015fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:09.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.733+0000 7f9d06e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d00148150 0x7f9d00139e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:09.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.733+0000 7f9d06e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9d000aea60 con 0x7f9d00148150 2024-09-11T23:24:09.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.733+0000 7f9d06e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9d000ae8e0 con 0x7f9d00147d70 2024-09-11T23:24:09.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.733+0000 7f9d06e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9d000aebe0 con 0x7f9d00072090 2024-09-11T23:24:09.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.733+0000 7f9d04e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d00148150 0x7f9d00139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:09.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.733+0000 7f9d04e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d00148150 0x7f9d00139e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50158/0 (socket says 172.21.15.144:50158) 2024-09-11T23:24:09.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.733+0000 7f9d04e00640 1 -- 172.21.15.144:0/232678543 learned_addr learned my addr 172.21.15.144:0/232678543 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:09.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.734+0000 7f9cf7400640 1 --2- 172.21.15.144:0/232678543 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d00147d70 0x7f9d0015fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:09.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.734+0000 7f9cffe00640 1 --2- 172.21.15.144:0/232678543 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d00072090 0x7f9d0015dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:09.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.734+0000 7f9d04e00640 1 -- 172.21.15.144:0/232678543 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d00072090 msgr2=0x7f9d0015dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:09.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.734+0000 7f9d04e00640 1 --2- 172.21.15.144:0/232678543 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d00072090 0x7f9d0015dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.734+0000 7f9d04e00640 1 -- 172.21.15.144:0/232678543 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d00147d70 msgr2=0x7f9d0015fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:09.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.734+0000 7f9d04e00640 1 --2- 172.21.15.144:0/232678543 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d00147d70 0x7f9d0015fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.734+0000 7f9d04e00640 1 -- 172.21.15.144:0/232678543 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0015e530 con 0x7f9d00148150 2024-09-11T23:24:09.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.734+0000 7f9d04e00640 1 --2- 172.21.15.144:0/232678543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d00148150 0x7f9d00139e20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8007d40 tx=0x7f9cf800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:09.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.734+0000 7f9cfcc00640 1 -- 172.21.15.144:0/232678543 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8014420 con 0x7f9d00148150 2024-09-11T23:24:09.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.735+0000 7f9cfcc00640 1 -- 172.21.15.144:0/232678543 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cf8019070 con 0x7f9d00148150 2024-09-11T23:24:09.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.735+0000 7f9cfcc00640 1 -- 172.21.15.144:0/232678543 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8014820 con 0x7f9d00148150 2024-09-11T23:24:09.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.735+0000 7f9d06e00640 1 -- 172.21.15.144:0/232678543 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d001607d0 con 0x7f9d00148150 2024-09-11T23:24:09.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.735+0000 7f9d06e00640 1 -- 172.21.15.144:0/232678543 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d00160d90 con 0x7f9d00148150 2024-09-11T23:24:09.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.736+0000 7f9d06e00640 1 -- 172.21.15.144:0/232678543 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d000af010 con 0x7f9d00148150 2024-09-11T23:24:09.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.737+0000 7f9cfcc00640 1 -- 172.21.15.144:0/232678543 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f9cf80149c0 con 0x7f9d00148150 2024-09-11T23:24:09.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.737+0000 7f9cfcc00640 1 --2- 172.21.15.144:0/232678543 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9cdc06c220 0x7f9cdc06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:09.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.738+0000 7f9cfcc00640 1 -- 172.21.15.144:0/232678543 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f9cf808bbc0 con 0x7f9d00148150 2024-09-11T23:24:09.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.738+0000 7f9cffe00640 1 --2- 172.21.15.144:0/232678543 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9cdc06c220 0x7f9cdc06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.739+0000 7f9cffe00640 1 --2- 172.21.15.144:0/232678543 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9cdc06c220 0x7f9cdc06e6e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0034000 tx=0x7f9cf002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:09.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.742+0000 7f9cfcc00640 1 -- 172.21.15.144:0/232678543 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9cf8059940 con 0x7f9d00148150 2024-09-11T23:24:09.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.979+0000 7f9d06e00640 1 -- 172.21.15.144:0/232678543 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f9d0006dbe0 con 0x7f9d00148150 2024-09-11T23:24:09.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.981+0000 7f9cfcc00640 1 -- 172.21.15.144:0/232678543 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f9cf805dc40 con 0x7f9d00148150 2024-09-11T23:24:09.981 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-11T23:24:09.981 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A== 2024-09-11T23:24:09.981 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-11T23:24:09.981 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-11T23:24:09.981 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:24:09.982 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-11T23:24:09.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.984+0000 7f9d06e00640 1 -- 172.21.15.144:0/232678543 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9cdc06c220 msgr2=0x7f9cdc06e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:09.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.984+0000 7f9d06e00640 1 --2- 172.21.15.144:0/232678543 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9cdc06c220 0x7f9cdc06e6e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0034000 tx=0x7f9cf002e000 comp rx=0 tx=0).stop 2024-09-11T23:24:09.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.984+0000 7f9d06e00640 1 -- 172.21.15.144:0/232678543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d00148150 msgr2=0x7f9d00139e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:09.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.984+0000 7f9d06e00640 1 --2- 172.21.15.144:0/232678543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d00148150 0x7f9d00139e20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8007d40 tx=0x7f9cf800e4b0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.984+0000 7f9d06e00640 1 -- 172.21.15.144:0/232678543 shutdown_connections 2024-09-11T23:24:09.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.984+0000 7f9d06e00640 1 --2- 172.21.15.144:0/232678543 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9cdc06c220 0x7f9cdc06e6e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.984+0000 7f9d06e00640 1 --2- 172.21.15.144:0/232678543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d00148150 0x7f9d00139e20 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.984+0000 7f9d06e00640 1 --2- 172.21.15.144:0/232678543 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d00147d70 0x7f9d0015fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.984+0000 7f9d06e00640 1 --2- 172.21.15.144:0/232678543 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9d00072090 0x7f9d0015dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:09.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.984+0000 7f9d06e00640 1 -- 172.21.15.144:0/232678543 >> 172.21.15.144:0/232678543 conn(0x7f9d0006bba0 msgr2=0x7f9d000b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:09.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.984+0000 7f9d06e00640 1 -- 172.21.15.144:0/232678543 shutdown_connections 2024-09-11T23:24:09.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:09.984+0000 7f9d06e00640 1 -- 172.21.15.144:0/232678543 wait complete. 2024-09-11T23:24:10.000 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:24:10.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.153+0000 7fbf62e00640 1 Processor -- start 2024-09-11T23:24:10.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.154+0000 7fbf62e00640 1 -- start start 2024-09-11T23:24:10.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.155+0000 7fbf62e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf5c15b530 0x7fbf5c15b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.155+0000 7fbf62e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf5c0b31d0 con 0x7fbf5c0b4510 2024-09-11T23:24:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.155+0000 7fbf62e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf5c15c0a0 con 0x7fbf5c15b150 2024-09-11T23:24:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.155+0000 7fbf62e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbf5c15c380 con 0x7fbf5c15b530 2024-09-11T23:24:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.155+0000 7fbf61000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbf5c0b4510 0x7fbf5c0b3960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57540/0 (socket says 172.21.15.144:57540) 2024-09-11T23:24:10.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.155+0000 7fbf61000640 1 -- 172.21.15.144:0/1866514540 learned_addr learned my addr 172.21.15.144:0/1866514540 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.155+0000 7fbf62400640 1 --2- 172.21.15.144:0/1866514540 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf5c15b530 0x7fbf5c15b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.155+0000 7fbf5be00640 1 -- 172.21.15.144:0/1866514540 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3704204793 0 0) 0x7fbf5c0b31d0 con 0x7fbf5c0b4510 2024-09-11T23:24:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.156+0000 7fbf5be00640 1 -- 172.21.15.144:0/1866514540 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf44003520 con 0x7fbf5c0b4510 2024-09-11T23:24:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.156+0000 7fbf5be00640 1 -- 172.21.15.144:0/1866514540 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2802161498 0 0) 0x7fbf44003520 con 0x7fbf5c0b4510 2024-09-11T23:24:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.156+0000 7fbf5be00640 1 -- 172.21.15.144:0/1866514540 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf5c15b530 msgr2=0x7fbf5c15b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.156+0000 7fbf5be00640 1 --2- 172.21.15.144:0/1866514540 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf5c15b530 0x7fbf5c15b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.156+0000 7fbf5be00640 1 -- 172.21.15.144:0/1866514540 >> v1:172.21.15.165:6789/0 conn(0x7fbf5c15b150 legacy=0x7fbf5c0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.156+0000 7fbf5be00640 1 -- 172.21.15.144:0/1866514540 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5c0b3440 con 0x7fbf5c0b4510 2024-09-11T23:24:10.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.156+0000 7fbf5be00640 1 -- 172.21.15.144:0/1866514540 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fbf48001670 con 0x7fbf5c0b4510 2024-09-11T23:24:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.156+0000 7fbf5be00640 1 -- 172.21.15.144:0/1866514540 >> v1:172.21.15.144:6789/0 conn(0x7fbf5c0b4510 legacy=0x7fbf5c0b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.156+0000 7fbf5be00640 1 --2- 172.21.15.144:0/1866514540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf440039e0 0x7fbf44003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.156+0000 7fbf5be00640 1 --2- 172.21.15.144:0/1866514540 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf5c15b530 0x7fbf44004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.156+0000 7fbf5be00640 1 --2- 172.21.15.144:0/1866514540 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf44004d40 0x7fbf440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.156+0000 7fbf5be00640 1 -- 172.21.15.144:0/1866514540 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c15c380 con 0x7fbf440039e0 2024-09-11T23:24:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.156+0000 7fbf5be00640 1 -- 172.21.15.144:0/1866514540 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4400ba70 con 0x7fbf44004d40 2024-09-11T23:24:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.156+0000 7fbf5be00640 1 -- 172.21.15.144:0/1866514540 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbf4400de30 con 0x7fbf5c15b530 2024-09-11T23:24:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.156+0000 7fbf61a00640 1 --2- 172.21.15.144:0/1866514540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf440039e0 0x7fbf44003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.156+0000 7fbf61000640 1 --2- 172.21.15.144:0/1866514540 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf5c15b530 0x7fbf44004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.156+0000 7fbf62400640 1 --2- 172.21.15.144:0/1866514540 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf44004d40 0x7fbf440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.157+0000 7fbf61a00640 1 -- 172.21.15.144:0/1866514540 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf5c15b530 msgr2=0x7fbf44004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.157+0000 7fbf61a00640 1 --2- 172.21.15.144:0/1866514540 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf5c15b530 0x7fbf44004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.157+0000 7fbf61a00640 1 -- 172.21.15.144:0/1866514540 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf44004d40 msgr2=0x7fbf440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.157+0000 7fbf61a00640 1 --2- 172.21.15.144:0/1866514540 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf44004d40 0x7fbf440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.157+0000 7fbf61a00640 1 -- 172.21.15.144:0/1866514540 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf44003520 con 0x7fbf440039e0 2024-09-11T23:24:10.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.158+0000 7fbf61a00640 1 --2- 172.21.15.144:0/1866514540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf440039e0 0x7fbf44003dc0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fbf50001860 tx=0x7fbf44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b10ec0abbafa2a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:10.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.158+0000 7fbf5be00640 1 -- 172.21.15.144:0/1866514540 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf50037070 con 0x7fbf440039e0 2024-09-11T23:24:10.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.158+0000 7fbf5be00640 1 -- 172.21.15.144:0/1866514540 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf5002ac30 con 0x7fbf440039e0 2024-09-11T23:24:10.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.158+0000 7fbf5be00640 1 -- 172.21.15.144:0/1866514540 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf50001430 con 0x7fbf440039e0 2024-09-11T23:24:10.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.158+0000 7fbf62e00640 1 -- 172.21.15.144:0/1866514540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf440039e0 msgr2=0x7fbf44003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:10.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.158+0000 7fbf62e00640 1 --2- 172.21.15.144:0/1866514540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf440039e0 0x7fbf44003dc0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fbf50001860 tx=0x7fbf44005830 comp rx=0 tx=0).stop 2024-09-11T23:24:10.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.158+0000 7fbf62400640 1 -- 172.21.15.144:0/1866514540 reap_dead start 2024-09-11T23:24:10.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.159+0000 7fbf62e00640 1 -- 172.21.15.144:0/1866514540 shutdown_connections 2024-09-11T23:24:10.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.159+0000 7fbf62e00640 1 -- 172.21.15.144:0/1866514540 >> 172.21.15.144:0/1866514540 conn(0x7fbf5c06e910 msgr2=0x7fbf5c06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:10.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.159+0000 7fbf62e00640 1 -- 172.21.15.144:0/1866514540 shutdown_connections 2024-09-11T23:24:10.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.159+0000 7fbf62e00640 1 -- 172.21.15.144:0/1866514540 wait complete. 2024-09-11T23:24:10.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.160+0000 7fbf62e00640 1 Processor -- start 2024-09-11T23:24:10.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.160+0000 7fbf62e00640 1 -- start start 2024-09-11T23:24:10.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.161+0000 7fbf62e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf440039e0 0x7fbf5c13bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.161+0000 7fbf62e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf5c14bcc0 0x7fbf5c14c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.161+0000 7fbf62e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf5c14de20 0x7fbf5c14e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.161+0000 7fbf62e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c0cd200 con 0x7fbf5c14bcc0 2024-09-11T23:24:10.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.161+0000 7fbf62e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c0b4070 con 0x7fbf5c14de20 2024-09-11T23:24:10.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.161+0000 7fbf62e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbf5c14eb90 con 0x7fbf440039e0 2024-09-11T23:24:10.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.161+0000 7fbf61000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf5c14bcc0 0x7fbf5c14c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.162+0000 7fbf61000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf5c14bcc0 0x7fbf5c14c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50186/0 (socket says 172.21.15.144:50186) 2024-09-11T23:24:10.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.162+0000 7fbf61000640 1 -- 172.21.15.144:0/1717857477 learned_addr learned my addr 172.21.15.144:0/1717857477 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:10.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.162+0000 7fbf62400640 1 --2- 172.21.15.144:0/1717857477 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf5c14de20 0x7fbf5c14e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.162+0000 7fbf61a00640 1 --2- 172.21.15.144:0/1717857477 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf440039e0 0x7fbf5c13bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.162+0000 7fbf61000640 1 -- 172.21.15.144:0/1717857477 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf440039e0 msgr2=0x7fbf5c13bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:10.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.162+0000 7fbf61000640 1 --2- 172.21.15.144:0/1717857477 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf440039e0 0x7fbf5c13bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.162+0000 7fbf61000640 1 -- 172.21.15.144:0/1717857477 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf5c14de20 msgr2=0x7fbf5c14e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:10.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.162+0000 7fbf61000640 1 --2- 172.21.15.144:0/1717857477 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf5c14de20 0x7fbf5c14e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.162+0000 7fbf61000640 1 -- 172.21.15.144:0/1717857477 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5c14ee70 con 0x7fbf5c14bcc0 2024-09-11T23:24:10.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.162+0000 7fbf62400640 1 --2- 172.21.15.144:0/1717857477 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf5c14de20 0x7fbf5c14e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:10.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.162+0000 7fbf61000640 1 --2- 172.21.15.144:0/1717857477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf5c14bcc0 0x7fbf5c14c140 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fbf48004fa0 tx=0x7fbf48007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:10.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.162+0000 7fbf59600640 1 -- 172.21.15.144:0/1717857477 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4800f780 con 0x7fbf5c14bcc0 2024-09-11T23:24:10.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.162+0000 7fbf59600640 1 -- 172.21.15.144:0/1717857477 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf48018070 con 0x7fbf5c14bcc0 2024-09-11T23:24:10.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.162+0000 7fbf59600640 1 -- 172.21.15.144:0/1717857477 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4800fb40 con 0x7fbf5c14bcc0 2024-09-11T23:24:10.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.162+0000 7fbf62e00640 1 -- 172.21.15.144:0/1717857477 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf5c1529d0 con 0x7fbf5c14bcc0 2024-09-11T23:24:10.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.163+0000 7fbf62e00640 1 -- 172.21.15.144:0/1717857477 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf5c13c480 con 0x7fbf5c14bcc0 2024-09-11T23:24:10.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.164+0000 7fbf62e00640 1 -- 172.21.15.144:0/1717857477 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf5c14f040 con 0x7fbf5c14bcc0 2024-09-11T23:24:10.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.164+0000 7fbf59600640 1 -- 172.21.15.144:0/1717857477 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7fbf4800fce0 con 0x7fbf5c14bcc0 2024-09-11T23:24:10.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.165+0000 7fbf59600640 1 --2- 172.21.15.144:0/1717857477 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbf3c06c250 0x7fbf3c06e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.165+0000 7fbf59600640 1 -- 172.21.15.144:0/1717857477 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7fbf4808b440 con 0x7fbf5c14bcc0 2024-09-11T23:24:10.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.166+0000 7fbf61a00640 1 --2- 172.21.15.144:0/1717857477 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbf3c06c250 0x7fbf3c06e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.167+0000 7fbf61a00640 1 --2- 172.21.15.144:0/1717857477 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbf3c06c250 0x7fbf3c06e710 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbf50034000 tx=0x7fbf50009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:10.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.169+0000 7fbf59600640 1 -- 172.21.15.144:0/1717857477 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbf5c14f040 con 0x7fbf5c14bcc0 2024-09-11T23:24:10.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.375+0000 7fbf62e00640 1 -- 172.21.15.144:0/1717857477 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf5c1527c0 con 0x7fbf5c14bcc0 2024-09-11T23:24:10.376 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.376+0000 7fbf59600640 1 -- 172.21.15.144:0/1717857477 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5237 (secure 0 0 0) 0x7fbf48059920 con 0x7fbf5c14bcc0 2024-09-11T23:24:10.376 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:10.376 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":81,"btime":"2024-09-11T23:24:07:964174+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6997,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1218671521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1218671521},{"type":"v1","addr":"172.21.15.165:6835","nonce":1218671521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7000,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/4243031268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":4243031268},{"type":"v1","addr":"172.21.15.165:6834","nonce":4243031268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/1613796839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1613796839},{"type":"v1","addr":"172.21.15.144:6801","nonce":1613796839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:24:04.329682+0000","modified":"2024-09-11T23:24:07.364254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7389":{"gid":7389,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1311760947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1311760947},{"type":"v1","addr":"172.21.15.144:6835","nonce":1311760947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7389,"qdb_cluster":[7389]},"id":9}]} 2024-09-11T23:24:10.376 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 81 2024-09-11T23:24:10.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.378+0000 7fbf62e00640 1 -- 172.21.15.144:0/1717857477 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbf3c06c250 msgr2=0x7fbf3c06e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:10.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.378+0000 7fbf62e00640 1 --2- 172.21.15.144:0/1717857477 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbf3c06c250 0x7fbf3c06e710 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbf50034000 tx=0x7fbf50009030 comp rx=0 tx=0).stop 2024-09-11T23:24:10.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.378+0000 7fbf62e00640 1 -- 172.21.15.144:0/1717857477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf5c14bcc0 msgr2=0x7fbf5c14c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:10.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.378+0000 7fbf62e00640 1 --2- 172.21.15.144:0/1717857477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf5c14bcc0 0x7fbf5c14c140 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fbf48004fa0 tx=0x7fbf48007430 comp rx=0 tx=0).stop 2024-09-11T23:24:10.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.378+0000 7fbf62e00640 1 -- 172.21.15.144:0/1717857477 shutdown_connections 2024-09-11T23:24:10.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.378+0000 7fbf62e00640 1 --2- 172.21.15.144:0/1717857477 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbf3c06c250 0x7fbf3c06e710 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.378+0000 7fbf62e00640 1 --2- 172.21.15.144:0/1717857477 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf5c14de20 0x7fbf5c14e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.378+0000 7fbf62e00640 1 --2- 172.21.15.144:0/1717857477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbf5c14bcc0 0x7fbf5c14c140 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.378+0000 7fbf62e00640 1 --2- 172.21.15.144:0/1717857477 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbf440039e0 0x7fbf5c13bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.378+0000 7fbf62e00640 1 -- 172.21.15.144:0/1717857477 >> 172.21.15.144:0/1717857477 conn(0x7fbf5c06e910 msgr2=0x7fbf5c155470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:10.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.378+0000 7fbf62e00640 1 -- 172.21.15.144:0/1717857477 shutdown_connections 2024-09-11T23:24:10.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.378+0000 7fbf62e00640 1 -- 172.21.15.144:0/1717857477 wait complete. 2024-09-11T23:24:10.797 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 81, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:24:04.329682+0000', 'modified': '2024-09-11T23:24:07.364254+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7389}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7389': {'gid': 7389, 'name': 'c', 'rank': 0, 'incarnation': 77, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6835/1311760947', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 1311760947}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 1311760947}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7389, 'qdb_cluster': [7389]} 2024-09-11T23:24:10.797 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:24:10.797 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-11T23:24:10.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.954+0000 7f14d2a00640 1 Processor -- start 2024-09-11T23:24:10.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.955+0000 7f14d2a00640 1 -- start start 2024-09-11T23:24:10.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.956+0000 7f14d2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f14cc0b4930 0x7f14cc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.956+0000 7f14d2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14cc15f620 0x7f14cc15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.956+0000 7f14d2a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14cc162870 con 0x7f14cc0d0a50 2024-09-11T23:24:10.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.956+0000 7f14d2a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f14cc0b52d0 con 0x7f14cc0b4930 2024-09-11T23:24:10.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.956+0000 7f14d2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f14cc162b50 con 0x7f14cc15f620 2024-09-11T23:24:10.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.956+0000 7f14cb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f14cc0b4930 0x7f14cc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.956+0000 7f14cb400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f14cc0b4930 0x7f14cc0b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50190/0 (socket says 172.21.15.144:50190) 2024-09-11T23:24:10.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.956+0000 7f14cb400640 1 -- 172.21.15.144:0/3941226567 learned_addr learned my addr 172.21.15.144:0/3941226567 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:10.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.956+0000 7f14d0a00640 1 --2- 172.21.15.144:0/3941226567 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14cc15f620 0x7f14cc15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.957+0000 7f14cb400640 1 -- 172.21.15.144:0/3941226567 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14cc15f620 msgr2=0x7f14cc15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:10.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.957+0000 7f14cb400640 1 --2- 172.21.15.144:0/3941226567 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14cc15f620 0x7f14cc15fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.957+0000 7f14cb400640 1 -- 172.21.15.144:0/3941226567 >> v1:172.21.15.165:6789/0 conn(0x7f14cc0d0a50 legacy=0x7f14cc1620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:10.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.957+0000 7f14cb400640 1 -- 172.21.15.144:0/3941226567 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14cc162e30 con 0x7f14cc0b4930 2024-09-11T23:24:10.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.958+0000 7f14cb400640 1 --2- 172.21.15.144:0/3941226567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14cc0b4930 0x7f14cc0b4d90 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f14b8009870 tx=0x7f14b802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205a29657d3f4aad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:10.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.958+0000 7f14caa00640 1 -- 172.21.15.144:0/3941226567 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b8037070 con 0x7f14cc0b4930 2024-09-11T23:24:10.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.958+0000 7f14caa00640 1 -- 172.21.15.144:0/3941226567 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b8032440 con 0x7f14cc0b4930 2024-09-11T23:24:10.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.958+0000 7f14caa00640 1 -- 172.21.15.144:0/3941226567 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b8032810 con 0x7f14cc0b4930 2024-09-11T23:24:10.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.958+0000 7f14d2a00640 1 -- 172.21.15.144:0/3941226567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14cc0b4930 msgr2=0x7f14cc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:10.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.958+0000 7f14d2a00640 1 --2- 172.21.15.144:0/3941226567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14cc0b4930 0x7f14cc0b4d90 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f14b8009870 tx=0x7f14b802a1c0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.958+0000 7f14d2a00640 1 -- 172.21.15.144:0/3941226567 shutdown_connections 2024-09-11T23:24:10.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.958+0000 7f14d2a00640 1 --2- 172.21.15.144:0/3941226567 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14cc15f620 0x7f14cc15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.958+0000 7f14d2a00640 1 --2- 172.21.15.144:0/3941226567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14cc0b4930 0x7f14cc0b4d90 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.958+0000 7f14d2a00640 1 -- 172.21.15.144:0/3941226567 >> 172.21.15.144:0/3941226567 conn(0x7f14cc062cc0 msgr2=0x7f14cc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:10.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.958+0000 7f14d2a00640 1 -- 172.21.15.144:0/3941226567 shutdown_connections 2024-09-11T23:24:10.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.959+0000 7f14d2a00640 1 -- 172.21.15.144:0/3941226567 wait complete. 2024-09-11T23:24:10.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.960+0000 7f14d2a00640 1 Processor -- start 2024-09-11T23:24:10.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.960+0000 7f14d2a00640 1 -- start start 2024-09-11T23:24:10.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.961+0000 7f14d2a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14cc0b4930 0x7f14cc071950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.961+0000 7f14d2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14cc15f620 0x7f14cc073550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.961+0000 7f14d2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14cc15b7a0 0x7f14cc0b1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.961+0000 7f14d2a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc15fff0 con 0x7f14cc15f620 2024-09-11T23:24:10.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.961+0000 7f14d2a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc0b3620 con 0x7f14cc0b4930 2024-09-11T23:24:10.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.961+0000 7f14d2a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f14cc1596a0 con 0x7f14cc15b7a0 2024-09-11T23:24:10.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.961+0000 7f14cb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14cc15f620 0x7f14cc073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.961+0000 7f14cb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14cc15f620 0x7f14cc073550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50202/0 (socket says 172.21.15.144:50202) 2024-09-11T23:24:10.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.961+0000 7f14cb400640 1 -- 172.21.15.144:0/2102898500 learned_addr learned my addr 172.21.15.144:0/2102898500 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:10.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.961+0000 7f14cbe00640 1 --2- 172.21.15.144:0/2102898500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14cc0b4930 0x7f14cc071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.962+0000 7f14d0a00640 1 --2- 172.21.15.144:0/2102898500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14cc15b7a0 0x7f14cc0b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.962+0000 7f14cb400640 1 -- 172.21.15.144:0/2102898500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14cc15b7a0 msgr2=0x7f14cc0b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:10.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.962+0000 7f14cb400640 1 --2- 172.21.15.144:0/2102898500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14cc15b7a0 0x7f14cc0b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.962+0000 7f14cb400640 1 -- 172.21.15.144:0/2102898500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14cc0b4930 msgr2=0x7f14cc071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:10.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.962+0000 7f14cb400640 1 --2- 172.21.15.144:0/2102898500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14cc0b4930 0x7f14cc071950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.962+0000 7f14cb400640 1 -- 172.21.15.144:0/2102898500 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14cc071f30 con 0x7f14cc15f620 2024-09-11T23:24:10.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.962+0000 7f14d0a00640 1 --2- 172.21.15.144:0/2102898500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14cc15b7a0 0x7f14cc0b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:10.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.962+0000 7f14cb400640 1 --2- 172.21.15.144:0/2102898500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14cc15f620 0x7f14cc073550 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f14b8000c00 tx=0x7f14b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:10.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.962+0000 7f14c3e00640 1 -- 172.21.15.144:0/2102898500 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b8037040 con 0x7f14cc15f620 2024-09-11T23:24:10.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.962+0000 7f14c3e00640 1 -- 172.21.15.144:0/2102898500 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b8042070 con 0x7f14cc15f620 2024-09-11T23:24:10.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.963+0000 7f14d2a00640 1 -- 172.21.15.144:0/2102898500 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14cc072210 con 0x7f14cc15f620 2024-09-11T23:24:10.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.963+0000 7f14c3e00640 1 -- 172.21.15.144:0/2102898500 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b8030880 con 0x7f14cc15f620 2024-09-11T23:24:10.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.963+0000 7f14d2a00640 1 -- 172.21.15.144:0/2102898500 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14cc0727d0 con 0x7f14cc15f620 2024-09-11T23:24:10.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.965+0000 7f14c3e00640 1 -- 172.21.15.144:0/2102898500 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f14b802ad10 con 0x7f14cc15f620 2024-09-11T23:24:10.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.965+0000 7f14c3e00640 1 --2- 172.21.15.144:0/2102898500 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f14ac06c220 0x7f14ac06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.966+0000 7f14c3e00640 1 -- 172.21.15.144:0/2102898500 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f14b80ab950 con 0x7f14cc15f620 2024-09-11T23:24:10.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.966+0000 7f14cbe00640 1 --2- 172.21.15.144:0/2102898500 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f14ac06c220 0x7f14ac06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.966+0000 7f14d58a9740 1 Processor -- start 2024-09-11T23:24:10.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.966+0000 7f14d58a9740 1 -- start start 2024-09-11T23:24:10.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.967+0000 7f14cbe00640 1 --2- 172.21.15.144:0/2102898500 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f14ac06c220 0x7f14ac06e6e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f14bc001780 tx=0x7f14bc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:10.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.967+0000 7f14d58a9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce29cf0 0x55735ce6f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.967+0000 7f14d58a9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce274b0 0x55735ce2a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.967+0000 7f14d58a9740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce2b480 0x55735ce24570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.967+0000 7f14d58a9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55735cd883b0 con 0x55735ce274b0 2024-09-11T23:24:10.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.967+0000 7f14d58a9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55735cd8d410 con 0x55735ce29cf0 2024-09-11T23:24:10.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.967+0000 7f14d58a9740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55735cd35620 con 0x55735ce2b480 2024-09-11T23:24:10.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.968+0000 7f14cb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce274b0 0x55735ce2a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.968+0000 7f14cb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce274b0 0x55735ce2a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50218/0 (socket says 172.21.15.144:50218) 2024-09-11T23:24:10.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.968+0000 7f14cb400640 1 -- 172.21.15.144:0/1915872141 learned_addr learned my addr 172.21.15.144:0/1915872141 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:10.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.968+0000 7f14cbe00640 1 --2- 172.21.15.144:0/1915872141 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce29cf0 0x55735ce6f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.968+0000 7f14d0a00640 1 --2- 172.21.15.144:0/1915872141 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce2b480 0x55735ce24570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.968+0000 7f14cb400640 1 -- 172.21.15.144:0/1915872141 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce2b480 msgr2=0x55735ce24570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:10.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.968+0000 7f14cb400640 1 --2- 172.21.15.144:0/1915872141 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce2b480 0x55735ce24570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.968+0000 7f14cb400640 1 -- 172.21.15.144:0/1915872141 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce29cf0 msgr2=0x55735ce6f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:10.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.968+0000 7f14cb400640 1 --2- 172.21.15.144:0/1915872141 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce29cf0 0x55735ce6f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.968+0000 7f14cb400640 1 -- 172.21.15.144:0/1915872141 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55735caa02d0 con 0x55735ce274b0 2024-09-11T23:24:10.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.968+0000 7f14cb400640 1 --2- 172.21.15.144:0/1915872141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce274b0 0x55735ce2a0d0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f14b80793f0 tx=0x7f14b80792f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df495e72968d9bc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:10.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.968+0000 7f14b7e00640 1 -- 172.21.15.144:0/1915872141 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b80796f0 con 0x55735ce274b0 2024-09-11T23:24:10.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.969+0000 7f14b7e00640 1 -- 172.21.15.144:0/1915872141 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b807daa0 con 0x55735ce274b0 2024-09-11T23:24:10.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.969+0000 7f14b7e00640 1 -- 172.21.15.144:0/1915872141 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b80822d0 con 0x55735ce274b0 2024-09-11T23:24:10.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.969+0000 7f14d58a9740 1 -- 172.21.15.144:0/1915872141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce274b0 msgr2=0x55735ce2a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:10.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.969+0000 7f14d58a9740 1 --2- 172.21.15.144:0/1915872141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce274b0 0x55735ce2a0d0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f14b80793f0 tx=0x7f14b80792f0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.969+0000 7f14d58a9740 1 -- 172.21.15.144:0/1915872141 shutdown_connections 2024-09-11T23:24:10.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.969+0000 7f14d58a9740 1 --2- 172.21.15.144:0/1915872141 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce2b480 0x55735ce24570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.969+0000 7f14d58a9740 1 --2- 172.21.15.144:0/1915872141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce274b0 0x55735ce2a0d0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.969+0000 7f14d58a9740 1 --2- 172.21.15.144:0/1915872141 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce29cf0 0x55735ce6f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.969+0000 7f14d58a9740 1 -- 172.21.15.144:0/1915872141 >> 172.21.15.144:0/1915872141 conn(0x55735ce26740 msgr2=0x55735ce6e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:10.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.969+0000 7f14d58a9740 1 -- 172.21.15.144:0/1915872141 shutdown_connections 2024-09-11T23:24:10.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.969+0000 7f14d58a9740 1 -- 172.21.15.144:0/1915872141 wait complete. 2024-09-11T23:24:10.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.970+0000 7f14d58a9740 1 -- start start 2024-09-11T23:24:10.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.970+0000 7f14d58a9740 1 Processor -- start 2024-09-11T23:24:10.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.971+0000 7f14d58a9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce29cf0 0x55735ce24450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.971+0000 7f14d58a9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce2b480 0x55735ce4a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.971+0000 7f14d58a9740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce48150 0x55735ce28030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.971+0000 7f14d58a9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55735cd48780 con 0x55735ce29cf0 2024-09-11T23:24:10.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.971+0000 7f14d58a9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55735cd893d0 con 0x55735ce2b480 2024-09-11T23:24:10.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.971+0000 7f14d58a9740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55735cd883b0 con 0x55735ce48150 2024-09-11T23:24:10.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.971+0000 7f14d58a9740 10 client.0 _ll_register_callbacks cb 0x55735cd865d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:24:10.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.971+0000 7f14cbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce29cf0 0x55735ce24450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.971+0000 7f14cbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce29cf0 0x55735ce24450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50226/0 (socket says 172.21.15.144:50226) 2024-09-11T23:24:10.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.971+0000 7f14cbe00640 1 -- 172.21.15.144:0/4023487753 learned_addr learned my addr 172.21.15.144:0/4023487753 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:10.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.972+0000 7f14d0a00640 1 --2- 172.21.15.144:0/4023487753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce48150 0x55735ce28030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.972+0000 7f14cb400640 1 --2- 172.21.15.144:0/4023487753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce2b480 0x55735ce4a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.972+0000 7f14cbe00640 1 -- 172.21.15.144:0/4023487753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce48150 msgr2=0x55735ce28030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:10.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.972+0000 7f14cbe00640 1 --2- 172.21.15.144:0/4023487753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce48150 0x55735ce28030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.972+0000 7f14cbe00640 1 -- 172.21.15.144:0/4023487753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce2b480 msgr2=0x55735ce4a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:10.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.972+0000 7f14cbe00640 1 --2- 172.21.15.144:0/4023487753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce2b480 0x55735ce4a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.972+0000 7f14cbe00640 1 -- 172.21.15.144:0/4023487753 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55735cb6a6b0 con 0x55735ce29cf0 2024-09-11T23:24:10.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.972+0000 7f14cb400640 1 --2- 172.21.15.144:0/4023487753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce2b480 0x55735ce4a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:10.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.972+0000 7f14cbe00640 1 --2- 172.21.15.144:0/4023487753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce29cf0 0x55735ce24450 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f14bc006ae0 tx=0x7f14bc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df998858332a28ee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:10.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.972+0000 7f14b4c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:24:10.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.972+0000 7f14b4c00640 1 -- 172.21.15.144:0/4023487753 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc021410 con 0x55735ce29cf0 2024-09-11T23:24:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.972+0000 7f14b4c00640 1 -- 172.21.15.144:0/4023487753 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f14bc0215b0 con 0x55735ce29cf0 2024-09-11T23:24:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.972+0000 7f14d58a9740 1 -- 172.21.15.144:0/4023487753 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14b807daa0 con 0x55735ce29cf0 2024-09-11T23:24:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.972+0000 7f14b4c00640 1 -- 172.21.15.144:0/4023487753 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f14bc02e050 con 0x55735ce29cf0 2024-09-11T23:24:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.972+0000 7f14d58a9740 10 client.7497 fetch_fsmap learned FSMap version 81 2024-09-11T23:24:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.972+0000 7f14d58a9740 1 -- 172.21.15.144:0/4023487753 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x55735ce23f30 con 0x55735ce29cf0 2024-09-11T23:24:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.973+0000 7f14b4c00640 1 -- 172.21.15.144:0/4023487753 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14b807daa0 con 0x55735ce29cf0 2024-09-11T23:24:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.973+0000 7f14b4c00640 1 -- 172.21.15.144:0/4023487753 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 81) ==== 3502+0+0 (secure 0 0 0) 0x7f14bc031020 con 0x55735ce29cf0 2024-09-11T23:24:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.973+0000 7f14d58a9740 10 client.7497 fetch_fsmap finished waiting for FSMap version 81 2024-09-11T23:24:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.973+0000 7f14d58a9740 10 client.7497 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:24:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.973+0000 7f14d58a9740 20 client.7497 populate_metadata read hostname 'smithi144' 2024-09-11T23:24:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.973+0000 7f14d58a9740 1 --2- 172.21.15.144:0/4023487753 >> [v2:172.21.15.144:6834/1311760947,v1:172.21.15.144:6835/1311760947] conn(0x55735ce52ce0 0x55735ce8c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.973+0000 7f14d58a9740 4 client.7497 mds_command: new command op to 7389 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:24:10.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.973+0000 7f14d58a9740 1 -- 172.21.15.144:0/4023487753 --> [v2:172.21.15.144:6834/1311760947,v1:172.21.15.144:6835/1311760947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55735cd9ab40 con 0x55735ce52ce0 2024-09-11T23:24:10.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.973+0000 7f14cb400640 1 --2- 172.21.15.144:0/4023487753 >> [v2:172.21.15.144:6834/1311760947,v1:172.21.15.144:6835/1311760947] conn(0x55735ce52ce0 0x55735ce8c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.974+0000 7f14cb400640 1 --2- 172.21.15.144:0/4023487753 >> [v2:172.21.15.144:6834/1311760947,v1:172.21.15.144:6835/1311760947] conn(0x55735ce52ce0 0x55735ce8c9e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c12922f762cbd705 server_cookie=32f8fb66a49ed6b6 in_seq=0 out_seq=0 2024-09-11T23:24:10.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.974+0000 7f14b4c00640 10 client.7497 ms_handle_connect on v2:172.21.15.144:6834/1311760947 2024-09-11T23:24:10.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.974+0000 7f14b4c00640 1 -- 172.21.15.144:0/4023487753 <== mds.0 v2:172.21.15.144:6834/1311760947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55735cd9ab40 con 0x55735ce52ce0 2024-09-11T23:24:10.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.974+0000 7f14b4c00640 10 client.7497 handle_command_reply: tid=0 2024-09-11T23:24:10.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.975+0000 7f14d58a9740 1 client.7497 shutdown 2024-09-11T23:24:10.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.975+0000 7f14d58a9740 1 -- 172.21.15.144:0/4023487753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce29cf0 msgr2=0x55735ce24450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:10.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.975+0000 7f14d58a9740 1 --2- 172.21.15.144:0/4023487753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce29cf0 0x55735ce24450 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f14bc006ae0 tx=0x7f14bc000ed0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.975+0000 7f14d58a9740 1 -- 172.21.15.144:0/4023487753 shutdown_connections 2024-09-11T23:24:10.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.975+0000 7f14d58a9740 1 --2- 172.21.15.144:0/4023487753 >> [v2:172.21.15.144:6834/1311760947,v1:172.21.15.144:6835/1311760947] conn(0x55735ce52ce0 0x55735ce8c9e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.975+0000 7f14d58a9740 1 --2- 172.21.15.144:0/4023487753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce48150 0x55735ce28030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.975+0000 7f14d58a9740 1 --2- 172.21.15.144:0/4023487753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce2b480 0x55735ce4a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.975+0000 7f14d58a9740 1 --2- 172.21.15.144:0/4023487753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce29cf0 0x55735ce24450 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.975+0000 7f14b4c00640 0 client.7497 ms_handle_reset on v2:172.21.15.144:6834/1311760947 2024-09-11T23:24:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.975+0000 7f14d58a9740 1 -- 172.21.15.144:0/4023487753 >> 172.21.15.144:0/4023487753 conn(0x55735ce274b0 msgr2=0x55735ce6e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.975+0000 7f14d58a9740 1 -- 172.21.15.144:0/4023487753 shutdown_connections 2024-09-11T23:24:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.975+0000 7f14d58a9740 1 -- 172.21.15.144:0/4023487753 wait complete. 2024-09-11T23:24:10.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.975+0000 7f14d58a9740 20 client.7497 trim_cache size 0 max 16384 2024-09-11T23:24:10.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.994+0000 7f14d58a9740 1 Processor -- start 2024-09-11T23:24:10.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.994+0000 7f14d58a9740 1 -- start start 2024-09-11T23:24:10.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.995+0000 7f14d58a9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce29cf0 0x55735ce72320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.995+0000 7f14d58a9740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce2b480 0x55735ce68550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.995+0000 7f14d58a9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce48150 0x55735ce28e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:10.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.995+0000 7f14d58a9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc1ffd20 con 0x55735ce29cf0 2024-09-11T23:24:10.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.995+0000 7f14d58a9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f14cc15a490 con 0x55735ce48150 2024-09-11T23:24:10.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.995+0000 7f14d58a9740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f14cc15aae0 con 0x55735ce2b480 2024-09-11T23:24:10.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.995+0000 7f14cbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce29cf0 0x55735ce72320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.995+0000 7f14cbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce29cf0 0x55735ce72320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50232/0 (socket says 172.21.15.144:50232) 2024-09-11T23:24:10.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.995+0000 7f14cbe00640 1 -- 172.21.15.144:0/3573623281 learned_addr learned my addr 172.21.15.144:0/3573623281 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:10.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.995+0000 7f14d0a00640 1 --2- 172.21.15.144:0/3573623281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce48150 0x55735ce28e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.995+0000 7f14cb400640 1 --2- 172.21.15.144:0/3573623281 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce2b480 0x55735ce68550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:10.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.995+0000 7f14cbe00640 1 -- 172.21.15.144:0/3573623281 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce2b480 msgr2=0x55735ce68550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:10.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.995+0000 7f14cbe00640 1 --2- 172.21.15.144:0/3573623281 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce2b480 0x55735ce68550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.995+0000 7f14cbe00640 1 -- 172.21.15.144:0/3573623281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce48150 msgr2=0x55735ce28e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:10.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.995+0000 7f14cbe00640 1 --2- 172.21.15.144:0/3573623281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce48150 0x55735ce28e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.995+0000 7f14cbe00640 1 -- 172.21.15.144:0/3573623281 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55735ce4ac70 con 0x55735ce29cf0 2024-09-11T23:24:10.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.995+0000 7f14cb400640 1 --2- 172.21.15.144:0/3573623281 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce2b480 0x55735ce68550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:10.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.996+0000 7f14cbe00640 1 --2- 172.21.15.144:0/3573623281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce29cf0 0x55735ce72320 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f14bc007530 tx=0x7f14bc021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab4bb1b940088dd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:10.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.996+0000 7f14b7400640 1 -- 172.21.15.144:0/3573623281 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc021ce0 con 0x55735ce29cf0 2024-09-11T23:24:10.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.996+0000 7f14b7400640 1 -- 172.21.15.144:0/3573623281 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14bc026070 con 0x55735ce29cf0 2024-09-11T23:24:10.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.996+0000 7f14b7400640 1 -- 172.21.15.144:0/3573623281 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc021270 con 0x55735ce29cf0 2024-09-11T23:24:10.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.997+0000 7f14d58a9740 1 -- 172.21.15.144:0/3573623281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce29cf0 msgr2=0x55735ce72320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:10.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.997+0000 7f14d58a9740 1 --2- 172.21.15.144:0/3573623281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce29cf0 0x55735ce72320 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f14bc007530 tx=0x7f14bc021000 comp rx=0 tx=0).stop 2024-09-11T23:24:10.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.997+0000 7f14d58a9740 1 -- 172.21.15.144:0/3573623281 shutdown_connections 2024-09-11T23:24:10.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.997+0000 7f14d58a9740 1 --2- 172.21.15.144:0/3573623281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce48150 0x55735ce28e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.997+0000 7f14d58a9740 1 --2- 172.21.15.144:0/3573623281 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce2b480 0x55735ce68550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.997+0000 7f14d58a9740 1 --2- 172.21.15.144:0/3573623281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce29cf0 0x55735ce72320 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:10.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.997+0000 7f14d58a9740 1 -- 172.21.15.144:0/3573623281 >> 172.21.15.144:0/3573623281 conn(0x55735ce274b0 msgr2=0x55735ce24430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:10.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.997+0000 7f14d58a9740 1 -- 172.21.15.144:0/3573623281 shutdown_connections 2024-09-11T23:24:10.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.997+0000 7f14d58a9740 1 -- 172.21.15.144:0/3573623281 wait complete. 2024-09-11T23:24:11.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.997+0000 7f14d58a9740 1 -- start start 2024-09-11T23:24:11.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.998+0000 7f14d58a9740 1 Processor -- start 2024-09-11T23:24:11.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.998+0000 7f14d58a9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce29cf0 0x55735ce71ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:11.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.998+0000 7f14d58a9740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce2b480 0x55735ceecc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:11.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.998+0000 7f14d58a9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce48150 0x55735ce24350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:11.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.998+0000 7f14d58a9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55735ce52b60 con 0x55735ce48150 2024-09-11T23:24:11.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.998+0000 7f14d58a9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55735ce53620 con 0x55735ce29cf0 2024-09-11T23:24:11.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.998+0000 7f14d58a9740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55735ce531b0 con 0x55735ce2b480 2024-09-11T23:24:11.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.998+0000 7f14d58a9740 10 client.0 _ll_register_callbacks cb 0x7f14bc001420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:24:11.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.999+0000 7f14d0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce48150 0x55735ce24350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:11.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.999+0000 7f14d0a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce48150 0x55735ce24350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50240/0 (socket says 172.21.15.144:50240) 2024-09-11T23:24:11.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.999+0000 7f14d0a00640 1 -- 172.21.15.144:0/2287504425 learned_addr learned my addr 172.21.15.144:0/2287504425 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:11.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.999+0000 7f14cbe00640 1 --2- 172.21.15.144:0/2287504425 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce29cf0 0x55735ce71ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:11.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.999+0000 7f14cb400640 1 --2- 172.21.15.144:0/2287504425 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce2b480 0x55735ceecc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:11.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.999+0000 7f14d0a00640 1 -- 172.21.15.144:0/2287504425 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce2b480 msgr2=0x55735ceecc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:11.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.999+0000 7f14d0a00640 1 --2- 172.21.15.144:0/2287504425 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce2b480 0x55735ceecc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.999+0000 7f14d0a00640 1 -- 172.21.15.144:0/2287504425 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce29cf0 msgr2=0x55735ce71ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:11.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.999+0000 7f14d0a00640 1 --2- 172.21.15.144:0/2287504425 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce29cf0 0x55735ce71ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.999+0000 7f14d0a00640 1 -- 172.21.15.144:0/2287504425 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55735ce28fd0 con 0x55735ce48150 2024-09-11T23:24:11.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.999+0000 7f14cbe00640 1 --2- 172.21.15.144:0/2287504425 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce29cf0 0x55735ce71ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:11.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.999+0000 7f14d0a00640 1 --2- 172.21.15.144:0/2287504425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce48150 0x55735ce24350 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f14c4017fa0 tx=0x7f14c40198c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925f55ec98893d8c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:11.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:10.999+0000 7f14b4c00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:24:11.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.000+0000 7f14b4c00640 1 -- 172.21.15.144:0/2287504425 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c4016670 con 0x55735ce48150 2024-09-11T23:24:11.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.000+0000 7f14b4c00640 1 -- 172.21.15.144:0/2287504425 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f14c4023af0 con 0x55735ce48150 2024-09-11T23:24:11.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.000+0000 7f14d58a9740 1 -- 172.21.15.144:0/2287504425 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14bc026070 con 0x55735ce48150 2024-09-11T23:24:11.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.000+0000 7f14b4c00640 1 -- 172.21.15.144:0/2287504425 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f14c4023cf0 con 0x55735ce48150 2024-09-11T23:24:11.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.000+0000 7f14d58a9740 10 client.7503 fetch_fsmap learned FSMap version 81 2024-09-11T23:24:11.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.000+0000 7f14d58a9740 1 -- 172.21.15.144:0/2287504425 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x55735ceee8c0 con 0x55735ce48150 2024-09-11T23:24:11.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.000+0000 7f14b4c00640 1 -- 172.21.15.144:0/2287504425 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14bc026070 con 0x55735ce48150 2024-09-11T23:24:11.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.000+0000 7f14b4c00640 1 -- 172.21.15.144:0/2287504425 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 81) ==== 3502+0+0 (secure 0 0 0) 0x7f14c4020070 con 0x55735ce48150 2024-09-11T23:24:11.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.000+0000 7f14d58a9740 10 client.7503 fetch_fsmap finished waiting for FSMap version 81 2024-09-11T23:24:11.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.000+0000 7f14d58a9740 10 client.7503 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:24:11.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.000+0000 7f14d58a9740 20 client.7503 populate_metadata read hostname 'smithi144' 2024-09-11T23:24:11.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.000+0000 7f14d58a9740 1 --2- 172.21.15.144:0/2287504425 >> [v2:172.21.15.144:6834/1311760947,v1:172.21.15.144:6835/1311760947] conn(0x55735ceed840 0x55735ce24890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:11.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.000+0000 7f14d58a9740 4 client.7503 mds_command: new command op to 7389 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:24:11.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.000+0000 7f14d58a9740 1 -- 172.21.15.144:0/2287504425 --> [v2:172.21.15.144:6834/1311760947,v1:172.21.15.144:6835/1311760947] -- command(tid 0: {"prefix": "status"}) -- 0x55735ce6dbf0 con 0x55735ceed840 2024-09-11T23:24:11.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.001+0000 7f14cbe00640 1 --2- 172.21.15.144:0/2287504425 >> [v2:172.21.15.144:6834/1311760947,v1:172.21.15.144:6835/1311760947] conn(0x55735ceed840 0x55735ce24890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:11.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.001+0000 7f14cbe00640 1 --2- 172.21.15.144:0/2287504425 >> [v2:172.21.15.144:6834/1311760947,v1:172.21.15.144:6835/1311760947] conn(0x55735ceed840 0x55735ce24890 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e5261014b7525df server_cookie=2b7706147884ef4f in_seq=0 out_seq=0 2024-09-11T23:24:11.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.001+0000 7f14b4c00640 10 client.7503 ms_handle_connect on v2:172.21.15.144:6834/1311760947 2024-09-11T23:24:11.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.001+0000 7f14b4c00640 1 -- 172.21.15.144:0/2287504425 <== mds.0 v2:172.21.15.144:6834/1311760947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55735ce6dbf0 con 0x55735ceed840 2024-09-11T23:24:11.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.001+0000 7f14b4c00640 10 client.7503 handle_command_reply: tid=0 2024-09-11T23:24:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.001+0000 7f14d58a9740 1 client.7503 shutdown 2024-09-11T23:24:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.001+0000 7f14d58a9740 1 -- 172.21.15.144:0/2287504425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce48150 msgr2=0x55735ce24350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.001+0000 7f14d58a9740 1 --2- 172.21.15.144:0/2287504425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce48150 0x55735ce24350 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f14c4017fa0 tx=0x7f14c40198c0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.002+0000 7f14d58a9740 1 -- 172.21.15.144:0/2287504425 shutdown_connections 2024-09-11T23:24:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.002+0000 7f14d58a9740 1 --2- 172.21.15.144:0/2287504425 >> [v2:172.21.15.144:6834/1311760947,v1:172.21.15.144:6835/1311760947] conn(0x55735ceed840 0x55735ce24890 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.002+0000 7f14d58a9740 1 --2- 172.21.15.144:0/2287504425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55735ce48150 0x55735ce24350 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.002+0000 7f14d58a9740 1 --2- 172.21.15.144:0/2287504425 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55735ce2b480 0x55735ceecc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.002+0000 7f14d58a9740 1 --2- 172.21.15.144:0/2287504425 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55735ce29cf0 0x55735ce71ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.002+0000 7f14b4c00640 0 client.7503 ms_handle_reset on v2:172.21.15.144:6834/1311760947 2024-09-11T23:24:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.002+0000 7f14d58a9740 1 -- 172.21.15.144:0/2287504425 >> 172.21.15.144:0/2287504425 conn(0x55735ce274b0 msgr2=0x55735ce50740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.002+0000 7f14d58a9740 1 -- 172.21.15.144:0/2287504425 shutdown_connections 2024-09-11T23:24:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.002+0000 7f14d58a9740 1 -- 172.21.15.144:0/2287504425 wait complete. 2024-09-11T23:24:11.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.002+0000 7f14d58a9740 20 client.7503 trim_cache size 0 max 16384 2024-09-11T23:24:11.007 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:24:11.007 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "4b73e4b7-12f0-4e37-94bc-45e333efe84e", 2024-09-11T23:24:11.007 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-11T23:24:11.007 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 7389, 2024-09-11T23:24:11.007 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-11T23:24:11.007 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-11T23:24:11.007 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-11T23:24:11.007 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 6.0609363710000004, 2024-09-11T23:24:11.007 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 81, 2024-09-11T23:24:11.007 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 116, 2024-09-11T23:24:11.008 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 116, 2024-09-11T23:24:11.008 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 10.795395750999999 2024-09-11T23:24:11.008 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:24:11.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.002+0000 7f14d2a00640 1 -- 172.21.15.144:0/2102898500 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f14ac06c220 msgr2=0x7f14ac06e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:11.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.002+0000 7f14d2a00640 1 --2- 172.21.15.144:0/2102898500 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f14ac06c220 0x7f14ac06e6e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f14bc001780 tx=0x7f14bc009040 comp rx=0 tx=0).stop 2024-09-11T23:24:11.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.002+0000 7f14d2a00640 1 -- 172.21.15.144:0/2102898500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14cc15f620 msgr2=0x7f14cc073550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:11.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.002+0000 7f14d2a00640 1 --2- 172.21.15.144:0/2102898500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14cc15f620 0x7f14cc073550 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f14b8000c00 tx=0x7f14b80046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.003+0000 7f14d2a00640 1 -- 172.21.15.144:0/2102898500 shutdown_connections 2024-09-11T23:24:11.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.003+0000 7f14d2a00640 1 --2- 172.21.15.144:0/2102898500 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f14ac06c220 0x7f14ac06e6e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.003+0000 7f14d2a00640 1 --2- 172.21.15.144:0/2102898500 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f14cc15b7a0 0x7f14cc0b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.003+0000 7f14d2a00640 1 --2- 172.21.15.144:0/2102898500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14cc15f620 0x7f14cc073550 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.003+0000 7f14d2a00640 1 --2- 172.21.15.144:0/2102898500 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f14cc0b4930 0x7f14cc071950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.003+0000 7f14d2a00640 1 -- 172.21.15.144:0/2102898500 >> 172.21.15.144:0/2102898500 conn(0x7f14cc062cc0 msgr2=0x7f14cc0cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:11.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.003+0000 7f14d2a00640 1 -- 172.21.15.144:0/2102898500 shutdown_connections 2024-09-11T23:24:11.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.003+0000 7f14d2a00640 1 -- 172.21.15.144:0/2102898500 wait complete. 2024-09-11T23:24:11.018 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:24:11.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.171+0000 7fb466200640 1 Processor -- start 2024-09-11T23:24:11.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.171+0000 7fb466200640 1 -- start start 2024-09-11T23:24:11.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.172+0000 7fb466200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4600b4930 0x7fb4600b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:11.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.172+0000 7fb466200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb46015f620 0x7fb46015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:11.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.172+0000 7fb466200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb460162870 con 0x7fb4600d0a50 2024-09-11T23:24:11.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.172+0000 7fb466200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb4600b52d0 con 0x7fb46015f620 2024-09-11T23:24:11.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.172+0000 7fb466200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb460162b50 con 0x7fb4600b4930 2024-09-11T23:24:11.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.173+0000 7fb45ea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4600b4930 0x7fb4600b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:11.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.173+0000 7fb45f400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fb4600d0a50 0x7fb4601620b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:47794/0 (socket says 172.21.15.144:47794) 2024-09-11T23:24:11.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.173+0000 7fb45f400640 1 -- 172.21.15.144:0/3174642592 learned_addr learned my addr 172.21.15.144:0/3174642592 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:11.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.173+0000 7fb45fe00640 1 --2- 172.21.15.144:0/3174642592 >> v2:172.21.15.165:3300/0 conn(0x7fb46015f620 0x7fb46015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:11.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.173+0000 7fb45ea00640 1 -- 172.21.15.144:0/3174642592 >> v2:172.21.15.165:3300/0 conn(0x7fb46015f620 msgr2=0x7fb46015fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:11.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.173+0000 7fb45ea00640 1 --2- 172.21.15.144:0/3174642592 >> v2:172.21.15.165:3300/0 conn(0x7fb46015f620 0x7fb46015fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.173+0000 7fb45ea00640 1 -- 172.21.15.144:0/3174642592 >> v1:172.21.15.165:6789/0 conn(0x7fb4600d0a50 legacy=0x7fb4601620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:11.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.173+0000 7fb45ea00640 1 -- 172.21.15.144:0/3174642592 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb460162e30 con 0x7fb4600b4930 2024-09-11T23:24:11.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.174+0000 7fb45ea00640 1 --2- 172.21.15.144:0/3174642592 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4600b4930 0x7fb4600b4d90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0097a0 tx=0x7fb44c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dc45eaf3738a46c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:11.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.174+0000 7fb45e000640 1 -- 172.21.15.144:0/3174642592 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c037070 con 0x7fb4600b4930 2024-09-11T23:24:11.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.175+0000 7fb45e000640 1 -- 172.21.15.144:0/3174642592 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb44c02ae50 con 0x7fb4600b4930 2024-09-11T23:24:11.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.175+0000 7fb45e000640 1 -- 172.21.15.144:0/3174642592 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44c032660 con 0x7fb4600b4930 2024-09-11T23:24:11.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.175+0000 7fb466200640 1 -- 172.21.15.144:0/3174642592 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4600b4930 msgr2=0x7fb4600b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:11.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.175+0000 7fb466200640 1 --2- 172.21.15.144:0/3174642592 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4600b4930 0x7fb4600b4d90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0097a0 tx=0x7fb44c02a100 comp rx=0 tx=0).stop 2024-09-11T23:24:11.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.175+0000 7fb466200640 1 -- 172.21.15.144:0/3174642592 shutdown_connections 2024-09-11T23:24:11.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.175+0000 7fb466200640 1 --2- 172.21.15.144:0/3174642592 >> v2:172.21.15.165:3300/0 conn(0x7fb46015f620 0x7fb46015fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.175+0000 7fb466200640 1 --2- 172.21.15.144:0/3174642592 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4600b4930 0x7fb4600b4d90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.175+0000 7fb466200640 1 -- 172.21.15.144:0/3174642592 >> 172.21.15.144:0/3174642592 conn(0x7fb460062cc0 msgr2=0x7fb46006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:11.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.175+0000 7fb466200640 1 -- 172.21.15.144:0/3174642592 shutdown_connections 2024-09-11T23:24:11.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.175+0000 7fb466200640 1 -- 172.21.15.144:0/3174642592 wait complete. 2024-09-11T23:24:11.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.177+0000 7fb466200640 1 Processor -- start 2024-09-11T23:24:11.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.177+0000 7fb466200640 1 -- start start 2024-09-11T23:24:11.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.178+0000 7fb466200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4600b4930 0x7fb4601543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:11.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.178+0000 7fb466200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46015f620 0x7fb4601548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:11.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.178+0000 7fb466200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4601566b0 0x7fb46015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:11.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.178+0000 7fb466200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb46015fff0 con 0x7fb4601566b0 2024-09-11T23:24:11.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.178+0000 7fb466200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb4600b3620 con 0x7fb46015f620 2024-09-11T23:24:11.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.178+0000 7fb466200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb4600b1b80 con 0x7fb4600b4930 2024-09-11T23:24:11.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.178+0000 7fb45fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4601566b0 0x7fb46015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:11.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.178+0000 7fb45fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4601566b0 0x7fb46015a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50250/0 (socket says 172.21.15.144:50250) 2024-09-11T23:24:11.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.178+0000 7fb45fe00640 1 -- 172.21.15.144:0/152524533 learned_addr learned my addr 172.21.15.144:0/152524533 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:11.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.178+0000 7fb45f400640 1 --2- 172.21.15.144:0/152524533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4600b4930 0x7fb4601543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:11.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.178+0000 7fb45ea00640 1 --2- 172.21.15.144:0/152524533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46015f620 0x7fb4601548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:11.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.179+0000 7fb45fe00640 1 -- 172.21.15.144:0/152524533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4600b4930 msgr2=0x7fb4601543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:11.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.179+0000 7fb45fe00640 1 --2- 172.21.15.144:0/152524533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4600b4930 0x7fb4601543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.179+0000 7fb45fe00640 1 -- 172.21.15.144:0/152524533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46015f620 msgr2=0x7fb4601548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:11.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.179+0000 7fb45fe00640 1 --2- 172.21.15.144:0/152524533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46015f620 0x7fb4601548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.179+0000 7fb45fe00640 1 -- 172.21.15.144:0/152524533 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4601580c0 con 0x7fb4601566b0 2024-09-11T23:24:11.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.179+0000 7fb45fe00640 1 --2- 172.21.15.144:0/152524533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4601566b0 0x7fb46015a1f0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fb458009d30 tx=0x7fb45800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:11.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.179+0000 7fb457400640 1 -- 172.21.15.144:0/152524533 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458018020 con 0x7fb4601566b0 2024-09-11T23:24:11.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.179+0000 7fb457400640 1 -- 172.21.15.144:0/152524533 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb458014480 con 0x7fb4601566b0 2024-09-11T23:24:11.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.179+0000 7fb466200640 1 -- 172.21.15.144:0/152524533 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4601583a0 con 0x7fb4601566b0 2024-09-11T23:24:11.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.179+0000 7fb457400640 1 -- 172.21.15.144:0/152524533 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458014870 con 0x7fb4601566b0 2024-09-11T23:24:11.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.179+0000 7fb466200640 1 -- 172.21.15.144:0/152524533 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb460154ef0 con 0x7fb4601566b0 2024-09-11T23:24:11.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.180+0000 7fb466200640 1 -- 172.21.15.144:0/152524533 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb460155210 con 0x7fb4601566b0 2024-09-11T23:24:11.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.181+0000 7fb457400640 1 -- 172.21.15.144:0/152524533 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7fb458005d10 con 0x7fb4601566b0 2024-09-11T23:24:11.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.182+0000 7fb457400640 1 --2- 172.21.15.144:0/152524533 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb44006c220 0x7fb44006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:11.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.182+0000 7fb457400640 1 -- 172.21.15.144:0/152524533 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7fb45808c3b0 con 0x7fb4601566b0 2024-09-11T23:24:11.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.183+0000 7fb45f400640 1 --2- 172.21.15.144:0/152524533 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb44006c220 0x7fb44006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:11.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.183+0000 7fb45f400640 1 --2- 172.21.15.144:0/152524533 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb44006c220 0x7fb44006e6e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb4601556c0 tx=0x7fb450007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:11.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.186+0000 7fb457400640 1 -- 172.21.15.144:0/152524533 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb458022030 con 0x7fb4601566b0 2024-09-11T23:24:11.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.395+0000 7fb466200640 1 -- 172.21.15.144:0/152524533 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb4600b4d90 con 0x7fb4601566b0 2024-09-11T23:24:11.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.396+0000 7fb457400640 1 -- 172.21.15.144:0/152524533 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v81) ==== 53+0+73 (secure 0 0 0) 0x7fb458010040 con 0x7fb4601566b0 2024-09-11T23:24:11.396 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:24:11.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.398+0000 7fb466200640 1 -- 172.21.15.144:0/152524533 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb44006c220 msgr2=0x7fb44006e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:11.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.398+0000 7fb466200640 1 --2- 172.21.15.144:0/152524533 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb44006c220 0x7fb44006e6e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb4601556c0 tx=0x7fb450007e80 comp rx=0 tx=0).stop 2024-09-11T23:24:11.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.398+0000 7fb466200640 1 -- 172.21.15.144:0/152524533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4601566b0 msgr2=0x7fb46015a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.398+0000 7fb466200640 1 --2- 172.21.15.144:0/152524533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4601566b0 0x7fb46015a1f0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fb458009d30 tx=0x7fb45800c490 comp rx=0 tx=0).stop 2024-09-11T23:24:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.398+0000 7fb466200640 1 -- 172.21.15.144:0/152524533 shutdown_connections 2024-09-11T23:24:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.398+0000 7fb466200640 1 --2- 172.21.15.144:0/152524533 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb44006c220 0x7fb44006e6e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.398+0000 7fb466200640 1 --2- 172.21.15.144:0/152524533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4601566b0 0x7fb46015a1f0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.398+0000 7fb466200640 1 --2- 172.21.15.144:0/152524533 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46015f620 0x7fb4601548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.398+0000 7fb466200640 1 --2- 172.21.15.144:0/152524533 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4600b4930 0x7fb4601543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.398+0000 7fb466200640 1 -- 172.21.15.144:0/152524533 >> 172.21.15.144:0/152524533 conn(0x7fb460062cc0 msgr2=0x7fb4600b3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.398+0000 7fb466200640 1 -- 172.21.15.144:0/152524533 shutdown_connections 2024-09-11T23:24:11.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11.399+0000 7fb466200640 1 -- 172.21.15.144:0/152524533 wait complete. 2024-09-11T23:24:11.414 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:24:11.414 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:24:11.414 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-11T23:24:11.414 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:24:11.414 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:24:11.414 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:24:11.414 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:24:11.414 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:24:11.415 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:24:11.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:11.415 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-11T23:24:11.452 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:24:11.452 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:24:11.452 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:24:11.452 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:11.452 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-11T23:24:11.452 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:11.452 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:24:11.452 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:24:11.452 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-11T23:24:11.452 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:24:11.452 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:24:11.453 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-11T23:24:11.453 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:24:11.453 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:24:11.453 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:24:11.453 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-11T23:24:11.453 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:24:11.453 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42311sec preferred_lft 42311sec 2024-09-11T23:24:11.453 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2024-09-11T23:24:11.453 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:11.453 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:24:11.453 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff 2024-09-11T23:24:11.453 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:24:11.453 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:11.454 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::243b:82ff:fe06:fac9/64 scope link 2024-09-11T23:24:11.454 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:11.454 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:24:11.454 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:24:11.454 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::74ca:30ff:fef2:cddf/64 scope link 2024-09-11T23:24:11.454 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:11.454 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:24:11.454 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether be:01:ec:87:34:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:24:11.454 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bc01:ecff:fe87:34e1/64 scope link 2024-09-11T23:24:11.454 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:11.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:11.455 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:24:11.546 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-11T23:24:11.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:11.549 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-11T23:24:11.585 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-11T23:24:11.585 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:24:11.586 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:24:11.586 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:24:11.586 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:24:11.586 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:24:11.586 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-11T23:24:11.586 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:24:11.586 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:24:11.587 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:24:11.587 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-11T23:24:11.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:24:11.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:24:11.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:11.783 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-11T23:24:11.818 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:24:11.819 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:24:11.819 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:24:11.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:11.819 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-11T23:24:11.915 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:24:11.915 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:24:11.951 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:24:11.952 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:24:11.952 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:24:12.026 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T23:24:12.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:12.026 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:24:12.156 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:24:12.156 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:24:12.185 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:24:12.185 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:24:12.185 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:24:12.185 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:24:12.185 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:24:12.188 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T23:24:12.188 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:24:12.188 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:24:12.188 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:24:12.188 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:24:12.191 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:24:12.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:12.191 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:24:12.248 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:24:12.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:24:12.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:24:12.344 INFO:teuthology.orchestra.run.smithi144.stdout:client6407 2024-09-11T23:24:12.345 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:24:12.345 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:24:12.381 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:24:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.575+0000 7f587c800640 1 Processor -- start 2024-09-11T23:24:12.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.575+0000 7f587c800640 1 -- start start 2024-09-11T23:24:12.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.576+0000 7f587c800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f587406be10 0x7f58740cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:12.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.577+0000 7f587c800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58740cd5f0 con 0x7f587406c1f0 2024-09-11T23:24:12.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.577+0000 7f587c800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58740cd8d0 con 0x7f5874151c50 2024-09-11T23:24:12.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.577+0000 7f587c800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f58740cdbb0 con 0x7f587406be10 2024-09-11T23:24:12.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.577+0000 7f5879400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f587406c1f0 0x7f5874151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:57552/0 (socket says 172.21.15.144:57552) 2024-09-11T23:24:12.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.577+0000 7f5879400640 1 -- 172.21.15.144:0/1538380907 learned_addr learned my addr 172.21.15.144:0/1538380907 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:12.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.577+0000 7f5879e00640 1 --2- 172.21.15.144:0/1538380907 >> v2:172.21.15.165:3300/0 conn(0x7f587406be10 0x7f58740cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:12.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.577+0000 7f5878a00640 1 -- 172.21.15.144:0/1538380907 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2155600772 0 0) 0x7f58740cd5f0 con 0x7f587406c1f0 2024-09-11T23:24:12.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.577+0000 7f5878a00640 1 -- 172.21.15.144:0/1538380907 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f585c003520 con 0x7f587406c1f0 2024-09-11T23:24:12.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.577+0000 7f5879e00640 1 -- 172.21.15.144:0/1538380907 >> v1:172.21.15.165:6789/0 conn(0x7f5874151c50 legacy=0x7f5874164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:12.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.577+0000 7f5879e00640 1 -- 172.21.15.144:0/1538380907 >> v1:172.21.15.144:6789/0 conn(0x7f587406c1f0 legacy=0x7f5874151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:12.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.577+0000 7f5879e00640 1 -- 172.21.15.144:0/1538380907 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58740cde90 con 0x7f587406be10 2024-09-11T23:24:12.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.579+0000 7f5879e00640 1 --2- 172.21.15.144:0/1538380907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f587406be10 0x7f58740cd010 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f58680097a0 tx=0x7f586802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ceded3ccd2ce84f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:12.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.579+0000 7f5878a00640 1 -- 172.21.15.144:0/1538380907 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868037070 con 0x7f587406be10 2024-09-11T23:24:12.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.579+0000 7f5878a00640 1 -- 172.21.15.144:0/1538380907 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5868032440 con 0x7f587406be10 2024-09-11T23:24:12.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.579+0000 7f5878a00640 1 -- 172.21.15.144:0/1538380907 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868032810 con 0x7f587406be10 2024-09-11T23:24:12.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.579+0000 7f587c800640 1 -- 172.21.15.144:0/1538380907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f587406be10 msgr2=0x7f58740cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:12.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.579+0000 7f587c800640 1 --2- 172.21.15.144:0/1538380907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f587406be10 0x7f58740cd010 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f58680097a0 tx=0x7f586802a230 comp rx=0 tx=0).stop 2024-09-11T23:24:12.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.579+0000 7f587c800640 1 -- 172.21.15.144:0/1538380907 shutdown_connections 2024-09-11T23:24:12.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.579+0000 7f587c800640 1 --2- 172.21.15.144:0/1538380907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f587406be10 0x7f58740cd010 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:12.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.579+0000 7f587c800640 1 -- 172.21.15.144:0/1538380907 >> 172.21.15.144:0/1538380907 conn(0x7f5874062cc0 msgr2=0x7f587406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:12.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.579+0000 7f587c800640 1 -- 172.21.15.144:0/1538380907 shutdown_connections 2024-09-11T23:24:12.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.579+0000 7f587c800640 1 -- 172.21.15.144:0/1538380907 wait complete. 2024-09-11T23:24:12.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.581+0000 7f587c800640 1 Processor -- start 2024-09-11T23:24:12.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.581+0000 7f587c800640 1 -- start start 2024-09-11T23:24:12.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.582+0000 7f587c800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f587406be10 0x7f587414c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:12.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.582+0000 7f587c800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f587406c1f0 0x7f58740b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:12.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.582+0000 7f587c800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5874151c50 0x7f58741f7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:12.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.582+0000 7f587c800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f587415baa0 con 0x7f5874151c50 2024-09-11T23:24:12.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.582+0000 7f587c800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f58740ce690 con 0x7f587406be10 2024-09-11T23:24:12.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.582+0000 7f587c800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f587415bc20 con 0x7f587406c1f0 2024-09-11T23:24:12.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.582+0000 7f587a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5874151c50 0x7f58741f7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:12.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.582+0000 7f587a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5874151c50 0x7f58741f7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50262/0 (socket says 172.21.15.144:50262) 2024-09-11T23:24:12.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.582+0000 7f587a800640 1 -- 172.21.15.144:0/818646114 learned_addr learned my addr 172.21.15.144:0/818646114 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:12.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.583+0000 7f5879e00640 1 --2- 172.21.15.144:0/818646114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f587406be10 0x7f587414c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:12.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.583+0000 7f5879400640 1 --2- 172.21.15.144:0/818646114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f587406c1f0 0x7f58740b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:12.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.583+0000 7f587a800640 1 -- 172.21.15.144:0/818646114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f587406c1f0 msgr2=0x7f58740b1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:12.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.583+0000 7f587a800640 1 --2- 172.21.15.144:0/818646114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f587406c1f0 0x7f58740b1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:12.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.583+0000 7f587a800640 1 -- 172.21.15.144:0/818646114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f587406be10 msgr2=0x7f587414c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:12.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.583+0000 7f587a800640 1 --2- 172.21.15.144:0/818646114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f587406be10 0x7f587414c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:12.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.583+0000 7f587a800640 1 -- 172.21.15.144:0/818646114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58741f84f0 con 0x7f5874151c50 2024-09-11T23:24:12.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.583+0000 7f5879e00640 1 --2- 172.21.15.144:0/818646114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f587406be10 0x7f587414c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:12.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.583+0000 7f5879400640 1 --2- 172.21.15.144:0/818646114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f587406c1f0 0x7f58740b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:12.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.583+0000 7f587a800640 1 --2- 172.21.15.144:0/818646114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5874151c50 0x7f58741f7850 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f587000c6b0 tx=0x7f587000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:12.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.583+0000 7f586e000640 1 -- 172.21.15.144:0/818646114 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5870003b70 con 0x7f5874151c50 2024-09-11T23:24:12.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.583+0000 7f586e000640 1 -- 172.21.15.144:0/818646114 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5870003d30 con 0x7f5874151c50 2024-09-11T23:24:12.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.583+0000 7f587c800640 1 -- 172.21.15.144:0/818646114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f587414bb60 con 0x7f5874151c50 2024-09-11T23:24:12.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.583+0000 7f586e000640 1 -- 172.21.15.144:0/818646114 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5870005310 con 0x7f5874151c50 2024-09-11T23:24:12.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.584+0000 7f587c800640 1 -- 172.21.15.144:0/818646114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f587414c120 con 0x7f5874151c50 2024-09-11T23:24:12.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.584+0000 7f587c800640 1 -- 172.21.15.144:0/818646114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f587414c320 con 0x7f5874151c50 2024-09-11T23:24:12.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.585+0000 7f586e000640 1 -- 172.21.15.144:0/818646114 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f58700054b0 con 0x7f5874151c50 2024-09-11T23:24:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.586+0000 7f586e000640 1 --2- 172.21.15.144:0/818646114 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f585806c220 0x7f585806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.586+0000 7f586e000640 1 -- 172.21.15.144:0/818646114 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f587008b430 con 0x7f5874151c50 2024-09-11T23:24:12.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.587+0000 7f5879e00640 1 --2- 172.21.15.144:0/818646114 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f585806c220 0x7f585806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:12.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.587+0000 7f5879e00640 1 --2- 172.21.15.144:0/818646114 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f585806c220 0x7f585806e6e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5868034000 tx=0x7f586802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:12.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.590+0000 7f586e000640 1 -- 172.21.15.144:0/818646114 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f587414c320 con 0x7f5874151c50 2024-09-11T23:24:12.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.799+0000 7f587c800640 1 -- 172.21.15.144:0/818646114 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f58740cd010 con 0x7f5874151c50 2024-09-11T23:24:12.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.799+0000 7f586e000640 1 -- 172.21.15.144:0/818646114 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v81) ==== 53+0+73 (secure 0 0 0) 0x7f5870059850 con 0x7f5874151c50 2024-09-11T23:24:12.799 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:24:12.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.802+0000 7f587c800640 1 -- 172.21.15.144:0/818646114 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f585806c220 msgr2=0x7f585806e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:12.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.802+0000 7f587c800640 1 --2- 172.21.15.144:0/818646114 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f585806c220 0x7f585806e6e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5868034000 tx=0x7f586802e000 comp rx=0 tx=0).stop 2024-09-11T23:24:12.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.802+0000 7f587c800640 1 -- 172.21.15.144:0/818646114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5874151c50 msgr2=0x7f58741f7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:12.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.802+0000 7f587c800640 1 --2- 172.21.15.144:0/818646114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5874151c50 0x7f58741f7850 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f587000c6b0 tx=0x7f587000cb70 comp rx=0 tx=0).stop 2024-09-11T23:24:12.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.802+0000 7f587c800640 1 -- 172.21.15.144:0/818646114 shutdown_connections 2024-09-11T23:24:12.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.802+0000 7f587c800640 1 --2- 172.21.15.144:0/818646114 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f585806c220 0x7f585806e6e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:12.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.802+0000 7f587c800640 1 --2- 172.21.15.144:0/818646114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5874151c50 0x7f58741f7850 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:12.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.802+0000 7f587c800640 1 --2- 172.21.15.144:0/818646114 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f587406c1f0 0x7f58740b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:12.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.802+0000 7f587c800640 1 --2- 172.21.15.144:0/818646114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f587406be10 0x7f587414c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:12.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.802+0000 7f587c800640 1 -- 172.21.15.144:0/818646114 >> 172.21.15.144:0/818646114 conn(0x7f5874062cc0 msgr2=0x7f587414b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:12.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.802+0000 7f587c800640 1 -- 172.21.15.144:0/818646114 shutdown_connections 2024-09-11T23:24:12.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:12.802+0000 7f587c800640 1 -- 172.21.15.144:0/818646114 wait complete. 2024-09-11T23:24:12.818 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:24:12.819 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:24:12.819 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi165.front.sepia.ceph.com 2024-09-11T23:24:12.819 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T23:24:12.819 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:24:12.819 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:24:12.819 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:24:12.819 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:24:12.819 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:24:12.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:12.819 DEBUG:teuthology.orchestra.run.smithi165:> ip addr 2024-09-11T23:24:12.860 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:24:12.860 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:24:12.860 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:24:12.860 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:12.860 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-11T23:24:12.860 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:12.860 INFO:teuthology.orchestra.run.smithi165.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:24:12.861 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:94 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:24:12.861 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f0 2024-09-11T23:24:12.861 INFO:teuthology.orchestra.run.smithi165.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:24:12.862 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:95 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:24:12.862 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f1 2024-09-11T23:24:12.862 INFO:teuthology.orchestra.run.smithi165.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:24:12.862 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:24:12.862 INFO:teuthology.orchestra.run.smithi165.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:24:12.862 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:24:12.862 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.21.15.165/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:24:12.862 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft 42313sec preferred_lft 42313sec 2024-09-11T23:24:12.862 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::ec4:7aff:fe88:7f63/64 scope link noprefixroute 2024-09-11T23:24:12.862 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:12.862 INFO:teuthology.orchestra.run.smithi165.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:24:12.862 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:24:12.862 INFO:teuthology.orchestra.run.smithi165.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:24:12.863 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:12.863 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::c063:d7ff:fec8:c56c/64 scope link 2024-09-11T23:24:12.863 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:12.863 INFO:teuthology.orchestra.run.smithi165.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:24:12.863 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:24:12.863 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::5478:e4ff:fecd:76c/64 scope link 2024-09-11T23:24:12.863 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:12.863 INFO:teuthology.orchestra.run.smithi165.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:24:12.863 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether ba:fa:43:78:5f:29 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:24:12.863 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::b8fa:43ff:fe78:5f29/64 scope link 2024-09-11T23:24:12.863 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:12.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:12.864 DEBUG:teuthology.orchestra.run.smithi165:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:24:12.966 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-11T23:24:12.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:12.970 DEBUG:teuthology.orchestra.run.smithi165:> route 2024-09-11T23:24:13.009 INFO:teuthology.orchestra.run.smithi165.stdout:Kernel IP routing table 2024-09-11T23:24:13.009 INFO:teuthology.orchestra.run.smithi165.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:24:13.009 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:24:13.009 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:24:13.009 INFO:teuthology.orchestra.run.smithi165.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:24:13.009 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:24:13.009 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-11T23:24:13.009 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:24:13.009 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:24:13.010 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:24:13.010 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-11T23:24:13.127 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:24:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:24:13.199 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:24:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:24:13.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:13.207 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-11T23:24:13.243 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-11T23:24:13.243 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-11T23:24:13.243 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:24:13.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:13.243 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set brx.0 up 2024-09-11T23:24:13.340 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:24:13.340 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T23:24:13.375 INFO:teuthology.orchestra.run.smithi165.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:24:13.375 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:24:13.376 DEBUG:teuthology.orchestra.run.smithi165:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:24:13.450 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-11T23:24:13.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:13.450 DEBUG:teuthology.orchestra.run.smithi165:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:24:13.578 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:24:13.578 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:24:13.605 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:24:13.605 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:24:13.605 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:24:13.605 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: trying mount with new device syntax: 1@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:24:13.605 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:24:13.608 INFO:teuthology.orchestra.run.smithi165.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-11T23:24:13.608 INFO:teuthology.orchestra.run.smithi165.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:24:13.608 INFO:teuthology.orchestra.run.smithi165.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:24:13.608 INFO:teuthology.orchestra.run.smithi165.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:24:13.608 INFO:teuthology.orchestra.run.smithi165.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:24:13.611 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:24:13.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:13.611 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:24:13.667 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:24:13.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:24:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:24:13.749 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:24:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:24:13.757 INFO:teuthology.orchestra.run.smithi165.stdout:client6413 2024-09-11T23:24:13.757 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:24:13.758 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:24:13.794 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-11T23:24:13.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.954+0000 7fe81e200640 1 Processor -- start 2024-09-11T23:24:13.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.954+0000 7fe81e200640 1 -- start start 2024-09-11T23:24:13.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.956+0000 7fe81e200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe81815b1d0 0x7fe8180b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:13.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.956+0000 7fe81e200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe8180ce090 0x7fe8180ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:13.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.956+0000 7fe81e200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe81815b5b0 con 0x7fe81815ed60 2024-09-11T23:24:13.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.956+0000 7fe81e200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe8180b21b0 con 0x7fe8180ce090 2024-09-11T23:24:13.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.956+0000 7fe81e200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8180cea10 con 0x7fe81815b1d0 2024-09-11T23:24:13.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.956+0000 7fe80fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe8180ce090 0x7fe8180ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:13.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.956+0000 7fe80fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe8180ce090 0x7fe8180ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50274/0 (socket says 172.21.15.144:50274) 2024-09-11T23:24:13.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.956+0000 7fe80fe00640 1 -- 172.21.15.144:0/2193100032 learned_addr learned my addr 172.21.15.144:0/2193100032 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:13.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.957+0000 7fe81ce00640 1 --2- 172.21.15.144:0/2193100032 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe81815b1d0 0x7fe8180b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:13.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.957+0000 7fe80fe00640 1 -- 172.21.15.144:0/2193100032 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe81815b1d0 msgr2=0x7fe8180b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:13.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.957+0000 7fe80fe00640 1 --2- 172.21.15.144:0/2193100032 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe81815b1d0 0x7fe8180b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:13.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.957+0000 7fe80fe00640 1 -- 172.21.15.144:0/2193100032 >> v1:172.21.15.165:6789/0 conn(0x7fe81815ed60 legacy=0x7fe81815f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:13.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.957+0000 7fe80fe00640 1 -- 172.21.15.144:0/2193100032 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8180b4800 con 0x7fe8180ce090 2024-09-11T23:24:13.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.958+0000 7fe80fe00640 1 --2- 172.21.15.144:0/2193100032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8180ce090 0x7fe8180ce4d0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fe800009870 tx=0x7fe80002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d33be5bcb669e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:13.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.958+0000 7fe817e00640 1 -- 172.21.15.144:0/2193100032 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800037070 con 0x7fe8180ce090 2024-09-11T23:24:13.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.958+0000 7fe817e00640 1 -- 172.21.15.144:0/2193100032 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe800032440 con 0x7fe8180ce090 2024-09-11T23:24:13.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.958+0000 7fe817e00640 1 -- 172.21.15.144:0/2193100032 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800032810 con 0x7fe8180ce090 2024-09-11T23:24:13.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.959+0000 7fe81e200640 1 -- 172.21.15.144:0/2193100032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8180ce090 msgr2=0x7fe8180ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:13.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.959+0000 7fe81e200640 1 --2- 172.21.15.144:0/2193100032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8180ce090 0x7fe8180ce4d0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fe800009870 tx=0x7fe80002a1c0 comp rx=0 tx=0).stop 2024-09-11T23:24:13.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.959+0000 7fe81e200640 1 -- 172.21.15.144:0/2193100032 shutdown_connections 2024-09-11T23:24:13.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.959+0000 7fe81e200640 1 --2- 172.21.15.144:0/2193100032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8180ce090 0x7fe8180ce4d0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:13.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.959+0000 7fe81e200640 1 --2- 172.21.15.144:0/2193100032 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe81815b1d0 0x7fe8180b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:13.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.959+0000 7fe81e200640 1 -- 172.21.15.144:0/2193100032 >> 172.21.15.144:0/2193100032 conn(0x7fe81806bba0 msgr2=0x7fe81806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:13.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.959+0000 7fe81e200640 1 -- 172.21.15.144:0/2193100032 shutdown_connections 2024-09-11T23:24:13.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.959+0000 7fe81e200640 1 -- 172.21.15.144:0/2193100032 wait complete. 2024-09-11T23:24:13.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.960+0000 7fe81e200640 1 Processor -- start 2024-09-11T23:24:13.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.961+0000 7fe81e200640 1 -- start start 2024-09-11T23:24:13.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.961+0000 7fe81e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8180ce090 0x7fe8180ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:13.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.961+0000 7fe81e200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe81815b1d0 0x7fe8180c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:13.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.961+0000 7fe81e200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe81815ed60 0x7fe8180c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:13.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.961+0000 7fe81e200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe8180b50a0 con 0x7fe8180ce090 2024-09-11T23:24:13.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.961+0000 7fe81e200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe8180b4dc0 con 0x7fe81815ed60 2024-09-11T23:24:13.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.961+0000 7fe81e200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8180b5380 con 0x7fe81815b1d0 2024-09-11T23:24:13.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.962+0000 7fe81ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8180ce090 0x7fe8180ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:13.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.962+0000 7fe81ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8180ce090 0x7fe8180ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50286/0 (socket says 172.21.15.144:50286) 2024-09-11T23:24:13.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.962+0000 7fe81ce00640 1 -- 172.21.15.144:0/1614189912 learned_addr learned my addr 172.21.15.144:0/1614189912 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:13.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.962+0000 7fe80fe00640 1 --2- 172.21.15.144:0/1614189912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe81815b1d0 0x7fe8180c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:13.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.962+0000 7fe81d800640 1 --2- 172.21.15.144:0/1614189912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe81815ed60 0x7fe8180c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:13.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.962+0000 7fe81ce00640 1 -- 172.21.15.144:0/1614189912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe81815b1d0 msgr2=0x7fe8180c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:13.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.962+0000 7fe81ce00640 1 --2- 172.21.15.144:0/1614189912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe81815b1d0 0x7fe8180c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:13.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.962+0000 7fe81ce00640 1 -- 172.21.15.144:0/1614189912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe81815ed60 msgr2=0x7fe8180c5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:13.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.962+0000 7fe81ce00640 1 --2- 172.21.15.144:0/1614189912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe81815ed60 0x7fe8180c5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:13.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.962+0000 7fe81ce00640 1 -- 172.21.15.144:0/1614189912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8180af1e0 con 0x7fe8180ce090 2024-09-11T23:24:13.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.962+0000 7fe80fe00640 1 --2- 172.21.15.144:0/1614189912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe81815b1d0 0x7fe8180c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:13.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.962+0000 7fe81ce00640 1 --2- 172.21.15.144:0/1614189912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8180ce090 0x7fe8180ae8e0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fe80800e9b0 tx=0x7fe80800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:13.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.962+0000 7fe815600640 1 -- 172.21.15.144:0/1614189912 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808017070 con 0x7fe8180ce090 2024-09-11T23:24:13.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.962+0000 7fe815600640 1 -- 172.21.15.144:0/1614189912 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe80800c9a0 con 0x7fe8180ce090 2024-09-11T23:24:13.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.962+0000 7fe81e200640 1 -- 172.21.15.144:0/1614189912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8180af4c0 con 0x7fe8180ce090 2024-09-11T23:24:13.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.962+0000 7fe815600640 1 -- 172.21.15.144:0/1614189912 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80800cd90 con 0x7fe8180ce090 2024-09-11T23:24:13.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.963+0000 7fe81e200640 1 -- 172.21.15.144:0/1614189912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8180aee20 con 0x7fe8180ce090 2024-09-11T23:24:13.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.964+0000 7fe81e200640 1 -- 172.21.15.144:0/1614189912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8180afec0 con 0x7fe8180ce090 2024-09-11T23:24:13.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.965+0000 7fe815600640 1 -- 172.21.15.144:0/1614189912 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7fe80801a070 con 0x7fe8180ce090 2024-09-11T23:24:13.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.965+0000 7fe815600640 1 --2- 172.21.15.144:0/1614189912 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe7f406c220 0x7fe7f406e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:13.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.965+0000 7fe815600640 1 -- 172.21.15.144:0/1614189912 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7fe80808b8e0 con 0x7fe8180ce090 2024-09-11T23:24:13.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.966+0000 7fe80fe00640 1 --2- 172.21.15.144:0/1614189912 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe7f406c220 0x7fe7f406e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:13.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.967+0000 7fe80fe00640 1 --2- 172.21.15.144:0/1614189912 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe7f406c220 0x7fe7f406e6e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe800034000 tx=0x7fe80002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:13.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:13.970+0000 7fe815600640 1 -- 172.21.15.144:0/1614189912 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe808059d40 con 0x7fe8180ce090 2024-09-11T23:24:14.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:14.180+0000 7fe81e200640 1 -- 172.21.15.144:0/1614189912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fe8180b4440 con 0x7fe8180ce090 2024-09-11T23:24:14.765 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:24:14.770 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:24:15.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.002+0000 7fe815600640 1 -- 172.21.15.144:0/1614189912 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v82) ==== 136+0+0 (secure 0 0 0) 0x7fe808059640 con 0x7fe8180ce090 2024-09-11T23:24:15.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.005+0000 7fe81e200640 1 -- 172.21.15.144:0/1614189912 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe7f406c220 msgr2=0x7fe7f406e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:15.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.005+0000 7fe81e200640 1 --2- 172.21.15.144:0/1614189912 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe7f406c220 0x7fe7f406e6e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe800034000 tx=0x7fe80002e000 comp rx=0 tx=0).stop 2024-09-11T23:24:15.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.005+0000 7fe81e200640 1 -- 172.21.15.144:0/1614189912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8180ce090 msgr2=0x7fe8180ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:15.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.005+0000 7fe81e200640 1 --2- 172.21.15.144:0/1614189912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8180ce090 0x7fe8180ae8e0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fe80800e9b0 tx=0x7fe80800ee70 comp rx=0 tx=0).stop 2024-09-11T23:24:15.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.005+0000 7fe81e200640 1 -- 172.21.15.144:0/1614189912 shutdown_connections 2024-09-11T23:24:15.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.005+0000 7fe81e200640 1 --2- 172.21.15.144:0/1614189912 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe7f406c220 0x7fe7f406e6e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:15.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.005+0000 7fe81e200640 1 --2- 172.21.15.144:0/1614189912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe81815ed60 0x7fe8180c5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:15.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.005+0000 7fe81e200640 1 --2- 172.21.15.144:0/1614189912 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe81815b1d0 0x7fe8180c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:15.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.005+0000 7fe81e200640 1 --2- 172.21.15.144:0/1614189912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8180ce090 0x7fe8180ae8e0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:15.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.005+0000 7fe81e200640 1 -- 172.21.15.144:0/1614189912 >> 172.21.15.144:0/1614189912 conn(0x7fe81806bba0 msgr2=0x7fe8180b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:15.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.005+0000 7fe81e200640 1 -- 172.21.15.144:0/1614189912 shutdown_connections 2024-09-11T23:24:15.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.005+0000 7fe81e200640 1 -- 172.21.15.144:0/1614189912 wait complete. 2024-09-11T23:24:15.021 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-11T23:24:15.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.176+0000 7f9530c00640 1 Processor -- start 2024-09-11T23:24:15.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.177+0000 7f9530c00640 1 -- start start 2024-09-11T23:24:15.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.178+0000 7f9530c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f952c0d02a0 0x7f952c0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:15.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.178+0000 7f9530c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f952c0d0bc0 con 0x7f952c15ceb0 2024-09-11T23:24:15.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.178+0000 7f9530c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f952c15d390 con 0x7f952c15ca40 2024-09-11T23:24:15.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.178+0000 7f9530c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f952c15d670 con 0x7f952c0d02a0 2024-09-11T23:24:15.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.178+0000 7f9529e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f952c0d02a0 0x7f952c0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:15.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.178+0000 7f9529e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f952c0d02a0 0x7f952c0d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41918/0 (socket says 172.21.15.144:41918) 2024-09-11T23:24:15.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.178+0000 7f9529e00640 1 -- 172.21.15.144:0/1047316009 learned_addr learned my addr 172.21.15.144:0/1047316009 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:15.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.179+0000 7f9529e00640 1 -- 172.21.15.144:0/1047316009 >> v1:172.21.15.165:6789/0 conn(0x7f952c15ca40 legacy=0x7f952c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:15.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.179+0000 7f9529e00640 1 -- 172.21.15.144:0/1047316009 >> v1:172.21.15.144:6789/0 conn(0x7f952c15ceb0 legacy=0x7f952c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:15.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.179+0000 7f9529400640 1 -- 172.21.15.144:0/1047316009 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 812002708 0 0) 0x7f952c0d0bc0 con 0x7f952c15ceb0 2024-09-11T23:24:15.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.179+0000 7f9529e00640 1 -- 172.21.15.144:0/1047316009 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952c15d950 con 0x7f952c0d02a0 2024-09-11T23:24:15.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.180+0000 7f9529e00640 1 --2- 172.21.15.144:0/1047316009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c0d02a0 0x7f952c0d0680 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f951c009870 tx=0x7f951c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c2d62dd1f150d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:15.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.180+0000 7f9529400640 1 -- 172.21.15.144:0/1047316009 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c037070 con 0x7f952c0d02a0 2024-09-11T23:24:15.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.180+0000 7f9529400640 1 -- 172.21.15.144:0/1047316009 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f951c032440 con 0x7f952c0d02a0 2024-09-11T23:24:15.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.180+0000 7f9529400640 1 -- 172.21.15.144:0/1047316009 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c032810 con 0x7f952c0d02a0 2024-09-11T23:24:15.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.180+0000 7f9530c00640 1 -- 172.21.15.144:0/1047316009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c0d02a0 msgr2=0x7f952c0d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:15.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.181+0000 7f9530c00640 1 --2- 172.21.15.144:0/1047316009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c0d02a0 0x7f952c0d0680 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f951c009870 tx=0x7f951c02a270 comp rx=0 tx=0).stop 2024-09-11T23:24:15.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.181+0000 7f9530c00640 1 -- 172.21.15.144:0/1047316009 shutdown_connections 2024-09-11T23:24:15.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.181+0000 7f9530c00640 1 --2- 172.21.15.144:0/1047316009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c0d02a0 0x7f952c0d0680 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:15.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.181+0000 7f9530c00640 1 -- 172.21.15.144:0/1047316009 >> 172.21.15.144:0/1047316009 conn(0x7f952c062cc0 msgr2=0x7f952c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:15.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.181+0000 7f9530c00640 1 -- 172.21.15.144:0/1047316009 shutdown_connections 2024-09-11T23:24:15.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.181+0000 7f9530c00640 1 -- 172.21.15.144:0/1047316009 wait complete. 2024-09-11T23:24:15.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.182+0000 7f9530c00640 1 Processor -- start 2024-09-11T23:24:15.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.182+0000 7f9530c00640 1 -- start start 2024-09-11T23:24:15.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.183+0000 7f9530c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c0d02a0 0x7f952c0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:15.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.183+0000 7f9530c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f952c15ca40 0x7f952c14c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:15.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.183+0000 7f9530c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f952c15ceb0 0x7f952c1e7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:15.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.183+0000 7f9530c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f952c15eb40 con 0x7f952c0d02a0 2024-09-11T23:24:15.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.183+0000 7f9530c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f952c15df10 con 0x7f952c15ceb0 2024-09-11T23:24:15.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.183+0000 7f9530c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f952c155b90 con 0x7f952c15ca40 2024-09-11T23:24:15.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.183+0000 7f9529e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c0d02a0 0x7f952c0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:15.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.183+0000 7f9529e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c0d02a0 0x7f952c0cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41930/0 (socket says 172.21.15.144:41930) 2024-09-11T23:24:15.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.184+0000 7f9529e00640 1 -- 172.21.15.144:0/759623457 learned_addr learned my addr 172.21.15.144:0/759623457 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:15.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.184+0000 7f9521400640 1 --2- 172.21.15.144:0/759623457 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f952c15ca40 0x7f952c14c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:15.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.184+0000 7f952a800640 1 --2- 172.21.15.144:0/759623457 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f952c15ceb0 0x7f952c1e7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:15.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.184+0000 7f9529e00640 1 -- 172.21.15.144:0/759623457 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f952c15ca40 msgr2=0x7f952c14c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:15.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.184+0000 7f9529e00640 1 --2- 172.21.15.144:0/759623457 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f952c15ca40 0x7f952c14c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:15.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.184+0000 7f9529e00640 1 -- 172.21.15.144:0/759623457 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f952c15ceb0 msgr2=0x7f952c1e7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:15.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.184+0000 7f9529e00640 1 --2- 172.21.15.144:0/759623457 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f952c15ceb0 0x7f952c1e7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:15.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.184+0000 7f9529e00640 1 -- 172.21.15.144:0/759623457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952c0ce720 con 0x7f952c0d02a0 2024-09-11T23:24:15.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.184+0000 7f9529e00640 1 --2- 172.21.15.144:0/759623457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c0d02a0 0x7f952c0cde80 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f951c009870 tx=0x7f951c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:15.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.184+0000 7f9522a00640 1 -- 172.21.15.144:0/759623457 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c041020 con 0x7f952c0d02a0 2024-09-11T23:24:15.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.184+0000 7f9522a00640 1 -- 172.21.15.144:0/759623457 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f951c030970 con 0x7f952c0d02a0 2024-09-11T23:24:15.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.184+0000 7f9522a00640 1 -- 172.21.15.144:0/759623457 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c037040 con 0x7f952c0d02a0 2024-09-11T23:24:15.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.185+0000 7f9530c00640 1 -- 172.21.15.144:0/759623457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952c1580b0 con 0x7f952c0d02a0 2024-09-11T23:24:15.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.185+0000 7f9530c00640 1 -- 172.21.15.144:0/759623457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f952c158670 con 0x7f952c0d02a0 2024-09-11T23:24:15.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.186+0000 7f9530c00640 1 -- 172.21.15.144:0/759623457 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f952c0b4790 con 0x7f952c0d02a0 2024-09-11T23:24:15.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.187+0000 7f9522a00640 1 -- 172.21.15.144:0/759623457 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f951c044020 con 0x7f952c0d02a0 2024-09-11T23:24:15.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.187+0000 7f9522a00640 1 --2- 172.21.15.144:0/759623457 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f950806c220 0x7f950806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:15.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.187+0000 7f9522a00640 1 -- 172.21.15.144:0/759623457 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f951c0abd60 con 0x7f952c0d02a0 2024-09-11T23:24:15.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.188+0000 7f9521400640 1 --2- 172.21.15.144:0/759623457 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f950806c220 0x7f950806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:15.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.188+0000 7f9521400640 1 --2- 172.21.15.144:0/759623457 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f950806c220 0x7f950806e6e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f952c154ce0 tx=0x7f9514009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:15.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.191+0000 7f9522a00640 1 -- 172.21.15.144:0/759623457 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f951c04b030 con 0x7f952c0d02a0 2024-09-11T23:24:15.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.387+0000 7f9530c00640 1 -- 172.21.15.144:0/759623457 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f952c0b54a0 con 0x7f950806c220 2024-09-11T23:24:15.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.389+0000 7f9522a00640 1 -- 172.21.15.144:0/759623457 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f952c0b54a0 con 0x7f950806c220 2024-09-11T23:24:15.389 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:24:15.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:15.389 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephfs" 2024-09-11T23:24:15.389 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:15.390 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:24:15.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.391+0000 7f9530c00640 1 -- 172.21.15.144:0/759623457 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f950806c220 msgr2=0x7f950806e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:15.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.391+0000 7f9530c00640 1 --2- 172.21.15.144:0/759623457 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f950806c220 0x7f950806e6e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f952c154ce0 tx=0x7f9514009040 comp rx=0 tx=0).stop 2024-09-11T23:24:15.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.391+0000 7f9530c00640 1 -- 172.21.15.144:0/759623457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c0d02a0 msgr2=0x7f952c0cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:15.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.391+0000 7f9530c00640 1 --2- 172.21.15.144:0/759623457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c0d02a0 0x7f952c0cde80 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f951c009870 tx=0x7f951c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:15.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.391+0000 7f9530c00640 1 -- 172.21.15.144:0/759623457 shutdown_connections 2024-09-11T23:24:15.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.391+0000 7f9530c00640 1 --2- 172.21.15.144:0/759623457 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f950806c220 0x7f950806e6e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:15.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.391+0000 7f9530c00640 1 --2- 172.21.15.144:0/759623457 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f952c15ceb0 0x7f952c1e7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:15.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.391+0000 7f9530c00640 1 --2- 172.21.15.144:0/759623457 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f952c15ca40 0x7f952c14c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:15.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.391+0000 7f9530c00640 1 --2- 172.21.15.144:0/759623457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f952c0d02a0 0x7f952c0cde80 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:15.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.392+0000 7f9530c00640 1 -- 172.21.15.144:0/759623457 >> 172.21.15.144:0/759623457 conn(0x7f952c062cc0 msgr2=0x7f952c15e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:15.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.392+0000 7f9530c00640 1 -- 172.21.15.144:0/759623457 shutdown_connections 2024-09-11T23:24:15.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.392+0000 7f9530c00640 1 -- 172.21.15.144:0/759623457 wait complete. 2024-09-11T23:24:15.409 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:24:15.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.566+0000 7f7354a00640 1 Processor -- start 2024-09-11T23:24:15.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.566+0000 7f7354a00640 1 -- start start 2024-09-11T23:24:15.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.567+0000 7f7354a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f735015e390 0x7f735006c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:15.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.567+0000 7f7354a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73500ced30 con 0x7f73500d2530 2024-09-11T23:24:15.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.567+0000 7f7354a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73500cf010 con 0x7f73500b5f50 2024-09-11T23:24:15.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.567+0000 7f7354a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f73500d20a0 con 0x7f735015e390 2024-09-11T23:24:15.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.567+0000 7f734fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f73500d2530 0x7f73500d29e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51594/0 (socket says 172.21.15.144:51594) 2024-09-11T23:24:15.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.567+0000 7f734fe00640 1 -- 172.21.15.144:0/3361448719 learned_addr learned my addr 172.21.15.144:0/3361448719 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:15.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.568+0000 7f734f400640 1 --2- 172.21.15.144:0/3361448719 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f735015e390 0x7f735006c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:15.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.568+0000 7f734e000640 1 -- 172.21.15.144:0/3361448719 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2517883651 0 0) 0x7f73500ced30 con 0x7f73500d2530 2024-09-11T23:24:15.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.568+0000 7f734e000640 1 -- 172.21.15.144:0/3361448719 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7334003520 con 0x7f73500d2530 2024-09-11T23:24:15.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.568+0000 7f734e000640 1 -- 172.21.15.144:0/3361448719 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 475713750 0 0) 0x7f73500cf010 con 0x7f73500b5f50 2024-09-11T23:24:15.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.568+0000 7f734e000640 1 -- 172.21.15.144:0/3361448719 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73500ced30 con 0x7f73500b5f50 2024-09-11T23:24:15.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.568+0000 7f734f400640 1 -- 172.21.15.144:0/3361448719 >> v1:172.21.15.165:6789/0 conn(0x7f73500b5f50 legacy=0x7f73500b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:15.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.568+0000 7f734f400640 1 -- 172.21.15.144:0/3361448719 >> v1:172.21.15.144:6789/0 conn(0x7f73500d2530 legacy=0x7f73500d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:15.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.568+0000 7f734f400640 1 -- 172.21.15.144:0/3361448719 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73500cf2f0 con 0x7f735015e390 2024-09-11T23:24:15.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.569+0000 7f734f400640 1 --2- 172.21.15.144:0/3361448719 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f735015e390 0x7f735006c8e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f73500d2220 tx=0x7f734002a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61a74b0b55c3fe97 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:15.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.569+0000 7f734e000640 1 -- 172.21.15.144:0/3361448719 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7340037070 con 0x7f735015e390 2024-09-11T23:24:15.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.569+0000 7f734e000640 1 -- 172.21.15.144:0/3361448719 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7340032440 con 0x7f735015e390 2024-09-11T23:24:15.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.569+0000 7f734e000640 1 -- 172.21.15.144:0/3361448719 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73400327f0 con 0x7f735015e390 2024-09-11T23:24:15.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.570+0000 7f7354a00640 1 -- 172.21.15.144:0/3361448719 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f735015e390 msgr2=0x7f735006c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:15.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.570+0000 7f7354a00640 1 --2- 172.21.15.144:0/3361448719 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f735015e390 0x7f735006c8e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f73500d2220 tx=0x7f734002a230 comp rx=0 tx=0).stop 2024-09-11T23:24:15.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.570+0000 7f7354a00640 1 -- 172.21.15.144:0/3361448719 shutdown_connections 2024-09-11T23:24:15.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.570+0000 7f7354a00640 1 --2- 172.21.15.144:0/3361448719 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f735015e390 0x7f735006c8e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:15.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.570+0000 7f7354a00640 1 -- 172.21.15.144:0/3361448719 >> 172.21.15.144:0/3361448719 conn(0x7f73500d1130 msgr2=0x7f73500d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:15.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.570+0000 7f7354a00640 1 -- 172.21.15.144:0/3361448719 shutdown_connections 2024-09-11T23:24:15.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.570+0000 7f7354a00640 1 -- 172.21.15.144:0/3361448719 wait complete. 2024-09-11T23:24:15.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.572+0000 7f7354a00640 1 Processor -- start 2024-09-11T23:24:15.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.572+0000 7f7354a00640 1 -- start start 2024-09-11T23:24:15.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.572+0000 7f7354a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73500b5f50 0x7f735015ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:15.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.573+0000 7f7354a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73500d2530 0x7f73501ea0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:15.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.573+0000 7f7354a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f735015e390 0x7f7350150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:15.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.573+0000 7f7354a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f735015e770 con 0x7f73500b5f50 2024-09-11T23:24:15.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.573+0000 7f7354a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f73500cf8b0 con 0x7f73500d2530 2024-09-11T23:24:15.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.573+0000 7f7354a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f735015e8f0 con 0x7f735015e390 2024-09-11T23:24:15.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.573+0000 7f734f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73500b5f50 0x7f735015ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:15.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.573+0000 7f734f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73500b5f50 0x7f735015ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41934/0 (socket says 172.21.15.144:41934) 2024-09-11T23:24:15.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.573+0000 7f734f400640 1 -- 172.21.15.144:0/1550166555 learned_addr learned my addr 172.21.15.144:0/1550166555 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:15.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.573+0000 7f734fe00640 1 --2- 172.21.15.144:0/1550166555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f735015e390 0x7f7350150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:15.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.573+0000 7f734ea00640 1 --2- 172.21.15.144:0/1550166555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73500d2530 0x7f73501ea0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:15.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.573+0000 7f734f400640 1 -- 172.21.15.144:0/1550166555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f735015e390 msgr2=0x7f7350150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:15.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.573+0000 7f734f400640 1 --2- 172.21.15.144:0/1550166555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f735015e390 0x7f7350150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:15.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.573+0000 7f734f400640 1 -- 172.21.15.144:0/1550166555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73500d2530 msgr2=0x7f73501ea0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:15.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.573+0000 7f734f400640 1 --2- 172.21.15.144:0/1550166555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73500d2530 0x7f73501ea0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.573+0000 7f734f400640 1 -- 172.21.15.144:0/1550166555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f735015b470 con 0x7f73500b5f50 2024-09-11T23:24:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.573+0000 7f734fe00640 1 --2- 172.21.15.144:0/1550166555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f735015e390 0x7f7350150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.573+0000 7f734ea00640 1 --2- 172.21.15.144:0/1550166555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73500d2530 0x7f73501ea0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.574+0000 7f734f400640 1 --2- 172.21.15.144:0/1550166555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73500b5f50 0x7f735015ad70 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f734002a270 tx=0x7f73400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.574+0000 7f7347400640 1 -- 172.21.15.144:0/1550166555 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7340037040 con 0x7f73500b5f50 2024-09-11T23:24:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.574+0000 7f7347400640 1 -- 172.21.15.144:0/1550166555 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7340042070 con 0x7f73500b5f50 2024-09-11T23:24:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.574+0000 7f7354a00640 1 -- 172.21.15.144:0/1550166555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f735015b750 con 0x7f73500b5f50 2024-09-11T23:24:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.574+0000 7f7347400640 1 -- 172.21.15.144:0/1550166555 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7340032830 con 0x7f73500b5f50 2024-09-11T23:24:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.574+0000 7f7354a00640 1 -- 172.21.15.144:0/1550166555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73500b3da0 con 0x7f73500b5f50 2024-09-11T23:24:15.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.575+0000 7f7354a00640 1 -- 172.21.15.144:0/1550166555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73500b6370 con 0x7f73500b5f50 2024-09-11T23:24:15.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.576+0000 7f7347400640 1 -- 172.21.15.144:0/1550166555 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f73400329d0 con 0x7f73500b5f50 2024-09-11T23:24:15.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.577+0000 7f7347400640 1 --2- 172.21.15.144:0/1550166555 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f733006c220 0x7f733006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:15.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.577+0000 7f7347400640 1 -- 172.21.15.144:0/1550166555 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f73400abe10 con 0x7f73500b5f50 2024-09-11T23:24:15.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.577+0000 7f734ea00640 1 --2- 172.21.15.144:0/1550166555 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f733006c220 0x7f733006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:15.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.578+0000 7f734ea00640 1 --2- 172.21.15.144:0/1550166555 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f733006c220 0x7f733006e6e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f73501f7a40 tx=0x7f733c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:15.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.581+0000 7f7347400640 1 -- 172.21.15.144:0/1550166555 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f734007a3d0 con 0x7f73500b5f50 2024-09-11T23:24:15.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.760+0000 7f7354a00640 1 -- 172.21.15.144:0/1550166555 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f73500c7da0 con 0x7f73500b5f50 2024-09-11T23:24:15.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.760+0000 7f7347400640 1 -- 172.21.15.144:0/1550166555 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7f7340079cd0 con 0x7f73500b5f50 2024-09-11T23:24:15.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.762+0000 7f7354a00640 1 -- 172.21.15.144:0/1550166555 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f733006c220 msgr2=0x7f733006e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:15.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.762+0000 7f7354a00640 1 --2- 172.21.15.144:0/1550166555 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f733006c220 0x7f733006e6e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f73501f7a40 tx=0x7f733c009040 comp rx=0 tx=0).stop 2024-09-11T23:24:15.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.762+0000 7f7354a00640 1 -- 172.21.15.144:0/1550166555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73500b5f50 msgr2=0x7f735015ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:15.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.762+0000 7f7354a00640 1 --2- 172.21.15.144:0/1550166555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73500b5f50 0x7f735015ad70 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f734002a270 tx=0x7f73400046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:15.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.762+0000 7f7354a00640 1 -- 172.21.15.144:0/1550166555 shutdown_connections 2024-09-11T23:24:15.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.762+0000 7f7354a00640 1 --2- 172.21.15.144:0/1550166555 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f733006c220 0x7f733006e6e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:15.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.762+0000 7f7354a00640 1 --2- 172.21.15.144:0/1550166555 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f735015e390 0x7f7350150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:15.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.762+0000 7f7354a00640 1 --2- 172.21.15.144:0/1550166555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73500d2530 0x7f73501ea0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:15.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.762+0000 7f7354a00640 1 --2- 172.21.15.144:0/1550166555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73500b5f50 0x7f735015ad70 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:15.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.762+0000 7f7354a00640 1 -- 172.21.15.144:0/1550166555 >> 172.21.15.144:0/1550166555 conn(0x7f73500d1130 msgr2=0x7f73500d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:15.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.762+0000 7f7354a00640 1 -- 172.21.15.144:0/1550166555 shutdown_connections 2024-09-11T23:24:15.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:15.762+0000 7f7354a00640 1 -- 172.21.15.144:0/1550166555 wait complete. 2024-09-11T23:24:15.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:15.778 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol33240/4f1b3f3d-1f37-40f6-ba3f-b65d7cea04c5) 2024-09-11T23:24:15.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:15.843 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol33240/4f1b3f3d-1f37-40f6-ba3f-b65d7cea04c5/.snap/fake) 2024-09-11T23:24:15.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:15.929 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-11T23:24:15.965 INFO:teuthology.orchestra.run.smithi144.stdout:cephfs_data 2024-09-11T23:24:15.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:15.966 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol33240/4f1b3f3d-1f37-40f6-ba3f-b65d7cea04c5) 2024-09-11T23:24:16.069 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:24:16.069 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol33240/.meta 2024-09-11T23:24:16.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:16.130 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/subvol_grp65310/subvol35011/919e1733-d47c-49ba-8cf3-6ca1d18d24fb) 2024-09-11T23:24:16.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:16.230 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/subvol_grp65310/subvol35011/919e1733-d47c-49ba-8cf3-6ca1d18d24fb/.snap/fake) 2024-09-11T23:24:16.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:16.316 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-11T23:24:16.352 INFO:teuthology.orchestra.run.smithi144.stdout:cephfs_data 2024-09-11T23:24:16.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:16.353 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/subvol_grp65310/subvol35011/919e1733-d47c-49ba-8cf3-6ca1d18d24fb) 2024-09-11T23:24:16.453 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:24:16.453 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/subvol_grp65310/subvol35011/.meta 2024-09-11T23:24:16.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:16.510 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol33612/8b713714-56b2-4efc-8311-ae142d179c3c) 2024-09-11T23:24:16.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:16.608 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-11T23:24:16.644 INFO:teuthology.orchestra.run.smithi144.stdout:cephfs_data 2024-09-11T23:24:16.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:16.644 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol33612/8b713714-56b2-4efc-8311-ae142d179c3c) 2024-09-11T23:24:16.746 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:24:16.746 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol33612/.meta 2024-09-11T23:24:16.803 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol33240 2024-09-11T23:24:16.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:16.999+0000 7fe41e200640 1 Processor -- start 2024-09-11T23:24:16.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:16.999+0000 7fe41e200640 1 -- start start 2024-09-11T23:24:17.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.000+0000 7fe41e200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe41815d790 0x7fe4180cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:17.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.000+0000 7fe41e200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4180cd3b0 0x7fe4180cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:17.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.000+0000 7fe41e200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe41806d700 con 0x7fe41815d3b0 2024-09-11T23:24:17.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.000+0000 7fe41e200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe41806da30 con 0x7fe41815d790 2024-09-11T23:24:17.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.000+0000 7fe41e200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe4180cde80 con 0x7fe4180cd3b0 2024-09-11T23:24:17.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.001+0000 7fe416a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe41815d790 0x7fe4180cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:17.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.001+0000 7fe416a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe41815d790 0x7fe4180cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41946/0 (socket says 172.21.15.144:41946) 2024-09-11T23:24:17.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.001+0000 7fe416a00640 1 -- 172.21.15.144:0/1016284691 learned_addr learned my addr 172.21.15.144:0/1016284691 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:17.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.001+0000 7fe417e00640 1 --2- 172.21.15.144:0/1016284691 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4180cd3b0 0x7fe4180cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:17.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.001+0000 7fe416a00640 1 -- 172.21.15.144:0/1016284691 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4180cd3b0 msgr2=0x7fe4180cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:17.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.001+0000 7fe416a00640 1 --2- 172.21.15.144:0/1016284691 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4180cd3b0 0x7fe4180cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.001+0000 7fe416a00640 1 -- 172.21.15.144:0/1016284691 >> v1:172.21.15.165:6789/0 conn(0x7fe41815d3b0 legacy=0x7fe418071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:17.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.001+0000 7fe416a00640 1 -- 172.21.15.144:0/1016284691 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4180cd8c0 con 0x7fe41815d790 2024-09-11T23:24:17.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.002+0000 7fe416a00640 1 --2- 172.21.15.144:0/1016284691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe41815d790 0x7fe4180cce70 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fe41806dbb0 tx=0x7fe40402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11cd338aa6b11972 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:17.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.002+0000 7fe416000640 1 -- 172.21.15.144:0/1016284691 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe404004030 con 0x7fe41815d790 2024-09-11T23:24:17.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.002+0000 7fe416000640 1 -- 172.21.15.144:0/1016284691 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4040041d0 con 0x7fe41815d790 2024-09-11T23:24:17.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.002+0000 7fe416000640 1 -- 172.21.15.144:0/1016284691 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe404003610 con 0x7fe41815d790 2024-09-11T23:24:17.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.003+0000 7fe41e200640 1 -- 172.21.15.144:0/1016284691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe41815d790 msgr2=0x7fe4180cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:17.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.003+0000 7fe41e200640 1 --2- 172.21.15.144:0/1016284691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe41815d790 0x7fe4180cce70 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fe41806dbb0 tx=0x7fe40402a230 comp rx=0 tx=0).stop 2024-09-11T23:24:17.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.003+0000 7fe41e200640 1 -- 172.21.15.144:0/1016284691 shutdown_connections 2024-09-11T23:24:17.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.003+0000 7fe41e200640 1 --2- 172.21.15.144:0/1016284691 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4180cd3b0 0x7fe4180cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.003+0000 7fe41e200640 1 --2- 172.21.15.144:0/1016284691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe41815d790 0x7fe4180cce70 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.003+0000 7fe41e200640 1 -- 172.21.15.144:0/1016284691 >> 172.21.15.144:0/1016284691 conn(0x7fe41806bba0 msgr2=0x7fe41806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:17.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.003+0000 7fe41e200640 1 -- 172.21.15.144:0/1016284691 shutdown_connections 2024-09-11T23:24:17.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.003+0000 7fe41e200640 1 -- 172.21.15.144:0/1016284691 wait complete. 2024-09-11T23:24:17.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.005+0000 7fe41e200640 1 Processor -- start 2024-09-11T23:24:17.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.005+0000 7fe41e200640 1 -- start start 2024-09-11T23:24:17.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.006+0000 7fe41e200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4180cd3b0 0x7fe418152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:17.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.006+0000 7fe41e200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe41815d3b0 0x7fe4181e74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:17.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.006+0000 7fe41e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4181e79f0 0x7fe418153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:17.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.006+0000 7fe41e200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe41815cd70 con 0x7fe4181e79f0 2024-09-11T23:24:17.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.006+0000 7fe41e200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe41815cbf0 con 0x7fe41815d3b0 2024-09-11T23:24:17.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.006+0000 7fe41e200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe4180cf860 con 0x7fe4180cd3b0 2024-09-11T23:24:17.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.006+0000 7fe417e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4181e79f0 0x7fe418153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:17.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.006+0000 7fe417e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4181e79f0 0x7fe418153d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41954/0 (socket says 172.21.15.144:41954) 2024-09-11T23:24:17.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.006+0000 7fe417e00640 1 -- 172.21.15.144:0/1780009604 learned_addr learned my addr 172.21.15.144:0/1780009604 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:17.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.006+0000 7fe417400640 1 --2- 172.21.15.144:0/1780009604 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4180cd3b0 0x7fe418152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:17.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.006+0000 7fe416a00640 1 --2- 172.21.15.144:0/1780009604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe41815d3b0 0x7fe4181e74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:17.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.006+0000 7fe417e00640 1 -- 172.21.15.144:0/1780009604 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4180cd3b0 msgr2=0x7fe418152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:17.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.006+0000 7fe417e00640 1 --2- 172.21.15.144:0/1780009604 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4180cd3b0 0x7fe418152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.006+0000 7fe417e00640 1 -- 172.21.15.144:0/1780009604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe41815d3b0 msgr2=0x7fe4181e74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:17.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.006+0000 7fe417e00640 1 --2- 172.21.15.144:0/1780009604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe41815d3b0 0x7fe4181e74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.006+0000 7fe417e00640 1 -- 172.21.15.144:0/1780009604 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe418154af0 con 0x7fe4181e79f0 2024-09-11T23:24:17.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.007+0000 7fe417e00640 1 --2- 172.21.15.144:0/1780009604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4181e79f0 0x7fe418153d00 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fe410007e40 tx=0x7fe41000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.007+0000 7fe40f400640 1 -- 172.21.15.144:0/1780009604 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe410014620 con 0x7fe4181e79f0 2024-09-11T23:24:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.007+0000 7fe40f400640 1 -- 172.21.15.144:0/1780009604 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe410019070 con 0x7fe4181e79f0 2024-09-11T23:24:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.007+0000 7fe41e200640 1 -- 172.21.15.144:0/1780009604 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe418154dd0 con 0x7fe4181e79f0 2024-09-11T23:24:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.007+0000 7fe40f400640 1 -- 172.21.15.144:0/1780009604 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe410014a20 con 0x7fe4181e79f0 2024-09-11T23:24:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.007+0000 7fe41e200640 1 -- 172.21.15.144:0/1780009604 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe418155390 con 0x7fe4181e79f0 2024-09-11T23:24:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.008+0000 7fe41e200640 1 -- 172.21.15.144:0/1780009604 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4180cfc40 con 0x7fe4181e79f0 2024-09-11T23:24:17.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.009+0000 7fe40f400640 1 -- 172.21.15.144:0/1780009604 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7fe410014bc0 con 0x7fe4181e79f0 2024-09-11T23:24:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.010+0000 7fe40f400640 1 --2- 172.21.15.144:0/1780009604 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe3f806c220 0x7fe3f806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.010+0000 7fe40f400640 1 -- 172.21.15.144:0/1780009604 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5767+0+0 (secure 0 0 0) 0x7fe41008bd90 con 0x7fe4181e79f0 2024-09-11T23:24:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.010+0000 7fe417400640 1 --2- 172.21.15.144:0/1780009604 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe3f806c220 0x7fe3f806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:17.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.011+0000 7fe417400640 1 --2- 172.21.15.144:0/1780009604 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe3f806c220 0x7fe3f806e6e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe408001780 tx=0x7fe408009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:17.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.014+0000 7fe40f400640 1 -- 172.21.15.144:0/1780009604 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe410059b60 con 0x7fe4181e79f0 2024-09-11T23:24:17.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.219+0000 7fe41e200640 1 -- 172.21.15.144:0/1780009604 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol33240", "target": ["mon-mgr", ""]}) -- 0x7fe4180af540 con 0x7fe3f806c220 2024-09-11T23:24:17.227 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:17.227+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:24:17.227 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:17.227+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:24:17.227 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:17.227+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:24:17.227 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:17.227+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:24:17.228 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:17.227+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:24:17.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.271+0000 7fe40f400640 1 -- 172.21.15.144:0/1780009604 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7fe4180af540 con 0x7fe3f806c220 2024-09-11T23:24:17.271 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/_nogroup/subvol33240/4f1b3f3d-1f37-40f6-ba3f-b65d7cea04c5 2024-09-11T23:24:17.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.273+0000 7fe41e200640 1 -- 172.21.15.144:0/1780009604 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe3f806c220 msgr2=0x7fe3f806e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:17.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.273+0000 7fe41e200640 1 --2- 172.21.15.144:0/1780009604 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe3f806c220 0x7fe3f806e6e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe408001780 tx=0x7fe408009040 comp rx=0 tx=0).stop 2024-09-11T23:24:17.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.273+0000 7fe41e200640 1 -- 172.21.15.144:0/1780009604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4181e79f0 msgr2=0x7fe418153d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:17.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.273+0000 7fe41e200640 1 --2- 172.21.15.144:0/1780009604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4181e79f0 0x7fe418153d00 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fe410007e40 tx=0x7fe41000e4b0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.274+0000 7fe41e200640 1 -- 172.21.15.144:0/1780009604 shutdown_connections 2024-09-11T23:24:17.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.274+0000 7fe41e200640 1 --2- 172.21.15.144:0/1780009604 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe3f806c220 0x7fe3f806e6e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.274+0000 7fe41e200640 1 --2- 172.21.15.144:0/1780009604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4181e79f0 0x7fe418153d00 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.274+0000 7fe41e200640 1 --2- 172.21.15.144:0/1780009604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe41815d3b0 0x7fe4181e74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.274+0000 7fe41e200640 1 --2- 172.21.15.144:0/1780009604 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4180cd3b0 0x7fe418152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.274+0000 7fe41e200640 1 -- 172.21.15.144:0/1780009604 >> 172.21.15.144:0/1780009604 conn(0x7fe41806bba0 msgr2=0x7fe4180ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:17.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.274+0000 7fe41e200640 1 -- 172.21.15.144:0/1780009604 shutdown_connections 2024-09-11T23:24:17.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.274+0000 7fe41e200640 1 -- 172.21.15.144:0/1780009604 wait complete. 2024-09-11T23:24:17.289 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol35011 subvol_grp65310 2024-09-11T23:24:17.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.447+0000 7f426d800640 1 Processor -- start 2024-09-11T23:24:17.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.448+0000 7f426d800640 1 -- start start 2024-09-11T23:24:17.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.449+0000 7f426d800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f42680cf5d0 0x7f42680cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:17.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.449+0000 7f426d800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42680b4240 con 0x7f426806d4f0 2024-09-11T23:24:17.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.449+0000 7f426d800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42680b4520 con 0x7f4268145d90 2024-09-11T23:24:17.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.449+0000 7f426d800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f426806d080 con 0x7f42680cf5d0 2024-09-11T23:24:17.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.449+0000 7f4266000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f42680cf5d0 0x7f42680cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:17.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.449+0000 7f4267400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f426806d4f0 0x7f426806d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51606/0 (socket says 172.21.15.144:51606) 2024-09-11T23:24:17.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.449+0000 7f4267400640 1 -- 172.21.15.144:0/1955756680 learned_addr learned my addr 172.21.15.144:0/1955756680 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:17.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.450+0000 7f4266000640 1 -- 172.21.15.144:0/1955756680 >> v1:172.21.15.165:6789/0 conn(0x7f4268145d90 legacy=0x7f42680ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:17.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.450+0000 7f4266000640 1 -- 172.21.15.144:0/1955756680 >> v1:172.21.15.144:6789/0 conn(0x7f426806d4f0 legacy=0x7f426806d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:17.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.450+0000 7f4265600640 1 -- 172.21.15.144:0/1955756680 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2278872761 0 0) 0x7f42680b4240 con 0x7f426806d4f0 2024-09-11T23:24:17.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.450+0000 7f4266000640 1 -- 172.21.15.144:0/1955756680 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42680b4800 con 0x7f42680cf5d0 2024-09-11T23:24:17.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.451+0000 7f4266000640 1 --2- 172.21.15.144:0/1955756680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42680cf5d0 0x7f42680cfa40 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f42540097a0 tx=0x7f425402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c787d0d12d20ac92 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:17.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.451+0000 7f4265600640 1 -- 172.21.15.144:0/1955756680 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4254037070 con 0x7f42680cf5d0 2024-09-11T23:24:17.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.451+0000 7f4265600640 1 -- 172.21.15.144:0/1955756680 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4254032440 con 0x7f42680cf5d0 2024-09-11T23:24:17.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.451+0000 7f4265600640 1 -- 172.21.15.144:0/1955756680 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4254032810 con 0x7f42680cf5d0 2024-09-11T23:24:17.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.451+0000 7f426d800640 1 -- 172.21.15.144:0/1955756680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42680cf5d0 msgr2=0x7f42680cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:17.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.451+0000 7f426d800640 1 --2- 172.21.15.144:0/1955756680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42680cf5d0 0x7f42680cfa40 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f42540097a0 tx=0x7f425402a1e0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.451+0000 7f426d800640 1 -- 172.21.15.144:0/1955756680 shutdown_connections 2024-09-11T23:24:17.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.451+0000 7f426d800640 1 --2- 172.21.15.144:0/1955756680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42680cf5d0 0x7f42680cfa40 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.451+0000 7f426d800640 1 -- 172.21.15.144:0/1955756680 >> 172.21.15.144:0/1955756680 conn(0x7f426806bba0 msgr2=0x7f426806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:17.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.452+0000 7f426d800640 1 -- 172.21.15.144:0/1955756680 shutdown_connections 2024-09-11T23:24:17.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.452+0000 7f426d800640 1 -- 172.21.15.144:0/1955756680 wait complete. 2024-09-11T23:24:17.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.453+0000 7f426d800640 1 Processor -- start 2024-09-11T23:24:17.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.453+0000 7f426d800640 1 -- start start 2024-09-11T23:24:17.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.454+0000 7f426d800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f426806d4f0 0x7f426813fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:17.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.454+0000 7f426d800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42680cf5d0 0x7f426815f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:17.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.454+0000 7f426d800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4268145d90 0x7f4268160140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:17.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.454+0000 7f426d800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f42680cd660 con 0x7f42680cf5d0 2024-09-11T23:24:17.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.454+0000 7f426d800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f42680cff80 con 0x7f4268145d90 2024-09-11T23:24:17.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.454+0000 7f426d800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f42680b5610 con 0x7f426806d4f0 2024-09-11T23:24:17.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.454+0000 7f4266000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42680cf5d0 0x7f426815f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:17.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.454+0000 7f4266000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42680cf5d0 0x7f426815f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41980/0 (socket says 172.21.15.144:41980) 2024-09-11T23:24:17.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.454+0000 7f4266000640 1 -- 172.21.15.144:0/2227480085 learned_addr learned my addr 172.21.15.144:0/2227480085 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:17.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.455+0000 7f4267400640 1 --2- 172.21.15.144:0/2227480085 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4268145d90 0x7f4268160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:17.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.455+0000 7f4266a00640 1 --2- 172.21.15.144:0/2227480085 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f426806d4f0 0x7f426813fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:17.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.455+0000 7f4266000640 1 -- 172.21.15.144:0/2227480085 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f426806d4f0 msgr2=0x7f426813fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:17.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.455+0000 7f4266000640 1 --2- 172.21.15.144:0/2227480085 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f426806d4f0 0x7f426813fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.455+0000 7f4266000640 1 -- 172.21.15.144:0/2227480085 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4268145d90 msgr2=0x7f4268160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:17.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.455+0000 7f4266000640 1 --2- 172.21.15.144:0/2227480085 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4268145d90 0x7f4268160140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.455+0000 7f4266000640 1 -- 172.21.15.144:0/2227480085 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42681f4690 con 0x7f42680cf5d0 2024-09-11T23:24:17.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.455+0000 7f4266a00640 1 --2- 172.21.15.144:0/2227480085 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f426806d4f0 0x7f426813fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:17.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.455+0000 7f4266000640 1 --2- 172.21.15.144:0/2227480085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42680cf5d0 0x7f426815f400 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f42540097a0 tx=0x7f42540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:17.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.455+0000 7f425ea00640 1 -- 172.21.15.144:0/2227480085 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4254037040 con 0x7f42680cf5d0 2024-09-11T23:24:17.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.455+0000 7f425ea00640 1 -- 172.21.15.144:0/2227480085 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4254004250 con 0x7f42680cf5d0 2024-09-11T23:24:17.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.455+0000 7f425ea00640 1 -- 172.21.15.144:0/2227480085 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4254032e20 con 0x7f42680cf5d0 2024-09-11T23:24:17.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.455+0000 7f426d800640 1 -- 172.21.15.144:0/2227480085 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42681f4970 con 0x7f42680cf5d0 2024-09-11T23:24:17.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.456+0000 7f426d800640 1 -- 172.21.15.144:0/2227480085 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42681f4f30 con 0x7f42680cf5d0 2024-09-11T23:24:17.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.457+0000 7f426d800640 1 -- 172.21.15.144:0/2227480085 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4268146170 con 0x7f42680cf5d0 2024-09-11T23:24:17.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.458+0000 7f425ea00640 1 -- 172.21.15.144:0/2227480085 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7f4254030770 con 0x7f42680cf5d0 2024-09-11T23:24:17.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.458+0000 7f425ea00640 1 --2- 172.21.15.144:0/2227480085 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f424806c220 0x7f424806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:17.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.459+0000 7f425ea00640 1 -- 172.21.15.144:0/2227480085 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7f42540ac6c0 con 0x7f42680cf5d0 2024-09-11T23:24:17.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.459+0000 7f4266a00640 1 --2- 172.21.15.144:0/2227480085 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f424806c220 0x7f424806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:17.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.460+0000 7f4266a00640 1 --2- 172.21.15.144:0/2227480085 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f424806c220 0x7f424806e6e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4258003eb0 tx=0x7f4258009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:17.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.463+0000 7f425ea00640 1 -- 172.21.15.144:0/2227480085 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f425407ac80 con 0x7f42680cf5d0 2024-09-11T23:24:17.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.660+0000 7f426d800640 1 -- 172.21.15.144:0/2227480085 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol35011", "group_name": "subvol_grp65310", "target": ["mon-mgr", ""]}) -- 0x7f42680cf9b0 con 0x7f424806c220 2024-09-11T23:24:17.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.702+0000 7f425ea00640 1 -- 172.21.15.144:0/2227480085 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+74 (secure 0 0 0) 0x7f42680cf9b0 con 0x7f424806c220 2024-09-11T23:24:17.702 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/subvol_grp65310/subvol35011/919e1733-d47c-49ba-8cf3-6ca1d18d24fb 2024-09-11T23:24:17.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.704+0000 7f426d800640 1 -- 172.21.15.144:0/2227480085 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f424806c220 msgr2=0x7f424806e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:17.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.704+0000 7f426d800640 1 --2- 172.21.15.144:0/2227480085 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f424806c220 0x7f424806e6e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4258003eb0 tx=0x7f4258009040 comp rx=0 tx=0).stop 2024-09-11T23:24:17.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.704+0000 7f426d800640 1 -- 172.21.15.144:0/2227480085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42680cf5d0 msgr2=0x7f426815f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:17.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.704+0000 7f426d800640 1 --2- 172.21.15.144:0/2227480085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42680cf5d0 0x7f426815f400 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f42540097a0 tx=0x7f42540046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.704+0000 7f426d800640 1 -- 172.21.15.144:0/2227480085 shutdown_connections 2024-09-11T23:24:17.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.704+0000 7f426d800640 1 --2- 172.21.15.144:0/2227480085 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f424806c220 0x7f424806e6e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.704+0000 7f426d800640 1 --2- 172.21.15.144:0/2227480085 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4268145d90 0x7f4268160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.704+0000 7f426d800640 1 --2- 172.21.15.144:0/2227480085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42680cf5d0 0x7f426815f400 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.704+0000 7f426d800640 1 --2- 172.21.15.144:0/2227480085 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f426806d4f0 0x7f426813fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.704+0000 7f426d800640 1 -- 172.21.15.144:0/2227480085 >> 172.21.15.144:0/2227480085 conn(0x7f426806bba0 msgr2=0x7f426806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:17.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.705+0000 7f426d800640 1 -- 172.21.15.144:0/2227480085 shutdown_connections 2024-09-11T23:24:17.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.705+0000 7f426d800640 1 -- 172.21.15.144:0/2227480085 wait complete. 2024-09-11T23:24:17.720 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol33612 2024-09-11T23:24:17.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.877+0000 7fcdbfc00640 1 Processor -- start 2024-09-11T23:24:17.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.877+0000 7fcdbfc00640 1 -- start start 2024-09-11T23:24:17.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.879+0000 7fcdbfc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcdb815ed50 0x7fcdb8143d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:17.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.879+0000 7fcdbfc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fcdb80714d0 0x7fcdb80ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:17.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.879+0000 7fcdbfc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdb81443d0 con 0x7fcdb8071080 2024-09-11T23:24:17.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.879+0000 7fcdbfc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fcdb81446b0 con 0x7fcdb815ed50 2024-09-11T23:24:17.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.879+0000 7fcdbfc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fcdb8144990 con 0x7fcdb80714d0 2024-09-11T23:24:17.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.879+0000 7fcdbd200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcdb815ed50 0x7fcdb8143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:17.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.879+0000 7fcdbd200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcdb815ed50 0x7fcdb8143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41988/0 (socket says 172.21.15.144:41988) 2024-09-11T23:24:17.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.879+0000 7fcdbd200640 1 -- 172.21.15.144:0/3737231027 learned_addr learned my addr 172.21.15.144:0/3737231027 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:17.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.879+0000 7fcdbdc00640 1 --2- 172.21.15.144:0/3737231027 >> v2:172.21.15.165:3300/0 conn(0x7fcdb80714d0 0x7fcdb80ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:17.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.879+0000 7fcdbd200640 1 -- 172.21.15.144:0/3737231027 >> v2:172.21.15.165:3300/0 conn(0x7fcdb80714d0 msgr2=0x7fcdb80ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:17.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.879+0000 7fcdbd200640 1 --2- 172.21.15.144:0/3737231027 >> v2:172.21.15.165:3300/0 conn(0x7fcdb80714d0 0x7fcdb80ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.879+0000 7fcdbd200640 1 -- 172.21.15.144:0/3737231027 >> v1:172.21.15.165:6789/0 conn(0x7fcdb8071080 legacy=0x7fcdb80b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:17.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.879+0000 7fcdbd200640 1 -- 172.21.15.144:0/3737231027 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb80b35c0 con 0x7fcdb815ed50 2024-09-11T23:24:17.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.879+0000 7fcdbdc00640 1 --2- 172.21.15.144:0/3737231027 >> v2:172.21.15.165:3300/0 conn(0x7fcdb80714d0 0x7fcdb80ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:24:17.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.880+0000 7fcdbd200640 1 --2- 172.21.15.144:0/3737231027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdb815ed50 0x7fcdb8143d40 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fcdb806d630 tx=0x7fcda802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74fcdc3b35f3dd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:17.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.881+0000 7fcdb7e00640 1 -- 172.21.15.144:0/3737231027 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda8037070 con 0x7fcdb815ed50 2024-09-11T23:24:17.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.881+0000 7fcdb7e00640 1 -- 172.21.15.144:0/3737231027 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda8032440 con 0x7fcdb815ed50 2024-09-11T23:24:17.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.881+0000 7fcdb7e00640 1 -- 172.21.15.144:0/3737231027 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda8032810 con 0x7fcdb815ed50 2024-09-11T23:24:17.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.881+0000 7fcdbfc00640 1 -- 172.21.15.144:0/3737231027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdb815ed50 msgr2=0x7fcdb8143d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:17.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.881+0000 7fcdbfc00640 1 --2- 172.21.15.144:0/3737231027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdb815ed50 0x7fcdb8143d40 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fcdb806d630 tx=0x7fcda802a1a0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.881+0000 7fcdbfc00640 1 -- 172.21.15.144:0/3737231027 shutdown_connections 2024-09-11T23:24:17.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.881+0000 7fcdbfc00640 1 --2- 172.21.15.144:0/3737231027 >> v2:172.21.15.165:3300/0 conn(0x7fcdb80714d0 0x7fcdb80ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.881+0000 7fcdbfc00640 1 --2- 172.21.15.144:0/3737231027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdb815ed50 0x7fcdb8143d40 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.881+0000 7fcdbfc00640 1 -- 172.21.15.144:0/3737231027 >> 172.21.15.144:0/3737231027 conn(0x7fcdb806bba0 msgr2=0x7fcdb806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:17.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.881+0000 7fcdbfc00640 1 -- 172.21.15.144:0/3737231027 shutdown_connections 2024-09-11T23:24:17.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.881+0000 7fcdbfc00640 1 -- 172.21.15.144:0/3737231027 wait complete. 2024-09-11T23:24:17.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.883+0000 7fcdbfc00640 1 Processor -- start 2024-09-11T23:24:17.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.883+0000 7fcdbfc00640 1 -- start start 2024-09-11T23:24:17.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.884+0000 7fcdbfc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcdb8071080 0x7fcdb81f8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:17.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.884+0000 7fcdbfc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdb80714d0 0x7fcdb8159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:17.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.884+0000 7fcdbfc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdb815ed50 0x7fcdb81f7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:17.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.884+0000 7fcdbfc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb80aee20 con 0x7fcdb80714d0 2024-09-11T23:24:17.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.884+0000 7fcdbfc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb80b43e0 con 0x7fcdb8071080 2024-09-11T23:24:17.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.884+0000 7fcdbfc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcdb80aefa0 con 0x7fcdb815ed50 2024-09-11T23:24:17.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.884+0000 7fcdafe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdb80714d0 0x7fcdb8159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:17.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.884+0000 7fcdafe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdb80714d0 0x7fcdb8159210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42004/0 (socket says 172.21.15.144:42004) 2024-09-11T23:24:17.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.884+0000 7fcdafe00640 1 -- 172.21.15.144:0/491274132 learned_addr learned my addr 172.21.15.144:0/491274132 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:17.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.885+0000 7fcdbd200640 1 --2- 172.21.15.144:0/491274132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcdb8071080 0x7fcdb81f8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:17.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.885+0000 7fcdafe00640 1 -- 172.21.15.144:0/491274132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdb815ed50 msgr2=0x7fcdb81f7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:17.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.885+0000 7fcdafe00640 1 --2- 172.21.15.144:0/491274132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdb815ed50 0x7fcdb81f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.885+0000 7fcdafe00640 1 -- 172.21.15.144:0/491274132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcdb8071080 msgr2=0x7fcdb81f8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:17.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.885+0000 7fcdafe00640 1 --2- 172.21.15.144:0/491274132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcdb8071080 0x7fcdb81f8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:17.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.885+0000 7fcdafe00640 1 -- 172.21.15.144:0/491274132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb81577e0 con 0x7fcdb80714d0 2024-09-11T23:24:17.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.885+0000 7fcdafe00640 1 --2- 172.21.15.144:0/491274132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdb80714d0 0x7fcdb8159210 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fcda000c430 tx=0x7fcda000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:17.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.885+0000 7fcdb5600640 1 -- 172.21.15.144:0/491274132 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda0017070 con 0x7fcdb80714d0 2024-09-11T23:24:17.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.885+0000 7fcdb5600640 1 -- 172.21.15.144:0/491274132 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda0003640 con 0x7fcdb80714d0 2024-09-11T23:24:17.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.885+0000 7fcdb5600640 1 -- 172.21.15.144:0/491274132 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda0003a30 con 0x7fcdb80714d0 2024-09-11T23:24:17.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.885+0000 7fcdbfc00640 1 -- 172.21.15.144:0/491274132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdb8157ac0 con 0x7fcdb80714d0 2024-09-11T23:24:17.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.885+0000 7fcdbfc00640 1 -- 172.21.15.144:0/491274132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdb8158080 con 0x7fcdb80714d0 2024-09-11T23:24:17.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.886+0000 7fcdbfc00640 1 -- 172.21.15.144:0/491274132 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdb806f170 con 0x7fcdb80714d0 2024-09-11T23:24:17.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.887+0000 7fcdb5600640 1 -- 172.21.15.144:0/491274132 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 90855+0+0 (secure 0 0 0) 0x7fcda0003bd0 con 0x7fcdb80714d0 2024-09-11T23:24:17.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.888+0000 7fcdb5600640 1 --2- 172.21.15.144:0/491274132 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcd9406c250 0x7fcd9406e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:17.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.888+0000 7fcdb5600640 1 -- 172.21.15.144:0/491274132 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7fcda008a750 con 0x7fcdb80714d0 2024-09-11T23:24:17.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.889+0000 7fcdbd200640 1 --2- 172.21.15.144:0/491274132 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcd9406c250 0x7fcd9406e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:17.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.889+0000 7fcdbd200640 1 --2- 172.21.15.144:0/491274132 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcd9406c250 0x7fcd9406e710 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcda8034000 tx=0x7fcda802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:17.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:17.892+0000 7fcdb5600640 1 -- 172.21.15.144:0/491274132 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcdb806f170 con 0x7fcdb80714d0 2024-09-11T23:24:18.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.030+0000 7fcdb5600640 1 -- 172.21.15.144:0/491274132 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mgrmap(e 21) ==== 90906+0+0 (secure 0 0 0) 0x7fcda0054b00 con 0x7fcdb80714d0 2024-09-11T23:24:18.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.103+0000 7fcdbfc00640 1 -- 172.21.15.144:0/491274132 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol33612", "target": ["mon-mgr", ""]}) -- 0x7fcdb80ae8e0 con 0x7fcd9406c250 2024-09-11T23:24:18.140 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.141+0000 7fcdb5600640 1 -- 172.21.15.144:0/491274132 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+144 (secure 0 0 0) 0x7fcdb80ae8e0 con 0x7fcd9406c250 2024-09-11T23:24:18.141 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:24:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "status": { 2024-09-11T23:24:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "pending", 2024-09-11T23:24:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "source": { 2024-09-11T23:24:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "volume": "fake", 2024-09-11T23:24:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "subvolume": "fake", 2024-09-11T23:24:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: "snapshot": "fake" 2024-09-11T23:24:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:18.141 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:18.142 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:24:18.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.143+0000 7fcdbfc00640 1 -- 172.21.15.144:0/491274132 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcd9406c250 msgr2=0x7fcd9406e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:18.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.143+0000 7fcdbfc00640 1 --2- 172.21.15.144:0/491274132 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcd9406c250 0x7fcd9406e710 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcda8034000 tx=0x7fcda802e000 comp rx=0 tx=0).stop 2024-09-11T23:24:18.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.143+0000 7fcdbfc00640 1 -- 172.21.15.144:0/491274132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdb80714d0 msgr2=0x7fcdb8159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:18.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.143+0000 7fcdbfc00640 1 --2- 172.21.15.144:0/491274132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdb80714d0 0x7fcdb8159210 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fcda000c430 tx=0x7fcda000c8f0 comp rx=0 tx=0).stop 2024-09-11T23:24:18.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.143+0000 7fcdbfc00640 1 -- 172.21.15.144:0/491274132 shutdown_connections 2024-09-11T23:24:18.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.143+0000 7fcdbfc00640 1 --2- 172.21.15.144:0/491274132 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcd9406c250 0x7fcd9406e710 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:18.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.143+0000 7fcdbfc00640 1 --2- 172.21.15.144:0/491274132 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdb815ed50 0x7fcdb81f7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:18.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.143+0000 7fcdbfc00640 1 --2- 172.21.15.144:0/491274132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdb80714d0 0x7fcdb8159210 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:18.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.143+0000 7fcdbfc00640 1 --2- 172.21.15.144:0/491274132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcdb8071080 0x7fcdb81f8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:18.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.143+0000 7fcdbfc00640 1 -- 172.21.15.144:0/491274132 >> 172.21.15.144:0/491274132 conn(0x7fcdb806bba0 msgr2=0x7fcdb815fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:18.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.143+0000 7fcdbfc00640 1 -- 172.21.15.144:0/491274132 shutdown_connections 2024-09-11T23:24:18.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.143+0000 7fcdbfc00640 1 -- 172.21.15.144:0/491274132 wait complete. 2024-09-11T23:24:18.159 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol33240 fake 2024-09-11T23:24:18.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.319+0000 7f124ec00640 1 Processor -- start 2024-09-11T23:24:18.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.319+0000 7f124ec00640 1 -- start start 2024-09-11T23:24:18.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.320+0000 7f124ec00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f12480b5630 0x7f124815f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:18.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.320+0000 7f124ec00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12480af050 con 0x7f12480ae8e0 2024-09-11T23:24:18.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.320+0000 7f124ec00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12480af330 con 0x7f12481554d0 2024-09-11T23:24:18.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.320+0000 7f124ec00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f12480af610 con 0x7f12480b5630 2024-09-11T23:24:18.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.320+0000 7f1247400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f12480b5630 0x7f124815f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:18.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.320+0000 7f1247400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f12480b5630 0x7f124815f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42014/0 (socket says 172.21.15.144:42014) 2024-09-11T23:24:18.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.320+0000 7f124cc00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f12480ae8e0 0x7f1248072a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51610/0 (socket says 172.21.15.144:51610) 2024-09-11T23:24:18.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.320+0000 7f1247400640 1 -- 172.21.15.144:0/211359386 learned_addr learned my addr 172.21.15.144:0/211359386 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:18.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.321+0000 7f1247400640 1 -- 172.21.15.144:0/211359386 >> v1:172.21.15.165:6789/0 conn(0x7f12481554d0 legacy=0x7f12480b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:18.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.321+0000 7f1247400640 1 -- 172.21.15.144:0/211359386 >> v1:172.21.15.144:6789/0 conn(0x7f12480ae8e0 legacy=0x7f1248072a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:18.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.321+0000 7f1247400640 1 -- 172.21.15.144:0/211359386 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12480af8f0 con 0x7f12480b5630 2024-09-11T23:24:18.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.321+0000 7f1246a00640 1 -- 172.21.15.144:0/211359386 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 612949767 0 0) 0x7f12480af050 con 0x7f12480ae8e0 2024-09-11T23:24:18.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.322+0000 7f1247400640 1 --2- 172.21.15.144:0/211359386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12480b5630 0x7f124815f640 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f1234009870 tx=0x7f123402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0b3a53ee1a45f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:18.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.322+0000 7f1246a00640 1 -- 172.21.15.144:0/211359386 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234037070 con 0x7f12480b5630 2024-09-11T23:24:18.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.322+0000 7f1246a00640 1 -- 172.21.15.144:0/211359386 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f123402ae50 con 0x7f12480b5630 2024-09-11T23:24:18.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.322+0000 7f1246a00640 1 -- 172.21.15.144:0/211359386 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234032860 con 0x7f12480b5630 2024-09-11T23:24:18.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.323+0000 7f124ec00640 1 -- 172.21.15.144:0/211359386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12480b5630 msgr2=0x7f124815f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:18.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.323+0000 7f124ec00640 1 --2- 172.21.15.144:0/211359386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12480b5630 0x7f124815f640 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f1234009870 tx=0x7f123402a300 comp rx=0 tx=0).stop 2024-09-11T23:24:18.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.323+0000 7f124ec00640 1 -- 172.21.15.144:0/211359386 shutdown_connections 2024-09-11T23:24:18.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.323+0000 7f124ec00640 1 --2- 172.21.15.144:0/211359386 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12480b5630 0x7f124815f640 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:18.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.323+0000 7f124ec00640 1 -- 172.21.15.144:0/211359386 >> 172.21.15.144:0/211359386 conn(0x7f124806c9f0 msgr2=0x7f124806cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:18.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.323+0000 7f124ec00640 1 -- 172.21.15.144:0/211359386 shutdown_connections 2024-09-11T23:24:18.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.323+0000 7f124ec00640 1 -- 172.21.15.144:0/211359386 wait complete. 2024-09-11T23:24:18.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.324+0000 7f124ec00640 1 Processor -- start 2024-09-11T23:24:18.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.324+0000 7f124ec00640 1 -- start start 2024-09-11T23:24:18.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.325+0000 7f124ec00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12480ae8e0 0x7f12480cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:18.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.325+0000 7f124ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12480b5630 0x7f124815b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:18.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.325+0000 7f124ec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12481554d0 0x7f124815be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:18.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.325+0000 7f124ec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f12481558b0 con 0x7f12481554d0 2024-09-11T23:24:18.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.325+0000 7f124ec00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f12480aed50 con 0x7f12480ae8e0 2024-09-11T23:24:18.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.325+0000 7f124ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1248155a30 con 0x7f12480b5630 2024-09-11T23:24:18.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.325+0000 7f124cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12481554d0 0x7f124815be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:18.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.326+0000 7f124cc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12481554d0 0x7f124815be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42022/0 (socket says 172.21.15.144:42022) 2024-09-11T23:24:18.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.326+0000 7f124cc00640 1 -- 172.21.15.144:0/289062494 learned_addr learned my addr 172.21.15.144:0/289062494 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:18.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.326+0000 7f1247e00640 1 --2- 172.21.15.144:0/289062494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12480ae8e0 0x7f12480cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:18.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.326+0000 7f1247400640 1 --2- 172.21.15.144:0/289062494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12480b5630 0x7f124815b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:18.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.326+0000 7f124cc00640 1 -- 172.21.15.144:0/289062494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12480b5630 msgr2=0x7f124815b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:18.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.326+0000 7f124cc00640 1 --2- 172.21.15.144:0/289062494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12480b5630 0x7f124815b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:18.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.326+0000 7f124cc00640 1 -- 172.21.15.144:0/289062494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12480ae8e0 msgr2=0x7f12480cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:18.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.326+0000 7f124cc00640 1 --2- 172.21.15.144:0/289062494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12480ae8e0 0x7f12480cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:18.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.326+0000 7f124cc00640 1 -- 172.21.15.144:0/289062494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12480ce670 con 0x7f12481554d0 2024-09-11T23:24:18.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.326+0000 7f1247400640 1 --2- 172.21.15.144:0/289062494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12480b5630 0x7f124815b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:18.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.326+0000 7f1247e00640 1 --2- 172.21.15.144:0/289062494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12480ae8e0 0x7f12480cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:18.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.326+0000 7f124cc00640 1 --2- 172.21.15.144:0/289062494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12481554d0 0x7f124815be20 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f124000c7a0 tx=0x7f124000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:18.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.326+0000 7f123fe00640 1 -- 172.21.15.144:0/289062494 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1240018070 con 0x7f12481554d0 2024-09-11T23:24:18.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.326+0000 7f123fe00640 1 -- 172.21.15.144:0/289062494 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f124000a640 con 0x7f12481554d0 2024-09-11T23:24:18.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.326+0000 7f123fe00640 1 -- 172.21.15.144:0/289062494 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124000aab0 con 0x7f12481554d0 2024-09-11T23:24:18.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.326+0000 7f124ec00640 1 -- 172.21.15.144:0/289062494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12480ce950 con 0x7f12481554d0 2024-09-11T23:24:18.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.327+0000 7f124ec00640 1 -- 172.21.15.144:0/289062494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12480cef10 con 0x7f12481554d0 2024-09-11T23:24:18.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.328+0000 7f124ec00640 1 -- 172.21.15.144:0/289062494 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f124815f640 con 0x7f12481554d0 2024-09-11T23:24:18.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.328+0000 7f123fe00640 1 -- 172.21.15.144:0/289062494 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 21) ==== 90906+0+0 (secure 0 0 0) 0x7f124001b070 con 0x7f12481554d0 2024-09-11T23:24:18.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.329+0000 7f123fe00640 1 --2- 172.21.15.144:0/289062494 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f122806c2e0 0x7f122806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:18.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.329+0000 7f123fe00640 1 -- 172.21.15.144:0/289062494 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7f124008add0 con 0x7f12481554d0 2024-09-11T23:24:18.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.330+0000 7f1247e00640 1 --2- 172.21.15.144:0/289062494 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f122806c2e0 0x7f122806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:18.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.330+0000 7f1247e00640 1 --2- 172.21.15.144:0/289062494 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f122806c2e0 0x7f122806e7a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1238007fd0 tx=0x7f1238009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:18.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.333+0000 7f123fe00640 1 -- 172.21.15.144:0/289062494 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1240058fb0 con 0x7f12481554d0 2024-09-11T23:24:18.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.539+0000 7f124ec00640 1 -- 172.21.15.144:0/289062494 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol33240", "snap_name": "fake", "target": ["mon-mgr", ""]}) -- 0x7f1248062ca0 con 0x7f122806c2e0 2024-09-11T23:24:18.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.595+0000 7f123fe00640 1 -- 172.21.15.144:0/289062494 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1248062ca0 con 0x7f122806c2e0 2024-09-11T23:24:18.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.597+0000 7f124ec00640 1 -- 172.21.15.144:0/289062494 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f122806c2e0 msgr2=0x7f122806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:18.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.597+0000 7f124ec00640 1 --2- 172.21.15.144:0/289062494 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f122806c2e0 0x7f122806e7a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1238007fd0 tx=0x7f1238009040 comp rx=0 tx=0).stop 2024-09-11T23:24:18.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.597+0000 7f124ec00640 1 -- 172.21.15.144:0/289062494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12481554d0 msgr2=0x7f124815be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:18.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.597+0000 7f124ec00640 1 --2- 172.21.15.144:0/289062494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12481554d0 0x7f124815be20 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f124000c7a0 tx=0x7f124000cc60 comp rx=0 tx=0).stop 2024-09-11T23:24:18.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.598+0000 7f124ec00640 1 -- 172.21.15.144:0/289062494 shutdown_connections 2024-09-11T23:24:18.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.598+0000 7f124ec00640 1 --2- 172.21.15.144:0/289062494 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f122806c2e0 0x7f122806e7a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:18.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.598+0000 7f124ec00640 1 --2- 172.21.15.144:0/289062494 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f12481554d0 0x7f124815be20 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:18.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.598+0000 7f124ec00640 1 --2- 172.21.15.144:0/289062494 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f12480b5630 0x7f124815b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:18.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.598+0000 7f124ec00640 1 --2- 172.21.15.144:0/289062494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12480ae8e0 0x7f12480cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:18.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.598+0000 7f124ec00640 1 -- 172.21.15.144:0/289062494 >> 172.21.15.144:0/289062494 conn(0x7f124806c9f0 msgr2=0x7f1248072430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:18.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.598+0000 7f124ec00640 1 -- 172.21.15.144:0/289062494 shutdown_connections 2024-09-11T23:24:18.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.598+0000 7f124ec00640 1 -- 172.21.15.144:0/289062494 wait complete. 2024-09-11T23:24:18.614 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol35011 fake subvol_grp65310 2024-09-11T23:24:18.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.774+0000 7f9301000640 1 Processor -- start 2024-09-11T23:24:18.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.774+0000 7f9301000640 1 -- start start 2024-09-11T23:24:18.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.775+0000 7f9301000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92fc15f530 0x7f92fc06dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:18.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.775+0000 7f9301000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92fc162440 con 0x7f92fc15f0d0 2024-09-11T23:24:18.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.775+0000 7f9301000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92fc162720 con 0x7f92fc070710 2024-09-11T23:24:18.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.775+0000 7f9301000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f92fc06d400 con 0x7f92fc15f530 2024-09-11T23:24:18.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.776+0000 7f92faa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f92fc15f0d0 0x7f92fc06d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51626/0 (socket says 172.21.15.144:51626) 2024-09-11T23:24:18.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.776+0000 7f92faa00640 1 -- 172.21.15.144:0/4099757129 learned_addr learned my addr 172.21.15.144:0/4099757129 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:18.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.776+0000 7f92fbe00640 1 --2- 172.21.15.144:0/4099757129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92fc15f530 0x7f92fc06dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.776+0000 7f92fa000640 1 -- 172.21.15.144:0/4099757129 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1848494825 0 0) 0x7f92fc162440 con 0x7f92fc15f0d0 2024-09-11T23:24:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.776+0000 7f92fa000640 1 -- 172.21.15.144:0/4099757129 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92e0003520 con 0x7f92fc15f0d0 2024-09-11T23:24:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.776+0000 7f92fa000640 1 -- 172.21.15.144:0/4099757129 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2836581473 0 0) 0x7f92e0003520 con 0x7f92fc15f0d0 2024-09-11T23:24:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.776+0000 7f92fa000640 1 -- 172.21.15.144:0/4099757129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92fc15f530 msgr2=0x7f92fc06dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.776+0000 7f92fa000640 1 --2- 172.21.15.144:0/4099757129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92fc15f530 0x7f92fc06dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.776+0000 7f92fa000640 1 -- 172.21.15.144:0/4099757129 >> v1:172.21.15.165:6789/0 conn(0x7f92fc070710 legacy=0x7f92fc070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.776+0000 7f92fa000640 1 -- 172.21.15.144:0/4099757129 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92fc162a00 con 0x7f92fc15f0d0 2024-09-11T23:24:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.776+0000 7f92fa000640 1 -- 172.21.15.144:0/4099757129 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f92e8001670 con 0x7f92fc15f0d0 2024-09-11T23:24:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.776+0000 7f92fa000640 1 -- 172.21.15.144:0/4099757129 >> v1:172.21.15.144:6789/0 conn(0x7f92fc15f0d0 legacy=0x7f92fc06d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.777+0000 7f92fa000640 1 --2- 172.21.15.144:0/4099757129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92fc15f530 0x7f92e00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.777+0000 7f92fa000640 1 --2- 172.21.15.144:0/4099757129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92e0003f60 0x7f92e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.777+0000 7f92fa000640 1 --2- 172.21.15.144:0/4099757129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92e0004d40 0x7f92e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:18.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.777+0000 7f92fa000640 1 -- 172.21.15.144:0/4099757129 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc06d400 con 0x7f92e0004d40 2024-09-11T23:24:18.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.777+0000 7f92fa000640 1 -- 172.21.15.144:0/4099757129 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f92e000bb30 con 0x7f92e0003f60 2024-09-11T23:24:18.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.777+0000 7f92fa000640 1 -- 172.21.15.144:0/4099757129 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f92e000bd30 con 0x7f92fc15f530 2024-09-11T23:24:18.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.777+0000 7f92fbe00640 1 --2- 172.21.15.144:0/4099757129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92e0004d40 0x7f92e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:18.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.777+0000 7f92fb400640 1 --2- 172.21.15.144:0/4099757129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92fc15f530 0x7f92e00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:18.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.777+0000 7f92faa00640 1 --2- 172.21.15.144:0/4099757129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92e0003f60 0x7f92e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:18.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.777+0000 7f92fbe00640 1 -- 172.21.15.144:0/4099757129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92fc15f530 msgr2=0x7f92e00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:18.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.777+0000 7f92fbe00640 1 --2- 172.21.15.144:0/4099757129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92fc15f530 0x7f92e00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:18.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.777+0000 7f92fbe00640 1 -- 172.21.15.144:0/4099757129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92e0003f60 msgr2=0x7f92e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:18.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.777+0000 7f92fbe00640 1 --2- 172.21.15.144:0/4099757129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92e0003f60 0x7f92e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:18.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.777+0000 7f92fbe00640 1 -- 172.21.15.144:0/4099757129 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e0003520 con 0x7f92e0004d40 2024-09-11T23:24:18.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.778+0000 7f92fbe00640 1 --2- 172.21.15.144:0/4099757129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92e0004d40 0x7f92e00051c0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009fc0 tx=0x7f92e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf28d3e9c668e28 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:18.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.778+0000 7f92fa000640 1 -- 172.21.15.144:0/4099757129 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4009c10 con 0x7f92e0004d40 2024-09-11T23:24:18.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.779+0000 7f92fa000640 1 -- 172.21.15.144:0/4099757129 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f4036070 con 0x7f92e0004d40 2024-09-11T23:24:18.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.779+0000 7f92fa000640 1 -- 172.21.15.144:0/4099757129 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4031880 con 0x7f92e0004d40 2024-09-11T23:24:18.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.779+0000 7f9301000640 1 -- 172.21.15.144:0/4099757129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92e0004d40 msgr2=0x7f92e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:18.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.779+0000 7f9301000640 1 --2- 172.21.15.144:0/4099757129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92e0004d40 0x7f92e00051c0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009fc0 tx=0x7f92e0005830 comp rx=0 tx=0).stop 2024-09-11T23:24:18.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.779+0000 7f92fbe00640 1 -- 172.21.15.144:0/4099757129 reap_dead start 2024-09-11T23:24:18.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.779+0000 7f9301000640 1 -- 172.21.15.144:0/4099757129 shutdown_connections 2024-09-11T23:24:18.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.779+0000 7f9301000640 1 -- 172.21.15.144:0/4099757129 >> 172.21.15.144:0/4099757129 conn(0x7f92fc0b40d0 msgr2=0x7f92fc0b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:18.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.779+0000 7f9301000640 1 -- 172.21.15.144:0/4099757129 shutdown_connections 2024-09-11T23:24:18.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.779+0000 7f9301000640 1 -- 172.21.15.144:0/4099757129 wait complete. 2024-09-11T23:24:18.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.781+0000 7f9301000640 1 Processor -- start 2024-09-11T23:24:18.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.781+0000 7f9301000640 1 -- start start 2024-09-11T23:24:18.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.782+0000 7f9301000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92e0004d40 0x7f92fc15db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:18.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.782+0000 7f9301000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92fc1f80e0 0x7f92fc1f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:18.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.782+0000 7f9301000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92fc150670 0x7f92fc0d1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:18.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.782+0000 7f9301000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc0b6250 con 0x7f92fc150670 2024-09-11T23:24:18.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.782+0000 7f9301000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc0b60d0 con 0x7f92fc1f80e0 2024-09-11T23:24:18.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.782+0000 7f9301000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f92fc161ff0 con 0x7f92e0004d40 2024-09-11T23:24:18.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.782+0000 7f92fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92fc150670 0x7f92fc0d1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:18.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.782+0000 7f92fbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92fc150670 0x7f92fc0d1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42038/0 (socket says 172.21.15.144:42038) 2024-09-11T23:24:18.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.782+0000 7f92fbe00640 1 -- 172.21.15.144:0/718519735 learned_addr learned my addr 172.21.15.144:0/718519735 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:18.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.782+0000 7f92fb400640 1 --2- 172.21.15.144:0/718519735 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92e0004d40 0x7f92fc15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:18.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.782+0000 7f92faa00640 1 --2- 172.21.15.144:0/718519735 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92fc1f80e0 0x7f92fc1f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:18.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.782+0000 7f92fbe00640 1 -- 172.21.15.144:0/718519735 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92e0004d40 msgr2=0x7f92fc15db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:18.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.782+0000 7f92fbe00640 1 --2- 172.21.15.144:0/718519735 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92e0004d40 0x7f92fc15db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:18.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.782+0000 7f92fbe00640 1 -- 172.21.15.144:0/718519735 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92fc1f80e0 msgr2=0x7f92fc1f48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:18.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.782+0000 7f92fbe00640 1 --2- 172.21.15.144:0/718519735 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92fc1f80e0 0x7f92fc1f48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:18.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.782+0000 7f92fbe00640 1 -- 172.21.15.144:0/718519735 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92fc15e070 con 0x7f92fc150670 2024-09-11T23:24:18.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.782+0000 7f92faa00640 1 --2- 172.21.15.144:0/718519735 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92fc1f80e0 0x7f92fc1f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:18.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.783+0000 7f92fbe00640 1 --2- 172.21.15.144:0/718519735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92fc150670 0x7f92fc0d1070 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f92f400e230 tx=0x7f92f4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:18.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.783+0000 7f92f3400640 1 -- 172.21.15.144:0/718519735 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4009c10 con 0x7f92fc150670 2024-09-11T23:24:18.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.783+0000 7f92f3400640 1 -- 172.21.15.144:0/718519735 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f4031dd0 con 0x7f92fc150670 2024-09-11T23:24:18.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.783+0000 7f92f3400640 1 -- 172.21.15.144:0/718519735 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4003bd0 con 0x7f92fc150670 2024-09-11T23:24:18.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.783+0000 7f9301000640 1 -- 172.21.15.144:0/718519735 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92fc1f4de0 con 0x7f92fc150670 2024-09-11T23:24:18.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.783+0000 7f9301000640 1 -- 172.21.15.144:0/718519735 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92fc1f7600 con 0x7f92fc150670 2024-09-11T23:24:18.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.784+0000 7f9301000640 1 -- 172.21.15.144:0/718519735 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92fc070af0 con 0x7f92fc150670 2024-09-11T23:24:18.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.785+0000 7f92f3400640 1 -- 172.21.15.144:0/718519735 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 21) ==== 90906+0+0 (secure 0 0 0) 0x7f92f4005d10 con 0x7f92fc150670 2024-09-11T23:24:18.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.786+0000 7f92f3400640 1 --2- 172.21.15.144:0/718519735 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f92dc06c2b0 0x7f92dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:18.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.786+0000 7f92f3400640 1 -- 172.21.15.144:0/718519735 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7f92f40ac900 con 0x7f92fc150670 2024-09-11T23:24:18.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.786+0000 7f92fb400640 1 --2- 172.21.15.144:0/718519735 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f92dc06c2b0 0x7f92dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:18.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.787+0000 7f92fb400640 1 --2- 172.21.15.144:0/718519735 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f92dc06c2b0 0x7f92dc06e770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0017e0 tx=0x7f92ec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:18.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.790+0000 7f92f3400640 1 -- 172.21.15.144:0/718519735 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f92f407a5b0 con 0x7f92fc150670 2024-09-11T23:24:18.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:18.992+0000 7f9301000640 1 -- 172.21.15.144:0/718519735 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol35011", "snap_name": "fake", "group_name": "subvol_grp65310", "target": ["mon-mgr", ""]}) -- 0x7f92fc0b70f0 con 0x7f92dc06c2b0 2024-09-11T23:24:19.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.041+0000 7f92f3400640 1 -- 172.21.15.144:0/718519735 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f92fc0b70f0 con 0x7f92dc06c2b0 2024-09-11T23:24:19.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.044+0000 7f9301000640 1 -- 172.21.15.144:0/718519735 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f92dc06c2b0 msgr2=0x7f92dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:19.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.044+0000 7f9301000640 1 --2- 172.21.15.144:0/718519735 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f92dc06c2b0 0x7f92dc06e770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0017e0 tx=0x7f92ec009040 comp rx=0 tx=0).stop 2024-09-11T23:24:19.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.044+0000 7f9301000640 1 -- 172.21.15.144:0/718519735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92fc150670 msgr2=0x7f92fc0d1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:19.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.044+0000 7f9301000640 1 --2- 172.21.15.144:0/718519735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92fc150670 0x7f92fc0d1070 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f92f400e230 tx=0x7f92f4009750 comp rx=0 tx=0).stop 2024-09-11T23:24:19.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.044+0000 7f9301000640 1 -- 172.21.15.144:0/718519735 shutdown_connections 2024-09-11T23:24:19.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.044+0000 7f9301000640 1 --2- 172.21.15.144:0/718519735 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f92dc06c2b0 0x7f92dc06e770 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.044+0000 7f9301000640 1 --2- 172.21.15.144:0/718519735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f92fc150670 0x7f92fc0d1070 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.044+0000 7f9301000640 1 --2- 172.21.15.144:0/718519735 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92fc1f80e0 0x7f92fc1f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.044+0000 7f9301000640 1 --2- 172.21.15.144:0/718519735 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f92e0004d40 0x7f92fc15db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.044+0000 7f9301000640 1 -- 172.21.15.144:0/718519735 >> 172.21.15.144:0/718519735 conn(0x7f92fc0b40d0 msgr2=0x7f92fc0cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:19.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.044+0000 7f9301000640 1 -- 172.21.15.144:0/718519735 shutdown_connections 2024-09-11T23:24:19.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.044+0000 7f9301000640 1 -- 172.21.15.144:0/718519735 wait complete. 2024-09-11T23:24:19.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:19.059 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol33240/.meta) 2024-09-11T23:24:19.117 INFO:teuthology.orchestra.run.smithi144.stdout:[GLOBAL] 2024-09-11T23:24:19.118 INFO:teuthology.orchestra.run.smithi144.stdout:version = 1 2024-09-11T23:24:19.118 INFO:teuthology.orchestra.run.smithi144.stdout:type = subvolume 2024-09-11T23:24:19.118 INFO:teuthology.orchestra.run.smithi144.stdout:path = /volumes/_nogroup/subvol33240/4f1b3f3d-1f37-40f6-ba3f-b65d7cea04c5 2024-09-11T23:24:19.118 INFO:teuthology.orchestra.run.smithi144.stdout:state = complete 2024-09-11T23:24:19.119 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:19.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:19.121 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/subvol_grp65310/subvol35011/.meta) 2024-09-11T23:24:19.177 INFO:teuthology.orchestra.run.smithi144.stdout:[GLOBAL] 2024-09-11T23:24:19.178 INFO:teuthology.orchestra.run.smithi144.stdout:version = 1 2024-09-11T23:24:19.178 INFO:teuthology.orchestra.run.smithi144.stdout:type = subvolume 2024-09-11T23:24:19.178 INFO:teuthology.orchestra.run.smithi144.stdout:path = /volumes/subvol_grp65310/subvol35011/919e1733-d47c-49ba-8cf3-6ca1d18d24fb 2024-09-11T23:24:19.178 INFO:teuthology.orchestra.run.smithi144.stdout:state = complete 2024-09-11T23:24:19.178 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:19.181 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol33240 2024-09-11T23:24:19.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.337+0000 7fd34c400640 1 Processor -- start 2024-09-11T23:24:19.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.337+0000 7fd34c400640 1 -- start start 2024-09-11T23:24:19.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.338+0000 7fd34c400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd344158e50 0x7fd3440b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:19.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.338+0000 7fd34c400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd34415c370 0x7fd34406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:19.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.338+0000 7fd34c400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd34406ef60 0x7fd34415ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:19.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.338+0000 7fd34c400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd34406f3d0 con 0x7fd34406ef60 2024-09-11T23:24:19.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.338+0000 7fd34c400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd34415c800 con 0x7fd344158e50 2024-09-11T23:24:19.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.338+0000 7fd34c400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd3440b43f0 con 0x7fd34415c370 2024-09-11T23:24:19.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.338+0000 7fd34a400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd34406ef60 0x7fd34415ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:19.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.338+0000 7fd34a400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd34406ef60 0x7fd34415ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42042/0 (socket says 172.21.15.144:42042) 2024-09-11T23:24:19.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.338+0000 7fd34a400640 1 -- 172.21.15.144:0/1340544928 learned_addr learned my addr 172.21.15.144:0/1340544928 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:19.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.338+0000 7fd349000640 1 --2- 172.21.15.144:0/1340544928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd34415c370 0x7fd34406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:19.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.338+0000 7fd349a00640 1 --2- 172.21.15.144:0/1340544928 >> v2:172.21.15.165:3300/0 conn(0x7fd344158e50 0x7fd3440b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:19.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.339+0000 7fd34a400640 1 -- 172.21.15.144:0/1340544928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd34415c370 msgr2=0x7fd34406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:19.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.339+0000 7fd34a400640 1 --2- 172.21.15.144:0/1340544928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd34415c370 0x7fd34406ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.339+0000 7fd34a400640 1 -- 172.21.15.144:0/1340544928 >> v2:172.21.15.165:3300/0 conn(0x7fd344158e50 msgr2=0x7fd3440b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:19.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.339+0000 7fd34a400640 1 --2- 172.21.15.144:0/1340544928 >> v2:172.21.15.165:3300/0 conn(0x7fd344158e50 0x7fd3440b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.339+0000 7fd34a400640 1 -- 172.21.15.144:0/1340544928 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3440b3630 con 0x7fd34406ef60 2024-09-11T23:24:19.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.339+0000 7fd349000640 1 --2- 172.21.15.144:0/1340544928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd34415c370 0x7fd34406ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:19.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.339+0000 7fd349a00640 1 --2- 172.21.15.144:0/1340544928 >> v2:172.21.15.165:3300/0 conn(0x7fd344158e50 0x7fd3440b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:19.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.340+0000 7fd34a400640 1 --2- 172.21.15.144:0/1340544928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd34406ef60 0x7fd34415ee50 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fd344069580 tx=0x7fd33c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1da345bd1e19e57 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:19.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.340+0000 7fd343e00640 1 -- 172.21.15.144:0/1340544928 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c037070 con 0x7fd34406ef60 2024-09-11T23:24:19.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.340+0000 7fd343e00640 1 -- 172.21.15.144:0/1340544928 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd33c032440 con 0x7fd34406ef60 2024-09-11T23:24:19.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.340+0000 7fd343e00640 1 -- 172.21.15.144:0/1340544928 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c032810 con 0x7fd34406ef60 2024-09-11T23:24:19.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.340+0000 7fd34c400640 1 -- 172.21.15.144:0/1340544928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd34406ef60 msgr2=0x7fd34415ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:19.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.340+0000 7fd34c400640 1 --2- 172.21.15.144:0/1340544928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd34406ef60 0x7fd34415ee50 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fd344069580 tx=0x7fd33c02a1e0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.341+0000 7fd34c400640 1 -- 172.21.15.144:0/1340544928 shutdown_connections 2024-09-11T23:24:19.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.341+0000 7fd34c400640 1 --2- 172.21.15.144:0/1340544928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd34406ef60 0x7fd34415ee50 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.341+0000 7fd34c400640 1 --2- 172.21.15.144:0/1340544928 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd34415c370 0x7fd34406ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.341+0000 7fd34c400640 1 --2- 172.21.15.144:0/1340544928 >> v2:172.21.15.165:3300/0 conn(0x7fd344158e50 0x7fd3440b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.341+0000 7fd34c400640 1 -- 172.21.15.144:0/1340544928 >> 172.21.15.144:0/1340544928 conn(0x7fd34406bba0 msgr2=0x7fd34406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:19.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.341+0000 7fd34c400640 1 -- 172.21.15.144:0/1340544928 shutdown_connections 2024-09-11T23:24:19.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.341+0000 7fd34c400640 1 -- 172.21.15.144:0/1340544928 wait complete. 2024-09-11T23:24:19.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.342+0000 7fd34c400640 1 Processor -- start 2024-09-11T23:24:19.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.342+0000 7fd34c400640 1 -- start start 2024-09-11T23:24:19.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.343+0000 7fd34c400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd34406ef60 0x7fd3441497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:19.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.343+0000 7fd34c400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd344158e50 0x7fd3440ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:19.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.343+0000 7fd34c400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd34415c370 0x7fd344148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:19.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.343+0000 7fd34c400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd3440b3ed0 con 0x7fd34406ef60 2024-09-11T23:24:19.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.343+0000 7fd34c400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd3440b3bf0 con 0x7fd344158e50 2024-09-11T23:24:19.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.343+0000 7fd34c400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd344159230 con 0x7fd34415c370 2024-09-11T23:24:19.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.343+0000 7fd349a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd34406ef60 0x7fd3441497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:19.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.344+0000 7fd349a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd34406ef60 0x7fd3441497a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42054/0 (socket says 172.21.15.144:42054) 2024-09-11T23:24:19.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.344+0000 7fd349a00640 1 -- 172.21.15.144:0/4233853475 learned_addr learned my addr 172.21.15.144:0/4233853475 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:19.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.344+0000 7fd349000640 1 --2- 172.21.15.144:0/4233853475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd344158e50 0x7fd3440ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:19.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.344+0000 7fd34a400640 1 --2- 172.21.15.144:0/4233853475 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd34415c370 0x7fd344148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:19.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.344+0000 7fd349a00640 1 -- 172.21.15.144:0/4233853475 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd34415c370 msgr2=0x7fd344148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:19.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.344+0000 7fd349a00640 1 --2- 172.21.15.144:0/4233853475 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd34415c370 0x7fd344148c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.344+0000 7fd349a00640 1 -- 172.21.15.144:0/4233853475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd344158e50 msgr2=0x7fd3440ab460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:19.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.344+0000 7fd349a00640 1 --2- 172.21.15.144:0/4233853475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd344158e50 0x7fd3440ab460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.344+0000 7fd349a00640 1 -- 172.21.15.144:0/4233853475 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3440abc90 con 0x7fd34406ef60 2024-09-11T23:24:19.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.344+0000 7fd349a00640 1 --2- 172.21.15.144:0/4233853475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd34406ef60 0x7fd3441497a0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fd338007ef0 tx=0x7fd33800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:19.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.344+0000 7fd341600640 1 -- 172.21.15.144:0/4233853475 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33801a070 con 0x7fd34406ef60 2024-09-11T23:24:19.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.345+0000 7fd341600640 1 -- 172.21.15.144:0/4233853475 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd338003b90 con 0x7fd34406ef60 2024-09-11T23:24:19.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.345+0000 7fd34c400640 1 -- 172.21.15.144:0/4233853475 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3440abf70 con 0x7fd34406ef60 2024-09-11T23:24:19.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.345+0000 7fd341600640 1 -- 172.21.15.144:0/4233853475 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd338004030 con 0x7fd34406ef60 2024-09-11T23:24:19.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.345+0000 7fd34c400640 1 -- 172.21.15.144:0/4233853475 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3440ac530 con 0x7fd34406ef60 2024-09-11T23:24:19.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.346+0000 7fd34c400640 1 -- 172.21.15.144:0/4233853475 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd34406ea20 con 0x7fd34406ef60 2024-09-11T23:24:19.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.347+0000 7fd341600640 1 -- 172.21.15.144:0/4233853475 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 21) ==== 90906+0+0 (secure 0 0 0) 0x7fd33801d070 con 0x7fd34406ef60 2024-09-11T23:24:19.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.347+0000 7fd341600640 1 --2- 172.21.15.144:0/4233853475 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd32406c2b0 0x7fd32406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:19.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.348+0000 7fd341600640 1 -- 172.21.15.144:0/4233853475 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7fd33808b9a0 con 0x7fd34406ef60 2024-09-11T23:24:19.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.348+0000 7fd349000640 1 --2- 172.21.15.144:0/4233853475 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd32406c2b0 0x7fd32406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:19.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.349+0000 7fd349000640 1 --2- 172.21.15.144:0/4233853475 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd32406c2b0 0x7fd32406e770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd3440ab3f0 tx=0x7fd330008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:19.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.352+0000 7fd341600640 1 -- 172.21.15.144:0/4233853475 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd338010070 con 0x7fd34406ef60 2024-09-11T23:24:19.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.550+0000 7fd34c400640 1 -- 172.21.15.144:0/4233853475 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol33240", "target": ["mon-mgr", ""]}) -- 0x7fd34415c0f0 con 0x7fd32406c2b0 2024-09-11T23:24:19.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.602+0000 7fd341600640 1 -- 172.21.15.144:0/4233853475 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd34415c0f0 con 0x7fd32406c2b0 2024-09-11T23:24:19.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.604+0000 7fd34c400640 1 -- 172.21.15.144:0/4233853475 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd32406c2b0 msgr2=0x7fd32406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:19.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.604+0000 7fd34c400640 1 --2- 172.21.15.144:0/4233853475 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd32406c2b0 0x7fd32406e770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd3440ab3f0 tx=0x7fd330008040 comp rx=0 tx=0).stop 2024-09-11T23:24:19.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.604+0000 7fd34c400640 1 -- 172.21.15.144:0/4233853475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd34406ef60 msgr2=0x7fd3441497a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:19.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.604+0000 7fd34c400640 1 --2- 172.21.15.144:0/4233853475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd34406ef60 0x7fd3441497a0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fd338007ef0 tx=0x7fd33800d4a0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.604+0000 7fd34c400640 1 -- 172.21.15.144:0/4233853475 shutdown_connections 2024-09-11T23:24:19.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.605+0000 7fd34c400640 1 --2- 172.21.15.144:0/4233853475 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd32406c2b0 0x7fd32406e770 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.605+0000 7fd34c400640 1 --2- 172.21.15.144:0/4233853475 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd34415c370 0x7fd344148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.605+0000 7fd34c400640 1 --2- 172.21.15.144:0/4233853475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd344158e50 0x7fd3440ab460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.605+0000 7fd34c400640 1 --2- 172.21.15.144:0/4233853475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd34406ef60 0x7fd3441497a0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.605+0000 7fd34c400640 1 -- 172.21.15.144:0/4233853475 >> 172.21.15.144:0/4233853475 conn(0x7fd34406bba0 msgr2=0x7fd34406d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:19.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.605+0000 7fd34c400640 1 -- 172.21.15.144:0/4233853475 shutdown_connections 2024-09-11T23:24:19.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.605+0000 7fd34c400640 1 -- 172.21.15.144:0/4233853475 wait complete. 2024-09-11T23:24:19.610 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:19.610+0000 7f30e0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:24:19.610 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:19.610+0000 7f30e0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:24:19.610 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:19.610+0000 7f30e0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:24:19.610 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:19.610+0000 7f30e0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:24:19.610 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:19.610+0000 7f30e0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:24:19.621 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol35011 subvol_grp65310 2024-09-11T23:24:19.627 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:19.627+0000 7f30e1400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:24:19.628 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:19.627+0000 7f30e1400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:24:19.628 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:19.627+0000 7f30e1400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:24:19.628 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:19.627+0000 7f30e1400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:24:19.628 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:19.627+0000 7f30e1400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:24:19.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.782+0000 7f09cd400640 1 Processor -- start 2024-09-11T23:24:19.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.782+0000 7f09cd400640 1 -- start start 2024-09-11T23:24:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.783+0000 7f09cd400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f09c8070710 0x7f09c8070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.783+0000 7f09cd400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09c806e8a0 0x7f09c815f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.783+0000 7f09cd400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09c8071030 con 0x7f09c815f0d0 2024-09-11T23:24:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.783+0000 7f09cd400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f09c806d400 con 0x7f09c8070710 2024-09-11T23:24:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.783+0000 7f09cd400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f09c8162440 con 0x7f09c806e8a0 2024-09-11T23:24:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.783+0000 7f09c7400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f09c815f0d0 0x7f09c8072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51628/0 (socket says 172.21.15.144:51628) 2024-09-11T23:24:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.784+0000 7f09c7400640 1 -- 172.21.15.144:0/4153537162 learned_addr learned my addr 172.21.15.144:0/4153537162 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.784+0000 7f09c7e00640 1 --2- 172.21.15.144:0/4153537162 >> v2:172.21.15.165:3300/0 conn(0x7f09c8070710 0x7f09c8070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.784+0000 7f09cca00640 1 --2- 172.21.15.144:0/4153537162 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09c806e8a0 0x7f09c815f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.784+0000 7f09c6a00640 1 -- 172.21.15.144:0/4153537162 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1557024733 0 0) 0x7f09c8071030 con 0x7f09c815f0d0 2024-09-11T23:24:19.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.784+0000 7f09c6a00640 1 -- 172.21.15.144:0/4153537162 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09ac003520 con 0x7f09c815f0d0 2024-09-11T23:24:19.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.784+0000 7f09c7e00640 1 -- 172.21.15.144:0/4153537162 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09c806e8a0 msgr2=0x7f09c815f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:19.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.784+0000 7f09c7e00640 1 --2- 172.21.15.144:0/4153537162 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09c806e8a0 0x7f09c815f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.784+0000 7f09c7e00640 1 -- 172.21.15.144:0/4153537162 >> v1:172.21.15.144:6789/0 conn(0x7f09c815f0d0 legacy=0x7f09c8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:19.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.784+0000 7f09c7e00640 1 -- 172.21.15.144:0/4153537162 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c8162720 con 0x7f09c8070710 2024-09-11T23:24:19.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.784+0000 7f09cca00640 1 --2- 172.21.15.144:0/4153537162 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09c806e8a0 0x7f09c815f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:24:19.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.786+0000 7f09c7e00640 1 --2- 172.21.15.144:0/4153537162 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09c8070710 0x7f09c8070af0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f09b80097a0 tx=0x7f09b802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64328da6d51ad4a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:19.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.786+0000 7f09c6a00640 1 -- 172.21.15.144:0/4153537162 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b8037070 con 0x7f09c8070710 2024-09-11T23:24:19.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.786+0000 7f09c6a00640 1 -- 172.21.15.144:0/4153537162 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b8032440 con 0x7f09c8070710 2024-09-11T23:24:19.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.786+0000 7f09c6a00640 1 -- 172.21.15.144:0/4153537162 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b80327f0 con 0x7f09c8070710 2024-09-11T23:24:19.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.787+0000 7f09cd400640 1 -- 172.21.15.144:0/4153537162 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09c8070710 msgr2=0x7f09c8070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:19.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.787+0000 7f09cd400640 1 --2- 172.21.15.144:0/4153537162 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09c8070710 0x7f09c8070af0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f09b80097a0 tx=0x7f09b802a210 comp rx=0 tx=0).stop 2024-09-11T23:24:19.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.787+0000 7f09cd400640 1 -- 172.21.15.144:0/4153537162 shutdown_connections 2024-09-11T23:24:19.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.787+0000 7f09cd400640 1 --2- 172.21.15.144:0/4153537162 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09c806e8a0 0x7f09c815f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.787+0000 7f09cd400640 1 --2- 172.21.15.144:0/4153537162 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09c8070710 0x7f09c8070af0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.787+0000 7f09cd400640 1 -- 172.21.15.144:0/4153537162 >> 172.21.15.144:0/4153537162 conn(0x7f09c80b40d0 msgr2=0x7f09c80b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:19.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.787+0000 7f09cd400640 1 -- 172.21.15.144:0/4153537162 shutdown_connections 2024-09-11T23:24:19.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.787+0000 7f09cd400640 1 -- 172.21.15.144:0/4153537162 wait complete. 2024-09-11T23:24:19.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.788+0000 7f09cd400640 1 Processor -- start 2024-09-11T23:24:19.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.789+0000 7f09cd400640 1 -- start start 2024-09-11T23:24:19.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.789+0000 7f09cd400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09c806e8a0 0x7f09c80cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.790+0000 7f09cd400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09c8070710 0x7f09c80c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.790+0000 7f09cd400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09c815f0d0 0x7f09c80c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.790+0000 7f09cd400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f09c80b60d0 con 0x7f09c815f0d0 2024-09-11T23:24:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.790+0000 7f09cd400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f09c8162ce0 con 0x7f09c806e8a0 2024-09-11T23:24:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.790+0000 7f09cd400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f09c80b6250 con 0x7f09c8070710 2024-09-11T23:24:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.790+0000 7f09cca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09c815f0d0 0x7f09c80c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.790+0000 7f09cca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09c815f0d0 0x7f09c80c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42056/0 (socket says 172.21.15.144:42056) 2024-09-11T23:24:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.790+0000 7f09cca00640 1 -- 172.21.15.144:0/3118938184 learned_addr learned my addr 172.21.15.144:0/3118938184 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.790+0000 7f09c7400640 1 --2- 172.21.15.144:0/3118938184 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09c8070710 0x7f09c80c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.790+0000 7f09c7e00640 1 --2- 172.21.15.144:0/3118938184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09c806e8a0 0x7f09c80cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.790+0000 7f09cca00640 1 -- 172.21.15.144:0/3118938184 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09c8070710 msgr2=0x7f09c80c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.790+0000 7f09cca00640 1 --2- 172.21.15.144:0/3118938184 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09c8070710 0x7f09c80c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.790+0000 7f09cca00640 1 -- 172.21.15.144:0/3118938184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09c806e8a0 msgr2=0x7f09c80cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.790+0000 7f09cca00640 1 --2- 172.21.15.144:0/3118938184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09c806e8a0 0x7f09c80cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.790+0000 7f09cca00640 1 -- 172.21.15.144:0/3118938184 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c80afb80 con 0x7f09c815f0d0 2024-09-11T23:24:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.790+0000 7f09c7e00640 1 --2- 172.21.15.144:0/3118938184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09c806e8a0 0x7f09c80cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.790+0000 7f09c7400640 1 --2- 172.21.15.144:0/3118938184 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09c8070710 0x7f09c80c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.790+0000 7f09cca00640 1 --2- 172.21.15.144:0/3118938184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09c815f0d0 0x7f09c80c8230 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f09c000ef90 tx=0x7f09c0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.791+0000 7f09bfe00640 1 -- 172.21.15.144:0/3118938184 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c0018020 con 0x7f09c815f0d0 2024-09-11T23:24:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.791+0000 7f09bfe00640 1 -- 172.21.15.144:0/3118938184 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c0014480 con 0x7f09c815f0d0 2024-09-11T23:24:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.791+0000 7f09bfe00640 1 -- 172.21.15.144:0/3118938184 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c0014870 con 0x7f09c815f0d0 2024-09-11T23:24:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.791+0000 7f09cd400640 1 -- 172.21.15.144:0/3118938184 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c80afe60 con 0x7f09c815f0d0 2024-09-11T23:24:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.791+0000 7f09cd400640 1 -- 172.21.15.144:0/3118938184 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c80b0420 con 0x7f09c815f0d0 2024-09-11T23:24:19.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.792+0000 7f09cd400640 1 -- 172.21.15.144:0/3118938184 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09c80b0620 con 0x7f09c815f0d0 2024-09-11T23:24:19.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.793+0000 7f09bfe00640 1 -- 172.21.15.144:0/3118938184 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 21) ==== 90906+0+0 (secure 0 0 0) 0x7f09c0005d10 con 0x7f09c815f0d0 2024-09-11T23:24:19.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.794+0000 7f09bfe00640 1 --2- 172.21.15.144:0/3118938184 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f09a806c2b0 0x7f09a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:19.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.794+0000 7f09bfe00640 1 -- 172.21.15.144:0/3118938184 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7f09c008c5c0 con 0x7f09c815f0d0 2024-09-11T23:24:19.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.794+0000 7f09c7e00640 1 --2- 172.21.15.144:0/3118938184 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f09a806c2b0 0x7f09a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:19.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.795+0000 7f09c7e00640 1 --2- 172.21.15.144:0/3118938184 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f09a806c2b0 0x7f09a806e770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f09b8034000 tx=0x7f09b802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:19.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:19.798+0000 7f09bfe00640 1 -- 172.21.15.144:0/3118938184 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f09c80b0620 con 0x7f09c815f0d0 2024-09-11T23:24:19.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.000+0000 7f09cd400640 1 -- 172.21.15.144:0/3118938184 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol35011", "group_name": "subvol_grp65310", "target": ["mon-mgr", ""]}) -- 0x7f09c80ce8a0 con 0x7f09a806c2b0 2024-09-11T23:24:20.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.049+0000 7f09bfe00640 1 -- 172.21.15.144:0/3118938184 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f09c80ce8a0 con 0x7f09a806c2b0 2024-09-11T23:24:20.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.052+0000 7f09cd400640 1 -- 172.21.15.144:0/3118938184 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f09a806c2b0 msgr2=0x7f09a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:20.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.052+0000 7f09cd400640 1 --2- 172.21.15.144:0/3118938184 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f09a806c2b0 0x7f09a806e770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f09b8034000 tx=0x7f09b802e000 comp rx=0 tx=0).stop 2024-09-11T23:24:20.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.052+0000 7f09cd400640 1 -- 172.21.15.144:0/3118938184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09c815f0d0 msgr2=0x7f09c80c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:20.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.052+0000 7f09cd400640 1 --2- 172.21.15.144:0/3118938184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09c815f0d0 0x7f09c80c8230 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f09c000ef90 tx=0x7f09c0009f90 comp rx=0 tx=0).stop 2024-09-11T23:24:20.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.052+0000 7f09cd400640 1 -- 172.21.15.144:0/3118938184 shutdown_connections 2024-09-11T23:24:20.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.052+0000 7f09cd400640 1 --2- 172.21.15.144:0/3118938184 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f09a806c2b0 0x7f09a806e770 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:20.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.052+0000 7f09cd400640 1 --2- 172.21.15.144:0/3118938184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09c815f0d0 0x7f09c80c8230 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:20.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.052+0000 7f09cd400640 1 --2- 172.21.15.144:0/3118938184 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09c8070710 0x7f09c80c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:20.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.052+0000 7f09cd400640 1 --2- 172.21.15.144:0/3118938184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09c806e8a0 0x7f09c80cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:20.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.052+0000 7f09cd400640 1 -- 172.21.15.144:0/3118938184 >> 172.21.15.144:0/3118938184 conn(0x7f09c80b40d0 msgr2=0x7f09c80d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:20.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.052+0000 7f09cd400640 1 -- 172.21.15.144:0/3118938184 shutdown_connections 2024-09-11T23:24:20.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.052+0000 7f09cd400640 1 -- 172.21.15.144:0/3118938184 wait complete. 2024-09-11T23:24:20.072 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol33612 2024-09-11T23:24:20.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.233+0000 7f1684000640 1 Processor -- start 2024-09-11T23:24:20.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.234+0000 7f1684000640 1 -- start start 2024-09-11T23:24:20.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.235+0000 7f1684000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f167c15d3b0 0x7f167c071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:20.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.235+0000 7f1684000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f167c0cf320 0x7f167c0cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:20.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.235+0000 7f1684000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f167c0715c0 con 0x7f167c15d790 2024-09-11T23:24:20.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.235+0000 7f1684000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f167c06da30 con 0x7f167c15d3b0 2024-09-11T23:24:20.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.235+0000 7f1684000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f167c06d700 con 0x7f167c0cf320 2024-09-11T23:24:20.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.235+0000 7f1681600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f167c15d3b0 0x7f167c071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:20.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.235+0000 7f1681600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f167c15d3b0 0x7f167c071080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42068/0 (socket says 172.21.15.144:42068) 2024-09-11T23:24:20.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.235+0000 7f1681600640 1 -- 172.21.15.144:0/3478453158 learned_addr learned my addr 172.21.15.144:0/3478453158 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:20.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.235+0000 7f1682000640 1 --2- 172.21.15.144:0/3478453158 >> v2:172.21.15.165:3300/0 conn(0x7f167c0cf320 0x7f167c0cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:20.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.236+0000 7f1681600640 1 -- 172.21.15.144:0/3478453158 >> v2:172.21.15.165:3300/0 conn(0x7f167c0cf320 msgr2=0x7f167c0cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:20.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.236+0000 7f1681600640 1 --2- 172.21.15.144:0/3478453158 >> v2:172.21.15.165:3300/0 conn(0x7f167c0cf320 0x7f167c0cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:20.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.236+0000 7f1681600640 1 -- 172.21.15.144:0/3478453158 >> v1:172.21.15.144:6789/0 conn(0x7f167c15d790 legacy=0x7f167c0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:20.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.236+0000 7f1681600640 1 -- 172.21.15.144:0/3478453158 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f167c0cde80 con 0x7f167c15d3b0 2024-09-11T23:24:20.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.237+0000 7f1681600640 1 --2- 172.21.15.144:0/3478453158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f167c15d3b0 0x7f167c071080 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f167c15c9c0 tx=0x7f167002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff42bed8f119a5b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:20.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.237+0000 7f167be00640 1 -- 172.21.15.144:0/3478453158 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1670037070 con 0x7f167c15d3b0 2024-09-11T23:24:20.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.237+0000 7f167be00640 1 -- 172.21.15.144:0/3478453158 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1670032440 con 0x7f167c15d3b0 2024-09-11T23:24:20.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.237+0000 7f167be00640 1 -- 172.21.15.144:0/3478453158 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1670032810 con 0x7f167c15d3b0 2024-09-11T23:24:20.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.237+0000 7f1684000640 1 -- 172.21.15.144:0/3478453158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f167c15d3b0 msgr2=0x7f167c071080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:20.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.237+0000 7f1684000640 1 --2- 172.21.15.144:0/3478453158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f167c15d3b0 0x7f167c071080 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f167c15c9c0 tx=0x7f167002a270 comp rx=0 tx=0).stop 2024-09-11T23:24:20.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.238+0000 7f1684000640 1 -- 172.21.15.144:0/3478453158 shutdown_connections 2024-09-11T23:24:20.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.238+0000 7f1684000640 1 --2- 172.21.15.144:0/3478453158 >> v2:172.21.15.165:3300/0 conn(0x7f167c0cf320 0x7f167c0cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:20.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.238+0000 7f1684000640 1 --2- 172.21.15.144:0/3478453158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f167c15d3b0 0x7f167c071080 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:20.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.238+0000 7f1684000640 1 -- 172.21.15.144:0/3478453158 >> 172.21.15.144:0/3478453158 conn(0x7f167c06bba0 msgr2=0x7f167c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:20.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.238+0000 7f1684000640 1 -- 172.21.15.144:0/3478453158 shutdown_connections 2024-09-11T23:24:20.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.238+0000 7f1684000640 1 -- 172.21.15.144:0/3478453158 wait complete. 2024-09-11T23:24:20.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.239+0000 7f1684000640 1 Processor -- start 2024-09-11T23:24:20.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.239+0000 7f1684000640 1 -- start start 2024-09-11T23:24:20.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.240+0000 7f1684000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f167c0cf320 0x7f167c15b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:20.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.240+0000 7f1684000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f167c15d3b0 0x7f167c155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.240+0000 7f1684000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f167c158fb0 0x7f167c0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.240+0000 7f1684000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f167c0cfcd0 con 0x7f167c15d3b0 2024-09-11T23:24:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.240+0000 7f1684000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f167c0cdba0 con 0x7f167c0cf320 2024-09-11T23:24:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.240+0000 7f1684000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f167c0cd580 con 0x7f167c158fb0 2024-09-11T23:24:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.241+0000 7f1680c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f167c15d3b0 0x7f167c155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.241+0000 7f1680c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f167c15d3b0 0x7f167c155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42072/0 (socket says 172.21.15.144:42072) 2024-09-11T23:24:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.241+0000 7f1680c00640 1 -- 172.21.15.144:0/1459666491 learned_addr learned my addr 172.21.15.144:0/1459666491 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.241+0000 7f1681600640 1 --2- 172.21.15.144:0/1459666491 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f167c0cf320 0x7f167c15b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.241+0000 7f1682000640 1 --2- 172.21.15.144:0/1459666491 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f167c158fb0 0x7f167c0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.241+0000 7f1680c00640 1 -- 172.21.15.144:0/1459666491 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f167c158fb0 msgr2=0x7f167c0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.241+0000 7f1680c00640 1 --2- 172.21.15.144:0/1459666491 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f167c158fb0 0x7f167c0b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.241+0000 7f1680c00640 1 -- 172.21.15.144:0/1459666491 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f167c0cf320 msgr2=0x7f167c15b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:20.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.241+0000 7f1680c00640 1 --2- 172.21.15.144:0/1459666491 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f167c0cf320 0x7f167c15b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.241+0000 7f1680c00640 1 -- 172.21.15.144:0/1459666491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f167c15a310 con 0x7f167c15d3b0 2024-09-11T23:24:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.241+0000 7f1682000640 1 --2- 172.21.15.144:0/1459666491 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f167c158fb0 0x7f167c0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:24:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.241+0000 7f1680c00640 1 --2- 172.21.15.144:0/1459666491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f167c15d3b0 0x7f167c155c40 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f166800c3c0 tx=0x7f166800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.241+0000 7f1679600640 1 -- 172.21.15.144:0/1459666491 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668007020 con 0x7f167c15d3b0 2024-09-11T23:24:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.242+0000 7f1679600640 1 -- 172.21.15.144:0/1459666491 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16680071c0 con 0x7f167c15d3b0 2024-09-11T23:24:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.242+0000 7f1679600640 1 -- 172.21.15.144:0/1459666491 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668007630 con 0x7f167c15d3b0 2024-09-11T23:24:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.242+0000 7f1684000640 1 -- 172.21.15.144:0/1459666491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f167c159790 con 0x7f167c15d3b0 2024-09-11T23:24:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.242+0000 7f1684000640 1 -- 172.21.15.144:0/1459666491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f167c159d50 con 0x7f167c15d3b0 2024-09-11T23:24:20.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.243+0000 7f1684000640 1 -- 172.21.15.144:0/1459666491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f167c15cbf0 con 0x7f167c15d3b0 2024-09-11T23:24:20.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.244+0000 7f1679600640 1 -- 172.21.15.144:0/1459666491 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 21) ==== 90906+0+0 (secure 0 0 0) 0x7f16680067b0 con 0x7f167c15d3b0 2024-09-11T23:24:20.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.245+0000 7f1679600640 1 --2- 172.21.15.144:0/1459666491 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f165c06c2e0 0x7f165c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:20.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.245+0000 7f1679600640 1 -- 172.21.15.144:0/1459666491 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7f166808ab10 con 0x7f167c15d3b0 2024-09-11T23:24:20.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.245+0000 7f1681600640 1 --2- 172.21.15.144:0/1459666491 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f165c06c2e0 0x7f165c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:20.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.246+0000 7f1681600640 1 --2- 172.21.15.144:0/1459666491 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f165c06c2e0 0x7f165c06e7a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1670034000 tx=0x7f167002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:20.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.249+0000 7f1679600640 1 -- 172.21.15.144:0/1459666491 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1668058d80 con 0x7f167c15d3b0 2024-09-11T23:24:20.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.456+0000 7f1684000640 1 -- 172.21.15.144:0/1459666491 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol33612", "target": ["mon-mgr", ""]}) -- 0x7f167c06e7b0 con 0x7f165c06c2e0 2024-09-11T23:24:20.479 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:20.478+0000 7f30de200640 -1 mgr.server reply reply (11) Resource temporarily unavailable subvolume 'subvol33612' is not ready for operation rm (use --force to override) 2024-09-11T23:24:20.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.479+0000 7f1679600640 1 -- 172.21.15.144:0/1459666491 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -11 subvolume 'subvol33612' is not ready for operation rm (use --force to override)) ==== 87+0+0 (secure 0 0 0) 0x7f167c06e7b0 con 0x7f165c06c2e0 2024-09-11T23:24:20.479 INFO:teuthology.orchestra.run.smithi144.stderr:Error EAGAIN: subvolume 'subvol33612' is not ready for operation rm (use --force to override) 2024-09-11T23:24:20.494 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-09-11T23:24:20.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:20.495 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol33612/.meta) 2024-09-11T23:24:20.562 INFO:teuthology.orchestra.run.smithi144.stdout:[GLOBAL] 2024-09-11T23:24:20.562 INFO:teuthology.orchestra.run.smithi144.stdout:version = 1 2024-09-11T23:24:20.562 INFO:teuthology.orchestra.run.smithi144.stdout:type = clone 2024-09-11T23:24:20.562 INFO:teuthology.orchestra.run.smithi144.stdout:path = /volumes/_nogroup/subvol33612/8b713714-56b2-4efc-8311-ae142d179c3c 2024-09-11T23:24:20.562 INFO:teuthology.orchestra.run.smithi144.stdout:state = pending 2024-09-11T23:24:20.562 INFO:teuthology.orchestra.run.smithi144.stdout:[source] 2024-09-11T23:24:20.562 INFO:teuthology.orchestra.run.smithi144.stdout:volume = fake 2024-09-11T23:24:20.563 INFO:teuthology.orchestra.run.smithi144.stdout:subvolume = fake 2024-09-11T23:24:20.563 INFO:teuthology.orchestra.run.smithi144.stdout:snapshot = fake 2024-09-11T23:24:20.567 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol33612 --force 2024-09-11T23:24:20.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.736+0000 7fe656600640 1 Processor -- start 2024-09-11T23:24:20.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.737+0000 7fe656600640 1 -- start start 2024-09-11T23:24:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.738+0000 7fe656600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe6500d32d0 0x7fe65006d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.738+0000 7fe656600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6500d3890 con 0x7fe65015e650 2024-09-11T23:24:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.738+0000 7fe656600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6500d3b70 con 0x7fe65006db50 2024-09-11T23:24:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.738+0000 7fe656600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe65015ea30 con 0x7fe6500d32d0 2024-09-11T23:24:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.738+0000 7fe655200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe65015e650 0x7fe6500cf6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51648/0 (socket says 172.21.15.144:51648) 2024-09-11T23:24:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.738+0000 7fe655200640 1 -- 172.21.15.144:0/1580309118 learned_addr learned my addr 172.21.15.144:0/1580309118 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.738+0000 7fe64fe00640 1 --2- 172.21.15.144:0/1580309118 >> v2:172.21.15.165:3300/0 conn(0x7fe6500d32d0 0x7fe65006d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.738+0000 7fe64f400640 1 -- 172.21.15.144:0/1580309118 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2249628539 0 0) 0x7fe6500d3890 con 0x7fe65015e650 2024-09-11T23:24:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.738+0000 7fe64f400640 1 -- 172.21.15.144:0/1580309118 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe638003520 con 0x7fe65015e650 2024-09-11T23:24:20.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.739+0000 7fe64f400640 1 -- 172.21.15.144:0/1580309118 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3296945909 0 0) 0x7fe6500d3b70 con 0x7fe65006db50 2024-09-11T23:24:20.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.739+0000 7fe64f400640 1 -- 172.21.15.144:0/1580309118 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6500d3890 con 0x7fe65006db50 2024-09-11T23:24:20.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.739+0000 7fe64f400640 1 -- 172.21.15.144:0/1580309118 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1852655196 0 0) 0x7fe638003520 con 0x7fe65015e650 2024-09-11T23:24:20.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.739+0000 7fe64f400640 1 -- 172.21.15.144:0/1580309118 >> v2:172.21.15.165:3300/0 conn(0x7fe6500d32d0 msgr2=0x7fe65006d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:20.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.739+0000 7fe64f400640 1 --2- 172.21.15.144:0/1580309118 >> v2:172.21.15.165:3300/0 conn(0x7fe6500d32d0 0x7fe65006d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:20.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.739+0000 7fe64f400640 1 -- 172.21.15.144:0/1580309118 >> v1:172.21.15.165:6789/0 conn(0x7fe65006db50 legacy=0x7fe6500b7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:20.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.739+0000 7fe64f400640 1 -- 172.21.15.144:0/1580309118 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6500d3e50 con 0x7fe65015e650 2024-09-11T23:24:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.739+0000 7fe64f400640 1 -- 172.21.15.144:0/1580309118 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fe644001670 con 0x7fe65015e650 2024-09-11T23:24:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.739+0000 7fe64f400640 1 -- 172.21.15.144:0/1580309118 >> v1:172.21.15.144:6789/0 conn(0x7fe65015e650 legacy=0x7fe6500cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.739+0000 7fe64f400640 1 --2- 172.21.15.144:0/1580309118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe638003b40 0x7fe638003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.739+0000 7fe64f400640 1 --2- 172.21.15.144:0/1580309118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe638004800 0x7fe638004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.739+0000 7fe64f400640 1 --2- 172.21.15.144:0/1580309118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6380051c0 0x7fe63800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.739+0000 7fe64f400640 1 -- 172.21.15.144:0/1580309118 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe63800bfb0 con 0x7fe6380051c0 2024-09-11T23:24:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.739+0000 7fe64f400640 1 -- 172.21.15.144:0/1580309118 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe63800c130 con 0x7fe638004800 2024-09-11T23:24:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.739+0000 7fe64f400640 1 -- 172.21.15.144:0/1580309118 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe63800c330 con 0x7fe638003b40 2024-09-11T23:24:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.739+0000 7fe655c00640 1 --2- 172.21.15.144:0/1580309118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6380051c0 0x7fe63800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.739+0000 7fe655200640 1 --2- 172.21.15.144:0/1580309118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe638003b40 0x7fe638003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.739+0000 7fe64fe00640 1 --2- 172.21.15.144:0/1580309118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe638004800 0x7fe638004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.740+0000 7fe655200640 1 -- 172.21.15.144:0/1580309118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe638004800 msgr2=0x7fe638004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.740+0000 7fe655200640 1 --2- 172.21.15.144:0/1580309118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe638004800 0x7fe638004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:20.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.740+0000 7fe655200640 1 -- 172.21.15.144:0/1580309118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6380051c0 msgr2=0x7fe63800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:20.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.740+0000 7fe655200640 1 --2- 172.21.15.144:0/1580309118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6380051c0 0x7fe63800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:20.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.740+0000 7fe655200640 1 -- 172.21.15.144:0/1580309118 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe638003520 con 0x7fe638003b40 2024-09-11T23:24:20.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.740+0000 7fe655c00640 1 --2- 172.21.15.144:0/1580309118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6380051c0 0x7fe63800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:24:20.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.740+0000 7fe655c00640 1 -- 172.21.15.144:0/1580309118 reap_dead start 2024-09-11T23:24:20.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.741+0000 7fe655200640 1 --2- 172.21.15.144:0/1580309118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe638003b40 0x7fe638003f40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe64400c1c0 tx=0x7fe638005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dc29af1af8d0d52 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:20.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.741+0000 7fe64f400640 1 -- 172.21.15.144:0/1580309118 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe644007cc0 con 0x7fe638003b40 2024-09-11T23:24:20.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.741+0000 7fe64f400640 1 -- 172.21.15.144:0/1580309118 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe644005ad0 con 0x7fe638003b40 2024-09-11T23:24:20.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.741+0000 7fe64f400640 1 -- 172.21.15.144:0/1580309118 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe644007070 con 0x7fe638003b40 2024-09-11T23:24:20.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.742+0000 7fe656600640 1 -- 172.21.15.144:0/1580309118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe638003b40 msgr2=0x7fe638003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:20.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.742+0000 7fe656600640 1 --2- 172.21.15.144:0/1580309118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe638003b40 0x7fe638003f40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe64400c1c0 tx=0x7fe638005830 comp rx=0 tx=0).stop 2024-09-11T23:24:20.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.742+0000 7fe656600640 1 -- 172.21.15.144:0/1580309118 shutdown_connections 2024-09-11T23:24:20.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.742+0000 7fe656600640 1 --2- 172.21.15.144:0/1580309118 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe638003b40 0x7fe638003f40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:20.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.742+0000 7fe656600640 1 -- 172.21.15.144:0/1580309118 >> 172.21.15.144:0/1580309118 conn(0x7fe6500d4740 msgr2=0x7fe6500d4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:20.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.742+0000 7fe656600640 1 -- 172.21.15.144:0/1580309118 shutdown_connections 2024-09-11T23:24:20.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.742+0000 7fe656600640 1 -- 172.21.15.144:0/1580309118 wait complete. 2024-09-11T23:24:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.744+0000 7fe656600640 1 Processor -- start 2024-09-11T23:24:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.744+0000 7fe656600640 1 -- start start 2024-09-11T23:24:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.745+0000 7fe656600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe638003b40 0x7fe6500cab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.745+0000 7fe656600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6501e6d60 0x7fe65015aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.745+0000 7fe656600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6500b5140 0x7fe6500b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.745+0000 7fe656600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe6500b7690 con 0x7fe6501e6d60 2024-09-11T23:24:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.745+0000 7fe656600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe65006df90 con 0x7fe6500b5140 2024-09-11T23:24:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.745+0000 7fe656600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe6500b7810 con 0x7fe638003b40 2024-09-11T23:24:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.745+0000 7fe64fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6501e6d60 0x7fe65015aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.745+0000 7fe64fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6501e6d60 0x7fe65015aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42094/0 (socket says 172.21.15.144:42094) 2024-09-11T23:24:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.745+0000 7fe64fe00640 1 -- 172.21.15.144:0/3426053372 learned_addr learned my addr 172.21.15.144:0/3426053372 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.745+0000 7fe655c00640 1 --2- 172.21.15.144:0/3426053372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6500b5140 0x7fe6500b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.745+0000 7fe655200640 1 --2- 172.21.15.144:0/3426053372 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe638003b40 0x7fe6500cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.746+0000 7fe64fe00640 1 -- 172.21.15.144:0/3426053372 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe638003b40 msgr2=0x7fe6500cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.746+0000 7fe64fe00640 1 --2- 172.21.15.144:0/3426053372 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe638003b40 0x7fe6500cab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.746+0000 7fe64fe00640 1 -- 172.21.15.144:0/3426053372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6500b5140 msgr2=0x7fe6500b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:20.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.746+0000 7fe64fe00640 1 --2- 172.21.15.144:0/3426053372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6500b5140 0x7fe6500b55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:20.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.746+0000 7fe64fe00640 1 -- 172.21.15.144:0/3426053372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6501f4170 con 0x7fe6501e6d60 2024-09-11T23:24:20.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.746+0000 7fe64fe00640 1 --2- 172.21.15.144:0/3426053372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6501e6d60 0x7fe65015aaf0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0118c0 tx=0x7fe63c011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:20.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.746+0000 7fe64cc00640 1 -- 172.21.15.144:0/3426053372 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c019070 con 0x7fe6501e6d60 2024-09-11T23:24:20.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.746+0000 7fe64cc00640 1 -- 172.21.15.144:0/3426053372 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63c004240 con 0x7fe6501e6d60 2024-09-11T23:24:20.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.746+0000 7fe64cc00640 1 -- 172.21.15.144:0/3426053372 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c00f7c0 con 0x7fe6501e6d60 2024-09-11T23:24:20.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.746+0000 7fe656600640 1 -- 172.21.15.144:0/3426053372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6501e7590 con 0x7fe6501e6d60 2024-09-11T23:24:20.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.746+0000 7fe656600640 1 -- 172.21.15.144:0/3426053372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6501e7b50 con 0x7fe6501e6d60 2024-09-11T23:24:20.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.748+0000 7fe656600640 1 -- 172.21.15.144:0/3426053372 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6500b5b00 con 0x7fe6501e6d60 2024-09-11T23:24:20.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.749+0000 7fe64cc00640 1 -- 172.21.15.144:0/3426053372 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 21) ==== 90906+0+0 (secure 0 0 0) 0x7fe63c01c070 con 0x7fe6501e6d60 2024-09-11T23:24:20.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.751+0000 7fe64cc00640 1 --2- 172.21.15.144:0/3426053372 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe63006c2b0 0x7fe63006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:20.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.751+0000 7fe64cc00640 1 -- 172.21.15.144:0/3426053372 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5767+0+0 (secure 0 0 0) 0x7fe63c08b960 con 0x7fe6501e6d60 2024-09-11T23:24:20.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.751+0000 7fe655200640 1 --2- 172.21.15.144:0/3426053372 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe63006c2b0 0x7fe63006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:20.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.752+0000 7fe655200640 1 --2- 172.21.15.144:0/3426053372 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe63006c2b0 0x7fe63006e770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe644032000 tx=0x7fe644009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:20.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.755+0000 7fe64cc00640 1 -- 172.21.15.144:0/3426053372 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe63c059650 con 0x7fe6501e6d60 2024-09-11T23:24:20.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.960+0000 7fe656600640 1 -- 172.21.15.144:0/3426053372 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol33612", "force": true, "target": ["mon-mgr", ""]}) -- 0x7fe6500d4ea0 con 0x7fe63006c2b0 2024-09-11T23:24:20.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.989+0000 7fe64cc00640 1 -- 172.21.15.144:0/3426053372 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe6500d4ea0 con 0x7fe63006c2b0 2024-09-11T23:24:20.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.991+0000 7fe656600640 1 -- 172.21.15.144:0/3426053372 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe63006c2b0 msgr2=0x7fe63006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:20.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.991+0000 7fe656600640 1 --2- 172.21.15.144:0/3426053372 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe63006c2b0 0x7fe63006e770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe644032000 tx=0x7fe644009030 comp rx=0 tx=0).stop 2024-09-11T23:24:20.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.991+0000 7fe656600640 1 -- 172.21.15.144:0/3426053372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6501e6d60 msgr2=0x7fe65015aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:20.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.991+0000 7fe656600640 1 --2- 172.21.15.144:0/3426053372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6501e6d60 0x7fe65015aaf0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0118c0 tx=0x7fe63c011d80 comp rx=0 tx=0).stop 2024-09-11T23:24:20.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.992+0000 7fe656600640 1 -- 172.21.15.144:0/3426053372 shutdown_connections 2024-09-11T23:24:20.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.992+0000 7fe656600640 1 --2- 172.21.15.144:0/3426053372 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe63006c2b0 0x7fe63006e770 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:20.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.992+0000 7fe656600640 1 --2- 172.21.15.144:0/3426053372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6500b5140 0x7fe6500b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:20.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.992+0000 7fe656600640 1 --2- 172.21.15.144:0/3426053372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe6501e6d60 0x7fe65015aaf0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:20.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.992+0000 7fe656600640 1 --2- 172.21.15.144:0/3426053372 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe638003b40 0x7fe6500cab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:20.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.992+0000 7fe656600640 1 -- 172.21.15.144:0/3426053372 >> 172.21.15.144:0/3426053372 conn(0x7fe6500d4740 msgr2=0x7fe650160f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:20.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.992+0000 7fe656600640 1 -- 172.21.15.144:0/3426053372 shutdown_connections 2024-09-11T23:24:20.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:20.992+0000 7fe656600640 1 -- 172.21.15.144:0/3426053372 wait complete. 2024-09-11T23:24:21.013 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs 2024-09-11T23:24:21.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.179+0000 7fedeb200640 1 Processor -- start 2024-09-11T23:24:21.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.179+0000 7fedeb200640 1 -- start start 2024-09-11T23:24:21.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.180+0000 7fedeb200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fedec06d6e0 0x7fedec0d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:21.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.180+0000 7fedeb200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fedec15e6f0 0x7fedec06dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:21.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.180+0000 7fedeb200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fedec0b73c0 0x7fedec161ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:21.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.180+0000 7fedeb200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fedec06e000 con 0x7fedec06d6e0 2024-09-11T23:24:21.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.180+0000 7fedeb200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fedec0b7930 con 0x7fedec0b73c0 2024-09-11T23:24:21.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.180+0000 7fedeb200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fedec0b90a0 con 0x7fedec15e6f0 2024-09-11T23:24:21.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.180+0000 7fede9e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fedec06d6e0 0x7fedec0d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:21.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.180+0000 7fede9e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fedec06d6e0 0x7fedec0d1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42102/0 (socket says 172.21.15.144:42102) 2024-09-11T23:24:21.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.180+0000 7fede9e00640 1 -- 172.21.15.144:0/1437059077 learned_addr learned my addr 172.21.15.144:0/1437059077 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:21.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.180+0000 7fedea800640 1 --2- 172.21.15.144:0/1437059077 >> v2:172.21.15.165:3300/0 conn(0x7fedec0b73c0 0x7fedec161ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:21.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.181+0000 7fede9400640 1 --2- 172.21.15.144:0/1437059077 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fedec15e6f0 0x7fedec06dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:21.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.181+0000 7fede9e00640 1 -- 172.21.15.144:0/1437059077 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fedec15e6f0 msgr2=0x7fedec06dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:21.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.181+0000 7fede9e00640 1 --2- 172.21.15.144:0/1437059077 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fedec15e6f0 0x7fedec06dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:21.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.181+0000 7fede9e00640 1 -- 172.21.15.144:0/1437059077 >> v2:172.21.15.165:3300/0 conn(0x7fedec0b73c0 msgr2=0x7fedec161ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:21.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.181+0000 7fede9e00640 1 --2- 172.21.15.144:0/1437059077 >> v2:172.21.15.165:3300/0 conn(0x7fedec0b73c0 0x7fedec161ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:21.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.181+0000 7fede9e00640 1 -- 172.21.15.144:0/1437059077 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedec0b9380 con 0x7fedec06d6e0 2024-09-11T23:24:21.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.181+0000 7fedea800640 1 --2- 172.21.15.144:0/1437059077 >> v2:172.21.15.165:3300/0 conn(0x7fedec0b73c0 0x7fedec161ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:21.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.182+0000 7fede9e00640 1 --2- 172.21.15.144:0/1437059077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedec06d6e0 0x7fedec0d1930 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fedec06bf40 tx=0x7feddc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6968e929a7a556dd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:21.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.182+0000 7fede8a00640 1 -- 172.21.15.144:0/1437059077 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc037070 con 0x7fedec06d6e0 2024-09-11T23:24:21.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.182+0000 7fede8a00640 1 -- 172.21.15.144:0/1437059077 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feddc032440 con 0x7fedec06d6e0 2024-09-11T23:24:21.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.182+0000 7fede8a00640 1 -- 172.21.15.144:0/1437059077 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc032810 con 0x7fedec06d6e0 2024-09-11T23:24:21.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.183+0000 7fedeb200640 1 -- 172.21.15.144:0/1437059077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedec06d6e0 msgr2=0x7fedec0d1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:21.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.183+0000 7fedeb200640 1 --2- 172.21.15.144:0/1437059077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedec06d6e0 0x7fedec0d1930 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fedec06bf40 tx=0x7feddc02a1e0 comp rx=0 tx=0).stop 2024-09-11T23:24:21.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.183+0000 7fedeb200640 1 -- 172.21.15.144:0/1437059077 shutdown_connections 2024-09-11T23:24:21.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.183+0000 7fedeb200640 1 --2- 172.21.15.144:0/1437059077 >> v2:172.21.15.165:3300/0 conn(0x7fedec0b73c0 0x7fedec161ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:21.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.183+0000 7fedeb200640 1 --2- 172.21.15.144:0/1437059077 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fedec15e6f0 0x7fedec06dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:21.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.183+0000 7fedeb200640 1 --2- 172.21.15.144:0/1437059077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedec06d6e0 0x7fedec0d1930 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:21.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.183+0000 7fedeb200640 1 -- 172.21.15.144:0/1437059077 >> 172.21.15.144:0/1437059077 conn(0x7fedec0d4970 msgr2=0x7fedec0d4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:21.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.183+0000 7fedeb200640 1 -- 172.21.15.144:0/1437059077 shutdown_connections 2024-09-11T23:24:21.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.183+0000 7fedeb200640 1 -- 172.21.15.144:0/1437059077 wait complete. 2024-09-11T23:24:21.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.184+0000 7fedeb200640 1 Processor -- start 2024-09-11T23:24:21.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.185+0000 7fedeb200640 1 -- start start 2024-09-11T23:24:21.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.185+0000 7fedeb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedec0b73c0 0x7fedec13e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:21.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.185+0000 7fedeb200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fedec15e6f0 0x7fedec160100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:21.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.185+0000 7fedeb200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fedec141c80 0x7fedec156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:21.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.185+0000 7fedeb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fedec162530 con 0x7fedec0b73c0 2024-09-11T23:24:21.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.185+0000 7fedeb200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fedec0b9660 con 0x7fedec15e6f0 2024-09-11T23:24:21.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.185+0000 7fedeb200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fedec1626b0 con 0x7fedec141c80 2024-09-11T23:24:21.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.186+0000 7fede9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedec0b73c0 0x7fedec13e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:21.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.186+0000 7fede9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedec0b73c0 0x7fedec13e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42118/0 (socket says 172.21.15.144:42118) 2024-09-11T23:24:21.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.186+0000 7fede9e00640 1 -- 172.21.15.144:0/2291392711 learned_addr learned my addr 172.21.15.144:0/2291392711 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:21.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.186+0000 7fede9400640 1 --2- 172.21.15.144:0/2291392711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fedec15e6f0 0x7fedec160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:21.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.186+0000 7fedea800640 1 --2- 172.21.15.144:0/2291392711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fedec141c80 0x7fedec156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:21.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.186+0000 7fede9e00640 1 -- 172.21.15.144:0/2291392711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fedec141c80 msgr2=0x7fedec156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:21.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.186+0000 7fede9e00640 1 --2- 172.21.15.144:0/2291392711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fedec141c80 0x7fedec156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:21.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.186+0000 7fede9e00640 1 -- 172.21.15.144:0/2291392711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fedec15e6f0 msgr2=0x7fedec160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:21.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.186+0000 7fede9e00640 1 --2- 172.21.15.144:0/2291392711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fedec15e6f0 0x7fedec160100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:21.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.186+0000 7fede9e00640 1 -- 172.21.15.144:0/2291392711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedec160a00 con 0x7fedec0b73c0 2024-09-11T23:24:21.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.186+0000 7fede9400640 1 --2- 172.21.15.144:0/2291392711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fedec15e6f0 0x7fedec160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:21.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.186+0000 7fedea800640 1 --2- 172.21.15.144:0/2291392711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fedec141c80 0x7fedec156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:21.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.186+0000 7fede9e00640 1 --2- 172.21.15.144:0/2291392711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedec0b73c0 0x7fedec13e8a0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7feddc0097c0 tx=0x7feddc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:21.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.187+0000 7fede2000640 1 -- 172.21.15.144:0/2291392711 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc041020 con 0x7fedec0b73c0 2024-09-11T23:24:21.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.187+0000 7fede2000640 1 -- 172.21.15.144:0/2291392711 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feddc0306c0 con 0x7fedec0b73c0 2024-09-11T23:24:21.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.187+0000 7fede2000640 1 -- 172.21.15.144:0/2291392711 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc037040 con 0x7fedec0b73c0 2024-09-11T23:24:21.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.187+0000 7fedeb200640 1 -- 172.21.15.144:0/2291392711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedec160ce0 con 0x7fedec0b73c0 2024-09-11T23:24:21.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.187+0000 7fedeb200640 1 -- 172.21.15.144:0/2291392711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedec1612a0 con 0x7fedec0b73c0 2024-09-11T23:24:21.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.188+0000 7fedeb200640 1 -- 172.21.15.144:0/2291392711 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedec162e90 con 0x7fedec0b73c0 2024-09-11T23:24:21.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.189+0000 7fede2000640 1 -- 172.21.15.144:0/2291392711 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 21) ==== 90906+0+0 (secure 0 0 0) 0x7feddc044020 con 0x7fedec0b73c0 2024-09-11T23:24:21.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.190+0000 7fede2000640 1 --2- 172.21.15.144:0/2291392711 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fedcc06c2b0 0x7fedcc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:21.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.190+0000 7fede2000640 1 -- 172.21.15.144:0/2291392711 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5823+0+0 (secure 0 0 0) 0x7feddc0abe70 con 0x7fedec0b73c0 2024-09-11T23:24:21.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.190+0000 7fede9400640 1 --2- 172.21.15.144:0/2291392711 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fedcc06c2b0 0x7fedcc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:21.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.191+0000 7fede9400640 1 --2- 172.21.15.144:0/2291392711 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fedcc06c2b0 0x7fedcc06e770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fedd8006fd0 tx=0x7fedd8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:21.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.198+0000 7fede2000640 1 -- 172.21.15.144:0/2291392711 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feddc04b030 con 0x7fedec0b73c0 2024-09-11T23:24:21.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.415+0000 7fedeb200640 1 -- 172.21.15.144:0/2291392711 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) -- 0x7fedec0b3950 con 0x7fedcc06c2b0 2024-09-11T23:24:21.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.420+0000 7fede2000640 1 -- 172.21.15.144:0/2291392711 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7fedec0b3950 con 0x7fedcc06c2b0 2024-09-11T23:24:21.419 INFO:teuthology.orchestra.run.smithi144.stdout:[] 2024-09-11T23:24:21.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.422+0000 7fedeb200640 1 -- 172.21.15.144:0/2291392711 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fedcc06c2b0 msgr2=0x7fedcc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:21.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.422+0000 7fedeb200640 1 --2- 172.21.15.144:0/2291392711 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fedcc06c2b0 0x7fedcc06e770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fedd8006fd0 tx=0x7fedd8008040 comp rx=0 tx=0).stop 2024-09-11T23:24:21.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.422+0000 7fedeb200640 1 -- 172.21.15.144:0/2291392711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedec0b73c0 msgr2=0x7fedec13e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:21.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.422+0000 7fedeb200640 1 --2- 172.21.15.144:0/2291392711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedec0b73c0 0x7fedec13e8a0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7feddc0097c0 tx=0x7feddc0046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:21.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.422+0000 7fedeb200640 1 -- 172.21.15.144:0/2291392711 shutdown_connections 2024-09-11T23:24:21.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.422+0000 7fedeb200640 1 --2- 172.21.15.144:0/2291392711 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fedcc06c2b0 0x7fedcc06e770 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:21.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.422+0000 7fedeb200640 1 --2- 172.21.15.144:0/2291392711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fedec141c80 0x7fedec156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:21.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.422+0000 7fedeb200640 1 --2- 172.21.15.144:0/2291392711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fedec15e6f0 0x7fedec160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:21.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.422+0000 7fedeb200640 1 --2- 172.21.15.144:0/2291392711 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fedec0b73c0 0x7fedec13e8a0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:21.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.422+0000 7fedeb200640 1 -- 172.21.15.144:0/2291392711 >> 172.21.15.144:0/2291392711 conn(0x7fedec0d4970 msgr2=0x7fedec0b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:21.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.422+0000 7fedeb200640 1 -- 172.21.15.144:0/2291392711 shutdown_connections 2024-09-11T23:24:21.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21.422+0000 7fedeb200640 1 -- 172.21.15.144:0/2291392711 wait complete. 2024-09-11T23:24:21.437 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-11T23:24:21.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:24:21.521 INFO:teuthology.orchestra.run.smithi144.stdout:2 2024-09-11T23:24:21.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:24:21.529 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:24:21.530 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:24:21.616 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:24:21.712 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:24:21.712 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:24:21.713 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:24:21.713 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:24:21.749 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:24:21.749 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:24:21.824 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:24:22.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.021+0000 7f570b200640 1 Processor -- start 2024-09-11T23:24:22.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.021+0000 7f570b200640 1 -- start start 2024-09-11T23:24:22.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.022+0000 7f570b200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f57040b5600 0x7f5704073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:22.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.022+0000 7f570b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5704073ff0 0x7f570406ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:22.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.022+0000 7f570b200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f570406e8d0 con 0x7f570415e7b0 2024-09-11T23:24:22.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.022+0000 7f570b200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f570406e680 con 0x7f57040b5600 2024-09-11T23:24:22.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.022+0000 7f570b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f570406ebb0 con 0x7f5704073ff0 2024-09-11T23:24:22.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.022+0000 7f5709200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5704073ff0 0x7f570406ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:22.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.022+0000 7f56fbe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f57040b5600 0x7f5704073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:22.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.022+0000 7f5703e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f570415e7b0 0x7f5704071340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:59078/0 (socket says 172.21.15.144:59078) 2024-09-11T23:24:22.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.022+0000 7f5703e00640 1 -- 172.21.15.144:0/605825045 learned_addr learned my addr 172.21.15.144:0/605825045 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:22.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.023+0000 7f56fbe00640 1 -- 172.21.15.144:0/605825045 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5704073ff0 msgr2=0x7f570406ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:22.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.023+0000 7f56fbe00640 1 --2- 172.21.15.144:0/605825045 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5704073ff0 0x7f570406ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.023+0000 7f56fbe00640 1 -- 172.21.15.144:0/605825045 >> v1:172.21.15.165:6789/0 conn(0x7f570415e7b0 legacy=0x7f5704071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:22.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.023+0000 7f56fbe00640 1 -- 172.21.15.144:0/605825045 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57040732b0 con 0x7f57040b5600 2024-09-11T23:24:22.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.023+0000 7f5709200640 1 --2- 172.21.15.144:0/605825045 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5704073ff0 0x7f570406ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:24:22.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.024+0000 7f56fbe00640 1 --2- 172.21.15.144:0/605825045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57040b5600 0x7f5704073ab0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0097a0 tx=0x7f56ec02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6d69af3cb56c155 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:22.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.024+0000 7f5703400640 1 -- 172.21.15.144:0/605825045 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec037070 con 0x7f57040b5600 2024-09-11T23:24:22.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.024+0000 7f5703400640 1 -- 172.21.15.144:0/605825045 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ec02ae50 con 0x7f57040b5600 2024-09-11T23:24:22.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.024+0000 7f5703400640 1 -- 172.21.15.144:0/605825045 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec032660 con 0x7f57040b5600 2024-09-11T23:24:22.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.025+0000 7f570b200640 1 -- 172.21.15.144:0/605825045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57040b5600 msgr2=0x7f5704073ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:22.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.025+0000 7f570b200640 1 --2- 172.21.15.144:0/605825045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57040b5600 0x7f5704073ab0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0097a0 tx=0x7f56ec02a100 comp rx=0 tx=0).stop 2024-09-11T23:24:22.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.025+0000 7f570b200640 1 -- 172.21.15.144:0/605825045 shutdown_connections 2024-09-11T23:24:22.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.025+0000 7f570b200640 1 --2- 172.21.15.144:0/605825045 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5704073ff0 0x7f570406ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.025+0000 7f570b200640 1 --2- 172.21.15.144:0/605825045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57040b5600 0x7f5704073ab0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.025+0000 7f570b200640 1 -- 172.21.15.144:0/605825045 >> 172.21.15.144:0/605825045 conn(0x7f57040b4300 msgr2=0x7f57040b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:22.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.025+0000 7f570b200640 1 -- 172.21.15.144:0/605825045 shutdown_connections 2024-09-11T23:24:22.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.025+0000 7f570b200640 1 -- 172.21.15.144:0/605825045 wait complete. 2024-09-11T23:24:22.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.026+0000 7f570b200640 1 Processor -- start 2024-09-11T23:24:22.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.027+0000 7f570b200640 1 -- start start 2024-09-11T23:24:22.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.027+0000 7f570b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57040b5600 0x7f5704149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:22.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.027+0000 7f570b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f570415e7b0 0x7f57041e7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:22.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.027+0000 7f570b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57041e8180 0x7f57040cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:22.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.027+0000 7f570b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f570406d370 con 0x7f57041e8180 2024-09-11T23:24:22.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.027+0000 7f570b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f570406d1f0 con 0x7f57040b5600 2024-09-11T23:24:22.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.027+0000 7f570b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f570406d4f0 con 0x7f570415e7b0 2024-09-11T23:24:22.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.028+0000 7f5703e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57040b5600 0x7f5704149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:22.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.028+0000 7f5709200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57041e8180 0x7f57040cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:22.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.028+0000 7f56fbe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f570415e7b0 0x7f57041e7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:22.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.028+0000 7f5703e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57040b5600 0x7f5704149f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:57696/0 (socket says 172.21.15.144:57696) 2024-09-11T23:24:22.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.028+0000 7f5703e00640 1 -- 172.21.15.144:0/1214273545 learned_addr learned my addr 172.21.15.144:0/1214273545 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:22.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.028+0000 7f5703e00640 1 -- 172.21.15.144:0/1214273545 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f570415e7b0 msgr2=0x7f57041e7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:22.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.028+0000 7f5703e00640 1 --2- 172.21.15.144:0/1214273545 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f570415e7b0 0x7f57041e7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.028+0000 7f5703e00640 1 -- 172.21.15.144:0/1214273545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57041e8180 msgr2=0x7f57040cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:22.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.028+0000 7f5703e00640 1 --2- 172.21.15.144:0/1214273545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57041e8180 0x7f57040cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.028+0000 7f5703e00640 1 -- 172.21.15.144:0/1214273545 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57040cebe0 con 0x7f57040b5600 2024-09-11T23:24:22.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.028+0000 7f5709200640 1 --2- 172.21.15.144:0/1214273545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57041e8180 0x7f57040cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:24:22.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.029+0000 7f5703e00640 1 --2- 172.21.15.144:0/1214273545 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57040b5600 0x7f5704149f60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f56f400c3c0 tx=0x7f56f400c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:22.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.029+0000 7f5700c00640 1 -- 172.21.15.144:0/1214273545 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f4017070 con 0x7f57040b5600 2024-09-11T23:24:22.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.029+0000 7f5700c00640 1 -- 172.21.15.144:0/1214273545 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56f4005ce0 con 0x7f57040b5600 2024-09-11T23:24:22.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.029+0000 7f5700c00640 1 -- 172.21.15.144:0/1214273545 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f40072f0 con 0x7f57040b5600 2024-09-11T23:24:22.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.029+0000 7f570b200640 1 -- 172.21.15.144:0/1214273545 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57040ceec0 con 0x7f57040b5600 2024-09-11T23:24:22.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.029+0000 7f570b200640 1 -- 172.21.15.144:0/1214273545 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57041e8630 con 0x7f57040b5600 2024-09-11T23:24:22.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.030+0000 7f570b200640 1 -- 172.21.15.144:0/1214273545 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f570406ccb0 con 0x7f57040b5600 2024-09-11T23:24:22.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.031+0000 7f5700c00640 1 -- 172.21.15.144:0/1214273545 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 21) ==== 90906+0+0 (secure 0 0 0) 0x7f56f401a070 con 0x7f57040b5600 2024-09-11T23:24:22.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.032+0000 7f5700c00640 1 --2- 172.21.15.144:0/1214273545 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f56e006c2e0 0x7f56e006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:22.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.032+0000 7f5700c00640 1 -- 172.21.15.144:0/1214273545 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5823+0+0 (secure 0 0 0) 0x7f56f408a920 con 0x7f57040b5600 2024-09-11T23:24:22.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.032+0000 7f56fbe00640 1 --2- 172.21.15.144:0/1214273545 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f56e006c2e0 0x7f56e006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:22.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.033+0000 7f56fbe00640 1 --2- 172.21.15.144:0/1214273545 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f56e006c2e0 0x7f56e006e7a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f56ec034000 tx=0x7f56ec02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:22.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.037+0000 7f5700c00640 1 -- 172.21.15.144:0/1214273545 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f56f4058510 con 0x7f57040b5600 2024-09-11T23:24:22.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.054+0000 7f5700c00640 1 -- 172.21.15.144:0/1214273545 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f56f4054b80 con 0x7f57040b5600 2024-09-11T23:24:22.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.224+0000 7f570b200640 1 -- 172.21.15.144:0/1214273545 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f57040b1a90 con 0x7f57040b5600 2024-09-11T23:24:22.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.225+0000 7f5700c00640 1 -- 172.21.15.144:0/1214273545 <== mon.1 v2:172.21.15.165:3300/0 8 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v119) ==== 80+0+0 (secure 0 0 0) 0x7f56f4077ca0 con 0x7f57040b5600 2024-09-11T23:24:22.225 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:24:22.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.227+0000 7f570b200640 1 -- 172.21.15.144:0/1214273545 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f56e006c2e0 msgr2=0x7f56e006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:22.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.227+0000 7f570b200640 1 --2- 172.21.15.144:0/1214273545 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f56e006c2e0 0x7f56e006e7a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f56ec034000 tx=0x7f56ec02e000 comp rx=0 tx=0).stop 2024-09-11T23:24:22.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.227+0000 7f570b200640 1 -- 172.21.15.144:0/1214273545 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57040b5600 msgr2=0x7f5704149f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:22.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.227+0000 7f570b200640 1 --2- 172.21.15.144:0/1214273545 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57040b5600 0x7f5704149f60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f56f400c3c0 tx=0x7f56f400c7c0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.227+0000 7f570b200640 1 -- 172.21.15.144:0/1214273545 shutdown_connections 2024-09-11T23:24:22.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.227+0000 7f570b200640 1 --2- 172.21.15.144:0/1214273545 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f56e006c2e0 0x7f56e006e7a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.227+0000 7f570b200640 1 --2- 172.21.15.144:0/1214273545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57041e8180 0x7f57040cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.227+0000 7f570b200640 1 --2- 172.21.15.144:0/1214273545 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f570415e7b0 0x7f57041e7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.227+0000 7f570b200640 1 --2- 172.21.15.144:0/1214273545 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57040b5600 0x7f5704149f60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.227+0000 7f570b200640 1 -- 172.21.15.144:0/1214273545 >> 172.21.15.144:0/1214273545 conn(0x7f57040b4300 msgr2=0x7f57040711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:22.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.227+0000 7f570b200640 1 -- 172.21.15.144:0/1214273545 shutdown_connections 2024-09-11T23:24:22.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.227+0000 7f570b200640 1 -- 172.21.15.144:0/1214273545 wait complete. 2024-09-11T23:24:22.243 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T23:24:22.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:22.243 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T23:24:22.329 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:24:22.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:22.330 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:24:22.378 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:24:22.379 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:24:22.379 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:24:22.416 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:24:22.417 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:24:22.494 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:24:22.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.649+0000 7f349da00640 1 Processor -- start 2024-09-11T23:24:22.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.649+0000 7f349da00640 1 -- start start 2024-09-11T23:24:22.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.650+0000 7f349da00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349815c180 0x7f34980cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:22.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.650+0000 7f349da00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f34980ce230 0x7f34980cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:22.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.650+0000 7f349da00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34980ce740 con 0x7f34980cf5b0 2024-09-11T23:24:22.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.650+0000 7f349da00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3498072640 con 0x7f34980ce230 2024-09-11T23:24:22.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.650+0000 7f349da00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3498072920 con 0x7f349815c180 2024-09-11T23:24:22.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.651+0000 7f3496a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349815c180 0x7f34980cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:22.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.651+0000 7f348e000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f34980ce230 0x7f34980cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:22.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.651+0000 7f348e000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f34980ce230 0x7f34980cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:57712/0 (socket says 172.21.15.144:57712) 2024-09-11T23:24:22.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.651+0000 7f348e000640 1 -- 172.21.15.144:0/3436292468 learned_addr learned my addr 172.21.15.144:0/3436292468 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:22.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.651+0000 7f3496a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349815c180 0x7f34980cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:42894/0 (socket says 172.21.15.144:42894) 2024-09-11T23:24:22.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.651+0000 7f348e000640 1 -- 172.21.15.144:0/3436292468 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349815c180 msgr2=0x7f34980cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:22.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.651+0000 7f348e000640 1 --2- 172.21.15.144:0/3436292468 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349815c180 0x7f34980cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.651+0000 7f348e000640 1 -- 172.21.15.144:0/3436292468 >> v1:172.21.15.165:6789/0 conn(0x7f34980cf5b0 legacy=0x7f3498073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:22.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.651+0000 7f348e000640 1 -- 172.21.15.144:0/3436292468 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3498072c00 con 0x7f34980ce230 2024-09-11T23:24:22.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.651+0000 7f3496a00640 1 --2- 172.21.15.144:0/3436292468 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349815c180 0x7f34980cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:24:22.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.652+0000 7f348e000640 1 --2- 172.21.15.144:0/3436292468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34980ce230 0x7f34980cf070 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3480009870 tx=0x7f348002a1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daa6169fb199db05 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:22.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.653+0000 7f3496000640 1 -- 172.21.15.144:0/3436292468 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480037070 con 0x7f34980ce230 2024-09-11T23:24:22.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.653+0000 7f3496000640 1 -- 172.21.15.144:0/3436292468 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3480032440 con 0x7f34980ce230 2024-09-11T23:24:22.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.653+0000 7f3496000640 1 -- 172.21.15.144:0/3436292468 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480032810 con 0x7f34980ce230 2024-09-11T23:24:22.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.653+0000 7f349da00640 1 -- 172.21.15.144:0/3436292468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34980ce230 msgr2=0x7f34980cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:22.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.653+0000 7f349da00640 1 --2- 172.21.15.144:0/3436292468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34980ce230 0x7f34980cf070 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3480009870 tx=0x7f348002a1d0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.653+0000 7f349da00640 1 -- 172.21.15.144:0/3436292468 shutdown_connections 2024-09-11T23:24:22.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.653+0000 7f349da00640 1 --2- 172.21.15.144:0/3436292468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34980ce230 0x7f34980cf070 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.653+0000 7f349da00640 1 --2- 172.21.15.144:0/3436292468 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349815c180 0x7f34980cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.653+0000 7f349da00640 1 -- 172.21.15.144:0/3436292468 >> 172.21.15.144:0/3436292468 conn(0x7f3498062cc0 msgr2=0x7f349806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:22.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.653+0000 7f349da00640 1 -- 172.21.15.144:0/3436292468 shutdown_connections 2024-09-11T23:24:22.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.653+0000 7f349da00640 1 -- 172.21.15.144:0/3436292468 wait complete. 2024-09-11T23:24:22.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.655+0000 7f349da00640 1 Processor -- start 2024-09-11T23:24:22.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.655+0000 7f349da00640 1 -- start start 2024-09-11T23:24:22.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.656+0000 7f349da00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34980ce230 0x7f3498160320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:22.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.656+0000 7f349da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34980cf5b0 0x7f349814bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:22.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.656+0000 7f349da00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349815c180 0x7f34980ac570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:22.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.656+0000 7f349da00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f349815c560 con 0x7f34980cf5b0 2024-09-11T23:24:22.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.656+0000 7f349da00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f34980722f0 con 0x7f34980ce230 2024-09-11T23:24:22.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.656+0000 7f349da00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f349815c6e0 con 0x7f349815c180 2024-09-11T23:24:22.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.656+0000 7f348e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34980cf5b0 0x7f349814bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:22.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.656+0000 7f348e000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34980cf5b0 0x7f349814bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42138/0 (socket says 172.21.15.144:42138) 2024-09-11T23:24:22.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.656+0000 7f348e000640 1 -- 172.21.15.144:0/751234356 learned_addr learned my addr 172.21.15.144:0/751234356 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:22.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.656+0000 7f3497400640 1 --2- 172.21.15.144:0/751234356 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349815c180 0x7f34980ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:22.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.656+0000 7f3496a00640 1 --2- 172.21.15.144:0/751234356 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34980ce230 0x7f3498160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:22.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.657+0000 7f348e000640 1 -- 172.21.15.144:0/751234356 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349815c180 msgr2=0x7f34980ac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:22.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.657+0000 7f348e000640 1 --2- 172.21.15.144:0/751234356 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349815c180 0x7f34980ac570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.657+0000 7f348e000640 1 -- 172.21.15.144:0/751234356 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34980ce230 msgr2=0x7f3498160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:22.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.657+0000 7f348e000640 1 --2- 172.21.15.144:0/751234356 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34980ce230 0x7f3498160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.657+0000 7f348e000640 1 -- 172.21.15.144:0/751234356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34980abd90 con 0x7f34980cf5b0 2024-09-11T23:24:22.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.657+0000 7f348e000640 1 --2- 172.21.15.144:0/751234356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34980cf5b0 0x7f349814bff0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f348002a210 tx=0x7f34800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:22.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.657+0000 7f348f400640 1 -- 172.21.15.144:0/751234356 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480037040 con 0x7f34980cf5b0 2024-09-11T23:24:22.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.657+0000 7f348f400640 1 -- 172.21.15.144:0/751234356 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3480042070 con 0x7f34980cf5b0 2024-09-11T23:24:22.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.657+0000 7f348f400640 1 -- 172.21.15.144:0/751234356 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480030880 con 0x7f34980cf5b0 2024-09-11T23:24:22.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.657+0000 7f349da00640 1 -- 172.21.15.144:0/751234356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34980ab210 con 0x7f34980cf5b0 2024-09-11T23:24:22.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.657+0000 7f349da00640 1 -- 172.21.15.144:0/751234356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34980ab7d0 con 0x7f34980cf5b0 2024-09-11T23:24:22.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.658+0000 7f349da00640 1 -- 172.21.15.144:0/751234356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34980cf070 con 0x7f34980cf5b0 2024-09-11T23:24:22.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.659+0000 7f348f400640 1 -- 172.21.15.144:0/751234356 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f3480030a20 con 0x7f34980cf5b0 2024-09-11T23:24:22.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.660+0000 7f348f400640 1 --2- 172.21.15.144:0/751234356 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f347406c3d0 0x7f347406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:22.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.660+0000 7f348f400640 1 -- 172.21.15.144:0/751234356 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5823+0+0 (secure 0 0 0) 0x7f34800ac060 con 0x7f34980cf5b0 2024-09-11T23:24:22.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.660+0000 7f3496a00640 1 --2- 172.21.15.144:0/751234356 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f347406c3d0 0x7f347406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:22.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.661+0000 7f3496a00640 1 --2- 172.21.15.144:0/751234356 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f347406c3d0 0x7f347406e890 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f34981f5740 tx=0x7f3488009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:22.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.665+0000 7f348f400640 1 -- 172.21.15.144:0/751234356 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3480079aa0 con 0x7f34980cf5b0 2024-09-11T23:24:22.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.849+0000 7f349da00640 1 -- 172.21.15.144:0/751234356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3498157b70 con 0x7f34980cf5b0 2024-09-11T23:24:22.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.850+0000 7f348f400640 1 -- 172.21.15.144:0/751234356 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v119) ==== 80+0+0 (secure 0 0 0) 0x7f348007dda0 con 0x7f34980cf5b0 2024-09-11T23:24:22.850 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:24:22.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.852+0000 7f349da00640 1 -- 172.21.15.144:0/751234356 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f347406c3d0 msgr2=0x7f347406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:22.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.852+0000 7f349da00640 1 --2- 172.21.15.144:0/751234356 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f347406c3d0 0x7f347406e890 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f34981f5740 tx=0x7f3488009190 comp rx=0 tx=0).stop 2024-09-11T23:24:22.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.852+0000 7f349da00640 1 -- 172.21.15.144:0/751234356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34980cf5b0 msgr2=0x7f349814bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:22.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.852+0000 7f349da00640 1 --2- 172.21.15.144:0/751234356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34980cf5b0 0x7f349814bff0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f348002a210 tx=0x7f34800046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.852+0000 7f349da00640 1 -- 172.21.15.144:0/751234356 shutdown_connections 2024-09-11T23:24:22.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.852+0000 7f349da00640 1 --2- 172.21.15.144:0/751234356 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f347406c3d0 0x7f347406e890 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.852+0000 7f349da00640 1 --2- 172.21.15.144:0/751234356 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349815c180 0x7f34980ac570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.852+0000 7f349da00640 1 --2- 172.21.15.144:0/751234356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f34980cf5b0 0x7f349814bff0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.852+0000 7f349da00640 1 --2- 172.21.15.144:0/751234356 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34980ce230 0x7f3498160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:22.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.852+0000 7f349da00640 1 -- 172.21.15.144:0/751234356 >> 172.21.15.144:0/751234356 conn(0x7f3498062cc0 msgr2=0x7f349815a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:22.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.852+0000 7f349da00640 1 -- 172.21.15.144:0/751234356 shutdown_connections 2024-09-11T23:24:22.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:22.852+0000 7f349da00640 1 -- 172.21.15.144:0/751234356 wait complete. 2024-09-11T23:24:22.867 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-11T23:24:22.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:22.867 DEBUG:teuthology.orchestra.run.smithi165:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-11T23:24:22.931 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:24:22.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:22.931 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:24:22.968 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:24:22.968 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:24:22.968 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:24:23.004 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:24:23.004 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:24:23.005 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:24:23.005 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:24:23.043 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:24:23.044 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:24:23.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.198+0000 7f10c7c00640 1 Processor -- start 2024-09-11T23:24:23.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.199+0000 7f10c7c00640 1 -- start start 2024-09-11T23:24:23.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.200+0000 7f10c7c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10c015ceb0 0x7f10c01594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:23.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.200+0000 7f10c7c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10c015d390 con 0x7f10c015ca40 2024-09-11T23:24:23.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.200+0000 7f10c7c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10c015d670 con 0x7f10c00d02a0 2024-09-11T23:24:23.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.200+0000 7f10c7c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f10c015d950 con 0x7f10c015ceb0 2024-09-11T23:24:23.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.200+0000 7f10b7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f10c015ca40 0x7f10c015e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51664/0 (socket says 172.21.15.144:51664) 2024-09-11T23:24:23.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.200+0000 7f10b7e00640 1 -- 172.21.15.144:0/2129654063 learned_addr learned my addr 172.21.15.144:0/2129654063 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:23.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.200+0000 7f10c5c00640 1 --2- 172.21.15.144:0/2129654063 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10c015ceb0 0x7f10c01594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:23.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.201+0000 7f10bfe00640 1 -- 172.21.15.144:0/2129654063 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 364166928 0 0) 0x7f10c015d390 con 0x7f10c015ca40 2024-09-11T23:24:23.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.201+0000 7f10bfe00640 1 -- 172.21.15.144:0/2129654063 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10a4003520 con 0x7f10c015ca40 2024-09-11T23:24:23.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.201+0000 7f10bfe00640 1 -- 172.21.15.144:0/2129654063 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2969940866 0 0) 0x7f10c015d670 con 0x7f10c00d02a0 2024-09-11T23:24:23.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.201+0000 7f10c5c00640 1 -- 172.21.15.144:0/2129654063 >> v1:172.21.15.165:6789/0 conn(0x7f10c00d02a0 legacy=0x7f10c00d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:23.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.201+0000 7f10c5c00640 1 -- 172.21.15.144:0/2129654063 >> v1:172.21.15.144:6789/0 conn(0x7f10c015ca40 legacy=0x7f10c015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:23.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.201+0000 7f10c5c00640 1 -- 172.21.15.144:0/2129654063 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c015dc30 con 0x7f10c015ceb0 2024-09-11T23:24:23.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.202+0000 7f10c5c00640 1 --2- 172.21.15.144:0/2129654063 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10c015ceb0 0x7f10c01594c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f10b8009dc0 tx=0x7f10b802a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dcd3c73e3449ed1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:23.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.202+0000 7f10bfe00640 1 -- 172.21.15.144:0/2129654063 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b802ae60 con 0x7f10c015ceb0 2024-09-11T23:24:23.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.202+0000 7f10bfe00640 1 -- 172.21.15.144:0/2129654063 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b8007740 con 0x7f10c015ceb0 2024-09-11T23:24:23.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.202+0000 7f10bfe00640 1 -- 172.21.15.144:0/2129654063 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b8007b10 con 0x7f10c015ceb0 2024-09-11T23:24:23.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.203+0000 7f10c7c00640 1 -- 172.21.15.144:0/2129654063 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10c015ceb0 msgr2=0x7f10c01594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:23.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.203+0000 7f10c7c00640 1 --2- 172.21.15.144:0/2129654063 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10c015ceb0 0x7f10c01594c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f10b8009dc0 tx=0x7f10b802a640 comp rx=0 tx=0).stop 2024-09-11T23:24:23.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.203+0000 7f10c7c00640 1 -- 172.21.15.144:0/2129654063 shutdown_connections 2024-09-11T23:24:23.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.203+0000 7f10c7c00640 1 --2- 172.21.15.144:0/2129654063 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10c015ceb0 0x7f10c01594c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.203+0000 7f10c7c00640 1 -- 172.21.15.144:0/2129654063 >> 172.21.15.144:0/2129654063 conn(0x7f10c0062cc0 msgr2=0x7f10c006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:23.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.203+0000 7f10c7c00640 1 -- 172.21.15.144:0/2129654063 shutdown_connections 2024-09-11T23:24:23.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.203+0000 7f10c7c00640 1 -- 172.21.15.144:0/2129654063 wait complete. 2024-09-11T23:24:23.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.204+0000 7f10c7c00640 1 Processor -- start 2024-09-11T23:24:23.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.205+0000 7f10c7c00640 1 -- start start 2024-09-11T23:24:23.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.205+0000 7f10c7c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10c00d02a0 0x7f10c01471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:23.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.205+0000 7f10c7c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10c015ca40 0x7f10c00b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:23.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.205+0000 7f10c7c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10c015ceb0 0x7f10c00b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:23.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.205+0000 7f10c7c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10c0155b90 con 0x7f10c015ca40 2024-09-11T23:24:23.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.205+0000 7f10c7c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f10c015eb40 con 0x7f10c015ceb0 2024-09-11T23:24:23.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.205+0000 7f10c7c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f10c0155d10 con 0x7f10c00d02a0 2024-09-11T23:24:23.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.206+0000 7f10b7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10c015ca40 0x7f10c00b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:23.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.206+0000 7f10b7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10c015ca40 0x7f10c00b3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42144/0 (socket says 172.21.15.144:42144) 2024-09-11T23:24:23.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.206+0000 7f10b7e00640 1 -- 172.21.15.144:0/2513115567 learned_addr learned my addr 172.21.15.144:0/2513115567 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:23.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.206+0000 7f10c5c00640 1 --2- 172.21.15.144:0/2513115567 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10c015ceb0 0x7f10c00b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:23.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.206+0000 7f10c5200640 1 --2- 172.21.15.144:0/2513115567 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10c00d02a0 0x7f10c01471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:23.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.206+0000 7f10b7e00640 1 -- 172.21.15.144:0/2513115567 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10c00d02a0 msgr2=0x7f10c01471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:23.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.206+0000 7f10b7e00640 1 --2- 172.21.15.144:0/2513115567 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10c00d02a0 0x7f10c01471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.206+0000 7f10b7e00640 1 -- 172.21.15.144:0/2513115567 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10c015ceb0 msgr2=0x7f10c00b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:23.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.206+0000 7f10b7e00640 1 --2- 172.21.15.144:0/2513115567 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10c015ceb0 0x7f10c00b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.206+0000 7f10b7e00640 1 -- 172.21.15.144:0/2513115567 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c01476e0 con 0x7f10c015ca40 2024-09-11T23:24:23.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.207+0000 7f10b7e00640 1 --2- 172.21.15.144:0/2513115567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10c015ca40 0x7f10c00b3340 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f10a800c430 tx=0x7f10a800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:23.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.207+0000 7f10bd600640 1 -- 172.21.15.144:0/2513115567 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8017070 con 0x7f10c015ca40 2024-09-11T23:24:23.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.207+0000 7f10bd600640 1 -- 172.21.15.144:0/2513115567 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a8005ce0 con 0x7f10c015ca40 2024-09-11T23:24:23.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.207+0000 7f10bd600640 1 -- 172.21.15.144:0/2513115567 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a80072f0 con 0x7f10c015ca40 2024-09-11T23:24:23.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.207+0000 7f10c7c00640 1 -- 172.21.15.144:0/2513115567 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c00713e0 con 0x7f10c015ca40 2024-09-11T23:24:23.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.207+0000 7f10c7c00640 1 -- 172.21.15.144:0/2513115567 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c00719a0 con 0x7f10c015ca40 2024-09-11T23:24:23.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.208+0000 7f10c7c00640 1 -- 172.21.15.144:0/2513115567 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10c00b4790 con 0x7f10c015ca40 2024-09-11T23:24:23.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.209+0000 7f10bd600640 1 -- 172.21.15.144:0/2513115567 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f10a801a070 con 0x7f10c015ca40 2024-09-11T23:24:23.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.210+0000 7f10bd600640 1 --2- 172.21.15.144:0/2513115567 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f109c06c3d0 0x7f109c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:23.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.210+0000 7f10bd600640 1 -- 172.21.15.144:0/2513115567 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5823+0+0 (secure 0 0 0) 0x7f10a808ad50 con 0x7f10c015ca40 2024-09-11T23:24:23.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.210+0000 7f10c5200640 1 --2- 172.21.15.144:0/2513115567 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f109c06c3d0 0x7f109c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:23.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.211+0000 7f10c5200640 1 --2- 172.21.15.144:0/2513115567 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f109c06c3d0 0x7f109c06e890 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f10b0000f60 tx=0x7f10b0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:23.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.214+0000 7f10bd600640 1 -- 172.21.15.144:0/2513115567 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f10a8091080 con 0x7f10c015ca40 2024-09-11T23:24:23.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.422+0000 7f10c7c00640 1 -- 172.21.15.144:0/2513115567 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10c015bce0 con 0x7f10c015ca40 2024-09-11T23:24:23.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.423+0000 7f10bd600640 1 -- 172.21.15.144:0/2513115567 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5237 (secure 0 0 0) 0x7f10a80587d0 con 0x7f10c015ca40 2024-09-11T23:24:23.423 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:23.423 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":82,"btime":"2024-09-11T23:24:14:995182+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6997,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1218671521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1218671521},{"type":"v1","addr":"172.21.15.165:6835","nonce":1218671521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7000,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/4243031268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":4243031268},{"type":"v1","addr":"172.21.15.165:6834","nonce":4243031268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/1613796839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1613796839},{"type":"v1","addr":"172.21.15.144:6801","nonce":1613796839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:24:04.329682+0000","modified":"2024-09-11T23:24:07.364254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7389":{"gid":7389,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1311760947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1311760947},{"type":"v1","addr":"172.21.15.144:6835","nonce":1311760947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7389,"qdb_cluster":[7389]},"id":9}]} 2024-09-11T23:24:23.424 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 82 2024-09-11T23:24:23.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.425+0000 7f10c7c00640 1 -- 172.21.15.144:0/2513115567 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f109c06c3d0 msgr2=0x7f109c06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:23.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.425+0000 7f10c7c00640 1 --2- 172.21.15.144:0/2513115567 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f109c06c3d0 0x7f109c06e890 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f10b0000f60 tx=0x7f10b0009040 comp rx=0 tx=0).stop 2024-09-11T23:24:23.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.425+0000 7f10c7c00640 1 -- 172.21.15.144:0/2513115567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10c015ca40 msgr2=0x7f10c00b3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:23.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.425+0000 7f10c7c00640 1 --2- 172.21.15.144:0/2513115567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10c015ca40 0x7f10c00b3340 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f10a800c430 tx=0x7f10a800c8f0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.425+0000 7f10c7c00640 1 -- 172.21.15.144:0/2513115567 shutdown_connections 2024-09-11T23:24:23.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.425+0000 7f10c7c00640 1 --2- 172.21.15.144:0/2513115567 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f109c06c3d0 0x7f109c06e890 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.425+0000 7f10c7c00640 1 --2- 172.21.15.144:0/2513115567 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10c015ceb0 0x7f10c00b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.425+0000 7f10c7c00640 1 --2- 172.21.15.144:0/2513115567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10c015ca40 0x7f10c00b3340 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.425+0000 7f10c7c00640 1 --2- 172.21.15.144:0/2513115567 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10c00d02a0 0x7f10c01471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.425+0000 7f10c7c00640 1 -- 172.21.15.144:0/2513115567 >> 172.21.15.144:0/2513115567 conn(0x7f10c0062cc0 msgr2=0x7f10c014c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:23.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.425+0000 7f10c7c00640 1 -- 172.21.15.144:0/2513115567 shutdown_connections 2024-09-11T23:24:23.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.426+0000 7f10c7c00640 1 -- 172.21.15.144:0/2513115567 wait complete. 2024-09-11T23:24:23.441 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:24:23.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.595+0000 7f36d5200640 1 Processor -- start 2024-09-11T23:24:23.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.595+0000 7f36d5200640 1 -- start start 2024-09-11T23:24:23.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.596+0000 7f36d5200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f36d00d02a0 0x7f36d00d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:23.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.596+0000 7f36d5200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f36d015ceb0 0x7f36d01594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:23.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.596+0000 7f36d5200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36d00d0bc0 con 0x7f36d015ca40 2024-09-11T23:24:23.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.596+0000 7f36d5200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f36d015d390 con 0x7f36d015ceb0 2024-09-11T23:24:23.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.596+0000 7f36d5200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f36d015d670 con 0x7f36d00d02a0 2024-09-11T23:24:23.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.597+0000 7f36ce800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f36d015ceb0 0x7f36d01594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:23.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.597+0000 7f36ce800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f36d015ceb0 0x7f36d01594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42150/0 (socket says 172.21.15.144:42150) 2024-09-11T23:24:23.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.597+0000 7f36ce800640 1 -- 172.21.15.144:0/3900230014 learned_addr learned my addr 172.21.15.144:0/3900230014 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:23.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.597+0000 7f36cde00640 1 --2- 172.21.15.144:0/3900230014 >> v2:172.21.15.165:3300/0 conn(0x7f36d00d02a0 0x7f36d00d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:23.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.597+0000 7f36ce800640 1 -- 172.21.15.144:0/3900230014 >> v2:172.21.15.165:3300/0 conn(0x7f36d00d02a0 msgr2=0x7f36d00d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:23.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.597+0000 7f36ce800640 1 --2- 172.21.15.144:0/3900230014 >> v2:172.21.15.165:3300/0 conn(0x7f36d00d02a0 0x7f36d00d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.597+0000 7f36ce800640 1 -- 172.21.15.144:0/3900230014 >> v1:172.21.15.165:6789/0 conn(0x7f36d015ca40 legacy=0x7f36d015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:23.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.597+0000 7f36ce800640 1 -- 172.21.15.144:0/3900230014 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d015d950 con 0x7f36d015ceb0 2024-09-11T23:24:23.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.598+0000 7f36ce800640 1 --2- 172.21.15.144:0/3900230014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36d015ceb0 0x7f36d01594c0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f36d006f030 tx=0x7f36c802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8000b07e5a85cd43 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:23.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.598+0000 7f36cca00640 1 -- 172.21.15.144:0/3900230014 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c800b2d0 con 0x7f36d015ceb0 2024-09-11T23:24:23.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.598+0000 7f36cca00640 1 -- 172.21.15.144:0/3900230014 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36c800b470 con 0x7f36d015ceb0 2024-09-11T23:24:23.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.598+0000 7f36cca00640 1 -- 172.21.15.144:0/3900230014 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c8009820 con 0x7f36d015ceb0 2024-09-11T23:24:23.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.599+0000 7f36d5200640 1 -- 172.21.15.144:0/3900230014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36d015ceb0 msgr2=0x7f36d01594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:23.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.599+0000 7f36d5200640 1 --2- 172.21.15.144:0/3900230014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36d015ceb0 0x7f36d01594c0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f36d006f030 tx=0x7f36c802c8b0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.599+0000 7f36d5200640 1 -- 172.21.15.144:0/3900230014 shutdown_connections 2024-09-11T23:24:23.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.599+0000 7f36d5200640 1 --2- 172.21.15.144:0/3900230014 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36d015ceb0 0x7f36d01594c0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.599+0000 7f36d5200640 1 --2- 172.21.15.144:0/3900230014 >> v2:172.21.15.165:3300/0 conn(0x7f36d00d02a0 0x7f36d00d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.599+0000 7f36d5200640 1 -- 172.21.15.144:0/3900230014 >> 172.21.15.144:0/3900230014 conn(0x7f36d0062cc0 msgr2=0x7f36d006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:23.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.599+0000 7f36d5200640 1 -- 172.21.15.144:0/3900230014 shutdown_connections 2024-09-11T23:24:23.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.599+0000 7f36d5200640 1 -- 172.21.15.144:0/3900230014 wait complete. 2024-09-11T23:24:23.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.601+0000 7f36d5200640 1 Processor -- start 2024-09-11T23:24:23.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.601+0000 7f36d5200640 1 -- start start 2024-09-11T23:24:23.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.602+0000 7f36d5200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36d00d02a0 0x7f36d01f8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:23.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.602+0000 7f36d5200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36d015ca40 0x7f36d014bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:23.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.602+0000 7f36d5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36d015ceb0 0x7f36d014fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:23.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.602+0000 7f36d5200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f36d015eb40 con 0x7f36d015ceb0 2024-09-11T23:24:23.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.602+0000 7f36d5200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f36d015df10 con 0x7f36d015ca40 2024-09-11T23:24:23.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.602+0000 7f36d5200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f36d0155b90 con 0x7f36d00d02a0 2024-09-11T23:24:23.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.602+0000 7f36ce800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36d015ceb0 0x7f36d014fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:23.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.602+0000 7f36ce800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36d015ceb0 0x7f36d014fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42162/0 (socket says 172.21.15.144:42162) 2024-09-11T23:24:23.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.602+0000 7f36ce800640 1 -- 172.21.15.144:0/2354486018 learned_addr learned my addr 172.21.15.144:0/2354486018 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:23.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.602+0000 7f36cde00640 1 --2- 172.21.15.144:0/2354486018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36d00d02a0 0x7f36d01f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:23.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.602+0000 7f36cd400640 1 --2- 172.21.15.144:0/2354486018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36d015ca40 0x7f36d014bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:23.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.602+0000 7f36ce800640 1 -- 172.21.15.144:0/2354486018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36d00d02a0 msgr2=0x7f36d01f8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:23.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.602+0000 7f36ce800640 1 --2- 172.21.15.144:0/2354486018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36d00d02a0 0x7f36d01f8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.602+0000 7f36ce800640 1 -- 172.21.15.144:0/2354486018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36d015ca40 msgr2=0x7f36d014bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:23.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.602+0000 7f36ce800640 1 --2- 172.21.15.144:0/2354486018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36d015ca40 0x7f36d014bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.602+0000 7f36ce800640 1 -- 172.21.15.144:0/2354486018 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d014d690 con 0x7f36d015ceb0 2024-09-11T23:24:23.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.603+0000 7f36ce800640 1 --2- 172.21.15.144:0/2354486018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36d015ceb0 0x7f36d014fcb0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f36c800d210 tx=0x7f36c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:23.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.603+0000 7f36c6000640 1 -- 172.21.15.144:0/2354486018 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c8040020 con 0x7f36d015ceb0 2024-09-11T23:24:23.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.603+0000 7f36c6000640 1 -- 172.21.15.144:0/2354486018 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36c8009370 con 0x7f36d015ceb0 2024-09-11T23:24:23.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.603+0000 7f36c6000640 1 -- 172.21.15.144:0/2354486018 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c800b720 con 0x7f36d015ceb0 2024-09-11T23:24:23.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.603+0000 7f36d5200640 1 -- 172.21.15.144:0/2354486018 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36d0158b80 con 0x7f36d015ceb0 2024-09-11T23:24:23.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.603+0000 7f36d5200640 1 -- 172.21.15.144:0/2354486018 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36d00b0700 con 0x7f36d015ceb0 2024-09-11T23:24:23.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.604+0000 7f36d5200640 1 -- 172.21.15.144:0/2354486018 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36d00b4790 con 0x7f36d015ceb0 2024-09-11T23:24:23.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.605+0000 7f36c6000640 1 -- 172.21.15.144:0/2354486018 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f36c8043020 con 0x7f36d015ceb0 2024-09-11T23:24:23.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.606+0000 7f36c6000640 1 --2- 172.21.15.144:0/2354486018 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f36b006c3d0 0x7f36b006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:23.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.606+0000 7f36c6000640 1 -- 172.21.15.144:0/2354486018 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5823+0+0 (secure 0 0 0) 0x7f36c80ac470 con 0x7f36d015ceb0 2024-09-11T23:24:23.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.606+0000 7f36cde00640 1 --2- 172.21.15.144:0/2354486018 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f36b006c3d0 0x7f36b006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:23.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.607+0000 7f36cde00640 1 --2- 172.21.15.144:0/2354486018 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f36b006c3d0 0x7f36b006e890 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009b40 tx=0x7f36c0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:23.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.611+0000 7f36c6000640 1 -- 172.21.15.144:0/2354486018 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f36c804a030 con 0x7f36d015ceb0 2024-09-11T23:24:23.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.818+0000 7f36d5200640 1 -- 172.21.15.144:0/2354486018 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36d006d440 con 0x7f36d015ceb0 2024-09-11T23:24:23.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.818+0000 7f36c6000640 1 -- 172.21.15.144:0/2354486018 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5237 (secure 0 0 0) 0x7f36c8079e30 con 0x7f36d015ceb0 2024-09-11T23:24:23.818 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:23.818 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":82,"btime":"2024-09-11T23:24:14:995182+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6997,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1218671521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1218671521},{"type":"v1","addr":"172.21.15.165:6835","nonce":1218671521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7000,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/4243031268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":4243031268},{"type":"v1","addr":"172.21.15.165:6834","nonce":4243031268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/1613796839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1613796839},{"type":"v1","addr":"172.21.15.144:6801","nonce":1613796839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:24:04.329682+0000","modified":"2024-09-11T23:24:07.364254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7389":{"gid":7389,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1311760947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1311760947},{"type":"v1","addr":"172.21.15.144:6835","nonce":1311760947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7389,"qdb_cluster":[7389]},"id":9}]} 2024-09-11T23:24:23.818 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 82 2024-09-11T23:24:23.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.820+0000 7f36d5200640 1 -- 172.21.15.144:0/2354486018 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f36b006c3d0 msgr2=0x7f36b006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:23.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.820+0000 7f36d5200640 1 --2- 172.21.15.144:0/2354486018 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f36b006c3d0 0x7f36b006e890 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f36c0009b40 tx=0x7f36c0009190 comp rx=0 tx=0).stop 2024-09-11T23:24:23.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.820+0000 7f36d5200640 1 -- 172.21.15.144:0/2354486018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36d015ceb0 msgr2=0x7f36d014fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:23.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.820+0000 7f36d5200640 1 --2- 172.21.15.144:0/2354486018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36d015ceb0 0x7f36d014fcb0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f36c800d210 tx=0x7f36c8004a40 comp rx=0 tx=0).stop 2024-09-11T23:24:23.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.820+0000 7f36d5200640 1 -- 172.21.15.144:0/2354486018 shutdown_connections 2024-09-11T23:24:23.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.820+0000 7f36d5200640 1 --2- 172.21.15.144:0/2354486018 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f36b006c3d0 0x7f36b006e890 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.820+0000 7f36d5200640 1 --2- 172.21.15.144:0/2354486018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36d015ceb0 0x7f36d014fcb0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.820+0000 7f36d5200640 1 --2- 172.21.15.144:0/2354486018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36d015ca40 0x7f36d014bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.820+0000 7f36d5200640 1 --2- 172.21.15.144:0/2354486018 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f36d00d02a0 0x7f36d01f8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.820+0000 7f36d5200640 1 -- 172.21.15.144:0/2354486018 >> 172.21.15.144:0/2354486018 conn(0x7f36d0062cc0 msgr2=0x7f36d00af100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:23.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.820+0000 7f36d5200640 1 -- 172.21.15.144:0/2354486018 shutdown_connections 2024-09-11T23:24:23.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.820+0000 7f36d5200640 1 -- 172.21.15.144:0/2354486018 wait complete. 2024-09-11T23:24:23.837 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:24:23.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.990+0000 7fc4f7000640 1 Processor -- start 2024-09-11T23:24:23.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.991+0000 7fc4f7000640 1 -- start start 2024-09-11T23:24:23.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.992+0000 7fc4f7000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc4f015e4f0 0x7fc4f00cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:23.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.992+0000 7fc4f7000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4f006e8f0 0x7fc4f00b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:23.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.992+0000 7fc4f7000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4f00d0070 con 0x7fc4f00ce740 2024-09-11T23:24:23.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.992+0000 7fc4f7000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc4f00d12a0 con 0x7fc4f015e4f0 2024-09-11T23:24:23.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.992+0000 7fc4f7000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc4f00d1580 con 0x7fc4f006e8f0 2024-09-11T23:24:23.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.992+0000 7fc4f5c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc4f015e4f0 0x7fc4f00cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:23.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.992+0000 7fc4f6600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4f006e8f0 0x7fc4f00b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:23.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.992+0000 7fc4f6600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4f006e8f0 0x7fc4f00b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:42948/0 (socket says 172.21.15.144:42948) 2024-09-11T23:24:23.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.992+0000 7fc4f5c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc4f015e4f0 0x7fc4f00cdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:57750/0 (socket says 172.21.15.144:57750) 2024-09-11T23:24:23.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.992+0000 7fc4f6600640 1 -- 172.21.15.144:0/3475300839 learned_addr learned my addr 172.21.15.144:0/3475300839 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:23.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.993+0000 7fc4f5c00640 1 -- 172.21.15.144:0/3475300839 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4f006e8f0 msgr2=0x7fc4f00b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:23.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.993+0000 7fc4f5c00640 1 --2- 172.21.15.144:0/3475300839 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4f006e8f0 0x7fc4f00b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.993+0000 7fc4f5c00640 1 -- 172.21.15.144:0/3475300839 >> v1:172.21.15.165:6789/0 conn(0x7fc4f00ce740 legacy=0x7fc4f006e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:23.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.993+0000 7fc4f5c00640 1 -- 172.21.15.144:0/3475300839 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f00d1860 con 0x7fc4f015e4f0 2024-09-11T23:24:23.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.993+0000 7fc4f6600640 1 --2- 172.21.15.144:0/3475300839 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4f006e8f0 0x7fc4f00b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:24:23.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.994+0000 7fc4f5c00640 1 --2- 172.21.15.144:0/3475300839 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4f015e4f0 0x7fc4f00cdb60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40097a0 tx=0x7fc4e402a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=304ceeb6d4655abe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:23.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.994+0000 7fc4efe00640 1 -- 172.21.15.144:0/3475300839 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4037070 con 0x7fc4f015e4f0 2024-09-11T23:24:23.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.994+0000 7fc4efe00640 1 -- 172.21.15.144:0/3475300839 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e402ae40 con 0x7fc4f015e4f0 2024-09-11T23:24:23.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.994+0000 7fc4efe00640 1 -- 172.21.15.144:0/3475300839 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4032660 con 0x7fc4f015e4f0 2024-09-11T23:24:23.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.995+0000 7fc4f7000640 1 -- 172.21.15.144:0/3475300839 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4f015e4f0 msgr2=0x7fc4f00cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:23.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.995+0000 7fc4f7000640 1 --2- 172.21.15.144:0/3475300839 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4f015e4f0 0x7fc4f00cdb60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40097a0 tx=0x7fc4e402a0f0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.995+0000 7fc4f7000640 1 -- 172.21.15.144:0/3475300839 shutdown_connections 2024-09-11T23:24:23.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.995+0000 7fc4f7000640 1 --2- 172.21.15.144:0/3475300839 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4f006e8f0 0x7fc4f00b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.995+0000 7fc4f7000640 1 --2- 172.21.15.144:0/3475300839 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4f015e4f0 0x7fc4f00cdb60 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:23.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.995+0000 7fc4f7000640 1 -- 172.21.15.144:0/3475300839 >> 172.21.15.144:0/3475300839 conn(0x7fc4f00b6700 msgr2=0x7fc4f00b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:23.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.995+0000 7fc4f7000640 1 -- 172.21.15.144:0/3475300839 shutdown_connections 2024-09-11T23:24:23.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.995+0000 7fc4f7000640 1 -- 172.21.15.144:0/3475300839 wait complete. 2024-09-11T23:24:23.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.997+0000 7fc4f7000640 1 Processor -- start 2024-09-11T23:24:23.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.997+0000 7fc4f7000640 1 -- start start 2024-09-11T23:24:23.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.998+0000 7fc4f7000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4f006e8f0 0x7fc4f0153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:23.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.998+0000 7fc4f7000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4f00ce740 0x7fc4f0155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:23.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.998+0000 7fc4f7000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4f015e4f0 0x7fc4f00afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:23.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.998+0000 7fc4f7000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f015e8d0 con 0x7fc4f00ce740 2024-09-11T23:24:23.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.998+0000 7fc4f7000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f00b4dd0 con 0x7fc4f015e4f0 2024-09-11T23:24:23.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.998+0000 7fc4f7000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc4f0156050 con 0x7fc4f006e8f0 2024-09-11T23:24:23.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.998+0000 7fc4f5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4f00ce740 0x7fc4f0155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:23.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.998+0000 7fc4f5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4f00ce740 0x7fc4f0155b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:42166/0 (socket says 172.21.15.144:42166) 2024-09-11T23:24:23.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.998+0000 7fc4f5200640 1 -- 172.21.15.144:0/4006357852 learned_addr learned my addr 172.21.15.144:0/4006357852 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:23.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.998+0000 7fc4f6600640 1 --2- 172.21.15.144:0/4006357852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4f015e4f0 0x7fc4f00afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:24.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.998+0000 7fc4f5c00640 1 --2- 172.21.15.144:0/4006357852 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4f006e8f0 0x7fc4f0153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:24.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.998+0000 7fc4f5200640 1 -- 172.21.15.144:0/4006357852 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4f006e8f0 msgr2=0x7fc4f0153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:24.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.998+0000 7fc4f5200640 1 --2- 172.21.15.144:0/4006357852 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4f006e8f0 0x7fc4f0153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.998+0000 7fc4f5200640 1 -- 172.21.15.144:0/4006357852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4f015e4f0 msgr2=0x7fc4f00afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:24.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.998+0000 7fc4f5200640 1 --2- 172.21.15.144:0/4006357852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4f015e4f0 0x7fc4f00afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.998+0000 7fc4f5200640 1 -- 172.21.15.144:0/4006357852 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f00b2050 con 0x7fc4f00ce740 2024-09-11T23:24:24.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.998+0000 7fc4f5c00640 1 --2- 172.21.15.144:0/4006357852 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4f006e8f0 0x7fc4f0153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:24:24.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.999+0000 7fc4f5200640 1 --2- 172.21.15.144:0/4006357852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4f00ce740 0x7fc4f0155b10 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00c430 tx=0x7fc4dc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:24.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.999+0000 7fc4ed600640 1 -- 172.21.15.144:0/4006357852 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc0052d0 con 0x7fc4f00ce740 2024-09-11T23:24:24.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.999+0000 7fc4ed600640 1 -- 172.21.15.144:0/4006357852 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4dc005490 con 0x7fc4f00ce740 2024-09-11T23:24:24.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.999+0000 7fc4f7000640 1 -- 172.21.15.144:0/4006357852 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f01522f0 con 0x7fc4f00ce740 2024-09-11T23:24:24.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.999+0000 7fc4ed600640 1 -- 172.21.15.144:0/4006357852 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc007260 con 0x7fc4f00ce740 2024-09-11T23:24:24.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:23.999+0000 7fc4f7000640 1 -- 172.21.15.144:0/4006357852 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f00b25d0 con 0x7fc4f00ce740 2024-09-11T23:24:24.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.000+0000 7fc4f7000640 1 -- 172.21.15.144:0/4006357852 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4f00b4890 con 0x7fc4f00ce740 2024-09-11T23:24:24.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.001+0000 7fc4ed600640 1 -- 172.21.15.144:0/4006357852 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7fc4dc007400 con 0x7fc4f00ce740 2024-09-11T23:24:24.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.002+0000 7fc4ed600640 1 --2- 172.21.15.144:0/4006357852 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc4d006c3d0 0x7fc4d006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:24.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.002+0000 7fc4ed600640 1 -- 172.21.15.144:0/4006357852 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5823+0+0 (secure 0 0 0) 0x7fc4dc08ae50 con 0x7fc4f00ce740 2024-09-11T23:24:24.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.003+0000 7fc4f5c00640 1 --2- 172.21.15.144:0/4006357852 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc4d006c3d0 0x7fc4d006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:24.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.003+0000 7fc4f5c00640 1 --2- 172.21.15.144:0/4006357852 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc4d006c3d0 0x7fc4d006e890 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4034000 tx=0x7fc4e402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:24.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.006+0000 7fc4ed600640 1 -- 172.21.15.144:0/4006357852 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc4dc058f20 con 0x7fc4f00ce740 2024-09-11T23:24:24.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.183+0000 7fc4f7000640 1 -- 172.21.15.144:0/4006357852 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4f00b6250 con 0x7fc4f00ce740 2024-09-11T23:24:24.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.184+0000 7fc4ed600640 1 -- 172.21.15.144:0/4006357852 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) ==== 74+0+16915 (secure 0 0 0) 0x7fc4dc058820 con 0x7fc4f00ce740 2024-09-11T23:24:24.184 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:24.185 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":119,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:24:21.033434+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:24:02.109644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-11T23:24:03.330949+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":119,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.a","mappings":[{"from":2,"to":0}]},{"pgid":"19.1f","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:24:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.187+0000 7fc4f7000640 1 -- 172.21.15.144:0/4006357852 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc4d006c3d0 msgr2=0x7fc4d006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.187+0000 7fc4f7000640 1 --2- 172.21.15.144:0/4006357852 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc4d006c3d0 0x7fc4d006e890 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4034000 tx=0x7fc4e402e000 comp rx=0 tx=0).stop 2024-09-11T23:24:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.187+0000 7fc4f7000640 1 -- 172.21.15.144:0/4006357852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4f00ce740 msgr2=0x7fc4f0155b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.187+0000 7fc4f7000640 1 --2- 172.21.15.144:0/4006357852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4f00ce740 0x7fc4f0155b10 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00c430 tx=0x7fc4dc00c8f0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.187+0000 7fc4f7000640 1 -- 172.21.15.144:0/4006357852 shutdown_connections 2024-09-11T23:24:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.187+0000 7fc4f7000640 1 --2- 172.21.15.144:0/4006357852 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc4d006c3d0 0x7fc4d006e890 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.187+0000 7fc4f7000640 1 --2- 172.21.15.144:0/4006357852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4f015e4f0 0x7fc4f00afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.187+0000 7fc4f7000640 1 --2- 172.21.15.144:0/4006357852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4f00ce740 0x7fc4f0155b10 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.187+0000 7fc4f7000640 1 --2- 172.21.15.144:0/4006357852 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4f006e8f0 0x7fc4f0153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.187+0000 7fc4f7000640 1 -- 172.21.15.144:0/4006357852 >> 172.21.15.144:0/4006357852 conn(0x7fc4f00b6700 msgr2=0x7fc4f015c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:24.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.187+0000 7fc4f7000640 1 -- 172.21.15.144:0/4006357852 shutdown_connections 2024-09-11T23:24:24.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.187+0000 7fc4f7000640 1 -- 172.21.15.144:0/4006357852 wait complete. 2024-09-11T23:24:24.203 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:24:24.203 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:24:24.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.356+0000 7f0f72c00640 1 Processor -- start 2024-09-11T23:24:24.356 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.356+0000 7f0f72c00640 1 -- start start 2024-09-11T23:24:24.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.357+0000 7f0f72c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0f6c0b6410 0x7f0f6c0b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:24.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.357+0000 7f0f72c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f6c06bee0 con 0x7f0f6c15e640 2024-09-11T23:24:24.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.357+0000 7f0f72c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f6c06c1c0 con 0x7f0f6c0b5fd0 2024-09-11T23:24:24.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.357+0000 7f0f72c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0f6c15ea20 con 0x7f0f6c0b6410 2024-09-11T23:24:24.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.357+0000 7f0f72200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0f6c0b6410 0x7f0f6c0b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:24.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.357+0000 7f0f71800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0f6c15e640 0x7f0f6c0d3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33680/0 (socket says 172.21.15.144:33680) 2024-09-11T23:24:24.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.357+0000 7f0f71800640 1 -- 172.21.15.144:0/4221133335 learned_addr learned my addr 172.21.15.144:0/4221133335 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:24.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.358+0000 7f0f72200640 1 -- 172.21.15.144:0/4221133335 >> v1:172.21.15.165:6789/0 conn(0x7f0f6c0b5fd0 legacy=0x7f0f6c0b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:24.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.358+0000 7f0f72200640 1 -- 172.21.15.144:0/4221133335 >> v1:172.21.15.144:6789/0 conn(0x7f0f6c15e640 legacy=0x7f0f6c0d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:24.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.358+0000 7f0f72200640 1 -- 172.21.15.144:0/4221133335 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6c06c4a0 con 0x7f0f6c0b6410 2024-09-11T23:24:24.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.359+0000 7f0f72200640 1 --2- 172.21.15.144:0/4221133335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f6c0b6410 0x7f0f6c0b7e60 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f0f640097a0 tx=0x7f0f6402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aec5c3b5b85cb07 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:24.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.359+0000 7f0f6be00640 1 -- 172.21.15.144:0/4221133335 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64037070 con 0x7f0f6c0b6410 2024-09-11T23:24:24.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.359+0000 7f0f6be00640 1 -- 172.21.15.144:0/4221133335 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f64032440 con 0x7f0f6c0b6410 2024-09-11T23:24:24.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.359+0000 7f0f6be00640 1 -- 172.21.15.144:0/4221133335 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64032810 con 0x7f0f6c0b6410 2024-09-11T23:24:24.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.360+0000 7f0f72c00640 1 -- 172.21.15.144:0/4221133335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f6c0b6410 msgr2=0x7f0f6c0b7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:24.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.360+0000 7f0f72c00640 1 --2- 172.21.15.144:0/4221133335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f6c0b6410 0x7f0f6c0b7e60 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f0f640097a0 tx=0x7f0f6402a230 comp rx=0 tx=0).stop 2024-09-11T23:24:24.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.360+0000 7f0f72c00640 1 -- 172.21.15.144:0/4221133335 shutdown_connections 2024-09-11T23:24:24.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.360+0000 7f0f72c00640 1 --2- 172.21.15.144:0/4221133335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f6c0b6410 0x7f0f6c0b7e60 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.360+0000 7f0f72c00640 1 -- 172.21.15.144:0/4221133335 >> 172.21.15.144:0/4221133335 conn(0x7f0f6c0d0fd0 msgr2=0x7f0f6c0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:24.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.360+0000 7f0f72c00640 1 -- 172.21.15.144:0/4221133335 shutdown_connections 2024-09-11T23:24:24.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.360+0000 7f0f72c00640 1 -- 172.21.15.144:0/4221133335 wait complete. 2024-09-11T23:24:24.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.361+0000 7f0f72c00640 1 Processor -- start 2024-09-11T23:24:24.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.361+0000 7f0f72c00640 1 -- start start 2024-09-11T23:24:24.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.363+0000 7f0f72c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f6c0b5fd0 0x7f0f6c14a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:24.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.363+0000 7f0f72c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f6c0b6410 0x7f0f6c14bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:24.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.363+0000 7f0f72c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f6c15e640 0x7f0f6c0c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:24.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.363+0000 7f0f72c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c0b68a0 con 0x7f0f6c0b5fd0 2024-09-11T23:24:24.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.363+0000 7f0f72c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c06caf0 con 0x7f0f6c0b6410 2024-09-11T23:24:24.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.363+0000 7f0f72c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6c0d4130 con 0x7f0f6c15e640 2024-09-11T23:24:24.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.363+0000 7f0f71800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f6c0b5fd0 0x7f0f6c14a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:24.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.363+0000 7f0f71800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f6c0b5fd0 0x7f0f6c14a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46332/0 (socket says 172.21.15.144:46332) 2024-09-11T23:24:24.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.363+0000 7f0f71800640 1 -- 172.21.15.144:0/2907809181 learned_addr learned my addr 172.21.15.144:0/2907809181 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:24.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.363+0000 7f0f70e00640 1 --2- 172.21.15.144:0/2907809181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f6c0b6410 0x7f0f6c14bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:24.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.363+0000 7f0f72200640 1 --2- 172.21.15.144:0/2907809181 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f6c15e640 0x7f0f6c0c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:24.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.363+0000 7f0f71800640 1 -- 172.21.15.144:0/2907809181 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f6c15e640 msgr2=0x7f0f6c0c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:24.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.363+0000 7f0f71800640 1 --2- 172.21.15.144:0/2907809181 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f6c15e640 0x7f0f6c0c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.363+0000 7f0f71800640 1 -- 172.21.15.144:0/2907809181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f6c0b6410 msgr2=0x7f0f6c14bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:24.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.363+0000 7f0f71800640 1 --2- 172.21.15.144:0/2907809181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f6c0b6410 0x7f0f6c14bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.363+0000 7f0f71800640 1 -- 172.21.15.144:0/2907809181 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6c14ab50 con 0x7f0f6c0b5fd0 2024-09-11T23:24:24.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.364+0000 7f0f71800640 1 --2- 172.21.15.144:0/2907809181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f6c0b5fd0 0x7f0f6c14a490 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000cbd0 tx=0x7f0f6000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:24.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.364+0000 7f0f69600640 1 -- 172.21.15.144:0/2907809181 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60017070 con 0x7f0f6c0b5fd0 2024-09-11T23:24:24.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.364+0000 7f0f69600640 1 -- 172.21.15.144:0/2907809181 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6000ad40 con 0x7f0f6c0b5fd0 2024-09-11T23:24:24.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.364+0000 7f0f69600640 1 -- 172.21.15.144:0/2907809181 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60012600 con 0x7f0f6c0b5fd0 2024-09-11T23:24:24.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.364+0000 7f0f72c00640 1 -- 172.21.15.144:0/2907809181 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6c14ae30 con 0x7f0f6c0b5fd0 2024-09-11T23:24:24.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.364+0000 7f0f72c00640 1 -- 172.21.15.144:0/2907809181 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f6c14b3f0 con 0x7f0f6c0b5fd0 2024-09-11T23:24:24.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.365+0000 7f0f72c00640 1 -- 172.21.15.144:0/2907809181 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f6c0d3a20 con 0x7f0f6c0b5fd0 2024-09-11T23:24:24.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.366+0000 7f0f69600640 1 -- 172.21.15.144:0/2907809181 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f0f6001a070 con 0x7f0f6c0b5fd0 2024-09-11T23:24:24.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.367+0000 7f0f69600640 1 --2- 172.21.15.144:0/2907809181 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0f4c06c3d0 0x7f0f4c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:24.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.367+0000 7f0f69600640 1 -- 172.21.15.144:0/2907809181 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5823+0+0 (secure 0 0 0) 0x7f0f6008b740 con 0x7f0f6c0b5fd0 2024-09-11T23:24:24.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.367+0000 7f0f70e00640 1 --2- 172.21.15.144:0/2907809181 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0f4c06c3d0 0x7f0f4c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:24.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.368+0000 7f0f70e00640 1 --2- 172.21.15.144:0/2907809181 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0f4c06c3d0 0x7f0f4c06e890 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0f58007fd0 tx=0x7f0f58009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:24.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.371+0000 7f0f69600640 1 -- 172.21.15.144:0/2907809181 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f600592f0 con 0x7f0f6c0b5fd0 2024-09-11T23:24:24.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.577+0000 7f0f72c00640 1 -- 172.21.15.144:0/2907809181 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f6c0b7780 con 0x7f0f6c0b5fd0 2024-09-11T23:24:24.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.578+0000 7f0f69600640 1 -- 172.21.15.144:0/2907809181 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5237 (secure 0 0 0) 0x7f0f6005d5f0 con 0x7f0f6c0b5fd0 2024-09-11T23:24:24.578 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:24.578 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":82,"btime":"2024-09-11T23:24:14:995182+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6997,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1218671521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1218671521},{"type":"v1","addr":"172.21.15.165:6835","nonce":1218671521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7000,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/4243031268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":4243031268},{"type":"v1","addr":"172.21.15.165:6834","nonce":4243031268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/1613796839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1613796839},{"type":"v1","addr":"172.21.15.144:6801","nonce":1613796839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:24:04.329682+0000","modified":"2024-09-11T23:24:07.364254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7389":{"gid":7389,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1311760947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1311760947},{"type":"v1","addr":"172.21.15.144:6835","nonce":1311760947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7389,"qdb_cluster":[7389]},"id":9}]} 2024-09-11T23:24:24.578 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 82 2024-09-11T23:24:24.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.580+0000 7f0f72c00640 1 -- 172.21.15.144:0/2907809181 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0f4c06c3d0 msgr2=0x7f0f4c06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:24.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.580+0000 7f0f72c00640 1 --2- 172.21.15.144:0/2907809181 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0f4c06c3d0 0x7f0f4c06e890 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0f58007fd0 tx=0x7f0f58009040 comp rx=0 tx=0).stop 2024-09-11T23:24:24.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.580+0000 7f0f72c00640 1 -- 172.21.15.144:0/2907809181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f6c0b5fd0 msgr2=0x7f0f6c14a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:24.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.580+0000 7f0f72c00640 1 --2- 172.21.15.144:0/2907809181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f6c0b5fd0 0x7f0f6c14a490 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000cbd0 tx=0x7f0f6000a430 comp rx=0 tx=0).stop 2024-09-11T23:24:24.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.580+0000 7f0f72c00640 1 -- 172.21.15.144:0/2907809181 shutdown_connections 2024-09-11T23:24:24.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.580+0000 7f0f72c00640 1 --2- 172.21.15.144:0/2907809181 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0f4c06c3d0 0x7f0f4c06e890 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.580+0000 7f0f72c00640 1 --2- 172.21.15.144:0/2907809181 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f6c15e640 0x7f0f6c0c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.580+0000 7f0f72c00640 1 --2- 172.21.15.144:0/2907809181 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f6c0b6410 0x7f0f6c14bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.580+0000 7f0f72c00640 1 --2- 172.21.15.144:0/2907809181 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f6c0b5fd0 0x7f0f6c14a490 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.580+0000 7f0f72c00640 1 -- 172.21.15.144:0/2907809181 >> 172.21.15.144:0/2907809181 conn(0x7f0f6c0d0fd0 msgr2=0x7f0f6c0b9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:24.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.580+0000 7f0f72c00640 1 -- 172.21.15.144:0/2907809181 shutdown_connections 2024-09-11T23:24:24.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.580+0000 7f0f72c00640 1 -- 172.21.15.144:0/2907809181 wait complete. 2024-09-11T23:24:24.595 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:24:24.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.749+0000 7f6caf200640 1 Processor -- start 2024-09-11T23:24:24.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.749+0000 7f6caf200640 1 -- start start 2024-09-11T23:24:24.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.750+0000 7f6caf200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ca815ca40 0x7f6ca815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:24.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.750+0000 7f6caf200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca815d390 con 0x7f6ca80d02a0 2024-09-11T23:24:24.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.750+0000 7f6caf200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca815d670 con 0x7f6ca815ce80 2024-09-11T23:24:24.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.750+0000 7f6caf200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca815d950 con 0x7f6ca815ca40 2024-09-11T23:24:24.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.750+0000 7f6ca7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6ca80d02a0 0x7f6ca80d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33692/0 (socket says 172.21.15.144:33692) 2024-09-11T23:24:24.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.750+0000 7f6ca7e00640 1 -- 172.21.15.144:0/2922040717 learned_addr learned my addr 172.21.15.144:0/2922040717 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:24.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.751+0000 7f6ca7400640 1 -- 172.21.15.144:0/2922040717 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1506767551 0 0) 0x7f6ca815d390 con 0x7f6ca80d02a0 2024-09-11T23:24:24.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.751+0000 7f6ca7400640 1 -- 172.21.15.144:0/2922040717 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c8c003520 con 0x7f6ca80d02a0 2024-09-11T23:24:24.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.751+0000 7f6c9f400640 1 --2- 172.21.15.144:0/2922040717 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ca815ca40 0x7f6ca815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:24.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.751+0000 7f6ca7400640 1 -- 172.21.15.144:0/2922040717 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2696550525 0 0) 0x7f6c8c003520 con 0x7f6ca80d02a0 2024-09-11T23:24:24.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.751+0000 7f6ca7400640 1 -- 172.21.15.144:0/2922040717 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ca815ca40 msgr2=0x7f6ca815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:24.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.751+0000 7f6ca7400640 1 --2- 172.21.15.144:0/2922040717 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ca815ca40 0x7f6ca815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.751+0000 7f6ca7400640 1 -- 172.21.15.144:0/2922040717 >> v1:172.21.15.165:6789/0 conn(0x7f6ca815ce80 legacy=0x7f6ca81594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:24.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.751+0000 7f6ca7400640 1 -- 172.21.15.144:0/2922040717 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca815dc30 con 0x7f6ca80d02a0 2024-09-11T23:24:24.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.751+0000 7f6ca7400640 1 -- 172.21.15.144:0/2922040717 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f6c98001670 con 0x7f6ca80d02a0 2024-09-11T23:24:24.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.751+0000 7f6ca7400640 1 -- 172.21.15.144:0/2922040717 >> v1:172.21.15.144:6789/0 conn(0x7f6ca80d02a0 legacy=0x7f6ca80d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:24.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.751+0000 7f6ca7400640 1 --2- 172.21.15.144:0/2922040717 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c8c0039e0 0x7f6c8c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:24.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.751+0000 7f6ca7400640 1 --2- 172.21.15.144:0/2922040717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c8c004800 0x7f6c8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:24.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.751+0000 7f6ca7400640 1 --2- 172.21.15.144:0/2922040717 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ca815ca40 0x7f6c8c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:24.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.751+0000 7f6ca7400640 1 -- 172.21.15.144:0/2922040717 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca815d950 con 0x7f6c8c004800 2024-09-11T23:24:24.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.751+0000 7f6ca7400640 1 -- 172.21.15.144:0/2922040717 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c00baf0 con 0x7f6c8c0039e0 2024-09-11T23:24:24.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.751+0000 7f6ca7400640 1 -- 172.21.15.144:0/2922040717 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6c8c00bcf0 con 0x7f6ca815ca40 2024-09-11T23:24:24.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.751+0000 7f6c9f400640 1 --2- 172.21.15.144:0/2922040717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c8c004800 0x7f6c8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:24.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.751+0000 7f6ca7e00640 1 --2- 172.21.15.144:0/2922040717 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c8c0039e0 0x7f6c8c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:24.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.751+0000 7f6cad200640 1 --2- 172.21.15.144:0/2922040717 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ca815ca40 0x7f6c8c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:24.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.752+0000 7f6c9f400640 1 -- 172.21.15.144:0/2922040717 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ca815ca40 msgr2=0x7f6c8c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:24.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.752+0000 7f6c9f400640 1 --2- 172.21.15.144:0/2922040717 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6ca815ca40 0x7f6c8c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.752+0000 7f6c9f400640 1 -- 172.21.15.144:0/2922040717 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c8c0039e0 msgr2=0x7f6c8c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:24.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.752+0000 7f6c9f400640 1 --2- 172.21.15.144:0/2922040717 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6c8c0039e0 0x7f6c8c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.752+0000 7f6c9f400640 1 -- 172.21.15.144:0/2922040717 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8c003520 con 0x7f6c8c004800 2024-09-11T23:24:24.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.753+0000 7f6c9f400640 1 --2- 172.21.15.144:0/2922040717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c8c004800 0x7f6c8c004c80 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009ac0 tx=0x7f6c8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff6c5d3a49224ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:24.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.753+0000 7f6ca7400640 1 -- 172.21.15.144:0/2922040717 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c90036070 con 0x7f6c8c004800 2024-09-11T23:24:24.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.753+0000 7f6ca7400640 1 -- 172.21.15.144:0/2922040717 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c90031400 con 0x7f6c8c004800 2024-09-11T23:24:24.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.753+0000 7f6ca7400640 1 -- 172.21.15.144:0/2922040717 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c90009690 con 0x7f6c8c004800 2024-09-11T23:24:24.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.754+0000 7f6caf200640 1 -- 172.21.15.144:0/2922040717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c8c004800 msgr2=0x7f6c8c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:24.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.754+0000 7f6caf200640 1 --2- 172.21.15.144:0/2922040717 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6c8c004800 0x7f6c8c004c80 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009ac0 tx=0x7f6c8c005830 comp rx=0 tx=0).stop 2024-09-11T23:24:24.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.754+0000 7f6cad200640 1 -- 172.21.15.144:0/2922040717 reap_dead start 2024-09-11T23:24:24.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.754+0000 7f6caf200640 1 -- 172.21.15.144:0/2922040717 shutdown_connections 2024-09-11T23:24:24.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.754+0000 7f6caf200640 1 -- 172.21.15.144:0/2922040717 >> 172.21.15.144:0/2922040717 conn(0x7f6ca8062cc0 msgr2=0x7f6ca806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:24.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.754+0000 7f6caf200640 1 -- 172.21.15.144:0/2922040717 shutdown_connections 2024-09-11T23:24:24.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.754+0000 7f6caf200640 1 -- 172.21.15.144:0/2922040717 wait complete. 2024-09-11T23:24:24.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.755+0000 7f6caf200640 1 Processor -- start 2024-09-11T23:24:24.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.756+0000 7f6caf200640 1 -- start start 2024-09-11T23:24:24.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.756+0000 7f6caf200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c8c004800 0x7f6ca814acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:24.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.756+0000 7f6caf200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ca8158740 0x7f6ca8158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:24.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.756+0000 7f6caf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ca8073570 0x7f6ca80739f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:24.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.756+0000 7f6caf200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca8155d10 con 0x7f6ca8073570 2024-09-11T23:24:24.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.756+0000 7f6caf200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca8155b90 con 0x7f6ca8158740 2024-09-11T23:24:24.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.756+0000 7f6caf200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca80b4790 con 0x7f6c8c004800 2024-09-11T23:24:24.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.757+0000 7f6cad200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ca8073570 0x7f6ca80739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:24.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.757+0000 7f6cad200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ca8073570 0x7f6ca80739f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46348/0 (socket says 172.21.15.144:46348) 2024-09-11T23:24:24.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.757+0000 7f6cad200640 1 -- 172.21.15.144:0/362870919 learned_addr learned my addr 172.21.15.144:0/362870919 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:24.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.757+0000 7f6ca7e00640 1 --2- 172.21.15.144:0/362870919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c8c004800 0x7f6ca814acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:24.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.757+0000 7f6c9f400640 1 --2- 172.21.15.144:0/362870919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ca8158740 0x7f6ca8158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:24.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.757+0000 7f6cad200640 1 -- 172.21.15.144:0/362870919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c8c004800 msgr2=0x7f6ca814acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:24.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.757+0000 7f6cad200640 1 --2- 172.21.15.144:0/362870919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c8c004800 0x7f6ca814acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.757+0000 7f6cad200640 1 -- 172.21.15.144:0/362870919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ca8158740 msgr2=0x7f6ca8158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:24.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.757+0000 7f6cad200640 1 --2- 172.21.15.144:0/362870919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ca8158740 0x7f6ca8158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.757+0000 7f6cad200640 1 -- 172.21.15.144:0/362870919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca814b630 con 0x7f6ca8073570 2024-09-11T23:24:24.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.757+0000 7f6ca7e00640 1 --2- 172.21.15.144:0/362870919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c8c004800 0x7f6ca814acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:24.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.757+0000 7f6c9f400640 1 --2- 172.21.15.144:0/362870919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ca8158740 0x7f6ca8158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:24.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.757+0000 7f6cad200640 1 --2- 172.21.15.144:0/362870919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ca8073570 0x7f6ca80739f0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80b52b0 tx=0x7f6ca000fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:24.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.757+0000 7f6ca4c00640 1 -- 172.21.15.144:0/362870919 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca001a070 con 0x7f6ca8073570 2024-09-11T23:24:24.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.758+0000 7f6ca4c00640 1 -- 172.21.15.144:0/362870919 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca0006d60 con 0x7f6ca8073570 2024-09-11T23:24:24.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.758+0000 7f6caf200640 1 -- 172.21.15.144:0/362870919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca814b910 con 0x7f6ca8073570 2024-09-11T23:24:24.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.758+0000 7f6ca4c00640 1 -- 172.21.15.144:0/362870919 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0003b90 con 0x7f6ca8073570 2024-09-11T23:24:24.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.758+0000 7f6caf200640 1 -- 172.21.15.144:0/362870919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca814bed0 con 0x7f6ca8073570 2024-09-11T23:24:24.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.759+0000 7f6caf200640 1 -- 172.21.15.144:0/362870919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca815d2f0 con 0x7f6ca8073570 2024-09-11T23:24:24.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.760+0000 7f6ca4c00640 1 -- 172.21.15.144:0/362870919 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f6ca001d070 con 0x7f6ca8073570 2024-09-11T23:24:24.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.761+0000 7f6ca4c00640 1 --2- 172.21.15.144:0/362870919 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6c8406c3d0 0x7f6c8406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:24.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.761+0000 7f6ca4c00640 1 -- 172.21.15.144:0/362870919 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5823+0+0 (secure 0 0 0) 0x7f6ca008ae30 con 0x7f6ca8073570 2024-09-11T23:24:24.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.761+0000 7f6ca7e00640 1 --2- 172.21.15.144:0/362870919 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6c8406c3d0 0x7f6c8406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:24.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.762+0000 7f6ca7e00640 1 --2- 172.21.15.144:0/362870919 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6c8406c3d0 0x7f6c8406e890 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6c98000c00 tx=0x7f6c98009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:24.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.765+0000 7f6ca4c00640 1 -- 172.21.15.144:0/362870919 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ca0058f90 con 0x7f6ca8073570 2024-09-11T23:24:24.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.972+0000 7f6caf200640 1 -- 172.21.15.144:0/362870919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ca80b55e0 con 0x7f6ca8073570 2024-09-11T23:24:24.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.972+0000 7f6ca4c00640 1 -- 172.21.15.144:0/362870919 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5237 (secure 0 0 0) 0x7f6ca0058890 con 0x7f6ca8073570 2024-09-11T23:24:24.972 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:24.973 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":82,"btime":"2024-09-11T23:24:14:995182+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6997,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1218671521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1218671521},{"type":"v1","addr":"172.21.15.165:6835","nonce":1218671521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7000,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/4243031268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":4243031268},{"type":"v1","addr":"172.21.15.165:6834","nonce":4243031268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/1613796839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1613796839},{"type":"v1","addr":"172.21.15.144:6801","nonce":1613796839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:24:04.329682+0000","modified":"2024-09-11T23:24:07.364254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7389":{"gid":7389,"name":"c","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1311760947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1311760947},{"type":"v1","addr":"172.21.15.144:6835","nonce":1311760947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7389,"qdb_cluster":[7389]},"id":9}]} 2024-09-11T23:24:24.973 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 82 2024-09-11T23:24:24.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.975+0000 7f6caf200640 1 -- 172.21.15.144:0/362870919 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6c8406c3d0 msgr2=0x7f6c8406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:24.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.975+0000 7f6caf200640 1 --2- 172.21.15.144:0/362870919 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6c8406c3d0 0x7f6c8406e890 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6c98000c00 tx=0x7f6c98009040 comp rx=0 tx=0).stop 2024-09-11T23:24:24.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.975+0000 7f6caf200640 1 -- 172.21.15.144:0/362870919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ca8073570 msgr2=0x7f6ca80739f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:24.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.975+0000 7f6caf200640 1 --2- 172.21.15.144:0/362870919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ca8073570 0x7f6ca80739f0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80b52b0 tx=0x7f6ca000fd40 comp rx=0 tx=0).stop 2024-09-11T23:24:24.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.975+0000 7f6caf200640 1 -- 172.21.15.144:0/362870919 shutdown_connections 2024-09-11T23:24:24.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.975+0000 7f6caf200640 1 --2- 172.21.15.144:0/362870919 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6c8406c3d0 0x7f6c8406e890 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.975+0000 7f6caf200640 1 --2- 172.21.15.144:0/362870919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ca8073570 0x7f6ca80739f0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.975+0000 7f6caf200640 1 --2- 172.21.15.144:0/362870919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ca8158740 0x7f6ca8158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.975+0000 7f6caf200640 1 --2- 172.21.15.144:0/362870919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6c8c004800 0x7f6ca814acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:24.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.975+0000 7f6caf200640 1 -- 172.21.15.144:0/362870919 >> 172.21.15.144:0/362870919 conn(0x7f6ca8062cc0 msgr2=0x7f6ca8154870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:24.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.975+0000 7f6caf200640 1 -- 172.21.15.144:0/362870919 shutdown_connections 2024-09-11T23:24:24.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:24.975+0000 7f6caf200640 1 -- 172.21.15.144:0/362870919 wait complete. 2024-09-11T23:24:24.990 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:24:25.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.146+0000 7fe0ce000640 1 Processor -- start 2024-09-11T23:24:25.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.146+0000 7fe0ce000640 1 -- start start 2024-09-11T23:24:25.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.147+0000 7fe0ce000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0c815e860 0x7fe0c80cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:25.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.147+0000 7fe0ce000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe0c80b7aa0 0x7fe0c80b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:25.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.147+0000 7fe0ce000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c80d34d0 con 0x7fe0c80b61f0 2024-09-11T23:24:25.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.147+0000 7fe0ce000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe0c80d3790 con 0x7fe0c80b7aa0 2024-09-11T23:24:25.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.147+0000 7fe0ce000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c80d3a70 con 0x7fe0c815e860 2024-09-11T23:24:25.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.148+0000 7fe0c7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe0c80b7aa0 0x7fe0c80b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:25.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.148+0000 7fe0c7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe0c80b7aa0 0x7fe0c80b7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46360/0 (socket says 172.21.15.144:46360) 2024-09-11T23:24:25.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.148+0000 7fe0c7e00640 1 -- 172.21.15.144:0/849223342 learned_addr learned my addr 172.21.15.144:0/849223342 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:25.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.148+0000 7fe0c7400640 1 --2- 172.21.15.144:0/849223342 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0c815e860 0x7fe0c80cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:25.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.148+0000 7fe0c7e00640 1 -- 172.21.15.144:0/849223342 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0c815e860 msgr2=0x7fe0c80cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:25.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.148+0000 7fe0c7e00640 1 --2- 172.21.15.144:0/849223342 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0c815e860 0x7fe0c80cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.148+0000 7fe0c7e00640 1 -- 172.21.15.144:0/849223342 >> v1:172.21.15.165:6789/0 conn(0x7fe0c80b61f0 legacy=0x7fe0c80b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:25.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.148+0000 7fe0c7e00640 1 -- 172.21.15.144:0/849223342 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c80d3d50 con 0x7fe0c80b7aa0 2024-09-11T23:24:25.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.149+0000 7fe0c7e00640 1 --2- 172.21.15.144:0/849223342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c80b7aa0 0x7fe0c80b7f10 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009e50 tx=0x7fe0c002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2248a1cb1404c40 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:25.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.149+0000 7fe0c6000640 1 -- 172.21.15.144:0/849223342 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0036070 con 0x7fe0c80b7aa0 2024-09-11T23:24:25.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.149+0000 7fe0c6000640 1 -- 172.21.15.144:0/849223342 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c0031600 con 0x7fe0c80b7aa0 2024-09-11T23:24:25.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.149+0000 7fe0c6000640 1 -- 172.21.15.144:0/849223342 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c00319d0 con 0x7fe0c80b7aa0 2024-09-11T23:24:25.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.150+0000 7fe0ce000640 1 -- 172.21.15.144:0/849223342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c80b7aa0 msgr2=0x7fe0c80b7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:25.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.150+0000 7fe0ce000640 1 --2- 172.21.15.144:0/849223342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c80b7aa0 0x7fe0c80b7f10 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009e50 tx=0x7fe0c002a7a0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.150+0000 7fe0ce000640 1 -- 172.21.15.144:0/849223342 shutdown_connections 2024-09-11T23:24:25.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.150+0000 7fe0ce000640 1 --2- 172.21.15.144:0/849223342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c80b7aa0 0x7fe0c80b7f10 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.150+0000 7fe0ce000640 1 --2- 172.21.15.144:0/849223342 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0c815e860 0x7fe0c80cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.150+0000 7fe0ce000640 1 -- 172.21.15.144:0/849223342 >> 172.21.15.144:0/849223342 conn(0x7fe0c8062c60 msgr2=0x7fe0c80d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:25.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.150+0000 7fe0ce000640 1 -- 172.21.15.144:0/849223342 shutdown_connections 2024-09-11T23:24:25.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.150+0000 7fe0ce000640 1 -- 172.21.15.144:0/849223342 wait complete. 2024-09-11T23:24:25.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.152+0000 7fe0ce000640 1 Processor -- start 2024-09-11T23:24:25.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.152+0000 7fe0ce000640 1 -- start start 2024-09-11T23:24:25.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.153+0000 7fe0ce000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0c80b61f0 0x7fe0c80ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:25.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.153+0000 7fe0ce000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0c80b7aa0 0x7fe0c8160190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:25.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.153+0000 7fe0ce000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c815e860 0x7fe0c81606d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:25.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.153+0000 7fe0ce000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c815ec40 con 0x7fe0c815e860 2024-09-11T23:24:25.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.153+0000 7fe0ce000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c80d4310 con 0x7fe0c80b7aa0 2024-09-11T23:24:25.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.153+0000 7fe0ce000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c815edc0 con 0x7fe0c80b61f0 2024-09-11T23:24:25.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.153+0000 7fe0c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c815e860 0x7fe0c81606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:25.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.153+0000 7fe0c7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c815e860 0x7fe0c81606d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46372/0 (socket says 172.21.15.144:46372) 2024-09-11T23:24:25.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.153+0000 7fe0c7e00640 1 -- 172.21.15.144:0/363840172 learned_addr learned my addr 172.21.15.144:0/363840172 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:25.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.153+0000 7fe0c7400640 1 --2- 172.21.15.144:0/363840172 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0c80b61f0 0x7fe0c80ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:25.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.153+0000 7fe0c6a00640 1 --2- 172.21.15.144:0/363840172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0c80b7aa0 0x7fe0c8160190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:25.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.153+0000 7fe0c7e00640 1 -- 172.21.15.144:0/363840172 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0c80b61f0 msgr2=0x7fe0c80ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:25.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.153+0000 7fe0c7e00640 1 --2- 172.21.15.144:0/363840172 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0c80b61f0 0x7fe0c80ca690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.153+0000 7fe0c7e00640 1 -- 172.21.15.144:0/363840172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0c80b7aa0 msgr2=0x7fe0c8160190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:25.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.153+0000 7fe0c7e00640 1 --2- 172.21.15.144:0/363840172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0c80b7aa0 0x7fe0c8160190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.153+0000 7fe0c7e00640 1 -- 172.21.15.144:0/363840172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c8158680 con 0x7fe0c815e860 2024-09-11T23:24:25.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.154+0000 7fe0c7e00640 1 --2- 172.21.15.144:0/363840172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c815e860 0x7fe0c81606d0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0034040 tx=0x7fe0c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:25.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.154+0000 7fe0bf400640 1 -- 172.21.15.144:0/363840172 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0036050 con 0x7fe0c815e860 2024-09-11T23:24:25.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.154+0000 7fe0bf400640 1 -- 172.21.15.144:0/363840172 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c0042070 con 0x7fe0c815e860 2024-09-11T23:24:25.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.154+0000 7fe0ce000640 1 -- 172.21.15.144:0/363840172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c8158940 con 0x7fe0c815e860 2024-09-11T23:24:25.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.154+0000 7fe0bf400640 1 -- 172.21.15.144:0/363840172 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0009510 con 0x7fe0c815e860 2024-09-11T23:24:25.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.154+0000 7fe0ce000640 1 -- 172.21.15.144:0/363840172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c8158f00 con 0x7fe0c815e860 2024-09-11T23:24:25.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.155+0000 7fe0ce000640 1 -- 172.21.15.144:0/363840172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c80b3ad0 con 0x7fe0c815e860 2024-09-11T23:24:25.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.156+0000 7fe0bf400640 1 -- 172.21.15.144:0/363840172 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7fe0c0007bf0 con 0x7fe0c815e860 2024-09-11T23:24:25.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.157+0000 7fe0bf400640 1 --2- 172.21.15.144:0/363840172 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe0a806c3d0 0x7fe0a806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:25.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.157+0000 7fe0bf400640 1 -- 172.21.15.144:0/363840172 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5823+0+0 (secure 0 0 0) 0x7fe0c00ac690 con 0x7fe0c815e860 2024-09-11T23:24:25.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.157+0000 7fe0c7400640 1 --2- 172.21.15.144:0/363840172 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe0a806c3d0 0x7fe0a806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:25.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.158+0000 7fe0c7400640 1 --2- 172.21.15.144:0/363840172 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe0a806c3d0 0x7fe0a806e890 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe0c81f7b00 tx=0x7fe0b8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:25.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.161+0000 7fe0bf400640 1 -- 172.21.15.144:0/363840172 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe0c007a050 con 0x7fe0c815e860 2024-09-11T23:24:25.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.336+0000 7fe0ce000640 1 -- 172.21.15.144:0/363840172 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0c80cabd0 con 0x7fe0c815e860 2024-09-11T23:24:25.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.338+0000 7fe0bf400640 1 -- 172.21.15.144:0/363840172 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) ==== 74+0+16915 (secure 0 0 0) 0x7fe0c007e350 con 0x7fe0c815e860 2024-09-11T23:24:25.337 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:25.338 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":119,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:24:21.033434+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:24:02.109644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-11T23:24:03.330949+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":119,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.a","mappings":[{"from":2,"to":0}]},{"pgid":"19.1f","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:24:25.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.340+0000 7fe0ce000640 1 -- 172.21.15.144:0/363840172 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe0a806c3d0 msgr2=0x7fe0a806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:25.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.340+0000 7fe0ce000640 1 --2- 172.21.15.144:0/363840172 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe0a806c3d0 0x7fe0a806e890 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe0c81f7b00 tx=0x7fe0b8009190 comp rx=0 tx=0).stop 2024-09-11T23:24:25.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.340+0000 7fe0ce000640 1 -- 172.21.15.144:0/363840172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c815e860 msgr2=0x7fe0c81606d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:25.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.340+0000 7fe0ce000640 1 --2- 172.21.15.144:0/363840172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c815e860 0x7fe0c81606d0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0034040 tx=0x7fe0c0004a40 comp rx=0 tx=0).stop 2024-09-11T23:24:25.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.340+0000 7fe0ce000640 1 -- 172.21.15.144:0/363840172 shutdown_connections 2024-09-11T23:24:25.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.340+0000 7fe0ce000640 1 --2- 172.21.15.144:0/363840172 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe0a806c3d0 0x7fe0a806e890 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.340+0000 7fe0ce000640 1 --2- 172.21.15.144:0/363840172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0c815e860 0x7fe0c81606d0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.340+0000 7fe0ce000640 1 --2- 172.21.15.144:0/363840172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0c80b7aa0 0x7fe0c8160190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.340+0000 7fe0ce000640 1 --2- 172.21.15.144:0/363840172 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe0c80b61f0 0x7fe0c80ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.340+0000 7fe0ce000640 1 -- 172.21.15.144:0/363840172 >> 172.21.15.144:0/363840172 conn(0x7fe0c8062c60 msgr2=0x7fe0c80b94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:25.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.340+0000 7fe0ce000640 1 -- 172.21.15.144:0/363840172 shutdown_connections 2024-09-11T23:24:25.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.340+0000 7fe0ce000640 1 -- 172.21.15.144:0/363840172 wait complete. 2024-09-11T23:24:25.356 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:24:25.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.511+0000 7f8ab5c00640 1 Processor -- start 2024-09-11T23:24:25.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.511+0000 7f8ab5c00640 1 -- start start 2024-09-11T23:24:25.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.512+0000 7f8ab5c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8ab006c2b0 0x7f8ab00cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:25.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.512+0000 7f8ab5c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ab00af900 0x7f8ab00cf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:25.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.512+0000 7f8ab5c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab00cf3a0 con 0x7f8ab0162930 2024-09-11T23:24:25.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.512+0000 7f8ab5c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8ab00b4870 con 0x7f8ab006c2b0 2024-09-11T23:24:25.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.512+0000 7f8ab5c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab00afd40 con 0x7f8ab00af900 2024-09-11T23:24:25.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.513+0000 7f8aaea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8ab0162930 0x7f8ab006bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33696/0 (socket says 172.21.15.144:33696) 2024-09-11T23:24:25.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.513+0000 7f8aaea00640 1 -- 172.21.15.144:0/3875113587 learned_addr learned my addr 172.21.15.144:0/3875113587 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:25.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.513+0000 7f8aaf400640 1 --2- 172.21.15.144:0/3875113587 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ab00af900 0x7f8ab00cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:25.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.513+0000 7f8aae000640 1 --2- 172.21.15.144:0/3875113587 >> v2:172.21.15.165:3300/0 conn(0x7f8ab006c2b0 0x7f8ab00cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:25.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.513+0000 7f8aad600640 1 -- 172.21.15.144:0/3875113587 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 915573441 0 0) 0x7f8aa0001110 con 0x7f8ab0162930 2024-09-11T23:24:25.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.513+0000 7f8aad600640 1 -- 172.21.15.144:0/3875113587 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a94003520 con 0x7f8ab0162930 2024-09-11T23:24:25.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.513+0000 7f8aae000640 1 -- 172.21.15.144:0/3875113587 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ab00af900 msgr2=0x7f8ab00cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:25.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.513+0000 7f8aae000640 1 --2- 172.21.15.144:0/3875113587 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ab00af900 0x7f8ab00cf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.513+0000 7f8aae000640 1 -- 172.21.15.144:0/3875113587 >> v1:172.21.15.144:6789/0 conn(0x7f8ab0162930 legacy=0x7f8ab006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:25.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.513+0000 7f8aae000640 1 -- 172.21.15.144:0/3875113587 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab00b4010 con 0x7f8ab006c2b0 2024-09-11T23:24:25.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.513+0000 7f8aaf400640 1 --2- 172.21.15.144:0/3875113587 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ab00af900 0x7f8ab00cf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:24:25.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.514+0000 7f8aae000640 1 --2- 172.21.15.144:0/3875113587 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ab006c2b0 0x7f8ab00cd750 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0097a0 tx=0x7f8a9c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=809754159bc79e29 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:25.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.515+0000 7f8aad600640 1 -- 172.21.15.144:0/3875113587 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c037070 con 0x7f8ab006c2b0 2024-09-11T23:24:25.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.515+0000 7f8aad600640 1 -- 172.21.15.144:0/3875113587 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a9c032440 con 0x7f8ab006c2b0 2024-09-11T23:24:25.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.515+0000 7f8aad600640 1 -- 172.21.15.144:0/3875113587 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c0327f0 con 0x7f8ab006c2b0 2024-09-11T23:24:25.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.515+0000 7f8ab5c00640 1 -- 172.21.15.144:0/3875113587 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ab006c2b0 msgr2=0x7f8ab00cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:25.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.515+0000 7f8ab5c00640 1 --2- 172.21.15.144:0/3875113587 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ab006c2b0 0x7f8ab00cd750 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0097a0 tx=0x7f8a9c02a180 comp rx=0 tx=0).stop 2024-09-11T23:24:25.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.515+0000 7f8ab5c00640 1 -- 172.21.15.144:0/3875113587 shutdown_connections 2024-09-11T23:24:25.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.515+0000 7f8ab5c00640 1 --2- 172.21.15.144:0/3875113587 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ab00af900 0x7f8ab00cf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.515+0000 7f8ab5c00640 1 --2- 172.21.15.144:0/3875113587 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ab006c2b0 0x7f8ab00cd750 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.515+0000 7f8ab5c00640 1 -- 172.21.15.144:0/3875113587 >> 172.21.15.144:0/3875113587 conn(0x7f8ab0062cc0 msgr2=0x7f8ab006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:25.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.515+0000 7f8ab5c00640 1 -- 172.21.15.144:0/3875113587 shutdown_connections 2024-09-11T23:24:25.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.515+0000 7f8ab5c00640 1 -- 172.21.15.144:0/3875113587 wait complete. 2024-09-11T23:24:25.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.517+0000 7f8ab5c00640 1 Processor -- start 2024-09-11T23:24:25.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.517+0000 7f8ab5c00640 1 -- start start 2024-09-11T23:24:25.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.518+0000 7f8ab5c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ab006c2b0 0x7f8ab01f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.518+0000 7f8ab5c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ab00af900 0x7f8ab015dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.518+0000 7f8ab5c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ab0162930 0x7f8ab01fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.518+0000 7f8ab5c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab0162d10 con 0x7f8ab00af900 2024-09-11T23:24:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.518+0000 7f8ab5c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab00b4590 con 0x7f8ab0162930 2024-09-11T23:24:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.518+0000 7f8ab5c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab00cde00 con 0x7f8ab006c2b0 2024-09-11T23:24:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.518+0000 7f8aae000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ab00af900 0x7f8ab015dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.518+0000 7f8aae000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ab00af900 0x7f8ab015dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46384/0 (socket says 172.21.15.144:46384) 2024-09-11T23:24:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.518+0000 7f8aae000640 1 -- 172.21.15.144:0/816520651 learned_addr learned my addr 172.21.15.144:0/816520651 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.518+0000 7f8aaea00640 1 --2- 172.21.15.144:0/816520651 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ab006c2b0 0x7f8ab01f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.519+0000 7f8aaf400640 1 --2- 172.21.15.144:0/816520651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ab0162930 0x7f8ab01fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.519+0000 7f8aae000640 1 -- 172.21.15.144:0/816520651 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ab006c2b0 msgr2=0x7f8ab01f7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.519+0000 7f8aae000640 1 --2- 172.21.15.144:0/816520651 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ab006c2b0 0x7f8ab01f7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.519+0000 7f8aae000640 1 -- 172.21.15.144:0/816520651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ab0162930 msgr2=0x7f8ab01fbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:25.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.519+0000 7f8aae000640 1 --2- 172.21.15.144:0/816520651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ab0162930 0x7f8ab01fbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.519+0000 7f8aae000640 1 -- 172.21.15.144:0/816520651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab0163c50 con 0x7f8ab00af900 2024-09-11T23:24:25.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.519+0000 7f8aaf400640 1 --2- 172.21.15.144:0/816520651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ab0162930 0x7f8ab01fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:25.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.519+0000 7f8aae000640 1 --2- 172.21.15.144:0/816520651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ab00af900 0x7f8ab015dea0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c035040 tx=0x7f8a9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:25.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.519+0000 7f8aa6a00640 1 -- 172.21.15.144:0/816520651 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c037040 con 0x7f8ab00af900 2024-09-11T23:24:25.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.519+0000 7f8aa6a00640 1 -- 172.21.15.144:0/816520651 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a9c042070 con 0x7f8ab00af900 2024-09-11T23:24:25.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.519+0000 7f8aa6a00640 1 -- 172.21.15.144:0/816520651 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c03b930 con 0x7f8ab00af900 2024-09-11T23:24:25.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.519+0000 7f8ab5c00640 1 -- 172.21.15.144:0/816520651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab01633b0 con 0x7f8ab00af900 2024-09-11T23:24:25.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.520+0000 7f8ab5c00640 1 -- 172.21.15.144:0/816520651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab0163970 con 0x7f8ab00af900 2024-09-11T23:24:25.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.521+0000 7f8ab5c00640 1 -- 172.21.15.144:0/816520651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab00cd750 con 0x7f8ab00af900 2024-09-11T23:24:25.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.521+0000 7f8aa6a00640 1 -- 172.21.15.144:0/816520651 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f8a9c03bad0 con 0x7f8ab00af900 2024-09-11T23:24:25.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.522+0000 7f8aa6a00640 1 --2- 172.21.15.144:0/816520651 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8a9006c3d0 0x7f8a9006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:25.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.522+0000 7f8aa6a00640 1 -- 172.21.15.144:0/816520651 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5823+0+0 (secure 0 0 0) 0x7f8a9c0ac140 con 0x7f8ab00af900 2024-09-11T23:24:25.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.523+0000 7f8aaea00640 1 --2- 172.21.15.144:0/816520651 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8a9006c3d0 0x7f8a9006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:25.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.524+0000 7f8aaea00640 1 --2- 172.21.15.144:0/816520651 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8a9006c3d0 0x7f8a9006e890 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0005880 tx=0x7f8aa0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:25.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.526+0000 7f8aa6a00640 1 -- 172.21.15.144:0/816520651 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a9c07a1d0 con 0x7f8ab00af900 2024-09-11T23:24:25.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.734+0000 7f8ab5c00640 1 -- 172.21.15.144:0/816520651 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8ab00b2d40 con 0x7f8ab00af900 2024-09-11T23:24:25.734 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-11T23:24:25.735+0000 7f86fcc00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:24:25.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.737+0000 7f8aa6a00640 1 -- 172.21.15.144:0/816520651 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v83) ==== 161+0+0 (secure 0 0 0) 0x7f8a9c079ad0 con 0x7f8ab00af900 2024-09-11T23:24:25.736 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:24:25.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.740+0000 7f8ab5c00640 1 -- 172.21.15.144:0/816520651 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8a9006c3d0 msgr2=0x7f8a9006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:25.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.740+0000 7f8ab5c00640 1 --2- 172.21.15.144:0/816520651 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8a9006c3d0 0x7f8a9006e890 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0005880 tx=0x7f8aa0009040 comp rx=0 tx=0).stop 2024-09-11T23:24:25.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.740+0000 7f8ab5c00640 1 -- 172.21.15.144:0/816520651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ab00af900 msgr2=0x7f8ab015dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:25.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.740+0000 7f8ab5c00640 1 --2- 172.21.15.144:0/816520651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ab00af900 0x7f8ab015dea0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c035040 tx=0x7f8a9c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.740+0000 7f8ab5c00640 1 -- 172.21.15.144:0/816520651 shutdown_connections 2024-09-11T23:24:25.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.740+0000 7f8ab5c00640 1 --2- 172.21.15.144:0/816520651 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8a9006c3d0 0x7f8a9006e890 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.740+0000 7f8ab5c00640 1 --2- 172.21.15.144:0/816520651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ab0162930 0x7f8ab01fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.740+0000 7f8ab5c00640 1 --2- 172.21.15.144:0/816520651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ab00af900 0x7f8ab015dea0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.740+0000 7f8ab5c00640 1 --2- 172.21.15.144:0/816520651 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8ab006c2b0 0x7f8ab01f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.740+0000 7f8ab5c00640 1 -- 172.21.15.144:0/816520651 >> 172.21.15.144:0/816520651 conn(0x7f8ab0062cc0 msgr2=0x7f8ab006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:25.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.740+0000 7f8ab5c00640 1 -- 172.21.15.144:0/816520651 shutdown_connections 2024-09-11T23:24:25.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.740+0000 7f8ab5c00640 1 -- 172.21.15.144:0/816520651 wait complete. 2024-09-11T23:24:25.757 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:24:25.804 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-11T23:24:25.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.914+0000 7f69df400640 1 Processor -- start 2024-09-11T23:24:25.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.914+0000 7f69df400640 1 -- start start 2024-09-11T23:24:25.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.915+0000 7f69df400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f69d815d3b0 0x7f69d8071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:25.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.915+0000 7f69df400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69d815d790 0x7f69d80cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:25.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.916+0000 7f69df400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69d80715c0 con 0x7f69d80cd3b0 2024-09-11T23:24:25.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.916+0000 7f69df400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f69d806da30 con 0x7f69d815d3b0 2024-09-11T23:24:25.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.916+0000 7f69df400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f69d806d700 con 0x7f69d815d790 2024-09-11T23:24:25.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.916+0000 7f69dd400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f69d80cd3b0 0x7f69d80cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33726/0 (socket says 172.21.15.144:33726) 2024-09-11T23:24:25.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.916+0000 7f69dd400640 1 -- 172.21.15.144:0/1981737431 learned_addr learned my addr 172.21.15.144:0/1981737431 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:25.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.916+0000 7f69dca00640 1 --2- 172.21.15.144:0/1981737431 >> v2:172.21.15.165:3300/0 conn(0x7f69d815d3b0 0x7f69d8071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:25.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.916+0000 7f69d7e00640 1 --2- 172.21.15.144:0/1981737431 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69d815d790 0x7f69d80cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:25.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.916+0000 7f69d7400640 1 -- 172.21.15.144:0/1981737431 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4217009209 0 0) 0x7f69d80715c0 con 0x7f69d80cd3b0 2024-09-11T23:24:25.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.916+0000 7f69d7400640 1 -- 172.21.15.144:0/1981737431 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69c0003520 con 0x7f69d80cd3b0 2024-09-11T23:24:25.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.917+0000 7f69dca00640 1 -- 172.21.15.144:0/1981737431 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69d815d790 msgr2=0x7f69d80cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:25.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.917+0000 7f69dca00640 1 --2- 172.21.15.144:0/1981737431 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69d815d790 0x7f69d80cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.917+0000 7f69dca00640 1 -- 172.21.15.144:0/1981737431 >> v1:172.21.15.144:6789/0 conn(0x7f69d80cd3b0 legacy=0x7f69d80cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:25.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.917+0000 7f69dca00640 1 -- 172.21.15.144:0/1981737431 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d80cde80 con 0x7f69d815d3b0 2024-09-11T23:24:25.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.918+0000 7f69dca00640 1 --2- 172.21.15.144:0/1981737431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69d815d3b0 0x7f69d8071080 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0097a0 tx=0x7f69cc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=271027c28f04b117 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:25.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.918+0000 7f69d7400640 1 -- 172.21.15.144:0/1981737431 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69cc037070 con 0x7f69d815d3b0 2024-09-11T23:24:25.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.918+0000 7f69d7400640 1 -- 172.21.15.144:0/1981737431 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69cc032440 con 0x7f69d815d3b0 2024-09-11T23:24:25.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.918+0000 7f69d7400640 1 -- 172.21.15.144:0/1981737431 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69cc032810 con 0x7f69d815d3b0 2024-09-11T23:24:25.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.918+0000 7f69df400640 1 -- 172.21.15.144:0/1981737431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69d815d3b0 msgr2=0x7f69d8071080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:25.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.918+0000 7f69df400640 1 --2- 172.21.15.144:0/1981737431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69d815d3b0 0x7f69d8071080 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0097a0 tx=0x7f69cc02a180 comp rx=0 tx=0).stop 2024-09-11T23:24:25.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.918+0000 7f69df400640 1 -- 172.21.15.144:0/1981737431 shutdown_connections 2024-09-11T23:24:25.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.918+0000 7f69df400640 1 --2- 172.21.15.144:0/1981737431 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69d815d790 0x7f69d80cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.918+0000 7f69df400640 1 --2- 172.21.15.144:0/1981737431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69d815d3b0 0x7f69d8071080 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.918+0000 7f69df400640 1 -- 172.21.15.144:0/1981737431 >> 172.21.15.144:0/1981737431 conn(0x7f69d806bba0 msgr2=0x7f69d806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:25.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.919+0000 7f69df400640 1 -- 172.21.15.144:0/1981737431 shutdown_connections 2024-09-11T23:24:25.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.919+0000 7f69df400640 1 -- 172.21.15.144:0/1981737431 wait complete. 2024-09-11T23:24:25.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.920+0000 7f69df400640 1 Processor -- start 2024-09-11T23:24:25.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.920+0000 7f69df400640 1 -- start start 2024-09-11T23:24:25.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.921+0000 7f69df400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69d80cd3b0 0x7f69d815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.921+0000 7f69df400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69d815d3b0 0x7f69d8148940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.921+0000 7f69df400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69d8148e80 0x7f69d81f7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.921+0000 7f69df400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f69d815cbf0 con 0x7f69d80cd3b0 2024-09-11T23:24:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.921+0000 7f69df400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f69d80cdba0 con 0x7f69d815d3b0 2024-09-11T23:24:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.921+0000 7f69df400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f69d815cd70 con 0x7f69d8148e80 2024-09-11T23:24:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.921+0000 7f69dca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69d80cd3b0 0x7f69d815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.922+0000 7f69dca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69d80cd3b0 0x7f69d815efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46408/0 (socket says 172.21.15.144:46408) 2024-09-11T23:24:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.922+0000 7f69dca00640 1 -- 172.21.15.144:0/3222641121 learned_addr learned my addr 172.21.15.144:0/3222641121 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.922+0000 7f69d7e00640 1 --2- 172.21.15.144:0/3222641121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69d815d3b0 0x7f69d8148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.922+0000 7f69dd400640 1 --2- 172.21.15.144:0/3222641121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69d8148e80 0x7f69d81f7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.922+0000 7f69dca00640 1 -- 172.21.15.144:0/3222641121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69d8148e80 msgr2=0x7f69d81f7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:25.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.922+0000 7f69dca00640 1 --2- 172.21.15.144:0/3222641121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69d8148e80 0x7f69d81f7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.922+0000 7f69dca00640 1 -- 172.21.15.144:0/3222641121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69d815d3b0 msgr2=0x7f69d8148940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:25.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.922+0000 7f69dca00640 1 --2- 172.21.15.144:0/3222641121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69d815d3b0 0x7f69d8148940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:25.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.922+0000 7f69dca00640 1 -- 172.21.15.144:0/3222641121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d8156520 con 0x7f69d80cd3b0 2024-09-11T23:24:25.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.922+0000 7f69d7e00640 1 --2- 172.21.15.144:0/3222641121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69d815d3b0 0x7f69d8148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:25.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.922+0000 7f69dca00640 1 --2- 172.21.15.144:0/3222641121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69d80cd3b0 0x7f69d815efa0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f69cc035040 tx=0x7f69cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:25.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.922+0000 7f69d4c00640 1 -- 172.21.15.144:0/3222641121 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69cc037040 con 0x7f69d80cd3b0 2024-09-11T23:24:25.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.923+0000 7f69d4c00640 1 -- 172.21.15.144:0/3222641121 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69cc042070 con 0x7f69d80cd3b0 2024-09-11T23:24:25.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.923+0000 7f69d4c00640 1 -- 172.21.15.144:0/3222641121 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69cc03b930 con 0x7f69d80cd3b0 2024-09-11T23:24:25.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.923+0000 7f69df400640 1 -- 172.21.15.144:0/3222641121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69d81f8940 con 0x7f69d80cd3b0 2024-09-11T23:24:25.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.923+0000 7f69df400640 1 -- 172.21.15.144:0/3222641121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69d8157ab0 con 0x7f69d80cd3b0 2024-09-11T23:24:25.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.924+0000 7f69df400640 1 -- 172.21.15.144:0/3222641121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69d8149290 con 0x7f69d80cd3b0 2024-09-11T23:24:25.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.925+0000 7f69d4c00640 1 -- 172.21.15.144:0/3222641121 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f69cc03bad0 con 0x7f69d80cd3b0 2024-09-11T23:24:25.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.925+0000 7f69d4c00640 1 --2- 172.21.15.144:0/3222641121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f69b806c3d0 0x7f69b806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:25.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.925+0000 7f69d4c00640 1 -- 172.21.15.144:0/3222641121 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5881+0+0 (secure 0 0 0) 0x7f69cc0ac250 con 0x7f69d80cd3b0 2024-09-11T23:24:25.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.926+0000 7f69d7e00640 1 --2- 172.21.15.144:0/3222641121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f69b806c3d0 0x7f69b806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:25.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.927+0000 7f69d7e00640 1 --2- 172.21.15.144:0/3222641121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f69b806c3d0 0x7f69b806e890 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f69d814c830 tx=0x7f69c4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:25.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:25.930+0000 7f69d4c00640 1 -- 172.21.15.144:0/3222641121 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f69d8149290 con 0x7f69d80cd3b0 2024-09-11T23:24:26.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.140+0000 7f69df400640 1 -- 172.21.15.144:0/3222641121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f69d80cfac0 con 0x7f69d80cd3b0 2024-09-11T23:24:26.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.739+0000 7f69d4c00640 1 -- 172.21.15.144:0/3222641121 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v84) ==== 104+0+0 (secure 0 0 0) 0x7f69d8156520 con 0x7f69d80cd3b0 2024-09-11T23:24:26.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.741+0000 7f69df400640 1 -- 172.21.15.144:0/3222641121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f69b806c3d0 msgr2=0x7f69b806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:26.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.741+0000 7f69df400640 1 --2- 172.21.15.144:0/3222641121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f69b806c3d0 0x7f69b806e890 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f69d814c830 tx=0x7f69c4008040 comp rx=0 tx=0).stop 2024-09-11T23:24:26.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.741+0000 7f69df400640 1 -- 172.21.15.144:0/3222641121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69d80cd3b0 msgr2=0x7f69d815efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:26.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.741+0000 7f69df400640 1 --2- 172.21.15.144:0/3222641121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69d80cd3b0 0x7f69d815efa0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f69cc035040 tx=0x7f69cc0046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:26.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.742+0000 7f69df400640 1 -- 172.21.15.144:0/3222641121 shutdown_connections 2024-09-11T23:24:26.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.742+0000 7f69df400640 1 --2- 172.21.15.144:0/3222641121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f69b806c3d0 0x7f69b806e890 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:26.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.742+0000 7f69df400640 1 --2- 172.21.15.144:0/3222641121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f69d8148e80 0x7f69d81f7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:26.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.742+0000 7f69df400640 1 --2- 172.21.15.144:0/3222641121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69d815d3b0 0x7f69d8148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:26.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.742+0000 7f69df400640 1 --2- 172.21.15.144:0/3222641121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69d80cd3b0 0x7f69d815efa0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:26.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.742+0000 7f69df400640 1 -- 172.21.15.144:0/3222641121 >> 172.21.15.144:0/3222641121 conn(0x7f69d806bba0 msgr2=0x7f69d806ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:26.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.742+0000 7f69df400640 1 -- 172.21.15.144:0/3222641121 shutdown_connections 2024-09-11T23:24:26.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.742+0000 7f69df400640 1 -- 172.21.15.144:0/3222641121 wait complete. 2024-09-11T23:24:26.759 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:24:26.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.918+0000 7fb997a00640 1 Processor -- start 2024-09-11T23:24:26.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.918+0000 7fb997a00640 1 -- start start 2024-09-11T23:24:26.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.919+0000 7fb997a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb990161d70 0x7fb99015fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:26.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.919+0000 7fb997a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9900b61d0 0x7fb9900b6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:26.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.919+0000 7fb997a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb99015fc30 con 0x7fb99015eeb0 2024-09-11T23:24:26.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.919+0000 7fb997a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb9900b6b70 con 0x7fb990161d70 2024-09-11T23:24:26.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.919+0000 7fb997a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb9900d28d0 con 0x7fb9900b61d0 2024-09-11T23:24:26.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.919+0000 7fb995a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb99015eeb0 0x7fb99015f360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33728/0 (socket says 172.21.15.144:33728) 2024-09-11T23:24:26.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.919+0000 7fb995a00640 1 -- 172.21.15.144:0/356568732 learned_addr learned my addr 172.21.15.144:0/356568732 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:26.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.919+0000 7fb995000640 1 --2- 172.21.15.144:0/356568732 >> v2:172.21.15.165:3300/0 conn(0x7fb990161d70 0x7fb99015fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:26.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.919+0000 7fb98fe00640 1 --2- 172.21.15.144:0/356568732 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9900b61d0 0x7fb9900b6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:26.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.920+0000 7fb98f400640 1 -- 172.21.15.144:0/356568732 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1805138576 0 0) 0x7fb99015fc30 con 0x7fb99015eeb0 2024-09-11T23:24:26.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.920+0000 7fb98f400640 1 -- 172.21.15.144:0/356568732 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb978003520 con 0x7fb99015eeb0 2024-09-11T23:24:26.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.920+0000 7fb995000640 1 -- 172.21.15.144:0/356568732 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9900b61d0 msgr2=0x7fb9900b6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:26.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.920+0000 7fb995000640 1 --2- 172.21.15.144:0/356568732 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9900b61d0 0x7fb9900b6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:26.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.920+0000 7fb995000640 1 -- 172.21.15.144:0/356568732 >> v1:172.21.15.144:6789/0 conn(0x7fb99015eeb0 legacy=0x7fb99015f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:26.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.920+0000 7fb995000640 1 -- 172.21.15.144:0/356568732 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9900d2bb0 con 0x7fb990161d70 2024-09-11T23:24:26.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.921+0000 7fb995000640 1 --2- 172.21.15.144:0/356568732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb990161d70 0x7fb99015fe90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb9840097a0 tx=0x7fb98402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a3c4a8cef9516ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:26.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.921+0000 7fb98f400640 1 -- 172.21.15.144:0/356568732 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984037070 con 0x7fb990161d70 2024-09-11T23:24:26.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.921+0000 7fb98f400640 1 -- 172.21.15.144:0/356568732 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb984032440 con 0x7fb990161d70 2024-09-11T23:24:26.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.921+0000 7fb98f400640 1 -- 172.21.15.144:0/356568732 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9840327f0 con 0x7fb990161d70 2024-09-11T23:24:26.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.922+0000 7fb997a00640 1 -- 172.21.15.144:0/356568732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb990161d70 msgr2=0x7fb99015fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:26.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.922+0000 7fb997a00640 1 --2- 172.21.15.144:0/356568732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb990161d70 0x7fb99015fe90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb9840097a0 tx=0x7fb98402a180 comp rx=0 tx=0).stop 2024-09-11T23:24:26.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.922+0000 7fb997a00640 1 -- 172.21.15.144:0/356568732 shutdown_connections 2024-09-11T23:24:26.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.922+0000 7fb997a00640 1 --2- 172.21.15.144:0/356568732 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9900b61d0 0x7fb9900b6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:26.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.922+0000 7fb997a00640 1 --2- 172.21.15.144:0/356568732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb990161d70 0x7fb99015fe90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:26.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.922+0000 7fb997a00640 1 -- 172.21.15.144:0/356568732 >> 172.21.15.144:0/356568732 conn(0x7fb990062c60 msgr2=0x7fb9900d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:26.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.922+0000 7fb997a00640 1 -- 172.21.15.144:0/356568732 shutdown_connections 2024-09-11T23:24:26.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.922+0000 7fb997a00640 1 -- 172.21.15.144:0/356568732 wait complete. 2024-09-11T23:24:26.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.924+0000 7fb997a00640 1 Processor -- start 2024-09-11T23:24:26.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.924+0000 7fb997a00640 1 -- start start 2024-09-11T23:24:26.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.925+0000 7fb997a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9900b61d0 0x7fb9901f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:26.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.925+0000 7fb997a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb99015eeb0 0x7fb9900cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:26.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.925+0000 7fb997a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb990161d70 0x7fb99015bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:26.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.925+0000 7fb997a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb9900d3810 con 0x7fb99015eeb0 2024-09-11T23:24:26.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.925+0000 7fb997a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb9900d3690 con 0x7fb990161d70 2024-09-11T23:24:26.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.925+0000 7fb997a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb9900d3990 con 0x7fb9900b61d0 2024-09-11T23:24:26.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.925+0000 7fb98fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb99015eeb0 0x7fb9900cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:26.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.925+0000 7fb98fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb99015eeb0 0x7fb9900cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46420/0 (socket says 172.21.15.144:46420) 2024-09-11T23:24:26.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.925+0000 7fb98fe00640 1 -- 172.21.15.144:0/4019937216 learned_addr learned my addr 172.21.15.144:0/4019937216 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:26.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.925+0000 7fb995a00640 1 --2- 172.21.15.144:0/4019937216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb990161d70 0x7fb99015bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:26.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.925+0000 7fb995000640 1 --2- 172.21.15.144:0/4019937216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9900b61d0 0x7fb9901f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:26.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.925+0000 7fb98fe00640 1 -- 172.21.15.144:0/4019937216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9900b61d0 msgr2=0x7fb9901f40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:26.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.925+0000 7fb98fe00640 1 --2- 172.21.15.144:0/4019937216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9900b61d0 0x7fb9901f40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:26.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.925+0000 7fb98fe00640 1 -- 172.21.15.144:0/4019937216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb990161d70 msgr2=0x7fb99015bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:26.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.925+0000 7fb98fe00640 1 --2- 172.21.15.144:0/4019937216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb990161d70 0x7fb99015bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:26.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.925+0000 7fb98fe00640 1 -- 172.21.15.144:0/4019937216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9900ccd30 con 0x7fb99015eeb0 2024-09-11T23:24:26.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.925+0000 7fb995a00640 1 --2- 172.21.15.144:0/4019937216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb990161d70 0x7fb99015bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:24:26.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.926+0000 7fb98fe00640 1 --2- 172.21.15.144:0/4019937216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb99015eeb0 0x7fb9900cc230 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fb97c00e980 tx=0x7fb97c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:26.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.926+0000 7fb98cc00640 1 -- 172.21.15.144:0/4019937216 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c017070 con 0x7fb99015eeb0 2024-09-11T23:24:26.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.926+0000 7fb98cc00640 1 -- 172.21.15.144:0/4019937216 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb97c00c9a0 con 0x7fb99015eeb0 2024-09-11T23:24:26.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.926+0000 7fb98cc00640 1 -- 172.21.15.144:0/4019937216 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c00cd70 con 0x7fb99015eeb0 2024-09-11T23:24:26.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.926+0000 7fb997a00640 1 -- 172.21.15.144:0/4019937216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9900cd010 con 0x7fb99015eeb0 2024-09-11T23:24:26.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.926+0000 7fb997a00640 1 -- 172.21.15.144:0/4019937216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9900cd5d0 con 0x7fb99015eeb0 2024-09-11T23:24:26.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.927+0000 7fb997a00640 1 -- 172.21.15.144:0/4019937216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9900b6630 con 0x7fb99015eeb0 2024-09-11T23:24:26.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.928+0000 7fb98cc00640 1 -- 172.21.15.144:0/4019937216 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7fb97c01a070 con 0x7fb99015eeb0 2024-09-11T23:24:26.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.929+0000 7fb98cc00640 1 --2- 172.21.15.144:0/4019937216 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb97006c3d0 0x7fb97006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:26.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.929+0000 7fb98cc00640 1 -- 172.21.15.144:0/4019937216 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5881+0+0 (secure 0 0 0) 0x7fb97c08bc50 con 0x7fb99015eeb0 2024-09-11T23:24:26.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.929+0000 7fb995000640 1 --2- 172.21.15.144:0/4019937216 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb97006c3d0 0x7fb97006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:26.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.930+0000 7fb995000640 1 --2- 172.21.15.144:0/4019937216 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb97006c3d0 0x7fb97006e890 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb984034000 tx=0x7fb98402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:26.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:26.933+0000 7fb98cc00640 1 -- 172.21.15.144:0/4019937216 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb97c059d30 con 0x7fb99015eeb0 2024-09-11T23:24:27.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:27.107+0000 7fb997a00640 1 -- 172.21.15.144:0/4019937216 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb9901601f0 con 0x7fb99015eeb0 2024-09-11T23:24:28.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.071+0000 7fb98cc00640 1 -- 172.21.15.144:0/4019937216 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v121) ==== 181+0+0 (secure 0 0 0) 0x7fb97c059630 con 0x7fb99015eeb0 2024-09-11T23:24:28.073 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:24:28.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.075+0000 7fb997a00640 1 -- 172.21.15.144:0/4019937216 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb97006c3d0 msgr2=0x7fb97006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:28.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.075+0000 7fb997a00640 1 --2- 172.21.15.144:0/4019937216 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb97006c3d0 0x7fb97006e890 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb984034000 tx=0x7fb98402e000 comp rx=0 tx=0).stop 2024-09-11T23:24:28.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.075+0000 7fb997a00640 1 -- 172.21.15.144:0/4019937216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb99015eeb0 msgr2=0x7fb9900cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:28.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.075+0000 7fb997a00640 1 --2- 172.21.15.144:0/4019937216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb99015eeb0 0x7fb9900cc230 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fb97c00e980 tx=0x7fb97c00ee40 comp rx=0 tx=0).stop 2024-09-11T23:24:28.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.076+0000 7fb997a00640 1 -- 172.21.15.144:0/4019937216 shutdown_connections 2024-09-11T23:24:28.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.076+0000 7fb997a00640 1 --2- 172.21.15.144:0/4019937216 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb97006c3d0 0x7fb97006e890 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.076+0000 7fb997a00640 1 --2- 172.21.15.144:0/4019937216 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb990161d70 0x7fb99015bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.076+0000 7fb997a00640 1 --2- 172.21.15.144:0/4019937216 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb99015eeb0 0x7fb9900cc230 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.076+0000 7fb997a00640 1 --2- 172.21.15.144:0/4019937216 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9900b61d0 0x7fb9901f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.076+0000 7fb997a00640 1 -- 172.21.15.144:0/4019937216 >> 172.21.15.144:0/4019937216 conn(0x7fb990062c60 msgr2=0x7fb9900cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:28.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.076+0000 7fb997a00640 1 -- 172.21.15.144:0/4019937216 shutdown_connections 2024-09-11T23:24:28.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.076+0000 7fb997a00640 1 -- 172.21.15.144:0/4019937216 wait complete. 2024-09-11T23:24:28.095 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:24:28.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.262+0000 7fcddac00640 1 Processor -- start 2024-09-11T23:24:28.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.262+0000 7fcddac00640 1 -- start start 2024-09-11T23:24:28.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.263+0000 7fcddac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdd4147d70 0x7fcdd4071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:28.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.263+0000 7fcddac00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fcdd4072090 0x7fcdd40ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:28.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.263+0000 7fcddac00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdd40710e0 con 0x7fcdd4148150 2024-09-11T23:24:28.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.263+0000 7fcddac00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fcdd40b5700 con 0x7fcdd4072090 2024-09-11T23:24:28.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.263+0000 7fcddac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcdd4071350 con 0x7fcdd4147d70 2024-09-11T23:24:28.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.264+0000 7fcdd3e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdd4147d70 0x7fcdd4071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:28.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.264+0000 7fcdd8c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fcdd4072090 0x7fcdd40ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:28.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.264+0000 7fcdd3e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdd4147d70 0x7fcdd4071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:60776/0 (socket says 172.21.15.144:60776) 2024-09-11T23:24:28.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.264+0000 7fcdd3e00640 1 -- 172.21.15.144:0/4190597864 learned_addr learned my addr 172.21.15.144:0/4190597864 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:28.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.265+0000 7fcdd3e00640 1 -- 172.21.15.144:0/4190597864 >> v2:172.21.15.165:3300/0 conn(0x7fcdd4072090 msgr2=0x7fcdd40ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:28.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.265+0000 7fcdd3e00640 1 --2- 172.21.15.144:0/4190597864 >> v2:172.21.15.165:3300/0 conn(0x7fcdd4072090 0x7fcdd40ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.265+0000 7fcdd3e00640 1 -- 172.21.15.144:0/4190597864 >> v1:172.21.15.165:6789/0 conn(0x7fcdd4148150 legacy=0x7fcdd406d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:28.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.265+0000 7fcdd3e00640 1 -- 172.21.15.144:0/4190597864 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd4071630 con 0x7fcdd4147d70 2024-09-11T23:24:28.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.265+0000 7fcdd8c00640 1 --2- 172.21.15.144:0/4190597864 >> v2:172.21.15.165:3300/0 conn(0x7fcdd4072090 0x7fcdd40ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:24:28.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.266+0000 7fcdd3e00640 1 --2- 172.21.15.144:0/4190597864 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdd4147d70 0x7fcdd4071b50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009870 tx=0x7fcdc402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25df15a91a9267ff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:28.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.266+0000 7fcdd3400640 1 -- 172.21.15.144:0/4190597864 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4037070 con 0x7fcdd4147d70 2024-09-11T23:24:28.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.266+0000 7fcdd3400640 1 -- 172.21.15.144:0/4190597864 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc4032440 con 0x7fcdd4147d70 2024-09-11T23:24:28.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.266+0000 7fcdd3400640 1 -- 172.21.15.144:0/4190597864 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4032810 con 0x7fcdd4147d70 2024-09-11T23:24:28.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.266+0000 7fcddac00640 1 -- 172.21.15.144:0/4190597864 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdd4147d70 msgr2=0x7fcdd4071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:28.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.266+0000 7fcddac00640 1 --2- 172.21.15.144:0/4190597864 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdd4147d70 0x7fcdd4071b50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009870 tx=0x7fcdc402a250 comp rx=0 tx=0).stop 2024-09-11T23:24:28.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.266+0000 7fcddac00640 1 -- 172.21.15.144:0/4190597864 shutdown_connections 2024-09-11T23:24:28.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.266+0000 7fcddac00640 1 --2- 172.21.15.144:0/4190597864 >> v2:172.21.15.165:3300/0 conn(0x7fcdd4072090 0x7fcdd40ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.266+0000 7fcddac00640 1 --2- 172.21.15.144:0/4190597864 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdd4147d70 0x7fcdd4071b50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.266+0000 7fcddac00640 1 -- 172.21.15.144:0/4190597864 >> 172.21.15.144:0/4190597864 conn(0x7fcdd406bba0 msgr2=0x7fcdd406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:28.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.267+0000 7fcddac00640 1 -- 172.21.15.144:0/4190597864 shutdown_connections 2024-09-11T23:24:28.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.267+0000 7fcddac00640 1 -- 172.21.15.144:0/4190597864 wait complete. 2024-09-11T23:24:28.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.268+0000 7fcddac00640 1 Processor -- start 2024-09-11T23:24:28.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.268+0000 7fcddac00640 1 -- start start 2024-09-11T23:24:28.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.269+0000 7fcddac00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdd4072090 0x7fcdd413dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:28.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.269+0000 7fcddac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdd4147d70 0x7fcdd406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:28.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.269+0000 7fcddac00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcdd4148150 0x7fcdd406e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:28.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.269+0000 7fcddac00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd406d910 con 0x7fcdd4072090 2024-09-11T23:24:28.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.269+0000 7fcddac00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd406d790 con 0x7fcdd4148150 2024-09-11T23:24:28.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.269+0000 7fcddac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcdd40aee20 con 0x7fcdd4147d70 2024-09-11T23:24:28.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.270+0000 7fcdd3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdd4072090 0x7fcdd413dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:28.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.270+0000 7fcdd3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdd4072090 0x7fcdd413dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46422/0 (socket says 172.21.15.144:46422) 2024-09-11T23:24:28.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.270+0000 7fcdd3e00640 1 -- 172.21.15.144:0/4189143742 learned_addr learned my addr 172.21.15.144:0/4189143742 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:28.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.270+0000 7fcdcb400640 1 --2- 172.21.15.144:0/4189143742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdd4147d70 0x7fcdd406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:28.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.270+0000 7fcdd8c00640 1 --2- 172.21.15.144:0/4189143742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcdd4148150 0x7fcdd406e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:28.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.270+0000 7fcdd3e00640 1 -- 172.21.15.144:0/4189143742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdd4147d70 msgr2=0x7fcdd406e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:28.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.270+0000 7fcdd3e00640 1 --2- 172.21.15.144:0/4189143742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdd4147d70 0x7fcdd406e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.270+0000 7fcdd3e00640 1 -- 172.21.15.144:0/4189143742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcdd4148150 msgr2=0x7fcdd406e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:28.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.270+0000 7fcdd3e00640 1 --2- 172.21.15.144:0/4189143742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcdd4148150 0x7fcdd406e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.270+0000 7fcdd3e00640 1 -- 172.21.15.144:0/4189143742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd415f7b0 con 0x7fcdd4072090 2024-09-11T23:24:28.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.270+0000 7fcdd3e00640 1 --2- 172.21.15.144:0/4189143742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdd4072090 0x7fcdd413dc50 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fcdc402a290 tx=0x7fcdc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:28.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.271+0000 7fcdd0c00640 1 -- 172.21.15.144:0/4189143742 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4037040 con 0x7fcdd4072090 2024-09-11T23:24:28.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.271+0000 7fcdd0c00640 1 -- 172.21.15.144:0/4189143742 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc4042070 con 0x7fcdd4072090 2024-09-11T23:24:28.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.271+0000 7fcdd0c00640 1 -- 172.21.15.144:0/4189143742 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4030880 con 0x7fcdd4072090 2024-09-11T23:24:28.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.271+0000 7fcddac00640 1 -- 172.21.15.144:0/4189143742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd415fa90 con 0x7fcdd4072090 2024-09-11T23:24:28.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.271+0000 7fcddac00640 1 -- 172.21.15.144:0/4189143742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd41f41c0 con 0x7fcdd4072090 2024-09-11T23:24:28.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.272+0000 7fcddac00640 1 -- 172.21.15.144:0/4189143742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdd40af200 con 0x7fcdd4072090 2024-09-11T23:24:28.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.273+0000 7fcdd0c00640 1 -- 172.21.15.144:0/4189143742 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7fcdc4030a20 con 0x7fcdd4072090 2024-09-11T23:24:28.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.274+0000 7fcdd0c00640 1 --2- 172.21.15.144:0/4189143742 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcdb006c3d0 0x7fcdb006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:28.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.274+0000 7fcdd0c00640 1 -- 172.21.15.144:0/4189143742 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5443+0+0 (secure 0 0 0) 0x7fcdc40abe30 con 0x7fcdd4072090 2024-09-11T23:24:28.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.274+0000 7fcdcb400640 1 --2- 172.21.15.144:0/4189143742 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcdb006c3d0 0x7fcdb006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:28.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.275+0000 7fcdcb400640 1 --2- 172.21.15.144:0/4189143742 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcdb006c3d0 0x7fcdb006e890 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4160220 tx=0x7fcdbc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:28.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.278+0000 7fcdd0c00640 1 -- 172.21.15.144:0/4189143742 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcdc4079a70 con 0x7fcdd4072090 2024-09-11T23:24:28.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.453+0000 7fcddac00640 1 -- 172.21.15.144:0/4189143742 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcdd40b1ba0 con 0x7fcdd4072090 2024-09-11T23:24:28.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.480+0000 7fcdd0c00640 1 -- 172.21.15.144:0/4189143742 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v122) ==== 169+0+0 (secure 0 0 0) 0x7fcdc407dd70 con 0x7fcdd4072090 2024-09-11T23:24:28.481 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-11T23:24:28.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.482+0000 7fcddac00640 1 -- 172.21.15.144:0/4189143742 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcdb006c3d0 msgr2=0x7fcdb006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:28.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.482+0000 7fcddac00640 1 --2- 172.21.15.144:0/4189143742 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcdb006c3d0 0x7fcdb006e890 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4160220 tx=0x7fcdbc009040 comp rx=0 tx=0).stop 2024-09-11T23:24:28.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.482+0000 7fcddac00640 1 -- 172.21.15.144:0/4189143742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdd4072090 msgr2=0x7fcdd413dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:28.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.482+0000 7fcddac00640 1 --2- 172.21.15.144:0/4189143742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdd4072090 0x7fcdd413dc50 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fcdc402a290 tx=0x7fcdc40046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.482+0000 7fcddac00640 1 -- 172.21.15.144:0/4189143742 shutdown_connections 2024-09-11T23:24:28.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.482+0000 7fcddac00640 1 --2- 172.21.15.144:0/4189143742 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcdb006c3d0 0x7fcdb006e890 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.482+0000 7fcddac00640 1 --2- 172.21.15.144:0/4189143742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcdd4148150 0x7fcdd406e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.482+0000 7fcddac00640 1 --2- 172.21.15.144:0/4189143742 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcdd4147d70 0x7fcdd406e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.482+0000 7fcddac00640 1 --2- 172.21.15.144:0/4189143742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdd4072090 0x7fcdd413dc50 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.482+0000 7fcddac00640 1 -- 172.21.15.144:0/4189143742 >> 172.21.15.144:0/4189143742 conn(0x7fcdd406bba0 msgr2=0x7fcdd40b4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:28.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.482+0000 7fcddac00640 1 -- 172.21.15.144:0/4189143742 shutdown_connections 2024-09-11T23:24:28.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.482+0000 7fcddac00640 1 -- 172.21.15.144:0/4189143742 wait complete. 2024-09-11T23:24:28.501 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:24:28.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.657+0000 7fe42be00640 1 Processor -- start 2024-09-11T23:24:28.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.657+0000 7fe42be00640 1 -- start start 2024-09-11T23:24:28.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.658+0000 7fe42be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe42c143c70 0x7fe42c06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:28.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.658+0000 7fe42be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe42c06e410 0x7fe42c0733a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:28.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.658+0000 7fe42be00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe42c162080 con 0x7fe42c15c090 2024-09-11T23:24:28.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.658+0000 7fe42be00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe42c06e880 con 0x7fe42c143c70 2024-09-11T23:24:28.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.658+0000 7fe42be00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe42c162360 con 0x7fe42c06e410 2024-09-11T23:24:28.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.658+0000 7fe42a000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe42c143c70 0x7fe42c06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:28.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.658+0000 7fe42a000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe42c143c70 0x7fe42c06ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46438/0 (socket says 172.21.15.144:46438) 2024-09-11T23:24:28.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.658+0000 7fe42a000640 1 -- 172.21.15.144:0/2964293775 learned_addr learned my addr 172.21.15.144:0/2964293775 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:28.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.658+0000 7fe42aa00640 1 --1- 172.21.15.144:0/2964293775 >> v1:172.21.15.144:6789/0 conn(0x7fe42c15c090 0x7fe42c06f820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33732/0 (socket says 172.21.15.144:33732) 2024-09-11T23:24:28.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.658+0000 7fe42b400640 1 --2- 172.21.15.144:0/2964293775 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe42c06e410 0x7fe42c0733a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.659+0000 7fe42a000640 1 -- 172.21.15.144:0/2964293775 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe42c06e410 msgr2=0x7fe42c0733a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.659+0000 7fe42a000640 1 --2- 172.21.15.144:0/2964293775 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe42c06e410 0x7fe42c0733a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.659+0000 7fe42a000640 1 -- 172.21.15.144:0/2964293775 >> v1:172.21.15.144:6789/0 conn(0x7fe42c15c090 legacy=0x7fe42c06f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.659+0000 7fe42a000640 1 -- 172.21.15.144:0/2964293775 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c162640 con 0x7fe42c143c70 2024-09-11T23:24:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.660+0000 7fe42a000640 1 --2- 172.21.15.144:0/2964293775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c143c70 0x7fe42c06ded0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fe418009870 tx=0x7fe41802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3ed62ba7c5ee83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.660+0000 7fe429600640 1 -- 172.21.15.144:0/2964293775 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418037070 con 0x7fe42c143c70 2024-09-11T23:24:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.660+0000 7fe429600640 1 -- 172.21.15.144:0/2964293775 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe418032440 con 0x7fe42c143c70 2024-09-11T23:24:28.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.660+0000 7fe429600640 1 -- 172.21.15.144:0/2964293775 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418032810 con 0x7fe42c143c70 2024-09-11T23:24:28.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.660+0000 7fe42be00640 1 -- 172.21.15.144:0/2964293775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c143c70 msgr2=0x7fe42c06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:28.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.660+0000 7fe42be00640 1 --2- 172.21.15.144:0/2964293775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c143c70 0x7fe42c06ded0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fe418009870 tx=0x7fe41802a1c0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.660+0000 7fe42be00640 1 -- 172.21.15.144:0/2964293775 shutdown_connections 2024-09-11T23:24:28.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.661+0000 7fe42be00640 1 --2- 172.21.15.144:0/2964293775 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe42c06e410 0x7fe42c0733a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.661+0000 7fe42be00640 1 --2- 172.21.15.144:0/2964293775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c143c70 0x7fe42c06ded0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.661+0000 7fe42be00640 1 -- 172.21.15.144:0/2964293775 >> 172.21.15.144:0/2964293775 conn(0x7fe42c06bd80 msgr2=0x7fe42c062630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:28.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.661+0000 7fe42be00640 1 -- 172.21.15.144:0/2964293775 shutdown_connections 2024-09-11T23:24:28.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.661+0000 7fe42be00640 1 -- 172.21.15.144:0/2964293775 wait complete. 2024-09-11T23:24:28.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.662+0000 7fe42be00640 1 Processor -- start 2024-09-11T23:24:28.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.662+0000 7fe42be00640 1 -- start start 2024-09-11T23:24:28.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.663+0000 7fe42be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe42c06e410 0x7fe42c1f8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:28.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.663+0000 7fe42be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c143c70 0x7fe42c13fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:28.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.663+0000 7fe42be00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe42c15c090 0x7fe42c073310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:28.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.663+0000 7fe42be00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c06f3b0 con 0x7fe42c143c70 2024-09-11T23:24:28.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.663+0000 7fe42be00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c06ff30 con 0x7fe42c06e410 2024-09-11T23:24:28.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.663+0000 7fe42be00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe42c06f530 con 0x7fe42c15c090 2024-09-11T23:24:28.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.663+0000 7fe42a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c143c70 0x7fe42c13fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:28.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.663+0000 7fe42a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c143c70 0x7fe42c13fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46442/0 (socket says 172.21.15.144:46442) 2024-09-11T23:24:28.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.663+0000 7fe42a000640 1 -- 172.21.15.144:0/1396656961 learned_addr learned my addr 172.21.15.144:0/1396656961 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:28.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.664+0000 7fe42b400640 1 --2- 172.21.15.144:0/1396656961 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe42c15c090 0x7fe42c073310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:28.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.664+0000 7fe42aa00640 1 --2- 172.21.15.144:0/1396656961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe42c06e410 0x7fe42c1f8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:28.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.664+0000 7fe42a000640 1 -- 172.21.15.144:0/1396656961 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe42c15c090 msgr2=0x7fe42c073310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:28.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.664+0000 7fe42a000640 1 --2- 172.21.15.144:0/1396656961 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe42c15c090 0x7fe42c073310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.664+0000 7fe42a000640 1 -- 172.21.15.144:0/1396656961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe42c06e410 msgr2=0x7fe42c1f8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:28.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.664+0000 7fe42a000640 1 --2- 172.21.15.144:0/1396656961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe42c06e410 0x7fe42c1f8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.664+0000 7fe42a000640 1 -- 172.21.15.144:0/1396656961 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c1f4ba0 con 0x7fe42c143c70 2024-09-11T23:24:28.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.664+0000 7fe42aa00640 1 --2- 172.21.15.144:0/1396656961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe42c06e410 0x7fe42c1f8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:28.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.664+0000 7fe42a000640 1 --2- 172.21.15.144:0/1396656961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c143c70 0x7fe42c13fe70 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fe418000c00 tx=0x7fe4180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:28.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.664+0000 7fe422a00640 1 -- 172.21.15.144:0/1396656961 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418041020 con 0x7fe42c143c70 2024-09-11T23:24:28.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.665+0000 7fe422a00640 1 -- 172.21.15.144:0/1396656961 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4180306c0 con 0x7fe42c143c70 2024-09-11T23:24:28.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.665+0000 7fe422a00640 1 -- 172.21.15.144:0/1396656961 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418037040 con 0x7fe42c143c70 2024-09-11T23:24:28.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.665+0000 7fe42be00640 1 -- 172.21.15.144:0/1396656961 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42c1f4e80 con 0x7fe42c143c70 2024-09-11T23:24:28.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.665+0000 7fe42be00640 1 -- 172.21.15.144:0/1396656961 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe42c1f5440 con 0x7fe42c143c70 2024-09-11T23:24:28.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.666+0000 7fe42be00640 1 -- 172.21.15.144:0/1396656961 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe42c06ded0 con 0x7fe42c143c70 2024-09-11T23:24:28.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.667+0000 7fe422a00640 1 -- 172.21.15.144:0/1396656961 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7fe418044020 con 0x7fe42c143c70 2024-09-11T23:24:28.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.667+0000 7fe422a00640 1 --2- 172.21.15.144:0/1396656961 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe40c06c400 0x7fe40c06e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:28.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.668+0000 7fe422a00640 1 -- 172.21.15.144:0/1396656961 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 4971+0+0 (secure 0 0 0) 0x7fe4180abc60 con 0x7fe42c143c70 2024-09-11T23:24:28.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.668+0000 7fe42aa00640 1 --2- 172.21.15.144:0/1396656961 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe40c06c400 0x7fe40c06e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:28.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.669+0000 7fe42aa00640 1 --2- 172.21.15.144:0/1396656961 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe40c06c400 0x7fe40c06e8c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe41c000f60 tx=0x7fe41c007ce0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:28.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.672+0000 7fe422a00640 1 -- 172.21.15.144:0/1396656961 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe41804b030 con 0x7fe42c143c70 2024-09-11T23:24:28.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.847+0000 7fe42be00640 1 -- 172.21.15.144:0/1396656961 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fe42c0b1d60 con 0x7fe42c143c70 2024-09-11T23:24:28.852 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.853+0000 7fe422a00640 1 -- 172.21.15.144:0/1396656961 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7fe41807a110 con 0x7fe42c143c70 2024-09-11T23:24:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.855+0000 7fe42be00640 1 -- 172.21.15.144:0/1396656961 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe40c06c400 msgr2=0x7fe40c06e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.855+0000 7fe42be00640 1 --2- 172.21.15.144:0/1396656961 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe40c06c400 0x7fe40c06e8c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe41c000f60 tx=0x7fe41c007ce0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.855+0000 7fe42be00640 1 -- 172.21.15.144:0/1396656961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c143c70 msgr2=0x7fe42c13fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.855+0000 7fe42be00640 1 --2- 172.21.15.144:0/1396656961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c143c70 0x7fe42c13fe70 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fe418000c00 tx=0x7fe4180046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.856+0000 7fe42be00640 1 -- 172.21.15.144:0/1396656961 shutdown_connections 2024-09-11T23:24:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.856+0000 7fe42be00640 1 --2- 172.21.15.144:0/1396656961 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe40c06c400 0x7fe40c06e8c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.856+0000 7fe42be00640 1 --2- 172.21.15.144:0/1396656961 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe42c15c090 0x7fe42c073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.856+0000 7fe42be00640 1 --2- 172.21.15.144:0/1396656961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c143c70 0x7fe42c13fe70 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.856+0000 7fe42be00640 1 --2- 172.21.15.144:0/1396656961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe42c06e410 0x7fe42c1f8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.856+0000 7fe42be00640 1 -- 172.21.15.144:0/1396656961 >> 172.21.15.144:0/1396656961 conn(0x7fe42c06bd80 msgr2=0x7fe42c15f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.856+0000 7fe42be00640 1 -- 172.21.15.144:0/1396656961 shutdown_connections 2024-09-11T23:24:28.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:28.856+0000 7fe42be00640 1 -- 172.21.15.144:0/1396656961 wait complete. 2024-09-11T23:24:28.871 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2' 2024-09-11T23:24:29.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.027+0000 7fe1e5000640 1 Processor -- start 2024-09-11T23:24:29.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.027+0000 7fe1e5000640 1 -- start start 2024-09-11T23:24:29.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.028+0000 7fe1e5000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe1e00d02a0 0x7fe1e00d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:29.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.028+0000 7fe1e5000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1e015ca40 0x7fe1e015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:29.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.028+0000 7fe1e5000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e00d0bc0 con 0x7fe1e015ce80 2024-09-11T23:24:29.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.028+0000 7fe1e5000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe1e015d390 con 0x7fe1e00d02a0 2024-09-11T23:24:29.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.028+0000 7fe1e5000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe1e015d670 con 0x7fe1e015ca40 2024-09-11T23:24:29.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.028+0000 7fe1dde00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe1e00d02a0 0x7fe1e00d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:29.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.028+0000 7fe1de800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe1e015ce80 0x7fe1e01594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33734/0 (socket says 172.21.15.144:33734) 2024-09-11T23:24:29.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.028+0000 7fe1de800640 1 -- 172.21.15.144:0/2164027237 learned_addr learned my addr 172.21.15.144:0/2164027237 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:29.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.029+0000 7fe1d7e00640 1 --2- 172.21.15.144:0/2164027237 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1e015ca40 0x7fe1e015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.029+0000 7fe1dde00640 1 -- 172.21.15.144:0/2164027237 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1e015ca40 msgr2=0x7fe1e015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.029+0000 7fe1dde00640 1 --2- 172.21.15.144:0/2164027237 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1e015ca40 0x7fe1e015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.029+0000 7fe1dde00640 1 -- 172.21.15.144:0/2164027237 >> v1:172.21.15.144:6789/0 conn(0x7fe1e015ce80 legacy=0x7fe1e01594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.029+0000 7fe1dde00640 1 -- 172.21.15.144:0/2164027237 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e015d950 con 0x7fe1e00d02a0 2024-09-11T23:24:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.029+0000 7fe1d7e00640 1 --2- 172.21.15.144:0/2164027237 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1e015ca40 0x7fe1e015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:24:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.029+0000 7fe1dd400640 1 -- 172.21.15.144:0/2164027237 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 511401188 0 0) 0x7fe1e00d0bc0 con 0x7fe1e015ce80 2024-09-11T23:24:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.030+0000 7fe1dde00640 1 --2- 172.21.15.144:0/2164027237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e00d02a0 0x7fe1e00d0680 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00097a0 tx=0x7fe1d002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea429805cb32eea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.030+0000 7fe1dd400640 1 -- 172.21.15.144:0/2164027237 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0037070 con 0x7fe1e00d02a0 2024-09-11T23:24:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.030+0000 7fe1dd400640 1 -- 172.21.15.144:0/2164027237 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d002ae50 con 0x7fe1e00d02a0 2024-09-11T23:24:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.030+0000 7fe1dd400640 1 -- 172.21.15.144:0/2164027237 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0032660 con 0x7fe1e00d02a0 2024-09-11T23:24:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.030+0000 7fe1e5000640 1 -- 172.21.15.144:0/2164027237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e00d02a0 msgr2=0x7fe1e00d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:29.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.030+0000 7fe1e5000640 1 --2- 172.21.15.144:0/2164027237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e00d02a0 0x7fe1e00d0680 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00097a0 tx=0x7fe1d002a100 comp rx=0 tx=0).stop 2024-09-11T23:24:29.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.031+0000 7fe1e5000640 1 -- 172.21.15.144:0/2164027237 shutdown_connections 2024-09-11T23:24:29.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.031+0000 7fe1e5000640 1 --2- 172.21.15.144:0/2164027237 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1e015ca40 0x7fe1e015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:29.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.031+0000 7fe1e5000640 1 --2- 172.21.15.144:0/2164027237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e00d02a0 0x7fe1e00d0680 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:29.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.031+0000 7fe1e5000640 1 -- 172.21.15.144:0/2164027237 >> 172.21.15.144:0/2164027237 conn(0x7fe1e0062cc0 msgr2=0x7fe1e006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:29.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.031+0000 7fe1e5000640 1 -- 172.21.15.144:0/2164027237 shutdown_connections 2024-09-11T23:24:29.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.031+0000 7fe1e5000640 1 -- 172.21.15.144:0/2164027237 wait complete. 2024-09-11T23:24:29.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.032+0000 7fe1e5000640 1 Processor -- start 2024-09-11T23:24:29.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.032+0000 7fe1e5000640 1 -- start start 2024-09-11T23:24:29.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.033+0000 7fe1e5000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1e00d02a0 0x7fe1e01f4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.033+0000 7fe1e5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e015ca40 0x7fe1e01f7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.033+0000 7fe1e5000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1e015ce80 0x7fe1e01f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.033+0000 7fe1e5000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e0155b90 con 0x7fe1e015ca40 2024-09-11T23:24:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.033+0000 7fe1e5000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e015df10 con 0x7fe1e015ce80 2024-09-11T23:24:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.033+0000 7fe1e5000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe1e0155d10 con 0x7fe1e00d02a0 2024-09-11T23:24:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.033+0000 7fe1d7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e015ca40 0x7fe1e01f7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.033+0000 7fe1d7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e015ca40 0x7fe1e01f7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46460/0 (socket says 172.21.15.144:46460) 2024-09-11T23:24:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.034+0000 7fe1d7e00640 1 -- 172.21.15.144:0/683184773 learned_addr learned my addr 172.21.15.144:0/683184773 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.034+0000 7fe1dde00640 1 --2- 172.21.15.144:0/683184773 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1e00d02a0 0x7fe1e01f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.034+0000 7fe1de800640 1 --2- 172.21.15.144:0/683184773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1e015ce80 0x7fe1e01f7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.034+0000 7fe1d7e00640 1 -- 172.21.15.144:0/683184773 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1e00d02a0 msgr2=0x7fe1e01f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.034+0000 7fe1d7e00640 1 --2- 172.21.15.144:0/683184773 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1e00d02a0 0x7fe1e01f4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:29.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.034+0000 7fe1d7e00640 1 -- 172.21.15.144:0/683184773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1e015ce80 msgr2=0x7fe1e01f7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.034+0000 7fe1d7e00640 1 --2- 172.21.15.144:0/683184773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1e015ce80 0x7fe1e01f7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.034+0000 7fe1d7e00640 1 -- 172.21.15.144:0/683184773 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e01f51d0 con 0x7fe1e015ca40 2024-09-11T23:24:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.034+0000 7fe1de800640 1 --2- 172.21.15.144:0/683184773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1e015ce80 0x7fe1e01f7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.034+0000 7fe1d7e00640 1 --2- 172.21.15.144:0/683184773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e015ca40 0x7fe1e01f7800 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800c820 tx=0x7fe1c800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.034+0000 7fe1d6000640 1 -- 172.21.15.144:0/683184773 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8015070 con 0x7fe1e015ca40 2024-09-11T23:24:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.034+0000 7fe1d6000640 1 -- 172.21.15.144:0/683184773 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c8007a30 con 0x7fe1e015ca40 2024-09-11T23:24:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.034+0000 7fe1d6000640 1 -- 172.21.15.144:0/683184773 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8007de0 con 0x7fe1e015ca40 2024-09-11T23:24:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.034+0000 7fe1e5000640 1 -- 172.21.15.144:0/683184773 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e00731d0 con 0x7fe1e015ca40 2024-09-11T23:24:29.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.035+0000 7fe1e5000640 1 -- 172.21.15.144:0/683184773 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e0073790 con 0x7fe1e015ca40 2024-09-11T23:24:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.036+0000 7fe1e5000640 1 -- 172.21.15.144:0/683184773 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1e00b4790 con 0x7fe1e015ca40 2024-09-11T23:24:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.037+0000 7fe1d6000640 1 -- 172.21.15.144:0/683184773 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7fe1c8018070 con 0x7fe1e015ca40 2024-09-11T23:24:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.037+0000 7fe1d6000640 1 --2- 172.21.15.144:0/683184773 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe1bc06c3d0 0x7fe1bc06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.037+0000 7fe1d6000640 1 -- 172.21.15.144:0/683184773 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 4971+0+0 (secure 0 0 0) 0x7fe1c808b400 con 0x7fe1e015ca40 2024-09-11T23:24:29.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.038+0000 7fe1dde00640 1 --2- 172.21.15.144:0/683184773 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe1bc06c3d0 0x7fe1bc06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:29.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.038+0000 7fe1dde00640 1 --2- 172.21.15.144:0/683184773 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe1bc06c3d0 0x7fe1bc06e890 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0034000 tx=0x7fe1d002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:29.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.041+0000 7fe1d6000640 1 -- 172.21.15.144:0/683184773 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe1e01f51d0 con 0x7fe1e015ca40 2024-09-11T23:24:29.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:29.294+0000 7fe1e5000640 1 -- 172.21.15.144:0/683184773 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]} v 0) -- 0x7fe1e00cc6b0 con 0x7fe1e015ca40 2024-09-11T23:24:30.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.075+0000 7fe1d6000640 1 -- 172.21.15.144:0/683184773 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]}]=0 v360) ==== 148+0+0 (secure 0 0 0) 0x7fe1c80591f0 con 0x7fe1e015ca40 2024-09-11T23:24:30.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.077+0000 7fe1e5000640 1 -- 172.21.15.144:0/683184773 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe1bc06c3d0 msgr2=0x7fe1bc06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.077+0000 7fe1e5000640 1 --2- 172.21.15.144:0/683184773 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe1bc06c3d0 0x7fe1bc06e890 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0034000 tx=0x7fe1d002e000 comp rx=0 tx=0).stop 2024-09-11T23:24:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.077+0000 7fe1e5000640 1 -- 172.21.15.144:0/683184773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e015ca40 msgr2=0x7fe1e01f7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.077+0000 7fe1e5000640 1 --2- 172.21.15.144:0/683184773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e015ca40 0x7fe1e01f7800 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800c820 tx=0x7fe1c800cce0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.078+0000 7fe1e5000640 1 -- 172.21.15.144:0/683184773 shutdown_connections 2024-09-11T23:24:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.078+0000 7fe1e5000640 1 --2- 172.21.15.144:0/683184773 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe1bc06c3d0 0x7fe1bc06e890 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.078+0000 7fe1e5000640 1 --2- 172.21.15.144:0/683184773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1e015ce80 0x7fe1e01f7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.078+0000 7fe1e5000640 1 --2- 172.21.15.144:0/683184773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe1e015ca40 0x7fe1e01f7800 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.078+0000 7fe1e5000640 1 --2- 172.21.15.144:0/683184773 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe1e00d02a0 0x7fe1e01f4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.078+0000 7fe1e5000640 1 -- 172.21.15.144:0/683184773 >> 172.21.15.144:0/683184773 conn(0x7fe1e0062cc0 msgr2=0x7fe1e00b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.078+0000 7fe1e5000640 1 -- 172.21.15.144:0/683184773 shutdown_connections 2024-09-11T23:24:30.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.078+0000 7fe1e5000640 1 -- 172.21.15.144:0/683184773 wait complete. 2024-09-11T23:24:30.097 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- theme continues... ... ok 2024-09-11T23:24:30.097 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_ops_on_nonexistent_vol (tasks.cephfs.test_volumes.TestMisc) 2024-09-11T23:24:30.098 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:24:30.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.254+0000 7fce43e00640 1 Processor -- start 2024-09-11T23:24:30.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.255+0000 7fce43e00640 1 -- start start 2024-09-11T23:24:30.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.256+0000 7fce43e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce3c15c180 0x7fce3c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:30.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.256+0000 7fce43e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fce3c073120 0x7fce3c0735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:30.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.256+0000 7fce43e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce3c0ce740 con 0x7fce3c0ce230 2024-09-11T23:24:30.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.256+0000 7fce43e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fce3c072640 con 0x7fce3c073120 2024-09-11T23:24:30.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.256+0000 7fce43e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fce3c072920 con 0x7fce3c15c180 2024-09-11T23:24:30.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.256+0000 7fce41e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fce3c073120 0x7fce3c0735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:30.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.256+0000 7fce41e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fce3c073120 0x7fce3c0735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46464/0 (socket says 172.21.15.144:46464) 2024-09-11T23:24:30.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.256+0000 7fce41e00640 1 -- 172.21.15.144:0/1444336420 learned_addr learned my addr 172.21.15.144:0/1444336420 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:30.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.256+0000 7fce41400640 1 --2- 172.21.15.144:0/1444336420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce3c15c180 0x7fce3c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:30.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.257+0000 7fce41e00640 1 -- 172.21.15.144:0/1444336420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce3c15c180 msgr2=0x7fce3c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:30.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.257+0000 7fce41e00640 1 --2- 172.21.15.144:0/1444336420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce3c15c180 0x7fce3c0cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.257+0000 7fce41e00640 1 -- 172.21.15.144:0/1444336420 >> v1:172.21.15.165:6789/0 conn(0x7fce3c0ce230 legacy=0x7fce3c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.257+0000 7fce41e00640 1 -- 172.21.15.144:0/1444336420 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c072c00 con 0x7fce3c073120 2024-09-11T23:24:30.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.258+0000 7fce41e00640 1 --2- 172.21.15.144:0/1444336420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c073120 0x7fce3c0735d0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fce34009e50 tx=0x7fce3402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f813446591958670 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:30.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.258+0000 7fce3be00640 1 -- 172.21.15.144:0/1444336420 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce34036070 con 0x7fce3c073120 2024-09-11T23:24:30.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.258+0000 7fce3be00640 1 -- 172.21.15.144:0/1444336420 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce34031600 con 0x7fce3c073120 2024-09-11T23:24:30.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.258+0000 7fce3be00640 1 -- 172.21.15.144:0/1444336420 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce340319d0 con 0x7fce3c073120 2024-09-11T23:24:30.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.258+0000 7fce43e00640 1 -- 172.21.15.144:0/1444336420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c073120 msgr2=0x7fce3c0735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.258+0000 7fce43e00640 1 --2- 172.21.15.144:0/1444336420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c073120 0x7fce3c0735d0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fce34009e50 tx=0x7fce3402a680 comp rx=0 tx=0).stop 2024-09-11T23:24:30.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.258+0000 7fce43e00640 1 -- 172.21.15.144:0/1444336420 shutdown_connections 2024-09-11T23:24:30.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.258+0000 7fce43e00640 1 --2- 172.21.15.144:0/1444336420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c073120 0x7fce3c0735d0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.258+0000 7fce43e00640 1 --2- 172.21.15.144:0/1444336420 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce3c15c180 0x7fce3c0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.258+0000 7fce43e00640 1 -- 172.21.15.144:0/1444336420 >> 172.21.15.144:0/1444336420 conn(0x7fce3c062cc0 msgr2=0x7fce3c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:30.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.259+0000 7fce43e00640 1 -- 172.21.15.144:0/1444336420 shutdown_connections 2024-09-11T23:24:30.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.259+0000 7fce43e00640 1 -- 172.21.15.144:0/1444336420 wait complete. 2024-09-11T23:24:30.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.260+0000 7fce43e00640 1 Processor -- start 2024-09-11T23:24:30.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.260+0000 7fce43e00640 1 -- start start 2024-09-11T23:24:30.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.261+0000 7fce43e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce3c073120 0x7fce3c149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:30.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.261+0000 7fce43e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c0ce230 0x7fce3c0ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:30.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.261+0000 7fce43e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce3c15c180 0x7fce3c0aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:30.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.261+0000 7fce43e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c0cf780 con 0x7fce3c0ce230 2024-09-11T23:24:30.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.261+0000 7fce43e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c0722f0 con 0x7fce3c15c180 2024-09-11T23:24:30.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.261+0000 7fce43e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fce3c15c560 con 0x7fce3c073120 2024-09-11T23:24:30.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.261+0000 7fce40a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c0ce230 0x7fce3c0ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:30.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.261+0000 7fce40a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c0ce230 0x7fce3c0ac3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46472/0 (socket says 172.21.15.144:46472) 2024-09-11T23:24:30.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.261+0000 7fce40a00640 1 -- 172.21.15.144:0/2535274394 learned_addr learned my addr 172.21.15.144:0/2535274394 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:30.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.262+0000 7fce41400640 1 --2- 172.21.15.144:0/2535274394 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce3c073120 0x7fce3c149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:30.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.262+0000 7fce41e00640 1 --2- 172.21.15.144:0/2535274394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce3c15c180 0x7fce3c0aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:30.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.262+0000 7fce40a00640 1 -- 172.21.15.144:0/2535274394 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce3c073120 msgr2=0x7fce3c149d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.262+0000 7fce40a00640 1 --2- 172.21.15.144:0/2535274394 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce3c073120 0x7fce3c149d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.262+0000 7fce40a00640 1 -- 172.21.15.144:0/2535274394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce3c15c180 msgr2=0x7fce3c0aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.262+0000 7fce40a00640 1 --2- 172.21.15.144:0/2535274394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce3c15c180 0x7fce3c0aa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.262+0000 7fce40a00640 1 -- 172.21.15.144:0/2535274394 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c0acd80 con 0x7fce3c0ce230 2024-09-11T23:24:30.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.262+0000 7fce41400640 1 --2- 172.21.15.144:0/2535274394 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce3c073120 0x7fce3c149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:30.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.262+0000 7fce40a00640 1 --2- 172.21.15.144:0/2535274394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c0ce230 0x7fce3c0ac3a0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fce2800c440 tx=0x7fce28001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:30.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.262+0000 7fce39600640 1 -- 172.21.15.144:0/2535274394 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce280052d0 con 0x7fce3c0ce230 2024-09-11T23:24:30.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.262+0000 7fce39600640 1 -- 172.21.15.144:0/2535274394 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce28005470 con 0x7fce3c0ce230 2024-09-11T23:24:30.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.262+0000 7fce39600640 1 -- 172.21.15.144:0/2535274394 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce28007260 con 0x7fce3c0ce230 2024-09-11T23:24:30.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.262+0000 7fce43e00640 1 -- 172.21.15.144:0/2535274394 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3c0ad060 con 0x7fce3c0ce230 2024-09-11T23:24:30.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.263+0000 7fce43e00640 1 -- 172.21.15.144:0/2535274394 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3c0ad620 con 0x7fce3c0ce230 2024-09-11T23:24:30.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.263+0000 7fce43e00640 1 -- 172.21.15.144:0/2535274394 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce3c071610 con 0x7fce3c0ce230 2024-09-11T23:24:30.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.264+0000 7fce39600640 1 -- 172.21.15.144:0/2535274394 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7fce28007400 con 0x7fce3c0ce230 2024-09-11T23:24:30.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.265+0000 7fce39600640 1 --2- 172.21.15.144:0/2535274394 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fce1c06c3d0 0x7fce1c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:30.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.265+0000 7fce39600640 1 -- 172.21.15.144:0/2535274394 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 4971+0+0 (secure 0 0 0) 0x7fce2808aaa0 con 0x7fce3c0ce230 2024-09-11T23:24:30.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.266+0000 7fce41400640 1 --2- 172.21.15.144:0/2535274394 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fce1c06c3d0 0x7fce1c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:30.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.266+0000 7fce41400640 1 --2- 172.21.15.144:0/2535274394 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fce1c06c3d0 0x7fce1c06e890 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fce30009b90 tx=0x7fce30008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:30.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.269+0000 7fce39600640 1 -- 172.21.15.144:0/2535274394 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce3c071610 con 0x7fce3c0ce230 2024-09-11T23:24:30.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.444+0000 7fce43e00640 1 -- 172.21.15.144:0/2535274394 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce3c0d0cf0 con 0x7fce3c0ce230 2024-09-11T23:24:30.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.445+0000 7fce39600640 1 -- 172.21.15.144:0/2535274394 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) ==== 74+0+13112 (secure 0 0 0) 0x7fce3c0d0cf0 con 0x7fce3c0ce230 2024-09-11T23:24:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:30.445 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":122,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:24:28.479199+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6835/1311760947":"2024-09-12T23:24:25.735557+0000","172.21.15.144:6834/1311760947":"2024-09-12T23:24:25.735557+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:24:30.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.447+0000 7fce43e00640 1 -- 172.21.15.144:0/2535274394 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fce1c06c3d0 msgr2=0x7fce1c06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.447+0000 7fce43e00640 1 --2- 172.21.15.144:0/2535274394 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fce1c06c3d0 0x7fce1c06e890 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fce30009b90 tx=0x7fce30008040 comp rx=0 tx=0).stop 2024-09-11T23:24:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.447+0000 7fce43e00640 1 -- 172.21.15.144:0/2535274394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c0ce230 msgr2=0x7fce3c0ac3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.447+0000 7fce43e00640 1 --2- 172.21.15.144:0/2535274394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c0ce230 0x7fce3c0ac3a0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fce2800c440 tx=0x7fce28001e70 comp rx=0 tx=0).stop 2024-09-11T23:24:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.447+0000 7fce43e00640 1 -- 172.21.15.144:0/2535274394 shutdown_connections 2024-09-11T23:24:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.447+0000 7fce43e00640 1 --2- 172.21.15.144:0/2535274394 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fce1c06c3d0 0x7fce1c06e890 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.447+0000 7fce43e00640 1 --2- 172.21.15.144:0/2535274394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce3c15c180 0x7fce3c0aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.447+0000 7fce43e00640 1 --2- 172.21.15.144:0/2535274394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fce3c0ce230 0x7fce3c0ac3a0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.447+0000 7fce43e00640 1 --2- 172.21.15.144:0/2535274394 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fce3c073120 0x7fce3c149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.447+0000 7fce43e00640 1 -- 172.21.15.144:0/2535274394 >> 172.21.15.144:0/2535274394 conn(0x7fce3c062cc0 msgr2=0x7fce3c0cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.448+0000 7fce43e00640 1 -- 172.21.15.144:0/2535274394 shutdown_connections 2024-09-11T23:24:30.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.448+0000 7fce43e00640 1 -- 172.21.15.144:0/2535274394 wait complete. 2024-09-11T23:24:30.463 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:17:47.307937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:24:30.463 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:24:30.620 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.621+0000 7f5f8d000640 1 Processor -- start 2024-09-11T23:24:30.621 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.621+0000 7f5f8d000640 1 -- start start 2024-09-11T23:24:30.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.622+0000 7f5f8d000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5f88073cf0 0x7f5f8806d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:30.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.622+0000 7f5f8d000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f880b63b0 0x7f5f8806bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:30.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.622+0000 7f5f8d000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f88147c00 con 0x7f5f88147820 2024-09-11T23:24:30.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.622+0000 7f5f8d000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5f880741d0 con 0x7f5f88073cf0 2024-09-11T23:24:30.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.622+0000 7f5f8d000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5f88162160 con 0x7f5f880b63b0 2024-09-11T23:24:30.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.622+0000 7f5f87400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5f88147820 0x7f5f880b5ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33750/0 (socket says 172.21.15.144:33750) 2024-09-11T23:24:30.622 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.622+0000 7f5f87400640 1 -- 172.21.15.144:0/4007634352 learned_addr learned my addr 172.21.15.144:0/4007634352 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:30.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.622+0000 7f5f7ea00640 1 --2- 172.21.15.144:0/4007634352 >> v2:172.21.15.165:3300/0 conn(0x7f5f88073cf0 0x7f5f8806d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:30.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.622+0000 7f5f87e00640 1 --2- 172.21.15.144:0/4007634352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f880b63b0 0x7f5f8806bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:30.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.623+0000 7f5f86a00640 1 -- 172.21.15.144:0/4007634352 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1108338806 0 0) 0x7f5f88147c00 con 0x7f5f88147820 2024-09-11T23:24:30.623 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.623+0000 7f5f86a00640 1 -- 172.21.15.144:0/4007634352 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f6c003520 con 0x7f5f88147820 2024-09-11T23:24:30.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.623+0000 7f5f7ea00640 1 -- 172.21.15.144:0/4007634352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f880b63b0 msgr2=0x7f5f8806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:30.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.623+0000 7f5f7ea00640 1 --2- 172.21.15.144:0/4007634352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f880b63b0 0x7f5f8806bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.623+0000 7f5f7ea00640 1 -- 172.21.15.144:0/4007634352 >> v1:172.21.15.144:6789/0 conn(0x7f5f88147820 legacy=0x7f5f880b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.624 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.623+0000 7f5f7ea00640 1 -- 172.21.15.144:0/4007634352 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f88162440 con 0x7f5f88073cf0 2024-09-11T23:24:30.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.624+0000 7f5f7ea00640 1 --2- 172.21.15.144:0/4007634352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f88073cf0 0x7f5f8806d7a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5f700097a0 tx=0x7f5f7002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5c81746efc3ddc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:30.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.624+0000 7f5f86a00640 1 -- 172.21.15.144:0/4007634352 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f70037070 con 0x7f5f88073cf0 2024-09-11T23:24:30.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.625+0000 7f5f86a00640 1 -- 172.21.15.144:0/4007634352 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f70032440 con 0x7f5f88073cf0 2024-09-11T23:24:30.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.625+0000 7f5f86a00640 1 -- 172.21.15.144:0/4007634352 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f700327f0 con 0x7f5f88073cf0 2024-09-11T23:24:30.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.625+0000 7f5f8d000640 1 -- 172.21.15.144:0/4007634352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f88073cf0 msgr2=0x7f5f8806d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.625 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.625+0000 7f5f8d000640 1 --2- 172.21.15.144:0/4007634352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f88073cf0 0x7f5f8806d7a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5f700097a0 tx=0x7f5f7002a180 comp rx=0 tx=0).stop 2024-09-11T23:24:30.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.625+0000 7f5f8d000640 1 -- 172.21.15.144:0/4007634352 shutdown_connections 2024-09-11T23:24:30.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.625+0000 7f5f8d000640 1 --2- 172.21.15.144:0/4007634352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f880b63b0 0x7f5f8806bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.625+0000 7f5f8d000640 1 --2- 172.21.15.144:0/4007634352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f88073cf0 0x7f5f8806d7a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.625+0000 7f5f8d000640 1 -- 172.21.15.144:0/4007634352 >> 172.21.15.144:0/4007634352 conn(0x7f5f8806ccb0 msgr2=0x7f5f8806d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:30.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.625+0000 7f5f8d000640 1 -- 172.21.15.144:0/4007634352 shutdown_connections 2024-09-11T23:24:30.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.625+0000 7f5f8d000640 1 -- 172.21.15.144:0/4007634352 wait complete. 2024-09-11T23:24:30.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.627+0000 7f5f8d000640 1 Processor -- start 2024-09-11T23:24:30.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.627+0000 7f5f8d000640 1 -- start start 2024-09-11T23:24:30.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.628+0000 7f5f8d000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f88073cf0 0x7f5f88146230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:30.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.628+0000 7f5f8d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f880b63b0 0x7f5f880cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:30.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.628+0000 7f5f8d000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f88147820 0x7f5f8815fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.628+0000 7f5f8d000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5f88162f20 con 0x7f5f880b63b0 2024-09-11T23:24:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.628+0000 7f5f8d000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5f88162a00 con 0x7f5f88147820 2024-09-11T23:24:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.628+0000 7f5f8d000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5f88148280 con 0x7f5f88073cf0 2024-09-11T23:24:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.628+0000 7f5f7ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f880b63b0 0x7f5f880cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.628+0000 7f5f7ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f880b63b0 0x7f5f880cf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46476/0 (socket says 172.21.15.144:46476) 2024-09-11T23:24:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.628+0000 7f5f7ea00640 1 -- 172.21.15.144:0/3636029235 learned_addr learned my addr 172.21.15.144:0/3636029235 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.628+0000 7f5f87e00640 1 --2- 172.21.15.144:0/3636029235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f88147820 0x7f5f8815fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.628+0000 7f5f87400640 1 --2- 172.21.15.144:0/3636029235 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f88073cf0 0x7f5f88146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:30.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.628+0000 7f5f7ea00640 1 -- 172.21.15.144:0/3636029235 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f88073cf0 msgr2=0x7f5f88146230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.628+0000 7f5f7ea00640 1 --2- 172.21.15.144:0/3636029235 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f88073cf0 0x7f5f88146230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.628+0000 7f5f7ea00640 1 -- 172.21.15.144:0/3636029235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f88147820 msgr2=0x7f5f8815fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.628+0000 7f5f7ea00640 1 --2- 172.21.15.144:0/3636029235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f88147820 0x7f5f8815fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.629+0000 7f5f7ea00640 1 -- 172.21.15.144:0/3636029235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f880cfef0 con 0x7f5f880b63b0 2024-09-11T23:24:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.629+0000 7f5f87400640 1 --2- 172.21.15.144:0/3636029235 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f88073cf0 0x7f5f88146230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:24:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.629+0000 7f5f7ea00640 1 --2- 172.21.15.144:0/3636029235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f880b63b0 0x7f5f880cf7c0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f5f7002a1c0 tx=0x7f5f700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.629+0000 7f5f7fe00640 1 -- 172.21.15.144:0/3636029235 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f70037040 con 0x7f5f880b63b0 2024-09-11T23:24:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.629+0000 7f5f7fe00640 1 -- 172.21.15.144:0/3636029235 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f70042070 con 0x7f5f880b63b0 2024-09-11T23:24:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.629+0000 7f5f7fe00640 1 -- 172.21.15.144:0/3636029235 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7003b930 con 0x7f5f880b63b0 2024-09-11T23:24:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.629+0000 7f5f8d000640 1 -- 172.21.15.144:0/3636029235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f880d01d0 con 0x7f5f880b63b0 2024-09-11T23:24:30.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.629+0000 7f5f8d000640 1 -- 172.21.15.144:0/3636029235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f880d0790 con 0x7f5f880b63b0 2024-09-11T23:24:30.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.630+0000 7f5f8d000640 1 -- 172.21.15.144:0/3636029235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f8806d7a0 con 0x7f5f880b63b0 2024-09-11T23:24:30.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.631+0000 7f5f7fe00640 1 -- 172.21.15.144:0/3636029235 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f5f7003bad0 con 0x7f5f880b63b0 2024-09-11T23:24:30.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.632+0000 7f5f7fe00640 1 --2- 172.21.15.144:0/3636029235 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5f6406c3d0 0x7f5f6406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:30.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.632+0000 7f5f7fe00640 1 -- 172.21.15.144:0/3636029235 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 4971+0+0 (secure 0 0 0) 0x7f5f700abe80 con 0x7f5f880b63b0 2024-09-11T23:24:30.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.633+0000 7f5f87400640 1 --2- 172.21.15.144:0/3636029235 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5f6406c3d0 0x7f5f6406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:30.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.633+0000 7f5f87400640 1 --2- 172.21.15.144:0/3636029235 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5f6406c3d0 0x7f5f6406e890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5f78005880 tx=0x7f5f78009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:30.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.636+0000 7f5f7fe00640 1 -- 172.21.15.144:0/3636029235 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5f700b0070 con 0x7f5f880b63b0 2024-09-11T23:24:30.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.812+0000 7f5f8d000640 1 -- 172.21.15.144:0/3636029235 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5f88148060 con 0x7f5f880b63b0 2024-09-11T23:24:30.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.813+0000 7f5f7fe00640 1 -- 172.21.15.144:0/3636029235 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v122) ==== 93+0+10 (secure 0 0 0) 0x7f5f7007a260 con 0x7f5f880b63b0 2024-09-11T23:24:30.813 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-11T23:24:30.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.815+0000 7f5f8d000640 1 -- 172.21.15.144:0/3636029235 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5f6406c3d0 msgr2=0x7f5f6406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.815+0000 7f5f8d000640 1 --2- 172.21.15.144:0/3636029235 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5f6406c3d0 0x7f5f6406e890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5f78005880 tx=0x7f5f78009040 comp rx=0 tx=0).stop 2024-09-11T23:24:30.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.815+0000 7f5f8d000640 1 -- 172.21.15.144:0/3636029235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f880b63b0 msgr2=0x7f5f880cf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.815+0000 7f5f8d000640 1 --2- 172.21.15.144:0/3636029235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f880b63b0 0x7f5f880cf7c0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f5f7002a1c0 tx=0x7f5f700046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.815+0000 7f5f8d000640 1 -- 172.21.15.144:0/3636029235 shutdown_connections 2024-09-11T23:24:30.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.815+0000 7f5f8d000640 1 --2- 172.21.15.144:0/3636029235 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5f6406c3d0 0x7f5f6406e890 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.815+0000 7f5f8d000640 1 --2- 172.21.15.144:0/3636029235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f88147820 0x7f5f8815fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.815+0000 7f5f8d000640 1 --2- 172.21.15.144:0/3636029235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f880b63b0 0x7f5f880cf7c0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.815+0000 7f5f8d000640 1 --2- 172.21.15.144:0/3636029235 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5f88073cf0 0x7f5f88146230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.815+0000 7f5f8d000640 1 -- 172.21.15.144:0/3636029235 >> 172.21.15.144:0/3636029235 conn(0x7f5f8806ccb0 msgr2=0x7f5f88140660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.815+0000 7f5f8d000640 1 -- 172.21.15.144:0/3636029235 shutdown_connections 2024-09-11T23:24:30.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.815+0000 7f5f8d000640 1 -- 172.21.15.144:0/3636029235 wait complete. 2024-09-11T23:24:30.830 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol' 2024-09-11T23:24:30.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.989+0000 7fa3b3200640 1 Processor -- start 2024-09-11T23:24:30.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.989+0000 7fa3b3200640 1 -- start start 2024-09-11T23:24:30.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.990+0000 7fa3b3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b40b4510 0x7fa3b40b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:30.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.990+0000 7fa3b3200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b40b31d0 con 0x7fa3b415b150 2024-09-11T23:24:30.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.990+0000 7fa3b3200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b415c0a0 con 0x7fa3b40b3ea0 2024-09-11T23:24:30.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.990+0000 7fa3b3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b415c380 con 0x7fa3b40b4510 2024-09-11T23:24:30.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.990+0000 7fa3b1e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa3b415b150 0x7fa3b40ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33762/0 (socket says 172.21.15.144:33762) 2024-09-11T23:24:30.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.990+0000 7fa3b1e00640 1 -- 172.21.15.144:0/2979116338 learned_addr learned my addr 172.21.15.144:0/2979116338 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:30.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.991+0000 7fa3b1400640 1 --2- 172.21.15.144:0/2979116338 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b40b4510 0x7fa3b40b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:30.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.991+0000 7fa3b0a00640 1 -- 172.21.15.144:0/2979116338 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4557724 0 0) 0x7fa3b40b31d0 con 0x7fa3b415b150 2024-09-11T23:24:30.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.991+0000 7fa3b0a00640 1 -- 172.21.15.144:0/2979116338 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa398005730 con 0x7fa3b415b150 2024-09-11T23:24:30.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.991+0000 7fa3b0a00640 1 -- 172.21.15.144:0/2979116338 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2377283098 0 0) 0x7fa3b415c0a0 con 0x7fa3b40b3ea0 2024-09-11T23:24:30.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.991+0000 7fa3b0a00640 1 -- 172.21.15.144:0/2979116338 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3b40b31d0 con 0x7fa3b40b3ea0 2024-09-11T23:24:30.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.991+0000 7fa3b0a00640 1 -- 172.21.15.144:0/2979116338 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2433050678 0 0) 0x7fa398005730 con 0x7fa3b415b150 2024-09-11T23:24:30.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.991+0000 7fa3b0a00640 1 -- 172.21.15.144:0/2979116338 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b40b4510 msgr2=0x7fa3b40b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:30.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.991+0000 7fa3b0a00640 1 --2- 172.21.15.144:0/2979116338 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b40b4510 0x7fa3b40b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.991+0000 7fa3b0a00640 1 -- 172.21.15.144:0/2979116338 >> v1:172.21.15.165:6789/0 conn(0x7fa3b40b3ea0 legacy=0x7fa3b415b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.991+0000 7fa3b0a00640 1 -- 172.21.15.144:0/2979116338 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b40b3440 con 0x7fa3b415b150 2024-09-11T23:24:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.991+0000 7fa3b0a00640 1 -- 172.21.15.144:0/2979116338 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fa3a4001670 con 0x7fa3b415b150 2024-09-11T23:24:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.991+0000 7fa3b0a00640 1 -- 172.21.15.144:0/2979116338 >> v1:172.21.15.144:6789/0 conn(0x7fa3b415b150 legacy=0x7fa3b40ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.991+0000 7fa3b0a00640 1 --2- 172.21.15.144:0/2979116338 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b40b4510 0x7fa398005d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.991+0000 7fa3b0a00640 1 --2- 172.21.15.144:0/2979116338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa398006330 0x7fa398006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.991+0000 7fa3b0a00640 1 --2- 172.21.15.144:0/2979116338 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa398006f50 0x7fa3980073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.991+0000 7fa3b0a00640 1 -- 172.21.15.144:0/2979116338 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b415c380 con 0x7fa398006330 2024-09-11T23:24:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.991+0000 7fa3b0a00640 1 -- 172.21.15.144:0/2979116338 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa39800dd10 con 0x7fa398006f50 2024-09-11T23:24:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.991+0000 7fa3b0a00640 1 -- 172.21.15.144:0/2979116338 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa39800df10 con 0x7fa3b40b4510 2024-09-11T23:24:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.992+0000 7fa3b1400640 1 --2- 172.21.15.144:0/2979116338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa398006330 0x7fa398006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:30.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.992+0000 7fa3b1e00640 1 --2- 172.21.15.144:0/2979116338 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b40b4510 0x7fa398005d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.992+0000 7fa3b2800640 1 --2- 172.21.15.144:0/2979116338 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa398006f50 0x7fa3980073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.992+0000 7fa3b1400640 1 -- 172.21.15.144:0/2979116338 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b40b4510 msgr2=0x7fa398005d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.992+0000 7fa3b1400640 1 --2- 172.21.15.144:0/2979116338 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b40b4510 0x7fa398005d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.992+0000 7fa3b1400640 1 -- 172.21.15.144:0/2979116338 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa398006f50 msgr2=0x7fa3980073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.992+0000 7fa3b1400640 1 --2- 172.21.15.144:0/2979116338 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa398006f50 0x7fa3980073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.992+0000 7fa3b1400640 1 -- 172.21.15.144:0/2979116338 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa398005730 con 0x7fa398006330 2024-09-11T23:24:30.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.993+0000 7fa3b1400640 1 --2- 172.21.15.144:0/2979116338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa398006330 0x7fa398006a10 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009fc0 tx=0x7fa398007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a44cefe15d002fc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:30.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.993+0000 7fa3b0a00640 1 -- 172.21.15.144:0/2979116338 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c037070 con 0x7fa398006330 2024-09-11T23:24:30.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.993+0000 7fa3b0a00640 1 -- 172.21.15.144:0/2979116338 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa39c0325f0 con 0x7fa398006330 2024-09-11T23:24:30.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.993+0000 7fa3b0a00640 1 -- 172.21.15.144:0/2979116338 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c009c10 con 0x7fa398006330 2024-09-11T23:24:30.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.994+0000 7fa3b3200640 1 -- 172.21.15.144:0/2979116338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa398006330 msgr2=0x7fa398006a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.994+0000 7fa3b3200640 1 --2- 172.21.15.144:0/2979116338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa398006330 0x7fa398006a10 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009fc0 tx=0x7fa398007a40 comp rx=0 tx=0).stop 2024-09-11T23:24:30.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.994+0000 7fa3b2800640 1 -- 172.21.15.144:0/2979116338 reap_dead start 2024-09-11T23:24:30.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.994+0000 7fa3b3200640 1 -- 172.21.15.144:0/2979116338 shutdown_connections 2024-09-11T23:24:30.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.994+0000 7fa3b3200640 1 -- 172.21.15.144:0/2979116338 >> 172.21.15.144:0/2979116338 conn(0x7fa3b406e910 msgr2=0x7fa3b406bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:30.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.994+0000 7fa3b3200640 1 -- 172.21.15.144:0/2979116338 shutdown_connections 2024-09-11T23:24:30.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.994+0000 7fa3b3200640 1 -- 172.21.15.144:0/2979116338 wait complete. 2024-09-11T23:24:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.996+0000 7fa3b3200640 1 Processor -- start 2024-09-11T23:24:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.996+0000 7fa3b3200640 1 -- start start 2024-09-11T23:24:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.997+0000 7fa3b3200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa398006330 0x7fa3b41514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.997+0000 7fa3b3200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3b414ede0 0x7fa3b4152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.997+0000 7fa3b3200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b414fec0 0x7fa3b4073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.997+0000 7fa3b3200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b40cd200 con 0x7fa398006330 2024-09-11T23:24:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.997+0000 7fa3b3200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b415bc40 con 0x7fa3b414ede0 2024-09-11T23:24:30.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.997+0000 7fa3b3200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b4154a20 con 0x7fa3b414fec0 2024-09-11T23:24:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.997+0000 7fa3b1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa398006330 0x7fa3b41514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.997+0000 7fa3b1e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa398006330 0x7fa3b41514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46492/0 (socket says 172.21.15.144:46492) 2024-09-11T23:24:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.997+0000 7fa3b1e00640 1 -- 172.21.15.144:0/4026369258 learned_addr learned my addr 172.21.15.144:0/4026369258 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.997+0000 7fa3b1400640 1 --2- 172.21.15.144:0/4026369258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3b414ede0 0x7fa3b4152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.997+0000 7fa3b2800640 1 --2- 172.21.15.144:0/4026369258 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b414fec0 0x7fa3b4073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.997+0000 7fa3b1e00640 1 -- 172.21.15.144:0/4026369258 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b414fec0 msgr2=0x7fa3b4073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.997+0000 7fa3b1e00640 1 --2- 172.21.15.144:0/4026369258 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b414fec0 0x7fa3b4073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.997+0000 7fa3b1e00640 1 -- 172.21.15.144:0/4026369258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3b414ede0 msgr2=0x7fa3b4152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.997+0000 7fa3b1e00640 1 --2- 172.21.15.144:0/4026369258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3b414ede0 0x7fa3b4152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.997+0000 7fa3b1e00640 1 -- 172.21.15.144:0/4026369258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b4153260 con 0x7fa398006330 2024-09-11T23:24:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.997+0000 7fa3b1400640 1 --2- 172.21.15.144:0/4026369258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3b414ede0 0x7fa3b4152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.998+0000 7fa3b1e00640 1 --2- 172.21.15.144:0/4026369258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa398006330 0x7fa3b41514a0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4004ea0 tx=0x7fa3a4004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:30.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.998+0000 7fa3aa000640 1 -- 172.21.15.144:0/4026369258 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a400f680 con 0x7fa398006330 2024-09-11T23:24:31.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.998+0000 7fa3aa000640 1 -- 172.21.15.144:0/4026369258 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a4018070 con 0x7fa398006330 2024-09-11T23:24:31.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.998+0000 7fa3aa000640 1 -- 172.21.15.144:0/4026369258 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a400fa80 con 0x7fa398006330 2024-09-11T23:24:31.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.998+0000 7fa3b3200640 1 -- 172.21.15.144:0/4026369258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b41506d0 con 0x7fa398006330 2024-09-11T23:24:31.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.998+0000 7fa3b3200640 1 -- 172.21.15.144:0/4026369258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b4154f50 con 0x7fa398006330 2024-09-11T23:24:31.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:30.999+0000 7fa3b3200640 1 -- 172.21.15.144:0/4026369258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b40b3960 con 0x7fa398006330 2024-09-11T23:24:31.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:31.000+0000 7fa3aa000640 1 -- 172.21.15.144:0/4026369258 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7fa3a400fc20 con 0x7fa398006330 2024-09-11T23:24:31.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:31.001+0000 7fa3aa000640 1 --2- 172.21.15.144:0/4026369258 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa39006c400 0x7fa39006e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:31.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:31.001+0000 7fa3aa000640 1 -- 172.21.15.144:0/4026369258 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 4971+0+0 (secure 0 0 0) 0x7fa3a408b530 con 0x7fa398006330 2024-09-11T23:24:31.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:31.001+0000 7fa3b1400640 1 --2- 172.21.15.144:0/4026369258 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa39006c400 0x7fa39006e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:31.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:31.002+0000 7fa3b1400640 1 --2- 172.21.15.144:0/4026369258 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa39006c400 0x7fa39006e8c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa39c034000 tx=0x7fa39c02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:31.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:31.005+0000 7fa3aa000640 1 -- 172.21.15.144:0/4026369258 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa3a4059910 con 0x7fa398006330 2024-09-11T23:24:31.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:31.245+0000 7fa3b3200640 1 -- 172.21.15.144:0/4026369258 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]} v 0) -- 0x7fa3b415d360 con 0x7fa398006330 2024-09-11T23:24:32.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.082+0000 7fa3aa000640 1 -- 172.21.15.144:0/4026369258 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]}]=0 v362) ==== 154+0+0 (secure 0 0 0) 0x7fa3a4059210 con 0x7fa398006330 2024-09-11T23:24:32.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.084+0000 7fa3b3200640 1 -- 172.21.15.144:0/4026369258 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa39006c400 msgr2=0x7fa39006e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:32.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.084+0000 7fa3b3200640 1 --2- 172.21.15.144:0/4026369258 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa39006c400 0x7fa39006e8c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa39c034000 tx=0x7fa39c02f000 comp rx=0 tx=0).stop 2024-09-11T23:24:32.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.084+0000 7fa3b3200640 1 -- 172.21.15.144:0/4026369258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa398006330 msgr2=0x7fa3b41514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:32.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.084+0000 7fa3b3200640 1 --2- 172.21.15.144:0/4026369258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa398006330 0x7fa3b41514a0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4004ea0 tx=0x7fa3a4004f90 comp rx=0 tx=0).stop 2024-09-11T23:24:32.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.084+0000 7fa3b3200640 1 -- 172.21.15.144:0/4026369258 shutdown_connections 2024-09-11T23:24:32.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.084+0000 7fa3b3200640 1 --2- 172.21.15.144:0/4026369258 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa39006c400 0x7fa39006e8c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:32.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.084+0000 7fa3b3200640 1 --2- 172.21.15.144:0/4026369258 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa3b414fec0 0x7fa3b4073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:32.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.084+0000 7fa3b3200640 1 --2- 172.21.15.144:0/4026369258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3b414ede0 0x7fa3b4152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:32.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.084+0000 7fa3b3200640 1 --2- 172.21.15.144:0/4026369258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa398006330 0x7fa3b41514a0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:32.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.084+0000 7fa3b3200640 1 -- 172.21.15.144:0/4026369258 >> 172.21.15.144:0/4026369258 conn(0x7fa3b406e910 msgr2=0x7fa3b415b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:32.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.084+0000 7fa3b3200640 1 -- 172.21.15.144:0/4026369258 shutdown_connections 2024-09-11T23:24:32.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.084+0000 7fa3b3200640 1 -- 172.21.15.144:0/4026369258 wait complete. 2024-09-11T23:24:32.101 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:24:32.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.259+0000 7f5de6800640 1 Processor -- start 2024-09-11T23:24:32.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.259+0000 7f5de6800640 1 -- start start 2024-09-11T23:24:32.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.260+0000 7f5de6800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5de00cf510 0x7f5de00b7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:32.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.260+0000 7f5de6800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5de00b7bb0 0x7f5de006d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:32.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.260+0000 7f5de6800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5de015eaa0 con 0x7f5de015e6c0 2024-09-11T23:24:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.260+0000 7f5de6800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5de00d34d0 con 0x7f5de00b7bb0 2024-09-11T23:24:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.260+0000 7f5de6800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5de00d28c0 con 0x7f5de00cf510 2024-09-11T23:24:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.260+0000 7f5de5e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5de00b7bb0 0x7f5de006d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.260+0000 7f5de5e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5de00b7bb0 0x7f5de006d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46506/0 (socket says 172.21.15.144:46506) 2024-09-11T23:24:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.260+0000 7f5de5e00640 1 -- 172.21.15.144:0/4270566989 learned_addr learned my addr 172.21.15.144:0/4270566989 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.261+0000 7f5de4a00640 1 --2- 172.21.15.144:0/4270566989 >> v2:172.21.15.165:3300/0 conn(0x7f5de00cf510 0x7f5de00b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.261+0000 7f5de5e00640 1 -- 172.21.15.144:0/4270566989 >> v2:172.21.15.165:3300/0 conn(0x7f5de00cf510 msgr2=0x7f5de00b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.261+0000 7f5de5e00640 1 --2- 172.21.15.144:0/4270566989 >> v2:172.21.15.165:3300/0 conn(0x7f5de00cf510 0x7f5de00b7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.261+0000 7f5de5e00640 1 -- 172.21.15.144:0/4270566989 >> v1:172.21.15.165:6789/0 conn(0x7f5de015e6c0 legacy=0x7f5de006c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:32.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.261+0000 7f5de5e00640 1 -- 172.21.15.144:0/4270566989 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de00d2ba0 con 0x7f5de00b7bb0 2024-09-11T23:24:32.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.262+0000 7f5de5e00640 1 --2- 172.21.15.144:0/4270566989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5de00b7bb0 0x7f5de006d610 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f5de0163240 tx=0x7f5dd802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cebc39ec142b158 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.262+0000 7f5ddfe00640 1 -- 172.21.15.144:0/4270566989 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8036070 con 0x7f5de00b7bb0 2024-09-11T23:24:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.262+0000 7f5ddfe00640 1 -- 172.21.15.144:0/4270566989 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd8031600 con 0x7f5de00b7bb0 2024-09-11T23:24:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.262+0000 7f5ddfe00640 1 -- 172.21.15.144:0/4270566989 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd80319d0 con 0x7f5de00b7bb0 2024-09-11T23:24:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.263+0000 7f5de6800640 1 -- 172.21.15.144:0/4270566989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5de00b7bb0 msgr2=0x7f5de006d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.263+0000 7f5de6800640 1 --2- 172.21.15.144:0/4270566989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5de00b7bb0 0x7f5de006d610 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f5de0163240 tx=0x7f5dd802a730 comp rx=0 tx=0).stop 2024-09-11T23:24:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.263+0000 7f5de6800640 1 -- 172.21.15.144:0/4270566989 shutdown_connections 2024-09-11T23:24:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.263+0000 7f5de6800640 1 --2- 172.21.15.144:0/4270566989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5de00b7bb0 0x7f5de006d610 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.263+0000 7f5de6800640 1 --2- 172.21.15.144:0/4270566989 >> v2:172.21.15.165:3300/0 conn(0x7f5de00cf510 0x7f5de00b7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.263+0000 7f5de6800640 1 -- 172.21.15.144:0/4270566989 >> 172.21.15.144:0/4270566989 conn(0x7f5de00d4720 msgr2=0x7f5de00d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.263+0000 7f5de6800640 1 -- 172.21.15.144:0/4270566989 shutdown_connections 2024-09-11T23:24:32.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.263+0000 7f5de6800640 1 -- 172.21.15.144:0/4270566989 wait complete. 2024-09-11T23:24:32.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.264+0000 7f5de6800640 1 Processor -- start 2024-09-11T23:24:32.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.264+0000 7f5de6800640 1 -- start start 2024-09-11T23:24:32.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.265+0000 7f5de6800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5de00b7bb0 0x7f5de0159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:32.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.265+0000 7f5de6800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5de00cf510 0x7f5de0158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:32.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.265+0000 7f5de6800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5de015e6c0 0x7f5de01f8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:32.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.265+0000 7f5de6800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5de006db50 con 0x7f5de00cf510 2024-09-11T23:24:32.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.265+0000 7f5de6800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5de00d3160 con 0x7f5de00b7bb0 2024-09-11T23:24:32.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.265+0000 7f5de6800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5de006dcd0 con 0x7f5de015e6c0 2024-09-11T23:24:32.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.266+0000 7f5de4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5de00cf510 0x7f5de0158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:32.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.266+0000 7f5de4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5de00cf510 0x7f5de0158450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46518/0 (socket says 172.21.15.144:46518) 2024-09-11T23:24:32.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.266+0000 7f5de4a00640 1 -- 172.21.15.144:0/2935952417 learned_addr learned my addr 172.21.15.144:0/2935952417 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:32.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.266+0000 7f5de5400640 1 --2- 172.21.15.144:0/2935952417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5de00b7bb0 0x7f5de0159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:32.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.266+0000 7f5de5e00640 1 --2- 172.21.15.144:0/2935952417 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5de015e6c0 0x7f5de01f8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:32.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.266+0000 7f5de4a00640 1 -- 172.21.15.144:0/2935952417 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5de015e6c0 msgr2=0x7f5de01f8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:32.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.266+0000 7f5de4a00640 1 --2- 172.21.15.144:0/2935952417 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5de015e6c0 0x7f5de01f8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:32.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.266+0000 7f5de4a00640 1 -- 172.21.15.144:0/2935952417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5de00b7bb0 msgr2=0x7f5de0159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:32.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.266+0000 7f5de4a00640 1 --2- 172.21.15.144:0/2935952417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5de00b7bb0 0x7f5de0159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:32.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.266+0000 7f5de4a00640 1 -- 172.21.15.144:0/2935952417 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de01593f0 con 0x7f5de00cf510 2024-09-11T23:24:32.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.266+0000 7f5de4a00640 1 --2- 172.21.15.144:0/2935952417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5de00cf510 0x7f5de0158450 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00d830 tx=0x7f5dcc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.267+0000 7f5ddd600640 1 -- 172.21.15.144:0/2935952417 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00b6c0 con 0x7f5de00cf510 2024-09-11T23:24:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.267+0000 7f5ddd600640 1 -- 172.21.15.144:0/2935952417 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dcc019070 con 0x7f5de00cf510 2024-09-11T23:24:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.267+0000 7f5ddd600640 1 -- 172.21.15.144:0/2935952417 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00ba80 con 0x7f5de00cf510 2024-09-11T23:24:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.267+0000 7f5de6800640 1 -- 172.21.15.144:0/2935952417 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de0158b50 con 0x7f5de00cf510 2024-09-11T23:24:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.267+0000 7f5de6800640 1 -- 172.21.15.144:0/2935952417 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de0159110 con 0x7f5de00cf510 2024-09-11T23:24:32.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.268+0000 7f5de6800640 1 -- 172.21.15.144:0/2935952417 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de006d610 con 0x7f5de00cf510 2024-09-11T23:24:32.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.269+0000 7f5ddd600640 1 -- 172.21.15.144:0/2935952417 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f5dcc00bc20 con 0x7f5de00cf510 2024-09-11T23:24:32.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.270+0000 7f5ddd600640 1 --2- 172.21.15.144:0/2935952417 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5dc006c3d0 0x7f5dc006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:32.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.270+0000 7f5ddd600640 1 -- 172.21.15.144:0/2935952417 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 4971+0+0 (secure 0 0 0) 0x7f5dcc08bb70 con 0x7f5de00cf510 2024-09-11T23:24:32.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.270+0000 7f5de5400640 1 --2- 172.21.15.144:0/2935952417 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5dc006c3d0 0x7f5dc006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:32.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.271+0000 7f5de5400640 1 --2- 172.21.15.144:0/2935952417 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5dc006c3d0 0x7f5dc006e890 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40016e0 tx=0x7f5dd4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:32.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.274+0000 7f5ddd600640 1 -- 172.21.15.144:0/2935952417 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5dcc0596f0 con 0x7f5de00cf510 2024-09-11T23:24:32.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.450+0000 7f5de6800640 1 -- 172.21.15.144:0/2935952417 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5de00d2600 con 0x7f5de00cf510 2024-09-11T23:24:32.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.453+0000 7f5ddd600640 1 -- 172.21.15.144:0/2935952417 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f5dcc05d9f0 con 0x7f5de00cf510 2024-09-11T23:24:32.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.455+0000 7f5de6800640 1 -- 172.21.15.144:0/2935952417 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5dc006c3d0 msgr2=0x7f5dc006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:32.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.456+0000 7f5de6800640 1 --2- 172.21.15.144:0/2935952417 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5dc006c3d0 0x7f5dc006e890 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40016e0 tx=0x7f5dd4009040 comp rx=0 tx=0).stop 2024-09-11T23:24:32.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.456+0000 7f5de6800640 1 -- 172.21.15.144:0/2935952417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5de00cf510 msgr2=0x7f5de0158450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:32.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.456+0000 7f5de6800640 1 --2- 172.21.15.144:0/2935952417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5de00cf510 0x7f5de0158450 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00d830 tx=0x7f5dcc00dcf0 comp rx=0 tx=0).stop 2024-09-11T23:24:32.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.456+0000 7f5de6800640 1 -- 172.21.15.144:0/2935952417 shutdown_connections 2024-09-11T23:24:32.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.456+0000 7f5de6800640 1 --2- 172.21.15.144:0/2935952417 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5dc006c3d0 0x7f5dc006e890 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:32.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.456+0000 7f5de6800640 1 --2- 172.21.15.144:0/2935952417 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5de015e6c0 0x7f5de01f8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:32.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.456+0000 7f5de6800640 1 --2- 172.21.15.144:0/2935952417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5de00cf510 0x7f5de0158450 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:32.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.456+0000 7f5de6800640 1 --2- 172.21.15.144:0/2935952417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5de00b7bb0 0x7f5de0159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:32.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.456+0000 7f5de6800640 1 -- 172.21.15.144:0/2935952417 >> 172.21.15.144:0/2935952417 conn(0x7f5de00d4720 msgr2=0x7f5de015d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:32.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.456+0000 7f5de6800640 1 -- 172.21.15.144:0/2935952417 shutdown_connections 2024-09-11T23:24:32.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.456+0000 7f5de6800640 1 -- 172.21.15.144:0/2935952417 wait complete. 2024-09-11T23:24:32.471 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:24:32.472 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:24:32.552 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:24:32.642 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:24:32.643 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:24:32.643 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:24:32.678 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:24:32.679 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:24:32.679 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:24:32.716 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:24:32.716 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:24:32.716 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:24:32.754 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:24:32.754 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:24:32.754 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:24:32.792 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:24:32.792 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T23:24:32.793 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:24:32.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.948+0000 7efe22000640 1 Processor -- start 2024-09-11T23:24:32.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.948+0000 7efe22000640 1 -- start start 2024-09-11T23:24:32.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.949+0000 7efe22000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efe1c15a0a0 0x7efe1c073180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:32.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.949+0000 7efe22000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7efe1c0736c0 0x7efe1c0ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:32.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.949+0000 7efe22000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe1c072100 con 0x7efe1c0ce9c0 2024-09-11T23:24:32.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.949+0000 7efe22000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7efe1c0cee30 con 0x7efe1c15a0a0 2024-09-11T23:24:32.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.949+0000 7efe22000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7efe1c0723c0 con 0x7efe1c0736c0 2024-09-11T23:24:32.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.949+0000 7efe20c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efe1c15a0a0 0x7efe1c073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:32.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.949+0000 7efe21600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7efe1c0ce9c0 0x7efe1c0b1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33768/0 (socket says 172.21.15.144:33768) 2024-09-11T23:24:32.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.949+0000 7efe20c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efe1c15a0a0 0x7efe1c073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46522/0 (socket says 172.21.15.144:46522) 2024-09-11T23:24:32.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.949+0000 7efe21600640 1 -- 172.21.15.144:0/1368192372 learned_addr learned my addr 172.21.15.144:0/1368192372 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:32.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.949+0000 7efe13e00640 1 --2- 172.21.15.144:0/1368192372 >> v2:172.21.15.165:3300/0 conn(0x7efe1c0736c0 0x7efe1c0ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:32.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.950+0000 7efe20c00640 1 -- 172.21.15.144:0/1368192372 >> v2:172.21.15.165:3300/0 conn(0x7efe1c0736c0 msgr2=0x7efe1c0ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:32.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.950+0000 7efe20c00640 1 --2- 172.21.15.144:0/1368192372 >> v2:172.21.15.165:3300/0 conn(0x7efe1c0736c0 0x7efe1c0ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:32.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.950+0000 7efe20c00640 1 -- 172.21.15.144:0/1368192372 >> v1:172.21.15.144:6789/0 conn(0x7efe1c0ce9c0 legacy=0x7efe1c0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:32.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.950+0000 7efe20c00640 1 -- 172.21.15.144:0/1368192372 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1c0726a0 con 0x7efe1c15a0a0 2024-09-11T23:24:32.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.950+0000 7efe1be00640 1 -- 172.21.15.144:0/1368192372 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3767139583 0 0) 0x7efe1c072100 con 0x7efe1c0ce9c0 2024-09-11T23:24:32.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.951+0000 7efe20c00640 1 --2- 172.21.15.144:0/1368192372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe1c15a0a0 0x7efe1c073180 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7efe1c0ccab0 tx=0x7efe0c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5a8b28bb62a60d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:32.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.951+0000 7efe1be00640 1 -- 172.21.15.144:0/1368192372 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c037070 con 0x7efe1c15a0a0 2024-09-11T23:24:32.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.951+0000 7efe1be00640 1 -- 172.21.15.144:0/1368192372 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe0c032440 con 0x7efe1c15a0a0 2024-09-11T23:24:32.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.951+0000 7efe1be00640 1 -- 172.21.15.144:0/1368192372 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c032810 con 0x7efe1c15a0a0 2024-09-11T23:24:32.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.951+0000 7efe22000640 1 -- 172.21.15.144:0/1368192372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe1c15a0a0 msgr2=0x7efe1c073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:32.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.951+0000 7efe22000640 1 --2- 172.21.15.144:0/1368192372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe1c15a0a0 0x7efe1c073180 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7efe1c0ccab0 tx=0x7efe0c02a1a0 comp rx=0 tx=0).stop 2024-09-11T23:24:32.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.952+0000 7efe22000640 1 -- 172.21.15.144:0/1368192372 shutdown_connections 2024-09-11T23:24:32.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.952+0000 7efe22000640 1 --2- 172.21.15.144:0/1368192372 >> v2:172.21.15.165:3300/0 conn(0x7efe1c0736c0 0x7efe1c0ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:32.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.952+0000 7efe22000640 1 --2- 172.21.15.144:0/1368192372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe1c15a0a0 0x7efe1c073180 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:32.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.952+0000 7efe22000640 1 -- 172.21.15.144:0/1368192372 >> 172.21.15.144:0/1368192372 conn(0x7efe1c06e910 msgr2=0x7efe1c06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:32.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.952+0000 7efe22000640 1 -- 172.21.15.144:0/1368192372 shutdown_connections 2024-09-11T23:24:32.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.952+0000 7efe22000640 1 -- 172.21.15.144:0/1368192372 wait complete. 2024-09-11T23:24:32.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.953+0000 7efe22000640 1 Processor -- start 2024-09-11T23:24:32.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.953+0000 7efe22000640 1 -- start start 2024-09-11T23:24:32.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.954+0000 7efe22000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe1c0ce9c0 0x7efe1c0af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:32.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.954+0000 7efe22000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe1c15a0a0 0x7efe1c1e7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:32.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.954+0000 7efe22000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe1c0abd70 0x7efe1c0ac220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:32.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.954+0000 7efe22000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c0b2650 con 0x7efe1c0abd70 2024-09-11T23:24:32.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.954+0000 7efe22000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c0b24d0 con 0x7efe1c15a0a0 2024-09-11T23:24:32.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.954+0000 7efe22000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efe1c0cf240 con 0x7efe1c0ce9c0 2024-09-11T23:24:32.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.954+0000 7efe21600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe1c0abd70 0x7efe1c0ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:32.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.955+0000 7efe21600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe1c0abd70 0x7efe1c0ac220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46528/0 (socket says 172.21.15.144:46528) 2024-09-11T23:24:32.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.955+0000 7efe21600640 1 -- 172.21.15.144:0/1580047442 learned_addr learned my addr 172.21.15.144:0/1580047442 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:32.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.955+0000 7efe13e00640 1 --2- 172.21.15.144:0/1580047442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe1c15a0a0 0x7efe1c1e7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:32.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.955+0000 7efe20c00640 1 --2- 172.21.15.144:0/1580047442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe1c0ce9c0 0x7efe1c0af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:32.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.955+0000 7efe21600640 1 -- 172.21.15.144:0/1580047442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe1c0ce9c0 msgr2=0x7efe1c0af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:32.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.955+0000 7efe21600640 1 --2- 172.21.15.144:0/1580047442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe1c0ce9c0 0x7efe1c0af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:32.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.955+0000 7efe21600640 1 -- 172.21.15.144:0/1580047442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe1c15a0a0 msgr2=0x7efe1c1e7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:32.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.955+0000 7efe21600640 1 --2- 172.21.15.144:0/1580047442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe1c15a0a0 0x7efe1c1e7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:32.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.955+0000 7efe21600640 1 -- 172.21.15.144:0/1580047442 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1c0ade50 con 0x7efe1c0abd70 2024-09-11T23:24:32.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.955+0000 7efe21600640 1 --2- 172.21.15.144:0/1580047442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe1c0abd70 0x7efe1c0ac220 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7efe1400c7a0 tx=0x7efe1400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:32.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.955+0000 7efe19600640 1 -- 172.21.15.144:0/1580047442 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe14018070 con 0x7efe1c0abd70 2024-09-11T23:24:32.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.955+0000 7efe19600640 1 -- 172.21.15.144:0/1580047442 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe1400a640 con 0x7efe1c0abd70 2024-09-11T23:24:32.956 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.955+0000 7efe19600640 1 -- 172.21.15.144:0/1580047442 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe1400aa70 con 0x7efe1c0abd70 2024-09-11T23:24:32.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.955+0000 7efe22000640 1 -- 172.21.15.144:0/1580047442 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe1c0ae110 con 0x7efe1c0abd70 2024-09-11T23:24:32.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.956+0000 7efe22000640 1 -- 172.21.15.144:0/1580047442 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe1c0ae6d0 con 0x7efe1c0abd70 2024-09-11T23:24:32.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.957+0000 7efe22000640 1 -- 172.21.15.144:0/1580047442 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe1c0ce480 con 0x7efe1c0abd70 2024-09-11T23:24:32.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.957+0000 7efe19600640 1 -- 172.21.15.144:0/1580047442 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7efe1400ac10 con 0x7efe1c0abd70 2024-09-11T23:24:32.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.958+0000 7efe19600640 1 --2- 172.21.15.144:0/1580047442 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efdf806c3d0 0x7efdf806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:32.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.958+0000 7efe19600640 1 -- 172.21.15.144:0/1580047442 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 4971+0+0 (secure 0 0 0) 0x7efe1408ab60 con 0x7efe1c0abd70 2024-09-11T23:24:32.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.959+0000 7efe20c00640 1 --2- 172.21.15.144:0/1580047442 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efdf806c3d0 0x7efdf806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:32.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.960+0000 7efe20c00640 1 --2- 172.21.15.144:0/1580047442 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efdf806c3d0 0x7efdf806e890 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efe0c034000 tx=0x7efe0c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:32.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:32.962+0000 7efe19600640 1 -- 172.21.15.144:0/1580047442 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efe140588f0 con 0x7efe1c0abd70 2024-09-11T23:24:33.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.172+0000 7efe22000640 1 -- 172.21.15.144:0/1580047442 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe1c15b810 con 0x7efe1c0abd70 2024-09-11T23:24:33.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.173+0000 7efe19600640 1 -- 172.21.15.144:0/1580047442 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+3923 (secure 0 0 0) 0x7efe1405cbf0 con 0x7efe1c0abd70 2024-09-11T23:24:33.173 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:33.173 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":84,"btime":"2024-09-11T23:24:26:737992+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6997,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1218671521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1218671521},{"type":"v1","addr":"172.21.15.165:6835","nonce":1218671521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":7000,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/4243031268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":4243031268},{"type":"v1","addr":"172.21.15.165:6834","nonce":4243031268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/1613796839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1613796839},{"type":"v1","addr":"172.21.15.144:6801","nonce":1613796839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7671,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3715975342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3715975342},{"type":"v1","addr":"172.21.15.144:6835","nonce":3715975342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[]} 2024-09-11T23:24:33.173 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 84 2024-09-11T23:24:33.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.175+0000 7efe22000640 1 -- 172.21.15.144:0/1580047442 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efdf806c3d0 msgr2=0x7efdf806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:33.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.175+0000 7efe22000640 1 --2- 172.21.15.144:0/1580047442 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efdf806c3d0 0x7efdf806e890 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efe0c034000 tx=0x7efe0c02e000 comp rx=0 tx=0).stop 2024-09-11T23:24:33.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.175+0000 7efe22000640 1 -- 172.21.15.144:0/1580047442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe1c0abd70 msgr2=0x7efe1c0ac220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:33.175 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.175+0000 7efe22000640 1 --2- 172.21.15.144:0/1580047442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe1c0abd70 0x7efe1c0ac220 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7efe1400c7a0 tx=0x7efe1400cc60 comp rx=0 tx=0).stop 2024-09-11T23:24:33.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.175+0000 7efe22000640 1 -- 172.21.15.144:0/1580047442 shutdown_connections 2024-09-11T23:24:33.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.175+0000 7efe22000640 1 --2- 172.21.15.144:0/1580047442 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efdf806c3d0 0x7efdf806e890 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:33.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.175+0000 7efe22000640 1 --2- 172.21.15.144:0/1580047442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe1c0abd70 0x7efe1c0ac220 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:33.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.175+0000 7efe22000640 1 --2- 172.21.15.144:0/1580047442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe1c15a0a0 0x7efe1c1e7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:33.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.175+0000 7efe22000640 1 --2- 172.21.15.144:0/1580047442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe1c0ce9c0 0x7efe1c0af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:33.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.175+0000 7efe22000640 1 -- 172.21.15.144:0/1580047442 >> 172.21.15.144:0/1580047442 conn(0x7efe1c06e910 msgr2=0x7efe1c0b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:33.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.175+0000 7efe22000640 1 -- 172.21.15.144:0/1580047442 shutdown_connections 2024-09-11T23:24:33.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.175+0000 7efe22000640 1 -- 172.21.15.144:0/1580047442 wait complete. 2024-09-11T23:24:33.191 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:24:33.191 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:24:33.191 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:24:33.192 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:24:33.192 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:24:33.192 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T23:24:33.192 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:24:33.192 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:24:33.192 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:24:33.192 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:24:33.193 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:24:33.193 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:24:33.193 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:24:33.193 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T23:24:33.193 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:24:33.193 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:24:33.209 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:24:33.209 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:24:33.210 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:24:33.210 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:24:33.212 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:24:33.212 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:24:33.212 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:24:33.213 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:24:33.254 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:24:33.254 DEBUG:teuthology.parallel:result is None 2024-09-11T23:24:33.255 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:24:33.256 DEBUG:teuthology.parallel:result is None 2024-09-11T23:24:33.256 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:24:33.256 DEBUG:teuthology.parallel:result is None 2024-09-11T23:24:33.258 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:24:33.258 DEBUG:teuthology.parallel:result is None 2024-09-11T23:24:33.259 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:24:33.388 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-11T23:24:33.388 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-11T23:24:33.389 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-11T23:24:33.389 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-11T23:24:33.411 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-11T23:24:33.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.420+0000 7f0f7de00640 1 Processor -- start 2024-09-11T23:24:33.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.421+0000 7f0f7de00640 1 -- start start 2024-09-11T23:24:33.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.422+0000 7f0f7de00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0f78162930 0x7f0f780cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:33.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.422+0000 7f0f7de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f780af900 0x7f0f7806bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:33.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.422+0000 7f0f7de00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f780afd60 con 0x7f0f7806c0e0 2024-09-11T23:24:33.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.422+0000 7f0f7de00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f0f780b4870 con 0x7f0f78162930 2024-09-11T23:24:33.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.422+0000 7f0f7de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0f780cf3a0 con 0x7f0f780af900 2024-09-11T23:24:33.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.422+0000 7f0f77400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f0f7806c0e0 0x7f0f781664c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33790/0 (socket says 172.21.15.144:33790) 2024-09-11T23:24:33.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.422+0000 7f0f77400640 1 -- 172.21.15.144:0/1438490013 learned_addr learned my addr 172.21.15.144:0/1438490013 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:33.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.422+0000 7f0f76000640 1 --2- 172.21.15.144:0/1438490013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f780af900 0x7f0f7806bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:33.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.422+0000 7f0f76a00640 1 --2- 172.21.15.144:0/1438490013 >> v2:172.21.15.165:3300/0 conn(0x7f0f78162930 0x7f0f780cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:33.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.423+0000 7f0f76000640 1 -- 172.21.15.144:0/1438490013 >> v2:172.21.15.165:3300/0 conn(0x7f0f78162930 msgr2=0x7f0f780cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:33.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.423+0000 7f0f76000640 1 --2- 172.21.15.144:0/1438490013 >> v2:172.21.15.165:3300/0 conn(0x7f0f78162930 0x7f0f780cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:33.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.423+0000 7f0f76000640 1 -- 172.21.15.144:0/1438490013 >> v1:172.21.15.144:6789/0 conn(0x7f0f7806c0e0 legacy=0x7f0f781664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:33.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.423+0000 7f0f75600640 1 -- 172.21.15.144:0/1438490013 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 881924999 0 0) 0x7f0f780afd60 con 0x7f0f7806c0e0 2024-09-11T23:24:33.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.423+0000 7f0f76000640 1 -- 172.21.15.144:0/1438490013 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f780b4010 con 0x7f0f780af900 2024-09-11T23:24:33.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.424+0000 7f0f76000640 1 --2- 172.21.15.144:0/1438490013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f780af900 0x7f0f7806bba0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0f640097a0 tx=0x7f0f6402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a24ac5392c8be123 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:33.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.424+0000 7f0f75600640 1 -- 172.21.15.144:0/1438490013 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64037070 con 0x7f0f780af900 2024-09-11T23:24:33.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.424+0000 7f0f75600640 1 -- 172.21.15.144:0/1438490013 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f64032440 con 0x7f0f780af900 2024-09-11T23:24:33.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.424+0000 7f0f75600640 1 -- 172.21.15.144:0/1438490013 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64032810 con 0x7f0f780af900 2024-09-11T23:24:33.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.424+0000 7f0f7de00640 1 -- 172.21.15.144:0/1438490013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f780af900 msgr2=0x7f0f7806bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:33.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.424+0000 7f0f7de00640 1 --2- 172.21.15.144:0/1438490013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f780af900 0x7f0f7806bba0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0f640097a0 tx=0x7f0f6402a180 comp rx=0 tx=0).stop 2024-09-11T23:24:33.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.425+0000 7f0f7de00640 1 -- 172.21.15.144:0/1438490013 shutdown_connections 2024-09-11T23:24:33.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.425+0000 7f0f7de00640 1 --2- 172.21.15.144:0/1438490013 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f780af900 0x7f0f7806bba0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:33.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.425+0000 7f0f7de00640 1 --2- 172.21.15.144:0/1438490013 >> v2:172.21.15.165:3300/0 conn(0x7f0f78162930 0x7f0f780cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:33.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.425+0000 7f0f7de00640 1 -- 172.21.15.144:0/1438490013 >> 172.21.15.144:0/1438490013 conn(0x7f0f78062cc0 msgr2=0x7f0f7806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:33.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.425+0000 7f0f7de00640 1 -- 172.21.15.144:0/1438490013 shutdown_connections 2024-09-11T23:24:33.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.425+0000 7f0f7de00640 1 -- 172.21.15.144:0/1438490013 wait complete. 2024-09-11T23:24:33.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.426+0000 7f0f7de00640 1 Processor -- start 2024-09-11T23:24:33.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.426+0000 7f0f7de00640 1 -- start start 2024-09-11T23:24:33.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.427+0000 7f0f7de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f7806c0e0 0x7f0f78154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.427+0000 7f0f7de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f780af900 0x7f0f78162e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.427+0000 7f0f7de00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f78162930 0x7f0f780731c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.427+0000 7f0f7de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0f78162d10 con 0x7f0f7806c0e0 2024-09-11T23:24:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.427+0000 7f0f7de00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0f780b4590 con 0x7f0f78162930 2024-09-11T23:24:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.427+0000 7f0f7de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0f780cde00 con 0x7f0f780af900 2024-09-11T23:24:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.427+0000 7f0f76a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f7806c0e0 0x7f0f78154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.427+0000 7f0f76000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f780af900 0x7f0f78162e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.427+0000 7f0f76a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f7806c0e0 0x7f0f78154ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46550/0 (socket says 172.21.15.144:46550) 2024-09-11T23:24:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.427+0000 7f0f76a00640 1 -- 172.21.15.144:0/2081289452 learned_addr learned my addr 172.21.15.144:0/2081289452 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.428+0000 7f0f77400640 1 --2- 172.21.15.144:0/2081289452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f78162930 0x7f0f780731c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.428+0000 7f0f76000640 1 -- 172.21.15.144:0/2081289452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f78162930 msgr2=0x7f0f780731c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:33.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.428+0000 7f0f76000640 1 --2- 172.21.15.144:0/2081289452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f78162930 0x7f0f780731c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:33.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.428+0000 7f0f76000640 1 -- 172.21.15.144:0/2081289452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f7806c0e0 msgr2=0x7f0f78154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:33.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.428+0000 7f0f76000640 1 --2- 172.21.15.144:0/2081289452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f7806c0e0 0x7f0f78154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:33.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.428+0000 7f0f76000640 1 -- 172.21.15.144:0/2081289452 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f78155400 con 0x7f0f780af900 2024-09-11T23:24:33.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.428+0000 7f0f77400640 1 --2- 172.21.15.144:0/2081289452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f78162930 0x7f0f780731c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:33.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.428+0000 7f0f76000640 1 --2- 172.21.15.144:0/2081289452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f780af900 0x7f0f78162e90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0f64031000 tx=0x7f0f640046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:33.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.428+0000 7f0f6f400640 1 -- 172.21.15.144:0/2081289452 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64041030 con 0x7f0f780af900 2024-09-11T23:24:33.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.428+0000 7f0f6f400640 1 -- 172.21.15.144:0/2081289452 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f64030500 con 0x7f0f780af900 2024-09-11T23:24:33.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.428+0000 7f0f6f400640 1 -- 172.21.15.144:0/2081289452 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f64037040 con 0x7f0f780af900 2024-09-11T23:24:33.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.428+0000 7f0f7de00640 1 -- 172.21.15.144:0/2081289452 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f781636e0 con 0x7f0f780af900 2024-09-11T23:24:33.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.429+0000 7f0f7de00640 1 -- 172.21.15.144:0/2081289452 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f78163ca0 con 0x7f0f780af900 2024-09-11T23:24:33.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.430+0000 7f0f7de00640 1 -- 172.21.15.144:0/2081289452 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f7806bba0 con 0x7f0f780af900 2024-09-11T23:24:33.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.430+0000 7f0f6f400640 1 -- 172.21.15.144:0/2081289452 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f0f64044070 con 0x7f0f780af900 2024-09-11T23:24:33.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.431+0000 7f0f6f400640 1 --2- 172.21.15.144:0/2081289452 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0f5806c3d0 0x7f0f5806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:33.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.431+0000 7f0f6f400640 1 -- 172.21.15.144:0/2081289452 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(122..122 src has 1..122) ==== 4971+0+0 (secure 0 0 0) 0x7f0f640abbe0 con 0x7f0f780af900 2024-09-11T23:24:33.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.432+0000 7f0f76a00640 1 --2- 172.21.15.144:0/2081289452 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0f5806c3d0 0x7f0f5806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:33.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.432+0000 7f0f76a00640 1 --2- 172.21.15.144:0/2081289452 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0f5806c3d0 0x7f0f5806e890 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0f78164a90 tx=0x7f0f68009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:33.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.436+0000 7f0f6f400640 1 -- 172.21.15.144:0/2081289452 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f6407a170 con 0x7f0f780af900 2024-09-11T23:24:33.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:33.630+0000 7f0f7de00640 1 -- 172.21.15.144:0/2081289452 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f0f7815c4f0 con 0x7f0f780af900 2024-09-11T23:24:34.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.475+0000 7f0f6f400640 1 -- 172.21.15.144:0/2081289452 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v127) ==== 97+0+0 (secure 0 0 0) 0x7f0f64079a70 con 0x7f0f780af900 2024-09-11T23:24:34.475 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-11T23:24:34.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.478+0000 7f0f7de00640 1 -- 172.21.15.144:0/2081289452 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0f5806c3d0 msgr2=0x7f0f5806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:34.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.478+0000 7f0f7de00640 1 --2- 172.21.15.144:0/2081289452 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0f5806c3d0 0x7f0f5806e890 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0f78164a90 tx=0x7f0f68009190 comp rx=0 tx=0).stop 2024-09-11T23:24:34.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.478+0000 7f0f7de00640 1 -- 172.21.15.144:0/2081289452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f780af900 msgr2=0x7f0f78162e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:34.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.478+0000 7f0f7de00640 1 --2- 172.21.15.144:0/2081289452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f780af900 0x7f0f78162e90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0f64031000 tx=0x7f0f640046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:34.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.478+0000 7f0f7de00640 1 -- 172.21.15.144:0/2081289452 shutdown_connections 2024-09-11T23:24:34.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.478+0000 7f0f7de00640 1 --2- 172.21.15.144:0/2081289452 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f0f5806c3d0 0x7f0f5806e890 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:34.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.478+0000 7f0f7de00640 1 --2- 172.21.15.144:0/2081289452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f78162930 0x7f0f780731c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:34.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.478+0000 7f0f7de00640 1 --2- 172.21.15.144:0/2081289452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0f780af900 0x7f0f78162e90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:34.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.478+0000 7f0f7de00640 1 --2- 172.21.15.144:0/2081289452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f7806c0e0 0x7f0f78154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:34.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.478+0000 7f0f7de00640 1 -- 172.21.15.144:0/2081289452 >> 172.21.15.144:0/2081289452 conn(0x7f0f78062cc0 msgr2=0x7f0f78160840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:34.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.478+0000 7f0f7de00640 1 -- 172.21.15.144:0/2081289452 shutdown_connections 2024-09-11T23:24:34.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.478+0000 7f0f7de00640 1 -- 172.21.15.144:0/2081289452 wait complete. 2024-09-11T23:24:34.497 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:24:34.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.653+0000 7f42d8200640 1 Processor -- start 2024-09-11T23:24:34.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.653+0000 7f42d8200640 1 -- start start 2024-09-11T23:24:34.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.654+0000 7f42d8200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d00d0a50 0x7f42d01620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:34.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.654+0000 7f42d8200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f42d00b4930 0x7f42d00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:34.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.654+0000 7f42d8200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d01625f0 con 0x7f42d015f620 2024-09-11T23:24:34.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.655+0000 7f42d8200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f42d00b52d0 con 0x7f42d00b4930 2024-09-11T23:24:34.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.655+0000 7f42d8200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f42d0162870 con 0x7f42d00d0a50 2024-09-11T23:24:34.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.655+0000 7f42d6200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f42d015f620 0x7f42d015fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54258/0 (socket says 172.21.15.144:54258) 2024-09-11T23:24:34.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.655+0000 7f42d6200640 1 -- 172.21.15.144:0/1110710233 learned_addr learned my addr 172.21.15.144:0/1110710233 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:34.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.655+0000 7f42d4e00640 1 --2- 172.21.15.144:0/1110710233 >> v2:172.21.15.165:3300/0 conn(0x7f42d00b4930 0x7f42d00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:34.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.655+0000 7f42d5800640 1 --2- 172.21.15.144:0/1110710233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d00d0a50 0x7f42d01620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:34.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.655+0000 7f42cfe00640 1 -- 172.21.15.144:0/1110710233 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2595257921 0 0) 0x7f42c8001490 con 0x7f42d015f620 2024-09-11T23:24:34.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.655+0000 7f42cfe00640 1 -- 172.21.15.144:0/1110710233 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42b8003520 con 0x7f42d015f620 2024-09-11T23:24:34.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.655+0000 7f42d5800640 1 -- 172.21.15.144:0/1110710233 >> v2:172.21.15.165:3300/0 conn(0x7f42d00b4930 msgr2=0x7f42d00b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:34.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.655+0000 7f42d5800640 1 --2- 172.21.15.144:0/1110710233 >> v2:172.21.15.165:3300/0 conn(0x7f42d00b4930 0x7f42d00b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:34.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.655+0000 7f42d5800640 1 -- 172.21.15.144:0/1110710233 >> v1:172.21.15.144:6789/0 conn(0x7f42d015f620 legacy=0x7f42d015fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:34.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.655+0000 7f42d5800640 1 -- 172.21.15.144:0/1110710233 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d0162b50 con 0x7f42d00d0a50 2024-09-11T23:24:34.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.655+0000 7f42d4e00640 1 --2- 172.21.15.144:0/1110710233 >> v2:172.21.15.165:3300/0 conn(0x7f42d00b4930 0x7f42d00b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:24:34.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.656+0000 7f42d5800640 1 --2- 172.21.15.144:0/1110710233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d00d0a50 0x7f42d01620b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f42c40097a0 tx=0x7f42c402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9f011a8b871b3d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:34.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.657+0000 7f42cfe00640 1 -- 172.21.15.144:0/1110710233 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c4037070 con 0x7f42d00d0a50 2024-09-11T23:24:34.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.657+0000 7f42cfe00640 1 -- 172.21.15.144:0/1110710233 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c402ae50 con 0x7f42d00d0a50 2024-09-11T23:24:34.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.657+0000 7f42cfe00640 1 -- 172.21.15.144:0/1110710233 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c4032660 con 0x7f42d00d0a50 2024-09-11T23:24:34.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.657+0000 7f42d8200640 1 -- 172.21.15.144:0/1110710233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d00d0a50 msgr2=0x7f42d01620b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:34.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.657+0000 7f42d8200640 1 --2- 172.21.15.144:0/1110710233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d00d0a50 0x7f42d01620b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f42c40097a0 tx=0x7f42c402a100 comp rx=0 tx=0).stop 2024-09-11T23:24:34.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.657+0000 7f42d8200640 1 -- 172.21.15.144:0/1110710233 shutdown_connections 2024-09-11T23:24:34.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.657+0000 7f42d8200640 1 --2- 172.21.15.144:0/1110710233 >> v2:172.21.15.165:3300/0 conn(0x7f42d00b4930 0x7f42d00b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:34.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.657+0000 7f42d8200640 1 --2- 172.21.15.144:0/1110710233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d00d0a50 0x7f42d01620b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:34.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.657+0000 7f42d8200640 1 -- 172.21.15.144:0/1110710233 >> 172.21.15.144:0/1110710233 conn(0x7f42d0062cc0 msgr2=0x7f42d006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:34.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.657+0000 7f42d8200640 1 -- 172.21.15.144:0/1110710233 shutdown_connections 2024-09-11T23:24:34.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.657+0000 7f42d8200640 1 -- 172.21.15.144:0/1110710233 wait complete. 2024-09-11T23:24:34.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.659+0000 7f42d8200640 1 Processor -- start 2024-09-11T23:24:34.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.659+0000 7f42d8200640 1 -- start start 2024-09-11T23:24:34.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.660+0000 7f42d8200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42d00b4930 0x7f42d0146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:34.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.660+0000 7f42d8200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d015f620 0x7f42d0158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:34.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.660+0000 7f42d8200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42d01593e0 0x7f42d01f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:34.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.660+0000 7f42d8200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f42d00b3620 con 0x7f42d01593e0 2024-09-11T23:24:34.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.660+0000 7f42d8200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f42d00b3340 con 0x7f42d00b4930 2024-09-11T23:24:34.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.660+0000 7f42d8200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f42d00b3b40 con 0x7f42d015f620 2024-09-11T23:24:34.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.660+0000 7f42d6200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42d01593e0 0x7f42d01f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:34.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.660+0000 7f42d6200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42d01593e0 0x7f42d01f4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38688/0 (socket says 172.21.15.144:38688) 2024-09-11T23:24:34.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.660+0000 7f42d6200640 1 -- 172.21.15.144:0/4161079208 learned_addr learned my addr 172.21.15.144:0/4161079208 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:34.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.660+0000 7f42d4e00640 1 --2- 172.21.15.144:0/4161079208 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d015f620 0x7f42d0158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:34.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.660+0000 7f42d5800640 1 --2- 172.21.15.144:0/4161079208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42d00b4930 0x7f42d0146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:34.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.661+0000 7f42d6200640 1 -- 172.21.15.144:0/4161079208 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d015f620 msgr2=0x7f42d0158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:34.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.661+0000 7f42d6200640 1 --2- 172.21.15.144:0/4161079208 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d015f620 0x7f42d0158ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:34.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.661+0000 7f42d6200640 1 -- 172.21.15.144:0/4161079208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42d00b4930 msgr2=0x7f42d0146df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:34.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.661+0000 7f42d6200640 1 --2- 172.21.15.144:0/4161079208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42d00b4930 0x7f42d0146df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:34.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.661+0000 7f42d6200640 1 -- 172.21.15.144:0/4161079208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d01f4af0 con 0x7f42d01593e0 2024-09-11T23:24:34.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.661+0000 7f42d6200640 1 --2- 172.21.15.144:0/4161079208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42d01593e0 0x7f42d01f4020 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f42c800cb10 tx=0x7f42c800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:34.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.661+0000 7f42cd600640 1 -- 172.21.15.144:0/4161079208 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8017070 con 0x7f42d01593e0 2024-09-11T23:24:34.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.661+0000 7f42cd600640 1 -- 172.21.15.144:0/4161079208 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c800ac10 con 0x7f42d01593e0 2024-09-11T23:24:34.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.661+0000 7f42cd600640 1 -- 172.21.15.144:0/4161079208 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8012400 con 0x7f42d01593e0 2024-09-11T23:24:34.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.661+0000 7f42d8200640 1 -- 172.21.15.144:0/4161079208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d01f4dd0 con 0x7f42d01593e0 2024-09-11T23:24:34.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.661+0000 7f42d8200640 1 -- 172.21.15.144:0/4161079208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d015a2b0 con 0x7f42d01593e0 2024-09-11T23:24:34.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.662+0000 7f42d8200640 1 -- 172.21.15.144:0/4161079208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d00b4d90 con 0x7f42d01593e0 2024-09-11T23:24:34.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.663+0000 7f42cd600640 1 -- 172.21.15.144:0/4161079208 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f42c801a070 con 0x7f42d01593e0 2024-09-11T23:24:34.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.664+0000 7f42cd600640 1 --2- 172.21.15.144:0/4161079208 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f42b006c3d0 0x7f42b006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:34.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.664+0000 7f42cd600640 1 -- 172.21.15.144:0/4161079208 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 4857+0+0 (secure 0 0 0) 0x7f42c808b290 con 0x7f42d01593e0 2024-09-11T23:24:34.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.665+0000 7f42d5800640 1 --2- 172.21.15.144:0/4161079208 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f42b006c3d0 0x7f42b006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:34.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.665+0000 7f42d5800640 1 --2- 172.21.15.144:0/4161079208 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f42b006c3d0 0x7f42b006e890 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f42c4034000 tx=0x7f42c402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:34.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.669+0000 7f42cd600640 1 -- 172.21.15.144:0/4161079208 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42d01625f0 con 0x7f42d01593e0 2024-09-11T23:24:34.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.906+0000 7f42d8200640 1 -- 172.21.15.144:0/4161079208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f42d00cff90 con 0x7f42d01593e0 2024-09-11T23:24:34.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.907+0000 7f42cd600640 1 -- 172.21.15.144:0/4161079208 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7f42c8059120 con 0x7f42d01593e0 2024-09-11T23:24:34.907 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:34.907 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:24:34.907 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-11T23:24:34.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:34.907 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-11T23:24:34.908 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmQjymBhAA4BWEVNGY37RsnMGLL3Ow8A==", 2024-09-11T23:24:34.908 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:34.908 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:24:34.908 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:24:34.908 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:24:34.908 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:34.908 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:34.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:34.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:34.908 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-11T23:24:34.909 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmD0mIGhAAvug7T/kOcEmnyMyG++V+zA==", 2024-09-11T23:24:34.909 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:34.909 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:24:34.909 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:24:34.909 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:24:34.909 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:34.909 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:34.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:34.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:34.909 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-11T23:24:34.909 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmDwSZEBAAdf4eF3MrADSPzBTICzpOiA==", 2024-09-11T23:24:34.909 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:34.909 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:24:34.910 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:24:34.910 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:24:34.910 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:34.910 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:34.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:34.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:34.910 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-11T23:24:34.910 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmqYtRJBAAgpzvHNUPVnxNoflhqVIJuQ==", 2024-09-11T23:24:34.910 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:34.910 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:24:34.910 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:24:34.910 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:24:34.910 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:34.911 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:34.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:34.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:34.911 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-11T23:24:34.911 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDiJOJmzDABABAA+Qa772+Mm69pecG0QUXlyA==", 2024-09-11T23:24:34.911 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:34.911 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:24:34.911 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:24:34.911 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:34.911 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:34.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:34.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:34.912 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-11T23:24:34.912 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDlJOJmgVjJKRAAtl30JxJHurKdrn1vLUneww==", 2024-09-11T23:24:34.912 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:34.912 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:24:34.912 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:24:34.912 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:34.912 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:34.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:34.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:34.912 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-11T23:24:34.913 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDpJOJmRzO6FxAAiLDOwDlXYTj6WfEhlI+uVQ==", 2024-09-11T23:24:34.913 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:34.913 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:24:34.913 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:24:34.913 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:34.913 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:34.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:34.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:34.913 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-11T23:24:34.913 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDtJOJmVFh6EhAA7hcJn4k31nEPMcqiB7+djA==", 2024-09-11T23:24:34.913 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:34.914 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:24:34.914 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:24:34.914 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:34.914 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:34.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:34.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:34.914 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-11T23:24:34.914 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD0JOJmpIFTAhAAYQyoBrMjL6CcDDCNAOMGwQ==", 2024-09-11T23:24:34.914 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:34.914 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:24:34.914 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:24:34.915 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:34.915 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:34.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:34.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:34.915 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-11T23:24:34.915 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD4JOJmBAIIDhAA8G/usUslfQPNpFP1YZsgmg==", 2024-09-11T23:24:34.915 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:34.915 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:24:34.915 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:24:34.915 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:34.915 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:34.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:34.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:34.916 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-11T23:24:34.916 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD8JOJmDl2dCBAA5bL+2AIp0uWL4qjpI/mAdQ==", 2024-09-11T23:24:34.916 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:34.916 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:24:34.916 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:24:34.916 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:34.916 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:34.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:34.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:34.916 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-11T23:24:34.917 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAAJeJmMWX+AhAA7ABVgJPwhRZNkPNdZzmnOQ==", 2024-09-11T23:24:34.917 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:34.917 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:24:34.917 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:24:34.917 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:34.917 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:34.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:34.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:34.917 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-11T23:24:34.917 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A==", 2024-09-11T23:24:34.917 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:34.917 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:24:34.918 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-11T23:24:34.918 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T23:24:34.918 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:34.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:34.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:34.918 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-11T23:24:34.918 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmLFrBORAAT64lj0sWlVoTHVUZQf0JjA==", 2024-09-11T23:24:34.918 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:34.918 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:24:34.918 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:24:34.918 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:24:34.919 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:24:34.919 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:34.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:34.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:34.919 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-11T23:24:34.919 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJm2/dLMxAAbuKdVAbscrlF5jcBnouBOQ==", 2024-09-11T23:24:34.919 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:34.919 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:24:34.919 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:24:34.919 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:24:34.919 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:24:34.920 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:34.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:34.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:34.920 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-11T23:24:34.920 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDfJOJmse6UBBAAq+3afsp+2jApe9sTFmVVOw==", 2024-09-11T23:24:34.920 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:34.920 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:24:34.920 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:24:34.920 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:24:34.920 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:24:34.920 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:34.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:34.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:34.921 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-11T23:24:34.921 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmHmAwEhAAEGCvu0NgtyjIPcJBk6bkdA==", 2024-09-11T23:24:34.921 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:34.921 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:24:34.921 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:24:34.921 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:24:34.921 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:34.921 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:34.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:34.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:34.922 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-11T23:24:34.922 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmxMaVOxAA62zJwlyk0qdrsemalijH4Q==", 2024-09-11T23:24:34.922 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:34.922 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:24:34.922 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:24:34.922 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:34.922 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:34.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:24:34.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:34.922 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-11T23:24:34.922 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmWZRNNBAAwZ2GCP7mGn87ZSnsKCcDRQ==", 2024-09-11T23:24:34.922 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:24:34.922 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:24:34.923 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:24:34.923 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:24:34.923 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:34.923 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:34.923 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:24:34.923 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:24:34.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.909+0000 7f42d8200640 1 -- 172.21.15.144:0/4161079208 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f42b006c3d0 msgr2=0x7f42b006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:34.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.909+0000 7f42d8200640 1 --2- 172.21.15.144:0/4161079208 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f42b006c3d0 0x7f42b006e890 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f42c4034000 tx=0x7f42c402e000 comp rx=0 tx=0).stop 2024-09-11T23:24:34.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.909+0000 7f42d8200640 1 -- 172.21.15.144:0/4161079208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42d01593e0 msgr2=0x7f42d01f4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:34.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.909+0000 7f42d8200640 1 --2- 172.21.15.144:0/4161079208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42d01593e0 0x7f42d01f4020 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f42c800cb10 tx=0x7f42c800a060 comp rx=0 tx=0).stop 2024-09-11T23:24:34.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.909+0000 7f42d8200640 1 -- 172.21.15.144:0/4161079208 shutdown_connections 2024-09-11T23:24:34.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.909+0000 7f42d8200640 1 --2- 172.21.15.144:0/4161079208 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f42b006c3d0 0x7f42b006e890 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.909+0000 7f42d8200640 1 --2- 172.21.15.144:0/4161079208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42d01593e0 0x7f42d01f4020 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.909+0000 7f42d8200640 1 --2- 172.21.15.144:0/4161079208 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42d015f620 0x7f42d0158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.909+0000 7f42d8200640 1 --2- 172.21.15.144:0/4161079208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42d00b4930 0x7f42d0146df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.909+0000 7f42d8200640 1 -- 172.21.15.144:0/4161079208 >> 172.21.15.144:0/4161079208 conn(0x7f42d0062cc0 msgr2=0x7f42d00cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.909+0000 7f42d8200640 1 -- 172.21.15.144:0/4161079208 shutdown_connections 2024-09-11T23:24:34.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:34.909+0000 7f42d8200640 1 -- 172.21.15.144:0/4161079208 wait complete. 2024-09-11T23:24:34.926 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:24:35.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.081+0000 7f8f20a00640 1 Processor -- start 2024-09-11T23:24:35.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.081+0000 7f8f20a00640 1 -- start start 2024-09-11T23:24:35.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.083+0000 7f8f20a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8f1c0d02a0 0x7f8f1c0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:35.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.083+0000 7f8f20a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f1c0d0bc0 con 0x7f8f1c15ca40 2024-09-11T23:24:35.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.083+0000 7f8f20a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f1c15d390 con 0x7f8f1c15ceb0 2024-09-11T23:24:35.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.083+0000 7f8f20a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8f1c15d670 con 0x7f8f1c0d02a0 2024-09-11T23:24:35.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.083+0000 7f8f19400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8f1c15ca40 0x7f8f1c15e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54274/0 (socket says 172.21.15.144:54274) 2024-09-11T23:24:35.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.083+0000 7f8f19400640 1 -- 172.21.15.144:0/1239715624 learned_addr learned my addr 172.21.15.144:0/1239715624 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:35.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.083+0000 7f8f19e00640 1 --2- 172.21.15.144:0/1239715624 >> v2:172.21.15.165:3300/0 conn(0x7f8f1c0d02a0 0x7f8f1c0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:35.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.083+0000 7f8f18a00640 1 -- 172.21.15.144:0/1239715624 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3589211236 0 0) 0x7f8f1c0d0bc0 con 0x7f8f1c15ca40 2024-09-11T23:24:35.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.083+0000 7f8f18a00640 1 -- 172.21.15.144:0/1239715624 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f00003520 con 0x7f8f1c15ca40 2024-09-11T23:24:35.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.083+0000 7f8f19e00640 1 -- 172.21.15.144:0/1239715624 >> v1:172.21.15.165:6789/0 conn(0x7f8f1c15ceb0 legacy=0x7f8f1c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:35.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.084+0000 7f8f19e00640 1 -- 172.21.15.144:0/1239715624 >> v1:172.21.15.144:6789/0 conn(0x7f8f1c15ca40 legacy=0x7f8f1c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:35.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.084+0000 7f8f19e00640 1 -- 172.21.15.144:0/1239715624 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1c15d950 con 0x7f8f1c0d02a0 2024-09-11T23:24:35.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.085+0000 7f8f19e00640 1 --2- 172.21.15.144:0/1239715624 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f1c0d02a0 0x7f8f1c0d0680 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009d90 tx=0x7f8f0c02c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32af005233c0c4fd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:35.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.085+0000 7f8f18a00640 1 -- 172.21.15.144:0/1239715624 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c032770 con 0x7f8f1c0d02a0 2024-09-11T23:24:35.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.085+0000 7f8f18a00640 1 -- 172.21.15.144:0/1239715624 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f0c038070 con 0x7f8f1c0d02a0 2024-09-11T23:24:35.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.085+0000 7f8f18a00640 1 -- 172.21.15.144:0/1239715624 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c032b30 con 0x7f8f1c0d02a0 2024-09-11T23:24:35.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.085+0000 7f8f20a00640 1 -- 172.21.15.144:0/1239715624 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f1c0d02a0 msgr2=0x7f8f1c0d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:35.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.085+0000 7f8f20a00640 1 --2- 172.21.15.144:0/1239715624 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f1c0d02a0 0x7f8f1c0d0680 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009d90 tx=0x7f8f0c02c870 comp rx=0 tx=0).stop 2024-09-11T23:24:35.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.086+0000 7f8f20a00640 1 -- 172.21.15.144:0/1239715624 shutdown_connections 2024-09-11T23:24:35.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.086+0000 7f8f20a00640 1 --2- 172.21.15.144:0/1239715624 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f1c0d02a0 0x7f8f1c0d0680 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:35.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.086+0000 7f8f20a00640 1 -- 172.21.15.144:0/1239715624 >> 172.21.15.144:0/1239715624 conn(0x7f8f1c062cc0 msgr2=0x7f8f1c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:35.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.086+0000 7f8f20a00640 1 -- 172.21.15.144:0/1239715624 shutdown_connections 2024-09-11T23:24:35.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.086+0000 7f8f20a00640 1 -- 172.21.15.144:0/1239715624 wait complete. 2024-09-11T23:24:35.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.087+0000 7f8f20a00640 1 Processor -- start 2024-09-11T23:24:35.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.087+0000 7f8f20a00640 1 -- start start 2024-09-11T23:24:35.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.088+0000 7f8f20a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1c0d02a0 0x7f8f1c14c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:35.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.088+0000 7f8f20a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f1c15ca40 0x7f8f1c157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:35.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.088+0000 7f8f20a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f1c15ceb0 0x7f8f1c153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:35.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.088+0000 7f8f20a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c15eb40 con 0x7f8f1c0d02a0 2024-09-11T23:24:35.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.088+0000 7f8f20a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c15df10 con 0x7f8f1c15ceb0 2024-09-11T23:24:35.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.088+0000 7f8f20a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8f1c155b90 con 0x7f8f1c15ca40 2024-09-11T23:24:35.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.088+0000 7f8f19e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1c0d02a0 0x7f8f1c14c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:35.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.088+0000 7f8f19e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1c0d02a0 0x7f8f1c14c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38704/0 (socket says 172.21.15.144:38704) 2024-09-11T23:24:35.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.088+0000 7f8f19e00640 1 -- 172.21.15.144:0/4228620226 learned_addr learned my addr 172.21.15.144:0/4228620226 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:35.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.089+0000 7f8f19400640 1 --2- 172.21.15.144:0/4228620226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f1c15ca40 0x7f8f1c157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:35.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.089+0000 7f8f1a800640 1 --2- 172.21.15.144:0/4228620226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f1c15ceb0 0x7f8f1c153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:35.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.089+0000 7f8f19e00640 1 -- 172.21.15.144:0/4228620226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f1c15ca40 msgr2=0x7f8f1c157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:35.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.089+0000 7f8f19e00640 1 --2- 172.21.15.144:0/4228620226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f1c15ca40 0x7f8f1c157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:35.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.089+0000 7f8f19e00640 1 -- 172.21.15.144:0/4228620226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f1c15ceb0 msgr2=0x7f8f1c153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:35.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.089+0000 7f8f19e00640 1 --2- 172.21.15.144:0/4228620226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f1c15ceb0 0x7f8f1c153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:35.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.089+0000 7f8f19e00640 1 -- 172.21.15.144:0/4228620226 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1c0733b0 con 0x7f8f1c0d02a0 2024-09-11T23:24:35.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.089+0000 7f8f19400640 1 --2- 172.21.15.144:0/4228620226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f1c15ca40 0x7f8f1c157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:35.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.089+0000 7f8f19e00640 1 --2- 172.21.15.144:0/4228620226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1c0d02a0 0x7f8f1c14c1d0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009d90 tx=0x7f8f0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:35.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.090+0000 7f8f12000640 1 -- 172.21.15.144:0/4228620226 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c033600 con 0x7f8f1c0d02a0 2024-09-11T23:24:35.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.090+0000 7f8f12000640 1 -- 172.21.15.144:0/4228620226 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f0c0337a0 con 0x7f8f1c0d02a0 2024-09-11T23:24:35.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.090+0000 7f8f12000640 1 -- 172.21.15.144:0/4228620226 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c033b90 con 0x7f8f1c0d02a0 2024-09-11T23:24:35.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.090+0000 7f8f20a00640 1 -- 172.21.15.144:0/4228620226 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f1c0730d0 con 0x7f8f1c0d02a0 2024-09-11T23:24:35.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.090+0000 7f8f20a00640 1 -- 172.21.15.144:0/4228620226 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f1c156c90 con 0x7f8f1c0d02a0 2024-09-11T23:24:35.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.091+0000 7f8f20a00640 1 -- 172.21.15.144:0/4228620226 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f1c0b4790 con 0x7f8f1c0d02a0 2024-09-11T23:24:35.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.092+0000 7f8f12000640 1 -- 172.21.15.144:0/4228620226 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f8f0c005d10 con 0x7f8f1c0d02a0 2024-09-11T23:24:35.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.093+0000 7f8f12000640 1 --2- 172.21.15.144:0/4228620226 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8efc06c3d0 0x7f8efc06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:35.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.093+0000 7f8f12000640 1 -- 172.21.15.144:0/4228620226 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 4857+0+0 (secure 0 0 0) 0x7f8f0c0ae0e0 con 0x7f8f1c0d02a0 2024-09-11T23:24:35.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.093+0000 7f8f19400640 1 --2- 172.21.15.144:0/4228620226 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8efc06c3d0 0x7f8efc06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:35.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.094+0000 7f8f19400640 1 --2- 172.21.15.144:0/4228620226 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8efc06c3d0 0x7f8efc06e890 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8f08007fd0 tx=0x7f8f08009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:35.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.099+0000 7f8f12000640 1 -- 172.21.15.144:0/4228620226 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f0c042070 con 0x7f8f1c0d02a0 2024-09-11T23:24:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.277+0000 7f8f20a00640 1 -- 172.21.15.144:0/4228620226 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8f1c0b3c00 con 0x7f8f1c0d02a0 2024-09-11T23:24:35.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.277+0000 7f8f12000640 1 -- 172.21.15.144:0/4228620226 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v127) ==== 84+0+65 (secure 0 0 0) 0x7f8f0c07c4b0 con 0x7f8f1c0d02a0 2024-09-11T23:24:35.277 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:35.277 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:24:35.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:35.277 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-11T23:24:35.278 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-11T23:24:35.278 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:35.278 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:24:35.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.279+0000 7f8f20a00640 1 -- 172.21.15.144:0/4228620226 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8efc06c3d0 msgr2=0x7f8efc06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:35.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.279+0000 7f8f20a00640 1 --2- 172.21.15.144:0/4228620226 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8efc06c3d0 0x7f8efc06e890 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8f08007fd0 tx=0x7f8f08009040 comp rx=0 tx=0).stop 2024-09-11T23:24:35.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.279+0000 7f8f20a00640 1 -- 172.21.15.144:0/4228620226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1c0d02a0 msgr2=0x7f8f1c14c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:35.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.279+0000 7f8f20a00640 1 --2- 172.21.15.144:0/4228620226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1c0d02a0 0x7f8f1c14c1d0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009d90 tx=0x7f8f0c004a40 comp rx=0 tx=0).stop 2024-09-11T23:24:35.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.279+0000 7f8f20a00640 1 -- 172.21.15.144:0/4228620226 shutdown_connections 2024-09-11T23:24:35.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.279+0000 7f8f20a00640 1 --2- 172.21.15.144:0/4228620226 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8efc06c3d0 0x7f8efc06e890 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:35.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.279+0000 7f8f20a00640 1 --2- 172.21.15.144:0/4228620226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f1c15ceb0 0x7f8f1c153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:35.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.279+0000 7f8f20a00640 1 --2- 172.21.15.144:0/4228620226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8f1c15ca40 0x7f8f1c157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:35.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.279+0000 7f8f20a00640 1 --2- 172.21.15.144:0/4228620226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8f1c0d02a0 0x7f8f1c14c1d0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:35.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.279+0000 7f8f20a00640 1 -- 172.21.15.144:0/4228620226 >> 172.21.15.144:0/4228620226 conn(0x7f8f1c062cc0 msgr2=0x7f8f1c0b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:35.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.280+0000 7f8f20a00640 1 -- 172.21.15.144:0/4228620226 shutdown_connections 2024-09-11T23:24:35.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.280+0000 7f8f20a00640 1 -- 172.21.15.144:0/4228620226 wait complete. 2024-09-11T23:24:35.296 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:24:35.296 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:24:35.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.454+0000 7f4621c00640 1 Processor -- start 2024-09-11T23:24:35.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.454+0000 7f4621c00640 1 -- start start 2024-09-11T23:24:35.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.455+0000 7f4621c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f461c15f9f0 0x7f461c072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:35.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.455+0000 7f4621c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f461c15c970 con 0x7f461c15b370 2024-09-11T23:24:35.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.455+0000 7f4621c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f461c15bbb0 con 0x7f461c06f130 2024-09-11T23:24:35.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.455+0000 7f4621c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f461c15fef0 con 0x7f461c15f9f0 2024-09-11T23:24:35.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.455+0000 7f461b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f461c15f9f0 0x7f461c072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:35.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.455+0000 7f461aa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f461c15b370 0x7f461c06ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54280/0 (socket says 172.21.15.144:54280) 2024-09-11T23:24:35.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.455+0000 7f461aa00640 1 -- 172.21.15.144:0/331222931 learned_addr learned my addr 172.21.15.144:0/331222931 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:35.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.456+0000 7f461b400640 1 -- 172.21.15.144:0/331222931 >> v1:172.21.15.165:6789/0 conn(0x7f461c06f130 legacy=0x7f461c0ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:35.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.456+0000 7f461b400640 1 -- 172.21.15.144:0/331222931 >> v1:172.21.15.144:6789/0 conn(0x7f461c15b370 legacy=0x7f461c06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:35.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.456+0000 7f461b400640 1 -- 172.21.15.144:0/331222931 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461c15be90 con 0x7f461c15f9f0 2024-09-11T23:24:35.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.456+0000 7f4619600640 1 -- 172.21.15.144:0/331222931 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1078944393 0 0) 0x7f461c15c970 con 0x7f461c15b370 2024-09-11T23:24:35.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.457+0000 7f461b400640 1 --2- 172.21.15.144:0/331222931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c15f9f0 0x7f461c072560 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f4614009d90 tx=0x7f461402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2eb05607bbae8e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:35.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.457+0000 7f4619600640 1 -- 172.21.15.144:0/331222931 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614031600 con 0x7f461c15f9f0 2024-09-11T23:24:35.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.457+0000 7f4619600640 1 -- 172.21.15.144:0/331222931 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46140317a0 con 0x7f461c15f9f0 2024-09-11T23:24:35.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.457+0000 7f4619600640 1 -- 172.21.15.144:0/331222931 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614031b70 con 0x7f461c15f9f0 2024-09-11T23:24:35.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.457+0000 7f4621c00640 1 -- 172.21.15.144:0/331222931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c15f9f0 msgr2=0x7f461c072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:35.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.457+0000 7f4621c00640 1 --2- 172.21.15.144:0/331222931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c15f9f0 0x7f461c072560 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f4614009d90 tx=0x7f461402a610 comp rx=0 tx=0).stop 2024-09-11T23:24:35.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.457+0000 7f4621c00640 1 -- 172.21.15.144:0/331222931 shutdown_connections 2024-09-11T23:24:35.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.457+0000 7f4621c00640 1 --2- 172.21.15.144:0/331222931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c15f9f0 0x7f461c072560 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:35.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.457+0000 7f4621c00640 1 -- 172.21.15.144:0/331222931 >> 172.21.15.144:0/331222931 conn(0x7f461c06bba0 msgr2=0x7f461c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:35.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.458+0000 7f4621c00640 1 -- 172.21.15.144:0/331222931 shutdown_connections 2024-09-11T23:24:35.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.458+0000 7f4621c00640 1 -- 172.21.15.144:0/331222931 wait complete. 2024-09-11T23:24:35.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.459+0000 7f4621c00640 1 Processor -- start 2024-09-11T23:24:35.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.459+0000 7f4621c00640 1 -- start start 2024-09-11T23:24:35.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.460+0000 7f4621c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f461c06f130 0x7f461c1f3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:35.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.460+0000 7f4621c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c15b370 0x7f461c0b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:35.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.460+0000 7f4621c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f461c15f9f0 0x7f461c0ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:35.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.460+0000 7f4621c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f461c0731b0 con 0x7f461c15b370 2024-09-11T23:24:35.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.460+0000 7f4621c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f461c15c450 con 0x7f461c15f9f0 2024-09-11T23:24:35.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.460+0000 7f4621c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f461c15b750 con 0x7f461c06f130 2024-09-11T23:24:35.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.460+0000 7f461a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c15b370 0x7f461c0b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:35.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.460+0000 7f461a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c15b370 0x7f461c0b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38728/0 (socket says 172.21.15.144:38728) 2024-09-11T23:24:35.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.460+0000 7f461a000640 1 -- 172.21.15.144:0/4215523999 learned_addr learned my addr 172.21.15.144:0/4215523999 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:35.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.460+0000 7f461b400640 1 --2- 172.21.15.144:0/4215523999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f461c15f9f0 0x7f461c0ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:35.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.460+0000 7f461aa00640 1 --2- 172.21.15.144:0/4215523999 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f461c06f130 0x7f461c1f3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:35.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.461+0000 7f461a000640 1 -- 172.21.15.144:0/4215523999 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f461c06f130 msgr2=0x7f461c1f3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:35.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.461+0000 7f461a000640 1 --2- 172.21.15.144:0/4215523999 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f461c06f130 0x7f461c1f3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:35.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.461+0000 7f461a000640 1 -- 172.21.15.144:0/4215523999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f461c15f9f0 msgr2=0x7f461c0ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:35.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.461+0000 7f461a000640 1 --2- 172.21.15.144:0/4215523999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f461c15f9f0 0x7f461c0ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:35.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.461+0000 7f461a000640 1 -- 172.21.15.144:0/4215523999 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461c0b4a10 con 0x7f461c15b370 2024-09-11T23:24:35.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.461+0000 7f461a000640 1 --2- 172.21.15.144:0/4215523999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c15b370 0x7f461c0b3f80 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f460800b3f0 tx=0x7f460800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:35.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.461+0000 7f4612a00640 1 -- 172.21.15.144:0/4215523999 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4608015020 con 0x7f461c15b370 2024-09-11T23:24:35.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.461+0000 7f4612a00640 1 -- 172.21.15.144:0/4215523999 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4608011830 con 0x7f461c15b370 2024-09-11T23:24:35.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.461+0000 7f4612a00640 1 -- 172.21.15.144:0/4215523999 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4608011c20 con 0x7f461c15b370 2024-09-11T23:24:35.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.461+0000 7f4621c00640 1 -- 172.21.15.144:0/4215523999 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f461c0b4cb0 con 0x7f461c15b370 2024-09-11T23:24:35.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.461+0000 7f4621c00640 1 -- 172.21.15.144:0/4215523999 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f461c0b5270 con 0x7f461c15b370 2024-09-11T23:24:35.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.463+0000 7f4621c00640 1 -- 172.21.15.144:0/4215523999 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f461c0008d0 con 0x7f461c15b370 2024-09-11T23:24:35.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.463+0000 7f4612a00640 1 -- 172.21.15.144:0/4215523999 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f4608018020 con 0x7f461c15b370 2024-09-11T23:24:35.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.464+0000 7f4612a00640 1 --2- 172.21.15.144:0/4215523999 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f45fc06c3d0 0x7f45fc06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:35.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.464+0000 7f4612a00640 1 -- 172.21.15.144:0/4215523999 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 4857+0+0 (secure 0 0 0) 0x7f460808b100 con 0x7f461c15b370 2024-09-11T23:24:35.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.465+0000 7f461aa00640 1 --2- 172.21.15.144:0/4215523999 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f45fc06c3d0 0x7f45fc06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:35.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.465+0000 7f461aa00640 1 --2- 172.21.15.144:0/4215523999 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f45fc06c3d0 0x7f45fc06e890 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f460c000f60 tx=0x7f460c007d50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:35.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.469+0000 7f4612a00640 1 -- 172.21.15.144:0/4215523999 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f460801f030 con 0x7f461c15b370 2024-09-11T23:24:35.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:35.644+0000 7f4621c00640 1 -- 172.21.15.144:0/4215523999 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f461c072560 con 0x7f461c15b370 2024-09-11T23:24:36.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.473+0000 7f4612a00640 1 -- 172.21.15.144:0/4215523999 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v128) ==== 138+0+0 (secure 0 0 0) 0x7f4608058f00 con 0x7f461c15b370 2024-09-11T23:24:36.473 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-11T23:24:36.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.476+0000 7f4621c00640 1 -- 172.21.15.144:0/4215523999 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f45fc06c3d0 msgr2=0x7f45fc06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:36.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.476+0000 7f4621c00640 1 --2- 172.21.15.144:0/4215523999 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f45fc06c3d0 0x7f45fc06e890 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f460c000f60 tx=0x7f460c007d50 comp rx=0 tx=0).stop 2024-09-11T23:24:36.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.476+0000 7f4621c00640 1 -- 172.21.15.144:0/4215523999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c15b370 msgr2=0x7f461c0b3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:36.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.476+0000 7f4621c00640 1 --2- 172.21.15.144:0/4215523999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c15b370 0x7f461c0b3f80 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f460800b3f0 tx=0x7f460800b8b0 comp rx=0 tx=0).stop 2024-09-11T23:24:36.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.476+0000 7f4621c00640 1 -- 172.21.15.144:0/4215523999 shutdown_connections 2024-09-11T23:24:36.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.476+0000 7f4621c00640 1 --2- 172.21.15.144:0/4215523999 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f45fc06c3d0 0x7f45fc06e890 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:36.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.476+0000 7f4621c00640 1 --2- 172.21.15.144:0/4215523999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f461c15f9f0 0x7f461c0ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:36.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.476+0000 7f4621c00640 1 --2- 172.21.15.144:0/4215523999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f461c15b370 0x7f461c0b3f80 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:36.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.476+0000 7f4621c00640 1 --2- 172.21.15.144:0/4215523999 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f461c06f130 0x7f461c1f3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:36.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.476+0000 7f4621c00640 1 -- 172.21.15.144:0/4215523999 >> 172.21.15.144:0/4215523999 conn(0x7f461c06bba0 msgr2=0x7f461c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:36.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.477+0000 7f4621c00640 1 -- 172.21.15.144:0/4215523999 shutdown_connections 2024-09-11T23:24:36.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.477+0000 7f4621c00640 1 -- 172.21.15.144:0/4215523999 wait complete. 2024-09-11T23:24:36.496 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:24:36.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.658+0000 7fb559200640 1 Processor -- start 2024-09-11T23:24:36.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.658+0000 7fb559200640 1 -- start start 2024-09-11T23:24:36.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.659+0000 7fb559200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb5540d0960 0x7fb5540cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:36.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.659+0000 7fb559200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb5540d1180 0x7fb5540d15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:36.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.659+0000 7fb559200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb55415fab0 con 0x7fb5540d0d40 2024-09-11T23:24:36.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.659+0000 7fb559200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb5540d1b30 con 0x7fb5540d1180 2024-09-11T23:24:36.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.659+0000 7fb559200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb55415fd90 con 0x7fb5540d0960 2024-09-11T23:24:36.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.660+0000 7fb553e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb5540d1180 0x7fb5540d15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:36.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.660+0000 7fb552a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb5540d0d40 0x7fb55415f010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54296/0 (socket says 172.21.15.144:54296) 2024-09-11T23:24:36.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.660+0000 7fb552a00640 1 -- 172.21.15.144:0/531159049 learned_addr learned my addr 172.21.15.144:0/531159049 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:36.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.660+0000 7fb553400640 1 --2- 172.21.15.144:0/531159049 >> v2:172.21.15.165:3300/0 conn(0x7fb5540d0960 0x7fb5540cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:36.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.660+0000 7fb553e00640 1 -- 172.21.15.144:0/531159049 >> v2:172.21.15.165:3300/0 conn(0x7fb5540d0960 msgr2=0x7fb5540cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:36.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.660+0000 7fb553e00640 1 --2- 172.21.15.144:0/531159049 >> v2:172.21.15.165:3300/0 conn(0x7fb5540d0960 0x7fb5540cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:36.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.660+0000 7fb553e00640 1 -- 172.21.15.144:0/531159049 >> v1:172.21.15.144:6789/0 conn(0x7fb5540d0d40 legacy=0x7fb55415f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:36.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.660+0000 7fb553e00640 1 -- 172.21.15.144:0/531159049 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5540cf300 con 0x7fb5540d1180 2024-09-11T23:24:36.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.661+0000 7fb553e00640 1 --2- 172.21.15.144:0/531159049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540d1180 0x7fb5540d15f0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009d90 tx=0x7fb54c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a8877fec100e01 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:36.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.661+0000 7fb552000640 1 -- 172.21.15.144:0/531159049 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c007740 con 0x7fb5540d1180 2024-09-11T23:24:36.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.661+0000 7fb552000640 1 -- 172.21.15.144:0/531159049 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54c0078e0 con 0x7fb5540d1180 2024-09-11T23:24:36.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.661+0000 7fb552000640 1 -- 172.21.15.144:0/531159049 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c007cb0 con 0x7fb5540d1180 2024-09-11T23:24:36.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.662+0000 7fb559200640 1 -- 172.21.15.144:0/531159049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540d1180 msgr2=0x7fb5540d15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:36.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.662+0000 7fb559200640 1 --2- 172.21.15.144:0/531159049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540d1180 0x7fb5540d15f0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009d90 tx=0x7fb54c02a6a0 comp rx=0 tx=0).stop 2024-09-11T23:24:36.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.662+0000 7fb559200640 1 -- 172.21.15.144:0/531159049 shutdown_connections 2024-09-11T23:24:36.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.662+0000 7fb559200640 1 --2- 172.21.15.144:0/531159049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540d1180 0x7fb5540d15f0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:36.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.662+0000 7fb559200640 1 --2- 172.21.15.144:0/531159049 >> v2:172.21.15.165:3300/0 conn(0x7fb5540d0960 0x7fb5540cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:36.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.662+0000 7fb559200640 1 -- 172.21.15.144:0/531159049 >> 172.21.15.144:0/531159049 conn(0x7fb55406e190 msgr2=0x7fb55406e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:36.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.662+0000 7fb559200640 1 -- 172.21.15.144:0/531159049 shutdown_connections 2024-09-11T23:24:36.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.662+0000 7fb559200640 1 -- 172.21.15.144:0/531159049 wait complete. 2024-09-11T23:24:36.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.664+0000 7fb559200640 1 Processor -- start 2024-09-11T23:24:36.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.664+0000 7fb559200640 1 -- start start 2024-09-11T23:24:36.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.665+0000 7fb559200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5540d0960 0x7fb5541f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:36.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.665+0000 7fb559200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540d0d40 0x7fb554152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:36.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.665+0000 7fb559200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb5540d1180 0x7fb5540b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:36.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.665+0000 7fb559200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb55415f720 con 0x7fb5540d0d40 2024-09-11T23:24:36.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.665+0000 7fb559200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb5540d0040 con 0x7fb5540d0960 2024-09-11T23:24:36.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.665+0000 7fb559200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb5540cd360 con 0x7fb5540d1180 2024-09-11T23:24:36.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.665+0000 7fb552a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540d0d40 0x7fb554152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:36.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.665+0000 7fb552a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540d0d40 0x7fb554152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38750/0 (socket says 172.21.15.144:38750) 2024-09-11T23:24:36.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.665+0000 7fb552a00640 1 -- 172.21.15.144:0/2243677816 learned_addr learned my addr 172.21.15.144:0/2243677816 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:36.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.665+0000 7fb553400640 1 --2- 172.21.15.144:0/2243677816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5540d0960 0x7fb5541f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:36.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.665+0000 7fb553e00640 1 --2- 172.21.15.144:0/2243677816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb5540d1180 0x7fb5540b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:36.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.665+0000 7fb552a00640 1 -- 172.21.15.144:0/2243677816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb5540d1180 msgr2=0x7fb5540b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:36.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.665+0000 7fb552a00640 1 --2- 172.21.15.144:0/2243677816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb5540d1180 0x7fb5540b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:36.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.665+0000 7fb552a00640 1 -- 172.21.15.144:0/2243677816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5540d0960 msgr2=0x7fb5541f89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:36.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.665+0000 7fb552a00640 1 --2- 172.21.15.144:0/2243677816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5540d0960 0x7fb5541f89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:36.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.665+0000 7fb552a00640 1 -- 172.21.15.144:0/2243677816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55415bc20 con 0x7fb5540d0d40 2024-09-11T23:24:36.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.665+0000 7fb553400640 1 --2- 172.21.15.144:0/2243677816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5540d0960 0x7fb5541f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:36.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.666+0000 7fb552a00640 1 --2- 172.21.15.144:0/2243677816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540d0d40 0x7fb554152e10 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fb54000c440 tx=0x7fb540001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:36.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.666+0000 7fb54b400640 1 -- 172.21.15.144:0/2243677816 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540017070 con 0x7fb5540d0d40 2024-09-11T23:24:36.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.666+0000 7fb54b400640 1 -- 172.21.15.144:0/2243677816 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb540005ce0 con 0x7fb5540d0d40 2024-09-11T23:24:36.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.666+0000 7fb559200640 1 -- 172.21.15.144:0/2243677816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb55415bf00 con 0x7fb5540d0d40 2024-09-11T23:24:36.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.666+0000 7fb54b400640 1 -- 172.21.15.144:0/2243677816 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5400072f0 con 0x7fb5540d0d40 2024-09-11T23:24:36.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.666+0000 7fb559200640 1 -- 172.21.15.144:0/2243677816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb55415c4c0 con 0x7fb5540d0d40 2024-09-11T23:24:36.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.667+0000 7fb559200640 1 -- 172.21.15.144:0/2243677816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5540cfb00 con 0x7fb5540d0d40 2024-09-11T23:24:36.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.668+0000 7fb54b400640 1 -- 172.21.15.144:0/2243677816 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7fb54001a070 con 0x7fb5540d0d40 2024-09-11T23:24:36.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.669+0000 7fb54b400640 1 --2- 172.21.15.144:0/2243677816 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb53406c3d0 0x7fb53406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:36.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.669+0000 7fb54b400640 1 -- 172.21.15.144:0/2243677816 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5227+0+0 (secure 0 0 0) 0x7fb54008ae70 con 0x7fb5540d0d40 2024-09-11T23:24:36.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.670+0000 7fb553400640 1 --2- 172.21.15.144:0/2243677816 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb53406c3d0 0x7fb53406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:36.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.670+0000 7fb553400640 1 --2- 172.21.15.144:0/2243677816 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb53406c3d0 0x7fb53406e890 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb544009b90 tx=0x7fb544008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:36.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.673+0000 7fb54b400640 1 -- 172.21.15.144:0/2243677816 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb540021020 con 0x7fb5540d0d40 2024-09-11T23:24:36.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:36.849+0000 7fb559200640 1 -- 172.21.15.144:0/2243677816 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb5540d0340 con 0x7fb5540d0d40 2024-09-11T23:24:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.479+0000 7fb54b400640 1 -- 172.21.15.144:0/2243677816 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v129) ==== 170+0+0 (secure 0 0 0) 0x7fb540059260 con 0x7fb5540d0d40 2024-09-11T23:24:37.479 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-11T23:24:37.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.481+0000 7fb559200640 1 -- 172.21.15.144:0/2243677816 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb53406c3d0 msgr2=0x7fb53406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:37.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.481+0000 7fb559200640 1 --2- 172.21.15.144:0/2243677816 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb53406c3d0 0x7fb53406e890 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb544009b90 tx=0x7fb544008040 comp rx=0 tx=0).stop 2024-09-11T23:24:37.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.481+0000 7fb559200640 1 -- 172.21.15.144:0/2243677816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540d0d40 msgr2=0x7fb554152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:37.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.481+0000 7fb559200640 1 --2- 172.21.15.144:0/2243677816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540d0d40 0x7fb554152e10 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fb54000c440 tx=0x7fb540001e70 comp rx=0 tx=0).stop 2024-09-11T23:24:37.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.482+0000 7fb559200640 1 -- 172.21.15.144:0/2243677816 shutdown_connections 2024-09-11T23:24:37.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.482+0000 7fb559200640 1 --2- 172.21.15.144:0/2243677816 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb53406c3d0 0x7fb53406e890 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:37.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.482+0000 7fb559200640 1 --2- 172.21.15.144:0/2243677816 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb5540d1180 0x7fb5540b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:37.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.482+0000 7fb559200640 1 --2- 172.21.15.144:0/2243677816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5540d0d40 0x7fb554152e10 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:37.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.482+0000 7fb559200640 1 --2- 172.21.15.144:0/2243677816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5540d0960 0x7fb5541f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:37.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.482+0000 7fb559200640 1 -- 172.21.15.144:0/2243677816 >> 172.21.15.144:0/2243677816 conn(0x7fb55406e190 msgr2=0x7fb554159350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:37.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.482+0000 7fb559200640 1 -- 172.21.15.144:0/2243677816 shutdown_connections 2024-09-11T23:24:37.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.482+0000 7fb559200640 1 -- 172.21.15.144:0/2243677816 wait complete. 2024-09-11T23:24:37.510 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:24:37.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.667+0000 7f664ca00640 1 Processor -- start 2024-09-11T23:24:37.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.668+0000 7f664ca00640 1 -- start start 2024-09-11T23:24:37.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.669+0000 7f664ca00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6648158e50 0x7f66480b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:37.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.669+0000 7f664ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f664815c370 0x7f664806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:37.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.669+0000 7f664ca00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f664815c800 con 0x7f664806ef60 2024-09-11T23:24:37.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.669+0000 7f664ca00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f66480b43f0 con 0x7f664815c370 2024-09-11T23:24:37.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.669+0000 7f664ca00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f66480b3630 con 0x7f6648158e50 2024-09-11T23:24:37.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.669+0000 7f6645400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f664815c370 0x7f664806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:37.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.669+0000 7f6646800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f664806ef60 0x7f664815ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54298/0 (socket says 172.21.15.144:54298) 2024-09-11T23:24:37.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.669+0000 7f6646800640 1 -- 172.21.15.144:0/2026223209 learned_addr learned my addr 172.21.15.144:0/2026223209 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:37.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.669+0000 7f6645e00640 1 --2- 172.21.15.144:0/2026223209 >> v2:172.21.15.165:3300/0 conn(0x7f6648158e50 0x7f66480b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:37.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.670+0000 7f6645400640 1 -- 172.21.15.144:0/2026223209 >> v2:172.21.15.165:3300/0 conn(0x7f6648158e50 msgr2=0x7f66480b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:37.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.670+0000 7f6645400640 1 --2- 172.21.15.144:0/2026223209 >> v2:172.21.15.165:3300/0 conn(0x7f6648158e50 0x7f66480b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:37.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.670+0000 7f6645400640 1 -- 172.21.15.144:0/2026223209 >> v1:172.21.15.144:6789/0 conn(0x7f664806ef60 legacy=0x7f664815ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:37.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.670+0000 7f6645400640 1 -- 172.21.15.144:0/2026223209 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66480b3910 con 0x7f664815c370 2024-09-11T23:24:37.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.670+0000 7f6644a00640 1 -- 172.21.15.144:0/2026223209 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 686539670 0 0) 0x7f664815c800 con 0x7f664806ef60 2024-09-11T23:24:37.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.671+0000 7f6645400640 1 --2- 172.21.15.144:0/2026223209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f664815c370 0x7f664806ea20 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f6648069580 tx=0x7f663402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9ffea53191cd7f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:37.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.671+0000 7f6644a00640 1 -- 172.21.15.144:0/2026223209 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6634037070 con 0x7f664815c370 2024-09-11T23:24:37.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.671+0000 7f6644a00640 1 -- 172.21.15.144:0/2026223209 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6634032440 con 0x7f664815c370 2024-09-11T23:24:37.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.671+0000 7f6644a00640 1 -- 172.21.15.144:0/2026223209 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6634032810 con 0x7f664815c370 2024-09-11T23:24:37.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.671+0000 7f664ca00640 1 -- 172.21.15.144:0/2026223209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f664815c370 msgr2=0x7f664806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:37.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.671+0000 7f664ca00640 1 --2- 172.21.15.144:0/2026223209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f664815c370 0x7f664806ea20 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f6648069580 tx=0x7f663402a1a0 comp rx=0 tx=0).stop 2024-09-11T23:24:37.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.672+0000 7f664ca00640 1 -- 172.21.15.144:0/2026223209 shutdown_connections 2024-09-11T23:24:37.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.672+0000 7f664ca00640 1 --2- 172.21.15.144:0/2026223209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f664815c370 0x7f664806ea20 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:37.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.672+0000 7f664ca00640 1 --2- 172.21.15.144:0/2026223209 >> v2:172.21.15.165:3300/0 conn(0x7f6648158e50 0x7f66480b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:37.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.672+0000 7f664ca00640 1 -- 172.21.15.144:0/2026223209 >> 172.21.15.144:0/2026223209 conn(0x7f664806bba0 msgr2=0x7f664806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:37.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.672+0000 7f664ca00640 1 -- 172.21.15.144:0/2026223209 shutdown_connections 2024-09-11T23:24:37.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.672+0000 7f664ca00640 1 -- 172.21.15.144:0/2026223209 wait complete. 2024-09-11T23:24:37.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.673+0000 7f664ca00640 1 Processor -- start 2024-09-11T23:24:37.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.673+0000 7f664ca00640 1 -- start start 2024-09-11T23:24:37.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.674+0000 7f664ca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f664806ef60 0x7f6648159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:37.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.674+0000 7f664ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6648158e50 0x7f6648151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:37.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.674+0000 7f664ca00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f664815c370 0x7f66481528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:37.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.674+0000 7f664ca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6648159230 con 0x7f6648158e50 2024-09-11T23:24:37.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.674+0000 7f664ca00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f66480b3ed0 con 0x7f664815c370 2024-09-11T23:24:37.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.674+0000 7f664ca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f66480cf210 con 0x7f664806ef60 2024-09-11T23:24:37.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.675+0000 7f6645400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6648158e50 0x7f6648151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:37.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.675+0000 7f6645400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6648158e50 0x7f6648151dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38766/0 (socket says 172.21.15.144:38766) 2024-09-11T23:24:37.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.675+0000 7f6645400640 1 -- 172.21.15.144:0/2976974756 learned_addr learned my addr 172.21.15.144:0/2976974756 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:37.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.675+0000 7f6645e00640 1 --2- 172.21.15.144:0/2976974756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f664806ef60 0x7f6648159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:37.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.675+0000 7f6646800640 1 --2- 172.21.15.144:0/2976974756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f664815c370 0x7f66481528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:37.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.675+0000 7f6645400640 1 -- 172.21.15.144:0/2976974756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f664806ef60 msgr2=0x7f6648159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:37.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.675+0000 7f6645400640 1 --2- 172.21.15.144:0/2976974756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f664806ef60 0x7f6648159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:37.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.675+0000 7f6645400640 1 -- 172.21.15.144:0/2976974756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f664815c370 msgr2=0x7f66481528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:37.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.675+0000 7f6645400640 1 --2- 172.21.15.144:0/2976974756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f664815c370 0x7f66481528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:37.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.675+0000 7f6645400640 1 -- 172.21.15.144:0/2976974756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664815ae70 con 0x7f6648158e50 2024-09-11T23:24:37.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.675+0000 7f6645400640 1 --2- 172.21.15.144:0/2976974756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6648158e50 0x7f6648151dc0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f6634000c00 tx=0x7f66340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:37.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.676+0000 7f663e000640 1 -- 172.21.15.144:0/2976974756 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6634043070 con 0x7f6648158e50 2024-09-11T23:24:37.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.676+0000 7f663e000640 1 -- 172.21.15.144:0/2976974756 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6634038040 con 0x7f6648158e50 2024-09-11T23:24:37.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.676+0000 7f663e000640 1 -- 172.21.15.144:0/2976974756 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6634037050 con 0x7f6648158e50 2024-09-11T23:24:37.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.676+0000 7f664ca00640 1 -- 172.21.15.144:0/2976974756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f664815b150 con 0x7f6648158e50 2024-09-11T23:24:37.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.676+0000 7f664ca00640 1 -- 172.21.15.144:0/2976974756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6648159830 con 0x7f6648158e50 2024-09-11T23:24:37.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.677+0000 7f664ca00640 1 -- 172.21.15.144:0/2976974756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f664806ea20 con 0x7f6648158e50 2024-09-11T23:24:37.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.678+0000 7f663e000640 1 -- 172.21.15.144:0/2976974756 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f6634046070 con 0x7f6648158e50 2024-09-11T23:24:37.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.679+0000 7f663e000640 1 --2- 172.21.15.144:0/2976974756 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f662806c3d0 0x7f662806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:37.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.679+0000 7f663e000640 1 -- 172.21.15.144:0/2976974756 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5609+0+0 (secure 0 0 0) 0x7f66340ab950 con 0x7f6648158e50 2024-09-11T23:24:37.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.679+0000 7f6645e00640 1 --2- 172.21.15.144:0/2976974756 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f662806c3d0 0x7f662806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:37.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.680+0000 7f6645e00640 1 --2- 172.21.15.144:0/2976974756 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f662806c3d0 0x7f662806e890 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6638006fd0 tx=0x7f6638008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:37.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.683+0000 7f663e000640 1 -- 172.21.15.144:0/2976974756 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6634079460 con 0x7f6648158e50 2024-09-11T23:24:37.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:37.893+0000 7f664ca00640 1 -- 172.21.15.144:0/2976974756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f66480727b0 con 0x7f6648158e50 2024-09-11T23:24:38.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.481+0000 7f663e000640 1 -- 172.21.15.144:0/2976974756 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v86) ==== 174+0+0 (secure 0 0 0) 0x7f663407d760 con 0x7f6648158e50 2024-09-11T23:24:38.481 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 20 and data pool 21 2024-09-11T23:24:38.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.486+0000 7f664ca00640 1 -- 172.21.15.144:0/2976974756 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f662806c3d0 msgr2=0x7f662806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:38.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.486+0000 7f664ca00640 1 --2- 172.21.15.144:0/2976974756 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f662806c3d0 0x7f662806e890 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6638006fd0 tx=0x7f6638008040 comp rx=0 tx=0).stop 2024-09-11T23:24:38.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.486+0000 7f664ca00640 1 -- 172.21.15.144:0/2976974756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6648158e50 msgr2=0x7f6648151dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:38.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.486+0000 7f664ca00640 1 --2- 172.21.15.144:0/2976974756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6648158e50 0x7f6648151dc0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f6634000c00 tx=0x7f66340046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:38.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.487+0000 7f664ca00640 1 -- 172.21.15.144:0/2976974756 shutdown_connections 2024-09-11T23:24:38.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.487+0000 7f664ca00640 1 --2- 172.21.15.144:0/2976974756 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f662806c3d0 0x7f662806e890 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:38.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.487+0000 7f664ca00640 1 --2- 172.21.15.144:0/2976974756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f664815c370 0x7f66481528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:38.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.487+0000 7f664ca00640 1 --2- 172.21.15.144:0/2976974756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6648158e50 0x7f6648151dc0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:38.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.487+0000 7f664ca00640 1 --2- 172.21.15.144:0/2976974756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f664806ef60 0x7f6648159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:38.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.487+0000 7f664ca00640 1 -- 172.21.15.144:0/2976974756 >> 172.21.15.144:0/2976974756 conn(0x7f664806bba0 msgr2=0x7f66480cf5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:38.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.488+0000 7f664ca00640 1 -- 172.21.15.144:0/2976974756 shutdown_connections 2024-09-11T23:24:38.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.489+0000 7f664ca00640 1 -- 172.21.15.144:0/2976974756 wait complete. 2024-09-11T23:24:38.531 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:24:38.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.686+0000 7f7725800640 1 Processor -- start 2024-09-11T23:24:38.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.687+0000 7f7725800640 1 -- start start 2024-09-11T23:24:38.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.688+0000 7f7725800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f772015c180 0x7f77200cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:38.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.688+0000 7f7725800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f77200ce230 0x7f77200cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:38.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.688+0000 7f7725800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77200ce740 con 0x7f77200cf5b0 2024-09-11T23:24:38.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.688+0000 7f7725800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7720072640 con 0x7f77200ce230 2024-09-11T23:24:38.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.688+0000 7f7725800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7720072920 con 0x7f772015c180 2024-09-11T23:24:38.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.688+0000 7f7716000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f77200ce230 0x7f77200cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:38.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.688+0000 7f7716000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f77200ce230 0x7f77200cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38772/0 (socket says 172.21.15.144:38772) 2024-09-11T23:24:38.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.688+0000 7f7716000640 1 -- 172.21.15.144:0/1637355185 learned_addr learned my addr 172.21.15.144:0/1637355185 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:38.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.688+0000 7f771ea00640 1 --2- 172.21.15.144:0/1637355185 >> v2:172.21.15.165:3300/0 conn(0x7f772015c180 0x7f77200cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:38.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.688+0000 7f7716000640 1 -- 172.21.15.144:0/1637355185 >> v2:172.21.15.165:3300/0 conn(0x7f772015c180 msgr2=0x7f77200cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:38.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.688+0000 7f7716000640 1 --2- 172.21.15.144:0/1637355185 >> v2:172.21.15.165:3300/0 conn(0x7f772015c180 0x7f77200cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:38.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.688+0000 7f7716000640 1 -- 172.21.15.144:0/1637355185 >> v1:172.21.15.165:6789/0 conn(0x7f77200cf5b0 legacy=0x7f7720073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:38.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.688+0000 7f7716000640 1 -- 172.21.15.144:0/1637355185 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7720072c00 con 0x7f77200ce230 2024-09-11T23:24:38.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.689+0000 7f771ea00640 1 --2- 172.21.15.144:0/1637355185 >> v2:172.21.15.165:3300/0 conn(0x7f772015c180 0x7f77200cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:24:38.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.689+0000 7f7716000640 1 --2- 172.21.15.144:0/1637355185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77200ce230 0x7f77200cf070 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f772006cc10 tx=0x7f770802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dee19897de72bc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:38.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.690+0000 7f771e000640 1 -- 172.21.15.144:0/1637355185 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7708037070 con 0x7f77200ce230 2024-09-11T23:24:38.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.690+0000 7f771e000640 1 -- 172.21.15.144:0/1637355185 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7708032440 con 0x7f77200ce230 2024-09-11T23:24:38.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.690+0000 7f771e000640 1 -- 172.21.15.144:0/1637355185 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7708032810 con 0x7f77200ce230 2024-09-11T23:24:38.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.690+0000 7f7725800640 1 -- 172.21.15.144:0/1637355185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77200ce230 msgr2=0x7f77200cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:38.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.690+0000 7f7725800640 1 --2- 172.21.15.144:0/1637355185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77200ce230 0x7f77200cf070 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f772006cc10 tx=0x7f770802a1a0 comp rx=0 tx=0).stop 2024-09-11T23:24:38.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.690+0000 7f7725800640 1 -- 172.21.15.144:0/1637355185 shutdown_connections 2024-09-11T23:24:38.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.690+0000 7f7725800640 1 --2- 172.21.15.144:0/1637355185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77200ce230 0x7f77200cf070 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:38.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.690+0000 7f7725800640 1 --2- 172.21.15.144:0/1637355185 >> v2:172.21.15.165:3300/0 conn(0x7f772015c180 0x7f77200cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:38.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.690+0000 7f7725800640 1 -- 172.21.15.144:0/1637355185 >> 172.21.15.144:0/1637355185 conn(0x7f7720062cc0 msgr2=0x7f772006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:38.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.690+0000 7f7725800640 1 -- 172.21.15.144:0/1637355185 shutdown_connections 2024-09-11T23:24:38.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.691+0000 7f7725800640 1 -- 172.21.15.144:0/1637355185 wait complete. 2024-09-11T23:24:38.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.692+0000 7f7725800640 1 Processor -- start 2024-09-11T23:24:38.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.692+0000 7f7725800640 1 -- start start 2024-09-11T23:24:38.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.693+0000 7f7725800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77200ce230 0x7f77201f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:38.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.693+0000 7f7725800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77200cf5b0 0x7f77201e7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:38.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.693+0000 7f7725800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f772015c180 0x7f77201e7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:38.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.693+0000 7f7725800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f772015c560 con 0x7f77200ce230 2024-09-11T23:24:38.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.693+0000 7f7725800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f77200722f0 con 0x7f772015c180 2024-09-11T23:24:38.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.693+0000 7f7725800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f772015c6e0 con 0x7f77200cf5b0 2024-09-11T23:24:38.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.693+0000 7f771ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77200ce230 0x7f77201f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:38.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.693+0000 7f771ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77200ce230 0x7f77201f2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38778/0 (socket says 172.21.15.144:38778) 2024-09-11T23:24:38.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.693+0000 7f771ea00640 1 -- 172.21.15.144:0/3861121259 learned_addr learned my addr 172.21.15.144:0/3861121259 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:38.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.694+0000 7f7716000640 1 --2- 172.21.15.144:0/3861121259 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77200cf5b0 0x7f77201e7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:38.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.694+0000 7f771f400640 1 --2- 172.21.15.144:0/3861121259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f772015c180 0x7f77201e7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:38.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.694+0000 7f771ea00640 1 -- 172.21.15.144:0/3861121259 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77200cf5b0 msgr2=0x7f77201e7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:38.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.694+0000 7f771ea00640 1 --2- 172.21.15.144:0/3861121259 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77200cf5b0 0x7f77201e7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:38.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.694+0000 7f771ea00640 1 -- 172.21.15.144:0/3861121259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f772015c180 msgr2=0x7f77201e7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:38.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.694+0000 7f771ea00640 1 --2- 172.21.15.144:0/3861121259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f772015c180 0x7f77201e7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:38.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.694+0000 7f771ea00640 1 -- 172.21.15.144:0/3861121259 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77201e6f90 con 0x7f77200ce230 2024-09-11T23:24:38.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.694+0000 7f771f400640 1 --2- 172.21.15.144:0/3861121259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f772015c180 0x7f77201e7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:38.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.694+0000 7f771ea00640 1 --2- 172.21.15.144:0/3861121259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77200ce230 0x7f77201f2130 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f771000c7f0 tx=0x7f771000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:38.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.694+0000 7f7717400640 1 -- 172.21.15.144:0/3861121259 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7710015070 con 0x7f77200ce230 2024-09-11T23:24:38.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.694+0000 7f7717400640 1 -- 172.21.15.144:0/3861121259 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7710007a30 con 0x7f77200ce230 2024-09-11T23:24:38.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.694+0000 7f7717400640 1 -- 172.21.15.144:0/3861121259 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7710007e00 con 0x7f77200ce230 2024-09-11T23:24:38.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.694+0000 7f7725800640 1 -- 172.21.15.144:0/3861121259 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f772015e340 con 0x7f77200ce230 2024-09-11T23:24:38.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.695+0000 7f7725800640 1 -- 172.21.15.144:0/3861121259 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77201e7510 con 0x7f77200ce230 2024-09-11T23:24:38.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.696+0000 7f7725800640 1 -- 172.21.15.144:0/3861121259 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77200cf070 con 0x7f77200ce230 2024-09-11T23:24:38.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.697+0000 7f7717400640 1 -- 172.21.15.144:0/3861121259 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f7710018070 con 0x7f77200ce230 2024-09-11T23:24:38.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.698+0000 7f7717400640 1 --2- 172.21.15.144:0/3861121259 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f76fc06c3d0 0x7f76fc06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:38.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.698+0000 7f7717400640 1 -- 172.21.15.144:0/3861121259 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f771008b8e0 con 0x7f77200ce230 2024-09-11T23:24:38.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.698+0000 7f7716000640 1 --2- 172.21.15.144:0/3861121259 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f76fc06c3d0 0x7f76fc06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:38.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.699+0000 7f7716000640 1 --2- 172.21.15.144:0/3861121259 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f76fc06c3d0 0x7f76fc06e890 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7708034000 tx=0x7f770802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:38.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.702+0000 7f7717400640 1 -- 172.21.15.144:0/3861121259 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7710059280 con 0x7f77200ce230 2024-09-11T23:24:38.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.877+0000 7f7725800640 1 -- 172.21.15.144:0/3861121259 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7720073150 con 0x7f77200ce230 2024-09-11T23:24:38.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.878+0000 7f7717400640 1 -- 172.21.15.144:0/3861121259 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) ==== 74+0+16776 (secure 0 0 0) 0x7f771005d580 con 0x7f77200ce230 2024-09-11T23:24:38.878 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:38.878 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":130,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:24:37.894942+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:24:35.685780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-11T23:24:36.890387+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:24:38.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.881+0000 7f7725800640 1 -- 172.21.15.144:0/3861121259 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f76fc06c3d0 msgr2=0x7f76fc06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:38.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.881+0000 7f7725800640 1 --2- 172.21.15.144:0/3861121259 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f76fc06c3d0 0x7f76fc06e890 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7708034000 tx=0x7f770802e000 comp rx=0 tx=0).stop 2024-09-11T23:24:38.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.881+0000 7f7725800640 1 -- 172.21.15.144:0/3861121259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77200ce230 msgr2=0x7f77201f2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:38.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.881+0000 7f7725800640 1 --2- 172.21.15.144:0/3861121259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77200ce230 0x7f77201f2130 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f771000c7f0 tx=0x7f771000cbf0 comp rx=0 tx=0).stop 2024-09-11T23:24:38.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.881+0000 7f7725800640 1 -- 172.21.15.144:0/3861121259 shutdown_connections 2024-09-11T23:24:38.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.881+0000 7f7725800640 1 --2- 172.21.15.144:0/3861121259 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f76fc06c3d0 0x7f76fc06e890 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:38.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.881+0000 7f7725800640 1 --2- 172.21.15.144:0/3861121259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f772015c180 0x7f77201e7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:38.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.881+0000 7f7725800640 1 --2- 172.21.15.144:0/3861121259 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77200cf5b0 0x7f77201e7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:38.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.881+0000 7f7725800640 1 --2- 172.21.15.144:0/3861121259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77200ce230 0x7f77201f2130 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:38.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.881+0000 7f7725800640 1 -- 172.21.15.144:0/3861121259 >> 172.21.15.144:0/3861121259 conn(0x7f7720062cc0 msgr2=0x7f772006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:38.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.881+0000 7f7725800640 1 -- 172.21.15.144:0/3861121259 shutdown_connections 2024-09-11T23:24:38.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:38.881+0000 7f7725800640 1 -- 172.21.15.144:0/3861121259 wait complete. 2024-09-11T23:24:38.897 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:24:39.050 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.051+0000 7fb623c00640 1 Processor -- start 2024-09-11T23:24:39.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.051+0000 7fb623c00640 1 -- start start 2024-09-11T23:24:39.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.052+0000 7fb623c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb61c15c180 0x7fb61c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:39.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.052+0000 7fb623c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb61c0ce230 0x7fb61c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:39.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.052+0000 7fb623c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb61c0ce740 con 0x7fb61c0cf5b0 2024-09-11T23:24:39.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.052+0000 7fb623c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb61c072640 con 0x7fb61c15c180 2024-09-11T23:24:39.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.052+0000 7fb623c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb61c072920 con 0x7fb61c0ce230 2024-09-11T23:24:39.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.052+0000 7fb621c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb61c0cf5b0 0x7fb61c073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54310/0 (socket says 172.21.15.144:54310) 2024-09-11T23:24:39.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.052+0000 7fb621c00640 1 -- 172.21.15.144:0/2282760128 learned_addr learned my addr 172.21.15.144:0/2282760128 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:39.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.052+0000 7fb621200640 1 --2- 172.21.15.144:0/2282760128 >> v2:172.21.15.144:3300/0 conn(0x7fb61c15c180 0x7fb61c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:39.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.052+0000 7fb61be00640 1 --2- 172.21.15.144:0/2282760128 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb61c0ce230 0x7fb61c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:39.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.053+0000 7fb621200640 1 -- 172.21.15.144:0/2282760128 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb61c0ce230 msgr2=0x7fb61c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:39.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.053+0000 7fb621200640 1 --2- 172.21.15.144:0/2282760128 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb61c0ce230 0x7fb61c0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:39.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.053+0000 7fb621200640 1 -- 172.21.15.144:0/2282760128 >> v1:172.21.15.144:6789/0 conn(0x7fb61c0cf5b0 legacy=0x7fb61c073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:39.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.053+0000 7fb61b400640 1 -- 172.21.15.144:0/2282760128 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1057363555 0 0) 0x7fb61c0ce740 con 0x7fb61c0cf5b0 2024-09-11T23:24:39.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.053+0000 7fb621200640 1 -- 172.21.15.144:0/2282760128 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61c072c00 con 0x7fb61c15c180 2024-09-11T23:24:39.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.054+0000 7fb621200640 1 --2- 172.21.15.144:0/2282760128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb61c15c180 0x7fb61c0cdcf0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009d90 tx=0x7fb60c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e5083395670c5e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:39.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.054+0000 7fb61b400640 1 -- 172.21.15.144:0/2282760128 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60c031600 con 0x7fb61c15c180 2024-09-11T23:24:39.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.054+0000 7fb61b400640 1 -- 172.21.15.144:0/2282760128 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb60c0317a0 con 0x7fb61c15c180 2024-09-11T23:24:39.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.054+0000 7fb61b400640 1 -- 172.21.15.144:0/2282760128 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60c031b70 con 0x7fb61c15c180 2024-09-11T23:24:39.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.054+0000 7fb623c00640 1 -- 172.21.15.144:0/2282760128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb61c15c180 msgr2=0x7fb61c0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:39.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.054+0000 7fb623c00640 1 --2- 172.21.15.144:0/2282760128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb61c15c180 0x7fb61c0cdcf0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009d90 tx=0x7fb60c02a5d0 comp rx=0 tx=0).stop 2024-09-11T23:24:39.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.055+0000 7fb623c00640 1 -- 172.21.15.144:0/2282760128 shutdown_connections 2024-09-11T23:24:39.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.055+0000 7fb623c00640 1 --2- 172.21.15.144:0/2282760128 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb61c0ce230 0x7fb61c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:39.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.055+0000 7fb623c00640 1 --2- 172.21.15.144:0/2282760128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb61c15c180 0x7fb61c0cdcf0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:39.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.055+0000 7fb623c00640 1 -- 172.21.15.144:0/2282760128 >> 172.21.15.144:0/2282760128 conn(0x7fb61c062cc0 msgr2=0x7fb61c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:39.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.055+0000 7fb623c00640 1 -- 172.21.15.144:0/2282760128 shutdown_connections 2024-09-11T23:24:39.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.055+0000 7fb623c00640 1 -- 172.21.15.144:0/2282760128 wait complete. 2024-09-11T23:24:39.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.056+0000 7fb623c00640 1 Processor -- start 2024-09-11T23:24:39.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.056+0000 7fb623c00640 1 -- start start 2024-09-11T23:24:39.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.057+0000 7fb623c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb61c0ce230 0x7fb61c149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:39.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.057+0000 7fb623c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb61c0cf5b0 0x7fb61c147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:39.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.057+0000 7fb623c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb61c15c180 0x7fb61c147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:39.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.057+0000 7fb623c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c15c560 con 0x7fb61c0cf5b0 2024-09-11T23:24:39.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.057+0000 7fb623c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c0722f0 con 0x7fb61c0ce230 2024-09-11T23:24:39.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.057+0000 7fb623c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb61c15c6e0 con 0x7fb61c15c180 2024-09-11T23:24:39.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.058+0000 7fb61be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb61c0cf5b0 0x7fb61c147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:39.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.058+0000 7fb61be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb61c0cf5b0 0x7fb61c147710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38794/0 (socket says 172.21.15.144:38794) 2024-09-11T23:24:39.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.058+0000 7fb61be00640 1 -- 172.21.15.144:0/3125366250 learned_addr learned my addr 172.21.15.144:0/3125366250 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:39.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.058+0000 7fb621200640 1 --2- 172.21.15.144:0/3125366250 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb61c0ce230 0x7fb61c149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:39.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.058+0000 7fb621c00640 1 --2- 172.21.15.144:0/3125366250 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb61c15c180 0x7fb61c147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:39.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.058+0000 7fb61be00640 1 -- 172.21.15.144:0/3125366250 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb61c15c180 msgr2=0x7fb61c147f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:39.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.058+0000 7fb61be00640 1 --2- 172.21.15.144:0/3125366250 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb61c15c180 0x7fb61c147f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:39.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.058+0000 7fb61be00640 1 -- 172.21.15.144:0/3125366250 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb61c0ce230 msgr2=0x7fb61c149ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:39.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.058+0000 7fb61be00640 1 --2- 172.21.15.144:0/3125366250 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb61c0ce230 0x7fb61c149ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:39.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.058+0000 7fb61be00640 1 -- 172.21.15.144:0/3125366250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61c1f7750 con 0x7fb61c0cf5b0 2024-09-11T23:24:39.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.058+0000 7fb621200640 1 --2- 172.21.15.144:0/3125366250 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb61c0ce230 0x7fb61c149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:39.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.058+0000 7fb621c00640 1 --2- 172.21.15.144:0/3125366250 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb61c15c180 0x7fb61c147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:39.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.058+0000 7fb61be00640 1 --2- 172.21.15.144:0/3125366250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb61c0cf5b0 0x7fb61c147710 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fb60800e840 tx=0x7fb60800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:39.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.058+0000 7fb618c00640 1 -- 172.21.15.144:0/3125366250 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb608017070 con 0x7fb61c0cf5b0 2024-09-11T23:24:39.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.058+0000 7fb618c00640 1 -- 172.21.15.144:0/3125366250 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb60800c940 con 0x7fb61c0cf5b0 2024-09-11T23:24:39.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.058+0000 7fb618c00640 1 -- 172.21.15.144:0/3125366250 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60800cd10 con 0x7fb61c0cf5b0 2024-09-11T23:24:39.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.059+0000 7fb623c00640 1 -- 172.21.15.144:0/3125366250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb61c147c50 con 0x7fb61c0cf5b0 2024-09-11T23:24:39.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.059+0000 7fb623c00640 1 -- 172.21.15.144:0/3125366250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb61c14a8b0 con 0x7fb61c0cf5b0 2024-09-11T23:24:39.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.060+0000 7fb623c00640 1 -- 172.21.15.144:0/3125366250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb61c0cf070 con 0x7fb61c0cf5b0 2024-09-11T23:24:39.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.061+0000 7fb618c00640 1 -- 172.21.15.144:0/3125366250 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7fb60801a070 con 0x7fb61c0cf5b0 2024-09-11T23:24:39.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.061+0000 7fb618c00640 1 --2- 172.21.15.144:0/3125366250 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb5fc06c3d0 0x7fb5fc06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:39.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.062+0000 7fb618c00640 1 -- 172.21.15.144:0/3125366250 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fb60808b660 con 0x7fb61c0cf5b0 2024-09-11T23:24:39.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.062+0000 7fb621200640 1 --2- 172.21.15.144:0/3125366250 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb5fc06c3d0 0x7fb5fc06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:39.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.063+0000 7fb621200640 1 --2- 172.21.15.144:0/3125366250 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb5fc06c3d0 0x7fb5fc06e890 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb60c034000 tx=0x7fb60c02f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:39.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.065+0000 7fb618c00640 1 -- 172.21.15.144:0/3125366250 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb6080598b0 con 0x7fb61c0cf5b0 2024-09-11T23:24:39.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.243+0000 7fb623c00640 1 -- 172.21.15.144:0/3125366250 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb61c0afa10 con 0x7fb61c0cf5b0 2024-09-11T23:24:39.244 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.244+0000 7fb618c00640 1 -- 172.21.15.144:0/3125366250 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) ==== 74+0+16776 (secure 0 0 0) 0x7fb6080591b0 con 0x7fb61c0cf5b0 2024-09-11T23:24:39.244 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:39.245 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":130,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:24:37.894942+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:24:35.685780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-11T23:24:36.890387+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:24:39.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.247+0000 7fb623c00640 1 -- 172.21.15.144:0/3125366250 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb5fc06c3d0 msgr2=0x7fb5fc06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:39.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.247+0000 7fb623c00640 1 --2- 172.21.15.144:0/3125366250 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb5fc06c3d0 0x7fb5fc06e890 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb60c034000 tx=0x7fb60c02f000 comp rx=0 tx=0).stop 2024-09-11T23:24:39.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.247+0000 7fb623c00640 1 -- 172.21.15.144:0/3125366250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb61c0cf5b0 msgr2=0x7fb61c147710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:39.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.247+0000 7fb623c00640 1 --2- 172.21.15.144:0/3125366250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb61c0cf5b0 0x7fb61c147710 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fb60800e840 tx=0x7fb60800ed00 comp rx=0 tx=0).stop 2024-09-11T23:24:39.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.247+0000 7fb623c00640 1 -- 172.21.15.144:0/3125366250 shutdown_connections 2024-09-11T23:24:39.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.247+0000 7fb623c00640 1 --2- 172.21.15.144:0/3125366250 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb5fc06c3d0 0x7fb5fc06e890 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:39.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.247+0000 7fb623c00640 1 --2- 172.21.15.144:0/3125366250 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb61c15c180 0x7fb61c147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:39.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.247+0000 7fb623c00640 1 --2- 172.21.15.144:0/3125366250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb61c0cf5b0 0x7fb61c147710 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:39.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.247+0000 7fb623c00640 1 --2- 172.21.15.144:0/3125366250 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb61c0ce230 0x7fb61c149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:39.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.247+0000 7fb623c00640 1 -- 172.21.15.144:0/3125366250 >> 172.21.15.144:0/3125366250 conn(0x7fb61c062cc0 msgr2=0x7fb61c0afe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:39.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.247+0000 7fb623c00640 1 -- 172.21.15.144:0/3125366250 shutdown_connections 2024-09-11T23:24:39.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.247+0000 7fb623c00640 1 -- 172.21.15.144:0/3125366250 wait complete. 2024-09-11T23:24:39.263 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:24:39.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.418+0000 7fc137e00640 1 Processor -- start 2024-09-11T23:24:39.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.418+0000 7fc137e00640 1 -- start start 2024-09-11T23:24:39.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.419+0000 7fc137e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc13806d610 0x7fc13806d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:39.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.419+0000 7fc137e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc13815eaa0 con 0x7fc13815e6c0 2024-09-11T23:24:39.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.419+0000 7fc137e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc13806df30 con 0x7fc1380cf510 2024-09-11T23:24:39.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.419+0000 7fc137e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc1380d34d0 con 0x7fc13806d610 2024-09-11T23:24:39.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.419+0000 7fc136a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc13815e6c0 0x7fc13806c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54322/0 (socket says 172.21.15.144:54322) 2024-09-11T23:24:39.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.420+0000 7fc136a00640 1 -- 172.21.15.144:0/2245732767 learned_addr learned my addr 172.21.15.144:0/2245732767 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:39.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.420+0000 7fc137400640 1 --2- 172.21.15.144:0/2245732767 >> v2:172.21.15.165:3300/0 conn(0x7fc13806d610 0x7fc13806d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:39.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.420+0000 7fc135600640 1 -- 172.21.15.144:0/2245732767 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 424279642 0 0) 0x7fc13815eaa0 con 0x7fc13815e6c0 2024-09-11T23:24:39.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.420+0000 7fc135600640 1 -- 172.21.15.144:0/2245732767 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc11c003520 con 0x7fc13815e6c0 2024-09-11T23:24:39.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.420+0000 7fc137400640 1 -- 172.21.15.144:0/2245732767 >> v1:172.21.15.165:6789/0 conn(0x7fc1380cf510 legacy=0x7fc1380b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:39.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.420+0000 7fc135600640 1 -- 172.21.15.144:0/2245732767 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 329077437 0 0) 0x7fc11c003520 con 0x7fc13815e6c0 2024-09-11T23:24:39.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.420+0000 7fc137400640 1 -- 172.21.15.144:0/2245732767 >> v1:172.21.15.144:6789/0 conn(0x7fc13815e6c0 legacy=0x7fc13806c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:39.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.420+0000 7fc137400640 1 -- 172.21.15.144:0/2245732767 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1380d28c0 con 0x7fc13806d610 2024-09-11T23:24:39.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.421+0000 7fc137400640 1 --2- 172.21.15.144:0/2245732767 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc13806d610 0x7fc13806d9f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc130009d90 tx=0x7fc13002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8e54a70a767f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:39.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.422+0000 7fc135600640 1 -- 172.21.15.144:0/2245732767 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128001690 con 0x7fc13806d610 2024-09-11T23:24:39.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.422+0000 7fc135600640 1 -- 172.21.15.144:0/2245732767 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc130007540 con 0x7fc13806d610 2024-09-11T23:24:39.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.422+0000 7fc135600640 1 -- 172.21.15.144:0/2245732767 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1300078f0 con 0x7fc13806d610 2024-09-11T23:24:39.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.422+0000 7fc137e00640 1 -- 172.21.15.144:0/2245732767 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc13806d610 msgr2=0x7fc13806d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:39.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.422+0000 7fc137e00640 1 --2- 172.21.15.144:0/2245732767 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc13806d610 0x7fc13806d9f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc130009d90 tx=0x7fc13002a680 comp rx=0 tx=0).stop 2024-09-11T23:24:39.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.422+0000 7fc137e00640 1 -- 172.21.15.144:0/2245732767 shutdown_connections 2024-09-11T23:24:39.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.422+0000 7fc137e00640 1 --2- 172.21.15.144:0/2245732767 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc13806d610 0x7fc13806d9f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:39.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.422+0000 7fc137e00640 1 -- 172.21.15.144:0/2245732767 >> 172.21.15.144:0/2245732767 conn(0x7fc1380d4720 msgr2=0x7fc1380d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:39.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.422+0000 7fc137e00640 1 -- 172.21.15.144:0/2245732767 shutdown_connections 2024-09-11T23:24:39.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.422+0000 7fc137e00640 1 -- 172.21.15.144:0/2245732767 wait complete. 2024-09-11T23:24:39.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.424+0000 7fc137e00640 1 Processor -- start 2024-09-11T23:24:39.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.424+0000 7fc137e00640 1 -- start start 2024-09-11T23:24:39.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.425+0000 7fc137e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc13806d610 0x7fc1380ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:39.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.425+0000 7fc137e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1380cf510 0x7fc1380cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:39.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.425+0000 7fc137e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc13815e6c0 0x7fc1380cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:39.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.425+0000 7fc137e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc1380d3160 con 0x7fc13815e6c0 2024-09-11T23:24:39.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.425+0000 7fc137e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc1380d2e80 con 0x7fc13806d610 2024-09-11T23:24:39.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.425+0000 7fc137e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc1380b7d80 con 0x7fc1380cf510 2024-09-11T23:24:39.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.425+0000 7fc137400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc13815e6c0 0x7fc1380cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:39.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.425+0000 7fc137400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc13815e6c0 0x7fc1380cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38802/0 (socket says 172.21.15.144:38802) 2024-09-11T23:24:39.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.425+0000 7fc137400640 1 -- 172.21.15.144:0/2382649772 learned_addr learned my addr 172.21.15.144:0/2382649772 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:39.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.425+0000 7fc136a00640 1 --2- 172.21.15.144:0/2382649772 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc13806d610 0x7fc1380ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:39.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.425+0000 7fc136000640 1 --2- 172.21.15.144:0/2382649772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1380cf510 0x7fc1380cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:39.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.426+0000 7fc137400640 1 -- 172.21.15.144:0/2382649772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1380cf510 msgr2=0x7fc1380cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:39.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.426+0000 7fc137400640 1 --2- 172.21.15.144:0/2382649772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1380cf510 0x7fc1380cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:39.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.426+0000 7fc137400640 1 -- 172.21.15.144:0/2382649772 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc13806d610 msgr2=0x7fc1380ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:39.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.426+0000 7fc137400640 1 --2- 172.21.15.144:0/2382649772 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc13806d610 0x7fc1380ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:39.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.426+0000 7fc137400640 1 -- 172.21.15.144:0/2382649772 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc138159440 con 0x7fc13815e6c0 2024-09-11T23:24:39.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.426+0000 7fc136000640 1 --2- 172.21.15.144:0/2382649772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1380cf510 0x7fc1380cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:39.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.426+0000 7fc137400640 1 --2- 172.21.15.144:0/2382649772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc13815e6c0 0x7fc1380cc4c0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fc130009eb0 tx=0x7fc130004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:39.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.426+0000 7fc12f400640 1 -- 172.21.15.144:0/2382649772 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc130009450 con 0x7fc13815e6c0 2024-09-11T23:24:39.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.426+0000 7fc12f400640 1 -- 172.21.15.144:0/2382649772 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc130004240 con 0x7fc13815e6c0 2024-09-11T23:24:39.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.426+0000 7fc12f400640 1 -- 172.21.15.144:0/2382649772 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1300045f0 con 0x7fc13815e6c0 2024-09-11T23:24:39.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.426+0000 7fc137e00640 1 -- 172.21.15.144:0/2382649772 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc138159720 con 0x7fc13815e6c0 2024-09-11T23:24:39.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.426+0000 7fc137e00640 1 -- 172.21.15.144:0/2382649772 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc138159ce0 con 0x7fc13815e6c0 2024-09-11T23:24:39.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.427+0000 7fc137e00640 1 -- 172.21.15.144:0/2382649772 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc13806d9f0 con 0x7fc13815e6c0 2024-09-11T23:24:39.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.428+0000 7fc12f400640 1 -- 172.21.15.144:0/2382649772 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7fc130039040 con 0x7fc13815e6c0 2024-09-11T23:24:39.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.429+0000 7fc12f400640 1 --2- 172.21.15.144:0/2382649772 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc11806c3d0 0x7fc11806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:39.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.429+0000 7fc12f400640 1 -- 172.21.15.144:0/2382649772 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fc1300accb0 con 0x7fc13815e6c0 2024-09-11T23:24:39.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.430+0000 7fc136a00640 1 --2- 172.21.15.144:0/2382649772 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc11806c3d0 0x7fc11806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:39.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.430+0000 7fc136a00640 1 --2- 172.21.15.144:0/2382649772 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc11806c3d0 0x7fc11806e890 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc128001eb0 tx=0x7fc128001c60 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:39.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.434+0000 7fc12f400640 1 -- 172.21.15.144:0/2382649772 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc130040030 con 0x7fc13815e6c0 2024-09-11T23:24:39.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:39.645+0000 7fc137e00640 1 -- 172.21.15.144:0/2382649772 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc1380d2600 con 0x7fc13815e6c0 2024-09-11T23:24:40.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-11T23:24:40.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.511+0000 7fc12f400640 1 -- 172.21.15.144:0/2382649772 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v89) ==== 118+0+0 (secure 0 0 0) 0x7fc13007ad30 con 0x7fc13815e6c0 2024-09-11T23:24:40.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.514+0000 7fc137e00640 1 -- 172.21.15.144:0/2382649772 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc11806c3d0 msgr2=0x7fc11806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:40.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.514+0000 7fc137e00640 1 --2- 172.21.15.144:0/2382649772 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc11806c3d0 0x7fc11806e890 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc128001eb0 tx=0x7fc128001c60 comp rx=0 tx=0).stop 2024-09-11T23:24:40.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.514+0000 7fc137e00640 1 -- 172.21.15.144:0/2382649772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc13815e6c0 msgr2=0x7fc1380cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:40.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.514+0000 7fc137e00640 1 --2- 172.21.15.144:0/2382649772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc13815e6c0 0x7fc1380cc4c0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fc130009eb0 tx=0x7fc130004a40 comp rx=0 tx=0).stop 2024-09-11T23:24:40.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.514+0000 7fc137e00640 1 -- 172.21.15.144:0/2382649772 shutdown_connections 2024-09-11T23:24:40.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.514+0000 7fc137e00640 1 --2- 172.21.15.144:0/2382649772 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc11806c3d0 0x7fc11806e890 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:40.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.514+0000 7fc137e00640 1 --2- 172.21.15.144:0/2382649772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc13815e6c0 0x7fc1380cc4c0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:40.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.514+0000 7fc137e00640 1 --2- 172.21.15.144:0/2382649772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc1380cf510 0x7fc1380cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:40.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.514+0000 7fc137e00640 1 --2- 172.21.15.144:0/2382649772 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc13806d610 0x7fc1380ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:40.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.514+0000 7fc137e00640 1 -- 172.21.15.144:0/2382649772 >> 172.21.15.144:0/2382649772 conn(0x7fc1380d4720 msgr2=0x7fc1380cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:40.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.514+0000 7fc137e00640 1 -- 172.21.15.144:0/2382649772 shutdown_connections 2024-09-11T23:24:40.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.514+0000 7fc137e00640 1 -- 172.21.15.144:0/2382649772 wait complete. 2024-09-11T23:24:40.532 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:24:40.532 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:24:40.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.692+0000 7f7803200640 1 Processor -- start 2024-09-11T23:24:40.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.692+0000 7f7803200640 1 -- start start 2024-09-11T23:24:40.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.693+0000 7f7803200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77fc15e240 0x7f77fc0b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:40.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.693+0000 7f7803200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f77fc06bba0 0x7f77fc06bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:40.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.693+0000 7f7803200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77fc0b3ac0 con 0x7f77fc15e620 2024-09-11T23:24:40.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.693+0000 7f7803200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f77fc06c510 con 0x7f77fc06bba0 2024-09-11T23:24:40.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.693+0000 7f7803200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f77fc0b3d50 con 0x7f77fc15e240 2024-09-11T23:24:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.694+0000 7f7801e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77fc15e240 0x7f77fc0b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.694+0000 7f7802800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f77fc06bba0 0x7f77fc06bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.694+0000 7f7801e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77fc15e240 0x7f77fc0b4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:53598/0 (socket says 172.21.15.144:53598) 2024-09-11T23:24:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.694+0000 7f7802800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f77fc06bba0 0x7f77fc06bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:40536/0 (socket says 172.21.15.144:40536) 2024-09-11T23:24:40.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.694+0000 7f7801e00640 1 -- 172.21.15.144:0/48431885 learned_addr learned my addr 172.21.15.144:0/48431885 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:40.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.694+0000 7f7801e00640 1 -- 172.21.15.144:0/48431885 >> v2:172.21.15.165:3300/0 conn(0x7f77fc06bba0 msgr2=0x7f77fc06bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:40.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.694+0000 7f7801e00640 1 --2- 172.21.15.144:0/48431885 >> v2:172.21.15.165:3300/0 conn(0x7f77fc06bba0 0x7f77fc06bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:40.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.694+0000 7f7801e00640 1 -- 172.21.15.144:0/48431885 >> v1:172.21.15.165:6789/0 conn(0x7f77fc15e620 legacy=0x7f77fc0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:40.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.695+0000 7f7801e00640 1 -- 172.21.15.144:0/48431885 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77fc0b4030 con 0x7f77fc15e240 2024-09-11T23:24:40.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.695+0000 7f7802800640 1 --2- 172.21.15.144:0/48431885 >> v2:172.21.15.165:3300/0 conn(0x7f77fc06bba0 0x7f77fc06bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:24:40.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.696+0000 7f7801e00640 1 --2- 172.21.15.144:0/48431885 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77fc15e240 0x7f77fc0b4df0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f77f0009870 tx=0x7f77f002a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf488c7a6ade1c4f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:40.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.696+0000 7f7800a00640 1 -- 172.21.15.144:0/48431885 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f0037070 con 0x7f77fc15e240 2024-09-11T23:24:40.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.696+0000 7f7800a00640 1 -- 172.21.15.144:0/48431885 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f0032440 con 0x7f77fc15e240 2024-09-11T23:24:40.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.696+0000 7f7800a00640 1 -- 172.21.15.144:0/48431885 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f0032810 con 0x7f77fc15e240 2024-09-11T23:24:40.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.696+0000 7f7803200640 1 -- 172.21.15.144:0/48431885 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77fc15e240 msgr2=0x7f77fc0b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.696+0000 7f7803200640 1 --2- 172.21.15.144:0/48431885 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77fc15e240 0x7f77fc0b4df0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f77f0009870 tx=0x7f77f002a1e0 comp rx=0 tx=0).stop 2024-09-11T23:24:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.696+0000 7f7803200640 1 -- 172.21.15.144:0/48431885 shutdown_connections 2024-09-11T23:24:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.696+0000 7f7803200640 1 --2- 172.21.15.144:0/48431885 >> v2:172.21.15.165:3300/0 conn(0x7f77fc06bba0 0x7f77fc06bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.696+0000 7f7803200640 1 --2- 172.21.15.144:0/48431885 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77fc15e240 0x7f77fc0b4df0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.696+0000 7f7803200640 1 -- 172.21.15.144:0/48431885 >> 172.21.15.144:0/48431885 conn(0x7f77fc0d0300 msgr2=0x7f77fc0d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.697+0000 7f7803200640 1 -- 172.21.15.144:0/48431885 shutdown_connections 2024-09-11T23:24:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.697+0000 7f7803200640 1 -- 172.21.15.144:0/48431885 wait complete. 2024-09-11T23:24:40.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.698+0000 7f7803200640 1 Processor -- start 2024-09-11T23:24:40.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.698+0000 7f7803200640 1 -- start start 2024-09-11T23:24:40.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.699+0000 7f7803200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77fc06bba0 0x7f77fc145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.699+0000 7f7803200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77fc15e240 0x7f77fc160e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.699+0000 7f7803200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77fc15e620 0x7f77fc073940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.699+0000 7f7803200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc0b48d0 con 0x7f77fc15e240 2024-09-11T23:24:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.699+0000 7f7803200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f77fc0b45f0 con 0x7f77fc06bba0 2024-09-11T23:24:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.699+0000 7f7803200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f77fc162d50 con 0x7f77fc15e620 2024-09-11T23:24:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.699+0000 7f7801400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77fc15e240 0x7f77fc160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.699+0000 7f7801400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77fc15e240 0x7f77fc160e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38810/0 (socket says 172.21.15.144:38810) 2024-09-11T23:24:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.699+0000 7f7801e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77fc06bba0 0x7f77fc145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.699+0000 7f7801400640 1 -- 172.21.15.144:0/2822507503 learned_addr learned my addr 172.21.15.144:0/2822507503 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.699+0000 7f7802800640 1 --2- 172.21.15.144:0/2822507503 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77fc15e620 0x7f77fc073940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.700+0000 7f7801400640 1 -- 172.21.15.144:0/2822507503 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77fc15e620 msgr2=0x7f77fc073940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:40.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.700+0000 7f7801400640 1 --2- 172.21.15.144:0/2822507503 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77fc15e620 0x7f77fc073940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:40.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.700+0000 7f7801400640 1 -- 172.21.15.144:0/2822507503 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77fc06bba0 msgr2=0x7f77fc145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:40.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.700+0000 7f7801400640 1 --2- 172.21.15.144:0/2822507503 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77fc06bba0 0x7f77fc145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:40.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.700+0000 7f7801400640 1 -- 172.21.15.144:0/2822507503 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77fc15fab0 con 0x7f77fc15e240 2024-09-11T23:24:40.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.700+0000 7f7801400640 1 --2- 172.21.15.144:0/2822507503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77fc15e240 0x7f77fc160e30 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00c430 tx=0x7f77ec00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:40.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.700+0000 7f77f6000640 1 -- 172.21.15.144:0/2822507503 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec0052d0 con 0x7f77fc15e240 2024-09-11T23:24:40.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.700+0000 7f77f6000640 1 -- 172.21.15.144:0/2822507503 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77ec005490 con 0x7f77fc15e240 2024-09-11T23:24:40.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.700+0000 7f77f6000640 1 -- 172.21.15.144:0/2822507503 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec007260 con 0x7f77fc15e240 2024-09-11T23:24:40.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.700+0000 7f7803200640 1 -- 172.21.15.144:0/2822507503 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77fc15fd90 con 0x7f77fc15e240 2024-09-11T23:24:40.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.701+0000 7f7803200640 1 -- 172.21.15.144:0/2822507503 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77fc160350 con 0x7f77fc15e240 2024-09-11T23:24:40.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.701+0000 7f7803200640 1 -- 172.21.15.144:0/2822507503 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77fc06bfd0 con 0x7f77fc15e240 2024-09-11T23:24:40.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.702+0000 7f77f6000640 1 -- 172.21.15.144:0/2822507503 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f77ec007400 con 0x7f77fc15e240 2024-09-11T23:24:40.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.704+0000 7f77f6000640 1 --2- 172.21.15.144:0/2822507503 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f77e006c3d0 0x7f77e006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:40.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.704+0000 7f77f6000640 1 -- 172.21.15.144:0/2822507503 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f77ec08ac50 con 0x7f77fc15e240 2024-09-11T23:24:40.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.704+0000 7f7801e00640 1 --2- 172.21.15.144:0/2822507503 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f77e006c3d0 0x7f77e006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:40.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.705+0000 7f7801e00640 1 --2- 172.21.15.144:0/2822507503 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f77e006c3d0 0x7f77e006e890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f77f0034000 tx=0x7f77f002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:40.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.708+0000 7f77f6000640 1 -- 172.21.15.144:0/2822507503 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f77ec058790 con 0x7f77fc15e240 2024-09-11T23:24:40.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:40.917+0000 7f7803200640 1 -- 172.21.15.144:0/2822507503 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f77fc15d2c0 con 0x7f77fc15e240 2024-09-11T23:24:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.519+0000 7f77f6000640 1 -- 172.21.15.144:0/2822507503 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v90) ==== 122+0+0 (secure 0 0 0) 0x7f77ec05ca90 con 0x7f77fc15e240 2024-09-11T23:24:41.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.522+0000 7f7803200640 1 -- 172.21.15.144:0/2822507503 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f77e006c3d0 msgr2=0x7f77e006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:41.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.522+0000 7f7803200640 1 --2- 172.21.15.144:0/2822507503 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f77e006c3d0 0x7f77e006e890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f77f0034000 tx=0x7f77f002e000 comp rx=0 tx=0).stop 2024-09-11T23:24:41.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.522+0000 7f7803200640 1 -- 172.21.15.144:0/2822507503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77fc15e240 msgr2=0x7f77fc160e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:41.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.522+0000 7f7803200640 1 --2- 172.21.15.144:0/2822507503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77fc15e240 0x7f77fc160e30 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00c430 tx=0x7f77ec00c830 comp rx=0 tx=0).stop 2024-09-11T23:24:41.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.522+0000 7f7803200640 1 -- 172.21.15.144:0/2822507503 shutdown_connections 2024-09-11T23:24:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.522+0000 7f7803200640 1 --2- 172.21.15.144:0/2822507503 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f77e006c3d0 0x7f77e006e890 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.522+0000 7f7803200640 1 --2- 172.21.15.144:0/2822507503 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f77fc15e620 0x7f77fc073940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.522+0000 7f7803200640 1 --2- 172.21.15.144:0/2822507503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77fc15e240 0x7f77fc160e30 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.522+0000 7f7803200640 1 --2- 172.21.15.144:0/2822507503 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77fc06bba0 0x7f77fc145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.522+0000 7f7803200640 1 -- 172.21.15.144:0/2822507503 >> 172.21.15.144:0/2822507503 conn(0x7f77fc0d0300 msgr2=0x7f77fc0d0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.522+0000 7f7803200640 1 -- 172.21.15.144:0/2822507503 shutdown_connections 2024-09-11T23:24:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.522+0000 7f7803200640 1 -- 172.21.15.144:0/2822507503 wait complete. 2024-09-11T23:24:41.541 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:24:41.541 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:24:41.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.699+0000 7fae23400640 1 Processor -- start 2024-09-11T23:24:41.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.699+0000 7fae23400640 1 -- start start 2024-09-11T23:24:41.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.700+0000 7fae23400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fae1c151c50 0x7fae1c0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:41.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.700+0000 7fae23400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae1c0cd5f0 con 0x7fae1c06be10 2024-09-11T23:24:41.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.700+0000 7fae23400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae1c0cd8d0 con 0x7fae1c06c1f0 2024-09-11T23:24:41.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.700+0000 7fae23400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fae1c0cdbb0 con 0x7fae1c151c50 2024-09-11T23:24:41.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.701+0000 7fae20a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fae1c06be10 0x7fae1c151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54324/0 (socket says 172.21.15.144:54324) 2024-09-11T23:24:41.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.701+0000 7fae20a00640 1 -- 172.21.15.144:0/2775905870 learned_addr learned my addr 172.21.15.144:0/2775905870 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:41.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.701+0000 7fae13e00640 1 --2- 172.21.15.144:0/2775905870 >> v2:172.21.15.165:3300/0 conn(0x7fae1c151c50 0x7fae1c0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:41.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.701+0000 7fae1be00640 1 -- 172.21.15.144:0/2775905870 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 862594043 0 0) 0x7fae1c0cd5f0 con 0x7fae1c06be10 2024-09-11T23:24:41.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.701+0000 7fae1be00640 1 -- 172.21.15.144:0/2775905870 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae00003520 con 0x7fae1c06be10 2024-09-11T23:24:41.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.701+0000 7fae1be00640 1 -- 172.21.15.144:0/2775905870 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1609178145 0 0) 0x7fae00003520 con 0x7fae1c06be10 2024-09-11T23:24:41.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.701+0000 7fae1be00640 1 -- 172.21.15.144:0/2775905870 >> v2:172.21.15.165:3300/0 conn(0x7fae1c151c50 msgr2=0x7fae1c0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:41.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.701+0000 7fae1be00640 1 --2- 172.21.15.144:0/2775905870 >> v2:172.21.15.165:3300/0 conn(0x7fae1c151c50 0x7fae1c0cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:41.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.701+0000 7fae1be00640 1 -- 172.21.15.144:0/2775905870 >> v1:172.21.15.165:6789/0 conn(0x7fae1c06c1f0 legacy=0x7fae1c164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:41.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.701+0000 7fae1be00640 1 -- 172.21.15.144:0/2775905870 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1c0cde90 con 0x7fae1c06be10 2024-09-11T23:24:41.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.701+0000 7fae1be00640 1 -- 172.21.15.144:0/2775905870 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fae0c001670 con 0x7fae1c06be10 2024-09-11T23:24:41.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.701+0000 7fae1be00640 1 -- 172.21.15.144:0/2775905870 >> v1:172.21.15.144:6789/0 conn(0x7fae1c06be10 legacy=0x7fae1c151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:41.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.701+0000 7fae1be00640 1 --2- 172.21.15.144:0/2775905870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae000039b0 0x7fae00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:41.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.701+0000 7fae1be00640 1 --2- 172.21.15.144:0/2775905870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae00004800 0x7fae00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:41.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.702+0000 7fae1be00640 1 --2- 172.21.15.144:0/2775905870 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae000051c0 0x7fae0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:41.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.702+0000 7fae1be00640 1 -- 172.21.15.144:0/2775905870 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c0cdbb0 con 0x7fae000039b0 2024-09-11T23:24:41.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.702+0000 7fae1be00640 1 -- 172.21.15.144:0/2775905870 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fae0000c060 con 0x7fae00004800 2024-09-11T23:24:41.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.702+0000 7fae1be00640 1 -- 172.21.15.144:0/2775905870 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fae0000c260 con 0x7fae000051c0 2024-09-11T23:24:41.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.702+0000 7fae20a00640 1 --2- 172.21.15.144:0/2775905870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae000039b0 0x7fae00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:41.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.702+0000 7fae13e00640 1 --2- 172.21.15.144:0/2775905870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae00004800 0x7fae00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:41.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.702+0000 7fae21400640 1 --2- 172.21.15.144:0/2775905870 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae000051c0 0x7fae0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:41.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.702+0000 7fae20a00640 1 -- 172.21.15.144:0/2775905870 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae000051c0 msgr2=0x7fae0000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:41.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.702+0000 7fae20a00640 1 --2- 172.21.15.144:0/2775905870 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae000051c0 0x7fae0000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:41.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.702+0000 7fae20a00640 1 -- 172.21.15.144:0/2775905870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae00004800 msgr2=0x7fae00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:41.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.702+0000 7fae20a00640 1 --2- 172.21.15.144:0/2775905870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae00004800 0x7fae00004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:41.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.702+0000 7fae20a00640 1 -- 172.21.15.144:0/2775905870 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae00003520 con 0x7fae000039b0 2024-09-11T23:24:41.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.702+0000 7fae21400640 1 -- 172.21.15.144:0/2775905870 reap_dead start 2024-09-11T23:24:41.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.703+0000 7fae20a00640 1 --2- 172.21.15.144:0/2775905870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae000039b0 0x7fae00003dd0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00c240 tx=0x7fae00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591f35503b4efcc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:41.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.703+0000 7fae1be00640 1 -- 172.21.15.144:0/2775905870 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c007cf0 con 0x7fae000039b0 2024-09-11T23:24:41.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.703+0000 7fae1be00640 1 -- 172.21.15.144:0/2775905870 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0c005af0 con 0x7fae000039b0 2024-09-11T23:24:41.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.703+0000 7fae1be00640 1 -- 172.21.15.144:0/2775905870 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c007070 con 0x7fae000039b0 2024-09-11T23:24:41.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.704+0000 7fae23400640 1 -- 172.21.15.144:0/2775905870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae000039b0 msgr2=0x7fae00003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:41.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.704+0000 7fae23400640 1 --2- 172.21.15.144:0/2775905870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae000039b0 0x7fae00003dd0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00c240 tx=0x7fae00005830 comp rx=0 tx=0).stop 2024-09-11T23:24:41.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.704+0000 7fae23400640 1 -- 172.21.15.144:0/2775905870 shutdown_connections 2024-09-11T23:24:41.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.704+0000 7fae23400640 1 --2- 172.21.15.144:0/2775905870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae000039b0 0x7fae00003dd0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:41.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.704+0000 7fae23400640 1 -- 172.21.15.144:0/2775905870 >> 172.21.15.144:0/2775905870 conn(0x7fae1c062cc0 msgr2=0x7fae1c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:41.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.704+0000 7fae23400640 1 -- 172.21.15.144:0/2775905870 shutdown_connections 2024-09-11T23:24:41.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.704+0000 7fae23400640 1 -- 172.21.15.144:0/2775905870 wait complete. 2024-09-11T23:24:41.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.706+0000 7fae23400640 1 Processor -- start 2024-09-11T23:24:41.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.706+0000 7fae23400640 1 -- start start 2024-09-11T23:24:41.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.707+0000 7fae23400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae000039b0 0x7fae1c149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:41.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.707+0000 7fae23400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae1c074060 0x7fae1c152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:41.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.707+0000 7fae23400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae1c152fe0 0x7fae1c072340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:41.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.707+0000 7fae23400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c0cd010 con 0x7fae1c074060 2024-09-11T23:24:41.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.707+0000 7fae23400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c0ce690 con 0x7fae1c152fe0 2024-09-11T23:24:41.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.707+0000 7fae23400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fae1c0cd190 con 0x7fae000039b0 2024-09-11T23:24:41.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.707+0000 7fae13e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae1c074060 0x7fae1c152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:41.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.707+0000 7fae13e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae1c074060 0x7fae1c152aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38824/0 (socket says 172.21.15.144:38824) 2024-09-11T23:24:41.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.707+0000 7fae13e00640 1 -- 172.21.15.144:0/2185318143 learned_addr learned my addr 172.21.15.144:0/2185318143 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:41.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.708+0000 7fae20a00640 1 --2- 172.21.15.144:0/2185318143 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae000039b0 0x7fae1c149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:41.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.708+0000 7fae21400640 1 --2- 172.21.15.144:0/2185318143 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae1c152fe0 0x7fae1c072340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:41.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.708+0000 7fae13e00640 1 -- 172.21.15.144:0/2185318143 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae000039b0 msgr2=0x7fae1c149840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:41.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.708+0000 7fae13e00640 1 --2- 172.21.15.144:0/2185318143 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae000039b0 0x7fae1c149840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:41.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.708+0000 7fae13e00640 1 -- 172.21.15.144:0/2185318143 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae1c152fe0 msgr2=0x7fae1c072340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:41.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.708+0000 7fae13e00640 1 --2- 172.21.15.144:0/2185318143 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae1c152fe0 0x7fae1c072340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:41.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.708+0000 7fae13e00640 1 -- 172.21.15.144:0/2185318143 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1c072fc0 con 0x7fae1c074060 2024-09-11T23:24:41.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.708+0000 7fae13e00640 1 --2- 172.21.15.144:0/2185318143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae1c074060 0x7fae1c152aa0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fae04011960 tx=0x7fae04011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:41.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.708+0000 7fae19600640 1 -- 172.21.15.144:0/2185318143 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04019070 con 0x7fae1c074060 2024-09-11T23:24:41.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.708+0000 7fae19600640 1 -- 172.21.15.144:0/2185318143 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae04004240 con 0x7fae1c074060 2024-09-11T23:24:41.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.708+0000 7fae23400640 1 -- 172.21.15.144:0/2185318143 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae1c0732a0 con 0x7fae1c074060 2024-09-11T23:24:41.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.708+0000 7fae19600640 1 -- 172.21.15.144:0/2185318143 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0400f880 con 0x7fae1c074060 2024-09-11T23:24:41.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.709+0000 7fae23400640 1 -- 172.21.15.144:0/2185318143 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae1c073860 con 0x7fae1c074060 2024-09-11T23:24:41.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.710+0000 7fae23400640 1 -- 172.21.15.144:0/2185318143 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae1c1533f0 con 0x7fae1c074060 2024-09-11T23:24:41.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.711+0000 7fae19600640 1 -- 172.21.15.144:0/2185318143 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7fae0401c070 con 0x7fae1c074060 2024-09-11T23:24:41.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.712+0000 7fae19600640 1 --2- 172.21.15.144:0/2185318143 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fadf806c3d0 0x7fadf806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:41.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.712+0000 7fae19600640 1 -- 172.21.15.144:0/2185318143 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7fae0408bd00 con 0x7fae1c074060 2024-09-11T23:24:41.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.712+0000 7fae20a00640 1 --2- 172.21.15.144:0/2185318143 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fadf806c3d0 0x7fadf806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:41.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.713+0000 7fae20a00640 1 --2- 172.21.15.144:0/2185318143 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fadf806c3d0 0x7fadf806e890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fae0c032000 tx=0x7fae0c009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:41.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.716+0000 7fae19600640 1 -- 172.21.15.144:0/2185318143 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae1c1533f0 con 0x7fae1c074060 2024-09-11T23:24:41.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.923+0000 7fae23400640 1 -- 172.21.15.144:0/2185318143 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae1c0afd90 con 0x7fae1c074060 2024-09-11T23:24:41.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.924+0000 7fae19600640 1 -- 172.21.15.144:0/2185318143 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5239 (secure 0 0 0) 0x7fae04059e00 con 0x7fae1c074060 2024-09-11T23:24:41.924 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:41.924 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":90,"btime":"2024-09-11T23:24:41:512789+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6587,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/3230009607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3230009607},{"type":"v1","addr":"172.21.15.144:6801","nonce":3230009607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7755,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2789293878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2789293878},{"type":"v1","addr":"172.21.15.165:6834","nonce":2789293878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7758,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2328841770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2328841770},{"type":"v1","addr":"172.21.15.165:6835","nonce":2328841770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:24:37.895286+0000","modified":"2024-09-11T23:24:40.918906+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7761":{"gid":7761,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1155743669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1155743669},{"type":"v1","addr":"172.21.15.144:6835","nonce":1155743669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7761,"qdb_cluster":[7761]},"id":10}]} 2024-09-11T23:24:41.925 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 90 2024-09-11T23:24:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.926+0000 7fae23400640 1 -- 172.21.15.144:0/2185318143 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fadf806c3d0 msgr2=0x7fadf806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.926+0000 7fae23400640 1 --2- 172.21.15.144:0/2185318143 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fadf806c3d0 0x7fadf806e890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fae0c032000 tx=0x7fae0c009030 comp rx=0 tx=0).stop 2024-09-11T23:24:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.926+0000 7fae23400640 1 -- 172.21.15.144:0/2185318143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae1c074060 msgr2=0x7fae1c152aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.926+0000 7fae23400640 1 --2- 172.21.15.144:0/2185318143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae1c074060 0x7fae1c152aa0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fae04011960 tx=0x7fae04011e20 comp rx=0 tx=0).stop 2024-09-11T23:24:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.926+0000 7fae23400640 1 -- 172.21.15.144:0/2185318143 shutdown_connections 2024-09-11T23:24:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.926+0000 7fae23400640 1 --2- 172.21.15.144:0/2185318143 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fadf806c3d0 0x7fadf806e890 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.926+0000 7fae23400640 1 --2- 172.21.15.144:0/2185318143 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fae1c152fe0 0x7fae1c072340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.926+0000 7fae23400640 1 --2- 172.21.15.144:0/2185318143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae1c074060 0x7fae1c152aa0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.926+0000 7fae23400640 1 --2- 172.21.15.144:0/2185318143 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fae000039b0 0x7fae1c149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.926+0000 7fae23400640 1 -- 172.21.15.144:0/2185318143 >> 172.21.15.144:0/2185318143 conn(0x7fae1c062cc0 msgr2=0x7fae1c0aea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.927+0000 7fae23400640 1 -- 172.21.15.144:0/2185318143 shutdown_connections 2024-09-11T23:24:41.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:41.927+0000 7fae23400640 1 -- 172.21.15.144:0/2185318143 wait complete. 2024-09-11T23:24:41.942 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:24:42.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.096+0000 7f5a68000640 1 Processor -- start 2024-09-11T23:24:42.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.096+0000 7f5a68000640 1 -- start start 2024-09-11T23:24:42.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.098+0000 7f5a68000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5a600b4930 0x7f5a600b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:42.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.098+0000 7f5a68000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a60162870 con 0x7f5a6015f620 2024-09-11T23:24:42.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.098+0000 7f5a68000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a60162b50 con 0x7f5a600d0a50 2024-09-11T23:24:42.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.098+0000 7f5a68000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5a60160180 con 0x7f5a600b4930 2024-09-11T23:24:42.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.098+0000 7f5a64c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5a600b4930 0x7f5a600b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:42.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.098+0000 7f5a66000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5a6015f620 0x7f5a6015fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54326/0 (socket says 172.21.15.144:54326) 2024-09-11T23:24:42.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.098+0000 7f5a66000640 1 -- 172.21.15.144:0/2491221381 learned_addr learned my addr 172.21.15.144:0/2491221381 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:42.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.098+0000 7f5a5fe00640 1 -- 172.21.15.144:0/2491221381 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1269581060 0 0) 0x7f5a60162870 con 0x7f5a6015f620 2024-09-11T23:24:42.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.098+0000 7f5a5fe00640 1 -- 172.21.15.144:0/2491221381 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a48003520 con 0x7f5a6015f620 2024-09-11T23:24:42.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.098+0000 7f5a64c00640 1 -- 172.21.15.144:0/2491221381 >> v1:172.21.15.165:6789/0 conn(0x7f5a600d0a50 legacy=0x7f5a601620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:42.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.099+0000 7f5a64c00640 1 -- 172.21.15.144:0/2491221381 >> v1:172.21.15.144:6789/0 conn(0x7f5a6015f620 legacy=0x7f5a6015fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:42.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.099+0000 7f5a64c00640 1 -- 172.21.15.144:0/2491221381 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a60162e30 con 0x7f5a600b4930 2024-09-11T23:24:42.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.100+0000 7f5a64c00640 1 --2- 172.21.15.144:0/2491221381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a600b4930 0x7f5a600b4d90 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c0097a0 tx=0x7f5a4c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd389641c742566d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:42.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.100+0000 7f5a5fe00640 1 -- 172.21.15.144:0/2491221381 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c037070 con 0x7f5a600b4930 2024-09-11T23:24:42.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.100+0000 7f5a5fe00640 1 -- 172.21.15.144:0/2491221381 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a4c032440 con 0x7f5a600b4930 2024-09-11T23:24:42.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.100+0000 7f5a5fe00640 1 -- 172.21.15.144:0/2491221381 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c0327f0 con 0x7f5a600b4930 2024-09-11T23:24:42.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.100+0000 7f5a68000640 1 -- 172.21.15.144:0/2491221381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a600b4930 msgr2=0x7f5a600b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:42.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.100+0000 7f5a68000640 1 --2- 172.21.15.144:0/2491221381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a600b4930 0x7f5a600b4d90 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c0097a0 tx=0x7f5a4c02a1a0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.100+0000 7f5a68000640 1 -- 172.21.15.144:0/2491221381 shutdown_connections 2024-09-11T23:24:42.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.100+0000 7f5a68000640 1 --2- 172.21.15.144:0/2491221381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a600b4930 0x7f5a600b4d90 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.100+0000 7f5a68000640 1 -- 172.21.15.144:0/2491221381 >> 172.21.15.144:0/2491221381 conn(0x7f5a60062cc0 msgr2=0x7f5a6006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:42.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.101+0000 7f5a68000640 1 -- 172.21.15.144:0/2491221381 shutdown_connections 2024-09-11T23:24:42.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.101+0000 7f5a68000640 1 -- 172.21.15.144:0/2491221381 wait complete. 2024-09-11T23:24:42.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.102+0000 7f5a68000640 1 Processor -- start 2024-09-11T23:24:42.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.102+0000 7f5a68000640 1 -- start start 2024-09-11T23:24:42.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.103+0000 7f5a68000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a600b4930 0x7f5a600cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:42.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.103+0000 7f5a68000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a6015f620 0x7f5a6014ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:42.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.103+0000 7f5a68000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a60071110 0x7f5a601e7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:42.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.103+0000 7f5a68000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5a600b3620 con 0x7f5a60071110 2024-09-11T23:24:42.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.103+0000 7f5a68000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5a600b52d0 con 0x7f5a6015f620 2024-09-11T23:24:42.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.103+0000 7f5a68000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5a600b3b40 con 0x7f5a600b4930 2024-09-11T23:24:42.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.103+0000 7f5a66000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a60071110 0x7f5a601e7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:42.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.103+0000 7f5a66000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a60071110 0x7f5a601e7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38834/0 (socket says 172.21.15.144:38834) 2024-09-11T23:24:42.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.103+0000 7f5a66000640 1 -- 172.21.15.144:0/4161827786 learned_addr learned my addr 172.21.15.144:0/4161827786 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:42.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.103+0000 7f5a64c00640 1 --2- 172.21.15.144:0/4161827786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a6015f620 0x7f5a6014ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:42.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.103+0000 7f5a65600640 1 --2- 172.21.15.144:0/4161827786 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a600b4930 0x7f5a600cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:42.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.104+0000 7f5a66000640 1 -- 172.21.15.144:0/4161827786 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a600b4930 msgr2=0x7f5a600cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:42.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.104+0000 7f5a66000640 1 --2- 172.21.15.144:0/4161827786 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a600b4930 0x7f5a600cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.104+0000 7f5a66000640 1 -- 172.21.15.144:0/4161827786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a6015f620 msgr2=0x7f5a6014ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:42.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.104+0000 7f5a66000640 1 --2- 172.21.15.144:0/4161827786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a6015f620 0x7f5a6014ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.104+0000 7f5a66000640 1 -- 172.21.15.144:0/4161827786 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a6014b2c0 con 0x7f5a60071110 2024-09-11T23:24:42.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.104+0000 7f5a65600640 1 --2- 172.21.15.144:0/4161827786 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a600b4930 0x7f5a600cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:42.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.104+0000 7f5a66000640 1 --2- 172.21.15.144:0/4161827786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a60071110 0x7f5a601e7ed0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800caa0 tx=0x7f5a5800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:42.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.104+0000 7f5a5d600640 1 -- 172.21.15.144:0/4161827786 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a58017070 con 0x7f5a60071110 2024-09-11T23:24:42.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.104+0000 7f5a5d600640 1 -- 172.21.15.144:0/4161827786 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a5800ac00 con 0x7f5a60071110 2024-09-11T23:24:42.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.104+0000 7f5a5d600640 1 -- 172.21.15.144:0/4161827786 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a58012400 con 0x7f5a60071110 2024-09-11T23:24:42.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.104+0000 7f5a68000640 1 -- 172.21.15.144:0/4161827786 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a60072b10 con 0x7f5a60071110 2024-09-11T23:24:42.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.104+0000 7f5a68000640 1 -- 172.21.15.144:0/4161827786 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a600733b0 con 0x7f5a60071110 2024-09-11T23:24:42.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.105+0000 7f5a68000640 1 -- 172.21.15.144:0/4161827786 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a60072ce0 con 0x7f5a60071110 2024-09-11T23:24:42.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.106+0000 7f5a5d600640 1 -- 172.21.15.144:0/4161827786 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f5a5801a070 con 0x7f5a60071110 2024-09-11T23:24:42.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.108+0000 7f5a5d600640 1 --2- 172.21.15.144:0/4161827786 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5a4006c3d0 0x7f5a4006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:42.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.108+0000 7f5a5d600640 1 -- 172.21.15.144:0/4161827786 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f5a5808b5a0 con 0x7f5a60071110 2024-09-11T23:24:42.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.108+0000 7f5a65600640 1 --2- 172.21.15.144:0/4161827786 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5a4006c3d0 0x7f5a4006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:42.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.109+0000 7f5a65600640 1 --2- 172.21.15.144:0/4161827786 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5a4006c3d0 0x7f5a4006e890 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5a54007fd0 tx=0x7f5a54009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:42.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.112+0000 7f5a5d600640 1 -- 172.21.15.144:0/4161827786 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5a580590e0 con 0x7f5a60071110 2024-09-11T23:24:42.288 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.289+0000 7f5a68000640 1 -- 172.21.15.144:0/4161827786 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a600b4d90 con 0x7f5a60071110 2024-09-11T23:24:42.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.290+0000 7f5a5d600640 1 -- 172.21.15.144:0/4161827786 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) ==== 74+0+16763 (secure 0 0 0) 0x7f5a5805d3e0 con 0x7f5a60071110 2024-09-11T23:24:42.290 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:42.290 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":131,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:24:39.495019+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:24:35.685780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-11T23:24:36.890387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:24:42.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.292+0000 7f5a68000640 1 -- 172.21.15.144:0/4161827786 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5a4006c3d0 msgr2=0x7f5a4006e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:42.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.292+0000 7f5a68000640 1 --2- 172.21.15.144:0/4161827786 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5a4006c3d0 0x7f5a4006e890 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5a54007fd0 tx=0x7f5a54009040 comp rx=0 tx=0).stop 2024-09-11T23:24:42.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.292+0000 7f5a68000640 1 -- 172.21.15.144:0/4161827786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a60071110 msgr2=0x7f5a601e7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:42.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.292+0000 7f5a68000640 1 --2- 172.21.15.144:0/4161827786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a60071110 0x7f5a601e7ed0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800caa0 tx=0x7f5a5800cf60 comp rx=0 tx=0).stop 2024-09-11T23:24:42.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.292+0000 7f5a68000640 1 -- 172.21.15.144:0/4161827786 shutdown_connections 2024-09-11T23:24:42.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.292+0000 7f5a68000640 1 --2- 172.21.15.144:0/4161827786 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5a4006c3d0 0x7f5a4006e890 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.292+0000 7f5a68000640 1 --2- 172.21.15.144:0/4161827786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5a60071110 0x7f5a601e7ed0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.292+0000 7f5a68000640 1 --2- 172.21.15.144:0/4161827786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5a6015f620 0x7f5a6014ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.292+0000 7f5a68000640 1 --2- 172.21.15.144:0/4161827786 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5a600b4930 0x7f5a600cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.292+0000 7f5a68000640 1 -- 172.21.15.144:0/4161827786 >> 172.21.15.144:0/4161827786 conn(0x7f5a60062cc0 msgr2=0x7f5a6015b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:42.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.293+0000 7f5a68000640 1 -- 172.21.15.144:0/4161827786 shutdown_connections 2024-09-11T23:24:42.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.293+0000 7f5a68000640 1 -- 172.21.15.144:0/4161827786 wait complete. 2024-09-11T23:24:42.308 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:24:42.308 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:24:42.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.460+0000 7f2872000640 1 Processor -- start 2024-09-11T23:24:42.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.461+0000 7f2872000640 1 -- start start 2024-09-11T23:24:42.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.462+0000 7f2872000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f286c15f570 0x7f286c071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:42.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.462+0000 7f2872000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f286c0d0370 0x7f286c0d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:42.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.462+0000 7f2872000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f286c0d1d90 con 0x7f286c0b6c60 2024-09-11T23:24:42.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.462+0000 7f2872000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f286c0d2070 con 0x7f286c0d0370 2024-09-11T23:24:42.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.462+0000 7f2872000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f286c070a60 con 0x7f286c15f570 2024-09-11T23:24:42.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.462+0000 7f2870c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f286c0b6c60 0x7f286c0b7040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54332/0 (socket says 172.21.15.144:54332) 2024-09-11T23:24:42.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.462+0000 7f2870c00640 1 -- 172.21.15.144:0/2407744431 learned_addr learned my addr 172.21.15.144:0/2407744431 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:42.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.462+0000 7f2871600640 1 --2- 172.21.15.144:0/2407744431 >> v2:172.21.15.165:3300/0 conn(0x7f286c0d0370 0x7f286c0d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:42.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.462+0000 7f2863e00640 1 --2- 172.21.15.144:0/2407744431 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f286c15f570 0x7f286c071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:42.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.463+0000 7f286be00640 1 -- 172.21.15.144:0/2407744431 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857064869 0 0) 0x7f286c0d1d90 con 0x7f286c0b6c60 2024-09-11T23:24:42.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.463+0000 7f286be00640 1 -- 172.21.15.144:0/2407744431 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2850003520 con 0x7f286c0b6c60 2024-09-11T23:24:42.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.463+0000 7f2863e00640 1 -- 172.21.15.144:0/2407744431 >> v2:172.21.15.165:3300/0 conn(0x7f286c0d0370 msgr2=0x7f286c0d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:42.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.463+0000 7f2863e00640 1 --2- 172.21.15.144:0/2407744431 >> v2:172.21.15.165:3300/0 conn(0x7f286c0d0370 0x7f286c0d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.463+0000 7f2863e00640 1 -- 172.21.15.144:0/2407744431 >> v1:172.21.15.144:6789/0 conn(0x7f286c0b6c60 legacy=0x7f286c0b7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:42.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.463+0000 7f2863e00640 1 -- 172.21.15.144:0/2407744431 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286c070d40 con 0x7f286c15f570 2024-09-11T23:24:42.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.463+0000 7f2871600640 1 --2- 172.21.15.144:0/2407744431 >> v2:172.21.15.165:3300/0 conn(0x7f286c0d0370 0x7f286c0d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:24:42.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.464+0000 7f2863e00640 1 --2- 172.21.15.144:0/2407744431 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f286c15f570 0x7f286c071260 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f28540097a0 tx=0x7f285402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=905c7e508f621464 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:42.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.464+0000 7f286be00640 1 -- 172.21.15.144:0/2407744431 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2854037070 con 0x7f286c15f570 2024-09-11T23:24:42.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.464+0000 7f286be00640 1 -- 172.21.15.144:0/2407744431 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285402ae50 con 0x7f286c15f570 2024-09-11T23:24:42.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.464+0000 7f286be00640 1 -- 172.21.15.144:0/2407744431 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2854032640 con 0x7f286c15f570 2024-09-11T23:24:42.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.465+0000 7f2872000640 1 -- 172.21.15.144:0/2407744431 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f286c15f570 msgr2=0x7f286c071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:42.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.465+0000 7f2872000640 1 --2- 172.21.15.144:0/2407744431 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f286c15f570 0x7f286c071260 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f28540097a0 tx=0x7f285402a100 comp rx=0 tx=0).stop 2024-09-11T23:24:42.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.465+0000 7f2872000640 1 -- 172.21.15.144:0/2407744431 shutdown_connections 2024-09-11T23:24:42.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.465+0000 7f2872000640 1 --2- 172.21.15.144:0/2407744431 >> v2:172.21.15.165:3300/0 conn(0x7f286c0d0370 0x7f286c0d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.465+0000 7f2872000640 1 --2- 172.21.15.144:0/2407744431 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f286c15f570 0x7f286c071260 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.465+0000 7f2872000640 1 -- 172.21.15.144:0/2407744431 >> 172.21.15.144:0/2407744431 conn(0x7f286c06f390 msgr2=0x7f286c06f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:42.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.465+0000 7f2872000640 1 -- 172.21.15.144:0/2407744431 shutdown_connections 2024-09-11T23:24:42.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.465+0000 7f2872000640 1 -- 172.21.15.144:0/2407744431 wait complete. 2024-09-11T23:24:42.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.467+0000 7f2872000640 1 Processor -- start 2024-09-11T23:24:42.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.467+0000 7f2872000640 1 -- start start 2024-09-11T23:24:42.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.468+0000 7f2872000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f286c0b6c60 0x7f286c1571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:42.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.468+0000 7f2872000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f286c0d0370 0x7f286c15b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:42.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.468+0000 7f2872000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f286c15f570 0x7f286c15b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:42.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.468+0000 7f2872000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f286c0d0d40 con 0x7f286c0d0370 2024-09-11T23:24:42.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.468+0000 7f2872000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f286c0d1a50 con 0x7f286c15f570 2024-09-11T23:24:42.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.468+0000 7f2872000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f286c158f30 con 0x7f286c0b6c60 2024-09-11T23:24:42.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.468+0000 7f2863e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f286c0d0370 0x7f286c15b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:42.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.468+0000 7f2863e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f286c0d0370 0x7f286c15b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38850/0 (socket says 172.21.15.144:38850) 2024-09-11T23:24:42.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.468+0000 7f2863e00640 1 -- 172.21.15.144:0/2133078402 learned_addr learned my addr 172.21.15.144:0/2133078402 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:42.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.468+0000 7f2870c00640 1 --2- 172.21.15.144:0/2133078402 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f286c0b6c60 0x7f286c1571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:42.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.468+0000 7f2871600640 1 --2- 172.21.15.144:0/2133078402 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f286c15f570 0x7f286c15b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:42.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.468+0000 7f2863e00640 1 -- 172.21.15.144:0/2133078402 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f286c0b6c60 msgr2=0x7f286c1571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:42.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.468+0000 7f2863e00640 1 --2- 172.21.15.144:0/2133078402 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f286c0b6c60 0x7f286c1571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.468+0000 7f2863e00640 1 -- 172.21.15.144:0/2133078402 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f286c15f570 msgr2=0x7f286c15b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:42.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.468+0000 7f2863e00640 1 --2- 172.21.15.144:0/2133078402 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f286c15f570 0x7f286c15b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.468+0000 7f2863e00640 1 -- 172.21.15.144:0/2133078402 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286c0cbe60 con 0x7f286c0d0370 2024-09-11T23:24:42.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.468+0000 7f2871600640 1 --2- 172.21.15.144:0/2133078402 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f286c15f570 0x7f286c15b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:42.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.469+0000 7f2863e00640 1 --2- 172.21.15.144:0/2133078402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f286c0d0370 0x7f286c15b440 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f2854035040 tx=0x7f28540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:42.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.469+0000 7f2869600640 1 -- 172.21.15.144:0/2133078402 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2854041020 con 0x7f286c0d0370 2024-09-11T23:24:42.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.469+0000 7f2869600640 1 -- 172.21.15.144:0/2133078402 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285403c670 con 0x7f286c0d0370 2024-09-11T23:24:42.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.469+0000 7f2869600640 1 -- 172.21.15.144:0/2133078402 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2854037040 con 0x7f286c0d0370 2024-09-11T23:24:42.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.469+0000 7f2872000640 1 -- 172.21.15.144:0/2133078402 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f286c0cc140 con 0x7f286c0d0370 2024-09-11T23:24:42.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.469+0000 7f2872000640 1 -- 172.21.15.144:0/2133078402 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f286c0cc700 con 0x7f286c0d0370 2024-09-11T23:24:42.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.470+0000 7f2872000640 1 -- 172.21.15.144:0/2133078402 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f286c0d1d90 con 0x7f286c0d0370 2024-09-11T23:24:42.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.471+0000 7f2869600640 1 -- 172.21.15.144:0/2133078402 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f2854044020 con 0x7f286c0d0370 2024-09-11T23:24:42.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.472+0000 7f2869600640 1 --2- 172.21.15.144:0/2133078402 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f284806c3d0 0x7f284806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:42.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.472+0000 7f2869600640 1 -- 172.21.15.144:0/2133078402 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f28540abf60 con 0x7f286c0d0370 2024-09-11T23:24:42.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.473+0000 7f2870c00640 1 --2- 172.21.15.144:0/2133078402 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f284806c3d0 0x7f284806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:42.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.473+0000 7f2870c00640 1 --2- 172.21.15.144:0/2133078402 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f284806c3d0 0x7f284806e890 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f285c005880 tx=0x7f285c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:42.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.476+0000 7f2869600640 1 -- 172.21.15.144:0/2133078402 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f285404b030 con 0x7f286c0d0370 2024-09-11T23:24:42.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.648+0000 7f2872000640 1 -- 172.21.15.144:0/2133078402 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f286c073fe0 con 0x7f284806c3d0 2024-09-11T23:24:42.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.654+0000 7f2869600640 1 -- 172.21.15.144:0/2133078402 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252487 (secure 0 0 0) 0x7f286c073fe0 con 0x7f284806c3d0 2024-09-11T23:24:42.657 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:42.658 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:24:42.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.658+0000 7f2872000640 1 -- 172.21.15.144:0/2133078402 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f284806c3d0 msgr2=0x7f284806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:42.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.658+0000 7f2872000640 1 --2- 172.21.15.144:0/2133078402 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f284806c3d0 0x7f284806e890 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f285c005880 tx=0x7f285c009040 comp rx=0 tx=0).stop 2024-09-11T23:24:42.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.658+0000 7f2872000640 1 -- 172.21.15.144:0/2133078402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f286c0d0370 msgr2=0x7f286c15b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:42.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.658+0000 7f2872000640 1 --2- 172.21.15.144:0/2133078402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f286c0d0370 0x7f286c15b440 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f2854035040 tx=0x7f28540046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.658+0000 7f2872000640 1 -- 172.21.15.144:0/2133078402 shutdown_connections 2024-09-11T23:24:42.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.658+0000 7f2872000640 1 --2- 172.21.15.144:0/2133078402 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f284806c3d0 0x7f284806e890 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.658+0000 7f2872000640 1 --2- 172.21.15.144:0/2133078402 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f286c15f570 0x7f286c15b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.658+0000 7f2872000640 1 --2- 172.21.15.144:0/2133078402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f286c0d0370 0x7f286c15b440 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.658+0000 7f2872000640 1 --2- 172.21.15.144:0/2133078402 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f286c0b6c60 0x7f286c1571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.658+0000 7f2872000640 1 -- 172.21.15.144:0/2133078402 >> 172.21.15.144:0/2133078402 conn(0x7f286c06f390 msgr2=0x7f286c0b2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:42.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.658+0000 7f2872000640 1 -- 172.21.15.144:0/2133078402 shutdown_connections 2024-09-11T23:24:42.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.658+0000 7f2872000640 1 -- 172.21.15.144:0/2133078402 wait complete. 2024-09-11T23:24:42.675 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-09-11T23:24:40.746365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":263496,"kb_used_data":13960,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711224,"statfs":{"total":773094113280,"available":772824293376,"internally_reserved":0,"allocated":14295040,"data_stored":6933964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.271108"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575942+0000","last_change":"2024-09-11T23:24:38.520316+0000","last_active":"2024-09-11T23:24:39.575942+0000","last_peered":"2024-09-11T23:24:39.575942+0000","last_clean":"2024-09-11T23:24:39.575942+0000","last_became_active":"2024-09-11T23:24:38.519994+0000","last_became_peered":"2024-09-11T23:24:38.519994+0000","last_unstale":"2024-09-11T23:24:39.575942+0000","last_undegraded":"2024-09-11T23:24:39.575942+0000","last_fullsized":"2024-09-11T23:24:39.575942+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:18.528825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575729+0000","last_change":"2024-09-11T23:24:38.505486+0000","last_active":"2024-09-11T23:24:39.575729+0000","last_peered":"2024-09-11T23:24:39.575729+0000","last_clean":"2024-09-11T23:24:39.575729+0000","last_became_active":"2024-09-11T23:24:38.505179+0000","last_became_peered":"2024-09-11T23:24:38.505179+0000","last_unstale":"2024-09-11T23:24:39.575729+0000","last_undegraded":"2024-09-11T23:24:39.575729+0000","last_fullsized":"2024-09-11T23:24:39.575729+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:00.749222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575435+0000","last_change":"2024-09-11T23:24:38.503083+0000","last_active":"2024-09-11T23:24:39.575435+0000","last_peered":"2024-09-11T23:24:39.575435+0000","last_clean":"2024-09-11T23:24:39.575435+0000","last_became_active":"2024-09-11T23:24:38.502804+0000","last_became_peered":"2024-09-11T23:24:38.502804+0000","last_unstale":"2024-09-11T23:24:39.575435+0000","last_undegraded":"2024-09-11T23:24:39.575435+0000","last_fullsized":"2024-09-11T23:24:39.575435+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:40.808419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507765+0000","last_change":"2024-09-11T23:24:38.514813+0000","last_active":"2024-09-11T23:24:39.507765+0000","last_peered":"2024-09-11T23:24:39.507765+0000","last_clean":"2024-09-11T23:24:39.507765+0000","last_became_active":"2024-09-11T23:24:38.509954+0000","last_became_peered":"2024-09-11T23:24:38.509954+0000","last_unstale":"2024-09-11T23:24:39.507765+0000","last_undegraded":"2024-09-11T23:24:39.507765+0000","last_fullsized":"2024-09-11T23:24:39.507765+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:18.401893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507237+0000","last_change":"2024-09-11T23:24:38.520064+0000","last_active":"2024-09-11T23:24:39.507237+0000","last_peered":"2024-09-11T23:24:39.507237+0000","last_clean":"2024-09-11T23:24:39.507237+0000","last_became_active":"2024-09-11T23:24:38.519535+0000","last_became_peered":"2024-09-11T23:24:38.519535+0000","last_unstale":"2024-09-11T23:24:39.507237+0000","last_undegraded":"2024-09-11T23:24:39.507237+0000","last_fullsized":"2024-09-11T23:24:39.507237+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:18.219343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574821+0000","last_change":"2024-09-11T23:24:38.498164+0000","last_active":"2024-09-11T23:24:39.574821+0000","last_peered":"2024-09-11T23:24:39.574821+0000","last_clean":"2024-09-11T23:24:39.574821+0000","last_became_active":"2024-09-11T23:24:38.497867+0000","last_became_peered":"2024-09-11T23:24:38.497867+0000","last_unstale":"2024-09-11T23:24:39.574821+0000","last_undegraded":"2024-09-11T23:24:39.574821+0000","last_fullsized":"2024-09-11T23:24:39.574821+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:54.981251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.502895+0000","last_change":"2024-09-11T23:24:38.498191+0000","last_active":"2024-09-11T23:24:39.502895+0000","last_peered":"2024-09-11T23:24:39.502895+0000","last_clean":"2024-09-11T23:24:39.502895+0000","last_became_active":"2024-09-11T23:24:38.497893+0000","last_became_peered":"2024-09-11T23:24:38.497893+0000","last_unstale":"2024-09-11T23:24:39.502895+0000","last_undegraded":"2024-09-11T23:24:39.502895+0000","last_fullsized":"2024-09-11T23:24:39.502895+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:56.944178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574542+0000","last_change":"2024-09-11T23:24:38.520250+0000","last_active":"2024-09-11T23:24:39.574542+0000","last_peered":"2024-09-11T23:24:39.574542+0000","last_clean":"2024-09-11T23:24:39.574542+0000","last_became_active":"2024-09-11T23:24:38.519922+0000","last_became_peered":"2024-09-11T23:24:38.519922+0000","last_unstale":"2024-09-11T23:24:39.574542+0000","last_undegraded":"2024-09-11T23:24:39.574542+0000","last_fullsized":"2024-09-11T23:24:39.574542+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:01.254826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575966+0000","last_change":"2024-09-11T23:24:38.522057+0000","last_active":"2024-09-11T23:24:39.575966+0000","last_peered":"2024-09-11T23:24:39.575966+0000","last_clean":"2024-09-11T23:24:39.575966+0000","last_became_active":"2024-09-11T23:24:38.521787+0000","last_became_peered":"2024-09-11T23:24:38.521787+0000","last_unstale":"2024-09-11T23:24:39.575966+0000","last_undegraded":"2024-09-11T23:24:39.575966+0000","last_fullsized":"2024-09-11T23:24:39.575966+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:44.602339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576058+0000","last_change":"2024-09-11T23:24:38.514403+0000","last_active":"2024-09-11T23:24:39.576058+0000","last_peered":"2024-09-11T23:24:39.576058+0000","last_clean":"2024-09-11T23:24:39.576058+0000","last_became_active":"2024-09-11T23:24:38.514080+0000","last_became_peered":"2024-09-11T23:24:38.514080+0000","last_unstale":"2024-09-11T23:24:39.576058+0000","last_undegraded":"2024-09-11T23:24:39.576058+0000","last_fullsized":"2024-09-11T23:24:39.576058+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:10.872794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574849+0000","last_change":"2024-09-11T23:24:38.518114+0000","last_active":"2024-09-11T23:24:39.574849+0000","last_peered":"2024-09-11T23:24:39.574849+0000","last_clean":"2024-09-11T23:24:39.574849+0000","last_became_active":"2024-09-11T23:24:38.517897+0000","last_became_peered":"2024-09-11T23:24:38.517897+0000","last_unstale":"2024-09-11T23:24:39.574849+0000","last_undegraded":"2024-09-11T23:24:39.574849+0000","last_fullsized":"2024-09-11T23:24:39.574849+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:40.808419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575628+0000","last_change":"2024-09-11T23:24:38.509808+0000","last_active":"2024-09-11T23:24:39.575628+0000","last_peered":"2024-09-11T23:24:39.575628+0000","last_clean":"2024-09-11T23:24:39.575628+0000","last_became_active":"2024-09-11T23:24:38.509544+0000","last_became_peered":"2024-09-11T23:24:38.509544+0000","last_unstale":"2024-09-11T23:24:39.575628+0000","last_undegraded":"2024-09-11T23:24:39.575628+0000","last_fullsized":"2024-09-11T23:24:39.575628+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:32.606623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.506936+0000","last_change":"2024-09-11T23:24:38.519851+0000","last_active":"2024-09-11T23:24:39.506936+0000","last_peered":"2024-09-11T23:24:39.506936+0000","last_clean":"2024-09-11T23:24:39.506936+0000","last_became_active":"2024-09-11T23:24:38.519163+0000","last_became_peered":"2024-09-11T23:24:38.519163+0000","last_unstale":"2024-09-11T23:24:39.506936+0000","last_undegraded":"2024-09-11T23:24:39.506936+0000","last_fullsized":"2024-09-11T23:24:39.506936+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:37.263621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507150+0000","last_change":"2024-09-11T23:24:38.510802+0000","last_active":"2024-09-11T23:24:39.507150+0000","last_peered":"2024-09-11T23:24:39.507150+0000","last_clean":"2024-09-11T23:24:39.507150+0000","last_became_active":"2024-09-11T23:24:38.510524+0000","last_became_peered":"2024-09-11T23:24:38.510524+0000","last_unstale":"2024-09-11T23:24:39.507150+0000","last_undegraded":"2024-09-11T23:24:39.507150+0000","last_fullsized":"2024-09-11T23:24:39.507150+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:03.784871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574754+0000","last_change":"2024-09-11T23:24:38.514604+0000","last_active":"2024-09-11T23:24:39.574754+0000","last_peered":"2024-09-11T23:24:39.574754+0000","last_clean":"2024-09-11T23:24:39.574754+0000","last_became_active":"2024-09-11T23:24:38.514282+0000","last_became_peered":"2024-09-11T23:24:38.514282+0000","last_unstale":"2024-09-11T23:24:39.574754+0000","last_undegraded":"2024-09-11T23:24:39.574754+0000","last_fullsized":"2024-09-11T23:24:39.574754+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:56.668564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575965+0000","last_change":"2024-09-11T23:24:38.515304+0000","last_active":"2024-09-11T23:24:39.575965+0000","last_peered":"2024-09-11T23:24:39.575965+0000","last_clean":"2024-09-11T23:24:39.575965+0000","last_became_active":"2024-09-11T23:24:38.515035+0000","last_became_peered":"2024-09-11T23:24:38.515035+0000","last_unstale":"2024-09-11T23:24:39.575965+0000","last_undegraded":"2024-09-11T23:24:39.575965+0000","last_fullsized":"2024-09-11T23:24:39.575965+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:57.543292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576045+0000","last_change":"2024-09-11T23:24:38.514645+0000","last_active":"2024-09-11T23:24:39.576045+0000","last_peered":"2024-09-11T23:24:39.576045+0000","last_clean":"2024-09-11T23:24:39.576045+0000","last_became_active":"2024-09-11T23:24:38.514231+0000","last_became_peered":"2024-09-11T23:24:38.514231+0000","last_unstale":"2024-09-11T23:24:39.576045+0000","last_undegraded":"2024-09-11T23:24:39.576045+0000","last_fullsized":"2024-09-11T23:24:39.576045+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:48.826844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575886+0000","last_change":"2024-09-11T23:24:38.504603+0000","last_active":"2024-09-11T23:24:39.575886+0000","last_peered":"2024-09-11T23:24:39.575886+0000","last_clean":"2024-09-11T23:24:39.575886+0000","last_became_active":"2024-09-11T23:24:38.504301+0000","last_became_peered":"2024-09-11T23:24:38.504301+0000","last_unstale":"2024-09-11T23:24:39.575886+0000","last_undegraded":"2024-09-11T23:24:39.575886+0000","last_fullsized":"2024-09-11T23:24:39.575886+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:45.402512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575325+0000","last_change":"2024-09-11T23:24:38.519000+0000","last_active":"2024-09-11T23:24:39.575325+0000","last_peered":"2024-09-11T23:24:39.575325+0000","last_clean":"2024-09-11T23:24:39.575325+0000","last_became_active":"2024-09-11T23:24:38.518611+0000","last_became_peered":"2024-09-11T23:24:38.518611+0000","last_unstale":"2024-09-11T23:24:39.575325+0000","last_undegraded":"2024-09-11T23:24:39.575325+0000","last_fullsized":"2024-09-11T23:24:39.575325+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:03.784871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575004+0000","last_change":"2024-09-11T23:24:38.509333+0000","last_active":"2024-09-11T23:24:39.575004+0000","last_peered":"2024-09-11T23:24:39.575004+0000","last_clean":"2024-09-11T23:24:39.575004+0000","last_became_active":"2024-09-11T23:24:38.509020+0000","last_became_peered":"2024-09-11T23:24:38.509020+0000","last_unstale":"2024-09-11T23:24:39.575004+0000","last_undegraded":"2024-09-11T23:24:39.575004+0000","last_fullsized":"2024-09-11T23:24:39.575004+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:50.983022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575580+0000","last_change":"2024-09-11T23:24:38.511590+0000","last_active":"2024-09-11T23:24:39.575580+0000","last_peered":"2024-09-11T23:24:39.575580+0000","last_clean":"2024-09-11T23:24:39.575580+0000","last_became_active":"2024-09-11T23:24:38.511296+0000","last_became_peered":"2024-09-11T23:24:38.511296+0000","last_unstale":"2024-09-11T23:24:39.575580+0000","last_undegraded":"2024-09-11T23:24:39.575580+0000","last_fullsized":"2024-09-11T23:24:39.575580+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:56.138030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507234+0000","last_change":"2024-09-11T23:24:38.501444+0000","last_active":"2024-09-11T23:24:39.507234+0000","last_peered":"2024-09-11T23:24:39.507234+0000","last_clean":"2024-09-11T23:24:39.507234+0000","last_became_active":"2024-09-11T23:24:38.501131+0000","last_became_peered":"2024-09-11T23:24:38.501131+0000","last_unstale":"2024-09-11T23:24:39.507234+0000","last_undegraded":"2024-09-11T23:24:39.507234+0000","last_fullsized":"2024-09-11T23:24:39.507234+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:40.552989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507535+0000","last_change":"2024-09-11T23:24:38.498571+0000","last_active":"2024-09-11T23:24:39.507535+0000","last_peered":"2024-09-11T23:24:39.507535+0000","last_clean":"2024-09-11T23:24:39.507535+0000","last_became_active":"2024-09-11T23:24:38.498291+0000","last_became_peered":"2024-09-11T23:24:38.498291+0000","last_unstale":"2024-09-11T23:24:39.507535+0000","last_undegraded":"2024-09-11T23:24:39.507535+0000","last_fullsized":"2024-09-11T23:24:39.507535+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:09.101277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574758+0000","last_change":"2024-09-11T23:24:38.514350+0000","last_active":"2024-09-11T23:24:39.574758+0000","last_peered":"2024-09-11T23:24:39.574758+0000","last_clean":"2024-09-11T23:24:39.574758+0000","last_became_active":"2024-09-11T23:24:38.513616+0000","last_became_peered":"2024-09-11T23:24:38.513616+0000","last_unstale":"2024-09-11T23:24:39.574758+0000","last_undegraded":"2024-09-11T23:24:39.574758+0000","last_fullsized":"2024-09-11T23:24:39.574758+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:48.209703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576124+0000","last_change":"2024-09-11T23:24:38.522546+0000","last_active":"2024-09-11T23:24:39.576124+0000","last_peered":"2024-09-11T23:24:39.576124+0000","last_clean":"2024-09-11T23:24:39.576124+0000","last_became_active":"2024-09-11T23:24:38.521991+0000","last_became_peered":"2024-09-11T23:24:38.521991+0000","last_unstale":"2024-09-11T23:24:39.576124+0000","last_undegraded":"2024-09-11T23:24:39.576124+0000","last_fullsized":"2024-09-11T23:24:39.576124+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:13.222886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575584+0000","last_change":"2024-09-11T23:24:38.502195+0000","last_active":"2024-09-11T23:24:39.575584+0000","last_peered":"2024-09-11T23:24:39.575584+0000","last_clean":"2024-09-11T23:24:39.575584+0000","last_became_active":"2024-09-11T23:24:38.501790+0000","last_became_peered":"2024-09-11T23:24:38.501790+0000","last_unstale":"2024-09-11T23:24:39.575584+0000","last_undegraded":"2024-09-11T23:24:39.575584+0000","last_fullsized":"2024-09-11T23:24:39.575584+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:40.552989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575683+0000","last_change":"2024-09-11T23:24:38.516017+0000","last_active":"2024-09-11T23:24:39.575683+0000","last_peered":"2024-09-11T23:24:39.575683+0000","last_clean":"2024-09-11T23:24:39.575683+0000","last_became_active":"2024-09-11T23:24:38.515651+0000","last_became_peered":"2024-09-11T23:24:38.515651+0000","last_unstale":"2024-09-11T23:24:39.575683+0000","last_undegraded":"2024-09-11T23:24:39.575683+0000","last_fullsized":"2024-09-11T23:24:39.575683+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:43.887898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.502594+0000","last_change":"2024-09-11T23:24:38.498949+0000","last_active":"2024-09-11T23:24:39.502594+0000","last_peered":"2024-09-11T23:24:39.502594+0000","last_clean":"2024-09-11T23:24:39.502594+0000","last_became_active":"2024-09-11T23:24:38.497454+0000","last_became_peered":"2024-09-11T23:24:38.497454+0000","last_unstale":"2024-09-11T23:24:39.502594+0000","last_undegraded":"2024-09-11T23:24:39.502594+0000","last_fullsized":"2024-09-11T23:24:39.502594+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:15.472339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574827+0000","last_change":"2024-09-11T23:24:38.497485+0000","last_active":"2024-09-11T23:24:39.574827+0000","last_peered":"2024-09-11T23:24:39.574827+0000","last_clean":"2024-09-11T23:24:39.574827+0000","last_became_active":"2024-09-11T23:24:38.497203+0000","last_became_peered":"2024-09-11T23:24:38.497203+0000","last_unstale":"2024-09-11T23:24:39.574827+0000","last_undegraded":"2024-09-11T23:24:39.574827+0000","last_fullsized":"2024-09-11T23:24:39.574827+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:37.191719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507309+0000","last_change":"2024-09-11T23:24:38.495948+0000","last_active":"2024-09-11T23:24:39.507309+0000","last_peered":"2024-09-11T23:24:39.507309+0000","last_clean":"2024-09-11T23:24:39.507309+0000","last_became_active":"2024-09-11T23:24:38.495525+0000","last_became_peered":"2024-09-11T23:24:38.495525+0000","last_unstale":"2024-09-11T23:24:39.507309+0000","last_undegraded":"2024-09-11T23:24:39.507309+0000","last_fullsized":"2024-09-11T23:24:39.507309+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:03.852371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574646+0000","last_change":"2024-09-11T23:24:38.516466+0000","last_active":"2024-09-11T23:24:39.574646+0000","last_peered":"2024-09-11T23:24:39.574646+0000","last_clean":"2024-09-11T23:24:39.574646+0000","last_became_active":"2024-09-11T23:24:38.515878+0000","last_became_peered":"2024-09-11T23:24:38.515878+0000","last_unstale":"2024-09-11T23:24:39.574646+0000","last_undegraded":"2024-09-11T23:24:39.574646+0000","last_fullsized":"2024-09-11T23:24:39.574646+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:22.805785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574610+0000","last_change":"2024-09-11T23:24:38.511173+0000","last_active":"2024-09-11T23:24:39.574610+0000","last_peered":"2024-09-11T23:24:39.574610+0000","last_clean":"2024-09-11T23:24:39.574610+0000","last_became_active":"2024-09-11T23:24:38.510860+0000","last_became_peered":"2024-09-11T23:24:38.510860+0000","last_unstale":"2024-09-11T23:24:39.574610+0000","last_undegraded":"2024-09-11T23:24:39.574610+0000","last_fullsized":"2024-09-11T23:24:39.574610+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:43.829789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575859+0000","last_change":"2024-09-11T23:24:38.516241+0000","last_active":"2024-09-11T23:24:39.575859+0000","last_peered":"2024-09-11T23:24:39.575859+0000","last_clean":"2024-09-11T23:24:39.575859+0000","last_became_active":"2024-09-11T23:24:38.513758+0000","last_became_peered":"2024-09-11T23:24:38.513758+0000","last_unstale":"2024-09-11T23:24:39.575859+0000","last_undegraded":"2024-09-11T23:24:39.575859+0000","last_fullsized":"2024-09-11T23:24:39.575859+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:22.448677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"130'4","reported_seq":18,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575881+0000","last_change":"2024-09-11T23:24:37.506613+0000","last_active":"2024-09-11T23:24:39.575881+0000","last_peered":"2024-09-11T23:24:39.575881+0000","last_clean":"2024-09-11T23:24:39.575881+0000","last_became_active":"2024-09-11T23:24:37.506309+0000","last_became_peered":"2024-09-11T23:24:37.506309+0000","last_unstale":"2024-09-11T23:24:39.575881+0000","last_undegraded":"2024-09-11T23:24:39.575881+0000","last_fullsized":"2024-09-11T23:24:39.575881+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:54.726155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576257+0000","last_change":"2024-09-11T23:24:38.505440+0000","last_active":"2024-09-11T23:24:39.576257+0000","last_peered":"2024-09-11T23:24:39.576257+0000","last_clean":"2024-09-11T23:24:39.576257+0000","last_became_active":"2024-09-11T23:24:38.505009+0000","last_became_peered":"2024-09-11T23:24:38.505009+0000","last_unstale":"2024-09-11T23:24:39.576257+0000","last_undegraded":"2024-09-11T23:24:39.576257+0000","last_fullsized":"2024-09-11T23:24:39.576257+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:51.756561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576143+0000","last_change":"2024-09-11T23:24:37.505362+0000","last_active":"2024-09-11T23:24:39.576143+0000","last_peered":"2024-09-11T23:24:39.576143+0000","last_clean":"2024-09-11T23:24:39.576143+0000","last_became_active":"2024-09-11T23:24:37.505096+0000","last_became_peered":"2024-09-11T23:24:37.505096+0000","last_unstale":"2024-09-11T23:24:39.576143+0000","last_undegraded":"2024-09-11T23:24:39.576143+0000","last_fullsized":"2024-09-11T23:24:39.576143+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:37.164672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575220+0000","last_change":"2024-09-11T23:24:38.495286+0000","last_active":"2024-09-11T23:24:39.575220+0000","last_peered":"2024-09-11T23:24:39.575220+0000","last_clean":"2024-09-11T23:24:39.575220+0000","last_became_active":"2024-09-11T23:24:38.495017+0000","last_became_peered":"2024-09-11T23:24:38.495017+0000","last_unstale":"2024-09-11T23:24:39.575220+0000","last_undegraded":"2024-09-11T23:24:39.575220+0000","last_fullsized":"2024-09-11T23:24:39.575220+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:17.659464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507938+0000","last_change":"2024-09-11T23:24:37.503895+0000","last_active":"2024-09-11T23:24:39.507938+0000","last_peered":"2024-09-11T23:24:39.507938+0000","last_clean":"2024-09-11T23:24:39.507938+0000","last_became_active":"2024-09-11T23:24:37.503589+0000","last_became_peered":"2024-09-11T23:24:37.503589+0000","last_unstale":"2024-09-11T23:24:39.507938+0000","last_undegraded":"2024-09-11T23:24:39.507938+0000","last_fullsized":"2024-09-11T23:24:39.507938+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:43.414051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575756+0000","last_change":"2024-09-11T23:24:38.514805+0000","last_active":"2024-09-11T23:24:39.575756+0000","last_peered":"2024-09-11T23:24:39.575756+0000","last_clean":"2024-09-11T23:24:39.575756+0000","last_became_active":"2024-09-11T23:24:38.513704+0000","last_became_peered":"2024-09-11T23:24:38.513704+0000","last_unstale":"2024-09-11T23:24:39.575756+0000","last_undegraded":"2024-09-11T23:24:39.575756+0000","last_fullsized":"2024-09-11T23:24:39.575756+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:02.790667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507768+0000","last_change":"2024-09-11T23:24:37.492085+0000","last_active":"2024-09-11T23:24:39.507768+0000","last_peered":"2024-09-11T23:24:39.507768+0000","last_clean":"2024-09-11T23:24:39.507768+0000","last_became_active":"2024-09-11T23:24:37.491722+0000","last_became_peered":"2024-09-11T23:24:37.491722+0000","last_unstale":"2024-09-11T23:24:39.507768+0000","last_undegraded":"2024-09-11T23:24:39.507768+0000","last_fullsized":"2024-09-11T23:24:39.507768+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:07.838799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575606+0000","last_change":"2024-09-11T23:24:38.514679+0000","last_active":"2024-09-11T23:24:39.575606+0000","last_peered":"2024-09-11T23:24:39.575606+0000","last_clean":"2024-09-11T23:24:39.575606+0000","last_became_active":"2024-09-11T23:24:38.514405+0000","last_became_peered":"2024-09-11T23:24:38.514405+0000","last_unstale":"2024-09-11T23:24:39.575606+0000","last_undegraded":"2024-09-11T23:24:39.575606+0000","last_fullsized":"2024-09-11T23:24:39.575606+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:28.857370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574554+0000","last_change":"2024-09-11T23:24:37.504197+0000","last_active":"2024-09-11T23:24:39.574554+0000","last_peered":"2024-09-11T23:24:39.574554+0000","last_clean":"2024-09-11T23:24:39.574554+0000","last_became_active":"2024-09-11T23:24:37.503944+0000","last_became_peered":"2024-09-11T23:24:37.503944+0000","last_unstale":"2024-09-11T23:24:39.574554+0000","last_undegraded":"2024-09-11T23:24:39.574554+0000","last_fullsized":"2024-09-11T23:24:39.574554+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:11.845210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507257+0000","last_change":"2024-09-11T23:24:38.510117+0000","last_active":"2024-09-11T23:24:39.507257+0000","last_peered":"2024-09-11T23:24:39.507257+0000","last_clean":"2024-09-11T23:24:39.507257+0000","last_became_active":"2024-09-11T23:24:38.509815+0000","last_became_peered":"2024-09-11T23:24:38.509815+0000","last_unstale":"2024-09-11T23:24:39.507257+0000","last_undegraded":"2024-09-11T23:24:39.507257+0000","last_fullsized":"2024-09-11T23:24:39.507257+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:18.528825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.506326+0000","last_change":"2024-09-11T23:24:37.504453+0000","last_active":"2024-09-11T23:24:39.506326+0000","last_peered":"2024-09-11T23:24:39.506326+0000","last_clean":"2024-09-11T23:24:39.506326+0000","last_became_active":"2024-09-11T23:24:37.504084+0000","last_became_peered":"2024-09-11T23:24:37.504084+0000","last_unstale":"2024-09-11T23:24:39.506326+0000","last_undegraded":"2024-09-11T23:24:39.506326+0000","last_fullsized":"2024-09-11T23:24:39.506326+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:36.538666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574290+0000","last_change":"2024-09-11T23:24:38.507202+0000","last_active":"2024-09-11T23:24:39.574290+0000","last_peered":"2024-09-11T23:24:39.574290+0000","last_clean":"2024-09-11T23:24:39.574290+0000","last_became_active":"2024-09-11T23:24:38.506929+0000","last_became_peered":"2024-09-11T23:24:38.506929+0000","last_unstale":"2024-09-11T23:24:39.574290+0000","last_undegraded":"2024-09-11T23:24:39.574290+0000","last_fullsized":"2024-09-11T23:24:39.574290+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:07.414844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574315+0000","last_change":"2024-09-11T23:24:37.499614+0000","last_active":"2024-09-11T23:24:39.574315+0000","last_peered":"2024-09-11T23:24:39.574315+0000","last_clean":"2024-09-11T23:24:39.574315+0000","last_became_active":"2024-09-11T23:24:37.499330+0000","last_became_peered":"2024-09-11T23:24:37.499330+0000","last_unstale":"2024-09-11T23:24:39.574315+0000","last_undegraded":"2024-09-11T23:24:39.574315+0000","last_fullsized":"2024-09-11T23:24:39.574315+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:41.077471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.506814+0000","last_change":"2024-09-11T23:24:38.518129+0000","last_active":"2024-09-11T23:24:39.506814+0000","last_peered":"2024-09-11T23:24:39.506814+0000","last_clean":"2024-09-11T23:24:39.506814+0000","last_became_active":"2024-09-11T23:24:38.517833+0000","last_became_peered":"2024-09-11T23:24:38.517833+0000","last_unstale":"2024-09-11T23:24:39.506814+0000","last_undegraded":"2024-09-11T23:24:39.506814+0000","last_fullsized":"2024-09-11T23:24:39.506814+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:36.996086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.506704+0000","last_change":"2024-09-11T23:24:37.497100+0000","last_active":"2024-09-11T23:24:39.506704+0000","last_peered":"2024-09-11T23:24:39.506704+0000","last_clean":"2024-09-11T23:24:39.506704+0000","last_became_active":"2024-09-11T23:24:37.496824+0000","last_became_peered":"2024-09-11T23:24:37.496824+0000","last_unstale":"2024-09-11T23:24:39.506704+0000","last_undegraded":"2024-09-11T23:24:39.506704+0000","last_fullsized":"2024-09-11T23:24:39.506704+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:17.216284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.506582+0000","last_change":"2024-09-11T23:24:38.514999+0000","last_active":"2024-09-11T23:24:39.506582+0000","last_peered":"2024-09-11T23:24:39.506582+0000","last_clean":"2024-09-11T23:24:39.506582+0000","last_became_active":"2024-09-11T23:24:38.514697+0000","last_became_peered":"2024-09-11T23:24:38.514697+0000","last_unstale":"2024-09-11T23:24:39.506582+0000","last_undegraded":"2024-09-11T23:24:39.506582+0000","last_fullsized":"2024-09-11T23:24:39.506582+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:26.913190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576056+0000","last_change":"2024-09-11T23:24:37.502826+0000","last_active":"2024-09-11T23:24:39.576056+0000","last_peered":"2024-09-11T23:24:39.576056+0000","last_clean":"2024-09-11T23:24:39.576056+0000","last_became_active":"2024-09-11T23:24:37.502546+0000","last_became_peered":"2024-09-11T23:24:37.502546+0000","last_unstale":"2024-09-11T23:24:39.576056+0000","last_undegraded":"2024-09-11T23:24:39.576056+0000","last_fullsized":"2024-09-11T23:24:39.576056+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:10.667329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575882+0000","last_change":"2024-09-11T23:24:38.514174+0000","last_active":"2024-09-11T23:24:39.575882+0000","last_peered":"2024-09-11T23:24:39.575882+0000","last_clean":"2024-09-11T23:24:39.575882+0000","last_became_active":"2024-09-11T23:24:38.513801+0000","last_became_peered":"2024-09-11T23:24:38.513801+0000","last_unstale":"2024-09-11T23:24:39.575882+0000","last_undegraded":"2024-09-11T23:24:39.575882+0000","last_fullsized":"2024-09-11T23:24:39.575882+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:35.685427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576139+0000","last_change":"2024-09-11T23:24:37.504782+0000","last_active":"2024-09-11T23:24:39.576139+0000","last_peered":"2024-09-11T23:24:39.576139+0000","last_clean":"2024-09-11T23:24:39.576139+0000","last_became_active":"2024-09-11T23:24:37.504363+0000","last_became_peered":"2024-09-11T23:24:37.504363+0000","last_unstale":"2024-09-11T23:24:39.576139+0000","last_undegraded":"2024-09-11T23:24:39.576139+0000","last_fullsized":"2024-09-11T23:24:39.576139+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:04.674150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575835+0000","last_change":"2024-09-11T23:24:38.511550+0000","last_active":"2024-09-11T23:24:39.575835+0000","last_peered":"2024-09-11T23:24:39.575835+0000","last_clean":"2024-09-11T23:24:39.575835+0000","last_became_active":"2024-09-11T23:24:38.511388+0000","last_became_peered":"2024-09-11T23:24:38.511388+0000","last_unstale":"2024-09-11T23:24:39.575835+0000","last_undegraded":"2024-09-11T23:24:39.575835+0000","last_fullsized":"2024-09-11T23:24:39.575835+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:03.548410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"130'6","reported_seq":20,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.502723+0000","last_change":"2024-09-11T23:24:37.504292+0000","last_active":"2024-09-11T23:24:39.502723+0000","last_peered":"2024-09-11T23:24:39.502723+0000","last_clean":"2024-09-11T23:24:39.502723+0000","last_became_active":"2024-09-11T23:24:37.504034+0000","last_became_peered":"2024-09-11T23:24:37.504034+0000","last_unstale":"2024-09-11T23:24:39.502723+0000","last_undegraded":"2024-09-11T23:24:39.502723+0000","last_fullsized":"2024-09-11T23:24:39.502723+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:55.134972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574985+0000","last_change":"2024-09-11T23:24:38.504806+0000","last_active":"2024-09-11T23:24:39.574985+0000","last_peered":"2024-09-11T23:24:39.574985+0000","last_clean":"2024-09-11T23:24:39.574985+0000","last_became_active":"2024-09-11T23:24:38.504488+0000","last_became_peered":"2024-09-11T23:24:38.504488+0000","last_unstale":"2024-09-11T23:24:39.574985+0000","last_undegraded":"2024-09-11T23:24:39.574985+0000","last_fullsized":"2024-09-11T23:24:39.574985+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:54.981251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575105+0000","last_change":"2024-09-11T23:24:37.504947+0000","last_active":"2024-09-11T23:24:39.575105+0000","last_peered":"2024-09-11T23:24:39.575105+0000","last_clean":"2024-09-11T23:24:39.575105+0000","last_became_active":"2024-09-11T23:24:37.504605+0000","last_became_peered":"2024-09-11T23:24:37.504605+0000","last_unstale":"2024-09-11T23:24:39.575105+0000","last_undegraded":"2024-09-11T23:24:39.575105+0000","last_fullsized":"2024-09-11T23:24:39.575105+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:35.993028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575590+0000","last_change":"2024-09-11T23:24:38.505581+0000","last_active":"2024-09-11T23:24:39.575590+0000","last_peered":"2024-09-11T23:24:39.575590+0000","last_clean":"2024-09-11T23:24:39.575590+0000","last_became_active":"2024-09-11T23:24:38.505220+0000","last_became_peered":"2024-09-11T23:24:38.505220+0000","last_unstale":"2024-09-11T23:24:39.575590+0000","last_undegraded":"2024-09-11T23:24:39.575590+0000","last_fullsized":"2024-09-11T23:24:39.575590+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:07.543877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574969+0000","last_change":"2024-09-11T23:24:37.497776+0000","last_active":"2024-09-11T23:24:39.574969+0000","last_peered":"2024-09-11T23:24:39.574969+0000","last_clean":"2024-09-11T23:24:39.574969+0000","last_became_active":"2024-09-11T23:24:37.497500+0000","last_became_peered":"2024-09-11T23:24:37.497500+0000","last_unstale":"2024-09-11T23:24:39.574969+0000","last_undegraded":"2024-09-11T23:24:39.574969+0000","last_fullsized":"2024-09-11T23:24:39.574969+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:08.918002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.506573+0000","last_change":"2024-09-11T23:24:38.519430+0000","last_active":"2024-09-11T23:24:39.506573+0000","last_peered":"2024-09-11T23:24:39.506573+0000","last_clean":"2024-09-11T23:24:39.506573+0000","last_became_active":"2024-09-11T23:24:38.519080+0000","last_became_peered":"2024-09-11T23:24:38.519080+0000","last_unstale":"2024-09-11T23:24:39.506573+0000","last_undegraded":"2024-09-11T23:24:39.506573+0000","last_fullsized":"2024-09-11T23:24:39.506573+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:30.572611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574409+0000","last_change":"2024-09-11T23:24:37.503731+0000","last_active":"2024-09-11T23:24:39.574409+0000","last_peered":"2024-09-11T23:24:39.574409+0000","last_clean":"2024-09-11T23:24:39.574409+0000","last_became_active":"2024-09-11T23:24:37.503476+0000","last_became_peered":"2024-09-11T23:24:37.503476+0000","last_unstale":"2024-09-11T23:24:39.574409+0000","last_undegraded":"2024-09-11T23:24:39.574409+0000","last_fullsized":"2024-09-11T23:24:39.574409+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:11.589412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574709+0000","last_change":"2024-09-11T23:24:38.504289+0000","last_active":"2024-09-11T23:24:39.574709+0000","last_peered":"2024-09-11T23:24:39.574709+0000","last_clean":"2024-09-11T23:24:39.574709+0000","last_became_active":"2024-09-11T23:24:38.503977+0000","last_became_peered":"2024-09-11T23:24:38.503977+0000","last_unstale":"2024-09-11T23:24:39.574709+0000","last_undegraded":"2024-09-11T23:24:39.574709+0000","last_fullsized":"2024-09-11T23:24:39.574709+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:01.254826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"130'8","reported_seq":22,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574728+0000","last_change":"2024-09-11T23:24:37.499221+0000","last_active":"2024-09-11T23:24:39.574728+0000","last_peered":"2024-09-11T23:24:39.574728+0000","last_clean":"2024-09-11T23:24:39.574728+0000","last_became_active":"2024-09-11T23:24:37.498966+0000","last_became_peered":"2024-09-11T23:24:37.498966+0000","last_unstale":"2024-09-11T23:24:39.574728+0000","last_undegraded":"2024-09-11T23:24:39.574728+0000","last_fullsized":"2024-09-11T23:24:39.574728+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:07.910553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576041+0000","last_change":"2024-09-11T23:24:38.522246+0000","last_active":"2024-09-11T23:24:39.576041+0000","last_peered":"2024-09-11T23:24:39.576041+0000","last_clean":"2024-09-11T23:24:39.576041+0000","last_became_active":"2024-09-11T23:24:38.521675+0000","last_became_peered":"2024-09-11T23:24:38.521675+0000","last_unstale":"2024-09-11T23:24:39.576041+0000","last_undegraded":"2024-09-11T23:24:39.576041+0000","last_fullsized":"2024-09-11T23:24:39.576041+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:43.845287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.506551+0000","last_change":"2024-09-11T23:24:37.497172+0000","last_active":"2024-09-11T23:24:39.506551+0000","last_peered":"2024-09-11T23:24:39.506551+0000","last_clean":"2024-09-11T23:24:39.506551+0000","last_became_active":"2024-09-11T23:24:37.496588+0000","last_became_peered":"2024-09-11T23:24:37.496588+0000","last_unstale":"2024-09-11T23:24:39.506551+0000","last_undegraded":"2024-09-11T23:24:39.506551+0000","last_fullsized":"2024-09-11T23:24:39.506551+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:37.340507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576259+0000","last_change":"2024-09-11T23:24:38.518000+0000","last_active":"2024-09-11T23:24:39.576259+0000","last_peered":"2024-09-11T23:24:39.576259+0000","last_clean":"2024-09-11T23:24:39.576259+0000","last_became_active":"2024-09-11T23:24:38.517683+0000","last_became_peered":"2024-09-11T23:24:38.517683+0000","last_unstale":"2024-09-11T23:24:39.576259+0000","last_undegraded":"2024-09-11T23:24:39.576259+0000","last_fullsized":"2024-09-11T23:24:39.576259+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:49.782305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575843+0000","last_change":"2024-09-11T23:24:37.501850+0000","last_active":"2024-09-11T23:24:39.575843+0000","last_peered":"2024-09-11T23:24:39.575843+0000","last_clean":"2024-09-11T23:24:39.575843+0000","last_became_active":"2024-09-11T23:24:37.500774+0000","last_became_peered":"2024-09-11T23:24:37.500774+0000","last_unstale":"2024-09-11T23:24:39.575843+0000","last_undegraded":"2024-09-11T23:24:39.575843+0000","last_fullsized":"2024-09-11T23:24:39.575843+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:16.647256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575273+0000","last_change":"2024-09-11T23:24:38.507367+0000","last_active":"2024-09-11T23:24:39.575273+0000","last_peered":"2024-09-11T23:24:39.575273+0000","last_clean":"2024-09-11T23:24:39.575273+0000","last_became_active":"2024-09-11T23:24:38.507045+0000","last_became_peered":"2024-09-11T23:24:38.507045+0000","last_unstale":"2024-09-11T23:24:39.575273+0000","last_undegraded":"2024-09-11T23:24:39.575273+0000","last_fullsized":"2024-09-11T23:24:39.575273+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:37.191719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576073+0000","last_change":"2024-09-11T23:24:37.504201+0000","last_active":"2024-09-11T23:24:39.576073+0000","last_peered":"2024-09-11T23:24:39.576073+0000","last_clean":"2024-09-11T23:24:39.576073+0000","last_became_active":"2024-09-11T23:24:37.503912+0000","last_became_peered":"2024-09-11T23:24:37.503912+0000","last_unstale":"2024-09-11T23:24:39.576073+0000","last_undegraded":"2024-09-11T23:24:39.576073+0000","last_fullsized":"2024-09-11T23:24:39.576073+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:17.942968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574984+0000","last_change":"2024-09-11T23:24:38.497451+0000","last_active":"2024-09-11T23:24:39.574984+0000","last_peered":"2024-09-11T23:24:39.574984+0000","last_clean":"2024-09-11T23:24:39.574984+0000","last_became_active":"2024-09-11T23:24:38.497128+0000","last_became_peered":"2024-09-11T23:24:38.497128+0000","last_unstale":"2024-09-11T23:24:39.574984+0000","last_undegraded":"2024-09-11T23:24:39.574984+0000","last_fullsized":"2024-09-11T23:24:39.574984+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:45.402512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575692+0000","last_change":"2024-09-11T23:24:37.500219+0000","last_active":"2024-09-11T23:24:39.575692+0000","last_peered":"2024-09-11T23:24:39.575692+0000","last_clean":"2024-09-11T23:24:39.575692+0000","last_became_active":"2024-09-11T23:24:37.499968+0000","last_became_peered":"2024-09-11T23:24:37.499968+0000","last_unstale":"2024-09-11T23:24:39.575692+0000","last_undegraded":"2024-09-11T23:24:39.575692+0000","last_fullsized":"2024-09-11T23:24:39.575692+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:34.918647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507411+0000","last_change":"2024-09-11T23:24:38.495465+0000","last_active":"2024-09-11T23:24:39.507411+0000","last_peered":"2024-09-11T23:24:39.507411+0000","last_clean":"2024-09-11T23:24:39.507411+0000","last_became_active":"2024-09-11T23:24:38.495093+0000","last_became_peered":"2024-09-11T23:24:38.495093+0000","last_unstale":"2024-09-11T23:24:39.507411+0000","last_undegraded":"2024-09-11T23:24:39.507411+0000","last_fullsized":"2024-09-11T23:24:39.507411+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:12.661571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.502935+0000","last_change":"2024-09-11T23:24:37.500170+0000","last_active":"2024-09-11T23:24:39.502935+0000","last_peered":"2024-09-11T23:24:39.502935+0000","last_clean":"2024-09-11T23:24:39.502935+0000","last_became_active":"2024-09-11T23:24:37.499881+0000","last_became_peered":"2024-09-11T23:24:37.499881+0000","last_unstale":"2024-09-11T23:24:39.502935+0000","last_undegraded":"2024-09-11T23:24:39.502935+0000","last_fullsized":"2024-09-11T23:24:39.502935+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:21.602369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.502718+0000","last_change":"2024-09-11T23:24:38.508082+0000","last_active":"2024-09-11T23:24:39.502718+0000","last_peered":"2024-09-11T23:24:39.502718+0000","last_clean":"2024-09-11T23:24:39.502718+0000","last_became_active":"2024-09-11T23:24:38.507597+0000","last_became_peered":"2024-09-11T23:24:38.507597+0000","last_unstale":"2024-09-11T23:24:39.502718+0000","last_undegraded":"2024-09-11T23:24:39.502718+0000","last_fullsized":"2024-09-11T23:24:39.502718+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:29.754512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575296+0000","last_change":"2024-09-11T23:24:37.504049+0000","last_active":"2024-09-11T23:24:39.575296+0000","last_peered":"2024-09-11T23:24:39.575296+0000","last_clean":"2024-09-11T23:24:39.575296+0000","last_became_active":"2024-09-11T23:24:37.503680+0000","last_became_peered":"2024-09-11T23:24:37.503680+0000","last_unstale":"2024-09-11T23:24:39.575296+0000","last_undegraded":"2024-09-11T23:24:39.575296+0000","last_fullsized":"2024-09-11T23:24:39.575296+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:19.607889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.506694+0000","last_change":"2024-09-11T23:24:38.498638+0000","last_active":"2024-09-11T23:24:39.506694+0000","last_peered":"2024-09-11T23:24:39.506694+0000","last_clean":"2024-09-11T23:24:39.506694+0000","last_became_active":"2024-09-11T23:24:38.498318+0000","last_became_peered":"2024-09-11T23:24:38.498318+0000","last_unstale":"2024-09-11T23:24:39.506694+0000","last_undegraded":"2024-09-11T23:24:39.506694+0000","last_fullsized":"2024-09-11T23:24:39.506694+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:17.659464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574859+0000","last_change":"2024-09-11T23:24:37.501114+0000","last_active":"2024-09-11T23:24:39.574859+0000","last_peered":"2024-09-11T23:24:39.574859+0000","last_clean":"2024-09-11T23:24:39.574859+0000","last_became_active":"2024-09-11T23:24:37.500854+0000","last_became_peered":"2024-09-11T23:24:37.500854+0000","last_unstale":"2024-09-11T23:24:39.574859+0000","last_undegraded":"2024-09-11T23:24:39.574859+0000","last_fullsized":"2024-09-11T23:24:39.574859+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:55.288141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.502495+0000","last_change":"2024-09-11T23:24:38.508608+0000","last_active":"2024-09-11T23:24:39.502495+0000","last_peered":"2024-09-11T23:24:39.502495+0000","last_clean":"2024-09-11T23:24:39.502495+0000","last_became_active":"2024-09-11T23:24:38.507720+0000","last_became_peered":"2024-09-11T23:24:38.507720+0000","last_unstale":"2024-09-11T23:24:39.502495+0000","last_undegraded":"2024-09-11T23:24:39.502495+0000","last_fullsized":"2024-09-11T23:24:39.502495+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:10.872794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574645+0000","last_change":"2024-09-11T23:24:37.499476+0000","last_active":"2024-09-11T23:24:39.574645+0000","last_peered":"2024-09-11T23:24:39.574645+0000","last_clean":"2024-09-11T23:24:39.574645+0000","last_became_active":"2024-09-11T23:24:37.499203+0000","last_became_peered":"2024-09-11T23:24:37.499203+0000","last_unstale":"2024-09-11T23:24:39.574645+0000","last_undegraded":"2024-09-11T23:24:39.574645+0000","last_fullsized":"2024-09-11T23:24:39.574645+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:25.910132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.506694+0000","last_change":"2024-09-11T23:24:38.518269+0000","last_active":"2024-09-11T23:24:39.506694+0000","last_peered":"2024-09-11T23:24:39.506694+0000","last_clean":"2024-09-11T23:24:39.506694+0000","last_became_active":"2024-09-11T23:24:38.517865+0000","last_became_peered":"2024-09-11T23:24:38.517865+0000","last_unstale":"2024-09-11T23:24:39.506694+0000","last_undegraded":"2024-09-11T23:24:39.506694+0000","last_fullsized":"2024-09-11T23:24:39.506694+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:19.576781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576017+0000","last_change":"2024-09-11T23:24:37.503202+0000","last_active":"2024-09-11T23:24:39.576017+0000","last_peered":"2024-09-11T23:24:39.576017+0000","last_clean":"2024-09-11T23:24:39.576017+0000","last_became_active":"2024-09-11T23:24:37.502879+0000","last_became_peered":"2024-09-11T23:24:37.502879+0000","last_unstale":"2024-09-11T23:24:39.576017+0000","last_undegraded":"2024-09-11T23:24:39.576017+0000","last_fullsized":"2024-09-11T23:24:39.576017+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.386567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575933+0000","last_change":"2024-09-11T23:24:38.500288+0000","last_active":"2024-09-11T23:24:39.575933+0000","last_peered":"2024-09-11T23:24:39.575933+0000","last_clean":"2024-09-11T23:24:39.575933+0000","last_became_active":"2024-09-11T23:24:38.499878+0000","last_became_peered":"2024-09-11T23:24:38.499878+0000","last_unstale":"2024-09-11T23:24:39.575933+0000","last_undegraded":"2024-09-11T23:24:39.575933+0000","last_fullsized":"2024-09-11T23:24:39.575933+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:13.412283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"131'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:40.494559+0000","last_change":"2024-09-11T23:24:37.494466+0000","last_active":"2024-09-11T23:24:40.494559+0000","last_peered":"2024-09-11T23:24:40.494559+0000","last_clean":"2024-09-11T23:24:40.494559+0000","last_became_active":"2024-09-11T23:24:37.494210+0000","last_became_peered":"2024-09-11T23:24:37.494210+0000","last_unstale":"2024-09-11T23:24:40.494559+0000","last_undegraded":"2024-09-11T23:24:40.494559+0000","last_fullsized":"2024-09-11T23:24:40.494559+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:23.202290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576342+0000","last_change":"2024-09-11T23:24:38.514064+0000","last_active":"2024-09-11T23:24:39.576342+0000","last_peered":"2024-09-11T23:24:39.576342+0000","last_clean":"2024-09-11T23:24:39.576342+0000","last_became_active":"2024-09-11T23:24:38.513785+0000","last_became_peered":"2024-09-11T23:24:38.513785+0000","last_unstale":"2024-09-11T23:24:39.576342+0000","last_undegraded":"2024-09-11T23:24:39.576342+0000","last_fullsized":"2024-09-11T23:24:39.576342+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:43.077685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575366+0000","last_change":"2024-09-11T23:24:37.499159+0000","last_active":"2024-09-11T23:24:39.575366+0000","last_peered":"2024-09-11T23:24:39.575366+0000","last_clean":"2024-09-11T23:24:39.575366+0000","last_became_active":"2024-09-11T23:24:37.498863+0000","last_became_peered":"2024-09-11T23:24:37.498863+0000","last_unstale":"2024-09-11T23:24:39.575366+0000","last_undegraded":"2024-09-11T23:24:39.575366+0000","last_fullsized":"2024-09-11T23:24:39.575366+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:25.910132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575117+0000","last_change":"2024-09-11T23:24:38.496070+0000","last_active":"2024-09-11T23:24:39.575117+0000","last_peered":"2024-09-11T23:24:39.575117+0000","last_clean":"2024-09-11T23:24:39.575117+0000","last_became_active":"2024-09-11T23:24:38.495632+0000","last_became_peered":"2024-09-11T23:24:38.495632+0000","last_unstale":"2024-09-11T23:24:39.575117+0000","last_undegraded":"2024-09-11T23:24:39.575117+0000","last_fullsized":"2024-09-11T23:24:39.575117+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:13.412283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575380+0000","last_change":"2024-09-11T23:24:37.501506+0000","last_active":"2024-09-11T23:24:39.575380+0000","last_peered":"2024-09-11T23:24:39.575380+0000","last_clean":"2024-09-11T23:24:39.575380+0000","last_became_active":"2024-09-11T23:24:37.501272+0000","last_became_peered":"2024-09-11T23:24:37.501272+0000","last_unstale":"2024-09-11T23:24:39.575380+0000","last_undegraded":"2024-09-11T23:24:39.575380+0000","last_fullsized":"2024-09-11T23:24:39.575380+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:29.569552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574716+0000","last_change":"2024-09-11T23:24:38.511510+0000","last_active":"2024-09-11T23:24:39.574716+0000","last_peered":"2024-09-11T23:24:39.574716+0000","last_clean":"2024-09-11T23:24:39.574716+0000","last_became_active":"2024-09-11T23:24:38.511239+0000","last_became_peered":"2024-09-11T23:24:38.511239+0000","last_unstale":"2024-09-11T23:24:39.574716+0000","last_undegraded":"2024-09-11T23:24:39.574716+0000","last_fullsized":"2024-09-11T23:24:39.574716+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:26.954920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.502831+0000","last_change":"2024-09-11T23:24:37.506005+0000","last_active":"2024-09-11T23:24:39.502831+0000","last_peered":"2024-09-11T23:24:39.502831+0000","last_clean":"2024-09-11T23:24:39.502831+0000","last_became_active":"2024-09-11T23:24:37.504818+0000","last_became_peered":"2024-09-11T23:24:37.504818+0000","last_unstale":"2024-09-11T23:24:39.502831+0000","last_undegraded":"2024-09-11T23:24:39.502831+0000","last_fullsized":"2024-09-11T23:24:39.502831+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:31.603564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507081+0000","last_change":"2024-09-11T23:24:38.514795+0000","last_active":"2024-09-11T23:24:39.507081+0000","last_peered":"2024-09-11T23:24:39.507081+0000","last_clean":"2024-09-11T23:24:39.507081+0000","last_became_active":"2024-09-11T23:24:38.514497+0000","last_became_peered":"2024-09-11T23:24:38.514497+0000","last_unstale":"2024-09-11T23:24:39.507081+0000","last_undegraded":"2024-09-11T23:24:39.507081+0000","last_fullsized":"2024-09-11T23:24:39.507081+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:39.760701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575432+0000","last_change":"2024-09-11T23:24:37.502249+0000","last_active":"2024-09-11T23:24:39.575432+0000","last_peered":"2024-09-11T23:24:39.575432+0000","last_clean":"2024-09-11T23:24:39.575432+0000","last_became_active":"2024-09-11T23:24:37.501351+0000","last_became_peered":"2024-09-11T23:24:37.501351+0000","last_unstale":"2024-09-11T23:24:39.575432+0000","last_undegraded":"2024-09-11T23:24:39.575432+0000","last_fullsized":"2024-09-11T23:24:39.575432+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:17.942985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574858+0000","last_change":"2024-09-11T23:24:38.514642+0000","last_active":"2024-09-11T23:24:39.574858+0000","last_peered":"2024-09-11T23:24:39.574858+0000","last_clean":"2024-09-11T23:24:39.574858+0000","last_became_active":"2024-09-11T23:24:38.514029+0000","last_became_peered":"2024-09-11T23:24:38.514029+0000","last_unstale":"2024-09-11T23:24:39.574858+0000","last_undegraded":"2024-09-11T23:24:39.574858+0000","last_fullsized":"2024-09-11T23:24:39.574858+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:22.605428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574678+0000","last_change":"2024-09-11T23:24:37.506394+0000","last_active":"2024-09-11T23:24:39.574678+0000","last_peered":"2024-09-11T23:24:39.574678+0000","last_clean":"2024-09-11T23:24:39.574678+0000","last_became_active":"2024-09-11T23:24:37.506052+0000","last_became_peered":"2024-09-11T23:24:37.506052+0000","last_unstale":"2024-09-11T23:24:39.574678+0000","last_undegraded":"2024-09-11T23:24:39.574678+0000","last_fullsized":"2024-09-11T23:24:39.574678+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:18.573723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.506710+0000","last_change":"2024-09-11T23:24:38.515310+0000","last_active":"2024-09-11T23:24:39.506710+0000","last_peered":"2024-09-11T23:24:39.506710+0000","last_clean":"2024-09-11T23:24:39.506710+0000","last_became_active":"2024-09-11T23:24:38.515042+0000","last_became_peered":"2024-09-11T23:24:38.515042+0000","last_unstale":"2024-09-11T23:24:39.506710+0000","last_undegraded":"2024-09-11T23:24:39.506710+0000","last_fullsized":"2024-09-11T23:24:39.506710+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:09.921060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574517+0000","last_change":"2024-09-11T23:24:37.498140+0000","last_active":"2024-09-11T23:24:39.574517+0000","last_peered":"2024-09-11T23:24:39.574517+0000","last_clean":"2024-09-11T23:24:39.574517+0000","last_became_active":"2024-09-11T23:24:37.497858+0000","last_became_peered":"2024-09-11T23:24:37.497858+0000","last_unstale":"2024-09-11T23:24:39.574517+0000","last_undegraded":"2024-09-11T23:24:39.574517+0000","last_fullsized":"2024-09-11T23:24:39.574517+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:24.856592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.502722+0000","last_change":"2024-09-11T23:24:38.501453+0000","last_active":"2024-09-11T23:24:39.502722+0000","last_peered":"2024-09-11T23:24:39.502722+0000","last_clean":"2024-09-11T23:24:39.502722+0000","last_became_active":"2024-09-11T23:24:38.501088+0000","last_became_peered":"2024-09-11T23:24:38.501088+0000","last_unstale":"2024-09-11T23:24:39.502722+0000","last_undegraded":"2024-09-11T23:24:39.502722+0000","last_fullsized":"2024-09-11T23:24:39.502722+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:54.009537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"130'3","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575468+0000","last_change":"2024-09-11T23:24:37.499303+0000","last_active":"2024-09-11T23:24:39.575468+0000","last_peered":"2024-09-11T23:24:39.575468+0000","last_clean":"2024-09-11T23:24:39.575468+0000","last_became_active":"2024-09-11T23:24:37.498975+0000","last_became_peered":"2024-09-11T23:24:37.498975+0000","last_unstale":"2024-09-11T23:24:39.575468+0000","last_undegraded":"2024-09-11T23:24:39.575468+0000","last_fullsized":"2024-09-11T23:24:39.575468+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:36.260563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":413,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574877+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:24:39.574877+0000","last_peered":"2024-09-11T23:24:39.574877+0000","last_clean":"2024-09-11T23:24:39.574877+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:24:39.574877+0000","last_undegraded":"2024-09-11T23:24:39.574877+0000","last_fullsized":"2024-09-11T23:24:39.574877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476823,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33376,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338464,"statfs":{"total":96636764160,"available":96602587136,"internally_reserved":0,"allocated":2232320,"data_stored":1309571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476822,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32796,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339044,"statfs":{"total":96636764160,"available":96603181056,"internally_reserved":0,"allocated":1642496,"data_stored":718697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476821,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32792,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339048,"statfs":{"total":96636764160,"available":96603185152,"internally_reserved":0,"allocated":1634304,"data_stored":718573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476821,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1630208,"data_stored":718551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542230,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1634304,"data_stored":718641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542230,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32800,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339040,"statfs":{"total":96636764160,"available":96603176960,"internally_reserved":0,"allocated":1646592,"data_stored":720233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509526,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32784,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339056,"statfs":{"total":96636764160,"available":96603193344,"internally_reserved":0,"allocated":1634304,"data_stored":719133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509526,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33380,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338460,"statfs":{"total":96636764160,"available":96602583040,"internally_reserved":0,"allocated":2240512,"data_stored":1310565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:24:42.680 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:24:42.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.869+0000 7f76f5200640 1 Processor -- start 2024-09-11T23:24:42.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.869+0000 7f76f5200640 1 -- start start 2024-09-11T23:24:42.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.870+0000 7f76f5200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f76f015e640 0x7f76f00d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:42.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.870+0000 7f76f5200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f006bee0 con 0x7f76f00d3f60 2024-09-11T23:24:42.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.870+0000 7f76f5200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f006c1c0 con 0x7f76f00b66e0 2024-09-11T23:24:42.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.870+0000 7f76f5200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f76f015ea20 con 0x7f76f015e640 2024-09-11T23:24:42.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.870+0000 7f76eea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f76f00d3f60 0x7f76f00b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54344/0 (socket says 172.21.15.144:54344) 2024-09-11T23:24:42.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.870+0000 7f76eea00640 1 -- 172.21.15.144:0/348359410 learned_addr learned my addr 172.21.15.144:0/348359410 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:42.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.870+0000 7f76ef400640 1 --2- 172.21.15.144:0/348359410 >> v2:172.21.15.144:3300/0 conn(0x7f76f015e640 0x7f76f00d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:42.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.871+0000 7f76ef400640 1 -- 172.21.15.144:0/348359410 >> v1:172.21.15.165:6789/0 conn(0x7f76f00b66e0 legacy=0x7f76f00b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:42.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.871+0000 7f76ef400640 1 -- 172.21.15.144:0/348359410 >> v1:172.21.15.144:6789/0 conn(0x7f76f00d3f60 legacy=0x7f76f00b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:42.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.871+0000 7f76ef400640 1 -- 172.21.15.144:0/348359410 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f006c4a0 con 0x7f76f015e640 2024-09-11T23:24:42.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.871+0000 7f76ee000640 1 -- 172.21.15.144:0/348359410 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3703744568 0 0) 0x7f76f006bee0 con 0x7f76f00d3f60 2024-09-11T23:24:42.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.872+0000 7f76ef400640 1 --2- 172.21.15.144:0/348359410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f015e640 0x7f76f00d3a20 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f76e00097a0 tx=0x7f76e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe2097282301acb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:42.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.872+0000 7f76ee000640 1 -- 172.21.15.144:0/348359410 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e0037070 con 0x7f76f015e640 2024-09-11T23:24:42.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.872+0000 7f76ee000640 1 -- 172.21.15.144:0/348359410 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e0032440 con 0x7f76f015e640 2024-09-11T23:24:42.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.872+0000 7f76ee000640 1 -- 172.21.15.144:0/348359410 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e0032810 con 0x7f76f015e640 2024-09-11T23:24:42.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.873+0000 7f76f5200640 1 -- 172.21.15.144:0/348359410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f015e640 msgr2=0x7f76f00d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:42.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.873+0000 7f76f5200640 1 --2- 172.21.15.144:0/348359410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f015e640 0x7f76f00d3a20 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f76e00097a0 tx=0x7f76e002a1e0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.873+0000 7f76f5200640 1 -- 172.21.15.144:0/348359410 shutdown_connections 2024-09-11T23:24:42.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.873+0000 7f76f5200640 1 --2- 172.21.15.144:0/348359410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f015e640 0x7f76f00d3a20 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.873+0000 7f76f5200640 1 -- 172.21.15.144:0/348359410 >> 172.21.15.144:0/348359410 conn(0x7f76f00d0fd0 msgr2=0x7f76f00d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:42.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.873+0000 7f76f5200640 1 -- 172.21.15.144:0/348359410 shutdown_connections 2024-09-11T23:24:42.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.873+0000 7f76f5200640 1 -- 172.21.15.144:0/348359410 wait complete. 2024-09-11T23:24:42.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.874+0000 7f76f5200640 1 Processor -- start 2024-09-11T23:24:42.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.874+0000 7f76f5200640 1 -- start start 2024-09-11T23:24:42.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.875+0000 7f76f5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f00b66e0 0x7f76f015cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:42.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.875+0000 7f76f5200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76f00d3f60 0x7f76f00b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:42.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.875+0000 7f76f5200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76f015e640 0x7f76f0160470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:42.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.875+0000 7f76f5200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f76f00b7e60 con 0x7f76f00b66e0 2024-09-11T23:24:42.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.875+0000 7f76f5200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f76f006caf0 con 0x7f76f015e640 2024-09-11T23:24:42.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.875+0000 7f76f5200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f76f00b7fe0 con 0x7f76f00d3f60 2024-09-11T23:24:42.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.876+0000 7f76ef400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f00b66e0 0x7f76f015cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:42.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.876+0000 7f76ef400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f00b66e0 0x7f76f015cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38868/0 (socket says 172.21.15.144:38868) 2024-09-11T23:24:42.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.876+0000 7f76ef400640 1 -- 172.21.15.144:0/2074266738 learned_addr learned my addr 172.21.15.144:0/2074266738 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:42.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.876+0000 7f76eea00640 1 --2- 172.21.15.144:0/2074266738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76f00d3f60 0x7f76f00b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:42.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.876+0000 7f76efe00640 1 --2- 172.21.15.144:0/2074266738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76f015e640 0x7f76f0160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.876+0000 7f76ef400640 1 -- 172.21.15.144:0/2074266738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76f00d3f60 msgr2=0x7f76f00b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.876+0000 7f76ef400640 1 --2- 172.21.15.144:0/2074266738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76f00d3f60 0x7f76f00b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.876+0000 7f76ef400640 1 -- 172.21.15.144:0/2074266738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76f015e640 msgr2=0x7f76f0160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.876+0000 7f76ef400640 1 --2- 172.21.15.144:0/2074266738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76f015e640 0x7f76f0160470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.876+0000 7f76ef400640 1 -- 172.21.15.144:0/2074266738 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f00abe50 con 0x7f76f00b66e0 2024-09-11T23:24:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.876+0000 7f76efe00640 1 --2- 172.21.15.144:0/2074266738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76f015e640 0x7f76f0160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.876+0000 7f76eea00640 1 --2- 172.21.15.144:0/2074266738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76f00d3f60 0x7f76f00b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:42.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.876+0000 7f76ef400640 1 --2- 172.21.15.144:0/2074266738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f00b66e0 0x7f76f015cc90 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f76e0035040 tx=0x7f76e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.877+0000 7f76e7400640 1 -- 172.21.15.144:0/2074266738 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e0037040 con 0x7f76f00b66e0 2024-09-11T23:24:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.877+0000 7f76e7400640 1 -- 172.21.15.144:0/2074266738 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e0004250 con 0x7f76f00b66e0 2024-09-11T23:24:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.877+0000 7f76e7400640 1 -- 172.21.15.144:0/2074266738 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e0032e20 con 0x7f76f00b66e0 2024-09-11T23:24:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.877+0000 7f76f5200640 1 -- 172.21.15.144:0/2074266738 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f00ac130 con 0x7f76f00b66e0 2024-09-11T23:24:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.877+0000 7f76f5200640 1 -- 172.21.15.144:0/2074266738 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f00ac6f0 con 0x7f76f00b66e0 2024-09-11T23:24:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.878+0000 7f76f5200640 1 -- 172.21.15.144:0/2074266738 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76f00ce960 con 0x7f76f00b66e0 2024-09-11T23:24:42.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.879+0000 7f76e7400640 1 -- 172.21.15.144:0/2074266738 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f76e0030770 con 0x7f76f00b66e0 2024-09-11T23:24:42.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.880+0000 7f76e7400640 1 --2- 172.21.15.144:0/2074266738 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f76d006c400 0x7f76d006e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:42.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.880+0000 7f76e7400640 1 -- 172.21.15.144:0/2074266738 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f76e00accd0 con 0x7f76f00b66e0 2024-09-11T23:24:42.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.880+0000 7f76eea00640 1 --2- 172.21.15.144:0/2074266738 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f76d006c400 0x7f76d006e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:42.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.881+0000 7f76eea00640 1 --2- 172.21.15.144:0/2074266738 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f76d006c400 0x7f76d006e8c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f76f00b5bb0 tx=0x7f76dc007c10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:42.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:42.884+0000 7f76e7400640 1 -- 172.21.15.144:0/2074266738 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76e007aef0 con 0x7f76f00b66e0 2024-09-11T23:24:43.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.056+0000 7f76f5200640 1 -- 172.21.15.144:0/2074266738 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f76f015d1d0 con 0x7f76d006c400 2024-09-11T23:24:43.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.062+0000 7f76e7400640 1 -- 172.21.15.144:0/2074266738 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252487 (secure 0 0 0) 0x7f76dc007270 con 0x7f76d006c400 2024-09-11T23:24:43.064 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:43.065 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:24:43.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.066+0000 7f76f5200640 1 -- 172.21.15.144:0/2074266738 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f76d006c400 msgr2=0x7f76d006e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:43.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.066+0000 7f76f5200640 1 --2- 172.21.15.144:0/2074266738 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f76d006c400 0x7f76d006e8c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f76f00b5bb0 tx=0x7f76dc007c10 comp rx=0 tx=0).stop 2024-09-11T23:24:43.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.066+0000 7f76f5200640 1 -- 172.21.15.144:0/2074266738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f00b66e0 msgr2=0x7f76f015cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:43.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.066+0000 7f76f5200640 1 --2- 172.21.15.144:0/2074266738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f00b66e0 0x7f76f015cc90 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f76e0035040 tx=0x7f76e00046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.066+0000 7f76f5200640 1 -- 172.21.15.144:0/2074266738 shutdown_connections 2024-09-11T23:24:43.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.066+0000 7f76f5200640 1 --2- 172.21.15.144:0/2074266738 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f76d006c400 0x7f76d006e8c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.066+0000 7f76f5200640 1 --2- 172.21.15.144:0/2074266738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76f015e640 0x7f76f0160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.066+0000 7f76f5200640 1 --2- 172.21.15.144:0/2074266738 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f76f00d3f60 0x7f76f00b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.066+0000 7f76f5200640 1 --2- 172.21.15.144:0/2074266738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76f00b66e0 0x7f76f015cc90 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.066+0000 7f76f5200640 1 -- 172.21.15.144:0/2074266738 >> 172.21.15.144:0/2074266738 conn(0x7f76f00d0fd0 msgr2=0x7f76f00b3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:43.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.066+0000 7f76f5200640 1 -- 172.21.15.144:0/2074266738 shutdown_connections 2024-09-11T23:24:43.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.066+0000 7f76f5200640 1 -- 172.21.15.144:0/2074266738 wait complete. 2024-09-11T23:24:43.082 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-09-11T23:24:42.746883+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":263496,"kb_used_data":13960,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711224,"statfs":{"total":773094113280,"available":772824293376,"internally_reserved":0,"allocated":14295040,"data_stored":6933964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001609"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575942+0000","last_change":"2024-09-11T23:24:38.520316+0000","last_active":"2024-09-11T23:24:39.575942+0000","last_peered":"2024-09-11T23:24:39.575942+0000","last_clean":"2024-09-11T23:24:39.575942+0000","last_became_active":"2024-09-11T23:24:38.519994+0000","last_became_peered":"2024-09-11T23:24:38.519994+0000","last_unstale":"2024-09-11T23:24:39.575942+0000","last_undegraded":"2024-09-11T23:24:39.575942+0000","last_fullsized":"2024-09-11T23:24:39.575942+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:18.528825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575729+0000","last_change":"2024-09-11T23:24:38.505486+0000","last_active":"2024-09-11T23:24:39.575729+0000","last_peered":"2024-09-11T23:24:39.575729+0000","last_clean":"2024-09-11T23:24:39.575729+0000","last_became_active":"2024-09-11T23:24:38.505179+0000","last_became_peered":"2024-09-11T23:24:38.505179+0000","last_unstale":"2024-09-11T23:24:39.575729+0000","last_undegraded":"2024-09-11T23:24:39.575729+0000","last_fullsized":"2024-09-11T23:24:39.575729+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:00.749222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575435+0000","last_change":"2024-09-11T23:24:38.503083+0000","last_active":"2024-09-11T23:24:39.575435+0000","last_peered":"2024-09-11T23:24:39.575435+0000","last_clean":"2024-09-11T23:24:39.575435+0000","last_became_active":"2024-09-11T23:24:38.502804+0000","last_became_peered":"2024-09-11T23:24:38.502804+0000","last_unstale":"2024-09-11T23:24:39.575435+0000","last_undegraded":"2024-09-11T23:24:39.575435+0000","last_fullsized":"2024-09-11T23:24:39.575435+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:40.808419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507765+0000","last_change":"2024-09-11T23:24:38.514813+0000","last_active":"2024-09-11T23:24:39.507765+0000","last_peered":"2024-09-11T23:24:39.507765+0000","last_clean":"2024-09-11T23:24:39.507765+0000","last_became_active":"2024-09-11T23:24:38.509954+0000","last_became_peered":"2024-09-11T23:24:38.509954+0000","last_unstale":"2024-09-11T23:24:39.507765+0000","last_undegraded":"2024-09-11T23:24:39.507765+0000","last_fullsized":"2024-09-11T23:24:39.507765+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:18.401893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507237+0000","last_change":"2024-09-11T23:24:38.520064+0000","last_active":"2024-09-11T23:24:39.507237+0000","last_peered":"2024-09-11T23:24:39.507237+0000","last_clean":"2024-09-11T23:24:39.507237+0000","last_became_active":"2024-09-11T23:24:38.519535+0000","last_became_peered":"2024-09-11T23:24:38.519535+0000","last_unstale":"2024-09-11T23:24:39.507237+0000","last_undegraded":"2024-09-11T23:24:39.507237+0000","last_fullsized":"2024-09-11T23:24:39.507237+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:18.219343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574821+0000","last_change":"2024-09-11T23:24:38.498164+0000","last_active":"2024-09-11T23:24:39.574821+0000","last_peered":"2024-09-11T23:24:39.574821+0000","last_clean":"2024-09-11T23:24:39.574821+0000","last_became_active":"2024-09-11T23:24:38.497867+0000","last_became_peered":"2024-09-11T23:24:38.497867+0000","last_unstale":"2024-09-11T23:24:39.574821+0000","last_undegraded":"2024-09-11T23:24:39.574821+0000","last_fullsized":"2024-09-11T23:24:39.574821+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:54.981251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.502895+0000","last_change":"2024-09-11T23:24:38.498191+0000","last_active":"2024-09-11T23:24:39.502895+0000","last_peered":"2024-09-11T23:24:39.502895+0000","last_clean":"2024-09-11T23:24:39.502895+0000","last_became_active":"2024-09-11T23:24:38.497893+0000","last_became_peered":"2024-09-11T23:24:38.497893+0000","last_unstale":"2024-09-11T23:24:39.502895+0000","last_undegraded":"2024-09-11T23:24:39.502895+0000","last_fullsized":"2024-09-11T23:24:39.502895+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:56.944178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574542+0000","last_change":"2024-09-11T23:24:38.520250+0000","last_active":"2024-09-11T23:24:39.574542+0000","last_peered":"2024-09-11T23:24:39.574542+0000","last_clean":"2024-09-11T23:24:39.574542+0000","last_became_active":"2024-09-11T23:24:38.519922+0000","last_became_peered":"2024-09-11T23:24:38.519922+0000","last_unstale":"2024-09-11T23:24:39.574542+0000","last_undegraded":"2024-09-11T23:24:39.574542+0000","last_fullsized":"2024-09-11T23:24:39.574542+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:01.254826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575966+0000","last_change":"2024-09-11T23:24:38.522057+0000","last_active":"2024-09-11T23:24:39.575966+0000","last_peered":"2024-09-11T23:24:39.575966+0000","last_clean":"2024-09-11T23:24:39.575966+0000","last_became_active":"2024-09-11T23:24:38.521787+0000","last_became_peered":"2024-09-11T23:24:38.521787+0000","last_unstale":"2024-09-11T23:24:39.575966+0000","last_undegraded":"2024-09-11T23:24:39.575966+0000","last_fullsized":"2024-09-11T23:24:39.575966+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:44.602339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576058+0000","last_change":"2024-09-11T23:24:38.514403+0000","last_active":"2024-09-11T23:24:39.576058+0000","last_peered":"2024-09-11T23:24:39.576058+0000","last_clean":"2024-09-11T23:24:39.576058+0000","last_became_active":"2024-09-11T23:24:38.514080+0000","last_became_peered":"2024-09-11T23:24:38.514080+0000","last_unstale":"2024-09-11T23:24:39.576058+0000","last_undegraded":"2024-09-11T23:24:39.576058+0000","last_fullsized":"2024-09-11T23:24:39.576058+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:10.872794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574849+0000","last_change":"2024-09-11T23:24:38.518114+0000","last_active":"2024-09-11T23:24:39.574849+0000","last_peered":"2024-09-11T23:24:39.574849+0000","last_clean":"2024-09-11T23:24:39.574849+0000","last_became_active":"2024-09-11T23:24:38.517897+0000","last_became_peered":"2024-09-11T23:24:38.517897+0000","last_unstale":"2024-09-11T23:24:39.574849+0000","last_undegraded":"2024-09-11T23:24:39.574849+0000","last_fullsized":"2024-09-11T23:24:39.574849+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:40.808419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575628+0000","last_change":"2024-09-11T23:24:38.509808+0000","last_active":"2024-09-11T23:24:39.575628+0000","last_peered":"2024-09-11T23:24:39.575628+0000","last_clean":"2024-09-11T23:24:39.575628+0000","last_became_active":"2024-09-11T23:24:38.509544+0000","last_became_peered":"2024-09-11T23:24:38.509544+0000","last_unstale":"2024-09-11T23:24:39.575628+0000","last_undegraded":"2024-09-11T23:24:39.575628+0000","last_fullsized":"2024-09-11T23:24:39.575628+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:32.606623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.506936+0000","last_change":"2024-09-11T23:24:38.519851+0000","last_active":"2024-09-11T23:24:39.506936+0000","last_peered":"2024-09-11T23:24:39.506936+0000","last_clean":"2024-09-11T23:24:39.506936+0000","last_became_active":"2024-09-11T23:24:38.519163+0000","last_became_peered":"2024-09-11T23:24:38.519163+0000","last_unstale":"2024-09-11T23:24:39.506936+0000","last_undegraded":"2024-09-11T23:24:39.506936+0000","last_fullsized":"2024-09-11T23:24:39.506936+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:37.263621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507150+0000","last_change":"2024-09-11T23:24:38.510802+0000","last_active":"2024-09-11T23:24:39.507150+0000","last_peered":"2024-09-11T23:24:39.507150+0000","last_clean":"2024-09-11T23:24:39.507150+0000","last_became_active":"2024-09-11T23:24:38.510524+0000","last_became_peered":"2024-09-11T23:24:38.510524+0000","last_unstale":"2024-09-11T23:24:39.507150+0000","last_undegraded":"2024-09-11T23:24:39.507150+0000","last_fullsized":"2024-09-11T23:24:39.507150+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:03.784871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574754+0000","last_change":"2024-09-11T23:24:38.514604+0000","last_active":"2024-09-11T23:24:39.574754+0000","last_peered":"2024-09-11T23:24:39.574754+0000","last_clean":"2024-09-11T23:24:39.574754+0000","last_became_active":"2024-09-11T23:24:38.514282+0000","last_became_peered":"2024-09-11T23:24:38.514282+0000","last_unstale":"2024-09-11T23:24:39.574754+0000","last_undegraded":"2024-09-11T23:24:39.574754+0000","last_fullsized":"2024-09-11T23:24:39.574754+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:56.668564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575965+0000","last_change":"2024-09-11T23:24:38.515304+0000","last_active":"2024-09-11T23:24:39.575965+0000","last_peered":"2024-09-11T23:24:39.575965+0000","last_clean":"2024-09-11T23:24:39.575965+0000","last_became_active":"2024-09-11T23:24:38.515035+0000","last_became_peered":"2024-09-11T23:24:38.515035+0000","last_unstale":"2024-09-11T23:24:39.575965+0000","last_undegraded":"2024-09-11T23:24:39.575965+0000","last_fullsized":"2024-09-11T23:24:39.575965+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:57.543292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576045+0000","last_change":"2024-09-11T23:24:38.514645+0000","last_active":"2024-09-11T23:24:39.576045+0000","last_peered":"2024-09-11T23:24:39.576045+0000","last_clean":"2024-09-11T23:24:39.576045+0000","last_became_active":"2024-09-11T23:24:38.514231+0000","last_became_peered":"2024-09-11T23:24:38.514231+0000","last_unstale":"2024-09-11T23:24:39.576045+0000","last_undegraded":"2024-09-11T23:24:39.576045+0000","last_fullsized":"2024-09-11T23:24:39.576045+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:48.826844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575886+0000","last_change":"2024-09-11T23:24:38.504603+0000","last_active":"2024-09-11T23:24:39.575886+0000","last_peered":"2024-09-11T23:24:39.575886+0000","last_clean":"2024-09-11T23:24:39.575886+0000","last_became_active":"2024-09-11T23:24:38.504301+0000","last_became_peered":"2024-09-11T23:24:38.504301+0000","last_unstale":"2024-09-11T23:24:39.575886+0000","last_undegraded":"2024-09-11T23:24:39.575886+0000","last_fullsized":"2024-09-11T23:24:39.575886+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:45.402512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575325+0000","last_change":"2024-09-11T23:24:38.519000+0000","last_active":"2024-09-11T23:24:39.575325+0000","last_peered":"2024-09-11T23:24:39.575325+0000","last_clean":"2024-09-11T23:24:39.575325+0000","last_became_active":"2024-09-11T23:24:38.518611+0000","last_became_peered":"2024-09-11T23:24:38.518611+0000","last_unstale":"2024-09-11T23:24:39.575325+0000","last_undegraded":"2024-09-11T23:24:39.575325+0000","last_fullsized":"2024-09-11T23:24:39.575325+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:03.784871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575004+0000","last_change":"2024-09-11T23:24:38.509333+0000","last_active":"2024-09-11T23:24:39.575004+0000","last_peered":"2024-09-11T23:24:39.575004+0000","last_clean":"2024-09-11T23:24:39.575004+0000","last_became_active":"2024-09-11T23:24:38.509020+0000","last_became_peered":"2024-09-11T23:24:38.509020+0000","last_unstale":"2024-09-11T23:24:39.575004+0000","last_undegraded":"2024-09-11T23:24:39.575004+0000","last_fullsized":"2024-09-11T23:24:39.575004+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:50.983022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575580+0000","last_change":"2024-09-11T23:24:38.511590+0000","last_active":"2024-09-11T23:24:39.575580+0000","last_peered":"2024-09-11T23:24:39.575580+0000","last_clean":"2024-09-11T23:24:39.575580+0000","last_became_active":"2024-09-11T23:24:38.511296+0000","last_became_peered":"2024-09-11T23:24:38.511296+0000","last_unstale":"2024-09-11T23:24:39.575580+0000","last_undegraded":"2024-09-11T23:24:39.575580+0000","last_fullsized":"2024-09-11T23:24:39.575580+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:56.138030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507234+0000","last_change":"2024-09-11T23:24:38.501444+0000","last_active":"2024-09-11T23:24:39.507234+0000","last_peered":"2024-09-11T23:24:39.507234+0000","last_clean":"2024-09-11T23:24:39.507234+0000","last_became_active":"2024-09-11T23:24:38.501131+0000","last_became_peered":"2024-09-11T23:24:38.501131+0000","last_unstale":"2024-09-11T23:24:39.507234+0000","last_undegraded":"2024-09-11T23:24:39.507234+0000","last_fullsized":"2024-09-11T23:24:39.507234+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:40.552989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507535+0000","last_change":"2024-09-11T23:24:38.498571+0000","last_active":"2024-09-11T23:24:39.507535+0000","last_peered":"2024-09-11T23:24:39.507535+0000","last_clean":"2024-09-11T23:24:39.507535+0000","last_became_active":"2024-09-11T23:24:38.498291+0000","last_became_peered":"2024-09-11T23:24:38.498291+0000","last_unstale":"2024-09-11T23:24:39.507535+0000","last_undegraded":"2024-09-11T23:24:39.507535+0000","last_fullsized":"2024-09-11T23:24:39.507535+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:09.101277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574758+0000","last_change":"2024-09-11T23:24:38.514350+0000","last_active":"2024-09-11T23:24:39.574758+0000","last_peered":"2024-09-11T23:24:39.574758+0000","last_clean":"2024-09-11T23:24:39.574758+0000","last_became_active":"2024-09-11T23:24:38.513616+0000","last_became_peered":"2024-09-11T23:24:38.513616+0000","last_unstale":"2024-09-11T23:24:39.574758+0000","last_undegraded":"2024-09-11T23:24:39.574758+0000","last_fullsized":"2024-09-11T23:24:39.574758+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:48.209703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576124+0000","last_change":"2024-09-11T23:24:38.522546+0000","last_active":"2024-09-11T23:24:39.576124+0000","last_peered":"2024-09-11T23:24:39.576124+0000","last_clean":"2024-09-11T23:24:39.576124+0000","last_became_active":"2024-09-11T23:24:38.521991+0000","last_became_peered":"2024-09-11T23:24:38.521991+0000","last_unstale":"2024-09-11T23:24:39.576124+0000","last_undegraded":"2024-09-11T23:24:39.576124+0000","last_fullsized":"2024-09-11T23:24:39.576124+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:13.222886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575584+0000","last_change":"2024-09-11T23:24:38.502195+0000","last_active":"2024-09-11T23:24:39.575584+0000","last_peered":"2024-09-11T23:24:39.575584+0000","last_clean":"2024-09-11T23:24:39.575584+0000","last_became_active":"2024-09-11T23:24:38.501790+0000","last_became_peered":"2024-09-11T23:24:38.501790+0000","last_unstale":"2024-09-11T23:24:39.575584+0000","last_undegraded":"2024-09-11T23:24:39.575584+0000","last_fullsized":"2024-09-11T23:24:39.575584+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:40.552989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575683+0000","last_change":"2024-09-11T23:24:38.516017+0000","last_active":"2024-09-11T23:24:39.575683+0000","last_peered":"2024-09-11T23:24:39.575683+0000","last_clean":"2024-09-11T23:24:39.575683+0000","last_became_active":"2024-09-11T23:24:38.515651+0000","last_became_peered":"2024-09-11T23:24:38.515651+0000","last_unstale":"2024-09-11T23:24:39.575683+0000","last_undegraded":"2024-09-11T23:24:39.575683+0000","last_fullsized":"2024-09-11T23:24:39.575683+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:43.887898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.502594+0000","last_change":"2024-09-11T23:24:38.498949+0000","last_active":"2024-09-11T23:24:39.502594+0000","last_peered":"2024-09-11T23:24:39.502594+0000","last_clean":"2024-09-11T23:24:39.502594+0000","last_became_active":"2024-09-11T23:24:38.497454+0000","last_became_peered":"2024-09-11T23:24:38.497454+0000","last_unstale":"2024-09-11T23:24:39.502594+0000","last_undegraded":"2024-09-11T23:24:39.502594+0000","last_fullsized":"2024-09-11T23:24:39.502594+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:15.472339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574827+0000","last_change":"2024-09-11T23:24:38.497485+0000","last_active":"2024-09-11T23:24:39.574827+0000","last_peered":"2024-09-11T23:24:39.574827+0000","last_clean":"2024-09-11T23:24:39.574827+0000","last_became_active":"2024-09-11T23:24:38.497203+0000","last_became_peered":"2024-09-11T23:24:38.497203+0000","last_unstale":"2024-09-11T23:24:39.574827+0000","last_undegraded":"2024-09-11T23:24:39.574827+0000","last_fullsized":"2024-09-11T23:24:39.574827+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:37.191719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507309+0000","last_change":"2024-09-11T23:24:38.495948+0000","last_active":"2024-09-11T23:24:39.507309+0000","last_peered":"2024-09-11T23:24:39.507309+0000","last_clean":"2024-09-11T23:24:39.507309+0000","last_became_active":"2024-09-11T23:24:38.495525+0000","last_became_peered":"2024-09-11T23:24:38.495525+0000","last_unstale":"2024-09-11T23:24:39.507309+0000","last_undegraded":"2024-09-11T23:24:39.507309+0000","last_fullsized":"2024-09-11T23:24:39.507309+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:03.852371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574646+0000","last_change":"2024-09-11T23:24:38.516466+0000","last_active":"2024-09-11T23:24:39.574646+0000","last_peered":"2024-09-11T23:24:39.574646+0000","last_clean":"2024-09-11T23:24:39.574646+0000","last_became_active":"2024-09-11T23:24:38.515878+0000","last_became_peered":"2024-09-11T23:24:38.515878+0000","last_unstale":"2024-09-11T23:24:39.574646+0000","last_undegraded":"2024-09-11T23:24:39.574646+0000","last_fullsized":"2024-09-11T23:24:39.574646+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:22.805785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574610+0000","last_change":"2024-09-11T23:24:38.511173+0000","last_active":"2024-09-11T23:24:39.574610+0000","last_peered":"2024-09-11T23:24:39.574610+0000","last_clean":"2024-09-11T23:24:39.574610+0000","last_became_active":"2024-09-11T23:24:38.510860+0000","last_became_peered":"2024-09-11T23:24:38.510860+0000","last_unstale":"2024-09-11T23:24:39.574610+0000","last_undegraded":"2024-09-11T23:24:39.574610+0000","last_fullsized":"2024-09-11T23:24:39.574610+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:43.829789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575859+0000","last_change":"2024-09-11T23:24:38.516241+0000","last_active":"2024-09-11T23:24:39.575859+0000","last_peered":"2024-09-11T23:24:39.575859+0000","last_clean":"2024-09-11T23:24:39.575859+0000","last_became_active":"2024-09-11T23:24:38.513758+0000","last_became_peered":"2024-09-11T23:24:38.513758+0000","last_unstale":"2024-09-11T23:24:39.575859+0000","last_undegraded":"2024-09-11T23:24:39.575859+0000","last_fullsized":"2024-09-11T23:24:39.575859+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:22.448677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"130'4","reported_seq":18,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575881+0000","last_change":"2024-09-11T23:24:37.506613+0000","last_active":"2024-09-11T23:24:39.575881+0000","last_peered":"2024-09-11T23:24:39.575881+0000","last_clean":"2024-09-11T23:24:39.575881+0000","last_became_active":"2024-09-11T23:24:37.506309+0000","last_became_peered":"2024-09-11T23:24:37.506309+0000","last_unstale":"2024-09-11T23:24:39.575881+0000","last_undegraded":"2024-09-11T23:24:39.575881+0000","last_fullsized":"2024-09-11T23:24:39.575881+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:54.726155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576257+0000","last_change":"2024-09-11T23:24:38.505440+0000","last_active":"2024-09-11T23:24:39.576257+0000","last_peered":"2024-09-11T23:24:39.576257+0000","last_clean":"2024-09-11T23:24:39.576257+0000","last_became_active":"2024-09-11T23:24:38.505009+0000","last_became_peered":"2024-09-11T23:24:38.505009+0000","last_unstale":"2024-09-11T23:24:39.576257+0000","last_undegraded":"2024-09-11T23:24:39.576257+0000","last_fullsized":"2024-09-11T23:24:39.576257+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:51.756561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576143+0000","last_change":"2024-09-11T23:24:37.505362+0000","last_active":"2024-09-11T23:24:39.576143+0000","last_peered":"2024-09-11T23:24:39.576143+0000","last_clean":"2024-09-11T23:24:39.576143+0000","last_became_active":"2024-09-11T23:24:37.505096+0000","last_became_peered":"2024-09-11T23:24:37.505096+0000","last_unstale":"2024-09-11T23:24:39.576143+0000","last_undegraded":"2024-09-11T23:24:39.576143+0000","last_fullsized":"2024-09-11T23:24:39.576143+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:37.164672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575220+0000","last_change":"2024-09-11T23:24:38.495286+0000","last_active":"2024-09-11T23:24:39.575220+0000","last_peered":"2024-09-11T23:24:39.575220+0000","last_clean":"2024-09-11T23:24:39.575220+0000","last_became_active":"2024-09-11T23:24:38.495017+0000","last_became_peered":"2024-09-11T23:24:38.495017+0000","last_unstale":"2024-09-11T23:24:39.575220+0000","last_undegraded":"2024-09-11T23:24:39.575220+0000","last_fullsized":"2024-09-11T23:24:39.575220+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:17.659464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507938+0000","last_change":"2024-09-11T23:24:37.503895+0000","last_active":"2024-09-11T23:24:39.507938+0000","last_peered":"2024-09-11T23:24:39.507938+0000","last_clean":"2024-09-11T23:24:39.507938+0000","last_became_active":"2024-09-11T23:24:37.503589+0000","last_became_peered":"2024-09-11T23:24:37.503589+0000","last_unstale":"2024-09-11T23:24:39.507938+0000","last_undegraded":"2024-09-11T23:24:39.507938+0000","last_fullsized":"2024-09-11T23:24:39.507938+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:43.414051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575756+0000","last_change":"2024-09-11T23:24:38.514805+0000","last_active":"2024-09-11T23:24:39.575756+0000","last_peered":"2024-09-11T23:24:39.575756+0000","last_clean":"2024-09-11T23:24:39.575756+0000","last_became_active":"2024-09-11T23:24:38.513704+0000","last_became_peered":"2024-09-11T23:24:38.513704+0000","last_unstale":"2024-09-11T23:24:39.575756+0000","last_undegraded":"2024-09-11T23:24:39.575756+0000","last_fullsized":"2024-09-11T23:24:39.575756+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:02.790667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507768+0000","last_change":"2024-09-11T23:24:37.492085+0000","last_active":"2024-09-11T23:24:39.507768+0000","last_peered":"2024-09-11T23:24:39.507768+0000","last_clean":"2024-09-11T23:24:39.507768+0000","last_became_active":"2024-09-11T23:24:37.491722+0000","last_became_peered":"2024-09-11T23:24:37.491722+0000","last_unstale":"2024-09-11T23:24:39.507768+0000","last_undegraded":"2024-09-11T23:24:39.507768+0000","last_fullsized":"2024-09-11T23:24:39.507768+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:07.838799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575606+0000","last_change":"2024-09-11T23:24:38.514679+0000","last_active":"2024-09-11T23:24:39.575606+0000","last_peered":"2024-09-11T23:24:39.575606+0000","last_clean":"2024-09-11T23:24:39.575606+0000","last_became_active":"2024-09-11T23:24:38.514405+0000","last_became_peered":"2024-09-11T23:24:38.514405+0000","last_unstale":"2024-09-11T23:24:39.575606+0000","last_undegraded":"2024-09-11T23:24:39.575606+0000","last_fullsized":"2024-09-11T23:24:39.575606+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:28.857370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574554+0000","last_change":"2024-09-11T23:24:37.504197+0000","last_active":"2024-09-11T23:24:39.574554+0000","last_peered":"2024-09-11T23:24:39.574554+0000","last_clean":"2024-09-11T23:24:39.574554+0000","last_became_active":"2024-09-11T23:24:37.503944+0000","last_became_peered":"2024-09-11T23:24:37.503944+0000","last_unstale":"2024-09-11T23:24:39.574554+0000","last_undegraded":"2024-09-11T23:24:39.574554+0000","last_fullsized":"2024-09-11T23:24:39.574554+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:11.845210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507257+0000","last_change":"2024-09-11T23:24:38.510117+0000","last_active":"2024-09-11T23:24:39.507257+0000","last_peered":"2024-09-11T23:24:39.507257+0000","last_clean":"2024-09-11T23:24:39.507257+0000","last_became_active":"2024-09-11T23:24:38.509815+0000","last_became_peered":"2024-09-11T23:24:38.509815+0000","last_unstale":"2024-09-11T23:24:39.507257+0000","last_undegraded":"2024-09-11T23:24:39.507257+0000","last_fullsized":"2024-09-11T23:24:39.507257+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:18.528825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.506326+0000","last_change":"2024-09-11T23:24:37.504453+0000","last_active":"2024-09-11T23:24:39.506326+0000","last_peered":"2024-09-11T23:24:39.506326+0000","last_clean":"2024-09-11T23:24:39.506326+0000","last_became_active":"2024-09-11T23:24:37.504084+0000","last_became_peered":"2024-09-11T23:24:37.504084+0000","last_unstale":"2024-09-11T23:24:39.506326+0000","last_undegraded":"2024-09-11T23:24:39.506326+0000","last_fullsized":"2024-09-11T23:24:39.506326+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:36.538666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574290+0000","last_change":"2024-09-11T23:24:38.507202+0000","last_active":"2024-09-11T23:24:39.574290+0000","last_peered":"2024-09-11T23:24:39.574290+0000","last_clean":"2024-09-11T23:24:39.574290+0000","last_became_active":"2024-09-11T23:24:38.506929+0000","last_became_peered":"2024-09-11T23:24:38.506929+0000","last_unstale":"2024-09-11T23:24:39.574290+0000","last_undegraded":"2024-09-11T23:24:39.574290+0000","last_fullsized":"2024-09-11T23:24:39.574290+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:07.414844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574315+0000","last_change":"2024-09-11T23:24:37.499614+0000","last_active":"2024-09-11T23:24:39.574315+0000","last_peered":"2024-09-11T23:24:39.574315+0000","last_clean":"2024-09-11T23:24:39.574315+0000","last_became_active":"2024-09-11T23:24:37.499330+0000","last_became_peered":"2024-09-11T23:24:37.499330+0000","last_unstale":"2024-09-11T23:24:39.574315+0000","last_undegraded":"2024-09-11T23:24:39.574315+0000","last_fullsized":"2024-09-11T23:24:39.574315+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:41.077471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.506814+0000","last_change":"2024-09-11T23:24:38.518129+0000","last_active":"2024-09-11T23:24:39.506814+0000","last_peered":"2024-09-11T23:24:39.506814+0000","last_clean":"2024-09-11T23:24:39.506814+0000","last_became_active":"2024-09-11T23:24:38.517833+0000","last_became_peered":"2024-09-11T23:24:38.517833+0000","last_unstale":"2024-09-11T23:24:39.506814+0000","last_undegraded":"2024-09-11T23:24:39.506814+0000","last_fullsized":"2024-09-11T23:24:39.506814+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:36.996086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.506704+0000","last_change":"2024-09-11T23:24:37.497100+0000","last_active":"2024-09-11T23:24:39.506704+0000","last_peered":"2024-09-11T23:24:39.506704+0000","last_clean":"2024-09-11T23:24:39.506704+0000","last_became_active":"2024-09-11T23:24:37.496824+0000","last_became_peered":"2024-09-11T23:24:37.496824+0000","last_unstale":"2024-09-11T23:24:39.506704+0000","last_undegraded":"2024-09-11T23:24:39.506704+0000","last_fullsized":"2024-09-11T23:24:39.506704+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:17.216284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.506582+0000","last_change":"2024-09-11T23:24:38.514999+0000","last_active":"2024-09-11T23:24:39.506582+0000","last_peered":"2024-09-11T23:24:39.506582+0000","last_clean":"2024-09-11T23:24:39.506582+0000","last_became_active":"2024-09-11T23:24:38.514697+0000","last_became_peered":"2024-09-11T23:24:38.514697+0000","last_unstale":"2024-09-11T23:24:39.506582+0000","last_undegraded":"2024-09-11T23:24:39.506582+0000","last_fullsized":"2024-09-11T23:24:39.506582+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:26.913190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576056+0000","last_change":"2024-09-11T23:24:37.502826+0000","last_active":"2024-09-11T23:24:39.576056+0000","last_peered":"2024-09-11T23:24:39.576056+0000","last_clean":"2024-09-11T23:24:39.576056+0000","last_became_active":"2024-09-11T23:24:37.502546+0000","last_became_peered":"2024-09-11T23:24:37.502546+0000","last_unstale":"2024-09-11T23:24:39.576056+0000","last_undegraded":"2024-09-11T23:24:39.576056+0000","last_fullsized":"2024-09-11T23:24:39.576056+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:10.667329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575882+0000","last_change":"2024-09-11T23:24:38.514174+0000","last_active":"2024-09-11T23:24:39.575882+0000","last_peered":"2024-09-11T23:24:39.575882+0000","last_clean":"2024-09-11T23:24:39.575882+0000","last_became_active":"2024-09-11T23:24:38.513801+0000","last_became_peered":"2024-09-11T23:24:38.513801+0000","last_unstale":"2024-09-11T23:24:39.575882+0000","last_undegraded":"2024-09-11T23:24:39.575882+0000","last_fullsized":"2024-09-11T23:24:39.575882+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:35.685427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576139+0000","last_change":"2024-09-11T23:24:37.504782+0000","last_active":"2024-09-11T23:24:39.576139+0000","last_peered":"2024-09-11T23:24:39.576139+0000","last_clean":"2024-09-11T23:24:39.576139+0000","last_became_active":"2024-09-11T23:24:37.504363+0000","last_became_peered":"2024-09-11T23:24:37.504363+0000","last_unstale":"2024-09-11T23:24:39.576139+0000","last_undegraded":"2024-09-11T23:24:39.576139+0000","last_fullsized":"2024-09-11T23:24:39.576139+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:04.674150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575835+0000","last_change":"2024-09-11T23:24:38.511550+0000","last_active":"2024-09-11T23:24:39.575835+0000","last_peered":"2024-09-11T23:24:39.575835+0000","last_clean":"2024-09-11T23:24:39.575835+0000","last_became_active":"2024-09-11T23:24:38.511388+0000","last_became_peered":"2024-09-11T23:24:38.511388+0000","last_unstale":"2024-09-11T23:24:39.575835+0000","last_undegraded":"2024-09-11T23:24:39.575835+0000","last_fullsized":"2024-09-11T23:24:39.575835+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:03.548410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"130'6","reported_seq":20,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.502723+0000","last_change":"2024-09-11T23:24:37.504292+0000","last_active":"2024-09-11T23:24:39.502723+0000","last_peered":"2024-09-11T23:24:39.502723+0000","last_clean":"2024-09-11T23:24:39.502723+0000","last_became_active":"2024-09-11T23:24:37.504034+0000","last_became_peered":"2024-09-11T23:24:37.504034+0000","last_unstale":"2024-09-11T23:24:39.502723+0000","last_undegraded":"2024-09-11T23:24:39.502723+0000","last_fullsized":"2024-09-11T23:24:39.502723+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:55.134972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574985+0000","last_change":"2024-09-11T23:24:38.504806+0000","last_active":"2024-09-11T23:24:39.574985+0000","last_peered":"2024-09-11T23:24:39.574985+0000","last_clean":"2024-09-11T23:24:39.574985+0000","last_became_active":"2024-09-11T23:24:38.504488+0000","last_became_peered":"2024-09-11T23:24:38.504488+0000","last_unstale":"2024-09-11T23:24:39.574985+0000","last_undegraded":"2024-09-11T23:24:39.574985+0000","last_fullsized":"2024-09-11T23:24:39.574985+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:54.981251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575105+0000","last_change":"2024-09-11T23:24:37.504947+0000","last_active":"2024-09-11T23:24:39.575105+0000","last_peered":"2024-09-11T23:24:39.575105+0000","last_clean":"2024-09-11T23:24:39.575105+0000","last_became_active":"2024-09-11T23:24:37.504605+0000","last_became_peered":"2024-09-11T23:24:37.504605+0000","last_unstale":"2024-09-11T23:24:39.575105+0000","last_undegraded":"2024-09-11T23:24:39.575105+0000","last_fullsized":"2024-09-11T23:24:39.575105+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:35.993028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575590+0000","last_change":"2024-09-11T23:24:38.505581+0000","last_active":"2024-09-11T23:24:39.575590+0000","last_peered":"2024-09-11T23:24:39.575590+0000","last_clean":"2024-09-11T23:24:39.575590+0000","last_became_active":"2024-09-11T23:24:38.505220+0000","last_became_peered":"2024-09-11T23:24:38.505220+0000","last_unstale":"2024-09-11T23:24:39.575590+0000","last_undegraded":"2024-09-11T23:24:39.575590+0000","last_fullsized":"2024-09-11T23:24:39.575590+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:07.543877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574969+0000","last_change":"2024-09-11T23:24:37.497776+0000","last_active":"2024-09-11T23:24:39.574969+0000","last_peered":"2024-09-11T23:24:39.574969+0000","last_clean":"2024-09-11T23:24:39.574969+0000","last_became_active":"2024-09-11T23:24:37.497500+0000","last_became_peered":"2024-09-11T23:24:37.497500+0000","last_unstale":"2024-09-11T23:24:39.574969+0000","last_undegraded":"2024-09-11T23:24:39.574969+0000","last_fullsized":"2024-09-11T23:24:39.574969+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:08.918002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.506573+0000","last_change":"2024-09-11T23:24:38.519430+0000","last_active":"2024-09-11T23:24:39.506573+0000","last_peered":"2024-09-11T23:24:39.506573+0000","last_clean":"2024-09-11T23:24:39.506573+0000","last_became_active":"2024-09-11T23:24:38.519080+0000","last_became_peered":"2024-09-11T23:24:38.519080+0000","last_unstale":"2024-09-11T23:24:39.506573+0000","last_undegraded":"2024-09-11T23:24:39.506573+0000","last_fullsized":"2024-09-11T23:24:39.506573+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:30.572611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574409+0000","last_change":"2024-09-11T23:24:37.503731+0000","last_active":"2024-09-11T23:24:39.574409+0000","last_peered":"2024-09-11T23:24:39.574409+0000","last_clean":"2024-09-11T23:24:39.574409+0000","last_became_active":"2024-09-11T23:24:37.503476+0000","last_became_peered":"2024-09-11T23:24:37.503476+0000","last_unstale":"2024-09-11T23:24:39.574409+0000","last_undegraded":"2024-09-11T23:24:39.574409+0000","last_fullsized":"2024-09-11T23:24:39.574409+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:11.589412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574709+0000","last_change":"2024-09-11T23:24:38.504289+0000","last_active":"2024-09-11T23:24:39.574709+0000","last_peered":"2024-09-11T23:24:39.574709+0000","last_clean":"2024-09-11T23:24:39.574709+0000","last_became_active":"2024-09-11T23:24:38.503977+0000","last_became_peered":"2024-09-11T23:24:38.503977+0000","last_unstale":"2024-09-11T23:24:39.574709+0000","last_undegraded":"2024-09-11T23:24:39.574709+0000","last_fullsized":"2024-09-11T23:24:39.574709+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:01.254826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"130'8","reported_seq":22,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574728+0000","last_change":"2024-09-11T23:24:37.499221+0000","last_active":"2024-09-11T23:24:39.574728+0000","last_peered":"2024-09-11T23:24:39.574728+0000","last_clean":"2024-09-11T23:24:39.574728+0000","last_became_active":"2024-09-11T23:24:37.498966+0000","last_became_peered":"2024-09-11T23:24:37.498966+0000","last_unstale":"2024-09-11T23:24:39.574728+0000","last_undegraded":"2024-09-11T23:24:39.574728+0000","last_fullsized":"2024-09-11T23:24:39.574728+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:07.910553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576041+0000","last_change":"2024-09-11T23:24:38.522246+0000","last_active":"2024-09-11T23:24:39.576041+0000","last_peered":"2024-09-11T23:24:39.576041+0000","last_clean":"2024-09-11T23:24:39.576041+0000","last_became_active":"2024-09-11T23:24:38.521675+0000","last_became_peered":"2024-09-11T23:24:38.521675+0000","last_unstale":"2024-09-11T23:24:39.576041+0000","last_undegraded":"2024-09-11T23:24:39.576041+0000","last_fullsized":"2024-09-11T23:24:39.576041+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:43.845287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.506551+0000","last_change":"2024-09-11T23:24:37.497172+0000","last_active":"2024-09-11T23:24:39.506551+0000","last_peered":"2024-09-11T23:24:39.506551+0000","last_clean":"2024-09-11T23:24:39.506551+0000","last_became_active":"2024-09-11T23:24:37.496588+0000","last_became_peered":"2024-09-11T23:24:37.496588+0000","last_unstale":"2024-09-11T23:24:39.506551+0000","last_undegraded":"2024-09-11T23:24:39.506551+0000","last_fullsized":"2024-09-11T23:24:39.506551+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:37.340507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576259+0000","last_change":"2024-09-11T23:24:38.518000+0000","last_active":"2024-09-11T23:24:39.576259+0000","last_peered":"2024-09-11T23:24:39.576259+0000","last_clean":"2024-09-11T23:24:39.576259+0000","last_became_active":"2024-09-11T23:24:38.517683+0000","last_became_peered":"2024-09-11T23:24:38.517683+0000","last_unstale":"2024-09-11T23:24:39.576259+0000","last_undegraded":"2024-09-11T23:24:39.576259+0000","last_fullsized":"2024-09-11T23:24:39.576259+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:49.782305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575843+0000","last_change":"2024-09-11T23:24:37.501850+0000","last_active":"2024-09-11T23:24:39.575843+0000","last_peered":"2024-09-11T23:24:39.575843+0000","last_clean":"2024-09-11T23:24:39.575843+0000","last_became_active":"2024-09-11T23:24:37.500774+0000","last_became_peered":"2024-09-11T23:24:37.500774+0000","last_unstale":"2024-09-11T23:24:39.575843+0000","last_undegraded":"2024-09-11T23:24:39.575843+0000","last_fullsized":"2024-09-11T23:24:39.575843+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:16.647256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575273+0000","last_change":"2024-09-11T23:24:38.507367+0000","last_active":"2024-09-11T23:24:39.575273+0000","last_peered":"2024-09-11T23:24:39.575273+0000","last_clean":"2024-09-11T23:24:39.575273+0000","last_became_active":"2024-09-11T23:24:38.507045+0000","last_became_peered":"2024-09-11T23:24:38.507045+0000","last_unstale":"2024-09-11T23:24:39.575273+0000","last_undegraded":"2024-09-11T23:24:39.575273+0000","last_fullsized":"2024-09-11T23:24:39.575273+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:37.191719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"130'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576073+0000","last_change":"2024-09-11T23:24:37.504201+0000","last_active":"2024-09-11T23:24:39.576073+0000","last_peered":"2024-09-11T23:24:39.576073+0000","last_clean":"2024-09-11T23:24:39.576073+0000","last_became_active":"2024-09-11T23:24:37.503912+0000","last_became_peered":"2024-09-11T23:24:37.503912+0000","last_unstale":"2024-09-11T23:24:39.576073+0000","last_undegraded":"2024-09-11T23:24:39.576073+0000","last_fullsized":"2024-09-11T23:24:39.576073+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:17.942968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574984+0000","last_change":"2024-09-11T23:24:38.497451+0000","last_active":"2024-09-11T23:24:39.574984+0000","last_peered":"2024-09-11T23:24:39.574984+0000","last_clean":"2024-09-11T23:24:39.574984+0000","last_became_active":"2024-09-11T23:24:38.497128+0000","last_became_peered":"2024-09-11T23:24:38.497128+0000","last_unstale":"2024-09-11T23:24:39.574984+0000","last_undegraded":"2024-09-11T23:24:39.574984+0000","last_fullsized":"2024-09-11T23:24:39.574984+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:45.402512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575692+0000","last_change":"2024-09-11T23:24:37.500219+0000","last_active":"2024-09-11T23:24:39.575692+0000","last_peered":"2024-09-11T23:24:39.575692+0000","last_clean":"2024-09-11T23:24:39.575692+0000","last_became_active":"2024-09-11T23:24:37.499968+0000","last_became_peered":"2024-09-11T23:24:37.499968+0000","last_unstale":"2024-09-11T23:24:39.575692+0000","last_undegraded":"2024-09-11T23:24:39.575692+0000","last_fullsized":"2024-09-11T23:24:39.575692+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:34.918647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507411+0000","last_change":"2024-09-11T23:24:38.495465+0000","last_active":"2024-09-11T23:24:39.507411+0000","last_peered":"2024-09-11T23:24:39.507411+0000","last_clean":"2024-09-11T23:24:39.507411+0000","last_became_active":"2024-09-11T23:24:38.495093+0000","last_became_peered":"2024-09-11T23:24:38.495093+0000","last_unstale":"2024-09-11T23:24:39.507411+0000","last_undegraded":"2024-09-11T23:24:39.507411+0000","last_fullsized":"2024-09-11T23:24:39.507411+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:12.661571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.502935+0000","last_change":"2024-09-11T23:24:37.500170+0000","last_active":"2024-09-11T23:24:39.502935+0000","last_peered":"2024-09-11T23:24:39.502935+0000","last_clean":"2024-09-11T23:24:39.502935+0000","last_became_active":"2024-09-11T23:24:37.499881+0000","last_became_peered":"2024-09-11T23:24:37.499881+0000","last_unstale":"2024-09-11T23:24:39.502935+0000","last_undegraded":"2024-09-11T23:24:39.502935+0000","last_fullsized":"2024-09-11T23:24:39.502935+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:21.602369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.502718+0000","last_change":"2024-09-11T23:24:38.508082+0000","last_active":"2024-09-11T23:24:39.502718+0000","last_peered":"2024-09-11T23:24:39.502718+0000","last_clean":"2024-09-11T23:24:39.502718+0000","last_became_active":"2024-09-11T23:24:38.507597+0000","last_became_peered":"2024-09-11T23:24:38.507597+0000","last_unstale":"2024-09-11T23:24:39.502718+0000","last_undegraded":"2024-09-11T23:24:39.502718+0000","last_fullsized":"2024-09-11T23:24:39.502718+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:29.754512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575296+0000","last_change":"2024-09-11T23:24:37.504049+0000","last_active":"2024-09-11T23:24:39.575296+0000","last_peered":"2024-09-11T23:24:39.575296+0000","last_clean":"2024-09-11T23:24:39.575296+0000","last_became_active":"2024-09-11T23:24:37.503680+0000","last_became_peered":"2024-09-11T23:24:37.503680+0000","last_unstale":"2024-09-11T23:24:39.575296+0000","last_undegraded":"2024-09-11T23:24:39.575296+0000","last_fullsized":"2024-09-11T23:24:39.575296+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:19.607889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.506694+0000","last_change":"2024-09-11T23:24:38.498638+0000","last_active":"2024-09-11T23:24:39.506694+0000","last_peered":"2024-09-11T23:24:39.506694+0000","last_clean":"2024-09-11T23:24:39.506694+0000","last_became_active":"2024-09-11T23:24:38.498318+0000","last_became_peered":"2024-09-11T23:24:38.498318+0000","last_unstale":"2024-09-11T23:24:39.506694+0000","last_undegraded":"2024-09-11T23:24:39.506694+0000","last_fullsized":"2024-09-11T23:24:39.506694+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:17.659464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574859+0000","last_change":"2024-09-11T23:24:37.501114+0000","last_active":"2024-09-11T23:24:39.574859+0000","last_peered":"2024-09-11T23:24:39.574859+0000","last_clean":"2024-09-11T23:24:39.574859+0000","last_became_active":"2024-09-11T23:24:37.500854+0000","last_became_peered":"2024-09-11T23:24:37.500854+0000","last_unstale":"2024-09-11T23:24:39.574859+0000","last_undegraded":"2024-09-11T23:24:39.574859+0000","last_fullsized":"2024-09-11T23:24:39.574859+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:55.288141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.502495+0000","last_change":"2024-09-11T23:24:38.508608+0000","last_active":"2024-09-11T23:24:39.502495+0000","last_peered":"2024-09-11T23:24:39.502495+0000","last_clean":"2024-09-11T23:24:39.502495+0000","last_became_active":"2024-09-11T23:24:38.507720+0000","last_became_peered":"2024-09-11T23:24:38.507720+0000","last_unstale":"2024-09-11T23:24:39.502495+0000","last_undegraded":"2024-09-11T23:24:39.502495+0000","last_fullsized":"2024-09-11T23:24:39.502495+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:10.872794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574645+0000","last_change":"2024-09-11T23:24:37.499476+0000","last_active":"2024-09-11T23:24:39.574645+0000","last_peered":"2024-09-11T23:24:39.574645+0000","last_clean":"2024-09-11T23:24:39.574645+0000","last_became_active":"2024-09-11T23:24:37.499203+0000","last_became_peered":"2024-09-11T23:24:37.499203+0000","last_unstale":"2024-09-11T23:24:39.574645+0000","last_undegraded":"2024-09-11T23:24:39.574645+0000","last_fullsized":"2024-09-11T23:24:39.574645+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:25.910132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.506694+0000","last_change":"2024-09-11T23:24:38.518269+0000","last_active":"2024-09-11T23:24:39.506694+0000","last_peered":"2024-09-11T23:24:39.506694+0000","last_clean":"2024-09-11T23:24:39.506694+0000","last_became_active":"2024-09-11T23:24:38.517865+0000","last_became_peered":"2024-09-11T23:24:38.517865+0000","last_unstale":"2024-09-11T23:24:39.506694+0000","last_undegraded":"2024-09-11T23:24:39.506694+0000","last_fullsized":"2024-09-11T23:24:39.506694+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:19.576781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"130'2","reported_seq":16,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576017+0000","last_change":"2024-09-11T23:24:37.503202+0000","last_active":"2024-09-11T23:24:39.576017+0000","last_peered":"2024-09-11T23:24:39.576017+0000","last_clean":"2024-09-11T23:24:39.576017+0000","last_became_active":"2024-09-11T23:24:37.502879+0000","last_became_peered":"2024-09-11T23:24:37.502879+0000","last_unstale":"2024-09-11T23:24:39.576017+0000","last_undegraded":"2024-09-11T23:24:39.576017+0000","last_fullsized":"2024-09-11T23:24:39.576017+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:48.386567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575933+0000","last_change":"2024-09-11T23:24:38.500288+0000","last_active":"2024-09-11T23:24:39.575933+0000","last_peered":"2024-09-11T23:24:39.575933+0000","last_clean":"2024-09-11T23:24:39.575933+0000","last_became_active":"2024-09-11T23:24:38.499878+0000","last_became_peered":"2024-09-11T23:24:38.499878+0000","last_unstale":"2024-09-11T23:24:39.575933+0000","last_undegraded":"2024-09-11T23:24:39.575933+0000","last_fullsized":"2024-09-11T23:24:39.575933+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:13.412283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"131'1","reported_seq":15,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:40.494559+0000","last_change":"2024-09-11T23:24:37.494466+0000","last_active":"2024-09-11T23:24:40.494559+0000","last_peered":"2024-09-11T23:24:40.494559+0000","last_clean":"2024-09-11T23:24:40.494559+0000","last_became_active":"2024-09-11T23:24:37.494210+0000","last_became_peered":"2024-09-11T23:24:37.494210+0000","last_unstale":"2024-09-11T23:24:40.494559+0000","last_undegraded":"2024-09-11T23:24:40.494559+0000","last_fullsized":"2024-09-11T23:24:40.494559+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:23.202290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.576342+0000","last_change":"2024-09-11T23:24:38.514064+0000","last_active":"2024-09-11T23:24:39.576342+0000","last_peered":"2024-09-11T23:24:39.576342+0000","last_clean":"2024-09-11T23:24:39.576342+0000","last_became_active":"2024-09-11T23:24:38.513785+0000","last_became_peered":"2024-09-11T23:24:38.513785+0000","last_unstale":"2024-09-11T23:24:39.576342+0000","last_undegraded":"2024-09-11T23:24:39.576342+0000","last_fullsized":"2024-09-11T23:24:39.576342+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:43.077685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575366+0000","last_change":"2024-09-11T23:24:37.499159+0000","last_active":"2024-09-11T23:24:39.575366+0000","last_peered":"2024-09-11T23:24:39.575366+0000","last_clean":"2024-09-11T23:24:39.575366+0000","last_became_active":"2024-09-11T23:24:37.498863+0000","last_became_peered":"2024-09-11T23:24:37.498863+0000","last_unstale":"2024-09-11T23:24:39.575366+0000","last_undegraded":"2024-09-11T23:24:39.575366+0000","last_fullsized":"2024-09-11T23:24:39.575366+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:25.910132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575117+0000","last_change":"2024-09-11T23:24:38.496070+0000","last_active":"2024-09-11T23:24:39.575117+0000","last_peered":"2024-09-11T23:24:39.575117+0000","last_clean":"2024-09-11T23:24:39.575117+0000","last_became_active":"2024-09-11T23:24:38.495632+0000","last_became_peered":"2024-09-11T23:24:38.495632+0000","last_unstale":"2024-09-11T23:24:39.575117+0000","last_undegraded":"2024-09-11T23:24:39.575117+0000","last_fullsized":"2024-09-11T23:24:39.575117+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:13.412283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575380+0000","last_change":"2024-09-11T23:24:37.501506+0000","last_active":"2024-09-11T23:24:39.575380+0000","last_peered":"2024-09-11T23:24:39.575380+0000","last_clean":"2024-09-11T23:24:39.575380+0000","last_became_active":"2024-09-11T23:24:37.501272+0000","last_became_peered":"2024-09-11T23:24:37.501272+0000","last_unstale":"2024-09-11T23:24:39.575380+0000","last_undegraded":"2024-09-11T23:24:39.575380+0000","last_fullsized":"2024-09-11T23:24:39.575380+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:29.569552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574716+0000","last_change":"2024-09-11T23:24:38.511510+0000","last_active":"2024-09-11T23:24:39.574716+0000","last_peered":"2024-09-11T23:24:39.574716+0000","last_clean":"2024-09-11T23:24:39.574716+0000","last_became_active":"2024-09-11T23:24:38.511239+0000","last_became_peered":"2024-09-11T23:24:38.511239+0000","last_unstale":"2024-09-11T23:24:39.574716+0000","last_undegraded":"2024-09-11T23:24:39.574716+0000","last_fullsized":"2024-09-11T23:24:39.574716+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:26.954920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.502831+0000","last_change":"2024-09-11T23:24:37.506005+0000","last_active":"2024-09-11T23:24:39.502831+0000","last_peered":"2024-09-11T23:24:39.502831+0000","last_clean":"2024-09-11T23:24:39.502831+0000","last_became_active":"2024-09-11T23:24:37.504818+0000","last_became_peered":"2024-09-11T23:24:37.504818+0000","last_unstale":"2024-09-11T23:24:39.502831+0000","last_undegraded":"2024-09-11T23:24:39.502831+0000","last_fullsized":"2024-09-11T23:24:39.502831+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:31.603564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.507081+0000","last_change":"2024-09-11T23:24:38.514795+0000","last_active":"2024-09-11T23:24:39.507081+0000","last_peered":"2024-09-11T23:24:39.507081+0000","last_clean":"2024-09-11T23:24:39.507081+0000","last_became_active":"2024-09-11T23:24:38.514497+0000","last_became_peered":"2024-09-11T23:24:38.514497+0000","last_unstale":"2024-09-11T23:24:39.507081+0000","last_undegraded":"2024-09-11T23:24:39.507081+0000","last_fullsized":"2024-09-11T23:24:39.507081+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:39.760701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575432+0000","last_change":"2024-09-11T23:24:37.502249+0000","last_active":"2024-09-11T23:24:39.575432+0000","last_peered":"2024-09-11T23:24:39.575432+0000","last_clean":"2024-09-11T23:24:39.575432+0000","last_became_active":"2024-09-11T23:24:37.501351+0000","last_became_peered":"2024-09-11T23:24:37.501351+0000","last_unstale":"2024-09-11T23:24:39.575432+0000","last_undegraded":"2024-09-11T23:24:39.575432+0000","last_fullsized":"2024-09-11T23:24:39.575432+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:17.942985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574858+0000","last_change":"2024-09-11T23:24:38.514642+0000","last_active":"2024-09-11T23:24:39.574858+0000","last_peered":"2024-09-11T23:24:39.574858+0000","last_clean":"2024-09-11T23:24:39.574858+0000","last_became_active":"2024-09-11T23:24:38.514029+0000","last_became_peered":"2024-09-11T23:24:38.514029+0000","last_unstale":"2024-09-11T23:24:39.574858+0000","last_undegraded":"2024-09-11T23:24:39.574858+0000","last_fullsized":"2024-09-11T23:24:39.574858+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:22.605428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574678+0000","last_change":"2024-09-11T23:24:37.506394+0000","last_active":"2024-09-11T23:24:39.574678+0000","last_peered":"2024-09-11T23:24:39.574678+0000","last_clean":"2024-09-11T23:24:39.574678+0000","last_became_active":"2024-09-11T23:24:37.506052+0000","last_became_peered":"2024-09-11T23:24:37.506052+0000","last_unstale":"2024-09-11T23:24:39.574678+0000","last_undegraded":"2024-09-11T23:24:39.574678+0000","last_fullsized":"2024-09-11T23:24:39.574678+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:18.573723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.506710+0000","last_change":"2024-09-11T23:24:38.515310+0000","last_active":"2024-09-11T23:24:39.506710+0000","last_peered":"2024-09-11T23:24:39.506710+0000","last_clean":"2024-09-11T23:24:39.506710+0000","last_became_active":"2024-09-11T23:24:38.515042+0000","last_became_peered":"2024-09-11T23:24:38.515042+0000","last_unstale":"2024-09-11T23:24:39.506710+0000","last_undegraded":"2024-09-11T23:24:39.506710+0000","last_fullsized":"2024-09-11T23:24:39.506710+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:09.921060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":14,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574517+0000","last_change":"2024-09-11T23:24:37.498140+0000","last_active":"2024-09-11T23:24:39.574517+0000","last_peered":"2024-09-11T23:24:39.574517+0000","last_clean":"2024-09-11T23:24:39.574517+0000","last_became_active":"2024-09-11T23:24:37.497858+0000","last_became_peered":"2024-09-11T23:24:37.497858+0000","last_unstale":"2024-09-11T23:24:39.574517+0000","last_undegraded":"2024-09-11T23:24:39.574517+0000","last_fullsized":"2024-09-11T23:24:39.574517+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:24.856592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":12,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.502722+0000","last_change":"2024-09-11T23:24:38.501453+0000","last_active":"2024-09-11T23:24:39.502722+0000","last_peered":"2024-09-11T23:24:39.502722+0000","last_clean":"2024-09-11T23:24:39.502722+0000","last_became_active":"2024-09-11T23:24:38.501088+0000","last_became_peered":"2024-09-11T23:24:38.501088+0000","last_unstale":"2024-09-11T23:24:39.502722+0000","last_undegraded":"2024-09-11T23:24:39.502722+0000","last_fullsized":"2024-09-11T23:24:39.502722+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":129,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:37.474204+0000","last_clean_scrub_stamp":"2024-09-11T23:24:37.474204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:54.009537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"130'3","reported_seq":17,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.575468+0000","last_change":"2024-09-11T23:24:37.499303+0000","last_active":"2024-09-11T23:24:39.575468+0000","last_peered":"2024-09-11T23:24:39.575468+0000","last_clean":"2024-09-11T23:24:39.575468+0000","last_became_active":"2024-09-11T23:24:37.498975+0000","last_became_peered":"2024-09-11T23:24:37.498975+0000","last_unstale":"2024-09-11T23:24:39.575468+0000","last_undegraded":"2024-09-11T23:24:39.575468+0000","last_fullsized":"2024-09-11T23:24:39.575468+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:24:36.471146+0000","last_clean_scrub_stamp":"2024-09-11T23:24:36.471146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:36.260563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":413,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-11T23:24:39.574877+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:24:39.574877+0000","last_peered":"2024-09-11T23:24:39.574877+0000","last_clean":"2024-09-11T23:24:39.574877+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:24:39.574877+0000","last_undegraded":"2024-09-11T23:24:39.574877+0000","last_fullsized":"2024-09-11T23:24:39.574877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476823,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33376,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338464,"statfs":{"total":96636764160,"available":96602587136,"internally_reserved":0,"allocated":2232320,"data_stored":1309571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476822,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32796,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339044,"statfs":{"total":96636764160,"available":96603181056,"internally_reserved":0,"allocated":1642496,"data_stored":718697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476821,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32792,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339048,"statfs":{"total":96636764160,"available":96603185152,"internally_reserved":0,"allocated":1634304,"data_stored":718573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476821,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1630208,"data_stored":718551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542230,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1634304,"data_stored":718641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542230,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32800,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339040,"statfs":{"total":96636764160,"available":96603176960,"internally_reserved":0,"allocated":1646592,"data_stored":720233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509526,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32784,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339056,"statfs":{"total":96636764160,"available":96603193344,"internally_reserved":0,"allocated":1634304,"data_stored":719133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509526,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33380,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338460,"statfs":{"total":96636764160,"available":96602583040,"internally_reserved":0,"allocated":2240512,"data_stored":1310565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:24:43.086 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:24:43.086 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:24:43.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.282+0000 7fbac6000640 1 Processor -- start 2024-09-11T23:24:43.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.282+0000 7fbac6000640 1 -- start start 2024-09-11T23:24:43.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.283+0000 7fbac6000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbac006f130 0x7fbac0072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:43.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.283+0000 7fbac6000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbac015f9f0 0x7fbac00ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:43.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.283+0000 7fbac6000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbac015c970 con 0x7fbac015b370 2024-09-11T23:24:43.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.283+0000 7fbac6000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fbac015fef0 con 0x7fbac006f130 2024-09-11T23:24:43.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.283+0000 7fbac6000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbac015bbb0 con 0x7fbac015f9f0 2024-09-11T23:24:43.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.284+0000 7fbab6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbac006f130 0x7fbac0072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:43.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.284+0000 7fbabf400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbac015b370 0x7fbac006ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54356/0 (socket says 172.21.15.144:54356) 2024-09-11T23:24:43.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.284+0000 7fbabf400640 1 -- 172.21.15.144:0/1984016482 learned_addr learned my addr 172.21.15.144:0/1984016482 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:43.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.284+0000 7fbab6a00640 1 -- 172.21.15.144:0/1984016482 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbac015f9f0 msgr2=0x7fbac00ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:43.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.284+0000 7fbab6a00640 1 --2- 172.21.15.144:0/1984016482 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbac015f9f0 0x7fbac00ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.284+0000 7fbab6a00640 1 -- 172.21.15.144:0/1984016482 >> v1:172.21.15.144:6789/0 conn(0x7fbac015b370 legacy=0x7fbac006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:43.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.284+0000 7fbab6a00640 1 -- 172.21.15.144:0/1984016482 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac015be90 con 0x7fbac006f130 2024-09-11T23:24:43.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.285+0000 7fbab6a00640 1 --2- 172.21.15.144:0/1984016482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac006f130 0x7fbac0072560 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80097a0 tx=0x7fbaa802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8280a3b38cf67dcb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.285+0000 7fbabea00640 1 -- 172.21.15.144:0/1984016482 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8037070 con 0x7fbac006f130 2024-09-11T23:24:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.285+0000 7fbabea00640 1 -- 172.21.15.144:0/1984016482 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaa8032440 con 0x7fbac006f130 2024-09-11T23:24:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.285+0000 7fbabea00640 1 -- 172.21.15.144:0/1984016482 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa802ae60 con 0x7fbac006f130 2024-09-11T23:24:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.286+0000 7fbac6000640 1 -- 172.21.15.144:0/1984016482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac006f130 msgr2=0x7fbac0072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.286+0000 7fbac6000640 1 --2- 172.21.15.144:0/1984016482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac006f130 0x7fbac0072560 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80097a0 tx=0x7fbaa802a110 comp rx=0 tx=0).stop 2024-09-11T23:24:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.286+0000 7fbac6000640 1 -- 172.21.15.144:0/1984016482 shutdown_connections 2024-09-11T23:24:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.286+0000 7fbac6000640 1 --2- 172.21.15.144:0/1984016482 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbac015f9f0 0x7fbac00ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.286+0000 7fbac6000640 1 --2- 172.21.15.144:0/1984016482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac006f130 0x7fbac0072560 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.286+0000 7fbac6000640 1 -- 172.21.15.144:0/1984016482 >> 172.21.15.144:0/1984016482 conn(0x7fbac006bba0 msgr2=0x7fbac006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:43.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.286+0000 7fbac6000640 1 -- 172.21.15.144:0/1984016482 shutdown_connections 2024-09-11T23:24:43.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.286+0000 7fbac6000640 1 -- 172.21.15.144:0/1984016482 wait complete. 2024-09-11T23:24:43.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.288+0000 7fbac6000640 1 Processor -- start 2024-09-11T23:24:43.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.288+0000 7fbac6000640 1 -- start start 2024-09-11T23:24:43.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.289+0000 7fbac6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac006f130 0x7fbac01427f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:43.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.289+0000 7fbac6000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbac015b370 0x7fbac0159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:43.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.289+0000 7fbac6000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbac015f9f0 0x7fbac0148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:43.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.289+0000 7fbac6000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbac00731b0 con 0x7fbac006f130 2024-09-11T23:24:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.289+0000 7fbac6000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbac015c450 con 0x7fbac015f9f0 2024-09-11T23:24:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.289+0000 7fbac6000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbac015b750 con 0x7fbac015b370 2024-09-11T23:24:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.289+0000 7fbabf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac006f130 0x7fbac01427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.289+0000 7fbabf400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac006f130 0x7fbac01427f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38888/0 (socket says 172.21.15.144:38888) 2024-09-11T23:24:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.289+0000 7fbabf400640 1 -- 172.21.15.144:0/3983690355 learned_addr learned my addr 172.21.15.144:0/3983690355 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.289+0000 7fbab6a00640 1 --2- 172.21.15.144:0/3983690355 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbac015b370 0x7fbac0159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.289+0000 7fbabfe00640 1 --2- 172.21.15.144:0/3983690355 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbac015f9f0 0x7fbac0148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.289+0000 7fbabf400640 1 -- 172.21.15.144:0/3983690355 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbac015b370 msgr2=0x7fbac0159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.289+0000 7fbabf400640 1 --2- 172.21.15.144:0/3983690355 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbac015b370 0x7fbac0159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.289+0000 7fbabf400640 1 -- 172.21.15.144:0/3983690355 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbac015f9f0 msgr2=0x7fbac0148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.289+0000 7fbabf400640 1 --2- 172.21.15.144:0/3983690355 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbac015f9f0 0x7fbac0148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.289+0000 7fbabf400640 1 -- 172.21.15.144:0/3983690355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac00b39f0 con 0x7fbac006f130 2024-09-11T23:24:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.290+0000 7fbabf400640 1 --2- 172.21.15.144:0/3983690355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac006f130 0x7fbac01427f0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fbab000c430 tx=0x7fbab000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:43.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.290+0000 7fbab7e00640 1 -- 172.21.15.144:0/3983690355 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab0017070 con 0x7fbac006f130 2024-09-11T23:24:43.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.290+0000 7fbab7e00640 1 -- 172.21.15.144:0/3983690355 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbab0005ce0 con 0x7fbac006f130 2024-09-11T23:24:43.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.290+0000 7fbab7e00640 1 -- 172.21.15.144:0/3983690355 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab00072f0 con 0x7fbac006f130 2024-09-11T23:24:43.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.290+0000 7fbac6000640 1 -- 172.21.15.144:0/3983690355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac0159c50 con 0x7fbac006f130 2024-09-11T23:24:43.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.290+0000 7fbac6000640 1 -- 172.21.15.144:0/3983690355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac015a210 con 0x7fbac006f130 2024-09-11T23:24:43.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.291+0000 7fbac6000640 1 -- 172.21.15.144:0/3983690355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbac0072560 con 0x7fbac006f130 2024-09-11T23:24:43.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.292+0000 7fbab7e00640 1 -- 172.21.15.144:0/3983690355 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7fbab001a070 con 0x7fbac006f130 2024-09-11T23:24:43.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.293+0000 7fbab7e00640 1 --2- 172.21.15.144:0/3983690355 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fba9c06c3d0 0x7fba9c06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:43.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.293+0000 7fbab7e00640 1 -- 172.21.15.144:0/3983690355 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7fbab008ad30 con 0x7fbac006f130 2024-09-11T23:24:43.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.293+0000 7fbab6a00640 1 --2- 172.21.15.144:0/3983690355 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fba9c06c3d0 0x7fba9c06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:43.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.294+0000 7fbab6a00640 1 --2- 172.21.15.144:0/3983690355 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fba9c06c3d0 0x7fba9c06e890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8034000 tx=0x7fbaa802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:43.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.297+0000 7fbab7e00640 1 -- 172.21.15.144:0/3983690355 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbac00b39f0 con 0x7fbac006f130 2024-09-11T23:24:43.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.534+0000 7fbac6000640 1 -- 172.21.15.144:0/3983690355 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fbac00ce4f0 con 0x7fbac006f130 2024-09-11T23:24:43.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.538+0000 7fbab7e00640 1 -- 172.21.15.144:0/3983690355 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7fbab0058e30 con 0x7fbac006f130 2024-09-11T23:24:43.539 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-11T23:24:43.539 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A== 2024-09-11T23:24:43.539 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-11T23:24:43.539 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-11T23:24:43.539 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:24:43.539 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-11T23:24:43.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.540+0000 7fbac6000640 1 -- 172.21.15.144:0/3983690355 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fba9c06c3d0 msgr2=0x7fba9c06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:43.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.540+0000 7fbac6000640 1 --2- 172.21.15.144:0/3983690355 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fba9c06c3d0 0x7fba9c06e890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8034000 tx=0x7fbaa802e000 comp rx=0 tx=0).stop 2024-09-11T23:24:43.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.540+0000 7fbac6000640 1 -- 172.21.15.144:0/3983690355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac006f130 msgr2=0x7fbac01427f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:43.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.540+0000 7fbac6000640 1 --2- 172.21.15.144:0/3983690355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac006f130 0x7fbac01427f0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fbab000c430 tx=0x7fbab000c8f0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.540+0000 7fbac6000640 1 -- 172.21.15.144:0/3983690355 shutdown_connections 2024-09-11T23:24:43.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.540+0000 7fbac6000640 1 --2- 172.21.15.144:0/3983690355 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fba9c06c3d0 0x7fba9c06e890 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.540+0000 7fbac6000640 1 --2- 172.21.15.144:0/3983690355 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbac015f9f0 0x7fbac0148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.540+0000 7fbac6000640 1 --2- 172.21.15.144:0/3983690355 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbac015b370 0x7fbac0159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.540+0000 7fbac6000640 1 --2- 172.21.15.144:0/3983690355 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbac006f130 0x7fbac01427f0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.540+0000 7fbac6000640 1 -- 172.21.15.144:0/3983690355 >> 172.21.15.144:0/3983690355 conn(0x7fbac006bba0 msgr2=0x7fbac006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:43.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.541+0000 7fbac6000640 1 -- 172.21.15.144:0/3983690355 shutdown_connections 2024-09-11T23:24:43.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.541+0000 7fbac6000640 1 -- 172.21.15.144:0/3983690355 wait complete. 2024-09-11T23:24:43.557 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:24:43.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.726+0000 7f58d0200640 1 Processor -- start 2024-09-11T23:24:43.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.726+0000 7f58d0200640 1 -- start start 2024-09-11T23:24:43.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.727+0000 7f58d0200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c80d02a0 0x7f58c80d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:43.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.727+0000 7f58d0200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58c80d0bc0 con 0x7f58c815ca40 2024-09-11T23:24:43.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.727+0000 7f58d0200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58c815d390 con 0x7f58c815ce80 2024-09-11T23:24:43.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.727+0000 7f58d0200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f58c815d670 con 0x7f58c80d02a0 2024-09-11T23:24:43.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.728+0000 7f58cce00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f58c815ca40 0x7f58c815e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:54362/0 (socket says 172.21.15.144:54362) 2024-09-11T23:24:43.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.728+0000 7f58cce00640 1 -- 172.21.15.144:0/3765965355 learned_addr learned my addr 172.21.15.144:0/3765965355 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:43.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.728+0000 7f58cd800640 1 --2- 172.21.15.144:0/3765965355 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c80d02a0 0x7f58c80d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:43.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.728+0000 7f58c7e00640 1 -- 172.21.15.144:0/3765965355 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4294322066 0 0) 0x7f58c80d0bc0 con 0x7f58c815ca40 2024-09-11T23:24:43.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.728+0000 7f58c7e00640 1 -- 172.21.15.144:0/3765965355 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58b0003520 con 0x7f58c815ca40 2024-09-11T23:24:43.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.728+0000 7f58c7e00640 1 -- 172.21.15.144:0/3765965355 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1085464187 0 0) 0x7f58c815d390 con 0x7f58c815ce80 2024-09-11T23:24:43.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.728+0000 7f58c7e00640 1 -- 172.21.15.144:0/3765965355 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58c80d0bc0 con 0x7f58c815ce80 2024-09-11T23:24:43.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.728+0000 7f58cd800640 1 -- 172.21.15.144:0/3765965355 >> v1:172.21.15.165:6789/0 conn(0x7f58c815ce80 legacy=0x7f58c81594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:43.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.728+0000 7f58cd800640 1 -- 172.21.15.144:0/3765965355 >> v1:172.21.15.144:6789/0 conn(0x7f58c815ca40 legacy=0x7f58c815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:43.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.728+0000 7f58cd800640 1 -- 172.21.15.144:0/3765965355 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c815d950 con 0x7f58c80d02a0 2024-09-11T23:24:43.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.729+0000 7f58cd800640 1 --2- 172.21.15.144:0/3765965355 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c80d02a0 0x7f58c80d0680 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0097d0 tx=0x7f58bc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c3aa3972aaa2ee7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:43.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.730+0000 7f58c7e00640 1 -- 172.21.15.144:0/3765965355 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc037070 con 0x7f58c80d02a0 2024-09-11T23:24:43.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.730+0000 7f58c7e00640 1 -- 172.21.15.144:0/3765965355 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58bc032440 con 0x7f58c80d02a0 2024-09-11T23:24:43.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.730+0000 7f58c7e00640 1 -- 172.21.15.144:0/3765965355 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc032810 con 0x7f58c80d02a0 2024-09-11T23:24:43.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.730+0000 7f58d0200640 1 -- 172.21.15.144:0/3765965355 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c80d02a0 msgr2=0x7f58c80d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:43.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.730+0000 7f58d0200640 1 --2- 172.21.15.144:0/3765965355 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c80d02a0 0x7f58c80d0680 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0097d0 tx=0x7f58bc02a180 comp rx=0 tx=0).stop 2024-09-11T23:24:43.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.731+0000 7f58d0200640 1 -- 172.21.15.144:0/3765965355 shutdown_connections 2024-09-11T23:24:43.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.731+0000 7f58d0200640 1 --2- 172.21.15.144:0/3765965355 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c80d02a0 0x7f58c80d0680 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.731+0000 7f58d0200640 1 -- 172.21.15.144:0/3765965355 >> 172.21.15.144:0/3765965355 conn(0x7f58c8062cc0 msgr2=0x7f58c806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:43.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.731+0000 7f58d0200640 1 -- 172.21.15.144:0/3765965355 shutdown_connections 2024-09-11T23:24:43.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.731+0000 7f58d0200640 1 -- 172.21.15.144:0/3765965355 wait complete. 2024-09-11T23:24:43.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.732+0000 7f58d0200640 1 Processor -- start 2024-09-11T23:24:43.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.732+0000 7f58d0200640 1 -- start start 2024-09-11T23:24:43.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.733+0000 7f58d0200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c80d02a0 0x7f58c815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:43.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.733+0000 7f58d0200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58c815ca40 0x7f58c8145150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:43.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.733+0000 7f58d0200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58c815ce80 0x7f58c80733d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:43.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.733+0000 7f58d0200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f58c815eb40 con 0x7f58c815ca40 2024-09-11T23:24:43.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.733+0000 7f58d0200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f58c815df10 con 0x7f58c815ce80 2024-09-11T23:24:43.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.733+0000 7f58d0200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f58c8155b90 con 0x7f58c80d02a0 2024-09-11T23:24:43.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.734+0000 7f58cce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58c815ca40 0x7f58c8145150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:43.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.734+0000 7f58cce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58c815ca40 0x7f58c8145150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:38892/0 (socket says 172.21.15.144:38892) 2024-09-11T23:24:43.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.734+0000 7f58cce00640 1 -- 172.21.15.144:0/3044458359 learned_addr learned my addr 172.21.15.144:0/3044458359 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:43.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.734+0000 7f58cd800640 1 --2- 172.21.15.144:0/3044458359 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c80d02a0 0x7f58c815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:43.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.734+0000 7f58ce200640 1 --2- 172.21.15.144:0/3044458359 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58c815ce80 0x7f58c80733d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:43.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.734+0000 7f58cce00640 1 -- 172.21.15.144:0/3044458359 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c80d02a0 msgr2=0x7f58c815a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:43.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.734+0000 7f58cce00640 1 --2- 172.21.15.144:0/3044458359 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c80d02a0 0x7f58c815a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.734+0000 7f58cce00640 1 -- 172.21.15.144:0/3044458359 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58c815ce80 msgr2=0x7f58c80733d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:43.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.734+0000 7f58cce00640 1 --2- 172.21.15.144:0/3044458359 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58c815ce80 0x7f58c80733d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.734+0000 7f58cce00640 1 -- 172.21.15.144:0/3044458359 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c80af7d0 con 0x7f58c815ca40 2024-09-11T23:24:43.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.734+0000 7f58cce00640 1 --2- 172.21.15.144:0/3044458359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58c815ca40 0x7f58c8145150 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f58b400c4d0 tx=0x7f58b400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:43.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.735+0000 7f58c5600640 1 -- 172.21.15.144:0/3044458359 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b4017070 con 0x7f58c815ca40 2024-09-11T23:24:43.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.735+0000 7f58c5600640 1 -- 172.21.15.144:0/3044458359 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b4005ce0 con 0x7f58c815ca40 2024-09-11T23:24:43.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.735+0000 7f58c5600640 1 -- 172.21.15.144:0/3044458359 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b4007270 con 0x7f58c815ca40 2024-09-11T23:24:43.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.735+0000 7f58d0200640 1 -- 172.21.15.144:0/3044458359 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c814ccb0 con 0x7f58c815ca40 2024-09-11T23:24:43.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.735+0000 7f58d0200640 1 -- 172.21.15.144:0/3044458359 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c814d270 con 0x7f58c815ca40 2024-09-11T23:24:43.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.736+0000 7f58d0200640 1 -- 172.21.15.144:0/3044458359 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c80b4790 con 0x7f58c815ca40 2024-09-11T23:24:43.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.737+0000 7f58c5600640 1 -- 172.21.15.144:0/3044458359 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f58b401a070 con 0x7f58c815ca40 2024-09-11T23:24:43.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.737+0000 7f58c5600640 1 --2- 172.21.15.144:0/3044458359 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f58a806c3d0 0x7f58a806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:43.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.737+0000 7f58c5600640 1 -- 172.21.15.144:0/3044458359 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f58b408aaf0 con 0x7f58c815ca40 2024-09-11T23:24:43.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.738+0000 7f58cd800640 1 --2- 172.21.15.144:0/3044458359 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f58a806c3d0 0x7f58a806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:43.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.739+0000 7f58cd800640 1 --2- 172.21.15.144:0/3044458359 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f58a806c3d0 0x7f58a806e890 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f58bc034000 tx=0x7f58bc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:43.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.742+0000 7f58c5600640 1 -- 172.21.15.144:0/3044458359 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f58c80af7d0 con 0x7f58c815ca40 2024-09-11T23:24:43.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.949+0000 7f58d0200640 1 -- 172.21.15.144:0/3044458359 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58c80ce920 con 0x7f58c815ca40 2024-09-11T23:24:43.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.950+0000 7f58c5600640 1 -- 172.21.15.144:0/3044458359 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5239 (secure 0 0 0) 0x7f58b4058630 con 0x7f58c815ca40 2024-09-11T23:24:43.950 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:24:43.950 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":90,"btime":"2024-09-11T23:24:41:512789+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6587,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/3230009607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3230009607},{"type":"v1","addr":"172.21.15.144:6801","nonce":3230009607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7755,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2789293878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2789293878},{"type":"v1","addr":"172.21.15.165:6834","nonce":2789293878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7758,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2328841770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2328841770},{"type":"v1","addr":"172.21.15.165:6835","nonce":2328841770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:24:37.895286+0000","modified":"2024-09-11T23:24:40.918906+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7761":{"gid":7761,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1155743669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1155743669},{"type":"v1","addr":"172.21.15.144:6835","nonce":1155743669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7761,"qdb_cluster":[7761]},"id":10}]} 2024-09-11T23:24:43.950 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 90 2024-09-11T23:24:43.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.952+0000 7f58d0200640 1 -- 172.21.15.144:0/3044458359 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f58a806c3d0 msgr2=0x7f58a806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:43.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.952+0000 7f58d0200640 1 --2- 172.21.15.144:0/3044458359 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f58a806c3d0 0x7f58a806e890 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f58bc034000 tx=0x7f58bc02e000 comp rx=0 tx=0).stop 2024-09-11T23:24:43.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.952+0000 7f58d0200640 1 -- 172.21.15.144:0/3044458359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58c815ca40 msgr2=0x7f58c8145150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:43.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.952+0000 7f58d0200640 1 --2- 172.21.15.144:0/3044458359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58c815ca40 0x7f58c8145150 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f58b400c4d0 tx=0x7f58b400c990 comp rx=0 tx=0).stop 2024-09-11T23:24:43.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.952+0000 7f58d0200640 1 -- 172.21.15.144:0/3044458359 shutdown_connections 2024-09-11T23:24:43.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.952+0000 7f58d0200640 1 --2- 172.21.15.144:0/3044458359 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f58a806c3d0 0x7f58a806e890 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.952+0000 7f58d0200640 1 --2- 172.21.15.144:0/3044458359 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58c815ce80 0x7f58c80733d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.952+0000 7f58d0200640 1 --2- 172.21.15.144:0/3044458359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58c815ca40 0x7f58c8145150 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.952+0000 7f58d0200640 1 --2- 172.21.15.144:0/3044458359 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58c80d02a0 0x7f58c815a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:43.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.952+0000 7f58d0200640 1 -- 172.21.15.144:0/3044458359 >> 172.21.15.144:0/3044458359 conn(0x7f58c8062cc0 msgr2=0x7f58c80cdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:43.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.952+0000 7f58d0200640 1 -- 172.21.15.144:0/3044458359 shutdown_connections 2024-09-11T23:24:43.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:43.952+0000 7f58d0200640 1 -- 172.21.15.144:0/3044458359 wait complete. 2024-09-11T23:24:44.093 INFO:tasks.ceph.mds.c.smithi144.stderr:2024-09-11T23:24:44.093+0000 7f4183800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:24:44.371 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 90, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:24:37.895286+0000', 'modified': '2024-09-11T23:24:40.918906+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7761}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7761': {'gid': 7761, 'name': 'c', 'rank': 0, 'incarnation': 86, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6835/1155743669', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 1155743669}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 1155743669}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7761, 'qdb_cluster': [7761]} 2024-09-11T23:24:44.372 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:24:44.372 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-11T23:24:44.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.527+0000 7fad03800640 1 Processor -- start 2024-09-11T23:24:44.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.528+0000 7fad03800640 1 -- start start 2024-09-11T23:24:44.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.529+0000 7fad03800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7facfc0cf070 0x7facfc0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.529+0000 7fad03800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facfc0ce740 con 0x7facfc15c180 2024-09-11T23:24:44.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.529+0000 7fad03800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facfc072640 con 0x7facfc073120 2024-09-11T23:24:44.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.529+0000 7fad03800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7facfc072920 con 0x7facfc0cf070 2024-09-11T23:24:44.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.529+0000 7fad00e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7facfc15c180 0x7facfc0cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39616/0 (socket says 172.21.15.144:39616) 2024-09-11T23:24:44.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.529+0000 7fad00e00640 1 -- 172.21.15.144:0/1855299784 learned_addr learned my addr 172.21.15.144:0/1855299784 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:44.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.529+0000 7facf3e00640 1 --2- 172.21.15.144:0/1855299784 >> v2:172.21.15.165:3300/0 conn(0x7facfc0cf070 0x7facfc0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.530+0000 7facf3e00640 1 -- 172.21.15.144:0/1855299784 >> v1:172.21.15.165:6789/0 conn(0x7facfc073120 legacy=0x7facfc06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:44.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.530+0000 7facf3e00640 1 -- 172.21.15.144:0/1855299784 >> v1:172.21.15.144:6789/0 conn(0x7facfc15c180 legacy=0x7facfc0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:44.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.530+0000 7facf3e00640 1 -- 172.21.15.144:0/1855299784 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facfc072c00 con 0x7facfc0cf070 2024-09-11T23:24:44.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.531+0000 7facf3e00640 1 --2- 172.21.15.144:0/1855299784 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facfc0cf070 0x7facfc0cf4e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7face40097a0 tx=0x7face402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=105052a55182e6ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:44.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.533+0000 7facfbe00640 1 -- 172.21.15.144:0/1855299784 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4037070 con 0x7facfc0cf070 2024-09-11T23:24:44.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.533+0000 7facfbe00640 1 -- 172.21.15.144:0/1855299784 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face4032440 con 0x7facfc0cf070 2024-09-11T23:24:44.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.533+0000 7facfbe00640 1 -- 172.21.15.144:0/1855299784 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4032810 con 0x7facfc0cf070 2024-09-11T23:24:44.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.533+0000 7fad03800640 1 -- 172.21.15.144:0/1855299784 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facfc0cf070 msgr2=0x7facfc0cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:44.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.533+0000 7fad03800640 1 --2- 172.21.15.144:0/1855299784 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facfc0cf070 0x7facfc0cf4e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7face40097a0 tx=0x7face402a1a0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.534+0000 7fad03800640 1 -- 172.21.15.144:0/1855299784 shutdown_connections 2024-09-11T23:24:44.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.534+0000 7fad03800640 1 --2- 172.21.15.144:0/1855299784 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facfc0cf070 0x7facfc0cf4e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.534+0000 7fad03800640 1 -- 172.21.15.144:0/1855299784 >> 172.21.15.144:0/1855299784 conn(0x7facfc062cc0 msgr2=0x7facfc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:44.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.534+0000 7fad03800640 1 -- 172.21.15.144:0/1855299784 shutdown_connections 2024-09-11T23:24:44.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.534+0000 7fad03800640 1 -- 172.21.15.144:0/1855299784 wait complete. 2024-09-11T23:24:44.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.535+0000 7fad03800640 1 Processor -- start 2024-09-11T23:24:44.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.535+0000 7fad03800640 1 -- start start 2024-09-11T23:24:44.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.536+0000 7fad03800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7facfc073120 0x7facfc1438a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.536+0000 7fad03800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facfc0cf070 0x7facfc0c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.536+0000 7fad03800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facfc15c180 0x7facfc140430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.536+0000 7fad03800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7facfc0722f0 con 0x7facfc0cf070 2024-09-11T23:24:44.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.536+0000 7fad03800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7facfc0ced00 con 0x7facfc15c180 2024-09-11T23:24:44.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.536+0000 7fad03800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7facfc15c560 con 0x7facfc073120 2024-09-11T23:24:44.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.537+0000 7facf3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facfc0cf070 0x7facfc0c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.537+0000 7facf3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facfc0cf070 0x7facfc0c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50944/0 (socket says 172.21.15.144:50944) 2024-09-11T23:24:44.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.537+0000 7facf3e00640 1 -- 172.21.15.144:0/2784149950 learned_addr learned my addr 172.21.15.144:0/2784149950 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:44.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.537+0000 7fad00e00640 1 --2- 172.21.15.144:0/2784149950 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7facfc073120 0x7facfc1438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.537+0000 7fad01800640 1 --2- 172.21.15.144:0/2784149950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facfc15c180 0x7facfc140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.537+0000 7facf3e00640 1 -- 172.21.15.144:0/2784149950 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7facfc073120 msgr2=0x7facfc1438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:44.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.537+0000 7facf3e00640 1 --2- 172.21.15.144:0/2784149950 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7facfc073120 0x7facfc1438a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.537+0000 7facf3e00640 1 -- 172.21.15.144:0/2784149950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facfc15c180 msgr2=0x7facfc140430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:44.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.537+0000 7facf3e00640 1 --2- 172.21.15.144:0/2784149950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facfc15c180 0x7facfc140430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.537+0000 7facf3e00640 1 -- 172.21.15.144:0/2784149950 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facfc140e00 con 0x7facfc0cf070 2024-09-11T23:24:44.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.537+0000 7fad00e00640 1 --2- 172.21.15.144:0/2784149950 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7facfc073120 0x7facfc1438a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:44.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.537+0000 7facf3e00640 1 --2- 172.21.15.144:0/2784149950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facfc0cf070 0x7facfc0c52b0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7face4035040 tx=0x7face40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:44.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.538+0000 7facf9600640 1 -- 172.21.15.144:0/2784149950 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4037040 con 0x7facfc0cf070 2024-09-11T23:24:44.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.538+0000 7facf9600640 1 -- 172.21.15.144:0/2784149950 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face4030770 con 0x7facfc0cf070 2024-09-11T23:24:44.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.538+0000 7fad03800640 1 -- 172.21.15.144:0/2784149950 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facfc1410a0 con 0x7facfc0cf070 2024-09-11T23:24:44.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.538+0000 7facf9600640 1 -- 172.21.15.144:0/2784149950 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4030b80 con 0x7facfc0cf070 2024-09-11T23:24:44.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.538+0000 7fad03800640 1 -- 172.21.15.144:0/2784149950 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facfc141660 con 0x7facfc0cf070 2024-09-11T23:24:44.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.540+0000 7facf9600640 1 -- 172.21.15.144:0/2784149950 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7face4044020 con 0x7facfc0cf070 2024-09-11T23:24:44.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.540+0000 7facf9600640 1 --2- 172.21.15.144:0/2784149950 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7facd806c3d0 0x7facd806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.540+0000 7facf9600640 1 -- 172.21.15.144:0/2784149950 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7face40abce0 con 0x7facfc0cf070 2024-09-11T23:24:44.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.541+0000 7fad00e00640 1 --2- 172.21.15.144:0/2784149950 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7facd806c3d0 0x7facd806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.541+0000 7fad065e2740 1 Processor -- start 2024-09-11T23:24:44.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.541+0000 7fad065e2740 1 -- start start 2024-09-11T23:24:44.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.542+0000 7fad00e00640 1 --2- 172.21.15.144:0/2784149950 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7facd806c3d0 0x7facd806e890 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7facec005880 tx=0x7facec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:44.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.542+0000 7fad065e2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce7362b50 0x55dce7362f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.542+0000 7fad065e2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce737d510 0x55dce737ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.542+0000 7fad065e2740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce73364b0 0x55dce737f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.542+0000 7fad065e2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55dce72973b0 con 0x55dce7362b50 2024-09-11T23:24:44.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.542+0000 7fad065e2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55dce729c410 con 0x55dce737d510 2024-09-11T23:24:44.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.542+0000 7fad065e2740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55dce7244620 con 0x55dce73364b0 2024-09-11T23:24:44.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.542+0000 7fad00e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce7362b50 0x55dce7362f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.542+0000 7fad00e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce7362b50 0x55dce7362f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50948/0 (socket says 172.21.15.144:50948) 2024-09-11T23:24:44.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.542+0000 7fad00e00640 1 -- 172.21.15.144:0/3106872287 learned_addr learned my addr 172.21.15.144:0/3106872287 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:44.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.542+0000 7facf3e00640 1 --2- 172.21.15.144:0/3106872287 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce737d510 0x55dce737ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.542+0000 7fad01800640 1 --2- 172.21.15.144:0/3106872287 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce73364b0 0x55dce737f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.543+0000 7fad00e00640 1 -- 172.21.15.144:0/3106872287 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce73364b0 msgr2=0x55dce737f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:44.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.543+0000 7fad00e00640 1 --2- 172.21.15.144:0/3106872287 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce73364b0 0x55dce737f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.543+0000 7fad00e00640 1 -- 172.21.15.144:0/3106872287 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce737d510 msgr2=0x55dce737ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:44.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.543+0000 7fad00e00640 1 --2- 172.21.15.144:0/3106872287 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce737d510 0x55dce737ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.543+0000 7fad00e00640 1 -- 172.21.15.144:0/3106872287 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dce6faf2d0 con 0x55dce7362b50 2024-09-11T23:24:44.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.543+0000 7fad00e00640 1 --2- 172.21.15.144:0/3106872287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce7362b50 0x55dce7362f30 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7facec0058b0 tx=0x7facec011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec787533feea2ed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:44.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.543+0000 7facf1600640 1 -- 172.21.15.144:0/3106872287 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facec005e30 con 0x55dce7362b50 2024-09-11T23:24:44.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.543+0000 7facf1600640 1 -- 172.21.15.144:0/3106872287 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facec00e7b0 con 0x55dce7362b50 2024-09-11T23:24:44.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.543+0000 7facf1600640 1 -- 172.21.15.144:0/3106872287 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facec00eb60 con 0x55dce7362b50 2024-09-11T23:24:44.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.544+0000 7fad065e2740 1 -- 172.21.15.144:0/3106872287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce7362b50 msgr2=0x55dce7362f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:44.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.544+0000 7fad065e2740 1 --2- 172.21.15.144:0/3106872287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce7362b50 0x55dce7362f30 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7facec0058b0 tx=0x7facec011000 comp rx=0 tx=0).stop 2024-09-11T23:24:44.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.544+0000 7fad065e2740 1 -- 172.21.15.144:0/3106872287 shutdown_connections 2024-09-11T23:24:44.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.544+0000 7fad065e2740 1 --2- 172.21.15.144:0/3106872287 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce73364b0 0x55dce737f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.544+0000 7fad065e2740 1 --2- 172.21.15.144:0/3106872287 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce737d510 0x55dce737ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.544+0000 7fad065e2740 1 --2- 172.21.15.144:0/3106872287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce7362b50 0x55dce7362f30 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.544+0000 7fad065e2740 1 -- 172.21.15.144:0/3106872287 >> 172.21.15.144:0/3106872287 conn(0x55dce7335740 msgr2=0x55dce737d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:44.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.544+0000 7fad065e2740 1 -- 172.21.15.144:0/3106872287 shutdown_connections 2024-09-11T23:24:44.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.544+0000 7fad065e2740 1 -- 172.21.15.144:0/3106872287 wait complete. 2024-09-11T23:24:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.545+0000 7fad065e2740 1 -- start start 2024-09-11T23:24:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.545+0000 7fad065e2740 1 Processor -- start 2024-09-11T23:24:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.546+0000 7fad065e2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce7362b50 0x55dce7350de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.546+0000 7fad065e2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce737d510 0x55dce7351320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.546+0000 7fad065e2740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce7386ca0 0x55dce7363d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.546+0000 7fad065e2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55dce7257780 con 0x55dce737d510 2024-09-11T23:24:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.546+0000 7fad065e2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55dce72983d0 con 0x55dce7362b50 2024-09-11T23:24:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.546+0000 7fad065e2740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55dce7363910 con 0x55dce7386ca0 2024-09-11T23:24:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.546+0000 7fad065e2740 10 client.0 _ll_register_callbacks cb 0x55dce72955d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:24:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.546+0000 7facf3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce737d510 0x55dce7351320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.546+0000 7fad00e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce7362b50 0x55dce7350de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.546+0000 7facf3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce737d510 0x55dce7351320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50954/0 (socket says 172.21.15.144:50954) 2024-09-11T23:24:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.546+0000 7facf3e00640 1 -- 172.21.15.144:0/746829505 learned_addr learned my addr 172.21.15.144:0/746829505 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.546+0000 7fad00e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce7362b50 0x55dce7350de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:35386/0 (socket says 172.21.15.144:35386) 2024-09-11T23:24:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.546+0000 7fad01800640 1 --2- 172.21.15.144:0/746829505 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce7386ca0 0x55dce7363d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.547+0000 7facf3e00640 1 -- 172.21.15.144:0/746829505 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce7386ca0 msgr2=0x55dce7363d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.547+0000 7facf3e00640 1 --2- 172.21.15.144:0/746829505 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce7386ca0 0x55dce7363d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.547+0000 7facf3e00640 1 -- 172.21.15.144:0/746829505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce7362b50 msgr2=0x55dce7350de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.547+0000 7facf3e00640 1 --2- 172.21.15.144:0/746829505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce7362b50 0x55dce7350de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.547+0000 7facf3e00640 1 -- 172.21.15.144:0/746829505 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dce70796b0 con 0x55dce737d510 2024-09-11T23:24:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.547+0000 7fad00e00640 1 --2- 172.21.15.144:0/746829505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce7362b50 0x55dce7350de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:24:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.547+0000 7facf3e00640 1 --2- 172.21.15.144:0/746829505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce737d510 0x55dce7351320 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7face40097a0 tx=0x7face407a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aeb993b57841af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.547+0000 7facea000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:24:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.547+0000 7facea000640 1 -- 172.21.15.144:0/746829505 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face40a8060 con 0x55dce737d510 2024-09-11T23:24:44.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.547+0000 7facea000640 1 -- 172.21.15.144:0/746829505 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7face40800b0 con 0x55dce737d510 2024-09-11T23:24:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.547+0000 7fad065e2740 1 -- 172.21.15.144:0/746829505 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facec00e7b0 con 0x55dce737d510 2024-09-11T23:24:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.548+0000 7facea000640 1 -- 172.21.15.144:0/746829505 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7face4096050 con 0x55dce737d510 2024-09-11T23:24:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.548+0000 7fad065e2740 10 client.7884 fetch_fsmap learned FSMap version 90 2024-09-11T23:24:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.548+0000 7fad065e2740 1 -- 172.21.15.144:0/746829505 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) -- 0x55dce7351ba0 con 0x55dce737d510 2024-09-11T23:24:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.548+0000 7facea000640 1 -- 172.21.15.144:0/746829505 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facec00e7b0 con 0x55dce737d510 2024-09-11T23:24:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.548+0000 7facea000640 1 -- 172.21.15.144:0/746829505 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 90) ==== 3502+0+0 (secure 0 0 0) 0x7face403a030 con 0x55dce737d510 2024-09-11T23:24:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.548+0000 7fad065e2740 10 client.7884 fetch_fsmap finished waiting for FSMap version 90 2024-09-11T23:24:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.548+0000 7fad065e2740 10 client.7884 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:24:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.548+0000 7fad065e2740 20 client.7884 populate_metadata read hostname 'smithi144' 2024-09-11T23:24:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.548+0000 7fad065e2740 1 --2- 172.21.15.144:0/746829505 >> [v2:172.21.15.144:6834/1155743669,v1:172.21.15.144:6835/1155743669] conn(0x55dce739e310 0x55dce73a0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.548+0000 7fad065e2740 4 client.7884 mds_command: new command op to 7761 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:24:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.548+0000 7fad065e2740 1 -- 172.21.15.144:0/746829505 --> [v2:172.21.15.144:6834/1155743669,v1:172.21.15.144:6835/1155743669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dce72a9b40 con 0x55dce739e310 2024-09-11T23:24:44.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.548+0000 7fad00e00640 1 --2- 172.21.15.144:0/746829505 >> [v2:172.21.15.144:6834/1155743669,v1:172.21.15.144:6835/1155743669] conn(0x55dce739e310 0x55dce73a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.549+0000 7facea000640 10 client.7884 ms_handle_connect on v2:172.21.15.144:6834/1155743669 2024-09-11T23:24:44.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.549+0000 7fad00e00640 1 --2- 172.21.15.144:0/746829505 >> [v2:172.21.15.144:6834/1155743669,v1:172.21.15.144:6835/1155743669] conn(0x55dce739e310 0x55dce73a0700 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24e766d61483e503 server_cookie=b2a5776c4ff3cf4d in_seq=0 out_seq=0 2024-09-11T23:24:44.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.550+0000 7facea000640 1 -- 172.21.15.144:0/746829505 <== mds.0 v2:172.21.15.144:6834/1155743669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dce72a9b40 con 0x55dce739e310 2024-09-11T23:24:44.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.550+0000 7facea000640 10 client.7884 handle_command_reply: tid=0 2024-09-11T23:24:44.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.550+0000 7fad065e2740 1 client.7884 shutdown 2024-09-11T23:24:44.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.550+0000 7fad065e2740 1 -- 172.21.15.144:0/746829505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce737d510 msgr2=0x55dce7351320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:44.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.550+0000 7fad065e2740 1 --2- 172.21.15.144:0/746829505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce737d510 0x55dce7351320 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7face40097a0 tx=0x7face407a140 comp rx=0 tx=0).stop 2024-09-11T23:24:44.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.550+0000 7fad065e2740 1 -- 172.21.15.144:0/746829505 shutdown_connections 2024-09-11T23:24:44.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.550+0000 7fad065e2740 1 --2- 172.21.15.144:0/746829505 >> [v2:172.21.15.144:6834/1155743669,v1:172.21.15.144:6835/1155743669] conn(0x55dce739e310 0x55dce73a0700 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.550+0000 7fad065e2740 1 --2- 172.21.15.144:0/746829505 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce7386ca0 0x55dce7363d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.550+0000 7fad065e2740 1 --2- 172.21.15.144:0/746829505 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce737d510 0x55dce7351320 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.550+0000 7fad065e2740 1 --2- 172.21.15.144:0/746829505 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce7362b50 0x55dce7350de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.550+0000 7fad065e2740 1 -- 172.21.15.144:0/746829505 >> 172.21.15.144:0/746829505 conn(0x55dce73364b0 msgr2=0x55dce7380e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:44.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.550+0000 7facea000640 0 client.7884 ms_handle_reset on v2:172.21.15.144:6834/1155743669 2024-09-11T23:24:44.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.550+0000 7fad065e2740 1 -- 172.21.15.144:0/746829505 shutdown_connections 2024-09-11T23:24:44.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.550+0000 7fad065e2740 1 -- 172.21.15.144:0/746829505 wait complete. 2024-09-11T23:24:44.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.550+0000 7fad065e2740 20 client.7884 trim_cache size 0 max 16384 2024-09-11T23:24:44.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.569+0000 7fad065e2740 1 Processor -- start 2024-09-11T23:24:44.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.569+0000 7fad065e2740 1 -- start start 2024-09-11T23:24:44.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.569+0000 7fad065e2740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce7362b50 0x55dce73870a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.569+0000 7fad065e2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce737d510 0x55dce737bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.569+0000 7fad065e2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce7386ca0 0x55dce7390740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.569+0000 7fad065e2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7facfc0b4650 con 0x55dce7386ca0 2024-09-11T23:24:44.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.569+0000 7fad065e2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7facfc1567d0 con 0x55dce737d510 2024-09-11T23:24:44.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.569+0000 7fad065e2740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7facfc1426b0 con 0x55dce7362b50 2024-09-11T23:24:44.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.570+0000 7fad01800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce7386ca0 0x55dce7390740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.570+0000 7fad01800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce7386ca0 0x55dce7390740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50970/0 (socket says 172.21.15.144:50970) 2024-09-11T23:24:44.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.570+0000 7fad01800640 1 -- 172.21.15.144:0/1038235785 learned_addr learned my addr 172.21.15.144:0/1038235785 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:44.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.570+0000 7fad00e00640 1 --2- 172.21.15.144:0/1038235785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce7362b50 0x55dce73870a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.570+0000 7facf3e00640 1 --2- 172.21.15.144:0/1038235785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce737d510 0x55dce737bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.570+0000 7fad01800640 1 -- 172.21.15.144:0/1038235785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce7362b50 msgr2=0x55dce73870a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:44.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.570+0000 7fad01800640 1 --2- 172.21.15.144:0/1038235785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce7362b50 0x55dce73870a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.570+0000 7fad01800640 1 -- 172.21.15.144:0/1038235785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce737d510 msgr2=0x55dce737bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:44.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.570+0000 7fad01800640 1 --2- 172.21.15.144:0/1038235785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce737d510 0x55dce737bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.570+0000 7fad01800640 1 -- 172.21.15.144:0/1038235785 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dce7298360 con 0x55dce7386ca0 2024-09-11T23:24:44.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.570+0000 7fad00e00640 1 --2- 172.21.15.144:0/1038235785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce7362b50 0x55dce73870a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:24:44.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.570+0000 7facf3e00640 1 --2- 172.21.15.144:0/1038235785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce737d510 0x55dce737bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:24:44.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.570+0000 7fad01800640 1 --2- 172.21.15.144:0/1038235785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce7386ca0 0x55dce7390740 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7facf4001bb0 tx=0x7facf4002070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4060844aff99e750 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:44.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.571+0000 7facf0c00640 1 -- 172.21.15.144:0/1038235785 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf4003c40 con 0x55dce7386ca0 2024-09-11T23:24:44.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.571+0000 7facf0c00640 1 -- 172.21.15.144:0/1038235785 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facf4003de0 con 0x55dce7386ca0 2024-09-11T23:24:44.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.571+0000 7facf0c00640 1 -- 172.21.15.144:0/1038235785 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf4006d50 con 0x55dce7386ca0 2024-09-11T23:24:44.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.571+0000 7fad065e2740 1 -- 172.21.15.144:0/1038235785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce7386ca0 msgr2=0x55dce7390740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:44.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.571+0000 7fad065e2740 1 --2- 172.21.15.144:0/1038235785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce7386ca0 0x55dce7390740 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7facf4001bb0 tx=0x7facf4002070 comp rx=0 tx=0).stop 2024-09-11T23:24:44.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.571+0000 7fad065e2740 1 -- 172.21.15.144:0/1038235785 shutdown_connections 2024-09-11T23:24:44.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.571+0000 7fad065e2740 1 --2- 172.21.15.144:0/1038235785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce7386ca0 0x55dce7390740 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.571+0000 7fad065e2740 1 --2- 172.21.15.144:0/1038235785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce737d510 0x55dce737bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.571+0000 7fad065e2740 1 --2- 172.21.15.144:0/1038235785 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce7362b50 0x55dce73870a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.571+0000 7fad065e2740 1 -- 172.21.15.144:0/1038235785 >> 172.21.15.144:0/1038235785 conn(0x55dce73364b0 msgr2=0x55dce7382730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:44.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.571+0000 7fad065e2740 1 -- 172.21.15.144:0/1038235785 shutdown_connections 2024-09-11T23:24:44.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.571+0000 7fad065e2740 1 -- 172.21.15.144:0/1038235785 wait complete. 2024-09-11T23:24:44.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.572+0000 7fad065e2740 1 -- start start 2024-09-11T23:24:44.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.572+0000 7fad065e2740 1 Processor -- start 2024-09-11T23:24:44.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.573+0000 7fad065e2740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce7362b50 0x55dce73e2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.573+0000 7fad065e2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce737d510 0x55dce73381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.573+0000 7fad065e2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce7386ca0 0x55dce737c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.573+0000 7fad065e2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55dce73524e0 con 0x55dce737d510 2024-09-11T23:24:44.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.573+0000 7fad065e2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55dce7351f40 con 0x55dce7386ca0 2024-09-11T23:24:44.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.573+0000 7fad065e2740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x55dce7337fa0 con 0x55dce7362b50 2024-09-11T23:24:44.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.573+0000 7fad065e2740 10 client.0 _ll_register_callbacks cb 0x7face40792e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:24:44.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.573+0000 7facf3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce737d510 0x55dce73381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.573+0000 7facf3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce737d510 0x55dce73381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50974/0 (socket says 172.21.15.144:50974) 2024-09-11T23:24:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.573+0000 7facf3e00640 1 -- 172.21.15.144:0/3058312304 learned_addr learned my addr 172.21.15.144:0/3058312304 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.574+0000 7fad01800640 1 --2- 172.21.15.144:0/3058312304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce7386ca0 0x55dce737c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.574+0000 7fad00e00640 1 --2- 172.21.15.144:0/3058312304 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce7362b50 0x55dce73e2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.574+0000 7facf3e00640 1 -- 172.21.15.144:0/3058312304 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce7362b50 msgr2=0x55dce73e2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.574+0000 7facf3e00640 1 --2- 172.21.15.144:0/3058312304 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce7362b50 0x55dce73e2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.574+0000 7facf3e00640 1 -- 172.21.15.144:0/3058312304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce7386ca0 msgr2=0x55dce737c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.574+0000 7facf3e00640 1 --2- 172.21.15.144:0/3058312304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce7386ca0 0x55dce737c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.574+0000 7facf3e00640 1 -- 172.21.15.144:0/3058312304 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dce73e3140 con 0x55dce737d510 2024-09-11T23:24:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.574+0000 7fad01800640 1 --2- 172.21.15.144:0/3058312304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce7386ca0 0x55dce737c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.574+0000 7fad00e00640 1 --2- 172.21.15.144:0/3058312304 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce7362b50 0x55dce73e2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.574+0000 7facf3e00640 1 --2- 172.21.15.144:0/3058312304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce737d510 0x55dce73381c0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7face40798a0 tx=0x7face4048070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d9c96cc30a6c5b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.574+0000 7facea000640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:24:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.574+0000 7facea000640 1 -- 172.21.15.144:0/3058312304 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4082270 con 0x55dce737d510 2024-09-11T23:24:44.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.574+0000 7facea000640 1 -- 172.21.15.144:0/3058312304 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7face40a30b0 con 0x55dce737d510 2024-09-11T23:24:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.574+0000 7fad065e2740 1 -- 172.21.15.144:0/3058312304 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facf4003de0 con 0x55dce737d510 2024-09-11T23:24:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.574+0000 7facea000640 1 -- 172.21.15.144:0/3058312304 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7face40a32b0 con 0x55dce737d510 2024-09-11T23:24:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.574+0000 7fad065e2740 10 client.7890 fetch_fsmap learned FSMap version 90 2024-09-11T23:24:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.574+0000 7fad065e2740 1 -- 172.21.15.144:0/3058312304 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) -- 0x55dce73e3140 con 0x55dce737d510 2024-09-11T23:24:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.575+0000 7facea000640 1 -- 172.21.15.144:0/3058312304 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facf4003de0 con 0x55dce737d510 2024-09-11T23:24:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.575+0000 7facea000640 1 -- 172.21.15.144:0/3058312304 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 90) ==== 3502+0+0 (secure 0 0 0) 0x7face4079b70 con 0x55dce737d510 2024-09-11T23:24:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.575+0000 7fad065e2740 10 client.7890 fetch_fsmap finished waiting for FSMap version 90 2024-09-11T23:24:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.575+0000 7fad065e2740 10 client.7890 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:24:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.575+0000 7fad065e2740 20 client.7890 populate_metadata read hostname 'smithi144' 2024-09-11T23:24:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.575+0000 7fad065e2740 1 --2- 172.21.15.144:0/3058312304 >> [v2:172.21.15.144:6834/1155743669,v1:172.21.15.144:6835/1155743669] conn(0x55dce7403aa0 0x55dce7403e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.575+0000 7fad065e2740 4 client.7890 mds_command: new command op to 7761 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:24:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.575+0000 7fad065e2740 1 -- 172.21.15.144:0/3058312304 --> [v2:172.21.15.144:6834/1155743669,v1:172.21.15.144:6835/1155743669] -- command(tid 0: {"prefix": "status"}) -- 0x55dce72a3e90 con 0x55dce7403aa0 2024-09-11T23:24:44.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.575+0000 7fad00e00640 1 --2- 172.21.15.144:0/3058312304 >> [v2:172.21.15.144:6834/1155743669,v1:172.21.15.144:6835/1155743669] conn(0x55dce7403aa0 0x55dce7403e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.576+0000 7facea000640 10 client.7890 ms_handle_connect on v2:172.21.15.144:6834/1155743669 2024-09-11T23:24:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.576+0000 7fad00e00640 1 --2- 172.21.15.144:0/3058312304 >> [v2:172.21.15.144:6834/1155743669,v1:172.21.15.144:6835/1155743669] conn(0x55dce7403aa0 0x55dce7403e80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40d22208c429790b server_cookie=b2e9c7ba58caf01f in_seq=0 out_seq=0 2024-09-11T23:24:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.576+0000 7facea000640 1 -- 172.21.15.144:0/3058312304 <== mds.0 v2:172.21.15.144:6834/1155743669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55dce72a3e90 con 0x55dce7403aa0 2024-09-11T23:24:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.576+0000 7facea000640 10 client.7890 handle_command_reply: tid=0 2024-09-11T23:24:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.576+0000 7fad065e2740 1 client.7890 shutdown 2024-09-11T23:24:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.576+0000 7fad065e2740 1 -- 172.21.15.144:0/3058312304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce737d510 msgr2=0x55dce73381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.576+0000 7fad065e2740 1 --2- 172.21.15.144:0/3058312304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce737d510 0x55dce73381c0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7face40798a0 tx=0x7face4048070 comp rx=0 tx=0).stop 2024-09-11T23:24:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.576+0000 7fad065e2740 1 -- 172.21.15.144:0/3058312304 shutdown_connections 2024-09-11T23:24:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.576+0000 7fad065e2740 1 --2- 172.21.15.144:0/3058312304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dce7386ca0 0x55dce737c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.576+0000 7fad065e2740 1 --2- 172.21.15.144:0/3058312304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dce737d510 0x55dce73381c0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.576+0000 7fad065e2740 1 --2- 172.21.15.144:0/3058312304 >> [v2:172.21.15.144:6834/1155743669,v1:172.21.15.144:6835/1155743669] conn(0x55dce7403aa0 0x55dce7403e80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.576+0000 7fad065e2740 1 --2- 172.21.15.144:0/3058312304 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x55dce7362b50 0x55dce73e2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.576+0000 7facea000640 0 client.7890 ms_handle_reset on v2:172.21.15.144:6834/1155743669 2024-09-11T23:24:44.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.576+0000 7fad065e2740 1 -- 172.21.15.144:0/3058312304 >> 172.21.15.144:0/3058312304 conn(0x55dce73364b0 msgr2=0x55dce737bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:44.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.576+0000 7fad065e2740 1 -- 172.21.15.144:0/3058312304 shutdown_connections 2024-09-11T23:24:44.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.576+0000 7fad065e2740 1 -- 172.21.15.144:0/3058312304 wait complete. 2024-09-11T23:24:44.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.576+0000 7fad065e2740 20 client.7890 trim_cache size 0 max 16384 2024-09-11T23:24:44.581 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:24:44.581 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "4b73e4b7-12f0-4e37-94bc-45e333efe84e", 2024-09-11T23:24:44.581 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-11T23:24:44.581 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 7761, 2024-09-11T23:24:44.581 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-11T23:24:44.581 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-11T23:24:44.581 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-11T23:24:44.582 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 6.0935692939999999, 2024-09-11T23:24:44.582 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 90, 2024-09-11T23:24:44.582 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 131, 2024-09-11T23:24:44.582 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 131, 2024-09-11T23:24:44.582 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 11.182768427999999 2024-09-11T23:24:44.582 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:24:44.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.577+0000 7fad03800640 1 -- 172.21.15.144:0/2784149950 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7facd806c3d0 msgr2=0x7facd806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.577+0000 7fad03800640 1 --2- 172.21.15.144:0/2784149950 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7facd806c3d0 0x7facd806e890 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7facec005880 tx=0x7facec009040 comp rx=0 tx=0).stop 2024-09-11T23:24:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.577+0000 7fad03800640 1 -- 172.21.15.144:0/2784149950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facfc0cf070 msgr2=0x7facfc0c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.577+0000 7fad03800640 1 --2- 172.21.15.144:0/2784149950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facfc0cf070 0x7facfc0c52b0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7face4035040 tx=0x7face40046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.577+0000 7fad03800640 1 -- 172.21.15.144:0/2784149950 shutdown_connections 2024-09-11T23:24:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.577+0000 7fad03800640 1 --2- 172.21.15.144:0/2784149950 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7facd806c3d0 0x7facd806e890 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.577+0000 7fad03800640 1 --2- 172.21.15.144:0/2784149950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facfc15c180 0x7facfc140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.577+0000 7fad03800640 1 --2- 172.21.15.144:0/2784149950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facfc0cf070 0x7facfc0c52b0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.577+0000 7fad03800640 1 --2- 172.21.15.144:0/2784149950 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7facfc073120 0x7facfc1438a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.577+0000 7fad03800640 1 -- 172.21.15.144:0/2784149950 >> 172.21.15.144:0/2784149950 conn(0x7facfc062cc0 msgr2=0x7facfc157560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.577+0000 7fad03800640 1 -- 172.21.15.144:0/2784149950 shutdown_connections 2024-09-11T23:24:44.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.577+0000 7fad03800640 1 -- 172.21.15.144:0/2784149950 wait complete. 2024-09-11T23:24:44.593 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:24:44.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.747+0000 7f88d5e00640 1 Processor -- start 2024-09-11T23:24:44.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.747+0000 7f88d5e00640 1 -- start start 2024-09-11T23:24:44.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.748+0000 7f88d5e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f88d00cf070 0x7f88d00cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.748+0000 7f88d5e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d0073120 0x7f88d00735b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.748+0000 7f88d5e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88d00ce740 con 0x7f88d015c180 2024-09-11T23:24:44.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.748+0000 7f88d5e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f88d0072640 con 0x7f88d00cf070 2024-09-11T23:24:44.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.748+0000 7f88d5e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f88d0072920 con 0x7f88d0073120 2024-09-11T23:24:44.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.749+0000 7f88ce000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f88d00cf070 0x7f88d00cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.749+0000 7f88ce000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f88d00cf070 0x7f88d00cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50980/0 (socket says 172.21.15.144:50980) 2024-09-11T23:24:44.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.749+0000 7f88ce000640 1 -- 172.21.15.144:0/1277496851 learned_addr learned my addr 172.21.15.144:0/1277496851 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:44.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.749+0000 7f88cf400640 1 --2- 172.21.15.144:0/1277496851 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d0073120 0x7f88d00735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.749+0000 7f88ce000640 1 -- 172.21.15.144:0/1277496851 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d0073120 msgr2=0x7f88d00735b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:44.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.749+0000 7f88ce000640 1 --2- 172.21.15.144:0/1277496851 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d0073120 0x7f88d00735b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.749+0000 7f88ce000640 1 -- 172.21.15.144:0/1277496851 >> v1:172.21.15.165:6789/0 conn(0x7f88d015c180 legacy=0x7f88d00cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:44.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.749+0000 7f88ce000640 1 -- 172.21.15.144:0/1277496851 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d0072c00 con 0x7f88d00cf070 2024-09-11T23:24:44.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.749+0000 7f88cf400640 1 --2- 172.21.15.144:0/1277496851 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d0073120 0x7f88d00735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:44.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.750+0000 7f88ce000640 1 --2- 172.21.15.144:0/1277496851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d00cf070 0x7f88d00cf4e0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009e50 tx=0x7f88b802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa4984adf83cf62 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:44.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.750+0000 7f88cd600640 1 -- 172.21.15.144:0/1277496851 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b8036070 con 0x7f88d00cf070 2024-09-11T23:24:44.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.750+0000 7f88cd600640 1 -- 172.21.15.144:0/1277496851 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b8031600 con 0x7f88d00cf070 2024-09-11T23:24:44.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.750+0000 7f88cd600640 1 -- 172.21.15.144:0/1277496851 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b80319d0 con 0x7f88d00cf070 2024-09-11T23:24:44.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.751+0000 7f88d5e00640 1 -- 172.21.15.144:0/1277496851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d00cf070 msgr2=0x7f88d00cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:44.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.751+0000 7f88d5e00640 1 --2- 172.21.15.144:0/1277496851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d00cf070 0x7f88d00cf4e0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009e50 tx=0x7f88b802a6a0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.751+0000 7f88d5e00640 1 -- 172.21.15.144:0/1277496851 shutdown_connections 2024-09-11T23:24:44.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.751+0000 7f88d5e00640 1 --2- 172.21.15.144:0/1277496851 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d0073120 0x7f88d00735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.751+0000 7f88d5e00640 1 --2- 172.21.15.144:0/1277496851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d00cf070 0x7f88d00cf4e0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.751+0000 7f88d5e00640 1 -- 172.21.15.144:0/1277496851 >> 172.21.15.144:0/1277496851 conn(0x7f88d0062cc0 msgr2=0x7f88d006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:44.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.751+0000 7f88d5e00640 1 -- 172.21.15.144:0/1277496851 shutdown_connections 2024-09-11T23:24:44.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.751+0000 7f88d5e00640 1 -- 172.21.15.144:0/1277496851 wait complete. 2024-09-11T23:24:44.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.753+0000 7f88d5e00640 1 Processor -- start 2024-09-11T23:24:44.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.753+0000 7f88d5e00640 1 -- start start 2024-09-11T23:24:44.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.754+0000 7f88d5e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d0073120 0x7f88d00b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.754+0000 7f88d5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d00cf070 0x7f88d0148e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.754+0000 7f88d5e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88d015c180 0x7f88d01f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.754+0000 7f88d5e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f88d00722f0 con 0x7f88d00cf070 2024-09-11T23:24:44.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.754+0000 7f88d5e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f88d00ced00 con 0x7f88d015c180 2024-09-11T23:24:44.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.754+0000 7f88d5e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f88d015c560 con 0x7f88d0073120 2024-09-11T23:24:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.754+0000 7f88ce000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d00cf070 0x7f88d0148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.754+0000 7f88ce000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d00cf070 0x7f88d0148e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:50990/0 (socket says 172.21.15.144:50990) 2024-09-11T23:24:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.754+0000 7f88ce000640 1 -- 172.21.15.144:0/2987873064 learned_addr learned my addr 172.21.15.144:0/2987873064 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.754+0000 7f88cf400640 1 --2- 172.21.15.144:0/2987873064 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88d015c180 0x7f88d01f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.754+0000 7f88cea00640 1 --2- 172.21.15.144:0/2987873064 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d0073120 0x7f88d00b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.754+0000 7f88ce000640 1 -- 172.21.15.144:0/2987873064 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d0073120 msgr2=0x7f88d00b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.754+0000 7f88ce000640 1 --2- 172.21.15.144:0/2987873064 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d0073120 0x7f88d00b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.754+0000 7f88ce000640 1 -- 172.21.15.144:0/2987873064 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88d015c180 msgr2=0x7f88d01f40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.754+0000 7f88ce000640 1 --2- 172.21.15.144:0/2987873064 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88d015c180 0x7f88d01f40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.754+0000 7f88ce000640 1 -- 172.21.15.144:0/2987873064 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d01f4960 con 0x7f88d00cf070 2024-09-11T23:24:44.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.755+0000 7f88ce000640 1 --2- 172.21.15.144:0/2987873064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d00cf070 0x7f88d0148e10 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f88b8034040 tx=0x7f88b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:44.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.755+0000 7f88c7400640 1 -- 172.21.15.144:0/2987873064 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b8036050 con 0x7f88d00cf070 2024-09-11T23:24:44.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.755+0000 7f88c7400640 1 -- 172.21.15.144:0/2987873064 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b8042070 con 0x7f88d00cf070 2024-09-11T23:24:44.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.755+0000 7f88c7400640 1 -- 172.21.15.144:0/2987873064 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b8009510 con 0x7f88d00cf070 2024-09-11T23:24:44.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.755+0000 7f88d5e00640 1 -- 172.21.15.144:0/2987873064 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d01f4c40 con 0x7f88d00cf070 2024-09-11T23:24:44.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.755+0000 7f88d5e00640 1 -- 172.21.15.144:0/2987873064 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d00b3650 con 0x7f88d00cf070 2024-09-11T23:24:44.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.756+0000 7f88d5e00640 1 -- 172.21.15.144:0/2987873064 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d00afaf0 con 0x7f88d00cf070 2024-09-11T23:24:44.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.757+0000 7f88c7400640 1 -- 172.21.15.144:0/2987873064 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f88b8007c50 con 0x7f88d00cf070 2024-09-11T23:24:44.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.758+0000 7f88c7400640 1 --2- 172.21.15.144:0/2987873064 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f88ac06c3d0 0x7f88ac06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:44.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.758+0000 7f88c7400640 1 -- 172.21.15.144:0/2987873064 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f88b80ac6a0 con 0x7f88d00cf070 2024-09-11T23:24:44.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.758+0000 7f88cea00640 1 --2- 172.21.15.144:0/2987873064 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f88ac06c3d0 0x7f88ac06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:44.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.759+0000 7f88cea00640 1 --2- 172.21.15.144:0/2987873064 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f88ac06c3d0 0x7f88ac06e890 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f88c0000f60 tx=0x7f88c0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:44.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.762+0000 7f88c7400640 1 -- 172.21.15.144:0/2987873064 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88d00afaf0 con 0x7f88d00cf070 2024-09-11T23:24:44.886 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:24:44.891 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:24:44.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.975+0000 7f88d5e00640 1 -- 172.21.15.144:0/2987873064 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f88d00b3440 con 0x7f88d00cf070 2024-09-11T23:24:44.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.976+0000 7f88c7400640 1 -- 172.21.15.144:0/2987873064 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v90) ==== 53+0+73 (secure 0 0 0) 0x7f88b807a120 con 0x7f88d00cf070 2024-09-11T23:24:44.976 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:24:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.978+0000 7f88d5e00640 1 -- 172.21.15.144:0/2987873064 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f88ac06c3d0 msgr2=0x7f88ac06e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.978+0000 7f88d5e00640 1 --2- 172.21.15.144:0/2987873064 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f88ac06c3d0 0x7f88ac06e890 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f88c0000f60 tx=0x7f88c0009040 comp rx=0 tx=0).stop 2024-09-11T23:24:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.978+0000 7f88d5e00640 1 -- 172.21.15.144:0/2987873064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d00cf070 msgr2=0x7f88d0148e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.978+0000 7f88d5e00640 1 --2- 172.21.15.144:0/2987873064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d00cf070 0x7f88d0148e10 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f88b8034040 tx=0x7f88b8004a40 comp rx=0 tx=0).stop 2024-09-11T23:24:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.978+0000 7f88d5e00640 1 -- 172.21.15.144:0/2987873064 shutdown_connections 2024-09-11T23:24:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.978+0000 7f88d5e00640 1 --2- 172.21.15.144:0/2987873064 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f88ac06c3d0 0x7f88ac06e890 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.978+0000 7f88d5e00640 1 --2- 172.21.15.144:0/2987873064 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88d015c180 0x7f88d01f40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.978+0000 7f88d5e00640 1 --2- 172.21.15.144:0/2987873064 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d00cf070 0x7f88d0148e10 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.978+0000 7f88d5e00640 1 --2- 172.21.15.144:0/2987873064 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d0073120 0x7f88d00b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:44.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.978+0000 7f88d5e00640 1 -- 172.21.15.144:0/2987873064 >> 172.21.15.144:0/2987873064 conn(0x7f88d0062cc0 msgr2=0x7f88d015a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:44.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.978+0000 7f88d5e00640 1 -- 172.21.15.144:0/2987873064 shutdown_connections 2024-09-11T23:24:44.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:44.978+0000 7f88d5e00640 1 -- 172.21.15.144:0/2987873064 wait complete. 2024-09-11T23:24:44.994 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:24:44.994 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:24:44.994 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-11T23:24:44.994 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:24:44.994 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:24:44.994 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:24:44.994 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:24:44.994 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:24:44.994 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:24:44.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:44.995 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-11T23:24:45.071 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:24:45.071 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:24:45.071 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:24:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-11T23:24:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:45.072 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:24:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:24:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-11T23:24:45.072 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:24:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:24:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-11T23:24:45.072 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:24:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:24:45.073 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:24:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-11T23:24:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:24:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42277sec preferred_lft 42277sec 2024-09-11T23:24:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2024-09-11T23:24:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:45.073 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:24:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff 2024-09-11T23:24:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:24:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::243b:82ff:fe06:fac9/64 scope link 2024-09-11T23:24:45.074 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:45.074 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:24:45.074 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:24:45.074 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::74ca:30ff:fef2:cddf/64 scope link 2024-09-11T23:24:45.074 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:45.074 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:24:45.074 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether be:01:ec:87:34:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:24:45.074 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bc01:ecff:fe87:34e1/64 scope link 2024-09-11T23:24:45.075 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:45.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:45.075 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:24:45.166 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-11T23:24:45.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:45.169 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-11T23:24:45.205 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-11T23:24:45.206 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:24:45.206 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:24:45.206 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:24:45.206 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:24:45.206 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:24:45.206 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-11T23:24:45.206 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:24:45.206 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:24:45.207 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:24:45.207 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-11T23:24:45.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:24:45.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:24:45.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:45.404 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-11T23:24:45.440 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:24:45.440 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:24:45.440 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:24:45.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:45.440 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-11T23:24:45.541 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:24:45.541 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:24:45.576 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:24:45.577 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:24:45.577 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:24:45.653 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T23:24:45.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:45.653 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:24:45.783 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:24:45.783 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:24:45.810 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:24:45.810 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:24:45.810 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:24:45.810 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:24:45.810 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:24:45.811 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T23:24:45.811 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:24:45.812 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:24:45.812 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:24:45.812 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:24:45.814 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:24:45.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:45.815 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:24:45.871 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:24:45.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:24:45.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:24:45.966 INFO:teuthology.orchestra.run.smithi144.stdout:client7899 2024-09-11T23:24:45.967 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:24:45.967 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:24:46.003 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:24:46.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.196+0000 7f27ed600640 1 Processor -- start 2024-09-11T23:24:46.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.197+0000 7f27ed600640 1 -- start start 2024-09-11T23:24:46.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.198+0000 7f27ed600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f27e80d02a0 0x7f27e80d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:46.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.198+0000 7f27ed600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e80d0bc0 con 0x7f27e815ca40 2024-09-11T23:24:46.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.198+0000 7f27ed600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e815d390 con 0x7f27e815ceb0 2024-09-11T23:24:46.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.198+0000 7f27ed600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f27e815d670 con 0x7f27e80d02a0 2024-09-11T23:24:46.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.198+0000 7f27e6000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f27e815ca40 0x7f27e815e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39618/0 (socket says 172.21.15.144:39618) 2024-09-11T23:24:46.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.198+0000 7f27e6000640 1 -- 172.21.15.144:0/4081605975 learned_addr learned my addr 172.21.15.144:0/4081605975 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:46.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.198+0000 7f27e6a00640 1 --2- 172.21.15.144:0/4081605975 >> v2:172.21.15.165:3300/0 conn(0x7f27e80d02a0 0x7f27e80d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:46.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.198+0000 7f27e5600640 1 -- 172.21.15.144:0/4081605975 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 720829534 0 0) 0x7f27e80d0bc0 con 0x7f27e815ca40 2024-09-11T23:24:46.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.199+0000 7f27e5600640 1 -- 172.21.15.144:0/4081605975 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27cc003520 con 0x7f27e815ca40 2024-09-11T23:24:46.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.199+0000 7f27e5600640 1 -- 172.21.15.144:0/4081605975 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3273226462 0 0) 0x7f27cc003520 con 0x7f27e815ca40 2024-09-11T23:24:46.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.199+0000 7f27e6a00640 1 -- 172.21.15.144:0/4081605975 >> v1:172.21.15.165:6789/0 conn(0x7f27e815ceb0 legacy=0x7f27e81594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:46.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.199+0000 7f27e6a00640 1 -- 172.21.15.144:0/4081605975 >> v1:172.21.15.144:6789/0 conn(0x7f27e815ca40 legacy=0x7f27e815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:46.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.199+0000 7f27e6a00640 1 -- 172.21.15.144:0/4081605975 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e815d950 con 0x7f27e80d02a0 2024-09-11T23:24:46.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.200+0000 7f27e6a00640 1 --2- 172.21.15.144:0/4081605975 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27e80d02a0 0x7f27e80d0680 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f27d80097a0 tx=0x7f27d802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11d86cc3e838109d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:46.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.200+0000 7f27e5600640 1 -- 172.21.15.144:0/4081605975 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d8037070 con 0x7f27e80d02a0 2024-09-11T23:24:46.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.200+0000 7f27e5600640 1 -- 172.21.15.144:0/4081605975 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d802abc0 con 0x7f27e80d02a0 2024-09-11T23:24:46.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.200+0000 7f27e5600640 1 -- 172.21.15.144:0/4081605975 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d4001670 con 0x7f27e80d02a0 2024-09-11T23:24:46.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.201+0000 7f27ed600640 1 -- 172.21.15.144:0/4081605975 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27e80d02a0 msgr2=0x7f27e80d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:46.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.201+0000 7f27ed600640 1 --2- 172.21.15.144:0/4081605975 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27e80d02a0 0x7f27e80d0680 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f27d80097a0 tx=0x7f27d802a130 comp rx=0 tx=0).stop 2024-09-11T23:24:46.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.201+0000 7f27ed600640 1 -- 172.21.15.144:0/4081605975 shutdown_connections 2024-09-11T23:24:46.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.201+0000 7f27ed600640 1 --2- 172.21.15.144:0/4081605975 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27e80d02a0 0x7f27e80d0680 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:46.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.201+0000 7f27ed600640 1 -- 172.21.15.144:0/4081605975 >> 172.21.15.144:0/4081605975 conn(0x7f27e8062cc0 msgr2=0x7f27e806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:46.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.201+0000 7f27ed600640 1 -- 172.21.15.144:0/4081605975 shutdown_connections 2024-09-11T23:24:46.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.201+0000 7f27ed600640 1 -- 172.21.15.144:0/4081605975 wait complete. 2024-09-11T23:24:46.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.202+0000 7f27ed600640 1 Processor -- start 2024-09-11T23:24:46.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.203+0000 7f27ed600640 1 -- start start 2024-09-11T23:24:46.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.203+0000 7f27ed600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27e80d02a0 0x7f27e8072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:46.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.204+0000 7f27ed600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27e815ca40 0x7f27e80cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:46.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.204+0000 7f27ed600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27e815ceb0 0x7f27e814ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:46.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.204+0000 7f27ed600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f27e815eb40 con 0x7f27e80d02a0 2024-09-11T23:24:46.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.204+0000 7f27ed600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f27e815df10 con 0x7f27e815ca40 2024-09-11T23:24:46.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.204+0000 7f27ed600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f27e8155b90 con 0x7f27e815ceb0 2024-09-11T23:24:46.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.204+0000 7f27e6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27e80d02a0 0x7f27e8072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:46.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.204+0000 7f27e6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27e80d02a0 0x7f27e8072f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51006/0 (socket says 172.21.15.144:51006) 2024-09-11T23:24:46.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.204+0000 7f27e6a00640 1 -- 172.21.15.144:0/3224208747 learned_addr learned my addr 172.21.15.144:0/3224208747 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:46.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.204+0000 7f27e6a00640 1 -- 172.21.15.144:0/3224208747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27e815ceb0 msgr2=0x7f27e814ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:46.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.204+0000 7f27e6a00640 1 --2- 172.21.15.144:0/3224208747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27e815ceb0 0x7f27e814ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:46.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.204+0000 7f27e6a00640 1 -- 172.21.15.144:0/3224208747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27e815ca40 msgr2=0x7f27e80cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:46.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.204+0000 7f27e6a00640 1 --2- 172.21.15.144:0/3224208747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27e815ca40 0x7f27e80cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:46.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.204+0000 7f27e6a00640 1 -- 172.21.15.144:0/3224208747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e814d390 con 0x7f27e80d02a0 2024-09-11T23:24:46.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.204+0000 7f27e6a00640 1 --2- 172.21.15.144:0/3224208747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27e80d02a0 0x7f27e8072f30 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f27d8035040 tx=0x7f27d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:46.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.205+0000 7f27dea00640 1 -- 172.21.15.144:0/3224208747 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d8041070 con 0x7f27e80d02a0 2024-09-11T23:24:46.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.205+0000 7f27dea00640 1 -- 172.21.15.144:0/3224208747 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d803c670 con 0x7f27e80d02a0 2024-09-11T23:24:46.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.205+0000 7f27dea00640 1 -- 172.21.15.144:0/3224208747 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d8037040 con 0x7f27e80d02a0 2024-09-11T23:24:46.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.205+0000 7f27ed600640 1 -- 172.21.15.144:0/3224208747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e80cd940 con 0x7f27e80d02a0 2024-09-11T23:24:46.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.205+0000 7f27ed600640 1 -- 172.21.15.144:0/3224208747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e80cd380 con 0x7f27e80d02a0 2024-09-11T23:24:46.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.206+0000 7f27ed600640 1 -- 172.21.15.144:0/3224208747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27e80b4790 con 0x7f27e80d02a0 2024-09-11T23:24:46.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.207+0000 7f27dea00640 1 -- 172.21.15.144:0/3224208747 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f27d8044070 con 0x7f27e80d02a0 2024-09-11T23:24:46.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.208+0000 7f27dea00640 1 --2- 172.21.15.144:0/3224208747 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f27c806c450 0x7f27c806e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:46.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.208+0000 7f27dea00640 1 -- 172.21.15.144:0/3224208747 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f27d80ac0c0 con 0x7f27e80d02a0 2024-09-11T23:24:46.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.208+0000 7f27e6000640 1 --2- 172.21.15.144:0/3224208747 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f27c806c450 0x7f27c806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:46.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.209+0000 7f27e6000640 1 --2- 172.21.15.144:0/3224208747 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f27c806c450 0x7f27c806e910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f27d4005880 tx=0x7f27d4001060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:46.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.212+0000 7f27dea00640 1 -- 172.21.15.144:0/3224208747 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f27e814d390 con 0x7f27e80d02a0 2024-09-11T23:24:46.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.419+0000 7f27ed600640 1 -- 172.21.15.144:0/3224208747 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f27e80b5480 con 0x7f27e80d02a0 2024-09-11T23:24:46.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.419+0000 7f27dea00640 1 -- 172.21.15.144:0/3224208747 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v90) ==== 53+0+73 (secure 0 0 0) 0x7f27d807a240 con 0x7f27e80d02a0 2024-09-11T23:24:46.419 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:24:46.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.421+0000 7f27ed600640 1 -- 172.21.15.144:0/3224208747 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f27c806c450 msgr2=0x7f27c806e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:46.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.421+0000 7f27ed600640 1 --2- 172.21.15.144:0/3224208747 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f27c806c450 0x7f27c806e910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f27d4005880 tx=0x7f27d4001060 comp rx=0 tx=0).stop 2024-09-11T23:24:46.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.421+0000 7f27ed600640 1 -- 172.21.15.144:0/3224208747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27e80d02a0 msgr2=0x7f27e8072f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:46.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.421+0000 7f27ed600640 1 --2- 172.21.15.144:0/3224208747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27e80d02a0 0x7f27e8072f30 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f27d8035040 tx=0x7f27d80046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:46.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.421+0000 7f27ed600640 1 -- 172.21.15.144:0/3224208747 shutdown_connections 2024-09-11T23:24:46.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.421+0000 7f27ed600640 1 --2- 172.21.15.144:0/3224208747 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f27c806c450 0x7f27c806e910 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:46.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.421+0000 7f27ed600640 1 --2- 172.21.15.144:0/3224208747 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f27e815ceb0 0x7f27e814ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:46.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.421+0000 7f27ed600640 1 --2- 172.21.15.144:0/3224208747 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f27e815ca40 0x7f27e80cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:46.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.421+0000 7f27ed600640 1 --2- 172.21.15.144:0/3224208747 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27e80d02a0 0x7f27e8072f30 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:46.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.421+0000 7f27ed600640 1 -- 172.21.15.144:0/3224208747 >> 172.21.15.144:0/3224208747 conn(0x7f27e8062cc0 msgr2=0x7f27e80b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:46.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.422+0000 7f27ed600640 1 -- 172.21.15.144:0/3224208747 shutdown_connections 2024-09-11T23:24:46.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:46.422+0000 7f27ed600640 1 -- 172.21.15.144:0/3224208747 wait complete. 2024-09-11T23:24:46.437 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:24:46.437 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:24:46.437 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi165.front.sepia.ceph.com 2024-09-11T23:24:46.437 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T23:24:46.437 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:24:46.437 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:24:46.437 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:24:46.438 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:24:46.438 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:24:46.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:46.438 DEBUG:teuthology.orchestra.run.smithi165:> ip addr 2024-09-11T23:24:46.478 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:24:46.479 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:24:46.479 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:24:46.479 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:46.479 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-11T23:24:46.479 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:46.479 INFO:teuthology.orchestra.run.smithi165.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:24:46.479 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:94 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:24:46.479 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f0 2024-09-11T23:24:46.479 INFO:teuthology.orchestra.run.smithi165.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:24:46.479 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:95 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:24:46.479 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f1 2024-09-11T23:24:46.479 INFO:teuthology.orchestra.run.smithi165.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:24:46.479 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:24:46.479 INFO:teuthology.orchestra.run.smithi165.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:24:46.480 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:24:46.480 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.21.15.165/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:24:46.480 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft 42279sec preferred_lft 42279sec 2024-09-11T23:24:46.480 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::ec4:7aff:fe88:7f63/64 scope link noprefixroute 2024-09-11T23:24:46.480 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:46.480 INFO:teuthology.orchestra.run.smithi165.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:24:46.480 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:24:46.480 INFO:teuthology.orchestra.run.smithi165.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:24:46.480 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:46.480 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::c063:d7ff:fec8:c56c/64 scope link 2024-09-11T23:24:46.481 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:46.481 INFO:teuthology.orchestra.run.smithi165.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:24:46.481 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:24:46.481 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::5478:e4ff:fecd:76c/64 scope link 2024-09-11T23:24:46.481 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:46.481 INFO:teuthology.orchestra.run.smithi165.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:24:46.481 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether ba:fa:43:78:5f:29 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:24:46.481 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::b8fa:43ff:fe78:5f29/64 scope link 2024-09-11T23:24:46.481 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:24:46.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:46.482 DEBUG:teuthology.orchestra.run.smithi165:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:24:46.577 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-11T23:24:46.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:46.580 DEBUG:teuthology.orchestra.run.smithi165:> route 2024-09-11T23:24:46.617 INFO:teuthology.orchestra.run.smithi165.stdout:Kernel IP routing table 2024-09-11T23:24:46.617 INFO:teuthology.orchestra.run.smithi165.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:24:46.617 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:24:46.617 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:24:46.617 INFO:teuthology.orchestra.run.smithi165.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:24:46.618 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:24:46.618 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-11T23:24:46.618 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:24:46.618 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:24:46.618 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:24:46.618 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-11T23:24:46.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:24:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:24:46.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:24:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:24:46.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:46.814 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-11T23:24:46.849 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-11T23:24:46.849 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-11T23:24:46.850 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:24:46.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:46.850 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set brx.0 up 2024-09-11T23:24:46.946 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:24:46.946 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T23:24:46.981 INFO:teuthology.orchestra.run.smithi165.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:24:46.981 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:24:46.981 DEBUG:teuthology.orchestra.run.smithi165:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:24:47.056 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-11T23:24:47.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:47.056 DEBUG:teuthology.orchestra.run.smithi165:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:24:47.184 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:24:47.184 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:24:47.212 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:24:47.212 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:24:47.212 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:24:47.212 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: trying mount with new device syntax: 1@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:24:47.212 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:24:47.214 INFO:teuthology.orchestra.run.smithi165.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-11T23:24:47.214 INFO:teuthology.orchestra.run.smithi165.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:24:47.214 INFO:teuthology.orchestra.run.smithi165.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:24:47.214 INFO:teuthology.orchestra.run.smithi165.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:24:47.215 INFO:teuthology.orchestra.run.smithi165.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:24:47.217 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:24:47.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:47.217 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:24:47.273 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:24:47.350 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:24:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:24:47.353 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:24:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:24:47.361 INFO:teuthology.orchestra.run.smithi165.stdout:client7908 2024-09-11T23:24:47.361 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:24:47.361 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:24:47.397 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-11T23:24:47.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.568+0000 7f4a2f200640 1 Processor -- start 2024-09-11T23:24:47.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.568+0000 7f4a2f200640 1 -- start start 2024-09-11T23:24:47.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.569+0000 7f4a2f200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4a300ce090 0x7f4a300ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:47.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.569+0000 7f4a2f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a30070eb0 0x7f4a30071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:47.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.569+0000 7f4a2f200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3015b5b0 con 0x7f4a3015b1d0 2024-09-11T23:24:47.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.569+0000 7f4a2f200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4a300cea40 con 0x7f4a300ce090 2024-09-11T23:24:47.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.569+0000 7f4a2f200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4a300b21b0 con 0x7f4a30070eb0 2024-09-11T23:24:47.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.569+0000 7f4a2de00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4a3015b1d0 0x7f4a300b3be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39632/0 (socket says 172.21.15.144:39632) 2024-09-11T23:24:47.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.569+0000 7f4a2de00640 1 -- 172.21.15.144:0/1002019561 learned_addr learned my addr 172.21.15.144:0/1002019561 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:47.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.569+0000 7f4a2ca00640 1 -- 172.21.15.144:0/1002019561 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2773950150 0 0) 0x7f4a3015b5b0 con 0x7f4a3015b1d0 2024-09-11T23:24:47.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.569+0000 7f4a2ca00640 1 -- 172.21.15.144:0/1002019561 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a14003520 con 0x7f4a3015b1d0 2024-09-11T23:24:47.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.569+0000 7f4a2e800640 1 --2- 172.21.15.144:0/1002019561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a30070eb0 0x7f4a30071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:47.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.569+0000 7f4a2d400640 1 --2- 172.21.15.144:0/1002019561 >> v2:172.21.15.165:3300/0 conn(0x7f4a300ce090 0x7f4a300ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:47.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.570+0000 7f4a2ca00640 1 -- 172.21.15.144:0/1002019561 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3456681542 0 0) 0x7f4a14003520 con 0x7f4a3015b1d0 2024-09-11T23:24:47.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.570+0000 7f4a2ca00640 1 -- 172.21.15.144:0/1002019561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a30070eb0 msgr2=0x7f4a30071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:47.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.570+0000 7f4a2ca00640 1 --2- 172.21.15.144:0/1002019561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a30070eb0 0x7f4a30071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:47.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.570+0000 7f4a2ca00640 1 -- 172.21.15.144:0/1002019561 >> v2:172.21.15.165:3300/0 conn(0x7f4a300ce090 msgr2=0x7f4a300ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:47.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.570+0000 7f4a2ca00640 1 --2- 172.21.15.144:0/1002019561 >> v2:172.21.15.165:3300/0 conn(0x7f4a300ce090 0x7f4a300ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:47.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.570+0000 7f4a2ca00640 1 -- 172.21.15.144:0/1002019561 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a300b4800 con 0x7f4a3015b1d0 2024-09-11T23:24:47.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.570+0000 7f4a2ca00640 1 -- 172.21.15.144:0/1002019561 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f4a200019f0 con 0x7f4a3015b1d0 2024-09-11T23:24:47.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.570+0000 7f4a2d400640 1 --2- 172.21.15.144:0/1002019561 >> v2:172.21.15.165:3300/0 conn(0x7f4a300ce090 0x7f4a300ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:47.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.570+0000 7f4a2ca00640 1 -- 172.21.15.144:0/1002019561 >> v1:172.21.15.144:6789/0 conn(0x7f4a3015b1d0 legacy=0x7f4a300b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:47.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.570+0000 7f4a2ca00640 1 --2- 172.21.15.144:0/1002019561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a140039b0 0x7f4a14003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:47.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.570+0000 7f4a2ca00640 1 --2- 172.21.15.144:0/1002019561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a30070eb0 0x7f4a14004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:47.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.570+0000 7f4a2ca00640 1 --2- 172.21.15.144:0/1002019561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a14004d40 0x7f4a140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:47.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.570+0000 7f4a2ca00640 1 -- 172.21.15.144:0/1002019561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4a300cea40 con 0x7f4a14004d40 2024-09-11T23:24:47.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.570+0000 7f4a2ca00640 1 -- 172.21.15.144:0/1002019561 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1400b9f0 con 0x7f4a140039b0 2024-09-11T23:24:47.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.570+0000 7f4a2ca00640 1 -- 172.21.15.144:0/1002019561 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4a1400bbf0 con 0x7f4a30070eb0 2024-09-11T23:24:47.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.570+0000 7f4a2de00640 1 --2- 172.21.15.144:0/1002019561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a140039b0 0x7f4a14003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:47.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.570+0000 7f4a2e800640 1 --2- 172.21.15.144:0/1002019561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a14004d40 0x7f4a140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:47.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.570+0000 7f4a2d400640 1 --2- 172.21.15.144:0/1002019561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a30070eb0 0x7f4a14004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:47.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.571+0000 7f4a2e800640 1 -- 172.21.15.144:0/1002019561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a30070eb0 msgr2=0x7f4a14004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:47.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.571+0000 7f4a2e800640 1 --2- 172.21.15.144:0/1002019561 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a30070eb0 0x7f4a14004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:47.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.571+0000 7f4a2e800640 1 -- 172.21.15.144:0/1002019561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a140039b0 msgr2=0x7f4a14003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:47.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.571+0000 7f4a2e800640 1 --2- 172.21.15.144:0/1002019561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a140039b0 0x7f4a14003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:47.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.571+0000 7f4a2e800640 1 -- 172.21.15.144:0/1002019561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a14003520 con 0x7f4a14004d40 2024-09-11T23:24:47.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.571+0000 7f4a2e800640 1 --2- 172.21.15.144:0/1002019561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a14004d40 0x7f4a140051c0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009ac0 tx=0x7f4a14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80867b2877e760f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:47.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.572+0000 7f4a2ca00640 1 -- 172.21.15.144:0/1002019561 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a28036070 con 0x7f4a14004d40 2024-09-11T23:24:47.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.572+0000 7f4a2ca00640 1 -- 172.21.15.144:0/1002019561 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a28031400 con 0x7f4a14004d40 2024-09-11T23:24:47.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.572+0000 7f4a2ca00640 1 -- 172.21.15.144:0/1002019561 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a28009690 con 0x7f4a14004d40 2024-09-11T23:24:47.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.572+0000 7f4a2f200640 1 -- 172.21.15.144:0/1002019561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a14004d40 msgr2=0x7f4a140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:47.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.572+0000 7f4a2f200640 1 --2- 172.21.15.144:0/1002019561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a14004d40 0x7f4a140051c0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009ac0 tx=0x7f4a14005830 comp rx=0 tx=0).stop 2024-09-11T23:24:47.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.572+0000 7f4a2e800640 1 -- 172.21.15.144:0/1002019561 reap_dead start 2024-09-11T23:24:47.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.572+0000 7f4a2f200640 1 -- 172.21.15.144:0/1002019561 shutdown_connections 2024-09-11T23:24:47.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.572+0000 7f4a2f200640 1 -- 172.21.15.144:0/1002019561 >> 172.21.15.144:0/1002019561 conn(0x7f4a3006bba0 msgr2=0x7f4a3006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:47.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.572+0000 7f4a2f200640 1 -- 172.21.15.144:0/1002019561 shutdown_connections 2024-09-11T23:24:47.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.572+0000 7f4a2f200640 1 -- 172.21.15.144:0/1002019561 wait complete. 2024-09-11T23:24:47.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.574+0000 7f4a2f200640 1 Processor -- start 2024-09-11T23:24:47.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.574+0000 7f4a2f200640 1 -- start start 2024-09-11T23:24:47.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.575+0000 7f4a2f200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a14004d40 0x7f4a30142350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:47.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.575+0000 7f4a2f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a3014f6c0 0x7f4a3015b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:47.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.575+0000 7f4a2f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a3015be70 0x7f4a3014fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:47.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.575+0000 7f4a2f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4a300b50a0 con 0x7f4a3014f6c0 2024-09-11T23:24:47.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.575+0000 7f4a2f200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4a300b4dc0 con 0x7f4a14004d40 2024-09-11T23:24:47.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.575+0000 7f4a2f200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4a300b5380 con 0x7f4a3015be70 2024-09-11T23:24:47.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.575+0000 7f4a2d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a3014f6c0 0x7f4a3015b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:47.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.575+0000 7f4a2d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a3014f6c0 0x7f4a3015b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51028/0 (socket says 172.21.15.144:51028) 2024-09-11T23:24:47.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.575+0000 7f4a2d400640 1 -- 172.21.15.144:0/981623667 learned_addr learned my addr 172.21.15.144:0/981623667 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:47.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.576+0000 7f4a2de00640 1 --2- 172.21.15.144:0/981623667 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a14004d40 0x7f4a30142350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:47.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.576+0000 7f4a2e800640 1 --2- 172.21.15.144:0/981623667 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a3015be70 0x7f4a3014fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:47.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.576+0000 7f4a2d400640 1 -- 172.21.15.144:0/981623667 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a3015be70 msgr2=0x7f4a3014fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:47.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.576+0000 7f4a2d400640 1 --2- 172.21.15.144:0/981623667 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a3015be70 0x7f4a3014fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:47.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.576+0000 7f4a2d400640 1 -- 172.21.15.144:0/981623667 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a14004d40 msgr2=0x7f4a30142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:47.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.576+0000 7f4a2d400640 1 --2- 172.21.15.144:0/981623667 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a14004d40 0x7f4a30142350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:47.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.576+0000 7f4a2d400640 1 -- 172.21.15.144:0/981623667 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a30143930 con 0x7f4a3014f6c0 2024-09-11T23:24:47.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.576+0000 7f4a2de00640 1 --2- 172.21.15.144:0/981623667 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a14004d40 0x7f4a30142350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:47.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.576+0000 7f4a2d400640 1 --2- 172.21.15.144:0/981623667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a3014f6c0 0x7f4a3015b930 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c010810 tx=0x7f4a1c010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:47.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.576+0000 7f4a26000640 1 -- 172.21.15.144:0/981623667 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c01a020 con 0x7f4a3014f6c0 2024-09-11T23:24:47.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.576+0000 7f4a26000640 1 -- 172.21.15.144:0/981623667 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a1c00eb00 con 0x7f4a3014f6c0 2024-09-11T23:24:47.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.576+0000 7f4a26000640 1 -- 172.21.15.144:0/981623667 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c00f040 con 0x7f4a3014f6c0 2024-09-11T23:24:47.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.576+0000 7f4a2f200640 1 -- 172.21.15.144:0/981623667 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a30143c10 con 0x7f4a3014f6c0 2024-09-11T23:24:47.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.576+0000 7f4a2f200640 1 -- 172.21.15.144:0/981623667 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a301441d0 con 0x7f4a3014f6c0 2024-09-11T23:24:47.578 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.577+0000 7f4a2f200640 1 -- 172.21.15.144:0/981623667 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a3015c280 con 0x7f4a3014f6c0 2024-09-11T23:24:47.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.578+0000 7f4a26000640 1 -- 172.21.15.144:0/981623667 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f4a1c01d020 con 0x7f4a3014f6c0 2024-09-11T23:24:47.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.579+0000 7f4a26000640 1 --2- 172.21.15.144:0/981623667 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4a1006c400 0x7f4a1006e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:47.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.579+0000 7f4a26000640 1 -- 172.21.15.144:0/981623667 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f4a1c08c230 con 0x7f4a3014f6c0 2024-09-11T23:24:47.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.580+0000 7f4a2de00640 1 --2- 172.21.15.144:0/981623667 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4a1006c400 0x7f4a1006e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:47.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.580+0000 7f4a2de00640 1 --2- 172.21.15.144:0/981623667 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4a1006c400 0x7f4a1006e8c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4a300ce750 tx=0x7f4a20006040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:47.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.583+0000 7f4a26000640 1 -- 172.21.15.144:0/981623667 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a3015c280 con 0x7f4a3014f6c0 2024-09-11T23:24:47.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:47.794+0000 7f4a2f200640 1 -- 172.21.15.144:0/981623667 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f4a3014fb70 con 0x7f4a3014f6c0 2024-09-11T23:24:48.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.550+0000 7f4a26000640 1 -- 172.21.15.144:0/981623667 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v91) ==== 136+0+0 (secure 0 0 0) 0x7f4a3014fb70 con 0x7f4a3014f6c0 2024-09-11T23:24:48.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.552+0000 7f4a2f200640 1 -- 172.21.15.144:0/981623667 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4a1006c400 msgr2=0x7f4a1006e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:48.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.552+0000 7f4a2f200640 1 --2- 172.21.15.144:0/981623667 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4a1006c400 0x7f4a1006e8c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4a300ce750 tx=0x7f4a20006040 comp rx=0 tx=0).stop 2024-09-11T23:24:48.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.552+0000 7f4a2f200640 1 -- 172.21.15.144:0/981623667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a3014f6c0 msgr2=0x7f4a3015b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:48.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.552+0000 7f4a2f200640 1 --2- 172.21.15.144:0/981623667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a3014f6c0 0x7f4a3015b930 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c010810 tx=0x7f4a1c010cd0 comp rx=0 tx=0).stop 2024-09-11T23:24:48.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.552+0000 7f4a2f200640 1 -- 172.21.15.144:0/981623667 shutdown_connections 2024-09-11T23:24:48.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.552+0000 7f4a2f200640 1 --2- 172.21.15.144:0/981623667 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4a1006c400 0x7f4a1006e8c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:48.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.552+0000 7f4a2f200640 1 --2- 172.21.15.144:0/981623667 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4a3015be70 0x7f4a3014fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:48.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.552+0000 7f4a2f200640 1 --2- 172.21.15.144:0/981623667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a3014f6c0 0x7f4a3015b930 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:48.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.552+0000 7f4a2f200640 1 --2- 172.21.15.144:0/981623667 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a14004d40 0x7f4a30142350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:48.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.552+0000 7f4a2f200640 1 -- 172.21.15.144:0/981623667 >> 172.21.15.144:0/981623667 conn(0x7f4a3006bba0 msgr2=0x7f4a3014d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:48.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.553+0000 7f4a2f200640 1 -- 172.21.15.144:0/981623667 shutdown_connections 2024-09-11T23:24:48.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.553+0000 7f4a2f200640 1 -- 172.21.15.144:0/981623667 wait complete. 2024-09-11T23:24:48.573 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-11T23:24:48.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.732+0000 7fc9ab000640 1 Processor -- start 2024-09-11T23:24:48.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.732+0000 7fc9ab000640 1 -- start start 2024-09-11T23:24:48.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.733+0000 7fc9ab000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc9a40d4ae0 0x7fc9a40d4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:48.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.733+0000 7fc9ab000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc9a40d3ff0 0x7fc9a4162930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:48.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.733+0000 7fc9ab000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9a40d1f40 con 0x7fc9a40b7740 2024-09-11T23:24:48.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.733+0000 7fc9ab000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc9a40d3c30 con 0x7fc9a40d4ae0 2024-09-11T23:24:48.733 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.733+0000 7fc9ab000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc9a40d5400 con 0x7fc9a40d3ff0 2024-09-11T23:24:48.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.733+0000 7fc9a9c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc9a40d4ae0 0x7fc9a40d4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:48.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.733+0000 7fc9a9c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc9a40d4ae0 0x7fc9a40d4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51042/0 (socket says 172.21.15.144:51042) 2024-09-11T23:24:48.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.733+0000 7fc9a9c00640 1 -- 172.21.15.144:0/1882459399 learned_addr learned my addr 172.21.15.144:0/1882459399 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:48.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.733+0000 7fc9aa600640 1 --2- 172.21.15.144:0/1882459399 >> v2:172.21.15.165:3300/0 conn(0x7fc9a40d3ff0 0x7fc9a4162930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:48.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.734+0000 7fc9a9c00640 1 -- 172.21.15.144:0/1882459399 >> v2:172.21.15.165:3300/0 conn(0x7fc9a40d3ff0 msgr2=0x7fc9a4162930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:48.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.734+0000 7fc9a9c00640 1 --2- 172.21.15.144:0/1882459399 >> v2:172.21.15.165:3300/0 conn(0x7fc9a40d3ff0 0x7fc9a4162930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:48.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.734+0000 7fc9a9c00640 1 -- 172.21.15.144:0/1882459399 >> v1:172.21.15.165:6789/0 conn(0x7fc9a40b7740 legacy=0x7fc9a4162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:48.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.734+0000 7fc9a9c00640 1 -- 172.21.15.144:0/1882459399 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a40d1c60 con 0x7fc9a40d4ae0 2024-09-11T23:24:48.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.735+0000 7fc9a9c00640 1 --2- 172.21.15.144:0/1882459399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9a40d4ae0 0x7fc9a40d4ec0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40cebf0 tx=0x7fc99802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d0f2bc0ea02ead server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:48.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.735+0000 7fc9a3e00640 1 -- 172.21.15.144:0/1882459399 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc998037070 con 0x7fc9a40d4ae0 2024-09-11T23:24:48.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.735+0000 7fc9a3e00640 1 -- 172.21.15.144:0/1882459399 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc998032440 con 0x7fc9a40d4ae0 2024-09-11T23:24:48.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.735+0000 7fc9a3e00640 1 -- 172.21.15.144:0/1882459399 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc998032810 con 0x7fc9a40d4ae0 2024-09-11T23:24:48.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.735+0000 7fc9ab000640 1 -- 172.21.15.144:0/1882459399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9a40d4ae0 msgr2=0x7fc9a40d4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:48.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.735+0000 7fc9ab000640 1 --2- 172.21.15.144:0/1882459399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9a40d4ae0 0x7fc9a40d4ec0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40cebf0 tx=0x7fc99802a1e0 comp rx=0 tx=0).stop 2024-09-11T23:24:48.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.736+0000 7fc9ab000640 1 -- 172.21.15.144:0/1882459399 shutdown_connections 2024-09-11T23:24:48.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.736+0000 7fc9ab000640 1 --2- 172.21.15.144:0/1882459399 >> v2:172.21.15.165:3300/0 conn(0x7fc9a40d3ff0 0x7fc9a4162930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:48.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.736+0000 7fc9ab000640 1 --2- 172.21.15.144:0/1882459399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9a40d4ae0 0x7fc9a40d4ec0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:48.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.736+0000 7fc9ab000640 1 -- 172.21.15.144:0/1882459399 >> 172.21.15.144:0/1882459399 conn(0x7fc9a4062a50 msgr2=0x7fc9a4062e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:48.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.736+0000 7fc9ab000640 1 -- 172.21.15.144:0/1882459399 shutdown_connections 2024-09-11T23:24:48.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.736+0000 7fc9ab000640 1 -- 172.21.15.144:0/1882459399 wait complete. 2024-09-11T23:24:48.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.737+0000 7fc9ab000640 1 Processor -- start 2024-09-11T23:24:48.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.737+0000 7fc9ab000640 1 -- start start 2024-09-11T23:24:48.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.738+0000 7fc9ab000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9a40b7740 0x7fc9a4159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:48.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.738+0000 7fc9ab000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9a40d3ff0 0x7fc9a41e95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:48.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.738+0000 7fc9ab000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9a40d4ae0 0x7fc9a4157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:48.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.738+0000 7fc9ab000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a40cfc40 con 0x7fc9a40b7740 2024-09-11T23:24:48.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.738+0000 7fc9ab000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a40cf960 con 0x7fc9a40d4ae0 2024-09-11T23:24:48.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.738+0000 7fc9ab000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a4161f10 con 0x7fc9a40d3ff0 2024-09-11T23:24:48.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.738+0000 7fc9a9c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9a40b7740 0x7fc9a4159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:48.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.738+0000 7fc9a9c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9a40b7740 0x7fc9a4159a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51058/0 (socket says 172.21.15.144:51058) 2024-09-11T23:24:48.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.738+0000 7fc9a9c00640 1 -- 172.21.15.144:0/1932769034 learned_addr learned my addr 172.21.15.144:0/1932769034 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:48.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.739+0000 7fc9aa600640 1 --2- 172.21.15.144:0/1932769034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9a40d4ae0 0x7fc9a4157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:48.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.739+0000 7fc9a9200640 1 --2- 172.21.15.144:0/1932769034 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9a40d3ff0 0x7fc9a41e95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:48.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.739+0000 7fc9a9c00640 1 -- 172.21.15.144:0/1932769034 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9a40d3ff0 msgr2=0x7fc9a41e95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:48.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.739+0000 7fc9a9c00640 1 --2- 172.21.15.144:0/1932769034 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9a40d3ff0 0x7fc9a41e95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:48.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.739+0000 7fc9a9c00640 1 -- 172.21.15.144:0/1932769034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9a40d4ae0 msgr2=0x7fc9a4157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:48.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.739+0000 7fc9a9c00640 1 --2- 172.21.15.144:0/1932769034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9a40d4ae0 0x7fc9a4157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:48.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.739+0000 7fc9a9c00640 1 -- 172.21.15.144:0/1932769034 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a415a100 con 0x7fc9a40b7740 2024-09-11T23:24:48.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.739+0000 7fc9aa600640 1 --2- 172.21.15.144:0/1932769034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9a40d4ae0 0x7fc9a4157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:48.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.739+0000 7fc9a9c00640 1 --2- 172.21.15.144:0/1932769034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9a40b7740 0x7fc9a4159a00 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fc99802a220 tx=0x7fc9980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:48.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.739+0000 7fc9a1600640 1 -- 172.21.15.144:0/1932769034 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc998041020 con 0x7fc9a40b7740 2024-09-11T23:24:48.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.739+0000 7fc9a1600640 1 -- 172.21.15.144:0/1932769034 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9980306c0 con 0x7fc9a40b7740 2024-09-11T23:24:48.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.739+0000 7fc9a1600640 1 -- 172.21.15.144:0/1932769034 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc998037040 con 0x7fc9a40b7740 2024-09-11T23:24:48.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.739+0000 7fc9ab000640 1 -- 172.21.15.144:0/1932769034 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a415a3e0 con 0x7fc9a40b7740 2024-09-11T23:24:48.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.740+0000 7fc9ab000640 1 -- 172.21.15.144:0/1932769034 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a415a9a0 con 0x7fc9a40b7740 2024-09-11T23:24:48.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.741+0000 7fc9ab000640 1 -- 172.21.15.144:0/1932769034 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a406c610 con 0x7fc9a40b7740 2024-09-11T23:24:48.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.741+0000 7fc9a1600640 1 -- 172.21.15.144:0/1932769034 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7fc998044020 con 0x7fc9a40b7740 2024-09-11T23:24:48.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.742+0000 7fc9a1600640 1 --2- 172.21.15.144:0/1932769034 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc98406c3d0 0x7fc98406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:48.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.742+0000 7fc9a1600640 1 -- 172.21.15.144:0/1932769034 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7fc9980ac150 con 0x7fc9a40b7740 2024-09-11T23:24:48.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.743+0000 7fc9a9200640 1 --2- 172.21.15.144:0/1932769034 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc98406c3d0 0x7fc98406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:48.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.743+0000 7fc9a9200640 1 --2- 172.21.15.144:0/1932769034 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc98406c3d0 0x7fc98406e890 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc990007fd0 tx=0x7fc990009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:48.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.747+0000 7fc9a1600640 1 -- 172.21.15.144:0/1932769034 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc9a406c610 con 0x7fc9a40b7740 2024-09-11T23:24:48.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.943+0000 7fc9ab000640 1 -- 172.21.15.144:0/1932769034 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fc9a40d18c0 con 0x7fc98406c3d0 2024-09-11T23:24:48.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.946+0000 7fc9a1600640 1 -- 172.21.15.144:0/1932769034 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fc9a40d18c0 con 0x7fc98406c3d0 2024-09-11T23:24:48.945 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:24:48.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:24:48.946 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephfs" 2024-09-11T23:24:48.946 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:24:48.946 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:24:48.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.948+0000 7fc9ab000640 1 -- 172.21.15.144:0/1932769034 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc98406c3d0 msgr2=0x7fc98406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:48.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.948+0000 7fc9ab000640 1 --2- 172.21.15.144:0/1932769034 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc98406c3d0 0x7fc98406e890 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc990007fd0 tx=0x7fc990009040 comp rx=0 tx=0).stop 2024-09-11T23:24:48.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.948+0000 7fc9ab000640 1 -- 172.21.15.144:0/1932769034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9a40b7740 msgr2=0x7fc9a4159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:48.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.948+0000 7fc9ab000640 1 --2- 172.21.15.144:0/1932769034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9a40b7740 0x7fc9a4159a00 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fc99802a220 tx=0x7fc9980046c0 comp rx=0 tx=0).stop 2024-09-11T23:24:48.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.948+0000 7fc9ab000640 1 -- 172.21.15.144:0/1932769034 shutdown_connections 2024-09-11T23:24:48.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.948+0000 7fc9ab000640 1 --2- 172.21.15.144:0/1932769034 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc98406c3d0 0x7fc98406e890 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:48.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.948+0000 7fc9ab000640 1 --2- 172.21.15.144:0/1932769034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9a40d4ae0 0x7fc9a4157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:48.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.948+0000 7fc9ab000640 1 --2- 172.21.15.144:0/1932769034 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc9a40d3ff0 0x7fc9a41e95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:48.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.948+0000 7fc9ab000640 1 --2- 172.21.15.144:0/1932769034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc9a40b7740 0x7fc9a4159a00 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:48.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.948+0000 7fc9ab000640 1 -- 172.21.15.144:0/1932769034 >> 172.21.15.144:0/1932769034 conn(0x7fc9a4062a50 msgr2=0x7fc9a4062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:48.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.949+0000 7fc9ab000640 1 -- 172.21.15.144:0/1932769034 shutdown_connections 2024-09-11T23:24:48.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:48.949+0000 7fc9ab000640 1 -- 172.21.15.144:0/1932769034 wait complete. 2024-09-11T23:24:48.964 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:24:49.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.121+0000 7ff5fee00640 1 Processor -- start 2024-09-11T23:24:49.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.121+0000 7ff5fee00640 1 -- start start 2024-09-11T23:24:49.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.122+0000 7ff5fee00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff5f815e960 0x7ff5f806bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.122+0000 7ff5fee00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff5f80b7ed0 0x7ff5f80b8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.122+0000 7ff5fee00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5f80d4040 con 0x7ff5f80cb2f0 2024-09-11T23:24:49.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.122+0000 7ff5fee00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff5f80b7a40 con 0x7ff5f815e960 2024-09-11T23:24:49.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.122+0000 7ff5fee00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff5f80cf750 con 0x7ff5f80b7ed0 2024-09-11T23:24:49.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.122+0000 7ff5f7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff5f815e960 0x7ff5f806bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.122+0000 7ff5f7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff5f815e960 0x7ff5f806bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51072/0 (socket says 172.21.15.144:51072) 2024-09-11T23:24:49.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.123+0000 7ff5f7e00640 1 -- 172.21.15.144:0/2727814339 learned_addr learned my addr 172.21.15.144:0/2727814339 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:49.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.123+0000 7ff5fce00640 1 --2- 172.21.15.144:0/2727814339 >> v2:172.21.15.165:3300/0 conn(0x7ff5f80b7ed0 0x7ff5f80b8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.123+0000 7ff5f7e00640 1 -- 172.21.15.144:0/2727814339 >> v2:172.21.15.165:3300/0 conn(0x7ff5f80b7ed0 msgr2=0x7ff5f80b8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:49.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.123+0000 7ff5f7e00640 1 --2- 172.21.15.144:0/2727814339 >> v2:172.21.15.165:3300/0 conn(0x7ff5f80b7ed0 0x7ff5f80b8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.123+0000 7ff5f7e00640 1 -- 172.21.15.144:0/2727814339 >> v1:172.21.15.165:6789/0 conn(0x7ff5f80cb2f0 legacy=0x7ff5f806c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:49.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.123+0000 7ff5f7e00640 1 -- 172.21.15.144:0/2727814339 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f80cfa30 con 0x7ff5f815e960 2024-09-11T23:24:49.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.123+0000 7ff5fce00640 1 --2- 172.21.15.144:0/2727814339 >> v2:172.21.15.165:3300/0 conn(0x7ff5f80b7ed0 0x7ff5f80b8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:49.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.124+0000 7ff5f7e00640 1 --2- 172.21.15.144:0/2727814339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f815e960 0x7ff5f806bf70 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7ff5f808d520 tx=0x7ff5e802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de860184e591362 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:49.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.124+0000 7ff5f6a00640 1 -- 172.21.15.144:0/2727814339 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e8036070 con 0x7ff5f815e960 2024-09-11T23:24:49.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.124+0000 7ff5f6a00640 1 -- 172.21.15.144:0/2727814339 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e8031600 con 0x7ff5f815e960 2024-09-11T23:24:49.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.124+0000 7ff5f6a00640 1 -- 172.21.15.144:0/2727814339 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80319d0 con 0x7ff5f815e960 2024-09-11T23:24:49.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.125+0000 7ff5fee00640 1 -- 172.21.15.144:0/2727814339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f815e960 msgr2=0x7ff5f806bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:49.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.125+0000 7ff5fee00640 1 --2- 172.21.15.144:0/2727814339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f815e960 0x7ff5f806bf70 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7ff5f808d520 tx=0x7ff5e802a730 comp rx=0 tx=0).stop 2024-09-11T23:24:49.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.125+0000 7ff5fee00640 1 -- 172.21.15.144:0/2727814339 shutdown_connections 2024-09-11T23:24:49.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.125+0000 7ff5fee00640 1 --2- 172.21.15.144:0/2727814339 >> v2:172.21.15.165:3300/0 conn(0x7ff5f80b7ed0 0x7ff5f80b8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.125+0000 7ff5fee00640 1 --2- 172.21.15.144:0/2727814339 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f815e960 0x7ff5f806bf70 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.125+0000 7ff5fee00640 1 -- 172.21.15.144:0/2727814339 >> 172.21.15.144:0/2727814339 conn(0x7ff5f80d46e0 msgr2=0x7ff5f80d4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:49.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.125+0000 7ff5fee00640 1 -- 172.21.15.144:0/2727814339 shutdown_connections 2024-09-11T23:24:49.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.125+0000 7ff5fee00640 1 -- 172.21.15.144:0/2727814339 wait complete. 2024-09-11T23:24:49.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.126+0000 7ff5fee00640 1 Processor -- start 2024-09-11T23:24:49.126 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.127+0000 7ff5fee00640 1 -- start start 2024-09-11T23:24:49.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.127+0000 7ff5fee00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f80b7ed0 0x7ff5f8159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.127+0000 7ff5fee00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f80cb2f0 0x7ff5f815aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.127+0000 7ff5fee00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5f815e960 0x7ff5f81e96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.127+0000 7ff5fee00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f806cbc0 con 0x7ff5f80b7ed0 2024-09-11T23:24:49.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.127+0000 7ff5fee00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f80d3cd0 con 0x7ff5f815e960 2024-09-11T23:24:49.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.127+0000 7ff5fee00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f806cd40 con 0x7ff5f80cb2f0 2024-09-11T23:24:49.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.128+0000 7ff5f7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f80b7ed0 0x7ff5f8159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.128+0000 7ff5f7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f80b7ed0 0x7ff5f8159220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51088/0 (socket says 172.21.15.144:51088) 2024-09-11T23:24:49.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.128+0000 7ff5f7e00640 1 -- 172.21.15.144:0/2617974416 learned_addr learned my addr 172.21.15.144:0/2617974416 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:49.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.128+0000 7ff5fce00640 1 --2- 172.21.15.144:0/2617974416 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5f815e960 0x7ff5f81e96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.128+0000 7ff5f7400640 1 --2- 172.21.15.144:0/2617974416 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f80cb2f0 0x7ff5f815aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.128+0000 7ff5f7e00640 1 -- 172.21.15.144:0/2617974416 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f80cb2f0 msgr2=0x7ff5f815aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:49.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.128+0000 7ff5f7e00640 1 --2- 172.21.15.144:0/2617974416 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f80cb2f0 0x7ff5f815aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.128+0000 7ff5f7e00640 1 -- 172.21.15.144:0/2617974416 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5f815e960 msgr2=0x7ff5f81e96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:49.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.128+0000 7ff5f7e00640 1 --2- 172.21.15.144:0/2617974416 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5f815e960 0x7ff5f81e96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.128+0000 7ff5f7e00640 1 -- 172.21.15.144:0/2617974416 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f815b3f0 con 0x7ff5f80b7ed0 2024-09-11T23:24:49.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.128+0000 7ff5f7400640 1 --2- 172.21.15.144:0/2617974416 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f80cb2f0 0x7ff5f815aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:49.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.128+0000 7ff5f7e00640 1 --2- 172.21.15.144:0/2617974416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f80b7ed0 0x7ff5f8159220 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8000f80 tx=0x7ff5e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:49.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.129+0000 7ff5efe00640 1 -- 172.21.15.144:0/2617974416 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e8041020 con 0x7ff5f80b7ed0 2024-09-11T23:24:49.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.129+0000 7ff5efe00640 1 -- 172.21.15.144:0/2617974416 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e8007820 con 0x7ff5f80b7ed0 2024-09-11T23:24:49.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.129+0000 7ff5efe00640 1 -- 172.21.15.144:0/2617974416 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e8036040 con 0x7ff5f80b7ed0 2024-09-11T23:24:49.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.129+0000 7ff5fee00640 1 -- 172.21.15.144:0/2617974416 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f815b6a0 con 0x7ff5f80b7ed0 2024-09-11T23:24:49.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.129+0000 7ff5fee00640 1 -- 172.21.15.144:0/2617974416 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f815fe50 con 0x7ff5f80b7ed0 2024-09-11T23:24:49.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.130+0000 7ff5fee00640 1 -- 172.21.15.144:0/2617974416 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5f806bf70 con 0x7ff5f80b7ed0 2024-09-11T23:24:49.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.131+0000 7ff5efe00640 1 -- 172.21.15.144:0/2617974416 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7ff5e8044020 con 0x7ff5f80b7ed0 2024-09-11T23:24:49.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.132+0000 7ff5efe00640 1 --2- 172.21.15.144:0/2617974416 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff5d806c3d0 0x7ff5d806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.132+0000 7ff5efe00640 1 -- 172.21.15.144:0/2617974416 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7ff5e80ac560 con 0x7ff5f80b7ed0 2024-09-11T23:24:49.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.132+0000 7ff5f7400640 1 --2- 172.21.15.144:0/2617974416 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff5d806c3d0 0x7ff5d806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.132 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.133+0000 7ff5f7400640 1 --2- 172.21.15.144:0/2617974416 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff5d806c3d0 0x7ff5d806e890 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80b5380 tx=0x7ff5e4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:49.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.136+0000 7ff5efe00640 1 -- 172.21.15.144:0/2617974416 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff5e804b030 con 0x7ff5f80b7ed0 2024-09-11T23:24:49.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.311+0000 7ff5fee00640 1 -- 172.21.15.144:0/2617974416 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff5f80cf280 con 0x7ff5f80b7ed0 2024-09-11T23:24:49.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.312+0000 7ff5efe00640 1 -- 172.21.15.144:0/2617974416 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7ff5e807a6a0 con 0x7ff5f80b7ed0 2024-09-11T23:24:49.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.314+0000 7ff5fee00640 1 -- 172.21.15.144:0/2617974416 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff5d806c3d0 msgr2=0x7ff5d806e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:49.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.314+0000 7ff5fee00640 1 --2- 172.21.15.144:0/2617974416 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff5d806c3d0 0x7ff5d806e890 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80b5380 tx=0x7ff5e4009040 comp rx=0 tx=0).stop 2024-09-11T23:24:49.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.314+0000 7ff5fee00640 1 -- 172.21.15.144:0/2617974416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f80b7ed0 msgr2=0x7ff5f8159220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:49.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.314+0000 7ff5fee00640 1 --2- 172.21.15.144:0/2617974416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f80b7ed0 0x7ff5f8159220 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8000f80 tx=0x7ff5e8004a40 comp rx=0 tx=0).stop 2024-09-11T23:24:49.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.314+0000 7ff5fee00640 1 -- 172.21.15.144:0/2617974416 shutdown_connections 2024-09-11T23:24:49.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.314+0000 7ff5fee00640 1 --2- 172.21.15.144:0/2617974416 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff5d806c3d0 0x7ff5d806e890 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.314+0000 7ff5fee00640 1 --2- 172.21.15.144:0/2617974416 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5f815e960 0x7ff5f81e96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.314 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.314+0000 7ff5fee00640 1 --2- 172.21.15.144:0/2617974416 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5f80cb2f0 0x7ff5f815aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.314+0000 7ff5fee00640 1 --2- 172.21.15.144:0/2617974416 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5f80b7ed0 0x7ff5f8159220 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.314+0000 7ff5fee00640 1 -- 172.21.15.144:0/2617974416 >> 172.21.15.144:0/2617974416 conn(0x7ff5f80d46e0 msgr2=0x7ff5f80b8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:49.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.314+0000 7ff5fee00640 1 -- 172.21.15.144:0/2617974416 shutdown_connections 2024-09-11T23:24:49.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.314+0000 7ff5fee00640 1 -- 172.21.15.144:0/2617974416 wait complete. 2024-09-11T23:24:49.330 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create non_existent_subvolume subvolume_1 2024-09-11T23:24:49.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.486+0000 7f34b7e00640 1 Processor -- start 2024-09-11T23:24:49.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.486+0000 7f34b7e00640 1 -- start start 2024-09-11T23:24:49.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.487+0000 7f34b7e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f34b8159dd0 0x7f34b80cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.487+0000 7f34b7e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b80cfd20 con 0x7f34b80cf260 2024-09-11T23:24:49.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.487+0000 7f34b7e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b80cd4e0 con 0x7f34b806c2b0 2024-09-11T23:24:49.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.487+0000 7f34b7e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f34b80cd7c0 con 0x7f34b8159dd0 2024-09-11T23:24:49.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.488+0000 7f34b6000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f34b80cf260 0x7f34b806bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39644/0 (socket says 172.21.15.144:39644) 2024-09-11T23:24:49.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.488+0000 7f34b6000640 1 -- 172.21.15.144:0/3840724692 learned_addr learned my addr 172.21.15.144:0/3840724692 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:49.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.488+0000 7f34b6a00640 1 --2- 172.21.15.144:0/3840724692 >> v2:172.21.15.165:3300/0 conn(0x7f34b8159dd0 0x7f34b80cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.488+0000 7f34b5600640 1 -- 172.21.15.144:0/3840724692 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4264647204 0 0) 0x7f34b80cfd20 con 0x7f34b80cf260 2024-09-11T23:24:49.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.488+0000 7f34b5600640 1 -- 172.21.15.144:0/3840724692 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f349c003520 con 0x7f34b80cf260 2024-09-11T23:24:49.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.488+0000 7f34b5600640 1 -- 172.21.15.144:0/3840724692 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3064683819 0 0) 0x7f349c003520 con 0x7f34b80cf260 2024-09-11T23:24:49.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.488+0000 7f34b5600640 1 -- 172.21.15.144:0/3840724692 >> v2:172.21.15.165:3300/0 conn(0x7f34b8159dd0 msgr2=0x7f34b80cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:49.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.488+0000 7f34b5600640 1 --2- 172.21.15.144:0/3840724692 >> v2:172.21.15.165:3300/0 conn(0x7f34b8159dd0 0x7f34b80cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.488+0000 7f34b5600640 1 -- 172.21.15.144:0/3840724692 >> v1:172.21.15.165:6789/0 conn(0x7f34b806c2b0 legacy=0x7f34b815d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:49.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.488+0000 7f34b5600640 1 -- 172.21.15.144:0/3840724692 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b80cdaa0 con 0x7f34b80cf260 2024-09-11T23:24:49.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.488+0000 7f34b5600640 1 -- 172.21.15.144:0/3840724692 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f34a4001670 con 0x7f34b80cf260 2024-09-11T23:24:49.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.489+0000 7f34b5600640 1 -- 172.21.15.144:0/3840724692 >> v1:172.21.15.144:6789/0 conn(0x7f34b80cf260 legacy=0x7f34b806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:49.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.489+0000 7f34b5600640 1 --2- 172.21.15.144:0/3840724692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f349c0039b0 0x7f349c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.489+0000 7f34b5600640 1 --2- 172.21.15.144:0/3840724692 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349c004800 0x7f349c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.489+0000 7f34b5600640 1 --2- 172.21.15.144:0/3840724692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c0051c0 0x7f349c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.489+0000 7f34b5600640 1 -- 172.21.15.144:0/3840724692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f34b80cd7c0 con 0x7f349c0051c0 2024-09-11T23:24:49.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.489+0000 7f34b5600640 1 -- 172.21.15.144:0/3840724692 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f349c00c010 con 0x7f349c0039b0 2024-09-11T23:24:49.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.489+0000 7f34b5600640 1 -- 172.21.15.144:0/3840724692 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f349c00c210 con 0x7f349c004800 2024-09-11T23:24:49.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.489+0000 7f34b7400640 1 --2- 172.21.15.144:0/3840724692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c0051c0 0x7f349c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.489+0000 7f34b6000640 1 --2- 172.21.15.144:0/3840724692 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349c004800 0x7f349c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.489+0000 7f34b6a00640 1 --2- 172.21.15.144:0/3840724692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f349c0039b0 0x7f349c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.489+0000 7f34b7400640 1 -- 172.21.15.144:0/3840724692 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349c004800 msgr2=0x7f349c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:49.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.489+0000 7f34b7400640 1 --2- 172.21.15.144:0/3840724692 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f349c004800 0x7f349c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.489+0000 7f34b7400640 1 -- 172.21.15.144:0/3840724692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f349c0039b0 msgr2=0x7f349c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:49.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.489+0000 7f34b7400640 1 --2- 172.21.15.144:0/3840724692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f349c0039b0 0x7f349c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.490+0000 7f34b7400640 1 -- 172.21.15.144:0/3840724692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349c003520 con 0x7f349c0051c0 2024-09-11T23:24:49.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.490+0000 7f34b7400640 1 -- 172.21.15.144:0/3840724692 reap_dead start 2024-09-11T23:24:49.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.490+0000 7f34b7400640 1 --2- 172.21.15.144:0/3840724692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c0051c0 0x7f349c00b9c0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f34b0001f60 tx=0x7f349c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4686ad4fcd9f166b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:49.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.491+0000 7f34b5600640 1 -- 172.21.15.144:0/3840724692 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b0001b30 con 0x7f349c0051c0 2024-09-11T23:24:49.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.491+0000 7f34b5600640 1 -- 172.21.15.144:0/3840724692 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b0003b90 con 0x7f349c0051c0 2024-09-11T23:24:49.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.491+0000 7f34b5600640 1 -- 172.21.15.144:0/3840724692 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b0005110 con 0x7f349c0051c0 2024-09-11T23:24:49.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.491+0000 7f34b7e00640 1 -- 172.21.15.144:0/3840724692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c0051c0 msgr2=0x7f349c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:49.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.491+0000 7f34b7e00640 1 --2- 172.21.15.144:0/3840724692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c0051c0 0x7f349c00b9c0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f34b0001f60 tx=0x7f349c005830 comp rx=0 tx=0).stop 2024-09-11T23:24:49.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.491+0000 7f34b7e00640 1 -- 172.21.15.144:0/3840724692 shutdown_connections 2024-09-11T23:24:49.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.491+0000 7f34b7e00640 1 --2- 172.21.15.144:0/3840724692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c0051c0 0x7f349c00b9c0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.491+0000 7f34b7e00640 1 -- 172.21.15.144:0/3840724692 >> 172.21.15.144:0/3840724692 conn(0x7f34b80d0300 msgr2=0x7f34b80d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:49.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.491+0000 7f34b7e00640 1 -- 172.21.15.144:0/3840724692 shutdown_connections 2024-09-11T23:24:49.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.491+0000 7f34b7e00640 1 -- 172.21.15.144:0/3840724692 wait complete. 2024-09-11T23:24:49.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.493+0000 7f34b7e00640 1 Processor -- start 2024-09-11T23:24:49.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.493+0000 7f34b7e00640 1 -- start start 2024-09-11T23:24:49.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.494+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c0051c0 0x7f34b81f8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.494+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34b80ad530 0x7f34b815a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.494+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f34b815ad40 0x7f34b814fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.494+0000 7f34b7e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f34b80cf6d0 con 0x7f349c0051c0 2024-09-11T23:24:49.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.494+0000 7f34b7e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f34b815d6d0 con 0x7f34b80ad530 2024-09-11T23:24:49.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.494+0000 7f34b7e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f34b80cf850 con 0x7f34b815ad40 2024-09-11T23:24:49.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.494+0000 7f34b6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c0051c0 0x7f34b81f8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.494+0000 7f34b6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c0051c0 0x7f34b81f8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51106/0 (socket says 172.21.15.144:51106) 2024-09-11T23:24:49.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.494+0000 7f34b6a00640 1 -- 172.21.15.144:0/2253614892 learned_addr learned my addr 172.21.15.144:0/2253614892 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:49.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.494+0000 7f34b7400640 1 --2- 172.21.15.144:0/2253614892 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f34b815ad40 0x7f34b814fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.494+0000 7f34b6000640 1 --2- 172.21.15.144:0/2253614892 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34b80ad530 0x7f34b815a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.495+0000 7f34b6a00640 1 -- 172.21.15.144:0/2253614892 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f34b815ad40 msgr2=0x7f34b814fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:49.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.495+0000 7f34b6a00640 1 --2- 172.21.15.144:0/2253614892 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f34b815ad40 0x7f34b814fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.495+0000 7f34b6a00640 1 -- 172.21.15.144:0/2253614892 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34b80ad530 msgr2=0x7f34b815a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:49.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.495+0000 7f34b6a00640 1 --2- 172.21.15.144:0/2253614892 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34b80ad530 0x7f34b815a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.495+0000 7f34b6a00640 1 -- 172.21.15.144:0/2253614892 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b81f7b20 con 0x7f349c0051c0 2024-09-11T23:24:49.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.495+0000 7f34b6a00640 1 --2- 172.21.15.144:0/2253614892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f349c0051c0 0x7f34b81f8300 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f34a8011960 tx=0x7f34a8011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:49.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.495+0000 7f34af400640 1 -- 172.21.15.144:0/2253614892 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a800fa90 con 0x7f349c0051c0 2024-09-11T23:24:49.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.495+0000 7f34af400640 1 -- 172.21.15.144:0/2253614892 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34a800fc50 con 0x7f349c0051c0 2024-09-11T23:24:49.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.495+0000 7f34b7e00640 1 -- 172.21.15.144:0/2253614892 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b81f4d80 con 0x7f349c0051c0 2024-09-11T23:24:49.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.495+0000 7f34af400640 1 -- 172.21.15.144:0/2253614892 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a8014440 con 0x7f349c0051c0 2024-09-11T23:24:49.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.495+0000 7f34b7e00640 1 -- 172.21.15.144:0/2253614892 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b81f5340 con 0x7f349c0051c0 2024-09-11T23:24:49.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.496+0000 7f34b7e00640 1 -- 172.21.15.144:0/2253614892 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b815b150 con 0x7f349c0051c0 2024-09-11T23:24:49.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.497+0000 7f34af400640 1 -- 172.21.15.144:0/2253614892 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f34a8012040 con 0x7f349c0051c0 2024-09-11T23:24:49.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.498+0000 7f34af400640 1 --2- 172.21.15.144:0/2253614892 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f349806c400 0x7f349806e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.498+0000 7f34af400640 1 -- 172.21.15.144:0/2253614892 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f34a808be20 con 0x7f349c0051c0 2024-09-11T23:24:49.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.499+0000 7f34b6000640 1 --2- 172.21.15.144:0/2253614892 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f349806c400 0x7f349806e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.499+0000 7f34b6000640 1 --2- 172.21.15.144:0/2253614892 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f349806c400 0x7f349806e8c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f34a4007b00 tx=0x7f34a4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:49.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.503+0000 7f34af400640 1 -- 172.21.15.144:0/2253614892 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f34b815b150 con 0x7f349c0051c0 2024-09-11T23:24:49.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.702+0000 7f34b7e00640 1 -- 172.21.15.144:0/2253614892 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7f34b80cdfc0 con 0x7f349806c400 2024-09-11T23:24:49.703 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:49.704+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:49.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.705+0000 7f34af400640 1 -- 172.21.15.144:0/2253614892 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f34b80cdfc0 con 0x7f349806c400 2024-09-11T23:24:49.704 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:49.713 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:49.714 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm non_existent_subvolume subvolume_1 2024-09-11T23:24:49.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.871+0000 7fe347200640 1 Processor -- start 2024-09-11T23:24:49.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.871+0000 7fe347200640 1 -- start start 2024-09-11T23:24:49.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.872+0000 7fe347200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe34815e6c0 0x7fe34806c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.872+0000 7fe347200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe3480cf510 0x7fe3480b7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.872+0000 7fe347200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe3480b7bb0 0x7fe34806d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.872+0000 7fe347200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe3480d34d0 con 0x7fe3480b7bb0 2024-09-11T23:24:49.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.872+0000 7fe347200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe34815eaa0 con 0x7fe3480cf510 2024-09-11T23:24:49.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.872+0000 7fe347200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe34806cdf0 con 0x7fe34815e6c0 2024-09-11T23:24:49.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.872+0000 7fe346800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe3480b7bb0 0x7fe34806d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.872+0000 7fe346800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe3480b7bb0 0x7fe34806d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51110/0 (socket says 172.21.15.144:51110) 2024-09-11T23:24:49.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.872+0000 7fe346800640 1 -- 172.21.15.144:0/1429194957 learned_addr learned my addr 172.21.15.144:0/1429194957 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:49.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.873+0000 7fe345e00640 1 --2- 172.21.15.144:0/1429194957 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe34815e6c0 0x7fe34806c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.873+0000 7fe345400640 1 --2- 172.21.15.144:0/1429194957 >> v2:172.21.15.165:3300/0 conn(0x7fe3480cf510 0x7fe3480b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.873+0000 7fe346800640 1 -- 172.21.15.144:0/1429194957 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe34815e6c0 msgr2=0x7fe34806c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:49.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.873+0000 7fe346800640 1 --2- 172.21.15.144:0/1429194957 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe34815e6c0 0x7fe34806c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.873+0000 7fe346800640 1 -- 172.21.15.144:0/1429194957 >> v2:172.21.15.165:3300/0 conn(0x7fe3480cf510 msgr2=0x7fe3480b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:49.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.873+0000 7fe346800640 1 --2- 172.21.15.144:0/1429194957 >> v2:172.21.15.165:3300/0 conn(0x7fe3480cf510 0x7fe3480b7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.873+0000 7fe346800640 1 -- 172.21.15.144:0/1429194957 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3480d28c0 con 0x7fe3480b7bb0 2024-09-11T23:24:49.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.874+0000 7fe346800640 1 --2- 172.21.15.144:0/1429194957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3480b7bb0 0x7fe34806d610 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fe348074300 tx=0x7fe34002a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7618861bafb8d97a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:49.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.874+0000 7fe344a00640 1 -- 172.21.15.144:0/1429194957 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340036070 con 0x7fe3480b7bb0 2024-09-11T23:24:49.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.874+0000 7fe344a00640 1 -- 172.21.15.144:0/1429194957 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe340031600 con 0x7fe3480b7bb0 2024-09-11T23:24:49.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.874+0000 7fe344a00640 1 -- 172.21.15.144:0/1429194957 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3400319d0 con 0x7fe3480b7bb0 2024-09-11T23:24:49.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.875+0000 7fe347200640 1 -- 172.21.15.144:0/1429194957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3480b7bb0 msgr2=0x7fe34806d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:49.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.875+0000 7fe347200640 1 --2- 172.21.15.144:0/1429194957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3480b7bb0 0x7fe34806d610 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fe348074300 tx=0x7fe34002a720 comp rx=0 tx=0).stop 2024-09-11T23:24:49.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.875+0000 7fe347200640 1 -- 172.21.15.144:0/1429194957 shutdown_connections 2024-09-11T23:24:49.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.875+0000 7fe347200640 1 --2- 172.21.15.144:0/1429194957 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3480b7bb0 0x7fe34806d610 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.875+0000 7fe347200640 1 --2- 172.21.15.144:0/1429194957 >> v2:172.21.15.165:3300/0 conn(0x7fe3480cf510 0x7fe3480b7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.875+0000 7fe347200640 1 --2- 172.21.15.144:0/1429194957 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe34815e6c0 0x7fe34806c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.875+0000 7fe347200640 1 -- 172.21.15.144:0/1429194957 >> 172.21.15.144:0/1429194957 conn(0x7fe3480d4720 msgr2=0x7fe3480d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:49.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.875+0000 7fe347200640 1 -- 172.21.15.144:0/1429194957 shutdown_connections 2024-09-11T23:24:49.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.875+0000 7fe347200640 1 -- 172.21.15.144:0/1429194957 wait complete. 2024-09-11T23:24:49.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.876+0000 7fe347200640 1 Processor -- start 2024-09-11T23:24:49.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.877+0000 7fe347200640 1 -- start start 2024-09-11T23:24:49.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.877+0000 7fe347200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3480b7bb0 0x7fe3480cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.878+0000 7fe347200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3480cf510 0x7fe3480b7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.878+0000 7fe347200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe34815e6c0 0x7fe3480b8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.878+0000 7fe347200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe3480d3160 con 0x7fe34815e6c0 2024-09-11T23:24:49.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.878+0000 7fe347200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe3480d2e80 con 0x7fe3480cf510 2024-09-11T23:24:49.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.878+0000 7fe347200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe34806db50 con 0x7fe3480b7bb0 2024-09-11T23:24:49.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.878+0000 7fe346800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe34815e6c0 0x7fe3480b8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.878+0000 7fe346800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe34815e6c0 0x7fe3480b8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51112/0 (socket says 172.21.15.144:51112) 2024-09-11T23:24:49.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.878+0000 7fe346800640 1 -- 172.21.15.144:0/3547306091 learned_addr learned my addr 172.21.15.144:0/3547306091 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:49.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.878+0000 7fe345400640 1 --2- 172.21.15.144:0/3547306091 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3480cf510 0x7fe3480b7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.878+0000 7fe345e00640 1 --2- 172.21.15.144:0/3547306091 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3480b7bb0 0x7fe3480cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.878+0000 7fe346800640 1 -- 172.21.15.144:0/3547306091 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3480b7bb0 msgr2=0x7fe3480cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:49.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.878+0000 7fe346800640 1 --2- 172.21.15.144:0/3547306091 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe3480b7bb0 0x7fe3480cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.878+0000 7fe346800640 1 -- 172.21.15.144:0/3547306091 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3480cf510 msgr2=0x7fe3480b7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:49.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.878+0000 7fe346800640 1 --2- 172.21.15.144:0/3547306091 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3480cf510 0x7fe3480b7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:49.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.878+0000 7fe346800640 1 -- 172.21.15.144:0/3547306091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3481f47f0 con 0x7fe34815e6c0 2024-09-11T23:24:49.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.879+0000 7fe346800640 1 --2- 172.21.15.144:0/3547306091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe34815e6c0 0x7fe3480b8520 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fe340034040 tx=0x7fe340004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:49.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.879+0000 7fe33e000640 1 -- 172.21.15.144:0/3547306091 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340036050 con 0x7fe34815e6c0 2024-09-11T23:24:49.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.879+0000 7fe33e000640 1 -- 172.21.15.144:0/3547306091 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe340042070 con 0x7fe34815e6c0 2024-09-11T23:24:49.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.879+0000 7fe33e000640 1 -- 172.21.15.144:0/3547306091 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340009510 con 0x7fe34815e6c0 2024-09-11T23:24:49.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.879+0000 7fe347200640 1 -- 172.21.15.144:0/3547306091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3480ce490 con 0x7fe34815e6c0 2024-09-11T23:24:49.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.879+0000 7fe347200640 1 -- 172.21.15.144:0/3547306091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe348159440 con 0x7fe34815e6c0 2024-09-11T23:24:49.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.880+0000 7fe347200640 1 -- 172.21.15.144:0/3547306091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3480ce9b0 con 0x7fe34815e6c0 2024-09-11T23:24:49.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.881+0000 7fe33e000640 1 -- 172.21.15.144:0/3547306091 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7fe340007bd0 con 0x7fe34815e6c0 2024-09-11T23:24:49.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.882+0000 7fe33e000640 1 --2- 172.21.15.144:0/3547306091 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe32806c3d0 0x7fe32806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:49.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.882+0000 7fe33e000640 1 -- 172.21.15.144:0/3547306091 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7fe3400ac660 con 0x7fe34815e6c0 2024-09-11T23:24:49.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.882+0000 7fe345e00640 1 --2- 172.21.15.144:0/3547306091 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe32806c3d0 0x7fe32806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:49.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.883+0000 7fe345e00640 1 --2- 172.21.15.144:0/3547306091 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe32806c3d0 0x7fe32806e890 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe338006fd0 tx=0x7fe338008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:49.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:49.886+0000 7fe33e000640 1 -- 172.21.15.144:0/3547306091 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe34007a710 con 0x7fe34815e6c0 2024-09-11T23:24:50.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.083+0000 7fe347200640 1 -- 172.21.15.144:0/3547306091 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7fe3480b7670 con 0x7fe32806c3d0 2024-09-11T23:24:50.084 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:50.085+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:50.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.086+0000 7fe33e000640 1 -- 172.21.15.144:0/3547306091 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fe3480b7670 con 0x7fe32806c3d0 2024-09-11T23:24:50.085 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:50.095 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:50.096 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath non_existent_subvolume subvolume_1 2024-09-11T23:24:50.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.253+0000 7faafb000640 1 Processor -- start 2024-09-11T23:24:50.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.253+0000 7faafb000640 1 -- start start 2024-09-11T23:24:50.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.254+0000 7faafb000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faaf415a750 0x7faaf406c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:50.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.254+0000 7faafb000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faaf40cd930 0x7faaf415ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:50.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.255+0000 7faafb000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaf415e590 con 0x7faaf406d080 2024-09-11T23:24:50.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.255+0000 7faafb000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7faaf40ce660 con 0x7faaf415a750 2024-09-11T23:24:50.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.255+0000 7faafb000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faaf40ce0a0 con 0x7faaf40cd930 2024-09-11T23:24:50.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.255+0000 7faaf9c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faaf415a750 0x7faaf406c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:50.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.255+0000 7faaf9c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faaf415a750 0x7faaf406c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51116/0 (socket says 172.21.15.144:51116) 2024-09-11T23:24:50.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.255+0000 7faafa600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7faaf406d080 0x7faaf40b33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39658/0 (socket says 172.21.15.144:39658) 2024-09-11T23:24:50.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.255+0000 7faaf9c00640 1 -- 172.21.15.144:0/297309428 learned_addr learned my addr 172.21.15.144:0/297309428 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:50.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.255+0000 7faaf9200640 1 --2- 172.21.15.144:0/297309428 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faaf40cd930 0x7faaf415ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:50.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.255+0000 7faaf9c00640 1 -- 172.21.15.144:0/297309428 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faaf40cd930 msgr2=0x7faaf415ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:50.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.255+0000 7faaf9c00640 1 --2- 172.21.15.144:0/297309428 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faaf40cd930 0x7faaf415ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:50.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.255+0000 7faaf9c00640 1 -- 172.21.15.144:0/297309428 >> v1:172.21.15.144:6789/0 conn(0x7faaf406d080 legacy=0x7faaf40b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:50.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.255+0000 7faaf9c00640 1 -- 172.21.15.144:0/297309428 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf40ce380 con 0x7faaf415a750 2024-09-11T23:24:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.256+0000 7faaf9c00640 1 --2- 172.21.15.144:0/297309428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faaf415a750 0x7faaf406c660 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7faae8009e80 tx=0x7faae802a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399b5feca900bfe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.256+0000 7faaf3e00640 1 -- 172.21.15.144:0/297309428 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8036070 con 0x7faaf415a750 2024-09-11T23:24:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.256+0000 7faaf3e00640 1 -- 172.21.15.144:0/297309428 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae8031600 con 0x7faaf415a750 2024-09-11T23:24:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.256+0000 7faaf3e00640 1 -- 172.21.15.144:0/297309428 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae80319d0 con 0x7faaf415a750 2024-09-11T23:24:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.257+0000 7faafb000640 1 -- 172.21.15.144:0/297309428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faaf415a750 msgr2=0x7faaf406c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.257+0000 7faafb000640 1 --2- 172.21.15.144:0/297309428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faaf415a750 0x7faaf406c660 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7faae8009e80 tx=0x7faae802a740 comp rx=0 tx=0).stop 2024-09-11T23:24:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.257+0000 7faafb000640 1 -- 172.21.15.144:0/297309428 shutdown_connections 2024-09-11T23:24:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.257+0000 7faafb000640 1 --2- 172.21.15.144:0/297309428 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faaf40cd930 0x7faaf415ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:50.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.257+0000 7faafb000640 1 --2- 172.21.15.144:0/297309428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faaf415a750 0x7faaf406c660 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:50.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.257+0000 7faafb000640 1 -- 172.21.15.144:0/297309428 >> 172.21.15.144:0/297309428 conn(0x7faaf40d0300 msgr2=0x7faaf40d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:50.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.257+0000 7faafb000640 1 -- 172.21.15.144:0/297309428 shutdown_connections 2024-09-11T23:24:50.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.257+0000 7faafb000640 1 -- 172.21.15.144:0/297309428 wait complete. 2024-09-11T23:24:50.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.259+0000 7faafb000640 1 Processor -- start 2024-09-11T23:24:50.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.259+0000 7faafb000640 1 -- start start 2024-09-11T23:24:50.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.260+0000 7faafb000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faaf406d080 0x7faaf414abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:50.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.260+0000 7faafb000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faaf40cd930 0x7faaf40b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:50.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.260+0000 7faafb000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faaf415a750 0x7faaf414b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:50.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.260+0000 7faafb000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faaf415f290 con 0x7faaf40cd930 2024-09-11T23:24:50.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.260+0000 7faafb000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faaf40cddc0 con 0x7faaf406d080 2024-09-11T23:24:50.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.260+0000 7faafb000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7faaf415bb40 con 0x7faaf415a750 2024-09-11T23:24:50.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.260+0000 7faaf9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faaf40cd930 0x7faaf40b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:50.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.260+0000 7faaf9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faaf40cd930 0x7faaf40b0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51128/0 (socket says 172.21.15.144:51128) 2024-09-11T23:24:50.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.260+0000 7faaf9200640 1 -- 172.21.15.144:0/2963432329 learned_addr learned my addr 172.21.15.144:0/2963432329 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:50.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.260+0000 7faaf9200640 1 -- 172.21.15.144:0/2963432329 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faaf415a750 msgr2=0x7faaf414b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:50.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.260+0000 7faaf9c00640 1 --2- 172.21.15.144:0/2963432329 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faaf406d080 0x7faaf414abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:50.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.260+0000 7faafa600640 1 --2- 172.21.15.144:0/2963432329 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faaf415a750 0x7faaf414b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:50.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.260+0000 7faaf9200640 1 --2- 172.21.15.144:0/2963432329 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faaf415a750 0x7faaf414b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:50.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.260+0000 7faaf9200640 1 -- 172.21.15.144:0/2963432329 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faaf406d080 msgr2=0x7faaf414abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:50.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.260+0000 7faaf9200640 1 --2- 172.21.15.144:0/2963432329 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faaf406d080 0x7faaf414abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:50.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.260+0000 7faaf9200640 1 -- 172.21.15.144:0/2963432329 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf40b11c0 con 0x7faaf40cd930 2024-09-11T23:24:50.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.260+0000 7faaf9c00640 1 --2- 172.21.15.144:0/2963432329 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faaf406d080 0x7faaf414abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:24:50.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.260+0000 7faafa600640 1 --2- 172.21.15.144:0/2963432329 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7faaf415a750 0x7faaf414b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:24:50.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.261+0000 7faaf9200640 1 --2- 172.21.15.144:0/2963432329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faaf40cd930 0x7faaf40b0c80 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7faae000d800 tx=0x7faae000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:50.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.261+0000 7faaf1600640 1 -- 172.21.15.144:0/2963432329 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae000b6c0 con 0x7faaf40cd930 2024-09-11T23:24:50.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.261+0000 7faaf1600640 1 -- 172.21.15.144:0/2963432329 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae0019070 con 0x7faaf40cd930 2024-09-11T23:24:50.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.261+0000 7faaf1600640 1 -- 172.21.15.144:0/2963432329 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae000ba80 con 0x7faaf40cd930 2024-09-11T23:24:50.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.261+0000 7faafb000640 1 -- 172.21.15.144:0/2963432329 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf414f870 con 0x7faaf40cd930 2024-09-11T23:24:50.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.261+0000 7faafb000640 1 -- 172.21.15.144:0/2963432329 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf414fe30 con 0x7faaf40cd930 2024-09-11T23:24:50.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.262+0000 7faafb000640 1 -- 172.21.15.144:0/2963432329 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf415ed50 con 0x7faaf40cd930 2024-09-11T23:24:50.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.263+0000 7faaf1600640 1 -- 172.21.15.144:0/2963432329 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7faae000bc20 con 0x7faaf40cd930 2024-09-11T23:24:50.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.264+0000 7faaf1600640 1 --2- 172.21.15.144:0/2963432329 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7faad406c3d0 0x7faad406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:50.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.264+0000 7faaf1600640 1 -- 172.21.15.144:0/2963432329 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7faae008bdb0 con 0x7faaf40cd930 2024-09-11T23:24:50.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.264+0000 7faaf9c00640 1 --2- 172.21.15.144:0/2963432329 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7faad406c3d0 0x7faad406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:50.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.265+0000 7faaf9c00640 1 --2- 172.21.15.144:0/2963432329 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7faad406c3d0 0x7faad406e890 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faae8033000 tx=0x7faae8009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:50.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.268+0000 7faaf1600640 1 -- 172.21.15.144:0/2963432329 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faae001c360 con 0x7faaf40cd930 2024-09-11T23:24:50.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.467+0000 7faafb000640 1 -- 172.21.15.144:0/2963432329 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7faaf415c840 con 0x7faad406c3d0 2024-09-11T23:24:50.468 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:50.469+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:50.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.469+0000 7faaf1600640 1 -- 172.21.15.144:0/2963432329 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7faaf415c840 con 0x7faad406c3d0 2024-09-11T23:24:50.469 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:50.478 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:50.479 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info non_existent_subvolume subvolume_1 2024-09-11T23:24:50.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.637+0000 7f8e89e00640 1 Processor -- start 2024-09-11T23:24:50.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.637+0000 7f8e89e00640 1 -- start start 2024-09-11T23:24:50.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.638+0000 7f8e89e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8e84158e50 0x7f8e840b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:50.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.638+0000 7f8e89e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8e8406f130 0x7f8e840ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:50.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.638+0000 7f8e89e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e8415c800 con 0x7f8e8415c370 2024-09-11T23:24:50.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.638+0000 7f8e89e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8e840b43f0 con 0x7f8e84158e50 2024-09-11T23:24:50.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.638+0000 7f8e89e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8e840b3630 con 0x7f8e8406f130 2024-09-11T23:24:50.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.639+0000 7f8e82a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8e84158e50 0x7f8e840b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:50.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.639+0000 7f8e82a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8e84158e50 0x7f8e840b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51142/0 (socket says 172.21.15.144:51142) 2024-09-11T23:24:50.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.639+0000 7f8e82a00640 1 -- 172.21.15.144:0/1190028353 learned_addr learned my addr 172.21.15.144:0/1190028353 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:50.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.639+0000 7f8e83400640 1 --2- 172.21.15.144:0/1190028353 >> v2:172.21.15.165:3300/0 conn(0x7f8e8406f130 0x7f8e840ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:50.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.639+0000 7f8e82a00640 1 -- 172.21.15.144:0/1190028353 >> v2:172.21.15.165:3300/0 conn(0x7f8e8406f130 msgr2=0x7f8e840ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:50.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.639+0000 7f8e82a00640 1 --2- 172.21.15.144:0/1190028353 >> v2:172.21.15.165:3300/0 conn(0x7f8e8406f130 0x7f8e840ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:50.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.639+0000 7f8e82a00640 1 -- 172.21.15.144:0/1190028353 >> v1:172.21.15.144:6789/0 conn(0x7f8e8415c370 legacy=0x7f8e8406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:50.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.639+0000 7f8e82a00640 1 -- 172.21.15.144:0/1190028353 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e840b3910 con 0x7f8e84158e50 2024-09-11T23:24:50.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.640+0000 7f8e82a00640 1 --2- 172.21.15.144:0/1190028353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e84158e50 0x7f8e840b5050 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f8e840cda60 tx=0x7f8e7402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcae3708f088f674 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:50.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.640+0000 7f8e82000640 1 -- 172.21.15.144:0/1190028353 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e74037070 con 0x7f8e84158e50 2024-09-11T23:24:50.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.640+0000 7f8e82000640 1 -- 172.21.15.144:0/1190028353 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e74032440 con 0x7f8e84158e50 2024-09-11T23:24:50.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.640+0000 7f8e82000640 1 -- 172.21.15.144:0/1190028353 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e74032810 con 0x7f8e84158e50 2024-09-11T23:24:50.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.641+0000 7f8e89e00640 1 -- 172.21.15.144:0/1190028353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e84158e50 msgr2=0x7f8e840b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:50.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.641+0000 7f8e89e00640 1 --2- 172.21.15.144:0/1190028353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e84158e50 0x7f8e840b5050 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f8e840cda60 tx=0x7f8e7402a200 comp rx=0 tx=0).stop 2024-09-11T23:24:50.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.641+0000 7f8e89e00640 1 -- 172.21.15.144:0/1190028353 shutdown_connections 2024-09-11T23:24:50.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.641+0000 7f8e89e00640 1 --2- 172.21.15.144:0/1190028353 >> v2:172.21.15.165:3300/0 conn(0x7f8e8406f130 0x7f8e840ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:50.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.641+0000 7f8e89e00640 1 --2- 172.21.15.144:0/1190028353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e84158e50 0x7f8e840b5050 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:50.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.641+0000 7f8e89e00640 1 -- 172.21.15.144:0/1190028353 >> 172.21.15.144:0/1190028353 conn(0x7f8e8406bba0 msgr2=0x7f8e8406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:50.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.641+0000 7f8e89e00640 1 -- 172.21.15.144:0/1190028353 shutdown_connections 2024-09-11T23:24:50.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.641+0000 7f8e89e00640 1 -- 172.21.15.144:0/1190028353 wait complete. 2024-09-11T23:24:50.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.643+0000 7f8e89e00640 1 Processor -- start 2024-09-11T23:24:50.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.643+0000 7f8e89e00640 1 -- start start 2024-09-11T23:24:50.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.644+0000 7f8e89e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e8406f130 0x7f8e84159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:50.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.644+0000 7f8e89e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e84158e50 0x7f8e84145c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:50.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.644+0000 7f8e89e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e8415c370 0x7f8e84146540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:50.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.644+0000 7f8e89e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8e84159230 con 0x7f8e8406f130 2024-09-11T23:24:50.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.644+0000 7f8e89e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8e840b3ed0 con 0x7f8e8415c370 2024-09-11T23:24:50.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.644+0000 7f8e89e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8e840ce740 con 0x7f8e84158e50 2024-09-11T23:24:50.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.644+0000 7f8e82a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e8406f130 0x7f8e84159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:50.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.644+0000 7f8e82a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e8406f130 0x7f8e84159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51156/0 (socket says 172.21.15.144:51156) 2024-09-11T23:24:50.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.644+0000 7f8e82a00640 1 -- 172.21.15.144:0/3341823450 learned_addr learned my addr 172.21.15.144:0/3341823450 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:50.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.644+0000 7f8e82a00640 1 -- 172.21.15.144:0/3341823450 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e84158e50 msgr2=0x7f8e84145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:50.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.644+0000 7f8e82a00640 1 --2- 172.21.15.144:0/3341823450 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e84158e50 0x7f8e84145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:50.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.644+0000 7f8e82a00640 1 -- 172.21.15.144:0/3341823450 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e8415c370 msgr2=0x7f8e84146540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:50.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.644+0000 7f8e82a00640 1 --2- 172.21.15.144:0/3341823450 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e8415c370 0x7f8e84146540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:50.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.644+0000 7f8e82a00640 1 -- 172.21.15.144:0/3341823450 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8414f250 con 0x7f8e8406f130 2024-09-11T23:24:50.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.645+0000 7f8e82a00640 1 --2- 172.21.15.144:0/3341823450 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e8406f130 0x7f8e84159d70 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f8e74000c00 tx=0x7f8e740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:50.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.645+0000 7f8e7be00640 1 -- 172.21.15.144:0/3341823450 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e74041020 con 0x7f8e8406f130 2024-09-11T23:24:50.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.645+0000 7f8e7be00640 1 -- 172.21.15.144:0/3341823450 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e740306c0 con 0x7f8e8406f130 2024-09-11T23:24:50.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.645+0000 7f8e89e00640 1 -- 172.21.15.144:0/3341823450 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e84151070 con 0x7f8e8406f130 2024-09-11T23:24:50.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.645+0000 7f8e7be00640 1 -- 172.21.15.144:0/3341823450 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e74037040 con 0x7f8e8406f130 2024-09-11T23:24:50.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.645+0000 7f8e89e00640 1 -- 172.21.15.144:0/3341823450 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e841461d0 con 0x7f8e8406f130 2024-09-11T23:24:50.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.646+0000 7f8e89e00640 1 -- 172.21.15.144:0/3341823450 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e84155a10 con 0x7f8e8406f130 2024-09-11T23:24:50.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.647+0000 7f8e7be00640 1 -- 172.21.15.144:0/3341823450 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f8e74044020 con 0x7f8e8406f130 2024-09-11T23:24:50.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.648+0000 7f8e7be00640 1 --2- 172.21.15.144:0/3341823450 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8e6006c400 0x7f8e6006e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:50.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.648+0000 7f8e7be00640 1 -- 172.21.15.144:0/3341823450 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f8e740ac190 con 0x7f8e8406f130 2024-09-11T23:24:50.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.649+0000 7f8e7a000640 1 --2- 172.21.15.144:0/3341823450 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8e6006c400 0x7f8e6006e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:50.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.649+0000 7f8e7a000640 1 --2- 172.21.15.144:0/3341823450 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8e6006c400 0x7f8e6006e8c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8e84150c70 tx=0x7f8e6c007950 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:50.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.653+0000 7f8e7be00640 1 -- 172.21.15.144:0/3341823450 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e84155a10 con 0x7f8e8406f130 2024-09-11T23:24:50.853 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.853+0000 7f8e89e00640 1 -- 172.21.15.144:0/3341823450 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7f8e840ce200 con 0x7f8e6006c400 2024-09-11T23:24:50.855 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:50.856+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:50.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:50.856+0000 7f8e7be00640 1 -- 172.21.15.144:0/3341823450 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f8e840ce200 con 0x7f8e6006c400 2024-09-11T23:24:50.856 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:50.864 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:50.865 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume resize non_existent_subvolume subvolname_1 inf 2024-09-11T23:24:51.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.022+0000 7fcf6ca00640 1 Processor -- start 2024-09-11T23:24:51.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.022+0000 7fcf6ca00640 1 -- start start 2024-09-11T23:24:51.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.023+0000 7fcf6ca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf680ce500 0x7fcf680715c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:51.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.023+0000 7fcf6ca00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf6815b5b0 con 0x7fcf680ce090 2024-09-11T23:24:51.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.023+0000 7fcf6ca00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf680ce990 con 0x7fcf6815b1d0 2024-09-11T23:24:51.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.023+0000 7fcf6ca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcf680b21b0 con 0x7fcf680ce500 2024-09-11T23:24:51.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.023+0000 7fcf66a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fcf680ce090 0x7fcf68070eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39680/0 (socket says 172.21.15.144:39680) 2024-09-11T23:24:51.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.023+0000 7fcf66a00640 1 -- 172.21.15.144:0/2611837203 learned_addr learned my addr 172.21.15.144:0/2611837203 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:51.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.024+0000 7fcf67e00640 1 --2- 172.21.15.144:0/2611837203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf680ce500 0x7fcf680715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:51.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.024+0000 7fcf66000640 1 -- 172.21.15.144:0/2611837203 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2163863177 0 0) 0x7fcf6815b5b0 con 0x7fcf680ce090 2024-09-11T23:24:51.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.024+0000 7fcf66000640 1 -- 172.21.15.144:0/2611837203 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf4c005730 con 0x7fcf680ce090 2024-09-11T23:24:51.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.024+0000 7fcf66000640 1 -- 172.21.15.144:0/2611837203 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3880945045 0 0) 0x7fcf680ce990 con 0x7fcf6815b1d0 2024-09-11T23:24:51.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.024+0000 7fcf66000640 1 -- 172.21.15.144:0/2611837203 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf6815b5b0 con 0x7fcf6815b1d0 2024-09-11T23:24:51.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.024+0000 7fcf66000640 1 -- 172.21.15.144:0/2611837203 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3105120933 0 0) 0x7fcf4c005730 con 0x7fcf680ce090 2024-09-11T23:24:51.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.024+0000 7fcf66000640 1 -- 172.21.15.144:0/2611837203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf680ce500 msgr2=0x7fcf680715c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:51.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.024+0000 7fcf66000640 1 --2- 172.21.15.144:0/2611837203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf680ce500 0x7fcf680715c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:51.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.024+0000 7fcf66000640 1 -- 172.21.15.144:0/2611837203 >> v1:172.21.15.165:6789/0 conn(0x7fcf6815b1d0 legacy=0x7fcf680b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:51.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.024+0000 7fcf66000640 1 -- 172.21.15.144:0/2611837203 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf680b4800 con 0x7fcf680ce090 2024-09-11T23:24:51.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.024+0000 7fcf66000640 1 -- 172.21.15.144:0/2611837203 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fcf54001670 con 0x7fcf680ce090 2024-09-11T23:24:51.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.024+0000 7fcf66000640 1 -- 172.21.15.144:0/2611837203 >> v1:172.21.15.144:6789/0 conn(0x7fcf680ce090 legacy=0x7fcf68070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:51.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.024+0000 7fcf66000640 1 --2- 172.21.15.144:0/2611837203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf4c005d80 0x7fcf4c006180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:51.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.024+0000 7fcf66000640 1 --2- 172.21.15.144:0/2611837203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf4c006a10 0x7fcf4c006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:51.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.024+0000 7fcf66000640 1 --2- 172.21.15.144:0/2611837203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf680ce500 0x7fcf4c0073f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:51.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.024+0000 7fcf66000640 1 -- 172.21.15.144:0/2611837203 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c00dcb0 con 0x7fcf4c006a10 2024-09-11T23:24:51.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.024+0000 7fcf66000640 1 -- 172.21.15.144:0/2611837203 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c00de60 con 0x7fcf4c005d80 2024-09-11T23:24:51.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.024+0000 7fcf66000640 1 -- 172.21.15.144:0/2611837203 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcf4c00e060 con 0x7fcf680ce500 2024-09-11T23:24:51.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.025+0000 7fcf66a00640 1 --2- 172.21.15.144:0/2611837203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf4c006a10 0x7fcf4c006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:51.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.025+0000 7fcf67e00640 1 --2- 172.21.15.144:0/2611837203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf680ce500 0x7fcf4c0073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:51.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.025+0000 7fcf67400640 1 --2- 172.21.15.144:0/2611837203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf4c005d80 0x7fcf4c006180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:51.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.025+0000 7fcf66a00640 1 -- 172.21.15.144:0/2611837203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf680ce500 msgr2=0x7fcf4c0073f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:51.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.025+0000 7fcf66a00640 1 --2- 172.21.15.144:0/2611837203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf680ce500 0x7fcf4c0073f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:51.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.025+0000 7fcf66a00640 1 -- 172.21.15.144:0/2611837203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf4c005d80 msgr2=0x7fcf4c006180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:51.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.025+0000 7fcf66a00640 1 --2- 172.21.15.144:0/2611837203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf4c005d80 0x7fcf4c006180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:51.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.025+0000 7fcf66a00640 1 -- 172.21.15.144:0/2611837203 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf4c005730 con 0x7fcf4c006a10 2024-09-11T23:24:51.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.025+0000 7fcf67e00640 1 --2- 172.21.15.144:0/2611837203 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf680ce500 0x7fcf4c0073f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:51.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.025+0000 7fcf67400640 1 --2- 172.21.15.144:0/2611837203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf4c005d80 0x7fcf4c006180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:51.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.026+0000 7fcf66a00640 1 --2- 172.21.15.144:0/2611837203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf4c006a10 0x7fcf4c006e90 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400c190 tx=0x7fcf4c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5f5248aeaca91a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:51.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.026+0000 7fcf66000640 1 -- 172.21.15.144:0/2611837203 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf54007ce0 con 0x7fcf4c006a10 2024-09-11T23:24:51.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.026+0000 7fcf66000640 1 -- 172.21.15.144:0/2611837203 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf54005ad0 con 0x7fcf4c006a10 2024-09-11T23:24:51.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.026+0000 7fcf66000640 1 -- 172.21.15.144:0/2611837203 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf54007070 con 0x7fcf4c006a10 2024-09-11T23:24:51.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.027+0000 7fcf6ca00640 1 -- 172.21.15.144:0/2611837203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf4c006a10 msgr2=0x7fcf4c006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:51.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.027+0000 7fcf6ca00640 1 --2- 172.21.15.144:0/2611837203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf4c006a10 0x7fcf4c006e90 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400c190 tx=0x7fcf4c007a40 comp rx=0 tx=0).stop 2024-09-11T23:24:51.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.027+0000 7fcf67e00640 1 -- 172.21.15.144:0/2611837203 reap_dead start 2024-09-11T23:24:51.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.027+0000 7fcf6ca00640 1 -- 172.21.15.144:0/2611837203 shutdown_connections 2024-09-11T23:24:51.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.027+0000 7fcf6ca00640 1 -- 172.21.15.144:0/2611837203 >> 172.21.15.144:0/2611837203 conn(0x7fcf6806bba0 msgr2=0x7fcf6806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:51.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.027+0000 7fcf6ca00640 1 -- 172.21.15.144:0/2611837203 shutdown_connections 2024-09-11T23:24:51.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.027+0000 7fcf6ca00640 1 -- 172.21.15.144:0/2611837203 wait complete. 2024-09-11T23:24:51.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.028+0000 7fcf6ca00640 1 Processor -- start 2024-09-11T23:24:51.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.029+0000 7fcf6ca00640 1 -- start start 2024-09-11T23:24:51.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.029+0000 7fcf6ca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf4c006a10 0x7fcf681f76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:51.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.029+0000 7fcf6ca00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf6814eb70 0x7fcf681515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:51.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.030+0000 7fcf6ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf681f48d0 0x7fcf681edc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:51.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.030+0000 7fcf6ca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcf680b50a0 con 0x7fcf681f48d0 2024-09-11T23:24:51.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.030+0000 7fcf6ca00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcf680b4dc0 con 0x7fcf6814eb70 2024-09-11T23:24:51.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.030+0000 7fcf6ca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcf680b5380 con 0x7fcf4c006a10 2024-09-11T23:24:51.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.030+0000 7fcf67e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf681f48d0 0x7fcf681edc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:51.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.030+0000 7fcf67e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf681f48d0 0x7fcf681edc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51172/0 (socket says 172.21.15.144:51172) 2024-09-11T23:24:51.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.030+0000 7fcf67e00640 1 -- 172.21.15.144:0/486459895 learned_addr learned my addr 172.21.15.144:0/486459895 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:51.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.030+0000 7fcf66a00640 1 --2- 172.21.15.144:0/486459895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf6814eb70 0x7fcf681515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:51.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.030+0000 7fcf67400640 1 --2- 172.21.15.144:0/486459895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf4c006a10 0x7fcf681f76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:51.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.030+0000 7fcf67e00640 1 -- 172.21.15.144:0/486459895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf4c006a10 msgr2=0x7fcf681f76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:51.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.030+0000 7fcf67e00640 1 --2- 172.21.15.144:0/486459895 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcf4c006a10 0x7fcf681f76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:51.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.030+0000 7fcf67e00640 1 -- 172.21.15.144:0/486459895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf6814eb70 msgr2=0x7fcf681515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:51.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.030+0000 7fcf67e00640 1 --2- 172.21.15.144:0/486459895 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf6814eb70 0x7fcf681515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:51.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.030+0000 7fcf67e00640 1 -- 172.21.15.144:0/486459895 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf681f40f0 con 0x7fcf681f48d0 2024-09-11T23:24:51.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.031+0000 7fcf67e00640 1 --2- 172.21.15.144:0/486459895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf681f48d0 0x7fcf681edc30 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c006990 tx=0x7fcf60009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:51.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.031+0000 7fcf5f400640 1 -- 172.21.15.144:0/486459895 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6001a030 con 0x7fcf681f48d0 2024-09-11T23:24:51.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.031+0000 7fcf5f400640 1 -- 172.21.15.144:0/486459895 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf60010e80 con 0x7fcf681f48d0 2024-09-11T23:24:51.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.031+0000 7fcf6ca00640 1 -- 172.21.15.144:0/486459895 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf681f7c20 con 0x7fcf681f48d0 2024-09-11T23:24:51.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.031+0000 7fcf5f400640 1 -- 172.21.15.144:0/486459895 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60003bd0 con 0x7fcf681f48d0 2024-09-11T23:24:51.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.031+0000 7fcf6ca00640 1 -- 172.21.15.144:0/486459895 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf681f81d0 con 0x7fcf681f48d0 2024-09-11T23:24:51.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.032+0000 7fcf6ca00640 1 -- 172.21.15.144:0/486459895 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf680b4440 con 0x7fcf681f48d0 2024-09-11T23:24:51.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.033+0000 7fcf5f400640 1 -- 172.21.15.144:0/486459895 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7fcf6001d070 con 0x7fcf681f48d0 2024-09-11T23:24:51.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.034+0000 7fcf5f400640 1 --2- 172.21.15.144:0/486459895 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcf4806c3d0 0x7fcf4806e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:51.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.034+0000 7fcf5f400640 1 -- 172.21.15.144:0/486459895 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7fcf6008bcd0 con 0x7fcf681f48d0 2024-09-11T23:24:51.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.035+0000 7fcf67400640 1 --2- 172.21.15.144:0/486459895 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcf4806c3d0 0x7fcf4806e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:51.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.035+0000 7fcf67400640 1 --2- 172.21.15.144:0/486459895 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcf4806c3d0 0x7fcf4806e890 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcf680b1100 tx=0x7fcf58009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:51.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.038+0000 7fcf5f400640 1 -- 172.21.15.144:0/486459895 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcf600598a0 con 0x7fcf681f48d0 2024-09-11T23:24:51.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.241+0000 7fcf6ca00640 1 -- 172.21.15.144:0/486459895 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume resize", "vol_name": "non_existent_subvolume", "sub_name": "subvolname_1", "new_size": "inf", "target": ["mon-mgr", ""]}) -- 0x7fcf68073e10 con 0x7fcf4806c3d0 2024-09-11T23:24:51.243 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:51.243+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:51.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.244+0000 7fcf5f400640 1 -- 172.21.15.144:0/486459895 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fcf68073e10 con 0x7fcf4806c3d0 2024-09-11T23:24:51.243 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:51.252 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:51.253 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume pin non_existent_subvolume subvolname_1 export 1 2024-09-11T23:24:51.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.410+0000 7f3414000640 1 Processor -- start 2024-09-11T23:24:51.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.411+0000 7f3414000640 1 -- start start 2024-09-11T23:24:51.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.412+0000 7f3414000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f340c0cd920 0x7f340c06d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:51.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.412+0000 7f3414000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f340c15d880 con 0x7f340c0cdd00 2024-09-11T23:24:51.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.412+0000 7f3414000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f340c0b42c0 con 0x7f340c0cffe0 2024-09-11T23:24:51.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.412+0000 7f3414000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f340c0b45a0 con 0x7f340c0cd920 2024-09-11T23:24:51.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.412+0000 7f3410c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f340c0cdd00 0x7f340c0cf8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39682/0 (socket says 172.21.15.144:39682) 2024-09-11T23:24:51.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.412+0000 7f3410c00640 1 -- 172.21.15.144:0/925142568 learned_addr learned my addr 172.21.15.144:0/925142568 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:51.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.412+0000 7f3411600640 1 --2- 172.21.15.144:0/925142568 >> v2:172.21.15.165:3300/0 conn(0x7f340c0cd920 0x7f340c06d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:51.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.413+0000 7f340be00640 1 -- 172.21.15.144:0/925142568 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1913566800 0 0) 0x7f340c15d880 con 0x7f340c0cdd00 2024-09-11T23:24:51.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.413+0000 7f340be00640 1 -- 172.21.15.144:0/925142568 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33f4003520 con 0x7f340c0cdd00 2024-09-11T23:24:51.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.413+0000 7f340be00640 1 -- 172.21.15.144:0/925142568 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1403084366 0 0) 0x7f340c0b42c0 con 0x7f340c0cffe0 2024-09-11T23:24:51.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.413+0000 7f340be00640 1 -- 172.21.15.144:0/925142568 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f340c15d880 con 0x7f340c0cffe0 2024-09-11T23:24:51.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.413+0000 7f3411600640 1 -- 172.21.15.144:0/925142568 >> v1:172.21.15.165:6789/0 conn(0x7f340c0cffe0 legacy=0x7f340c15cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:51.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.413+0000 7f3411600640 1 -- 172.21.15.144:0/925142568 >> v1:172.21.15.144:6789/0 conn(0x7f340c0cdd00 legacy=0x7f340c0cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:51.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.413+0000 7f3411600640 1 -- 172.21.15.144:0/925142568 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340c0b4880 con 0x7f340c0cd920 2024-09-11T23:24:51.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.414+0000 7f3411600640 1 --2- 172.21.15.144:0/925142568 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f340c0cd920 0x7f340c06d080 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f34000097d0 tx=0x7f340002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=235cb427a8fcf17d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:51.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.414+0000 7f340be00640 1 -- 172.21.15.144:0/925142568 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400037070 con 0x7f340c0cd920 2024-09-11T23:24:51.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.414+0000 7f340be00640 1 -- 172.21.15.144:0/925142568 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3400032440 con 0x7f340c0cd920 2024-09-11T23:24:51.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.414+0000 7f340be00640 1 -- 172.21.15.144:0/925142568 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34000327f0 con 0x7f340c0cd920 2024-09-11T23:24:51.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.415+0000 7f3414000640 1 -- 172.21.15.144:0/925142568 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f340c0cd920 msgr2=0x7f340c06d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:51.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.415+0000 7f3414000640 1 --2- 172.21.15.144:0/925142568 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f340c0cd920 0x7f340c06d080 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f34000097d0 tx=0x7f340002a250 comp rx=0 tx=0).stop 2024-09-11T23:24:51.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.415+0000 7f3414000640 1 -- 172.21.15.144:0/925142568 shutdown_connections 2024-09-11T23:24:51.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.415+0000 7f3414000640 1 --2- 172.21.15.144:0/925142568 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f340c0cd920 0x7f340c06d080 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:51.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.415+0000 7f3414000640 1 -- 172.21.15.144:0/925142568 >> 172.21.15.144:0/925142568 conn(0x7f340c06bba0 msgr2=0x7f340c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:51.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.415+0000 7f3414000640 1 -- 172.21.15.144:0/925142568 shutdown_connections 2024-09-11T23:24:51.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.415+0000 7f3414000640 1 -- 172.21.15.144:0/925142568 wait complete. 2024-09-11T23:24:51.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.417+0000 7f3414000640 1 Processor -- start 2024-09-11T23:24:51.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.417+0000 7f3414000640 1 -- start start 2024-09-11T23:24:51.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.418+0000 7f3414000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f340c0cd920 0x7f340c153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:51.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.418+0000 7f3414000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f340c0cdd00 0x7f340c14ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:51.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.418+0000 7f3414000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f340c0cffe0 0x7f340c15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:51.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.418+0000 7f3414000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f340c15d5c0 con 0x7f340c0cd920 2024-09-11T23:24:51.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.418+0000 7f3414000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f340c15d440 con 0x7f340c0cdd00 2024-09-11T23:24:51.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.418+0000 7f3414000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f340c0b4da0 con 0x7f340c0cffe0 2024-09-11T23:24:51.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.418+0000 7f3411600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f340c0cd920 0x7f340c153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:51.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.418+0000 7f3411600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f340c0cd920 0x7f340c153bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51178/0 (socket says 172.21.15.144:51178) 2024-09-11T23:24:51.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.418+0000 7f3411600640 1 -- 172.21.15.144:0/1270249317 learned_addr learned my addr 172.21.15.144:0/1270249317 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:51.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.418+0000 7f3410c00640 1 --2- 172.21.15.144:0/1270249317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f340c0cdd00 0x7f340c14ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:51.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.418+0000 7f3412000640 1 --2- 172.21.15.144:0/1270249317 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f340c0cffe0 0x7f340c15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:51.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.418+0000 7f3411600640 1 -- 172.21.15.144:0/1270249317 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f340c0cffe0 msgr2=0x7f340c15fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:51.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.418+0000 7f3411600640 1 --2- 172.21.15.144:0/1270249317 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f340c0cffe0 0x7f340c15fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:51.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.418+0000 7f3411600640 1 -- 172.21.15.144:0/1270249317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f340c0cdd00 msgr2=0x7f340c14ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:51.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.418+0000 7f3411600640 1 --2- 172.21.15.144:0/1270249317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f340c0cdd00 0x7f340c14ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:51.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.418+0000 7f3411600640 1 -- 172.21.15.144:0/1270249317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340c156280 con 0x7f340c0cd920 2024-09-11T23:24:51.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.419+0000 7f3411600640 1 --2- 172.21.15.144:0/1270249317 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f340c0cd920 0x7f340c153bb0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f3400000c00 tx=0x7f34000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:51.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.419+0000 7f3409600640 1 -- 172.21.15.144:0/1270249317 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400037040 con 0x7f340c0cd920 2024-09-11T23:24:51.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.419+0000 7f3409600640 1 -- 172.21.15.144:0/1270249317 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3400042070 con 0x7f340c0cd920 2024-09-11T23:24:51.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.419+0000 7f3414000640 1 -- 172.21.15.144:0/1270249317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f340c156500 con 0x7f340c0cd920 2024-09-11T23:24:51.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.419+0000 7f3409600640 1 -- 172.21.15.144:0/1270249317 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400006e10 con 0x7f340c0cd920 2024-09-11T23:24:51.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.419+0000 7f3414000640 1 -- 172.21.15.144:0/1270249317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f340c156ac0 con 0x7f340c0cd920 2024-09-11T23:24:51.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.420+0000 7f3414000640 1 -- 172.21.15.144:0/1270249317 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f340c0b5330 con 0x7f340c0cd920 2024-09-11T23:24:51.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.421+0000 7f3409600640 1 -- 172.21.15.144:0/1270249317 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f3400032810 con 0x7f340c0cd920 2024-09-11T23:24:51.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.422+0000 7f3409600640 1 --2- 172.21.15.144:0/1270249317 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f33ec06c3d0 0x7f33ec06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:51.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.422+0000 7f3409600640 1 -- 172.21.15.144:0/1270249317 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f34000ac250 con 0x7f340c0cd920 2024-09-11T23:24:51.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.422+0000 7f3410c00640 1 --2- 172.21.15.144:0/1270249317 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f33ec06c3d0 0x7f33ec06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:51.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.423+0000 7f3410c00640 1 --2- 172.21.15.144:0/1270249317 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f33ec06c3d0 0x7f33ec06e890 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f340c0cc6b0 tx=0x7f33f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:51.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.426+0000 7f3409600640 1 -- 172.21.15.144:0/1270249317 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f340c156280 con 0x7f340c0cd920 2024-09-11T23:24:51.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.631+0000 7f3414000640 1 -- 172.21.15.144:0/1270249317 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume pin", "vol_name": "non_existent_subvolume", "sub_name": "subvolname_1", "pin_type": "export", "pin_setting": "1", "target": ["mon-mgr", ""]}) -- 0x7f340c151180 con 0x7f33ec06c3d0 2024-09-11T23:24:51.632 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:51.632+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:51.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.633+0000 7f3409600640 1 -- 172.21.15.144:0/1270249317 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f340c151180 con 0x7f33ec06c3d0 2024-09-11T23:24:51.633 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:51.642 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:51.643 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls non_existent_subvolume 2024-09-11T23:24:51.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.800+0000 7fa2c5600640 1 Processor -- start 2024-09-11T23:24:51.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.800+0000 7fa2c5600640 1 -- start start 2024-09-11T23:24:51.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.801+0000 7fa2c5600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa2c00b73c0 0x7fa2c00d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:51.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.801+0000 7fa2c5600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c00b7930 con 0x7fa2c006d6e0 2024-09-11T23:24:51.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.801+0000 7fa2c5600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c00b90a0 con 0x7fa2c015e6f0 2024-09-11T23:24:51.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.801+0000 7fa2c5600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa2c00b9380 con 0x7fa2c00b73c0 2024-09-11T23:24:51.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.801+0000 7fa2bfe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa2c006d6e0 0x7fa2c006dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39688/0 (socket says 172.21.15.144:39688) 2024-09-11T23:24:51.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.801+0000 7fa2bfe00640 1 -- 172.21.15.144:0/2590994015 learned_addr learned my addr 172.21.15.144:0/2590994015 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:51.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.801+0000 7fa2c4c00640 1 --2- 172.21.15.144:0/2590994015 >> v2:172.21.15.144:3300/0 conn(0x7fa2c00b73c0 0x7fa2c00d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:51.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.802+0000 7fa2bea00640 1 -- 172.21.15.144:0/2590994015 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1558922127 0 0) 0x7fa2c00b7930 con 0x7fa2c006d6e0 2024-09-11T23:24:51.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.802+0000 7fa2bea00640 1 -- 172.21.15.144:0/2590994015 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2a4003520 con 0x7fa2c006d6e0 2024-09-11T23:24:51.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.802+0000 7fa2c4c00640 1 -- 172.21.15.144:0/2590994015 >> v1:172.21.15.165:6789/0 conn(0x7fa2c015e6f0 legacy=0x7fa2c00d2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:51.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.802+0000 7fa2c4c00640 1 -- 172.21.15.144:0/2590994015 >> v1:172.21.15.144:6789/0 conn(0x7fa2c006d6e0 legacy=0x7fa2c006dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:51.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.802+0000 7fa2bea00640 1 -- 172.21.15.144:0/2590994015 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3475880594 0 0) 0x7fa2c00b90a0 con 0x7fa2c015e6f0 2024-09-11T23:24:51.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.802+0000 7fa2c4c00640 1 -- 172.21.15.144:0/2590994015 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c00d24f0 con 0x7fa2c00b73c0 2024-09-11T23:24:51.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.803+0000 7fa2c4c00640 1 --2- 172.21.15.144:0/2590994015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2c00b73c0 0x7fa2c00d1930 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009d90 tx=0x7fa2b802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459fab3054c259e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:51.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.803+0000 7fa2bea00640 1 -- 172.21.15.144:0/2590994015 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8007740 con 0x7fa2c00b73c0 2024-09-11T23:24:51.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.803+0000 7fa2bea00640 1 -- 172.21.15.144:0/2590994015 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2b80078e0 con 0x7fa2c00b73c0 2024-09-11T23:24:51.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.803+0000 7fa2bea00640 1 -- 172.21.15.144:0/2590994015 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8007cb0 con 0x7fa2c00b73c0 2024-09-11T23:24:51.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.804+0000 7fa2c5600640 1 -- 172.21.15.144:0/2590994015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2c00b73c0 msgr2=0x7fa2c00d1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:51.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.804+0000 7fa2c5600640 1 --2- 172.21.15.144:0/2590994015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2c00b73c0 0x7fa2c00d1930 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009d90 tx=0x7fa2b802a6f0 comp rx=0 tx=0).stop 2024-09-11T23:24:51.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.804+0000 7fa2c5600640 1 -- 172.21.15.144:0/2590994015 shutdown_connections 2024-09-11T23:24:51.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.804+0000 7fa2c5600640 1 --2- 172.21.15.144:0/2590994015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2c00b73c0 0x7fa2c00d1930 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:51.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.804+0000 7fa2c5600640 1 -- 172.21.15.144:0/2590994015 >> 172.21.15.144:0/2590994015 conn(0x7fa2c00d4970 msgr2=0x7fa2c00d4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:51.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.804+0000 7fa2c5600640 1 -- 172.21.15.144:0/2590994015 shutdown_connections 2024-09-11T23:24:51.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.804+0000 7fa2c5600640 1 -- 172.21.15.144:0/2590994015 wait complete. 2024-09-11T23:24:51.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.805+0000 7fa2c5600640 1 Processor -- start 2024-09-11T23:24:51.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.805+0000 7fa2c5600640 1 -- start start 2024-09-11T23:24:51.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.806+0000 7fa2c5600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2c006d6e0 0x7fa2c006c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:51.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.806+0000 7fa2c5600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2c00b73c0 0x7fa2c0152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:51.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.806+0000 7fa2c5600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2c015e6f0 0x7fa2c0152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:51.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.806+0000 7fa2c5600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c00d32a0 con 0x7fa2c015e6f0 2024-09-11T23:24:51.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.806+0000 7fa2c5600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c00d3120 con 0x7fa2c00b73c0 2024-09-11T23:24:51.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.806+0000 7fa2c5600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa2c00d3420 con 0x7fa2c006d6e0 2024-09-11T23:24:51.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.806+0000 7fa2c4c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2c015e6f0 0x7fa2c0152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:51.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.807+0000 7fa2c4c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2c015e6f0 0x7fa2c0152a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51204/0 (socket says 172.21.15.144:51204) 2024-09-11T23:24:51.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.807+0000 7fa2c4c00640 1 -- 172.21.15.144:0/4098626436 learned_addr learned my addr 172.21.15.144:0/4098626436 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:51.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.807+0000 7fa2bf400640 1 --2- 172.21.15.144:0/4098626436 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2c00b73c0 0x7fa2c0152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:51.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.807+0000 7fa2bfe00640 1 --2- 172.21.15.144:0/4098626436 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2c006d6e0 0x7fa2c006c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:51.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.807+0000 7fa2c4c00640 1 -- 172.21.15.144:0/4098626436 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2c006d6e0 msgr2=0x7fa2c006c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:51.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.807+0000 7fa2c4c00640 1 --2- 172.21.15.144:0/4098626436 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2c006d6e0 0x7fa2c006c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:51.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.807+0000 7fa2c4c00640 1 -- 172.21.15.144:0/4098626436 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2c00b73c0 msgr2=0x7fa2c0152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:51.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.807+0000 7fa2c4c00640 1 --2- 172.21.15.144:0/4098626436 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa2c00b73c0 0x7fa2c0152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:51.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.807+0000 7fa2c4c00640 1 -- 172.21.15.144:0/4098626436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c0160830 con 0x7fa2c015e6f0 2024-09-11T23:24:51.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.807+0000 7fa2c4c00640 1 --2- 172.21.15.144:0/4098626436 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2c015e6f0 0x7fa2c0152a90 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009eb0 tx=0x7fa2b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:51.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.807+0000 7fa2b7e00640 1 -- 172.21.15.144:0/4098626436 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8040070 con 0x7fa2c015e6f0 2024-09-11T23:24:51.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.807+0000 7fa2b7e00640 1 -- 172.21.15.144:0/4098626436 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2b8031bc0 con 0x7fa2c015e6f0 2024-09-11T23:24:51.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.807+0000 7fa2b7e00640 1 -- 172.21.15.144:0/4098626436 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b8009450 con 0x7fa2c015e6f0 2024-09-11T23:24:51.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.808+0000 7fa2c5600640 1 -- 172.21.15.144:0/4098626436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2c0160b10 con 0x7fa2c015e6f0 2024-09-11T23:24:51.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.808+0000 7fa2c5600640 1 -- 172.21.15.144:0/4098626436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2c01610d0 con 0x7fa2c015e6f0 2024-09-11T23:24:51.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.809+0000 7fa2c5600640 1 -- 172.21.15.144:0/4098626436 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2c00d1930 con 0x7fa2c015e6f0 2024-09-11T23:24:51.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.809+0000 7fa2b7e00640 1 -- 172.21.15.144:0/4098626436 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7fa2b8039040 con 0x7fa2c015e6f0 2024-09-11T23:24:51.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.811+0000 7fa2b7e00640 1 --2- 172.21.15.144:0/4098626436 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa2a006c3d0 0x7fa2a006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:51.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.811+0000 7fa2b7e00640 1 -- 172.21.15.144:0/4098626436 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7fa2b80acb40 con 0x7fa2c015e6f0 2024-09-11T23:24:51.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.811+0000 7fa2bfe00640 1 --2- 172.21.15.144:0/4098626436 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa2a006c3d0 0x7fa2a006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:51.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.812+0000 7fa2bfe00640 1 --2- 172.21.15.144:0/4098626436 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa2a006c3d0 0x7fa2a006e890 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0007fd0 tx=0x7fa2b0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:51.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:51.815+0000 7fa2b7e00640 1 -- 172.21.15.144:0/4098626436 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa2b807a4e0 con 0x7fa2c015e6f0 2024-09-11T23:24:52.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.016+0000 7fa2c5600640 1 -- 172.21.15.144:0/4098626436 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "non_existent_subvolume", "target": ["mon-mgr", ""]}) -- 0x7fa2c006de40 con 0x7fa2a006c3d0 2024-09-11T23:24:52.017 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:52.017+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:52.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.018+0000 7fa2b7e00640 1 -- 172.21.15.144:0/4098626436 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fa2c006de40 con 0x7fa2a006c3d0 2024-09-11T23:24:52.018 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:52.028 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:52.029 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create non_existent_subvolume subvolume_1 snapshot_1 2024-09-11T23:24:52.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.188+0000 7f5acbe00640 1 Processor -- start 2024-09-11T23:24:52.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.188+0000 7f5acbe00640 1 -- start start 2024-09-11T23:24:52.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.189+0000 7f5acbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5acc0ce090 0x7f5acc0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:52.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.189+0000 7f5acbe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5acc070eb0 0x7f5acc071300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:52.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.189+0000 7f5acbe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5acc15b5b0 con 0x7f5acc15b1d0 2024-09-11T23:24:52.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.189+0000 7f5acbe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5acc0cea40 con 0x7f5acc0ce090 2024-09-11T23:24:52.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.189+0000 7f5acbe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5acc0b21b0 con 0x7f5acc070eb0 2024-09-11T23:24:52.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.189+0000 7f5aca000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5acc0ce090 0x7f5acc0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:52.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.190+0000 7f5aca000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5acc0ce090 0x7f5acc0ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51214/0 (socket says 172.21.15.144:51214) 2024-09-11T23:24:52.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.190+0000 7f5aca000640 1 -- 172.21.15.144:0/3966784093 learned_addr learned my addr 172.21.15.144:0/3966784093 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:52.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.190+0000 7f5acb400640 1 --2- 172.21.15.144:0/3966784093 >> v2:172.21.15.165:3300/0 conn(0x7f5acc070eb0 0x7f5acc071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:52.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.190+0000 7f5aca000640 1 -- 172.21.15.144:0/3966784093 >> v2:172.21.15.165:3300/0 conn(0x7f5acc070eb0 msgr2=0x7f5acc071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:52.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.190+0000 7f5aca000640 1 --2- 172.21.15.144:0/3966784093 >> v2:172.21.15.165:3300/0 conn(0x7f5acc070eb0 0x7f5acc071300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:52.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.190+0000 7f5aca000640 1 -- 172.21.15.144:0/3966784093 >> v1:172.21.15.165:6789/0 conn(0x7f5acc15b1d0 legacy=0x7f5acc0b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:52.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.190+0000 7f5aca000640 1 -- 172.21.15.144:0/3966784093 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5acc0b4800 con 0x7f5acc0ce090 2024-09-11T23:24:52.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.191+0000 7f5aca000640 1 --2- 172.21.15.144:0/3966784093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5acc0ce090 0x7f5acc0ce500 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f5acc06eeb0 tx=0x7f5ab802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea40450019e6b46b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:52.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.191+0000 7f5ac9600640 1 -- 172.21.15.144:0/3966784093 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8037070 con 0x7f5acc0ce090 2024-09-11T23:24:52.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.191+0000 7f5ac9600640 1 -- 172.21.15.144:0/3966784093 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab8032440 con 0x7f5acc0ce090 2024-09-11T23:24:52.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.191+0000 7f5ac9600640 1 -- 172.21.15.144:0/3966784093 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8032810 con 0x7f5acc0ce090 2024-09-11T23:24:52.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.192+0000 7f5acbe00640 1 -- 172.21.15.144:0/3966784093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5acc0ce090 msgr2=0x7f5acc0ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:52.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.192+0000 7f5acbe00640 1 --2- 172.21.15.144:0/3966784093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5acc0ce090 0x7f5acc0ce500 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f5acc06eeb0 tx=0x7f5ab802a1a0 comp rx=0 tx=0).stop 2024-09-11T23:24:52.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.192+0000 7f5acbe00640 1 -- 172.21.15.144:0/3966784093 shutdown_connections 2024-09-11T23:24:52.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.192+0000 7f5acbe00640 1 --2- 172.21.15.144:0/3966784093 >> v2:172.21.15.165:3300/0 conn(0x7f5acc070eb0 0x7f5acc071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:52.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.192+0000 7f5acbe00640 1 --2- 172.21.15.144:0/3966784093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5acc0ce090 0x7f5acc0ce500 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:52.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.192+0000 7f5acbe00640 1 -- 172.21.15.144:0/3966784093 >> 172.21.15.144:0/3966784093 conn(0x7f5acc06bba0 msgr2=0x7f5acc06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:52.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.192+0000 7f5acbe00640 1 -- 172.21.15.144:0/3966784093 shutdown_connections 2024-09-11T23:24:52.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.192+0000 7f5acbe00640 1 -- 172.21.15.144:0/3966784093 wait complete. 2024-09-11T23:24:52.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.194+0000 7f5acbe00640 1 Processor -- start 2024-09-11T23:24:52.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.194+0000 7f5acbe00640 1 -- start start 2024-09-11T23:24:52.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.195+0000 7f5acbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5acc070eb0 0x7f5acc1542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:52.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.195+0000 7f5acbe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5acc0ce090 0x7f5acc15da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.195+0000 7f5acbe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5acc15b1d0 0x7f5acc147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.195+0000 7f5acbe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5acc0b50a0 con 0x7f5acc070eb0 2024-09-11T23:24:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.195+0000 7f5acbe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5acc0b4dc0 con 0x7f5acc15b1d0 2024-09-11T23:24:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.195+0000 7f5acbe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5acc0b5380 con 0x7f5acc0ce090 2024-09-11T23:24:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.195+0000 7f5acaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5acc070eb0 0x7f5acc1542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.195+0000 7f5acaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5acc070eb0 0x7f5acc1542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51228/0 (socket says 172.21.15.144:51228) 2024-09-11T23:24:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.195+0000 7f5acaa00640 1 -- 172.21.15.144:0/2963871887 learned_addr learned my addr 172.21.15.144:0/2963871887 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.195+0000 7f5aca000640 1 --2- 172.21.15.144:0/2963871887 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5acc0ce090 0x7f5acc15da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.195+0000 7f5acb400640 1 --2- 172.21.15.144:0/2963871887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5acc15b1d0 0x7f5acc147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.195+0000 7f5acaa00640 1 -- 172.21.15.144:0/2963871887 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5acc0ce090 msgr2=0x7f5acc15da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.195+0000 7f5acaa00640 1 --2- 172.21.15.144:0/2963871887 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5acc0ce090 0x7f5acc15da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.195+0000 7f5acaa00640 1 -- 172.21.15.144:0/2963871887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5acc15b1d0 msgr2=0x7f5acc147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:52.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.195+0000 7f5acaa00640 1 --2- 172.21.15.144:0/2963871887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5acc15b1d0 0x7f5acc147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.195+0000 7f5acaa00640 1 -- 172.21.15.144:0/2963871887 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5acc153200 con 0x7f5acc070eb0 2024-09-11T23:24:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.195+0000 7f5acb400640 1 --2- 172.21.15.144:0/2963871887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5acc15b1d0 0x7f5acc147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.196+0000 7f5acaa00640 1 --2- 172.21.15.144:0/2963871887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5acc070eb0 0x7f5acc1542a0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f5abc00c430 tx=0x7f5abc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.196+0000 7f5ac2a00640 1 -- 172.21.15.144:0/2963871887 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc011790 con 0x7f5acc070eb0 2024-09-11T23:24:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.196+0000 7f5ac2a00640 1 -- 172.21.15.144:0/2963871887 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5abc017070 con 0x7f5acc070eb0 2024-09-11T23:24:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.196+0000 7f5ac2a00640 1 -- 172.21.15.144:0/2963871887 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc011bb0 con 0x7f5acc070eb0 2024-09-11T23:24:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.196+0000 7f5acbe00640 1 -- 172.21.15.144:0/2963871887 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5acc1534e0 con 0x7f5acc070eb0 2024-09-11T23:24:52.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.196+0000 7f5acbe00640 1 -- 172.21.15.144:0/2963871887 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5acc153aa0 con 0x7f5acc070eb0 2024-09-11T23:24:52.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.197+0000 7f5acbe00640 1 -- 172.21.15.144:0/2963871887 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5acc0b4440 con 0x7f5acc070eb0 2024-09-11T23:24:52.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.198+0000 7f5ac2a00640 1 -- 172.21.15.144:0/2963871887 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f5abc01c460 con 0x7f5acc070eb0 2024-09-11T23:24:52.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.199+0000 7f5ac2a00640 1 --2- 172.21.15.144:0/2963871887 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5aac06c3d0 0x7f5aac06e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:52.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.199+0000 7f5ac2a00640 1 -- 172.21.15.144:0/2963871887 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f5abc08b670 con 0x7f5acc070eb0 2024-09-11T23:24:52.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.199+0000 7f5aca000640 1 --2- 172.21.15.144:0/2963871887 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5aac06c3d0 0x7f5aac06e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:52.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.200+0000 7f5aca000640 1 --2- 172.21.15.144:0/2963871887 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5aac06c3d0 0x7f5aac06e890 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8034000 tx=0x7f5ab802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:52.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.203+0000 7f5ac2a00640 1 -- 172.21.15.144:0/2963871887 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5abc059800 con 0x7f5acc070eb0 2024-09-11T23:24:52.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.405+0000 7f5acbe00640 1 -- 172.21.15.144:0/2963871887 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f5acc155740 con 0x7f5aac06c3d0 2024-09-11T23:24:52.407 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:52.407+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:52.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.408+0000 7f5ac2a00640 1 -- 172.21.15.144:0/2963871887 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f5acc155740 con 0x7f5aac06c3d0 2024-09-11T23:24:52.407 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:52.417 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:52.417 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm non_existent_subvolume subvolume_1 snapshot_1 2024-09-11T23:24:52.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.577+0000 7fb653200640 1 Processor -- start 2024-09-11T23:24:52.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.578+0000 7fb653200640 1 -- start start 2024-09-11T23:24:52.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.579+0000 7fb653200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb65415b290 0x7fb65415c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:52.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.579+0000 7fb653200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb6540b4680 0x7fb65415e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:52.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.579+0000 7fb653200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb65415e8a0 0x7fb6540b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:52.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.579+0000 7fb653200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb654070f80 con 0x7fb65415b290 2024-09-11T23:24:52.579 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.579+0000 7fb653200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb65415b670 con 0x7fb6540b4680 2024-09-11T23:24:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.579+0000 7fb653200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb65415d2c0 con 0x7fb65415e8a0 2024-09-11T23:24:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.579+0000 7fb651e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb65415b290 0x7fb65415c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.579+0000 7fb651e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb65415b290 0x7fb65415c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51236/0 (socket says 172.21.15.144:51236) 2024-09-11T23:24:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.579+0000 7fb651e00640 1 -- 172.21.15.144:0/1441784652 learned_addr learned my addr 172.21.15.144:0/1441784652 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.579+0000 7fb649400640 1 --2- 172.21.15.144:0/1441784652 >> v2:172.21.15.165:3300/0 conn(0x7fb6540b4680 0x7fb65415e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.579+0000 7fb652800640 1 --2- 172.21.15.144:0/1441784652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb65415e8a0 0x7fb6540b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.579+0000 7fb651e00640 1 -- 172.21.15.144:0/1441784652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb65415e8a0 msgr2=0x7fb6540b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.579+0000 7fb651e00640 1 --2- 172.21.15.144:0/1441784652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb65415e8a0 0x7fb6540b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.579+0000 7fb651e00640 1 -- 172.21.15.144:0/1441784652 >> v2:172.21.15.165:3300/0 conn(0x7fb6540b4680 msgr2=0x7fb65415e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.579+0000 7fb651e00640 1 --2- 172.21.15.144:0/1441784652 >> v2:172.21.15.165:3300/0 conn(0x7fb6540b4680 0x7fb65415e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.579+0000 7fb651e00640 1 -- 172.21.15.144:0/1441784652 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65415d5a0 con 0x7fb65415b290 2024-09-11T23:24:52.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.580+0000 7fb649400640 1 --2- 172.21.15.144:0/1441784652 >> v2:172.21.15.165:3300/0 conn(0x7fb6540b4680 0x7fb65415e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:52.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.580+0000 7fb651e00640 1 --2- 172.21.15.144:0/1441784652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb65415b290 0x7fb65415c950 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fb65415d4d0 tx=0x7fb64402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4988bfe23bb96f5a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:52.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.581+0000 7fb651400640 1 -- 172.21.15.144:0/1441784652 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644037070 con 0x7fb65415b290 2024-09-11T23:24:52.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.581+0000 7fb651400640 1 -- 172.21.15.144:0/1441784652 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb644032440 con 0x7fb65415b290 2024-09-11T23:24:52.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.581+0000 7fb651400640 1 -- 172.21.15.144:0/1441784652 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644032810 con 0x7fb65415b290 2024-09-11T23:24:52.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.581+0000 7fb653200640 1 -- 172.21.15.144:0/1441784652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb65415b290 msgr2=0x7fb65415c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:52.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.581+0000 7fb653200640 1 --2- 172.21.15.144:0/1441784652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb65415b290 0x7fb65415c950 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fb65415d4d0 tx=0x7fb64402a1c0 comp rx=0 tx=0).stop 2024-09-11T23:24:52.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.581+0000 7fb653200640 1 -- 172.21.15.144:0/1441784652 shutdown_connections 2024-09-11T23:24:52.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.581+0000 7fb653200640 1 --2- 172.21.15.144:0/1441784652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb65415e8a0 0x7fb6540b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:52.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.581+0000 7fb653200640 1 --2- 172.21.15.144:0/1441784652 >> v2:172.21.15.165:3300/0 conn(0x7fb6540b4680 0x7fb65415e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:52.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.581+0000 7fb653200640 1 --2- 172.21.15.144:0/1441784652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb65415b290 0x7fb65415c950 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:52.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.581+0000 7fb653200640 1 -- 172.21.15.144:0/1441784652 >> 172.21.15.144:0/1441784652 conn(0x7fb65406bba0 msgr2=0x7fb65406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:52.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.581+0000 7fb653200640 1 -- 172.21.15.144:0/1441784652 shutdown_connections 2024-09-11T23:24:52.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.582+0000 7fb653200640 1 -- 172.21.15.144:0/1441784652 wait complete. 2024-09-11T23:24:52.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.583+0000 7fb653200640 1 Processor -- start 2024-09-11T23:24:52.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.583+0000 7fb653200640 1 -- start start 2024-09-11T23:24:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.584+0000 7fb653200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6540b4680 0x7fb654157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.584+0000 7fb653200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb65415b290 0x7fb65414e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.584+0000 7fb653200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb65414e130 0x7fb6541501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.584+0000 7fb653200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb65415de40 con 0x7fb6540b4680 2024-09-11T23:24:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.584+0000 7fb653200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb65415db60 con 0x7fb65414e130 2024-09-11T23:24:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.584+0000 7fb653200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb65415ce90 con 0x7fb65415b290 2024-09-11T23:24:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.584+0000 7fb651e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6540b4680 0x7fb654157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.585+0000 7fb651e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6540b4680 0x7fb654157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51244/0 (socket says 172.21.15.144:51244) 2024-09-11T23:24:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.585+0000 7fb651e00640 1 -- 172.21.15.144:0/4244892111 learned_addr learned my addr 172.21.15.144:0/4244892111 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.585+0000 7fb652800640 1 --2- 172.21.15.144:0/4244892111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb65414e130 0x7fb6541501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:52.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.585+0000 7fb649400640 1 --2- 172.21.15.144:0/4244892111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb65415b290 0x7fb65414e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.585+0000 7fb651e00640 1 -- 172.21.15.144:0/4244892111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb65415b290 msgr2=0x7fb65414e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.585+0000 7fb651e00640 1 --2- 172.21.15.144:0/4244892111 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb65415b290 0x7fb65414e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.585+0000 7fb651e00640 1 -- 172.21.15.144:0/4244892111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb65414e130 msgr2=0x7fb6541501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.585+0000 7fb651e00640 1 --2- 172.21.15.144:0/4244892111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb65414e130 0x7fb6541501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.585+0000 7fb651e00640 1 -- 172.21.15.144:0/4244892111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65414f100 con 0x7fb6540b4680 2024-09-11T23:24:52.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.585+0000 7fb651e00640 1 --2- 172.21.15.144:0/4244892111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6540b4680 0x7fb654157410 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fb64402a200 tx=0x7fb6440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.585+0000 7fb64aa00640 1 -- 172.21.15.144:0/4244892111 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644041020 con 0x7fb6540b4680 2024-09-11T23:24:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.586+0000 7fb64aa00640 1 -- 172.21.15.144:0/4244892111 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6440306c0 con 0x7fb6540b4680 2024-09-11T23:24:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.586+0000 7fb653200640 1 -- 172.21.15.144:0/4244892111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb65414f3e0 con 0x7fb6540b4680 2024-09-11T23:24:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.586+0000 7fb64aa00640 1 -- 172.21.15.144:0/4244892111 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644037040 con 0x7fb6540b4680 2024-09-11T23:24:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.586+0000 7fb653200640 1 -- 172.21.15.144:0/4244892111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb65414f9a0 con 0x7fb6540b4680 2024-09-11T23:24:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.587+0000 7fb653200640 1 -- 172.21.15.144:0/4244892111 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb65415e360 con 0x7fb6540b4680 2024-09-11T23:24:52.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.588+0000 7fb64aa00640 1 -- 172.21.15.144:0/4244892111 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7fb644044020 con 0x7fb6540b4680 2024-09-11T23:24:52.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.588+0000 7fb64aa00640 1 --2- 172.21.15.144:0/4244892111 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb63006c400 0x7fb63006e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:52.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.589+0000 7fb64aa00640 1 -- 172.21.15.144:0/4244892111 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7fb6440ac180 con 0x7fb6540b4680 2024-09-11T23:24:52.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.589+0000 7fb649400640 1 --2- 172.21.15.144:0/4244892111 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb63006c400 0x7fb63006e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:52.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.590+0000 7fb649400640 1 --2- 172.21.15.144:0/4244892111 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb63006c400 0x7fb63006e8c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb63c006fd0 tx=0x7fb63c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:52.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.593+0000 7fb64aa00640 1 -- 172.21.15.144:0/4244892111 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb64404b030 con 0x7fb6540b4680 2024-09-11T23:24:52.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.798+0000 7fb653200640 1 -- 172.21.15.144:0/4244892111 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7fb65415c3a0 con 0x7fb63006c400 2024-09-11T23:24:52.799 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:52.799+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:52.800 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.800+0000 7fb64aa00640 1 -- 172.21.15.144:0/4244892111 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fb65415c3a0 con 0x7fb63006c400 2024-09-11T23:24:52.800 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:52.810 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:52.811 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot info non_existent_subvolume subvolume_1 snapshot_1 2024-09-11T23:24:52.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.971+0000 7f4af9800640 1 Processor -- start 2024-09-11T23:24:52.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.971+0000 7f4af9800640 1 -- start start 2024-09-11T23:24:52.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.972+0000 7f4af9800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4af406f070 0x7f4af415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:52.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.973+0000 7f4af9800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4af415bb70 con 0x7f4af4158a90 2024-09-11T23:24:52.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.973+0000 7f4af9800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4af415be10 con 0x7f4af406ec90 2024-09-11T23:24:52.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.973+0000 7f4af9800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4af415c0f0 con 0x7f4af406f070 2024-09-11T23:24:52.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.973+0000 7f4af3400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4af4158a90 0x7f4af40ce600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39698/0 (socket says 172.21.15.144:39698) 2024-09-11T23:24:52.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.973+0000 7f4af3400640 1 -- 172.21.15.144:0/321468937 learned_addr learned my addr 172.21.15.144:0/321468937 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:52.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.973+0000 7f4af2000640 1 --2- 172.21.15.144:0/321468937 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4af406f070 0x7f4af415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:52.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.973+0000 7f4af1600640 1 -- 172.21.15.144:0/321468937 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 959274008 0 0) 0x7f4af415bb70 con 0x7f4af4158a90 2024-09-11T23:24:52.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.973+0000 7f4af1600640 1 -- 172.21.15.144:0/321468937 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ad8003520 con 0x7f4af4158a90 2024-09-11T23:24:52.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.973+0000 7f4af1600640 1 -- 172.21.15.144:0/321468937 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3322056222 0 0) 0x7f4af415be10 con 0x7f4af406ec90 2024-09-11T23:24:52.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.974+0000 7f4af1600640 1 -- 172.21.15.144:0/321468937 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4af415bb70 con 0x7f4af406ec90 2024-09-11T23:24:52.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.974+0000 7f4af2000640 1 -- 172.21.15.144:0/321468937 >> v1:172.21.15.165:6789/0 conn(0x7f4af406ec90 legacy=0x7f4af40cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:52.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.974+0000 7f4af1600640 1 -- 172.21.15.144:0/321468937 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3356882317 0 0) 0x7f4ad8003520 con 0x7f4af4158a90 2024-09-11T23:24:52.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.974+0000 7f4af2000640 1 -- 172.21.15.144:0/321468937 >> v1:172.21.15.144:6789/0 conn(0x7f4af4158a90 legacy=0x7f4af40ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:52.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.974+0000 7f4af2000640 1 -- 172.21.15.144:0/321468937 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af415c3d0 con 0x7f4af406f070 2024-09-11T23:24:52.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.975+0000 7f4af2000640 1 --2- 172.21.15.144:0/321468937 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4af406f070 0x7f4af415fab0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00097d0 tx=0x7f4ae002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cd448b136909981 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:52.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.975+0000 7f4af1600640 1 -- 172.21.15.144:0/321468937 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0037070 con 0x7f4af406f070 2024-09-11T23:24:52.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.975+0000 7f4af1600640 1 -- 172.21.15.144:0/321468937 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae002ab90 con 0x7f4af406f070 2024-09-11T23:24:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.975+0000 7f4af1600640 1 -- 172.21.15.144:0/321468937 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0019f0 con 0x7f4af406f070 2024-09-11T23:24:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.975+0000 7f4af9800640 1 -- 172.21.15.144:0/321468937 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4af406f070 msgr2=0x7f4af415fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.975+0000 7f4af9800640 1 --2- 172.21.15.144:0/321468937 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4af406f070 0x7f4af415fab0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00097d0 tx=0x7f4ae002a100 comp rx=0 tx=0).stop 2024-09-11T23:24:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.976+0000 7f4af9800640 1 -- 172.21.15.144:0/321468937 shutdown_connections 2024-09-11T23:24:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.976+0000 7f4af9800640 1 --2- 172.21.15.144:0/321468937 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4af406f070 0x7f4af415fab0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.976+0000 7f4af9800640 1 -- 172.21.15.144:0/321468937 >> 172.21.15.144:0/321468937 conn(0x7f4af406bba0 msgr2=0x7f4af406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.976+0000 7f4af9800640 1 -- 172.21.15.144:0/321468937 shutdown_connections 2024-09-11T23:24:52.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.976+0000 7f4af9800640 1 -- 172.21.15.144:0/321468937 wait complete. 2024-09-11T23:24:52.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.977+0000 7f4af9800640 1 Processor -- start 2024-09-11T23:24:52.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.977+0000 7f4af9800640 1 -- start start 2024-09-11T23:24:52.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.978+0000 7f4af9800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4af406ec90 0x7f4af40b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:52.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.978+0000 7f4af9800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4af406f070 0x7f4af415cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:52.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.978+0000 7f4af9800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4af4158a90 0x7f4af4153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:52.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.978+0000 7f4af9800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4af41590a0 con 0x7f4af406ec90 2024-09-11T23:24:52.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.978+0000 7f4af9800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4af4158f20 con 0x7f4af406f070 2024-09-11T23:24:52.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.978+0000 7f4af9800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4af4159220 con 0x7f4af4158a90 2024-09-11T23:24:52.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.979+0000 7f4af2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4af406ec90 0x7f4af40b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:52.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.979+0000 7f4af2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4af406ec90 0x7f4af40b2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51250/0 (socket says 172.21.15.144:51250) 2024-09-11T23:24:52.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.979+0000 7f4af2a00640 1 -- 172.21.15.144:0/1921376503 learned_addr learned my addr 172.21.15.144:0/1921376503 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:52.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.979+0000 7f4af3400640 1 --2- 172.21.15.144:0/1921376503 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4af4158a90 0x7f4af4153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:52.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.979+0000 7f4af2000640 1 --2- 172.21.15.144:0/1921376503 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4af406f070 0x7f4af415cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:52.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.979+0000 7f4af2a00640 1 -- 172.21.15.144:0/1921376503 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4af4158a90 msgr2=0x7f4af4153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:52.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.979+0000 7f4af2a00640 1 --2- 172.21.15.144:0/1921376503 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4af4158a90 0x7f4af4153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:52.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.979+0000 7f4af2a00640 1 -- 172.21.15.144:0/1921376503 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4af406f070 msgr2=0x7f4af415cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:52.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.979+0000 7f4af2a00640 1 --2- 172.21.15.144:0/1921376503 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4af406f070 0x7f4af415cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:52.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.979+0000 7f4af2a00640 1 -- 172.21.15.144:0/1921376503 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af40aae30 con 0x7f4af406ec90 2024-09-11T23:24:52.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.979+0000 7f4af2a00640 1 --2- 172.21.15.144:0/1921376503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4af406ec90 0x7f4af40b2260 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400c500 tx=0x7f4ae400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:52.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.979+0000 7f4aeaa00640 1 -- 172.21.15.144:0/1921376503 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4017070 con 0x7f4af406ec90 2024-09-11T23:24:52.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.980+0000 7f4aeaa00640 1 -- 172.21.15.144:0/1921376503 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae4005310 con 0x7f4af406ec90 2024-09-11T23:24:52.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.980+0000 7f4aeaa00640 1 -- 172.21.15.144:0/1921376503 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4003830 con 0x7f4af406ec90 2024-09-11T23:24:52.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.980+0000 7f4af9800640 1 -- 172.21.15.144:0/1921376503 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af415d2a0 con 0x7f4af406ec90 2024-09-11T23:24:52.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.980+0000 7f4af9800640 1 -- 172.21.15.144:0/1921376503 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af415d860 con 0x7f4af406ec90 2024-09-11T23:24:52.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.981+0000 7f4af9800640 1 -- 172.21.15.144:0/1921376503 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af415fab0 con 0x7f4af406ec90 2024-09-11T23:24:52.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.982+0000 7f4aeaa00640 1 -- 172.21.15.144:0/1921376503 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f4ae401a070 con 0x7f4af406ec90 2024-09-11T23:24:52.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.982+0000 7f4aeaa00640 1 --2- 172.21.15.144:0/1921376503 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4ad406c400 0x7f4ad406e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:52.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.982+0000 7f4aeaa00640 1 -- 172.21.15.144:0/1921376503 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f4ae408ab70 con 0x7f4af406ec90 2024-09-11T23:24:52.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.983+0000 7f4af2000640 1 --2- 172.21.15.144:0/1921376503 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4ad406c400 0x7f4ad406e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:52.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.984+0000 7f4af2000640 1 --2- 172.21.15.144:0/1921376503 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4ad406c400 0x7f4ad406e8c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0034000 tx=0x7f4ae002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:52.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:52.987+0000 7f4aeaa00640 1 -- 172.21.15.144:0/1921376503 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ae4058630 con 0x7f4af406ec90 2024-09-11T23:24:53.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.189+0000 7f4af9800640 1 -- 172.21.15.144:0/1921376503 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot info", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f4af40ab000 con 0x7f4ad406c400 2024-09-11T23:24:53.190 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:53.190+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:53.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.191+0000 7f4aeaa00640 1 -- 172.21.15.144:0/1921376503 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f4af40ab000 con 0x7f4ad406c400 2024-09-11T23:24:53.191 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:53.201 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:53.202 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot protect non_existent_subvolume subvolume_1 snapshot_1 2024-09-11T23:24:53.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.361+0000 7f94ecc00640 1 Processor -- start 2024-09-11T23:24:53.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.361+0000 7f94ecc00640 1 -- start start 2024-09-11T23:24:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.362+0000 7f94ecc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f94e80b4ea0 0x7f94e80b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.362+0000 7f94ecc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f94e80cf920 0x7f94e815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.362+0000 7f94ecc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94e815e690 con 0x7f94e8158520 2024-09-11T23:24:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.362+0000 7f94ecc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f94e80b4120 con 0x7f94e80cf920 2024-09-11T23:24:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.362+0000 7f94ecc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f94e815e970 con 0x7f94e80b4ea0 2024-09-11T23:24:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.362+0000 7f94e7400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f94e8158520 0x7f94e80b4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39700/0 (socket says 172.21.15.144:39700) 2024-09-11T23:24:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.362+0000 7f94e7400640 1 -- 172.21.15.144:0/2817821787 learned_addr learned my addr 172.21.15.144:0/2817821787 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:53.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.362+0000 7f94e7e00640 1 --2- 172.21.15.144:0/2817821787 >> v2:172.21.15.144:3300/0 conn(0x7f94e80cf920 0x7f94e815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.363+0000 7f94e7e00640 1 -- 172.21.15.144:0/2817821787 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f94e80b4ea0 msgr2=0x7f94e80b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.363+0000 7f94e7e00640 1 --2- 172.21.15.144:0/2817821787 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f94e80b4ea0 0x7f94e80b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.363+0000 7f94e7e00640 1 -- 172.21.15.144:0/2817821787 >> v1:172.21.15.144:6789/0 conn(0x7f94e8158520 legacy=0x7f94e80b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.363+0000 7f94e7e00640 1 -- 172.21.15.144:0/2817821787 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e815ec50 con 0x7f94e80cf920 2024-09-11T23:24:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.363+0000 7f94e7e00640 1 --2- 172.21.15.144:0/2817821787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94e80cf920 0x7f94e815b090 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f94e0009dc0 tx=0x7f94e002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc36431eac35e58 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:53.363 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.364+0000 7f94e6a00640 1 -- 172.21.15.144:0/2817821787 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e002ae60 con 0x7f94e80cf920 2024-09-11T23:24:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.364+0000 7f94e6a00640 1 -- 172.21.15.144:0/2817821787 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e0007740 con 0x7f94e80cf920 2024-09-11T23:24:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.364+0000 7f94e6a00640 1 -- 172.21.15.144:0/2817821787 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e0007b10 con 0x7f94e80cf920 2024-09-11T23:24:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.364+0000 7f94ecc00640 1 -- 172.21.15.144:0/2817821787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94e80cf920 msgr2=0x7f94e815b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:53.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.364+0000 7f94ecc00640 1 --2- 172.21.15.144:0/2817821787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94e80cf920 0x7f94e815b090 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f94e0009dc0 tx=0x7f94e002a680 comp rx=0 tx=0).stop 2024-09-11T23:24:53.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.364+0000 7f94ecc00640 1 -- 172.21.15.144:0/2817821787 shutdown_connections 2024-09-11T23:24:53.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.364+0000 7f94ecc00640 1 --2- 172.21.15.144:0/2817821787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94e80cf920 0x7f94e815b090 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:53.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.364+0000 7f94ecc00640 1 --2- 172.21.15.144:0/2817821787 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f94e80b4ea0 0x7f94e80b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:53.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.364+0000 7f94ecc00640 1 -- 172.21.15.144:0/2817821787 >> 172.21.15.144:0/2817821787 conn(0x7f94e806bba0 msgr2=0x7f94e806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:53.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.364+0000 7f94ecc00640 1 -- 172.21.15.144:0/2817821787 shutdown_connections 2024-09-11T23:24:53.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.365+0000 7f94ecc00640 1 -- 172.21.15.144:0/2817821787 wait complete. 2024-09-11T23:24:53.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.366+0000 7f94ecc00640 1 Processor -- start 2024-09-11T23:24:53.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.366+0000 7f94ecc00640 1 -- start start 2024-09-11T23:24:53.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.367+0000 7f94ecc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f94e80b4ea0 0x7f94e8070d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:53.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.367+0000 7f94ecc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94e80cf920 0x7f94e815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:53.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.367+0000 7f94ecc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94e8158520 0x7f94e8148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:53.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.367+0000 7f94ecc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f94e80ccff0 con 0x7f94e80cf920 2024-09-11T23:24:53.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.367+0000 7f94ecc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f94e8158900 con 0x7f94e8158520 2024-09-11T23:24:53.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.367+0000 7f94ecc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f94e80cd170 con 0x7f94e80b4ea0 2024-09-11T23:24:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.367+0000 7f94dea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94e80cf920 0x7f94e815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.367+0000 7f94dea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94e80cf920 0x7f94e815dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51258/0 (socket says 172.21.15.144:51258) 2024-09-11T23:24:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.367+0000 7f94dea00640 1 -- 172.21.15.144:0/3695147978 learned_addr learned my addr 172.21.15.144:0/3695147978 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.367+0000 7f94e7400640 1 --2- 172.21.15.144:0/3695147978 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f94e80b4ea0 0x7f94e8070d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.368+0000 7f94e7e00640 1 --2- 172.21.15.144:0/3695147978 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94e8158520 0x7f94e8148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.368+0000 7f94dea00640 1 -- 172.21.15.144:0/3695147978 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f94e80b4ea0 msgr2=0x7f94e8070d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.368+0000 7f94dea00640 1 --2- 172.21.15.144:0/3695147978 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f94e80b4ea0 0x7f94e8070d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.368+0000 7f94dea00640 1 -- 172.21.15.144:0/3695147978 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94e8158520 msgr2=0x7f94e8148f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.368+0000 7f94dea00640 1 --2- 172.21.15.144:0/3695147978 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94e8158520 0x7f94e8148f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.368+0000 7f94dea00640 1 -- 172.21.15.144:0/3695147978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e815c500 con 0x7f94e80cf920 2024-09-11T23:24:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.368+0000 7f94e7e00640 1 --2- 172.21.15.144:0/3695147978 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94e8158520 0x7f94e8148f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.368+0000 7f94dea00640 1 --2- 172.21.15.144:0/3695147978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94e80cf920 0x7f94e815dbb0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f94d000b450 tx=0x7f94d000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:53.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.368+0000 7f94dfe00640 1 -- 172.21.15.144:0/3695147978 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d0015020 con 0x7f94e80cf920 2024-09-11T23:24:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.368+0000 7f94dfe00640 1 -- 172.21.15.144:0/3695147978 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d0011890 con 0x7f94e80cf920 2024-09-11T23:24:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.368+0000 7f94dfe00640 1 -- 172.21.15.144:0/3695147978 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d0011c80 con 0x7f94e80cf920 2024-09-11T23:24:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.368+0000 7f94ecc00640 1 -- 172.21.15.144:0/3695147978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e814e760 con 0x7f94e80cf920 2024-09-11T23:24:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.369+0000 7f94ecc00640 1 -- 172.21.15.144:0/3695147978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e814ed20 con 0x7f94e80cf920 2024-09-11T23:24:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.370+0000 7f94ecc00640 1 -- 172.21.15.144:0/3695147978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94e814e550 con 0x7f94e80cf920 2024-09-11T23:24:53.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.370+0000 7f94dfe00640 1 -- 172.21.15.144:0/3695147978 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f94d0018020 con 0x7f94e80cf920 2024-09-11T23:24:53.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.371+0000 7f94dfe00640 1 --2- 172.21.15.144:0/3695147978 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f94c406c3d0 0x7f94c406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:53.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.371+0000 7f94dfe00640 1 -- 172.21.15.144:0/3695147978 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f94d008b990 con 0x7f94e80cf920 2024-09-11T23:24:53.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.372+0000 7f94e7400640 1 --2- 172.21.15.144:0/3695147978 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f94c406c3d0 0x7f94c406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:53.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.373+0000 7f94e7400640 1 --2- 172.21.15.144:0/3695147978 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f94c406c3d0 0x7f94c406e890 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f94d8007fd0 tx=0x7f94d8007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:53.375 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.376+0000 7f94dfe00640 1 -- 172.21.15.144:0/3695147978 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f94d001f020 con 0x7f94e80cf920 2024-09-11T23:24:53.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.584+0000 7f94ecc00640 1 -- 172.21.15.144:0/3695147978 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot protect", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f94e814ccf0 con 0x7f94c406c3d0 2024-09-11T23:24:53.585 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:53.585+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:53.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.586+0000 7f94dfe00640 1 -- 172.21.15.144:0/3695147978 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f94e814ccf0 con 0x7f94c406c3d0 2024-09-11T23:24:53.586 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:53.596 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:53.597 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot unprotect non_existent_subvolume subvolume_1 snapshot_1 2024-09-11T23:24:53.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.755+0000 7f8637e00640 1 Processor -- start 2024-09-11T23:24:53.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.755+0000 7f8637e00640 1 -- start start 2024-09-11T23:24:53.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.756+0000 7f8637e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f86380cf920 0x7f86380b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:53.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.756+0000 7f8637e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f863815e690 con 0x7f8638158520 2024-09-11T23:24:53.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.756+0000 7f8637e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f863815e970 con 0x7f86380b4ea0 2024-09-11T23:24:53.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.756+0000 7f8637e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f86380b4120 con 0x7f86380cf920 2024-09-11T23:24:53.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.757+0000 7f8636a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8638158520 0x7f86380b4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:39708/0 (socket says 172.21.15.144:39708) 2024-09-11T23:24:53.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.757+0000 7f8636a00640 1 -- 172.21.15.144:0/2170262467 learned_addr learned my addr 172.21.15.144:0/2170262467 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:53.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.757+0000 7f8637400640 1 --2- 172.21.15.144:0/2170262467 >> v2:172.21.15.165:3300/0 conn(0x7f86380cf920 0x7f86380b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.757+0000 7f8635600640 1 -- 172.21.15.144:0/2170262467 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 982922909 0 0) 0x7f863815e690 con 0x7f8638158520 2024-09-11T23:24:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.757+0000 7f8635600640 1 -- 172.21.15.144:0/2170262467 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f861c004630 con 0x7f8638158520 2024-09-11T23:24:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.757+0000 7f8635600640 1 -- 172.21.15.144:0/2170262467 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1335489399 0 0) 0x7f861c004630 con 0x7f8638158520 2024-09-11T23:24:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.757+0000 7f8635600640 1 -- 172.21.15.144:0/2170262467 >> v2:172.21.15.165:3300/0 conn(0x7f86380cf920 msgr2=0x7f86380b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.757+0000 7f8635600640 1 --2- 172.21.15.144:0/2170262467 >> v2:172.21.15.165:3300/0 conn(0x7f86380cf920 0x7f86380b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.757+0000 7f8635600640 1 -- 172.21.15.144:0/2170262467 >> v1:172.21.15.165:6789/0 conn(0x7f86380b4ea0 legacy=0x7f863815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.757+0000 7f8635600640 1 -- 172.21.15.144:0/2170262467 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863815ec50 con 0x7f8638158520 2024-09-11T23:24:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.757+0000 7f8635600640 1 -- 172.21.15.144:0/2170262467 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f8628001670 con 0x7f8638158520 2024-09-11T23:24:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.757+0000 7f8635600640 1 -- 172.21.15.144:0/2170262467 >> v1:172.21.15.144:6789/0 conn(0x7f8638158520 legacy=0x7f86380b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.757+0000 7f8635600640 1 --2- 172.21.15.144:0/2170262467 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f861c004ac0 0x7f861c004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.757+0000 7f8635600640 1 --2- 172.21.15.144:0/2170262467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f861c005910 0x7f861c005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:53.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.758+0000 7f8635600640 1 --2- 172.21.15.144:0/2170262467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f861c0062d0 0x7f861c00cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.758+0000 7f8635600640 1 -- 172.21.15.144:0/2170262467 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f86380b4120 con 0x7f861c0062d0 2024-09-11T23:24:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.758+0000 7f8635600640 1 -- 172.21.15.144:0/2170262467 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f861c00d170 con 0x7f861c005910 2024-09-11T23:24:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.758+0000 7f8635600640 1 -- 172.21.15.144:0/2170262467 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f861c00d370 con 0x7f861c004ac0 2024-09-11T23:24:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.758+0000 7f8637400640 1 --2- 172.21.15.144:0/2170262467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f861c0062d0 0x7f861c00cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.758+0000 7f8636a00640 1 --2- 172.21.15.144:0/2170262467 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f861c004ac0 0x7f861c004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.758+0000 7f8636000640 1 --2- 172.21.15.144:0/2170262467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f861c005910 0x7f861c005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.758+0000 7f8637400640 1 -- 172.21.15.144:0/2170262467 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f861c004ac0 msgr2=0x7f861c004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.758+0000 7f8637400640 1 --2- 172.21.15.144:0/2170262467 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f861c004ac0 0x7f861c004ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.758+0000 7f8637400640 1 -- 172.21.15.144:0/2170262467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f861c005910 msgr2=0x7f861c005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.758+0000 7f8637400640 1 --2- 172.21.15.144:0/2170262467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f861c005910 0x7f861c005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.758+0000 7f8637400640 1 -- 172.21.15.144:0/2170262467 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861c004630 con 0x7f861c0062d0 2024-09-11T23:24:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.758+0000 7f8636a00640 1 --2- 172.21.15.144:0/2170262467 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f861c004ac0 0x7f861c004ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:53.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.759+0000 7f8637400640 1 -- 172.21.15.144:0/2170262467 reap_dead start 2024-09-11T23:24:53.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.759+0000 7f8637400640 1 --2- 172.21.15.144:0/2170262467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f861c0062d0 0x7f861c00cad0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f8630009fc0 tx=0x7f861c006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a479b443d2df6d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:53.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.759+0000 7f8635600640 1 -- 172.21.15.144:0/2170262467 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8630035020 con 0x7f861c0062d0 2024-09-11T23:24:53.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.759+0000 7f8635600640 1 -- 172.21.15.144:0/2170262467 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8630003bd0 con 0x7f861c0062d0 2024-09-11T23:24:53.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.759+0000 7f8635600640 1 -- 172.21.15.144:0/2170262467 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8630009c10 con 0x7f861c0062d0 2024-09-11T23:24:53.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.760+0000 7f8637e00640 1 -- 172.21.15.144:0/2170262467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f861c0062d0 msgr2=0x7f861c00cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:53.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.760+0000 7f8637e00640 1 --2- 172.21.15.144:0/2170262467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f861c0062d0 0x7f861c00cad0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f8630009fc0 tx=0x7f861c006940 comp rx=0 tx=0).stop 2024-09-11T23:24:53.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.760+0000 7f8637e00640 1 -- 172.21.15.144:0/2170262467 shutdown_connections 2024-09-11T23:24:53.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.760+0000 7f8637e00640 1 --2- 172.21.15.144:0/2170262467 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f861c0062d0 0x7f861c00cad0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:53.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.760+0000 7f8637e00640 1 -- 172.21.15.144:0/2170262467 >> 172.21.15.144:0/2170262467 conn(0x7f863806bba0 msgr2=0x7f863806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:53.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.760+0000 7f8637e00640 1 -- 172.21.15.144:0/2170262467 shutdown_connections 2024-09-11T23:24:53.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.760+0000 7f8637e00640 1 -- 172.21.15.144:0/2170262467 wait complete. 2024-09-11T23:24:53.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.762+0000 7f8637e00640 1 Processor -- start 2024-09-11T23:24:53.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.762+0000 7f8637e00640 1 -- start start 2024-09-11T23:24:53.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.763+0000 7f8637e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f861c0062d0 0x7f8638148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.763+0000 7f8637e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86381e4d10 0x7f8638073000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.763+0000 7f8637e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86380aee80 0x7f86380af300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.763+0000 7f8637e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f86380ccff0 con 0x7f86381e4d10 2024-09-11T23:24:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.763+0000 7f8637e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8638158900 con 0x7f86380aee80 2024-09-11T23:24:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.763+0000 7f8637e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f86380cd170 con 0x7f861c0062d0 2024-09-11T23:24:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.763+0000 7f8636000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86381e4d10 0x7f8638073000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.763+0000 7f8636000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86381e4d10 0x7f8638073000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51284/0 (socket says 172.21.15.144:51284) 2024-09-11T23:24:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.763+0000 7f8636000640 1 -- 172.21.15.144:0/2821072231 learned_addr learned my addr 172.21.15.144:0/2821072231 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.763+0000 7f8636a00640 1 --2- 172.21.15.144:0/2821072231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f861c0062d0 0x7f8638148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.763+0000 7f8637400640 1 --2- 172.21.15.144:0/2821072231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86380aee80 0x7f86380af300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.764+0000 7f8636000640 1 -- 172.21.15.144:0/2821072231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f861c0062d0 msgr2=0x7f8638148d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.764+0000 7f8636000640 1 --2- 172.21.15.144:0/2821072231 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f861c0062d0 0x7f8638148d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.764+0000 7f8636000640 1 -- 172.21.15.144:0/2821072231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86380aee80 msgr2=0x7f86380af300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:53.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.764+0000 7f8636000640 1 --2- 172.21.15.144:0/2821072231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86380aee80 0x7f86380af300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:53.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.764+0000 7f8636000640 1 -- 172.21.15.144:0/2821072231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86381e6330 con 0x7f86381e4d10 2024-09-11T23:24:53.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.764+0000 7f8636000640 1 --2- 172.21.15.144:0/2821072231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86381e4d10 0x7f8638073000 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f862400f5f0 tx=0x7f862400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:53.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.764+0000 7f862f400640 1 -- 172.21.15.144:0/2821072231 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86240052e0 con 0x7f86381e4d10 2024-09-11T23:24:53.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.764+0000 7f862f400640 1 -- 172.21.15.144:0/2821072231 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8624018070 con 0x7f86381e4d10 2024-09-11T23:24:53.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.764+0000 7f8637e00640 1 -- 172.21.15.144:0/2821072231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86381e5290 con 0x7f86381e4d10 2024-09-11T23:24:53.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.764+0000 7f862f400640 1 -- 172.21.15.144:0/2821072231 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8624003830 con 0x7f86381e4d10 2024-09-11T23:24:53.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.764+0000 7f8637e00640 1 -- 172.21.15.144:0/2821072231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86381e5850 con 0x7f86381e4d10 2024-09-11T23:24:53.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.765+0000 7f8637e00640 1 -- 172.21.15.144:0/2821072231 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86380b3be0 con 0x7f86381e4d10 2024-09-11T23:24:53.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.766+0000 7f862f400640 1 -- 172.21.15.144:0/2821072231 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f86240039d0 con 0x7f86381e4d10 2024-09-11T23:24:53.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.767+0000 7f862f400640 1 --2- 172.21.15.144:0/2821072231 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f861806c3a0 0x7f861806e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:53.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.767+0000 7f862f400640 1 -- 172.21.15.144:0/2821072231 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f862408b640 con 0x7f86381e4d10 2024-09-11T23:24:53.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.767+0000 7f8636a00640 1 --2- 172.21.15.144:0/2821072231 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f861806c3a0 0x7f861806e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:53.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.768+0000 7f8636a00640 1 --2- 172.21.15.144:0/2821072231 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f861806c3a0 0x7f861806e860 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8628001050 tx=0x7f8628009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:53.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.772+0000 7f862f400640 1 -- 172.21.15.144:0/2821072231 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f86240597d0 con 0x7f86381e4d10 2024-09-11T23:24:53.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.974+0000 7f8637e00640 1 -- 172.21.15.144:0/2821072231 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot unprotect", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f863815e2f0 con 0x7f861806c3a0 2024-09-11T23:24:53.977 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:53.976+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:53.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:53.976+0000 7f862f400640 1 -- 172.21.15.144:0/2821072231 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f863815e2f0 con 0x7f861806c3a0 2024-09-11T23:24:53.977 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:53.987 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:53.987 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls non_existent_subvolume subvolume_1 2024-09-11T23:24:54.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.144+0000 7f6946c00640 1 Processor -- start 2024-09-11T23:24:54.145 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.144+0000 7f6946c00640 1 -- start start 2024-09-11T23:24:54.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.145+0000 7f6946c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f694015e650 0x7f69400cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.145+0000 7f6946c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f69400d32d0 0x7f694006d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.145+0000 7f6946c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f694006db50 0x7f694006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.145+0000 7f6946c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f694015ea30 con 0x7f694015e650 2024-09-11T23:24:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.145+0000 7f6946c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f69400d3890 con 0x7f69400d32d0 2024-09-11T23:24:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.145+0000 7f6946c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f69400d3b70 con 0x7f694006db50 2024-09-11T23:24:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.145+0000 7f6945800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f694015e650 0x7f69400cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.146+0000 7f6945800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f694015e650 0x7f69400cf6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51286/0 (socket says 172.21.15.144:51286) 2024-09-11T23:24:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.146+0000 7f6945800640 1 -- 172.21.15.144:0/1303404824 learned_addr learned my addr 172.21.15.144:0/1303404824 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.146+0000 7f6944e00640 1 --2- 172.21.15.144:0/1303404824 >> v2:172.21.15.165:3300/0 conn(0x7f69400d32d0 0x7f694006d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.146+0000 7f6946200640 1 --2- 172.21.15.144:0/1303404824 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f694006db50 0x7f694006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.146+0000 7f6945800640 1 -- 172.21.15.144:0/1303404824 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f694006db50 msgr2=0x7f694006bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.146+0000 7f6945800640 1 --2- 172.21.15.144:0/1303404824 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f694006db50 0x7f694006bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.146+0000 7f6945800640 1 -- 172.21.15.144:0/1303404824 >> v2:172.21.15.165:3300/0 conn(0x7f69400d32d0 msgr2=0x7f694006d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:54.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.146+0000 7f6945800640 1 --2- 172.21.15.144:0/1303404824 >> v2:172.21.15.165:3300/0 conn(0x7f69400d32d0 0x7f694006d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:54.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.146+0000 7f6945800640 1 -- 172.21.15.144:0/1303404824 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69400d3e50 con 0x7f694015e650 2024-09-11T23:24:54.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.146+0000 7f6944e00640 1 --2- 172.21.15.144:0/1303404824 >> v2:172.21.15.165:3300/0 conn(0x7f69400d32d0 0x7f694006d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:54.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.147+0000 7f6945800640 1 --2- 172.21.15.144:0/1303404824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f694015e650 0x7f69400cf6d0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f69400c7e90 tx=0x7f693402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90357fca8fddef80 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:54.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.147+0000 7f693fe00640 1 -- 172.21.15.144:0/1303404824 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934037070 con 0x7f694015e650 2024-09-11T23:24:54.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.147+0000 7f693fe00640 1 -- 172.21.15.144:0/1303404824 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6934032440 con 0x7f694015e650 2024-09-11T23:24:54.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.147+0000 7f693fe00640 1 -- 172.21.15.144:0/1303404824 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6934032810 con 0x7f694015e650 2024-09-11T23:24:54.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.148+0000 7f6946c00640 1 -- 172.21.15.144:0/1303404824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f694015e650 msgr2=0x7f69400cf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:54.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.148+0000 7f6946c00640 1 --2- 172.21.15.144:0/1303404824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f694015e650 0x7f69400cf6d0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f69400c7e90 tx=0x7f693402a270 comp rx=0 tx=0).stop 2024-09-11T23:24:54.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.148+0000 7f6946c00640 1 -- 172.21.15.144:0/1303404824 shutdown_connections 2024-09-11T23:24:54.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.148+0000 7f6946c00640 1 --2- 172.21.15.144:0/1303404824 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f694006db50 0x7f694006bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:54.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.148+0000 7f6946c00640 1 --2- 172.21.15.144:0/1303404824 >> v2:172.21.15.165:3300/0 conn(0x7f69400d32d0 0x7f694006d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:54.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.148+0000 7f6946c00640 1 --2- 172.21.15.144:0/1303404824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f694015e650 0x7f69400cf6d0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:54.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.148+0000 7f6946c00640 1 -- 172.21.15.144:0/1303404824 >> 172.21.15.144:0/1303404824 conn(0x7f69400d4740 msgr2=0x7f69400d4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:54.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.148+0000 7f6946c00640 1 -- 172.21.15.144:0/1303404824 shutdown_connections 2024-09-11T23:24:54.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.148+0000 7f6946c00640 1 -- 172.21.15.144:0/1303404824 wait complete. 2024-09-11T23:24:54.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.149+0000 7f6946c00640 1 Processor -- start 2024-09-11T23:24:54.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.150+0000 7f6946c00640 1 -- start start 2024-09-11T23:24:54.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.150+0000 7f6946c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f694006db50 0x7f6940157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.150+0000 7f6946c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69400d32d0 0x7f6940158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.150+0000 7f6946c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f694015e650 0x7f69400cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.150+0000 7f6946c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f69400cfd90 con 0x7f69400d32d0 2024-09-11T23:24:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.150+0000 7f6946c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f69400cfc10 con 0x7f694015e650 2024-09-11T23:24:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.150+0000 7f6946c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f69400b7690 con 0x7f694006db50 2024-09-11T23:24:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.151+0000 7f6944e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69400d32d0 0x7f6940158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.151+0000 7f6944e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69400d32d0 0x7f6940158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51290/0 (socket says 172.21.15.144:51290) 2024-09-11T23:24:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.151+0000 7f6944e00640 1 -- 172.21.15.144:0/881769819 learned_addr learned my addr 172.21.15.144:0/881769819 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.151+0000 7f6946200640 1 --2- 172.21.15.144:0/881769819 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f694015e650 0x7f69400cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.151+0000 7f6945800640 1 --2- 172.21.15.144:0/881769819 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f694006db50 0x7f6940157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.151+0000 7f6944e00640 1 -- 172.21.15.144:0/881769819 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f694006db50 msgr2=0x7f6940157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:54.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.151+0000 7f6944e00640 1 --2- 172.21.15.144:0/881769819 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f694006db50 0x7f6940157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:54.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.151+0000 7f6944e00640 1 -- 172.21.15.144:0/881769819 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f694015e650 msgr2=0x7f69400cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:54.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.151+0000 7f6944e00640 1 --2- 172.21.15.144:0/881769819 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f694015e650 0x7f69400cf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:54.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.151+0000 7f6944e00640 1 -- 172.21.15.144:0/881769819 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69401f78b0 con 0x7f69400d32d0 2024-09-11T23:24:54.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.151+0000 7f6944e00640 1 --2- 172.21.15.144:0/881769819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f69400d32d0 0x7f6940158530 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f692c00e730 tx=0x7f692c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:54.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.152+0000 7f693d600640 1 -- 172.21.15.144:0/881769819 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c00f040 con 0x7f69400d32d0 2024-09-11T23:24:54.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.152+0000 7f693d600640 1 -- 172.21.15.144:0/881769819 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692c004230 con 0x7f69400d32d0 2024-09-11T23:24:54.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.152+0000 7f693d600640 1 -- 172.21.15.144:0/881769819 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c00ee40 con 0x7f69400d32d0 2024-09-11T23:24:54.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.152+0000 7f6946c00640 1 -- 172.21.15.144:0/881769819 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69401f7b90 con 0x7f69400d32d0 2024-09-11T23:24:54.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.152+0000 7f6946c00640 1 -- 172.21.15.144:0/881769819 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69401f8150 con 0x7f69400d32d0 2024-09-11T23:24:54.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.153+0000 7f6946c00640 1 -- 172.21.15.144:0/881769819 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f694006d610 con 0x7f69400d32d0 2024-09-11T23:24:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.154+0000 7f693d600640 1 -- 172.21.15.144:0/881769819 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f692c00c670 con 0x7f69400d32d0 2024-09-11T23:24:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.155+0000 7f693d600640 1 --2- 172.21.15.144:0/881769819 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f692006c400 0x7f692006e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:54.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.155+0000 7f693d600640 1 -- 172.21.15.144:0/881769819 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f692c08b680 con 0x7f69400d32d0 2024-09-11T23:24:54.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.155+0000 7f6945800640 1 --2- 172.21.15.144:0/881769819 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f692006c400 0x7f692006e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:54.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.156+0000 7f6945800640 1 --2- 172.21.15.144:0/881769819 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f692006c400 0x7f692006e8c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6934034000 tx=0x7f693402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:54.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.159+0000 7f693d600640 1 -- 172.21.15.144:0/881769819 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f692c017020 con 0x7f69400d32d0 2024-09-11T23:24:54.358 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.357+0000 7f6946c00640 1 -- 172.21.15.144:0/881769819 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7f69401f3f50 con 0x7f692006c400 2024-09-11T23:24:54.360 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:54.359+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:54.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.359+0000 7f693d600640 1 -- 172.21.15.144:0/881769819 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f69401f3f50 con 0x7f692006c400 2024-09-11T23:24:54.360 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:54.369 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:54.370 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone non_existent_subvolume subvolume_1 snapshot_1 clone_1 2024-09-11T23:24:54.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.533+0000 7ffb2d000640 1 Processor -- start 2024-09-11T23:24:54.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.533+0000 7ffb2d000640 1 -- start start 2024-09-11T23:24:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.534+0000 7ffb2d000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb280d32d0 0x7ffb2806d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.534+0000 7ffb2d000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffb2806db50 0x7ffb280b7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.534+0000 7ffb2d000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb280d3890 con 0x7ffb2815e650 2024-09-11T23:24:54.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.534+0000 7ffb2d000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ffb2815ea30 con 0x7ffb2806db50 2024-09-11T23:24:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.534+0000 7ffb2d000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffb280d3b70 con 0x7ffb280d32d0 2024-09-11T23:24:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.534+0000 7ffb27e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffb2806db50 0x7ffb280b7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.534+0000 7ffb27e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffb2806db50 0x7ffb280b7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59038/0 (socket says 172.21.15.144:59038) 2024-09-11T23:24:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.534+0000 7ffb27e00640 1 -- 172.21.15.144:0/2354980642 learned_addr learned my addr 172.21.15.144:0/2354980642 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.534+0000 7ffb1ea00640 1 --2- 172.21.15.144:0/2354980642 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb280d32d0 0x7ffb2806d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.535+0000 7ffb27e00640 1 -- 172.21.15.144:0/2354980642 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb280d32d0 msgr2=0x7ffb2806d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.535+0000 7ffb27e00640 1 --2- 172.21.15.144:0/2354980642 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb280d32d0 0x7ffb2806d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.535+0000 7ffb27e00640 1 -- 172.21.15.144:0/2354980642 >> v1:172.21.15.144:6789/0 conn(0x7ffb2815e650 legacy=0x7ffb280cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:54.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.535+0000 7ffb27e00640 1 -- 172.21.15.144:0/2354980642 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb280d3e50 con 0x7ffb2806db50 2024-09-11T23:24:54.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.536+0000 7ffb27e00640 1 --2- 172.21.15.144:0/2354980642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb2806db50 0x7ffb280b7cb0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009e50 tx=0x7ffb2002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eab82ede1946661 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:54.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.536+0000 7ffb26a00640 1 -- 172.21.15.144:0/2354980642 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20036070 con 0x7ffb2806db50 2024-09-11T23:24:54.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.536+0000 7ffb26a00640 1 -- 172.21.15.144:0/2354980642 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb20031600 con 0x7ffb2806db50 2024-09-11T23:24:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.536+0000 7ffb26a00640 1 -- 172.21.15.144:0/2354980642 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb200319d0 con 0x7ffb2806db50 2024-09-11T23:24:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.536+0000 7ffb2d000640 1 -- 172.21.15.144:0/2354980642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb2806db50 msgr2=0x7ffb280b7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.536+0000 7ffb2d000640 1 --2- 172.21.15.144:0/2354980642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb2806db50 0x7ffb280b7cb0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009e50 tx=0x7ffb2002a7a0 comp rx=0 tx=0).stop 2024-09-11T23:24:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.537+0000 7ffb2d000640 1 -- 172.21.15.144:0/2354980642 shutdown_connections 2024-09-11T23:24:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.537+0000 7ffb2d000640 1 --2- 172.21.15.144:0/2354980642 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb2806db50 0x7ffb280b7cb0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.537+0000 7ffb2d000640 1 --2- 172.21.15.144:0/2354980642 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb280d32d0 0x7ffb2806d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.537+0000 7ffb2d000640 1 -- 172.21.15.144:0/2354980642 >> 172.21.15.144:0/2354980642 conn(0x7ffb280d4740 msgr2=0x7ffb280d4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.537+0000 7ffb2d000640 1 -- 172.21.15.144:0/2354980642 shutdown_connections 2024-09-11T23:24:54.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.537+0000 7ffb2d000640 1 -- 172.21.15.144:0/2354980642 wait complete. 2024-09-11T23:24:54.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.538+0000 7ffb2d000640 1 Processor -- start 2024-09-11T23:24:54.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.538+0000 7ffb2d000640 1 -- start start 2024-09-11T23:24:54.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.539+0000 7ffb2d000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb2806db50 0x7ffb280cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.539+0000 7ffb2d000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb280d32d0 0x7ffb281594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.539+0000 7ffb2d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb2815e650 0x7ffb28159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.539+0000 7ffb2d000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffb280b7810 con 0x7ffb2815e650 2024-09-11T23:24:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.539+0000 7ffb2d000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffb280b7690 con 0x7ffb280d32d0 2024-09-11T23:24:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.539+0000 7ffb2d000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ffb280b81f0 con 0x7ffb2806db50 2024-09-11T23:24:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.539+0000 7ffb27e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb2815e650 0x7ffb28159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.539+0000 7ffb27e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb2815e650 0x7ffb28159a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59040/0 (socket says 172.21.15.144:59040) 2024-09-11T23:24:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.539+0000 7ffb27e00640 1 -- 172.21.15.144:0/917826719 learned_addr learned my addr 172.21.15.144:0/917826719 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.540+0000 7ffb1ea00640 1 --2- 172.21.15.144:0/917826719 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb280d32d0 0x7ffb281594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.540+0000 7ffb27400640 1 --2- 172.21.15.144:0/917826719 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb2806db50 0x7ffb280cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.540+0000 7ffb27e00640 1 -- 172.21.15.144:0/917826719 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb2806db50 msgr2=0x7ffb280cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.540+0000 7ffb27e00640 1 --2- 172.21.15.144:0/917826719 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ffb2806db50 0x7ffb280cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:54.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.540+0000 7ffb27e00640 1 -- 172.21.15.144:0/917826719 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb280d32d0 msgr2=0x7ffb281594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:54.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.540+0000 7ffb27e00640 1 --2- 172.21.15.144:0/917826719 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb280d32d0 0x7ffb281594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:54.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.540+0000 7ffb27e00640 1 -- 172.21.15.144:0/917826719 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2815a060 con 0x7ffb2815e650 2024-09-11T23:24:54.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.540+0000 7ffb27e00640 1 --2- 172.21.15.144:0/917826719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb2815e650 0x7ffb28159a00 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009e50 tx=0x7ffb20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:54.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.540+0000 7ffb1fe00640 1 -- 172.21.15.144:0/917826719 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20036050 con 0x7ffb2815e650 2024-09-11T23:24:54.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.541+0000 7ffb1fe00640 1 -- 172.21.15.144:0/917826719 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb20042070 con 0x7ffb2815e650 2024-09-11T23:24:54.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.541+0000 7ffb2d000640 1 -- 172.21.15.144:0/917826719 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb2815a340 con 0x7ffb2815e650 2024-09-11T23:24:54.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.541+0000 7ffb1fe00640 1 -- 172.21.15.144:0/917826719 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20009510 con 0x7ffb2815e650 2024-09-11T23:24:54.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.541+0000 7ffb2d000640 1 -- 172.21.15.144:0/917826719 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb2815a900 con 0x7ffb2815e650 2024-09-11T23:24:54.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.542+0000 7ffb2d000640 1 -- 172.21.15.144:0/917826719 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb280b7cb0 con 0x7ffb2815e650 2024-09-11T23:24:54.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.543+0000 7ffb1fe00640 1 -- 172.21.15.144:0/917826719 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7ffb20007b70 con 0x7ffb2815e650 2024-09-11T23:24:54.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.543+0000 7ffb1fe00640 1 --2- 172.21.15.144:0/917826719 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ffb0406c3d0 0x7ffb0406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:54.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.543+0000 7ffb1fe00640 1 -- 172.21.15.144:0/917826719 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7ffb200ac6a0 con 0x7ffb2815e650 2024-09-11T23:24:54.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.544+0000 7ffb27400640 1 --2- 172.21.15.144:0/917826719 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ffb0406c3d0 0x7ffb0406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:54.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.545+0000 7ffb27400640 1 --2- 172.21.15.144:0/917826719 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ffb0406c3d0 0x7ffb0406e890 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffb180016e0 tx=0x7ffb18009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:54.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.548+0000 7ffb1fe00640 1 -- 172.21.15.144:0/917826719 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffb2007a190 con 0x7ffb2815e650 2024-09-11T23:24:54.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.757+0000 7ffb2d000640 1 -- 172.21.15.144:0/917826719 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target_sub_name": "clone_1", "target": ["mon-mgr", ""]}) -- 0x7ffb280b6e40 con 0x7ffb0406c3d0 2024-09-11T23:24:54.767 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:54.767+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:24:54.767 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:54.767+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:24:54.767 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:54.767+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:24:54.767 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:54.767+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:24:54.767 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:54.767+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:24:54.774 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:54.774+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:54.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.774+0000 7ffb1fe00640 1 -- 172.21.15.144:0/917826719 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7ffb280b6e40 con 0x7ffb0406c3d0 2024-09-11T23:24:54.775 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:54.785 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:54.786 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status non_existent_subvolume clone_1 2024-09-11T23:24:54.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.941+0000 7fcbcae00640 1 Processor -- start 2024-09-11T23:24:54.942 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.942+0000 7fcbcae00640 1 -- start start 2024-09-11T23:24:54.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.943+0000 7fcbcae00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcbc406f130 0x7fcbc40b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:54.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.943+0000 7fcbcae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc415c370 0x7fcbc40ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:54.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.943+0000 7fcbcae00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbc415c820 con 0x7fcbc4158e50 2024-09-11T23:24:54.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.943+0000 7fcbcae00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fcbc40b43f0 con 0x7fcbc406f130 2024-09-11T23:24:54.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.943+0000 7fcbcae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcbc40b3630 con 0x7fcbc415c370 2024-09-11T23:24:54.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.943+0000 7fcbbbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcbc406f130 0x7fcbc40b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:54.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.943+0000 7fcbbbe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcbc406f130 0x7fcbc40b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59044/0 (socket says 172.21.15.144:59044) 2024-09-11T23:24:54.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.943+0000 7fcbbbe00640 1 -- 172.21.15.144:0/426974032 learned_addr learned my addr 172.21.15.144:0/426974032 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:54.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.943+0000 7fcbc8e00640 1 --2- 172.21.15.144:0/426974032 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc415c370 0x7fcbc40ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:54.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.943+0000 7fcbbbe00640 1 -- 172.21.15.144:0/426974032 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc415c370 msgr2=0x7fcbc40ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:54.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.943+0000 7fcbbbe00640 1 --2- 172.21.15.144:0/426974032 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc415c370 0x7fcbc40ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:54.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.943+0000 7fcbbbe00640 1 -- 172.21.15.144:0/426974032 >> v1:172.21.15.144:6789/0 conn(0x7fcbc4158e50 legacy=0x7fcbc406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:54.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.944+0000 7fcbbbe00640 1 -- 172.21.15.144:0/426974032 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc40b3910 con 0x7fcbc406f130 2024-09-11T23:24:54.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.944+0000 7fcbc3400640 1 -- 172.21.15.144:0/426974032 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1030558478 0 0) 0x7fcbb4001110 con 0x7fcbc4158e50 2024-09-11T23:24:54.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.944+0000 7fcbc8e00640 1 --2- 172.21.15.144:0/426974032 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc415c370 0x7fcbc40ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:54.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.944+0000 7fcbbbe00640 1 --2- 172.21.15.144:0/426974032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbc406f130 0x7fcbc40b5050 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009850 tx=0x7fcbac02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8f84cf667552ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:54.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.945+0000 7fcbc3400640 1 -- 172.21.15.144:0/426974032 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac004030 con 0x7fcbc406f130 2024-09-11T23:24:54.946 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.945+0000 7fcbc3400640 1 -- 172.21.15.144:0/426974032 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbac0041d0 con 0x7fcbc406f130 2024-09-11T23:24:54.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.945+0000 7fcbc3400640 1 -- 172.21.15.144:0/426974032 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac003610 con 0x7fcbc406f130 2024-09-11T23:24:54.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.945+0000 7fcbcae00640 1 -- 172.21.15.144:0/426974032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbc406f130 msgr2=0x7fcbc40b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:54.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.945+0000 7fcbcae00640 1 --2- 172.21.15.144:0/426974032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbc406f130 0x7fcbc40b5050 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009850 tx=0x7fcbac02a250 comp rx=0 tx=0).stop 2024-09-11T23:24:54.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.945+0000 7fcbcae00640 1 -- 172.21.15.144:0/426974032 shutdown_connections 2024-09-11T23:24:54.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.945+0000 7fcbcae00640 1 --2- 172.21.15.144:0/426974032 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc415c370 0x7fcbc40ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:54.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.945+0000 7fcbcae00640 1 --2- 172.21.15.144:0/426974032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbc406f130 0x7fcbc40b5050 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:54.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.945+0000 7fcbcae00640 1 -- 172.21.15.144:0/426974032 >> 172.21.15.144:0/426974032 conn(0x7fcbc406bba0 msgr2=0x7fcbc406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:54.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.945+0000 7fcbcae00640 1 -- 172.21.15.144:0/426974032 shutdown_connections 2024-09-11T23:24:54.947 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.945+0000 7fcbcae00640 1 -- 172.21.15.144:0/426974032 wait complete. 2024-09-11T23:24:54.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.947+0000 7fcbcae00640 1 Processor -- start 2024-09-11T23:24:54.948 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.947+0000 7fcbcae00640 1 -- start start 2024-09-11T23:24:54.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.948+0000 7fcbcae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc406f130 0x7fcbc414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:54.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.948+0000 7fcbcae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbc4158e50 0x7fcbc4152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:54.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.948+0000 7fcbcae00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcbc415c370 0x7fcbc40affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:54.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.948+0000 7fcbcae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc4159230 con 0x7fcbc4158e50 2024-09-11T23:24:54.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.948+0000 7fcbcae00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc40b3ed0 con 0x7fcbc415c370 2024-09-11T23:24:54.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.948+0000 7fcbcae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcbc40ce740 con 0x7fcbc406f130 2024-09-11T23:24:54.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.948+0000 7fcbbbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbc4158e50 0x7fcbc4152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:54.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.948+0000 7fcbbbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbc4158e50 0x7fcbc4152fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59060/0 (socket says 172.21.15.144:59060) 2024-09-11T23:24:54.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.948+0000 7fcbbbe00640 1 -- 172.21.15.144:0/2615258264 learned_addr learned my addr 172.21.15.144:0/2615258264 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:54.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.948+0000 7fcbc3e00640 1 --2- 172.21.15.144:0/2615258264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc406f130 0x7fcbc414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:54.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.948+0000 7fcbc8e00640 1 --2- 172.21.15.144:0/2615258264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcbc415c370 0x7fcbc40affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:54.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.949+0000 7fcbbbe00640 1 -- 172.21.15.144:0/2615258264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc406f130 msgr2=0x7fcbc414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:54.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.949+0000 7fcbbbe00640 1 --2- 172.21.15.144:0/2615258264 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcbc406f130 0x7fcbc414ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:54.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.949+0000 7fcbbbe00640 1 -- 172.21.15.144:0/2615258264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcbc415c370 msgr2=0x7fcbc40affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:54.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.949+0000 7fcbbbe00640 1 --2- 172.21.15.144:0/2615258264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcbc415c370 0x7fcbc40affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:54.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.949+0000 7fcbbbe00640 1 -- 172.21.15.144:0/2615258264 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc41538a0 con 0x7fcbc4158e50 2024-09-11T23:24:54.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.949+0000 7fcbbbe00640 1 --2- 172.21.15.144:0/2615258264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbc4158e50 0x7fcbc4152fa0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fcbac02a290 tx=0x7fcbac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:54.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.949+0000 7fcbc0c00640 1 -- 172.21.15.144:0/2615258264 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac041020 con 0x7fcbc4158e50 2024-09-11T23:24:54.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.949+0000 7fcbc0c00640 1 -- 172.21.15.144:0/2615258264 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbac003c50 con 0x7fcbc4158e50 2024-09-11T23:24:54.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.949+0000 7fcbcae00640 1 -- 172.21.15.144:0/2615258264 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbc4153b80 con 0x7fcbc4158e50 2024-09-11T23:24:54.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.950+0000 7fcbc0c00640 1 -- 172.21.15.144:0/2615258264 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac004030 con 0x7fcbc4158e50 2024-09-11T23:24:54.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.950+0000 7fcbcae00640 1 -- 172.21.15.144:0/2615258264 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbc4151af0 con 0x7fcbc4158e50 2024-09-11T23:24:54.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.951+0000 7fcbcae00640 1 -- 172.21.15.144:0/2615258264 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbc40ce200 con 0x7fcbc4158e50 2024-09-11T23:24:54.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.952+0000 7fcbc0c00640 1 -- 172.21.15.144:0/2615258264 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7fcbac044020 con 0x7fcbc4158e50 2024-09-11T23:24:54.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.952+0000 7fcbc0c00640 1 --2- 172.21.15.144:0/2615258264 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcba006c3d0 0x7fcba006e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:54.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.952+0000 7fcbc0c00640 1 -- 172.21.15.144:0/2615258264 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7fcbac0ac360 con 0x7fcbc4158e50 2024-09-11T23:24:54.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.953+0000 7fcbc3e00640 1 --2- 172.21.15.144:0/2615258264 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcba006c3d0 0x7fcba006e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:54.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.953+0000 7fcbc3e00640 1 --2- 172.21.15.144:0/2615258264 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcba006c3d0 0x7fcba006e890 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4000f60 tx=0x7fcbb4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:54.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:54.957+0000 7fcbc0c00640 1 -- 172.21.15.144:0/2615258264 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcbac04b030 con 0x7fcbc4158e50 2024-09-11T23:24:55.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.164+0000 7fcbcae00640 1 -- 172.21.15.144:0/2615258264 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "non_existent_subvolume", "clone_name": "clone_1", "target": ["mon-mgr", ""]}) -- 0x7fcbc4071f70 con 0x7fcba006c3d0 2024-09-11T23:24:55.166 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:55.166+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:55.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.166+0000 7fcbc0c00640 1 -- 172.21.15.144:0/2615258264 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fcbc4071f70 con 0x7fcba006c3d0 2024-09-11T23:24:55.167 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:55.176 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:55.177 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create non_existent_subvolume group_1 2024-09-11T23:24:55.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.333+0000 7f400ca00640 1 Processor -- start 2024-09-11T23:24:55.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.333+0000 7f400ca00640 1 -- start start 2024-09-11T23:24:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.335+0000 7f400ca00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4008073cf0 0x7f400806d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.335+0000 7f400ca00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f40080b63b0 0x7f400806bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.335+0000 7f400ca00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4008147c00 con 0x7f4008147820 2024-09-11T23:24:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.335+0000 7f400ca00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f40080741d0 con 0x7f4008073cf0 2024-09-11T23:24:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.335+0000 7f400ca00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4008162160 con 0x7f40080b63b0 2024-09-11T23:24:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.335+0000 7f3ffea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4008073cf0 0x7f400806d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.335+0000 7f3ffea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4008073cf0 0x7f400806d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59066/0 (socket says 172.21.15.144:59066) 2024-09-11T23:24:55.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.335+0000 7f3ffea00640 1 -- 172.21.15.144:0/2348151037 learned_addr learned my addr 172.21.15.144:0/2348151037 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:55.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.335+0000 7f4007e00640 1 --2- 172.21.15.144:0/2348151037 >> v2:172.21.15.165:3300/0 conn(0x7f40080b63b0 0x7f400806bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:55.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.335+0000 7f3ffea00640 1 -- 172.21.15.144:0/2348151037 >> v2:172.21.15.165:3300/0 conn(0x7f40080b63b0 msgr2=0x7f400806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:55.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.335+0000 7f3ffea00640 1 --2- 172.21.15.144:0/2348151037 >> v2:172.21.15.165:3300/0 conn(0x7f40080b63b0 0x7f400806bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:55.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.335+0000 7f3ffea00640 1 -- 172.21.15.144:0/2348151037 >> v1:172.21.15.165:6789/0 conn(0x7f4008147820 legacy=0x7f40080b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:55.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.335+0000 7f3ffea00640 1 -- 172.21.15.144:0/2348151037 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4008162440 con 0x7f4008073cf0 2024-09-11T23:24:55.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.337+0000 7f3ffea00640 1 --2- 172.21.15.144:0/2348151037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4008073cf0 0x7f400806d7a0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f40080d2310 tx=0x7f3ff002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d60c784243bb02 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:55.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.337+0000 7f4006a00640 1 -- 172.21.15.144:0/2348151037 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0037070 con 0x7f4008073cf0 2024-09-11T23:24:55.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.337+0000 7f4006a00640 1 -- 172.21.15.144:0/2348151037 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff0032440 con 0x7f4008073cf0 2024-09-11T23:24:55.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.337+0000 7f4006a00640 1 -- 172.21.15.144:0/2348151037 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0032810 con 0x7f4008073cf0 2024-09-11T23:24:55.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.337+0000 7f400ca00640 1 -- 172.21.15.144:0/2348151037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4008073cf0 msgr2=0x7f400806d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:55.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.337+0000 7f400ca00640 1 --2- 172.21.15.144:0/2348151037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4008073cf0 0x7f400806d7a0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f40080d2310 tx=0x7f3ff002a270 comp rx=0 tx=0).stop 2024-09-11T23:24:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.337+0000 7f400ca00640 1 -- 172.21.15.144:0/2348151037 shutdown_connections 2024-09-11T23:24:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.337+0000 7f400ca00640 1 --2- 172.21.15.144:0/2348151037 >> v2:172.21.15.165:3300/0 conn(0x7f40080b63b0 0x7f400806bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.337+0000 7f400ca00640 1 --2- 172.21.15.144:0/2348151037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4008073cf0 0x7f400806d7a0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.337+0000 7f400ca00640 1 -- 172.21.15.144:0/2348151037 >> 172.21.15.144:0/2348151037 conn(0x7f400806ccb0 msgr2=0x7f400806d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.338+0000 7f400ca00640 1 -- 172.21.15.144:0/2348151037 shutdown_connections 2024-09-11T23:24:55.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.338+0000 7f400ca00640 1 -- 172.21.15.144:0/2348151037 wait complete. 2024-09-11T23:24:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.339+0000 7f400ca00640 1 Processor -- start 2024-09-11T23:24:55.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.339+0000 7f400ca00640 1 -- start start 2024-09-11T23:24:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.340+0000 7f400ca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4008073cf0 0x7f4008161a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.340+0000 7f400ca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f40080b63b0 0x7f400815dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.340+0000 7f400ca00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4008147820 0x7f40081601d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.340+0000 7f400ca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4008162f20 con 0x7f4008073cf0 2024-09-11T23:24:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.340+0000 7f400ca00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4008162a00 con 0x7f4008147820 2024-09-11T23:24:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.340+0000 7f400ca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4008148280 con 0x7f40080b63b0 2024-09-11T23:24:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.340+0000 7f4007400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4008073cf0 0x7f4008161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:55.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.340+0000 7f4007400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4008073cf0 0x7f4008161a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59074/0 (socket says 172.21.15.144:59074) 2024-09-11T23:24:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.340+0000 7f4007400640 1 -- 172.21.15.144:0/2928686117 learned_addr learned my addr 172.21.15.144:0/2928686117 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.340+0000 7f4007e00640 1 --2- 172.21.15.144:0/2928686117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4008147820 0x7f40081601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.340+0000 7f3ffea00640 1 --2- 172.21.15.144:0/2928686117 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f40080b63b0 0x7f400815dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.341+0000 7f4007400640 1 -- 172.21.15.144:0/2928686117 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f40080b63b0 msgr2=0x7f400815dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.341+0000 7f4007400640 1 --2- 172.21.15.144:0/2928686117 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f40080b63b0 0x7f400815dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.341+0000 7f4007400640 1 -- 172.21.15.144:0/2928686117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4008147820 msgr2=0x7f40081601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.341+0000 7f4007400640 1 --2- 172.21.15.144:0/2928686117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4008147820 0x7f40081601d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.341+0000 7f4007400640 1 -- 172.21.15.144:0/2928686117 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4008160710 con 0x7f4008073cf0 2024-09-11T23:24:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.341+0000 7f4007400640 1 --2- 172.21.15.144:0/2928686117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4008073cf0 0x7f4008161a50 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800c430 tx=0x7f3ff800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.341+0000 7f3fffe00640 1 -- 172.21.15.144:0/2928686117 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff80052d0 con 0x7f4008073cf0 2024-09-11T23:24:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.341+0000 7f3fffe00640 1 -- 172.21.15.144:0/2928686117 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff8005490 con 0x7f4008073cf0 2024-09-11T23:24:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.341+0000 7f400ca00640 1 -- 172.21.15.144:0/2928686117 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40081609b0 con 0x7f4008073cf0 2024-09-11T23:24:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.341+0000 7f3fffe00640 1 -- 172.21.15.144:0/2928686117 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8007260 con 0x7f4008073cf0 2024-09-11T23:24:55.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.341+0000 7f400ca00640 1 -- 172.21.15.144:0/2928686117 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4008160f70 con 0x7f4008073cf0 2024-09-11T23:24:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.342+0000 7f400ca00640 1 -- 172.21.15.144:0/2928686117 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f400806d7a0 con 0x7f4008073cf0 2024-09-11T23:24:55.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.343+0000 7f3fffe00640 1 -- 172.21.15.144:0/2928686117 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 22) ==== 91008+0+0 (secure 0 0 0) 0x7f3ff8007400 con 0x7f4008073cf0 2024-09-11T23:24:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.344+0000 7f3fffe00640 1 --2- 172.21.15.144:0/2928686117 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3fe406c3d0 0x7f3fe406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.344+0000 7f3fffe00640 1 -- 172.21.15.144:0/2928686117 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f3ff808ad70 con 0x7f4008073cf0 2024-09-11T23:24:55.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.345+0000 7f3ffea00640 1 --2- 172.21.15.144:0/2928686117 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3fe406c3d0 0x7f3fe406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:55.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.345+0000 7f3ffea00640 1 --2- 172.21.15.144:0/2928686117 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3fe406c3d0 0x7f3fe406e890 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0034000 tx=0x7f3ff002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:55.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.348+0000 7f3fffe00640 1 -- 172.21.15.144:0/2928686117 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3ff8058820 con 0x7f4008073cf0 2024-09-11T23:24:55.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.545+0000 7f400ca00640 1 -- 172.21.15.144:0/2928686117 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) -- 0x7f4008148060 con 0x7f3fe406c3d0 2024-09-11T23:24:55.547 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:55.547+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:55.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.547+0000 7f3fffe00640 1 -- 172.21.15.144:0/2928686117 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f4008148060 con 0x7f3fe406c3d0 2024-09-11T23:24:55.547 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:55.557 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:55.557 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm non_existent_subvolume group_1 2024-09-11T23:24:55.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.716+0000 7fdc9d000640 1 Processor -- start 2024-09-11T23:24:55.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.716+0000 7fdc9d000640 1 -- start start 2024-09-11T23:24:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.717+0000 7fdc9d000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fdc9806d610 0x7fdc9806d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.717+0000 7fdc9d000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc9815eaa0 con 0x7fdc9815e6c0 2024-09-11T23:24:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.717+0000 7fdc9d000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc9806df30 con 0x7fdc980cf510 2024-09-11T23:24:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.717+0000 7fdc9d000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fdc980d34d0 con 0x7fdc9806d610 2024-09-11T23:24:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.718+0000 7fdc97400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdc9815e6c0 0x7fdc9806c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37322/0 (socket says 172.21.15.144:37322) 2024-09-11T23:24:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.718+0000 7fdc97400640 1 -- 172.21.15.144:0/3018180959 learned_addr learned my addr 172.21.15.144:0/3018180959 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.718+0000 7fdc97e00640 1 --2- 172.21.15.144:0/3018180959 >> v2:172.21.15.165:3300/0 conn(0x7fdc9806d610 0x7fdc9806d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.718+0000 7fdc96000640 1 -- 172.21.15.144:0/3018180959 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 319285989 0 0) 0x7fdc9815eaa0 con 0x7fdc9815e6c0 2024-09-11T23:24:55.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.718+0000 7fdc96000640 1 -- 172.21.15.144:0/3018180959 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc7c003520 con 0x7fdc9815e6c0 2024-09-11T23:24:55.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.718+0000 7fdc96000640 1 -- 172.21.15.144:0/3018180959 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1885899683 0 0) 0x7fdc9806df30 con 0x7fdc980cf510 2024-09-11T23:24:55.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.718+0000 7fdc96000640 1 -- 172.21.15.144:0/3018180959 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc9815eaa0 con 0x7fdc980cf510 2024-09-11T23:24:55.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.718+0000 7fdc97e00640 1 -- 172.21.15.144:0/3018180959 >> v1:172.21.15.165:6789/0 conn(0x7fdc980cf510 legacy=0x7fdc980b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:55.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.718+0000 7fdc97e00640 1 -- 172.21.15.144:0/3018180959 >> v1:172.21.15.144:6789/0 conn(0x7fdc9815e6c0 legacy=0x7fdc9806c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:55.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.718+0000 7fdc97e00640 1 -- 172.21.15.144:0/3018180959 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc980d28c0 con 0x7fdc9806d610 2024-09-11T23:24:55.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.719+0000 7fdc97e00640 1 --2- 172.21.15.144:0/3018180959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc9806d610 0x7fdc9806d9f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009d90 tx=0x7fdc9002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f676cacc082b558 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:55.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.719+0000 7fdc96000640 1 -- 172.21.15.144:0/3018180959 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90007740 con 0x7fdc9806d610 2024-09-11T23:24:55.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.719+0000 7fdc96000640 1 -- 172.21.15.144:0/3018180959 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc900078e0 con 0x7fdc9806d610 2024-09-11T23:24:55.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.719+0000 7fdc96000640 1 -- 172.21.15.144:0/3018180959 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90007c90 con 0x7fdc9806d610 2024-09-11T23:24:55.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.720+0000 7fdc9d000640 1 -- 172.21.15.144:0/3018180959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc9806d610 msgr2=0x7fdc9806d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:55.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.720+0000 7fdc9d000640 1 --2- 172.21.15.144:0/3018180959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc9806d610 0x7fdc9806d9f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009d90 tx=0x7fdc9002a6f0 comp rx=0 tx=0).stop 2024-09-11T23:24:55.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.720+0000 7fdc9d000640 1 -- 172.21.15.144:0/3018180959 shutdown_connections 2024-09-11T23:24:55.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.720+0000 7fdc9d000640 1 --2- 172.21.15.144:0/3018180959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc9806d610 0x7fdc9806d9f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:55.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.720+0000 7fdc9d000640 1 -- 172.21.15.144:0/3018180959 >> 172.21.15.144:0/3018180959 conn(0x7fdc980d4720 msgr2=0x7fdc980d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:55.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.720+0000 7fdc9d000640 1 -- 172.21.15.144:0/3018180959 shutdown_connections 2024-09-11T23:24:55.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.720+0000 7fdc9d000640 1 -- 172.21.15.144:0/3018180959 wait complete. 2024-09-11T23:24:55.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.722+0000 7fdc9d000640 1 Processor -- start 2024-09-11T23:24:55.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.722+0000 7fdc9d000640 1 -- start start 2024-09-11T23:24:55.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.723+0000 7fdc9d000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc9806d610 0x7fdc981f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:55.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.723+0000 7fdc9d000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc980cf510 0x7fdc98160510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:55.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.723+0000 7fdc9d000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc9815e6c0 0x7fdc98160a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:55.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.723+0000 7fdc9d000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdc980d3160 con 0x7fdc9815e6c0 2024-09-11T23:24:55.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.723+0000 7fdc9d000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdc980d2e80 con 0x7fdc980cf510 2024-09-11T23:24:55.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.723+0000 7fdc9d000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdc980b7d80 con 0x7fdc9806d610 2024-09-11T23:24:55.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.723+0000 7fdc97e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc9815e6c0 0x7fdc98160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:55.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.723+0000 7fdc97e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc9815e6c0 0x7fdc98160a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59084/0 (socket says 172.21.15.144:59084) 2024-09-11T23:24:55.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.723+0000 7fdc97e00640 1 -- 172.21.15.144:0/1361568067 learned_addr learned my addr 172.21.15.144:0/1361568067 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:55.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.723+0000 7fdc97400640 1 --2- 172.21.15.144:0/1361568067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc9806d610 0x7fdc981f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:55.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.723+0000 7fdc96a00640 1 --2- 172.21.15.144:0/1361568067 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc980cf510 0x7fdc98160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:55.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.723+0000 7fdc97e00640 1 -- 172.21.15.144:0/1361568067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc9806d610 msgr2=0x7fdc981f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:55.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.723+0000 7fdc97e00640 1 --2- 172.21.15.144:0/1361568067 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc9806d610 0x7fdc981f4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:55.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.723+0000 7fdc97e00640 1 -- 172.21.15.144:0/1361568067 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc980cf510 msgr2=0x7fdc98160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:55.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.723+0000 7fdc97e00640 1 --2- 172.21.15.144:0/1361568067 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc980cf510 0x7fdc98160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:55.725 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.723+0000 7fdc97e00640 1 -- 172.21.15.144:0/1361568067 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc980b18c0 con 0x7fdc9815e6c0 2024-09-11T23:24:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.724+0000 7fdc97e00640 1 --2- 172.21.15.144:0/1361568067 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc9815e6c0 0x7fdc98160a50 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009eb0 tx=0x7fdc90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.724+0000 7fdc8f400640 1 -- 172.21.15.144:0/1361568067 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90009450 con 0x7fdc9815e6c0 2024-09-11T23:24:55.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.724+0000 7fdc8f400640 1 -- 172.21.15.144:0/1361568067 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc90004260 con 0x7fdc9815e6c0 2024-09-11T23:24:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.724+0000 7fdc8f400640 1 -- 172.21.15.144:0/1361568067 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc90004650 con 0x7fdc9815e6c0 2024-09-11T23:24:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.724+0000 7fdc9d000640 1 -- 172.21.15.144:0/1361568067 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc980b1ba0 con 0x7fdc9815e6c0 2024-09-11T23:24:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.724+0000 7fdc9d000640 1 -- 172.21.15.144:0/1361568067 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc980b2160 con 0x7fdc9815e6c0 2024-09-11T23:24:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.725+0000 7fdc9d000640 1 -- 172.21.15.144:0/1361568067 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc980b7670 con 0x7fdc9815e6c0 2024-09-11T23:24:55.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.726+0000 7fdc8f400640 1 -- 172.21.15.144:0/1361568067 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7fdc9003b410 con 0x7fdc9815e6c0 2024-09-11T23:24:55.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.727+0000 7fdc8f400640 1 --2- 172.21.15.144:0/1361568067 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdc7806c460 0x7fdc7806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:55.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.727+0000 7fdc8f400640 1 -- 172.21.15.144:0/1361568067 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7fdc900acdb0 con 0x7fdc9815e6c0 2024-09-11T23:24:55.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.727+0000 7fdc97400640 1 --2- 172.21.15.144:0/1361568067 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdc7806c460 0x7fdc7806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:55.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.728+0000 7fdc97400640 1 --2- 172.21.15.144:0/1361568067 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdc7806c460 0x7fdc7806e920 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdc88000f60 tx=0x7fdc88009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:55.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.731+0000 7fdc8f400640 1 -- 172.21.15.144:0/1361568067 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc9003f030 con 0x7fdc9815e6c0 2024-09-11T23:24:55.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.928+0000 7fdc9d000640 1 -- 172.21.15.144:0/1361568067 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) -- 0x7fdc980d2600 con 0x7fdc7806c460 2024-09-11T23:24:55.931 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:55.931+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:55.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:55.930+0000 7fdc8f400640 1 -- 172.21.15.144:0/1361568067 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fdc980d2600 con 0x7fdc7806c460 2024-09-11T23:24:55.931 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:55.941 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:55.942 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup getpath non_existent_subvolume group_1 2024-09-11T23:24:56.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.097+0000 7fbbaca00640 1 Processor -- start 2024-09-11T23:24:56.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.098+0000 7fbbaca00640 1 -- start start 2024-09-11T23:24:56.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.099+0000 7fbbaca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbba815d790 0x7fbba80cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:56.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.099+0000 7fbbaca00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbba806d700 con 0x7fbba815d3b0 2024-09-11T23:24:56.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.099+0000 7fbbaca00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbba80cde80 con 0x7fbba80cd3b0 2024-09-11T23:24:56.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.099+0000 7fbbaca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbba806da30 con 0x7fbba815d790 2024-09-11T23:24:56.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.099+0000 7fbba5e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbba815d3b0 0x7fbba8071080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37324/0 (socket says 172.21.15.144:37324) 2024-09-11T23:24:56.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.099+0000 7fbba5e00640 1 -- 172.21.15.144:0/270279880 learned_addr learned my addr 172.21.15.144:0/270279880 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:56.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.099+0000 7fbb9d400640 1 --2- 172.21.15.144:0/270279880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbba815d790 0x7fbba80cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:56.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.099+0000 7fbba5400640 1 -- 172.21.15.144:0/270279880 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 57083814 0 0) 0x7fbba806d700 con 0x7fbba815d3b0 2024-09-11T23:24:56.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.100+0000 7fbba5400640 1 -- 172.21.15.144:0/270279880 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb8c003520 con 0x7fbba815d3b0 2024-09-11T23:24:56.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.100+0000 7fbba5400640 1 -- 172.21.15.144:0/270279880 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3072956057 0 0) 0x7fbb8c003520 con 0x7fbba815d3b0 2024-09-11T23:24:56.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.100+0000 7fbba5400640 1 -- 172.21.15.144:0/270279880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbba815d790 msgr2=0x7fbba80cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:56.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.100+0000 7fbba5400640 1 --2- 172.21.15.144:0/270279880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbba815d790 0x7fbba80cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:56.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.100+0000 7fbba5400640 1 -- 172.21.15.144:0/270279880 >> v1:172.21.15.165:6789/0 conn(0x7fbba80cd3b0 legacy=0x7fbba80cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:56.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.100+0000 7fbba5400640 1 -- 172.21.15.144:0/270279880 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba80cd8c0 con 0x7fbba815d3b0 2024-09-11T23:24:56.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.100+0000 7fbba5400640 1 -- 172.21.15.144:0/270279880 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fbb98001690 con 0x7fbba815d3b0 2024-09-11T23:24:56.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.100+0000 7fbba5400640 1 -- 172.21.15.144:0/270279880 >> v1:172.21.15.144:6789/0 conn(0x7fbba815d3b0 legacy=0x7fbba8071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:56.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.100+0000 7fbba5400640 1 --2- 172.21.15.144:0/270279880 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb8c0039e0 0x7fbb8c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:56.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.100+0000 7fbba5400640 1 --2- 172.21.15.144:0/270279880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb8c004800 0x7fbb8c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:56.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.100+0000 7fbba5400640 1 --2- 172.21.15.144:0/270279880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb8c005180 0x7fbb8c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:56.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.100+0000 7fbba5400640 1 -- 172.21.15.144:0/270279880 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbba806da30 con 0x7fbb8c005180 2024-09-11T23:24:56.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.100+0000 7fbba5400640 1 -- 172.21.15.144:0/270279880 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c00bf00 con 0x7fbb8c0039e0 2024-09-11T23:24:56.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.100+0000 7fbba5400640 1 -- 172.21.15.144:0/270279880 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbb8c00c080 con 0x7fbb8c004800 2024-09-11T23:24:56.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.100+0000 7fbba6800640 1 --2- 172.21.15.144:0/270279880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb8c005180 0x7fbb8c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:56.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.100+0000 7fbba5e00640 1 --2- 172.21.15.144:0/270279880 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb8c0039e0 0x7fbb8c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:56.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.100+0000 7fbb9d400640 1 --2- 172.21.15.144:0/270279880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb8c004800 0x7fbb8c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:56.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.101+0000 7fbba6800640 1 -- 172.21.15.144:0/270279880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb8c004800 msgr2=0x7fbb8c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:56.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.101+0000 7fbba6800640 1 --2- 172.21.15.144:0/270279880 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb8c004800 0x7fbb8c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:56.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.101+0000 7fbba6800640 1 -- 172.21.15.144:0/270279880 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb8c0039e0 msgr2=0x7fbb8c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:56.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.101+0000 7fbba6800640 1 --2- 172.21.15.144:0/270279880 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb8c0039e0 0x7fbb8c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:56.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.101+0000 7fbba6800640 1 -- 172.21.15.144:0/270279880 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8c003520 con 0x7fbb8c005180 2024-09-11T23:24:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.102+0000 7fbba6800640 1 --2- 172.21.15.144:0/270279880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb8c005180 0x7fbb8c00b9c0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fbba0001e50 tx=0x7fbb8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372f6e4eb9290bbe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.102+0000 7fbba5400640 1 -- 172.21.15.144:0/270279880 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0001a70 con 0x7fbb8c005180 2024-09-11T23:24:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.102+0000 7fbba5400640 1 -- 172.21.15.144:0/270279880 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba002ae50 con 0x7fbb8c005180 2024-09-11T23:24:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.102+0000 7fbba5400640 1 -- 172.21.15.144:0/270279880 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0003bb0 con 0x7fbb8c005180 2024-09-11T23:24:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.102+0000 7fbbaca00640 1 -- 172.21.15.144:0/270279880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb8c005180 msgr2=0x7fbb8c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.102+0000 7fbbaca00640 1 --2- 172.21.15.144:0/270279880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb8c005180 0x7fbb8c00b9c0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fbba0001e50 tx=0x7fbb8c005830 comp rx=0 tx=0).stop 2024-09-11T23:24:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.102+0000 7fbba6800640 1 -- 172.21.15.144:0/270279880 reap_dead start 2024-09-11T23:24:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.103+0000 7fbbaca00640 1 -- 172.21.15.144:0/270279880 shutdown_connections 2024-09-11T23:24:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.103+0000 7fbbaca00640 1 -- 172.21.15.144:0/270279880 >> 172.21.15.144:0/270279880 conn(0x7fbba806bba0 msgr2=0x7fbba806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:56.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.103+0000 7fbbaca00640 1 -- 172.21.15.144:0/270279880 shutdown_connections 2024-09-11T23:24:56.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.103+0000 7fbbaca00640 1 -- 172.21.15.144:0/270279880 wait complete. 2024-09-11T23:24:56.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.104+0000 7fbbaca00640 1 Processor -- start 2024-09-11T23:24:56.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.104+0000 7fbbaca00640 1 -- start start 2024-09-11T23:24:56.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.105+0000 7fbbaca00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb8c005180 0x7fbba81f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:56.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.105+0000 7fbbaca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbba80b4010 0x7fbba8152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.105+0000 7fbbaca00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbba80ae8e0 0x7fbba80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.105+0000 7fbbaca00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbba815cd70 con 0x7fbba80b4010 2024-09-11T23:24:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.105+0000 7fbbaca00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbba815cbf0 con 0x7fbba80ae8e0 2024-09-11T23:24:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.105+0000 7fbbaca00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbba80cfa30 con 0x7fbb8c005180 2024-09-11T23:24:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.106+0000 7fbb9d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbba80b4010 0x7fbba8152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.106+0000 7fbb9d400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbba80b4010 0x7fbba8152cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59098/0 (socket says 172.21.15.144:59098) 2024-09-11T23:24:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.106+0000 7fbb9d400640 1 -- 172.21.15.144:0/594000390 learned_addr learned my addr 172.21.15.144:0/594000390 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.106+0000 7fbba5e00640 1 --2- 172.21.15.144:0/594000390 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb8c005180 0x7fbba81f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.106+0000 7fbba6800640 1 --2- 172.21.15.144:0/594000390 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbba80ae8e0 0x7fbba80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.106+0000 7fbb9d400640 1 -- 172.21.15.144:0/594000390 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb8c005180 msgr2=0x7fbba81f42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.106+0000 7fbb9d400640 1 --2- 172.21.15.144:0/594000390 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb8c005180 0x7fbba81f42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.106+0000 7fbb9d400640 1 -- 172.21.15.144:0/594000390 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbba80ae8e0 msgr2=0x7fbba80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.106+0000 7fbb9d400640 1 --2- 172.21.15.144:0/594000390 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbba80ae8e0 0x7fbba80aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.106+0000 7fbb9d400640 1 -- 172.21.15.144:0/594000390 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba81f4940 con 0x7fbba80b4010 2024-09-11T23:24:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.106+0000 7fbb9d400640 1 --2- 172.21.15.144:0/594000390 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbba80b4010 0x7fbba8152cc0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fbb90011990 tx=0x7fbb90011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.107+0000 7fbb9ea00640 1 -- 172.21.15.144:0/594000390 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb90005ba0 con 0x7fbba80b4010 2024-09-11T23:24:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.107+0000 7fbb9ea00640 1 -- 172.21.15.144:0/594000390 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb90005d40 con 0x7fbba80b4010 2024-09-11T23:24:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.107+0000 7fbb9ea00640 1 -- 172.21.15.144:0/594000390 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9000fae0 con 0x7fbba80b4010 2024-09-11T23:24:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.107+0000 7fbbaca00640 1 -- 172.21.15.144:0/594000390 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbba81f4c20 con 0x7fbba80b4010 2024-09-11T23:24:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.107+0000 7fbbaca00640 1 -- 172.21.15.144:0/594000390 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbba81f51e0 con 0x7fbba80b4010 2024-09-11T23:24:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.108+0000 7fbbaca00640 1 -- 172.21.15.144:0/594000390 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbba815e910 con 0x7fbba80b4010 2024-09-11T23:24:56.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.109+0000 7fbb9ea00640 1 -- 172.21.15.144:0/594000390 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7fbb90012040 con 0x7fbba80b4010 2024-09-11T23:24:56.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.109+0000 7fbb9ea00640 1 --2- 172.21.15.144:0/594000390 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbb8406c490 0x7fbb8406e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:56.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.110+0000 7fbb9ea00640 1 -- 172.21.15.144:0/594000390 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7fbb9008bf50 con 0x7fbba80b4010 2024-09-11T23:24:56.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.110+0000 7fbba5e00640 1 --2- 172.21.15.144:0/594000390 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbb8406c490 0x7fbb8406e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:56.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.111+0000 7fbba5e00640 1 --2- 172.21.15.144:0/594000390 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbb8406c490 0x7fbb8406e950 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbba806d8d0 tx=0x7fbb980078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:56.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.114+0000 7fbb9ea00640 1 -- 172.21.15.144:0/594000390 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb90018030 con 0x7fbba80b4010 2024-09-11T23:24:56.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.309+0000 7fbbaca00640 1 -- 172.21.15.144:0/594000390 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup getpath", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) -- 0x7fbba8156e20 con 0x7fbb8406c490 2024-09-11T23:24:56.311 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:56.311+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:56.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.311+0000 7fbb9ea00640 1 -- 172.21.15.144:0/594000390 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fbba8156e20 con 0x7fbb8406c490 2024-09-11T23:24:56.311 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:56.322 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:56.322 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup pin non_existent_subvolume group_1 export 0 2024-09-11T23:24:56.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.479+0000 7f5628200640 1 Processor -- start 2024-09-11T23:24:56.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.479+0000 7f5628200640 1 -- start start 2024-09-11T23:24:56.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.481+0000 7f5628200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5620145d90 0x7f56200ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:56.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.481+0000 7f5628200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56200b4240 con 0x7f56200cfce0 2024-09-11T23:24:56.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.481+0000 7f5628200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56200b4520 con 0x7f56200cd490 2024-09-11T23:24:56.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.481+0000 7f5628200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f562006d080 con 0x7f5620145d90 2024-09-11T23:24:56.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.481+0000 7f5626200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f56200cfce0 0x7f562006d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37328/0 (socket says 172.21.15.144:37328) 2024-09-11T23:24:56.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.481+0000 7f5626200640 1 -- 172.21.15.144:0/2016975307 learned_addr learned my addr 172.21.15.144:0/2016975307 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:56.482 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.481+0000 7f5625800640 1 --2- 172.21.15.144:0/2016975307 >> v2:172.21.15.165:3300/0 conn(0x7f5620145d90 0x7f56200ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:56.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.481+0000 7f561fe00640 1 -- 172.21.15.144:0/2016975307 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 149123553 0 0) 0x7f56200b4240 con 0x7f56200cfce0 2024-09-11T23:24:56.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.482+0000 7f561fe00640 1 -- 172.21.15.144:0/2016975307 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5608003520 con 0x7f56200cfce0 2024-09-11T23:24:56.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.482+0000 7f5625800640 1 -- 172.21.15.144:0/2016975307 >> v1:172.21.15.165:6789/0 conn(0x7f56200cd490 legacy=0x7f56200cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:56.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.482+0000 7f561fe00640 1 -- 172.21.15.144:0/2016975307 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 251873409 0 0) 0x7f56200b4520 con 0x7f56200cd490 2024-09-11T23:24:56.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.482+0000 7f5625800640 1 -- 172.21.15.144:0/2016975307 >> v1:172.21.15.144:6789/0 conn(0x7f56200cfce0 legacy=0x7f562006d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:56.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.482+0000 7f5625800640 1 -- 172.21.15.144:0/2016975307 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56200b4800 con 0x7f5620145d90 2024-09-11T23:24:56.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.483+0000 7f5625800640 1 --2- 172.21.15.144:0/2016975307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5620145d90 0x7f56200ccf50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f56140097a0 tx=0x7f561402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9424b6bf1c22f3b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:56.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.483+0000 7f561fe00640 1 -- 172.21.15.144:0/2016975307 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5614037070 con 0x7f5620145d90 2024-09-11T23:24:56.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.483+0000 7f561fe00640 1 -- 172.21.15.144:0/2016975307 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5614032440 con 0x7f5620145d90 2024-09-11T23:24:56.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.483+0000 7f561fe00640 1 -- 172.21.15.144:0/2016975307 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5614032810 con 0x7f5620145d90 2024-09-11T23:24:56.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.483+0000 7f5628200640 1 -- 172.21.15.144:0/2016975307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5620145d90 msgr2=0x7f56200ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:56.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.483+0000 7f5628200640 1 --2- 172.21.15.144:0/2016975307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5620145d90 0x7f56200ccf50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f56140097a0 tx=0x7f561402a230 comp rx=0 tx=0).stop 2024-09-11T23:24:56.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.484+0000 7f5628200640 1 -- 172.21.15.144:0/2016975307 shutdown_connections 2024-09-11T23:24:56.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.484+0000 7f5628200640 1 --2- 172.21.15.144:0/2016975307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5620145d90 0x7f56200ccf50 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:56.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.484+0000 7f5628200640 1 -- 172.21.15.144:0/2016975307 >> 172.21.15.144:0/2016975307 conn(0x7f562006bba0 msgr2=0x7f562006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:56.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.484+0000 7f5628200640 1 -- 172.21.15.144:0/2016975307 shutdown_connections 2024-09-11T23:24:56.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.484+0000 7f5628200640 1 -- 172.21.15.144:0/2016975307 wait complete. 2024-09-11T23:24:56.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.485+0000 7f5628200640 1 Processor -- start 2024-09-11T23:24:56.486 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.485+0000 7f5628200640 1 -- start start 2024-09-11T23:24:56.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.486+0000 7f5628200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56200cd490 0x7f56201f38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:56.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.486+0000 7f5628200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56200cfce0 0x7f56200cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:56.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.486+0000 7f5628200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5620145d90 0x7f562015dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:56.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.486+0000 7f5628200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f56200b5790 con 0x7f5620145d90 2024-09-11T23:24:56.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.486+0000 7f5628200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f56200b5610 con 0x7f56200cd490 2024-09-11T23:24:56.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.486+0000 7f5628200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5620146170 con 0x7f56200cfce0 2024-09-11T23:24:56.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.487+0000 7f5626200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5620145d90 0x7f562015dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:56.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.487+0000 7f5625800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56200cd490 0x7f56201f38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:56.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.487+0000 7f5625800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56200cd490 0x7f56201f38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:49932/0 (socket says 172.21.15.144:49932) 2024-09-11T23:24:56.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.487+0000 7f5625800640 1 -- 172.21.15.144:0/845040226 learned_addr learned my addr 172.21.15.144:0/845040226 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:56.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.487+0000 7f5624e00640 1 --2- 172.21.15.144:0/845040226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56200cfce0 0x7f56200cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:56.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.487+0000 7f5625800640 1 -- 172.21.15.144:0/845040226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56200cfce0 msgr2=0x7f56200cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:56.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.487+0000 7f5625800640 1 --2- 172.21.15.144:0/845040226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56200cfce0 0x7f56200cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:56.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.487+0000 7f5625800640 1 -- 172.21.15.144:0/845040226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5620145d90 msgr2=0x7f562015dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:56.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.487+0000 7f5625800640 1 --2- 172.21.15.144:0/845040226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5620145d90 0x7f562015dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:56.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.487+0000 7f5625800640 1 -- 172.21.15.144:0/845040226 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56200cbd80 con 0x7f56200cd490 2024-09-11T23:24:56.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.487+0000 7f5626200640 1 --2- 172.21.15.144:0/845040226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5620145d90 0x7f562015dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:24:56.489 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.487+0000 7f5625800640 1 --2- 172.21.15.144:0/845040226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56200cd490 0x7f56201f38f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5614035040 tx=0x7f56140046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:56.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.488+0000 7f561d600640 1 -- 172.21.15.144:0/845040226 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5614041020 con 0x7f56200cd490 2024-09-11T23:24:56.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.488+0000 7f561d600640 1 -- 172.21.15.144:0/845040226 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f561403d6e0 con 0x7f56200cd490 2024-09-11T23:24:56.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.488+0000 7f561d600640 1 -- 172.21.15.144:0/845040226 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5614037040 con 0x7f56200cd490 2024-09-11T23:24:56.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.488+0000 7f5628200640 1 -- 172.21.15.144:0/845040226 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56200cc060 con 0x7f56200cd490 2024-09-11T23:24:56.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.488+0000 7f5628200640 1 -- 172.21.15.144:0/845040226 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56200cc620 con 0x7f56200cd490 2024-09-11T23:24:56.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.489+0000 7f5628200640 1 -- 172.21.15.144:0/845040226 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56200ccf50 con 0x7f56200cd490 2024-09-11T23:24:56.490 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.490+0000 7f561d600640 1 -- 172.21.15.144:0/845040226 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f5614044020 con 0x7f56200cd490 2024-09-11T23:24:56.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.491+0000 7f561d600640 1 --2- 172.21.15.144:0/845040226 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f560006c460 0x7f560006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:56.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.491+0000 7f561d600640 1 -- 172.21.15.144:0/845040226 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f56140ac110 con 0x7f56200cd490 2024-09-11T23:24:56.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.491+0000 7f5624e00640 1 --2- 172.21.15.144:0/845040226 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f560006c460 0x7f560006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:56.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.492+0000 7f5624e00640 1 --2- 172.21.15.144:0/845040226 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f560006c460 0x7f560006e920 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f56201f7400 tx=0x7f560c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:56.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.495+0000 7f561d600640 1 -- 172.21.15.144:0/845040226 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f561404b030 con 0x7f56200cd490 2024-09-11T23:24:56.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.694+0000 7f5628200640 1 -- 172.21.15.144:0/845040226 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "non_existent_subvolume", "group_name": "group_1", "pin_type": "export", "pin_setting": "0", "target": ["mon-mgr", ""]}) -- 0x7f56200cee90 con 0x7f560006c460 2024-09-11T23:24:56.696 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:56.696+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:56.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.697+0000 7f561d600640 1 -- 172.21.15.144:0/845040226 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f56200cee90 con 0x7f560006c460 2024-09-11T23:24:56.697 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:56.706 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:56.707 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup ls non_existent_subvolume 2024-09-11T23:24:56.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.862+0000 7f5761000640 1 Processor -- start 2024-09-11T23:24:56.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.862+0000 7f5761000640 1 -- start start 2024-09-11T23:24:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.863+0000 7f5761000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f575c0b7570 0x7f575c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.863+0000 7f5761000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f575c06e460 con 0x7f575c0b1a40 2024-09-11T23:24:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.863+0000 7f5761000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f575c06e740 con 0x7f575c15e9b0 2024-09-11T23:24:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.863+0000 7f5761000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f575c15ed90 con 0x7f575c0b7570 2024-09-11T23:24:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.863+0000 7f575a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f575c0b7570 0x7f575c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.863+0000 7f575a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f575c0b7570 0x7f575c070ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59120/0 (socket says 172.21.15.144:59120) 2024-09-11T23:24:56.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.863+0000 7f575a800640 1 -- 172.21.15.144:0/3598036451 learned_addr learned my addr 172.21.15.144:0/3598036451 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:56.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.863+0000 7f5753e00640 1 --1- 172.21.15.144:0/3598036451 >> v1:172.21.15.144:6789/0 conn(0x7f575c0b1a40 0x7f575c0731e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37340/0 (socket says 172.21.15.144:37340) 2024-09-11T23:24:56.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.864+0000 7f575a800640 1 -- 172.21.15.144:0/3598036451 >> v1:172.21.15.165:6789/0 conn(0x7f575c15e9b0 legacy=0x7f575c0b6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:56.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.864+0000 7f575a800640 1 -- 172.21.15.144:0/3598036451 >> v1:172.21.15.144:6789/0 conn(0x7f575c0b1a40 legacy=0x7f575c0731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:56.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.864+0000 7f575a800640 1 -- 172.21.15.144:0/3598036451 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575c06ea20 con 0x7f575c0b7570 2024-09-11T23:24:56.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.864+0000 7f5759400640 1 -- 172.21.15.144:0/3598036451 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2650987042 0 0) 0x7f575c06e460 con 0x7f575c0b1a40 2024-09-11T23:24:56.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.865+0000 7f575a800640 1 --2- 172.21.15.144:0/3598036451 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575c0b7570 0x7f575c070ab0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f5754009e50 tx=0x7f575402a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8085a8020b9de5f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:56.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.865+0000 7f5759400640 1 -- 172.21.15.144:0/3598036451 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754036070 con 0x7f575c0b7570 2024-09-11T23:24:56.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.865+0000 7f5759400640 1 -- 172.21.15.144:0/3598036451 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5754031600 con 0x7f575c0b7570 2024-09-11T23:24:56.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.865+0000 7f5759400640 1 -- 172.21.15.144:0/3598036451 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57540319f0 con 0x7f575c0b7570 2024-09-11T23:24:56.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.865+0000 7f5761000640 1 -- 172.21.15.144:0/3598036451 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575c0b7570 msgr2=0x7f575c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:56.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.865+0000 7f5761000640 1 --2- 172.21.15.144:0/3598036451 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575c0b7570 0x7f575c070ab0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f5754009e50 tx=0x7f575402a7c0 comp rx=0 tx=0).stop 2024-09-11T23:24:56.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.866+0000 7f5761000640 1 -- 172.21.15.144:0/3598036451 shutdown_connections 2024-09-11T23:24:56.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.866+0000 7f5761000640 1 --2- 172.21.15.144:0/3598036451 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575c0b7570 0x7f575c070ab0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:56.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.866+0000 7f5761000640 1 -- 172.21.15.144:0/3598036451 >> 172.21.15.144:0/3598036451 conn(0x7f575c06f370 msgr2=0x7f575c06f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:56.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.866+0000 7f5761000640 1 -- 172.21.15.144:0/3598036451 shutdown_connections 2024-09-11T23:24:56.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.866+0000 7f5761000640 1 -- 172.21.15.144:0/3598036451 wait complete. 2024-09-11T23:24:56.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.867+0000 7f5761000640 1 Processor -- start 2024-09-11T23:24:56.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.867+0000 7f5761000640 1 -- start start 2024-09-11T23:24:56.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.868+0000 7f5761000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f575c0b1a40 0x7f575c144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:56.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.868+0000 7f5761000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575c0b7570 0x7f575c15d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:56.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.868+0000 7f5761000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f575c15e9b0 0x7f575c1550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:56.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.868+0000 7f5761000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f575c0718e0 con 0x7f575c0b7570 2024-09-11T23:24:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.868+0000 7f5761000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f575c070ff0 con 0x7f575c0b1a40 2024-09-11T23:24:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.868+0000 7f5761000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f575c06cc40 con 0x7f575c15e9b0 2024-09-11T23:24:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.868+0000 7f5753e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575c0b7570 0x7f575c15d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.869+0000 7f5753e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575c0b7570 0x7f575c15d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59136/0 (socket says 172.21.15.144:59136) 2024-09-11T23:24:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.869+0000 7f5753e00640 1 -- 172.21.15.144:0/2778193047 learned_addr learned my addr 172.21.15.144:0/2778193047 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.869+0000 7f5759e00640 1 --2- 172.21.15.144:0/2778193047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f575c0b1a40 0x7f575c144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.869+0000 7f575a800640 1 --2- 172.21.15.144:0/2778193047 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f575c15e9b0 0x7f575c1550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.869+0000 7f5753e00640 1 -- 172.21.15.144:0/2778193047 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f575c15e9b0 msgr2=0x7f575c1550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.869+0000 7f5753e00640 1 --2- 172.21.15.144:0/2778193047 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f575c15e9b0 0x7f575c1550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.869+0000 7f5753e00640 1 -- 172.21.15.144:0/2778193047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f575c0b1a40 msgr2=0x7f575c144880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.869+0000 7f5753e00640 1 --2- 172.21.15.144:0/2778193047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f575c0b1a40 0x7f575c144880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.869+0000 7f5753e00640 1 -- 172.21.15.144:0/2778193047 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575c152c90 con 0x7f575c0b7570 2024-09-11T23:24:56.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.869+0000 7f5753e00640 1 --2- 172.21.15.144:0/2778193047 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575c0b7570 0x7f575c15d150 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f574400c3f0 tx=0x7f574400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:56.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.869+0000 7f5752000640 1 -- 172.21.15.144:0/2778193047 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57440074e0 con 0x7f575c0b7570 2024-09-11T23:24:56.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.869+0000 7f5752000640 1 -- 172.21.15.144:0/2778193047 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57440047e0 con 0x7f575c0b7570 2024-09-11T23:24:56.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.869+0000 7f5752000640 1 -- 172.21.15.144:0/2778193047 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744004bd0 con 0x7f575c0b7570 2024-09-11T23:24:56.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.869+0000 7f5761000640 1 -- 172.21.15.144:0/2778193047 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575c152f70 con 0x7f575c0b7570 2024-09-11T23:24:56.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.870+0000 7f5761000640 1 -- 172.21.15.144:0/2778193047 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f575c153530 con 0x7f575c0b7570 2024-09-11T23:24:56.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.871+0000 7f5761000640 1 -- 172.21.15.144:0/2778193047 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f575c153a20 con 0x7f575c0b7570 2024-09-11T23:24:56.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.872+0000 7f5752000640 1 -- 172.21.15.144:0/2778193047 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f5744011070 con 0x7f575c0b7570 2024-09-11T23:24:56.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.872+0000 7f5752000640 1 --2- 172.21.15.144:0/2778193047 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f573806c460 0x7f573806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:56.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.873+0000 7f5752000640 1 -- 172.21.15.144:0/2778193047 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f574408b450 con 0x7f575c0b7570 2024-09-11T23:24:56.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.873+0000 7f5759e00640 1 --2- 172.21.15.144:0/2778193047 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f573806c460 0x7f573806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:56.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.874+0000 7f5759e00640 1 --2- 172.21.15.144:0/2778193047 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f573806c460 0x7f573806e920 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f574c000f60 tx=0x7f574c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:56.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:56.877+0000 7f5752000640 1 -- 172.21.15.144:0/2778193047 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5744058f00 con 0x7f575c0b7570 2024-09-11T23:24:57.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.073+0000 7f5761000640 1 -- 172.21.15.144:0/2778193047 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup ls", "vol_name": "non_existent_subvolume", "target": ["mon-mgr", ""]}) -- 0x7f575c070ab0 con 0x7f573806c460 2024-09-11T23:24:57.075 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:57.075+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:57.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.075+0000 7f5752000640 1 -- 172.21.15.144:0/2778193047 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f575c070ab0 con 0x7f573806c460 2024-09-11T23:24:57.075 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:57.084 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:57.085 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot create non_existent_subvolume group_1 snapshot_1 2024-09-11T23:24:57.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.242+0000 7f52c8400640 1 Processor -- start 2024-09-11T23:24:57.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.242+0000 7f52c8400640 1 -- start start 2024-09-11T23:24:57.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.244+0000 7f52c8400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f52c00cf5d0 0x7f52c00cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:57.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.244+0000 7f52c8400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f52c006d4f0 0x7f52c006d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:57.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.244+0000 7f52c8400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c00b4240 con 0x7f52c0145d90 2024-09-11T23:24:57.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.244+0000 7f52c8400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f52c006d080 con 0x7f52c00cf5d0 2024-09-11T23:24:57.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.244+0000 7f52c8400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f52c00b4520 con 0x7f52c006d4f0 2024-09-11T23:24:57.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.244+0000 7f52c5000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f52c00cf5d0 0x7f52c00cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:57.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.244+0000 7f52c5000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f52c00cf5d0 0x7f52c00cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59150/0 (socket says 172.21.15.144:59150) 2024-09-11T23:24:57.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.244+0000 7f52c5000640 1 -- 172.21.15.144:0/3860095668 learned_addr learned my addr 172.21.15.144:0/3860095668 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:57.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.244+0000 7f52c6400640 1 --2- 172.21.15.144:0/3860095668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f52c006d4f0 0x7f52c006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:57.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.244+0000 7f52c5000640 1 -- 172.21.15.144:0/3860095668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f52c006d4f0 msgr2=0x7f52c006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:57.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.244+0000 7f52c5000640 1 --2- 172.21.15.144:0/3860095668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f52c006d4f0 0x7f52c006d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:57.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.244+0000 7f52c5000640 1 -- 172.21.15.144:0/3860095668 >> v1:172.21.15.144:6789/0 conn(0x7f52c0145d90 legacy=0x7f52c00ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:57.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.244+0000 7f52c5000640 1 -- 172.21.15.144:0/3860095668 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c00b4800 con 0x7f52c00cf5d0 2024-09-11T23:24:57.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.244+0000 7f52c6400640 1 --2- 172.21.15.144:0/3860095668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f52c006d4f0 0x7f52c006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:24:57.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.245+0000 7f52c5000640 1 --2- 172.21.15.144:0/3860095668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52c00cf5d0 0x7f52c00cfa40 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009870 tx=0x7f52ac02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e78f7d775ccb4c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:57.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.246+0000 7f52bfe00640 1 -- 172.21.15.144:0/3860095668 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac037070 con 0x7f52c00cf5d0 2024-09-11T23:24:57.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.246+0000 7f52bfe00640 1 -- 172.21.15.144:0/3860095668 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ac032440 con 0x7f52c00cf5d0 2024-09-11T23:24:57.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.246+0000 7f52bfe00640 1 -- 172.21.15.144:0/3860095668 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac032810 con 0x7f52c00cf5d0 2024-09-11T23:24:57.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.246+0000 7f52c8400640 1 -- 172.21.15.144:0/3860095668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52c00cf5d0 msgr2=0x7f52c00cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:57.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.246+0000 7f52c8400640 1 --2- 172.21.15.144:0/3860095668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52c00cf5d0 0x7f52c00cfa40 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009870 tx=0x7f52ac02a250 comp rx=0 tx=0).stop 2024-09-11T23:24:57.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.246+0000 7f52c8400640 1 -- 172.21.15.144:0/3860095668 shutdown_connections 2024-09-11T23:24:57.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.246+0000 7f52c8400640 1 --2- 172.21.15.144:0/3860095668 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f52c006d4f0 0x7f52c006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:57.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.246+0000 7f52c8400640 1 --2- 172.21.15.144:0/3860095668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52c00cf5d0 0x7f52c00cfa40 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:57.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.246+0000 7f52c8400640 1 -- 172.21.15.144:0/3860095668 >> 172.21.15.144:0/3860095668 conn(0x7f52c006bba0 msgr2=0x7f52c006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:57.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.246+0000 7f52c8400640 1 -- 172.21.15.144:0/3860095668 shutdown_connections 2024-09-11T23:24:57.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.246+0000 7f52c8400640 1 -- 172.21.15.144:0/3860095668 wait complete. 2024-09-11T23:24:57.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.248+0000 7f52c8400640 1 Processor -- start 2024-09-11T23:24:57.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.248+0000 7f52c8400640 1 -- start start 2024-09-11T23:24:57.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.249+0000 7f52c8400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52c006d4f0 0x7f52c0136c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:57.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.249+0000 7f52c8400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f52c00cf5d0 0x7f52c013f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:57.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.249+0000 7f52c8400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f52c0145d90 0x7f52c00ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:57.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.249+0000 7f52c8400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f52c00cd660 con 0x7f52c006d4f0 2024-09-11T23:24:57.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.249+0000 7f52c8400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f52c00cff80 con 0x7f52c0145d90 2024-09-11T23:24:57.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.249+0000 7f52c8400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f52c00b5610 con 0x7f52c00cf5d0 2024-09-11T23:24:57.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.249+0000 7f52c5a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52c006d4f0 0x7f52c0136c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:57.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.249+0000 7f52c5a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52c006d4f0 0x7f52c0136c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59152/0 (socket says 172.21.15.144:59152) 2024-09-11T23:24:57.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.249+0000 7f52c5a00640 1 -- 172.21.15.144:0/1312399133 learned_addr learned my addr 172.21.15.144:0/1312399133 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:57.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.249+0000 7f52c5000640 1 --2- 172.21.15.144:0/1312399133 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f52c00cf5d0 0x7f52c013f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:57.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.250+0000 7f52c6400640 1 --2- 172.21.15.144:0/1312399133 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f52c0145d90 0x7f52c00ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:57.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.250+0000 7f52c5a00640 1 -- 172.21.15.144:0/1312399133 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f52c00cf5d0 msgr2=0x7f52c013f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:57.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.250+0000 7f52c5a00640 1 --2- 172.21.15.144:0/1312399133 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f52c00cf5d0 0x7f52c013f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:57.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.250+0000 7f52c5a00640 1 -- 172.21.15.144:0/1312399133 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f52c0145d90 msgr2=0x7f52c00ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:57.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.250+0000 7f52c5a00640 1 --2- 172.21.15.144:0/1312399133 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f52c0145d90 0x7f52c00ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:57.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.250+0000 7f52c5a00640 1 -- 172.21.15.144:0/1312399133 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c0140d30 con 0x7f52c006d4f0 2024-09-11T23:24:57.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.250+0000 7f52c5000640 1 --2- 172.21.15.144:0/1312399133 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f52c00cf5d0 0x7f52c013f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:24:57.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.250+0000 7f52c5a00640 1 --2- 172.21.15.144:0/1312399133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52c006d4f0 0x7f52c0136c50 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f52b400c3c0 tx=0x7f52b400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:57.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.250+0000 7f52bd600640 1 -- 172.21.15.144:0/1312399133 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b40052d0 con 0x7f52c006d4f0 2024-09-11T23:24:57.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.250+0000 7f52bd600640 1 -- 172.21.15.144:0/1312399133 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b4005490 con 0x7f52c006d4f0 2024-09-11T23:24:57.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.250+0000 7f52bd600640 1 -- 172.21.15.144:0/1312399133 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b4007260 con 0x7f52c006d4f0 2024-09-11T23:24:57.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.250+0000 7f52c8400640 1 -- 172.21.15.144:0/1312399133 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c01401b0 con 0x7f52c006d4f0 2024-09-11T23:24:57.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.251+0000 7f52c8400640 1 -- 172.21.15.144:0/1312399133 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c0140770 con 0x7f52c006d4f0 2024-09-11T23:24:57.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.252+0000 7f52c8400640 1 -- 172.21.15.144:0/1312399133 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52c00ce910 con 0x7f52c006d4f0 2024-09-11T23:24:57.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.252+0000 7f52bd600640 1 -- 172.21.15.144:0/1312399133 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f52b4007400 con 0x7f52c006d4f0 2024-09-11T23:24:57.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.254+0000 7f52bd600640 1 --2- 172.21.15.144:0/1312399133 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f52a006c460 0x7f52a006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:57.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.254+0000 7f52bd600640 1 -- 172.21.15.144:0/1312399133 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f52b408ae40 con 0x7f52c006d4f0 2024-09-11T23:24:57.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.254+0000 7f52c5000640 1 --2- 172.21.15.144:0/1312399133 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f52a006c460 0x7f52a006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:57.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.255+0000 7f52c5000640 1 --2- 172.21.15.144:0/1312399133 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f52a006c460 0x7f52a006e920 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f52ac034000 tx=0x7f52ac02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:57.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.258+0000 7f52bd600640 1 -- 172.21.15.144:0/1312399133 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f52c00ce910 con 0x7f52c006d4f0 2024-09-11T23:24:57.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.456+0000 7f52c8400640 1 -- 172.21.15.144:0/1312399133 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot create", "vol_name": "non_existent_subvolume", "group_name": "group_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f52c0146170 con 0x7f52a006c460 2024-09-11T23:24:57.458 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:57.458+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:57.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.458+0000 7f52bd600640 1 -- 172.21.15.144:0/1312399133 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f52c0146170 con 0x7f52a006c460 2024-09-11T23:24:57.459 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:57.468 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:57.469 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot rm non_existent_subvolume group_1 snapshot_1 2024-09-11T23:24:57.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.630+0000 7f80b7200640 1 Processor -- start 2024-09-11T23:24:57.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.630+0000 7f80b7200640 1 -- start start 2024-09-11T23:24:57.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.632+0000 7f80b7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80b8070710 0x7f80b8070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:57.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.632+0000 7f80b7200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f80b806e8a0 0x7f80b815f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:57.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.632+0000 7f80b7200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80b8071030 con 0x7f80b815f0d0 2024-09-11T23:24:57.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.632+0000 7f80b7200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f80b806d400 con 0x7f80b806e8a0 2024-09-11T23:24:57.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.632+0000 7f80b7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f80b8162440 con 0x7f80b8070710 2024-09-11T23:24:57.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.632+0000 7f80b6800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f80b806e8a0 0x7f80b815f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:57.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.632+0000 7f80b6800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f80b806e8a0 0x7f80b815f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59160/0 (socket says 172.21.15.144:59160) 2024-09-11T23:24:57.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.632+0000 7f80b6800640 1 -- 172.21.15.144:0/2341555353 learned_addr learned my addr 172.21.15.144:0/2341555353 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:57.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.632+0000 7f80b5e00640 1 --2- 172.21.15.144:0/2341555353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80b8070710 0x7f80b8070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:57.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.632+0000 7f80b6800640 1 -- 172.21.15.144:0/2341555353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80b8070710 msgr2=0x7f80b8070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:57.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.632+0000 7f80b6800640 1 --2- 172.21.15.144:0/2341555353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80b8070710 0x7f80b8070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:57.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.633+0000 7f80b6800640 1 -- 172.21.15.144:0/2341555353 >> v1:172.21.15.165:6789/0 conn(0x7f80b815f0d0 legacy=0x7f80b8072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:57.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.633+0000 7f80b6800640 1 -- 172.21.15.144:0/2341555353 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b8162720 con 0x7f80b806e8a0 2024-09-11T23:24:57.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.633+0000 7f80b6800640 1 --2- 172.21.15.144:0/2341555353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80b806e8a0 0x7f80b815f530 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009e50 tx=0x7f80b002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74db2339ea89630 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:57.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.634+0000 7f80b5400640 1 -- 172.21.15.144:0/2341555353 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b0036070 con 0x7f80b806e8a0 2024-09-11T23:24:57.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.634+0000 7f80b5400640 1 -- 172.21.15.144:0/2341555353 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80b0031600 con 0x7f80b806e8a0 2024-09-11T23:24:57.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.634+0000 7f80b5400640 1 -- 172.21.15.144:0/2341555353 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b00319d0 con 0x7f80b806e8a0 2024-09-11T23:24:57.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.634+0000 7f80b7200640 1 -- 172.21.15.144:0/2341555353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80b806e8a0 msgr2=0x7f80b815f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:57.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.634+0000 7f80b7200640 1 --2- 172.21.15.144:0/2341555353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80b806e8a0 0x7f80b815f530 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009e50 tx=0x7f80b002a7a0 comp rx=0 tx=0).stop 2024-09-11T23:24:57.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.634+0000 7f80b7200640 1 -- 172.21.15.144:0/2341555353 shutdown_connections 2024-09-11T23:24:57.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.634+0000 7f80b7200640 1 --2- 172.21.15.144:0/2341555353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80b806e8a0 0x7f80b815f530 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:57.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.634+0000 7f80b7200640 1 --2- 172.21.15.144:0/2341555353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80b8070710 0x7f80b8070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:57.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.634+0000 7f80b7200640 1 -- 172.21.15.144:0/2341555353 >> 172.21.15.144:0/2341555353 conn(0x7f80b80b40d0 msgr2=0x7f80b80b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:57.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.634+0000 7f80b7200640 1 -- 172.21.15.144:0/2341555353 shutdown_connections 2024-09-11T23:24:57.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.634+0000 7f80b7200640 1 -- 172.21.15.144:0/2341555353 wait complete. 2024-09-11T23:24:57.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.636+0000 7f80b7200640 1 Processor -- start 2024-09-11T23:24:57.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.636+0000 7f80b7200640 1 -- start start 2024-09-11T23:24:57.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.637+0000 7f80b7200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80b806e8a0 0x7f80b8153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:57.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.637+0000 7f80b7200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80b8070710 0x7f80b8155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:57.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.637+0000 7f80b7200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80b815f0d0 0x7f80b81555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:57.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.637+0000 7f80b7200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f80b80b60d0 con 0x7f80b8070710 2024-09-11T23:24:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.637+0000 7f80b7200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f80b8162ce0 con 0x7f80b806e8a0 2024-09-11T23:24:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.637+0000 7f80b7200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f80b80b6250 con 0x7f80b815f0d0 2024-09-11T23:24:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.637+0000 7f80ad400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80b8070710 0x7f80b8155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.637+0000 7f80ad400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80b8070710 0x7f80b8155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59174/0 (socket says 172.21.15.144:59174) 2024-09-11T23:24:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.637+0000 7f80ad400640 1 -- 172.21.15.144:0/3450984608 learned_addr learned my addr 172.21.15.144:0/3450984608 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.637+0000 7f80b5e00640 1 --2- 172.21.15.144:0/3450984608 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80b806e8a0 0x7f80b8153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.637+0000 7f80b6800640 1 --2- 172.21.15.144:0/3450984608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80b815f0d0 0x7f80b81555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.638+0000 7f80ad400640 1 -- 172.21.15.144:0/3450984608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80b815f0d0 msgr2=0x7f80b81555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.638+0000 7f80ad400640 1 --2- 172.21.15.144:0/3450984608 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80b815f0d0 0x7f80b81555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.638+0000 7f80ad400640 1 -- 172.21.15.144:0/3450984608 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80b806e8a0 msgr2=0x7f80b8153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:57.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.638+0000 7f80ad400640 1 --2- 172.21.15.144:0/3450984608 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80b806e8a0 0x7f80b8153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:57.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.638+0000 7f80ad400640 1 -- 172.21.15.144:0/3450984608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b8155be0 con 0x7f80b8070710 2024-09-11T23:24:57.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.638+0000 7f80ad400640 1 --2- 172.21.15.144:0/3450984608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80b8070710 0x7f80b8155070 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f80a000c440 tx=0x7f80a000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:57.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.638+0000 7f80aea00640 1 -- 172.21.15.144:0/3450984608 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a00052d0 con 0x7f80b8070710 2024-09-11T23:24:57.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.638+0000 7f80aea00640 1 -- 172.21.15.144:0/3450984608 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a0005470 con 0x7f80b8070710 2024-09-11T23:24:57.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.638+0000 7f80b7200640 1 -- 172.21.15.144:0/3450984608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b80aff10 con 0x7f80b8070710 2024-09-11T23:24:57.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.638+0000 7f80aea00640 1 -- 172.21.15.144:0/3450984608 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a0007260 con 0x7f80b8070710 2024-09-11T23:24:57.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.638+0000 7f80b7200640 1 -- 172.21.15.144:0/3450984608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b80b04d0 con 0x7f80b8070710 2024-09-11T23:24:57.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.639+0000 7f80b7200640 1 -- 172.21.15.144:0/3450984608 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80b80b06d0 con 0x7f80b8070710 2024-09-11T23:24:57.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.640+0000 7f80aea00640 1 -- 172.21.15.144:0/3450984608 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f80a0007400 con 0x7f80b8070710 2024-09-11T23:24:57.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.641+0000 7f80aea00640 1 --2- 172.21.15.144:0/3450984608 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f809406c460 0x7f809406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:57.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.641+0000 7f80aea00640 1 -- 172.21.15.144:0/3450984608 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f80a008ad60 con 0x7f80b8070710 2024-09-11T23:24:57.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.642+0000 7f80b5e00640 1 --2- 172.21.15.144:0/3450984608 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f809406c460 0x7f809406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:57.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.642+0000 7f80b5e00640 1 --2- 172.21.15.144:0/3450984608 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f809406c460 0x7f809406e920 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f80a8006fd0 tx=0x7f80a8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:57.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.645+0000 7f80aea00640 1 -- 172.21.15.144:0/3450984608 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f80b80b06d0 con 0x7f80b8070710 2024-09-11T23:24:57.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.842+0000 7f80b7200640 1 -- 172.21.15.144:0/3450984608 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot rm", "vol_name": "non_existent_subvolume", "group_name": "group_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f80b815faf0 con 0x7f809406c460 2024-09-11T23:24:57.845 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:57.845+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:57.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:57.845+0000 7f80aea00640 1 -- 172.21.15.144:0/3450984608 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f80b815faf0 con 0x7f809406c460 2024-09-11T23:24:57.846 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:57.856 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:57.856 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot ls non_existent_subvolume group_1 2024-09-11T23:24:58.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.012+0000 7f36a4600640 1 Processor -- start 2024-09-11T23:24:58.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.012+0000 7f36a4600640 1 -- start start 2024-09-11T23:24:58.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.014+0000 7f36a4600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f369c06f130 0x7f369c072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:58.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.014+0000 7f36a4600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f369c15f9f0 0x7f369c0ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:58.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.014+0000 7f36a4600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f369c15c970 con 0x7f369c15b370 2024-09-11T23:24:58.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.014+0000 7f36a4600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f369c15fef0 con 0x7f369c15f9f0 2024-09-11T23:24:58.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.014+0000 7f36a4600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f369c15bbb0 con 0x7f369c06f130 2024-09-11T23:24:58.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.014+0000 7f36a1c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f369c15b370 0x7f369c06ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37372/0 (socket says 172.21.15.144:37372) 2024-09-11T23:24:58.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.014+0000 7f36a1c00640 1 -- 172.21.15.144:0/501855821 learned_addr learned my addr 172.21.15.144:0/501855821 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:24:58.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.014+0000 7f36a2600640 1 --2- 172.21.15.144:0/501855821 >> v2:172.21.15.144:3300/0 conn(0x7f369c15f9f0 0x7f369c0ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:58.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.014+0000 7f36a1200640 1 --2- 172.21.15.144:0/501855821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f369c06f130 0x7f369c072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:58.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.015+0000 7f36a2600640 1 -- 172.21.15.144:0/501855821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f369c06f130 msgr2=0x7f369c072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:58.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.015+0000 7f36a2600640 1 --2- 172.21.15.144:0/501855821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f369c06f130 0x7f369c072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:58.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.015+0000 7f36a2600640 1 -- 172.21.15.144:0/501855821 >> v1:172.21.15.144:6789/0 conn(0x7f369c15b370 legacy=0x7f369c06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:58.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.015+0000 7f369be00640 1 -- 172.21.15.144:0/501855821 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 375441499 0 0) 0x7f369c15c970 con 0x7f369c15b370 2024-09-11T23:24:58.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.015+0000 7f36a2600640 1 -- 172.21.15.144:0/501855821 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369c15be90 con 0x7f369c15f9f0 2024-09-11T23:24:58.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.016+0000 7f36a2600640 1 --2- 172.21.15.144:0/501855821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f369c15f9f0 0x7f369c0ce490 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f369c160070 tx=0x7f369402a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c672312dcc2fdbb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:58.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.016+0000 7f369be00640 1 -- 172.21.15.144:0/501855821 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3694007740 con 0x7f369c15f9f0 2024-09-11T23:24:58.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.016+0000 7f369be00640 1 -- 172.21.15.144:0/501855821 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36940078e0 con 0x7f369c15f9f0 2024-09-11T23:24:58.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.016+0000 7f369be00640 1 -- 172.21.15.144:0/501855821 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3694007cb0 con 0x7f369c15f9f0 2024-09-11T23:24:58.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.016+0000 7f36a4600640 1 -- 172.21.15.144:0/501855821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f369c15f9f0 msgr2=0x7f369c0ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:58.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.016+0000 7f36a4600640 1 --2- 172.21.15.144:0/501855821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f369c15f9f0 0x7f369c0ce490 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f369c160070 tx=0x7f369402a5b0 comp rx=0 tx=0).stop 2024-09-11T23:24:58.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.017+0000 7f36a4600640 1 -- 172.21.15.144:0/501855821 shutdown_connections 2024-09-11T23:24:58.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.017+0000 7f36a4600640 1 --2- 172.21.15.144:0/501855821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f369c15f9f0 0x7f369c0ce490 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:58.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.017+0000 7f36a4600640 1 --2- 172.21.15.144:0/501855821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f369c06f130 0x7f369c072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:58.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.017+0000 7f36a4600640 1 -- 172.21.15.144:0/501855821 >> 172.21.15.144:0/501855821 conn(0x7f369c06bba0 msgr2=0x7f369c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:58.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.017+0000 7f36a4600640 1 -- 172.21.15.144:0/501855821 shutdown_connections 2024-09-11T23:24:58.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.017+0000 7f36a4600640 1 -- 172.21.15.144:0/501855821 wait complete. 2024-09-11T23:24:58.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.018+0000 7f36a4600640 1 Processor -- start 2024-09-11T23:24:58.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.018+0000 7f36a4600640 1 -- start start 2024-09-11T23:24:58.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.019+0000 7f36a4600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f369c06f130 0x7f369c1f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:58.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.019+0000 7f36a4600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f369c15b370 0x7f369c1599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:58.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.019+0000 7f36a4600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f369c15f9f0 0x7f369c159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:58.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.019+0000 7f36a4600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f369c0731b0 con 0x7f369c06f130 2024-09-11T23:24:58.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.019+0000 7f36a4600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f369c15c450 con 0x7f369c15f9f0 2024-09-11T23:24:58.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.019+0000 7f36a4600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f369c15b750 con 0x7f369c15b370 2024-09-11T23:24:58.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.019+0000 7f36a1c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f369c06f130 0x7f369c1f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:58.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.019+0000 7f36a1c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f369c06f130 0x7f369c1f2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59188/0 (socket says 172.21.15.144:59188) 2024-09-11T23:24:58.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.019+0000 7f36a1c00640 1 -- 172.21.15.144:0/1693346678 learned_addr learned my addr 172.21.15.144:0/1693346678 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:58.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.020+0000 7f36a1200640 1 --2- 172.21.15.144:0/1693346678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f369c15b370 0x7f369c1599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:58.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.020+0000 7f36a2600640 1 --2- 172.21.15.144:0/1693346678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f369c15f9f0 0x7f369c159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:58.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.020+0000 7f36a1c00640 1 -- 172.21.15.144:0/1693346678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f369c15b370 msgr2=0x7f369c1599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:58.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.020+0000 7f36a1c00640 1 --2- 172.21.15.144:0/1693346678 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f369c15b370 0x7f369c1599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:58.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.020+0000 7f36a1c00640 1 -- 172.21.15.144:0/1693346678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f369c15f9f0 msgr2=0x7f369c159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:58.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.020+0000 7f36a1c00640 1 --2- 172.21.15.144:0/1693346678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f369c15f9f0 0x7f369c159ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:58.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.020+0000 7f36a1c00640 1 -- 172.21.15.144:0/1693346678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369c1408d0 con 0x7f369c06f130 2024-09-11T23:24:58.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.020+0000 7f36a1c00640 1 --2- 172.21.15.144:0/1693346678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f369c06f130 0x7f369c1f2670 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f369000c500 tx=0x7f369000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:58.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.020+0000 7f3699600640 1 -- 172.21.15.144:0/1693346678 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690018070 con 0x7f369c06f130 2024-09-11T23:24:58.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.020+0000 7f3699600640 1 -- 172.21.15.144:0/1693346678 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3690007580 con 0x7f369c06f130 2024-09-11T23:24:58.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.020+0000 7f3699600640 1 -- 172.21.15.144:0/1693346678 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690004a20 con 0x7f369c06f130 2024-09-11T23:24:58.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.020+0000 7f36a4600640 1 -- 172.21.15.144:0/1693346678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f369c13d8e0 con 0x7f369c06f130 2024-09-11T23:24:58.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.021+0000 7f36a4600640 1 -- 172.21.15.144:0/1693346678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f369c1405f0 con 0x7f369c06f130 2024-09-11T23:24:58.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.021+0000 7f36a4600640 1 -- 172.21.15.144:0/1693346678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f369c072560 con 0x7f369c06f130 2024-09-11T23:24:58.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.022+0000 7f3699600640 1 -- 172.21.15.144:0/1693346678 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f3690004bc0 con 0x7f369c06f130 2024-09-11T23:24:58.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.023+0000 7f3699600640 1 --2- 172.21.15.144:0/1693346678 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f367c06c460 0x7f367c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:58.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.023+0000 7f3699600640 1 -- 172.21.15.144:0/1693346678 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f369008ac90 con 0x7f369c06f130 2024-09-11T23:24:58.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.024+0000 7f36a1200640 1 --2- 172.21.15.144:0/1693346678 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f367c06c460 0x7f367c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:58.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.024+0000 7f36a1200640 1 --2- 172.21.15.144:0/1693346678 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f367c06c460 0x7f367c06e920 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3688006fd0 tx=0x7f3688008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:58.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.027+0000 7f3699600640 1 -- 172.21.15.144:0/1693346678 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3690058d50 con 0x7f369c06f130 2024-09-11T23:24:58.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.224+0000 7f36a4600640 1 -- 172.21.15.144:0/1693346678 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot ls", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) -- 0x7f369c0b3140 con 0x7f367c06c460 2024-09-11T23:24:58.226 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:24:58.226+0000 7f30de200640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-11T23:24:58.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.226+0000 7f3699600640 1 -- 172.21.15.144:0/1693346678 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f369c0b3140 con 0x7f367c06c460 2024-09-11T23:24:58.227 INFO:teuthology.orchestra.run.smithi144.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-11T23:24:58.237 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T23:24:58.238 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:24:58.238 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:24:58.316 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:24:58.419 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:24:58.420 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:24:58.420 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:24:58.420 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:24:58.455 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:24:58.456 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:24:58.531 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:24:58.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.726+0000 7f4e0b200640 1 Processor -- start 2024-09-11T23:24:58.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.726+0000 7f4e0b200640 1 -- start start 2024-09-11T23:24:58.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.727+0000 7f4e0b200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4e040d02a0 0x7f4e040d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:58.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.727+0000 7f4e0b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e0415ceb0 0x7f4e041594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:58.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.727+0000 7f4e0b200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e040d0bc0 con 0x7f4e0415ca40 2024-09-11T23:24:58.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.727+0000 7f4e0b200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f4e0415d390 con 0x7f4e040d02a0 2024-09-11T23:24:58.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.727+0000 7f4e0b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0415d670 con 0x7f4e0415ceb0 2024-09-11T23:24:58.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.727+0000 7f4e03e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4e040d02a0 0x7f4e040d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:58.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.727+0000 7f4e03e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4e040d02a0 0x7f4e040d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59200/0 (socket says 172.21.15.144:59200) 2024-09-11T23:24:58.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.727+0000 7f4e03e00640 1 -- 172.21.15.144:0/790032503 learned_addr learned my addr 172.21.15.144:0/790032503 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:58.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.727+0000 7f4e09200640 1 --2- 172.21.15.144:0/790032503 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e0415ceb0 0x7f4e041594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:58.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.728+0000 7f4e03e00640 1 -- 172.21.15.144:0/790032503 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e0415ceb0 msgr2=0x7f4e041594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:58.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.728+0000 7f4e03e00640 1 --2- 172.21.15.144:0/790032503 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e0415ceb0 0x7f4e041594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:58.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.728+0000 7f4e03e00640 1 -- 172.21.15.144:0/790032503 >> v1:172.21.15.165:6789/0 conn(0x7f4e0415ca40 legacy=0x7f4e0415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:58.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.728+0000 7f4e03e00640 1 -- 172.21.15.144:0/790032503 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0415d950 con 0x7f4e040d02a0 2024-09-11T23:24:58.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.728+0000 7f4e09200640 1 --2- 172.21.15.144:0/790032503 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e0415ceb0 0x7f4e041594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:58.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.729+0000 7f4e03e00640 1 --2- 172.21.15.144:0/790032503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e040d02a0 0x7f4e040d0680 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f4df4009870 tx=0x7f4df402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b19db3bf0cc40a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:58.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.729+0000 7f4e02a00640 1 -- 172.21.15.144:0/790032503 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df4037070 con 0x7f4e040d02a0 2024-09-11T23:24:58.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.729+0000 7f4e02a00640 1 -- 172.21.15.144:0/790032503 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df4032440 con 0x7f4e040d02a0 2024-09-11T23:24:58.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.729+0000 7f4e02a00640 1 -- 172.21.15.144:0/790032503 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df4032810 con 0x7f4e040d02a0 2024-09-11T23:24:58.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.729+0000 7f4e0b200640 1 -- 172.21.15.144:0/790032503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e040d02a0 msgr2=0x7f4e040d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:58.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.729+0000 7f4e0b200640 1 --2- 172.21.15.144:0/790032503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e040d02a0 0x7f4e040d0680 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f4df4009870 tx=0x7f4df402a1c0 comp rx=0 tx=0).stop 2024-09-11T23:24:58.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.730+0000 7f4e0b200640 1 -- 172.21.15.144:0/790032503 shutdown_connections 2024-09-11T23:24:58.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.730+0000 7f4e0b200640 1 --2- 172.21.15.144:0/790032503 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e0415ceb0 0x7f4e041594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:58.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.730+0000 7f4e0b200640 1 --2- 172.21.15.144:0/790032503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e040d02a0 0x7f4e040d0680 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:58.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.730+0000 7f4e0b200640 1 -- 172.21.15.144:0/790032503 >> 172.21.15.144:0/790032503 conn(0x7f4e04062cc0 msgr2=0x7f4e0406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:58.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.730+0000 7f4e0b200640 1 -- 172.21.15.144:0/790032503 shutdown_connections 2024-09-11T23:24:58.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.730+0000 7f4e0b200640 1 -- 172.21.15.144:0/790032503 wait complete. 2024-09-11T23:24:58.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.731+0000 7f4e0b200640 1 Processor -- start 2024-09-11T23:24:58.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.731+0000 7f4e0b200640 1 -- start start 2024-09-11T23:24:58.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.732+0000 7f4e0b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e040d02a0 0x7f4e040af780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:58.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.732+0000 7f4e0b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e0415ca40 0x7f4e041f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:58.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.732+0000 7f4e0b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e0415ceb0 0x7f4e04073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:58.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.732+0000 7f4e0b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0415eb40 con 0x7f4e0415ca40 2024-09-11T23:24:58.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.732+0000 7f4e0b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0415df10 con 0x7f4e040d02a0 2024-09-11T23:24:58.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.732+0000 7f4e0b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4e04155b90 con 0x7f4e0415ceb0 2024-09-11T23:24:58.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.733+0000 7f4e03400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e0415ca40 0x7f4e041f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:58.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.733+0000 7f4e03400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e0415ca40 0x7f4e041f4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59208/0 (socket says 172.21.15.144:59208) 2024-09-11T23:24:58.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.733+0000 7f4e03400640 1 -- 172.21.15.144:0/3569558089 learned_addr learned my addr 172.21.15.144:0/3569558089 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:58.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.733+0000 7f4e03e00640 1 --2- 172.21.15.144:0/3569558089 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e040d02a0 0x7f4e040af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:58.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.733+0000 7f4e09200640 1 --2- 172.21.15.144:0/3569558089 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e0415ceb0 0x7f4e04073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:58.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.733+0000 7f4e03400640 1 -- 172.21.15.144:0/3569558089 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e0415ceb0 msgr2=0x7f4e04073480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:58.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.733+0000 7f4e03400640 1 --2- 172.21.15.144:0/3569558089 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e0415ceb0 0x7f4e04073480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:58.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.733+0000 7f4e03400640 1 -- 172.21.15.144:0/3569558089 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e040d02a0 msgr2=0x7f4e040af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:58.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.733+0000 7f4e03400640 1 --2- 172.21.15.144:0/3569558089 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e040d02a0 0x7f4e040af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:58.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.733+0000 7f4e03400640 1 -- 172.21.15.144:0/3569558089 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e040739c0 con 0x7f4e0415ca40 2024-09-11T23:24:58.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.733+0000 7f4e03400640 1 --2- 172.21.15.144:0/3569558089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e0415ca40 0x7f4e041f4d30 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f4df000c3c0 tx=0x7f4df000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:58.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.733+0000 7f4dfbe00640 1 -- 172.21.15.144:0/3569558089 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df00052d0 con 0x7f4e0415ca40 2024-09-11T23:24:58.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.733+0000 7f4dfbe00640 1 -- 172.21.15.144:0/3569558089 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df0005490 con 0x7f4e0415ca40 2024-09-11T23:24:58.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.734+0000 7f4dfbe00640 1 -- 172.21.15.144:0/3569558089 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df0007260 con 0x7f4e0415ca40 2024-09-11T23:24:58.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.734+0000 7f4e0b200640 1 -- 172.21.15.144:0/3569558089 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e04073c90 con 0x7f4e0415ca40 2024-09-11T23:24:58.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.734+0000 7f4e0b200640 1 -- 172.21.15.144:0/3569558089 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e041f4270 con 0x7f4e0415ca40 2024-09-11T23:24:58.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.735+0000 7f4e0b200640 1 -- 172.21.15.144:0/3569558089 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e040b4790 con 0x7f4e0415ca40 2024-09-11T23:24:58.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.736+0000 7f4dfbe00640 1 -- 172.21.15.144:0/3569558089 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f4df0007400 con 0x7f4e0415ca40 2024-09-11T23:24:58.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.736+0000 7f4dfbe00640 1 --2- 172.21.15.144:0/3569558089 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4de406c460 0x7f4de406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:58.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.737+0000 7f4dfbe00640 1 -- 172.21.15.144:0/3569558089 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f4df008ae30 con 0x7f4e0415ca40 2024-09-11T23:24:58.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.737+0000 7f4e03e00640 1 --2- 172.21.15.144:0/3569558089 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4de406c460 0x7f4de406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:58.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.738+0000 7f4e03e00640 1 --2- 172.21.15.144:0/3569558089 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4de406c460 0x7f4de406e920 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4df4034000 tx=0x7f4df402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:58.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.741+0000 7f4dfbe00640 1 -- 172.21.15.144:0/3569558089 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4df0090020 con 0x7f4e0415ca40 2024-09-11T23:24:58.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.924+0000 7f4e0b200640 1 -- 172.21.15.144:0/3569558089 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4e0415bfc0 con 0x7f4e0415ca40 2024-09-11T23:24:58.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.925+0000 7f4dfbe00640 1 -- 172.21.15.144:0/3569558089 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v131) ==== 80+0+0 (secure 0 0 0) 0x7f4df0058ef0 con 0x7f4e0415ca40 2024-09-11T23:24:58.926 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:24:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.927+0000 7f4e0b200640 1 -- 172.21.15.144:0/3569558089 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4de406c460 msgr2=0x7f4de406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.927+0000 7f4e0b200640 1 --2- 172.21.15.144:0/3569558089 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4de406c460 0x7f4de406e920 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4df4034000 tx=0x7f4df402e000 comp rx=0 tx=0).stop 2024-09-11T23:24:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.927+0000 7f4e0b200640 1 -- 172.21.15.144:0/3569558089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e0415ca40 msgr2=0x7f4e041f4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.927+0000 7f4e0b200640 1 --2- 172.21.15.144:0/3569558089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e0415ca40 0x7f4e041f4d30 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f4df000c3c0 tx=0x7f4df000c880 comp rx=0 tx=0).stop 2024-09-11T23:24:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.927+0000 7f4e0b200640 1 -- 172.21.15.144:0/3569558089 shutdown_connections 2024-09-11T23:24:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.927+0000 7f4e0b200640 1 --2- 172.21.15.144:0/3569558089 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4de406c460 0x7f4de406e920 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.927+0000 7f4e0b200640 1 --2- 172.21.15.144:0/3569558089 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4e0415ceb0 0x7f4e04073480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.927+0000 7f4e0b200640 1 --2- 172.21.15.144:0/3569558089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e0415ca40 0x7f4e041f4d30 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.927+0000 7f4e0b200640 1 --2- 172.21.15.144:0/3569558089 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e040d02a0 0x7f4e040af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.927+0000 7f4e0b200640 1 -- 172.21.15.144:0/3569558089 >> 172.21.15.144:0/3569558089 conn(0x7f4e04062cc0 msgr2=0x7f4e040b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.927+0000 7f4e0b200640 1 -- 172.21.15.144:0/3569558089 shutdown_connections 2024-09-11T23:24:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:58.927+0000 7f4e0b200640 1 -- 172.21.15.144:0/3569558089 wait complete. 2024-09-11T23:24:58.943 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T23:24:58.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:58.943 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T23:24:59.006 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:24:59.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:59.007 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:24:59.043 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:24:59.043 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:24:59.043 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:24:59.083 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:24:59.083 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:24:59.161 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:24:59.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.315+0000 7fc7e2200640 1 Processor -- start 2024-09-11T23:24:59.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.315+0000 7fc7e2200640 1 -- start start 2024-09-11T23:24:59.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.316+0000 7fc7e2200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc7dc1632e0 0x7fc7dc0b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:59.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.316+0000 7fc7e2200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc7dc0b24d0 0x7fc7dc163ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.316+0000 7fc7e2200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7dc0cd510 con 0x7fc7dc1636c0 2024-09-11T23:24:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.316+0000 7fc7e2200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc7dc0b38a0 con 0x7fc7dc0b24d0 2024-09-11T23:24:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.316+0000 7fc7e2200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc7dc0b3b80 con 0x7fc7dc1632e0 2024-09-11T23:24:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.316+0000 7fc7e1800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc7dc0b24d0 0x7fc7dc163ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.316+0000 7fc7e1800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc7dc0b24d0 0x7fc7dc163ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59218/0 (socket says 172.21.15.144:59218) 2024-09-11T23:24:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.316+0000 7fc7e1800640 1 -- 172.21.15.144:0/2332255856 learned_addr learned my addr 172.21.15.144:0/2332255856 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.317+0000 7fc7e0e00640 1 --2- 172.21.15.144:0/2332255856 >> v2:172.21.15.165:3300/0 conn(0x7fc7dc1632e0 0x7fc7dc0b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.317+0000 7fc7e1800640 1 -- 172.21.15.144:0/2332255856 >> v2:172.21.15.165:3300/0 conn(0x7fc7dc1632e0 msgr2=0x7fc7dc0b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.317+0000 7fc7e1800640 1 --2- 172.21.15.144:0/2332255856 >> v2:172.21.15.165:3300/0 conn(0x7fc7dc1632e0 0x7fc7dc0b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.317+0000 7fc7e1800640 1 -- 172.21.15.144:0/2332255856 >> v1:172.21.15.165:6789/0 conn(0x7fc7dc1636c0 legacy=0x7fc7dc0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:59.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.317+0000 7fc7e1800640 1 -- 172.21.15.144:0/2332255856 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7dc0cd7f0 con 0x7fc7dc0b24d0 2024-09-11T23:24:59.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.318+0000 7fc7e1800640 1 --2- 172.21.15.144:0/2332255856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7dc0b24d0 0x7fc7dc163ae0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0d1130 tx=0x7fc7d402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4ab9d24ab1818e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:59.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.318+0000 7fc7db400640 1 -- 172.21.15.144:0/2332255856 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4036070 con 0x7fc7dc0b24d0 2024-09-11T23:24:59.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.318+0000 7fc7db400640 1 -- 172.21.15.144:0/2332255856 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d4031600 con 0x7fc7dc0b24d0 2024-09-11T23:24:59.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.318+0000 7fc7db400640 1 -- 172.21.15.144:0/2332255856 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d40319d0 con 0x7fc7dc0b24d0 2024-09-11T23:24:59.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.319+0000 7fc7e2200640 1 -- 172.21.15.144:0/2332255856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7dc0b24d0 msgr2=0x7fc7dc163ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:59.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.319+0000 7fc7e2200640 1 --2- 172.21.15.144:0/2332255856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7dc0b24d0 0x7fc7dc163ae0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0d1130 tx=0x7fc7d402a6a0 comp rx=0 tx=0).stop 2024-09-11T23:24:59.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.319+0000 7fc7e2200640 1 -- 172.21.15.144:0/2332255856 shutdown_connections 2024-09-11T23:24:59.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.319+0000 7fc7e2200640 1 --2- 172.21.15.144:0/2332255856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7dc0b24d0 0x7fc7dc163ae0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:59.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.319+0000 7fc7e2200640 1 --2- 172.21.15.144:0/2332255856 >> v2:172.21.15.165:3300/0 conn(0x7fc7dc1632e0 0x7fc7dc0b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:59.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.319+0000 7fc7e2200640 1 -- 172.21.15.144:0/2332255856 >> 172.21.15.144:0/2332255856 conn(0x7fc7dc06e910 msgr2=0x7fc7dc06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:59.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.319+0000 7fc7e2200640 1 -- 172.21.15.144:0/2332255856 shutdown_connections 2024-09-11T23:24:59.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.319+0000 7fc7e2200640 1 -- 172.21.15.144:0/2332255856 wait complete. 2024-09-11T23:24:59.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.320+0000 7fc7e2200640 1 Processor -- start 2024-09-11T23:24:59.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.321+0000 7fc7e2200640 1 -- start start 2024-09-11T23:24:59.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.321+0000 7fc7e2200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7dc0b24d0 0x7fc7dc15b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:59.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.321+0000 7fc7e2200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7dc1632e0 0x7fc7dc1f8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:59.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.321+0000 7fc7e2200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7dc1636c0 0x7fc7dc0c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:59.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.321+0000 7fc7e2200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc0b4190 con 0x7fc7dc1636c0 2024-09-11T23:24:59.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.321+0000 7fc7e2200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc7dc0b4010 con 0x7fc7dc1632e0 2024-09-11T23:24:59.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.321+0000 7fc7e2200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc7dc0b4310 con 0x7fc7dc0b24d0 2024-09-11T23:24:59.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.322+0000 7fc7e1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7dc1636c0 0x7fc7dc0c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:59.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.322+0000 7fc7e1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7dc1636c0 0x7fc7dc0c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59224/0 (socket says 172.21.15.144:59224) 2024-09-11T23:24:59.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.322+0000 7fc7e1800640 1 -- 172.21.15.144:0/1055942904 learned_addr learned my addr 172.21.15.144:0/1055942904 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:59.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.322+0000 7fc7dbe00640 1 --2- 172.21.15.144:0/1055942904 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7dc1632e0 0x7fc7dc1f8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:59.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.322+0000 7fc7e0e00640 1 --2- 172.21.15.144:0/1055942904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7dc0b24d0 0x7fc7dc15b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:59.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.322+0000 7fc7e1800640 1 -- 172.21.15.144:0/1055942904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7dc0b24d0 msgr2=0x7fc7dc15b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:59.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.322+0000 7fc7e1800640 1 --2- 172.21.15.144:0/1055942904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7dc0b24d0 0x7fc7dc15b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:59.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.322+0000 7fc7e1800640 1 -- 172.21.15.144:0/1055942904 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7dc1632e0 msgr2=0x7fc7dc1f8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:59.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.322+0000 7fc7e1800640 1 --2- 172.21.15.144:0/1055942904 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7dc1632e0 0x7fc7dc1f8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:59.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.322+0000 7fc7e1800640 1 -- 172.21.15.144:0/1055942904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7dc1f8af0 con 0x7fc7dc1636c0 2024-09-11T23:24:59.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.322+0000 7fc7e0e00640 1 --2- 172.21.15.144:0/1055942904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7dc0b24d0 0x7fc7dc15b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:24:59.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.322+0000 7fc7e1800640 1 --2- 172.21.15.144:0/1055942904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7dc1636c0 0x7fc7dc0c5400 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009f40 tx=0x7fc7d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:59.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.323+0000 7fc7d8c00640 1 -- 172.21.15.144:0/1055942904 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4036050 con 0x7fc7dc1636c0 2024-09-11T23:24:59.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.323+0000 7fc7d8c00640 1 -- 172.21.15.144:0/1055942904 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7d4042070 con 0x7fc7dc1636c0 2024-09-11T23:24:59.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.323+0000 7fc7d8c00640 1 -- 172.21.15.144:0/1055942904 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4009510 con 0x7fc7dc1636c0 2024-09-11T23:24:59.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.323+0000 7fc7e2200640 1 -- 172.21.15.144:0/1055942904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7dc1f8dd0 con 0x7fc7dc1636c0 2024-09-11T23:24:59.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.323+0000 7fc7e2200640 1 -- 172.21.15.144:0/1055942904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7dc1f9410 con 0x7fc7dc1636c0 2024-09-11T23:24:59.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.324+0000 7fc7e2200640 1 -- 172.21.15.144:0/1055942904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7dc163ae0 con 0x7fc7dc1636c0 2024-09-11T23:24:59.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.325+0000 7fc7d8c00640 1 -- 172.21.15.144:0/1055942904 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7fc7d4007bd0 con 0x7fc7dc1636c0 2024-09-11T23:24:59.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.326+0000 7fc7d8c00640 1 --2- 172.21.15.144:0/1055942904 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7bc06c460 0x7fc7bc06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:59.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.326+0000 7fc7d8c00640 1 -- 172.21.15.144:0/1055942904 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7fc7d40ac6b0 con 0x7fc7dc1636c0 2024-09-11T23:24:59.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.326+0000 7fc7e0e00640 1 --2- 172.21.15.144:0/1055942904 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7bc06c460 0x7fc7bc06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:59.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.327+0000 7fc7e0e00640 1 --2- 172.21.15.144:0/1055942904 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7bc06c460 0x7fc7bc06e920 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0006fd0 tx=0x7fc7d0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:59.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.330+0000 7fc7d8c00640 1 -- 172.21.15.144:0/1055942904 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc7d407a860 con 0x7fc7dc1636c0 2024-09-11T23:24:59.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.513+0000 7fc7e2200640 1 -- 172.21.15.144:0/1055942904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc7dc0d0510 con 0x7fc7dc1636c0 2024-09-11T23:24:59.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.514+0000 7fc7d8c00640 1 -- 172.21.15.144:0/1055942904 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v131) ==== 80+0+0 (secure 0 0 0) 0x7fc7d407a160 con 0x7fc7dc1636c0 2024-09-11T23:24:59.515 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:24:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.516+0000 7fc7e2200640 1 -- 172.21.15.144:0/1055942904 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7bc06c460 msgr2=0x7fc7bc06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.516+0000 7fc7e2200640 1 --2- 172.21.15.144:0/1055942904 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7bc06c460 0x7fc7bc06e920 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0006fd0 tx=0x7fc7d0008040 comp rx=0 tx=0).stop 2024-09-11T23:24:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.516+0000 7fc7e2200640 1 -- 172.21.15.144:0/1055942904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7dc1636c0 msgr2=0x7fc7dc0c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.516+0000 7fc7e2200640 1 --2- 172.21.15.144:0/1055942904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7dc1636c0 0x7fc7dc0c5400 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009f40 tx=0x7fc7d4004a40 comp rx=0 tx=0).stop 2024-09-11T23:24:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.516+0000 7fc7e2200640 1 -- 172.21.15.144:0/1055942904 shutdown_connections 2024-09-11T23:24:59.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.516+0000 7fc7e2200640 1 --2- 172.21.15.144:0/1055942904 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7bc06c460 0x7fc7bc06e920 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:59.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.516+0000 7fc7e2200640 1 --2- 172.21.15.144:0/1055942904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7dc1636c0 0x7fc7dc0c5400 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:59.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.516+0000 7fc7e2200640 1 --2- 172.21.15.144:0/1055942904 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7dc1632e0 0x7fc7dc1f8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:59.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.516+0000 7fc7e2200640 1 --2- 172.21.15.144:0/1055942904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7dc0b24d0 0x7fc7dc15b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:59.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.516+0000 7fc7e2200640 1 -- 172.21.15.144:0/1055942904 >> 172.21.15.144:0/1055942904 conn(0x7fc7dc06e910 msgr2=0x7fc7dc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:59.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.516+0000 7fc7e2200640 1 -- 172.21.15.144:0/1055942904 shutdown_connections 2024-09-11T23:24:59.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.516+0000 7fc7e2200640 1 -- 172.21.15.144:0/1055942904 wait complete. 2024-09-11T23:24:59.532 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-11T23:24:59.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:59.532 DEBUG:teuthology.orchestra.run.smithi165:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-11T23:24:59.605 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:24:59.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:24:59.605 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:24:59.642 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:24:59.642 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:24:59.643 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:24:59.678 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:24:59.678 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:24:59.679 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:24:59.679 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:24:59.719 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:24:59.719 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:24:59.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.871+0000 7f2023a00640 1 Processor -- start 2024-09-11T23:24:59.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.871+0000 7f2023a00640 1 -- start start 2024-09-11T23:24:59.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.872+0000 7f2023a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f201c151c50 0x7f201c0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:59.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.872+0000 7f2023a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f201c06c1f0 0x7f201c15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:59.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.872+0000 7f2023a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f201c0cd5f0 con 0x7f201c06be10 2024-09-11T23:24:59.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.873+0000 7f2023a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f201c0cd8d0 con 0x7f201c151c50 2024-09-11T23:24:59.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.873+0000 7f2023a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f201c0cdbb0 con 0x7f201c06c1f0 2024-09-11T23:24:59.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.873+0000 7f2021a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f201c06c1f0 0x7f201c15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:59.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.873+0000 7f2013e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f201c151c50 0x7f201c0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.873+0000 7f2021a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f201c06c1f0 0x7f201c15baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:58664/0 (socket says 172.21.15.144:58664) 2024-09-11T23:24:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.873+0000 7f2021a00640 1 -- 172.21.15.144:0/3212646907 learned_addr learned my addr 172.21.15.144:0/3212646907 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.874+0000 7f2021a00640 1 -- 172.21.15.144:0/3212646907 >> v2:172.21.15.165:3300/0 conn(0x7f201c151c50 msgr2=0x7f201c0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:24:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.874+0000 7f2021a00640 1 --2- 172.21.15.144:0/3212646907 >> v2:172.21.15.165:3300/0 conn(0x7f201c151c50 0x7f201c0cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.874+0000 7f2021a00640 1 -- 172.21.15.144:0/3212646907 >> v1:172.21.15.165:6789/0 conn(0x7f201c06be10 legacy=0x7f201c151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.874+0000 7f2021a00640 1 -- 172.21.15.144:0/3212646907 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201c0cde90 con 0x7f201c06c1f0 2024-09-11T23:24:59.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.875+0000 7f2021a00640 1 --2- 172.21.15.144:0/3212646907 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f201c06c1f0 0x7f201c15baa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2014009e50 tx=0x7f201402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc4d53f80054fc07 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:59.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.875+0000 7f201be00640 1 -- 172.21.15.144:0/3212646907 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2014036070 con 0x7f201c06c1f0 2024-09-11T23:24:59.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.875+0000 7f201be00640 1 -- 172.21.15.144:0/3212646907 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2014031600 con 0x7f201c06c1f0 2024-09-11T23:24:59.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.875+0000 7f201be00640 1 -- 172.21.15.144:0/3212646907 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20140319d0 con 0x7f201c06c1f0 2024-09-11T23:24:59.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.876+0000 7f2023a00640 1 -- 172.21.15.144:0/3212646907 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f201c06c1f0 msgr2=0x7f201c15baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:59.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.876+0000 7f2023a00640 1 --2- 172.21.15.144:0/3212646907 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f201c06c1f0 0x7f201c15baa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2014009e50 tx=0x7f201402a710 comp rx=0 tx=0).stop 2024-09-11T23:24:59.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.876+0000 7f2023a00640 1 -- 172.21.15.144:0/3212646907 shutdown_connections 2024-09-11T23:24:59.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.876+0000 7f2023a00640 1 --2- 172.21.15.144:0/3212646907 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f201c06c1f0 0x7f201c15baa0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:59.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.876+0000 7f2023a00640 1 --2- 172.21.15.144:0/3212646907 >> v2:172.21.15.165:3300/0 conn(0x7f201c151c50 0x7f201c0cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:59.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.876+0000 7f2023a00640 1 -- 172.21.15.144:0/3212646907 >> 172.21.15.144:0/3212646907 conn(0x7f201c062cc0 msgr2=0x7f201c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:24:59.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.876+0000 7f2023a00640 1 -- 172.21.15.144:0/3212646907 shutdown_connections 2024-09-11T23:24:59.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.876+0000 7f2023a00640 1 -- 172.21.15.144:0/3212646907 wait complete. 2024-09-11T23:24:59.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.878+0000 7f2023a00640 1 Processor -- start 2024-09-11T23:24:59.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.878+0000 7f2023a00640 1 -- start start 2024-09-11T23:24:59.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.878+0000 7f2023a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f201c06be10 0x7f201c153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:59.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.878+0000 7f2023a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f201c06c1f0 0x7f201c14c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:59.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.878+0000 7f2023a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f201c151c50 0x7f201c0ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:59.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.878+0000 7f2023a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f201c0d0310 con 0x7f201c151c50 2024-09-11T23:24:59.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.878+0000 7f2023a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f201c0ce690 con 0x7f201c06c1f0 2024-09-11T23:24:59.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.878+0000 7f2023a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f201c0d0490 con 0x7f201c06be10 2024-09-11T23:24:59.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.879+0000 7f2021a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f201c151c50 0x7f201c0ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:59.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.879+0000 7f2021a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f201c151c50 0x7f201c0ac1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59240/0 (socket says 172.21.15.144:59240) 2024-09-11T23:24:59.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.879+0000 7f2021a00640 1 -- 172.21.15.144:0/4141491191 learned_addr learned my addr 172.21.15.144:0/4141491191 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:24:59.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.879+0000 7f2021000640 1 --2- 172.21.15.144:0/4141491191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f201c06be10 0x7f201c153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:59.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.879+0000 7f2013e00640 1 --2- 172.21.15.144:0/4141491191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f201c06c1f0 0x7f201c14c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:59.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.879+0000 7f2021a00640 1 -- 172.21.15.144:0/4141491191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f201c06be10 msgr2=0x7f201c153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:59.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.879+0000 7f2021a00640 1 --2- 172.21.15.144:0/4141491191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f201c06be10 0x7f201c153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:59.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.879+0000 7f2021a00640 1 -- 172.21.15.144:0/4141491191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f201c06c1f0 msgr2=0x7f201c14c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:24:59.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.879+0000 7f2021a00640 1 --2- 172.21.15.144:0/4141491191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f201c06c1f0 0x7f201c14c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:24:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.879+0000 7f2021a00640 1 -- 172.21.15.144:0/4141491191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201c154050 con 0x7f201c151c50 2024-09-11T23:24:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.880+0000 7f2021a00640 1 --2- 172.21.15.144:0/4141491191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f201c151c50 0x7f201c0ac1d0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f2014009f70 tx=0x7f2014004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.880+0000 7f2019600640 1 -- 172.21.15.144:0/4141491191 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2014041020 con 0x7f201c151c50 2024-09-11T23:24:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.880+0000 7f2019600640 1 -- 172.21.15.144:0/4141491191 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2014008730 con 0x7f201c151c50 2024-09-11T23:24:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.880+0000 7f2023a00640 1 -- 172.21.15.144:0/4141491191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f201c1547e0 con 0x7f201c151c50 2024-09-11T23:24:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.880+0000 7f2019600640 1 -- 172.21.15.144:0/4141491191 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2014036040 con 0x7f201c151c50 2024-09-11T23:24:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.880+0000 7f2023a00640 1 -- 172.21.15.144:0/4141491191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f201c0ab6f0 con 0x7f201c151c50 2024-09-11T23:24:59.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.881+0000 7f2023a00640 1 -- 172.21.15.144:0/4141491191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f201c0d0870 con 0x7f201c151c50 2024-09-11T23:24:59.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.882+0000 7f2019600640 1 -- 172.21.15.144:0/4141491191 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f2014044020 con 0x7f201c151c50 2024-09-11T23:24:59.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.883+0000 7f2019600640 1 --2- 172.21.15.144:0/4141491191 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ff806c460 0x7f1ff806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:24:59.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.883+0000 7f2019600640 1 -- 172.21.15.144:0/4141491191 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f20140ac4f0 con 0x7f201c151c50 2024-09-11T23:24:59.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.883+0000 7f2021000640 1 --2- 172.21.15.144:0/4141491191 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ff806c460 0x7f1ff806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:24:59.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.884+0000 7f2021000640 1 --2- 172.21.15.144:0/4141491191 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ff806c460 0x7f1ff806e920 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f200c007fd0 tx=0x7f200c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:24:59.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:24:59.887+0000 7f2019600640 1 -- 172.21.15.144:0/4141491191 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f201404b030 con 0x7f201c151c50 2024-09-11T23:25:00.098 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.098+0000 7f2023a00640 1 -- 172.21.15.144:0/4141491191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f201c0d0fb0 con 0x7f201c151c50 2024-09-11T23:25:00.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.098+0000 7f2019600640 1 -- 172.21.15.144:0/4141491191 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5239 (secure 0 0 0) 0x7f201c154050 con 0x7f201c151c50 2024-09-11T23:25:00.099 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:00.099 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":91,"btime":"2024-09-11T23:24:48:545080+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6587,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/3230009607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3230009607},{"type":"v1","addr":"172.21.15.144:6801","nonce":3230009607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7755,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2789293878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2789293878},{"type":"v1","addr":"172.21.15.165:6834","nonce":2789293878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7758,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2328841770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2328841770},{"type":"v1","addr":"172.21.15.165:6835","nonce":2328841770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:24:37.895286+0000","modified":"2024-09-11T23:24:40.918906+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7761":{"gid":7761,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1155743669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1155743669},{"type":"v1","addr":"172.21.15.144:6835","nonce":1155743669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7761,"qdb_cluster":[7761]},"id":10}]} 2024-09-11T23:25:00.100 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 91 2024-09-11T23:25:00.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.101+0000 7f2023a00640 1 -- 172.21.15.144:0/4141491191 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ff806c460 msgr2=0x7f1ff806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:00.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.101+0000 7f2023a00640 1 --2- 172.21.15.144:0/4141491191 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ff806c460 0x7f1ff806e920 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f200c007fd0 tx=0x7f200c009040 comp rx=0 tx=0).stop 2024-09-11T23:25:00.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.101+0000 7f2023a00640 1 -- 172.21.15.144:0/4141491191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f201c151c50 msgr2=0x7f201c0ac1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:00.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.101+0000 7f2023a00640 1 --2- 172.21.15.144:0/4141491191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f201c151c50 0x7f201c0ac1d0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f2014009f70 tx=0x7f2014004a40 comp rx=0 tx=0).stop 2024-09-11T23:25:00.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.101+0000 7f2023a00640 1 -- 172.21.15.144:0/4141491191 shutdown_connections 2024-09-11T23:25:00.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.101+0000 7f2023a00640 1 --2- 172.21.15.144:0/4141491191 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ff806c460 0x7f1ff806e920 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.101+0000 7f2023a00640 1 --2- 172.21.15.144:0/4141491191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f201c151c50 0x7f201c0ac1d0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.101+0000 7f2023a00640 1 --2- 172.21.15.144:0/4141491191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f201c06c1f0 0x7f201c14c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.101+0000 7f2023a00640 1 --2- 172.21.15.144:0/4141491191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f201c06be10 0x7f201c153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.101+0000 7f2023a00640 1 -- 172.21.15.144:0/4141491191 >> 172.21.15.144:0/4141491191 conn(0x7f201c062cc0 msgr2=0x7f201c0b4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:00.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.101+0000 7f2023a00640 1 -- 172.21.15.144:0/4141491191 shutdown_connections 2024-09-11T23:25:00.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.101+0000 7f2023a00640 1 -- 172.21.15.144:0/4141491191 wait complete. 2024-09-11T23:25:00.117 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:25:00.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.269+0000 7fc447e00640 1 Processor -- start 2024-09-11T23:25:00.270 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.269+0000 7fc447e00640 1 -- start start 2024-09-11T23:25:00.271 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.270+0000 7fc447e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc44015c180 0x7fc4400cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:00.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.270+0000 7fc447e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc440073120 0x7fc4400735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:00.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.270+0000 7fc447e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4400ce740 con 0x7fc4400ce230 2024-09-11T23:25:00.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.271+0000 7fc447e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc440072640 con 0x7fc440073120 2024-09-11T23:25:00.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.271+0000 7fc447e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc440072920 con 0x7fc44015c180 2024-09-11T23:25:00.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.271+0000 7fc445400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc44015c180 0x7fc4400cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:00.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.271+0000 7fc445e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc440073120 0x7fc4400735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:00.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.271+0000 7fc445400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc44015c180 0x7fc4400cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:58674/0 (socket says 172.21.15.144:58674) 2024-09-11T23:25:00.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.271+0000 7fc445400640 1 -- 172.21.15.144:0/2858233233 learned_addr learned my addr 172.21.15.144:0/2858233233 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:00.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.271+0000 7fc445400640 1 -- 172.21.15.144:0/2858233233 >> v2:172.21.15.165:3300/0 conn(0x7fc440073120 msgr2=0x7fc4400735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:00.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.271+0000 7fc445400640 1 --2- 172.21.15.144:0/2858233233 >> v2:172.21.15.165:3300/0 conn(0x7fc440073120 0x7fc4400735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.271+0000 7fc445400640 1 -- 172.21.15.144:0/2858233233 >> v1:172.21.15.165:6789/0 conn(0x7fc4400ce230 legacy=0x7fc4400cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:00.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.271+0000 7fc445400640 1 -- 172.21.15.144:0/2858233233 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc440072c00 con 0x7fc44015c180 2024-09-11T23:25:00.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.272+0000 7fc445400640 1 --2- 172.21.15.144:0/2858233233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc44015c180 0x7fc4400cdcf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc434009870 tx=0x7fc43402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fb8b444cfa525ca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:00.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.272+0000 7fc43fe00640 1 -- 172.21.15.144:0/2858233233 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434037070 con 0x7fc44015c180 2024-09-11T23:25:00.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.273+0000 7fc43fe00640 1 -- 172.21.15.144:0/2858233233 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc434032440 con 0x7fc44015c180 2024-09-11T23:25:00.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.273+0000 7fc43fe00640 1 -- 172.21.15.144:0/2858233233 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434032810 con 0x7fc44015c180 2024-09-11T23:25:00.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.273+0000 7fc447e00640 1 -- 172.21.15.144:0/2858233233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc44015c180 msgr2=0x7fc4400cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:00.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.273+0000 7fc447e00640 1 --2- 172.21.15.144:0/2858233233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc44015c180 0x7fc4400cdcf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc434009870 tx=0x7fc43402a1c0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.273+0000 7fc447e00640 1 -- 172.21.15.144:0/2858233233 shutdown_connections 2024-09-11T23:25:00.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.273+0000 7fc447e00640 1 --2- 172.21.15.144:0/2858233233 >> v2:172.21.15.165:3300/0 conn(0x7fc440073120 0x7fc4400735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.273+0000 7fc447e00640 1 --2- 172.21.15.144:0/2858233233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc44015c180 0x7fc4400cdcf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.273+0000 7fc447e00640 1 -- 172.21.15.144:0/2858233233 >> 172.21.15.144:0/2858233233 conn(0x7fc440062cc0 msgr2=0x7fc44006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:00.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.273+0000 7fc447e00640 1 -- 172.21.15.144:0/2858233233 shutdown_connections 2024-09-11T23:25:00.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.273+0000 7fc447e00640 1 -- 172.21.15.144:0/2858233233 wait complete. 2024-09-11T23:25:00.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.275+0000 7fc447e00640 1 Processor -- start 2024-09-11T23:25:00.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.275+0000 7fc447e00640 1 -- start start 2024-09-11T23:25:00.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.276+0000 7fc447e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc440073120 0x7fc440155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:00.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.276+0000 7fc447e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4400ce230 0x7fc4401514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:00.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.276+0000 7fc447e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc44015c180 0x7fc4401519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:00.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.276+0000 7fc447e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc4400cf780 con 0x7fc4400ce230 2024-09-11T23:25:00.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.276+0000 7fc447e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc4400722f0 con 0x7fc44015c180 2024-09-11T23:25:00.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.276+0000 7fc447e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc44015c560 con 0x7fc440073120 2024-09-11T23:25:00.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.276+0000 7fc444a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4400ce230 0x7fc4401514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:00.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.276+0000 7fc445400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc440073120 0x7fc440155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:00.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.276+0000 7fc444a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4400ce230 0x7fc4401514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59244/0 (socket says 172.21.15.144:59244) 2024-09-11T23:25:00.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.276+0000 7fc444a00640 1 -- 172.21.15.144:0/1326839814 learned_addr learned my addr 172.21.15.144:0/1326839814 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:00.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.276+0000 7fc445e00640 1 --2- 172.21.15.144:0/1326839814 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc44015c180 0x7fc4401519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:00.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.276+0000 7fc444a00640 1 -- 172.21.15.144:0/1326839814 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc440073120 msgr2=0x7fc440155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:00.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.276+0000 7fc444a00640 1 --2- 172.21.15.144:0/1326839814 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc440073120 0x7fc440155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.276+0000 7fc444a00640 1 -- 172.21.15.144:0/1326839814 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc44015c180 msgr2=0x7fc4401519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:00.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.276+0000 7fc444a00640 1 --2- 172.21.15.144:0/1326839814 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc44015c180 0x7fc4401519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.276+0000 7fc444a00640 1 -- 172.21.15.144:0/1326839814 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44015f000 con 0x7fc4400ce230 2024-09-11T23:25:00.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.277+0000 7fc444a00640 1 --2- 172.21.15.144:0/1326839814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4400ce230 0x7fc4401514b0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00c440 tx=0x7fc42c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:00.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.277+0000 7fc43d600640 1 -- 172.21.15.144:0/1326839814 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c0052d0 con 0x7fc4400ce230 2024-09-11T23:25:00.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.277+0000 7fc43d600640 1 -- 172.21.15.144:0/1326839814 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc42c005470 con 0x7fc4400ce230 2024-09-11T23:25:00.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.277+0000 7fc43d600640 1 -- 172.21.15.144:0/1326839814 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c007260 con 0x7fc4400ce230 2024-09-11T23:25:00.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.277+0000 7fc447e00640 1 -- 172.21.15.144:0/1326839814 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4401520e0 con 0x7fc4400ce230 2024-09-11T23:25:00.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.277+0000 7fc447e00640 1 -- 172.21.15.144:0/1326839814 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44015f550 con 0x7fc4400ce230 2024-09-11T23:25:00.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.278+0000 7fc447e00640 1 -- 172.21.15.144:0/1326839814 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc44015f750 con 0x7fc4400ce230 2024-09-11T23:25:00.280 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.279+0000 7fc43d600640 1 -- 172.21.15.144:0/1326839814 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7fc42c007400 con 0x7fc4400ce230 2024-09-11T23:25:00.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.280+0000 7fc43d600640 1 --2- 172.21.15.144:0/1326839814 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc42006c460 0x7fc42006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:00.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.280+0000 7fc43d600640 1 -- 172.21.15.144:0/1326839814 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7fc42c08ae80 con 0x7fc4400ce230 2024-09-11T23:25:00.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.280+0000 7fc445400640 1 --2- 172.21.15.144:0/1326839814 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc42006c460 0x7fc42006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:00.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.281+0000 7fc445400640 1 --2- 172.21.15.144:0/1326839814 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc42006c460 0x7fc42006e920 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc434034000 tx=0x7fc43402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:00.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.284+0000 7fc43d600640 1 -- 172.21.15.144:0/1326839814 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc44015f750 con 0x7fc4400ce230 2024-09-11T23:25:00.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.491+0000 7fc447e00640 1 -- 172.21.15.144:0/1326839814 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4400cdcf0 con 0x7fc4400ce230 2024-09-11T23:25:00.492 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.492+0000 7fc43d600640 1 -- 172.21.15.144:0/1326839814 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5239 (secure 0 0 0) 0x7fc42c05f080 con 0x7fc4400ce230 2024-09-11T23:25:00.493 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:00.493 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":91,"btime":"2024-09-11T23:24:48:545080+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6587,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/3230009607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3230009607},{"type":"v1","addr":"172.21.15.144:6801","nonce":3230009607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7755,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2789293878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2789293878},{"type":"v1","addr":"172.21.15.165:6834","nonce":2789293878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7758,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2328841770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2328841770},{"type":"v1","addr":"172.21.15.165:6835","nonce":2328841770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:24:37.895286+0000","modified":"2024-09-11T23:24:40.918906+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7761":{"gid":7761,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1155743669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1155743669},{"type":"v1","addr":"172.21.15.144:6835","nonce":1155743669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7761,"qdb_cluster":[7761]},"id":10}]} 2024-09-11T23:25:00.493 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 91 2024-09-11T23:25:00.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.494+0000 7fc447e00640 1 -- 172.21.15.144:0/1326839814 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc42006c460 msgr2=0x7fc42006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:00.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.494+0000 7fc447e00640 1 --2- 172.21.15.144:0/1326839814 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc42006c460 0x7fc42006e920 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc434034000 tx=0x7fc43402e000 comp rx=0 tx=0).stop 2024-09-11T23:25:00.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.494+0000 7fc447e00640 1 -- 172.21.15.144:0/1326839814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4400ce230 msgr2=0x7fc4401514b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:00.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.494+0000 7fc447e00640 1 --2- 172.21.15.144:0/1326839814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4400ce230 0x7fc4401514b0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00c440 tx=0x7fc42c001e70 comp rx=0 tx=0).stop 2024-09-11T23:25:00.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.494+0000 7fc447e00640 1 -- 172.21.15.144:0/1326839814 shutdown_connections 2024-09-11T23:25:00.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.494+0000 7fc447e00640 1 --2- 172.21.15.144:0/1326839814 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc42006c460 0x7fc42006e920 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.494+0000 7fc447e00640 1 --2- 172.21.15.144:0/1326839814 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc44015c180 0x7fc4401519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.494+0000 7fc447e00640 1 --2- 172.21.15.144:0/1326839814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4400ce230 0x7fc4401514b0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.494+0000 7fc447e00640 1 --2- 172.21.15.144:0/1326839814 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc440073120 0x7fc440155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.494+0000 7fc447e00640 1 -- 172.21.15.144:0/1326839814 >> 172.21.15.144:0/1326839814 conn(0x7fc440062cc0 msgr2=0x7fc440158500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:00.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.494+0000 7fc447e00640 1 -- 172.21.15.144:0/1326839814 shutdown_connections 2024-09-11T23:25:00.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.494+0000 7fc447e00640 1 -- 172.21.15.144:0/1326839814 wait complete. 2024-09-11T23:25:00.511 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:25:00.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.664+0000 7fbb53a00640 1 Processor -- start 2024-09-11T23:25:00.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.664+0000 7fbb53a00640 1 -- start start 2024-09-11T23:25:00.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.665+0000 7fbb53a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb4c0d02a0 0x7fbb4c0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:00.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.665+0000 7fbb53a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbb4c15ce80 0x7fbb4c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:00.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.665+0000 7fbb53a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb4c0d0bc0 con 0x7fbb4c15ca40 2024-09-11T23:25:00.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.666+0000 7fbb53a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fbb4c15d390 con 0x7fbb4c15ce80 2024-09-11T23:25:00.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.666+0000 7fbb53a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbb4c15d670 con 0x7fbb4c0d02a0 2024-09-11T23:25:00.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.666+0000 7fbb43e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fbb4c15ca40 0x7fbb4c15e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37378/0 (socket says 172.21.15.144:37378) 2024-09-11T23:25:00.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.666+0000 7fbb43e00640 1 -- 172.21.15.144:0/247564971 learned_addr learned my addr 172.21.15.144:0/247564971 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:00.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.666+0000 7fbb51a00640 1 --2- 172.21.15.144:0/247564971 >> v2:172.21.15.165:3300/0 conn(0x7fbb4c15ce80 0x7fbb4c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:00.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.666+0000 7fbb51000640 1 --2- 172.21.15.144:0/247564971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb4c0d02a0 0x7fbb4c0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:00.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.666+0000 7fbb4be00640 1 -- 172.21.15.144:0/247564971 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3819518830 0 0) 0x7fbb4c0d0bc0 con 0x7fbb4c15ca40 2024-09-11T23:25:00.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.666+0000 7fbb4be00640 1 -- 172.21.15.144:0/247564971 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb30003520 con 0x7fbb4c15ca40 2024-09-11T23:25:00.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.666+0000 7fbb51a00640 1 -- 172.21.15.144:0/247564971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb4c0d02a0 msgr2=0x7fbb4c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:00.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.666+0000 7fbb51a00640 1 --2- 172.21.15.144:0/247564971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb4c0d02a0 0x7fbb4c0d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.666+0000 7fbb51a00640 1 -- 172.21.15.144:0/247564971 >> v1:172.21.15.144:6789/0 conn(0x7fbb4c15ca40 legacy=0x7fbb4c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:00.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.666+0000 7fbb51a00640 1 -- 172.21.15.144:0/247564971 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4c15d950 con 0x7fbb4c15ce80 2024-09-11T23:25:00.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.666+0000 7fbb51000640 1 --2- 172.21.15.144:0/247564971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb4c0d02a0 0x7fbb4c0d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:25:00.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.668+0000 7fbb51a00640 1 --2- 172.21.15.144:0/247564971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb4c15ce80 0x7fbb4c1594c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009d90 tx=0x7fbb4402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d647dd1836ecdedf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:00.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.668+0000 7fbb4be00640 1 -- 172.21.15.144:0/247564971 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb44031600 con 0x7fbb4c15ce80 2024-09-11T23:25:00.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.668+0000 7fbb4be00640 1 -- 172.21.15.144:0/247564971 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb440317a0 con 0x7fbb4c15ce80 2024-09-11T23:25:00.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.668+0000 7fbb4be00640 1 -- 172.21.15.144:0/247564971 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb44031b70 con 0x7fbb4c15ce80 2024-09-11T23:25:00.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.668+0000 7fbb53a00640 1 -- 172.21.15.144:0/247564971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb4c15ce80 msgr2=0x7fbb4c1594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:00.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.668+0000 7fbb53a00640 1 --2- 172.21.15.144:0/247564971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb4c15ce80 0x7fbb4c1594c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009d90 tx=0x7fbb4402a5d0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.668+0000 7fbb53a00640 1 -- 172.21.15.144:0/247564971 shutdown_connections 2024-09-11T23:25:00.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.668+0000 7fbb53a00640 1 --2- 172.21.15.144:0/247564971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb4c15ce80 0x7fbb4c1594c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.668+0000 7fbb53a00640 1 --2- 172.21.15.144:0/247564971 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb4c0d02a0 0x7fbb4c0d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.669+0000 7fbb53a00640 1 -- 172.21.15.144:0/247564971 >> 172.21.15.144:0/247564971 conn(0x7fbb4c062cc0 msgr2=0x7fbb4c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:00.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.669+0000 7fbb53a00640 1 -- 172.21.15.144:0/247564971 shutdown_connections 2024-09-11T23:25:00.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.669+0000 7fbb53a00640 1 -- 172.21.15.144:0/247564971 wait complete. 2024-09-11T23:25:00.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.670+0000 7fbb53a00640 1 Processor -- start 2024-09-11T23:25:00.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.670+0000 7fbb53a00640 1 -- start start 2024-09-11T23:25:00.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.671+0000 7fbb53a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb4c0d02a0 0x7fbb4c073e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:00.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.671+0000 7fbb53a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb4c15ca40 0x7fbb4c14e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:00.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.671+0000 7fbb53a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb4c15ce80 0x7fbb4c1f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:00.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.671+0000 7fbb53a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c15eb40 con 0x7fbb4c15ce80 2024-09-11T23:25:00.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.671+0000 7fbb53a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c15df10 con 0x7fbb4c15ca40 2024-09-11T23:25:00.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.671+0000 7fbb53a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbb4c155b90 con 0x7fbb4c0d02a0 2024-09-11T23:25:00.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.672+0000 7fbb51a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb4c15ce80 0x7fbb4c1f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:00.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.672+0000 7fbb51a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb4c15ce80 0x7fbb4c1f52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59258/0 (socket says 172.21.15.144:59258) 2024-09-11T23:25:00.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.672+0000 7fbb51a00640 1 -- 172.21.15.144:0/2406482721 learned_addr learned my addr 172.21.15.144:0/2406482721 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:00.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.672+0000 7fbb43e00640 1 --2- 172.21.15.144:0/2406482721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb4c15ca40 0x7fbb4c14e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:00.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.672+0000 7fbb51a00640 1 -- 172.21.15.144:0/2406482721 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb4c0d02a0 msgr2=0x7fbb4c073e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:00.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.672+0000 7fbb51000640 1 --2- 172.21.15.144:0/2406482721 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb4c0d02a0 0x7fbb4c073e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:00.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.672+0000 7fbb51a00640 1 --2- 172.21.15.144:0/2406482721 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb4c0d02a0 0x7fbb4c073e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.672+0000 7fbb51a00640 1 -- 172.21.15.144:0/2406482721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb4c15ca40 msgr2=0x7fbb4c14e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:00.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.672+0000 7fbb51a00640 1 --2- 172.21.15.144:0/2406482721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb4c15ca40 0x7fbb4c14e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.672+0000 7fbb51a00640 1 -- 172.21.15.144:0/2406482721 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4c14e980 con 0x7fbb4c15ce80 2024-09-11T23:25:00.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.672+0000 7fbb51000640 1 --2- 172.21.15.144:0/2406482721 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb4c0d02a0 0x7fbb4c073e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:00.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.672+0000 7fbb43e00640 1 --2- 172.21.15.144:0/2406482721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb4c15ca40 0x7fbb4c14e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:00.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.672+0000 7fbb51a00640 1 --2- 172.21.15.144:0/2406482721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb4c15ce80 0x7fbb4c1f52d0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009eb0 tx=0x7fbb44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:00.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.673+0000 7fbb49600640 1 -- 172.21.15.144:0/2406482721 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4403f070 con 0x7fbb4c15ce80 2024-09-11T23:25:00.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.673+0000 7fbb49600640 1 -- 172.21.15.144:0/2406482721 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb4403b820 con 0x7fbb4c15ce80 2024-09-11T23:25:00.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.673+0000 7fbb53a00640 1 -- 172.21.15.144:0/2406482721 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb4c157090 con 0x7fbb4c15ce80 2024-09-11T23:25:00.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.673+0000 7fbb49600640 1 -- 172.21.15.144:0/2406482721 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4403bbd0 con 0x7fbb4c15ce80 2024-09-11T23:25:00.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.673+0000 7fbb53a00640 1 -- 172.21.15.144:0/2406482721 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb4c14e670 con 0x7fbb4c15ce80 2024-09-11T23:25:00.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.674+0000 7fbb53a00640 1 -- 172.21.15.144:0/2406482721 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb4c0b4790 con 0x7fbb4c15ce80 2024-09-11T23:25:00.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.675+0000 7fbb49600640 1 -- 172.21.15.144:0/2406482721 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7fbb4404d3f0 con 0x7fbb4c15ce80 2024-09-11T23:25:00.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.675+0000 7fbb49600640 1 --2- 172.21.15.144:0/2406482721 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbb2806c460 0x7fbb2806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:00.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.676+0000 7fbb49600640 1 -- 172.21.15.144:0/2406482721 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7fbb440ace70 con 0x7fbb4c15ce80 2024-09-11T23:25:00.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.676+0000 7fbb51000640 1 --2- 172.21.15.144:0/2406482721 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbb2806c460 0x7fbb2806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:00.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.677+0000 7fbb51000640 1 --2- 172.21.15.144:0/2406482721 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbb2806c460 0x7fbb2806e920 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c1f2e10 tx=0x7fbb3c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:00.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.680+0000 7fbb49600640 1 -- 172.21.15.144:0/2406482721 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb4407af90 con 0x7fbb4c15ce80 2024-09-11T23:25:00.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.855+0000 7fbb53a00640 1 -- 172.21.15.144:0/2406482721 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb4c150d40 con 0x7fbb4c15ce80 2024-09-11T23:25:00.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.856+0000 7fbb49600640 1 -- 172.21.15.144:0/2406482721 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) ==== 74+0+16763 (secure 0 0 0) 0x7fbb4407a890 con 0x7fbb4c15ce80 2024-09-11T23:25:00.857 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:00.857 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":131,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:24:39.495019+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:24:35.685780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-11T23:24:36.890387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:25:00.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.858+0000 7fbb53a00640 1 -- 172.21.15.144:0/2406482721 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbb2806c460 msgr2=0x7fbb2806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:00.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.858+0000 7fbb53a00640 1 --2- 172.21.15.144:0/2406482721 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbb2806c460 0x7fbb2806e920 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c1f2e10 tx=0x7fbb3c008040 comp rx=0 tx=0).stop 2024-09-11T23:25:00.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.858+0000 7fbb53a00640 1 -- 172.21.15.144:0/2406482721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb4c15ce80 msgr2=0x7fbb4c1f52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:00.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.858+0000 7fbb53a00640 1 --2- 172.21.15.144:0/2406482721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb4c15ce80 0x7fbb4c1f52d0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009eb0 tx=0x7fbb44004a40 comp rx=0 tx=0).stop 2024-09-11T23:25:00.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.858+0000 7fbb53a00640 1 -- 172.21.15.144:0/2406482721 shutdown_connections 2024-09-11T23:25:00.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.858+0000 7fbb53a00640 1 --2- 172.21.15.144:0/2406482721 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbb2806c460 0x7fbb2806e920 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.858+0000 7fbb53a00640 1 --2- 172.21.15.144:0/2406482721 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb4c15ce80 0x7fbb4c1f52d0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.858+0000 7fbb53a00640 1 --2- 172.21.15.144:0/2406482721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb4c15ca40 0x7fbb4c14e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.858+0000 7fbb53a00640 1 --2- 172.21.15.144:0/2406482721 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbb4c0d02a0 0x7fbb4c073e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:00.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.858+0000 7fbb53a00640 1 -- 172.21.15.144:0/2406482721 >> 172.21.15.144:0/2406482721 conn(0x7fbb4c062cc0 msgr2=0x7fbb4c154e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:00.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.859+0000 7fbb53a00640 1 -- 172.21.15.144:0/2406482721 shutdown_connections 2024-09-11T23:25:00.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:00.859+0000 7fbb53a00640 1 -- 172.21.15.144:0/2406482721 wait complete. 2024-09-11T23:25:00.875 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:25:00.875 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:25:01.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.027+0000 7f8bd5c00640 1 Processor -- start 2024-09-11T23:25:01.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.027+0000 7f8bd5c00640 1 -- start start 2024-09-11T23:25:01.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.028+0000 7f8bd5c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd00d02a0 0x7f8bd00d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.028+0000 7f8bd5c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8bd015ca40 0x7f8bd015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.028+0000 7f8bd5c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8bd015ce80 0x7f8bd01594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.028+0000 7f8bd5c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8bd00d0bc0 con 0x7f8bd015ce80 2024-09-11T23:25:01.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.029+0000 7f8bd5c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f8bd015d390 con 0x7f8bd015ca40 2024-09-11T23:25:01.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.029+0000 7f8bd5c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd015d670 con 0x7f8bd00d02a0 2024-09-11T23:25:01.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.029+0000 7f8bcea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd00d02a0 0x7f8bd00d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.029+0000 7f8bc6000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f8bd015ca40 0x7f8bd015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.029+0000 7f8bcea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd00d02a0 0x7f8bd00d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:58714/0 (socket says 172.21.15.144:58714) 2024-09-11T23:25:01.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.029+0000 7f8bcea00640 1 -- 172.21.15.144:0/1167008652 learned_addr learned my addr 172.21.15.144:0/1167008652 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:01.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.029+0000 7f8bcf400640 1 --2- 172.21.15.144:0/1167008652 >> v2:172.21.15.144:3300/0 conn(0x7f8bd015ce80 0x7f8bd01594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.029+0000 7f8bcea00640 1 -- 172.21.15.144:0/1167008652 >> v2:172.21.15.165:3300/0 conn(0x7f8bd015ca40 msgr2=0x7f8bd015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:01.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.029+0000 7f8bcea00640 1 --2- 172.21.15.144:0/1167008652 >> v2:172.21.15.165:3300/0 conn(0x7f8bd015ca40 0x7f8bd015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.029+0000 7f8bcea00640 1 -- 172.21.15.144:0/1167008652 >> v2:172.21.15.144:3300/0 conn(0x7f8bd015ce80 msgr2=0x7f8bd01594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:01.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.029+0000 7f8bcea00640 1 --2- 172.21.15.144:0/1167008652 >> v2:172.21.15.144:3300/0 conn(0x7f8bd015ce80 0x7f8bd01594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.029+0000 7f8bcea00640 1 -- 172.21.15.144:0/1167008652 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd015d950 con 0x7f8bd00d02a0 2024-09-11T23:25:01.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.029+0000 7f8bc6000640 1 --2- 172.21.15.144:0/1167008652 >> v2:172.21.15.165:3300/0 conn(0x7f8bd015ca40 0x7f8bd015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:25:01.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.030+0000 7f8bcea00640 1 --2- 172.21.15.144:0/1167008652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd00d02a0 0x7f8bd00d0680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8bd006f400 tx=0x7f8bc002c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b532aa7b4e0134f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:01.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.031+0000 7f8bce000640 1 -- 172.21.15.144:0/1167008652 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0032710 con 0x7f8bd00d02a0 2024-09-11T23:25:01.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.031+0000 7f8bce000640 1 -- 172.21.15.144:0/1167008652 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc00328b0 con 0x7f8bd00d02a0 2024-09-11T23:25:01.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.031+0000 7f8bce000640 1 -- 172.21.15.144:0/1167008652 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0032ca0 con 0x7f8bd00d02a0 2024-09-11T23:25:01.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.031+0000 7f8bd5c00640 1 -- 172.21.15.144:0/1167008652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd00d02a0 msgr2=0x7f8bd00d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:01.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.031+0000 7f8bd5c00640 1 --2- 172.21.15.144:0/1167008652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd00d02a0 0x7f8bd00d0680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8bd006f400 tx=0x7f8bc002c810 comp rx=0 tx=0).stop 2024-09-11T23:25:01.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.031+0000 7f8bd5c00640 1 -- 172.21.15.144:0/1167008652 shutdown_connections 2024-09-11T23:25:01.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.031+0000 7f8bd5c00640 1 --2- 172.21.15.144:0/1167008652 >> v2:172.21.15.144:3300/0 conn(0x7f8bd015ce80 0x7f8bd01594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.031+0000 7f8bd5c00640 1 --2- 172.21.15.144:0/1167008652 >> v2:172.21.15.165:3300/0 conn(0x7f8bd015ca40 0x7f8bd015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.031+0000 7f8bd5c00640 1 --2- 172.21.15.144:0/1167008652 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd00d02a0 0x7f8bd00d0680 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.031+0000 7f8bd5c00640 1 -- 172.21.15.144:0/1167008652 >> 172.21.15.144:0/1167008652 conn(0x7f8bd0062cc0 msgr2=0x7f8bd006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:01.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.031+0000 7f8bd5c00640 1 -- 172.21.15.144:0/1167008652 shutdown_connections 2024-09-11T23:25:01.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.032+0000 7f8bd5c00640 1 -- 172.21.15.144:0/1167008652 wait complete. 2024-09-11T23:25:01.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.033+0000 7f8bd5c00640 1 Processor -- start 2024-09-11T23:25:01.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.033+0000 7f8bd5c00640 1 -- start start 2024-09-11T23:25:01.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.034+0000 7f8bd5c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd00d02a0 0x7f8bd01f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.034+0000 7f8bd5c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bd015ca40 0x7f8bd01f7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.034+0000 7f8bd5c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bd015ce80 0x7f8bd0140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.034+0000 7f8bd5c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd0155b90 con 0x7f8bd015ca40 2024-09-11T23:25:01.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.034+0000 7f8bd5c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd015df10 con 0x7f8bd015ce80 2024-09-11T23:25:01.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.034+0000 7f8bd5c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd0155d10 con 0x7f8bd00d02a0 2024-09-11T23:25:01.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.034+0000 7f8bc6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bd015ca40 0x7f8bd01f7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.034+0000 7f8bc6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bd015ca40 0x7f8bd01f7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59282/0 (socket says 172.21.15.144:59282) 2024-09-11T23:25:01.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.034+0000 7f8bcea00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd00d02a0 0x7f8bd01f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.034+0000 7f8bc6000640 1 -- 172.21.15.144:0/4220276692 learned_addr learned my addr 172.21.15.144:0/4220276692 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:01.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.035+0000 7f8bcf400640 1 --2- 172.21.15.144:0/4220276692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bd015ce80 0x7f8bd0140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.035+0000 7f8bc6000640 1 -- 172.21.15.144:0/4220276692 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd00d02a0 msgr2=0x7f8bd01f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:01.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.035+0000 7f8bc6000640 1 --2- 172.21.15.144:0/4220276692 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd00d02a0 0x7f8bd01f4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.035+0000 7f8bc6000640 1 -- 172.21.15.144:0/4220276692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bd015ce80 msgr2=0x7f8bd0140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:01.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.035+0000 7f8bc6000640 1 --2- 172.21.15.144:0/4220276692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bd015ce80 0x7f8bd0140fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.035+0000 7f8bc6000640 1 -- 172.21.15.144:0/4220276692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd0140850 con 0x7f8bd015ca40 2024-09-11T23:25:01.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.035+0000 7f8bcea00640 1 --2- 172.21.15.144:0/4220276692 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd00d02a0 0x7f8bd01f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:25:01.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.035+0000 7f8bc6000640 1 --2- 172.21.15.144:0/4220276692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bd015ca40 0x7f8bd01f7770 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f8bb800e8c0 tx=0x7f8bb800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:01.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.035+0000 7f8bc7400640 1 -- 172.21.15.144:0/4220276692 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8017070 con 0x7f8bd015ca40 2024-09-11T23:25:01.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.035+0000 7f8bc7400640 1 -- 172.21.15.144:0/4220276692 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb800c940 con 0x7f8bd015ca40 2024-09-11T23:25:01.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.036+0000 7f8bc7400640 1 -- 172.21.15.144:0/4220276692 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb800cd10 con 0x7f8bd015ca40 2024-09-11T23:25:01.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.036+0000 7f8bd5c00640 1 -- 172.21.15.144:0/4220276692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd01f7fc0 con 0x7f8bd015ca40 2024-09-11T23:25:01.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.036+0000 7f8bd5c00640 1 -- 172.21.15.144:0/4220276692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd0140ac0 con 0x7f8bd015ca40 2024-09-11T23:25:01.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.037+0000 7f8bd5c00640 1 -- 172.21.15.144:0/4220276692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bd00b4790 con 0x7f8bd015ca40 2024-09-11T23:25:01.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.038+0000 7f8bc7400640 1 -- 172.21.15.144:0/4220276692 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f8bb801a070 con 0x7f8bd015ca40 2024-09-11T23:25:01.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.039+0000 7f8bc7400640 1 --2- 172.21.15.144:0/4220276692 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8bac06c460 0x7f8bac06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.039+0000 7f8bc7400640 1 -- 172.21.15.144:0/4220276692 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f8bb808b690 con 0x7f8bd015ca40 2024-09-11T23:25:01.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.039+0000 7f8bcea00640 1 --2- 172.21.15.144:0/4220276692 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8bac06c460 0x7f8bac06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.040+0000 7f8bcea00640 1 --2- 172.21.15.144:0/4220276692 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8bac06c460 0x7f8bac06e920 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0037000 tx=0x7f8bc0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:01.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.043+0000 7f8bc7400640 1 -- 172.21.15.144:0/4220276692 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8bb8059170 con 0x7f8bd015ca40 2024-09-11T23:25:01.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.253+0000 7f8bd5c00640 1 -- 172.21.15.144:0/4220276692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8bd0076170 con 0x7f8bd015ca40 2024-09-11T23:25:01.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.254+0000 7f8bc7400640 1 -- 172.21.15.144:0/4220276692 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5239 (secure 0 0 0) 0x7f8bb805d470 con 0x7f8bd015ca40 2024-09-11T23:25:01.255 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:01.255 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":91,"btime":"2024-09-11T23:24:48:545080+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6587,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/3230009607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3230009607},{"type":"v1","addr":"172.21.15.144:6801","nonce":3230009607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7755,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2789293878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2789293878},{"type":"v1","addr":"172.21.15.165:6834","nonce":2789293878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7758,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2328841770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2328841770},{"type":"v1","addr":"172.21.15.165:6835","nonce":2328841770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:24:37.895286+0000","modified":"2024-09-11T23:24:40.918906+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7761":{"gid":7761,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1155743669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1155743669},{"type":"v1","addr":"172.21.15.144:6835","nonce":1155743669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7761,"qdb_cluster":[7761]},"id":10}]} 2024-09-11T23:25:01.255 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 91 2024-09-11T23:25:01.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.256+0000 7f8bd5c00640 1 -- 172.21.15.144:0/4220276692 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8bac06c460 msgr2=0x7f8bac06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:01.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.256+0000 7f8bd5c00640 1 --2- 172.21.15.144:0/4220276692 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8bac06c460 0x7f8bac06e920 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0037000 tx=0x7f8bc0008040 comp rx=0 tx=0).stop 2024-09-11T23:25:01.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.256+0000 7f8bd5c00640 1 -- 172.21.15.144:0/4220276692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bd015ca40 msgr2=0x7f8bd01f7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:01.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.256+0000 7f8bd5c00640 1 --2- 172.21.15.144:0/4220276692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bd015ca40 0x7f8bd01f7770 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f8bb800e8c0 tx=0x7f8bb800ed80 comp rx=0 tx=0).stop 2024-09-11T23:25:01.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.256+0000 7f8bd5c00640 1 -- 172.21.15.144:0/4220276692 shutdown_connections 2024-09-11T23:25:01.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.256+0000 7f8bd5c00640 1 --2- 172.21.15.144:0/4220276692 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8bac06c460 0x7f8bac06e920 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.256+0000 7f8bd5c00640 1 --2- 172.21.15.144:0/4220276692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bd015ce80 0x7f8bd0140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.256+0000 7f8bd5c00640 1 --2- 172.21.15.144:0/4220276692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8bd015ca40 0x7f8bd01f7770 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.256+0000 7f8bd5c00640 1 --2- 172.21.15.144:0/4220276692 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8bd00d02a0 0x7f8bd01f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.256+0000 7f8bd5c00640 1 -- 172.21.15.144:0/4220276692 >> 172.21.15.144:0/4220276692 conn(0x7f8bd0062cc0 msgr2=0x7f8bd00b1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:01.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.256+0000 7f8bd5c00640 1 -- 172.21.15.144:0/4220276692 shutdown_connections 2024-09-11T23:25:01.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.256+0000 7f8bd5c00640 1 -- 172.21.15.144:0/4220276692 wait complete. 2024-09-11T23:25:01.273 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:25:01.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.426+0000 7f8b0b200640 1 Processor -- start 2024-09-11T23:25:01.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.426+0000 7f8b0b200640 1 -- start start 2024-09-11T23:25:01.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.427+0000 7f8b0b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b040d02a0 0x7f8b040d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.428+0000 7f8b0b200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b040d0bc0 con 0x7f8b0415ce80 2024-09-11T23:25:01.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.428+0000 7f8b0b200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0415d390 con 0x7f8b0415ca40 2024-09-11T23:25:01.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.428+0000 7f8b0b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8b0415d670 con 0x7f8b040d02a0 2024-09-11T23:25:01.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.428+0000 7f8b09200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8b0415ce80 0x7f8b041594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37384/0 (socket says 172.21.15.144:37384) 2024-09-11T23:25:01.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.428+0000 7f8b09200640 1 -- 172.21.15.144:0/601045526 learned_addr learned my addr 172.21.15.144:0/601045526 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:01.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.428+0000 7f8b03e00640 1 --2- 172.21.15.144:0/601045526 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b040d02a0 0x7f8b040d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.428+0000 7f8b02a00640 1 -- 172.21.15.144:0/601045526 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3115993718 0 0) 0x7f8b040d0bc0 con 0x7f8b0415ce80 2024-09-11T23:25:01.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.428+0000 7f8b02a00640 1 -- 172.21.15.144:0/601045526 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ae8003520 con 0x7f8b0415ce80 2024-09-11T23:25:01.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.429+0000 7f8b03e00640 1 -- 172.21.15.144:0/601045526 >> v1:172.21.15.165:6789/0 conn(0x7f8b0415ca40 legacy=0x7f8b0415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:01.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.429+0000 7f8b02a00640 1 -- 172.21.15.144:0/601045526 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2429972641 0 0) 0x7f8b0415d390 con 0x7f8b0415ca40 2024-09-11T23:25:01.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.429+0000 7f8b03e00640 1 -- 172.21.15.144:0/601045526 >> v1:172.21.15.144:6789/0 conn(0x7f8b0415ce80 legacy=0x7f8b041594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:01.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.429+0000 7f8b03e00640 1 -- 172.21.15.144:0/601045526 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0415d950 con 0x7f8b040d02a0 2024-09-11T23:25:01.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.430+0000 7f8b03e00640 1 --2- 172.21.15.144:0/601045526 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b040d02a0 0x7f8b040d0680 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8af40097d0 tx=0x7f8af402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2bd5eac3232b9f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:01.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.430+0000 7f8b02a00640 1 -- 172.21.15.144:0/601045526 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af4037070 con 0x7f8b040d02a0 2024-09-11T23:25:01.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.430+0000 7f8b02a00640 1 -- 172.21.15.144:0/601045526 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af4032440 con 0x7f8b040d02a0 2024-09-11T23:25:01.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.430+0000 7f8b02a00640 1 -- 172.21.15.144:0/601045526 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af40327f0 con 0x7f8b040d02a0 2024-09-11T23:25:01.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.431+0000 7f8b0b200640 1 -- 172.21.15.144:0/601045526 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b040d02a0 msgr2=0x7f8b040d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:01.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.431+0000 7f8b0b200640 1 --2- 172.21.15.144:0/601045526 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b040d02a0 0x7f8b040d0680 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8af40097d0 tx=0x7f8af402a180 comp rx=0 tx=0).stop 2024-09-11T23:25:01.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.431+0000 7f8b0b200640 1 -- 172.21.15.144:0/601045526 shutdown_connections 2024-09-11T23:25:01.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.431+0000 7f8b0b200640 1 --2- 172.21.15.144:0/601045526 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b040d02a0 0x7f8b040d0680 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.431+0000 7f8b0b200640 1 -- 172.21.15.144:0/601045526 >> 172.21.15.144:0/601045526 conn(0x7f8b04062cc0 msgr2=0x7f8b0406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:01.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.431+0000 7f8b0b200640 1 -- 172.21.15.144:0/601045526 shutdown_connections 2024-09-11T23:25:01.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.431+0000 7f8b0b200640 1 -- 172.21.15.144:0/601045526 wait complete. 2024-09-11T23:25:01.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.432+0000 7f8b0b200640 1 Processor -- start 2024-09-11T23:25:01.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.432+0000 7f8b0b200640 1 -- start start 2024-09-11T23:25:01.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.433+0000 7f8b0b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b040d02a0 0x7f8b04073a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.433+0000 7f8b0b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b0415ca40 0x7f8b0415aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.433+0000 7f8b0b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b0415ce80 0x7f8b04149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.433+0000 7f8b0b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0415eb40 con 0x7f8b0415ca40 2024-09-11T23:25:01.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.433+0000 7f8b0b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0415df10 con 0x7f8b040d02a0 2024-09-11T23:25:01.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.433+0000 7f8b0b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8b04155b90 con 0x7f8b0415ce80 2024-09-11T23:25:01.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.434+0000 7f8b03400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b0415ca40 0x7f8b0415aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.434+0000 7f8b03400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b0415ca40 0x7f8b0415aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59286/0 (socket says 172.21.15.144:59286) 2024-09-11T23:25:01.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.434+0000 7f8b03400640 1 -- 172.21.15.144:0/1703988091 learned_addr learned my addr 172.21.15.144:0/1703988091 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:01.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.434+0000 7f8b03e00640 1 --2- 172.21.15.144:0/1703988091 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b040d02a0 0x7f8b04073a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.434+0000 7f8b09200640 1 --2- 172.21.15.144:0/1703988091 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b0415ce80 0x7f8b04149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.434+0000 7f8b03400640 1 -- 172.21.15.144:0/1703988091 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b0415ce80 msgr2=0x7f8b04149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:01.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.434+0000 7f8b03400640 1 --2- 172.21.15.144:0/1703988091 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b0415ce80 0x7f8b04149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.434+0000 7f8b03400640 1 -- 172.21.15.144:0/1703988091 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b040d02a0 msgr2=0x7f8b04073a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:01.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.434+0000 7f8b03400640 1 --2- 172.21.15.144:0/1703988091 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b040d02a0 0x7f8b04073a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.434+0000 7f8b03400640 1 -- 172.21.15.144:0/1703988091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b04071110 con 0x7f8b0415ca40 2024-09-11T23:25:01.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.434+0000 7f8b03400640 1 --2- 172.21.15.144:0/1703988091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b0415ca40 0x7f8b0415aa80 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f8af000c3e0 tx=0x7f8af000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:01.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.435+0000 7f8afbe00640 1 -- 172.21.15.144:0/1703988091 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0017070 con 0x7f8b0415ca40 2024-09-11T23:25:01.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.435+0000 7f8afbe00640 1 -- 172.21.15.144:0/1703988091 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af00035f0 con 0x7f8b0415ca40 2024-09-11T23:25:01.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.435+0000 7f8afbe00640 1 -- 172.21.15.144:0/1703988091 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0003a00 con 0x7f8b0415ca40 2024-09-11T23:25:01.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.435+0000 7f8b0b200640 1 -- 172.21.15.144:0/1703988091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b04071380 con 0x7f8b0415ca40 2024-09-11T23:25:01.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.435+0000 7f8b0b200640 1 -- 172.21.15.144:0/1703988091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b04071940 con 0x7f8b0415ca40 2024-09-11T23:25:01.437 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.436+0000 7f8b0b200640 1 -- 172.21.15.144:0/1703988091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b04071e30 con 0x7f8b0415ca40 2024-09-11T23:25:01.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.437+0000 7f8afbe00640 1 -- 172.21.15.144:0/1703988091 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f8af001a070 con 0x7f8b0415ca40 2024-09-11T23:25:01.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.438+0000 7f8afbe00640 1 --2- 172.21.15.144:0/1703988091 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8ae406c460 0x7f8ae406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.438+0000 7f8afbe00640 1 -- 172.21.15.144:0/1703988091 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f8af008ae10 con 0x7f8b0415ca40 2024-09-11T23:25:01.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.438+0000 7f8b03e00640 1 --2- 172.21.15.144:0/1703988091 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8ae406c460 0x7f8ae406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.439+0000 7f8b03e00640 1 --2- 172.21.15.144:0/1703988091 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8ae406c460 0x7f8ae406e920 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8af4034000 tx=0x7f8af402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:01.442 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.442+0000 7f8afbe00640 1 -- 172.21.15.144:0/1703988091 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8af0058770 con 0x7f8b0415ca40 2024-09-11T23:25:01.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.652+0000 7f8b0b200640 1 -- 172.21.15.144:0/1703988091 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b040b4790 con 0x7f8b0415ca40 2024-09-11T23:25:01.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.653+0000 7f8afbe00640 1 -- 172.21.15.144:0/1703988091 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5239 (secure 0 0 0) 0x7f8af005ca70 con 0x7f8b0415ca40 2024-09-11T23:25:01.654 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:01.655 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":91,"btime":"2024-09-11T23:24:48:545080+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6587,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/3230009607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3230009607},{"type":"v1","addr":"172.21.15.144:6801","nonce":3230009607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7755,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2789293878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2789293878},{"type":"v1","addr":"172.21.15.165:6834","nonce":2789293878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7758,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2328841770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2328841770},{"type":"v1","addr":"172.21.15.165:6835","nonce":2328841770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:24:37.895286+0000","modified":"2024-09-11T23:24:40.918906+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7761":{"gid":7761,"name":"c","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1155743669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1155743669},{"type":"v1","addr":"172.21.15.144:6835","nonce":1155743669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7761,"qdb_cluster":[7761]},"id":10}]} 2024-09-11T23:25:01.655 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 91 2024-09-11T23:25:01.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.655+0000 7f8b0b200640 1 -- 172.21.15.144:0/1703988091 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8ae406c460 msgr2=0x7f8ae406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:01.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.655+0000 7f8b0b200640 1 --2- 172.21.15.144:0/1703988091 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8ae406c460 0x7f8ae406e920 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8af4034000 tx=0x7f8af402e000 comp rx=0 tx=0).stop 2024-09-11T23:25:01.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.655+0000 7f8b0b200640 1 -- 172.21.15.144:0/1703988091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b0415ca40 msgr2=0x7f8b0415aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:01.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.655+0000 7f8b0b200640 1 --2- 172.21.15.144:0/1703988091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b0415ca40 0x7f8b0415aa80 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f8af000c3e0 tx=0x7f8af000c8a0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.655+0000 7f8b0b200640 1 -- 172.21.15.144:0/1703988091 shutdown_connections 2024-09-11T23:25:01.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.655+0000 7f8b0b200640 1 --2- 172.21.15.144:0/1703988091 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8ae406c460 0x7f8ae406e920 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.655+0000 7f8b0b200640 1 --2- 172.21.15.144:0/1703988091 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8b0415ce80 0x7f8b04149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.655+0000 7f8b0b200640 1 --2- 172.21.15.144:0/1703988091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b0415ca40 0x7f8b0415aa80 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.655+0000 7f8b0b200640 1 --2- 172.21.15.144:0/1703988091 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8b040d02a0 0x7f8b04073a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.655+0000 7f8b0b200640 1 -- 172.21.15.144:0/1703988091 >> 172.21.15.144:0/1703988091 conn(0x7f8b04062cc0 msgr2=0x7f8b040d0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:01.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.655+0000 7f8b0b200640 1 -- 172.21.15.144:0/1703988091 shutdown_connections 2024-09-11T23:25:01.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.655+0000 7f8b0b200640 1 -- 172.21.15.144:0/1703988091 wait complete. 2024-09-11T23:25:01.672 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:25:01.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.824+0000 7fd60b200640 1 Processor -- start 2024-09-11T23:25:01.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.825+0000 7fd60b200640 1 -- start start 2024-09-11T23:25:01.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.826+0000 7fd60b200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd60c071490 0x7fd60c0d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.826+0000 7fd60b200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd60c0d22a0 con 0x7fd60c0b6d00 2024-09-11T23:25:01.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.826+0000 7fd60b200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd60c0718e0 con 0x7fd60c0d1b00 2024-09-11T23:25:01.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.826+0000 7fd60b200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd60c0b5720 con 0x7fd60c071490 2024-09-11T23:25:01.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.826+0000 7fd609e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd60c0b6d00 0x7fd60c15f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37390/0 (socket says 172.21.15.144:37390) 2024-09-11T23:25:01.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.826+0000 7fd609e00640 1 -- 172.21.15.144:0/4273885277 learned_addr learned my addr 172.21.15.144:0/4273885277 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:01.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.826+0000 7fd60a800640 1 --2- 172.21.15.144:0/4273885277 >> v2:172.21.15.165:3300/0 conn(0x7fd60c071490 0x7fd60c0d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd609400640 1 -- 172.21.15.144:0/4273885277 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1756515172 0 0) 0x7fd60c0d22a0 con 0x7fd60c0b6d00 2024-09-11T23:25:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd609400640 1 -- 172.21.15.144:0/4273885277 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5f0003520 con 0x7fd60c0b6d00 2024-09-11T23:25:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd609400640 1 -- 172.21.15.144:0/4273885277 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1496358685 0 0) 0x7fd60c0718e0 con 0x7fd60c0d1b00 2024-09-11T23:25:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd609400640 1 -- 172.21.15.144:0/4273885277 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd60c0d22a0 con 0x7fd60c0d1b00 2024-09-11T23:25:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd609400640 1 -- 172.21.15.144:0/4273885277 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2374970462 0 0) 0x7fd5f0003520 con 0x7fd60c0b6d00 2024-09-11T23:25:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd609400640 1 -- 172.21.15.144:0/4273885277 >> v2:172.21.15.165:3300/0 conn(0x7fd60c071490 msgr2=0x7fd60c0d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:01.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd609400640 1 --2- 172.21.15.144:0/4273885277 >> v2:172.21.15.165:3300/0 conn(0x7fd60c071490 0x7fd60c0d0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd609400640 1 -- 172.21.15.144:0/4273885277 >> v1:172.21.15.165:6789/0 conn(0x7fd60c0d1b00 legacy=0x7fd60c0b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd609400640 1 -- 172.21.15.144:0/4273885277 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c0d1fc0 con 0x7fd60c0b6d00 2024-09-11T23:25:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd609400640 1 -- 172.21.15.144:0/4273885277 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fd5fc001670 con 0x7fd60c0b6d00 2024-09-11T23:25:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd60a800640 1 --2- 172.21.15.144:0/4273885277 >> v2:172.21.15.165:3300/0 conn(0x7fd60c071490 0x7fd60c0d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:25:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd609400640 1 -- 172.21.15.144:0/4273885277 >> v1:172.21.15.144:6789/0 conn(0x7fd60c0b6d00 legacy=0x7fd60c15f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd609400640 1 --2- 172.21.15.144:0/4273885277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd5f0003b90 0x7fd5f0003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd609400640 1 --2- 172.21.15.144:0/4273885277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5f0004800 0x7fd5f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd609400640 1 --2- 172.21.15.144:0/4273885277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5f00051c0 0x7fd5f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd609400640 1 -- 172.21.15.144:0/4273885277 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f000c090 con 0x7fd5f0004800 2024-09-11T23:25:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd609400640 1 -- 172.21.15.144:0/4273885277 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f000c210 con 0x7fd5f00051c0 2024-09-11T23:25:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd609400640 1 -- 172.21.15.144:0/4273885277 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f000c410 con 0x7fd5f0003b90 2024-09-11T23:25:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd601400640 1 --2- 172.21.15.144:0/4273885277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5f0004800 0x7fd5f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd609e00640 1 --2- 172.21.15.144:0/4273885277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd5f0003b90 0x7fd5f0003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.827+0000 7fd60a800640 1 --2- 172.21.15.144:0/4273885277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5f00051c0 0x7fd5f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.828+0000 7fd601400640 1 -- 172.21.15.144:0/4273885277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd5f0003b90 msgr2=0x7fd5f0003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:01.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.828+0000 7fd601400640 1 --2- 172.21.15.144:0/4273885277 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd5f0003b90 0x7fd5f0003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.828+0000 7fd601400640 1 -- 172.21.15.144:0/4273885277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5f00051c0 msgr2=0x7fd5f000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:01.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.828+0000 7fd601400640 1 --2- 172.21.15.144:0/4273885277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5f00051c0 0x7fd5f000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.828+0000 7fd601400640 1 -- 172.21.15.144:0/4273885277 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f0003520 con 0x7fd5f0004800 2024-09-11T23:25:01.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.828+0000 7fd60a800640 1 -- 172.21.15.144:0/4273885277 reap_dead start 2024-09-11T23:25:01.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.829+0000 7fd601400640 1 --2- 172.21.15.144:0/4273885277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5f0004800 0x7fd5f0004c80 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40018d0 tx=0x7fd5f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf773fbdfe2d064 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:01.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.829+0000 7fd609400640 1 -- 172.21.15.144:0/4273885277 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f40014f0 con 0x7fd5f0004800 2024-09-11T23:25:01.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.829+0000 7fd609400640 1 -- 172.21.15.144:0/4273885277 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f40052d0 con 0x7fd5f0004800 2024-09-11T23:25:01.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.829+0000 7fd609400640 1 -- 172.21.15.144:0/4273885277 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f402ac40 con 0x7fd5f0004800 2024-09-11T23:25:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.829+0000 7fd60b200640 1 -- 172.21.15.144:0/4273885277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5f0004800 msgr2=0x7fd5f0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.829+0000 7fd60b200640 1 --2- 172.21.15.144:0/4273885277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5f0004800 0x7fd5f0004c80 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40018d0 tx=0x7fd5f0005830 comp rx=0 tx=0).stop 2024-09-11T23:25:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.829+0000 7fd60b200640 1 -- 172.21.15.144:0/4273885277 shutdown_connections 2024-09-11T23:25:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.829+0000 7fd60b200640 1 --2- 172.21.15.144:0/4273885277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd5f0004800 0x7fd5f0004c80 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.829+0000 7fd60b200640 1 -- 172.21.15.144:0/4273885277 >> 172.21.15.144:0/4273885277 conn(0x7fd60c06f390 msgr2=0x7fd60c06f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.830+0000 7fd60b200640 1 -- 172.21.15.144:0/4273885277 shutdown_connections 2024-09-11T23:25:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.830+0000 7fd60b200640 1 -- 172.21.15.144:0/4273885277 wait complete. 2024-09-11T23:25:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.831+0000 7fd60b200640 1 Processor -- start 2024-09-11T23:25:01.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.831+0000 7fd60b200640 1 -- start start 2024-09-11T23:25:01.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.832+0000 7fd60b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5f0004800 0x7fd60c1e94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.832+0000 7fd60b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd60c14ec80 0x7fd60c1e6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.832+0000 7fd60b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd60c06dc20 0x7fd60c06e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.832+0000 7fd60b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c070c90 con 0x7fd60c06dc20 2024-09-11T23:25:01.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.832+0000 7fd60b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c071000 con 0x7fd5f0004800 2024-09-11T23:25:01.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.832+0000 7fd60b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd60c158f50 con 0x7fd60c14ec80 2024-09-11T23:25:01.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.832+0000 7fd60a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd60c06dc20 0x7fd60c06e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.832+0000 7fd60a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd60c06dc20 0x7fd60c06e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59298/0 (socket says 172.21.15.144:59298) 2024-09-11T23:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.832+0000 7fd60a800640 1 -- 172.21.15.144:0/3093525978 learned_addr learned my addr 172.21.15.144:0/3093525978 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.832+0000 7fd609e00640 1 --2- 172.21.15.144:0/3093525978 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5f0004800 0x7fd60c1e94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.833+0000 7fd601400640 1 --2- 172.21.15.144:0/3093525978 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd60c14ec80 0x7fd60c1e6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.833+0000 7fd60a800640 1 -- 172.21.15.144:0/3093525978 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd60c14ec80 msgr2=0x7fd60c1e6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.833+0000 7fd60a800640 1 --2- 172.21.15.144:0/3093525978 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd60c14ec80 0x7fd60c1e6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.833+0000 7fd60a800640 1 -- 172.21.15.144:0/3093525978 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5f0004800 msgr2=0x7fd60c1e94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.833+0000 7fd60a800640 1 --2- 172.21.15.144:0/3093525978 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5f0004800 0x7fd60c1e94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.833+0000 7fd60a800640 1 -- 172.21.15.144:0/3093525978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c1e73d0 con 0x7fd60c06dc20 2024-09-11T23:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.833+0000 7fd60a800640 1 --2- 172.21.15.144:0/3093525978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd60c06dc20 0x7fd60c06e0a0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0b1c40 tx=0x7fd60400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.833+0000 7fd602a00640 1 -- 172.21.15.144:0/3093525978 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604003990 con 0x7fd60c06dc20 2024-09-11T23:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.833+0000 7fd602a00640 1 -- 172.21.15.144:0/3093525978 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd604003b30 con 0x7fd60c06dc20 2024-09-11T23:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.833+0000 7fd602a00640 1 -- 172.21.15.144:0/3093525978 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604004020 con 0x7fd60c06dc20 2024-09-11T23:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.833+0000 7fd60b200640 1 -- 172.21.15.144:0/3093525978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60c159260 con 0x7fd60c06dc20 2024-09-11T23:25:01.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.834+0000 7fd60b200640 1 -- 172.21.15.144:0/3093525978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd60c159820 con 0x7fd60c06dc20 2024-09-11T23:25:01.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.835+0000 7fd60b200640 1 -- 172.21.15.144:0/3093525978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd60c0b70e0 con 0x7fd60c06dc20 2024-09-11T23:25:01.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.836+0000 7fd602a00640 1 -- 172.21.15.144:0/3093525978 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7fd6040041c0 con 0x7fd60c06dc20 2024-09-11T23:25:01.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.836+0000 7fd602a00640 1 --2- 172.21.15.144:0/3093525978 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd5e806c490 0x7fd5e806e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:01.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.836+0000 7fd602a00640 1 -- 172.21.15.144:0/3093525978 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7fd60408c4f0 con 0x7fd60c06dc20 2024-09-11T23:25:01.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.837+0000 7fd609e00640 1 --2- 172.21.15.144:0/3093525978 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd5e806c490 0x7fd5e806e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:01.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.837+0000 7fd609e00640 1 --2- 172.21.15.144:0/3093525978 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd5e806c490 0x7fd5e806e950 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc000c00 tx=0x7fd5fc000ed0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:01.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:01.840+0000 7fd602a00640 1 -- 172.21.15.144:0/3093525978 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd604019030 con 0x7fd60c06dc20 2024-09-11T23:25:02.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.015+0000 7fd60b200640 1 -- 172.21.15.144:0/3093525978 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd60c0b3a00 con 0x7fd60c06dc20 2024-09-11T23:25:02.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.016+0000 7fd602a00640 1 -- 172.21.15.144:0/3093525978 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) ==== 74+0+16763 (secure 0 0 0) 0x7fd604010040 con 0x7fd60c06dc20 2024-09-11T23:25:02.017 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:02.018 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":131,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:24:39.495019+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:24:35.685780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-11T23:24:36.890387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:25:02.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.019+0000 7fd60b200640 1 -- 172.21.15.144:0/3093525978 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd5e806c490 msgr2=0x7fd5e806e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:02.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.019+0000 7fd60b200640 1 --2- 172.21.15.144:0/3093525978 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd5e806c490 0x7fd5e806e950 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc000c00 tx=0x7fd5fc000ed0 comp rx=0 tx=0).stop 2024-09-11T23:25:02.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.019+0000 7fd60b200640 1 -- 172.21.15.144:0/3093525978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd60c06dc20 msgr2=0x7fd60c06e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:02.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.019+0000 7fd60b200640 1 --2- 172.21.15.144:0/3093525978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd60c06dc20 0x7fd60c06e0a0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0b1c40 tx=0x7fd60400f580 comp rx=0 tx=0).stop 2024-09-11T23:25:02.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.019+0000 7fd60b200640 1 -- 172.21.15.144:0/3093525978 shutdown_connections 2024-09-11T23:25:02.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.019+0000 7fd60b200640 1 --2- 172.21.15.144:0/3093525978 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd5e806c490 0x7fd5e806e950 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:02.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.019+0000 7fd60b200640 1 --2- 172.21.15.144:0/3093525978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd60c06dc20 0x7fd60c06e0a0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:02.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.019+0000 7fd60b200640 1 --2- 172.21.15.144:0/3093525978 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd60c14ec80 0x7fd60c1e6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:02.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.019+0000 7fd60b200640 1 --2- 172.21.15.144:0/3093525978 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5f0004800 0x7fd60c1e94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:02.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.019+0000 7fd60b200640 1 -- 172.21.15.144:0/3093525978 >> 172.21.15.144:0/3093525978 conn(0x7fd60c06f390 msgr2=0x7fd60c06f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:02.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.019+0000 7fd60b200640 1 -- 172.21.15.144:0/3093525978 shutdown_connections 2024-09-11T23:25:02.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.019+0000 7fd60b200640 1 -- 172.21.15.144:0/3093525978 wait complete. 2024-09-11T23:25:02.036 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:25:02.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.189+0000 7f2389e00640 1 Processor -- start 2024-09-11T23:25:02.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.190+0000 7f2389e00640 1 -- start start 2024-09-11T23:25:02.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.191+0000 7f2389e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f23840b4510 0x7f23840b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:02.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.191+0000 7f2389e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23840b31d0 con 0x7f238415b150 2024-09-11T23:25:02.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.191+0000 7f2389e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f238415c0a0 con 0x7f23840b3ea0 2024-09-11T23:25:02.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.191+0000 7f2389e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f238415c380 con 0x7f23840b4510 2024-09-11T23:25:02.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.191+0000 7f2388a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f238415b150 0x7f23840ccaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37400/0 (socket says 172.21.15.144:37400) 2024-09-11T23:25:02.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.191+0000 7f2388a00640 1 -- 172.21.15.144:0/1725538178 learned_addr learned my addr 172.21.15.144:0/1725538178 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.191+0000 7f237be00640 1 --2- 172.21.15.144:0/1725538178 >> v2:172.21.15.165:3300/0 conn(0x7f23840b4510 0x7f23840b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.191+0000 7f2383e00640 1 -- 172.21.15.144:0/1725538178 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4253677205 0 0) 0x7f23840b31d0 con 0x7f238415b150 2024-09-11T23:25:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.191+0000 7f2383e00640 1 -- 172.21.15.144:0/1725538178 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2368003520 con 0x7f238415b150 2024-09-11T23:25:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.192+0000 7f2383e00640 1 -- 172.21.15.144:0/1725538178 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2276681463 0 0) 0x7f2368003520 con 0x7f238415b150 2024-09-11T23:25:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.192+0000 7f2383e00640 1 -- 172.21.15.144:0/1725538178 >> v2:172.21.15.165:3300/0 conn(0x7f23840b4510 msgr2=0x7f23840b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.192+0000 7f2383e00640 1 --2- 172.21.15.144:0/1725538178 >> v2:172.21.15.165:3300/0 conn(0x7f23840b4510 0x7f23840b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.192+0000 7f2383e00640 1 -- 172.21.15.144:0/1725538178 >> v1:172.21.15.165:6789/0 conn(0x7f23840b3ea0 legacy=0x7f238415b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.192+0000 7f2383e00640 1 -- 172.21.15.144:0/1725538178 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23840b3440 con 0x7f238415b150 2024-09-11T23:25:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.192+0000 7f2383e00640 1 -- 172.21.15.144:0/1725538178 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f2374001670 con 0x7f238415b150 2024-09-11T23:25:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.192+0000 7f2383e00640 1 -- 172.21.15.144:0/1725538178 >> v1:172.21.15.144:6789/0 conn(0x7f238415b150 legacy=0x7f23840ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.192+0000 7f2383e00640 1 --2- 172.21.15.144:0/1725538178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2368003a30 0x7f2368003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:02.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.192+0000 7f2383e00640 1 --2- 172.21.15.144:0/1725538178 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2368004800 0x7f2368004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:02.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.192+0000 7f2383e00640 1 --2- 172.21.15.144:0/1725538178 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f23680051c0 0x7f236800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:02.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.192+0000 7f2383e00640 1 -- 172.21.15.144:0/1725538178 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f238415c380 con 0x7f2368003a30 2024-09-11T23:25:02.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.192+0000 7f2383e00640 1 -- 172.21.15.144:0/1725538178 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f236800c0f0 con 0x7f2368004800 2024-09-11T23:25:02.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.192+0000 7f2383e00640 1 -- 172.21.15.144:0/1725538178 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f236800c2f0 con 0x7f23680051c0 2024-09-11T23:25:02.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.192+0000 7f2388a00640 1 --2- 172.21.15.144:0/1725538178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2368003a30 0x7f2368003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:02.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.192+0000 7f237be00640 1 --2- 172.21.15.144:0/1725538178 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2368004800 0x7f2368004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:02.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.192+0000 7f2389400640 1 --2- 172.21.15.144:0/1725538178 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f23680051c0 0x7f236800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:02.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.192+0000 7f2388a00640 1 -- 172.21.15.144:0/1725538178 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f23680051c0 msgr2=0x7f236800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:02.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.192+0000 7f2388a00640 1 --2- 172.21.15.144:0/1725538178 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f23680051c0 0x7f236800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:02.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.192+0000 7f2388a00640 1 -- 172.21.15.144:0/1725538178 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2368004800 msgr2=0x7f2368004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:02.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.192+0000 7f2388a00640 1 --2- 172.21.15.144:0/1725538178 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2368004800 0x7f2368004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:02.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.193+0000 7f2388a00640 1 -- 172.21.15.144:0/1725538178 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2368003520 con 0x7f2368003a30 2024-09-11T23:25:02.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.193+0000 7f2389400640 1 --2- 172.21.15.144:0/1725538178 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f23680051c0 0x7f236800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:02.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.193+0000 7f237be00640 1 --2- 172.21.15.144:0/1725538178 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2368004800 0x7f2368004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:02.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.193+0000 7f2389400640 1 -- 172.21.15.144:0/1725538178 reap_dead start 2024-09-11T23:25:02.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.193+0000 7f2388a00640 1 --2- 172.21.15.144:0/1725538178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2368003a30 0x7f2368003e50 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f237400c0e0 tx=0x7f2368005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1081c6272e1b0d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:02.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.194+0000 7f2383e00640 1 -- 172.21.15.144:0/1725538178 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374007c20 con 0x7f2368003a30 2024-09-11T23:25:02.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.194+0000 7f2383e00640 1 -- 172.21.15.144:0/1725538178 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2374005af0 con 0x7f2368003a30 2024-09-11T23:25:02.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.194+0000 7f2383e00640 1 -- 172.21.15.144:0/1725538178 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374007070 con 0x7f2368003a30 2024-09-11T23:25:02.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.194+0000 7f2389e00640 1 -- 172.21.15.144:0/1725538178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2368003a30 msgr2=0x7f2368003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:02.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.194+0000 7f2389e00640 1 --2- 172.21.15.144:0/1725538178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2368003a30 0x7f2368003e50 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f237400c0e0 tx=0x7f2368005830 comp rx=0 tx=0).stop 2024-09-11T23:25:02.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.194+0000 7f2389e00640 1 -- 172.21.15.144:0/1725538178 shutdown_connections 2024-09-11T23:25:02.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.194+0000 7f2389e00640 1 --2- 172.21.15.144:0/1725538178 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2368003a30 0x7f2368003e50 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:02.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.194+0000 7f2389e00640 1 -- 172.21.15.144:0/1725538178 >> 172.21.15.144:0/1725538178 conn(0x7f238406e910 msgr2=0x7f238406bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:02.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.194+0000 7f2389e00640 1 -- 172.21.15.144:0/1725538178 shutdown_connections 2024-09-11T23:25:02.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.194+0000 7f2389e00640 1 -- 172.21.15.144:0/1725538178 wait complete. 2024-09-11T23:25:02.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.196+0000 7f2389e00640 1 Processor -- start 2024-09-11T23:25:02.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.196+0000 7f2389e00640 1 -- start start 2024-09-11T23:25:02.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.197+0000 7f2389e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2368003a30 0x7f238414d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:02.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.197+0000 7f2389e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2384158d50 0x7f23841591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:02.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.197+0000 7f2389e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23840ae8e0 0x7f23840aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:02.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.197+0000 7f2389e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f23840b3ae0 con 0x7f23840ae8e0 2024-09-11T23:25:02.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.197+0000 7f2389e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f23840b3960 con 0x7f2384158d50 2024-09-11T23:25:02.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.197+0000 7f2389e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f23840b3c60 con 0x7f2368003a30 2024-09-11T23:25:02.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.197+0000 7f2389400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23840ae8e0 0x7f23840aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:02.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.197+0000 7f2388a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2368003a30 0x7f238414d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:02.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.197+0000 7f2389400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23840ae8e0 0x7f23840aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59316/0 (socket says 172.21.15.144:59316) 2024-09-11T23:25:02.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.197+0000 7f2389400640 1 -- 172.21.15.144:0/792520446 learned_addr learned my addr 172.21.15.144:0/792520446 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:02.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.198+0000 7f237be00640 1 --2- 172.21.15.144:0/792520446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2384158d50 0x7f23841591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:02.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.198+0000 7f2389400640 1 -- 172.21.15.144:0/792520446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2368003a30 msgr2=0x7f238414d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:02.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.198+0000 7f2389400640 1 --2- 172.21.15.144:0/792520446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2368003a30 0x7f238414d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:02.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.198+0000 7f2389400640 1 -- 172.21.15.144:0/792520446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2384158d50 msgr2=0x7f23841591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:02.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.198+0000 7f2389400640 1 --2- 172.21.15.144:0/792520446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2384158d50 0x7f23841591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:02.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.198+0000 7f2389400640 1 -- 172.21.15.144:0/792520446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238414ddd0 con 0x7f23840ae8e0 2024-09-11T23:25:02.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.198+0000 7f2389400640 1 --2- 172.21.15.144:0/792520446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23840ae8e0 0x7f23840aed60 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f23840b2a50 tx=0x7f237c00db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:02.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.198+0000 7f2381600640 1 -- 172.21.15.144:0/792520446 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c018070 con 0x7f23840ae8e0 2024-09-11T23:25:02.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.198+0000 7f2389e00640 1 -- 172.21.15.144:0/792520446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f238415db90 con 0x7f23840ae8e0 2024-09-11T23:25:02.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.198+0000 7f2381600640 1 -- 172.21.15.144:0/792520446 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f237c003b70 con 0x7f23840ae8e0 2024-09-11T23:25:02.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.198+0000 7f2381600640 1 -- 172.21.15.144:0/792520446 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c005070 con 0x7f23840ae8e0 2024-09-11T23:25:02.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.199+0000 7f2389e00640 1 -- 172.21.15.144:0/792520446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f238415e150 con 0x7f23840ae8e0 2024-09-11T23:25:02.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.200+0000 7f2389e00640 1 -- 172.21.15.144:0/792520446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23840af2a0 con 0x7f23840ae8e0 2024-09-11T23:25:02.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.201+0000 7f2381600640 1 -- 172.21.15.144:0/792520446 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f237c01b070 con 0x7f23840ae8e0 2024-09-11T23:25:02.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.202+0000 7f2381600640 1 --2- 172.21.15.144:0/792520446 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f236006c460 0x7f236006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:02.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.202+0000 7f2381600640 1 -- 172.21.15.144:0/792520446 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5709+0+0 (secure 0 0 0) 0x7f237c08b200 con 0x7f23840ae8e0 2024-09-11T23:25:02.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.202+0000 7f2388a00640 1 --2- 172.21.15.144:0/792520446 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f236006c460 0x7f236006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:02.203 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.203+0000 7f2388a00640 1 --2- 172.21.15.144:0/792520446 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f236006c460 0x7f236006e920 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2374032000 tx=0x7f2374009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:02.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.206+0000 7f2381600640 1 -- 172.21.15.144:0/792520446 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f237c0589c0 con 0x7f23840ae8e0 2024-09-11T23:25:02.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.414+0000 7f2389e00640 1 -- 172.21.15.144:0/792520446 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f23840b1790 con 0x7f23840ae8e0 2024-09-11T23:25:02.415 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-11T23:25:02.415+0000 7f86fcc00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:25:02.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.417+0000 7f2381600640 1 -- 172.21.15.144:0/792520446 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v92) ==== 161+0+0 (secure 0 0 0) 0x7f237c05ccc0 con 0x7f23840ae8e0 2024-09-11T23:25:02.417 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:25:02.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.419+0000 7f2389e00640 1 -- 172.21.15.144:0/792520446 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f236006c460 msgr2=0x7f236006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:02.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.419+0000 7f2389e00640 1 --2- 172.21.15.144:0/792520446 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f236006c460 0x7f236006e920 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2374032000 tx=0x7f2374009030 comp rx=0 tx=0).stop 2024-09-11T23:25:02.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.419+0000 7f2389e00640 1 -- 172.21.15.144:0/792520446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23840ae8e0 msgr2=0x7f23840aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:02.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.419+0000 7f2389e00640 1 --2- 172.21.15.144:0/792520446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23840ae8e0 0x7f23840aed60 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f23840b2a50 tx=0x7f237c00db80 comp rx=0 tx=0).stop 2024-09-11T23:25:02.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.419+0000 7f2389e00640 1 -- 172.21.15.144:0/792520446 shutdown_connections 2024-09-11T23:25:02.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.419+0000 7f2389e00640 1 --2- 172.21.15.144:0/792520446 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f236006c460 0x7f236006e920 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:02.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.419+0000 7f2389e00640 1 --2- 172.21.15.144:0/792520446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23840ae8e0 0x7f23840aed60 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:02.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.419+0000 7f2389e00640 1 --2- 172.21.15.144:0/792520446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2384158d50 0x7f23841591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:02.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.419+0000 7f2389e00640 1 --2- 172.21.15.144:0/792520446 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2368003a30 0x7f238414d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:02.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.419+0000 7f2389e00640 1 -- 172.21.15.144:0/792520446 >> 172.21.15.144:0/792520446 conn(0x7f238406e910 msgr2=0x7f238406da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:02.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.419+0000 7f2389e00640 1 -- 172.21.15.144:0/792520446 shutdown_connections 2024-09-11T23:25:02.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.419+0000 7f2389e00640 1 -- 172.21.15.144:0/792520446 wait complete. 2024-09-11T23:25:02.426 INFO:tasks.ceph.mds.c.smithi144.stderr: -2772> 2024-09-11T23:24:44.093+0000 7f4183800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:25:02.437 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:25:02.473 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-11T23:25:02.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.594+0000 7fa073e00640 1 Processor -- start 2024-09-11T23:25:02.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.594+0000 7fa073e00640 1 -- start start 2024-09-11T23:25:02.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.595+0000 7fa073e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa074073cf0 0x7fa07406d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:02.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.595+0000 7fa073e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0740b63b0 0x7fa07406bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:02.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.595+0000 7fa073e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa074147c00 con 0x7fa074147820 2024-09-11T23:25:02.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.595+0000 7fa073e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa0740741d0 con 0x7fa074073cf0 2024-09-11T23:25:02.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.595+0000 7fa073e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa074162160 con 0x7fa0740b63b0 2024-09-11T23:25:02.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.596+0000 7fa072000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa074073cf0 0x7fa07406d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:02.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.596+0000 7fa072000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa074073cf0 0x7fa07406d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59340/0 (socket says 172.21.15.144:59340) 2024-09-11T23:25:02.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.596+0000 7fa072000640 1 -- 172.21.15.144:0/3397459903 learned_addr learned my addr 172.21.15.144:0/3397459903 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:02.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.596+0000 7fa072000640 1 -- 172.21.15.144:0/3397459903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0740b63b0 msgr2=0x7fa07406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:02.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.596+0000 7fa073400640 1 --2- 172.21.15.144:0/3397459903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0740b63b0 0x7fa07406bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:02.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.596+0000 7fa072000640 1 --2- 172.21.15.144:0/3397459903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0740b63b0 0x7fa07406bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:02.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.596+0000 7fa072000640 1 -- 172.21.15.144:0/3397459903 >> v1:172.21.15.165:6789/0 conn(0x7fa074147820 legacy=0x7fa0740b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:02.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.596+0000 7fa072000640 1 -- 172.21.15.144:0/3397459903 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa074162440 con 0x7fa074073cf0 2024-09-11T23:25:02.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.596+0000 7fa073400640 1 --2- 172.21.15.144:0/3397459903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0740b63b0 0x7fa07406bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:02.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.597+0000 7fa072000640 1 --2- 172.21.15.144:0/3397459903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa074073cf0 0x7fa07406d7a0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fa060009870 tx=0x7fa06002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7e26a4363fc311 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:02.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.597+0000 7fa071600640 1 -- 172.21.15.144:0/3397459903 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa060037070 con 0x7fa074073cf0 2024-09-11T23:25:02.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.597+0000 7fa071600640 1 -- 172.21.15.144:0/3397459903 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa060032440 con 0x7fa074073cf0 2024-09-11T23:25:02.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.597+0000 7fa071600640 1 -- 172.21.15.144:0/3397459903 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa060032810 con 0x7fa074073cf0 2024-09-11T23:25:02.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.598+0000 7fa073e00640 1 -- 172.21.15.144:0/3397459903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa074073cf0 msgr2=0x7fa07406d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:02.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.598+0000 7fa073e00640 1 --2- 172.21.15.144:0/3397459903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa074073cf0 0x7fa07406d7a0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fa060009870 tx=0x7fa06002a200 comp rx=0 tx=0).stop 2024-09-11T23:25:02.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.598+0000 7fa073e00640 1 -- 172.21.15.144:0/3397459903 shutdown_connections 2024-09-11T23:25:02.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.598+0000 7fa073e00640 1 --2- 172.21.15.144:0/3397459903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa0740b63b0 0x7fa07406bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:02.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.598+0000 7fa073e00640 1 --2- 172.21.15.144:0/3397459903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa074073cf0 0x7fa07406d7a0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:02.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.598+0000 7fa073e00640 1 -- 172.21.15.144:0/3397459903 >> 172.21.15.144:0/3397459903 conn(0x7fa07406ccb0 msgr2=0x7fa07406d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:02.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.598+0000 7fa073e00640 1 -- 172.21.15.144:0/3397459903 shutdown_connections 2024-09-11T23:25:02.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.598+0000 7fa073e00640 1 -- 172.21.15.144:0/3397459903 wait complete. 2024-09-11T23:25:02.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.600+0000 7fa073e00640 1 Processor -- start 2024-09-11T23:25:02.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.600+0000 7fa073e00640 1 -- start start 2024-09-11T23:25:02.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.601+0000 7fa073e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa074073cf0 0x7fa07413fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:02.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.601+0000 7fa073e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0740b63b0 0x7fa0741428e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:02.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.601+0000 7fa073e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa074147820 0x7fa074142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:02.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.601+0000 7fa073e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa074162f20 con 0x7fa0740b63b0 2024-09-11T23:25:02.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.601+0000 7fa073e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa074162a00 con 0x7fa074147820 2024-09-11T23:25:02.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.601+0000 7fa073e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa074148280 con 0x7fa074073cf0 2024-09-11T23:25:02.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.601+0000 7fa072000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0740b63b0 0x7fa0741428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:02.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.601+0000 7fa072000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0740b63b0 0x7fa0741428e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59344/0 (socket says 172.21.15.144:59344) 2024-09-11T23:25:02.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.601+0000 7fa072000640 1 -- 172.21.15.144:0/3454995093 learned_addr learned my addr 172.21.15.144:0/3454995093 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:02.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.601+0000 7fa073400640 1 --2- 172.21.15.144:0/3454995093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa074147820 0x7fa074142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:02.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.601+0000 7fa072a00640 1 --2- 172.21.15.144:0/3454995093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa074073cf0 0x7fa07413fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:02.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.601+0000 7fa072000640 1 -- 172.21.15.144:0/3454995093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa074073cf0 msgr2=0x7fa07413fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:02.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.601+0000 7fa072000640 1 --2- 172.21.15.144:0/3454995093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa074073cf0 0x7fa07413fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:02.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.601+0000 7fa072000640 1 -- 172.21.15.144:0/3454995093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa074147820 msgr2=0x7fa074142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:02.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.601+0000 7fa072000640 1 --2- 172.21.15.144:0/3454995093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa074147820 0x7fa074142e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:02.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.601+0000 7fa072000640 1 -- 172.21.15.144:0/3454995093 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0740af610 con 0x7fa0740b63b0 2024-09-11T23:25:02.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.601+0000 7fa072a00640 1 --2- 172.21.15.144:0/3454995093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa074073cf0 0x7fa07413fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:02.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.602+0000 7fa072000640 1 --2- 172.21.15.144:0/3454995093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0740b63b0 0x7fa0741428e0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fa060009870 tx=0x7fa0600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:02.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.602+0000 7fa06aa00640 1 -- 172.21.15.144:0/3454995093 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa060041020 con 0x7fa0740b63b0 2024-09-11T23:25:02.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.602+0000 7fa073e00640 1 -- 172.21.15.144:0/3454995093 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0740cdfb0 con 0x7fa0740b63b0 2024-09-11T23:25:02.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.602+0000 7fa073e00640 1 -- 172.21.15.144:0/3454995093 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa074140410 con 0x7fa0740b63b0 2024-09-11T23:25:02.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.602+0000 7fa06aa00640 1 -- 172.21.15.144:0/3454995093 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa060032440 con 0x7fa0740b63b0 2024-09-11T23:25:02.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.602+0000 7fa06aa00640 1 -- 172.21.15.144:0/3454995093 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa060037040 con 0x7fa0740b63b0 2024-09-11T23:25:02.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.603+0000 7fa073e00640 1 -- 172.21.15.144:0/3454995093 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa04c005290 con 0x7fa0740b63b0 2024-09-11T23:25:02.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.604+0000 7fa06aa00640 1 -- 172.21.15.144:0/3454995093 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7fa060044020 con 0x7fa0740b63b0 2024-09-11T23:25:02.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.605+0000 7fa06aa00640 1 --2- 172.21.15.144:0/3454995093 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa05406c460 0x7fa05406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:02.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.605+0000 7fa06aa00640 1 -- 172.21.15.144:0/3454995093 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5795+0+0 (secure 0 0 0) 0x7fa0600ac0d0 con 0x7fa0740b63b0 2024-09-11T23:25:02.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.606+0000 7fa072a00640 1 --2- 172.21.15.144:0/3454995093 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa05406c460 0x7fa05406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:02.607 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.606+0000 7fa072a00640 1 --2- 172.21.15.144:0/3454995093 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa05406c460 0x7fa05406e920 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa0740cd4e0 tx=0x7fa064008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:02.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.609+0000 7fa06aa00640 1 -- 172.21.15.144:0/3454995093 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa06004b030 con 0x7fa0740b63b0 2024-09-11T23:25:02.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:02.820+0000 7fa073e00640 1 -- 172.21.15.144:0/3454995093 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa04c005850 con 0x7fa0740b63b0 2024-09-11T23:25:03.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.418+0000 7fa06aa00640 1 -- 172.21.15.144:0/3454995093 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v93) ==== 104+0+0 (secure 0 0 0) 0x7fa06007a0f0 con 0x7fa0740b63b0 2024-09-11T23:25:03.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.421+0000 7fa073e00640 1 -- 172.21.15.144:0/3454995093 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa05406c460 msgr2=0x7fa05406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:03.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.421+0000 7fa073e00640 1 --2- 172.21.15.144:0/3454995093 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa05406c460 0x7fa05406e920 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa0740cd4e0 tx=0x7fa064008040 comp rx=0 tx=0).stop 2024-09-11T23:25:03.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.421+0000 7fa073e00640 1 -- 172.21.15.144:0/3454995093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0740b63b0 msgr2=0x7fa0741428e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:03.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.421+0000 7fa073e00640 1 --2- 172.21.15.144:0/3454995093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0740b63b0 0x7fa0741428e0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fa060009870 tx=0x7fa0600046c0 comp rx=0 tx=0).stop 2024-09-11T23:25:03.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.421+0000 7fa073e00640 1 -- 172.21.15.144:0/3454995093 shutdown_connections 2024-09-11T23:25:03.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.421+0000 7fa073e00640 1 --2- 172.21.15.144:0/3454995093 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa05406c460 0x7fa05406e920 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:03.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.421+0000 7fa073e00640 1 --2- 172.21.15.144:0/3454995093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa074147820 0x7fa074142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:03.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.421+0000 7fa073e00640 1 --2- 172.21.15.144:0/3454995093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0740b63b0 0x7fa0741428e0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:03.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.421+0000 7fa073e00640 1 --2- 172.21.15.144:0/3454995093 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa074073cf0 0x7fa07413fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:03.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.421+0000 7fa073e00640 1 -- 172.21.15.144:0/3454995093 >> 172.21.15.144:0/3454995093 conn(0x7fa07406ccb0 msgr2=0x7fa07406d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:03.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.421+0000 7fa073e00640 1 -- 172.21.15.144:0/3454995093 shutdown_connections 2024-09-11T23:25:03.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.421+0000 7fa073e00640 1 -- 172.21.15.144:0/3454995093 wait complete. 2024-09-11T23:25:03.441 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:25:03.643 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.642+0000 7f18e8000640 1 Processor -- start 2024-09-11T23:25:03.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.643+0000 7f18e8000640 1 -- start start 2024-09-11T23:25:03.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.644+0000 7f18e8000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f18e00cdd00 0x7f18e015d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:03.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.644+0000 7f18e8000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18e015d880 con 0x7f18e00cd920 2024-09-11T23:25:03.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.644+0000 7f18e8000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18e00b42c0 con 0x7f18e00cffe0 2024-09-11T23:25:03.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.644+0000 7f18e8000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f18e00b45a0 con 0x7f18e00cdd00 2024-09-11T23:25:03.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.644+0000 7f18e5600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f18e00cd920 0x7f18e00cf8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37402/0 (socket says 172.21.15.144:37402) 2024-09-11T23:25:03.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.644+0000 7f18e5600640 1 -- 172.21.15.144:0/2209405131 learned_addr learned my addr 172.21.15.144:0/2209405131 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:03.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.644+0000 7f18e6000640 1 --2- 172.21.15.144:0/2209405131 >> v2:172.21.15.165:3300/0 conn(0x7f18e00cdd00 0x7f18e015d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:03.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.645+0000 7f18dfe00640 1 -- 172.21.15.144:0/2209405131 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 695396718 0 0) 0x7f18e015d880 con 0x7f18e00cd920 2024-09-11T23:25:03.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.645+0000 7f18dfe00640 1 -- 172.21.15.144:0/2209405131 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18c8003520 con 0x7f18e00cd920 2024-09-11T23:25:03.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.645+0000 7f18dfe00640 1 -- 172.21.15.144:0/2209405131 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3958644416 0 0) 0x7f18e00b42c0 con 0x7f18e00cffe0 2024-09-11T23:25:03.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.645+0000 7f18dfe00640 1 -- 172.21.15.144:0/2209405131 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18e015d880 con 0x7f18e00cffe0 2024-09-11T23:25:03.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.645+0000 7f18dfe00640 1 -- 172.21.15.144:0/2209405131 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3379813475 0 0) 0x7f18c8003520 con 0x7f18e00cd920 2024-09-11T23:25:03.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.645+0000 7f18dfe00640 1 -- 172.21.15.144:0/2209405131 >> v2:172.21.15.165:3300/0 conn(0x7f18e00cdd00 msgr2=0x7f18e015d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:03.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.645+0000 7f18dfe00640 1 --2- 172.21.15.144:0/2209405131 >> v2:172.21.15.165:3300/0 conn(0x7f18e00cdd00 0x7f18e015d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:03.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.645+0000 7f18dfe00640 1 -- 172.21.15.144:0/2209405131 >> v1:172.21.15.165:6789/0 conn(0x7f18e00cffe0 legacy=0x7f18e015cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:03.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.645+0000 7f18dfe00640 1 -- 172.21.15.144:0/2209405131 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e00b4880 con 0x7f18e00cd920 2024-09-11T23:25:03.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.645+0000 7f18dfe00640 1 -- 172.21.15.144:0/2209405131 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f18d4001670 con 0x7f18e00cd920 2024-09-11T23:25:03.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.645+0000 7f18dfe00640 1 -- 172.21.15.144:0/2209405131 >> v1:172.21.15.144:6789/0 conn(0x7f18e00cd920 legacy=0x7f18e00cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:03.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.645+0000 7f18dfe00640 1 --2- 172.21.15.144:0/2209405131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18c8003b90 0x7f18c8003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:03.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.645+0000 7f18dfe00640 1 --2- 172.21.15.144:0/2209405131 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18c8004800 0x7f18c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:03.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.645+0000 7f18dfe00640 1 --2- 172.21.15.144:0/2209405131 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18c80051c0 0x7f18c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:03.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.645+0000 7f18dfe00640 1 -- 172.21.15.144:0/2209405131 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f18e00b45a0 con 0x7f18c8003b90 2024-09-11T23:25:03.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.645+0000 7f18dfe00640 1 -- 172.21.15.144:0/2209405131 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f18c800c090 con 0x7f18c8004800 2024-09-11T23:25:03.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.645+0000 7f18dfe00640 1 -- 172.21.15.144:0/2209405131 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f18c800c290 con 0x7f18c80051c0 2024-09-11T23:25:03.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.645+0000 7f18e5600640 1 --2- 172.21.15.144:0/2209405131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18c8003b90 0x7f18c8003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:03.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.645+0000 7f18e4c00640 1 --2- 172.21.15.144:0/2209405131 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18c8004800 0x7f18c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:03.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.645+0000 7f18e6000640 1 --2- 172.21.15.144:0/2209405131 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18c80051c0 0x7f18c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:03.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.646+0000 7f18e5600640 1 -- 172.21.15.144:0/2209405131 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18c80051c0 msgr2=0x7f18c800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:03.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.646+0000 7f18e5600640 1 --2- 172.21.15.144:0/2209405131 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18c80051c0 0x7f18c800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:03.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.646+0000 7f18e5600640 1 -- 172.21.15.144:0/2209405131 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18c8004800 msgr2=0x7f18c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:03.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.646+0000 7f18e5600640 1 --2- 172.21.15.144:0/2209405131 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18c8004800 0x7f18c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:03.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.646+0000 7f18e5600640 1 -- 172.21.15.144:0/2209405131 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c8003520 con 0x7f18c8003b90 2024-09-11T23:25:03.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.646+0000 7f18e6000640 1 --2- 172.21.15.144:0/2209405131 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18c80051c0 0x7f18c800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:03.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.646+0000 7f18e6000640 1 -- 172.21.15.144:0/2209405131 reap_dead start 2024-09-11T23:25:03.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.647+0000 7f18e5600640 1 --2- 172.21.15.144:0/2209405131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18c8003b90 0x7f18c8003f90 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f18d4007fa0 tx=0x7f18c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3d859cf1294922 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:03.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.647+0000 7f18dfe00640 1 -- 172.21.15.144:0/2209405131 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d4007bc0 con 0x7f18c8003b90 2024-09-11T23:25:03.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.647+0000 7f18dfe00640 1 -- 172.21.15.144:0/2209405131 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d4005af0 con 0x7f18c8003b90 2024-09-11T23:25:03.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.647+0000 7f18dfe00640 1 -- 172.21.15.144:0/2209405131 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d4007070 con 0x7f18c8003b90 2024-09-11T23:25:03.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.647+0000 7f18e8000640 1 -- 172.21.15.144:0/2209405131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18c8003b90 msgr2=0x7f18c8003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:03.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.647+0000 7f18e8000640 1 --2- 172.21.15.144:0/2209405131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18c8003b90 0x7f18c8003f90 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f18d4007fa0 tx=0x7f18c8005830 comp rx=0 tx=0).stop 2024-09-11T23:25:03.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.648+0000 7f18e8000640 1 -- 172.21.15.144:0/2209405131 shutdown_connections 2024-09-11T23:25:03.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.648+0000 7f18e8000640 1 --2- 172.21.15.144:0/2209405131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18c8003b90 0x7f18c8003f90 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:03.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.648+0000 7f18e8000640 1 -- 172.21.15.144:0/2209405131 >> 172.21.15.144:0/2209405131 conn(0x7f18e006bba0 msgr2=0x7f18e006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:03.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.648+0000 7f18e8000640 1 -- 172.21.15.144:0/2209405131 shutdown_connections 2024-09-11T23:25:03.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.648+0000 7f18e8000640 1 -- 172.21.15.144:0/2209405131 wait complete. 2024-09-11T23:25:03.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.649+0000 7f18e8000640 1 Processor -- start 2024-09-11T23:25:03.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.649+0000 7f18e8000640 1 -- start start 2024-09-11T23:25:03.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.650+0000 7f18e8000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18c8003b90 0x7f18e013f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:03.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.650+0000 7f18e8000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18e00aceb0 0x7f18e015ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:03.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.650+0000 7f18e8000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e015f220 0x7f18e00c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:03.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.650+0000 7f18e8000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f18e006d410 con 0x7f18e015f220 2024-09-11T23:25:03.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.650+0000 7f18e8000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f18e006d290 con 0x7f18c8003b90 2024-09-11T23:25:03.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.650+0000 7f18e8000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f18e00cf8d0 con 0x7f18e00aceb0 2024-09-11T23:25:03.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.650+0000 7f18e6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e015f220 0x7f18e00c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:03.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.651+0000 7f18e6000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e015f220 0x7f18e00c54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:59368/0 (socket says 172.21.15.144:59368) 2024-09-11T23:25:03.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.651+0000 7f18e6000640 1 -- 172.21.15.144:0/2915002793 learned_addr learned my addr 172.21.15.144:0/2915002793 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:03.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.651+0000 7f18e5600640 1 --2- 172.21.15.144:0/2915002793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18c8003b90 0x7f18e013f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:03.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.651+0000 7f18e4c00640 1 --2- 172.21.15.144:0/2915002793 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18e00aceb0 0x7f18e015ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:03.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.651+0000 7f18e6000640 1 -- 172.21.15.144:0/2915002793 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18e00aceb0 msgr2=0x7f18e015ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:03.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.651+0000 7f18e6000640 1 --2- 172.21.15.144:0/2915002793 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18e00aceb0 0x7f18e015ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:03.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.651+0000 7f18e6000640 1 -- 172.21.15.144:0/2915002793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18c8003b90 msgr2=0x7f18e013f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:03.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.651+0000 7f18e6000640 1 --2- 172.21.15.144:0/2915002793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18c8003b90 0x7f18e013f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:03.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.651+0000 7f18e6000640 1 -- 172.21.15.144:0/2915002793 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e0140250 con 0x7f18e015f220 2024-09-11T23:25:03.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.651+0000 7f18e6000640 1 --2- 172.21.15.144:0/2915002793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e015f220 0x7f18e00c54e0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f18d8009fd0 tx=0x7f18d8010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:03.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.651+0000 7f18dd600640 1 -- 172.21.15.144:0/2915002793 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d801a030 con 0x7f18e015f220 2024-09-11T23:25:03.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.651+0000 7f18dd600640 1 -- 172.21.15.144:0/2915002793 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d8010dd0 con 0x7f18e015f220 2024-09-11T23:25:03.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.652+0000 7f18e8000640 1 -- 172.21.15.144:0/2915002793 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e0140530 con 0x7f18e015f220 2024-09-11T23:25:03.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.652+0000 7f18dd600640 1 -- 172.21.15.144:0/2915002793 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8003bd0 con 0x7f18e015f220 2024-09-11T23:25:03.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.652+0000 7f18e8000640 1 -- 172.21.15.144:0/2915002793 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e0140af0 con 0x7f18e015f220 2024-09-11T23:25:03.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.653+0000 7f18e8000640 1 -- 172.21.15.144:0/2915002793 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e00b3ec0 con 0x7f18e015f220 2024-09-11T23:25:03.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.654+0000 7f18dd600640 1 -- 172.21.15.144:0/2915002793 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f18d801d070 con 0x7f18e015f220 2024-09-11T23:25:03.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.654+0000 7f18dd600640 1 --2- 172.21.15.144:0/2915002793 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f18c006c490 0x7f18c006e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:03.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.655+0000 7f18dd600640 1 -- 172.21.15.144:0/2915002793 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5795+0+0 (secure 0 0 0) 0x7f18d808c000 con 0x7f18e015f220 2024-09-11T23:25:03.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.655+0000 7f18e5600640 1 --2- 172.21.15.144:0/2915002793 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f18c006c490 0x7f18c006e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:03.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.656+0000 7f18e5600640 1 --2- 172.21.15.144:0/2915002793 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f18c006c490 0x7f18c006e950 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f18d4032000 tx=0x7f18d4009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:03.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.659+0000 7f18dd600640 1 -- 172.21.15.144:0/2915002793 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f18d805a0c0 con 0x7f18e015f220 2024-09-11T23:25:03.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:03.834+0000 7f18e8000640 1 -- 172.21.15.144:0/2915002793 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f18e006f340 con 0x7f18e015f220 2024-09-11T23:25:04.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.625+0000 7f18dd600640 1 -- 172.21.15.144:0/2915002793 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v133) ==== 181+0+0 (secure 0 0 0) 0x7f18d80599c0 con 0x7f18e015f220 2024-09-11T23:25:04.626 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:25:04.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.628+0000 7f18e8000640 1 -- 172.21.15.144:0/2915002793 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f18c006c490 msgr2=0x7f18c006e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:04.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.628+0000 7f18e8000640 1 --2- 172.21.15.144:0/2915002793 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f18c006c490 0x7f18c006e950 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f18d4032000 tx=0x7f18d4009030 comp rx=0 tx=0).stop 2024-09-11T23:25:04.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.628+0000 7f18e8000640 1 -- 172.21.15.144:0/2915002793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e015f220 msgr2=0x7f18e00c54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:04.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.628+0000 7f18e8000640 1 --2- 172.21.15.144:0/2915002793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e015f220 0x7f18e00c54e0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f18d8009fd0 tx=0x7f18d8010590 comp rx=0 tx=0).stop 2024-09-11T23:25:04.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.629+0000 7f18e8000640 1 -- 172.21.15.144:0/2915002793 shutdown_connections 2024-09-11T23:25:04.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.629+0000 7f18e8000640 1 --2- 172.21.15.144:0/2915002793 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f18c006c490 0x7f18c006e950 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:04.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.629+0000 7f18e8000640 1 --2- 172.21.15.144:0/2915002793 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f18e015f220 0x7f18e00c54e0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:04.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.629+0000 7f18e8000640 1 --2- 172.21.15.144:0/2915002793 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f18e00aceb0 0x7f18e015ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:04.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.629+0000 7f18e8000640 1 --2- 172.21.15.144:0/2915002793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18c8003b90 0x7f18e013f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:04.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.629+0000 7f18e8000640 1 -- 172.21.15.144:0/2915002793 >> 172.21.15.144:0/2915002793 conn(0x7f18e006bba0 msgr2=0x7f18e0160a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:04.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.629+0000 7f18e8000640 1 -- 172.21.15.144:0/2915002793 shutdown_connections 2024-09-11T23:25:04.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.629+0000 7f18e8000640 1 -- 172.21.15.144:0/2915002793 wait complete. 2024-09-11T23:25:04.648 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:25:04.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.807+0000 7fde55200640 1 Processor -- start 2024-09-11T23:25:04.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.807+0000 7fde55200640 1 -- start start 2024-09-11T23:25:04.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.808+0000 7fde55200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fde5006f130 0x7fde50072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:04.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.808+0000 7fde55200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde5015f9f0 0x7fde500ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:04.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.808+0000 7fde55200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde5015c970 con 0x7fde5015b370 2024-09-11T23:25:04.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.808+0000 7fde55200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fde5015fef0 con 0x7fde5006f130 2024-09-11T23:25:04.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.808+0000 7fde55200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fde5015bbb0 con 0x7fde5015f9f0 2024-09-11T23:25:04.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.808+0000 7fde4de00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fde5015b370 0x7fde5006ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40540/0 (socket says 172.21.15.144:40540) 2024-09-11T23:25:04.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.808+0000 7fde4de00640 1 -- 172.21.15.144:0/2666514306 learned_addr learned my addr 172.21.15.144:0/2666514306 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:04.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.808+0000 7fde4e800640 1 --2- 172.21.15.144:0/2666514306 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde5015f9f0 0x7fde500ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:04.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.808+0000 7fde45400640 1 --2- 172.21.15.144:0/2666514306 >> v2:172.21.15.165:3300/0 conn(0x7fde5006f130 0x7fde50072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:04.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.809+0000 7fde4d400640 1 -- 172.21.15.144:0/2666514306 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3827531620 0 0) 0x7fde5015c970 con 0x7fde5015b370 2024-09-11T23:25:04.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.809+0000 7fde4d400640 1 -- 172.21.15.144:0/2666514306 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde34003520 con 0x7fde5015b370 2024-09-11T23:25:04.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.809+0000 7fde4e800640 1 -- 172.21.15.144:0/2666514306 >> v2:172.21.15.165:3300/0 conn(0x7fde5006f130 msgr2=0x7fde50072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:04.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.809+0000 7fde4e800640 1 --2- 172.21.15.144:0/2666514306 >> v2:172.21.15.165:3300/0 conn(0x7fde5006f130 0x7fde50072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:04.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.809+0000 7fde4d400640 1 -- 172.21.15.144:0/2666514306 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 916882333 0 0) 0x7fde34003520 con 0x7fde5015b370 2024-09-11T23:25:04.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.809+0000 7fde4e800640 1 -- 172.21.15.144:0/2666514306 >> v1:172.21.15.144:6789/0 conn(0x7fde5015b370 legacy=0x7fde5006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:04.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.809+0000 7fde4e800640 1 -- 172.21.15.144:0/2666514306 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5015be90 con 0x7fde5015f9f0 2024-09-11T23:25:04.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.810+0000 7fde4e800640 1 --2- 172.21.15.144:0/2666514306 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde5015f9f0 0x7fde500ce490 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fde48009d90 tx=0x7fde4802a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=236f9ffa5d21d3e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:04.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.810+0000 7fde4d400640 1 -- 172.21.15.144:0/2666514306 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40001670 con 0x7fde5015f9f0 2024-09-11T23:25:04.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.810+0000 7fde4d400640 1 -- 172.21.15.144:0/2666514306 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde48007540 con 0x7fde5015f9f0 2024-09-11T23:25:04.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.810+0000 7fde4d400640 1 -- 172.21.15.144:0/2666514306 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48007910 con 0x7fde5015f9f0 2024-09-11T23:25:04.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.811+0000 7fde55200640 1 -- 172.21.15.144:0/2666514306 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde5015f9f0 msgr2=0x7fde500ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:04.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.811+0000 7fde55200640 1 --2- 172.21.15.144:0/2666514306 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde5015f9f0 0x7fde500ce490 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fde48009d90 tx=0x7fde4802a560 comp rx=0 tx=0).stop 2024-09-11T23:25:04.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.811+0000 7fde55200640 1 -- 172.21.15.144:0/2666514306 shutdown_connections 2024-09-11T23:25:04.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.811+0000 7fde55200640 1 --2- 172.21.15.144:0/2666514306 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde5015f9f0 0x7fde500ce490 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:04.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.811+0000 7fde55200640 1 --2- 172.21.15.144:0/2666514306 >> v2:172.21.15.165:3300/0 conn(0x7fde5006f130 0x7fde50072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:04.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.811+0000 7fde55200640 1 -- 172.21.15.144:0/2666514306 >> 172.21.15.144:0/2666514306 conn(0x7fde5006bba0 msgr2=0x7fde5006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:04.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.811+0000 7fde55200640 1 -- 172.21.15.144:0/2666514306 shutdown_connections 2024-09-11T23:25:04.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.811+0000 7fde55200640 1 -- 172.21.15.144:0/2666514306 wait complete. 2024-09-11T23:25:04.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.813+0000 7fde55200640 1 Processor -- start 2024-09-11T23:25:04.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.813+0000 7fde55200640 1 -- start start 2024-09-11T23:25:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.814+0000 7fde55200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde5006f130 0x7fde50148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.814+0000 7fde55200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde5015b370 0x7fde5015d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.814+0000 7fde55200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde5015f9f0 0x7fde5015d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.814+0000 7fde55200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fde500731b0 con 0x7fde5015b370 2024-09-11T23:25:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.814+0000 7fde55200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fde5015c450 con 0x7fde5015f9f0 2024-09-11T23:25:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.814+0000 7fde55200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fde5015b750 con 0x7fde5006f130 2024-09-11T23:25:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.814+0000 7fde45400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde5015b370 0x7fde5015d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:04.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.814+0000 7fde45400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde5015b370 0x7fde5015d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37376/0 (socket says 172.21.15.144:37376) 2024-09-11T23:25:04.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.814+0000 7fde45400640 1 -- 172.21.15.144:0/2869336840 learned_addr learned my addr 172.21.15.144:0/2869336840 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:04.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.814+0000 7fde4de00640 1 --2- 172.21.15.144:0/2869336840 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde5006f130 0x7fde50148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:04.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.814+0000 7fde4e800640 1 --2- 172.21.15.144:0/2869336840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde5015f9f0 0x7fde5015d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:04.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.814+0000 7fde45400640 1 -- 172.21.15.144:0/2869336840 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde5006f130 msgr2=0x7fde50148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:04.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.814+0000 7fde45400640 1 --2- 172.21.15.144:0/2869336840 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde5006f130 0x7fde50148850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:04.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.814+0000 7fde45400640 1 -- 172.21.15.144:0/2869336840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde5015f9f0 msgr2=0x7fde5015d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:04.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.814+0000 7fde45400640 1 --2- 172.21.15.144:0/2869336840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde5015f9f0 0x7fde5015d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:04.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.814+0000 7fde45400640 1 -- 172.21.15.144:0/2869336840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5014f140 con 0x7fde5015b370 2024-09-11T23:25:04.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.815+0000 7fde45400640 1 --2- 172.21.15.144:0/2869336840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde5015b370 0x7fde5015d330 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fde3800e960 tx=0x7fde3800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.815+0000 7fde46a00640 1 -- 172.21.15.144:0/2869336840 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde38017070 con 0x7fde5015b370 2024-09-11T23:25:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.815+0000 7fde46a00640 1 -- 172.21.15.144:0/2869336840 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde3800ca00 con 0x7fde5015b370 2024-09-11T23:25:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.815+0000 7fde55200640 1 -- 172.21.15.144:0/2869336840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde501498f0 con 0x7fde5015b370 2024-09-11T23:25:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.815+0000 7fde46a00640 1 -- 172.21.15.144:0/2869336840 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3800cdf0 con 0x7fde5015b370 2024-09-11T23:25:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.815+0000 7fde55200640 1 -- 172.21.15.144:0/2869336840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde50149eb0 con 0x7fde5015b370 2024-09-11T23:25:04.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.816+0000 7fde55200640 1 -- 172.21.15.144:0/2869336840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde50072560 con 0x7fde5015b370 2024-09-11T23:25:04.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.817+0000 7fde46a00640 1 -- 172.21.15.144:0/2869336840 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7fde3801a070 con 0x7fde5015b370 2024-09-11T23:25:04.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.818+0000 7fde46a00640 1 --2- 172.21.15.144:0/2869336840 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fde2c06c460 0x7fde2c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:04.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.818+0000 7fde46a00640 1 -- 172.21.15.144:0/2869336840 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5357+0+0 (secure 0 0 0) 0x7fde3808b920 con 0x7fde5015b370 2024-09-11T23:25:04.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.818+0000 7fde4de00640 1 --2- 172.21.15.144:0/2869336840 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fde2c06c460 0x7fde2c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:04.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.819+0000 7fde4de00640 1 --2- 172.21.15.144:0/2869336840 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fde2c06c460 0x7fde2c06e920 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fde40005880 tx=0x7fde40009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:04.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.822+0000 7fde46a00640 1 -- 172.21.15.144:0/2869336840 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fde38059ac0 con 0x7fde5015b370 2024-09-11T23:25:04.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:04.995+0000 7fde55200640 1 -- 172.21.15.144:0/2869336840 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fde5014a0b0 con 0x7fde5015b370 2024-09-11T23:25:05.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.631+0000 7fde46a00640 1 -- 172.21.15.144:0/2869336840 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v134) ==== 169+0+0 (secure 0 0 0) 0x7fde380593c0 con 0x7fde5015b370 2024-09-11T23:25:05.632 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-11T23:25:05.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.635+0000 7fde55200640 1 -- 172.21.15.144:0/2869336840 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fde2c06c460 msgr2=0x7fde2c06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:05.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.635+0000 7fde55200640 1 --2- 172.21.15.144:0/2869336840 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fde2c06c460 0x7fde2c06e920 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fde40005880 tx=0x7fde40009040 comp rx=0 tx=0).stop 2024-09-11T23:25:05.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.635+0000 7fde55200640 1 -- 172.21.15.144:0/2869336840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde5015b370 msgr2=0x7fde5015d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:05.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.635+0000 7fde55200640 1 --2- 172.21.15.144:0/2869336840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde5015b370 0x7fde5015d330 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fde3800e960 tx=0x7fde3800ee20 comp rx=0 tx=0).stop 2024-09-11T23:25:05.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.635+0000 7fde55200640 1 -- 172.21.15.144:0/2869336840 shutdown_connections 2024-09-11T23:25:05.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.635+0000 7fde55200640 1 --2- 172.21.15.144:0/2869336840 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fde2c06c460 0x7fde2c06e920 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:05.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.635+0000 7fde55200640 1 --2- 172.21.15.144:0/2869336840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde5015f9f0 0x7fde5015d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:05.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.635+0000 7fde55200640 1 --2- 172.21.15.144:0/2869336840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde5015b370 0x7fde5015d330 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:05.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.635+0000 7fde55200640 1 --2- 172.21.15.144:0/2869336840 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fde5006f130 0x7fde50148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:05.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.635+0000 7fde55200640 1 -- 172.21.15.144:0/2869336840 >> 172.21.15.144:0/2869336840 conn(0x7fde5006bba0 msgr2=0x7fde5006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:05.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.635+0000 7fde55200640 1 -- 172.21.15.144:0/2869336840 shutdown_connections 2024-09-11T23:25:05.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.636+0000 7fde55200640 1 -- 172.21.15.144:0/2869336840 wait complete. 2024-09-11T23:25:05.654 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:25:05.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.810+0000 7fac94000640 1 Processor -- start 2024-09-11T23:25:05.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.811+0000 7fac94000640 1 -- start start 2024-09-11T23:25:05.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.812+0000 7fac94000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fac8c06f130 0x7fac8c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:05.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.812+0000 7fac94000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8c15c820 con 0x7fac8c15c370 2024-09-11T23:25:05.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.812+0000 7fac94000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8c0b43f0 con 0x7fac8c158e50 2024-09-11T23:25:05.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.812+0000 7fac94000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fac8c0b3630 con 0x7fac8c06f130 2024-09-11T23:25:05.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.812+0000 7fac92000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fac8c15c370 0x7fac8c0ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40554/0 (socket says 172.21.15.144:40554) 2024-09-11T23:25:05.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.812+0000 7fac90c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fac8c06f130 0x7fac8c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:05.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.812+0000 7fac92000640 1 -- 172.21.15.144:0/576486322 learned_addr learned my addr 172.21.15.144:0/576486322 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:05.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.813+0000 7fac90c00640 1 -- 172.21.15.144:0/576486322 >> v1:172.21.15.165:6789/0 conn(0x7fac8c158e50 legacy=0x7fac8c06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:05.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.813+0000 7fac90c00640 1 -- 172.21.15.144:0/576486322 >> v1:172.21.15.144:6789/0 conn(0x7fac8c15c370 legacy=0x7fac8c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:05.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.813+0000 7fac90c00640 1 -- 172.21.15.144:0/576486322 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8c0b3910 con 0x7fac8c06f130 2024-09-11T23:25:05.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.813+0000 7fac8be00640 1 -- 172.21.15.144:0/576486322 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2095778146 0 0) 0x7fac84001490 con 0x7fac8c15c370 2024-09-11T23:25:05.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.814+0000 7fac90c00640 1 --2- 172.21.15.144:0/576486322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac8c06f130 0x7fac8c0b5050 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fac78009790 tx=0x7fac7802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53cbedaf93d09fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:05.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.814+0000 7fac8be00640 1 -- 172.21.15.144:0/576486322 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78037070 con 0x7fac8c06f130 2024-09-11T23:25:05.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.814+0000 7fac8be00640 1 -- 172.21.15.144:0/576486322 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac78032440 con 0x7fac8c06f130 2024-09-11T23:25:05.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.814+0000 7fac8be00640 1 -- 172.21.15.144:0/576486322 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78032810 con 0x7fac8c06f130 2024-09-11T23:25:05.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.814+0000 7fac94000640 1 -- 172.21.15.144:0/576486322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac8c06f130 msgr2=0x7fac8c0b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:05.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.814+0000 7fac94000640 1 --2- 172.21.15.144:0/576486322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac8c06f130 0x7fac8c0b5050 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fac78009790 tx=0x7fac7802a180 comp rx=0 tx=0).stop 2024-09-11T23:25:05.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.814+0000 7fac94000640 1 -- 172.21.15.144:0/576486322 shutdown_connections 2024-09-11T23:25:05.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.814+0000 7fac94000640 1 --2- 172.21.15.144:0/576486322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac8c06f130 0x7fac8c0b5050 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:05.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.814+0000 7fac94000640 1 -- 172.21.15.144:0/576486322 >> 172.21.15.144:0/576486322 conn(0x7fac8c06bba0 msgr2=0x7fac8c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:05.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.814+0000 7fac94000640 1 -- 172.21.15.144:0/576486322 shutdown_connections 2024-09-11T23:25:05.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.815+0000 7fac94000640 1 -- 172.21.15.144:0/576486322 wait complete. 2024-09-11T23:25:05.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.816+0000 7fac94000640 1 Processor -- start 2024-09-11T23:25:05.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.816+0000 7fac94000640 1 -- start start 2024-09-11T23:25:05.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.817+0000 7fac94000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac8c06f130 0x7fac8c147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:05.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.817+0000 7fac94000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac8c158e50 0x7fac8c1e5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:05.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.817+0000 7fac94000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac8c15c370 0x7fac8c157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.817+0000 7fac94000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c159230 con 0x7fac8c158e50 2024-09-11T23:25:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.817+0000 7fac94000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c0b3ed0 con 0x7fac8c06f130 2024-09-11T23:25:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.817+0000 7fac94000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fac8c0ce910 con 0x7fac8c15c370 2024-09-11T23:25:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.817+0000 7fac90c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac8c158e50 0x7fac8c1e5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.817+0000 7fac90c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac8c158e50 0x7fac8c1e5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37404/0 (socket says 172.21.15.144:37404) 2024-09-11T23:25:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.818+0000 7fac90c00640 1 -- 172.21.15.144:0/3215567212 learned_addr learned my addr 172.21.15.144:0/3215567212 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.818+0000 7fac91600640 1 --2- 172.21.15.144:0/3215567212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac8c06f130 0x7fac8c147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.818+0000 7fac92000640 1 --2- 172.21.15.144:0/3215567212 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac8c15c370 0x7fac8c157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.818+0000 7fac90c00640 1 -- 172.21.15.144:0/3215567212 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac8c15c370 msgr2=0x7fac8c157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.818+0000 7fac90c00640 1 --2- 172.21.15.144:0/3215567212 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac8c15c370 0x7fac8c157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.818+0000 7fac90c00640 1 -- 172.21.15.144:0/3215567212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac8c06f130 msgr2=0x7fac8c147cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.818+0000 7fac90c00640 1 --2- 172.21.15.144:0/3215567212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac8c06f130 0x7fac8c147cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:05.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.818+0000 7fac90c00640 1 -- 172.21.15.144:0/3215567212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8c0ae4f0 con 0x7fac8c158e50 2024-09-11T23:25:05.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.818+0000 7fac91600640 1 --2- 172.21.15.144:0/3215567212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac8c06f130 0x7fac8c147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:05.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.818+0000 7fac92000640 1 --2- 172.21.15.144:0/3215567212 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac8c15c370 0x7fac8c157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:05.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.818+0000 7fac90c00640 1 --2- 172.21.15.144:0/3215567212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac8c158e50 0x7fac8c1e5ce0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fac78035040 tx=0x7fac780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:05.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.818+0000 7fac89600640 1 -- 172.21.15.144:0/3215567212 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78037050 con 0x7fac8c158e50 2024-09-11T23:25:05.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.819+0000 7fac89600640 1 -- 172.21.15.144:0/3215567212 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac78038040 con 0x7fac8c158e50 2024-09-11T23:25:05.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.819+0000 7fac94000640 1 -- 172.21.15.144:0/3215567212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac8c1e6780 con 0x7fac8c158e50 2024-09-11T23:25:05.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.819+0000 7fac89600640 1 -- 172.21.15.144:0/3215567212 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78005dd0 con 0x7fac8c158e50 2024-09-11T23:25:05.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.819+0000 7fac94000640 1 -- 172.21.15.144:0/3215567212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac8c1e6d40 con 0x7fac8c158e50 2024-09-11T23:25:05.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.820+0000 7fac94000640 1 -- 172.21.15.144:0/3215567212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac8c06e600 con 0x7fac8c158e50 2024-09-11T23:25:05.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.821+0000 7fac89600640 1 -- 172.21.15.144:0/3215567212 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7fac78030900 con 0x7fac8c158e50 2024-09-11T23:25:05.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.821+0000 7fac89600640 1 --2- 172.21.15.144:0/3215567212 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fac6c06c490 0x7fac6c06e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:05.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.821+0000 7fac89600640 1 -- 172.21.15.144:0/3215567212 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 4943+0+0 (secure 0 0 0) 0x7fac780ac340 con 0x7fac8c158e50 2024-09-11T23:25:05.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.822+0000 7fac91600640 1 --2- 172.21.15.144:0/3215567212 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fac6c06c490 0x7fac6c06e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:05.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.822+0000 7fac91600640 1 --2- 172.21.15.144:0/3215567212 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fac6c06c490 0x7fac6c06e950 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fac80000f60 tx=0x7fac80009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:05.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:05.826+0000 7fac89600640 1 -- 172.21.15.144:0/3215567212 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac8c0ae4f0 con 0x7fac8c158e50 2024-09-11T23:25:06.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.004+0000 7fac94000640 1 -- 172.21.15.144:0/3215567212 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fac8c06e320 con 0x7fac8c158e50 2024-09-11T23:25:06.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.008+0000 7fac89600640 1 -- 172.21.15.144:0/3215567212 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) ==== 104+0+0 (secure 0 0 0) 0x7fac7807a790 con 0x7fac8c158e50 2024-09-11T23:25:06.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.010+0000 7fac94000640 1 -- 172.21.15.144:0/3215567212 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fac6c06c490 msgr2=0x7fac6c06e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:06.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.010+0000 7fac94000640 1 --2- 172.21.15.144:0/3215567212 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fac6c06c490 0x7fac6c06e950 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fac80000f60 tx=0x7fac80009040 comp rx=0 tx=0).stop 2024-09-11T23:25:06.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.010+0000 7fac94000640 1 -- 172.21.15.144:0/3215567212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac8c158e50 msgr2=0x7fac8c1e5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:06.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.010+0000 7fac94000640 1 --2- 172.21.15.144:0/3215567212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac8c158e50 0x7fac8c1e5ce0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fac78035040 tx=0x7fac780046c0 comp rx=0 tx=0).stop 2024-09-11T23:25:06.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.010+0000 7fac94000640 1 -- 172.21.15.144:0/3215567212 shutdown_connections 2024-09-11T23:25:06.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.010+0000 7fac94000640 1 --2- 172.21.15.144:0/3215567212 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fac6c06c490 0x7fac6c06e950 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:06.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.010+0000 7fac94000640 1 --2- 172.21.15.144:0/3215567212 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac8c15c370 0x7fac8c157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:06.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.010+0000 7fac94000640 1 --2- 172.21.15.144:0/3215567212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac8c158e50 0x7fac8c1e5ce0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:06.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.010+0000 7fac94000640 1 --2- 172.21.15.144:0/3215567212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac8c06f130 0x7fac8c147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:06.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.010+0000 7fac94000640 1 -- 172.21.15.144:0/3215567212 >> 172.21.15.144:0/3215567212 conn(0x7fac8c06bba0 msgr2=0x7fac8c071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:06.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.010+0000 7fac94000640 1 -- 172.21.15.144:0/3215567212 shutdown_connections 2024-09-11T23:25:06.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.010+0000 7fac94000640 1 -- 172.21.15.144:0/3215567212 wait complete. 2024-09-11T23:25:06.027 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol' 2024-09-11T23:25:06.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.183+0000 7efd5ae00640 1 Processor -- start 2024-09-11T23:25:06.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.183+0000 7efd5ae00640 1 -- start start 2024-09-11T23:25:06.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.184+0000 7efd5ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd540cf070 0x7efd540cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:06.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.184+0000 7efd5ae00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7efd54073120 0x7efd54073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:06.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.184+0000 7efd5ae00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd540ce740 con 0x7efd5415c180 2024-09-11T23:25:06.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.184+0000 7efd5ae00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7efd54072640 con 0x7efd54073120 2024-09-11T23:25:06.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.184+0000 7efd5ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efd54072920 con 0x7efd540cf070 2024-09-11T23:25:06.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.184+0000 7efd53e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7efd5415c180 0x7efd540cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40560/0 (socket says 172.21.15.144:40560) 2024-09-11T23:25:06.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.184+0000 7efd53e00640 1 -- 172.21.15.144:0/4259335285 learned_addr learned my addr 172.21.15.144:0/4259335285 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:06.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.185+0000 7efd58e00640 1 --2- 172.21.15.144:0/4259335285 >> v2:172.21.15.165:3300/0 conn(0x7efd54073120 0x7efd54073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:06.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.185+0000 7efd53400640 1 --2- 172.21.15.144:0/4259335285 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd540cf070 0x7efd540cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:06.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.185+0000 7efd52a00640 1 -- 172.21.15.144:0/4259335285 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1528152445 0 0) 0x7efd540ce740 con 0x7efd5415c180 2024-09-11T23:25:06.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.185+0000 7efd52a00640 1 -- 172.21.15.144:0/4259335285 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd38003520 con 0x7efd5415c180 2024-09-11T23:25:06.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.185+0000 7efd58e00640 1 -- 172.21.15.144:0/4259335285 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd540cf070 msgr2=0x7efd540cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:06.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.185+0000 7efd58e00640 1 --2- 172.21.15.144:0/4259335285 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd540cf070 0x7efd540cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:06.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.185+0000 7efd58e00640 1 -- 172.21.15.144:0/4259335285 >> v1:172.21.15.144:6789/0 conn(0x7efd5415c180 legacy=0x7efd540cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:06.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.185+0000 7efd52a00640 1 -- 172.21.15.144:0/4259335285 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 385692272 0 0) 0x7efd38003520 con 0x7efd5415c180 2024-09-11T23:25:06.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.185+0000 7efd58e00640 1 -- 172.21.15.144:0/4259335285 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd54072c00 con 0x7efd54073120 2024-09-11T23:25:06.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.185+0000 7efd53400640 1 --2- 172.21.15.144:0/4259335285 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd540cf070 0x7efd540cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:25:06.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.186+0000 7efd58e00640 1 --2- 172.21.15.144:0/4259335285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd54073120 0x7efd54073590 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7efd4c009d90 tx=0x7efd4c02a550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc6908b575d4d78a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:06.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.187+0000 7efd52a00640 1 -- 172.21.15.144:0/4259335285 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd44001690 con 0x7efd54073120 2024-09-11T23:25:06.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.187+0000 7efd52a00640 1 -- 172.21.15.144:0/4259335285 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd4c007540 con 0x7efd54073120 2024-09-11T23:25:06.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.187+0000 7efd52a00640 1 -- 172.21.15.144:0/4259335285 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c007910 con 0x7efd54073120 2024-09-11T23:25:06.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.187+0000 7efd5ae00640 1 -- 172.21.15.144:0/4259335285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd54073120 msgr2=0x7efd54073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:06.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.187+0000 7efd5ae00640 1 --2- 172.21.15.144:0/4259335285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd54073120 0x7efd54073590 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7efd4c009d90 tx=0x7efd4c02a550 comp rx=0 tx=0).stop 2024-09-11T23:25:06.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.187+0000 7efd5ae00640 1 -- 172.21.15.144:0/4259335285 shutdown_connections 2024-09-11T23:25:06.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.187+0000 7efd5ae00640 1 --2- 172.21.15.144:0/4259335285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd54073120 0x7efd54073590 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:06.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.187+0000 7efd5ae00640 1 --2- 172.21.15.144:0/4259335285 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd540cf070 0x7efd540cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:06.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.187+0000 7efd5ae00640 1 -- 172.21.15.144:0/4259335285 >> 172.21.15.144:0/4259335285 conn(0x7efd54062cc0 msgr2=0x7efd5406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:06.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.187+0000 7efd5ae00640 1 -- 172.21.15.144:0/4259335285 shutdown_connections 2024-09-11T23:25:06.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.187+0000 7efd5ae00640 1 -- 172.21.15.144:0/4259335285 wait complete. 2024-09-11T23:25:06.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.189+0000 7efd5ae00640 1 Processor -- start 2024-09-11T23:25:06.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.189+0000 7efd5ae00640 1 -- start start 2024-09-11T23:25:06.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.190+0000 7efd5ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd54073120 0x7efd5414cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:06.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.190+0000 7efd5ae00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd540cf070 0x7efd540b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:06.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.190+0000 7efd5ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd5415c180 0x7efd541f5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:06.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.190+0000 7efd5ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efd540722f0 con 0x7efd5415c180 2024-09-11T23:25:06.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.190+0000 7efd5ae00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efd540ced00 con 0x7efd540cf070 2024-09-11T23:25:06.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.190+0000 7efd5ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efd5415c560 con 0x7efd54073120 2024-09-11T23:25:06.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.190+0000 7efd58e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd5415c180 0x7efd541f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:06.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.190+0000 7efd58e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd5415c180 0x7efd541f5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37418/0 (socket says 172.21.15.144:37418) 2024-09-11T23:25:06.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.190+0000 7efd58e00640 1 -- 172.21.15.144:0/2726044781 learned_addr learned my addr 172.21.15.144:0/2726044781 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:06.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.190+0000 7efd53400640 1 --2- 172.21.15.144:0/2726044781 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd540cf070 0x7efd540b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:06.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.190+0000 7efd53e00640 1 --2- 172.21.15.144:0/2726044781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd54073120 0x7efd5414cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:06.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.191+0000 7efd58e00640 1 -- 172.21.15.144:0/2726044781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd54073120 msgr2=0x7efd5414cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:06.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.191+0000 7efd58e00640 1 --2- 172.21.15.144:0/2726044781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd54073120 0x7efd5414cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:06.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.191+0000 7efd58e00640 1 -- 172.21.15.144:0/2726044781 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd540cf070 msgr2=0x7efd540b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:06.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.191+0000 7efd58e00640 1 --2- 172.21.15.144:0/2726044781 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd540cf070 0x7efd540b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:06.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.191+0000 7efd58e00640 1 -- 172.21.15.144:0/2726044781 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd54154430 con 0x7efd5415c180 2024-09-11T23:25:06.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.191+0000 7efd58e00640 1 --2- 172.21.15.144:0/2726044781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd5415c180 0x7efd541f5800 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7efd4c009eb0 tx=0x7efd4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:06.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.191+0000 7efd4be00640 1 -- 172.21.15.144:0/2726044781 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c03f070 con 0x7efd5415c180 2024-09-11T23:25:06.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.191+0000 7efd4be00640 1 -- 172.21.15.144:0/2726044781 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd4c031c40 con 0x7efd5415c180 2024-09-11T23:25:06.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.191+0000 7efd4be00640 1 -- 172.21.15.144:0/2726044781 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c009450 con 0x7efd5415c180 2024-09-11T23:25:06.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.191+0000 7efd5ae00640 1 -- 172.21.15.144:0/2726044781 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5415f180 con 0x7efd5415c180 2024-09-11T23:25:06.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.191+0000 7efd5ae00640 1 -- 172.21.15.144:0/2726044781 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd54153c30 con 0x7efd5415c180 2024-09-11T23:25:06.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.193+0000 7efd5ae00640 1 -- 172.21.15.144:0/2726044781 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd540d0cf0 con 0x7efd5415c180 2024-09-11T23:25:06.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.193+0000 7efd4be00640 1 -- 172.21.15.144:0/2726044781 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7efd4c03b410 con 0x7efd5415c180 2024-09-11T23:25:06.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.195+0000 7efd4be00640 1 --2- 172.21.15.144:0/2726044781 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efd3406c490 0x7efd3406e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:06.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.195+0000 7efd4be00640 1 -- 172.21.15.144:0/2726044781 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 4943+0+0 (secure 0 0 0) 0x7efd4c0ac360 con 0x7efd5415c180 2024-09-11T23:25:06.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.195+0000 7efd53e00640 1 --2- 172.21.15.144:0/2726044781 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efd3406c490 0x7efd3406e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:06.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.196+0000 7efd53e00640 1 --2- 172.21.15.144:0/2726044781 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efd3406c490 0x7efd3406e950 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efd44001eb0 tx=0x7efd44001750 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:06.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.199+0000 7efd4be00640 1 -- 172.21.15.144:0/2726044781 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efd540d0cf0 con 0x7efd5415c180 2024-09-11T23:25:06.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.438+0000 7efd5ae00640 1 -- 172.21.15.144:0/2726044781 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]} v 0) -- 0x7efd540cf4b0 con 0x7efd5415c180 2024-09-11T23:25:06.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.633+0000 7efd4be00640 1 -- 172.21.15.144:0/2726044781 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]}]=0 v396) ==== 151+0+0 (secure 0 0 0) 0x7efd4c07a1f0 con 0x7efd5415c180 2024-09-11T23:25:06.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.635+0000 7efd5ae00640 1 -- 172.21.15.144:0/2726044781 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efd3406c490 msgr2=0x7efd3406e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:06.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.635+0000 7efd5ae00640 1 --2- 172.21.15.144:0/2726044781 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efd3406c490 0x7efd3406e950 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efd44001eb0 tx=0x7efd44001750 comp rx=0 tx=0).stop 2024-09-11T23:25:06.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.635+0000 7efd5ae00640 1 -- 172.21.15.144:0/2726044781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd5415c180 msgr2=0x7efd541f5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:06.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.635+0000 7efd5ae00640 1 --2- 172.21.15.144:0/2726044781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd5415c180 0x7efd541f5800 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7efd4c009eb0 tx=0x7efd4c004a40 comp rx=0 tx=0).stop 2024-09-11T23:25:06.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.635+0000 7efd5ae00640 1 -- 172.21.15.144:0/2726044781 shutdown_connections 2024-09-11T23:25:06.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.635+0000 7efd5ae00640 1 --2- 172.21.15.144:0/2726044781 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efd3406c490 0x7efd3406e950 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:06.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.635+0000 7efd5ae00640 1 --2- 172.21.15.144:0/2726044781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd5415c180 0x7efd541f5800 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:06.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.635+0000 7efd5ae00640 1 --2- 172.21.15.144:0/2726044781 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd540cf070 0x7efd540b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:06.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.635+0000 7efd5ae00640 1 --2- 172.21.15.144:0/2726044781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efd54073120 0x7efd5414cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:06.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.635+0000 7efd5ae00640 1 -- 172.21.15.144:0/2726044781 >> 172.21.15.144:0/2726044781 conn(0x7efd54062cc0 msgr2=0x7efd54159ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:06.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.636+0000 7efd5ae00640 1 -- 172.21.15.144:0/2726044781 shutdown_connections 2024-09-11T23:25:06.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.636+0000 7efd5ae00640 1 -- 172.21.15.144:0/2726044781 wait complete. 2024-09-11T23:25:06.654 INFO:tasks.cephfs_test_runner:test_subvolume_ops_on_nonexistent_vol (tasks.cephfs.test_volumes.TestMisc) ... ok 2024-09-11T23:25:06.654 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_upgrade_legacy_to_v1 (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- rather than going through a full upgrade cycle, 2024-09-11T23:25:06.654 INFO:tasks.cephfs_test_runner:test_subvolume_upgrade_legacy_to_v1 (tasks.cephfs.test_volumes.TestMisc) 2024-09-11T23:25:06.655 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:25:06.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.808+0000 7fcfc1800640 1 Processor -- start 2024-09-11T23:25:06.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.808+0000 7fcfc1800640 1 -- start start 2024-09-11T23:25:06.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.809+0000 7fcfc1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfbc15c180 0x7fcfbc0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:06.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.809+0000 7fcfc1800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfbc0ce740 con 0x7fcfbc0ce230 2024-09-11T23:25:06.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.809+0000 7fcfc1800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfbc072640 con 0x7fcfbc073120 2024-09-11T23:25:06.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.809+0000 7fcfc1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcfbc072920 con 0x7fcfbc15c180 2024-09-11T23:25:06.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.809+0000 7fcfba000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fcfbc0ce230 0x7fcfbc0cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40568/0 (socket says 172.21.15.144:40568) 2024-09-11T23:25:06.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.809+0000 7fcfba000640 1 -- 172.21.15.144:0/533845075 learned_addr learned my addr 172.21.15.144:0/533845075 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:06.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.810+0000 7fcfbaa00640 1 --2- 172.21.15.144:0/533845075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfbc15c180 0x7fcfbc0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:06.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.810+0000 7fcfb9600640 1 -- 172.21.15.144:0/533845075 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 172936290 0 0) 0x7fcfbc0ce740 con 0x7fcfbc0ce230 2024-09-11T23:25:06.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.810+0000 7fcfb9600640 1 -- 172.21.15.144:0/533845075 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfa0003520 con 0x7fcfbc0ce230 2024-09-11T23:25:06.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.810+0000 7fcfb9600640 1 -- 172.21.15.144:0/533845075 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4166064999 0 0) 0x7fcfbc072640 con 0x7fcfbc073120 2024-09-11T23:25:06.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.810+0000 7fcfbaa00640 1 -- 172.21.15.144:0/533845075 >> v1:172.21.15.165:6789/0 conn(0x7fcfbc073120 legacy=0x7fcfbc06bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:06.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.810+0000 7fcfbaa00640 1 -- 172.21.15.144:0/533845075 >> v1:172.21.15.144:6789/0 conn(0x7fcfbc0ce230 legacy=0x7fcfbc0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:06.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.810+0000 7fcfbaa00640 1 -- 172.21.15.144:0/533845075 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfbc072c00 con 0x7fcfbc15c180 2024-09-11T23:25:06.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.811+0000 7fcfbaa00640 1 --2- 172.21.15.144:0/533845075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfbc15c180 0x7fcfbc0cdcf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0097d0 tx=0x7fcfac02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6134e79a2c03749 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:06.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.811+0000 7fcfb9600640 1 -- 172.21.15.144:0/533845075 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfac037070 con 0x7fcfbc15c180 2024-09-11T23:25:06.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.811+0000 7fcfb9600640 1 -- 172.21.15.144:0/533845075 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfac032440 con 0x7fcfbc15c180 2024-09-11T23:25:06.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.811+0000 7fcfb9600640 1 -- 172.21.15.144:0/533845075 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfac032810 con 0x7fcfbc15c180 2024-09-11T23:25:06.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.812+0000 7fcfc1800640 1 -- 172.21.15.144:0/533845075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfbc15c180 msgr2=0x7fcfbc0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:06.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.812+0000 7fcfc1800640 1 --2- 172.21.15.144:0/533845075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfbc15c180 0x7fcfbc0cdcf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0097d0 tx=0x7fcfac02a180 comp rx=0 tx=0).stop 2024-09-11T23:25:06.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.812+0000 7fcfc1800640 1 -- 172.21.15.144:0/533845075 shutdown_connections 2024-09-11T23:25:06.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.812+0000 7fcfc1800640 1 --2- 172.21.15.144:0/533845075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfbc15c180 0x7fcfbc0cdcf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:06.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.812+0000 7fcfc1800640 1 -- 172.21.15.144:0/533845075 >> 172.21.15.144:0/533845075 conn(0x7fcfbc062cc0 msgr2=0x7fcfbc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:06.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.812+0000 7fcfc1800640 1 -- 172.21.15.144:0/533845075 shutdown_connections 2024-09-11T23:25:06.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.812+0000 7fcfc1800640 1 -- 172.21.15.144:0/533845075 wait complete. 2024-09-11T23:25:06.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.814+0000 7fcfc1800640 1 Processor -- start 2024-09-11T23:25:06.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.814+0000 7fcfc1800640 1 -- start start 2024-09-11T23:25:06.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.815+0000 7fcfc1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfbc073120 0x7fcfbc1f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:06.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.815+0000 7fcfc1800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfbc0ce230 0x7fcfbc14d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:06.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.815+0000 7fcfc1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfbc15c180 0x7fcfbc15fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:06.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.815+0000 7fcfc1800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc0cf780 con 0x7fcfbc073120 2024-09-11T23:25:06.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.815+0000 7fcfc1800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc0722f0 con 0x7fcfbc0ce230 2024-09-11T23:25:06.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.815+0000 7fcfc1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcfbc15c560 con 0x7fcfbc15c180 2024-09-11T23:25:06.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.815+0000 7fcfbaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfbc073120 0x7fcfbc1f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:06.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.815+0000 7fcfbaa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfbc073120 0x7fcfbc1f1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37430/0 (socket says 172.21.15.144:37430) 2024-09-11T23:25:06.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.815+0000 7fcfbaa00640 1 -- 172.21.15.144:0/733480463 learned_addr learned my addr 172.21.15.144:0/733480463 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:06.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.815+0000 7fcfba000640 1 --2- 172.21.15.144:0/733480463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfbc0ce230 0x7fcfbc14d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:06.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.815+0000 7fcfbb400640 1 --2- 172.21.15.144:0/733480463 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfbc15c180 0x7fcfbc15fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:06.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.815+0000 7fcfbaa00640 1 -- 172.21.15.144:0/733480463 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfbc15c180 msgr2=0x7fcfbc15fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:06.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.815+0000 7fcfbaa00640 1 --2- 172.21.15.144:0/733480463 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfbc15c180 0x7fcfbc15fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:06.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.815+0000 7fcfbaa00640 1 -- 172.21.15.144:0/733480463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfbc0ce230 msgr2=0x7fcfbc14d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:06.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.815+0000 7fcfbaa00640 1 --2- 172.21.15.144:0/733480463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfbc0ce230 0x7fcfbc14d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:06.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.815+0000 7fcfbaa00640 1 -- 172.21.15.144:0/733480463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfbc15d540 con 0x7fcfbc073120 2024-09-11T23:25:06.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.816+0000 7fcfbaa00640 1 --2- 172.21.15.144:0/733480463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfbc073120 0x7fcfbc1f1e10 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0097d0 tx=0x7fcfac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:06.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.816+0000 7fcfb2a00640 1 -- 172.21.15.144:0/733480463 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfac037050 con 0x7fcfbc073120 2024-09-11T23:25:06.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.816+0000 7fcfb2a00640 1 -- 172.21.15.144:0/733480463 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfac038040 con 0x7fcfbc073120 2024-09-11T23:25:06.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.816+0000 7fcfb2a00640 1 -- 172.21.15.144:0/733480463 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfac004470 con 0x7fcfbc073120 2024-09-11T23:25:06.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.816+0000 7fcfc1800640 1 -- 172.21.15.144:0/733480463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfbc15d820 con 0x7fcfbc073120 2024-09-11T23:25:06.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.816+0000 7fcfc1800640 1 -- 172.21.15.144:0/733480463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfbc15dde0 con 0x7fcfbc073120 2024-09-11T23:25:06.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.817+0000 7fcfc1800640 1 -- 172.21.15.144:0/733480463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfbc0d0cf0 con 0x7fcfbc073120 2024-09-11T23:25:06.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.818+0000 7fcfb2a00640 1 -- 172.21.15.144:0/733480463 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7fcfac03c6d0 con 0x7fcfbc073120 2024-09-11T23:25:06.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.819+0000 7fcfb2a00640 1 --2- 172.21.15.144:0/733480463 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcf9c06c460 0x7fcf9c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:06.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.819+0000 7fcfb2a00640 1 -- 172.21.15.144:0/733480463 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 4943+0+0 (secure 0 0 0) 0x7fcfac0ac130 con 0x7fcfbc073120 2024-09-11T23:25:06.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.819+0000 7fcfba000640 1 --2- 172.21.15.144:0/733480463 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcf9c06c460 0x7fcf9c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:06.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.820+0000 7fcfba000640 1 --2- 172.21.15.144:0/733480463 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcf9c06c460 0x7fcf9c06e920 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc160b90 tx=0x7fcfa8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:06.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.823+0000 7fcfb2a00640 1 -- 172.21.15.144:0/733480463 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcfbc0d0cf0 con 0x7fcfbc073120 2024-09-11T23:25:06.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.998+0000 7fcfc1800640 1 -- 172.21.15.144:0/733480463 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcfbc0cdcf0 con 0x7fcfbc073120 2024-09-11T23:25:07.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:06.999+0000 7fcfb2a00640 1 -- 172.21.15.144:0/733480463 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) ==== 74+0+13068 (secure 0 0 0) 0x7fcfac07a4f0 con 0x7fcfbc073120 2024-09-11T23:25:07.001 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:07.002 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":134,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:25:05.627510+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6835/1155743669":"2024-09-12T23:25:02.416625+0000","172.21.15.144:6834/1155743669":"2024-09-12T23:25:02.416625+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:25:07.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.002+0000 7fcfc1800640 1 -- 172.21.15.144:0/733480463 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcf9c06c460 msgr2=0x7fcf9c06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:07.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.002+0000 7fcfc1800640 1 --2- 172.21.15.144:0/733480463 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcf9c06c460 0x7fcf9c06e920 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc160b90 tx=0x7fcfa8009040 comp rx=0 tx=0).stop 2024-09-11T23:25:07.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.002+0000 7fcfc1800640 1 -- 172.21.15.144:0/733480463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfbc073120 msgr2=0x7fcfbc1f1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:07.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.002+0000 7fcfc1800640 1 --2- 172.21.15.144:0/733480463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfbc073120 0x7fcfbc1f1e10 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0097d0 tx=0x7fcfac0046c0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.002+0000 7fcfc1800640 1 -- 172.21.15.144:0/733480463 shutdown_connections 2024-09-11T23:25:07.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.002+0000 7fcfc1800640 1 --2- 172.21.15.144:0/733480463 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcf9c06c460 0x7fcf9c06e920 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.002+0000 7fcfc1800640 1 --2- 172.21.15.144:0/733480463 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfbc15c180 0x7fcfbc15fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.002+0000 7fcfc1800640 1 --2- 172.21.15.144:0/733480463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfbc0ce230 0x7fcfbc14d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.002+0000 7fcfc1800640 1 --2- 172.21.15.144:0/733480463 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfbc073120 0x7fcfbc1f1e10 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.002+0000 7fcfc1800640 1 -- 172.21.15.144:0/733480463 >> 172.21.15.144:0/733480463 conn(0x7fcfbc062cc0 msgr2=0x7fcfbc0b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:07.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.002+0000 7fcfc1800640 1 -- 172.21.15.144:0/733480463 shutdown_connections 2024-09-11T23:25:07.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.002+0000 7fcfc1800640 1 -- 172.21.15.144:0/733480463 wait complete. 2024-09-11T23:25:07.020 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:17:47.307937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:25:07.020 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:25:07.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.177+0000 7fdf4b200640 1 Processor -- start 2024-09-11T23:25:07.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.177+0000 7fdf4b200640 1 -- start start 2024-09-11T23:25:07.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.178+0000 7fdf4b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf440cc6e0 0x7fdf440cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:07.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.178+0000 7fdf4b200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdf44070eb0 0x7fdf44071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:07.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.178+0000 7fdf4b200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf440cdea0 con 0x7fdf4406bba0 2024-09-11T23:25:07.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.178+0000 7fdf4b200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fdf440ce180 con 0x7fdf44070eb0 2024-09-11T23:25:07.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.178+0000 7fdf4b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdf440ce460 con 0x7fdf440cc6e0 2024-09-11T23:25:07.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.178+0000 7fdf49e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdf4406bba0 0x7fdf4406bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40578/0 (socket says 172.21.15.144:40578) 2024-09-11T23:25:07.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.178+0000 7fdf49e00640 1 -- 172.21.15.144:0/3083282886 learned_addr learned my addr 172.21.15.144:0/3083282886 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:07.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.178+0000 7fdf4a800640 1 --2- 172.21.15.144:0/3083282886 >> v2:172.21.15.144:3300/0 conn(0x7fdf44070eb0 0x7fdf44071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:07.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.178+0000 7fdf49400640 1 --2- 172.21.15.144:0/3083282886 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf440cc6e0 0x7fdf440cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:07.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.179+0000 7fdf48a00640 1 -- 172.21.15.144:0/3083282886 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1149975120 0 0) 0x7fdf440cdea0 con 0x7fdf4406bba0 2024-09-11T23:25:07.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.179+0000 7fdf48a00640 1 -- 172.21.15.144:0/3083282886 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf2c003520 con 0x7fdf4406bba0 2024-09-11T23:25:07.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.179+0000 7fdf4a800640 1 -- 172.21.15.144:0/3083282886 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf440cc6e0 msgr2=0x7fdf440cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:07.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.179+0000 7fdf4a800640 1 --2- 172.21.15.144:0/3083282886 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf440cc6e0 0x7fdf440cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.179+0000 7fdf4a800640 1 -- 172.21.15.144:0/3083282886 >> v1:172.21.15.144:6789/0 conn(0x7fdf4406bba0 legacy=0x7fdf4406bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:07.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.179+0000 7fdf4a800640 1 -- 172.21.15.144:0/3083282886 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf440ce740 con 0x7fdf44070eb0 2024-09-11T23:25:07.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.180+0000 7fdf4a800640 1 --2- 172.21.15.144:0/3083282886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf44070eb0 0x7fdf44071340 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009d90 tx=0x7fdf4002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204a0967b83752d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:07.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.180+0000 7fdf48a00640 1 -- 172.21.15.144:0/3083282886 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf40007740 con 0x7fdf44070eb0 2024-09-11T23:25:07.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.180+0000 7fdf48a00640 1 -- 172.21.15.144:0/3083282886 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf400078e0 con 0x7fdf44070eb0 2024-09-11T23:25:07.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.180+0000 7fdf48a00640 1 -- 172.21.15.144:0/3083282886 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf40007cb0 con 0x7fdf44070eb0 2024-09-11T23:25:07.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.180+0000 7fdf4b200640 1 -- 172.21.15.144:0/3083282886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf44070eb0 msgr2=0x7fdf44071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:07.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.180+0000 7fdf4b200640 1 --2- 172.21.15.144:0/3083282886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf44070eb0 0x7fdf44071340 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009d90 tx=0x7fdf4002a6f0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.181+0000 7fdf4b200640 1 -- 172.21.15.144:0/3083282886 shutdown_connections 2024-09-11T23:25:07.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.181+0000 7fdf4b200640 1 --2- 172.21.15.144:0/3083282886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf44070eb0 0x7fdf44071340 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.181+0000 7fdf4b200640 1 --2- 172.21.15.144:0/3083282886 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf440cc6e0 0x7fdf440cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.181+0000 7fdf4b200640 1 -- 172.21.15.144:0/3083282886 >> 172.21.15.144:0/3083282886 conn(0x7fdf440d0300 msgr2=0x7fdf440d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:07.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.181+0000 7fdf4b200640 1 -- 172.21.15.144:0/3083282886 shutdown_connections 2024-09-11T23:25:07.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.181+0000 7fdf4b200640 1 -- 172.21.15.144:0/3083282886 wait complete. 2024-09-11T23:25:07.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.182+0000 7fdf4b200640 1 Processor -- start 2024-09-11T23:25:07.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.182+0000 7fdf4b200640 1 -- start start 2024-09-11T23:25:07.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.183+0000 7fdf4b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf4406bba0 0x7fdf44147e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:07.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.183+0000 7fdf4b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf44070eb0 0x7fdf4415c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:07.194 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.183+0000 7fdf4b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf440cc6e0 0x7fdf440ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:07.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.183+0000 7fdf4b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdf440cdc30 con 0x7fdf4406bba0 2024-09-11T23:25:07.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.183+0000 7fdf4b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdf440cdab0 con 0x7fdf440cc6e0 2024-09-11T23:25:07.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.183+0000 7fdf4b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdf4415b410 con 0x7fdf44070eb0 2024-09-11T23:25:07.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.183+0000 7fdf49e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf4406bba0 0x7fdf44147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:07.195 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.184+0000 7fdf49e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf4406bba0 0x7fdf44147e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37446/0 (socket says 172.21.15.144:37446) 2024-09-11T23:25:07.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.184+0000 7fdf49e00640 1 -- 172.21.15.144:0/4104763229 learned_addr learned my addr 172.21.15.144:0/4104763229 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:07.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.184+0000 7fdf4a800640 1 --2- 172.21.15.144:0/4104763229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf440cc6e0 0x7fdf440ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:07.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.184+0000 7fdf49400640 1 --2- 172.21.15.144:0/4104763229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf44070eb0 0x7fdf4415c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:07.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.184+0000 7fdf49e00640 1 -- 172.21.15.144:0/4104763229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf44070eb0 msgr2=0x7fdf4415c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:07.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.184+0000 7fdf49e00640 1 --2- 172.21.15.144:0/4104763229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf44070eb0 0x7fdf4415c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.184+0000 7fdf49e00640 1 -- 172.21.15.144:0/4104763229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf440cc6e0 msgr2=0x7fdf440ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:07.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.184+0000 7fdf49e00640 1 --2- 172.21.15.144:0/4104763229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf440cc6e0 0x7fdf440ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.184+0000 7fdf49e00640 1 -- 172.21.15.144:0/4104763229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf441f8310 con 0x7fdf4406bba0 2024-09-11T23:25:07.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.184+0000 7fdf49400640 1 --2- 172.21.15.144:0/4104763229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf44070eb0 0x7fdf4415c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:07.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.184+0000 7fdf49e00640 1 --2- 172.21.15.144:0/4104763229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf4406bba0 0x7fdf44147e20 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800c430 tx=0x7fdf3800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:07.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.184+0000 7fdf3e000640 1 -- 172.21.15.144:0/4104763229 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38017070 con 0x7fdf4406bba0 2024-09-11T23:25:07.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.184+0000 7fdf3e000640 1 -- 172.21.15.144:0/4104763229 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf38005ce0 con 0x7fdf4406bba0 2024-09-11T23:25:07.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.184+0000 7fdf3e000640 1 -- 172.21.15.144:0/4104763229 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf380072f0 con 0x7fdf4406bba0 2024-09-11T23:25:07.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.184+0000 7fdf4b200640 1 -- 172.21.15.144:0/4104763229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf440b0150 con 0x7fdf4406bba0 2024-09-11T23:25:07.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.185+0000 7fdf4b200640 1 -- 172.21.15.144:0/4104763229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf44148360 con 0x7fdf4406bba0 2024-09-11T23:25:07.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.186+0000 7fdf4b200640 1 -- 172.21.15.144:0/4104763229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf440cd570 con 0x7fdf4406bba0 2024-09-11T23:25:07.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.186+0000 7fdf3e000640 1 -- 172.21.15.144:0/4104763229 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7fdf3801a070 con 0x7fdf4406bba0 2024-09-11T23:25:07.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.187+0000 7fdf3e000640 1 --2- 172.21.15.144:0/4104763229 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdf2806c490 0x7fdf2806e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:07.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.187+0000 7fdf3e000640 1 -- 172.21.15.144:0/4104763229 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 4943+0+0 (secure 0 0 0) 0x7fdf3808ab10 con 0x7fdf4406bba0 2024-09-11T23:25:07.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.188+0000 7fdf49400640 1 --2- 172.21.15.144:0/4104763229 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdf2806c490 0x7fdf2806e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:07.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.188+0000 7fdf49400640 1 --2- 172.21.15.144:0/4104763229 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdf2806c490 0x7fdf2806e950 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdf440d0da0 tx=0x7fdf34008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:07.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.191+0000 7fdf3e000640 1 -- 172.21.15.144:0/4104763229 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdf38058ed0 con 0x7fdf4406bba0 2024-09-11T23:25:07.366 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.366+0000 7fdf4b200640 1 -- 172.21.15.144:0/4104763229 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdf44074250 con 0x7fdf4406bba0 2024-09-11T23:25:07.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.366+0000 7fdf3e000640 1 -- 172.21.15.144:0/4104763229 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v134) ==== 93+0+10 (secure 0 0 0) 0x7fdf380587d0 con 0x7fdf4406bba0 2024-09-11T23:25:07.367 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-11T23:25:07.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.368+0000 7fdf4b200640 1 -- 172.21.15.144:0/4104763229 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdf2806c490 msgr2=0x7fdf2806e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:07.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.368+0000 7fdf4b200640 1 --2- 172.21.15.144:0/4104763229 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdf2806c490 0x7fdf2806e950 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdf440d0da0 tx=0x7fdf34008040 comp rx=0 tx=0).stop 2024-09-11T23:25:07.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.368+0000 7fdf4b200640 1 -- 172.21.15.144:0/4104763229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf4406bba0 msgr2=0x7fdf44147e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:07.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.368+0000 7fdf4b200640 1 --2- 172.21.15.144:0/4104763229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf4406bba0 0x7fdf44147e20 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800c430 tx=0x7fdf3800c8f0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.369+0000 7fdf4b200640 1 -- 172.21.15.144:0/4104763229 shutdown_connections 2024-09-11T23:25:07.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.369+0000 7fdf4b200640 1 --2- 172.21.15.144:0/4104763229 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdf2806c490 0x7fdf2806e950 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.369+0000 7fdf4b200640 1 --2- 172.21.15.144:0/4104763229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdf440cc6e0 0x7fdf440ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.369+0000 7fdf4b200640 1 --2- 172.21.15.144:0/4104763229 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdf44070eb0 0x7fdf4415c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.369+0000 7fdf4b200640 1 --2- 172.21.15.144:0/4104763229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf4406bba0 0x7fdf44147e20 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.369+0000 7fdf4b200640 1 -- 172.21.15.144:0/4104763229 >> 172.21.15.144:0/4104763229 conn(0x7fdf440d0300 msgr2=0x7fdf4406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:07.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.369+0000 7fdf4b200640 1 -- 172.21.15.144:0/4104763229 shutdown_connections 2024-09-11T23:25:07.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.369+0000 7fdf4b200640 1 -- 172.21.15.144:0/4104763229 wait complete. 2024-09-11T23:25:07.385 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1' 2024-09-11T23:25:07.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.538+0000 7effb5000640 1 Processor -- start 2024-09-11T23:25:07.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.539+0000 7effb5000640 1 -- start start 2024-09-11T23:25:07.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.540+0000 7effb5000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effb00d02a0 0x7effb00d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:07.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.540+0000 7effb5000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7effb015ca40 0x7effb015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:07.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.540+0000 7effb5000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb00d0bc0 con 0x7effb015ce80 2024-09-11T23:25:07.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.540+0000 7effb5000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7effb015d390 con 0x7effb015ca40 2024-09-11T23:25:07.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.540+0000 7effb5000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7effb015d670 con 0x7effb00d02a0 2024-09-11T23:25:07.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.540+0000 7effad400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7effb015ca40 0x7effb015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:07.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.540+0000 7effae800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7effb015ce80 0x7effb01594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40588/0 (socket says 172.21.15.144:40588) 2024-09-11T23:25:07.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.540+0000 7effae800640 1 -- 172.21.15.144:0/1778975107 learned_addr learned my addr 172.21.15.144:0/1778975107 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:07.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.540+0000 7effade00640 1 --2- 172.21.15.144:0/1778975107 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effb00d02a0 0x7effb00d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:07.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.541+0000 7effad400640 1 -- 172.21.15.144:0/1778975107 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effb00d02a0 msgr2=0x7effb00d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:07.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.541+0000 7effad400640 1 --2- 172.21.15.144:0/1778975107 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effb00d02a0 0x7effb00d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.541+0000 7effad400640 1 -- 172.21.15.144:0/1778975107 >> v1:172.21.15.144:6789/0 conn(0x7effb015ce80 legacy=0x7effb01594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:07.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.541+0000 7effad400640 1 -- 172.21.15.144:0/1778975107 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb015d950 con 0x7effb015ca40 2024-09-11T23:25:07.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.541+0000 7effaca00640 1 -- 172.21.15.144:0/1778975107 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 592682701 0 0) 0x7effb00d0bc0 con 0x7effb015ce80 2024-09-11T23:25:07.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.542+0000 7effad400640 1 --2- 172.21.15.144:0/1778975107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb015ca40 0x7effb015e430 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0097a0 tx=0x7eff9c02c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed82834bf0ed9dbb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:07.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.542+0000 7effaca00640 1 -- 172.21.15.144:0/1778975107 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c039070 con 0x7effb015ca40 2024-09-11T23:25:07.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.542+0000 7effaca00640 1 -- 172.21.15.144:0/1778975107 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff9c034640 con 0x7effb015ca40 2024-09-11T23:25:07.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.542+0000 7effaca00640 1 -- 172.21.15.144:0/1778975107 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c02ce60 con 0x7effb015ca40 2024-09-11T23:25:07.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.542+0000 7effb5000640 1 -- 172.21.15.144:0/1778975107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb015ca40 msgr2=0x7effb015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:07.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.542+0000 7effb5000640 1 --2- 172.21.15.144:0/1778975107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb015ca40 0x7effb015e430 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0097a0 tx=0x7eff9c02c310 comp rx=0 tx=0).stop 2024-09-11T23:25:07.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.543+0000 7effb5000640 1 -- 172.21.15.144:0/1778975107 shutdown_connections 2024-09-11T23:25:07.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.543+0000 7effb5000640 1 --2- 172.21.15.144:0/1778975107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb015ca40 0x7effb015e430 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.543+0000 7effb5000640 1 --2- 172.21.15.144:0/1778975107 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effb00d02a0 0x7effb00d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.543+0000 7effb5000640 1 -- 172.21.15.144:0/1778975107 >> 172.21.15.144:0/1778975107 conn(0x7effb0062cc0 msgr2=0x7effb006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:07.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.543+0000 7effb5000640 1 -- 172.21.15.144:0/1778975107 shutdown_connections 2024-09-11T23:25:07.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.543+0000 7effb5000640 1 -- 172.21.15.144:0/1778975107 wait complete. 2024-09-11T23:25:07.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.544+0000 7effb5000640 1 Processor -- start 2024-09-11T23:25:07.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.544+0000 7effb5000640 1 -- start start 2024-09-11T23:25:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.545+0000 7effb5000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effb00d02a0 0x7effb014f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.545+0000 7effb5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb015ca40 0x7effb0145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.545+0000 7effb5000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effb015ce80 0x7effb0151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.545+0000 7effb5000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7effb0155b90 con 0x7effb015ca40 2024-09-11T23:25:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.545+0000 7effb5000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7effb015df10 con 0x7effb015ce80 2024-09-11T23:25:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.545+0000 7effb5000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7effb0155d10 con 0x7effb00d02a0 2024-09-11T23:25:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.545+0000 7effad400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb015ca40 0x7effb0145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:07.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.545+0000 7effade00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effb00d02a0 0x7effb014f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.545+0000 7effad400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb015ca40 0x7effb0145ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37466/0 (socket says 172.21.15.144:37466) 2024-09-11T23:25:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.545+0000 7effade00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effb00d02a0 0x7effb014f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:46864/0 (socket says 172.21.15.144:46864) 2024-09-11T23:25:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.545+0000 7effad400640 1 -- 172.21.15.144:0/1315208012 learned_addr learned my addr 172.21.15.144:0/1315208012 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.546+0000 7effae800640 1 --2- 172.21.15.144:0/1315208012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effb015ce80 0x7effb0151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.546+0000 7effad400640 1 -- 172.21.15.144:0/1315208012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effb00d02a0 msgr2=0x7effb014f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.546+0000 7effad400640 1 --2- 172.21.15.144:0/1315208012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effb00d02a0 0x7effb014f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.546+0000 7effad400640 1 -- 172.21.15.144:0/1315208012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effb015ce80 msgr2=0x7effb0151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.546+0000 7effad400640 1 --2- 172.21.15.144:0/1315208012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effb015ce80 0x7effb0151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.546+0000 7effad400640 1 -- 172.21.15.144:0/1315208012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb0153580 con 0x7effb015ca40 2024-09-11T23:25:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.546+0000 7effad400640 1 --2- 172.21.15.144:0/1315208012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb015ca40 0x7effb0145ab0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0098c0 tx=0x7eff9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.546+0000 7effa6000640 1 -- 172.21.15.144:0/1315208012 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c039040 con 0x7effb015ca40 2024-09-11T23:25:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.547+0000 7effa6000640 1 -- 172.21.15.144:0/1315208012 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff9c034440 con 0x7effb015ca40 2024-09-11T23:25:07.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.547+0000 7effb5000640 1 -- 172.21.15.144:0/1315208012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb01537f0 con 0x7effb015ca40 2024-09-11T23:25:07.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.547+0000 7effa6000640 1 -- 172.21.15.144:0/1315208012 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c02ce60 con 0x7effb015ca40 2024-09-11T23:25:07.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.547+0000 7effb5000640 1 -- 172.21.15.144:0/1315208012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb0151a30 con 0x7effb015ca40 2024-09-11T23:25:07.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.548+0000 7effb5000640 1 -- 172.21.15.144:0/1315208012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb0151c30 con 0x7effb015ca40 2024-09-11T23:25:07.550 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.549+0000 7effa6000640 1 -- 172.21.15.144:0/1315208012 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7eff9c046020 con 0x7effb015ca40 2024-09-11T23:25:07.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.549+0000 7effa6000640 1 --2- 172.21.15.144:0/1315208012 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff9006c460 0x7eff9006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:07.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.550+0000 7effa6000640 1 -- 172.21.15.144:0/1315208012 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 4943+0+0 (secure 0 0 0) 0x7eff9c0ad640 con 0x7effb015ca40 2024-09-11T23:25:07.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.550+0000 7effade00640 1 --2- 172.21.15.144:0/1315208012 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff9006c460 0x7eff9006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:07.551 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.551+0000 7effade00640 1 --2- 172.21.15.144:0/1315208012 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff9006c460 0x7eff9006e920 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7effa0009a80 tx=0x7effa0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:07.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.554+0000 7effa6000640 1 -- 172.21.15.144:0/1315208012 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7effb0151c30 con 0x7effb015ca40 2024-09-11T23:25:07.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:07.793+0000 7effb5000640 1 -- 172.21.15.144:0/1315208012 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]} v 0) -- 0x7effb00b4790 con 0x7effb015ca40 2024-09-11T23:25:08.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.641+0000 7effa6000640 1 -- 172.21.15.144:0/1315208012 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]}]=0 v398) ==== 152+0+0 (secure 0 0 0) 0x7eff9c07b3b0 con 0x7effb015ca40 2024-09-11T23:25:08.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.644+0000 7effb5000640 1 -- 172.21.15.144:0/1315208012 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff9006c460 msgr2=0x7eff9006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:08.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.644+0000 7effb5000640 1 --2- 172.21.15.144:0/1315208012 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff9006c460 0x7eff9006e920 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7effa0009a80 tx=0x7effa0009190 comp rx=0 tx=0).stop 2024-09-11T23:25:08.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.644+0000 7effb5000640 1 -- 172.21.15.144:0/1315208012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb015ca40 msgr2=0x7effb0145ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:08.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.644+0000 7effb5000640 1 --2- 172.21.15.144:0/1315208012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb015ca40 0x7effb0145ab0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0098c0 tx=0x7eff9c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:25:08.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.644+0000 7effb5000640 1 -- 172.21.15.144:0/1315208012 shutdown_connections 2024-09-11T23:25:08.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.644+0000 7effb5000640 1 --2- 172.21.15.144:0/1315208012 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff9006c460 0x7eff9006e920 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:08.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.644+0000 7effb5000640 1 --2- 172.21.15.144:0/1315208012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effb015ce80 0x7effb0151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:08.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.644+0000 7effb5000640 1 --2- 172.21.15.144:0/1315208012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb015ca40 0x7effb0145ab0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:08.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.644+0000 7effb5000640 1 --2- 172.21.15.144:0/1315208012 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effb00d02a0 0x7effb014f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:08.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.644+0000 7effb5000640 1 -- 172.21.15.144:0/1315208012 >> 172.21.15.144:0/1315208012 conn(0x7effb0062cc0 msgr2=0x7effb00b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:08.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.644+0000 7effb5000640 1 -- 172.21.15.144:0/1315208012 shutdown_connections 2024-09-11T23:25:08.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.644+0000 7effb5000640 1 -- 172.21.15.144:0/1315208012 wait complete. 2024-09-11T23:25:08.664 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:25:08.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.823+0000 7fa63e600640 1 Processor -- start 2024-09-11T23:25:08.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.823+0000 7fa63e600640 1 -- start start 2024-09-11T23:25:08.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.824+0000 7fa63e600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa6380b5050 0x7fa63815c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:08.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.824+0000 7fa63e600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6380b5500 con 0x7fa63806f130 2024-09-11T23:25:08.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.824+0000 7fa63e600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6380b43f0 con 0x7fa638158e50 2024-09-11T23:25:08.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.824+0000 7fa63e600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa6380b3630 con 0x7fa6380b5050 2024-09-11T23:25:08.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.824+0000 7fa62ea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa63806f130 0x7fa6380ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40590/0 (socket says 172.21.15.144:40590) 2024-09-11T23:25:08.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.824+0000 7fa62ea00640 1 -- 172.21.15.144:0/1532134699 learned_addr learned my addr 172.21.15.144:0/1532134699 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:08.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.824+0000 7fa637e00640 1 --2- 172.21.15.144:0/1532134699 >> v2:172.21.15.165:3300/0 conn(0x7fa6380b5050 0x7fa63815c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:08.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.825+0000 7fa636a00640 1 -- 172.21.15.144:0/1532134699 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3448978670 0 0) 0x7fa620001290 con 0x7fa63806f130 2024-09-11T23:25:08.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.825+0000 7fa636a00640 1 -- 172.21.15.144:0/1532134699 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa61c003520 con 0x7fa63806f130 2024-09-11T23:25:08.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.825+0000 7fa636a00640 1 -- 172.21.15.144:0/1532134699 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 738865632 0 0) 0x7fa6380b43f0 con 0x7fa638158e50 2024-09-11T23:25:08.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.825+0000 7fa636a00640 1 -- 172.21.15.144:0/1532134699 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa620001290 con 0x7fa638158e50 2024-09-11T23:25:08.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.825+0000 7fa637e00640 1 -- 172.21.15.144:0/1532134699 >> v1:172.21.15.165:6789/0 conn(0x7fa638158e50 legacy=0x7fa63806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:08.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.825+0000 7fa637e00640 1 -- 172.21.15.144:0/1532134699 >> v1:172.21.15.144:6789/0 conn(0x7fa63806f130 legacy=0x7fa6380ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:08.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.825+0000 7fa637e00640 1 -- 172.21.15.144:0/1532134699 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6380b3910 con 0x7fa6380b5050 2024-09-11T23:25:08.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.827+0000 7fa637e00640 1 --2- 172.21.15.144:0/1532134699 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6380b5050 0x7fa63815c370 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa630009d90 tx=0x7fa63002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1871d087ce9c3a0a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:08.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.827+0000 7fa636a00640 1 -- 172.21.15.144:0/1532134699 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa630007740 con 0x7fa6380b5050 2024-09-11T23:25:08.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.827+0000 7fa636a00640 1 -- 172.21.15.144:0/1532134699 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6300078e0 con 0x7fa6380b5050 2024-09-11T23:25:08.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.827+0000 7fa636a00640 1 -- 172.21.15.144:0/1532134699 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa630007cb0 con 0x7fa6380b5050 2024-09-11T23:25:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.827+0000 7fa63e600640 1 -- 172.21.15.144:0/1532134699 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6380b5050 msgr2=0x7fa63815c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.827+0000 7fa63e600640 1 --2- 172.21.15.144:0/1532134699 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6380b5050 0x7fa63815c370 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa630009d90 tx=0x7fa63002a660 comp rx=0 tx=0).stop 2024-09-11T23:25:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.827+0000 7fa63e600640 1 -- 172.21.15.144:0/1532134699 shutdown_connections 2024-09-11T23:25:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.827+0000 7fa63e600640 1 --2- 172.21.15.144:0/1532134699 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa6380b5050 0x7fa63815c370 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.827+0000 7fa63e600640 1 -- 172.21.15.144:0/1532134699 >> 172.21.15.144:0/1532134699 conn(0x7fa63806bba0 msgr2=0x7fa63806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.827+0000 7fa63e600640 1 -- 172.21.15.144:0/1532134699 shutdown_connections 2024-09-11T23:25:08.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.827+0000 7fa63e600640 1 -- 172.21.15.144:0/1532134699 wait complete. 2024-09-11T23:25:08.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.829+0000 7fa63e600640 1 Processor -- start 2024-09-11T23:25:08.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.829+0000 7fa63e600640 1 -- start start 2024-09-11T23:25:08.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.830+0000 7fa63e600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa63806f130 0x7fa638159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:08.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.830+0000 7fa63e600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6380b5050 0x7fa6381448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:08.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.830+0000 7fa63e600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa638158e50 0x7fa6380affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:08.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.830+0000 7fa63e600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa638159230 con 0x7fa63806f130 2024-09-11T23:25:08.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.830+0000 7fa63e600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa6380b3ed0 con 0x7fa638158e50 2024-09-11T23:25:08.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.830+0000 7fa63e600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa6380ce910 con 0x7fa6380b5050 2024-09-11T23:25:08.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.830+0000 7fa637400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa63806f130 0x7fa638159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:08.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.830+0000 7fa637400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa63806f130 0x7fa638159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37476/0 (socket says 172.21.15.144:37476) 2024-09-11T23:25:08.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.830+0000 7fa637400640 1 -- 172.21.15.144:0/1325575712 learned_addr learned my addr 172.21.15.144:0/1325575712 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:08.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.830+0000 7fa62ea00640 1 --2- 172.21.15.144:0/1325575712 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6380b5050 0x7fa6381448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:08.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.830+0000 7fa637e00640 1 --2- 172.21.15.144:0/1325575712 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa638158e50 0x7fa6380affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:08.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.830+0000 7fa637400640 1 -- 172.21.15.144:0/1325575712 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6380b5050 msgr2=0x7fa6381448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:08.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.830+0000 7fa637400640 1 --2- 172.21.15.144:0/1325575712 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6380b5050 0x7fa6381448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:08.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.830+0000 7fa637400640 1 -- 172.21.15.144:0/1325575712 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa638158e50 msgr2=0x7fa6380affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:08.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.830+0000 7fa637400640 1 --2- 172.21.15.144:0/1325575712 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa638158e50 0x7fa6380affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:08.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.830+0000 7fa637400640 1 -- 172.21.15.144:0/1325575712 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa638144e00 con 0x7fa63806f130 2024-09-11T23:25:08.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.831+0000 7fa637400640 1 --2- 172.21.15.144:0/1325575712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa63806f130 0x7fa638159dc0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fa62800c460 tx=0x7fa62800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:08.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.831+0000 7fa62fe00640 1 -- 172.21.15.144:0/1325575712 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa628017070 con 0x7fa63806f130 2024-09-11T23:25:08.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.831+0000 7fa62fe00640 1 -- 172.21.15.144:0/1325575712 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6280052f0 con 0x7fa63806f130 2024-09-11T23:25:08.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.831+0000 7fa63e600640 1 -- 172.21.15.144:0/1325575712 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa638156e20 con 0x7fa63806f130 2024-09-11T23:25:08.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.831+0000 7fa62fe00640 1 -- 172.21.15.144:0/1325575712 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa628003830 con 0x7fa63806f130 2024-09-11T23:25:08.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.831+0000 7fa63e600640 1 -- 172.21.15.144:0/1325575712 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa63815a780 con 0x7fa63806f130 2024-09-11T23:25:08.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.832+0000 7fa63e600640 1 -- 172.21.15.144:0/1325575712 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa63815b070 con 0x7fa63806f130 2024-09-11T23:25:08.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.834+0000 7fa62fe00640 1 -- 172.21.15.144:0/1325575712 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7fa62801a070 con 0x7fa63806f130 2024-09-11T23:25:08.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.834+0000 7fa62fe00640 1 --2- 172.21.15.144:0/1325575712 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa61406c460 0x7fa61406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:08.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.834+0000 7fa62fe00640 1 -- 172.21.15.144:0/1325575712 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 4943+0+0 (secure 0 0 0) 0x7fa62808aad0 con 0x7fa63806f130 2024-09-11T23:25:08.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.834+0000 7fa62ea00640 1 --2- 172.21.15.144:0/1325575712 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa61406c460 0x7fa61406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:08.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.835+0000 7fa62ea00640 1 --2- 172.21.15.144:0/1325575712 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa61406c460 0x7fa61406e920 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa63815c5f0 tx=0x7fa620009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:08.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:08.840+0000 7fa62fe00640 1 -- 172.21.15.144:0/1325575712 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa638144e00 con 0x7fa63806f130 2024-09-11T23:25:09.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.014+0000 7fa63e600640 1 -- 172.21.15.144:0/1325575712 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa63815c370 con 0x7fa63806f130 2024-09-11T23:25:09.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.018+0000 7fa62fe00640 1 -- 172.21.15.144:0/1325575712 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7fa628058e40 con 0x7fa63806f130 2024-09-11T23:25:09.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.020+0000 7fa63e600640 1 -- 172.21.15.144:0/1325575712 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa61406c460 msgr2=0x7fa61406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:09.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.020+0000 7fa63e600640 1 --2- 172.21.15.144:0/1325575712 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa61406c460 0x7fa61406e920 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa63815c5f0 tx=0x7fa620009040 comp rx=0 tx=0).stop 2024-09-11T23:25:09.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.020+0000 7fa63e600640 1 -- 172.21.15.144:0/1325575712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa63806f130 msgr2=0x7fa638159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:09.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.020+0000 7fa63e600640 1 --2- 172.21.15.144:0/1325575712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa63806f130 0x7fa638159dc0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fa62800c460 tx=0x7fa62800c920 comp rx=0 tx=0).stop 2024-09-11T23:25:09.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.020+0000 7fa63e600640 1 -- 172.21.15.144:0/1325575712 shutdown_connections 2024-09-11T23:25:09.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.020+0000 7fa63e600640 1 --2- 172.21.15.144:0/1325575712 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa61406c460 0x7fa61406e920 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:09.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.020+0000 7fa63e600640 1 --2- 172.21.15.144:0/1325575712 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa638158e50 0x7fa6380affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:09.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.020+0000 7fa63e600640 1 --2- 172.21.15.144:0/1325575712 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa6380b5050 0x7fa6381448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:09.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.020+0000 7fa63e600640 1 --2- 172.21.15.144:0/1325575712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa63806f130 0x7fa638159dc0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:09.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.020+0000 7fa63e600640 1 -- 172.21.15.144:0/1325575712 >> 172.21.15.144:0/1325575712 conn(0x7fa63806bba0 msgr2=0x7fa6380ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:09.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.020+0000 7fa63e600640 1 -- 172.21.15.144:0/1325575712 shutdown_connections 2024-09-11T23:25:09.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.020+0000 7fa63e600640 1 -- 172.21.15.144:0/1325575712 wait complete. 2024-09-11T23:25:09.036 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:25:09.036 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:25:09.115 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:25:09.226 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:25:09.227 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:25:09.227 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:25:09.262 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:25:09.262 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:25:09.262 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:25:09.299 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:25:09.300 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:25:09.300 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:25:09.338 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:25:09.339 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:25:09.339 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:25:09.378 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:25:09.378 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T23:25:09.378 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:25:09.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.537+0000 7f3fafe00640 1 Processor -- start 2024-09-11T23:25:09.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.537+0000 7f3fafe00640 1 -- start start 2024-09-11T23:25:09.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.538+0000 7f3fafe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3fb015a0a0 0x7f3fb0073180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:09.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.538+0000 7f3fafe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fb00ceb90 0x7f3fb00b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:09.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.538+0000 7f3fafe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fb0072100 con 0x7f3fb00736c0 2024-09-11T23:25:09.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.538+0000 7f3fafe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3fb00723c0 con 0x7f3fb015a0a0 2024-09-11T23:25:09.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.538+0000 7f3fafe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3fb00726a0 con 0x7f3fb00ceb90 2024-09-11T23:25:09.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.538+0000 7f3faea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3fb015a0a0 0x7f3fb0073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:09.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.538+0000 7f3faea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3fb015a0a0 0x7f3fb0073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37488/0 (socket says 172.21.15.144:37488) 2024-09-11T23:25:09.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.538+0000 7f3faea00640 1 -- 172.21.15.144:0/60595525 learned_addr learned my addr 172.21.15.144:0/60595525 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:09.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.538+0000 7f3faf400640 1 --2- 172.21.15.144:0/60595525 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fb00ceb90 0x7f3fb00b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:09.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.538+0000 7f3faea00640 1 -- 172.21.15.144:0/60595525 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fb00ceb90 msgr2=0x7f3fb00b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:09.540 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.538+0000 7f3faea00640 1 --2- 172.21.15.144:0/60595525 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fb00ceb90 0x7f3fb00b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.538+0000 7f3faea00640 1 -- 172.21.15.144:0/60595525 >> v1:172.21.15.165:6789/0 conn(0x7f3fb00736c0 legacy=0x7f3fb00ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.538+0000 7f3faea00640 1 -- 172.21.15.144:0/60595525 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb0072980 con 0x7f3fb015a0a0 2024-09-11T23:25:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.539+0000 7f3faea00640 1 --2- 172.21.15.144:0/60595525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fb015a0a0 0x7f3fb0073180 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009e50 tx=0x7f3fa002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe6d2c1d694a1a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.540+0000 7f3fad600640 1 -- 172.21.15.144:0/60595525 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0036070 con 0x7f3fb015a0a0 2024-09-11T23:25:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.540+0000 7f3fad600640 1 -- 172.21.15.144:0/60595525 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fa0031600 con 0x7f3fb015a0a0 2024-09-11T23:25:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.540+0000 7f3fad600640 1 -- 172.21.15.144:0/60595525 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa00319d0 con 0x7f3fb015a0a0 2024-09-11T23:25:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.540+0000 7f3fafe00640 1 -- 172.21.15.144:0/60595525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fb015a0a0 msgr2=0x7f3fb0073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.540+0000 7f3fafe00640 1 --2- 172.21.15.144:0/60595525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fb015a0a0 0x7f3fb0073180 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009e50 tx=0x7f3fa002a6c0 comp rx=0 tx=0).stop 2024-09-11T23:25:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.540+0000 7f3fafe00640 1 -- 172.21.15.144:0/60595525 shutdown_connections 2024-09-11T23:25:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.540+0000 7f3fafe00640 1 --2- 172.21.15.144:0/60595525 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fb00ceb90 0x7f3fb00b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.540+0000 7f3fafe00640 1 --2- 172.21.15.144:0/60595525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fb015a0a0 0x7f3fb0073180 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.540+0000 7f3fafe00640 1 -- 172.21.15.144:0/60595525 >> 172.21.15.144:0/60595525 conn(0x7f3fb006e910 msgr2=0x7f3fb006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:09.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.540+0000 7f3fafe00640 1 -- 172.21.15.144:0/60595525 shutdown_connections 2024-09-11T23:25:09.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.540+0000 7f3fafe00640 1 -- 172.21.15.144:0/60595525 wait complete. 2024-09-11T23:25:09.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.542+0000 7f3fafe00640 1 Processor -- start 2024-09-11T23:25:09.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.542+0000 7f3fafe00640 1 -- start start 2024-09-11T23:25:09.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.543+0000 7f3fafe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fb00ceb90 0x7f3fb01e58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:09.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.543+0000 7f3fafe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fb015a0a0 0x7f3fb015e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:09.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.543+0000 7f3fafe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fb015ba90 0x7f3fb00c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:09.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.543+0000 7f3fafe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb00b2690 con 0x7f3fb00ceb90 2024-09-11T23:25:09.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.543+0000 7f3fafe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb00b2510 con 0x7f3fb015ba90 2024-09-11T23:25:09.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.543+0000 7f3fafe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3fb00cf240 con 0x7f3fb015a0a0 2024-09-11T23:25:09.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.543+0000 7f3faea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fb00ceb90 0x7f3fb01e58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:09.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.543+0000 7f3faea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fb00ceb90 0x7f3fb01e58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37492/0 (socket says 172.21.15.144:37492) 2024-09-11T23:25:09.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.543+0000 7f3faea00640 1 -- 172.21.15.144:0/3082920802 learned_addr learned my addr 172.21.15.144:0/3082920802 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:09.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.543+0000 7f3fae000640 1 --2- 172.21.15.144:0/3082920802 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fb015a0a0 0x7f3fb015e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:09.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.543+0000 7f3faf400640 1 --2- 172.21.15.144:0/3082920802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fb015ba90 0x7f3fb00c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:09.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.544+0000 7f3faea00640 1 -- 172.21.15.144:0/3082920802 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fb015a0a0 msgr2=0x7f3fb015e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:09.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.544+0000 7f3faea00640 1 --2- 172.21.15.144:0/3082920802 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fb015a0a0 0x7f3fb015e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:09.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.544+0000 7f3faea00640 1 -- 172.21.15.144:0/3082920802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fb015ba90 msgr2=0x7f3fb00c50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:09.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.544+0000 7f3faea00640 1 --2- 172.21.15.144:0/3082920802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fb015ba90 0x7f3fb00c50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:09.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.544+0000 7f3faea00640 1 -- 172.21.15.144:0/3082920802 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb01e5df0 con 0x7f3fb00ceb90 2024-09-11T23:25:09.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.544+0000 7f3faea00640 1 --2- 172.21.15.144:0/3082920802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fb00ceb90 0x7f3fb01e58b0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009e50 tx=0x7f3fa0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:09.545 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.544+0000 7f3fa6a00640 1 -- 172.21.15.144:0/3082920802 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0036050 con 0x7f3fb00ceb90 2024-09-11T23:25:09.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.544+0000 7f3fa6a00640 1 -- 172.21.15.144:0/3082920802 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fa0042070 con 0x7f3fb00ceb90 2024-09-11T23:25:09.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.544+0000 7f3fafe00640 1 -- 172.21.15.144:0/3082920802 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb015c090 con 0x7f3fb00ceb90 2024-09-11T23:25:09.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.544+0000 7f3fa6a00640 1 -- 172.21.15.144:0/3082920802 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0009510 con 0x7f3fb00ceb90 2024-09-11T23:25:09.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.544+0000 7f3fafe00640 1 -- 172.21.15.144:0/3082920802 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb015c8d0 con 0x7f3fb00ceb90 2024-09-11T23:25:09.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.546+0000 7f3fafe00640 1 -- 172.21.15.144:0/3082920802 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fb00cf020 con 0x7f3fb00ceb90 2024-09-11T23:25:09.546 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.546+0000 7f3fa6a00640 1 -- 172.21.15.144:0/3082920802 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f3fa0007c50 con 0x7f3fb00ceb90 2024-09-11T23:25:09.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.547+0000 7f3fa6a00640 1 --2- 172.21.15.144:0/3082920802 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3f9006c460 0x7f3f9006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:09.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.547+0000 7f3fa6a00640 1 -- 172.21.15.144:0/3082920802 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 4943+0+0 (secure 0 0 0) 0x7f3fa00ac350 con 0x7f3fb00ceb90 2024-09-11T23:25:09.548 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.548+0000 7f3fae000640 1 --2- 172.21.15.144:0/3082920802 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3f9006c460 0x7f3f9006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:09.549 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.548+0000 7f3fae000640 1 --2- 172.21.15.144:0/3082920802 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3f9006c460 0x7f3f9006e920 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3fb015e2e0 tx=0x7f3f9c007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:09.552 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.551+0000 7f3fa6a00640 1 -- 172.21.15.144:0/3082920802 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3fb015c090 con 0x7f3fb00ceb90 2024-09-11T23:25:09.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.763+0000 7f3fafe00640 1 -- 172.21.15.144:0/3082920802 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3fb00d0900 con 0x7f3fb00ceb90 2024-09-11T23:25:09.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.764+0000 7f3fa6a00640 1 -- 172.21.15.144:0/3082920802 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+3920 (secure 0 0 0) 0x7f3fa007a1d0 con 0x7f3fb00ceb90 2024-09-11T23:25:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:09.764 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":93,"btime":"2024-09-11T23:25:03:418639+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6587,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/3230009607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":3230009607},{"type":"v1","addr":"172.21.15.144:6801","nonce":3230009607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7755,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2789293878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2789293878},{"type":"v1","addr":"172.21.15.165:6834","nonce":2789293878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7758,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2328841770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2328841770},{"type":"v1","addr":"172.21.15.165:6835","nonce":2328841770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":8151,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/270822756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":270822756},{"type":"v1","addr":"172.21.15.144:6835","nonce":270822756}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93}],"filesystems":[]} 2024-09-11T23:25:09.765 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 93 2024-09-11T23:25:09.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.766+0000 7f3fafe00640 1 -- 172.21.15.144:0/3082920802 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3f9006c460 msgr2=0x7f3f9006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:09.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.766+0000 7f3fafe00640 1 --2- 172.21.15.144:0/3082920802 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3f9006c460 0x7f3f9006e920 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3fb015e2e0 tx=0x7f3f9c007e30 comp rx=0 tx=0).stop 2024-09-11T23:25:09.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.766+0000 7f3fafe00640 1 -- 172.21.15.144:0/3082920802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fb00ceb90 msgr2=0x7f3fb01e58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:09.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.766+0000 7f3fafe00640 1 --2- 172.21.15.144:0/3082920802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fb00ceb90 0x7f3fb01e58b0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009e50 tx=0x7f3fa0004a40 comp rx=0 tx=0).stop 2024-09-11T23:25:09.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.766+0000 7f3fafe00640 1 -- 172.21.15.144:0/3082920802 shutdown_connections 2024-09-11T23:25:09.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.766+0000 7f3fafe00640 1 --2- 172.21.15.144:0/3082920802 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3f9006c460 0x7f3f9006e920 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:09.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.766+0000 7f3fafe00640 1 --2- 172.21.15.144:0/3082920802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3fb015ba90 0x7f3fb00c50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:09.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.766+0000 7f3fafe00640 1 --2- 172.21.15.144:0/3082920802 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3fb015a0a0 0x7f3fb015e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:09.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.766+0000 7f3fafe00640 1 --2- 172.21.15.144:0/3082920802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3fb00ceb90 0x7f3fb01e58b0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:09.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.766+0000 7f3fafe00640 1 -- 172.21.15.144:0/3082920802 >> 172.21.15.144:0/3082920802 conn(0x7f3fb006e910 msgr2=0x7f3fb00afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:09.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.766+0000 7f3fafe00640 1 -- 172.21.15.144:0/3082920802 shutdown_connections 2024-09-11T23:25:09.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:09.766+0000 7f3fafe00640 1 -- 172.21.15.144:0/3082920802 wait complete. 2024-09-11T23:25:09.782 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:25:09.782 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:25:09.783 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:25:09.783 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:25:09.783 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:25:09.783 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T23:25:09.783 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:25:09.783 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:25:09.784 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:25:09.784 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:25:09.784 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:25:09.784 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:25:09.784 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:25:09.784 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T23:25:09.785 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:25:09.785 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:25:09.802 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:25:09.802 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:25:09.803 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:25:09.803 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:25:09.806 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:25:09.806 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:25:09.807 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:25:09.807 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:25:09.850 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:25:09.850 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:25:09.851 DEBUG:teuthology.parallel:result is None 2024-09-11T23:25:09.851 DEBUG:teuthology.parallel:result is None 2024-09-11T23:25:09.852 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:25:09.852 DEBUG:teuthology.parallel:result is None 2024-09-11T23:25:09.855 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:25:09.855 DEBUG:teuthology.parallel:result is None 2024-09-11T23:25:09.856 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:25:09.977 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-11T23:25:09.978 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-11T23:25:09.980 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-11T23:25:09.981 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-11T23:25:10.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.019+0000 7f1922800640 1 Processor -- start 2024-09-11T23:25:10.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.019+0000 7f1922800640 1 -- start start 2024-09-11T23:25:10.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.020+0000 7f1922800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f191c15c3b0 0x7f191c073110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:10.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.020+0000 7f1922800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f191c0d1ee0 0x7f191c073650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:10.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.020+0000 7f1922800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f191c160420 con 0x7f191c073b90 2024-09-11T23:25:10.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.020+0000 7f1922800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f191c161030 con 0x7f191c15c3b0 2024-09-11T23:25:10.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.020+0000 7f1922800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f191c0d0450 con 0x7f191c0d1ee0 2024-09-11T23:25:10.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.021+0000 7f191b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f191c15c3b0 0x7f191c073110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:10.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.021+0000 7f191b400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f191c15c3b0 0x7f191c073110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37538/0 (socket says 172.21.15.144:37538) 2024-09-11T23:25:10.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.021+0000 7f191b400640 1 -- 172.21.15.144:0/3334133609 learned_addr learned my addr 172.21.15.144:0/3334133609 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:10.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.021+0000 7f1912a00640 1 --2- 172.21.15.144:0/3334133609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f191c0d1ee0 0x7f191c073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:10.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.021+0000 7f191b400640 1 -- 172.21.15.144:0/3334133609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f191c0d1ee0 msgr2=0x7f191c073650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:10.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.021+0000 7f191b400640 1 --2- 172.21.15.144:0/3334133609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f191c0d1ee0 0x7f191c073650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:10.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.021+0000 7f191b400640 1 -- 172.21.15.144:0/3334133609 >> v1:172.21.15.165:6789/0 conn(0x7f191c073b90 legacy=0x7f191c070930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:10.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.021+0000 7f191b400640 1 -- 172.21.15.144:0/3334133609 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191c160700 con 0x7f191c15c3b0 2024-09-11T23:25:10.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.022+0000 7f191b400640 1 --2- 172.21.15.144:0/3334133609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f191c15c3b0 0x7f191c073110 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f190c009870 tx=0x7f190c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4acb6325b2becbd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:10.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.022+0000 7f191aa00640 1 -- 172.21.15.144:0/3334133609 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c037070 con 0x7f191c15c3b0 2024-09-11T23:25:10.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.022+0000 7f191aa00640 1 -- 172.21.15.144:0/3334133609 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f190c032440 con 0x7f191c15c3b0 2024-09-11T23:25:10.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.022+0000 7f191aa00640 1 -- 172.21.15.144:0/3334133609 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c032810 con 0x7f191c15c3b0 2024-09-11T23:25:10.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.023+0000 7f1922800640 1 -- 172.21.15.144:0/3334133609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f191c15c3b0 msgr2=0x7f191c073110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:10.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.023+0000 7f1922800640 1 --2- 172.21.15.144:0/3334133609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f191c15c3b0 0x7f191c073110 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f190c009870 tx=0x7f190c02a270 comp rx=0 tx=0).stop 2024-09-11T23:25:10.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.023+0000 7f1922800640 1 -- 172.21.15.144:0/3334133609 shutdown_connections 2024-09-11T23:25:10.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.023+0000 7f1922800640 1 --2- 172.21.15.144:0/3334133609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f191c0d1ee0 0x7f191c073650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:10.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.023+0000 7f1922800640 1 --2- 172.21.15.144:0/3334133609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f191c15c3b0 0x7f191c073110 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:10.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.023+0000 7f1922800640 1 -- 172.21.15.144:0/3334133609 >> 172.21.15.144:0/3334133609 conn(0x7f191c0b4300 msgr2=0x7f191c0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:10.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.023+0000 7f1922800640 1 -- 172.21.15.144:0/3334133609 shutdown_connections 2024-09-11T23:25:10.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.023+0000 7f1922800640 1 -- 172.21.15.144:0/3334133609 wait complete. 2024-09-11T23:25:10.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.025+0000 7f1922800640 1 Processor -- start 2024-09-11T23:25:10.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.025+0000 7f1922800640 1 -- start start 2024-09-11T23:25:10.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.026+0000 7f1922800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f191c073b90 0x7f191c150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:10.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.026+0000 7f1922800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f191c0d1ee0 0x7f191c15f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:10.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.026+0000 7f1922800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f191c15c3b0 0x7f191c1f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:10.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.026+0000 7f1922800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f191c160060 con 0x7f191c0d1ee0 2024-09-11T23:25:10.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.026+0000 7f1922800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f191c160cc0 con 0x7f191c15c3b0 2024-09-11T23:25:10.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.026+0000 7f1922800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f191c1601e0 con 0x7f191c073b90 2024-09-11T23:25:10.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.026+0000 7f1912a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f191c0d1ee0 0x7f191c15f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:10.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.026+0000 7f1912a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f191c0d1ee0 0x7f191c15f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37554/0 (socket says 172.21.15.144:37554) 2024-09-11T23:25:10.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.026+0000 7f1912a00640 1 -- 172.21.15.144:0/3345941428 learned_addr learned my addr 172.21.15.144:0/3345941428 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:10.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.026+0000 7f191b400640 1 --2- 172.21.15.144:0/3345941428 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f191c073b90 0x7f191c150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:10.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.026+0000 7f191be00640 1 --2- 172.21.15.144:0/3345941428 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f191c15c3b0 0x7f191c1f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:10.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.026+0000 7f1912a00640 1 -- 172.21.15.144:0/3345941428 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f191c073b90 msgr2=0x7f191c150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:10.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.026+0000 7f1912a00640 1 --2- 172.21.15.144:0/3345941428 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f191c073b90 0x7f191c150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:10.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.026+0000 7f1912a00640 1 -- 172.21.15.144:0/3345941428 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f191c15c3b0 msgr2=0x7f191c1f61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:10.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.026+0000 7f1912a00640 1 --2- 172.21.15.144:0/3345941428 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f191c15c3b0 0x7f191c1f61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:10.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.027+0000 7f1912a00640 1 -- 172.21.15.144:0/3345941428 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191c15c9a0 con 0x7f191c0d1ee0 2024-09-11T23:25:10.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.027+0000 7f1912a00640 1 --2- 172.21.15.144:0/3345941428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f191c0d1ee0 0x7f191c15f0c0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f190400e9b0 tx=0x7f190400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:10.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.027+0000 7f1913e00640 1 -- 172.21.15.144:0/3345941428 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1904017070 con 0x7f191c0d1ee0 2024-09-11T23:25:10.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.027+0000 7f1913e00640 1 -- 172.21.15.144:0/3345941428 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f190400c9a0 con 0x7f191c0d1ee0 2024-09-11T23:25:10.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.027+0000 7f1922800640 1 -- 172.21.15.144:0/3345941428 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f191c15cc80 con 0x7f191c0d1ee0 2024-09-11T23:25:10.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.027+0000 7f1913e00640 1 -- 172.21.15.144:0/3345941428 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190400cd70 con 0x7f191c0d1ee0 2024-09-11T23:25:10.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.027+0000 7f1922800640 1 -- 172.21.15.144:0/3345941428 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f191c15d240 con 0x7f191c0d1ee0 2024-09-11T23:25:10.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.028+0000 7f1922800640 1 -- 172.21.15.144:0/3345941428 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f191c15c790 con 0x7f191c0d1ee0 2024-09-11T23:25:10.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.029+0000 7f1913e00640 1 -- 172.21.15.144:0/3345941428 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f190401a070 con 0x7f191c0d1ee0 2024-09-11T23:25:10.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.030+0000 7f1913e00640 1 --2- 172.21.15.144:0/3345941428 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f18f806c460 0x7f18f806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:10.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.030+0000 7f1913e00640 1 -- 172.21.15.144:0/3345941428 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 4943+0+0 (secure 0 0 0) 0x7f190408b9d0 con 0x7f191c0d1ee0 2024-09-11T23:25:10.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.030+0000 7f191b400640 1 --2- 172.21.15.144:0/3345941428 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f18f806c460 0x7f18f806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:10.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.031+0000 7f191b400640 1 --2- 172.21.15.144:0/3345941428 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f18f806c460 0x7f18f806e920 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f190c034000 tx=0x7f190c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:10.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.035+0000 7f1913e00640 1 -- 172.21.15.144:0/3345941428 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f19040596f0 con 0x7f191c0d1ee0 2024-09-11T23:25:10.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.218+0000 7f1922800640 1 -- 172.21.15.144:0/3345941428 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f191c0cf1f0 con 0x7f191c0d1ee0 2024-09-11T23:25:10.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.658+0000 7f1913e00640 1 -- 172.21.15.144:0/3345941428 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v136) ==== 97+0+0 (secure 0 0 0) 0x7f190405d9f0 con 0x7f191c0d1ee0 2024-09-11T23:25:10.658 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-11T23:25:10.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.661+0000 7f1922800640 1 -- 172.21.15.144:0/3345941428 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f18f806c460 msgr2=0x7f18f806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:10.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.661+0000 7f1922800640 1 --2- 172.21.15.144:0/3345941428 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f18f806c460 0x7f18f806e920 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f190c034000 tx=0x7f190c02e000 comp rx=0 tx=0).stop 2024-09-11T23:25:10.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.661+0000 7f1922800640 1 -- 172.21.15.144:0/3345941428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f191c0d1ee0 msgr2=0x7f191c15f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:10.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.661+0000 7f1922800640 1 --2- 172.21.15.144:0/3345941428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f191c0d1ee0 0x7f191c15f0c0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f190400e9b0 tx=0x7f190400ee70 comp rx=0 tx=0).stop 2024-09-11T23:25:10.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.661+0000 7f1922800640 1 -- 172.21.15.144:0/3345941428 shutdown_connections 2024-09-11T23:25:10.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.661+0000 7f1922800640 1 --2- 172.21.15.144:0/3345941428 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f18f806c460 0x7f18f806e920 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:10.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.661+0000 7f1922800640 1 --2- 172.21.15.144:0/3345941428 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f191c15c3b0 0x7f191c1f61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.661+0000 7f1922800640 1 --2- 172.21.15.144:0/3345941428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f191c0d1ee0 0x7f191c15f0c0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.661+0000 7f1922800640 1 --2- 172.21.15.144:0/3345941428 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f191c073b90 0x7f191c150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.661+0000 7f1922800640 1 -- 172.21.15.144:0/3345941428 >> 172.21.15.144:0/3345941428 conn(0x7f191c0b4300 msgr2=0x7f191c0d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.662+0000 7f1922800640 1 -- 172.21.15.144:0/3345941428 shutdown_connections 2024-09-11T23:25:10.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.662+0000 7f1922800640 1 -- 172.21.15.144:0/3345941428 wait complete. 2024-09-11T23:25:10.679 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:25:10.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.834+0000 7f5d42800640 1 Processor -- start 2024-09-11T23:25:10.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.834+0000 7f5d42800640 1 -- start start 2024-09-11T23:25:10.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.835+0000 7f5d42800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5d3c073830 0x7f5d3c0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:10.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.835+0000 7f5d42800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d3c0ce740 con 0x7f5d3c15c180 2024-09-11T23:25:10.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.835+0000 7f5d42800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d3c072640 con 0x7f5d3c0cf070 2024-09-11T23:25:10.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.835+0000 7f5d42800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5d3c072920 con 0x7f5d3c073830 2024-09-11T23:25:10.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.835+0000 7f5d3be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5d3c073830 0x7f5d3c0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:10.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.835+0000 7f5d3b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f5d3c15c180 0x7f5d3c0cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40626/0 (socket says 172.21.15.144:40626) 2024-09-11T23:25:10.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.835+0000 7f5d3b400640 1 -- 172.21.15.144:0/3844305058 learned_addr learned my addr 172.21.15.144:0/3844305058 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:10.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.836+0000 7f5d3be00640 1 -- 172.21.15.144:0/3844305058 >> v1:172.21.15.165:6789/0 conn(0x7f5d3c0cf070 legacy=0x7f5d3c073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:10.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.836+0000 7f5d3be00640 1 -- 172.21.15.144:0/3844305058 >> v1:172.21.15.144:6789/0 conn(0x7f5d3c15c180 legacy=0x7f5d3c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:10.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.836+0000 7f5d3be00640 1 -- 172.21.15.144:0/3844305058 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3c072c00 con 0x7f5d3c073830 2024-09-11T23:25:10.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.836+0000 7f5d3a000640 1 -- 172.21.15.144:0/3844305058 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2209647535 0 0) 0x7f5d3c0ce740 con 0x7f5d3c15c180 2024-09-11T23:25:10.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.837+0000 7f5d3be00640 1 --2- 172.21.15.144:0/3844305058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d3c073830 0x7f5d3c0cf4e0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f5d34009d90 tx=0x7f5d3402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd05c10915757eec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:10.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.837+0000 7f5d3a000640 1 -- 172.21.15.144:0/3844305058 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d34007740 con 0x7f5d3c073830 2024-09-11T23:25:10.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.837+0000 7f5d3a000640 1 -- 172.21.15.144:0/3844305058 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d340078e0 con 0x7f5d3c073830 2024-09-11T23:25:10.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.837+0000 7f5d3a000640 1 -- 172.21.15.144:0/3844305058 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d34007cb0 con 0x7f5d3c073830 2024-09-11T23:25:10.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.838+0000 7f5d42800640 1 -- 172.21.15.144:0/3844305058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d3c073830 msgr2=0x7f5d3c0cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:10.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.838+0000 7f5d42800640 1 --2- 172.21.15.144:0/3844305058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d3c073830 0x7f5d3c0cf4e0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f5d34009d90 tx=0x7f5d3402a660 comp rx=0 tx=0).stop 2024-09-11T23:25:10.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.838+0000 7f5d42800640 1 -- 172.21.15.144:0/3844305058 shutdown_connections 2024-09-11T23:25:10.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.838+0000 7f5d42800640 1 --2- 172.21.15.144:0/3844305058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d3c073830 0x7f5d3c0cf4e0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:10.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.838+0000 7f5d42800640 1 -- 172.21.15.144:0/3844305058 >> 172.21.15.144:0/3844305058 conn(0x7f5d3c062cc0 msgr2=0x7f5d3c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:10.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.838+0000 7f5d42800640 1 -- 172.21.15.144:0/3844305058 shutdown_connections 2024-09-11T23:25:10.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.838+0000 7f5d42800640 1 -- 172.21.15.144:0/3844305058 wait complete. 2024-09-11T23:25:10.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.839+0000 7f5d42800640 1 Processor -- start 2024-09-11T23:25:10.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.840+0000 7f5d42800640 1 -- start start 2024-09-11T23:25:10.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.840+0000 7f5d42800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d3c073830 0x7f5d3c14bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:10.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.841+0000 7f5d42800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d3c0cf070 0x7f5d3c1f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:10.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.841+0000 7f5d42800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d3c15c180 0x7f5d3c0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:10.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.841+0000 7f5d42800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c0722f0 con 0x7f5d3c15c180 2024-09-11T23:25:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.841+0000 7f5d42800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c0ced00 con 0x7f5d3c073830 2024-09-11T23:25:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.841+0000 7f5d42800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5d3c15c560 con 0x7f5d3c0cf070 2024-09-11T23:25:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.841+0000 7f5d3be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d3c15c180 0x7f5d3c0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.841+0000 7f5d3be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d3c15c180 0x7f5d3c0b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37566/0 (socket says 172.21.15.144:37566) 2024-09-11T23:25:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.841+0000 7f5d3be00640 1 -- 172.21.15.144:0/3504706352 learned_addr learned my addr 172.21.15.144:0/3504706352 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.841+0000 7f5d3b400640 1 --2- 172.21.15.144:0/3504706352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d3c073830 0x7f5d3c14bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.841+0000 7f5d3aa00640 1 --2- 172.21.15.144:0/3504706352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d3c0cf070 0x7f5d3c1f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.841+0000 7f5d3be00640 1 -- 172.21.15.144:0/3504706352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d3c0cf070 msgr2=0x7f5d3c1f40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.841+0000 7f5d3be00640 1 --2- 172.21.15.144:0/3504706352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d3c0cf070 0x7f5d3c1f40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.841+0000 7f5d3be00640 1 -- 172.21.15.144:0/3504706352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d3c073830 msgr2=0x7f5d3c14bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.841+0000 7f5d3be00640 1 --2- 172.21.15.144:0/3504706352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d3c073830 0x7f5d3c14bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.841+0000 7f5d3be00640 1 -- 172.21.15.144:0/3504706352 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3c0b0f60 con 0x7f5d3c15c180 2024-09-11T23:25:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.841+0000 7f5d3aa00640 1 --2- 172.21.15.144:0/3504706352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d3c0cf070 0x7f5d3c1f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:10.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.842+0000 7f5d3be00640 1 --2- 172.21.15.144:0/3504706352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d3c15c180 0x7f5d3c0b1710 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f5d34009eb0 tx=0x7f5d34004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:10.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.842+0000 7f5d33400640 1 -- 172.21.15.144:0/3504706352 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d34040070 con 0x7f5d3c15c180 2024-09-11T23:25:10.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.842+0000 7f5d33400640 1 -- 172.21.15.144:0/3504706352 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d34031c90 con 0x7f5d3c15c180 2024-09-11T23:25:10.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.842+0000 7f5d42800640 1 -- 172.21.15.144:0/3504706352 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3c15f520 con 0x7f5d3c15c180 2024-09-11T23:25:10.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.842+0000 7f5d33400640 1 -- 172.21.15.144:0/3504706352 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3403c640 con 0x7f5d3c15c180 2024-09-11T23:25:10.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.842+0000 7f5d42800640 1 -- 172.21.15.144:0/3504706352 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d3c14c280 con 0x7f5d3c15c180 2024-09-11T23:25:10.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.843+0000 7f5d42800640 1 -- 172.21.15.144:0/3504706352 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d3c0cf4e0 con 0x7f5d3c15c180 2024-09-11T23:25:10.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.844+0000 7f5d33400640 1 -- 172.21.15.144:0/3504706352 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f5d34039040 con 0x7f5d3c15c180 2024-09-11T23:25:10.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.845+0000 7f5d33400640 1 --2- 172.21.15.144:0/3504706352 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5d1c06c460 0x7f5d1c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:10.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.845+0000 7f5d33400640 1 -- 172.21.15.144:0/3504706352 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 4857+0+0 (secure 0 0 0) 0x7f5d340acbe0 con 0x7f5d3c15c180 2024-09-11T23:25:10.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.846+0000 7f5d3b400640 1 --2- 172.21.15.144:0/3504706352 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5d1c06c460 0x7f5d1c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:10.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.846+0000 7f5d3b400640 1 --2- 172.21.15.144:0/3504706352 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5d1c06c460 0x7f5d1c06e920 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c000f60 tx=0x7f5d2c007e40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:10.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:10.850+0000 7f5d33400640 1 -- 172.21.15.144:0/3504706352 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d3407b080 con 0x7f5d3c15c180 2024-09-11T23:25:11.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.085+0000 7f5d42800640 1 -- 172.21.15.144:0/3504706352 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f5d3c15aa80 con 0x7f5d3c15c180 2024-09-11T23:25:11.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.086+0000 7f5d33400640 1 -- 172.21.15.144:0/3504706352 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) ==== 80+0+5304 (secure 0 0 0) 0x7f5d3407a980 con 0x7f5d3c15c180 2024-09-11T23:25:11.086 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:11.086 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:25:11.086 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-11T23:25:11.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:11.086 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-11T23:25:11.086 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmQjymBhAA4BWEVNGY37RsnMGLL3Ow8A==", 2024-09-11T23:25:11.086 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:11.086 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:25:11.086 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:25:11.086 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:25:11.086 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:11.086 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:11.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:11.087 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-11T23:25:11.087 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmD0mIGhAAvug7T/kOcEmnyMyG++V+zA==", 2024-09-11T23:25:11.087 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:11.087 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:25:11.087 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:25:11.087 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:25:11.087 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:11.087 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:11.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:11.087 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-11T23:25:11.087 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmDwSZEBAAdf4eF3MrADSPzBTICzpOiA==", 2024-09-11T23:25:11.088 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:11.088 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:25:11.088 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:25:11.088 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:25:11.088 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:11.088 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:11.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:11.088 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-11T23:25:11.088 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmqYtRJBAAgpzvHNUPVnxNoflhqVIJuQ==", 2024-09-11T23:25:11.088 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:11.088 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:25:11.088 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:25:11.089 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:25:11.089 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:11.089 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:11.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:11.089 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-11T23:25:11.089 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDiJOJmzDABABAA+Qa772+Mm69pecG0QUXlyA==", 2024-09-11T23:25:11.089 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:11.089 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:25:11.089 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:25:11.089 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:11.089 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:11.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:11.090 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-11T23:25:11.090 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDlJOJmgVjJKRAAtl30JxJHurKdrn1vLUneww==", 2024-09-11T23:25:11.090 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:11.090 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:25:11.090 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:25:11.090 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:11.090 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:11.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:11.090 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-11T23:25:11.090 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDpJOJmRzO6FxAAiLDOwDlXYTj6WfEhlI+uVQ==", 2024-09-11T23:25:11.090 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:11.091 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:25:11.091 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:25:11.091 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:11.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:11.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:11.091 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-11T23:25:11.091 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDtJOJmVFh6EhAA7hcJn4k31nEPMcqiB7+djA==", 2024-09-11T23:25:11.091 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:11.091 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:25:11.091 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:25:11.091 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:11.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:11.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:11.092 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-11T23:25:11.092 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD0JOJmpIFTAhAAYQyoBrMjL6CcDDCNAOMGwQ==", 2024-09-11T23:25:11.092 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:11.092 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:25:11.092 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:25:11.092 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:11.092 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:11.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:11.092 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-11T23:25:11.092 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD4JOJmBAIIDhAA8G/usUslfQPNpFP1YZsgmg==", 2024-09-11T23:25:11.093 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:11.093 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:25:11.093 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:25:11.093 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:11.093 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:11.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:11.093 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-11T23:25:11.093 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD8JOJmDl2dCBAA5bL+2AIp0uWL4qjpI/mAdQ==", 2024-09-11T23:25:11.093 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:11.093 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:25:11.093 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:25:11.093 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:11.093 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:11.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:11.094 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-11T23:25:11.094 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAAJeJmMWX+AhAA7ABVgJPwhRZNkPNdZzmnOQ==", 2024-09-11T23:25:11.094 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:11.094 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:25:11.094 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:25:11.094 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:11.094 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:11.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:11.094 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-11T23:25:11.094 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A==", 2024-09-11T23:25:11.094 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:11.095 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:25:11.095 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-11T23:25:11.095 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T23:25:11.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:11.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:11.095 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-11T23:25:11.095 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmLFrBORAAT64lj0sWlVoTHVUZQf0JjA==", 2024-09-11T23:25:11.095 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:11.095 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:25:11.095 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:25:11.095 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:25:11.095 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:25:11.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:11.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:11.096 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-11T23:25:11.096 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJm2/dLMxAAbuKdVAbscrlF5jcBnouBOQ==", 2024-09-11T23:25:11.096 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:11.096 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:25:11.096 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:25:11.096 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:25:11.096 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:25:11.096 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:11.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:11.096 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-11T23:25:11.096 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDfJOJmse6UBBAAq+3afsp+2jApe9sTFmVVOw==", 2024-09-11T23:25:11.096 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:11.097 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:25:11.097 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:25:11.097 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:25:11.097 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:25:11.097 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:11.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:11.097 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-11T23:25:11.097 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmHmAwEhAAEGCvu0NgtyjIPcJBk6bkdA==", 2024-09-11T23:25:11.097 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:11.097 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:25:11.097 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:25:11.097 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:25:11.097 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:11.098 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:11.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:11.098 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-11T23:25:11.098 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmxMaVOxAA62zJwlyk0qdrsemalijH4Q==", 2024-09-11T23:25:11.098 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:11.098 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:25:11.098 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:25:11.098 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:11.098 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:11.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:11.098 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-11T23:25:11.098 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmWZRNNBAAwZ2GCP7mGn87ZSnsKCcDRQ==", 2024-09-11T23:25:11.099 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:11.099 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:25:11.099 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:25:11.099 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:11.099 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.099 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.099 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:25:11.099 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:25:11.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.088+0000 7f5d42800640 1 -- 172.21.15.144:0/3504706352 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5d1c06c460 msgr2=0x7f5d1c06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:11.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.088+0000 7f5d42800640 1 --2- 172.21.15.144:0/3504706352 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5d1c06c460 0x7f5d1c06e920 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c000f60 tx=0x7f5d2c007e40 comp rx=0 tx=0).stop 2024-09-11T23:25:11.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.088+0000 7f5d42800640 1 -- 172.21.15.144:0/3504706352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d3c15c180 msgr2=0x7f5d3c0b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:11.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.088+0000 7f5d42800640 1 --2- 172.21.15.144:0/3504706352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d3c15c180 0x7f5d3c0b1710 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f5d34009eb0 tx=0x7f5d34004a40 comp rx=0 tx=0).stop 2024-09-11T23:25:11.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.088+0000 7f5d42800640 1 -- 172.21.15.144:0/3504706352 shutdown_connections 2024-09-11T23:25:11.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.088+0000 7f5d42800640 1 --2- 172.21.15.144:0/3504706352 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5d1c06c460 0x7f5d1c06e920 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:11.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.088+0000 7f5d42800640 1 --2- 172.21.15.144:0/3504706352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d3c15c180 0x7f5d3c0b1710 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:11.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.088+0000 7f5d42800640 1 --2- 172.21.15.144:0/3504706352 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5d3c0cf070 0x7f5d3c1f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:11.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.088+0000 7f5d42800640 1 --2- 172.21.15.144:0/3504706352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5d3c073830 0x7f5d3c14bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:11.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.088+0000 7f5d42800640 1 -- 172.21.15.144:0/3504706352 >> 172.21.15.144:0/3504706352 conn(0x7f5d3c062cc0 msgr2=0x7f5d3c0af0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:11.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.088+0000 7f5d42800640 1 -- 172.21.15.144:0/3504706352 shutdown_connections 2024-09-11T23:25:11.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.088+0000 7f5d42800640 1 -- 172.21.15.144:0/3504706352 wait complete. 2024-09-11T23:25:11.103 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:25:11.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.257+0000 7f4b5ce00640 1 Processor -- start 2024-09-11T23:25:11.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.257+0000 7f4b5ce00640 1 -- start start 2024-09-11T23:25:11.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.258+0000 7f4b5ce00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4b580cf070 0x7f4b580cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:11.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.258+0000 7f4b5ce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b58073120 0x7f4b580735b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:11.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.258+0000 7f4b5ce00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b580ce740 con 0x7f4b5815c180 2024-09-11T23:25:11.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.258+0000 7f4b5ce00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4b58072640 con 0x7f4b580cf070 2024-09-11T23:25:11.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.258+0000 7f4b5ce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4b58072920 con 0x7f4b58073120 2024-09-11T23:25:11.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.258+0000 7f4b55e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4b5815c180 0x7f4b580cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40628/0 (socket says 172.21.15.144:40628) 2024-09-11T23:25:11.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.258+0000 7f4b55e00640 1 -- 172.21.15.144:0/2759131618 learned_addr learned my addr 172.21.15.144:0/2759131618 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:11.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.258+0000 7f4b56800640 1 --2- 172.21.15.144:0/2759131618 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b58073120 0x7f4b580735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:11.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.258+0000 7f4b55400640 1 --2- 172.21.15.144:0/2759131618 >> v2:172.21.15.165:3300/0 conn(0x7f4b580cf070 0x7f4b580cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:11.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.259+0000 7f4b54a00640 1 -- 172.21.15.144:0/2759131618 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364645346 0 0) 0x7f4b580ce740 con 0x7f4b5815c180 2024-09-11T23:25:11.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.259+0000 7f4b54a00640 1 -- 172.21.15.144:0/2759131618 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b3c003520 con 0x7f4b5815c180 2024-09-11T23:25:11.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.259+0000 7f4b54a00640 1 -- 172.21.15.144:0/2759131618 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1703320200 0 0) 0x7f4b3c003520 con 0x7f4b5815c180 2024-09-11T23:25:11.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.259+0000 7f4b54a00640 1 -- 172.21.15.144:0/2759131618 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b58073120 msgr2=0x7f4b580735b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:11.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.259+0000 7f4b54a00640 1 --2- 172.21.15.144:0/2759131618 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b58073120 0x7f4b580735b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:11.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.259+0000 7f4b54a00640 1 -- 172.21.15.144:0/2759131618 >> v2:172.21.15.165:3300/0 conn(0x7f4b580cf070 msgr2=0x7f4b580cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:11.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.259+0000 7f4b54a00640 1 --2- 172.21.15.144:0/2759131618 >> v2:172.21.15.165:3300/0 conn(0x7f4b580cf070 0x7f4b580cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:11.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.259+0000 7f4b54a00640 1 -- 172.21.15.144:0/2759131618 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b58072c00 con 0x7f4b5815c180 2024-09-11T23:25:11.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.259+0000 7f4b54a00640 1 -- 172.21.15.144:0/2759131618 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f4b48001a10 con 0x7f4b5815c180 2024-09-11T23:25:11.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.259+0000 7f4b54a00640 1 -- 172.21.15.144:0/2759131618 >> v1:172.21.15.144:6789/0 conn(0x7f4b5815c180 legacy=0x7f4b580cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:11.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.259+0000 7f4b54a00640 1 --2- 172.21.15.144:0/2759131618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b3c0039b0 0x7f4b3c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:11.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.259+0000 7f4b54a00640 1 --2- 172.21.15.144:0/2759131618 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b58073120 0x7f4b3c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:11.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.259+0000 7f4b54a00640 1 --2- 172.21.15.144:0/2759131618 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b3c004d40 0x7f4b3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:11.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.259+0000 7f4b54a00640 1 -- 172.21.15.144:0/2759131618 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4b58072640 con 0x7f4b3c0039b0 2024-09-11T23:25:11.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.259+0000 7f4b54a00640 1 -- 172.21.15.144:0/2759131618 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4b58072920 con 0x7f4b3c004d40 2024-09-11T23:25:11.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.259+0000 7f4b54a00640 1 -- 172.21.15.144:0/2759131618 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4b3c00b9c0 con 0x7f4b58073120 2024-09-11T23:25:11.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.259+0000 7f4b55e00640 1 --2- 172.21.15.144:0/2759131618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b3c0039b0 0x7f4b3c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:11.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.259+0000 7f4b55400640 1 --2- 172.21.15.144:0/2759131618 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b58073120 0x7f4b3c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:11.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.260+0000 7f4b56800640 1 --2- 172.21.15.144:0/2759131618 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b3c004d40 0x7f4b3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:11.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.260+0000 7f4b55e00640 1 -- 172.21.15.144:0/2759131618 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b58073120 msgr2=0x7f4b3c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:11.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.260+0000 7f4b55e00640 1 --2- 172.21.15.144:0/2759131618 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b58073120 0x7f4b3c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:11.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.260+0000 7f4b55e00640 1 -- 172.21.15.144:0/2759131618 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b3c004d40 msgr2=0x7f4b3c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:11.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.260+0000 7f4b55e00640 1 --2- 172.21.15.144:0/2759131618 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b3c004d40 0x7f4b3c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:11.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.260+0000 7f4b55e00640 1 -- 172.21.15.144:0/2759131618 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3c003520 con 0x7f4b3c0039b0 2024-09-11T23:25:11.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.261+0000 7f4b55e00640 1 --2- 172.21.15.144:0/2759131618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b3c0039b0 0x7f4b3c003dd0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800a870 tx=0x7f4b3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c240fabb673013e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:11.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.261+0000 7f4b54a00640 1 -- 172.21.15.144:0/2759131618 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4800a4c0 con 0x7f4b3c0039b0 2024-09-11T23:25:11.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.261+0000 7f4b54a00640 1 -- 172.21.15.144:0/2759131618 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b4802f070 con 0x7f4b3c0039b0 2024-09-11T23:25:11.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.261+0000 7f4b54a00640 1 -- 172.21.15.144:0/2759131618 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4802bca0 con 0x7f4b3c0039b0 2024-09-11T23:25:11.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.261+0000 7f4b5ce00640 1 -- 172.21.15.144:0/2759131618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b3c0039b0 msgr2=0x7f4b3c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:11.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.261+0000 7f4b5ce00640 1 --2- 172.21.15.144:0/2759131618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b3c0039b0 0x7f4b3c003dd0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f4b4800a870 tx=0x7f4b3c005830 comp rx=0 tx=0).stop 2024-09-11T23:25:11.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.261+0000 7f4b56800640 1 -- 172.21.15.144:0/2759131618 reap_dead start 2024-09-11T23:25:11.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.262+0000 7f4b5ce00640 1 -- 172.21.15.144:0/2759131618 shutdown_connections 2024-09-11T23:25:11.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.262+0000 7f4b5ce00640 1 -- 172.21.15.144:0/2759131618 >> 172.21.15.144:0/2759131618 conn(0x7f4b58062cc0 msgr2=0x7f4b5806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:11.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.262+0000 7f4b5ce00640 1 -- 172.21.15.144:0/2759131618 shutdown_connections 2024-09-11T23:25:11.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.262+0000 7f4b5ce00640 1 -- 172.21.15.144:0/2759131618 wait complete. 2024-09-11T23:25:11.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.263+0000 7f4b5ce00640 1 Processor -- start 2024-09-11T23:25:11.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.263+0000 7f4b5ce00640 1 -- start start 2024-09-11T23:25:11.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.264+0000 7f4b5ce00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b3c0039b0 0x7f4b58151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:11.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.264+0000 7f4b5ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b58151e10 0x7f4b5813fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:11.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.264+0000 7f4b5ce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b581537c0 0x7f4b58153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:11.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.264+0000 7f4b5ce00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4b580722f0 con 0x7f4b58151e10 2024-09-11T23:25:11.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.264+0000 7f4b5ce00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4b580ced00 con 0x7f4b3c0039b0 2024-09-11T23:25:11.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.264+0000 7f4b5ce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4b5815c560 con 0x7f4b581537c0 2024-09-11T23:25:11.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.265+0000 7f4b55400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b58151e10 0x7f4b5813fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:11.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.265+0000 7f4b55400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b58151e10 0x7f4b5813fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37586/0 (socket says 172.21.15.144:37586) 2024-09-11T23:25:11.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.265+0000 7f4b55400640 1 -- 172.21.15.144:0/3115475274 learned_addr learned my addr 172.21.15.144:0/3115475274 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:11.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.265+0000 7f4b56800640 1 --2- 172.21.15.144:0/3115475274 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b581537c0 0x7f4b58153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:11.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.265+0000 7f4b55e00640 1 --2- 172.21.15.144:0/3115475274 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b3c0039b0 0x7f4b58151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:11.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.265+0000 7f4b55400640 1 -- 172.21.15.144:0/3115475274 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b581537c0 msgr2=0x7f4b58153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:11.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.265+0000 7f4b55400640 1 --2- 172.21.15.144:0/3115475274 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b581537c0 0x7f4b58153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:11.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.265+0000 7f4b55400640 1 -- 172.21.15.144:0/3115475274 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b3c0039b0 msgr2=0x7f4b58151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:11.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.265+0000 7f4b55400640 1 --2- 172.21.15.144:0/3115475274 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b3c0039b0 0x7f4b58151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:11.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.265+0000 7f4b55400640 1 -- 172.21.15.144:0/3115475274 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5815a6d0 con 0x7f4b58151e10 2024-09-11T23:25:11.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.265+0000 7f4b55e00640 1 --2- 172.21.15.144:0/3115475274 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b3c0039b0 0x7f4b58151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:11.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.265+0000 7f4b55400640 1 --2- 172.21.15.144:0/3115475274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b58151e10 0x7f4b5813fbe0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f4b44011980 tx=0x7f4b44011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:11.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.265+0000 7f4b4e000640 1 -- 172.21.15.144:0/3115475274 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4400faf0 con 0x7f4b58151e10 2024-09-11T23:25:11.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.265+0000 7f4b4e000640 1 -- 172.21.15.144:0/3115475274 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b4400fc90 con 0x7f4b58151e10 2024-09-11T23:25:11.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.266+0000 7f4b4e000640 1 -- 172.21.15.144:0/3115475274 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b44014440 con 0x7f4b58151e10 2024-09-11T23:25:11.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.266+0000 7f4b5ce00640 1 -- 172.21.15.144:0/3115475274 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b5815b710 con 0x7f4b58151e10 2024-09-11T23:25:11.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.266+0000 7f4b5ce00640 1 -- 172.21.15.144:0/3115475274 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b5815ac30 con 0x7f4b58151e10 2024-09-11T23:25:11.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.267+0000 7f4b5ce00640 1 -- 172.21.15.144:0/3115475274 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b580cf4e0 con 0x7f4b58151e10 2024-09-11T23:25:11.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.268+0000 7f4b4e000640 1 -- 172.21.15.144:0/3115475274 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f4b44012040 con 0x7f4b58151e10 2024-09-11T23:25:11.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.268+0000 7f4b4e000640 1 --2- 172.21.15.144:0/3115475274 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4b3806c490 0x7f4b3806e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:11.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.269+0000 7f4b4e000640 1 -- 172.21.15.144:0/3115475274 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 4857+0+0 (secure 0 0 0) 0x7f4b4408bc40 con 0x7f4b58151e10 2024-09-11T23:25:11.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.269+0000 7f4b55e00640 1 --2- 172.21.15.144:0/3115475274 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4b3806c490 0x7f4b3806e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:11.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.270+0000 7f4b55e00640 1 --2- 172.21.15.144:0/3115475274 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4b3806c490 0x7f4b3806e950 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4b48033000 tx=0x7f4b48007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:11.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.273+0000 7f4b4e000640 1 -- 172.21.15.144:0/3115475274 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4b5815a6d0 con 0x7f4b58151e10 2024-09-11T23:25:11.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.449+0000 7f4b5ce00640 1 -- 172.21.15.144:0/3115475274 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4b580b2850 con 0x7f4b58151e10 2024-09-11T23:25:11.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.450+0000 7f4b4e000640 1 -- 172.21.15.144:0/3115475274 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v138) ==== 84+0+65 (secure 0 0 0) 0x7f4b44019030 con 0x7f4b58151e10 2024-09-11T23:25:11.450 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:11.450 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:25:11.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:11.450 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-11T23:25:11.450 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-11T23:25:11.450 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:11.450 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:25:11.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.452+0000 7f4b5ce00640 1 -- 172.21.15.144:0/3115475274 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4b3806c490 msgr2=0x7f4b3806e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:11.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.452+0000 7f4b5ce00640 1 --2- 172.21.15.144:0/3115475274 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4b3806c490 0x7f4b3806e950 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4b48033000 tx=0x7f4b48007000 comp rx=0 tx=0).stop 2024-09-11T23:25:11.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.452+0000 7f4b5ce00640 1 -- 172.21.15.144:0/3115475274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b58151e10 msgr2=0x7f4b5813fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:11.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.452+0000 7f4b5ce00640 1 --2- 172.21.15.144:0/3115475274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b58151e10 0x7f4b5813fbe0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f4b44011980 tx=0x7f4b44011e40 comp rx=0 tx=0).stop 2024-09-11T23:25:11.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.452+0000 7f4b5ce00640 1 -- 172.21.15.144:0/3115475274 shutdown_connections 2024-09-11T23:25:11.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.452+0000 7f4b5ce00640 1 --2- 172.21.15.144:0/3115475274 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4b3806c490 0x7f4b3806e950 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:11.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.452+0000 7f4b5ce00640 1 --2- 172.21.15.144:0/3115475274 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4b581537c0 0x7f4b58153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:11.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.452+0000 7f4b5ce00640 1 --2- 172.21.15.144:0/3115475274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4b58151e10 0x7f4b5813fbe0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:11.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.452+0000 7f4b5ce00640 1 --2- 172.21.15.144:0/3115475274 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b3c0039b0 0x7f4b58151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:11.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.452+0000 7f4b5ce00640 1 -- 172.21.15.144:0/3115475274 >> 172.21.15.144:0/3115475274 conn(0x7f4b58062cc0 msgr2=0x7f4b580cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:11.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.452+0000 7f4b5ce00640 1 -- 172.21.15.144:0/3115475274 shutdown_connections 2024-09-11T23:25:11.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.452+0000 7f4b5ce00640 1 -- 172.21.15.144:0/3115475274 wait complete. 2024-09-11T23:25:11.468 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:25:11.468 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:25:11.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.626+0000 7f626a000640 1 Processor -- start 2024-09-11T23:25:11.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.627+0000 7f626a000640 1 -- start start 2024-09-11T23:25:11.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.628+0000 7f626a000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f626415b370 0x7f6264072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:11.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.628+0000 7f626a000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f626415c970 con 0x7f626406f130 2024-09-11T23:25:11.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.628+0000 7f626a000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f626415bbb0 con 0x7f626415f9f0 2024-09-11T23:25:11.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.628+0000 7f626a000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f626415fef0 con 0x7f626415b370 2024-09-11T23:25:11.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.628+0000 7f6263400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f626415b370 0x7f6264072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:11.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.628+0000 7f6263e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f626406f130 0x7f62640ce490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40638/0 (socket says 172.21.15.144:40638) 2024-09-11T23:25:11.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.628+0000 7f6263400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f626415b370 0x7f6264072560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37598/0 (socket says 172.21.15.144:37598) 2024-09-11T23:25:11.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.628+0000 7f6263e00640 1 -- 172.21.15.144:0/2910512812 learned_addr learned my addr 172.21.15.144:0/2910512812 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:11.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.629+0000 7f6263400640 1 -- 172.21.15.144:0/2910512812 >> v1:172.21.15.165:6789/0 conn(0x7f626415f9f0 legacy=0x7f626406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:11.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.629+0000 7f6263400640 1 -- 172.21.15.144:0/2910512812 >> v1:172.21.15.144:6789/0 conn(0x7f626406f130 legacy=0x7f62640ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:11.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.629+0000 7f6263400640 1 -- 172.21.15.144:0/2910512812 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f626415be90 con 0x7f626415b370 2024-09-11T23:25:11.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.630+0000 7f6263400640 1 --2- 172.21.15.144:0/2910512812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f626415b370 0x7f6264072560 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f625400ba40 tx=0x7f625402c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aec338506a64d7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:11.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.630+0000 7f6262a00640 1 -- 172.21.15.144:0/2910512812 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6254032750 con 0x7f626415b370 2024-09-11T23:25:11.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.630+0000 7f6262a00640 1 -- 172.21.15.144:0/2910512812 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6254030050 con 0x7f626415b370 2024-09-11T23:25:11.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.630+0000 7f6262a00640 1 -- 172.21.15.144:0/2910512812 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6254032b10 con 0x7f626415b370 2024-09-11T23:25:11.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.630+0000 7f626a000640 1 -- 172.21.15.144:0/2910512812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f626415b370 msgr2=0x7f6264072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:11.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.630+0000 7f626a000640 1 --2- 172.21.15.144:0/2910512812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f626415b370 0x7f6264072560 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f625400ba40 tx=0x7f625402c850 comp rx=0 tx=0).stop 2024-09-11T23:25:11.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.630+0000 7f626a000640 1 -- 172.21.15.144:0/2910512812 shutdown_connections 2024-09-11T23:25:11.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.630+0000 7f626a000640 1 --2- 172.21.15.144:0/2910512812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f626415b370 0x7f6264072560 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:11.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.630+0000 7f626a000640 1 -- 172.21.15.144:0/2910512812 >> 172.21.15.144:0/2910512812 conn(0x7f626406bba0 msgr2=0x7f626406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:11.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.631+0000 7f626a000640 1 -- 172.21.15.144:0/2910512812 shutdown_connections 2024-09-11T23:25:11.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.631+0000 7f626a000640 1 -- 172.21.15.144:0/2910512812 wait complete. 2024-09-11T23:25:11.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.632+0000 7f626a000640 1 Processor -- start 2024-09-11T23:25:11.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.632+0000 7f626a000640 1 -- start start 2024-09-11T23:25:11.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.633+0000 7f626a000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f626406f130 0x7f626414fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:11.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.633+0000 7f626a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f626415b370 0x7f62641f7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:11.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.633+0000 7f626a000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f626415f9f0 0x7f62641f8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:11.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.633+0000 7f626a000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f62640731b0 con 0x7f626415b370 2024-09-11T23:25:11.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.633+0000 7f626a000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f626415c450 con 0x7f626406f130 2024-09-11T23:25:11.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.633+0000 7f626a000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f626415b750 con 0x7f626415f9f0 2024-09-11T23:25:11.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.633+0000 7f625aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f626415b370 0x7f62641f7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:11.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.634+0000 7f625aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f626415b370 0x7f62641f7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37610/0 (socket says 172.21.15.144:37610) 2024-09-11T23:25:11.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.634+0000 7f625aa00640 1 -- 172.21.15.144:0/3811343059 learned_addr learned my addr 172.21.15.144:0/3811343059 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:11.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.634+0000 7f6263400640 1 --2- 172.21.15.144:0/3811343059 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f626406f130 0x7f626414fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:11.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.634+0000 7f6263e00640 1 --2- 172.21.15.144:0/3811343059 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f626415f9f0 0x7f62641f8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:11.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.634+0000 7f625aa00640 1 -- 172.21.15.144:0/3811343059 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f626415f9f0 msgr2=0x7f62641f8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:11.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.634+0000 7f625aa00640 1 --2- 172.21.15.144:0/3811343059 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f626415f9f0 0x7f62641f8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:11.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.634+0000 7f625aa00640 1 -- 172.21.15.144:0/3811343059 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f626406f130 msgr2=0x7f626414fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:11.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.634+0000 7f625aa00640 1 --2- 172.21.15.144:0/3811343059 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f626406f130 0x7f626414fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:11.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.634+0000 7f625aa00640 1 -- 172.21.15.144:0/3811343059 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62641572e0 con 0x7f626415b370 2024-09-11T23:25:11.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.634+0000 7f625aa00640 1 --2- 172.21.15.144:0/3811343059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f626415b370 0x7f62641f7b40 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f624c00c470 tx=0x7f624c00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:11.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.634+0000 7f625be00640 1 -- 172.21.15.144:0/3811343059 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c0052d0 con 0x7f626415b370 2024-09-11T23:25:11.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.634+0000 7f625be00640 1 -- 172.21.15.144:0/3811343059 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624c005490 con 0x7f626415b370 2024-09-11T23:25:11.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.634+0000 7f625be00640 1 -- 172.21.15.144:0/3811343059 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c007260 con 0x7f626415b370 2024-09-11T23:25:11.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.634+0000 7f626a000640 1 -- 172.21.15.144:0/3811343059 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62641f8a00 con 0x7f626415b370 2024-09-11T23:25:11.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.635+0000 7f626a000640 1 -- 172.21.15.144:0/3811343059 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62640c5580 con 0x7f626415b370 2024-09-11T23:25:11.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.636+0000 7f626a000640 1 -- 172.21.15.144:0/3811343059 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6264072560 con 0x7f626415b370 2024-09-11T23:25:11.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.636+0000 7f625be00640 1 -- 172.21.15.144:0/3811343059 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f624c007400 con 0x7f626415b370 2024-09-11T23:25:11.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.637+0000 7f625be00640 1 --2- 172.21.15.144:0/3811343059 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f624006c490 0x7f624006e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:11.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.637+0000 7f625be00640 1 -- 172.21.15.144:0/3811343059 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 4857+0+0 (secure 0 0 0) 0x7f624c08a9c0 con 0x7f626415b370 2024-09-11T23:25:11.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.638+0000 7f6263400640 1 --2- 172.21.15.144:0/3811343059 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f624006c490 0x7f624006e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:11.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.638+0000 7f6263400640 1 --2- 172.21.15.144:0/3811343059 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f624006c490 0x7f624006e950 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6254037000 tx=0x7f6254032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:11.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.641+0000 7f625be00640 1 -- 172.21.15.144:0/3811343059 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f62641572e0 con 0x7f626415b370 2024-09-11T23:25:11.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:11.822+0000 7f626a000640 1 -- 172.21.15.144:0/3811343059 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f626406e8a0 con 0x7f626415b370 2024-09-11T23:25:12.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.674+0000 7f625be00640 1 -- 172.21.15.144:0/3811343059 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v139) ==== 138+0+0 (secure 0 0 0) 0x7f624c058780 con 0x7f626415b370 2024-09-11T23:25:12.674 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-11T23:25:12.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.677+0000 7f626a000640 1 -- 172.21.15.144:0/3811343059 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f624006c490 msgr2=0x7f624006e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:12.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.677+0000 7f626a000640 1 --2- 172.21.15.144:0/3811343059 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f624006c490 0x7f624006e950 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6254037000 tx=0x7f6254032000 comp rx=0 tx=0).stop 2024-09-11T23:25:12.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.677+0000 7f626a000640 1 -- 172.21.15.144:0/3811343059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f626415b370 msgr2=0x7f62641f7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:12.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.677+0000 7f626a000640 1 --2- 172.21.15.144:0/3811343059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f626415b370 0x7f62641f7b40 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f624c00c470 tx=0x7f624c00c930 comp rx=0 tx=0).stop 2024-09-11T23:25:12.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.678+0000 7f626a000640 1 -- 172.21.15.144:0/3811343059 shutdown_connections 2024-09-11T23:25:12.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.678+0000 7f626a000640 1 --2- 172.21.15.144:0/3811343059 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f624006c490 0x7f624006e950 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:12.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.678+0000 7f626a000640 1 --2- 172.21.15.144:0/3811343059 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f626415f9f0 0x7f62641f8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:12.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.678+0000 7f626a000640 1 --2- 172.21.15.144:0/3811343059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f626415b370 0x7f62641f7b40 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:12.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.678+0000 7f626a000640 1 --2- 172.21.15.144:0/3811343059 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f626406f130 0x7f626414fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:12.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.678+0000 7f626a000640 1 -- 172.21.15.144:0/3811343059 >> 172.21.15.144:0/3811343059 conn(0x7f626406bba0 msgr2=0x7f62640b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:12.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.679+0000 7f626a000640 1 -- 172.21.15.144:0/3811343059 shutdown_connections 2024-09-11T23:25:12.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.679+0000 7f626a000640 1 -- 172.21.15.144:0/3811343059 wait complete. 2024-09-11T23:25:12.699 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:25:12.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.862+0000 7f51af200640 1 Processor -- start 2024-09-11T23:25:12.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.862+0000 7f51af200640 1 -- start start 2024-09-11T23:25:12.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.864+0000 7f51af200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51b0074040 0x7f51b00b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:12.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.864+0000 7f51af200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b00738e0 con 0x7f51b008ca70 2024-09-11T23:25:12.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.864+0000 7f51af200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b0073640 con 0x7f51b0073af0 2024-09-11T23:25:12.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.864+0000 7f51af200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f51b008ce50 con 0x7f51b0074040 2024-09-11T23:25:12.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.864+0000 7f51a7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51b0074040 0x7f51b00b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:12.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.864+0000 7f51a7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f51b0074040 0x7f51b00b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37622/0 (socket says 172.21.15.144:37622) 2024-09-11T23:25:12.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.864+0000 7f51a7e00640 1 -- 172.21.15.144:0/1248233248 learned_addr learned my addr 172.21.15.144:0/1248233248 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:12.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.864+0000 7f51ade00640 1 --1- 172.21.15.144:0/1248233248 >> v1:172.21.15.144:6789/0 conn(0x7f51b008ca70 0x7f51b00cf230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40644/0 (socket says 172.21.15.144:40644) 2024-09-11T23:25:12.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.865+0000 7f51ad400640 1 -- 172.21.15.144:0/1248233248 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2452792481 0 0) 0x7f51b0073640 con 0x7f51b0073af0 2024-09-11T23:25:12.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.870+0000 7f51ad400640 1 -- 172.21.15.144:0/1248233248 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5194003500 con 0x7f51b0073af0 2024-09-11T23:25:12.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.871+0000 7f51ad400640 1 -- 172.21.15.144:0/1248233248 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3173219995 0 0) 0x7f51b00738e0 con 0x7f51b008ca70 2024-09-11T23:25:12.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.871+0000 7f51ad400640 1 -- 172.21.15.144:0/1248233248 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51b0073640 con 0x7f51b008ca70 2024-09-11T23:25:12.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.871+0000 7f51a7e00640 1 -- 172.21.15.144:0/1248233248 >> v1:172.21.15.165:6789/0 conn(0x7f51b0073af0 legacy=0x7f51b00b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:12.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.871+0000 7f51a7e00640 1 -- 172.21.15.144:0/1248233248 >> v1:172.21.15.144:6789/0 conn(0x7f51b008ca70 legacy=0x7f51b00cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:12.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.871+0000 7f51a7e00640 1 -- 172.21.15.144:0/1248233248 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b00cd760 con 0x7f51b0074040 2024-09-11T23:25:12.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.872+0000 7f51a7e00640 1 --2- 172.21.15.144:0/1248233248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0074040 0x7f51b00b3ec0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f5198008120 tx=0x7f519802a500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa7a4674f97d4b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:12.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.872+0000 7f51ad400640 1 -- 172.21.15.144:0/1248233248 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5198036070 con 0x7f51b0074040 2024-09-11T23:25:12.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.872+0000 7f51ad400640 1 -- 172.21.15.144:0/1248233248 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5198004230 con 0x7f51b0074040 2024-09-11T23:25:12.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.872+0000 7f51ad400640 1 -- 172.21.15.144:0/1248233248 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519800b040 con 0x7f51b0074040 2024-09-11T23:25:12.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.873+0000 7f51af200640 1 -- 172.21.15.144:0/1248233248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0074040 msgr2=0x7f51b00b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:12.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.873+0000 7f51af200640 1 --2- 172.21.15.144:0/1248233248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0074040 0x7f51b00b3ec0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f5198008120 tx=0x7f519802a500 comp rx=0 tx=0).stop 2024-09-11T23:25:12.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.873+0000 7f51af200640 1 -- 172.21.15.144:0/1248233248 shutdown_connections 2024-09-11T23:25:12.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.873+0000 7f51af200640 1 --2- 172.21.15.144:0/1248233248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0074040 0x7f51b00b3ec0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:12.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.873+0000 7f51af200640 1 -- 172.21.15.144:0/1248233248 >> 172.21.15.144:0/1248233248 conn(0x7f51b00b1ed0 msgr2=0x7f51b00b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:12.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.873+0000 7f51af200640 1 -- 172.21.15.144:0/1248233248 shutdown_connections 2024-09-11T23:25:12.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.873+0000 7f51af200640 1 -- 172.21.15.144:0/1248233248 wait complete. 2024-09-11T23:25:12.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.874+0000 7f51af200640 1 Processor -- start 2024-09-11T23:25:12.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.875+0000 7f51af200640 1 -- start start 2024-09-11T23:25:12.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.875+0000 7f51af200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51b0073af0 0x7f51b0204c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:12.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.875+0000 7f51af200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0074040 0x7f51b015dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:12.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.875+0000 7f51af200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51b008ca70 0x7f51b00cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:12.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.875+0000 7f51af200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f51b00b5500 con 0x7f51b0074040 2024-09-11T23:25:12.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.875+0000 7f51af200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f51b00cdce0 con 0x7f51b0073af0 2024-09-11T23:25:12.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.875+0000 7f51af200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f51b00b5680 con 0x7f51b008ca70 2024-09-11T23:25:12.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.876+0000 7f51a7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0074040 0x7f51b015dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:12.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.876+0000 7f51a7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0074040 0x7f51b015dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37628/0 (socket says 172.21.15.144:37628) 2024-09-11T23:25:12.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.876+0000 7f51a7e00640 1 -- 172.21.15.144:0/419860945 learned_addr learned my addr 172.21.15.144:0/419860945 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:12.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.876+0000 7f51ade00640 1 --2- 172.21.15.144:0/419860945 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51b0073af0 0x7f51b0204c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:12.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.876+0000 7f51ae800640 1 --2- 172.21.15.144:0/419860945 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51b008ca70 0x7f51b00cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:12.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.876+0000 7f51a7e00640 1 -- 172.21.15.144:0/419860945 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51b008ca70 msgr2=0x7f51b00cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:12.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.876+0000 7f51a7e00640 1 --2- 172.21.15.144:0/419860945 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51b008ca70 0x7f51b00cfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:12.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.876+0000 7f51a7e00640 1 -- 172.21.15.144:0/419860945 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51b0073af0 msgr2=0x7f51b0204c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:12.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.876+0000 7f51a7e00640 1 --2- 172.21.15.144:0/419860945 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51b0073af0 0x7f51b0204c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:12.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.876+0000 7f51a7e00640 1 -- 172.21.15.144:0/419860945 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b0205350 con 0x7f51b0074040 2024-09-11T23:25:12.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.876+0000 7f51ade00640 1 --2- 172.21.15.144:0/419860945 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51b0073af0 0x7f51b0204c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:12.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.876+0000 7f51a7e00640 1 --2- 172.21.15.144:0/419860945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0074040 0x7f51b015dd30 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f5198000c00 tx=0x7f51980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:12.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.877+0000 7f51a6000640 1 -- 172.21.15.144:0/419860945 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5198041030 con 0x7f51b0074040 2024-09-11T23:25:12.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.877+0000 7f51a6000640 1 -- 172.21.15.144:0/419860945 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f519800b000 con 0x7f51b0074040 2024-09-11T23:25:12.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.877+0000 7f51a6000640 1 -- 172.21.15.144:0/419860945 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5198036040 con 0x7f51b0074040 2024-09-11T23:25:12.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.877+0000 7f51af200640 1 -- 172.21.15.144:0/419860945 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b0205630 con 0x7f51b0074040 2024-09-11T23:25:12.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.877+0000 7f51af200640 1 -- 172.21.15.144:0/419860945 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b0208440 con 0x7f51b0074040 2024-09-11T23:25:12.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.878+0000 7f51af200640 1 -- 172.21.15.144:0/419860945 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b015e2d0 con 0x7f51b0074040 2024-09-11T23:25:12.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.879+0000 7f51a6000640 1 -- 172.21.15.144:0/419860945 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f5198044070 con 0x7f51b0074040 2024-09-11T23:25:12.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.880+0000 7f51a6000640 1 --2- 172.21.15.144:0/419860945 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f518c06c4b0 0x7f518c06e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:12.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.880+0000 7f51a6000640 1 -- 172.21.15.144:0/419860945 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5227+0+0 (secure 0 0 0) 0x7f51980ac010 con 0x7f51b0074040 2024-09-11T23:25:12.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.881+0000 7f51ade00640 1 --2- 172.21.15.144:0/419860945 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f518c06c4b0 0x7f518c06e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:12.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.881+0000 7f51ade00640 1 --2- 172.21.15.144:0/419860945 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f518c06c4b0 0x7f518c06e970 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f51a0004870 tx=0x7f51a00093c0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:12.885 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:12.885+0000 7f51a6000640 1 -- 172.21.15.144:0/419860945 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f519803a370 con 0x7f51b0074040 2024-09-11T23:25:13.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.060+0000 7f51af200640 1 -- 172.21.15.144:0/419860945 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f51b00cf230 con 0x7f51b0074040 2024-09-11T23:25:13.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.680+0000 7f51a6000640 1 -- 172.21.15.144:0/419860945 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v140) ==== 170+0+0 (secure 0 0 0) 0x7f519807a300 con 0x7f51b0074040 2024-09-11T23:25:13.680 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-11T23:25:13.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.683+0000 7f51af200640 1 -- 172.21.15.144:0/419860945 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f518c06c4b0 msgr2=0x7f518c06e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:13.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.683+0000 7f51af200640 1 --2- 172.21.15.144:0/419860945 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f518c06c4b0 0x7f518c06e970 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f51a0004870 tx=0x7f51a00093c0 comp rx=0 tx=0).stop 2024-09-11T23:25:13.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.683+0000 7f51af200640 1 -- 172.21.15.144:0/419860945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0074040 msgr2=0x7f51b015dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:13.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.683+0000 7f51af200640 1 --2- 172.21.15.144:0/419860945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0074040 0x7f51b015dd30 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f5198000c00 tx=0x7f51980046c0 comp rx=0 tx=0).stop 2024-09-11T23:25:13.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.683+0000 7f51af200640 1 -- 172.21.15.144:0/419860945 shutdown_connections 2024-09-11T23:25:13.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.683+0000 7f51af200640 1 --2- 172.21.15.144:0/419860945 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f518c06c4b0 0x7f518c06e970 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:13.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.683+0000 7f51af200640 1 --2- 172.21.15.144:0/419860945 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f51b008ca70 0x7f51b00cfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:13.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.683+0000 7f51af200640 1 --2- 172.21.15.144:0/419860945 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0074040 0x7f51b015dd30 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:13.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.683+0000 7f51af200640 1 --2- 172.21.15.144:0/419860945 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f51b0073af0 0x7f51b0204c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:13.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.683+0000 7f51af200640 1 -- 172.21.15.144:0/419860945 >> 172.21.15.144:0/419860945 conn(0x7f51b00b1ed0 msgr2=0x7f51b00b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:13.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.683+0000 7f51af200640 1 -- 172.21.15.144:0/419860945 shutdown_connections 2024-09-11T23:25:13.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.684+0000 7f51af200640 1 -- 172.21.15.144:0/419860945 wait complete. 2024-09-11T23:25:13.712 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:25:13.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.868+0000 7fc7f4e00640 1 Processor -- start 2024-09-11T23:25:13.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.869+0000 7fc7f4e00640 1 -- start start 2024-09-11T23:25:13.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.870+0000 7fc7f4e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc7f015d3b0 0x7fc7f0071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:13.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.870+0000 7fc7f4e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc7f015d790 0x7fc7f00cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:13.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.870+0000 7fc7f4e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7f00715c0 con 0x7fc7f00cd3b0 2024-09-11T23:25:13.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.870+0000 7fc7f4e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc7f006da30 con 0x7fc7f015d3b0 2024-09-11T23:25:13.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.870+0000 7fc7f4e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc7f006d700 con 0x7fc7f015d790 2024-09-11T23:25:13.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.870+0000 7fc7ede00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc7f015d3b0 0x7fc7f0071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:13.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.870+0000 7fc7ede00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc7f015d3b0 0x7fc7f0071080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37632/0 (socket says 172.21.15.144:37632) 2024-09-11T23:25:13.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.870+0000 7fc7ee800640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc7f00cd3b0 0x7fc7f00cf320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:40654/0 (socket says 172.21.15.144:40654) 2024-09-11T23:25:13.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.870+0000 7fc7ede00640 1 -- 172.21.15.144:0/169918376 learned_addr learned my addr 172.21.15.144:0/169918376 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:13.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.870+0000 7fc7ed400640 1 --2- 172.21.15.144:0/169918376 >> v2:172.21.15.165:3300/0 conn(0x7fc7f015d790 0x7fc7f00cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:13.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.871+0000 7fc7ede00640 1 -- 172.21.15.144:0/169918376 >> v2:172.21.15.165:3300/0 conn(0x7fc7f015d790 msgr2=0x7fc7f00cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:13.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.871+0000 7fc7ede00640 1 --2- 172.21.15.144:0/169918376 >> v2:172.21.15.165:3300/0 conn(0x7fc7f015d790 0x7fc7f00cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:13.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.871+0000 7fc7ede00640 1 -- 172.21.15.144:0/169918376 >> v1:172.21.15.144:6789/0 conn(0x7fc7f00cd3b0 legacy=0x7fc7f00cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:13.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.871+0000 7fc7ede00640 1 -- 172.21.15.144:0/169918376 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f00cde80 con 0x7fc7f015d3b0 2024-09-11T23:25:13.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.871+0000 7fc7ed400640 1 --2- 172.21.15.144:0/169918376 >> v2:172.21.15.165:3300/0 conn(0x7fc7f015d790 0x7fc7f00cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:13.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.872+0000 7fc7ede00640 1 --2- 172.21.15.144:0/169918376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7f015d3b0 0x7fc7f0071080 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0157010 tx=0x7fc7e002a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec4de1ac290766e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:13.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.872+0000 7fc7eca00640 1 -- 172.21.15.144:0/169918376 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0036070 con 0x7fc7f015d3b0 2024-09-11T23:25:13.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.872+0000 7fc7eca00640 1 -- 172.21.15.144:0/169918376 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e0031600 con 0x7fc7f015d3b0 2024-09-11T23:25:13.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.872+0000 7fc7eca00640 1 -- 172.21.15.144:0/169918376 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e00319d0 con 0x7fc7f015d3b0 2024-09-11T23:25:13.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.872+0000 7fc7f4e00640 1 -- 172.21.15.144:0/169918376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7f015d3b0 msgr2=0x7fc7f0071080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:13.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.872+0000 7fc7f4e00640 1 --2- 172.21.15.144:0/169918376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7f015d3b0 0x7fc7f0071080 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0157010 tx=0x7fc7e002a740 comp rx=0 tx=0).stop 2024-09-11T23:25:13.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.872+0000 7fc7f4e00640 1 -- 172.21.15.144:0/169918376 shutdown_connections 2024-09-11T23:25:13.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.872+0000 7fc7f4e00640 1 --2- 172.21.15.144:0/169918376 >> v2:172.21.15.165:3300/0 conn(0x7fc7f015d790 0x7fc7f00cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:13.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.872+0000 7fc7f4e00640 1 --2- 172.21.15.144:0/169918376 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7f015d3b0 0x7fc7f0071080 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:13.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.872+0000 7fc7f4e00640 1 -- 172.21.15.144:0/169918376 >> 172.21.15.144:0/169918376 conn(0x7fc7f006bba0 msgr2=0x7fc7f006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:13.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.873+0000 7fc7f4e00640 1 -- 172.21.15.144:0/169918376 shutdown_connections 2024-09-11T23:25:13.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.873+0000 7fc7f4e00640 1 -- 172.21.15.144:0/169918376 wait complete. 2024-09-11T23:25:13.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.874+0000 7fc7f4e00640 1 Processor -- start 2024-09-11T23:25:13.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.874+0000 7fc7f4e00640 1 -- start start 2024-09-11T23:25:13.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.875+0000 7fc7f4e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7f00cd3b0 0x7fc7f0071a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:13.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.875+0000 7fc7f4e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7f015d3b0 0x7fc7f01530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:13.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.875+0000 7fc7f4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7f0153600 0x7fc7f014c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:13.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.875+0000 7fc7f4e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f015cbf0 con 0x7fc7f0153600 2024-09-11T23:25:13.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.875+0000 7fc7f4e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f00cdba0 con 0x7fc7f015d3b0 2024-09-11T23:25:13.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.875+0000 7fc7f4e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc7f015cd70 con 0x7fc7f00cd3b0 2024-09-11T23:25:13.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.875+0000 7fc7ee800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7f0153600 0x7fc7f014c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:13.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.875+0000 7fc7ee800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7f0153600 0x7fc7f014c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37646/0 (socket says 172.21.15.144:37646) 2024-09-11T23:25:13.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.875+0000 7fc7ee800640 1 -- 172.21.15.144:0/2509937078 learned_addr learned my addr 172.21.15.144:0/2509937078 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:13.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.875+0000 7fc7ede00640 1 --2- 172.21.15.144:0/2509937078 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7f00cd3b0 0x7fc7f0071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:13.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.875+0000 7fc7ed400640 1 --2- 172.21.15.144:0/2509937078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7f015d3b0 0x7fc7f01530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:13.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.876+0000 7fc7ee800640 1 -- 172.21.15.144:0/2509937078 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7f00cd3b0 msgr2=0x7fc7f0071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:13.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.876+0000 7fc7ee800640 1 --2- 172.21.15.144:0/2509937078 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7f00cd3b0 0x7fc7f0071a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:13.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.876+0000 7fc7ee800640 1 -- 172.21.15.144:0/2509937078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7f015d3b0 msgr2=0x7fc7f01530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:13.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.876+0000 7fc7ee800640 1 --2- 172.21.15.144:0/2509937078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7f015d3b0 0x7fc7f01530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:13.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.876+0000 7fc7ee800640 1 -- 172.21.15.144:0/2509937078 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f0155fc0 con 0x7fc7f0153600 2024-09-11T23:25:13.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.876+0000 7fc7ed400640 1 --2- 172.21.15.144:0/2509937078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7f015d3b0 0x7fc7f01530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:13.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.876+0000 7fc7ee800640 1 --2- 172.21.15.144:0/2509937078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7f0153600 0x7fc7f014c2f0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800c400 tx=0x7fc7e800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:13.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.876+0000 7fc7e6000640 1 -- 172.21.15.144:0/2509937078 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e80074e0 con 0x7fc7f0153600 2024-09-11T23:25:13.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.876+0000 7fc7e6000640 1 -- 172.21.15.144:0/2509937078 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e8007680 con 0x7fc7f0153600 2024-09-11T23:25:13.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.876+0000 7fc7f4e00640 1 -- 172.21.15.144:0/2509937078 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f01562a0 con 0x7fc7f0153600 2024-09-11T23:25:13.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.876+0000 7fc7e6000640 1 -- 172.21.15.144:0/2509937078 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e80049e0 con 0x7fc7f0153600 2024-09-11T23:25:13.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.876+0000 7fc7f4e00640 1 -- 172.21.15.144:0/2509937078 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f0156860 con 0x7fc7f0153600 2024-09-11T23:25:13.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.877+0000 7fc7f4e00640 1 -- 172.21.15.144:0/2509937078 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f00cfbe0 con 0x7fc7f0153600 2024-09-11T23:25:13.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.879+0000 7fc7e6000640 1 -- 172.21.15.144:0/2509937078 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7fc7e801a020 con 0x7fc7f0153600 2024-09-11T23:25:13.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.879+0000 7fc7e6000640 1 --2- 172.21.15.144:0/2509937078 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7d006c460 0x7fc7d006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:13.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.880+0000 7fc7e6000640 1 -- 172.21.15.144:0/2509937078 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5609+0+0 (secure 0 0 0) 0x7fc7e808b0d0 con 0x7fc7f0153600 2024-09-11T23:25:13.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.880+0000 7fc7ede00640 1 --2- 172.21.15.144:0/2509937078 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7d006c460 0x7fc7d006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:13.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.881+0000 7fc7ede00640 1 --2- 172.21.15.144:0/2509937078 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7d006c460 0x7fc7d006e920 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0033000 tx=0x7fc7e0009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:13.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:13.884+0000 7fc7e6000640 1 -- 172.21.15.144:0/2509937078 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc7e80591a0 con 0x7fc7f0153600 2024-09-11T23:25:14.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.093+0000 7fc7f4e00640 1 -- 172.21.15.144:0/2509937078 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc7f00634e0 con 0x7fc7f0153600 2024-09-11T23:25:14.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.695+0000 7fc7e6000640 1 -- 172.21.15.144:0/2509937078 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v96) ==== 174+0+0 (secure 0 0 0) 0x7fc7e8058aa0 con 0x7fc7f0153600 2024-09-11T23:25:14.695 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 22 and data pool 23 2024-09-11T23:25:14.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.700+0000 7fc7f4e00640 1 -- 172.21.15.144:0/2509937078 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7d006c460 msgr2=0x7fc7d006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:14.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.700+0000 7fc7f4e00640 1 --2- 172.21.15.144:0/2509937078 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7d006c460 0x7fc7d006e920 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0033000 tx=0x7fc7e0009000 comp rx=0 tx=0).stop 2024-09-11T23:25:14.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.700+0000 7fc7f4e00640 1 -- 172.21.15.144:0/2509937078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7f0153600 msgr2=0x7fc7f014c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:14.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.700+0000 7fc7f4e00640 1 --2- 172.21.15.144:0/2509937078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7f0153600 0x7fc7f014c2f0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800c400 tx=0x7fc7e800c8c0 comp rx=0 tx=0).stop 2024-09-11T23:25:14.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.701+0000 7fc7f4e00640 1 -- 172.21.15.144:0/2509937078 shutdown_connections 2024-09-11T23:25:14.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.701+0000 7fc7f4e00640 1 --2- 172.21.15.144:0/2509937078 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7d006c460 0x7fc7d006e920 secure :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0033000 tx=0x7fc7e0009000 comp rx=0 tx=0).stop 2024-09-11T23:25:14.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.701+0000 7fc7f4e00640 1 --2- 172.21.15.144:0/2509937078 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7f0153600 0x7fc7f014c2f0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:14.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.701+0000 7fc7f4e00640 1 --2- 172.21.15.144:0/2509937078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7f015d3b0 0x7fc7f01530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:14.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.701+0000 7fc7f4e00640 1 --2- 172.21.15.144:0/2509937078 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7f00cd3b0 0x7fc7f0071a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:14.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.701+0000 7fc7f4e00640 1 -- 172.21.15.144:0/2509937078 >> 172.21.15.144:0/2509937078 conn(0x7fc7f006bba0 msgr2=0x7fc7f015f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:14.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.703+0000 7fc7f4e00640 1 -- 172.21.15.144:0/2509937078 shutdown_connections 2024-09-11T23:25:14.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.704+0000 7fc7f4e00640 1 -- 172.21.15.144:0/2509937078 wait complete. 2024-09-11T23:25:14.733 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:25:14.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.888+0000 7f0967a00640 1 Processor -- start 2024-09-11T23:25:14.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.888+0000 7f0967a00640 1 -- start start 2024-09-11T23:25:14.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.889+0000 7f0967a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f09600b4930 0x7f09600b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:14.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.890+0000 7f0967a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f096015f620 0x7f096015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:14.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.890+0000 7f0967a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0960162870 con 0x7f09600d0a50 2024-09-11T23:25:14.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.890+0000 7f0967a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f09600b52d0 con 0x7f09600b4930 2024-09-11T23:25:14.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.890+0000 7f0967a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0960162b50 con 0x7f096015f620 2024-09-11T23:25:14.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.890+0000 7f0965a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f096015f620 0x7f096015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:14.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.890+0000 7f0957e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f09600b4930 0x7f09600b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:14.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.890+0000 7f0965000640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f09600d0a50 0x7f09601620b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:40670/0 (socket says 172.21.15.144:40670) 2024-09-11T23:25:14.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.890+0000 7f0965000640 1 -- 172.21.15.144:0/1947866323 learned_addr learned my addr 172.21.15.144:0/1947866323 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:14.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.890+0000 7f095fe00640 1 -- 172.21.15.144:0/1947866323 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1686713285 0 0) 0x7f0960162870 con 0x7f09600d0a50 2024-09-11T23:25:14.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.891+0000 7f0965a00640 1 -- 172.21.15.144:0/1947866323 >> v2:172.21.15.165:3300/0 conn(0x7f09600b4930 msgr2=0x7f09600b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:14.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.891+0000 7f0965a00640 1 --2- 172.21.15.144:0/1947866323 >> v2:172.21.15.165:3300/0 conn(0x7f09600b4930 0x7f09600b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:14.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.891+0000 7f0965a00640 1 -- 172.21.15.144:0/1947866323 >> v1:172.21.15.165:6789/0 conn(0x7f09600d0a50 legacy=0x7f09601620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:14.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.891+0000 7f0965a00640 1 -- 172.21.15.144:0/1947866323 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0960162e30 con 0x7f096015f620 2024-09-11T23:25:14.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.891+0000 7f0957e00640 1 --2- 172.21.15.144:0/1947866323 >> v2:172.21.15.165:3300/0 conn(0x7f09600b4930 0x7f09600b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:25:14.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.892+0000 7f0965a00640 1 --2- 172.21.15.144:0/1947866323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f096015f620 0x7f096015fab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0958009d90 tx=0x7f095802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfc737b4011a9ba6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:14.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.892+0000 7f095fe00640 1 -- 172.21.15.144:0/1947866323 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958031600 con 0x7f096015f620 2024-09-11T23:25:14.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.892+0000 7f095fe00640 1 -- 172.21.15.144:0/1947866323 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09580317a0 con 0x7f096015f620 2024-09-11T23:25:14.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.892+0000 7f095fe00640 1 -- 172.21.15.144:0/1947866323 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958031b70 con 0x7f096015f620 2024-09-11T23:25:14.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.892+0000 7f0967a00640 1 -- 172.21.15.144:0/1947866323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f096015f620 msgr2=0x7f096015fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:14.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.892+0000 7f0967a00640 1 --2- 172.21.15.144:0/1947866323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f096015f620 0x7f096015fab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0958009d90 tx=0x7f095802a5d0 comp rx=0 tx=0).stop 2024-09-11T23:25:14.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.892+0000 7f0967a00640 1 -- 172.21.15.144:0/1947866323 shutdown_connections 2024-09-11T23:25:14.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.892+0000 7f0967a00640 1 --2- 172.21.15.144:0/1947866323 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f096015f620 0x7f096015fab0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:14.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.892+0000 7f0967a00640 1 --2- 172.21.15.144:0/1947866323 >> v2:172.21.15.165:3300/0 conn(0x7f09600b4930 0x7f09600b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:14.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.892+0000 7f0967a00640 1 -- 172.21.15.144:0/1947866323 >> 172.21.15.144:0/1947866323 conn(0x7f0960062cc0 msgr2=0x7f096006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:14.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.892+0000 7f0967a00640 1 -- 172.21.15.144:0/1947866323 shutdown_connections 2024-09-11T23:25:14.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.893+0000 7f0967a00640 1 -- 172.21.15.144:0/1947866323 wait complete. 2024-09-11T23:25:14.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.894+0000 7f0967a00640 1 Processor -- start 2024-09-11T23:25:14.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.894+0000 7f0967a00640 1 -- start start 2024-09-11T23:25:14.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.895+0000 7f0967a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09600b4930 0x7f0960157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:14.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.895+0000 7f0967a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f096015f620 0x7f0960159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:14.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.895+0000 7f0967a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09601e8fe0 0x7f09601e9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:14.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.895+0000 7f0967a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f096015fff0 con 0x7f09600b4930 2024-09-11T23:25:14.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.895+0000 7f0967a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f09600b3620 con 0x7f09601e8fe0 2024-09-11T23:25:14.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.895+0000 7f0967a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f09600b1bc0 con 0x7f096015f620 2024-09-11T23:25:14.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.895+0000 7f0965000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09600b4930 0x7f0960157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:14.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.895+0000 7f0965000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09600b4930 0x7f0960157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57362/0 (socket says 172.21.15.144:57362) 2024-09-11T23:25:14.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.895+0000 7f0957e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f096015f620 0x7f0960159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:14.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.895+0000 7f0965000640 1 -- 172.21.15.144:0/1194659485 learned_addr learned my addr 172.21.15.144:0/1194659485 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:14.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.895+0000 7f0965a00640 1 --2- 172.21.15.144:0/1194659485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09601e8fe0 0x7f09601e9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:14.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.896+0000 7f0965000640 1 -- 172.21.15.144:0/1194659485 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f096015f620 msgr2=0x7f0960159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:14.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.896+0000 7f0965000640 1 --2- 172.21.15.144:0/1194659485 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f096015f620 0x7f0960159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:14.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.896+0000 7f0965000640 1 -- 172.21.15.144:0/1194659485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09601e8fe0 msgr2=0x7f09601e9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:14.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.896+0000 7f0965000640 1 --2- 172.21.15.144:0/1194659485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09601e8fe0 0x7f09601e9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:14.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.896+0000 7f0965000640 1 -- 172.21.15.144:0/1194659485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09600b0b20 con 0x7f09600b4930 2024-09-11T23:25:14.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.896+0000 7f0965a00640 1 --2- 172.21.15.144:0/1194659485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09601e8fe0 0x7f09601e9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:25:14.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.896+0000 7f0965000640 1 --2- 172.21.15.144:0/1194659485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09600b4930 0x7f0960157b40 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f095000c4d0 tx=0x7f095000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:14.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.896+0000 7f095d600640 1 -- 172.21.15.144:0/1194659485 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0950018070 con 0x7f09600b4930 2024-09-11T23:25:14.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.896+0000 7f095d600640 1 -- 172.21.15.144:0/1194659485 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0950007500 con 0x7f09600b4930 2024-09-11T23:25:14.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.896+0000 7f0967a00640 1 -- 172.21.15.144:0/1194659485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09600b0e00 con 0x7f09600b4930 2024-09-11T23:25:14.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.896+0000 7f095d600640 1 -- 172.21.15.144:0/1194659485 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0950004a20 con 0x7f09600b4930 2024-09-11T23:25:14.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.897+0000 7f0967a00640 1 -- 172.21.15.144:0/1194659485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09600b13c0 con 0x7f09600b4930 2024-09-11T23:25:14.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.897+0000 7f0967a00640 1 -- 172.21.15.144:0/1194659485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09600b4d90 con 0x7f09600b4930 2024-09-11T23:25:14.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.898+0000 7f095d600640 1 -- 172.21.15.144:0/1194659485 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f095001b070 con 0x7f09600b4930 2024-09-11T23:25:14.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.899+0000 7f095d600640 1 --2- 172.21.15.144:0/1194659485 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f093c06c460 0x7f093c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:14.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.899+0000 7f095d600640 1 -- 172.21.15.144:0/1194659485 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7f095008ace0 con 0x7f09600b4930 2024-09-11T23:25:14.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.900+0000 7f0957e00640 1 --2- 172.21.15.144:0/1194659485 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f093c06c460 0x7f093c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:14.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.900+0000 7f0957e00640 1 --2- 172.21.15.144:0/1194659485 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f093c06c460 0x7f093c06e920 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0948009560 tx=0x7f0948009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:14.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:14.903+0000 7f095d600640 1 -- 172.21.15.144:0/1194659485 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f09500586c0 con 0x7f09600b4930 2024-09-11T23:25:14.985 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:25:14.989 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:25:15.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.084+0000 7f0967a00640 1 -- 172.21.15.144:0/1194659485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09600cdfe0 con 0x7f09600b4930 2024-09-11T23:25:15.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.085+0000 7f095d600640 1 -- 172.21.15.144:0/1194659485 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) ==== 74+0+16768 (secure 0 0 0) 0x7f095005c9c0 con 0x7f09600b4930 2024-09-11T23:25:15.085 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:15.085 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":141,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:25:14.094233+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:25:11.862995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-11T23:25:13.101996+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:25:15.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.087+0000 7f0967a00640 1 -- 172.21.15.144:0/1194659485 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f093c06c460 msgr2=0x7f093c06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:15.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.087+0000 7f0967a00640 1 --2- 172.21.15.144:0/1194659485 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f093c06c460 0x7f093c06e920 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0948009560 tx=0x7f0948009190 comp rx=0 tx=0).stop 2024-09-11T23:25:15.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.087+0000 7f0967a00640 1 -- 172.21.15.144:0/1194659485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09600b4930 msgr2=0x7f0960157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:15.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.087+0000 7f0967a00640 1 --2- 172.21.15.144:0/1194659485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09600b4930 0x7f0960157b40 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f095000c4d0 tx=0x7f095000c990 comp rx=0 tx=0).stop 2024-09-11T23:25:15.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.087+0000 7f0967a00640 1 -- 172.21.15.144:0/1194659485 shutdown_connections 2024-09-11T23:25:15.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.087+0000 7f0967a00640 1 --2- 172.21.15.144:0/1194659485 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f093c06c460 0x7f093c06e920 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:15.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.087+0000 7f0967a00640 1 --2- 172.21.15.144:0/1194659485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09601e8fe0 0x7f09601e9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:15.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.087+0000 7f0967a00640 1 --2- 172.21.15.144:0/1194659485 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f096015f620 0x7f0960159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:15.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.087+0000 7f0967a00640 1 --2- 172.21.15.144:0/1194659485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09600b4930 0x7f0960157b40 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:15.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.087+0000 7f0967a00640 1 -- 172.21.15.144:0/1194659485 >> 172.21.15.144:0/1194659485 conn(0x7f0960062cc0 msgr2=0x7f09600b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:15.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.087+0000 7f0967a00640 1 -- 172.21.15.144:0/1194659485 shutdown_connections 2024-09-11T23:25:15.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.087+0000 7f0967a00640 1 -- 172.21.15.144:0/1194659485 wait complete. 2024-09-11T23:25:15.103 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:25:15.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.297+0000 7f421c600640 1 Processor -- start 2024-09-11T23:25:15.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.297+0000 7f421c600640 1 -- start start 2024-09-11T23:25:15.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.298+0000 7f421c600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4214073830 0x7f42140cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:15.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.298+0000 7f421c600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42140ce740 con 0x7f42140cf070 2024-09-11T23:25:15.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.298+0000 7f421c600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4214072640 con 0x7f421415c180 2024-09-11T23:25:15.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.298+0000 7f421c600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4214072920 con 0x7f4214073830 2024-09-11T23:25:15.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.299+0000 7f4219200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f42140cf070 0x7f4214073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33026/0 (socket says 172.21.15.144:33026) 2024-09-11T23:25:15.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.299+0000 7f4219200640 1 -- 172.21.15.144:0/3702301138 learned_addr learned my addr 172.21.15.144:0/3702301138 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.299+0000 7f421a600640 1 --2- 172.21.15.144:0/3702301138 >> v2:172.21.15.165:3300/0 conn(0x7f4214073830 0x7f42140cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.299+0000 7f4213e00640 1 -- 172.21.15.144:0/3702301138 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 371223494 0 0) 0x7f42140ce740 con 0x7f42140cf070 2024-09-11T23:25:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.299+0000 7f4213e00640 1 -- 172.21.15.144:0/3702301138 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41fc003520 con 0x7f42140cf070 2024-09-11T23:25:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.299+0000 7f4213e00640 1 -- 172.21.15.144:0/3702301138 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1511123157 0 0) 0x7f4214072640 con 0x7f421415c180 2024-09-11T23:25:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.299+0000 7f4213e00640 1 -- 172.21.15.144:0/3702301138 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42140ce740 con 0x7f421415c180 2024-09-11T23:25:15.299 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.299+0000 7f421a600640 1 -- 172.21.15.144:0/3702301138 >> v1:172.21.15.165:6789/0 conn(0x7f421415c180 legacy=0x7f42140cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.299+0000 7f421a600640 1 -- 172.21.15.144:0/3702301138 >> v1:172.21.15.144:6789/0 conn(0x7f42140cf070 legacy=0x7f4214073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:15.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.299+0000 7f421a600640 1 -- 172.21.15.144:0/3702301138 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4214072c00 con 0x7f4214073830 2024-09-11T23:25:15.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.300+0000 7f421a600640 1 --2- 172.21.15.144:0/3702301138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4214073830 0x7f42140cf4e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f420c009d90 tx=0x7f420c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca41de24abba4401 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:15.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.301+0000 7f4213e00640 1 -- 172.21.15.144:0/3702301138 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c007740 con 0x7f4214073830 2024-09-11T23:25:15.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.301+0000 7f4213e00640 1 -- 172.21.15.144:0/3702301138 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f420c0078e0 con 0x7f4214073830 2024-09-11T23:25:15.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.301+0000 7f4213e00640 1 -- 172.21.15.144:0/3702301138 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c007cb0 con 0x7f4214073830 2024-09-11T23:25:15.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.301+0000 7f421c600640 1 -- 172.21.15.144:0/3702301138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4214073830 msgr2=0x7f42140cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:15.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.301+0000 7f421c600640 1 --2- 172.21.15.144:0/3702301138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4214073830 0x7f42140cf4e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f420c009d90 tx=0x7f420c02a660 comp rx=0 tx=0).stop 2024-09-11T23:25:15.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.301+0000 7f421c600640 1 -- 172.21.15.144:0/3702301138 shutdown_connections 2024-09-11T23:25:15.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.301+0000 7f421c600640 1 --2- 172.21.15.144:0/3702301138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4214073830 0x7f42140cf4e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:15.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.301+0000 7f421c600640 1 -- 172.21.15.144:0/3702301138 >> 172.21.15.144:0/3702301138 conn(0x7f4214062cc0 msgr2=0x7f421406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:15.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.301+0000 7f421c600640 1 -- 172.21.15.144:0/3702301138 shutdown_connections 2024-09-11T23:25:15.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.301+0000 7f421c600640 1 -- 172.21.15.144:0/3702301138 wait complete. 2024-09-11T23:25:15.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.303+0000 7f421c600640 1 Processor -- start 2024-09-11T23:25:15.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.303+0000 7f421c600640 1 -- start start 2024-09-11T23:25:15.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.304+0000 7f421c600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4214073830 0x7f42140ae800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:15.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.304+0000 7f421c600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42140cf070 0x7f42140b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:15.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.304+0000 7f421c600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f421415c180 0x7f42140b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:15.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.304+0000 7f421c600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f42140722f0 con 0x7f42140cf070 2024-09-11T23:25:15.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.304+0000 7f421c600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f42140ced00 con 0x7f421415c180 2024-09-11T23:25:15.304 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.304+0000 7f421c600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f421415c560 con 0x7f4214073830 2024-09-11T23:25:15.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.304+0000 7f4219200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42140cf070 0x7f42140b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:15.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.304+0000 7f4219200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42140cf070 0x7f42140b1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57372/0 (socket says 172.21.15.144:57372) 2024-09-11T23:25:15.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.304+0000 7f4219200640 1 -- 172.21.15.144:0/3715828609 learned_addr learned my addr 172.21.15.144:0/3715828609 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:15.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.304+0000 7f421a600640 1 --2- 172.21.15.144:0/3715828609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f421415c180 0x7f42140b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:15.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.304+0000 7f4219c00640 1 --2- 172.21.15.144:0/3715828609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4214073830 0x7f42140ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:15.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.304+0000 7f4219200640 1 -- 172.21.15.144:0/3715828609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4214073830 msgr2=0x7f42140ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:15.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.304+0000 7f4219200640 1 --2- 172.21.15.144:0/3715828609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4214073830 0x7f42140ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:15.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.304+0000 7f4219200640 1 -- 172.21.15.144:0/3715828609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f421415c180 msgr2=0x7f42140b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:15.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.304+0000 7f4219200640 1 --2- 172.21.15.144:0/3715828609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f421415c180 0x7f42140b2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:15.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.304+0000 7f4219200640 1 -- 172.21.15.144:0/3715828609 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42141f2e20 con 0x7f42140cf070 2024-09-11T23:25:15.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.304+0000 7f421a600640 1 --2- 172.21.15.144:0/3715828609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f421415c180 0x7f42140b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:15.305 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.305+0000 7f4219200640 1 --2- 172.21.15.144:0/3715828609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42140cf070 0x7f42140b1bd0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f420000c4d0 tx=0x7f420000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:15.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.305+0000 7f4211600640 1 -- 172.21.15.144:0/3715828609 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200017070 con 0x7f42140cf070 2024-09-11T23:25:15.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.305+0000 7f4211600640 1 -- 172.21.15.144:0/3715828609 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4200005ce0 con 0x7f42140cf070 2024-09-11T23:25:15.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.305+0000 7f4211600640 1 -- 172.21.15.144:0/3715828609 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200007290 con 0x7f42140cf070 2024-09-11T23:25:15.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.305+0000 7f421c600640 1 -- 172.21.15.144:0/3715828609 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42141f2b40 con 0x7f42140cf070 2024-09-11T23:25:15.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.305+0000 7f421c600640 1 -- 172.21.15.144:0/3715828609 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42141eff20 con 0x7f42140cf070 2024-09-11T23:25:15.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.306+0000 7f421c600640 1 -- 172.21.15.144:0/3715828609 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42140cf4e0 con 0x7f42140cf070 2024-09-11T23:25:15.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.307+0000 7f4211600640 1 -- 172.21.15.144:0/3715828609 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f420001a070 con 0x7f42140cf070 2024-09-11T23:25:15.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.308+0000 7f4211600640 1 --2- 172.21.15.144:0/3715828609 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f41f406c460 0x7f41f406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:15.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.308+0000 7f4211600640 1 -- 172.21.15.144:0/3715828609 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7f420008ae30 con 0x7f42140cf070 2024-09-11T23:25:15.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.308+0000 7f4219c00640 1 --2- 172.21.15.144:0/3715828609 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f41f406c460 0x7f41f406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:15.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.309+0000 7f4219c00640 1 --2- 172.21.15.144:0/3715828609 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f41f406c460 0x7f41f406e920 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f42080015b0 tx=0x7f4208009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:15.311 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.312+0000 7f4211600640 1 -- 172.21.15.144:0/3715828609 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4200090020 con 0x7f42140cf070 2024-09-11T23:25:15.487 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.487+0000 7f421c600640 1 -- 172.21.15.144:0/3715828609 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4214156a40 con 0x7f42140cf070 2024-09-11T23:25:15.488 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.488+0000 7f4211600640 1 -- 172.21.15.144:0/3715828609 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) ==== 74+0+16768 (secure 0 0 0) 0x7f4200058e60 con 0x7f42140cf070 2024-09-11T23:25:15.488 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:15.488 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":141,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:25:14.094233+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:25:11.862995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-11T23:25:13.101996+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.491+0000 7f421c600640 1 -- 172.21.15.144:0/3715828609 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f41f406c460 msgr2=0x7f41f406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.491+0000 7f421c600640 1 --2- 172.21.15.144:0/3715828609 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f41f406c460 0x7f41f406e920 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f42080015b0 tx=0x7f4208009040 comp rx=0 tx=0).stop 2024-09-11T23:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.491+0000 7f421c600640 1 -- 172.21.15.144:0/3715828609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42140cf070 msgr2=0x7f42140b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.491+0000 7f421c600640 1 --2- 172.21.15.144:0/3715828609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42140cf070 0x7f42140b1bd0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f420000c4d0 tx=0x7f420000c990 comp rx=0 tx=0).stop 2024-09-11T23:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.491+0000 7f421c600640 1 -- 172.21.15.144:0/3715828609 shutdown_connections 2024-09-11T23:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.491+0000 7f421c600640 1 --2- 172.21.15.144:0/3715828609 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f41f406c460 0x7f41f406e920 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.491+0000 7f421c600640 1 --2- 172.21.15.144:0/3715828609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f421415c180 0x7f42140b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.491+0000 7f421c600640 1 --2- 172.21.15.144:0/3715828609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42140cf070 0x7f42140b1bd0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.491+0000 7f421c600640 1 --2- 172.21.15.144:0/3715828609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4214073830 0x7f42140ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.491+0000 7f421c600640 1 -- 172.21.15.144:0/3715828609 >> 172.21.15.144:0/3715828609 conn(0x7f4214062cc0 msgr2=0x7f42140d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.491+0000 7f421c600640 1 -- 172.21.15.144:0/3715828609 shutdown_connections 2024-09-11T23:25:15.491 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.491+0000 7f421c600640 1 -- 172.21.15.144:0/3715828609 wait complete. 2024-09-11T23:25:15.508 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:25:15.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.665+0000 7f59d4c00640 1 Processor -- start 2024-09-11T23:25:15.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.665+0000 7f59d4c00640 1 -- start start 2024-09-11T23:25:15.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.667+0000 7f59d4c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f59d015d790 0x7f59d00cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:15.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.667+0000 7f59d4c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59d006d700 con 0x7f59d015d3b0 2024-09-11T23:25:15.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.667+0000 7f59d4c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59d00cde80 con 0x7f59d00cd3b0 2024-09-11T23:25:15.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.667+0000 7f59d4c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f59d006da30 con 0x7f59d015d790 2024-09-11T23:25:15.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.667+0000 7f59c5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f59d015d790 0x7f59d00cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:15.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.667+0000 7f59cde00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f59d015d3b0 0x7f59d0071080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33030/0 (socket says 172.21.15.144:33030) 2024-09-11T23:25:15.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.667+0000 7f59cde00640 1 -- 172.21.15.144:0/1212181487 learned_addr learned my addr 172.21.15.144:0/1212181487 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:15.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.667+0000 7f59c5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f59d015d790 0x7f59d00cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57388/0 (socket says 172.21.15.144:57388) 2024-09-11T23:25:15.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.667+0000 7f59c5400640 1 -- 172.21.15.144:0/1212181487 >> v1:172.21.15.165:6789/0 conn(0x7f59d00cd3b0 legacy=0x7f59d00cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:15.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.667+0000 7f59c5400640 1 -- 172.21.15.144:0/1212181487 >> v1:172.21.15.144:6789/0 conn(0x7f59d015d3b0 legacy=0x7f59d0071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:15.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.667+0000 7f59c5400640 1 -- 172.21.15.144:0/1212181487 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d00cd8c0 con 0x7f59d015d790 2024-09-11T23:25:15.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.667+0000 7f59cd400640 1 -- 172.21.15.144:0/1212181487 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2062446142 0 0) 0x7f59d006d700 con 0x7f59d015d3b0 2024-09-11T23:25:15.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.668+0000 7f59c5400640 1 --2- 172.21.15.144:0/1212181487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d015d790 0x7f59d00cce70 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009790 tx=0x7f59b802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50644c238ff585d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:15.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.669+0000 7f59cd400640 1 -- 172.21.15.144:0/1212181487 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8037070 con 0x7f59d015d790 2024-09-11T23:25:15.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.669+0000 7f59cd400640 1 -- 172.21.15.144:0/1212181487 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b8032440 con 0x7f59d015d790 2024-09-11T23:25:15.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.669+0000 7f59cd400640 1 -- 172.21.15.144:0/1212181487 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8032810 con 0x7f59d015d790 2024-09-11T23:25:15.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.669+0000 7f59d4c00640 1 -- 172.21.15.144:0/1212181487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d015d790 msgr2=0x7f59d00cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:15.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.669+0000 7f59d4c00640 1 --2- 172.21.15.144:0/1212181487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d015d790 0x7f59d00cce70 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009790 tx=0x7f59b802a210 comp rx=0 tx=0).stop 2024-09-11T23:25:15.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.669+0000 7f59d4c00640 1 -- 172.21.15.144:0/1212181487 shutdown_connections 2024-09-11T23:25:15.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.669+0000 7f59d4c00640 1 --2- 172.21.15.144:0/1212181487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d015d790 0x7f59d00cce70 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:15.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.669+0000 7f59d4c00640 1 -- 172.21.15.144:0/1212181487 >> 172.21.15.144:0/1212181487 conn(0x7f59d006bba0 msgr2=0x7f59d006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:15.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.669+0000 7f59d4c00640 1 -- 172.21.15.144:0/1212181487 shutdown_connections 2024-09-11T23:25:15.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.669+0000 7f59d4c00640 1 -- 172.21.15.144:0/1212181487 wait complete. 2024-09-11T23:25:15.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.671+0000 7f59d4c00640 1 Processor -- start 2024-09-11T23:25:15.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.671+0000 7f59d4c00640 1 -- start start 2024-09-11T23:25:15.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.672+0000 7f59d4c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d00cd3b0 0x7f59d0147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:15.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.672+0000 7f59d4c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59d015d3b0 0x7f59d00b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:15.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.672+0000 7f59d4c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59d00b4c50 0x7f59d00b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:15.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.672+0000 7f59d4c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f59d015cd70 con 0x7f59d00cd3b0 2024-09-11T23:25:15.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.672+0000 7f59d4c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f59d015cbf0 con 0x7f59d00b4c50 2024-09-11T23:25:15.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.672+0000 7f59d4c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f59d00cfa30 con 0x7f59d015d3b0 2024-09-11T23:25:15.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.672+0000 7f59cde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d00cd3b0 0x7f59d0147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:15.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.672+0000 7f59cde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d00cd3b0 0x7f59d0147eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57394/0 (socket says 172.21.15.144:57394) 2024-09-11T23:25:15.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.672+0000 7f59cde00640 1 -- 172.21.15.144:0/1046761406 learned_addr learned my addr 172.21.15.144:0/1046761406 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.673+0000 7f59ce800640 1 --2- 172.21.15.144:0/1046761406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59d00b4c50 0x7f59d00b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.673+0000 7f59c5400640 1 --2- 172.21.15.144:0/1046761406 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59d015d3b0 0x7f59d00b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.673+0000 7f59cde00640 1 -- 172.21.15.144:0/1046761406 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59d015d3b0 msgr2=0x7f59d00b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.673+0000 7f59cde00640 1 --2- 172.21.15.144:0/1046761406 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59d015d3b0 0x7f59d00b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.673+0000 7f59cde00640 1 -- 172.21.15.144:0/1046761406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59d00b4c50 msgr2=0x7f59d00b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.673+0000 7f59cde00640 1 --2- 172.21.15.144:0/1046761406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59d00b4c50 0x7f59d00b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.673+0000 7f59cde00640 1 -- 172.21.15.144:0/1046761406 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d00b03f0 con 0x7f59d00cd3b0 2024-09-11T23:25:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.673+0000 7f59cde00640 1 --2- 172.21.15.144:0/1046761406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d00cd3b0 0x7f59d0147eb0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f59c000c4d0 tx=0x7f59c000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.673+0000 7f59c6a00640 1 -- 172.21.15.144:0/1046761406 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0018070 con 0x7f59d00cd3b0 2024-09-11T23:25:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.673+0000 7f59c6a00640 1 -- 172.21.15.144:0/1046761406 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59c00074e0 con 0x7f59d00cd3b0 2024-09-11T23:25:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.673+0000 7f59c6a00640 1 -- 172.21.15.144:0/1046761406 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0004a20 con 0x7f59d00cd3b0 2024-09-11T23:25:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.673+0000 7f59d4c00640 1 -- 172.21.15.144:0/1046761406 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d00b27d0 con 0x7f59d00cd3b0 2024-09-11T23:25:15.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.673+0000 7f59d4c00640 1 -- 172.21.15.144:0/1046761406 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d00b2d90 con 0x7f59d00cd3b0 2024-09-11T23:25:15.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.675+0000 7f59d4c00640 1 -- 172.21.15.144:0/1046761406 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d006f240 con 0x7f59d00cd3b0 2024-09-11T23:25:15.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.675+0000 7f59c6a00640 1 -- 172.21.15.144:0/1046761406 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f59c0004bc0 con 0x7f59d00cd3b0 2024-09-11T23:25:15.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.676+0000 7f59c6a00640 1 --2- 172.21.15.144:0/1046761406 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f59ac06c460 0x7f59ac06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:15.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.676+0000 7f59c6a00640 1 -- 172.21.15.144:0/1046761406 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7f59c008ad90 con 0x7f59d00cd3b0 2024-09-11T23:25:15.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.677+0000 7f59c5400640 1 --2- 172.21.15.144:0/1046761406 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f59ac06c460 0x7f59ac06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:15.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.678+0000 7f59c5400640 1 --2- 172.21.15.144:0/1046761406 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f59ac06c460 0x7f59ac06e920 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f59b8034000 tx=0x7f59b802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:15.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.680+0000 7f59c6a00640 1 -- 172.21.15.144:0/1046761406 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59d00b03f0 con 0x7f59d00cd3b0 2024-09-11T23:25:15.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:15.894+0000 7f59d4c00640 1 -- 172.21.15.144:0/1046761406 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f59d006ef60 con 0x7f59d00cd3b0 2024-09-11T23:25:16.666 INFO:tasks.ceph.mds.a.smithi144.stderr:2024-09-11T23:25:16.666+0000 7fca6e200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:25:16.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.707+0000 7f59c6a00640 1 -- 172.21.15.144:0/1046761406 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v99) ==== 118+0+0 (secure 0 0 0) 0x7f59c0058e00 con 0x7f59d00cd3b0 2024-09-11T23:25:16.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.709+0000 7f59d4c00640 1 -- 172.21.15.144:0/1046761406 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f59ac06c460 msgr2=0x7f59ac06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:16.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.709+0000 7f59d4c00640 1 --2- 172.21.15.144:0/1046761406 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f59ac06c460 0x7f59ac06e920 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f59b8034000 tx=0x7f59b802e000 comp rx=0 tx=0).stop 2024-09-11T23:25:16.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.709+0000 7f59d4c00640 1 -- 172.21.15.144:0/1046761406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d00cd3b0 msgr2=0x7f59d0147eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:16.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.709+0000 7f59d4c00640 1 --2- 172.21.15.144:0/1046761406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d00cd3b0 0x7f59d0147eb0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f59c000c4d0 tx=0x7f59c000c990 comp rx=0 tx=0).stop 2024-09-11T23:25:16.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.710+0000 7f59d4c00640 1 -- 172.21.15.144:0/1046761406 shutdown_connections 2024-09-11T23:25:16.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.710+0000 7f59d4c00640 1 --2- 172.21.15.144:0/1046761406 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f59ac06c460 0x7f59ac06e920 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:16.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.710+0000 7f59d4c00640 1 --2- 172.21.15.144:0/1046761406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59d00b4c50 0x7f59d00b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:16.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.710+0000 7f59d4c00640 1 --2- 172.21.15.144:0/1046761406 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59d015d3b0 0x7f59d00b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:16.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.710+0000 7f59d4c00640 1 --2- 172.21.15.144:0/1046761406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59d00cd3b0 0x7f59d0147eb0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:16.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.710+0000 7f59d4c00640 1 -- 172.21.15.144:0/1046761406 >> 172.21.15.144:0/1046761406 conn(0x7f59d006bba0 msgr2=0x7f59d0071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:16.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.710+0000 7f59d4c00640 1 -- 172.21.15.144:0/1046761406 shutdown_connections 2024-09-11T23:25:16.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.710+0000 7f59d4c00640 1 -- 172.21.15.144:0/1046761406 wait complete. 2024-09-11T23:25:16.727 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:25:16.727 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:25:16.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.887+0000 7f1ece200640 1 Processor -- start 2024-09-11T23:25:16.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.887+0000 7f1ece200640 1 -- start start 2024-09-11T23:25:16.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.888+0000 7f1ece200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ec81416f0 0x7f1ec8162a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:16.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.888+0000 7f1ece200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1ec80ceb20 0x7f1ec8144580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:16.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.888+0000 7f1ece200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ec8142e30 con 0x7f1ec80ce6d0 2024-09-11T23:25:16.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.888+0000 7f1ece200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1ec80aea10 con 0x7f1ec81416f0 2024-09-11T23:25:16.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.888+0000 7f1ece200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1ec80aecf0 con 0x7f1ec80ceb20 2024-09-11T23:25:16.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.888+0000 7f1ec7400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ec81416f0 0x7f1ec8162a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:16.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.888+0000 7f1ebea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1ec80ce6d0 0x7f1ec8143e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33032/0 (socket says 172.21.15.144:33032) 2024-09-11T23:25:16.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.888+0000 7f1ebea00640 1 -- 172.21.15.144:0/4231798716 learned_addr learned my addr 172.21.15.144:0/4231798716 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:16.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.888+0000 7f1ec7400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1ec81416f0 0x7f1ec8162a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57408/0 (socket says 172.21.15.144:57408) 2024-09-11T23:25:16.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.889+0000 7f1ec7400640 1 -- 172.21.15.144:0/4231798716 >> v2:172.21.15.165:3300/0 conn(0x7f1ec80ceb20 msgr2=0x7f1ec8144580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:16.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.889+0000 7f1ec7400640 1 --2- 172.21.15.144:0/4231798716 >> v2:172.21.15.165:3300/0 conn(0x7f1ec80ceb20 0x7f1ec8144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:16.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.889+0000 7f1ec7400640 1 -- 172.21.15.144:0/4231798716 >> v1:172.21.15.144:6789/0 conn(0x7f1ec80ce6d0 legacy=0x7f1ec8143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:16.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.889+0000 7f1ec7400640 1 -- 172.21.15.144:0/4231798716 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec80aefd0 con 0x7f1ec81416f0 2024-09-11T23:25:16.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.889+0000 7f1ec6a00640 1 -- 172.21.15.144:0/4231798716 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3715911102 0 0) 0x7f1ec8142e30 con 0x7f1ec80ce6d0 2024-09-11T23:25:16.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.890+0000 7f1ec7400640 1 --2- 172.21.15.144:0/4231798716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ec81416f0 0x7f1ec8162a80 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f1ec80cdf50 tx=0x7f1eb802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a96731d4c66d2f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:16.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.890+0000 7f1ec6a00640 1 -- 172.21.15.144:0/4231798716 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8037070 con 0x7f1ec81416f0 2024-09-11T23:25:16.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.890+0000 7f1ec6a00640 1 -- 172.21.15.144:0/4231798716 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eb8032440 con 0x7f1ec81416f0 2024-09-11T23:25:16.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.890+0000 7f1ec6a00640 1 -- 172.21.15.144:0/4231798716 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb802ae60 con 0x7f1ec81416f0 2024-09-11T23:25:16.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.890+0000 7f1ece200640 1 -- 172.21.15.144:0/4231798716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ec81416f0 msgr2=0x7f1ec8162a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:16.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.890+0000 7f1ece200640 1 --2- 172.21.15.144:0/4231798716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ec81416f0 0x7f1ec8162a80 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f1ec80cdf50 tx=0x7f1eb802a110 comp rx=0 tx=0).stop 2024-09-11T23:25:16.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.891+0000 7f1ece200640 1 -- 172.21.15.144:0/4231798716 shutdown_connections 2024-09-11T23:25:16.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.891+0000 7f1ece200640 1 --2- 172.21.15.144:0/4231798716 >> v2:172.21.15.165:3300/0 conn(0x7f1ec80ceb20 0x7f1ec8144580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:16.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.891+0000 7f1ece200640 1 --2- 172.21.15.144:0/4231798716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ec81416f0 0x7f1ec8162a80 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:16.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.891+0000 7f1ece200640 1 -- 172.21.15.144:0/4231798716 >> 172.21.15.144:0/4231798716 conn(0x7f1ec8062c60 msgr2=0x7f1ec806bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:16.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.891+0000 7f1ece200640 1 -- 172.21.15.144:0/4231798716 shutdown_connections 2024-09-11T23:25:16.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.891+0000 7f1ece200640 1 -- 172.21.15.144:0/4231798716 wait complete. 2024-09-11T23:25:16.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.892+0000 7f1ece200640 1 Processor -- start 2024-09-11T23:25:16.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.892+0000 7f1ece200640 1 -- start start 2024-09-11T23:25:16.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.893+0000 7f1ece200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ec80ce6d0 0x7f1ec81404d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:16.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.893+0000 7f1ece200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ec80ceb20 0x7f1ec8157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:16.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.893+0000 7f1ece200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ec81416f0 0x7f1ec8154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:16.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.893+0000 7f1ece200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec8141ad0 con 0x7f1ec80ce6d0 2024-09-11T23:25:16.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.893+0000 7f1ece200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec80af590 con 0x7f1ec81416f0 2024-09-11T23:25:16.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.893+0000 7f1ece200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1ec80cef80 con 0x7f1ec80ceb20 2024-09-11T23:25:16.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.893+0000 7f1ec7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ec80ce6d0 0x7f1ec81404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:16.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.893+0000 7f1ec7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ec80ce6d0 0x7f1ec81404d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57418/0 (socket says 172.21.15.144:57418) 2024-09-11T23:25:16.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.893+0000 7f1ec7400640 1 -- 172.21.15.144:0/382300965 learned_addr learned my addr 172.21.15.144:0/382300965 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:16.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.894+0000 7f1ec7e00640 1 --2- 172.21.15.144:0/382300965 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ec81416f0 0x7f1ec8154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:16.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.894+0000 7f1ebea00640 1 --2- 172.21.15.144:0/382300965 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ec80ceb20 0x7f1ec8157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:16.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.894+0000 7f1ec7400640 1 -- 172.21.15.144:0/382300965 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ec80ceb20 msgr2=0x7f1ec8157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:16.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.894+0000 7f1ec7400640 1 --2- 172.21.15.144:0/382300965 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ec80ceb20 0x7f1ec8157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:16.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.894+0000 7f1ec7400640 1 -- 172.21.15.144:0/382300965 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ec81416f0 msgr2=0x7f1ec8154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:16.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.894+0000 7f1ec7400640 1 --2- 172.21.15.144:0/382300965 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ec81416f0 0x7f1ec8154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:16.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.894+0000 7f1ec7400640 1 -- 172.21.15.144:0/382300965 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec8156040 con 0x7f1ec80ce6d0 2024-09-11T23:25:16.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.894+0000 7f1ebea00640 1 --2- 172.21.15.144:0/382300965 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ec80ceb20 0x7f1ec8157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:16.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.894+0000 7f1ec7400640 1 --2- 172.21.15.144:0/382300965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ec80ce6d0 0x7f1ec81404d0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8035040 tx=0x7f1eb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:16.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.894+0000 7f1ebfe00640 1 -- 172.21.15.144:0/382300965 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8037040 con 0x7f1ec80ce6d0 2024-09-11T23:25:16.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.894+0000 7f1ebfe00640 1 -- 172.21.15.144:0/382300965 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eb8004230 con 0x7f1ec80ce6d0 2024-09-11T23:25:16.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.894+0000 7f1ebfe00640 1 -- 172.21.15.144:0/382300965 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8032e20 con 0x7f1ec80ce6d0 2024-09-11T23:25:16.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.894+0000 7f1ece200640 1 -- 172.21.15.144:0/382300965 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec8156320 con 0x7f1ec80ce6d0 2024-09-11T23:25:16.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.894+0000 7f1ece200640 1 -- 172.21.15.144:0/382300965 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec8156600 con 0x7f1ec80ce6d0 2024-09-11T23:25:16.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.895+0000 7f1ece200640 1 -- 172.21.15.144:0/382300965 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec80afab0 con 0x7f1ec80ce6d0 2024-09-11T23:25:16.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.896+0000 7f1ebfe00640 1 -- 172.21.15.144:0/382300965 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f1eb8030770 con 0x7f1ec80ce6d0 2024-09-11T23:25:16.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.898+0000 7f1ebfe00640 1 --2- 172.21.15.144:0/382300965 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ea406c460 0x7f1ea406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:16.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.898+0000 7f1ebfe00640 1 -- 172.21.15.144:0/382300965 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f1eb80accb0 con 0x7f1ec80ce6d0 2024-09-11T23:25:16.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.898+0000 7f1ebea00640 1 --2- 172.21.15.144:0/382300965 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ea406c460 0x7f1ea406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:16.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.899+0000 7f1ebea00640 1 --2- 172.21.15.144:0/382300965 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ea406c460 0x7f1ea406e920 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8154880 tx=0x7f1eb0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:16.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:16.902+0000 7f1ebfe00640 1 -- 172.21.15.144:0/382300965 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1eb807ae90 con 0x7f1ec80ce6d0 2024-09-11T23:25:17.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.111+0000 7f1ece200640 1 -- 172.21.15.144:0/382300965 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f1ec80b14c0 con 0x7f1ec80ce6d0 2024-09-11T23:25:17.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.713+0000 7f1ebfe00640 1 -- 172.21.15.144:0/382300965 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v100) ==== 122+0+0 (secure 0 0 0) 0x7f1eb807a790 con 0x7f1ec80ce6d0 2024-09-11T23:25:17.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.715+0000 7f1ece200640 1 -- 172.21.15.144:0/382300965 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ea406c460 msgr2=0x7f1ea406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:17.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.715+0000 7f1ece200640 1 --2- 172.21.15.144:0/382300965 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ea406c460 0x7f1ea406e920 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8154880 tx=0x7f1eb0009040 comp rx=0 tx=0).stop 2024-09-11T23:25:17.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.715+0000 7f1ece200640 1 -- 172.21.15.144:0/382300965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ec80ce6d0 msgr2=0x7f1ec81404d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:17.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.715+0000 7f1ece200640 1 --2- 172.21.15.144:0/382300965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ec80ce6d0 0x7f1ec81404d0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8035040 tx=0x7f1eb80046c0 comp rx=0 tx=0).stop 2024-09-11T23:25:17.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.715+0000 7f1ece200640 1 -- 172.21.15.144:0/382300965 shutdown_connections 2024-09-11T23:25:17.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.715+0000 7f1ece200640 1 --2- 172.21.15.144:0/382300965 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ea406c460 0x7f1ea406e920 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:17.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.715+0000 7f1ece200640 1 --2- 172.21.15.144:0/382300965 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ec81416f0 0x7f1ec8154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:17.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.715+0000 7f1ece200640 1 --2- 172.21.15.144:0/382300965 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1ec80ceb20 0x7f1ec8157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:17.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.715+0000 7f1ece200640 1 --2- 172.21.15.144:0/382300965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ec80ce6d0 0x7f1ec81404d0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:17.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.715+0000 7f1ece200640 1 -- 172.21.15.144:0/382300965 >> 172.21.15.144:0/382300965 conn(0x7f1ec8062c60 msgr2=0x7f1ec80b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:17.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.715+0000 7f1ece200640 1 -- 172.21.15.144:0/382300965 shutdown_connections 2024-09-11T23:25:17.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.715+0000 7f1ece200640 1 -- 172.21.15.144:0/382300965 wait complete. 2024-09-11T23:25:17.733 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:25:17.733 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:25:17.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.887+0000 7f97d2e00640 1 Processor -- start 2024-09-11T23:25:17.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.887+0000 7f97d2e00640 1 -- start start 2024-09-11T23:25:17.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.888+0000 7f97d2e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f97cc0cf070 0x7f97cc0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:17.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.888+0000 7f97d2e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97cc073120 0x7f97cc0735b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:17.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.888+0000 7f97d2e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97cc0ce740 con 0x7f97cc15c180 2024-09-11T23:25:17.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.888+0000 7f97d2e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f97cc072640 con 0x7f97cc0cf070 2024-09-11T23:25:17.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.888+0000 7f97d2e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f97cc072920 con 0x7f97cc073120 2024-09-11T23:25:17.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.889+0000 7f97cbe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f97cc15c180 0x7f97cc0cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33034/0 (socket says 172.21.15.144:33034) 2024-09-11T23:25:17.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.889+0000 7f97cbe00640 1 -- 172.21.15.144:0/3758480156 learned_addr learned my addr 172.21.15.144:0/3758480156 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:17.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.889+0000 7f97cb400640 1 --2- 172.21.15.144:0/3758480156 >> v2:172.21.15.165:3300/0 conn(0x7f97cc0cf070 0x7f97cc0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:17.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.889+0000 7f97caa00640 1 -- 172.21.15.144:0/3758480156 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1504595707 0 0) 0x7f97cc0ce740 con 0x7f97cc15c180 2024-09-11T23:25:17.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.889+0000 7f97d0e00640 1 --2- 172.21.15.144:0/3758480156 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97cc073120 0x7f97cc0735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:17.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.889+0000 7f97caa00640 1 -- 172.21.15.144:0/3758480156 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97b0003520 con 0x7f97cc15c180 2024-09-11T23:25:17.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.889+0000 7f97caa00640 1 -- 172.21.15.144:0/3758480156 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3848129084 0 0) 0x7f97b0003520 con 0x7f97cc15c180 2024-09-11T23:25:17.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.889+0000 7f97caa00640 1 -- 172.21.15.144:0/3758480156 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97cc073120 msgr2=0x7f97cc0735b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:17.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.889+0000 7f97caa00640 1 --2- 172.21.15.144:0/3758480156 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97cc073120 0x7f97cc0735b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:17.891 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.889+0000 7f97caa00640 1 -- 172.21.15.144:0/3758480156 >> v2:172.21.15.165:3300/0 conn(0x7f97cc0cf070 msgr2=0x7f97cc0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:17.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.889+0000 7f97caa00640 1 --2- 172.21.15.144:0/3758480156 >> v2:172.21.15.165:3300/0 conn(0x7f97cc0cf070 0x7f97cc0cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:17.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.889+0000 7f97caa00640 1 -- 172.21.15.144:0/3758480156 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97cc072c00 con 0x7f97cc15c180 2024-09-11T23:25:17.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.890+0000 7f97caa00640 1 -- 172.21.15.144:0/3758480156 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f97bc001690 con 0x7f97cc15c180 2024-09-11T23:25:17.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.890+0000 7f97caa00640 1 -- 172.21.15.144:0/3758480156 >> v1:172.21.15.144:6789/0 conn(0x7f97cc15c180 legacy=0x7f97cc0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:17.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.890+0000 7f97caa00640 1 --2- 172.21.15.144:0/3758480156 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97cc073120 0x7f97b00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:17.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.890+0000 7f97caa00640 1 --2- 172.21.15.144:0/3758480156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97b0003f80 0x7f97b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:17.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.890+0000 7f97caa00640 1 --2- 172.21.15.144:0/3758480156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0004d40 0x7f97b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:17.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.890+0000 7f97caa00640 1 -- 172.21.15.144:0/3758480156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc072640 con 0x7f97b0004d40 2024-09-11T23:25:17.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.890+0000 7f97caa00640 1 -- 172.21.15.144:0/3758480156 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc072920 con 0x7f97b0003f80 2024-09-11T23:25:17.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.890+0000 7f97caa00640 1 -- 172.21.15.144:0/3758480156 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f97b000ba70 con 0x7f97cc073120 2024-09-11T23:25:17.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.890+0000 7f97d0e00640 1 --2- 172.21.15.144:0/3758480156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0004d40 0x7f97b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:17.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.890+0000 7f97cb400640 1 --2- 172.21.15.144:0/3758480156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97b0003f80 0x7f97b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:17.892 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.890+0000 7f97cbe00640 1 --2- 172.21.15.144:0/3758480156 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97cc073120 0x7f97b00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:17.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.890+0000 7f97d0e00640 1 -- 172.21.15.144:0/3758480156 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97cc073120 msgr2=0x7f97b00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:17.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.890+0000 7f97d0e00640 1 --2- 172.21.15.144:0/3758480156 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97cc073120 0x7f97b00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:17.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.890+0000 7f97d0e00640 1 -- 172.21.15.144:0/3758480156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97b0003f80 msgr2=0x7f97b0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:17.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.890+0000 7f97d0e00640 1 --2- 172.21.15.144:0/3758480156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97b0003f80 0x7f97b0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:17.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.890+0000 7f97d0e00640 1 -- 172.21.15.144:0/3758480156 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b0003520 con 0x7f97b0004d40 2024-09-11T23:25:17.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.891+0000 7f97d0e00640 1 --2- 172.21.15.144:0/3758480156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0004d40 0x7f97b00051c0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009fc0 tx=0x7f97b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2bbc1b59e6999ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:17.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.892+0000 7f97caa00640 1 -- 172.21.15.144:0/3758480156 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c4009c10 con 0x7f97b0004d40 2024-09-11T23:25:17.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.892+0000 7f97caa00640 1 -- 172.21.15.144:0/3758480156 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97c4036070 con 0x7f97b0004d40 2024-09-11T23:25:17.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.892+0000 7f97caa00640 1 -- 172.21.15.144:0/3758480156 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c4031880 con 0x7f97b0004d40 2024-09-11T23:25:17.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.892+0000 7f97d2e00640 1 -- 172.21.15.144:0/3758480156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0004d40 msgr2=0x7f97b00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:17.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.892+0000 7f97d2e00640 1 --2- 172.21.15.144:0/3758480156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0004d40 0x7f97b00051c0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009fc0 tx=0x7f97b0005830 comp rx=0 tx=0).stop 2024-09-11T23:25:17.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.892+0000 7f97d0e00640 1 -- 172.21.15.144:0/3758480156 reap_dead start 2024-09-11T23:25:17.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.892+0000 7f97d2e00640 1 -- 172.21.15.144:0/3758480156 shutdown_connections 2024-09-11T23:25:17.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.892+0000 7f97d2e00640 1 -- 172.21.15.144:0/3758480156 >> 172.21.15.144:0/3758480156 conn(0x7f97cc062cc0 msgr2=0x7f97cc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:17.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.892+0000 7f97d2e00640 1 -- 172.21.15.144:0/3758480156 shutdown_connections 2024-09-11T23:25:17.896 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.892+0000 7f97d2e00640 1 -- 172.21.15.144:0/3758480156 wait complete. 2024-09-11T23:25:17.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.894+0000 7f97d2e00640 1 Processor -- start 2024-09-11T23:25:17.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.894+0000 7f97d2e00640 1 -- start start 2024-09-11T23:25:17.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.895+0000 7f97d2e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0004d40 0x7f97cc1514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:17.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.895+0000 7f97d2e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97cc15b3b0 0x7f97cc150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:17.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.895+0000 7f97d2e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97cc1586e0 0x7f97cc158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:17.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.895+0000 7f97d2e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc0722f0 con 0x7f97b0004d40 2024-09-11T23:25:17.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.895+0000 7f97d2e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc0ced00 con 0x7f97cc1586e0 2024-09-11T23:25:17.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.895+0000 7f97d2e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f97cc15c560 con 0x7f97cc15b3b0 2024-09-11T23:25:17.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.895+0000 7f97cbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0004d40 0x7f97cc1514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:17.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.895+0000 7f97cbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0004d40 0x7f97cc1514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57426/0 (socket says 172.21.15.144:57426) 2024-09-11T23:25:17.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.895+0000 7f97cbe00640 1 -- 172.21.15.144:0/2268393452 learned_addr learned my addr 172.21.15.144:0/2268393452 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:17.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.895+0000 7f97d0e00640 1 --2- 172.21.15.144:0/2268393452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97cc1586e0 0x7f97cc158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:17.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.895+0000 7f97cb400640 1 --2- 172.21.15.144:0/2268393452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97cc15b3b0 0x7f97cc150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:17.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.895+0000 7f97cbe00640 1 -- 172.21.15.144:0/2268393452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97cc15b3b0 msgr2=0x7f97cc150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:17.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.895+0000 7f97cbe00640 1 --2- 172.21.15.144:0/2268393452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97cc15b3b0 0x7f97cc150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:17.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.895+0000 7f97cbe00640 1 -- 172.21.15.144:0/2268393452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97cc1586e0 msgr2=0x7f97cc158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:17.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.895+0000 7f97cbe00640 1 --2- 172.21.15.144:0/2268393452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97cc1586e0 0x7f97cc158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:17.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.895+0000 7f97cbe00640 1 -- 172.21.15.144:0/2268393452 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97cc151c50 con 0x7f97b0004d40 2024-09-11T23:25:17.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.895+0000 7f97cb400640 1 --2- 172.21.15.144:0/2268393452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97cc15b3b0 0x7f97cc150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:17.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.896+0000 7f97cbe00640 1 --2- 172.21.15.144:0/2268393452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0004d40 0x7f97cc1514b0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f97bc007340 tx=0x7f97bc007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:17.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.896+0000 7f97c3e00640 1 -- 172.21.15.144:0/2268393452 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc00f860 con 0x7f97b0004d40 2024-09-11T23:25:17.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.896+0000 7f97c3e00640 1 -- 172.21.15.144:0/2268393452 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97bc018070 con 0x7f97b0004d40 2024-09-11T23:25:17.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.896+0000 7f97d2e00640 1 -- 172.21.15.144:0/2268393452 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97cc151f30 con 0x7f97b0004d40 2024-09-11T23:25:17.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.896+0000 7f97c3e00640 1 -- 172.21.15.144:0/2268393452 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc00fc60 con 0x7f97b0004d40 2024-09-11T23:25:17.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.896+0000 7f97d2e00640 1 -- 172.21.15.144:0/2268393452 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97cc1524f0 con 0x7f97b0004d40 2024-09-11T23:25:17.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.897+0000 7f97d2e00640 1 -- 172.21.15.144:0/2268393452 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97cc0cf4e0 con 0x7f97b0004d40 2024-09-11T23:25:17.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.898+0000 7f97c3e00640 1 -- 172.21.15.144:0/2268393452 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f97bc01d460 con 0x7f97b0004d40 2024-09-11T23:25:17.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.899+0000 7f97c3e00640 1 --2- 172.21.15.144:0/2268393452 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f97ac06c490 0x7f97ac06e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:17.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.900+0000 7f97c3e00640 1 -- 172.21.15.144:0/2268393452 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f97bc08bb10 con 0x7f97b0004d40 2024-09-11T23:25:17.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.900+0000 7f97cb400640 1 --2- 172.21.15.144:0/2268393452 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f97ac06c490 0x7f97ac06e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:17.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.900+0000 7f97cb400640 1 --2- 172.21.15.144:0/2268393452 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f97ac06c490 0x7f97ac06e950 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f97cc150cb0 tx=0x7f97b8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:17.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:17.904+0000 7f97c3e00640 1 -- 172.21.15.144:0/2268393452 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f97bc059b40 con 0x7f97b0004d40 2024-09-11T23:25:18.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.109+0000 7f97d2e00640 1 -- 172.21.15.144:0/2268393452 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97cc0d0660 con 0x7f97b0004d40 2024-09-11T23:25:18.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.110+0000 7f97c3e00640 1 -- 172.21.15.144:0/2268393452 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5241 (secure 0 0 0) 0x7f97bc059440 con 0x7f97b0004d40 2024-09-11T23:25:18.110 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:18.110 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":100,"btime":"2024-09-11T23:25:17:708642+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6893,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2346696977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2346696977},{"type":"v1","addr":"172.21.15.165:6834","nonce":2346696977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3411942787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3411942787},{"type":"v1","addr":"172.21.15.165:6835","nonce":3411942787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/1554186582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1554186582},{"type":"v1","addr":"172.21.15.144:6801","nonce":1554186582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:25:14.094581+0000","modified":"2024-09-11T23:25:17.112238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"a","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1597149290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1597149290},{"type":"v1","addr":"172.21.15.144:6835","nonce":1597149290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8244,"qdb_cluster":[8244]},"id":11}]} 2024-09-11T23:25:18.110 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 100 2024-09-11T23:25:18.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.112+0000 7f97d2e00640 1 -- 172.21.15.144:0/2268393452 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f97ac06c490 msgr2=0x7f97ac06e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:18.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.112+0000 7f97d2e00640 1 --2- 172.21.15.144:0/2268393452 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f97ac06c490 0x7f97ac06e950 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f97cc150cb0 tx=0x7f97b8008040 comp rx=0 tx=0).stop 2024-09-11T23:25:18.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.112+0000 7f97d2e00640 1 -- 172.21.15.144:0/2268393452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0004d40 msgr2=0x7f97cc1514b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:18.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.112+0000 7f97d2e00640 1 --2- 172.21.15.144:0/2268393452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0004d40 0x7f97cc1514b0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f97bc007340 tx=0x7f97bc007800 comp rx=0 tx=0).stop 2024-09-11T23:25:18.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.112+0000 7f97d2e00640 1 -- 172.21.15.144:0/2268393452 shutdown_connections 2024-09-11T23:25:18.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.112+0000 7f97d2e00640 1 --2- 172.21.15.144:0/2268393452 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f97ac06c490 0x7f97ac06e950 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.112+0000 7f97d2e00640 1 --2- 172.21.15.144:0/2268393452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97cc1586e0 0x7f97cc158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.112+0000 7f97d2e00640 1 --2- 172.21.15.144:0/2268393452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f97cc15b3b0 0x7f97cc150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.112+0000 7f97d2e00640 1 --2- 172.21.15.144:0/2268393452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97b0004d40 0x7f97cc1514b0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.112+0000 7f97d2e00640 1 -- 172.21.15.144:0/2268393452 >> 172.21.15.144:0/2268393452 conn(0x7f97cc062cc0 msgr2=0x7f97cc0b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:18.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.113+0000 7f97d2e00640 1 -- 172.21.15.144:0/2268393452 shutdown_connections 2024-09-11T23:25:18.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.113+0000 7f97d2e00640 1 -- 172.21.15.144:0/2268393452 wait complete. 2024-09-11T23:25:18.129 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:25:18.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.281+0000 7fcd21a00640 1 Processor -- start 2024-09-11T23:25:18.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.282+0000 7fcd21a00640 1 -- start start 2024-09-11T23:25:18.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.283+0000 7fcd21a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fcd1c15a0a0 0x7fcd1c073180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:18.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.283+0000 7fcd21a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd1c0ceb90 0x7fcd1c0b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:18.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.283+0000 7fcd21a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd1c072100 con 0x7fcd1c0736c0 2024-09-11T23:25:18.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.283+0000 7fcd21a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fcd1c0723c0 con 0x7fcd1c0ceb90 2024-09-11T23:25:18.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.283+0000 7fcd21a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fcd1c0726a0 con 0x7fcd1c15a0a0 2024-09-11T23:25:18.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.283+0000 7fcd21000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd1c0ceb90 0x7fcd1c0b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:18.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.283+0000 7fcd21000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd1c0ceb90 0x7fcd1c0b1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57434/0 (socket says 172.21.15.144:57434) 2024-09-11T23:25:18.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.283+0000 7fcd21000640 1 -- 172.21.15.144:0/3220709470 learned_addr learned my addr 172.21.15.144:0/3220709470 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:18.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.284+0000 7fcd1be00640 1 --2- 172.21.15.144:0/3220709470 >> v2:172.21.15.165:3300/0 conn(0x7fcd1c15a0a0 0x7fcd1c073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:18.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.284+0000 7fcd21000640 1 -- 172.21.15.144:0/3220709470 >> v2:172.21.15.165:3300/0 conn(0x7fcd1c15a0a0 msgr2=0x7fcd1c073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:18.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.284+0000 7fcd21000640 1 --2- 172.21.15.144:0/3220709470 >> v2:172.21.15.165:3300/0 conn(0x7fcd1c15a0a0 0x7fcd1c073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.284+0000 7fcd21000640 1 -- 172.21.15.144:0/3220709470 >> v1:172.21.15.165:6789/0 conn(0x7fcd1c0736c0 legacy=0x7fcd1c0ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:18.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.284+0000 7fcd21000640 1 -- 172.21.15.144:0/3220709470 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1c072980 con 0x7fcd1c0ceb90 2024-09-11T23:25:18.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.285+0000 7fcd21000640 1 --2- 172.21.15.144:0/3220709470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1c0ceb90 0x7fcd1c0b1dc0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c0d1160 tx=0x7fcd1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b747cfd8ba444c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:18.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.285+0000 7fcd1aa00640 1 -- 172.21.15.144:0/3220709470 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd14037070 con 0x7fcd1c0ceb90 2024-09-11T23:25:18.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.285+0000 7fcd1aa00640 1 -- 172.21.15.144:0/3220709470 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd14032440 con 0x7fcd1c0ceb90 2024-09-11T23:25:18.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.285+0000 7fcd1aa00640 1 -- 172.21.15.144:0/3220709470 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd14032810 con 0x7fcd1c0ceb90 2024-09-11T23:25:18.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.286+0000 7fcd21a00640 1 -- 172.21.15.144:0/3220709470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1c0ceb90 msgr2=0x7fcd1c0b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:18.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.286+0000 7fcd21a00640 1 --2- 172.21.15.144:0/3220709470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1c0ceb90 0x7fcd1c0b1dc0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c0d1160 tx=0x7fcd1402a270 comp rx=0 tx=0).stop 2024-09-11T23:25:18.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.286+0000 7fcd21a00640 1 -- 172.21.15.144:0/3220709470 shutdown_connections 2024-09-11T23:25:18.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.286+0000 7fcd21a00640 1 --2- 172.21.15.144:0/3220709470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1c0ceb90 0x7fcd1c0b1dc0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.286+0000 7fcd21a00640 1 --2- 172.21.15.144:0/3220709470 >> v2:172.21.15.165:3300/0 conn(0x7fcd1c15a0a0 0x7fcd1c073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.286+0000 7fcd21a00640 1 -- 172.21.15.144:0/3220709470 >> 172.21.15.144:0/3220709470 conn(0x7fcd1c06e910 msgr2=0x7fcd1c06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:18.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.286+0000 7fcd21a00640 1 -- 172.21.15.144:0/3220709470 shutdown_connections 2024-09-11T23:25:18.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.286+0000 7fcd21a00640 1 -- 172.21.15.144:0/3220709470 wait complete. 2024-09-11T23:25:18.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.287+0000 7fcd21a00640 1 Processor -- start 2024-09-11T23:25:18.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.288+0000 7fcd21a00640 1 -- start start 2024-09-11T23:25:18.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.288+0000 7fcd21a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd1c0ceb90 0x7fcd1c150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:18.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.288+0000 7fcd21a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1c15a0a0 0x7fcd1c1f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:18.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.288+0000 7fcd21a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd1c1f2510 0x7fcd1c1531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:18.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.288+0000 7fcd21a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c0b26d0 con 0x7fcd1c15a0a0 2024-09-11T23:25:18.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.288+0000 7fcd21a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c0b2550 con 0x7fcd1c1f2510 2024-09-11T23:25:18.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.288+0000 7fcd21a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcd1c0cf240 con 0x7fcd1c0ceb90 2024-09-11T23:25:18.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.289+0000 7fcd1b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1c15a0a0 0x7fcd1c1f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:18.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.289+0000 7fcd1b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1c15a0a0 0x7fcd1c1f1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57438/0 (socket says 172.21.15.144:57438) 2024-09-11T23:25:18.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.289+0000 7fcd1b400640 1 -- 172.21.15.144:0/517135521 learned_addr learned my addr 172.21.15.144:0/517135521 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:18.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.289+0000 7fcd21000640 1 --2- 172.21.15.144:0/517135521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd1c1f2510 0x7fcd1c1531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:18.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.289+0000 7fcd1be00640 1 --2- 172.21.15.144:0/517135521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd1c0ceb90 0x7fcd1c150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:18.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.289+0000 7fcd1b400640 1 -- 172.21.15.144:0/517135521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd1c0ceb90 msgr2=0x7fcd1c150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:18.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.289+0000 7fcd1b400640 1 --2- 172.21.15.144:0/517135521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd1c0ceb90 0x7fcd1c150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.289+0000 7fcd1b400640 1 -- 172.21.15.144:0/517135521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd1c1f2510 msgr2=0x7fcd1c1531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:18.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.289+0000 7fcd1b400640 1 --2- 172.21.15.144:0/517135521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd1c1f2510 0x7fcd1c1531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.289+0000 7fcd1b400640 1 -- 172.21.15.144:0/517135521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1c152430 con 0x7fcd1c15a0a0 2024-09-11T23:25:18.290 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.289+0000 7fcd1b400640 1 --2- 172.21.15.144:0/517135521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1c15a0a0 0x7fcd1c1f1fd0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fcd0800c400 tx=0x7fcd0800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.290+0000 7fcd13e00640 1 -- 172.21.15.144:0/517135521 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd080052d0 con 0x7fcd1c15a0a0 2024-09-11T23:25:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.290+0000 7fcd13e00640 1 -- 172.21.15.144:0/517135521 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd08005490 con 0x7fcd1c15a0a0 2024-09-11T23:25:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.290+0000 7fcd13e00640 1 -- 172.21.15.144:0/517135521 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08007260 con 0x7fcd1c15a0a0 2024-09-11T23:25:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.290+0000 7fcd21a00640 1 -- 172.21.15.144:0/517135521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd1c152710 con 0x7fcd1c15a0a0 2024-09-11T23:25:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.290+0000 7fcd21a00640 1 -- 172.21.15.144:0/517135521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd1c152cd0 con 0x7fcd1c15a0a0 2024-09-11T23:25:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.291+0000 7fcd21a00640 1 -- 172.21.15.144:0/517135521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd1c0b1dc0 con 0x7fcd1c15a0a0 2024-09-11T23:25:18.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.292+0000 7fcd13e00640 1 -- 172.21.15.144:0/517135521 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7fcd08007400 con 0x7fcd1c15a0a0 2024-09-11T23:25:18.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.293+0000 7fcd13e00640 1 --2- 172.21.15.144:0/517135521 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fccfc06c460 0x7fccfc06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:18.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.293+0000 7fcd13e00640 1 -- 172.21.15.144:0/517135521 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fcd0808aea0 con 0x7fcd1c15a0a0 2024-09-11T23:25:18.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.293+0000 7fcd1be00640 1 --2- 172.21.15.144:0/517135521 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fccfc06c460 0x7fccfc06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:18.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.294+0000 7fcd1be00640 1 --2- 172.21.15.144:0/517135521 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fccfc06c460 0x7fccfc06e920 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c0cc520 tx=0x7fcd0c00b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:18.296 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.297+0000 7fcd13e00640 1 -- 172.21.15.144:0/517135521 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcd08058880 con 0x7fcd1c15a0a0 2024-09-11T23:25:18.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.471+0000 7fcd21a00640 1 -- 172.21.15.144:0/517135521 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd1c0cf020 con 0x7fcd1c15a0a0 2024-09-11T23:25:18.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.472+0000 7fcd13e00640 1 -- 172.21.15.144:0/517135521 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) ==== 74+0+16755 (secure 0 0 0) 0x7fcd0805cb80 con 0x7fcd1c15a0a0 2024-09-11T23:25:18.472 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:18.473 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":142,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:25:15.695849+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:25:11.862995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-11T23:25:13.101996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:25:18.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.474+0000 7fcd21a00640 1 -- 172.21.15.144:0/517135521 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fccfc06c460 msgr2=0x7fccfc06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:18.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.474+0000 7fcd21a00640 1 --2- 172.21.15.144:0/517135521 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fccfc06c460 0x7fccfc06e920 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c0cc520 tx=0x7fcd0c00b040 comp rx=0 tx=0).stop 2024-09-11T23:25:18.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.474+0000 7fcd21a00640 1 -- 172.21.15.144:0/517135521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1c15a0a0 msgr2=0x7fcd1c1f1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:18.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.474+0000 7fcd21a00640 1 --2- 172.21.15.144:0/517135521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1c15a0a0 0x7fcd1c1f1fd0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fcd0800c400 tx=0x7fcd0800c8c0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.474+0000 7fcd21a00640 1 -- 172.21.15.144:0/517135521 shutdown_connections 2024-09-11T23:25:18.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.474+0000 7fcd21a00640 1 --2- 172.21.15.144:0/517135521 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fccfc06c460 0x7fccfc06e920 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.474+0000 7fcd21a00640 1 --2- 172.21.15.144:0/517135521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd1c1f2510 0x7fcd1c1531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.474+0000 7fcd21a00640 1 --2- 172.21.15.144:0/517135521 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd1c15a0a0 0x7fcd1c1f1fd0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.474+0000 7fcd21a00640 1 --2- 172.21.15.144:0/517135521 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd1c0ceb90 0x7fcd1c150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.475+0000 7fcd21a00640 1 -- 172.21.15.144:0/517135521 >> 172.21.15.144:0/517135521 conn(0x7fcd1c06e910 msgr2=0x7fcd1c0ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:18.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.475+0000 7fcd21a00640 1 -- 172.21.15.144:0/517135521 shutdown_connections 2024-09-11T23:25:18.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.475+0000 7fcd21a00640 1 -- 172.21.15.144:0/517135521 wait complete. 2024-09-11T23:25:18.491 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:25:18.491 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:25:18.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.644+0000 7fab2ae00640 1 Processor -- start 2024-09-11T23:25:18.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.644+0000 7fab2ae00640 1 -- start start 2024-09-11T23:25:18.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.645+0000 7fab2ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab2415ca40 0x7fab2415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:18.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.645+0000 7fab2ae00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab2415d390 con 0x7fab2415ce80 2024-09-11T23:25:18.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.645+0000 7fab2ae00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab2415d670 con 0x7fab240d02a0 2024-09-11T23:25:18.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.645+0000 7fab2ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fab2415d950 con 0x7fab2415ca40 2024-09-11T23:25:18.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.646+0000 7fab28e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fab2415ce80 0x7fab241594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33038/0 (socket says 172.21.15.144:33038) 2024-09-11T23:25:18.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.646+0000 7fab28e00640 1 -- 172.21.15.144:0/1610412119 learned_addr learned my addr 172.21.15.144:0/1610412119 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:18.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.646+0000 7fab23400640 1 --2- 172.21.15.144:0/1610412119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab2415ca40 0x7fab2415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:18.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.646+0000 7fab22a00640 1 -- 172.21.15.144:0/1610412119 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1708158284 0 0) 0x7fab2415d390 con 0x7fab2415ce80 2024-09-11T23:25:18.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.646+0000 7fab22a00640 1 -- 172.21.15.144:0/1610412119 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab08003520 con 0x7fab2415ce80 2024-09-11T23:25:18.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.646+0000 7fab22a00640 1 -- 172.21.15.144:0/1610412119 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3607437882 0 0) 0x7fab2415d670 con 0x7fab240d02a0 2024-09-11T23:25:18.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.646+0000 7fab22a00640 1 -- 172.21.15.144:0/1610412119 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab2415d390 con 0x7fab240d02a0 2024-09-11T23:25:18.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.646+0000 7fab23400640 1 -- 172.21.15.144:0/1610412119 >> v1:172.21.15.165:6789/0 conn(0x7fab240d02a0 legacy=0x7fab240d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:18.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.646+0000 7fab22a00640 1 -- 172.21.15.144:0/1610412119 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 83257770 0 0) 0x7fab08003520 con 0x7fab2415ce80 2024-09-11T23:25:18.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.646+0000 7fab23400640 1 -- 172.21.15.144:0/1610412119 >> v1:172.21.15.144:6789/0 conn(0x7fab2415ce80 legacy=0x7fab241594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:18.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.646+0000 7fab23400640 1 -- 172.21.15.144:0/1610412119 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab2415dc30 con 0x7fab2415ca40 2024-09-11T23:25:18.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.647+0000 7fab23400640 1 --2- 172.21.15.144:0/1610412119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab2415ca40 0x7fab2415e430 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fab100097d0 tx=0x7fab1002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b337636b260bba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:18.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.648+0000 7fab22a00640 1 -- 172.21.15.144:0/1610412119 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab10037070 con 0x7fab2415ca40 2024-09-11T23:25:18.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.648+0000 7fab22a00640 1 -- 172.21.15.144:0/1610412119 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab1002ab90 con 0x7fab2415ca40 2024-09-11T23:25:18.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.648+0000 7fab22a00640 1 -- 172.21.15.144:0/1610412119 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1c0019f0 con 0x7fab2415ca40 2024-09-11T23:25:18.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.648+0000 7fab2ae00640 1 -- 172.21.15.144:0/1610412119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab2415ca40 msgr2=0x7fab2415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.648+0000 7fab2ae00640 1 --2- 172.21.15.144:0/1610412119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab2415ca40 0x7fab2415e430 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fab100097d0 tx=0x7fab1002a100 comp rx=0 tx=0).stop 2024-09-11T23:25:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.649+0000 7fab2ae00640 1 -- 172.21.15.144:0/1610412119 shutdown_connections 2024-09-11T23:25:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.649+0000 7fab2ae00640 1 --2- 172.21.15.144:0/1610412119 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab2415ca40 0x7fab2415e430 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.649+0000 7fab2ae00640 1 -- 172.21.15.144:0/1610412119 >> 172.21.15.144:0/1610412119 conn(0x7fab24062cc0 msgr2=0x7fab2406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.649+0000 7fab2ae00640 1 -- 172.21.15.144:0/1610412119 shutdown_connections 2024-09-11T23:25:18.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.649+0000 7fab2ae00640 1 -- 172.21.15.144:0/1610412119 wait complete. 2024-09-11T23:25:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.650+0000 7fab2ae00640 1 Processor -- start 2024-09-11T23:25:18.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.650+0000 7fab2ae00640 1 -- start start 2024-09-11T23:25:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.651+0000 7fab2ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab240d02a0 0x7fab241f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.651+0000 7fab2ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab2415ca40 0x7fab241f1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.651+0000 7fab2ae00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab2415ce80 0x7fab24157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.651+0000 7fab2ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fab24155d10 con 0x7fab2415ca40 2024-09-11T23:25:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.651+0000 7fab2ae00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fab24155b90 con 0x7fab2415ce80 2024-09-11T23:25:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.651+0000 7fab2ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fab240b4790 con 0x7fab240d02a0 2024-09-11T23:25:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.651+0000 7fab23400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab2415ca40 0x7fab241f1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.652+0000 7fab23400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab2415ca40 0x7fab241f1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57452/0 (socket says 172.21.15.144:57452) 2024-09-11T23:25:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.652+0000 7fab23400640 1 -- 172.21.15.144:0/3194871499 learned_addr learned my addr 172.21.15.144:0/3194871499 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.652+0000 7fab23e00640 1 --2- 172.21.15.144:0/3194871499 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab240d02a0 0x7fab241f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.652+0000 7fab28e00640 1 --2- 172.21.15.144:0/3194871499 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab2415ce80 0x7fab24157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:18.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.652+0000 7fab23400640 1 -- 172.21.15.144:0/3194871499 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab240d02a0 msgr2=0x7fab241f3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:18.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.652+0000 7fab23400640 1 --2- 172.21.15.144:0/3194871499 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab240d02a0 0x7fab241f3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.652+0000 7fab23400640 1 -- 172.21.15.144:0/3194871499 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab2415ce80 msgr2=0x7fab24157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:18.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.652+0000 7fab23400640 1 --2- 172.21.15.144:0/3194871499 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab2415ce80 0x7fab24157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.652+0000 7fab23400640 1 -- 172.21.15.144:0/3194871499 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab241f2050 con 0x7fab2415ca40 2024-09-11T23:25:18.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.652+0000 7fab23400640 1 --2- 172.21.15.144:0/3194871499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab2415ca40 0x7fab241f1b10 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fab10035040 tx=0x7fab100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:18.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.652+0000 7fab1be00640 1 -- 172.21.15.144:0/3194871499 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab10041020 con 0x7fab2415ca40 2024-09-11T23:25:18.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.653+0000 7fab1be00640 1 -- 172.21.15.144:0/3194871499 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab1003d640 con 0x7fab2415ca40 2024-09-11T23:25:18.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.653+0000 7fab1be00640 1 -- 172.21.15.144:0/3194871499 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab10037040 con 0x7fab2415ca40 2024-09-11T23:25:18.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.653+0000 7fab2ae00640 1 -- 172.21.15.144:0/3194871499 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab24071110 con 0x7fab2415ca40 2024-09-11T23:25:18.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.653+0000 7fab2ae00640 1 -- 172.21.15.144:0/3194871499 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab240716d0 con 0x7fab2415ca40 2024-09-11T23:25:18.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.654+0000 7fab2ae00640 1 -- 172.21.15.144:0/3194871499 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab240b53a0 con 0x7fab2415ca40 2024-09-11T23:25:18.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.655+0000 7fab1be00640 1 -- 172.21.15.144:0/3194871499 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7fab10044020 con 0x7fab2415ca40 2024-09-11T23:25:18.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.656+0000 7fab1be00640 1 --2- 172.21.15.144:0/3194871499 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fab0406c460 0x7fab0406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:18.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.656+0000 7fab1be00640 1 -- 172.21.15.144:0/3194871499 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fab100abd60 con 0x7fab2415ca40 2024-09-11T23:25:18.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.656+0000 7fab23e00640 1 --2- 172.21.15.144:0/3194871499 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fab0406c460 0x7fab0406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:18.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.657+0000 7fab23e00640 1 --2- 172.21.15.144:0/3194871499 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fab0406c460 0x7fab0406e920 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fab140011e0 tx=0x7fab14009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:18.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.660+0000 7fab1be00640 1 -- 172.21.15.144:0/3194871499 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab1004b030 con 0x7fab2415ca40 2024-09-11T23:25:18.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.834+0000 7fab2ae00640 1 -- 172.21.15.144:0/3194871499 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fab2406d1d0 con 0x7fab0406c460 2024-09-11T23:25:18.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.841+0000 7fab1be00640 1 -- 172.21.15.144:0/3194871499 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252457 (secure 0 0 0) 0x7fab2406d1d0 con 0x7fab0406c460 2024-09-11T23:25:18.843 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:18.844 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:25:18.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.844+0000 7fab2ae00640 1 -- 172.21.15.144:0/3194871499 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fab0406c460 msgr2=0x7fab0406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:18.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.844+0000 7fab2ae00640 1 --2- 172.21.15.144:0/3194871499 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fab0406c460 0x7fab0406e920 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fab140011e0 tx=0x7fab14009040 comp rx=0 tx=0).stop 2024-09-11T23:25:18.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.844+0000 7fab2ae00640 1 -- 172.21.15.144:0/3194871499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab2415ca40 msgr2=0x7fab241f1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:18.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.844+0000 7fab2ae00640 1 --2- 172.21.15.144:0/3194871499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab2415ca40 0x7fab241f1b10 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fab10035040 tx=0x7fab100046c0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.844+0000 7fab2ae00640 1 -- 172.21.15.144:0/3194871499 shutdown_connections 2024-09-11T23:25:18.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.844+0000 7fab2ae00640 1 --2- 172.21.15.144:0/3194871499 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fab0406c460 0x7fab0406e920 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.844+0000 7fab2ae00640 1 --2- 172.21.15.144:0/3194871499 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab2415ce80 0x7fab24157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.844+0000 7fab2ae00640 1 --2- 172.21.15.144:0/3194871499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fab2415ca40 0x7fab241f1b10 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.844+0000 7fab2ae00640 1 --2- 172.21.15.144:0/3194871499 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fab240d02a0 0x7fab241f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:18.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.844+0000 7fab2ae00640 1 -- 172.21.15.144:0/3194871499 >> 172.21.15.144:0/3194871499 conn(0x7fab24062cc0 msgr2=0x7fab24154370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:18.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.844+0000 7fab2ae00640 1 -- 172.21.15.144:0/3194871499 shutdown_connections 2024-09-11T23:25:18.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:18.844+0000 7fab2ae00640 1 -- 172.21.15.144:0/3194871499 wait complete. 2024-09-11T23:25:18.860 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2024-09-11T23:25:18.755907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":223,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264512,"kb_used_data":14984,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754710208,"statfs":{"total":773094113280,"available":772823252992,"internally_reserved":0,"allocated":15343616,"data_stored":7389164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001513"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.705032+0000","last_change":"2024-09-11T23:25:14.697222+0000","last_active":"2024-09-11T23:25:15.705032+0000","last_peered":"2024-09-11T23:25:15.705032+0000","last_clean":"2024-09-11T23:25:15.705032+0000","last_became_active":"2024-09-11T23:25:14.696903+0000","last_became_peered":"2024-09-11T23:25:14.696903+0000","last_unstale":"2024-09-11T23:25:15.705032+0000","last_undegraded":"2024-09-11T23:25:15.705032+0000","last_fullsized":"2024-09-11T23:25:15.705032+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:17.960694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.713391+0000","last_change":"2024-09-11T23:25:14.706857+0000","last_active":"2024-09-11T23:25:14.713391+0000","last_peered":"2024-09-11T23:25:14.713391+0000","last_clean":"2024-09-11T23:25:14.713391+0000","last_became_active":"2024-09-11T23:25:14.706480+0000","last_became_peered":"2024-09-11T23:25:14.706480+0000","last_unstale":"2024-09-11T23:25:14.713391+0000","last_undegraded":"2024-09-11T23:25:14.713391+0000","last_fullsized":"2024-09-11T23:25:14.713391+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:30.713741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704696+0000","last_change":"2024-09-11T23:25:14.708614+0000","last_active":"2024-09-11T23:25:15.704696+0000","last_peered":"2024-09-11T23:25:15.704696+0000","last_clean":"2024-09-11T23:25:15.704696+0000","last_became_active":"2024-09-11T23:25:14.706840+0000","last_became_peered":"2024-09-11T23:25:14.706840+0000","last_unstale":"2024-09-11T23:25:15.704696+0000","last_undegraded":"2024-09-11T23:25:15.704696+0000","last_fullsized":"2024-09-11T23:25:15.704696+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:08.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.712489+0000","last_change":"2024-09-11T23:25:14.708110+0000","last_active":"2024-09-11T23:25:14.712489+0000","last_peered":"2024-09-11T23:25:14.712489+0000","last_clean":"2024-09-11T23:25:14.712489+0000","last_became_active":"2024-09-11T23:25:14.707861+0000","last_became_peered":"2024-09-11T23:25:14.707861+0000","last_unstale":"2024-09-11T23:25:14.712489+0000","last_undegraded":"2024-09-11T23:25:14.712489+0000","last_fullsized":"2024-09-11T23:25:14.712489+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:51.674013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.715164+0000","last_change":"2024-09-11T23:25:14.711050+0000","last_active":"2024-09-11T23:25:14.715164+0000","last_peered":"2024-09-11T23:25:14.715164+0000","last_clean":"2024-09-11T23:25:14.715164+0000","last_became_active":"2024-09-11T23:25:14.710774+0000","last_became_peered":"2024-09-11T23:25:14.710774+0000","last_unstale":"2024-09-11T23:25:14.715164+0000","last_undegraded":"2024-09-11T23:25:14.715164+0000","last_fullsized":"2024-09-11T23:25:14.715164+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:24.411377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.703879+0000","last_change":"2024-09-11T23:25:14.702689+0000","last_active":"2024-09-11T23:25:14.703879+0000","last_peered":"2024-09-11T23:25:14.703879+0000","last_clean":"2024-09-11T23:25:14.703879+0000","last_became_active":"2024-09-11T23:25:14.702419+0000","last_became_peered":"2024-09-11T23:25:14.702419+0000","last_unstale":"2024-09-11T23:25:14.703879+0000","last_undegraded":"2024-09-11T23:25:14.703879+0000","last_fullsized":"2024-09-11T23:25:14.703879+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:48.416598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.705004+0000","last_change":"2024-09-11T23:25:14.699435+0000","last_active":"2024-09-11T23:25:14.705004+0000","last_peered":"2024-09-11T23:25:14.705004+0000","last_clean":"2024-09-11T23:25:14.705004+0000","last_became_active":"2024-09-11T23:25:14.698899+0000","last_became_peered":"2024-09-11T23:25:14.698899+0000","last_unstale":"2024-09-11T23:25:14.705004+0000","last_undegraded":"2024-09-11T23:25:14.705004+0000","last_fullsized":"2024-09-11T23:25:14.705004+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:38.787256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.713423+0000","last_change":"2024-09-11T23:25:14.706304+0000","last_active":"2024-09-11T23:25:14.713423+0000","last_peered":"2024-09-11T23:25:14.713423+0000","last_clean":"2024-09-11T23:25:14.713423+0000","last_became_active":"2024-09-11T23:25:14.706040+0000","last_became_peered":"2024-09-11T23:25:14.706040+0000","last_unstale":"2024-09-11T23:25:14.713423+0000","last_undegraded":"2024-09-11T23:25:14.713423+0000","last_fullsized":"2024-09-11T23:25:14.713423+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:31.692286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.715057+0000","last_change":"2024-09-11T23:25:14.708311+0000","last_active":"2024-09-11T23:25:14.715057+0000","last_peered":"2024-09-11T23:25:14.715057+0000","last_clean":"2024-09-11T23:25:14.715057+0000","last_became_active":"2024-09-11T23:25:14.708053+0000","last_became_peered":"2024-09-11T23:25:14.708053+0000","last_unstale":"2024-09-11T23:25:14.715057+0000","last_undegraded":"2024-09-11T23:25:14.715057+0000","last_fullsized":"2024-09-11T23:25:14.715057+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:06.904330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.715111+0000","last_change":"2024-09-11T23:25:14.709293+0000","last_active":"2024-09-11T23:25:14.715111+0000","last_peered":"2024-09-11T23:25:14.715111+0000","last_clean":"2024-09-11T23:25:14.715111+0000","last_became_active":"2024-09-11T23:25:14.708992+0000","last_became_peered":"2024-09-11T23:25:14.708992+0000","last_unstale":"2024-09-11T23:25:14.715111+0000","last_undegraded":"2024-09-11T23:25:14.715111+0000","last_fullsized":"2024-09-11T23:25:14.715111+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:55.472887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.715069+0000","last_change":"2024-09-11T23:25:14.708572+0000","last_active":"2024-09-11T23:25:14.715069+0000","last_peered":"2024-09-11T23:25:14.715069+0000","last_clean":"2024-09-11T23:25:14.715069+0000","last_became_active":"2024-09-11T23:25:14.707869+0000","last_became_peered":"2024-09-11T23:25:14.707869+0000","last_unstale":"2024-09-11T23:25:14.715069+0000","last_undegraded":"2024-09-11T23:25:14.715069+0000","last_fullsized":"2024-09-11T23:25:14.715069+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:33.152744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.713008+0000","last_change":"2024-09-11T23:25:14.704370+0000","last_active":"2024-09-11T23:25:14.713008+0000","last_peered":"2024-09-11T23:25:14.713008+0000","last_clean":"2024-09-11T23:25:14.713008+0000","last_became_active":"2024-09-11T23:25:14.704085+0000","last_became_peered":"2024-09-11T23:25:14.704085+0000","last_unstale":"2024-09-11T23:25:14.713008+0000","last_undegraded":"2024-09-11T23:25:14.713008+0000","last_fullsized":"2024-09-11T23:25:14.713008+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:00.324632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704134+0000","last_change":"2024-09-11T23:25:14.710551+0000","last_active":"2024-09-11T23:25:15.704134+0000","last_peered":"2024-09-11T23:25:15.704134+0000","last_clean":"2024-09-11T23:25:15.704134+0000","last_became_active":"2024-09-11T23:25:14.710065+0000","last_became_peered":"2024-09-11T23:25:14.710065+0000","last_unstale":"2024-09-11T23:25:15.704134+0000","last_undegraded":"2024-09-11T23:25:15.704134+0000","last_fullsized":"2024-09-11T23:25:15.704134+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:55.472887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704098+0000","last_change":"2024-09-11T23:25:14.696114+0000","last_active":"2024-09-11T23:25:15.704098+0000","last_peered":"2024-09-11T23:25:15.704098+0000","last_clean":"2024-09-11T23:25:15.704098+0000","last_became_active":"2024-09-11T23:25:14.695828+0000","last_became_peered":"2024-09-11T23:25:14.695828+0000","last_unstale":"2024-09-11T23:25:15.704098+0000","last_undegraded":"2024-09-11T23:25:15.704098+0000","last_fullsized":"2024-09-11T23:25:15.704098+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:33.152744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703707+0000","last_change":"2024-09-11T23:25:14.693480+0000","last_active":"2024-09-11T23:25:15.703707+0000","last_peered":"2024-09-11T23:25:15.703707+0000","last_clean":"2024-09-11T23:25:15.703707+0000","last_became_active":"2024-09-11T23:25:14.693132+0000","last_became_peered":"2024-09-11T23:25:14.693132+0000","last_unstale":"2024-09-11T23:25:15.703707+0000","last_undegraded":"2024-09-11T23:25:15.703707+0000","last_fullsized":"2024-09-11T23:25:15.703707+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:13.964882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.718671+0000","last_change":"2024-09-11T23:25:14.715606+0000","last_active":"2024-09-11T23:25:14.718671+0000","last_peered":"2024-09-11T23:25:14.718671+0000","last_clean":"2024-09-11T23:25:14.718671+0000","last_became_active":"2024-09-11T23:25:14.714740+0000","last_became_peered":"2024-09-11T23:25:14.714740+0000","last_unstale":"2024-09-11T23:25:14.718671+0000","last_undegraded":"2024-09-11T23:25:14.718671+0000","last_fullsized":"2024-09-11T23:25:14.718671+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:17.458480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.715918+0000","last_change":"2024-09-11T23:25:14.712929+0000","last_active":"2024-09-11T23:25:14.715918+0000","last_peered":"2024-09-11T23:25:14.715918+0000","last_clean":"2024-09-11T23:25:14.715918+0000","last_became_active":"2024-09-11T23:25:14.712657+0000","last_became_peered":"2024-09-11T23:25:14.712657+0000","last_unstale":"2024-09-11T23:25:14.715918+0000","last_undegraded":"2024-09-11T23:25:14.715918+0000","last_fullsized":"2024-09-11T23:25:14.715918+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:35.987119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703086+0000","last_change":"2024-09-11T23:25:14.709204+0000","last_active":"2024-09-11T23:25:15.703086+0000","last_peered":"2024-09-11T23:25:15.703086+0000","last_clean":"2024-09-11T23:25:15.703086+0000","last_became_active":"2024-09-11T23:25:14.708937+0000","last_became_peered":"2024-09-11T23:25:14.708937+0000","last_unstale":"2024-09-11T23:25:15.703086+0000","last_undegraded":"2024-09-11T23:25:15.703086+0000","last_fullsized":"2024-09-11T23:25:15.703086+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:24.886218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.712654+0000","last_change":"2024-09-11T23:25:14.708624+0000","last_active":"2024-09-11T23:25:14.712654+0000","last_peered":"2024-09-11T23:25:14.712654+0000","last_clean":"2024-09-11T23:25:14.712654+0000","last_became_active":"2024-09-11T23:25:14.708322+0000","last_became_peered":"2024-09-11T23:25:14.708322+0000","last_unstale":"2024-09-11T23:25:14.712654+0000","last_undegraded":"2024-09-11T23:25:14.712654+0000","last_fullsized":"2024-09-11T23:25:14.712654+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:20.274064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704230+0000","last_change":"2024-09-11T23:25:14.694876+0000","last_active":"2024-09-11T23:25:15.704230+0000","last_peered":"2024-09-11T23:25:15.704230+0000","last_clean":"2024-09-11T23:25:15.704230+0000","last_became_active":"2024-09-11T23:25:14.694562+0000","last_became_peered":"2024-09-11T23:25:14.694562+0000","last_unstale":"2024-09-11T23:25:15.704230+0000","last_undegraded":"2024-09-11T23:25:15.704230+0000","last_fullsized":"2024-09-11T23:25:15.704230+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:58.807102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.713052+0000","last_change":"2024-09-11T23:25:14.710047+0000","last_active":"2024-09-11T23:25:14.713052+0000","last_peered":"2024-09-11T23:25:14.713052+0000","last_clean":"2024-09-11T23:25:14.713052+0000","last_became_active":"2024-09-11T23:25:14.709782+0000","last_became_peered":"2024-09-11T23:25:14.709782+0000","last_unstale":"2024-09-11T23:25:14.713052+0000","last_undegraded":"2024-09-11T23:25:14.713052+0000","last_fullsized":"2024-09-11T23:25:14.713052+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:05.709686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.713392+0000","last_change":"2024-09-11T23:25:14.704920+0000","last_active":"2024-09-11T23:25:14.713392+0000","last_peered":"2024-09-11T23:25:14.713392+0000","last_clean":"2024-09-11T23:25:14.713392+0000","last_became_active":"2024-09-11T23:25:14.704615+0000","last_became_peered":"2024-09-11T23:25:14.704615+0000","last_unstale":"2024-09-11T23:25:14.713392+0000","last_undegraded":"2024-09-11T23:25:14.713392+0000","last_fullsized":"2024-09-11T23:25:14.713392+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:01.636914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.709243+0000","last_change":"2024-09-11T23:25:14.704832+0000","last_active":"2024-09-11T23:25:14.709243+0000","last_peered":"2024-09-11T23:25:14.709243+0000","last_clean":"2024-09-11T23:25:14.709243+0000","last_became_active":"2024-09-11T23:25:14.703717+0000","last_became_peered":"2024-09-11T23:25:14.703717+0000","last_unstale":"2024-09-11T23:25:14.709243+0000","last_undegraded":"2024-09-11T23:25:14.709243+0000","last_fullsized":"2024-09-11T23:25:14.709243+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:37.476143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.716193+0000","last_change":"2024-09-11T23:25:14.712916+0000","last_active":"2024-09-11T23:25:14.716193+0000","last_peered":"2024-09-11T23:25:14.716193+0000","last_clean":"2024-09-11T23:25:14.716193+0000","last_became_active":"2024-09-11T23:25:14.712602+0000","last_became_peered":"2024-09-11T23:25:14.712602+0000","last_unstale":"2024-09-11T23:25:14.716193+0000","last_undegraded":"2024-09-11T23:25:14.716193+0000","last_fullsized":"2024-09-11T23:25:14.716193+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:32.870238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.705084+0000","last_change":"2024-09-11T23:25:14.697569+0000","last_active":"2024-09-11T23:25:15.705084+0000","last_peered":"2024-09-11T23:25:15.705084+0000","last_clean":"2024-09-11T23:25:15.705084+0000","last_became_active":"2024-09-11T23:25:14.697279+0000","last_became_peered":"2024-09-11T23:25:14.697279+0000","last_unstale":"2024-09-11T23:25:15.705084+0000","last_undegraded":"2024-09-11T23:25:15.705084+0000","last_fullsized":"2024-09-11T23:25:15.705084+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:11.887101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.723592+0000","last_change":"2024-09-11T23:25:14.718546+0000","last_active":"2024-09-11T23:25:14.723592+0000","last_peered":"2024-09-11T23:25:14.723592+0000","last_clean":"2024-09-11T23:25:14.723592+0000","last_became_active":"2024-09-11T23:25:14.718324+0000","last_became_peered":"2024-09-11T23:25:14.718324+0000","last_unstale":"2024-09-11T23:25:14.723592+0000","last_undegraded":"2024-09-11T23:25:14.723592+0000","last_fullsized":"2024-09-11T23:25:14.723592+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:12.590899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704715+0000","last_change":"2024-09-11T23:25:14.695347+0000","last_active":"2024-09-11T23:25:15.704715+0000","last_peered":"2024-09-11T23:25:15.704715+0000","last_clean":"2024-09-11T23:25:15.704715+0000","last_became_active":"2024-09-11T23:25:14.694632+0000","last_became_peered":"2024-09-11T23:25:14.694632+0000","last_unstale":"2024-09-11T23:25:15.704715+0000","last_undegraded":"2024-09-11T23:25:15.704715+0000","last_fullsized":"2024-09-11T23:25:15.704715+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:38.992341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.708989+0000","last_change":"2024-09-11T23:25:14.701787+0000","last_active":"2024-09-11T23:25:14.708989+0000","last_peered":"2024-09-11T23:25:14.708989+0000","last_clean":"2024-09-11T23:25:14.708989+0000","last_became_active":"2024-09-11T23:25:14.698373+0000","last_became_peered":"2024-09-11T23:25:14.698373+0000","last_unstale":"2024-09-11T23:25:14.708989+0000","last_undegraded":"2024-09-11T23:25:14.708989+0000","last_fullsized":"2024-09-11T23:25:14.708989+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:47.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704291+0000","last_change":"2024-09-11T23:25:14.698697+0000","last_active":"2024-09-11T23:25:15.704291+0000","last_peered":"2024-09-11T23:25:15.704291+0000","last_clean":"2024-09-11T23:25:15.704291+0000","last_became_active":"2024-09-11T23:25:14.698408+0000","last_became_peered":"2024-09-11T23:25:14.698408+0000","last_unstale":"2024-09-11T23:25:15.704291+0000","last_undegraded":"2024-09-11T23:25:15.704291+0000","last_fullsized":"2024-09-11T23:25:15.704291+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:32.339705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.706919+0000","last_change":"2024-09-11T23:25:14.702582+0000","last_active":"2024-09-11T23:25:14.706919+0000","last_peered":"2024-09-11T23:25:14.706919+0000","last_clean":"2024-09-11T23:25:14.706919+0000","last_became_active":"2024-09-11T23:25:14.701680+0000","last_became_peered":"2024-09-11T23:25:14.701680+0000","last_unstale":"2024-09-11T23:25:14.706919+0000","last_undegraded":"2024-09-11T23:25:14.706919+0000","last_fullsized":"2024-09-11T23:25:14.706919+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:20.046961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.708790+0000","last_change":"2024-09-11T23:25:14.706832+0000","last_active":"2024-09-11T23:25:14.708790+0000","last_peered":"2024-09-11T23:25:14.708790+0000","last_clean":"2024-09-11T23:25:14.708790+0000","last_became_active":"2024-09-11T23:25:14.706562+0000","last_became_peered":"2024-09-11T23:25:14.706562+0000","last_unstale":"2024-09-11T23:25:14.708790+0000","last_undegraded":"2024-09-11T23:25:14.708790+0000","last_fullsized":"2024-09-11T23:25:14.708790+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:25.028518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.702560+0000","last_change":"2024-09-11T23:25:14.715684+0000","last_active":"2024-09-11T23:25:15.702560+0000","last_peered":"2024-09-11T23:25:15.702560+0000","last_clean":"2024-09-11T23:25:15.702560+0000","last_became_active":"2024-09-11T23:25:14.715424+0000","last_became_peered":"2024-09-11T23:25:14.715424+0000","last_unstale":"2024-09-11T23:25:15.702560+0000","last_undegraded":"2024-09-11T23:25:15.702560+0000","last_fullsized":"2024-09-11T23:25:15.702560+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:17.758083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.723568+0000","last_change":"2024-09-11T23:25:14.718044+0000","last_active":"2024-09-11T23:25:14.723568+0000","last_peered":"2024-09-11T23:25:14.723568+0000","last_clean":"2024-09-11T23:25:14.723568+0000","last_became_active":"2024-09-11T23:25:14.717776+0000","last_became_peered":"2024-09-11T23:25:14.717776+0000","last_unstale":"2024-09-11T23:25:14.723568+0000","last_undegraded":"2024-09-11T23:25:14.723568+0000","last_fullsized":"2024-09-11T23:25:14.723568+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:52.644231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"141'4","reported_seq":18,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.705075+0000","last_change":"2024-09-11T23:25:13.702793+0000","last_active":"2024-09-11T23:25:15.705075+0000","last_peered":"2024-09-11T23:25:15.705075+0000","last_clean":"2024-09-11T23:25:15.705075+0000","last_became_active":"2024-09-11T23:25:13.702469+0000","last_became_peered":"2024-09-11T23:25:13.702469+0000","last_unstale":"2024-09-11T23:25:15.705075+0000","last_undegraded":"2024-09-11T23:25:15.705075+0000","last_fullsized":"2024-09-11T23:25:15.705075+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:43.562815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.712164+0000","last_change":"2024-09-11T23:25:14.710387+0000","last_active":"2024-09-11T23:25:14.712164+0000","last_peered":"2024-09-11T23:25:14.712164+0000","last_clean":"2024-09-11T23:25:14.712164+0000","last_became_active":"2024-09-11T23:25:14.710044+0000","last_became_peered":"2024-09-11T23:25:14.710044+0000","last_unstale":"2024-09-11T23:25:14.712164+0000","last_undegraded":"2024-09-11T23:25:14.712164+0000","last_fullsized":"2024-09-11T23:25:14.712164+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:47.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.728838+0000","last_change":"2024-09-11T23:25:13.708150+0000","last_active":"2024-09-11T23:25:14.728838+0000","last_peered":"2024-09-11T23:25:14.728838+0000","last_clean":"2024-09-11T23:25:14.728838+0000","last_became_active":"2024-09-11T23:25:13.707273+0000","last_became_peered":"2024-09-11T23:25:13.707273+0000","last_unstale":"2024-09-11T23:25:14.728838+0000","last_undegraded":"2024-09-11T23:25:14.728838+0000","last_fullsized":"2024-09-11T23:25:14.728838+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:10.884338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.709458+0000","last_change":"2024-09-11T23:25:14.703954+0000","last_active":"2024-09-11T23:25:14.709458+0000","last_peered":"2024-09-11T23:25:14.709458+0000","last_clean":"2024-09-11T23:25:14.709458+0000","last_became_active":"2024-09-11T23:25:14.703666+0000","last_became_peered":"2024-09-11T23:25:14.703666+0000","last_unstale":"2024-09-11T23:25:14.709458+0000","last_undegraded":"2024-09-11T23:25:14.709458+0000","last_fullsized":"2024-09-11T23:25:14.709458+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:04.504470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.731284+0000","last_change":"2024-09-11T23:25:13.708221+0000","last_active":"2024-09-11T23:25:14.731284+0000","last_peered":"2024-09-11T23:25:14.731284+0000","last_clean":"2024-09-11T23:25:14.731284+0000","last_became_active":"2024-09-11T23:25:13.707961+0000","last_became_peered":"2024-09-11T23:25:13.707961+0000","last_unstale":"2024-09-11T23:25:14.731284+0000","last_undegraded":"2024-09-11T23:25:14.731284+0000","last_fullsized":"2024-09-11T23:25:14.731284+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:37.989578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704846+0000","last_change":"2024-09-11T23:25:14.698120+0000","last_active":"2024-09-11T23:25:15.704846+0000","last_peered":"2024-09-11T23:25:15.704846+0000","last_clean":"2024-09-11T23:25:15.704846+0000","last_became_active":"2024-09-11T23:25:14.697847+0000","last_became_peered":"2024-09-11T23:25:14.697847+0000","last_unstale":"2024-09-11T23:25:15.704846+0000","last_undegraded":"2024-09-11T23:25:15.704846+0000","last_fullsized":"2024-09-11T23:25:15.704846+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:58.650351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.729490+0000","last_change":"2024-09-11T23:25:13.700457+0000","last_active":"2024-09-11T23:25:14.729490+0000","last_peered":"2024-09-11T23:25:14.729490+0000","last_clean":"2024-09-11T23:25:14.729490+0000","last_became_active":"2024-09-11T23:25:13.699132+0000","last_became_peered":"2024-09-11T23:25:13.699132+0000","last_unstale":"2024-09-11T23:25:14.729490+0000","last_undegraded":"2024-09-11T23:25:14.729490+0000","last_fullsized":"2024-09-11T23:25:14.729490+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:57.647588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.715556+0000","last_change":"2024-09-11T23:25:14.713204+0000","last_active":"2024-09-11T23:25:14.715556+0000","last_peered":"2024-09-11T23:25:14.715556+0000","last_clean":"2024-09-11T23:25:14.715556+0000","last_became_active":"2024-09-11T23:25:14.712923+0000","last_became_peered":"2024-09-11T23:25:14.712923+0000","last_unstale":"2024-09-11T23:25:14.715556+0000","last_undegraded":"2024-09-11T23:25:14.715556+0000","last_fullsized":"2024-09-11T23:25:14.715556+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:55.301077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"141'1","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704409+0000","last_change":"2024-09-11T23:25:13.698242+0000","last_active":"2024-09-11T23:25:15.704409+0000","last_peered":"2024-09-11T23:25:15.704409+0000","last_clean":"2024-09-11T23:25:15.704409+0000","last_became_active":"2024-09-11T23:25:13.697774+0000","last_became_peered":"2024-09-11T23:25:13.697774+0000","last_unstale":"2024-09-11T23:25:15.704409+0000","last_undegraded":"2024-09-11T23:25:15.704409+0000","last_fullsized":"2024-09-11T23:25:15.704409+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:55.809859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.718829+0000","last_change":"2024-09-11T23:25:14.715638+0000","last_active":"2024-09-11T23:25:14.718829+0000","last_peered":"2024-09-11T23:25:14.718829+0000","last_clean":"2024-09-11T23:25:14.718829+0000","last_became_active":"2024-09-11T23:25:14.715379+0000","last_became_peered":"2024-09-11T23:25:14.715379+0000","last_unstale":"2024-09-11T23:25:14.718829+0000","last_undegraded":"2024-09-11T23:25:14.718829+0000","last_fullsized":"2024-09-11T23:25:14.718829+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:30.211211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.728572+0000","last_change":"2024-09-11T23:25:13.703129+0000","last_active":"2024-09-11T23:25:14.728572+0000","last_peered":"2024-09-11T23:25:14.728572+0000","last_clean":"2024-09-11T23:25:14.728572+0000","last_became_active":"2024-09-11T23:25:13.702882+0000","last_became_peered":"2024-09-11T23:25:13.702882+0000","last_unstale":"2024-09-11T23:25:14.728572+0000","last_undegraded":"2024-09-11T23:25:14.728572+0000","last_fullsized":"2024-09-11T23:25:14.728572+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:54.470124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.699523+0000","last_change":"2024-09-11T23:25:14.695517+0000","last_active":"2024-09-11T23:25:14.699523+0000","last_peered":"2024-09-11T23:25:14.699523+0000","last_clean":"2024-09-11T23:25:14.699523+0000","last_became_active":"2024-09-11T23:25:14.694908+0000","last_became_peered":"2024-09-11T23:25:14.694908+0000","last_unstale":"2024-09-11T23:25:14.699523+0000","last_undegraded":"2024-09-11T23:25:14.699523+0000","last_fullsized":"2024-09-11T23:25:14.699523+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:11.887101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.698416+0000","last_change":"2024-09-11T23:25:13.708545+0000","last_active":"2024-09-11T23:25:14.698416+0000","last_peered":"2024-09-11T23:25:14.698416+0000","last_clean":"2024-09-11T23:25:14.698416+0000","last_became_active":"2024-09-11T23:25:13.707531+0000","last_became_peered":"2024-09-11T23:25:13.707531+0000","last_unstale":"2024-09-11T23:25:14.698416+0000","last_undegraded":"2024-09-11T23:25:14.698416+0000","last_fullsized":"2024-09-11T23:25:14.698416+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:57.035393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.709280+0000","last_change":"2024-09-11T23:25:14.705794+0000","last_active":"2024-09-11T23:25:14.709280+0000","last_peered":"2024-09-11T23:25:14.709280+0000","last_clean":"2024-09-11T23:25:14.709280+0000","last_became_active":"2024-09-11T23:25:14.705497+0000","last_became_peered":"2024-09-11T23:25:14.705497+0000","last_unstale":"2024-09-11T23:25:14.709280+0000","last_undegraded":"2024-09-11T23:25:14.709280+0000","last_fullsized":"2024-09-11T23:25:14.709280+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:59.354101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.703611+0000","last_change":"2024-09-11T23:25:13.699934+0000","last_active":"2024-09-11T23:25:14.703611+0000","last_peered":"2024-09-11T23:25:14.703611+0000","last_clean":"2024-09-11T23:25:14.703611+0000","last_became_active":"2024-09-11T23:25:13.699651+0000","last_became_peered":"2024-09-11T23:25:13.699651+0000","last_unstale":"2024-09-11T23:25:14.703611+0000","last_undegraded":"2024-09-11T23:25:14.703611+0000","last_fullsized":"2024-09-11T23:25:14.703611+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:24.713257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703436+0000","last_change":"2024-09-11T23:25:14.717435+0000","last_active":"2024-09-11T23:25:15.703436+0000","last_peered":"2024-09-11T23:25:15.703436+0000","last_clean":"2024-09-11T23:25:15.703436+0000","last_became_active":"2024-09-11T23:25:14.717182+0000","last_became_peered":"2024-09-11T23:25:14.717182+0000","last_unstale":"2024-09-11T23:25:15.703436+0000","last_undegraded":"2024-09-11T23:25:15.703436+0000","last_fullsized":"2024-09-11T23:25:15.703436+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:40.137449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.700530+0000","last_change":"2024-09-11T23:25:13.699240+0000","last_active":"2024-09-11T23:25:14.700530+0000","last_peered":"2024-09-11T23:25:14.700530+0000","last_clean":"2024-09-11T23:25:14.700530+0000","last_became_active":"2024-09-11T23:25:13.698962+0000","last_became_peered":"2024-09-11T23:25:13.698962+0000","last_unstale":"2024-09-11T23:25:14.700530+0000","last_undegraded":"2024-09-11T23:25:14.700530+0000","last_fullsized":"2024-09-11T23:25:14.700530+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:55.001578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703123+0000","last_change":"2024-09-11T23:25:14.718303+0000","last_active":"2024-09-11T23:25:15.703123+0000","last_peered":"2024-09-11T23:25:15.703123+0000","last_clean":"2024-09-11T23:25:15.703123+0000","last_became_active":"2024-09-11T23:25:14.714186+0000","last_became_peered":"2024-09-11T23:25:14.714186+0000","last_unstale":"2024-09-11T23:25:15.703123+0000","last_undegraded":"2024-09-11T23:25:15.703123+0000","last_fullsized":"2024-09-11T23:25:15.703123+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:34.149308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"141'3","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.732031+0000","last_change":"2024-09-11T23:25:13.703061+0000","last_active":"2024-09-11T23:25:14.732031+0000","last_peered":"2024-09-11T23:25:14.732031+0000","last_clean":"2024-09-11T23:25:14.732031+0000","last_became_active":"2024-09-11T23:25:13.702832+0000","last_became_peered":"2024-09-11T23:25:13.702832+0000","last_unstale":"2024-09-11T23:25:14.732031+0000","last_undegraded":"2024-09-11T23:25:14.732031+0000","last_fullsized":"2024-09-11T23:25:14.732031+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:35.572326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.716409+0000","last_change":"2024-09-11T23:25:14.713149+0000","last_active":"2024-09-11T23:25:14.716409+0000","last_peered":"2024-09-11T23:25:14.716409+0000","last_clean":"2024-09-11T23:25:14.716409+0000","last_became_active":"2024-09-11T23:25:14.712615+0000","last_became_peered":"2024-09-11T23:25:14.712615+0000","last_unstale":"2024-09-11T23:25:14.716409+0000","last_undegraded":"2024-09-11T23:25:14.716409+0000","last_fullsized":"2024-09-11T23:25:14.716409+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:05.956187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"141'6","reported_seq":18,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.735550+0000","last_change":"2024-09-11T23:25:13.699270+0000","last_active":"2024-09-11T23:25:14.735550+0000","last_peered":"2024-09-11T23:25:14.735550+0000","last_clean":"2024-09-11T23:25:14.735550+0000","last_became_active":"2024-09-11T23:25:13.698944+0000","last_became_peered":"2024-09-11T23:25:13.698944+0000","last_unstale":"2024-09-11T23:25:14.735550+0000","last_undegraded":"2024-09-11T23:25:14.735550+0000","last_fullsized":"2024-09-11T23:25:14.735550+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:07.805534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.702834+0000","last_change":"2024-09-11T23:25:14.710562+0000","last_active":"2024-09-11T23:25:15.702834+0000","last_peered":"2024-09-11T23:25:15.702834+0000","last_clean":"2024-09-11T23:25:15.702834+0000","last_became_active":"2024-09-11T23:25:14.710300+0000","last_became_peered":"2024-09-11T23:25:14.710300+0000","last_unstale":"2024-09-11T23:25:15.702834+0000","last_undegraded":"2024-09-11T23:25:15.702834+0000","last_fullsized":"2024-09-11T23:25:15.702834+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:19.866952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.729212+0000","last_change":"2024-09-11T23:25:13.703931+0000","last_active":"2024-09-11T23:25:14.729212+0000","last_peered":"2024-09-11T23:25:14.729212+0000","last_clean":"2024-09-11T23:25:14.729212+0000","last_became_active":"2024-09-11T23:25:13.703594+0000","last_became_peered":"2024-09-11T23:25:13.703594+0000","last_unstale":"2024-09-11T23:25:14.729212+0000","last_undegraded":"2024-09-11T23:25:14.729212+0000","last_fullsized":"2024-09-11T23:25:14.729212+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:31.336941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.723903+0000","last_change":"2024-09-11T23:25:14.720167+0000","last_active":"2024-09-11T23:25:14.723903+0000","last_peered":"2024-09-11T23:25:14.723903+0000","last_clean":"2024-09-11T23:25:14.723903+0000","last_became_active":"2024-09-11T23:25:14.719902+0000","last_became_peered":"2024-09-11T23:25:14.719902+0000","last_unstale":"2024-09-11T23:25:14.723903+0000","last_undegraded":"2024-09-11T23:25:14.723903+0000","last_fullsized":"2024-09-11T23:25:14.723903+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:17.960694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.702922+0000","last_change":"2024-09-11T23:25:13.695686+0000","last_active":"2024-09-11T23:25:15.702922+0000","last_peered":"2024-09-11T23:25:15.702922+0000","last_clean":"2024-09-11T23:25:15.702922+0000","last_became_active":"2024-09-11T23:25:13.695432+0000","last_became_peered":"2024-09-11T23:25:13.695432+0000","last_unstale":"2024-09-11T23:25:15.702922+0000","last_undegraded":"2024-09-11T23:25:15.702922+0000","last_fullsized":"2024-09-11T23:25:15.702922+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:25.604051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.699547+0000","last_change":"2024-09-11T23:25:14.695741+0000","last_active":"2024-09-11T23:25:14.699547+0000","last_peered":"2024-09-11T23:25:14.699547+0000","last_clean":"2024-09-11T23:25:14.699547+0000","last_became_active":"2024-09-11T23:25:14.695259+0000","last_became_peered":"2024-09-11T23:25:14.695259+0000","last_unstale":"2024-09-11T23:25:14.699547+0000","last_undegraded":"2024-09-11T23:25:14.699547+0000","last_fullsized":"2024-09-11T23:25:14.699547+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:20.046961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.687936+0000","last_change":"2024-09-11T23:25:13.708207+0000","last_active":"2024-09-11T23:25:14.687936+0000","last_peered":"2024-09-11T23:25:14.687936+0000","last_clean":"2024-09-11T23:25:14.687936+0000","last_became_active":"2024-09-11T23:25:13.707824+0000","last_became_peered":"2024-09-11T23:25:13.707824+0000","last_unstale":"2024-09-11T23:25:14.687936+0000","last_undegraded":"2024-09-11T23:25:14.687936+0000","last_fullsized":"2024-09-11T23:25:14.687936+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:23.408614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704014+0000","last_change":"2024-09-11T23:25:14.708038+0000","last_active":"2024-09-11T23:25:15.704014+0000","last_peered":"2024-09-11T23:25:15.704014+0000","last_clean":"2024-09-11T23:25:15.704014+0000","last_became_active":"2024-09-11T23:25:14.706294+0000","last_became_peered":"2024-09-11T23:25:14.706294+0000","last_unstale":"2024-09-11T23:25:15.704014+0000","last_undegraded":"2024-09-11T23:25:15.704014+0000","last_fullsized":"2024-09-11T23:25:15.704014+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:06.904330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"141'8","reported_seq":20,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.733939+0000","last_change":"2024-09-11T23:25:13.698164+0000","last_active":"2024-09-11T23:25:14.733939+0000","last_peered":"2024-09-11T23:25:14.733939+0000","last_clean":"2024-09-11T23:25:14.733939+0000","last_became_active":"2024-09-11T23:25:13.697280+0000","last_became_peered":"2024-09-11T23:25:13.697280+0000","last_unstale":"2024-09-11T23:25:14.733939+0000","last_undegraded":"2024-09-11T23:25:14.733939+0000","last_fullsized":"2024-09-11T23:25:14.733939+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:57.804339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.706386+0000","last_change":"2024-09-11T23:25:14.698307+0000","last_active":"2024-09-11T23:25:14.706386+0000","last_peered":"2024-09-11T23:25:14.706386+0000","last_clean":"2024-09-11T23:25:14.706386+0000","last_became_active":"2024-09-11T23:25:14.698010+0000","last_became_peered":"2024-09-11T23:25:14.698010+0000","last_unstale":"2024-09-11T23:25:14.706386+0000","last_undegraded":"2024-09-11T23:25:14.706386+0000","last_fullsized":"2024-09-11T23:25:14.706386+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:25.028518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"141'1","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.705042+0000","last_change":"2024-09-11T23:25:13.708531+0000","last_active":"2024-09-11T23:25:15.705042+0000","last_peered":"2024-09-11T23:25:15.705042+0000","last_clean":"2024-09-11T23:25:15.705042+0000","last_became_active":"2024-09-11T23:25:13.708217+0000","last_became_peered":"2024-09-11T23:25:13.708217+0000","last_unstale":"2024-09-11T23:25:15.705042+0000","last_undegraded":"2024-09-11T23:25:15.705042+0000","last_fullsized":"2024-09-11T23:25:15.705042+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:30.928125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703435+0000","last_change":"2024-09-11T23:25:14.711364+0000","last_active":"2024-09-11T23:25:15.703435+0000","last_peered":"2024-09-11T23:25:15.703435+0000","last_clean":"2024-09-11T23:25:15.703435+0000","last_became_active":"2024-09-11T23:25:14.711050+0000","last_became_peered":"2024-09-11T23:25:14.711050+0000","last_unstale":"2024-09-11T23:25:15.703435+0000","last_undegraded":"2024-09-11T23:25:15.703435+0000","last_fullsized":"2024-09-11T23:25:15.703435+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:54.484292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"141'2","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704701+0000","last_change":"2024-09-11T23:25:13.704751+0000","last_active":"2024-09-11T23:25:15.704701+0000","last_peered":"2024-09-11T23:25:15.704701+0000","last_clean":"2024-09-11T23:25:15.704701+0000","last_became_active":"2024-09-11T23:25:13.704452+0000","last_became_peered":"2024-09-11T23:25:13.704452+0000","last_unstale":"2024-09-11T23:25:15.704701+0000","last_undegraded":"2024-09-11T23:25:15.704701+0000","last_fullsized":"2024-09-11T23:25:15.704701+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:54.144955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.712514+0000","last_change":"2024-09-11T23:25:14.708839+0000","last_active":"2024-09-11T23:25:14.712514+0000","last_peered":"2024-09-11T23:25:14.712514+0000","last_clean":"2024-09-11T23:25:14.712514+0000","last_became_active":"2024-09-11T23:25:14.706208+0000","last_became_peered":"2024-09-11T23:25:14.706208+0000","last_unstale":"2024-09-11T23:25:14.712514+0000","last_undegraded":"2024-09-11T23:25:14.712514+0000","last_fullsized":"2024-09-11T23:25:14.712514+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:05.956187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"141'1","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704759+0000","last_change":"2024-09-11T23:25:13.704861+0000","last_active":"2024-09-11T23:25:15.704759+0000","last_peered":"2024-09-11T23:25:15.704759+0000","last_clean":"2024-09-11T23:25:15.704759+0000","last_became_active":"2024-09-11T23:25:13.704575+0000","last_became_peered":"2024-09-11T23:25:13.704575+0000","last_unstale":"2024-09-11T23:25:15.704759+0000","last_undegraded":"2024-09-11T23:25:15.704759+0000","last_fullsized":"2024-09-11T23:25:15.704759+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:24.713257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.712125+0000","last_change":"2024-09-11T23:25:14.707127+0000","last_active":"2024-09-11T23:25:14.712125+0000","last_peered":"2024-09-11T23:25:14.712125+0000","last_clean":"2024-09-11T23:25:14.712125+0000","last_became_active":"2024-09-11T23:25:14.706619+0000","last_became_peered":"2024-09-11T23:25:14.706619+0000","last_unstale":"2024-09-11T23:25:14.712125+0000","last_undegraded":"2024-09-11T23:25:14.712125+0000","last_fullsized":"2024-09-11T23:25:14.712125+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:58.264121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704620+0000","last_change":"2024-09-11T23:25:13.705699+0000","last_active":"2024-09-11T23:25:15.704620+0000","last_peered":"2024-09-11T23:25:15.704620+0000","last_clean":"2024-09-11T23:25:15.704620+0000","last_became_active":"2024-09-11T23:25:13.704902+0000","last_became_peered":"2024-09-11T23:25:13.704902+0000","last_unstale":"2024-09-11T23:25:15.704620+0000","last_undegraded":"2024-09-11T23:25:15.704620+0000","last_fullsized":"2024-09-11T23:25:15.704620+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:57.261358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704228+0000","last_change":"2024-09-11T23:25:14.711678+0000","last_active":"2024-09-11T23:25:15.704228+0000","last_peered":"2024-09-11T23:25:15.704228+0000","last_clean":"2024-09-11T23:25:15.704228+0000","last_became_active":"2024-09-11T23:25:14.711377+0000","last_became_peered":"2024-09-11T23:25:14.711377+0000","last_unstale":"2024-09-11T23:25:15.704228+0000","last_undegraded":"2024-09-11T23:25:15.704228+0000","last_fullsized":"2024-09-11T23:25:15.704228+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:32.870238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.734149+0000","last_change":"2024-09-11T23:25:13.708319+0000","last_active":"2024-09-11T23:25:14.734149+0000","last_peered":"2024-09-11T23:25:14.734149+0000","last_clean":"2024-09-11T23:25:14.734149+0000","last_became_active":"2024-09-11T23:25:13.708024+0000","last_became_peered":"2024-09-11T23:25:13.708024+0000","last_unstale":"2024-09-11T23:25:14.734149+0000","last_undegraded":"2024-09-11T23:25:14.734149+0000","last_fullsized":"2024-09-11T23:25:14.734149+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:07.805534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.717677+0000","last_change":"2024-09-11T23:25:14.707768+0000","last_active":"2024-09-11T23:25:14.717677+0000","last_peered":"2024-09-11T23:25:14.717677+0000","last_clean":"2024-09-11T23:25:14.717677+0000","last_became_active":"2024-09-11T23:25:14.707467+0000","last_became_peered":"2024-09-11T23:25:14.707467+0000","last_unstale":"2024-09-11T23:25:14.717677+0000","last_undegraded":"2024-09-11T23:25:14.717677+0000","last_fullsized":"2024-09-11T23:25:14.717677+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:07.513028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704362+0000","last_change":"2024-09-11T23:25:13.707947+0000","last_active":"2024-09-11T23:25:15.704362+0000","last_peered":"2024-09-11T23:25:15.704362+0000","last_clean":"2024-09-11T23:25:15.704362+0000","last_became_active":"2024-09-11T23:25:13.707680+0000","last_became_peered":"2024-09-11T23:25:13.707680+0000","last_unstale":"2024-09-11T23:25:15.704362+0000","last_undegraded":"2024-09-11T23:25:15.704362+0000","last_fullsized":"2024-09-11T23:25:15.704362+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:50.334364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703742+0000","last_change":"2024-09-11T23:25:14.705055+0000","last_active":"2024-09-11T23:25:15.703742+0000","last_peered":"2024-09-11T23:25:15.703742+0000","last_clean":"2024-09-11T23:25:15.703742+0000","last_became_active":"2024-09-11T23:25:14.704756+0000","last_became_peered":"2024-09-11T23:25:14.704756+0000","last_unstale":"2024-09-11T23:25:15.703742+0000","last_undegraded":"2024-09-11T23:25:15.703742+0000","last_fullsized":"2024-09-11T23:25:15.703742+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:12.590899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.688002+0000","last_change":"2024-09-11T23:25:13.700997+0000","last_active":"2024-09-11T23:25:14.688002+0000","last_peered":"2024-09-11T23:25:14.688002+0000","last_clean":"2024-09-11T23:25:14.688002+0000","last_became_active":"2024-09-11T23:25:13.699433+0000","last_became_peered":"2024-09-11T23:25:13.699433+0000","last_unstale":"2024-09-11T23:25:14.688002+0000","last_undegraded":"2024-09-11T23:25:14.688002+0000","last_fullsized":"2024-09-11T23:25:14.688002+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:31.867475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.709263+0000","last_change":"2024-09-11T23:25:14.704869+0000","last_active":"2024-09-11T23:25:14.709263+0000","last_peered":"2024-09-11T23:25:14.709263+0000","last_clean":"2024-09-11T23:25:14.709263+0000","last_became_active":"2024-09-11T23:25:14.704556+0000","last_became_peered":"2024-09-11T23:25:14.704556+0000","last_unstale":"2024-09-11T23:25:14.709263+0000","last_undegraded":"2024-09-11T23:25:14.709263+0000","last_fullsized":"2024-09-11T23:25:14.709263+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:19.536266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703988+0000","last_change":"2024-09-11T23:25:13.704742+0000","last_active":"2024-09-11T23:25:15.703988+0000","last_peered":"2024-09-11T23:25:15.703988+0000","last_clean":"2024-09-11T23:25:15.703988+0000","last_became_active":"2024-09-11T23:25:13.704404+0000","last_became_peered":"2024-09-11T23:25:13.704404+0000","last_unstale":"2024-09-11T23:25:15.703988+0000","last_undegraded":"2024-09-11T23:25:15.703988+0000","last_fullsized":"2024-09-11T23:25:15.703988+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:37.784493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703370+0000","last_change":"2024-09-11T23:25:14.716535+0000","last_active":"2024-09-11T23:25:15.703370+0000","last_peered":"2024-09-11T23:25:15.703370+0000","last_clean":"2024-09-11T23:25:15.703370+0000","last_became_active":"2024-09-11T23:25:14.716263+0000","last_became_peered":"2024-09-11T23:25:14.716263+0000","last_unstale":"2024-09-11T23:25:15.703370+0000","last_undegraded":"2024-09-11T23:25:15.703370+0000","last_fullsized":"2024-09-11T23:25:15.703370+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:39.260235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"141'2","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703514+0000","last_change":"2024-09-11T23:25:13.707494+0000","last_active":"2024-09-11T23:25:15.703514+0000","last_peered":"2024-09-11T23:25:15.703514+0000","last_clean":"2024-09-11T23:25:15.703514+0000","last_became_active":"2024-09-11T23:25:13.707198+0000","last_became_peered":"2024-09-11T23:25:13.707198+0000","last_unstale":"2024-09-11T23:25:15.703514+0000","last_undegraded":"2024-09-11T23:25:15.703514+0000","last_fullsized":"2024-09-11T23:25:15.703514+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:12.758736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.723496+0000","last_change":"2024-09-11T23:25:14.718189+0000","last_active":"2024-09-11T23:25:14.723496+0000","last_peered":"2024-09-11T23:25:14.723496+0000","last_clean":"2024-09-11T23:25:14.723496+0000","last_became_active":"2024-09-11T23:25:14.717884+0000","last_became_peered":"2024-09-11T23:25:14.717884+0000","last_unstale":"2024-09-11T23:25:14.723496+0000","last_undegraded":"2024-09-11T23:25:14.723496+0000","last_fullsized":"2024-09-11T23:25:14.723496+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:13.964882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704818+0000","last_change":"2024-09-11T23:25:13.696644+0000","last_active":"2024-09-11T23:25:15.704818+0000","last_peered":"2024-09-11T23:25:15.704818+0000","last_clean":"2024-09-11T23:25:15.704818+0000","last_became_active":"2024-09-11T23:25:13.696275+0000","last_became_peered":"2024-09-11T23:25:13.696275+0000","last_unstale":"2024-09-11T23:25:15.704818+0000","last_undegraded":"2024-09-11T23:25:15.704818+0000","last_fullsized":"2024-09-11T23:25:15.704818+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:31.490111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.709481+0000","last_change":"2024-09-11T23:25:14.707227+0000","last_active":"2024-09-11T23:25:14.709481+0000","last_peered":"2024-09-11T23:25:14.709481+0000","last_clean":"2024-09-11T23:25:14.709481+0000","last_became_active":"2024-09-11T23:25:14.706822+0000","last_became_peered":"2024-09-11T23:25:14.706822+0000","last_unstale":"2024-09-11T23:25:14.709481+0000","last_undegraded":"2024-09-11T23:25:14.709481+0000","last_fullsized":"2024-09-11T23:25:14.709481+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:46.506384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.699887+0000","last_change":"2024-09-11T23:25:13.704197+0000","last_active":"2024-09-11T23:25:14.699887+0000","last_peered":"2024-09-11T23:25:14.699887+0000","last_clean":"2024-09-11T23:25:14.699887+0000","last_became_active":"2024-09-11T23:25:13.703225+0000","last_became_peered":"2024-09-11T23:25:13.703225+0000","last_unstale":"2024-09-11T23:25:14.699887+0000","last_undegraded":"2024-09-11T23:25:14.699887+0000","last_fullsized":"2024-09-11T23:25:14.699887+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:22.768093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703168+0000","last_change":"2024-09-11T23:25:14.714242+0000","last_active":"2024-09-11T23:25:15.703168+0000","last_peered":"2024-09-11T23:25:15.703168+0000","last_clean":"2024-09-11T23:25:15.703168+0000","last_became_active":"2024-09-11T23:25:14.713973+0000","last_became_peered":"2024-09-11T23:25:14.713973+0000","last_unstale":"2024-09-11T23:25:15.703168+0000","last_undegraded":"2024-09-11T23:25:15.703168+0000","last_fullsized":"2024-09-11T23:25:15.703168+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:06.755051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703125+0000","last_change":"2024-09-11T23:25:13.695649+0000","last_active":"2024-09-11T23:25:15.703125+0000","last_peered":"2024-09-11T23:25:15.703125+0000","last_clean":"2024-09-11T23:25:15.703125+0000","last_became_active":"2024-09-11T23:25:13.695042+0000","last_became_peered":"2024-09-11T23:25:13.695042+0000","last_unstale":"2024-09-11T23:25:15.703125+0000","last_undegraded":"2024-09-11T23:25:15.703125+0000","last_fullsized":"2024-09-11T23:25:15.703125+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:07.283654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.702850+0000","last_change":"2024-09-11T23:25:14.710987+0000","last_active":"2024-09-11T23:25:15.702850+0000","last_peered":"2024-09-11T23:25:15.702850+0000","last_clean":"2024-09-11T23:25:15.702850+0000","last_became_active":"2024-09-11T23:25:14.708510+0000","last_became_peered":"2024-09-11T23:25:14.708510+0000","last_unstale":"2024-09-11T23:25:15.702850+0000","last_undegraded":"2024-09-11T23:25:15.702850+0000","last_fullsized":"2024-09-11T23:25:15.702850+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:05.130244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.700000+0000","last_change":"2024-09-11T23:25:13.703435+0000","last_active":"2024-09-11T23:25:14.700000+0000","last_peered":"2024-09-11T23:25:14.700000+0000","last_clean":"2024-09-11T23:25:14.700000+0000","last_became_active":"2024-09-11T23:25:13.703169+0000","last_became_peered":"2024-09-11T23:25:13.703169+0000","last_unstale":"2024-09-11T23:25:14.700000+0000","last_undegraded":"2024-09-11T23:25:14.700000+0000","last_fullsized":"2024-09-11T23:25:14.700000+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:37.989578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.713436+0000","last_change":"2024-09-11T23:25:14.710534+0000","last_active":"2024-09-11T23:25:14.713436+0000","last_peered":"2024-09-11T23:25:14.713436+0000","last_clean":"2024-09-11T23:25:14.713436+0000","last_became_active":"2024-09-11T23:25:14.710074+0000","last_became_peered":"2024-09-11T23:25:14.710074+0000","last_unstale":"2024-09-11T23:25:14.713436+0000","last_undegraded":"2024-09-11T23:25:14.713436+0000","last_fullsized":"2024-09-11T23:25:14.713436+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:51.674013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.688099+0000","last_change":"2024-09-11T23:25:13.700336+0000","last_active":"2024-09-11T23:25:14.688099+0000","last_peered":"2024-09-11T23:25:14.688099+0000","last_clean":"2024-09-11T23:25:14.688099+0000","last_became_active":"2024-09-11T23:25:13.699644+0000","last_became_peered":"2024-09-11T23:25:13.699644+0000","last_unstale":"2024-09-11T23:25:14.688099+0000","last_undegraded":"2024-09-11T23:25:14.688099+0000","last_fullsized":"2024-09-11T23:25:14.688099+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:57.804339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.715489+0000","last_change":"2024-09-11T23:25:14.706010+0000","last_active":"2024-09-11T23:25:14.715489+0000","last_peered":"2024-09-11T23:25:14.715489+0000","last_clean":"2024-09-11T23:25:14.715489+0000","last_became_active":"2024-09-11T23:25:14.705730+0000","last_became_peered":"2024-09-11T23:25:14.705730+0000","last_unstale":"2024-09-11T23:25:14.715489+0000","last_undegraded":"2024-09-11T23:25:14.715489+0000","last_fullsized":"2024-09-11T23:25:14.715489+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:44.565579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.698563+0000","last_change":"2024-09-11T23:25:13.703834+0000","last_active":"2024-09-11T23:25:14.698563+0000","last_peered":"2024-09-11T23:25:14.698563+0000","last_clean":"2024-09-11T23:25:14.698563+0000","last_became_active":"2024-09-11T23:25:13.703579+0000","last_became_peered":"2024-09-11T23:25:13.703579+0000","last_unstale":"2024-09-11T23:25:14.698563+0000","last_undegraded":"2024-09-11T23:25:14.698563+0000","last_fullsized":"2024-09-11T23:25:14.698563+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:19.888993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704163+0000","last_change":"2024-09-11T23:25:14.697052+0000","last_active":"2024-09-11T23:25:15.704163+0000","last_peered":"2024-09-11T23:25:15.704163+0000","last_clean":"2024-09-11T23:25:15.704163+0000","last_became_active":"2024-09-11T23:25:14.696749+0000","last_became_peered":"2024-09-11T23:25:14.696749+0000","last_unstale":"2024-09-11T23:25:15.704163+0000","last_undegraded":"2024-09-11T23:25:15.704163+0000","last_fullsized":"2024-09-11T23:25:15.704163+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:24.411377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.698873+0000","last_change":"2024-09-11T23:25:13.702795+0000","last_active":"2024-09-11T23:25:14.698873+0000","last_peered":"2024-09-11T23:25:14.698873+0000","last_clean":"2024-09-11T23:25:14.698873+0000","last_became_active":"2024-09-11T23:25:13.702507+0000","last_became_peered":"2024-09-11T23:25:13.702507+0000","last_unstale":"2024-09-11T23:25:14.698873+0000","last_undegraded":"2024-09-11T23:25:14.698873+0000","last_fullsized":"2024-09-11T23:25:14.698873+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:31.336941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703154+0000","last_change":"2024-09-11T23:25:14.715401+0000","last_active":"2024-09-11T23:25:15.703154+0000","last_peered":"2024-09-11T23:25:15.703154+0000","last_clean":"2024-09-11T23:25:15.703154+0000","last_became_active":"2024-09-11T23:25:14.715120+0000","last_became_peered":"2024-09-11T23:25:14.715120+0000","last_unstale":"2024-09-11T23:25:15.703154+0000","last_undegraded":"2024-09-11T23:25:15.703154+0000","last_fullsized":"2024-09-11T23:25:15.703154+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:10.733724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.700933+0000","last_change":"2024-09-11T23:25:13.702400+0000","last_active":"2024-09-11T23:25:14.700933+0000","last_peered":"2024-09-11T23:25:14.700933+0000","last_clean":"2024-09-11T23:25:14.700933+0000","last_became_active":"2024-09-11T23:25:13.701842+0000","last_became_peered":"2024-09-11T23:25:13.701842+0000","last_unstale":"2024-09-11T23:25:14.700933+0000","last_undegraded":"2024-09-11T23:25:14.700933+0000","last_fullsized":"2024-09-11T23:25:14.700933+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:57.647588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":434,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703834+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:25:15.703834+0000","last_peered":"2024-09-11T23:25:15.703834+0000","last_clean":"2024-09-11T23:25:15.703834+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:25:15.703834+0000","last_undegraded":"2024-09-11T23:25:15.703834+0000","last_fullsized":"2024-09-11T23:25:15.703834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476830,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33516,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338324,"statfs":{"total":96636764160,"available":96602443776,"internally_reserved":0,"allocated":2379776,"data_stored":1368173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476829,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1765376,"data_stored":775473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476828,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1769472,"data_stored":776055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476828,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1777664,"data_stored":777133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542237,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1765376,"data_stored":775485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542237,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1765376,"data_stored":775541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1765376,"data_stored":775485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509533,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33488,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338352,"statfs":{"total":96636764160,"available":96602472448,"internally_reserved":0,"allocated":2355200,"data_stored":1365819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:25:18.864 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:25:19.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.054+0000 7f3e52e00640 1 Processor -- start 2024-09-11T23:25:19.054 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.054+0000 7f3e52e00640 1 -- start start 2024-09-11T23:25:19.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.055+0000 7f3e52e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e4c0d0a50 0x7f3e4c1620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.055+0000 7f3e52e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3e4c0b4930 0x7f3e4c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.055+0000 7f3e52e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e4c15f620 0x7f3e4c15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.055+0000 7f3e52e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3e4c0b52d0 con 0x7f3e4c0d0a50 2024-09-11T23:25:19.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.055+0000 7f3e52e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3e4c1625f0 con 0x7f3e4c0b4930 2024-09-11T23:25:19.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.055+0000 7f3e52e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3e4c162870 con 0x7f3e4c15f620 2024-09-11T23:25:19.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.055+0000 7f3e4be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e4c0d0a50 0x7f3e4c1620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:19.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.055+0000 7f3e4be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e4c0d0a50 0x7f3e4c1620b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57454/0 (socket says 172.21.15.144:57454) 2024-09-11T23:25:19.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.055+0000 7f3e4be00640 1 -- 172.21.15.144:0/172141129 learned_addr learned my addr 172.21.15.144:0/172141129 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.055+0000 7f3e43e00640 1 --2- 172.21.15.144:0/172141129 >> v2:172.21.15.165:3300/0 conn(0x7f3e4c0b4930 0x7f3e4c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.056+0000 7f3e50e00640 1 --2- 172.21.15.144:0/172141129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e4c15f620 0x7f3e4c15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.056+0000 7f3e4be00640 1 -- 172.21.15.144:0/172141129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e4c15f620 msgr2=0x7f3e4c15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.056+0000 7f3e4be00640 1 --2- 172.21.15.144:0/172141129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e4c15f620 0x7f3e4c15fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.056+0000 7f3e4be00640 1 -- 172.21.15.144:0/172141129 >> v2:172.21.15.165:3300/0 conn(0x7f3e4c0b4930 msgr2=0x7f3e4c0b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.056+0000 7f3e4be00640 1 --2- 172.21.15.144:0/172141129 >> v2:172.21.15.165:3300/0 conn(0x7f3e4c0b4930 0x7f3e4c0b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.056+0000 7f3e4be00640 1 -- 172.21.15.144:0/172141129 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4c162b50 con 0x7f3e4c0d0a50 2024-09-11T23:25:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.056+0000 7f3e43e00640 1 --2- 172.21.15.144:0/172141129 >> v2:172.21.15.165:3300/0 conn(0x7f3e4c0b4930 0x7f3e4c0b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.056+0000 7f3e50e00640 1 --2- 172.21.15.144:0/172141129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e4c15f620 0x7f3e4c15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.057+0000 7f3e4be00640 1 --2- 172.21.15.144:0/172141129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4c0d0a50 0x7f3e4c1620b0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c070ef0 tx=0x7f3e3c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58f8556ecbbde2b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.057+0000 7f3e4b400640 1 -- 172.21.15.144:0/172141129 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c037070 con 0x7f3e4c0d0a50 2024-09-11T23:25:19.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.057+0000 7f3e4b400640 1 -- 172.21.15.144:0/172141129 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e3c032440 con 0x7f3e4c0d0a50 2024-09-11T23:25:19.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.057+0000 7f3e4b400640 1 -- 172.21.15.144:0/172141129 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c032810 con 0x7f3e4c0d0a50 2024-09-11T23:25:19.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.057+0000 7f3e52e00640 1 -- 172.21.15.144:0/172141129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4c0d0a50 msgr2=0x7f3e4c1620b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:19.058 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.057+0000 7f3e52e00640 1 --2- 172.21.15.144:0/172141129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4c0d0a50 0x7f3e4c1620b0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c070ef0 tx=0x7f3e3c02a140 comp rx=0 tx=0).stop 2024-09-11T23:25:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.057+0000 7f3e52e00640 1 -- 172.21.15.144:0/172141129 shutdown_connections 2024-09-11T23:25:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.057+0000 7f3e52e00640 1 --2- 172.21.15.144:0/172141129 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e4c15f620 0x7f3e4c15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.058+0000 7f3e52e00640 1 --2- 172.21.15.144:0/172141129 >> v2:172.21.15.165:3300/0 conn(0x7f3e4c0b4930 0x7f3e4c0b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.058+0000 7f3e52e00640 1 --2- 172.21.15.144:0/172141129 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4c0d0a50 0x7f3e4c1620b0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.058+0000 7f3e52e00640 1 -- 172.21.15.144:0/172141129 >> 172.21.15.144:0/172141129 conn(0x7f3e4c062cc0 msgr2=0x7f3e4c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.058+0000 7f3e52e00640 1 -- 172.21.15.144:0/172141129 shutdown_connections 2024-09-11T23:25:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.058+0000 7f3e52e00640 1 -- 172.21.15.144:0/172141129 wait complete. 2024-09-11T23:25:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.059+0000 7f3e52e00640 1 Processor -- start 2024-09-11T23:25:19.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.059+0000 7f3e52e00640 1 -- start start 2024-09-11T23:25:19.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.060+0000 7f3e52e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4c0b4930 0x7f3e4c144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.060+0000 7f3e52e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e4c15f620 0x7f3e4c15d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.060+0000 7f3e52e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e4c073690 0x7f3e4c1461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.060+0000 7f3e52e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c0b3620 con 0x7f3e4c0b4930 2024-09-11T23:25:19.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.060+0000 7f3e52e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c0b3340 con 0x7f3e4c15f620 2024-09-11T23:25:19.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.060+0000 7f3e52e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3e4c15fff0 con 0x7f3e4c073690 2024-09-11T23:25:19.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.060+0000 7f3e4be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4c0b4930 0x7f3e4c144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:19.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.060+0000 7f3e4be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4c0b4930 0x7f3e4c144a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57468/0 (socket says 172.21.15.144:57468) 2024-09-11T23:25:19.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.060+0000 7f3e4be00640 1 -- 172.21.15.144:0/946211107 learned_addr learned my addr 172.21.15.144:0/946211107 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:19.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.060+0000 7f3e43e00640 1 --2- 172.21.15.144:0/946211107 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e4c15f620 0x7f3e4c15d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:19.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.061+0000 7f3e50e00640 1 --2- 172.21.15.144:0/946211107 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e4c073690 0x7f3e4c1461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:19.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.061+0000 7f3e4be00640 1 -- 172.21.15.144:0/946211107 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e4c073690 msgr2=0x7f3e4c1461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:19.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.061+0000 7f3e4be00640 1 --2- 172.21.15.144:0/946211107 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e4c073690 0x7f3e4c1461f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.061+0000 7f3e4be00640 1 -- 172.21.15.144:0/946211107 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e4c15f620 msgr2=0x7f3e4c15d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:19.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.061+0000 7f3e4be00640 1 --2- 172.21.15.144:0/946211107 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e4c15f620 0x7f3e4c15d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.061+0000 7f3e4be00640 1 -- 172.21.15.144:0/946211107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4c145150 con 0x7f3e4c0b4930 2024-09-11T23:25:19.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.061+0000 7f3e50e00640 1 --2- 172.21.15.144:0/946211107 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e4c073690 0x7f3e4c1461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:19.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.061+0000 7f3e4be00640 1 --2- 172.21.15.144:0/946211107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4c0b4930 0x7f3e4c144a70 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c02a180 tx=0x7f3e3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:19.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.061+0000 7f3e48c00640 1 -- 172.21.15.144:0/946211107 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c037040 con 0x7f3e4c0b4930 2024-09-11T23:25:19.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.061+0000 7f3e48c00640 1 -- 172.21.15.144:0/946211107 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e3c042070 con 0x7f3e4c0b4930 2024-09-11T23:25:19.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.061+0000 7f3e48c00640 1 -- 172.21.15.144:0/946211107 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c030bb0 con 0x7f3e4c0b4930 2024-09-11T23:25:19.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.061+0000 7f3e52e00640 1 -- 172.21.15.144:0/946211107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e4c145430 con 0x7f3e4c0b4930 2024-09-11T23:25:19.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.061+0000 7f3e52e00640 1 -- 172.21.15.144:0/946211107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e4c1459f0 con 0x7f3e4c0b4930 2024-09-11T23:25:19.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.062+0000 7f3e52e00640 1 -- 172.21.15.144:0/946211107 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e4c1620b0 con 0x7f3e4c0b4930 2024-09-11T23:25:19.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.063+0000 7f3e48c00640 1 -- 172.21.15.144:0/946211107 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f3e3c047460 con 0x7f3e4c0b4930 2024-09-11T23:25:19.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.064+0000 7f3e48c00640 1 --2- 172.21.15.144:0/946211107 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e2806c460 0x7f3e2806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.064+0000 7f3e48c00640 1 -- 172.21.15.144:0/946211107 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f3e3c0ac510 con 0x7f3e4c0b4930 2024-09-11T23:25:19.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.065+0000 7f3e43e00640 1 --2- 172.21.15.144:0/946211107 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e2806c460 0x7f3e2806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:19.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.066+0000 7f3e43e00640 1 --2- 172.21.15.144:0/946211107 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e2806c460 0x7f3e2806e920 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c15f060 tx=0x7f3e34008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:19.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.068+0000 7f3e48c00640 1 -- 172.21.15.144:0/946211107 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e3c07a660 con 0x7f3e4c0b4930 2024-09-11T23:25:19.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.242+0000 7f3e52e00640 1 -- 172.21.15.144:0/946211107 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3e4c15b9e0 con 0x7f3e2806c460 2024-09-11T23:25:19.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.249+0000 7f3e48c00640 1 -- 172.21.15.144:0/946211107 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252457 (secure 0 0 0) 0x7f3e4c15b9e0 con 0x7f3e2806c460 2024-09-11T23:25:19.251 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:19.252 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:25:19.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.252+0000 7f3e52e00640 1 -- 172.21.15.144:0/946211107 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e2806c460 msgr2=0x7f3e2806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:19.254 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.252+0000 7f3e52e00640 1 --2- 172.21.15.144:0/946211107 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e2806c460 0x7f3e2806e920 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c15f060 tx=0x7f3e34008040 comp rx=0 tx=0).stop 2024-09-11T23:25:19.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.252+0000 7f3e52e00640 1 -- 172.21.15.144:0/946211107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4c0b4930 msgr2=0x7f3e4c144a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:19.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.252+0000 7f3e52e00640 1 --2- 172.21.15.144:0/946211107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4c0b4930 0x7f3e4c144a70 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c02a180 tx=0x7f3e3c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.252+0000 7f3e52e00640 1 -- 172.21.15.144:0/946211107 shutdown_connections 2024-09-11T23:25:19.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.252+0000 7f3e52e00640 1 --2- 172.21.15.144:0/946211107 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e2806c460 0x7f3e2806e920 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.252+0000 7f3e52e00640 1 --2- 172.21.15.144:0/946211107 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e4c073690 0x7f3e4c1461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.252+0000 7f3e52e00640 1 --2- 172.21.15.144:0/946211107 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e4c15f620 0x7f3e4c15d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.252+0000 7f3e52e00640 1 --2- 172.21.15.144:0/946211107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4c0b4930 0x7f3e4c144a70 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.252+0000 7f3e52e00640 1 -- 172.21.15.144:0/946211107 >> 172.21.15.144:0/946211107 conn(0x7f3e4c062cc0 msgr2=0x7f3e4c1616f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:19.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.253+0000 7f3e52e00640 1 -- 172.21.15.144:0/946211107 shutdown_connections 2024-09-11T23:25:19.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.253+0000 7f3e52e00640 1 -- 172.21.15.144:0/946211107 wait complete. 2024-09-11T23:25:19.269 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2024-09-11T23:25:18.755907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":223,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":166,"ondisk_log_size":166,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264512,"kb_used_data":14984,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754710208,"statfs":{"total":773094113280,"available":772823252992,"internally_reserved":0,"allocated":15343616,"data_stored":7389164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001513"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.705032+0000","last_change":"2024-09-11T23:25:14.697222+0000","last_active":"2024-09-11T23:25:15.705032+0000","last_peered":"2024-09-11T23:25:15.705032+0000","last_clean":"2024-09-11T23:25:15.705032+0000","last_became_active":"2024-09-11T23:25:14.696903+0000","last_became_peered":"2024-09-11T23:25:14.696903+0000","last_unstale":"2024-09-11T23:25:15.705032+0000","last_undegraded":"2024-09-11T23:25:15.705032+0000","last_fullsized":"2024-09-11T23:25:15.705032+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:17.960694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.713391+0000","last_change":"2024-09-11T23:25:14.706857+0000","last_active":"2024-09-11T23:25:14.713391+0000","last_peered":"2024-09-11T23:25:14.713391+0000","last_clean":"2024-09-11T23:25:14.713391+0000","last_became_active":"2024-09-11T23:25:14.706480+0000","last_became_peered":"2024-09-11T23:25:14.706480+0000","last_unstale":"2024-09-11T23:25:14.713391+0000","last_undegraded":"2024-09-11T23:25:14.713391+0000","last_fullsized":"2024-09-11T23:25:14.713391+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:30.713741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704696+0000","last_change":"2024-09-11T23:25:14.708614+0000","last_active":"2024-09-11T23:25:15.704696+0000","last_peered":"2024-09-11T23:25:15.704696+0000","last_clean":"2024-09-11T23:25:15.704696+0000","last_became_active":"2024-09-11T23:25:14.706840+0000","last_became_peered":"2024-09-11T23:25:14.706840+0000","last_unstale":"2024-09-11T23:25:15.704696+0000","last_undegraded":"2024-09-11T23:25:15.704696+0000","last_fullsized":"2024-09-11T23:25:15.704696+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:08.808297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.712489+0000","last_change":"2024-09-11T23:25:14.708110+0000","last_active":"2024-09-11T23:25:14.712489+0000","last_peered":"2024-09-11T23:25:14.712489+0000","last_clean":"2024-09-11T23:25:14.712489+0000","last_became_active":"2024-09-11T23:25:14.707861+0000","last_became_peered":"2024-09-11T23:25:14.707861+0000","last_unstale":"2024-09-11T23:25:14.712489+0000","last_undegraded":"2024-09-11T23:25:14.712489+0000","last_fullsized":"2024-09-11T23:25:14.712489+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:51.674013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.715164+0000","last_change":"2024-09-11T23:25:14.711050+0000","last_active":"2024-09-11T23:25:14.715164+0000","last_peered":"2024-09-11T23:25:14.715164+0000","last_clean":"2024-09-11T23:25:14.715164+0000","last_became_active":"2024-09-11T23:25:14.710774+0000","last_became_peered":"2024-09-11T23:25:14.710774+0000","last_unstale":"2024-09-11T23:25:14.715164+0000","last_undegraded":"2024-09-11T23:25:14.715164+0000","last_fullsized":"2024-09-11T23:25:14.715164+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:24.411377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.703879+0000","last_change":"2024-09-11T23:25:14.702689+0000","last_active":"2024-09-11T23:25:14.703879+0000","last_peered":"2024-09-11T23:25:14.703879+0000","last_clean":"2024-09-11T23:25:14.703879+0000","last_became_active":"2024-09-11T23:25:14.702419+0000","last_became_peered":"2024-09-11T23:25:14.702419+0000","last_unstale":"2024-09-11T23:25:14.703879+0000","last_undegraded":"2024-09-11T23:25:14.703879+0000","last_fullsized":"2024-09-11T23:25:14.703879+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:48.416598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.705004+0000","last_change":"2024-09-11T23:25:14.699435+0000","last_active":"2024-09-11T23:25:14.705004+0000","last_peered":"2024-09-11T23:25:14.705004+0000","last_clean":"2024-09-11T23:25:14.705004+0000","last_became_active":"2024-09-11T23:25:14.698899+0000","last_became_peered":"2024-09-11T23:25:14.698899+0000","last_unstale":"2024-09-11T23:25:14.705004+0000","last_undegraded":"2024-09-11T23:25:14.705004+0000","last_fullsized":"2024-09-11T23:25:14.705004+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:38.787256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.713423+0000","last_change":"2024-09-11T23:25:14.706304+0000","last_active":"2024-09-11T23:25:14.713423+0000","last_peered":"2024-09-11T23:25:14.713423+0000","last_clean":"2024-09-11T23:25:14.713423+0000","last_became_active":"2024-09-11T23:25:14.706040+0000","last_became_peered":"2024-09-11T23:25:14.706040+0000","last_unstale":"2024-09-11T23:25:14.713423+0000","last_undegraded":"2024-09-11T23:25:14.713423+0000","last_fullsized":"2024-09-11T23:25:14.713423+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:31.692286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.715057+0000","last_change":"2024-09-11T23:25:14.708311+0000","last_active":"2024-09-11T23:25:14.715057+0000","last_peered":"2024-09-11T23:25:14.715057+0000","last_clean":"2024-09-11T23:25:14.715057+0000","last_became_active":"2024-09-11T23:25:14.708053+0000","last_became_peered":"2024-09-11T23:25:14.708053+0000","last_unstale":"2024-09-11T23:25:14.715057+0000","last_undegraded":"2024-09-11T23:25:14.715057+0000","last_fullsized":"2024-09-11T23:25:14.715057+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:06.904330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.715111+0000","last_change":"2024-09-11T23:25:14.709293+0000","last_active":"2024-09-11T23:25:14.715111+0000","last_peered":"2024-09-11T23:25:14.715111+0000","last_clean":"2024-09-11T23:25:14.715111+0000","last_became_active":"2024-09-11T23:25:14.708992+0000","last_became_peered":"2024-09-11T23:25:14.708992+0000","last_unstale":"2024-09-11T23:25:14.715111+0000","last_undegraded":"2024-09-11T23:25:14.715111+0000","last_fullsized":"2024-09-11T23:25:14.715111+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:55.472887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.715069+0000","last_change":"2024-09-11T23:25:14.708572+0000","last_active":"2024-09-11T23:25:14.715069+0000","last_peered":"2024-09-11T23:25:14.715069+0000","last_clean":"2024-09-11T23:25:14.715069+0000","last_became_active":"2024-09-11T23:25:14.707869+0000","last_became_peered":"2024-09-11T23:25:14.707869+0000","last_unstale":"2024-09-11T23:25:14.715069+0000","last_undegraded":"2024-09-11T23:25:14.715069+0000","last_fullsized":"2024-09-11T23:25:14.715069+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:33.152744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.713008+0000","last_change":"2024-09-11T23:25:14.704370+0000","last_active":"2024-09-11T23:25:14.713008+0000","last_peered":"2024-09-11T23:25:14.713008+0000","last_clean":"2024-09-11T23:25:14.713008+0000","last_became_active":"2024-09-11T23:25:14.704085+0000","last_became_peered":"2024-09-11T23:25:14.704085+0000","last_unstale":"2024-09-11T23:25:14.713008+0000","last_undegraded":"2024-09-11T23:25:14.713008+0000","last_fullsized":"2024-09-11T23:25:14.713008+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:00.324632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704134+0000","last_change":"2024-09-11T23:25:14.710551+0000","last_active":"2024-09-11T23:25:15.704134+0000","last_peered":"2024-09-11T23:25:15.704134+0000","last_clean":"2024-09-11T23:25:15.704134+0000","last_became_active":"2024-09-11T23:25:14.710065+0000","last_became_peered":"2024-09-11T23:25:14.710065+0000","last_unstale":"2024-09-11T23:25:15.704134+0000","last_undegraded":"2024-09-11T23:25:15.704134+0000","last_fullsized":"2024-09-11T23:25:15.704134+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:55.472887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704098+0000","last_change":"2024-09-11T23:25:14.696114+0000","last_active":"2024-09-11T23:25:15.704098+0000","last_peered":"2024-09-11T23:25:15.704098+0000","last_clean":"2024-09-11T23:25:15.704098+0000","last_became_active":"2024-09-11T23:25:14.695828+0000","last_became_peered":"2024-09-11T23:25:14.695828+0000","last_unstale":"2024-09-11T23:25:15.704098+0000","last_undegraded":"2024-09-11T23:25:15.704098+0000","last_fullsized":"2024-09-11T23:25:15.704098+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:33.152744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703707+0000","last_change":"2024-09-11T23:25:14.693480+0000","last_active":"2024-09-11T23:25:15.703707+0000","last_peered":"2024-09-11T23:25:15.703707+0000","last_clean":"2024-09-11T23:25:15.703707+0000","last_became_active":"2024-09-11T23:25:14.693132+0000","last_became_peered":"2024-09-11T23:25:14.693132+0000","last_unstale":"2024-09-11T23:25:15.703707+0000","last_undegraded":"2024-09-11T23:25:15.703707+0000","last_fullsized":"2024-09-11T23:25:15.703707+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:13.964882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.718671+0000","last_change":"2024-09-11T23:25:14.715606+0000","last_active":"2024-09-11T23:25:14.718671+0000","last_peered":"2024-09-11T23:25:14.718671+0000","last_clean":"2024-09-11T23:25:14.718671+0000","last_became_active":"2024-09-11T23:25:14.714740+0000","last_became_peered":"2024-09-11T23:25:14.714740+0000","last_unstale":"2024-09-11T23:25:14.718671+0000","last_undegraded":"2024-09-11T23:25:14.718671+0000","last_fullsized":"2024-09-11T23:25:14.718671+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:17.458480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.715918+0000","last_change":"2024-09-11T23:25:14.712929+0000","last_active":"2024-09-11T23:25:14.715918+0000","last_peered":"2024-09-11T23:25:14.715918+0000","last_clean":"2024-09-11T23:25:14.715918+0000","last_became_active":"2024-09-11T23:25:14.712657+0000","last_became_peered":"2024-09-11T23:25:14.712657+0000","last_unstale":"2024-09-11T23:25:14.715918+0000","last_undegraded":"2024-09-11T23:25:14.715918+0000","last_fullsized":"2024-09-11T23:25:14.715918+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:35.987119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703086+0000","last_change":"2024-09-11T23:25:14.709204+0000","last_active":"2024-09-11T23:25:15.703086+0000","last_peered":"2024-09-11T23:25:15.703086+0000","last_clean":"2024-09-11T23:25:15.703086+0000","last_became_active":"2024-09-11T23:25:14.708937+0000","last_became_peered":"2024-09-11T23:25:14.708937+0000","last_unstale":"2024-09-11T23:25:15.703086+0000","last_undegraded":"2024-09-11T23:25:15.703086+0000","last_fullsized":"2024-09-11T23:25:15.703086+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:24.886218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.712654+0000","last_change":"2024-09-11T23:25:14.708624+0000","last_active":"2024-09-11T23:25:14.712654+0000","last_peered":"2024-09-11T23:25:14.712654+0000","last_clean":"2024-09-11T23:25:14.712654+0000","last_became_active":"2024-09-11T23:25:14.708322+0000","last_became_peered":"2024-09-11T23:25:14.708322+0000","last_unstale":"2024-09-11T23:25:14.712654+0000","last_undegraded":"2024-09-11T23:25:14.712654+0000","last_fullsized":"2024-09-11T23:25:14.712654+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:20.274064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704230+0000","last_change":"2024-09-11T23:25:14.694876+0000","last_active":"2024-09-11T23:25:15.704230+0000","last_peered":"2024-09-11T23:25:15.704230+0000","last_clean":"2024-09-11T23:25:15.704230+0000","last_became_active":"2024-09-11T23:25:14.694562+0000","last_became_peered":"2024-09-11T23:25:14.694562+0000","last_unstale":"2024-09-11T23:25:15.704230+0000","last_undegraded":"2024-09-11T23:25:15.704230+0000","last_fullsized":"2024-09-11T23:25:15.704230+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:58.807102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.713052+0000","last_change":"2024-09-11T23:25:14.710047+0000","last_active":"2024-09-11T23:25:14.713052+0000","last_peered":"2024-09-11T23:25:14.713052+0000","last_clean":"2024-09-11T23:25:14.713052+0000","last_became_active":"2024-09-11T23:25:14.709782+0000","last_became_peered":"2024-09-11T23:25:14.709782+0000","last_unstale":"2024-09-11T23:25:14.713052+0000","last_undegraded":"2024-09-11T23:25:14.713052+0000","last_fullsized":"2024-09-11T23:25:14.713052+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:05.709686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.713392+0000","last_change":"2024-09-11T23:25:14.704920+0000","last_active":"2024-09-11T23:25:14.713392+0000","last_peered":"2024-09-11T23:25:14.713392+0000","last_clean":"2024-09-11T23:25:14.713392+0000","last_became_active":"2024-09-11T23:25:14.704615+0000","last_became_peered":"2024-09-11T23:25:14.704615+0000","last_unstale":"2024-09-11T23:25:14.713392+0000","last_undegraded":"2024-09-11T23:25:14.713392+0000","last_fullsized":"2024-09-11T23:25:14.713392+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:01.636914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.709243+0000","last_change":"2024-09-11T23:25:14.704832+0000","last_active":"2024-09-11T23:25:14.709243+0000","last_peered":"2024-09-11T23:25:14.709243+0000","last_clean":"2024-09-11T23:25:14.709243+0000","last_became_active":"2024-09-11T23:25:14.703717+0000","last_became_peered":"2024-09-11T23:25:14.703717+0000","last_unstale":"2024-09-11T23:25:14.709243+0000","last_undegraded":"2024-09-11T23:25:14.709243+0000","last_fullsized":"2024-09-11T23:25:14.709243+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:37.476143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.716193+0000","last_change":"2024-09-11T23:25:14.712916+0000","last_active":"2024-09-11T23:25:14.716193+0000","last_peered":"2024-09-11T23:25:14.716193+0000","last_clean":"2024-09-11T23:25:14.716193+0000","last_became_active":"2024-09-11T23:25:14.712602+0000","last_became_peered":"2024-09-11T23:25:14.712602+0000","last_unstale":"2024-09-11T23:25:14.716193+0000","last_undegraded":"2024-09-11T23:25:14.716193+0000","last_fullsized":"2024-09-11T23:25:14.716193+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:32.870238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.705084+0000","last_change":"2024-09-11T23:25:14.697569+0000","last_active":"2024-09-11T23:25:15.705084+0000","last_peered":"2024-09-11T23:25:15.705084+0000","last_clean":"2024-09-11T23:25:15.705084+0000","last_became_active":"2024-09-11T23:25:14.697279+0000","last_became_peered":"2024-09-11T23:25:14.697279+0000","last_unstale":"2024-09-11T23:25:15.705084+0000","last_undegraded":"2024-09-11T23:25:15.705084+0000","last_fullsized":"2024-09-11T23:25:15.705084+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:11.887101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.723592+0000","last_change":"2024-09-11T23:25:14.718546+0000","last_active":"2024-09-11T23:25:14.723592+0000","last_peered":"2024-09-11T23:25:14.723592+0000","last_clean":"2024-09-11T23:25:14.723592+0000","last_became_active":"2024-09-11T23:25:14.718324+0000","last_became_peered":"2024-09-11T23:25:14.718324+0000","last_unstale":"2024-09-11T23:25:14.723592+0000","last_undegraded":"2024-09-11T23:25:14.723592+0000","last_fullsized":"2024-09-11T23:25:14.723592+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:12.590899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704715+0000","last_change":"2024-09-11T23:25:14.695347+0000","last_active":"2024-09-11T23:25:15.704715+0000","last_peered":"2024-09-11T23:25:15.704715+0000","last_clean":"2024-09-11T23:25:15.704715+0000","last_became_active":"2024-09-11T23:25:14.694632+0000","last_became_peered":"2024-09-11T23:25:14.694632+0000","last_unstale":"2024-09-11T23:25:15.704715+0000","last_undegraded":"2024-09-11T23:25:15.704715+0000","last_fullsized":"2024-09-11T23:25:15.704715+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:38.992341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.708989+0000","last_change":"2024-09-11T23:25:14.701787+0000","last_active":"2024-09-11T23:25:14.708989+0000","last_peered":"2024-09-11T23:25:14.708989+0000","last_clean":"2024-09-11T23:25:14.708989+0000","last_became_active":"2024-09-11T23:25:14.698373+0000","last_became_peered":"2024-09-11T23:25:14.698373+0000","last_unstale":"2024-09-11T23:25:14.708989+0000","last_undegraded":"2024-09-11T23:25:14.708989+0000","last_fullsized":"2024-09-11T23:25:14.708989+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:47.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704291+0000","last_change":"2024-09-11T23:25:14.698697+0000","last_active":"2024-09-11T23:25:15.704291+0000","last_peered":"2024-09-11T23:25:15.704291+0000","last_clean":"2024-09-11T23:25:15.704291+0000","last_became_active":"2024-09-11T23:25:14.698408+0000","last_became_peered":"2024-09-11T23:25:14.698408+0000","last_unstale":"2024-09-11T23:25:15.704291+0000","last_undegraded":"2024-09-11T23:25:15.704291+0000","last_fullsized":"2024-09-11T23:25:15.704291+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:32.339705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.706919+0000","last_change":"2024-09-11T23:25:14.702582+0000","last_active":"2024-09-11T23:25:14.706919+0000","last_peered":"2024-09-11T23:25:14.706919+0000","last_clean":"2024-09-11T23:25:14.706919+0000","last_became_active":"2024-09-11T23:25:14.701680+0000","last_became_peered":"2024-09-11T23:25:14.701680+0000","last_unstale":"2024-09-11T23:25:14.706919+0000","last_undegraded":"2024-09-11T23:25:14.706919+0000","last_fullsized":"2024-09-11T23:25:14.706919+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:20.046961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.708790+0000","last_change":"2024-09-11T23:25:14.706832+0000","last_active":"2024-09-11T23:25:14.708790+0000","last_peered":"2024-09-11T23:25:14.708790+0000","last_clean":"2024-09-11T23:25:14.708790+0000","last_became_active":"2024-09-11T23:25:14.706562+0000","last_became_peered":"2024-09-11T23:25:14.706562+0000","last_unstale":"2024-09-11T23:25:14.708790+0000","last_undegraded":"2024-09-11T23:25:14.708790+0000","last_fullsized":"2024-09-11T23:25:14.708790+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:25.028518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.702560+0000","last_change":"2024-09-11T23:25:14.715684+0000","last_active":"2024-09-11T23:25:15.702560+0000","last_peered":"2024-09-11T23:25:15.702560+0000","last_clean":"2024-09-11T23:25:15.702560+0000","last_became_active":"2024-09-11T23:25:14.715424+0000","last_became_peered":"2024-09-11T23:25:14.715424+0000","last_unstale":"2024-09-11T23:25:15.702560+0000","last_undegraded":"2024-09-11T23:25:15.702560+0000","last_fullsized":"2024-09-11T23:25:15.702560+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:17.758083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.723568+0000","last_change":"2024-09-11T23:25:14.718044+0000","last_active":"2024-09-11T23:25:14.723568+0000","last_peered":"2024-09-11T23:25:14.723568+0000","last_clean":"2024-09-11T23:25:14.723568+0000","last_became_active":"2024-09-11T23:25:14.717776+0000","last_became_peered":"2024-09-11T23:25:14.717776+0000","last_unstale":"2024-09-11T23:25:14.723568+0000","last_undegraded":"2024-09-11T23:25:14.723568+0000","last_fullsized":"2024-09-11T23:25:14.723568+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:52.644231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"141'4","reported_seq":18,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.705075+0000","last_change":"2024-09-11T23:25:13.702793+0000","last_active":"2024-09-11T23:25:15.705075+0000","last_peered":"2024-09-11T23:25:15.705075+0000","last_clean":"2024-09-11T23:25:15.705075+0000","last_became_active":"2024-09-11T23:25:13.702469+0000","last_became_peered":"2024-09-11T23:25:13.702469+0000","last_unstale":"2024-09-11T23:25:15.705075+0000","last_undegraded":"2024-09-11T23:25:15.705075+0000","last_fullsized":"2024-09-11T23:25:15.705075+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:43.562815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.712164+0000","last_change":"2024-09-11T23:25:14.710387+0000","last_active":"2024-09-11T23:25:14.712164+0000","last_peered":"2024-09-11T23:25:14.712164+0000","last_clean":"2024-09-11T23:25:14.712164+0000","last_became_active":"2024-09-11T23:25:14.710044+0000","last_became_peered":"2024-09-11T23:25:14.710044+0000","last_unstale":"2024-09-11T23:25:14.712164+0000","last_undegraded":"2024-09-11T23:25:14.712164+0000","last_fullsized":"2024-09-11T23:25:14.712164+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:47.074468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.728838+0000","last_change":"2024-09-11T23:25:13.708150+0000","last_active":"2024-09-11T23:25:14.728838+0000","last_peered":"2024-09-11T23:25:14.728838+0000","last_clean":"2024-09-11T23:25:14.728838+0000","last_became_active":"2024-09-11T23:25:13.707273+0000","last_became_peered":"2024-09-11T23:25:13.707273+0000","last_unstale":"2024-09-11T23:25:14.728838+0000","last_undegraded":"2024-09-11T23:25:14.728838+0000","last_fullsized":"2024-09-11T23:25:14.728838+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:10.884338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.709458+0000","last_change":"2024-09-11T23:25:14.703954+0000","last_active":"2024-09-11T23:25:14.709458+0000","last_peered":"2024-09-11T23:25:14.709458+0000","last_clean":"2024-09-11T23:25:14.709458+0000","last_became_active":"2024-09-11T23:25:14.703666+0000","last_became_peered":"2024-09-11T23:25:14.703666+0000","last_unstale":"2024-09-11T23:25:14.709458+0000","last_undegraded":"2024-09-11T23:25:14.709458+0000","last_fullsized":"2024-09-11T23:25:14.709458+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:04.504470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.731284+0000","last_change":"2024-09-11T23:25:13.708221+0000","last_active":"2024-09-11T23:25:14.731284+0000","last_peered":"2024-09-11T23:25:14.731284+0000","last_clean":"2024-09-11T23:25:14.731284+0000","last_became_active":"2024-09-11T23:25:13.707961+0000","last_became_peered":"2024-09-11T23:25:13.707961+0000","last_unstale":"2024-09-11T23:25:14.731284+0000","last_undegraded":"2024-09-11T23:25:14.731284+0000","last_fullsized":"2024-09-11T23:25:14.731284+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:37.989578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704846+0000","last_change":"2024-09-11T23:25:14.698120+0000","last_active":"2024-09-11T23:25:15.704846+0000","last_peered":"2024-09-11T23:25:15.704846+0000","last_clean":"2024-09-11T23:25:15.704846+0000","last_became_active":"2024-09-11T23:25:14.697847+0000","last_became_peered":"2024-09-11T23:25:14.697847+0000","last_unstale":"2024-09-11T23:25:15.704846+0000","last_undegraded":"2024-09-11T23:25:15.704846+0000","last_fullsized":"2024-09-11T23:25:15.704846+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:58.650351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.729490+0000","last_change":"2024-09-11T23:25:13.700457+0000","last_active":"2024-09-11T23:25:14.729490+0000","last_peered":"2024-09-11T23:25:14.729490+0000","last_clean":"2024-09-11T23:25:14.729490+0000","last_became_active":"2024-09-11T23:25:13.699132+0000","last_became_peered":"2024-09-11T23:25:13.699132+0000","last_unstale":"2024-09-11T23:25:14.729490+0000","last_undegraded":"2024-09-11T23:25:14.729490+0000","last_fullsized":"2024-09-11T23:25:14.729490+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:57.647588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.715556+0000","last_change":"2024-09-11T23:25:14.713204+0000","last_active":"2024-09-11T23:25:14.715556+0000","last_peered":"2024-09-11T23:25:14.715556+0000","last_clean":"2024-09-11T23:25:14.715556+0000","last_became_active":"2024-09-11T23:25:14.712923+0000","last_became_peered":"2024-09-11T23:25:14.712923+0000","last_unstale":"2024-09-11T23:25:14.715556+0000","last_undegraded":"2024-09-11T23:25:14.715556+0000","last_fullsized":"2024-09-11T23:25:14.715556+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:55.301077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"141'1","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704409+0000","last_change":"2024-09-11T23:25:13.698242+0000","last_active":"2024-09-11T23:25:15.704409+0000","last_peered":"2024-09-11T23:25:15.704409+0000","last_clean":"2024-09-11T23:25:15.704409+0000","last_became_active":"2024-09-11T23:25:13.697774+0000","last_became_peered":"2024-09-11T23:25:13.697774+0000","last_unstale":"2024-09-11T23:25:15.704409+0000","last_undegraded":"2024-09-11T23:25:15.704409+0000","last_fullsized":"2024-09-11T23:25:15.704409+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:55.809859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.718829+0000","last_change":"2024-09-11T23:25:14.715638+0000","last_active":"2024-09-11T23:25:14.718829+0000","last_peered":"2024-09-11T23:25:14.718829+0000","last_clean":"2024-09-11T23:25:14.718829+0000","last_became_active":"2024-09-11T23:25:14.715379+0000","last_became_peered":"2024-09-11T23:25:14.715379+0000","last_unstale":"2024-09-11T23:25:14.718829+0000","last_undegraded":"2024-09-11T23:25:14.718829+0000","last_fullsized":"2024-09-11T23:25:14.718829+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:30.211211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.728572+0000","last_change":"2024-09-11T23:25:13.703129+0000","last_active":"2024-09-11T23:25:14.728572+0000","last_peered":"2024-09-11T23:25:14.728572+0000","last_clean":"2024-09-11T23:25:14.728572+0000","last_became_active":"2024-09-11T23:25:13.702882+0000","last_became_peered":"2024-09-11T23:25:13.702882+0000","last_unstale":"2024-09-11T23:25:14.728572+0000","last_undegraded":"2024-09-11T23:25:14.728572+0000","last_fullsized":"2024-09-11T23:25:14.728572+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:54.470124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.699523+0000","last_change":"2024-09-11T23:25:14.695517+0000","last_active":"2024-09-11T23:25:14.699523+0000","last_peered":"2024-09-11T23:25:14.699523+0000","last_clean":"2024-09-11T23:25:14.699523+0000","last_became_active":"2024-09-11T23:25:14.694908+0000","last_became_peered":"2024-09-11T23:25:14.694908+0000","last_unstale":"2024-09-11T23:25:14.699523+0000","last_undegraded":"2024-09-11T23:25:14.699523+0000","last_fullsized":"2024-09-11T23:25:14.699523+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:11.887101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.698416+0000","last_change":"2024-09-11T23:25:13.708545+0000","last_active":"2024-09-11T23:25:14.698416+0000","last_peered":"2024-09-11T23:25:14.698416+0000","last_clean":"2024-09-11T23:25:14.698416+0000","last_became_active":"2024-09-11T23:25:13.707531+0000","last_became_peered":"2024-09-11T23:25:13.707531+0000","last_unstale":"2024-09-11T23:25:14.698416+0000","last_undegraded":"2024-09-11T23:25:14.698416+0000","last_fullsized":"2024-09-11T23:25:14.698416+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:57.035393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.709280+0000","last_change":"2024-09-11T23:25:14.705794+0000","last_active":"2024-09-11T23:25:14.709280+0000","last_peered":"2024-09-11T23:25:14.709280+0000","last_clean":"2024-09-11T23:25:14.709280+0000","last_became_active":"2024-09-11T23:25:14.705497+0000","last_became_peered":"2024-09-11T23:25:14.705497+0000","last_unstale":"2024-09-11T23:25:14.709280+0000","last_undegraded":"2024-09-11T23:25:14.709280+0000","last_fullsized":"2024-09-11T23:25:14.709280+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:59.354101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.703611+0000","last_change":"2024-09-11T23:25:13.699934+0000","last_active":"2024-09-11T23:25:14.703611+0000","last_peered":"2024-09-11T23:25:14.703611+0000","last_clean":"2024-09-11T23:25:14.703611+0000","last_became_active":"2024-09-11T23:25:13.699651+0000","last_became_peered":"2024-09-11T23:25:13.699651+0000","last_unstale":"2024-09-11T23:25:14.703611+0000","last_undegraded":"2024-09-11T23:25:14.703611+0000","last_fullsized":"2024-09-11T23:25:14.703611+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:24.713257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703436+0000","last_change":"2024-09-11T23:25:14.717435+0000","last_active":"2024-09-11T23:25:15.703436+0000","last_peered":"2024-09-11T23:25:15.703436+0000","last_clean":"2024-09-11T23:25:15.703436+0000","last_became_active":"2024-09-11T23:25:14.717182+0000","last_became_peered":"2024-09-11T23:25:14.717182+0000","last_unstale":"2024-09-11T23:25:15.703436+0000","last_undegraded":"2024-09-11T23:25:15.703436+0000","last_fullsized":"2024-09-11T23:25:15.703436+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:40.137449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.700530+0000","last_change":"2024-09-11T23:25:13.699240+0000","last_active":"2024-09-11T23:25:14.700530+0000","last_peered":"2024-09-11T23:25:14.700530+0000","last_clean":"2024-09-11T23:25:14.700530+0000","last_became_active":"2024-09-11T23:25:13.698962+0000","last_became_peered":"2024-09-11T23:25:13.698962+0000","last_unstale":"2024-09-11T23:25:14.700530+0000","last_undegraded":"2024-09-11T23:25:14.700530+0000","last_fullsized":"2024-09-11T23:25:14.700530+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:55.001578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703123+0000","last_change":"2024-09-11T23:25:14.718303+0000","last_active":"2024-09-11T23:25:15.703123+0000","last_peered":"2024-09-11T23:25:15.703123+0000","last_clean":"2024-09-11T23:25:15.703123+0000","last_became_active":"2024-09-11T23:25:14.714186+0000","last_became_peered":"2024-09-11T23:25:14.714186+0000","last_unstale":"2024-09-11T23:25:15.703123+0000","last_undegraded":"2024-09-11T23:25:15.703123+0000","last_fullsized":"2024-09-11T23:25:15.703123+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:34.149308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"141'3","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.732031+0000","last_change":"2024-09-11T23:25:13.703061+0000","last_active":"2024-09-11T23:25:14.732031+0000","last_peered":"2024-09-11T23:25:14.732031+0000","last_clean":"2024-09-11T23:25:14.732031+0000","last_became_active":"2024-09-11T23:25:13.702832+0000","last_became_peered":"2024-09-11T23:25:13.702832+0000","last_unstale":"2024-09-11T23:25:14.732031+0000","last_undegraded":"2024-09-11T23:25:14.732031+0000","last_fullsized":"2024-09-11T23:25:14.732031+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:35.572326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.716409+0000","last_change":"2024-09-11T23:25:14.713149+0000","last_active":"2024-09-11T23:25:14.716409+0000","last_peered":"2024-09-11T23:25:14.716409+0000","last_clean":"2024-09-11T23:25:14.716409+0000","last_became_active":"2024-09-11T23:25:14.712615+0000","last_became_peered":"2024-09-11T23:25:14.712615+0000","last_unstale":"2024-09-11T23:25:14.716409+0000","last_undegraded":"2024-09-11T23:25:14.716409+0000","last_fullsized":"2024-09-11T23:25:14.716409+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:05.956187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"141'6","reported_seq":18,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.735550+0000","last_change":"2024-09-11T23:25:13.699270+0000","last_active":"2024-09-11T23:25:14.735550+0000","last_peered":"2024-09-11T23:25:14.735550+0000","last_clean":"2024-09-11T23:25:14.735550+0000","last_became_active":"2024-09-11T23:25:13.698944+0000","last_became_peered":"2024-09-11T23:25:13.698944+0000","last_unstale":"2024-09-11T23:25:14.735550+0000","last_undegraded":"2024-09-11T23:25:14.735550+0000","last_fullsized":"2024-09-11T23:25:14.735550+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:07.805534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.702834+0000","last_change":"2024-09-11T23:25:14.710562+0000","last_active":"2024-09-11T23:25:15.702834+0000","last_peered":"2024-09-11T23:25:15.702834+0000","last_clean":"2024-09-11T23:25:15.702834+0000","last_became_active":"2024-09-11T23:25:14.710300+0000","last_became_peered":"2024-09-11T23:25:14.710300+0000","last_unstale":"2024-09-11T23:25:15.702834+0000","last_undegraded":"2024-09-11T23:25:15.702834+0000","last_fullsized":"2024-09-11T23:25:15.702834+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:19.866952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.729212+0000","last_change":"2024-09-11T23:25:13.703931+0000","last_active":"2024-09-11T23:25:14.729212+0000","last_peered":"2024-09-11T23:25:14.729212+0000","last_clean":"2024-09-11T23:25:14.729212+0000","last_became_active":"2024-09-11T23:25:13.703594+0000","last_became_peered":"2024-09-11T23:25:13.703594+0000","last_unstale":"2024-09-11T23:25:14.729212+0000","last_undegraded":"2024-09-11T23:25:14.729212+0000","last_fullsized":"2024-09-11T23:25:14.729212+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:31.336941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.723903+0000","last_change":"2024-09-11T23:25:14.720167+0000","last_active":"2024-09-11T23:25:14.723903+0000","last_peered":"2024-09-11T23:25:14.723903+0000","last_clean":"2024-09-11T23:25:14.723903+0000","last_became_active":"2024-09-11T23:25:14.719902+0000","last_became_peered":"2024-09-11T23:25:14.719902+0000","last_unstale":"2024-09-11T23:25:14.723903+0000","last_undegraded":"2024-09-11T23:25:14.723903+0000","last_fullsized":"2024-09-11T23:25:14.723903+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:17.960694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.702922+0000","last_change":"2024-09-11T23:25:13.695686+0000","last_active":"2024-09-11T23:25:15.702922+0000","last_peered":"2024-09-11T23:25:15.702922+0000","last_clean":"2024-09-11T23:25:15.702922+0000","last_became_active":"2024-09-11T23:25:13.695432+0000","last_became_peered":"2024-09-11T23:25:13.695432+0000","last_unstale":"2024-09-11T23:25:15.702922+0000","last_undegraded":"2024-09-11T23:25:15.702922+0000","last_fullsized":"2024-09-11T23:25:15.702922+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:25.604051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.699547+0000","last_change":"2024-09-11T23:25:14.695741+0000","last_active":"2024-09-11T23:25:14.699547+0000","last_peered":"2024-09-11T23:25:14.699547+0000","last_clean":"2024-09-11T23:25:14.699547+0000","last_became_active":"2024-09-11T23:25:14.695259+0000","last_became_peered":"2024-09-11T23:25:14.695259+0000","last_unstale":"2024-09-11T23:25:14.699547+0000","last_undegraded":"2024-09-11T23:25:14.699547+0000","last_fullsized":"2024-09-11T23:25:14.699547+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:20.046961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.687936+0000","last_change":"2024-09-11T23:25:13.708207+0000","last_active":"2024-09-11T23:25:14.687936+0000","last_peered":"2024-09-11T23:25:14.687936+0000","last_clean":"2024-09-11T23:25:14.687936+0000","last_became_active":"2024-09-11T23:25:13.707824+0000","last_became_peered":"2024-09-11T23:25:13.707824+0000","last_unstale":"2024-09-11T23:25:14.687936+0000","last_undegraded":"2024-09-11T23:25:14.687936+0000","last_fullsized":"2024-09-11T23:25:14.687936+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:23.408614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704014+0000","last_change":"2024-09-11T23:25:14.708038+0000","last_active":"2024-09-11T23:25:15.704014+0000","last_peered":"2024-09-11T23:25:15.704014+0000","last_clean":"2024-09-11T23:25:15.704014+0000","last_became_active":"2024-09-11T23:25:14.706294+0000","last_became_peered":"2024-09-11T23:25:14.706294+0000","last_unstale":"2024-09-11T23:25:15.704014+0000","last_undegraded":"2024-09-11T23:25:15.704014+0000","last_fullsized":"2024-09-11T23:25:15.704014+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:06.904330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"141'8","reported_seq":20,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.733939+0000","last_change":"2024-09-11T23:25:13.698164+0000","last_active":"2024-09-11T23:25:14.733939+0000","last_peered":"2024-09-11T23:25:14.733939+0000","last_clean":"2024-09-11T23:25:14.733939+0000","last_became_active":"2024-09-11T23:25:13.697280+0000","last_became_peered":"2024-09-11T23:25:13.697280+0000","last_unstale":"2024-09-11T23:25:14.733939+0000","last_undegraded":"2024-09-11T23:25:14.733939+0000","last_fullsized":"2024-09-11T23:25:14.733939+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:57.804339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.706386+0000","last_change":"2024-09-11T23:25:14.698307+0000","last_active":"2024-09-11T23:25:14.706386+0000","last_peered":"2024-09-11T23:25:14.706386+0000","last_clean":"2024-09-11T23:25:14.706386+0000","last_became_active":"2024-09-11T23:25:14.698010+0000","last_became_peered":"2024-09-11T23:25:14.698010+0000","last_unstale":"2024-09-11T23:25:14.706386+0000","last_undegraded":"2024-09-11T23:25:14.706386+0000","last_fullsized":"2024-09-11T23:25:14.706386+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:25.028518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"141'1","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.705042+0000","last_change":"2024-09-11T23:25:13.708531+0000","last_active":"2024-09-11T23:25:15.705042+0000","last_peered":"2024-09-11T23:25:15.705042+0000","last_clean":"2024-09-11T23:25:15.705042+0000","last_became_active":"2024-09-11T23:25:13.708217+0000","last_became_peered":"2024-09-11T23:25:13.708217+0000","last_unstale":"2024-09-11T23:25:15.705042+0000","last_undegraded":"2024-09-11T23:25:15.705042+0000","last_fullsized":"2024-09-11T23:25:15.705042+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:30.928125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703435+0000","last_change":"2024-09-11T23:25:14.711364+0000","last_active":"2024-09-11T23:25:15.703435+0000","last_peered":"2024-09-11T23:25:15.703435+0000","last_clean":"2024-09-11T23:25:15.703435+0000","last_became_active":"2024-09-11T23:25:14.711050+0000","last_became_peered":"2024-09-11T23:25:14.711050+0000","last_unstale":"2024-09-11T23:25:15.703435+0000","last_undegraded":"2024-09-11T23:25:15.703435+0000","last_fullsized":"2024-09-11T23:25:15.703435+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:54.484292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"141'2","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704701+0000","last_change":"2024-09-11T23:25:13.704751+0000","last_active":"2024-09-11T23:25:15.704701+0000","last_peered":"2024-09-11T23:25:15.704701+0000","last_clean":"2024-09-11T23:25:15.704701+0000","last_became_active":"2024-09-11T23:25:13.704452+0000","last_became_peered":"2024-09-11T23:25:13.704452+0000","last_unstale":"2024-09-11T23:25:15.704701+0000","last_undegraded":"2024-09-11T23:25:15.704701+0000","last_fullsized":"2024-09-11T23:25:15.704701+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:54.144955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.712514+0000","last_change":"2024-09-11T23:25:14.708839+0000","last_active":"2024-09-11T23:25:14.712514+0000","last_peered":"2024-09-11T23:25:14.712514+0000","last_clean":"2024-09-11T23:25:14.712514+0000","last_became_active":"2024-09-11T23:25:14.706208+0000","last_became_peered":"2024-09-11T23:25:14.706208+0000","last_unstale":"2024-09-11T23:25:14.712514+0000","last_undegraded":"2024-09-11T23:25:14.712514+0000","last_fullsized":"2024-09-11T23:25:14.712514+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:05.956187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"141'1","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704759+0000","last_change":"2024-09-11T23:25:13.704861+0000","last_active":"2024-09-11T23:25:15.704759+0000","last_peered":"2024-09-11T23:25:15.704759+0000","last_clean":"2024-09-11T23:25:15.704759+0000","last_became_active":"2024-09-11T23:25:13.704575+0000","last_became_peered":"2024-09-11T23:25:13.704575+0000","last_unstale":"2024-09-11T23:25:15.704759+0000","last_undegraded":"2024-09-11T23:25:15.704759+0000","last_fullsized":"2024-09-11T23:25:15.704759+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:24.713257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.712125+0000","last_change":"2024-09-11T23:25:14.707127+0000","last_active":"2024-09-11T23:25:14.712125+0000","last_peered":"2024-09-11T23:25:14.712125+0000","last_clean":"2024-09-11T23:25:14.712125+0000","last_became_active":"2024-09-11T23:25:14.706619+0000","last_became_peered":"2024-09-11T23:25:14.706619+0000","last_unstale":"2024-09-11T23:25:14.712125+0000","last_undegraded":"2024-09-11T23:25:14.712125+0000","last_fullsized":"2024-09-11T23:25:14.712125+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:58.264121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704620+0000","last_change":"2024-09-11T23:25:13.705699+0000","last_active":"2024-09-11T23:25:15.704620+0000","last_peered":"2024-09-11T23:25:15.704620+0000","last_clean":"2024-09-11T23:25:15.704620+0000","last_became_active":"2024-09-11T23:25:13.704902+0000","last_became_peered":"2024-09-11T23:25:13.704902+0000","last_unstale":"2024-09-11T23:25:15.704620+0000","last_undegraded":"2024-09-11T23:25:15.704620+0000","last_fullsized":"2024-09-11T23:25:15.704620+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:57.261358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704228+0000","last_change":"2024-09-11T23:25:14.711678+0000","last_active":"2024-09-11T23:25:15.704228+0000","last_peered":"2024-09-11T23:25:15.704228+0000","last_clean":"2024-09-11T23:25:15.704228+0000","last_became_active":"2024-09-11T23:25:14.711377+0000","last_became_peered":"2024-09-11T23:25:14.711377+0000","last_unstale":"2024-09-11T23:25:15.704228+0000","last_undegraded":"2024-09-11T23:25:15.704228+0000","last_fullsized":"2024-09-11T23:25:15.704228+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:32.870238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.734149+0000","last_change":"2024-09-11T23:25:13.708319+0000","last_active":"2024-09-11T23:25:14.734149+0000","last_peered":"2024-09-11T23:25:14.734149+0000","last_clean":"2024-09-11T23:25:14.734149+0000","last_became_active":"2024-09-11T23:25:13.708024+0000","last_became_peered":"2024-09-11T23:25:13.708024+0000","last_unstale":"2024-09-11T23:25:14.734149+0000","last_undegraded":"2024-09-11T23:25:14.734149+0000","last_fullsized":"2024-09-11T23:25:14.734149+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:07.805534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.717677+0000","last_change":"2024-09-11T23:25:14.707768+0000","last_active":"2024-09-11T23:25:14.717677+0000","last_peered":"2024-09-11T23:25:14.717677+0000","last_clean":"2024-09-11T23:25:14.717677+0000","last_became_active":"2024-09-11T23:25:14.707467+0000","last_became_peered":"2024-09-11T23:25:14.707467+0000","last_unstale":"2024-09-11T23:25:14.717677+0000","last_undegraded":"2024-09-11T23:25:14.717677+0000","last_fullsized":"2024-09-11T23:25:14.717677+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:07.513028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704362+0000","last_change":"2024-09-11T23:25:13.707947+0000","last_active":"2024-09-11T23:25:15.704362+0000","last_peered":"2024-09-11T23:25:15.704362+0000","last_clean":"2024-09-11T23:25:15.704362+0000","last_became_active":"2024-09-11T23:25:13.707680+0000","last_became_peered":"2024-09-11T23:25:13.707680+0000","last_unstale":"2024-09-11T23:25:15.704362+0000","last_undegraded":"2024-09-11T23:25:15.704362+0000","last_fullsized":"2024-09-11T23:25:15.704362+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:50.334364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703742+0000","last_change":"2024-09-11T23:25:14.705055+0000","last_active":"2024-09-11T23:25:15.703742+0000","last_peered":"2024-09-11T23:25:15.703742+0000","last_clean":"2024-09-11T23:25:15.703742+0000","last_became_active":"2024-09-11T23:25:14.704756+0000","last_became_peered":"2024-09-11T23:25:14.704756+0000","last_unstale":"2024-09-11T23:25:15.703742+0000","last_undegraded":"2024-09-11T23:25:15.703742+0000","last_fullsized":"2024-09-11T23:25:15.703742+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:12.590899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.688002+0000","last_change":"2024-09-11T23:25:13.700997+0000","last_active":"2024-09-11T23:25:14.688002+0000","last_peered":"2024-09-11T23:25:14.688002+0000","last_clean":"2024-09-11T23:25:14.688002+0000","last_became_active":"2024-09-11T23:25:13.699433+0000","last_became_peered":"2024-09-11T23:25:13.699433+0000","last_unstale":"2024-09-11T23:25:14.688002+0000","last_undegraded":"2024-09-11T23:25:14.688002+0000","last_fullsized":"2024-09-11T23:25:14.688002+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:31.867475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.709263+0000","last_change":"2024-09-11T23:25:14.704869+0000","last_active":"2024-09-11T23:25:14.709263+0000","last_peered":"2024-09-11T23:25:14.709263+0000","last_clean":"2024-09-11T23:25:14.709263+0000","last_became_active":"2024-09-11T23:25:14.704556+0000","last_became_peered":"2024-09-11T23:25:14.704556+0000","last_unstale":"2024-09-11T23:25:14.709263+0000","last_undegraded":"2024-09-11T23:25:14.709263+0000","last_fullsized":"2024-09-11T23:25:14.709263+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:19.536266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703988+0000","last_change":"2024-09-11T23:25:13.704742+0000","last_active":"2024-09-11T23:25:15.703988+0000","last_peered":"2024-09-11T23:25:15.703988+0000","last_clean":"2024-09-11T23:25:15.703988+0000","last_became_active":"2024-09-11T23:25:13.704404+0000","last_became_peered":"2024-09-11T23:25:13.704404+0000","last_unstale":"2024-09-11T23:25:15.703988+0000","last_undegraded":"2024-09-11T23:25:15.703988+0000","last_fullsized":"2024-09-11T23:25:15.703988+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:37.784493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703370+0000","last_change":"2024-09-11T23:25:14.716535+0000","last_active":"2024-09-11T23:25:15.703370+0000","last_peered":"2024-09-11T23:25:15.703370+0000","last_clean":"2024-09-11T23:25:15.703370+0000","last_became_active":"2024-09-11T23:25:14.716263+0000","last_became_peered":"2024-09-11T23:25:14.716263+0000","last_unstale":"2024-09-11T23:25:15.703370+0000","last_undegraded":"2024-09-11T23:25:15.703370+0000","last_fullsized":"2024-09-11T23:25:15.703370+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:39.260235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"141'2","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703514+0000","last_change":"2024-09-11T23:25:13.707494+0000","last_active":"2024-09-11T23:25:15.703514+0000","last_peered":"2024-09-11T23:25:15.703514+0000","last_clean":"2024-09-11T23:25:15.703514+0000","last_became_active":"2024-09-11T23:25:13.707198+0000","last_became_peered":"2024-09-11T23:25:13.707198+0000","last_unstale":"2024-09-11T23:25:15.703514+0000","last_undegraded":"2024-09-11T23:25:15.703514+0000","last_fullsized":"2024-09-11T23:25:15.703514+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:12.758736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.723496+0000","last_change":"2024-09-11T23:25:14.718189+0000","last_active":"2024-09-11T23:25:14.723496+0000","last_peered":"2024-09-11T23:25:14.723496+0000","last_clean":"2024-09-11T23:25:14.723496+0000","last_became_active":"2024-09-11T23:25:14.717884+0000","last_became_peered":"2024-09-11T23:25:14.717884+0000","last_unstale":"2024-09-11T23:25:14.723496+0000","last_undegraded":"2024-09-11T23:25:14.723496+0000","last_fullsized":"2024-09-11T23:25:14.723496+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:13.964882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704818+0000","last_change":"2024-09-11T23:25:13.696644+0000","last_active":"2024-09-11T23:25:15.704818+0000","last_peered":"2024-09-11T23:25:15.704818+0000","last_clean":"2024-09-11T23:25:15.704818+0000","last_became_active":"2024-09-11T23:25:13.696275+0000","last_became_peered":"2024-09-11T23:25:13.696275+0000","last_unstale":"2024-09-11T23:25:15.704818+0000","last_undegraded":"2024-09-11T23:25:15.704818+0000","last_fullsized":"2024-09-11T23:25:15.704818+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:31.490111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.709481+0000","last_change":"2024-09-11T23:25:14.707227+0000","last_active":"2024-09-11T23:25:14.709481+0000","last_peered":"2024-09-11T23:25:14.709481+0000","last_clean":"2024-09-11T23:25:14.709481+0000","last_became_active":"2024-09-11T23:25:14.706822+0000","last_became_peered":"2024-09-11T23:25:14.706822+0000","last_unstale":"2024-09-11T23:25:14.709481+0000","last_undegraded":"2024-09-11T23:25:14.709481+0000","last_fullsized":"2024-09-11T23:25:14.709481+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:09:46.506384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.699887+0000","last_change":"2024-09-11T23:25:13.704197+0000","last_active":"2024-09-11T23:25:14.699887+0000","last_peered":"2024-09-11T23:25:14.699887+0000","last_clean":"2024-09-11T23:25:14.699887+0000","last_became_active":"2024-09-11T23:25:13.703225+0000","last_became_peered":"2024-09-11T23:25:13.703225+0000","last_unstale":"2024-09-11T23:25:14.699887+0000","last_undegraded":"2024-09-11T23:25:14.699887+0000","last_fullsized":"2024-09-11T23:25:14.699887+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:22.768093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703168+0000","last_change":"2024-09-11T23:25:14.714242+0000","last_active":"2024-09-11T23:25:15.703168+0000","last_peered":"2024-09-11T23:25:15.703168+0000","last_clean":"2024-09-11T23:25:15.703168+0000","last_became_active":"2024-09-11T23:25:14.713973+0000","last_became_peered":"2024-09-11T23:25:14.713973+0000","last_unstale":"2024-09-11T23:25:15.703168+0000","last_undegraded":"2024-09-11T23:25:15.703168+0000","last_fullsized":"2024-09-11T23:25:15.703168+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:06.755051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703125+0000","last_change":"2024-09-11T23:25:13.695649+0000","last_active":"2024-09-11T23:25:15.703125+0000","last_peered":"2024-09-11T23:25:15.703125+0000","last_clean":"2024-09-11T23:25:15.703125+0000","last_became_active":"2024-09-11T23:25:13.695042+0000","last_became_peered":"2024-09-11T23:25:13.695042+0000","last_unstale":"2024-09-11T23:25:15.703125+0000","last_undegraded":"2024-09-11T23:25:15.703125+0000","last_fullsized":"2024-09-11T23:25:15.703125+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:07.283654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.702850+0000","last_change":"2024-09-11T23:25:14.710987+0000","last_active":"2024-09-11T23:25:15.702850+0000","last_peered":"2024-09-11T23:25:15.702850+0000","last_clean":"2024-09-11T23:25:15.702850+0000","last_became_active":"2024-09-11T23:25:14.708510+0000","last_became_peered":"2024-09-11T23:25:14.708510+0000","last_unstale":"2024-09-11T23:25:15.702850+0000","last_undegraded":"2024-09-11T23:25:15.702850+0000","last_fullsized":"2024-09-11T23:25:15.702850+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:05.130244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.700000+0000","last_change":"2024-09-11T23:25:13.703435+0000","last_active":"2024-09-11T23:25:14.700000+0000","last_peered":"2024-09-11T23:25:14.700000+0000","last_clean":"2024-09-11T23:25:14.700000+0000","last_became_active":"2024-09-11T23:25:13.703169+0000","last_became_peered":"2024-09-11T23:25:13.703169+0000","last_unstale":"2024-09-11T23:25:14.700000+0000","last_undegraded":"2024-09-11T23:25:14.700000+0000","last_fullsized":"2024-09-11T23:25:14.700000+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:37.989578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.713436+0000","last_change":"2024-09-11T23:25:14.710534+0000","last_active":"2024-09-11T23:25:14.713436+0000","last_peered":"2024-09-11T23:25:14.713436+0000","last_clean":"2024-09-11T23:25:14.713436+0000","last_became_active":"2024-09-11T23:25:14.710074+0000","last_became_peered":"2024-09-11T23:25:14.710074+0000","last_unstale":"2024-09-11T23:25:14.713436+0000","last_undegraded":"2024-09-11T23:25:14.713436+0000","last_fullsized":"2024-09-11T23:25:14.713436+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:51.674013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.688099+0000","last_change":"2024-09-11T23:25:13.700336+0000","last_active":"2024-09-11T23:25:14.688099+0000","last_peered":"2024-09-11T23:25:14.688099+0000","last_clean":"2024-09-11T23:25:14.688099+0000","last_became_active":"2024-09-11T23:25:13.699644+0000","last_became_peered":"2024-09-11T23:25:13.699644+0000","last_unstale":"2024-09-11T23:25:14.688099+0000","last_undegraded":"2024-09-11T23:25:14.688099+0000","last_fullsized":"2024-09-11T23:25:14.688099+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:57.804339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.715489+0000","last_change":"2024-09-11T23:25:14.706010+0000","last_active":"2024-09-11T23:25:14.715489+0000","last_peered":"2024-09-11T23:25:14.715489+0000","last_clean":"2024-09-11T23:25:14.715489+0000","last_became_active":"2024-09-11T23:25:14.705730+0000","last_became_peered":"2024-09-11T23:25:14.705730+0000","last_unstale":"2024-09-11T23:25:14.715489+0000","last_undegraded":"2024-09-11T23:25:14.715489+0000","last_fullsized":"2024-09-11T23:25:14.715489+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:44.565579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.698563+0000","last_change":"2024-09-11T23:25:13.703834+0000","last_active":"2024-09-11T23:25:14.698563+0000","last_peered":"2024-09-11T23:25:14.698563+0000","last_clean":"2024-09-11T23:25:14.698563+0000","last_became_active":"2024-09-11T23:25:13.703579+0000","last_became_peered":"2024-09-11T23:25:13.703579+0000","last_unstale":"2024-09-11T23:25:14.698563+0000","last_undegraded":"2024-09-11T23:25:14.698563+0000","last_fullsized":"2024-09-11T23:25:14.698563+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:19.888993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.704163+0000","last_change":"2024-09-11T23:25:14.697052+0000","last_active":"2024-09-11T23:25:15.704163+0000","last_peered":"2024-09-11T23:25:15.704163+0000","last_clean":"2024-09-11T23:25:15.704163+0000","last_became_active":"2024-09-11T23:25:14.696749+0000","last_became_peered":"2024-09-11T23:25:14.696749+0000","last_unstale":"2024-09-11T23:25:15.704163+0000","last_undegraded":"2024-09-11T23:25:15.704163+0000","last_fullsized":"2024-09-11T23:25:15.704163+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:24.411377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.698873+0000","last_change":"2024-09-11T23:25:13.702795+0000","last_active":"2024-09-11T23:25:14.698873+0000","last_peered":"2024-09-11T23:25:14.698873+0000","last_clean":"2024-09-11T23:25:14.698873+0000","last_became_active":"2024-09-11T23:25:13.702507+0000","last_became_peered":"2024-09-11T23:25:13.702507+0000","last_unstale":"2024-09-11T23:25:14.698873+0000","last_undegraded":"2024-09-11T23:25:14.698873+0000","last_fullsized":"2024-09-11T23:25:14.698873+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:31.336941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703154+0000","last_change":"2024-09-11T23:25:14.715401+0000","last_active":"2024-09-11T23:25:15.703154+0000","last_peered":"2024-09-11T23:25:15.703154+0000","last_clean":"2024-09-11T23:25:15.703154+0000","last_became_active":"2024-09-11T23:25:14.715120+0000","last_became_peered":"2024-09-11T23:25:14.715120+0000","last_unstale":"2024-09-11T23:25:15.703154+0000","last_undegraded":"2024-09-11T23:25:15.703154+0000","last_fullsized":"2024-09-11T23:25:15.703154+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:13.675879+0000","last_clean_scrub_stamp":"2024-09-11T23:25:13.675879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:10.733724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-11T23:25:14.700933+0000","last_change":"2024-09-11T23:25:13.702400+0000","last_active":"2024-09-11T23:25:14.700933+0000","last_peered":"2024-09-11T23:25:14.700933+0000","last_clean":"2024-09-11T23:25:14.700933+0000","last_became_active":"2024-09-11T23:25:13.701842+0000","last_became_peered":"2024-09-11T23:25:13.701842+0000","last_unstale":"2024-09-11T23:25:14.700933+0000","last_undegraded":"2024-09-11T23:25:14.700933+0000","last_fullsized":"2024-09-11T23:25:14.700933+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:12.673116+0000","last_clean_scrub_stamp":"2024-09-11T23:25:12.673116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:57.647588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":434,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-11T23:25:15.703834+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:25:15.703834+0000","last_peered":"2024-09-11T23:25:15.703834+0000","last_clean":"2024-09-11T23:25:15.703834+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:25:15.703834+0000","last_undegraded":"2024-09-11T23:25:15.703834+0000","last_fullsized":"2024-09-11T23:25:15.703834+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476830,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33516,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338324,"statfs":{"total":96636764160,"available":96602443776,"internally_reserved":0,"allocated":2379776,"data_stored":1368173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476829,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1765376,"data_stored":775473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476828,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1769472,"data_stored":776055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476828,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1777664,"data_stored":777133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542237,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1765376,"data_stored":775485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542237,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1765376,"data_stored":775541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1765376,"data_stored":775485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509533,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33488,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338352,"statfs":{"total":96636764160,"available":96602472448,"internally_reserved":0,"allocated":2355200,"data_stored":1365819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:25:19.273 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:25:19.273 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:25:19.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.470+0000 7fc803600640 1 Processor -- start 2024-09-11T23:25:19.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.470+0000 7fc803600640 1 -- start start 2024-09-11T23:25:19.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.471+0000 7fc803600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc7fc06f130 0x7fc7fc072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.471+0000 7fc803600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc7fc15f9f0 0x7fc7fc0ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.471+0000 7fc803600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7fc15c970 con 0x7fc7fc15b370 2024-09-11T23:25:19.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.471+0000 7fc803600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc7fc15fef0 con 0x7fc7fc15f9f0 2024-09-11T23:25:19.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.471+0000 7fc803600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc7fc15bbb0 con 0x7fc7fc06f130 2024-09-11T23:25:19.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.472+0000 7fc801600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc7fc15f9f0 0x7fc7fc0ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:19.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.472+0000 7fc800c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc7fc15b370 0x7fc7fc06ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33040/0 (socket says 172.21.15.144:33040) 2024-09-11T23:25:19.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.472+0000 7fc800c00640 1 -- 172.21.15.144:0/4132622761 learned_addr learned my addr 172.21.15.144:0/4132622761 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:19.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.472+0000 7fc7fbe00640 1 --2- 172.21.15.144:0/4132622761 >> v2:172.21.15.165:3300/0 conn(0x7fc7fc06f130 0x7fc7fc072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:19.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.472+0000 7fc801600640 1 -- 172.21.15.144:0/4132622761 >> v2:172.21.15.165:3300/0 conn(0x7fc7fc06f130 msgr2=0x7fc7fc072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:19.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.472+0000 7fc801600640 1 --2- 172.21.15.144:0/4132622761 >> v2:172.21.15.165:3300/0 conn(0x7fc7fc06f130 0x7fc7fc072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.472+0000 7fc801600640 1 -- 172.21.15.144:0/4132622761 >> v1:172.21.15.144:6789/0 conn(0x7fc7fc15b370 legacy=0x7fc7fc06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:19.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.472+0000 7fc801600640 1 -- 172.21.15.144:0/4132622761 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7fc15be90 con 0x7fc7fc15f9f0 2024-09-11T23:25:19.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.472+0000 7fc7fb400640 1 -- 172.21.15.144:0/4132622761 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1033795338 0 0) 0x7fc7fc15c970 con 0x7fc7fc15b370 2024-09-11T23:25:19.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.473+0000 7fc801600640 1 --2- 172.21.15.144:0/4132622761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7fc15f9f0 0x7fc7fc0ce490 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc0d0470 tx=0x7fc7f402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b871d0a98ec6aaa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:19.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.473+0000 7fc7fb400640 1 -- 172.21.15.144:0/4132622761 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4007740 con 0x7fc7fc15f9f0 2024-09-11T23:25:19.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.473+0000 7fc7fb400640 1 -- 172.21.15.144:0/4132622761 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f40078e0 con 0x7fc7fc15f9f0 2024-09-11T23:25:19.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.473+0000 7fc7fb400640 1 -- 172.21.15.144:0/4132622761 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4007cb0 con 0x7fc7fc15f9f0 2024-09-11T23:25:19.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.474+0000 7fc803600640 1 -- 172.21.15.144:0/4132622761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7fc15f9f0 msgr2=0x7fc7fc0ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:19.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.474+0000 7fc803600640 1 --2- 172.21.15.144:0/4132622761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7fc15f9f0 0x7fc7fc0ce490 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc0d0470 tx=0x7fc7f402a5f0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.474+0000 7fc803600640 1 -- 172.21.15.144:0/4132622761 shutdown_connections 2024-09-11T23:25:19.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.474+0000 7fc803600640 1 --2- 172.21.15.144:0/4132622761 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7fc15f9f0 0x7fc7fc0ce490 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.474+0000 7fc803600640 1 --2- 172.21.15.144:0/4132622761 >> v2:172.21.15.165:3300/0 conn(0x7fc7fc06f130 0x7fc7fc072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.474+0000 7fc803600640 1 -- 172.21.15.144:0/4132622761 >> 172.21.15.144:0/4132622761 conn(0x7fc7fc06bba0 msgr2=0x7fc7fc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:19.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.474+0000 7fc803600640 1 -- 172.21.15.144:0/4132622761 shutdown_connections 2024-09-11T23:25:19.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.474+0000 7fc803600640 1 -- 172.21.15.144:0/4132622761 wait complete. 2024-09-11T23:25:19.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.476+0000 7fc803600640 1 Processor -- start 2024-09-11T23:25:19.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.476+0000 7fc803600640 1 -- start start 2024-09-11T23:25:19.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.477+0000 7fc803600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7fc06f130 0x7fc7fc167530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.477+0000 7fc803600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7fc15b370 0x7fc7fc0aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.477+0000 7fc803600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7fc15f9f0 0x7fc7fc168960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.477+0000 7fc803600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc7fc0731b0 con 0x7fc7fc06f130 2024-09-11T23:25:19.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.477+0000 7fc803600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc7fc15c450 con 0x7fc7fc15f9f0 2024-09-11T23:25:19.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.477+0000 7fc803600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc7fc15b750 con 0x7fc7fc15b370 2024-09-11T23:25:19.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.477+0000 7fc800c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7fc06f130 0x7fc7fc167530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:19.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.477+0000 7fc800c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7fc06f130 0x7fc7fc167530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57488/0 (socket says 172.21.15.144:57488) 2024-09-11T23:25:19.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.477+0000 7fc800c00640 1 -- 172.21.15.144:0/1684017278 learned_addr learned my addr 172.21.15.144:0/1684017278 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:19.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.477+0000 7fc800c00640 1 -- 172.21.15.144:0/1684017278 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7fc15b370 msgr2=0x7fc7fc0aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:19.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.477+0000 7fc800c00640 1 --2- 172.21.15.144:0/1684017278 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7fc15b370 0x7fc7fc0aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.477+0000 7fc800c00640 1 -- 172.21.15.144:0/1684017278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7fc15f9f0 msgr2=0x7fc7fc168960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:19.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.477+0000 7fc800c00640 1 --2- 172.21.15.144:0/1684017278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7fc15f9f0 0x7fc7fc168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.477+0000 7fc800c00640 1 -- 172.21.15.144:0/1684017278 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7fc14b1c0 con 0x7fc7fc06f130 2024-09-11T23:25:19.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.478+0000 7fc800c00640 1 --2- 172.21.15.144:0/1684017278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7fc06f130 0x7fc7fc167530 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000c4d0 tx=0x7fc7f000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:19.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.478+0000 7fc7f8c00640 1 -- 172.21.15.144:0/1684017278 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f0018070 con 0x7fc7fc06f130 2024-09-11T23:25:19.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.478+0000 7fc7f8c00640 1 -- 172.21.15.144:0/1684017278 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f0007500 con 0x7fc7fc06f130 2024-09-11T23:25:19.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.478+0000 7fc7f8c00640 1 -- 172.21.15.144:0/1684017278 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f0004a20 con 0x7fc7fc06f130 2024-09-11T23:25:19.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.478+0000 7fc803600640 1 -- 172.21.15.144:0/1684017278 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7fc15de40 con 0x7fc7fc06f130 2024-09-11T23:25:19.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.478+0000 7fc803600640 1 -- 172.21.15.144:0/1684017278 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7fc167e80 con 0x7fc7fc06f130 2024-09-11T23:25:19.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.479+0000 7fc803600640 1 -- 172.21.15.144:0/1684017278 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7fc072560 con 0x7fc7fc06f130 2024-09-11T23:25:19.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.480+0000 7fc7f8c00640 1 -- 172.21.15.144:0/1684017278 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7fc7f001b070 con 0x7fc7fc06f130 2024-09-11T23:25:19.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.481+0000 7fc7f8c00640 1 --2- 172.21.15.144:0/1684017278 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7dc06c490 0x7fc7dc06e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.481+0000 7fc7f8c00640 1 -- 172.21.15.144:0/1684017278 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fc7f008ad30 con 0x7fc7fc06f130 2024-09-11T23:25:19.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.481+0000 7fc7fbe00640 1 --2- 172.21.15.144:0/1684017278 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7dc06c490 0x7fc7dc06e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:19.481 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.482+0000 7fc7fbe00640 1 --2- 172.21.15.144:0/1684017278 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7dc06c490 0x7fc7dc06e950 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc167d50 tx=0x7fc7e8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:19.485 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.485+0000 7fc7f8c00640 1 -- 172.21.15.144:0/1684017278 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc7fc14b1c0 con 0x7fc7fc06f130 2024-09-11T23:25:19.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.721+0000 7fc803600640 1 -- 172.21.15.144:0/1684017278 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc7fc06c120 con 0x7fc7fc06f130 2024-09-11T23:25:19.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.724+0000 7fc7f8c00640 1 -- 172.21.15.144:0/1684017278 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) ==== 190+0+147 (secure 0 0 0) 0x7fc7f0058d60 con 0x7fc7fc06f130 2024-09-11T23:25:19.724 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-11T23:25:19.724 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A== 2024-09-11T23:25:19.724 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-11T23:25:19.724 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-11T23:25:19.724 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:25:19.724 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-11T23:25:19.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.726+0000 7fc803600640 1 -- 172.21.15.144:0/1684017278 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7dc06c490 msgr2=0x7fc7dc06e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:19.726 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.726+0000 7fc803600640 1 --2- 172.21.15.144:0/1684017278 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7dc06c490 0x7fc7dc06e950 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc167d50 tx=0x7fc7e8008040 comp rx=0 tx=0).stop 2024-09-11T23:25:19.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.726+0000 7fc803600640 1 -- 172.21.15.144:0/1684017278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7fc06f130 msgr2=0x7fc7fc167530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:19.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.726+0000 7fc803600640 1 --2- 172.21.15.144:0/1684017278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7fc06f130 0x7fc7fc167530 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fc7f000c4d0 tx=0x7fc7f000c990 comp rx=0 tx=0).stop 2024-09-11T23:25:19.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.727+0000 7fc803600640 1 -- 172.21.15.144:0/1684017278 shutdown_connections 2024-09-11T23:25:19.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.727+0000 7fc803600640 1 --2- 172.21.15.144:0/1684017278 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc7dc06c490 0x7fc7dc06e950 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.727+0000 7fc803600640 1 --2- 172.21.15.144:0/1684017278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc7fc15f9f0 0x7fc7fc168960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.727+0000 7fc803600640 1 --2- 172.21.15.144:0/1684017278 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc7fc15b370 0x7fc7fc0aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.727+0000 7fc803600640 1 --2- 172.21.15.144:0/1684017278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7fc06f130 0x7fc7fc167530 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.727+0000 7fc803600640 1 -- 172.21.15.144:0/1684017278 >> 172.21.15.144:0/1684017278 conn(0x7fc7fc06bba0 msgr2=0x7fc7fc06e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:19.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.727+0000 7fc803600640 1 -- 172.21.15.144:0/1684017278 shutdown_connections 2024-09-11T23:25:19.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.727+0000 7fc803600640 1 -- 172.21.15.144:0/1684017278 wait complete. 2024-09-11T23:25:19.742 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:25:19.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.895+0000 7f516ce00640 1 Processor -- start 2024-09-11T23:25:19.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.895+0000 7f516ce00640 1 -- start start 2024-09-11T23:25:19.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.897+0000 7f516ce00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f516815ca40 0x7f516815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.897+0000 7f516ce00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f516815d390 con 0x7f51680d02a0 2024-09-11T23:25:19.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.897+0000 7f516ce00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f516815d670 con 0x7f516815ceb0 2024-09-11T23:25:19.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.897+0000 7f516ce00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f516815d950 con 0x7f516815ca40 2024-09-11T23:25:19.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.897+0000 7f5165e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f51680d02a0 0x7f51680d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33046/0 (socket says 172.21.15.144:33046) 2024-09-11T23:25:19.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.897+0000 7f5165e00640 1 -- 172.21.15.144:0/160166497 learned_addr learned my addr 172.21.15.144:0/160166497 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:19.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.897+0000 7f515fe00640 1 --2- 172.21.15.144:0/160166497 >> v2:172.21.15.165:3300/0 conn(0x7f516815ca40 0x7f516815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:19.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.897+0000 7f5165400640 1 -- 172.21.15.144:0/160166497 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1209806808 0 0) 0x7f516815d390 con 0x7f51680d02a0 2024-09-11T23:25:19.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.897+0000 7f5165400640 1 -- 172.21.15.144:0/160166497 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f514c005730 con 0x7f51680d02a0 2024-09-11T23:25:19.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.898+0000 7f5165400640 1 -- 172.21.15.144:0/160166497 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1979520135 0 0) 0x7f516815d670 con 0x7f516815ceb0 2024-09-11T23:25:19.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.898+0000 7f5165400640 1 -- 172.21.15.144:0/160166497 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f516815d390 con 0x7f516815ceb0 2024-09-11T23:25:19.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.898+0000 7f5165400640 1 -- 172.21.15.144:0/160166497 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1663146430 0 0) 0x7f514c005730 con 0x7f51680d02a0 2024-09-11T23:25:19.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.898+0000 7f5165400640 1 -- 172.21.15.144:0/160166497 >> v2:172.21.15.165:3300/0 conn(0x7f516815ca40 msgr2=0x7f516815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:19.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.898+0000 7f5165400640 1 --2- 172.21.15.144:0/160166497 >> v2:172.21.15.165:3300/0 conn(0x7f516815ca40 0x7f516815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.898+0000 7f5165400640 1 -- 172.21.15.144:0/160166497 >> v1:172.21.15.165:6789/0 conn(0x7f516815ceb0 legacy=0x7f51681594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:19.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.898+0000 7f5165400640 1 -- 172.21.15.144:0/160166497 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516815dc30 con 0x7f51680d02a0 2024-09-11T23:25:19.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.898+0000 7f5165400640 1 -- 172.21.15.144:0/160166497 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f5158001670 con 0x7f51680d02a0 2024-09-11T23:25:19.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.898+0000 7f5165400640 1 -- 172.21.15.144:0/160166497 >> v1:172.21.15.144:6789/0 conn(0x7f51680d02a0 legacy=0x7f51680d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:19.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.898+0000 7f5165400640 1 --2- 172.21.15.144:0/160166497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f514c005d50 0x7f514c006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.898+0000 7f5165400640 1 --2- 172.21.15.144:0/160166497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f514c006a10 0x7f514c006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.898+0000 7f5165400640 1 --2- 172.21.15.144:0/160166497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f514c0073d0 0x7f514c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.898+0000 7f5165400640 1 -- 172.21.15.144:0/160166497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f516815d950 con 0x7f514c005d50 2024-09-11T23:25:19.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.898+0000 7f5165400640 1 -- 172.21.15.144:0/160166497 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f514c00e300 con 0x7f514c0073d0 2024-09-11T23:25:19.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.898+0000 7f5165400640 1 -- 172.21.15.144:0/160166497 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f514c00e500 con 0x7f514c006a10 2024-09-11T23:25:19.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.898+0000 7f5165e00640 1 --2- 172.21.15.144:0/160166497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f514c005d50 0x7f514c006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:19.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.898+0000 7f5166800640 1 --2- 172.21.15.144:0/160166497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f514c0073d0 0x7f514c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:19.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.898+0000 7f515fe00640 1 --2- 172.21.15.144:0/160166497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f514c006a10 0x7f514c006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:19.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.899+0000 7f5165e00640 1 -- 172.21.15.144:0/160166497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f514c006a10 msgr2=0x7f514c006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:19.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.899+0000 7f5165e00640 1 --2- 172.21.15.144:0/160166497 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f514c006a10 0x7f514c006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.899+0000 7f5165e00640 1 -- 172.21.15.144:0/160166497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f514c0073d0 msgr2=0x7f514c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:19.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.899+0000 7f5165e00640 1 --2- 172.21.15.144:0/160166497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f514c0073d0 0x7f514c00dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.899+0000 7f5165e00640 1 -- 172.21.15.144:0/160166497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f514c005730 con 0x7f514c005d50 2024-09-11T23:25:19.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.899+0000 7f5166800640 1 --2- 172.21.15.144:0/160166497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f514c0073d0 0x7f514c00dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:19.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.899+0000 7f5166800640 1 -- 172.21.15.144:0/160166497 reap_dead start 2024-09-11T23:25:19.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.899+0000 7f5165e00640 1 --2- 172.21.15.144:0/160166497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f514c005d50 0x7f514c006150 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f515800c190 tx=0x7f514c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5da6cca56d2e05b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:19.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.900+0000 7f5165400640 1 -- 172.21.15.144:0/160166497 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5158007ce0 con 0x7f514c005d50 2024-09-11T23:25:19.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.900+0000 7f5165400640 1 -- 172.21.15.144:0/160166497 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5158005ad0 con 0x7f514c005d50 2024-09-11T23:25:19.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.900+0000 7f5165400640 1 -- 172.21.15.144:0/160166497 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5158007070 con 0x7f514c005d50 2024-09-11T23:25:19.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.900+0000 7f516ce00640 1 -- 172.21.15.144:0/160166497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f514c005d50 msgr2=0x7f514c006150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:19.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.900+0000 7f516ce00640 1 --2- 172.21.15.144:0/160166497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f514c005d50 0x7f514c006150 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f515800c190 tx=0x7f514c007a40 comp rx=0 tx=0).stop 2024-09-11T23:25:19.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.900+0000 7f516ce00640 1 -- 172.21.15.144:0/160166497 shutdown_connections 2024-09-11T23:25:19.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.900+0000 7f516ce00640 1 --2- 172.21.15.144:0/160166497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f514c005d50 0x7f514c006150 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.900+0000 7f516ce00640 1 -- 172.21.15.144:0/160166497 >> 172.21.15.144:0/160166497 conn(0x7f5168062cc0 msgr2=0x7f516806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:19.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.900+0000 7f516ce00640 1 -- 172.21.15.144:0/160166497 shutdown_connections 2024-09-11T23:25:19.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.900+0000 7f516ce00640 1 -- 172.21.15.144:0/160166497 wait complete. 2024-09-11T23:25:19.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.902+0000 7f516ce00640 1 Processor -- start 2024-09-11T23:25:19.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.902+0000 7f516ce00640 1 -- start start 2024-09-11T23:25:19.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.903+0000 7f516ce00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f514c005d50 0x7f51681e7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.903+0000 7f516ce00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51681f48a0 0x7f5168147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.903+0000 7f516ce00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5168151c80 0x7f5168147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.903+0000 7f516ce00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5168155d10 con 0x7f51681f48a0 2024-09-11T23:25:19.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.903+0000 7f516ce00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5168155b90 con 0x7f5168151c80 2024-09-11T23:25:19.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.903+0000 7f516ce00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f51680b4790 con 0x7f514c005d50 2024-09-11T23:25:19.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.903+0000 7f515fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51681f48a0 0x7f5168147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:19.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.903+0000 7f515fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51681f48a0 0x7f5168147960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57510/0 (socket says 172.21.15.144:57510) 2024-09-11T23:25:19.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.903+0000 7f515fe00640 1 -- 172.21.15.144:0/4277916959 learned_addr learned my addr 172.21.15.144:0/4277916959 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:19.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.903+0000 7f5166800640 1 --2- 172.21.15.144:0/4277916959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5168151c80 0x7f5168147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:19.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.903+0000 7f5165e00640 1 --2- 172.21.15.144:0/4277916959 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f514c005d50 0x7f51681e7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:19.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.904+0000 7f515fe00640 1 -- 172.21.15.144:0/4277916959 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f514c005d50 msgr2=0x7f51681e7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:19.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.904+0000 7f515fe00640 1 --2- 172.21.15.144:0/4277916959 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f514c005d50 0x7f51681e7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.904+0000 7f515fe00640 1 -- 172.21.15.144:0/4277916959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5168151c80 msgr2=0x7f5168147ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:19.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.904+0000 7f515fe00640 1 --2- 172.21.15.144:0/4277916959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5168151c80 0x7f5168147ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:19.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.904+0000 7f515fe00640 1 -- 172.21.15.144:0/4277916959 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5168071b60 con 0x7f51681f48a0 2024-09-11T23:25:19.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.904+0000 7f5165e00640 1 --2- 172.21.15.144:0/4277916959 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f514c005d50 0x7f51681e7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:19.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.904+0000 7f515fe00640 1 --2- 172.21.15.144:0/4277916959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51681f48a0 0x7f5168147960 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f51500114e0 tx=0x7f51500119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:19.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.904+0000 7f515e000640 1 -- 172.21.15.144:0/4277916959 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5150015870 con 0x7f51681f48a0 2024-09-11T23:25:19.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.904+0000 7f515e000640 1 -- 172.21.15.144:0/4277916959 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5150015a10 con 0x7f51681f48a0 2024-09-11T23:25:19.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.904+0000 7f516ce00640 1 -- 172.21.15.144:0/4277916959 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5168071e40 con 0x7f51681f48a0 2024-09-11T23:25:19.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.904+0000 7f515e000640 1 -- 172.21.15.144:0/4277916959 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5150015dc0 con 0x7f51681f48a0 2024-09-11T23:25:19.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.904+0000 7f516ce00640 1 -- 172.21.15.144:0/4277916959 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5168072b50 con 0x7f51681f48a0 2024-09-11T23:25:19.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.905+0000 7f516ce00640 1 -- 172.21.15.144:0/4277916959 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51681553b0 con 0x7f51681f48a0 2024-09-11T23:25:19.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.906+0000 7f515e000640 1 -- 172.21.15.144:0/4277916959 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f5150013400 con 0x7f51681f48a0 2024-09-11T23:25:19.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.907+0000 7f515e000640 1 --2- 172.21.15.144:0/4277916959 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f514406c460 0x7f514406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:19.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.907+0000 7f515e000640 1 -- 172.21.15.144:0/4277916959 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f515008c330 con 0x7f51681f48a0 2024-09-11T23:25:19.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.908+0000 7f5165e00640 1 --2- 172.21.15.144:0/4277916959 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f514406c460 0x7f514406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:19.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.908+0000 7f5165e00640 1 --2- 172.21.15.144:0/4277916959 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f514406c460 0x7f514406e920 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5158032000 tx=0x7f5158009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:19.911 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:19.911+0000 7f515e000640 1 -- 172.21.15.144:0/4277916959 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f51681553b0 con 0x7f51681f48a0 2024-09-11T23:25:20.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.121+0000 7f516ce00640 1 -- 172.21.15.144:0/4277916959 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51680d0680 con 0x7f51681f48a0 2024-09-11T23:25:20.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.121+0000 7f515e000640 1 -- 172.21.15.144:0/4277916959 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5241 (secure 0 0 0) 0x7f5150019030 con 0x7f51681f48a0 2024-09-11T23:25:20.121 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:20.121 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":100,"btime":"2024-09-11T23:25:17:708642+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6893,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2346696977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2346696977},{"type":"v1","addr":"172.21.15.165:6834","nonce":2346696977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3411942787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3411942787},{"type":"v1","addr":"172.21.15.165:6835","nonce":3411942787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/1554186582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1554186582},{"type":"v1","addr":"172.21.15.144:6801","nonce":1554186582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:25:14.094581+0000","modified":"2024-09-11T23:25:17.112238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"a","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1597149290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1597149290},{"type":"v1","addr":"172.21.15.144:6835","nonce":1597149290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8244,"qdb_cluster":[8244]},"id":11}]} 2024-09-11T23:25:20.121 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 100 2024-09-11T23:25:20.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.123+0000 7f516ce00640 1 -- 172.21.15.144:0/4277916959 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f514406c460 msgr2=0x7f514406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:20.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.123+0000 7f516ce00640 1 --2- 172.21.15.144:0/4277916959 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f514406c460 0x7f514406e920 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5158032000 tx=0x7f5158009030 comp rx=0 tx=0).stop 2024-09-11T23:25:20.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.123+0000 7f516ce00640 1 -- 172.21.15.144:0/4277916959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51681f48a0 msgr2=0x7f5168147960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:20.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.123+0000 7f516ce00640 1 --2- 172.21.15.144:0/4277916959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51681f48a0 0x7f5168147960 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f51500114e0 tx=0x7f51500119a0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.123+0000 7f516ce00640 1 -- 172.21.15.144:0/4277916959 shutdown_connections 2024-09-11T23:25:20.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.123+0000 7f516ce00640 1 --2- 172.21.15.144:0/4277916959 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f514406c460 0x7f514406e920 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.123+0000 7f516ce00640 1 --2- 172.21.15.144:0/4277916959 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5168151c80 0x7f5168147ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.123+0000 7f516ce00640 1 --2- 172.21.15.144:0/4277916959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51681f48a0 0x7f5168147960 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.123+0000 7f516ce00640 1 --2- 172.21.15.144:0/4277916959 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f514c005d50 0x7f51681e7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.123+0000 7f516ce00640 1 -- 172.21.15.144:0/4277916959 >> 172.21.15.144:0/4277916959 conn(0x7f5168062cc0 msgr2=0x7f5168154920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:20.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.124+0000 7f516ce00640 1 -- 172.21.15.144:0/4277916959 shutdown_connections 2024-09-11T23:25:20.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.124+0000 7f516ce00640 1 -- 172.21.15.144:0/4277916959 wait complete. 2024-09-11T23:25:20.542 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 100, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:25:14.094581+0000', 'modified': '2024-09-11T23:25:17.112238+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8244}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8244': {'gid': 8244, 'name': 'a', 'rank': 0, 'incarnation': 96, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6835/1597149290', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 1597149290}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 1597149290}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8244, 'qdb_cluster': [8244]} 2024-09-11T23:25:20.543 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:25:20.543 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T23:25:20.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.697+0000 7f1b1e200640 1 Processor -- start 2024-09-11T23:25:20.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.697+0000 7f1b1e200640 1 -- start start 2024-09-11T23:25:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.698+0000 7f1b1e200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b180d02a0 0x7f1b180d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.698+0000 7f1b1e200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b1815ce80 0x7f1b181594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.698+0000 7f1b1e200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b180d0bc0 con 0x7f1b1815ca40 2024-09-11T23:25:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.698+0000 7f1b1e200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1b1815d390 con 0x7f1b1815ce80 2024-09-11T23:25:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.698+0000 7f1b1e200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1b1815d670 con 0x7f1b180d02a0 2024-09-11T23:25:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.698+0000 7f1b17e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b1815ce80 0x7f1b181594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.699+0000 7f1b16a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1b1815ca40 0x7f1b1815e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33062/0 (socket says 172.21.15.144:33062) 2024-09-11T23:25:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.699+0000 7f1b16a00640 1 -- 172.21.15.144:0/1559490171 learned_addr learned my addr 172.21.15.144:0/1559490171 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.699+0000 7f1b17e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b1815ce80 0x7f1b181594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57524/0 (socket says 172.21.15.144:57524) 2024-09-11T23:25:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.699+0000 7f1b17400640 1 --2- 172.21.15.144:0/1559490171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b180d02a0 0x7f1b180d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.699+0000 7f1b17e00640 1 -- 172.21.15.144:0/1559490171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b180d02a0 msgr2=0x7f1b180d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:20.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.699+0000 7f1b17e00640 1 --2- 172.21.15.144:0/1559490171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b180d02a0 0x7f1b180d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.699+0000 7f1b17e00640 1 -- 172.21.15.144:0/1559490171 >> v1:172.21.15.144:6789/0 conn(0x7f1b1815ca40 legacy=0x7f1b1815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:20.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.699+0000 7f1b17e00640 1 -- 172.21.15.144:0/1559490171 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1815d950 con 0x7f1b1815ce80 2024-09-11T23:25:20.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.699+0000 7f1b16000640 1 -- 172.21.15.144:0/1559490171 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 524775744 0 0) 0x7f1b180d0bc0 con 0x7f1b1815ca40 2024-09-11T23:25:20.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.700+0000 7f1b17e00640 1 --2- 172.21.15.144:0/1559490171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1815ce80 0x7f1b181594c0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009d90 tx=0x7f1b1002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cda0c5f6b5ede8a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:20.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.700+0000 7f1b16000640 1 -- 172.21.15.144:0/1559490171 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b10031600 con 0x7f1b1815ce80 2024-09-11T23:25:20.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.700+0000 7f1b16000640 1 -- 172.21.15.144:0/1559490171 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b100317a0 con 0x7f1b1815ce80 2024-09-11T23:25:20.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.700+0000 7f1b16000640 1 -- 172.21.15.144:0/1559490171 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b10031b70 con 0x7f1b1815ce80 2024-09-11T23:25:20.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.701+0000 7f1b1e200640 1 -- 172.21.15.144:0/1559490171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1815ce80 msgr2=0x7f1b181594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:20.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.701+0000 7f1b1e200640 1 --2- 172.21.15.144:0/1559490171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1815ce80 0x7f1b181594c0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009d90 tx=0x7f1b1002a5d0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.701+0000 7f1b1e200640 1 -- 172.21.15.144:0/1559490171 shutdown_connections 2024-09-11T23:25:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.701+0000 7f1b1e200640 1 --2- 172.21.15.144:0/1559490171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b1815ce80 0x7f1b181594c0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.701+0000 7f1b1e200640 1 --2- 172.21.15.144:0/1559490171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b180d02a0 0x7f1b180d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.701+0000 7f1b1e200640 1 -- 172.21.15.144:0/1559490171 >> 172.21.15.144:0/1559490171 conn(0x7f1b18062cc0 msgr2=0x7f1b1806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.701+0000 7f1b1e200640 1 -- 172.21.15.144:0/1559490171 shutdown_connections 2024-09-11T23:25:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.701+0000 7f1b1e200640 1 -- 172.21.15.144:0/1559490171 wait complete. 2024-09-11T23:25:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.702+0000 7f1b1e200640 1 Processor -- start 2024-09-11T23:25:20.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.703+0000 7f1b1e200640 1 -- start start 2024-09-11T23:25:20.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.703+0000 7f1b1e200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b180d02a0 0x7f1b18145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.703+0000 7f1b1e200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b1815ca40 0x7f1b180ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.703+0000 7f1b1e200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b1815ce80 0x7f1b180aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.703+0000 7f1b1e200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1815eb40 con 0x7f1b180d02a0 2024-09-11T23:25:20.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.703+0000 7f1b1e200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1815df10 con 0x7f1b1815ca40 2024-09-11T23:25:20.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.703+0000 7f1b1e200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1b18155b90 con 0x7f1b1815ce80 2024-09-11T23:25:20.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.704+0000 7f1b17400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b180d02a0 0x7f1b18145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.704+0000 7f1b17400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b180d02a0 0x7f1b18145540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57538/0 (socket says 172.21.15.144:57538) 2024-09-11T23:25:20.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.704+0000 7f1b17400640 1 -- 172.21.15.144:0/2221544124 learned_addr learned my addr 172.21.15.144:0/2221544124 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:20.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.704+0000 7f1b17e00640 1 --2- 172.21.15.144:0/2221544124 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b1815ce80 0x7f1b180aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.704+0000 7f1b16a00640 1 --2- 172.21.15.144:0/2221544124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b1815ca40 0x7f1b180ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.704+0000 7f1b17400640 1 -- 172.21.15.144:0/2221544124 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b1815ce80 msgr2=0x7f1b180aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:20.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.704+0000 7f1b17400640 1 --2- 172.21.15.144:0/2221544124 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b1815ce80 0x7f1b180aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.704+0000 7f1b17400640 1 -- 172.21.15.144:0/2221544124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b1815ca40 msgr2=0x7f1b180ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:20.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.704+0000 7f1b17400640 1 --2- 172.21.15.144:0/2221544124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b1815ca40 0x7f1b180ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.704+0000 7f1b17400640 1 -- 172.21.15.144:0/2221544124 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1814f3b0 con 0x7f1b180d02a0 2024-09-11T23:25:20.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.704+0000 7f1b17400640 1 --2- 172.21.15.144:0/2221544124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b180d02a0 0x7f1b18145540 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800e9b0 tx=0x7f1b0800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:20.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.705+0000 7f1b0f400640 1 -- 172.21.15.144:0/2221544124 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b08017070 con 0x7f1b180d02a0 2024-09-11T23:25:20.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.705+0000 7f1b0f400640 1 -- 172.21.15.144:0/2221544124 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b0800c9a0 con 0x7f1b180d02a0 2024-09-11T23:25:20.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.705+0000 7f1b0f400640 1 -- 172.21.15.144:0/2221544124 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0800cd90 con 0x7f1b180d02a0 2024-09-11T23:25:20.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.705+0000 7f1b1e200640 1 -- 172.21.15.144:0/2221544124 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b18145a80 con 0x7f1b180d02a0 2024-09-11T23:25:20.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.705+0000 7f1b1e200640 1 -- 172.21.15.144:0/2221544124 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b18071490 con 0x7f1b180d02a0 2024-09-11T23:25:20.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.708+0000 7f1b0f400640 1 -- 172.21.15.144:0/2221544124 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f1b0801a070 con 0x7f1b180d02a0 2024-09-11T23:25:20.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.708+0000 7f1b0f400640 1 --2- 172.21.15.144:0/2221544124 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1af806c460 0x7f1af806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.709+0000 7f1b0f400640 1 -- 172.21.15.144:0/2221544124 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f1b0808bd50 con 0x7f1b180d02a0 2024-09-11T23:25:20.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.709+0000 7f1b20d22740 1 Processor -- start 2024-09-11T23:25:20.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.709+0000 7f1b20d22740 1 -- start start 2024-09-11T23:25:20.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.709+0000 7f1b16a00640 1 --2- 172.21.15.144:0/2221544124 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1af806c460 0x7f1af806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.710+0000 7f1b20d22740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b438cf0 0x56428b47e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.710+0000 7f1b20d22740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56428b4364b0 0x56428b4390d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.710+0000 7f1b20d22740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56428b43a480 0x56428b433570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.710+0000 7f1b16a00640 1 --2- 172.21.15.144:0/2221544124 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1af806c460 0x7f1af806e920 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1b18154dd0 tx=0x7f1b04007b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.710+0000 7f1b20d22740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56428b3973b0 con 0x56428b438cf0 2024-09-11T23:25:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.710+0000 7f1b20d22740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56428b39c410 con 0x56428b43a480 2024-09-11T23:25:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.710+0000 7f1b20d22740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56428b344620 con 0x56428b4364b0 2024-09-11T23:25:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.710+0000 7f1b17400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b438cf0 0x56428b47e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.710+0000 7f1b17400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b438cf0 0x56428b47e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57554/0 (socket says 172.21.15.144:57554) 2024-09-11T23:25:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.710+0000 7f1b17400640 1 -- 172.21.15.144:0/4075767373 learned_addr learned my addr 172.21.15.144:0/4075767373 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.711+0000 7f1b17400640 1 -- 172.21.15.144:0/4075767373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56428b4364b0 msgr2=0x56428b4390d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.711+0000 7f1b17400640 1 --2- 172.21.15.144:0/4075767373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56428b4364b0 0x56428b4390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.711+0000 7f1b17400640 1 -- 172.21.15.144:0/4075767373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56428b43a480 msgr2=0x56428b433570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:20.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.711+0000 7f1b17400640 1 --2- 172.21.15.144:0/4075767373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56428b43a480 0x56428b433570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.711+0000 7f1b17400640 1 -- 172.21.15.144:0/4075767373 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56428b0af2d0 con 0x56428b438cf0 2024-09-11T23:25:20.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.711+0000 7f1b17400640 1 --2- 172.21.15.144:0/4075767373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b438cf0 0x56428b47e490 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f1b08059650 tx=0x7f1b080595c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18309f635f9e57ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:20.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.711+0000 7f1b03400640 1 -- 172.21.15.144:0/4075767373 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b08021070 con 0x56428b438cf0 2024-09-11T23:25:20.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.711+0000 7f1b03400640 1 -- 172.21.15.144:0/4075767373 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b080622a0 con 0x56428b438cf0 2024-09-11T23:25:20.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.711+0000 7f1b03400640 1 -- 172.21.15.144:0/4075767373 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0806db50 con 0x56428b438cf0 2024-09-11T23:25:20.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.712+0000 7f1b20d22740 1 -- 172.21.15.144:0/4075767373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b438cf0 msgr2=0x56428b47e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:20.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.712+0000 7f1b20d22740 1 --2- 172.21.15.144:0/4075767373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b438cf0 0x56428b47e490 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f1b08059650 tx=0x7f1b080595c0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.712+0000 7f1b20d22740 1 -- 172.21.15.144:0/4075767373 shutdown_connections 2024-09-11T23:25:20.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.712+0000 7f1b20d22740 1 --2- 172.21.15.144:0/4075767373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56428b43a480 0x56428b433570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.712+0000 7f1b20d22740 1 --2- 172.21.15.144:0/4075767373 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56428b4364b0 0x56428b4390d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.712+0000 7f1b20d22740 1 --2- 172.21.15.144:0/4075767373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b438cf0 0x56428b47e490 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.712+0000 7f1b20d22740 1 -- 172.21.15.144:0/4075767373 >> 172.21.15.144:0/4075767373 conn(0x56428b435740 msgr2=0x56428b47d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:20.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.712+0000 7f1b20d22740 1 -- 172.21.15.144:0/4075767373 shutdown_connections 2024-09-11T23:25:20.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.712+0000 7f1b20d22740 1 -- 172.21.15.144:0/4075767373 wait complete. 2024-09-11T23:25:20.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.713+0000 7f1b20d22740 1 -- start start 2024-09-11T23:25:20.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.713+0000 7f1b20d22740 1 Processor -- start 2024-09-11T23:25:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.714+0000 7f1b20d22740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56428b438cf0 0x56428b458d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.714+0000 7f1b20d22740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56428b43a480 0x56428b4585b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.714+0000 7f1b20d22740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b45b860 0x56428b45abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.714+0000 7f1b20d22740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56428b357780 con 0x56428b45b860 2024-09-11T23:25:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.714+0000 7f1b20d22740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56428b3983d0 con 0x56428b43a480 2024-09-11T23:25:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.714+0000 7f1b20d22740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56428b434be0 con 0x56428b438cf0 2024-09-11T23:25:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.714+0000 7f1b20d22740 10 client.0 _ll_register_callbacks cb 0x56428b3955d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:25:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.714+0000 7f1b17e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b45b860 0x56428b45abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.714+0000 7f1b17e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b45b860 0x56428b45abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57570/0 (socket says 172.21.15.144:57570) 2024-09-11T23:25:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.714+0000 7f1b17e00640 1 -- 172.21.15.144:0/4247688337 learned_addr learned my addr 172.21.15.144:0/4247688337 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.714+0000 7f1b16a00640 1 --2- 172.21.15.144:0/4247688337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56428b43a480 0x56428b4585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.714+0000 7f1b17400640 1 --2- 172.21.15.144:0/4247688337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56428b438cf0 0x56428b458d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.715+0000 7f1b17e00640 1 -- 172.21.15.144:0/4247688337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56428b438cf0 msgr2=0x56428b458d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.715+0000 7f1b17e00640 1 --2- 172.21.15.144:0/4247688337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56428b438cf0 0x56428b458d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.715+0000 7f1b17e00640 1 -- 172.21.15.144:0/4247688337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56428b43a480 msgr2=0x56428b4585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.715+0000 7f1b17e00640 1 --2- 172.21.15.144:0/4247688337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56428b43a480 0x56428b4585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.715+0000 7f1b17e00640 1 -- 172.21.15.144:0/4247688337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56428b1796b0 con 0x56428b45b860 2024-09-11T23:25:20.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.715+0000 7f1b17e00640 1 --2- 172.21.15.144:0/4247688337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b45b860 0x56428b45abe0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009e80 tx=0x7f1b10004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3990145d5e1279df server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.715+0000 7f1af7e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:25:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.715+0000 7f1af7e00640 1 -- 172.21.15.144:0/4247688337 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b10009450 con 0x56428b45b860 2024-09-11T23:25:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.715+0000 7f1b20d22740 1 -- 172.21.15.144:0/4247688337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b080622a0 con 0x56428b45b860 2024-09-11T23:25:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.715+0000 7f1af7e00640 1 -- 172.21.15.144:0/4247688337 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f1b10046b20 con 0x56428b45b860 2024-09-11T23:25:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.715+0000 7f1af7e00640 1 -- 172.21.15.144:0/4247688337 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f1b10046d20 con 0x56428b45b860 2024-09-11T23:25:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.715+0000 7f1b20d22740 10 client.8379 fetch_fsmap learned FSMap version 100 2024-09-11T23:25:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.715+0000 7f1b20d22740 1 -- 172.21.15.144:0/4247688337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x56428b45a3e0 con 0x56428b45b860 2024-09-11T23:25:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.716+0000 7f1af7e00640 1 -- 172.21.15.144:0/4247688337 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b080622a0 con 0x56428b45b860 2024-09-11T23:25:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.716+0000 7f1af7e00640 1 -- 172.21.15.144:0/4247688337 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7f1b10046020 con 0x56428b45b860 2024-09-11T23:25:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.716+0000 7f1b20d22740 10 client.8379 fetch_fsmap finished waiting for FSMap version 100 2024-09-11T23:25:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.716+0000 7f1b20d22740 10 client.8379 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T23:25:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.716+0000 7f1b20d22740 20 client.8379 populate_metadata read hostname 'smithi144' 2024-09-11T23:25:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.716+0000 7f1b20d22740 1 --2- 172.21.15.144:0/4247688337 >> [v2:172.21.15.144:6834/1597149290,v1:172.21.15.144:6835/1597149290] conn(0x56428b491650 0x56428b491a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.716+0000 7f1b20d22740 4 client.8379 mds_command: new command op to 8244 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:25:20.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.716+0000 7f1b20d22740 1 -- 172.21.15.144:0/4247688337 --> [v2:172.21.15.144:6834/1597149290,v1:172.21.15.144:6835/1597149290] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56428b3a9b40 con 0x56428b491650 2024-09-11T23:25:20.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.716+0000 7f1b17400640 1 --2- 172.21.15.144:0/4247688337 >> [v2:172.21.15.144:6834/1597149290,v1:172.21.15.144:6835/1597149290] conn(0x56428b491650 0x56428b491a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.717+0000 7f1b17400640 1 --2- 172.21.15.144:0/4247688337 >> [v2:172.21.15.144:6834/1597149290,v1:172.21.15.144:6835/1597149290] conn(0x56428b491650 0x56428b491a30 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff5b9c9631a01f13 server_cookie=fab873355c498147 in_seq=0 out_seq=0 2024-09-11T23:25:20.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.717+0000 7f1af7e00640 10 client.8379 ms_handle_connect on v2:172.21.15.144:6834/1597149290 2024-09-11T23:25:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.717+0000 7f1af7e00640 1 -- 172.21.15.144:0/4247688337 <== mds.0 v2:172.21.15.144:6834/1597149290 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56428b3a9b40 con 0x56428b491650 2024-09-11T23:25:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.717+0000 7f1af7e00640 10 client.8379 handle_command_reply: tid=0 2024-09-11T23:25:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.717+0000 7f1b20d22740 1 client.8379 shutdown 2024-09-11T23:25:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.718+0000 7f1b20d22740 1 -- 172.21.15.144:0/4247688337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b45b860 msgr2=0x56428b45abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.718+0000 7f1b20d22740 1 --2- 172.21.15.144:0/4247688337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b45b860 0x56428b45abe0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009e80 tx=0x7f1b10004ab0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.718+0000 7f1b20d22740 1 -- 172.21.15.144:0/4247688337 shutdown_connections 2024-09-11T23:25:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.718+0000 7f1b20d22740 1 --2- 172.21.15.144:0/4247688337 >> [v2:172.21.15.144:6834/1597149290,v1:172.21.15.144:6835/1597149290] conn(0x56428b491650 0x56428b491a30 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.718+0000 7f1b20d22740 1 --2- 172.21.15.144:0/4247688337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b45b860 0x56428b45abe0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.718+0000 7f1b20d22740 1 --2- 172.21.15.144:0/4247688337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56428b43a480 0x56428b4585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.718+0000 7f1b20d22740 1 --2- 172.21.15.144:0/4247688337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56428b438cf0 0x56428b458d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.718+0000 7f1af7e00640 0 client.8379 ms_handle_reset on v2:172.21.15.144:6834/1597149290 2024-09-11T23:25:20.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.718+0000 7f1b20d22740 1 -- 172.21.15.144:0/4247688337 >> 172.21.15.144:0/4247688337 conn(0x56428b4364b0 msgr2=0x56428b47f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:20.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.718+0000 7f1b20d22740 1 -- 172.21.15.144:0/4247688337 shutdown_connections 2024-09-11T23:25:20.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.718+0000 7f1b20d22740 1 -- 172.21.15.144:0/4247688337 wait complete. 2024-09-11T23:25:20.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.718+0000 7f1b20d22740 20 client.8379 trim_cache size 0 max 16384 2024-09-11T23:25:20.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.736+0000 7f1b20d22740 1 Processor -- start 2024-09-11T23:25:20.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.737+0000 7f1b20d22740 1 -- start start 2024-09-11T23:25:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.737+0000 7f1b20d22740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56428b438cf0 0x56428b459930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.737+0000 7f1b20d22740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b43a480 0x56428b48ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.737+0000 7f1b20d22740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56428b45b860 0x56428b4904b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.737+0000 7f1b20d22740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1b181ffb80 con 0x56428b43a480 2024-09-11T23:25:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.737+0000 7f1b20d22740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1b18068350 con 0x56428b438cf0 2024-09-11T23:25:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.737+0000 7f1b20d22740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1b181ff680 con 0x56428b45b860 2024-09-11T23:25:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.738+0000 7f1b16a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b43a480 0x56428b48ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.738+0000 7f1b16a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b43a480 0x56428b48ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57582/0 (socket says 172.21.15.144:57582) 2024-09-11T23:25:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.738+0000 7f1b16a00640 1 -- 172.21.15.144:0/324938617 learned_addr learned my addr 172.21.15.144:0/324938617 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.738+0000 7f1b17400640 1 --2- 172.21.15.144:0/324938617 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56428b438cf0 0x56428b459930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.738+0000 7f1b17e00640 1 --2- 172.21.15.144:0/324938617 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56428b45b860 0x56428b4904b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.738+0000 7f1b16a00640 1 -- 172.21.15.144:0/324938617 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56428b45b860 msgr2=0x56428b4904b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:20.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.738+0000 7f1b16a00640 1 --2- 172.21.15.144:0/324938617 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56428b45b860 0x56428b4904b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.738+0000 7f1b16a00640 1 -- 172.21.15.144:0/324938617 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56428b438cf0 msgr2=0x56428b459930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:20.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.738+0000 7f1b16a00640 1 --2- 172.21.15.144:0/324938617 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56428b438cf0 0x56428b459930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.738+0000 7f1b16a00640 1 -- 172.21.15.144:0/324938617 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56428b4354e0 con 0x56428b43a480 2024-09-11T23:25:20.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.738+0000 7f1b17400640 1 --2- 172.21.15.144:0/324938617 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56428b438cf0 0x56428b459930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:20.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.738+0000 7f1b16a00640 1 --2- 172.21.15.144:0/324938617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b43a480 0x56428b48ff70 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f1b04005d30 tx=0x7f1b04011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02980fb49030f27 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:20.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.739+0000 7f1b02a00640 1 -- 172.21.15.144:0/324938617 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b04027070 con 0x56428b43a480 2024-09-11T23:25:20.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.739+0000 7f1b02a00640 1 -- 172.21.15.144:0/324938617 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b04014930 con 0x56428b43a480 2024-09-11T23:25:20.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.739+0000 7f1b02a00640 1 -- 172.21.15.144:0/324938617 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b04014b00 con 0x56428b43a480 2024-09-11T23:25:20.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.739+0000 7f1b20d22740 1 -- 172.21.15.144:0/324938617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b43a480 msgr2=0x56428b48ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:20.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.739+0000 7f1b20d22740 1 --2- 172.21.15.144:0/324938617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b43a480 0x56428b48ff70 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f1b04005d30 tx=0x7f1b04011000 comp rx=0 tx=0).stop 2024-09-11T23:25:20.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.739+0000 7f1b20d22740 1 -- 172.21.15.144:0/324938617 shutdown_connections 2024-09-11T23:25:20.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.739+0000 7f1b20d22740 1 --2- 172.21.15.144:0/324938617 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56428b45b860 0x56428b4904b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.739+0000 7f1b20d22740 1 --2- 172.21.15.144:0/324938617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b43a480 0x56428b48ff70 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.739+0000 7f1b20d22740 1 --2- 172.21.15.144:0/324938617 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56428b438cf0 0x56428b459930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.739+0000 7f1b20d22740 1 -- 172.21.15.144:0/324938617 >> 172.21.15.144:0/324938617 conn(0x56428b4364b0 msgr2=0x56428b458190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.740+0000 7f1b20d22740 1 -- 172.21.15.144:0/324938617 shutdown_connections 2024-09-11T23:25:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.740+0000 7f1b20d22740 1 -- 172.21.15.144:0/324938617 wait complete. 2024-09-11T23:25:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.740+0000 7f1b20d22740 1 -- start start 2024-09-11T23:25:20.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.740+0000 7f1b20d22740 1 Processor -- start 2024-09-11T23:25:20.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.741+0000 7f1b20d22740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56428b438cf0 0x56428b45ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.741+0000 7f1b20d22740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b43a480 0x56428b48ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.741+0000 7f1b20d22740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56428b45b860 0x56428b4904b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.741+0000 7f1b20d22740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56428b4593e0 con 0x56428b43a480 2024-09-11T23:25:20.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.741+0000 7f1b20d22740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56428b458b40 con 0x56428b45b860 2024-09-11T23:25:20.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.741+0000 7f1b20d22740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x56428b462f30 con 0x56428b438cf0 2024-09-11T23:25:20.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.741+0000 7f1b20d22740 10 client.0 _ll_register_callbacks cb 0x7f1b08009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:25:20.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.742+0000 7f1b16a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b43a480 0x56428b48ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.742+0000 7f1b16a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b43a480 0x56428b48ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57592/0 (socket says 172.21.15.144:57592) 2024-09-11T23:25:20.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.742+0000 7f1b16a00640 1 -- 172.21.15.144:0/3811469278 learned_addr learned my addr 172.21.15.144:0/3811469278 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:20.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.742+0000 7f1b17400640 1 --2- 172.21.15.144:0/3811469278 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56428b438cf0 0x56428b45ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.742+0000 7f1b17e00640 1 --2- 172.21.15.144:0/3811469278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56428b45b860 0x56428b4904b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.742+0000 7f1b16a00640 1 -- 172.21.15.144:0/3811469278 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56428b438cf0 msgr2=0x56428b45ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:20.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.742+0000 7f1b16a00640 1 --2- 172.21.15.144:0/3811469278 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56428b438cf0 0x56428b45ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.742+0000 7f1b16a00640 1 -- 172.21.15.144:0/3811469278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56428b45b860 msgr2=0x56428b4904b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:20.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.742+0000 7f1b16a00640 1 --2- 172.21.15.144:0/3811469278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56428b45b860 0x56428b4904b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.742+0000 7f1b16a00640 1 -- 172.21.15.144:0/3811469278 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56428b45f2c0 con 0x56428b43a480 2024-09-11T23:25:20.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.742+0000 7f1b16a00640 1 --2- 172.21.15.144:0/3811469278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b43a480 0x56428b48ff70 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f1b04014800 tx=0x7f1b04000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1c9e8d116a54f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.742+0000 7f1af7e00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:25:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.743+0000 7f1af7e00640 1 -- 172.21.15.144:0/3811469278 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0402f060 con 0x56428b43a480 2024-09-11T23:25:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.743+0000 7f1b20d22740 1 -- 172.21.15.144:0/3811469278 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b04014930 con 0x56428b43a480 2024-09-11T23:25:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.743+0000 7f1af7e00640 1 -- 172.21.15.144:0/3811469278 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f1b04022660 con 0x56428b43a480 2024-09-11T23:25:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.743+0000 7f1af7e00640 1 -- 172.21.15.144:0/3811469278 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f1b04035050 con 0x56428b43a480 2024-09-11T23:25:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.743+0000 7f1b20d22740 10 client.8385 fetch_fsmap learned FSMap version 100 2024-09-11T23:25:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.743+0000 7f1b20d22740 1 -- 172.21.15.144:0/3811469278 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x56428b45ffe0 con 0x56428b43a480 2024-09-11T23:25:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.743+0000 7f1af7e00640 1 -- 172.21.15.144:0/3811469278 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b04014930 con 0x56428b43a480 2024-09-11T23:25:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.743+0000 7f1af7e00640 1 -- 172.21.15.144:0/3811469278 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7f1b04038020 con 0x56428b43a480 2024-09-11T23:25:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.743+0000 7f1b20d22740 10 client.8385 fetch_fsmap finished waiting for FSMap version 100 2024-09-11T23:25:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.743+0000 7f1b20d22740 10 client.8385 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T23:25:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.743+0000 7f1b20d22740 20 client.8385 populate_metadata read hostname 'smithi144' 2024-09-11T23:25:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.743+0000 7f1b20d22740 1 --2- 172.21.15.144:0/3811469278 >> [v2:172.21.15.144:6834/1597149290,v1:172.21.15.144:6835/1597149290] conn(0x56428b4fb930 0x56428b45d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.743+0000 7f1b20d22740 4 client.8385 mds_command: new command op to 8244 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:25:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.743+0000 7f1b20d22740 1 -- 172.21.15.144:0/3811469278 --> [v2:172.21.15.144:6834/1597149290,v1:172.21.15.144:6835/1597149290] -- command(tid 0: {"prefix": "status"}) -- 0x56428b3a3e90 con 0x56428b4fb930 2024-09-11T23:25:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.744+0000 7f1b17400640 1 --2- 172.21.15.144:0/3811469278 >> [v2:172.21.15.144:6834/1597149290,v1:172.21.15.144:6835/1597149290] conn(0x56428b4fb930 0x56428b45d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.744+0000 7f1b17400640 1 --2- 172.21.15.144:0/3811469278 >> [v2:172.21.15.144:6834/1597149290,v1:172.21.15.144:6835/1597149290] conn(0x56428b4fb930 0x56428b45d530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f657b37916349acc server_cookie=6be810397163d40d in_seq=0 out_seq=0 2024-09-11T23:25:20.746 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.744+0000 7f1af7e00640 10 client.8385 ms_handle_connect on v2:172.21.15.144:6834/1597149290 2024-09-11T23:25:20.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.744+0000 7f1af7e00640 1 -- 172.21.15.144:0/3811469278 <== mds.0 v2:172.21.15.144:6834/1597149290 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x56428b3a3e90 con 0x56428b4fb930 2024-09-11T23:25:20.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.744+0000 7f1af7e00640 10 client.8385 handle_command_reply: tid=0 2024-09-11T23:25:20.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.744+0000 7f1b20d22740 1 client.8385 shutdown 2024-09-11T23:25:20.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.744+0000 7f1b20d22740 1 -- 172.21.15.144:0/3811469278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b43a480 msgr2=0x56428b48ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:20.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.744+0000 7f1b20d22740 1 --2- 172.21.15.144:0/3811469278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b43a480 0x56428b48ff70 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f1b04014800 tx=0x7f1b04000ed0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.744+0000 7f1b20d22740 1 -- 172.21.15.144:0/3811469278 shutdown_connections 2024-09-11T23:25:20.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.744+0000 7f1b20d22740 1 --2- 172.21.15.144:0/3811469278 >> [v2:172.21.15.144:6834/1597149290,v1:172.21.15.144:6835/1597149290] conn(0x56428b4fb930 0x56428b45d530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.744+0000 7f1b20d22740 1 --2- 172.21.15.144:0/3811469278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56428b45b860 0x56428b4904b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.744+0000 7f1b20d22740 1 --2- 172.21.15.144:0/3811469278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56428b43a480 0x56428b48ff70 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.744+0000 7f1af7e00640 0 client.8385 ms_handle_reset on v2:172.21.15.144:6834/1597149290 2024-09-11T23:25:20.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.744+0000 7f1b20d22740 1 --2- 172.21.15.144:0/3811469278 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x56428b438cf0 0x56428b45ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.745+0000 7f1b20d22740 1 -- 172.21.15.144:0/3811469278 >> 172.21.15.144:0/3811469278 conn(0x56428b4364b0 msgr2=0x56428b459930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:20.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.745+0000 7f1b20d22740 1 -- 172.21.15.144:0/3811469278 shutdown_connections 2024-09-11T23:25:20.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.745+0000 7f1b20d22740 1 -- 172.21.15.144:0/3811469278 wait complete. 2024-09-11T23:25:20.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.745+0000 7f1b20d22740 20 client.8385 trim_cache size 0 max 16384 2024-09-11T23:25:20.748 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:25:20.749 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "4b73e4b7-12f0-4e37-94bc-45e333efe84e", 2024-09-11T23:25:20.749 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-11T23:25:20.749 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 8244, 2024-09-11T23:25:20.749 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-11T23:25:20.749 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-11T23:25:20.749 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-11T23:25:20.749 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 6.0460355290000001, 2024-09-11T23:25:20.749 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 100, 2024-09-11T23:25:20.749 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 142, 2024-09-11T23:25:20.749 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 142, 2024-09-11T23:25:20.749 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 10.761442958 2024-09-11T23:25:20.749 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:25:20.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.745+0000 7f1b1e200640 1 -- 172.21.15.144:0/2221544124 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1af806c460 msgr2=0x7f1af806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:20.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.745+0000 7f1b1e200640 1 --2- 172.21.15.144:0/2221544124 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1af806c460 0x7f1af806e920 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1b18154dd0 tx=0x7f1b04007b50 comp rx=0 tx=0).stop 2024-09-11T23:25:20.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.745+0000 7f1b1e200640 1 -- 172.21.15.144:0/2221544124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b180d02a0 msgr2=0x7f1b18145540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:20.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.745+0000 7f1b1e200640 1 --2- 172.21.15.144:0/2221544124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b180d02a0 0x7f1b18145540 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800e9b0 tx=0x7f1b0800ee70 comp rx=0 tx=0).stop 2024-09-11T23:25:20.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.745+0000 7f1b1e200640 1 -- 172.21.15.144:0/2221544124 shutdown_connections 2024-09-11T23:25:20.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.745+0000 7f1b1e200640 1 --2- 172.21.15.144:0/2221544124 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1af806c460 0x7f1af806e920 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.745+0000 7f1b1e200640 1 --2- 172.21.15.144:0/2221544124 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b1815ce80 0x7f1b180aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.745+0000 7f1b1e200640 1 --2- 172.21.15.144:0/2221544124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b1815ca40 0x7f1b180ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.745+0000 7f1b1e200640 1 --2- 172.21.15.144:0/2221544124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b180d02a0 0x7f1b18145540 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.745+0000 7f1b1e200640 1 -- 172.21.15.144:0/2221544124 >> 172.21.15.144:0/2221544124 conn(0x7f1b18062cc0 msgr2=0x7f1b180cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:20.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.746+0000 7f1b1e200640 1 -- 172.21.15.144:0/2221544124 shutdown_connections 2024-09-11T23:25:20.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.746+0000 7f1b1e200640 1 -- 172.21.15.144:0/2221544124 wait complete. 2024-09-11T23:25:20.760 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:25:20.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.913+0000 7f20d2e00640 1 Processor -- start 2024-09-11T23:25:20.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.913+0000 7f20d2e00640 1 -- start start 2024-09-11T23:25:20.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.914+0000 7f20d2e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20cc15ceb0 0x7f20cc1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.914+0000 7f20d2e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20cc15d390 con 0x7f20cc15ca40 2024-09-11T23:25:20.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.914+0000 7f20d2e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20cc15d670 con 0x7f20cc0d02a0 2024-09-11T23:25:20.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.914+0000 7f20d2e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f20cc15d950 con 0x7f20cc15ceb0 2024-09-11T23:25:20.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.915+0000 7f20d0e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20cc15ceb0 0x7f20cc1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.915+0000 7f20d0e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f20cc15ceb0 0x7f20cc1594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57600/0 (socket says 172.21.15.144:57600) 2024-09-11T23:25:20.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.915+0000 7f20d0e00640 1 -- 172.21.15.144:0/2963737019 learned_addr learned my addr 172.21.15.144:0/2963737019 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:20.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.915+0000 7f20d0e00640 1 -- 172.21.15.144:0/2963737019 >> v1:172.21.15.165:6789/0 conn(0x7f20cc0d02a0 legacy=0x7f20cc0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:20.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.915+0000 7f20d0e00640 1 -- 172.21.15.144:0/2963737019 >> v1:172.21.15.144:6789/0 conn(0x7f20cc15ca40 legacy=0x7f20cc15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:20.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.915+0000 7f20d0e00640 1 -- 172.21.15.144:0/2963737019 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20cc15dc30 con 0x7f20cc15ceb0 2024-09-11T23:25:20.915 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.916+0000 7f20d0e00640 1 --2- 172.21.15.144:0/2963737019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20cc15ceb0 0x7f20cc1594c0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009e50 tx=0x7f20c402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c7314a1bcedb5e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.916+0000 7f20caa00640 1 -- 172.21.15.144:0/2963737019 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c4036070 con 0x7f20cc15ceb0 2024-09-11T23:25:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.916+0000 7f20caa00640 1 -- 172.21.15.144:0/2963737019 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c4031600 con 0x7f20cc15ceb0 2024-09-11T23:25:20.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.916+0000 7f20caa00640 1 -- 172.21.15.144:0/2963737019 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c40319d0 con 0x7f20cc15ceb0 2024-09-11T23:25:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.917+0000 7f20d2e00640 1 -- 172.21.15.144:0/2963737019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20cc15ceb0 msgr2=0x7f20cc1594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.917+0000 7f20d2e00640 1 --2- 172.21.15.144:0/2963737019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20cc15ceb0 0x7f20cc1594c0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009e50 tx=0x7f20c402a730 comp rx=0 tx=0).stop 2024-09-11T23:25:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.917+0000 7f20d2e00640 1 -- 172.21.15.144:0/2963737019 shutdown_connections 2024-09-11T23:25:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.917+0000 7f20d2e00640 1 --2- 172.21.15.144:0/2963737019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20cc15ceb0 0x7f20cc1594c0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.917+0000 7f20d2e00640 1 -- 172.21.15.144:0/2963737019 >> 172.21.15.144:0/2963737019 conn(0x7f20cc062cc0 msgr2=0x7f20cc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.917+0000 7f20d2e00640 1 -- 172.21.15.144:0/2963737019 shutdown_connections 2024-09-11T23:25:20.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.917+0000 7f20d2e00640 1 -- 172.21.15.144:0/2963737019 wait complete. 2024-09-11T23:25:20.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.919+0000 7f20d2e00640 1 Processor -- start 2024-09-11T23:25:20.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.919+0000 7f20d2e00640 1 -- start start 2024-09-11T23:25:20.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.919+0000 7f20d2e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20cc0d02a0 0x7f20cc150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.920+0000 7f20d2e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20cc15ca40 0x7f20cc14b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.920+0000 7f20d2e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20cc15ceb0 0x7f20cc14bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.920+0000 7f20d2e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc155b90 con 0x7f20cc15ca40 2024-09-11T23:25:20.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.920+0000 7f20d2e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc15eb40 con 0x7f20cc0d02a0 2024-09-11T23:25:20.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.920+0000 7f20d2e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f20cc155d10 con 0x7f20cc15ceb0 2024-09-11T23:25:20.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.920+0000 7f20cb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20cc15ca40 0x7f20cc14b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.920+0000 7f20cb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20cc15ca40 0x7f20cc14b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57602/0 (socket says 172.21.15.144:57602) 2024-09-11T23:25:20.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.920+0000 7f20cb400640 1 -- 172.21.15.144:0/162303489 learned_addr learned my addr 172.21.15.144:0/162303489 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:20.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.920+0000 7f20cbe00640 1 --2- 172.21.15.144:0/162303489 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20cc0d02a0 0x7f20cc150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.920+0000 7f20d0e00640 1 --2- 172.21.15.144:0/162303489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20cc15ceb0 0x7f20cc14bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.920+0000 7f20cb400640 1 -- 172.21.15.144:0/162303489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20cc15ceb0 msgr2=0x7f20cc14bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:20.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.920+0000 7f20cb400640 1 --2- 172.21.15.144:0/162303489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20cc15ceb0 0x7f20cc14bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.920+0000 7f20cb400640 1 -- 172.21.15.144:0/162303489 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20cc0d02a0 msgr2=0x7f20cc150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:20.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.920+0000 7f20cb400640 1 --2- 172.21.15.144:0/162303489 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20cc0d02a0 0x7f20cc150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:20.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.920+0000 7f20cb400640 1 -- 172.21.15.144:0/162303489 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20cc159590 con 0x7f20cc15ca40 2024-09-11T23:25:20.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.921+0000 7f20cb400640 1 --2- 172.21.15.144:0/162303489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20cc15ca40 0x7f20cc14b760 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f20b800c450 tx=0x7f20b800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.921+0000 7f20c3e00640 1 -- 172.21.15.144:0/162303489 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b80052d0 con 0x7f20cc15ca40 2024-09-11T23:25:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.921+0000 7f20c3e00640 1 -- 172.21.15.144:0/162303489 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b8005470 con 0x7f20cc15ca40 2024-09-11T23:25:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.921+0000 7f20c3e00640 1 -- 172.21.15.144:0/162303489 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8012870 con 0x7f20cc15ca40 2024-09-11T23:25:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.921+0000 7f20d2e00640 1 -- 172.21.15.144:0/162303489 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20cc159870 con 0x7f20cc15ca40 2024-09-11T23:25:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.921+0000 7f20d2e00640 1 -- 172.21.15.144:0/162303489 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20cc159e30 con 0x7f20cc15ca40 2024-09-11T23:25:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.922+0000 7f20d2e00640 1 -- 172.21.15.144:0/162303489 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20cc0b4790 con 0x7f20cc15ca40 2024-09-11T23:25:20.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.923+0000 7f20c3e00640 1 -- 172.21.15.144:0/162303489 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f20b8012a10 con 0x7f20cc15ca40 2024-09-11T23:25:20.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.924+0000 7f20c3e00640 1 --2- 172.21.15.144:0/162303489 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f20ac06c460 0x7f20ac06e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:20.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.924+0000 7f20c3e00640 1 -- 172.21.15.144:0/162303489 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f20b808b450 con 0x7f20cc15ca40 2024-09-11T23:25:20.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.925+0000 7f20cbe00640 1 --2- 172.21.15.144:0/162303489 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f20ac06c460 0x7f20ac06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:20.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.925+0000 7f20cbe00640 1 --2- 172.21.15.144:0/162303489 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f20ac06c460 0x7f20ac06e920 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f20bc001780 tx=0x7f20bc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:20.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:20.928+0000 7f20c3e00640 1 -- 172.21.15.144:0/162303489 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f20b8058ec0 con 0x7f20cc15ca40 2024-09-11T23:25:21.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:21.135+0000 7f20d2e00640 1 -- 172.21.15.144:0/162303489 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f20cc153c70 con 0x7f20cc15ca40 2024-09-11T23:25:21.135 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:21.136+0000 7f20c3e00640 1 -- 172.21.15.144:0/162303489 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v100) ==== 53+0+73 (secure 0 0 0) 0x7f20b805d1c0 con 0x7f20cc15ca40 2024-09-11T23:25:21.135 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:25:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:21.138+0000 7f20d2e00640 1 -- 172.21.15.144:0/162303489 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f20ac06c460 msgr2=0x7f20ac06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:21.138+0000 7f20d2e00640 1 --2- 172.21.15.144:0/162303489 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f20ac06c460 0x7f20ac06e920 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f20bc001780 tx=0x7f20bc009040 comp rx=0 tx=0).stop 2024-09-11T23:25:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:21.138+0000 7f20d2e00640 1 -- 172.21.15.144:0/162303489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20cc15ca40 msgr2=0x7f20cc14b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:21.138+0000 7f20d2e00640 1 --2- 172.21.15.144:0/162303489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20cc15ca40 0x7f20cc14b760 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f20b800c450 tx=0x7f20b800c910 comp rx=0 tx=0).stop 2024-09-11T23:25:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:21.138+0000 7f20d2e00640 1 -- 172.21.15.144:0/162303489 shutdown_connections 2024-09-11T23:25:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:21.138+0000 7f20d2e00640 1 --2- 172.21.15.144:0/162303489 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f20ac06c460 0x7f20ac06e920 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:21.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:21.138+0000 7f20d2e00640 1 --2- 172.21.15.144:0/162303489 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f20cc15ceb0 0x7f20cc14bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:21.138+0000 7f20d2e00640 1 --2- 172.21.15.144:0/162303489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20cc15ca40 0x7f20cc14b760 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:21.138+0000 7f20d2e00640 1 --2- 172.21.15.144:0/162303489 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20cc0d02a0 0x7f20cc150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:21.138+0000 7f20d2e00640 1 -- 172.21.15.144:0/162303489 >> 172.21.15.144:0/162303489 conn(0x7f20cc062cc0 msgr2=0x7f20cc0b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:21.138+0000 7f20d2e00640 1 -- 172.21.15.144:0/162303489 shutdown_connections 2024-09-11T23:25:21.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:21.138+0000 7f20d2e00640 1 -- 172.21.15.144:0/162303489 wait complete. 2024-09-11T23:25:21.156 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:25:21.156 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:25:21.156 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-11T23:25:21.156 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:25:21.156 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:25:21.156 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:25:21.156 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:25:21.156 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:25:21.156 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:25:21.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:21.157 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-11T23:25:21.193 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:25:21.193 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:25:21.193 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:25:21.193 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:21.193 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-11T23:25:21.193 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:21.194 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:25:21.194 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:25:21.194 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-11T23:25:21.194 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:25:21.194 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:25:21.194 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-11T23:25:21.194 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:25:21.194 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:25:21.194 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:25:21.194 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-11T23:25:21.194 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:25:21.194 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42241sec preferred_lft 42241sec 2024-09-11T23:25:21.195 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2024-09-11T23:25:21.195 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:21.195 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:25:21.195 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff 2024-09-11T23:25:21.195 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:25:21.195 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:21.195 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::243b:82ff:fe06:fac9/64 scope link 2024-09-11T23:25:21.195 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:21.195 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:25:21.195 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:25:21.195 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::74ca:30ff:fef2:cddf/64 scope link 2024-09-11T23:25:21.196 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:21.196 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:25:21.196 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether be:01:ec:87:34:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:25:21.196 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bc01:ecff:fe87:34e1/64 scope link 2024-09-11T23:25:21.196 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:21.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:21.196 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:25:21.286 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-11T23:25:21.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:21.290 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-11T23:25:21.326 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-11T23:25:21.327 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:25:21.327 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:25:21.327 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:25:21.327 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:25:21.327 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:25:21.327 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-11T23:25:21.327 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:25:21.327 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:25:21.327 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:25:21.328 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-11T23:25:21.444 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:25:21.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:25:21.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:21.524 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-11T23:25:21.560 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:25:21.560 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:25:21.560 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:25:21.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:21.561 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-11T23:25:21.657 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:25:21.657 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:25:21.693 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:25:21.693 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:25:21.693 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:25:21.769 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T23:25:21.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:21.769 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:25:21.898 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:25:21.898 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:25:21.927 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:25:21.927 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:25:21.927 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:25:21.928 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:25:21.928 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:25:21.930 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T23:25:21.930 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:25:21.930 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:25:21.930 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:25:21.930 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:25:21.933 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:25:21.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:21.933 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:25:21.989 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:25:22.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:25:22.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:25:22.085 INFO:teuthology.orchestra.run.smithi144.stdout:client6965 2024-09-11T23:25:22.086 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:25:22.086 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:25:22.121 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:25:22.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.315+0000 7f10b8600640 1 Processor -- start 2024-09-11T23:25:22.315 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.315+0000 7f10b8600640 1 -- start start 2024-09-11T23:25:22.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.316+0000 7f10b8600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f10b00d02a0 0x7f10b00d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:22.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.317+0000 7f10b8600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b00d0bc0 con 0x7f10b015ca40 2024-09-11T23:25:22.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.317+0000 7f10b8600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b015d390 con 0x7f10b015ceb0 2024-09-11T23:25:22.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.317+0000 7f10b8600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f10b015d670 con 0x7f10b00d02a0 2024-09-11T23:25:22.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.317+0000 7f10b5c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f10b00d02a0 0x7f10b00d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:22.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.317+0000 7f10b5200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f10b015ca40 0x7f10b015e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33078/0 (socket says 172.21.15.144:33078) 2024-09-11T23:25:22.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.317+0000 7f10b5200640 1 -- 172.21.15.144:0/2311771084 learned_addr learned my addr 172.21.15.144:0/2311771084 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:22.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.317+0000 7f10b5c00640 1 -- 172.21.15.144:0/2311771084 >> v1:172.21.15.165:6789/0 conn(0x7f10b015ceb0 legacy=0x7f10b01594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:22.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.317+0000 7f10b5c00640 1 -- 172.21.15.144:0/2311771084 >> v1:172.21.15.144:6789/0 conn(0x7f10b015ca40 legacy=0x7f10b015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:22.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.317+0000 7f10b5c00640 1 -- 172.21.15.144:0/2311771084 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b015d950 con 0x7f10b00d02a0 2024-09-11T23:25:22.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.317+0000 7f10afe00640 1 -- 172.21.15.144:0/2311771084 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1467523065 0 0) 0x7f10b00d0bc0 con 0x7f10b015ca40 2024-09-11T23:25:22.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.318+0000 7f10b5c00640 1 --2- 172.21.15.144:0/2311771084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b00d02a0 0x7f10b00d0680 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f10a4009d90 tx=0x7f10a402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13ac1a92c192f04 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:22.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.319+0000 7f10afe00640 1 -- 172.21.15.144:0/2311771084 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a4007740 con 0x7f10b00d02a0 2024-09-11T23:25:22.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.319+0000 7f10afe00640 1 -- 172.21.15.144:0/2311771084 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a40078e0 con 0x7f10b00d02a0 2024-09-11T23:25:22.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.319+0000 7f10afe00640 1 -- 172.21.15.144:0/2311771084 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a4007cb0 con 0x7f10b00d02a0 2024-09-11T23:25:22.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.319+0000 7f10b8600640 1 -- 172.21.15.144:0/2311771084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b00d02a0 msgr2=0x7f10b00d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:22.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.319+0000 7f10b8600640 1 --2- 172.21.15.144:0/2311771084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b00d02a0 0x7f10b00d0680 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f10a4009d90 tx=0x7f10a402a660 comp rx=0 tx=0).stop 2024-09-11T23:25:22.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.319+0000 7f10b8600640 1 -- 172.21.15.144:0/2311771084 shutdown_connections 2024-09-11T23:25:22.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.319+0000 7f10b8600640 1 --2- 172.21.15.144:0/2311771084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b00d02a0 0x7f10b00d0680 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:22.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.319+0000 7f10b8600640 1 -- 172.21.15.144:0/2311771084 >> 172.21.15.144:0/2311771084 conn(0x7f10b0062cc0 msgr2=0x7f10b006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:22.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.319+0000 7f10b8600640 1 -- 172.21.15.144:0/2311771084 shutdown_connections 2024-09-11T23:25:22.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.319+0000 7f10b8600640 1 -- 172.21.15.144:0/2311771084 wait complete. 2024-09-11T23:25:22.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.321+0000 7f10b8600640 1 Processor -- start 2024-09-11T23:25:22.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.321+0000 7f10b8600640 1 -- start start 2024-09-11T23:25:22.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.322+0000 7f10b8600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10b00d02a0 0x7f10b0156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:22.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.322+0000 7f10b8600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10b015ca40 0x7f10b013be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:22.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.322+0000 7f10b8600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b015ceb0 0x7f10b013c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:22.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.322+0000 7f10b8600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10b015eb40 con 0x7f10b015ceb0 2024-09-11T23:25:22.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.322+0000 7f10b8600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f10b015df10 con 0x7f10b00d02a0 2024-09-11T23:25:22.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.322+0000 7f10b8600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f10b0155b90 con 0x7f10b015ca40 2024-09-11T23:25:22.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.322+0000 7f10b6600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b015ceb0 0x7f10b013c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:22.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.322+0000 7f10b6600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b015ceb0 0x7f10b013c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57616/0 (socket says 172.21.15.144:57616) 2024-09-11T23:25:22.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.322+0000 7f10b6600640 1 -- 172.21.15.144:0/1340767293 learned_addr learned my addr 172.21.15.144:0/1340767293 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:22.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.322+0000 7f10b5200640 1 --2- 172.21.15.144:0/1340767293 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10b015ca40 0x7f10b013be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:22.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.322+0000 7f10b5c00640 1 --2- 172.21.15.144:0/1340767293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10b00d02a0 0x7f10b0156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:22.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.322+0000 7f10b6600640 1 -- 172.21.15.144:0/1340767293 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10b015ca40 msgr2=0x7f10b013be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:22.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.322+0000 7f10b6600640 1 --2- 172.21.15.144:0/1340767293 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10b015ca40 0x7f10b013be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:22.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.322+0000 7f10b6600640 1 -- 172.21.15.144:0/1340767293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10b00d02a0 msgr2=0x7f10b0156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:22.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.322+0000 7f10b6600640 1 --2- 172.21.15.144:0/1340767293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10b00d02a0 0x7f10b0156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:22.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.322+0000 7f10b6600640 1 -- 172.21.15.144:0/1340767293 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b014d1a0 con 0x7f10b015ceb0 2024-09-11T23:25:22.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.322+0000 7f10b5200640 1 --2- 172.21.15.144:0/1340767293 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10b015ca40 0x7f10b013be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:22.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.322+0000 7f10b5c00640 1 --2- 172.21.15.144:0/1340767293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10b00d02a0 0x7f10b0156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:22.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.323+0000 7f10b6600640 1 --2- 172.21.15.144:0/1340767293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b015ceb0 0x7f10b013c3c0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f10a800c3a0 tx=0x7f10a800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:22.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.323+0000 7f10ad600640 1 -- 172.21.15.144:0/1340767293 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8017070 con 0x7f10b015ceb0 2024-09-11T23:25:22.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.323+0000 7f10ad600640 1 -- 172.21.15.144:0/1340767293 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a80052d0 con 0x7f10b015ceb0 2024-09-11T23:25:22.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.323+0000 7f10b8600640 1 -- 172.21.15.144:0/1340767293 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b0139e90 con 0x7f10b015ceb0 2024-09-11T23:25:22.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.323+0000 7f10ad600640 1 -- 172.21.15.144:0/1340767293 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8003830 con 0x7f10b015ceb0 2024-09-11T23:25:22.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.323+0000 7f10b8600640 1 -- 172.21.15.144:0/1340767293 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b013a450 con 0x7f10b015ceb0 2024-09-11T23:25:22.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.324+0000 7f10b8600640 1 -- 172.21.15.144:0/1340767293 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b00b4790 con 0x7f10b015ceb0 2024-09-11T23:25:22.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.325+0000 7f10ad600640 1 -- 172.21.15.144:0/1340767293 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f10a801a070 con 0x7f10b015ceb0 2024-09-11T23:25:22.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.326+0000 7f10ad600640 1 --2- 172.21.15.144:0/1340767293 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f109006c460 0x7f109006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:22.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.326+0000 7f10ad600640 1 -- 172.21.15.144:0/1340767293 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f10a808acf0 con 0x7f10b015ceb0 2024-09-11T23:25:22.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.326+0000 7f10b5c00640 1 --2- 172.21.15.144:0/1340767293 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f109006c460 0x7f109006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:22.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.327+0000 7f10b5c00640 1 --2- 172.21.15.144:0/1340767293 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f109006c460 0x7f109006e920 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f10a4034000 tx=0x7f10a402f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:22.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.330+0000 7f10ad600640 1 -- 172.21.15.144:0/1340767293 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f10a8058e20 con 0x7f10b015ceb0 2024-09-11T23:25:22.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.538+0000 7f10b8600640 1 -- 172.21.15.144:0/1340767293 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f10b00ceac0 con 0x7f10b015ceb0 2024-09-11T23:25:22.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.539+0000 7f10ad600640 1 -- 172.21.15.144:0/1340767293 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v100) ==== 53+0+73 (secure 0 0 0) 0x7f10a8058720 con 0x7f10b015ceb0 2024-09-11T23:25:22.539 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:25:22.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.541+0000 7f10b8600640 1 -- 172.21.15.144:0/1340767293 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f109006c460 msgr2=0x7f109006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:22.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.541+0000 7f10b8600640 1 --2- 172.21.15.144:0/1340767293 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f109006c460 0x7f109006e920 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f10a4034000 tx=0x7f10a402f000 comp rx=0 tx=0).stop 2024-09-11T23:25:22.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.541+0000 7f10b8600640 1 -- 172.21.15.144:0/1340767293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b015ceb0 msgr2=0x7f10b013c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:22.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.541+0000 7f10b8600640 1 --2- 172.21.15.144:0/1340767293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b015ceb0 0x7f10b013c3c0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f10a800c3a0 tx=0x7f10a800c860 comp rx=0 tx=0).stop 2024-09-11T23:25:22.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.541+0000 7f10b8600640 1 -- 172.21.15.144:0/1340767293 shutdown_connections 2024-09-11T23:25:22.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.541+0000 7f10b8600640 1 --2- 172.21.15.144:0/1340767293 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f109006c460 0x7f109006e920 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:22.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.541+0000 7f10b8600640 1 --2- 172.21.15.144:0/1340767293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10b015ceb0 0x7f10b013c3c0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:22.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.541+0000 7f10b8600640 1 --2- 172.21.15.144:0/1340767293 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10b015ca40 0x7f10b013be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:22.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.541+0000 7f10b8600640 1 --2- 172.21.15.144:0/1340767293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10b00d02a0 0x7f10b0156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:22.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.541+0000 7f10b8600640 1 -- 172.21.15.144:0/1340767293 >> 172.21.15.144:0/1340767293 conn(0x7f10b0062cc0 msgr2=0x7f10b00ccd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:22.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.541+0000 7f10b8600640 1 -- 172.21.15.144:0/1340767293 shutdown_connections 2024-09-11T23:25:22.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:22.541+0000 7f10b8600640 1 -- 172.21.15.144:0/1340767293 wait complete. 2024-09-11T23:25:22.557 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:25:22.557 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:25:22.558 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi165.front.sepia.ceph.com 2024-09-11T23:25:22.558 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T23:25:22.558 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:25:22.558 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:25:22.558 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:25:22.559 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:25:22.559 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:25:22.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:22.559 DEBUG:teuthology.orchestra.run.smithi165:> ip addr 2024-09-11T23:25:22.600 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:25:22.600 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:25:22.600 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:25:22.600 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:22.600 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-11T23:25:22.600 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:22.600 INFO:teuthology.orchestra.run.smithi165.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:25:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:94 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:25:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f0 2024-09-11T23:25:22.601 INFO:teuthology.orchestra.run.smithi165.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:25:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:95 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:25:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f1 2024-09-11T23:25:22.601 INFO:teuthology.orchestra.run.smithi165.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:25:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:25:22.601 INFO:teuthology.orchestra.run.smithi165.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:25:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:25:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.21.15.165/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:25:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft 42243sec preferred_lft 42243sec 2024-09-11T23:25:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::ec4:7aff:fe88:7f63/64 scope link noprefixroute 2024-09-11T23:25:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:22.601 INFO:teuthology.orchestra.run.smithi165.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:25:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:25:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:25:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::c063:d7ff:fec8:c56c/64 scope link 2024-09-11T23:25:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:22.602 INFO:teuthology.orchestra.run.smithi165.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:25:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:25:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::5478:e4ff:fecd:76c/64 scope link 2024-09-11T23:25:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:22.602 INFO:teuthology.orchestra.run.smithi165.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:25:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether ba:fa:43:78:5f:29 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:25:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::b8fa:43ff:fe78:5f29/64 scope link 2024-09-11T23:25:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:22.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:22.603 DEBUG:teuthology.orchestra.run.smithi165:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:25:22.698 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-11T23:25:22.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:22.701 DEBUG:teuthology.orchestra.run.smithi165:> route 2024-09-11T23:25:22.740 INFO:teuthology.orchestra.run.smithi165.stdout:Kernel IP routing table 2024-09-11T23:25:22.740 INFO:teuthology.orchestra.run.smithi165.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:25:22.740 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:25:22.740 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:25:22.741 INFO:teuthology.orchestra.run.smithi165.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:25:22.741 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:25:22.741 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-11T23:25:22.741 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:25:22.741 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:25:22.741 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:25:22.741 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-11T23:25:22.858 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:25:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:25:22.929 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:25:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:25:22.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:22.938 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-11T23:25:22.973 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-11T23:25:22.974 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-11T23:25:22.974 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:25:22.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:22.974 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set brx.0 up 2024-09-11T23:25:23.070 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:25:23.070 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T23:25:23.106 INFO:teuthology.orchestra.run.smithi165.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:25:23.106 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:25:23.106 DEBUG:teuthology.orchestra.run.smithi165:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:25:23.181 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-11T23:25:23.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:23.182 DEBUG:teuthology.orchestra.run.smithi165:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:25:23.310 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:25:23.310 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:25:23.336 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:25:23.336 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:25:23.337 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:25:23.337 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: trying mount with new device syntax: 1@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:25:23.337 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:25:23.338 INFO:teuthology.orchestra.run.smithi165.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-11T23:25:23.338 INFO:teuthology.orchestra.run.smithi165.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:25:23.338 INFO:teuthology.orchestra.run.smithi165.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:25:23.338 INFO:teuthology.orchestra.run.smithi165.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:25:23.338 INFO:teuthology.orchestra.run.smithi165.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:25:23.341 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:25:23.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:23.341 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:25:23.397 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:25:23.475 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:25:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:25:23.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:25:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:25:23.486 INFO:teuthology.orchestra.run.smithi165.stdout:client7921 2024-09-11T23:25:23.487 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:25:23.487 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:25:23.525 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-11T23:25:23.685 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.686+0000 7fc405e00640 1 Processor -- start 2024-09-11T23:25:23.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.686+0000 7fc405e00640 1 -- start start 2024-09-11T23:25:23.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.687+0000 7fc405e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc40015f9f0 0x7fc400072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:23.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.687+0000 7fc405e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc40015c970 con 0x7fc40006f130 2024-09-11T23:25:23.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.687+0000 7fc405e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc40015bbb0 con 0x7fc40015b370 2024-09-11T23:25:23.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.687+0000 7fc405e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc40015fef0 con 0x7fc40015f9f0 2024-09-11T23:25:23.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.687+0000 7fc3ff400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc40015f9f0 0x7fc400072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:23.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.687+0000 7fc3fe000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc40006f130 0x7fc4000ce490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:33080/0 (socket says 172.21.15.144:33080) 2024-09-11T23:25:23.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.687+0000 7fc3fe000640 1 -- 172.21.15.144:0/1500513301 learned_addr learned my addr 172.21.15.144:0/1500513301 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:23.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.688+0000 7fc3ff400640 1 -- 172.21.15.144:0/1500513301 >> v1:172.21.15.165:6789/0 conn(0x7fc40015b370 legacy=0x7fc40006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:23.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.688+0000 7fc3ff400640 1 -- 172.21.15.144:0/1500513301 >> v1:172.21.15.144:6789/0 conn(0x7fc40006f130 legacy=0x7fc4000ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:23.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.688+0000 7fc3ff400640 1 -- 172.21.15.144:0/1500513301 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40015be90 con 0x7fc40015f9f0 2024-09-11T23:25:23.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.688+0000 7fc3fd600640 1 -- 172.21.15.144:0/1500513301 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1257998248 0 0) 0x7fc40015c970 con 0x7fc40006f130 2024-09-11T23:25:23.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.689+0000 7fc3ff400640 1 --2- 172.21.15.144:0/1500513301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc40015f9f0 0x7fc400072560 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8009d90 tx=0x7fc3f802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e6d279006e1b8f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:23.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.689+0000 7fc3fd600640 1 -- 172.21.15.144:0/1500513301 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8007740 con 0x7fc40015f9f0 2024-09-11T23:25:23.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.689+0000 7fc3fd600640 1 -- 172.21.15.144:0/1500513301 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f80078e0 con 0x7fc40015f9f0 2024-09-11T23:25:23.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.689+0000 7fc3fd600640 1 -- 172.21.15.144:0/1500513301 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8007cb0 con 0x7fc40015f9f0 2024-09-11T23:25:23.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.689+0000 7fc405e00640 1 -- 172.21.15.144:0/1500513301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc40015f9f0 msgr2=0x7fc400072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:23.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.689+0000 7fc405e00640 1 --2- 172.21.15.144:0/1500513301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc40015f9f0 0x7fc400072560 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8009d90 tx=0x7fc3f802a660 comp rx=0 tx=0).stop 2024-09-11T23:25:23.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.690+0000 7fc405e00640 1 -- 172.21.15.144:0/1500513301 shutdown_connections 2024-09-11T23:25:23.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.690+0000 7fc405e00640 1 --2- 172.21.15.144:0/1500513301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc40015f9f0 0x7fc400072560 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:23.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.690+0000 7fc405e00640 1 -- 172.21.15.144:0/1500513301 >> 172.21.15.144:0/1500513301 conn(0x7fc40006bba0 msgr2=0x7fc40006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:23.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.690+0000 7fc405e00640 1 -- 172.21.15.144:0/1500513301 shutdown_connections 2024-09-11T23:25:23.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.690+0000 7fc405e00640 1 -- 172.21.15.144:0/1500513301 wait complete. 2024-09-11T23:25:23.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.691+0000 7fc405e00640 1 Processor -- start 2024-09-11T23:25:23.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.691+0000 7fc405e00640 1 -- start start 2024-09-11T23:25:23.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.692+0000 7fc405e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc40006f130 0x7fc400144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:23.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.692+0000 7fc405e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc40015b370 0x7fc4001473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:23.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.692+0000 7fc405e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc40015f9f0 0x7fc4001e4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:23.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.692+0000 7fc405e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc4000731b0 con 0x7fc40006f130 2024-09-11T23:25:23.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.692+0000 7fc405e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc40015c450 con 0x7fc40015f9f0 2024-09-11T23:25:23.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.692+0000 7fc405e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc40015b750 con 0x7fc40015b370 2024-09-11T23:25:23.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.693+0000 7fc3fea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc40006f130 0x7fc400144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:23.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.693+0000 7fc3fea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc40006f130 0x7fc400144a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57644/0 (socket says 172.21.15.144:57644) 2024-09-11T23:25:23.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.693+0000 7fc3fea00640 1 -- 172.21.15.144:0/4031645667 learned_addr learned my addr 172.21.15.144:0/4031645667 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:23.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.693+0000 7fc3fea00640 1 -- 172.21.15.144:0/4031645667 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc40015b370 msgr2=0x7fc4001473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:23.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.693+0000 7fc3fea00640 1 --2- 172.21.15.144:0/4031645667 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc40015b370 0x7fc4001473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:23.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.693+0000 7fc3fea00640 1 -- 172.21.15.144:0/4031645667 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc40015f9f0 msgr2=0x7fc4001e4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:23.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.693+0000 7fc3fea00640 1 --2- 172.21.15.144:0/4031645667 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc40015f9f0 0x7fc4001e4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:23.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.693+0000 7fc3fea00640 1 -- 172.21.15.144:0/4031645667 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc400147df0 con 0x7fc40006f130 2024-09-11T23:25:23.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.693+0000 7fc3fea00640 1 --2- 172.21.15.144:0/4031645667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc40006f130 0x7fc400144a90 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000c480 tx=0x7fc3f000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:23.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.693+0000 7fc3f7400640 1 -- 172.21.15.144:0/4031645667 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f00052d0 con 0x7fc40006f130 2024-09-11T23:25:23.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.693+0000 7fc3f7400640 1 -- 172.21.15.144:0/4031645667 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f0005470 con 0x7fc40006f130 2024-09-11T23:25:23.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.694+0000 7fc405e00640 1 -- 172.21.15.144:0/4031645667 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4001480d0 con 0x7fc40006f130 2024-09-11T23:25:23.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.694+0000 7fc3f7400640 1 -- 172.21.15.144:0/4031645667 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f0012870 con 0x7fc40006f130 2024-09-11T23:25:23.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.694+0000 7fc405e00640 1 -- 172.21.15.144:0/4031645667 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc400145800 con 0x7fc40006f130 2024-09-11T23:25:23.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.695+0000 7fc405e00640 1 -- 172.21.15.144:0/4031645667 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc400072560 con 0x7fc40006f130 2024-09-11T23:25:23.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.695+0000 7fc3f7400640 1 -- 172.21.15.144:0/4031645667 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7fc3f0012a10 con 0x7fc40006f130 2024-09-11T23:25:23.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.696+0000 7fc3f7400640 1 --2- 172.21.15.144:0/4031645667 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc3e006c460 0x7fc3e006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:23.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.696+0000 7fc3f7400640 1 -- 172.21.15.144:0/4031645667 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fc3f008b620 con 0x7fc40006f130 2024-09-11T23:25:23.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.697+0000 7fc3fe000640 1 --2- 172.21.15.144:0/4031645667 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc3e006c460 0x7fc3e006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:23.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.697+0000 7fc3fe000640 1 --2- 172.21.15.144:0/4031645667 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc3e006c460 0x7fc3e006e920 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec000c00 tx=0x7fc3ec0079c0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:23.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.701+0000 7fc3f7400640 1 -- 172.21.15.144:0/4031645667 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc3f00596e0 con 0x7fc40006f130 2024-09-11T23:25:23.914 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:23.914+0000 7fc405e00640 1 -- 172.21.15.144:0/4031645667 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fc400145a00 con 0x7fc40006f130 2024-09-11T23:25:24.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.747+0000 7fc3f7400640 1 -- 172.21.15.144:0/4031645667 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v101) ==== 136+0+0 (secure 0 0 0) 0x7fc3f0058fe0 con 0x7fc40006f130 2024-09-11T23:25:24.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.751+0000 7fc405e00640 1 -- 172.21.15.144:0/4031645667 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc3e006c460 msgr2=0x7fc3e006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:24.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.751+0000 7fc405e00640 1 --2- 172.21.15.144:0/4031645667 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc3e006c460 0x7fc3e006e920 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec000c00 tx=0x7fc3ec0079c0 comp rx=0 tx=0).stop 2024-09-11T23:25:24.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.751+0000 7fc405e00640 1 -- 172.21.15.144:0/4031645667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc40006f130 msgr2=0x7fc400144a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:24.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.751+0000 7fc405e00640 1 --2- 172.21.15.144:0/4031645667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc40006f130 0x7fc400144a90 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000c480 tx=0x7fc3f000c940 comp rx=0 tx=0).stop 2024-09-11T23:25:24.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.751+0000 7fc405e00640 1 -- 172.21.15.144:0/4031645667 shutdown_connections 2024-09-11T23:25:24.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.751+0000 7fc405e00640 1 --2- 172.21.15.144:0/4031645667 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc3e006c460 0x7fc3e006e920 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:24.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.751+0000 7fc405e00640 1 --2- 172.21.15.144:0/4031645667 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc40015f9f0 0x7fc4001e4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:24.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.751+0000 7fc405e00640 1 --2- 172.21.15.144:0/4031645667 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc40015b370 0x7fc4001473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:24.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.751+0000 7fc405e00640 1 --2- 172.21.15.144:0/4031645667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc40006f130 0x7fc400144a90 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:24.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.751+0000 7fc405e00640 1 -- 172.21.15.144:0/4031645667 >> 172.21.15.144:0/4031645667 conn(0x7fc40006bba0 msgr2=0x7fc40006e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:24.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.751+0000 7fc405e00640 1 -- 172.21.15.144:0/4031645667 shutdown_connections 2024-09-11T23:25:24.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.751+0000 7fc405e00640 1 -- 172.21.15.144:0/4031645667 wait complete. 2024-09-11T23:25:24.770 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-11T23:25:24.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.929+0000 7f60b7800640 1 Processor -- start 2024-09-11T23:25:24.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.929+0000 7f60b7800640 1 -- start start 2024-09-11T23:25:24.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.930+0000 7f60b7800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f60b015ca40 0x7f60b015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:24.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.930+0000 7f60b7800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f60b015ceb0 0x7f60b01594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:24.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.930+0000 7f60b7800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60b015d390 con 0x7f60b00d02a0 2024-09-11T23:25:24.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.930+0000 7f60b7800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f60b015d670 con 0x7f60b015ceb0 2024-09-11T23:25:24.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.930+0000 7f60b7800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f60b015d950 con 0x7f60b015ca40 2024-09-11T23:25:24.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.930+0000 7f60b5800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f60b015ceb0 0x7f60b01594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:24.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.931+0000 7f60b5800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f60b015ceb0 0x7f60b01594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34564/0 (socket says 172.21.15.144:34564) 2024-09-11T23:25:24.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.931+0000 7f60b5800640 1 -- 172.21.15.144:0/1487553868 learned_addr learned my addr 172.21.15.144:0/1487553868 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:24.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.931+0000 7f60afe00640 1 --2- 172.21.15.144:0/1487553868 >> v2:172.21.15.165:3300/0 conn(0x7f60b015ca40 0x7f60b015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:24.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.931+0000 7f60b5800640 1 -- 172.21.15.144:0/1487553868 >> v2:172.21.15.165:3300/0 conn(0x7f60b015ca40 msgr2=0x7f60b015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:24.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.931+0000 7f60b5800640 1 --2- 172.21.15.144:0/1487553868 >> v2:172.21.15.165:3300/0 conn(0x7f60b015ca40 0x7f60b015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:24.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.931+0000 7f60b5800640 1 -- 172.21.15.144:0/1487553868 >> v1:172.21.15.165:6789/0 conn(0x7f60b00d02a0 legacy=0x7f60b00d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:24.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.931+0000 7f60b5800640 1 -- 172.21.15.144:0/1487553868 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b015dc30 con 0x7f60b015ceb0 2024-09-11T23:25:24.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.932+0000 7f60b5800640 1 --2- 172.21.15.144:0/1487553868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b015ceb0 0x7f60b01594c0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f60b00cf320 tx=0x7f60a802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b66cd6d46ff2b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:24.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.932+0000 7f60af400640 1 -- 172.21.15.144:0/1487553868 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a8033400 con 0x7f60b015ceb0 2024-09-11T23:25:24.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.932+0000 7f60af400640 1 -- 172.21.15.144:0/1487553868 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a80335a0 con 0x7f60b015ceb0 2024-09-11T23:25:24.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.932+0000 7f60af400640 1 -- 172.21.15.144:0/1487553868 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a8033970 con 0x7f60b015ceb0 2024-09-11T23:25:24.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.933+0000 7f60b7800640 1 -- 172.21.15.144:0/1487553868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b015ceb0 msgr2=0x7f60b01594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:24.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.933+0000 7f60b7800640 1 --2- 172.21.15.144:0/1487553868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b015ceb0 0x7f60b01594c0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f60b00cf320 tx=0x7f60a802c8b0 comp rx=0 tx=0).stop 2024-09-11T23:25:24.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.933+0000 7f60b7800640 1 -- 172.21.15.144:0/1487553868 shutdown_connections 2024-09-11T23:25:24.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.933+0000 7f60b7800640 1 --2- 172.21.15.144:0/1487553868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b015ceb0 0x7f60b01594c0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:24.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.933+0000 7f60b7800640 1 --2- 172.21.15.144:0/1487553868 >> v2:172.21.15.165:3300/0 conn(0x7f60b015ca40 0x7f60b015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:24.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.933+0000 7f60b7800640 1 -- 172.21.15.144:0/1487553868 >> 172.21.15.144:0/1487553868 conn(0x7f60b0062cc0 msgr2=0x7f60b006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:24.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.933+0000 7f60b7800640 1 -- 172.21.15.144:0/1487553868 shutdown_connections 2024-09-11T23:25:24.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.933+0000 7f60b7800640 1 -- 172.21.15.144:0/1487553868 wait complete. 2024-09-11T23:25:24.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.934+0000 7f60b7800640 1 Processor -- start 2024-09-11T23:25:24.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.935+0000 7f60b7800640 1 -- start start 2024-09-11T23:25:24.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.935+0000 7f60b7800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b00d02a0 0x7f60b01520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:24.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.935+0000 7f60b7800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60b015ca40 0x7f60b0157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:24.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.935+0000 7f60b7800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f60b015ceb0 0x7f60b00aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:24.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.935+0000 7f60b7800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f60b0155d10 con 0x7f60b00d02a0 2024-09-11T23:25:24.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.936+0000 7f60b7800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f60b0155b90 con 0x7f60b015ca40 2024-09-11T23:25:24.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.936+0000 7f60b7800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f60b00b4790 con 0x7f60b015ceb0 2024-09-11T23:25:24.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.936+0000 7f60b4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b00d02a0 0x7f60b01520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:24.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.936+0000 7f60b4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b00d02a0 0x7f60b01520b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34572/0 (socket says 172.21.15.144:34572) 2024-09-11T23:25:24.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.936+0000 7f60b4e00640 1 -- 172.21.15.144:0/1785212031 learned_addr learned my addr 172.21.15.144:0/1785212031 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:24.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.936+0000 7f60afe00640 1 --2- 172.21.15.144:0/1785212031 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60b015ca40 0x7f60b0157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:24.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.936+0000 7f60b5800640 1 --2- 172.21.15.144:0/1785212031 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f60b015ceb0 0x7f60b00aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:24.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.936+0000 7f60b4e00640 1 -- 172.21.15.144:0/1785212031 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f60b015ceb0 msgr2=0x7f60b00aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:24.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.936+0000 7f60b4e00640 1 --2- 172.21.15.144:0/1785212031 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f60b015ceb0 0x7f60b00aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:24.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.936+0000 7f60b4e00640 1 -- 172.21.15.144:0/1785212031 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60b015ca40 msgr2=0x7f60b0157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:24.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.936+0000 7f60b4e00640 1 --2- 172.21.15.144:0/1785212031 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60b015ca40 0x7f60b0157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:24.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.936+0000 7f60b4e00640 1 -- 172.21.15.144:0/1785212031 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b014c660 con 0x7f60b00d02a0 2024-09-11T23:25:24.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.936+0000 7f60b4e00640 1 --2- 172.21.15.144:0/1785212031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b00d02a0 0x7f60b01520b0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f60a400c430 tx=0x7f60a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:24.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.937+0000 7f60acc00640 1 -- 172.21.15.144:0/1785212031 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a40052d0 con 0x7f60b00d02a0 2024-09-11T23:25:24.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.937+0000 7f60acc00640 1 -- 172.21.15.144:0/1785212031 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a4005490 con 0x7f60b00d02a0 2024-09-11T23:25:24.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.937+0000 7f60acc00640 1 -- 172.21.15.144:0/1785212031 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a4007260 con 0x7f60b00d02a0 2024-09-11T23:25:24.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.937+0000 7f60b7800640 1 -- 172.21.15.144:0/1785212031 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b015adf0 con 0x7f60b00d02a0 2024-09-11T23:25:24.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.937+0000 7f60b7800640 1 -- 172.21.15.144:0/1785212031 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b015b090 con 0x7f60b00d02a0 2024-09-11T23:25:24.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.938+0000 7f60b7800640 1 -- 172.21.15.144:0/1785212031 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60b00d0680 con 0x7f60b00d02a0 2024-09-11T23:25:24.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.939+0000 7f60acc00640 1 -- 172.21.15.144:0/1785212031 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f60a4007400 con 0x7f60b00d02a0 2024-09-11T23:25:24.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.939+0000 7f60acc00640 1 --2- 172.21.15.144:0/1785212031 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f609006c460 0x7f609006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:24.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.940+0000 7f60acc00640 1 -- 172.21.15.144:0/1785212031 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f60a408aea0 con 0x7f60b00d02a0 2024-09-11T23:25:24.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.940+0000 7f60afe00640 1 --2- 172.21.15.144:0/1785212031 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f609006c460 0x7f609006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:24.940 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.941+0000 7f60afe00640 1 --2- 172.21.15.144:0/1785212031 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f609006c460 0x7f609006e920 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f60b0153040 tx=0x7f609c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:24.944 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:24.944+0000 7f60acc00640 1 -- 172.21.15.144:0/1785212031 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f60b014c660 con 0x7f60b00d02a0 2024-09-11T23:25:25.138 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.138+0000 7f60b7800640 1 -- 172.21.15.144:0/1785212031 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f60b00ceac0 con 0x7f609006c460 2024-09-11T23:25:25.139 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.140+0000 7f60acc00640 1 -- 172.21.15.144:0/1785212031 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f60b00ceac0 con 0x7f609006c460 2024-09-11T23:25:25.139 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:25:25.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:25.140 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephfs" 2024-09-11T23:25:25.140 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:25.140 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:25:25.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.142+0000 7f60b7800640 1 -- 172.21.15.144:0/1785212031 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f609006c460 msgr2=0x7f609006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:25.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.142+0000 7f60b7800640 1 --2- 172.21.15.144:0/1785212031 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f609006c460 0x7f609006e920 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f60b0153040 tx=0x7f609c008040 comp rx=0 tx=0).stop 2024-09-11T23:25:25.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.142+0000 7f60b7800640 1 -- 172.21.15.144:0/1785212031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b00d02a0 msgr2=0x7f60b01520b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:25.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.142+0000 7f60b7800640 1 --2- 172.21.15.144:0/1785212031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b00d02a0 0x7f60b01520b0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f60a400c430 tx=0x7f60a400c8f0 comp rx=0 tx=0).stop 2024-09-11T23:25:25.142 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.142+0000 7f60b7800640 1 -- 172.21.15.144:0/1785212031 shutdown_connections 2024-09-11T23:25:25.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.142+0000 7f60b7800640 1 --2- 172.21.15.144:0/1785212031 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f609006c460 0x7f609006e920 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:25.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.142+0000 7f60b7800640 1 --2- 172.21.15.144:0/1785212031 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f60b015ceb0 0x7f60b00aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:25.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.142+0000 7f60b7800640 1 --2- 172.21.15.144:0/1785212031 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f60b015ca40 0x7f60b0157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:25.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.142+0000 7f60b7800640 1 --2- 172.21.15.144:0/1785212031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60b00d02a0 0x7f60b01520b0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:25.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.142+0000 7f60b7800640 1 -- 172.21.15.144:0/1785212031 >> 172.21.15.144:0/1785212031 conn(0x7f60b0062cc0 msgr2=0x7f60b0154a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:25.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.142+0000 7f60b7800640 1 -- 172.21.15.144:0/1785212031 shutdown_connections 2024-09-11T23:25:25.143 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.142+0000 7f60b7800640 1 -- 172.21.15.144:0/1785212031 wait complete. 2024-09-11T23:25:25.159 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:25:25.316 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.316+0000 7f6a38600640 1 Processor -- start 2024-09-11T23:25:25.317 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.316+0000 7f6a38600640 1 -- start start 2024-09-11T23:25:25.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.317+0000 7f6a38600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a3006dfd0 0x7f6a300b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:25.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.317+0000 7f6a38600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a300cf9a0 con 0x7f6a300b3d50 2024-09-11T23:25:25.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.318+0000 7f6a38600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a30162210 con 0x7f6a30161e30 2024-09-11T23:25:25.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.318+0000 7f6a38600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6a300cfcf0 con 0x7f6a3006dfd0 2024-09-11T23:25:25.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.318+0000 7f6a36600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6a3006dfd0 0x7f6a300b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:25.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.318+0000 7f6a35200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6a300b3d50 0x7f6a3006d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51826/0 (socket says 172.21.15.144:51826) 2024-09-11T23:25:25.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.318+0000 7f6a35200640 1 -- 172.21.15.144:0/2469371156 learned_addr learned my addr 172.21.15.144:0/2469371156 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:25.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.318+0000 7f6a36600640 1 -- 172.21.15.144:0/2469371156 >> v1:172.21.15.165:6789/0 conn(0x7f6a30161e30 legacy=0x7f6a300d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:25.318 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.318+0000 7f6a36600640 1 -- 172.21.15.144:0/2469371156 >> v1:172.21.15.144:6789/0 conn(0x7f6a300b3d50 legacy=0x7f6a3006d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:25.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.318+0000 7f6a36600640 1 -- 172.21.15.144:0/2469371156 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a300d5210 con 0x7f6a3006dfd0 2024-09-11T23:25:25.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.319+0000 7f6a36600640 1 --2- 172.21.15.144:0/2469371156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a3006dfd0 0x7f6a300b78b0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009d90 tx=0x7f6a2802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ca76778f25c126 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:25.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.319+0000 7f6a2fe00640 1 -- 172.21.15.144:0/2469371156 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a28007740 con 0x7f6a3006dfd0 2024-09-11T23:25:25.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.319+0000 7f6a2fe00640 1 -- 172.21.15.144:0/2469371156 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a280078e0 con 0x7f6a3006dfd0 2024-09-11T23:25:25.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.319+0000 7f6a2fe00640 1 -- 172.21.15.144:0/2469371156 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a28007cb0 con 0x7f6a3006dfd0 2024-09-11T23:25:25.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.320+0000 7f6a38600640 1 -- 172.21.15.144:0/2469371156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a3006dfd0 msgr2=0x7f6a300b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:25.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.320+0000 7f6a38600640 1 --2- 172.21.15.144:0/2469371156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a3006dfd0 0x7f6a300b78b0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009d90 tx=0x7f6a2802a6f0 comp rx=0 tx=0).stop 2024-09-11T23:25:25.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.320+0000 7f6a38600640 1 -- 172.21.15.144:0/2469371156 shutdown_connections 2024-09-11T23:25:25.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.320+0000 7f6a38600640 1 --2- 172.21.15.144:0/2469371156 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a3006dfd0 0x7f6a300b78b0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:25.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.320+0000 7f6a38600640 1 -- 172.21.15.144:0/2469371156 >> 172.21.15.144:0/2469371156 conn(0x7f6a300d1870 msgr2=0x7f6a300d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:25.320 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.320+0000 7f6a38600640 1 -- 172.21.15.144:0/2469371156 shutdown_connections 2024-09-11T23:25:25.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.320+0000 7f6a38600640 1 -- 172.21.15.144:0/2469371156 wait complete. 2024-09-11T23:25:25.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.322+0000 7f6a38600640 1 Processor -- start 2024-09-11T23:25:25.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.322+0000 7f6a38600640 1 -- start start 2024-09-11T23:25:25.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.323+0000 7f6a38600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a3006dfd0 0x7f6a301f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:25.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.323+0000 7f6a38600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a300b3d50 0x7f6a300caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:25.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.323+0000 7f6a38600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a30161e30 0x7f6a3015fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:25.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.323+0000 7f6a38600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6a300b3290 con 0x7f6a30161e30 2024-09-11T23:25:25.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.323+0000 7f6a38600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6a300b3950 con 0x7f6a3006dfd0 2024-09-11T23:25:25.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.323+0000 7f6a38600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6a300b3410 con 0x7f6a300b3d50 2024-09-11T23:25:25.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.323+0000 7f6a36600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a30161e30 0x7f6a3015fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:25.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.323+0000 7f6a36600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a30161e30 0x7f6a3015fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34590/0 (socket says 172.21.15.144:34590) 2024-09-11T23:25:25.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.323+0000 7f6a36600640 1 -- 172.21.15.144:0/1319460835 learned_addr learned my addr 172.21.15.144:0/1319460835 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:25.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.323+0000 7f6a35c00640 1 --2- 172.21.15.144:0/1319460835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a3006dfd0 0x7f6a301f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:25.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.323+0000 7f6a35200640 1 --2- 172.21.15.144:0/1319460835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a300b3d50 0x7f6a300caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:25.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.323+0000 7f6a36600640 1 -- 172.21.15.144:0/1319460835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a300b3d50 msgr2=0x7f6a300caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:25.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.323+0000 7f6a36600640 1 --2- 172.21.15.144:0/1319460835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a300b3d50 0x7f6a300caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:25.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.323+0000 7f6a36600640 1 -- 172.21.15.144:0/1319460835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a3006dfd0 msgr2=0x7f6a301f5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:25.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.323+0000 7f6a36600640 1 --2- 172.21.15.144:0/1319460835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a3006dfd0 0x7f6a301f5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:25.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.323+0000 7f6a36600640 1 -- 172.21.15.144:0/1319460835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a301f7ae0 con 0x7f6a30161e30 2024-09-11T23:25:25.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.323+0000 7f6a35200640 1 --2- 172.21.15.144:0/1319460835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a300b3d50 0x7f6a300caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:25.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.324+0000 7f6a36600640 1 --2- 172.21.15.144:0/1319460835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a30161e30 0x7f6a3015fe90 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009eb0 tx=0x7f6a28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:25.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.324+0000 7f6a2d600640 1 -- 172.21.15.144:0/1319460835 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a28040070 con 0x7f6a30161e30 2024-09-11T23:25:25.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.324+0000 7f6a2d600640 1 -- 172.21.15.144:0/1319460835 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a28031bc0 con 0x7f6a30161e30 2024-09-11T23:25:25.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.324+0000 7f6a2d600640 1 -- 172.21.15.144:0/1319460835 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a28045460 con 0x7f6a30161e30 2024-09-11T23:25:25.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.324+0000 7f6a38600640 1 -- 172.21.15.144:0/1319460835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a301f7dc0 con 0x7f6a30161e30 2024-09-11T23:25:25.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.324+0000 7f6a38600640 1 -- 172.21.15.144:0/1319460835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a301f8380 con 0x7f6a30161e30 2024-09-11T23:25:25.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.325+0000 7f6a38600640 1 -- 172.21.15.144:0/1319460835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a3006d8c0 con 0x7f6a30161e30 2024-09-11T23:25:25.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.326+0000 7f6a2d600640 1 -- 172.21.15.144:0/1319460835 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f6a28039040 con 0x7f6a30161e30 2024-09-11T23:25:25.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.327+0000 7f6a2d600640 1 --2- 172.21.15.144:0/1319460835 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6a1006c490 0x7f6a1006e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:25.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.327+0000 7f6a2d600640 1 -- 172.21.15.144:0/1319460835 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f6a280ad2a0 con 0x7f6a30161e30 2024-09-11T23:25:25.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.327+0000 7f6a35c00640 1 --2- 172.21.15.144:0/1319460835 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6a1006c490 0x7f6a1006e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:25.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.328+0000 7f6a35c00640 1 --2- 172.21.15.144:0/1319460835 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6a1006c490 0x7f6a1006e950 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6a24000f60 tx=0x7f6a24009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:25.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.331+0000 7f6a2d600640 1 -- 172.21.15.144:0/1319460835 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a2807b3f0 con 0x7f6a30161e30 2024-09-11T23:25:25.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.505+0000 7f6a38600640 1 -- 172.21.15.144:0/1319460835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f6a30069190 con 0x7f6a30161e30 2024-09-11T23:25:25.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.505+0000 7f6a2d600640 1 -- 172.21.15.144:0/1319460835 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f6a2807acf0 con 0x7f6a30161e30 2024-09-11T23:25:25.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.507+0000 7f6a38600640 1 -- 172.21.15.144:0/1319460835 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6a1006c490 msgr2=0x7f6a1006e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:25.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.507+0000 7f6a38600640 1 --2- 172.21.15.144:0/1319460835 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6a1006c490 0x7f6a1006e950 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6a24000f60 tx=0x7f6a24009040 comp rx=0 tx=0).stop 2024-09-11T23:25:25.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.507+0000 7f6a38600640 1 -- 172.21.15.144:0/1319460835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a30161e30 msgr2=0x7f6a3015fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:25.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.507+0000 7f6a38600640 1 --2- 172.21.15.144:0/1319460835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a30161e30 0x7f6a3015fe90 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f6a28009eb0 tx=0x7f6a28004a40 comp rx=0 tx=0).stop 2024-09-11T23:25:25.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.507+0000 7f6a38600640 1 -- 172.21.15.144:0/1319460835 shutdown_connections 2024-09-11T23:25:25.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.507+0000 7f6a38600640 1 --2- 172.21.15.144:0/1319460835 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6a1006c490 0x7f6a1006e950 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:25.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.507+0000 7f6a38600640 1 --2- 172.21.15.144:0/1319460835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6a30161e30 0x7f6a3015fe90 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:25.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.507+0000 7f6a38600640 1 --2- 172.21.15.144:0/1319460835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6a300b3d50 0x7f6a300caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:25.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.507+0000 7f6a38600640 1 --2- 172.21.15.144:0/1319460835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a3006dfd0 0x7f6a301f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:25.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.507+0000 7f6a38600640 1 -- 172.21.15.144:0/1319460835 >> 172.21.15.144:0/1319460835 conn(0x7f6a300d1870 msgr2=0x7f6a300b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:25.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.507+0000 7f6a38600640 1 -- 172.21.15.144:0/1319460835 shutdown_connections 2024-09-11T23:25:25.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.507+0000 7f6a38600640 1 -- 172.21.15.144:0/1319460835 wait complete. 2024-09-11T23:25:25.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:25.523 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/_nogroup/subvol79470) 2024-09-11T23:25:25.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:25.588 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp40900/subvol3511) 2024-09-11T23:25:25.647 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol79470 2024-09-11T23:25:25.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.806+0000 7f62e6e00640 1 Processor -- start 2024-09-11T23:25:25.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.806+0000 7f62e6e00640 1 -- start start 2024-09-11T23:25:25.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.807+0000 7f62e6e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62e0159dd0 0x7f62e00cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:25.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.808+0000 7f62e6e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e00cfd20 con 0x7f62e00cf260 2024-09-11T23:25:25.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.808+0000 7f62e6e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e00cd4e0 con 0x7f62e006c2b0 2024-09-11T23:25:25.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.808+0000 7f62e6e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f62e00cd7c0 con 0x7f62e0159dd0 2024-09-11T23:25:25.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.808+0000 7f62e5000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f62e00cf260 0x7f62e006bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51830/0 (socket says 172.21.15.144:51830) 2024-09-11T23:25:25.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.808+0000 7f62e5000640 1 -- 172.21.15.144:0/1022507353 learned_addr learned my addr 172.21.15.144:0/1022507353 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:25.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.808+0000 7f62e5a00640 1 --2- 172.21.15.144:0/1022507353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62e0159dd0 0x7f62e00cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:25.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.808+0000 7f62dfe00640 1 -- 172.21.15.144:0/1022507353 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4144549878 0 0) 0x7f62e00cfd20 con 0x7f62e00cf260 2024-09-11T23:25:25.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.808+0000 7f62dfe00640 1 -- 172.21.15.144:0/1022507353 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62c8003520 con 0x7f62e00cf260 2024-09-11T23:25:25.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.809+0000 7f62dfe00640 1 -- 172.21.15.144:0/1022507353 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4000866657 0 0) 0x7f62e00cd4e0 con 0x7f62e006c2b0 2024-09-11T23:25:25.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.809+0000 7f62e5a00640 1 -- 172.21.15.144:0/1022507353 >> v1:172.21.15.165:6789/0 conn(0x7f62e006c2b0 legacy=0x7f62e015d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:25.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.809+0000 7f62e5a00640 1 -- 172.21.15.144:0/1022507353 >> v1:172.21.15.144:6789/0 conn(0x7f62e00cf260 legacy=0x7f62e006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:25.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.809+0000 7f62e5a00640 1 -- 172.21.15.144:0/1022507353 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e00cdaa0 con 0x7f62e0159dd0 2024-09-11T23:25:25.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.810+0000 7f62e5a00640 1 --2- 172.21.15.144:0/1022507353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62e0159dd0 0x7f62e00cdfc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f62d40097d0 tx=0x7f62d402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0be0c4c973e1a38 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.810+0000 7f62dfe00640 1 -- 172.21.15.144:0/1022507353 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4037070 con 0x7f62e0159dd0 2024-09-11T23:25:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.810+0000 7f62dfe00640 1 -- 172.21.15.144:0/1022507353 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d402ac10 con 0x7f62e0159dd0 2024-09-11T23:25:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.810+0000 7f62dfe00640 1 -- 172.21.15.144:0/1022507353 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62cc0015f0 con 0x7f62e0159dd0 2024-09-11T23:25:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.810+0000 7f62e6e00640 1 -- 172.21.15.144:0/1022507353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62e0159dd0 msgr2=0x7f62e00cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.810+0000 7f62e6e00640 1 --2- 172.21.15.144:0/1022507353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62e0159dd0 0x7f62e00cdfc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f62d40097d0 tx=0x7f62d402a180 comp rx=0 tx=0).stop 2024-09-11T23:25:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.811+0000 7f62e6e00640 1 -- 172.21.15.144:0/1022507353 shutdown_connections 2024-09-11T23:25:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.811+0000 7f62e6e00640 1 --2- 172.21.15.144:0/1022507353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62e0159dd0 0x7f62e00cdfc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.811+0000 7f62e6e00640 1 -- 172.21.15.144:0/1022507353 >> 172.21.15.144:0/1022507353 conn(0x7f62e00d0300 msgr2=0x7f62e00d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.811+0000 7f62e6e00640 1 -- 172.21.15.144:0/1022507353 shutdown_connections 2024-09-11T23:25:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.811+0000 7f62e6e00640 1 -- 172.21.15.144:0/1022507353 wait complete. 2024-09-11T23:25:25.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.812+0000 7f62e6e00640 1 Processor -- start 2024-09-11T23:25:25.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.812+0000 7f62e6e00640 1 -- start start 2024-09-11T23:25:25.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.813+0000 7f62e6e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62e006c2b0 0x7f62e00c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:25.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.813+0000 7f62e6e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62e00cf260 0x7f62e0146e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:25.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.813+0000 7f62e6e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62e0159dd0 0x7f62e00c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:25.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.813+0000 7f62e6e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f62e00cf6a0 con 0x7f62e006c2b0 2024-09-11T23:25:25.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.813+0000 7f62e6e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f62e015d6d0 con 0x7f62e00cf260 2024-09-11T23:25:25.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.813+0000 7f62e6e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f62e00cf820 con 0x7f62e0159dd0 2024-09-11T23:25:25.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.814+0000 7f62e5a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62e006c2b0 0x7f62e00c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:25.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.814+0000 7f62e5a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62e006c2b0 0x7f62e00c5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34594/0 (socket says 172.21.15.144:34594) 2024-09-11T23:25:25.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.814+0000 7f62e5a00640 1 -- 172.21.15.144:0/857157213 learned_addr learned my addr 172.21.15.144:0/857157213 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:25.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.814+0000 7f62e6400640 1 --2- 172.21.15.144:0/857157213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62e0159dd0 0x7f62e00c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:25.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.814+0000 7f62e5000640 1 --2- 172.21.15.144:0/857157213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62e00cf260 0x7f62e0146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:25.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.814+0000 7f62e5a00640 1 -- 172.21.15.144:0/857157213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62e0159dd0 msgr2=0x7f62e00c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:25.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.814+0000 7f62e5a00640 1 --2- 172.21.15.144:0/857157213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62e0159dd0 0x7f62e00c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:25.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.814+0000 7f62e5a00640 1 -- 172.21.15.144:0/857157213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62e00cf260 msgr2=0x7f62e0146e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:25.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.814+0000 7f62e5a00640 1 --2- 172.21.15.144:0/857157213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62e00cf260 0x7f62e0146e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:25.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.814+0000 7f62e5a00640 1 -- 172.21.15.144:0/857157213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e00ca970 con 0x7f62e006c2b0 2024-09-11T23:25:25.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.814+0000 7f62e5a00640 1 --2- 172.21.15.144:0/857157213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62e006c2b0 0x7f62e00c5f60 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f62d4035040 tx=0x7f62d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:25.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.815+0000 7f62dd600640 1 -- 172.21.15.144:0/857157213 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4042070 con 0x7f62e006c2b0 2024-09-11T23:25:25.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.815+0000 7f62dd600640 1 -- 172.21.15.144:0/857157213 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d403d440 con 0x7f62e006c2b0 2024-09-11T23:25:25.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.815+0000 7f62dd600640 1 -- 172.21.15.144:0/857157213 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4037040 con 0x7f62e006c2b0 2024-09-11T23:25:25.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.815+0000 7f62e6e00640 1 -- 172.21.15.144:0/857157213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e00cabf0 con 0x7f62e006c2b0 2024-09-11T23:25:25.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.815+0000 7f62e6e00640 1 -- 172.21.15.144:0/857157213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e00cb490 con 0x7f62e006c2b0 2024-09-11T23:25:25.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.816+0000 7f62e6e00640 1 -- 172.21.15.144:0/857157213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62e00cdfc0 con 0x7f62e006c2b0 2024-09-11T23:25:25.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.817+0000 7f62dd600640 1 -- 172.21.15.144:0/857157213 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f62d4045070 con 0x7f62e006c2b0 2024-09-11T23:25:25.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.817+0000 7f62dd600640 1 --2- 172.21.15.144:0/857157213 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f62c006c460 0x7f62c006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:25.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.818+0000 7f62dd600640 1 -- 172.21.15.144:0/857157213 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f62d40abfe0 con 0x7f62e006c2b0 2024-09-11T23:25:25.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.818+0000 7f62e5000640 1 --2- 172.21.15.144:0/857157213 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f62c006c460 0x7f62c006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:25.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.818+0000 7f62e5000640 1 --2- 172.21.15.144:0/857157213 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f62c006c460 0x7f62c006e920 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f62cc001540 tx=0x7f62cc0014b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:25.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:25.822+0000 7f62dd600640 1 -- 172.21.15.144:0/857157213 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f62e00ca970 con 0x7f62e006c2b0 2024-09-11T23:25:26.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.023+0000 7f62e6e00640 1 -- 172.21.15.144:0/857157213 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol79470", "target": ["mon-mgr", ""]}) -- 0x7f62e01e28a0 con 0x7f62c006c460 2024-09-11T23:25:26.030 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:25:26.030+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:25:26.030 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:25:26.030+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:25:26.030 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:25:26.030+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:25:26.030 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:25:26.030+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:25:26.030 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:25:26.030+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:25:26.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.066+0000 7f62dd600640 1 -- 172.21.15.144:0/857157213 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7f62e01e28a0 con 0x7f62c006c460 2024-09-11T23:25:26.066 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/_nogroup/subvol79470 2024-09-11T23:25:26.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.068+0000 7f62e6e00640 1 -- 172.21.15.144:0/857157213 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f62c006c460 msgr2=0x7f62c006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:26.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.068+0000 7f62e6e00640 1 --2- 172.21.15.144:0/857157213 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f62c006c460 0x7f62c006e920 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f62cc001540 tx=0x7f62cc0014b0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.068+0000 7f62e6e00640 1 -- 172.21.15.144:0/857157213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62e006c2b0 msgr2=0x7f62e00c5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:26.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.068+0000 7f62e6e00640 1 --2- 172.21.15.144:0/857157213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62e006c2b0 0x7f62e00c5f60 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f62d4035040 tx=0x7f62d40046c0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.068+0000 7f62e6e00640 1 -- 172.21.15.144:0/857157213 shutdown_connections 2024-09-11T23:25:26.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.068+0000 7f62e6e00640 1 --2- 172.21.15.144:0/857157213 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f62c006c460 0x7f62c006e920 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.068+0000 7f62e6e00640 1 --2- 172.21.15.144:0/857157213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f62e0159dd0 0x7f62e00c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.068+0000 7f62e6e00640 1 --2- 172.21.15.144:0/857157213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62e00cf260 0x7f62e0146e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.068+0000 7f62e6e00640 1 --2- 172.21.15.144:0/857157213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62e006c2b0 0x7f62e00c5f60 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.068+0000 7f62e6e00640 1 -- 172.21.15.144:0/857157213 >> 172.21.15.144:0/857157213 conn(0x7f62e00d0300 msgr2=0x7f62e0158290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:26.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.069+0000 7f62e6e00640 1 -- 172.21.15.144:0/857157213 shutdown_connections 2024-09-11T23:25:26.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.069+0000 7f62e6e00640 1 -- 172.21.15.144:0/857157213 wait complete. 2024-09-11T23:25:26.084 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol3511 subvol_grp40900 2024-09-11T23:25:26.241 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.242+0000 7f29aa000640 1 Processor -- start 2024-09-11T23:25:26.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.242+0000 7f29aa000640 1 -- start start 2024-09-11T23:25:26.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.243+0000 7f29aa000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f29a415e650 0x7f29a40cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:26.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.243+0000 7f29aa000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f29a40d32d0 0x7f29a406d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:26.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.243+0000 7f29aa000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29a40d3890 con 0x7f29a406db50 2024-09-11T23:25:26.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.243+0000 7f29aa000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f29a415ea30 con 0x7f29a40d32d0 2024-09-11T23:25:26.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.243+0000 7f29aa000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f29a406df90 con 0x7f29a415e650 2024-09-11T23:25:26.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.243+0000 7f29a3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f29a40d32d0 0x7f29a406d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:26.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.243+0000 7f29a3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f29a40d32d0 0x7f29a406d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34598/0 (socket says 172.21.15.144:34598) 2024-09-11T23:25:26.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.243+0000 7f29a3e00640 1 -- 172.21.15.144:0/3774333131 learned_addr learned my addr 172.21.15.144:0/3774333131 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:26.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.243+0000 7f29a8c00640 1 --2- 172.21.15.144:0/3774333131 >> v2:172.21.15.165:3300/0 conn(0x7f29a415e650 0x7f29a40cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:26.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.244+0000 7f29a3e00640 1 -- 172.21.15.144:0/3774333131 >> v2:172.21.15.165:3300/0 conn(0x7f29a415e650 msgr2=0x7f29a40cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:26.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.244+0000 7f29a3e00640 1 --2- 172.21.15.144:0/3774333131 >> v2:172.21.15.165:3300/0 conn(0x7f29a415e650 0x7f29a40cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.244+0000 7f29a3e00640 1 -- 172.21.15.144:0/3774333131 >> v1:172.21.15.165:6789/0 conn(0x7f29a406db50 legacy=0x7f29a406bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:26.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.244+0000 7f29a3e00640 1 -- 172.21.15.144:0/3774333131 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a40d3b70 con 0x7f29a40d32d0 2024-09-11T23:25:26.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.245+0000 7f29a3e00640 1 --2- 172.21.15.144:0/3774333131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29a40d32d0 0x7f29a406d610 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f29a4069b80 tx=0x7f299002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216e5cd6a3693f18 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:26.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.245+0000 7f29a3400640 1 -- 172.21.15.144:0/3774333131 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2990037070 con 0x7f29a40d32d0 2024-09-11T23:25:26.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.245+0000 7f29a3400640 1 -- 172.21.15.144:0/3774333131 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f299002ae50 con 0x7f29a40d32d0 2024-09-11T23:25:26.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.245+0000 7f29a3400640 1 -- 172.21.15.144:0/3774333131 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2990032860 con 0x7f29a40d32d0 2024-09-11T23:25:26.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.245+0000 7f29aa000640 1 -- 172.21.15.144:0/3774333131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29a40d32d0 msgr2=0x7f29a406d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:26.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.245+0000 7f29aa000640 1 --2- 172.21.15.144:0/3774333131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29a40d32d0 0x7f29a406d610 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f29a4069b80 tx=0x7f299002a300 comp rx=0 tx=0).stop 2024-09-11T23:25:26.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.246+0000 7f29aa000640 1 -- 172.21.15.144:0/3774333131 shutdown_connections 2024-09-11T23:25:26.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.246+0000 7f29aa000640 1 --2- 172.21.15.144:0/3774333131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29a40d32d0 0x7f29a406d610 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.246+0000 7f29aa000640 1 --2- 172.21.15.144:0/3774333131 >> v2:172.21.15.165:3300/0 conn(0x7f29a415e650 0x7f29a40cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.246+0000 7f29aa000640 1 -- 172.21.15.144:0/3774333131 >> 172.21.15.144:0/3774333131 conn(0x7f29a40d4740 msgr2=0x7f29a40d4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:26.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.246+0000 7f29aa000640 1 -- 172.21.15.144:0/3774333131 shutdown_connections 2024-09-11T23:25:26.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.246+0000 7f29aa000640 1 -- 172.21.15.144:0/3774333131 wait complete. 2024-09-11T23:25:26.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.247+0000 7f29aa000640 1 Processor -- start 2024-09-11T23:25:26.247 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.247+0000 7f29aa000640 1 -- start start 2024-09-11T23:25:26.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.248+0000 7f29aa000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29a406db50 0x7f29a41f49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:26.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.248+0000 7f29aa000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f29a40d32d0 0x7f29a40ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:26.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.248+0000 7f29aa000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f29a415e650 0x7f29a40adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:26.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.248+0000 7f29aa000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f29a40cfc10 con 0x7f29a406db50 2024-09-11T23:25:26.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.248+0000 7f29aa000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f29a40d4130 con 0x7f29a40d32d0 2024-09-11T23:25:26.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.248+0000 7f29aa000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f29a40cfd90 con 0x7f29a415e650 2024-09-11T23:25:26.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.248+0000 7f29a8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29a406db50 0x7f29a41f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:26.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.248+0000 7f29a8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29a406db50 0x7f29a41f49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34608/0 (socket says 172.21.15.144:34608) 2024-09-11T23:25:26.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.249+0000 7f29a8c00640 1 -- 172.21.15.144:0/2548126191 learned_addr learned my addr 172.21.15.144:0/2548126191 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:26.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.249+0000 7f29a3e00640 1 --2- 172.21.15.144:0/2548126191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f29a40d32d0 0x7f29a40ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:26.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.249+0000 7f29a9600640 1 --2- 172.21.15.144:0/2548126191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f29a415e650 0x7f29a40adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:26.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.249+0000 7f29a8c00640 1 -- 172.21.15.144:0/2548126191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f29a415e650 msgr2=0x7f29a40adbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:26.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.249+0000 7f29a8c00640 1 --2- 172.21.15.144:0/2548126191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f29a415e650 0x7f29a40adbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.249+0000 7f29a8c00640 1 -- 172.21.15.144:0/2548126191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f29a40d32d0 msgr2=0x7f29a40ac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:26.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.249+0000 7f29a8c00640 1 --2- 172.21.15.144:0/2548126191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f29a40d32d0 0x7f29a40ac2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.249+0000 7f29a8c00640 1 -- 172.21.15.144:0/2548126191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a40ab520 con 0x7f29a406db50 2024-09-11T23:25:26.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.249+0000 7f29a9600640 1 --2- 172.21.15.144:0/2548126191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f29a415e650 0x7f29a40adbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:26.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.249+0000 7f29a8c00640 1 --2- 172.21.15.144:0/2548126191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29a406db50 0x7f29a41f49c0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f299800e870 tx=0x7f299800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:26.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.249+0000 7f29a0c00640 1 -- 172.21.15.144:0/2548126191 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2998017070 con 0x7f29a406db50 2024-09-11T23:25:26.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.249+0000 7f29a0c00640 1 -- 172.21.15.144:0/2548126191 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f299800c940 con 0x7f29a406db50 2024-09-11T23:25:26.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.249+0000 7f29a0c00640 1 -- 172.21.15.144:0/2548126191 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299800cd30 con 0x7f29a406db50 2024-09-11T23:25:26.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.249+0000 7f29aa000640 1 -- 172.21.15.144:0/2548126191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29a40ab800 con 0x7f29a406db50 2024-09-11T23:25:26.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.250+0000 7f29aa000640 1 -- 172.21.15.144:0/2548126191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a40ae6a0 con 0x7f29a406db50 2024-09-11T23:25:26.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.251+0000 7f29aa000640 1 -- 172.21.15.144:0/2548126191 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29a40abf20 con 0x7f29a406db50 2024-09-11T23:25:26.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.251+0000 7f29a0c00640 1 -- 172.21.15.144:0/2548126191 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f299801a070 con 0x7f29a406db50 2024-09-11T23:25:26.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.252+0000 7f29a0c00640 1 --2- 172.21.15.144:0/2548126191 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f298406c460 0x7f298406e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:26.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.252+0000 7f29a0c00640 1 -- 172.21.15.144:0/2548126191 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f299808bbb0 con 0x7f29a406db50 2024-09-11T23:25:26.252 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.253+0000 7f29a3e00640 1 --2- 172.21.15.144:0/2548126191 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f298406c460 0x7f298406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:26.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.253+0000 7f29a3e00640 1 --2- 172.21.15.144:0/2548126191 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f298406c460 0x7f298406e920 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2990034000 tx=0x7f299002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:26.256 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.256+0000 7f29a0c00640 1 -- 172.21.15.144:0/2548126191 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2998059cb0 con 0x7f29a406db50 2024-09-11T23:25:26.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.459+0000 7f29aa000640 1 -- 172.21.15.144:0/2548126191 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol3511", "group_name": "subvol_grp40900", "target": ["mon-mgr", ""]}) -- 0x7f29a4068cd0 con 0x7f298406c460 2024-09-11T23:25:26.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.481+0000 7f29a0c00640 1 -- 172.21.15.144:0/2548126191 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f29a4068cd0 con 0x7f298406c460 2024-09-11T23:25:26.481 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/subvol_grp40900/subvol3511 2024-09-11T23:25:26.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.483+0000 7f29aa000640 1 -- 172.21.15.144:0/2548126191 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f298406c460 msgr2=0x7f298406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:26.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.483+0000 7f29aa000640 1 --2- 172.21.15.144:0/2548126191 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f298406c460 0x7f298406e920 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2990034000 tx=0x7f299002e000 comp rx=0 tx=0).stop 2024-09-11T23:25:26.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.483+0000 7f29aa000640 1 -- 172.21.15.144:0/2548126191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29a406db50 msgr2=0x7f29a41f49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:26.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.483+0000 7f29aa000640 1 --2- 172.21.15.144:0/2548126191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29a406db50 0x7f29a41f49c0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f299800e870 tx=0x7f299800ed30 comp rx=0 tx=0).stop 2024-09-11T23:25:26.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.483+0000 7f29aa000640 1 -- 172.21.15.144:0/2548126191 shutdown_connections 2024-09-11T23:25:26.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.483+0000 7f29aa000640 1 --2- 172.21.15.144:0/2548126191 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f298406c460 0x7f298406e920 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.483+0000 7f29aa000640 1 --2- 172.21.15.144:0/2548126191 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f29a415e650 0x7f29a40adbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.483+0000 7f29aa000640 1 --2- 172.21.15.144:0/2548126191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f29a40d32d0 0x7f29a40ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.483+0000 7f29aa000640 1 --2- 172.21.15.144:0/2548126191 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29a406db50 0x7f29a41f49c0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.483+0000 7f29aa000640 1 -- 172.21.15.144:0/2548126191 >> 172.21.15.144:0/2548126191 conn(0x7f29a40d4740 msgr2=0x7f29a40b6690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:26.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.483+0000 7f29aa000640 1 -- 172.21.15.144:0/2548126191 shutdown_connections 2024-09-11T23:25:26.484 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.483+0000 7f29aa000640 1 -- 172.21.15.144:0/2548126191 wait complete. 2024-09-11T23:25:26.499 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol79470 2024-09-11T23:25:26.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.656+0000 7f4d95600640 1 Processor -- start 2024-09-11T23:25:26.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.656+0000 7f4d95600640 1 -- start start 2024-09-11T23:25:26.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.658+0000 7f4d95600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4d90073cf0 0x7f4d9006d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:26.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.658+0000 7f4d95600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d90147c00 con 0x7f4d900b63b0 2024-09-11T23:25:26.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.658+0000 7f4d95600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d900741d0 con 0x7f4d90147820 2024-09-11T23:25:26.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.658+0000 7f4d95600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4d90162160 con 0x7f4d90073cf0 2024-09-11T23:25:26.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.658+0000 7f4d94c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4d900b63b0 0x7f4d9006bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51836/0 (socket says 172.21.15.144:51836) 2024-09-11T23:25:26.658 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.658+0000 7f4d94c00640 1 -- 172.21.15.144:0/986841768 learned_addr learned my addr 172.21.15.144:0/986841768 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:26.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.658+0000 7f4d8f400640 1 --2- 172.21.15.144:0/986841768 >> v2:172.21.15.165:3300/0 conn(0x7f4d90073cf0 0x7f4d9006d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:26.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.658+0000 7f4d8ea00640 1 -- 172.21.15.144:0/986841768 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1840277177 0 0) 0x7f4d90147c00 con 0x7f4d900b63b0 2024-09-11T23:25:26.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.658+0000 7f4d8ea00640 1 -- 172.21.15.144:0/986841768 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d74003520 con 0x7f4d900b63b0 2024-09-11T23:25:26.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.659+0000 7f4d8ea00640 1 -- 172.21.15.144:0/986841768 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4236243472 0 0) 0x7f4d900741d0 con 0x7f4d90147820 2024-09-11T23:25:26.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.659+0000 7f4d8ea00640 1 -- 172.21.15.144:0/986841768 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d90147c00 con 0x7f4d90147820 2024-09-11T23:25:26.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.659+0000 7f4d8f400640 1 -- 172.21.15.144:0/986841768 >> v1:172.21.15.165:6789/0 conn(0x7f4d90147820 legacy=0x7f4d900b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:26.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.659+0000 7f4d8f400640 1 -- 172.21.15.144:0/986841768 >> v1:172.21.15.144:6789/0 conn(0x7f4d900b63b0 legacy=0x7f4d9006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:26.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.659+0000 7f4d8f400640 1 -- 172.21.15.144:0/986841768 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d90162440 con 0x7f4d90073cf0 2024-09-11T23:25:26.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.660+0000 7f4d8f400640 1 --2- 172.21.15.144:0/986841768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d90073cf0 0x7f4d9006d7a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0097a0 tx=0x7f4d7c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9506e3e99aa0c267 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:26.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.660+0000 7f4d8ea00640 1 -- 172.21.15.144:0/986841768 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c037070 con 0x7f4d90073cf0 2024-09-11T23:25:26.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.660+0000 7f4d8ea00640 1 -- 172.21.15.144:0/986841768 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d7c032440 con 0x7f4d90073cf0 2024-09-11T23:25:26.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.660+0000 7f4d8ea00640 1 -- 172.21.15.144:0/986841768 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c032810 con 0x7f4d90073cf0 2024-09-11T23:25:26.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.660+0000 7f4d95600640 1 -- 172.21.15.144:0/986841768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d90073cf0 msgr2=0x7f4d9006d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:26.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.660+0000 7f4d95600640 1 --2- 172.21.15.144:0/986841768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d90073cf0 0x7f4d9006d7a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0097a0 tx=0x7f4d7c02a230 comp rx=0 tx=0).stop 2024-09-11T23:25:26.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.661+0000 7f4d95600640 1 -- 172.21.15.144:0/986841768 shutdown_connections 2024-09-11T23:25:26.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.661+0000 7f4d95600640 1 --2- 172.21.15.144:0/986841768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d90073cf0 0x7f4d9006d7a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.661+0000 7f4d95600640 1 -- 172.21.15.144:0/986841768 >> 172.21.15.144:0/986841768 conn(0x7f4d9006ccb0 msgr2=0x7f4d9006d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:26.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.661+0000 7f4d95600640 1 -- 172.21.15.144:0/986841768 shutdown_connections 2024-09-11T23:25:26.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.661+0000 7f4d95600640 1 -- 172.21.15.144:0/986841768 wait complete. 2024-09-11T23:25:26.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.662+0000 7f4d95600640 1 Processor -- start 2024-09-11T23:25:26.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.662+0000 7f4d95600640 1 -- start start 2024-09-11T23:25:26.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.663+0000 7f4d95600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d90073cf0 0x7f4d900b2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:26.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.663+0000 7f4d95600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d900b63b0 0x7f4d900cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:26.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.663+0000 7f4d95600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4d90147820 0x7f4d900cf330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:26.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.663+0000 7f4d95600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4d90162f20 con 0x7f4d900b63b0 2024-09-11T23:25:26.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.663+0000 7f4d95600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4d90162a00 con 0x7f4d90073cf0 2024-09-11T23:25:26.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.663+0000 7f4d95600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4d90148280 con 0x7f4d90147820 2024-09-11T23:25:26.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.663+0000 7f4d8f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d900b63b0 0x7f4d900cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:26.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.664+0000 7f4d8f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d900b63b0 0x7f4d900cedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34612/0 (socket says 172.21.15.144:34612) 2024-09-11T23:25:26.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.664+0000 7f4d8f400640 1 -- 172.21.15.144:0/520307476 learned_addr learned my addr 172.21.15.144:0/520307476 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:26.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.664+0000 7f4d8fe00640 1 --2- 172.21.15.144:0/520307476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d90073cf0 0x7f4d900b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:26.664 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.664+0000 7f4d94c00640 1 --2- 172.21.15.144:0/520307476 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4d90147820 0x7f4d900cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:26.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.664+0000 7f4d8f400640 1 -- 172.21.15.144:0/520307476 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4d90147820 msgr2=0x7f4d900cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:26.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.664+0000 7f4d8f400640 1 --2- 172.21.15.144:0/520307476 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4d90147820 0x7f4d900cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.664+0000 7f4d8f400640 1 -- 172.21.15.144:0/520307476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d90073cf0 msgr2=0x7f4d900b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:26.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.664+0000 7f4d8f400640 1 --2- 172.21.15.144:0/520307476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d90073cf0 0x7f4d900b2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.664+0000 7f4d8f400640 1 -- 172.21.15.144:0/520307476 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9015f130 con 0x7f4d900b63b0 2024-09-11T23:25:26.665 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.664+0000 7f4d8f400640 1 --2- 172.21.15.144:0/520307476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d900b63b0 0x7f4d900cedf0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c035040 tx=0x7f4d7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:26.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.665+0000 7f4d87e00640 1 -- 172.21.15.144:0/520307476 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c041030 con 0x7f4d900b63b0 2024-09-11T23:25:26.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.665+0000 7f4d87e00640 1 -- 172.21.15.144:0/520307476 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d7c03d4e0 con 0x7f4d900b63b0 2024-09-11T23:25:26.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.665+0000 7f4d87e00640 1 -- 172.21.15.144:0/520307476 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c037040 con 0x7f4d900b63b0 2024-09-11T23:25:26.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.665+0000 7f4d95600640 1 -- 172.21.15.144:0/520307476 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d9015f410 con 0x7f4d900b63b0 2024-09-11T23:25:26.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.665+0000 7f4d95600640 1 -- 172.21.15.144:0/520307476 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d9015f9d0 con 0x7f4d900b63b0 2024-09-11T23:25:26.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.666+0000 7f4d95600640 1 -- 172.21.15.144:0/520307476 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d9006d7a0 con 0x7f4d900b63b0 2024-09-11T23:25:26.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.667+0000 7f4d87e00640 1 -- 172.21.15.144:0/520307476 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 23) ==== 91059+0+0 (secure 0 0 0) 0x7f4d7c044070 con 0x7f4d900b63b0 2024-09-11T23:25:26.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.668+0000 7f4d87e00640 1 --2- 172.21.15.144:0/520307476 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4d7006c460 0x7f4d7006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:26.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.668+0000 7f4d87e00640 1 -- 172.21.15.144:0/520307476 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f4d7c0ac050 con 0x7f4d900b63b0 2024-09-11T23:25:26.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.669+0000 7f4d8fe00640 1 --2- 172.21.15.144:0/520307476 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4d7006c460 0x7f4d7006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:26.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.669+0000 7f4d8fe00640 1 --2- 172.21.15.144:0/520307476 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4d7006c460 0x7f4d7006e920 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4d80001e00 tx=0x7f4d80009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:26.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.672+0000 7f4d87e00640 1 -- 172.21.15.144:0/520307476 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d7c07a000 con 0x7f4d900b63b0 2024-09-11T23:25:26.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.873+0000 7f4d95600640 1 -- 172.21.15.144:0/520307476 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol79470", "target": ["mon-mgr", ""]}) -- 0x7f4d900cd8d0 con 0x7f4d7006c460 2024-09-11T23:25:26.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.879+0000 7f4d87e00640 1 -- 172.21.15.144:0/520307476 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7f4d900cd8d0 con 0x7f4d7006c460 2024-09-11T23:25:26.878 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/_nogroup/subvol79470 2024-09-11T23:25:26.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.881+0000 7f4d95600640 1 -- 172.21.15.144:0/520307476 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4d7006c460 msgr2=0x7f4d7006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:26.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.881+0000 7f4d95600640 1 --2- 172.21.15.144:0/520307476 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4d7006c460 0x7f4d7006e920 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4d80001e00 tx=0x7f4d80009040 comp rx=0 tx=0).stop 2024-09-11T23:25:26.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.881+0000 7f4d95600640 1 -- 172.21.15.144:0/520307476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d900b63b0 msgr2=0x7f4d900cedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:26.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.881+0000 7f4d95600640 1 --2- 172.21.15.144:0/520307476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d900b63b0 0x7f4d900cedf0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c035040 tx=0x7f4d7c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.881+0000 7f4d95600640 1 -- 172.21.15.144:0/520307476 shutdown_connections 2024-09-11T23:25:26.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.881+0000 7f4d95600640 1 --2- 172.21.15.144:0/520307476 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4d7006c460 0x7f4d7006e920 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.881+0000 7f4d95600640 1 --2- 172.21.15.144:0/520307476 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4d90147820 0x7f4d900cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.881+0000 7f4d95600640 1 --2- 172.21.15.144:0/520307476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d900b63b0 0x7f4d900cedf0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.881+0000 7f4d95600640 1 --2- 172.21.15.144:0/520307476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d90073cf0 0x7f4d900b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:26.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.881+0000 7f4d95600640 1 -- 172.21.15.144:0/520307476 >> 172.21.15.144:0/520307476 conn(0x7f4d9006ccb0 msgr2=0x7f4d9015e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:26.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.881+0000 7f4d95600640 1 -- 172.21.15.144:0/520307476 shutdown_connections 2024-09-11T23:25:26.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:26.881+0000 7f4d95600640 1 -- 172.21.15.144:0/520307476 wait complete. 2024-09-11T23:25:26.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:26.896 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/3c61a48e0ec4caa98b358038b26839f0.meta) 2024-09-11T23:25:29.994 INFO:teuthology.orchestra.run.smithi144.stdout:[GLOBAL] 2024-09-11T23:25:29.994 INFO:teuthology.orchestra.run.smithi144.stdout:version = 1 2024-09-11T23:25:29.994 INFO:teuthology.orchestra.run.smithi144.stdout:type = subvolume 2024-09-11T23:25:29.994 INFO:teuthology.orchestra.run.smithi144.stdout:path = /volumes/_nogroup/subvol79470 2024-09-11T23:25:29.994 INFO:teuthology.orchestra.run.smithi144.stdout:state = complete 2024-09-11T23:25:29.994 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:29.998 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol3511 subvol_grp40900 2024-09-11T23:25:30.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.161+0000 7fe96da00640 1 Processor -- start 2024-09-11T23:25:30.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.161+0000 7fe96da00640 1 -- start start 2024-09-11T23:25:30.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.163+0000 7fe96da00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fe968145d90 0x7fe9680ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:30.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.163+0000 7fe96da00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9680cfce0 0x7fe96806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.163+0000 7fe96da00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9680b4240 con 0x7fe9680cd490 2024-09-11T23:25:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.163+0000 7fe96da00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fe96806d080 con 0x7fe968145d90 2024-09-11T23:25:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.163+0000 7fe96da00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe9680b4520 con 0x7fe9680cfce0 2024-09-11T23:25:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.163+0000 7fe966000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe9680cd490 0x7fe9680cf5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:51848/0 (socket says 172.21.15.144:51848) 2024-09-11T23:25:30.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.163+0000 7fe966000640 1 -- 172.21.15.144:0/3483429745 learned_addr learned my addr 172.21.15.144:0/3483429745 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.163+0000 7fe966a00640 1 --2- 172.21.15.144:0/3483429745 >> v2:172.21.15.165:3300/0 conn(0x7fe968145d90 0x7fe9680ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.163+0000 7fe967400640 1 --2- 172.21.15.144:0/3483429745 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9680cfce0 0x7fe96806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.163+0000 7fe965600640 1 -- 172.21.15.144:0/3483429745 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 726895917 0 0) 0x7fe9680b4240 con 0x7fe9680cd490 2024-09-11T23:25:30.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.163+0000 7fe965600640 1 -- 172.21.15.144:0/3483429745 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe94c003520 con 0x7fe9680cd490 2024-09-11T23:25:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.164+0000 7fe965600640 1 -- 172.21.15.144:0/3483429745 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2832351720 0 0) 0x7fe94c003520 con 0x7fe9680cd490 2024-09-11T23:25:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.164+0000 7fe967400640 1 -- 172.21.15.144:0/3483429745 >> v2:172.21.15.165:3300/0 conn(0x7fe968145d90 msgr2=0x7fe9680ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.164+0000 7fe967400640 1 --2- 172.21.15.144:0/3483429745 >> v2:172.21.15.165:3300/0 conn(0x7fe968145d90 0x7fe9680ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.164+0000 7fe967400640 1 -- 172.21.15.144:0/3483429745 >> v1:172.21.15.144:6789/0 conn(0x7fe9680cd490 legacy=0x7fe9680cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.164+0000 7fe967400640 1 -- 172.21.15.144:0/3483429745 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9680b4800 con 0x7fe9680cfce0 2024-09-11T23:25:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.164+0000 7fe966a00640 1 --2- 172.21.15.144:0/3483429745 >> v2:172.21.15.165:3300/0 conn(0x7fe968145d90 0x7fe9680ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:25:30.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.165+0000 7fe967400640 1 --2- 172.21.15.144:0/3483429745 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9680cfce0 0x7fe96806d4f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe960009d90 tx=0x7fe96002a550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cb1d2422a00e8f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.165+0000 7fe965600640 1 -- 172.21.15.144:0/3483429745 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954001670 con 0x7fe9680cfce0 2024-09-11T23:25:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.165+0000 7fe965600640 1 -- 172.21.15.144:0/3483429745 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe960007540 con 0x7fe9680cfce0 2024-09-11T23:25:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.165+0000 7fe965600640 1 -- 172.21.15.144:0/3483429745 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9600078f0 con 0x7fe9680cfce0 2024-09-11T23:25:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.166+0000 7fe96da00640 1 -- 172.21.15.144:0/3483429745 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9680cfce0 msgr2=0x7fe96806d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:30.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.166+0000 7fe96da00640 1 --2- 172.21.15.144:0/3483429745 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9680cfce0 0x7fe96806d4f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe960009d90 tx=0x7fe96002a550 comp rx=0 tx=0).stop 2024-09-11T23:25:30.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.166+0000 7fe96da00640 1 -- 172.21.15.144:0/3483429745 shutdown_connections 2024-09-11T23:25:30.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.166+0000 7fe96da00640 1 --2- 172.21.15.144:0/3483429745 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe9680cfce0 0x7fe96806d4f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:30.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.166+0000 7fe96da00640 1 --2- 172.21.15.144:0/3483429745 >> v2:172.21.15.165:3300/0 conn(0x7fe968145d90 0x7fe9680ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:30.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.166+0000 7fe96da00640 1 -- 172.21.15.144:0/3483429745 >> 172.21.15.144:0/3483429745 conn(0x7fe96806bba0 msgr2=0x7fe96806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:30.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.166+0000 7fe96da00640 1 -- 172.21.15.144:0/3483429745 shutdown_connections 2024-09-11T23:25:30.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.166+0000 7fe96da00640 1 -- 172.21.15.144:0/3483429745 wait complete. 2024-09-11T23:25:30.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.168+0000 7fe96da00640 1 Processor -- start 2024-09-11T23:25:30.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.168+0000 7fe96da00640 1 -- start start 2024-09-11T23:25:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.169+0000 7fe96da00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9680cd490 0x7fe9681f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:30.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.169+0000 7fe96da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9680cfce0 0x7fe9680adc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.169+0000 7fe96da00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe968145d90 0x7fe9680ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.169+0000 7fe96da00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe9680b5790 con 0x7fe9680cfce0 2024-09-11T23:25:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.169+0000 7fe96da00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe9680b5610 con 0x7fe9680cd490 2024-09-11T23:25:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.169+0000 7fe96da00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe968146170 con 0x7fe968145d90 2024-09-11T23:25:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.169+0000 7fe966000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9680cfce0 0x7fe9680adc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.169+0000 7fe966000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9680cfce0 0x7fe9680adc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34626/0 (socket says 172.21.15.144:34626) 2024-09-11T23:25:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.169+0000 7fe966000640 1 -- 172.21.15.144:0/1176115532 learned_addr learned my addr 172.21.15.144:0/1176115532 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.169+0000 7fe967400640 1 --2- 172.21.15.144:0/1176115532 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe968145d90 0x7fe9680ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.169+0000 7fe966a00640 1 --2- 172.21.15.144:0/1176115532 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9680cd490 0x7fe9681f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.169+0000 7fe966000640 1 -- 172.21.15.144:0/1176115532 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe968145d90 msgr2=0x7fe9680ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.169+0000 7fe966000640 1 --2- 172.21.15.144:0/1176115532 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe968145d90 0x7fe9680ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.169+0000 7fe966000640 1 -- 172.21.15.144:0/1176115532 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9680cd490 msgr2=0x7fe9681f3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:30.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.169+0000 7fe966000640 1 --2- 172.21.15.144:0/1176115532 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9680cd490 0x7fe9681f3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:30.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.169+0000 7fe966000640 1 -- 172.21.15.144:0/1176115532 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9680ace50 con 0x7fe9680cfce0 2024-09-11T23:25:30.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.169+0000 7fe966a00640 1 --2- 172.21.15.144:0/1176115532 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9680cd490 0x7fe9681f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:30.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.169+0000 7fe967400640 1 --2- 172.21.15.144:0/1176115532 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe968145d90 0x7fe9680ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:30.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.170+0000 7fe966000640 1 --2- 172.21.15.144:0/1176115532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9680cfce0 0x7fe9680adc10 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fe95400c700 tx=0x7fe95400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:30.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.170+0000 7fe95ea00640 1 -- 172.21.15.144:0/1176115532 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954017070 con 0x7fe9680cfce0 2024-09-11T23:25:30.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.170+0000 7fe95ea00640 1 -- 172.21.15.144:0/1176115532 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe954005ad0 con 0x7fe9680cfce0 2024-09-11T23:25:30.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.170+0000 7fe95ea00640 1 -- 172.21.15.144:0/1176115532 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954007070 con 0x7fe9680cfce0 2024-09-11T23:25:30.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.170+0000 7fe96da00640 1 -- 172.21.15.144:0/1176115532 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9680ad130 con 0x7fe9680cfce0 2024-09-11T23:25:30.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.170+0000 7fe96da00640 1 -- 172.21.15.144:0/1176115532 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9680ad6f0 con 0x7fe9680cfce0 2024-09-11T23:25:30.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.171+0000 7fe96da00640 1 -- 172.21.15.144:0/1176115532 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9680ad8f0 con 0x7fe9680cfce0 2024-09-11T23:25:30.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.172+0000 7fe95ea00640 1 -- 172.21.15.144:0/1176115532 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 91110+0+0 (secure 0 0 0) 0x7fe95401a070 con 0x7fe9680cfce0 2024-09-11T23:25:30.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.173+0000 7fe95ea00640 1 --2- 172.21.15.144:0/1176115532 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe94806c4f0 0x7fe94806e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:30.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.173+0000 7fe95ea00640 1 -- 172.21.15.144:0/1176115532 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fe95408ae80 con 0x7fe9680cfce0 2024-09-11T23:25:30.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.173+0000 7fe966a00640 1 --2- 172.21.15.144:0/1176115532 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe94806c4f0 0x7fe94806e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:30.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.174+0000 7fe966a00640 1 --2- 172.21.15.144:0/1176115532 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe94806c4f0 0x7fe94806e9b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe958009ac0 tx=0x7fe958008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:30.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.177+0000 7fe95ea00640 1 -- 172.21.15.144:0/1176115532 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe9680ad8f0 con 0x7fe9680cfce0 2024-09-11T23:25:30.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.375+0000 7fe96da00640 1 -- 172.21.15.144:0/1176115532 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol3511", "group_name": "subvol_grp40900", "target": ["mon-mgr", ""]}) -- 0x7fe9680ae6f0 con 0x7fe94806c4f0 2024-09-11T23:25:30.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.380+0000 7fe95ea00640 1 -- 172.21.15.144:0/1176115532 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fe958010910 con 0x7fe94806c4f0 2024-09-11T23:25:30.380 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/subvol_grp40900/subvol3511 2024-09-11T23:25:30.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.383+0000 7fe96da00640 1 -- 172.21.15.144:0/1176115532 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe94806c4f0 msgr2=0x7fe94806e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:30.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.383+0000 7fe96da00640 1 --2- 172.21.15.144:0/1176115532 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe94806c4f0 0x7fe94806e9b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe958009ac0 tx=0x7fe958008040 comp rx=0 tx=0).stop 2024-09-11T23:25:30.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.383+0000 7fe96da00640 1 -- 172.21.15.144:0/1176115532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9680cfce0 msgr2=0x7fe9680adc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:30.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.383+0000 7fe96da00640 1 --2- 172.21.15.144:0/1176115532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9680cfce0 0x7fe9680adc10 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fe95400c700 tx=0x7fe95400cbc0 comp rx=0 tx=0).stop 2024-09-11T23:25:30.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.383+0000 7fe96da00640 1 -- 172.21.15.144:0/1176115532 shutdown_connections 2024-09-11T23:25:30.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.383+0000 7fe96da00640 1 --2- 172.21.15.144:0/1176115532 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe94806c4f0 0x7fe94806e9b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:30.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.383+0000 7fe96da00640 1 --2- 172.21.15.144:0/1176115532 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe968145d90 0x7fe9680ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:30.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.383+0000 7fe96da00640 1 --2- 172.21.15.144:0/1176115532 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9680cfce0 0x7fe9680adc10 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:30.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.383+0000 7fe96da00640 1 --2- 172.21.15.144:0/1176115532 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe9680cd490 0x7fe9681f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:30.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.383+0000 7fe96da00640 1 -- 172.21.15.144:0/1176115532 >> 172.21.15.144:0/1176115532 conn(0x7fe96806bba0 msgr2=0x7fe96815e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:30.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.383+0000 7fe96da00640 1 -- 172.21.15.144:0/1176115532 shutdown_connections 2024-09-11T23:25:30.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:30.383+0000 7fe96da00640 1 -- 172.21.15.144:0/1176115532 wait complete. 2024-09-11T23:25:30.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:30.399 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/3f8fdf59b6b9616898b75a0c37835da3.meta) 2024-09-11T23:25:34.993 INFO:teuthology.orchestra.run.smithi144.stdout:[GLOBAL] 2024-09-11T23:25:34.993 INFO:teuthology.orchestra.run.smithi144.stdout:version = 1 2024-09-11T23:25:34.994 INFO:teuthology.orchestra.run.smithi144.stdout:type = subvolume 2024-09-11T23:25:34.994 INFO:teuthology.orchestra.run.smithi144.stdout:path = /volumes/subvol_grp40900/subvol3511 2024-09-11T23:25:34.994 INFO:teuthology.orchestra.run.smithi144.stdout:state = complete 2024-09-11T23:25:34.994 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:34.996 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol79470 2024-09-11T23:25:35.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.162+0000 7f09ad000640 1 Processor -- start 2024-09-11T23:25:35.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.162+0000 7f09ad000640 1 -- start start 2024-09-11T23:25:35.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.163+0000 7f09ad000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f09a815e6c0 0x7f09a806c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:35.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.163+0000 7f09ad000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f09a80cf510 0x7f09a80b7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:35.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.163+0000 7f09ad000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09a80b7bb0 0x7f09a806d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:35.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.163+0000 7f09ad000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f09a80d34d0 con 0x7f09a80cf510 2024-09-11T23:25:35.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.163+0000 7f09ad000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f09a815eaa0 con 0x7f09a815e6c0 2024-09-11T23:25:35.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.163+0000 7f09ad000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f09a806cdf0 con 0x7f09a80b7bb0 2024-09-11T23:25:35.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.163+0000 7f09a6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f09a80cf510 0x7f09a80b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:35.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.163+0000 7f09a6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f09a80cf510 0x7f09a80b7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53914/0 (socket says 172.21.15.144:53914) 2024-09-11T23:25:35.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.163+0000 7f09a6a00640 1 -- 172.21.15.144:0/1658182528 learned_addr learned my addr 172.21.15.144:0/1658182528 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:35.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.164+0000 7f09a6a00640 1 -- 172.21.15.144:0/1658182528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09a80b7bb0 msgr2=0x7f09a806d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:35.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.164+0000 7f09a7400640 1 --2- 172.21.15.144:0/1658182528 >> v2:172.21.15.165:3300/0 conn(0x7f09a815e6c0 0x7f09a806c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:35.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.164+0000 7f09a7e00640 1 --2- 172.21.15.144:0/1658182528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09a80b7bb0 0x7f09a806d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:35.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.164+0000 7f09a6a00640 1 --2- 172.21.15.144:0/1658182528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09a80b7bb0 0x7f09a806d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.164+0000 7f09a6a00640 1 -- 172.21.15.144:0/1658182528 >> v2:172.21.15.165:3300/0 conn(0x7f09a815e6c0 msgr2=0x7f09a806c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:35.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.164+0000 7f09a6a00640 1 --2- 172.21.15.144:0/1658182528 >> v2:172.21.15.165:3300/0 conn(0x7f09a815e6c0 0x7f09a806c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.164+0000 7f09a6a00640 1 -- 172.21.15.144:0/1658182528 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a80d28c0 con 0x7f09a80cf510 2024-09-11T23:25:35.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.164+0000 7f09a7400640 1 --2- 172.21.15.144:0/1658182528 >> v2:172.21.15.165:3300/0 conn(0x7f09a815e6c0 0x7f09a806c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:35.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.164+0000 7f09a7e00640 1 --2- 172.21.15.144:0/1658182528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09a80b7bb0 0x7f09a806d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:35.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.165+0000 7f09a6a00640 1 --2- 172.21.15.144:0/1658182528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09a80cf510 0x7f09a80b7670 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f09a8069df0 tx=0x7f099402a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5d50ef91680d74 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:35.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.165+0000 7f09a6000640 1 -- 172.21.15.144:0/1658182528 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994037070 con 0x7f09a80cf510 2024-09-11T23:25:35.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.165+0000 7f09a6000640 1 -- 172.21.15.144:0/1658182528 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0994032440 con 0x7f09a80cf510 2024-09-11T23:25:35.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.165+0000 7f09a6000640 1 -- 172.21.15.144:0/1658182528 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994032810 con 0x7f09a80cf510 2024-09-11T23:25:35.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.165+0000 7f09ad000640 1 -- 172.21.15.144:0/1658182528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09a80cf510 msgr2=0x7f09a80b7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:35.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.165+0000 7f09ad000640 1 --2- 172.21.15.144:0/1658182528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09a80cf510 0x7f09a80b7670 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f09a8069df0 tx=0x7f099402a1d0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.166+0000 7f09ad000640 1 -- 172.21.15.144:0/1658182528 shutdown_connections 2024-09-11T23:25:35.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.166+0000 7f09ad000640 1 --2- 172.21.15.144:0/1658182528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09a80cf510 0x7f09a80b7670 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.166+0000 7f09ad000640 1 --2- 172.21.15.144:0/1658182528 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09a80b7bb0 0x7f09a806d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.166+0000 7f09ad000640 1 --2- 172.21.15.144:0/1658182528 >> v2:172.21.15.165:3300/0 conn(0x7f09a815e6c0 0x7f09a806c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.166+0000 7f09ad000640 1 -- 172.21.15.144:0/1658182528 >> 172.21.15.144:0/1658182528 conn(0x7f09a80d4720 msgr2=0x7f09a80d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:35.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.166+0000 7f09ad000640 1 -- 172.21.15.144:0/1658182528 shutdown_connections 2024-09-11T23:25:35.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.166+0000 7f09ad000640 1 -- 172.21.15.144:0/1658182528 wait complete. 2024-09-11T23:25:35.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.167+0000 7f09ad000640 1 Processor -- start 2024-09-11T23:25:35.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.168+0000 7f09ad000640 1 -- start start 2024-09-11T23:25:35.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.168+0000 7f09ad000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09a80b7bb0 0x7f09a81582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:35.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.168+0000 7f09ad000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09a80cf510 0x7f09a8158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:35.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.168+0000 7f09ad000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09a815e6c0 0x7f09a815ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:35.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.168+0000 7f09ad000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f09a80d3160 con 0x7f09a80cf510 2024-09-11T23:25:35.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.168+0000 7f09ad000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f09a80d2e80 con 0x7f09a815e6c0 2024-09-11T23:25:35.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.168+0000 7f09ad000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f09a806db50 con 0x7f09a80b7bb0 2024-09-11T23:25:35.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.169+0000 7f09a6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09a80cf510 0x7f09a8158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.169+0000 7f09a6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09a80cf510 0x7f09a8158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53922/0 (socket says 172.21.15.144:53922) 2024-09-11T23:25:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.169+0000 7f09a6a00640 1 -- 172.21.15.144:0/1228380808 learned_addr learned my addr 172.21.15.144:0/1228380808 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.169+0000 7f09a7e00640 1 --2- 172.21.15.144:0/1228380808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09a815e6c0 0x7f09a815ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.169+0000 7f09a7400640 1 --2- 172.21.15.144:0/1228380808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09a80b7bb0 0x7f09a81582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.169+0000 7f09a6a00640 1 -- 172.21.15.144:0/1228380808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09a80b7bb0 msgr2=0x7f09a81582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.169+0000 7f09a6a00640 1 --2- 172.21.15.144:0/1228380808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09a80b7bb0 0x7f09a81582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.169+0000 7f09a6a00640 1 -- 172.21.15.144:0/1228380808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09a815e6c0 msgr2=0x7f09a815ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.169+0000 7f09a6a00640 1 --2- 172.21.15.144:0/1228380808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09a815e6c0 0x7f09a815ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.169+0000 7f09a6a00640 1 -- 172.21.15.144:0/1228380808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a8158e50 con 0x7f09a80cf510 2024-09-11T23:25:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.169+0000 7f09a6a00640 1 --2- 172.21.15.144:0/1228380808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09a80cf510 0x7f09a8158810 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f099402a210 tx=0x7f09940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.170+0000 7f099f400640 1 -- 172.21.15.144:0/1228380808 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994037040 con 0x7f09a80cf510 2024-09-11T23:25:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.170+0000 7f099f400640 1 -- 172.21.15.144:0/1228380808 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0994042070 con 0x7f09a80cf510 2024-09-11T23:25:35.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.170+0000 7f09ad000640 1 -- 172.21.15.144:0/1228380808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a8159130 con 0x7f09a80cf510 2024-09-11T23:25:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.170+0000 7f099f400640 1 -- 172.21.15.144:0/1228380808 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0994030bb0 con 0x7f09a80cf510 2024-09-11T23:25:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.170+0000 7f09ad000640 1 -- 172.21.15.144:0/1228380808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a81596f0 con 0x7f09a80cf510 2024-09-11T23:25:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.171+0000 7f09ad000640 1 -- 172.21.15.144:0/1228380808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09a8160930 con 0x7f09a80cf510 2024-09-11T23:25:35.172 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.172+0000 7f099f400640 1 -- 172.21.15.144:0/1228380808 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 91110+0+0 (secure 0 0 0) 0x7f0994047460 con 0x7f09a80cf510 2024-09-11T23:25:35.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.173+0000 7f099f400640 1 --2- 172.21.15.144:0/1228380808 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f098806c4f0 0x7f098806e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:35.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.173+0000 7f099f400640 1 -- 172.21.15.144:0/1228380808 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f09940ac580 con 0x7f09a80cf510 2024-09-11T23:25:35.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.173+0000 7f09a7400640 1 --2- 172.21.15.144:0/1228380808 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f098806c4f0 0x7f098806e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:35.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.174+0000 7f09a7400640 1 --2- 172.21.15.144:0/1228380808 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f098806c4f0 0x7f098806e9b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f099800a950 tx=0x7f0998008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:35.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.177+0000 7f099f400640 1 -- 172.21.15.144:0/1228380808 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0994045360 con 0x7f09a80cf510 2024-09-11T23:25:35.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.376+0000 7f09ad000640 1 -- 172.21.15.144:0/1228380808 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol79470", "target": ["mon-mgr", ""]}) -- 0x7f09a815ddd0 con 0x7f098806c4f0 2024-09-11T23:25:35.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.412+0000 7f099f400640 1 -- 172.21.15.144:0/1228380808 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f09a815ddd0 con 0x7f098806c4f0 2024-09-11T23:25:35.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.415+0000 7f09ad000640 1 -- 172.21.15.144:0/1228380808 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f098806c4f0 msgr2=0x7f098806e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:35.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.415+0000 7f09ad000640 1 --2- 172.21.15.144:0/1228380808 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f098806c4f0 0x7f098806e9b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f099800a950 tx=0x7f0998008040 comp rx=0 tx=0).stop 2024-09-11T23:25:35.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.415+0000 7f09ad000640 1 -- 172.21.15.144:0/1228380808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09a80cf510 msgr2=0x7f09a8158810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:35.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.415+0000 7f09ad000640 1 --2- 172.21.15.144:0/1228380808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09a80cf510 0x7f09a8158810 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f099402a210 tx=0x7f09940046c0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.415+0000 7f09ad000640 1 -- 172.21.15.144:0/1228380808 shutdown_connections 2024-09-11T23:25:35.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.415+0000 7f09ad000640 1 --2- 172.21.15.144:0/1228380808 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f098806c4f0 0x7f098806e9b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.415+0000 7f09ad000640 1 --2- 172.21.15.144:0/1228380808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09a815e6c0 0x7f09a815ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.415+0000 7f09ad000640 1 --2- 172.21.15.144:0/1228380808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09a80cf510 0x7f09a8158810 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.415+0000 7f09ad000640 1 --2- 172.21.15.144:0/1228380808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f09a80b7bb0 0x7f09a81582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.415+0000 7f09ad000640 1 -- 172.21.15.144:0/1228380808 >> 172.21.15.144:0/1228380808 conn(0x7f09a80d4720 msgr2=0x7f09a80d3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:35.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.415+0000 7f09ad000640 1 -- 172.21.15.144:0/1228380808 shutdown_connections 2024-09-11T23:25:35.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.415+0000 7f09ad000640 1 -- 172.21.15.144:0/1228380808 wait complete. 2024-09-11T23:25:35.421 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:25:35.420+0000 7f30e0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:25:35.421 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:25:35.420+0000 7f30e0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:25:35.421 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:25:35.420+0000 7f30e0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:25:35.421 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:25:35.420+0000 7f30e0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:25:35.421 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:25:35.420+0000 7f30e0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:25:35.432 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol3511 subvol_grp40900 2024-09-11T23:25:35.438 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:25:35.438+0000 7f30e0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:25:35.438 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:25:35.438+0000 7f30e0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:25:35.438 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:25:35.438+0000 7f30e0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:25:35.438 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:25:35.438+0000 7f30e0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:25:35.438 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:25:35.438+0000 7f30e0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:25:35.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.596+0000 7fcfcda00640 1 Processor -- start 2024-09-11T23:25:35.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.596+0000 7fcfcda00640 1 -- start start 2024-09-11T23:25:35.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.597+0000 7fcfcda00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcfc8145d90 0x7fcfc80ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:35.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.598+0000 7fcfcda00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc80b4240 con 0x7fcfc80cd490 2024-09-11T23:25:35.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.598+0000 7fcfcda00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc80b4520 con 0x7fcfc80cfce0 2024-09-11T23:25:35.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.598+0000 7fcfcda00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fcfc806d080 con 0x7fcfc8145d90 2024-09-11T23:25:35.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.598+0000 7fcfc6a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcfc8145d90 0x7fcfc80ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:35.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.598+0000 7fcfc6000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fcfc80cd490 0x7fcfc80cf5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55890/0 (socket says 172.21.15.144:55890) 2024-09-11T23:25:35.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.598+0000 7fcfc6000640 1 -- 172.21.15.144:0/404747193 learned_addr learned my addr 172.21.15.144:0/404747193 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:35.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.598+0000 7fcfc6a00640 1 -- 172.21.15.144:0/404747193 >> v1:172.21.15.165:6789/0 conn(0x7fcfc80cfce0 legacy=0x7fcfc806d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:35.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.598+0000 7fcfc6a00640 1 -- 172.21.15.144:0/404747193 >> v1:172.21.15.144:6789/0 conn(0x7fcfc80cd490 legacy=0x7fcfc80cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:35.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.598+0000 7fcfc6a00640 1 -- 172.21.15.144:0/404747193 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc80b4800 con 0x7fcfc8145d90 2024-09-11T23:25:35.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.598+0000 7fcfc5600640 1 -- 172.21.15.144:0/404747193 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 85966457 0 0) 0x7fcfc80b4240 con 0x7fcfc80cd490 2024-09-11T23:25:35.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.599+0000 7fcfc6a00640 1 --2- 172.21.15.144:0/404747193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfc8145d90 0x7fcfc80ccf50 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80097a0 tx=0x7fcfb802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18d92f14520d1a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:35.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.599+0000 7fcfc5600640 1 -- 172.21.15.144:0/404747193 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8037070 con 0x7fcfc8145d90 2024-09-11T23:25:35.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.600+0000 7fcfc5600640 1 -- 172.21.15.144:0/404747193 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb8032440 con 0x7fcfc8145d90 2024-09-11T23:25:35.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.600+0000 7fcfc5600640 1 -- 172.21.15.144:0/404747193 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8032810 con 0x7fcfc8145d90 2024-09-11T23:25:35.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.600+0000 7fcfcda00640 1 -- 172.21.15.144:0/404747193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfc8145d90 msgr2=0x7fcfc80ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:35.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.600+0000 7fcfcda00640 1 --2- 172.21.15.144:0/404747193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfc8145d90 0x7fcfc80ccf50 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80097a0 tx=0x7fcfb802a230 comp rx=0 tx=0).stop 2024-09-11T23:25:35.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.600+0000 7fcfcda00640 1 -- 172.21.15.144:0/404747193 shutdown_connections 2024-09-11T23:25:35.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.600+0000 7fcfcda00640 1 --2- 172.21.15.144:0/404747193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfc8145d90 0x7fcfc80ccf50 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.600+0000 7fcfcda00640 1 -- 172.21.15.144:0/404747193 >> 172.21.15.144:0/404747193 conn(0x7fcfc806bba0 msgr2=0x7fcfc806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:35.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.600+0000 7fcfcda00640 1 -- 172.21.15.144:0/404747193 shutdown_connections 2024-09-11T23:25:35.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.600+0000 7fcfcda00640 1 -- 172.21.15.144:0/404747193 wait complete. 2024-09-11T23:25:35.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.602+0000 7fcfcda00640 1 Processor -- start 2024-09-11T23:25:35.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.602+0000 7fcfcda00640 1 -- start start 2024-09-11T23:25:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.603+0000 7fcfcda00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfc80cd490 0x7fcfc8136b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.603+0000 7fcfcda00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfc80cfce0 0x7fcfc8072440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.603+0000 7fcfcda00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfc8145d90 0x7fcfc80ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.603+0000 7fcfcda00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc80b5790 con 0x7fcfc8145d90 2024-09-11T23:25:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.603+0000 7fcfcda00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc80b5610 con 0x7fcfc80cd490 2024-09-11T23:25:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.603+0000 7fcfcda00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc8146170 con 0x7fcfc80cfce0 2024-09-11T23:25:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.603+0000 7fcfc7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfc8145d90 0x7fcfc80ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.603+0000 7fcfc7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfc8145d90 0x7fcfc80ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53942/0 (socket says 172.21.15.144:53942) 2024-09-11T23:25:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.603+0000 7fcfc7400640 1 -- 172.21.15.144:0/1375824836 learned_addr learned my addr 172.21.15.144:0/1375824836 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:35.604 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.603+0000 7fcfc7400640 1 -- 172.21.15.144:0/1375824836 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfc80cfce0 msgr2=0x7fcfc8072440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.603+0000 7fcfc7400640 1 --2- 172.21.15.144:0/1375824836 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfc80cfce0 0x7fcfc8072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.603+0000 7fcfc7400640 1 -- 172.21.15.144:0/1375824836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfc80cd490 msgr2=0x7fcfc8136b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.603+0000 7fcfc6a00640 1 --2- 172.21.15.144:0/1375824836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfc80cd490 0x7fcfc8136b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.603+0000 7fcfc7400640 1 --2- 172.21.15.144:0/1375824836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfc80cd490 0x7fcfc8136b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.603+0000 7fcfc7400640 1 -- 172.21.15.144:0/1375824836 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc8072ec0 con 0x7fcfc8145d90 2024-09-11T23:25:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.604+0000 7fcfc7400640 1 --2- 172.21.15.144:0/1375824836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfc8145d90 0x7fcfc80ae8e0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000c730 tx=0x7fcfc000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.604+0000 7fcfbea00640 1 -- 172.21.15.144:0/1375824836 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0003b70 con 0x7fcfc8145d90 2024-09-11T23:25:35.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.604+0000 7fcfbea00640 1 -- 172.21.15.144:0/1375824836 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc0003d30 con 0x7fcfc8145d90 2024-09-11T23:25:35.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.604+0000 7fcfbea00640 1 -- 172.21.15.144:0/1375824836 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0005310 con 0x7fcfc8145d90 2024-09-11T23:25:35.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.604+0000 7fcfcda00640 1 -- 172.21.15.144:0/1375824836 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc813f540 con 0x7fcfc8145d90 2024-09-11T23:25:35.608 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.604+0000 7fcfcda00640 1 -- 172.21.15.144:0/1375824836 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc813fb00 con 0x7fcfc8145d90 2024-09-11T23:25:35.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.605+0000 7fcfcda00640 1 -- 172.21.15.144:0/1375824836 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfc80ccf50 con 0x7fcfc8145d90 2024-09-11T23:25:35.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.606+0000 7fcfbea00640 1 -- 172.21.15.144:0/1375824836 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 91110+0+0 (secure 0 0 0) 0x7fcfc00056c0 con 0x7fcfc8145d90 2024-09-11T23:25:35.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.607+0000 7fcfbea00640 1 --2- 172.21.15.144:0/1375824836 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcfa806c4f0 0x7fcfa806e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:35.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.607+0000 7fcfbea00640 1 -- 172.21.15.144:0/1375824836 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fcfc008ba70 con 0x7fcfc8145d90 2024-09-11T23:25:35.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.607+0000 7fcfc6a00640 1 --2- 172.21.15.144:0/1375824836 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcfa806c4f0 0x7fcfa806e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:35.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.608+0000 7fcfc6a00640 1 --2- 172.21.15.144:0/1375824836 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcfa806c4f0 0x7fcfa806e9b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8034000 tx=0x7fcfb802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:35.611 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.611+0000 7fcfbea00640 1 -- 172.21.15.144:0/1375824836 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcfc0059b50 con 0x7fcfc8145d90 2024-09-11T23:25:35.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.793+0000 7fcfbea00640 1 -- 172.21.15.144:0/1375824836 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7fcfc0055ac0 con 0x7fcfc8145d90 2024-09-11T23:25:35.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.813+0000 7fcfcda00640 1 -- 172.21.15.144:0/1375824836 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol3511", "group_name": "subvol_grp40900", "target": ["mon-mgr", ""]}) -- 0x7fcfc813ff90 con 0x7fcfa806c4f0 2024-09-11T23:25:35.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.841+0000 7fcfbea00640 1 -- 172.21.15.144:0/1375824836 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcfc813ff90 con 0x7fcfa806c4f0 2024-09-11T23:25:35.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.843+0000 7fcfcda00640 1 -- 172.21.15.144:0/1375824836 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcfa806c4f0 msgr2=0x7fcfa806e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:35.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.843+0000 7fcfcda00640 1 --2- 172.21.15.144:0/1375824836 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcfa806c4f0 0x7fcfa806e9b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8034000 tx=0x7fcfb802e000 comp rx=0 tx=0).stop 2024-09-11T23:25:35.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.843+0000 7fcfcda00640 1 -- 172.21.15.144:0/1375824836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfc8145d90 msgr2=0x7fcfc80ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:35.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.844+0000 7fcfcda00640 1 --2- 172.21.15.144:0/1375824836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfc8145d90 0x7fcfc80ae8e0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000c730 tx=0x7fcfc000cbf0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.844+0000 7fcfcda00640 1 -- 172.21.15.144:0/1375824836 shutdown_connections 2024-09-11T23:25:35.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.844+0000 7fcfcda00640 1 --2- 172.21.15.144:0/1375824836 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcfa806c4f0 0x7fcfa806e9b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.844+0000 7fcfcda00640 1 --2- 172.21.15.144:0/1375824836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfc8145d90 0x7fcfc80ae8e0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.844+0000 7fcfcda00640 1 --2- 172.21.15.144:0/1375824836 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfc80cfce0 0x7fcfc8072440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.844+0000 7fcfcda00640 1 --2- 172.21.15.144:0/1375824836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfc80cd490 0x7fcfc8136b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:35.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.844+0000 7fcfcda00640 1 -- 172.21.15.144:0/1375824836 >> 172.21.15.144:0/1375824836 conn(0x7fcfc806bba0 msgr2=0x7fcfc80cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:35.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.844+0000 7fcfcda00640 1 -- 172.21.15.144:0/1375824836 shutdown_connections 2024-09-11T23:25:35.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35.844+0000 7fcfcda00640 1 -- 172.21.15.144:0/1375824836 wait complete. 2024-09-11T23:25:35.860 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-11T23:25:35.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:25:35.945 INFO:teuthology.orchestra.run.smithi144.stdout:2 2024-09-11T23:25:35.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:25:35.954 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp40900 2024-09-11T23:25:36.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.110+0000 7fd53ec00640 1 Processor -- start 2024-09-11T23:25:36.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.110+0000 7fd53ec00640 1 -- start start 2024-09-11T23:25:36.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.111+0000 7fd53ec00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd53815bb80 0x7fd5380b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:36.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.111+0000 7fd53ec00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd538071de0 con 0x7fd53806ea00 2024-09-11T23:25:36.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.111+0000 7fd53ec00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5380720c0 con 0x7fd53815b090 2024-09-11T23:25:36.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.111+0000 7fd53ec00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd5380723a0 con 0x7fd53815bb80 2024-09-11T23:25:36.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.112+0000 7fd52f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd53806ea00 0x7fd53815b470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55894/0 (socket says 172.21.15.144:55894) 2024-09-11T23:25:36.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.112+0000 7fd52f400640 1 -- 172.21.15.144:0/1400536833 learned_addr learned my addr 172.21.15.144:0/1400536833 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:36.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.112+0000 7fd53cc00640 1 --2- 172.21.15.144:0/1400536833 >> v2:172.21.15.144:3300/0 conn(0x7fd53815bb80 0x7fd5380b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:36.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.112+0000 7fd537400640 1 -- 172.21.15.144:0/1400536833 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 968155796 0 0) 0x7fd538071de0 con 0x7fd53806ea00 2024-09-11T23:25:36.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.112+0000 7fd537400640 1 -- 172.21.15.144:0/1400536833 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd51c003520 con 0x7fd53806ea00 2024-09-11T23:25:36.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.112+0000 7fd537400640 1 -- 172.21.15.144:0/1400536833 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1289746029 0 0) 0x7fd5380720c0 con 0x7fd53815b090 2024-09-11T23:25:36.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.112+0000 7fd53cc00640 1 -- 172.21.15.144:0/1400536833 >> v1:172.21.15.165:6789/0 conn(0x7fd53815b090 legacy=0x7fd5380715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:36.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.112+0000 7fd53cc00640 1 -- 172.21.15.144:0/1400536833 >> v1:172.21.15.144:6789/0 conn(0x7fd53806ea00 legacy=0x7fd53815b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:36.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.112+0000 7fd53cc00640 1 -- 172.21.15.144:0/1400536833 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd538072680 con 0x7fd53815bb80 2024-09-11T23:25:36.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.113+0000 7fd53cc00640 1 --2- 172.21.15.144:0/1400536833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd53815bb80 0x7fd5380b5420 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fd530009d90 tx=0x7fd53002c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7548f57c3ce40ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:36.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.114+0000 7fd537400640 1 -- 172.21.15.144:0/1400536833 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd530036020 con 0x7fd53815bb80 2024-09-11T23:25:36.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.114+0000 7fd537400640 1 -- 172.21.15.144:0/1400536833 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd530032800 con 0x7fd53815bb80 2024-09-11T23:25:36.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.114+0000 7fd537400640 1 -- 172.21.15.144:0/1400536833 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd530032bb0 con 0x7fd53815bb80 2024-09-11T23:25:36.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.114+0000 7fd53ec00640 1 -- 172.21.15.144:0/1400536833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd53815bb80 msgr2=0x7fd5380b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:36.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.114+0000 7fd53ec00640 1 --2- 172.21.15.144:0/1400536833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd53815bb80 0x7fd5380b5420 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fd530009d90 tx=0x7fd53002c900 comp rx=0 tx=0).stop 2024-09-11T23:25:36.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.114+0000 7fd53ec00640 1 -- 172.21.15.144:0/1400536833 shutdown_connections 2024-09-11T23:25:36.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.114+0000 7fd53ec00640 1 --2- 172.21.15.144:0/1400536833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd53815bb80 0x7fd5380b5420 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:36.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.114+0000 7fd53ec00640 1 -- 172.21.15.144:0/1400536833 >> 172.21.15.144:0/1400536833 conn(0x7fd53806bba0 msgr2=0x7fd53806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:36.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.114+0000 7fd53ec00640 1 -- 172.21.15.144:0/1400536833 shutdown_connections 2024-09-11T23:25:36.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.114+0000 7fd53ec00640 1 -- 172.21.15.144:0/1400536833 wait complete. 2024-09-11T23:25:36.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.116+0000 7fd53ec00640 1 Processor -- start 2024-09-11T23:25:36.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.116+0000 7fd53ec00640 1 -- start start 2024-09-11T23:25:36.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.117+0000 7fd53ec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd53806ea00 0x7fd5381403e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:36.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.117+0000 7fd53ec00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd53815b090 0x7fd5381e3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:36.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.117+0000 7fd53ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd53815bb80 0x7fd5381547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:36.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.117+0000 7fd53ec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd53806d200 con 0x7fd53806ea00 2024-09-11T23:25:36.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.117+0000 7fd53ec00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd53806d080 con 0x7fd53815b090 2024-09-11T23:25:36.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.117+0000 7fd53ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd53806d380 con 0x7fd53815bb80 2024-09-11T23:25:36.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.117+0000 7fd537e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd53806ea00 0x7fd5381403e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:36.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.117+0000 7fd537e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd53806ea00 0x7fd5381403e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53954/0 (socket says 172.21.15.144:53954) 2024-09-11T23:25:36.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.117+0000 7fd537e00640 1 -- 172.21.15.144:0/2934540564 learned_addr learned my addr 172.21.15.144:0/2934540564 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:36.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.117+0000 7fd52f400640 1 --2- 172.21.15.144:0/2934540564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd53815b090 0x7fd5381e3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:36.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.117+0000 7fd53cc00640 1 --2- 172.21.15.144:0/2934540564 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd53815bb80 0x7fd5381547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:36.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.117+0000 7fd537e00640 1 -- 172.21.15.144:0/2934540564 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd53815bb80 msgr2=0x7fd5381547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:36.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.118+0000 7fd537e00640 1 --2- 172.21.15.144:0/2934540564 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd53815bb80 0x7fd5381547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:36.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.118+0000 7fd537e00640 1 -- 172.21.15.144:0/2934540564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd53815b090 msgr2=0x7fd5381e3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:36.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.118+0000 7fd537e00640 1 --2- 172.21.15.144:0/2934540564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd53815b090 0x7fd5381e3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:36.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.118+0000 7fd537e00640 1 -- 172.21.15.144:0/2934540564 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5381e43d0 con 0x7fd53806ea00 2024-09-11T23:25:36.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.118+0000 7fd53cc00640 1 --2- 172.21.15.144:0/2934540564 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd53815bb80 0x7fd5381547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:36.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.118+0000 7fd52f400640 1 --2- 172.21.15.144:0/2934540564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd53815b090 0x7fd5381e3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:36.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.118+0000 7fd537e00640 1 --2- 172.21.15.144:0/2934540564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd53806ea00 0x7fd5381403e0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fd52800c460 tx=0x7fd52800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:36.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.118+0000 7fd534c00640 1 -- 172.21.15.144:0/2934540564 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd528005480 con 0x7fd53806ea00 2024-09-11T23:25:36.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.118+0000 7fd534c00640 1 -- 172.21.15.144:0/2934540564 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5280035f0 con 0x7fd53806ea00 2024-09-11T23:25:36.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.118+0000 7fd534c00640 1 -- 172.21.15.144:0/2934540564 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd528003a00 con 0x7fd53806ea00 2024-09-11T23:25:36.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.118+0000 7fd53ec00640 1 -- 172.21.15.144:0/2934540564 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd538140c80 con 0x7fd53806ea00 2024-09-11T23:25:36.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.118+0000 7fd53ec00640 1 -- 172.21.15.144:0/2934540564 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd538141240 con 0x7fd53806ea00 2024-09-11T23:25:36.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.119+0000 7fd53ec00640 1 -- 172.21.15.144:0/2934540564 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5380b5420 con 0x7fd53806ea00 2024-09-11T23:25:36.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.120+0000 7fd534c00640 1 -- 172.21.15.144:0/2934540564 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7fd528003ba0 con 0x7fd53806ea00 2024-09-11T23:25:36.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.121+0000 7fd534c00640 1 --2- 172.21.15.144:0/2934540564 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd51406c7b0 0x7fd51406ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:36.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.121+0000 7fd534c00640 1 -- 172.21.15.144:0/2934540564 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fd52808be20 con 0x7fd53806ea00 2024-09-11T23:25:36.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.121+0000 7fd52f400640 1 --2- 172.21.15.144:0/2934540564 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd51406c7b0 0x7fd51406ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:36.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.122+0000 7fd52f400640 1 --2- 172.21.15.144:0/2934540564 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd51406c7b0 0x7fd51406ec70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd53806f200 tx=0x7fd520009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:36.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.125+0000 7fd534c00640 1 -- 172.21.15.144:0/2934540564 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd5280597b0 con 0x7fd53806ea00 2024-09-11T23:25:36.321 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.321+0000 7fd53ec00640 1 -- 172.21.15.144:0/2934540564 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp40900", "target": ["mon-mgr", ""]}) -- 0x7fd5380aef00 con 0x7fd51406c7b0 2024-09-11T23:25:36.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.338+0000 7fd534c00640 1 -- 172.21.15.144:0/2934540564 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd5380aef00 con 0x7fd51406c7b0 2024-09-11T23:25:36.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.341+0000 7fd53ec00640 1 -- 172.21.15.144:0/2934540564 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd51406c7b0 msgr2=0x7fd51406ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:36.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.341+0000 7fd53ec00640 1 --2- 172.21.15.144:0/2934540564 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd51406c7b0 0x7fd51406ec70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd53806f200 tx=0x7fd520009040 comp rx=0 tx=0).stop 2024-09-11T23:25:36.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.341+0000 7fd53ec00640 1 -- 172.21.15.144:0/2934540564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd53806ea00 msgr2=0x7fd5381403e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:36.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.341+0000 7fd53ec00640 1 --2- 172.21.15.144:0/2934540564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd53806ea00 0x7fd5381403e0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fd52800c460 tx=0x7fd52800c920 comp rx=0 tx=0).stop 2024-09-11T23:25:36.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.341+0000 7fd53ec00640 1 -- 172.21.15.144:0/2934540564 shutdown_connections 2024-09-11T23:25:36.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.341+0000 7fd53ec00640 1 --2- 172.21.15.144:0/2934540564 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd51406c7b0 0x7fd51406ec70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:36.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.341+0000 7fd53ec00640 1 --2- 172.21.15.144:0/2934540564 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd53815bb80 0x7fd5381547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:36.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.341+0000 7fd53ec00640 1 --2- 172.21.15.144:0/2934540564 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd53815b090 0x7fd5381e3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:36.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.341+0000 7fd53ec00640 1 --2- 172.21.15.144:0/2934540564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd53806ea00 0x7fd5381403e0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:36.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.341+0000 7fd53ec00640 1 -- 172.21.15.144:0/2934540564 >> 172.21.15.144:0/2934540564 conn(0x7fd53806bba0 msgr2=0x7fd5380b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:36.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.341+0000 7fd53ec00640 1 -- 172.21.15.144:0/2934540564 shutdown_connections 2024-09-11T23:25:36.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.341+0000 7fd53ec00640 1 -- 172.21.15.144:0/2934540564 wait complete. 2024-09-11T23:25:36.357 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:25:36.357 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:25:36.450 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:25:36.554 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:25:36.554 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:25:36.555 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:25:36.555 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:25:36.590 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:25:36.590 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:25:36.666 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:25:36.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.863+0000 7f1a29c00640 1 Processor -- start 2024-09-11T23:25:36.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.863+0000 7f1a29c00640 1 -- start start 2024-09-11T23:25:36.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.864+0000 7f1a29c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1a240b6c60 0x7f1a240b7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:36.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.864+0000 7f1a29c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a24071970 con 0x7f1a2415f570 2024-09-11T23:25:36.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.864+0000 7f1a29c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a240b7580 con 0x7f1a240d0370 2024-09-11T23:25:36.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.864+0000 7f1a29c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1a240d1d90 con 0x7f1a240b6c60 2024-09-11T23:25:36.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.864+0000 7f1a1b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1a2415f570 0x7f1a24071260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55904/0 (socket says 172.21.15.144:55904) 2024-09-11T23:25:36.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.864+0000 7f1a1b400640 1 -- 172.21.15.144:0/3122257848 learned_addr learned my addr 172.21.15.144:0/3122257848 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:36.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.864+0000 7f1a23e00640 1 --2- 172.21.15.144:0/3122257848 >> v2:172.21.15.165:3300/0 conn(0x7f1a240b6c60 0x7f1a240b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:36.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.865+0000 7f1a23e00640 1 -- 172.21.15.144:0/3122257848 >> v1:172.21.15.165:6789/0 conn(0x7f1a240d0370 legacy=0x7f1a240d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:36.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.865+0000 7f1a23e00640 1 -- 172.21.15.144:0/3122257848 >> v1:172.21.15.144:6789/0 conn(0x7f1a2415f570 legacy=0x7f1a24071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:36.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.865+0000 7f1a23400640 1 -- 172.21.15.144:0/3122257848 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 605397679 0 0) 0x7f1a24071970 con 0x7f1a2415f570 2024-09-11T23:25:36.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.865+0000 7f1a23e00640 1 -- 172.21.15.144:0/3122257848 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a240d2070 con 0x7f1a240b6c60 2024-09-11T23:25:36.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.866+0000 7f1a23e00640 1 --2- 172.21.15.144:0/3122257848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a240b6c60 0x7f1a240b7040 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1a140097a0 tx=0x7f1a1402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=543e3b77b26cf5b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:36.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.866+0000 7f1a23400640 1 -- 172.21.15.144:0/3122257848 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a14037070 con 0x7f1a240b6c60 2024-09-11T23:25:36.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.866+0000 7f1a23400640 1 -- 172.21.15.144:0/3122257848 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a14032440 con 0x7f1a240b6c60 2024-09-11T23:25:36.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.866+0000 7f1a23400640 1 -- 172.21.15.144:0/3122257848 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a14032810 con 0x7f1a240b6c60 2024-09-11T23:25:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.867+0000 7f1a29c00640 1 -- 172.21.15.144:0/3122257848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a240b6c60 msgr2=0x7f1a240b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.867+0000 7f1a29c00640 1 --2- 172.21.15.144:0/3122257848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a240b6c60 0x7f1a240b7040 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1a140097a0 tx=0x7f1a1402a1a0 comp rx=0 tx=0).stop 2024-09-11T23:25:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.867+0000 7f1a29c00640 1 -- 172.21.15.144:0/3122257848 shutdown_connections 2024-09-11T23:25:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.867+0000 7f1a29c00640 1 --2- 172.21.15.144:0/3122257848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a240b6c60 0x7f1a240b7040 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.867+0000 7f1a29c00640 1 -- 172.21.15.144:0/3122257848 >> 172.21.15.144:0/3122257848 conn(0x7f1a2406f390 msgr2=0x7f1a2406f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.867+0000 7f1a29c00640 1 -- 172.21.15.144:0/3122257848 shutdown_connections 2024-09-11T23:25:36.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.867+0000 7f1a29c00640 1 -- 172.21.15.144:0/3122257848 wait complete. 2024-09-11T23:25:36.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.868+0000 7f1a29c00640 1 Processor -- start 2024-09-11T23:25:36.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.868+0000 7f1a29c00640 1 -- start start 2024-09-11T23:25:36.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.869+0000 7f1a29c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a240b6c60 0x7f1a2415fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:36.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.869+0000 7f1a29c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a240d0370 0x7f1a240ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:36.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.869+0000 7f1a29c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a2415f570 0x7f1a240cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:36.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.869+0000 7f1a29c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1a24074220 con 0x7f1a2415f570 2024-09-11T23:25:36.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.869+0000 7f1a29c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1a24070d40 con 0x7f1a240d0370 2024-09-11T23:25:36.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.869+0000 7f1a29c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1a240d1a50 con 0x7f1a240b6c60 2024-09-11T23:25:36.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.870+0000 7f1a29200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a2415f570 0x7f1a240cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:36.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.870+0000 7f1a1b400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a240d0370 0x7f1a240ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:36.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.870+0000 7f1a29200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a2415f570 0x7f1a240cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53956/0 (socket says 172.21.15.144:53956) 2024-09-11T23:25:36.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.870+0000 7f1a29200640 1 -- 172.21.15.144:0/1662619875 learned_addr learned my addr 172.21.15.144:0/1662619875 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:36.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.870+0000 7f1a23e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a240b6c60 0x7f1a2415fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.870+0000 7f1a29200640 1 -- 172.21.15.144:0/1662619875 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a240b6c60 msgr2=0x7f1a2415fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.870+0000 7f1a29200640 1 --2- 172.21.15.144:0/1662619875 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a240b6c60 0x7f1a2415fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.870+0000 7f1a29200640 1 -- 172.21.15.144:0/1662619875 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a240d0370 msgr2=0x7f1a240ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:36.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.870+0000 7f1a29200640 1 --2- 172.21.15.144:0/1662619875 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a240d0370 0x7f1a240ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.870+0000 7f1a29200640 1 -- 172.21.15.144:0/1662619875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a24160090 con 0x7f1a2415f570 2024-09-11T23:25:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.870+0000 7f1a29200640 1 --2- 172.21.15.144:0/1662619875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a2415f570 0x7f1a240cb8a0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00c6b0 tx=0x7f1a1c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.871+0000 7f1a20c00640 1 -- 172.21.15.144:0/1662619875 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c003b70 con 0x7f1a2415f570 2024-09-11T23:25:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.871+0000 7f1a20c00640 1 -- 172.21.15.144:0/1662619875 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c003d30 con 0x7f1a2415f570 2024-09-11T23:25:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.871+0000 7f1a29c00640 1 -- 172.21.15.144:0/1662619875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a24160370 con 0x7f1a2415f570 2024-09-11T23:25:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.871+0000 7f1a20c00640 1 -- 172.21.15.144:0/1662619875 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c005310 con 0x7f1a2415f570 2024-09-11T23:25:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.871+0000 7f1a29c00640 1 -- 172.21.15.144:0/1662619875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a24160930 con 0x7f1a2415f570 2024-09-11T23:25:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.872+0000 7f1a29c00640 1 -- 172.21.15.144:0/1662619875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a24158f30 con 0x7f1a2415f570 2024-09-11T23:25:36.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.873+0000 7f1a20c00640 1 -- 172.21.15.144:0/1662619875 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f1a1c0054b0 con 0x7f1a2415f570 2024-09-11T23:25:36.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.873+0000 7f1a20c00640 1 --2- 172.21.15.144:0/1662619875 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1a0006c640 0x7f1a0006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:36.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.874+0000 7f1a20c00640 1 -- 172.21.15.144:0/1662619875 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f1a1c08bd80 con 0x7f1a2415f570 2024-09-11T23:25:36.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.874+0000 7f1a23e00640 1 --2- 172.21.15.144:0/1662619875 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1a0006c640 0x7f1a0006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:36.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.875+0000 7f1a23e00640 1 --2- 172.21.15.144:0/1662619875 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1a0006c640 0x7f1a0006eb00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1a14034000 tx=0x7f1a1402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:36.877 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:36.878+0000 7f1a20c00640 1 -- 172.21.15.144:0/1662619875 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a1c059150 con 0x7f1a2415f570 2024-09-11T23:25:37.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.064+0000 7f1a29c00640 1 -- 172.21.15.144:0/1662619875 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1a2415dac0 con 0x7f1a2415f570 2024-09-11T23:25:37.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.064+0000 7f1a20c00640 1 -- 172.21.15.144:0/1662619875 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v142) ==== 80+0+0 (secure 0 0 0) 0x7f1a1c05d450 con 0x7f1a2415f570 2024-09-11T23:25:37.064 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:25:37.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.066+0000 7f1a29c00640 1 -- 172.21.15.144:0/1662619875 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1a0006c640 msgr2=0x7f1a0006eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:37.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.066+0000 7f1a29c00640 1 --2- 172.21.15.144:0/1662619875 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1a0006c640 0x7f1a0006eb00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1a14034000 tx=0x7f1a1402e000 comp rx=0 tx=0).stop 2024-09-11T23:25:37.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.066+0000 7f1a29c00640 1 -- 172.21.15.144:0/1662619875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a2415f570 msgr2=0x7f1a240cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:37.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.066+0000 7f1a29c00640 1 --2- 172.21.15.144:0/1662619875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a2415f570 0x7f1a240cb8a0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00c6b0 tx=0x7f1a1c00cb70 comp rx=0 tx=0).stop 2024-09-11T23:25:37.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.066+0000 7f1a29c00640 1 -- 172.21.15.144:0/1662619875 shutdown_connections 2024-09-11T23:25:37.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.066+0000 7f1a29c00640 1 --2- 172.21.15.144:0/1662619875 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1a0006c640 0x7f1a0006eb00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:37.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.066+0000 7f1a29c00640 1 --2- 172.21.15.144:0/1662619875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a2415f570 0x7f1a240cb8a0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:37.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.066+0000 7f1a29c00640 1 --2- 172.21.15.144:0/1662619875 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a240d0370 0x7f1a240ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:37.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.066+0000 7f1a29c00640 1 --2- 172.21.15.144:0/1662619875 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a240b6c60 0x7f1a2415fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:37.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.066+0000 7f1a29c00640 1 -- 172.21.15.144:0/1662619875 >> 172.21.15.144:0/1662619875 conn(0x7f1a2406f390 msgr2=0x7f1a2415e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:37.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.066+0000 7f1a29c00640 1 -- 172.21.15.144:0/1662619875 shutdown_connections 2024-09-11T23:25:37.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.067+0000 7f1a29c00640 1 -- 172.21.15.144:0/1662619875 wait complete. 2024-09-11T23:25:37.082 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T23:25:37.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:37.082 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T23:25:37.145 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:25:37.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:37.146 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:25:37.182 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:25:37.182 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:25:37.182 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:25:37.222 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:25:37.222 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:25:37.300 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:25:37.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.455+0000 7f7b14a00640 1 Processor -- start 2024-09-11T23:25:37.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.455+0000 7f7b14a00640 1 -- start start 2024-09-11T23:25:37.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.456+0000 7f7b14a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7b100d02a0 0x7f7b100d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:37.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.456+0000 7f7b14a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7b1015ca40 0x7f7b1015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.456+0000 7f7b14a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b100d0bc0 con 0x7f7b1015ceb0 2024-09-11T23:25:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.456+0000 7f7b14a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1015d390 con 0x7f7b100d02a0 2024-09-11T23:25:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.456+0000 7f7b14a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1015d670 con 0x7f7b1015ca40 2024-09-11T23:25:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.457+0000 7f7b0de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7b100d02a0 0x7f7b100d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.457+0000 7f7b0de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7b100d02a0 0x7f7b100d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53960/0 (socket says 172.21.15.144:53960) 2024-09-11T23:25:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.457+0000 7f7b0de00640 1 -- 172.21.15.144:0/1866081058 learned_addr learned my addr 172.21.15.144:0/1866081058 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.457+0000 7f7b0e800640 1 --1- 172.21.15.144:0/1866081058 >> v1:172.21.15.144:6789/0 conn(0x7f7b1015ceb0 0x7f7b101594c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55916/0 (socket says 172.21.15.144:55916) 2024-09-11T23:25:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.457+0000 7f7b0d400640 1 --2- 172.21.15.144:0/1866081058 >> v2:172.21.15.165:3300/0 conn(0x7f7b1015ca40 0x7f7b1015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.457+0000 7f7b0de00640 1 -- 172.21.15.144:0/1866081058 >> v2:172.21.15.165:3300/0 conn(0x7f7b1015ca40 msgr2=0x7f7b1015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.457+0000 7f7b0de00640 1 --2- 172.21.15.144:0/1866081058 >> v2:172.21.15.165:3300/0 conn(0x7f7b1015ca40 0x7f7b1015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.457+0000 7f7b0de00640 1 -- 172.21.15.144:0/1866081058 >> v1:172.21.15.144:6789/0 conn(0x7f7b1015ceb0 legacy=0x7f7b101594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.457+0000 7f7b0de00640 1 -- 172.21.15.144:0/1866081058 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1015d950 con 0x7f7b100d02a0 2024-09-11T23:25:37.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.457+0000 7f7b0d400640 1 --2- 172.21.15.144:0/1866081058 >> v2:172.21.15.165:3300/0 conn(0x7f7b1015ca40 0x7f7b1015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:37.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.458+0000 7f7b0de00640 1 --2- 172.21.15.144:0/1866081058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b100d02a0 0x7f7b100d0680 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f7b100cf320 tx=0x7f7b0002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d543451311e4acd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:37.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.458+0000 7f7b0ca00640 1 -- 172.21.15.144:0/1866081058 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00037070 con 0x7f7b100d02a0 2024-09-11T23:25:37.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.458+0000 7f7b0ca00640 1 -- 172.21.15.144:0/1866081058 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b00032440 con 0x7f7b100d02a0 2024-09-11T23:25:37.460 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.458+0000 7f7b0ca00640 1 -- 172.21.15.144:0/1866081058 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00032810 con 0x7f7b100d02a0 2024-09-11T23:25:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.459+0000 7f7b14a00640 1 -- 172.21.15.144:0/1866081058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b100d02a0 msgr2=0x7f7b100d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.459+0000 7f7b14a00640 1 --2- 172.21.15.144:0/1866081058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b100d02a0 0x7f7b100d0680 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f7b100cf320 tx=0x7f7b0002a1e0 comp rx=0 tx=0).stop 2024-09-11T23:25:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.459+0000 7f7b14a00640 1 -- 172.21.15.144:0/1866081058 shutdown_connections 2024-09-11T23:25:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.459+0000 7f7b14a00640 1 --2- 172.21.15.144:0/1866081058 >> v2:172.21.15.165:3300/0 conn(0x7f7b1015ca40 0x7f7b1015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.459+0000 7f7b14a00640 1 --2- 172.21.15.144:0/1866081058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b100d02a0 0x7f7b100d0680 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:37.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.459+0000 7f7b14a00640 1 -- 172.21.15.144:0/1866081058 >> 172.21.15.144:0/1866081058 conn(0x7f7b10062cc0 msgr2=0x7f7b1006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:37.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.459+0000 7f7b14a00640 1 -- 172.21.15.144:0/1866081058 shutdown_connections 2024-09-11T23:25:37.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.459+0000 7f7b14a00640 1 -- 172.21.15.144:0/1866081058 wait complete. 2024-09-11T23:25:37.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.461+0000 7f7b14a00640 1 Processor -- start 2024-09-11T23:25:37.462 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.461+0000 7f7b14a00640 1 -- start start 2024-09-11T23:25:37.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.462+0000 7f7b14a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b100d02a0 0x7f7b101469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:37.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.462+0000 7f7b14a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b1015ca40 0x7f7b101471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:37.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.462+0000 7f7b14a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b1015ceb0 0x7f7b100736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:37.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.462+0000 7f7b14a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7b10155b90 con 0x7f7b100d02a0 2024-09-11T23:25:37.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.462+0000 7f7b14a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1015df10 con 0x7f7b1015ceb0 2024-09-11T23:25:37.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.462+0000 7f7b14a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f7b10155d10 con 0x7f7b1015ca40 2024-09-11T23:25:37.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.462+0000 7f7b0de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b100d02a0 0x7f7b101469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:37.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.462+0000 7f7b0de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b100d02a0 0x7f7b101469c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53976/0 (socket says 172.21.15.144:53976) 2024-09-11T23:25:37.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.462+0000 7f7b0de00640 1 -- 172.21.15.144:0/3207618973 learned_addr learned my addr 172.21.15.144:0/3207618973 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:37.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.462+0000 7f7b0d400640 1 --2- 172.21.15.144:0/3207618973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b1015ca40 0x7f7b101471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:37.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.462+0000 7f7b0e800640 1 --2- 172.21.15.144:0/3207618973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b1015ceb0 0x7f7b100736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:37.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.462+0000 7f7b0de00640 1 -- 172.21.15.144:0/3207618973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b1015ca40 msgr2=0x7f7b101471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:37.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.462+0000 7f7b0de00640 1 --2- 172.21.15.144:0/3207618973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b1015ca40 0x7f7b101471e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:37.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.462+0000 7f7b0de00640 1 -- 172.21.15.144:0/3207618973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b1015ceb0 msgr2=0x7f7b100736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:37.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.462+0000 7f7b0de00640 1 --2- 172.21.15.144:0/3207618973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b1015ceb0 0x7f7b100736f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:37.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.462+0000 7f7b0de00640 1 -- 172.21.15.144:0/3207618973 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b10147c10 con 0x7f7b100d02a0 2024-09-11T23:25:37.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.462+0000 7f7b0d400640 1 --2- 172.21.15.144:0/3207618973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b1015ca40 0x7f7b101471e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:37.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.462+0000 7f7b0e800640 1 --2- 172.21.15.144:0/3207618973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b1015ceb0 0x7f7b100736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:37.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.463+0000 7f7b0de00640 1 --2- 172.21.15.144:0/3207618973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b100d02a0 0x7f7b101469c0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f7b0002a220 tx=0x7f7b000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:37.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.463+0000 7f7b06000640 1 -- 172.21.15.144:0/3207618973 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00037040 con 0x7f7b100d02a0 2024-09-11T23:25:37.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.463+0000 7f7b06000640 1 -- 172.21.15.144:0/3207618973 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b00042070 con 0x7f7b100d02a0 2024-09-11T23:25:37.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.463+0000 7f7b14a00640 1 -- 172.21.15.144:0/3207618973 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b10147ef0 con 0x7f7b100d02a0 2024-09-11T23:25:37.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.463+0000 7f7b06000640 1 -- 172.21.15.144:0/3207618973 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00030bb0 con 0x7f7b100d02a0 2024-09-11T23:25:37.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.463+0000 7f7b14a00640 1 -- 172.21.15.144:0/3207618973 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b100b00e0 con 0x7f7b100d02a0 2024-09-11T23:25:37.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.464+0000 7f7b14a00640 1 -- 172.21.15.144:0/3207618973 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b100b4790 con 0x7f7b100d02a0 2024-09-11T23:25:37.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.465+0000 7f7b06000640 1 -- 172.21.15.144:0/3207618973 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f7b00047460 con 0x7f7b100d02a0 2024-09-11T23:25:37.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.466+0000 7f7b06000640 1 --2- 172.21.15.144:0/3207618973 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f7af006c610 0x7f7af006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:37.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.466+0000 7f7b06000640 1 -- 172.21.15.144:0/3207618973 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f7b000acd90 con 0x7f7b100d02a0 2024-09-11T23:25:37.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.466+0000 7f7b0d400640 1 --2- 172.21.15.144:0/3207618973 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f7af006c610 0x7f7af006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:37.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.467+0000 7f7b0d400640 1 --2- 172.21.15.144:0/3207618973 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f7af006c610 0x7f7af006ead0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7afc006fd0 tx=0x7f7afc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:37.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.470+0000 7f7b06000640 1 -- 172.21.15.144:0/3207618973 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b00045360 con 0x7f7b100d02a0 2024-09-11T23:25:37.661 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.657+0000 7f7b14a00640 1 -- 172.21.15.144:0/3207618973 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7b1015afd0 con 0x7f7b100d02a0 2024-09-11T23:25:37.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.658+0000 7f7b06000640 1 -- 172.21.15.144:0/3207618973 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v142) ==== 80+0+0 (secure 0 0 0) 0x7f7b0007a720 con 0x7f7b100d02a0 2024-09-11T23:25:37.662 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:25:37.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.660+0000 7f7b14a00640 1 -- 172.21.15.144:0/3207618973 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f7af006c610 msgr2=0x7f7af006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:37.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.660+0000 7f7b14a00640 1 --2- 172.21.15.144:0/3207618973 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f7af006c610 0x7f7af006ead0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7afc006fd0 tx=0x7f7afc008040 comp rx=0 tx=0).stop 2024-09-11T23:25:37.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.660+0000 7f7b14a00640 1 -- 172.21.15.144:0/3207618973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b100d02a0 msgr2=0x7f7b101469c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:37.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.660+0000 7f7b14a00640 1 --2- 172.21.15.144:0/3207618973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b100d02a0 0x7f7b101469c0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f7b0002a220 tx=0x7f7b000046c0 comp rx=0 tx=0).stop 2024-09-11T23:25:37.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.660+0000 7f7b14a00640 1 -- 172.21.15.144:0/3207618973 shutdown_connections 2024-09-11T23:25:37.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.660+0000 7f7b14a00640 1 --2- 172.21.15.144:0/3207618973 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f7af006c610 0x7f7af006ead0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:37.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.660+0000 7f7b14a00640 1 --2- 172.21.15.144:0/3207618973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7b1015ceb0 0x7f7b100736f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:37.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.660+0000 7f7b14a00640 1 --2- 172.21.15.144:0/3207618973 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f7b1015ca40 0x7f7b101471e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:37.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.660+0000 7f7b14a00640 1 --2- 172.21.15.144:0/3207618973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b100d02a0 0x7f7b101469c0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:37.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.660+0000 7f7b14a00640 1 -- 172.21.15.144:0/3207618973 >> 172.21.15.144:0/3207618973 conn(0x7f7b10062cc0 msgr2=0x7f7b10159dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:37.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.660+0000 7f7b14a00640 1 -- 172.21.15.144:0/3207618973 shutdown_connections 2024-09-11T23:25:37.663 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:37.660+0000 7f7b14a00640 1 -- 172.21.15.144:0/3207618973 wait complete. 2024-09-11T23:25:37.676 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-11T23:25:37.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:37.676 DEBUG:teuthology.orchestra.run.smithi165:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-11T23:25:37.747 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:25:37.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:37.747 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:25:37.784 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:25:37.784 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:25:37.785 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:25:37.821 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:25:37.821 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:25:37.821 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:25:37.821 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:25:37.865 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:25:37.865 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:25:38.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.019+0000 7f5686200640 1 Processor -- start 2024-09-11T23:25:38.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.019+0000 7f5686200640 1 -- start start 2024-09-11T23:25:38.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.020+0000 7f5686200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f56800cf070 0x7f56800cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:38.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.020+0000 7f5686200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5680073120 0x7f5680073560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:38.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.020+0000 7f5686200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56800ce740 con 0x7f568015c180 2024-09-11T23:25:38.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.020+0000 7f5686200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5680072640 con 0x7f5680073120 2024-09-11T23:25:38.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.020+0000 7f5686200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5680072920 con 0x7f56800cf070 2024-09-11T23:25:38.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.021+0000 7f567fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5680073120 0x7f5680073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:38.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.021+0000 7f567fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5680073120 0x7f5680073560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53978/0 (socket says 172.21.15.144:53978) 2024-09-11T23:25:38.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.021+0000 7f567fe00640 1 -- 172.21.15.144:0/3476575982 learned_addr learned my addr 172.21.15.144:0/3476575982 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:38.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.021+0000 7f567ea00640 1 --2- 172.21.15.144:0/3476575982 >> v2:172.21.15.165:3300/0 conn(0x7f56800cf070 0x7f56800cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:38.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.021+0000 7f567fe00640 1 -- 172.21.15.144:0/3476575982 >> v2:172.21.15.165:3300/0 conn(0x7f56800cf070 msgr2=0x7f56800cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:38.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.021+0000 7f567fe00640 1 --2- 172.21.15.144:0/3476575982 >> v2:172.21.15.165:3300/0 conn(0x7f56800cf070 0x7f56800cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:38.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.021+0000 7f567fe00640 1 -- 172.21.15.144:0/3476575982 >> v1:172.21.15.165:6789/0 conn(0x7f568015c180 legacy=0x7f56800cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:38.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.021+0000 7f567fe00640 1 -- 172.21.15.144:0/3476575982 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5680072c00 con 0x7f5680073120 2024-09-11T23:25:38.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.022+0000 7f567fe00640 1 --2- 172.21.15.144:0/3476575982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5680073120 0x7f5680073560 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f568006f430 tx=0x7f567802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc4e032b9a3fc77 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:38.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.022+0000 7f567e000640 1 -- 172.21.15.144:0/3476575982 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678036070 con 0x7f5680073120 2024-09-11T23:25:38.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.022+0000 7f567e000640 1 -- 172.21.15.144:0/3476575982 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5678031600 con 0x7f5680073120 2024-09-11T23:25:38.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.022+0000 7f567e000640 1 -- 172.21.15.144:0/3476575982 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56780319d0 con 0x7f5680073120 2024-09-11T23:25:38.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.023+0000 7f5686200640 1 -- 172.21.15.144:0/3476575982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5680073120 msgr2=0x7f5680073560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:38.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.023+0000 7f5686200640 1 --2- 172.21.15.144:0/3476575982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5680073120 0x7f5680073560 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f568006f430 tx=0x7f567802a6a0 comp rx=0 tx=0).stop 2024-09-11T23:25:38.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.023+0000 7f5686200640 1 -- 172.21.15.144:0/3476575982 shutdown_connections 2024-09-11T23:25:38.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.023+0000 7f5686200640 1 --2- 172.21.15.144:0/3476575982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5680073120 0x7f5680073560 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:38.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.023+0000 7f5686200640 1 --2- 172.21.15.144:0/3476575982 >> v2:172.21.15.165:3300/0 conn(0x7f56800cf070 0x7f56800cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:38.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.023+0000 7f5686200640 1 -- 172.21.15.144:0/3476575982 >> 172.21.15.144:0/3476575982 conn(0x7f5680062cc0 msgr2=0x7f568006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:38.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.023+0000 7f5686200640 1 -- 172.21.15.144:0/3476575982 shutdown_connections 2024-09-11T23:25:38.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.023+0000 7f5686200640 1 -- 172.21.15.144:0/3476575982 wait complete. 2024-09-11T23:25:38.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.025+0000 7f5686200640 1 Processor -- start 2024-09-11T23:25:38.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.025+0000 7f5686200640 1 -- start start 2024-09-11T23:25:38.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.026+0000 7f5686200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5680073120 0x7f56801456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:38.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.026+0000 7f5686200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56800cf070 0x7f56800cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:38.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.026+0000 7f5686200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f568015c180 0x7f56800d0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:38.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.026+0000 7f5686200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f56800722f0 con 0x7f568015c180 2024-09-11T23:25:38.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.026+0000 7f5686200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f56800ced00 con 0x7f5680073120 2024-09-11T23:25:38.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.026+0000 7f5686200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f568015c560 con 0x7f56800cf070 2024-09-11T23:25:38.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.026+0000 7f567fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f568015c180 0x7f56800d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:38.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.026+0000 7f567fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f568015c180 0x7f56800d0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53984/0 (socket says 172.21.15.144:53984) 2024-09-11T23:25:38.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.026+0000 7f567fe00640 1 -- 172.21.15.144:0/3753389262 learned_addr learned my addr 172.21.15.144:0/3753389262 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:38.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.026+0000 7f567f400640 1 --2- 172.21.15.144:0/3753389262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5680073120 0x7f56801456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:38.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.026+0000 7f567ea00640 1 --2- 172.21.15.144:0/3753389262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56800cf070 0x7f56800cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:38.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.026+0000 7f567fe00640 1 -- 172.21.15.144:0/3753389262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56800cf070 msgr2=0x7f56800cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:38.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.026+0000 7f567fe00640 1 --2- 172.21.15.144:0/3753389262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56800cf070 0x7f56800cfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:38.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.026+0000 7f567fe00640 1 -- 172.21.15.144:0/3753389262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5680073120 msgr2=0x7f56801456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:38.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.026+0000 7f567fe00640 1 --2- 172.21.15.144:0/3753389262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5680073120 0x7f56801456b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:38.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.026+0000 7f567fe00640 1 -- 172.21.15.144:0/3753389262 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56801482d0 con 0x7f568015c180 2024-09-11T23:25:38.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.027+0000 7f567fe00640 1 --2- 172.21.15.144:0/3753389262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f568015c180 0x7f56800d0140 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f5678009f40 tx=0x7f5678004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:38.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.027+0000 7f5677400640 1 -- 172.21.15.144:0/3753389262 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678036050 con 0x7f568015c180 2024-09-11T23:25:38.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.027+0000 7f5677400640 1 -- 172.21.15.144:0/3753389262 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5678042070 con 0x7f568015c180 2024-09-11T23:25:38.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.027+0000 7f5686200640 1 -- 172.21.15.144:0/3753389262 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56801485b0 con 0x7f568015c180 2024-09-11T23:25:38.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.027+0000 7f5677400640 1 -- 172.21.15.144:0/3753389262 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678009510 con 0x7f568015c180 2024-09-11T23:25:38.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.027+0000 7f5686200640 1 -- 172.21.15.144:0/3753389262 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5680148b70 con 0x7f568015c180 2024-09-11T23:25:38.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.028+0000 7f5686200640 1 -- 172.21.15.144:0/3753389262 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56800cf4e0 con 0x7f568015c180 2024-09-11T23:25:38.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.029+0000 7f5677400640 1 -- 172.21.15.144:0/3753389262 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f5678007bf0 con 0x7f568015c180 2024-09-11T23:25:38.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.030+0000 7f5677400640 1 --2- 172.21.15.144:0/3753389262 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f566006c640 0x7f566006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:38.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.030+0000 7f5677400640 1 -- 172.21.15.144:0/3753389262 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f56780acef0 con 0x7f568015c180 2024-09-11T23:25:38.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.030+0000 7f567f400640 1 --2- 172.21.15.144:0/3753389262 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f566006c640 0x7f566006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:38.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.031+0000 7f567f400640 1 --2- 172.21.15.144:0/3753389262 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f566006c640 0x7f566006eb00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f56700016e0 tx=0x7f5670009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:38.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.034+0000 7f5677400640 1 -- 172.21.15.144:0/3753389262 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f567807a120 con 0x7f568015c180 2024-09-11T23:25:38.242 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.242+0000 7f5686200640 1 -- 172.21.15.144:0/3753389262 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f568006f0c0 con 0x7f568015c180 2024-09-11T23:25:38.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.243+0000 7f5677400640 1 -- 172.21.15.144:0/3753389262 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5241 (secure 0 0 0) 0x7f567807e420 con 0x7f568015c180 2024-09-11T23:25:38.243 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:38.243 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":101,"btime":"2024-09-11T23:25:24:738425+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6893,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2346696977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2346696977},{"type":"v1","addr":"172.21.15.165:6834","nonce":2346696977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3411942787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3411942787},{"type":"v1","addr":"172.21.15.165:6835","nonce":3411942787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/1554186582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1554186582},{"type":"v1","addr":"172.21.15.144:6801","nonce":1554186582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:25:14.094581+0000","modified":"2024-09-11T23:25:17.112238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"a","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1597149290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1597149290},{"type":"v1","addr":"172.21.15.144:6835","nonce":1597149290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8244,"qdb_cluster":[8244]},"id":11}]} 2024-09-11T23:25:38.243 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 101 2024-09-11T23:25:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.245+0000 7f5686200640 1 -- 172.21.15.144:0/3753389262 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f566006c640 msgr2=0x7f566006eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.245+0000 7f5686200640 1 --2- 172.21.15.144:0/3753389262 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f566006c640 0x7f566006eb00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f56700016e0 tx=0x7f5670009040 comp rx=0 tx=0).stop 2024-09-11T23:25:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.245+0000 7f5686200640 1 -- 172.21.15.144:0/3753389262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f568015c180 msgr2=0x7f56800d0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.245+0000 7f5686200640 1 --2- 172.21.15.144:0/3753389262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f568015c180 0x7f56800d0140 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f5678009f40 tx=0x7f5678004a40 comp rx=0 tx=0).stop 2024-09-11T23:25:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.245+0000 7f5686200640 1 -- 172.21.15.144:0/3753389262 shutdown_connections 2024-09-11T23:25:38.245 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.245+0000 7f5686200640 1 --2- 172.21.15.144:0/3753389262 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f566006c640 0x7f566006eb00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:38.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.245+0000 7f5686200640 1 --2- 172.21.15.144:0/3753389262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f568015c180 0x7f56800d0140 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:38.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.245+0000 7f5686200640 1 --2- 172.21.15.144:0/3753389262 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f56800cf070 0x7f56800cfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:38.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.245+0000 7f5686200640 1 --2- 172.21.15.144:0/3753389262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5680073120 0x7f56801456b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:38.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.245+0000 7f5686200640 1 -- 172.21.15.144:0/3753389262 >> 172.21.15.144:0/3753389262 conn(0x7f5680062cc0 msgr2=0x7f5680159fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:38.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.245+0000 7f5686200640 1 -- 172.21.15.144:0/3753389262 shutdown_connections 2024-09-11T23:25:38.246 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.245+0000 7f5686200640 1 -- 172.21.15.144:0/3753389262 wait complete. 2024-09-11T23:25:38.261 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:25:38.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.413+0000 7ff663000640 1 Processor -- start 2024-09-11T23:25:38.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.413+0000 7ff663000640 1 -- start start 2024-09-11T23:25:38.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.414+0000 7ff663000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff65c073830 0x7ff65c0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:38.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.414+0000 7ff663000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff65c0ce740 con 0x7ff65c15c180 2024-09-11T23:25:38.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.414+0000 7ff663000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff65c072640 con 0x7ff65c0cf070 2024-09-11T23:25:38.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.414+0000 7ff663000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff65c072920 con 0x7ff65c073830 2024-09-11T23:25:38.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.415+0000 7ff65be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff65c15c180 0x7ff65c0cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55922/0 (socket says 172.21.15.144:55922) 2024-09-11T23:25:38.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.415+0000 7ff65be00640 1 -- 172.21.15.144:0/2098826938 learned_addr learned my addr 172.21.15.144:0/2098826938 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:38.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.415+0000 7ff661000640 1 --2- 172.21.15.144:0/2098826938 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff65c073830 0x7ff65c0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:38.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.415+0000 7ff65aa00640 1 -- 172.21.15.144:0/2098826938 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3468670925 0 0) 0x7ff65c0ce740 con 0x7ff65c15c180 2024-09-11T23:25:38.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.415+0000 7ff65aa00640 1 -- 172.21.15.144:0/2098826938 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff640003520 con 0x7ff65c15c180 2024-09-11T23:25:38.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.415+0000 7ff65aa00640 1 -- 172.21.15.144:0/2098826938 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2595190018 0 0) 0x7ff65c072640 con 0x7ff65c0cf070 2024-09-11T23:25:38.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.415+0000 7ff65aa00640 1 -- 172.21.15.144:0/2098826938 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff65c0ce740 con 0x7ff65c0cf070 2024-09-11T23:25:38.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.415+0000 7ff661000640 1 -- 172.21.15.144:0/2098826938 >> v1:172.21.15.165:6789/0 conn(0x7ff65c0cf070 legacy=0x7ff65c073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:38.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.415+0000 7ff661000640 1 -- 172.21.15.144:0/2098826938 >> v1:172.21.15.144:6789/0 conn(0x7ff65c15c180 legacy=0x7ff65c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:38.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.415+0000 7ff661000640 1 -- 172.21.15.144:0/2098826938 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65c072c00 con 0x7ff65c073830 2024-09-11T23:25:38.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.416+0000 7ff661000640 1 --2- 172.21.15.144:0/2098826938 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff65c073830 0x7ff65c0cf4e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff654009dc0 tx=0x7ff65402a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66726f0fabeaba4f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:38.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.416+0000 7ff65aa00640 1 -- 172.21.15.144:0/2098826938 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65402ae60 con 0x7ff65c073830 2024-09-11T23:25:38.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.416+0000 7ff65aa00640 1 -- 172.21.15.144:0/2098826938 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff654007740 con 0x7ff65c073830 2024-09-11T23:25:38.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.416+0000 7ff65aa00640 1 -- 172.21.15.144:0/2098826938 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654007af0 con 0x7ff65c073830 2024-09-11T23:25:38.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.417+0000 7ff663000640 1 -- 172.21.15.144:0/2098826938 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff65c073830 msgr2=0x7ff65c0cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:38.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.417+0000 7ff663000640 1 --2- 172.21.15.144:0/2098826938 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff65c073830 0x7ff65c0cf4e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff654009dc0 tx=0x7ff65402a640 comp rx=0 tx=0).stop 2024-09-11T23:25:38.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.417+0000 7ff663000640 1 -- 172.21.15.144:0/2098826938 shutdown_connections 2024-09-11T23:25:38.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.417+0000 7ff663000640 1 --2- 172.21.15.144:0/2098826938 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff65c073830 0x7ff65c0cf4e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:38.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.417+0000 7ff663000640 1 -- 172.21.15.144:0/2098826938 >> 172.21.15.144:0/2098826938 conn(0x7ff65c062cc0 msgr2=0x7ff65c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:38.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.417+0000 7ff663000640 1 -- 172.21.15.144:0/2098826938 shutdown_connections 2024-09-11T23:25:38.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.417+0000 7ff663000640 1 -- 172.21.15.144:0/2098826938 wait complete. 2024-09-11T23:25:38.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.419+0000 7ff663000640 1 Processor -- start 2024-09-11T23:25:38.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.419+0000 7ff663000640 1 -- start start 2024-09-11T23:25:38.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.420+0000 7ff663000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff65c073830 0x7ff65c1e5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:38.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.420+0000 7ff663000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff65c0cf070 0x7ff65c15c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:38.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.420+0000 7ff663000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff65c15c180 0x7ff65c15ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:38.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.420+0000 7ff663000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c0722f0 con 0x7ff65c15c180 2024-09-11T23:25:38.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.420+0000 7ff663000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c0ced00 con 0x7ff65c073830 2024-09-11T23:25:38.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.420+0000 7ff663000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff65c15c560 con 0x7ff65c0cf070 2024-09-11T23:25:38.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.420+0000 7ff661000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff65c15c180 0x7ff65c15ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:38.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.420+0000 7ff661000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff65c15c180 0x7ff65c15ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53986/0 (socket says 172.21.15.144:53986) 2024-09-11T23:25:38.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.420+0000 7ff661000640 1 -- 172.21.15.144:0/2449485391 learned_addr learned my addr 172.21.15.144:0/2449485391 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:38.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.420+0000 7ff65be00640 1 --2- 172.21.15.144:0/2449485391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff65c073830 0x7ff65c1e5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:38.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.420+0000 7ff65b400640 1 --2- 172.21.15.144:0/2449485391 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff65c0cf070 0x7ff65c15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:38.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.420+0000 7ff661000640 1 -- 172.21.15.144:0/2449485391 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff65c0cf070 msgr2=0x7ff65c15c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:38.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.420+0000 7ff661000640 1 --2- 172.21.15.144:0/2449485391 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff65c0cf070 0x7ff65c15c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:38.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.420+0000 7ff661000640 1 -- 172.21.15.144:0/2449485391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff65c073830 msgr2=0x7ff65c1e5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:38.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.420+0000 7ff661000640 1 --2- 172.21.15.144:0/2449485391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff65c073830 0x7ff65c1e5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:38.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.421+0000 7ff661000640 1 -- 172.21.15.144:0/2449485391 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65c1e62b0 con 0x7ff65c15c180 2024-09-11T23:25:38.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.421+0000 7ff65be00640 1 --2- 172.21.15.144:0/2449485391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff65c073830 0x7ff65c1e5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:25:38.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.421+0000 7ff661000640 1 --2- 172.21.15.144:0/2449485391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff65c15c180 0x7ff65c15ce00 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7ff65402ac30 tx=0x7ff654004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:38.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.421+0000 7ff653e00640 1 -- 172.21.15.144:0/2449485391 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654009450 con 0x7ff65c15c180 2024-09-11T23:25:38.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.421+0000 7ff653e00640 1 -- 172.21.15.144:0/2449485391 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff65402ae60 con 0x7ff65c15c180 2024-09-11T23:25:38.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.421+0000 7ff653e00640 1 -- 172.21.15.144:0/2449485391 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654004470 con 0x7ff65c15c180 2024-09-11T23:25:38.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.421+0000 7ff663000640 1 -- 172.21.15.144:0/2449485391 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff65c1e6550 con 0x7ff65c15c180 2024-09-11T23:25:38.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.421+0000 7ff663000640 1 -- 172.21.15.144:0/2449485391 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff65c1e6b10 con 0x7ff65c15c180 2024-09-11T23:25:38.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.422+0000 7ff663000640 1 -- 172.21.15.144:0/2449485391 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff65c0cf4e0 con 0x7ff65c15c180 2024-09-11T23:25:38.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.423+0000 7ff653e00640 1 -- 172.21.15.144:0/2449485391 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7ff654004610 con 0x7ff65c15c180 2024-09-11T23:25:38.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.424+0000 7ff653e00640 1 --2- 172.21.15.144:0/2449485391 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff63c06c610 0x7ff63c06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:38.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.424+0000 7ff653e00640 1 -- 172.21.15.144:0/2449485391 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7ff6540ad3b0 con 0x7ff65c15c180 2024-09-11T23:25:38.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.425+0000 7ff65be00640 1 --2- 172.21.15.144:0/2449485391 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff63c06c610 0x7ff63c06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:38.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.425+0000 7ff65be00640 1 --2- 172.21.15.144:0/2449485391 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff63c06c610 0x7ff63c06ead0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff64c000f60 tx=0x7ff64c007d70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:38.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.428+0000 7ff653e00640 1 -- 172.21.15.144:0/2449485391 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff65403f030 con 0x7ff65c15c180 2024-09-11T23:25:38.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.635+0000 7ff663000640 1 -- 172.21.15.144:0/2449485391 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff65c06f130 con 0x7ff65c15c180 2024-09-11T23:25:38.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.636+0000 7ff653e00640 1 -- 172.21.15.144:0/2449485391 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5241 (secure 0 0 0) 0x7ff65407a670 con 0x7ff65c15c180 2024-09-11T23:25:38.636 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:38.636 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":101,"btime":"2024-09-11T23:25:24:738425+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6893,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2346696977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2346696977},{"type":"v1","addr":"172.21.15.165:6834","nonce":2346696977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3411942787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3411942787},{"type":"v1","addr":"172.21.15.165:6835","nonce":3411942787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/1554186582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1554186582},{"type":"v1","addr":"172.21.15.144:6801","nonce":1554186582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:25:14.094581+0000","modified":"2024-09-11T23:25:17.112238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"a","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1597149290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1597149290},{"type":"v1","addr":"172.21.15.144:6835","nonce":1597149290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8244,"qdb_cluster":[8244]},"id":11}]} 2024-09-11T23:25:38.636 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 101 2024-09-11T23:25:38.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.638+0000 7ff663000640 1 -- 172.21.15.144:0/2449485391 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff63c06c610 msgr2=0x7ff63c06ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:38.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.638+0000 7ff663000640 1 --2- 172.21.15.144:0/2449485391 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff63c06c610 0x7ff63c06ead0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff64c000f60 tx=0x7ff64c007d70 comp rx=0 tx=0).stop 2024-09-11T23:25:38.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.638+0000 7ff663000640 1 -- 172.21.15.144:0/2449485391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff65c15c180 msgr2=0x7ff65c15ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:38.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.638+0000 7ff663000640 1 --2- 172.21.15.144:0/2449485391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff65c15c180 0x7ff65c15ce00 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7ff65402ac30 tx=0x7ff654004a40 comp rx=0 tx=0).stop 2024-09-11T23:25:38.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.638+0000 7ff663000640 1 -- 172.21.15.144:0/2449485391 shutdown_connections 2024-09-11T23:25:38.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.638+0000 7ff663000640 1 --2- 172.21.15.144:0/2449485391 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff63c06c610 0x7ff63c06ead0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:38.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.638+0000 7ff663000640 1 --2- 172.21.15.144:0/2449485391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff65c15c180 0x7ff65c15ce00 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:38.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.638+0000 7ff663000640 1 --2- 172.21.15.144:0/2449485391 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff65c0cf070 0x7ff65c15c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:38.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.638+0000 7ff663000640 1 --2- 172.21.15.144:0/2449485391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff65c073830 0x7ff65c1e5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:38.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.638+0000 7ff663000640 1 -- 172.21.15.144:0/2449485391 >> 172.21.15.144:0/2449485391 conn(0x7ff65c062cc0 msgr2=0x7ff65c0cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:38.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.638+0000 7ff663000640 1 -- 172.21.15.144:0/2449485391 shutdown_connections 2024-09-11T23:25:38.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.638+0000 7ff663000640 1 -- 172.21.15.144:0/2449485391 wait complete. 2024-09-11T23:25:38.654 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:25:38.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.812+0000 7fb91c200640 1 Processor -- start 2024-09-11T23:25:38.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.812+0000 7fb91c200640 1 -- start start 2024-09-11T23:25:38.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.813+0000 7fb91c200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb91415ceb0 0x7fb9141594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:38.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.813+0000 7fb91c200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91415d390 con 0x7fb91415ca40 2024-09-11T23:25:38.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.813+0000 7fb91c200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91415d670 con 0x7fb9140d02a0 2024-09-11T23:25:38.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.813+0000 7fb91c200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb91415d950 con 0x7fb91415ceb0 2024-09-11T23:25:38.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.813+0000 7fb918e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb91415ca40 0x7fb91415e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55930/0 (socket says 172.21.15.144:55930) 2024-09-11T23:25:38.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.813+0000 7fb918e00640 1 -- 172.21.15.144:0/1910649554 learned_addr learned my addr 172.21.15.144:0/1910649554 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:38.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.813+0000 7fb91a200640 1 --2- 172.21.15.144:0/1910649554 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb91415ceb0 0x7fb9141594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:38.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.814+0000 7fb913e00640 1 -- 172.21.15.144:0/1910649554 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3435985529 0 0) 0x7fb91415d390 con 0x7fb91415ca40 2024-09-11T23:25:38.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.814+0000 7fb913e00640 1 -- 172.21.15.144:0/1910649554 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8fc003520 con 0x7fb91415ca40 2024-09-11T23:25:38.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.814+0000 7fb913e00640 1 -- 172.21.15.144:0/1910649554 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2875994625 0 0) 0x7fb91415d670 con 0x7fb9140d02a0 2024-09-11T23:25:38.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.814+0000 7fb91a200640 1 -- 172.21.15.144:0/1910649554 >> v1:172.21.15.165:6789/0 conn(0x7fb9140d02a0 legacy=0x7fb9140d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:38.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.814+0000 7fb91a200640 1 -- 172.21.15.144:0/1910649554 >> v1:172.21.15.144:6789/0 conn(0x7fb91415ca40 legacy=0x7fb91415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:38.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.814+0000 7fb91a200640 1 -- 172.21.15.144:0/1910649554 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91415dc30 con 0x7fb91415ceb0 2024-09-11T23:25:38.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.815+0000 7fb91a200640 1 --2- 172.21.15.144:0/1910649554 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb91415ceb0 0x7fb9141594c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009dc0 tx=0x7fb90c02a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b8d4d4105625ec4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:38.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.815+0000 7fb913e00640 1 -- 172.21.15.144:0/1910649554 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c02ae60 con 0x7fb91415ceb0 2024-09-11T23:25:38.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.815+0000 7fb913e00640 1 -- 172.21.15.144:0/1910649554 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb90c007740 con 0x7fb91415ceb0 2024-09-11T23:25:38.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.815+0000 7fb913e00640 1 -- 172.21.15.144:0/1910649554 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c007b10 con 0x7fb91415ceb0 2024-09-11T23:25:38.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.816+0000 7fb91c200640 1 -- 172.21.15.144:0/1910649554 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb91415ceb0 msgr2=0x7fb9141594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:38.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.816+0000 7fb91c200640 1 --2- 172.21.15.144:0/1910649554 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb91415ceb0 0x7fb9141594c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009dc0 tx=0x7fb90c02a640 comp rx=0 tx=0).stop 2024-09-11T23:25:38.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.816+0000 7fb91c200640 1 -- 172.21.15.144:0/1910649554 shutdown_connections 2024-09-11T23:25:38.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.816+0000 7fb91c200640 1 --2- 172.21.15.144:0/1910649554 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb91415ceb0 0x7fb9141594c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:38.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.816+0000 7fb91c200640 1 -- 172.21.15.144:0/1910649554 >> 172.21.15.144:0/1910649554 conn(0x7fb914062cc0 msgr2=0x7fb91406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:38.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.816+0000 7fb91c200640 1 -- 172.21.15.144:0/1910649554 shutdown_connections 2024-09-11T23:25:38.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.816+0000 7fb91c200640 1 -- 172.21.15.144:0/1910649554 wait complete. 2024-09-11T23:25:38.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.817+0000 7fb91c200640 1 Processor -- start 2024-09-11T23:25:38.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.818+0000 7fb91c200640 1 -- start start 2024-09-11T23:25:38.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.818+0000 7fb91c200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9140d02a0 0x7fb914073ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:38.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.818+0000 7fb91c200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb91415ca40 0x7fb9141f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:38.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.818+0000 7fb91c200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb91415ceb0 0x7fb91414c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:38.818 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.818+0000 7fb91c200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb914155b90 con 0x7fb9140d02a0 2024-09-11T23:25:38.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.818+0000 7fb91c200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb91415eb40 con 0x7fb91415ca40 2024-09-11T23:25:38.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.818+0000 7fb91c200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb914155d10 con 0x7fb91415ceb0 2024-09-11T23:25:38.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.819+0000 7fb919800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9140d02a0 0x7fb914073ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:38.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.819+0000 7fb919800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9140d02a0 0x7fb914073ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53992/0 (socket says 172.21.15.144:53992) 2024-09-11T23:25:38.819 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.819+0000 7fb919800640 1 -- 172.21.15.144:0/587319658 learned_addr learned my addr 172.21.15.144:0/587319658 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:38.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.819+0000 7fb919800640 1 -- 172.21.15.144:0/587319658 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb91415ceb0 msgr2=0x7fb91414c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:38.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.819+0000 7fb919800640 1 --2- 172.21.15.144:0/587319658 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb91415ceb0 0x7fb91414c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:38.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.819+0000 7fb919800640 1 -- 172.21.15.144:0/587319658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb91415ca40 msgr2=0x7fb9141f40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:38.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.819+0000 7fb919800640 1 --2- 172.21.15.144:0/587319658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb91415ca40 0x7fb9141f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:38.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.819+0000 7fb919800640 1 -- 172.21.15.144:0/587319658 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9140712c0 con 0x7fb9140d02a0 2024-09-11T23:25:38.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.819+0000 7fb919800640 1 --2- 172.21.15.144:0/587319658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9140d02a0 0x7fb914073ca0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fb90800c440 tx=0x7fb90800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:38.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.820+0000 7fb911600640 1 -- 172.21.15.144:0/587319658 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908017070 con 0x7fb9140d02a0 2024-09-11T23:25:38.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.820+0000 7fb911600640 1 -- 172.21.15.144:0/587319658 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9080035f0 con 0x7fb9140d02a0 2024-09-11T23:25:38.820 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.820+0000 7fb911600640 1 -- 172.21.15.144:0/587319658 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9080039e0 con 0x7fb9140d02a0 2024-09-11T23:25:38.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.820+0000 7fb91c200640 1 -- 172.21.15.144:0/587319658 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9140715a0 con 0x7fb9140d02a0 2024-09-11T23:25:38.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.820+0000 7fb91c200640 1 -- 172.21.15.144:0/587319658 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb914071b60 con 0x7fb9140d02a0 2024-09-11T23:25:38.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.821+0000 7fb91c200640 1 -- 172.21.15.144:0/587319658 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb914071d60 con 0x7fb9140d02a0 2024-09-11T23:25:38.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.822+0000 7fb911600640 1 -- 172.21.15.144:0/587319658 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7fb90801a070 con 0x7fb9140d02a0 2024-09-11T23:25:38.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.822+0000 7fb911600640 1 --2- 172.21.15.144:0/587319658 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb8f406c610 0x7fb8f406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:38.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.823+0000 7fb911600640 1 -- 172.21.15.144:0/587319658 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fb90808b4d0 con 0x7fb9140d02a0 2024-09-11T23:25:38.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.823+0000 7fb918e00640 1 --2- 172.21.15.144:0/587319658 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb8f406c610 0x7fb8f406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:38.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.824+0000 7fb918e00640 1 --2- 172.21.15.144:0/587319658 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb8f406c610 0x7fb8f406ead0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb900005880 tx=0x7fb900007950 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:38.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:38.827+0000 7fb911600640 1 -- 172.21.15.144:0/587319658 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb908058e60 con 0x7fb9140d02a0 2024-09-11T23:25:39.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.002+0000 7fb91c200640 1 -- 172.21.15.144:0/587319658 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9140cea90 con 0x7fb9140d02a0 2024-09-11T23:25:39.003 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.003+0000 7fb911600640 1 -- 172.21.15.144:0/587319658 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) ==== 74+0+16755 (secure 0 0 0) 0x7fb908058760 con 0x7fb9140d02a0 2024-09-11T23:25:39.003 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:39.003 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":142,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:25:15.695849+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:25:11.862995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-11T23:25:13.101996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:25:39.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.006+0000 7fb91c200640 1 -- 172.21.15.144:0/587319658 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb8f406c610 msgr2=0x7fb8f406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:39.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.006+0000 7fb91c200640 1 --2- 172.21.15.144:0/587319658 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb8f406c610 0x7fb8f406ead0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb900005880 tx=0x7fb900007950 comp rx=0 tx=0).stop 2024-09-11T23:25:39.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.006+0000 7fb91c200640 1 -- 172.21.15.144:0/587319658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9140d02a0 msgr2=0x7fb914073ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:39.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.006+0000 7fb91c200640 1 --2- 172.21.15.144:0/587319658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9140d02a0 0x7fb914073ca0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fb90800c440 tx=0x7fb90800c900 comp rx=0 tx=0).stop 2024-09-11T23:25:39.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.006+0000 7fb91c200640 1 -- 172.21.15.144:0/587319658 shutdown_connections 2024-09-11T23:25:39.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.006+0000 7fb91c200640 1 --2- 172.21.15.144:0/587319658 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb8f406c610 0x7fb8f406ead0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.006+0000 7fb91c200640 1 --2- 172.21.15.144:0/587319658 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb91415ceb0 0x7fb91414c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.006+0000 7fb91c200640 1 --2- 172.21.15.144:0/587319658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb91415ca40 0x7fb9141f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.006+0000 7fb91c200640 1 --2- 172.21.15.144:0/587319658 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9140d02a0 0x7fb914073ca0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.006+0000 7fb91c200640 1 -- 172.21.15.144:0/587319658 >> 172.21.15.144:0/587319658 conn(0x7fb914062cc0 msgr2=0x7fb9140b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:39.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.006+0000 7fb91c200640 1 -- 172.21.15.144:0/587319658 shutdown_connections 2024-09-11T23:25:39.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.006+0000 7fb91c200640 1 -- 172.21.15.144:0/587319658 wait complete. 2024-09-11T23:25:39.022 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:25:39.022 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:25:39.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.175+0000 7fe32b200640 1 Processor -- start 2024-09-11T23:25:39.174 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.175+0000 7fe32b200640 1 -- start start 2024-09-11T23:25:39.176 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.176+0000 7fe32b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe32c15a0a0 0x7fe32c073180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:39.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.176+0000 7fe32b200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe32c0736c0 0x7fe32c0ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:39.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.176+0000 7fe32b200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe32c072100 con 0x7fe32c0ce9c0 2024-09-11T23:25:39.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.176+0000 7fe32b200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe32c0cee00 con 0x7fe32c0736c0 2024-09-11T23:25:39.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.176+0000 7fe32b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe32c0723c0 con 0x7fe32c15a0a0 2024-09-11T23:25:39.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.176+0000 7fe321400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe32c0736c0 0x7fe32c0ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:39.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.176+0000 7fe321400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe32c0736c0 0x7fe32c0ce480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53996/0 (socket says 172.21.15.144:53996) 2024-09-11T23:25:39.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.176+0000 7fe321400640 1 -- 172.21.15.144:0/1757511288 learned_addr learned my addr 172.21.15.144:0/1757511288 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:39.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.176+0000 7fe32a800640 1 --1- 172.21.15.144:0/1757511288 >> v1:172.21.15.144:6789/0 conn(0x7fe32c0ce9c0 0x7fe32c0b1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55938/0 (socket says 172.21.15.144:55938) 2024-09-11T23:25:39.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.176+0000 7fe329e00640 1 --2- 172.21.15.144:0/1757511288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe32c15a0a0 0x7fe32c073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:39.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.177+0000 7fe321400640 1 -- 172.21.15.144:0/1757511288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe32c15a0a0 msgr2=0x7fe32c073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:39.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.177+0000 7fe321400640 1 --2- 172.21.15.144:0/1757511288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe32c15a0a0 0x7fe32c073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.177+0000 7fe321400640 1 -- 172.21.15.144:0/1757511288 >> v1:172.21.15.144:6789/0 conn(0x7fe32c0ce9c0 legacy=0x7fe32c0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:39.177 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.177+0000 7fe321400640 1 -- 172.21.15.144:0/1757511288 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32c0726a0 con 0x7fe32c0736c0 2024-09-11T23:25:39.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.177+0000 7fe329400640 1 -- 172.21.15.144:0/1757511288 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 718785996 0 0) 0x7fe32c072100 con 0x7fe32c0ce9c0 2024-09-11T23:25:39.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.178+0000 7fe321400640 1 --2- 172.21.15.144:0/1757511288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe32c0736c0 0x7fe32c0ce480 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0cef80 tx=0x7fe31402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d961e001ebef360c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:39.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.178+0000 7fe329400640 1 -- 172.21.15.144:0/1757511288 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe314037070 con 0x7fe32c0736c0 2024-09-11T23:25:39.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.178+0000 7fe329400640 1 -- 172.21.15.144:0/1757511288 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe314032440 con 0x7fe32c0736c0 2024-09-11T23:25:39.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.178+0000 7fe329400640 1 -- 172.21.15.144:0/1757511288 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe314032810 con 0x7fe32c0736c0 2024-09-11T23:25:39.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.178+0000 7fe32b200640 1 -- 172.21.15.144:0/1757511288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe32c0736c0 msgr2=0x7fe32c0ce480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:39.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.178+0000 7fe32b200640 1 --2- 172.21.15.144:0/1757511288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe32c0736c0 0x7fe32c0ce480 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0cef80 tx=0x7fe31402a250 comp rx=0 tx=0).stop 2024-09-11T23:25:39.179 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.179+0000 7fe32b200640 1 -- 172.21.15.144:0/1757511288 shutdown_connections 2024-09-11T23:25:39.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.179+0000 7fe32b200640 1 --2- 172.21.15.144:0/1757511288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe32c0736c0 0x7fe32c0ce480 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.179+0000 7fe32b200640 1 --2- 172.21.15.144:0/1757511288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe32c15a0a0 0x7fe32c073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.179+0000 7fe32b200640 1 -- 172.21.15.144:0/1757511288 >> 172.21.15.144:0/1757511288 conn(0x7fe32c06e910 msgr2=0x7fe32c06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:39.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.179+0000 7fe32b200640 1 -- 172.21.15.144:0/1757511288 shutdown_connections 2024-09-11T23:25:39.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.179+0000 7fe32b200640 1 -- 172.21.15.144:0/1757511288 wait complete. 2024-09-11T23:25:39.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.180+0000 7fe32b200640 1 Processor -- start 2024-09-11T23:25:39.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.180+0000 7fe32b200640 1 -- start start 2024-09-11T23:25:39.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.181+0000 7fe32b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe32c0ce9c0 0x7fe32c14b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:39.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.181+0000 7fe32b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe32c15a0a0 0x7fe32c0aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:39.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.181+0000 7fe32b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe32c0aef90 0x7fe32c0abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:39.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.181+0000 7fe32b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c0b2650 con 0x7fe32c0ce9c0 2024-09-11T23:25:39.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.181+0000 7fe32b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c0b24d0 con 0x7fe32c0aef90 2024-09-11T23:25:39.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.181+0000 7fe32b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe32c0cf240 con 0x7fe32c15a0a0 2024-09-11T23:25:39.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.182+0000 7fe329e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe32c0ce9c0 0x7fe32c14b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:39.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.182+0000 7fe329e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe32c0ce9c0 0x7fe32c14b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53998/0 (socket says 172.21.15.144:53998) 2024-09-11T23:25:39.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.182+0000 7fe329e00640 1 -- 172.21.15.144:0/494350609 learned_addr learned my addr 172.21.15.144:0/494350609 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:39.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.182+0000 7fe32a800640 1 --2- 172.21.15.144:0/494350609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe32c0aef90 0x7fe32c0abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:39.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.182+0000 7fe321400640 1 --2- 172.21.15.144:0/494350609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe32c15a0a0 0x7fe32c0aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:39.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.182+0000 7fe329e00640 1 -- 172.21.15.144:0/494350609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe32c15a0a0 msgr2=0x7fe32c0aea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:39.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.182+0000 7fe329e00640 1 --2- 172.21.15.144:0/494350609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe32c15a0a0 0x7fe32c0aea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.182+0000 7fe329e00640 1 -- 172.21.15.144:0/494350609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe32c0aef90 msgr2=0x7fe32c0abe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:39.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.182+0000 7fe329e00640 1 --2- 172.21.15.144:0/494350609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe32c0aef90 0x7fe32c0abe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.182+0000 7fe329e00640 1 -- 172.21.15.144:0/494350609 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32c14b9d0 con 0x7fe32c0ce9c0 2024-09-11T23:25:39.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.182+0000 7fe329e00640 1 --2- 172.21.15.144:0/494350609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe32c0ce9c0 0x7fe32c14b490 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00e870 tx=0x7fe31c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:39.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.183+0000 7fe322a00640 1 -- 172.21.15.144:0/494350609 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c017070 con 0x7fe32c0ce9c0 2024-09-11T23:25:39.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.183+0000 7fe322a00640 1 -- 172.21.15.144:0/494350609 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31c00c940 con 0x7fe32c0ce9c0 2024-09-11T23:25:39.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.183+0000 7fe32b200640 1 -- 172.21.15.144:0/494350609 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32c0af410 con 0x7fe32c0ce9c0 2024-09-11T23:25:39.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.183+0000 7fe322a00640 1 -- 172.21.15.144:0/494350609 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00cd30 con 0x7fe32c0ce9c0 2024-09-11T23:25:39.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.183+0000 7fe32b200640 1 -- 172.21.15.144:0/494350609 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe32c1e5190 con 0x7fe32c0ce9c0 2024-09-11T23:25:39.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.184+0000 7fe32b200640 1 -- 172.21.15.144:0/494350609 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe32c0af930 con 0x7fe32c0ce9c0 2024-09-11T23:25:39.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.185+0000 7fe322a00640 1 -- 172.21.15.144:0/494350609 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7fe31c01a070 con 0x7fe32c0ce9c0 2024-09-11T23:25:39.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.185+0000 7fe322a00640 1 --2- 172.21.15.144:0/494350609 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe30806c610 0x7fe30806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:39.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.186+0000 7fe322a00640 1 -- 172.21.15.144:0/494350609 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fe31c08bee0 con 0x7fe32c0ce9c0 2024-09-11T23:25:39.185 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.186+0000 7fe321400640 1 --2- 172.21.15.144:0/494350609 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe30806c610 0x7fe30806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:39.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.187+0000 7fe321400640 1 --2- 172.21.15.144:0/494350609 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe30806c610 0x7fe30806ead0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe314034000 tx=0x7fe31402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:39.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.190+0000 7fe322a00640 1 -- 172.21.15.144:0/494350609 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe32c0af930 con 0x7fe32c0ce9c0 2024-09-11T23:25:39.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.398+0000 7fe32b200640 1 -- 172.21.15.144:0/494350609 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe32c0ce480 con 0x7fe32c0ce9c0 2024-09-11T23:25:39.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.399+0000 7fe322a00640 1 -- 172.21.15.144:0/494350609 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5241 (secure 0 0 0) 0x7fe31c0592b0 con 0x7fe32c0ce9c0 2024-09-11T23:25:39.399 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:39.399 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":101,"btime":"2024-09-11T23:25:24:738425+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6893,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2346696977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2346696977},{"type":"v1","addr":"172.21.15.165:6834","nonce":2346696977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3411942787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3411942787},{"type":"v1","addr":"172.21.15.165:6835","nonce":3411942787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/1554186582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1554186582},{"type":"v1","addr":"172.21.15.144:6801","nonce":1554186582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:25:14.094581+0000","modified":"2024-09-11T23:25:17.112238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"a","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1597149290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1597149290},{"type":"v1","addr":"172.21.15.144:6835","nonce":1597149290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8244,"qdb_cluster":[8244]},"id":11}]} 2024-09-11T23:25:39.399 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 101 2024-09-11T23:25:39.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.401+0000 7fe32b200640 1 -- 172.21.15.144:0/494350609 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe30806c610 msgr2=0x7fe30806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:39.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.401+0000 7fe32b200640 1 --2- 172.21.15.144:0/494350609 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe30806c610 0x7fe30806ead0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe314034000 tx=0x7fe31402e000 comp rx=0 tx=0).stop 2024-09-11T23:25:39.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.401+0000 7fe32b200640 1 -- 172.21.15.144:0/494350609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe32c0ce9c0 msgr2=0x7fe32c14b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:39.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.401+0000 7fe32b200640 1 --2- 172.21.15.144:0/494350609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe32c0ce9c0 0x7fe32c14b490 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00e870 tx=0x7fe31c00ed30 comp rx=0 tx=0).stop 2024-09-11T23:25:39.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.401+0000 7fe32b200640 1 -- 172.21.15.144:0/494350609 shutdown_connections 2024-09-11T23:25:39.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.401+0000 7fe32b200640 1 --2- 172.21.15.144:0/494350609 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe30806c610 0x7fe30806ead0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.401+0000 7fe32b200640 1 --2- 172.21.15.144:0/494350609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe32c0aef90 0x7fe32c0abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.401+0000 7fe32b200640 1 --2- 172.21.15.144:0/494350609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe32c15a0a0 0x7fe32c0aea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.401+0000 7fe32b200640 1 --2- 172.21.15.144:0/494350609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe32c0ce9c0 0x7fe32c14b490 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.401+0000 7fe32b200640 1 -- 172.21.15.144:0/494350609 >> 172.21.15.144:0/494350609 conn(0x7fe32c06e910 msgr2=0x7fe32c0b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:39.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.402+0000 7fe32b200640 1 -- 172.21.15.144:0/494350609 shutdown_connections 2024-09-11T23:25:39.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.402+0000 7fe32b200640 1 -- 172.21.15.144:0/494350609 wait complete. 2024-09-11T23:25:39.418 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:25:39.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.572+0000 7f7113e00640 1 Processor -- start 2024-09-11T23:25:39.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.572+0000 7f7113e00640 1 -- start start 2024-09-11T23:25:39.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.574+0000 7f7113e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f710c0d0a50 0x7f710c1620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:39.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.574+0000 7f7113e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f710c1625f0 con 0x7f710c0b4930 2024-09-11T23:25:39.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.574+0000 7f7113e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f710c162870 con 0x7f710c15fd30 2024-09-11T23:25:39.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.574+0000 7f7113e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f710c160180 con 0x7f710c0d0a50 2024-09-11T23:25:39.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.574+0000 7f7111400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f710c0d0a50 0x7f710c1620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:39.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.574+0000 7f7110a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f710c0b4930 0x7f710c15f620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55946/0 (socket says 172.21.15.144:55946) 2024-09-11T23:25:39.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.574+0000 7f7110a00640 1 -- 172.21.15.144:0/2816573382 learned_addr learned my addr 172.21.15.144:0/2816573382 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:39.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.574+0000 7f7111400640 1 -- 172.21.15.144:0/2816573382 >> v1:172.21.15.165:6789/0 conn(0x7f710c15fd30 legacy=0x7f710c0b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:39.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.574+0000 7f7111400640 1 -- 172.21.15.144:0/2816573382 >> v1:172.21.15.144:6789/0 conn(0x7f710c0b4930 legacy=0x7f710c15f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:39.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.574+0000 7f710be00640 1 -- 172.21.15.144:0/2816573382 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 522519852 0 0) 0x7f70f8001110 con 0x7f710c0b4930 2024-09-11T23:25:39.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.574+0000 7f7111400640 1 -- 172.21.15.144:0/2816573382 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c162b50 con 0x7f710c0d0a50 2024-09-11T23:25:39.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.575+0000 7f7111400640 1 --2- 172.21.15.144:0/2816573382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c0d0a50 0x7f710c1620b0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f71000097a0 tx=0x7f710002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42b60ea27257dd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:39.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.576+0000 7f710be00640 1 -- 172.21.15.144:0/2816573382 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100037070 con 0x7f710c0d0a50 2024-09-11T23:25:39.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.576+0000 7f710be00640 1 -- 172.21.15.144:0/2816573382 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f710002ae50 con 0x7f710c0d0a50 2024-09-11T23:25:39.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.576+0000 7f710be00640 1 -- 172.21.15.144:0/2816573382 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100032660 con 0x7f710c0d0a50 2024-09-11T23:25:39.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.576+0000 7f7113e00640 1 -- 172.21.15.144:0/2816573382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c0d0a50 msgr2=0x7f710c1620b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:39.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.576+0000 7f7113e00640 1 --2- 172.21.15.144:0/2816573382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c0d0a50 0x7f710c1620b0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f71000097a0 tx=0x7f710002a140 comp rx=0 tx=0).stop 2024-09-11T23:25:39.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.576+0000 7f7113e00640 1 -- 172.21.15.144:0/2816573382 shutdown_connections 2024-09-11T23:25:39.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.576+0000 7f7113e00640 1 --2- 172.21.15.144:0/2816573382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c0d0a50 0x7f710c1620b0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.576+0000 7f7113e00640 1 -- 172.21.15.144:0/2816573382 >> 172.21.15.144:0/2816573382 conn(0x7f710c062cc0 msgr2=0x7f710c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:39.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.576+0000 7f7113e00640 1 -- 172.21.15.144:0/2816573382 shutdown_connections 2024-09-11T23:25:39.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.576+0000 7f7113e00640 1 -- 172.21.15.144:0/2816573382 wait complete. 2024-09-11T23:25:39.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.578+0000 7f7113e00640 1 Processor -- start 2024-09-11T23:25:39.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.578+0000 7f7113e00640 1 -- start start 2024-09-11T23:25:39.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.579+0000 7f7113e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f710c0b4930 0x7f710c14f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:39.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.579+0000 7f7113e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f710c15fd30 0x7f710c0b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:39.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.579+0000 7f7113e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c0b1280 0x7f710c158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:39.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.579+0000 7f7113e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f710c0b3620 con 0x7f710c0b1280 2024-09-11T23:25:39.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.579+0000 7f7113e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f710c0b3340 con 0x7f710c0b4930 2024-09-11T23:25:39.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.579+0000 7f7113e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f710c0b4250 con 0x7f710c15fd30 2024-09-11T23:25:39.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.579+0000 7f7111e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c0b1280 0x7f710c158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:39.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.579+0000 7f7111e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c0b1280 0x7f710c158ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54014/0 (socket says 172.21.15.144:54014) 2024-09-11T23:25:39.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.579+0000 7f7111e00640 1 -- 172.21.15.144:0/1355611756 learned_addr learned my addr 172.21.15.144:0/1355611756 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:39.580 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.580+0000 7f7111400640 1 --2- 172.21.15.144:0/1355611756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f710c0b4930 0x7f710c14f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:39.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.580+0000 7f7111e00640 1 -- 172.21.15.144:0/1355611756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f710c15fd30 msgr2=0x7f710c0b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:39.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.580+0000 7f7111e00640 1 --2- 172.21.15.144:0/1355611756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f710c15fd30 0x7f710c0b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.580+0000 7f7111e00640 1 -- 172.21.15.144:0/1355611756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f710c0b4930 msgr2=0x7f710c14f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:39.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.580+0000 7f7111e00640 1 --2- 172.21.15.144:0/1355611756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f710c0b4930 0x7f710c14f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.580+0000 7f7111e00640 1 -- 172.21.15.144:0/1355611756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710c159af0 con 0x7f710c0b1280 2024-09-11T23:25:39.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.580+0000 7f7111400640 1 --2- 172.21.15.144:0/1355611756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f710c0b4930 0x7f710c14f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:39.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.580+0000 7f7111e00640 1 --2- 172.21.15.144:0/1355611756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c0b1280 0x7f710c158ce0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f710400b970 tx=0x7f710400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:39.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.580+0000 7f7109600640 1 -- 172.21.15.144:0/1355611756 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7104019070 con 0x7f710c0b1280 2024-09-11T23:25:39.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.580+0000 7f7109600640 1 -- 172.21.15.144:0/1355611756 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f710400cb40 con 0x7f710c0b1280 2024-09-11T23:25:39.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.580+0000 7f7109600640 1 -- 172.21.15.144:0/1355611756 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7104014440 con 0x7f710c0b1280 2024-09-11T23:25:39.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.580+0000 7f7113e00640 1 -- 172.21.15.144:0/1355611756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710c0730c0 con 0x7f710c0b1280 2024-09-11T23:25:39.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.580+0000 7f7113e00640 1 -- 172.21.15.144:0/1355611756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f710c073680 con 0x7f710c0b1280 2024-09-11T23:25:39.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.581+0000 7f7113e00640 1 -- 172.21.15.144:0/1355611756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f710c0b4610 con 0x7f710c0b1280 2024-09-11T23:25:39.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.582+0000 7f7109600640 1 -- 172.21.15.144:0/1355611756 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f710401c070 con 0x7f710c0b1280 2024-09-11T23:25:39.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.583+0000 7f7109600640 1 --2- 172.21.15.144:0/1355611756 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f70ec06c610 0x7f70ec06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:39.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.583+0000 7f7109600640 1 -- 172.21.15.144:0/1355611756 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f7104089480 con 0x7f710c0b1280 2024-09-11T23:25:39.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.584+0000 7f7111400640 1 --2- 172.21.15.144:0/1355611756 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f70ec06c610 0x7f70ec06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:39.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.584+0000 7f7111400640 1 --2- 172.21.15.144:0/1355611756 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f70ec06c610 0x7f70ec06ead0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7100034000 tx=0x7f710002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:39.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.587+0000 7f7109600640 1 -- 172.21.15.144:0/1355611756 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7104059720 con 0x7f710c0b1280 2024-09-11T23:25:39.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.799+0000 7f7113e00640 1 -- 172.21.15.144:0/1355611756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f710c15eca0 con 0x7f710c0b1280 2024-09-11T23:25:39.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.799+0000 7f7109600640 1 -- 172.21.15.144:0/1355611756 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5241 (secure 0 0 0) 0x7f7104059020 con 0x7f710c0b1280 2024-09-11T23:25:39.799 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:39.799 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":101,"btime":"2024-09-11T23:25:24:738425+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6893,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2346696977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2346696977},{"type":"v1","addr":"172.21.15.165:6834","nonce":2346696977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3411942787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3411942787},{"type":"v1","addr":"172.21.15.165:6835","nonce":3411942787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/1554186582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1554186582},{"type":"v1","addr":"172.21.15.144:6801","nonce":1554186582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:25:14.094581+0000","modified":"2024-09-11T23:25:17.112238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8244":{"gid":8244,"name":"a","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/1597149290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1597149290},{"type":"v1","addr":"172.21.15.144:6835","nonce":1597149290}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8244,"qdb_cluster":[8244]},"id":11}]} 2024-09-11T23:25:39.799 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 101 2024-09-11T23:25:39.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.802+0000 7f7113e00640 1 -- 172.21.15.144:0/1355611756 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f70ec06c610 msgr2=0x7f70ec06ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:39.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.802+0000 7f7113e00640 1 --2- 172.21.15.144:0/1355611756 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f70ec06c610 0x7f70ec06ead0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7100034000 tx=0x7f710002e000 comp rx=0 tx=0).stop 2024-09-11T23:25:39.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.802+0000 7f7113e00640 1 -- 172.21.15.144:0/1355611756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c0b1280 msgr2=0x7f710c158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:39.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.802+0000 7f7113e00640 1 --2- 172.21.15.144:0/1355611756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c0b1280 0x7f710c158ce0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f710400b970 tx=0x7f710400be30 comp rx=0 tx=0).stop 2024-09-11T23:25:39.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.802+0000 7f7113e00640 1 -- 172.21.15.144:0/1355611756 shutdown_connections 2024-09-11T23:25:39.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.802+0000 7f7113e00640 1 --2- 172.21.15.144:0/1355611756 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f70ec06c610 0x7f70ec06ead0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.802+0000 7f7113e00640 1 --2- 172.21.15.144:0/1355611756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f710c0b1280 0x7f710c158ce0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.802+0000 7f7113e00640 1 --2- 172.21.15.144:0/1355611756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f710c15fd30 0x7f710c0b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.802+0000 7f7113e00640 1 --2- 172.21.15.144:0/1355611756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f710c0b4930 0x7f710c14f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.802+0000 7f7113e00640 1 -- 172.21.15.144:0/1355611756 >> 172.21.15.144:0/1355611756 conn(0x7f710c062cc0 msgr2=0x7f710c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:39.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.802+0000 7f7113e00640 1 -- 172.21.15.144:0/1355611756 shutdown_connections 2024-09-11T23:25:39.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.802+0000 7f7113e00640 1 -- 172.21.15.144:0/1355611756 wait complete. 2024-09-11T23:25:39.818 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:25:39.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.971+0000 7fcfc7400640 1 Processor -- start 2024-09-11T23:25:39.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.971+0000 7fcfc7400640 1 -- start start 2024-09-11T23:25:39.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.973+0000 7fcfc7400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfc015e8e0 0x7fcfc00d2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:39.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.973+0000 7fcfc7400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc0074200 con 0x7fcfc00b4b70 2024-09-11T23:25:39.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.973+0000 7fcfc7400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc00b6e80 con 0x7fcfc015e500 2024-09-11T23:25:39.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.973+0000 7fcfc7400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc00b7160 con 0x7fcfc015e8e0 2024-09-11T23:25:39.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.973+0000 7fcfb7e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fcfc00b4b70 0x7fcfc00d2460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55962/0 (socket says 172.21.15.144:55962) 2024-09-11T23:25:39.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.973+0000 7fcfb7e00640 1 -- 172.21.15.144:0/3144994609 learned_addr learned my addr 172.21.15.144:0/3144994609 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:39.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.973+0000 7fcfc5400640 1 --2- 172.21.15.144:0/3144994609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfc015e8e0 0x7fcfc00d2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:39.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.973+0000 7fcfbfe00640 1 -- 172.21.15.144:0/3144994609 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3073035223 0 0) 0x7fcfc0074200 con 0x7fcfc00b4b70 2024-09-11T23:25:39.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.973+0000 7fcfbfe00640 1 -- 172.21.15.144:0/3144994609 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfa4003520 con 0x7fcfc00b4b70 2024-09-11T23:25:39.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfbfe00640 1 -- 172.21.15.144:0/3144994609 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 543852030 0 0) 0x7fcfc00b6e80 con 0x7fcfc015e500 2024-09-11T23:25:39.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfbfe00640 1 -- 172.21.15.144:0/3144994609 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfc0074200 con 0x7fcfc015e500 2024-09-11T23:25:39.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfbfe00640 1 -- 172.21.15.144:0/3144994609 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1791807312 0 0) 0x7fcfa4003520 con 0x7fcfc00b4b70 2024-09-11T23:25:39.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfbfe00640 1 -- 172.21.15.144:0/3144994609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfc015e8e0 msgr2=0x7fcfc00d2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:39.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfbfe00640 1 --2- 172.21.15.144:0/3144994609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfc015e8e0 0x7fcfc00d2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfbfe00640 1 -- 172.21.15.144:0/3144994609 >> v1:172.21.15.165:6789/0 conn(0x7fcfc015e500 legacy=0x7fcfc00b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:39.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfbfe00640 1 -- 172.21.15.144:0/3144994609 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc00b7440 con 0x7fcfc00b4b70 2024-09-11T23:25:39.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfbfe00640 1 -- 172.21.15.144:0/3144994609 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fcfa8001670 con 0x7fcfc00b4b70 2024-09-11T23:25:39.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfbfe00640 1 -- 172.21.15.144:0/3144994609 >> v1:172.21.15.144:6789/0 conn(0x7fcfc00b4b70 legacy=0x7fcfc00d2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:39.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfbfe00640 1 --2- 172.21.15.144:0/3144994609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfa4003b70 0x7fcfa4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:39.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfbfe00640 1 --2- 172.21.15.144:0/3144994609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfa4004800 0x7fcfa4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:39.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfbfe00640 1 --2- 172.21.15.144:0/3144994609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfc015e8e0 0x7fcfa40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:39.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfbfe00640 1 -- 172.21.15.144:0/3144994609 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc00b7160 con 0x7fcfa4004800 2024-09-11T23:25:39.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfbfe00640 1 -- 172.21.15.144:0/3144994609 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa400bad0 con 0x7fcfa4003b70 2024-09-11T23:25:39.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfbfe00640 1 -- 172.21.15.144:0/3144994609 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcfa400bcd0 con 0x7fcfc015e8e0 2024-09-11T23:25:39.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfb7e00640 1 --2- 172.21.15.144:0/3144994609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfa4004800 0x7fcfa4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfc5400640 1 --2- 172.21.15.144:0/3144994609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfc015e8e0 0x7fcfa40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfc4a00640 1 --2- 172.21.15.144:0/3144994609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfa4003b70 0x7fcfa4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfb7e00640 1 -- 172.21.15.144:0/3144994609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfc015e8e0 msgr2=0x7fcfa40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfb7e00640 1 --2- 172.21.15.144:0/3144994609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfc015e8e0 0x7fcfa40051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfb7e00640 1 -- 172.21.15.144:0/3144994609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfa4003b70 msgr2=0x7fcfa4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfb7e00640 1 --2- 172.21.15.144:0/3144994609 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfa4003b70 0x7fcfa4003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfb7e00640 1 -- 172.21.15.144:0/3144994609 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa4003520 con 0x7fcfa4004800 2024-09-11T23:25:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.974+0000 7fcfc5400640 1 --2- 172.21.15.144:0/3144994609 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfc015e8e0 0x7fcfa40051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.975+0000 7fcfb7e00640 1 --2- 172.21.15.144:0/3144994609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfa4004800 0x7fcfa4004c80 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800c160 tx=0x7fcfa4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8938ca6bbc67c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.976+0000 7fcfbfe00640 1 -- 172.21.15.144:0/3144994609 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8007cc0 con 0x7fcfa4004800 2024-09-11T23:25:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.976+0000 7fcfbfe00640 1 -- 172.21.15.144:0/3144994609 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa8005af0 con 0x7fcfa4004800 2024-09-11T23:25:39.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.976+0000 7fcfbfe00640 1 -- 172.21.15.144:0/3144994609 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8007070 con 0x7fcfa4004800 2024-09-11T23:25:39.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.976+0000 7fcfc7400640 1 -- 172.21.15.144:0/3144994609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfa4004800 msgr2=0x7fcfa4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:39.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.976+0000 7fcfc7400640 1 --2- 172.21.15.144:0/3144994609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfa4004800 0x7fcfa4004c80 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800c160 tx=0x7fcfa4005830 comp rx=0 tx=0).stop 2024-09-11T23:25:39.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.976+0000 7fcfc5400640 1 -- 172.21.15.144:0/3144994609 reap_dead start 2024-09-11T23:25:39.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.976+0000 7fcfc7400640 1 -- 172.21.15.144:0/3144994609 shutdown_connections 2024-09-11T23:25:39.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.976+0000 7fcfc7400640 1 -- 172.21.15.144:0/3144994609 >> 172.21.15.144:0/3144994609 conn(0x7fcfc0062810 msgr2=0x7fcfc0062bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:39.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.976+0000 7fcfc7400640 1 -- 172.21.15.144:0/3144994609 shutdown_connections 2024-09-11T23:25:39.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.976+0000 7fcfc7400640 1 -- 172.21.15.144:0/3144994609 wait complete. 2024-09-11T23:25:39.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.978+0000 7fcfc7400640 1 Processor -- start 2024-09-11T23:25:39.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.978+0000 7fcfc7400640 1 -- start start 2024-09-11T23:25:39.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.979+0000 7fcfc7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfa4004800 0x7fcfc0149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:39.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.979+0000 7fcfc7400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfc00cc820 0x7fcfc01f3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:39.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.979+0000 7fcfc7400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfc0153770 0x7fcfc0153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:39.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.979+0000 7fcfc7400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc006ce30 con 0x7fcfa4004800 2024-09-11T23:25:39.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.979+0000 7fcfc7400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc006ccb0 con 0x7fcfc0153770 2024-09-11T23:25:39.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.979+0000 7fcfc7400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc0073cb0 con 0x7fcfc00cc820 2024-09-11T23:25:39.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.979+0000 7fcfc4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfa4004800 0x7fcfc0149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:39.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.979+0000 7fcfc4a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfa4004800 0x7fcfc0149cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54030/0 (socket says 172.21.15.144:54030) 2024-09-11T23:25:39.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.979+0000 7fcfc4a00640 1 -- 172.21.15.144:0/3223389529 learned_addr learned my addr 172.21.15.144:0/3223389529 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:39.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.979+0000 7fcfc5400640 1 --2- 172.21.15.144:0/3223389529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfc0153770 0x7fcfc0153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:39.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.979+0000 7fcfb7e00640 1 --2- 172.21.15.144:0/3223389529 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfc00cc820 0x7fcfc01f3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:39.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.980+0000 7fcfc4a00640 1 -- 172.21.15.144:0/3223389529 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfc00cc820 msgr2=0x7fcfc01f3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:39.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.980+0000 7fcfc4a00640 1 --2- 172.21.15.144:0/3223389529 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfc00cc820 0x7fcfc01f3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.980+0000 7fcfc4a00640 1 -- 172.21.15.144:0/3223389529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfc0153770 msgr2=0x7fcfc0153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:39.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.980+0000 7fcfc4a00640 1 --2- 172.21.15.144:0/3223389529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfc0153770 0x7fcfc0153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:39.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.980+0000 7fcfc4a00640 1 -- 172.21.15.144:0/3223389529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc00ccd70 con 0x7fcfa4004800 2024-09-11T23:25:39.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.980+0000 7fcfc5400640 1 --2- 172.21.15.144:0/3223389529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfc0153770 0x7fcfc0153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:39.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.980+0000 7fcfc4a00640 1 --2- 172.21.15.144:0/3223389529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfa4004800 0x7fcfc0149cb0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000e7b0 tx=0x7fcfb000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:39.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.980+0000 7fcfbd600640 1 -- 172.21.15.144:0/3223389529 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb00050d0 con 0x7fcfa4004800 2024-09-11T23:25:39.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.980+0000 7fcfbd600640 1 -- 172.21.15.144:0/3223389529 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb0018070 con 0x7fcfa4004800 2024-09-11T23:25:39.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.980+0000 7fcfbd600640 1 -- 172.21.15.144:0/3223389529 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb000c6c0 con 0x7fcfa4004800 2024-09-11T23:25:39.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.980+0000 7fcfc7400640 1 -- 172.21.15.144:0/3223389529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc00cd050 con 0x7fcfa4004800 2024-09-11T23:25:39.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.980+0000 7fcfc7400640 1 -- 172.21.15.144:0/3223389529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc00cd610 con 0x7fcfa4004800 2024-09-11T23:25:39.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.981+0000 7fcfc7400640 1 -- 172.21.15.144:0/3223389529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfc00d1cf0 con 0x7fcfa4004800 2024-09-11T23:25:39.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.982+0000 7fcfbd600640 1 -- 172.21.15.144:0/3223389529 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7fcfb000c860 con 0x7fcfa4004800 2024-09-11T23:25:39.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.984+0000 7fcfbd600640 1 --2- 172.21.15.144:0/3223389529 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcf9c06c640 0x7fcf9c06eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:39.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.984+0000 7fcfbd600640 1 -- 172.21.15.144:0/3223389529 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fcfb008be10 con 0x7fcfa4004800 2024-09-11T23:25:39.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.984+0000 7fcfb7e00640 1 --2- 172.21.15.144:0/3223389529 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcf9c06c640 0x7fcf9c06eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:39.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.985+0000 7fcfb7e00640 1 --2- 172.21.15.144:0/3223389529 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcf9c06c640 0x7fcf9c06eb00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8032000 tx=0x7fcfa8009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:39.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:39.988+0000 7fcfbd600640 1 -- 172.21.15.144:0/3223389529 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcfb0059830 con 0x7fcfa4004800 2024-09-11T23:25:40.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.163+0000 7fcfc7400640 1 -- 172.21.15.144:0/3223389529 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcfc0069160 con 0x7fcfa4004800 2024-09-11T23:25:40.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.164+0000 7fcfbd600640 1 -- 172.21.15.144:0/3223389529 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) ==== 74+0+16755 (secure 0 0 0) 0x7fcfb0059130 con 0x7fcfa4004800 2024-09-11T23:25:40.164 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:40.164 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":142,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:25:15.695849+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:25:11.862995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-11T23:25:13.101996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:25:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.166+0000 7fcfc7400640 1 -- 172.21.15.144:0/3223389529 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcf9c06c640 msgr2=0x7fcf9c06eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.166+0000 7fcfc7400640 1 --2- 172.21.15.144:0/3223389529 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcf9c06c640 0x7fcf9c06eb00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8032000 tx=0x7fcfa8009030 comp rx=0 tx=0).stop 2024-09-11T23:25:40.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.166+0000 7fcfc7400640 1 -- 172.21.15.144:0/3223389529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfa4004800 msgr2=0x7fcfc0149cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.166+0000 7fcfc7400640 1 --2- 172.21.15.144:0/3223389529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfa4004800 0x7fcfc0149cb0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000e7b0 tx=0x7fcfb000ec70 comp rx=0 tx=0).stop 2024-09-11T23:25:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.166+0000 7fcfc7400640 1 -- 172.21.15.144:0/3223389529 shutdown_connections 2024-09-11T23:25:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.166+0000 7fcfc7400640 1 --2- 172.21.15.144:0/3223389529 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcf9c06c640 0x7fcf9c06eb00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.166+0000 7fcfc7400640 1 --2- 172.21.15.144:0/3223389529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfc0153770 0x7fcfc0153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.166+0000 7fcfc7400640 1 --2- 172.21.15.144:0/3223389529 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcfc00cc820 0x7fcfc01f3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.166+0000 7fcfc7400640 1 --2- 172.21.15.144:0/3223389529 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfa4004800 0x7fcfc0149cb0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.166+0000 7fcfc7400640 1 -- 172.21.15.144:0/3223389529 >> 172.21.15.144:0/3223389529 conn(0x7fcfc0062810 msgr2=0x7fcfc00b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.167+0000 7fcfc7400640 1 -- 172.21.15.144:0/3223389529 shutdown_connections 2024-09-11T23:25:40.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.167+0000 7fcfc7400640 1 -- 172.21.15.144:0/3223389529 wait complete. 2024-09-11T23:25:40.182 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:25:40.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.337+0000 7f6751000640 1 Processor -- start 2024-09-11T23:25:40.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.337+0000 7f6751000640 1 -- start start 2024-09-11T23:25:40.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.338+0000 7f6751000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f674c0d0a50 0x7f674c1620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:40.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.338+0000 7f6751000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f674c1625f0 con 0x7f674c0b4930 2024-09-11T23:25:40.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.338+0000 7f6751000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f674c162870 con 0x7f674c15fd30 2024-09-11T23:25:40.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.338+0000 7f6751000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f674c160180 con 0x7f674c0d0a50 2024-09-11T23:25:40.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.338+0000 7f6743e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f674c0b4930 0x7f674c15f620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55978/0 (socket says 172.21.15.144:55978) 2024-09-11T23:25:40.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.338+0000 7f6743e00640 1 -- 172.21.15.144:0/31714207 learned_addr learned my addr 172.21.15.144:0/31714207 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:40.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.339+0000 7f6749e00640 1 --2- 172.21.15.144:0/31714207 >> v2:172.21.15.165:3300/0 conn(0x7f674c0d0a50 0x7f674c1620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:40.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.339+0000 7f6749400640 1 -- 172.21.15.144:0/31714207 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3702176932 0 0) 0x7f6734001110 con 0x7f674c0b4930 2024-09-11T23:25:40.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.339+0000 7f6749400640 1 -- 172.21.15.144:0/31714207 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6730003520 con 0x7f674c0b4930 2024-09-11T23:25:40.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.339+0000 7f6749400640 1 -- 172.21.15.144:0/31714207 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3033605338 0 0) 0x7f674c162870 con 0x7f674c15fd30 2024-09-11T23:25:40.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.339+0000 7f6749400640 1 -- 172.21.15.144:0/31714207 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6734001110 con 0x7f674c15fd30 2024-09-11T23:25:40.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.339+0000 7f6749400640 1 -- 172.21.15.144:0/31714207 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 965071254 0 0) 0x7f6730003520 con 0x7f674c0b4930 2024-09-11T23:25:40.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.339+0000 7f6749e00640 1 -- 172.21.15.144:0/31714207 >> v1:172.21.15.165:6789/0 conn(0x7f674c15fd30 legacy=0x7f674c0b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:40.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.339+0000 7f6749e00640 1 -- 172.21.15.144:0/31714207 >> v1:172.21.15.144:6789/0 conn(0x7f674c0b4930 legacy=0x7f674c15f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:40.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.339+0000 7f6749e00640 1 -- 172.21.15.144:0/31714207 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f674c162b50 con 0x7f674c0d0a50 2024-09-11T23:25:40.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.340+0000 7f6749e00640 1 --2- 172.21.15.144:0/31714207 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f674c0d0a50 0x7f674c1620b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f673c0097a0 tx=0x7f673c02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f187f24a624bf2ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:40.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.340+0000 7f6749400640 1 -- 172.21.15.144:0/31714207 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c037070 con 0x7f674c0d0a50 2024-09-11T23:25:40.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.340+0000 7f6749400640 1 -- 172.21.15.144:0/31714207 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f673c02abc0 con 0x7f674c0d0a50 2024-09-11T23:25:40.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.340+0000 7f6749400640 1 -- 172.21.15.144:0/31714207 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734001840 con 0x7f674c0d0a50 2024-09-11T23:25:40.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.341+0000 7f6751000640 1 -- 172.21.15.144:0/31714207 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f674c0d0a50 msgr2=0x7f674c1620b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:40.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.341+0000 7f6751000640 1 --2- 172.21.15.144:0/31714207 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f674c0d0a50 0x7f674c1620b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f673c0097a0 tx=0x7f673c02a130 comp rx=0 tx=0).stop 2024-09-11T23:25:40.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.341+0000 7f6751000640 1 -- 172.21.15.144:0/31714207 shutdown_connections 2024-09-11T23:25:40.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.341+0000 7f6751000640 1 --2- 172.21.15.144:0/31714207 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f674c0d0a50 0x7f674c1620b0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:40.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.341+0000 7f6751000640 1 -- 172.21.15.144:0/31714207 >> 172.21.15.144:0/31714207 conn(0x7f674c062cc0 msgr2=0x7f674c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:40.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.341+0000 7f6751000640 1 -- 172.21.15.144:0/31714207 shutdown_connections 2024-09-11T23:25:40.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.341+0000 7f6751000640 1 -- 172.21.15.144:0/31714207 wait complete. 2024-09-11T23:25:40.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.343+0000 7f6751000640 1 Processor -- start 2024-09-11T23:25:40.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.343+0000 7f6751000640 1 -- start start 2024-09-11T23:25:40.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.344+0000 7f6751000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f674c0b4930 0x7f674c070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:40.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.344+0000 7f6751000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f674c15fd30 0x7f674c072f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:40.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.344+0000 7f6751000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f674c1f75a0 0x7f674c15a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:40.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.344+0000 7f6751000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f674c0b3620 con 0x7f674c15fd30 2024-09-11T23:25:40.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.344+0000 7f6751000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f674c0b3340 con 0x7f674c0b4930 2024-09-11T23:25:40.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.344+0000 7f6751000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f674c0b4250 con 0x7f674c1f75a0 2024-09-11T23:25:40.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.344+0000 7f6743e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f674c15fd30 0x7f674c072f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:40.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.344+0000 7f6743e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f674c15fd30 0x7f674c072f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54046/0 (socket says 172.21.15.144:54046) 2024-09-11T23:25:40.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.344+0000 7f6743e00640 1 -- 172.21.15.144:0/1713578312 learned_addr learned my addr 172.21.15.144:0/1713578312 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:40.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.344+0000 7f6749e00640 1 --2- 172.21.15.144:0/1713578312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f674c0b4930 0x7f674c070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:40.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.344+0000 7f674a800640 1 --2- 172.21.15.144:0/1713578312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f674c1f75a0 0x7f674c15a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:40.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.345+0000 7f6743e00640 1 -- 172.21.15.144:0/1713578312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f674c1f75a0 msgr2=0x7f674c15a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:40.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.345+0000 7f6743e00640 1 --2- 172.21.15.144:0/1713578312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f674c1f75a0 0x7f674c15a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:40.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.345+0000 7f6743e00640 1 -- 172.21.15.144:0/1713578312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f674c0b4930 msgr2=0x7f674c070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:40.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.345+0000 7f6743e00640 1 --2- 172.21.15.144:0/1713578312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f674c0b4930 0x7f674c070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:40.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.345+0000 7f6743e00640 1 -- 172.21.15.144:0/1713578312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f674c073850 con 0x7f674c15fd30 2024-09-11T23:25:40.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.345+0000 7f6743e00640 1 --2- 172.21.15.144:0/1713578312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f674c15fd30 0x7f674c072f70 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f673400cac0 tx=0x7f673400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:40.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.345+0000 7f6742000640 1 -- 172.21.15.144:0/1713578312 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734017070 con 0x7f674c15fd30 2024-09-11T23:25:40.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.345+0000 7f6742000640 1 -- 172.21.15.144:0/1713578312 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6734005d00 con 0x7f674c15fd30 2024-09-11T23:25:40.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.345+0000 7f6742000640 1 -- 172.21.15.144:0/1713578312 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67340072b0 con 0x7f674c15fd30 2024-09-11T23:25:40.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.345+0000 7f6751000640 1 -- 172.21.15.144:0/1713578312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f674c073b30 con 0x7f674c15fd30 2024-09-11T23:25:40.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.345+0000 7f6751000640 1 -- 172.21.15.144:0/1713578312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f674c0740f0 con 0x7f674c15fd30 2024-09-11T23:25:40.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.346+0000 7f6751000640 1 -- 172.21.15.144:0/1713578312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f674c0b4610 con 0x7f674c15fd30 2024-09-11T23:25:40.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.347+0000 7f6742000640 1 -- 172.21.15.144:0/1713578312 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f673401a070 con 0x7f674c15fd30 2024-09-11T23:25:40.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.348+0000 7f6742000640 1 --2- 172.21.15.144:0/1713578312 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f672806c640 0x7f672806eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:40.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.348+0000 7f6742000640 1 -- 172.21.15.144:0/1713578312 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f673408b830 con 0x7f674c15fd30 2024-09-11T23:25:40.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.349+0000 7f6749e00640 1 --2- 172.21.15.144:0/1713578312 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f672806c640 0x7f672806eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:40.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.349+0000 7f6749e00640 1 --2- 172.21.15.144:0/1713578312 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f672806c640 0x7f672806eb00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f673c034000 tx=0x7f673c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:40.351 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.352+0000 7f6742000640 1 -- 172.21.15.144:0/1713578312 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f674c1625f0 con 0x7f674c15fd30 2024-09-11T23:25:40.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.561+0000 7f6751000640 1 -- 172.21.15.144:0/1713578312 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f674c0b3ea0 con 0x7f674c15fd30 2024-09-11T23:25:40.561 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-11T23:25:40.562+0000 7f86fcc00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:25:40.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.564+0000 7f6742000640 1 -- 172.21.15.144:0/1713578312 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v102) ==== 161+0+0 (secure 0 0 0) 0x7f6734058ae0 con 0x7f674c15fd30 2024-09-11T23:25:40.564 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:25:40.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.566+0000 7f6751000640 1 -- 172.21.15.144:0/1713578312 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f672806c640 msgr2=0x7f672806eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:40.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.566+0000 7f6751000640 1 --2- 172.21.15.144:0/1713578312 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f672806c640 0x7f672806eb00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f673c034000 tx=0x7f673c02e000 comp rx=0 tx=0).stop 2024-09-11T23:25:40.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.566+0000 7f6751000640 1 -- 172.21.15.144:0/1713578312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f674c15fd30 msgr2=0x7f674c072f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:40.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.566+0000 7f6751000640 1 --2- 172.21.15.144:0/1713578312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f674c15fd30 0x7f674c072f70 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f673400cac0 tx=0x7f673400cf80 comp rx=0 tx=0).stop 2024-09-11T23:25:40.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.567+0000 7f6751000640 1 -- 172.21.15.144:0/1713578312 shutdown_connections 2024-09-11T23:25:40.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.567+0000 7f6751000640 1 --2- 172.21.15.144:0/1713578312 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f672806c640 0x7f672806eb00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:40.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.567+0000 7f6751000640 1 --2- 172.21.15.144:0/1713578312 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f674c1f75a0 0x7f674c15a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:40.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.567+0000 7f6751000640 1 --2- 172.21.15.144:0/1713578312 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f674c15fd30 0x7f674c072f70 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:40.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.567+0000 7f6751000640 1 --2- 172.21.15.144:0/1713578312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f674c0b4930 0x7f674c070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:40.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.567+0000 7f6751000640 1 -- 172.21.15.144:0/1713578312 >> 172.21.15.144:0/1713578312 conn(0x7f674c062cc0 msgr2=0x7f674c0cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:40.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.567+0000 7f6751000640 1 -- 172.21.15.144:0/1713578312 shutdown_connections 2024-09-11T23:25:40.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.567+0000 7f6751000640 1 -- 172.21.15.144:0/1713578312 wait complete. 2024-09-11T23:25:40.584 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:25:40.631 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-11T23:25:40.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.743+0000 7f98afe00640 1 Processor -- start 2024-09-11T23:25:40.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.743+0000 7f98afe00640 1 -- start start 2024-09-11T23:25:40.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.745+0000 7f98afe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98b00cc6e0 0x7f98b00cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:40.744 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.745+0000 7f98afe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98b00cdea0 con 0x7f98b006bba0 2024-09-11T23:25:40.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.745+0000 7f98afe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98b00ce180 con 0x7f98b0070eb0 2024-09-11T23:25:40.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.745+0000 7f98afe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f98b00ce460 con 0x7f98b00cc6e0 2024-09-11T23:25:40.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.745+0000 7f98aea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f98b006bba0 0x7f98b006bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56004/0 (socket says 172.21.15.144:56004) 2024-09-11T23:25:40.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.745+0000 7f98aea00640 1 -- 172.21.15.144:0/3016666565 learned_addr learned my addr 172.21.15.144:0/3016666565 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.745+0000 7f98a6000640 1 --2- 172.21.15.144:0/3016666565 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98b00cc6e0 0x7f98b00cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.745+0000 7f98ae000640 1 -- 172.21.15.144:0/3016666565 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1964560703 0 0) 0x7f98b00cdea0 con 0x7f98b006bba0 2024-09-11T23:25:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.745+0000 7f98ae000640 1 -- 172.21.15.144:0/3016666565 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9894003520 con 0x7f98b006bba0 2024-09-11T23:25:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.746+0000 7f98ae000640 1 -- 172.21.15.144:0/3016666565 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1321245734 0 0) 0x7f98b00ce180 con 0x7f98b0070eb0 2024-09-11T23:25:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.746+0000 7f98ae000640 1 -- 172.21.15.144:0/3016666565 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98b00cdea0 con 0x7f98b0070eb0 2024-09-11T23:25:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.746+0000 7f98a6000640 1 -- 172.21.15.144:0/3016666565 >> v1:172.21.15.165:6789/0 conn(0x7f98b0070eb0 legacy=0x7f98b0071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.746+0000 7f98a6000640 1 -- 172.21.15.144:0/3016666565 >> v1:172.21.15.144:6789/0 conn(0x7f98b006bba0 legacy=0x7f98b006bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.746+0000 7f98ae000640 1 -- 172.21.15.144:0/3016666565 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 98590485 0 0) 0x7f9894003520 con 0x7f98b006bba0 2024-09-11T23:25:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.746+0000 7f98a6000640 1 -- 172.21.15.144:0/3016666565 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b00ce740 con 0x7f98b00cc6e0 2024-09-11T23:25:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.747+0000 7f98a6000640 1 --2- 172.21.15.144:0/3016666565 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98b00cc6e0 0x7f98b00cd570 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f98980097d0 tx=0x7f989802a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7026a86c338fb00 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.747+0000 7f98ae000640 1 -- 172.21.15.144:0/3016666565 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9898037070 con 0x7f98b00cc6e0 2024-09-11T23:25:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.747+0000 7f98ae000640 1 -- 172.21.15.144:0/3016666565 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f989802acc0 con 0x7f98b00cc6e0 2024-09-11T23:25:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.747+0000 7f98ae000640 1 -- 172.21.15.144:0/3016666565 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a0001670 con 0x7f98b00cc6e0 2024-09-11T23:25:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.747+0000 7f98afe00640 1 -- 172.21.15.144:0/3016666565 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98b00cc6e0 msgr2=0x7f98b00cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.747+0000 7f98afe00640 1 --2- 172.21.15.144:0/3016666565 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98b00cc6e0 0x7f98b00cd570 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f98980097d0 tx=0x7f989802a230 comp rx=0 tx=0).stop 2024-09-11T23:25:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.747+0000 7f98afe00640 1 -- 172.21.15.144:0/3016666565 shutdown_connections 2024-09-11T23:25:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.747+0000 7f98afe00640 1 --2- 172.21.15.144:0/3016666565 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98b00cc6e0 0x7f98b00cd570 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.747+0000 7f98afe00640 1 -- 172.21.15.144:0/3016666565 >> 172.21.15.144:0/3016666565 conn(0x7f98b00d0300 msgr2=0x7f98b00d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.748+0000 7f98afe00640 1 -- 172.21.15.144:0/3016666565 shutdown_connections 2024-09-11T23:25:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.748+0000 7f98afe00640 1 -- 172.21.15.144:0/3016666565 wait complete. 2024-09-11T23:25:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.749+0000 7f98afe00640 1 Processor -- start 2024-09-11T23:25:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.749+0000 7f98afe00640 1 -- start start 2024-09-11T23:25:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.750+0000 7f98afe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98b006bba0 0x7f98b0145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.750+0000 7f98afe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98b0070eb0 0x7f98b015d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.750+0000 7f98afe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98b00cc6e0 0x7f98b015c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.750+0000 7f98afe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f98b00cdc30 con 0x7f98b00cc6e0 2024-09-11T23:25:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.750+0000 7f98afe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f98b00cdab0 con 0x7f98b006bba0 2024-09-11T23:25:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.750+0000 7f98afe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f98b015b410 con 0x7f98b0070eb0 2024-09-11T23:25:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.750+0000 7f98af400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98b00cc6e0 0x7f98b015c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.750+0000 7f98af400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98b00cc6e0 0x7f98b015c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54078/0 (socket says 172.21.15.144:54078) 2024-09-11T23:25:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.750+0000 7f98af400640 1 -- 172.21.15.144:0/3296372753 learned_addr learned my addr 172.21.15.144:0/3296372753 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.751+0000 7f98aea00640 1 --2- 172.21.15.144:0/3296372753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98b006bba0 0x7f98b0145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.751+0000 7f98a6000640 1 --2- 172.21.15.144:0/3296372753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98b0070eb0 0x7f98b015d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.751+0000 7f98af400640 1 -- 172.21.15.144:0/3296372753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98b0070eb0 msgr2=0x7f98b015d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.751+0000 7f98af400640 1 --2- 172.21.15.144:0/3296372753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98b0070eb0 0x7f98b015d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.751+0000 7f98af400640 1 -- 172.21.15.144:0/3296372753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98b006bba0 msgr2=0x7f98b0145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.751+0000 7f98af400640 1 --2- 172.21.15.144:0/3296372753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98b006bba0 0x7f98b0145ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.751+0000 7f98af400640 1 -- 172.21.15.144:0/3296372753 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b015df70 con 0x7f98b00cc6e0 2024-09-11T23:25:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.751+0000 7f98af400640 1 --2- 172.21.15.144:0/3296372753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98b00cc6e0 0x7f98b015c490 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f98a800c790 tx=0x7f98a800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:40.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.751+0000 7f98a7400640 1 -- 172.21.15.144:0/3296372753 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a8003b70 con 0x7f98b00cc6e0 2024-09-11T23:25:40.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.751+0000 7f98a7400640 1 -- 172.21.15.144:0/3296372753 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a8003d10 con 0x7f98b00cc6e0 2024-09-11T23:25:40.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.751+0000 7f98afe00640 1 -- 172.21.15.144:0/3296372753 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98b015b9b0 con 0x7f98b00cc6e0 2024-09-11T23:25:40.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.751+0000 7f98a7400640 1 -- 172.21.15.144:0/3296372753 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a800aa50 con 0x7f98b00cc6e0 2024-09-11T23:25:40.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.751+0000 7f98afe00640 1 -- 172.21.15.144:0/3296372753 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98b01507c0 con 0x7f98b00cc6e0 2024-09-11T23:25:40.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.752+0000 7f98afe00640 1 -- 172.21.15.144:0/3296372753 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98b00cd570 con 0x7f98b00cc6e0 2024-09-11T23:25:40.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.753+0000 7f98a7400640 1 -- 172.21.15.144:0/3296372753 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f98a800abf0 con 0x7f98b00cc6e0 2024-09-11T23:25:40.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.754+0000 7f98a7400640 1 --2- 172.21.15.144:0/3296372753 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f988c06c610 0x7f988c06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:40.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.754+0000 7f98a7400640 1 -- 172.21.15.144:0/3296372753 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5795+0+0 (secure 0 0 0) 0x7f98a808bfd0 con 0x7f98b00cc6e0 2024-09-11T23:25:40.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.755+0000 7f98aea00640 1 --2- 172.21.15.144:0/3296372753 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f988c06c610 0x7f988c06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:40.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.756+0000 7f98aea00640 1 --2- 172.21.15.144:0/3296372753 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f988c06c610 0x7f988c06ead0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f98a0001eb0 tx=0x7f98a00016d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:40.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.759+0000 7f98a7400640 1 -- 172.21.15.144:0/3296372753 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f98a8059340 con 0x7f98b00cc6e0 2024-09-11T23:25:40.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:40.971+0000 7f98afe00640 1 -- 172.21.15.144:0/3296372753 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f98b0074250 con 0x7f98b00cc6e0 2024-09-11T23:25:41.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.570+0000 7f98a7400640 1 -- 172.21.15.144:0/3296372753 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v103) ==== 104+0+0 (secure 0 0 0) 0x7f98a805d640 con 0x7f98b00cc6e0 2024-09-11T23:25:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.573+0000 7f98afe00640 1 -- 172.21.15.144:0/3296372753 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f988c06c610 msgr2=0x7f988c06ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.573+0000 7f98afe00640 1 --2- 172.21.15.144:0/3296372753 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f988c06c610 0x7f988c06ead0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f98a0001eb0 tx=0x7f98a00016d0 comp rx=0 tx=0).stop 2024-09-11T23:25:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.573+0000 7f98afe00640 1 -- 172.21.15.144:0/3296372753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98b00cc6e0 msgr2=0x7f98b015c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.573+0000 7f98afe00640 1 --2- 172.21.15.144:0/3296372753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98b00cc6e0 0x7f98b015c490 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f98a800c790 tx=0x7f98a800cc50 comp rx=0 tx=0).stop 2024-09-11T23:25:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.573+0000 7f98afe00640 1 -- 172.21.15.144:0/3296372753 shutdown_connections 2024-09-11T23:25:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.573+0000 7f98afe00640 1 --2- 172.21.15.144:0/3296372753 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f988c06c610 0x7f988c06ead0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.573+0000 7f98afe00640 1 --2- 172.21.15.144:0/3296372753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98b00cc6e0 0x7f98b015c490 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:41.573 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.573+0000 7f98afe00640 1 --2- 172.21.15.144:0/3296372753 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f98b0070eb0 0x7f98b015d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:41.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.573+0000 7f98afe00640 1 --2- 172.21.15.144:0/3296372753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98b006bba0 0x7f98b0145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:41.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.573+0000 7f98afe00640 1 -- 172.21.15.144:0/3296372753 >> 172.21.15.144:0/3296372753 conn(0x7f98b00d0300 msgr2=0x7f98b015a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:41.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.573+0000 7f98afe00640 1 -- 172.21.15.144:0/3296372753 shutdown_connections 2024-09-11T23:25:41.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.573+0000 7f98afe00640 1 -- 172.21.15.144:0/3296372753 wait complete. 2024-09-11T23:25:41.591 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:25:41.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.751+0000 7fafd4e00640 1 Processor -- start 2024-09-11T23:25:41.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.751+0000 7fafd4e00640 1 -- start start 2024-09-11T23:25:41.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.752+0000 7fafd4e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafd015ea00 0x7fafd00b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:41.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.752+0000 7fafd4e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fafd00b3970 0x7fafd00b6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:41.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.752+0000 7fafd4e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd00cf860 con 0x7fafd00b3420 2024-09-11T23:25:41.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.752+0000 7fafd4e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fafd015ede0 con 0x7fafd00b3970 2024-09-11T23:25:41.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.752+0000 7fafd4e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fafd00d0100 con 0x7fafd015ea00 2024-09-11T23:25:41.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.752+0000 7fafcd400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fafd00b3970 0x7fafd00b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:41.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.752+0000 7fafcd400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fafd00b3970 0x7fafd00b6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54094/0 (socket says 172.21.15.144:54094) 2024-09-11T23:25:41.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.752+0000 7fafcd400640 1 -- 172.21.15.144:0/3504284759 learned_addr learned my addr 172.21.15.144:0/3504284759 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:41.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.753+0000 7fafcde00640 1 --2- 172.21.15.144:0/3504284759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafd015ea00 0x7fafd00b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:41.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.753+0000 7fafcd400640 1 -- 172.21.15.144:0/3504284759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafd015ea00 msgr2=0x7fafd00b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:41.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.753+0000 7fafcd400640 1 --2- 172.21.15.144:0/3504284759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafd015ea00 0x7fafd00b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:41.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.753+0000 7fafcd400640 1 -- 172.21.15.144:0/3504284759 >> v1:172.21.15.165:6789/0 conn(0x7fafd00b3420 legacy=0x7fafd0162460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:41.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.753+0000 7fafcd400640 1 -- 172.21.15.144:0/3504284759 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd00cfb40 con 0x7fafd00b3970 2024-09-11T23:25:41.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.753+0000 7fafcde00640 1 --2- 172.21.15.144:0/3504284759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafd015ea00 0x7fafd00b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:41.754 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.754+0000 7fafcd400640 1 --2- 172.21.15.144:0/3504284759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd00b3970 0x7fafd00b6720 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009870 tx=0x7fafbc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d42a5674ffe131 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:41.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.754+0000 7fafcca00640 1 -- 172.21.15.144:0/3504284759 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafbc037070 con 0x7fafd00b3970 2024-09-11T23:25:41.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.754+0000 7fafcca00640 1 -- 172.21.15.144:0/3504284759 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafbc032440 con 0x7fafd00b3970 2024-09-11T23:25:41.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.754+0000 7fafcca00640 1 -- 172.21.15.144:0/3504284759 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafbc032810 con 0x7fafd00b3970 2024-09-11T23:25:41.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.755+0000 7fafd4e00640 1 -- 172.21.15.144:0/3504284759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd00b3970 msgr2=0x7fafd00b6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:41.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.755+0000 7fafd4e00640 1 --2- 172.21.15.144:0/3504284759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd00b3970 0x7fafd00b6720 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009870 tx=0x7fafbc02a210 comp rx=0 tx=0).stop 2024-09-11T23:25:41.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.755+0000 7fafd4e00640 1 -- 172.21.15.144:0/3504284759 shutdown_connections 2024-09-11T23:25:41.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.755+0000 7fafd4e00640 1 --2- 172.21.15.144:0/3504284759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd00b3970 0x7fafd00b6720 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:41.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.755+0000 7fafd4e00640 1 --2- 172.21.15.144:0/3504284759 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafd015ea00 0x7fafd00b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:41.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.755+0000 7fafd4e00640 1 -- 172.21.15.144:0/3504284759 >> 172.21.15.144:0/3504284759 conn(0x7fafd00d11e0 msgr2=0x7fafd00d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:41.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.755+0000 7fafd4e00640 1 -- 172.21.15.144:0/3504284759 shutdown_connections 2024-09-11T23:25:41.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.755+0000 7fafd4e00640 1 -- 172.21.15.144:0/3504284759 wait complete. 2024-09-11T23:25:41.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.756+0000 7fafd4e00640 1 Processor -- start 2024-09-11T23:25:41.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.756+0000 7fafd4e00640 1 -- start start 2024-09-11T23:25:41.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.757+0000 7fafd4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd00b3420 0x7fafd0158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:41.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.757+0000 7fafd4e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafd00b3970 0x7fafd0156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:41.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.757+0000 7fafd4e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafd015ea00 0x7fafd00c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:41.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.757+0000 7fafd4e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fafd00d1f00 con 0x7fafd00b3420 2024-09-11T23:25:41.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.757+0000 7fafd4e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fafd00d24b0 con 0x7fafd015ea00 2024-09-11T23:25:41.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.757+0000 7fafd4e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fafd00d39e0 con 0x7fafd00b3970 2024-09-11T23:25:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.758+0000 7fafcde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd00b3420 0x7fafd0158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.758+0000 7fafcde00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd00b3420 0x7fafd0158670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54108/0 (socket says 172.21.15.144:54108) 2024-09-11T23:25:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.758+0000 7fafcde00640 1 -- 172.21.15.144:0/639004358 learned_addr learned my addr 172.21.15.144:0/639004358 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.758+0000 7fafcd400640 1 --2- 172.21.15.144:0/639004358 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafd00b3970 0x7fafd0156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.758+0000 7fafce800640 1 --2- 172.21.15.144:0/639004358 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafd015ea00 0x7fafd00c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.758+0000 7fafcde00640 1 -- 172.21.15.144:0/639004358 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafd00b3970 msgr2=0x7fafd0156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.758+0000 7fafcde00640 1 --2- 172.21.15.144:0/639004358 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafd00b3970 0x7fafd0156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.758+0000 7fafcde00640 1 -- 172.21.15.144:0/639004358 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafd015ea00 msgr2=0x7fafd00c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.758+0000 7fafcde00640 1 --2- 172.21.15.144:0/639004358 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafd015ea00 0x7fafd00c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.758+0000 7fafcde00640 1 -- 172.21.15.144:0/639004358 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd00c94d0 con 0x7fafd00b3420 2024-09-11T23:25:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.758+0000 7fafcde00640 1 --2- 172.21.15.144:0/639004358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd00b3420 0x7fafd0158670 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fafc000c7f0 tx=0x7fafc000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.758+0000 7fafc6000640 1 -- 172.21.15.144:0/639004358 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0015070 con 0x7fafd00b3420 2024-09-11T23:25:41.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.758+0000 7fafc6000640 1 -- 172.21.15.144:0/639004358 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc0007820 con 0x7fafd00b3420 2024-09-11T23:25:41.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.758+0000 7fafc6000640 1 -- 172.21.15.144:0/639004358 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0007bd0 con 0x7fafd00b3420 2024-09-11T23:25:41.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.759+0000 7fafd4e00640 1 -- 172.21.15.144:0/639004358 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd00cb960 con 0x7fafd00b3420 2024-09-11T23:25:41.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.759+0000 7fafd4e00640 1 -- 172.21.15.144:0/639004358 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd00c9190 con 0x7fafd00b3420 2024-09-11T23:25:41.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.760+0000 7fafd4e00640 1 -- 172.21.15.144:0/639004358 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd00b61e0 con 0x7fafd00b3420 2024-09-11T23:25:41.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.760+0000 7fafc6000640 1 -- 172.21.15.144:0/639004358 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7fafc0018070 con 0x7fafd00b3420 2024-09-11T23:25:41.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.762+0000 7fafc6000640 1 --2- 172.21.15.144:0/639004358 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fafb006c610 0x7fafb006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:41.761 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.762+0000 7fafc6000640 1 -- 172.21.15.144:0/639004358 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5795+0+0 (secure 0 0 0) 0x7fafc008c390 con 0x7fafd00b3420 2024-09-11T23:25:41.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.762+0000 7fafcd400640 1 --2- 172.21.15.144:0/639004358 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fafb006c610 0x7fafb006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:41.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.763+0000 7fafcd400640 1 --2- 172.21.15.144:0/639004358 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fafb006c610 0x7fafb006ead0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fafbc034000 tx=0x7fafbc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:41.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.766+0000 7fafc6000640 1 -- 172.21.15.144:0/639004358 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fafc0059c40 con 0x7fafd00b3420 2024-09-11T23:25:41.941 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:41.941+0000 7fafd4e00640 1 -- 172.21.15.144:0/639004358 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fafd00ba470 con 0x7fafd00b3420 2024-09-11T23:25:42.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:42.821+0000 7fafc6000640 1 -- 172.21.15.144:0/639004358 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v144) ==== 181+0+0 (secure 0 0 0) 0x7fafc0059540 con 0x7fafd00b3420 2024-09-11T23:25:42.821 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:25:42.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:42.825+0000 7fafd4e00640 1 -- 172.21.15.144:0/639004358 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fafb006c610 msgr2=0x7fafb006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:42.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:42.825+0000 7fafd4e00640 1 --2- 172.21.15.144:0/639004358 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fafb006c610 0x7fafb006ead0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fafbc034000 tx=0x7fafbc02e000 comp rx=0 tx=0).stop 2024-09-11T23:25:42.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:42.825+0000 7fafd4e00640 1 -- 172.21.15.144:0/639004358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd00b3420 msgr2=0x7fafd0158670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:42.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:42.825+0000 7fafd4e00640 1 --2- 172.21.15.144:0/639004358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd00b3420 0x7fafd0158670 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fafc000c7f0 tx=0x7fafc000ccb0 comp rx=0 tx=0).stop 2024-09-11T23:25:42.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:42.825+0000 7fafd4e00640 1 -- 172.21.15.144:0/639004358 shutdown_connections 2024-09-11T23:25:42.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:42.825+0000 7fafd4e00640 1 --2- 172.21.15.144:0/639004358 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fafb006c610 0x7fafb006ead0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:42.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:42.825+0000 7fafd4e00640 1 --2- 172.21.15.144:0/639004358 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafd015ea00 0x7fafd00c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:42.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:42.825+0000 7fafd4e00640 1 --2- 172.21.15.144:0/639004358 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fafd00b3970 0x7fafd0156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:42.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:42.825+0000 7fafd4e00640 1 --2- 172.21.15.144:0/639004358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd00b3420 0x7fafd0158670 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:42.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:42.825+0000 7fafd4e00640 1 -- 172.21.15.144:0/639004358 >> 172.21.15.144:0/639004358 conn(0x7fafd00d11e0 msgr2=0x7fafd00b83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:42.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:42.825+0000 7fafd4e00640 1 -- 172.21.15.144:0/639004358 shutdown_connections 2024-09-11T23:25:42.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:42.825+0000 7fafd4e00640 1 -- 172.21.15.144:0/639004358 wait complete. 2024-09-11T23:25:42.845 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:25:43.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.007+0000 7fd236400640 1 Processor -- start 2024-09-11T23:25:43.007 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.007+0000 7fd236400640 1 -- start start 2024-09-11T23:25:43.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.008+0000 7fd236400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd23015e650 0x7fd2300cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:43.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.008+0000 7fd236400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2300d3890 con 0x7fd23006dd20 2024-09-11T23:25:43.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.008+0000 7fd236400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2300d3b70 con 0x7fd2300d32d0 2024-09-11T23:25:43.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.008+0000 7fd236400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd23015ea30 con 0x7fd23015e650 2024-09-11T23:25:43.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.008+0000 7fd235a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd23006dd20 0x7fd2300b7cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56014/0 (socket says 172.21.15.144:56014) 2024-09-11T23:25:43.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.008+0000 7fd235a00640 1 -- 172.21.15.144:0/2027349795 learned_addr learned my addr 172.21.15.144:0/2027349795 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:43.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.009+0000 7fd235000640 1 --2- 172.21.15.144:0/2027349795 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd23015e650 0x7fd2300cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:43.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.009+0000 7fd22f400640 1 -- 172.21.15.144:0/2027349795 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2576984177 0 0) 0x7fd2300d3890 con 0x7fd23006dd20 2024-09-11T23:25:43.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.009+0000 7fd22f400640 1 -- 172.21.15.144:0/2027349795 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd218003520 con 0x7fd23006dd20 2024-09-11T23:25:43.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.009+0000 7fd22f400640 1 -- 172.21.15.144:0/2027349795 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 435550867 0 0) 0x7fd2300d3b70 con 0x7fd2300d32d0 2024-09-11T23:25:43.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.009+0000 7fd22f400640 1 -- 172.21.15.144:0/2027349795 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2300d3890 con 0x7fd2300d32d0 2024-09-11T23:25:43.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.009+0000 7fd235000640 1 -- 172.21.15.144:0/2027349795 >> v1:172.21.15.165:6789/0 conn(0x7fd2300d32d0 legacy=0x7fd23006d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:43.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.009+0000 7fd235000640 1 -- 172.21.15.144:0/2027349795 >> v1:172.21.15.144:6789/0 conn(0x7fd23006dd20 legacy=0x7fd2300b7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:43.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.009+0000 7fd235000640 1 -- 172.21.15.144:0/2027349795 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2300d3e50 con 0x7fd23015e650 2024-09-11T23:25:43.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.010+0000 7fd235000640 1 --2- 172.21.15.144:0/2027349795 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd23015e650 0x7fd2300cf6d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd2240097d0 tx=0x7fd22402a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a4e4317a6f716c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:43.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.010+0000 7fd22f400640 1 -- 172.21.15.144:0/2027349795 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd224037070 con 0x7fd23015e650 2024-09-11T23:25:43.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.010+0000 7fd22f400640 1 -- 172.21.15.144:0/2027349795 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd224032440 con 0x7fd23015e650 2024-09-11T23:25:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.010+0000 7fd22f400640 1 -- 172.21.15.144:0/2027349795 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2240327f0 con 0x7fd23015e650 2024-09-11T23:25:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.011+0000 7fd236400640 1 -- 172.21.15.144:0/2027349795 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd23015e650 msgr2=0x7fd2300cf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.011+0000 7fd236400640 1 --2- 172.21.15.144:0/2027349795 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd23015e650 0x7fd2300cf6d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd2240097d0 tx=0x7fd22402a2a0 comp rx=0 tx=0).stop 2024-09-11T23:25:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.011+0000 7fd236400640 1 -- 172.21.15.144:0/2027349795 shutdown_connections 2024-09-11T23:25:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.011+0000 7fd236400640 1 --2- 172.21.15.144:0/2027349795 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd23015e650 0x7fd2300cf6d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:43.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.011+0000 7fd236400640 1 -- 172.21.15.144:0/2027349795 >> 172.21.15.144:0/2027349795 conn(0x7fd2300d4740 msgr2=0x7fd2300d4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:43.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.011+0000 7fd236400640 1 -- 172.21.15.144:0/2027349795 shutdown_connections 2024-09-11T23:25:43.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.011+0000 7fd236400640 1 -- 172.21.15.144:0/2027349795 wait complete. 2024-09-11T23:25:43.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.013+0000 7fd236400640 1 Processor -- start 2024-09-11T23:25:43.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.013+0000 7fd236400640 1 -- start start 2024-09-11T23:25:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.014+0000 7fd236400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd23006dd20 0x7fd23015a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.014+0000 7fd236400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2300d32d0 0x7fd2301573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.014+0000 7fd236400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd23015e650 0x7fd2300b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.014+0000 7fd236400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd2300cfd90 con 0x7fd23006dd20 2024-09-11T23:25:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.014+0000 7fd236400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd2300cfc10 con 0x7fd2300d32d0 2024-09-11T23:25:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.014+0000 7fd236400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd2300b7690 con 0x7fd23015e650 2024-09-11T23:25:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.014+0000 7fd235000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd23006dd20 0x7fd23015a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.014+0000 7fd235000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd23006dd20 0x7fd23015a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54116/0 (socket says 172.21.15.144:54116) 2024-09-11T23:25:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.014+0000 7fd235000640 1 -- 172.21.15.144:0/3166539919 learned_addr learned my addr 172.21.15.144:0/3166539919 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.014+0000 7fd235000640 1 -- 172.21.15.144:0/3166539919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd23015e650 msgr2=0x7fd2300b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.014+0000 7fd235000640 1 --2- 172.21.15.144:0/3166539919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd23015e650 0x7fd2300b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:43.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.014+0000 7fd22fe00640 1 --2- 172.21.15.144:0/3166539919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2300d32d0 0x7fd2301573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:43.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.014+0000 7fd235000640 1 -- 172.21.15.144:0/3166539919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2300d32d0 msgr2=0x7fd2301573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:43.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.014+0000 7fd235000640 1 --2- 172.21.15.144:0/3166539919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2300d32d0 0x7fd2301573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:43.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.014+0000 7fd235000640 1 -- 172.21.15.144:0/3166539919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2301f75b0 con 0x7fd23006dd20 2024-09-11T23:25:43.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.014+0000 7fd22fe00640 1 --2- 172.21.15.144:0/3166539919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2300d32d0 0x7fd2301573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:43.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.015+0000 7fd235000640 1 --2- 172.21.15.144:0/3166539919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd23006dd20 0x7fd23015a2f0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fd224000c00 tx=0x7fd2240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:43.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.015+0000 7fd22cc00640 1 -- 172.21.15.144:0/3166539919 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd224037040 con 0x7fd23006dd20 2024-09-11T23:25:43.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.015+0000 7fd22cc00640 1 -- 172.21.15.144:0/3166539919 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd224042070 con 0x7fd23006dd20 2024-09-11T23:25:43.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.015+0000 7fd22cc00640 1 -- 172.21.15.144:0/3166539919 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22403d880 con 0x7fd23006dd20 2024-09-11T23:25:43.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.015+0000 7fd236400640 1 -- 172.21.15.144:0/3166539919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd23015a830 con 0x7fd23006dd20 2024-09-11T23:25:43.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.015+0000 7fd236400640 1 -- 172.21.15.144:0/3166539919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2301f7b00 con 0x7fd23006dd20 2024-09-11T23:25:43.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.016+0000 7fd236400640 1 -- 172.21.15.144:0/3166539919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2300cf6d0 con 0x7fd23006dd20 2024-09-11T23:25:43.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.017+0000 7fd22cc00640 1 -- 172.21.15.144:0/3166539919 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7fd22403da20 con 0x7fd23006dd20 2024-09-11T23:25:43.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.018+0000 7fd22cc00640 1 --2- 172.21.15.144:0/3166539919 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd21006c640 0x7fd21006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:43.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.018+0000 7fd22cc00640 1 -- 172.21.15.144:0/3166539919 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5357+0+0 (secure 0 0 0) 0x7fd2240abf70 con 0x7fd23006dd20 2024-09-11T23:25:43.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.018+0000 7fd22fe00640 1 --2- 172.21.15.144:0/3166539919 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd21006c640 0x7fd21006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:43.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.019+0000 7fd22fe00640 1 --2- 172.21.15.144:0/3166539919 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd21006c640 0x7fd21006eb00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd2300b6d30 tx=0x7fd21c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:43.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.022+0000 7fd22cc00640 1 -- 172.21.15.144:0/3166539919 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd22404b020 con 0x7fd23006dd20 2024-09-11T23:25:43.196 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.196+0000 7fd236400640 1 -- 172.21.15.144:0/3166539919 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd2301617e0 con 0x7fd23006dd20 2024-09-11T23:25:43.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.824+0000 7fd22cc00640 1 -- 172.21.15.144:0/3166539919 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v145) ==== 169+0+0 (secure 0 0 0) 0x7fd224079af0 con 0x7fd23006dd20 2024-09-11T23:25:43.823 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-11T23:25:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.826+0000 7fd236400640 1 -- 172.21.15.144:0/3166539919 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd21006c640 msgr2=0x7fd21006eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.826+0000 7fd236400640 1 --2- 172.21.15.144:0/3166539919 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd21006c640 0x7fd21006eb00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd2300b6d30 tx=0x7fd21c009040 comp rx=0 tx=0).stop 2024-09-11T23:25:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.826+0000 7fd236400640 1 -- 172.21.15.144:0/3166539919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd23006dd20 msgr2=0x7fd23015a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.826+0000 7fd236400640 1 --2- 172.21.15.144:0/3166539919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd23006dd20 0x7fd23015a2f0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fd224000c00 tx=0x7fd2240046c0 comp rx=0 tx=0).stop 2024-09-11T23:25:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.826+0000 7fd236400640 1 -- 172.21.15.144:0/3166539919 shutdown_connections 2024-09-11T23:25:43.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.826+0000 7fd236400640 1 --2- 172.21.15.144:0/3166539919 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd21006c640 0x7fd21006eb00 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.826+0000 7fd236400640 1 --2- 172.21.15.144:0/3166539919 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd23015e650 0x7fd2300b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.826+0000 7fd236400640 1 --2- 172.21.15.144:0/3166539919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2300d32d0 0x7fd2301573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.826+0000 7fd236400640 1 --2- 172.21.15.144:0/3166539919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd23006dd20 0x7fd23015a2f0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.826+0000 7fd236400640 1 -- 172.21.15.144:0/3166539919 >> 172.21.15.144:0/3166539919 conn(0x7fd2300d4740 msgr2=0x7fd2300b9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.827+0000 7fd236400640 1 -- 172.21.15.144:0/3166539919 shutdown_connections 2024-09-11T23:25:43.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:43.827+0000 7fd236400640 1 -- 172.21.15.144:0/3166539919 wait complete. 2024-09-11T23:25:43.851 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:25:44.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.016+0000 7f50ea000640 1 Processor -- start 2024-09-11T23:25:44.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.016+0000 7f50ea000640 1 -- start start 2024-09-11T23:25:44.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.018+0000 7f50ea000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f50e415d790 0x7f50e40cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:44.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.018+0000 7f50ea000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e406d700 con 0x7f50e415d3b0 2024-09-11T23:25:44.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.018+0000 7f50ea000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e40cde80 con 0x7f50e40cd3b0 2024-09-11T23:25:44.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.018+0000 7f50ea000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f50e406da30 con 0x7f50e415d790 2024-09-11T23:25:44.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.018+0000 7f50daa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f50e415d790 0x7f50e40cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:44.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.018+0000 7f50e3400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f50e415d3b0 0x7f50e4071080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:56030/0 (socket says 172.21.15.144:56030) 2024-09-11T23:25:44.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.018+0000 7f50daa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f50e415d790 0x7f50e40cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54118/0 (socket says 172.21.15.144:54118) 2024-09-11T23:25:44.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.018+0000 7f50e3400640 1 -- 172.21.15.144:0/3447405700 learned_addr learned my addr 172.21.15.144:0/3447405700 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:44.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.018+0000 7f50daa00640 1 -- 172.21.15.144:0/3447405700 >> v1:172.21.15.165:6789/0 conn(0x7f50e40cd3b0 legacy=0x7f50e40cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:44.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.018+0000 7f50daa00640 1 -- 172.21.15.144:0/3447405700 >> v1:172.21.15.144:6789/0 conn(0x7f50e415d3b0 legacy=0x7f50e4071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:44.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.018+0000 7f50e2a00640 1 -- 172.21.15.144:0/3447405700 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 642375581 0 0) 0x7f50e406d700 con 0x7f50e415d3b0 2024-09-11T23:25:44.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.018+0000 7f50daa00640 1 -- 172.21.15.144:0/3447405700 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e40cd8c0 con 0x7f50e415d790 2024-09-11T23:25:44.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.019+0000 7f50daa00640 1 --2- 172.21.15.144:0/3447405700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e415d790 0x7f50e40cce70 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009790 tx=0x7f50cc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9172674f95f1ec37 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:44.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.020+0000 7f50e2a00640 1 -- 172.21.15.144:0/3447405700 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc037070 con 0x7f50e415d790 2024-09-11T23:25:44.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.020+0000 7f50e2a00640 1 -- 172.21.15.144:0/3447405700 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50cc032440 con 0x7f50e415d790 2024-09-11T23:25:44.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.020+0000 7f50e2a00640 1 -- 172.21.15.144:0/3447405700 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc032810 con 0x7f50e415d790 2024-09-11T23:25:44.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.020+0000 7f50ea000640 1 -- 172.21.15.144:0/3447405700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e415d790 msgr2=0x7f50e40cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:44.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.020+0000 7f50ea000640 1 --2- 172.21.15.144:0/3447405700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e415d790 0x7f50e40cce70 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009790 tx=0x7f50cc02a210 comp rx=0 tx=0).stop 2024-09-11T23:25:44.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.020+0000 7f50ea000640 1 -- 172.21.15.144:0/3447405700 shutdown_connections 2024-09-11T23:25:44.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.020+0000 7f50ea000640 1 --2- 172.21.15.144:0/3447405700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e415d790 0x7f50e40cce70 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:44.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.020+0000 7f50ea000640 1 -- 172.21.15.144:0/3447405700 >> 172.21.15.144:0/3447405700 conn(0x7f50e406bba0 msgr2=0x7f50e406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:44.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.020+0000 7f50ea000640 1 -- 172.21.15.144:0/3447405700 shutdown_connections 2024-09-11T23:25:44.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.020+0000 7f50ea000640 1 -- 172.21.15.144:0/3447405700 wait complete. 2024-09-11T23:25:44.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.022+0000 7f50ea000640 1 Processor -- start 2024-09-11T23:25:44.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.022+0000 7f50ea000640 1 -- start start 2024-09-11T23:25:44.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.023+0000 7f50ea000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50e40cd3b0 0x7f50e4153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:44.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.023+0000 7f50ea000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e415d3b0 0x7f50e41417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:44.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.023+0000 7f50ea000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50e415b470 0x7f50e415b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:44.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.023+0000 7f50ea000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f50e415cd70 con 0x7f50e415d3b0 2024-09-11T23:25:44.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.023+0000 7f50ea000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f50e415cbf0 con 0x7f50e415b470 2024-09-11T23:25:44.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.023+0000 7f50ea000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f50e40cfa30 con 0x7f50e40cd3b0 2024-09-11T23:25:44.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.023+0000 7f50daa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e415d3b0 0x7f50e41417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:44.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.023+0000 7f50daa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e415d3b0 0x7f50e41417e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54124/0 (socket says 172.21.15.144:54124) 2024-09-11T23:25:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.023+0000 7f50daa00640 1 -- 172.21.15.144:0/1926070511 learned_addr learned my addr 172.21.15.144:0/1926070511 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.023+0000 7f50e3e00640 1 --2- 172.21.15.144:0/1926070511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50e415b470 0x7f50e415b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.023+0000 7f50e3400640 1 --2- 172.21.15.144:0/1926070511 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50e40cd3b0 0x7f50e4153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.024+0000 7f50daa00640 1 -- 172.21.15.144:0/1926070511 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50e40cd3b0 msgr2=0x7f50e4153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.024+0000 7f50daa00640 1 --2- 172.21.15.144:0/1926070511 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50e40cd3b0 0x7f50e4153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.024+0000 7f50daa00640 1 -- 172.21.15.144:0/1926070511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50e415b470 msgr2=0x7f50e415b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.024+0000 7f50daa00640 1 --2- 172.21.15.144:0/1926070511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50e415b470 0x7f50e415b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.024+0000 7f50daa00640 1 -- 172.21.15.144:0/1926070511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e41420b0 con 0x7f50e415d3b0 2024-09-11T23:25:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.024+0000 7f50daa00640 1 --2- 172.21.15.144:0/1926070511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e415d3b0 0x7f50e41417e0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f50cc035040 tx=0x7f50cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.024+0000 7f50dbe00640 1 -- 172.21.15.144:0/1926070511 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc041020 con 0x7f50e415d3b0 2024-09-11T23:25:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.024+0000 7f50dbe00640 1 -- 172.21.15.144:0/1926070511 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50cc030990 con 0x7f50e415d3b0 2024-09-11T23:25:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.024+0000 7f50ea000640 1 -- 172.21.15.144:0/1926070511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e4142390 con 0x7f50e415d3b0 2024-09-11T23:25:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.024+0000 7f50dbe00640 1 -- 172.21.15.144:0/1926070511 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc037040 con 0x7f50e415d3b0 2024-09-11T23:25:44.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.024+0000 7f50ea000640 1 -- 172.21.15.144:0/1926070511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e4142950 con 0x7f50e415d3b0 2024-09-11T23:25:44.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.025+0000 7f50ea000640 1 -- 172.21.15.144:0/1926070511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e40b1170 con 0x7f50e415d3b0 2024-09-11T23:25:44.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.026+0000 7f50dbe00640 1 -- 172.21.15.144:0/1926070511 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f50cc044020 con 0x7f50e415d3b0 2024-09-11T23:25:44.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.027+0000 7f50dbe00640 1 --2- 172.21.15.144:0/1926070511 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f50c006c640 0x7f50c006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:44.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.027+0000 7f50dbe00640 1 -- 172.21.15.144:0/1926070511 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f50cc0ac670 con 0x7f50e415d3b0 2024-09-11T23:25:44.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.027+0000 7f50e3400640 1 --2- 172.21.15.144:0/1926070511 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f50c006c640 0x7f50c006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:44.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.028+0000 7f50e3400640 1 --2- 172.21.15.144:0/1926070511 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f50c006c640 0x7f50c006eb00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f50d4007f70 tx=0x7f50d4007f00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:44.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.031+0000 7f50dbe00640 1 -- 172.21.15.144:0/1926070511 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f50cc04b030 con 0x7f50e415d3b0 2024-09-11T23:25:44.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.206+0000 7f50ea000640 1 -- 172.21.15.144:0/1926070511 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f50e40b0e90 con 0x7f50e415d3b0 2024-09-11T23:25:44.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.209+0000 7f50dbe00640 1 -- 172.21.15.144:0/1926070511 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) ==== 104+0+0 (secure 0 0 0) 0x7f50cc032e20 con 0x7f50e415d3b0 2024-09-11T23:25:44.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.212+0000 7f50ea000640 1 -- 172.21.15.144:0/1926070511 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f50c006c640 msgr2=0x7f50c006eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:44.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.212+0000 7f50ea000640 1 --2- 172.21.15.144:0/1926070511 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f50c006c640 0x7f50c006eb00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f50d4007f70 tx=0x7f50d4007f00 comp rx=0 tx=0).stop 2024-09-11T23:25:44.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.212+0000 7f50ea000640 1 -- 172.21.15.144:0/1926070511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e415d3b0 msgr2=0x7f50e41417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:44.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.212+0000 7f50ea000640 1 --2- 172.21.15.144:0/1926070511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e415d3b0 0x7f50e41417e0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f50cc035040 tx=0x7f50cc0046c0 comp rx=0 tx=0).stop 2024-09-11T23:25:44.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.212+0000 7f50ea000640 1 -- 172.21.15.144:0/1926070511 shutdown_connections 2024-09-11T23:25:44.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.212+0000 7f50ea000640 1 --2- 172.21.15.144:0/1926070511 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f50c006c640 0x7f50c006eb00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:44.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.212+0000 7f50ea000640 1 --2- 172.21.15.144:0/1926070511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f50e415b470 0x7f50e415b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:44.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.212+0000 7f50ea000640 1 --2- 172.21.15.144:0/1926070511 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50e415d3b0 0x7f50e41417e0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:44.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.212+0000 7f50ea000640 1 --2- 172.21.15.144:0/1926070511 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f50e40cd3b0 0x7f50e4153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:44.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.212+0000 7f50ea000640 1 -- 172.21.15.144:0/1926070511 >> 172.21.15.144:0/1926070511 conn(0x7f50e406bba0 msgr2=0x7f50e415e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:44.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.212+0000 7f50ea000640 1 -- 172.21.15.144:0/1926070511 shutdown_connections 2024-09-11T23:25:44.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.212+0000 7f50ea000640 1 -- 172.21.15.144:0/1926070511 wait complete. 2024-09-11T23:25:44.227 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1' 2024-09-11T23:25:44.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.381+0000 7feaea600640 1 Processor -- start 2024-09-11T23:25:44.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.381+0000 7feaea600640 1 -- start start 2024-09-11T23:25:44.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.382+0000 7feaea600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feae4162ad0 0x7feae406bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:44.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.382+0000 7feaea600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7feae406c0e0 0x7feae40b0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:44.382 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.382+0000 7feaea600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae40b0380 con 0x7feae415e3f0 2024-09-11T23:25:44.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.382+0000 7feaea600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7feae40b30d0 con 0x7feae406c0e0 2024-09-11T23:25:44.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.382+0000 7feaea600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7feae406c540 con 0x7feae4162ad0 2024-09-11T23:25:44.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.382+0000 7feae3400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7feae415e3f0 0x7feae415e7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43372/0 (socket says 172.21.15.144:43372) 2024-09-11T23:25:44.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.382+0000 7feae3400640 1 -- 172.21.15.144:0/1441677201 learned_addr learned my addr 172.21.15.144:0/1441677201 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:44.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.382+0000 7feae3e00640 1 --2- 172.21.15.144:0/1441677201 >> v2:172.21.15.144:3300/0 conn(0x7feae406c0e0 0x7feae40b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:44.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.383+0000 7feadaa00640 1 --2- 172.21.15.144:0/1441677201 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feae4162ad0 0x7feae406bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:44.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.383+0000 7feae2a00640 1 -- 172.21.15.144:0/1441677201 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2277991137 0 0) 0x7feae40b0380 con 0x7feae415e3f0 2024-09-11T23:25:44.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.383+0000 7feae2a00640 1 -- 172.21.15.144:0/1441677201 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feac8003520 con 0x7feae415e3f0 2024-09-11T23:25:44.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.383+0000 7feae3e00640 1 -- 172.21.15.144:0/1441677201 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feae4162ad0 msgr2=0x7feae406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:44.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.383+0000 7feae3e00640 1 --2- 172.21.15.144:0/1441677201 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feae4162ad0 0x7feae406bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:44.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.383+0000 7feae3e00640 1 -- 172.21.15.144:0/1441677201 >> v1:172.21.15.144:6789/0 conn(0x7feae415e3f0 legacy=0x7feae415e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:44.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.383+0000 7feae3e00640 1 -- 172.21.15.144:0/1441677201 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae415f0e0 con 0x7feae406c0e0 2024-09-11T23:25:44.383 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.383+0000 7feadaa00640 1 --2- 172.21.15.144:0/1441677201 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feae4162ad0 0x7feae406bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:44.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.384+0000 7feae3e00640 1 --2- 172.21.15.144:0/1441677201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feae406c0e0 0x7feae40b0830 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7feadc009d90 tx=0x7feadc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731b0da81dd0a8e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:44.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.384+0000 7feae2a00640 1 -- 172.21.15.144:0/1441677201 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc007740 con 0x7feae406c0e0 2024-09-11T23:25:44.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.384+0000 7feae2a00640 1 -- 172.21.15.144:0/1441677201 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feadc0078e0 con 0x7feae406c0e0 2024-09-11T23:25:44.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.384+0000 7feae2a00640 1 -- 172.21.15.144:0/1441677201 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc007c90 con 0x7feae406c0e0 2024-09-11T23:25:44.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.384+0000 7feaea600640 1 -- 172.21.15.144:0/1441677201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feae406c0e0 msgr2=0x7feae40b0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:44.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.385+0000 7feaea600640 1 --2- 172.21.15.144:0/1441677201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feae406c0e0 0x7feae40b0830 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7feadc009d90 tx=0x7feadc02a660 comp rx=0 tx=0).stop 2024-09-11T23:25:44.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.385+0000 7feaea600640 1 -- 172.21.15.144:0/1441677201 shutdown_connections 2024-09-11T23:25:44.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.385+0000 7feaea600640 1 --2- 172.21.15.144:0/1441677201 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feae406c0e0 0x7feae40b0830 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:44.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.385+0000 7feaea600640 1 --2- 172.21.15.144:0/1441677201 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feae4162ad0 0x7feae406bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:44.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.385+0000 7feaea600640 1 -- 172.21.15.144:0/1441677201 >> 172.21.15.144:0/1441677201 conn(0x7feae406ce90 msgr2=0x7feae406d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:44.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.385+0000 7feaea600640 1 -- 172.21.15.144:0/1441677201 shutdown_connections 2024-09-11T23:25:44.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.385+0000 7feaea600640 1 -- 172.21.15.144:0/1441677201 wait complete. 2024-09-11T23:25:44.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.386+0000 7feaea600640 1 Processor -- start 2024-09-11T23:25:44.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.386+0000 7feaea600640 1 -- start start 2024-09-11T23:25:44.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.387+0000 7feaea600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feae406c0e0 0x7feae414afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:44.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.387+0000 7feaea600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feae415e3f0 0x7feae414ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:44.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.387+0000 7feaea600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feae4162ad0 0x7feae40d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:44.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.387+0000 7feaea600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feae4162f40 con 0x7feae406c0e0 2024-09-11T23:25:44.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.387+0000 7feaea600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feae415f6a0 con 0x7feae4162ad0 2024-09-11T23:25:44.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.387+0000 7feaea600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7feae415f980 con 0x7feae415e3f0 2024-09-11T23:25:44.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.388+0000 7feae3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feae406c0e0 0x7feae414afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:44.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.388+0000 7feae3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feae406c0e0 0x7feae414afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54500/0 (socket says 172.21.15.144:54500) 2024-09-11T23:25:44.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.388+0000 7feae3400640 1 -- 172.21.15.144:0/3594031695 learned_addr learned my addr 172.21.15.144:0/3594031695 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:44.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.388+0000 7feadaa00640 1 --2- 172.21.15.144:0/3594031695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feae415e3f0 0x7feae414ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:44.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.388+0000 7feae3e00640 1 --2- 172.21.15.144:0/3594031695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feae4162ad0 0x7feae40d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:44.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.388+0000 7feae3400640 1 -- 172.21.15.144:0/3594031695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feae415e3f0 msgr2=0x7feae414ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:44.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.388+0000 7feae3400640 1 --2- 172.21.15.144:0/3594031695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feae415e3f0 0x7feae414ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:44.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.388+0000 7feae3400640 1 -- 172.21.15.144:0/3594031695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feae4162ad0 msgr2=0x7feae40d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:44.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.388+0000 7feae3400640 1 --2- 172.21.15.144:0/3594031695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feae4162ad0 0x7feae40d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:44.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.388+0000 7feae3400640 1 -- 172.21.15.144:0/3594031695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae415a690 con 0x7feae406c0e0 2024-09-11T23:25:44.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.388+0000 7feae3400640 1 --2- 172.21.15.144:0/3594031695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feae406c0e0 0x7feae414afa0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fead400c430 tx=0x7fead400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:44.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.389+0000 7feadbe00640 1 -- 172.21.15.144:0/3594031695 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead4017070 con 0x7feae406c0e0 2024-09-11T23:25:44.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.389+0000 7feadbe00640 1 -- 172.21.15.144:0/3594031695 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fead4005ce0 con 0x7feae406c0e0 2024-09-11T23:25:44.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.389+0000 7feaea600640 1 -- 172.21.15.144:0/3594031695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae414b4e0 con 0x7feae406c0e0 2024-09-11T23:25:44.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.389+0000 7feadbe00640 1 -- 172.21.15.144:0/3594031695 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead40072f0 con 0x7feae406c0e0 2024-09-11T23:25:44.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.389+0000 7feaea600640 1 -- 172.21.15.144:0/3594031695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae415ac10 con 0x7feae406c0e0 2024-09-11T23:25:44.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.390+0000 7feaea600640 1 -- 172.21.15.144:0/3594031695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feae406bba0 con 0x7feae406c0e0 2024-09-11T23:25:44.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.391+0000 7feadbe00640 1 -- 172.21.15.144:0/3594031695 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7fead401a070 con 0x7feae406c0e0 2024-09-11T23:25:44.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.392+0000 7feadbe00640 1 --2- 172.21.15.144:0/3594031695 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7feac006c610 0x7feac006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:44.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.392+0000 7feadbe00640 1 -- 172.21.15.144:0/3594031695 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7fead408b200 con 0x7feae406c0e0 2024-09-11T23:25:44.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.392+0000 7feadaa00640 1 --2- 172.21.15.144:0/3594031695 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7feac006c610 0x7feac006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:44.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.393+0000 7feadaa00640 1 --2- 172.21.15.144:0/3594031695 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7feac006c610 0x7feac006ead0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7feae4162950 tx=0x7feacc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:44.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.396+0000 7feadbe00640 1 -- 172.21.15.144:0/3594031695 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fead40588d0 con 0x7feae406c0e0 2024-09-11T23:25:44.633 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.633+0000 7feaea600640 1 -- 172.21.15.144:0/3594031695 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]} v 0) -- 0x7feae4158be0 con 0x7feae406c0e0 2024-09-11T23:25:44.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.836+0000 7feadbe00640 1 -- 172.21.15.144:0/3594031695 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]}]=0 v432) ==== 149+0+0 (secure 0 0 0) 0x7fead405cbd0 con 0x7feae406c0e0 2024-09-11T23:25:44.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.838+0000 7feaea600640 1 -- 172.21.15.144:0/3594031695 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7feac006c610 msgr2=0x7feac006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:44.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.838+0000 7feaea600640 1 --2- 172.21.15.144:0/3594031695 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7feac006c610 0x7feac006ead0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7feae4162950 tx=0x7feacc008040 comp rx=0 tx=0).stop 2024-09-11T23:25:44.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.838+0000 7feaea600640 1 -- 172.21.15.144:0/3594031695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feae406c0e0 msgr2=0x7feae414afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:44.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.838+0000 7feaea600640 1 --2- 172.21.15.144:0/3594031695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feae406c0e0 0x7feae414afa0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fead400c430 tx=0x7fead400c8f0 comp rx=0 tx=0).stop 2024-09-11T23:25:44.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.838+0000 7feaea600640 1 -- 172.21.15.144:0/3594031695 shutdown_connections 2024-09-11T23:25:44.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.838+0000 7feaea600640 1 --2- 172.21.15.144:0/3594031695 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7feac006c610 0x7feac006ead0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:44.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.838+0000 7feaea600640 1 --2- 172.21.15.144:0/3594031695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feae4162ad0 0x7feae40d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:44.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.838+0000 7feaea600640 1 --2- 172.21.15.144:0/3594031695 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feae415e3f0 0x7feae414ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:44.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.838+0000 7feaea600640 1 --2- 172.21.15.144:0/3594031695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feae406c0e0 0x7feae414afa0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:44.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.838+0000 7feaea600640 1 -- 172.21.15.144:0/3594031695 >> 172.21.15.144:0/3594031695 conn(0x7feae406ce90 msgr2=0x7feae415e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:44.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.839+0000 7feaea600640 1 -- 172.21.15.144:0/3594031695 shutdown_connections 2024-09-11T23:25:44.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:44.839+0000 7feaea600640 1 -- 172.21.15.144:0/3594031695 wait complete. 2024-09-11T23:25:44.855 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- rather than going through a full upgrade cycle, ... ok 2024-09-11T23:25:44.855 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- theme continues... 2024-09-11T23:25:44.855 INFO:tasks.cephfs_test_runner:test_subvolume_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) 2024-09-11T23:25:44.856 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:25:45.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.009+0000 7f948fe00640 1 Processor -- start 2024-09-11T23:25:45.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.010+0000 7f948fe00640 1 -- start start 2024-09-11T23:25:45.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.011+0000 7f948fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f94880cf070 0x7f94880cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.011+0000 7f948fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9488073120 0x7f9488073560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.011+0000 7f948fe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94880ce740 con 0x7f948815c180 2024-09-11T23:25:45.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.011+0000 7f948fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9488072640 con 0x7f9488073120 2024-09-11T23:25:45.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.011+0000 7f948fe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9488072920 con 0x7f94880cf070 2024-09-11T23:25:45.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.011+0000 7f948de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9488073120 0x7f9488073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.011+0000 7f948d400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f948815c180 0x7f94880cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43386/0 (socket says 172.21.15.144:43386) 2024-09-11T23:25:45.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.011+0000 7f948de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9488073120 0x7f9488073560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54516/0 (socket says 172.21.15.144:54516) 2024-09-11T23:25:45.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.011+0000 7f948d400640 1 -- 172.21.15.144:0/1455632397 learned_addr learned my addr 172.21.15.144:0/1455632397 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:45.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.011+0000 7f948ca00640 1 --2- 172.21.15.144:0/1455632397 >> v2:172.21.15.165:3300/0 conn(0x7f94880cf070 0x7f94880cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.011+0000 7f948de00640 1 -- 172.21.15.144:0/1455632397 >> v2:172.21.15.165:3300/0 conn(0x7f94880cf070 msgr2=0x7f94880cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:45.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.011+0000 7f948de00640 1 --2- 172.21.15.144:0/1455632397 >> v2:172.21.15.165:3300/0 conn(0x7f94880cf070 0x7f94880cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.012+0000 7f948de00640 1 -- 172.21.15.144:0/1455632397 >> v1:172.21.15.144:6789/0 conn(0x7f948815c180 legacy=0x7f94880cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:45.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.012+0000 7f948de00640 1 -- 172.21.15.144:0/1455632397 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9488072c00 con 0x7f9488073120 2024-09-11T23:25:45.012 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.012+0000 7f9487e00640 1 -- 172.21.15.144:0/1455632397 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2918348914 0 0) 0x7f94880ce740 con 0x7f948815c180 2024-09-11T23:25:45.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.012+0000 7f948de00640 1 --2- 172.21.15.144:0/1455632397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9488073120 0x7f9488073560 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f948806f430 tx=0x7f948002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62220311c59292d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:45.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.013+0000 7f9487e00640 1 -- 172.21.15.144:0/1455632397 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9480007740 con 0x7f9488073120 2024-09-11T23:25:45.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.013+0000 7f9487e00640 1 -- 172.21.15.144:0/1455632397 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94800078e0 con 0x7f9488073120 2024-09-11T23:25:45.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.013+0000 7f9487e00640 1 -- 172.21.15.144:0/1455632397 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9480007cb0 con 0x7f9488073120 2024-09-11T23:25:45.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.013+0000 7f948fe00640 1 -- 172.21.15.144:0/1455632397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9488073120 msgr2=0x7f9488073560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:45.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.013+0000 7f948fe00640 1 --2- 172.21.15.144:0/1455632397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9488073120 0x7f9488073560 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f948806f430 tx=0x7f948002a5f0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.013+0000 7f948fe00640 1 -- 172.21.15.144:0/1455632397 shutdown_connections 2024-09-11T23:25:45.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.013+0000 7f948fe00640 1 --2- 172.21.15.144:0/1455632397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9488073120 0x7f9488073560 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.013+0000 7f948fe00640 1 --2- 172.21.15.144:0/1455632397 >> v2:172.21.15.165:3300/0 conn(0x7f94880cf070 0x7f94880cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.013+0000 7f948fe00640 1 -- 172.21.15.144:0/1455632397 >> 172.21.15.144:0/1455632397 conn(0x7f9488062cc0 msgr2=0x7f948806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:45.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.013+0000 7f948fe00640 1 -- 172.21.15.144:0/1455632397 shutdown_connections 2024-09-11T23:25:45.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.013+0000 7f948fe00640 1 -- 172.21.15.144:0/1455632397 wait complete. 2024-09-11T23:25:45.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.015+0000 7f948fe00640 1 Processor -- start 2024-09-11T23:25:45.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.015+0000 7f948fe00640 1 -- start start 2024-09-11T23:25:45.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.016+0000 7f948fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9488073120 0x7f9488153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.016+0000 7f948fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94880cf070 0x7f9488152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.016+0000 7f948fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f948815c180 0x7f94880b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.016+0000 7f948fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f94880722f0 con 0x7f948815c180 2024-09-11T23:25:45.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.016+0000 7f948fe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f94880ced00 con 0x7f94880cf070 2024-09-11T23:25:45.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.016+0000 7f948fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f948815c560 con 0x7f9488073120 2024-09-11T23:25:45.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.016+0000 7f948de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f948815c180 0x7f94880b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.016+0000 7f948de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f948815c180 0x7f94880b0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54526/0 (socket says 172.21.15.144:54526) 2024-09-11T23:25:45.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.016+0000 7f948de00640 1 -- 172.21.15.144:0/1667865288 learned_addr learned my addr 172.21.15.144:0/1667865288 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:45.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.016+0000 7f948ca00640 1 --2- 172.21.15.144:0/1667865288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94880cf070 0x7f9488152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.016+0000 7f948d400640 1 --2- 172.21.15.144:0/1667865288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9488073120 0x7f9488153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.017+0000 7f948de00640 1 -- 172.21.15.144:0/1667865288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9488073120 msgr2=0x7f9488153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:45.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.017+0000 7f948de00640 1 --2- 172.21.15.144:0/1667865288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9488073120 0x7f9488153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.017+0000 7f948de00640 1 -- 172.21.15.144:0/1667865288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94880cf070 msgr2=0x7f9488152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:45.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.017+0000 7f948de00640 1 --2- 172.21.15.144:0/1667865288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94880cf070 0x7f9488152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.017+0000 7f948de00640 1 -- 172.21.15.144:0/1667865288 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94880b1e40 con 0x7f948815c180 2024-09-11T23:25:45.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.017+0000 7f948de00640 1 --2- 172.21.15.144:0/1667865288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f948815c180 0x7f94880b0ea0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f948002abe0 tx=0x7f9480004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:45.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.017+0000 7f9485600640 1 -- 172.21.15.144:0/1667865288 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9480040070 con 0x7f948815c180 2024-09-11T23:25:45.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.017+0000 7f9485600640 1 -- 172.21.15.144:0/1667865288 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9480031bc0 con 0x7f948815c180 2024-09-11T23:25:45.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.017+0000 7f9485600640 1 -- 172.21.15.144:0/1667865288 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9480045460 con 0x7f948815c180 2024-09-11T23:25:45.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.017+0000 7f948fe00640 1 -- 172.21.15.144:0/1667865288 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9488154160 con 0x7f948815c180 2024-09-11T23:25:45.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.017+0000 7f948fe00640 1 -- 172.21.15.144:0/1667865288 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94880b1880 con 0x7f948815c180 2024-09-11T23:25:45.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.018+0000 7f948fe00640 1 -- 172.21.15.144:0/1667865288 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94880cf4e0 con 0x7f948815c180 2024-09-11T23:25:45.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.019+0000 7f9485600640 1 -- 172.21.15.144:0/1667865288 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f9480039040 con 0x7f948815c180 2024-09-11T23:25:45.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.020+0000 7f9485600640 1 --2- 172.21.15.144:0/1667865288 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f946806c610 0x7f946806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.020+0000 7f9485600640 1 -- 172.21.15.144:0/1667865288 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f94800ad7e0 con 0x7f948815c180 2024-09-11T23:25:45.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.020+0000 7f948d400640 1 --2- 172.21.15.144:0/1667865288 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f946806c610 0x7f946806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.021+0000 7f948d400640 1 --2- 172.21.15.144:0/1667865288 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f946806c610 0x7f946806ead0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f947c000f60 tx=0x7f947c007c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:45.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.024+0000 7f9485600640 1 -- 172.21.15.144:0/1667865288 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f948007b3f0 con 0x7f948815c180 2024-09-11T23:25:45.090 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:25:45.095 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:25:45.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.206+0000 7f948fe00640 1 -- 172.21.15.144:0/1667865288 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94880cfbf0 con 0x7f948815c180 2024-09-11T23:25:45.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.207+0000 7f9485600640 1 -- 172.21.15.144:0/1667865288 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) ==== 74+0+13068 (secure 0 0 0) 0x7f948007acf0 con 0x7f948815c180 2024-09-11T23:25:45.207 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:45.207 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":145,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:25:43.822390+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6835/1597149290":"2024-09-12T23:25:40.562898+0000","172.21.15.144:6834/1597149290":"2024-09-12T23:25:40.562898+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:25:45.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.209+0000 7f948fe00640 1 -- 172.21.15.144:0/1667865288 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f946806c610 msgr2=0x7f946806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:45.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.209+0000 7f948fe00640 1 --2- 172.21.15.144:0/1667865288 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f946806c610 0x7f946806ead0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f947c000f60 tx=0x7f947c007c00 comp rx=0 tx=0).stop 2024-09-11T23:25:45.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.209+0000 7f948fe00640 1 -- 172.21.15.144:0/1667865288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f948815c180 msgr2=0x7f94880b0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:45.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.209+0000 7f948fe00640 1 --2- 172.21.15.144:0/1667865288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f948815c180 0x7f94880b0ea0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f948002abe0 tx=0x7f9480004a40 comp rx=0 tx=0).stop 2024-09-11T23:25:45.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.209+0000 7f948fe00640 1 -- 172.21.15.144:0/1667865288 shutdown_connections 2024-09-11T23:25:45.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.209+0000 7f948fe00640 1 --2- 172.21.15.144:0/1667865288 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f946806c610 0x7f946806ead0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.209+0000 7f948fe00640 1 --2- 172.21.15.144:0/1667865288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f948815c180 0x7f94880b0ea0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.209+0000 7f948fe00640 1 --2- 172.21.15.144:0/1667865288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94880cf070 0x7f9488152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.209+0000 7f948fe00640 1 --2- 172.21.15.144:0/1667865288 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9488073120 0x7f9488153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.209+0000 7f948fe00640 1 -- 172.21.15.144:0/1667865288 >> 172.21.15.144:0/1667865288 conn(0x7f9488062cc0 msgr2=0x7f94880d03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:45.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.210+0000 7f948fe00640 1 -- 172.21.15.144:0/1667865288 shutdown_connections 2024-09-11T23:25:45.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.210+0000 7f948fe00640 1 -- 172.21.15.144:0/1667865288 wait complete. 2024-09-11T23:25:45.225 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:17:47.307937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:25:45.226 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:25:45.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.423+0000 7f86c8200640 1 Processor -- start 2024-09-11T23:25:45.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.423+0000 7f86c8200640 1 -- start start 2024-09-11T23:25:45.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.424+0000 7f86c8200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86c015d3b0 0x7f86c0071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.424+0000 7f86c8200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f86c00cf320 0x7f86c00cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.424+0000 7f86c8200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c00715c0 con 0x7f86c015d790 2024-09-11T23:25:45.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.424+0000 7f86c8200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f86c006da30 con 0x7f86c00cf320 2024-09-11T23:25:45.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.424+0000 7f86c8200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f86c006d700 con 0x7f86c015d3b0 2024-09-11T23:25:45.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.425+0000 7f86c4e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f86c015d790 0x7f86c00cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43390/0 (socket says 172.21.15.144:43390) 2024-09-11T23:25:45.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.425+0000 7f86c4e00640 1 -- 172.21.15.144:0/1460434213 learned_addr learned my addr 172.21.15.144:0/1460434213 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:45.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.425+0000 7f86bfe00640 1 -- 172.21.15.144:0/1460434213 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 314396228 0 0) 0x7f86c00715c0 con 0x7f86c015d790 2024-09-11T23:25:45.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.425+0000 7f86c5800640 1 --2- 172.21.15.144:0/1460434213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86c015d3b0 0x7f86c0071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.425+0000 7f86c6200640 1 --2- 172.21.15.144:0/1460434213 >> v2:172.21.15.165:3300/0 conn(0x7f86c00cf320 0x7f86c00cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.425+0000 7f86bfe00640 1 -- 172.21.15.144:0/1460434213 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86a8003520 con 0x7f86c015d790 2024-09-11T23:25:45.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86bfe00640 1 -- 172.21.15.144:0/1460434213 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3467872772 0 0) 0x7f86a8003520 con 0x7f86c015d790 2024-09-11T23:25:45.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86bfe00640 1 -- 172.21.15.144:0/1460434213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86c015d3b0 msgr2=0x7f86c0071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:45.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86bfe00640 1 --2- 172.21.15.144:0/1460434213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86c015d3b0 0x7f86c0071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86bfe00640 1 -- 172.21.15.144:0/1460434213 >> v2:172.21.15.165:3300/0 conn(0x7f86c00cf320 msgr2=0x7f86c00cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:45.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86bfe00640 1 --2- 172.21.15.144:0/1460434213 >> v2:172.21.15.165:3300/0 conn(0x7f86c00cf320 0x7f86c00cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86bfe00640 1 -- 172.21.15.144:0/1460434213 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c00cde80 con 0x7f86c015d790 2024-09-11T23:25:45.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86bfe00640 1 -- 172.21.15.144:0/1460434213 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f86ac0017f0 con 0x7f86c015d790 2024-09-11T23:25:45.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86bfe00640 1 -- 172.21.15.144:0/1460434213 >> v1:172.21.15.144:6789/0 conn(0x7f86c015d790 legacy=0x7f86c00cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:45.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86bfe00640 1 --2- 172.21.15.144:0/1460434213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86c015d3b0 0x7f86a80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86bfe00640 1 --2- 172.21.15.144:0/1460434213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86a8003f80 0x7f86a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86bfe00640 1 --2- 172.21.15.144:0/1460434213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86a8004d40 0x7f86a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86bfe00640 1 -- 172.21.15.144:0/1460434213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f86c006da30 con 0x7f86a8003f80 2024-09-11T23:25:45.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86bfe00640 1 -- 172.21.15.144:0/1460434213 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f86c006d700 con 0x7f86a8004d40 2024-09-11T23:25:45.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86bfe00640 1 -- 172.21.15.144:0/1460434213 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f86a800b9c0 con 0x7f86c015d3b0 2024-09-11T23:25:45.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86c4e00640 1 --2- 172.21.15.144:0/1460434213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86a8003f80 0x7f86a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86c6200640 1 --2- 172.21.15.144:0/1460434213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86a8004d40 0x7f86a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86c5800640 1 --2- 172.21.15.144:0/1460434213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86c015d3b0 0x7f86a80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86c4e00640 1 -- 172.21.15.144:0/1460434213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86c015d3b0 msgr2=0x7f86a80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:45.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86c4e00640 1 --2- 172.21.15.144:0/1460434213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86c015d3b0 0x7f86a80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86c4e00640 1 -- 172.21.15.144:0/1460434213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86a8004d40 msgr2=0x7f86a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:45.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86c4e00640 1 --2- 172.21.15.144:0/1460434213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86a8004d40 0x7f86a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86c4e00640 1 -- 172.21.15.144:0/1460434213 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a8003520 con 0x7f86a8003f80 2024-09-11T23:25:45.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.426+0000 7f86c5800640 1 --2- 172.21.15.144:0/1460434213 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86c015d3b0 0x7f86a80039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:45.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.427+0000 7f86c4e00640 1 --2- 172.21.15.144:0/1460434213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86a8003f80 0x7f86a8004800 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00c1c0 tx=0x7f86a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2131b1690626a8b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:45.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.428+0000 7f86bfe00640 1 -- 172.21.15.144:0/1460434213 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac007c70 con 0x7f86a8003f80 2024-09-11T23:25:45.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.428+0000 7f86bfe00640 1 -- 172.21.15.144:0/1460434213 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86ac007290 con 0x7f86a8003f80 2024-09-11T23:25:45.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.428+0000 7f86bfe00640 1 -- 172.21.15.144:0/1460434213 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0057a0 con 0x7f86a8003f80 2024-09-11T23:25:45.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.428+0000 7f86c8200640 1 -- 172.21.15.144:0/1460434213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86a8003f80 msgr2=0x7f86a8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:45.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.428+0000 7f86c8200640 1 --2- 172.21.15.144:0/1460434213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86a8003f80 0x7f86a8004800 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00c1c0 tx=0x7f86a8005830 comp rx=0 tx=0).stop 2024-09-11T23:25:45.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.428+0000 7f86c6200640 1 -- 172.21.15.144:0/1460434213 reap_dead start 2024-09-11T23:25:45.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.428+0000 7f86c8200640 1 -- 172.21.15.144:0/1460434213 shutdown_connections 2024-09-11T23:25:45.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.428+0000 7f86c8200640 1 -- 172.21.15.144:0/1460434213 >> 172.21.15.144:0/1460434213 conn(0x7f86c006bba0 msgr2=0x7f86c006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:45.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.428+0000 7f86c8200640 1 -- 172.21.15.144:0/1460434213 shutdown_connections 2024-09-11T23:25:45.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.428+0000 7f86c8200640 1 -- 172.21.15.144:0/1460434213 wait complete. 2024-09-11T23:25:45.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.430+0000 7f86c8200640 1 Processor -- start 2024-09-11T23:25:45.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.430+0000 7f86c8200640 1 -- start start 2024-09-11T23:25:45.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.431+0000 7f86c8200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86a8003f80 0x7f86c00aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.431+0000 7f86c8200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c0157a90 0x7f86c01f2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.431+0000 7f86c8200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86c01f25b0 0x7f86c01f2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.431+0000 7f86c8200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f86c00cd580 con 0x7f86c0157a90 2024-09-11T23:25:45.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.431+0000 7f86c8200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f86c00cdba0 con 0x7f86c01f25b0 2024-09-11T23:25:45.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.431+0000 7f86c8200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f86c00cfc70 con 0x7f86a8003f80 2024-09-11T23:25:45.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.431+0000 7f86c4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c0157a90 0x7f86c01f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.431+0000 7f86c4e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c0157a90 0x7f86c01f2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54552/0 (socket says 172.21.15.144:54552) 2024-09-11T23:25:45.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.431+0000 7f86c4e00640 1 -- 172.21.15.144:0/2701678070 learned_addr learned my addr 172.21.15.144:0/2701678070 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:45.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.432+0000 7f86c6200640 1 --2- 172.21.15.144:0/2701678070 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86c01f25b0 0x7f86c01f2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.432+0000 7f86c5800640 1 --2- 172.21.15.144:0/2701678070 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86a8003f80 0x7f86c00aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.432+0000 7f86c4e00640 1 -- 172.21.15.144:0/2701678070 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86a8003f80 msgr2=0x7f86c00aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:45.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.432+0000 7f86c4e00640 1 --2- 172.21.15.144:0/2701678070 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86a8003f80 0x7f86c00aa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.432+0000 7f86c4e00640 1 -- 172.21.15.144:0/2701678070 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86c01f25b0 msgr2=0x7f86c01f2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:45.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.432+0000 7f86c4e00640 1 --2- 172.21.15.144:0/2701678070 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86c01f25b0 0x7f86c01f2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.432+0000 7f86c4e00640 1 -- 172.21.15.144:0/2701678070 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c00aaa10 con 0x7f86c0157a90 2024-09-11T23:25:45.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.432+0000 7f86c4e00640 1 --2- 172.21.15.144:0/2701678070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c0157a90 0x7f86c01f2070 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00c1c0 tx=0x7f86ac001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:45.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.432+0000 7f86bd600640 1 -- 172.21.15.144:0/2701678070 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac043070 con 0x7f86c0157a90 2024-09-11T23:25:45.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.433+0000 7f86bd600640 1 -- 172.21.15.144:0/2701678070 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86ac038040 con 0x7f86c0157a90 2024-09-11T23:25:45.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.433+0000 7f86bd600640 1 -- 172.21.15.144:0/2701678070 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0059e0 con 0x7f86c0157a90 2024-09-11T23:25:45.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.433+0000 7f86c8200640 1 -- 172.21.15.144:0/2701678070 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c0159820 con 0x7f86c0157a90 2024-09-11T23:25:45.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.433+0000 7f86c8200640 1 -- 172.21.15.144:0/2701678070 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c01582e0 con 0x7f86c0157a90 2024-09-11T23:25:45.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.434+0000 7f86c8200640 1 -- 172.21.15.144:0/2701678070 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c015cbf0 con 0x7f86c0157a90 2024-09-11T23:25:45.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.435+0000 7f86bd600640 1 -- 172.21.15.144:0/2701678070 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f86ac005b80 con 0x7f86c0157a90 2024-09-11T23:25:45.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.436+0000 7f86bd600640 1 --2- 172.21.15.144:0/2701678070 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f86a006c640 0x7f86a006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.436+0000 7f86bd600640 1 -- 172.21.15.144:0/2701678070 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f86ac0ab370 con 0x7f86c0157a90 2024-09-11T23:25:45.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.436+0000 7f86c5800640 1 --2- 172.21.15.144:0/2701678070 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f86a006c640 0x7f86a006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.437+0000 7f86c5800640 1 --2- 172.21.15.144:0/2701678070 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f86a006c640 0x7f86a006eb00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f86b40099e0 tx=0x7f86b4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:45.440 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.440+0000 7f86bd600640 1 -- 172.21.15.144:0/2701678070 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f86ac078ec0 con 0x7f86c0157a90 2024-09-11T23:25:45.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.612+0000 7f86c8200640 1 -- 172.21.15.144:0/2701678070 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f86c00cd150 con 0x7f86c0157a90 2024-09-11T23:25:45.612 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.612+0000 7f86bd600640 1 -- 172.21.15.144:0/2701678070 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v145) ==== 93+0+10 (secure 0 0 0) 0x7f86ac07d1c0 con 0x7f86c0157a90 2024-09-11T23:25:45.612 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-11T23:25:45.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.615+0000 7f86c8200640 1 -- 172.21.15.144:0/2701678070 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f86a006c640 msgr2=0x7f86a006eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:45.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.615+0000 7f86c8200640 1 --2- 172.21.15.144:0/2701678070 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f86a006c640 0x7f86a006eb00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f86b40099e0 tx=0x7f86b4008040 comp rx=0 tx=0).stop 2024-09-11T23:25:45.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.615+0000 7f86c8200640 1 -- 172.21.15.144:0/2701678070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c0157a90 msgr2=0x7f86c01f2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:45.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.615+0000 7f86c8200640 1 --2- 172.21.15.144:0/2701678070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c0157a90 0x7f86c01f2070 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00c1c0 tx=0x7f86ac001af0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.615+0000 7f86c8200640 1 -- 172.21.15.144:0/2701678070 shutdown_connections 2024-09-11T23:25:45.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.615+0000 7f86c8200640 1 --2- 172.21.15.144:0/2701678070 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f86a006c640 0x7f86a006eb00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.615+0000 7f86c8200640 1 --2- 172.21.15.144:0/2701678070 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86c01f25b0 0x7f86c01f2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.615+0000 7f86c8200640 1 --2- 172.21.15.144:0/2701678070 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c0157a90 0x7f86c01f2070 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.615+0000 7f86c8200640 1 --2- 172.21.15.144:0/2701678070 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86a8003f80 0x7f86c00aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.615+0000 7f86c8200640 1 -- 172.21.15.144:0/2701678070 >> 172.21.15.144:0/2701678070 conn(0x7f86c006bba0 msgr2=0x7f86c015ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:45.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.615+0000 7f86c8200640 1 -- 172.21.15.144:0/2701678070 shutdown_connections 2024-09-11T23:25:45.615 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.615+0000 7f86c8200640 1 -- 172.21.15.144:0/2701678070 wait complete. 2024-09-11T23:25:45.631 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2' 2024-09-11T23:25:45.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.784+0000 7fa5f7e00640 1 Processor -- start 2024-09-11T23:25:45.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.785+0000 7fa5f7e00640 1 -- start start 2024-09-11T23:25:45.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.786+0000 7fa5f7e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f815a0a0 0x7fa5f8073180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.786+0000 7fa5f7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa5f80736c0 0x7fa5f80ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.786+0000 7fa5f7e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f8072100 con 0x7fa5f80ce9c0 2024-09-11T23:25:45.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.786+0000 7fa5f7e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa5f80cee00 con 0x7fa5f80736c0 2024-09-11T23:25:45.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.786+0000 7fa5f7e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f80723c0 con 0x7fa5f815a0a0 2024-09-11T23:25:45.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.786+0000 7fa5ee000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa5f80736c0 0x7fa5f80ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.786+0000 7fa5f7400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa5f80ce9c0 0x7fa5f80b1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43400/0 (socket says 172.21.15.144:43400) 2024-09-11T23:25:45.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.786+0000 7fa5f7400640 1 -- 172.21.15.144:0/3235262002 learned_addr learned my addr 172.21.15.144:0/3235262002 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:45.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.786+0000 7fa5ee000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa5f80736c0 0x7fa5f80ce480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54562/0 (socket says 172.21.15.144:54562) 2024-09-11T23:25:45.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.786+0000 7fa5f6a00640 1 --2- 172.21.15.144:0/3235262002 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f815a0a0 0x7fa5f8073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.786+0000 7fa5ee000640 1 -- 172.21.15.144:0/3235262002 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f815a0a0 msgr2=0x7fa5f8073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:45.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.787+0000 7fa5ee000640 1 --2- 172.21.15.144:0/3235262002 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f815a0a0 0x7fa5f8073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.787+0000 7fa5ee000640 1 -- 172.21.15.144:0/3235262002 >> v1:172.21.15.144:6789/0 conn(0x7fa5f80ce9c0 legacy=0x7fa5f80b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:45.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.787+0000 7fa5ee000640 1 -- 172.21.15.144:0/3235262002 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f80726a0 con 0x7fa5f80736c0 2024-09-11T23:25:45.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.787+0000 7fa5f6000640 1 -- 172.21.15.144:0/3235262002 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1083618796 0 0) 0x7fa5f8072100 con 0x7fa5f80ce9c0 2024-09-11T23:25:45.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.787+0000 7fa5ee000640 1 --2- 172.21.15.144:0/3235262002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f80736c0 0x7fa5f80ce480 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80cef80 tx=0x7fa5e002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd4e449c45d9659 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:45.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.788+0000 7fa5f6000640 1 -- 172.21.15.144:0/3235262002 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0037070 con 0x7fa5f80736c0 2024-09-11T23:25:45.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.788+0000 7fa5f6000640 1 -- 172.21.15.144:0/3235262002 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e0032440 con 0x7fa5f80736c0 2024-09-11T23:25:45.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.788+0000 7fa5f6000640 1 -- 172.21.15.144:0/3235262002 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0032810 con 0x7fa5f80736c0 2024-09-11T23:25:45.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.788+0000 7fa5f7e00640 1 -- 172.21.15.144:0/3235262002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f80736c0 msgr2=0x7fa5f80ce480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:45.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.788+0000 7fa5f7e00640 1 --2- 172.21.15.144:0/3235262002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f80736c0 0x7fa5f80ce480 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80cef80 tx=0x7fa5e002a180 comp rx=0 tx=0).stop 2024-09-11T23:25:45.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.788+0000 7fa5f7e00640 1 -- 172.21.15.144:0/3235262002 shutdown_connections 2024-09-11T23:25:45.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.788+0000 7fa5f7e00640 1 --2- 172.21.15.144:0/3235262002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f80736c0 0x7fa5f80ce480 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.788+0000 7fa5f7e00640 1 --2- 172.21.15.144:0/3235262002 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f815a0a0 0x7fa5f8073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.788+0000 7fa5f7e00640 1 -- 172.21.15.144:0/3235262002 >> 172.21.15.144:0/3235262002 conn(0x7fa5f806e910 msgr2=0x7fa5f806bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:45.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.788+0000 7fa5f7e00640 1 -- 172.21.15.144:0/3235262002 shutdown_connections 2024-09-11T23:25:45.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.788+0000 7fa5f7e00640 1 -- 172.21.15.144:0/3235262002 wait complete. 2024-09-11T23:25:45.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.790+0000 7fa5f7e00640 1 Processor -- start 2024-09-11T23:25:45.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.790+0000 7fa5f7e00640 1 -- start start 2024-09-11T23:25:45.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.791+0000 7fa5f7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f80ce9c0 0x7fa5f814bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.791+0000 7fa5f7e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f815a0a0 0x7fa5f8152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.791+0000 7fa5f7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5f8157640 0x7fa5f80ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.791+0000 7fa5f7e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f80b2650 con 0x7fa5f80ce9c0 2024-09-11T23:25:45.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.791+0000 7fa5f7e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f80b24d0 con 0x7fa5f8157640 2024-09-11T23:25:45.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.791+0000 7fa5f7e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f80cf240 con 0x7fa5f815a0a0 2024-09-11T23:25:45.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.791+0000 7fa5f6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f80ce9c0 0x7fa5f814bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.791+0000 7fa5f6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f80ce9c0 0x7fa5f814bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54572/0 (socket says 172.21.15.144:54572) 2024-09-11T23:25:45.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.791+0000 7fa5f6a00640 1 -- 172.21.15.144:0/3405539901 learned_addr learned my addr 172.21.15.144:0/3405539901 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:45.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.792+0000 7fa5ee000640 1 --2- 172.21.15.144:0/3405539901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f815a0a0 0x7fa5f8152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.792+0000 7fa5f7400640 1 --2- 172.21.15.144:0/3405539901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5f8157640 0x7fa5f80ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.792+0000 7fa5f6a00640 1 -- 172.21.15.144:0/3405539901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f815a0a0 msgr2=0x7fa5f8152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:45.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.792+0000 7fa5f6a00640 1 --2- 172.21.15.144:0/3405539901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f815a0a0 0x7fa5f8152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.792+0000 7fa5f6a00640 1 -- 172.21.15.144:0/3405539901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5f8157640 msgr2=0x7fa5f80ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:45.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.792+0000 7fa5f6a00640 1 --2- 172.21.15.144:0/3405539901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5f8157640 0x7fa5f80ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:45.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.792+0000 7fa5f6a00640 1 -- 172.21.15.144:0/3405539901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f8153510 con 0x7fa5f80ce9c0 2024-09-11T23:25:45.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.792+0000 7fa5f6a00640 1 --2- 172.21.15.144:0/3405539901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f80ce9c0 0x7fa5f814bc30 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800e870 tx=0x7fa5e800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:45.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.792+0000 7fa5ef400640 1 -- 172.21.15.144:0/3405539901 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8017070 con 0x7fa5f80ce9c0 2024-09-11T23:25:45.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.792+0000 7fa5ef400640 1 -- 172.21.15.144:0/3405539901 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e800c8e0 con 0x7fa5f80ce9c0 2024-09-11T23:25:45.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.792+0000 7fa5f7e00640 1 -- 172.21.15.144:0/3405539901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f81537b0 con 0x7fa5f80ce9c0 2024-09-11T23:25:45.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.792+0000 7fa5ef400640 1 -- 172.21.15.144:0/3405539901 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e800ccd0 con 0x7fa5f80ce9c0 2024-09-11T23:25:45.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.793+0000 7fa5f7e00640 1 -- 172.21.15.144:0/3405539901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f8153d70 con 0x7fa5f80ce9c0 2024-09-11T23:25:45.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.794+0000 7fa5f7e00640 1 -- 172.21.15.144:0/3405539901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f80ce480 con 0x7fa5f80ce9c0 2024-09-11T23:25:45.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.794+0000 7fa5ef400640 1 -- 172.21.15.144:0/3405539901 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7fa5e801a070 con 0x7fa5f80ce9c0 2024-09-11T23:25:45.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.795+0000 7fa5ef400640 1 --2- 172.21.15.144:0/3405539901 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa5d406c640 0x7fa5d406eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:45.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.795+0000 7fa5ef400640 1 -- 172.21.15.144:0/3405539901 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7fa5e808bac0 con 0x7fa5f80ce9c0 2024-09-11T23:25:45.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.796+0000 7fa5ee000640 1 --2- 172.21.15.144:0/3405539901 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa5d406c640 0x7fa5d406eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:45.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.796+0000 7fa5ee000640 1 --2- 172.21.15.144:0/3405539901 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa5d406c640 0x7fa5d406eb00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0034000 tx=0x7fa5e002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:45.799 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:45.800+0000 7fa5ef400640 1 -- 172.21.15.144:0/3405539901 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa5e8059190 con 0x7fa5f80ce9c0 2024-09-11T23:25:46.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:46.038+0000 7fa5f7e00640 1 -- 172.21.15.144:0/3405539901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]} v 0) -- 0x7fa5f80cf020 con 0x7fa5f80ce9c0 2024-09-11T23:25:46.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:46.843+0000 7fa5ef400640 1 -- 172.21.15.144:0/3405539901 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]}]=0 v434) ==== 148+0+0 (secure 0 0 0) 0x7fa5e805d490 con 0x7fa5f80ce9c0 2024-09-11T23:25:46.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:46.846+0000 7fa5f7e00640 1 -- 172.21.15.144:0/3405539901 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa5d406c640 msgr2=0x7fa5d406eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:46.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:46.846+0000 7fa5f7e00640 1 --2- 172.21.15.144:0/3405539901 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa5d406c640 0x7fa5d406eb00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0034000 tx=0x7fa5e002e000 comp rx=0 tx=0).stop 2024-09-11T23:25:46.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:46.846+0000 7fa5f7e00640 1 -- 172.21.15.144:0/3405539901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f80ce9c0 msgr2=0x7fa5f814bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:46.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:46.846+0000 7fa5f7e00640 1 --2- 172.21.15.144:0/3405539901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f80ce9c0 0x7fa5f814bc30 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800e870 tx=0x7fa5e800ed30 comp rx=0 tx=0).stop 2024-09-11T23:25:46.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:46.846+0000 7fa5f7e00640 1 -- 172.21.15.144:0/3405539901 shutdown_connections 2024-09-11T23:25:46.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:46.846+0000 7fa5f7e00640 1 --2- 172.21.15.144:0/3405539901 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa5d406c640 0x7fa5d406eb00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:46.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:46.846+0000 7fa5f7e00640 1 --2- 172.21.15.144:0/3405539901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5f8157640 0x7fa5f80ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:46.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:46.846+0000 7fa5f7e00640 1 --2- 172.21.15.144:0/3405539901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa5f815a0a0 0x7fa5f8152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:46.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:46.846+0000 7fa5f7e00640 1 --2- 172.21.15.144:0/3405539901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f80ce9c0 0x7fa5f814bc30 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:46.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:46.846+0000 7fa5f7e00640 1 -- 172.21.15.144:0/3405539901 >> 172.21.15.144:0/3405539901 conn(0x7fa5f806e910 msgr2=0x7fa5f80afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:46.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:46.846+0000 7fa5f7e00640 1 -- 172.21.15.144:0/3405539901 shutdown_connections 2024-09-11T23:25:46.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:46.846+0000 7fa5f7e00640 1 -- 172.21.15.144:0/3405539901 wait complete. 2024-09-11T23:25:46.864 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:25:47.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.022+0000 7f8276800640 1 Processor -- start 2024-09-11T23:25:47.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.022+0000 7f8276800640 1 -- start start 2024-09-11T23:25:47.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.023+0000 7f8276800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f827006d2c0 0x7f82701656c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:47.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.023+0000 7f8276800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82700b4bb0 con 0x7f8270144610 2024-09-11T23:25:47.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.023+0000 7f8276800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82700b4e20 con 0x7f82700721e0 2024-09-11T23:25:47.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.023+0000 7f8276800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f82700b5100 con 0x7f827006d2c0 2024-09-11T23:25:47.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.023+0000 7f8275400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f8270144610 0x7f82700b44a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43406/0 (socket says 172.21.15.144:43406) 2024-09-11T23:25:47.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.023+0000 7f8275400640 1 -- 172.21.15.144:0/2686031426 learned_addr learned my addr 172.21.15.144:0/2686031426 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:47.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.023+0000 7f8275e00640 1 --2- 172.21.15.144:0/2686031426 >> v2:172.21.15.144:3300/0 conn(0x7f827006d2c0 0x7f82701656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:47.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.024+0000 7f826fe00640 1 -- 172.21.15.144:0/2686031426 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3474872674 0 0) 0x7f82700b4bb0 con 0x7f8270144610 2024-09-11T23:25:47.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.024+0000 7f8275e00640 1 -- 172.21.15.144:0/2686031426 >> v1:172.21.15.165:6789/0 conn(0x7f82700721e0 legacy=0x7f827006cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:47.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.024+0000 7f8275e00640 1 -- 172.21.15.144:0/2686031426 >> v1:172.21.15.144:6789/0 conn(0x7f8270144610 legacy=0x7f82700b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:47.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.024+0000 7f8275e00640 1 -- 172.21.15.144:0/2686031426 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82700b53e0 con 0x7f827006d2c0 2024-09-11T23:25:47.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.025+0000 7f8275e00640 1 --2- 172.21.15.144:0/2686031426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f827006d2c0 0x7f82701656c0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f8268009d90 tx=0x7f826802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379cedfe6126c369 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:47.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.025+0000 7f826fe00640 1 -- 172.21.15.144:0/2686031426 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268007740 con 0x7f827006d2c0 2024-09-11T23:25:47.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.025+0000 7f826fe00640 1 -- 172.21.15.144:0/2686031426 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82680078e0 con 0x7f827006d2c0 2024-09-11T23:25:47.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.025+0000 7f826fe00640 1 -- 172.21.15.144:0/2686031426 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268007cb0 con 0x7f827006d2c0 2024-09-11T23:25:47.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.026+0000 7f8276800640 1 -- 172.21.15.144:0/2686031426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f827006d2c0 msgr2=0x7f82701656c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:47.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.026+0000 7f8276800640 1 --2- 172.21.15.144:0/2686031426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f827006d2c0 0x7f82701656c0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f8268009d90 tx=0x7f826802a6f0 comp rx=0 tx=0).stop 2024-09-11T23:25:47.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.026+0000 7f8276800640 1 -- 172.21.15.144:0/2686031426 shutdown_connections 2024-09-11T23:25:47.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.026+0000 7f8276800640 1 --2- 172.21.15.144:0/2686031426 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f827006d2c0 0x7f82701656c0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:47.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.026+0000 7f8276800640 1 -- 172.21.15.144:0/2686031426 >> 172.21.15.144:0/2686031426 conn(0x7f82700cd780 msgr2=0x7f82700cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:47.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.026+0000 7f8276800640 1 -- 172.21.15.144:0/2686031426 shutdown_connections 2024-09-11T23:25:47.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.026+0000 7f8276800640 1 -- 172.21.15.144:0/2686031426 wait complete. 2024-09-11T23:25:47.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.027+0000 7f8276800640 1 Processor -- start 2024-09-11T23:25:47.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.028+0000 7f8276800640 1 -- start start 2024-09-11T23:25:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.028+0000 7f8276800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f827006d2c0 0x7f827013e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.028+0000 7f8276800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82700721e0 0x7f827013c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.028+0000 7f8276800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8270144610 0x7f827006bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.028+0000 7f8276800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f82701449f0 con 0x7f827006d2c0 2024-09-11T23:25:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.028+0000 7f8276800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f827006dc50 con 0x7f8270144610 2024-09-11T23:25:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.028+0000 7f8276800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f827006f180 con 0x7f82700721e0 2024-09-11T23:25:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.029+0000 7f8275400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f827006d2c0 0x7f827013e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.029+0000 7f8275400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f827006d2c0 0x7f827013e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54596/0 (socket says 172.21.15.144:54596) 2024-09-11T23:25:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.029+0000 7f8275400640 1 -- 172.21.15.144:0/3821398396 learned_addr learned my addr 172.21.15.144:0/3821398396 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.029+0000 7f8275e00640 1 --2- 172.21.15.144:0/3821398396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8270144610 0x7f827006bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.029+0000 7f8274a00640 1 --2- 172.21.15.144:0/3821398396 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82700721e0 0x7f827013c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:47.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.029+0000 7f8275400640 1 -- 172.21.15.144:0/3821398396 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82700721e0 msgr2=0x7f827013c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.029+0000 7f8275400640 1 --2- 172.21.15.144:0/3821398396 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82700721e0 0x7f827013c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.029+0000 7f8275400640 1 -- 172.21.15.144:0/3821398396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8270144610 msgr2=0x7f827006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.029+0000 7f8275400640 1 --2- 172.21.15.144:0/3821398396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8270144610 0x7f827006bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.029+0000 7f8275400640 1 -- 172.21.15.144:0/3821398396 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8270157be0 con 0x7f827006d2c0 2024-09-11T23:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.029+0000 7f8275400640 1 --2- 172.21.15.144:0/3821398396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f827006d2c0 0x7f827013e780 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f826400c3f0 tx=0x7f826400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.030+0000 7f826d600640 1 -- 172.21.15.144:0/3821398396 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82640074e0 con 0x7f827006d2c0 2024-09-11T23:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.030+0000 7f826d600640 1 -- 172.21.15.144:0/3821398396 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82640047e0 con 0x7f827006d2c0 2024-09-11T23:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.030+0000 7f8276800640 1 -- 172.21.15.144:0/3821398396 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8270157ec0 con 0x7f827006d2c0 2024-09-11T23:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.030+0000 7f826d600640 1 -- 172.21.15.144:0/3821398396 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8264004c10 con 0x7f827006d2c0 2024-09-11T23:25:47.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.030+0000 7f8276800640 1 -- 172.21.15.144:0/3821398396 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82701406f0 con 0x7f827006d2c0 2024-09-11T23:25:47.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.031+0000 7f8276800640 1 -- 172.21.15.144:0/3821398396 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f827006cbb0 con 0x7f827006d2c0 2024-09-11T23:25:47.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.032+0000 7f826d600640 1 -- 172.21.15.144:0/3821398396 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f8264011070 con 0x7f827006d2c0 2024-09-11T23:25:47.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.033+0000 7f826d600640 1 --2- 172.21.15.144:0/3821398396 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f825006c610 0x7f825006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:47.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.033+0000 7f826d600640 1 -- 172.21.15.144:0/3821398396 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f826408b9f0 con 0x7f827006d2c0 2024-09-11T23:25:47.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.033+0000 7f8274a00640 1 --2- 172.21.15.144:0/3821398396 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f825006c610 0x7f825006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:47.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.034+0000 7f8274a00640 1 --2- 172.21.15.144:0/3821398396 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f825006c610 0x7f825006ead0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8270159ef0 tx=0x7f825c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:47.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.037+0000 7f826d600640 1 -- 172.21.15.144:0/3821398396 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f826401a2b0 con 0x7f827006d2c0 2024-09-11T23:25:47.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.210+0000 7f8276800640 1 -- 172.21.15.144:0/3821398396 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f82700761a0 con 0x7f827006d2c0 2024-09-11T23:25:47.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.213+0000 7f826d600640 1 -- 172.21.15.144:0/3821398396 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f8264059710 con 0x7f827006d2c0 2024-09-11T23:25:47.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.216+0000 7f8276800640 1 -- 172.21.15.144:0/3821398396 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f825006c610 msgr2=0x7f825006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:47.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.216+0000 7f8276800640 1 --2- 172.21.15.144:0/3821398396 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f825006c610 0x7f825006ead0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8270159ef0 tx=0x7f825c009040 comp rx=0 tx=0).stop 2024-09-11T23:25:47.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.216+0000 7f8276800640 1 -- 172.21.15.144:0/3821398396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f827006d2c0 msgr2=0x7f827013e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:47.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.216+0000 7f8276800640 1 --2- 172.21.15.144:0/3821398396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f827006d2c0 0x7f827013e780 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f826400c3f0 tx=0x7f826400c8b0 comp rx=0 tx=0).stop 2024-09-11T23:25:47.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.216+0000 7f8276800640 1 -- 172.21.15.144:0/3821398396 shutdown_connections 2024-09-11T23:25:47.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.216+0000 7f8276800640 1 --2- 172.21.15.144:0/3821398396 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f825006c610 0x7f825006ead0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:47.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.216+0000 7f8276800640 1 --2- 172.21.15.144:0/3821398396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8270144610 0x7f827006bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:47.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.216+0000 7f8276800640 1 --2- 172.21.15.144:0/3821398396 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f82700721e0 0x7f827013c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:47.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.216+0000 7f8276800640 1 --2- 172.21.15.144:0/3821398396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f827006d2c0 0x7f827013e780 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:47.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.216+0000 7f8276800640 1 -- 172.21.15.144:0/3821398396 >> 172.21.15.144:0/3821398396 conn(0x7f82700cd780 msgr2=0x7f82700cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:47.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.216+0000 7f8276800640 1 -- 172.21.15.144:0/3821398396 shutdown_connections 2024-09-11T23:25:47.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.216+0000 7f8276800640 1 -- 172.21.15.144:0/3821398396 wait complete. 2024-09-11T23:25:47.231 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:25:47.231 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:25:47.325 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:25:47.441 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:25:47.441 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:25:47.441 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:25:47.476 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:25:47.476 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:25:47.476 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:25:47.513 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:25:47.513 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:25:47.514 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:25:47.552 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:25:47.552 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:25:47.552 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:25:47.590 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:25:47.590 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T23:25:47.590 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:25:47.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.747+0000 7fb173000640 1 Processor -- start 2024-09-11T23:25:47.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.748+0000 7fb173000640 1 -- start start 2024-09-11T23:25:47.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.749+0000 7fb173000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb16c15ca40 0x7fb16c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:47.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.749+0000 7fb173000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb16c15ce80 0x7fb16c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:47.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.749+0000 7fb173000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb16c15d390 con 0x7fb16c0d02a0 2024-09-11T23:25:47.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.749+0000 7fb173000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb16c15d670 con 0x7fb16c15ce80 2024-09-11T23:25:47.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.749+0000 7fb173000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb16c15d950 con 0x7fb16c15ca40 2024-09-11T23:25:47.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.749+0000 7fb171000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb16c15ce80 0x7fb16c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:47.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.749+0000 7fb171000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb16c15ce80 0x7fb16c1594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54606/0 (socket says 172.21.15.144:54606) 2024-09-11T23:25:47.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.749+0000 7fb171000640 1 -- 172.21.15.144:0/2137526455 learned_addr learned my addr 172.21.15.144:0/2137526455 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:47.749 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.749+0000 7fb163400640 1 --2- 172.21.15.144:0/2137526455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb16c15ca40 0x7fb16c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:47.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.750+0000 7fb163400640 1 -- 172.21.15.144:0/2137526455 >> v2:172.21.15.144:3300/0 conn(0x7fb16c15ce80 msgr2=0x7fb16c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:47.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.750+0000 7fb163400640 1 --2- 172.21.15.144:0/2137526455 >> v2:172.21.15.144:3300/0 conn(0x7fb16c15ce80 0x7fb16c1594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:47.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.750+0000 7fb163400640 1 -- 172.21.15.144:0/2137526455 >> v1:172.21.15.165:6789/0 conn(0x7fb16c0d02a0 legacy=0x7fb16c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:47.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.750+0000 7fb163400640 1 -- 172.21.15.144:0/2137526455 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16c15dc30 con 0x7fb16c15ca40 2024-09-11T23:25:47.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.750+0000 7fb16b400640 1 -- 172.21.15.144:0/2137526455 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 888511170 0 0) 0x7fb16c15d390 con 0x7fb16c0d02a0 2024-09-11T23:25:47.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.750+0000 7fb171000640 1 --2- 172.21.15.144:0/2137526455 >> v2:172.21.15.144:3300/0 conn(0x7fb16c15ce80 0x7fb16c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:25:47.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.751+0000 7fb163400640 1 --2- 172.21.15.144:0/2137526455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb16c15ca40 0x7fb16c15e430 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb1540097a0 tx=0x7fb15402a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5959cfd6c98d769 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:47.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.751+0000 7fb16b400640 1 -- 172.21.15.144:0/2137526455 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154037070 con 0x7fb16c15ca40 2024-09-11T23:25:47.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.751+0000 7fb16b400640 1 -- 172.21.15.144:0/2137526455 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb15402ae40 con 0x7fb16c15ca40 2024-09-11T23:25:47.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.751+0000 7fb16b400640 1 -- 172.21.15.144:0/2137526455 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154032660 con 0x7fb16c15ca40 2024-09-11T23:25:47.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.751+0000 7fb173000640 1 -- 172.21.15.144:0/2137526455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb16c15ca40 msgr2=0x7fb16c15e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:47.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.751+0000 7fb173000640 1 --2- 172.21.15.144:0/2137526455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb16c15ca40 0x7fb16c15e430 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb1540097a0 tx=0x7fb15402a0f0 comp rx=0 tx=0).stop 2024-09-11T23:25:47.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.752+0000 7fb173000640 1 -- 172.21.15.144:0/2137526455 shutdown_connections 2024-09-11T23:25:47.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.752+0000 7fb173000640 1 --2- 172.21.15.144:0/2137526455 >> v2:172.21.15.144:3300/0 conn(0x7fb16c15ce80 0x7fb16c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:47.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.752+0000 7fb173000640 1 --2- 172.21.15.144:0/2137526455 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb16c15ca40 0x7fb16c15e430 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:47.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.752+0000 7fb173000640 1 -- 172.21.15.144:0/2137526455 >> 172.21.15.144:0/2137526455 conn(0x7fb16c062cc0 msgr2=0x7fb16c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:47.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.752+0000 7fb173000640 1 -- 172.21.15.144:0/2137526455 shutdown_connections 2024-09-11T23:25:47.752 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.752+0000 7fb173000640 1 -- 172.21.15.144:0/2137526455 wait complete. 2024-09-11T23:25:47.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.753+0000 7fb173000640 1 Processor -- start 2024-09-11T23:25:47.753 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.753+0000 7fb173000640 1 -- start start 2024-09-11T23:25:47.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.754+0000 7fb173000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb16c0d02a0 0x7fb16c14b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:47.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.754+0000 7fb173000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb16c15ca40 0x7fb16c158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:47.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.754+0000 7fb173000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb16c15ce80 0x7fb16c15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:47.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.754+0000 7fb173000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c155d10 con 0x7fb16c15ca40 2024-09-11T23:25:47.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.754+0000 7fb173000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c155b90 con 0x7fb16c15ce80 2024-09-11T23:25:47.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.754+0000 7fb173000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb16c0b4790 con 0x7fb16c0d02a0 2024-09-11T23:25:47.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.754+0000 7fb163400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb16c15ca40 0x7fb16c158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:47.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.755+0000 7fb163400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb16c15ca40 0x7fb16c158720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54618/0 (socket says 172.21.15.144:54618) 2024-09-11T23:25:47.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.755+0000 7fb163400640 1 -- 172.21.15.144:0/2522496522 learned_addr learned my addr 172.21.15.144:0/2522496522 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:47.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.755+0000 7fb16be00640 1 --2- 172.21.15.144:0/2522496522 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb16c0d02a0 0x7fb16c14b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:47.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.755+0000 7fb171000640 1 --2- 172.21.15.144:0/2522496522 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb16c15ce80 0x7fb16c15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:47.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.755+0000 7fb163400640 1 -- 172.21.15.144:0/2522496522 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb16c0d02a0 msgr2=0x7fb16c14b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:47.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.755+0000 7fb163400640 1 --2- 172.21.15.144:0/2522496522 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb16c0d02a0 0x7fb16c14b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:47.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.755+0000 7fb163400640 1 -- 172.21.15.144:0/2522496522 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb16c15ce80 msgr2=0x7fb16c15a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:47.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.755+0000 7fb163400640 1 --2- 172.21.15.144:0/2522496522 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb16c15ce80 0x7fb16c15a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:47.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.755+0000 7fb163400640 1 -- 172.21.15.144:0/2522496522 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16c14f9e0 con 0x7fb16c15ca40 2024-09-11T23:25:47.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.755+0000 7fb163400640 1 --2- 172.21.15.144:0/2522496522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb16c15ca40 0x7fb16c158720 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fb154035040 tx=0x7fb1540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:47.756 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.755+0000 7fb168c00640 1 -- 172.21.15.144:0/2522496522 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154037040 con 0x7fb16c15ca40 2024-09-11T23:25:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.756+0000 7fb168c00640 1 -- 172.21.15.144:0/2522496522 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb154004030 con 0x7fb16c15ca40 2024-09-11T23:25:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.756+0000 7fb168c00640 1 -- 172.21.15.144:0/2522496522 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154004420 con 0x7fb16c15ca40 2024-09-11T23:25:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.756+0000 7fb173000640 1 -- 172.21.15.144:0/2522496522 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb16c14fcc0 con 0x7fb16c15ca40 2024-09-11T23:25:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.756+0000 7fb173000640 1 -- 172.21.15.144:0/2522496522 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb16c150280 con 0x7fb16c15ca40 2024-09-11T23:25:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.757+0000 7fb173000640 1 -- 172.21.15.144:0/2522496522 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb16c0b1a50 con 0x7fb16c15ca40 2024-09-11T23:25:47.757 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.758+0000 7fb168c00640 1 -- 172.21.15.144:0/2522496522 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7fb154003610 con 0x7fb16c15ca40 2024-09-11T23:25:47.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.759+0000 7fb168c00640 1 --2- 172.21.15.144:0/2522496522 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb14806c610 0x7fb14806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:47.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.759+0000 7fb168c00640 1 -- 172.21.15.144:0/2522496522 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7fb1540acb10 con 0x7fb16c15ca40 2024-09-11T23:25:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.759+0000 7fb16be00640 1 --2- 172.21.15.144:0/2522496522 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb14806c610 0x7fb14806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:47.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.760+0000 7fb16be00640 1 --2- 172.21.15.144:0/2522496522 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb14806c610 0x7fb14806ead0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0cc8a0 tx=0x7fb15c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:47.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.763+0000 7fb168c00640 1 -- 172.21.15.144:0/2522496522 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb16c0b1a50 con 0x7fb16c15ca40 2024-09-11T23:25:47.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.971+0000 7fb173000640 1 -- 172.21.15.144:0/2522496522 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb16c0d0680 con 0x7fb16c15ca40 2024-09-11T23:25:47.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.972+0000 7fb168c00640 1 -- 172.21.15.144:0/2522496522 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+3925 (secure 0 0 0) 0x7fb15407a950 con 0x7fb16c15ca40 2024-09-11T23:25:47.972 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:47.972 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":103,"btime":"2024-09-11T23:25:41:565707+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6893,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2346696977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2346696977},{"type":"v1","addr":"172.21.15.165:6834","nonce":2346696977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/3411942787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":3411942787},{"type":"v1","addr":"172.21.15.165:6835","nonce":3411942787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/1554186582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1554186582},{"type":"v1","addr":"172.21.15.144:6801","nonce":1554186582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":8565,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1023341061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1023341061},{"type":"v1","addr":"172.21.15.144:6835","nonce":1023341061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[]} 2024-09-11T23:25:47.972 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 103 2024-09-11T23:25:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.974+0000 7fb173000640 1 -- 172.21.15.144:0/2522496522 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb14806c610 msgr2=0x7fb14806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.974+0000 7fb173000640 1 --2- 172.21.15.144:0/2522496522 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb14806c610 0x7fb14806ead0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0cc8a0 tx=0x7fb15c009040 comp rx=0 tx=0).stop 2024-09-11T23:25:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.974+0000 7fb173000640 1 -- 172.21.15.144:0/2522496522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb16c15ca40 msgr2=0x7fb16c158720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.974+0000 7fb173000640 1 --2- 172.21.15.144:0/2522496522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb16c15ca40 0x7fb16c158720 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fb154035040 tx=0x7fb1540046c0 comp rx=0 tx=0).stop 2024-09-11T23:25:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.974+0000 7fb173000640 1 -- 172.21.15.144:0/2522496522 shutdown_connections 2024-09-11T23:25:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.974+0000 7fb173000640 1 --2- 172.21.15.144:0/2522496522 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb14806c610 0x7fb14806ead0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.974+0000 7fb173000640 1 --2- 172.21.15.144:0/2522496522 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb16c15ce80 0x7fb16c15a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.974+0000 7fb173000640 1 --2- 172.21.15.144:0/2522496522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb16c15ca40 0x7fb16c158720 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:47.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.974+0000 7fb173000640 1 --2- 172.21.15.144:0/2522496522 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb16c0d02a0 0x7fb16c14b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:47.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.974+0000 7fb173000640 1 -- 172.21.15.144:0/2522496522 >> 172.21.15.144:0/2522496522 conn(0x7fb16c062cc0 msgr2=0x7fb16c06c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:47.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.974+0000 7fb173000640 1 -- 172.21.15.144:0/2522496522 shutdown_connections 2024-09-11T23:25:47.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:47.974+0000 7fb173000640 1 -- 172.21.15.144:0/2522496522 wait complete. 2024-09-11T23:25:47.991 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:25:47.991 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:25:47.991 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:25:47.991 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:25:47.991 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:25:47.992 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T23:25:47.992 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:25:47.992 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:25:47.992 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:25:47.992 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:25:47.992 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:25:47.992 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:25:47.993 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:25:47.993 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T23:25:47.993 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:25:47.993 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:25:48.009 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:25:48.009 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:25:48.010 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:25:48.010 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:25:48.011 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:25:48.011 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:25:48.012 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:25:48.012 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:25:48.054 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:25:48.054 DEBUG:teuthology.parallel:result is None 2024-09-11T23:25:48.055 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:25:48.056 DEBUG:teuthology.parallel:result is None 2024-09-11T23:25:48.056 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:25:48.056 DEBUG:teuthology.parallel:result is None 2024-09-11T23:25:48.057 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:25:48.058 DEBUG:teuthology.parallel:result is None 2024-09-11T23:25:48.058 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:25:48.185 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-11T23:25:48.186 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-11T23:25:48.186 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-11T23:25:48.187 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-11T23:25:48.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.222+0000 7f809f600640 1 Processor -- start 2024-09-11T23:25:48.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.222+0000 7f809f600640 1 -- start start 2024-09-11T23:25:48.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.223+0000 7f809f600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f80980d0a50 0x7f80981620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:48.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.223+0000 7f809f600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80980b4930 0x7f80980b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:48.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.223+0000 7f809f600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80981625f0 con 0x7f809815f620 2024-09-11T23:25:48.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.223+0000 7f809f600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f80980b52d0 con 0x7f80980d0a50 2024-09-11T23:25:48.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.223+0000 7f809f600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8098162870 con 0x7f80980b4930 2024-09-11T23:25:48.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.224+0000 7f809cc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f80980d0a50 0x7f80981620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:48.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.224+0000 7f809d600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f809815f620 0x7f809815fab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43424/0 (socket says 172.21.15.144:43424) 2024-09-11T23:25:48.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.224+0000 7f809d600640 1 -- 172.21.15.144:0/28078939 learned_addr learned my addr 172.21.15.144:0/28078939 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:48.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.224+0000 7f8097e00640 1 --2- 172.21.15.144:0/28078939 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80980b4930 0x7f80980b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:48.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.224+0000 7f809cc00640 1 -- 172.21.15.144:0/28078939 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80980b4930 msgr2=0x7f80980b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:48.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.224+0000 7f809cc00640 1 --2- 172.21.15.144:0/28078939 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80980b4930 0x7f80980b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:48.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.224+0000 7f809cc00640 1 -- 172.21.15.144:0/28078939 >> v1:172.21.15.144:6789/0 conn(0x7f809815f620 legacy=0x7f809815fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:48.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.224+0000 7f809cc00640 1 -- 172.21.15.144:0/28078939 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8098162b50 con 0x7f80980d0a50 2024-09-11T23:25:48.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.224+0000 7f8097400640 1 -- 172.21.15.144:0/28078939 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 924924964 0 0) 0x7f8090001490 con 0x7f809815f620 2024-09-11T23:25:48.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.225+0000 7f809cc00640 1 --2- 172.21.15.144:0/28078939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80980d0a50 0x7f80981620b0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f808c0097a0 tx=0x7f808c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da85ac2711bf28e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:48.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.225+0000 7f8097400640 1 -- 172.21.15.144:0/28078939 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c037070 con 0x7f80980d0a50 2024-09-11T23:25:48.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.225+0000 7f8097400640 1 -- 172.21.15.144:0/28078939 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f808c02ae50 con 0x7f80980d0a50 2024-09-11T23:25:48.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.225+0000 7f8097400640 1 -- 172.21.15.144:0/28078939 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c032660 con 0x7f80980d0a50 2024-09-11T23:25:48.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.226+0000 7f809f600640 1 -- 172.21.15.144:0/28078939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80980d0a50 msgr2=0x7f80981620b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:48.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.226+0000 7f809f600640 1 --2- 172.21.15.144:0/28078939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80980d0a50 0x7f80981620b0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f808c0097a0 tx=0x7f808c02a100 comp rx=0 tx=0).stop 2024-09-11T23:25:48.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.226+0000 7f809f600640 1 -- 172.21.15.144:0/28078939 shutdown_connections 2024-09-11T23:25:48.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.226+0000 7f809f600640 1 --2- 172.21.15.144:0/28078939 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f80980b4930 0x7f80980b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:48.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.226+0000 7f809f600640 1 --2- 172.21.15.144:0/28078939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f80980d0a50 0x7f80981620b0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:48.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.226+0000 7f809f600640 1 -- 172.21.15.144:0/28078939 >> 172.21.15.144:0/28078939 conn(0x7f8098062cc0 msgr2=0x7f809806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:48.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.226+0000 7f809f600640 1 -- 172.21.15.144:0/28078939 shutdown_connections 2024-09-11T23:25:48.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.226+0000 7f809f600640 1 -- 172.21.15.144:0/28078939 wait complete. 2024-09-11T23:25:48.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.228+0000 7f809f600640 1 Processor -- start 2024-09-11T23:25:48.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.228+0000 7f809f600640 1 -- start start 2024-09-11T23:25:48.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.229+0000 7f809f600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80980b4930 0x7f8098144f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:48.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.229+0000 7f809f600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f809815f620 0x7f809814a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:48.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.229+0000 7f809f600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f809814b040 0x7f809814a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:48.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.229+0000 7f809f600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f80980b3620 con 0x7f809814b040 2024-09-11T23:25:48.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.229+0000 7f809f600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f80980b3340 con 0x7f80980b4930 2024-09-11T23:25:48.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.229+0000 7f809f600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f80980b3b40 con 0x7f809815f620 2024-09-11T23:25:48.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.229+0000 7f809d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f809814b040 0x7f809814a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:48.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.229+0000 7f809d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f809814b040 0x7f809814a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54644/0 (socket says 172.21.15.144:54644) 2024-09-11T23:25:48.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.229+0000 7f809d600640 1 -- 172.21.15.144:0/2135424159 learned_addr learned my addr 172.21.15.144:0/2135424159 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:48.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.229+0000 7f8097e00640 1 --2- 172.21.15.144:0/2135424159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f809815f620 0x7f809814a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:48.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.229+0000 7f809cc00640 1 --2- 172.21.15.144:0/2135424159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80980b4930 0x7f8098144f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:48.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.229+0000 7f809d600640 1 -- 172.21.15.144:0/2135424159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f809815f620 msgr2=0x7f809814a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:48.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.229+0000 7f809d600640 1 --2- 172.21.15.144:0/2135424159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f809815f620 0x7f809814a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:48.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.229+0000 7f809d600640 1 -- 172.21.15.144:0/2135424159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80980b4930 msgr2=0x7f8098144f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:48.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.229+0000 7f809d600640 1 --2- 172.21.15.144:0/2135424159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80980b4930 0x7f8098144f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:48.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.229+0000 7f809d600640 1 -- 172.21.15.144:0/2135424159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8098073c50 con 0x7f809814b040 2024-09-11T23:25:48.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.229+0000 7f8097e00640 1 --2- 172.21.15.144:0/2135424159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f809815f620 0x7f809814a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:48.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.229+0000 7f809cc00640 1 --2- 172.21.15.144:0/2135424159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80980b4930 0x7f8098144f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:48.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.230+0000 7f809d600640 1 --2- 172.21.15.144:0/2135424159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f809814b040 0x7f809814a980 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f809000c700 tx=0x7f809000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:48.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.230+0000 7f8094c00640 1 -- 172.21.15.144:0/2135424159 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090018070 con 0x7f809814b040 2024-09-11T23:25:48.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.230+0000 7f8094c00640 1 -- 172.21.15.144:0/2135424159 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f809000ce10 con 0x7f809814b040 2024-09-11T23:25:48.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.230+0000 7f8094c00640 1 -- 172.21.15.144:0/2135424159 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809000a860 con 0x7f809814b040 2024-09-11T23:25:48.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.230+0000 7f809f600640 1 -- 172.21.15.144:0/2135424159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8098070f40 con 0x7f809814b040 2024-09-11T23:25:48.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.230+0000 7f809f600640 1 -- 172.21.15.144:0/2135424159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8098073ef0 con 0x7f809814b040 2024-09-11T23:25:48.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.231+0000 7f809f600640 1 -- 172.21.15.144:0/2135424159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80980b4d90 con 0x7f809814b040 2024-09-11T23:25:48.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.232+0000 7f8094c00640 1 -- 172.21.15.144:0/2135424159 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f809001b070 con 0x7f809814b040 2024-09-11T23:25:48.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.233+0000 7f8094c00640 1 --2- 172.21.15.144:0/2135424159 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f807806c610 0x7f807806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:48.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.233+0000 7f8094c00640 1 -- 172.21.15.144:0/2135424159 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f809008b3a0 con 0x7f809814b040 2024-09-11T23:25:48.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.233+0000 7f809cc00640 1 --2- 172.21.15.144:0/2135424159 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f807806c610 0x7f807806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:48.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.234+0000 7f809cc00640 1 --2- 172.21.15.144:0/2135424159 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f807806c610 0x7f807806ead0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f808c034000 tx=0x7f808c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:48.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.237+0000 7f8094c00640 1 -- 172.21.15.144:0/2135424159 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f80981625f0 con 0x7f809814b040 2024-09-11T23:25:48.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.421+0000 7f809f600640 1 -- 172.21.15.144:0/2135424159 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f80980cfdc0 con 0x7f809814b040 2024-09-11T23:25:48.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.859+0000 7f8094c00640 1 -- 172.21.15.144:0/2135424159 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v147) ==== 97+0+0 (secure 0 0 0) 0x7f80900590f0 con 0x7f809814b040 2024-09-11T23:25:48.860 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-11T23:25:48.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.862+0000 7f809f600640 1 -- 172.21.15.144:0/2135424159 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f807806c610 msgr2=0x7f807806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:48.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.862+0000 7f809f600640 1 --2- 172.21.15.144:0/2135424159 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f807806c610 0x7f807806ead0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f808c034000 tx=0x7f808c02e000 comp rx=0 tx=0).stop 2024-09-11T23:25:48.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.862+0000 7f809f600640 1 -- 172.21.15.144:0/2135424159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f809814b040 msgr2=0x7f809814a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:48.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.862+0000 7f809f600640 1 --2- 172.21.15.144:0/2135424159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f809814b040 0x7f809814a980 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f809000c700 tx=0x7f809000cbc0 comp rx=0 tx=0).stop 2024-09-11T23:25:48.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.863+0000 7f809f600640 1 -- 172.21.15.144:0/2135424159 shutdown_connections 2024-09-11T23:25:48.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.863+0000 7f809f600640 1 --2- 172.21.15.144:0/2135424159 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f807806c610 0x7f807806ead0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:48.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.863+0000 7f809f600640 1 --2- 172.21.15.144:0/2135424159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f809814b040 0x7f809814a980 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:48.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.863+0000 7f809f600640 1 --2- 172.21.15.144:0/2135424159 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f809815f620 0x7f809814a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:48.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.863+0000 7f809f600640 1 --2- 172.21.15.144:0/2135424159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80980b4930 0x7f8098144f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:48.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.863+0000 7f809f600640 1 -- 172.21.15.144:0/2135424159 >> 172.21.15.144:0/2135424159 conn(0x7f8098062cc0 msgr2=0x7f809815b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:48.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.863+0000 7f809f600640 1 -- 172.21.15.144:0/2135424159 shutdown_connections 2024-09-11T23:25:48.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:48.863+0000 7f809f600640 1 -- 172.21.15.144:0/2135424159 wait complete. 2024-09-11T23:25:48.883 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:25:49.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.036+0000 7f42b5e00640 1 Processor -- start 2024-09-11T23:25:49.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.036+0000 7f42b5e00640 1 -- start start 2024-09-11T23:25:49.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.038+0000 7f42b5e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42b00cf070 0x7f42b00cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:49.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.038+0000 7f42b5e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f42b0073120 0x7f42b0073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:49.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.038+0000 7f42b5e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42b00ce740 con 0x7f42b015c180 2024-09-11T23:25:49.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.038+0000 7f42b5e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f42b0072640 con 0x7f42b0073120 2024-09-11T23:25:49.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.038+0000 7f42b5e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f42b0072920 con 0x7f42b00cf070 2024-09-11T23:25:49.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.038+0000 7f42af400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f42b0073120 0x7f42b0073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:49.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.038+0000 7f42af400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f42b0073120 0x7f42b0073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54658/0 (socket says 172.21.15.144:54658) 2024-09-11T23:25:49.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.038+0000 7f42af400640 1 -- 172.21.15.144:0/2388410755 learned_addr learned my addr 172.21.15.144:0/2388410755 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:49.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.038+0000 7f42aea00640 1 --1- 172.21.15.144:0/2388410755 >> v1:172.21.15.144:6789/0 conn(0x7f42b015c180 0x7f42b00cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43436/0 (socket says 172.21.15.144:43436) 2024-09-11T23:25:49.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.038+0000 7f42a6000640 1 --2- 172.21.15.144:0/2388410755 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42b00cf070 0x7f42b00cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:49.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.038+0000 7f42af400640 1 -- 172.21.15.144:0/2388410755 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42b00cf070 msgr2=0x7f42b00cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:49.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.038+0000 7f42af400640 1 --2- 172.21.15.144:0/2388410755 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42b00cf070 0x7f42b00cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.038+0000 7f42af400640 1 -- 172.21.15.144:0/2388410755 >> v1:172.21.15.144:6789/0 conn(0x7f42b015c180 legacy=0x7f42b00cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.039+0000 7f42af400640 1 -- 172.21.15.144:0/2388410755 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b0072c00 con 0x7f42b0073120 2024-09-11T23:25:49.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.038+0000 7f42ae000640 1 -- 172.21.15.144:0/2388410755 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4151916309 0 0) 0x7f42b00ce740 con 0x7f42b015c180 2024-09-11T23:25:49.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.039+0000 7f42af400640 1 --2- 172.21.15.144:0/2388410755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0073120 0x7f42b0073590 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f42a8009e50 tx=0x7f42a802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4abf06eb5d876d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:49.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.040+0000 7f42ae000640 1 -- 172.21.15.144:0/2388410755 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a8036070 con 0x7f42b0073120 2024-09-11T23:25:49.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.040+0000 7f42ae000640 1 -- 172.21.15.144:0/2388410755 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42a8031600 con 0x7f42b0073120 2024-09-11T23:25:49.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.040+0000 7f42ae000640 1 -- 172.21.15.144:0/2388410755 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a80319d0 con 0x7f42b0073120 2024-09-11T23:25:49.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.040+0000 7f42b5e00640 1 -- 172.21.15.144:0/2388410755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0073120 msgr2=0x7f42b0073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.040+0000 7f42b5e00640 1 --2- 172.21.15.144:0/2388410755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0073120 0x7f42b0073590 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f42a8009e50 tx=0x7f42a802a6a0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.040+0000 7f42b5e00640 1 -- 172.21.15.144:0/2388410755 shutdown_connections 2024-09-11T23:25:49.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.040+0000 7f42b5e00640 1 --2- 172.21.15.144:0/2388410755 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0073120 0x7f42b0073590 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.040+0000 7f42b5e00640 1 --2- 172.21.15.144:0/2388410755 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42b00cf070 0x7f42b00cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.040+0000 7f42b5e00640 1 -- 172.21.15.144:0/2388410755 >> 172.21.15.144:0/2388410755 conn(0x7f42b0062cc0 msgr2=0x7f42b006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:49.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.040+0000 7f42b5e00640 1 -- 172.21.15.144:0/2388410755 shutdown_connections 2024-09-11T23:25:49.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.040+0000 7f42b5e00640 1 -- 172.21.15.144:0/2388410755 wait complete. 2024-09-11T23:25:49.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.042+0000 7f42b5e00640 1 Processor -- start 2024-09-11T23:25:49.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.042+0000 7f42b5e00640 1 -- start start 2024-09-11T23:25:49.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.043+0000 7f42b5e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0073120 0x7f42b014e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.043+0000 7f42b5e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42b00cf070 0x7f42b00b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.043+0000 7f42b5e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42b015c180 0x7f42b014bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.043+0000 7f42b5e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f42b00722f0 con 0x7f42b0073120 2024-09-11T23:25:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.043+0000 7f42b5e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f42b00ced00 con 0x7f42b015c180 2024-09-11T23:25:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.043+0000 7f42b5e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f42b015c560 con 0x7f42b00cf070 2024-09-11T23:25:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.043+0000 7f42aea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0073120 0x7f42b014e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.043+0000 7f42aea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0073120 0x7f42b014e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54670/0 (socket says 172.21.15.144:54670) 2024-09-11T23:25:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.043+0000 7f42aea00640 1 -- 172.21.15.144:0/1748127441 learned_addr learned my addr 172.21.15.144:0/1748127441 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.043+0000 7f42a6000640 1 --2- 172.21.15.144:0/1748127441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42b00cf070 0x7f42b00b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.043+0000 7f42af400640 1 --2- 172.21.15.144:0/1748127441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42b015c180 0x7f42b014bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.044+0000 7f42aea00640 1 -- 172.21.15.144:0/1748127441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42b00cf070 msgr2=0x7f42b00b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.044+0000 7f42aea00640 1 --2- 172.21.15.144:0/1748127441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42b00cf070 0x7f42b00b22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.044+0000 7f42aea00640 1 -- 172.21.15.144:0/1748127441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42b015c180 msgr2=0x7f42b014bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.044+0000 7f42aea00640 1 --2- 172.21.15.144:0/1748127441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42b015c180 0x7f42b014bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.044+0000 7f42aea00640 1 -- 172.21.15.144:0/1748127441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b00d0990 con 0x7f42b0073120 2024-09-11T23:25:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.044+0000 7f42aea00640 1 --2- 172.21.15.144:0/1748127441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0073120 0x7f42b014e240 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f42a000c4b0 tx=0x7f42a000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.044+0000 7f42a7e00640 1 -- 172.21.15.144:0/1748127441 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a0018070 con 0x7f42b0073120 2024-09-11T23:25:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.044+0000 7f42a7e00640 1 -- 172.21.15.144:0/1748127441 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42a0007480 con 0x7f42b0073120 2024-09-11T23:25:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.044+0000 7f42b5e00640 1 -- 172.21.15.144:0/1748127441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b00d06b0 con 0x7f42b0073120 2024-09-11T23:25:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.044+0000 7f42a7e00640 1 -- 172.21.15.144:0/1748127441 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a0004820 con 0x7f42b0073120 2024-09-11T23:25:49.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.044+0000 7f42b5e00640 1 -- 172.21.15.144:0/1748127441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b0150fa0 con 0x7f42b0073120 2024-09-11T23:25:49.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.045+0000 7f42b5e00640 1 -- 172.21.15.144:0/1748127441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b00cf4b0 con 0x7f42b0073120 2024-09-11T23:25:49.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.046+0000 7f42a7e00640 1 -- 172.21.15.144:0/1748127441 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f42a001b070 con 0x7f42b0073120 2024-09-11T23:25:49.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.047+0000 7f42a7e00640 1 --2- 172.21.15.144:0/1748127441 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f428c06c610 0x7f428c06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:49.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.047+0000 7f42a7e00640 1 -- 172.21.15.144:0/1748127441 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 4857+0+0 (secure 0 0 0) 0x7f42a008b190 con 0x7f42b0073120 2024-09-11T23:25:49.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.048+0000 7f42a6000640 1 --2- 172.21.15.144:0/1748127441 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f428c06c610 0x7f428c06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:49.048 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.048+0000 7f42a6000640 1 --2- 172.21.15.144:0/1748127441 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f428c06c610 0x7f428c06ead0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4298006fd0 tx=0x7f4298008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:49.051 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.051+0000 7f42a7e00640 1 -- 172.21.15.144:0/1748127441 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42a0058ea0 con 0x7f42b0073120 2024-09-11T23:25:49.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.292+0000 7f42b5e00640 1 -- 172.21.15.144:0/1748127441 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f42b01569b0 con 0x7f42b0073120 2024-09-11T23:25:49.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.292+0000 7f42a7e00640 1 -- 172.21.15.144:0/1748127441 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) ==== 80+0+5304 (secure 0 0 0) 0x7f42a00587a0 con 0x7f42b0073120 2024-09-11T23:25:49.292 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:49.292 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:25:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-11T23:25:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-11T23:25:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmQjymBhAA4BWEVNGY37RsnMGLL3Ow8A==", 2024-09-11T23:25:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:25:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:25:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:25:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:49.293 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-11T23:25:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmD0mIGhAAvug7T/kOcEmnyMyG++V+zA==", 2024-09-11T23:25:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:25:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:25:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:25:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-11T23:25:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmDwSZEBAAdf4eF3MrADSPzBTICzpOiA==", 2024-09-11T23:25:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:49.294 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:25:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:25:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:25:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-11T23:25:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmqYtRJBAAgpzvHNUPVnxNoflhqVIJuQ==", 2024-09-11T23:25:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:25:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:25:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:25:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-11T23:25:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDiJOJmzDABABAA+Qa772+Mm69pecG0QUXlyA==", 2024-09-11T23:25:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:25:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:25:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-11T23:25:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDlJOJmgVjJKRAAtl30JxJHurKdrn1vLUneww==", 2024-09-11T23:25:49.296 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:25:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:25:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-11T23:25:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDpJOJmRzO6FxAAiLDOwDlXYTj6WfEhlI+uVQ==", 2024-09-11T23:25:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:25:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:25:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-11T23:25:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDtJOJmVFh6EhAA7hcJn4k31nEPMcqiB7+djA==", 2024-09-11T23:25:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:25:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:25:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-11T23:25:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD0JOJmpIFTAhAAYQyoBrMjL6CcDDCNAOMGwQ==", 2024-09-11T23:25:49.298 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:25:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:25:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-11T23:25:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD4JOJmBAIIDhAA8G/usUslfQPNpFP1YZsgmg==", 2024-09-11T23:25:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:25:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:25:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:49.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-11T23:25:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD8JOJmDl2dCBAA5bL+2AIp0uWL4qjpI/mAdQ==", 2024-09-11T23:25:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:25:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:25:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-11T23:25:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAAJeJmMWX+AhAA7ABVgJPwhRZNkPNdZzmnOQ==", 2024-09-11T23:25:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:49.300 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:25:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:25:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-11T23:25:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A==", 2024-09-11T23:25:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:25:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-11T23:25:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T23:25:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:49.301 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-11T23:25:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmLFrBORAAT64lj0sWlVoTHVUZQf0JjA==", 2024-09-11T23:25:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:25:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:25:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:25:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:25:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-11T23:25:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJm2/dLMxAAbuKdVAbscrlF5jcBnouBOQ==", 2024-09-11T23:25:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:25:49.302 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:25:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:25:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:25:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-11T23:25:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDfJOJmse6UBBAAq+3afsp+2jApe9sTFmVVOw==", 2024-09-11T23:25:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:25:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:25:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:25:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:25:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:49.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-11T23:25:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmHmAwEhAAEGCvu0NgtyjIPcJBk6bkdA==", 2024-09-11T23:25:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:25:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:25:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:25:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-11T23:25:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmxMaVOxAA62zJwlyk0qdrsemalijH4Q==", 2024-09-11T23:25:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:49.304 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:25:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:25:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:25:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-11T23:25:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmWZRNNBAAwZ2GCP7mGn87ZSnsKCcDRQ==", 2024-09-11T23:25:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:25:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:25:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:25:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:25:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.305 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:25:49.306 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:25:49.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.295+0000 7f42b5e00640 1 -- 172.21.15.144:0/1748127441 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f428c06c610 msgr2=0x7f428c06ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.295+0000 7f42b5e00640 1 --2- 172.21.15.144:0/1748127441 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f428c06c610 0x7f428c06ead0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4298006fd0 tx=0x7f4298008040 comp rx=0 tx=0).stop 2024-09-11T23:25:49.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.295+0000 7f42b5e00640 1 -- 172.21.15.144:0/1748127441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0073120 msgr2=0x7f42b014e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.295+0000 7f42b5e00640 1 --2- 172.21.15.144:0/1748127441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0073120 0x7f42b014e240 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f42a000c4b0 tx=0x7f42a000c970 comp rx=0 tx=0).stop 2024-09-11T23:25:49.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.295+0000 7f42b5e00640 1 -- 172.21.15.144:0/1748127441 shutdown_connections 2024-09-11T23:25:49.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.295+0000 7f42b5e00640 1 --2- 172.21.15.144:0/1748127441 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f428c06c610 0x7f428c06ead0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.295+0000 7f42b5e00640 1 --2- 172.21.15.144:0/1748127441 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f42b015c180 0x7f42b014bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.295+0000 7f42b5e00640 1 --2- 172.21.15.144:0/1748127441 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f42b00cf070 0x7f42b00b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.295+0000 7f42b5e00640 1 --2- 172.21.15.144:0/1748127441 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f42b0073120 0x7f42b014e240 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.295+0000 7f42b5e00640 1 -- 172.21.15.144:0/1748127441 >> 172.21.15.144:0/1748127441 conn(0x7f42b0062cc0 msgr2=0x7f42b006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:49.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.295+0000 7f42b5e00640 1 -- 172.21.15.144:0/1748127441 shutdown_connections 2024-09-11T23:25:49.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.295+0000 7f42b5e00640 1 -- 172.21.15.144:0/1748127441 wait complete. 2024-09-11T23:25:49.310 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:25:49.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.463+0000 7f104bc00640 1 Processor -- start 2024-09-11T23:25:49.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.463+0000 7f104bc00640 1 -- start start 2024-09-11T23:25:49.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.464+0000 7f104bc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f10440d02a0 0x7f10440d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:49.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.464+0000 7f104bc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10440d0bc0 con 0x7f104415ca40 2024-09-11T23:25:49.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.464+0000 7f104bc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f104415d390 con 0x7f104415ceb0 2024-09-11T23:25:49.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.464+0000 7f104bc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f104415d670 con 0x7f10440d02a0 2024-09-11T23:25:49.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.465+0000 7f1049200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f10440d02a0 0x7f10440d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:49.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.465+0000 7f1043e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f104415ca40 0x7f104415e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43442/0 (socket says 172.21.15.144:43442) 2024-09-11T23:25:49.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.465+0000 7f1043e00640 1 -- 172.21.15.144:0/1204083741 learned_addr learned my addr 172.21.15.144:0/1204083741 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:49.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.465+0000 7f1049200640 1 -- 172.21.15.144:0/1204083741 >> v1:172.21.15.165:6789/0 conn(0x7f104415ceb0 legacy=0x7f10441594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.465+0000 7f1049200640 1 -- 172.21.15.144:0/1204083741 >> v1:172.21.15.144:6789/0 conn(0x7f104415ca40 legacy=0x7f104415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:49.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.465+0000 7f1049200640 1 -- 172.21.15.144:0/1204083741 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104415d950 con 0x7f10440d02a0 2024-09-11T23:25:49.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.466+0000 7f1049200640 1 --2- 172.21.15.144:0/1204083741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10440d02a0 0x7f10440d0680 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f10380097a0 tx=0x7f103802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e493faa1cc1bc0a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:49.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.466+0000 7f1043400640 1 -- 172.21.15.144:0/1204083741 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1038037070 con 0x7f10440d02a0 2024-09-11T23:25:49.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.466+0000 7f1043400640 1 -- 172.21.15.144:0/1204083741 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f103802ae50 con 0x7f10440d02a0 2024-09-11T23:25:49.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.466+0000 7f1043400640 1 -- 172.21.15.144:0/1204083741 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1038032660 con 0x7f10440d02a0 2024-09-11T23:25:49.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.467+0000 7f104bc00640 1 -- 172.21.15.144:0/1204083741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10440d02a0 msgr2=0x7f10440d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.467+0000 7f104bc00640 1 --2- 172.21.15.144:0/1204083741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10440d02a0 0x7f10440d0680 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f10380097a0 tx=0x7f103802a140 comp rx=0 tx=0).stop 2024-09-11T23:25:49.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.467+0000 7f104bc00640 1 -- 172.21.15.144:0/1204083741 shutdown_connections 2024-09-11T23:25:49.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.467+0000 7f104bc00640 1 --2- 172.21.15.144:0/1204083741 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10440d02a0 0x7f10440d0680 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.467+0000 7f104bc00640 1 -- 172.21.15.144:0/1204083741 >> 172.21.15.144:0/1204083741 conn(0x7f1044062cc0 msgr2=0x7f104406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:49.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.467+0000 7f104bc00640 1 -- 172.21.15.144:0/1204083741 shutdown_connections 2024-09-11T23:25:49.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.467+0000 7f104bc00640 1 -- 172.21.15.144:0/1204083741 wait complete. 2024-09-11T23:25:49.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.469+0000 7f104bc00640 1 Processor -- start 2024-09-11T23:25:49.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.469+0000 7f104bc00640 1 -- start start 2024-09-11T23:25:49.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.470+0000 7f104bc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10440d02a0 0x7f104414c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:49.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.470+0000 7f104bc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f104415ca40 0x7f10441f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:49.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.470+0000 7f104bc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f104415ceb0 0x7f10441e7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:49.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.470+0000 7f104bc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f104415eb40 con 0x7f104415ceb0 2024-09-11T23:25:49.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.470+0000 7f104bc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f104415df10 con 0x7f104415ca40 2024-09-11T23:25:49.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.470+0000 7f104bc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1044155b90 con 0x7f10440d02a0 2024-09-11T23:25:49.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.470+0000 7f1049c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f104415ceb0 0x7f10441e7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:49.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.470+0000 7f1049200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10440d02a0 0x7f104414c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:49.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.470+0000 7f1043e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f104415ca40 0x7f10441f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:49.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.470+0000 7f1049c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f104415ceb0 0x7f10441e7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54688/0 (socket says 172.21.15.144:54688) 2024-09-11T23:25:49.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.470+0000 7f1049c00640 1 -- 172.21.15.144:0/574791275 learned_addr learned my addr 172.21.15.144:0/574791275 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:49.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.470+0000 7f1049c00640 1 -- 172.21.15.144:0/574791275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10440d02a0 msgr2=0x7f104414c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.470+0000 7f1049c00640 1 --2- 172.21.15.144:0/574791275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10440d02a0 0x7f104414c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.470+0000 7f1049c00640 1 -- 172.21.15.144:0/574791275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f104415ca40 msgr2=0x7f10441f41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.470+0000 7f1049c00640 1 --2- 172.21.15.144:0/574791275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f104415ca40 0x7f10441f41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.470+0000 7f1049c00640 1 -- 172.21.15.144:0/574791275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10440ce490 con 0x7f104415ceb0 2024-09-11T23:25:49.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.471+0000 7f1049c00640 1 --2- 172.21.15.144:0/574791275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f104415ceb0 0x7f10441e7de0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f103c00c730 tx=0x7f103c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:49.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.471+0000 7f1040c00640 1 -- 172.21.15.144:0/574791275 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c003b70 con 0x7f104415ceb0 2024-09-11T23:25:49.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.471+0000 7f1040c00640 1 -- 172.21.15.144:0/574791275 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f103c003d10 con 0x7f104415ceb0 2024-09-11T23:25:49.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.471+0000 7f1040c00640 1 -- 172.21.15.144:0/574791275 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c00aa30 con 0x7f104415ceb0 2024-09-11T23:25:49.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.471+0000 7f104bc00640 1 -- 172.21.15.144:0/574791275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10440ce770 con 0x7f104415ceb0 2024-09-11T23:25:49.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.471+0000 7f104bc00640 1 -- 172.21.15.144:0/574791275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10441f4730 con 0x7f104415ceb0 2024-09-11T23:25:49.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.472+0000 7f104bc00640 1 -- 172.21.15.144:0/574791275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10440ce940 con 0x7f104415ceb0 2024-09-11T23:25:49.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.473+0000 7f1040c00640 1 -- 172.21.15.144:0/574791275 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f103c00abd0 con 0x7f104415ceb0 2024-09-11T23:25:49.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.474+0000 7f1040c00640 1 --2- 172.21.15.144:0/574791275 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f102406c610 0x7f102406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:49.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.474+0000 7f1040c00640 1 -- 172.21.15.144:0/574791275 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 4857+0+0 (secure 0 0 0) 0x7f103c08bbc0 con 0x7f104415ceb0 2024-09-11T23:25:49.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.474+0000 7f1049200640 1 --2- 172.21.15.144:0/574791275 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f102406c610 0x7f102406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:49.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.475+0000 7f1049200640 1 --2- 172.21.15.144:0/574791275 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f102406c610 0x7f102406ead0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1038034000 tx=0x7f103802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:49.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.478+0000 7f1040c00640 1 -- 172.21.15.144:0/574791275 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f103c059250 con 0x7f104415ceb0 2024-09-11T23:25:49.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.653+0000 7f104bc00640 1 -- 172.21.15.144:0/574791275 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f10440b4790 con 0x7f104415ceb0 2024-09-11T23:25:49.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.654+0000 7f1040c00640 1 -- 172.21.15.144:0/574791275 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v149) ==== 84+0+65 (secure 0 0 0) 0x7f103c05d550 con 0x7f104415ceb0 2024-09-11T23:25:49.654 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:49.654 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:25:49.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:25:49.654 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-11T23:25:49.654 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-11T23:25:49.654 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:25:49.654 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:25:49.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.656+0000 7f104bc00640 1 -- 172.21.15.144:0/574791275 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f102406c610 msgr2=0x7f102406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.656+0000 7f104bc00640 1 --2- 172.21.15.144:0/574791275 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f102406c610 0x7f102406ead0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1038034000 tx=0x7f103802e000 comp rx=0 tx=0).stop 2024-09-11T23:25:49.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.656+0000 7f104bc00640 1 -- 172.21.15.144:0/574791275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f104415ceb0 msgr2=0x7f10441e7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.656+0000 7f104bc00640 1 --2- 172.21.15.144:0/574791275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f104415ceb0 0x7f10441e7de0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f103c00c730 tx=0x7f103c00cbf0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.656+0000 7f104bc00640 1 -- 172.21.15.144:0/574791275 shutdown_connections 2024-09-11T23:25:49.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.656+0000 7f104bc00640 1 --2- 172.21.15.144:0/574791275 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f102406c610 0x7f102406ead0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.656+0000 7f104bc00640 1 --2- 172.21.15.144:0/574791275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f104415ceb0 0x7f10441e7de0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.656+0000 7f104bc00640 1 --2- 172.21.15.144:0/574791275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f104415ca40 0x7f10441f41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.656+0000 7f104bc00640 1 --2- 172.21.15.144:0/574791275 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f10440d02a0 0x7f104414c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.656+0000 7f104bc00640 1 -- 172.21.15.144:0/574791275 >> 172.21.15.144:0/574791275 conn(0x7f1044062cc0 msgr2=0x7f104406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:49.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.656+0000 7f104bc00640 1 -- 172.21.15.144:0/574791275 shutdown_connections 2024-09-11T23:25:49.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.656+0000 7f104bc00640 1 -- 172.21.15.144:0/574791275 wait complete. 2024-09-11T23:25:49.672 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:25:49.672 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:25:49.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.830+0000 7f083de00640 1 Processor -- start 2024-09-11T23:25:49.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.830+0000 7f083de00640 1 -- start start 2024-09-11T23:25:49.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.832+0000 7f083de00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f083806e500 0x7f0838167310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:49.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.832+0000 7f083de00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08380b4240 con 0x7f08380cf5d0 2024-09-11T23:25:49.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.832+0000 7f083de00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08380b4520 con 0x7f0838145d90 2024-09-11T23:25:49.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.832+0000 7f083de00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f083806d080 con 0x7f083806e500 2024-09-11T23:25:49.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.832+0000 7f0836000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f08380cf5d0 0x7f08380cfa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43456/0 (socket says 172.21.15.144:43456) 2024-09-11T23:25:49.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.832+0000 7f0836000640 1 -- 172.21.15.144:0/1006300819 learned_addr learned my addr 172.21.15.144:0/1006300819 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.832+0000 7f0837400640 1 --2- 172.21.15.144:0/1006300819 >> v2:172.21.15.165:3300/0 conn(0x7f083806e500 0x7f0838167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.832+0000 7f0835600640 1 -- 172.21.15.144:0/1006300819 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3338351047 0 0) 0x7f08380b4240 con 0x7f08380cf5d0 2024-09-11T23:25:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.833+0000 7f0835600640 1 -- 172.21.15.144:0/1006300819 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f081c003520 con 0x7f08380cf5d0 2024-09-11T23:25:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.833+0000 7f0835600640 1 -- 172.21.15.144:0/1006300819 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2096650634 0 0) 0x7f08380b4520 con 0x7f0838145d90 2024-09-11T23:25:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.833+0000 7f0835600640 1 -- 172.21.15.144:0/1006300819 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08380b4240 con 0x7f0838145d90 2024-09-11T23:25:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.833+0000 7f0837400640 1 -- 172.21.15.144:0/1006300819 >> v1:172.21.15.165:6789/0 conn(0x7f0838145d90 legacy=0x7f08380ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.833+0000 7f0835600640 1 -- 172.21.15.144:0/1006300819 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3088244814 0 0) 0x7f081c003520 con 0x7f08380cf5d0 2024-09-11T23:25:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.833+0000 7f0837400640 1 -- 172.21.15.144:0/1006300819 >> v1:172.21.15.144:6789/0 conn(0x7f08380cf5d0 legacy=0x7f08380cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.833+0000 7f0837400640 1 -- 172.21.15.144:0/1006300819 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08380b4800 con 0x7f083806e500 2024-09-11T23:25:49.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.834+0000 7f0837400640 1 --2- 172.21.15.144:0/1006300819 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f083806e500 0x7f0838167310 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0830009d90 tx=0x7f083002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50fdcf51ca763d61 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:49.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.834+0000 7f0835600640 1 -- 172.21.15.144:0/1006300819 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0824001670 con 0x7f083806e500 2024-09-11T23:25:49.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.834+0000 7f0835600640 1 -- 172.21.15.144:0/1006300819 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0830007540 con 0x7f083806e500 2024-09-11T23:25:49.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.834+0000 7f0835600640 1 -- 172.21.15.144:0/1006300819 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08300078f0 con 0x7f083806e500 2024-09-11T23:25:49.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.835+0000 7f083de00640 1 -- 172.21.15.144:0/1006300819 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f083806e500 msgr2=0x7f0838167310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.835+0000 7f083de00640 1 --2- 172.21.15.144:0/1006300819 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f083806e500 0x7f0838167310 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0830009d90 tx=0x7f083002a680 comp rx=0 tx=0).stop 2024-09-11T23:25:49.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.835+0000 7f083de00640 1 -- 172.21.15.144:0/1006300819 shutdown_connections 2024-09-11T23:25:49.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.835+0000 7f083de00640 1 --2- 172.21.15.144:0/1006300819 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f083806e500 0x7f0838167310 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.835+0000 7f083de00640 1 -- 172.21.15.144:0/1006300819 >> 172.21.15.144:0/1006300819 conn(0x7f083806bba0 msgr2=0x7f083806bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:49.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.835+0000 7f083de00640 1 -- 172.21.15.144:0/1006300819 shutdown_connections 2024-09-11T23:25:49.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.835+0000 7f083de00640 1 -- 172.21.15.144:0/1006300819 wait complete. 2024-09-11T23:25:49.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.836+0000 7f083de00640 1 Processor -- start 2024-09-11T23:25:49.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.837+0000 7f083de00640 1 -- start start 2024-09-11T23:25:49.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.837+0000 7f083de00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f083806e500 0x7f08381f3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:49.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.837+0000 7f083de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08380cf5d0 0x7f08381e8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:49.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.837+0000 7f083de00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0838145d90 0x7f08381e8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:49.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.837+0000 7f083de00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f08380b5610 con 0x7f08380cf5d0 2024-09-11T23:25:49.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.837+0000 7f083de00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f08380cd660 con 0x7f083806e500 2024-09-11T23:25:49.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.837+0000 7f083de00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f08380b5790 con 0x7f0838145d90 2024-09-11T23:25:49.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.838+0000 7f0836000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08380cf5d0 0x7f08381e8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:49.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.838+0000 7f0836000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08380cf5d0 0x7f08381e8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54698/0 (socket says 172.21.15.144:54698) 2024-09-11T23:25:49.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.838+0000 7f0836000640 1 -- 172.21.15.144:0/3719632461 learned_addr learned my addr 172.21.15.144:0/3719632461 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:49.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.838+0000 7f0836000640 1 -- 172.21.15.144:0/3719632461 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0838145d90 msgr2=0x7f08381e8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.838+0000 7f0836000640 1 --2- 172.21.15.144:0/3719632461 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0838145d90 0x7f08381e8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.838+0000 7f0836a00640 1 --2- 172.21.15.144:0/3719632461 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f083806e500 0x7f08381f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:49.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.838+0000 7f0836000640 1 -- 172.21.15.144:0/3719632461 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f083806e500 msgr2=0x7f08381f3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:49.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.838+0000 7f0836000640 1 --2- 172.21.15.144:0/3719632461 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f083806e500 0x7f08381f3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:49.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.838+0000 7f0836000640 1 -- 172.21.15.144:0/3719632461 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083815ce60 con 0x7f08380cf5d0 2024-09-11T23:25:49.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.838+0000 7f0836a00640 1 --2- 172.21.15.144:0/3719632461 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f083806e500 0x7f08381f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:49.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.838+0000 7f0836000640 1 --2- 172.21.15.144:0/3719632461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08380cf5d0 0x7f08381e8400 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f08240017e0 tx=0x7f082400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:49.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.839+0000 7f082f400640 1 -- 172.21.15.144:0/3719632461 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0824017070 con 0x7f08380cf5d0 2024-09-11T23:25:49.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.839+0000 7f082f400640 1 -- 172.21.15.144:0/3719632461 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0824005ad0 con 0x7f08380cf5d0 2024-09-11T23:25:49.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.839+0000 7f082f400640 1 -- 172.21.15.144:0/3719632461 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0824007070 con 0x7f08380cf5d0 2024-09-11T23:25:49.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.839+0000 7f083de00640 1 -- 172.21.15.144:0/3719632461 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f083815d140 con 0x7f08380cf5d0 2024-09-11T23:25:49.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.839+0000 7f083de00640 1 -- 172.21.15.144:0/3719632461 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08381f7250 con 0x7f08380cf5d0 2024-09-11T23:25:49.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.840+0000 7f083de00640 1 -- 172.21.15.144:0/3719632461 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0838146170 con 0x7f08380cf5d0 2024-09-11T23:25:49.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.841+0000 7f082f400640 1 -- 172.21.15.144:0/3719632461 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f082401a070 con 0x7f08380cf5d0 2024-09-11T23:25:49.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.842+0000 7f082f400640 1 --2- 172.21.15.144:0/3719632461 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f081806c610 0x7f081806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:49.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.842+0000 7f082f400640 1 -- 172.21.15.144:0/3719632461 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 4857+0+0 (secure 0 0 0) 0x7f082408b1f0 con 0x7f08380cf5d0 2024-09-11T23:25:49.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.842+0000 7f0836a00640 1 --2- 172.21.15.144:0/3719632461 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f081806c610 0x7f081806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:49.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.843+0000 7f0836a00640 1 --2- 172.21.15.144:0/3719632461 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f081806c610 0x7f081806ead0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0828001610 tx=0x7f0828009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:49.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:49.846+0000 7f082f400640 1 -- 172.21.15.144:0/3719632461 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0824058910 con 0x7f08380cf5d0 2024-09-11T23:25:50.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:50.023+0000 7f083de00640 1 -- 172.21.15.144:0/3719632461 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f08381e81e0 con 0x7f08380cf5d0 2024-09-11T23:25:50.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:50.872+0000 7f082f400640 1 -- 172.21.15.144:0/3719632461 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v150) ==== 138+0+0 (secure 0 0 0) 0x7f082405cc10 con 0x7f08380cf5d0 2024-09-11T23:25:50.872 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-11T23:25:50.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:50.875+0000 7f083de00640 1 -- 172.21.15.144:0/3719632461 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f081806c610 msgr2=0x7f081806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:50.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:50.875+0000 7f083de00640 1 --2- 172.21.15.144:0/3719632461 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f081806c610 0x7f081806ead0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0828001610 tx=0x7f0828009040 comp rx=0 tx=0).stop 2024-09-11T23:25:50.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:50.875+0000 7f083de00640 1 -- 172.21.15.144:0/3719632461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08380cf5d0 msgr2=0x7f08381e8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:50.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:50.875+0000 7f083de00640 1 --2- 172.21.15.144:0/3719632461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08380cf5d0 0x7f08381e8400 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f08240017e0 tx=0x7f082400cc00 comp rx=0 tx=0).stop 2024-09-11T23:25:50.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:50.875+0000 7f083de00640 1 -- 172.21.15.144:0/3719632461 shutdown_connections 2024-09-11T23:25:50.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:50.875+0000 7f083de00640 1 --2- 172.21.15.144:0/3719632461 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f081806c610 0x7f081806ead0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:50.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:50.875+0000 7f083de00640 1 --2- 172.21.15.144:0/3719632461 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0838145d90 0x7f08381e8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:50.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:50.875+0000 7f083de00640 1 --2- 172.21.15.144:0/3719632461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f08380cf5d0 0x7f08381e8400 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:50.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:50.875+0000 7f083de00640 1 --2- 172.21.15.144:0/3719632461 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f083806e500 0x7f08381f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:50.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:50.875+0000 7f083de00640 1 -- 172.21.15.144:0/3719632461 >> 172.21.15.144:0/3719632461 conn(0x7f083806bba0 msgr2=0x7f08380cccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:50.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:50.875+0000 7f083de00640 1 -- 172.21.15.144:0/3719632461 shutdown_connections 2024-09-11T23:25:50.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:50.875+0000 7f083de00640 1 -- 172.21.15.144:0/3719632461 wait complete. 2024-09-11T23:25:50.898 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:25:51.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.062+0000 7ff5c0e00640 1 Processor -- start 2024-09-11T23:25:51.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.062+0000 7ff5c0e00640 1 -- start start 2024-09-11T23:25:51.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.063+0000 7ff5c0e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff5bc15b370 0x7ff5bc072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:51.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.064+0000 7ff5c0e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5bc15c970 con 0x7ff5bc15f9f0 2024-09-11T23:25:51.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.064+0000 7ff5c0e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5bc15bbb0 con 0x7ff5bc06f130 2024-09-11T23:25:51.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.064+0000 7ff5c0e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff5bc15fef0 con 0x7ff5bc15b370 2024-09-11T23:25:51.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.064+0000 7ff5b9e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff5bc15b370 0x7ff5bc072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:51.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.064+0000 7ff5b1400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff5bc15f9f0 0x7ff5bc06ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43460/0 (socket says 172.21.15.144:43460) 2024-09-11T23:25:51.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.064+0000 7ff5b1400640 1 -- 172.21.15.144:0/4049682833 learned_addr learned my addr 172.21.15.144:0/4049682833 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:51.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.064+0000 7ff5b9e00640 1 -- 172.21.15.144:0/4049682833 >> v1:172.21.15.165:6789/0 conn(0x7ff5bc06f130 legacy=0x7ff5bc0ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:51.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.064+0000 7ff5b9e00640 1 -- 172.21.15.144:0/4049682833 >> v1:172.21.15.144:6789/0 conn(0x7ff5bc15f9f0 legacy=0x7ff5bc06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:51.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.064+0000 7ff5b9e00640 1 -- 172.21.15.144:0/4049682833 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5bc15be90 con 0x7ff5bc15b370 2024-09-11T23:25:51.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.064+0000 7ff5b9400640 1 -- 172.21.15.144:0/4049682833 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 669018135 0 0) 0x7ff5bc15c970 con 0x7ff5bc15f9f0 2024-09-11T23:25:51.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.065+0000 7ff5b9e00640 1 --2- 172.21.15.144:0/4049682833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5bc15b370 0x7ff5bc072560 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00ba40 tx=0x7ff5ac02c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e056dc2d4bca6442 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:51.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.066+0000 7ff5b9400640 1 -- 172.21.15.144:0/4049682833 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac032750 con 0x7ff5bc15b370 2024-09-11T23:25:51.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.066+0000 7ff5b9400640 1 -- 172.21.15.144:0/4049682833 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ac030050 con 0x7ff5bc15b370 2024-09-11T23:25:51.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.066+0000 7ff5b9400640 1 -- 172.21.15.144:0/4049682833 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac032b10 con 0x7ff5bc15b370 2024-09-11T23:25:51.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.066+0000 7ff5c0e00640 1 -- 172.21.15.144:0/4049682833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5bc15b370 msgr2=0x7ff5bc072560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:51.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.066+0000 7ff5c0e00640 1 --2- 172.21.15.144:0/4049682833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5bc15b370 0x7ff5bc072560 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00ba40 tx=0x7ff5ac02c850 comp rx=0 tx=0).stop 2024-09-11T23:25:51.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.066+0000 7ff5c0e00640 1 -- 172.21.15.144:0/4049682833 shutdown_connections 2024-09-11T23:25:51.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.066+0000 7ff5c0e00640 1 --2- 172.21.15.144:0/4049682833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5bc15b370 0x7ff5bc072560 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:51.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.066+0000 7ff5c0e00640 1 -- 172.21.15.144:0/4049682833 >> 172.21.15.144:0/4049682833 conn(0x7ff5bc06bba0 msgr2=0x7ff5bc06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:51.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.066+0000 7ff5c0e00640 1 -- 172.21.15.144:0/4049682833 shutdown_connections 2024-09-11T23:25:51.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.066+0000 7ff5c0e00640 1 -- 172.21.15.144:0/4049682833 wait complete. 2024-09-11T23:25:51.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.068+0000 7ff5c0e00640 1 Processor -- start 2024-09-11T23:25:51.391 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.068+0000 7ff5c0e00640 1 -- start start 2024-09-11T23:25:51.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.069+0000 7ff5c0e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5bc06f130 0x7ff5bc0b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:51.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.069+0000 7ff5c0e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5bc15b370 0x7ff5bc152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:51.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.069+0000 7ff5c0e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5bc15f9f0 0x7ff5bc159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:51.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.069+0000 7ff5c0e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc0731b0 con 0x7ff5bc15f9f0 2024-09-11T23:25:51.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.069+0000 7ff5c0e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc15c450 con 0x7ff5bc06f130 2024-09-11T23:25:51.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.069+0000 7ff5c0e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff5bc15b750 con 0x7ff5bc15b370 2024-09-11T23:25:51.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.069+0000 7ff5ba800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5bc15f9f0 0x7ff5bc159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:51.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.069+0000 7ff5ba800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5bc15f9f0 0x7ff5bc159410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54712/0 (socket says 172.21.15.144:54712) 2024-09-11T23:25:51.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.069+0000 7ff5ba800640 1 -- 172.21.15.144:0/786809751 learned_addr learned my addr 172.21.15.144:0/786809751 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:51.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.069+0000 7ff5b9e00640 1 --2- 172.21.15.144:0/786809751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5bc06f130 0x7ff5bc0b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:51.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.069+0000 7ff5b1400640 1 --2- 172.21.15.144:0/786809751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5bc15b370 0x7ff5bc152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:51.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.070+0000 7ff5ba800640 1 -- 172.21.15.144:0/786809751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5bc15b370 msgr2=0x7ff5bc152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:51.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.070+0000 7ff5ba800640 1 --2- 172.21.15.144:0/786809751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5bc15b370 0x7ff5bc152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:51.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.070+0000 7ff5ba800640 1 -- 172.21.15.144:0/786809751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5bc06f130 msgr2=0x7ff5bc0b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.070+0000 7ff5ba800640 1 --2- 172.21.15.144:0/786809751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5bc06f130 0x7ff5bc0b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.070+0000 7ff5ba800640 1 -- 172.21.15.144:0/786809751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5bc158370 con 0x7ff5bc15f9f0 2024-09-11T23:25:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.070+0000 7ff5ba800640 1 --2- 172.21.15.144:0/786809751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5bc15f9f0 0x7ff5bc159410 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7ff5b400c730 tx=0x7ff5b400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.070+0000 7ff5b2a00640 1 -- 172.21.15.144:0/786809751 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4003b70 con 0x7ff5bc15f9f0 2024-09-11T23:25:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.070+0000 7ff5b2a00640 1 -- 172.21.15.144:0/786809751 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5b4003d30 con 0x7ff5bc15f9f0 2024-09-11T23:25:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.070+0000 7ff5b2a00640 1 -- 172.21.15.144:0/786809751 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4005310 con 0x7ff5bc15f9f0 2024-09-11T23:25:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.070+0000 7ff5c0e00640 1 -- 172.21.15.144:0/786809751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5bc158650 con 0x7ff5bc15f9f0 2024-09-11T23:25:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.070+0000 7ff5c0e00640 1 -- 172.21.15.144:0/786809751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5bc158c10 con 0x7ff5bc15f9f0 2024-09-11T23:25:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.071+0000 7ff5c0e00640 1 -- 172.21.15.144:0/786809751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5bc072560 con 0x7ff5bc15f9f0 2024-09-11T23:25:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.073+0000 7ff5b2a00640 1 -- 172.21.15.144:0/786809751 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7ff5b40056c0 con 0x7ff5bc15f9f0 2024-09-11T23:25:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.074+0000 7ff5b2a00640 1 --2- 172.21.15.144:0/786809751 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff59806c610 0x7ff59806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.074+0000 7ff5b2a00640 1 -- 172.21.15.144:0/786809751 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5227+0+0 (secure 0 0 0) 0x7ff5b408c480 con 0x7ff5bc15f9f0 2024-09-11T23:25:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.074+0000 7ff5b9e00640 1 --2- 172.21.15.144:0/786809751 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff59806c610 0x7ff59806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:51.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.075+0000 7ff5b9e00640 1 --2- 172.21.15.144:0/786809751 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff59806c610 0x7ff59806ead0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac037000 tx=0x7ff5ac032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:51.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.077+0000 7ff5b2a00640 1 -- 172.21.15.144:0/786809751 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff5b4059ec0 con 0x7ff5bc15f9f0 2024-09-11T23:25:51.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.252+0000 7ff5c0e00640 1 -- 172.21.15.144:0/786809751 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff5bc15aaa0 con 0x7ff5bc15f9f0 2024-09-11T23:25:51.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.875+0000 7ff5b2a00640 1 -- 172.21.15.144:0/786809751 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v151) ==== 170+0+0 (secure 0 0 0) 0x7ff5b405e1c0 con 0x7ff5bc15f9f0 2024-09-11T23:25:51.875 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-11T23:25:51.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.878+0000 7ff5c0e00640 1 -- 172.21.15.144:0/786809751 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff59806c610 msgr2=0x7ff59806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:51.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.878+0000 7ff5c0e00640 1 --2- 172.21.15.144:0/786809751 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff59806c610 0x7ff59806ead0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac037000 tx=0x7ff5ac032000 comp rx=0 tx=0).stop 2024-09-11T23:25:51.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.878+0000 7ff5c0e00640 1 -- 172.21.15.144:0/786809751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5bc15f9f0 msgr2=0x7ff5bc159410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:51.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.878+0000 7ff5c0e00640 1 --2- 172.21.15.144:0/786809751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5bc15f9f0 0x7ff5bc159410 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7ff5b400c730 tx=0x7ff5b400cbf0 comp rx=0 tx=0).stop 2024-09-11T23:25:51.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.878+0000 7ff5c0e00640 1 -- 172.21.15.144:0/786809751 shutdown_connections 2024-09-11T23:25:51.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.878+0000 7ff5c0e00640 1 --2- 172.21.15.144:0/786809751 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff59806c610 0x7ff59806ead0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:51.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.878+0000 7ff5c0e00640 1 --2- 172.21.15.144:0/786809751 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5bc15f9f0 0x7ff5bc159410 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:51.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.878+0000 7ff5c0e00640 1 --2- 172.21.15.144:0/786809751 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff5bc15b370 0x7ff5bc152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:51.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.878+0000 7ff5c0e00640 1 --2- 172.21.15.144:0/786809751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5bc06f130 0x7ff5bc0b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:51.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.878+0000 7ff5c0e00640 1 -- 172.21.15.144:0/786809751 >> 172.21.15.144:0/786809751 conn(0x7ff5bc06bba0 msgr2=0x7ff5bc0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:51.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.878+0000 7ff5c0e00640 1 -- 172.21.15.144:0/786809751 shutdown_connections 2024-09-11T23:25:51.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:51.878+0000 7ff5c0e00640 1 -- 172.21.15.144:0/786809751 wait complete. 2024-09-11T23:25:51.914 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:25:52.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.072+0000 7f1b09200640 1 Processor -- start 2024-09-11T23:25:52.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.072+0000 7f1b09200640 1 -- start start 2024-09-11T23:25:52.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.074+0000 7f1b09200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b0415b090 0x7f1b040b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:52.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.074+0000 7f1b09200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1b0406ea00 0x7f1b04164640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:52.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.074+0000 7f1b09200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b04071de0 con 0x7f1b040715b0 2024-09-11T23:25:52.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.074+0000 7f1b09200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1b040720c0 con 0x7f1b0415b090 2024-09-11T23:25:52.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.074+0000 7f1b09200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1b040723a0 con 0x7f1b0406ea00 2024-09-11T23:25:52.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.074+0000 7f1b01e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b0415b090 0x7f1b040b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:52.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.074+0000 7f1b01e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b0415b090 0x7f1b040b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54724/0 (socket says 172.21.15.144:54724) 2024-09-11T23:25:52.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.074+0000 7f1b01e00640 1 -- 172.21.15.144:0/157859435 learned_addr learned my addr 172.21.15.144:0/157859435 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:52.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.074+0000 7f1b01e00640 1 -- 172.21.15.144:0/157859435 >> v2:172.21.15.165:3300/0 conn(0x7f1b0406ea00 msgr2=0x7f1b04164640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:52.074 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.074+0000 7f1b01e00640 1 --2- 172.21.15.144:0/157859435 >> v2:172.21.15.165:3300/0 conn(0x7f1b0406ea00 0x7f1b04164640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:52.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.074+0000 7f1b01e00640 1 -- 172.21.15.144:0/157859435 >> v1:172.21.15.144:6789/0 conn(0x7f1b040715b0 legacy=0x7f1b0415b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:52.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.074+0000 7f1b01e00640 1 -- 172.21.15.144:0/157859435 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b04072680 con 0x7f1b0415b090 2024-09-11T23:25:52.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.075+0000 7f1b01e00640 1 --2- 172.21.15.144:0/157859435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b0415b090 0x7f1b040b5420 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f1b0406cb80 tx=0x7f1af402a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f48e366f7702493 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:52.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.076+0000 7f1b00a00640 1 -- 172.21.15.144:0/157859435 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af4037070 con 0x7f1b0415b090 2024-09-11T23:25:52.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.076+0000 7f1b00a00640 1 -- 172.21.15.144:0/157859435 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1af4032440 con 0x7f1b0415b090 2024-09-11T23:25:52.075 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.076+0000 7f1b00a00640 1 -- 172.21.15.144:0/157859435 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af4032810 con 0x7f1b0415b090 2024-09-11T23:25:52.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.076+0000 7f1b09200640 1 -- 172.21.15.144:0/157859435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b0415b090 msgr2=0x7f1b040b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:52.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.076+0000 7f1b09200640 1 --2- 172.21.15.144:0/157859435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b0415b090 0x7f1b040b5420 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f1b0406cb80 tx=0x7f1af402a280 comp rx=0 tx=0).stop 2024-09-11T23:25:52.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.076+0000 7f1b09200640 1 -- 172.21.15.144:0/157859435 shutdown_connections 2024-09-11T23:25:52.076 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.076+0000 7f1b09200640 1 --2- 172.21.15.144:0/157859435 >> v2:172.21.15.165:3300/0 conn(0x7f1b0406ea00 0x7f1b04164640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:52.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.076+0000 7f1b09200640 1 --2- 172.21.15.144:0/157859435 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b0415b090 0x7f1b040b5420 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:52.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.076+0000 7f1b09200640 1 -- 172.21.15.144:0/157859435 >> 172.21.15.144:0/157859435 conn(0x7f1b0406bba0 msgr2=0x7f1b0406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:52.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.076+0000 7f1b09200640 1 -- 172.21.15.144:0/157859435 shutdown_connections 2024-09-11T23:25:52.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.076+0000 7f1b09200640 1 -- 172.21.15.144:0/157859435 wait complete. 2024-09-11T23:25:52.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.078+0000 7f1b09200640 1 Processor -- start 2024-09-11T23:25:52.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.078+0000 7f1b09200640 1 -- start start 2024-09-11T23:25:52.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.079+0000 7f1b09200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b0406ea00 0x7f1b040af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:52.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.079+0000 7f1b09200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b040715b0 0x7f1b041578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:52.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.079+0000 7f1b09200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b0415b090 0x7f1b04157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:52.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.079+0000 7f1b09200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1b04071ba0 con 0x7f1b0415b090 2024-09-11T23:25:52.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.079+0000 7f1b09200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1b04071a20 con 0x7f1b0406ea00 2024-09-11T23:25:52.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.079+0000 7f1b09200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0415bb80 con 0x7f1b040715b0 2024-09-11T23:25:52.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.079+0000 7f1b02800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b0415b090 0x7f1b04157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:52.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.079+0000 7f1b02800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b0415b090 0x7f1b04157df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54726/0 (socket says 172.21.15.144:54726) 2024-09-11T23:25:52.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.079+0000 7f1b02800640 1 -- 172.21.15.144:0/1002175417 learned_addr learned my addr 172.21.15.144:0/1002175417 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:52.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.079+0000 7f1b01e00640 1 --2- 172.21.15.144:0/1002175417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b0406ea00 0x7f1b040af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:52.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.079+0000 7f1b01400640 1 --2- 172.21.15.144:0/1002175417 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b040715b0 0x7f1b041578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:52.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.080+0000 7f1b02800640 1 -- 172.21.15.144:0/1002175417 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b040715b0 msgr2=0x7f1b041578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:52.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.080+0000 7f1b02800640 1 --2- 172.21.15.144:0/1002175417 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b040715b0 0x7f1b041578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:52.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.080+0000 7f1b02800640 1 -- 172.21.15.144:0/1002175417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b0406ea00 msgr2=0x7f1b040af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:52.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.080+0000 7f1b02800640 1 --2- 172.21.15.144:0/1002175417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b0406ea00 0x7f1b040af520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:52.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.080+0000 7f1b02800640 1 -- 172.21.15.144:0/1002175417 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0414f550 con 0x7f1b0415b090 2024-09-11T23:25:52.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.080+0000 7f1b02800640 1 --2- 172.21.15.144:0/1002175417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b0415b090 0x7f1b04157df0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00b9a0 tx=0x7f1afc00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:52.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.080+0000 7f1afa000640 1 -- 172.21.15.144:0/1002175417 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc019070 con 0x7f1b0415b090 2024-09-11T23:25:52.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.080+0000 7f1afa000640 1 -- 172.21.15.144:0/1002175417 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1afc00cbc0 con 0x7f1b0415b090 2024-09-11T23:25:52.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.080+0000 7f1afa000640 1 -- 172.21.15.144:0/1002175417 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc014440 con 0x7f1b0415b090 2024-09-11T23:25:52.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.080+0000 7f1b09200640 1 -- 172.21.15.144:0/1002175417 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b0414f830 con 0x7f1b0415b090 2024-09-11T23:25:52.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.080+0000 7f1b09200640 1 -- 172.21.15.144:0/1002175417 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b0414fdf0 con 0x7f1b0415b090 2024-09-11T23:25:52.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.081+0000 7f1b09200640 1 -- 172.21.15.144:0/1002175417 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b0414fff0 con 0x7f1b0415b090 2024-09-11T23:25:52.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.082+0000 7f1afa000640 1 -- 172.21.15.144:0/1002175417 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f1afc01c070 con 0x7f1b0415b090 2024-09-11T23:25:52.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.083+0000 7f1afa000640 1 --2- 172.21.15.144:0/1002175417 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ae406c610 0x7f1ae406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:52.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.083+0000 7f1afa000640 1 -- 172.21.15.144:0/1002175417 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5609+0+0 (secure 0 0 0) 0x7f1afc08bd80 con 0x7f1b0415b090 2024-09-11T23:25:52.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.084+0000 7f1b01e00640 1 --2- 172.21.15.144:0/1002175417 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ae406c610 0x7f1ae406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:52.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.085+0000 7f1b01e00640 1 --2- 172.21.15.144:0/1002175417 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ae406c610 0x7f1ae406ead0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1af4034000 tx=0x7f1af402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:52.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.088+0000 7f1afa000640 1 -- 172.21.15.144:0/1002175417 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1b0414fff0 con 0x7f1b0415b090 2024-09-11T23:25:52.297 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.297+0000 7f1b09200640 1 -- 172.21.15.144:0/1002175417 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1b040b5420 con 0x7f1b0415b090 2024-09-11T23:25:52.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.901+0000 7f1afa000640 1 -- 172.21.15.144:0/1002175417 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v106) ==== 174+0+0 (secure 0 0 0) 0x7f1afc059120 con 0x7f1b0415b090 2024-09-11T23:25:52.904 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 24 and data pool 25 2024-09-11T23:25:52.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.908+0000 7f1b09200640 1 -- 172.21.15.144:0/1002175417 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ae406c610 msgr2=0x7f1ae406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:52.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.908+0000 7f1b09200640 1 --2- 172.21.15.144:0/1002175417 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ae406c610 0x7f1ae406ead0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1af4034000 tx=0x7f1af402e000 comp rx=0 tx=0).stop 2024-09-11T23:25:52.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.908+0000 7f1b09200640 1 -- 172.21.15.144:0/1002175417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b0415b090 msgr2=0x7f1b04157df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:52.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.908+0000 7f1b09200640 1 --2- 172.21.15.144:0/1002175417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b0415b090 0x7f1b04157df0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00b9a0 tx=0x7f1afc00be60 comp rx=0 tx=0).stop 2024-09-11T23:25:52.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.909+0000 7f1b09200640 1 -- 172.21.15.144:0/1002175417 shutdown_connections 2024-09-11T23:25:52.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.909+0000 7f1b09200640 1 --2- 172.21.15.144:0/1002175417 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1ae406c610 0x7f1ae406ead0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:52.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.909+0000 7f1b09200640 1 --2- 172.21.15.144:0/1002175417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b0415b090 0x7f1b04157df0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:52.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.909+0000 7f1b09200640 1 --2- 172.21.15.144:0/1002175417 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b040715b0 0x7f1b041578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:52.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.909+0000 7f1b09200640 1 --2- 172.21.15.144:0/1002175417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b0406ea00 0x7f1b040af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:52.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.909+0000 7f1b09200640 1 -- 172.21.15.144:0/1002175417 >> 172.21.15.144:0/1002175417 conn(0x7f1b0406bba0 msgr2=0x7f1b04154b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:52.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.909+0000 7f1b09200640 1 -- 172.21.15.144:0/1002175417 shutdown_connections 2024-09-11T23:25:52.910 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:52.910+0000 7f1b09200640 1 -- 172.21.15.144:0/1002175417 wait complete. 2024-09-11T23:25:52.945 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:25:53.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.099+0000 7f741bc00640 1 Processor -- start 2024-09-11T23:25:53.099 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.099+0000 7f741bc00640 1 -- start start 2024-09-11T23:25:53.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.100+0000 7f741bc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f7414073830 0x7f74140cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:53.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.100+0000 7f741bc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74140ce740 con 0x7f741415c180 2024-09-11T23:25:53.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.100+0000 7f741bc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7414072640 con 0x7f74140cf070 2024-09-11T23:25:53.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.100+0000 7f741bc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f7414072920 con 0x7f7414073830 2024-09-11T23:25:53.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.101+0000 7f7419200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f741415c180 0x7f74140cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43474/0 (socket says 172.21.15.144:43474) 2024-09-11T23:25:53.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.101+0000 7f7419200640 1 -- 172.21.15.144:0/1398266982 learned_addr learned my addr 172.21.15.144:0/1398266982 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:53.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.101+0000 7f7419c00640 1 --2- 172.21.15.144:0/1398266982 >> v2:172.21.15.165:3300/0 conn(0x7f7414073830 0x7f74140cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:53.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.101+0000 7f7413400640 1 -- 172.21.15.144:0/1398266982 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 710464437 0 0) 0x7f74140ce740 con 0x7f741415c180 2024-09-11T23:25:53.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.101+0000 7f7413400640 1 -- 172.21.15.144:0/1398266982 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73f8003520 con 0x7f741415c180 2024-09-11T23:25:53.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.101+0000 7f7413400640 1 -- 172.21.15.144:0/1398266982 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 487594991 0 0) 0x7f73f8003520 con 0x7f741415c180 2024-09-11T23:25:53.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.101+0000 7f7413400640 1 -- 172.21.15.144:0/1398266982 >> v2:172.21.15.165:3300/0 conn(0x7f7414073830 msgr2=0x7f74140cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:53.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.101+0000 7f7413400640 1 --2- 172.21.15.144:0/1398266982 >> v2:172.21.15.165:3300/0 conn(0x7f7414073830 0x7f74140cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.101+0000 7f7413400640 1 -- 172.21.15.144:0/1398266982 >> v1:172.21.15.165:6789/0 conn(0x7f74140cf070 legacy=0x7f7414073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:53.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.101+0000 7f7413400640 1 -- 172.21.15.144:0/1398266982 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7414072c00 con 0x7f741415c180 2024-09-11T23:25:53.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.101+0000 7f7413400640 1 -- 172.21.15.144:0/1398266982 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f7404001670 con 0x7f741415c180 2024-09-11T23:25:53.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.101+0000 7f7413400640 1 -- 172.21.15.144:0/1398266982 >> v1:172.21.15.144:6789/0 conn(0x7f741415c180 legacy=0x7f74140cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:53.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.101+0000 7f7413400640 1 --2- 172.21.15.144:0/1398266982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73f8003a00 0x7f73f8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:53.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.101+0000 7f7413400640 1 --2- 172.21.15.144:0/1398266982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f8004800 0x7f73f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:53.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.101+0000 7f7413400640 1 --2- 172.21.15.144:0/1398266982 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73f8005210 0x7f73f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:53.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.101+0000 7f7413400640 1 -- 172.21.15.144:0/1398266982 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7414072920 con 0x7f73f8004800 2024-09-11T23:25:53.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.101+0000 7f7413400640 1 -- 172.21.15.144:0/1398266982 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f73f800c160 con 0x7f73f8003a00 2024-09-11T23:25:53.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.101+0000 7f7413400640 1 -- 172.21.15.144:0/1398266982 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f73f800c360 con 0x7f73f8005210 2024-09-11T23:25:53.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.102+0000 7f7413e00640 1 --2- 172.21.15.144:0/1398266982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f8004800 0x7f73f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:53.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.102+0000 7f7419200640 1 --2- 172.21.15.144:0/1398266982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73f8003a00 0x7f73f8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:53.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.102+0000 7f7419c00640 1 --2- 172.21.15.144:0/1398266982 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73f8005210 0x7f73f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:53.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.102+0000 7f7413e00640 1 -- 172.21.15.144:0/1398266982 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73f8005210 msgr2=0x7f73f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:53.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.102+0000 7f7413e00640 1 --2- 172.21.15.144:0/1398266982 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f73f8005210 0x7f73f800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.102+0000 7f7413e00640 1 -- 172.21.15.144:0/1398266982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73f8003a00 msgr2=0x7f73f8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:53.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.102+0000 7f7413e00640 1 --2- 172.21.15.144:0/1398266982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73f8003a00 0x7f73f8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.102+0000 7f7413e00640 1 -- 172.21.15.144:0/1398266982 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f8003520 con 0x7f73f8004800 2024-09-11T23:25:53.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.102+0000 7f7419c00640 1 -- 172.21.15.144:0/1398266982 reap_dead start 2024-09-11T23:25:53.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.103+0000 7f7413e00640 1 --2- 172.21.15.144:0/1398266982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f8004800 0x7f73f8004c80 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f7400001720 tx=0x7f73f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9813226d402863b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:53.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.103+0000 7f7413400640 1 -- 172.21.15.144:0/1398266982 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7400001370 con 0x7f73f8004800 2024-09-11T23:25:53.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.103+0000 7f7413400640 1 -- 172.21.15.144:0/1398266982 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74000052d0 con 0x7f73f8004800 2024-09-11T23:25:53.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.103+0000 7f7413400640 1 -- 172.21.15.144:0/1398266982 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740002ab90 con 0x7f73f8004800 2024-09-11T23:25:53.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.104+0000 7f741bc00640 1 -- 172.21.15.144:0/1398266982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f8004800 msgr2=0x7f73f8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:53.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.104+0000 7f741bc00640 1 --2- 172.21.15.144:0/1398266982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f8004800 0x7f73f8004c80 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f7400001720 tx=0x7f73f8005830 comp rx=0 tx=0).stop 2024-09-11T23:25:53.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.104+0000 7f741bc00640 1 -- 172.21.15.144:0/1398266982 shutdown_connections 2024-09-11T23:25:53.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.104+0000 7f741bc00640 1 --2- 172.21.15.144:0/1398266982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f8004800 0x7f73f8004c80 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.104+0000 7f741bc00640 1 -- 172.21.15.144:0/1398266982 >> 172.21.15.144:0/1398266982 conn(0x7f7414062cc0 msgr2=0x7f741406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:53.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.104+0000 7f741bc00640 1 -- 172.21.15.144:0/1398266982 shutdown_connections 2024-09-11T23:25:53.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.104+0000 7f741bc00640 1 -- 172.21.15.144:0/1398266982 wait complete. 2024-09-11T23:25:53.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.105+0000 7f741bc00640 1 Processor -- start 2024-09-11T23:25:53.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.106+0000 7f741bc00640 1 -- start start 2024-09-11T23:25:53.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.106+0000 7f741bc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f8004800 0x7f74140b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:53.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.106+0000 7f741bc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f741415c8c0 0x7f741414e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:53.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.106+0000 7f741bc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f741414fcc0 0x7f74140ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:53.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.106+0000 7f741bc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f741415c560 con 0x7f73f8004800 2024-09-11T23:25:53.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.106+0000 7f741bc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f74140722f0 con 0x7f741415c8c0 2024-09-11T23:25:53.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.106+0000 7f741bc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f741415c6e0 con 0x7f741414fcc0 2024-09-11T23:25:53.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.107+0000 7f7419200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f8004800 0x7f74140b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:53.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.107+0000 7f7419200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f8004800 0x7f74140b4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54732/0 (socket says 172.21.15.144:54732) 2024-09-11T23:25:53.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.107+0000 7f7419200640 1 -- 172.21.15.144:0/4112763615 learned_addr learned my addr 172.21.15.144:0/4112763615 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:53.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.107+0000 7f7413e00640 1 --2- 172.21.15.144:0/4112763615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f741415c8c0 0x7f741414e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:53.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.107+0000 7f7419c00640 1 --2- 172.21.15.144:0/4112763615 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f741414fcc0 0x7f74140ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:53.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.107+0000 7f7419200640 1 -- 172.21.15.144:0/4112763615 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f741414fcc0 msgr2=0x7f74140ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:53.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.107+0000 7f7419200640 1 --2- 172.21.15.144:0/4112763615 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f741414fcc0 0x7f74140ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.107+0000 7f7419200640 1 -- 172.21.15.144:0/4112763615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f741415c8c0 msgr2=0x7f741414e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:53.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.107+0000 7f7419200640 1 --2- 172.21.15.144:0/4112763615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f741415c8c0 0x7f741414e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.107+0000 7f7419200640 1 -- 172.21.15.144:0/4112763615 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741415ce10 con 0x7f73f8004800 2024-09-11T23:25:53.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.107+0000 7f7419c00640 1 --2- 172.21.15.144:0/4112763615 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f741414fcc0 0x7f74140ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:53.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.107+0000 7f7419200640 1 --2- 172.21.15.144:0/4112763615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f8004800 0x7f74140b4ff0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f740400e790 tx=0x7f740400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:53.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.108+0000 7f7410c00640 1 -- 172.21.15.144:0/4112763615 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740400c660 con 0x7f73f8004800 2024-09-11T23:25:53.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.108+0000 7f7410c00640 1 -- 172.21.15.144:0/4112763615 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7404018070 con 0x7f73f8004800 2024-09-11T23:25:53.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.108+0000 7f741bc00640 1 -- 172.21.15.144:0/4112763615 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f741415d0f0 con 0x7f73f8004800 2024-09-11T23:25:53.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.108+0000 7f7410c00640 1 -- 172.21.15.144:0/4112763615 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740400ca60 con 0x7f73f8004800 2024-09-11T23:25:53.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.108+0000 7f741bc00640 1 -- 172.21.15.144:0/4112763615 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f741415d6b0 con 0x7f73f8004800 2024-09-11T23:25:53.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.109+0000 7f741bc00640 1 -- 172.21.15.144:0/4112763615 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74140cf4e0 con 0x7f73f8004800 2024-09-11T23:25:53.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.110+0000 7f7410c00640 1 -- 172.21.15.144:0/4112763615 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f740400cc00 con 0x7f73f8004800 2024-09-11T23:25:53.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.111+0000 7f7410c00640 1 --2- 172.21.15.144:0/4112763615 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f73f406c640 0x7f73f406eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:53.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.111+0000 7f7410c00640 1 -- 172.21.15.144:0/4112763615 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5709+0+0 (secure 0 0 0) 0x7f740408ba60 con 0x7f73f8004800 2024-09-11T23:25:53.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.111+0000 7f7413e00640 1 --2- 172.21.15.144:0/4112763615 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f73f406c640 0x7f73f406eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:53.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.112+0000 7f7413e00640 1 --2- 172.21.15.144:0/4112763615 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f73f406c640 0x7f73f406eb00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7400032000 tx=0x7f740002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:53.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.115+0000 7f7410c00640 1 -- 172.21.15.144:0/4112763615 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7404059480 con 0x7f73f8004800 2024-09-11T23:25:53.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.289+0000 7f741bc00640 1 -- 172.21.15.144:0/4112763615 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f741415fc10 con 0x7f73f8004800 2024-09-11T23:25:53.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.290+0000 7f7410c00640 1 -- 172.21.15.144:0/4112763615 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) ==== 74+0+16776 (secure 0 0 0) 0x7f7404058d80 con 0x7f73f8004800 2024-09-11T23:25:53.291 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:53.291 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":152,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:25:52.298578+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:25:50.064555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-11T23:25:51.293809+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:25:53.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.292+0000 7f741bc00640 1 -- 172.21.15.144:0/4112763615 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f73f406c640 msgr2=0x7f73f406eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:53.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.292+0000 7f741bc00640 1 --2- 172.21.15.144:0/4112763615 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f73f406c640 0x7f73f406eb00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7400032000 tx=0x7f740002e000 comp rx=0 tx=0).stop 2024-09-11T23:25:53.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.292+0000 7f741bc00640 1 -- 172.21.15.144:0/4112763615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f8004800 msgr2=0x7f74140b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:53.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.292+0000 7f741bc00640 1 --2- 172.21.15.144:0/4112763615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f8004800 0x7f74140b4ff0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f740400e790 tx=0x7f740400ec50 comp rx=0 tx=0).stop 2024-09-11T23:25:53.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.292+0000 7f741bc00640 1 -- 172.21.15.144:0/4112763615 shutdown_connections 2024-09-11T23:25:53.293 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.292+0000 7f741bc00640 1 --2- 172.21.15.144:0/4112763615 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f73f406c640 0x7f73f406eb00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.292+0000 7f741bc00640 1 --2- 172.21.15.144:0/4112763615 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f741414fcc0 0x7f74140ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.292+0000 7f741bc00640 1 --2- 172.21.15.144:0/4112763615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f741415c8c0 0x7f741414e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.292+0000 7f741bc00640 1 --2- 172.21.15.144:0/4112763615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73f8004800 0x7f74140b4ff0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.292+0000 7f741bc00640 1 -- 172.21.15.144:0/4112763615 >> 172.21.15.144:0/4112763615 conn(0x7f7414062cc0 msgr2=0x7f741415aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:53.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.292+0000 7f741bc00640 1 -- 172.21.15.144:0/4112763615 shutdown_connections 2024-09-11T23:25:53.294 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.292+0000 7f741bc00640 1 -- 172.21.15.144:0/4112763615 wait complete. 2024-09-11T23:25:53.309 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:25:53.463 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.463+0000 7f8947e00640 1 Processor -- start 2024-09-11T23:25:53.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.463+0000 7f8947e00640 1 -- start start 2024-09-11T23:25:53.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.464+0000 7f8947e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89480b6c60 0x7f89480b7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:53.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.464+0000 7f8947e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f89480d0370 0x7f89480d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:53.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.464+0000 7f8947e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8948071970 con 0x7f894815f570 2024-09-11T23:25:53.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.464+0000 7f8947e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f89480b7580 con 0x7f89480d0370 2024-09-11T23:25:53.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.464+0000 7f8947e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f89480d1d90 con 0x7f89480b6c60 2024-09-11T23:25:53.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.464+0000 7f8947400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f89480d0370 0x7f89480d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:53.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.465+0000 7f893e000640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f894815f570 0x7f8948071260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:42256/0 (socket says 172.21.15.144:42256) 2024-09-11T23:25:53.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.465+0000 7f893e000640 1 -- 172.21.15.144:0/1362586465 learned_addr learned my addr 172.21.15.144:0/1362586465 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:53.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.465+0000 7f8946a00640 1 --2- 172.21.15.144:0/1362586465 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89480b6c60 0x7f89480b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:53.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.465+0000 7f8947400640 1 -- 172.21.15.144:0/1362586465 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89480b6c60 msgr2=0x7f89480b7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:53.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.465+0000 7f8947400640 1 --2- 172.21.15.144:0/1362586465 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89480b6c60 0x7f89480b7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.465+0000 7f8947400640 1 -- 172.21.15.144:0/1362586465 >> v1:172.21.15.165:6789/0 conn(0x7f894815f570 legacy=0x7f8948071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:53.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.465+0000 7f8947400640 1 -- 172.21.15.144:0/1362586465 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89480d2070 con 0x7f89480d0370 2024-09-11T23:25:53.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.465+0000 7f8946000640 1 -- 172.21.15.144:0/1362586465 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 950192843 0 0) 0x7f8948071970 con 0x7f894815f570 2024-09-11T23:25:53.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.466+0000 7f8947400640 1 --2- 172.21.15.144:0/1362586465 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89480d0370 0x7f89480d0820 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8940009d90 tx=0x7f894002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=283308953c25669a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:53.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.466+0000 7f8946000640 1 -- 172.21.15.144:0/1362586465 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8940031600 con 0x7f89480d0370 2024-09-11T23:25:53.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.466+0000 7f8946000640 1 -- 172.21.15.144:0/1362586465 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89400317a0 con 0x7f89480d0370 2024-09-11T23:25:53.467 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.466+0000 7f8946000640 1 -- 172.21.15.144:0/1362586465 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8940031b70 con 0x7f89480d0370 2024-09-11T23:25:53.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.467+0000 7f8947e00640 1 -- 172.21.15.144:0/1362586465 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89480d0370 msgr2=0x7f89480d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:53.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.467+0000 7f8947e00640 1 --2- 172.21.15.144:0/1362586465 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89480d0370 0x7f89480d0820 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8940009d90 tx=0x7f894002a5d0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.467+0000 7f8947e00640 1 -- 172.21.15.144:0/1362586465 shutdown_connections 2024-09-11T23:25:53.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.467+0000 7f8947e00640 1 --2- 172.21.15.144:0/1362586465 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89480d0370 0x7f89480d0820 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.467+0000 7f8947e00640 1 --2- 172.21.15.144:0/1362586465 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89480b6c60 0x7f89480b7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.467+0000 7f8947e00640 1 -- 172.21.15.144:0/1362586465 >> 172.21.15.144:0/1362586465 conn(0x7f894806f390 msgr2=0x7f894806f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:53.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.467+0000 7f8947e00640 1 -- 172.21.15.144:0/1362586465 shutdown_connections 2024-09-11T23:25:53.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.467+0000 7f8947e00640 1 -- 172.21.15.144:0/1362586465 wait complete. 2024-09-11T23:25:53.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.469+0000 7f8947e00640 1 Processor -- start 2024-09-11T23:25:53.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.469+0000 7f8947e00640 1 -- start start 2024-09-11T23:25:53.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.470+0000 7f8947e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89480b6c60 0x7f894814ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:53.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.470+0000 7f8947e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89480d0370 0x7f89480cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:53.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.470+0000 7f8947e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f894815f570 0x7f894815b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:53.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.470+0000 7f8947e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8948074220 con 0x7f894815f570 2024-09-11T23:25:53.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.470+0000 7f8947e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8948070d40 con 0x7f89480b6c60 2024-09-11T23:25:53.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.470+0000 7f8947e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f89480d0d60 con 0x7f89480d0370 2024-09-11T23:25:53.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.470+0000 7f8947400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f894815f570 0x7f894815b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:53.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.470+0000 7f8947400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f894815f570 0x7f894815b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54740/0 (socket says 172.21.15.144:54740) 2024-09-11T23:25:53.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.470+0000 7f8947400640 1 -- 172.21.15.144:0/224344337 learned_addr learned my addr 172.21.15.144:0/224344337 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:53.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.470+0000 7f893e000640 1 --2- 172.21.15.144:0/224344337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89480d0370 0x7f89480cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:53.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.470+0000 7f8946a00640 1 --2- 172.21.15.144:0/224344337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89480b6c60 0x7f894814ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:53.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.470+0000 7f8947400640 1 -- 172.21.15.144:0/224344337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89480d0370 msgr2=0x7f89480cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:53.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.470+0000 7f8947400640 1 --2- 172.21.15.144:0/224344337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89480d0370 0x7f89480cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.470+0000 7f8947400640 1 -- 172.21.15.144:0/224344337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89480b6c60 msgr2=0x7f894814ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:53.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.470+0000 7f8947400640 1 --2- 172.21.15.144:0/224344337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89480b6c60 0x7f894814ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.470+0000 7f8947400640 1 -- 172.21.15.144:0/224344337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f894814d340 con 0x7f894815f570 2024-09-11T23:25:53.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.471+0000 7f8947400640 1 --2- 172.21.15.144:0/224344337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f894815f570 0x7f894815b540 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f8940009eb0 tx=0x7f8940004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:53.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.471+0000 7f893fe00640 1 -- 172.21.15.144:0/224344337 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8940040070 con 0x7f894815f570 2024-09-11T23:25:53.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.471+0000 7f893fe00640 1 -- 172.21.15.144:0/224344337 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8940030be0 con 0x7f894815f570 2024-09-11T23:25:53.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.471+0000 7f893fe00640 1 -- 172.21.15.144:0/224344337 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8940009450 con 0x7f894815f570 2024-09-11T23:25:53.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.471+0000 7f8947e00640 1 -- 172.21.15.144:0/224344337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89480cc130 con 0x7f894815f570 2024-09-11T23:25:53.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.471+0000 7f8947e00640 1 -- 172.21.15.144:0/224344337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89480cc6f0 con 0x7f894815f570 2024-09-11T23:25:53.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.472+0000 7f8947e00640 1 -- 172.21.15.144:0/224344337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89480b3d50 con 0x7f894815f570 2024-09-11T23:25:53.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.473+0000 7f893fe00640 1 -- 172.21.15.144:0/224344337 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f8940039040 con 0x7f894815f570 2024-09-11T23:25:53.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.474+0000 7f893fe00640 1 --2- 172.21.15.144:0/224344337 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f892406c610 0x7f892406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:53.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.474+0000 7f893fe00640 1 -- 172.21.15.144:0/224344337 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5709+0+0 (secure 0 0 0) 0x7f89400ace10 con 0x7f894815f570 2024-09-11T23:25:53.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.474+0000 7f8946a00640 1 --2- 172.21.15.144:0/224344337 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f892406c610 0x7f892406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:53.475 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.475+0000 7f8946a00640 1 --2- 172.21.15.144:0/224344337 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f892406c610 0x7f892406ead0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8938009aa0 tx=0x7f8938009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:53.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.478+0000 7f893fe00640 1 -- 172.21.15.144:0/224344337 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f894814d340 con 0x7f894815f570 2024-09-11T23:25:53.655 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.654+0000 7f8947e00640 1 -- 172.21.15.144:0/224344337 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89480d19d0 con 0x7f894815f570 2024-09-11T23:25:53.657 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.656+0000 7f893fe00640 1 -- 172.21.15.144:0/224344337 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) ==== 74+0+16776 (secure 0 0 0) 0x7f894007a040 con 0x7f894815f570 2024-09-11T23:25:53.657 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:53.657 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":152,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:25:52.298578+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:25:50.064555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-11T23:25:51.293809+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:25:53.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.658+0000 7f8947e00640 1 -- 172.21.15.144:0/224344337 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f892406c610 msgr2=0x7f892406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:53.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.658+0000 7f8947e00640 1 --2- 172.21.15.144:0/224344337 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f892406c610 0x7f892406ead0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8938009aa0 tx=0x7f8938009190 comp rx=0 tx=0).stop 2024-09-11T23:25:53.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.658+0000 7f8947e00640 1 -- 172.21.15.144:0/224344337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f894815f570 msgr2=0x7f894815b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:53.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.658+0000 7f8947e00640 1 --2- 172.21.15.144:0/224344337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f894815f570 0x7f894815b540 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f8940009eb0 tx=0x7f8940004a40 comp rx=0 tx=0).stop 2024-09-11T23:25:53.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.658+0000 7f8947e00640 1 -- 172.21.15.144:0/224344337 shutdown_connections 2024-09-11T23:25:53.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.658+0000 7f8947e00640 1 --2- 172.21.15.144:0/224344337 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f892406c610 0x7f892406ead0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.658+0000 7f8947e00640 1 --2- 172.21.15.144:0/224344337 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f894815f570 0x7f894815b540 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.658+0000 7f8947e00640 1 --2- 172.21.15.144:0/224344337 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89480d0370 0x7f89480cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.659 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.658+0000 7f8947e00640 1 --2- 172.21.15.144:0/224344337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89480b6c60 0x7f894814ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.658+0000 7f8947e00640 1 -- 172.21.15.144:0/224344337 >> 172.21.15.144:0/224344337 conn(0x7f894806f390 msgr2=0x7f89480b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:53.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.658+0000 7f8947e00640 1 -- 172.21.15.144:0/224344337 shutdown_connections 2024-09-11T23:25:53.660 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.658+0000 7f8947e00640 1 -- 172.21.15.144:0/224344337 wait complete. 2024-09-11T23:25:53.676 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:25:53.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.832+0000 7fa24a200640 1 Processor -- start 2024-09-11T23:25:53.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.832+0000 7fa24a200640 1 -- start start 2024-09-11T23:25:53.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.834+0000 7fa24a200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa24415d3b0 0x7fa244071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:53.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.834+0000 7fa24a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2440cf320 0x7fa2440cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:53.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.834+0000 7fa24a200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2440715c0 con 0x7fa24415d790 2024-09-11T23:25:53.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.834+0000 7fa24a200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa24406da30 con 0x7fa24415d3b0 2024-09-11T23:25:53.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.834+0000 7fa24a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa24406d700 con 0x7fa2440cf320 2024-09-11T23:25:53.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.834+0000 7fa243400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa24415d3b0 0x7fa244071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:53.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.834+0000 7fa243400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa24415d3b0 0x7fa244071080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54750/0 (socket says 172.21.15.144:54750) 2024-09-11T23:25:53.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.834+0000 7fa243400640 1 -- 172.21.15.144:0/1728620347 learned_addr learned my addr 172.21.15.144:0/1728620347 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:53.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.834+0000 7fa23aa00640 1 --1- 172.21.15.144:0/1728620347 >> v1:172.21.15.144:6789/0 conn(0x7fa24415d790 0x7fa2440cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43488/0 (socket says 172.21.15.144:43488) 2024-09-11T23:25:53.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.834+0000 7fa243e00640 1 --2- 172.21.15.144:0/1728620347 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2440cf320 0x7fa2440cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:53.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.834+0000 7fa243400640 1 -- 172.21.15.144:0/1728620347 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2440cf320 msgr2=0x7fa2440cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:53.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.834+0000 7fa243400640 1 --2- 172.21.15.144:0/1728620347 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2440cf320 0x7fa2440cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.834+0000 7fa243400640 1 -- 172.21.15.144:0/1728620347 >> v1:172.21.15.144:6789/0 conn(0x7fa24415d790 legacy=0x7fa2440cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:53.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.835+0000 7fa243400640 1 -- 172.21.15.144:0/1728620347 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2440cde80 con 0x7fa24415d3b0 2024-09-11T23:25:53.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.834+0000 7fa242a00640 1 -- 172.21.15.144:0/1728620347 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2236619894 0 0) 0x7fa2440715c0 con 0x7fa24415d790 2024-09-11T23:25:53.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.835+0000 7fa243400640 1 --2- 172.21.15.144:0/1728620347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa24415d3b0 0x7fa244071080 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fa234009870 tx=0x7fa23402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f2ca585fbc2d76 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:53.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.836+0000 7fa242a00640 1 -- 172.21.15.144:0/1728620347 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234037070 con 0x7fa24415d3b0 2024-09-11T23:25:53.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.836+0000 7fa242a00640 1 -- 172.21.15.144:0/1728620347 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa234032440 con 0x7fa24415d3b0 2024-09-11T23:25:53.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.836+0000 7fa242a00640 1 -- 172.21.15.144:0/1728620347 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234032810 con 0x7fa24415d3b0 2024-09-11T23:25:53.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.836+0000 7fa24a200640 1 -- 172.21.15.144:0/1728620347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa24415d3b0 msgr2=0x7fa244071080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:53.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.836+0000 7fa24a200640 1 --2- 172.21.15.144:0/1728620347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa24415d3b0 0x7fa244071080 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fa234009870 tx=0x7fa23402a270 comp rx=0 tx=0).stop 2024-09-11T23:25:53.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.836+0000 7fa24a200640 1 -- 172.21.15.144:0/1728620347 shutdown_connections 2024-09-11T23:25:53.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.836+0000 7fa24a200640 1 --2- 172.21.15.144:0/1728620347 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa2440cf320 0x7fa2440cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.836+0000 7fa24a200640 1 --2- 172.21.15.144:0/1728620347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa24415d3b0 0x7fa244071080 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.836+0000 7fa24a200640 1 -- 172.21.15.144:0/1728620347 >> 172.21.15.144:0/1728620347 conn(0x7fa24406bba0 msgr2=0x7fa24406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:53.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.836+0000 7fa24a200640 1 -- 172.21.15.144:0/1728620347 shutdown_connections 2024-09-11T23:25:53.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.836+0000 7fa24a200640 1 -- 172.21.15.144:0/1728620347 wait complete. 2024-09-11T23:25:53.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.838+0000 7fa24a200640 1 Processor -- start 2024-09-11T23:25:53.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.838+0000 7fa24a200640 1 -- start start 2024-09-11T23:25:53.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.839+0000 7fa24a200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2440cf320 0x7fa2440aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:53.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.839+0000 7fa24a200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa24415d3b0 0x7fa2441564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:53.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.839+0000 7fa24a200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa244156a10 0x7fa2441f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:53.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.839+0000 7fa24a200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa2440cfcd0 con 0x7fa2440cf320 2024-09-11T23:25:53.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.839+0000 7fa24a200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa2440cdba0 con 0x7fa244156a10 2024-09-11T23:25:53.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.839+0000 7fa24a200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa2440cd580 con 0x7fa24415d3b0 2024-09-11T23:25:53.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.839+0000 7fa243400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2440cf320 0x7fa2440aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:53.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.839+0000 7fa243400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2440cf320 0x7fa2440aee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:54756/0 (socket says 172.21.15.144:54756) 2024-09-11T23:25:53.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.839+0000 7fa243400640 1 -- 172.21.15.144:0/1748366904 learned_addr learned my addr 172.21.15.144:0/1748366904 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:53.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.839+0000 7fa23aa00640 1 --2- 172.21.15.144:0/1748366904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa24415d3b0 0x7fa2441564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:53.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.839+0000 7fa243400640 1 -- 172.21.15.144:0/1748366904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa24415d3b0 msgr2=0x7fa2441564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:53.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.840+0000 7fa243400640 1 --2- 172.21.15.144:0/1748366904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa24415d3b0 0x7fa2441564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.840+0000 7fa243e00640 1 --2- 172.21.15.144:0/1748366904 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa244156a10 0x7fa2441f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:53.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.840+0000 7fa243400640 1 -- 172.21.15.144:0/1748366904 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa244156a10 msgr2=0x7fa2441f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:53.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.840+0000 7fa243400640 1 --2- 172.21.15.144:0/1748366904 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa244156a10 0x7fa2441f58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:53.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.840+0000 7fa243400640 1 -- 172.21.15.144:0/1748366904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2441f6610 con 0x7fa2440cf320 2024-09-11T23:25:53.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.840+0000 7fa23aa00640 1 --2- 172.21.15.144:0/1748366904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa24415d3b0 0x7fa2441564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:53.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.840+0000 7fa243400640 1 --2- 172.21.15.144:0/1748366904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2440cf320 0x7fa2440aee20 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fa234009870 tx=0x7fa2340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:53.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.840+0000 7fa23be00640 1 -- 172.21.15.144:0/1748366904 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234041020 con 0x7fa2440cf320 2024-09-11T23:25:53.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.840+0000 7fa23be00640 1 -- 172.21.15.144:0/1748366904 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2340306c0 con 0x7fa2440cf320 2024-09-11T23:25:53.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.840+0000 7fa23be00640 1 -- 172.21.15.144:0/1748366904 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234037040 con 0x7fa2440cf320 2024-09-11T23:25:53.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.840+0000 7fa24a200640 1 -- 172.21.15.144:0/1748366904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2440ac050 con 0x7fa2440cf320 2024-09-11T23:25:53.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.840+0000 7fa24a200640 1 -- 172.21.15.144:0/1748366904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2440af360 con 0x7fa2440cf320 2024-09-11T23:25:53.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.841+0000 7fa24a200640 1 -- 172.21.15.144:0/1748366904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa244156e20 con 0x7fa2440cf320 2024-09-11T23:25:53.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.842+0000 7fa23be00640 1 -- 172.21.15.144:0/1748366904 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7fa234044020 con 0x7fa2440cf320 2024-09-11T23:25:53.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.843+0000 7fa23be00640 1 --2- 172.21.15.144:0/1748366904 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa22006c610 0x7fa22006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:53.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.843+0000 7fa23be00640 1 -- 172.21.15.144:0/1748366904 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5709+0+0 (secure 0 0 0) 0x7fa2340ac8b0 con 0x7fa2440cf320 2024-09-11T23:25:53.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.843+0000 7fa23aa00640 1 --2- 172.21.15.144:0/1748366904 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa22006c610 0x7fa22006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:53.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.844+0000 7fa23aa00640 1 --2- 172.21.15.144:0/1748366904 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa22006c610 0x7fa22006ead0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa2440af7f0 tx=0x7fa22c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:53.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:53.848+0000 7fa23be00640 1 -- 172.21.15.144:0/1748366904 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa23404b030 con 0x7fa2440cf320 2024-09-11T23:25:54.064 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:54.063+0000 7fa24a200640 1 -- 172.21.15.144:0/1748366904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa24415cbf0 con 0x7fa2440cf320 2024-09-11T23:25:54.872 INFO:tasks.ceph.mds.c.smithi144.stderr:2024-09-11T23:25:54.870+0000 7ff1cc200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:25:54.918 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:54.918+0000 7fa23be00640 1 -- 172.21.15.144:0/1748366904 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v108) ==== 118+0+0 (secure 0 0 0) 0x7fa23407a2d0 con 0x7fa2440cf320 2024-09-11T23:25:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:54.921+0000 7fa24a200640 1 -- 172.21.15.144:0/1748366904 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa22006c610 msgr2=0x7fa22006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:54.921+0000 7fa24a200640 1 --2- 172.21.15.144:0/1748366904 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa22006c610 0x7fa22006ead0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa2440af7f0 tx=0x7fa22c009040 comp rx=0 tx=0).stop 2024-09-11T23:25:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:54.921+0000 7fa24a200640 1 -- 172.21.15.144:0/1748366904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2440cf320 msgr2=0x7fa2440aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:54.921+0000 7fa24a200640 1 --2- 172.21.15.144:0/1748366904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2440cf320 0x7fa2440aee20 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fa234009870 tx=0x7fa2340046c0 comp rx=0 tx=0).stop 2024-09-11T23:25:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:54.921+0000 7fa24a200640 1 -- 172.21.15.144:0/1748366904 shutdown_connections 2024-09-11T23:25:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:54.921+0000 7fa24a200640 1 --2- 172.21.15.144:0/1748366904 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa22006c610 0x7fa22006ead0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:54.921+0000 7fa24a200640 1 --2- 172.21.15.144:0/1748366904 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa244156a10 0x7fa2441f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:54.921+0000 7fa24a200640 1 --2- 172.21.15.144:0/1748366904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa24415d3b0 0x7fa2441564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:54.921+0000 7fa24a200640 1 --2- 172.21.15.144:0/1748366904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2440cf320 0x7fa2440aee20 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:54.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:54.921+0000 7fa24a200640 1 -- 172.21.15.144:0/1748366904 >> 172.21.15.144:0/1748366904 conn(0x7fa24406bba0 msgr2=0x7fa24406dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:54.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:54.921+0000 7fa24a200640 1 -- 172.21.15.144:0/1748366904 shutdown_connections 2024-09-11T23:25:54.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:54.921+0000 7fa24a200640 1 -- 172.21.15.144:0/1748366904 wait complete. 2024-09-11T23:25:54.940 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:25:54.941 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:25:55.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.099+0000 7fdbcfc00640 1 Processor -- start 2024-09-11T23:25:55.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.099+0000 7fdbcfc00640 1 -- start start 2024-09-11T23:25:55.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.100+0000 7fdbcfc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdbc80b3d50 0x7fdbc806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:55.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.100+0000 7fdbcfc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc80cf9a0 con 0x7fdbc8161e30 2024-09-11T23:25:55.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.100+0000 7fdbcfc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc8162210 con 0x7fdbc80b3290 2024-09-11T23:25:55.103 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.100+0000 7fdbcfc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fdbc80cfcf0 con 0x7fdbc80b3d50 2024-09-11T23:25:55.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.100+0000 7fdbc7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdbc80b3d50 0x7fdbc806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:55.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.100+0000 7fdbcd200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdbc8161e30 0x7fdbc80d34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35152/0 (socket says 172.21.15.144:35152) 2024-09-11T23:25:55.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.101+0000 7fdbc7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdbc80b3d50 0x7fdbc806d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40772/0 (socket says 172.21.15.144:40772) 2024-09-11T23:25:55.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.101+0000 7fdbcd200640 1 -- 172.21.15.144:0/3142321043 learned_addr learned my addr 172.21.15.144:0/3142321043 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:55.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.101+0000 7fdbc7e00640 1 -- 172.21.15.144:0/3142321043 >> v1:172.21.15.165:6789/0 conn(0x7fdbc80b3290 legacy=0x7fdbc80b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:55.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.101+0000 7fdbc7e00640 1 -- 172.21.15.144:0/3142321043 >> v1:172.21.15.144:6789/0 conn(0x7fdbc8161e30 legacy=0x7fdbc80d34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:55.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.101+0000 7fdbc7e00640 1 -- 172.21.15.144:0/3142321043 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc80d5210 con 0x7fdbc80b3d50 2024-09-11T23:25:55.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.101+0000 7fdbc7400640 1 -- 172.21.15.144:0/3142321043 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2397377545 0 0) 0x7fdbc80cf9a0 con 0x7fdbc8161e30 2024-09-11T23:25:55.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.102+0000 7fdbc7e00640 1 --2- 172.21.15.144:0/3142321043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbc80b3d50 0x7fdbc806d8c0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40097a0 tx=0x7fdbb402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d3b69471a21099 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:55.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.102+0000 7fdbc7400640 1 -- 172.21.15.144:0/3142321043 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4037070 con 0x7fdbc80b3d50 2024-09-11T23:25:55.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.102+0000 7fdbc7400640 1 -- 172.21.15.144:0/3142321043 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbb4032440 con 0x7fdbc80b3d50 2024-09-11T23:25:55.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.102+0000 7fdbc7400640 1 -- 172.21.15.144:0/3142321043 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4032810 con 0x7fdbc80b3d50 2024-09-11T23:25:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.103+0000 7fdbcfc00640 1 -- 172.21.15.144:0/3142321043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbc80b3d50 msgr2=0x7fdbc806d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.103+0000 7fdbcfc00640 1 --2- 172.21.15.144:0/3142321043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbc80b3d50 0x7fdbc806d8c0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40097a0 tx=0x7fdbb402a1e0 comp rx=0 tx=0).stop 2024-09-11T23:25:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.103+0000 7fdbcfc00640 1 -- 172.21.15.144:0/3142321043 shutdown_connections 2024-09-11T23:25:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.103+0000 7fdbcfc00640 1 --2- 172.21.15.144:0/3142321043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbc80b3d50 0x7fdbc806d8c0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.103+0000 7fdbcfc00640 1 -- 172.21.15.144:0/3142321043 >> 172.21.15.144:0/3142321043 conn(0x7fdbc80d1870 msgr2=0x7fdbc80d47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.103+0000 7fdbcfc00640 1 -- 172.21.15.144:0/3142321043 shutdown_connections 2024-09-11T23:25:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.103+0000 7fdbcfc00640 1 -- 172.21.15.144:0/3142321043 wait complete. 2024-09-11T23:25:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.105+0000 7fdbcfc00640 1 Processor -- start 2024-09-11T23:25:55.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.105+0000 7fdbcfc00640 1 -- start start 2024-09-11T23:25:55.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.106+0000 7fdbcfc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbc80b3290 0x7fdbc814bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:55.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.106+0000 7fdbcfc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbc80b3d50 0x7fdbc815ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:55.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.106+0000 7fdbcfc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdbc8161e30 0x7fdbc815f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:55.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.106+0000 7fdbcfc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc806de00 con 0x7fdbc80b3290 2024-09-11T23:25:55.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.106+0000 7fdbcfc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc80b3950 con 0x7fdbc80b3d50 2024-09-11T23:25:55.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.106+0000 7fdbcfc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdbc806df80 con 0x7fdbc8161e30 2024-09-11T23:25:55.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.106+0000 7fdbcd200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbc80b3290 0x7fdbc814bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:55.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.106+0000 7fdbcd200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbc80b3290 0x7fdbc814bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40788/0 (socket says 172.21.15.144:40788) 2024-09-11T23:25:55.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.106+0000 7fdbcd200640 1 -- 172.21.15.144:0/3870126379 learned_addr learned my addr 172.21.15.144:0/3870126379 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:55.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.106+0000 7fdbc7e00640 1 --2- 172.21.15.144:0/3870126379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbc80b3d50 0x7fdbc815ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:55.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.106+0000 7fdbcd200640 1 -- 172.21.15.144:0/3870126379 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdbc8161e30 msgr2=0x7fdbc815f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:55.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.106+0000 7fdbcd200640 1 --2- 172.21.15.144:0/3870126379 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdbc8161e30 0x7fdbc815f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:55.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.106+0000 7fdbcd200640 1 -- 172.21.15.144:0/3870126379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbc80b3d50 msgr2=0x7fdbc815ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:55.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.106+0000 7fdbcd200640 1 --2- 172.21.15.144:0/3870126379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbc80b3d50 0x7fdbc815ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:55.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.106+0000 7fdbcd200640 1 -- 172.21.15.144:0/3870126379 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc80c8390 con 0x7fdbc80b3290 2024-09-11T23:25:55.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.106+0000 7fdbc7e00640 1 --2- 172.21.15.144:0/3870126379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbc80b3d50 0x7fdbc815ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:55.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.107+0000 7fdbcd200640 1 --2- 172.21.15.144:0/3870126379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbc80b3290 0x7fdbc814bed0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00c430 tx=0x7fdbbc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:55.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.107+0000 7fdbc4c00640 1 -- 172.21.15.144:0/3870126379 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc0074e0 con 0x7fdbc80b3290 2024-09-11T23:25:55.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.107+0000 7fdbc4c00640 1 -- 172.21.15.144:0/3870126379 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbbc0047e0 con 0x7fdbc80b3290 2024-09-11T23:25:55.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.107+0000 7fdbcfc00640 1 -- 172.21.15.144:0/3870126379 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc80c8670 con 0x7fdbc80b3290 2024-09-11T23:25:55.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.107+0000 7fdbc4c00640 1 -- 172.21.15.144:0/3870126379 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc004bd0 con 0x7fdbc80b3290 2024-09-11T23:25:55.110 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.107+0000 7fdbcfc00640 1 -- 172.21.15.144:0/3870126379 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc80c8c30 con 0x7fdbc80b3290 2024-09-11T23:25:55.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.108+0000 7fdbcfc00640 1 -- 172.21.15.144:0/3870126379 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc806d8c0 con 0x7fdbc80b3290 2024-09-11T23:25:55.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.109+0000 7fdbc4c00640 1 -- 172.21.15.144:0/3870126379 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7fdbbc011070 con 0x7fdbc80b3290 2024-09-11T23:25:55.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.110+0000 7fdbc4c00640 1 --2- 172.21.15.144:0/3870126379 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdba806c610 0x7fdba806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:55.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.110+0000 7fdbc4c00640 1 -- 172.21.15.144:0/3870126379 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7fdbbc0894a0 con 0x7fdbc80b3290 2024-09-11T23:25:55.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.110+0000 7fdbc7e00640 1 --2- 172.21.15.144:0/3870126379 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdba806c610 0x7fdba806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:55.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.111+0000 7fdbc7e00640 1 --2- 172.21.15.144:0/3870126379 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdba806c610 0x7fdba806ead0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4034000 tx=0x7fdbb402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:55.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.114+0000 7fdbc4c00640 1 -- 172.21.15.144:0/3870126379 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdbbc00e280 con 0x7fdbc80b3290 2024-09-11T23:25:55.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.321+0000 7fdbcfc00640 1 -- 172.21.15.144:0/3870126379 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fdbc80cf170 con 0x7fdbc80b3290 2024-09-11T23:25:55.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.926+0000 7fdbc4c00640 1 -- 172.21.15.144:0/3870126379 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v109) ==== 122+0+0 (secure 0 0 0) 0x7fdbbc059740 con 0x7fdbc80b3290 2024-09-11T23:25:55.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.929+0000 7fdbcfc00640 1 -- 172.21.15.144:0/3870126379 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdba806c610 msgr2=0x7fdba806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:55.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.929+0000 7fdbcfc00640 1 --2- 172.21.15.144:0/3870126379 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdba806c610 0x7fdba806ead0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4034000 tx=0x7fdbb402e000 comp rx=0 tx=0).stop 2024-09-11T23:25:55.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.929+0000 7fdbcfc00640 1 -- 172.21.15.144:0/3870126379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbc80b3290 msgr2=0x7fdbc814bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:55.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.929+0000 7fdbcfc00640 1 --2- 172.21.15.144:0/3870126379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbc80b3290 0x7fdbc814bed0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00c430 tx=0x7fdbbc00c8f0 comp rx=0 tx=0).stop 2024-09-11T23:25:55.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.929+0000 7fdbcfc00640 1 -- 172.21.15.144:0/3870126379 shutdown_connections 2024-09-11T23:25:55.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.929+0000 7fdbcfc00640 1 --2- 172.21.15.144:0/3870126379 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdba806c610 0x7fdba806ead0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:55.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.929+0000 7fdbcfc00640 1 --2- 172.21.15.144:0/3870126379 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdbc8161e30 0x7fdbc815f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:55.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.929+0000 7fdbcfc00640 1 --2- 172.21.15.144:0/3870126379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdbc80b3d50 0x7fdbc815ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:55.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.929+0000 7fdbcfc00640 1 --2- 172.21.15.144:0/3870126379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbc80b3290 0x7fdbc814bed0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:55.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.929+0000 7fdbcfc00640 1 -- 172.21.15.144:0/3870126379 >> 172.21.15.144:0/3870126379 conn(0x7fdbc80d1870 msgr2=0x7fdbc80b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:55.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.930+0000 7fdbcfc00640 1 -- 172.21.15.144:0/3870126379 shutdown_connections 2024-09-11T23:25:55.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:55.930+0000 7fdbcfc00640 1 -- 172.21.15.144:0/3870126379 wait complete. 2024-09-11T23:25:55.947 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:25:55.948 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:25:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.103+0000 7f3f35c00640 1 Processor -- start 2024-09-11T23:25:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.103+0000 7f3f35c00640 1 -- start start 2024-09-11T23:25:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.104+0000 7f3f35c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f3015e640 0x7f3f300d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.104+0000 7f3f35c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f3006bee0 con 0x7f3f300b66e0 2024-09-11T23:25:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.104+0000 7f3f35c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f3006c1c0 con 0x7f3f300d3f60 2024-09-11T23:25:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.104+0000 7f3f35c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3f3015ea20 con 0x7f3f3015e640 2024-09-11T23:25:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.104+0000 7f3f35200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3f300b66e0 0x7f3f300b7750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35160/0 (socket says 172.21.15.144:35160) 2024-09-11T23:25:56.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.104+0000 7f3f35200640 1 -- 172.21.15.144:0/1158237689 learned_addr learned my addr 172.21.15.144:0/1158237689 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:56.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.105+0000 7f3f2fe00640 1 --2- 172.21.15.144:0/1158237689 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f3015e640 0x7f3f300d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:56.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.105+0000 7f3f2ea00640 1 -- 172.21.15.144:0/1158237689 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2939472588 0 0) 0x7f3f3006bee0 con 0x7f3f300b66e0 2024-09-11T23:25:56.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.105+0000 7f3f2ea00640 1 -- 172.21.15.144:0/1158237689 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f14003520 con 0x7f3f300b66e0 2024-09-11T23:25:56.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.105+0000 7f3f2ea00640 1 -- 172.21.15.144:0/1158237689 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1225829713 0 0) 0x7f3f3006c1c0 con 0x7f3f300d3f60 2024-09-11T23:25:56.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.105+0000 7f3f2ea00640 1 -- 172.21.15.144:0/1158237689 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f3006bee0 con 0x7f3f300d3f60 2024-09-11T23:25:56.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.105+0000 7f3f2fe00640 1 -- 172.21.15.144:0/1158237689 >> v1:172.21.15.165:6789/0 conn(0x7f3f300d3f60 legacy=0x7f3f300b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.105+0000 7f3f2fe00640 1 -- 172.21.15.144:0/1158237689 >> v1:172.21.15.144:6789/0 conn(0x7f3f300b66e0 legacy=0x7f3f300b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.105+0000 7f3f2fe00640 1 -- 172.21.15.144:0/1158237689 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3006c4a0 con 0x7f3f3015e640 2024-09-11T23:25:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.106+0000 7f3f2fe00640 1 --2- 172.21.15.144:0/1158237689 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f3015e640 0x7f3f300d3a20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3f200097d0 tx=0x7f3f2002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98308e2b56cbc2ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.107+0000 7f3f2ea00640 1 -- 172.21.15.144:0/1158237689 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f20037070 con 0x7f3f3015e640 2024-09-11T23:25:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.107+0000 7f3f2ea00640 1 -- 172.21.15.144:0/1158237689 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f20032440 con 0x7f3f3015e640 2024-09-11T23:25:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.107+0000 7f3f2ea00640 1 -- 172.21.15.144:0/1158237689 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f20032810 con 0x7f3f3015e640 2024-09-11T23:25:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.107+0000 7f3f35c00640 1 -- 172.21.15.144:0/1158237689 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f3015e640 msgr2=0x7f3f300d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.107+0000 7f3f35c00640 1 --2- 172.21.15.144:0/1158237689 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f3015e640 0x7f3f300d3a20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3f200097d0 tx=0x7f3f2002a210 comp rx=0 tx=0).stop 2024-09-11T23:25:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.107+0000 7f3f35c00640 1 -- 172.21.15.144:0/1158237689 shutdown_connections 2024-09-11T23:25:56.108 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.107+0000 7f3f35c00640 1 --2- 172.21.15.144:0/1158237689 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f3015e640 0x7f3f300d3a20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.107+0000 7f3f35c00640 1 -- 172.21.15.144:0/1158237689 >> 172.21.15.144:0/1158237689 conn(0x7f3f300d0fd0 msgr2=0x7f3f300d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.107+0000 7f3f35c00640 1 -- 172.21.15.144:0/1158237689 shutdown_connections 2024-09-11T23:25:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.107+0000 7f3f35c00640 1 -- 172.21.15.144:0/1158237689 wait complete. 2024-09-11T23:25:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.109+0000 7f3f35c00640 1 Processor -- start 2024-09-11T23:25:56.109 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.109+0000 7f3f35c00640 1 -- start start 2024-09-11T23:25:56.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.110+0000 7f3f35c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f300b66e0 0x7f3f30150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.110+0000 7f3f35c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f300d3f60 0x7f3f300ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.110+0000 7f3f35c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f3015e640 0x7f3f300ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.110+0000 7f3f35c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3f300b7e60 con 0x7f3f300b66e0 2024-09-11T23:25:56.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.110+0000 7f3f35c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3006caf0 con 0x7f3f300d3f60 2024-09-11T23:25:56.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.110+0000 7f3f35c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3f300b7fe0 con 0x7f3f3015e640 2024-09-11T23:25:56.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.110+0000 7f3f2fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f300b66e0 0x7f3f30150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:56.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.110+0000 7f3f2fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f300b66e0 0x7f3f30150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40792/0 (socket says 172.21.15.144:40792) 2024-09-11T23:25:56.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.110+0000 7f3f2fe00640 1 -- 172.21.15.144:0/1950902415 learned_addr learned my addr 172.21.15.144:0/1950902415 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:56.111 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.110+0000 7f3f2fe00640 1 -- 172.21.15.144:0/1950902415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f3015e640 msgr2=0x7f3f300ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.110+0000 7f3f2fe00640 1 --2- 172.21.15.144:0/1950902415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f3015e640 0x7f3f300ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.110+0000 7f3f2fe00640 1 -- 172.21.15.144:0/1950902415 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f300d3f60 msgr2=0x7f3f300ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.110+0000 7f3f2fe00640 1 --2- 172.21.15.144:0/1950902415 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f300d3f60 0x7f3f300ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.110+0000 7f3f2fe00640 1 -- 172.21.15.144:0/1950902415 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f301e7e40 con 0x7f3f300b66e0 2024-09-11T23:25:56.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.111+0000 7f3f2fe00640 1 --2- 172.21.15.144:0/1950902415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f300b66e0 0x7f3f30150860 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f3f200098f0 tx=0x7f3f200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:56.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.111+0000 7f3f27e00640 1 -- 172.21.15.144:0/1950902415 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f20041020 con 0x7f3f300b66e0 2024-09-11T23:25:56.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.111+0000 7f3f27e00640 1 -- 172.21.15.144:0/1950902415 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2003d6e0 con 0x7f3f300b66e0 2024-09-11T23:25:56.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.111+0000 7f3f27e00640 1 -- 172.21.15.144:0/1950902415 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f20037040 con 0x7f3f300b66e0 2024-09-11T23:25:56.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.111+0000 7f3f35c00640 1 -- 172.21.15.144:0/1950902415 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f301e6b00 con 0x7f3f300b66e0 2024-09-11T23:25:56.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.111+0000 7f3f35c00640 1 -- 172.21.15.144:0/1950902415 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f301e7360 con 0x7f3f300b66e0 2024-09-11T23:25:56.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.112+0000 7f3f35c00640 1 -- 172.21.15.144:0/1950902415 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f300d3a20 con 0x7f3f300b66e0 2024-09-11T23:25:56.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.113+0000 7f3f27e00640 1 -- 172.21.15.144:0/1950902415 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f3f20044020 con 0x7f3f300b66e0 2024-09-11T23:25:56.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.114+0000 7f3f27e00640 1 --2- 172.21.15.144:0/1950902415 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3f1006c610 0x7f3f1006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.114+0000 7f3f27e00640 1 -- 172.21.15.144:0/1950902415 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f3f200aa000 con 0x7f3f300b66e0 2024-09-11T23:25:56.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.114+0000 7f3f2f400640 1 --2- 172.21.15.144:0/1950902415 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3f1006c610 0x7f3f1006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:56.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.115+0000 7f3f2f400640 1 --2- 172.21.15.144:0/1950902415 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3f1006c610 0x7f3f1006ead0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0011e0 tx=0x7f3f1c0078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:56.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.118+0000 7f3f27e00640 1 -- 172.21.15.144:0/1950902415 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3f2004b030 con 0x7f3f300b66e0 2024-09-11T23:25:56.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.325+0000 7f3f35c00640 1 -- 172.21.15.144:0/1950902415 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f300d3100 con 0x7f3f300b66e0 2024-09-11T23:25:56.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.326+0000 7f3f27e00640 1 -- 172.21.15.144:0/1950902415 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+5245 (secure 0 0 0) 0x7f3f2007a220 con 0x7f3f300b66e0 2024-09-11T23:25:56.329 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:56.329 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":109,"btime":"2024-09-11T23:25:55:920158+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/2302333712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2302333712},{"type":"v1","addr":"172.21.15.144:6801","nonce":2302333712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104},{"gid":7097,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3051519109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3051519109},{"type":"v1","addr":"172.21.15.165:6834","nonce":3051519109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2403316225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2403316225},{"type":"v1","addr":"172.21.15.165:6835","nonce":2403316225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:25:52.298959+0000","modified":"2024-09-11T23:25:55.324109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8664":{"gid":8664,"name":"c","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/3397068730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3397068730},{"type":"v1","addr":"172.21.15.144:6835","nonce":3397068730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8664,"qdb_cluster":[8664]},"id":12}]} 2024-09-11T23:25:56.330 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 109 2024-09-11T23:25:56.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.328+0000 7f3f35c00640 1 -- 172.21.15.144:0/1950902415 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3f1006c610 msgr2=0x7f3f1006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.328+0000 7f3f35c00640 1 --2- 172.21.15.144:0/1950902415 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3f1006c610 0x7f3f1006ead0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0011e0 tx=0x7f3f1c0078f0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.329+0000 7f3f35c00640 1 -- 172.21.15.144:0/1950902415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f300b66e0 msgr2=0x7f3f30150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.329+0000 7f3f35c00640 1 --2- 172.21.15.144:0/1950902415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f300b66e0 0x7f3f30150860 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f3f200098f0 tx=0x7f3f200046c0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.329+0000 7f3f35c00640 1 -- 172.21.15.144:0/1950902415 shutdown_connections 2024-09-11T23:25:56.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.329+0000 7f3f35c00640 1 --2- 172.21.15.144:0/1950902415 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3f1006c610 0x7f3f1006ead0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.329+0000 7f3f35c00640 1 --2- 172.21.15.144:0/1950902415 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3f3015e640 0x7f3f300ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.329+0000 7f3f35c00640 1 --2- 172.21.15.144:0/1950902415 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f300d3f60 0x7f3f300ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.329+0000 7f3f35c00640 1 --2- 172.21.15.144:0/1950902415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f300b66e0 0x7f3f30150860 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.329+0000 7f3f35c00640 1 -- 172.21.15.144:0/1950902415 >> 172.21.15.144:0/1950902415 conn(0x7f3f300d0fd0 msgr2=0x7f3f300b7380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:56.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.329+0000 7f3f35c00640 1 -- 172.21.15.144:0/1950902415 shutdown_connections 2024-09-11T23:25:56.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.329+0000 7f3f35c00640 1 -- 172.21.15.144:0/1950902415 wait complete. 2024-09-11T23:25:56.347 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:25:56.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.501+0000 7f04b1000640 1 Processor -- start 2024-09-11T23:25:56.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.501+0000 7f04b1000640 1 -- start start 2024-09-11T23:25:56.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.502+0000 7f04b1000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f04ac06be10 0x7f04ac0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.502+0000 7f04b1000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f04ac06c1f0 0x7f04ac15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.502+0000 7f04b1000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04ac0cd5f0 con 0x7f04ac151540 2024-09-11T23:25:56.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.502+0000 7f04b1000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f04ac0cd8d0 con 0x7f04ac06be10 2024-09-11T23:25:56.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.502+0000 7f04b1000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f04ac0cdbb0 con 0x7f04ac06c1f0 2024-09-11T23:25:56.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.502+0000 7f04a9e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f04ac06be10 0x7f04ac0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:56.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.502+0000 7f04a9e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f04ac06be10 0x7f04ac0cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40806/0 (socket says 172.21.15.144:40806) 2024-09-11T23:25:56.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.502+0000 7f04a9e00640 1 -- 172.21.15.144:0/1738150341 learned_addr learned my addr 172.21.15.144:0/1738150341 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:56.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.503+0000 7f04a9e00640 1 -- 172.21.15.144:0/1738150341 >> v2:172.21.15.165:3300/0 conn(0x7f04ac06c1f0 msgr2=0x7f04ac15baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:56.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.503+0000 7f04a9e00640 1 --2- 172.21.15.144:0/1738150341 >> v2:172.21.15.165:3300/0 conn(0x7f04ac06c1f0 0x7f04ac15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.503+0000 7f04a9e00640 1 -- 172.21.15.144:0/1738150341 >> v1:172.21.15.165:6789/0 conn(0x7f04ac151540 legacy=0x7f04ac151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:56.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.503+0000 7f04a9e00640 1 -- 172.21.15.144:0/1738150341 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ac0cde90 con 0x7f04ac06be10 2024-09-11T23:25:56.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.503+0000 7f04a9e00640 1 --2- 172.21.15.144:0/1738150341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04ac06be10 0x7f04ac0cd010 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f04ac06ca50 tx=0x7f049c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4e008c2cd46eda server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:56.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.504+0000 7f04a9400640 1 -- 172.21.15.144:0/1738150341 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049c037070 con 0x7f04ac06be10 2024-09-11T23:25:56.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.504+0000 7f04a9400640 1 -- 172.21.15.144:0/1738150341 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049c032440 con 0x7f04ac06be10 2024-09-11T23:25:56.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.504+0000 7f04a9400640 1 -- 172.21.15.144:0/1738150341 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049c032810 con 0x7f04ac06be10 2024-09-11T23:25:56.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.504+0000 7f04b1000640 1 -- 172.21.15.144:0/1738150341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04ac06be10 msgr2=0x7f04ac0cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.504+0000 7f04b1000640 1 --2- 172.21.15.144:0/1738150341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04ac06be10 0x7f04ac0cd010 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f04ac06ca50 tx=0x7f049c02a230 comp rx=0 tx=0).stop 2024-09-11T23:25:56.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.504+0000 7f04b1000640 1 -- 172.21.15.144:0/1738150341 shutdown_connections 2024-09-11T23:25:56.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.504+0000 7f04b1000640 1 --2- 172.21.15.144:0/1738150341 >> v2:172.21.15.165:3300/0 conn(0x7f04ac06c1f0 0x7f04ac15baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.504+0000 7f04b1000640 1 --2- 172.21.15.144:0/1738150341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04ac06be10 0x7f04ac0cd010 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.504+0000 7f04b1000640 1 -- 172.21.15.144:0/1738150341 >> 172.21.15.144:0/1738150341 conn(0x7f04ac062cc0 msgr2=0x7f04ac06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:56.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.505+0000 7f04b1000640 1 -- 172.21.15.144:0/1738150341 shutdown_connections 2024-09-11T23:25:56.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.505+0000 7f04b1000640 1 -- 172.21.15.144:0/1738150341 wait complete. 2024-09-11T23:25:56.506 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.506+0000 7f04b1000640 1 Processor -- start 2024-09-11T23:25:56.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.506+0000 7f04b1000640 1 -- start start 2024-09-11T23:25:56.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.507+0000 7f04b1000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04ac06be10 0x7f04ac152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.507+0000 7f04b1000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04ac06c1f0 0x7f04ac142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.509 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.507+0000 7f04b1000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04ac151540 0x7f04ac142ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.507+0000 7f04b1000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac0d0310 con 0x7f04ac06be10 2024-09-11T23:25:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.507+0000 7f04b1000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac0ce690 con 0x7f04ac06c1f0 2024-09-11T23:25:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.507+0000 7f04b1000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f04ac0d0490 con 0x7f04ac151540 2024-09-11T23:25:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.507+0000 7f04a9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04ac06be10 0x7f04ac152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.507+0000 7f04a9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04ac06be10 0x7f04ac152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40818/0 (socket says 172.21.15.144:40818) 2024-09-11T23:25:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.507+0000 7f04a9e00640 1 -- 172.21.15.144:0/2459888019 learned_addr learned my addr 172.21.15.144:0/2459888019 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.507+0000 7f04aa800640 1 --2- 172.21.15.144:0/2459888019 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04ac151540 0x7f04ac142ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.507+0000 7f04a1400640 1 --2- 172.21.15.144:0/2459888019 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04ac06c1f0 0x7f04ac142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.508+0000 7f04a9e00640 1 -- 172.21.15.144:0/2459888019 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04ac151540 msgr2=0x7f04ac142ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.508+0000 7f04a9e00640 1 --2- 172.21.15.144:0/2459888019 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04ac151540 0x7f04ac142ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.508+0000 7f04a9e00640 1 -- 172.21.15.144:0/2459888019 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04ac06c1f0 msgr2=0x7f04ac142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.508+0000 7f04a9e00640 1 --2- 172.21.15.144:0/2459888019 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04ac06c1f0 0x7f04ac142510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.508+0000 7f04a9e00640 1 -- 172.21.15.144:0/2459888019 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ac143300 con 0x7f04ac06be10 2024-09-11T23:25:56.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.508+0000 7f04a1400640 1 --2- 172.21.15.144:0/2459888019 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04ac06c1f0 0x7f04ac142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:56.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.508+0000 7f04a9e00640 1 --2- 172.21.15.144:0/2459888019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04ac06be10 0x7f04ac152400 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f049c02a270 tx=0x7f049c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:56.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.508+0000 7f04a2a00640 1 -- 172.21.15.144:0/2459888019 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049c041070 con 0x7f04ac06be10 2024-09-11T23:25:56.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.508+0000 7f04a2a00640 1 -- 172.21.15.144:0/2459888019 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049c03c870 con 0x7f04ac06be10 2024-09-11T23:25:56.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.508+0000 7f04a2a00640 1 -- 172.21.15.144:0/2459888019 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049c037040 con 0x7f04ac06be10 2024-09-11T23:25:56.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.508+0000 7f04b1000640 1 -- 172.21.15.144:0/2459888019 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04ac071b70 con 0x7f04ac06be10 2024-09-11T23:25:56.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.508+0000 7f04b1000640 1 -- 172.21.15.144:0/2459888019 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04ac072130 con 0x7f04ac06be10 2024-09-11T23:25:56.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.509+0000 7f04b1000640 1 -- 172.21.15.144:0/2459888019 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04ac0d0830 con 0x7f04ac06be10 2024-09-11T23:25:56.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.510+0000 7f04a2a00640 1 -- 172.21.15.144:0/2459888019 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f049c044070 con 0x7f04ac06be10 2024-09-11T23:25:56.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.512+0000 7f04a2a00640 1 --2- 172.21.15.144:0/2459888019 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f048806c610 0x7f048806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.512+0000 7f04a2a00640 1 -- 172.21.15.144:0/2459888019 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f049c0acbe0 con 0x7f04ac06be10 2024-09-11T23:25:56.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.512+0000 7f04a1400640 1 --2- 172.21.15.144:0/2459888019 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f048806c610 0x7f048806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:56.513 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.513+0000 7f04a1400640 1 --2- 172.21.15.144:0/2459888019 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f048806c610 0x7f048806ead0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f04ac14fa70 tx=0x7f0494008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:56.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.516+0000 7f04a2a00640 1 -- 172.21.15.144:0/2459888019 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f049c07a640 con 0x7f04ac06be10 2024-09-11T23:25:56.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.689+0000 7f04b1000640 1 -- 172.21.15.144:0/2459888019 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04ac06d1d0 con 0x7f04ac06be10 2024-09-11T23:25:56.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.690+0000 7f04a2a00640 1 -- 172.21.15.144:0/2459888019 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) ==== 74+0+16763 (secure 0 0 0) 0x7f049c079f40 con 0x7f04ac06be10 2024-09-11T23:25:56.691 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:56.692 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":153,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:25:53.902129+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:25:50.064555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-11T23:25:51.293809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:25:56.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.693+0000 7f04b1000640 1 -- 172.21.15.144:0/2459888019 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f048806c610 msgr2=0x7f048806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.693+0000 7f04b1000640 1 --2- 172.21.15.144:0/2459888019 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f048806c610 0x7f048806ead0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f04ac14fa70 tx=0x7f0494008040 comp rx=0 tx=0).stop 2024-09-11T23:25:56.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.693+0000 7f04b1000640 1 -- 172.21.15.144:0/2459888019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04ac06be10 msgr2=0x7f04ac152400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.693+0000 7f04b1000640 1 --2- 172.21.15.144:0/2459888019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04ac06be10 0x7f04ac152400 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f049c02a270 tx=0x7f049c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.693+0000 7f04b1000640 1 -- 172.21.15.144:0/2459888019 shutdown_connections 2024-09-11T23:25:56.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.693+0000 7f04b1000640 1 --2- 172.21.15.144:0/2459888019 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f048806c610 0x7f048806ead0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.693+0000 7f04b1000640 1 --2- 172.21.15.144:0/2459888019 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04ac151540 0x7f04ac142ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.693+0000 7f04b1000640 1 --2- 172.21.15.144:0/2459888019 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04ac06c1f0 0x7f04ac142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.693+0000 7f04b1000640 1 --2- 172.21.15.144:0/2459888019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04ac06be10 0x7f04ac152400 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.693+0000 7f04b1000640 1 -- 172.21.15.144:0/2459888019 >> 172.21.15.144:0/2459888019 conn(0x7f04ac062cc0 msgr2=0x7f04ac0ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:56.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.693+0000 7f04b1000640 1 -- 172.21.15.144:0/2459888019 shutdown_connections 2024-09-11T23:25:56.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.693+0000 7f04b1000640 1 -- 172.21.15.144:0/2459888019 wait complete. 2024-09-11T23:25:56.710 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:25:56.710 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:25:56.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.864+0000 7f52e9e00640 1 Processor -- start 2024-09-11T23:25:56.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.864+0000 7f52e9e00640 1 -- start start 2024-09-11T23:25:56.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.865+0000 7f52e9e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f52e415ed20 0x7f52e40b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.865+0000 7f52e9e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f52e40cef90 0x7f52e40b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.865+0000 7f52e9e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e40b7170 con 0x7f52e415e940 2024-09-11T23:25:56.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.865+0000 7f52e9e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f52e40b7aa0 con 0x7f52e40cef90 2024-09-11T23:25:56.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.865+0000 7f52e9e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f52e40d3660 con 0x7f52e415ed20 2024-09-11T23:25:56.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.865+0000 7f52e2a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f52e415e940 0x7f52e40d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35164/0 (socket says 172.21.15.144:35164) 2024-09-11T23:25:56.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.865+0000 7f52e2a00640 1 -- 172.21.15.144:0/3295665767 learned_addr learned my addr 172.21.15.144:0/3295665767 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:56.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.865+0000 7f52e3400640 1 --2- 172.21.15.144:0/3295665767 >> v2:172.21.15.144:3300/0 conn(0x7f52e40cef90 0x7f52e40b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:56.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.865+0000 7f52dbe00640 1 --2- 172.21.15.144:0/3295665767 >> v2:172.21.15.165:3300/0 conn(0x7f52e415ed20 0x7f52e40b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:56.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.866+0000 7f52e3400640 1 -- 172.21.15.144:0/3295665767 >> v2:172.21.15.165:3300/0 conn(0x7f52e415ed20 msgr2=0x7f52e40b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:56.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.866+0000 7f52e3400640 1 --2- 172.21.15.144:0/3295665767 >> v2:172.21.15.165:3300/0 conn(0x7f52e415ed20 0x7f52e40b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.866+0000 7f52e3400640 1 -- 172.21.15.144:0/3295665767 >> v1:172.21.15.144:6789/0 conn(0x7f52e415e940 legacy=0x7f52e40d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.866+0000 7f52e2000640 1 -- 172.21.15.144:0/3295665767 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3140706956 0 0) 0x7f52d4001110 con 0x7f52e415e940 2024-09-11T23:25:56.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.866+0000 7f52e3400640 1 -- 172.21.15.144:0/3295665767 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e40d3940 con 0x7f52e40cef90 2024-09-11T23:25:56.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.867+0000 7f52e3400640 1 --2- 172.21.15.144:0/3295665767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52e40cef90 0x7f52e40b3760 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f52e406e900 tx=0x7f52dc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3718bd689613f585 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:56.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.867+0000 7f52e2000640 1 -- 172.21.15.144:0/3295665767 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc007740 con 0x7f52e40cef90 2024-09-11T23:25:56.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.867+0000 7f52e2000640 1 -- 172.21.15.144:0/3295665767 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52dc0078e0 con 0x7f52e40cef90 2024-09-11T23:25:56.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.867+0000 7f52e2000640 1 -- 172.21.15.144:0/3295665767 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc007cb0 con 0x7f52e40cef90 2024-09-11T23:25:56.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.867+0000 7f52e9e00640 1 -- 172.21.15.144:0/3295665767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52e40cef90 msgr2=0x7f52e40b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.867+0000 7f52e9e00640 1 --2- 172.21.15.144:0/3295665767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52e40cef90 0x7f52e40b3760 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f52e406e900 tx=0x7f52dc02a710 comp rx=0 tx=0).stop 2024-09-11T23:25:56.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.868+0000 7f52e9e00640 1 -- 172.21.15.144:0/3295665767 shutdown_connections 2024-09-11T23:25:56.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.868+0000 7f52e9e00640 1 --2- 172.21.15.144:0/3295665767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52e40cef90 0x7f52e40b3760 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.868+0000 7f52e9e00640 1 --2- 172.21.15.144:0/3295665767 >> v2:172.21.15.165:3300/0 conn(0x7f52e415ed20 0x7f52e40b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.868+0000 7f52e9e00640 1 -- 172.21.15.144:0/3295665767 >> 172.21.15.144:0/3295665767 conn(0x7f52e40b6240 msgr2=0x7f52e40b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:56.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.868+0000 7f52e9e00640 1 -- 172.21.15.144:0/3295665767 shutdown_connections 2024-09-11T23:25:56.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.868+0000 7f52e9e00640 1 -- 172.21.15.144:0/3295665767 wait complete. 2024-09-11T23:25:56.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.869+0000 7f52e9e00640 1 Processor -- start 2024-09-11T23:25:56.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.869+0000 7f52e9e00640 1 -- start start 2024-09-11T23:25:56.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.870+0000 7f52e9e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f52e40cef90 0x7f52e40b5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.870+0000 7f52e9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52e415e940 0x7f52e41e7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.870+0000 7f52e9e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f52e415ed20 0x7f52e41e7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.870+0000 7f52e9e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f52e40d3310 con 0x7f52e415e940 2024-09-11T23:25:56.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.870+0000 7f52e9e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f52e40d3f00 con 0x7f52e40cef90 2024-09-11T23:25:56.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.870+0000 7f52e9e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f52e40d1ef0 con 0x7f52e415ed20 2024-09-11T23:25:56.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.870+0000 7f52dbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52e415e940 0x7f52e41e7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:56.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.870+0000 7f52dbe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52e415e940 0x7f52e41e7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40842/0 (socket says 172.21.15.144:40842) 2024-09-11T23:25:56.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.871+0000 7f52dbe00640 1 -- 172.21.15.144:0/975731396 learned_addr learned my addr 172.21.15.144:0/975731396 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:56.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.871+0000 7f52e2a00640 1 --2- 172.21.15.144:0/975731396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f52e40cef90 0x7f52e40b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:56.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.871+0000 7f52e3400640 1 --2- 172.21.15.144:0/975731396 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f52e415ed20 0x7f52e41e7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:56.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.871+0000 7f52dbe00640 1 -- 172.21.15.144:0/975731396 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f52e415ed20 msgr2=0x7f52e41e7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.871+0000 7f52dbe00640 1 --2- 172.21.15.144:0/975731396 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f52e415ed20 0x7f52e41e7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.871+0000 7f52dbe00640 1 -- 172.21.15.144:0/975731396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f52e40cef90 msgr2=0x7f52e40b5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:56.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.871+0000 7f52dbe00640 1 --2- 172.21.15.144:0/975731396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f52e40cef90 0x7f52e40b5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:56.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.871+0000 7f52dbe00640 1 -- 172.21.15.144:0/975731396 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e40cdfd0 con 0x7f52e415e940 2024-09-11T23:25:56.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.871+0000 7f52dbe00640 1 --2- 172.21.15.144:0/975731396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52e415e940 0x7f52e41e7400 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00e840 tx=0x7f52cc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:56.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.872+0000 7f52db400640 1 -- 172.21.15.144:0/975731396 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc017070 con 0x7f52e415e940 2024-09-11T23:25:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.872+0000 7f52db400640 1 -- 172.21.15.144:0/975731396 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52cc00c940 con 0x7f52e415e940 2024-09-11T23:25:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.872+0000 7f52db400640 1 -- 172.21.15.144:0/975731396 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00cd10 con 0x7f52e415e940 2024-09-11T23:25:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.872+0000 7f52e9e00640 1 -- 172.21.15.144:0/975731396 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e41593b0 con 0x7f52e415e940 2024-09-11T23:25:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.872+0000 7f52e9e00640 1 -- 172.21.15.144:0/975731396 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e40cd260 con 0x7f52e415e940 2024-09-11T23:25:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.873+0000 7f52e9e00640 1 -- 172.21.15.144:0/975731396 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52e40d1060 con 0x7f52e415e940 2024-09-11T23:25:56.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.874+0000 7f52db400640 1 -- 172.21.15.144:0/975731396 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f52cc01a070 con 0x7f52e415e940 2024-09-11T23:25:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.875+0000 7f52db400640 1 --2- 172.21.15.144:0/975731396 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f52c006c610 0x7f52c006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:56.875 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.875+0000 7f52db400640 1 -- 172.21.15.144:0/975731396 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f52cc0899a0 con 0x7f52e415e940 2024-09-11T23:25:56.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.875+0000 7f52e2a00640 1 --2- 172.21.15.144:0/975731396 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f52c006c610 0x7f52c006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:56.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.876+0000 7f52e2a00640 1 --2- 172.21.15.144:0/975731396 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f52c006c610 0x7f52c006ead0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f52d4000f60 tx=0x7f52d4007b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:56.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:56.879+0000 7f52db400640 1 -- 172.21.15.144:0/975731396 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f52cc0595f0 con 0x7f52e415e940 2024-09-11T23:25:57.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.052+0000 7f52e9e00640 1 -- 172.21.15.144:0/975731396 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f52e40ba6b0 con 0x7f52c006c610 2024-09-11T23:25:57.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.059+0000 7f52db400640 1 -- 172.21.15.144:0/975731396 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252485 (secure 0 0 0) 0x7f52e40ba6b0 con 0x7f52c006c610 2024-09-11T23:25:57.062 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:57.063 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:25:57.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.062+0000 7f52e9e00640 1 -- 172.21.15.144:0/975731396 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f52c006c610 msgr2=0x7f52c006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:57.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.062+0000 7f52e9e00640 1 --2- 172.21.15.144:0/975731396 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f52c006c610 0x7f52c006ead0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f52d4000f60 tx=0x7f52d4007b50 comp rx=0 tx=0).stop 2024-09-11T23:25:57.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.062+0000 7f52e9e00640 1 -- 172.21.15.144:0/975731396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52e415e940 msgr2=0x7f52e41e7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:57.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.062+0000 7f52e9e00640 1 --2- 172.21.15.144:0/975731396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52e415e940 0x7f52e41e7400 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00e840 tx=0x7f52cc00ed00 comp rx=0 tx=0).stop 2024-09-11T23:25:57.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.062+0000 7f52e9e00640 1 -- 172.21.15.144:0/975731396 shutdown_connections 2024-09-11T23:25:57.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.062+0000 7f52e9e00640 1 --2- 172.21.15.144:0/975731396 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f52c006c610 0x7f52c006ead0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.062+0000 7f52e9e00640 1 --2- 172.21.15.144:0/975731396 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f52e415ed20 0x7f52e41e7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.062+0000 7f52e9e00640 1 --2- 172.21.15.144:0/975731396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52e415e940 0x7f52e41e7400 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.062+0000 7f52e9e00640 1 --2- 172.21.15.144:0/975731396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f52e40cef90 0x7f52e40b5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.062+0000 7f52e9e00640 1 -- 172.21.15.144:0/975731396 >> 172.21.15.144:0/975731396 conn(0x7f52e40b6240 msgr2=0x7f52e40cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:57.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.063+0000 7f52e9e00640 1 -- 172.21.15.144:0/975731396 shutdown_connections 2024-09-11T23:25:57.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.063+0000 7f52e9e00640 1 -- 172.21.15.144:0/975731396 wait complete. 2024-09-11T23:25:57.079 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-09-11T23:25:56.765247+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":265736,"kb_used_data":16200,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754708984,"statfs":{"total":773094113280,"available":772821999616,"internally_reserved":0,"allocated":16588800,"data_stored":7945164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.890850"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940590+0000","last_change":"2024-09-11T23:25:52.926481+0000","last_active":"2024-09-11T23:25:53.940590+0000","last_peered":"2024-09-11T23:25:53.940590+0000","last_clean":"2024-09-11T23:25:53.940590+0000","last_became_active":"2024-09-11T23:25:52.926181+0000","last_became_peered":"2024-09-11T23:25:52.926181+0000","last_unstale":"2024-09-11T23:25:53.940590+0000","last_undegraded":"2024-09-11T23:25:53.940590+0000","last_fullsized":"2024-09-11T23:25:53.940590+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:05.408560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.941302+0000","last_change":"2024-09-11T23:25:52.915421+0000","last_active":"2024-09-11T23:25:53.941302+0000","last_peered":"2024-09-11T23:25:53.941302+0000","last_clean":"2024-09-11T23:25:53.941302+0000","last_became_active":"2024-09-11T23:25:52.914856+0000","last_became_peered":"2024-09-11T23:25:52.914856+0000","last_unstale":"2024-09-11T23:25:53.941302+0000","last_undegraded":"2024-09-11T23:25:53.941302+0000","last_fullsized":"2024-09-11T23:25:53.941302+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:40.769361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929552+0000","last_change":"2024-09-11T23:25:52.912842+0000","last_active":"2024-09-11T23:25:53.929552+0000","last_peered":"2024-09-11T23:25:53.929552+0000","last_clean":"2024-09-11T23:25:53.929552+0000","last_became_active":"2024-09-11T23:25:52.911262+0000","last_became_peered":"2024-09-11T23:25:52.911262+0000","last_unstale":"2024-09-11T23:25:53.929552+0000","last_undegraded":"2024-09-11T23:25:53.929552+0000","last_fullsized":"2024-09-11T23:25:53.929552+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:53.721933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.941088+0000","last_change":"2024-09-11T23:25:52.916715+0000","last_active":"2024-09-11T23:25:53.941088+0000","last_peered":"2024-09-11T23:25:53.941088+0000","last_clean":"2024-09-11T23:25:53.941088+0000","last_became_active":"2024-09-11T23:25:52.915157+0000","last_became_peered":"2024-09-11T23:25:52.915157+0000","last_unstale":"2024-09-11T23:25:53.941088+0000","last_undegraded":"2024-09-11T23:25:53.941088+0000","last_fullsized":"2024-09-11T23:25:53.941088+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:48.489073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940114+0000","last_change":"2024-09-11T23:25:52.920678+0000","last_active":"2024-09-11T23:25:53.940114+0000","last_peered":"2024-09-11T23:25:53.940114+0000","last_clean":"2024-09-11T23:25:53.940114+0000","last_became_active":"2024-09-11T23:25:52.920372+0000","last_became_peered":"2024-09-11T23:25:52.920372+0000","last_unstale":"2024-09-11T23:25:53.940114+0000","last_undegraded":"2024-09-11T23:25:53.940114+0000","last_fullsized":"2024-09-11T23:25:53.940114+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:36.740246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929326+0000","last_change":"2024-09-11T23:25:52.917475+0000","last_active":"2024-09-11T23:25:53.929326+0000","last_peered":"2024-09-11T23:25:53.929326+0000","last_clean":"2024-09-11T23:25:53.929326+0000","last_became_active":"2024-09-11T23:25:52.917227+0000","last_became_peered":"2024-09-11T23:25:52.917227+0000","last_unstale":"2024-09-11T23:25:53.929326+0000","last_undegraded":"2024-09-11T23:25:53.929326+0000","last_fullsized":"2024-09-11T23:25:53.929326+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:22.254388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918104+0000","last_change":"2024-09-11T23:25:52.920725+0000","last_active":"2024-09-11T23:25:53.918104+0000","last_peered":"2024-09-11T23:25:53.918104+0000","last_clean":"2024-09-11T23:25:53.918104+0000","last_became_active":"2024-09-11T23:25:52.919293+0000","last_became_peered":"2024-09-11T23:25:52.919293+0000","last_unstale":"2024-09-11T23:25:53.918104+0000","last_undegraded":"2024-09-11T23:25:53.918104+0000","last_fullsized":"2024-09-11T23:25:53.918104+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:48.489073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.939639+0000","last_change":"2024-09-11T23:25:52.915430+0000","last_active":"2024-09-11T23:25:53.939639+0000","last_peered":"2024-09-11T23:25:53.939639+0000","last_clean":"2024-09-11T23:25:53.939639+0000","last_became_active":"2024-09-11T23:25:52.913529+0000","last_became_peered":"2024-09-11T23:25:52.913529+0000","last_unstale":"2024-09-11T23:25:53.939639+0000","last_undegraded":"2024-09-11T23:25:53.939639+0000","last_fullsized":"2024-09-11T23:25:53.939639+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:24.183314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.919237+0000","last_change":"2024-09-11T23:25:52.911929+0000","last_active":"2024-09-11T23:25:53.919237+0000","last_peered":"2024-09-11T23:25:53.919237+0000","last_clean":"2024-09-11T23:25:53.919237+0000","last_became_active":"2024-09-11T23:25:52.911640+0000","last_became_peered":"2024-09-11T23:25:52.911640+0000","last_unstale":"2024-09-11T23:25:53.919237+0000","last_undegraded":"2024-09-11T23:25:53.919237+0000","last_fullsized":"2024-09-11T23:25:53.919237+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:02.528835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913513+0000","last_change":"2024-09-11T23:25:52.910070+0000","last_active":"2024-09-11T23:25:53.913513+0000","last_peered":"2024-09-11T23:25:53.913513+0000","last_clean":"2024-09-11T23:25:53.913513+0000","last_became_active":"2024-09-11T23:25:52.909337+0000","last_became_peered":"2024-09-11T23:25:52.909337+0000","last_unstale":"2024-09-11T23:25:53.913513+0000","last_undegraded":"2024-09-11T23:25:53.913513+0000","last_fullsized":"2024-09-11T23:25:53.913513+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:24.935884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918930+0000","last_change":"2024-09-11T23:25:52.915163+0000","last_active":"2024-09-11T23:25:53.918930+0000","last_peered":"2024-09-11T23:25:53.918930+0000","last_clean":"2024-09-11T23:25:53.918930+0000","last_became_active":"2024-09-11T23:25:52.914876+0000","last_became_peered":"2024-09-11T23:25:52.914876+0000","last_unstale":"2024-09-11T23:25:53.918930+0000","last_undegraded":"2024-09-11T23:25:53.918930+0000","last_fullsized":"2024-09-11T23:25:53.918930+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:51.866683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.941296+0000","last_change":"2024-09-11T23:25:52.920074+0000","last_active":"2024-09-11T23:25:53.941296+0000","last_peered":"2024-09-11T23:25:53.941296+0000","last_clean":"2024-09-11T23:25:53.941296+0000","last_became_active":"2024-09-11T23:25:52.919799+0000","last_became_peered":"2024-09-11T23:25:52.919799+0000","last_unstale":"2024-09-11T23:25:53.941296+0000","last_undegraded":"2024-09-11T23:25:53.941296+0000","last_fullsized":"2024-09-11T23:25:53.941296+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:40.526970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940948+0000","last_change":"2024-09-11T23:25:52.917031+0000","last_active":"2024-09-11T23:25:53.940948+0000","last_peered":"2024-09-11T23:25:53.940948+0000","last_clean":"2024-09-11T23:25:53.940948+0000","last_became_active":"2024-09-11T23:25:52.916743+0000","last_became_peered":"2024-09-11T23:25:52.916743+0000","last_unstale":"2024-09-11T23:25:53.940948+0000","last_undegraded":"2024-09-11T23:25:53.940948+0000","last_fullsized":"2024-09-11T23:25:53.940948+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:48.999180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.917788+0000","last_change":"2024-09-11T23:25:52.902302+0000","last_active":"2024-09-11T23:25:53.917788+0000","last_peered":"2024-09-11T23:25:53.917788+0000","last_clean":"2024-09-11T23:25:53.917788+0000","last_became_active":"2024-09-11T23:25:52.901420+0000","last_became_peered":"2024-09-11T23:25:52.901420+0000","last_unstale":"2024-09-11T23:25:53.917788+0000","last_undegraded":"2024-09-11T23:25:53.917788+0000","last_fullsized":"2024-09-11T23:25:53.917788+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:50.787977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940883+0000","last_change":"2024-09-11T23:25:52.923277+0000","last_active":"2024-09-11T23:25:53.940883+0000","last_peered":"2024-09-11T23:25:53.940883+0000","last_clean":"2024-09-11T23:25:53.940883+0000","last_became_active":"2024-09-11T23:25:52.921649+0000","last_became_peered":"2024-09-11T23:25:52.921649+0000","last_unstale":"2024-09-11T23:25:53.940883+0000","last_undegraded":"2024-09-11T23:25:53.940883+0000","last_fullsized":"2024-09-11T23:25:53.940883+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:37.136434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.939787+0000","last_change":"2024-09-11T23:25:52.915795+0000","last_active":"2024-09-11T23:25:53.939787+0000","last_peered":"2024-09-11T23:25:53.939787+0000","last_clean":"2024-09-11T23:25:53.939787+0000","last_became_active":"2024-09-11T23:25:52.915501+0000","last_became_peered":"2024-09-11T23:25:52.915501+0000","last_unstale":"2024-09-11T23:25:53.939787+0000","last_undegraded":"2024-09-11T23:25:53.939787+0000","last_fullsized":"2024-09-11T23:25:53.939787+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:46.191506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940614+0000","last_change":"2024-09-11T23:25:52.921852+0000","last_active":"2024-09-11T23:25:53.940614+0000","last_peered":"2024-09-11T23:25:53.940614+0000","last_clean":"2024-09-11T23:25:53.940614+0000","last_became_active":"2024-09-11T23:25:52.921572+0000","last_became_peered":"2024-09-11T23:25:52.921572+0000","last_unstale":"2024-09-11T23:25:53.940614+0000","last_undegraded":"2024-09-11T23:25:53.940614+0000","last_fullsized":"2024-09-11T23:25:53.940614+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:20.052325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940347+0000","last_change":"2024-09-11T23:25:52.922187+0000","last_active":"2024-09-11T23:25:53.940347+0000","last_peered":"2024-09-11T23:25:53.940347+0000","last_clean":"2024-09-11T23:25:53.940347+0000","last_became_active":"2024-09-11T23:25:52.920932+0000","last_became_peered":"2024-09-11T23:25:52.920932+0000","last_unstale":"2024-09-11T23:25:53.940347+0000","last_undegraded":"2024-09-11T23:25:53.940347+0000","last_fullsized":"2024-09-11T23:25:53.940347+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:06.119153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913293+0000","last_change":"2024-09-11T23:25:52.918141+0000","last_active":"2024-09-11T23:25:53.913293+0000","last_peered":"2024-09-11T23:25:53.913293+0000","last_clean":"2024-09-11T23:25:53.913293+0000","last_became_active":"2024-09-11T23:25:52.917856+0000","last_became_peered":"2024-09-11T23:25:52.917856+0000","last_unstale":"2024-09-11T23:25:53.913293+0000","last_undegraded":"2024-09-11T23:25:53.913293+0000","last_fullsized":"2024-09-11T23:25:53.913293+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:02.414819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940186+0000","last_change":"2024-09-11T23:25:52.922042+0000","last_active":"2024-09-11T23:25:53.940186+0000","last_peered":"2024-09-11T23:25:53.940186+0000","last_clean":"2024-09-11T23:25:53.940186+0000","last_became_active":"2024-09-11T23:25:52.921778+0000","last_became_peered":"2024-09-11T23:25:52.921778+0000","last_unstale":"2024-09-11T23:25:53.940186+0000","last_undegraded":"2024-09-11T23:25:53.940186+0000","last_fullsized":"2024-09-11T23:25:53.940186+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:34.720765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940266+0000","last_change":"2024-09-11T23:25:52.920673+0000","last_active":"2024-09-11T23:25:53.940266+0000","last_peered":"2024-09-11T23:25:53.940266+0000","last_clean":"2024-09-11T23:25:53.940266+0000","last_became_active":"2024-09-11T23:25:52.920356+0000","last_became_peered":"2024-09-11T23:25:52.920356+0000","last_unstale":"2024-09-11T23:25:53.940266+0000","last_undegraded":"2024-09-11T23:25:53.940266+0000","last_fullsized":"2024-09-11T23:25:53.940266+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:25.885489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913065+0000","last_change":"2024-09-11T23:25:52.913196+0000","last_active":"2024-09-11T23:25:53.913065+0000","last_peered":"2024-09-11T23:25:53.913065+0000","last_clean":"2024-09-11T23:25:53.913065+0000","last_became_active":"2024-09-11T23:25:52.912635+0000","last_became_peered":"2024-09-11T23:25:52.912635+0000","last_unstale":"2024-09-11T23:25:53.913065+0000","last_undegraded":"2024-09-11T23:25:53.913065+0000","last_fullsized":"2024-09-11T23:25:53.913065+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:42.680793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929272+0000","last_change":"2024-09-11T23:25:52.923801+0000","last_active":"2024-09-11T23:25:53.929272+0000","last_peered":"2024-09-11T23:25:53.929272+0000","last_clean":"2024-09-11T23:25:53.929272+0000","last_became_active":"2024-09-11T23:25:52.923543+0000","last_became_peered":"2024-09-11T23:25:52.923543+0000","last_unstale":"2024-09-11T23:25:53.929272+0000","last_undegraded":"2024-09-11T23:25:53.929272+0000","last_fullsized":"2024-09-11T23:25:53.929272+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:56.207778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.939816+0000","last_change":"2024-09-11T23:25:52.919574+0000","last_active":"2024-09-11T23:25:53.939816+0000","last_peered":"2024-09-11T23:25:53.939816+0000","last_clean":"2024-09-11T23:25:53.939816+0000","last_became_active":"2024-09-11T23:25:52.919023+0000","last_became_peered":"2024-09-11T23:25:52.919023+0000","last_unstale":"2024-09-11T23:25:53.939816+0000","last_undegraded":"2024-09-11T23:25:53.939816+0000","last_fullsized":"2024-09-11T23:25:53.939816+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:13.753541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.941323+0000","last_change":"2024-09-11T23:25:52.923266+0000","last_active":"2024-09-11T23:25:53.941323+0000","last_peered":"2024-09-11T23:25:53.941323+0000","last_clean":"2024-09-11T23:25:53.941323+0000","last_became_active":"2024-09-11T23:25:52.922984+0000","last_became_peered":"2024-09-11T23:25:52.922984+0000","last_unstale":"2024-09-11T23:25:53.941323+0000","last_undegraded":"2024-09-11T23:25:53.941323+0000","last_fullsized":"2024-09-11T23:25:53.941323+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:38.933101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.919131+0000","last_change":"2024-09-11T23:25:52.916903+0000","last_active":"2024-09-11T23:25:53.919131+0000","last_peered":"2024-09-11T23:25:53.919131+0000","last_clean":"2024-09-11T23:25:53.919131+0000","last_became_active":"2024-09-11T23:25:52.916634+0000","last_became_peered":"2024-09-11T23:25:52.916634+0000","last_unstale":"2024-09-11T23:25:53.919131+0000","last_undegraded":"2024-09-11T23:25:53.919131+0000","last_fullsized":"2024-09-11T23:25:53.919131+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:13.723442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929624+0000","last_change":"2024-09-11T23:25:52.914303+0000","last_active":"2024-09-11T23:25:53.929624+0000","last_peered":"2024-09-11T23:25:53.929624+0000","last_clean":"2024-09-11T23:25:53.929624+0000","last_became_active":"2024-09-11T23:25:52.914070+0000","last_became_peered":"2024-09-11T23:25:52.914070+0000","last_unstale":"2024-09-11T23:25:53.929624+0000","last_undegraded":"2024-09-11T23:25:53.929624+0000","last_fullsized":"2024-09-11T23:25:53.929624+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:16.278123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940793+0000","last_change":"2024-09-11T23:25:52.921466+0000","last_active":"2024-09-11T23:25:53.940793+0000","last_peered":"2024-09-11T23:25:53.940793+0000","last_clean":"2024-09-11T23:25:53.940793+0000","last_became_active":"2024-09-11T23:25:52.921228+0000","last_became_peered":"2024-09-11T23:25:52.921228+0000","last_unstale":"2024-09-11T23:25:53.940793+0000","last_undegraded":"2024-09-11T23:25:53.940793+0000","last_fullsized":"2024-09-11T23:25:53.940793+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:55.955162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.941012+0000","last_change":"2024-09-11T23:25:52.915375+0000","last_active":"2024-09-11T23:25:53.941012+0000","last_peered":"2024-09-11T23:25:53.941012+0000","last_clean":"2024-09-11T23:25:53.941012+0000","last_became_active":"2024-09-11T23:25:52.914712+0000","last_became_peered":"2024-09-11T23:25:52.914712+0000","last_unstale":"2024-09-11T23:25:53.941012+0000","last_undegraded":"2024-09-11T23:25:53.941012+0000","last_fullsized":"2024-09-11T23:25:53.941012+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:02.528835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918027+0000","last_change":"2024-09-11T23:25:52.920403+0000","last_active":"2024-09-11T23:25:53.918027+0000","last_peered":"2024-09-11T23:25:53.918027+0000","last_clean":"2024-09-11T23:25:53.918027+0000","last_became_active":"2024-09-11T23:25:52.919987+0000","last_became_peered":"2024-09-11T23:25:52.919987+0000","last_unstale":"2024-09-11T23:25:53.918027+0000","last_undegraded":"2024-09-11T23:25:53.918027+0000","last_fullsized":"2024-09-11T23:25:53.918027+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:56.157773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929318+0000","last_change":"2024-09-11T23:25:52.915008+0000","last_active":"2024-09-11T23:25:53.929318+0000","last_peered":"2024-09-11T23:25:53.929318+0000","last_clean":"2024-09-11T23:25:53.929318+0000","last_became_active":"2024-09-11T23:25:52.914640+0000","last_became_peered":"2024-09-11T23:25:52.914640+0000","last_unstale":"2024-09-11T23:25:53.929318+0000","last_undegraded":"2024-09-11T23:25:53.929318+0000","last_fullsized":"2024-09-11T23:25:53.929318+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:45.648419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.939628+0000","last_change":"2024-09-11T23:25:52.914905+0000","last_active":"2024-09-11T23:25:53.939628+0000","last_peered":"2024-09-11T23:25:53.939628+0000","last_clean":"2024-09-11T23:25:53.939628+0000","last_became_active":"2024-09-11T23:25:52.914612+0000","last_became_peered":"2024-09-11T23:25:52.914612+0000","last_unstale":"2024-09-11T23:25:53.939628+0000","last_undegraded":"2024-09-11T23:25:53.939628+0000","last_fullsized":"2024-09-11T23:25:53.939628+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:23.635788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940448+0000","last_change":"2024-09-11T23:25:52.912068+0000","last_active":"2024-09-11T23:25:53.940448+0000","last_peered":"2024-09-11T23:25:53.940448+0000","last_clean":"2024-09-11T23:25:53.940448+0000","last_became_active":"2024-09-11T23:25:52.911672+0000","last_became_peered":"2024-09-11T23:25:52.911672+0000","last_unstale":"2024-09-11T23:25:53.940448+0000","last_undegraded":"2024-09-11T23:25:53.940448+0000","last_fullsized":"2024-09-11T23:25:53.940448+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:27.327036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"152'4","reported_seq":18,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940625+0000","last_change":"2024-09-11T23:25:51.900246+0000","last_active":"2024-09-11T23:25:53.940625+0000","last_peered":"2024-09-11T23:25:53.940625+0000","last_clean":"2024-09-11T23:25:53.940625+0000","last_became_active":"2024-09-11T23:25:51.899859+0000","last_became_peered":"2024-09-11T23:25:51.899859+0000","last_unstale":"2024-09-11T23:25:53.940625+0000","last_undegraded":"2024-09-11T23:25:53.940625+0000","last_fullsized":"2024-09-11T23:25:53.940625+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:45.193635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913505+0000","last_change":"2024-09-11T23:25:52.918859+0000","last_active":"2024-09-11T23:25:53.913505+0000","last_peered":"2024-09-11T23:25:53.913505+0000","last_clean":"2024-09-11T23:25:53.913505+0000","last_became_active":"2024-09-11T23:25:52.917555+0000","last_became_peered":"2024-09-11T23:25:52.917555+0000","last_unstale":"2024-09-11T23:25:53.913505+0000","last_undegraded":"2024-09-11T23:25:53.913505+0000","last_fullsized":"2024-09-11T23:25:53.913505+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:04.263795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"152'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918693+0000","last_change":"2024-09-11T23:25:51.895918+0000","last_active":"2024-09-11T23:25:53.918693+0000","last_peered":"2024-09-11T23:25:53.918693+0000","last_clean":"2024-09-11T23:25:53.918693+0000","last_became_active":"2024-09-11T23:25:51.895056+0000","last_became_peered":"2024-09-11T23:25:51.895056+0000","last_unstale":"2024-09-11T23:25:53.918693+0000","last_undegraded":"2024-09-11T23:25:53.918693+0000","last_fullsized":"2024-09-11T23:25:53.918693+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:07:58.939704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918782+0000","last_change":"2024-09-11T23:25:52.913059+0000","last_active":"2024-09-11T23:25:53.918782+0000","last_peered":"2024-09-11T23:25:53.918782+0000","last_clean":"2024-09-11T23:25:53.918782+0000","last_became_active":"2024-09-11T23:25:52.912768+0000","last_became_peered":"2024-09-11T23:25:52.912768+0000","last_unstale":"2024-09-11T23:25:53.918782+0000","last_undegraded":"2024-09-11T23:25:53.918782+0000","last_fullsized":"2024-09-11T23:25:53.918782+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:38.933101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929643+0000","last_change":"2024-09-11T23:25:51.907726+0000","last_active":"2024-09-11T23:25:53.929643+0000","last_peered":"2024-09-11T23:25:53.929643+0000","last_clean":"2024-09-11T23:25:53.929643+0000","last_became_active":"2024-09-11T23:25:51.907462+0000","last_became_peered":"2024-09-11T23:25:51.907462+0000","last_unstale":"2024-09-11T23:25:53.929643+0000","last_undegraded":"2024-09-11T23:25:53.929643+0000","last_fullsized":"2024-09-11T23:25:53.929643+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:47.482325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.919110+0000","last_change":"2024-09-11T23:25:52.907420+0000","last_active":"2024-09-11T23:25:53.919110+0000","last_peered":"2024-09-11T23:25:53.919110+0000","last_clean":"2024-09-11T23:25:53.919110+0000","last_became_active":"2024-09-11T23:25:52.907112+0000","last_became_peered":"2024-09-11T23:25:52.907112+0000","last_unstale":"2024-09-11T23:25:53.919110+0000","last_undegraded":"2024-09-11T23:25:53.919110+0000","last_fullsized":"2024-09-11T23:25:53.919110+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:48.999180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.941235+0000","last_change":"2024-09-11T23:25:51.896878+0000","last_active":"2024-09-11T23:25:53.941235+0000","last_peered":"2024-09-11T23:25:53.941235+0000","last_clean":"2024-09-11T23:25:53.941235+0000","last_became_active":"2024-09-11T23:25:51.896515+0000","last_became_peered":"2024-09-11T23:25:51.896515+0000","last_unstale":"2024-09-11T23:25:53.941235+0000","last_undegraded":"2024-09-11T23:25:53.941235+0000","last_fullsized":"2024-09-11T23:25:53.941235+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:07:58.939704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913168+0000","last_change":"2024-09-11T23:25:52.912929+0000","last_active":"2024-09-11T23:25:53.913168+0000","last_peered":"2024-09-11T23:25:53.913168+0000","last_clean":"2024-09-11T23:25:53.913168+0000","last_became_active":"2024-09-11T23:25:52.912294+0000","last_became_peered":"2024-09-11T23:25:52.912294+0000","last_unstale":"2024-09-11T23:25:53.913168+0000","last_undegraded":"2024-09-11T23:25:53.913168+0000","last_fullsized":"2024-09-11T23:25:53.913168+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:30.149289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"152'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940463+0000","last_change":"2024-09-11T23:25:51.906868+0000","last_active":"2024-09-11T23:25:53.940463+0000","last_peered":"2024-09-11T23:25:53.940463+0000","last_clean":"2024-09-11T23:25:53.940463+0000","last_became_active":"2024-09-11T23:25:51.906559+0000","last_became_peered":"2024-09-11T23:25:51.906559+0000","last_unstale":"2024-09-11T23:25:53.940463+0000","last_undegraded":"2024-09-11T23:25:53.940463+0000","last_fullsized":"2024-09-11T23:25:53.940463+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:53.100459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.939789+0000","last_change":"2024-09-11T23:25:52.920380+0000","last_active":"2024-09-11T23:25:53.939789+0000","last_peered":"2024-09-11T23:25:53.939789+0000","last_clean":"2024-09-11T23:25:53.939789+0000","last_became_active":"2024-09-11T23:25:52.920097+0000","last_became_peered":"2024-09-11T23:25:52.920097+0000","last_unstale":"2024-09-11T23:25:53.939789+0000","last_undegraded":"2024-09-11T23:25:53.939789+0000","last_fullsized":"2024-09-11T23:25:53.939789+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:50.926496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"152'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.939894+0000","last_change":"2024-09-11T23:25:51.900322+0000","last_active":"2024-09-11T23:25:53.939894+0000","last_peered":"2024-09-11T23:25:53.939894+0000","last_clean":"2024-09-11T23:25:53.939894+0000","last_became_active":"2024-09-11T23:25:51.900028+0000","last_became_peered":"2024-09-11T23:25:51.900028+0000","last_unstale":"2024-09-11T23:25:53.939894+0000","last_undegraded":"2024-09-11T23:25:53.939894+0000","last_fullsized":"2024-09-11T23:25:53.939894+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:48.291974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918329+0000","last_change":"2024-09-11T23:25:52.919229+0000","last_active":"2024-09-11T23:25:53.918329+0000","last_peered":"2024-09-11T23:25:53.918329+0000","last_clean":"2024-09-11T23:25:53.918329+0000","last_became_active":"2024-09-11T23:25:52.918949+0000","last_became_peered":"2024-09-11T23:25:52.918949+0000","last_unstale":"2024-09-11T23:25:53.918329+0000","last_undegraded":"2024-09-11T23:25:53.918329+0000","last_fullsized":"2024-09-11T23:25:53.918329+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:22.397789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940061+0000","last_change":"2024-09-11T23:25:51.903876+0000","last_active":"2024-09-11T23:25:53.940061+0000","last_peered":"2024-09-11T23:25:53.940061+0000","last_clean":"2024-09-11T23:25:53.940061+0000","last_became_active":"2024-09-11T23:25:51.903534+0000","last_became_peered":"2024-09-11T23:25:51.903534+0000","last_unstale":"2024-09-11T23:25:53.940061+0000","last_undegraded":"2024-09-11T23:25:53.940061+0000","last_fullsized":"2024-09-11T23:25:53.940061+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:15.271374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929677+0000","last_change":"2024-09-11T23:25:52.919557+0000","last_active":"2024-09-11T23:25:53.929677+0000","last_peered":"2024-09-11T23:25:53.929677+0000","last_clean":"2024-09-11T23:25:53.929677+0000","last_became_active":"2024-09-11T23:25:52.917199+0000","last_became_peered":"2024-09-11T23:25:52.917199+0000","last_unstale":"2024-09-11T23:25:53.929677+0000","last_undegraded":"2024-09-11T23:25:53.929677+0000","last_fullsized":"2024-09-11T23:25:53.929677+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:23.569240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.919167+0000","last_change":"2024-09-11T23:25:51.891786+0000","last_active":"2024-09-11T23:25:53.919167+0000","last_peered":"2024-09-11T23:25:53.919167+0000","last_clean":"2024-09-11T23:25:53.919167+0000","last_became_active":"2024-09-11T23:25:51.891475+0000","last_became_peered":"2024-09-11T23:25:51.891475+0000","last_unstale":"2024-09-11T23:25:53.919167+0000","last_undegraded":"2024-09-11T23:25:53.919167+0000","last_fullsized":"2024-09-11T23:25:53.919167+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:32.491407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940232+0000","last_change":"2024-09-11T23:25:52.919337+0000","last_active":"2024-09-11T23:25:53.940232+0000","last_peered":"2024-09-11T23:25:53.940232+0000","last_clean":"2024-09-11T23:25:53.940232+0000","last_became_active":"2024-09-11T23:25:52.919081+0000","last_became_peered":"2024-09-11T23:25:52.919081+0000","last_unstale":"2024-09-11T23:25:53.940232+0000","last_undegraded":"2024-09-11T23:25:53.940232+0000","last_fullsized":"2024-09-11T23:25:53.940232+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:52.363731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940519+0000","last_change":"2024-09-11T23:25:51.899265+0000","last_active":"2024-09-11T23:25:53.940519+0000","last_peered":"2024-09-11T23:25:53.940519+0000","last_clean":"2024-09-11T23:25:53.940519+0000","last_became_active":"2024-09-11T23:25:51.898966+0000","last_became_peered":"2024-09-11T23:25:51.898966+0000","last_unstale":"2024-09-11T23:25:53.940519+0000","last_undegraded":"2024-09-11T23:25:53.940519+0000","last_fullsized":"2024-09-11T23:25:53.940519+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:41.655379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918869+0000","last_change":"2024-09-11T23:25:52.911624+0000","last_active":"2024-09-11T23:25:53.918869+0000","last_peered":"2024-09-11T23:25:53.918869+0000","last_clean":"2024-09-11T23:25:53.918869+0000","last_became_active":"2024-09-11T23:25:52.911325+0000","last_became_peered":"2024-09-11T23:25:52.911325+0000","last_unstale":"2024-09-11T23:25:53.918869+0000","last_undegraded":"2024-09-11T23:25:53.918869+0000","last_fullsized":"2024-09-11T23:25:53.918869+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:59.996944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"152'3","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940395+0000","last_change":"2024-09-11T23:25:51.901562+0000","last_active":"2024-09-11T23:25:53.940395+0000","last_peered":"2024-09-11T23:25:53.940395+0000","last_clean":"2024-09-11T23:25:53.940395+0000","last_became_active":"2024-09-11T23:25:51.901297+0000","last_became_peered":"2024-09-11T23:25:51.901297+0000","last_unstale":"2024-09-11T23:25:53.940395+0000","last_undegraded":"2024-09-11T23:25:53.940395+0000","last_fullsized":"2024-09-11T23:25:53.940395+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:38.595431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913381+0000","last_change":"2024-09-11T23:25:52.911052+0000","last_active":"2024-09-11T23:25:53.913381+0000","last_peered":"2024-09-11T23:25:53.913381+0000","last_clean":"2024-09-11T23:25:53.913381+0000","last_became_active":"2024-09-11T23:25:52.910768+0000","last_became_peered":"2024-09-11T23:25:52.910768+0000","last_unstale":"2024-09-11T23:25:53.913381+0000","last_undegraded":"2024-09-11T23:25:53.913381+0000","last_fullsized":"2024-09-11T23:25:53.913381+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:00.530719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"152'6","reported_seq":20,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929451+0000","last_change":"2024-09-11T23:25:51.896849+0000","last_active":"2024-09-11T23:25:53.929451+0000","last_peered":"2024-09-11T23:25:53.929451+0000","last_clean":"2024-09-11T23:25:53.929451+0000","last_became_active":"2024-09-11T23:25:51.896552+0000","last_became_peered":"2024-09-11T23:25:51.896552+0000","last_unstale":"2024-09-11T23:25:53.929451+0000","last_undegraded":"2024-09-11T23:25:53.929451+0000","last_fullsized":"2024-09-11T23:25:53.929451+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:39.520222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929469+0000","last_change":"2024-09-11T23:25:52.915214+0000","last_active":"2024-09-11T23:25:53.929469+0000","last_peered":"2024-09-11T23:25:53.929469+0000","last_clean":"2024-09-11T23:25:53.929469+0000","last_became_active":"2024-09-11T23:25:52.914962+0000","last_became_peered":"2024-09-11T23:25:52.914962+0000","last_unstale":"2024-09-11T23:25:53.929469+0000","last_undegraded":"2024-09-11T23:25:53.929469+0000","last_fullsized":"2024-09-11T23:25:53.929469+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:45.908012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940445+0000","last_change":"2024-09-11T23:25:51.900554+0000","last_active":"2024-09-11T23:25:53.940445+0000","last_peered":"2024-09-11T23:25:53.940445+0000","last_clean":"2024-09-11T23:25:53.940445+0000","last_became_active":"2024-09-11T23:25:51.900100+0000","last_became_peered":"2024-09-11T23:25:51.900100+0000","last_unstale":"2024-09-11T23:25:53.940445+0000","last_undegraded":"2024-09-11T23:25:53.940445+0000","last_fullsized":"2024-09-11T23:25:53.940445+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:52.715185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918692+0000","last_change":"2024-09-11T23:25:52.910618+0000","last_active":"2024-09-11T23:25:53.918692+0000","last_peered":"2024-09-11T23:25:53.918692+0000","last_clean":"2024-09-11T23:25:53.918692+0000","last_became_active":"2024-09-11T23:25:52.910314+0000","last_became_peered":"2024-09-11T23:25:52.910314+0000","last_unstale":"2024-09-11T23:25:53.918692+0000","last_undegraded":"2024-09-11T23:25:53.918692+0000","last_fullsized":"2024-09-11T23:25:53.918692+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:40.526970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913354+0000","last_change":"2024-09-11T23:25:51.906178+0000","last_active":"2024-09-11T23:25:53.913354+0000","last_peered":"2024-09-11T23:25:53.913354+0000","last_clean":"2024-09-11T23:25:53.913354+0000","last_became_active":"2024-09-11T23:25:51.905881+0000","last_became_peered":"2024-09-11T23:25:51.905881+0000","last_unstale":"2024-09-11T23:25:53.913354+0000","last_undegraded":"2024-09-11T23:25:53.913354+0000","last_fullsized":"2024-09-11T23:25:53.913354+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:35.077389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.917762+0000","last_change":"2024-09-11T23:25:52.901720+0000","last_active":"2024-09-11T23:25:53.917762+0000","last_peered":"2024-09-11T23:25:53.917762+0000","last_clean":"2024-09-11T23:25:53.917762+0000","last_became_active":"2024-09-11T23:25:52.901428+0000","last_became_peered":"2024-09-11T23:25:52.901428+0000","last_unstale":"2024-09-11T23:25:53.917762+0000","last_undegraded":"2024-09-11T23:25:53.917762+0000","last_fullsized":"2024-09-11T23:25:53.917762+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:52.161961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.939567+0000","last_change":"2024-09-11T23:25:51.893291+0000","last_active":"2024-09-11T23:25:53.939567+0000","last_peered":"2024-09-11T23:25:53.939567+0000","last_clean":"2024-09-11T23:25:53.939567+0000","last_became_active":"2024-09-11T23:25:51.893049+0000","last_became_peered":"2024-09-11T23:25:51.893049+0000","last_unstale":"2024-09-11T23:25:53.939567+0000","last_undegraded":"2024-09-11T23:25:53.939567+0000","last_fullsized":"2024-09-11T23:25:53.939567+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:08.273889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913072+0000","last_change":"2024-09-11T23:25:52.909508+0000","last_active":"2024-09-11T23:25:53.913072+0000","last_peered":"2024-09-11T23:25:53.913072+0000","last_clean":"2024-09-11T23:25:53.913072+0000","last_became_active":"2024-09-11T23:25:52.904370+0000","last_became_peered":"2024-09-11T23:25:52.904370+0000","last_unstale":"2024-09-11T23:25:53.913072+0000","last_undegraded":"2024-09-11T23:25:53.913072+0000","last_fullsized":"2024-09-11T23:25:53.913072+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:08.639359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"152'8","reported_seq":22,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940510+0000","last_change":"2024-09-11T23:25:51.903877+0000","last_active":"2024-09-11T23:25:53.940510+0000","last_peered":"2024-09-11T23:25:53.940510+0000","last_clean":"2024-09-11T23:25:53.940510+0000","last_became_active":"2024-09-11T23:25:51.903569+0000","last_became_peered":"2024-09-11T23:25:51.903569+0000","last_unstale":"2024-09-11T23:25:53.940510+0000","last_undegraded":"2024-09-11T23:25:53.940510+0000","last_fullsized":"2024-09-11T23:25:53.940510+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:22.562492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913494+0000","last_change":"2024-09-11T23:25:52.909004+0000","last_active":"2024-09-11T23:25:53.913494+0000","last_peered":"2024-09-11T23:25:53.913494+0000","last_clean":"2024-09-11T23:25:53.913494+0000","last_became_active":"2024-09-11T23:25:52.908712+0000","last_became_peered":"2024-09-11T23:25:52.908712+0000","last_unstale":"2024-09-11T23:25:53.913494+0000","last_undegraded":"2024-09-11T23:25:53.913494+0000","last_fullsized":"2024-09-11T23:25:53.913494+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:41.050668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"152'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940714+0000","last_change":"2024-09-11T23:25:51.910694+0000","last_active":"2024-09-11T23:25:53.940714+0000","last_peered":"2024-09-11T23:25:53.940714+0000","last_clean":"2024-09-11T23:25:53.940714+0000","last_became_active":"2024-09-11T23:25:51.910275+0000","last_became_peered":"2024-09-11T23:25:51.910275+0000","last_unstale":"2024-09-11T23:25:53.940714+0000","last_undegraded":"2024-09-11T23:25:53.940714+0000","last_fullsized":"2024-09-11T23:25:53.940714+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:33.689166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.919253+0000","last_change":"2024-09-11T23:25:52.901427+0000","last_active":"2024-09-11T23:25:53.919253+0000","last_peered":"2024-09-11T23:25:53.919253+0000","last_clean":"2024-09-11T23:25:53.919253+0000","last_became_active":"2024-09-11T23:25:52.900976+0000","last_became_peered":"2024-09-11T23:25:52.900976+0000","last_unstale":"2024-09-11T23:25:53.919253+0000","last_undegraded":"2024-09-11T23:25:53.919253+0000","last_fullsized":"2024-09-11T23:25:53.919253+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:48.489073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940544+0000","last_change":"2024-09-11T23:25:51.892571+0000","last_active":"2024-09-11T23:25:53.940544+0000","last_peered":"2024-09-11T23:25:53.940544+0000","last_clean":"2024-09-11T23:25:53.940544+0000","last_became_active":"2024-09-11T23:25:51.891598+0000","last_became_peered":"2024-09-11T23:25:51.891598+0000","last_unstale":"2024-09-11T23:25:53.940544+0000","last_undegraded":"2024-09-11T23:25:53.940544+0000","last_fullsized":"2024-09-11T23:25:53.940544+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:59.728275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918364+0000","last_change":"2024-09-11T23:25:52.918012+0000","last_active":"2024-09-11T23:25:53.918364+0000","last_peered":"2024-09-11T23:25:53.918364+0000","last_clean":"2024-09-11T23:25:53.918364+0000","last_became_active":"2024-09-11T23:25:52.917726+0000","last_became_peered":"2024-09-11T23:25:52.917726+0000","last_unstale":"2024-09-11T23:25:53.918364+0000","last_undegraded":"2024-09-11T23:25:53.918364+0000","last_fullsized":"2024-09-11T23:25:53.918364+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:37.136434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"152'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940928+0000","last_change":"2024-09-11T23:25:51.905354+0000","last_active":"2024-09-11T23:25:53.940928+0000","last_peered":"2024-09-11T23:25:53.940928+0000","last_clean":"2024-09-11T23:25:53.940928+0000","last_became_active":"2024-09-11T23:25:51.905072+0000","last_became_peered":"2024-09-11T23:25:51.905072+0000","last_unstale":"2024-09-11T23:25:53.940928+0000","last_undegraded":"2024-09-11T23:25:53.940928+0000","last_fullsized":"2024-09-11T23:25:53.940928+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:27.311516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.941095+0000","last_change":"2024-09-11T23:25:52.912013+0000","last_active":"2024-09-11T23:25:53.941095+0000","last_peered":"2024-09-11T23:25:53.941095+0000","last_clean":"2024-09-11T23:25:53.941095+0000","last_became_active":"2024-09-11T23:25:52.911773+0000","last_became_peered":"2024-09-11T23:25:52.911773+0000","last_unstale":"2024-09-11T23:25:53.941095+0000","last_undegraded":"2024-09-11T23:25:53.941095+0000","last_fullsized":"2024-09-11T23:25:53.941095+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:22.397789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918881+0000","last_change":"2024-09-11T23:25:51.887367+0000","last_active":"2024-09-11T23:25:53.918881+0000","last_peered":"2024-09-11T23:25:53.918881+0000","last_clean":"2024-09-11T23:25:53.918881+0000","last_became_active":"2024-09-11T23:25:51.887017+0000","last_became_peered":"2024-09-11T23:25:51.887017+0000","last_unstale":"2024-09-11T23:25:53.918881+0000","last_undegraded":"2024-09-11T23:25:53.918881+0000","last_fullsized":"2024-09-11T23:25:53.918881+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:44.703359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913218+0000","last_change":"2024-09-11T23:25:52.919254+0000","last_active":"2024-09-11T23:25:53.913218+0000","last_peered":"2024-09-11T23:25:53.913218+0000","last_clean":"2024-09-11T23:25:53.913218+0000","last_became_active":"2024-09-11T23:25:52.918167+0000","last_became_peered":"2024-09-11T23:25:52.918167+0000","last_unstale":"2024-09-11T23:25:53.913218+0000","last_undegraded":"2024-09-11T23:25:53.913218+0000","last_fullsized":"2024-09-11T23:25:53.913218+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:47.015634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929325+0000","last_change":"2024-09-11T23:25:51.899337+0000","last_active":"2024-09-11T23:25:53.929325+0000","last_peered":"2024-09-11T23:25:53.929325+0000","last_clean":"2024-09-11T23:25:53.929325+0000","last_became_active":"2024-09-11T23:25:51.899015+0000","last_became_peered":"2024-09-11T23:25:51.899015+0000","last_unstale":"2024-09-11T23:25:53.929325+0000","last_undegraded":"2024-09-11T23:25:53.929325+0000","last_fullsized":"2024-09-11T23:25:53.929325+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:21.391041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918703+0000","last_change":"2024-09-11T23:25:52.910751+0000","last_active":"2024-09-11T23:25:53.918703+0000","last_peered":"2024-09-11T23:25:53.918703+0000","last_clean":"2024-09-11T23:25:53.918703+0000","last_became_active":"2024-09-11T23:25:52.910470+0000","last_became_peered":"2024-09-11T23:25:52.910470+0000","last_unstale":"2024-09-11T23:25:53.918703+0000","last_undegraded":"2024-09-11T23:25:53.918703+0000","last_fullsized":"2024-09-11T23:25:53.918703+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:40.769361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940108+0000","last_change":"2024-09-11T23:25:51.900424+0000","last_active":"2024-09-11T23:25:53.940108+0000","last_peered":"2024-09-11T23:25:53.940108+0000","last_clean":"2024-09-11T23:25:53.940108+0000","last_became_active":"2024-09-11T23:25:51.900158+0000","last_became_peered":"2024-09-11T23:25:51.900158+0000","last_unstale":"2024-09-11T23:25:53.940108+0000","last_undegraded":"2024-09-11T23:25:53.940108+0000","last_fullsized":"2024-09-11T23:25:53.940108+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:20.269934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940121+0000","last_change":"2024-09-11T23:25:52.920380+0000","last_active":"2024-09-11T23:25:53.940121+0000","last_peered":"2024-09-11T23:25:53.940121+0000","last_clean":"2024-09-11T23:25:53.940121+0000","last_became_active":"2024-09-11T23:25:52.920095+0000","last_became_peered":"2024-09-11T23:25:52.920095+0000","last_unstale":"2024-09-11T23:25:53.940121+0000","last_undegraded":"2024-09-11T23:25:53.940121+0000","last_fullsized":"2024-09-11T23:25:53.940121+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:50.787977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929385+0000","last_change":"2024-09-11T23:25:51.901075+0000","last_active":"2024-09-11T23:25:53.929385+0000","last_peered":"2024-09-11T23:25:53.929385+0000","last_clean":"2024-09-11T23:25:53.929385+0000","last_became_active":"2024-09-11T23:25:51.900780+0000","last_became_peered":"2024-09-11T23:25:51.900780+0000","last_unstale":"2024-09-11T23:25:53.929385+0000","last_undegraded":"2024-09-11T23:25:53.929385+0000","last_fullsized":"2024-09-11T23:25:53.929385+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:47.992432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.939679+0000","last_change":"2024-09-11T23:25:52.916565+0000","last_active":"2024-09-11T23:25:53.939679+0000","last_peered":"2024-09-11T23:25:53.939679+0000","last_clean":"2024-09-11T23:25:53.939679+0000","last_became_active":"2024-09-11T23:25:52.916300+0000","last_became_peered":"2024-09-11T23:25:52.916300+0000","last_unstale":"2024-09-11T23:25:53.939679+0000","last_undegraded":"2024-09-11T23:25:53.939679+0000","last_fullsized":"2024-09-11T23:25:53.939679+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:51.958578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.917737+0000","last_change":"2024-09-11T23:25:51.893776+0000","last_active":"2024-09-11T23:25:53.917737+0000","last_peered":"2024-09-11T23:25:53.917737+0000","last_clean":"2024-09-11T23:25:53.917737+0000","last_became_active":"2024-09-11T23:25:51.893477+0000","last_became_peered":"2024-09-11T23:25:51.893477+0000","last_unstale":"2024-09-11T23:25:53.917737+0000","last_undegraded":"2024-09-11T23:25:53.917737+0000","last_fullsized":"2024-09-11T23:25:53.917737+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:44.889964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940434+0000","last_change":"2024-09-11T23:25:52.914304+0000","last_active":"2024-09-11T23:25:53.940434+0000","last_peered":"2024-09-11T23:25:53.940434+0000","last_clean":"2024-09-11T23:25:53.940434+0000","last_became_active":"2024-09-11T23:25:52.913981+0000","last_became_peered":"2024-09-11T23:25:52.913981+0000","last_unstale":"2024-09-11T23:25:53.940434+0000","last_undegraded":"2024-09-11T23:25:53.940434+0000","last_fullsized":"2024-09-11T23:25:53.940434+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:06.680885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940707+0000","last_change":"2024-09-11T23:25:51.900937+0000","last_active":"2024-09-11T23:25:53.940707+0000","last_peered":"2024-09-11T23:25:53.940707+0000","last_clean":"2024-09-11T23:25:53.940707+0000","last_became_active":"2024-09-11T23:25:51.900594+0000","last_became_peered":"2024-09-11T23:25:51.900594+0000","last_unstale":"2024-09-11T23:25:53.940707+0000","last_undegraded":"2024-09-11T23:25:53.940707+0000","last_fullsized":"2024-09-11T23:25:53.940707+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:53.452192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913522+0000","last_change":"2024-09-11T23:25:52.919185+0000","last_active":"2024-09-11T23:25:53.913522+0000","last_peered":"2024-09-11T23:25:53.913522+0000","last_clean":"2024-09-11T23:25:53.913522+0000","last_became_active":"2024-09-11T23:25:52.918589+0000","last_became_peered":"2024-09-11T23:25:52.918589+0000","last_unstale":"2024-09-11T23:25:53.913522+0000","last_undegraded":"2024-09-11T23:25:53.913522+0000","last_fullsized":"2024-09-11T23:25:53.913522+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:12.746930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"153'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.928683+0000","last_change":"2024-09-11T23:25:51.905553+0000","last_active":"2024-09-11T23:25:53.928683+0000","last_peered":"2024-09-11T23:25:53.928683+0000","last_clean":"2024-09-11T23:25:53.928683+0000","last_became_active":"2024-09-11T23:25:51.905239+0000","last_became_peered":"2024-09-11T23:25:51.905239+0000","last_unstale":"2024-09-11T23:25:53.928683+0000","last_undegraded":"2024-09-11T23:25:53.928683+0000","last_fullsized":"2024-09-11T23:25:53.928683+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:00.116997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940032+0000","last_change":"2024-09-11T23:25:52.912679+0000","last_active":"2024-09-11T23:25:53.940032+0000","last_peered":"2024-09-11T23:25:53.940032+0000","last_clean":"2024-09-11T23:25:53.940032+0000","last_became_active":"2024-09-11T23:25:52.912197+0000","last_became_peered":"2024-09-11T23:25:52.912197+0000","last_unstale":"2024-09-11T23:25:53.940032+0000","last_undegraded":"2024-09-11T23:25:53.940032+0000","last_fullsized":"2024-09-11T23:25:53.940032+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:31.393436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913447+0000","last_change":"2024-09-11T23:25:51.903659+0000","last_active":"2024-09-11T23:25:53.913447+0000","last_peered":"2024-09-11T23:25:53.913447+0000","last_clean":"2024-09-11T23:25:53.913447+0000","last_became_active":"2024-09-11T23:25:51.903402+0000","last_became_peered":"2024-09-11T23:25:51.903402+0000","last_unstale":"2024-09-11T23:25:53.913447+0000","last_undegraded":"2024-09-11T23:25:53.913447+0000","last_fullsized":"2024-09-11T23:25:53.913447+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:06.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940296+0000","last_change":"2024-09-11T23:25:52.912072+0000","last_active":"2024-09-11T23:25:53.940296+0000","last_peered":"2024-09-11T23:25:53.940296+0000","last_clean":"2024-09-11T23:25:53.940296+0000","last_became_active":"2024-09-11T23:25:52.911802+0000","last_became_peered":"2024-09-11T23:25:52.911802+0000","last_unstale":"2024-09-11T23:25:53.940296+0000","last_undegraded":"2024-09-11T23:25:53.940296+0000","last_fullsized":"2024-09-11T23:25:53.940296+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:57.934305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940627+0000","last_change":"2024-09-11T23:25:51.889658+0000","last_active":"2024-09-11T23:25:53.940627+0000","last_peered":"2024-09-11T23:25:53.940627+0000","last_clean":"2024-09-11T23:25:53.940627+0000","last_became_active":"2024-09-11T23:25:51.888486+0000","last_became_peered":"2024-09-11T23:25:51.888486+0000","last_unstale":"2024-09-11T23:25:53.940627+0000","last_undegraded":"2024-09-11T23:25:53.940627+0000","last_fullsized":"2024-09-11T23:25:53.940627+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:02.942842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940812+0000","last_change":"2024-09-11T23:25:52.917541+0000","last_active":"2024-09-11T23:25:53.940812+0000","last_peered":"2024-09-11T23:25:53.940812+0000","last_clean":"2024-09-11T23:25:53.940812+0000","last_became_active":"2024-09-11T23:25:52.917255+0000","last_became_peered":"2024-09-11T23:25:52.917255+0000","last_unstale":"2024-09-11T23:25:53.940812+0000","last_undegraded":"2024-09-11T23:25:53.940812+0000","last_fullsized":"2024-09-11T23:25:53.940812+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:21.636617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918502+0000","last_change":"2024-09-11T23:25:51.895708+0000","last_active":"2024-09-11T23:25:53.918502+0000","last_peered":"2024-09-11T23:25:53.918502+0000","last_clean":"2024-09-11T23:25:53.918502+0000","last_became_active":"2024-09-11T23:25:51.895259+0000","last_became_peered":"2024-09-11T23:25:51.895259+0000","last_unstale":"2024-09-11T23:25:53.918502+0000","last_undegraded":"2024-09-11T23:25:53.918502+0000","last_fullsized":"2024-09-11T23:25:53.918502+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:28.527458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940296+0000","last_change":"2024-09-11T23:25:52.918407+0000","last_active":"2024-09-11T23:25:53.940296+0000","last_peered":"2024-09-11T23:25:53.940296+0000","last_clean":"2024-09-11T23:25:53.940296+0000","last_became_active":"2024-09-11T23:25:52.917887+0000","last_became_peered":"2024-09-11T23:25:52.917887+0000","last_unstale":"2024-09-11T23:25:53.940296+0000","last_undegraded":"2024-09-11T23:25:53.940296+0000","last_fullsized":"2024-09-11T23:25:53.940296+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:36.373141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918143+0000","last_change":"2024-09-11T23:25:51.893389+0000","last_active":"2024-09-11T23:25:53.918143+0000","last_peered":"2024-09-11T23:25:53.918143+0000","last_clean":"2024-09-11T23:25:53.918143+0000","last_became_active":"2024-09-11T23:25:51.892003+0000","last_became_peered":"2024-09-11T23:25:51.892003+0000","last_unstale":"2024-09-11T23:25:53.918143+0000","last_undegraded":"2024-09-11T23:25:53.918143+0000","last_fullsized":"2024-09-11T23:25:53.918143+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:15.977587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940179+0000","last_change":"2024-09-11T23:25:52.922162+0000","last_active":"2024-09-11T23:25:53.940179+0000","last_peered":"2024-09-11T23:25:53.940179+0000","last_clean":"2024-09-11T23:25:53.940179+0000","last_became_active":"2024-09-11T23:25:52.918295+0000","last_became_peered":"2024-09-11T23:25:52.918295+0000","last_unstale":"2024-09-11T23:25:53.940179+0000","last_undegraded":"2024-09-11T23:25:53.940179+0000","last_fullsized":"2024-09-11T23:25:53.940179+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:56.157773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940606+0000","last_change":"2024-09-11T23:25:51.894605+0000","last_active":"2024-09-11T23:25:53.940606+0000","last_peered":"2024-09-11T23:25:53.940606+0000","last_clean":"2024-09-11T23:25:53.940606+0000","last_became_active":"2024-09-11T23:25:51.893269+0000","last_became_peered":"2024-09-11T23:25:51.893269+0000","last_unstale":"2024-09-11T23:25:53.940606+0000","last_undegraded":"2024-09-11T23:25:53.940606+0000","last_fullsized":"2024-09-11T23:25:53.940606+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:40.566423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.939866+0000","last_change":"2024-09-11T23:25:52.914125+0000","last_active":"2024-09-11T23:25:53.939866+0000","last_peered":"2024-09-11T23:25:53.939866+0000","last_clean":"2024-09-11T23:25:53.939866+0000","last_became_active":"2024-09-11T23:25:52.913667+0000","last_became_peered":"2024-09-11T23:25:52.913667+0000","last_unstale":"2024-09-11T23:25:53.939866+0000","last_undegraded":"2024-09-11T23:25:53.939866+0000","last_fullsized":"2024-09-11T23:25:53.939866+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:01.434871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929211+0000","last_change":"2024-09-11T23:25:51.906070+0000","last_active":"2024-09-11T23:25:53.929211+0000","last_peered":"2024-09-11T23:25:53.929211+0000","last_clean":"2024-09-11T23:25:53.929211+0000","last_became_active":"2024-09-11T23:25:51.904452+0000","last_became_peered":"2024-09-11T23:25:51.904452+0000","last_unstale":"2024-09-11T23:25:53.929211+0000","last_undegraded":"2024-09-11T23:25:53.929211+0000","last_fullsized":"2024-09-11T23:25:53.929211+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:01.522087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.912916+0000","last_change":"2024-09-11T23:25:52.911223+0000","last_active":"2024-09-11T23:25:53.912916+0000","last_peered":"2024-09-11T23:25:53.912916+0000","last_clean":"2024-09-11T23:25:53.912916+0000","last_became_active":"2024-09-11T23:25:52.909072+0000","last_became_peered":"2024-09-11T23:25:52.909072+0000","last_unstale":"2024-09-11T23:25:53.912916+0000","last_undegraded":"2024-09-11T23:25:53.912916+0000","last_fullsized":"2024-09-11T23:25:53.912916+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:07.142860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940276+0000","last_change":"2024-09-11T23:25:51.897763+0000","last_active":"2024-09-11T23:25:53.940276+0000","last_peered":"2024-09-11T23:25:53.940276+0000","last_clean":"2024-09-11T23:25:53.940276+0000","last_became_active":"2024-09-11T23:25:51.896765+0000","last_became_peered":"2024-09-11T23:25:51.896765+0000","last_unstale":"2024-09-11T23:25:53.940276+0000","last_undegraded":"2024-09-11T23:25:53.940276+0000","last_fullsized":"2024-09-11T23:25:53.940276+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:17.826562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":455,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940226+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:25:53.940226+0000","last_peered":"2024-09-11T23:25:53.940226+0000","last_clean":"2024-09-11T23:25:53.940226+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:25:53.940226+0000","last_undegraded":"2024-09-11T23:25:53.940226+0000","last_fullsized":"2024-09-11T23:25:53.940226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476838,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33652,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338188,"statfs":{"total":96636764160,"available":96602304512,"internally_reserved":0,"allocated":2519040,"data_stored":1435423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476837,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33064,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338776,"statfs":{"total":96636764160,"available":96602906624,"internally_reserved":0,"allocated":1916928,"data_stored":844951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476836,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33068,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338772,"statfs":{"total":96636764160,"available":96602902528,"internally_reserved":0,"allocated":1916928,"data_stored":844951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476836,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33084,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338756,"statfs":{"total":96636764160,"available":96602886144,"internally_reserved":0,"allocated":1933312,"data_stored":847145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542245,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33072,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338768,"statfs":{"total":96636764160,"available":96602898432,"internally_reserved":0,"allocated":1929216,"data_stored":845145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542245,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33072,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338768,"statfs":{"total":96636764160,"available":96602898432,"internally_reserved":0,"allocated":1929216,"data_stored":845645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509541,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33080,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338760,"statfs":{"total":96636764160,"available":96602890240,"internally_reserved":0,"allocated":1929216,"data_stored":846563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509541,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33644,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338196,"statfs":{"total":96636764160,"available":96602312704,"internally_reserved":0,"allocated":2514944,"data_stored":1435341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:25:57.083 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:25:57.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.272+0000 7f58df400640 1 Processor -- start 2024-09-11T23:25:57.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.272+0000 7f58df400640 1 -- start start 2024-09-11T23:25:57.274 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.273+0000 7f58df400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58d80d02a0 0x7f58d80d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:57.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.273+0000 7f58df400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f58d815ce80 0x7f58d81594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:57.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.274+0000 7f58df400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d80d0bc0 con 0x7f58d815ca40 2024-09-11T23:25:57.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.274+0000 7f58df400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f58d815d390 con 0x7f58d815ce80 2024-09-11T23:25:57.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.274+0000 7f58df400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f58d815d670 con 0x7f58d80d02a0 2024-09-11T23:25:57.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.274+0000 7f58cfe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f58d815ca40 0x7f58d815e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35170/0 (socket says 172.21.15.144:35170) 2024-09-11T23:25:57.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.274+0000 7f58cfe00640 1 -- 172.21.15.144:0/719349040 learned_addr learned my addr 172.21.15.144:0/719349040 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:57.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.274+0000 7f58dd400640 1 --2- 172.21.15.144:0/719349040 >> v2:172.21.15.165:3300/0 conn(0x7f58d815ce80 0x7f58d81594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:57.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.274+0000 7f58dca00640 1 --2- 172.21.15.144:0/719349040 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58d80d02a0 0x7f58d80d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:57.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.274+0000 7f58d7e00640 1 -- 172.21.15.144:0/719349040 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1188328969 0 0) 0x7f58d80d0bc0 con 0x7f58d815ca40 2024-09-11T23:25:57.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.274+0000 7f58d7e00640 1 -- 172.21.15.144:0/719349040 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58bc003520 con 0x7f58d815ca40 2024-09-11T23:25:57.277 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.275+0000 7f58d7e00640 1 -- 172.21.15.144:0/719349040 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 805406408 0 0) 0x7f58bc003520 con 0x7f58d815ca40 2024-09-11T23:25:57.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.275+0000 7f58d7e00640 1 -- 172.21.15.144:0/719349040 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58d80d02a0 msgr2=0x7f58d80d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:57.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.275+0000 7f58d7e00640 1 --2- 172.21.15.144:0/719349040 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58d80d02a0 0x7f58d80d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.275+0000 7f58d7e00640 1 -- 172.21.15.144:0/719349040 >> v2:172.21.15.165:3300/0 conn(0x7f58d815ce80 msgr2=0x7f58d81594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:57.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.275+0000 7f58d7e00640 1 --2- 172.21.15.144:0/719349040 >> v2:172.21.15.165:3300/0 conn(0x7f58d815ce80 0x7f58d81594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.275+0000 7f58d7e00640 1 -- 172.21.15.144:0/719349040 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d815d950 con 0x7f58d815ca40 2024-09-11T23:25:57.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.275+0000 7f58d7e00640 1 -- 172.21.15.144:0/719349040 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f58c0001670 con 0x7f58d815ca40 2024-09-11T23:25:57.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.275+0000 7f58dca00640 1 --2- 172.21.15.144:0/719349040 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58d80d02a0 0x7f58d80d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:25:57.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.275+0000 7f58d7e00640 1 -- 172.21.15.144:0/719349040 >> v1:172.21.15.144:6789/0 conn(0x7f58d815ca40 legacy=0x7f58d815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:57.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.275+0000 7f58d7e00640 1 --2- 172.21.15.144:0/719349040 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58bc0039b0 0x7f58bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:57.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.275+0000 7f58d7e00640 1 --2- 172.21.15.144:0/719349040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58bc004800 0x7f58bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:57.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.275+0000 7f58d7e00640 1 --2- 172.21.15.144:0/719349040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58bc0051c0 0x7f58bc00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:57.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.275+0000 7f58d7e00640 1 -- 172.21.15.144:0/719349040 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f58d815d390 con 0x7f58bc0051c0 2024-09-11T23:25:57.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.275+0000 7f58d7e00640 1 -- 172.21.15.144:0/719349040 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f58d815d670 con 0x7f58bc004800 2024-09-11T23:25:57.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.275+0000 7f58d7e00640 1 -- 172.21.15.144:0/719349040 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f58bc00e190 con 0x7f58bc0039b0 2024-09-11T23:25:57.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.275+0000 7f58dd400640 1 --2- 172.21.15.144:0/719349040 >> v2:172.21.15.165:3300/0 conn(0x7f58d815ce80 0x7f58d81594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:25:57.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.275+0000 7f58dca00640 1 --2- 172.21.15.144:0/719349040 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58bc0039b0 0x7f58bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:57.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.275+0000 7f58dd400640 1 --2- 172.21.15.144:0/719349040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58bc0051c0 0x7f58bc00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:57.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.275+0000 7f58cfe00640 1 --2- 172.21.15.144:0/719349040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58bc004800 0x7f58bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:57.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.276+0000 7f58dd400640 1 -- 172.21.15.144:0/719349040 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58bc0039b0 msgr2=0x7f58bc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:57.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.276+0000 7f58dd400640 1 --2- 172.21.15.144:0/719349040 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58bc0039b0 0x7f58bc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.276+0000 7f58dd400640 1 -- 172.21.15.144:0/719349040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58bc004800 msgr2=0x7f58bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:57.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.276+0000 7f58dd400640 1 --2- 172.21.15.144:0/719349040 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58bc004800 0x7f58bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.276+0000 7f58dd400640 1 -- 172.21.15.144:0/719349040 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58bc003520 con 0x7f58bc0051c0 2024-09-11T23:25:57.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.277+0000 7f58dd400640 1 --2- 172.21.15.144:0/719349040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58bc0051c0 0x7f58bc00dbd0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f58d000e350 tx=0x7f58bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89276f3ed3588fa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:57.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.277+0000 7f58d7e00640 1 -- 172.21.15.144:0/719349040 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d0009dc0 con 0x7f58bc0051c0 2024-09-11T23:25:57.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.277+0000 7f58d7e00640 1 -- 172.21.15.144:0/719349040 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58d0003b90 con 0x7f58bc0051c0 2024-09-11T23:25:57.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.277+0000 7f58d7e00640 1 -- 172.21.15.144:0/719349040 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d0004020 con 0x7f58bc0051c0 2024-09-11T23:25:57.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.277+0000 7f58df400640 1 -- 172.21.15.144:0/719349040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58bc0051c0 msgr2=0x7f58bc00dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:57.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.277+0000 7f58df400640 1 --2- 172.21.15.144:0/719349040 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58bc0051c0 0x7f58bc00dbd0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f58d000e350 tx=0x7f58bc005830 comp rx=0 tx=0).stop 2024-09-11T23:25:57.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.277+0000 7f58dd400640 1 -- 172.21.15.144:0/719349040 reap_dead start 2024-09-11T23:25:57.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.277+0000 7f58df400640 1 -- 172.21.15.144:0/719349040 shutdown_connections 2024-09-11T23:25:57.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.277+0000 7f58df400640 1 -- 172.21.15.144:0/719349040 >> 172.21.15.144:0/719349040 conn(0x7f58d8062cc0 msgr2=0x7f58d806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:57.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.277+0000 7f58df400640 1 -- 172.21.15.144:0/719349040 shutdown_connections 2024-09-11T23:25:57.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.277+0000 7f58df400640 1 -- 172.21.15.144:0/719349040 wait complete. 2024-09-11T23:25:57.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.279+0000 7f58df400640 1 Processor -- start 2024-09-11T23:25:57.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.279+0000 7f58df400640 1 -- start start 2024-09-11T23:25:57.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.280+0000 7f58df400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58bc0051c0 0x7f58d8073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:57.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.280+0000 7f58df400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58d81594a0 0x7f58d8140d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:57.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.280+0000 7f58df400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58d8141650 0x7f58d8141b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:57.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.280+0000 7f58df400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f58d815eb40 con 0x7f58bc0051c0 2024-09-11T23:25:57.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.280+0000 7f58df400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f58d815df10 con 0x7f58d81594a0 2024-09-11T23:25:57.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.280+0000 7f58df400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f58d8155b90 con 0x7f58d8141650 2024-09-11T23:25:57.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.280+0000 7f58dca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58bc0051c0 0x7f58d8073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:57.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.280+0000 7f58dca00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58bc0051c0 0x7f58d8073ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40858/0 (socket says 172.21.15.144:40858) 2024-09-11T23:25:57.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.280+0000 7f58dca00640 1 -- 172.21.15.144:0/777091092 learned_addr learned my addr 172.21.15.144:0/777091092 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:57.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.281+0000 7f58dca00640 1 -- 172.21.15.144:0/777091092 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58d8141650 msgr2=0x7f58d8141b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:57.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.281+0000 7f58dd400640 1 --2- 172.21.15.144:0/777091092 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58d8141650 0x7f58d8141b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:57.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.281+0000 7f58cfe00640 1 --2- 172.21.15.144:0/777091092 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58d81594a0 0x7f58d8140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:57.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.281+0000 7f58dca00640 1 --2- 172.21.15.144:0/777091092 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58d8141650 0x7f58d8141b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.281+0000 7f58dca00640 1 -- 172.21.15.144:0/777091092 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58d81594a0 msgr2=0x7f58d8140d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:57.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.281+0000 7f58dca00640 1 --2- 172.21.15.144:0/777091092 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58d81594a0 0x7f58d8140d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.281+0000 7f58dca00640 1 -- 172.21.15.144:0/777091092 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d81444e0 con 0x7f58bc0051c0 2024-09-11T23:25:57.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.281+0000 7f58dd400640 1 --2- 172.21.15.144:0/777091092 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58d8141650 0x7f58d8141b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:57.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.281+0000 7f58cfe00640 1 --2- 172.21.15.144:0/777091092 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58d81594a0 0x7f58d8140d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:57.283 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.281+0000 7f58dca00640 1 --2- 172.21.15.144:0/777091092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58bc0051c0 0x7f58d8073ae0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f58c80119d0 tx=0x7f58c8011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:57.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.281+0000 7f58d5600640 1 -- 172.21.15.144:0/777091092 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c800fc10 con 0x7f58bc0051c0 2024-09-11T23:25:57.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.281+0000 7f58d5600640 1 -- 172.21.15.144:0/777091092 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c800fdb0 con 0x7f58bc0051c0 2024-09-11T23:25:57.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.281+0000 7f58d5600640 1 -- 172.21.15.144:0/777091092 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8014640 con 0x7f58bc0051c0 2024-09-11T23:25:57.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.281+0000 7f58df400640 1 -- 172.21.15.144:0/777091092 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d8141260 con 0x7f58bc0051c0 2024-09-11T23:25:57.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.281+0000 7f58df400640 1 -- 172.21.15.144:0/777091092 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d8159c60 con 0x7f58bc0051c0 2024-09-11T23:25:57.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.282+0000 7f58df400640 1 -- 172.21.15.144:0/777091092 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d80b4790 con 0x7f58bc0051c0 2024-09-11T23:25:57.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.283+0000 7f58d5600640 1 -- 172.21.15.144:0/777091092 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f58c8012040 con 0x7f58bc0051c0 2024-09-11T23:25:57.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.284+0000 7f58d5600640 1 --2- 172.21.15.144:0/777091092 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f58b406c640 0x7f58b406eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:57.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.284+0000 7f58d5600640 1 -- 172.21.15.144:0/777091092 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f58c808c8a0 con 0x7f58bc0051c0 2024-09-11T23:25:57.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.285+0000 7f58cfe00640 1 --2- 172.21.15.144:0/777091092 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f58b406c640 0x7f58b406eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:57.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.285+0000 7f58cfe00640 1 --2- 172.21.15.144:0/777091092 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f58b406c640 0x7f58b406eb00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f58c0000c00 tx=0x7f58c0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:57.289 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.288+0000 7f58d5600640 1 -- 172.21.15.144:0/777091092 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f58d8141260 con 0x7f58bc0051c0 2024-09-11T23:25:57.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.458+0000 7f58df400640 1 -- 172.21.15.144:0/777091092 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f58d8074020 con 0x7f58b406c640 2024-09-11T23:25:57.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.465+0000 7f58d5600640 1 -- 172.21.15.144:0/777091092 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252485 (secure 0 0 0) 0x7f58c0007d00 con 0x7f58b406c640 2024-09-11T23:25:57.468 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:57.469 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:25:57.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.468+0000 7f58df400640 1 -- 172.21.15.144:0/777091092 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f58b406c640 msgr2=0x7f58b406eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:57.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.468+0000 7f58df400640 1 --2- 172.21.15.144:0/777091092 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f58b406c640 0x7f58b406eb00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f58c0000c00 tx=0x7f58c0009040 comp rx=0 tx=0).stop 2024-09-11T23:25:57.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.468+0000 7f58df400640 1 -- 172.21.15.144:0/777091092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58bc0051c0 msgr2=0x7f58d8073ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:57.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.468+0000 7f58df400640 1 --2- 172.21.15.144:0/777091092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58bc0051c0 0x7f58d8073ae0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f58c80119d0 tx=0x7f58c8011e90 comp rx=0 tx=0).stop 2024-09-11T23:25:57.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.468+0000 7f58df400640 1 -- 172.21.15.144:0/777091092 shutdown_connections 2024-09-11T23:25:57.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.468+0000 7f58df400640 1 --2- 172.21.15.144:0/777091092 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f58b406c640 0x7f58b406eb00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.468+0000 7f58df400640 1 --2- 172.21.15.144:0/777091092 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f58d8141650 0x7f58d8141b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.468+0000 7f58df400640 1 --2- 172.21.15.144:0/777091092 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58d81594a0 0x7f58d8140d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.468+0000 7f58df400640 1 --2- 172.21.15.144:0/777091092 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58bc0051c0 0x7f58d8073ae0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.468+0000 7f58df400640 1 -- 172.21.15.144:0/777091092 >> 172.21.15.144:0/777091092 conn(0x7f58d8062cc0 msgr2=0x7f58d8153c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:57.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.469+0000 7f58df400640 1 -- 172.21.15.144:0/777091092 shutdown_connections 2024-09-11T23:25:57.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.469+0000 7f58df400640 1 -- 172.21.15.144:0/777091092 wait complete. 2024-09-11T23:25:57.486 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-09-11T23:25:56.765247+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":265736,"kb_used_data":16200,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754708984,"statfs":{"total":773094113280,"available":772821999616,"internally_reserved":0,"allocated":16588800,"data_stored":7945164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.890850"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940590+0000","last_change":"2024-09-11T23:25:52.926481+0000","last_active":"2024-09-11T23:25:53.940590+0000","last_peered":"2024-09-11T23:25:53.940590+0000","last_clean":"2024-09-11T23:25:53.940590+0000","last_became_active":"2024-09-11T23:25:52.926181+0000","last_became_peered":"2024-09-11T23:25:52.926181+0000","last_unstale":"2024-09-11T23:25:53.940590+0000","last_undegraded":"2024-09-11T23:25:53.940590+0000","last_fullsized":"2024-09-11T23:25:53.940590+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:05.408560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.941302+0000","last_change":"2024-09-11T23:25:52.915421+0000","last_active":"2024-09-11T23:25:53.941302+0000","last_peered":"2024-09-11T23:25:53.941302+0000","last_clean":"2024-09-11T23:25:53.941302+0000","last_became_active":"2024-09-11T23:25:52.914856+0000","last_became_peered":"2024-09-11T23:25:52.914856+0000","last_unstale":"2024-09-11T23:25:53.941302+0000","last_undegraded":"2024-09-11T23:25:53.941302+0000","last_fullsized":"2024-09-11T23:25:53.941302+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:40.769361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929552+0000","last_change":"2024-09-11T23:25:52.912842+0000","last_active":"2024-09-11T23:25:53.929552+0000","last_peered":"2024-09-11T23:25:53.929552+0000","last_clean":"2024-09-11T23:25:53.929552+0000","last_became_active":"2024-09-11T23:25:52.911262+0000","last_became_peered":"2024-09-11T23:25:52.911262+0000","last_unstale":"2024-09-11T23:25:53.929552+0000","last_undegraded":"2024-09-11T23:25:53.929552+0000","last_fullsized":"2024-09-11T23:25:53.929552+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:53.721933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.941088+0000","last_change":"2024-09-11T23:25:52.916715+0000","last_active":"2024-09-11T23:25:53.941088+0000","last_peered":"2024-09-11T23:25:53.941088+0000","last_clean":"2024-09-11T23:25:53.941088+0000","last_became_active":"2024-09-11T23:25:52.915157+0000","last_became_peered":"2024-09-11T23:25:52.915157+0000","last_unstale":"2024-09-11T23:25:53.941088+0000","last_undegraded":"2024-09-11T23:25:53.941088+0000","last_fullsized":"2024-09-11T23:25:53.941088+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:48.489073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940114+0000","last_change":"2024-09-11T23:25:52.920678+0000","last_active":"2024-09-11T23:25:53.940114+0000","last_peered":"2024-09-11T23:25:53.940114+0000","last_clean":"2024-09-11T23:25:53.940114+0000","last_became_active":"2024-09-11T23:25:52.920372+0000","last_became_peered":"2024-09-11T23:25:52.920372+0000","last_unstale":"2024-09-11T23:25:53.940114+0000","last_undegraded":"2024-09-11T23:25:53.940114+0000","last_fullsized":"2024-09-11T23:25:53.940114+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:36.740246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929326+0000","last_change":"2024-09-11T23:25:52.917475+0000","last_active":"2024-09-11T23:25:53.929326+0000","last_peered":"2024-09-11T23:25:53.929326+0000","last_clean":"2024-09-11T23:25:53.929326+0000","last_became_active":"2024-09-11T23:25:52.917227+0000","last_became_peered":"2024-09-11T23:25:52.917227+0000","last_unstale":"2024-09-11T23:25:53.929326+0000","last_undegraded":"2024-09-11T23:25:53.929326+0000","last_fullsized":"2024-09-11T23:25:53.929326+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:22.254388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918104+0000","last_change":"2024-09-11T23:25:52.920725+0000","last_active":"2024-09-11T23:25:53.918104+0000","last_peered":"2024-09-11T23:25:53.918104+0000","last_clean":"2024-09-11T23:25:53.918104+0000","last_became_active":"2024-09-11T23:25:52.919293+0000","last_became_peered":"2024-09-11T23:25:52.919293+0000","last_unstale":"2024-09-11T23:25:53.918104+0000","last_undegraded":"2024-09-11T23:25:53.918104+0000","last_fullsized":"2024-09-11T23:25:53.918104+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:48.489073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.939639+0000","last_change":"2024-09-11T23:25:52.915430+0000","last_active":"2024-09-11T23:25:53.939639+0000","last_peered":"2024-09-11T23:25:53.939639+0000","last_clean":"2024-09-11T23:25:53.939639+0000","last_became_active":"2024-09-11T23:25:52.913529+0000","last_became_peered":"2024-09-11T23:25:52.913529+0000","last_unstale":"2024-09-11T23:25:53.939639+0000","last_undegraded":"2024-09-11T23:25:53.939639+0000","last_fullsized":"2024-09-11T23:25:53.939639+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:24.183314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.919237+0000","last_change":"2024-09-11T23:25:52.911929+0000","last_active":"2024-09-11T23:25:53.919237+0000","last_peered":"2024-09-11T23:25:53.919237+0000","last_clean":"2024-09-11T23:25:53.919237+0000","last_became_active":"2024-09-11T23:25:52.911640+0000","last_became_peered":"2024-09-11T23:25:52.911640+0000","last_unstale":"2024-09-11T23:25:53.919237+0000","last_undegraded":"2024-09-11T23:25:53.919237+0000","last_fullsized":"2024-09-11T23:25:53.919237+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:02.528835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913513+0000","last_change":"2024-09-11T23:25:52.910070+0000","last_active":"2024-09-11T23:25:53.913513+0000","last_peered":"2024-09-11T23:25:53.913513+0000","last_clean":"2024-09-11T23:25:53.913513+0000","last_became_active":"2024-09-11T23:25:52.909337+0000","last_became_peered":"2024-09-11T23:25:52.909337+0000","last_unstale":"2024-09-11T23:25:53.913513+0000","last_undegraded":"2024-09-11T23:25:53.913513+0000","last_fullsized":"2024-09-11T23:25:53.913513+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:24.935884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918930+0000","last_change":"2024-09-11T23:25:52.915163+0000","last_active":"2024-09-11T23:25:53.918930+0000","last_peered":"2024-09-11T23:25:53.918930+0000","last_clean":"2024-09-11T23:25:53.918930+0000","last_became_active":"2024-09-11T23:25:52.914876+0000","last_became_peered":"2024-09-11T23:25:52.914876+0000","last_unstale":"2024-09-11T23:25:53.918930+0000","last_undegraded":"2024-09-11T23:25:53.918930+0000","last_fullsized":"2024-09-11T23:25:53.918930+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:51.866683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.941296+0000","last_change":"2024-09-11T23:25:52.920074+0000","last_active":"2024-09-11T23:25:53.941296+0000","last_peered":"2024-09-11T23:25:53.941296+0000","last_clean":"2024-09-11T23:25:53.941296+0000","last_became_active":"2024-09-11T23:25:52.919799+0000","last_became_peered":"2024-09-11T23:25:52.919799+0000","last_unstale":"2024-09-11T23:25:53.941296+0000","last_undegraded":"2024-09-11T23:25:53.941296+0000","last_fullsized":"2024-09-11T23:25:53.941296+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:40.526970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940948+0000","last_change":"2024-09-11T23:25:52.917031+0000","last_active":"2024-09-11T23:25:53.940948+0000","last_peered":"2024-09-11T23:25:53.940948+0000","last_clean":"2024-09-11T23:25:53.940948+0000","last_became_active":"2024-09-11T23:25:52.916743+0000","last_became_peered":"2024-09-11T23:25:52.916743+0000","last_unstale":"2024-09-11T23:25:53.940948+0000","last_undegraded":"2024-09-11T23:25:53.940948+0000","last_fullsized":"2024-09-11T23:25:53.940948+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:48.999180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.917788+0000","last_change":"2024-09-11T23:25:52.902302+0000","last_active":"2024-09-11T23:25:53.917788+0000","last_peered":"2024-09-11T23:25:53.917788+0000","last_clean":"2024-09-11T23:25:53.917788+0000","last_became_active":"2024-09-11T23:25:52.901420+0000","last_became_peered":"2024-09-11T23:25:52.901420+0000","last_unstale":"2024-09-11T23:25:53.917788+0000","last_undegraded":"2024-09-11T23:25:53.917788+0000","last_fullsized":"2024-09-11T23:25:53.917788+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:50.787977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940883+0000","last_change":"2024-09-11T23:25:52.923277+0000","last_active":"2024-09-11T23:25:53.940883+0000","last_peered":"2024-09-11T23:25:53.940883+0000","last_clean":"2024-09-11T23:25:53.940883+0000","last_became_active":"2024-09-11T23:25:52.921649+0000","last_became_peered":"2024-09-11T23:25:52.921649+0000","last_unstale":"2024-09-11T23:25:53.940883+0000","last_undegraded":"2024-09-11T23:25:53.940883+0000","last_fullsized":"2024-09-11T23:25:53.940883+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:37.136434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.939787+0000","last_change":"2024-09-11T23:25:52.915795+0000","last_active":"2024-09-11T23:25:53.939787+0000","last_peered":"2024-09-11T23:25:53.939787+0000","last_clean":"2024-09-11T23:25:53.939787+0000","last_became_active":"2024-09-11T23:25:52.915501+0000","last_became_peered":"2024-09-11T23:25:52.915501+0000","last_unstale":"2024-09-11T23:25:53.939787+0000","last_undegraded":"2024-09-11T23:25:53.939787+0000","last_fullsized":"2024-09-11T23:25:53.939787+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:46.191506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940614+0000","last_change":"2024-09-11T23:25:52.921852+0000","last_active":"2024-09-11T23:25:53.940614+0000","last_peered":"2024-09-11T23:25:53.940614+0000","last_clean":"2024-09-11T23:25:53.940614+0000","last_became_active":"2024-09-11T23:25:52.921572+0000","last_became_peered":"2024-09-11T23:25:52.921572+0000","last_unstale":"2024-09-11T23:25:53.940614+0000","last_undegraded":"2024-09-11T23:25:53.940614+0000","last_fullsized":"2024-09-11T23:25:53.940614+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:20.052325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940347+0000","last_change":"2024-09-11T23:25:52.922187+0000","last_active":"2024-09-11T23:25:53.940347+0000","last_peered":"2024-09-11T23:25:53.940347+0000","last_clean":"2024-09-11T23:25:53.940347+0000","last_became_active":"2024-09-11T23:25:52.920932+0000","last_became_peered":"2024-09-11T23:25:52.920932+0000","last_unstale":"2024-09-11T23:25:53.940347+0000","last_undegraded":"2024-09-11T23:25:53.940347+0000","last_fullsized":"2024-09-11T23:25:53.940347+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:06.119153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913293+0000","last_change":"2024-09-11T23:25:52.918141+0000","last_active":"2024-09-11T23:25:53.913293+0000","last_peered":"2024-09-11T23:25:53.913293+0000","last_clean":"2024-09-11T23:25:53.913293+0000","last_became_active":"2024-09-11T23:25:52.917856+0000","last_became_peered":"2024-09-11T23:25:52.917856+0000","last_unstale":"2024-09-11T23:25:53.913293+0000","last_undegraded":"2024-09-11T23:25:53.913293+0000","last_fullsized":"2024-09-11T23:25:53.913293+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:02.414819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940186+0000","last_change":"2024-09-11T23:25:52.922042+0000","last_active":"2024-09-11T23:25:53.940186+0000","last_peered":"2024-09-11T23:25:53.940186+0000","last_clean":"2024-09-11T23:25:53.940186+0000","last_became_active":"2024-09-11T23:25:52.921778+0000","last_became_peered":"2024-09-11T23:25:52.921778+0000","last_unstale":"2024-09-11T23:25:53.940186+0000","last_undegraded":"2024-09-11T23:25:53.940186+0000","last_fullsized":"2024-09-11T23:25:53.940186+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:34.720765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940266+0000","last_change":"2024-09-11T23:25:52.920673+0000","last_active":"2024-09-11T23:25:53.940266+0000","last_peered":"2024-09-11T23:25:53.940266+0000","last_clean":"2024-09-11T23:25:53.940266+0000","last_became_active":"2024-09-11T23:25:52.920356+0000","last_became_peered":"2024-09-11T23:25:52.920356+0000","last_unstale":"2024-09-11T23:25:53.940266+0000","last_undegraded":"2024-09-11T23:25:53.940266+0000","last_fullsized":"2024-09-11T23:25:53.940266+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:25.885489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913065+0000","last_change":"2024-09-11T23:25:52.913196+0000","last_active":"2024-09-11T23:25:53.913065+0000","last_peered":"2024-09-11T23:25:53.913065+0000","last_clean":"2024-09-11T23:25:53.913065+0000","last_became_active":"2024-09-11T23:25:52.912635+0000","last_became_peered":"2024-09-11T23:25:52.912635+0000","last_unstale":"2024-09-11T23:25:53.913065+0000","last_undegraded":"2024-09-11T23:25:53.913065+0000","last_fullsized":"2024-09-11T23:25:53.913065+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:42.680793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929272+0000","last_change":"2024-09-11T23:25:52.923801+0000","last_active":"2024-09-11T23:25:53.929272+0000","last_peered":"2024-09-11T23:25:53.929272+0000","last_clean":"2024-09-11T23:25:53.929272+0000","last_became_active":"2024-09-11T23:25:52.923543+0000","last_became_peered":"2024-09-11T23:25:52.923543+0000","last_unstale":"2024-09-11T23:25:53.929272+0000","last_undegraded":"2024-09-11T23:25:53.929272+0000","last_fullsized":"2024-09-11T23:25:53.929272+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:56.207778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.939816+0000","last_change":"2024-09-11T23:25:52.919574+0000","last_active":"2024-09-11T23:25:53.939816+0000","last_peered":"2024-09-11T23:25:53.939816+0000","last_clean":"2024-09-11T23:25:53.939816+0000","last_became_active":"2024-09-11T23:25:52.919023+0000","last_became_peered":"2024-09-11T23:25:52.919023+0000","last_unstale":"2024-09-11T23:25:53.939816+0000","last_undegraded":"2024-09-11T23:25:53.939816+0000","last_fullsized":"2024-09-11T23:25:53.939816+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:13.753541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.941323+0000","last_change":"2024-09-11T23:25:52.923266+0000","last_active":"2024-09-11T23:25:53.941323+0000","last_peered":"2024-09-11T23:25:53.941323+0000","last_clean":"2024-09-11T23:25:53.941323+0000","last_became_active":"2024-09-11T23:25:52.922984+0000","last_became_peered":"2024-09-11T23:25:52.922984+0000","last_unstale":"2024-09-11T23:25:53.941323+0000","last_undegraded":"2024-09-11T23:25:53.941323+0000","last_fullsized":"2024-09-11T23:25:53.941323+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:38.933101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.919131+0000","last_change":"2024-09-11T23:25:52.916903+0000","last_active":"2024-09-11T23:25:53.919131+0000","last_peered":"2024-09-11T23:25:53.919131+0000","last_clean":"2024-09-11T23:25:53.919131+0000","last_became_active":"2024-09-11T23:25:52.916634+0000","last_became_peered":"2024-09-11T23:25:52.916634+0000","last_unstale":"2024-09-11T23:25:53.919131+0000","last_undegraded":"2024-09-11T23:25:53.919131+0000","last_fullsized":"2024-09-11T23:25:53.919131+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:13.723442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929624+0000","last_change":"2024-09-11T23:25:52.914303+0000","last_active":"2024-09-11T23:25:53.929624+0000","last_peered":"2024-09-11T23:25:53.929624+0000","last_clean":"2024-09-11T23:25:53.929624+0000","last_became_active":"2024-09-11T23:25:52.914070+0000","last_became_peered":"2024-09-11T23:25:52.914070+0000","last_unstale":"2024-09-11T23:25:53.929624+0000","last_undegraded":"2024-09-11T23:25:53.929624+0000","last_fullsized":"2024-09-11T23:25:53.929624+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:16.278123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940793+0000","last_change":"2024-09-11T23:25:52.921466+0000","last_active":"2024-09-11T23:25:53.940793+0000","last_peered":"2024-09-11T23:25:53.940793+0000","last_clean":"2024-09-11T23:25:53.940793+0000","last_became_active":"2024-09-11T23:25:52.921228+0000","last_became_peered":"2024-09-11T23:25:52.921228+0000","last_unstale":"2024-09-11T23:25:53.940793+0000","last_undegraded":"2024-09-11T23:25:53.940793+0000","last_fullsized":"2024-09-11T23:25:53.940793+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:55.955162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.941012+0000","last_change":"2024-09-11T23:25:52.915375+0000","last_active":"2024-09-11T23:25:53.941012+0000","last_peered":"2024-09-11T23:25:53.941012+0000","last_clean":"2024-09-11T23:25:53.941012+0000","last_became_active":"2024-09-11T23:25:52.914712+0000","last_became_peered":"2024-09-11T23:25:52.914712+0000","last_unstale":"2024-09-11T23:25:53.941012+0000","last_undegraded":"2024-09-11T23:25:53.941012+0000","last_fullsized":"2024-09-11T23:25:53.941012+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:02.528835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918027+0000","last_change":"2024-09-11T23:25:52.920403+0000","last_active":"2024-09-11T23:25:53.918027+0000","last_peered":"2024-09-11T23:25:53.918027+0000","last_clean":"2024-09-11T23:25:53.918027+0000","last_became_active":"2024-09-11T23:25:52.919987+0000","last_became_peered":"2024-09-11T23:25:52.919987+0000","last_unstale":"2024-09-11T23:25:53.918027+0000","last_undegraded":"2024-09-11T23:25:53.918027+0000","last_fullsized":"2024-09-11T23:25:53.918027+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:56.157773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929318+0000","last_change":"2024-09-11T23:25:52.915008+0000","last_active":"2024-09-11T23:25:53.929318+0000","last_peered":"2024-09-11T23:25:53.929318+0000","last_clean":"2024-09-11T23:25:53.929318+0000","last_became_active":"2024-09-11T23:25:52.914640+0000","last_became_peered":"2024-09-11T23:25:52.914640+0000","last_unstale":"2024-09-11T23:25:53.929318+0000","last_undegraded":"2024-09-11T23:25:53.929318+0000","last_fullsized":"2024-09-11T23:25:53.929318+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:45.648419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.939628+0000","last_change":"2024-09-11T23:25:52.914905+0000","last_active":"2024-09-11T23:25:53.939628+0000","last_peered":"2024-09-11T23:25:53.939628+0000","last_clean":"2024-09-11T23:25:53.939628+0000","last_became_active":"2024-09-11T23:25:52.914612+0000","last_became_peered":"2024-09-11T23:25:52.914612+0000","last_unstale":"2024-09-11T23:25:53.939628+0000","last_undegraded":"2024-09-11T23:25:53.939628+0000","last_fullsized":"2024-09-11T23:25:53.939628+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:23.635788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940448+0000","last_change":"2024-09-11T23:25:52.912068+0000","last_active":"2024-09-11T23:25:53.940448+0000","last_peered":"2024-09-11T23:25:53.940448+0000","last_clean":"2024-09-11T23:25:53.940448+0000","last_became_active":"2024-09-11T23:25:52.911672+0000","last_became_peered":"2024-09-11T23:25:52.911672+0000","last_unstale":"2024-09-11T23:25:53.940448+0000","last_undegraded":"2024-09-11T23:25:53.940448+0000","last_fullsized":"2024-09-11T23:25:53.940448+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:27.327036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"152'4","reported_seq":18,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940625+0000","last_change":"2024-09-11T23:25:51.900246+0000","last_active":"2024-09-11T23:25:53.940625+0000","last_peered":"2024-09-11T23:25:53.940625+0000","last_clean":"2024-09-11T23:25:53.940625+0000","last_became_active":"2024-09-11T23:25:51.899859+0000","last_became_peered":"2024-09-11T23:25:51.899859+0000","last_unstale":"2024-09-11T23:25:53.940625+0000","last_undegraded":"2024-09-11T23:25:53.940625+0000","last_fullsized":"2024-09-11T23:25:53.940625+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:45.193635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913505+0000","last_change":"2024-09-11T23:25:52.918859+0000","last_active":"2024-09-11T23:25:53.913505+0000","last_peered":"2024-09-11T23:25:53.913505+0000","last_clean":"2024-09-11T23:25:53.913505+0000","last_became_active":"2024-09-11T23:25:52.917555+0000","last_became_peered":"2024-09-11T23:25:52.917555+0000","last_unstale":"2024-09-11T23:25:53.913505+0000","last_undegraded":"2024-09-11T23:25:53.913505+0000","last_fullsized":"2024-09-11T23:25:53.913505+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:04.263795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"152'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918693+0000","last_change":"2024-09-11T23:25:51.895918+0000","last_active":"2024-09-11T23:25:53.918693+0000","last_peered":"2024-09-11T23:25:53.918693+0000","last_clean":"2024-09-11T23:25:53.918693+0000","last_became_active":"2024-09-11T23:25:51.895056+0000","last_became_peered":"2024-09-11T23:25:51.895056+0000","last_unstale":"2024-09-11T23:25:53.918693+0000","last_undegraded":"2024-09-11T23:25:53.918693+0000","last_fullsized":"2024-09-11T23:25:53.918693+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:07:58.939704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918782+0000","last_change":"2024-09-11T23:25:52.913059+0000","last_active":"2024-09-11T23:25:53.918782+0000","last_peered":"2024-09-11T23:25:53.918782+0000","last_clean":"2024-09-11T23:25:53.918782+0000","last_became_active":"2024-09-11T23:25:52.912768+0000","last_became_peered":"2024-09-11T23:25:52.912768+0000","last_unstale":"2024-09-11T23:25:53.918782+0000","last_undegraded":"2024-09-11T23:25:53.918782+0000","last_fullsized":"2024-09-11T23:25:53.918782+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:38.933101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929643+0000","last_change":"2024-09-11T23:25:51.907726+0000","last_active":"2024-09-11T23:25:53.929643+0000","last_peered":"2024-09-11T23:25:53.929643+0000","last_clean":"2024-09-11T23:25:53.929643+0000","last_became_active":"2024-09-11T23:25:51.907462+0000","last_became_peered":"2024-09-11T23:25:51.907462+0000","last_unstale":"2024-09-11T23:25:53.929643+0000","last_undegraded":"2024-09-11T23:25:53.929643+0000","last_fullsized":"2024-09-11T23:25:53.929643+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:47.482325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.919110+0000","last_change":"2024-09-11T23:25:52.907420+0000","last_active":"2024-09-11T23:25:53.919110+0000","last_peered":"2024-09-11T23:25:53.919110+0000","last_clean":"2024-09-11T23:25:53.919110+0000","last_became_active":"2024-09-11T23:25:52.907112+0000","last_became_peered":"2024-09-11T23:25:52.907112+0000","last_unstale":"2024-09-11T23:25:53.919110+0000","last_undegraded":"2024-09-11T23:25:53.919110+0000","last_fullsized":"2024-09-11T23:25:53.919110+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:48.999180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.941235+0000","last_change":"2024-09-11T23:25:51.896878+0000","last_active":"2024-09-11T23:25:53.941235+0000","last_peered":"2024-09-11T23:25:53.941235+0000","last_clean":"2024-09-11T23:25:53.941235+0000","last_became_active":"2024-09-11T23:25:51.896515+0000","last_became_peered":"2024-09-11T23:25:51.896515+0000","last_unstale":"2024-09-11T23:25:53.941235+0000","last_undegraded":"2024-09-11T23:25:53.941235+0000","last_fullsized":"2024-09-11T23:25:53.941235+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:07:58.939704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913168+0000","last_change":"2024-09-11T23:25:52.912929+0000","last_active":"2024-09-11T23:25:53.913168+0000","last_peered":"2024-09-11T23:25:53.913168+0000","last_clean":"2024-09-11T23:25:53.913168+0000","last_became_active":"2024-09-11T23:25:52.912294+0000","last_became_peered":"2024-09-11T23:25:52.912294+0000","last_unstale":"2024-09-11T23:25:53.913168+0000","last_undegraded":"2024-09-11T23:25:53.913168+0000","last_fullsized":"2024-09-11T23:25:53.913168+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:30.149289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"152'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940463+0000","last_change":"2024-09-11T23:25:51.906868+0000","last_active":"2024-09-11T23:25:53.940463+0000","last_peered":"2024-09-11T23:25:53.940463+0000","last_clean":"2024-09-11T23:25:53.940463+0000","last_became_active":"2024-09-11T23:25:51.906559+0000","last_became_peered":"2024-09-11T23:25:51.906559+0000","last_unstale":"2024-09-11T23:25:53.940463+0000","last_undegraded":"2024-09-11T23:25:53.940463+0000","last_fullsized":"2024-09-11T23:25:53.940463+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:53.100459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.939789+0000","last_change":"2024-09-11T23:25:52.920380+0000","last_active":"2024-09-11T23:25:53.939789+0000","last_peered":"2024-09-11T23:25:53.939789+0000","last_clean":"2024-09-11T23:25:53.939789+0000","last_became_active":"2024-09-11T23:25:52.920097+0000","last_became_peered":"2024-09-11T23:25:52.920097+0000","last_unstale":"2024-09-11T23:25:53.939789+0000","last_undegraded":"2024-09-11T23:25:53.939789+0000","last_fullsized":"2024-09-11T23:25:53.939789+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:50.926496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"152'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.939894+0000","last_change":"2024-09-11T23:25:51.900322+0000","last_active":"2024-09-11T23:25:53.939894+0000","last_peered":"2024-09-11T23:25:53.939894+0000","last_clean":"2024-09-11T23:25:53.939894+0000","last_became_active":"2024-09-11T23:25:51.900028+0000","last_became_peered":"2024-09-11T23:25:51.900028+0000","last_unstale":"2024-09-11T23:25:53.939894+0000","last_undegraded":"2024-09-11T23:25:53.939894+0000","last_fullsized":"2024-09-11T23:25:53.939894+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:48.291974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918329+0000","last_change":"2024-09-11T23:25:52.919229+0000","last_active":"2024-09-11T23:25:53.918329+0000","last_peered":"2024-09-11T23:25:53.918329+0000","last_clean":"2024-09-11T23:25:53.918329+0000","last_became_active":"2024-09-11T23:25:52.918949+0000","last_became_peered":"2024-09-11T23:25:52.918949+0000","last_unstale":"2024-09-11T23:25:53.918329+0000","last_undegraded":"2024-09-11T23:25:53.918329+0000","last_fullsized":"2024-09-11T23:25:53.918329+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:22.397789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940061+0000","last_change":"2024-09-11T23:25:51.903876+0000","last_active":"2024-09-11T23:25:53.940061+0000","last_peered":"2024-09-11T23:25:53.940061+0000","last_clean":"2024-09-11T23:25:53.940061+0000","last_became_active":"2024-09-11T23:25:51.903534+0000","last_became_peered":"2024-09-11T23:25:51.903534+0000","last_unstale":"2024-09-11T23:25:53.940061+0000","last_undegraded":"2024-09-11T23:25:53.940061+0000","last_fullsized":"2024-09-11T23:25:53.940061+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:15.271374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929677+0000","last_change":"2024-09-11T23:25:52.919557+0000","last_active":"2024-09-11T23:25:53.929677+0000","last_peered":"2024-09-11T23:25:53.929677+0000","last_clean":"2024-09-11T23:25:53.929677+0000","last_became_active":"2024-09-11T23:25:52.917199+0000","last_became_peered":"2024-09-11T23:25:52.917199+0000","last_unstale":"2024-09-11T23:25:53.929677+0000","last_undegraded":"2024-09-11T23:25:53.929677+0000","last_fullsized":"2024-09-11T23:25:53.929677+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:23.569240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.919167+0000","last_change":"2024-09-11T23:25:51.891786+0000","last_active":"2024-09-11T23:25:53.919167+0000","last_peered":"2024-09-11T23:25:53.919167+0000","last_clean":"2024-09-11T23:25:53.919167+0000","last_became_active":"2024-09-11T23:25:51.891475+0000","last_became_peered":"2024-09-11T23:25:51.891475+0000","last_unstale":"2024-09-11T23:25:53.919167+0000","last_undegraded":"2024-09-11T23:25:53.919167+0000","last_fullsized":"2024-09-11T23:25:53.919167+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:32.491407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940232+0000","last_change":"2024-09-11T23:25:52.919337+0000","last_active":"2024-09-11T23:25:53.940232+0000","last_peered":"2024-09-11T23:25:53.940232+0000","last_clean":"2024-09-11T23:25:53.940232+0000","last_became_active":"2024-09-11T23:25:52.919081+0000","last_became_peered":"2024-09-11T23:25:52.919081+0000","last_unstale":"2024-09-11T23:25:53.940232+0000","last_undegraded":"2024-09-11T23:25:53.940232+0000","last_fullsized":"2024-09-11T23:25:53.940232+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:52.363731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940519+0000","last_change":"2024-09-11T23:25:51.899265+0000","last_active":"2024-09-11T23:25:53.940519+0000","last_peered":"2024-09-11T23:25:53.940519+0000","last_clean":"2024-09-11T23:25:53.940519+0000","last_became_active":"2024-09-11T23:25:51.898966+0000","last_became_peered":"2024-09-11T23:25:51.898966+0000","last_unstale":"2024-09-11T23:25:53.940519+0000","last_undegraded":"2024-09-11T23:25:53.940519+0000","last_fullsized":"2024-09-11T23:25:53.940519+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:41.655379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918869+0000","last_change":"2024-09-11T23:25:52.911624+0000","last_active":"2024-09-11T23:25:53.918869+0000","last_peered":"2024-09-11T23:25:53.918869+0000","last_clean":"2024-09-11T23:25:53.918869+0000","last_became_active":"2024-09-11T23:25:52.911325+0000","last_became_peered":"2024-09-11T23:25:52.911325+0000","last_unstale":"2024-09-11T23:25:53.918869+0000","last_undegraded":"2024-09-11T23:25:53.918869+0000","last_fullsized":"2024-09-11T23:25:53.918869+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:59.996944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"152'3","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940395+0000","last_change":"2024-09-11T23:25:51.901562+0000","last_active":"2024-09-11T23:25:53.940395+0000","last_peered":"2024-09-11T23:25:53.940395+0000","last_clean":"2024-09-11T23:25:53.940395+0000","last_became_active":"2024-09-11T23:25:51.901297+0000","last_became_peered":"2024-09-11T23:25:51.901297+0000","last_unstale":"2024-09-11T23:25:53.940395+0000","last_undegraded":"2024-09-11T23:25:53.940395+0000","last_fullsized":"2024-09-11T23:25:53.940395+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:38.595431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913381+0000","last_change":"2024-09-11T23:25:52.911052+0000","last_active":"2024-09-11T23:25:53.913381+0000","last_peered":"2024-09-11T23:25:53.913381+0000","last_clean":"2024-09-11T23:25:53.913381+0000","last_became_active":"2024-09-11T23:25:52.910768+0000","last_became_peered":"2024-09-11T23:25:52.910768+0000","last_unstale":"2024-09-11T23:25:53.913381+0000","last_undegraded":"2024-09-11T23:25:53.913381+0000","last_fullsized":"2024-09-11T23:25:53.913381+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:00.530719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"152'6","reported_seq":20,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929451+0000","last_change":"2024-09-11T23:25:51.896849+0000","last_active":"2024-09-11T23:25:53.929451+0000","last_peered":"2024-09-11T23:25:53.929451+0000","last_clean":"2024-09-11T23:25:53.929451+0000","last_became_active":"2024-09-11T23:25:51.896552+0000","last_became_peered":"2024-09-11T23:25:51.896552+0000","last_unstale":"2024-09-11T23:25:53.929451+0000","last_undegraded":"2024-09-11T23:25:53.929451+0000","last_fullsized":"2024-09-11T23:25:53.929451+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:39.520222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929469+0000","last_change":"2024-09-11T23:25:52.915214+0000","last_active":"2024-09-11T23:25:53.929469+0000","last_peered":"2024-09-11T23:25:53.929469+0000","last_clean":"2024-09-11T23:25:53.929469+0000","last_became_active":"2024-09-11T23:25:52.914962+0000","last_became_peered":"2024-09-11T23:25:52.914962+0000","last_unstale":"2024-09-11T23:25:53.929469+0000","last_undegraded":"2024-09-11T23:25:53.929469+0000","last_fullsized":"2024-09-11T23:25:53.929469+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:45.908012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940445+0000","last_change":"2024-09-11T23:25:51.900554+0000","last_active":"2024-09-11T23:25:53.940445+0000","last_peered":"2024-09-11T23:25:53.940445+0000","last_clean":"2024-09-11T23:25:53.940445+0000","last_became_active":"2024-09-11T23:25:51.900100+0000","last_became_peered":"2024-09-11T23:25:51.900100+0000","last_unstale":"2024-09-11T23:25:53.940445+0000","last_undegraded":"2024-09-11T23:25:53.940445+0000","last_fullsized":"2024-09-11T23:25:53.940445+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:52.715185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918692+0000","last_change":"2024-09-11T23:25:52.910618+0000","last_active":"2024-09-11T23:25:53.918692+0000","last_peered":"2024-09-11T23:25:53.918692+0000","last_clean":"2024-09-11T23:25:53.918692+0000","last_became_active":"2024-09-11T23:25:52.910314+0000","last_became_peered":"2024-09-11T23:25:52.910314+0000","last_unstale":"2024-09-11T23:25:53.918692+0000","last_undegraded":"2024-09-11T23:25:53.918692+0000","last_fullsized":"2024-09-11T23:25:53.918692+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:40.526970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913354+0000","last_change":"2024-09-11T23:25:51.906178+0000","last_active":"2024-09-11T23:25:53.913354+0000","last_peered":"2024-09-11T23:25:53.913354+0000","last_clean":"2024-09-11T23:25:53.913354+0000","last_became_active":"2024-09-11T23:25:51.905881+0000","last_became_peered":"2024-09-11T23:25:51.905881+0000","last_unstale":"2024-09-11T23:25:53.913354+0000","last_undegraded":"2024-09-11T23:25:53.913354+0000","last_fullsized":"2024-09-11T23:25:53.913354+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:35.077389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.917762+0000","last_change":"2024-09-11T23:25:52.901720+0000","last_active":"2024-09-11T23:25:53.917762+0000","last_peered":"2024-09-11T23:25:53.917762+0000","last_clean":"2024-09-11T23:25:53.917762+0000","last_became_active":"2024-09-11T23:25:52.901428+0000","last_became_peered":"2024-09-11T23:25:52.901428+0000","last_unstale":"2024-09-11T23:25:53.917762+0000","last_undegraded":"2024-09-11T23:25:53.917762+0000","last_fullsized":"2024-09-11T23:25:53.917762+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:52.161961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.939567+0000","last_change":"2024-09-11T23:25:51.893291+0000","last_active":"2024-09-11T23:25:53.939567+0000","last_peered":"2024-09-11T23:25:53.939567+0000","last_clean":"2024-09-11T23:25:53.939567+0000","last_became_active":"2024-09-11T23:25:51.893049+0000","last_became_peered":"2024-09-11T23:25:51.893049+0000","last_unstale":"2024-09-11T23:25:53.939567+0000","last_undegraded":"2024-09-11T23:25:53.939567+0000","last_fullsized":"2024-09-11T23:25:53.939567+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:08.273889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913072+0000","last_change":"2024-09-11T23:25:52.909508+0000","last_active":"2024-09-11T23:25:53.913072+0000","last_peered":"2024-09-11T23:25:53.913072+0000","last_clean":"2024-09-11T23:25:53.913072+0000","last_became_active":"2024-09-11T23:25:52.904370+0000","last_became_peered":"2024-09-11T23:25:52.904370+0000","last_unstale":"2024-09-11T23:25:53.913072+0000","last_undegraded":"2024-09-11T23:25:53.913072+0000","last_fullsized":"2024-09-11T23:25:53.913072+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:08.639359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"152'8","reported_seq":22,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940510+0000","last_change":"2024-09-11T23:25:51.903877+0000","last_active":"2024-09-11T23:25:53.940510+0000","last_peered":"2024-09-11T23:25:53.940510+0000","last_clean":"2024-09-11T23:25:53.940510+0000","last_became_active":"2024-09-11T23:25:51.903569+0000","last_became_peered":"2024-09-11T23:25:51.903569+0000","last_unstale":"2024-09-11T23:25:53.940510+0000","last_undegraded":"2024-09-11T23:25:53.940510+0000","last_fullsized":"2024-09-11T23:25:53.940510+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:22.562492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913494+0000","last_change":"2024-09-11T23:25:52.909004+0000","last_active":"2024-09-11T23:25:53.913494+0000","last_peered":"2024-09-11T23:25:53.913494+0000","last_clean":"2024-09-11T23:25:53.913494+0000","last_became_active":"2024-09-11T23:25:52.908712+0000","last_became_peered":"2024-09-11T23:25:52.908712+0000","last_unstale":"2024-09-11T23:25:53.913494+0000","last_undegraded":"2024-09-11T23:25:53.913494+0000","last_fullsized":"2024-09-11T23:25:53.913494+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:41.050668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"152'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940714+0000","last_change":"2024-09-11T23:25:51.910694+0000","last_active":"2024-09-11T23:25:53.940714+0000","last_peered":"2024-09-11T23:25:53.940714+0000","last_clean":"2024-09-11T23:25:53.940714+0000","last_became_active":"2024-09-11T23:25:51.910275+0000","last_became_peered":"2024-09-11T23:25:51.910275+0000","last_unstale":"2024-09-11T23:25:53.940714+0000","last_undegraded":"2024-09-11T23:25:53.940714+0000","last_fullsized":"2024-09-11T23:25:53.940714+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:33.689166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.919253+0000","last_change":"2024-09-11T23:25:52.901427+0000","last_active":"2024-09-11T23:25:53.919253+0000","last_peered":"2024-09-11T23:25:53.919253+0000","last_clean":"2024-09-11T23:25:53.919253+0000","last_became_active":"2024-09-11T23:25:52.900976+0000","last_became_peered":"2024-09-11T23:25:52.900976+0000","last_unstale":"2024-09-11T23:25:53.919253+0000","last_undegraded":"2024-09-11T23:25:53.919253+0000","last_fullsized":"2024-09-11T23:25:53.919253+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:48.489073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940544+0000","last_change":"2024-09-11T23:25:51.892571+0000","last_active":"2024-09-11T23:25:53.940544+0000","last_peered":"2024-09-11T23:25:53.940544+0000","last_clean":"2024-09-11T23:25:53.940544+0000","last_became_active":"2024-09-11T23:25:51.891598+0000","last_became_peered":"2024-09-11T23:25:51.891598+0000","last_unstale":"2024-09-11T23:25:53.940544+0000","last_undegraded":"2024-09-11T23:25:53.940544+0000","last_fullsized":"2024-09-11T23:25:53.940544+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:59.728275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918364+0000","last_change":"2024-09-11T23:25:52.918012+0000","last_active":"2024-09-11T23:25:53.918364+0000","last_peered":"2024-09-11T23:25:53.918364+0000","last_clean":"2024-09-11T23:25:53.918364+0000","last_became_active":"2024-09-11T23:25:52.917726+0000","last_became_peered":"2024-09-11T23:25:52.917726+0000","last_unstale":"2024-09-11T23:25:53.918364+0000","last_undegraded":"2024-09-11T23:25:53.918364+0000","last_fullsized":"2024-09-11T23:25:53.918364+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:37.136434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"152'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940928+0000","last_change":"2024-09-11T23:25:51.905354+0000","last_active":"2024-09-11T23:25:53.940928+0000","last_peered":"2024-09-11T23:25:53.940928+0000","last_clean":"2024-09-11T23:25:53.940928+0000","last_became_active":"2024-09-11T23:25:51.905072+0000","last_became_peered":"2024-09-11T23:25:51.905072+0000","last_unstale":"2024-09-11T23:25:53.940928+0000","last_undegraded":"2024-09-11T23:25:53.940928+0000","last_fullsized":"2024-09-11T23:25:53.940928+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:27.311516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.941095+0000","last_change":"2024-09-11T23:25:52.912013+0000","last_active":"2024-09-11T23:25:53.941095+0000","last_peered":"2024-09-11T23:25:53.941095+0000","last_clean":"2024-09-11T23:25:53.941095+0000","last_became_active":"2024-09-11T23:25:52.911773+0000","last_became_peered":"2024-09-11T23:25:52.911773+0000","last_unstale":"2024-09-11T23:25:53.941095+0000","last_undegraded":"2024-09-11T23:25:53.941095+0000","last_fullsized":"2024-09-11T23:25:53.941095+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:22.397789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918881+0000","last_change":"2024-09-11T23:25:51.887367+0000","last_active":"2024-09-11T23:25:53.918881+0000","last_peered":"2024-09-11T23:25:53.918881+0000","last_clean":"2024-09-11T23:25:53.918881+0000","last_became_active":"2024-09-11T23:25:51.887017+0000","last_became_peered":"2024-09-11T23:25:51.887017+0000","last_unstale":"2024-09-11T23:25:53.918881+0000","last_undegraded":"2024-09-11T23:25:53.918881+0000","last_fullsized":"2024-09-11T23:25:53.918881+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:44.703359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913218+0000","last_change":"2024-09-11T23:25:52.919254+0000","last_active":"2024-09-11T23:25:53.913218+0000","last_peered":"2024-09-11T23:25:53.913218+0000","last_clean":"2024-09-11T23:25:53.913218+0000","last_became_active":"2024-09-11T23:25:52.918167+0000","last_became_peered":"2024-09-11T23:25:52.918167+0000","last_unstale":"2024-09-11T23:25:53.913218+0000","last_undegraded":"2024-09-11T23:25:53.913218+0000","last_fullsized":"2024-09-11T23:25:53.913218+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:47.015634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929325+0000","last_change":"2024-09-11T23:25:51.899337+0000","last_active":"2024-09-11T23:25:53.929325+0000","last_peered":"2024-09-11T23:25:53.929325+0000","last_clean":"2024-09-11T23:25:53.929325+0000","last_became_active":"2024-09-11T23:25:51.899015+0000","last_became_peered":"2024-09-11T23:25:51.899015+0000","last_unstale":"2024-09-11T23:25:53.929325+0000","last_undegraded":"2024-09-11T23:25:53.929325+0000","last_fullsized":"2024-09-11T23:25:53.929325+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:21.391041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918703+0000","last_change":"2024-09-11T23:25:52.910751+0000","last_active":"2024-09-11T23:25:53.918703+0000","last_peered":"2024-09-11T23:25:53.918703+0000","last_clean":"2024-09-11T23:25:53.918703+0000","last_became_active":"2024-09-11T23:25:52.910470+0000","last_became_peered":"2024-09-11T23:25:52.910470+0000","last_unstale":"2024-09-11T23:25:53.918703+0000","last_undegraded":"2024-09-11T23:25:53.918703+0000","last_fullsized":"2024-09-11T23:25:53.918703+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:40.769361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940108+0000","last_change":"2024-09-11T23:25:51.900424+0000","last_active":"2024-09-11T23:25:53.940108+0000","last_peered":"2024-09-11T23:25:53.940108+0000","last_clean":"2024-09-11T23:25:53.940108+0000","last_became_active":"2024-09-11T23:25:51.900158+0000","last_became_peered":"2024-09-11T23:25:51.900158+0000","last_unstale":"2024-09-11T23:25:53.940108+0000","last_undegraded":"2024-09-11T23:25:53.940108+0000","last_fullsized":"2024-09-11T23:25:53.940108+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:20.269934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940121+0000","last_change":"2024-09-11T23:25:52.920380+0000","last_active":"2024-09-11T23:25:53.940121+0000","last_peered":"2024-09-11T23:25:53.940121+0000","last_clean":"2024-09-11T23:25:53.940121+0000","last_became_active":"2024-09-11T23:25:52.920095+0000","last_became_peered":"2024-09-11T23:25:52.920095+0000","last_unstale":"2024-09-11T23:25:53.940121+0000","last_undegraded":"2024-09-11T23:25:53.940121+0000","last_fullsized":"2024-09-11T23:25:53.940121+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:50.787977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929385+0000","last_change":"2024-09-11T23:25:51.901075+0000","last_active":"2024-09-11T23:25:53.929385+0000","last_peered":"2024-09-11T23:25:53.929385+0000","last_clean":"2024-09-11T23:25:53.929385+0000","last_became_active":"2024-09-11T23:25:51.900780+0000","last_became_peered":"2024-09-11T23:25:51.900780+0000","last_unstale":"2024-09-11T23:25:53.929385+0000","last_undegraded":"2024-09-11T23:25:53.929385+0000","last_fullsized":"2024-09-11T23:25:53.929385+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:47.992432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.939679+0000","last_change":"2024-09-11T23:25:52.916565+0000","last_active":"2024-09-11T23:25:53.939679+0000","last_peered":"2024-09-11T23:25:53.939679+0000","last_clean":"2024-09-11T23:25:53.939679+0000","last_became_active":"2024-09-11T23:25:52.916300+0000","last_became_peered":"2024-09-11T23:25:52.916300+0000","last_unstale":"2024-09-11T23:25:53.939679+0000","last_undegraded":"2024-09-11T23:25:53.939679+0000","last_fullsized":"2024-09-11T23:25:53.939679+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:51.958578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.917737+0000","last_change":"2024-09-11T23:25:51.893776+0000","last_active":"2024-09-11T23:25:53.917737+0000","last_peered":"2024-09-11T23:25:53.917737+0000","last_clean":"2024-09-11T23:25:53.917737+0000","last_became_active":"2024-09-11T23:25:51.893477+0000","last_became_peered":"2024-09-11T23:25:51.893477+0000","last_unstale":"2024-09-11T23:25:53.917737+0000","last_undegraded":"2024-09-11T23:25:53.917737+0000","last_fullsized":"2024-09-11T23:25:53.917737+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:44.889964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940434+0000","last_change":"2024-09-11T23:25:52.914304+0000","last_active":"2024-09-11T23:25:53.940434+0000","last_peered":"2024-09-11T23:25:53.940434+0000","last_clean":"2024-09-11T23:25:53.940434+0000","last_became_active":"2024-09-11T23:25:52.913981+0000","last_became_peered":"2024-09-11T23:25:52.913981+0000","last_unstale":"2024-09-11T23:25:53.940434+0000","last_undegraded":"2024-09-11T23:25:53.940434+0000","last_fullsized":"2024-09-11T23:25:53.940434+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:06.680885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"152'2","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940707+0000","last_change":"2024-09-11T23:25:51.900937+0000","last_active":"2024-09-11T23:25:53.940707+0000","last_peered":"2024-09-11T23:25:53.940707+0000","last_clean":"2024-09-11T23:25:53.940707+0000","last_became_active":"2024-09-11T23:25:51.900594+0000","last_became_peered":"2024-09-11T23:25:51.900594+0000","last_unstale":"2024-09-11T23:25:53.940707+0000","last_undegraded":"2024-09-11T23:25:53.940707+0000","last_fullsized":"2024-09-11T23:25:53.940707+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:53.452192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913522+0000","last_change":"2024-09-11T23:25:52.919185+0000","last_active":"2024-09-11T23:25:53.913522+0000","last_peered":"2024-09-11T23:25:53.913522+0000","last_clean":"2024-09-11T23:25:53.913522+0000","last_became_active":"2024-09-11T23:25:52.918589+0000","last_became_peered":"2024-09-11T23:25:52.918589+0000","last_unstale":"2024-09-11T23:25:53.913522+0000","last_undegraded":"2024-09-11T23:25:53.913522+0000","last_fullsized":"2024-09-11T23:25:53.913522+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:12.746930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"153'1","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.928683+0000","last_change":"2024-09-11T23:25:51.905553+0000","last_active":"2024-09-11T23:25:53.928683+0000","last_peered":"2024-09-11T23:25:53.928683+0000","last_clean":"2024-09-11T23:25:53.928683+0000","last_became_active":"2024-09-11T23:25:51.905239+0000","last_became_peered":"2024-09-11T23:25:51.905239+0000","last_unstale":"2024-09-11T23:25:53.928683+0000","last_undegraded":"2024-09-11T23:25:53.928683+0000","last_fullsized":"2024-09-11T23:25:53.928683+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:00.116997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940032+0000","last_change":"2024-09-11T23:25:52.912679+0000","last_active":"2024-09-11T23:25:53.940032+0000","last_peered":"2024-09-11T23:25:53.940032+0000","last_clean":"2024-09-11T23:25:53.940032+0000","last_became_active":"2024-09-11T23:25:52.912197+0000","last_became_peered":"2024-09-11T23:25:52.912197+0000","last_unstale":"2024-09-11T23:25:53.940032+0000","last_undegraded":"2024-09-11T23:25:53.940032+0000","last_fullsized":"2024-09-11T23:25:53.940032+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:31.393436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.913447+0000","last_change":"2024-09-11T23:25:51.903659+0000","last_active":"2024-09-11T23:25:53.913447+0000","last_peered":"2024-09-11T23:25:53.913447+0000","last_clean":"2024-09-11T23:25:53.913447+0000","last_became_active":"2024-09-11T23:25:51.903402+0000","last_became_peered":"2024-09-11T23:25:51.903402+0000","last_unstale":"2024-09-11T23:25:53.913447+0000","last_undegraded":"2024-09-11T23:25:53.913447+0000","last_fullsized":"2024-09-11T23:25:53.913447+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:06.197385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940296+0000","last_change":"2024-09-11T23:25:52.912072+0000","last_active":"2024-09-11T23:25:53.940296+0000","last_peered":"2024-09-11T23:25:53.940296+0000","last_clean":"2024-09-11T23:25:53.940296+0000","last_became_active":"2024-09-11T23:25:52.911802+0000","last_became_peered":"2024-09-11T23:25:52.911802+0000","last_unstale":"2024-09-11T23:25:53.940296+0000","last_undegraded":"2024-09-11T23:25:53.940296+0000","last_fullsized":"2024-09-11T23:25:53.940296+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:57.934305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940627+0000","last_change":"2024-09-11T23:25:51.889658+0000","last_active":"2024-09-11T23:25:53.940627+0000","last_peered":"2024-09-11T23:25:53.940627+0000","last_clean":"2024-09-11T23:25:53.940627+0000","last_became_active":"2024-09-11T23:25:51.888486+0000","last_became_peered":"2024-09-11T23:25:51.888486+0000","last_unstale":"2024-09-11T23:25:53.940627+0000","last_undegraded":"2024-09-11T23:25:53.940627+0000","last_fullsized":"2024-09-11T23:25:53.940627+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:02.942842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940812+0000","last_change":"2024-09-11T23:25:52.917541+0000","last_active":"2024-09-11T23:25:53.940812+0000","last_peered":"2024-09-11T23:25:53.940812+0000","last_clean":"2024-09-11T23:25:53.940812+0000","last_became_active":"2024-09-11T23:25:52.917255+0000","last_became_peered":"2024-09-11T23:25:52.917255+0000","last_unstale":"2024-09-11T23:25:53.940812+0000","last_undegraded":"2024-09-11T23:25:53.940812+0000","last_fullsized":"2024-09-11T23:25:53.940812+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:21.636617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918502+0000","last_change":"2024-09-11T23:25:51.895708+0000","last_active":"2024-09-11T23:25:53.918502+0000","last_peered":"2024-09-11T23:25:53.918502+0000","last_clean":"2024-09-11T23:25:53.918502+0000","last_became_active":"2024-09-11T23:25:51.895259+0000","last_became_peered":"2024-09-11T23:25:51.895259+0000","last_unstale":"2024-09-11T23:25:53.918502+0000","last_undegraded":"2024-09-11T23:25:53.918502+0000","last_fullsized":"2024-09-11T23:25:53.918502+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:28.527458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940296+0000","last_change":"2024-09-11T23:25:52.918407+0000","last_active":"2024-09-11T23:25:53.940296+0000","last_peered":"2024-09-11T23:25:53.940296+0000","last_clean":"2024-09-11T23:25:53.940296+0000","last_became_active":"2024-09-11T23:25:52.917887+0000","last_became_peered":"2024-09-11T23:25:52.917887+0000","last_unstale":"2024-09-11T23:25:53.940296+0000","last_undegraded":"2024-09-11T23:25:53.940296+0000","last_fullsized":"2024-09-11T23:25:53.940296+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:36.373141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.918143+0000","last_change":"2024-09-11T23:25:51.893389+0000","last_active":"2024-09-11T23:25:53.918143+0000","last_peered":"2024-09-11T23:25:53.918143+0000","last_clean":"2024-09-11T23:25:53.918143+0000","last_became_active":"2024-09-11T23:25:51.892003+0000","last_became_peered":"2024-09-11T23:25:51.892003+0000","last_unstale":"2024-09-11T23:25:53.918143+0000","last_undegraded":"2024-09-11T23:25:53.918143+0000","last_fullsized":"2024-09-11T23:25:53.918143+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:15.977587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940179+0000","last_change":"2024-09-11T23:25:52.922162+0000","last_active":"2024-09-11T23:25:53.940179+0000","last_peered":"2024-09-11T23:25:53.940179+0000","last_clean":"2024-09-11T23:25:53.940179+0000","last_became_active":"2024-09-11T23:25:52.918295+0000","last_became_peered":"2024-09-11T23:25:52.918295+0000","last_unstale":"2024-09-11T23:25:53.940179+0000","last_undegraded":"2024-09-11T23:25:53.940179+0000","last_fullsized":"2024-09-11T23:25:53.940179+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:56.157773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940606+0000","last_change":"2024-09-11T23:25:51.894605+0000","last_active":"2024-09-11T23:25:53.940606+0000","last_peered":"2024-09-11T23:25:53.940606+0000","last_clean":"2024-09-11T23:25:53.940606+0000","last_became_active":"2024-09-11T23:25:51.893269+0000","last_became_peered":"2024-09-11T23:25:51.893269+0000","last_unstale":"2024-09-11T23:25:53.940606+0000","last_undegraded":"2024-09-11T23:25:53.940606+0000","last_fullsized":"2024-09-11T23:25:53.940606+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:00:40.566423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.939866+0000","last_change":"2024-09-11T23:25:52.914125+0000","last_active":"2024-09-11T23:25:53.939866+0000","last_peered":"2024-09-11T23:25:53.939866+0000","last_clean":"2024-09-11T23:25:53.939866+0000","last_became_active":"2024-09-11T23:25:52.913667+0000","last_became_peered":"2024-09-11T23:25:52.913667+0000","last_unstale":"2024-09-11T23:25:53.939866+0000","last_undegraded":"2024-09-11T23:25:53.939866+0000","last_fullsized":"2024-09-11T23:25:53.939866+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:01.434871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.929211+0000","last_change":"2024-09-11T23:25:51.906070+0000","last_active":"2024-09-11T23:25:53.929211+0000","last_peered":"2024-09-11T23:25:53.929211+0000","last_clean":"2024-09-11T23:25:53.929211+0000","last_became_active":"2024-09-11T23:25:51.904452+0000","last_became_peered":"2024-09-11T23:25:51.904452+0000","last_unstale":"2024-09-11T23:25:53.929211+0000","last_undegraded":"2024-09-11T23:25:53.929211+0000","last_fullsized":"2024-09-11T23:25:53.929211+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:01.522087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.912916+0000","last_change":"2024-09-11T23:25:52.911223+0000","last_active":"2024-09-11T23:25:53.912916+0000","last_peered":"2024-09-11T23:25:53.912916+0000","last_clean":"2024-09-11T23:25:53.912916+0000","last_became_active":"2024-09-11T23:25:52.909072+0000","last_became_peered":"2024-09-11T23:25:52.909072+0000","last_unstale":"2024-09-11T23:25:53.912916+0000","last_undegraded":"2024-09-11T23:25:53.912916+0000","last_fullsized":"2024-09-11T23:25:53.912916+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:51.872958+0000","last_clean_scrub_stamp":"2024-09-11T23:25:51.872958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:07.142860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940276+0000","last_change":"2024-09-11T23:25:51.897763+0000","last_active":"2024-09-11T23:25:53.940276+0000","last_peered":"2024-09-11T23:25:53.940276+0000","last_clean":"2024-09-11T23:25:53.940276+0000","last_became_active":"2024-09-11T23:25:51.896765+0000","last_became_peered":"2024-09-11T23:25:51.896765+0000","last_unstale":"2024-09-11T23:25:53.940276+0000","last_undegraded":"2024-09-11T23:25:53.940276+0000","last_fullsized":"2024-09-11T23:25:53.940276+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:25:50.866210+0000","last_clean_scrub_stamp":"2024-09-11T23:25:50.866210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:17.826562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":455,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-11T23:25:53.940226+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:25:53.940226+0000","last_peered":"2024-09-11T23:25:53.940226+0000","last_clean":"2024-09-11T23:25:53.940226+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:25:53.940226+0000","last_undegraded":"2024-09-11T23:25:53.940226+0000","last_fullsized":"2024-09-11T23:25:53.940226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476838,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33652,"kb_used_data":2460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338188,"statfs":{"total":96636764160,"available":96602304512,"internally_reserved":0,"allocated":2519040,"data_stored":1435423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476837,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33064,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338776,"statfs":{"total":96636764160,"available":96602906624,"internally_reserved":0,"allocated":1916928,"data_stored":844951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476836,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33068,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338772,"statfs":{"total":96636764160,"available":96602902528,"internally_reserved":0,"allocated":1916928,"data_stored":844951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476836,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33084,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338756,"statfs":{"total":96636764160,"available":96602886144,"internally_reserved":0,"allocated":1933312,"data_stored":847145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542245,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33072,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338768,"statfs":{"total":96636764160,"available":96602898432,"internally_reserved":0,"allocated":1929216,"data_stored":845145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542245,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33072,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338768,"statfs":{"total":96636764160,"available":96602898432,"internally_reserved":0,"allocated":1929216,"data_stored":845645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509541,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33080,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338760,"statfs":{"total":96636764160,"available":96602890240,"internally_reserved":0,"allocated":1929216,"data_stored":846563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509541,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33644,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338196,"statfs":{"total":96636764160,"available":96602312704,"internally_reserved":0,"allocated":2514944,"data_stored":1435341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:25:57.490 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:25:57.490 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:25:57.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.685+0000 7feba3c00640 1 Processor -- start 2024-09-11T23:25:57.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.685+0000 7feba3c00640 1 -- start start 2024-09-11T23:25:57.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.686+0000 7feba3c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb9c0cf5d0 0x7feb9c0cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:57.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.686+0000 7feba3c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb9c0b4240 con 0x7feb9c06d4f0 2024-09-11T23:25:57.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.686+0000 7feba3c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb9c0b4520 con 0x7feb9c145d90 2024-09-11T23:25:57.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.687+0000 7feba3c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7feb9c06d080 con 0x7feb9c0cf5d0 2024-09-11T23:25:57.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.687+0000 7feba1c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7feb9c06d4f0 0x7feb9c06d980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35176/0 (socket says 172.21.15.144:35176) 2024-09-11T23:25:57.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.687+0000 7feba1c00640 1 -- 172.21.15.144:0/3681279205 learned_addr learned my addr 172.21.15.144:0/3681279205 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:57.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.687+0000 7feb9be00640 1 --2- 172.21.15.144:0/3681279205 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb9c0cf5d0 0x7feb9c0cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:57.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.687+0000 7feb9b400640 1 -- 172.21.15.144:0/3681279205 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3760335535 0 0) 0x7feb9c0b4240 con 0x7feb9c06d4f0 2024-09-11T23:25:57.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.687+0000 7feb9b400640 1 -- 172.21.15.144:0/3681279205 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb80003520 con 0x7feb9c06d4f0 2024-09-11T23:25:57.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.687+0000 7feb9b400640 1 -- 172.21.15.144:0/3681279205 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2915864695 0 0) 0x7feb9c0b4520 con 0x7feb9c145d90 2024-09-11T23:25:57.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.687+0000 7feb9b400640 1 -- 172.21.15.144:0/3681279205 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb9c0b4240 con 0x7feb9c145d90 2024-09-11T23:25:57.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.687+0000 7feb9be00640 1 -- 172.21.15.144:0/3681279205 >> v1:172.21.15.165:6789/0 conn(0x7feb9c145d90 legacy=0x7feb9c0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:57.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.687+0000 7feb9be00640 1 -- 172.21.15.144:0/3681279205 >> v1:172.21.15.144:6789/0 conn(0x7feb9c06d4f0 legacy=0x7feb9c06d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:57.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.687+0000 7feb9be00640 1 -- 172.21.15.144:0/3681279205 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9c0b4800 con 0x7feb9c0cf5d0 2024-09-11T23:25:57.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.688+0000 7feb9be00640 1 --2- 172.21.15.144:0/3681279205 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb9c0cf5d0 0x7feb9c0cfa10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feb880097d0 tx=0x7feb8802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7e89832cf2133a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:57.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.689+0000 7feb9b400640 1 -- 172.21.15.144:0/3681279205 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb88037070 con 0x7feb9c0cf5d0 2024-09-11T23:25:57.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.689+0000 7feb9b400640 1 -- 172.21.15.144:0/3681279205 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb88032440 con 0x7feb9c0cf5d0 2024-09-11T23:25:57.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.689+0000 7feb9b400640 1 -- 172.21.15.144:0/3681279205 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb88032810 con 0x7feb9c0cf5d0 2024-09-11T23:25:57.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.689+0000 7feba3c00640 1 -- 172.21.15.144:0/3681279205 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb9c0cf5d0 msgr2=0x7feb9c0cfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:57.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.689+0000 7feba3c00640 1 --2- 172.21.15.144:0/3681279205 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb9c0cf5d0 0x7feb9c0cfa10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feb880097d0 tx=0x7feb8802a210 comp rx=0 tx=0).stop 2024-09-11T23:25:57.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.689+0000 7feba3c00640 1 -- 172.21.15.144:0/3681279205 shutdown_connections 2024-09-11T23:25:57.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.689+0000 7feba3c00640 1 --2- 172.21.15.144:0/3681279205 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb9c0cf5d0 0x7feb9c0cfa10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.689+0000 7feba3c00640 1 -- 172.21.15.144:0/3681279205 >> 172.21.15.144:0/3681279205 conn(0x7feb9c06bba0 msgr2=0x7feb9c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:57.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.689+0000 7feba3c00640 1 -- 172.21.15.144:0/3681279205 shutdown_connections 2024-09-11T23:25:57.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.689+0000 7feba3c00640 1 -- 172.21.15.144:0/3681279205 wait complete. 2024-09-11T23:25:57.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.691+0000 7feba3c00640 1 Processor -- start 2024-09-11T23:25:57.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.691+0000 7feba3c00640 1 -- start start 2024-09-11T23:25:57.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.692+0000 7feba3c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb9c06d4f0 0x7feb9c13d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:57.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.692+0000 7feba3c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb9c0cf5d0 0x7feb9c15bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:57.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.692+0000 7feba3c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb9c145d90 0x7feb9c072310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:57.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.692+0000 7feba3c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feb9c0cd660 con 0x7feb9c06d4f0 2024-09-11T23:25:57.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.692+0000 7feba3c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feb9c0cff50 con 0x7feb9c145d90 2024-09-11T23:25:57.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.692+0000 7feba3c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7feb9c0b5610 con 0x7feb9c0cf5d0 2024-09-11T23:25:57.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.692+0000 7feba1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb9c06d4f0 0x7feb9c13d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:57.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.692+0000 7feba1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb9c06d4f0 0x7feb9c13d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40870/0 (socket says 172.21.15.144:40870) 2024-09-11T23:25:57.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.692+0000 7feba1200640 1 -- 172.21.15.144:0/3860122728 learned_addr learned my addr 172.21.15.144:0/3860122728 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:57.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.693+0000 7feba1200640 1 -- 172.21.15.144:0/3860122728 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb9c0cf5d0 msgr2=0x7feb9c15bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:57.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.693+0000 7feba1c00640 1 --2- 172.21.15.144:0/3860122728 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb9c145d90 0x7feb9c072310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:57.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.693+0000 7feb9be00640 1 --2- 172.21.15.144:0/3860122728 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb9c0cf5d0 0x7feb9c15bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:57.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.693+0000 7feba1200640 1 --2- 172.21.15.144:0/3860122728 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb9c0cf5d0 0x7feb9c15bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.693+0000 7feba1200640 1 -- 172.21.15.144:0/3860122728 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb9c145d90 msgr2=0x7feb9c072310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:57.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.693+0000 7feba1200640 1 --2- 172.21.15.144:0/3860122728 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb9c145d90 0x7feb9c072310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.693+0000 7feba1200640 1 -- 172.21.15.144:0/3860122728 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9c15c400 con 0x7feb9c06d4f0 2024-09-11T23:25:57.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.693+0000 7feba1c00640 1 --2- 172.21.15.144:0/3860122728 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb9c145d90 0x7feb9c072310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:57.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.693+0000 7feb9be00640 1 --2- 172.21.15.144:0/3860122728 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb9c0cf5d0 0x7feb9c15bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:57.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.693+0000 7feba1200640 1 --2- 172.21.15.144:0/3860122728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb9c06d4f0 0x7feb9c13d6a0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00c430 tx=0x7feb8c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:57.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.693+0000 7feb98c00640 1 -- 172.21.15.144:0/3860122728 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c017070 con 0x7feb9c06d4f0 2024-09-11T23:25:57.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.693+0000 7feb98c00640 1 -- 172.21.15.144:0/3860122728 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb8c0052f0 con 0x7feb9c06d4f0 2024-09-11T23:25:57.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.693+0000 7feba3c00640 1 -- 172.21.15.144:0/3860122728 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb9c1e9b30 con 0x7feb9c06d4f0 2024-09-11T23:25:57.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.693+0000 7feb98c00640 1 -- 172.21.15.144:0/3860122728 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c003830 con 0x7feb9c06d4f0 2024-09-11T23:25:57.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.693+0000 7feba3c00640 1 -- 172.21.15.144:0/3860122728 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb9c1ea0f0 con 0x7feb9c06d4f0 2024-09-11T23:25:57.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.694+0000 7feba3c00640 1 -- 172.21.15.144:0/3860122728 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb9c0cd480 con 0x7feb9c06d4f0 2024-09-11T23:25:57.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.695+0000 7feb98c00640 1 -- 172.21.15.144:0/3860122728 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7feb8c01a070 con 0x7feb9c06d4f0 2024-09-11T23:25:57.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.696+0000 7feb98c00640 1 --2- 172.21.15.144:0/3860122728 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7feb7c06c610 0x7feb7c06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:57.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.696+0000 7feb98c00640 1 -- 172.21.15.144:0/3860122728 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7feb8c08b540 con 0x7feb9c06d4f0 2024-09-11T23:25:57.697 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.696+0000 7feb9be00640 1 --2- 172.21.15.144:0/3860122728 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7feb7c06c610 0x7feb7c06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:57.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.697+0000 7feb9be00640 1 --2- 172.21.15.144:0/3860122728 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7feb7c06c610 0x7feb7c06ead0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7feb88034000 tx=0x7feb8802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:57.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.700+0000 7feb98c00640 1 -- 172.21.15.144:0/3860122728 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feb9c0cd480 con 0x7feb9c06d4f0 2024-09-11T23:25:57.943 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.942+0000 7feba3c00640 1 -- 172.21.15.144:0/3860122728 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7feb9c146170 con 0x7feb9c06d4f0 2024-09-11T23:25:57.945 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.945+0000 7feb98c00640 1 -- 172.21.15.144:0/3860122728 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) ==== 190+0+147 (secure 0 0 0) 0x7feb9c15c400 con 0x7feb9c06d4f0 2024-09-11T23:25:57.945 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-11T23:25:57.945 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A== 2024-09-11T23:25:57.946 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-11T23:25:57.946 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-11T23:25:57.946 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:25:57.946 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-11T23:25:57.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.948+0000 7feba3c00640 1 -- 172.21.15.144:0/3860122728 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7feb7c06c610 msgr2=0x7feb7c06ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:57.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.948+0000 7feba3c00640 1 --2- 172.21.15.144:0/3860122728 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7feb7c06c610 0x7feb7c06ead0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7feb88034000 tx=0x7feb8802e000 comp rx=0 tx=0).stop 2024-09-11T23:25:57.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.948+0000 7feba3c00640 1 -- 172.21.15.144:0/3860122728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb9c06d4f0 msgr2=0x7feb9c13d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:57.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.948+0000 7feba3c00640 1 --2- 172.21.15.144:0/3860122728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb9c06d4f0 0x7feb9c13d6a0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00c430 tx=0x7feb8c00c8f0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.948+0000 7feba3c00640 1 -- 172.21.15.144:0/3860122728 shutdown_connections 2024-09-11T23:25:57.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.948+0000 7feba3c00640 1 --2- 172.21.15.144:0/3860122728 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7feb7c06c610 0x7feb7c06ead0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.948+0000 7feba3c00640 1 --2- 172.21.15.144:0/3860122728 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb9c145d90 0x7feb9c072310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.948+0000 7feba3c00640 1 --2- 172.21.15.144:0/3860122728 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7feb9c0cf5d0 0x7feb9c15bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.948+0000 7feba3c00640 1 --2- 172.21.15.144:0/3860122728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb9c06d4f0 0x7feb9c13d6a0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:57.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.948+0000 7feba3c00640 1 -- 172.21.15.144:0/3860122728 >> 172.21.15.144:0/3860122728 conn(0x7feb9c06bba0 msgr2=0x7feb9c0af570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:57.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.948+0000 7feba3c00640 1 -- 172.21.15.144:0/3860122728 shutdown_connections 2024-09-11T23:25:57.949 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:57.948+0000 7feba3c00640 1 -- 172.21.15.144:0/3860122728 wait complete. 2024-09-11T23:25:57.965 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:25:58.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.118+0000 7efe1e400640 1 Processor -- start 2024-09-11T23:25:58.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.118+0000 7efe1e400640 1 -- start start 2024-09-11T23:25:58.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.119+0000 7efe1e400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe1815e640 0x7efe180d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.119+0000 7efe1e400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7efe180d3f60 0x7efe180b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.119+0000 7efe1e400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe1806bee0 con 0x7efe180b6510 2024-09-11T23:25:58.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.119+0000 7efe1e400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7efe1815ea20 con 0x7efe180d3f60 2024-09-11T23:25:58.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.119+0000 7efe1e400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efe1806caf0 con 0x7efe1815e640 2024-09-11T23:25:58.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.120+0000 7efe1d000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe1815e640 0x7efe180d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.120+0000 7efe17e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7efe180d3f60 0x7efe180b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.120+0000 7efe1da00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7efe180b6510 0x7efe180d27c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:47860/0 (socket says 172.21.15.144:47860) 2024-09-11T23:25:58.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.120+0000 7efe1d000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe1815e640 0x7efe180d3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:35148/0 (socket says 172.21.15.144:35148) 2024-09-11T23:25:58.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.120+0000 7efe1da00640 1 -- 172.21.15.144:0/2173235748 learned_addr learned my addr 172.21.15.144:0/2173235748 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:25:58.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.120+0000 7efe1d000640 1 -- 172.21.15.144:0/2173235748 >> v2:172.21.15.165:3300/0 conn(0x7efe180d3f60 msgr2=0x7efe180b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:58.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.120+0000 7efe1d000640 1 --2- 172.21.15.144:0/2173235748 >> v2:172.21.15.165:3300/0 conn(0x7efe180d3f60 0x7efe180b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.120+0000 7efe1d000640 1 -- 172.21.15.144:0/2173235748 >> v1:172.21.15.165:6789/0 conn(0x7efe180b6510 legacy=0x7efe180d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:58.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.120+0000 7efe1d000640 1 -- 172.21.15.144:0/2173235748 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1806c1c0 con 0x7efe1815e640 2024-09-11T23:25:58.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.121+0000 7efe1d000640 1 --2- 172.21.15.144:0/2173235748 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe1815e640 0x7efe180d3a20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0097a0 tx=0x7efe0c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=894360b4a7f8aa04 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:58.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.122+0000 7efe17400640 1 -- 172.21.15.144:0/2173235748 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c037070 con 0x7efe1815e640 2024-09-11T23:25:58.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.122+0000 7efe17400640 1 -- 172.21.15.144:0/2173235748 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe0c032440 con 0x7efe1815e640 2024-09-11T23:25:58.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.122+0000 7efe17400640 1 -- 172.21.15.144:0/2173235748 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c032810 con 0x7efe1815e640 2024-09-11T23:25:58.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.122+0000 7efe1e400640 1 -- 172.21.15.144:0/2173235748 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe1815e640 msgr2=0x7efe180d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:58.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.122+0000 7efe1e400640 1 --2- 172.21.15.144:0/2173235748 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe1815e640 0x7efe180d3a20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0097a0 tx=0x7efe0c02a180 comp rx=0 tx=0).stop 2024-09-11T23:25:58.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.123+0000 7efe1e400640 1 -- 172.21.15.144:0/2173235748 shutdown_connections 2024-09-11T23:25:58.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.123+0000 7efe1e400640 1 --2- 172.21.15.144:0/2173235748 >> v2:172.21.15.165:3300/0 conn(0x7efe180d3f60 0x7efe180b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.123+0000 7efe1e400640 1 --2- 172.21.15.144:0/2173235748 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe1815e640 0x7efe180d3a20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.123+0000 7efe1e400640 1 -- 172.21.15.144:0/2173235748 >> 172.21.15.144:0/2173235748 conn(0x7efe180d0fd0 msgr2=0x7efe180d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:58.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.123+0000 7efe1e400640 1 -- 172.21.15.144:0/2173235748 shutdown_connections 2024-09-11T23:25:58.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.123+0000 7efe1e400640 1 -- 172.21.15.144:0/2173235748 wait complete. 2024-09-11T23:25:58.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.124+0000 7efe1e400640 1 Processor -- start 2024-09-11T23:25:58.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.124+0000 7efe1e400640 1 -- start start 2024-09-11T23:25:58.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.125+0000 7efe1e400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe180b6510 0x7efe181523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.125+0000 7efe1e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe180d3f60 0x7efe181528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.125+0000 7efe1e400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe1815e640 0x7efe1814c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.125+0000 7efe1e400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efe180b8760 con 0x7efe180d3f60 2024-09-11T23:25:58.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.125+0000 7efe1e400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efe1806c780 con 0x7efe180b6510 2024-09-11T23:25:58.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.125+0000 7efe1e400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7efe180b88e0 con 0x7efe1815e640 2024-09-11T23:25:58.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.125+0000 7efe17e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe180d3f60 0x7efe181528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.126+0000 7efe17e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe180d3f60 0x7efe181528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40872/0 (socket says 172.21.15.144:40872) 2024-09-11T23:25:58.128 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.126+0000 7efe17e00640 1 -- 172.21.15.144:0/2805661769 learned_addr learned my addr 172.21.15.144:0/2805661769 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:58.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.126+0000 7efe1d000640 1 --2- 172.21.15.144:0/2805661769 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe180b6510 0x7efe181523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.126+0000 7efe1da00640 1 --2- 172.21.15.144:0/2805661769 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe1815e640 0x7efe1814c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.126+0000 7efe17e00640 1 -- 172.21.15.144:0/2805661769 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe1815e640 msgr2=0x7efe1814c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:58.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.126+0000 7efe17e00640 1 --2- 172.21.15.144:0/2805661769 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe1815e640 0x7efe1814c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.126+0000 7efe17e00640 1 -- 172.21.15.144:0/2805661769 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe180b6510 msgr2=0x7efe181523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:58.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.126+0000 7efe17e00640 1 --2- 172.21.15.144:0/2805661769 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe180b6510 0x7efe181523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.126+0000 7efe17e00640 1 -- 172.21.15.144:0/2805661769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe180ca3c0 con 0x7efe180d3f60 2024-09-11T23:25:58.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.126+0000 7efe17e00640 1 --2- 172.21.15.144:0/2805661769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe180d3f60 0x7efe181528e0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7efe0400e980 tx=0x7efe0400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:58.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.127+0000 7efe14c00640 1 -- 172.21.15.144:0/2805661769 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe04017070 con 0x7efe180d3f60 2024-09-11T23:25:58.129 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.127+0000 7efe14c00640 1 -- 172.21.15.144:0/2805661769 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe0400ca00 con 0x7efe180d3f60 2024-09-11T23:25:58.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.127+0000 7efe1e400640 1 -- 172.21.15.144:0/2805661769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe180ca6a0 con 0x7efe180d3f60 2024-09-11T23:25:58.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.127+0000 7efe14c00640 1 -- 172.21.15.144:0/2805661769 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0400cdd0 con 0x7efe180d3f60 2024-09-11T23:25:58.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.127+0000 7efe1e400640 1 -- 172.21.15.144:0/2805661769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe1814ce90 con 0x7efe180d3f60 2024-09-11T23:25:58.130 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.128+0000 7efe1e400640 1 -- 172.21.15.144:0/2805661769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe18068cd0 con 0x7efe180d3f60 2024-09-11T23:25:58.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.129+0000 7efe14c00640 1 -- 172.21.15.144:0/2805661769 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7efe0401a070 con 0x7efe180d3f60 2024-09-11T23:25:58.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.130+0000 7efe14c00640 1 --2- 172.21.15.144:0/2805661769 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efdf806c610 0x7efdf806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.130+0000 7efe14c00640 1 -- 172.21.15.144:0/2805661769 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7efe0408c4e0 con 0x7efe180d3f60 2024-09-11T23:25:58.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.130+0000 7efe1d000640 1 --2- 172.21.15.144:0/2805661769 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efdf806c610 0x7efdf806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.131 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.131+0000 7efe1d000640 1 --2- 172.21.15.144:0/2805661769 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efdf806c610 0x7efdf806ead0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efe0c034000 tx=0x7efe0c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:58.134 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.134+0000 7efe14c00640 1 -- 172.21.15.144:0/2805661769 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efe18068cd0 con 0x7efe180d3f60 2024-09-11T23:25:58.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.342+0000 7efe1e400640 1 -- 172.21.15.144:0/2805661769 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe180d3630 con 0x7efe180d3f60 2024-09-11T23:25:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.342+0000 7efe14c00640 1 -- 172.21.15.144:0/2805661769 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+5245 (secure 0 0 0) 0x7efe180d3630 con 0x7efe180d3f60 2024-09-11T23:25:58.343 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:25:58.343 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":109,"btime":"2024-09-11T23:25:55:920158+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/2302333712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2302333712},{"type":"v1","addr":"172.21.15.144:6801","nonce":2302333712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104},{"gid":7097,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3051519109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3051519109},{"type":"v1","addr":"172.21.15.165:6834","nonce":3051519109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2403316225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2403316225},{"type":"v1","addr":"172.21.15.165:6835","nonce":2403316225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:25:52.298959+0000","modified":"2024-09-11T23:25:55.324109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8664":{"gid":8664,"name":"c","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/3397068730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3397068730},{"type":"v1","addr":"172.21.15.144:6835","nonce":3397068730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8664,"qdb_cluster":[8664]},"id":12}]} 2024-09-11T23:25:58.343 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 109 2024-09-11T23:25:58.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.344+0000 7efe1e400640 1 -- 172.21.15.144:0/2805661769 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efdf806c610 msgr2=0x7efdf806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:58.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.344+0000 7efe1e400640 1 --2- 172.21.15.144:0/2805661769 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efdf806c610 0x7efdf806ead0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efe0c034000 tx=0x7efe0c02e000 comp rx=0 tx=0).stop 2024-09-11T23:25:58.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.345+0000 7efe1e400640 1 -- 172.21.15.144:0/2805661769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe180d3f60 msgr2=0x7efe181528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:58.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.345+0000 7efe1e400640 1 --2- 172.21.15.144:0/2805661769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe180d3f60 0x7efe181528e0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7efe0400e980 tx=0x7efe0400ee40 comp rx=0 tx=0).stop 2024-09-11T23:25:58.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.345+0000 7efe1e400640 1 -- 172.21.15.144:0/2805661769 shutdown_connections 2024-09-11T23:25:58.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.345+0000 7efe1e400640 1 --2- 172.21.15.144:0/2805661769 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7efdf806c610 0x7efdf806ead0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.345+0000 7efe1e400640 1 --2- 172.21.15.144:0/2805661769 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7efe1815e640 0x7efe1814c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.345+0000 7efe1e400640 1 --2- 172.21.15.144:0/2805661769 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe180d3f60 0x7efe181528e0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.345+0000 7efe1e400640 1 --2- 172.21.15.144:0/2805661769 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efe180b6510 0x7efe181523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.345+0000 7efe1e400640 1 -- 172.21.15.144:0/2805661769 >> 172.21.15.144:0/2805661769 conn(0x7efe180d0fd0 msgr2=0x7efe1815daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:58.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.345+0000 7efe1e400640 1 -- 172.21.15.144:0/2805661769 shutdown_connections 2024-09-11T23:25:58.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.345+0000 7efe1e400640 1 -- 172.21.15.144:0/2805661769 wait complete. 2024-09-11T23:25:58.763 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 109, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:25:52.298959+0000', 'modified': '2024-09-11T23:25:55.324109+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8664}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8664': {'gid': 8664, 'name': 'c', 'rank': 0, 'incarnation': 106, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.144:6835/3397068730', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 3397068730}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 3397068730}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8664, 'qdb_cluster': [8664]} 2024-09-11T23:25:58.764 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:25:58.764 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-11T23:25:58.919 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.918+0000 7f5bbf200640 1 Processor -- start 2024-09-11T23:25:58.920 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.919+0000 7f5bbf200640 1 -- start start 2024-09-11T23:25:58.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.920+0000 7f5bbf200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5bb815c180 0x7f5bb80cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.920+0000 7f5bbf200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f5bb8073120 0x7f5bb8073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.920+0000 7f5bbf200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bb80ce740 con 0x7f5bb80ce230 2024-09-11T23:25:58.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.920+0000 7f5bbf200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f5bb8072640 con 0x7f5bb815c180 2024-09-11T23:25:58.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.920+0000 7f5bbf200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f5bb8072920 con 0x7f5bb8073120 2024-09-11T23:25:58.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.920+0000 7f5bb7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5bb815c180 0x7f5bb80cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.920+0000 7f5bb7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5bb815c180 0x7f5bb80cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40886/0 (socket says 172.21.15.144:40886) 2024-09-11T23:25:58.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.920+0000 7f5bb7e00640 1 -- 172.21.15.144:0/809771038 learned_addr learned my addr 172.21.15.144:0/809771038 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:58.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.920+0000 7f5bbd200640 1 --2- 172.21.15.144:0/809771038 >> v2:172.21.15.165:3300/0 conn(0x7f5bb8073120 0x7f5bb8073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.921+0000 7f5bb7e00640 1 -- 172.21.15.144:0/809771038 >> v2:172.21.15.165:3300/0 conn(0x7f5bb8073120 msgr2=0x7f5bb8073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:58.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.921+0000 7f5bb7e00640 1 --2- 172.21.15.144:0/809771038 >> v2:172.21.15.165:3300/0 conn(0x7f5bb8073120 0x7f5bb8073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.921+0000 7f5bb7e00640 1 -- 172.21.15.144:0/809771038 >> v1:172.21.15.165:6789/0 conn(0x7f5bb80ce230 legacy=0x7f5bb80cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:58.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.921+0000 7f5bb7e00640 1 -- 172.21.15.144:0/809771038 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb8072c00 con 0x7f5bb815c180 2024-09-11T23:25:58.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.921+0000 7f5bbd200640 1 --2- 172.21.15.144:0/809771038 >> v2:172.21.15.165:3300/0 conn(0x7f5bb8073120 0x7f5bb8073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:58.922 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.922+0000 7f5bb7e00640 1 --2- 172.21.15.144:0/809771038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bb815c180 0x7f5bb80cdcf0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f5bb80cd0a0 tx=0x7f5ba802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c54a728e22df1c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:58.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.922+0000 7f5bb6a00640 1 -- 172.21.15.144:0/809771038 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8037070 con 0x7f5bb815c180 2024-09-11T23:25:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.922+0000 7f5bb6a00640 1 -- 172.21.15.144:0/809771038 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba8032440 con 0x7f5bb815c180 2024-09-11T23:25:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.922+0000 7f5bb6a00640 1 -- 172.21.15.144:0/809771038 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8032810 con 0x7f5bb815c180 2024-09-11T23:25:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.922+0000 7f5bbf200640 1 -- 172.21.15.144:0/809771038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bb815c180 msgr2=0x7f5bb80cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.923+0000 7f5bbf200640 1 --2- 172.21.15.144:0/809771038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bb815c180 0x7f5bb80cdcf0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f5bb80cd0a0 tx=0x7f5ba802a200 comp rx=0 tx=0).stop 2024-09-11T23:25:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.923+0000 7f5bbf200640 1 -- 172.21.15.144:0/809771038 shutdown_connections 2024-09-11T23:25:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.923+0000 7f5bbf200640 1 --2- 172.21.15.144:0/809771038 >> v2:172.21.15.165:3300/0 conn(0x7f5bb8073120 0x7f5bb8073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.923+0000 7f5bbf200640 1 --2- 172.21.15.144:0/809771038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bb815c180 0x7f5bb80cdcf0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.923+0000 7f5bbf200640 1 -- 172.21.15.144:0/809771038 >> 172.21.15.144:0/809771038 conn(0x7f5bb8062cc0 msgr2=0x7f5bb806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.923+0000 7f5bbf200640 1 -- 172.21.15.144:0/809771038 shutdown_connections 2024-09-11T23:25:58.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.923+0000 7f5bbf200640 1 -- 172.21.15.144:0/809771038 wait complete. 2024-09-11T23:25:58.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.924+0000 7f5bbf200640 1 Processor -- start 2024-09-11T23:25:58.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.924+0000 7f5bbf200640 1 -- start start 2024-09-11T23:25:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.925+0000 7f5bbf200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bb8073120 0x7f5bb81569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.925+0000 7f5bbf200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bb80ce230 0x7f5bb815b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.925+0000 7f5bbf200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bb815c180 0x7f5bb814fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.925+0000 7f5bbf200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb80cf780 con 0x7f5bb80ce230 2024-09-11T23:25:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.925+0000 7f5bbf200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb80722f0 con 0x7f5bb815c180 2024-09-11T23:25:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.925+0000 7f5bbf200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5bb815c560 con 0x7f5bb8073120 2024-09-11T23:25:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.926+0000 7f5bb7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bb80ce230 0x7f5bb815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.926+0000 7f5bb7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bb80ce230 0x7f5bb815b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40898/0 (socket says 172.21.15.144:40898) 2024-09-11T23:25:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.926+0000 7f5bb7400640 1 -- 172.21.15.144:0/679874375 learned_addr learned my addr 172.21.15.144:0/679874375 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.926+0000 7f5bb7e00640 1 --2- 172.21.15.144:0/679874375 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bb8073120 0x7f5bb81569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.926+0000 7f5bbd200640 1 --2- 172.21.15.144:0/679874375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bb815c180 0x7f5bb814fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.926+0000 7f5bb7400640 1 -- 172.21.15.144:0/679874375 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bb8073120 msgr2=0x7f5bb81569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.926+0000 7f5bb7400640 1 --2- 172.21.15.144:0/679874375 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bb8073120 0x7f5bb81569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.926+0000 7f5bb7400640 1 -- 172.21.15.144:0/679874375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bb815c180 msgr2=0x7f5bb814fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.926+0000 7f5bb7400640 1 --2- 172.21.15.144:0/679874375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bb815c180 0x7f5bb814fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.926+0000 7f5bb7400640 1 -- 172.21.15.144:0/679874375 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb815c8c0 con 0x7f5bb80ce230 2024-09-11T23:25:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.926+0000 7f5bbd200640 1 --2- 172.21.15.144:0/679874375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bb815c180 0x7f5bb814fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:25:58.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.926+0000 7f5bb7400640 1 --2- 172.21.15.144:0/679874375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bb80ce230 0x7f5bb815b090 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f5ba400c3c0 tx=0x7f5ba400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.927+0000 7f5bafe00640 1 -- 172.21.15.144:0/679874375 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba40052d0 con 0x7f5bb80ce230 2024-09-11T23:25:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.927+0000 7f5bafe00640 1 -- 172.21.15.144:0/679874375 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba4005490 con 0x7f5bb80ce230 2024-09-11T23:25:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.927+0000 7f5bafe00640 1 -- 172.21.15.144:0/679874375 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4007260 con 0x7f5bb80ce230 2024-09-11T23:25:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.927+0000 7f5bbf200640 1 -- 172.21.15.144:0/679874375 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb815cba0 con 0x7f5bb80ce230 2024-09-11T23:25:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.927+0000 7f5bbf200640 1 -- 172.21.15.144:0/679874375 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb815d160 con 0x7f5bb80ce230 2024-09-11T23:25:58.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.929+0000 7f5bafe00640 1 -- 172.21.15.144:0/679874375 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f5ba4007400 con 0x7f5bb80ce230 2024-09-11T23:25:58.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.929+0000 7f5bafe00640 1 --2- 172.21.15.144:0/679874375 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5b9806c610 0x7f5b9806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.930+0000 7f5bafe00640 1 -- 172.21.15.144:0/679874375 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f5ba408b4e0 con 0x7f5bb80ce230 2024-09-11T23:25:58.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.930+0000 7f5bb7e00640 1 --2- 172.21.15.144:0/679874375 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5b9806c610 0x7f5b9806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.930+0000 7f5bc2072740 1 Processor -- start 2024-09-11T23:25:58.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.930+0000 7f5bc2072740 1 -- start start 2024-09-11T23:25:58.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.931+0000 7f5bb7e00640 1 --2- 172.21.15.144:0/679874375 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5b9806c610 0x7f5b9806ead0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8034000 tx=0x7f5ba802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:58.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.931+0000 7f5bc2072740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b97cf0 0x557720bdd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.931+0000 7f5bc2072740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557720b954b0 0x557720b980d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.931+0000 7f5bc2072740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720b99480 0x557720b92570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.931+0000 7f5bc2072740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557720af63b0 con 0x557720b97cf0 2024-09-11T23:25:58.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.931+0000 7f5bc2072740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557720afb410 con 0x557720b99480 2024-09-11T23:25:58.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.931+0000 7f5bc2072740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557720aa3620 con 0x557720b954b0 2024-09-11T23:25:58.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.932+0000 7f5bb7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b97cf0 0x557720bdd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.932+0000 7f5bb7400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557720b954b0 0x557720b980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.932+0000 7f5bb7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b97cf0 0x557720bdd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40908/0 (socket says 172.21.15.144:40908) 2024-09-11T23:25:58.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.932+0000 7f5bb7e00640 1 -- 172.21.15.144:0/383737061 learned_addr learned my addr 172.21.15.144:0/383737061 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:58.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.932+0000 7f5bbd200640 1 --2- 172.21.15.144:0/383737061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720b99480 0x557720b92570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.932+0000 7f5bb7e00640 1 -- 172.21.15.144:0/383737061 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557720b954b0 msgr2=0x557720b980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:58.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.932+0000 7f5bb7e00640 1 --2- 172.21.15.144:0/383737061 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557720b954b0 0x557720b980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.932+0000 7f5bb7e00640 1 -- 172.21.15.144:0/383737061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720b99480 msgr2=0x557720b92570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:58.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.932+0000 7f5bb7e00640 1 --2- 172.21.15.144:0/383737061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720b99480 0x557720b92570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.934 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.932+0000 7f5bb7e00640 1 -- 172.21.15.144:0/383737061 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55772080e2d0 con 0x557720b97cf0 2024-09-11T23:25:58.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.932+0000 7f5bb7e00640 1 --2- 172.21.15.144:0/383737061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b97cf0 0x557720bdd490 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f5ba803e040 tx=0x7f5ba802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d44d7b8b086264 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:58.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.933+0000 7f5bacc00640 1 -- 172.21.15.144:0/383737061 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8037040 con 0x557720b97cf0 2024-09-11T23:25:58.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.933+0000 7f5bacc00640 1 -- 172.21.15.144:0/383737061 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba804e070 con 0x557720b97cf0 2024-09-11T23:25:58.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.933+0000 7f5bacc00640 1 -- 172.21.15.144:0/383737061 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba8049480 con 0x557720b97cf0 2024-09-11T23:25:58.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.933+0000 7f5bc2072740 1 -- 172.21.15.144:0/383737061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b97cf0 msgr2=0x557720bdd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:58.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.933+0000 7f5bc2072740 1 --2- 172.21.15.144:0/383737061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b97cf0 0x557720bdd490 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f5ba803e040 tx=0x7f5ba802c000 comp rx=0 tx=0).stop 2024-09-11T23:25:58.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.933+0000 7f5bc2072740 1 -- 172.21.15.144:0/383737061 shutdown_connections 2024-09-11T23:25:58.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.933+0000 7f5bc2072740 1 --2- 172.21.15.144:0/383737061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720b99480 0x557720b92570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.933+0000 7f5bc2072740 1 --2- 172.21.15.144:0/383737061 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557720b954b0 0x557720b980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.933+0000 7f5bc2072740 1 --2- 172.21.15.144:0/383737061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b97cf0 0x557720bdd490 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.933+0000 7f5bc2072740 1 -- 172.21.15.144:0/383737061 >> 172.21.15.144:0/383737061 conn(0x557720b94740 msgr2=0x557720bdc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:58.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.933+0000 7f5bc2072740 1 -- 172.21.15.144:0/383737061 shutdown_connections 2024-09-11T23:25:58.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.934+0000 7f5bc2072740 1 -- 172.21.15.144:0/383737061 wait complete. 2024-09-11T23:25:58.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.934+0000 7f5bc2072740 1 -- start start 2024-09-11T23:25:58.936 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.934+0000 7f5bc2072740 1 Processor -- start 2024-09-11T23:25:58.937 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.935+0000 7f5bc2072740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720b97cf0 0x557720bb5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.935+0000 7f5bc2072740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557720b99480 0x557720bb3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.935+0000 7f5bc2072740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720bb3d40 0x557720be33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.935+0000 7f5bc2072740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557720ab6780 con 0x557720bb3d40 2024-09-11T23:25:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.935+0000 7f5bc2072740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557720af73d0 con 0x557720b97cf0 2024-09-11T23:25:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.935+0000 7f5bc2072740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557720b93be0 con 0x557720b99480 2024-09-11T23:25:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.935+0000 7f5bc2072740 10 client.0 _ll_register_callbacks cb 0x557720af45d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:25:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.936+0000 7f5bb7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720b97cf0 0x557720bb5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.936+0000 7f5bbd200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720bb3d40 0x557720be33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.936+0000 7f5bb7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720b97cf0 0x557720bb5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:35974/0 (socket says 172.21.15.144:35974) 2024-09-11T23:25:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.936+0000 7f5bb7e00640 1 -- 172.21.15.144:0/174908650 learned_addr learned my addr 172.21.15.144:0/174908650 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.936+0000 7f5bb7400640 1 --2- 172.21.15.144:0/174908650 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557720b99480 0x557720bb3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.938 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.936+0000 7f5bbd200640 1 -- 172.21.15.144:0/174908650 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557720b99480 msgr2=0x557720bb3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:58.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.936+0000 7f5bbd200640 1 --2- 172.21.15.144:0/174908650 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557720b99480 0x557720bb3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.936+0000 7f5bbd200640 1 -- 172.21.15.144:0/174908650 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720b97cf0 msgr2=0x557720bb5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:58.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.936+0000 7f5bbd200640 1 --2- 172.21.15.144:0/174908650 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720b97cf0 0x557720bb5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.936+0000 7f5bbd200640 1 -- 172.21.15.144:0/174908650 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577208d86b0 con 0x557720bb3d40 2024-09-11T23:25:58.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.936+0000 7f5bb7e00640 1 --2- 172.21.15.144:0/174908650 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720b97cf0 0x557720bb5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:25:58.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.936+0000 7f5bbd200640 1 --2- 172.21.15.144:0/174908650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720bb3d40 0x557720be33e0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0004320 tx=0x7f5bb00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392e87f6d707705a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:58.939 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.936+0000 7f5ba1600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:25:58.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.978+0000 7f5ba1600640 1 -- 172.21.15.144:0/174908650 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb001a020 con 0x557720bb3d40 2024-09-11T23:25:58.979 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.978+0000 7f5ba1600640 1 -- 172.21.15.144:0/174908650 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f5bb0007de0 con 0x557720bb3d40 2024-09-11T23:25:58.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.978+0000 7f5bc2072740 1 -- 172.21.15.144:0/174908650 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ba804e070 con 0x557720bb3d40 2024-09-11T23:25:58.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.978+0000 7f5ba1600640 1 -- 172.21.15.144:0/174908650 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) ==== 24+0+0 (secure 0 0 0) 0x7f5bb0024050 con 0x557720bb3d40 2024-09-11T23:25:58.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.978+0000 7f5bc2072740 10 client.8787 fetch_fsmap learned FSMap version 109 2024-09-11T23:25:58.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.978+0000 7f5bc2072740 1 -- 172.21.15.144:0/174908650 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) -- 0x557720bc1410 con 0x557720bb3d40 2024-09-11T23:25:58.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.978+0000 7f5ba1600640 1 -- 172.21.15.144:0/174908650 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba804e070 con 0x557720bb3d40 2024-09-11T23:25:58.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.978+0000 7f5ba1600640 1 -- 172.21.15.144:0/174908650 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 109) ==== 3502+0+0 (secure 0 0 0) 0x7f5bb0027020 con 0x557720bb3d40 2024-09-11T23:25:58.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.978+0000 7f5bc2072740 10 client.8787 fetch_fsmap finished waiting for FSMap version 109 2024-09-11T23:25:58.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.978+0000 7f5bc2072740 10 client.8787 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:25:58.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.979+0000 7f5bc2072740 20 client.8787 populate_metadata read hostname 'smithi144' 2024-09-11T23:25:58.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.979+0000 7f5bc2072740 1 --2- 172.21.15.144:0/174908650 >> [v2:172.21.15.144:6834/3397068730,v1:172.21.15.144:6835/3397068730] conn(0x557720bfcda0 0x557720bff190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:58.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.979+0000 7f5bc2072740 4 client.8787 mds_command: new command op to 8664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:25:58.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.979+0000 7f5bc2072740 1 -- 172.21.15.144:0/174908650 --> [v2:172.21.15.144:6834/3397068730,v1:172.21.15.144:6835/3397068730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557720b08b40 con 0x557720bfcda0 2024-09-11T23:25:58.980 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.979+0000 7f5bb7e00640 1 --2- 172.21.15.144:0/174908650 >> [v2:172.21.15.144:6834/3397068730,v1:172.21.15.144:6835/3397068730] conn(0x557720bfcda0 0x557720bff190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:58.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.979+0000 7f5bb7e00640 1 --2- 172.21.15.144:0/174908650 >> [v2:172.21.15.144:6834/3397068730,v1:172.21.15.144:6835/3397068730] conn(0x557720bfcda0 0x557720bff190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5eecbbfc94ced4f server_cookie=c3851ceb2249f5f9 in_seq=0 out_seq=0 2024-09-11T23:25:58.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.979+0000 7f5ba1600640 10 client.8787 ms_handle_connect on v2:172.21.15.144:6834/3397068730 2024-09-11T23:25:58.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.980+0000 7f5ba1600640 1 -- 172.21.15.144:0/174908650 <== mds.0 v2:172.21.15.144:6834/3397068730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557720b08b40 con 0x557720bfcda0 2024-09-11T23:25:58.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.980+0000 7f5ba1600640 10 client.8787 handle_command_reply: tid=0 2024-09-11T23:25:58.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.980+0000 7f5bc2072740 1 client.8787 shutdown 2024-09-11T23:25:58.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.981+0000 7f5bc2072740 1 -- 172.21.15.144:0/174908650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720bb3d40 msgr2=0x557720be33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:58.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.981+0000 7f5bc2072740 1 --2- 172.21.15.144:0/174908650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720bb3d40 0x557720be33e0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0004320 tx=0x7f5bb00047e0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.981+0000 7f5bc2072740 1 -- 172.21.15.144:0/174908650 shutdown_connections 2024-09-11T23:25:58.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.981+0000 7f5bc2072740 1 --2- 172.21.15.144:0/174908650 >> [v2:172.21.15.144:6834/3397068730,v1:172.21.15.144:6835/3397068730] conn(0x557720bfcda0 0x557720bff190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.981+0000 7f5bc2072740 1 --2- 172.21.15.144:0/174908650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720bb3d40 0x557720be33e0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.981+0000 7f5bc2072740 1 --2- 172.21.15.144:0/174908650 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557720b99480 0x557720bb3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.981+0000 7f5bc2072740 1 --2- 172.21.15.144:0/174908650 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720b97cf0 0x557720bb5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:58.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.981+0000 7f5ba1600640 0 client.8787 ms_handle_reset on v2:172.21.15.144:6834/3397068730 2024-09-11T23:25:58.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.981+0000 7f5bc2072740 1 -- 172.21.15.144:0/174908650 >> 172.21.15.144:0/174908650 conn(0x557720b954b0 msgr2=0x557720bdbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:58.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.981+0000 7f5bc2072740 1 -- 172.21.15.144:0/174908650 shutdown_connections 2024-09-11T23:25:58.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.981+0000 7f5bc2072740 1 -- 172.21.15.144:0/174908650 wait complete. 2024-09-11T23:25:58.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.981+0000 7f5bc2072740 20 client.8787 trim_cache size 0 max 16384 2024-09-11T23:25:59.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.999+0000 7f5bc2072740 1 Processor -- start 2024-09-11T23:25:59.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:58.999+0000 7f5bc2072740 1 -- start start 2024-09-11T23:25:59.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.000+0000 7f5bc2072740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720b97cf0 0x557720be2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:59.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.000+0000 7f5bc2072740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b99480 0x557720bde4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:59.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.000+0000 7f5bc2072740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557720bb3d40 0x557720bdea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:59.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.000+0000 7f5bc2072740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb815df60 con 0x557720b99480 2024-09-11T23:25:59.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.000+0000 7f5bc2072740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb80b4840 con 0x557720b97cf0 2024-09-11T23:25:59.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.000+0000 7f5bc2072740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f5bb80b4e90 con 0x557720bb3d40 2024-09-11T23:25:59.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.000+0000 7f5bb7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b99480 0x557720bde4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:59.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.001+0000 7f5bb7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b99480 0x557720bde4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40922/0 (socket says 172.21.15.144:40922) 2024-09-11T23:25:59.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.001+0000 7f5bb7400640 1 -- 172.21.15.144:0/2849147427 learned_addr learned my addr 172.21.15.144:0/2849147427 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:59.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.001+0000 7f5bb7e00640 1 --2- 172.21.15.144:0/2849147427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720b97cf0 0x557720be2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:59.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.001+0000 7f5bbd200640 1 --2- 172.21.15.144:0/2849147427 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557720bb3d40 0x557720bdea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:59.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.001+0000 7f5bb7400640 1 -- 172.21.15.144:0/2849147427 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557720bb3d40 msgr2=0x557720bdea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:59.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.001+0000 7f5bb7400640 1 --2- 172.21.15.144:0/2849147427 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557720bb3d40 0x557720bdea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.001+0000 7f5bb7400640 1 -- 172.21.15.144:0/2849147427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720b97cf0 msgr2=0x557720be2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:59.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.001+0000 7f5bb7400640 1 --2- 172.21.15.144:0/2849147427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720b97cf0 0x557720be2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.001+0000 7f5bb7400640 1 -- 172.21.15.144:0/2849147427 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557720bdab80 con 0x557720b99480 2024-09-11T23:25:59.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.001+0000 7f5bb7400640 1 --2- 172.21.15.144:0/2849147427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b99480 0x557720bde4c0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f5ba400c390 tx=0x7f5ba408b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8acde77d7e5fea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:59.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.001+0000 7f5ba3e00640 1 -- 172.21.15.144:0/2849147427 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba405f0c0 con 0x557720b99480 2024-09-11T23:25:59.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.001+0000 7f5ba3e00640 1 -- 172.21.15.144:0/2849147427 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba4070020 con 0x557720b99480 2024-09-11T23:25:59.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.001+0000 7f5ba3e00640 1 -- 172.21.15.144:0/2849147427 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4061190 con 0x557720b99480 2024-09-11T23:25:59.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.002+0000 7f5bc2072740 1 -- 172.21.15.144:0/2849147427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b99480 msgr2=0x557720bde4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:59.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.002+0000 7f5bc2072740 1 --2- 172.21.15.144:0/2849147427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b99480 0x557720bde4c0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f5ba400c390 tx=0x7f5ba408b040 comp rx=0 tx=0).stop 2024-09-11T23:25:59.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.002+0000 7f5bc2072740 1 -- 172.21.15.144:0/2849147427 shutdown_connections 2024-09-11T23:25:59.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.002+0000 7f5bc2072740 1 --2- 172.21.15.144:0/2849147427 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557720bb3d40 0x557720bdea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.002+0000 7f5bc2072740 1 --2- 172.21.15.144:0/2849147427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b99480 0x557720bde4c0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.002+0000 7f5bc2072740 1 --2- 172.21.15.144:0/2849147427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720b97cf0 0x557720be2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.002+0000 7f5bc2072740 1 -- 172.21.15.144:0/2849147427 >> 172.21.15.144:0/2849147427 conn(0x557720b954b0 msgr2=0x557720bb4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:59.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.002+0000 7f5bc2072740 1 -- 172.21.15.144:0/2849147427 shutdown_connections 2024-09-11T23:25:59.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.002+0000 7f5bc2072740 1 -- 172.21.15.144:0/2849147427 wait complete. 2024-09-11T23:25:59.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.003+0000 7f5bc2072740 1 -- start start 2024-09-11T23:25:59.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.003+0000 7f5bc2072740 1 Processor -- start 2024-09-11T23:25:59.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.004+0000 7f5bc2072740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557720b97cf0 0x557720c450e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:59.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.004+0000 7f5bc2072740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b99480 0x557720bde4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:59.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.004+0000 7f5bc2072740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720bb3d40 0x557720bdea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:59.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.004+0000 7f5bc2072740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557720be4050 con 0x557720b99480 2024-09-11T23:25:59.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.004+0000 7f5bc2072740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557720bc1990 con 0x557720bb3d40 2024-09-11T23:25:59.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.004+0000 7f5bc2072740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x557720be1570 con 0x557720b97cf0 2024-09-11T23:25:59.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.004+0000 7f5bc2072740 10 client.0 _ll_register_callbacks cb 0x7f5bb0009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:25:59.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.004+0000 7f5bb7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b99480 0x557720bde4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:59.008 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.004+0000 7f5bb7400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b99480 0x557720bde4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40932/0 (socket says 172.21.15.144:40932) 2024-09-11T23:25:59.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.004+0000 7f5bb7400640 1 -- 172.21.15.144:0/1723013023 learned_addr learned my addr 172.21.15.144:0/1723013023 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:59.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.004+0000 7f5bb7e00640 1 --2- 172.21.15.144:0/1723013023 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557720b97cf0 0x557720c450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:59.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.004+0000 7f5bbd200640 1 --2- 172.21.15.144:0/1723013023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720bb3d40 0x557720bdea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:59.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.005+0000 7f5bb7400640 1 -- 172.21.15.144:0/1723013023 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557720b97cf0 msgr2=0x557720c450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:59.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.005+0000 7f5bb7400640 1 --2- 172.21.15.144:0/1723013023 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557720b97cf0 0x557720c450e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.005+0000 7f5bb7400640 1 -- 172.21.15.144:0/1723013023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720bb3d40 msgr2=0x557720bdea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:59.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.005+0000 7f5bb7400640 1 --2- 172.21.15.144:0/1723013023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720bb3d40 0x557720bdea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.005+0000 7f5bb7400640 1 -- 172.21.15.144:0/1723013023 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557720be8070 con 0x557720b99480 2024-09-11T23:25:59.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.005+0000 7f5bb7400640 1 --2- 172.21.15.144:0/1723013023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b99480 0x557720bde4c0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f5ba400cd80 tx=0x7f5ba4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694df96d572e94c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:59.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.005+0000 7f5ba1600640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:25:59.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.005+0000 7f5ba1600640 1 -- 172.21.15.144:0/1723013023 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4075060 con 0x557720b99480 2024-09-11T23:25:59.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.005+0000 7f5ba1600640 1 -- 172.21.15.144:0/1723013023 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f5ba4061160 con 0x557720b99480 2024-09-11T23:25:59.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.005+0000 7f5bc2072740 1 -- 172.21.15.144:0/1723013023 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ba4070020 con 0x557720b99480 2024-09-11T23:25:59.009 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.005+0000 7f5ba1600640 1 -- 172.21.15.144:0/1723013023 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) ==== 24+0+0 (secure 0 0 0) 0x7f5ba4001080 con 0x557720b99480 2024-09-11T23:25:59.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.005+0000 7f5bc2072740 10 client.8793 fetch_fsmap learned FSMap version 109 2024-09-11T23:25:59.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.005+0000 7f5bc2072740 1 -- 172.21.15.144:0/1723013023 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) -- 0x557720bdca20 con 0x557720b99480 2024-09-11T23:25:59.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.005+0000 7f5ba1600640 1 -- 172.21.15.144:0/1723013023 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba4070020 con 0x557720b99480 2024-09-11T23:25:59.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.005+0000 7f5ba1600640 1 -- 172.21.15.144:0/1723013023 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 109) ==== 3502+0+0 (secure 0 0 0) 0x7f5ba4077ba0 con 0x557720b99480 2024-09-11T23:25:59.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.006+0000 7f5bc2072740 10 client.8793 fetch_fsmap finished waiting for FSMap version 109 2024-09-11T23:25:59.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.006+0000 7f5bc2072740 10 client.8793 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-11T23:25:59.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.006+0000 7f5bc2072740 20 client.8793 populate_metadata read hostname 'smithi144' 2024-09-11T23:25:59.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.006+0000 7f5bc2072740 1 --2- 172.21.15.144:0/1723013023 >> [v2:172.21.15.144:6834/3397068730,v1:172.21.15.144:6835/3397068730] conn(0x557720be9b50 0x557720be9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:59.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.006+0000 7f5bc2072740 4 client.8793 mds_command: new command op to 8664 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:25:59.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.006+0000 7f5bc2072740 1 -- 172.21.15.144:0/1723013023 --> [v2:172.21.15.144:6834/3397068730,v1:172.21.15.144:6835/3397068730] -- command(tid 0: {"prefix": "status"}) -- 0x557720b02e90 con 0x557720be9b50 2024-09-11T23:25:59.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.006+0000 7f5bb7e00640 1 --2- 172.21.15.144:0/1723013023 >> [v2:172.21.15.144:6834/3397068730,v1:172.21.15.144:6835/3397068730] conn(0x557720be9b50 0x557720be9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:59.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.006+0000 7f5bb7e00640 1 --2- 172.21.15.144:0/1723013023 >> [v2:172.21.15.144:6834/3397068730,v1:172.21.15.144:6835/3397068730] conn(0x557720be9b50 0x557720be9f30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a8213dab9c32b26 server_cookie=2e932d7946d104b2 in_seq=0 out_seq=0 2024-09-11T23:25:59.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.006+0000 7f5ba1600640 10 client.8793 ms_handle_connect on v2:172.21.15.144:6834/3397068730 2024-09-11T23:25:59.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.006+0000 7f5ba1600640 1 -- 172.21.15.144:0/1723013023 <== mds.0 v2:172.21.15.144:6834/3397068730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x557720b02e90 con 0x557720be9b50 2024-09-11T23:25:59.010 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.006+0000 7f5ba1600640 10 client.8793 handle_command_reply: tid=0 2024-09-11T23:25:59.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.006+0000 7f5bc2072740 1 client.8793 shutdown 2024-09-11T23:25:59.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.007+0000 7f5bc2072740 1 -- 172.21.15.144:0/1723013023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b99480 msgr2=0x557720bde4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:59.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.007+0000 7f5bc2072740 1 --2- 172.21.15.144:0/1723013023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b99480 0x557720bde4c0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f5ba400cd80 tx=0x7f5ba4000bc0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.007+0000 7f5bc2072740 1 -- 172.21.15.144:0/1723013023 shutdown_connections 2024-09-11T23:25:59.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.007+0000 7f5bc2072740 1 --2- 172.21.15.144:0/1723013023 >> [v2:172.21.15.144:6834/3397068730,v1:172.21.15.144:6835/3397068730] conn(0x557720be9b50 0x557720be9f30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.007+0000 7f5bc2072740 1 --2- 172.21.15.144:0/1723013023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557720bb3d40 0x557720bdea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.007+0000 7f5bc2072740 1 --2- 172.21.15.144:0/1723013023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557720b99480 0x557720bde4c0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.007+0000 7f5ba1600640 0 client.8793 ms_handle_reset on v2:172.21.15.144:6834/3397068730 2024-09-11T23:25:59.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.007+0000 7f5bc2072740 1 --2- 172.21.15.144:0/1723013023 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x557720b97cf0 0x557720c450e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.007+0000 7f5bc2072740 1 -- 172.21.15.144:0/1723013023 >> 172.21.15.144:0/1723013023 conn(0x557720b954b0 msgr2=0x557720bc0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:59.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.007+0000 7f5bc2072740 1 -- 172.21.15.144:0/1723013023 shutdown_connections 2024-09-11T23:25:59.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.007+0000 7f5bc2072740 1 -- 172.21.15.144:0/1723013023 wait complete. 2024-09-11T23:25:59.011 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.007+0000 7f5bc2072740 20 client.8793 trim_cache size 0 max 16384 2024-09-11T23:25:59.012 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:25:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "4b73e4b7-12f0-4e37-94bc-45e333efe84e", 2024-09-11T23:25:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-11T23:25:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 8664, 2024-09-11T23:25:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-11T23:25:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-11T23:25:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-11T23:25:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 6.1033629960000004, 2024-09-11T23:25:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 109, 2024-09-11T23:25:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 153, 2024-09-11T23:25:59.012 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 153, 2024-09-11T23:25:59.013 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 10.815621616 2024-09-11T23:25:59.013 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:25:59.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.008+0000 7f5bbf200640 1 -- 172.21.15.144:0/679874375 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5b9806c610 msgr2=0x7f5b9806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:59.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.008+0000 7f5bbf200640 1 --2- 172.21.15.144:0/679874375 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5b9806c610 0x7f5b9806ead0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8034000 tx=0x7f5ba802e000 comp rx=0 tx=0).stop 2024-09-11T23:25:59.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.008+0000 7f5bbf200640 1 -- 172.21.15.144:0/679874375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bb80ce230 msgr2=0x7f5bb815b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:59.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.008+0000 7f5bbf200640 1 --2- 172.21.15.144:0/679874375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bb80ce230 0x7f5bb815b090 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f5ba400c3c0 tx=0x7f5ba400c880 comp rx=0 tx=0).stop 2024-09-11T23:25:59.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.008+0000 7f5bbf200640 1 -- 172.21.15.144:0/679874375 shutdown_connections 2024-09-11T23:25:59.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.008+0000 7f5bbf200640 1 --2- 172.21.15.144:0/679874375 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f5b9806c610 0x7f5b9806ead0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.008+0000 7f5bbf200640 1 --2- 172.21.15.144:0/679874375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5bb815c180 0x7f5bb814fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.008+0000 7f5bbf200640 1 --2- 172.21.15.144:0/679874375 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bb80ce230 0x7f5bb815b090 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.008+0000 7f5bbf200640 1 --2- 172.21.15.144:0/679874375 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f5bb8073120 0x7f5bb81569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.008+0000 7f5bbf200640 1 -- 172.21.15.144:0/679874375 >> 172.21.15.144:0/679874375 conn(0x7f5bb8062cc0 msgr2=0x7f5bb80b0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:59.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.008+0000 7f5bbf200640 1 -- 172.21.15.144:0/679874375 shutdown_connections 2024-09-11T23:25:59.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.008+0000 7f5bbf200640 1 -- 172.21.15.144:0/679874375 wait complete. 2024-09-11T23:25:59.024 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:25:59.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.177+0000 7f6370600640 1 Processor -- start 2024-09-11T23:25:59.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.177+0000 7f6370600640 1 -- start start 2024-09-11T23:25:59.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.179+0000 7f6370600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f636815ca40 0x7f636815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:59.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.179+0000 7f6370600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f636815ceb0 0x7f63681594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:59.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.179+0000 7f6370600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f636815d390 con 0x7f63680d02a0 2024-09-11T23:25:59.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.179+0000 7f6370600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f636815d670 con 0x7f636815ca40 2024-09-11T23:25:59.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.179+0000 7f6370600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f636815d950 con 0x7f636815ceb0 2024-09-11T23:25:59.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.179+0000 7f636d200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f636815ca40 0x7f636815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:59.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.179+0000 7f636d200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f636815ca40 0x7f636815e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40940/0 (socket says 172.21.15.144:40940) 2024-09-11T23:25:59.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.179+0000 7f636d200640 1 -- 172.21.15.144:0/1064992786 learned_addr learned my addr 172.21.15.144:0/1064992786 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:59.180 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.179+0000 7f636e600640 1 --2- 172.21.15.144:0/1064992786 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f636815ceb0 0x7f63681594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:59.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.179+0000 7f636d200640 1 -- 172.21.15.144:0/1064992786 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f636815ceb0 msgr2=0x7f63681594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:59.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.179+0000 7f636d200640 1 --2- 172.21.15.144:0/1064992786 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f636815ceb0 0x7f63681594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.179+0000 7f636d200640 1 -- 172.21.15.144:0/1064992786 >> v1:172.21.15.165:6789/0 conn(0x7f63680d02a0 legacy=0x7f63680d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:25:59.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.179+0000 7f636d200640 1 -- 172.21.15.144:0/1064992786 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636815dc30 con 0x7f636815ca40 2024-09-11T23:25:59.181 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.179+0000 7f636e600640 1 --2- 172.21.15.144:0/1064992786 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f636815ceb0 0x7f63681594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:25:59.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.180+0000 7f636d200640 1 --2- 172.21.15.144:0/1064992786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f636815ca40 0x7f636815e430 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f6354009870 tx=0x7f635402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25569f321eb71f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:59.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.181+0000 7f6367e00640 1 -- 172.21.15.144:0/1064992786 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354037070 con 0x7f636815ca40 2024-09-11T23:25:59.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.181+0000 7f6367e00640 1 -- 172.21.15.144:0/1064992786 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6354032440 con 0x7f636815ca40 2024-09-11T23:25:59.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.181+0000 7f6367e00640 1 -- 172.21.15.144:0/1064992786 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354032810 con 0x7f636815ca40 2024-09-11T23:25:59.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.181+0000 7f6370600640 1 -- 172.21.15.144:0/1064992786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f636815ca40 msgr2=0x7f636815e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:59.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.181+0000 7f6370600640 1 --2- 172.21.15.144:0/1064992786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f636815ca40 0x7f636815e430 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f6354009870 tx=0x7f635402a180 comp rx=0 tx=0).stop 2024-09-11T23:25:59.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.181+0000 7f6370600640 1 -- 172.21.15.144:0/1064992786 shutdown_connections 2024-09-11T23:25:59.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.181+0000 7f6370600640 1 --2- 172.21.15.144:0/1064992786 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f636815ceb0 0x7f63681594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.181+0000 7f6370600640 1 --2- 172.21.15.144:0/1064992786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f636815ca40 0x7f636815e430 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.181+0000 7f6370600640 1 -- 172.21.15.144:0/1064992786 >> 172.21.15.144:0/1064992786 conn(0x7f6368062cc0 msgr2=0x7f636806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:59.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.181+0000 7f6370600640 1 -- 172.21.15.144:0/1064992786 shutdown_connections 2024-09-11T23:25:59.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.181+0000 7f6370600640 1 -- 172.21.15.144:0/1064992786 wait complete. 2024-09-11T23:25:59.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.183+0000 7f6370600640 1 Processor -- start 2024-09-11T23:25:59.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.183+0000 7f6370600640 1 -- start start 2024-09-11T23:25:59.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.184+0000 7f6370600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63680d02a0 0x7f6368073510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:59.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.184+0000 7f6370600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f636815ca40 0x7f6368071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:59.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.184+0000 7f6370600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f636815ceb0 0x7f63680b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:59.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.184+0000 7f6370600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6368155d10 con 0x7f636815ca40 2024-09-11T23:25:59.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.184+0000 7f6370600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6368155b90 con 0x7f63680d02a0 2024-09-11T23:25:59.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.184+0000 7f6370600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f63680b4790 con 0x7f636815ceb0 2024-09-11T23:25:59.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.184+0000 7f636d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f636815ca40 0x7f6368071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:59.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.184+0000 7f636d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f636815ca40 0x7f6368071070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40948/0 (socket says 172.21.15.144:40948) 2024-09-11T23:25:59.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.184+0000 7f636d200640 1 -- 172.21.15.144:0/4057149649 learned_addr learned my addr 172.21.15.144:0/4057149649 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:25:59.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.184+0000 7f636dc00640 1 --2- 172.21.15.144:0/4057149649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63680d02a0 0x7f6368073510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:59.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.184+0000 7f636e600640 1 --2- 172.21.15.144:0/4057149649 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f636815ceb0 0x7f63680b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:59.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.185+0000 7f636d200640 1 -- 172.21.15.144:0/4057149649 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f636815ceb0 msgr2=0x7f63680b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:59.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.185+0000 7f636d200640 1 --2- 172.21.15.144:0/4057149649 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f636815ceb0 0x7f63680b04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.185+0000 7f636d200640 1 -- 172.21.15.144:0/4057149649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63680d02a0 msgr2=0x7f6368073510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:59.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.185+0000 7f636d200640 1 --2- 172.21.15.144:0/4057149649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63680d02a0 0x7f6368073510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.185+0000 7f636d200640 1 -- 172.21.15.144:0/4057149649 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6368071770 con 0x7f636815ca40 2024-09-11T23:25:59.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.185+0000 7f636d200640 1 --2- 172.21.15.144:0/4057149649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f636815ca40 0x7f6368071070 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f6354000c00 tx=0x7f63540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:59.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.185+0000 7f6365600640 1 -- 172.21.15.144:0/4057149649 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354041070 con 0x7f636815ca40 2024-09-11T23:25:59.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.185+0000 7f6365600640 1 -- 172.21.15.144:0/4057149649 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f635403c870 con 0x7f636815ca40 2024-09-11T23:25:59.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.185+0000 7f6365600640 1 -- 172.21.15.144:0/4057149649 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354037040 con 0x7f636815ca40 2024-09-11T23:25:59.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.185+0000 7f6370600640 1 -- 172.21.15.144:0/4057149649 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6368071a50 con 0x7f636815ca40 2024-09-11T23:25:59.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.186+0000 7f6370600640 1 -- 172.21.15.144:0/4057149649 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6368072010 con 0x7f636815ca40 2024-09-11T23:25:59.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.186+0000 7f6370600640 1 -- 172.21.15.144:0/4057149649 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63680d0680 con 0x7f636815ca40 2024-09-11T23:25:59.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.187+0000 7f6365600640 1 -- 172.21.15.144:0/4057149649 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f6354044070 con 0x7f636815ca40 2024-09-11T23:25:59.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.188+0000 7f6365600640 1 --2- 172.21.15.144:0/4057149649 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f634806c610 0x7f634806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:25:59.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.188+0000 7f6365600640 1 -- 172.21.15.144:0/4057149649 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f63540acc80 con 0x7f636815ca40 2024-09-11T23:25:59.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.189+0000 7f636dc00640 1 --2- 172.21.15.144:0/4057149649 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f634806c610 0x7f634806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:25:59.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.189+0000 7f636dc00640 1 --2- 172.21.15.144:0/4057149649 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f634806c610 0x7f634806ead0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f63680b1020 tx=0x7f635c007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:25:59.193 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.193+0000 7f6365600640 1 -- 172.21.15.144:0/4057149649 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f635407a0e0 con 0x7f636815ca40 2024-09-11T23:25:59.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.401+0000 7f6370600640 1 -- 172.21.15.144:0/4057149649 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f63680d0a30 con 0x7f636815ca40 2024-09-11T23:25:59.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.401+0000 7f6365600640 1 -- 172.21.15.144:0/4057149649 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v109) ==== 53+0+73 (secure 0 0 0) 0x7f635407e3e0 con 0x7f636815ca40 2024-09-11T23:25:59.402 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:25:59.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.403+0000 7f6370600640 1 -- 172.21.15.144:0/4057149649 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f634806c610 msgr2=0x7f634806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:59.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.403+0000 7f6370600640 1 --2- 172.21.15.144:0/4057149649 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f634806c610 0x7f634806ead0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f63680b1020 tx=0x7f635c007e30 comp rx=0 tx=0).stop 2024-09-11T23:25:59.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.403+0000 7f6370600640 1 -- 172.21.15.144:0/4057149649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f636815ca40 msgr2=0x7f6368071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:25:59.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.403+0000 7f6370600640 1 --2- 172.21.15.144:0/4057149649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f636815ca40 0x7f6368071070 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f6354000c00 tx=0x7f63540046c0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.404+0000 7f6370600640 1 -- 172.21.15.144:0/4057149649 shutdown_connections 2024-09-11T23:25:59.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.404+0000 7f6370600640 1 --2- 172.21.15.144:0/4057149649 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f634806c610 0x7f634806ead0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.404+0000 7f6370600640 1 --2- 172.21.15.144:0/4057149649 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f636815ceb0 0x7f63680b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.404+0000 7f6370600640 1 --2- 172.21.15.144:0/4057149649 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f636815ca40 0x7f6368071070 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.404+0000 7f6370600640 1 --2- 172.21.15.144:0/4057149649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63680d02a0 0x7f6368073510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:25:59.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.404+0000 7f6370600640 1 -- 172.21.15.144:0/4057149649 >> 172.21.15.144:0/4057149649 conn(0x7f6368062cc0 msgr2=0x7f63680af280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:25:59.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.404+0000 7f6370600640 1 -- 172.21.15.144:0/4057149649 shutdown_connections 2024-09-11T23:25:59.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59.404+0000 7f6370600640 1 -- 172.21.15.144:0/4057149649 wait complete. 2024-09-11T23:25:59.420 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:25:59.420 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:25:59.420 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-11T23:25:59.420 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:25:59.420 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:25:59.420 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:25:59.420 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:25:59.421 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:25:59.421 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:25:59.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:59.421 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-11T23:25:59.457 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:25:59.457 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:25:59.457 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:25:59.457 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-11T23:25:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:59.458 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:25:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:25:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-11T23:25:59.458 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:25:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:25:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-11T23:25:59.458 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:25:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:25:59.458 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:25:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-11T23:25:59.458 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:25:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42203sec preferred_lft 42203sec 2024-09-11T23:25:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2024-09-11T23:25:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:59.459 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:25:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff 2024-09-11T23:25:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:25:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::243b:82ff:fe06:fac9/64 scope link 2024-09-11T23:25:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:59.459 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:25:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:25:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::74ca:30ff:fef2:cddf/64 scope link 2024-09-11T23:25:59.459 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:59.459 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:25:59.460 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether be:01:ec:87:34:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:25:59.460 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bc01:ecff:fe87:34e1/64 scope link 2024-09-11T23:25:59.460 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:25:59.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:59.460 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:25:59.551 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-11T23:25:59.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:59.555 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-11T23:25:59.593 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-11T23:25:59.594 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:25:59.594 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:25:59.594 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:25:59.594 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:25:59.594 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:25:59.594 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-11T23:25:59.594 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:25:59.595 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:25:59.595 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:25:59.595 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-11T23:25:59.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:25:59.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:25:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:25:59.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:59.791 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-11T23:25:59.826 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:25:59.826 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:25:59.826 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:25:59.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:25:59.827 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-11T23:25:59.925 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:25:59.925 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:25:59.960 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:25:59.961 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:25:59.961 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:26:00.036 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T23:26:00.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:00.037 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:26:00.165 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:26:00.165 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:26:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:26:00.192 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:26:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:26:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:26:00.193 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:26:00.194 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T23:26:00.194 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:26:00.194 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:26:00.194 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:26:00.194 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:26:00.197 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:26:00.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:00.198 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:26:00.254 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:26:00.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:26:00.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:26:00.351 INFO:teuthology.orchestra.run.smithi144.stdout:client7172 2024-09-11T23:26:00.351 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:26:00.351 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:00.387 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:26:00.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.580+0000 7f0416600640 1 Processor -- start 2024-09-11T23:26:00.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.580+0000 7f0416600640 1 -- start start 2024-09-11T23:26:00.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.581+0000 7f0416600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f0410151540 0x7f0410151980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:00.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.581+0000 7f0416600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0410151ec0 con 0x7f04100cd010 2024-09-11T23:26:00.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.581+0000 7f0416600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04100cd5f0 con 0x7f041015baa0 2024-09-11T23:26:00.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.581+0000 7f0416600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f04100d0a20 con 0x7f0410151540 2024-09-11T23:26:00.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.582+0000 7f040f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f04100cd010 0x7f04100d0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:35184/0 (socket says 172.21.15.144:35184) 2024-09-11T23:26:00.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.582+0000 7f040f400640 1 -- 172.21.15.144:0/2233918177 learned_addr learned my addr 172.21.15.144:0/2233918177 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:00.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.582+0000 7f040fe00640 1 --2- 172.21.15.144:0/2233918177 >> v2:172.21.15.165:3300/0 conn(0x7f0410151540 0x7f0410151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:00.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.582+0000 7f040e000640 1 -- 172.21.15.144:0/2233918177 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2844034066 0 0) 0x7f0410151ec0 con 0x7f04100cd010 2024-09-11T23:26:00.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.582+0000 7f040e000640 1 -- 172.21.15.144:0/2233918177 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03f4003520 con 0x7f04100cd010 2024-09-11T23:26:00.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.582+0000 7f040e000640 1 -- 172.21.15.144:0/2233918177 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2282135282 0 0) 0x7f03f4003520 con 0x7f04100cd010 2024-09-11T23:26:00.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.582+0000 7f040e000640 1 -- 172.21.15.144:0/2233918177 >> v2:172.21.15.165:3300/0 conn(0x7f0410151540 msgr2=0x7f0410151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:00.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.582+0000 7f040e000640 1 --2- 172.21.15.144:0/2233918177 >> v2:172.21.15.165:3300/0 conn(0x7f0410151540 0x7f0410151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:00.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.582+0000 7f040e000640 1 -- 172.21.15.144:0/2233918177 >> v1:172.21.15.165:6789/0 conn(0x7f041015baa0 legacy=0x7f041006be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:00.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.582+0000 7f040e000640 1 -- 172.21.15.144:0/2233918177 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04100cd8d0 con 0x7f04100cd010 2024-09-11T23:26:00.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.582+0000 7f040e000640 1 -- 172.21.15.144:0/2233918177 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f0400001670 con 0x7f04100cd010 2024-09-11T23:26:00.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.582+0000 7f040e000640 1 -- 172.21.15.144:0/2233918177 >> v1:172.21.15.144:6789/0 conn(0x7f04100cd010 legacy=0x7f04100d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:00.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.582+0000 7f040e000640 1 --2- 172.21.15.144:0/2233918177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03f40039b0 0x7f03f4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:00.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.582+0000 7f040e000640 1 --2- 172.21.15.144:0/2233918177 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f03f4004800 0x7f03f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:00.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.583+0000 7f040e000640 1 --2- 172.21.15.144:0/2233918177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f40051c0 0x7f03f400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:00.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.583+0000 7f040e000640 1 -- 172.21.15.144:0/2233918177 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f04100d0a20 con 0x7f03f40051c0 2024-09-11T23:26:00.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.583+0000 7f040e000640 1 -- 172.21.15.144:0/2233918177 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f03f400e220 con 0x7f03f40039b0 2024-09-11T23:26:00.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.583+0000 7f040e000640 1 -- 172.21.15.144:0/2233918177 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f03f400e420 con 0x7f03f4004800 2024-09-11T23:26:00.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.583+0000 7f040fe00640 1 --2- 172.21.15.144:0/2233918177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f40051c0 0x7f03f400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:00.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.583+0000 7f040f400640 1 --2- 172.21.15.144:0/2233918177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03f40039b0 0x7f03f4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:00.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.583+0000 7f040ea00640 1 --2- 172.21.15.144:0/2233918177 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f03f4004800 0x7f03f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:00.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.583+0000 7f040fe00640 1 -- 172.21.15.144:0/2233918177 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f03f4004800 msgr2=0x7f03f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:00.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.583+0000 7f040fe00640 1 --2- 172.21.15.144:0/2233918177 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f03f4004800 0x7f03f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:00.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.583+0000 7f040fe00640 1 -- 172.21.15.144:0/2233918177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03f40039b0 msgr2=0x7f03f4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:00.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.583+0000 7f040fe00640 1 --2- 172.21.15.144:0/2233918177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03f40039b0 0x7f03f4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:00.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.583+0000 7f040fe00640 1 -- 172.21.15.144:0/2233918177 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f4003520 con 0x7f03f40051c0 2024-09-11T23:26:00.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.584+0000 7f040fe00640 1 -- 172.21.15.144:0/2233918177 reap_dead start 2024-09-11T23:26:00.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.584+0000 7f040fe00640 1 --2- 172.21.15.144:0/2233918177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f40051c0 0x7f03f400b9c0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f0408009fc0 tx=0x7f03f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=232ae57e9dd6b970 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:00.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.584+0000 7f040e000640 1 -- 172.21.15.144:0/2233918177 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408035020 con 0x7f03f40051c0 2024-09-11T23:26:00.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.585+0000 7f040e000640 1 -- 172.21.15.144:0/2233918177 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0408003bd0 con 0x7f03f40051c0 2024-09-11T23:26:00.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.585+0000 7f040e000640 1 -- 172.21.15.144:0/2233918177 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408009c10 con 0x7f03f40051c0 2024-09-11T23:26:00.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.585+0000 7f0416600640 1 -- 172.21.15.144:0/2233918177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f40051c0 msgr2=0x7f03f400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:00.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.585+0000 7f0416600640 1 --2- 172.21.15.144:0/2233918177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f40051c0 0x7f03f400b9c0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f0408009fc0 tx=0x7f03f4005830 comp rx=0 tx=0).stop 2024-09-11T23:26:00.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.585+0000 7f0416600640 1 -- 172.21.15.144:0/2233918177 shutdown_connections 2024-09-11T23:26:00.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.585+0000 7f0416600640 1 --2- 172.21.15.144:0/2233918177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f40051c0 0x7f03f400b9c0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:00.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.585+0000 7f0416600640 1 -- 172.21.15.144:0/2233918177 >> 172.21.15.144:0/2233918177 conn(0x7f0410062cc0 msgr2=0x7f041006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:00.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.585+0000 7f0416600640 1 -- 172.21.15.144:0/2233918177 shutdown_connections 2024-09-11T23:26:00.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.585+0000 7f0416600640 1 -- 172.21.15.144:0/2233918177 wait complete. 2024-09-11T23:26:00.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.587+0000 7f0416600640 1 Processor -- start 2024-09-11T23:26:00.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.587+0000 7f0416600640 1 -- start start 2024-09-11T23:26:00.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.588+0000 7f0416600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f40051c0 0x7f04101581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:00.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.588+0000 7f0416600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f041014ec50 0x7f041014f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:00.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.588+0000 7f0416600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04100734d0 0x7f04101520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:00.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.588+0000 7f0416600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f04100ce170 con 0x7f03f40051c0 2024-09-11T23:26:00.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.588+0000 7f0416600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f04100cde90 con 0x7f041014ec50 2024-09-11T23:26:00.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.588+0000 7f0416600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f041015bf10 con 0x7f04100734d0 2024-09-11T23:26:00.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.588+0000 7f040f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f40051c0 0x7f04101581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:00.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.588+0000 7f040f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f40051c0 0x7f04101581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40980/0 (socket says 172.21.15.144:40980) 2024-09-11T23:26:00.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.588+0000 7f040f400640 1 -- 172.21.15.144:0/2959695515 learned_addr learned my addr 172.21.15.144:0/2959695515 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:00.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.588+0000 7f040ea00640 1 --2- 172.21.15.144:0/2959695515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f041014ec50 0x7f041014f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:00.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.588+0000 7f040fe00640 1 --2- 172.21.15.144:0/2959695515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04100734d0 0x7f04101520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:00.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.588+0000 7f040f400640 1 -- 172.21.15.144:0/2959695515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04100734d0 msgr2=0x7f04101520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:00.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.588+0000 7f040f400640 1 --2- 172.21.15.144:0/2959695515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04100734d0 0x7f04101520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:00.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.588+0000 7f040f400640 1 -- 172.21.15.144:0/2959695515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f041014ec50 msgr2=0x7f041014f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:00.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.588+0000 7f040f400640 1 --2- 172.21.15.144:0/2959695515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f041014ec50 0x7f041014f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:00.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.588+0000 7f040f400640 1 -- 172.21.15.144:0/2959695515 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0410072430 con 0x7f03f40051c0 2024-09-11T23:26:00.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.588+0000 7f040ea00640 1 --2- 172.21.15.144:0/2959695515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f041014ec50 0x7f041014f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:00.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.589+0000 7f040f400640 1 --2- 172.21.15.144:0/2959695515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f40051c0 0x7f04101581e0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f0400007370 tx=0x7f0400007770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:00.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.589+0000 7f0407400640 1 -- 172.21.15.144:0/2959695515 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040001a070 con 0x7f03f40051c0 2024-09-11T23:26:00.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.589+0000 7f0407400640 1 -- 172.21.15.144:0/2959695515 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0400001630 con 0x7f03f40051c0 2024-09-11T23:26:00.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.589+0000 7f0416600640 1 -- 172.21.15.144:0/2959695515 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0410072710 con 0x7f03f40051c0 2024-09-11T23:26:00.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.589+0000 7f0407400640 1 -- 172.21.15.144:0/2959695515 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040000fbc0 con 0x7f03f40051c0 2024-09-11T23:26:00.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.589+0000 7f0416600640 1 -- 172.21.15.144:0/2959695515 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0410072cd0 con 0x7f03f40051c0 2024-09-11T23:26:00.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.590+0000 7f0416600640 1 -- 172.21.15.144:0/2959695515 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04100ce690 con 0x7f03f40051c0 2024-09-11T23:26:00.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.591+0000 7f0407400640 1 -- 172.21.15.144:0/2959695515 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f040001d070 con 0x7f03f40051c0 2024-09-11T23:26:00.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.592+0000 7f0407400640 1 --2- 172.21.15.144:0/2959695515 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f03f006c610 0x7f03f006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:00.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.592+0000 7f0407400640 1 -- 172.21.15.144:0/2959695515 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f040008ba40 con 0x7f03f40051c0 2024-09-11T23:26:00.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.593+0000 7f040ea00640 1 --2- 172.21.15.144:0/2959695515 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f03f006c610 0x7f03f006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:00.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.593+0000 7f040ea00640 1 --2- 172.21.15.144:0/2959695515 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f03f006c610 0x7f03f006ead0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f04101f3270 tx=0x7f03fc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:00.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.596+0000 7f0407400640 1 -- 172.21.15.144:0/2959695515 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f04000593d0 con 0x7f03f40051c0 2024-09-11T23:26:00.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.806+0000 7f0416600640 1 -- 172.21.15.144:0/2959695515 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f04100afd90 con 0x7f03f40051c0 2024-09-11T23:26:00.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.806+0000 7f0407400640 1 -- 172.21.15.144:0/2959695515 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v109) ==== 53+0+73 (secure 0 0 0) 0x7f0400058cd0 con 0x7f03f40051c0 2024-09-11T23:26:00.807 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:26:00.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.808+0000 7f0416600640 1 -- 172.21.15.144:0/2959695515 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f03f006c610 msgr2=0x7f03f006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:00.809 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.808+0000 7f0416600640 1 --2- 172.21.15.144:0/2959695515 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f03f006c610 0x7f03f006ead0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f04101f3270 tx=0x7f03fc009040 comp rx=0 tx=0).stop 2024-09-11T23:26:00.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.808+0000 7f0416600640 1 -- 172.21.15.144:0/2959695515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f40051c0 msgr2=0x7f04101581e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:00.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.808+0000 7f0416600640 1 --2- 172.21.15.144:0/2959695515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f40051c0 0x7f04101581e0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f0400007370 tx=0x7f0400007770 comp rx=0 tx=0).stop 2024-09-11T23:26:00.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.809+0000 7f0416600640 1 -- 172.21.15.144:0/2959695515 shutdown_connections 2024-09-11T23:26:00.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.809+0000 7f0416600640 1 --2- 172.21.15.144:0/2959695515 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f03f006c610 0x7f03f006ead0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:00.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.809+0000 7f0416600640 1 --2- 172.21.15.144:0/2959695515 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04100734d0 0x7f04101520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:00.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.809+0000 7f0416600640 1 --2- 172.21.15.144:0/2959695515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f041014ec50 0x7f041014f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:00.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.809+0000 7f0416600640 1 --2- 172.21.15.144:0/2959695515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03f40051c0 0x7f04101581e0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:00.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.809+0000 7f0416600640 1 -- 172.21.15.144:0/2959695515 >> 172.21.15.144:0/2959695515 conn(0x7f0410062cc0 msgr2=0x7f041006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:00.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.809+0000 7f0416600640 1 -- 172.21.15.144:0/2959695515 shutdown_connections 2024-09-11T23:26:00.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:00.809+0000 7f0416600640 1 -- 172.21.15.144:0/2959695515 wait complete. 2024-09-11T23:26:00.825 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:26:00.825 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:26:00.825 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi165.front.sepia.ceph.com 2024-09-11T23:26:00.825 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T23:26:00.825 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:26:00.825 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:26:00.825 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:26:00.825 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:26:00.826 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:26:00.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:00.826 DEBUG:teuthology.orchestra.run.smithi165:> ip addr 2024-09-11T23:26:00.867 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:26:00.867 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:26:00.867 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:26:00.867 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:00.867 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-11T23:26:00.867 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:00.867 INFO:teuthology.orchestra.run.smithi165.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:26:00.868 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:94 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:26:00.868 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f0 2024-09-11T23:26:00.868 INFO:teuthology.orchestra.run.smithi165.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:26:00.868 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:95 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:26:00.868 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f1 2024-09-11T23:26:00.868 INFO:teuthology.orchestra.run.smithi165.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:26:00.868 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:26:00.868 INFO:teuthology.orchestra.run.smithi165.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:26:00.868 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:26:00.868 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.21.15.165/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:26:00.868 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft 42205sec preferred_lft 42205sec 2024-09-11T23:26:00.868 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::ec4:7aff:fe88:7f63/64 scope link noprefixroute 2024-09-11T23:26:00.868 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:00.868 INFO:teuthology.orchestra.run.smithi165.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:26:00.869 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:26:00.869 INFO:teuthology.orchestra.run.smithi165.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:26:00.869 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:00.869 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::c063:d7ff:fec8:c56c/64 scope link 2024-09-11T23:26:00.869 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:00.869 INFO:teuthology.orchestra.run.smithi165.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:26:00.869 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:26:00.869 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::5478:e4ff:fecd:76c/64 scope link 2024-09-11T23:26:00.869 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:00.869 INFO:teuthology.orchestra.run.smithi165.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:26:00.869 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether ba:fa:43:78:5f:29 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:26:00.869 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::b8fa:43ff:fe78:5f29/64 scope link 2024-09-11T23:26:00.869 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:00.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:00.870 DEBUG:teuthology.orchestra.run.smithi165:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:26:00.967 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-11T23:26:00.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:00.971 DEBUG:teuthology.orchestra.run.smithi165:> route 2024-09-11T23:26:01.008 INFO:teuthology.orchestra.run.smithi165.stdout:Kernel IP routing table 2024-09-11T23:26:01.009 INFO:teuthology.orchestra.run.smithi165.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:26:01.009 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:26:01.009 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:26:01.009 INFO:teuthology.orchestra.run.smithi165.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:26:01.009 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:26:01.010 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-11T23:26:01.010 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:26:01.010 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:26:01.010 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:26:01.010 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-11T23:26:01.126 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:26:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:26:01.198 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:26:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:26:01.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:01.206 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-11T23:26:01.242 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-11T23:26:01.242 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-11T23:26:01.242 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:26:01.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:01.242 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set brx.0 up 2024-09-11T23:26:01.338 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:26:01.338 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T23:26:01.376 INFO:teuthology.orchestra.run.smithi165.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:26:01.376 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:26:01.376 DEBUG:teuthology.orchestra.run.smithi165:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:26:01.453 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-11T23:26:01.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:01.454 DEBUG:teuthology.orchestra.run.smithi165:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:26:01.582 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:26:01.582 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:26:01.609 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:26:01.609 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:26:01.609 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:26:01.609 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: trying mount with new device syntax: 1@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:26:01.609 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:26:01.610 INFO:teuthology.orchestra.run.smithi165.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-11T23:26:01.610 INFO:teuthology.orchestra.run.smithi165.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:26:01.610 INFO:teuthology.orchestra.run.smithi165.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:26:01.610 INFO:teuthology.orchestra.run.smithi165.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:26:01.611 INFO:teuthology.orchestra.run.smithi165.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:26:01.613 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:26:01.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:01.613 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:26:01.670 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:26:01.748 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:26:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:26:01.752 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:26:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:26:01.760 INFO:teuthology.orchestra.run.smithi165.stdout:client7178 2024-09-11T23:26:01.761 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:26:01.761 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:01.798 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-11T23:26:01.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.957+0000 7fadb8a00640 1 Processor -- start 2024-09-11T23:26:01.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.957+0000 7fadb8a00640 1 -- start start 2024-09-11T23:26:01.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.959+0000 7fadb8a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fadb406f130 0x7fadb4072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:01.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.959+0000 7fadb8a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadb415f9f0 0x7fadb40ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:01.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.959+0000 7fadb8a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadb415c970 con 0x7fadb415b370 2024-09-11T23:26:01.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.959+0000 7fadb8a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fadb415fef0 con 0x7fadb406f130 2024-09-11T23:26:01.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.959+0000 7fadb8a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fadb415bbb0 con 0x7fadb415f9f0 2024-09-11T23:26:01.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.959+0000 7fadb2800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadb415f9f0 0x7fadb40ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:01.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.959+0000 7fadb1e00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7fadb415b370 0x7fadb406ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:47908/0 (socket says 172.21.15.144:47908) 2024-09-11T23:26:01.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.959+0000 7fada9400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fadb406f130 0x7fadb4072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:01.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.959+0000 7fadb1e00640 1 -- 172.21.15.144:0/1291105493 learned_addr learned my addr 172.21.15.144:0/1291105493 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:01.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.959+0000 7fadb2800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadb415f9f0 0x7fadb40ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:35230/0 (socket says 172.21.15.144:35230) 2024-09-11T23:26:01.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.960+0000 7fadb2800640 1 -- 172.21.15.144:0/1291105493 >> v2:172.21.15.165:3300/0 conn(0x7fadb406f130 msgr2=0x7fadb4072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:01.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.960+0000 7fadb2800640 1 --2- 172.21.15.144:0/1291105493 >> v2:172.21.15.165:3300/0 conn(0x7fadb406f130 0x7fadb4072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:01.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.960+0000 7fadb2800640 1 -- 172.21.15.144:0/1291105493 >> v1:172.21.15.165:6789/0 conn(0x7fadb415b370 legacy=0x7fadb406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:01.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.960+0000 7fadb2800640 1 -- 172.21.15.144:0/1291105493 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb415be90 con 0x7fadb415f9f0 2024-09-11T23:26:01.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.961+0000 7fadb2800640 1 --2- 172.21.15.144:0/1291105493 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadb415f9f0 0x7fadb40ce490 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fadac009d90 tx=0x7fadac02c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=955053b2c40f2f72 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:01.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.961+0000 7fadb1400640 1 -- 172.21.15.144:0/1291105493 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac007740 con 0x7fadb415f9f0 2024-09-11T23:26:01.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.961+0000 7fadb1400640 1 -- 172.21.15.144:0/1291105493 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadac0078e0 con 0x7fadb415f9f0 2024-09-11T23:26:01.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.961+0000 7fadb1400640 1 -- 172.21.15.144:0/1291105493 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac007cb0 con 0x7fadb415f9f0 2024-09-11T23:26:01.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.962+0000 7fadb8a00640 1 -- 172.21.15.144:0/1291105493 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadb415f9f0 msgr2=0x7fadb40ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:01.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.962+0000 7fadb8a00640 1 --2- 172.21.15.144:0/1291105493 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadb415f9f0 0x7fadb40ce490 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fadac009d90 tx=0x7fadac02c7e0 comp rx=0 tx=0).stop 2024-09-11T23:26:01.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.962+0000 7fadb8a00640 1 -- 172.21.15.144:0/1291105493 shutdown_connections 2024-09-11T23:26:01.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.962+0000 7fadb8a00640 1 --2- 172.21.15.144:0/1291105493 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadb415f9f0 0x7fadb40ce490 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:01.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.962+0000 7fadb8a00640 1 --2- 172.21.15.144:0/1291105493 >> v2:172.21.15.165:3300/0 conn(0x7fadb406f130 0x7fadb4072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:01.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.962+0000 7fadb8a00640 1 -- 172.21.15.144:0/1291105493 >> 172.21.15.144:0/1291105493 conn(0x7fadb406bba0 msgr2=0x7fadb406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:01.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.962+0000 7fadb8a00640 1 -- 172.21.15.144:0/1291105493 shutdown_connections 2024-09-11T23:26:01.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.962+0000 7fadb8a00640 1 -- 172.21.15.144:0/1291105493 wait complete. 2024-09-11T23:26:01.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.964+0000 7fadb8a00640 1 Processor -- start 2024-09-11T23:26:01.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.964+0000 7fadb8a00640 1 -- start start 2024-09-11T23:26:01.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.965+0000 7fadb8a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadb406f130 0x7fadb4149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:01.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.965+0000 7fadb8a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadb415b370 0x7fadb40b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:01.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.965+0000 7fadb8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadb415f9f0 0x7fadb40b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:01.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.965+0000 7fadb8a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fadb40731b0 con 0x7fadb415f9f0 2024-09-11T23:26:01.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.965+0000 7fadb8a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fadb415c450 con 0x7fadb406f130 2024-09-11T23:26:01.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.965+0000 7fadb8a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fadb415b750 con 0x7fadb415b370 2024-09-11T23:26:01.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.965+0000 7fadb2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadb415f9f0 0x7fadb40b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:01.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.965+0000 7fadb1e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadb406f130 0x7fadb4149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:01.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.965+0000 7fada9400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadb415b370 0x7fadb40b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:01.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.965+0000 7fadb1e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadb406f130 0x7fadb4149d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:36030/0 (socket says 172.21.15.144:36030) 2024-09-11T23:26:01.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.965+0000 7fada9400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadb415b370 0x7fadb40b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:35234/0 (socket says 172.21.15.144:35234) 2024-09-11T23:26:01.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.965+0000 7fadb2800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadb415f9f0 0x7fadb40b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40988/0 (socket says 172.21.15.144:40988) 2024-09-11T23:26:01.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.965+0000 7fadb1e00640 1 -- 172.21.15.144:0/484460121 learned_addr learned my addr 172.21.15.144:0/484460121 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:01.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.965+0000 7fadb1e00640 1 -- 172.21.15.144:0/484460121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadb415b370 msgr2=0x7fadb40b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:01.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.965+0000 7fadb1e00640 1 --2- 172.21.15.144:0/484460121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadb415b370 0x7fadb40b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:01.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.965+0000 7fadb1e00640 1 -- 172.21.15.144:0/484460121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadb415f9f0 msgr2=0x7fadb40b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:01.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.965+0000 7fadb1e00640 1 --2- 172.21.15.144:0/484460121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadb415f9f0 0x7fadb40b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:01.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.965+0000 7fadb1e00640 1 -- 172.21.15.144:0/484460121 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb40b5180 con 0x7fadb406f130 2024-09-11T23:26:01.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.965+0000 7fada9400640 1 --2- 172.21.15.144:0/484460121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadb415b370 0x7fadb40b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:26:01.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.966+0000 7fadb1e00640 1 --2- 172.21.15.144:0/484460121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadb406f130 0x7fadb4149d10 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fada400c400 tx=0x7fada400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:01.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.966+0000 7fadaaa00640 1 -- 172.21.15.144:0/484460121 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada4017070 con 0x7fadb406f130 2024-09-11T23:26:01.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.966+0000 7fadaaa00640 1 -- 172.21.15.144:0/484460121 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada4005ce0 con 0x7fadb406f130 2024-09-11T23:26:01.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.966+0000 7fadaaa00640 1 -- 172.21.15.144:0/484460121 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada40072f0 con 0x7fadb406f130 2024-09-11T23:26:01.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.966+0000 7fadb8a00640 1 -- 172.21.15.144:0/484460121 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadb40b40e0 con 0x7fadb406f130 2024-09-11T23:26:01.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.966+0000 7fadb8a00640 1 -- 172.21.15.144:0/484460121 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadb40b46a0 con 0x7fadb406f130 2024-09-11T23:26:01.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.967+0000 7fadb8a00640 1 -- 172.21.15.144:0/484460121 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadb4072560 con 0x7fadb406f130 2024-09-11T23:26:01.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.968+0000 7fadaaa00640 1 -- 172.21.15.144:0/484460121 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7fada401a070 con 0x7fadb406f130 2024-09-11T23:26:01.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.969+0000 7fadaaa00640 1 --2- 172.21.15.144:0/484460121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fad9006c610 0x7fad9006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:01.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.969+0000 7fadaaa00640 1 -- 172.21.15.144:0/484460121 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7fada408b370 con 0x7fadb406f130 2024-09-11T23:26:01.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.969+0000 7fada9400640 1 --2- 172.21.15.144:0/484460121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fad9006c610 0x7fad9006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:01.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.970+0000 7fada9400640 1 --2- 172.21.15.144:0/484460121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fad9006c610 0x7fad9006ead0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fadb41f7990 tx=0x7fad9c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:01.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:01.974+0000 7fadaaa00640 1 -- 172.21.15.144:0/484460121 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fada4058740 con 0x7fadb406f130 2024-09-11T23:26:02.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:02.183+0000 7fadb8a00640 1 -- 172.21.15.144:0/484460121 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fadb406de10 con 0x7fadb406f130 2024-09-11T23:26:03.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.002+0000 7fadaaa00640 1 -- 172.21.15.144:0/484460121 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v110) ==== 136+0+0 (secure 0 0 0) 0x7fada405ca40 con 0x7fadb406f130 2024-09-11T23:26:03.005 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.004+0000 7fadb8a00640 1 -- 172.21.15.144:0/484460121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fad9006c610 msgr2=0x7fad9006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:03.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.004+0000 7fadb8a00640 1 --2- 172.21.15.144:0/484460121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fad9006c610 0x7fad9006ead0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fadb41f7990 tx=0x7fad9c009190 comp rx=0 tx=0).stop 2024-09-11T23:26:03.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.004+0000 7fadb8a00640 1 -- 172.21.15.144:0/484460121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadb406f130 msgr2=0x7fadb4149d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:03.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.004+0000 7fadb8a00640 1 --2- 172.21.15.144:0/484460121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadb406f130 0x7fadb4149d10 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fada400c400 tx=0x7fada400c8c0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.004+0000 7fadb8a00640 1 -- 172.21.15.144:0/484460121 shutdown_connections 2024-09-11T23:26:03.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.004+0000 7fadb8a00640 1 --2- 172.21.15.144:0/484460121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fad9006c610 0x7fad9006ead0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.004+0000 7fadb8a00640 1 --2- 172.21.15.144:0/484460121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadb415f9f0 0x7fadb40b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.004+0000 7fadb8a00640 1 --2- 172.21.15.144:0/484460121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fadb415b370 0x7fadb40b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.004+0000 7fadb8a00640 1 --2- 172.21.15.144:0/484460121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadb406f130 0x7fadb4149d10 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.005+0000 7fadb8a00640 1 -- 172.21.15.144:0/484460121 >> 172.21.15.144:0/484460121 conn(0x7fadb406bba0 msgr2=0x7fadb4152de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:03.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.005+0000 7fadb8a00640 1 -- 172.21.15.144:0/484460121 shutdown_connections 2024-09-11T23:26:03.006 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.005+0000 7fadb8a00640 1 -- 172.21.15.144:0/484460121 wait complete. 2024-09-11T23:26:03.022 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-11T23:26:03.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.177+0000 7f02efe00640 1 Processor -- start 2024-09-11T23:26:03.178 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.177+0000 7f02efe00640 1 -- start start 2024-09-11T23:26:03.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.178+0000 7f02efe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f02f015e640 0x7f02f00d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:03.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.178+0000 7f02efe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f02f00b66e0 0x7f02f00b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:03.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.178+0000 7f02efe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02f006bee0 con 0x7f02f00d3f60 2024-09-11T23:26:03.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.178+0000 7f02efe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f02f015ea20 con 0x7f02f015e640 2024-09-11T23:26:03.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.178+0000 7f02efe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f02f006caf0 con 0x7f02f00b66e0 2024-09-11T23:26:03.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.178+0000 7f02eea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f02f015e640 0x7f02f00d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:03.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.178+0000 7f02eea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f02f015e640 0x7f02f00d3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40998/0 (socket says 172.21.15.144:40998) 2024-09-11T23:26:03.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.178+0000 7f02eea00640 1 -- 172.21.15.144:0/3083014374 learned_addr learned my addr 172.21.15.144:0/3083014374 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:03.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.179+0000 7f02ef400640 1 --2- 172.21.15.144:0/3083014374 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f02f00b66e0 0x7f02f00b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:03.182 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.179+0000 7f02eea00640 1 -- 172.21.15.144:0/3083014374 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f02f00b66e0 msgr2=0x7f02f00b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:03.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.179+0000 7f02eea00640 1 --2- 172.21.15.144:0/3083014374 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f02f00b66e0 0x7f02f00b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.179+0000 7f02eea00640 1 -- 172.21.15.144:0/3083014374 >> v1:172.21.15.165:6789/0 conn(0x7f02f00d3f60 legacy=0x7f02f00b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:03.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.179+0000 7f02eea00640 1 -- 172.21.15.144:0/3083014374 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f006c1c0 con 0x7f02f015e640 2024-09-11T23:26:03.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.180+0000 7f02eea00640 1 --2- 172.21.15.144:0/3083014374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f015e640 0x7f02f00d3a20 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009870 tx=0x7f02e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb963c139a2e6764 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:03.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.180+0000 7f02ed600640 1 -- 172.21.15.144:0/3083014374 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e0037070 con 0x7f02f015e640 2024-09-11T23:26:03.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.180+0000 7f02ed600640 1 -- 172.21.15.144:0/3083014374 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e0032440 con 0x7f02f015e640 2024-09-11T23:26:03.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.180+0000 7f02ed600640 1 -- 172.21.15.144:0/3083014374 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e0032810 con 0x7f02f015e640 2024-09-11T23:26:03.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.181+0000 7f02efe00640 1 -- 172.21.15.144:0/3083014374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f015e640 msgr2=0x7f02f00d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:03.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.181+0000 7f02efe00640 1 --2- 172.21.15.144:0/3083014374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f015e640 0x7f02f00d3a20 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009870 tx=0x7f02e002a270 comp rx=0 tx=0).stop 2024-09-11T23:26:03.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.181+0000 7f02efe00640 1 -- 172.21.15.144:0/3083014374 shutdown_connections 2024-09-11T23:26:03.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.181+0000 7f02efe00640 1 --2- 172.21.15.144:0/3083014374 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f02f00b66e0 0x7f02f00b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.181+0000 7f02efe00640 1 --2- 172.21.15.144:0/3083014374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f015e640 0x7f02f00d3a20 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.181+0000 7f02efe00640 1 -- 172.21.15.144:0/3083014374 >> 172.21.15.144:0/3083014374 conn(0x7f02f00d0fd0 msgr2=0x7f02f00d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:03.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.181+0000 7f02efe00640 1 -- 172.21.15.144:0/3083014374 shutdown_connections 2024-09-11T23:26:03.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.181+0000 7f02efe00640 1 -- 172.21.15.144:0/3083014374 wait complete. 2024-09-11T23:26:03.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.182+0000 7f02efe00640 1 Processor -- start 2024-09-11T23:26:03.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.182+0000 7f02efe00640 1 -- start start 2024-09-11T23:26:03.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.183+0000 7f02efe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f02f00b66e0 0x7f02f01f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:03.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.183+0000 7f02efe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f00d3f60 0x7f02f015d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:03.186 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.183+0000 7f02efe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02f015e640 0x7f02f015d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:03.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.183+0000 7f02efe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f02f00b7c90 con 0x7f02f00d3f60 2024-09-11T23:26:03.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.183+0000 7f02efe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f02f006c780 con 0x7f02f015e640 2024-09-11T23:26:03.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.183+0000 7f02efe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f02f00b7e10 con 0x7f02f00b66e0 2024-09-11T23:26:03.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.184+0000 7f02ee000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f00d3f60 0x7f02f015d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:03.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.184+0000 7f02ee000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f00d3f60 0x7f02f015d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41014/0 (socket says 172.21.15.144:41014) 2024-09-11T23:26:03.187 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.184+0000 7f02ee000640 1 -- 172.21.15.144:0/710655612 learned_addr learned my addr 172.21.15.144:0/710655612 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:03.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.184+0000 7f02eea00640 1 --2- 172.21.15.144:0/710655612 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f02f00b66e0 0x7f02f01f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:03.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.184+0000 7f02ef400640 1 --2- 172.21.15.144:0/710655612 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02f015e640 0x7f02f015d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:03.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.184+0000 7f02ee000640 1 -- 172.21.15.144:0/710655612 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f02f00b66e0 msgr2=0x7f02f01f4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:03.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.184+0000 7f02ee000640 1 --2- 172.21.15.144:0/710655612 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f02f00b66e0 0x7f02f01f4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.184+0000 7f02ee000640 1 -- 172.21.15.144:0/710655612 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02f015e640 msgr2=0x7f02f015d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:03.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.184+0000 7f02ee000640 1 --2- 172.21.15.144:0/710655612 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02f015e640 0x7f02f015d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.184+0000 7f02ee000640 1 -- 172.21.15.144:0/710655612 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f00ab570 con 0x7f02f00d3f60 2024-09-11T23:26:03.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.184+0000 7f02ee000640 1 --2- 172.21.15.144:0/710655612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f00d3f60 0x7f02f015d4b0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00c400 tx=0x7f02dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:03.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.185+0000 7f02e7400640 1 -- 172.21.15.144:0/710655612 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc0052d0 con 0x7f02f00d3f60 2024-09-11T23:26:03.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.185+0000 7f02e7400640 1 -- 172.21.15.144:0/710655612 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02dc005490 con 0x7f02f00d3f60 2024-09-11T23:26:03.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.185+0000 7f02e7400640 1 -- 172.21.15.144:0/710655612 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc007260 con 0x7f02f00d3f60 2024-09-11T23:26:03.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.185+0000 7f02efe00640 1 -- 172.21.15.144:0/710655612 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f00ab850 con 0x7f02f00d3f60 2024-09-11T23:26:03.189 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.185+0000 7f02efe00640 1 -- 172.21.15.144:0/710655612 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f00abe10 con 0x7f02f00d3f60 2024-09-11T23:26:03.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.186+0000 7f02efe00640 1 -- 172.21.15.144:0/710655612 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02f00b7750 con 0x7f02f00d3f60 2024-09-11T23:26:03.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.187+0000 7f02e7400640 1 -- 172.21.15.144:0/710655612 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f02dc007400 con 0x7f02f00d3f60 2024-09-11T23:26:03.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.187+0000 7f02e7400640 1 --2- 172.21.15.144:0/710655612 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f02d006c610 0x7f02d006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:03.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.188+0000 7f02e7400640 1 -- 172.21.15.144:0/710655612 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f02dc08b540 con 0x7f02f00d3f60 2024-09-11T23:26:03.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.188+0000 7f02eea00640 1 --2- 172.21.15.144:0/710655612 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f02d006c610 0x7f02d006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:03.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.189+0000 7f02eea00640 1 --2- 172.21.15.144:0/710655612 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f02d006c610 0x7f02d006ead0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f02e0034000 tx=0x7f02e002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:03.192 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.192+0000 7f02e7400640 1 -- 172.21.15.144:0/710655612 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02dc058910 con 0x7f02f00d3f60 2024-09-11T23:26:03.388 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.387+0000 7f02efe00640 1 -- 172.21.15.144:0/710655612 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f02f015d170 con 0x7f02d006c610 2024-09-11T23:26:03.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.390+0000 7f02e7400640 1 -- 172.21.15.144:0/710655612 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f02f015d170 con 0x7f02d006c610 2024-09-11T23:26:03.390 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:26:03.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:03.390 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephfs" 2024-09-11T23:26:03.390 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:03.390 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:26:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.392+0000 7f02efe00640 1 -- 172.21.15.144:0/710655612 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f02d006c610 msgr2=0x7f02d006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.392+0000 7f02efe00640 1 --2- 172.21.15.144:0/710655612 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f02d006c610 0x7f02d006ead0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f02e0034000 tx=0x7f02e002e000 comp rx=0 tx=0).stop 2024-09-11T23:26:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.392+0000 7f02efe00640 1 -- 172.21.15.144:0/710655612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f00d3f60 msgr2=0x7f02f015d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.392+0000 7f02efe00640 1 --2- 172.21.15.144:0/710655612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f00d3f60 0x7f02f015d4b0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00c400 tx=0x7f02dc00c8c0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.392+0000 7f02efe00640 1 -- 172.21.15.144:0/710655612 shutdown_connections 2024-09-11T23:26:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.392+0000 7f02efe00640 1 --2- 172.21.15.144:0/710655612 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f02d006c610 0x7f02d006ead0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.392+0000 7f02efe00640 1 --2- 172.21.15.144:0/710655612 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f02f015e640 0x7f02f015d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.392+0000 7f02efe00640 1 --2- 172.21.15.144:0/710655612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02f00d3f60 0x7f02f015d4b0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.392+0000 7f02efe00640 1 --2- 172.21.15.144:0/710655612 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f02f00b66e0 0x7f02f01f4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.392+0000 7f02efe00640 1 -- 172.21.15.144:0/710655612 >> 172.21.15.144:0/710655612 conn(0x7f02f00d0fd0 msgr2=0x7f02f00cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.392+0000 7f02efe00640 1 -- 172.21.15.144:0/710655612 shutdown_connections 2024-09-11T23:26:03.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.392+0000 7f02efe00640 1 -- 172.21.15.144:0/710655612 wait complete. 2024-09-11T23:26:03.409 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:26:03.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.565+0000 7f9979400640 1 Processor -- start 2024-09-11T23:26:03.567 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.565+0000 7f9979400640 1 -- start start 2024-09-11T23:26:03.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.567+0000 7f9979400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9974158e50 0x7f99740b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:03.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.567+0000 7f9979400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f997415c370 0x7f997406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:03.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.567+0000 7f9979400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f997406ef60 0x7f997415ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:03.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.567+0000 7f9979400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f997406f3d0 con 0x7f997415c370 2024-09-11T23:26:03.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.567+0000 7f9979400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f99740b43f0 con 0x7f997406ef60 2024-09-11T23:26:03.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.567+0000 7f9979400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f997415c7d0 con 0x7f9974158e50 2024-09-11T23:26:03.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.567+0000 7f9969e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f997415c370 0x7f997406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:03.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.567+0000 7f9969e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f997415c370 0x7f997406ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41020/0 (socket says 172.21.15.144:41020) 2024-09-11T23:26:03.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.567+0000 7f9969e00640 1 -- 172.21.15.144:0/2806385382 learned_addr learned my addr 172.21.15.144:0/2806385382 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:03.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.567+0000 7f9969e00640 1 -- 172.21.15.144:0/2806385382 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9974158e50 msgr2=0x7f99740b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:03.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.567+0000 7f9969e00640 1 --2- 172.21.15.144:0/2806385382 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9974158e50 0x7f99740b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.567+0000 7f9969e00640 1 -- 172.21.15.144:0/2806385382 >> v2:172.21.15.165:3300/0 conn(0x7f997406ef60 msgr2=0x7f997415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:03.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.567+0000 7f9973200640 1 --2- 172.21.15.144:0/2806385382 >> v2:172.21.15.165:3300/0 conn(0x7f997406ef60 0x7f997415ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:03.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.567+0000 7f9969e00640 1 --2- 172.21.15.144:0/2806385382 >> v2:172.21.15.165:3300/0 conn(0x7f997406ef60 0x7f997415ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.567+0000 7f9969e00640 1 -- 172.21.15.144:0/2806385382 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99740b3630 con 0x7f997415c370 2024-09-11T23:26:03.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.567+0000 7f9973200640 1 --2- 172.21.15.144:0/2806385382 >> v2:172.21.15.165:3300/0 conn(0x7f997406ef60 0x7f997415ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:03.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.568+0000 7f9969e00640 1 --2- 172.21.15.144:0/2806385382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f997415c370 0x7f997406ea20 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f99740ccee0 tx=0x7f995c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e8f6cc89a3b078 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:03.570 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.569+0000 7f9971e00640 1 -- 172.21.15.144:0/2806385382 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c037070 con 0x7f997415c370 2024-09-11T23:26:03.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.569+0000 7f9971e00640 1 -- 172.21.15.144:0/2806385382 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995c032440 con 0x7f997415c370 2024-09-11T23:26:03.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.569+0000 7f9971e00640 1 -- 172.21.15.144:0/2806385382 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c032810 con 0x7f997415c370 2024-09-11T23:26:03.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.569+0000 7f9979400640 1 -- 172.21.15.144:0/2806385382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f997415c370 msgr2=0x7f997406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:03.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.569+0000 7f9979400640 1 --2- 172.21.15.144:0/2806385382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f997415c370 0x7f997406ea20 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f99740ccee0 tx=0x7f995c02a1c0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.569+0000 7f9979400640 1 -- 172.21.15.144:0/2806385382 shutdown_connections 2024-09-11T23:26:03.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.569+0000 7f9979400640 1 --2- 172.21.15.144:0/2806385382 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f997415c370 0x7f997406ea20 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.569+0000 7f9979400640 1 --2- 172.21.15.144:0/2806385382 >> v2:172.21.15.165:3300/0 conn(0x7f997406ef60 0x7f997415ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.569+0000 7f9979400640 1 --2- 172.21.15.144:0/2806385382 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9974158e50 0x7f99740b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.571 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.569+0000 7f9979400640 1 -- 172.21.15.144:0/2806385382 >> 172.21.15.144:0/2806385382 conn(0x7f997406bba0 msgr2=0x7f997406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:03.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.569+0000 7f9979400640 1 -- 172.21.15.144:0/2806385382 shutdown_connections 2024-09-11T23:26:03.572 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.569+0000 7f9979400640 1 -- 172.21.15.144:0/2806385382 wait complete. 2024-09-11T23:26:03.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.571+0000 7f9979400640 1 Processor -- start 2024-09-11T23:26:03.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.571+0000 7f9979400640 1 -- start start 2024-09-11T23:26:03.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.572+0000 7f9979400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f997406ef60 0x7f99740c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:03.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.572+0000 7f9979400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9974158e50 0x7f99740af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:03.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.572+0000 7f9979400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f997415c370 0x7f99741f7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:03.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.572+0000 7f9979400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f99740b3ed0 con 0x7f9974158e50 2024-09-11T23:26:03.574 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.572+0000 7f9979400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f99740b3bf0 con 0x7f997415c370 2024-09-11T23:26:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.572+0000 7f9979400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9974159230 con 0x7f997406ef60 2024-09-11T23:26:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.572+0000 7f9969e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9974158e50 0x7f99740af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.572+0000 7f9969e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9974158e50 0x7f99740af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:41036/0 (socket says 172.21.15.144:41036) 2024-09-11T23:26:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.572+0000 7f9969e00640 1 -- 172.21.15.144:0/410313030 learned_addr learned my addr 172.21.15.144:0/410313030 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.572+0000 7f9973200640 1 --2- 172.21.15.144:0/410313030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f997415c370 0x7f99741f7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.572+0000 7f9972800640 1 --2- 172.21.15.144:0/410313030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f997406ef60 0x7f99740c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.572+0000 7f9969e00640 1 -- 172.21.15.144:0/410313030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f997406ef60 msgr2=0x7f99740c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.572+0000 7f9969e00640 1 --2- 172.21.15.144:0/410313030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f997406ef60 0x7f99740c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.573+0000 7f9969e00640 1 -- 172.21.15.144:0/410313030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f997415c370 msgr2=0x7f99741f7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.573+0000 7f9969e00640 1 --2- 172.21.15.144:0/410313030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f997415c370 0x7f99741f7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.573+0000 7f9969e00640 1 -- 172.21.15.144:0/410313030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99741f7840 con 0x7f9974158e50 2024-09-11T23:26:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.573+0000 7f9969e00640 1 --2- 172.21.15.144:0/410313030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9974158e50 0x7f99740af2c0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f995c000c00 tx=0x7f995c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:03.575 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.573+0000 7f996b400640 1 -- 172.21.15.144:0/410313030 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c041020 con 0x7f9974158e50 2024-09-11T23:26:03.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.573+0000 7f996b400640 1 -- 172.21.15.144:0/410313030 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995c030970 con 0x7f9974158e50 2024-09-11T23:26:03.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.573+0000 7f9979400640 1 -- 172.21.15.144:0/410313030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9974148da0 con 0x7f9974158e50 2024-09-11T23:26:03.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.573+0000 7f996b400640 1 -- 172.21.15.144:0/410313030 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c037040 con 0x7f9974158e50 2024-09-11T23:26:03.576 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.573+0000 7f9979400640 1 -- 172.21.15.144:0/410313030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9974149360 con 0x7f9974158e50 2024-09-11T23:26:03.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.574+0000 7f9979400640 1 -- 172.21.15.144:0/410313030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9974072860 con 0x7f9974158e50 2024-09-11T23:26:03.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.575+0000 7f996b400640 1 -- 172.21.15.144:0/410313030 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f995c044020 con 0x7f9974158e50 2024-09-11T23:26:03.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.576+0000 7f996b400640 1 --2- 172.21.15.144:0/410313030 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f995006c610 0x7f995006ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:03.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.576+0000 7f996b400640 1 -- 172.21.15.144:0/410313030 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f995c0aca20 con 0x7f9974158e50 2024-09-11T23:26:03.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.576+0000 7f9972800640 1 --2- 172.21.15.144:0/410313030 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f995006c610 0x7f995006ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:03.577 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.577+0000 7f9972800640 1 --2- 172.21.15.144:0/410313030 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f995006c610 0x7f995006ead0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9964009990 tx=0x7f9964009110 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:03.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.580+0000 7f996b400640 1 -- 172.21.15.144:0/410313030 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f995c04b030 con 0x7f9974158e50 2024-09-11T23:26:03.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.754+0000 7f9979400640 1 -- 172.21.15.144:0/410313030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f9974072580 con 0x7f9974158e50 2024-09-11T23:26:03.755 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.755+0000 7f996b400640 1 -- 172.21.15.144:0/410313030 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f995c07a3b0 con 0x7f9974158e50 2024-09-11T23:26:03.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.757+0000 7f9979400640 1 -- 172.21.15.144:0/410313030 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f995006c610 msgr2=0x7f995006ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:03.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.757+0000 7f9979400640 1 --2- 172.21.15.144:0/410313030 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f995006c610 0x7f995006ead0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9964009990 tx=0x7f9964009110 comp rx=0 tx=0).stop 2024-09-11T23:26:03.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.757+0000 7f9979400640 1 -- 172.21.15.144:0/410313030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9974158e50 msgr2=0x7f99740af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:03.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.757+0000 7f9979400640 1 --2- 172.21.15.144:0/410313030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9974158e50 0x7f99740af2c0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f995c000c00 tx=0x7f995c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.757+0000 7f9979400640 1 -- 172.21.15.144:0/410313030 shutdown_connections 2024-09-11T23:26:03.758 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.757+0000 7f9979400640 1 --2- 172.21.15.144:0/410313030 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f995006c610 0x7f995006ead0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.757+0000 7f9979400640 1 --2- 172.21.15.144:0/410313030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f997415c370 0x7f99741f7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.757+0000 7f9979400640 1 --2- 172.21.15.144:0/410313030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9974158e50 0x7f99740af2c0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.757+0000 7f9979400640 1 --2- 172.21.15.144:0/410313030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f997406ef60 0x7f99740c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:03.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.757+0000 7f9979400640 1 -- 172.21.15.144:0/410313030 >> 172.21.15.144:0/410313030 conn(0x7f997406bba0 msgr2=0x7f997406e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:03.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.757+0000 7f9979400640 1 -- 172.21.15.144:0/410313030 shutdown_connections 2024-09-11T23:26:03.759 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:03.757+0000 7f9979400640 1 -- 172.21.15.144:0/410313030 wait complete. 2024-09-11T23:26:03.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:03.775 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol10500/e543a314-bc71-4b05-b97b-ae4ef6b9368b) 2024-09-11T23:26:03.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:03.839 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-11T23:26:03.876 INFO:teuthology.orchestra.run.smithi144.stdout:cephfs_data 2024-09-11T23:26:03.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:03.876 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol10500/e543a314-bc71-4b05-b97b-ae4ef6b9368b) 2024-09-11T23:26:03.979 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:26:03.979 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol10500/.meta 2024-09-11T23:26:04.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:04.040 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/subvol_grp20160/subvol85241/2df6902c-c362-408d-8f4e-e61ad9c85d01) 2024-09-11T23:26:04.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:04.140 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-11T23:26:04.176 INFO:teuthology.orchestra.run.smithi144.stdout:cephfs_data 2024-09-11T23:26:04.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:04.176 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/subvol_grp20160/subvol85241/2df6902c-c362-408d-8f4e-e61ad9c85d01) 2024-09-11T23:26:04.278 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:26:04.278 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/subvol_grp20160/subvol85241/.meta 2024-09-11T23:26:04.334 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol10500 2024-09-11T23:26:04.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.530+0000 7fa351e00640 1 Processor -- start 2024-09-11T23:26:04.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.531+0000 7fa351e00640 1 -- start start 2024-09-11T23:26:04.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.532+0000 7fa351e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa34c158e50 0x7fa34c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:04.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.532+0000 7fa351e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa34c0b43f0 con 0x7fa34c06f130 2024-09-11T23:26:04.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.532+0000 7fa351e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa34c15c7d0 con 0x7fa34c15c370 2024-09-11T23:26:04.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.532+0000 7fa351e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa34c0b3630 con 0x7fa34c158e50 2024-09-11T23:26:04.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.532+0000 7fa34b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa34c06f130 0x7fa34c0ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50760/0 (socket says 172.21.15.144:50760) 2024-09-11T23:26:04.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.532+0000 7fa34b400640 1 -- 172.21.15.144:0/891227438 learned_addr learned my addr 172.21.15.144:0/891227438 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:04.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.532+0000 7fa34aa00640 1 --2- 172.21.15.144:0/891227438 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa34c158e50 0x7fa34c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:04.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.532+0000 7fa349600640 1 -- 172.21.15.144:0/891227438 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2928889189 0 0) 0x7fa34c0b43f0 con 0x7fa34c06f130 2024-09-11T23:26:04.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.532+0000 7fa349600640 1 -- 172.21.15.144:0/891227438 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa330005730 con 0x7fa34c06f130 2024-09-11T23:26:04.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.533+0000 7fa349600640 1 -- 172.21.15.144:0/891227438 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2216969760 0 0) 0x7fa34c15c7d0 con 0x7fa34c15c370 2024-09-11T23:26:04.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.533+0000 7fa349600640 1 -- 172.21.15.144:0/891227438 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa34c0b43f0 con 0x7fa34c15c370 2024-09-11T23:26:04.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.533+0000 7fa349600640 1 -- 172.21.15.144:0/891227438 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1009719994 0 0) 0x7fa330005730 con 0x7fa34c06f130 2024-09-11T23:26:04.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.533+0000 7fa349600640 1 -- 172.21.15.144:0/891227438 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa34c158e50 msgr2=0x7fa34c0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:04.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.533+0000 7fa349600640 1 --2- 172.21.15.144:0/891227438 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa34c158e50 0x7fa34c0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:04.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.533+0000 7fa349600640 1 -- 172.21.15.144:0/891227438 >> v1:172.21.15.165:6789/0 conn(0x7fa34c15c370 legacy=0x7fa34c06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:04.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.533+0000 7fa349600640 1 -- 172.21.15.144:0/891227438 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa34c0b3910 con 0x7fa34c06f130 2024-09-11T23:26:04.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.533+0000 7fa349600640 1 -- 172.21.15.144:0/891227438 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fa3440019f0 con 0x7fa34c06f130 2024-09-11T23:26:04.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.533+0000 7fa349600640 1 -- 172.21.15.144:0/891227438 >> v1:172.21.15.144:6789/0 conn(0x7fa34c06f130 legacy=0x7fa34c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:04.535 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.533+0000 7fa349600640 1 --2- 172.21.15.144:0/891227438 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa330005d80 0x7fa330006180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:04.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.533+0000 7fa349600640 1 --2- 172.21.15.144:0/891227438 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa34c158e50 0x7fa330006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:04.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.533+0000 7fa349600640 1 --2- 172.21.15.144:0/891227438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa330006f50 0x7fa3300073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:04.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.533+0000 7fa349600640 1 -- 172.21.15.144:0/891227438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa34c0b3630 con 0x7fa330006f50 2024-09-11T23:26:04.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.533+0000 7fa349600640 1 -- 172.21.15.144:0/891227438 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa33000dc80 con 0x7fa330005d80 2024-09-11T23:26:04.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.533+0000 7fa349600640 1 -- 172.21.15.144:0/891227438 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa33000de30 con 0x7fa34c158e50 2024-09-11T23:26:04.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.533+0000 7fa34b400640 1 --2- 172.21.15.144:0/891227438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa330006f50 0x7fa3300073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:04.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.533+0000 7fa34aa00640 1 --2- 172.21.15.144:0/891227438 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa330005d80 0x7fa330006180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:04.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.533+0000 7fa34a000640 1 --2- 172.21.15.144:0/891227438 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa34c158e50 0x7fa330006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:04.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.534+0000 7fa34b400640 1 -- 172.21.15.144:0/891227438 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa34c158e50 msgr2=0x7fa330006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:04.536 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.534+0000 7fa34b400640 1 --2- 172.21.15.144:0/891227438 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa34c158e50 0x7fa330006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:04.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.534+0000 7fa34b400640 1 -- 172.21.15.144:0/891227438 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa330005d80 msgr2=0x7fa330006180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:04.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.534+0000 7fa34b400640 1 --2- 172.21.15.144:0/891227438 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa330005d80 0x7fa330006180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:04.537 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.534+0000 7fa34b400640 1 -- 172.21.15.144:0/891227438 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa330005730 con 0x7fa330006f50 2024-09-11T23:26:04.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.534+0000 7fa34b400640 1 --2- 172.21.15.144:0/891227438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa330006f50 0x7fa3300073d0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fa34400a7f0 tx=0x7fa330007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b8ce544f03254 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:04.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.535+0000 7fa349600640 1 -- 172.21.15.144:0/891227438 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34400a450 con 0x7fa330006f50 2024-09-11T23:26:04.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.535+0000 7fa349600640 1 -- 172.21.15.144:0/891227438 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa34402f070 con 0x7fa330006f50 2024-09-11T23:26:04.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.535+0000 7fa349600640 1 -- 172.21.15.144:0/891227438 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa34402bc50 con 0x7fa330006f50 2024-09-11T23:26:04.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.535+0000 7fa351e00640 1 -- 172.21.15.144:0/891227438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa330006f50 msgr2=0x7fa3300073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:04.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.535+0000 7fa351e00640 1 --2- 172.21.15.144:0/891227438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa330006f50 0x7fa3300073d0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fa34400a7f0 tx=0x7fa330007a40 comp rx=0 tx=0).stop 2024-09-11T23:26:04.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.535+0000 7fa34b400640 1 -- 172.21.15.144:0/891227438 reap_dead start 2024-09-11T23:26:04.538 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.535+0000 7fa351e00640 1 -- 172.21.15.144:0/891227438 shutdown_connections 2024-09-11T23:26:04.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.535+0000 7fa351e00640 1 -- 172.21.15.144:0/891227438 >> 172.21.15.144:0/891227438 conn(0x7fa34c06bba0 msgr2=0x7fa34c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:04.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.535+0000 7fa351e00640 1 -- 172.21.15.144:0/891227438 shutdown_connections 2024-09-11T23:26:04.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.535+0000 7fa351e00640 1 -- 172.21.15.144:0/891227438 wait complete. 2024-09-11T23:26:04.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.537+0000 7fa351e00640 1 Processor -- start 2024-09-11T23:26:04.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.537+0000 7fa351e00640 1 -- start start 2024-09-11T23:26:04.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.538+0000 7fa351e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa34c15a400 0x7fa34c14f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:04.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.538+0000 7fa351e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa34c15a7e0 0x7fa34c14fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:04.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.538+0000 7fa351e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa34c15ea50 0x7fa34c15eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:04.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.538+0000 7fa351e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa34c159230 con 0x7fa34c15a7e0 2024-09-11T23:26:04.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.538+0000 7fa351e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa34c0b3ed0 con 0x7fa34c15a400 2024-09-11T23:26:04.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.538+0000 7fa351e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa34c0b5050 con 0x7fa34c15ea50 2024-09-11T23:26:04.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.538+0000 7fa34a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa34c15a7e0 0x7fa34c14fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:04.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.538+0000 7fa34a000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa34c15a7e0 0x7fa34c14fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36308/0 (socket says 172.21.15.144:36308) 2024-09-11T23:26:04.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.538+0000 7fa34a000640 1 -- 172.21.15.144:0/1992506963 learned_addr learned my addr 172.21.15.144:0/1992506963 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:04.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.538+0000 7fa34aa00640 1 --2- 172.21.15.144:0/1992506963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa34c15a400 0x7fa34c14f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:04.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.539+0000 7fa34b400640 1 --2- 172.21.15.144:0/1992506963 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa34c15ea50 0x7fa34c15eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:04.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.539+0000 7fa34a000640 1 -- 172.21.15.144:0/1992506963 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa34c15ea50 msgr2=0x7fa34c15eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:04.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.539+0000 7fa34a000640 1 --2- 172.21.15.144:0/1992506963 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa34c15ea50 0x7fa34c15eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:04.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.539+0000 7fa34a000640 1 -- 172.21.15.144:0/1992506963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa34c15a400 msgr2=0x7fa34c14f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:04.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.539+0000 7fa34a000640 1 --2- 172.21.15.144:0/1992506963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa34c15a400 0x7fa34c14f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:04.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.539+0000 7fa34a000640 1 -- 172.21.15.144:0/1992506963 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa34c15cba0 con 0x7fa34c15a7e0 2024-09-11T23:26:04.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.539+0000 7fa34aa00640 1 --2- 172.21.15.144:0/1992506963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa34c15a400 0x7fa34c14f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:26:04.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.539+0000 7fa34a000640 1 --2- 172.21.15.144:0/1992506963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa34c15a7e0 0x7fa34c14fa90 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fa33800e7b0 tx=0x7fa33800ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:04.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.539+0000 7fa343400640 1 -- 172.21.15.144:0/1992506963 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3380050d0 con 0x7fa34c15a7e0 2024-09-11T23:26:04.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.539+0000 7fa343400640 1 -- 172.21.15.144:0/1992506963 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa338018070 con 0x7fa34c15a7e0 2024-09-11T23:26:04.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.539+0000 7fa351e00640 1 -- 172.21.15.144:0/1992506963 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa34c15ce80 con 0x7fa34c15a7e0 2024-09-11T23:26:04.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.539+0000 7fa343400640 1 -- 172.21.15.144:0/1992506963 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3380054d0 con 0x7fa34c15a7e0 2024-09-11T23:26:04.542 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.539+0000 7fa351e00640 1 -- 172.21.15.144:0/1992506963 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa34c15d440 con 0x7fa34c15a7e0 2024-09-11T23:26:04.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.540+0000 7fa351e00640 1 -- 172.21.15.144:0/1992506963 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa34c0b5480 con 0x7fa34c15a7e0 2024-09-11T23:26:04.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.541+0000 7fa343400640 1 -- 172.21.15.144:0/1992506963 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7fa33800c6c0 con 0x7fa34c15a7e0 2024-09-11T23:26:04.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.542+0000 7fa343400640 1 --2- 172.21.15.144:0/1992506963 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa32c06c7b0 0x7fa32c06ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:04.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.542+0000 7fa343400640 1 -- 172.21.15.144:0/1992506963 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7fa33808be60 con 0x7fa34c15a7e0 2024-09-11T23:26:04.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.543+0000 7fa34aa00640 1 --2- 172.21.15.144:0/1992506963 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa32c06c7b0 0x7fa32c06ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:04.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.543+0000 7fa34aa00640 1 --2- 172.21.15.144:0/1992506963 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa32c06c7b0 0x7fa32c06ec70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa34c15af30 tx=0x7fa33c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:04.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.547+0000 7fa343400640 1 -- 172.21.15.144:0/1992506963 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa3380597f0 con 0x7fa34c15a7e0 2024-09-11T23:26:04.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.746+0000 7fa351e00640 1 -- 172.21.15.144:0/1992506963 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol10500", "target": ["mon-mgr", ""]}) -- 0x7fa34c0cefd0 con 0x7fa32c06c7b0 2024-09-11T23:26:04.754 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:04.754+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:04.754 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:04.754+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:04.754 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:04.754+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:04.755 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:04.754+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:04.755 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:04.754+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:04.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.812+0000 7fa343400640 1 -- 172.21.15.144:0/1992506963 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7fa34c0cefd0 con 0x7fa32c06c7b0 2024-09-11T23:26:04.813 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/_nogroup/subvol10500/e543a314-bc71-4b05-b97b-ae4ef6b9368b 2024-09-11T23:26:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.814+0000 7fa351e00640 1 -- 172.21.15.144:0/1992506963 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa32c06c7b0 msgr2=0x7fa32c06ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.814+0000 7fa351e00640 1 --2- 172.21.15.144:0/1992506963 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa32c06c7b0 0x7fa32c06ec70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa34c15af30 tx=0x7fa33c009190 comp rx=0 tx=0).stop 2024-09-11T23:26:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.814+0000 7fa351e00640 1 -- 172.21.15.144:0/1992506963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa34c15a7e0 msgr2=0x7fa34c14fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.814+0000 7fa351e00640 1 --2- 172.21.15.144:0/1992506963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa34c15a7e0 0x7fa34c14fa90 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fa33800e7b0 tx=0x7fa33800ebb0 comp rx=0 tx=0).stop 2024-09-11T23:26:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.814+0000 7fa351e00640 1 -- 172.21.15.144:0/1992506963 shutdown_connections 2024-09-11T23:26:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.814+0000 7fa351e00640 1 --2- 172.21.15.144:0/1992506963 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa32c06c7b0 0x7fa32c06ec70 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.814+0000 7fa351e00640 1 --2- 172.21.15.144:0/1992506963 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa34c15ea50 0x7fa34c15eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.814+0000 7fa351e00640 1 --2- 172.21.15.144:0/1992506963 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa34c15a7e0 0x7fa34c14fa90 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.814+0000 7fa351e00640 1 --2- 172.21.15.144:0/1992506963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa34c15a400 0x7fa34c14f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:04.815 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.814+0000 7fa351e00640 1 -- 172.21.15.144:0/1992506963 >> 172.21.15.144:0/1992506963 conn(0x7fa34c06bba0 msgr2=0x7fa34c0cf4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:04.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.814+0000 7fa351e00640 1 -- 172.21.15.144:0/1992506963 shutdown_connections 2024-09-11T23:26:04.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.814+0000 7fa351e00640 1 -- 172.21.15.144:0/1992506963 wait complete. 2024-09-11T23:26:04.831 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol85241 subvol_grp20160 2024-09-11T23:26:04.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.988+0000 7fc431c00640 1 Processor -- start 2024-09-11T23:26:04.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.988+0000 7fc431c00640 1 -- start start 2024-09-11T23:26:04.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.989+0000 7fc431c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc42c070710 0x7fc42c070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:04.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.989+0000 7fc431c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc42c15f0d0 0x7fc42c15f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:04.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.989+0000 7fc431c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc42c072fa0 0x7fc42c073430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:04.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.989+0000 7fc431c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc42c06d400 con 0x7fc42c15f0d0 2024-09-11T23:26:04.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.989+0000 7fc431c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc42c071030 con 0x7fc42c070710 2024-09-11T23:26:04.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.989+0000 7fc431c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc42c162440 con 0x7fc42c072fa0 2024-09-11T23:26:04.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.990+0000 7fc423400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc42c15f0d0 0x7fc42c15f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:04.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.990+0000 7fc423400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc42c15f0d0 0x7fc42c15f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36310/0 (socket says 172.21.15.144:36310) 2024-09-11T23:26:04.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.990+0000 7fc423400640 1 -- 172.21.15.144:0/2291337473 learned_addr learned my addr 172.21.15.144:0/2291337473 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:04.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.990+0000 7fc431200640 1 --2- 172.21.15.144:0/2291337473 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc42c072fa0 0x7fc42c073430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:04.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.990+0000 7fc42be00640 1 --2- 172.21.15.144:0/2291337473 >> v2:172.21.15.165:3300/0 conn(0x7fc42c070710 0x7fc42c070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:04.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.990+0000 7fc423400640 1 -- 172.21.15.144:0/2291337473 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc42c072fa0 msgr2=0x7fc42c073430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:04.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.990+0000 7fc423400640 1 --2- 172.21.15.144:0/2291337473 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc42c072fa0 0x7fc42c073430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:04.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.990+0000 7fc423400640 1 -- 172.21.15.144:0/2291337473 >> v2:172.21.15.165:3300/0 conn(0x7fc42c070710 msgr2=0x7fc42c070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:04.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.990+0000 7fc423400640 1 --2- 172.21.15.144:0/2291337473 >> v2:172.21.15.165:3300/0 conn(0x7fc42c070710 0x7fc42c070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:04.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.990+0000 7fc423400640 1 -- 172.21.15.144:0/2291337473 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42c162720 con 0x7fc42c15f0d0 2024-09-11T23:26:04.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.991+0000 7fc423400640 1 --2- 172.21.15.144:0/2291337473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc42c15f0d0 0x7fc42c15f530 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0697b0 tx=0x7fc41402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43d8cf638effae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:04.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.991+0000 7fc42b400640 1 -- 172.21.15.144:0/2291337473 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc414037070 con 0x7fc42c15f0d0 2024-09-11T23:26:04.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.992+0000 7fc42b400640 1 -- 172.21.15.144:0/2291337473 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc414032440 con 0x7fc42c15f0d0 2024-09-11T23:26:04.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.992+0000 7fc42b400640 1 -- 172.21.15.144:0/2291337473 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc414032810 con 0x7fc42c15f0d0 2024-09-11T23:26:04.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.992+0000 7fc431c00640 1 -- 172.21.15.144:0/2291337473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc42c15f0d0 msgr2=0x7fc42c15f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:04.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.992+0000 7fc431c00640 1 --2- 172.21.15.144:0/2291337473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc42c15f0d0 0x7fc42c15f530 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0697b0 tx=0x7fc41402a270 comp rx=0 tx=0).stop 2024-09-11T23:26:04.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.992+0000 7fc431c00640 1 -- 172.21.15.144:0/2291337473 shutdown_connections 2024-09-11T23:26:04.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.992+0000 7fc431c00640 1 --2- 172.21.15.144:0/2291337473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc42c15f0d0 0x7fc42c15f530 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:04.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.992+0000 7fc431c00640 1 --2- 172.21.15.144:0/2291337473 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc42c072fa0 0x7fc42c073430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:04.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.992+0000 7fc431c00640 1 --2- 172.21.15.144:0/2291337473 >> v2:172.21.15.165:3300/0 conn(0x7fc42c070710 0x7fc42c070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:04.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.992+0000 7fc431c00640 1 -- 172.21.15.144:0/2291337473 >> 172.21.15.144:0/2291337473 conn(0x7fc42c0b40d0 msgr2=0x7fc42c0b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:04.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.992+0000 7fc431c00640 1 -- 172.21.15.144:0/2291337473 shutdown_connections 2024-09-11T23:26:04.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.992+0000 7fc431c00640 1 -- 172.21.15.144:0/2291337473 wait complete. 2024-09-11T23:26:04.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.994+0000 7fc431c00640 1 Processor -- start 2024-09-11T23:26:04.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.994+0000 7fc431c00640 1 -- start start 2024-09-11T23:26:04.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.995+0000 7fc431c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc42c070710 0x7fc42c1593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:04.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.995+0000 7fc431c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc42c072fa0 0x7fc42c0d1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:04.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.995+0000 7fc431c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc42c15f0d0 0x7fc42c1533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:04.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.995+0000 7fc431c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c0b60d0 con 0x7fc42c070710 2024-09-11T23:26:04.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.995+0000 7fc431c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c162ce0 con 0x7fc42c15f0d0 2024-09-11T23:26:04.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.995+0000 7fc431c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc42c0b6250 con 0x7fc42c072fa0 2024-09-11T23:26:04.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.995+0000 7fc42be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc42c070710 0x7fc42c1593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:04.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.995+0000 7fc42be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc42c070710 0x7fc42c1593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36322/0 (socket says 172.21.15.144:36322) 2024-09-11T23:26:04.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.995+0000 7fc42be00640 1 -- 172.21.15.144:0/546493772 learned_addr learned my addr 172.21.15.144:0/546493772 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:04.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.995+0000 7fc431200640 1 --2- 172.21.15.144:0/546493772 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc42c15f0d0 0x7fc42c1533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:04.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.995+0000 7fc423400640 1 --2- 172.21.15.144:0/546493772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc42c072fa0 0x7fc42c0d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:04.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.996+0000 7fc42be00640 1 -- 172.21.15.144:0/546493772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc42c072fa0 msgr2=0x7fc42c0d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:04.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.996+0000 7fc42be00640 1 --2- 172.21.15.144:0/546493772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc42c072fa0 0x7fc42c0d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:04.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.996+0000 7fc42be00640 1 -- 172.21.15.144:0/546493772 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc42c15f0d0 msgr2=0x7fc42c1533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:04.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.996+0000 7fc42be00640 1 --2- 172.21.15.144:0/546493772 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc42c15f0d0 0x7fc42c1533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:04.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.996+0000 7fc42be00640 1 -- 172.21.15.144:0/546493772 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42c155d60 con 0x7fc42c070710 2024-09-11T23:26:04.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.996+0000 7fc423400640 1 --2- 172.21.15.144:0/546493772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc42c072fa0 0x7fc42c0d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:04.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.996+0000 7fc42be00640 1 --2- 172.21.15.144:0/546493772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc42c070710 0x7fc42c1593b0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00e890 tx=0x7fc41c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:04.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.996+0000 7fc428c00640 1 -- 172.21.15.144:0/546493772 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c017070 con 0x7fc42c070710 2024-09-11T23:26:04.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.996+0000 7fc428c00640 1 -- 172.21.15.144:0/546493772 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc41c00c8e0 con 0x7fc42c070710 2024-09-11T23:26:04.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.996+0000 7fc431c00640 1 -- 172.21.15.144:0/546493772 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc42c156040 con 0x7fc42c070710 2024-09-11T23:26:04.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.996+0000 7fc428c00640 1 -- 172.21.15.144:0/546493772 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c00ccb0 con 0x7fc42c070710 2024-09-11T23:26:04.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.996+0000 7fc431c00640 1 -- 172.21.15.144:0/546493772 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc42c154190 con 0x7fc42c070710 2024-09-11T23:26:04.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.998+0000 7fc431c00640 1 -- 172.21.15.144:0/546493772 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc42c161ff0 con 0x7fc42c070710 2024-09-11T23:26:04.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.998+0000 7fc428c00640 1 -- 172.21.15.144:0/546493772 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7fc41c01a070 con 0x7fc42c070710 2024-09-11T23:26:05.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.999+0000 7fc428c00640 1 --2- 172.21.15.144:0/546493772 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc40806c640 0x7fc40806eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:05.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:04.999+0000 7fc428c00640 1 -- 172.21.15.144:0/546493772 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7fc41c089ab0 con 0x7fc42c070710 2024-09-11T23:26:05.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.000+0000 7fc423400640 1 --2- 172.21.15.144:0/546493772 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc40806c640 0x7fc40806eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:05.001 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.001+0000 7fc423400640 1 --2- 172.21.15.144:0/546493772 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc40806c640 0x7fc40806eb00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc414034000 tx=0x7fc41402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:05.004 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.004+0000 7fc428c00640 1 -- 172.21.15.144:0/546493772 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc41c059700 con 0x7fc42c070710 2024-09-11T23:26:05.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.204+0000 7fc431c00640 1 -- 172.21.15.144:0/546493772 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol85241", "group_name": "subvol_grp20160", "target": ["mon-mgr", ""]}) -- 0x7fc42c06e600 con 0x7fc40806c640 2024-09-11T23:26:05.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.259+0000 7fc428c00640 1 -- 172.21.15.144:0/546493772 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+74 (secure 0 0 0) 0x7fc42c06e600 con 0x7fc40806c640 2024-09-11T23:26:05.260 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/subvol_grp20160/subvol85241/2df6902c-c362-408d-8f4e-e61ad9c85d01 2024-09-11T23:26:05.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.262+0000 7fc431c00640 1 -- 172.21.15.144:0/546493772 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc40806c640 msgr2=0x7fc40806eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:05.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.262+0000 7fc431c00640 1 --2- 172.21.15.144:0/546493772 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc40806c640 0x7fc40806eb00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc414034000 tx=0x7fc41402e000 comp rx=0 tx=0).stop 2024-09-11T23:26:05.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.262+0000 7fc431c00640 1 -- 172.21.15.144:0/546493772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc42c070710 msgr2=0x7fc42c1593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:05.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.262+0000 7fc431c00640 1 --2- 172.21.15.144:0/546493772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc42c070710 0x7fc42c1593b0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00e890 tx=0x7fc41c00ed50 comp rx=0 tx=0).stop 2024-09-11T23:26:05.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.262+0000 7fc431c00640 1 -- 172.21.15.144:0/546493772 shutdown_connections 2024-09-11T23:26:05.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.262+0000 7fc431c00640 1 --2- 172.21.15.144:0/546493772 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc40806c640 0x7fc40806eb00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.262+0000 7fc431c00640 1 --2- 172.21.15.144:0/546493772 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc42c15f0d0 0x7fc42c1533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.262+0000 7fc431c00640 1 --2- 172.21.15.144:0/546493772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc42c072fa0 0x7fc42c0d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.262+0000 7fc431c00640 1 --2- 172.21.15.144:0/546493772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc42c070710 0x7fc42c1593b0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.262+0000 7fc431c00640 1 -- 172.21.15.144:0/546493772 >> 172.21.15.144:0/546493772 conn(0x7fc42c0b40d0 msgr2=0x7fc42c06d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:05.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.262+0000 7fc431c00640 1 -- 172.21.15.144:0/546493772 shutdown_connections 2024-09-11T23:26:05.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.262+0000 7fc431c00640 1 -- 172.21.15.144:0/546493772 wait complete. 2024-09-11T23:26:05.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:05.279 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol10500/.meta) 2024-09-11T23:26:05.335 INFO:teuthology.orchestra.run.smithi144.stdout:[GLOBAL] 2024-09-11T23:26:05.335 INFO:teuthology.orchestra.run.smithi144.stdout:version = 2 2024-09-11T23:26:05.335 INFO:teuthology.orchestra.run.smithi144.stdout:type = subvolume 2024-09-11T23:26:05.335 INFO:teuthology.orchestra.run.smithi144.stdout:path = /volumes/_nogroup/subvol10500/e543a314-bc71-4b05-b97b-ae4ef6b9368b 2024-09-11T23:26:05.335 INFO:teuthology.orchestra.run.smithi144.stdout:state = complete 2024-09-11T23:26:05.335 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:05.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:05.338 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/subvol_grp20160/subvol85241/.meta) 2024-09-11T23:26:05.393 INFO:teuthology.orchestra.run.smithi144.stdout:[GLOBAL] 2024-09-11T23:26:05.393 INFO:teuthology.orchestra.run.smithi144.stdout:version = 2 2024-09-11T23:26:05.393 INFO:teuthology.orchestra.run.smithi144.stdout:type = subvolume 2024-09-11T23:26:05.394 INFO:teuthology.orchestra.run.smithi144.stdout:path = /volumes/subvol_grp20160/subvol85241/2df6902c-c362-408d-8f4e-e61ad9c85d01 2024-09-11T23:26:05.394 INFO:teuthology.orchestra.run.smithi144.stdout:state = complete 2024-09-11T23:26:05.394 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:05.397 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol10500 2024-09-11T23:26:05.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.552+0000 7f280dc00640 1 Processor -- start 2024-09-11T23:26:05.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.552+0000 7f280dc00640 1 -- start start 2024-09-11T23:26:05.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.554+0000 7f280dc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f280806f130 0x7f28080b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:05.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.554+0000 7f280dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f280815c370 0x7f28080ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:05.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.554+0000 7f280dc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f280815c820 con 0x7f2808158e50 2024-09-11T23:26:05.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.554+0000 7f280dc00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f28080b43f0 con 0x7f280806f130 2024-09-11T23:26:05.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.554+0000 7f280dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f28080b3630 con 0x7f280815c370 2024-09-11T23:26:05.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.554+0000 7f27fe000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f280806f130 0x7f28080b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:05.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.554+0000 7f27fe000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f280806f130 0x7f28080b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36328/0 (socket says 172.21.15.144:36328) 2024-09-11T23:26:05.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.554+0000 7f27fe000640 1 -- 172.21.15.144:0/2827457286 learned_addr learned my addr 172.21.15.144:0/2827457286 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:05.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.554+0000 7f2807400640 1 --2- 172.21.15.144:0/2827457286 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f280815c370 0x7f28080ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:05.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.554+0000 7f27fe000640 1 -- 172.21.15.144:0/2827457286 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f280815c370 msgr2=0x7f28080ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:05.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.555+0000 7f27fe000640 1 --2- 172.21.15.144:0/2827457286 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f280815c370 0x7f28080ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.555+0000 7f27fe000640 1 -- 172.21.15.144:0/2827457286 >> v1:172.21.15.144:6789/0 conn(0x7f2808158e50 legacy=0x7f280806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:05.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.555+0000 7f2806000640 1 -- 172.21.15.144:0/2827457286 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1752698784 0 0) 0x7f27f8001110 con 0x7f2808158e50 2024-09-11T23:26:05.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.555+0000 7f27fe000640 1 -- 172.21.15.144:0/2827457286 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28080b3910 con 0x7f280806f130 2024-09-11T23:26:05.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.556+0000 7f27fe000640 1 --2- 172.21.15.144:0/2827457286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f280806f130 0x7f28080b5050 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f27f000baf0 tx=0x7f27f002c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1789efde63d6730 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:05.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.556+0000 7f2806000640 1 -- 172.21.15.144:0/2827457286 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f0004230 con 0x7f280806f130 2024-09-11T23:26:05.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.556+0000 7f2806000640 1 -- 172.21.15.144:0/2827457286 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f00043d0 con 0x7f280806f130 2024-09-11T23:26:05.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.556+0000 7f2806000640 1 -- 172.21.15.144:0/2827457286 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f0003810 con 0x7f280806f130 2024-09-11T23:26:05.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.556+0000 7f280dc00640 1 -- 172.21.15.144:0/2827457286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f280806f130 msgr2=0x7f28080b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:05.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.556+0000 7f280dc00640 1 --2- 172.21.15.144:0/2827457286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f280806f130 0x7f28080b5050 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f27f000baf0 tx=0x7f27f002c900 comp rx=0 tx=0).stop 2024-09-11T23:26:05.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.556+0000 7f280dc00640 1 -- 172.21.15.144:0/2827457286 shutdown_connections 2024-09-11T23:26:05.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.556+0000 7f280dc00640 1 --2- 172.21.15.144:0/2827457286 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f280815c370 0x7f28080ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.556+0000 7f280dc00640 1 --2- 172.21.15.144:0/2827457286 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f280806f130 0x7f28080b5050 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.556+0000 7f280dc00640 1 -- 172.21.15.144:0/2827457286 >> 172.21.15.144:0/2827457286 conn(0x7f280806bba0 msgr2=0x7f280806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:05.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.556+0000 7f280dc00640 1 -- 172.21.15.144:0/2827457286 shutdown_connections 2024-09-11T23:26:05.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.557+0000 7f280dc00640 1 -- 172.21.15.144:0/2827457286 wait complete. 2024-09-11T23:26:05.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.558+0000 7f280dc00640 1 Processor -- start 2024-09-11T23:26:05.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.558+0000 7f280dc00640 1 -- start start 2024-09-11T23:26:05.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.559+0000 7f280dc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f280806f130 0x7f280814dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:05.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.559+0000 7f280dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2808158e50 0x7f28081f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:05.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.559+0000 7f280dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f280815c370 0x7f28080ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:05.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.559+0000 7f280dc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2808159230 con 0x7f280815c370 2024-09-11T23:26:05.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.559+0000 7f280dc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f28080b3ed0 con 0x7f280806f130 2024-09-11T23:26:05.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.559+0000 7f280dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f28080ce740 con 0x7f2808158e50 2024-09-11T23:26:05.561 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.559+0000 7f2807400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f280815c370 0x7f28080ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:05.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.559+0000 7f2807400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f280815c370 0x7f28080ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36338/0 (socket says 172.21.15.144:36338) 2024-09-11T23:26:05.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.559+0000 7f2807400640 1 -- 172.21.15.144:0/577814121 learned_addr learned my addr 172.21.15.144:0/577814121 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:05.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.559+0000 7f2806a00640 1 --2- 172.21.15.144:0/577814121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f280806f130 0x7f280814dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:05.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.559+0000 7f27fe000640 1 --2- 172.21.15.144:0/577814121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2808158e50 0x7f28081f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:05.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.560+0000 7f2807400640 1 -- 172.21.15.144:0/577814121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2808158e50 msgr2=0x7f28081f7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:05.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.560+0000 7f2807400640 1 --2- 172.21.15.144:0/577814121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2808158e50 0x7f28081f7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.560+0000 7f2807400640 1 -- 172.21.15.144:0/577814121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f280806f130 msgr2=0x7f280814dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:05.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.560+0000 7f2807400640 1 --2- 172.21.15.144:0/577814121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f280806f130 0x7f280814dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.560+0000 7f2807400640 1 -- 172.21.15.144:0/577814121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28081f8960 con 0x7f280815c370 2024-09-11T23:26:05.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.560+0000 7f2807400640 1 --2- 172.21.15.144:0/577814121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f280815c370 0x7f28080ae8e0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f2800007e60 tx=0x7f280000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:05.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.560+0000 7f27ff400640 1 -- 172.21.15.144:0/577814121 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2800014420 con 0x7f280815c370 2024-09-11T23:26:05.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.560+0000 7f27ff400640 1 -- 172.21.15.144:0/577814121 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2800019070 con 0x7f280815c370 2024-09-11T23:26:05.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.560+0000 7f27ff400640 1 -- 172.21.15.144:0/577814121 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2800014820 con 0x7f280815c370 2024-09-11T23:26:05.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.560+0000 7f280dc00640 1 -- 172.21.15.144:0/577814121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28081f8c40 con 0x7f280815c370 2024-09-11T23:26:05.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.560+0000 7f280dc00640 1 -- 172.21.15.144:0/577814121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f280814e500 con 0x7f280815c370 2024-09-11T23:26:05.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.562+0000 7f280dc00640 1 -- 172.21.15.144:0/577814121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28080ce200 con 0x7f280815c370 2024-09-11T23:26:05.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.562+0000 7f27ff400640 1 -- 172.21.15.144:0/577814121 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7f28000149c0 con 0x7f280815c370 2024-09-11T23:26:05.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.563+0000 7f27ff400640 1 --2- 172.21.15.144:0/577814121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f27e406c610 0x7f27e406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:05.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.563+0000 7f27ff400640 1 -- 172.21.15.144:0/577814121 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f280008c640 con 0x7f280815c370 2024-09-11T23:26:05.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.564+0000 7f2806a00640 1 --2- 172.21.15.144:0/577814121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f27e406c610 0x7f27e406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:05.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.565+0000 7f2806a00640 1 --2- 172.21.15.144:0/577814121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f27e406c610 0x7f27e406ead0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f27f8000f60 tx=0x7f27f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:05.568 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.567+0000 7f27ff400640 1 -- 172.21.15.144:0/577814121 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2800059b50 con 0x7f280815c370 2024-09-11T23:26:05.767 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.766+0000 7f280dc00640 1 -- 172.21.15.144:0/577814121 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol10500", "target": ["mon-mgr", ""]}) -- 0x7f28080ca530 con 0x7f27e406c610 2024-09-11T23:26:05.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.781+0000 7f27ff400640 1 -- 172.21.15.144:0/577814121 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f27f8007e10 con 0x7f27e406c610 2024-09-11T23:26:05.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.784+0000 7f280dc00640 1 -- 172.21.15.144:0/577814121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f27e406c610 msgr2=0x7f27e406ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:05.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.784+0000 7f280dc00640 1 --2- 172.21.15.144:0/577814121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f27e406c610 0x7f27e406ead0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f27f8000f60 tx=0x7f27f8009040 comp rx=0 tx=0).stop 2024-09-11T23:26:05.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.784+0000 7f280dc00640 1 -- 172.21.15.144:0/577814121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f280815c370 msgr2=0x7f28080ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:05.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.784+0000 7f280dc00640 1 --2- 172.21.15.144:0/577814121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f280815c370 0x7f28080ae8e0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f2800007e60 tx=0x7f280000e4b0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.784+0000 7f280dc00640 1 -- 172.21.15.144:0/577814121 shutdown_connections 2024-09-11T23:26:05.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.784+0000 7f280dc00640 1 --2- 172.21.15.144:0/577814121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f27e406c610 0x7f27e406ead0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.784+0000 7f280dc00640 1 --2- 172.21.15.144:0/577814121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f280815c370 0x7f28080ae8e0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.784+0000 7f280dc00640 1 --2- 172.21.15.144:0/577814121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2808158e50 0x7f28081f7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.784+0000 7f280dc00640 1 --2- 172.21.15.144:0/577814121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f280806f130 0x7f280814dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.784+0000 7f280dc00640 1 -- 172.21.15.144:0/577814121 >> 172.21.15.144:0/577814121 conn(0x7f280806bba0 msgr2=0x7f2808074d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:05.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.784+0000 7f280dc00640 1 -- 172.21.15.144:0/577814121 shutdown_connections 2024-09-11T23:26:05.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.784+0000 7f280dc00640 1 -- 172.21.15.144:0/577814121 wait complete. 2024-09-11T23:26:05.790 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:05.790+0000 7f30e0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:05.790 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:05.790+0000 7f30e0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:05.790 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:05.790+0000 7f30e0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:05.790 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:05.790+0000 7f30e0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:05.790 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:05.790+0000 7f30e0a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:05.801 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol85241 subvol_grp20160 2024-09-11T23:26:05.808 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:05.808+0000 7f30e1400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:05.808 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:05.808+0000 7f30e1400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:05.808 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:05.808+0000 7f30e1400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:05.808 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:05.808+0000 7f30e1400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:05.808 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:05.808+0000 7f30e1400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:05.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.960+0000 7fc33fe00640 1 Processor -- start 2024-09-11T23:26:05.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.960+0000 7fc33fe00640 1 -- start start 2024-09-11T23:26:05.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.961+0000 7fc33fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc3400d32d0 0x7fc34006d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:05.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.961+0000 7fc33fe00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3400d3890 con 0x7fc34006db50 2024-09-11T23:26:05.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.961+0000 7fc33fe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3400d3b70 con 0x7fc34015e650 2024-09-11T23:26:05.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.961+0000 7fc33fe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc34015ea30 con 0x7fc3400d32d0 2024-09-11T23:26:05.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.962+0000 7fc33f400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fc34006db50 0x7fc3400b7cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:50786/0 (socket says 172.21.15.144:50786) 2024-09-11T23:26:05.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.962+0000 7fc33f400640 1 -- 172.21.15.144:0/3081388255 learned_addr learned my addr 172.21.15.144:0/3081388255 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:05.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.962+0000 7fc336000640 1 --2- 172.21.15.144:0/3081388255 >> v2:172.21.15.165:3300/0 conn(0x7fc3400d32d0 0x7fc34006d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:05.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.962+0000 7fc33e000640 1 -- 172.21.15.144:0/3081388255 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1359419290 0 0) 0x7fc3400d3890 con 0x7fc34006db50 2024-09-11T23:26:05.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.962+0000 7fc33e000640 1 -- 172.21.15.144:0/3081388255 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc324003520 con 0x7fc34006db50 2024-09-11T23:26:05.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.962+0000 7fc336000640 1 -- 172.21.15.144:0/3081388255 >> v1:172.21.15.165:6789/0 conn(0x7fc34015e650 legacy=0x7fc3400cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:05.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.962+0000 7fc336000640 1 -- 172.21.15.144:0/3081388255 >> v1:172.21.15.144:6789/0 conn(0x7fc34006db50 legacy=0x7fc3400b7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:05.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.962+0000 7fc336000640 1 -- 172.21.15.144:0/3081388255 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3400d3e50 con 0x7fc3400d32d0 2024-09-11T23:26:05.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.963+0000 7fc336000640 1 --2- 172.21.15.144:0/3081388255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3400d32d0 0x7fc34006d610 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc3280097a0 tx=0x7fc32802a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98b3077040912032 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:05.964 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.964+0000 7fc33e000640 1 -- 172.21.15.144:0/3081388255 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc328037070 con 0x7fc3400d32d0 2024-09-11T23:26:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.964+0000 7fc33e000640 1 -- 172.21.15.144:0/3081388255 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc328032640 con 0x7fc3400d32d0 2024-09-11T23:26:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.964+0000 7fc33e000640 1 -- 172.21.15.144:0/3081388255 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3280329f0 con 0x7fc3400d32d0 2024-09-11T23:26:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.964+0000 7fc33fe00640 1 -- 172.21.15.144:0/3081388255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3400d32d0 msgr2=0x7fc34006d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:05.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.964+0000 7fc33fe00640 1 --2- 172.21.15.144:0/3081388255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3400d32d0 0x7fc34006d610 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc3280097a0 tx=0x7fc32802a2c0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.964+0000 7fc33fe00640 1 -- 172.21.15.144:0/3081388255 shutdown_connections 2024-09-11T23:26:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.964+0000 7fc33fe00640 1 --2- 172.21.15.144:0/3081388255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3400d32d0 0x7fc34006d610 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.964+0000 7fc33fe00640 1 -- 172.21.15.144:0/3081388255 >> 172.21.15.144:0/3081388255 conn(0x7fc3400d4740 msgr2=0x7fc3400d4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.964+0000 7fc33fe00640 1 -- 172.21.15.144:0/3081388255 shutdown_connections 2024-09-11T23:26:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.964+0000 7fc33fe00640 1 -- 172.21.15.144:0/3081388255 wait complete. 2024-09-11T23:26:05.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.966+0000 7fc33fe00640 1 Processor -- start 2024-09-11T23:26:05.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.966+0000 7fc33fe00640 1 -- start start 2024-09-11T23:26:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.967+0000 7fc33fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc34006db50 0x7fc34014b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.967+0000 7fc33fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3400d32d0 0x7fc34015a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.967+0000 7fc33fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc34015e650 0x7fc3401e92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.967+0000 7fc33fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc3400b7690 con 0x7fc3400d32d0 2024-09-11T23:26:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.967+0000 7fc33fe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc34006df90 con 0x7fc34015e650 2024-09-11T23:26:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.967+0000 7fc33fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc3400b7810 con 0x7fc34006db50 2024-09-11T23:26:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.967+0000 7fc336000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3400d32d0 0x7fc34015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.967+0000 7fc336000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3400d32d0 0x7fc34015a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36354/0 (socket says 172.21.15.144:36354) 2024-09-11T23:26:05.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.967+0000 7fc336000640 1 -- 172.21.15.144:0/391751772 learned_addr learned my addr 172.21.15.144:0/391751772 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.967+0000 7fc33ea00640 1 --2- 172.21.15.144:0/391751772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc34006db50 0x7fc34014b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.967+0000 7fc33f400640 1 --2- 172.21.15.144:0/391751772 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc34015e650 0x7fc3401e92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.968+0000 7fc336000640 1 -- 172.21.15.144:0/391751772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc34006db50 msgr2=0x7fc34014b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.968+0000 7fc336000640 1 --2- 172.21.15.144:0/391751772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc34006db50 0x7fc34014b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.968+0000 7fc336000640 1 -- 172.21.15.144:0/391751772 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc34015e650 msgr2=0x7fc3401e92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.968+0000 7fc336000640 1 --2- 172.21.15.144:0/391751772 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc34015e650 0x7fc3401e92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.968+0000 7fc336000640 1 -- 172.21.15.144:0/391751772 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc34015acc0 con 0x7fc3400d32d0 2024-09-11T23:26:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.968+0000 7fc33f400640 1 --2- 172.21.15.144:0/391751772 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc34015e650 0x7fc3401e92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.968+0000 7fc336000640 1 --2- 172.21.15.144:0/391751772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3400d32d0 0x7fc34015a420 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fc3280097a0 tx=0x7fc3280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.968+0000 7fc337400640 1 -- 172.21.15.144:0/391751772 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc328040020 con 0x7fc3400d32d0 2024-09-11T23:26:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.968+0000 7fc337400640 1 -- 172.21.15.144:0/391751772 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc328038040 con 0x7fc3400d32d0 2024-09-11T23:26:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.968+0000 7fc337400640 1 -- 172.21.15.144:0/391751772 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc328037070 con 0x7fc3400d32d0 2024-09-11T23:26:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.968+0000 7fc33fe00640 1 -- 172.21.15.144:0/391751772 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc34015afa0 con 0x7fc3400d32d0 2024-09-11T23:26:05.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.968+0000 7fc33fe00640 1 -- 172.21.15.144:0/391751772 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc34015a960 con 0x7fc3400d32d0 2024-09-11T23:26:05.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.969+0000 7fc33fe00640 1 -- 172.21.15.144:0/391751772 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3401e6ca0 con 0x7fc3400d32d0 2024-09-11T23:26:05.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.970+0000 7fc337400640 1 -- 172.21.15.144:0/391751772 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 91212+0+0 (secure 0 0 0) 0x7fc328043020 con 0x7fc3400d32d0 2024-09-11T23:26:05.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.971+0000 7fc337400640 1 --2- 172.21.15.144:0/391751772 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc31c06c610 0x7fc31c06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:05.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.971+0000 7fc337400640 1 -- 172.21.15.144:0/391751772 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7fc3280ac3a0 con 0x7fc3400d32d0 2024-09-11T23:26:05.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.971+0000 7fc33ea00640 1 --2- 172.21.15.144:0/391751772 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc31c06c610 0x7fc31c06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:05.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.972+0000 7fc33ea00640 1 --2- 172.21.15.144:0/391751772 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc31c06c610 0x7fc31c06ead0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc3300016e0 tx=0x7fc330009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:05.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:05.975+0000 7fc337400640 1 -- 172.21.15.144:0/391751772 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc3401e6ca0 con 0x7fc3400d32d0 2024-09-11T23:26:06.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:06.014+0000 7fc337400640 1 -- 172.21.15.144:0/391751772 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mgrmap(e 26) ==== 91263+0+0 (secure 0 0 0) 0x7fc328075ca0 con 0x7fc3400d32d0 2024-09-11T23:26:06.183 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:06.182+0000 7fc33fe00640 1 -- 172.21.15.144:0/391751772 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol85241", "group_name": "subvol_grp20160", "target": ["mon-mgr", ""]}) -- 0x7fc34006d610 con 0x7fc31c06c610 2024-09-11T23:26:08.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:08.038+0000 7fc337400640 1 -- 172.21.15.144:0/391751772 <== mon.0 v2:172.21.15.144:3300/0 8 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7fc3280a9410 con 0x7fc3400d32d0 2024-09-11T23:26:13.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.209+0000 7fc337400640 1 -- 172.21.15.144:0/391751772 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc34006d610 con 0x7fc31c06c610 2024-09-11T23:26:13.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.213+0000 7fc33fe00640 1 -- 172.21.15.144:0/391751772 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc31c06c610 msgr2=0x7fc31c06ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:13.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.213+0000 7fc33fe00640 1 --2- 172.21.15.144:0/391751772 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc31c06c610 0x7fc31c06ead0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc3300016e0 tx=0x7fc330009040 comp rx=0 tx=0).stop 2024-09-11T23:26:13.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.213+0000 7fc33fe00640 1 -- 172.21.15.144:0/391751772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3400d32d0 msgr2=0x7fc34015a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:13.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.213+0000 7fc33fe00640 1 --2- 172.21.15.144:0/391751772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3400d32d0 0x7fc34015a420 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fc3280097a0 tx=0x7fc3280046c0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.213+0000 7fc33fe00640 1 -- 172.21.15.144:0/391751772 shutdown_connections 2024-09-11T23:26:13.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.213+0000 7fc33fe00640 1 --2- 172.21.15.144:0/391751772 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc31c06c610 0x7fc31c06ead0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.213+0000 7fc33fe00640 1 --2- 172.21.15.144:0/391751772 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc34015e650 0x7fc3401e92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.213+0000 7fc33fe00640 1 --2- 172.21.15.144:0/391751772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3400d32d0 0x7fc34015a420 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.213+0000 7fc33fe00640 1 --2- 172.21.15.144:0/391751772 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc34006db50 0x7fc34014b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.213+0000 7fc33fe00640 1 -- 172.21.15.144:0/391751772 >> 172.21.15.144:0/391751772 conn(0x7fc3400d4740 msgr2=0x7fc34015f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:13.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.214+0000 7fc33fe00640 1 -- 172.21.15.144:0/391751772 shutdown_connections 2024-09-11T23:26:13.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.214+0000 7fc33fe00640 1 -- 172.21.15.144:0/391751772 wait complete. 2024-09-11T23:26:13.236 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-11T23:26:13.319 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:26:13.326 INFO:teuthology.orchestra.run.smithi144.stdout:2 2024-09-11T23:26:13.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:26:13.335 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:26:13.335 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:26:13.435 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:26:13.532 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:26:13.532 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:26:13.533 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:26:13.533 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:13.569 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:26:13.569 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:13.645 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:26:13.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.839+0000 7f995dc00640 1 Processor -- start 2024-09-11T23:26:13.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.839+0000 7f995dc00640 1 -- start start 2024-09-11T23:26:13.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.840+0000 7f995dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99580d0a50 0x7f99581620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:13.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.840+0000 7f995dc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f99580b4930 0x7f99580b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:13.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.841+0000 7f995dc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99581625f0 con 0x7f995815f620 2024-09-11T23:26:13.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.841+0000 7f995dc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f99580b52d0 con 0x7f99580b4930 2024-09-11T23:26:13.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.841+0000 7f995dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9958162870 con 0x7f99580d0a50 2024-09-11T23:26:13.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.841+0000 7f9956a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99580d0a50 0x7f99581620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:13.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.841+0000 7f9956a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99580d0a50 0x7f99581620b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:41610/0 (socket says 172.21.15.144:41610) 2024-09-11T23:26:13.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.841+0000 7f9957400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f995815f620 0x7f995815fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:42108/0 (socket says 172.21.15.144:42108) 2024-09-11T23:26:13.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.841+0000 7f9956a00640 1 -- 172.21.15.144:0/141726693 learned_addr learned my addr 172.21.15.144:0/141726693 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:13.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.841+0000 7f994fe00640 1 --2- 172.21.15.144:0/141726693 >> v2:172.21.15.165:3300/0 conn(0x7f99580b4930 0x7f99580b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:13.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.841+0000 7f9956a00640 1 -- 172.21.15.144:0/141726693 >> v2:172.21.15.165:3300/0 conn(0x7f99580b4930 msgr2=0x7f99580b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:13.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.841+0000 7f9956a00640 1 --2- 172.21.15.144:0/141726693 >> v2:172.21.15.165:3300/0 conn(0x7f99580b4930 0x7f99580b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.841+0000 7f9956a00640 1 -- 172.21.15.144:0/141726693 >> v1:172.21.15.165:6789/0 conn(0x7f995815f620 legacy=0x7f995815fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:13.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.841+0000 7f9956a00640 1 -- 172.21.15.144:0/141726693 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9958162b50 con 0x7f99580d0a50 2024-09-11T23:26:13.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.842+0000 7f9956a00640 1 --2- 172.21.15.144:0/141726693 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99580d0a50 0x7f99581620b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9948009870 tx=0x7f994802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8d2259515fd7a8d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:13.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.843+0000 7f9956000640 1 -- 172.21.15.144:0/141726693 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9948037070 con 0x7f99580d0a50 2024-09-11T23:26:13.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.843+0000 7f9956000640 1 -- 172.21.15.144:0/141726693 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9948032440 con 0x7f99580d0a50 2024-09-11T23:26:13.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.843+0000 7f9956000640 1 -- 172.21.15.144:0/141726693 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9948032810 con 0x7f99580d0a50 2024-09-11T23:26:13.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.843+0000 7f995dc00640 1 -- 172.21.15.144:0/141726693 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99580d0a50 msgr2=0x7f99581620b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:13.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.843+0000 7f995dc00640 1 --2- 172.21.15.144:0/141726693 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99580d0a50 0x7f99581620b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9948009870 tx=0x7f994802a1c0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.843+0000 7f995dc00640 1 -- 172.21.15.144:0/141726693 shutdown_connections 2024-09-11T23:26:13.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.843+0000 7f995dc00640 1 --2- 172.21.15.144:0/141726693 >> v2:172.21.15.165:3300/0 conn(0x7f99580b4930 0x7f99580b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.843+0000 7f995dc00640 1 --2- 172.21.15.144:0/141726693 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f99580d0a50 0x7f99581620b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.843+0000 7f995dc00640 1 -- 172.21.15.144:0/141726693 >> 172.21.15.144:0/141726693 conn(0x7f9958062cc0 msgr2=0x7f995806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:13.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.844+0000 7f995dc00640 1 -- 172.21.15.144:0/141726693 shutdown_connections 2024-09-11T23:26:13.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.844+0000 7f995dc00640 1 -- 172.21.15.144:0/141726693 wait complete. 2024-09-11T23:26:13.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.845+0000 7f995dc00640 1 Processor -- start 2024-09-11T23:26:13.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.845+0000 7f995dc00640 1 -- start start 2024-09-11T23:26:13.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.846+0000 7f995dc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99580b4930 0x7f99581585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:13.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.846+0000 7f995dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f995815f620 0x7f99580b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:13.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.846+0000 7f995dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9958153f50 0x7f9958159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:13.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.846+0000 7f995dc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f99580b3620 con 0x7f9958153f50 2024-09-11T23:26:13.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.846+0000 7f995dc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f99580b3340 con 0x7f99580b4930 2024-09-11T23:26:13.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.846+0000 7f995dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f99580b3b40 con 0x7f995815f620 2024-09-11T23:26:13.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.846+0000 7f9957400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9958153f50 0x7f9958159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:13.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.846+0000 7f9957400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9958153f50 0x7f9958159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36360/0 (socket says 172.21.15.144:36360) 2024-09-11T23:26:13.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.846+0000 7f9957400640 1 -- 172.21.15.144:0/3803619901 learned_addr learned my addr 172.21.15.144:0/3803619901 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:13.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.847+0000 7f9956a00640 1 --2- 172.21.15.144:0/3803619901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99580b4930 0x7f99581585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:13.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.847+0000 7f994fe00640 1 --2- 172.21.15.144:0/3803619901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f995815f620 0x7f99580b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:13.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.847+0000 7f9957400640 1 -- 172.21.15.144:0/3803619901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f995815f620 msgr2=0x7f99580b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:13.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.847+0000 7f9957400640 1 --2- 172.21.15.144:0/3803619901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f995815f620 0x7f99580b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.847+0000 7f9957400640 1 -- 172.21.15.144:0/3803619901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99580b4930 msgr2=0x7f99581585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:13.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.847+0000 7f9957400640 1 --2- 172.21.15.144:0/3803619901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99580b4930 0x7f99581585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:13.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.847+0000 7f9957400640 1 -- 172.21.15.144:0/3803619901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99580b0cf0 con 0x7f9958153f50 2024-09-11T23:26:13.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.847+0000 7f9956a00640 1 --2- 172.21.15.144:0/3803619901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99580b4930 0x7f99581585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:13.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.847+0000 7f9957400640 1 --2- 172.21.15.144:0/3803619901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9958153f50 0x7f9958159ce0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f995000c760 tx=0x7f995000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:13.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.847+0000 7f994ea00640 1 -- 172.21.15.144:0/3803619901 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9950017070 con 0x7f9958153f50 2024-09-11T23:26:13.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.847+0000 7f994ea00640 1 -- 172.21.15.144:0/3803619901 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995000a640 con 0x7f9958153f50 2024-09-11T23:26:13.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.847+0000 7f994ea00640 1 -- 172.21.15.144:0/3803619901 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995000a9f0 con 0x7f9958153f50 2024-09-11T23:26:13.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.847+0000 7f995dc00640 1 -- 172.21.15.144:0/3803619901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99580b0fd0 con 0x7f9958153f50 2024-09-11T23:26:13.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.848+0000 7f995dc00640 1 -- 172.21.15.144:0/3803619901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99580b1590 con 0x7f9958153f50 2024-09-11T23:26:13.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.849+0000 7f995dc00640 1 -- 172.21.15.144:0/3803619901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99580b4d90 con 0x7f9958153f50 2024-09-11T23:26:13.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.849+0000 7f994ea00640 1 -- 172.21.15.144:0/3803619901 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f995001a070 con 0x7f9958153f50 2024-09-11T23:26:13.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.850+0000 7f994ea00640 1 --2- 172.21.15.144:0/3803619901 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f993406c7f0 0x7f993406ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:13.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.850+0000 7f994ea00640 1 -- 172.21.15.144:0/3803619901 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f9950088ab0 con 0x7f9958153f50 2024-09-11T23:26:13.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.851+0000 7f9956a00640 1 --2- 172.21.15.144:0/3803619901 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f993406c7f0 0x7f993406ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:13.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.851+0000 7f9956a00640 1 --2- 172.21.15.144:0/3803619901 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f993406c7f0 0x7f993406ecb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9948034000 tx=0x7f994802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:13.854 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:13.855+0000 7f994ea00640 1 -- 172.21.15.144:0/3803619901 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f99581625f0 con 0x7f9958153f50 2024-09-11T23:26:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.041+0000 7f995dc00640 1 -- 172.21.15.144:0/3803619901 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9958160730 con 0x7f9958153f50 2024-09-11T23:26:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.042+0000 7f994ea00640 1 -- 172.21.15.144:0/3803619901 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v153) ==== 80+0+0 (secure 0 0 0) 0x7f9950058a10 con 0x7f9958153f50 2024-09-11T23:26:14.041 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:26:14.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.044+0000 7f995dc00640 1 -- 172.21.15.144:0/3803619901 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f993406c7f0 msgr2=0x7f993406ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:14.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.044+0000 7f995dc00640 1 --2- 172.21.15.144:0/3803619901 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f993406c7f0 0x7f993406ecb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9948034000 tx=0x7f994802e000 comp rx=0 tx=0).stop 2024-09-11T23:26:14.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.044+0000 7f995dc00640 1 -- 172.21.15.144:0/3803619901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9958153f50 msgr2=0x7f9958159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:14.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.044+0000 7f995dc00640 1 --2- 172.21.15.144:0/3803619901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9958153f50 0x7f9958159ce0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f995000c760 tx=0x7f995000cc20 comp rx=0 tx=0).stop 2024-09-11T23:26:14.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.044+0000 7f995dc00640 1 -- 172.21.15.144:0/3803619901 shutdown_connections 2024-09-11T23:26:14.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.044+0000 7f995dc00640 1 --2- 172.21.15.144:0/3803619901 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f993406c7f0 0x7f993406ecb0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:14.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.044+0000 7f995dc00640 1 --2- 172.21.15.144:0/3803619901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9958153f50 0x7f9958159ce0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:14.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.044+0000 7f995dc00640 1 --2- 172.21.15.144:0/3803619901 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f995815f620 0x7f99580b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:14.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.044+0000 7f995dc00640 1 --2- 172.21.15.144:0/3803619901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f99580b4930 0x7f99581585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:14.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.044+0000 7f995dc00640 1 -- 172.21.15.144:0/3803619901 >> 172.21.15.144:0/3803619901 conn(0x7f9958062cc0 msgr2=0x7f9958160c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:14.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.044+0000 7f995dc00640 1 -- 172.21.15.144:0/3803619901 shutdown_connections 2024-09-11T23:26:14.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.044+0000 7f995dc00640 1 -- 172.21.15.144:0/3803619901 wait complete. 2024-09-11T23:26:14.061 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T23:26:14.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:14.061 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T23:26:14.143 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:26:14.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:14.143 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:26:14.196 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:26:14.197 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:26:14.197 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:14.236 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:26:14.236 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:14.312 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:26:14.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.468+0000 7f7956800640 1 Processor -- start 2024-09-11T23:26:14.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.468+0000 7f7956800640 1 -- start start 2024-09-11T23:26:14.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.470+0000 7f7956800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f795015ca40 0x7f795015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.470+0000 7f7956800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f795015ceb0 0x7f79501594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.470+0000 7f7956800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f795015d390 con 0x7f79500d02a0 2024-09-11T23:26:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.470+0000 7f7956800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f795015d670 con 0x7f795015ca40 2024-09-11T23:26:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.470+0000 7f7956800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f795015d950 con 0x7f795015ceb0 2024-09-11T23:26:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.470+0000 7f7946a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f795015ca40 0x7f795015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.470+0000 7f7946a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f795015ca40 0x7f795015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36254/0 (socket says 172.21.15.144:36254) 2024-09-11T23:26:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.470+0000 7f7946a00640 1 -- 172.21.15.144:0/865571387 learned_addr learned my addr 172.21.15.144:0/865571387 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:14.470 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.470+0000 7f794fe00640 1 --2- 172.21.15.144:0/865571387 >> v2:172.21.15.165:3300/0 conn(0x7f795015ceb0 0x7f79501594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:14.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.470+0000 7f7946a00640 1 -- 172.21.15.144:0/865571387 >> v2:172.21.15.165:3300/0 conn(0x7f795015ceb0 msgr2=0x7f79501594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:14.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.470+0000 7f7946a00640 1 --2- 172.21.15.144:0/865571387 >> v2:172.21.15.165:3300/0 conn(0x7f795015ceb0 0x7f79501594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:14.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.470+0000 7f7946a00640 1 -- 172.21.15.144:0/865571387 >> v1:172.21.15.165:6789/0 conn(0x7f79500d02a0 legacy=0x7f79500d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:14.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.470+0000 7f7946a00640 1 -- 172.21.15.144:0/865571387 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795015dc30 con 0x7f795015ca40 2024-09-11T23:26:14.471 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.471+0000 7f7946a00640 1 --2- 172.21.15.144:0/865571387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f795015ca40 0x7f795015e430 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f79500b4be0 tx=0x7f793802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86125f162824637 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:14.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.472+0000 7f794ea00640 1 -- 172.21.15.144:0/865571387 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7938033640 con 0x7f795015ca40 2024-09-11T23:26:14.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.472+0000 7f794ea00640 1 -- 172.21.15.144:0/865571387 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7938038070 con 0x7f795015ca40 2024-09-11T23:26:14.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.472+0000 7f794ea00640 1 -- 172.21.15.144:0/865571387 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7938033a00 con 0x7f795015ca40 2024-09-11T23:26:14.472 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.472+0000 7f7956800640 1 -- 172.21.15.144:0/865571387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f795015ca40 msgr2=0x7f795015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:14.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.472+0000 7f7956800640 1 --2- 172.21.15.144:0/865571387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f795015ca40 0x7f795015e430 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f79500b4be0 tx=0x7f793802c8b0 comp rx=0 tx=0).stop 2024-09-11T23:26:14.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.472+0000 7f7956800640 1 -- 172.21.15.144:0/865571387 shutdown_connections 2024-09-11T23:26:14.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.472+0000 7f7956800640 1 --2- 172.21.15.144:0/865571387 >> v2:172.21.15.165:3300/0 conn(0x7f795015ceb0 0x7f79501594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:14.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.472+0000 7f7956800640 1 --2- 172.21.15.144:0/865571387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f795015ca40 0x7f795015e430 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:14.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.472+0000 7f7956800640 1 -- 172.21.15.144:0/865571387 >> 172.21.15.144:0/865571387 conn(0x7f7950062cc0 msgr2=0x7f795006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:14.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.472+0000 7f7956800640 1 -- 172.21.15.144:0/865571387 shutdown_connections 2024-09-11T23:26:14.473 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.472+0000 7f7956800640 1 -- 172.21.15.144:0/865571387 wait complete. 2024-09-11T23:26:14.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.474+0000 7f7956800640 1 Processor -- start 2024-09-11T23:26:14.474 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.474+0000 7f7956800640 1 -- start start 2024-09-11T23:26:14.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.475+0000 7f7956800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79500d02a0 0x7f79501f5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:14.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.475+0000 7f7956800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f795015ca40 0x7f7950149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:14.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.475+0000 7f7956800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f795015ceb0 0x7f795014b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:14.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.475+0000 7f7956800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7950155d10 con 0x7f795015ca40 2024-09-11T23:26:14.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.475+0000 7f7956800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7950155b90 con 0x7f79500d02a0 2024-09-11T23:26:14.476 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.475+0000 7f7956800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f79500b4790 con 0x7f795015ceb0 2024-09-11T23:26:14.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.475+0000 7f7946a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f795015ca40 0x7f7950149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:14.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.475+0000 7f7946a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f795015ca40 0x7f7950149fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36268/0 (socket says 172.21.15.144:36268) 2024-09-11T23:26:14.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.475+0000 7f7946a00640 1 -- 172.21.15.144:0/2530728498 learned_addr learned my addr 172.21.15.144:0/2530728498 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:14.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.475+0000 7f7946a00640 1 -- 172.21.15.144:0/2530728498 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f795015ceb0 msgr2=0x7f795014b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:14.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.475+0000 7f7946a00640 1 --2- 172.21.15.144:0/2530728498 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f795015ceb0 0x7f795014b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:14.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.475+0000 7f7946a00640 1 -- 172.21.15.144:0/2530728498 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79500d02a0 msgr2=0x7f79501f5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:14.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.475+0000 7f7946a00640 1 --2- 172.21.15.144:0/2530728498 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79500d02a0 0x7f79501f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:14.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.475+0000 7f7946a00640 1 -- 172.21.15.144:0/2530728498 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79501512f0 con 0x7f795015ca40 2024-09-11T23:26:14.477 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.476+0000 7f7946a00640 1 --2- 172.21.15.144:0/2530728498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f795015ca40 0x7f7950149fd0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f793800b2c0 tx=0x7f7938004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:14.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.476+0000 7f7947e00640 1 -- 172.21.15.144:0/2530728498 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7938043070 con 0x7f795015ca40 2024-09-11T23:26:14.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.476+0000 7f7947e00640 1 -- 172.21.15.144:0/2530728498 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f793803c830 con 0x7f795015ca40 2024-09-11T23:26:14.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.476+0000 7f7947e00640 1 -- 172.21.15.144:0/2530728498 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793803cc00 con 0x7f795015ca40 2024-09-11T23:26:14.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.476+0000 7f7956800640 1 -- 172.21.15.144:0/2530728498 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f795014bc20 con 0x7f795015ca40 2024-09-11T23:26:14.478 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.476+0000 7f7956800640 1 -- 172.21.15.144:0/2530728498 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79501f5240 con 0x7f795015ca40 2024-09-11T23:26:14.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.477+0000 7f7956800640 1 -- 172.21.15.144:0/2530728498 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79500d0680 con 0x7f795015ca40 2024-09-11T23:26:14.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.478+0000 7f7947e00640 1 -- 172.21.15.144:0/2530728498 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f7938046070 con 0x7f795015ca40 2024-09-11T23:26:14.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.479+0000 7f7947e00640 1 --2- 172.21.15.144:0/2530728498 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f792c06c7c0 0x7f792c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:14.479 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.479+0000 7f7947e00640 1 -- 172.21.15.144:0/2530728498 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f79380a9d70 con 0x7f795015ca40 2024-09-11T23:26:14.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.479+0000 7f794f400640 1 --2- 172.21.15.144:0/2530728498 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f792c06c7c0 0x7f792c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:14.480 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.480+0000 7f794f400640 1 --2- 172.21.15.144:0/2530728498 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f792c06c7c0 0x7f792c06ec80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7940000f60 tx=0x7f79400079d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:14.483 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.483+0000 7f7947e00640 1 -- 172.21.15.144:0/2530728498 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f793807a320 con 0x7f795015ca40 2024-09-11T23:26:14.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.666+0000 7f7956800640 1 -- 172.21.15.144:0/2530728498 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f79500cea70 con 0x7f795015ca40 2024-09-11T23:26:14.666 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.666+0000 7f7947e00640 1 -- 172.21.15.144:0/2530728498 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v153) ==== 80+0+0 (secure 0 0 0) 0x7f7938079c20 con 0x7f795015ca40 2024-09-11T23:26:14.666 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:26:14.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.669+0000 7f7956800640 1 -- 172.21.15.144:0/2530728498 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f792c06c7c0 msgr2=0x7f792c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:14.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.669+0000 7f7956800640 1 --2- 172.21.15.144:0/2530728498 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f792c06c7c0 0x7f792c06ec80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7940000f60 tx=0x7f79400079d0 comp rx=0 tx=0).stop 2024-09-11T23:26:14.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.669+0000 7f7956800640 1 -- 172.21.15.144:0/2530728498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f795015ca40 msgr2=0x7f7950149fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:14.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.669+0000 7f7956800640 1 --2- 172.21.15.144:0/2530728498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f795015ca40 0x7f7950149fd0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f793800b2c0 tx=0x7f7938004730 comp rx=0 tx=0).stop 2024-09-11T23:26:14.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.669+0000 7f7956800640 1 -- 172.21.15.144:0/2530728498 shutdown_connections 2024-09-11T23:26:14.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.669+0000 7f7956800640 1 --2- 172.21.15.144:0/2530728498 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f792c06c7c0 0x7f792c06ec80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:14.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.669+0000 7f7956800640 1 --2- 172.21.15.144:0/2530728498 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f795015ceb0 0x7f795014b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:14.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.669+0000 7f7956800640 1 --2- 172.21.15.144:0/2530728498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f795015ca40 0x7f7950149fd0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:14.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.669+0000 7f7956800640 1 --2- 172.21.15.144:0/2530728498 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79500d02a0 0x7f79501f5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:14.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.669+0000 7f7956800640 1 -- 172.21.15.144:0/2530728498 >> 172.21.15.144:0/2530728498 conn(0x7f7950062cc0 msgr2=0x7f7950154dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:14.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.669+0000 7f7956800640 1 -- 172.21.15.144:0/2530728498 shutdown_connections 2024-09-11T23:26:14.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:14.669+0000 7f7956800640 1 -- 172.21.15.144:0/2530728498 wait complete. 2024-09-11T23:26:14.684 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-11T23:26:14.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:14.685 DEBUG:teuthology.orchestra.run.smithi165:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-11T23:26:14.749 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:26:14.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:14.749 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:26:14.786 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:26:14.786 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:26:14.786 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:14.822 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:26:14.822 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:26:14.822 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:26:14.822 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:14.861 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:26:14.862 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:26:15.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.017+0000 7fd3a7000640 1 Processor -- start 2024-09-11T23:26:15.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.017+0000 7fd3a7000640 1 -- start start 2024-09-11T23:26:15.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.019+0000 7fd3a7000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3a00b4930 0x7fd3a00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:15.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.019+0000 7fd3a7000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd3a015f620 0x7fd3a015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:15.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.019+0000 7fd3a7000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3a0162870 con 0x7fd3a00d0a50 2024-09-11T23:26:15.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.019+0000 7fd3a7000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd3a00b52d0 con 0x7fd3a015f620 2024-09-11T23:26:15.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.019+0000 7fd3a7000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd3a0162b50 con 0x7fd3a00b4930 2024-09-11T23:26:15.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.019+0000 7fd3a5000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd3a015f620 0x7fd3a015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:15.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.019+0000 7fd3a5000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd3a015f620 0x7fd3a015fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36270/0 (socket says 172.21.15.144:36270) 2024-09-11T23:26:15.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.019+0000 7fd3a5000640 1 -- 172.21.15.144:0/2802459478 learned_addr learned my addr 172.21.15.144:0/2802459478 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:15.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.019+0000 7fd39f400640 1 --2- 172.21.15.144:0/2802459478 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3a00b4930 0x7fd3a00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:15.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.019+0000 7fd3a5000640 1 -- 172.21.15.144:0/2802459478 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3a00b4930 msgr2=0x7fd3a00b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:15.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.019+0000 7fd3a5000640 1 --2- 172.21.15.144:0/2802459478 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3a00b4930 0x7fd3a00b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.019+0000 7fd3a5000640 1 -- 172.21.15.144:0/2802459478 >> v1:172.21.15.165:6789/0 conn(0x7fd3a00d0a50 legacy=0x7fd3a01620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:15.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.019+0000 7fd3a5000640 1 -- 172.21.15.144:0/2802459478 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a0162e30 con 0x7fd3a015f620 2024-09-11T23:26:15.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.020+0000 7fd3a5000640 1 --2- 172.21.15.144:0/2802459478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3a015f620 0x7fd3a015fab0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fd398009e50 tx=0x7fd39802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7ee8736da62105 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:15.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.021+0000 7fd39ea00640 1 -- 172.21.15.144:0/2802459478 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd398036070 con 0x7fd3a015f620 2024-09-11T23:26:15.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.021+0000 7fd39ea00640 1 -- 172.21.15.144:0/2802459478 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd398031600 con 0x7fd3a015f620 2024-09-11T23:26:15.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.021+0000 7fd39ea00640 1 -- 172.21.15.144:0/2802459478 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3980319d0 con 0x7fd3a015f620 2024-09-11T23:26:15.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.021+0000 7fd3a7000640 1 -- 172.21.15.144:0/2802459478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3a015f620 msgr2=0x7fd3a015fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:15.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.021+0000 7fd3a7000640 1 --2- 172.21.15.144:0/2802459478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3a015f620 0x7fd3a015fab0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fd398009e50 tx=0x7fd39802a680 comp rx=0 tx=0).stop 2024-09-11T23:26:15.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.021+0000 7fd3a7000640 1 -- 172.21.15.144:0/2802459478 shutdown_connections 2024-09-11T23:26:15.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.021+0000 7fd3a7000640 1 --2- 172.21.15.144:0/2802459478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3a015f620 0x7fd3a015fab0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.021+0000 7fd3a7000640 1 --2- 172.21.15.144:0/2802459478 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3a00b4930 0x7fd3a00b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.021+0000 7fd3a7000640 1 -- 172.21.15.144:0/2802459478 >> 172.21.15.144:0/2802459478 conn(0x7fd3a0062cc0 msgr2=0x7fd3a006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:15.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.021+0000 7fd3a7000640 1 -- 172.21.15.144:0/2802459478 shutdown_connections 2024-09-11T23:26:15.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.021+0000 7fd3a7000640 1 -- 172.21.15.144:0/2802459478 wait complete. 2024-09-11T23:26:15.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.023+0000 7fd3a7000640 1 Processor -- start 2024-09-11T23:26:15.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.023+0000 7fd3a7000640 1 -- start start 2024-09-11T23:26:15.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.024+0000 7fd3a7000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3a00b4930 0x7fd3a014ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:15.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.024+0000 7fd3a7000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3a015f620 0x7fd3a0070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:15.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.024+0000 7fd3a7000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3a015d6a0 0x7fd3a015db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:15.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.024+0000 7fd3a7000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a015fff0 con 0x7fd3a00b4930 2024-09-11T23:26:15.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.024+0000 7fd3a7000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a00b3620 con 0x7fd3a015f620 2024-09-11T23:26:15.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.024+0000 7fd3a7000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd3a014b8b0 con 0x7fd3a015d6a0 2024-09-11T23:26:15.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.024+0000 7fd39fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3a00b4930 0x7fd3a014ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.024+0000 7fd39fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3a00b4930 0x7fd3a014ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36276/0 (socket says 172.21.15.144:36276) 2024-09-11T23:26:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.024+0000 7fd39fe00640 1 -- 172.21.15.144:0/3271642756 learned_addr learned my addr 172.21.15.144:0/3271642756 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.024+0000 7fd3a5000640 1 --2- 172.21.15.144:0/3271642756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3a015d6a0 0x7fd3a015db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.024+0000 7fd39f400640 1 --2- 172.21.15.144:0/3271642756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3a015f620 0x7fd3a0070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.025+0000 7fd39fe00640 1 -- 172.21.15.144:0/3271642756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3a015d6a0 msgr2=0x7fd3a015db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.025+0000 7fd39fe00640 1 --2- 172.21.15.144:0/3271642756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3a015d6a0 0x7fd3a015db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.025+0000 7fd39fe00640 1 -- 172.21.15.144:0/3271642756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3a015f620 msgr2=0x7fd3a0070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.025+0000 7fd39fe00640 1 --2- 172.21.15.144:0/3271642756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3a015f620 0x7fd3a0070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.025+0000 7fd39fe00640 1 -- 172.21.15.144:0/3271642756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a014bb90 con 0x7fd3a00b4930 2024-09-11T23:26:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.025+0000 7fd39fe00640 1 --2- 172.21.15.144:0/3271642756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3a00b4930 0x7fd3a014ac90 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fd39000c400 tx=0x7fd39000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.025+0000 7fd397e00640 1 -- 172.21.15.144:0/3271642756 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3900052d0 con 0x7fd3a00b4930 2024-09-11T23:26:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.025+0000 7fd397e00640 1 -- 172.21.15.144:0/3271642756 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd390005490 con 0x7fd3a00b4930 2024-09-11T23:26:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.025+0000 7fd3a7000640 1 -- 172.21.15.144:0/3271642756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3a014be70 con 0x7fd3a00b4930 2024-09-11T23:26:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.025+0000 7fd397e00640 1 -- 172.21.15.144:0/3271642756 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd390007260 con 0x7fd3a00b4930 2024-09-11T23:26:15.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.025+0000 7fd3a7000640 1 -- 172.21.15.144:0/3271642756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3a014c430 con 0x7fd3a00b4930 2024-09-11T23:26:15.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.026+0000 7fd3a7000640 1 -- 172.21.15.144:0/3271642756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3a014c630 con 0x7fd3a00b4930 2024-09-11T23:26:15.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.027+0000 7fd397e00640 1 -- 172.21.15.144:0/3271642756 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7fd390007400 con 0x7fd3a00b4930 2024-09-11T23:26:15.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.029+0000 7fd397e00640 1 --2- 172.21.15.144:0/3271642756 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd38006c7c0 0x7fd38006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:15.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.029+0000 7fd397e00640 1 -- 172.21.15.144:0/3271642756 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7fd390088a60 con 0x7fd3a00b4930 2024-09-11T23:26:15.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.029+0000 7fd39f400640 1 --2- 172.21.15.144:0/3271642756 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd38006c7c0 0x7fd38006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:15.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.030+0000 7fd39f400640 1 --2- 172.21.15.144:0/3271642756 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd38006c7c0 0x7fd38006ec80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd3a015e780 tx=0x7fd38c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:15.032 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.033+0000 7fd397e00640 1 -- 172.21.15.144:0/3271642756 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3a014c630 con 0x7fd3a00b4930 2024-09-11T23:26:15.188 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:26:15.192 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:26:15.249 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.250+0000 7fd3a7000640 1 -- 172.21.15.144:0/3271642756 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3a00b4d90 con 0x7fd3a00b4930 2024-09-11T23:26:15.250 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.250+0000 7fd397e00640 1 -- 172.21.15.144:0/3271642756 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5245 (secure 0 0 0) 0x7fd3900589c0 con 0x7fd3a00b4930 2024-09-11T23:26:15.250 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:15.250 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":110,"btime":"2024-09-11T23:26:02:994371+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/2302333712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2302333712},{"type":"v1","addr":"172.21.15.144:6801","nonce":2302333712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104},{"gid":7097,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3051519109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3051519109},{"type":"v1","addr":"172.21.15.165:6834","nonce":3051519109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2403316225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2403316225},{"type":"v1","addr":"172.21.15.165:6835","nonce":2403316225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:25:52.298959+0000","modified":"2024-09-11T23:25:55.324109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8664":{"gid":8664,"name":"c","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/3397068730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3397068730},{"type":"v1","addr":"172.21.15.144:6835","nonce":3397068730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8664,"qdb_cluster":[8664]},"id":12}]} 2024-09-11T23:26:15.251 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 110 2024-09-11T23:26:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.253+0000 7fd3a7000640 1 -- 172.21.15.144:0/3271642756 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd38006c7c0 msgr2=0x7fd38006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.253+0000 7fd3a7000640 1 --2- 172.21.15.144:0/3271642756 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd38006c7c0 0x7fd38006ec80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd3a015e780 tx=0x7fd38c009190 comp rx=0 tx=0).stop 2024-09-11T23:26:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.253+0000 7fd3a7000640 1 -- 172.21.15.144:0/3271642756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3a00b4930 msgr2=0x7fd3a014ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.253+0000 7fd3a7000640 1 --2- 172.21.15.144:0/3271642756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3a00b4930 0x7fd3a014ac90 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fd39000c400 tx=0x7fd39000c8c0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.253+0000 7fd3a7000640 1 -- 172.21.15.144:0/3271642756 shutdown_connections 2024-09-11T23:26:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.253+0000 7fd3a7000640 1 --2- 172.21.15.144:0/3271642756 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd38006c7c0 0x7fd38006ec80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.253+0000 7fd3a7000640 1 --2- 172.21.15.144:0/3271642756 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd3a015d6a0 0x7fd3a015db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.253+0000 7fd3a7000640 1 --2- 172.21.15.144:0/3271642756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3a015f620 0x7fd3a0070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.253+0000 7fd3a7000640 1 --2- 172.21.15.144:0/3271642756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3a00b4930 0x7fd3a014ac90 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.253+0000 7fd3a7000640 1 -- 172.21.15.144:0/3271642756 >> 172.21.15.144:0/3271642756 conn(0x7fd3a0062cc0 msgr2=0x7fd3a015bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.253+0000 7fd3a7000640 1 -- 172.21.15.144:0/3271642756 shutdown_connections 2024-09-11T23:26:15.253 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.253+0000 7fd3a7000640 1 -- 172.21.15.144:0/3271642756 wait complete. 2024-09-11T23:26:15.269 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:26:15.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.424+0000 7f89da800640 1 Processor -- start 2024-09-11T23:26:15.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.424+0000 7f89da800640 1 -- start start 2024-09-11T23:26:15.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.425+0000 7f89da800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89d4158a70 0x7f89d40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:15.425 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.425+0000 7f89da800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f89d4072cf0 0x7f89d41602b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:15.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.425+0000 7f89da800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d40b4390 con 0x7f89d40b3e80 2024-09-11T23:26:15.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.425+0000 7f89da800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f89d40b4c30 con 0x7f89d4072cf0 2024-09-11T23:26:15.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.425+0000 7f89da800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f89d40b4670 con 0x7f89d4158a70 2024-09-11T23:26:15.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.425+0000 7f89d9400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89d4158a70 0x7f89d40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:15.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.425+0000 7f89d9400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89d4158a70 0x7f89d40b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:60582/0 (socket says 172.21.15.144:60582) 2024-09-11T23:26:15.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.425+0000 7f89d9400640 1 -- 172.21.15.144:0/729608614 learned_addr learned my addr 172.21.15.144:0/729608614 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:15.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.425+0000 7f89d9e00640 1 --2- 172.21.15.144:0/729608614 >> v2:172.21.15.165:3300/0 conn(0x7f89d4072cf0 0x7f89d41602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:15.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.426+0000 7f89d9e00640 1 -- 172.21.15.144:0/729608614 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89d4158a70 msgr2=0x7f89d40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:15.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.426+0000 7f89d9e00640 1 --2- 172.21.15.144:0/729608614 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89d4158a70 0x7f89d40b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.426+0000 7f89d9e00640 1 -- 172.21.15.144:0/729608614 >> v1:172.21.15.165:6789/0 conn(0x7f89d40b3e80 legacy=0x7f89d40725e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:15.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.426+0000 7f89d9e00640 1 -- 172.21.15.144:0/729608614 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d40b4950 con 0x7f89d4072cf0 2024-09-11T23:26:15.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.426+0000 7f89d9400640 1 --2- 172.21.15.144:0/729608614 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89d4158a70 0x7f89d40b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:26:15.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.426+0000 7f89d3e00640 1 -- 172.21.15.144:0/729608614 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2898470269 0 0) 0x7f89d40b4390 con 0x7f89d40b3e80 2024-09-11T23:26:15.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.427+0000 7f89d9e00640 1 --2- 172.21.15.144:0/729608614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89d4072cf0 0x7f89d41602b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0097a0 tx=0x7f89cc02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b650f3371fde3b19 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:15.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.427+0000 7f89d3e00640 1 -- 172.21.15.144:0/729608614 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc037070 con 0x7f89d4072cf0 2024-09-11T23:26:15.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.427+0000 7f89d3e00640 1 -- 172.21.15.144:0/729608614 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89cc02ae50 con 0x7f89d4072cf0 2024-09-11T23:26:15.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.427+0000 7f89d3e00640 1 -- 172.21.15.144:0/729608614 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc032660 con 0x7f89d4072cf0 2024-09-11T23:26:15.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.428+0000 7f89da800640 1 -- 172.21.15.144:0/729608614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89d4072cf0 msgr2=0x7f89d41602b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:15.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.428+0000 7f89da800640 1 --2- 172.21.15.144:0/729608614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89d4072cf0 0x7f89d41602b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0097a0 tx=0x7f89cc02a100 comp rx=0 tx=0).stop 2024-09-11T23:26:15.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.428+0000 7f89da800640 1 -- 172.21.15.144:0/729608614 shutdown_connections 2024-09-11T23:26:15.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.428+0000 7f89da800640 1 --2- 172.21.15.144:0/729608614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89d4072cf0 0x7f89d41602b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.428+0000 7f89da800640 1 --2- 172.21.15.144:0/729608614 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89d4158a70 0x7f89d40b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.428+0000 7f89da800640 1 -- 172.21.15.144:0/729608614 >> 172.21.15.144:0/729608614 conn(0x7f89d40d0af0 msgr2=0x7f89d40d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:15.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.428+0000 7f89da800640 1 -- 172.21.15.144:0/729608614 shutdown_connections 2024-09-11T23:26:15.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.428+0000 7f89da800640 1 -- 172.21.15.144:0/729608614 wait complete. 2024-09-11T23:26:15.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.430+0000 7f89da800640 1 Processor -- start 2024-09-11T23:26:15.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.430+0000 7f89da800640 1 -- start start 2024-09-11T23:26:15.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.431+0000 7f89da800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89d4072cf0 0x7f89d4157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:15.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.431+0000 7f89da800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89d40b3e80 0x7f89d4159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:15.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.431+0000 7f89da800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89d4158a70 0x7f89d414a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:15.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.431+0000 7f89da800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f89d4158e50 con 0x7f89d40b3e80 2024-09-11T23:26:15.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.431+0000 7f89da800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f89d40b5c60 con 0x7f89d4072cf0 2024-09-11T23:26:15.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.431+0000 7f89da800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f89d414e6c0 con 0x7f89d4158a70 2024-09-11T23:26:15.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.431+0000 7f89d8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89d40b3e80 0x7f89d4159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:15.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.431+0000 7f89d8a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89d40b3e80 0x7f89d4159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36286/0 (socket says 172.21.15.144:36286) 2024-09-11T23:26:15.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.431+0000 7f89d8a00640 1 -- 172.21.15.144:0/219336058 learned_addr learned my addr 172.21.15.144:0/219336058 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:15.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.431+0000 7f89d9400640 1 --2- 172.21.15.144:0/219336058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89d4072cf0 0x7f89d4157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:15.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.431+0000 7f89d9e00640 1 --2- 172.21.15.144:0/219336058 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89d4158a70 0x7f89d414a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:15.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.432+0000 7f89d8a00640 1 -- 172.21.15.144:0/219336058 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89d4158a70 msgr2=0x7f89d414a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:15.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.432+0000 7f89d8a00640 1 --2- 172.21.15.144:0/219336058 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89d4158a70 0x7f89d414a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.432+0000 7f89d8a00640 1 -- 172.21.15.144:0/219336058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89d4072cf0 msgr2=0x7f89d4157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:15.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.432+0000 7f89d8a00640 1 --2- 172.21.15.144:0/219336058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89d4072cf0 0x7f89d4157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.432+0000 7f89d8a00640 1 -- 172.21.15.144:0/219336058 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d415e1b0 con 0x7f89d40b3e80 2024-09-11T23:26:15.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.432+0000 7f89d8a00640 1 --2- 172.21.15.144:0/219336058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89d40b3e80 0x7f89d4159160 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f89c000c480 tx=0x7f89c000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:15.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.432+0000 7f89d1600640 1 -- 172.21.15.144:0/219336058 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c0017070 con 0x7f89d40b3e80 2024-09-11T23:26:15.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.432+0000 7f89d1600640 1 -- 172.21.15.144:0/219336058 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c0005480 con 0x7f89d40b3e80 2024-09-11T23:26:15.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.432+0000 7f89d1600640 1 -- 172.21.15.144:0/219336058 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c0003830 con 0x7f89d40b3e80 2024-09-11T23:26:15.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.432+0000 7f89da800640 1 -- 172.21.15.144:0/219336058 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d415e490 con 0x7f89d40b3e80 2024-09-11T23:26:15.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.432+0000 7f89da800640 1 -- 172.21.15.144:0/219336058 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d414ec40 con 0x7f89d40b3e80 2024-09-11T23:26:15.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.433+0000 7f89da800640 1 -- 172.21.15.144:0/219336058 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d4153b50 con 0x7f89d40b3e80 2024-09-11T23:26:15.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.434+0000 7f89d1600640 1 -- 172.21.15.144:0/219336058 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f89c001a070 con 0x7f89d40b3e80 2024-09-11T23:26:15.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.436+0000 7f89d1600640 1 --2- 172.21.15.144:0/219336058 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f89b406c7c0 0x7f89b406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:15.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.436+0000 7f89d1600640 1 -- 172.21.15.144:0/219336058 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f89c00888a0 con 0x7f89d40b3e80 2024-09-11T23:26:15.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.436+0000 7f89d9400640 1 --2- 172.21.15.144:0/219336058 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f89b406c7c0 0x7f89b406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:15.436 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.437+0000 7f89d9400640 1 --2- 172.21.15.144:0/219336058 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f89b406c7c0 0x7f89b406ec80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f89d41612a0 tx=0x7f89c800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:15.439 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.440+0000 7f89d1600640 1 -- 172.21.15.144:0/219336058 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f89d4153b50 con 0x7f89d40b3e80 2024-09-11T23:26:15.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.649+0000 7f89da800640 1 -- 172.21.15.144:0/219336058 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89d40b3940 con 0x7f89d40b3e80 2024-09-11T23:26:15.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.650+0000 7f89d1600640 1 -- 172.21.15.144:0/219336058 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5245 (secure 0 0 0) 0x7f89c0058800 con 0x7f89d40b3e80 2024-09-11T23:26:15.650 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:15.650 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":110,"btime":"2024-09-11T23:26:02:994371+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/2302333712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2302333712},{"type":"v1","addr":"172.21.15.144:6801","nonce":2302333712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104},{"gid":7097,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3051519109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3051519109},{"type":"v1","addr":"172.21.15.165:6834","nonce":3051519109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2403316225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2403316225},{"type":"v1","addr":"172.21.15.165:6835","nonce":2403316225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:25:52.298959+0000","modified":"2024-09-11T23:25:55.324109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8664":{"gid":8664,"name":"c","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/3397068730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3397068730},{"type":"v1","addr":"172.21.15.144:6835","nonce":3397068730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8664,"qdb_cluster":[8664]},"id":12}]} 2024-09-11T23:26:15.650 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 110 2024-09-11T23:26:15.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.652+0000 7f89da800640 1 -- 172.21.15.144:0/219336058 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f89b406c7c0 msgr2=0x7f89b406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:15.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.652+0000 7f89da800640 1 --2- 172.21.15.144:0/219336058 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f89b406c7c0 0x7f89b406ec80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f89d41612a0 tx=0x7f89c800b040 comp rx=0 tx=0).stop 2024-09-11T23:26:15.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.652+0000 7f89da800640 1 -- 172.21.15.144:0/219336058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89d40b3e80 msgr2=0x7f89d4159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:15.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.652+0000 7f89da800640 1 --2- 172.21.15.144:0/219336058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89d40b3e80 0x7f89d4159160 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f89c000c480 tx=0x7f89c000c940 comp rx=0 tx=0).stop 2024-09-11T23:26:15.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.652+0000 7f89da800640 1 -- 172.21.15.144:0/219336058 shutdown_connections 2024-09-11T23:26:15.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.652+0000 7f89da800640 1 --2- 172.21.15.144:0/219336058 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f89b406c7c0 0x7f89b406ec80 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.652+0000 7f89da800640 1 --2- 172.21.15.144:0/219336058 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89d4158a70 0x7f89d414a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.652+0000 7f89da800640 1 --2- 172.21.15.144:0/219336058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89d40b3e80 0x7f89d4159160 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.652+0000 7f89da800640 1 --2- 172.21.15.144:0/219336058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89d4072cf0 0x7f89d4157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.652+0000 7f89da800640 1 -- 172.21.15.144:0/219336058 >> 172.21.15.144:0/219336058 conn(0x7f89d40d0af0 msgr2=0x7f89d4153440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:15.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.652+0000 7f89da800640 1 -- 172.21.15.144:0/219336058 shutdown_connections 2024-09-11T23:26:15.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.652+0000 7f89da800640 1 -- 172.21.15.144:0/219336058 wait complete. 2024-09-11T23:26:15.668 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:26:15.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.822+0000 7fe431200640 1 Processor -- start 2024-09-11T23:26:15.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.822+0000 7fe431200640 1 -- start start 2024-09-11T23:26:15.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.823+0000 7fe431200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe42c0b5fd0 0x7fe42c0b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:15.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.823+0000 7fe431200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe42c0b7750 0x7fe42c0b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:15.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.823+0000 7fe431200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe42c06bee0 con 0x7fe42c15e640 2024-09-11T23:26:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.823+0000 7fe431200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe42c15ea20 con 0x7fe42c0b5fd0 2024-09-11T23:26:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.823+0000 7fe431200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe42c06caf0 con 0x7fe42c0b7750 2024-09-11T23:26:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.823+0000 7fe42aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe42c0b5fd0 0x7fe42c0b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.823+0000 7fe42aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe42c0b5fd0 0x7fe42c0b6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36294/0 (socket says 172.21.15.144:36294) 2024-09-11T23:26:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.823+0000 7fe42aa00640 1 -- 172.21.15.144:0/1692116781 learned_addr learned my addr 172.21.15.144:0/1692116781 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.824+0000 7fe42be00640 1 --2- 172.21.15.144:0/1692116781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe42c0b7750 0x7fe42c0b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.824+0000 7fe42aa00640 1 -- 172.21.15.144:0/1692116781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe42c0b7750 msgr2=0x7fe42c0b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.824+0000 7fe42aa00640 1 --2- 172.21.15.144:0/1692116781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe42c0b7750 0x7fe42c0b7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.824+0000 7fe42aa00640 1 -- 172.21.15.144:0/1692116781 >> v1:172.21.15.144:6789/0 conn(0x7fe42c15e640 legacy=0x7fe42c0d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:15.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.824+0000 7fe42aa00640 1 -- 172.21.15.144:0/1692116781 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c06c1c0 con 0x7fe42c0b5fd0 2024-09-11T23:26:15.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.825+0000 7fe42aa00640 1 --2- 172.21.15.144:0/1692116781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c0b5fd0 0x7fe42c0b6410 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fe418009870 tx=0x7fe41802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85911ab5dc9eed83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:15.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.825+0000 7fe42a000640 1 -- 172.21.15.144:0/1692116781 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418037070 con 0x7fe42c0b5fd0 2024-09-11T23:26:15.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.825+0000 7fe42a000640 1 -- 172.21.15.144:0/1692116781 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe418032440 con 0x7fe42c0b5fd0 2024-09-11T23:26:15.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.825+0000 7fe42a000640 1 -- 172.21.15.144:0/1692116781 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe418032810 con 0x7fe42c0b5fd0 2024-09-11T23:26:15.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.826+0000 7fe431200640 1 -- 172.21.15.144:0/1692116781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c0b5fd0 msgr2=0x7fe42c0b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:15.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.826+0000 7fe431200640 1 --2- 172.21.15.144:0/1692116781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c0b5fd0 0x7fe42c0b6410 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fe418009870 tx=0x7fe41802a270 comp rx=0 tx=0).stop 2024-09-11T23:26:15.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.826+0000 7fe431200640 1 -- 172.21.15.144:0/1692116781 shutdown_connections 2024-09-11T23:26:15.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.826+0000 7fe431200640 1 --2- 172.21.15.144:0/1692116781 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe42c0b7750 0x7fe42c0b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.826+0000 7fe431200640 1 --2- 172.21.15.144:0/1692116781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c0b5fd0 0x7fe42c0b6410 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.826+0000 7fe431200640 1 -- 172.21.15.144:0/1692116781 >> 172.21.15.144:0/1692116781 conn(0x7fe42c0d0fd0 msgr2=0x7fe42c0d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:15.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.826+0000 7fe431200640 1 -- 172.21.15.144:0/1692116781 shutdown_connections 2024-09-11T23:26:15.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.826+0000 7fe431200640 1 -- 172.21.15.144:0/1692116781 wait complete. 2024-09-11T23:26:15.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.827+0000 7fe431200640 1 Processor -- start 2024-09-11T23:26:15.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.827+0000 7fe431200640 1 -- start start 2024-09-11T23:26:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.828+0000 7fe431200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c0b5fd0 0x7fe42c15bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.828+0000 7fe431200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe42c0b7750 0x7fe42c0accc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.828+0000 7fe431200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe42c15e640 0x7fe42c0b7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.828+0000 7fe431200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c06c780 con 0x7fe42c0b5fd0 2024-09-11T23:26:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.828+0000 7fe431200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c0b6950 con 0x7fe42c0b7750 2024-09-11T23:26:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.828+0000 7fe431200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe42c0d4130 con 0x7fe42c15e640 2024-09-11T23:26:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.828+0000 7fe42b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c0b5fd0 0x7fe42c15bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.829+0000 7fe42b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c0b5fd0 0x7fe42c15bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36312/0 (socket says 172.21.15.144:36312) 2024-09-11T23:26:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.829+0000 7fe42b400640 1 -- 172.21.15.144:0/997442120 learned_addr learned my addr 172.21.15.144:0/997442120 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.829+0000 7fe42be00640 1 --2- 172.21.15.144:0/997442120 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe42c15e640 0x7fe42c0b7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.829+0000 7fe42aa00640 1 --2- 172.21.15.144:0/997442120 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe42c0b7750 0x7fe42c0accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.829+0000 7fe42b400640 1 -- 172.21.15.144:0/997442120 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe42c15e640 msgr2=0x7fe42c0b7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:15.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.829+0000 7fe42b400640 1 --2- 172.21.15.144:0/997442120 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe42c15e640 0x7fe42c0b7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.829+0000 7fe42b400640 1 -- 172.21.15.144:0/997442120 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe42c0b7750 msgr2=0x7fe42c0accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:15.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.829+0000 7fe42b400640 1 --2- 172.21.15.144:0/997442120 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe42c0b7750 0x7fe42c0accc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:15.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.829+0000 7fe42b400640 1 -- 172.21.15.144:0/997442120 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c0ad610 con 0x7fe42c0b5fd0 2024-09-11T23:26:15.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.829+0000 7fe42b400640 1 --2- 172.21.15.144:0/997442120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c0b5fd0 0x7fe42c15bb20 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00c3c0 tx=0x7fe41c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:15.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.829+0000 7fe423400640 1 -- 172.21.15.144:0/997442120 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0052d0 con 0x7fe42c0b5fd0 2024-09-11T23:26:15.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.829+0000 7fe423400640 1 -- 172.21.15.144:0/997442120 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe41c005490 con 0x7fe42c0b5fd0 2024-09-11T23:26:15.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.829+0000 7fe431200640 1 -- 172.21.15.144:0/997442120 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42c0ad8f0 con 0x7fe42c0b5fd0 2024-09-11T23:26:15.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.830+0000 7fe423400640 1 -- 172.21.15.144:0/997442120 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41c007260 con 0x7fe42c0b5fd0 2024-09-11T23:26:15.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.830+0000 7fe431200640 1 -- 172.21.15.144:0/997442120 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe42c0ab050 con 0x7fe42c0b5fd0 2024-09-11T23:26:15.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.831+0000 7fe431200640 1 -- 172.21.15.144:0/997442120 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe42c0b6410 con 0x7fe42c0b5fd0 2024-09-11T23:26:15.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.832+0000 7fe423400640 1 -- 172.21.15.144:0/997442120 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7fe41c007400 con 0x7fe42c0b5fd0 2024-09-11T23:26:15.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.833+0000 7fe423400640 1 --2- 172.21.15.144:0/997442120 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe40c06c7c0 0x7fe40c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:15.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.833+0000 7fe423400640 1 -- 172.21.15.144:0/997442120 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7fe41c0889f0 con 0x7fe42c0b5fd0 2024-09-11T23:26:15.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.833+0000 7fe42aa00640 1 --2- 172.21.15.144:0/997442120 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe40c06c7c0 0x7fe40c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:15.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.834+0000 7fe42aa00640 1 --2- 172.21.15.144:0/997442120 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe40c06c7c0 0x7fe40c06ec80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe418034000 tx=0x7fe41802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:15.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:15.837+0000 7fe423400640 1 -- 172.21.15.144:0/997442120 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe41c058950 con 0x7fe42c0b5fd0 2024-09-11T23:26:16.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.020+0000 7fe431200640 1 -- 172.21.15.144:0/997442120 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe42c0b5840 con 0x7fe42c0b5fd0 2024-09-11T23:26:16.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.021+0000 7fe423400640 1 -- 172.21.15.144:0/997442120 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) ==== 74+0+16763 (secure 0 0 0) 0x7fe41c05cc50 con 0x7fe42c0b5fd0 2024-09-11T23:26:16.021 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:16.021 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":153,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:25:53.902129+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:25:50.064555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-11T23:25:51.293809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:26:16.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.024+0000 7fe431200640 1 -- 172.21.15.144:0/997442120 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe40c06c7c0 msgr2=0x7fe40c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:16.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.024+0000 7fe431200640 1 --2- 172.21.15.144:0/997442120 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe40c06c7c0 0x7fe40c06ec80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe418034000 tx=0x7fe41802e000 comp rx=0 tx=0).stop 2024-09-11T23:26:16.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.024+0000 7fe431200640 1 -- 172.21.15.144:0/997442120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c0b5fd0 msgr2=0x7fe42c15bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:16.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.024+0000 7fe431200640 1 --2- 172.21.15.144:0/997442120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c0b5fd0 0x7fe42c15bb20 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00c3c0 tx=0x7fe41c00c880 comp rx=0 tx=0).stop 2024-09-11T23:26:16.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.024+0000 7fe431200640 1 -- 172.21.15.144:0/997442120 shutdown_connections 2024-09-11T23:26:16.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.024+0000 7fe431200640 1 --2- 172.21.15.144:0/997442120 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe40c06c7c0 0x7fe40c06ec80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.024+0000 7fe431200640 1 --2- 172.21.15.144:0/997442120 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe42c15e640 0x7fe42c0b7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.024+0000 7fe431200640 1 --2- 172.21.15.144:0/997442120 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe42c0b7750 0x7fe42c0accc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.024+0000 7fe431200640 1 --2- 172.21.15.144:0/997442120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe42c0b5fd0 0x7fe42c15bb20 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.024+0000 7fe431200640 1 -- 172.21.15.144:0/997442120 >> 172.21.15.144:0/997442120 conn(0x7fe42c0d0fd0 msgr2=0x7fe42c160bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:16.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.024+0000 7fe431200640 1 -- 172.21.15.144:0/997442120 shutdown_connections 2024-09-11T23:26:16.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.024+0000 7fe431200640 1 -- 172.21.15.144:0/997442120 wait complete. 2024-09-11T23:26:16.040 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:26:16.040 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:26:16.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.197+0000 7f4d7aa00640 1 Processor -- start 2024-09-11T23:26:16.197 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.198+0000 7f4d7aa00640 1 -- start start 2024-09-11T23:26:16.198 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.199+0000 7f4d7aa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4d740b6410 0x7f4d740b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:16.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.199+0000 7f4d7aa00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d7406bee0 con 0x7f4d7415e640 2024-09-11T23:26:16.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.199+0000 7f4d7aa00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d7406c1c0 con 0x7f4d740b5fd0 2024-09-11T23:26:16.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.199+0000 7f4d7aa00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f4d7415ea20 con 0x7f4d740b6410 2024-09-11T23:26:16.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.199+0000 7f4d7a000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4d740b6410 0x7f4d740b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:16.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.199+0000 7f4d79600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4d7415e640 0x7f4d740d3a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48104/0 (socket says 172.21.15.144:48104) 2024-09-11T23:26:16.199 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.199+0000 7f4d79600640 1 -- 172.21.15.144:0/1267409801 learned_addr learned my addr 172.21.15.144:0/1267409801 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:16.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.199+0000 7f4d7a000640 1 -- 172.21.15.144:0/1267409801 >> v1:172.21.15.165:6789/0 conn(0x7f4d740b5fd0 legacy=0x7f4d740b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:16.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.199+0000 7f4d7a000640 1 -- 172.21.15.144:0/1267409801 >> v1:172.21.15.144:6789/0 conn(0x7f4d7415e640 legacy=0x7f4d740d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:16.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.199+0000 7f4d7a000640 1 -- 172.21.15.144:0/1267409801 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d7406c4a0 con 0x7f4d740b6410 2024-09-11T23:26:16.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.199+0000 7f4d73e00640 1 -- 172.21.15.144:0/1267409801 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3896809271 0 0) 0x7f4d7406bee0 con 0x7f4d7415e640 2024-09-11T23:26:16.200 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.200+0000 7f4d7a000640 1 --2- 172.21.15.144:0/1267409801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d740b6410 0x7f4d740b7e60 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009d90 tx=0x7f4d6c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa33b1cb26ef0174 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:16.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.201+0000 7f4d73e00640 1 -- 172.21.15.144:0/1267409801 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c007740 con 0x7f4d740b6410 2024-09-11T23:26:16.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.201+0000 7f4d73e00640 1 -- 172.21.15.144:0/1267409801 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d6c0078e0 con 0x7f4d740b6410 2024-09-11T23:26:16.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.201+0000 7f4d73e00640 1 -- 172.21.15.144:0/1267409801 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c007cb0 con 0x7f4d740b6410 2024-09-11T23:26:16.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.201+0000 7f4d7aa00640 1 -- 172.21.15.144:0/1267409801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d740b6410 msgr2=0x7f4d740b7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:16.201 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.201+0000 7f4d7aa00640 1 --2- 172.21.15.144:0/1267409801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d740b6410 0x7f4d740b7e60 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009d90 tx=0x7f4d6c02a6f0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.201+0000 7f4d7aa00640 1 -- 172.21.15.144:0/1267409801 shutdown_connections 2024-09-11T23:26:16.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.201+0000 7f4d7aa00640 1 --2- 172.21.15.144:0/1267409801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d740b6410 0x7f4d740b7e60 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.201+0000 7f4d7aa00640 1 -- 172.21.15.144:0/1267409801 >> 172.21.15.144:0/1267409801 conn(0x7f4d740d0fd0 msgr2=0x7f4d740d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:16.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.201+0000 7f4d7aa00640 1 -- 172.21.15.144:0/1267409801 shutdown_connections 2024-09-11T23:26:16.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.201+0000 7f4d7aa00640 1 -- 172.21.15.144:0/1267409801 wait complete. 2024-09-11T23:26:16.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.203+0000 7f4d7aa00640 1 Processor -- start 2024-09-11T23:26:16.202 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.203+0000 7f4d7aa00640 1 -- start start 2024-09-11T23:26:16.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.204+0000 7f4d7aa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4d740b5fd0 0x7f4d741e9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:16.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.204+0000 7f4d7aa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d740b6410 0x7f4d741e6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:16.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.204+0000 7f4d7aa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d7415e640 0x7f4d741606a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:16.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.204+0000 7f4d7aa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4d740b68a0 con 0x7f4d740b6410 2024-09-11T23:26:16.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.204+0000 7f4d7aa00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7406caf0 con 0x7f4d7415e640 2024-09-11T23:26:16.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.204+0000 7f4d7aa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4d740d4130 con 0x7f4d740b5fd0 2024-09-11T23:26:16.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.204+0000 7f4d78c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d740b6410 0x7f4d741e6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:16.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.204+0000 7f4d78c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d740b6410 0x7f4d741e6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36330/0 (socket says 172.21.15.144:36330) 2024-09-11T23:26:16.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.204+0000 7f4d78c00640 1 -- 172.21.15.144:0/509597983 learned_addr learned my addr 172.21.15.144:0/509597983 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:16.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.204+0000 7f4d79600640 1 --2- 172.21.15.144:0/509597983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4d740b5fd0 0x7f4d741e9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:16.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.204+0000 7f4d7a000640 1 --2- 172.21.15.144:0/509597983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d7415e640 0x7f4d741606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:16.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.205+0000 7f4d78c00640 1 -- 172.21.15.144:0/509597983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4d740b5fd0 msgr2=0x7f4d741e9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:16.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.205+0000 7f4d78c00640 1 --2- 172.21.15.144:0/509597983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4d740b5fd0 0x7f4d741e9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.205+0000 7f4d78c00640 1 -- 172.21.15.144:0/509597983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d7415e640 msgr2=0x7f4d741606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:16.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.205+0000 7f4d78c00640 1 --2- 172.21.15.144:0/509597983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d7415e640 0x7f4d741606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.205+0000 7f4d78c00640 1 -- 172.21.15.144:0/509597983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d741e8910 con 0x7f4d740b6410 2024-09-11T23:26:16.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.205+0000 7f4d7a000640 1 --2- 172.21.15.144:0/509597983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d7415e640 0x7f4d741606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:16.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.205+0000 7f4d78c00640 1 --2- 172.21.15.144:0/509597983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d740b6410 0x7f4d741e6b00 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000c400 tx=0x7f4d6000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:16.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.205+0000 7f4d71600640 1 -- 172.21.15.144:0/509597983 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d60017070 con 0x7f4d740b6410 2024-09-11T23:26:16.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.205+0000 7f4d71600640 1 -- 172.21.15.144:0/509597983 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d600052d0 con 0x7f4d740b6410 2024-09-11T23:26:16.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.205+0000 7f4d71600640 1 -- 172.21.15.144:0/509597983 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d60003830 con 0x7f4d740b6410 2024-09-11T23:26:16.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.205+0000 7f4d7aa00640 1 -- 172.21.15.144:0/509597983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d741e8b80 con 0x7f4d740b6410 2024-09-11T23:26:16.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.205+0000 7f4d7aa00640 1 -- 172.21.15.144:0/509597983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d741e9140 con 0x7f4d740b6410 2024-09-11T23:26:16.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.206+0000 7f4d7aa00640 1 -- 172.21.15.144:0/509597983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d740d3a20 con 0x7f4d740b6410 2024-09-11T23:26:16.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.207+0000 7f4d71600640 1 -- 172.21.15.144:0/509597983 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f4d6001a070 con 0x7f4d740b6410 2024-09-11T23:26:16.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.208+0000 7f4d71600640 1 --2- 172.21.15.144:0/509597983 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4d5406c7c0 0x7f4d5406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:16.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.208+0000 7f4d71600640 1 -- 172.21.15.144:0/509597983 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5767+0+0 (secure 0 0 0) 0x7f4d60088870 con 0x7f4d740b6410 2024-09-11T23:26:16.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.208+0000 7f4d79600640 1 --2- 172.21.15.144:0/509597983 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4d5406c7c0 0x7f4d5406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:16.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.209+0000 7f4d79600640 1 --2- 172.21.15.144:0/509597983 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4d5406c7c0 0x7f4d5406ec80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4d68007f70 tx=0x7f4d68007f00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:16.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.212+0000 7f4d71600640 1 -- 172.21.15.144:0/509597983 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d600587d0 con 0x7f4d740b6410 2024-09-11T23:26:16.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.418+0000 7f4d7aa00640 1 -- 172.21.15.144:0/509597983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d740b5b70 con 0x7f4d740b6410 2024-09-11T23:26:16.418 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.419+0000 7f4d71600640 1 -- 172.21.15.144:0/509597983 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5245 (secure 0 0 0) 0x7f4d6005cad0 con 0x7f4d740b6410 2024-09-11T23:26:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:16.419 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":110,"btime":"2024-09-11T23:26:02:994371+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/2302333712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2302333712},{"type":"v1","addr":"172.21.15.144:6801","nonce":2302333712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104},{"gid":7097,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3051519109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3051519109},{"type":"v1","addr":"172.21.15.165:6834","nonce":3051519109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2403316225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2403316225},{"type":"v1","addr":"172.21.15.165:6835","nonce":2403316225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:25:52.298959+0000","modified":"2024-09-11T23:25:55.324109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8664":{"gid":8664,"name":"c","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/3397068730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3397068730},{"type":"v1","addr":"172.21.15.144:6835","nonce":3397068730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8664,"qdb_cluster":[8664]},"id":12}]} 2024-09-11T23:26:16.419 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 110 2024-09-11T23:26:16.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.421+0000 7f4d7aa00640 1 -- 172.21.15.144:0/509597983 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4d5406c7c0 msgr2=0x7f4d5406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:16.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.421+0000 7f4d7aa00640 1 --2- 172.21.15.144:0/509597983 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4d5406c7c0 0x7f4d5406ec80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4d68007f70 tx=0x7f4d68007f00 comp rx=0 tx=0).stop 2024-09-11T23:26:16.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.421+0000 7f4d7aa00640 1 -- 172.21.15.144:0/509597983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d740b6410 msgr2=0x7f4d741e6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:16.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.421+0000 7f4d7aa00640 1 --2- 172.21.15.144:0/509597983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d740b6410 0x7f4d741e6b00 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000c400 tx=0x7f4d6000c8c0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.421+0000 7f4d7aa00640 1 -- 172.21.15.144:0/509597983 shutdown_connections 2024-09-11T23:26:16.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.421+0000 7f4d7aa00640 1 --2- 172.21.15.144:0/509597983 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4d5406c7c0 0x7f4d5406ec80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.421+0000 7f4d7aa00640 1 --2- 172.21.15.144:0/509597983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d7415e640 0x7f4d741606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.421+0000 7f4d7aa00640 1 --2- 172.21.15.144:0/509597983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4d740b6410 0x7f4d741e6b00 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.421+0000 7f4d7aa00640 1 --2- 172.21.15.144:0/509597983 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4d740b5fd0 0x7f4d741e9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.421 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.421+0000 7f4d7aa00640 1 -- 172.21.15.144:0/509597983 >> 172.21.15.144:0/509597983 conn(0x7f4d740d0fd0 msgr2=0x7f4d74161430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:16.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.421+0000 7f4d7aa00640 1 -- 172.21.15.144:0/509597983 shutdown_connections 2024-09-11T23:26:16.422 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.421+0000 7f4d7aa00640 1 -- 172.21.15.144:0/509597983 wait complete. 2024-09-11T23:26:16.436 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:26:16.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.590+0000 7fa4aac00640 1 Processor -- start 2024-09-11T23:26:16.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.590+0000 7fa4aac00640 1 -- start start 2024-09-11T23:26:16.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.592+0000 7fa4aac00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4a415c180 0x7fa4a40cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:16.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.592+0000 7fa4aac00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4a40ce740 con 0x7fa4a4073120 2024-09-11T23:26:16.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.592+0000 7fa4aac00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4a4072640 con 0x7fa4a40ce230 2024-09-11T23:26:16.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.592+0000 7fa4aac00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fa4a4072920 con 0x7fa4a415c180 2024-09-11T23:26:16.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.592+0000 7fa4a3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4a415c180 0x7fa4a40cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:16.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.592+0000 7fa4a3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa4a415c180 0x7fa4a40cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36336/0 (socket says 172.21.15.144:36336) 2024-09-11T23:26:16.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.592+0000 7fa4a3e00640 1 -- 172.21.15.144:0/2578754384 learned_addr learned my addr 172.21.15.144:0/2578754384 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:16.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.592+0000 7fa4a3e00640 1 -- 172.21.15.144:0/2578754384 >> v1:172.21.15.165:6789/0 conn(0x7fa4a40ce230 legacy=0x7fa4a40cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:16.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.592+0000 7fa4a3e00640 1 -- 172.21.15.144:0/2578754384 >> v1:172.21.15.144:6789/0 conn(0x7fa4a4073120 legacy=0x7fa4a406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:16.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.592+0000 7fa4a3e00640 1 -- 172.21.15.144:0/2578754384 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a4072c00 con 0x7fa4a415c180 2024-09-11T23:26:16.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.593+0000 7fa4a3e00640 1 --2- 172.21.15.144:0/2578754384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4a415c180 0x7fa4a40cdcf0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fa494009e50 tx=0x7fa49402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=590790099ae5e12a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:16.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.594+0000 7fa4a2a00640 1 -- 172.21.15.144:0/2578754384 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa494036070 con 0x7fa4a415c180 2024-09-11T23:26:16.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.594+0000 7fa4a2a00640 1 -- 172.21.15.144:0/2578754384 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa494031600 con 0x7fa4a415c180 2024-09-11T23:26:16.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.594+0000 7fa4a2a00640 1 -- 172.21.15.144:0/2578754384 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4940319d0 con 0x7fa4a415c180 2024-09-11T23:26:16.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.594+0000 7fa4aac00640 1 -- 172.21.15.144:0/2578754384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4a415c180 msgr2=0x7fa4a40cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:16.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.594+0000 7fa4aac00640 1 --2- 172.21.15.144:0/2578754384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4a415c180 0x7fa4a40cdcf0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fa494009e50 tx=0x7fa49402a730 comp rx=0 tx=0).stop 2024-09-11T23:26:16.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.594+0000 7fa4aac00640 1 -- 172.21.15.144:0/2578754384 shutdown_connections 2024-09-11T23:26:16.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.594+0000 7fa4aac00640 1 --2- 172.21.15.144:0/2578754384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4a415c180 0x7fa4a40cdcf0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.594+0000 7fa4aac00640 1 -- 172.21.15.144:0/2578754384 >> 172.21.15.144:0/2578754384 conn(0x7fa4a4062cc0 msgr2=0x7fa4a406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:16.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.594+0000 7fa4aac00640 1 -- 172.21.15.144:0/2578754384 shutdown_connections 2024-09-11T23:26:16.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.594+0000 7fa4aac00640 1 -- 172.21.15.144:0/2578754384 wait complete. 2024-09-11T23:26:16.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.596+0000 7fa4aac00640 1 Processor -- start 2024-09-11T23:26:16.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.596+0000 7fa4aac00640 1 -- start start 2024-09-11T23:26:16.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.597+0000 7fa4aac00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4a4073120 0x7fa4a4146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:16.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.597+0000 7fa4aac00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4a40ce230 0x7fa4a415eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:16.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.597+0000 7fa4aac00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4a415c180 0x7fa4a415f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:16.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.597+0000 7fa4aac00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a40cf780 con 0x7fa4a40ce230 2024-09-11T23:26:16.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.597+0000 7fa4aac00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a40722f0 con 0x7fa4a4073120 2024-09-11T23:26:16.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.597+0000 7fa4aac00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a415c560 con 0x7fa4a415c180 2024-09-11T23:26:16.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.597+0000 7fa4a3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4a40ce230 0x7fa4a415eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:16.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.597+0000 7fa4a3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4a40ce230 0x7fa4a415eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36340/0 (socket says 172.21.15.144:36340) 2024-09-11T23:26:16.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.597+0000 7fa4a3400640 1 -- 172.21.15.144:0/134573617 learned_addr learned my addr 172.21.15.144:0/134573617 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:16.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.597+0000 7fa4a3e00640 1 --2- 172.21.15.144:0/134573617 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4a4073120 0x7fa4a4146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:16.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.597+0000 7fa4a8c00640 1 --2- 172.21.15.144:0/134573617 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4a415c180 0x7fa4a415f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:16.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.598+0000 7fa4a3400640 1 -- 172.21.15.144:0/134573617 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4a415c180 msgr2=0x7fa4a415f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:16.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.598+0000 7fa4a3400640 1 --2- 172.21.15.144:0/134573617 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4a415c180 0x7fa4a415f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.598+0000 7fa4a3400640 1 -- 172.21.15.144:0/134573617 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4a4073120 msgr2=0x7fa4a4146ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:16.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.598+0000 7fa4a3400640 1 --2- 172.21.15.144:0/134573617 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4a4073120 0x7fa4a4146ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.598+0000 7fa4a3400640 1 -- 172.21.15.144:0/134573617 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a4147000 con 0x7fa4a40ce230 2024-09-11T23:26:16.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.598+0000 7fa4a3e00640 1 --2- 172.21.15.144:0/134573617 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4a4073120 0x7fa4a4146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:16.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.598+0000 7fa4a3400640 1 --2- 172.21.15.144:0/134573617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4a40ce230 0x7fa4a415eed0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fa49000c400 tx=0x7fa49000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:16.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.598+0000 7fa49be00640 1 -- 172.21.15.144:0/134573617 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4900052d0 con 0x7fa4a40ce230 2024-09-11T23:26:16.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.598+0000 7fa49be00640 1 -- 172.21.15.144:0/134573617 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa490005490 con 0x7fa4a40ce230 2024-09-11T23:26:16.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.598+0000 7fa4aac00640 1 -- 172.21.15.144:0/134573617 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a41e6d40 con 0x7fa4a40ce230 2024-09-11T23:26:16.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.598+0000 7fa49be00640 1 -- 172.21.15.144:0/134573617 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490007260 con 0x7fa4a40ce230 2024-09-11T23:26:16.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.598+0000 7fa4aac00640 1 -- 172.21.15.144:0/134573617 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a4147540 con 0x7fa4a40ce230 2024-09-11T23:26:16.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.599+0000 7fa4aac00640 1 -- 172.21.15.144:0/134573617 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a40cdcf0 con 0x7fa4a40ce230 2024-09-11T23:26:16.600 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.600+0000 7fa49be00640 1 -- 172.21.15.144:0/134573617 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7fa490007400 con 0x7fa4a40ce230 2024-09-11T23:26:16.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.601+0000 7fa49be00640 1 --2- 172.21.15.144:0/134573617 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa48406c7f0 0x7fa48406ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:16.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.601+0000 7fa49be00640 1 -- 172.21.15.144:0/134573617 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5767+0+0 (secure 0 0 0) 0x7fa490088b00 con 0x7fa4a40ce230 2024-09-11T23:26:16.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.601+0000 7fa4a3e00640 1 --2- 172.21.15.144:0/134573617 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa48406c7f0 0x7fa48406ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:16.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.602+0000 7fa4a3e00640 1 --2- 172.21.15.144:0/134573617 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa48406c7f0 0x7fa48406ecb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa494033000 tx=0x7fa494009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:16.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.605+0000 7fa49be00640 1 -- 172.21.15.144:0/134573617 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa4900590b0 con 0x7fa4a40ce230 2024-09-11T23:26:16.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.813+0000 7fa4aac00640 1 -- 172.21.15.144:0/134573617 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4a4071170 con 0x7fa4a40ce230 2024-09-11T23:26:16.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.813+0000 7fa49be00640 1 -- 172.21.15.144:0/134573617 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5245 (secure 0 0 0) 0x7fa4900589b0 con 0x7fa4a40ce230 2024-09-11T23:26:16.813 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:16.813 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":110,"btime":"2024-09-11T23:26:02:994371+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/2302333712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2302333712},{"type":"v1","addr":"172.21.15.144:6801","nonce":2302333712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104},{"gid":7097,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3051519109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3051519109},{"type":"v1","addr":"172.21.15.165:6834","nonce":3051519109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2403316225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2403316225},{"type":"v1","addr":"172.21.15.165:6835","nonce":2403316225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:25:52.298959+0000","modified":"2024-09-11T23:25:55.324109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8664},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8664":{"gid":8664,"name":"c","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.144:6835/3397068730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3397068730},{"type":"v1","addr":"172.21.15.144:6835","nonce":3397068730}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8664,"qdb_cluster":[8664]},"id":12}]} 2024-09-11T23:26:16.814 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 110 2024-09-11T23:26:16.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.816+0000 7fa4aac00640 1 -- 172.21.15.144:0/134573617 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa48406c7f0 msgr2=0x7fa48406ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:16.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.816+0000 7fa4aac00640 1 --2- 172.21.15.144:0/134573617 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa48406c7f0 0x7fa48406ecb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa494033000 tx=0x7fa494009000 comp rx=0 tx=0).stop 2024-09-11T23:26:16.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.816+0000 7fa4aac00640 1 -- 172.21.15.144:0/134573617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4a40ce230 msgr2=0x7fa4a415eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:16.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.816+0000 7fa4aac00640 1 --2- 172.21.15.144:0/134573617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4a40ce230 0x7fa4a415eed0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fa49000c400 tx=0x7fa49000c8c0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.816+0000 7fa4aac00640 1 -- 172.21.15.144:0/134573617 shutdown_connections 2024-09-11T23:26:16.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.816+0000 7fa4aac00640 1 --2- 172.21.15.144:0/134573617 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa48406c7f0 0x7fa48406ecb0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.816+0000 7fa4aac00640 1 --2- 172.21.15.144:0/134573617 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa4a415c180 0x7fa4a415f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.816+0000 7fa4aac00640 1 --2- 172.21.15.144:0/134573617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4a40ce230 0x7fa4a415eed0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.816+0000 7fa4aac00640 1 --2- 172.21.15.144:0/134573617 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4a4073120 0x7fa4a4146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.816+0000 7fa4aac00640 1 -- 172.21.15.144:0/134573617 >> 172.21.15.144:0/134573617 conn(0x7fa4a4062cc0 msgr2=0x7fa4a40cf900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:16.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.816+0000 7fa4aac00640 1 -- 172.21.15.144:0/134573617 shutdown_connections 2024-09-11T23:26:16.816 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.816+0000 7fa4aac00640 1 -- 172.21.15.144:0/134573617 wait complete. 2024-09-11T23:26:16.831 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:26:16.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.987+0000 7fdd33a00640 1 Processor -- start 2024-09-11T23:26:16.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.987+0000 7fdd33a00640 1 -- start start 2024-09-11T23:26:16.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.989+0000 7fdd33a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fdd2c15ca40 0x7fdd2c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:16.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.989+0000 7fdd33a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdd2c15ceb0 0x7fdd2c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:16.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.989+0000 7fdd33a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd2c15d390 con 0x7fdd2c0d02a0 2024-09-11T23:26:16.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.989+0000 7fdd33a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fdd2c15d670 con 0x7fdd2c15ceb0 2024-09-11T23:26:16.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.989+0000 7fdd33a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fdd2c15d950 con 0x7fdd2c15ca40 2024-09-11T23:26:16.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.989+0000 7fdd31000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdd2c0d02a0 0x7fdd2c0d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48126/0 (socket says 172.21.15.144:48126) 2024-09-11T23:26:16.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.989+0000 7fdd31000640 1 -- 172.21.15.144:0/774433519 learned_addr learned my addr 172.21.15.144:0/774433519 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:16.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.989+0000 7fdd31a00640 1 --2- 172.21.15.144:0/774433519 >> v2:172.21.15.144:3300/0 conn(0x7fdd2c15ceb0 0x7fdd2c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:16.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.989+0000 7fdd2be00640 1 --2- 172.21.15.144:0/774433519 >> v2:172.21.15.165:3300/0 conn(0x7fdd2c15ca40 0x7fdd2c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:16.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.989+0000 7fdd2b400640 1 -- 172.21.15.144:0/774433519 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3049272292 0 0) 0x7fdd2c15d390 con 0x7fdd2c0d02a0 2024-09-11T23:26:16.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.989+0000 7fdd2b400640 1 -- 172.21.15.144:0/774433519 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd10003520 con 0x7fdd2c0d02a0 2024-09-11T23:26:16.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.989+0000 7fdd31a00640 1 -- 172.21.15.144:0/774433519 >> v2:172.21.15.165:3300/0 conn(0x7fdd2c15ca40 msgr2=0x7fdd2c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:16.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.989+0000 7fdd31a00640 1 --2- 172.21.15.144:0/774433519 >> v2:172.21.15.165:3300/0 conn(0x7fdd2c15ca40 0x7fdd2c15e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.989+0000 7fdd31a00640 1 -- 172.21.15.144:0/774433519 >> v1:172.21.15.144:6789/0 conn(0x7fdd2c0d02a0 legacy=0x7fdd2c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:16.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.989+0000 7fdd31a00640 1 -- 172.21.15.144:0/774433519 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2c15dc30 con 0x7fdd2c15ceb0 2024-09-11T23:26:16.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.990+0000 7fdd31a00640 1 --2- 172.21.15.144:0/774433519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd2c15ceb0 0x7fdd2c1594c0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c0cf320 tx=0x7fdd2402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5148d84b45be824d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:16.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.991+0000 7fdd2b400640 1 -- 172.21.15.144:0/774433519 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd24007740 con 0x7fdd2c15ceb0 2024-09-11T23:26:16.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.991+0000 7fdd2b400640 1 -- 172.21.15.144:0/774433519 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd240078e0 con 0x7fdd2c15ceb0 2024-09-11T23:26:16.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.991+0000 7fdd2b400640 1 -- 172.21.15.144:0/774433519 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd24007cb0 con 0x7fdd2c15ceb0 2024-09-11T23:26:16.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.991+0000 7fdd33a00640 1 -- 172.21.15.144:0/774433519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd2c15ceb0 msgr2=0x7fdd2c1594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:16.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.991+0000 7fdd33a00640 1 --2- 172.21.15.144:0/774433519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd2c15ceb0 0x7fdd2c1594c0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c0cf320 tx=0x7fdd2402a5f0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.991+0000 7fdd33a00640 1 -- 172.21.15.144:0/774433519 shutdown_connections 2024-09-11T23:26:16.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.991+0000 7fdd33a00640 1 --2- 172.21.15.144:0/774433519 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd2c15ceb0 0x7fdd2c1594c0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.991+0000 7fdd33a00640 1 --2- 172.21.15.144:0/774433519 >> v2:172.21.15.165:3300/0 conn(0x7fdd2c15ca40 0x7fdd2c15e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.991+0000 7fdd33a00640 1 -- 172.21.15.144:0/774433519 >> 172.21.15.144:0/774433519 conn(0x7fdd2c062cc0 msgr2=0x7fdd2c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:16.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.991+0000 7fdd33a00640 1 -- 172.21.15.144:0/774433519 shutdown_connections 2024-09-11T23:26:16.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.991+0000 7fdd33a00640 1 -- 172.21.15.144:0/774433519 wait complete. 2024-09-11T23:26:16.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.993+0000 7fdd33a00640 1 Processor -- start 2024-09-11T23:26:16.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.993+0000 7fdd33a00640 1 -- start start 2024-09-11T23:26:16.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.994+0000 7fdd33a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd2c0d02a0 0x7fdd2c147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:16.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.994+0000 7fdd33a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd2c15ca40 0x7fdd2c1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:16.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.994+0000 7fdd33a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd2c15ceb0 0x7fdd2c1599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:16.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.994+0000 7fdd33a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2c155d10 con 0x7fdd2c0d02a0 2024-09-11T23:26:16.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.994+0000 7fdd33a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2c155b90 con 0x7fdd2c15ceb0 2024-09-11T23:26:16.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.994+0000 7fdd33a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdd2c0b4790 con 0x7fdd2c15ca40 2024-09-11T23:26:16.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.994+0000 7fdd31000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd2c0d02a0 0x7fdd2c147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:16.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.994+0000 7fdd31000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd2c0d02a0 0x7fdd2c147710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36358/0 (socket says 172.21.15.144:36358) 2024-09-11T23:26:16.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.994+0000 7fdd31000640 1 -- 172.21.15.144:0/807051036 learned_addr learned my addr 172.21.15.144:0/807051036 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:16.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.994+0000 7fdd31a00640 1 --2- 172.21.15.144:0/807051036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd2c15ceb0 0x7fdd2c1599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:16.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.994+0000 7fdd2be00640 1 --2- 172.21.15.144:0/807051036 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd2c15ca40 0x7fdd2c1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:16.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.995+0000 7fdd31000640 1 -- 172.21.15.144:0/807051036 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd2c15ca40 msgr2=0x7fdd2c1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:16.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.995+0000 7fdd31000640 1 --2- 172.21.15.144:0/807051036 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd2c15ca40 0x7fdd2c1594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.995+0000 7fdd31000640 1 -- 172.21.15.144:0/807051036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd2c15ceb0 msgr2=0x7fdd2c1599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:16.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.995+0000 7fdd31000640 1 --2- 172.21.15.144:0/807051036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd2c15ceb0 0x7fdd2c1599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:16.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.995+0000 7fdd31000640 1 -- 172.21.15.144:0/807051036 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2c0cda30 con 0x7fdd2c0d02a0 2024-09-11T23:26:16.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.995+0000 7fdd2be00640 1 --2- 172.21.15.144:0/807051036 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd2c15ca40 0x7fdd2c1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:16.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.995+0000 7fdd31000640 1 --2- 172.21.15.144:0/807051036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd2c0d02a0 0x7fdd2c147710 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c00c460 tx=0x7fdd1c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:16.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.995+0000 7fdd28c00640 1 -- 172.21.15.144:0/807051036 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c017070 con 0x7fdd2c0d02a0 2024-09-11T23:26:16.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.995+0000 7fdd28c00640 1 -- 172.21.15.144:0/807051036 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd1c005ce0 con 0x7fdd2c0d02a0 2024-09-11T23:26:16.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.995+0000 7fdd33a00640 1 -- 172.21.15.144:0/807051036 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd2c0cdd10 con 0x7fdd2c0d02a0 2024-09-11T23:26:16.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.995+0000 7fdd28c00640 1 -- 172.21.15.144:0/807051036 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c007290 con 0x7fdd2c0d02a0 2024-09-11T23:26:16.996 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.995+0000 7fdd33a00640 1 -- 172.21.15.144:0/807051036 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd2c0ce2d0 con 0x7fdd2c0d02a0 2024-09-11T23:26:16.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.996+0000 7fdd33a00640 1 -- 172.21.15.144:0/807051036 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd2c0d0680 con 0x7fdd2c0d02a0 2024-09-11T23:26:16.997 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.997+0000 7fdd28c00640 1 -- 172.21.15.144:0/807051036 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7fdd1c01a070 con 0x7fdd2c0d02a0 2024-09-11T23:26:16.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.998+0000 7fdd28c00640 1 --2- 172.21.15.144:0/807051036 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdd0c06c7c0 0x7fdd0c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:16.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.998+0000 7fdd28c00640 1 -- 172.21.15.144:0/807051036 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5767+0+0 (secure 0 0 0) 0x7fdd1c0888e0 con 0x7fdd2c0d02a0 2024-09-11T23:26:16.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:16.999+0000 7fdd2be00640 1 --2- 172.21.15.144:0/807051036 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdd0c06c7c0 0x7fdd0c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:16.999 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.000+0000 7fdd2be00640 1 --2- 172.21.15.144:0/807051036 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdd0c06c7c0 0x7fdd0c06ec80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c06d170 tx=0x7fdd18008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:17.002 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.003+0000 7fdd28c00640 1 -- 172.21.15.144:0/807051036 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd1c058840 con 0x7fdd2c0d02a0 2024-09-11T23:26:17.184 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.184+0000 7fdd33a00640 1 -- 172.21.15.144:0/807051036 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd2c0b5070 con 0x7fdd2c0d02a0 2024-09-11T23:26:17.188 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.185+0000 7fdd28c00640 1 -- 172.21.15.144:0/807051036 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) ==== 74+0+16805 (secure 0 0 0) 0x7fdd1c05cb40 con 0x7fdd2c0d02a0 2024-09-11T23:26:17.189 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:17.189 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":155,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:26:17.064146+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:25:50.064555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-11T23:25:51.293809+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"25.1a","mappings":[{"from":0,"to":1}]},{"pgid":"25.27","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:26:17.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.188+0000 7fdd33a00640 1 -- 172.21.15.144:0/807051036 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdd0c06c7c0 msgr2=0x7fdd0c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:17.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.188+0000 7fdd33a00640 1 --2- 172.21.15.144:0/807051036 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdd0c06c7c0 0x7fdd0c06ec80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c06d170 tx=0x7fdd18008040 comp rx=0 tx=0).stop 2024-09-11T23:26:17.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.188+0000 7fdd33a00640 1 -- 172.21.15.144:0/807051036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd2c0d02a0 msgr2=0x7fdd2c147710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:17.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.188+0000 7fdd33a00640 1 --2- 172.21.15.144:0/807051036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd2c0d02a0 0x7fdd2c147710 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c00c460 tx=0x7fdd1c00c920 comp rx=0 tx=0).stop 2024-09-11T23:26:17.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.188+0000 7fdd33a00640 1 -- 172.21.15.144:0/807051036 shutdown_connections 2024-09-11T23:26:17.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.188+0000 7fdd33a00640 1 --2- 172.21.15.144:0/807051036 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdd0c06c7c0 0x7fdd0c06ec80 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.188+0000 7fdd33a00640 1 --2- 172.21.15.144:0/807051036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd2c15ceb0 0x7fdd2c1599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.190 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.188+0000 7fdd33a00640 1 --2- 172.21.15.144:0/807051036 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdd2c15ca40 0x7fdd2c1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.188+0000 7fdd33a00640 1 --2- 172.21.15.144:0/807051036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd2c0d02a0 0x7fdd2c147710 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.188+0000 7fdd33a00640 1 -- 172.21.15.144:0/807051036 >> 172.21.15.144:0/807051036 conn(0x7fdd2c062cc0 msgr2=0x7fdd2c152fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:17.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.188+0000 7fdd33a00640 1 -- 172.21.15.144:0/807051036 shutdown_connections 2024-09-11T23:26:17.191 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.188+0000 7fdd33a00640 1 -- 172.21.15.144:0/807051036 wait complete. 2024-09-11T23:26:17.204 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:26:17.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.360+0000 7f88dda00640 1 Processor -- start 2024-09-11T23:26:17.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.360+0000 7f88dda00640 1 -- start start 2024-09-11T23:26:17.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.361+0000 7f88dda00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f88d815e640 0x7f88d80d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:17.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.361+0000 7f88dda00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f88d80b66e0 0x7f88d80b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:17.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.361+0000 7f88dda00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88d806bee0 con 0x7f88d80d3f60 2024-09-11T23:26:17.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.361+0000 7f88dda00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f88d815ea20 con 0x7f88d815e640 2024-09-11T23:26:17.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.361+0000 7f88dda00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f88d806caf0 con 0x7f88d80b66e0 2024-09-11T23:26:17.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.361+0000 7f88d7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f88d815e640 0x7f88d80d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:17.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.361+0000 7f88d7400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f88d80d3f60 0x7f88d80b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48128/0 (socket says 172.21.15.144:48128) 2024-09-11T23:26:17.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.361+0000 7f88d7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f88d815e640 0x7f88d80d3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36362/0 (socket says 172.21.15.144:36362) 2024-09-11T23:26:17.361 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.361+0000 7f88d7400640 1 -- 172.21.15.144:0/510743440 learned_addr learned my addr 172.21.15.144:0/510743440 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:17.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.362+0000 7f88dd000640 1 --2- 172.21.15.144:0/510743440 >> v2:172.21.15.165:3300/0 conn(0x7f88d80b66e0 0x7f88d80b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:17.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.362+0000 7f88d7e00640 1 -- 172.21.15.144:0/510743440 >> v2:172.21.15.165:3300/0 conn(0x7f88d80b66e0 msgr2=0x7f88d80b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:17.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.362+0000 7f88d7e00640 1 --2- 172.21.15.144:0/510743440 >> v2:172.21.15.165:3300/0 conn(0x7f88d80b66e0 0x7f88d80b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.362+0000 7f88d7e00640 1 -- 172.21.15.144:0/510743440 >> v1:172.21.15.144:6789/0 conn(0x7f88d80d3f60 legacy=0x7f88d80b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:17.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.362+0000 7f88d7e00640 1 -- 172.21.15.144:0/510743440 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d806c1c0 con 0x7f88d815e640 2024-09-11T23:26:17.362 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.362+0000 7f88d6a00640 1 -- 172.21.15.144:0/510743440 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3956443430 0 0) 0x7f88d806bee0 con 0x7f88d80d3f60 2024-09-11T23:26:17.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.363+0000 7f88d7e00640 1 --2- 172.21.15.144:0/510743440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d815e640 0x7f88d80d3a20 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f88d80d26e0 tx=0x7f88c802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e84ea85166fe51d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:17.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.363+0000 7f88d6a00640 1 -- 172.21.15.144:0/510743440 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8037070 con 0x7f88d815e640 2024-09-11T23:26:17.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.363+0000 7f88d6a00640 1 -- 172.21.15.144:0/510743440 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c8032440 con 0x7f88d815e640 2024-09-11T23:26:17.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.363+0000 7f88d6a00640 1 -- 172.21.15.144:0/510743440 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8032810 con 0x7f88d815e640 2024-09-11T23:26:17.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.364+0000 7f88dda00640 1 -- 172.21.15.144:0/510743440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d815e640 msgr2=0x7f88d80d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:17.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.364+0000 7f88dda00640 1 --2- 172.21.15.144:0/510743440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d815e640 0x7f88d80d3a20 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f88d80d26e0 tx=0x7f88c802a1a0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.364+0000 7f88dda00640 1 -- 172.21.15.144:0/510743440 shutdown_connections 2024-09-11T23:26:17.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.364+0000 7f88dda00640 1 --2- 172.21.15.144:0/510743440 >> v2:172.21.15.165:3300/0 conn(0x7f88d80b66e0 0x7f88d80b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.364+0000 7f88dda00640 1 --2- 172.21.15.144:0/510743440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d815e640 0x7f88d80d3a20 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.364+0000 7f88dda00640 1 -- 172.21.15.144:0/510743440 >> 172.21.15.144:0/510743440 conn(0x7f88d80d0fd0 msgr2=0x7f88d80d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:17.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.364+0000 7f88dda00640 1 -- 172.21.15.144:0/510743440 shutdown_connections 2024-09-11T23:26:17.364 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.364+0000 7f88dda00640 1 -- 172.21.15.144:0/510743440 wait complete. 2024-09-11T23:26:17.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.365+0000 7f88dda00640 1 Processor -- start 2024-09-11T23:26:17.365 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.366+0000 7f88dda00640 1 -- start start 2024-09-11T23:26:17.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.366+0000 7f88dda00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d80b66e0 0x7f88d8154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:17.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.366+0000 7f88dda00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88d80d3f60 0x7f88d815fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:17.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.366+0000 7f88dda00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d815e640 0x7f88d8160140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:17.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.366+0000 7f88dda00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f88d80b7c90 con 0x7f88d815e640 2024-09-11T23:26:17.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.366+0000 7f88dda00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f88d806c780 con 0x7f88d80d3f60 2024-09-11T23:26:17.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.366+0000 7f88dda00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f88d80b7e10 con 0x7f88d80b66e0 2024-09-11T23:26:17.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.367+0000 7f88dd000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d815e640 0x7f88d8160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:17.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.367+0000 7f88dd000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d815e640 0x7f88d8160140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36376/0 (socket says 172.21.15.144:36376) 2024-09-11T23:26:17.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.367+0000 7f88dd000640 1 -- 172.21.15.144:0/4260921949 learned_addr learned my addr 172.21.15.144:0/4260921949 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:17.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.367+0000 7f88d7e00640 1 --2- 172.21.15.144:0/4260921949 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d80b66e0 0x7f88d8154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:17.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.367+0000 7f88d7400640 1 --2- 172.21.15.144:0/4260921949 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88d80d3f60 0x7f88d815fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:17.367 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.367+0000 7f88dd000640 1 -- 172.21.15.144:0/4260921949 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d80b66e0 msgr2=0x7f88d8154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:17.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.367+0000 7f88dd000640 1 --2- 172.21.15.144:0/4260921949 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d80b66e0 0x7f88d8154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.367+0000 7f88dd000640 1 -- 172.21.15.144:0/4260921949 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88d80d3f60 msgr2=0x7f88d815fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:17.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.367+0000 7f88dd000640 1 --2- 172.21.15.144:0/4260921949 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88d80d3f60 0x7f88d815fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.368 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.367+0000 7f88dd000640 1 -- 172.21.15.144:0/4260921949 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d80ae430 con 0x7f88d815e640 2024-09-11T23:26:17.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.367+0000 7f88dd000640 1 --2- 172.21.15.144:0/4260921949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d815e640 0x7f88d8160140 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f88d0007de0 tx=0x7f88d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:17.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.368+0000 7f88cfe00640 1 -- 172.21.15.144:0/4260921949 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d0014620 con 0x7f88d815e640 2024-09-11T23:26:17.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.368+0000 7f88cfe00640 1 -- 172.21.15.144:0/4260921949 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d0019070 con 0x7f88d815e640 2024-09-11T23:26:17.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.368+0000 7f88cfe00640 1 -- 172.21.15.144:0/4260921949 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d0014a20 con 0x7f88d815e640 2024-09-11T23:26:17.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.368+0000 7f88dda00640 1 -- 172.21.15.144:0/4260921949 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d80ad390 con 0x7f88d815e640 2024-09-11T23:26:17.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.368+0000 7f88dda00640 1 -- 172.21.15.144:0/4260921949 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d80ad950 con 0x7f88d815e640 2024-09-11T23:26:17.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.369+0000 7f88dda00640 1 -- 172.21.15.144:0/4260921949 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d80b7750 con 0x7f88d815e640 2024-09-11T23:26:17.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.370+0000 7f88cfe00640 1 -- 172.21.15.144:0/4260921949 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f88d0014bc0 con 0x7f88d815e640 2024-09-11T23:26:17.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.371+0000 7f88cfe00640 1 --2- 172.21.15.144:0/4260921949 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f88b806c7f0 0x7f88b806ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:17.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.371+0000 7f88cfe00640 1 -- 172.21.15.144:0/4260921949 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5767+0+0 (secure 0 0 0) 0x7f88d0089db0 con 0x7f88d815e640 2024-09-11T23:26:17.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.371+0000 7f88d7e00640 1 --2- 172.21.15.144:0/4260921949 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f88b806c7f0 0x7f88b806ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:17.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.372+0000 7f88d7e00640 1 --2- 172.21.15.144:0/4260921949 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f88b806c7f0 0x7f88b806ecb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f88c8034000 tx=0x7f88c802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:17.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.375+0000 7f88cfe00640 1 -- 172.21.15.144:0/4260921949 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88d0059d10 con 0x7f88d815e640 2024-09-11T23:26:17.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.585+0000 7f88dda00640 1 -- 172.21.15.144:0/4260921949 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f88d80ce960 con 0x7f88d815e640 2024-09-11T23:26:17.585 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-11T23:26:17.586+0000 7f86fcc00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:26:17.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.588+0000 7f88cfe00640 1 -- 172.21.15.144:0/4260921949 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v111) ==== 161+0+0 (secure 0 0 0) 0x7f88d005e010 con 0x7f88d815e640 2024-09-11T23:26:17.588 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:26:17.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.591+0000 7f88dda00640 1 -- 172.21.15.144:0/4260921949 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f88b806c7f0 msgr2=0x7f88b806ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:17.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.591+0000 7f88dda00640 1 --2- 172.21.15.144:0/4260921949 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f88b806c7f0 0x7f88b806ecb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f88c8034000 tx=0x7f88c802e000 comp rx=0 tx=0).stop 2024-09-11T23:26:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.591+0000 7f88dda00640 1 -- 172.21.15.144:0/4260921949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d815e640 msgr2=0x7f88d8160140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.591+0000 7f88dda00640 1 --2- 172.21.15.144:0/4260921949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d815e640 0x7f88d8160140 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f88d0007de0 tx=0x7f88d000e4b0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.591+0000 7f88dda00640 1 -- 172.21.15.144:0/4260921949 shutdown_connections 2024-09-11T23:26:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.591+0000 7f88dda00640 1 --2- 172.21.15.144:0/4260921949 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f88b806c7f0 0x7f88b806ecb0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.591+0000 7f88dda00640 1 --2- 172.21.15.144:0/4260921949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88d815e640 0x7f88d8160140 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.591+0000 7f88dda00640 1 --2- 172.21.15.144:0/4260921949 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88d80d3f60 0x7f88d815fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.591+0000 7f88dda00640 1 --2- 172.21.15.144:0/4260921949 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f88d80b66e0 0x7f88d8154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.591+0000 7f88dda00640 1 -- 172.21.15.144:0/4260921949 >> 172.21.15.144:0/4260921949 conn(0x7f88d80d0fd0 msgr2=0x7f88d80b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:17.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.591+0000 7f88dda00640 1 -- 172.21.15.144:0/4260921949 shutdown_connections 2024-09-11T23:26:17.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.591+0000 7f88dda00640 1 -- 172.21.15.144:0/4260921949 wait complete. 2024-09-11T23:26:17.615 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:26:17.669 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-11T23:26:17.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.776+0000 7ff849400640 1 Processor -- start 2024-09-11T23:26:17.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.777+0000 7ff849400640 1 -- start start 2024-09-11T23:26:17.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.778+0000 7ff849400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff84415e240 0x7ff8440b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:17.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.778+0000 7ff849400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff84406bba0 0x7ff84406bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:17.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.778+0000 7ff849400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8440b3ac0 con 0x7ff84415e620 2024-09-11T23:26:17.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.778+0000 7ff849400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff84406c510 con 0x7ff84406bba0 2024-09-11T23:26:17.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.778+0000 7ff849400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff8440b3d50 con 0x7ff84415e240 2024-09-11T23:26:17.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.778+0000 7ff848a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff84406bba0 0x7ff84406bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:17.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.778+0000 7ff843400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff84415e620 0x7ff8440b33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48138/0 (socket says 172.21.15.144:48138) 2024-09-11T23:26:17.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.778+0000 7ff843400640 1 -- 172.21.15.144:0/812733169 learned_addr learned my addr 172.21.15.144:0/812733169 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:17.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.778+0000 7ff843e00640 1 --2- 172.21.15.144:0/812733169 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff84415e240 0x7ff8440b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:17.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.779+0000 7ff848a00640 1 -- 172.21.15.144:0/812733169 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff84415e240 msgr2=0x7ff8440b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:17.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.779+0000 7ff848a00640 1 --2- 172.21.15.144:0/812733169 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff84415e240 0x7ff8440b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.779+0000 7ff848a00640 1 -- 172.21.15.144:0/812733169 >> v1:172.21.15.144:6789/0 conn(0x7ff84415e620 legacy=0x7ff8440b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:17.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.779+0000 7ff848a00640 1 -- 172.21.15.144:0/812733169 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8440b4030 con 0x7ff84406bba0 2024-09-11T23:26:17.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.779+0000 7ff842a00640 1 -- 172.21.15.144:0/812733169 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3382472507 0 0) 0x7ff8440b3ac0 con 0x7ff84415e620 2024-09-11T23:26:17.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.780+0000 7ff848a00640 1 --2- 172.21.15.144:0/812733169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff84406bba0 0x7ff84406bfd0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009d90 tx=0x7ff83c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686cd453601dcdff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:17.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.780+0000 7ff842a00640 1 -- 172.21.15.144:0/812733169 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c031600 con 0x7ff84406bba0 2024-09-11T23:26:17.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.780+0000 7ff842a00640 1 -- 172.21.15.144:0/812733169 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff83c0317a0 con 0x7ff84406bba0 2024-09-11T23:26:17.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.780+0000 7ff842a00640 1 -- 172.21.15.144:0/812733169 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c031b70 con 0x7ff84406bba0 2024-09-11T23:26:17.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.780+0000 7ff849400640 1 -- 172.21.15.144:0/812733169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff84406bba0 msgr2=0x7ff84406bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:17.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.780+0000 7ff849400640 1 --2- 172.21.15.144:0/812733169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff84406bba0 0x7ff84406bfd0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009d90 tx=0x7ff83c02a5d0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.781+0000 7ff849400640 1 -- 172.21.15.144:0/812733169 shutdown_connections 2024-09-11T23:26:17.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.781+0000 7ff849400640 1 --2- 172.21.15.144:0/812733169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff84406bba0 0x7ff84406bfd0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.781+0000 7ff849400640 1 --2- 172.21.15.144:0/812733169 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff84415e240 0x7ff8440b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.781+0000 7ff849400640 1 -- 172.21.15.144:0/812733169 >> 172.21.15.144:0/812733169 conn(0x7ff8440d0300 msgr2=0x7ff8440d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:17.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.781+0000 7ff849400640 1 -- 172.21.15.144:0/812733169 shutdown_connections 2024-09-11T23:26:17.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.781+0000 7ff849400640 1 -- 172.21.15.144:0/812733169 wait complete. 2024-09-11T23:26:17.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.782+0000 7ff849400640 1 Processor -- start 2024-09-11T23:26:17.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.782+0000 7ff849400640 1 -- start start 2024-09-11T23:26:17.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.783+0000 7ff849400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff84406bba0 0x7ff8440b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:17.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.783+0000 7ff849400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff84415e240 0x7ff844150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:17.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.783+0000 7ff849400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff84415e620 0x7ff844145e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:17.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.783+0000 7ff849400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff8440b48d0 con 0x7ff84415e620 2024-09-11T23:26:17.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.783+0000 7ff849400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff8440b45f0 con 0x7ff84415e240 2024-09-11T23:26:17.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.783+0000 7ff849400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff844162d50 con 0x7ff84406bba0 2024-09-11T23:26:17.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.783+0000 7ff848a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff84415e620 0x7ff844145e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:17.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.784+0000 7ff848a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff84415e620 0x7ff844145e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36414/0 (socket says 172.21.15.144:36414) 2024-09-11T23:26:17.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.784+0000 7ff848a00640 1 -- 172.21.15.144:0/425129185 learned_addr learned my addr 172.21.15.144:0/425129185 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:17.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.784+0000 7ff843400640 1 --2- 172.21.15.144:0/425129185 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff84415e240 0x7ff844150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:17.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.784+0000 7ff843e00640 1 --2- 172.21.15.144:0/425129185 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff84406bba0 0x7ff8440b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:17.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.784+0000 7ff848a00640 1 -- 172.21.15.144:0/425129185 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff84406bba0 msgr2=0x7ff8440b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:17.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.784+0000 7ff848a00640 1 --2- 172.21.15.144:0/425129185 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff84406bba0 0x7ff8440b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.784+0000 7ff848a00640 1 -- 172.21.15.144:0/425129185 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff84415e240 msgr2=0x7ff844150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:17.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.784+0000 7ff848a00640 1 --2- 172.21.15.144:0/425129185 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff84415e240 0x7ff844150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:17.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.784+0000 7ff848a00640 1 -- 172.21.15.144:0/425129185 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8441500b0 con 0x7ff84415e620 2024-09-11T23:26:17.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.784+0000 7ff848a00640 1 --2- 172.21.15.144:0/425129185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff84415e620 0x7ff844145e00 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009eb0 tx=0x7ff83c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:17.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.784+0000 7ff83be00640 1 -- 172.21.15.144:0/425129185 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c040070 con 0x7ff84415e620 2024-09-11T23:26:17.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.785+0000 7ff83be00640 1 -- 172.21.15.144:0/425129185 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff83c030b60 con 0x7ff84415e620 2024-09-11T23:26:17.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.785+0000 7ff849400640 1 -- 172.21.15.144:0/425129185 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff84415f430 con 0x7ff84415e620 2024-09-11T23:26:17.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.785+0000 7ff83be00640 1 -- 172.21.15.144:0/425129185 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c009450 con 0x7ff84415e620 2024-09-11T23:26:17.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.785+0000 7ff849400640 1 -- 172.21.15.144:0/425129185 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8440b2340 con 0x7ff84415e620 2024-09-11T23:26:17.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.786+0000 7ff849400640 1 -- 172.21.15.144:0/425129185 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff84406bfd0 con 0x7ff84415e620 2024-09-11T23:26:17.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.787+0000 7ff83be00640 1 -- 172.21.15.144:0/425129185 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7ff83c039040 con 0x7ff84415e620 2024-09-11T23:26:17.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.787+0000 7ff83be00640 1 --2- 172.21.15.144:0/425129185 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff82406c7f0 0x7ff82406ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:17.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.788+0000 7ff83be00640 1 -- 172.21.15.144:0/425129185 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5853+0+0 (secure 0 0 0) 0x7ff83c0aabd0 con 0x7ff84415e620 2024-09-11T23:26:17.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.788+0000 7ff843e00640 1 --2- 172.21.15.144:0/425129185 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff82406c7f0 0x7ff82406ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:17.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.789+0000 7ff843e00640 1 --2- 172.21.15.144:0/425129185 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff82406c7f0 0x7ff82406ecb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff834009ad0 tx=0x7ff834008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:17.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:17.792+0000 7ff83be00640 1 -- 172.21.15.144:0/425129185 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff83c07b0f0 con 0x7ff84415e620 2024-09-11T23:26:18.000 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.000+0000 7ff849400640 1 -- 172.21.15.144:0/425129185 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff84415bc20 con 0x7ff84415e620 2024-09-11T23:26:18.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.590+0000 7ff83be00640 1 -- 172.21.15.144:0/425129185 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v112) ==== 104+0+0 (secure 0 0 0) 0x7ff83c07a9f0 con 0x7ff84415e620 2024-09-11T23:26:18.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.592+0000 7ff849400640 1 -- 172.21.15.144:0/425129185 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff82406c7f0 msgr2=0x7ff82406ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:18.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.592+0000 7ff849400640 1 --2- 172.21.15.144:0/425129185 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff82406c7f0 0x7ff82406ecb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff834009ad0 tx=0x7ff834008040 comp rx=0 tx=0).stop 2024-09-11T23:26:18.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.592+0000 7ff849400640 1 -- 172.21.15.144:0/425129185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff84415e620 msgr2=0x7ff844145e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:18.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.592+0000 7ff849400640 1 --2- 172.21.15.144:0/425129185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff84415e620 0x7ff844145e00 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009eb0 tx=0x7ff83c004a40 comp rx=0 tx=0).stop 2024-09-11T23:26:18.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.593+0000 7ff849400640 1 -- 172.21.15.144:0/425129185 shutdown_connections 2024-09-11T23:26:18.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.593+0000 7ff849400640 1 --2- 172.21.15.144:0/425129185 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff82406c7f0 0x7ff82406ecb0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:18.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.593+0000 7ff849400640 1 --2- 172.21.15.144:0/425129185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff84415e620 0x7ff844145e00 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:18.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.593+0000 7ff849400640 1 --2- 172.21.15.144:0/425129185 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff84415e240 0x7ff844150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:18.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.593+0000 7ff849400640 1 --2- 172.21.15.144:0/425129185 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff84406bba0 0x7ff8440b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:18.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.593+0000 7ff849400640 1 -- 172.21.15.144:0/425129185 >> 172.21.15.144:0/425129185 conn(0x7ff8440d0300 msgr2=0x7ff8440b4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:18.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.593+0000 7ff849400640 1 -- 172.21.15.144:0/425129185 shutdown_connections 2024-09-11T23:26:18.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.593+0000 7ff849400640 1 -- 172.21.15.144:0/425129185 wait complete. 2024-09-11T23:26:18.610 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:26:18.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.769+0000 7f86cc800640 1 Processor -- start 2024-09-11T23:26:18.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.769+0000 7f86cc800640 1 -- start start 2024-09-11T23:26:18.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.770+0000 7f86cc800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86c406d910 0x7f86c40b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:18.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.770+0000 7f86cc800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c4072f10 con 0x7f86c40cdbb0 2024-09-11T23:26:18.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.770+0000 7f86cc800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c40b4020 con 0x7f86c40ce700 2024-09-11T23:26:18.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.770+0000 7f86cc800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f86c40ceb70 con 0x7f86c406d910 2024-09-11T23:26:18.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.770+0000 7f86c9400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f86c40cdbb0 0x7f86c40cdff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48144/0 (socket says 172.21.15.144:48144) 2024-09-11T23:26:18.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.770+0000 7f86c9400640 1 -- 172.21.15.144:0/378522452 learned_addr learned my addr 172.21.15.144:0/378522452 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:18.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.770+0000 7f86c9e00640 1 --2- 172.21.15.144:0/378522452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86c406d910 0x7f86c40b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:18.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.771+0000 7f86c9e00640 1 -- 172.21.15.144:0/378522452 >> v1:172.21.15.165:6789/0 conn(0x7f86c40ce700 legacy=0x7f86c406ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:18.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.771+0000 7f86c8a00640 1 -- 172.21.15.144:0/378522452 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2927860890 0 0) 0x7f86c40b4020 con 0x7f86c40ce700 2024-09-11T23:26:18.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.771+0000 7f86c9e00640 1 -- 172.21.15.144:0/378522452 >> v1:172.21.15.144:6789/0 conn(0x7f86c40cdbb0 legacy=0x7f86c40cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:18.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.771+0000 7f86c9e00640 1 -- 172.21.15.144:0/378522452 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c40b4300 con 0x7f86c406d910 2024-09-11T23:26:18.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.772+0000 7f86c9e00640 1 --2- 172.21.15.144:0/378522452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86c406d910 0x7f86c40b50c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f86b80097d0 tx=0x7f86b802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f31d3e673d66cbee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:18.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.772+0000 7f86c8a00640 1 -- 172.21.15.144:0/378522452 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b8037070 con 0x7f86c406d910 2024-09-11T23:26:18.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.772+0000 7f86c8a00640 1 -- 172.21.15.144:0/378522452 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86b8032440 con 0x7f86c406d910 2024-09-11T23:26:18.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.772+0000 7f86c8a00640 1 -- 172.21.15.144:0/378522452 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b8032810 con 0x7f86c406d910 2024-09-11T23:26:18.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.773+0000 7f86cc800640 1 -- 172.21.15.144:0/378522452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86c406d910 msgr2=0x7f86c40b50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:18.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.773+0000 7f86cc800640 1 --2- 172.21.15.144:0/378522452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86c406d910 0x7f86c40b50c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f86b80097d0 tx=0x7f86b802a210 comp rx=0 tx=0).stop 2024-09-11T23:26:18.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.773+0000 7f86cc800640 1 -- 172.21.15.144:0/378522452 shutdown_connections 2024-09-11T23:26:18.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.773+0000 7f86cc800640 1 --2- 172.21.15.144:0/378522452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86c406d910 0x7f86c40b50c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:18.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.773+0000 7f86cc800640 1 -- 172.21.15.144:0/378522452 >> 172.21.15.144:0/378522452 conn(0x7f86c406bba0 msgr2=0x7f86c406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:18.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.773+0000 7f86cc800640 1 -- 172.21.15.144:0/378522452 shutdown_connections 2024-09-11T23:26:18.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.773+0000 7f86cc800640 1 -- 172.21.15.144:0/378522452 wait complete. 2024-09-11T23:26:18.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.775+0000 7f86cc800640 1 Processor -- start 2024-09-11T23:26:18.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.775+0000 7f86cc800640 1 -- start start 2024-09-11T23:26:18.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.776+0000 7f86cc800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c406d910 0x7f86c40c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:18.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.776+0000 7f86cc800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86c40cdbb0 0x7f86c41f3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:18.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.776+0000 7f86cc800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86c40ce700 0x7f86c41f3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.776+0000 7f86cc800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f86c415af50 con 0x7f86c406d910 2024-09-11T23:26:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.776+0000 7f86cc800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f86c40b4ba0 con 0x7f86c40ce700 2024-09-11T23:26:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.776+0000 7f86cc800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f86c406d080 con 0x7f86c40cdbb0 2024-09-11T23:26:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.776+0000 7f86c9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c406d910 0x7f86c40c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.776+0000 7f86c9e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c406d910 0x7f86c40c98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36418/0 (socket says 172.21.15.144:36418) 2024-09-11T23:26:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.776+0000 7f86c9e00640 1 -- 172.21.15.144:0/3748348490 learned_addr learned my addr 172.21.15.144:0/3748348490 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.776+0000 7f86c9400640 1 --2- 172.21.15.144:0/3748348490 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86c40cdbb0 0x7f86c41f3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.776+0000 7f86ca800640 1 --2- 172.21.15.144:0/3748348490 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86c40ce700 0x7f86c41f3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.776+0000 7f86c9e00640 1 -- 172.21.15.144:0/3748348490 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86c40cdbb0 msgr2=0x7f86c41f3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.776+0000 7f86c9e00640 1 --2- 172.21.15.144:0/3748348490 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86c40cdbb0 0x7f86c41f3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.776+0000 7f86c9e00640 1 -- 172.21.15.144:0/3748348490 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86c40ce700 msgr2=0x7f86c41f3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.776+0000 7f86c9e00640 1 --2- 172.21.15.144:0/3748348490 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86c40ce700 0x7f86c41f3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:18.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.776+0000 7f86c9e00640 1 -- 172.21.15.144:0/3748348490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c414ebf0 con 0x7f86c406d910 2024-09-11T23:26:18.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.777+0000 7f86c9e00640 1 --2- 172.21.15.144:0/3748348490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c406d910 0x7f86c40c98b0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f86b80097d0 tx=0x7f86b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:18.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.777+0000 7f86be000640 1 -- 172.21.15.144:0/3748348490 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b8037040 con 0x7f86c406d910 2024-09-11T23:26:18.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.777+0000 7f86be000640 1 -- 172.21.15.144:0/3748348490 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86b8042070 con 0x7f86c406d910 2024-09-11T23:26:18.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.777+0000 7f86be000640 1 -- 172.21.15.144:0/3748348490 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b8030bd0 con 0x7f86c406d910 2024-09-11T23:26:18.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.777+0000 7f86cc800640 1 -- 172.21.15.144:0/3748348490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c414ee90 con 0x7f86c406d910 2024-09-11T23:26:18.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.777+0000 7f86cc800640 1 -- 172.21.15.144:0/3748348490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c414f450 con 0x7f86c406d910 2024-09-11T23:26:18.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.778+0000 7f86cc800640 1 -- 172.21.15.144:0/3748348490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c4069b00 con 0x7f86c406d910 2024-09-11T23:26:18.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.779+0000 7f86be000640 1 -- 172.21.15.144:0/3748348490 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f86b8047460 con 0x7f86c406d910 2024-09-11T23:26:18.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.780+0000 7f86be000640 1 --2- 172.21.15.144:0/3748348490 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f86a806c7c0 0x7f86a806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:18.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.781+0000 7f86be000640 1 -- 172.21.15.144:0/3748348490 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5853+0+0 (secure 0 0 0) 0x7f86b80aa2a0 con 0x7f86c406d910 2024-09-11T23:26:18.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.781+0000 7f86c9400640 1 --2- 172.21.15.144:0/3748348490 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f86a806c7c0 0x7f86a806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:18.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.781+0000 7f86c9400640 1 --2- 172.21.15.144:0/3748348490 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f86a806c7c0 0x7f86a806ec80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f86c40afb90 tx=0x7f86b4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:18.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.785+0000 7f86be000640 1 -- 172.21.15.144:0/3748348490 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f86c4069b00 con 0x7f86c406d910 2024-09-11T23:26:18.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:18.959+0000 7f86cc800640 1 -- 172.21.15.144:0/3748348490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f86c406d4b0 con 0x7f86c406d910 2024-09-11T23:26:19.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.595+0000 7f86be000640 1 -- 172.21.15.144:0/3748348490 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v157) ==== 181+0+0 (secure 0 0 0) 0x7f86b8032e20 con 0x7f86c406d910 2024-09-11T23:26:19.595 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:26:19.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.598+0000 7f86cc800640 1 -- 172.21.15.144:0/3748348490 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f86a806c7c0 msgr2=0x7f86a806ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:19.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.598+0000 7f86cc800640 1 --2- 172.21.15.144:0/3748348490 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f86a806c7c0 0x7f86a806ec80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f86c40afb90 tx=0x7f86b4009040 comp rx=0 tx=0).stop 2024-09-11T23:26:19.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.598+0000 7f86cc800640 1 -- 172.21.15.144:0/3748348490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c406d910 msgr2=0x7f86c40c98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:19.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.598+0000 7f86cc800640 1 --2- 172.21.15.144:0/3748348490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c406d910 0x7f86c40c98b0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f86b80097d0 tx=0x7f86b80046c0 comp rx=0 tx=0).stop 2024-09-11T23:26:19.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.599+0000 7f86cc800640 1 -- 172.21.15.144:0/3748348490 shutdown_connections 2024-09-11T23:26:19.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.599+0000 7f86cc800640 1 --2- 172.21.15.144:0/3748348490 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f86a806c7c0 0x7f86a806ec80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:19.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.599+0000 7f86cc800640 1 --2- 172.21.15.144:0/3748348490 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86c40ce700 0x7f86c41f3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:19.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.599+0000 7f86cc800640 1 --2- 172.21.15.144:0/3748348490 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f86c40cdbb0 0x7f86c41f3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:19.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.599+0000 7f86cc800640 1 --2- 172.21.15.144:0/3748348490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86c406d910 0x7f86c40c98b0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:19.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.599+0000 7f86cc800640 1 -- 172.21.15.144:0/3748348490 >> 172.21.15.144:0/3748348490 conn(0x7f86c406bba0 msgr2=0x7f86c4074c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:19.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.599+0000 7f86cc800640 1 -- 172.21.15.144:0/3748348490 shutdown_connections 2024-09-11T23:26:19.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.599+0000 7f86cc800640 1 -- 172.21.15.144:0/3748348490 wait complete. 2024-09-11T23:26:19.618 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:26:19.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.781+0000 7f8033200640 1 Processor -- start 2024-09-11T23:26:19.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.781+0000 7f8033200640 1 -- start start 2024-09-11T23:26:19.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.783+0000 7f8033200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f802c15c030 0x7f802c071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:19.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.783+0000 7f8033200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f802c072870 con 0x7f802c15c410 2024-09-11T23:26:19.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.783+0000 7f8033200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f802c072b50 con 0x7f802c0b2570 2024-09-11T23:26:19.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.783+0000 7f8033200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f802c072e30 con 0x7f802c15c030 2024-09-11T23:26:19.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.783+0000 7f8031e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f802c15c030 0x7f802c071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:19.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.783+0000 7f8031e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f802c15c030 0x7f802c071f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36428/0 (socket says 172.21.15.144:36428) 2024-09-11T23:26:19.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.783+0000 7f8031e00640 1 -- 172.21.15.144:0/1218414984 learned_addr learned my addr 172.21.15.144:0/1218414984 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.783+0000 7f8031e00640 1 -- 172.21.15.144:0/1218414984 >> v1:172.21.15.165:6789/0 conn(0x7f802c0b2570 legacy=0x7f802c0cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.783+0000 7f8031e00640 1 -- 172.21.15.144:0/1218414984 >> v1:172.21.15.144:6789/0 conn(0x7f802c15c410 legacy=0x7f802c0b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.783+0000 7f8031e00640 1 -- 172.21.15.144:0/1218414984 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f802c073110 con 0x7f802c15c030 2024-09-11T23:26:19.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.784+0000 7f8031e00640 1 --2- 172.21.15.144:0/1218414984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f802c15c030 0x7f802c071f60 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f80200098a0 tx=0x7f802002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e88b6d52930a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:19.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.785+0000 7f8030a00640 1 -- 172.21.15.144:0/1218414984 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8020037070 con 0x7f802c15c030 2024-09-11T23:26:19.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.785+0000 7f8030a00640 1 -- 172.21.15.144:0/1218414984 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8020032440 con 0x7f802c15c030 2024-09-11T23:26:19.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.785+0000 7f8030a00640 1 -- 172.21.15.144:0/1218414984 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8020032810 con 0x7f802c15c030 2024-09-11T23:26:19.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.785+0000 7f8033200640 1 -- 172.21.15.144:0/1218414984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f802c15c030 msgr2=0x7f802c071f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:19.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.785+0000 7f8033200640 1 --2- 172.21.15.144:0/1218414984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f802c15c030 0x7f802c071f60 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f80200098a0 tx=0x7f802002a250 comp rx=0 tx=0).stop 2024-09-11T23:26:19.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.785+0000 7f8033200640 1 -- 172.21.15.144:0/1218414984 shutdown_connections 2024-09-11T23:26:19.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.785+0000 7f8033200640 1 --2- 172.21.15.144:0/1218414984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f802c15c030 0x7f802c071f60 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:19.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.785+0000 7f8033200640 1 -- 172.21.15.144:0/1218414984 >> 172.21.15.144:0/1218414984 conn(0x7f802c06bba0 msgr2=0x7f802c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:19.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.785+0000 7f8033200640 1 -- 172.21.15.144:0/1218414984 shutdown_connections 2024-09-11T23:26:19.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.785+0000 7f8033200640 1 -- 172.21.15.144:0/1218414984 wait complete. 2024-09-11T23:26:19.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.787+0000 7f8033200640 1 Processor -- start 2024-09-11T23:26:19.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.787+0000 7f8033200640 1 -- start start 2024-09-11T23:26:19.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.788+0000 7f8033200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f802c0b2570 0x7f802c1551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:19.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.788+0000 7f8033200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f802c15c030 0x7f802c158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:19.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.788+0000 7f8033200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f802c15c410 0x7f802c0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:19.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.788+0000 7f8033200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f802c0b2ab0 con 0x7f802c15c030 2024-09-11T23:26:19.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.788+0000 7f8033200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f802c073450 con 0x7f802c0b2570 2024-09-11T23:26:19.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.788+0000 7f8033200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f802c0b2c30 con 0x7f802c15c410 2024-09-11T23:26:19.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.788+0000 7f8031400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f802c15c030 0x7f802c158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:19.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.788+0000 7f8031400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f802c15c030 0x7f802c158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36432/0 (socket says 172.21.15.144:36432) 2024-09-11T23:26:19.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.788+0000 7f8031400640 1 -- 172.21.15.144:0/2761149206 learned_addr learned my addr 172.21.15.144:0/2761149206 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:19.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.788+0000 7f8031e00640 1 --2- 172.21.15.144:0/2761149206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f802c0b2570 0x7f802c1551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:19.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.788+0000 7f8032800640 1 --2- 172.21.15.144:0/2761149206 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f802c15c410 0x7f802c0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:19.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.789+0000 7f8031400640 1 -- 172.21.15.144:0/2761149206 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f802c15c410 msgr2=0x7f802c0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:19.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.789+0000 7f8031400640 1 --2- 172.21.15.144:0/2761149206 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f802c15c410 0x7f802c0ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:19.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.789+0000 7f8031400640 1 -- 172.21.15.144:0/2761149206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f802c0b2570 msgr2=0x7f802c1551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:19.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.789+0000 7f8031400640 1 --2- 172.21.15.144:0/2761149206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f802c0b2570 0x7f802c1551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:19.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.789+0000 7f8031400640 1 -- 172.21.15.144:0/2761149206 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f802c1f7ec0 con 0x7f802c15c030 2024-09-11T23:26:19.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.789+0000 7f8031400640 1 --2- 172.21.15.144:0/2761149206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f802c15c030 0x7f802c158590 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f801c00c470 tx=0x7f801c00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:19.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.789+0000 7f8026000640 1 -- 172.21.15.144:0/2761149206 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c0052d0 con 0x7f802c15c030 2024-09-11T23:26:19.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.789+0000 7f8026000640 1 -- 172.21.15.144:0/2761149206 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f801c005490 con 0x7f802c15c030 2024-09-11T23:26:19.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.789+0000 7f8033200640 1 -- 172.21.15.144:0/2761149206 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f802c158ad0 con 0x7f802c15c030 2024-09-11T23:26:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.789+0000 7f8026000640 1 -- 172.21.15.144:0/2761149206 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c007260 con 0x7f802c15c030 2024-09-11T23:26:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.789+0000 7f8033200640 1 -- 172.21.15.144:0/2761149206 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f802c1f8410 con 0x7f802c15c030 2024-09-11T23:26:19.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.790+0000 7f8033200640 1 -- 172.21.15.144:0/2761149206 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f802c071f60 con 0x7f802c15c030 2024-09-11T23:26:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.791+0000 7f8026000640 1 -- 172.21.15.144:0/2761149206 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f801c007400 con 0x7f802c15c030 2024-09-11T23:26:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.792+0000 7f8026000640 1 --2- 172.21.15.144:0/2761149206 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f801006c7c0 0x7f801006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.792+0000 7f8026000640 1 -- 172.21.15.144:0/2761149206 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5415+0+0 (secure 0 0 0) 0x7f801c088a60 con 0x7f802c15c030 2024-09-11T23:26:19.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.793+0000 7f8031e00640 1 --2- 172.21.15.144:0/2761149206 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f801006c7c0 0x7f801006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:19.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.794+0000 7f8031e00640 1 --2- 172.21.15.144:0/2761149206 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f801006c7c0 0x7f801006ec80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8020034000 tx=0x7f802002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:19.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.796+0000 7f8026000640 1 -- 172.21.15.144:0/2761149206 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f802c158ad0 con 0x7f802c15c030 2024-09-11T23:26:19.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:19.970+0000 7f8033200640 1 -- 172.21.15.144:0/2761149206 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f802c0cc680 con 0x7f802c15c030 2024-09-11T23:26:20.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.598+0000 7f8026000640 1 -- 172.21.15.144:0/2761149206 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v158) ==== 169+0+0 (secure 0 0 0) 0x7f801c059010 con 0x7f802c15c030 2024-09-11T23:26:20.598 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-11T23:26:20.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.601+0000 7f8033200640 1 -- 172.21.15.144:0/2761149206 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f801006c7c0 msgr2=0x7f801006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:20.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.601+0000 7f8033200640 1 --2- 172.21.15.144:0/2761149206 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f801006c7c0 0x7f801006ec80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8020034000 tx=0x7f802002e000 comp rx=0 tx=0).stop 2024-09-11T23:26:20.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.601+0000 7f8033200640 1 -- 172.21.15.144:0/2761149206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f802c15c030 msgr2=0x7f802c158590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:20.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.601+0000 7f8033200640 1 --2- 172.21.15.144:0/2761149206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f802c15c030 0x7f802c158590 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f801c00c470 tx=0x7f801c00c930 comp rx=0 tx=0).stop 2024-09-11T23:26:20.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.602+0000 7f8033200640 1 -- 172.21.15.144:0/2761149206 shutdown_connections 2024-09-11T23:26:20.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.602+0000 7f8033200640 1 --2- 172.21.15.144:0/2761149206 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f801006c7c0 0x7f801006ec80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:20.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.602+0000 7f8033200640 1 --2- 172.21.15.144:0/2761149206 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f802c15c410 0x7f802c0ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:20.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.602+0000 7f8033200640 1 --2- 172.21.15.144:0/2761149206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f802c15c030 0x7f802c158590 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:20.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.602+0000 7f8033200640 1 --2- 172.21.15.144:0/2761149206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f802c0b2570 0x7f802c1551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:20.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.602+0000 7f8033200640 1 -- 172.21.15.144:0/2761149206 >> 172.21.15.144:0/2761149206 conn(0x7f802c06bba0 msgr2=0x7f802c0b1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:20.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.602+0000 7f8033200640 1 -- 172.21.15.144:0/2761149206 shutdown_connections 2024-09-11T23:26:20.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.602+0000 7f8033200640 1 -- 172.21.15.144:0/2761149206 wait complete. 2024-09-11T23:26:20.620 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:26:20.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.776+0000 7f7613800640 1 Processor -- start 2024-09-11T23:26:20.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.776+0000 7f7613800640 1 -- start start 2024-09-11T23:26:20.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.777+0000 7f7613800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f760c15d790 0x7f760c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:20.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.777+0000 7f7613800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f760c0cd3b0 0x7f760c0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:20.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.777+0000 7f7613800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f760c06d700 con 0x7f760c15d3b0 2024-09-11T23:26:20.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.777+0000 7f7613800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f760c06da30 con 0x7f760c15d790 2024-09-11T23:26:20.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.777+0000 7f7613800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f760c0cde80 con 0x7f760c0cd3b0 2024-09-11T23:26:20.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.778+0000 7f7610e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f760c15d3b0 0x7f760c071080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48162/0 (socket says 172.21.15.144:48162) 2024-09-11T23:26:20.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.778+0000 7f7610e00640 1 -- 172.21.15.144:0/382900711 learned_addr learned my addr 172.21.15.144:0/382900711 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:20.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.778+0000 7f760be00640 1 --2- 172.21.15.144:0/382900711 >> v2:172.21.15.165:3300/0 conn(0x7f760c15d790 0x7f760c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:20.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.778+0000 7f7611800640 1 --2- 172.21.15.144:0/382900711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f760c0cd3b0 0x7f760c0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:20.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.778+0000 7f760b400640 1 -- 172.21.15.144:0/382900711 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 390846912 0 0) 0x7f760c06d700 con 0x7f760c15d3b0 2024-09-11T23:26:20.778 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.778+0000 7f760b400640 1 -- 172.21.15.144:0/382900711 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75f4003520 con 0x7f760c15d3b0 2024-09-11T23:26:20.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.778+0000 7f760be00640 1 -- 172.21.15.144:0/382900711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f760c0cd3b0 msgr2=0x7f760c0cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:20.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.778+0000 7f760be00640 1 --2- 172.21.15.144:0/382900711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f760c0cd3b0 0x7f760c0cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:20.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.778+0000 7f760be00640 1 -- 172.21.15.144:0/382900711 >> v1:172.21.15.144:6789/0 conn(0x7f760c15d3b0 legacy=0x7f760c071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:20.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.778+0000 7f760b400640 1 -- 172.21.15.144:0/382900711 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 905232307 0 0) 0x7f75f4003520 con 0x7f760c15d3b0 2024-09-11T23:26:20.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.778+0000 7f760be00640 1 -- 172.21.15.144:0/382900711 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f760c0cd8c0 con 0x7f760c15d790 2024-09-11T23:26:20.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.778+0000 7f7611800640 1 --2- 172.21.15.144:0/382900711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f760c0cd3b0 0x7f760c0cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:26:20.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.779+0000 7f760be00640 1 --2- 172.21.15.144:0/382900711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f760c15d790 0x7f760c0cce70 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f760c06dbb0 tx=0x7f75f802a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3236d049906e888d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:20.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.780+0000 7f760b400640 1 -- 172.21.15.144:0/382900711 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f8037070 con 0x7f760c15d790 2024-09-11T23:26:20.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.780+0000 7f760b400640 1 -- 172.21.15.144:0/382900711 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f802ab80 con 0x7f760c15d790 2024-09-11T23:26:20.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.780+0000 7f760b400640 1 -- 172.21.15.144:0/382900711 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7600001670 con 0x7f760c15d790 2024-09-11T23:26:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.780+0000 7f7613800640 1 -- 172.21.15.144:0/382900711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f760c15d790 msgr2=0x7f760c0cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.780+0000 7f7613800640 1 --2- 172.21.15.144:0/382900711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f760c15d790 0x7f760c0cce70 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f760c06dbb0 tx=0x7f75f802a0f0 comp rx=0 tx=0).stop 2024-09-11T23:26:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.780+0000 7f7613800640 1 -- 172.21.15.144:0/382900711 shutdown_connections 2024-09-11T23:26:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.780+0000 7f7613800640 1 --2- 172.21.15.144:0/382900711 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f760c0cd3b0 0x7f760c0cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.780+0000 7f7613800640 1 --2- 172.21.15.144:0/382900711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f760c15d790 0x7f760c0cce70 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.780+0000 7f7613800640 1 -- 172.21.15.144:0/382900711 >> 172.21.15.144:0/382900711 conn(0x7f760c06bba0 msgr2=0x7f760c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.780+0000 7f7613800640 1 -- 172.21.15.144:0/382900711 shutdown_connections 2024-09-11T23:26:20.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.780+0000 7f7613800640 1 -- 172.21.15.144:0/382900711 wait complete. 2024-09-11T23:26:20.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.782+0000 7f7613800640 1 Processor -- start 2024-09-11T23:26:20.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.782+0000 7f7613800640 1 -- start start 2024-09-11T23:26:20.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.783+0000 7f7613800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f760c0cd3b0 0x7f760c149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:20.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.783+0000 7f7613800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f760c15d3b0 0x7f760c159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:20.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.783+0000 7f7613800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f760c15ee70 0x7f760c15f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:20.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.783+0000 7f7613800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f760c15cd70 con 0x7f760c0cd3b0 2024-09-11T23:26:20.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.783+0000 7f7613800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f760c15cbf0 con 0x7f760c15d3b0 2024-09-11T23:26:20.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.783+0000 7f7613800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f760c0cf860 con 0x7f760c15ee70 2024-09-11T23:26:20.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.783+0000 7f7610e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f760c0cd3b0 0x7f760c149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:20.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.783+0000 7f7610e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f760c0cd3b0 0x7f760c149c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36440/0 (socket says 172.21.15.144:36440) 2024-09-11T23:26:20.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.783+0000 7f7611800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f760c15ee70 0x7f760c15f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:20.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.783+0000 7f7610e00640 1 -- 172.21.15.144:0/2875027940 learned_addr learned my addr 172.21.15.144:0/2875027940 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:20.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.783+0000 7f760be00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f760c15d3b0 0x7f760c159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:20.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.784+0000 7f760be00640 1 -- 172.21.15.144:0/2875027940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f760c15ee70 msgr2=0x7f760c15f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:20.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.784+0000 7f760be00640 1 --2- 172.21.15.144:0/2875027940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f760c15ee70 0x7f760c15f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:20.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.784+0000 7f760be00640 1 -- 172.21.15.144:0/2875027940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f760c0cd3b0 msgr2=0x7f760c149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:20.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.784+0000 7f760be00640 1 --2- 172.21.15.144:0/2875027940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f760c0cd3b0 0x7f760c149c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:20.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.784+0000 7f760be00640 1 -- 172.21.15.144:0/2875027940 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f760c155480 con 0x7f760c15d3b0 2024-09-11T23:26:20.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.784+0000 7f7610e00640 1 --2- 172.21.15.144:0/2875027940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f760c0cd3b0 0x7f760c149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:26:20.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.784+0000 7f760be00640 1 --2- 172.21.15.144:0/2875027940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f760c15d3b0 0x7f760c159d20 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f75f8031000 tx=0x7f75f80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:20.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.785+0000 7f7608c00640 1 -- 172.21.15.144:0/2875027940 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f8041030 con 0x7f760c15d3b0 2024-09-11T23:26:20.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.785+0000 7f7608c00640 1 -- 172.21.15.144:0/2875027940 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f8005990 con 0x7f760c15d3b0 2024-09-11T23:26:20.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.785+0000 7f7608c00640 1 -- 172.21.15.144:0/2875027940 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f8037040 con 0x7f760c15d3b0 2024-09-11T23:26:20.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.785+0000 7f7613800640 1 -- 172.21.15.144:0/2875027940 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f760c155760 con 0x7f760c15d3b0 2024-09-11T23:26:20.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.785+0000 7f7613800640 1 -- 172.21.15.144:0/2875027940 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f760c155d20 con 0x7f760c15d3b0 2024-09-11T23:26:20.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.786+0000 7f7613800640 1 -- 172.21.15.144:0/2875027940 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f760c0cfc90 con 0x7f760c15d3b0 2024-09-11T23:26:20.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.787+0000 7f7608c00640 1 -- 172.21.15.144:0/2875027940 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f75f8044070 con 0x7f760c15d3b0 2024-09-11T23:26:20.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.788+0000 7f7608c00640 1 --2- 172.21.15.144:0/2875027940 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f75ec06c7c0 0x7f75ec06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:20.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.788+0000 7f7608c00640 1 -- 172.21.15.144:0/2875027940 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4943+0+0 (secure 0 0 0) 0x7f75f80aa110 con 0x7f760c15d3b0 2024-09-11T23:26:20.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.788+0000 7f7610e00640 1 --2- 172.21.15.144:0/2875027940 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f75ec06c7c0 0x7f75ec06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:20.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.789+0000 7f7610e00640 1 --2- 172.21.15.144:0/2875027940 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f75ec06c7c0 0x7f75ec06ec80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7600005880 tx=0x7f7600009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:20.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.792+0000 7f7608c00640 1 -- 172.21.15.144:0/2875027940 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f75f807a6c0 con 0x7f760c15d3b0 2024-09-11T23:26:20.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.973+0000 7f7613800640 1 -- 172.21.15.144:0/2875027940 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f760c0afa80 con 0x7f760c15d3b0 2024-09-11T23:26:20.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.979+0000 7f7608c00640 1 -- 172.21.15.144:0/2875027940 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v29) ==== 104+0+0 (secure 0 0 0) 0x7f75f8079fc0 con 0x7f760c15d3b0 2024-09-11T23:26:20.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.981+0000 7f7613800640 1 -- 172.21.15.144:0/2875027940 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f75ec06c7c0 msgr2=0x7f75ec06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:20.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.981+0000 7f7613800640 1 --2- 172.21.15.144:0/2875027940 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f75ec06c7c0 0x7f75ec06ec80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7600005880 tx=0x7f7600009040 comp rx=0 tx=0).stop 2024-09-11T23:26:20.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.981+0000 7f7613800640 1 -- 172.21.15.144:0/2875027940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f760c15d3b0 msgr2=0x7f760c159d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:20.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.981+0000 7f7613800640 1 --2- 172.21.15.144:0/2875027940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f760c15d3b0 0x7f760c159d20 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f75f8031000 tx=0x7f75f80046c0 comp rx=0 tx=0).stop 2024-09-11T23:26:20.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.981+0000 7f7613800640 1 -- 172.21.15.144:0/2875027940 shutdown_connections 2024-09-11T23:26:20.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.981+0000 7f7613800640 1 --2- 172.21.15.144:0/2875027940 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f75ec06c7c0 0x7f75ec06ec80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:20.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.981+0000 7f7613800640 1 --2- 172.21.15.144:0/2875027940 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f760c15ee70 0x7f760c15f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:20.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.981+0000 7f7613800640 1 --2- 172.21.15.144:0/2875027940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f760c15d3b0 0x7f760c159d20 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:20.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.981+0000 7f7613800640 1 --2- 172.21.15.144:0/2875027940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f760c0cd3b0 0x7f760c149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:20.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.981+0000 7f7613800640 1 -- 172.21.15.144:0/2875027940 >> 172.21.15.144:0/2875027940 conn(0x7f760c06bba0 msgr2=0x7f760c071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:20.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.981+0000 7f7613800640 1 -- 172.21.15.144:0/2875027940 shutdown_connections 2024-09-11T23:26:20.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:20.981+0000 7f7613800640 1 -- 172.21.15.144:0/2875027940 wait complete. 2024-09-11T23:26:20.996 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2' 2024-09-11T23:26:21.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.150+0000 7f6897e00640 1 Processor -- start 2024-09-11T23:26:21.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.150+0000 7f6897e00640 1 -- start start 2024-09-11T23:26:21.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.151+0000 7f6897e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f689815e640 0x7f68980d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:21.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.151+0000 7f6897e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68980d3f60 0x7f68980b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:21.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.151+0000 7f6897e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f689806bee0 con 0x7f68980b6510 2024-09-11T23:26:21.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.151+0000 7f6897e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f689815ea20 con 0x7f689815e640 2024-09-11T23:26:21.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.151+0000 7f6897e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f689806caf0 con 0x7f68980d3f60 2024-09-11T23:26:21.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.152+0000 7f6896000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68980d3f60 0x7f68980b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:21.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.152+0000 7f6896a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f689815e640 0x7f68980d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:21.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.152+0000 7f6897400640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f68980b6510 0x7f68980d27c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:48626/0 (socket says 172.21.15.144:48626) 2024-09-11T23:26:21.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.152+0000 7f6897400640 1 -- 172.21.15.144:0/1689973003 learned_addr learned my addr 172.21.15.144:0/1689973003 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:21.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.152+0000 7f6896000640 1 -- 172.21.15.144:0/1689973003 >> v2:172.21.15.165:3300/0 conn(0x7f689815e640 msgr2=0x7f68980d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:21.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.152+0000 7f6896000640 1 --2- 172.21.15.144:0/1689973003 >> v2:172.21.15.165:3300/0 conn(0x7f689815e640 0x7f68980d3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.152+0000 7f6896000640 1 -- 172.21.15.144:0/1689973003 >> v1:172.21.15.165:6789/0 conn(0x7f68980b6510 legacy=0x7f68980d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:21.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.152+0000 7f6896000640 1 -- 172.21.15.144:0/1689973003 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689806c1c0 con 0x7f68980d3f60 2024-09-11T23:26:21.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.153+0000 7f6896000640 1 --2- 172.21.15.144:0/1689973003 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68980d3f60 0x7f68980b5fd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f68840097a0 tx=0x7f688402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=259acc6a1559fe83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:21.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.154+0000 7f6895600640 1 -- 172.21.15.144:0/1689973003 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6884037070 con 0x7f68980d3f60 2024-09-11T23:26:21.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.154+0000 7f6895600640 1 -- 172.21.15.144:0/1689973003 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6884032440 con 0x7f68980d3f60 2024-09-11T23:26:21.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.154+0000 7f6895600640 1 -- 172.21.15.144:0/1689973003 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6884032810 con 0x7f68980d3f60 2024-09-11T23:26:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.154+0000 7f6897e00640 1 -- 172.21.15.144:0/1689973003 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68980d3f60 msgr2=0x7f68980b5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.154+0000 7f6897e00640 1 --2- 172.21.15.144:0/1689973003 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68980d3f60 0x7f68980b5fd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f68840097a0 tx=0x7f688402a180 comp rx=0 tx=0).stop 2024-09-11T23:26:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.154+0000 7f6897e00640 1 -- 172.21.15.144:0/1689973003 shutdown_connections 2024-09-11T23:26:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.154+0000 7f6897e00640 1 --2- 172.21.15.144:0/1689973003 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f68980d3f60 0x7f68980b5fd0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.154+0000 7f6897e00640 1 --2- 172.21.15.144:0/1689973003 >> v2:172.21.15.165:3300/0 conn(0x7f689815e640 0x7f68980d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.154+0000 7f6897e00640 1 -- 172.21.15.144:0/1689973003 >> 172.21.15.144:0/1689973003 conn(0x7f68980d0fd0 msgr2=0x7f68980d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:21.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.154+0000 7f6897e00640 1 -- 172.21.15.144:0/1689973003 shutdown_connections 2024-09-11T23:26:21.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.154+0000 7f6897e00640 1 -- 172.21.15.144:0/1689973003 wait complete. 2024-09-11T23:26:21.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.156+0000 7f6897e00640 1 Processor -- start 2024-09-11T23:26:21.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.156+0000 7f6897e00640 1 -- start start 2024-09-11T23:26:21.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.157+0000 7f6897e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68980b6510 0x7f68980c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:21.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.157+0000 7f6897e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f68980d3f60 0x7f68980c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:21.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.157+0000 7f6897e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f689815e640 0x7f68980c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:21.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.157+0000 7f6897e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f68980b8760 con 0x7f68980b6510 2024-09-11T23:26:21.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.157+0000 7f6897e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f689806c780 con 0x7f68980d3f60 2024-09-11T23:26:21.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.157+0000 7f6897e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f68980b88e0 con 0x7f689815e640 2024-09-11T23:26:21.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.157+0000 7f6896a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68980b6510 0x7f68980c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:21.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.157+0000 7f6896a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68980b6510 0x7f68980c9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36452/0 (socket says 172.21.15.144:36452) 2024-09-11T23:26:21.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.157+0000 7f6896a00640 1 -- 172.21.15.144:0/1978932405 learned_addr learned my addr 172.21.15.144:0/1978932405 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:21.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.157+0000 7f6896000640 1 --2- 172.21.15.144:0/1978932405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f68980d3f60 0x7f68980c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:21.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.157+0000 7f6897400640 1 --2- 172.21.15.144:0/1978932405 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f689815e640 0x7f68980c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:21.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.157+0000 7f6896a00640 1 -- 172.21.15.144:0/1978932405 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f689815e640 msgr2=0x7f68980c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:21.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.157+0000 7f6896a00640 1 --2- 172.21.15.144:0/1978932405 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f689815e640 0x7f68980c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.157+0000 7f6896a00640 1 -- 172.21.15.144:0/1978932405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f68980d3f60 msgr2=0x7f68980c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:21.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.158+0000 7f6896a00640 1 --2- 172.21.15.144:0/1978932405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f68980d3f60 0x7f68980c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.158+0000 7f6896a00640 1 -- 172.21.15.144:0/1978932405 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689815b610 con 0x7f68980b6510 2024-09-11T23:26:21.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.158+0000 7f6897400640 1 --2- 172.21.15.144:0/1978932405 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f689815e640 0x7f68980c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:21.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.158+0000 7f6896a00640 1 --2- 172.21.15.144:0/1978932405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68980b6510 0x7f68980c9ca0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f688800e8a0 tx=0x7f688800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:21.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.158+0000 7f688ea00640 1 -- 172.21.15.144:0/1978932405 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888017070 con 0x7f68980b6510 2024-09-11T23:26:21.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.158+0000 7f688ea00640 1 -- 172.21.15.144:0/1978932405 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f688800c940 con 0x7f68980b6510 2024-09-11T23:26:21.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.158+0000 7f6897e00640 1 -- 172.21.15.144:0/1978932405 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68980ca760 con 0x7f68980b6510 2024-09-11T23:26:21.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.158+0000 7f688ea00640 1 -- 172.21.15.144:0/1978932405 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688800cd30 con 0x7f68980b6510 2024-09-11T23:26:21.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.158+0000 7f6897e00640 1 -- 172.21.15.144:0/1978932405 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68980cad20 con 0x7f68980b6510 2024-09-11T23:26:21.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.159+0000 7f6897e00640 1 -- 172.21.15.144:0/1978932405 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68980b5fd0 con 0x7f68980b6510 2024-09-11T23:26:21.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.160+0000 7f688ea00640 1 -- 172.21.15.144:0/1978932405 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f688801a070 con 0x7f68980b6510 2024-09-11T23:26:21.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.161+0000 7f688ea00640 1 --2- 172.21.15.144:0/1978932405 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f687806c7c0 0x7f687806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:21.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.161+0000 7f688ea00640 1 -- 172.21.15.144:0/1978932405 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4943+0+0 (secure 0 0 0) 0x7f68880893d0 con 0x7f68980b6510 2024-09-11T23:26:21.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.161+0000 7f6896000640 1 --2- 172.21.15.144:0/1978932405 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f687806c7c0 0x7f687806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:21.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.162+0000 7f6896000640 1 --2- 172.21.15.144:0/1978932405 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f687806c7c0 0x7f687806ec80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6884034000 tx=0x7f688402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:21.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.165+0000 7f688ea00640 1 -- 172.21.15.144:0/1978932405 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6888059330 con 0x7f68980b6510 2024-09-11T23:26:21.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.409+0000 7f6897e00640 1 -- 172.21.15.144:0/1978932405 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]} v 0) -- 0x7f689806d010 con 0x7f68980b6510 2024-09-11T23:26:21.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.607+0000 7f688ea00640 1 -- 172.21.15.144:0/1978932405 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]}]=0 v465) ==== 145+0+0 (secure 0 0 0) 0x7f688805d630 con 0x7f68980b6510 2024-09-11T23:26:21.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.609+0000 7f6897e00640 1 -- 172.21.15.144:0/1978932405 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f687806c7c0 msgr2=0x7f687806ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:21.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.609+0000 7f6897e00640 1 --2- 172.21.15.144:0/1978932405 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f687806c7c0 0x7f687806ec80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6884034000 tx=0x7f688402e000 comp rx=0 tx=0).stop 2024-09-11T23:26:21.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.609+0000 7f6897e00640 1 -- 172.21.15.144:0/1978932405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68980b6510 msgr2=0x7f68980c9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:21.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.609+0000 7f6897e00640 1 --2- 172.21.15.144:0/1978932405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68980b6510 0x7f68980c9ca0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f688800e8a0 tx=0x7f688800ed60 comp rx=0 tx=0).stop 2024-09-11T23:26:21.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.609+0000 7f6897e00640 1 -- 172.21.15.144:0/1978932405 shutdown_connections 2024-09-11T23:26:21.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.609+0000 7f6897e00640 1 --2- 172.21.15.144:0/1978932405 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f687806c7c0 0x7f687806ec80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.609+0000 7f6897e00640 1 --2- 172.21.15.144:0/1978932405 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f689815e640 0x7f68980c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.609+0000 7f6897e00640 1 --2- 172.21.15.144:0/1978932405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f68980d3f60 0x7f68980c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.609+0000 7f6897e00640 1 --2- 172.21.15.144:0/1978932405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68980b6510 0x7f68980c9ca0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.609+0000 7f6897e00640 1 -- 172.21.15.144:0/1978932405 >> 172.21.15.144:0/1978932405 conn(0x7f68980d0fd0 msgr2=0x7f68980b3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:21.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.610+0000 7f6897e00640 1 -- 172.21.15.144:0/1978932405 shutdown_connections 2024-09-11T23:26:21.610 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.610+0000 7f6897e00640 1 -- 172.21.15.144:0/1978932405 wait complete. 2024-09-11T23:26:21.627 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- theme continues... ... ok 2024-09-11T23:26:21.627 INFO:tasks.cephfs_test_runner:Starting test: test_unparseable_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate unparseable text .meta file on legacy subvol root doesn't break the system 2024-09-11T23:26:21.627 INFO:tasks.cephfs_test_runner:test_unparseable_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2024-09-11T23:26:21.628 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:26:21.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.781+0000 7f8540400640 1 Processor -- start 2024-09-11T23:26:21.781 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.781+0000 7f8540400640 1 -- start start 2024-09-11T23:26:21.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.782+0000 7f8540400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f853815c180 0x7f85380cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:21.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.782+0000 7f8540400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8538073120 0x7f85380735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:21.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.782+0000 7f8540400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85380ce740 con 0x7f85380ce230 2024-09-11T23:26:21.782 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.782+0000 7f8540400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8538072640 con 0x7f8538073120 2024-09-11T23:26:21.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.782+0000 7f8540400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8538072920 con 0x7f853815c180 2024-09-11T23:26:21.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.783+0000 7f853e400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8538073120 0x7f85380735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:21.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.783+0000 7f853e400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8538073120 0x7f85380735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36464/0 (socket says 172.21.15.144:36464) 2024-09-11T23:26:21.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.783+0000 7f853e400640 1 -- 172.21.15.144:0/1944849927 learned_addr learned my addr 172.21.15.144:0/1944849927 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:21.783 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.783+0000 7f853da00640 1 --2- 172.21.15.144:0/1944849927 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f853815c180 0x7f85380cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:21.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.783+0000 7f853e400640 1 -- 172.21.15.144:0/1944849927 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f853815c180 msgr2=0x7f85380cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:21.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.783+0000 7f853e400640 1 --2- 172.21.15.144:0/1944849927 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f853815c180 0x7f85380cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.783+0000 7f853e400640 1 -- 172.21.15.144:0/1944849927 >> v1:172.21.15.144:6789/0 conn(0x7f85380ce230 legacy=0x7f85380cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:21.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.783+0000 7f853e400640 1 -- 172.21.15.144:0/1944849927 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8538072c00 con 0x7f8538073120 2024-09-11T23:26:21.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.783+0000 7f853da00640 1 --2- 172.21.15.144:0/1944849927 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f853815c180 0x7f85380cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:21.784 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.784+0000 7f853e400640 1 --2- 172.21.15.144:0/1944849927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8538073120 0x7f85380735d0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f8530009e50 tx=0x7f853002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5058b3651d71e335 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:21.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.784+0000 7f8537e00640 1 -- 172.21.15.144:0/1944849927 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8530036070 con 0x7f8538073120 2024-09-11T23:26:21.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.784+0000 7f8537e00640 1 -- 172.21.15.144:0/1944849927 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8530031600 con 0x7f8538073120 2024-09-11T23:26:21.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.785+0000 7f8537e00640 1 -- 172.21.15.144:0/1944849927 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85300319d0 con 0x7f8538073120 2024-09-11T23:26:21.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.785+0000 7f8540400640 1 -- 172.21.15.144:0/1944849927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8538073120 msgr2=0x7f85380735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:21.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.785+0000 7f8540400640 1 --2- 172.21.15.144:0/1944849927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8538073120 0x7f85380735d0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f8530009e50 tx=0x7f853002a6a0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.785 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.785+0000 7f8540400640 1 -- 172.21.15.144:0/1944849927 shutdown_connections 2024-09-11T23:26:21.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.785+0000 7f8540400640 1 --2- 172.21.15.144:0/1944849927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8538073120 0x7f85380735d0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.785+0000 7f8540400640 1 --2- 172.21.15.144:0/1944849927 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f853815c180 0x7f85380cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.785+0000 7f8540400640 1 -- 172.21.15.144:0/1944849927 >> 172.21.15.144:0/1944849927 conn(0x7f8538062cc0 msgr2=0x7f853806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:21.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.785+0000 7f8540400640 1 -- 172.21.15.144:0/1944849927 shutdown_connections 2024-09-11T23:26:21.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.785+0000 7f8540400640 1 -- 172.21.15.144:0/1944849927 wait complete. 2024-09-11T23:26:21.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.787+0000 7f8540400640 1 Processor -- start 2024-09-11T23:26:21.786 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.787+0000 7f8540400640 1 -- start start 2024-09-11T23:26:21.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.788+0000 7f8540400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8538073120 0x7f853814c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:21.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.788+0000 7f8540400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85380ce230 0x7f85380b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:21.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.788+0000 7f8540400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f853815c180 0x7f8538152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:21.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.788+0000 7f8540400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f85380cf780 con 0x7f853815c180 2024-09-11T23:26:21.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.788+0000 7f8540400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f85380722f0 con 0x7f8538073120 2024-09-11T23:26:21.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.788+0000 7f8540400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f853815c560 con 0x7f85380ce230 2024-09-11T23:26:21.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.788+0000 7f853e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f853815c180 0x7f8538152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:21.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.788+0000 7f853e400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f853815c180 0x7f8538152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36476/0 (socket says 172.21.15.144:36476) 2024-09-11T23:26:21.788 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.788+0000 7f853e400640 1 -- 172.21.15.144:0/286361236 learned_addr learned my addr 172.21.15.144:0/286361236 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:21.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.788+0000 7f853d000640 1 --2- 172.21.15.144:0/286361236 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85380ce230 0x7f85380b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:21.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.788+0000 7f853da00640 1 --2- 172.21.15.144:0/286361236 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8538073120 0x7f853814c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:21.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.788+0000 7f853e400640 1 -- 172.21.15.144:0/286361236 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85380ce230 msgr2=0x7f85380b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:21.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.788+0000 7f853e400640 1 --2- 172.21.15.144:0/286361236 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85380ce230 0x7f85380b13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.788+0000 7f853e400640 1 -- 172.21.15.144:0/286361236 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8538073120 msgr2=0x7f853814c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:21.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.788+0000 7f853e400640 1 --2- 172.21.15.144:0/286361236 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8538073120 0x7f853814c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.788+0000 7f853e400640 1 -- 172.21.15.144:0/286361236 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85380b0320 con 0x7f853815c180 2024-09-11T23:26:21.789 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.788+0000 7f853d000640 1 --2- 172.21.15.144:0/286361236 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85380ce230 0x7f85380b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:21.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.789+0000 7f853e400640 1 --2- 172.21.15.144:0/286361236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f853815c180 0x7f8538152420 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f8530034040 tx=0x7f8530004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:21.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.789+0000 7f8535600640 1 -- 172.21.15.144:0/286361236 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8530036050 con 0x7f853815c180 2024-09-11T23:26:21.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.789+0000 7f8535600640 1 -- 172.21.15.144:0/286361236 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8530042070 con 0x7f853815c180 2024-09-11T23:26:21.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.789+0000 7f8535600640 1 -- 172.21.15.144:0/286361236 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8530009510 con 0x7f853815c180 2024-09-11T23:26:21.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.789+0000 7f8540400640 1 -- 172.21.15.144:0/286361236 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85380b0600 con 0x7f853815c180 2024-09-11T23:26:21.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.789+0000 7f8540400640 1 -- 172.21.15.144:0/286361236 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85380b0bc0 con 0x7f853815c180 2024-09-11T23:26:21.790 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.790+0000 7f8540400640 1 -- 172.21.15.144:0/286361236 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85380d1170 con 0x7f853815c180 2024-09-11T23:26:21.791 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.791+0000 7f8535600640 1 -- 172.21.15.144:0/286361236 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f8530007bd0 con 0x7f853815c180 2024-09-11T23:26:21.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.792+0000 7f8535600640 1 --2- 172.21.15.144:0/286361236 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f851806c7f0 0x7f851806ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:21.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.792+0000 7f8535600640 1 -- 172.21.15.144:0/286361236 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4943+0+0 (secure 0 0 0) 0x7f85300aa530 con 0x7f853815c180 2024-09-11T23:26:21.792 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.793+0000 7f853da00640 1 --2- 172.21.15.144:0/286361236 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f851806c7f0 0x7f851806ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:21.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.793+0000 7f853da00640 1 --2- 172.21.15.144:0/286361236 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f851806c7f0 0x7f851806ecb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f852c00a990 tx=0x7f852c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:21.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.797+0000 7f8535600640 1 -- 172.21.15.144:0/286361236 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f85380d1170 con 0x7f853815c180 2024-09-11T23:26:21.972 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.972+0000 7f8540400640 1 -- 172.21.15.144:0/286361236 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85380b52e0 con 0x7f853815c180 2024-09-11T23:26:21.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.973+0000 7f8535600640 1 -- 172.21.15.144:0/286361236 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) ==== 74+0+13068 (secure 0 0 0) 0x7f85380b52e0 con 0x7f853815c180 2024-09-11T23:26:21.973 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:21.973 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":158,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:26:20.596054+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.144:6835/3397068730":"2024-09-12T23:26:17.586704+0000","172.21.15.144:6834/3397068730":"2024-09-12T23:26:17.586704+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:26:21.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.976+0000 7f8540400640 1 -- 172.21.15.144:0/286361236 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f851806c7f0 msgr2=0x7f851806ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:21.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.976+0000 7f8540400640 1 --2- 172.21.15.144:0/286361236 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f851806c7f0 0x7f851806ecb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f852c00a990 tx=0x7f852c008040 comp rx=0 tx=0).stop 2024-09-11T23:26:21.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.976+0000 7f8540400640 1 -- 172.21.15.144:0/286361236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f853815c180 msgr2=0x7f8538152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:21.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.976+0000 7f8540400640 1 --2- 172.21.15.144:0/286361236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f853815c180 0x7f8538152420 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f8530034040 tx=0x7f8530004a40 comp rx=0 tx=0).stop 2024-09-11T23:26:21.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.976+0000 7f8540400640 1 -- 172.21.15.144:0/286361236 shutdown_connections 2024-09-11T23:26:21.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.976+0000 7f8540400640 1 --2- 172.21.15.144:0/286361236 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f851806c7f0 0x7f851806ecb0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.976+0000 7f8540400640 1 --2- 172.21.15.144:0/286361236 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f853815c180 0x7f8538152420 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.976+0000 7f8540400640 1 --2- 172.21.15.144:0/286361236 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f85380ce230 0x7f85380b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.976+0000 7f8540400640 1 --2- 172.21.15.144:0/286361236 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8538073120 0x7f853814c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:21.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.976+0000 7f8540400640 1 -- 172.21.15.144:0/286361236 >> 172.21.15.144:0/286361236 conn(0x7f8538062cc0 msgr2=0x7f85380b4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:21.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.976+0000 7f8540400640 1 -- 172.21.15.144:0/286361236 shutdown_connections 2024-09-11T23:26:21.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:21.976+0000 7f8540400640 1 -- 172.21.15.144:0/286361236 wait complete. 2024-09-11T23:26:21.993 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T23:17:47.307937+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T23:26:21.993 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T23:26:22.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.150+0000 7f9c96200640 1 Processor -- start 2024-09-11T23:26:22.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.150+0000 7f9c96200640 1 -- start start 2024-09-11T23:26:22.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.151+0000 7f9c96200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f9c9006d610 0x7f9c9006d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:22.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.151+0000 7f9c96200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c9015eaa0 con 0x7f9c900cf510 2024-09-11T23:26:22.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.151+0000 7f9c96200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c9006df30 con 0x7f9c9015e6c0 2024-09-11T23:26:22.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.151+0000 7f9c96200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f9c900d34d0 con 0x7f9c9006d610 2024-09-11T23:26:22.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.151+0000 7f9c8fe00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9c900cf510 0x7f9c900b7670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48172/0 (socket says 172.21.15.144:48172) 2024-09-11T23:26:22.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.151+0000 7f9c8fe00640 1 -- 172.21.15.144:0/3207693230 learned_addr learned my addr 172.21.15.144:0/3207693230 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:22.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.151+0000 7f9c95800640 1 --2- 172.21.15.144:0/3207693230 >> v2:172.21.15.165:3300/0 conn(0x7f9c9006d610 0x7f9c9006d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:22.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.152+0000 7f9c8f400640 1 -- 172.21.15.144:0/3207693230 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4140294949 0 0) 0x7f9c9015eaa0 con 0x7f9c900cf510 2024-09-11T23:26:22.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.152+0000 7f9c8f400640 1 -- 172.21.15.144:0/3207693230 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c78003520 con 0x7f9c900cf510 2024-09-11T23:26:22.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.152+0000 7f9c95800640 1 -- 172.21.15.144:0/3207693230 >> v1:172.21.15.165:6789/0 conn(0x7f9c9015e6c0 legacy=0x7f9c9006c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:22.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.152+0000 7f9c95800640 1 -- 172.21.15.144:0/3207693230 >> v1:172.21.15.144:6789/0 conn(0x7f9c900cf510 legacy=0x7f9c900b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:22.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.152+0000 7f9c95800640 1 -- 172.21.15.144:0/3207693230 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c900d28c0 con 0x7f9c9006d610 2024-09-11T23:26:22.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.153+0000 7f9c95800640 1 --2- 172.21.15.144:0/3207693230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c9006d610 0x7f9c9006d9f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009d90 tx=0x7f9c8802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fdbb2ec221226ca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:22.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.153+0000 7f9c8f400640 1 -- 172.21.15.144:0/3207693230 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c88007740 con 0x7f9c9006d610 2024-09-11T23:26:22.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.153+0000 7f9c8f400640 1 -- 172.21.15.144:0/3207693230 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c880078e0 con 0x7f9c9006d610 2024-09-11T23:26:22.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.153+0000 7f9c8f400640 1 -- 172.21.15.144:0/3207693230 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c88007cb0 con 0x7f9c9006d610 2024-09-11T23:26:22.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.154+0000 7f9c96200640 1 -- 172.21.15.144:0/3207693230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c9006d610 msgr2=0x7f9c9006d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:22.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.154+0000 7f9c96200640 1 --2- 172.21.15.144:0/3207693230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c9006d610 0x7f9c9006d9f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009d90 tx=0x7f9c8802a6f0 comp rx=0 tx=0).stop 2024-09-11T23:26:22.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.154+0000 7f9c96200640 1 -- 172.21.15.144:0/3207693230 shutdown_connections 2024-09-11T23:26:22.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.154+0000 7f9c96200640 1 --2- 172.21.15.144:0/3207693230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c9006d610 0x7f9c9006d9f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:22.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.154+0000 7f9c96200640 1 -- 172.21.15.144:0/3207693230 >> 172.21.15.144:0/3207693230 conn(0x7f9c900d4720 msgr2=0x7f9c900d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:22.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.154+0000 7f9c96200640 1 -- 172.21.15.144:0/3207693230 shutdown_connections 2024-09-11T23:26:22.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.154+0000 7f9c96200640 1 -- 172.21.15.144:0/3207693230 wait complete. 2024-09-11T23:26:22.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.156+0000 7f9c96200640 1 Processor -- start 2024-09-11T23:26:22.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.156+0000 7f9c96200640 1 -- start start 2024-09-11T23:26:22.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.156+0000 7f9c96200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c9006d610 0x7f9c9015eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:22.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.156+0000 7f9c96200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c900cf510 0x7f9c9014ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:22.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.157+0000 7f9c96200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c9015e6c0 0x7f9c901617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:22.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.157+0000 7f9c96200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9c900d3160 con 0x7f9c9015e6c0 2024-09-11T23:26:22.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.157+0000 7f9c96200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9c900d2e80 con 0x7f9c900cf510 2024-09-11T23:26:22.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.157+0000 7f9c96200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9c900b7d80 con 0x7f9c9006d610 2024-09-11T23:26:22.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.157+0000 7f9c95800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c9015e6c0 0x7f9c901617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:22.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.157+0000 7f9c95800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c9015e6c0 0x7f9c901617b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36486/0 (socket says 172.21.15.144:36486) 2024-09-11T23:26:22.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.157+0000 7f9c95800640 1 -- 172.21.15.144:0/98282121 learned_addr learned my addr 172.21.15.144:0/98282121 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:22.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.157+0000 7f9c94e00640 1 --2- 172.21.15.144:0/98282121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c9006d610 0x7f9c9015eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:22.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.157+0000 7f9c8fe00640 1 --2- 172.21.15.144:0/98282121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c900cf510 0x7f9c9014ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:22.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.157+0000 7f9c95800640 1 -- 172.21.15.144:0/98282121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c9006d610 msgr2=0x7f9c9015eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:22.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.157+0000 7f9c95800640 1 --2- 172.21.15.144:0/98282121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c9006d610 0x7f9c9015eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:22.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.157+0000 7f9c95800640 1 -- 172.21.15.144:0/98282121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c900cf510 msgr2=0x7f9c9014ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:22.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.157+0000 7f9c95800640 1 --2- 172.21.15.144:0/98282121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c900cf510 0x7f9c9014ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:22.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.157+0000 7f9c95800640 1 -- 172.21.15.144:0/98282121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9015f280 con 0x7f9c9015e6c0 2024-09-11T23:26:22.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.158+0000 7f9c95800640 1 --2- 172.21.15.144:0/98282121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c9015e6c0 0x7f9c901617b0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009eb0 tx=0x7f9c88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:22.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.158+0000 7f9c8cc00640 1 -- 172.21.15.144:0/98282121 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8803f070 con 0x7f9c9015e6c0 2024-09-11T23:26:22.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.158+0000 7f9c8cc00640 1 -- 172.21.15.144:0/98282121 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c88031bc0 con 0x7f9c9015e6c0 2024-09-11T23:26:22.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.158+0000 7f9c8cc00640 1 -- 172.21.15.144:0/98282121 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c88009450 con 0x7f9c9015e6c0 2024-09-11T23:26:22.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.158+0000 7f9c96200640 1 -- 172.21.15.144:0/98282121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c9015f560 con 0x7f9c9015e6c0 2024-09-11T23:26:22.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.158+0000 7f9c96200640 1 -- 172.21.15.144:0/98282121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c9015fb20 con 0x7f9c9015e6c0 2024-09-11T23:26:22.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.159+0000 7f9c96200640 1 -- 172.21.15.144:0/98282121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c9006d9f0 con 0x7f9c9015e6c0 2024-09-11T23:26:22.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.160+0000 7f9c8cc00640 1 -- 172.21.15.144:0/98282121 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f9c8803b410 con 0x7f9c9015e6c0 2024-09-11T23:26:22.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.161+0000 7f9c8cc00640 1 --2- 172.21.15.144:0/98282121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9c7006c7c0 0x7f9c7006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:22.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.161+0000 7f9c8cc00640 1 -- 172.21.15.144:0/98282121 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4943+0+0 (secure 0 0 0) 0x7f9c880aabb0 con 0x7f9c9015e6c0 2024-09-11T23:26:22.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.161+0000 7f9c94e00640 1 --2- 172.21.15.144:0/98282121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9c7006c7c0 0x7f9c7006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:22.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.162+0000 7f9c94e00640 1 --2- 172.21.15.144:0/98282121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9c7006c7c0 0x7f9c7006ec80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9c90161660 tx=0x7f9c84009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:22.165 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.165+0000 7f9c8cc00640 1 -- 172.21.15.144:0/98282121 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c8807ab10 con 0x7f9c9015e6c0 2024-09-11T23:26:22.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.336+0000 7f9c96200640 1 -- 172.21.15.144:0/98282121 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9c900d2600 con 0x7f9c9015e6c0 2024-09-11T23:26:22.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.337+0000 7f9c8cc00640 1 -- 172.21.15.144:0/98282121 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v158) ==== 93+0+10 (secure 0 0 0) 0x7f9c8807ee10 con 0x7f9c9015e6c0 2024-09-11T23:26:22.337 INFO:teuthology.orchestra.run.smithi144.stdout:pg_num: 1 2024-09-11T23:26:22.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.339+0000 7f9c96200640 1 -- 172.21.15.144:0/98282121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9c7006c7c0 msgr2=0x7f9c7006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:22.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.339+0000 7f9c96200640 1 --2- 172.21.15.144:0/98282121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9c7006c7c0 0x7f9c7006ec80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9c90161660 tx=0x7f9c84009040 comp rx=0 tx=0).stop 2024-09-11T23:26:22.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.339+0000 7f9c96200640 1 -- 172.21.15.144:0/98282121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c9015e6c0 msgr2=0x7f9c901617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:22.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.339+0000 7f9c96200640 1 --2- 172.21.15.144:0/98282121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c9015e6c0 0x7f9c901617b0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009eb0 tx=0x7f9c88004a40 comp rx=0 tx=0).stop 2024-09-11T23:26:22.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.339+0000 7f9c96200640 1 -- 172.21.15.144:0/98282121 shutdown_connections 2024-09-11T23:26:22.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.339+0000 7f9c96200640 1 --2- 172.21.15.144:0/98282121 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9c7006c7c0 0x7f9c7006ec80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:22.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.339+0000 7f9c96200640 1 --2- 172.21.15.144:0/98282121 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c9015e6c0 0x7f9c901617b0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:22.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.339+0000 7f9c96200640 1 --2- 172.21.15.144:0/98282121 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9c900cf510 0x7f9c9014ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:22.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.339+0000 7f9c96200640 1 --2- 172.21.15.144:0/98282121 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9c9006d610 0x7f9c9015eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:22.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.339+0000 7f9c96200640 1 -- 172.21.15.144:0/98282121 >> 172.21.15.144:0/98282121 conn(0x7f9c900d4720 msgr2=0x7f9c900b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:22.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.339+0000 7f9c96200640 1 -- 172.21.15.144:0/98282121 shutdown_connections 2024-09-11T23:26:22.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.339+0000 7f9c96200640 1 -- 172.21.15.144:0/98282121 wait complete. 2024-09-11T23:26:22.355 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade' 2024-09-11T23:26:22.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.510+0000 7fd66f200640 1 Processor -- start 2024-09-11T23:26:22.510 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.510+0000 7fd66f200640 1 -- start start 2024-09-11T23:26:22.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.512+0000 7fd66f200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd668151c50 0x7fd6680cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:22.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.512+0000 7fd66f200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6680cd5f0 con 0x7fd66806be10 2024-09-11T23:26:22.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.512+0000 7fd66f200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6680cd8d0 con 0x7fd66806c1f0 2024-09-11T23:26:22.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.512+0000 7fd66f200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd6680cdbb0 con 0x7fd668151c50 2024-09-11T23:26:22.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.512+0000 7fd667e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd66806be10 0x7fd668151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48180/0 (socket says 172.21.15.144:48180) 2024-09-11T23:26:22.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.512+0000 7fd667e00640 1 -- 172.21.15.144:0/124445465 learned_addr learned my addr 172.21.15.144:0/124445465 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:22.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.512+0000 7fd667400640 1 -- 172.21.15.144:0/124445465 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3960110135 0 0) 0x7fd6680cd5f0 con 0x7fd66806be10 2024-09-11T23:26:22.514 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.512+0000 7fd65fe00640 1 --2- 172.21.15.144:0/124445465 >> v2:172.21.15.165:3300/0 conn(0x7fd668151c50 0x7fd6680cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:22.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.512+0000 7fd667400640 1 -- 172.21.15.144:0/124445465 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd64c003520 con 0x7fd66806be10 2024-09-11T23:26:22.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.513+0000 7fd667400640 1 -- 172.21.15.144:0/124445465 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1630437692 0 0) 0x7fd64c003520 con 0x7fd66806be10 2024-09-11T23:26:22.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.513+0000 7fd667400640 1 -- 172.21.15.144:0/124445465 >> v2:172.21.15.165:3300/0 conn(0x7fd668151c50 msgr2=0x7fd6680cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:22.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.513+0000 7fd667400640 1 --2- 172.21.15.144:0/124445465 >> v2:172.21.15.165:3300/0 conn(0x7fd668151c50 0x7fd6680cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:22.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.513+0000 7fd667400640 1 -- 172.21.15.144:0/124445465 >> v1:172.21.15.165:6789/0 conn(0x7fd66806c1f0 legacy=0x7fd668164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:22.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.513+0000 7fd667400640 1 -- 172.21.15.144:0/124445465 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6680cde90 con 0x7fd66806be10 2024-09-11T23:26:22.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.513+0000 7fd667400640 1 -- 172.21.15.144:0/124445465 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fd658001670 con 0x7fd66806be10 2024-09-11T23:26:22.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.513+0000 7fd667400640 1 -- 172.21.15.144:0/124445465 >> v1:172.21.15.144:6789/0 conn(0x7fd66806be10 legacy=0x7fd668151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:22.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.513+0000 7fd667400640 1 --2- 172.21.15.144:0/124445465 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd64c003a00 0x7fd64c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:22.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.513+0000 7fd667400640 1 --2- 172.21.15.144:0/124445465 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd64c004800 0x7fd64c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:22.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.513+0000 7fd667400640 1 --2- 172.21.15.144:0/124445465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd64c0051c0 0x7fd64c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:22.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.513+0000 7fd667400640 1 -- 172.21.15.144:0/124445465 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd6680cdbb0 con 0x7fd64c0051c0 2024-09-11T23:26:22.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.513+0000 7fd667400640 1 -- 172.21.15.144:0/124445465 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd64c00e2d0 con 0x7fd64c004800 2024-09-11T23:26:22.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.513+0000 7fd667400640 1 -- 172.21.15.144:0/124445465 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd64c00e4d0 con 0x7fd64c003a00 2024-09-11T23:26:22.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.513+0000 7fd66d200640 1 --2- 172.21.15.144:0/124445465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd64c0051c0 0x7fd64c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:22.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.513+0000 7fd65fe00640 1 --2- 172.21.15.144:0/124445465 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd64c004800 0x7fd64c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:22.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.513+0000 7fd667e00640 1 --2- 172.21.15.144:0/124445465 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd64c003a00 0x7fd64c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:22.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.514+0000 7fd66d200640 1 -- 172.21.15.144:0/124445465 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd64c003a00 msgr2=0x7fd64c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:22.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.514+0000 7fd66d200640 1 --2- 172.21.15.144:0/124445465 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd64c003a00 0x7fd64c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:22.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.514+0000 7fd66d200640 1 -- 172.21.15.144:0/124445465 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd64c004800 msgr2=0x7fd64c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:22.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.514+0000 7fd66d200640 1 --2- 172.21.15.144:0/124445465 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd64c004800 0x7fd64c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:22.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.514+0000 7fd66d200640 1 -- 172.21.15.144:0/124445465 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64c003520 con 0x7fd64c0051c0 2024-09-11T23:26:22.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.514+0000 7fd66d200640 1 -- 172.21.15.144:0/124445465 reap_dead start 2024-09-11T23:26:22.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.515+0000 7fd66d200640 1 --2- 172.21.15.144:0/124445465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd64c0051c0 0x7fd64c00dbd0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fd660001e50 tx=0x7fd64c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883e5a5cca45cb88 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:22.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.515+0000 7fd667400640 1 -- 172.21.15.144:0/124445465 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd660001a70 con 0x7fd64c0051c0 2024-09-11T23:26:22.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.515+0000 7fd667400640 1 -- 172.21.15.144:0/124445465 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd660003970 con 0x7fd64c0051c0 2024-09-11T23:26:22.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.515+0000 7fd667400640 1 -- 172.21.15.144:0/124445465 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd660003d60 con 0x7fd64c0051c0 2024-09-11T23:26:22.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.515+0000 7fd66f200640 1 -- 172.21.15.144:0/124445465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd64c0051c0 msgr2=0x7fd64c00dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:22.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.515+0000 7fd66f200640 1 --2- 172.21.15.144:0/124445465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd64c0051c0 0x7fd64c00dbd0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fd660001e50 tx=0x7fd64c005830 comp rx=0 tx=0).stop 2024-09-11T23:26:22.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.515+0000 7fd66f200640 1 -- 172.21.15.144:0/124445465 shutdown_connections 2024-09-11T23:26:22.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.515+0000 7fd66f200640 1 --2- 172.21.15.144:0/124445465 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd64c0051c0 0x7fd64c00dbd0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:22.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.515+0000 7fd66f200640 1 -- 172.21.15.144:0/124445465 >> 172.21.15.144:0/124445465 conn(0x7fd668062cc0 msgr2=0x7fd66806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:22.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.515+0000 7fd66f200640 1 -- 172.21.15.144:0/124445465 shutdown_connections 2024-09-11T23:26:22.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.515+0000 7fd66f200640 1 -- 172.21.15.144:0/124445465 wait complete. 2024-09-11T23:26:22.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.517+0000 7fd66f200640 1 Processor -- start 2024-09-11T23:26:22.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.517+0000 7fd66f200640 1 -- start start 2024-09-11T23:26:22.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.518+0000 7fd66f200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd64c0051c0 0x7fd6681f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:22.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.518+0000 7fd66f200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd668073510 0x7fd668073990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:22.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.518+0000 7fd66f200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd66815d7e0 0x7fd66815dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:22.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.518+0000 7fd66f200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd6680cd010 con 0x7fd64c0051c0 2024-09-11T23:26:22.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.518+0000 7fd66f200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd6680ce690 con 0x7fd668073510 2024-09-11T23:26:22.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.518+0000 7fd66f200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd6680cd190 con 0x7fd66815d7e0 2024-09-11T23:26:22.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.518+0000 7fd667e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd64c0051c0 0x7fd6681f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:22.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.518+0000 7fd667e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd64c0051c0 0x7fd6681f30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36518/0 (socket says 172.21.15.144:36518) 2024-09-11T23:26:22.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.518+0000 7fd667e00640 1 -- 172.21.15.144:0/1978756744 learned_addr learned my addr 172.21.15.144:0/1978756744 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:22.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.519+0000 7fd65fe00640 1 --2- 172.21.15.144:0/1978756744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd668073510 0x7fd668073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:22.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.519+0000 7fd667e00640 1 -- 172.21.15.144:0/1978756744 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd66815d7e0 msgr2=0x7fd66815dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:22.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.519+0000 7fd667e00640 1 --2- 172.21.15.144:0/1978756744 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd66815d7e0 0x7fd66815dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:22.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.519+0000 7fd667e00640 1 -- 172.21.15.144:0/1978756744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd668073510 msgr2=0x7fd668073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:22.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.519+0000 7fd667e00640 1 --2- 172.21.15.144:0/1978756744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd668073510 0x7fd668073990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:22.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.519+0000 7fd667e00640 1 -- 172.21.15.144:0/1978756744 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd668071950 con 0x7fd64c0051c0 2024-09-11T23:26:22.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.519+0000 7fd65fe00640 1 --2- 172.21.15.144:0/1978756744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd668073510 0x7fd668073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:22.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.519+0000 7fd667e00640 1 --2- 172.21.15.144:0/1978756744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd64c0051c0 0x7fd6681f30d0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fd658000fb0 tx=0x7fd6580074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:22.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.519+0000 7fd664c00640 1 -- 172.21.15.144:0/1978756744 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65800f7b0 con 0x7fd64c0051c0 2024-09-11T23:26:22.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.519+0000 7fd664c00640 1 -- 172.21.15.144:0/1978756744 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd658018070 con 0x7fd64c0051c0 2024-09-11T23:26:22.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.519+0000 7fd664c00640 1 -- 172.21.15.144:0/1978756744 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65800fb70 con 0x7fd64c0051c0 2024-09-11T23:26:22.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.519+0000 7fd66f200640 1 -- 172.21.15.144:0/1978756744 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd668071c30 con 0x7fd64c0051c0 2024-09-11T23:26:22.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.519+0000 7fd66f200640 1 -- 172.21.15.144:0/1978756744 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6680721f0 con 0x7fd64c0051c0 2024-09-11T23:26:22.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.521+0000 7fd66f200640 1 -- 172.21.15.144:0/1978756744 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6680afd90 con 0x7fd64c0051c0 2024-09-11T23:26:22.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.521+0000 7fd664c00640 1 -- 172.21.15.144:0/1978756744 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7fd65800fd10 con 0x7fd64c0051c0 2024-09-11T23:26:22.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.522+0000 7fd664c00640 1 --2- 172.21.15.144:0/1978756744 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd64406c7f0 0x7fd64406ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:22.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.522+0000 7fd664c00640 1 -- 172.21.15.144:0/1978756744 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4943+0+0 (secure 0 0 0) 0x7fd658089570 con 0x7fd64c0051c0 2024-09-11T23:26:22.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.523+0000 7fd65fe00640 1 --2- 172.21.15.144:0/1978756744 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd64406c7f0 0x7fd64406ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:22.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.523+0000 7fd65fe00640 1 --2- 172.21.15.144:0/1978756744 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd64406c7f0 0x7fd64406ecb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd6500093d0 tx=0x7fd650008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:22.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.526+0000 7fd664c00640 1 -- 172.21.15.144:0/1978756744 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd658092080 con 0x7fd64c0051c0 2024-09-11T23:26:22.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:22.766+0000 7fd66f200640 1 -- 172.21.15.144:0/1978756744 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7fd6680b3aa0 con 0x7fd64c0051c0 2024-09-11T23:26:23.614 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.614+0000 7fd664c00640 1 -- 172.21.15.144:0/1978756744 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]}]=0 v467) ==== 166+0+0 (secure 0 0 0) 0x7fd658059b20 con 0x7fd64c0051c0 2024-09-11T23:26:23.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.616+0000 7fd66f200640 1 -- 172.21.15.144:0/1978756744 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd64406c7f0 msgr2=0x7fd64406ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:23.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.616+0000 7fd66f200640 1 --2- 172.21.15.144:0/1978756744 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd64406c7f0 0x7fd64406ecb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd6500093d0 tx=0x7fd650008040 comp rx=0 tx=0).stop 2024-09-11T23:26:23.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.616+0000 7fd66f200640 1 -- 172.21.15.144:0/1978756744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd64c0051c0 msgr2=0x7fd6681f30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:23.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.616+0000 7fd66f200640 1 --2- 172.21.15.144:0/1978756744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd64c0051c0 0x7fd6681f30d0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fd658000fb0 tx=0x7fd6580074f0 comp rx=0 tx=0).stop 2024-09-11T23:26:23.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.617+0000 7fd66f200640 1 -- 172.21.15.144:0/1978756744 shutdown_connections 2024-09-11T23:26:23.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.617+0000 7fd66f200640 1 --2- 172.21.15.144:0/1978756744 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd64406c7f0 0x7fd64406ecb0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:23.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.617+0000 7fd66f200640 1 --2- 172.21.15.144:0/1978756744 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd66815d7e0 0x7fd66815dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:23.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.617+0000 7fd66f200640 1 --2- 172.21.15.144:0/1978756744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd668073510 0x7fd668073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:23.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.617+0000 7fd66f200640 1 --2- 172.21.15.144:0/1978756744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd64c0051c0 0x7fd6681f30d0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:23.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.617+0000 7fd66f200640 1 -- 172.21.15.144:0/1978756744 >> 172.21.15.144:0/1978756744 conn(0x7fd668062cc0 msgr2=0x7fd66815a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:23.617 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.617+0000 7fd66f200640 1 -- 172.21.15.144:0/1978756744 shutdown_connections 2024-09-11T23:26:23.618 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.617+0000 7fd66f200640 1 -- 172.21.15.144:0/1978756744 wait complete. 2024-09-11T23:26:23.635 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:26:23.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.793+0000 7f6e47200640 1 Processor -- start 2024-09-11T23:26:23.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.793+0000 7f6e47200640 1 -- start start 2024-09-11T23:26:23.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.794+0000 7f6e47200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e480cf510 0x7f6e480b7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:23.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.794+0000 7f6e47200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f6e480b7bb0 0x7f6e4806d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:23.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.794+0000 7f6e47200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e4815eaa0 con 0x7f6e4815e6c0 2024-09-11T23:26:23.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.794+0000 7f6e47200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f6e480d34d0 con 0x7f6e480b7bb0 2024-09-11T23:26:23.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.794+0000 7f6e47200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6e480d28c0 con 0x7f6e480cf510 2024-09-11T23:26:23.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.795+0000 7f6e45400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e480cf510 0x7f6e480b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:23.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.795+0000 7f6e45400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e480cf510 0x7f6e480b7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:60804/0 (socket says 172.21.15.144:60804) 2024-09-11T23:26:23.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.795+0000 7f6e45400640 1 -- 172.21.15.144:0/4238106828 learned_addr learned my addr 172.21.15.144:0/4238106828 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:23.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.795+0000 7f6e45e00640 1 --1- 172.21.15.144:0/4238106828 >> v1:172.21.15.165:6789/0 conn(0x7f6e4815e6c0 0x7f6e4806c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:48662/0 (socket says 172.21.15.144:48662) 2024-09-11T23:26:23.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.795+0000 7f6e46800640 1 --2- 172.21.15.144:0/4238106828 >> v2:172.21.15.165:3300/0 conn(0x7f6e480b7bb0 0x7f6e4806d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:23.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.795+0000 7f6e44a00640 1 -- 172.21.15.144:0/4238106828 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1649770453 0 0) 0x7f6e4815eaa0 con 0x7f6e4815e6c0 2024-09-11T23:26:23.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.795+0000 7f6e45400640 1 -- 172.21.15.144:0/4238106828 >> v2:172.21.15.165:3300/0 conn(0x7f6e480b7bb0 msgr2=0x7f6e4806d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:23.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.795+0000 7f6e45400640 1 --2- 172.21.15.144:0/4238106828 >> v2:172.21.15.165:3300/0 conn(0x7f6e480b7bb0 0x7f6e4806d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:23.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.795+0000 7f6e45400640 1 -- 172.21.15.144:0/4238106828 >> v1:172.21.15.165:6789/0 conn(0x7f6e4815e6c0 legacy=0x7f6e4806c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:23.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.795+0000 7f6e45400640 1 -- 172.21.15.144:0/4238106828 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e480d2ba0 con 0x7f6e480cf510 2024-09-11T23:26:23.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.796+0000 7f6e45400640 1 --2- 172.21.15.144:0/4238106828 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e480cf510 0x7f6e480b7670 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009870 tx=0x7f6e3402a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f77737db8a0f47ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:23.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.797+0000 7f6e44a00640 1 -- 172.21.15.144:0/4238106828 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34037070 con 0x7f6e480cf510 2024-09-11T23:26:23.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.797+0000 7f6e44a00640 1 -- 172.21.15.144:0/4238106828 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e3402ae50 con 0x7f6e480cf510 2024-09-11T23:26:23.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.797+0000 7f6e44a00640 1 -- 172.21.15.144:0/4238106828 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34032860 con 0x7f6e480cf510 2024-09-11T23:26:23.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.797+0000 7f6e47200640 1 -- 172.21.15.144:0/4238106828 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e480cf510 msgr2=0x7f6e480b7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:23.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.797+0000 7f6e47200640 1 --2- 172.21.15.144:0/4238106828 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e480cf510 0x7f6e480b7670 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009870 tx=0x7f6e3402a300 comp rx=0 tx=0).stop 2024-09-11T23:26:23.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.797+0000 7f6e47200640 1 -- 172.21.15.144:0/4238106828 shutdown_connections 2024-09-11T23:26:23.797 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.797+0000 7f6e47200640 1 --2- 172.21.15.144:0/4238106828 >> v2:172.21.15.165:3300/0 conn(0x7f6e480b7bb0 0x7f6e4806d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:23.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.797+0000 7f6e47200640 1 --2- 172.21.15.144:0/4238106828 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e480cf510 0x7f6e480b7670 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:23.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.797+0000 7f6e47200640 1 -- 172.21.15.144:0/4238106828 >> 172.21.15.144:0/4238106828 conn(0x7f6e480d4720 msgr2=0x7f6e480d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:23.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.797+0000 7f6e47200640 1 -- 172.21.15.144:0/4238106828 shutdown_connections 2024-09-11T23:26:23.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.797+0000 7f6e47200640 1 -- 172.21.15.144:0/4238106828 wait complete. 2024-09-11T23:26:23.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.799+0000 7f6e47200640 1 Processor -- start 2024-09-11T23:26:23.798 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.799+0000 7f6e47200640 1 -- start start 2024-09-11T23:26:23.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.800+0000 7f6e47200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e480b7bb0 0x7f6e4814f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:23.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.800+0000 7f6e47200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e480cf510 0x7f6e48161680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:23.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.800+0000 7f6e47200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e4815e6c0 0x7f6e480cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:23.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.800+0000 7f6e47200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4806db50 con 0x7f6e480b7bb0 2024-09-11T23:26:23.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.800+0000 7f6e47200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6e480d3160 con 0x7f6e480cf510 2024-09-11T23:26:23.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.800+0000 7f6e47200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6e4806dcd0 con 0x7f6e4815e6c0 2024-09-11T23:26:23.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.800+0000 7f6e45e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e480b7bb0 0x7f6e4814f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:23.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.800+0000 7f6e45e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e480b7bb0 0x7f6e4814f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:36522/0 (socket says 172.21.15.144:36522) 2024-09-11T23:26:23.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.800+0000 7f6e45e00640 1 -- 172.21.15.144:0/4152869251 learned_addr learned my addr 172.21.15.144:0/4152869251 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:23.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.800+0000 7f6e46800640 1 --2- 172.21.15.144:0/4152869251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e4815e6c0 0x7f6e480cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:23.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.800+0000 7f6e45400640 1 --2- 172.21.15.144:0/4152869251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e480cf510 0x7f6e48161680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:23.801 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.800+0000 7f6e45e00640 1 -- 172.21.15.144:0/4152869251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e4815e6c0 msgr2=0x7f6e480cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:23.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.800+0000 7f6e45e00640 1 --2- 172.21.15.144:0/4152869251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e4815e6c0 0x7f6e480cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:23.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.800+0000 7f6e45e00640 1 -- 172.21.15.144:0/4152869251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e480cf510 msgr2=0x7f6e48161680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:23.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.800+0000 7f6e45e00640 1 --2- 172.21.15.144:0/4152869251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e480cf510 0x7f6e48161680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:23.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.800+0000 7f6e45e00640 1 -- 172.21.15.144:0/4152869251 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4815f7e0 con 0x7f6e480b7bb0 2024-09-11T23:26:23.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.800+0000 7f6e46800640 1 --2- 172.21.15.144:0/4152869251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e4815e6c0 0x7f6e480cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:23.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.800+0000 7f6e45400640 1 --2- 172.21.15.144:0/4152869251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e480cf510 0x7f6e48161680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:23.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.801+0000 7f6e45e00640 1 --2- 172.21.15.144:0/4152869251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e480b7bb0 0x7f6e4814f540 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800c3f0 tx=0x7f6e3800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:23.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.801+0000 7f6e3e000640 1 -- 172.21.15.144:0/4152869251 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e380074e0 con 0x7f6e480b7bb0 2024-09-11T23:26:23.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.801+0000 7f6e3e000640 1 -- 172.21.15.144:0/4152869251 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e380047e0 con 0x7f6e480b7bb0 2024-09-11T23:26:23.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.801+0000 7f6e47200640 1 -- 172.21.15.144:0/4152869251 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e4815fa80 con 0x7f6e480b7bb0 2024-09-11T23:26:23.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.801+0000 7f6e3e000640 1 -- 172.21.15.144:0/4152869251 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e38004c10 con 0x7f6e480b7bb0 2024-09-11T23:26:23.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.801+0000 7f6e47200640 1 -- 172.21.15.144:0/4152869251 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e48160040 con 0x7f6e480b7bb0 2024-09-11T23:26:23.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.802+0000 7f6e47200640 1 -- 172.21.15.144:0/4152869251 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e4806d610 con 0x7f6e480b7bb0 2024-09-11T23:26:23.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.803+0000 7f6e3e000640 1 -- 172.21.15.144:0/4152869251 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f6e38011070 con 0x7f6e480b7bb0 2024-09-11T23:26:23.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.804+0000 7f6e3e000640 1 --2- 172.21.15.144:0/4152869251 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6e2806c7c0 0x7f6e2806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:23.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.804+0000 7f6e3e000640 1 -- 172.21.15.144:0/4152869251 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4943+0+0 (secure 0 0 0) 0x7f6e38089200 con 0x7f6e480b7bb0 2024-09-11T23:26:23.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.804+0000 7f6e45400640 1 --2- 172.21.15.144:0/4152869251 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6e2806c7c0 0x7f6e2806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:23.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.805+0000 7f6e45400640 1 --2- 172.21.15.144:0/4152869251 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6e2806c7c0 0x7f6e2806ec80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6e34034000 tx=0x7f6e3402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:23.808 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.808+0000 7f6e3e000640 1 -- 172.21.15.144:0/4152869251 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e3801a2b0 con 0x7f6e480b7bb0 2024-09-11T23:26:23.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.986+0000 7f6e47200640 1 -- 172.21.15.144:0/4152869251 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f6e480d2600 con 0x7f6e480b7bb0 2024-09-11T23:26:23.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.989+0000 7f6e3e000640 1 -- 172.21.15.144:0/4152869251 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7f6e380597b0 con 0x7f6e480b7bb0 2024-09-11T23:26:23.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.991+0000 7f6e47200640 1 -- 172.21.15.144:0/4152869251 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6e2806c7c0 msgr2=0x7f6e2806ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:23.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.991+0000 7f6e47200640 1 --2- 172.21.15.144:0/4152869251 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6e2806c7c0 0x7f6e2806ec80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6e34034000 tx=0x7f6e3402e000 comp rx=0 tx=0).stop 2024-09-11T23:26:23.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.991+0000 7f6e47200640 1 -- 172.21.15.144:0/4152869251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e480b7bb0 msgr2=0x7f6e4814f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:23.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.991+0000 7f6e47200640 1 --2- 172.21.15.144:0/4152869251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e480b7bb0 0x7f6e4814f540 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f6e3800c3f0 tx=0x7f6e3800c8b0 comp rx=0 tx=0).stop 2024-09-11T23:26:23.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.991+0000 7f6e47200640 1 -- 172.21.15.144:0/4152869251 shutdown_connections 2024-09-11T23:26:23.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.991+0000 7f6e47200640 1 --2- 172.21.15.144:0/4152869251 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6e2806c7c0 0x7f6e2806ec80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:23.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.991+0000 7f6e47200640 1 --2- 172.21.15.144:0/4152869251 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6e4815e6c0 0x7f6e480cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:23.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.991+0000 7f6e47200640 1 --2- 172.21.15.144:0/4152869251 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e480cf510 0x7f6e48161680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:23.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.991+0000 7f6e47200640 1 --2- 172.21.15.144:0/4152869251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e480b7bb0 0x7f6e4814f540 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:23.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.991+0000 7f6e47200640 1 -- 172.21.15.144:0/4152869251 >> 172.21.15.144:0/4152869251 conn(0x7f6e480d4720 msgr2=0x7f6e480d4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:23.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.992+0000 7f6e47200640 1 -- 172.21.15.144:0/4152869251 shutdown_connections 2024-09-11T23:26:23.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:23.992+0000 7f6e47200640 1 -- 172.21.15.144:0/4152869251 wait complete. 2024-09-11T23:26:24.007 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:26:24.007 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:26:24.092 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:26:24.188 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:26:24.188 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:26:24.188 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:24.223 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:26:24.224 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:26:24.224 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:24.261 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:26:24.261 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:26:24.261 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:24.299 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:26:24.299 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:26:24.299 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:24.337 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:26:24.337 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-11T23:26:24.337 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:26:24.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.493+0000 7f1042a00640 1 Processor -- start 2024-09-11T23:26:24.493 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.493+0000 7f1042a00640 1 -- start start 2024-09-11T23:26:24.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.494+0000 7f1042a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f103c15c180 0x7f103c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:24.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.494+0000 7f1042a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f103c073120 0x7f103c073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:24.494 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.495+0000 7f1042a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f103c0ce740 con 0x7f103c0ce230 2024-09-11T23:26:24.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.495+0000 7f1042a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f103c072640 con 0x7f103c15c180 2024-09-11T23:26:24.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.495+0000 7f1042a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f103c072920 con 0x7f103c073120 2024-09-11T23:26:24.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.495+0000 7f103be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f103c15c180 0x7f103c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:24.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.495+0000 7f103be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f103c15c180 0x7f103c0cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40300/0 (socket says 172.21.15.144:40300) 2024-09-11T23:26:24.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.495+0000 7f103be00640 1 -- 172.21.15.144:0/2608070345 learned_addr learned my addr 172.21.15.144:0/2608070345 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:24.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.495+0000 7f1040a00640 1 --2- 172.21.15.144:0/2608070345 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f103c073120 0x7f103c073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:24.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.495+0000 7f103be00640 1 -- 172.21.15.144:0/2608070345 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f103c073120 msgr2=0x7f103c073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:24.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.495+0000 7f103be00640 1 --2- 172.21.15.144:0/2608070345 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f103c073120 0x7f103c073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.495+0000 7f103be00640 1 -- 172.21.15.144:0/2608070345 >> v1:172.21.15.144:6789/0 conn(0x7f103c0ce230 legacy=0x7f103c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:24.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.495+0000 7f103be00640 1 -- 172.21.15.144:0/2608070345 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103c072c00 con 0x7f103c15c180 2024-09-11T23:26:24.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.495+0000 7f103aa00640 1 -- 172.21.15.144:0/2608070345 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884870362 0 0) 0x7f103c0ce740 con 0x7f103c0ce230 2024-09-11T23:26:24.496 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.495+0000 7f1040a00640 1 --2- 172.21.15.144:0/2608070345 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f103c073120 0x7f103c073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:24.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.496+0000 7f103be00640 1 --2- 172.21.15.144:0/2608070345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f103c15c180 0x7f103c0cdcf0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f102c009870 tx=0x7f102c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd032bcdc271c92 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:24.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.497+0000 7f103aa00640 1 -- 172.21.15.144:0/2608070345 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c037070 con 0x7f103c15c180 2024-09-11T23:26:24.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.497+0000 7f103aa00640 1 -- 172.21.15.144:0/2608070345 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f102c032440 con 0x7f103c15c180 2024-09-11T23:26:24.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.497+0000 7f103aa00640 1 -- 172.21.15.144:0/2608070345 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c032810 con 0x7f103c15c180 2024-09-11T23:26:24.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.497+0000 7f1042a00640 1 -- 172.21.15.144:0/2608070345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f103c15c180 msgr2=0x7f103c0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:24.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.497+0000 7f1042a00640 1 --2- 172.21.15.144:0/2608070345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f103c15c180 0x7f103c0cdcf0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f102c009870 tx=0x7f102c02a1c0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.497+0000 7f1042a00640 1 -- 172.21.15.144:0/2608070345 shutdown_connections 2024-09-11T23:26:24.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.497+0000 7f1042a00640 1 --2- 172.21.15.144:0/2608070345 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f103c073120 0x7f103c073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.497 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.497+0000 7f1042a00640 1 --2- 172.21.15.144:0/2608070345 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f103c15c180 0x7f103c0cdcf0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.497+0000 7f1042a00640 1 -- 172.21.15.144:0/2608070345 >> 172.21.15.144:0/2608070345 conn(0x7f103c062cc0 msgr2=0x7f103c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:24.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.497+0000 7f1042a00640 1 -- 172.21.15.144:0/2608070345 shutdown_connections 2024-09-11T23:26:24.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.497+0000 7f1042a00640 1 -- 172.21.15.144:0/2608070345 wait complete. 2024-09-11T23:26:24.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.499+0000 7f1042a00640 1 Processor -- start 2024-09-11T23:26:24.498 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.499+0000 7f1042a00640 1 -- start start 2024-09-11T23:26:24.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.500+0000 7f1042a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f103c073120 0x7f103c14c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:24.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.500+0000 7f1042a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f103c0ce230 0x7f103c14fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:24.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.500+0000 7f1042a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f103c15c180 0x7f103c14d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:24.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.500+0000 7f1042a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f103c0cf780 con 0x7f103c073120 2024-09-11T23:26:24.500 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.500+0000 7f1042a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f103c0722f0 con 0x7f103c15c180 2024-09-11T23:26:24.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.500+0000 7f1042a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f103c15c560 con 0x7f103c0ce230 2024-09-11T23:26:24.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.500+0000 7f103be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f103c073120 0x7f103c14c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:24.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.500+0000 7f103be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f103c073120 0x7f103c14c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40302/0 (socket says 172.21.15.144:40302) 2024-09-11T23:26:24.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.500+0000 7f103be00640 1 -- 172.21.15.144:0/3833222335 learned_addr learned my addr 172.21.15.144:0/3833222335 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:24.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.500+0000 7f103b400640 1 --2- 172.21.15.144:0/3833222335 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f103c0ce230 0x7f103c14fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:24.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.500+0000 7f1040a00640 1 --2- 172.21.15.144:0/3833222335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f103c15c180 0x7f103c14d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:24.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.501+0000 7f103be00640 1 -- 172.21.15.144:0/3833222335 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f103c0ce230 msgr2=0x7f103c14fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:24.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.501+0000 7f103be00640 1 --2- 172.21.15.144:0/3833222335 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f103c0ce230 0x7f103c14fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.501+0000 7f103be00640 1 -- 172.21.15.144:0/3833222335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f103c15c180 msgr2=0x7f103c14d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:24.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.501+0000 7f103be00640 1 --2- 172.21.15.144:0/3833222335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f103c15c180 0x7f103c14d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.501 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.501+0000 7f103be00640 1 -- 172.21.15.144:0/3833222335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103c150020 con 0x7f103c073120 2024-09-11T23:26:24.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.501+0000 7f103be00640 1 --2- 172.21.15.144:0/3833222335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f103c073120 0x7f103c14c900 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f102c035040 tx=0x7f102c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:24.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.501+0000 7f1033e00640 1 -- 172.21.15.144:0/3833222335 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c037040 con 0x7f103c073120 2024-09-11T23:26:24.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.501+0000 7f1033e00640 1 -- 172.21.15.144:0/3833222335 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f102c004230 con 0x7f103c073120 2024-09-11T23:26:24.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.501+0000 7f1033e00640 1 -- 172.21.15.144:0/3833222335 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c003610 con 0x7f103c073120 2024-09-11T23:26:24.502 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.501+0000 7f1042a00640 1 -- 172.21.15.144:0/3833222335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f103c0b5370 con 0x7f103c073120 2024-09-11T23:26:24.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.501+0000 7f1042a00640 1 -- 172.21.15.144:0/3833222335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f103c0cb670 con 0x7f103c073120 2024-09-11T23:26:24.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.503+0000 7f1042a00640 1 -- 172.21.15.144:0/3833222335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f103c0cdcf0 con 0x7f103c073120 2024-09-11T23:26:24.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.503+0000 7f1033e00640 1 -- 172.21.15.144:0/3833222335 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f102c02ad10 con 0x7f103c073120 2024-09-11T23:26:24.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.504+0000 7f1033e00640 1 --2- 172.21.15.144:0/3833222335 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f101c06c7c0 0x7f101c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:24.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.504+0000 7f1033e00640 1 -- 172.21.15.144:0/3833222335 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4943+0+0 (secure 0 0 0) 0x7f102c0aa0d0 con 0x7f103c073120 2024-09-11T23:26:24.504 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.505+0000 7f103b400640 1 --2- 172.21.15.144:0/3833222335 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f101c06c7c0 0x7f101c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:24.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.505+0000 7f103b400640 1 --2- 172.21.15.144:0/3833222335 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f101c06c7c0 0x7f101c06ec80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f103c0b1e40 tx=0x7f1028009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:24.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.508+0000 7f1033e00640 1 -- 172.21.15.144:0/3833222335 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f103c150020 con 0x7f103c073120 2024-09-11T23:26:24.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.718+0000 7f1042a00640 1 -- 172.21.15.144:0/3833222335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f103c15fbb0 con 0x7f103c073120 2024-09-11T23:26:24.718 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.718+0000 7f1033e00640 1 -- 172.21.15.144:0/3833222335 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+3928 (secure 0 0 0) 0x7f102c07a150 con 0x7f103c073120 2024-09-11T23:26:24.718 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:24.718 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":112,"btime":"2024-09-11T23:26:18:589017+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/2302333712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":2302333712},{"type":"v1","addr":"172.21.15.144:6801","nonce":2302333712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104},{"gid":7097,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/3051519109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3051519109},{"type":"v1","addr":"172.21.15.165:6834","nonce":3051519109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2403316225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":2403316225},{"type":"v1","addr":"172.21.15.165:6835","nonce":2403316225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8934,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1201832255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1201832255},{"type":"v1","addr":"172.21.15.144:6835","nonce":1201832255}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":112}],"filesystems":[]} 2024-09-11T23:26:24.719 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 112 2024-09-11T23:26:24.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.720+0000 7f1042a00640 1 -- 172.21.15.144:0/3833222335 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f101c06c7c0 msgr2=0x7f101c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:24.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.720+0000 7f1042a00640 1 --2- 172.21.15.144:0/3833222335 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f101c06c7c0 0x7f101c06ec80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f103c0b1e40 tx=0x7f1028009040 comp rx=0 tx=0).stop 2024-09-11T23:26:24.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.720+0000 7f1042a00640 1 -- 172.21.15.144:0/3833222335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f103c073120 msgr2=0x7f103c14c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:24.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.720+0000 7f1042a00640 1 --2- 172.21.15.144:0/3833222335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f103c073120 0x7f103c14c900 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f102c035040 tx=0x7f102c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.720+0000 7f1042a00640 1 -- 172.21.15.144:0/3833222335 shutdown_connections 2024-09-11T23:26:24.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.720+0000 7f1042a00640 1 --2- 172.21.15.144:0/3833222335 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f101c06c7c0 0x7f101c06ec80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.720+0000 7f1042a00640 1 --2- 172.21.15.144:0/3833222335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f103c15c180 0x7f103c14d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.720+0000 7f1042a00640 1 --2- 172.21.15.144:0/3833222335 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f103c0ce230 0x7f103c14fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.720+0000 7f1042a00640 1 --2- 172.21.15.144:0/3833222335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f103c073120 0x7f103c14c900 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.720+0000 7f1042a00640 1 -- 172.21.15.144:0/3833222335 >> 172.21.15.144:0/3833222335 conn(0x7f103c062cc0 msgr2=0x7f103c06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:24.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.721+0000 7f1042a00640 1 -- 172.21.15.144:0/3833222335 shutdown_connections 2024-09-11T23:26:24.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.721+0000 7f1042a00640 1 -- 172.21.15.144:0/3833222335 wait complete. 2024-09-11T23:26:24.736 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T23:26:24.736 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-11T23:26:24.736 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:26:24.737 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:26:24.737 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T23:26:24.737 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-11T23:26:24.737 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:26:24.737 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:26:24.737 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T23:26:24.737 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-11T23:26:24.738 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:26:24.738 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:26:24.738 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T23:26:24.738 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-11T23:26:24.738 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:26:24.738 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:26:24.753 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:26:24.753 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T23:26:24.754 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:26:24.754 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T23:26:24.755 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:26:24.755 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T23:26:24.756 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:26:24.756 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T23:26:24.797 INFO:tasks.ceph.mds.b:Started 2024-09-11T23:26:24.798 DEBUG:teuthology.parallel:result is None 2024-09-11T23:26:24.799 INFO:tasks.ceph.mds.a:Started 2024-09-11T23:26:24.800 DEBUG:teuthology.parallel:result is None 2024-09-11T23:26:24.800 INFO:tasks.ceph.mds.d:Started 2024-09-11T23:26:24.800 DEBUG:teuthology.parallel:result is None 2024-09-11T23:26:24.802 INFO:tasks.ceph.mds.c:Started 2024-09-11T23:26:24.802 DEBUG:teuthology.parallel:result is None 2024-09-11T23:26:24.802 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-11T23:26:24.928 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-11T23:26:24.929 INFO:tasks.ceph.mds.d.smithi165.stdout:starting mds.d at 2024-09-11T23:26:24.932 INFO:tasks.ceph.mds.c.smithi144.stdout:starting mds.c at 2024-09-11T23:26:24.932 INFO:tasks.ceph.mds.a.smithi144.stdout:starting mds.a at 2024-09-11T23:26:24.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.966+0000 7f1b9c200640 1 Processor -- start 2024-09-11T23:26:24.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.966+0000 7f1b9c200640 1 -- start start 2024-09-11T23:26:24.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.967+0000 7f1b9c200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b9415e860 0x7f1b940cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:24.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.967+0000 7f1b9c200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b940b61f0 0x7f1b940b6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:24.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.967+0000 7f1b9c200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b940b6b50 con 0x7f1b9406c070 2024-09-11T23:26:24.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.967+0000 7f1b9c200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1b940d34d0 con 0x7f1b9415e860 2024-09-11T23:26:24.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.967+0000 7f1b9c200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1b940d3790 con 0x7f1b940b61f0 2024-09-11T23:26:24.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.967+0000 7f1b99800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b9415e860 0x7f1b940cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:24.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.967+0000 7f1b99800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1b9415e860 0x7f1b940cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40344/0 (socket says 172.21.15.144:40344) 2024-09-11T23:26:24.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.967+0000 7f1b99800640 1 -- 172.21.15.144:0/3425752433 learned_addr learned my addr 172.21.15.144:0/3425752433 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:24.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.968+0000 7f1b98e00640 1 --2- 172.21.15.144:0/3425752433 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b940b61f0 0x7f1b940b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:24.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.968+0000 7f1b99800640 1 -- 172.21.15.144:0/3425752433 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b940b61f0 msgr2=0x7f1b940b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:24.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.968+0000 7f1b99800640 1 --2- 172.21.15.144:0/3425752433 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b940b61f0 0x7f1b940b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.968+0000 7f1b99800640 1 -- 172.21.15.144:0/3425752433 >> v1:172.21.15.165:6789/0 conn(0x7f1b9406c070 legacy=0x7f1b9406c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:24.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.968+0000 7f1b99800640 1 -- 172.21.15.144:0/3425752433 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b940d3a70 con 0x7f1b9415e860 2024-09-11T23:26:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.969+0000 7f1b99800640 1 --2- 172.21.15.144:0/3425752433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b9415e860 0x7f1b940cf720 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f1b88009870 tx=0x7f1b8802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec166595b478a204 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.969+0000 7f1b93e00640 1 -- 172.21.15.144:0/3425752433 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88037070 con 0x7f1b9415e860 2024-09-11T23:26:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.969+0000 7f1b93e00640 1 -- 172.21.15.144:0/3425752433 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b88032440 con 0x7f1b9415e860 2024-09-11T23:26:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.969+0000 7f1b93e00640 1 -- 172.21.15.144:0/3425752433 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88032810 con 0x7f1b9415e860 2024-09-11T23:26:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.970+0000 7f1b9c200640 1 -- 172.21.15.144:0/3425752433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b9415e860 msgr2=0x7f1b940cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.970+0000 7f1b9c200640 1 --2- 172.21.15.144:0/3425752433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b9415e860 0x7f1b940cf720 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f1b88009870 tx=0x7f1b8802a2a0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.970+0000 7f1b9c200640 1 -- 172.21.15.144:0/3425752433 shutdown_connections 2024-09-11T23:26:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.970+0000 7f1b9c200640 1 --2- 172.21.15.144:0/3425752433 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b940b61f0 0x7f1b940b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.970+0000 7f1b9c200640 1 --2- 172.21.15.144:0/3425752433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b9415e860 0x7f1b940cf720 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.970+0000 7f1b9c200640 1 -- 172.21.15.144:0/3425752433 >> 172.21.15.144:0/3425752433 conn(0x7f1b94062c60 msgr2=0x7f1b940d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.970+0000 7f1b9c200640 1 -- 172.21.15.144:0/3425752433 shutdown_connections 2024-09-11T23:26:24.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.970+0000 7f1b9c200640 1 -- 172.21.15.144:0/3425752433 wait complete. 2024-09-11T23:26:24.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.971+0000 7f1b9c200640 1 Processor -- start 2024-09-11T23:26:24.971 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.972+0000 7f1b9c200640 1 -- start start 2024-09-11T23:26:24.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.972+0000 7f1b9c200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b9406c070 0x7f1b941f1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:24.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.972+0000 7f1b9c200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b940b61f0 0x7f1b94157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:24.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.973+0000 7f1b9c200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b9415e860 0x7f1b94157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:24.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.973+0000 7f1b9c200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1b940d4310 con 0x7f1b9406c070 2024-09-11T23:26:24.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.973+0000 7f1b9c200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1b940d4030 con 0x7f1b940b61f0 2024-09-11T23:26:24.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.973+0000 7f1b9c200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1b9415ec40 con 0x7f1b9415e860 2024-09-11T23:26:24.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.973+0000 7f1b99800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b9406c070 0x7f1b941f1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:24.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.973+0000 7f1b99800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b9406c070 0x7f1b941f1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40346/0 (socket says 172.21.15.144:40346) 2024-09-11T23:26:24.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.973+0000 7f1b99800640 1 -- 172.21.15.144:0/1257835807 learned_addr learned my addr 172.21.15.144:0/1257835807 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:24.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.973+0000 7f1b98e00640 1 --2- 172.21.15.144:0/1257835807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b940b61f0 0x7f1b94157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:24.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.973+0000 7f1b9a200640 1 --2- 172.21.15.144:0/1257835807 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b9415e860 0x7f1b94157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:24.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.973+0000 7f1b99800640 1 -- 172.21.15.144:0/1257835807 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b9415e860 msgr2=0x7f1b94157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:24.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.973+0000 7f1b99800640 1 --2- 172.21.15.144:0/1257835807 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b9415e860 0x7f1b94157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.973+0000 7f1b99800640 1 -- 172.21.15.144:0/1257835807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b940b61f0 msgr2=0x7f1b94157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:24.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.973+0000 7f1b99800640 1 --2- 172.21.15.144:0/1257835807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b940b61f0 0x7f1b94157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:24.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.973+0000 7f1b99800640 1 -- 172.21.15.144:0/1257835807 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b94158ee0 con 0x7f1b9406c070 2024-09-11T23:26:24.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.973+0000 7f1b99800640 1 --2- 172.21.15.144:0/1257835807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b9406c070 0x7f1b941f1b90 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f1b88009870 tx=0x7f1b880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:24.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.974+0000 7f1b91600640 1 -- 172.21.15.144:0/1257835807 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88041020 con 0x7f1b9406c070 2024-09-11T23:26:24.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.974+0000 7f1b91600640 1 -- 172.21.15.144:0/1257835807 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b880306c0 con 0x7f1b9406c070 2024-09-11T23:26:24.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.974+0000 7f1b91600640 1 -- 172.21.15.144:0/1257835807 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88037040 con 0x7f1b9406c070 2024-09-11T23:26:24.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.974+0000 7f1b9c200640 1 -- 172.21.15.144:0/1257835807 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b94158360 con 0x7f1b9406c070 2024-09-11T23:26:24.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.974+0000 7f1b9c200640 1 -- 172.21.15.144:0/1257835807 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b94158920 con 0x7f1b9406c070 2024-09-11T23:26:24.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.975+0000 7f1b9c200640 1 -- 172.21.15.144:0/1257835807 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b940b3ad0 con 0x7f1b9406c070 2024-09-11T23:26:24.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.976+0000 7f1b91600640 1 -- 172.21.15.144:0/1257835807 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f1b88044020 con 0x7f1b9406c070 2024-09-11T23:26:24.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.977+0000 7f1b91600640 1 --2- 172.21.15.144:0/1257835807 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1b7406c810 0x7f1b7406ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:24.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.977+0000 7f1b91600640 1 -- 172.21.15.144:0/1257835807 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4943+0+0 (secure 0 0 0) 0x7f1b880a99e0 con 0x7f1b9406c070 2024-09-11T23:26:24.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.977+0000 7f1b98e00640 1 --2- 172.21.15.144:0/1257835807 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1b7406c810 0x7f1b7406ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:24.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.978+0000 7f1b98e00640 1 --2- 172.21.15.144:0/1257835807 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1b7406c810 0x7f1b7406ecd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1b940ba3d0 tx=0x7f1b80008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:24.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:24.981+0000 7f1b91600640 1 -- 172.21.15.144:0/1257835807 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1b8804b070 con 0x7f1b9406c070 2024-09-11T23:26:25.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.166+0000 7f1b9c200640 1 -- 172.21.15.144:0/1257835807 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f1b940ba400 con 0x7f1b9406c070 2024-09-11T23:26:25.626 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.626+0000 7f1b91600640 1 -- 172.21.15.144:0/1257835807 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v160) ==== 97+0+0 (secure 0 0 0) 0x7f1b88079f90 con 0x7f1b9406c070 2024-09-11T23:26:25.626 INFO:teuthology.orchestra.run.smithi144.stderr: removed all blocklist entries 2024-09-11T23:26:25.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.629+0000 7f1b9c200640 1 -- 172.21.15.144:0/1257835807 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1b7406c810 msgr2=0x7f1b7406ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:25.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.629+0000 7f1b9c200640 1 --2- 172.21.15.144:0/1257835807 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1b7406c810 0x7f1b7406ecd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1b940ba3d0 tx=0x7f1b80008040 comp rx=0 tx=0).stop 2024-09-11T23:26:25.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.629+0000 7f1b9c200640 1 -- 172.21.15.144:0/1257835807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b9406c070 msgr2=0x7f1b941f1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:25.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.629+0000 7f1b9c200640 1 --2- 172.21.15.144:0/1257835807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b9406c070 0x7f1b941f1b90 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f1b88009870 tx=0x7f1b880046c0 comp rx=0 tx=0).stop 2024-09-11T23:26:25.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.629+0000 7f1b9c200640 1 -- 172.21.15.144:0/1257835807 shutdown_connections 2024-09-11T23:26:25.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.629+0000 7f1b9c200640 1 --2- 172.21.15.144:0/1257835807 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1b7406c810 0x7f1b7406ecd0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:25.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.629+0000 7f1b9c200640 1 --2- 172.21.15.144:0/1257835807 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1b9415e860 0x7f1b94157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:25.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.629+0000 7f1b9c200640 1 --2- 172.21.15.144:0/1257835807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1b940b61f0 0x7f1b94157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:25.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.629+0000 7f1b9c200640 1 --2- 172.21.15.144:0/1257835807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1b9406c070 0x7f1b941f1b90 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:25.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.629+0000 7f1b9c200640 1 -- 172.21.15.144:0/1257835807 >> 172.21.15.144:0/1257835807 conn(0x7f1b94062c60 msgr2=0x7f1b940b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:25.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.630+0000 7f1b9c200640 1 -- 172.21.15.144:0/1257835807 shutdown_connections 2024-09-11T23:26:25.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.630+0000 7f1b9c200640 1 -- 172.21.15.144:0/1257835807 wait complete. 2024-09-11T23:26:25.647 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-11T23:26:25.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.802+0000 7f4c89200640 1 Processor -- start 2024-09-11T23:26:25.802 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.802+0000 7f4c89200640 1 -- start start 2024-09-11T23:26:25.803 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.803+0000 7f4c89200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4c8415ca40 0x7f4c8415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:25.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.803+0000 7f4c89200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c8415d390 con 0x7f4c840d02a0 2024-09-11T23:26:25.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.803+0000 7f4c89200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c8415d670 con 0x7f4c8415ceb0 2024-09-11T23:26:25.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.803+0000 7f4c89200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f4c8415d950 con 0x7f4c8415ca40 2024-09-11T23:26:25.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.804+0000 7f4c81400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4c8415ca40 0x7f4c8415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:25.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.804+0000 7f4c81400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4c8415ca40 0x7f4c8415e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40356/0 (socket says 172.21.15.144:40356) 2024-09-11T23:26:25.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.804+0000 7f4c81400640 1 -- 172.21.15.144:0/267936093 learned_addr learned my addr 172.21.15.144:0/267936093 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:25.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.804+0000 7f4c81400640 1 -- 172.21.15.144:0/267936093 >> v1:172.21.15.165:6789/0 conn(0x7f4c8415ceb0 legacy=0x7f4c841594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:25.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.804+0000 7f4c81400640 1 -- 172.21.15.144:0/267936093 >> v1:172.21.15.144:6789/0 conn(0x7f4c840d02a0 legacy=0x7f4c840d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:25.804 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.804+0000 7f4c81400640 1 -- 172.21.15.144:0/267936093 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c8415dc30 con 0x7f4c8415ca40 2024-09-11T23:26:25.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.805+0000 7f4c81400640 1 --2- 172.21.15.144:0/267936093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c8415ca40 0x7f4c8415e430 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009870 tx=0x7f4c7002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ac6df1481ac8b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:25.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.805+0000 7f4c80a00640 1 -- 172.21.15.144:0/267936093 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70037070 con 0x7f4c8415ca40 2024-09-11T23:26:25.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.805+0000 7f4c80a00640 1 -- 172.21.15.144:0/267936093 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c70032440 con 0x7f4c8415ca40 2024-09-11T23:26:25.805 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.805+0000 7f4c80a00640 1 -- 172.21.15.144:0/267936093 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70032810 con 0x7f4c8415ca40 2024-09-11T23:26:25.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.806+0000 7f4c89200640 1 -- 172.21.15.144:0/267936093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c8415ca40 msgr2=0x7f4c8415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:25.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.806+0000 7f4c89200640 1 --2- 172.21.15.144:0/267936093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c8415ca40 0x7f4c8415e430 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009870 tx=0x7f4c7002a210 comp rx=0 tx=0).stop 2024-09-11T23:26:25.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.806+0000 7f4c89200640 1 -- 172.21.15.144:0/267936093 shutdown_connections 2024-09-11T23:26:25.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.806+0000 7f4c89200640 1 --2- 172.21.15.144:0/267936093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c8415ca40 0x7f4c8415e430 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:25.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.806+0000 7f4c89200640 1 -- 172.21.15.144:0/267936093 >> 172.21.15.144:0/267936093 conn(0x7f4c84062cc0 msgr2=0x7f4c8406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:25.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.806+0000 7f4c89200640 1 -- 172.21.15.144:0/267936093 shutdown_connections 2024-09-11T23:26:25.806 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.806+0000 7f4c89200640 1 -- 172.21.15.144:0/267936093 wait complete. 2024-09-11T23:26:25.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.808+0000 7f4c89200640 1 Processor -- start 2024-09-11T23:26:25.807 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.808+0000 7f4c89200640 1 -- start start 2024-09-11T23:26:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.809+0000 7f4c89200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c840d02a0 0x7f4c84147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.809+0000 7f4c89200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c8415ca40 0x7f4c840cd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.809+0000 7f4c89200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c8415ceb0 0x7f4c840cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.809+0000 7f4c89200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4c84155d10 con 0x7f4c8415ca40 2024-09-11T23:26:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.809+0000 7f4c89200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4c84155b90 con 0x7f4c8415ceb0 2024-09-11T23:26:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.809+0000 7f4c89200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4c840b4790 con 0x7f4c840d02a0 2024-09-11T23:26:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.809+0000 7f4c81400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c8415ca40 0x7f4c840cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:25.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.809+0000 7f4c81400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c8415ca40 0x7f4c840cd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40362/0 (socket says 172.21.15.144:40362) 2024-09-11T23:26:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.809+0000 7f4c81400640 1 -- 172.21.15.144:0/741550707 learned_addr learned my addr 172.21.15.144:0/741550707 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.809+0000 7f4c81e00640 1 --2- 172.21.15.144:0/741550707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c840d02a0 0x7f4c84147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.809+0000 7f4c82800640 1 --2- 172.21.15.144:0/741550707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c8415ceb0 0x7f4c840cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.809+0000 7f4c81400640 1 -- 172.21.15.144:0/741550707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c840d02a0 msgr2=0x7f4c84147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.809+0000 7f4c81400640 1 --2- 172.21.15.144:0/741550707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c840d02a0 0x7f4c84147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.809+0000 7f4c81400640 1 -- 172.21.15.144:0/741550707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c8415ceb0 msgr2=0x7f4c840cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.809+0000 7f4c81400640 1 --2- 172.21.15.144:0/741550707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c8415ceb0 0x7f4c840cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.809+0000 7f4c81400640 1 -- 172.21.15.144:0/741550707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c841596b0 con 0x7f4c8415ca40 2024-09-11T23:26:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.810+0000 7f4c81400640 1 --2- 172.21.15.144:0/741550707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c8415ca40 0x7f4c840cd980 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009870 tx=0x7f4c700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.810+0000 7f4c7a000640 1 -- 172.21.15.144:0/741550707 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70041070 con 0x7f4c8415ca40 2024-09-11T23:26:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.810+0000 7f4c7a000640 1 -- 172.21.15.144:0/741550707 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7003c870 con 0x7f4c8415ca40 2024-09-11T23:26:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.810+0000 7f4c7a000640 1 -- 172.21.15.144:0/741550707 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70037040 con 0x7f4c8415ca40 2024-09-11T23:26:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.810+0000 7f4c89200640 1 -- 172.21.15.144:0/741550707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c84159990 con 0x7f4c8415ca40 2024-09-11T23:26:25.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.810+0000 7f4c89200640 1 -- 172.21.15.144:0/741550707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c84159f50 con 0x7f4c8415ca40 2024-09-11T23:26:25.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.811+0000 7f4c89200640 1 -- 172.21.15.144:0/741550707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c840d0680 con 0x7f4c8415ca40 2024-09-11T23:26:25.812 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.812+0000 7f4c7a000640 1 -- 172.21.15.144:0/741550707 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f4c70044070 con 0x7f4c8415ca40 2024-09-11T23:26:25.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.813+0000 7f4c7a000640 1 --2- 172.21.15.144:0/741550707 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c6406c7c0 0x7f4c6406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:25.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.813+0000 7f4c7a000640 1 -- 172.21.15.144:0/741550707 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 4857+0+0 (secure 0 0 0) 0x7f4c700aa100 con 0x7f4c8415ca40 2024-09-11T23:26:25.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.814+0000 7f4c81e00640 1 --2- 172.21.15.144:0/741550707 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c6406c7c0 0x7f4c6406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:25.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.814+0000 7f4c81e00640 1 --2- 172.21.15.144:0/741550707 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c6406c7c0 0x7f4c6406ec80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4c74001780 tx=0x7f4c74009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:25.817 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:25.817+0000 7f4c7a000640 1 -- 172.21.15.144:0/741550707 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c7007a060 con 0x7f4c8415ca40 2024-09-11T23:26:26.055 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.056+0000 7f4c89200640 1 -- 172.21.15.144:0/741550707 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f4c840d0a30 con 0x7f4c8415ca40 2024-09-11T23:26:26.056 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.056+0000 7f4c7a000640 1 -- 172.21.15.144:0/741550707 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) ==== 80+0+5304 (secure 0 0 0) 0x7f4c7007e360 con 0x7f4c8415ca40 2024-09-11T23:26:26.056 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:26.056 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:26:26.056 INFO:teuthology.orchestra.run.smithi144.stdout: "auth_dump": [ 2024-09-11T23:26:26.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.a", 2024-09-11T23:26:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmQjymBhAA4BWEVNGY37RsnMGLL3Ow8A==", 2024-09-11T23:26:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:26:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:26:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:26:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:26:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:26:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:26:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.b", 2024-09-11T23:26:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmD0mIGhAAvug7T/kOcEmnyMyG++V+zA==", 2024-09-11T23:26:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:26:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:26:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:26:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:26:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:26:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:26:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.c", 2024-09-11T23:26:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmDwSZEBAAdf4eF3MrADSPzBTICzpOiA==", 2024-09-11T23:26:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:26:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:26:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:26:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:26:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:26:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:26:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mds.d", 2024-09-11T23:26:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmqYtRJBAAgpzvHNUPVnxNoflhqVIJuQ==", 2024-09-11T23:26:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:26:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:26:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:26:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:26:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:26:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:26:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.0", 2024-09-11T23:26:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDiJOJmzDABABAA+Qa772+Mm69pecG0QUXlyA==", 2024-09-11T23:26:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:26:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:26:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:26:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:26:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:26:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.1", 2024-09-11T23:26:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDlJOJmgVjJKRAAtl30JxJHurKdrn1vLUneww==", 2024-09-11T23:26:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:26:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:26:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:26:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:26:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:26:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.2", 2024-09-11T23:26:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDpJOJmRzO6FxAAiLDOwDlXYTj6WfEhlI+uVQ==", 2024-09-11T23:26:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:26:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:26:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:26:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:26:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:26:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.3", 2024-09-11T23:26:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDtJOJmVFh6EhAA7hcJn4k31nEPMcqiB7+djA==", 2024-09-11T23:26:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:26:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:26:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:26:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:26:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:26:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.4", 2024-09-11T23:26:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD0JOJmpIFTAhAAYQyoBrMjL6CcDDCNAOMGwQ==", 2024-09-11T23:26:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:26:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:26:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:26:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:26:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:26:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.5", 2024-09-11T23:26:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD4JOJmBAIIDhAA8G/usUslfQPNpFP1YZsgmg==", 2024-09-11T23:26:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:26:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:26:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:26:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:26:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:26:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.6", 2024-09-11T23:26:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQD8JOJmDl2dCBAA5bL+2AIp0uWL4qjpI/mAdQ==", 2024-09-11T23:26:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:26:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:26:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:26:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:26:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:26:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "osd.7", 2024-09-11T23:26:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQAAJeJmMWX+AhAA7ABVgJPwhRZNkPNdZzmnOQ==", 2024-09-11T23:26:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:26:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow profile osd", 2024-09-11T23:26:26.065 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile osd", 2024-09-11T23:26:26.065 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:26:26.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:26:26.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:26.065 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.0", 2024-09-11T23:26:26.066 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A==", 2024-09-11T23:26:26.066 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:26:26.066 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:26:26.066 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow r", 2024-09-11T23:26:26.066 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-11T23:26:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:26:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.1", 2024-09-11T23:26:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJmLFrBORAAT64lj0sWlVoTHVUZQf0JjA==", 2024-09-11T23:26:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:26:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:26:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:26:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:26:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:26:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:26:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.2", 2024-09-11T23:26:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDeJOJm2/dLMxAAbuKdVAbscrlF5jcBnouBOQ==", 2024-09-11T23:26:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:26:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:26:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:26:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:26:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:26:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:26:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.3", 2024-09-11T23:26:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDfJOJmse6UBBAAq+3afsp+2jApe9sTFmVVOw==", 2024-09-11T23:26:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:26:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow", 2024-09-11T23:26:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow r", 2024-09-11T23:26:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow rw", 2024-09-11T23:26:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow rwx" 2024-09-11T23:26:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:26:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "client.admin", 2024-09-11T23:26:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmHmAwEhAAEGCvu0NgtyjIPcJBk6bkdA==", 2024-09-11T23:26:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:26:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:26:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: "mgr": "allow *", 2024-09-11T23:26:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow *", 2024-09-11T23:26:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:26:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:26:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.x", 2024-09-11T23:26:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmxMaVOxAA62zJwlyk0qdrsemalijH4Q==", 2024-09-11T23:26:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:26:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:26:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:26:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:26:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-11T23:26:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: "entity": "mgr.y", 2024-09-11T23:26:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: "key": "AQDdJOJmWZRNNBAAwZ2GCP7mGn87ZSnsKCcDRQ==", 2024-09-11T23:26:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": { 2024-09-11T23:26:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": "allow *", 2024-09-11T23:26:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: "mon": "allow profile mgr", 2024-09-11T23:26:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: "osd": "allow *" 2024-09-11T23:26:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-11T23:26:26.071 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:26:26.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.059+0000 7f4c89200640 1 -- 172.21.15.144:0/741550707 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c6406c7c0 msgr2=0x7f4c6406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:26.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.059+0000 7f4c89200640 1 --2- 172.21.15.144:0/741550707 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c6406c7c0 0x7f4c6406ec80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4c74001780 tx=0x7f4c74009040 comp rx=0 tx=0).stop 2024-09-11T23:26:26.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.059+0000 7f4c89200640 1 -- 172.21.15.144:0/741550707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c8415ca40 msgr2=0x7f4c840cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:26.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.059+0000 7f4c89200640 1 --2- 172.21.15.144:0/741550707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c8415ca40 0x7f4c840cd980 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009870 tx=0x7f4c700046c0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.059+0000 7f4c89200640 1 -- 172.21.15.144:0/741550707 shutdown_connections 2024-09-11T23:26:26.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.059+0000 7f4c89200640 1 --2- 172.21.15.144:0/741550707 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c6406c7c0 0x7f4c6406ec80 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.059+0000 7f4c89200640 1 --2- 172.21.15.144:0/741550707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c8415ceb0 0x7f4c840cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.059+0000 7f4c89200640 1 --2- 172.21.15.144:0/741550707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c8415ca40 0x7f4c840cd980 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.059+0000 7f4c89200640 1 --2- 172.21.15.144:0/741550707 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4c840d02a0 0x7f4c84147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.059+0000 7f4c89200640 1 -- 172.21.15.144:0/741550707 >> 172.21.15.144:0/741550707 conn(0x7f4c84062cc0 msgr2=0x7f4c840ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:26.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.059+0000 7f4c89200640 1 -- 172.21.15.144:0/741550707 shutdown_connections 2024-09-11T23:26:26.073 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.059+0000 7f4c89200640 1 -- 172.21.15.144:0/741550707 wait complete. 2024-09-11T23:26:26.075 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T23:26:26.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.229+0000 7f822b200640 1 Processor -- start 2024-09-11T23:26:26.228 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.229+0000 7f822b200640 1 -- start start 2024-09-11T23:26:26.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.230+0000 7f822b200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f822c0b1e60 0x7f822c0b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:26.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.230+0000 7f822b200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f822c160700 0x7f822c073060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:26.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.230+0000 7f822b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c0735a0 0x7f822c0b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:26.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.230+0000 7f822b200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f822c074100 con 0x7f822c160700 2024-09-11T23:26:26.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.230+0000 7f822b200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f822c160270 con 0x7f822c0b1e60 2024-09-11T23:26:26.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.230+0000 7f822b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f822c0b2780 con 0x7f822c0735a0 2024-09-11T23:26:26.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.230+0000 7f8229400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f822c160700 0x7f822c073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:26.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.230+0000 7f8229400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f822c160700 0x7f822c073060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40364/0 (socket says 172.21.15.144:40364) 2024-09-11T23:26:26.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.230+0000 7f8229400640 1 -- 172.21.15.144:0/1319974158 learned_addr learned my addr 172.21.15.144:0/1319974158 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:26.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.230+0000 7f822a800640 1 --2- 172.21.15.144:0/1319974158 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c0735a0 0x7f822c0b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:26.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.231+0000 7f8229e00640 1 --2- 172.21.15.144:0/1319974158 >> v2:172.21.15.165:3300/0 conn(0x7f822c0b1e60 0x7f822c0b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:26.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.231+0000 7f8229400640 1 -- 172.21.15.144:0/1319974158 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c0735a0 msgr2=0x7f822c0b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:26.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.231+0000 7f8229400640 1 --2- 172.21.15.144:0/1319974158 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c0735a0 0x7f822c0b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.231+0000 7f8229400640 1 -- 172.21.15.144:0/1319974158 >> v2:172.21.15.165:3300/0 conn(0x7f822c0b1e60 msgr2=0x7f822c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:26.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.231+0000 7f8229400640 1 --2- 172.21.15.144:0/1319974158 >> v2:172.21.15.165:3300/0 conn(0x7f822c0b1e60 0x7f822c0b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.231+0000 7f8229400640 1 -- 172.21.15.144:0/1319974158 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822c073b40 con 0x7f822c160700 2024-09-11T23:26:26.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.232+0000 7f8229400640 1 --2- 172.21.15.144:0/1319974158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c160700 0x7f822c073060 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f822c06ee40 tx=0x7f821802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d685d5827f10df7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:26.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.232+0000 7f8228a00640 1 -- 172.21.15.144:0/1319974158 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218037070 con 0x7f822c160700 2024-09-11T23:26:26.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.232+0000 7f8228a00640 1 -- 172.21.15.144:0/1319974158 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8218032440 con 0x7f822c160700 2024-09-11T23:26:26.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.232+0000 7f8228a00640 1 -- 172.21.15.144:0/1319974158 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218032810 con 0x7f822c160700 2024-09-11T23:26:26.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.233+0000 7f822b200640 1 -- 172.21.15.144:0/1319974158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c160700 msgr2=0x7f822c073060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:26.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.233+0000 7f822b200640 1 --2- 172.21.15.144:0/1319974158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c160700 0x7f822c073060 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f822c06ee40 tx=0x7f821802a1e0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.233+0000 7f822b200640 1 -- 172.21.15.144:0/1319974158 shutdown_connections 2024-09-11T23:26:26.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.233+0000 7f822b200640 1 --2- 172.21.15.144:0/1319974158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c160700 0x7f822c073060 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.233+0000 7f822b200640 1 --2- 172.21.15.144:0/1319974158 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c0735a0 0x7f822c0b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.233+0000 7f822b200640 1 --2- 172.21.15.144:0/1319974158 >> v2:172.21.15.165:3300/0 conn(0x7f822c0b1e60 0x7f822c0b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.233+0000 7f822b200640 1 -- 172.21.15.144:0/1319974158 >> 172.21.15.144:0/1319974158 conn(0x7f822c062a50 msgr2=0x7f822c06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:26.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.233+0000 7f822b200640 1 -- 172.21.15.144:0/1319974158 shutdown_connections 2024-09-11T23:26:26.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.233+0000 7f822b200640 1 -- 172.21.15.144:0/1319974158 wait complete. 2024-09-11T23:26:26.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.234+0000 7f822b200640 1 Processor -- start 2024-09-11T23:26:26.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.234+0000 7f822b200640 1 -- start start 2024-09-11T23:26:26.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.235+0000 7f822b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c0735a0 0x7f822c144fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:26.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.235+0000 7f822b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f822c0b1e60 0x7f822c143710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:26.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.235+0000 7f822b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c160700 0x7f822c139a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:26.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.235+0000 7f822b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f822c160b40 con 0x7f822c160700 2024-09-11T23:26:26.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.235+0000 7f822b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f822c15ff00 con 0x7f822c0b1e60 2024-09-11T23:26:26.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.235+0000 7f822b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f822c160cc0 con 0x7f822c0735a0 2024-09-11T23:26:26.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.236+0000 7f822a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c160700 0x7f822c139a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:26.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.236+0000 7f822a800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c160700 0x7f822c139a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40366/0 (socket says 172.21.15.144:40366) 2024-09-11T23:26:26.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.236+0000 7f822a800640 1 -- 172.21.15.144:0/834629133 learned_addr learned my addr 172.21.15.144:0/834629133 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:26.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.236+0000 7f8229e00640 1 --2- 172.21.15.144:0/834629133 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c0735a0 0x7f822c144fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:26.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.236+0000 7f8229400640 1 --2- 172.21.15.144:0/834629133 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f822c0b1e60 0x7f822c143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:26.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.236+0000 7f822a800640 1 -- 172.21.15.144:0/834629133 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c0735a0 msgr2=0x7f822c144fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:26.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.236+0000 7f822a800640 1 --2- 172.21.15.144:0/834629133 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c0735a0 0x7f822c144fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.236+0000 7f822a800640 1 -- 172.21.15.144:0/834629133 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f822c0b1e60 msgr2=0x7f822c143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:26.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.236+0000 7f822a800640 1 --2- 172.21.15.144:0/834629133 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f822c0b1e60 0x7f822c143710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.236+0000 7f822a800640 1 -- 172.21.15.144:0/834629133 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822c139f50 con 0x7f822c160700 2024-09-11T23:26:26.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.236+0000 7f822a800640 1 --2- 172.21.15.144:0/834629133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c160700 0x7f822c139a10 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f822400d5b0 tx=0x7f822400da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:26.237 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.237+0000 7f8222000640 1 -- 172.21.15.144:0/834629133 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224018020 con 0x7f822c160700 2024-09-11T23:26:26.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.237+0000 7f8222000640 1 -- 172.21.15.144:0/834629133 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8224014620 con 0x7f822c160700 2024-09-11T23:26:26.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.237+0000 7f8222000640 1 -- 172.21.15.144:0/834629133 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82240149f0 con 0x7f822c160700 2024-09-11T23:26:26.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.237+0000 7f822b200640 1 -- 172.21.15.144:0/834629133 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f822c1455f0 con 0x7f822c160700 2024-09-11T23:26:26.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.237+0000 7f822b200640 1 -- 172.21.15.144:0/834629133 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f822c13da50 con 0x7f822c160700 2024-09-11T23:26:26.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.238+0000 7f822b200640 1 -- 172.21.15.144:0/834629133 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f822c145df0 con 0x7f822c160700 2024-09-11T23:26:26.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.239+0000 7f8222000640 1 -- 172.21.15.144:0/834629133 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f822401b020 con 0x7f822c160700 2024-09-11T23:26:26.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.240+0000 7f8222000640 1 --2- 172.21.15.144:0/834629133 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f820c06c7c0 0x7f820c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:26.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.240+0000 7f8222000640 1 -- 172.21.15.144:0/834629133 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 4857+0+0 (secure 0 0 0) 0x7f8224089610 con 0x7f822c160700 2024-09-11T23:26:26.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.240+0000 7f8229e00640 1 --2- 172.21.15.144:0/834629133 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f820c06c7c0 0x7f820c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:26.240 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.241+0000 7f8229e00640 1 --2- 172.21.15.144:0/834629133 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f820c06c7c0 0x7f820c06ec80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f821c003b80 tx=0x7f821c0098d0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:26.243 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.244+0000 7f8222000640 1 -- 172.21.15.144:0/834629133 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8224022030 con 0x7f822c160700 2024-09-11T23:26:26.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.417+0000 7f822b200640 1 -- 172.21.15.144:0/834629133 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f822c141800 con 0x7f822c160700 2024-09-11T23:26:26.417 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.417+0000 7f8222000640 1 -- 172.21.15.144:0/834629133 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v162) ==== 84+0+65 (secure 0 0 0) 0x7f822c139f50 con 0x7f822c160700 2024-09-11T23:26:26.417 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:26.417 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:26:26.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:26.418 INFO:teuthology.orchestra.run.smithi144.stdout: "poolnum": 1, 2024-09-11T23:26:26.418 INFO:teuthology.orchestra.run.smithi144.stdout: "poolname": ".mgr" 2024-09-11T23:26:26.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:26.418 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:26:26.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.419+0000 7f822b200640 1 -- 172.21.15.144:0/834629133 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f820c06c7c0 msgr2=0x7f820c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:26.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.419+0000 7f822b200640 1 --2- 172.21.15.144:0/834629133 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f820c06c7c0 0x7f820c06ec80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f821c003b80 tx=0x7f821c0098d0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.419+0000 7f822b200640 1 -- 172.21.15.144:0/834629133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c160700 msgr2=0x7f822c139a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:26.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.419+0000 7f822b200640 1 --2- 172.21.15.144:0/834629133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c160700 0x7f822c139a10 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f822400d5b0 tx=0x7f822400da70 comp rx=0 tx=0).stop 2024-09-11T23:26:26.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.420+0000 7f822b200640 1 -- 172.21.15.144:0/834629133 shutdown_connections 2024-09-11T23:26:26.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.420+0000 7f822b200640 1 --2- 172.21.15.144:0/834629133 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f820c06c7c0 0x7f820c06ec80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.420+0000 7f822b200640 1 --2- 172.21.15.144:0/834629133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f822c160700 0x7f822c139a10 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.420+0000 7f822b200640 1 --2- 172.21.15.144:0/834629133 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f822c0b1e60 0x7f822c143710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.420+0000 7f822b200640 1 --2- 172.21.15.144:0/834629133 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f822c0735a0 0x7f822c144fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.420+0000 7f822b200640 1 -- 172.21.15.144:0/834629133 >> 172.21.15.144:0/834629133 conn(0x7f822c062a50 msgr2=0x7f822c0ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:26.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.420+0000 7f822b200640 1 -- 172.21.15.144:0/834629133 shutdown_connections 2024-09-11T23:26:26.420 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.420+0000 7f822b200640 1 -- 172.21.15.144:0/834629133 wait complete. 2024-09-11T23:26:26.437 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T23:26:26.437 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T23:26:26.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.594+0000 7fbe3d200640 1 Processor -- start 2024-09-11T23:26:26.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.594+0000 7fbe3d200640 1 -- start start 2024-09-11T23:26:26.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.595+0000 7fbe3d200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe3815b1d0 0x7fbe380b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:26.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.595+0000 7fbe3d200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe380ce090 0x7fbe380ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:26.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.595+0000 7fbe3d200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fbe3815ed60 0x7fbe3815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:26.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.595+0000 7fbe3d200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fbe380b21b0 con 0x7fbe3815b1d0 2024-09-11T23:26:26.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.595+0000 7fbe3d200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fbe380cea10 con 0x7fbe3815ed60 2024-09-11T23:26:26.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.595+0000 7fbe3d200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbe3815b5b0 con 0x7fbe380ce090 2024-09-11T23:26:26.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.595+0000 7fbe37400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe3815b1d0 0x7fbe380b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:26.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.595+0000 7fbe37400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe3815b1d0 0x7fbe380b3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40374/0 (socket says 172.21.15.144:40374) 2024-09-11T23:26:26.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.595+0000 7fbe37400640 1 -- 172.21.15.144:0/1466134543 learned_addr learned my addr 172.21.15.144:0/1466134543 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:26.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.596+0000 7fbe2ea00640 1 --2- 172.21.15.144:0/1466134543 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe380ce090 0x7fbe380ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:26.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.596+0000 7fbe37e00640 1 --2- 172.21.15.144:0/1466134543 >> v2:172.21.15.165:3300/0 conn(0x7fbe3815ed60 0x7fbe3815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:26.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.596+0000 7fbe37400640 1 -- 172.21.15.144:0/1466134543 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe380ce090 msgr2=0x7fbe380ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:26.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.596+0000 7fbe37400640 1 --2- 172.21.15.144:0/1466134543 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe380ce090 0x7fbe380ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.596+0000 7fbe37400640 1 -- 172.21.15.144:0/1466134543 >> v2:172.21.15.165:3300/0 conn(0x7fbe3815ed60 msgr2=0x7fbe3815f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:26.596 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.596+0000 7fbe37400640 1 --2- 172.21.15.144:0/1466134543 >> v2:172.21.15.165:3300/0 conn(0x7fbe3815ed60 0x7fbe3815f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.596+0000 7fbe37400640 1 -- 172.21.15.144:0/1466134543 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe380b4800 con 0x7fbe3815b1d0 2024-09-11T23:26:26.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.596+0000 7fbe37e00640 1 --2- 172.21.15.144:0/1466134543 >> v2:172.21.15.165:3300/0 conn(0x7fbe3815ed60 0x7fbe3815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:26.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.596+0000 7fbe2ea00640 1 --2- 172.21.15.144:0/1466134543 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe380ce090 0x7fbe380ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:26.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.597+0000 7fbe37400640 1 --2- 172.21.15.144:0/1466134543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe3815b1d0 0x7fbe380b3be0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fbe380cffd0 tx=0x7fbe2802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f36c5a7ed1f594 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:26.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.597+0000 7fbe36a00640 1 -- 172.21.15.144:0/1466134543 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe28037070 con 0x7fbe3815b1d0 2024-09-11T23:26:26.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.597+0000 7fbe36a00640 1 -- 172.21.15.144:0/1466134543 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe28032440 con 0x7fbe3815b1d0 2024-09-11T23:26:26.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.597+0000 7fbe36a00640 1 -- 172.21.15.144:0/1466134543 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe28032810 con 0x7fbe3815b1d0 2024-09-11T23:26:26.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.598+0000 7fbe3d200640 1 -- 172.21.15.144:0/1466134543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe3815b1d0 msgr2=0x7fbe380b3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:26.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.598+0000 7fbe3d200640 1 --2- 172.21.15.144:0/1466134543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe3815b1d0 0x7fbe380b3be0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fbe380cffd0 tx=0x7fbe2802a140 comp rx=0 tx=0).stop 2024-09-11T23:26:26.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.598+0000 7fbe3d200640 1 -- 172.21.15.144:0/1466134543 shutdown_connections 2024-09-11T23:26:26.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.598+0000 7fbe3d200640 1 --2- 172.21.15.144:0/1466134543 >> v2:172.21.15.165:3300/0 conn(0x7fbe3815ed60 0x7fbe3815f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.598+0000 7fbe3d200640 1 --2- 172.21.15.144:0/1466134543 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe380ce090 0x7fbe380ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.598+0000 7fbe3d200640 1 --2- 172.21.15.144:0/1466134543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe3815b1d0 0x7fbe380b3be0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.598+0000 7fbe3d200640 1 -- 172.21.15.144:0/1466134543 >> 172.21.15.144:0/1466134543 conn(0x7fbe3806bba0 msgr2=0x7fbe3806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:26.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.598+0000 7fbe3d200640 1 -- 172.21.15.144:0/1466134543 shutdown_connections 2024-09-11T23:26:26.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.598+0000 7fbe3d200640 1 -- 172.21.15.144:0/1466134543 wait complete. 2024-09-11T23:26:26.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.599+0000 7fbe3d200640 1 Processor -- start 2024-09-11T23:26:26.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.599+0000 7fbe3d200640 1 -- start start 2024-09-11T23:26:26.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.600+0000 7fbe3d200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe380ce090 0x7fbe38157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:26.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.600+0000 7fbe3d200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe3815b1d0 0x7fbe38150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:26.601 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.600+0000 7fbe3d200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe3815ed60 0x7fbe3814c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:26.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.600+0000 7fbe3d200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbe380b50a0 con 0x7fbe380ce090 2024-09-11T23:26:26.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.600+0000 7fbe3d200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbe380b4dc0 con 0x7fbe3815b1d0 2024-09-11T23:26:26.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.600+0000 7fbe3d200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fbe380b5380 con 0x7fbe3815ed60 2024-09-11T23:26:26.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.601+0000 7fbe37400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe380ce090 0x7fbe38157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:26.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.601+0000 7fbe37400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe380ce090 0x7fbe38157ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40382/0 (socket says 172.21.15.144:40382) 2024-09-11T23:26:26.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.601+0000 7fbe37400640 1 -- 172.21.15.144:0/2552777335 learned_addr learned my addr 172.21.15.144:0/2552777335 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:26.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.601+0000 7fbe37e00640 1 --2- 172.21.15.144:0/2552777335 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe3815ed60 0x7fbe3814c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:26.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.601+0000 7fbe2ea00640 1 --2- 172.21.15.144:0/2552777335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe3815b1d0 0x7fbe38150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:26.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.601+0000 7fbe37400640 1 -- 172.21.15.144:0/2552777335 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe3815ed60 msgr2=0x7fbe3814c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:26.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.601+0000 7fbe37400640 1 --2- 172.21.15.144:0/2552777335 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe3815ed60 0x7fbe3814c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.601+0000 7fbe37400640 1 -- 172.21.15.144:0/2552777335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe3815b1d0 msgr2=0x7fbe38150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:26.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.601+0000 7fbe37400640 1 --2- 172.21.15.144:0/2552777335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe3815b1d0 0x7fbe38150030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:26.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.601+0000 7fbe37400640 1 -- 172.21.15.144:0/2552777335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe38157730 con 0x7fbe380ce090 2024-09-11T23:26:26.602 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.601+0000 7fbe37e00640 1 --2- 172.21.15.144:0/2552777335 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe3815ed60 0x7fbe3814c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:26.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.601+0000 7fbe37400640 1 --2- 172.21.15.144:0/2552777335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe380ce090 0x7fbe38157ed0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fbe2802a180 tx=0x7fbe280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:26.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.601+0000 7fbe2fe00640 1 -- 172.21.15.144:0/2552777335 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe28037040 con 0x7fbe380ce090 2024-09-11T23:26:26.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.601+0000 7fbe2fe00640 1 -- 172.21.15.144:0/2552777335 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe28042070 con 0x7fbe380ce090 2024-09-11T23:26:26.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.601+0000 7fbe3d200640 1 -- 172.21.15.144:0/2552777335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe38157a10 con 0x7fbe380ce090 2024-09-11T23:26:26.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.601+0000 7fbe2fe00640 1 -- 172.21.15.144:0/2552777335 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe28030bb0 con 0x7fbe380ce090 2024-09-11T23:26:26.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.602+0000 7fbe3d200640 1 -- 172.21.15.144:0/2552777335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe38150690 con 0x7fbe380ce090 2024-09-11T23:26:26.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.603+0000 7fbe3d200640 1 -- 172.21.15.144:0/2552777335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe380b4440 con 0x7fbe380ce090 2024-09-11T23:26:26.603 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.603+0000 7fbe2fe00640 1 -- 172.21.15.144:0/2552777335 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7fbe28047460 con 0x7fbe380ce090 2024-09-11T23:26:26.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.605+0000 7fbe2fe00640 1 --2- 172.21.15.144:0/2552777335 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe1406c7c0 0x7fbe1406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:26.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.605+0000 7fbe2fe00640 1 -- 172.21.15.144:0/2552777335 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 4857+0+0 (secure 0 0 0) 0x7fbe280aa210 con 0x7fbe380ce090 2024-09-11T23:26:26.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.605+0000 7fbe2ea00640 1 --2- 172.21.15.144:0/2552777335 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe1406c7c0 0x7fbe1406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:26.605 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.606+0000 7fbe2ea00640 1 --2- 172.21.15.144:0/2552777335 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe1406c7c0 0x7fbe1406ec80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbe381f5300 tx=0x7fbe20008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:26.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.609+0000 7fbe2fe00640 1 -- 172.21.15.144:0/2552777335 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe28045360 con 0x7fbe380ce090 2024-09-11T23:26:26.787 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:26.787+0000 7fbe3d200640 1 -- 172.21.15.144:0/2552777335 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbe3806c120 con 0x7fbe380ce090 2024-09-11T23:26:27.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.634+0000 7fbe2fe00640 1 -- 172.21.15.144:0/2552777335 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v163) ==== 138+0+0 (secure 0 0 0) 0x7fbe2807a7c0 con 0x7fbe380ce090 2024-09-11T23:26:27.634 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' created 2024-09-11T23:26:27.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.638+0000 7fbe3d200640 1 -- 172.21.15.144:0/2552777335 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe1406c7c0 msgr2=0x7fbe1406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:27.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.638+0000 7fbe3d200640 1 --2- 172.21.15.144:0/2552777335 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe1406c7c0 0x7fbe1406ec80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbe381f5300 tx=0x7fbe20008040 comp rx=0 tx=0).stop 2024-09-11T23:26:27.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.638+0000 7fbe3d200640 1 -- 172.21.15.144:0/2552777335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe380ce090 msgr2=0x7fbe38157ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:27.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.638+0000 7fbe3d200640 1 --2- 172.21.15.144:0/2552777335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe380ce090 0x7fbe38157ed0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fbe2802a180 tx=0x7fbe280046c0 comp rx=0 tx=0).stop 2024-09-11T23:26:27.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.638+0000 7fbe3d200640 1 -- 172.21.15.144:0/2552777335 shutdown_connections 2024-09-11T23:26:27.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.638+0000 7fbe3d200640 1 --2- 172.21.15.144:0/2552777335 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fbe1406c7c0 0x7fbe1406ec80 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:27.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.638+0000 7fbe3d200640 1 --2- 172.21.15.144:0/2552777335 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fbe3815ed60 0x7fbe3814c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:27.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.638+0000 7fbe3d200640 1 --2- 172.21.15.144:0/2552777335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe3815b1d0 0x7fbe38150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:27.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.638+0000 7fbe3d200640 1 --2- 172.21.15.144:0/2552777335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe380ce090 0x7fbe38157ed0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:27.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.638+0000 7fbe3d200640 1 -- 172.21.15.144:0/2552777335 >> 172.21.15.144:0/2552777335 conn(0x7fbe3806bba0 msgr2=0x7fbe3815f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:27.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.638+0000 7fbe3d200640 1 -- 172.21.15.144:0/2552777335 shutdown_connections 2024-09-11T23:26:27.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.638+0000 7fbe3d200640 1 -- 172.21.15.144:0/2552777335 wait complete. 2024-09-11T23:26:27.659 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T23:26:27.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.822+0000 7f692b200640 1 Processor -- start 2024-09-11T23:26:27.822 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.822+0000 7f692b200640 1 -- start start 2024-09-11T23:26:27.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.823+0000 7f692b200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f692415b370 0x7f6924072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:27.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.824+0000 7f692b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f692415f9f0 0x7f692406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:27.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.824+0000 7f692b200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f692406ef60 0x7f6924071040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:27.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.824+0000 7f692b200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f692415fef0 con 0x7f692406ef60 2024-09-11T23:26:27.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.824+0000 7f692b200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f692415c970 con 0x7f692415b370 2024-09-11T23:26:27.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.824+0000 7f692b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f692415bbb0 con 0x7f692415f9f0 2024-09-11T23:26:27.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.824+0000 7f6929200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f692406ef60 0x7f6924071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:27.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.824+0000 7f6929200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f692406ef60 0x7f6924071040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40386/0 (socket says 172.21.15.144:40386) 2024-09-11T23:26:27.824 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.824+0000 7f6929200640 1 -- 172.21.15.144:0/1102418870 learned_addr learned my addr 172.21.15.144:0/1102418870 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.824+0000 7f6923e00640 1 --2- 172.21.15.144:0/1102418870 >> v2:172.21.15.165:3300/0 conn(0x7f692415b370 0x7f6924072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.824+0000 7f691b400640 1 --2- 172.21.15.144:0/1102418870 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f692415f9f0 0x7f692406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.824+0000 7f6929200640 1 -- 172.21.15.144:0/1102418870 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f692415f9f0 msgr2=0x7f692406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.824+0000 7f6929200640 1 --2- 172.21.15.144:0/1102418870 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f692415f9f0 0x7f692406ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.824+0000 7f6929200640 1 -- 172.21.15.144:0/1102418870 >> v2:172.21.15.165:3300/0 conn(0x7f692415b370 msgr2=0x7f6924072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.824+0000 7f6929200640 1 --2- 172.21.15.144:0/1102418870 >> v2:172.21.15.165:3300/0 conn(0x7f692415b370 0x7f6924072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.824+0000 7f6929200640 1 -- 172.21.15.144:0/1102418870 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692415be90 con 0x7f692406ef60 2024-09-11T23:26:27.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.825+0000 7f6929200640 1 --2- 172.21.15.144:0/1102418870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f692406ef60 0x7f6924071040 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f69240696e0 tx=0x7f691c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b89819073221c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:27.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.826+0000 7f6923400640 1 -- 172.21.15.144:0/1102418870 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691c036070 con 0x7f692406ef60 2024-09-11T23:26:27.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.826+0000 7f6923400640 1 -- 172.21.15.144:0/1102418870 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f691c031600 con 0x7f692406ef60 2024-09-11T23:26:27.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.826+0000 7f6923400640 1 -- 172.21.15.144:0/1102418870 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691c0319d0 con 0x7f692406ef60 2024-09-11T23:26:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.826+0000 7f692b200640 1 -- 172.21.15.144:0/1102418870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f692406ef60 msgr2=0x7f6924071040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.826+0000 7f692b200640 1 --2- 172.21.15.144:0/1102418870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f692406ef60 0x7f6924071040 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f69240696e0 tx=0x7f691c02a610 comp rx=0 tx=0).stop 2024-09-11T23:26:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.826+0000 7f692b200640 1 -- 172.21.15.144:0/1102418870 shutdown_connections 2024-09-11T23:26:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.826+0000 7f692b200640 1 --2- 172.21.15.144:0/1102418870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f692406ef60 0x7f6924071040 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.826+0000 7f692b200640 1 --2- 172.21.15.144:0/1102418870 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f692415f9f0 0x7f692406ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.826+0000 7f692b200640 1 --2- 172.21.15.144:0/1102418870 >> v2:172.21.15.165:3300/0 conn(0x7f692415b370 0x7f6924072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.826+0000 7f692b200640 1 -- 172.21.15.144:0/1102418870 >> 172.21.15.144:0/1102418870 conn(0x7f692406bba0 msgr2=0x7f692406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.826+0000 7f692b200640 1 -- 172.21.15.144:0/1102418870 shutdown_connections 2024-09-11T23:26:27.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.826+0000 7f692b200640 1 -- 172.21.15.144:0/1102418870 wait complete. 2024-09-11T23:26:27.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.828+0000 7f692b200640 1 Processor -- start 2024-09-11T23:26:27.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.828+0000 7f692b200640 1 -- start start 2024-09-11T23:26:27.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.829+0000 7f692b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f692406ef60 0x7f692415a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:27.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.829+0000 7f692b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f692415b370 0x7f69241eb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:27.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.829+0000 7f692b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f692415f9f0 0x7f69240b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:27.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.829+0000 7f692b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f69240731b0 con 0x7f692415f9f0 2024-09-11T23:26:27.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.829+0000 7f692b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f692415c450 con 0x7f692406ef60 2024-09-11T23:26:27.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.829+0000 7f692b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f692415b750 con 0x7f692415b370 2024-09-11T23:26:27.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.829+0000 7f6929200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f692415f9f0 0x7f69240b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:27.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.829+0000 7f6923e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f692406ef60 0x7f692415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:27.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.829+0000 7f6929200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f692415f9f0 0x7f69240b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40390/0 (socket says 172.21.15.144:40390) 2024-09-11T23:26:27.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.829+0000 7f6923e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f692406ef60 0x7f692415a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:39902/0 (socket says 172.21.15.144:39902) 2024-09-11T23:26:27.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.829+0000 7f6929200640 1 -- 172.21.15.144:0/2038013106 learned_addr learned my addr 172.21.15.144:0/2038013106 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:27.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.829+0000 7f691b400640 1 --2- 172.21.15.144:0/2038013106 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f692415b370 0x7f69241eb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:27.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.830+0000 7f6929200640 1 -- 172.21.15.144:0/2038013106 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f692415b370 msgr2=0x7f69241eb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:27.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.830+0000 7f6929200640 1 --2- 172.21.15.144:0/2038013106 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f692415b370 0x7f69241eb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:27.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.830+0000 7f6929200640 1 -- 172.21.15.144:0/2038013106 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f692406ef60 msgr2=0x7f692415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:27.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.830+0000 7f6929200640 1 --2- 172.21.15.144:0/2038013106 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f692406ef60 0x7f692415a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:27.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.830+0000 7f6929200640 1 -- 172.21.15.144:0/2038013106 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6924157c40 con 0x7f692415f9f0 2024-09-11T23:26:27.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.830+0000 7f6929200640 1 --2- 172.21.15.144:0/2038013106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f692415f9f0 0x7f69240b3570 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f691c009f40 tx=0x7f691c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:27.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.830+0000 7f6920c00640 1 -- 172.21.15.144:0/2038013106 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691c036050 con 0x7f692415f9f0 2024-09-11T23:26:27.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.830+0000 7f6920c00640 1 -- 172.21.15.144:0/2038013106 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f691c042070 con 0x7f692415f9f0 2024-09-11T23:26:27.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.830+0000 7f6920c00640 1 -- 172.21.15.144:0/2038013106 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691c009510 con 0x7f692415f9f0 2024-09-11T23:26:27.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.830+0000 7f692b200640 1 -- 172.21.15.144:0/2038013106 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6924157f20 con 0x7f692415f9f0 2024-09-11T23:26:27.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.831+0000 7f692b200640 1 -- 172.21.15.144:0/2038013106 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69241584e0 con 0x7f692415f9f0 2024-09-11T23:26:27.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.832+0000 7f692b200640 1 -- 172.21.15.144:0/2038013106 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f692406ea20 con 0x7f692415f9f0 2024-09-11T23:26:27.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.833+0000 7f6920c00640 1 -- 172.21.15.144:0/2038013106 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f691c007bf0 con 0x7f692415f9f0 2024-09-11T23:26:27.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.834+0000 7f6920c00640 1 --2- 172.21.15.144:0/2038013106 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f690006c7c0 0x7f690006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:27.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.834+0000 7f6920c00640 1 -- 172.21.15.144:0/2038013106 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5227+0+0 (secure 0 0 0) 0x7f691c0aa240 con 0x7f692415f9f0 2024-09-11T23:26:27.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.834+0000 7f6923e00640 1 --2- 172.21.15.144:0/2038013106 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f690006c7c0 0x7f690006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:27.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.835+0000 7f6923e00640 1 --2- 172.21.15.144:0/2038013106 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f690006c7c0 0x7f690006ec80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6914006fd0 tx=0x7f6914008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:27.838 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:27.838+0000 7f6920c00640 1 -- 172.21.15.144:0/2038013106 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f691c07a1a0 con 0x7f692415f9f0 2024-09-11T23:26:28.013 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.013+0000 7f692b200640 1 -- 172.21.15.144:0/2038013106 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f692406e5d0 con 0x7f692415f9f0 2024-09-11T23:26:28.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.637+0000 7f6920c00640 1 -- 172.21.15.144:0/2038013106 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v164) ==== 170+0+0 (secure 0 0 0) 0x7f691c07e4a0 con 0x7f692415f9f0 2024-09-11T23:26:28.637 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' created 2024-09-11T23:26:28.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.640+0000 7f692b200640 1 -- 172.21.15.144:0/2038013106 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f690006c7c0 msgr2=0x7f690006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:28.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.640+0000 7f692b200640 1 --2- 172.21.15.144:0/2038013106 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f690006c7c0 0x7f690006ec80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6914006fd0 tx=0x7f6914008040 comp rx=0 tx=0).stop 2024-09-11T23:26:28.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.640+0000 7f692b200640 1 -- 172.21.15.144:0/2038013106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f692415f9f0 msgr2=0x7f69240b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:28.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.640+0000 7f692b200640 1 --2- 172.21.15.144:0/2038013106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f692415f9f0 0x7f69240b3570 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f691c009f40 tx=0x7f691c004a40 comp rx=0 tx=0).stop 2024-09-11T23:26:28.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.641+0000 7f692b200640 1 -- 172.21.15.144:0/2038013106 shutdown_connections 2024-09-11T23:26:28.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.641+0000 7f692b200640 1 --2- 172.21.15.144:0/2038013106 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f690006c7c0 0x7f690006ec80 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:28.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.641+0000 7f692b200640 1 --2- 172.21.15.144:0/2038013106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f692415f9f0 0x7f69240b3570 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:28.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.641+0000 7f692b200640 1 --2- 172.21.15.144:0/2038013106 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f692415b370 0x7f69241eb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:28.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.641+0000 7f692b200640 1 --2- 172.21.15.144:0/2038013106 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f692406ef60 0x7f692415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:28.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.641+0000 7f692b200640 1 -- 172.21.15.144:0/2038013106 >> 172.21.15.144:0/2038013106 conn(0x7f692406bba0 msgr2=0x7f69240cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:28.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.641+0000 7f692b200640 1 -- 172.21.15.144:0/2038013106 shutdown_connections 2024-09-11T23:26:28.641 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.641+0000 7f692b200640 1 -- 172.21.15.144:0/2038013106 wait complete. 2024-09-11T23:26:28.669 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T23:26:28.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.827+0000 7f1c84c00640 1 Processor -- start 2024-09-11T23:26:28.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.828+0000 7f1c84c00640 1 -- start start 2024-09-11T23:26:28.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.829+0000 7f1c84c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1c8015d3b0 0x7f1c80071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:28.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.829+0000 7f1c84c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1c800cf320 0x7f1c800cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:28.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.829+0000 7f1c84c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c800715c0 con 0x7f1c8015d790 2024-09-11T23:26:28.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.829+0000 7f1c84c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f1c8006da30 con 0x7f1c800cf320 2024-09-11T23:26:28.829 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.829+0000 7f1c84c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1c8006d700 con 0x7f1c8015d3b0 2024-09-11T23:26:28.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.829+0000 7f1c7e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1c800cf320 0x7f1c800cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:28.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.829+0000 7f1c7e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f1c800cf320 0x7f1c800cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40406/0 (socket says 172.21.15.144:40406) 2024-09-11T23:26:28.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.829+0000 7f1c7e800640 1 -- 172.21.15.144:0/2990810568 learned_addr learned my addr 172.21.15.144:0/2990810568 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:28.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.829+0000 7f1c7de00640 1 --2- 172.21.15.144:0/2990810568 >> v2:172.21.15.165:3300/0 conn(0x7f1c8015d3b0 0x7f1c80071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:28.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.830+0000 7f1c7e800640 1 -- 172.21.15.144:0/2990810568 >> v2:172.21.15.165:3300/0 conn(0x7f1c8015d3b0 msgr2=0x7f1c80071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:28.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.830+0000 7f1c7e800640 1 --2- 172.21.15.144:0/2990810568 >> v2:172.21.15.165:3300/0 conn(0x7f1c8015d3b0 0x7f1c80071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:28.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.830+0000 7f1c7e800640 1 -- 172.21.15.144:0/2990810568 >> v1:172.21.15.144:6789/0 conn(0x7f1c8015d790 legacy=0x7f1c800cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:28.830 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.830+0000 7f1c7e800640 1 -- 172.21.15.144:0/2990810568 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c800cde80 con 0x7f1c800cf320 2024-09-11T23:26:28.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.831+0000 7f1c7e800640 1 --2- 172.21.15.144:0/2990810568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c800cf320 0x7f1c800cf790 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f1c800b5850 tx=0x7f1c7802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db08dc5bd95637c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:28.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.831+0000 7f1c7d400640 1 -- 172.21.15.144:0/2990810568 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c78036070 con 0x7f1c800cf320 2024-09-11T23:26:28.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.831+0000 7f1c7d400640 1 -- 172.21.15.144:0/2990810568 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c78031600 con 0x7f1c800cf320 2024-09-11T23:26:28.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.831+0000 7f1c7d400640 1 -- 172.21.15.144:0/2990810568 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c780319d0 con 0x7f1c800cf320 2024-09-11T23:26:28.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.831+0000 7f1c84c00640 1 -- 172.21.15.144:0/2990810568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c800cf320 msgr2=0x7f1c800cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:28.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.831+0000 7f1c84c00640 1 --2- 172.21.15.144:0/2990810568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c800cf320 0x7f1c800cf790 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f1c800b5850 tx=0x7f1c7802a730 comp rx=0 tx=0).stop 2024-09-11T23:26:28.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.832+0000 7f1c84c00640 1 -- 172.21.15.144:0/2990810568 shutdown_connections 2024-09-11T23:26:28.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.832+0000 7f1c84c00640 1 --2- 172.21.15.144:0/2990810568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c800cf320 0x7f1c800cf790 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:28.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.832+0000 7f1c84c00640 1 --2- 172.21.15.144:0/2990810568 >> v2:172.21.15.165:3300/0 conn(0x7f1c8015d3b0 0x7f1c80071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:28.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.832+0000 7f1c84c00640 1 -- 172.21.15.144:0/2990810568 >> 172.21.15.144:0/2990810568 conn(0x7f1c8006bba0 msgr2=0x7f1c8006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:28.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.832+0000 7f1c84c00640 1 -- 172.21.15.144:0/2990810568 shutdown_connections 2024-09-11T23:26:28.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.832+0000 7f1c84c00640 1 -- 172.21.15.144:0/2990810568 wait complete. 2024-09-11T23:26:28.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.833+0000 7f1c84c00640 1 Processor -- start 2024-09-11T23:26:28.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.833+0000 7f1c84c00640 1 -- start start 2024-09-11T23:26:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.834+0000 7f1c84c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c800cf320 0x7f1c801f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.834+0000 7f1c84c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c8015d3b0 0x7f1c801567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.834+0000 7f1c84c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c80154b30 0x7f1c8015b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.834+0000 7f1c84c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1c800cfcd0 con 0x7f1c8015d3b0 2024-09-11T23:26:28.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.834+0000 7f1c84c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1c800cdba0 con 0x7f1c800cf320 2024-09-11T23:26:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.834+0000 7f1c84c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1c800cd580 con 0x7f1c80154b30 2024-09-11T23:26:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.834+0000 7f1c75400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c8015d3b0 0x7f1c801567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.835+0000 7f1c75400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c8015d3b0 0x7f1c801567c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40410/0 (socket says 172.21.15.144:40410) 2024-09-11T23:26:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.835+0000 7f1c75400640 1 -- 172.21.15.144:0/2747653408 learned_addr learned my addr 172.21.15.144:0/2747653408 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.835+0000 7f1c7de00640 1 --2- 172.21.15.144:0/2747653408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c800cf320 0x7f1c801f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.835+0000 7f1c7e800640 1 --2- 172.21.15.144:0/2747653408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c80154b30 0x7f1c8015b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.835+0000 7f1c75400640 1 -- 172.21.15.144:0/2747653408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c80154b30 msgr2=0x7f1c8015b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.835+0000 7f1c75400640 1 --2- 172.21.15.144:0/2747653408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c80154b30 0x7f1c8015b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.835+0000 7f1c75400640 1 -- 172.21.15.144:0/2747653408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c800cf320 msgr2=0x7f1c801f6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.835+0000 7f1c75400640 1 --2- 172.21.15.144:0/2747653408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c800cf320 0x7f1c801f6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.835+0000 7f1c75400640 1 -- 172.21.15.144:0/2747653408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c801f72a0 con 0x7f1c8015d3b0 2024-09-11T23:26:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.835+0000 7f1c75400640 1 --2- 172.21.15.144:0/2747653408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c8015d3b0 0x7f1c801567c0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800c3c0 tx=0x7f1c6800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:28.836 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.835+0000 7f1c76a00640 1 -- 172.21.15.144:0/2747653408 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c68007020 con 0x7f1c8015d3b0 2024-09-11T23:26:28.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.835+0000 7f1c76a00640 1 -- 172.21.15.144:0/2747653408 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c680071c0 con 0x7f1c8015d3b0 2024-09-11T23:26:28.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.835+0000 7f1c76a00640 1 -- 172.21.15.144:0/2747653408 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c680075f0 con 0x7f1c8015d3b0 2024-09-11T23:26:28.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.836+0000 7f1c84c00640 1 -- 172.21.15.144:0/2747653408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c80155080 con 0x7f1c8015d3b0 2024-09-11T23:26:28.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.836+0000 7f1c84c00640 1 -- 172.21.15.144:0/2747653408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c80155640 con 0x7f1c8015d3b0 2024-09-11T23:26:28.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.837+0000 7f1c84c00640 1 -- 172.21.15.144:0/2747653408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c8015cbf0 con 0x7f1c8015d3b0 2024-09-11T23:26:28.837 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.838+0000 7f1c76a00640 1 -- 172.21.15.144:0/2747653408 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f1c680067b0 con 0x7f1c8015d3b0 2024-09-11T23:26:28.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.839+0000 7f1c76a00640 1 --2- 172.21.15.144:0/2747653408 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1c5c06c7c0 0x7f1c5c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:28.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.839+0000 7f1c76a00640 1 -- 172.21.15.144:0/2747653408 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 5609+0+0 (secure 0 0 0) 0x7f1c68088a60 con 0x7f1c8015d3b0 2024-09-11T23:26:28.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.839+0000 7f1c7de00640 1 --2- 172.21.15.144:0/2747653408 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1c5c06c7c0 0x7f1c5c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:28.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.840+0000 7f1c7de00640 1 --2- 172.21.15.144:0/2747653408 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1c5c06c7c0 0x7f1c5c06ec80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009ad0 tx=0x7f1c70008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:28.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:28.844+0000 7f1c76a00640 1 -- 172.21.15.144:0/2747653408 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1c68058f80 con 0x7f1c8015d3b0 2024-09-11T23:26:29.053 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.054+0000 7f1c84c00640 1 -- 172.21.15.144:0/2747653408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1c800634e0 con 0x7f1c8015d3b0 2024-09-11T23:26:29.662 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.662+0000 7f1c76a00640 1 -- 172.21.15.144:0/2747653408 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 26 and data pool 27 v115) ==== 174+0+0 (secure 0 0 0) 0x7f1c68058880 con 0x7f1c8015d3b0 2024-09-11T23:26:29.663 INFO:teuthology.orchestra.run.smithi144.stderr:new fs with metadata pool 26 and data pool 27 2024-09-11T23:26:29.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.667+0000 7f1c84c00640 1 -- 172.21.15.144:0/2747653408 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1c5c06c7c0 msgr2=0x7f1c5c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:29.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.667+0000 7f1c84c00640 1 --2- 172.21.15.144:0/2747653408 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1c5c06c7c0 0x7f1c5c06ec80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009ad0 tx=0x7f1c70008040 comp rx=0 tx=0).stop 2024-09-11T23:26:29.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.667+0000 7f1c84c00640 1 -- 172.21.15.144:0/2747653408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c8015d3b0 msgr2=0x7f1c801567c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:29.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.667+0000 7f1c84c00640 1 --2- 172.21.15.144:0/2747653408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c8015d3b0 0x7f1c801567c0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800c3c0 tx=0x7f1c6800c880 comp rx=0 tx=0).stop 2024-09-11T23:26:29.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.668+0000 7f1c84c00640 1 -- 172.21.15.144:0/2747653408 shutdown_connections 2024-09-11T23:26:29.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.668+0000 7f1c84c00640 1 --2- 172.21.15.144:0/2747653408 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1c5c06c7c0 0x7f1c5c06ec80 secure :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009ad0 tx=0x7f1c70008040 comp rx=0 tx=0).stop 2024-09-11T23:26:29.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.668+0000 7f1c84c00640 1 --2- 172.21.15.144:0/2747653408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1c80154b30 0x7f1c8015b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:29.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.668+0000 7f1c84c00640 1 --2- 172.21.15.144:0/2747653408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c8015d3b0 0x7f1c801567c0 secure :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800c3c0 tx=0x7f1c6800c880 comp rx=0 tx=0).stop 2024-09-11T23:26:29.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.668+0000 7f1c84c00640 1 --2- 172.21.15.144:0/2747653408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c800cf320 0x7f1c801f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:29.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.668+0000 7f1c84c00640 1 -- 172.21.15.144:0/2747653408 >> 172.21.15.144:0/2747653408 conn(0x7f1c8006bba0 msgr2=0x7f1c80072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:29.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.669+0000 7f1c84c00640 1 -- 172.21.15.144:0/2747653408 shutdown_connections 2024-09-11T23:26:29.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.669+0000 7f1c84c00640 1 -- 172.21.15.144:0/2747653408 wait complete. 2024-09-11T23:26:29.698 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:26:29.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.851+0000 7f3b32200640 1 Processor -- start 2024-09-11T23:26:29.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.852+0000 7f3b32200640 1 -- start start 2024-09-11T23:26:29.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.853+0000 7f3b32200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3b2c073830 0x7f3b2c0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:29.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.853+0000 7f3b32200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b2c0ce740 con 0x7f3b2c15c180 2024-09-11T23:26:29.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.853+0000 7f3b32200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b2c072640 con 0x7f3b2c0cf070 2024-09-11T23:26:29.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.853+0000 7f3b32200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3b2c072920 con 0x7f3b2c073830 2024-09-11T23:26:29.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.853+0000 7f3b2b400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3b2c15c180 0x7f3b2c0cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37756/0 (socket says 172.21.15.144:37756) 2024-09-11T23:26:29.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.853+0000 7f3b2b400640 1 -- 172.21.15.144:0/3502517808 learned_addr learned my addr 172.21.15.144:0/3502517808 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:29.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.853+0000 7f3b2be00640 1 --2- 172.21.15.144:0/3502517808 >> v2:172.21.15.165:3300/0 conn(0x7f3b2c073830 0x7f3b2c0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:29.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.853+0000 7f3b2aa00640 1 -- 172.21.15.144:0/3502517808 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 634745685 0 0) 0x7f3b2c0ce740 con 0x7f3b2c15c180 2024-09-11T23:26:29.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.853+0000 7f3b2aa00640 1 -- 172.21.15.144:0/3502517808 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b10003520 con 0x7f3b2c15c180 2024-09-11T23:26:29.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.854+0000 7f3b2aa00640 1 -- 172.21.15.144:0/3502517808 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2775321870 0 0) 0x7f3b10003520 con 0x7f3b2c15c180 2024-09-11T23:26:29.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.854+0000 7f3b2aa00640 1 -- 172.21.15.144:0/3502517808 >> v2:172.21.15.165:3300/0 conn(0x7f3b2c073830 msgr2=0x7f3b2c0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:29.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.854+0000 7f3b2aa00640 1 --2- 172.21.15.144:0/3502517808 >> v2:172.21.15.165:3300/0 conn(0x7f3b2c073830 0x7f3b2c0cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:29.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.854+0000 7f3b2aa00640 1 -- 172.21.15.144:0/3502517808 >> v1:172.21.15.165:6789/0 conn(0x7f3b2c0cf070 legacy=0x7f3b2c073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:29.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.854+0000 7f3b2aa00640 1 -- 172.21.15.144:0/3502517808 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2c072c00 con 0x7f3b2c15c180 2024-09-11T23:26:29.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.854+0000 7f3b2aa00640 1 -- 172.21.15.144:0/3502517808 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f3b1c001670 con 0x7f3b2c15c180 2024-09-11T23:26:29.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.854+0000 7f3b2be00640 1 --2- 172.21.15.144:0/3502517808 >> v2:172.21.15.165:3300/0 conn(0x7f3b2c073830 0x7f3b2c0cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:26:29.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.854+0000 7f3b2aa00640 1 -- 172.21.15.144:0/3502517808 >> v1:172.21.15.144:6789/0 conn(0x7f3b2c15c180 legacy=0x7f3b2c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:29.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.854+0000 7f3b2aa00640 1 --2- 172.21.15.144:0/3502517808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b100039b0 0x7f3b10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:29.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.854+0000 7f3b2aa00640 1 --2- 172.21.15.144:0/3502517808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b10004800 0x7f3b10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:29.856 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.854+0000 7f3b2aa00640 1 --2- 172.21.15.144:0/3502517808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b100051c0 0x7f3b1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:29.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.854+0000 7f3b2aa00640 1 -- 172.21.15.144:0/3502517808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2c072920 con 0x7f3b10004800 2024-09-11T23:26:29.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.854+0000 7f3b2aa00640 1 -- 172.21.15.144:0/3502517808 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1000c160 con 0x7f3b100039b0 2024-09-11T23:26:29.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.854+0000 7f3b2aa00640 1 -- 172.21.15.144:0/3502517808 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3b1000c360 con 0x7f3b100051c0 2024-09-11T23:26:29.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.854+0000 7f3b23e00640 1 --2- 172.21.15.144:0/3502517808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b10004800 0x7f3b10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:29.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.854+0000 7f3b2b400640 1 --2- 172.21.15.144:0/3502517808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b100039b0 0x7f3b10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:29.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.854+0000 7f3b2be00640 1 --2- 172.21.15.144:0/3502517808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b100051c0 0x7f3b1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:29.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.855+0000 7f3b23e00640 1 -- 172.21.15.144:0/3502517808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b100051c0 msgr2=0x7f3b1000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:29.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.855+0000 7f3b23e00640 1 --2- 172.21.15.144:0/3502517808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b100051c0 0x7f3b1000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:29.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.855+0000 7f3b23e00640 1 -- 172.21.15.144:0/3502517808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b100039b0 msgr2=0x7f3b10003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:29.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.855+0000 7f3b23e00640 1 --2- 172.21.15.144:0/3502517808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b100039b0 0x7f3b10003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:29.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.855+0000 7f3b23e00640 1 -- 172.21.15.144:0/3502517808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b10003520 con 0x7f3b10004800 2024-09-11T23:26:29.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.855+0000 7f3b2be00640 1 --2- 172.21.15.144:0/3502517808 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b100051c0 0x7f3b1000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:29.857 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.855+0000 7f3b2be00640 1 -- 172.21.15.144:0/3502517808 reap_dead start 2024-09-11T23:26:29.858 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.856+0000 7f3b23e00640 1 --2- 172.21.15.144:0/3502517808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b10004800 0x7f3b10004c80 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f3b14001750 tx=0x7f3b10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24f233ca9eb7cca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:29.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.856+0000 7f3b2aa00640 1 -- 172.21.15.144:0/3502517808 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b14001370 con 0x7f3b10004800 2024-09-11T23:26:29.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.856+0000 7f3b2aa00640 1 -- 172.21.15.144:0/3502517808 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b140052d0 con 0x7f3b10004800 2024-09-11T23:26:29.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.856+0000 7f3b2aa00640 1 -- 172.21.15.144:0/3502517808 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1402abc0 con 0x7f3b10004800 2024-09-11T23:26:29.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.856+0000 7f3b32200640 1 -- 172.21.15.144:0/3502517808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b10004800 msgr2=0x7f3b10004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:29.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.856+0000 7f3b32200640 1 --2- 172.21.15.144:0/3502517808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b10004800 0x7f3b10004c80 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f3b14001750 tx=0x7f3b10005830 comp rx=0 tx=0).stop 2024-09-11T23:26:29.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.856+0000 7f3b32200640 1 -- 172.21.15.144:0/3502517808 shutdown_connections 2024-09-11T23:26:29.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.856+0000 7f3b32200640 1 --2- 172.21.15.144:0/3502517808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b10004800 0x7f3b10004c80 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:29.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.856+0000 7f3b32200640 1 -- 172.21.15.144:0/3502517808 >> 172.21.15.144:0/3502517808 conn(0x7f3b2c062cc0 msgr2=0x7f3b2c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:29.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.857+0000 7f3b32200640 1 -- 172.21.15.144:0/3502517808 shutdown_connections 2024-09-11T23:26:29.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.857+0000 7f3b32200640 1 -- 172.21.15.144:0/3502517808 wait complete. 2024-09-11T23:26:29.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.858+0000 7f3b32200640 1 Processor -- start 2024-09-11T23:26:29.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.858+0000 7f3b32200640 1 -- start start 2024-09-11T23:26:29.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.859+0000 7f3b32200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b10004800 0x7f3b2c153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:29.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.859+0000 7f3b32200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b2c151a60 0x7f3b2c150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:29.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.859+0000 7f3b32200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b2c06bba0 0x7f3b2c06c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:29.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.859+0000 7f3b32200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2c15c560 con 0x7f3b2c151a60 2024-09-11T23:26:29.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.859+0000 7f3b32200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2c0722f0 con 0x7f3b2c06bba0 2024-09-11T23:26:29.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.859+0000 7f3b32200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3b2c15c6e0 con 0x7f3b10004800 2024-09-11T23:26:29.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.859+0000 7f3b23e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b2c151a60 0x7f3b2c150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:29.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.860+0000 7f3b23e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b2c151a60 0x7f3b2c150710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40426/0 (socket says 172.21.15.144:40426) 2024-09-11T23:26:29.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.860+0000 7f3b23e00640 1 -- 172.21.15.144:0/1113350606 learned_addr learned my addr 172.21.15.144:0/1113350606 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:29.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.860+0000 7f3b2be00640 1 --2- 172.21.15.144:0/1113350606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b2c06bba0 0x7f3b2c06c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:29.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.860+0000 7f3b2b400640 1 --2- 172.21.15.144:0/1113350606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b10004800 0x7f3b2c153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:29.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.860+0000 7f3b23e00640 1 -- 172.21.15.144:0/1113350606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b10004800 msgr2=0x7f3b2c153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:29.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.860+0000 7f3b23e00640 1 --2- 172.21.15.144:0/1113350606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b10004800 0x7f3b2c153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:29.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.860+0000 7f3b23e00640 1 -- 172.21.15.144:0/1113350606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b2c06bba0 msgr2=0x7f3b2c06c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:29.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.860+0000 7f3b23e00640 1 --2- 172.21.15.144:0/1113350606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b2c06bba0 0x7f3b2c06c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:29.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.860+0000 7f3b23e00640 1 -- 172.21.15.144:0/1113350606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2c151390 con 0x7f3b2c151a60 2024-09-11T23:26:29.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.860+0000 7f3b23e00640 1 --2- 172.21.15.144:0/1113350606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b2c151a60 0x7f3b2c150710 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f3b14000c00 tx=0x7f3b14001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:29.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.860+0000 7f3b23400640 1 -- 172.21.15.144:0/1113350606 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b14040030 con 0x7f3b2c151a60 2024-09-11T23:26:29.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.861+0000 7f3b23400640 1 -- 172.21.15.144:0/1113350606 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b1402be50 con 0x7f3b2c151a60 2024-09-11T23:26:29.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.861+0000 7f3b23400640 1 -- 172.21.15.144:0/1113350606 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b14001370 con 0x7f3b2c151a60 2024-09-11T23:26:29.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.861+0000 7f3b32200640 1 -- 172.21.15.144:0/1113350606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b2c155790 con 0x7f3b2c151a60 2024-09-11T23:26:29.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.861+0000 7f3b32200640 1 -- 172.21.15.144:0/1113350606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b2c155d50 con 0x7f3b2c151a60 2024-09-11T23:26:29.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.862+0000 7f3b32200640 1 -- 172.21.15.144:0/1113350606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b2c0cf4e0 con 0x7f3b2c151a60 2024-09-11T23:26:29.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.863+0000 7f3b23400640 1 -- 172.21.15.144:0/1113350606 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f3b14043070 con 0x7f3b2c151a60 2024-09-11T23:26:29.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.863+0000 7f3b23400640 1 --2- 172.21.15.144:0/1113350606 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3b0806c7c0 0x7f3b0806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:29.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.864+0000 7f3b23400640 1 -- 172.21.15.144:0/1113350606 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f3b140a9070 con 0x7f3b2c151a60 2024-09-11T23:26:29.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.864+0000 7f3b2b400640 1 --2- 172.21.15.144:0/1113350606 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3b0806c7c0 0x7f3b0806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:29.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.865+0000 7f3b2b400640 1 --2- 172.21.15.144:0/1113350606 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3b0806c7c0 0x7f3b0806ec80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c001050 tx=0x7f3b1c0078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:29.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:29.868+0000 7f3b23400640 1 -- 172.21.15.144:0/1113350606 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b1404a070 con 0x7f3b2c151a60 2024-09-11T23:26:30.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.042+0000 7f3b32200640 1 -- 172.21.15.144:0/1113350606 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b2c0cc460 con 0x7f3b2c151a60 2024-09-11T23:26:30.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.043+0000 7f3b23400640 1 -- 172.21.15.144:0/1113350606 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) ==== 74+0+16780 (secure 0 0 0) 0x7f3b14078fd0 con 0x7f3b2c151a60 2024-09-11T23:26:30.043 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:30.044 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":165,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:26:29.055235+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:26:26.828432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-11T23:26:28.054488+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:26:30.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.046+0000 7f3b32200640 1 -- 172.21.15.144:0/1113350606 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3b0806c7c0 msgr2=0x7f3b0806ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:30.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.046+0000 7f3b32200640 1 --2- 172.21.15.144:0/1113350606 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3b0806c7c0 0x7f3b0806ec80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c001050 tx=0x7f3b1c0078f0 comp rx=0 tx=0).stop 2024-09-11T23:26:30.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.046+0000 7f3b32200640 1 -- 172.21.15.144:0/1113350606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b2c151a60 msgr2=0x7f3b2c150710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:30.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.046+0000 7f3b32200640 1 --2- 172.21.15.144:0/1113350606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b2c151a60 0x7f3b2c150710 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f3b14000c00 tx=0x7f3b14001120 comp rx=0 tx=0).stop 2024-09-11T23:26:30.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.046+0000 7f3b32200640 1 -- 172.21.15.144:0/1113350606 shutdown_connections 2024-09-11T23:26:30.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.046+0000 7f3b32200640 1 --2- 172.21.15.144:0/1113350606 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3b0806c7c0 0x7f3b0806ec80 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:30.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.046+0000 7f3b32200640 1 --2- 172.21.15.144:0/1113350606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b2c06bba0 0x7f3b2c06c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:30.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.046+0000 7f3b32200640 1 --2- 172.21.15.144:0/1113350606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b2c151a60 0x7f3b2c150710 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:30.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.046+0000 7f3b32200640 1 --2- 172.21.15.144:0/1113350606 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3b10004800 0x7f3b2c153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:30.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.046+0000 7f3b32200640 1 -- 172.21.15.144:0/1113350606 >> 172.21.15.144:0/1113350606 conn(0x7f3b2c062cc0 msgr2=0x7f3b2c0b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:30.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.046+0000 7f3b32200640 1 -- 172.21.15.144:0/1113350606 shutdown_connections 2024-09-11T23:26:30.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.046+0000 7f3b32200640 1 -- 172.21.15.144:0/1113350606 wait complete. 2024-09-11T23:26:30.062 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:26:30.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.215+0000 7fa7eba00640 1 Processor -- start 2024-09-11T23:26:30.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.215+0000 7fa7eba00640 1 -- start start 2024-09-11T23:26:30.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.216+0000 7fa7eba00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa7e415c180 0x7fa7e40cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:30.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.216+0000 7fa7eba00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7e40ce740 con 0x7fa7e40ce230 2024-09-11T23:26:30.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.216+0000 7fa7eba00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7e4072640 con 0x7fa7e4073120 2024-09-11T23:26:30.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.216+0000 7fa7eba00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa7e4072920 con 0x7fa7e415c180 2024-09-11T23:26:30.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.216+0000 7fa7e3e00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa7e40ce230 0x7fa7e40cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37770/0 (socket says 172.21.15.144:37770) 2024-09-11T23:26:30.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.217+0000 7fa7e3e00640 1 -- 172.21.15.144:0/112913179 learned_addr learned my addr 172.21.15.144:0/112913179 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:30.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.217+0000 7fa7e9000640 1 --2- 172.21.15.144:0/112913179 >> v2:172.21.15.165:3300/0 conn(0x7fa7e415c180 0x7fa7e40cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:30.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.217+0000 7fa7e3400640 1 -- 172.21.15.144:0/112913179 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2703477461 0 0) 0x7fa7e40ce740 con 0x7fa7e40ce230 2024-09-11T23:26:30.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.217+0000 7fa7e3400640 1 -- 172.21.15.144:0/112913179 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7cc003520 con 0x7fa7e40ce230 2024-09-11T23:26:30.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.217+0000 7fa7e9000640 1 -- 172.21.15.144:0/112913179 >> v1:172.21.15.165:6789/0 conn(0x7fa7e4073120 legacy=0x7fa7e406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:30.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.217+0000 7fa7e9000640 1 -- 172.21.15.144:0/112913179 >> v1:172.21.15.144:6789/0 conn(0x7fa7e40ce230 legacy=0x7fa7e40cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:30.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.217+0000 7fa7e3400640 1 -- 172.21.15.144:0/112913179 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1402087727 0 0) 0x7fa7cc003520 con 0x7fa7e40ce230 2024-09-11T23:26:30.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.217+0000 7fa7e9000640 1 -- 172.21.15.144:0/112913179 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e4072c00 con 0x7fa7e415c180 2024-09-11T23:26:30.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.218+0000 7fa7e9000640 1 --2- 172.21.15.144:0/112913179 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e415c180 0x7fa7e40cdcf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80097a0 tx=0x7fa7d802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74e5dbed69fddb4e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:30.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.219+0000 7fa7e3400640 1 -- 172.21.15.144:0/112913179 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8037070 con 0x7fa7e415c180 2024-09-11T23:26:30.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.219+0000 7fa7e3400640 1 -- 172.21.15.144:0/112913179 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7d802abc0 con 0x7fa7e415c180 2024-09-11T23:26:30.218 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.219+0000 7fa7e3400640 1 -- 172.21.15.144:0/112913179 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0001670 con 0x7fa7e415c180 2024-09-11T23:26:30.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.219+0000 7fa7eba00640 1 -- 172.21.15.144:0/112913179 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e415c180 msgr2=0x7fa7e40cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:30.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.219+0000 7fa7eba00640 1 --2- 172.21.15.144:0/112913179 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e415c180 0x7fa7e40cdcf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80097a0 tx=0x7fa7d802a130 comp rx=0 tx=0).stop 2024-09-11T23:26:30.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.219+0000 7fa7eba00640 1 -- 172.21.15.144:0/112913179 shutdown_connections 2024-09-11T23:26:30.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.219+0000 7fa7eba00640 1 --2- 172.21.15.144:0/112913179 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e415c180 0x7fa7e40cdcf0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:30.219 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.219+0000 7fa7eba00640 1 -- 172.21.15.144:0/112913179 >> 172.21.15.144:0/112913179 conn(0x7fa7e4062cc0 msgr2=0x7fa7e406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:30.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.219+0000 7fa7eba00640 1 -- 172.21.15.144:0/112913179 shutdown_connections 2024-09-11T23:26:30.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.219+0000 7fa7eba00640 1 -- 172.21.15.144:0/112913179 wait complete. 2024-09-11T23:26:30.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.221+0000 7fa7eba00640 1 Processor -- start 2024-09-11T23:26:30.220 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.221+0000 7fa7eba00640 1 -- start start 2024-09-11T23:26:30.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.222+0000 7fa7eba00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e4073120 0x7fa7e40cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:30.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.222+0000 7fa7eba00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7e40ce230 0x7fa7e4148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:30.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.222+0000 7fa7eba00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa7e415c180 0x7fa7e4159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:30.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.222+0000 7fa7eba00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e40cf780 con 0x7fa7e40ce230 2024-09-11T23:26:30.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.222+0000 7fa7eba00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e40722f0 con 0x7fa7e4073120 2024-09-11T23:26:30.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.222+0000 7fa7eba00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa7e415c560 con 0x7fa7e415c180 2024-09-11T23:26:30.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.222+0000 7fa7e3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7e40ce230 0x7fa7e4148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:30.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.222+0000 7fa7e3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7e40ce230 0x7fa7e4148d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40438/0 (socket says 172.21.15.144:40438) 2024-09-11T23:26:30.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.222+0000 7fa7e3e00640 1 -- 172.21.15.144:0/425013991 learned_addr learned my addr 172.21.15.144:0/425013991 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:30.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.222+0000 7fa7e9000640 1 --2- 172.21.15.144:0/425013991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e4073120 0x7fa7e40cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:30.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.222+0000 7fa7e9a00640 1 --2- 172.21.15.144:0/425013991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa7e415c180 0x7fa7e4159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:30.223 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.223+0000 7fa7e3e00640 1 -- 172.21.15.144:0/425013991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa7e415c180 msgr2=0x7fa7e4159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:30.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.223+0000 7fa7e3e00640 1 --2- 172.21.15.144:0/425013991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa7e415c180 0x7fa7e4159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:30.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.223+0000 7fa7e3e00640 1 -- 172.21.15.144:0/425013991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e4073120 msgr2=0x7fa7e40cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:30.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.223+0000 7fa7e3e00640 1 --2- 172.21.15.144:0/425013991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e4073120 0x7fa7e40cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:30.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.223+0000 7fa7e3e00640 1 -- 172.21.15.144:0/425013991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e40cc460 con 0x7fa7e40ce230 2024-09-11T23:26:30.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.223+0000 7fa7e3e00640 1 --2- 172.21.15.144:0/425013991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7e40ce230 0x7fa7e4148d30 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0001eb0 tx=0x7fa7d000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:30.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.223+0000 7fa7e0c00640 1 -- 172.21.15.144:0/425013991 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0017070 con 0x7fa7e40ce230 2024-09-11T23:26:30.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.223+0000 7fa7e0c00640 1 -- 172.21.15.144:0/425013991 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7d0005ad0 con 0x7fa7e40ce230 2024-09-11T23:26:30.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.223+0000 7fa7eba00640 1 -- 172.21.15.144:0/425013991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7e40cbb30 con 0x7fa7e40ce230 2024-09-11T23:26:30.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.223+0000 7fa7e0c00640 1 -- 172.21.15.144:0/425013991 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0007070 con 0x7fa7e40ce230 2024-09-11T23:26:30.224 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.223+0000 7fa7eba00640 1 -- 172.21.15.144:0/425013991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7e4159310 con 0x7fa7e40ce230 2024-09-11T23:26:30.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.224+0000 7fa7eba00640 1 -- 172.21.15.144:0/425013991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7e40cdcf0 con 0x7fa7e40ce230 2024-09-11T23:26:30.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.225+0000 7fa7e0c00640 1 -- 172.21.15.144:0/425013991 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7fa7d001a070 con 0x7fa7e40ce230 2024-09-11T23:26:30.225 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.226+0000 7fa7e0c00640 1 --2- 172.21.15.144:0/425013991 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa7c406c7c0 0x7fa7c406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:30.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.226+0000 7fa7e0c00640 1 -- 172.21.15.144:0/425013991 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7fa7d0088b30 con 0x7fa7e40ce230 2024-09-11T23:26:30.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.226+0000 7fa7e9000640 1 --2- 172.21.15.144:0/425013991 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa7c406c7c0 0x7fa7c406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:30.226 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.227+0000 7fa7e9000640 1 --2- 172.21.15.144:0/425013991 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa7c406c7c0 0x7fa7c406ec80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8034000 tx=0x7fa7d802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:30.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.230+0000 7fa7e0c00640 1 -- 172.21.15.144:0/425013991 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa7d00590e0 con 0x7fa7e40ce230 2024-09-11T23:26:30.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.405+0000 7fa7eba00640 1 -- 172.21.15.144:0/425013991 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7e406d280 con 0x7fa7e40ce230 2024-09-11T23:26:30.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.407+0000 7fa7e0c00640 1 -- 172.21.15.144:0/425013991 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) ==== 74+0+16780 (secure 0 0 0) 0x7fa7d00589e0 con 0x7fa7e40ce230 2024-09-11T23:26:30.407 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:30.407 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":165,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:26:29.055235+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:26:26.828432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-11T23:26:28.054488+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:26:30.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.409+0000 7fa7eba00640 1 -- 172.21.15.144:0/425013991 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa7c406c7c0 msgr2=0x7fa7c406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:30.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.409+0000 7fa7eba00640 1 --2- 172.21.15.144:0/425013991 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa7c406c7c0 0x7fa7c406ec80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8034000 tx=0x7fa7d802e000 comp rx=0 tx=0).stop 2024-09-11T23:26:30.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.409+0000 7fa7eba00640 1 -- 172.21.15.144:0/425013991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7e40ce230 msgr2=0x7fa7e4148d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:30.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.409+0000 7fa7eba00640 1 --2- 172.21.15.144:0/425013991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7e40ce230 0x7fa7e4148d30 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0001eb0 tx=0x7fa7d000cbe0 comp rx=0 tx=0).stop 2024-09-11T23:26:30.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.409+0000 7fa7eba00640 1 -- 172.21.15.144:0/425013991 shutdown_connections 2024-09-11T23:26:30.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.409+0000 7fa7eba00640 1 --2- 172.21.15.144:0/425013991 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa7c406c7c0 0x7fa7c406ec80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:30.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.409+0000 7fa7eba00640 1 --2- 172.21.15.144:0/425013991 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa7e415c180 0x7fa7e4159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:30.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.409+0000 7fa7eba00640 1 --2- 172.21.15.144:0/425013991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7e40ce230 0x7fa7e4148d30 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:30.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.409+0000 7fa7eba00640 1 --2- 172.21.15.144:0/425013991 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e4073120 0x7fa7e40cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:30.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.409+0000 7fa7eba00640 1 -- 172.21.15.144:0/425013991 >> 172.21.15.144:0/425013991 conn(0x7fa7e4062cc0 msgr2=0x7fa7e415e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:30.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.409+0000 7fa7eba00640 1 -- 172.21.15.144:0/425013991 shutdown_connections 2024-09-11T23:26:30.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.409+0000 7fa7eba00640 1 -- 172.21.15.144:0/425013991 wait complete. 2024-09-11T23:26:30.426 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T23:26:30.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.582+0000 7f65dc000640 1 Processor -- start 2024-09-11T23:26:30.582 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.583+0000 7f65dc000640 1 -- start start 2024-09-11T23:26:30.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.584+0000 7f65dc000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65d4158e50 0x7f65d40b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:30.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.584+0000 7f65dc000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f65d415c370 0x7f65d406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.584+0000 7f65dc000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65d40b43f0 con 0x7f65d406ef60 2024-09-11T23:26:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.584+0000 7f65dc000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f65d406f3d0 con 0x7f65d415c370 2024-09-11T23:26:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.584+0000 7f65dc000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f65d415c7d0 con 0x7f65d4158e50 2024-09-11T23:26:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.584+0000 7f65d8c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f65d415c370 0x7f65d406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.584+0000 7f65d8c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f65d415c370 0x7f65d406ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40454/0 (socket says 172.21.15.144:40454) 2024-09-11T23:26:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.584+0000 7f65d8c00640 1 -- 172.21.15.144:0/3313870215 learned_addr learned my addr 172.21.15.144:0/3313870215 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.584+0000 7f65d9600640 1 --2- 172.21.15.144:0/3313870215 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65d4158e50 0x7f65d40b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.585+0000 7f65d8c00640 1 -- 172.21.15.144:0/3313870215 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65d4158e50 msgr2=0x7f65d40b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.585+0000 7f65d8c00640 1 --2- 172.21.15.144:0/3313870215 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65d4158e50 0x7f65d40b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.585+0000 7f65d8c00640 1 -- 172.21.15.144:0/3313870215 >> v1:172.21.15.165:6789/0 conn(0x7f65d406ef60 legacy=0x7f65d415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.585+0000 7f65d8c00640 1 -- 172.21.15.144:0/3313870215 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d40b3630 con 0x7f65d415c370 2024-09-11T23:26:30.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.585+0000 7f65d9600640 1 --2- 172.21.15.144:0/3313870215 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65d4158e50 0x7f65d40b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:30.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.586+0000 7f65d8c00640 1 --2- 172.21.15.144:0/3313870215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65d415c370 0x7f65d406ea20 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f65c000baf0 tx=0x7f65c002c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45938f819f180de6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:30.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.586+0000 7f65d3e00640 1 -- 172.21.15.144:0/3313870215 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0004230 con 0x7f65d415c370 2024-09-11T23:26:30.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.586+0000 7f65d3e00640 1 -- 172.21.15.144:0/3313870215 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c00043d0 con 0x7f65d415c370 2024-09-11T23:26:30.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.586+0000 7f65d3e00640 1 -- 172.21.15.144:0/3313870215 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0003810 con 0x7f65d415c370 2024-09-11T23:26:30.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.586+0000 7f65dc000640 1 -- 172.21.15.144:0/3313870215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65d415c370 msgr2=0x7f65d406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:30.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.586+0000 7f65dc000640 1 --2- 172.21.15.144:0/3313870215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65d415c370 0x7f65d406ea20 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f65c000baf0 tx=0x7f65c002c8b0 comp rx=0 tx=0).stop 2024-09-11T23:26:30.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.586+0000 7f65dc000640 1 -- 172.21.15.144:0/3313870215 shutdown_connections 2024-09-11T23:26:30.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.586+0000 7f65dc000640 1 --2- 172.21.15.144:0/3313870215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65d415c370 0x7f65d406ea20 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:30.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.586+0000 7f65dc000640 1 --2- 172.21.15.144:0/3313870215 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65d4158e50 0x7f65d40b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:30.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.586+0000 7f65dc000640 1 -- 172.21.15.144:0/3313870215 >> 172.21.15.144:0/3313870215 conn(0x7f65d406bba0 msgr2=0x7f65d406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:30.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.587+0000 7f65dc000640 1 -- 172.21.15.144:0/3313870215 shutdown_connections 2024-09-11T23:26:30.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.587+0000 7f65dc000640 1 -- 172.21.15.144:0/3313870215 wait complete. 2024-09-11T23:26:30.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.588+0000 7f65dc000640 1 Processor -- start 2024-09-11T23:26:30.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.589+0000 7f65dc000640 1 -- start start 2024-09-11T23:26:30.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.589+0000 7f65dc000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f65d406ef60 0x7f65d4150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:30.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.589+0000 7f65dc000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65d4158e50 0x7f65d41f4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.589+0000 7f65dc000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65d415c370 0x7f65d40b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.589+0000 7f65dc000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f65d40b3ed0 con 0x7f65d4158e50 2024-09-11T23:26:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.589+0000 7f65dc000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f65d40b3bf0 con 0x7f65d406ef60 2024-09-11T23:26:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.589+0000 7f65dc000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f65d4159230 con 0x7f65d415c370 2024-09-11T23:26:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.590+0000 7f65d8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65d4158e50 0x7f65d41f4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.590+0000 7f65d8c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65d4158e50 0x7f65d41f4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40458/0 (socket says 172.21.15.144:40458) 2024-09-11T23:26:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.590+0000 7f65d8c00640 1 -- 172.21.15.144:0/2637886835 learned_addr learned my addr 172.21.15.144:0/2637886835 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.590+0000 7f65d9600640 1 --2- 172.21.15.144:0/2637886835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f65d406ef60 0x7f65d4150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.590+0000 7f65da000640 1 --2- 172.21.15.144:0/2637886835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65d415c370 0x7f65d40b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.590+0000 7f65d8c00640 1 -- 172.21.15.144:0/2637886835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65d415c370 msgr2=0x7f65d40b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.590+0000 7f65d8c00640 1 --2- 172.21.15.144:0/2637886835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65d415c370 0x7f65d40b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.590+0000 7f65d8c00640 1 -- 172.21.15.144:0/2637886835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f65d406ef60 msgr2=0x7f65d4150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.590+0000 7f65d8c00640 1 --2- 172.21.15.144:0/2637886835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f65d406ef60 0x7f65d4150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:30.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.590+0000 7f65d8c00640 1 -- 172.21.15.144:0/2637886835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d41509d0 con 0x7f65d4158e50 2024-09-11T23:26:30.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.590+0000 7f65da000640 1 --2- 172.21.15.144:0/2637886835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65d415c370 0x7f65d40b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:30.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.590+0000 7f65d8c00640 1 --2- 172.21.15.144:0/2637886835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65d4158e50 0x7f65d41f4150 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f65c002c8f0 tx=0x7f65c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:30.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.591+0000 7f65d1600640 1 -- 172.21.15.144:0/2637886835 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0040020 con 0x7f65d4158e50 2024-09-11T23:26:30.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.591+0000 7f65d1600640 1 -- 172.21.15.144:0/2637886835 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c0003e10 con 0x7f65d4158e50 2024-09-11T23:26:30.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.591+0000 7f65d1600640 1 -- 172.21.15.144:0/2637886835 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c00327b0 con 0x7f65d4158e50 2024-09-11T23:26:30.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.591+0000 7f65dc000640 1 -- 172.21.15.144:0/2637886835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d40b29e0 con 0x7f65d4158e50 2024-09-11T23:26:30.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.591+0000 7f65dc000640 1 -- 172.21.15.144:0/2637886835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d41f4a80 con 0x7f65d4158e50 2024-09-11T23:26:30.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.592+0000 7f65dc000640 1 -- 172.21.15.144:0/2637886835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d4158280 con 0x7f65d4158e50 2024-09-11T23:26:30.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.593+0000 7f65d1600640 1 -- 172.21.15.144:0/2637886835 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f65c0043020 con 0x7f65d4158e50 2024-09-11T23:26:30.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.594+0000 7f65d1600640 1 --2- 172.21.15.144:0/2637886835 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f65b406c7c0 0x7f65b406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:30.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.594+0000 7f65d1600640 1 -- 172.21.15.144:0/2637886835 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5709+0+0 (secure 0 0 0) 0x7f65c00a9fc0 con 0x7f65d4158e50 2024-09-11T23:26:30.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.594+0000 7f65d9600640 1 --2- 172.21.15.144:0/2637886835 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f65b406c7c0 0x7f65b406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:30.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.595+0000 7f65d9600640 1 --2- 172.21.15.144:0/2637886835 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f65b406c7c0 0x7f65b406ec80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f65d40b2e10 tx=0x7f65c8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:30.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.598+0000 7f65d1600640 1 -- 172.21.15.144:0/2637886835 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f65c004a030 con 0x7f65d4158e50 2024-09-11T23:26:30.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:30.811+0000 7f65dc000640 1 -- 172.21.15.144:0/2637886835 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f65d40b4fd0 con 0x7f65d4158e50 2024-09-11T23:26:31.635 INFO:tasks.ceph.mds.b.smithi165.stderr:2024-09-11T23:26:31.635+0000 7f0b88000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T23:26:31.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.683+0000 7f65d1600640 1 -- 172.21.15.144:0/2637886835 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v118) ==== 118+0+0 (secure 0 0 0) 0x7f65c007a570 con 0x7f65d4158e50 2024-09-11T23:26:31.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.686+0000 7f65dc000640 1 -- 172.21.15.144:0/2637886835 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f65b406c7c0 msgr2=0x7f65b406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:31.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.686+0000 7f65dc000640 1 --2- 172.21.15.144:0/2637886835 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f65b406c7c0 0x7f65b406ec80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f65d40b2e10 tx=0x7f65c8008040 comp rx=0 tx=0).stop 2024-09-11T23:26:31.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.686+0000 7f65dc000640 1 -- 172.21.15.144:0/2637886835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65d4158e50 msgr2=0x7f65d41f4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:31.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.686+0000 7f65dc000640 1 --2- 172.21.15.144:0/2637886835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65d4158e50 0x7f65d41f4150 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f65c002c8f0 tx=0x7f65c00046c0 comp rx=0 tx=0).stop 2024-09-11T23:26:31.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.686+0000 7f65dc000640 1 -- 172.21.15.144:0/2637886835 shutdown_connections 2024-09-11T23:26:31.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.686+0000 7f65dc000640 1 --2- 172.21.15.144:0/2637886835 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f65b406c7c0 0x7f65b406ec80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:31.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.686+0000 7f65dc000640 1 --2- 172.21.15.144:0/2637886835 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f65d415c370 0x7f65d40b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:31.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.686+0000 7f65dc000640 1 --2- 172.21.15.144:0/2637886835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65d4158e50 0x7f65d41f4150 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:31.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.686+0000 7f65dc000640 1 --2- 172.21.15.144:0/2637886835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f65d406ef60 0x7f65d4150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:31.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.686+0000 7f65dc000640 1 -- 172.21.15.144:0/2637886835 >> 172.21.15.144:0/2637886835 conn(0x7f65d406bba0 msgr2=0x7f65d415a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:31.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.686+0000 7f65dc000640 1 -- 172.21.15.144:0/2637886835 shutdown_connections 2024-09-11T23:26:31.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.686+0000 7f65dc000640 1 -- 172.21.15.144:0/2637886835 wait complete. 2024-09-11T23:26:31.703 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-11T23:26:31.704 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T23:26:31.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.861+0000 7f2db5200640 1 Processor -- start 2024-09-11T23:26:31.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.862+0000 7f2db5200640 1 -- start start 2024-09-11T23:26:31.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.863+0000 7f2db5200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2db015d790 0x7f2db00cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:31.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.863+0000 7f2db5200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2db00cd3b0 0x7f2db00cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:31.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.863+0000 7f2db5200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2db006d700 con 0x7f2db015d3b0 2024-09-11T23:26:31.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.863+0000 7f2db5200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2db006da30 con 0x7f2db00cd3b0 2024-09-11T23:26:31.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.863+0000 7f2db5200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2db00cde80 con 0x7f2db015d790 2024-09-11T23:26:31.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.863+0000 7f2dae800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2db00cd3b0 0x7f2db00cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:31.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.863+0000 7f2dae800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2db00cd3b0 0x7f2db00cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40460/0 (socket says 172.21.15.144:40460) 2024-09-11T23:26:31.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.863+0000 7f2dae800640 1 -- 172.21.15.144:0/3129314981 learned_addr learned my addr 172.21.15.144:0/3129314981 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:31.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.863+0000 7f2da5400640 1 --2- 172.21.15.144:0/3129314981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2db015d790 0x7f2db00cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:31.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.864+0000 7f2dae800640 1 -- 172.21.15.144:0/3129314981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2db015d790 msgr2=0x7f2db00cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:31.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.864+0000 7f2dae800640 1 --2- 172.21.15.144:0/3129314981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2db015d790 0x7f2db00cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:31.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.864+0000 7f2dae800640 1 -- 172.21.15.144:0/3129314981 >> v1:172.21.15.165:6789/0 conn(0x7f2db015d3b0 legacy=0x7f2db0071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:31.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.864+0000 7f2dae800640 1 -- 172.21.15.144:0/3129314981 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db00cd8c0 con 0x7f2db00cd3b0 2024-09-11T23:26:31.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.864+0000 7f2da5400640 1 --2- 172.21.15.144:0/3129314981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2db015d790 0x7f2db00cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:31.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.865+0000 7f2dae800640 1 --2- 172.21.15.144:0/3129314981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2db00cd3b0 0x7f2db00cf320 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009e50 tx=0x7f2da802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c0f5e03b995ed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:31.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.865+0000 7f2dad400640 1 -- 172.21.15.144:0/3129314981 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8036070 con 0x7f2db00cd3b0 2024-09-11T23:26:31.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.865+0000 7f2dad400640 1 -- 172.21.15.144:0/3129314981 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da8031600 con 0x7f2db00cd3b0 2024-09-11T23:26:31.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.865+0000 7f2dad400640 1 -- 172.21.15.144:0/3129314981 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da80319d0 con 0x7f2db00cd3b0 2024-09-11T23:26:31.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.865+0000 7f2db5200640 1 -- 172.21.15.144:0/3129314981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2db00cd3b0 msgr2=0x7f2db00cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:31.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.865+0000 7f2db5200640 1 --2- 172.21.15.144:0/3129314981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2db00cd3b0 0x7f2db00cf320 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009e50 tx=0x7f2da802a730 comp rx=0 tx=0).stop 2024-09-11T23:26:31.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.865+0000 7f2db5200640 1 -- 172.21.15.144:0/3129314981 shutdown_connections 2024-09-11T23:26:31.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.865+0000 7f2db5200640 1 --2- 172.21.15.144:0/3129314981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2db00cd3b0 0x7f2db00cf320 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:31.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.865+0000 7f2db5200640 1 --2- 172.21.15.144:0/3129314981 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2db015d790 0x7f2db00cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:31.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.865+0000 7f2db5200640 1 -- 172.21.15.144:0/3129314981 >> 172.21.15.144:0/3129314981 conn(0x7f2db006bba0 msgr2=0x7f2db006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:31.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.866+0000 7f2db5200640 1 -- 172.21.15.144:0/3129314981 shutdown_connections 2024-09-11T23:26:31.866 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.866+0000 7f2db5200640 1 -- 172.21.15.144:0/3129314981 wait complete. 2024-09-11T23:26:31.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.867+0000 7f2db5200640 1 Processor -- start 2024-09-11T23:26:31.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.867+0000 7f2db5200640 1 -- start start 2024-09-11T23:26:31.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.868+0000 7f2db5200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2db00cd3b0 0x7f2db01598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:31.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.868+0000 7f2db5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2db015d3b0 0x7f2db00af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:31.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.868+0000 7f2db5200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2db0159de0 0x7f2db00afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.868+0000 7f2db5200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2db015cd70 con 0x7f2db015d3b0 2024-09-11T23:26:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.868+0000 7f2db5200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2db015cbf0 con 0x7f2db0159de0 2024-09-11T23:26:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.868+0000 7f2db5200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2db00cf860 con 0x7f2db00cd3b0 2024-09-11T23:26:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.868+0000 7f2da5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2db015d3b0 0x7f2db00af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.868+0000 7f2da5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2db015d3b0 0x7f2db00af520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40464/0 (socket says 172.21.15.144:40464) 2024-09-11T23:26:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.868+0000 7f2da5400640 1 -- 172.21.15.144:0/384425408 learned_addr learned my addr 172.21.15.144:0/384425408 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.869+0000 7f2dae800640 1 --2- 172.21.15.144:0/384425408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2db0159de0 0x7f2db00afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.869+0000 7f2dade00640 1 --2- 172.21.15.144:0/384425408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2db00cd3b0 0x7f2db01598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.869+0000 7f2da5400640 1 -- 172.21.15.144:0/384425408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2db00cd3b0 msgr2=0x7f2db01598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.869+0000 7f2da5400640 1 --2- 172.21.15.144:0/384425408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2db00cd3b0 0x7f2db01598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.869+0000 7f2da5400640 1 -- 172.21.15.144:0/384425408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2db0159de0 msgr2=0x7f2db00afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.869+0000 7f2da5400640 1 --2- 172.21.15.144:0/384425408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2db0159de0 0x7f2db00afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:31.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.869+0000 7f2da5400640 1 -- 172.21.15.144:0/384425408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db01571b0 con 0x7f2db015d3b0 2024-09-11T23:26:31.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.869+0000 7f2dade00640 1 --2- 172.21.15.144:0/384425408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2db00cd3b0 0x7f2db01598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:31.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.869+0000 7f2da5400640 1 --2- 172.21.15.144:0/384425408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2db015d3b0 0x7f2db00af520 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800d800 tx=0x7f2d9800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:31.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.869+0000 7f2da6a00640 1 -- 172.21.15.144:0/384425408 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d98018020 con 0x7f2db015d3b0 2024-09-11T23:26:31.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.869+0000 7f2da6a00640 1 -- 172.21.15.144:0/384425408 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d98004030 con 0x7f2db015d3b0 2024-09-11T23:26:31.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.869+0000 7f2db5200640 1 -- 172.21.15.144:0/384425408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db0157450 con 0x7f2db015d3b0 2024-09-11T23:26:31.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.869+0000 7f2da6a00640 1 -- 172.21.15.144:0/384425408 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d98004400 con 0x7f2db015d3b0 2024-09-11T23:26:31.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.869+0000 7f2db5200640 1 -- 172.21.15.144:0/384425408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db0157cf0 con 0x7f2db015d3b0 2024-09-11T23:26:31.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.870+0000 7f2db5200640 1 -- 172.21.15.144:0/384425408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db0157840 con 0x7f2db015d3b0 2024-09-11T23:26:31.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.871+0000 7f2da6a00640 1 -- 172.21.15.144:0/384425408 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f2d98005990 con 0x7f2db015d3b0 2024-09-11T23:26:31.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.872+0000 7f2da6a00640 1 --2- 172.21.15.144:0/384425408 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2d8c06c7c0 0x7f2d8c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:31.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.872+0000 7f2da6a00640 1 -- 172.21.15.144:0/384425408 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f2d98089600 con 0x7f2db015d3b0 2024-09-11T23:26:31.872 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.873+0000 7f2dade00640 1 --2- 172.21.15.144:0/384425408 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2d8c06c7c0 0x7f2d8c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:31.873 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.873+0000 7f2dade00640 1 --2- 172.21.15.144:0/384425408 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2d8c06c7c0 0x7f2d8c06ec80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2da0007fd0 tx=0x7f2da0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:31.876 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:31.876+0000 7f2da6a00640 1 -- 172.21.15.144:0/384425408 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2d98022020 con 0x7f2db015d3b0 2024-09-11T23:26:32.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.085+0000 7f2db5200640 1 -- 172.21.15.144:0/384425408 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2db00cfc90 con 0x7f2db015d3b0 2024-09-11T23:26:32.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.687+0000 7f2da6a00640 1 -- 172.21.15.144:0/384425408 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v119) ==== 122+0+0 (secure 0 0 0) 0x7f2d98059bb0 con 0x7f2db015d3b0 2024-09-11T23:26:32.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.689+0000 7f2db5200640 1 -- 172.21.15.144:0/384425408 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2d8c06c7c0 msgr2=0x7f2d8c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:32.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.689+0000 7f2db5200640 1 --2- 172.21.15.144:0/384425408 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2d8c06c7c0 0x7f2d8c06ec80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2da0007fd0 tx=0x7f2da0009040 comp rx=0 tx=0).stop 2024-09-11T23:26:32.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.689+0000 7f2db5200640 1 -- 172.21.15.144:0/384425408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2db015d3b0 msgr2=0x7f2db00af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:32.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.689+0000 7f2db5200640 1 --2- 172.21.15.144:0/384425408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2db015d3b0 0x7f2db00af520 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800d800 tx=0x7f2d9800dcc0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.689+0000 7f2db5200640 1 -- 172.21.15.144:0/384425408 shutdown_connections 2024-09-11T23:26:32.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.689+0000 7f2db5200640 1 --2- 172.21.15.144:0/384425408 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2d8c06c7c0 0x7f2d8c06ec80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.689+0000 7f2db5200640 1 --2- 172.21.15.144:0/384425408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2db0159de0 0x7f2db00afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.689+0000 7f2db5200640 1 --2- 172.21.15.144:0/384425408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2db015d3b0 0x7f2db00af520 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.689+0000 7f2db5200640 1 --2- 172.21.15.144:0/384425408 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2db00cd3b0 0x7f2db01598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.689+0000 7f2db5200640 1 -- 172.21.15.144:0/384425408 >> 172.21.15.144:0/384425408 conn(0x7f2db006bba0 msgr2=0x7f2db00b0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:32.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.689+0000 7f2db5200640 1 -- 172.21.15.144:0/384425408 shutdown_connections 2024-09-11T23:26:32.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.689+0000 7f2db5200640 1 -- 172.21.15.144:0/384425408 wait complete. 2024-09-11T23:26:32.705 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T23:26:32.705 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:26:32.859 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.860+0000 7fd147200640 1 Processor -- start 2024-09-11T23:26:32.860 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.860+0000 7fd147200640 1 -- start start 2024-09-11T23:26:32.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.861+0000 7fd147200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd14015ca40 0x7fd14015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:32.861 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.861+0000 7fd147200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd14015ceb0 0x7fd1401594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:32.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.861+0000 7fd147200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd14015d390 con 0x7fd1400d02a0 2024-09-11T23:26:32.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.861+0000 7fd147200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd14015d670 con 0x7fd14015ceb0 2024-09-11T23:26:32.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.861+0000 7fd147200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd14015d950 con 0x7fd14015ca40 2024-09-11T23:26:32.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.861+0000 7fd145200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd14015ceb0 0x7fd1401594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:32.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.861+0000 7fd145200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd14015ceb0 0x7fd1401594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40472/0 (socket says 172.21.15.144:40472) 2024-09-11T23:26:32.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.861+0000 7fd145200640 1 -- 172.21.15.144:0/3205584080 learned_addr learned my addr 172.21.15.144:0/3205584080 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:32.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.862+0000 7fd13f400640 1 --2- 172.21.15.144:0/3205584080 >> v2:172.21.15.165:3300/0 conn(0x7fd14015ca40 0x7fd14015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:32.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.862+0000 7fd145200640 1 -- 172.21.15.144:0/3205584080 >> v2:172.21.15.165:3300/0 conn(0x7fd14015ca40 msgr2=0x7fd14015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:32.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.862+0000 7fd145200640 1 --2- 172.21.15.144:0/3205584080 >> v2:172.21.15.165:3300/0 conn(0x7fd14015ca40 0x7fd14015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.862+0000 7fd145200640 1 -- 172.21.15.144:0/3205584080 >> v1:172.21.15.144:6789/0 conn(0x7fd1400d02a0 legacy=0x7fd1400d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:32.862 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.862+0000 7fd145200640 1 -- 172.21.15.144:0/3205584080 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd14015dc30 con 0x7fd14015ceb0 2024-09-11T23:26:32.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.863+0000 7fd145200640 1 --2- 172.21.15.144:0/3205584080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd14015ceb0 0x7fd1401594c0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fd1400cf320 tx=0x7fd13802c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f438ba249faa48b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:32.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.863+0000 7fd13ea00640 1 -- 172.21.15.144:0/3205584080 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd138009600 con 0x7fd14015ceb0 2024-09-11T23:26:32.863 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.863+0000 7fd13ea00640 1 -- 172.21.15.144:0/3205584080 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1380097a0 con 0x7fd14015ceb0 2024-09-11T23:26:32.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.863+0000 7fd13ea00640 1 -- 172.21.15.144:0/3205584080 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd138009b70 con 0x7fd14015ceb0 2024-09-11T23:26:32.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.863+0000 7fd147200640 1 -- 172.21.15.144:0/3205584080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd14015ceb0 msgr2=0x7fd1401594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:32.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.863+0000 7fd147200640 1 --2- 172.21.15.144:0/3205584080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd14015ceb0 0x7fd1401594c0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fd1400cf320 tx=0x7fd13802c8c0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.864+0000 7fd147200640 1 -- 172.21.15.144:0/3205584080 shutdown_connections 2024-09-11T23:26:32.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.864+0000 7fd147200640 1 --2- 172.21.15.144:0/3205584080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd14015ceb0 0x7fd1401594c0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.864+0000 7fd147200640 1 --2- 172.21.15.144:0/3205584080 >> v2:172.21.15.165:3300/0 conn(0x7fd14015ca40 0x7fd14015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.864+0000 7fd147200640 1 -- 172.21.15.144:0/3205584080 >> 172.21.15.144:0/3205584080 conn(0x7fd140062cc0 msgr2=0x7fd14006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:32.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.864+0000 7fd147200640 1 -- 172.21.15.144:0/3205584080 shutdown_connections 2024-09-11T23:26:32.864 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.864+0000 7fd147200640 1 -- 172.21.15.144:0/3205584080 wait complete. 2024-09-11T23:26:32.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.865+0000 7fd147200640 1 Processor -- start 2024-09-11T23:26:32.865 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.865+0000 7fd147200640 1 -- start start 2024-09-11T23:26:32.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.866+0000 7fd147200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1400d02a0 0x7fd1401f7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:32.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.866+0000 7fd147200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd14015ca40 0x7fd1401f8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:32.867 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.866+0000 7fd147200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd14015ceb0 0x7fd1401f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:32.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.866+0000 7fd147200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd140155d10 con 0x7fd14015ca40 2024-09-11T23:26:32.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.866+0000 7fd147200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd140155b90 con 0x7fd14015ceb0 2024-09-11T23:26:32.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.866+0000 7fd147200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd1400b4790 con 0x7fd1400d02a0 2024-09-11T23:26:32.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.866+0000 7fd13f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd14015ca40 0x7fd1401f8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:32.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.867+0000 7fd13f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd14015ca40 0x7fd1401f8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40482/0 (socket says 172.21.15.144:40482) 2024-09-11T23:26:32.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.867+0000 7fd13f400640 1 -- 172.21.15.144:0/2438013992 learned_addr learned my addr 172.21.15.144:0/2438013992 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:32.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.867+0000 7fd145200640 1 --2- 172.21.15.144:0/2438013992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd14015ceb0 0x7fd1401f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:32.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.867+0000 7fd13fe00640 1 --2- 172.21.15.144:0/2438013992 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1400d02a0 0x7fd1401f7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:32.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.867+0000 7fd13f400640 1 -- 172.21.15.144:0/2438013992 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1400d02a0 msgr2=0x7fd1401f7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:32.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.867+0000 7fd13f400640 1 --2- 172.21.15.144:0/2438013992 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1400d02a0 0x7fd1401f7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.867+0000 7fd13f400640 1 -- 172.21.15.144:0/2438013992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd14015ceb0 msgr2=0x7fd1401f5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:32.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.867+0000 7fd13f400640 1 --2- 172.21.15.144:0/2438013992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd14015ceb0 0x7fd1401f5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:32.868 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.867+0000 7fd13f400640 1 -- 172.21.15.144:0/2438013992 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd140153060 con 0x7fd14015ca40 2024-09-11T23:26:32.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.867+0000 7fd145200640 1 --2- 172.21.15.144:0/2438013992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd14015ceb0 0x7fd1401f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:32.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.867+0000 7fd13fe00640 1 --2- 172.21.15.144:0/2438013992 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1400d02a0 0x7fd1401f7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:32.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.867+0000 7fd13f400640 1 --2- 172.21.15.144:0/2438013992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd14015ca40 0x7fd1401f8190 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00d800 tx=0x7fd12c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:32.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.867+0000 7fd137e00640 1 -- 172.21.15.144:0/2438013992 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c00b6c0 con 0x7fd14015ca40 2024-09-11T23:26:32.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.867+0000 7fd137e00640 1 -- 172.21.15.144:0/2438013992 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd12c019070 con 0x7fd14015ca40 2024-09-11T23:26:32.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.867+0000 7fd147200640 1 -- 172.21.15.144:0/2438013992 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd140153340 con 0x7fd14015ca40 2024-09-11T23:26:32.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.868+0000 7fd137e00640 1 -- 172.21.15.144:0/2438013992 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c00ba80 con 0x7fd14015ca40 2024-09-11T23:26:32.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.868+0000 7fd147200640 1 -- 172.21.15.144:0/2438013992 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd140153900 con 0x7fd14015ca40 2024-09-11T23:26:32.869 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.869+0000 7fd147200640 1 -- 172.21.15.144:0/2438013992 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1400d0680 con 0x7fd14015ca40 2024-09-11T23:26:32.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.870+0000 7fd137e00640 1 -- 172.21.15.144:0/2438013992 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7fd12c00bc20 con 0x7fd14015ca40 2024-09-11T23:26:32.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.870+0000 7fd137e00640 1 --2- 172.21.15.144:0/2438013992 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd12006c7c0 0x7fd12006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:32.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.871+0000 7fd137e00640 1 -- 172.21.15.144:0/2438013992 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7fd12c089a80 con 0x7fd14015ca40 2024-09-11T23:26:32.870 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.871+0000 7fd13fe00640 1 --2- 172.21.15.144:0/2438013992 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd12006c7c0 0x7fd12006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:32.871 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.872+0000 7fd13fe00640 1 --2- 172.21.15.144:0/2438013992 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd12006c7c0 0x7fd12006ec80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd1400ce9f0 tx=0x7fd130009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:32.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:32.875+0000 7fd137e00640 1 -- 172.21.15.144:0/2438013992 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd12c05a030 con 0x7fd14015ca40 2024-09-11T23:26:33.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.085+0000 7fd147200640 1 -- 172.21.15.144:0/2438013992 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd140153d00 con 0x7fd14015ca40 2024-09-11T23:26:33.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.085+0000 7fd137e00640 1 -- 172.21.15.144:0/2438013992 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+5242 (secure 0 0 0) 0x7fd12c059930 con 0x7fd14015ca40 2024-09-11T23:26:33.085 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:33.085 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":119,"btime":"2024-09-11T23:26:32:684467+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/4202069031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4202069031},{"type":"v1","addr":"172.21.15.144:6801","nonce":4202069031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":7331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1262024638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1262024638},{"type":"v1","addr":"172.21.15.144:6835","nonce":1262024638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8407,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2678086616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2678086616},{"type":"v1","addr":"172.21.15.165:6834","nonce":2678086616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:26:29.055590+0000","modified":"2024-09-11T23:26:32.086872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9015":{"gid":9015,"name":"b","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/862543799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":862543799},{"type":"v1","addr":"172.21.15.165:6835","nonce":862543799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9015,"qdb_cluster":[9015]},"id":13}]} 2024-09-11T23:26:33.086 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 119 2024-09-11T23:26:33.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.088+0000 7fd147200640 1 -- 172.21.15.144:0/2438013992 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd12006c7c0 msgr2=0x7fd12006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:33.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.088+0000 7fd147200640 1 --2- 172.21.15.144:0/2438013992 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd12006c7c0 0x7fd12006ec80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd1400ce9f0 tx=0x7fd130009040 comp rx=0 tx=0).stop 2024-09-11T23:26:33.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.088+0000 7fd147200640 1 -- 172.21.15.144:0/2438013992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd14015ca40 msgr2=0x7fd1401f8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:33.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.088+0000 7fd147200640 1 --2- 172.21.15.144:0/2438013992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd14015ca40 0x7fd1401f8190 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00d800 tx=0x7fd12c00dcc0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.088+0000 7fd147200640 1 -- 172.21.15.144:0/2438013992 shutdown_connections 2024-09-11T23:26:33.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.088+0000 7fd147200640 1 --2- 172.21.15.144:0/2438013992 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd12006c7c0 0x7fd12006ec80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.088+0000 7fd147200640 1 --2- 172.21.15.144:0/2438013992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd14015ceb0 0x7fd1401f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.088+0000 7fd147200640 1 --2- 172.21.15.144:0/2438013992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd14015ca40 0x7fd1401f8190 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.088+0000 7fd147200640 1 --2- 172.21.15.144:0/2438013992 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1400d02a0 0x7fd1401f7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.088+0000 7fd147200640 1 -- 172.21.15.144:0/2438013992 >> 172.21.15.144:0/2438013992 conn(0x7fd140062cc0 msgr2=0x7fd1400b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:33.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.088+0000 7fd147200640 1 -- 172.21.15.144:0/2438013992 shutdown_connections 2024-09-11T23:26:33.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.088+0000 7fd147200640 1 -- 172.21.15.144:0/2438013992 wait complete. 2024-09-11T23:26:33.104 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:26:33.257 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.258+0000 7f00e1200640 1 Processor -- start 2024-09-11T23:26:33.258 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.258+0000 7f00e1200640 1 -- start start 2024-09-11T23:26:33.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.259+0000 7f00e1200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f00dc0ce480 0x7f00dc0ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:33.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.259+0000 7f00e1200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00dc0b1dc0 0x7f00dc0b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:33.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.259+0000 7f00e1200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00dc072100 con 0x7f00dc15a0a0 2024-09-11T23:26:33.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.259+0000 7f00e1200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f00dc0b2770 con 0x7f00dc0ce480 2024-09-11T23:26:33.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.259+0000 7f00e1200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f00dc073890 con 0x7f00dc0b1dc0 2024-09-11T23:26:33.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.259+0000 7f00db400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f00dc15a0a0 0x7f00dc073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:37778/0 (socket says 172.21.15.144:37778) 2024-09-11T23:26:33.259 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.259+0000 7f00db400640 1 -- 172.21.15.144:0/3679424306 learned_addr learned my addr 172.21.15.144:0/3679424306 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:33.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.259+0000 7f00d2a00640 1 --2- 172.21.15.144:0/3679424306 >> v2:172.21.15.144:3300/0 conn(0x7f00dc0ce480 0x7f00dc0ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:33.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.260+0000 7f00dbe00640 1 --2- 172.21.15.144:0/3679424306 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00dc0b1dc0 0x7f00dc0b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:33.260 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.260+0000 7f00d2a00640 1 -- 172.21.15.144:0/3679424306 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00dc0b1dc0 msgr2=0x7f00dc0b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:33.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.260+0000 7f00d2a00640 1 --2- 172.21.15.144:0/3679424306 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00dc0b1dc0 0x7f00dc0b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.260+0000 7f00d2a00640 1 -- 172.21.15.144:0/3679424306 >> v1:172.21.15.144:6789/0 conn(0x7f00dc15a0a0 legacy=0x7f00dc073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:33.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.260+0000 7f00d2a00640 1 -- 172.21.15.144:0/3679424306 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00dc0723c0 con 0x7f00dc0ce480 2024-09-11T23:26:33.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.261+0000 7f00d2a00640 1 --2- 172.21.15.144:0/3679424306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00dc0ce480 0x7f00dc0ce910 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f00c40097a0 tx=0x7f00c402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec641e01906b6ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:33.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.261+0000 7f00daa00640 1 -- 172.21.15.144:0/3679424306 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c4037070 con 0x7f00dc0ce480 2024-09-11T23:26:33.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.261+0000 7f00daa00640 1 -- 172.21.15.144:0/3679424306 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00c4032440 con 0x7f00dc0ce480 2024-09-11T23:26:33.261 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.261+0000 7f00daa00640 1 -- 172.21.15.144:0/3679424306 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c4032810 con 0x7f00dc0ce480 2024-09-11T23:26:33.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.262+0000 7f00e1200640 1 -- 172.21.15.144:0/3679424306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00dc0ce480 msgr2=0x7f00dc0ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:33.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.262+0000 7f00e1200640 1 --2- 172.21.15.144:0/3679424306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00dc0ce480 0x7f00dc0ce910 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f00c40097a0 tx=0x7f00c402a180 comp rx=0 tx=0).stop 2024-09-11T23:26:33.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.262+0000 7f00e1200640 1 -- 172.21.15.144:0/3679424306 shutdown_connections 2024-09-11T23:26:33.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.262+0000 7f00e1200640 1 --2- 172.21.15.144:0/3679424306 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00dc0b1dc0 0x7f00dc0b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.262+0000 7f00e1200640 1 --2- 172.21.15.144:0/3679424306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00dc0ce480 0x7f00dc0ce910 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.262+0000 7f00e1200640 1 -- 172.21.15.144:0/3679424306 >> 172.21.15.144:0/3679424306 conn(0x7f00dc06e910 msgr2=0x7f00dc06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:33.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.262+0000 7f00e1200640 1 -- 172.21.15.144:0/3679424306 shutdown_connections 2024-09-11T23:26:33.262 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.262+0000 7f00e1200640 1 -- 172.21.15.144:0/3679424306 wait complete. 2024-09-11T23:26:33.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.263+0000 7f00e1200640 1 Processor -- start 2024-09-11T23:26:33.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.263+0000 7f00e1200640 1 -- start start 2024-09-11T23:26:33.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.264+0000 7f00e1200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00dc0b1dc0 0x7f00dc15e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:33.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.264+0000 7f00e1200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00dc0ce480 0x7f00dc153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:33.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.264+0000 7f00e1200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00dc15a0a0 0x7f00dc1e7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:33.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.264+0000 7f00e1200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f00dc0cf240 con 0x7f00dc0ce480 2024-09-11T23:26:33.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.264+0000 7f00e1200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f00dc072980 con 0x7f00dc15a0a0 2024-09-11T23:26:33.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.264+0000 7f00e1200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f00dc0cf3c0 con 0x7f00dc0b1dc0 2024-09-11T23:26:33.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.265+0000 7f00d2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00dc0ce480 0x7f00dc153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:33.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.265+0000 7f00d2a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00dc0ce480 0x7f00dc153a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40498/0 (socket says 172.21.15.144:40498) 2024-09-11T23:26:33.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.265+0000 7f00d2a00640 1 -- 172.21.15.144:0/4065802226 learned_addr learned my addr 172.21.15.144:0/4065802226 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:33.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.265+0000 7f00db400640 1 --2- 172.21.15.144:0/4065802226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00dc0b1dc0 0x7f00dc15e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:33.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.265+0000 7f00dbe00640 1 --2- 172.21.15.144:0/4065802226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00dc15a0a0 0x7f00dc1e7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:33.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.265+0000 7f00d2a00640 1 -- 172.21.15.144:0/4065802226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00dc0b1dc0 msgr2=0x7f00dc15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:33.265 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.265+0000 7f00d2a00640 1 --2- 172.21.15.144:0/4065802226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00dc0b1dc0 0x7f00dc15e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.265+0000 7f00d2a00640 1 -- 172.21.15.144:0/4065802226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00dc15a0a0 msgr2=0x7f00dc1e7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:33.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.265+0000 7f00d2a00640 1 --2- 172.21.15.144:0/4065802226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00dc15a0a0 0x7f00dc1e7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.265+0000 7f00d2a00640 1 -- 172.21.15.144:0/4065802226 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00dc0af590 con 0x7f00dc0ce480 2024-09-11T23:26:33.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.265+0000 7f00d2a00640 1 --2- 172.21.15.144:0/4065802226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00dc0ce480 0x7f00dc153a80 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f00c40098c0 tx=0x7f00c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:33.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.265+0000 7f00d3e00640 1 -- 172.21.15.144:0/4065802226 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c4037040 con 0x7f00dc0ce480 2024-09-11T23:26:33.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.265+0000 7f00d3e00640 1 -- 172.21.15.144:0/4065802226 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00c4030500 con 0x7f00dc0ce480 2024-09-11T23:26:33.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.265+0000 7f00d3e00640 1 -- 172.21.15.144:0/4065802226 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c40308d0 con 0x7f00dc0ce480 2024-09-11T23:26:33.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.265+0000 7f00e1200640 1 -- 172.21.15.144:0/4065802226 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00dc15f040 con 0x7f00dc0ce480 2024-09-11T23:26:33.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.266+0000 7f00e1200640 1 -- 172.21.15.144:0/4065802226 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00dc15f600 con 0x7f00dc0ce480 2024-09-11T23:26:33.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.267+0000 7f00e1200640 1 -- 172.21.15.144:0/4065802226 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00dc15b6c0 con 0x7f00dc0ce480 2024-09-11T23:26:33.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.268+0000 7f00d3e00640 1 -- 172.21.15.144:0/4065802226 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f00c4044020 con 0x7f00dc0ce480 2024-09-11T23:26:33.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.269+0000 7f00d3e00640 1 --2- 172.21.15.144:0/4065802226 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f00b806c7c0 0x7f00b806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:33.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.269+0000 7f00d3e00640 1 -- 172.21.15.144:0/4065802226 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f00c40a9880 con 0x7f00dc0ce480 2024-09-11T23:26:33.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.269+0000 7f00db400640 1 --2- 172.21.15.144:0/4065802226 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f00b806c7c0 0x7f00b806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:33.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.270+0000 7f00db400640 1 --2- 172.21.15.144:0/4065802226 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f00b806c7c0 0x7f00b806ec80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f00cc000f60 tx=0x7f00cc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:33.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.273+0000 7f00d3e00640 1 -- 172.21.15.144:0/4065802226 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f00dc15b6c0 con 0x7f00dc0ce480 2024-09-11T23:26:33.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.451+0000 7f00e1200640 1 -- 172.21.15.144:0/4065802226 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00dc0b2230 con 0x7f00dc0ce480 2024-09-11T23:26:33.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.453+0000 7f00d3e00640 1 -- 172.21.15.144:0/4065802226 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) ==== 74+0+16767 (secure 0 0 0) 0x7f00c4079e30 con 0x7f00dc0ce480 2024-09-11T23:26:33.453 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:33.453 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":166,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:26:30.661485+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:26:26.828432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-11T23:26:28.054488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:26:33.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.455+0000 7f00e1200640 1 -- 172.21.15.144:0/4065802226 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f00b806c7c0 msgr2=0x7f00b806ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:33.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.455+0000 7f00e1200640 1 --2- 172.21.15.144:0/4065802226 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f00b806c7c0 0x7f00b806ec80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f00cc000f60 tx=0x7f00cc009040 comp rx=0 tx=0).stop 2024-09-11T23:26:33.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.455+0000 7f00e1200640 1 -- 172.21.15.144:0/4065802226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00dc0ce480 msgr2=0x7f00dc153a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:33.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.455+0000 7f00e1200640 1 --2- 172.21.15.144:0/4065802226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00dc0ce480 0x7f00dc153a80 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f00c40098c0 tx=0x7f00c40046c0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.455+0000 7f00e1200640 1 -- 172.21.15.144:0/4065802226 shutdown_connections 2024-09-11T23:26:33.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.455+0000 7f00e1200640 1 --2- 172.21.15.144:0/4065802226 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f00b806c7c0 0x7f00b806ec80 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.455+0000 7f00e1200640 1 --2- 172.21.15.144:0/4065802226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00dc15a0a0 0x7f00dc1e7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.455+0000 7f00e1200640 1 --2- 172.21.15.144:0/4065802226 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00dc0ce480 0x7f00dc153a80 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.455+0000 7f00e1200640 1 --2- 172.21.15.144:0/4065802226 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f00dc0b1dc0 0x7f00dc15e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.455+0000 7f00e1200640 1 -- 172.21.15.144:0/4065802226 >> 172.21.15.144:0/4065802226 conn(0x7f00dc06e910 msgr2=0x7f00dc0b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:33.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.455+0000 7f00e1200640 1 -- 172.21.15.144:0/4065802226 shutdown_connections 2024-09-11T23:26:33.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.455+0000 7f00e1200640 1 -- 172.21.15.144:0/4065802226 wait complete. 2024-09-11T23:26:33.472 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:26:33.472 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:26:33.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.627+0000 7fad24000640 1 Processor -- start 2024-09-11T23:26:33.627 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.627+0000 7fad24000640 1 -- start start 2024-09-11T23:26:33.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.628+0000 7fad24000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad1c15c180 0x7fad1c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:33.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.628+0000 7fad24000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad1c0ce230 0x7fad1c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:33.628 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.628+0000 7fad24000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad1c0ce740 con 0x7fad1c0cf5b0 2024-09-11T23:26:33.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.628+0000 7fad24000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fad1c072640 con 0x7fad1c0ce230 2024-09-11T23:26:33.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.628+0000 7fad24000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fad1c072920 con 0x7fad1c15c180 2024-09-11T23:26:33.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.629+0000 7fad20c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad1c0ce230 0x7fad1c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:33.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.629+0000 7fad20c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad1c0ce230 0x7fad1c0cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40500/0 (socket says 172.21.15.144:40500) 2024-09-11T23:26:33.629 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.629+0000 7fad20c00640 1 -- 172.21.15.144:0/3653684857 learned_addr learned my addr 172.21.15.144:0/3653684857 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:33.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.629+0000 7fad21600640 1 --2- 172.21.15.144:0/3653684857 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad1c15c180 0x7fad1c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:33.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.629+0000 7fad20c00640 1 -- 172.21.15.144:0/3653684857 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad1c15c180 msgr2=0x7fad1c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:33.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.629+0000 7fad20c00640 1 --2- 172.21.15.144:0/3653684857 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad1c15c180 0x7fad1c0cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.629+0000 7fad20c00640 1 -- 172.21.15.144:0/3653684857 >> v1:172.21.15.165:6789/0 conn(0x7fad1c0cf5b0 legacy=0x7fad1c073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:33.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.629+0000 7fad20c00640 1 -- 172.21.15.144:0/3653684857 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c072c00 con 0x7fad1c0ce230 2024-09-11T23:26:33.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.629+0000 7fad21600640 1 --2- 172.21.15.144:0/3653684857 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad1c15c180 0x7fad1c0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:33.630 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.630+0000 7fad20c00640 1 --2- 172.21.15.144:0/3653684857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1c0ce230 0x7fad1c0cf070 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fad08009870 tx=0x7fad0802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7209bc1df24b93c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:33.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.630+0000 7fad1be00640 1 -- 172.21.15.144:0/3653684857 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08037070 con 0x7fad1c0ce230 2024-09-11T23:26:33.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.631+0000 7fad1be00640 1 -- 172.21.15.144:0/3653684857 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad08032440 con 0x7fad1c0ce230 2024-09-11T23:26:33.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.631+0000 7fad1be00640 1 -- 172.21.15.144:0/3653684857 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08032810 con 0x7fad1c0ce230 2024-09-11T23:26:33.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.631+0000 7fad24000640 1 -- 172.21.15.144:0/3653684857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1c0ce230 msgr2=0x7fad1c0cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:33.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.631+0000 7fad24000640 1 --2- 172.21.15.144:0/3653684857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1c0ce230 0x7fad1c0cf070 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fad08009870 tx=0x7fad0802a180 comp rx=0 tx=0).stop 2024-09-11T23:26:33.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.631+0000 7fad24000640 1 -- 172.21.15.144:0/3653684857 shutdown_connections 2024-09-11T23:26:33.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.631+0000 7fad24000640 1 --2- 172.21.15.144:0/3653684857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1c0ce230 0x7fad1c0cf070 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.631+0000 7fad24000640 1 --2- 172.21.15.144:0/3653684857 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad1c15c180 0x7fad1c0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.631+0000 7fad24000640 1 -- 172.21.15.144:0/3653684857 >> 172.21.15.144:0/3653684857 conn(0x7fad1c062cc0 msgr2=0x7fad1c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:33.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.631+0000 7fad24000640 1 -- 172.21.15.144:0/3653684857 shutdown_connections 2024-09-11T23:26:33.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.631+0000 7fad24000640 1 -- 172.21.15.144:0/3653684857 wait complete. 2024-09-11T23:26:33.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.633+0000 7fad24000640 1 Processor -- start 2024-09-11T23:26:33.632 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.633+0000 7fad24000640 1 -- start start 2024-09-11T23:26:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.634+0000 7fad24000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1c0ce230 0x7fad1c141440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.634+0000 7fad24000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad1c0cf5b0 0x7fad1c1e8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.634+0000 7fad24000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad1c15c180 0x7fad1c141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.634+0000 7fad24000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c15c560 con 0x7fad1c0ce230 2024-09-11T23:26:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.634+0000 7fad24000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c0722f0 con 0x7fad1c15c180 2024-09-11T23:26:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.634+0000 7fad24000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fad1c15c6e0 con 0x7fad1c0cf5b0 2024-09-11T23:26:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.634+0000 7fad21600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1c0ce230 0x7fad1c141440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.634+0000 7fad21600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1c0ce230 0x7fad1c141440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40508/0 (socket says 172.21.15.144:40508) 2024-09-11T23:26:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.634+0000 7fad21600640 1 -- 172.21.15.144:0/3818498527 learned_addr learned my addr 172.21.15.144:0/3818498527 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.634+0000 7fad20c00640 1 --2- 172.21.15.144:0/3818498527 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad1c0cf5b0 0x7fad1c1e8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.634+0000 7fad21600640 1 -- 172.21.15.144:0/3818498527 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad1c0cf5b0 msgr2=0x7fad1c1e8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.634+0000 7fad22000640 1 --2- 172.21.15.144:0/3818498527 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad1c15c180 0x7fad1c141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:33.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.634+0000 7fad21600640 1 --2- 172.21.15.144:0/3818498527 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad1c0cf5b0 0x7fad1c1e8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.634+0000 7fad21600640 1 -- 172.21.15.144:0/3818498527 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad1c15c180 msgr2=0x7fad1c141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.635+0000 7fad21600640 1 --2- 172.21.15.144:0/3818498527 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad1c15c180 0x7fad1c141ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.635+0000 7fad21600640 1 -- 172.21.15.144:0/3818498527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c1e7070 con 0x7fad1c0ce230 2024-09-11T23:26:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.635+0000 7fad20c00640 1 --2- 172.21.15.144:0/3818498527 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad1c0cf5b0 0x7fad1c1e8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.635+0000 7fad22000640 1 --2- 172.21.15.144:0/3818498527 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad1c15c180 0x7fad1c141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.635+0000 7fad21600640 1 --2- 172.21.15.144:0/3818498527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1c0ce230 0x7fad1c141440 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fad1000cf60 tx=0x7fad1000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.635+0000 7fad19600640 1 -- 172.21.15.144:0/3818498527 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1001a070 con 0x7fad1c0ce230 2024-09-11T23:26:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.635+0000 7fad19600640 1 -- 172.21.15.144:0/3818498527 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad1000d840 con 0x7fad1c0ce230 2024-09-11T23:26:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.635+0000 7fad19600640 1 -- 172.21.15.144:0/3818498527 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1000dc10 con 0x7fad1c0ce230 2024-09-11T23:26:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.635+0000 7fad24000640 1 -- 172.21.15.144:0/3818498527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1c1e7350 con 0x7fad1c0ce230 2024-09-11T23:26:33.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.635+0000 7fad24000640 1 -- 172.21.15.144:0/3818498527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad1c1e7910 con 0x7fad1c0ce230 2024-09-11T23:26:33.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.636+0000 7fad24000640 1 -- 172.21.15.144:0/3818498527 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad1c0cf070 con 0x7fad1c0ce230 2024-09-11T23:26:33.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.637+0000 7fad19600640 1 -- 172.21.15.144:0/3818498527 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7fad1001d070 con 0x7fad1c0ce230 2024-09-11T23:26:33.637 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.638+0000 7fad19600640 1 --2- 172.21.15.144:0/3818498527 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7facfc06c7f0 0x7facfc06ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:33.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.638+0000 7fad19600640 1 -- 172.21.15.144:0/3818498527 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7fad10089df0 con 0x7fad1c0ce230 2024-09-11T23:26:33.638 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.638+0000 7fad20c00640 1 --2- 172.21.15.144:0/3818498527 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7facfc06c7f0 0x7facfc06ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:33.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.639+0000 7fad20c00640 1 --2- 172.21.15.144:0/3818498527 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7facfc06c7f0 0x7facfc06ecb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fad08034000 tx=0x7fad0802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:33.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.643+0000 7fad19600640 1 -- 172.21.15.144:0/3818498527 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad10059d50 con 0x7fad1c0ce230 2024-09-11T23:26:33.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.814+0000 7fad24000640 1 -- 172.21.15.144:0/3818498527 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad1c0b0bf0 con 0x7facfc06c7f0 2024-09-11T23:26:33.821 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.822+0000 7fad19600640 1 -- 172.21.15.144:0/3818498527 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252459 (secure 0 0 0) 0x7fad1c0b0bf0 con 0x7facfc06c7f0 2024-09-11T23:26:33.824 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:33.825 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:26:33.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.825+0000 7fad24000640 1 -- 172.21.15.144:0/3818498527 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7facfc06c7f0 msgr2=0x7facfc06ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:33.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.825+0000 7fad24000640 1 --2- 172.21.15.144:0/3818498527 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7facfc06c7f0 0x7facfc06ecb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fad08034000 tx=0x7fad0802e000 comp rx=0 tx=0).stop 2024-09-11T23:26:33.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.825+0000 7fad24000640 1 -- 172.21.15.144:0/3818498527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1c0ce230 msgr2=0x7fad1c141440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:33.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.825+0000 7fad24000640 1 --2- 172.21.15.144:0/3818498527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1c0ce230 0x7fad1c141440 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fad1000cf60 tx=0x7fad1000cf90 comp rx=0 tx=0).stop 2024-09-11T23:26:33.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.825+0000 7fad24000640 1 -- 172.21.15.144:0/3818498527 shutdown_connections 2024-09-11T23:26:33.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.825+0000 7fad24000640 1 --2- 172.21.15.144:0/3818498527 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7facfc06c7f0 0x7facfc06ecb0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.825+0000 7fad24000640 1 --2- 172.21.15.144:0/3818498527 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad1c15c180 0x7fad1c141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.825+0000 7fad24000640 1 --2- 172.21.15.144:0/3818498527 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad1c0cf5b0 0x7fad1c1e8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.825+0000 7fad24000640 1 --2- 172.21.15.144:0/3818498527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1c0ce230 0x7fad1c141440 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:33.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.825+0000 7fad24000640 1 -- 172.21.15.144:0/3818498527 >> 172.21.15.144:0/3818498527 conn(0x7fad1c062cc0 msgr2=0x7fad1c0cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:33.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.825+0000 7fad24000640 1 -- 172.21.15.144:0/3818498527 shutdown_connections 2024-09-11T23:26:33.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:33.825+0000 7fad24000640 1 -- 172.21.15.144:0/3818498527 wait complete. 2024-09-11T23:26:33.841 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-09-11T23:26:32.774284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":271096,"kb_used_data":17416,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703624,"statfs":{"total":773094113280,"available":772816510976,"internally_reserved":0,"allocated":17833984,"data_stored":8497628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.137488"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.679024+0000","last_change":"2024-09-11T23:26:29.673345+0000","last_active":"2024-09-11T23:26:29.679024+0000","last_peered":"2024-09-11T23:26:29.679024+0000","last_clean":"2024-09-11T23:26:29.679024+0000","last_became_active":"2024-09-11T23:26:29.672025+0000","last_became_peered":"2024-09-11T23:26:29.672025+0000","last_unstale":"2024-09-11T23:26:29.679024+0000","last_undegraded":"2024-09-11T23:26:29.679024+0000","last_fullsized":"2024-09-11T23:26:29.679024+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:46.467716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.668391+0000","last_change":"2024-09-11T23:26:29.668791+0000","last_active":"2024-09-11T23:26:30.668391+0000","last_peered":"2024-09-11T23:26:30.668391+0000","last_clean":"2024-09-11T23:26:30.668391+0000","last_became_active":"2024-09-11T23:26:29.668383+0000","last_became_peered":"2024-09-11T23:26:29.668383+0000","last_unstale":"2024-09-11T23:26:30.668391+0000","last_undegraded":"2024-09-11T23:26:30.668391+0000","last_fullsized":"2024-09-11T23:26:30.668391+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:49.604844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.675083+0000","last_change":"2024-09-11T23:26:29.668702+0000","last_active":"2024-09-11T23:26:29.675083+0000","last_peered":"2024-09-11T23:26:29.675083+0000","last_clean":"2024-09-11T23:26:29.675083+0000","last_became_active":"2024-09-11T23:26:29.667948+0000","last_became_peered":"2024-09-11T23:26:29.667948+0000","last_unstale":"2024-09-11T23:26:29.675083+0000","last_undegraded":"2024-09-11T23:26:29.675083+0000","last_fullsized":"2024-09-11T23:26:29.675083+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:05.062170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.681329+0000","last_change":"2024-09-11T23:26:29.669698+0000","last_active":"2024-09-11T23:26:30.681329+0000","last_peered":"2024-09-11T23:26:30.681329+0000","last_clean":"2024-09-11T23:26:30.681329+0000","last_became_active":"2024-09-11T23:26:29.669387+0000","last_became_peered":"2024-09-11T23:26:29.669387+0000","last_unstale":"2024-09-11T23:26:30.681329+0000","last_undegraded":"2024-09-11T23:26:30.681329+0000","last_fullsized":"2024-09-11T23:26:30.681329+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:42.382145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.684798+0000","last_change":"2024-09-11T23:26:29.681587+0000","last_active":"2024-09-11T23:26:29.684798+0000","last_peered":"2024-09-11T23:26:29.684798+0000","last_clean":"2024-09-11T23:26:29.684798+0000","last_became_active":"2024-09-11T23:26:29.679732+0000","last_became_peered":"2024-09-11T23:26:29.679732+0000","last_unstale":"2024-09-11T23:26:29.684798+0000","last_undegraded":"2024-09-11T23:26:29.684798+0000","last_fullsized":"2024-09-11T23:26:29.684798+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:49.509358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.677453+0000","last_change":"2024-09-11T23:26:29.673900+0000","last_active":"2024-09-11T23:26:29.677453+0000","last_peered":"2024-09-11T23:26:29.677453+0000","last_clean":"2024-09-11T23:26:29.677453+0000","last_became_active":"2024-09-11T23:26:29.673216+0000","last_became_peered":"2024-09-11T23:26:29.673216+0000","last_unstale":"2024-09-11T23:26:29.677453+0000","last_undegraded":"2024-09-11T23:26:29.677453+0000","last_fullsized":"2024-09-11T23:26:29.677453+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:37.293148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.684340+0000","last_change":"2024-09-11T23:26:29.677926+0000","last_active":"2024-09-11T23:26:29.684340+0000","last_peered":"2024-09-11T23:26:29.684340+0000","last_clean":"2024-09-11T23:26:29.684340+0000","last_became_active":"2024-09-11T23:26:29.677661+0000","last_became_peered":"2024-09-11T23:26:29.677661+0000","last_unstale":"2024-09-11T23:26:29.684340+0000","last_undegraded":"2024-09-11T23:26:29.684340+0000","last_fullsized":"2024-09-11T23:26:29.684340+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:17.001365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.679351+0000","last_change":"2024-09-11T23:26:29.674309+0000","last_active":"2024-09-11T23:26:29.679351+0000","last_peered":"2024-09-11T23:26:29.679351+0000","last_clean":"2024-09-11T23:26:29.679351+0000","last_became_active":"2024-09-11T23:26:29.674060+0000","last_became_peered":"2024-09-11T23:26:29.674060+0000","last_unstale":"2024-09-11T23:26:29.679351+0000","last_undegraded":"2024-09-11T23:26:29.679351+0000","last_fullsized":"2024-09-11T23:26:29.679351+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:41.026223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667942+0000","last_change":"2024-09-11T23:26:29.670671+0000","last_active":"2024-09-11T23:26:30.667942+0000","last_peered":"2024-09-11T23:26:30.667942+0000","last_clean":"2024-09-11T23:26:30.667942+0000","last_became_active":"2024-09-11T23:26:29.670409+0000","last_became_peered":"2024-09-11T23:26:29.670409+0000","last_unstale":"2024-09-11T23:26:30.667942+0000","last_undegraded":"2024-09-11T23:26:30.667942+0000","last_fullsized":"2024-09-11T23:26:30.667942+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:41.480878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665520+0000","last_change":"2024-09-11T23:26:29.680364+0000","last_active":"2024-09-11T23:26:30.665520+0000","last_peered":"2024-09-11T23:26:30.665520+0000","last_clean":"2024-09-11T23:26:30.665520+0000","last_became_active":"2024-09-11T23:26:29.679519+0000","last_became_peered":"2024-09-11T23:26:29.679519+0000","last_unstale":"2024-09-11T23:26:30.665520+0000","last_undegraded":"2024-09-11T23:26:30.665520+0000","last_fullsized":"2024-09-11T23:26:30.665520+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:09.192446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.682171+0000","last_change":"2024-09-11T23:26:29.676911+0000","last_active":"2024-09-11T23:26:29.682171+0000","last_peered":"2024-09-11T23:26:29.682171+0000","last_clean":"2024-09-11T23:26:29.682171+0000","last_became_active":"2024-09-11T23:26:29.676636+0000","last_became_peered":"2024-09-11T23:26:29.676636+0000","last_unstale":"2024-09-11T23:26:29.682171+0000","last_undegraded":"2024-09-11T23:26:29.682171+0000","last_fullsized":"2024-09-11T23:26:29.682171+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:19.870077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.683800+0000","last_change":"2024-09-11T23:26:29.673260+0000","last_active":"2024-09-11T23:26:30.683800+0000","last_peered":"2024-09-11T23:26:30.683800+0000","last_clean":"2024-09-11T23:26:30.683800+0000","last_became_active":"2024-09-11T23:26:29.672066+0000","last_became_peered":"2024-09-11T23:26:29.672066+0000","last_unstale":"2024-09-11T23:26:30.683800+0000","last_undegraded":"2024-09-11T23:26:30.683800+0000","last_fullsized":"2024-09-11T23:26:30.683800+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:55.015140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.683944+0000","last_change":"2024-09-11T23:26:29.676127+0000","last_active":"2024-09-11T23:26:30.683944+0000","last_peered":"2024-09-11T23:26:30.683944+0000","last_clean":"2024-09-11T23:26:30.683944+0000","last_became_active":"2024-09-11T23:26:29.675635+0000","last_became_peered":"2024-09-11T23:26:29.675635+0000","last_unstale":"2024-09-11T23:26:30.683944+0000","last_undegraded":"2024-09-11T23:26:30.683944+0000","last_fullsized":"2024-09-11T23:26:30.683944+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:41.480878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.672191+0000","last_change":"2024-09-11T23:26:29.667311+0000","last_active":"2024-09-11T23:26:29.672191+0000","last_peered":"2024-09-11T23:26:29.672191+0000","last_clean":"2024-09-11T23:26:29.672191+0000","last_became_active":"2024-09-11T23:26:29.667006+0000","last_became_peered":"2024-09-11T23:26:29.667006+0000","last_unstale":"2024-09-11T23:26:29.672191+0000","last_undegraded":"2024-09-11T23:26:29.672191+0000","last_fullsized":"2024-09-11T23:26:29.672191+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:02.147371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.674854+0000","last_change":"2024-09-11T23:26:29.669609+0000","last_active":"2024-09-11T23:26:29.674854+0000","last_peered":"2024-09-11T23:26:29.674854+0000","last_clean":"2024-09-11T23:26:29.674854+0000","last_became_active":"2024-09-11T23:26:29.669316+0000","last_became_peered":"2024-09-11T23:26:29.669316+0000","last_unstale":"2024-09-11T23:26:29.674854+0000","last_undegraded":"2024-09-11T23:26:29.674854+0000","last_fullsized":"2024-09-11T23:26:29.674854+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:25.772465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665080+0000","last_change":"2024-09-11T23:26:29.683203+0000","last_active":"2024-09-11T23:26:30.665080+0000","last_peered":"2024-09-11T23:26:30.665080+0000","last_clean":"2024-09-11T23:26:30.665080+0000","last_became_active":"2024-09-11T23:26:29.682290+0000","last_became_peered":"2024-09-11T23:26:29.682290+0000","last_unstale":"2024-09-11T23:26:30.665080+0000","last_undegraded":"2024-09-11T23:26:30.665080+0000","last_fullsized":"2024-09-11T23:26:30.665080+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:59.642346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.671836+0000","last_change":"2024-09-11T23:26:29.665102+0000","last_active":"2024-09-11T23:26:29.671836+0000","last_peered":"2024-09-11T23:26:29.671836+0000","last_clean":"2024-09-11T23:26:29.671836+0000","last_became_active":"2024-09-11T23:26:29.664710+0000","last_became_peered":"2024-09-11T23:26:29.664710+0000","last_unstale":"2024-09-11T23:26:29.671836+0000","last_undegraded":"2024-09-11T23:26:29.671836+0000","last_fullsized":"2024-09-11T23:26:29.671836+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:47.496133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665635+0000","last_change":"2024-09-11T23:26:29.680143+0000","last_active":"2024-09-11T23:26:30.665635+0000","last_peered":"2024-09-11T23:26:30.665635+0000","last_clean":"2024-09-11T23:26:30.665635+0000","last_became_active":"2024-09-11T23:26:29.679858+0000","last_became_peered":"2024-09-11T23:26:29.679858+0000","last_unstale":"2024-09-11T23:26:30.665635+0000","last_undegraded":"2024-09-11T23:26:30.665635+0000","last_fullsized":"2024-09-11T23:26:30.665635+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:30.735337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665650+0000","last_change":"2024-09-11T23:26:29.676602+0000","last_active":"2024-09-11T23:26:30.665650+0000","last_peered":"2024-09-11T23:26:30.665650+0000","last_clean":"2024-09-11T23:26:30.665650+0000","last_became_active":"2024-09-11T23:26:29.675499+0000","last_became_peered":"2024-09-11T23:26:29.675499+0000","last_unstale":"2024-09-11T23:26:30.665650+0000","last_undegraded":"2024-09-11T23:26:30.665650+0000","last_fullsized":"2024-09-11T23:26:30.665650+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:54.567375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.677126+0000","last_change":"2024-09-11T23:26:29.674143+0000","last_active":"2024-09-11T23:26:29.677126+0000","last_peered":"2024-09-11T23:26:29.677126+0000","last_clean":"2024-09-11T23:26:29.677126+0000","last_became_active":"2024-09-11T23:26:29.673850+0000","last_became_peered":"2024-09-11T23:26:29.673850+0000","last_unstale":"2024-09-11T23:26:29.677126+0000","last_undegraded":"2024-09-11T23:26:29.677126+0000","last_fullsized":"2024-09-11T23:26:29.677126+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:17.813096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.680929+0000","last_change":"2024-09-11T23:26:29.677443+0000","last_active":"2024-09-11T23:26:30.680929+0000","last_peered":"2024-09-11T23:26:30.680929+0000","last_clean":"2024-09-11T23:26:30.680929+0000","last_became_active":"2024-09-11T23:26:29.676823+0000","last_became_peered":"2024-09-11T23:26:29.676823+0000","last_unstale":"2024-09-11T23:26:30.680929+0000","last_undegraded":"2024-09-11T23:26:30.680929+0000","last_fullsized":"2024-09-11T23:26:30.680929+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:31.212424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667171+0000","last_change":"2024-09-11T23:26:29.673840+0000","last_active":"2024-09-11T23:26:30.667171+0000","last_peered":"2024-09-11T23:26:30.667171+0000","last_clean":"2024-09-11T23:26:30.667171+0000","last_became_active":"2024-09-11T23:26:29.673509+0000","last_became_peered":"2024-09-11T23:26:29.673509+0000","last_unstale":"2024-09-11T23:26:30.667171+0000","last_undegraded":"2024-09-11T23:26:30.667171+0000","last_fullsized":"2024-09-11T23:26:30.667171+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:19.443221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667707+0000","last_change":"2024-09-11T23:26:29.667215+0000","last_active":"2024-09-11T23:26:30.667707+0000","last_peered":"2024-09-11T23:26:30.667707+0000","last_clean":"2024-09-11T23:26:30.667707+0000","last_became_active":"2024-09-11T23:26:29.666929+0000","last_became_peered":"2024-09-11T23:26:29.666929+0000","last_unstale":"2024-09-11T23:26:30.667707+0000","last_undegraded":"2024-09-11T23:26:30.667707+0000","last_fullsized":"2024-09-11T23:26:30.667707+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:45.401787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.681010+0000","last_change":"2024-09-11T23:26:29.671073+0000","last_active":"2024-09-11T23:26:30.681010+0000","last_peered":"2024-09-11T23:26:30.681010+0000","last_clean":"2024-09-11T23:26:30.681010+0000","last_became_active":"2024-09-11T23:26:29.670726+0000","last_became_peered":"2024-09-11T23:26:29.670726+0000","last_unstale":"2024-09-11T23:26:30.681010+0000","last_undegraded":"2024-09-11T23:26:30.681010+0000","last_fullsized":"2024-09-11T23:26:30.681010+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:50.570342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667671+0000","last_change":"2024-09-11T23:26:29.675030+0000","last_active":"2024-09-11T23:26:30.667671+0000","last_peered":"2024-09-11T23:26:30.667671+0000","last_clean":"2024-09-11T23:26:30.667671+0000","last_became_active":"2024-09-11T23:26:29.674738+0000","last_became_peered":"2024-09-11T23:26:29.674738+0000","last_unstale":"2024-09-11T23:26:30.667671+0000","last_undegraded":"2024-09-11T23:26:30.667671+0000","last_fullsized":"2024-09-11T23:26:30.667671+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:52.826866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.682712+0000","last_change":"2024-09-11T23:26:29.676389+0000","last_active":"2024-09-11T23:26:29.682712+0000","last_peered":"2024-09-11T23:26:29.682712+0000","last_clean":"2024-09-11T23:26:29.682712+0000","last_became_active":"2024-09-11T23:26:29.676130+0000","last_became_peered":"2024-09-11T23:26:29.676130+0000","last_unstale":"2024-09-11T23:26:29.682712+0000","last_undegraded":"2024-09-11T23:26:29.682712+0000","last_fullsized":"2024-09-11T23:26:29.682712+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:07.341688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.683837+0000","last_change":"2024-09-11T23:26:29.673571+0000","last_active":"2024-09-11T23:26:30.683837+0000","last_peered":"2024-09-11T23:26:30.683837+0000","last_clean":"2024-09-11T23:26:30.683837+0000","last_became_active":"2024-09-11T23:26:29.673261+0000","last_became_peered":"2024-09-11T23:26:29.673261+0000","last_unstale":"2024-09-11T23:26:30.683837+0000","last_undegraded":"2024-09-11T23:26:30.683837+0000","last_fullsized":"2024-09-11T23:26:30.683837+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:10.532614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.675881+0000","last_change":"2024-09-11T23:26:29.671541+0000","last_active":"2024-09-11T23:26:29.675881+0000","last_peered":"2024-09-11T23:26:29.675881+0000","last_clean":"2024-09-11T23:26:29.675881+0000","last_became_active":"2024-09-11T23:26:29.671160+0000","last_became_peered":"2024-09-11T23:26:29.671160+0000","last_unstale":"2024-09-11T23:26:29.675881+0000","last_undegraded":"2024-09-11T23:26:29.675881+0000","last_fullsized":"2024-09-11T23:26:29.675881+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:17.863698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.683713+0000","last_change":"2024-09-11T23:26:29.675898+0000","last_active":"2024-09-11T23:26:30.683713+0000","last_peered":"2024-09-11T23:26:30.683713+0000","last_clean":"2024-09-11T23:26:30.683713+0000","last_became_active":"2024-09-11T23:26:29.674214+0000","last_became_peered":"2024-09-11T23:26:29.674214+0000","last_unstale":"2024-09-11T23:26:30.683713+0000","last_undegraded":"2024-09-11T23:26:30.683713+0000","last_fullsized":"2024-09-11T23:26:30.683713+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:52.826866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667675+0000","last_change":"2024-09-11T23:26:29.671997+0000","last_active":"2024-09-11T23:26:30.667675+0000","last_peered":"2024-09-11T23:26:30.667675+0000","last_clean":"2024-09-11T23:26:30.667675+0000","last_became_active":"2024-09-11T23:26:29.671620+0000","last_became_peered":"2024-09-11T23:26:29.671620+0000","last_unstale":"2024-09-11T23:26:30.667675+0000","last_undegraded":"2024-09-11T23:26:30.667675+0000","last_fullsized":"2024-09-11T23:26:30.667675+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:55.015140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665060+0000","last_change":"2024-09-11T23:26:29.679202+0000","last_active":"2024-09-11T23:26:30.665060+0000","last_peered":"2024-09-11T23:26:30.665060+0000","last_clean":"2024-09-11T23:26:30.665060+0000","last_became_active":"2024-09-11T23:26:29.678954+0000","last_became_peered":"2024-09-11T23:26:29.678954+0000","last_unstale":"2024-09-11T23:26:30.665060+0000","last_undegraded":"2024-09-11T23:26:30.665060+0000","last_fullsized":"2024-09-11T23:26:30.665060+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:37.058073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.677339+0000","last_change":"2024-09-11T23:26:29.670076+0000","last_active":"2024-09-11T23:26:29.677339+0000","last_peered":"2024-09-11T23:26:29.677339+0000","last_clean":"2024-09-11T23:26:29.677339+0000","last_became_active":"2024-09-11T23:26:29.669781+0000","last_became_peered":"2024-09-11T23:26:29.669781+0000","last_unstale":"2024-09-11T23:26:29.677339+0000","last_undegraded":"2024-09-11T23:26:29.677339+0000","last_fullsized":"2024-09-11T23:26:29.677339+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:56.527116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.668079+0000","last_change":"2024-09-11T23:26:29.672977+0000","last_active":"2024-09-11T23:26:30.668079+0000","last_peered":"2024-09-11T23:26:30.668079+0000","last_clean":"2024-09-11T23:26:30.668079+0000","last_became_active":"2024-09-11T23:26:29.672671+0000","last_became_peered":"2024-09-11T23:26:29.672671+0000","last_unstale":"2024-09-11T23:26:30.668079+0000","last_undegraded":"2024-09-11T23:26:30.668079+0000","last_fullsized":"2024-09-11T23:26:30.668079+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:43.911542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"165'4","reported_seq":18,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.683951+0000","last_change":"2024-09-11T23:26:28.658509+0000","last_active":"2024-09-11T23:26:30.683951+0000","last_peered":"2024-09-11T23:26:30.683951+0000","last_clean":"2024-09-11T23:26:30.683951+0000","last_became_active":"2024-09-11T23:26:28.658201+0000","last_became_peered":"2024-09-11T23:26:28.658201+0000","last_unstale":"2024-09-11T23:26:30.683951+0000","last_undegraded":"2024-09-11T23:26:30.683951+0000","last_fullsized":"2024-09-11T23:26:30.683951+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:11.840374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667110+0000","last_change":"2024-09-11T23:26:29.677235+0000","last_active":"2024-09-11T23:26:30.667110+0000","last_peered":"2024-09-11T23:26:30.667110+0000","last_clean":"2024-09-11T23:26:30.667110+0000","last_became_active":"2024-09-11T23:26:29.676873+0000","last_became_peered":"2024-09-11T23:26:29.676873+0000","last_unstale":"2024-09-11T23:26:30.667110+0000","last_undegraded":"2024-09-11T23:26:30.667110+0000","last_fullsized":"2024-09-11T23:26:30.667110+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:43.905288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"165'1","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.668230+0000","last_change":"2024-09-11T23:26:28.653126+0000","last_active":"2024-09-11T23:26:30.668230+0000","last_peered":"2024-09-11T23:26:30.668230+0000","last_clean":"2024-09-11T23:26:30.668230+0000","last_became_active":"2024-09-11T23:26:28.652838+0000","last_became_peered":"2024-09-11T23:26:28.652838+0000","last_unstale":"2024-09-11T23:26:30.668230+0000","last_undegraded":"2024-09-11T23:26:30.668230+0000","last_fullsized":"2024-09-11T23:26:30.668230+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:29.478169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.684420+0000","last_change":"2024-09-11T23:26:29.677790+0000","last_active":"2024-09-11T23:26:29.684420+0000","last_peered":"2024-09-11T23:26:29.684420+0000","last_clean":"2024-09-11T23:26:29.684420+0000","last_became_active":"2024-09-11T23:26:29.677280+0000","last_became_peered":"2024-09-11T23:26:29.677280+0000","last_unstale":"2024-09-11T23:26:29.684420+0000","last_undegraded":"2024-09-11T23:26:29.684420+0000","last_fullsized":"2024-09-11T23:26:29.684420+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:48.269141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"165'2","reported_seq":14,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.693982+0000","last_change":"2024-09-11T23:26:28.663136+0000","last_active":"2024-09-11T23:26:29.693982+0000","last_peered":"2024-09-11T23:26:29.693982+0000","last_clean":"2024-09-11T23:26:29.693982+0000","last_became_active":"2024-09-11T23:26:28.662881+0000","last_became_peered":"2024-09-11T23:26:28.662881+0000","last_unstale":"2024-09-11T23:26:29.693982+0000","last_undegraded":"2024-09-11T23:26:29.693982+0000","last_fullsized":"2024-09-11T23:26:29.693982+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:19.188710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665447+0000","last_change":"2024-09-11T23:26:29.676844+0000","last_active":"2024-09-11T23:26:30.665447+0000","last_peered":"2024-09-11T23:26:30.665447+0000","last_clean":"2024-09-11T23:26:30.665447+0000","last_became_active":"2024-09-11T23:26:29.676310+0000","last_became_peered":"2024-09-11T23:26:29.676310+0000","last_unstale":"2024-09-11T23:26:30.665447+0000","last_undegraded":"2024-09-11T23:26:30.665447+0000","last_fullsized":"2024-09-11T23:26:30.665447+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:57.345491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"165'2","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.681382+0000","last_change":"2024-09-11T23:26:28.659283+0000","last_active":"2024-09-11T23:26:30.681382+0000","last_peered":"2024-09-11T23:26:30.681382+0000","last_clean":"2024-09-11T23:26:30.681382+0000","last_became_active":"2024-09-11T23:26:28.658941+0000","last_became_peered":"2024-09-11T23:26:28.658941+0000","last_unstale":"2024-09-11T23:26:30.681382+0000","last_undegraded":"2024-09-11T23:26:30.681382+0000","last_fullsized":"2024-09-11T23:26:30.681382+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:40.020031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.681139+0000","last_change":"2024-09-11T23:26:29.677780+0000","last_active":"2024-09-11T23:26:30.681139+0000","last_peered":"2024-09-11T23:26:30.681139+0000","last_clean":"2024-09-11T23:26:30.681139+0000","last_became_active":"2024-09-11T23:26:29.677454+0000","last_became_peered":"2024-09-11T23:26:29.677454+0000","last_unstale":"2024-09-11T23:26:30.681139+0000","last_undegraded":"2024-09-11T23:26:30.681139+0000","last_fullsized":"2024-09-11T23:26:30.681139+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:00.484937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"165'1","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.687831+0000","last_change":"2024-09-11T23:26:28.662535+0000","last_active":"2024-09-11T23:26:29.687831+0000","last_peered":"2024-09-11T23:26:29.687831+0000","last_clean":"2024-09-11T23:26:29.687831+0000","last_became_active":"2024-09-11T23:26:28.662007+0000","last_became_peered":"2024-09-11T23:26:28.662007+0000","last_unstale":"2024-09-11T23:26:29.687831+0000","last_undegraded":"2024-09-11T23:26:29.687831+0000","last_fullsized":"2024-09-11T23:26:29.687831+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:42.899096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.671145+0000","last_change":"2024-09-11T23:26:29.667833+0000","last_active":"2024-09-11T23:26:29.671145+0000","last_peered":"2024-09-11T23:26:29.671145+0000","last_clean":"2024-09-11T23:26:29.671145+0000","last_became_active":"2024-09-11T23:26:29.667452+0000","last_became_peered":"2024-09-11T23:26:29.667452+0000","last_unstale":"2024-09-11T23:26:29.671145+0000","last_undegraded":"2024-09-11T23:26:29.671145+0000","last_fullsized":"2024-09-11T23:26:29.671145+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:39.177247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.659648+0000","last_change":"2024-09-11T23:26:28.658142+0000","last_active":"2024-09-11T23:26:29.659648+0000","last_peered":"2024-09-11T23:26:29.659648+0000","last_clean":"2024-09-11T23:26:29.659648+0000","last_became_active":"2024-09-11T23:26:28.657846+0000","last_became_peered":"2024-09-11T23:26:28.657846+0000","last_unstale":"2024-09-11T23:26:29.659648+0000","last_undegraded":"2024-09-11T23:26:29.659648+0000","last_fullsized":"2024-09-11T23:26:29.659648+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:56.586565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.680926+0000","last_change":"2024-09-11T23:26:29.675365+0000","last_active":"2024-09-11T23:26:30.680926+0000","last_peered":"2024-09-11T23:26:30.680926+0000","last_clean":"2024-09-11T23:26:30.680926+0000","last_became_active":"2024-09-11T23:26:29.675050+0000","last_became_peered":"2024-09-11T23:26:29.675050+0000","last_unstale":"2024-09-11T23:26:30.680926+0000","last_undegraded":"2024-09-11T23:26:30.680926+0000","last_fullsized":"2024-09-11T23:26:30.680926+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:49.112499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.666570+0000","last_change":"2024-09-11T23:26:28.663545+0000","last_active":"2024-09-11T23:26:30.666570+0000","last_peered":"2024-09-11T23:26:30.666570+0000","last_clean":"2024-09-11T23:26:30.666570+0000","last_became_active":"2024-09-11T23:26:28.662805+0000","last_became_peered":"2024-09-11T23:26:28.662805+0000","last_unstale":"2024-09-11T23:26:30.666570+0000","last_undegraded":"2024-09-11T23:26:30.666570+0000","last_fullsized":"2024-09-11T23:26:30.666570+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:57.392853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.681191+0000","last_change":"2024-09-11T23:26:29.684815+0000","last_active":"2024-09-11T23:26:30.681191+0000","last_peered":"2024-09-11T23:26:30.681191+0000","last_clean":"2024-09-11T23:26:30.681191+0000","last_became_active":"2024-09-11T23:26:29.684470+0000","last_became_peered":"2024-09-11T23:26:29.684470+0000","last_unstale":"2024-09-11T23:26:30.681191+0000","last_undegraded":"2024-09-11T23:26:30.681191+0000","last_fullsized":"2024-09-11T23:26:30.681191+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:55.403904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.662366+0000","last_change":"2024-09-11T23:26:28.649515+0000","last_active":"2024-09-11T23:26:29.662366+0000","last_peered":"2024-09-11T23:26:29.662366+0000","last_clean":"2024-09-11T23:26:29.662366+0000","last_became_active":"2024-09-11T23:26:28.647322+0000","last_became_peered":"2024-09-11T23:26:28.647322+0000","last_unstale":"2024-09-11T23:26:29.662366+0000","last_undegraded":"2024-09-11T23:26:29.662366+0000","last_fullsized":"2024-09-11T23:26:29.662366+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:44.395595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.682224+0000","last_change":"2024-09-11T23:26:29.678105+0000","last_active":"2024-09-11T23:26:29.682224+0000","last_peered":"2024-09-11T23:26:29.682224+0000","last_clean":"2024-09-11T23:26:29.682224+0000","last_became_active":"2024-09-11T23:26:29.677855+0000","last_became_peered":"2024-09-11T23:26:29.677855+0000","last_unstale":"2024-09-11T23:26:29.682224+0000","last_undegraded":"2024-09-11T23:26:29.682224+0000","last_fullsized":"2024-09-11T23:26:29.682224+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:46.043066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667126+0000","last_change":"2024-09-11T23:26:28.659883+0000","last_active":"2024-09-11T23:26:30.667126+0000","last_peered":"2024-09-11T23:26:30.667126+0000","last_clean":"2024-09-11T23:26:30.667126+0000","last_became_active":"2024-09-11T23:26:28.659490+0000","last_became_peered":"2024-09-11T23:26:28.659490+0000","last_unstale":"2024-09-11T23:26:30.667126+0000","last_undegraded":"2024-09-11T23:26:30.667126+0000","last_fullsized":"2024-09-11T23:26:30.667126+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:41.164797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.681294+0000","last_change":"2024-09-11T23:26:29.680954+0000","last_active":"2024-09-11T23:26:30.681294+0000","last_peered":"2024-09-11T23:26:30.681294+0000","last_clean":"2024-09-11T23:26:30.681294+0000","last_became_active":"2024-09-11T23:26:29.680681+0000","last_became_peered":"2024-09-11T23:26:29.680681+0000","last_unstale":"2024-09-11T23:26:30.681294+0000","last_undegraded":"2024-09-11T23:26:30.681294+0000","last_fullsized":"2024-09-11T23:26:30.681294+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:16.950095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"165'3","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665613+0000","last_change":"2024-09-11T23:26:28.660160+0000","last_active":"2024-09-11T23:26:30.665613+0000","last_peered":"2024-09-11T23:26:30.665613+0000","last_clean":"2024-09-11T23:26:30.665613+0000","last_became_active":"2024-09-11T23:26:28.659605+0000","last_became_peered":"2024-09-11T23:26:28.659605+0000","last_unstale":"2024-09-11T23:26:30.665613+0000","last_undegraded":"2024-09-11T23:26:30.665613+0000","last_fullsized":"2024-09-11T23:26:30.665613+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:01.209371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.677443+0000","last_change":"2024-09-11T23:26:29.670046+0000","last_active":"2024-09-11T23:26:29.677443+0000","last_peered":"2024-09-11T23:26:29.677443+0000","last_clean":"2024-09-11T23:26:29.677443+0000","last_became_active":"2024-09-11T23:26:29.669238+0000","last_became_peered":"2024-09-11T23:26:29.669238+0000","last_unstale":"2024-09-11T23:26:29.677443+0000","last_undegraded":"2024-09-11T23:26:29.677443+0000","last_fullsized":"2024-09-11T23:26:29.677443+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:57.290027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"165'6","reported_seq":20,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.681429+0000","last_change":"2024-09-11T23:26:28.661776+0000","last_active":"2024-09-11T23:26:30.681429+0000","last_peered":"2024-09-11T23:26:30.681429+0000","last_clean":"2024-09-11T23:26:30.681429+0000","last_became_active":"2024-09-11T23:26:28.661468+0000","last_became_peered":"2024-09-11T23:26:28.661468+0000","last_unstale":"2024-09-11T23:26:30.681429+0000","last_undegraded":"2024-09-11T23:26:30.681429+0000","last_fullsized":"2024-09-11T23:26:30.681429+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:00.692120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.684642+0000","last_change":"2024-09-11T23:26:29.678739+0000","last_active":"2024-09-11T23:26:29.684642+0000","last_peered":"2024-09-11T23:26:29.684642+0000","last_clean":"2024-09-11T23:26:29.684642+0000","last_became_active":"2024-09-11T23:26:29.678221+0000","last_became_peered":"2024-09-11T23:26:29.678221+0000","last_unstale":"2024-09-11T23:26:29.684642+0000","last_undegraded":"2024-09-11T23:26:29.684642+0000","last_fullsized":"2024-09-11T23:26:29.684642+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:01.698312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"165'2","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.666671+0000","last_change":"2024-09-11T23:26:28.662515+0000","last_active":"2024-09-11T23:26:30.666671+0000","last_peered":"2024-09-11T23:26:30.666671+0000","last_clean":"2024-09-11T23:26:30.666671+0000","last_became_active":"2024-09-11T23:26:28.658398+0000","last_became_peered":"2024-09-11T23:26:28.658398+0000","last_unstale":"2024-09-11T23:26:30.666671+0000","last_undegraded":"2024-09-11T23:26:30.666671+0000","last_fullsized":"2024-09-11T23:26:30.666671+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:12.129377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665513+0000","last_change":"2024-09-11T23:26:29.688968+0000","last_active":"2024-09-11T23:26:30.665513+0000","last_peered":"2024-09-11T23:26:30.665513+0000","last_clean":"2024-09-11T23:26:30.665513+0000","last_became_active":"2024-09-11T23:26:29.688570+0000","last_became_peered":"2024-09-11T23:26:29.688570+0000","last_unstale":"2024-09-11T23:26:30.665513+0000","last_undegraded":"2024-09-11T23:26:30.665513+0000","last_fullsized":"2024-09-11T23:26:30.665513+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:20.711415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667348+0000","last_change":"2024-09-11T23:26:28.665094+0000","last_active":"2024-09-11T23:26:30.667348+0000","last_peered":"2024-09-11T23:26:30.667348+0000","last_clean":"2024-09-11T23:26:30.667348+0000","last_became_active":"2024-09-11T23:26:28.664832+0000","last_became_peered":"2024-09-11T23:26:28.664832+0000","last_unstale":"2024-09-11T23:26:30.667348+0000","last_undegraded":"2024-09-11T23:26:30.667348+0000","last_fullsized":"2024-09-11T23:26:30.667348+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:41.875389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.684368+0000","last_change":"2024-09-11T23:26:29.678758+0000","last_active":"2024-09-11T23:26:29.684368+0000","last_peered":"2024-09-11T23:26:29.684368+0000","last_clean":"2024-09-11T23:26:29.684368+0000","last_became_active":"2024-09-11T23:26:29.678495+0000","last_became_peered":"2024-09-11T23:26:29.678495+0000","last_unstale":"2024-09-11T23:26:29.684368+0000","last_undegraded":"2024-09-11T23:26:29.684368+0000","last_fullsized":"2024-09-11T23:26:29.684368+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:40.712018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665021+0000","last_change":"2024-09-11T23:26:28.659184+0000","last_active":"2024-09-11T23:26:30.665021+0000","last_peered":"2024-09-11T23:26:30.665021+0000","last_clean":"2024-09-11T23:26:30.665021+0000","last_became_active":"2024-09-11T23:26:28.658921+0000","last_became_peered":"2024-09-11T23:26:28.658921+0000","last_unstale":"2024-09-11T23:26:30.665021+0000","last_undegraded":"2024-09-11T23:26:30.665021+0000","last_fullsized":"2024-09-11T23:26:30.665021+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:22.462502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.672274+0000","last_change":"2024-09-11T23:26:29.667720+0000","last_active":"2024-09-11T23:26:29.672274+0000","last_peered":"2024-09-11T23:26:29.672274+0000","last_clean":"2024-09-11T23:26:29.672274+0000","last_became_active":"2024-09-11T23:26:29.665589+0000","last_became_peered":"2024-09-11T23:26:29.665589+0000","last_unstale":"2024-09-11T23:26:29.672274+0000","last_undegraded":"2024-09-11T23:26:29.672274+0000","last_fullsized":"2024-09-11T23:26:29.672274+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.985234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"165'8","reported_seq":20,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.694605+0000","last_change":"2024-09-11T23:26:28.660544+0000","last_active":"2024-09-11T23:26:29.694605+0000","last_peered":"2024-09-11T23:26:29.694605+0000","last_clean":"2024-09-11T23:26:29.694605+0000","last_became_active":"2024-09-11T23:26:28.660291+0000","last_became_peered":"2024-09-11T23:26:28.660291+0000","last_unstale":"2024-09-11T23:26:29.694605+0000","last_undegraded":"2024-09-11T23:26:29.694605+0000","last_fullsized":"2024-09-11T23:26:29.694605+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:33.924099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.668173+0000","last_change":"2024-09-11T23:26:29.670045+0000","last_active":"2024-09-11T23:26:30.668173+0000","last_peered":"2024-09-11T23:26:30.668173+0000","last_clean":"2024-09-11T23:26:30.668173+0000","last_became_active":"2024-09-11T23:26:29.669155+0000","last_became_peered":"2024-09-11T23:26:29.669155+0000","last_unstale":"2024-09-11T23:26:30.668173+0000","last_undegraded":"2024-09-11T23:26:30.668173+0000","last_fullsized":"2024-09-11T23:26:30.668173+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:57.592757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"165'1","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.691198+0000","last_change":"2024-09-11T23:26:28.663454+0000","last_active":"2024-09-11T23:26:29.691198+0000","last_peered":"2024-09-11T23:26:29.691198+0000","last_clean":"2024-09-11T23:26:29.691198+0000","last_became_active":"2024-09-11T23:26:28.663173+0000","last_became_peered":"2024-09-11T23:26:28.663173+0000","last_unstale":"2024-09-11T23:26:29.691198+0000","last_undegraded":"2024-09-11T23:26:29.691198+0000","last_fullsized":"2024-09-11T23:26:29.691198+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:05.905525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667829+0000","last_change":"2024-09-11T23:26:29.674803+0000","last_active":"2024-09-11T23:26:30.667829+0000","last_peered":"2024-09-11T23:26:30.667829+0000","last_clean":"2024-09-11T23:26:30.667829+0000","last_became_active":"2024-09-11T23:26:29.674314+0000","last_became_peered":"2024-09-11T23:26:29.674314+0000","last_unstale":"2024-09-11T23:26:30.667829+0000","last_undegraded":"2024-09-11T23:26:30.667829+0000","last_fullsized":"2024-09-11T23:26:30.667829+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:10.532614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"165'2","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.668287+0000","last_change":"2024-09-11T23:26:28.662956+0000","last_active":"2024-09-11T23:26:30.668287+0000","last_peered":"2024-09-11T23:26:30.668287+0000","last_clean":"2024-09-11T23:26:30.668287+0000","last_became_active":"2024-09-11T23:26:28.662604+0000","last_became_peered":"2024-09-11T23:26:28.662604+0000","last_unstale":"2024-09-11T23:26:30.668287+0000","last_undegraded":"2024-09-11T23:26:30.668287+0000","last_fullsized":"2024-09-11T23:26:30.668287+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:52.034359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.687123+0000","last_change":"2024-09-11T23:26:29.684138+0000","last_active":"2024-09-11T23:26:29.687123+0000","last_peered":"2024-09-11T23:26:29.687123+0000","last_clean":"2024-09-11T23:26:29.687123+0000","last_became_active":"2024-09-11T23:26:29.683802+0000","last_became_peered":"2024-09-11T23:26:29.683802+0000","last_unstale":"2024-09-11T23:26:29.687123+0000","last_undegraded":"2024-09-11T23:26:29.687123+0000","last_fullsized":"2024-09-11T23:26:29.687123+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:37.497451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"165'1","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665716+0000","last_change":"2024-09-11T23:26:28.661089+0000","last_active":"2024-09-11T23:26:30.665716+0000","last_peered":"2024-09-11T23:26:30.665716+0000","last_clean":"2024-09-11T23:26:30.665716+0000","last_became_active":"2024-09-11T23:26:28.660164+0000","last_became_peered":"2024-09-11T23:26:28.660164+0000","last_unstale":"2024-09-11T23:26:30.665716+0000","last_undegraded":"2024-09-11T23:26:30.665716+0000","last_fullsized":"2024-09-11T23:26:30.665716+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:05.946031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665475+0000","last_change":"2024-09-11T23:26:29.678044+0000","last_active":"2024-09-11T23:26:30.665475+0000","last_peered":"2024-09-11T23:26:30.665475+0000","last_clean":"2024-09-11T23:26:30.665475+0000","last_became_active":"2024-09-11T23:26:29.677800+0000","last_became_peered":"2024-09-11T23:26:29.677800+0000","last_unstale":"2024-09-11T23:26:30.665475+0000","last_undegraded":"2024-09-11T23:26:30.665475+0000","last_fullsized":"2024-09-11T23:26:30.665475+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:11.998579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.668564+0000","last_change":"2024-09-11T23:26:28.667298+0000","last_active":"2024-09-11T23:26:29.668564+0000","last_peered":"2024-09-11T23:26:29.668564+0000","last_clean":"2024-09-11T23:26:29.668564+0000","last_became_active":"2024-09-11T23:26:28.666967+0000","last_became_peered":"2024-09-11T23:26:28.666967+0000","last_unstale":"2024-09-11T23:26:29.668564+0000","last_undegraded":"2024-09-11T23:26:29.668564+0000","last_fullsized":"2024-09-11T23:26:29.668564+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:34.009699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665203+0000","last_change":"2024-09-11T23:26:29.673057+0000","last_active":"2024-09-11T23:26:30.665203+0000","last_peered":"2024-09-11T23:26:30.665203+0000","last_clean":"2024-09-11T23:26:30.665203+0000","last_became_active":"2024-09-11T23:26:29.672280+0000","last_became_peered":"2024-09-11T23:26:29.672280+0000","last_unstale":"2024-09-11T23:26:30.665203+0000","last_undegraded":"2024-09-11T23:26:30.665203+0000","last_fullsized":"2024-09-11T23:26:30.665203+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:19:20.837332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"165'2","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665354+0000","last_change":"2024-09-11T23:26:28.660988+0000","last_active":"2024-09-11T23:26:30.665354+0000","last_peered":"2024-09-11T23:26:30.665354+0000","last_clean":"2024-09-11T23:26:30.665354+0000","last_became_active":"2024-09-11T23:26:28.660672+0000","last_became_peered":"2024-09-11T23:26:28.660672+0000","last_unstale":"2024-09-11T23:26:30.665354+0000","last_undegraded":"2024-09-11T23:26:30.665354+0000","last_fullsized":"2024-09-11T23:26:30.665354+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:07.783860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.677170+0000","last_change":"2024-09-11T23:26:29.674203+0000","last_active":"2024-09-11T23:26:29.677170+0000","last_peered":"2024-09-11T23:26:29.677170+0000","last_clean":"2024-09-11T23:26:29.677170+0000","last_became_active":"2024-09-11T23:26:29.673579+0000","last_became_peered":"2024-09-11T23:26:29.673579+0000","last_unstale":"2024-09-11T23:26:29.677170+0000","last_undegraded":"2024-09-11T23:26:29.677170+0000","last_fullsized":"2024-09-11T23:26:29.677170+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:36.629835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.656491+0000","last_change":"2024-09-11T23:26:28.655914+0000","last_active":"2024-09-11T23:26:29.656491+0000","last_peered":"2024-09-11T23:26:29.656491+0000","last_clean":"2024-09-11T23:26:29.656491+0000","last_became_active":"2024-09-11T23:26:28.654901+0000","last_became_peered":"2024-09-11T23:26:28.654901+0000","last_unstale":"2024-09-11T23:26:29.656491+0000","last_undegraded":"2024-09-11T23:26:29.656491+0000","last_fullsized":"2024-09-11T23:26:29.656491+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:28.212641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.666823+0000","last_change":"2024-09-11T23:26:29.668993+0000","last_active":"2024-09-11T23:26:30.666823+0000","last_peered":"2024-09-11T23:26:30.666823+0000","last_clean":"2024-09-11T23:26:30.666823+0000","last_became_active":"2024-09-11T23:26:29.668620+0000","last_became_peered":"2024-09-11T23:26:29.668620+0000","last_unstale":"2024-09-11T23:26:30.666823+0000","last_undegraded":"2024-09-11T23:26:30.666823+0000","last_fullsized":"2024-09-11T23:26:30.666823+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:42.170989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.656189+0000","last_change":"2024-09-11T23:26:28.661894+0000","last_active":"2024-09-11T23:26:29.656189+0000","last_peered":"2024-09-11T23:26:29.656189+0000","last_clean":"2024-09-11T23:26:29.656189+0000","last_became_active":"2024-09-11T23:26:28.661628+0000","last_became_peered":"2024-09-11T23:26:28.661628+0000","last_unstale":"2024-09-11T23:26:29.656189+0000","last_undegraded":"2024-09-11T23:26:29.656189+0000","last_fullsized":"2024-09-11T23:26:29.656189+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:10.333324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667862+0000","last_change":"2024-09-11T23:26:29.678009+0000","last_active":"2024-09-11T23:26:30.667862+0000","last_peered":"2024-09-11T23:26:30.667862+0000","last_clean":"2024-09-11T23:26:30.667862+0000","last_became_active":"2024-09-11T23:26:29.675760+0000","last_became_peered":"2024-09-11T23:26:29.675760+0000","last_unstale":"2024-09-11T23:26:30.667862+0000","last_undegraded":"2024-09-11T23:26:30.667862+0000","last_fullsized":"2024-09-11T23:26:30.667862+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:06.911717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.663672+0000","last_change":"2024-09-11T23:26:28.660356+0000","last_active":"2024-09-11T23:26:29.663672+0000","last_peered":"2024-09-11T23:26:29.663672+0000","last_clean":"2024-09-11T23:26:29.663672+0000","last_became_active":"2024-09-11T23:26:28.660084+0000","last_became_peered":"2024-09-11T23:26:28.660084+0000","last_unstale":"2024-09-11T23:26:29.663672+0000","last_undegraded":"2024-09-11T23:26:29.663672+0000","last_fullsized":"2024-09-11T23:26:29.663672+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:22.771870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.683966+0000","last_change":"2024-09-11T23:26:29.674028+0000","last_active":"2024-09-11T23:26:30.683966+0000","last_peered":"2024-09-11T23:26:30.683966+0000","last_clean":"2024-09-11T23:26:30.683966+0000","last_became_active":"2024-09-11T23:26:29.671895+0000","last_became_peered":"2024-09-11T23:26:29.671895+0000","last_unstale":"2024-09-11T23:26:30.683966+0000","last_undegraded":"2024-09-11T23:26:30.683966+0000","last_fullsized":"2024-09-11T23:26:30.683966+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:43.911542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"165'2","reported_seq":14,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.694139+0000","last_change":"2024-09-11T23:26:28.665927+0000","last_active":"2024-09-11T23:26:29.694139+0000","last_peered":"2024-09-11T23:26:29.694139+0000","last_clean":"2024-09-11T23:26:29.694139+0000","last_became_active":"2024-09-11T23:26:28.665625+0000","last_became_peered":"2024-09-11T23:26:28.665625+0000","last_unstale":"2024-09-11T23:26:29.694139+0000","last_undegraded":"2024-09-11T23:26:29.694139+0000","last_fullsized":"2024-09-11T23:26:29.694139+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:52.049199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.682638+0000","last_change":"2024-09-11T23:26:29.675874+0000","last_active":"2024-09-11T23:26:29.682638+0000","last_peered":"2024-09-11T23:26:29.682638+0000","last_clean":"2024-09-11T23:26:29.682638+0000","last_became_active":"2024-09-11T23:26:29.675220+0000","last_became_peered":"2024-09-11T23:26:29.675220+0000","last_unstale":"2024-09-11T23:26:29.682638+0000","last_undegraded":"2024-09-11T23:26:29.682638+0000","last_fullsized":"2024-09-11T23:26:29.682638+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:07.493152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"166'1","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.682984+0000","last_change":"2024-09-11T23:26:28.657787+0000","last_active":"2024-09-11T23:26:30.682984+0000","last_peered":"2024-09-11T23:26:30.682984+0000","last_clean":"2024-09-11T23:26:30.682984+0000","last_became_active":"2024-09-11T23:26:28.657389+0000","last_became_peered":"2024-09-11T23:26:28.657389+0000","last_unstale":"2024-09-11T23:26:30.682984+0000","last_undegraded":"2024-09-11T23:26:30.682984+0000","last_fullsized":"2024-09-11T23:26:30.682984+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:37.137426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667506+0000","last_change":"2024-09-11T23:26:29.666548+0000","last_active":"2024-09-11T23:26:30.667506+0000","last_peered":"2024-09-11T23:26:30.667506+0000","last_clean":"2024-09-11T23:26:30.667506+0000","last_became_active":"2024-09-11T23:26:29.666197+0000","last_became_peered":"2024-09-11T23:26:29.666197+0000","last_unstale":"2024-09-11T23:26:30.667506+0000","last_undegraded":"2024-09-11T23:26:30.667506+0000","last_fullsized":"2024-09-11T23:26:30.667506+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:40.007803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.659961+0000","last_change":"2024-09-11T23:26:28.663273+0000","last_active":"2024-09-11T23:26:29.659961+0000","last_peered":"2024-09-11T23:26:29.659961+0000","last_clean":"2024-09-11T23:26:29.659961+0000","last_became_active":"2024-09-11T23:26:28.663035+0000","last_became_peered":"2024-09-11T23:26:28.663035+0000","last_unstale":"2024-09-11T23:26:29.659961+0000","last_undegraded":"2024-09-11T23:26:29.659961+0000","last_fullsized":"2024-09-11T23:26:29.659961+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:48.598652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.666802+0000","last_change":"2024-09-11T23:26:29.663711+0000","last_active":"2024-09-11T23:26:30.666802+0000","last_peered":"2024-09-11T23:26:30.666802+0000","last_clean":"2024-09-11T23:26:30.666802+0000","last_became_active":"2024-09-11T23:26:29.663052+0000","last_became_peered":"2024-09-11T23:26:29.663052+0000","last_unstale":"2024-09-11T23:26:30.666802+0000","last_undegraded":"2024-09-11T23:26:30.666802+0000","last_fullsized":"2024-09-11T23:26:30.666802+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:49.604844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.668582+0000","last_change":"2024-09-11T23:26:28.666022+0000","last_active":"2024-09-11T23:26:29.668582+0000","last_peered":"2024-09-11T23:26:29.668582+0000","last_clean":"2024-09-11T23:26:29.668582+0000","last_became_active":"2024-09-11T23:26:28.665713+0000","last_became_peered":"2024-09-11T23:26:28.665713+0000","last_unstale":"2024-09-11T23:26:29.668582+0000","last_undegraded":"2024-09-11T23:26:29.668582+0000","last_fullsized":"2024-09-11T23:26:29.668582+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:01.611112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.682217+0000","last_change":"2024-09-11T23:26:29.674905+0000","last_active":"2024-09-11T23:26:29.682217+0000","last_peered":"2024-09-11T23:26:29.682217+0000","last_clean":"2024-09-11T23:26:29.682217+0000","last_became_active":"2024-09-11T23:26:29.674649+0000","last_became_peered":"2024-09-11T23:26:29.674649+0000","last_unstale":"2024-09-11T23:26:29.682217+0000","last_undegraded":"2024-09-11T23:26:29.682217+0000","last_fullsized":"2024-09-11T23:26:29.682217+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:08.917952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.681055+0000","last_change":"2024-09-11T23:26:28.656495+0000","last_active":"2024-09-11T23:26:30.681055+0000","last_peered":"2024-09-11T23:26:30.681055+0000","last_clean":"2024-09-11T23:26:30.681055+0000","last_became_active":"2024-09-11T23:26:28.656109+0000","last_became_peered":"2024-09-11T23:26:28.656109+0000","last_unstale":"2024-09-11T23:26:30.681055+0000","last_undegraded":"2024-09-11T23:26:30.681055+0000","last_fullsized":"2024-09-11T23:26:30.681055+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:48.503166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.683688+0000","last_change":"2024-09-11T23:26:29.676061+0000","last_active":"2024-09-11T23:26:30.683688+0000","last_peered":"2024-09-11T23:26:30.683688+0000","last_clean":"2024-09-11T23:26:30.683688+0000","last_became_active":"2024-09-11T23:26:29.675327+0000","last_became_peered":"2024-09-11T23:26:29.675327+0000","last_unstale":"2024-09-11T23:26:30.683688+0000","last_undegraded":"2024-09-11T23:26:30.683688+0000","last_fullsized":"2024-09-11T23:26:30.683688+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:40.007803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.661075+0000","last_change":"2024-09-11T23:26:28.662331+0000","last_active":"2024-09-11T23:26:29.661075+0000","last_peered":"2024-09-11T23:26:29.661075+0000","last_clean":"2024-09-11T23:26:29.661075+0000","last_became_active":"2024-09-11T23:26:28.661608+0000","last_became_peered":"2024-09-11T23:26:28.661608+0000","last_unstale":"2024-09-11T23:26:29.661075+0000","last_undegraded":"2024-09-11T23:26:29.661075+0000","last_fullsized":"2024-09-11T23:26:29.661075+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:18.437029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.684507+0000","last_change":"2024-09-11T23:26:29.679438+0000","last_active":"2024-09-11T23:26:29.684507+0000","last_peered":"2024-09-11T23:26:29.684507+0000","last_clean":"2024-09-11T23:26:29.684507+0000","last_became_active":"2024-09-11T23:26:29.679138+0000","last_became_peered":"2024-09-11T23:26:29.679138+0000","last_unstale":"2024-09-11T23:26:29.684507+0000","last_undegraded":"2024-09-11T23:26:29.684507+0000","last_fullsized":"2024-09-11T23:26:29.684507+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:26.061150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667961+0000","last_change":"2024-09-11T23:26:28.663233+0000","last_active":"2024-09-11T23:26:30.667961+0000","last_peered":"2024-09-11T23:26:30.667961+0000","last_clean":"2024-09-11T23:26:30.667961+0000","last_became_active":"2024-09-11T23:26:28.662206+0000","last_became_peered":"2024-09-11T23:26:28.662206+0000","last_unstale":"2024-09-11T23:26:30.667961+0000","last_undegraded":"2024-09-11T23:26:30.667961+0000","last_fullsized":"2024-09-11T23:26:30.667961+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:39.001611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.666850+0000","last_change":"2024-09-11T23:26:29.676267+0000","last_active":"2024-09-11T23:26:30.666850+0000","last_peered":"2024-09-11T23:26:30.666850+0000","last_clean":"2024-09-11T23:26:30.666850+0000","last_became_active":"2024-09-11T23:26:29.674953+0000","last_became_peered":"2024-09-11T23:26:29.674953+0000","last_unstale":"2024-09-11T23:26:30.666850+0000","last_undegraded":"2024-09-11T23:26:30.666850+0000","last_fullsized":"2024-09-11T23:26:30.666850+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:58.399045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.683541+0000","last_change":"2024-09-11T23:26:28.656532+0000","last_active":"2024-09-11T23:26:30.683541+0000","last_peered":"2024-09-11T23:26:30.683541+0000","last_clean":"2024-09-11T23:26:30.683541+0000","last_became_active":"2024-09-11T23:26:28.656146+0000","last_became_peered":"2024-09-11T23:26:28.656146+0000","last_unstale":"2024-09-11T23:26:30.683541+0000","last_undegraded":"2024-09-11T23:26:30.683541+0000","last_fullsized":"2024-09-11T23:26:30.683541+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:39.177768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.680108+0000","last_change":"2024-09-11T23:26:29.670601+0000","last_active":"2024-09-11T23:26:29.680108+0000","last_peered":"2024-09-11T23:26:29.680108+0000","last_clean":"2024-09-11T23:26:29.680108+0000","last_became_active":"2024-09-11T23:26:29.670314+0000","last_became_peered":"2024-09-11T23:26:29.670314+0000","last_unstale":"2024-09-11T23:26:29.680108+0000","last_undegraded":"2024-09-11T23:26:29.680108+0000","last_fullsized":"2024-09-11T23:26:29.680108+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:37:34.430206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"165'1","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.683872+0000","last_change":"2024-09-11T23:26:28.666899+0000","last_active":"2024-09-11T23:26:30.683872+0000","last_peered":"2024-09-11T23:26:30.683872+0000","last_clean":"2024-09-11T23:26:30.683872+0000","last_became_active":"2024-09-11T23:26:28.666576+0000","last_became_peered":"2024-09-11T23:26:28.666576+0000","last_unstale":"2024-09-11T23:26:30.683872+0000","last_undegraded":"2024-09-11T23:26:30.683872+0000","last_fullsized":"2024-09-11T23:26:30.683872+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:57.911629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":478,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.680877+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:26:30.680877+0000","last_peered":"2024-09-11T23:26:30.680877+0000","last_clean":"2024-09-11T23:26:30.680877+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:26:30.680877+0000","last_undegraded":"2024-09-11T23:26:30.680877+0000","last_fullsized":"2024-09-11T23:26:30.680877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476845,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33808,"kb_used_data":2616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338032,"statfs":{"total":96636764160,"available":96602144768,"internally_reserved":0,"allocated":2678784,"data_stored":1505989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476844,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33216,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338624,"statfs":{"total":96636764160,"available":96602750976,"internally_reserved":0,"allocated":2076672,"data_stored":914591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476843,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33220,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338620,"statfs":{"total":96636764160,"available":96602746880,"internally_reserved":0,"allocated":2076672,"data_stored":914591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476843,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33240,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2093056,"data_stored":915725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542252,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33224,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338616,"statfs":{"total":96636764160,"available":96602742784,"internally_reserved":0,"allocated":2084864,"data_stored":914191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542252,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33212,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338628,"statfs":{"total":96636764160,"available":96602755072,"internally_reserved":0,"allocated":2072576,"data_stored":914009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33220,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338620,"statfs":{"total":96636764160,"available":96602746880,"internally_reserved":0,"allocated":2080768,"data_stored":914065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509548,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37956,"kb_used_data":2608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333884,"statfs":{"total":96636764160,"available":96597897216,"internally_reserved":0,"allocated":2670592,"data_stored":1504467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:26:33.846 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:26:34.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.035+0000 7f3435600640 1 Processor -- start 2024-09-11T23:26:34.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.035+0000 7f3435600640 1 -- start start 2024-09-11T23:26:34.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.037+0000 7f3435600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f34300d02a0 0x7f34300d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:34.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.037+0000 7f3435600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f343015ca40 0x7f343015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:34.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.037+0000 7f3435600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34300d0bc0 con 0x7f343015ceb0 2024-09-11T23:26:34.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.037+0000 7f3435600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f343015d390 con 0x7f343015ca40 2024-09-11T23:26:34.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.037+0000 7f3435600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f343015d670 con 0x7f34300d02a0 2024-09-11T23:26:34.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.037+0000 7f3426000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f343015ca40 0x7f343015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:34.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.037+0000 7f3426000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f343015ca40 0x7f343015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40516/0 (socket says 172.21.15.144:40516) 2024-09-11T23:26:34.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.037+0000 7f3426000640 1 -- 172.21.15.144:0/461430774 learned_addr learned my addr 172.21.15.144:0/461430774 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:34.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.037+0000 7f3426000640 1 -- 172.21.15.144:0/461430774 >> v2:172.21.15.165:3300/0 conn(0x7f34300d02a0 msgr2=0x7f34300d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:34.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.037+0000 7f3426000640 1 --2- 172.21.15.144:0/461430774 >> v2:172.21.15.165:3300/0 conn(0x7f34300d02a0 0x7f34300d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.037+0000 7f3426000640 1 -- 172.21.15.144:0/461430774 >> v1:172.21.15.165:6789/0 conn(0x7f343015ceb0 legacy=0x7f34301594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:34.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.037+0000 7f3426000640 1 -- 172.21.15.144:0/461430774 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343015d950 con 0x7f343015ca40 2024-09-11T23:26:34.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.038+0000 7f3426000640 1 --2- 172.21.15.144:0/461430774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f343015ca40 0x7f343015e430 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f343006f030 tx=0x7f341802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f514c84a7db975 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:34.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.039+0000 7f342e000640 1 -- 172.21.15.144:0/461430774 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3418037070 con 0x7f343015ca40 2024-09-11T23:26:34.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.039+0000 7f342e000640 1 -- 172.21.15.144:0/461430774 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3418032440 con 0x7f343015ca40 2024-09-11T23:26:34.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.039+0000 7f342e000640 1 -- 172.21.15.144:0/461430774 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3418032810 con 0x7f343015ca40 2024-09-11T23:26:34.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.039+0000 7f3435600640 1 -- 172.21.15.144:0/461430774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f343015ca40 msgr2=0x7f343015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:34.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.039+0000 7f3435600640 1 --2- 172.21.15.144:0/461430774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f343015ca40 0x7f343015e430 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f343006f030 tx=0x7f341802a1a0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.039+0000 7f3435600640 1 -- 172.21.15.144:0/461430774 shutdown_connections 2024-09-11T23:26:34.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.039+0000 7f3435600640 1 --2- 172.21.15.144:0/461430774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f343015ca40 0x7f343015e430 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.039+0000 7f3435600640 1 --2- 172.21.15.144:0/461430774 >> v2:172.21.15.165:3300/0 conn(0x7f34300d02a0 0x7f34300d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.039+0000 7f3435600640 1 -- 172.21.15.144:0/461430774 >> 172.21.15.144:0/461430774 conn(0x7f3430062cc0 msgr2=0x7f343006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:34.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.039+0000 7f3435600640 1 -- 172.21.15.144:0/461430774 shutdown_connections 2024-09-11T23:26:34.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.039+0000 7f3435600640 1 -- 172.21.15.144:0/461430774 wait complete. 2024-09-11T23:26:34.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.041+0000 7f3435600640 1 Processor -- start 2024-09-11T23:26:34.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.041+0000 7f3435600640 1 -- start start 2024-09-11T23:26:34.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.042+0000 7f3435600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f34300d02a0 0x7f34301589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:34.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.042+0000 7f3435600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f343015ca40 0x7f3430156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:34.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.042+0000 7f3435600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f343015ceb0 0x7f34300aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:34.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.042+0000 7f3435600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3430155b90 con 0x7f343015ceb0 2024-09-11T23:26:34.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.042+0000 7f3435600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f343015df10 con 0x7f343015ca40 2024-09-11T23:26:34.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.042+0000 7f3435600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3430155d10 con 0x7f34300d02a0 2024-09-11T23:26:34.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.042+0000 7f342f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f343015ceb0 0x7f34300aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:34.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.042+0000 7f342f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f343015ceb0 0x7f34300aeb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40532/0 (socket says 172.21.15.144:40532) 2024-09-11T23:26:34.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.042+0000 7f342f400640 1 -- 172.21.15.144:0/1891819171 learned_addr learned my addr 172.21.15.144:0/1891819171 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:34.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.042+0000 7f342ea00640 1 --2- 172.21.15.144:0/1891819171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f34300d02a0 0x7f34301589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:34.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.042+0000 7f3426000640 1 --2- 172.21.15.144:0/1891819171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f343015ca40 0x7f3430156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:34.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.042+0000 7f342f400640 1 -- 172.21.15.144:0/1891819171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f34300d02a0 msgr2=0x7f34301589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:34.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.042+0000 7f342f400640 1 --2- 172.21.15.144:0/1891819171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f34300d02a0 0x7f34301589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.042+0000 7f342f400640 1 -- 172.21.15.144:0/1891819171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f343015ca40 msgr2=0x7f3430156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:34.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.042+0000 7f342f400640 1 --2- 172.21.15.144:0/1891819171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f343015ca40 0x7f3430156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.043+0000 7f342f400640 1 -- 172.21.15.144:0/1891819171 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34301576c0 con 0x7f343015ceb0 2024-09-11T23:26:34.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.043+0000 7f342f400640 1 --2- 172.21.15.144:0/1891819171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f343015ceb0 0x7f34300aeb50 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f342800b9e0 tx=0x7f342800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:34.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.043+0000 7f3427400640 1 -- 172.21.15.144:0/1891819171 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3428019070 con 0x7f343015ceb0 2024-09-11T23:26:34.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.043+0000 7f3427400640 1 -- 172.21.15.144:0/1891819171 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f342800cb20 con 0x7f343015ceb0 2024-09-11T23:26:34.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.043+0000 7f3427400640 1 -- 172.21.15.144:0/1891819171 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3428014440 con 0x7f343015ceb0 2024-09-11T23:26:34.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.043+0000 7f3435600640 1 -- 172.21.15.144:0/1891819171 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34301579a0 con 0x7f343015ceb0 2024-09-11T23:26:34.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.043+0000 7f3435600640 1 -- 172.21.15.144:0/1891819171 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3430157f60 con 0x7f343015ceb0 2024-09-11T23:26:34.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.044+0000 7f3435600640 1 -- 172.21.15.144:0/1891819171 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f343006cb40 con 0x7f343015ceb0 2024-09-11T23:26:34.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.045+0000 7f3427400640 1 -- 172.21.15.144:0/1891819171 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f342801c070 con 0x7f343015ceb0 2024-09-11T23:26:34.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.046+0000 7f3427400640 1 --2- 172.21.15.144:0/1891819171 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f340c06c7c0 0x7f340c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:34.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.046+0000 7f3427400640 1 -- 172.21.15.144:0/1891819171 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f3428089330 con 0x7f343015ceb0 2024-09-11T23:26:34.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.047+0000 7f342ea00640 1 --2- 172.21.15.144:0/1891819171 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f340c06c7c0 0x7f340c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:34.047 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.047+0000 7f342ea00640 1 --2- 172.21.15.144:0/1891819171 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f340c06c7c0 0x7f340c06ec80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3420009890 tx=0x7f3420008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:34.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.050+0000 7f3427400640 1 -- 172.21.15.144:0/1891819171 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f343006cb40 con 0x7f343015ceb0 2024-09-11T23:26:34.222 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.222+0000 7f3435600640 1 -- 172.21.15.144:0/1891819171 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f34300b4790 con 0x7f340c06c7c0 2024-09-11T23:26:34.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.229+0000 7f3427400640 1 -- 172.21.15.144:0/1891819171 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252459 (secure 0 0 0) 0x7f34300b4790 con 0x7f340c06c7c0 2024-09-11T23:26:34.231 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:34.233 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:26:34.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.232+0000 7f3435600640 1 -- 172.21.15.144:0/1891819171 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f340c06c7c0 msgr2=0x7f340c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:34.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.232+0000 7f3435600640 1 --2- 172.21.15.144:0/1891819171 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f340c06c7c0 0x7f340c06ec80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3420009890 tx=0x7f3420008040 comp rx=0 tx=0).stop 2024-09-11T23:26:34.234 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.233+0000 7f3435600640 1 -- 172.21.15.144:0/1891819171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f343015ceb0 msgr2=0x7f34300aeb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:34.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.233+0000 7f3435600640 1 --2- 172.21.15.144:0/1891819171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f343015ceb0 0x7f34300aeb50 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f342800b9e0 tx=0x7f342800bea0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.233+0000 7f3435600640 1 -- 172.21.15.144:0/1891819171 shutdown_connections 2024-09-11T23:26:34.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.233+0000 7f3435600640 1 --2- 172.21.15.144:0/1891819171 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f340c06c7c0 0x7f340c06ec80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.233+0000 7f3435600640 1 --2- 172.21.15.144:0/1891819171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f343015ceb0 0x7f34300aeb50 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.233+0000 7f3435600640 1 --2- 172.21.15.144:0/1891819171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f343015ca40 0x7f3430156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.233+0000 7f3435600640 1 --2- 172.21.15.144:0/1891819171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f34300d02a0 0x7f34301589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.233+0000 7f3435600640 1 -- 172.21.15.144:0/1891819171 >> 172.21.15.144:0/1891819171 conn(0x7f3430062cc0 msgr2=0x7f3430154610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:34.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.233+0000 7f3435600640 1 -- 172.21.15.144:0/1891819171 shutdown_connections 2024-09-11T23:26:34.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.233+0000 7f3435600640 1 -- 172.21.15.144:0/1891819171 wait complete. 2024-09-11T23:26:34.248 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-09-11T23:26:32.774284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":224,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":271096,"kb_used_data":17416,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703624,"statfs":{"total":773094113280,"available":772816510976,"internally_reserved":0,"allocated":17833984,"data_stored":8497628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.137488"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.679024+0000","last_change":"2024-09-11T23:26:29.673345+0000","last_active":"2024-09-11T23:26:29.679024+0000","last_peered":"2024-09-11T23:26:29.679024+0000","last_clean":"2024-09-11T23:26:29.679024+0000","last_became_active":"2024-09-11T23:26:29.672025+0000","last_became_peered":"2024-09-11T23:26:29.672025+0000","last_unstale":"2024-09-11T23:26:29.679024+0000","last_undegraded":"2024-09-11T23:26:29.679024+0000","last_fullsized":"2024-09-11T23:26:29.679024+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:46.467716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.668391+0000","last_change":"2024-09-11T23:26:29.668791+0000","last_active":"2024-09-11T23:26:30.668391+0000","last_peered":"2024-09-11T23:26:30.668391+0000","last_clean":"2024-09-11T23:26:30.668391+0000","last_became_active":"2024-09-11T23:26:29.668383+0000","last_became_peered":"2024-09-11T23:26:29.668383+0000","last_unstale":"2024-09-11T23:26:30.668391+0000","last_undegraded":"2024-09-11T23:26:30.668391+0000","last_fullsized":"2024-09-11T23:26:30.668391+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:49.604844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.675083+0000","last_change":"2024-09-11T23:26:29.668702+0000","last_active":"2024-09-11T23:26:29.675083+0000","last_peered":"2024-09-11T23:26:29.675083+0000","last_clean":"2024-09-11T23:26:29.675083+0000","last_became_active":"2024-09-11T23:26:29.667948+0000","last_became_peered":"2024-09-11T23:26:29.667948+0000","last_unstale":"2024-09-11T23:26:29.675083+0000","last_undegraded":"2024-09-11T23:26:29.675083+0000","last_fullsized":"2024-09-11T23:26:29.675083+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:05.062170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.681329+0000","last_change":"2024-09-11T23:26:29.669698+0000","last_active":"2024-09-11T23:26:30.681329+0000","last_peered":"2024-09-11T23:26:30.681329+0000","last_clean":"2024-09-11T23:26:30.681329+0000","last_became_active":"2024-09-11T23:26:29.669387+0000","last_became_peered":"2024-09-11T23:26:29.669387+0000","last_unstale":"2024-09-11T23:26:30.681329+0000","last_undegraded":"2024-09-11T23:26:30.681329+0000","last_fullsized":"2024-09-11T23:26:30.681329+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:42.382145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.684798+0000","last_change":"2024-09-11T23:26:29.681587+0000","last_active":"2024-09-11T23:26:29.684798+0000","last_peered":"2024-09-11T23:26:29.684798+0000","last_clean":"2024-09-11T23:26:29.684798+0000","last_became_active":"2024-09-11T23:26:29.679732+0000","last_became_peered":"2024-09-11T23:26:29.679732+0000","last_unstale":"2024-09-11T23:26:29.684798+0000","last_undegraded":"2024-09-11T23:26:29.684798+0000","last_fullsized":"2024-09-11T23:26:29.684798+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:49.509358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.677453+0000","last_change":"2024-09-11T23:26:29.673900+0000","last_active":"2024-09-11T23:26:29.677453+0000","last_peered":"2024-09-11T23:26:29.677453+0000","last_clean":"2024-09-11T23:26:29.677453+0000","last_became_active":"2024-09-11T23:26:29.673216+0000","last_became_peered":"2024-09-11T23:26:29.673216+0000","last_unstale":"2024-09-11T23:26:29.677453+0000","last_undegraded":"2024-09-11T23:26:29.677453+0000","last_fullsized":"2024-09-11T23:26:29.677453+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:37.293148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.684340+0000","last_change":"2024-09-11T23:26:29.677926+0000","last_active":"2024-09-11T23:26:29.684340+0000","last_peered":"2024-09-11T23:26:29.684340+0000","last_clean":"2024-09-11T23:26:29.684340+0000","last_became_active":"2024-09-11T23:26:29.677661+0000","last_became_peered":"2024-09-11T23:26:29.677661+0000","last_unstale":"2024-09-11T23:26:29.684340+0000","last_undegraded":"2024-09-11T23:26:29.684340+0000","last_fullsized":"2024-09-11T23:26:29.684340+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:17.001365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.679351+0000","last_change":"2024-09-11T23:26:29.674309+0000","last_active":"2024-09-11T23:26:29.679351+0000","last_peered":"2024-09-11T23:26:29.679351+0000","last_clean":"2024-09-11T23:26:29.679351+0000","last_became_active":"2024-09-11T23:26:29.674060+0000","last_became_peered":"2024-09-11T23:26:29.674060+0000","last_unstale":"2024-09-11T23:26:29.679351+0000","last_undegraded":"2024-09-11T23:26:29.679351+0000","last_fullsized":"2024-09-11T23:26:29.679351+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:41.026223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667942+0000","last_change":"2024-09-11T23:26:29.670671+0000","last_active":"2024-09-11T23:26:30.667942+0000","last_peered":"2024-09-11T23:26:30.667942+0000","last_clean":"2024-09-11T23:26:30.667942+0000","last_became_active":"2024-09-11T23:26:29.670409+0000","last_became_peered":"2024-09-11T23:26:29.670409+0000","last_unstale":"2024-09-11T23:26:30.667942+0000","last_undegraded":"2024-09-11T23:26:30.667942+0000","last_fullsized":"2024-09-11T23:26:30.667942+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:41.480878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665520+0000","last_change":"2024-09-11T23:26:29.680364+0000","last_active":"2024-09-11T23:26:30.665520+0000","last_peered":"2024-09-11T23:26:30.665520+0000","last_clean":"2024-09-11T23:26:30.665520+0000","last_became_active":"2024-09-11T23:26:29.679519+0000","last_became_peered":"2024-09-11T23:26:29.679519+0000","last_unstale":"2024-09-11T23:26:30.665520+0000","last_undegraded":"2024-09-11T23:26:30.665520+0000","last_fullsized":"2024-09-11T23:26:30.665520+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:09.192446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.682171+0000","last_change":"2024-09-11T23:26:29.676911+0000","last_active":"2024-09-11T23:26:29.682171+0000","last_peered":"2024-09-11T23:26:29.682171+0000","last_clean":"2024-09-11T23:26:29.682171+0000","last_became_active":"2024-09-11T23:26:29.676636+0000","last_became_peered":"2024-09-11T23:26:29.676636+0000","last_unstale":"2024-09-11T23:26:29.682171+0000","last_undegraded":"2024-09-11T23:26:29.682171+0000","last_fullsized":"2024-09-11T23:26:29.682171+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:19.870077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.683800+0000","last_change":"2024-09-11T23:26:29.673260+0000","last_active":"2024-09-11T23:26:30.683800+0000","last_peered":"2024-09-11T23:26:30.683800+0000","last_clean":"2024-09-11T23:26:30.683800+0000","last_became_active":"2024-09-11T23:26:29.672066+0000","last_became_peered":"2024-09-11T23:26:29.672066+0000","last_unstale":"2024-09-11T23:26:30.683800+0000","last_undegraded":"2024-09-11T23:26:30.683800+0000","last_fullsized":"2024-09-11T23:26:30.683800+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:55.015140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.683944+0000","last_change":"2024-09-11T23:26:29.676127+0000","last_active":"2024-09-11T23:26:30.683944+0000","last_peered":"2024-09-11T23:26:30.683944+0000","last_clean":"2024-09-11T23:26:30.683944+0000","last_became_active":"2024-09-11T23:26:29.675635+0000","last_became_peered":"2024-09-11T23:26:29.675635+0000","last_unstale":"2024-09-11T23:26:30.683944+0000","last_undegraded":"2024-09-11T23:26:30.683944+0000","last_fullsized":"2024-09-11T23:26:30.683944+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:41.480878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.672191+0000","last_change":"2024-09-11T23:26:29.667311+0000","last_active":"2024-09-11T23:26:29.672191+0000","last_peered":"2024-09-11T23:26:29.672191+0000","last_clean":"2024-09-11T23:26:29.672191+0000","last_became_active":"2024-09-11T23:26:29.667006+0000","last_became_peered":"2024-09-11T23:26:29.667006+0000","last_unstale":"2024-09-11T23:26:29.672191+0000","last_undegraded":"2024-09-11T23:26:29.672191+0000","last_fullsized":"2024-09-11T23:26:29.672191+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:02.147371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.674854+0000","last_change":"2024-09-11T23:26:29.669609+0000","last_active":"2024-09-11T23:26:29.674854+0000","last_peered":"2024-09-11T23:26:29.674854+0000","last_clean":"2024-09-11T23:26:29.674854+0000","last_became_active":"2024-09-11T23:26:29.669316+0000","last_became_peered":"2024-09-11T23:26:29.669316+0000","last_unstale":"2024-09-11T23:26:29.674854+0000","last_undegraded":"2024-09-11T23:26:29.674854+0000","last_fullsized":"2024-09-11T23:26:29.674854+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:25.772465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665080+0000","last_change":"2024-09-11T23:26:29.683203+0000","last_active":"2024-09-11T23:26:30.665080+0000","last_peered":"2024-09-11T23:26:30.665080+0000","last_clean":"2024-09-11T23:26:30.665080+0000","last_became_active":"2024-09-11T23:26:29.682290+0000","last_became_peered":"2024-09-11T23:26:29.682290+0000","last_unstale":"2024-09-11T23:26:30.665080+0000","last_undegraded":"2024-09-11T23:26:30.665080+0000","last_fullsized":"2024-09-11T23:26:30.665080+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:59.642346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.671836+0000","last_change":"2024-09-11T23:26:29.665102+0000","last_active":"2024-09-11T23:26:29.671836+0000","last_peered":"2024-09-11T23:26:29.671836+0000","last_clean":"2024-09-11T23:26:29.671836+0000","last_became_active":"2024-09-11T23:26:29.664710+0000","last_became_peered":"2024-09-11T23:26:29.664710+0000","last_unstale":"2024-09-11T23:26:29.671836+0000","last_undegraded":"2024-09-11T23:26:29.671836+0000","last_fullsized":"2024-09-11T23:26:29.671836+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:47.496133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665635+0000","last_change":"2024-09-11T23:26:29.680143+0000","last_active":"2024-09-11T23:26:30.665635+0000","last_peered":"2024-09-11T23:26:30.665635+0000","last_clean":"2024-09-11T23:26:30.665635+0000","last_became_active":"2024-09-11T23:26:29.679858+0000","last_became_peered":"2024-09-11T23:26:29.679858+0000","last_unstale":"2024-09-11T23:26:30.665635+0000","last_undegraded":"2024-09-11T23:26:30.665635+0000","last_fullsized":"2024-09-11T23:26:30.665635+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:30.735337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665650+0000","last_change":"2024-09-11T23:26:29.676602+0000","last_active":"2024-09-11T23:26:30.665650+0000","last_peered":"2024-09-11T23:26:30.665650+0000","last_clean":"2024-09-11T23:26:30.665650+0000","last_became_active":"2024-09-11T23:26:29.675499+0000","last_became_peered":"2024-09-11T23:26:29.675499+0000","last_unstale":"2024-09-11T23:26:30.665650+0000","last_undegraded":"2024-09-11T23:26:30.665650+0000","last_fullsized":"2024-09-11T23:26:30.665650+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:54.567375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.677126+0000","last_change":"2024-09-11T23:26:29.674143+0000","last_active":"2024-09-11T23:26:29.677126+0000","last_peered":"2024-09-11T23:26:29.677126+0000","last_clean":"2024-09-11T23:26:29.677126+0000","last_became_active":"2024-09-11T23:26:29.673850+0000","last_became_peered":"2024-09-11T23:26:29.673850+0000","last_unstale":"2024-09-11T23:26:29.677126+0000","last_undegraded":"2024-09-11T23:26:29.677126+0000","last_fullsized":"2024-09-11T23:26:29.677126+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:17.813096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.680929+0000","last_change":"2024-09-11T23:26:29.677443+0000","last_active":"2024-09-11T23:26:30.680929+0000","last_peered":"2024-09-11T23:26:30.680929+0000","last_clean":"2024-09-11T23:26:30.680929+0000","last_became_active":"2024-09-11T23:26:29.676823+0000","last_became_peered":"2024-09-11T23:26:29.676823+0000","last_unstale":"2024-09-11T23:26:30.680929+0000","last_undegraded":"2024-09-11T23:26:30.680929+0000","last_fullsized":"2024-09-11T23:26:30.680929+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:31.212424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667171+0000","last_change":"2024-09-11T23:26:29.673840+0000","last_active":"2024-09-11T23:26:30.667171+0000","last_peered":"2024-09-11T23:26:30.667171+0000","last_clean":"2024-09-11T23:26:30.667171+0000","last_became_active":"2024-09-11T23:26:29.673509+0000","last_became_peered":"2024-09-11T23:26:29.673509+0000","last_unstale":"2024-09-11T23:26:30.667171+0000","last_undegraded":"2024-09-11T23:26:30.667171+0000","last_fullsized":"2024-09-11T23:26:30.667171+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:19.443221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667707+0000","last_change":"2024-09-11T23:26:29.667215+0000","last_active":"2024-09-11T23:26:30.667707+0000","last_peered":"2024-09-11T23:26:30.667707+0000","last_clean":"2024-09-11T23:26:30.667707+0000","last_became_active":"2024-09-11T23:26:29.666929+0000","last_became_peered":"2024-09-11T23:26:29.666929+0000","last_unstale":"2024-09-11T23:26:30.667707+0000","last_undegraded":"2024-09-11T23:26:30.667707+0000","last_fullsized":"2024-09-11T23:26:30.667707+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:45.401787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.681010+0000","last_change":"2024-09-11T23:26:29.671073+0000","last_active":"2024-09-11T23:26:30.681010+0000","last_peered":"2024-09-11T23:26:30.681010+0000","last_clean":"2024-09-11T23:26:30.681010+0000","last_became_active":"2024-09-11T23:26:29.670726+0000","last_became_peered":"2024-09-11T23:26:29.670726+0000","last_unstale":"2024-09-11T23:26:30.681010+0000","last_undegraded":"2024-09-11T23:26:30.681010+0000","last_fullsized":"2024-09-11T23:26:30.681010+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:50.570342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667671+0000","last_change":"2024-09-11T23:26:29.675030+0000","last_active":"2024-09-11T23:26:30.667671+0000","last_peered":"2024-09-11T23:26:30.667671+0000","last_clean":"2024-09-11T23:26:30.667671+0000","last_became_active":"2024-09-11T23:26:29.674738+0000","last_became_peered":"2024-09-11T23:26:29.674738+0000","last_unstale":"2024-09-11T23:26:30.667671+0000","last_undegraded":"2024-09-11T23:26:30.667671+0000","last_fullsized":"2024-09-11T23:26:30.667671+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:52.826866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.682712+0000","last_change":"2024-09-11T23:26:29.676389+0000","last_active":"2024-09-11T23:26:29.682712+0000","last_peered":"2024-09-11T23:26:29.682712+0000","last_clean":"2024-09-11T23:26:29.682712+0000","last_became_active":"2024-09-11T23:26:29.676130+0000","last_became_peered":"2024-09-11T23:26:29.676130+0000","last_unstale":"2024-09-11T23:26:29.682712+0000","last_undegraded":"2024-09-11T23:26:29.682712+0000","last_fullsized":"2024-09-11T23:26:29.682712+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:07.341688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.683837+0000","last_change":"2024-09-11T23:26:29.673571+0000","last_active":"2024-09-11T23:26:30.683837+0000","last_peered":"2024-09-11T23:26:30.683837+0000","last_clean":"2024-09-11T23:26:30.683837+0000","last_became_active":"2024-09-11T23:26:29.673261+0000","last_became_peered":"2024-09-11T23:26:29.673261+0000","last_unstale":"2024-09-11T23:26:30.683837+0000","last_undegraded":"2024-09-11T23:26:30.683837+0000","last_fullsized":"2024-09-11T23:26:30.683837+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:10.532614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.675881+0000","last_change":"2024-09-11T23:26:29.671541+0000","last_active":"2024-09-11T23:26:29.675881+0000","last_peered":"2024-09-11T23:26:29.675881+0000","last_clean":"2024-09-11T23:26:29.675881+0000","last_became_active":"2024-09-11T23:26:29.671160+0000","last_became_peered":"2024-09-11T23:26:29.671160+0000","last_unstale":"2024-09-11T23:26:29.675881+0000","last_undegraded":"2024-09-11T23:26:29.675881+0000","last_fullsized":"2024-09-11T23:26:29.675881+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:17.863698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.683713+0000","last_change":"2024-09-11T23:26:29.675898+0000","last_active":"2024-09-11T23:26:30.683713+0000","last_peered":"2024-09-11T23:26:30.683713+0000","last_clean":"2024-09-11T23:26:30.683713+0000","last_became_active":"2024-09-11T23:26:29.674214+0000","last_became_peered":"2024-09-11T23:26:29.674214+0000","last_unstale":"2024-09-11T23:26:30.683713+0000","last_undegraded":"2024-09-11T23:26:30.683713+0000","last_fullsized":"2024-09-11T23:26:30.683713+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:52.826866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667675+0000","last_change":"2024-09-11T23:26:29.671997+0000","last_active":"2024-09-11T23:26:30.667675+0000","last_peered":"2024-09-11T23:26:30.667675+0000","last_clean":"2024-09-11T23:26:30.667675+0000","last_became_active":"2024-09-11T23:26:29.671620+0000","last_became_peered":"2024-09-11T23:26:29.671620+0000","last_unstale":"2024-09-11T23:26:30.667675+0000","last_undegraded":"2024-09-11T23:26:30.667675+0000","last_fullsized":"2024-09-11T23:26:30.667675+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:55.015140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665060+0000","last_change":"2024-09-11T23:26:29.679202+0000","last_active":"2024-09-11T23:26:30.665060+0000","last_peered":"2024-09-11T23:26:30.665060+0000","last_clean":"2024-09-11T23:26:30.665060+0000","last_became_active":"2024-09-11T23:26:29.678954+0000","last_became_peered":"2024-09-11T23:26:29.678954+0000","last_unstale":"2024-09-11T23:26:30.665060+0000","last_undegraded":"2024-09-11T23:26:30.665060+0000","last_fullsized":"2024-09-11T23:26:30.665060+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:37.058073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.677339+0000","last_change":"2024-09-11T23:26:29.670076+0000","last_active":"2024-09-11T23:26:29.677339+0000","last_peered":"2024-09-11T23:26:29.677339+0000","last_clean":"2024-09-11T23:26:29.677339+0000","last_became_active":"2024-09-11T23:26:29.669781+0000","last_became_peered":"2024-09-11T23:26:29.669781+0000","last_unstale":"2024-09-11T23:26:29.677339+0000","last_undegraded":"2024-09-11T23:26:29.677339+0000","last_fullsized":"2024-09-11T23:26:29.677339+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:56.527116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.668079+0000","last_change":"2024-09-11T23:26:29.672977+0000","last_active":"2024-09-11T23:26:30.668079+0000","last_peered":"2024-09-11T23:26:30.668079+0000","last_clean":"2024-09-11T23:26:30.668079+0000","last_became_active":"2024-09-11T23:26:29.672671+0000","last_became_peered":"2024-09-11T23:26:29.672671+0000","last_unstale":"2024-09-11T23:26:30.668079+0000","last_undegraded":"2024-09-11T23:26:30.668079+0000","last_fullsized":"2024-09-11T23:26:30.668079+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:43.911542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"165'4","reported_seq":18,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.683951+0000","last_change":"2024-09-11T23:26:28.658509+0000","last_active":"2024-09-11T23:26:30.683951+0000","last_peered":"2024-09-11T23:26:30.683951+0000","last_clean":"2024-09-11T23:26:30.683951+0000","last_became_active":"2024-09-11T23:26:28.658201+0000","last_became_peered":"2024-09-11T23:26:28.658201+0000","last_unstale":"2024-09-11T23:26:30.683951+0000","last_undegraded":"2024-09-11T23:26:30.683951+0000","last_fullsized":"2024-09-11T23:26:30.683951+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:11.840374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667110+0000","last_change":"2024-09-11T23:26:29.677235+0000","last_active":"2024-09-11T23:26:30.667110+0000","last_peered":"2024-09-11T23:26:30.667110+0000","last_clean":"2024-09-11T23:26:30.667110+0000","last_became_active":"2024-09-11T23:26:29.676873+0000","last_became_peered":"2024-09-11T23:26:29.676873+0000","last_unstale":"2024-09-11T23:26:30.667110+0000","last_undegraded":"2024-09-11T23:26:30.667110+0000","last_fullsized":"2024-09-11T23:26:30.667110+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:43.905288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"165'1","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.668230+0000","last_change":"2024-09-11T23:26:28.653126+0000","last_active":"2024-09-11T23:26:30.668230+0000","last_peered":"2024-09-11T23:26:30.668230+0000","last_clean":"2024-09-11T23:26:30.668230+0000","last_became_active":"2024-09-11T23:26:28.652838+0000","last_became_peered":"2024-09-11T23:26:28.652838+0000","last_unstale":"2024-09-11T23:26:30.668230+0000","last_undegraded":"2024-09-11T23:26:30.668230+0000","last_fullsized":"2024-09-11T23:26:30.668230+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:29.478169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.684420+0000","last_change":"2024-09-11T23:26:29.677790+0000","last_active":"2024-09-11T23:26:29.684420+0000","last_peered":"2024-09-11T23:26:29.684420+0000","last_clean":"2024-09-11T23:26:29.684420+0000","last_became_active":"2024-09-11T23:26:29.677280+0000","last_became_peered":"2024-09-11T23:26:29.677280+0000","last_unstale":"2024-09-11T23:26:29.684420+0000","last_undegraded":"2024-09-11T23:26:29.684420+0000","last_fullsized":"2024-09-11T23:26:29.684420+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:48.269141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"165'2","reported_seq":14,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.693982+0000","last_change":"2024-09-11T23:26:28.663136+0000","last_active":"2024-09-11T23:26:29.693982+0000","last_peered":"2024-09-11T23:26:29.693982+0000","last_clean":"2024-09-11T23:26:29.693982+0000","last_became_active":"2024-09-11T23:26:28.662881+0000","last_became_peered":"2024-09-11T23:26:28.662881+0000","last_unstale":"2024-09-11T23:26:29.693982+0000","last_undegraded":"2024-09-11T23:26:29.693982+0000","last_fullsized":"2024-09-11T23:26:29.693982+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:19.188710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665447+0000","last_change":"2024-09-11T23:26:29.676844+0000","last_active":"2024-09-11T23:26:30.665447+0000","last_peered":"2024-09-11T23:26:30.665447+0000","last_clean":"2024-09-11T23:26:30.665447+0000","last_became_active":"2024-09-11T23:26:29.676310+0000","last_became_peered":"2024-09-11T23:26:29.676310+0000","last_unstale":"2024-09-11T23:26:30.665447+0000","last_undegraded":"2024-09-11T23:26:30.665447+0000","last_fullsized":"2024-09-11T23:26:30.665447+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:57.345491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"165'2","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.681382+0000","last_change":"2024-09-11T23:26:28.659283+0000","last_active":"2024-09-11T23:26:30.681382+0000","last_peered":"2024-09-11T23:26:30.681382+0000","last_clean":"2024-09-11T23:26:30.681382+0000","last_became_active":"2024-09-11T23:26:28.658941+0000","last_became_peered":"2024-09-11T23:26:28.658941+0000","last_unstale":"2024-09-11T23:26:30.681382+0000","last_undegraded":"2024-09-11T23:26:30.681382+0000","last_fullsized":"2024-09-11T23:26:30.681382+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:40.020031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.681139+0000","last_change":"2024-09-11T23:26:29.677780+0000","last_active":"2024-09-11T23:26:30.681139+0000","last_peered":"2024-09-11T23:26:30.681139+0000","last_clean":"2024-09-11T23:26:30.681139+0000","last_became_active":"2024-09-11T23:26:29.677454+0000","last_became_peered":"2024-09-11T23:26:29.677454+0000","last_unstale":"2024-09-11T23:26:30.681139+0000","last_undegraded":"2024-09-11T23:26:30.681139+0000","last_fullsized":"2024-09-11T23:26:30.681139+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:00.484937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"165'1","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.687831+0000","last_change":"2024-09-11T23:26:28.662535+0000","last_active":"2024-09-11T23:26:29.687831+0000","last_peered":"2024-09-11T23:26:29.687831+0000","last_clean":"2024-09-11T23:26:29.687831+0000","last_became_active":"2024-09-11T23:26:28.662007+0000","last_became_peered":"2024-09-11T23:26:28.662007+0000","last_unstale":"2024-09-11T23:26:29.687831+0000","last_undegraded":"2024-09-11T23:26:29.687831+0000","last_fullsized":"2024-09-11T23:26:29.687831+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:42.899096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.671145+0000","last_change":"2024-09-11T23:26:29.667833+0000","last_active":"2024-09-11T23:26:29.671145+0000","last_peered":"2024-09-11T23:26:29.671145+0000","last_clean":"2024-09-11T23:26:29.671145+0000","last_became_active":"2024-09-11T23:26:29.667452+0000","last_became_peered":"2024-09-11T23:26:29.667452+0000","last_unstale":"2024-09-11T23:26:29.671145+0000","last_undegraded":"2024-09-11T23:26:29.671145+0000","last_fullsized":"2024-09-11T23:26:29.671145+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:39.177247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.659648+0000","last_change":"2024-09-11T23:26:28.658142+0000","last_active":"2024-09-11T23:26:29.659648+0000","last_peered":"2024-09-11T23:26:29.659648+0000","last_clean":"2024-09-11T23:26:29.659648+0000","last_became_active":"2024-09-11T23:26:28.657846+0000","last_became_peered":"2024-09-11T23:26:28.657846+0000","last_unstale":"2024-09-11T23:26:29.659648+0000","last_undegraded":"2024-09-11T23:26:29.659648+0000","last_fullsized":"2024-09-11T23:26:29.659648+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:56.586565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.680926+0000","last_change":"2024-09-11T23:26:29.675365+0000","last_active":"2024-09-11T23:26:30.680926+0000","last_peered":"2024-09-11T23:26:30.680926+0000","last_clean":"2024-09-11T23:26:30.680926+0000","last_became_active":"2024-09-11T23:26:29.675050+0000","last_became_peered":"2024-09-11T23:26:29.675050+0000","last_unstale":"2024-09-11T23:26:30.680926+0000","last_undegraded":"2024-09-11T23:26:30.680926+0000","last_fullsized":"2024-09-11T23:26:30.680926+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:49.112499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.666570+0000","last_change":"2024-09-11T23:26:28.663545+0000","last_active":"2024-09-11T23:26:30.666570+0000","last_peered":"2024-09-11T23:26:30.666570+0000","last_clean":"2024-09-11T23:26:30.666570+0000","last_became_active":"2024-09-11T23:26:28.662805+0000","last_became_peered":"2024-09-11T23:26:28.662805+0000","last_unstale":"2024-09-11T23:26:30.666570+0000","last_undegraded":"2024-09-11T23:26:30.666570+0000","last_fullsized":"2024-09-11T23:26:30.666570+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:57.392853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.681191+0000","last_change":"2024-09-11T23:26:29.684815+0000","last_active":"2024-09-11T23:26:30.681191+0000","last_peered":"2024-09-11T23:26:30.681191+0000","last_clean":"2024-09-11T23:26:30.681191+0000","last_became_active":"2024-09-11T23:26:29.684470+0000","last_became_peered":"2024-09-11T23:26:29.684470+0000","last_unstale":"2024-09-11T23:26:30.681191+0000","last_undegraded":"2024-09-11T23:26:30.681191+0000","last_fullsized":"2024-09-11T23:26:30.681191+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:55.403904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.662366+0000","last_change":"2024-09-11T23:26:28.649515+0000","last_active":"2024-09-11T23:26:29.662366+0000","last_peered":"2024-09-11T23:26:29.662366+0000","last_clean":"2024-09-11T23:26:29.662366+0000","last_became_active":"2024-09-11T23:26:28.647322+0000","last_became_peered":"2024-09-11T23:26:28.647322+0000","last_unstale":"2024-09-11T23:26:29.662366+0000","last_undegraded":"2024-09-11T23:26:29.662366+0000","last_fullsized":"2024-09-11T23:26:29.662366+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:44.395595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.682224+0000","last_change":"2024-09-11T23:26:29.678105+0000","last_active":"2024-09-11T23:26:29.682224+0000","last_peered":"2024-09-11T23:26:29.682224+0000","last_clean":"2024-09-11T23:26:29.682224+0000","last_became_active":"2024-09-11T23:26:29.677855+0000","last_became_peered":"2024-09-11T23:26:29.677855+0000","last_unstale":"2024-09-11T23:26:29.682224+0000","last_undegraded":"2024-09-11T23:26:29.682224+0000","last_fullsized":"2024-09-11T23:26:29.682224+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:46.043066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667126+0000","last_change":"2024-09-11T23:26:28.659883+0000","last_active":"2024-09-11T23:26:30.667126+0000","last_peered":"2024-09-11T23:26:30.667126+0000","last_clean":"2024-09-11T23:26:30.667126+0000","last_became_active":"2024-09-11T23:26:28.659490+0000","last_became_peered":"2024-09-11T23:26:28.659490+0000","last_unstale":"2024-09-11T23:26:30.667126+0000","last_undegraded":"2024-09-11T23:26:30.667126+0000","last_fullsized":"2024-09-11T23:26:30.667126+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:41.164797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.681294+0000","last_change":"2024-09-11T23:26:29.680954+0000","last_active":"2024-09-11T23:26:30.681294+0000","last_peered":"2024-09-11T23:26:30.681294+0000","last_clean":"2024-09-11T23:26:30.681294+0000","last_became_active":"2024-09-11T23:26:29.680681+0000","last_became_peered":"2024-09-11T23:26:29.680681+0000","last_unstale":"2024-09-11T23:26:30.681294+0000","last_undegraded":"2024-09-11T23:26:30.681294+0000","last_fullsized":"2024-09-11T23:26:30.681294+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:16.950095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"165'3","reported_seq":17,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665613+0000","last_change":"2024-09-11T23:26:28.660160+0000","last_active":"2024-09-11T23:26:30.665613+0000","last_peered":"2024-09-11T23:26:30.665613+0000","last_clean":"2024-09-11T23:26:30.665613+0000","last_became_active":"2024-09-11T23:26:28.659605+0000","last_became_peered":"2024-09-11T23:26:28.659605+0000","last_unstale":"2024-09-11T23:26:30.665613+0000","last_undegraded":"2024-09-11T23:26:30.665613+0000","last_fullsized":"2024-09-11T23:26:30.665613+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:01.209371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.677443+0000","last_change":"2024-09-11T23:26:29.670046+0000","last_active":"2024-09-11T23:26:29.677443+0000","last_peered":"2024-09-11T23:26:29.677443+0000","last_clean":"2024-09-11T23:26:29.677443+0000","last_became_active":"2024-09-11T23:26:29.669238+0000","last_became_peered":"2024-09-11T23:26:29.669238+0000","last_unstale":"2024-09-11T23:26:29.677443+0000","last_undegraded":"2024-09-11T23:26:29.677443+0000","last_fullsized":"2024-09-11T23:26:29.677443+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:57.290027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"165'6","reported_seq":20,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.681429+0000","last_change":"2024-09-11T23:26:28.661776+0000","last_active":"2024-09-11T23:26:30.681429+0000","last_peered":"2024-09-11T23:26:30.681429+0000","last_clean":"2024-09-11T23:26:30.681429+0000","last_became_active":"2024-09-11T23:26:28.661468+0000","last_became_peered":"2024-09-11T23:26:28.661468+0000","last_unstale":"2024-09-11T23:26:30.681429+0000","last_undegraded":"2024-09-11T23:26:30.681429+0000","last_fullsized":"2024-09-11T23:26:30.681429+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:00.692120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.684642+0000","last_change":"2024-09-11T23:26:29.678739+0000","last_active":"2024-09-11T23:26:29.684642+0000","last_peered":"2024-09-11T23:26:29.684642+0000","last_clean":"2024-09-11T23:26:29.684642+0000","last_became_active":"2024-09-11T23:26:29.678221+0000","last_became_peered":"2024-09-11T23:26:29.678221+0000","last_unstale":"2024-09-11T23:26:29.684642+0000","last_undegraded":"2024-09-11T23:26:29.684642+0000","last_fullsized":"2024-09-11T23:26:29.684642+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:01.698312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"165'2","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.666671+0000","last_change":"2024-09-11T23:26:28.662515+0000","last_active":"2024-09-11T23:26:30.666671+0000","last_peered":"2024-09-11T23:26:30.666671+0000","last_clean":"2024-09-11T23:26:30.666671+0000","last_became_active":"2024-09-11T23:26:28.658398+0000","last_became_peered":"2024-09-11T23:26:28.658398+0000","last_unstale":"2024-09-11T23:26:30.666671+0000","last_undegraded":"2024-09-11T23:26:30.666671+0000","last_fullsized":"2024-09-11T23:26:30.666671+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:12.129377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665513+0000","last_change":"2024-09-11T23:26:29.688968+0000","last_active":"2024-09-11T23:26:30.665513+0000","last_peered":"2024-09-11T23:26:30.665513+0000","last_clean":"2024-09-11T23:26:30.665513+0000","last_became_active":"2024-09-11T23:26:29.688570+0000","last_became_peered":"2024-09-11T23:26:29.688570+0000","last_unstale":"2024-09-11T23:26:30.665513+0000","last_undegraded":"2024-09-11T23:26:30.665513+0000","last_fullsized":"2024-09-11T23:26:30.665513+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:20.711415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667348+0000","last_change":"2024-09-11T23:26:28.665094+0000","last_active":"2024-09-11T23:26:30.667348+0000","last_peered":"2024-09-11T23:26:30.667348+0000","last_clean":"2024-09-11T23:26:30.667348+0000","last_became_active":"2024-09-11T23:26:28.664832+0000","last_became_peered":"2024-09-11T23:26:28.664832+0000","last_unstale":"2024-09-11T23:26:30.667348+0000","last_undegraded":"2024-09-11T23:26:30.667348+0000","last_fullsized":"2024-09-11T23:26:30.667348+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:41.875389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.684368+0000","last_change":"2024-09-11T23:26:29.678758+0000","last_active":"2024-09-11T23:26:29.684368+0000","last_peered":"2024-09-11T23:26:29.684368+0000","last_clean":"2024-09-11T23:26:29.684368+0000","last_became_active":"2024-09-11T23:26:29.678495+0000","last_became_peered":"2024-09-11T23:26:29.678495+0000","last_unstale":"2024-09-11T23:26:29.684368+0000","last_undegraded":"2024-09-11T23:26:29.684368+0000","last_fullsized":"2024-09-11T23:26:29.684368+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:40.712018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665021+0000","last_change":"2024-09-11T23:26:28.659184+0000","last_active":"2024-09-11T23:26:30.665021+0000","last_peered":"2024-09-11T23:26:30.665021+0000","last_clean":"2024-09-11T23:26:30.665021+0000","last_became_active":"2024-09-11T23:26:28.658921+0000","last_became_peered":"2024-09-11T23:26:28.658921+0000","last_unstale":"2024-09-11T23:26:30.665021+0000","last_undegraded":"2024-09-11T23:26:30.665021+0000","last_fullsized":"2024-09-11T23:26:30.665021+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:22.462502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.672274+0000","last_change":"2024-09-11T23:26:29.667720+0000","last_active":"2024-09-11T23:26:29.672274+0000","last_peered":"2024-09-11T23:26:29.672274+0000","last_clean":"2024-09-11T23:26:29.672274+0000","last_became_active":"2024-09-11T23:26:29.665589+0000","last_became_peered":"2024-09-11T23:26:29.665589+0000","last_unstale":"2024-09-11T23:26:29.672274+0000","last_undegraded":"2024-09-11T23:26:29.672274+0000","last_fullsized":"2024-09-11T23:26:29.672274+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.985234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"165'8","reported_seq":20,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.694605+0000","last_change":"2024-09-11T23:26:28.660544+0000","last_active":"2024-09-11T23:26:29.694605+0000","last_peered":"2024-09-11T23:26:29.694605+0000","last_clean":"2024-09-11T23:26:29.694605+0000","last_became_active":"2024-09-11T23:26:28.660291+0000","last_became_peered":"2024-09-11T23:26:28.660291+0000","last_unstale":"2024-09-11T23:26:29.694605+0000","last_undegraded":"2024-09-11T23:26:29.694605+0000","last_fullsized":"2024-09-11T23:26:29.694605+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:33.924099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.668173+0000","last_change":"2024-09-11T23:26:29.670045+0000","last_active":"2024-09-11T23:26:30.668173+0000","last_peered":"2024-09-11T23:26:30.668173+0000","last_clean":"2024-09-11T23:26:30.668173+0000","last_became_active":"2024-09-11T23:26:29.669155+0000","last_became_peered":"2024-09-11T23:26:29.669155+0000","last_unstale":"2024-09-11T23:26:30.668173+0000","last_undegraded":"2024-09-11T23:26:30.668173+0000","last_fullsized":"2024-09-11T23:26:30.668173+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:57.592757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"165'1","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.691198+0000","last_change":"2024-09-11T23:26:28.663454+0000","last_active":"2024-09-11T23:26:29.691198+0000","last_peered":"2024-09-11T23:26:29.691198+0000","last_clean":"2024-09-11T23:26:29.691198+0000","last_became_active":"2024-09-11T23:26:28.663173+0000","last_became_peered":"2024-09-11T23:26:28.663173+0000","last_unstale":"2024-09-11T23:26:29.691198+0000","last_undegraded":"2024-09-11T23:26:29.691198+0000","last_fullsized":"2024-09-11T23:26:29.691198+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:05.905525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667829+0000","last_change":"2024-09-11T23:26:29.674803+0000","last_active":"2024-09-11T23:26:30.667829+0000","last_peered":"2024-09-11T23:26:30.667829+0000","last_clean":"2024-09-11T23:26:30.667829+0000","last_became_active":"2024-09-11T23:26:29.674314+0000","last_became_peered":"2024-09-11T23:26:29.674314+0000","last_unstale":"2024-09-11T23:26:30.667829+0000","last_undegraded":"2024-09-11T23:26:30.667829+0000","last_fullsized":"2024-09-11T23:26:30.667829+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:10.532614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"165'2","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.668287+0000","last_change":"2024-09-11T23:26:28.662956+0000","last_active":"2024-09-11T23:26:30.668287+0000","last_peered":"2024-09-11T23:26:30.668287+0000","last_clean":"2024-09-11T23:26:30.668287+0000","last_became_active":"2024-09-11T23:26:28.662604+0000","last_became_peered":"2024-09-11T23:26:28.662604+0000","last_unstale":"2024-09-11T23:26:30.668287+0000","last_undegraded":"2024-09-11T23:26:30.668287+0000","last_fullsized":"2024-09-11T23:26:30.668287+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:52.034359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.687123+0000","last_change":"2024-09-11T23:26:29.684138+0000","last_active":"2024-09-11T23:26:29.687123+0000","last_peered":"2024-09-11T23:26:29.687123+0000","last_clean":"2024-09-11T23:26:29.687123+0000","last_became_active":"2024-09-11T23:26:29.683802+0000","last_became_peered":"2024-09-11T23:26:29.683802+0000","last_unstale":"2024-09-11T23:26:29.687123+0000","last_undegraded":"2024-09-11T23:26:29.687123+0000","last_fullsized":"2024-09-11T23:26:29.687123+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:37.497451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"165'1","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665716+0000","last_change":"2024-09-11T23:26:28.661089+0000","last_active":"2024-09-11T23:26:30.665716+0000","last_peered":"2024-09-11T23:26:30.665716+0000","last_clean":"2024-09-11T23:26:30.665716+0000","last_became_active":"2024-09-11T23:26:28.660164+0000","last_became_peered":"2024-09-11T23:26:28.660164+0000","last_unstale":"2024-09-11T23:26:30.665716+0000","last_undegraded":"2024-09-11T23:26:30.665716+0000","last_fullsized":"2024-09-11T23:26:30.665716+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:05.946031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665475+0000","last_change":"2024-09-11T23:26:29.678044+0000","last_active":"2024-09-11T23:26:30.665475+0000","last_peered":"2024-09-11T23:26:30.665475+0000","last_clean":"2024-09-11T23:26:30.665475+0000","last_became_active":"2024-09-11T23:26:29.677800+0000","last_became_peered":"2024-09-11T23:26:29.677800+0000","last_unstale":"2024-09-11T23:26:30.665475+0000","last_undegraded":"2024-09-11T23:26:30.665475+0000","last_fullsized":"2024-09-11T23:26:30.665475+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:11.998579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.668564+0000","last_change":"2024-09-11T23:26:28.667298+0000","last_active":"2024-09-11T23:26:29.668564+0000","last_peered":"2024-09-11T23:26:29.668564+0000","last_clean":"2024-09-11T23:26:29.668564+0000","last_became_active":"2024-09-11T23:26:28.666967+0000","last_became_peered":"2024-09-11T23:26:28.666967+0000","last_unstale":"2024-09-11T23:26:29.668564+0000","last_undegraded":"2024-09-11T23:26:29.668564+0000","last_fullsized":"2024-09-11T23:26:29.668564+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:28:34.009699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665203+0000","last_change":"2024-09-11T23:26:29.673057+0000","last_active":"2024-09-11T23:26:30.665203+0000","last_peered":"2024-09-11T23:26:30.665203+0000","last_clean":"2024-09-11T23:26:30.665203+0000","last_became_active":"2024-09-11T23:26:29.672280+0000","last_became_peered":"2024-09-11T23:26:29.672280+0000","last_unstale":"2024-09-11T23:26:30.665203+0000","last_undegraded":"2024-09-11T23:26:30.665203+0000","last_fullsized":"2024-09-11T23:26:30.665203+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:19:20.837332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"165'2","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.665354+0000","last_change":"2024-09-11T23:26:28.660988+0000","last_active":"2024-09-11T23:26:30.665354+0000","last_peered":"2024-09-11T23:26:30.665354+0000","last_clean":"2024-09-11T23:26:30.665354+0000","last_became_active":"2024-09-11T23:26:28.660672+0000","last_became_peered":"2024-09-11T23:26:28.660672+0000","last_unstale":"2024-09-11T23:26:30.665354+0000","last_undegraded":"2024-09-11T23:26:30.665354+0000","last_fullsized":"2024-09-11T23:26:30.665354+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:07.783860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.677170+0000","last_change":"2024-09-11T23:26:29.674203+0000","last_active":"2024-09-11T23:26:29.677170+0000","last_peered":"2024-09-11T23:26:29.677170+0000","last_clean":"2024-09-11T23:26:29.677170+0000","last_became_active":"2024-09-11T23:26:29.673579+0000","last_became_peered":"2024-09-11T23:26:29.673579+0000","last_unstale":"2024-09-11T23:26:29.677170+0000","last_undegraded":"2024-09-11T23:26:29.677170+0000","last_fullsized":"2024-09-11T23:26:29.677170+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:36.629835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.656491+0000","last_change":"2024-09-11T23:26:28.655914+0000","last_active":"2024-09-11T23:26:29.656491+0000","last_peered":"2024-09-11T23:26:29.656491+0000","last_clean":"2024-09-11T23:26:29.656491+0000","last_became_active":"2024-09-11T23:26:28.654901+0000","last_became_peered":"2024-09-11T23:26:28.654901+0000","last_unstale":"2024-09-11T23:26:29.656491+0000","last_undegraded":"2024-09-11T23:26:29.656491+0000","last_fullsized":"2024-09-11T23:26:29.656491+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:28.212641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.666823+0000","last_change":"2024-09-11T23:26:29.668993+0000","last_active":"2024-09-11T23:26:30.666823+0000","last_peered":"2024-09-11T23:26:30.666823+0000","last_clean":"2024-09-11T23:26:30.666823+0000","last_became_active":"2024-09-11T23:26:29.668620+0000","last_became_peered":"2024-09-11T23:26:29.668620+0000","last_unstale":"2024-09-11T23:26:30.666823+0000","last_undegraded":"2024-09-11T23:26:30.666823+0000","last_fullsized":"2024-09-11T23:26:30.666823+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:42.170989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.656189+0000","last_change":"2024-09-11T23:26:28.661894+0000","last_active":"2024-09-11T23:26:29.656189+0000","last_peered":"2024-09-11T23:26:29.656189+0000","last_clean":"2024-09-11T23:26:29.656189+0000","last_became_active":"2024-09-11T23:26:28.661628+0000","last_became_peered":"2024-09-11T23:26:28.661628+0000","last_unstale":"2024-09-11T23:26:29.656189+0000","last_undegraded":"2024-09-11T23:26:29.656189+0000","last_fullsized":"2024-09-11T23:26:29.656189+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:10.333324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667862+0000","last_change":"2024-09-11T23:26:29.678009+0000","last_active":"2024-09-11T23:26:30.667862+0000","last_peered":"2024-09-11T23:26:30.667862+0000","last_clean":"2024-09-11T23:26:30.667862+0000","last_became_active":"2024-09-11T23:26:29.675760+0000","last_became_peered":"2024-09-11T23:26:29.675760+0000","last_unstale":"2024-09-11T23:26:30.667862+0000","last_undegraded":"2024-09-11T23:26:30.667862+0000","last_fullsized":"2024-09-11T23:26:30.667862+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:06.911717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.663672+0000","last_change":"2024-09-11T23:26:28.660356+0000","last_active":"2024-09-11T23:26:29.663672+0000","last_peered":"2024-09-11T23:26:29.663672+0000","last_clean":"2024-09-11T23:26:29.663672+0000","last_became_active":"2024-09-11T23:26:28.660084+0000","last_became_peered":"2024-09-11T23:26:28.660084+0000","last_unstale":"2024-09-11T23:26:29.663672+0000","last_undegraded":"2024-09-11T23:26:29.663672+0000","last_fullsized":"2024-09-11T23:26:29.663672+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:22.771870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.683966+0000","last_change":"2024-09-11T23:26:29.674028+0000","last_active":"2024-09-11T23:26:30.683966+0000","last_peered":"2024-09-11T23:26:30.683966+0000","last_clean":"2024-09-11T23:26:30.683966+0000","last_became_active":"2024-09-11T23:26:29.671895+0000","last_became_peered":"2024-09-11T23:26:29.671895+0000","last_unstale":"2024-09-11T23:26:30.683966+0000","last_undegraded":"2024-09-11T23:26:30.683966+0000","last_fullsized":"2024-09-11T23:26:30.683966+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:43.911542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"165'2","reported_seq":14,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.694139+0000","last_change":"2024-09-11T23:26:28.665927+0000","last_active":"2024-09-11T23:26:29.694139+0000","last_peered":"2024-09-11T23:26:29.694139+0000","last_clean":"2024-09-11T23:26:29.694139+0000","last_became_active":"2024-09-11T23:26:28.665625+0000","last_became_peered":"2024-09-11T23:26:28.665625+0000","last_unstale":"2024-09-11T23:26:29.694139+0000","last_undegraded":"2024-09-11T23:26:29.694139+0000","last_fullsized":"2024-09-11T23:26:29.694139+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:52.049199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.682638+0000","last_change":"2024-09-11T23:26:29.675874+0000","last_active":"2024-09-11T23:26:29.682638+0000","last_peered":"2024-09-11T23:26:29.682638+0000","last_clean":"2024-09-11T23:26:29.682638+0000","last_became_active":"2024-09-11T23:26:29.675220+0000","last_became_peered":"2024-09-11T23:26:29.675220+0000","last_unstale":"2024-09-11T23:26:29.682638+0000","last_undegraded":"2024-09-11T23:26:29.682638+0000","last_fullsized":"2024-09-11T23:26:29.682638+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:07.493152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"166'1","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.682984+0000","last_change":"2024-09-11T23:26:28.657787+0000","last_active":"2024-09-11T23:26:30.682984+0000","last_peered":"2024-09-11T23:26:30.682984+0000","last_clean":"2024-09-11T23:26:30.682984+0000","last_became_active":"2024-09-11T23:26:28.657389+0000","last_became_peered":"2024-09-11T23:26:28.657389+0000","last_unstale":"2024-09-11T23:26:30.682984+0000","last_undegraded":"2024-09-11T23:26:30.682984+0000","last_fullsized":"2024-09-11T23:26:30.682984+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:37.137426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667506+0000","last_change":"2024-09-11T23:26:29.666548+0000","last_active":"2024-09-11T23:26:30.667506+0000","last_peered":"2024-09-11T23:26:30.667506+0000","last_clean":"2024-09-11T23:26:30.667506+0000","last_became_active":"2024-09-11T23:26:29.666197+0000","last_became_peered":"2024-09-11T23:26:29.666197+0000","last_unstale":"2024-09-11T23:26:30.667506+0000","last_undegraded":"2024-09-11T23:26:30.667506+0000","last_fullsized":"2024-09-11T23:26:30.667506+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:40.007803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.659961+0000","last_change":"2024-09-11T23:26:28.663273+0000","last_active":"2024-09-11T23:26:29.659961+0000","last_peered":"2024-09-11T23:26:29.659961+0000","last_clean":"2024-09-11T23:26:29.659961+0000","last_became_active":"2024-09-11T23:26:28.663035+0000","last_became_peered":"2024-09-11T23:26:28.663035+0000","last_unstale":"2024-09-11T23:26:29.659961+0000","last_undegraded":"2024-09-11T23:26:29.659961+0000","last_fullsized":"2024-09-11T23:26:29.659961+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:48.598652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.666802+0000","last_change":"2024-09-11T23:26:29.663711+0000","last_active":"2024-09-11T23:26:30.666802+0000","last_peered":"2024-09-11T23:26:30.666802+0000","last_clean":"2024-09-11T23:26:30.666802+0000","last_became_active":"2024-09-11T23:26:29.663052+0000","last_became_peered":"2024-09-11T23:26:29.663052+0000","last_unstale":"2024-09-11T23:26:30.666802+0000","last_undegraded":"2024-09-11T23:26:30.666802+0000","last_fullsized":"2024-09-11T23:26:30.666802+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:49.604844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.668582+0000","last_change":"2024-09-11T23:26:28.666022+0000","last_active":"2024-09-11T23:26:29.668582+0000","last_peered":"2024-09-11T23:26:29.668582+0000","last_clean":"2024-09-11T23:26:29.668582+0000","last_became_active":"2024-09-11T23:26:28.665713+0000","last_became_peered":"2024-09-11T23:26:28.665713+0000","last_unstale":"2024-09-11T23:26:29.668582+0000","last_undegraded":"2024-09-11T23:26:29.668582+0000","last_fullsized":"2024-09-11T23:26:29.668582+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:01.611112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.682217+0000","last_change":"2024-09-11T23:26:29.674905+0000","last_active":"2024-09-11T23:26:29.682217+0000","last_peered":"2024-09-11T23:26:29.682217+0000","last_clean":"2024-09-11T23:26:29.682217+0000","last_became_active":"2024-09-11T23:26:29.674649+0000","last_became_peered":"2024-09-11T23:26:29.674649+0000","last_unstale":"2024-09-11T23:26:29.682217+0000","last_undegraded":"2024-09-11T23:26:29.682217+0000","last_fullsized":"2024-09-11T23:26:29.682217+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:08.917952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.681055+0000","last_change":"2024-09-11T23:26:28.656495+0000","last_active":"2024-09-11T23:26:30.681055+0000","last_peered":"2024-09-11T23:26:30.681055+0000","last_clean":"2024-09-11T23:26:30.681055+0000","last_became_active":"2024-09-11T23:26:28.656109+0000","last_became_peered":"2024-09-11T23:26:28.656109+0000","last_unstale":"2024-09-11T23:26:30.681055+0000","last_undegraded":"2024-09-11T23:26:30.681055+0000","last_fullsized":"2024-09-11T23:26:30.681055+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:48.503166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.683688+0000","last_change":"2024-09-11T23:26:29.676061+0000","last_active":"2024-09-11T23:26:30.683688+0000","last_peered":"2024-09-11T23:26:30.683688+0000","last_clean":"2024-09-11T23:26:30.683688+0000","last_became_active":"2024-09-11T23:26:29.675327+0000","last_became_peered":"2024-09-11T23:26:29.675327+0000","last_unstale":"2024-09-11T23:26:30.683688+0000","last_undegraded":"2024-09-11T23:26:30.683688+0000","last_fullsized":"2024-09-11T23:26:30.683688+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:40.007803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.661075+0000","last_change":"2024-09-11T23:26:28.662331+0000","last_active":"2024-09-11T23:26:29.661075+0000","last_peered":"2024-09-11T23:26:29.661075+0000","last_clean":"2024-09-11T23:26:29.661075+0000","last_became_active":"2024-09-11T23:26:28.661608+0000","last_became_peered":"2024-09-11T23:26:28.661608+0000","last_unstale":"2024-09-11T23:26:29.661075+0000","last_undegraded":"2024-09-11T23:26:29.661075+0000","last_fullsized":"2024-09-11T23:26:29.661075+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:18.437029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.684507+0000","last_change":"2024-09-11T23:26:29.679438+0000","last_active":"2024-09-11T23:26:29.684507+0000","last_peered":"2024-09-11T23:26:29.684507+0000","last_clean":"2024-09-11T23:26:29.684507+0000","last_became_active":"2024-09-11T23:26:29.679138+0000","last_became_peered":"2024-09-11T23:26:29.679138+0000","last_unstale":"2024-09-11T23:26:29.684507+0000","last_undegraded":"2024-09-11T23:26:29.684507+0000","last_fullsized":"2024-09-11T23:26:29.684507+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:26.061150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.667961+0000","last_change":"2024-09-11T23:26:28.663233+0000","last_active":"2024-09-11T23:26:30.667961+0000","last_peered":"2024-09-11T23:26:30.667961+0000","last_clean":"2024-09-11T23:26:30.667961+0000","last_became_active":"2024-09-11T23:26:28.662206+0000","last_became_peered":"2024-09-11T23:26:28.662206+0000","last_unstale":"2024-09-11T23:26:30.667961+0000","last_undegraded":"2024-09-11T23:26:30.667961+0000","last_fullsized":"2024-09-11T23:26:30.667961+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:39.001611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.666850+0000","last_change":"2024-09-11T23:26:29.676267+0000","last_active":"2024-09-11T23:26:30.666850+0000","last_peered":"2024-09-11T23:26:30.666850+0000","last_clean":"2024-09-11T23:26:30.666850+0000","last_became_active":"2024-09-11T23:26:29.674953+0000","last_became_peered":"2024-09-11T23:26:29.674953+0000","last_unstale":"2024-09-11T23:26:30.666850+0000","last_undegraded":"2024-09-11T23:26:30.666850+0000","last_fullsized":"2024-09-11T23:26:30.666850+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:58.399045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.683541+0000","last_change":"2024-09-11T23:26:28.656532+0000","last_active":"2024-09-11T23:26:30.683541+0000","last_peered":"2024-09-11T23:26:30.683541+0000","last_clean":"2024-09-11T23:26:30.683541+0000","last_became_active":"2024-09-11T23:26:28.656146+0000","last_became_peered":"2024-09-11T23:26:28.656146+0000","last_unstale":"2024-09-11T23:26:30.683541+0000","last_undegraded":"2024-09-11T23:26:30.683541+0000","last_fullsized":"2024-09-11T23:26:30.683541+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:39.177768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-11T23:26:29.680108+0000","last_change":"2024-09-11T23:26:29.670601+0000","last_active":"2024-09-11T23:26:29.680108+0000","last_peered":"2024-09-11T23:26:29.680108+0000","last_clean":"2024-09-11T23:26:29.680108+0000","last_became_active":"2024-09-11T23:26:29.670314+0000","last_became_peered":"2024-09-11T23:26:29.670314+0000","last_unstale":"2024-09-11T23:26:29.680108+0000","last_undegraded":"2024-09-11T23:26:29.680108+0000","last_fullsized":"2024-09-11T23:26:29.680108+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:28.635386+0000","last_clean_scrub_stamp":"2024-09-11T23:26:28.635386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:37:34.430206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"165'1","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.683872+0000","last_change":"2024-09-11T23:26:28.666899+0000","last_active":"2024-09-11T23:26:30.683872+0000","last_peered":"2024-09-11T23:26:30.683872+0000","last_clean":"2024-09-11T23:26:30.683872+0000","last_became_active":"2024-09-11T23:26:28.666576+0000","last_became_peered":"2024-09-11T23:26:28.666576+0000","last_unstale":"2024-09-11T23:26:30.683872+0000","last_undegraded":"2024-09-11T23:26:30.683872+0000","last_fullsized":"2024-09-11T23:26:30.683872+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:26:27.629194+0000","last_clean_scrub_stamp":"2024-09-11T23:26:27.629194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:57.911629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":478,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-11T23:26:30.680877+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:26:30.680877+0000","last_peered":"2024-09-11T23:26:30.680877+0000","last_clean":"2024-09-11T23:26:30.680877+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:26:30.680877+0000","last_undegraded":"2024-09-11T23:26:30.680877+0000","last_fullsized":"2024-09-11T23:26:30.680877+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476845,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33808,"kb_used_data":2616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338032,"statfs":{"total":96636764160,"available":96602144768,"internally_reserved":0,"allocated":2678784,"data_stored":1505989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476844,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33216,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338624,"statfs":{"total":96636764160,"available":96602750976,"internally_reserved":0,"allocated":2076672,"data_stored":914591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476843,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33220,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338620,"statfs":{"total":96636764160,"available":96602746880,"internally_reserved":0,"allocated":2076672,"data_stored":914591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476843,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33240,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2093056,"data_stored":915725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542252,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33224,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338616,"statfs":{"total":96636764160,"available":96602742784,"internally_reserved":0,"allocated":2084864,"data_stored":914191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542252,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33212,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338628,"statfs":{"total":96636764160,"available":96602755072,"internally_reserved":0,"allocated":2072576,"data_stored":914009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33220,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338620,"statfs":{"total":96636764160,"available":96602746880,"internally_reserved":0,"allocated":2080768,"data_stored":914065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509548,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37956,"kb_used_data":2608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333884,"statfs":{"total":96636764160,"available":96597897216,"internally_reserved":0,"allocated":2670592,"data_stored":1504467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:26:34.252 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:26:34.252 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-11T23:26:34.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.449+0000 7f67c3e00640 1 Processor -- start 2024-09-11T23:26:34.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.449+0000 7f67c3e00640 1 -- start start 2024-09-11T23:26:34.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.451+0000 7f67c3e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f67c415c030 0x7f67c4071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:34.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.451+0000 7f67c3e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f67c415c410 0x7f67c40b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:34.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.451+0000 7f67c3e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c40b2ab0 0x7f67c40b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:34.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.451+0000 7f67c3e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f67c4072870 con 0x7f67c415c030 2024-09-11T23:26:34.451 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.451+0000 7f67c3e00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f67c4072b50 con 0x7f67c415c410 2024-09-11T23:26:34.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.451+0000 7f67c3e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f67c4072e30 con 0x7f67c40b2ab0 2024-09-11T23:26:34.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.451+0000 7f67c2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f67c415c030 0x7f67c4071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:34.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.451+0000 7f67c2a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f67c415c030 0x7f67c4071f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53406/0 (socket says 172.21.15.144:53406) 2024-09-11T23:26:34.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.451+0000 7f67c2a00640 1 -- 172.21.15.144:0/1476123636 learned_addr learned my addr 172.21.15.144:0/1476123636 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:34.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.451+0000 7f67c3400640 1 --2- 172.21.15.144:0/1476123636 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c40b2ab0 0x7f67c40b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:34.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.451+0000 7f67c2000640 1 --2- 172.21.15.144:0/1476123636 >> v2:172.21.15.165:3300/0 conn(0x7f67c415c410 0x7f67c40b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:34.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.451+0000 7f67c2a00640 1 -- 172.21.15.144:0/1476123636 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c40b2ab0 msgr2=0x7f67c40b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:34.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.451+0000 7f67c2a00640 1 --2- 172.21.15.144:0/1476123636 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c40b2ab0 0x7f67c40b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.451+0000 7f67c2a00640 1 -- 172.21.15.144:0/1476123636 >> v2:172.21.15.165:3300/0 conn(0x7f67c415c410 msgr2=0x7f67c40b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:34.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.451+0000 7f67c2a00640 1 --2- 172.21.15.144:0/1476123636 >> v2:172.21.15.165:3300/0 conn(0x7f67c415c410 0x7f67c40b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.451+0000 7f67c2a00640 1 -- 172.21.15.144:0/1476123636 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c4073110 con 0x7f67c415c030 2024-09-11T23:26:34.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.451+0000 7f67c3400640 1 --2- 172.21.15.144:0/1476123636 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c40b2ab0 0x7f67c40b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:34.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.451+0000 7f67c2000640 1 --2- 172.21.15.144:0/1476123636 >> v2:172.21.15.165:3300/0 conn(0x7f67c415c410 0x7f67c40b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:34.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.452+0000 7f67c2a00640 1 --2- 172.21.15.144:0/1476123636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67c415c030 0x7f67c4071f60 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f67c4072d60 tx=0x7f67b402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab54e291f6841f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:34.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.453+0000 7f67c1600640 1 -- 172.21.15.144:0/1476123636 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b4037070 con 0x7f67c415c030 2024-09-11T23:26:34.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.453+0000 7f67c1600640 1 -- 172.21.15.144:0/1476123636 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67b4032440 con 0x7f67c415c030 2024-09-11T23:26:34.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.453+0000 7f67c1600640 1 -- 172.21.15.144:0/1476123636 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b4032810 con 0x7f67c415c030 2024-09-11T23:26:34.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.453+0000 7f67c3e00640 1 -- 172.21.15.144:0/1476123636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67c415c030 msgr2=0x7f67c4071f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:34.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.453+0000 7f67c3e00640 1 --2- 172.21.15.144:0/1476123636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67c415c030 0x7f67c4071f60 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f67c4072d60 tx=0x7f67b402a200 comp rx=0 tx=0).stop 2024-09-11T23:26:34.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.453+0000 7f67c3e00640 1 -- 172.21.15.144:0/1476123636 shutdown_connections 2024-09-11T23:26:34.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.453+0000 7f67c3e00640 1 --2- 172.21.15.144:0/1476123636 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c40b2ab0 0x7f67c40b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.453+0000 7f67c3e00640 1 --2- 172.21.15.144:0/1476123636 >> v2:172.21.15.165:3300/0 conn(0x7f67c415c410 0x7f67c40b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.453+0000 7f67c3e00640 1 --2- 172.21.15.144:0/1476123636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67c415c030 0x7f67c4071f60 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.453+0000 7f67c3e00640 1 -- 172.21.15.144:0/1476123636 >> 172.21.15.144:0/1476123636 conn(0x7f67c406bba0 msgr2=0x7f67c406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:34.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.453+0000 7f67c3e00640 1 -- 172.21.15.144:0/1476123636 shutdown_connections 2024-09-11T23:26:34.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.453+0000 7f67c3e00640 1 -- 172.21.15.144:0/1476123636 wait complete. 2024-09-11T23:26:34.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.455+0000 7f67c3e00640 1 Processor -- start 2024-09-11T23:26:34.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.455+0000 7f67c3e00640 1 -- start start 2024-09-11T23:26:34.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.456+0000 7f67c3e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c40b2ab0 0x7f67c4157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:34.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.456+0000 7f67c3e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67c415c030 0x7f67c4145530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:34.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.456+0000 7f67c3e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67c415c410 0x7f67c40b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:34.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.456+0000 7f67c3e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f67c4072620 con 0x7f67c415c030 2024-09-11T23:26:34.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.456+0000 7f67c3e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f67c40724a0 con 0x7f67c415c410 2024-09-11T23:26:34.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.456+0000 7f67c3e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f67c40cff30 con 0x7f67c40b2ab0 2024-09-11T23:26:34.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.456+0000 7f67c2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67c415c030 0x7f67c4145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:34.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.456+0000 7f67c2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67c415c030 0x7f67c4145530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53414/0 (socket says 172.21.15.144:53414) 2024-09-11T23:26:34.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.456+0000 7f67c2000640 1 -- 172.21.15.144:0/931842634 learned_addr learned my addr 172.21.15.144:0/931842634 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:34.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.456+0000 7f67c2a00640 1 --2- 172.21.15.144:0/931842634 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c40b2ab0 0x7f67c4157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:34.458 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.456+0000 7f67c3400640 1 --2- 172.21.15.144:0/931842634 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67c415c410 0x7f67c40b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:34.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.457+0000 7f67c2000640 1 -- 172.21.15.144:0/931842634 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c40b2ab0 msgr2=0x7f67c4157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:34.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.457+0000 7f67c2000640 1 --2- 172.21.15.144:0/931842634 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c40b2ab0 0x7f67c4157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.457+0000 7f67c2000640 1 -- 172.21.15.144:0/931842634 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67c415c410 msgr2=0x7f67c40b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:34.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.457+0000 7f67c2000640 1 --2- 172.21.15.144:0/931842634 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67c415c410 0x7f67c40b0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.457+0000 7f67c2000640 1 -- 172.21.15.144:0/931842634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c4153bc0 con 0x7f67c415c030 2024-09-11T23:26:34.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.457+0000 7f67c3400640 1 --2- 172.21.15.144:0/931842634 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67c415c410 0x7f67c40b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:34.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.457+0000 7f67c2000640 1 --2- 172.21.15.144:0/931842634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67c415c030 0x7f67c4145530 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f67b000d830 tx=0x7f67b000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:34.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.457+0000 7f67baa00640 1 -- 172.21.15.144:0/931842634 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b0004030 con 0x7f67c415c030 2024-09-11T23:26:34.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.457+0000 7f67baa00640 1 -- 172.21.15.144:0/931842634 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67b00041d0 con 0x7f67c415c030 2024-09-11T23:26:34.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.457+0000 7f67baa00640 1 -- 172.21.15.144:0/931842634 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b000b6c0 con 0x7f67c415c030 2024-09-11T23:26:34.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.457+0000 7f67c3e00640 1 -- 172.21.15.144:0/931842634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67c4156580 con 0x7f67c415c030 2024-09-11T23:26:34.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.457+0000 7f67c3e00640 1 -- 172.21.15.144:0/931842634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67c4152f40 con 0x7f67c415c030 2024-09-11T23:26:34.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.458+0000 7f67c3e00640 1 -- 172.21.15.144:0/931842634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67c4156aa0 con 0x7f67c415c030 2024-09-11T23:26:34.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.459+0000 7f67baa00640 1 -- 172.21.15.144:0/931842634 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f67b000ba70 con 0x7f67c415c030 2024-09-11T23:26:34.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.460+0000 7f67baa00640 1 --2- 172.21.15.144:0/931842634 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f67a406c7c0 0x7f67a406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:34.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.460+0000 7f67baa00640 1 -- 172.21.15.144:0/931842634 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f67b0089910 con 0x7f67c415c030 2024-09-11T23:26:34.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.461+0000 7f67c2a00640 1 --2- 172.21.15.144:0/931842634 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f67a406c7c0 0x7f67a406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:34.461 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.461+0000 7f67c2a00640 1 --2- 172.21.15.144:0/931842634 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f67a406c7c0 0x7f67a406ec80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f67b4034000 tx=0x7f67b402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:34.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.464+0000 7f67baa00640 1 -- 172.21.15.144:0/931842634 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f67c4156aa0 con 0x7f67c415c030 2024-09-11T23:26:34.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.704+0000 7f67c3e00640 1 -- 172.21.15.144:0/931842634 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f67c4071f60 con 0x7f67c415c030 2024-09-11T23:26:34.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.706+0000 7f67baa00640 1 -- 172.21.15.144:0/931842634 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) ==== 190+0+147 (secure 0 0 0) 0x7f67b0059ec0 con 0x7f67c415c030 2024-09-11T23:26:34.706 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-09-11T23:26:34.706 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQDeJOJmSh/PLBAAjeMKmrGniiaRwUZlWmDk4A== 2024-09-11T23:26:34.706 INFO:teuthology.orchestra.run.smithi144.stdout: caps mds = "allow" 2024-09-11T23:26:34.706 INFO:teuthology.orchestra.run.smithi144.stdout: caps mon = "allow r" 2024-09-11T23:26:34.706 INFO:teuthology.orchestra.run.smithi144.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-11T23:26:34.706 INFO:teuthology.orchestra.run.smithi144.stderr:updated caps for client.0 2024-09-11T23:26:34.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.708+0000 7f67c3e00640 1 -- 172.21.15.144:0/931842634 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f67a406c7c0 msgr2=0x7f67a406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:34.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.708+0000 7f67c3e00640 1 --2- 172.21.15.144:0/931842634 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f67a406c7c0 0x7f67a406ec80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f67b4034000 tx=0x7f67b402e000 comp rx=0 tx=0).stop 2024-09-11T23:26:34.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.708+0000 7f67c3e00640 1 -- 172.21.15.144:0/931842634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67c415c030 msgr2=0x7f67c4145530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:34.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.708+0000 7f67c3e00640 1 --2- 172.21.15.144:0/931842634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67c415c030 0x7f67c4145530 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f67b000d830 tx=0x7f67b000dcf0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.708+0000 7f67c3e00640 1 -- 172.21.15.144:0/931842634 shutdown_connections 2024-09-11T23:26:34.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.708+0000 7f67c3e00640 1 --2- 172.21.15.144:0/931842634 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f67a406c7c0 0x7f67a406ec80 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.708+0000 7f67c3e00640 1 --2- 172.21.15.144:0/931842634 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67c415c410 0x7f67c40b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.708+0000 7f67c3e00640 1 --2- 172.21.15.144:0/931842634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67c415c030 0x7f67c4145530 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.708+0000 7f67c3e00640 1 --2- 172.21.15.144:0/931842634 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f67c40b2ab0 0x7f67c4157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.708+0000 7f67c3e00640 1 -- 172.21.15.144:0/931842634 >> 172.21.15.144:0/931842634 conn(0x7f67c406bba0 msgr2=0x7f67c40cf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:34.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.709+0000 7f67c3e00640 1 -- 172.21.15.144:0/931842634 shutdown_connections 2024-09-11T23:26:34.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.709+0000 7f67c3e00640 1 -- 172.21.15.144:0/931842634 wait complete. 2024-09-11T23:26:34.725 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:26:34.878 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.879+0000 7f19eb200640 1 Processor -- start 2024-09-11T23:26:34.879 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.879+0000 7f19eb200640 1 -- start start 2024-09-11T23:26:34.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.880+0000 7f19eb200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19ec15b150 0x7f19ec0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:34.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.880+0000 7f19eb200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f19ec0b4510 0x7f19ec0b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:34.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.880+0000 7f19eb200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19ec0b31d0 con 0x7f19ec0cd030 2024-09-11T23:26:34.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.880+0000 7f19eb200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f19ec15c0a0 con 0x7f19ec0b4510 2024-09-11T23:26:34.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.880+0000 7f19eb200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f19ec15c380 con 0x7f19ec15b150 2024-09-11T23:26:34.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.880+0000 7f19e9400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f19ec0b4510 0x7f19ec0b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:34.880 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.880+0000 7f19e9e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19ec15b150 0x7f19ec0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:34.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.881+0000 7f19e9400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f19ec0b4510 0x7f19ec0b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:54460/0 (socket says 172.21.15.144:54460) 2024-09-11T23:26:34.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.881+0000 7f19e9400640 1 -- 172.21.15.144:0/4174950881 learned_addr learned my addr 172.21.15.144:0/4174950881 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:34.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.881+0000 7f19e9e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19ec15b150 0x7f19ec0ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:43940/0 (socket says 172.21.15.144:43940) 2024-09-11T23:26:34.881 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.881+0000 7f19e9400640 1 -- 172.21.15.144:0/4174950881 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19ec15b150 msgr2=0x7f19ec0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:34.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.881+0000 7f19e9400640 1 --2- 172.21.15.144:0/4174950881 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19ec15b150 0x7f19ec0ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.881+0000 7f19e9400640 1 -- 172.21.15.144:0/4174950881 >> v1:172.21.15.165:6789/0 conn(0x7f19ec0cd030 legacy=0x7f19ec15b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:34.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.881+0000 7f19e9400640 1 -- 172.21.15.144:0/4174950881 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ec0b3440 con 0x7f19ec0b4510 2024-09-11T23:26:34.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.881+0000 7f19e9e00640 1 --2- 172.21.15.144:0/4174950881 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19ec15b150 0x7f19ec0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:26:34.882 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.882+0000 7f19e9400640 1 --2- 172.21.15.144:0/4174950881 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19ec0b4510 0x7f19ec0b3960 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f19d8009870 tx=0x7f19d802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfb88c381b1ce7ce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.882+0000 7f19e8a00640 1 -- 172.21.15.144:0/4174950881 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d8037070 con 0x7f19ec0b4510 2024-09-11T23:26:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.882+0000 7f19e8a00640 1 -- 172.21.15.144:0/4174950881 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d8032440 con 0x7f19ec0b4510 2024-09-11T23:26:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.882+0000 7f19e8a00640 1 -- 172.21.15.144:0/4174950881 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d8032810 con 0x7f19ec0b4510 2024-09-11T23:26:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.883+0000 7f19eb200640 1 -- 172.21.15.144:0/4174950881 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19ec0b4510 msgr2=0x7f19ec0b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.883+0000 7f19eb200640 1 --2- 172.21.15.144:0/4174950881 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19ec0b4510 0x7f19ec0b3960 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f19d8009870 tx=0x7f19d802a270 comp rx=0 tx=0).stop 2024-09-11T23:26:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.883+0000 7f19eb200640 1 -- 172.21.15.144:0/4174950881 shutdown_connections 2024-09-11T23:26:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.883+0000 7f19eb200640 1 --2- 172.21.15.144:0/4174950881 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19ec0b4510 0x7f19ec0b3960 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.883+0000 7f19eb200640 1 --2- 172.21.15.144:0/4174950881 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19ec15b150 0x7f19ec0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.883 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.883+0000 7f19eb200640 1 -- 172.21.15.144:0/4174950881 >> 172.21.15.144:0/4174950881 conn(0x7f19ec06e910 msgr2=0x7f19ec06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:34.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.883+0000 7f19eb200640 1 -- 172.21.15.144:0/4174950881 shutdown_connections 2024-09-11T23:26:34.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.883+0000 7f19eb200640 1 -- 172.21.15.144:0/4174950881 wait complete. 2024-09-11T23:26:34.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.885+0000 7f19eb200640 1 Processor -- start 2024-09-11T23:26:34.884 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.885+0000 7f19eb200640 1 -- start start 2024-09-11T23:26:34.886 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.885+0000 7f19eb200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19ec0b4510 0x7f19ec1f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.886+0000 7f19eb200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19ec0cd030 0x7f19ec071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.886+0000 7f19eb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19ec15b150 0x7f19ec1f4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.886+0000 7f19eb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec15bdc0 con 0x7f19ec15b150 2024-09-11T23:26:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.886+0000 7f19eb200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec15bc40 con 0x7f19ec0b4510 2024-09-11T23:26:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.886+0000 7f19eb200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f19ec0b3ea0 con 0x7f19ec0cd030 2024-09-11T23:26:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.886+0000 7f19ea800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19ec15b150 0x7f19ec1f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.886+0000 7f19ea800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19ec15b150 0x7f19ec1f4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53416/0 (socket says 172.21.15.144:53416) 2024-09-11T23:26:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.886+0000 7f19ea800640 1 -- 172.21.15.144:0/1211227041 learned_addr learned my addr 172.21.15.144:0/1211227041 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.886+0000 7f19e9e00640 1 --2- 172.21.15.144:0/1211227041 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19ec0b4510 0x7f19ec1f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.886+0000 7f19e9400640 1 --2- 172.21.15.144:0/1211227041 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19ec0cd030 0x7f19ec071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.886+0000 7f19ea800640 1 -- 172.21.15.144:0/1211227041 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19ec0cd030 msgr2=0x7f19ec071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.886+0000 7f19ea800640 1 --2- 172.21.15.144:0/1211227041 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19ec0cd030 0x7f19ec071010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.887 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.886+0000 7f19ea800640 1 -- 172.21.15.144:0/1211227041 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19ec0b4510 msgr2=0x7f19ec1f14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:34.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.886+0000 7f19ea800640 1 --2- 172.21.15.144:0/1211227041 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19ec0b4510 0x7f19ec1f14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:34.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.886+0000 7f19ea800640 1 -- 172.21.15.144:0/1211227041 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ec1f40c0 con 0x7f19ec15b150 2024-09-11T23:26:34.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.887+0000 7f19ea800640 1 --2- 172.21.15.144:0/1211227041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19ec15b150 0x7f19ec1f4880 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f19e400c730 tx=0x7f19e400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:34.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.887+0000 7f19e2000640 1 -- 172.21.15.144:0/1211227041 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4003b70 con 0x7f19ec15b150 2024-09-11T23:26:34.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.887+0000 7f19e2000640 1 -- 172.21.15.144:0/1211227041 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19e4003d10 con 0x7f19ec15b150 2024-09-11T23:26:34.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.887+0000 7f19eb200640 1 -- 172.21.15.144:0/1211227041 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19ec071e00 con 0x7f19ec15b150 2024-09-11T23:26:34.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.887+0000 7f19e2000640 1 -- 172.21.15.144:0/1211227041 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e400aa90 con 0x7f19ec15b150 2024-09-11T23:26:34.888 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.887+0000 7f19eb200640 1 -- 172.21.15.144:0/1211227041 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19ec071b20 con 0x7f19ec15b150 2024-09-11T23:26:34.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.888+0000 7f19eb200640 1 -- 172.21.15.144:0/1211227041 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19ec0b3960 con 0x7f19ec15b150 2024-09-11T23:26:34.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.889+0000 7f19e2000640 1 -- 172.21.15.144:0/1211227041 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f19e400ac30 con 0x7f19ec15b150 2024-09-11T23:26:34.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.890+0000 7f19e2000640 1 --2- 172.21.15.144:0/1211227041 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f19cc06c7c0 0x7f19cc06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:34.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.890+0000 7f19e2000640 1 -- 172.21.15.144:0/1211227041 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f19e4089560 con 0x7f19ec15b150 2024-09-11T23:26:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.890+0000 7f19e9e00640 1 --2- 172.21.15.144:0/1211227041 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f19cc06c7c0 0x7f19cc06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:34.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.891+0000 7f19e9e00640 1 --2- 172.21.15.144:0/1211227041 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f19cc06c7c0 0x7f19cc06ec80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f19dc009a30 tx=0x7f19dc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:34.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:34.894+0000 7f19e2000640 1 -- 172.21.15.144:0/1211227041 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f19e4059a90 con 0x7f19ec15b150 2024-09-11T23:26:35.101 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.101+0000 7f19eb200640 1 -- 172.21.15.144:0/1211227041 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19ec071550 con 0x7f19ec15b150 2024-09-11T23:26:35.102 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.102+0000 7f19e2000640 1 -- 172.21.15.144:0/1211227041 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+5242 (secure 0 0 0) 0x7f19e4059390 con 0x7f19ec15b150 2024-09-11T23:26:35.102 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:35.102 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":119,"btime":"2024-09-11T23:26:32:684467+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/4202069031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4202069031},{"type":"v1","addr":"172.21.15.144:6801","nonce":4202069031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":7331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1262024638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1262024638},{"type":"v1","addr":"172.21.15.144:6835","nonce":1262024638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8407,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2678086616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2678086616},{"type":"v1","addr":"172.21.15.165:6834","nonce":2678086616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:26:29.055590+0000","modified":"2024-09-11T23:26:32.086872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9015":{"gid":9015,"name":"b","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/862543799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":862543799},{"type":"v1","addr":"172.21.15.165:6835","nonce":862543799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9015,"qdb_cluster":[9015]},"id":13}]} 2024-09-11T23:26:35.102 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 119 2024-09-11T23:26:35.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.104+0000 7f19eb200640 1 -- 172.21.15.144:0/1211227041 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f19cc06c7c0 msgr2=0x7f19cc06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:35.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.104+0000 7f19eb200640 1 --2- 172.21.15.144:0/1211227041 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f19cc06c7c0 0x7f19cc06ec80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f19dc009a30 tx=0x7f19dc008040 comp rx=0 tx=0).stop 2024-09-11T23:26:35.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.104+0000 7f19eb200640 1 -- 172.21.15.144:0/1211227041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19ec15b150 msgr2=0x7f19ec1f4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:35.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.104+0000 7f19eb200640 1 --2- 172.21.15.144:0/1211227041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19ec15b150 0x7f19ec1f4880 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f19e400c730 tx=0x7f19e400cbf0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.104+0000 7f19eb200640 1 -- 172.21.15.144:0/1211227041 shutdown_connections 2024-09-11T23:26:35.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.104+0000 7f19eb200640 1 --2- 172.21.15.144:0/1211227041 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f19cc06c7c0 0x7f19cc06ec80 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.104+0000 7f19eb200640 1 --2- 172.21.15.144:0/1211227041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19ec15b150 0x7f19ec1f4880 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.104+0000 7f19eb200640 1 --2- 172.21.15.144:0/1211227041 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f19ec0cd030 0x7f19ec071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.104+0000 7f19eb200640 1 --2- 172.21.15.144:0/1211227041 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19ec0b4510 0x7f19ec1f14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.104+0000 7f19eb200640 1 -- 172.21.15.144:0/1211227041 >> 172.21.15.144:0/1211227041 conn(0x7f19ec06e910 msgr2=0x7f19ec155e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:35.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.104+0000 7f19eb200640 1 -- 172.21.15.144:0/1211227041 shutdown_connections 2024-09-11T23:26:35.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.104+0000 7f19eb200640 1 -- 172.21.15.144:0/1211227041 wait complete. 2024-09-11T23:26:35.523 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 119, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T23:26:29.055590+0000', 'modified': '2024-09-11T23:26:32.086872+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9015}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9015': {'gid': 9015, 'name': 'b', 'rank': 0, 'incarnation': 115, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.165:6835/862543799', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6833', 'nonce': 862543799}, {'type': 'v1', 'addr': '172.21.15.165:6835', 'nonce': 862543799}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9015, 'qdb_cluster': [9015]} 2024-09-11T23:26:35.523 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T23:26:35.523 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-11T23:26:35.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.679+0000 7f2bfb000640 1 Processor -- start 2024-09-11T23:26:35.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.679+0000 7f2bfb000640 1 -- start start 2024-09-11T23:26:35.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.680+0000 7f2bfb000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2bf40d2230 0x7f2bf40d3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.680+0000 7f2bfb000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bf40d3fb0 0x7f2bf406d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.680+0000 7f2bfb000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf415ea80 con 0x7f2bf415e6a0 2024-09-11T23:26:35.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.680+0000 7f2bfb000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2bf40d35e0 con 0x7f2bf40d2230 2024-09-11T23:26:35.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.680+0000 7f2bfb000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf40d29d0 con 0x7f2bf40d3fb0 2024-09-11T23:26:35.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.680+0000 7f2bf9200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2bf40d2230 0x7f2bf40d3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.680+0000 7f2bf9200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2bf40d2230 0x7f2bf40d3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53432/0 (socket says 172.21.15.144:53432) 2024-09-11T23:26:35.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.680+0000 7f2bf9200640 1 -- 172.21.15.144:0/3687680782 learned_addr learned my addr 172.21.15.144:0/3687680782 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:35.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.680+0000 7f2bfa600640 1 --2- 172.21.15.144:0/3687680782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bf40d3fb0 0x7f2bf406d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.681+0000 7f2bf9200640 1 -- 172.21.15.144:0/3687680782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bf40d3fb0 msgr2=0x7f2bf406d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:35.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.681+0000 7f2bf9200640 1 --2- 172.21.15.144:0/3687680782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bf40d3fb0 0x7f2bf406d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.681+0000 7f2bf9200640 1 -- 172.21.15.144:0/3687680782 >> v1:172.21.15.165:6789/0 conn(0x7f2bf415e6a0 legacy=0x7f2bf40cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:35.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.681+0000 7f2bf9200640 1 -- 172.21.15.144:0/3687680782 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf40d2cb0 con 0x7f2bf40d2230 2024-09-11T23:26:35.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.682+0000 7f2bf9200640 1 --2- 172.21.15.144:0/3687680782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bf40d2230 0x7f2bf40d3a70 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f2be0009870 tx=0x7f2be002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7cb6f3d3abd69ff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:35.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.682+0000 7f2bf3e00640 1 -- 172.21.15.144:0/3687680782 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0037070 con 0x7f2bf40d2230 2024-09-11T23:26:35.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.682+0000 7f2bf3e00640 1 -- 172.21.15.144:0/3687680782 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2be0032440 con 0x7f2bf40d2230 2024-09-11T23:26:35.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.682+0000 7f2bf3e00640 1 -- 172.21.15.144:0/3687680782 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0032810 con 0x7f2bf40d2230 2024-09-11T23:26:35.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.682+0000 7f2bfb000640 1 -- 172.21.15.144:0/3687680782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bf40d2230 msgr2=0x7f2bf40d3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:35.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.682+0000 7f2bfb000640 1 --2- 172.21.15.144:0/3687680782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bf40d2230 0x7f2bf40d3a70 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f2be0009870 tx=0x7f2be002a1e0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.683+0000 7f2bfb000640 1 -- 172.21.15.144:0/3687680782 shutdown_connections 2024-09-11T23:26:35.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.683+0000 7f2bfb000640 1 --2- 172.21.15.144:0/3687680782 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bf40d3fb0 0x7f2bf406d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.683+0000 7f2bfb000640 1 --2- 172.21.15.144:0/3687680782 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bf40d2230 0x7f2bf40d3a70 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.683+0000 7f2bfb000640 1 -- 172.21.15.144:0/3687680782 >> 172.21.15.144:0/3687680782 conn(0x7f2bf40d4540 msgr2=0x7f2bf40d4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:35.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.683+0000 7f2bfb000640 1 -- 172.21.15.144:0/3687680782 shutdown_connections 2024-09-11T23:26:35.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.683+0000 7f2bfb000640 1 -- 172.21.15.144:0/3687680782 wait complete. 2024-09-11T23:26:35.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.684+0000 7f2bfb000640 1 Processor -- start 2024-09-11T23:26:35.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.684+0000 7f2bfb000640 1 -- start start 2024-09-11T23:26:35.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.685+0000 7f2bfb000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2bf40d2230 0x7f2bf41f7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.685+0000 7f2bfb000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bf415e6a0 0x7f2bf40cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.685+0000 7f2bfb000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bf40b63f0 0x7f2bf41585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.685+0000 7f2bfb000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf406db50 con 0x7f2bf40b63f0 2024-09-11T23:26:35.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.685+0000 7f2bfb000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf40d3270 con 0x7f2bf40d2230 2024-09-11T23:26:35.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.685+0000 7f2bfb000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf406dcd0 con 0x7f2bf415e6a0 2024-09-11T23:26:35.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.686+0000 7f2bfa600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bf40b63f0 0x7f2bf41585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.686+0000 7f2bfa600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bf40b63f0 0x7f2bf41585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53448/0 (socket says 172.21.15.144:53448) 2024-09-11T23:26:35.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.686+0000 7f2bfa600640 1 -- 172.21.15.144:0/266037885 learned_addr learned my addr 172.21.15.144:0/266037885 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:35.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.686+0000 7f2bf9200640 1 --2- 172.21.15.144:0/266037885 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bf415e6a0 0x7f2bf40cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.686+0000 7f2bf9c00640 1 --2- 172.21.15.144:0/266037885 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2bf40d2230 0x7f2bf41f7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.686+0000 7f2bfa600640 1 -- 172.21.15.144:0/266037885 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bf415e6a0 msgr2=0x7f2bf40cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:35.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.686+0000 7f2bfa600640 1 --2- 172.21.15.144:0/266037885 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bf415e6a0 0x7f2bf40cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.686+0000 7f2bfa600640 1 -- 172.21.15.144:0/266037885 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2bf40d2230 msgr2=0x7f2bf41f7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:35.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.686+0000 7f2bfa600640 1 --2- 172.21.15.144:0/266037885 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2bf40d2230 0x7f2bf41f7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.686+0000 7f2bfa600640 1 -- 172.21.15.144:0/266037885 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf41f8000 con 0x7f2bf40b63f0 2024-09-11T23:26:35.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.686+0000 7f2bfa600640 1 --2- 172.21.15.144:0/266037885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bf40b63f0 0x7f2bf41585c0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f2bec007e10 tx=0x7f2bec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:35.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.687+0000 7f2bf1600640 1 -- 172.21.15.144:0/266037885 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec014620 con 0x7f2bf40b63f0 2024-09-11T23:26:35.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.687+0000 7f2bf1600640 1 -- 172.21.15.144:0/266037885 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bec019070 con 0x7f2bf40b63f0 2024-09-11T23:26:35.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.687+0000 7f2bf1600640 1 -- 172.21.15.144:0/266037885 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec014a20 con 0x7f2bf40b63f0 2024-09-11T23:26:35.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.687+0000 7f2bfb000640 1 -- 172.21.15.144:0/266037885 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf40cc900 con 0x7f2bf40b63f0 2024-09-11T23:26:35.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.687+0000 7f2bfb000640 1 -- 172.21.15.144:0/266037885 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf40ccec0 con 0x7f2bf40b63f0 2024-09-11T23:26:35.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.690+0000 7f2bf1600640 1 -- 172.21.15.144:0/266037885 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f2bec014bc0 con 0x7f2bf40b63f0 2024-09-11T23:26:35.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.691+0000 7f2bf1600640 1 --2- 172.21.15.144:0/266037885 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2bd406c7c0 0x7f2bd406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.691+0000 7f2bf1600640 1 -- 172.21.15.144:0/266037885 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f2bec089ce0 con 0x7f2bf40b63f0 2024-09-11T23:26:35.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.691+0000 7f2bff5d6740 1 Processor -- start 2024-09-11T23:26:35.690 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.691+0000 7f2bff5d6740 1 -- start start 2024-09-11T23:26:35.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.691+0000 7f2bf9c00640 1 --2- 172.21.15.144:0/266037885 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2bd406c7c0 0x7f2bd406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.692+0000 7f2bff5d6740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b0bf2eea0 0x558b0bf74640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.692+0000 7f2bff5d6740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf2c660 0x558b0bf2f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.692+0000 7f2bf9c00640 1 --2- 172.21.15.144:0/266037885 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2bd406c7c0 0x7f2bd406ec80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2be80016e0 tx=0x7f2be8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:35.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.692+0000 7f2bff5d6740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b0bf30630 0x558b0bf29720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.692+0000 7f2bff5d6740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558b0be8d3b0 con 0x558b0bf2c660 2024-09-11T23:26:35.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.692+0000 7f2bff5d6740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558b0be92410 con 0x558b0bf2eea0 2024-09-11T23:26:35.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.692+0000 7f2bff5d6740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x558b0be3a620 con 0x558b0bf30630 2024-09-11T23:26:35.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.692+0000 7f2bf9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf2c660 0x558b0bf2f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.692+0000 7f2bf9200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf2c660 0x558b0bf2f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53456/0 (socket says 172.21.15.144:53456) 2024-09-11T23:26:35.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.692+0000 7f2bf9200640 1 -- 172.21.15.144:0/2544880253 learned_addr learned my addr 172.21.15.144:0/2544880253 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:35.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.692+0000 7f2bf9c00640 1 --2- 172.21.15.144:0/2544880253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b0bf2eea0 0x558b0bf74640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.692+0000 7f2bfa600640 1 --2- 172.21.15.144:0/2544880253 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b0bf30630 0x558b0bf29720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.692+0000 7f2bf9200640 1 -- 172.21.15.144:0/2544880253 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b0bf30630 msgr2=0x558b0bf29720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:35.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.692+0000 7f2bf9200640 1 --2- 172.21.15.144:0/2544880253 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b0bf30630 0x558b0bf29720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.693+0000 7f2bf9200640 1 -- 172.21.15.144:0/2544880253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b0bf2eea0 msgr2=0x558b0bf74640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:35.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.693+0000 7f2bf9200640 1 --2- 172.21.15.144:0/2544880253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b0bf2eea0 0x558b0bf74640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.693+0000 7f2bf9200640 1 -- 172.21.15.144:0/2544880253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b0bba52d0 con 0x558b0bf2c660 2024-09-11T23:26:35.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.693+0000 7f2bf9200640 1 --2- 172.21.15.144:0/2544880253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf2c660 0x558b0bf2f280 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f2be0009870 tx=0x7f2be002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1837701963412 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:35.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.693+0000 7f2be6000640 1 -- 172.21.15.144:0/2544880253 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0037040 con 0x558b0bf2c660 2024-09-11T23:26:35.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.693+0000 7f2be6000640 1 -- 172.21.15.144:0/2544880253 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2be0032780 con 0x558b0bf2c660 2024-09-11T23:26:35.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.693+0000 7f2be6000640 1 -- 172.21.15.144:0/2544880253 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0032b70 con 0x558b0bf2c660 2024-09-11T23:26:35.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.694+0000 7f2bff5d6740 1 -- 172.21.15.144:0/2544880253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf2c660 msgr2=0x558b0bf2f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:35.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.694+0000 7f2bff5d6740 1 --2- 172.21.15.144:0/2544880253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf2c660 0x558b0bf2f280 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f2be0009870 tx=0x7f2be002c000 comp rx=0 tx=0).stop 2024-09-11T23:26:35.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.694+0000 7f2bff5d6740 1 -- 172.21.15.144:0/2544880253 shutdown_connections 2024-09-11T23:26:35.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.694+0000 7f2bff5d6740 1 --2- 172.21.15.144:0/2544880253 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b0bf30630 0x558b0bf29720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.694+0000 7f2bff5d6740 1 --2- 172.21.15.144:0/2544880253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf2c660 0x558b0bf2f280 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.694+0000 7f2bff5d6740 1 --2- 172.21.15.144:0/2544880253 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b0bf2eea0 0x558b0bf74640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.694+0000 7f2bff5d6740 1 -- 172.21.15.144:0/2544880253 >> 172.21.15.144:0/2544880253 conn(0x558b0bf2b8f0 msgr2=0x558b0bf73b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:35.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.694+0000 7f2bff5d6740 1 -- 172.21.15.144:0/2544880253 shutdown_connections 2024-09-11T23:26:35.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.694+0000 7f2bff5d6740 1 -- 172.21.15.144:0/2544880253 wait complete. 2024-09-11T23:26:35.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.694+0000 7f2bff5d6740 1 -- start start 2024-09-11T23:26:35.696 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.695+0000 7f2bff5d6740 1 Processor -- start 2024-09-11T23:26:35.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.696+0000 7f2bff5d6740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b0bf2eea0 0x558b0bf58990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.696+0000 7f2bff5d6740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b0bf30630 0x558b0bf2a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.698 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.696+0000 7f2bff5d6740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 0x558b0bf2d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.696+0000 7f2bff5d6740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558b0be4d780 con 0x558b0bf57d80 2024-09-11T23:26:35.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.696+0000 7f2bff5d6740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558b0be8e3d0 con 0x558b0bf30630 2024-09-11T23:26:35.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.696+0000 7f2bff5d6740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x558b0bf2ad90 con 0x558b0bf2eea0 2024-09-11T23:26:35.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.696+0000 7f2bff5d6740 10 client.0 _ll_register_callbacks cb 0x558b0be8b5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:26:35.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.696+0000 7f2bfa600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 0x558b0bf2d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.696+0000 7f2bfa600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 0x558b0bf2d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53470/0 (socket says 172.21.15.144:53470) 2024-09-11T23:26:35.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.696+0000 7f2bfa600640 1 -- 172.21.15.144:0/534780797 learned_addr learned my addr 172.21.15.144:0/534780797 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:35.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.696+0000 7f2bf9c00640 1 --2- 172.21.15.144:0/534780797 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b0bf2eea0 0x558b0bf58990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.696+0000 7f2bf9200640 1 --2- 172.21.15.144:0/534780797 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b0bf30630 0x558b0bf2a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.696+0000 7f2bfa600640 1 -- 172.21.15.144:0/534780797 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b0bf2eea0 msgr2=0x558b0bf58990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:35.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.696+0000 7f2bfa600640 1 --2- 172.21.15.144:0/534780797 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b0bf2eea0 0x558b0bf58990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.696+0000 7f2bfa600640 1 -- 172.21.15.144:0/534780797 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b0bf30630 msgr2=0x558b0bf2a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:35.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.696+0000 7f2bfa600640 1 --2- 172.21.15.144:0/534780797 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b0bf30630 0x558b0bf2a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.696+0000 7f2bfa600640 1 -- 172.21.15.144:0/534780797 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b0bc6f6b0 con 0x558b0bf57d80 2024-09-11T23:26:35.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.697+0000 7f2bfa600640 1 --2- 172.21.15.144:0/534780797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 0x558b0bf2d1c0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00e9b0 tx=0x7f2bec059d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871ab51ab8673f49 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:35.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.697+0000 7f2bdaa00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:26:35.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.697+0000 7f2bdaa00640 1 -- 172.21.15.144:0/534780797 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec088060 con 0x558b0bf57d80 2024-09-11T23:26:35.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.697+0000 7f2bdaa00640 1 -- 172.21.15.144:0/534780797 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f2bec0624e0 con 0x558b0bf57d80 2024-09-11T23:26:35.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.697+0000 7f2bff5d6740 1 -- 172.21.15.144:0/534780797 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2be0032780 con 0x558b0bf57d80 2024-09-11T23:26:35.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.697+0000 7f2bdaa00640 1 -- 172.21.15.144:0/534780797 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=119) ==== 24+0+0 (secure 0 0 0) 0x7f2bec076050 con 0x558b0bf57d80 2024-09-11T23:26:35.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.697+0000 7f2bff5d6740 10 client.9129 fetch_fsmap learned FSMap version 119 2024-09-11T23:26:35.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.697+0000 7f2bff5d6740 1 -- 172.21.15.144:0/534780797 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=119,monmap=2+}) -- 0x558b0bf4eb70 con 0x558b0bf57d80 2024-09-11T23:26:35.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.697+0000 7f2bdaa00640 1 -- 172.21.15.144:0/534780797 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2be0032780 con 0x558b0bf57d80 2024-09-11T23:26:35.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.698+0000 7f2bdaa00640 1 -- 172.21.15.144:0/534780797 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 119) ==== 3502+0+0 (secure 0 0 0) 0x7f2bec059090 con 0x558b0bf57d80 2024-09-11T23:26:35.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.698+0000 7f2bff5d6740 10 client.9129 fetch_fsmap finished waiting for FSMap version 119 2024-09-11T23:26:35.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.698+0000 7f2bff5d6740 10 client.9129 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:26:35.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.698+0000 7f2bff5d6740 20 client.9129 populate_metadata read hostname 'smithi144' 2024-09-11T23:26:35.700 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.698+0000 7f2bff5d6740 1 --2- 172.21.15.144:0/534780797 >> [v2:172.21.15.165:6833/862543799,v1:172.21.15.165:6835/862543799] conn(0x558b0bf87ae0 0x558b0bf845c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.698+0000 7f2bff5d6740 4 client.9129 mds_command: new command op to 9015 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T23:26:35.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.698+0000 7f2bff5d6740 1 -- 172.21.15.144:0/534780797 --> [v2:172.21.15.165:6833/862543799,v1:172.21.15.165:6835/862543799] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b0be9fb40 con 0x558b0bf87ae0 2024-09-11T23:26:35.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.698+0000 7f2bf9c00640 1 --2- 172.21.15.144:0/534780797 >> [v2:172.21.15.165:6833/862543799,v1:172.21.15.165:6835/862543799] conn(0x558b0bf87ae0 0x558b0bf845c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.699+0000 7f2bf9c00640 1 --2- 172.21.15.144:0/534780797 >> [v2:172.21.15.165:6833/862543799,v1:172.21.15.165:6835/862543799] conn(0x558b0bf87ae0 0x558b0bf845c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c857eeace8ab8e7 server_cookie=d18f9f53920f3015 in_seq=0 out_seq=0 2024-09-11T23:26:35.701 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.699+0000 7f2bdaa00640 10 client.9129 ms_handle_connect on v2:172.21.15.165:6833/862543799 2024-09-11T23:26:35.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.700+0000 7f2bdaa00640 1 -- 172.21.15.144:0/534780797 <== mds.0 v2:172.21.15.165:6833/862543799 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b0be9fb40 con 0x558b0bf87ae0 2024-09-11T23:26:35.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.700+0000 7f2bdaa00640 10 client.9129 handle_command_reply: tid=0 2024-09-11T23:26:35.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.700+0000 7f2bff5d6740 1 client.9129 shutdown 2024-09-11T23:26:35.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.701+0000 7f2bff5d6740 1 -- 172.21.15.144:0/534780797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 msgr2=0x558b0bf2d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:35.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.701+0000 7f2bff5d6740 1 --2- 172.21.15.144:0/534780797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 0x558b0bf2d1c0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00e9b0 tx=0x7f2bec059d50 comp rx=0 tx=0).stop 2024-09-11T23:26:35.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.701+0000 7f2bff5d6740 1 -- 172.21.15.144:0/534780797 shutdown_connections 2024-09-11T23:26:35.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.701+0000 7f2bff5d6740 1 --2- 172.21.15.144:0/534780797 >> [v2:172.21.15.165:6833/862543799,v1:172.21.15.165:6835/862543799] conn(0x558b0bf87ae0 0x558b0bf845c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.701+0000 7f2bff5d6740 1 --2- 172.21.15.144:0/534780797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 0x558b0bf2d1c0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.701+0000 7f2bff5d6740 1 --2- 172.21.15.144:0/534780797 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b0bf30630 0x558b0bf2a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.701+0000 7f2bff5d6740 1 --2- 172.21.15.144:0/534780797 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b0bf2eea0 0x558b0bf58990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.701+0000 7f2bdaa00640 0 client.9129 ms_handle_reset on v2:172.21.15.165:6833/862543799 2024-09-11T23:26:35.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.701+0000 7f2bff5d6740 1 -- 172.21.15.144:0/534780797 >> 172.21.15.144:0/534780797 conn(0x558b0bf2c660 msgr2=0x558b0bf73230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:35.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.701+0000 7f2bff5d6740 1 -- 172.21.15.144:0/534780797 shutdown_connections 2024-09-11T23:26:35.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.701+0000 7f2bff5d6740 1 -- 172.21.15.144:0/534780797 wait complete. 2024-09-11T23:26:35.703 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.701+0000 7f2bff5d6740 20 client.9129 trim_cache size 0 max 16384 2024-09-11T23:26:35.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.721+0000 7f2bff5d6740 1 Processor -- start 2024-09-11T23:26:35.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.721+0000 7f2bff5d6740 1 -- start start 2024-09-11T23:26:35.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.721+0000 7f2bff5d6740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b0bf2eea0 0x558b0bf86ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.721+0000 7f2bff5d6740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b0bf30630 0x558b0bf6d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.721+0000 7f2bff5d6740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 0x558b0bf6da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.721+0000 7f2bff5d6740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf41ffac0 con 0x558b0bf57d80 2024-09-11T23:26:35.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.722+0000 7f2bff5d6740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf40b4a80 con 0x558b0bf2eea0 2024-09-11T23:26:35.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.722+0000 7f2bff5d6740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf41ff430 con 0x558b0bf30630 2024-09-11T23:26:35.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.722+0000 7f2bfa600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 0x558b0bf6da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.722+0000 7f2bfa600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 0x558b0bf6da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53478/0 (socket says 172.21.15.144:53478) 2024-09-11T23:26:35.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.722+0000 7f2bfa600640 1 -- 172.21.15.144:0/2963584884 learned_addr learned my addr 172.21.15.144:0/2963584884 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:35.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.722+0000 7f2bfa600640 1 -- 172.21.15.144:0/2963584884 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b0bf30630 msgr2=0x558b0bf6d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:35.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.722+0000 7f2bfa600640 1 --2- 172.21.15.144:0/2963584884 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b0bf30630 0x558b0bf6d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.722+0000 7f2bfa600640 1 -- 172.21.15.144:0/2963584884 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b0bf2eea0 msgr2=0x558b0bf86ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:35.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.722+0000 7f2bfa600640 1 --2- 172.21.15.144:0/2963584884 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b0bf2eea0 0x558b0bf86ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.722+0000 7f2bfa600640 1 -- 172.21.15.144:0/2963584884 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b0bf25740 con 0x558b0bf57d80 2024-09-11T23:26:35.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.722+0000 7f2bfa600640 1 --2- 172.21.15.144:0/2963584884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 0x558b0bf6da80 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f2bec007de0 tx=0x7f2bec05c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af621f366858aa58 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:35.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.722+0000 7f2be5600640 1 -- 172.21.15.144:0/2963584884 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec088050 con 0x558b0bf57d80 2024-09-11T23:26:35.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.723+0000 7f2be5600640 1 -- 172.21.15.144:0/2963584884 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bec07d070 con 0x558b0bf57d80 2024-09-11T23:26:35.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.723+0000 7f2be5600640 1 -- 172.21.15.144:0/2963584884 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec0622e0 con 0x558b0bf57d80 2024-09-11T23:26:35.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.723+0000 7f2bff5d6740 1 -- 172.21.15.144:0/2963584884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 msgr2=0x558b0bf6da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:35.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.723+0000 7f2bff5d6740 1 --2- 172.21.15.144:0/2963584884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 0x558b0bf6da80 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f2bec007de0 tx=0x7f2bec05c000 comp rx=0 tx=0).stop 2024-09-11T23:26:35.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.723+0000 7f2bff5d6740 1 -- 172.21.15.144:0/2963584884 shutdown_connections 2024-09-11T23:26:35.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.723+0000 7f2bff5d6740 1 --2- 172.21.15.144:0/2963584884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 0x558b0bf6da80 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.723+0000 7f2bff5d6740 1 --2- 172.21.15.144:0/2963584884 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b0bf30630 0x558b0bf6d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.723+0000 7f2bff5d6740 1 --2- 172.21.15.144:0/2963584884 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b0bf2eea0 0x558b0bf86ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.723+0000 7f2bff5d6740 1 -- 172.21.15.144:0/2963584884 >> 172.21.15.144:0/2963584884 conn(0x558b0bf2c660 msgr2=0x558b0bf71db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:35.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.723+0000 7f2bff5d6740 1 -- 172.21.15.144:0/2963584884 shutdown_connections 2024-09-11T23:26:35.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.723+0000 7f2bff5d6740 1 -- 172.21.15.144:0/2963584884 wait complete. 2024-09-11T23:26:35.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.724+0000 7f2bff5d6740 1 -- start start 2024-09-11T23:26:35.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.724+0000 7f2bff5d6740 1 Processor -- start 2024-09-11T23:26:35.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.725+0000 7f2bff5d6740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b0bf2eea0 0x558b0bf723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.725+0000 7f2bff5d6740 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b0bf30630 0x558b0bff20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.725+0000 7f2bff5d6740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 0x558b0bf54ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.725+0000 7f2bff5d6740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558b0bf87960 con 0x558b0bf57d80 2024-09-11T23:26:35.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.725+0000 7f2bff5d6740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558b0bf58f90 con 0x558b0bf2eea0 2024-09-11T23:26:35.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.725+0000 7f2bff5d6740 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x558b0bf87fb0 con 0x558b0bf30630 2024-09-11T23:26:35.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.725+0000 7f2bff5d6740 10 client.0 _ll_register_callbacks cb 0x7f2bec0595a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T23:26:35.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.725+0000 7f2bfa600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 0x558b0bf54ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.725+0000 7f2bfa600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 0x558b0bf54ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53480/0 (socket says 172.21.15.144:53480) 2024-09-11T23:26:35.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.725+0000 7f2bfa600640 1 -- 172.21.15.144:0/1799404297 learned_addr learned my addr 172.21.15.144:0/1799404297 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:35.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.725+0000 7f2bf9c00640 1 --2- 172.21.15.144:0/1799404297 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b0bf2eea0 0x558b0bf723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.725+0000 7f2bf9200640 1 --2- 172.21.15.144:0/1799404297 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b0bf30630 0x558b0bff20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.726+0000 7f2bfa600640 1 -- 172.21.15.144:0/1799404297 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b0bf30630 msgr2=0x558b0bff20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:35.728 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.726+0000 7f2bfa600640 1 --2- 172.21.15.144:0/1799404297 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b0bf30630 0x558b0bff20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.726+0000 7f2bfa600640 1 -- 172.21.15.144:0/1799404297 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b0bf2eea0 msgr2=0x558b0bf723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:35.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.726+0000 7f2bfa600640 1 --2- 172.21.15.144:0/1799404297 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b0bf2eea0 0x558b0bf723e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.726+0000 7f2bfa600640 1 -- 172.21.15.144:0/1799404297 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b0bf55a30 con 0x558b0bf57d80 2024-09-11T23:26:35.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.726+0000 7f2bfa600640 1 --2- 172.21.15.144:0/1799404297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 0x558b0bf54ad0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f2bec059bd0 tx=0x7f2bec007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0611e4eaeabf29 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:35.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.726+0000 7f2bdaa00640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-11T23:26:35.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.726+0000 7f2bdaa00640 1 -- 172.21.15.144:0/1799404297 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec067060 con 0x558b0bf57d80 2024-09-11T23:26:35.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.726+0000 7f2bdaa00640 1 -- 172.21.15.144:0/1799404297 <== mon.0 v2:172.21.15.144:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f2bec0624f0 con 0x558b0bf57d80 2024-09-11T23:26:35.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.726+0000 7f2bff5d6740 1 -- 172.21.15.144:0/1799404297 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bec07d070 con 0x558b0bf57d80 2024-09-11T23:26:35.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.726+0000 7f2bdaa00640 1 -- 172.21.15.144:0/1799404297 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=119) ==== 24+0+0 (secure 0 0 0) 0x7f2bec06d050 con 0x558b0bf57d80 2024-09-11T23:26:35.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.726+0000 7f2bff5d6740 10 client.9135 fetch_fsmap learned FSMap version 119 2024-09-11T23:26:35.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.726+0000 7f2bff5d6740 1 -- 172.21.15.144:0/1799404297 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=119,monmap=2+}) -- 0x558b0bf289c0 con 0x558b0bf57d80 2024-09-11T23:26:35.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.727+0000 7f2bdaa00640 1 -- 172.21.15.144:0/1799404297 <== mon.0 v2:172.21.15.144:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bec07d070 con 0x558b0bf57d80 2024-09-11T23:26:35.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.727+0000 7f2bdaa00640 1 -- 172.21.15.144:0/1799404297 <== mon.0 v2:172.21.15.144:3300/0 5 ==== fsmap(e 119) ==== 3502+0+0 (secure 0 0 0) 0x7f2bec060140 con 0x558b0bf57d80 2024-09-11T23:26:35.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.727+0000 7f2bff5d6740 10 client.9135 fetch_fsmap finished waiting for FSMap version 119 2024-09-11T23:26:35.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.727+0000 7f2bff5d6740 10 client.9135 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T23:26:35.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.727+0000 7f2bff5d6740 20 client.9135 populate_metadata read hostname 'smithi144' 2024-09-11T23:26:35.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.727+0000 7f2bff5d6740 1 --2- 172.21.15.144:0/1799404297 >> [v2:172.21.15.165:6833/862543799,v1:172.21.15.165:6835/862543799] conn(0x558b0bf50870 0x558b0bf50c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.727+0000 7f2bff5d6740 4 client.9135 mds_command: new command op to 9015 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T23:26:35.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.727+0000 7f2bff5d6740 1 -- 172.21.15.144:0/1799404297 --> [v2:172.21.15.165:6833/862543799,v1:172.21.15.165:6835/862543799] -- command(tid 0: {"prefix": "status"}) -- 0x558b0be99e90 con 0x558b0bf50870 2024-09-11T23:26:35.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.727+0000 7f2bf9c00640 1 --2- 172.21.15.144:0/1799404297 >> [v2:172.21.15.165:6833/862543799,v1:172.21.15.165:6835/862543799] conn(0x558b0bf50870 0x558b0bf50c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.728+0000 7f2bdaa00640 10 client.9135 ms_handle_connect on v2:172.21.15.165:6833/862543799 2024-09-11T23:26:35.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.728+0000 7f2bf9c00640 1 --2- 172.21.15.144:0/1799404297 >> [v2:172.21.15.165:6833/862543799,v1:172.21.15.165:6835/862543799] conn(0x558b0bf50870 0x558b0bf50c50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f52c8ea32be2b363 server_cookie=d86975d385cab81c in_seq=0 out_seq=0 2024-09-11T23:26:35.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.728+0000 7f2bdaa00640 1 -- 172.21.15.144:0/1799404297 <== mds.0 v2:172.21.15.165:6833/862543799 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x558b0be99e90 con 0x558b0bf50870 2024-09-11T23:26:35.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.728+0000 7f2bdaa00640 10 client.9135 handle_command_reply: tid=0 2024-09-11T23:26:35.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.728+0000 7f2bff5d6740 1 client.9135 shutdown 2024-09-11T23:26:35.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.728+0000 7f2bff5d6740 1 -- 172.21.15.144:0/1799404297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 msgr2=0x558b0bf54ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.728+0000 7f2bff5d6740 1 --2- 172.21.15.144:0/1799404297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 0x558b0bf54ad0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f2bec059bd0 tx=0x7f2bec007040 comp rx=0 tx=0).stop 2024-09-11T23:26:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.728+0000 7f2bff5d6740 1 -- 172.21.15.144:0/1799404297 shutdown_connections 2024-09-11T23:26:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.728+0000 7f2bff5d6740 1 --2- 172.21.15.144:0/1799404297 >> [v2:172.21.15.165:6833/862543799,v1:172.21.15.165:6835/862543799] conn(0x558b0bf50870 0x558b0bf50c50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.728+0000 7f2bff5d6740 1 --2- 172.21.15.144:0/1799404297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558b0bf57d80 0x558b0bf54ad0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.728+0000 7f2bff5d6740 1 --2- 172.21.15.144:0/1799404297 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x558b0bf30630 0x558b0bff20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.728+0000 7f2bff5d6740 1 --2- 172.21.15.144:0/1799404297 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558b0bf2eea0 0x558b0bf723e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.728+0000 7f2bff5d6740 1 -- 172.21.15.144:0/1799404297 >> 172.21.15.144:0/1799404297 conn(0x558b0bf2c660 msgr2=0x558b0bf6d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.728+0000 7f2bdaa00640 0 client.9135 ms_handle_reset on v2:172.21.15.165:6833/862543799 2024-09-11T23:26:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.728+0000 7f2bff5d6740 1 -- 172.21.15.144:0/1799404297 shutdown_connections 2024-09-11T23:26:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.728+0000 7f2bff5d6740 1 -- 172.21.15.144:0/1799404297 wait complete. 2024-09-11T23:26:35.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.729+0000 7f2bff5d6740 20 client.9135 trim_cache size 0 max 16384 2024-09-11T23:26:35.733 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:26:35.733 INFO:teuthology.orchestra.run.smithi144.stdout: "cluster_fsid": "4b73e4b7-12f0-4e37-94bc-45e333efe84e", 2024-09-11T23:26:35.733 INFO:teuthology.orchestra.run.smithi144.stdout: "whoami": 0, 2024-09-11T23:26:35.733 INFO:teuthology.orchestra.run.smithi144.stdout: "id": 9015, 2024-09-11T23:26:35.733 INFO:teuthology.orchestra.run.smithi144.stdout: "want_state": "up:active", 2024-09-11T23:26:35.733 INFO:teuthology.orchestra.run.smithi144.stdout: "state": "up:active", 2024-09-11T23:26:35.733 INFO:teuthology.orchestra.run.smithi144.stdout: "fs_name": "cephfs", 2024-09-11T23:26:35.733 INFO:teuthology.orchestra.run.smithi144.stdout: "rank_uptime": 6.0649636129999998, 2024-09-11T23:26:35.733 INFO:teuthology.orchestra.run.smithi144.stdout: "mdsmap_epoch": 119, 2024-09-11T23:26:35.733 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch": 166, 2024-09-11T23:26:35.733 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_epoch_barrier": 166, 2024-09-11T23:26:35.733 INFO:teuthology.orchestra.run.smithi144.stdout: "uptime": 10.795748250999999 2024-09-11T23:26:35.734 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:26:35.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.729+0000 7f2bfb000640 1 -- 172.21.15.144:0/266037885 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2bd406c7c0 msgr2=0x7f2bd406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:35.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.729+0000 7f2bfb000640 1 --2- 172.21.15.144:0/266037885 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2bd406c7c0 0x7f2bd406ec80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2be80016e0 tx=0x7f2be8009040 comp rx=0 tx=0).stop 2024-09-11T23:26:35.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.729+0000 7f2bfb000640 1 -- 172.21.15.144:0/266037885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bf40b63f0 msgr2=0x7f2bf41585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.729+0000 7f2bfb000640 1 --2- 172.21.15.144:0/266037885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bf40b63f0 0x7f2bf41585c0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f2bec007e10 tx=0x7f2bec00e4b0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.729+0000 7f2bfb000640 1 -- 172.21.15.144:0/266037885 shutdown_connections 2024-09-11T23:26:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.729+0000 7f2bfb000640 1 --2- 172.21.15.144:0/266037885 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2bd406c7c0 0x7f2bd406ec80 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.729+0000 7f2bfb000640 1 --2- 172.21.15.144:0/266037885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bf40b63f0 0x7f2bf41585c0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.729+0000 7f2bfb000640 1 --2- 172.21.15.144:0/266037885 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2bf415e6a0 0x7f2bf40cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.729+0000 7f2bfb000640 1 --2- 172.21.15.144:0/266037885 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2bf40d2230 0x7f2bf41f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.729+0000 7f2bfb000640 1 -- 172.21.15.144:0/266037885 >> 172.21.15.144:0/266037885 conn(0x7f2bf40d4540 msgr2=0x7f2bf40d4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.729+0000 7f2bfb000640 1 -- 172.21.15.144:0/266037885 shutdown_connections 2024-09-11T23:26:35.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.729+0000 7f2bfb000640 1 -- 172.21.15.144:0/266037885 wait complete. 2024-09-11T23:26:35.744 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:26:35.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.897+0000 7fb9ce200640 1 Processor -- start 2024-09-11T23:26:35.897 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.898+0000 7fb9ce200640 1 -- start start 2024-09-11T23:26:35.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.899+0000 7fb9ce200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9c80d02a0 0x7fb9c80d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.899+0000 7fb9ce200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb9c815ce80 0x7fb9c81594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.899+0000 7fb9ce200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9c80d0bc0 con 0x7fb9c815ca40 2024-09-11T23:26:35.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.899+0000 7fb9ce200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb9c815d390 con 0x7fb9c815ce80 2024-09-11T23:26:35.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.899+0000 7fb9ce200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c815d670 con 0x7fb9c80d02a0 2024-09-11T23:26:35.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.899+0000 7fb9bea00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fb9c815ca40 0x7fb9c815e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:60088/0 (socket says 172.21.15.144:60088) 2024-09-11T23:26:35.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.899+0000 7fb9bea00640 1 -- 172.21.15.144:0/2779001935 learned_addr learned my addr 172.21.15.144:0/2779001935 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:35.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.899+0000 7fb9c7400640 1 --2- 172.21.15.144:0/2779001935 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9c80d02a0 0x7fb9c80d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.899+0000 7fb9c7e00640 1 --2- 172.21.15.144:0/2779001935 >> v2:172.21.15.165:3300/0 conn(0x7fb9c815ce80 0x7fb9c81594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.899+0000 7fb9c6a00640 1 -- 172.21.15.144:0/2779001935 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3864964891 0 0) 0x7fb9c80d0bc0 con 0x7fb9c815ca40 2024-09-11T23:26:35.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.900+0000 7fb9c6a00640 1 -- 172.21.15.144:0/2779001935 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9ac003520 con 0x7fb9c815ca40 2024-09-11T23:26:35.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.900+0000 7fb9c7400640 1 -- 172.21.15.144:0/2779001935 >> v2:172.21.15.165:3300/0 conn(0x7fb9c815ce80 msgr2=0x7fb9c81594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:35.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.900+0000 7fb9c7400640 1 --2- 172.21.15.144:0/2779001935 >> v2:172.21.15.165:3300/0 conn(0x7fb9c815ce80 0x7fb9c81594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.900+0000 7fb9c7400640 1 -- 172.21.15.144:0/2779001935 >> v1:172.21.15.144:6789/0 conn(0x7fb9c815ca40 legacy=0x7fb9c815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:35.900 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.900+0000 7fb9c7400640 1 -- 172.21.15.144:0/2779001935 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c815d950 con 0x7fb9c80d02a0 2024-09-11T23:26:35.901 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.901+0000 7fb9c7400640 1 --2- 172.21.15.144:0/2779001935 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9c80d02a0 0x7fb9c80d0680 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80097a0 tx=0x7fb9b802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90bdbaa4ed5cc2b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:35.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.901+0000 7fb9c6a00640 1 -- 172.21.15.144:0/2779001935 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8037070 con 0x7fb9c80d02a0 2024-09-11T23:26:35.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.901+0000 7fb9c6a00640 1 -- 172.21.15.144:0/2779001935 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b802ae50 con 0x7fb9c80d02a0 2024-09-11T23:26:35.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.901+0000 7fb9c6a00640 1 -- 172.21.15.144:0/2779001935 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8032640 con 0x7fb9c80d02a0 2024-09-11T23:26:35.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.902+0000 7fb9ce200640 1 -- 172.21.15.144:0/2779001935 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9c80d02a0 msgr2=0x7fb9c80d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:35.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.902+0000 7fb9ce200640 1 --2- 172.21.15.144:0/2779001935 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9c80d02a0 0x7fb9c80d0680 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb9b80097a0 tx=0x7fb9b802a100 comp rx=0 tx=0).stop 2024-09-11T23:26:35.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.902+0000 7fb9ce200640 1 -- 172.21.15.144:0/2779001935 shutdown_connections 2024-09-11T23:26:35.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.902+0000 7fb9ce200640 1 --2- 172.21.15.144:0/2779001935 >> v2:172.21.15.165:3300/0 conn(0x7fb9c815ce80 0x7fb9c81594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.902+0000 7fb9ce200640 1 --2- 172.21.15.144:0/2779001935 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9c80d02a0 0x7fb9c80d0680 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.902+0000 7fb9ce200640 1 -- 172.21.15.144:0/2779001935 >> 172.21.15.144:0/2779001935 conn(0x7fb9c8062cc0 msgr2=0x7fb9c806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:35.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.902+0000 7fb9ce200640 1 -- 172.21.15.144:0/2779001935 shutdown_connections 2024-09-11T23:26:35.902 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.902+0000 7fb9ce200640 1 -- 172.21.15.144:0/2779001935 wait complete. 2024-09-11T23:26:35.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.903+0000 7fb9ce200640 1 Processor -- start 2024-09-11T23:26:35.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.903+0000 7fb9ce200640 1 -- start start 2024-09-11T23:26:35.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.904+0000 7fb9ce200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9c80d02a0 0x7fb9c8152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.904+0000 7fb9ce200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9c815ca40 0x7fb9c814c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.904+0000 7fb9ce200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9c815ce80 0x7fb9c814c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.904+0000 7fb9ce200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c815eb40 con 0x7fb9c815ca40 2024-09-11T23:26:35.905 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.904+0000 7fb9ce200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c815df10 con 0x7fb9c815ce80 2024-09-11T23:26:35.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.904+0000 7fb9ce200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c8155b90 con 0x7fb9c80d02a0 2024-09-11T23:26:35.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.905+0000 7fb9bea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9c815ca40 0x7fb9c814c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.905+0000 7fb9bea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9c815ca40 0x7fb9c814c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53486/0 (socket says 172.21.15.144:53486) 2024-09-11T23:26:35.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.905+0000 7fb9bea00640 1 -- 172.21.15.144:0/4075540160 learned_addr learned my addr 172.21.15.144:0/4075540160 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:35.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.905+0000 7fb9c7400640 1 --2- 172.21.15.144:0/4075540160 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9c80d02a0 0x7fb9c8152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.905+0000 7fb9c7e00640 1 --2- 172.21.15.144:0/4075540160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9c815ce80 0x7fb9c814c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.905+0000 7fb9bea00640 1 -- 172.21.15.144:0/4075540160 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9c80d02a0 msgr2=0x7fb9c8152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:35.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.905+0000 7fb9bea00640 1 --2- 172.21.15.144:0/4075540160 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9c80d02a0 0x7fb9c8152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.905+0000 7fb9bea00640 1 -- 172.21.15.144:0/4075540160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9c815ce80 msgr2=0x7fb9c814c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:35.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.905+0000 7fb9bea00640 1 --2- 172.21.15.144:0/4075540160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9c815ce80 0x7fb9c814c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:35.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.905+0000 7fb9bea00640 1 -- 172.21.15.144:0/4075540160 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c81533e0 con 0x7fb9c815ca40 2024-09-11T23:26:35.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.905+0000 7fb9bea00640 1 --2- 172.21.15.144:0/4075540160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9c815ca40 0x7fb9c814c080 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000c400 tx=0x7fb9b000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:35.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.906+0000 7fb9bfe00640 1 -- 172.21.15.144:0/4075540160 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0017070 con 0x7fb9c815ca40 2024-09-11T23:26:35.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.906+0000 7fb9bfe00640 1 -- 172.21.15.144:0/4075540160 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9b0005d00 con 0x7fb9c815ca40 2024-09-11T23:26:35.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.906+0000 7fb9bfe00640 1 -- 172.21.15.144:0/4075540160 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0007310 con 0x7fb9c815ca40 2024-09-11T23:26:35.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.906+0000 7fb9ce200640 1 -- 172.21.15.144:0/4075540160 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c81536a0 con 0x7fb9c815ca40 2024-09-11T23:26:35.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.906+0000 7fb9ce200640 1 -- 172.21.15.144:0/4075540160 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c8153c60 con 0x7fb9c815ca40 2024-09-11T23:26:35.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.907+0000 7fb9ce200640 1 -- 172.21.15.144:0/4075540160 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9c81553f0 con 0x7fb9c815ca40 2024-09-11T23:26:35.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.908+0000 7fb9bfe00640 1 -- 172.21.15.144:0/4075540160 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7fb9b001a070 con 0x7fb9c815ca40 2024-09-11T23:26:35.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.908+0000 7fb9bfe00640 1 --2- 172.21.15.144:0/4075540160 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb9a406c7c0 0x7fb9a406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:35.908 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.909+0000 7fb9bfe00640 1 -- 172.21.15.144:0/4075540160 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7fb9b00889c0 con 0x7fb9c815ca40 2024-09-11T23:26:35.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.909+0000 7fb9c7400640 1 --2- 172.21.15.144:0/4075540160 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb9a406c7c0 0x7fb9a406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:35.909 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.910+0000 7fb9c7400640 1 --2- 172.21.15.144:0/4075540160 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb9a406c7c0 0x7fb9a406ec80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8034000 tx=0x7fb9b802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:35.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:35.913+0000 7fb9bfe00640 1 -- 172.21.15.144:0/4075540160 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb9c81553f0 con 0x7fb9c815ca40 2024-09-11T23:26:36.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:36.122+0000 7fb9ce200640 1 -- 172.21.15.144:0/4075540160 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb9c80b4790 con 0x7fb9c815ca40 2024-09-11T23:26:36.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:36.122+0000 7fb9bfe00640 1 -- 172.21.15.144:0/4075540160 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v119) ==== 53+0+73 (secure 0 0 0) 0x7fb9b0058920 con 0x7fb9c815ca40 2024-09-11T23:26:36.122 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:26:36.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:36.124+0000 7fb9ce200640 1 -- 172.21.15.144:0/4075540160 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb9a406c7c0 msgr2=0x7fb9a406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:36.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:36.125+0000 7fb9ce200640 1 --2- 172.21.15.144:0/4075540160 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb9a406c7c0 0x7fb9a406ec80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8034000 tx=0x7fb9b802e000 comp rx=0 tx=0).stop 2024-09-11T23:26:36.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:36.125+0000 7fb9ce200640 1 -- 172.21.15.144:0/4075540160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9c815ca40 msgr2=0x7fb9c814c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:36.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:36.125+0000 7fb9ce200640 1 --2- 172.21.15.144:0/4075540160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9c815ca40 0x7fb9c814c080 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000c400 tx=0x7fb9b000c8c0 comp rx=0 tx=0).stop 2024-09-11T23:26:36.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:36.125+0000 7fb9ce200640 1 -- 172.21.15.144:0/4075540160 shutdown_connections 2024-09-11T23:26:36.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:36.125+0000 7fb9ce200640 1 --2- 172.21.15.144:0/4075540160 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb9a406c7c0 0x7fb9a406ec80 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:36.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:36.125+0000 7fb9ce200640 1 --2- 172.21.15.144:0/4075540160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb9c815ce80 0x7fb9c814c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:36.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:36.125+0000 7fb9ce200640 1 --2- 172.21.15.144:0/4075540160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9c815ca40 0x7fb9c814c080 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:36.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:36.125+0000 7fb9ce200640 1 --2- 172.21.15.144:0/4075540160 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb9c80d02a0 0x7fb9c8152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:36.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:36.125+0000 7fb9ce200640 1 -- 172.21.15.144:0/4075540160 >> 172.21.15.144:0/4075540160 conn(0x7fb9c8062cc0 msgr2=0x7fb9c80b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:36.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:36.125+0000 7fb9ce200640 1 -- 172.21.15.144:0/4075540160 shutdown_connections 2024-09-11T23:26:36.125 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:36.125+0000 7fb9ce200640 1 -- 172.21.15.144:0/4075540160 wait complete. 2024-09-11T23:26:36.140 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:26:36.140 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:26:36.140 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi144.front.sepia.ceph.com 2024-09-11T23:26:36.140 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T23:26:36.140 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T23:26:36.140 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:26:36.140 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:26:36.141 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:26:36.141 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:26:36.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:36.141 DEBUG:teuthology.orchestra.run.smithi144:> ip addr 2024-09-11T23:26:36.177 INFO:teuthology.orchestra.run.smithi144.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:26:36.177 INFO:teuthology.orchestra.run.smithi144.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:26:36.177 INFO:teuthology.orchestra.run.smithi144.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:26:36.177 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:36.177 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 ::1/128 scope host 2024-09-11T23:26:36.177 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:36.177 INFO:teuthology.orchestra.run.smithi144.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:26:36.177 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:22 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:26:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f0 2024-09-11T23:26:36.178 INFO:teuthology.orchestra.run.smithi144.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:26:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:d9:38:23 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:26:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: altname enp7s0f1 2024-09-11T23:26:36.178 INFO:teuthology.orchestra.run.smithi144.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:26:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5e brd ff:ff:ff:ff:ff:ff 2024-09-11T23:26:36.178 INFO:teuthology.orchestra.run.smithi144.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:26:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 0c:c4:7a:88:7f:5f brd ff:ff:ff:ff:ff:ff 2024-09-11T23:26:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: inet 172.21.15.144/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:26:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft 42166sec preferred_lft 42166sec 2024-09-11T23:26:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::ec4:7aff:fe88:7f5f/64 scope link noprefixroute 2024-09-11T23:26:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:36.178 INFO:teuthology.orchestra.run.smithi144.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:26:36.178 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff 2024-09-11T23:26:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:26:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::243b:82ff:fe06:fac9/64 scope link 2024-09-11T23:26:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:36.179 INFO:teuthology.orchestra.run.smithi144.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:26:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether 76:ca:30:f2:cd:df brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:26:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::74ca:30ff:fef2:cddf/64 scope link 2024-09-11T23:26:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:36.179 INFO:teuthology.orchestra.run.smithi144.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:26:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: link/ether be:01:ec:87:34:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:26:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: inet6 fe80::bc01:ecff:fe87:34e1/64 scope link 2024-09-11T23:26:36.179 INFO:teuthology.orchestra.run.smithi144.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:36.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:36.180 DEBUG:teuthology.orchestra.run.smithi144:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:26:36.271 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-09-11T23:26:36.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:36.274 DEBUG:teuthology.orchestra.run.smithi144:> route 2024-09-11T23:26:36.310 INFO:teuthology.orchestra.run.smithi144.stdout:Kernel IP routing table 2024-09-11T23:26:36.310 INFO:teuthology.orchestra.run.smithi144.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:26:36.310 INFO:teuthology.orchestra.run.smithi144.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:26:36.311 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:26:36.311 INFO:teuthology.orchestra.run.smithi144.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:26:36.311 DEBUG:teuthology.orchestra.run.smithi144:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:26:36.311 DEBUG:teuthology.orchestra.run.smithi144:> set -e 2024-09-11T23:26:36.311 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:26:36.311 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:26:36.311 DEBUG:teuthology.orchestra.run.smithi144:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:26:36.311 DEBUG:teuthology.orchestra.run.smithi144:> ') 2024-09-11T23:26:36.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:26:36.499 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:26:36.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:36.507 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-11T23:26:36.543 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:26:36.543 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:26:36.543 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:26:36.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:36.543 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link set brx.0 up 2024-09-11T23:26:36.640 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:26:36.640 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T23:26:36.676 INFO:teuthology.orchestra.run.smithi144.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T23:26:36.676 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:26:36.676 DEBUG:teuthology.orchestra.run.smithi144:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:26:36.752 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-11T23:26:36.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:36.752 DEBUG:teuthology.orchestra.run.smithi144:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:26:36.880 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:26:36.881 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:26:36.908 INFO:teuthology.orchestra.run.smithi144.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:26:36.909 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:26:36.909 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:26:36.909 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: trying mount with new device syntax: 0@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:26:36.909 INFO:teuthology.orchestra.run.smithi144.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:26:36.910 INFO:teuthology.orchestra.run.smithi144.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T23:26:36.910 INFO:teuthology.orchestra.run.smithi144.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:26:36.910 INFO:teuthology.orchestra.run.smithi144.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:26:36.910 INFO:teuthology.orchestra.run.smithi144.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:26:36.910 INFO:teuthology.orchestra.run.smithi144.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:26:36.913 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:26:36.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:36.913 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T23:26:36.970 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:26:37.052 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:26:37.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:26:37.069 INFO:teuthology.orchestra.run.smithi144.stdout:client8518 2024-09-11T23:26:37.070 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:26:37.070 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:37.106 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T23:26:37.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.298+0000 7eff75600640 1 Processor -- start 2024-09-11T23:26:37.298 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.299+0000 7eff75600640 1 -- start start 2024-09-11T23:26:37.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.300+0000 7eff75600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff7015c180 0x7eff700cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:37.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.300+0000 7eff75600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7eff70073120 0x7eff700735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:37.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.300+0000 7eff75600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff700ce740 con 0x7eff700ce230 2024-09-11T23:26:37.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.300+0000 7eff75600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7eff70072640 con 0x7eff70073120 2024-09-11T23:26:37.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.300+0000 7eff75600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7eff70072920 con 0x7eff7015c180 2024-09-11T23:26:37.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.300+0000 7eff6f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7eff70073120 0x7eff700735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:37.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.300+0000 7eff6f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7eff70073120 0x7eff700735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53490/0 (socket says 172.21.15.144:53490) 2024-09-11T23:26:37.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.300+0000 7eff6f400640 1 -- 172.21.15.144:0/3161153709 learned_addr learned my addr 172.21.15.144:0/3161153709 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:37.300 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.300+0000 7eff6ea00640 1 --2- 172.21.15.144:0/3161153709 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff7015c180 0x7eff700cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:37.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.300+0000 7eff6f400640 1 -- 172.21.15.144:0/3161153709 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff7015c180 msgr2=0x7eff700cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:37.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.300+0000 7eff6f400640 1 --2- 172.21.15.144:0/3161153709 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff7015c180 0x7eff700cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:37.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.300+0000 7eff6f400640 1 -- 172.21.15.144:0/3161153709 >> v1:172.21.15.144:6789/0 conn(0x7eff700ce230 legacy=0x7eff700cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:37.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.300+0000 7eff6f400640 1 -- 172.21.15.144:0/3161153709 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff70072c00 con 0x7eff70073120 2024-09-11T23:26:37.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.301+0000 7eff6f400640 1 --2- 172.21.15.144:0/3161153709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff70073120 0x7eff700735d0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7eff68009e50 tx=0x7eff6802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dcdd35550a52d9f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:37.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.302+0000 7eff6d600640 1 -- 172.21.15.144:0/3161153709 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff68036070 con 0x7eff70073120 2024-09-11T23:26:37.301 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.302+0000 7eff6d600640 1 -- 172.21.15.144:0/3161153709 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff68031600 con 0x7eff70073120 2024-09-11T23:26:37.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.302+0000 7eff6d600640 1 -- 172.21.15.144:0/3161153709 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff680319d0 con 0x7eff70073120 2024-09-11T23:26:37.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.302+0000 7eff75600640 1 -- 172.21.15.144:0/3161153709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff70073120 msgr2=0x7eff700735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:37.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.302+0000 7eff75600640 1 --2- 172.21.15.144:0/3161153709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff70073120 0x7eff700735d0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7eff68009e50 tx=0x7eff6802a680 comp rx=0 tx=0).stop 2024-09-11T23:26:37.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.302+0000 7eff75600640 1 -- 172.21.15.144:0/3161153709 shutdown_connections 2024-09-11T23:26:37.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.302+0000 7eff75600640 1 --2- 172.21.15.144:0/3161153709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff70073120 0x7eff700735d0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:37.302 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.302+0000 7eff75600640 1 --2- 172.21.15.144:0/3161153709 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff7015c180 0x7eff700cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:37.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.302+0000 7eff75600640 1 -- 172.21.15.144:0/3161153709 >> 172.21.15.144:0/3161153709 conn(0x7eff70062cc0 msgr2=0x7eff7006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:37.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.302+0000 7eff75600640 1 -- 172.21.15.144:0/3161153709 shutdown_connections 2024-09-11T23:26:37.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.302+0000 7eff75600640 1 -- 172.21.15.144:0/3161153709 wait complete. 2024-09-11T23:26:37.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.304+0000 7eff75600640 1 Processor -- start 2024-09-11T23:26:37.303 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.304+0000 7eff75600640 1 -- start start 2024-09-11T23:26:37.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.305+0000 7eff75600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff70073120 0x7eff70147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:37.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.305+0000 7eff75600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff700ce230 0x7eff70160750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:37.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.305+0000 7eff75600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff7015c180 0x7eff701f2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:37.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.305+0000 7eff75600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff700cf780 con 0x7eff70073120 2024-09-11T23:26:37.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.305+0000 7eff75600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7eff700722f0 con 0x7eff7015c180 2024-09-11T23:26:37.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.305+0000 7eff75600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7eff7015c560 con 0x7eff700ce230 2024-09-11T23:26:37.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.305+0000 7eff6ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff70073120 0x7eff70147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:37.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.305+0000 7eff6ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff70073120 0x7eff70147e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53496/0 (socket says 172.21.15.144:53496) 2024-09-11T23:26:37.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.305+0000 7eff6ea00640 1 -- 172.21.15.144:0/565512719 learned_addr learned my addr 172.21.15.144:0/565512719 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:37.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.305+0000 7eff6e000640 1 --2- 172.21.15.144:0/565512719 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff700ce230 0x7eff70160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:37.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.305+0000 7eff6f400640 1 --2- 172.21.15.144:0/565512719 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff7015c180 0x7eff701f2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:37.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.305+0000 7eff6ea00640 1 -- 172.21.15.144:0/565512719 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff700ce230 msgr2=0x7eff70160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:37.306 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.305+0000 7eff6ea00640 1 --2- 172.21.15.144:0/565512719 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff700ce230 0x7eff70160750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:37.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.306+0000 7eff6ea00640 1 -- 172.21.15.144:0/565512719 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff7015c180 msgr2=0x7eff701f2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:37.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.306+0000 7eff6ea00640 1 --2- 172.21.15.144:0/565512719 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff7015c180 0x7eff701f2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:37.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.306+0000 7eff6ea00640 1 -- 172.21.15.144:0/565512719 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff70160c90 con 0x7eff70073120 2024-09-11T23:26:37.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.306+0000 7eff6ea00640 1 --2- 172.21.15.144:0/565512719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff70073120 0x7eff70147e70 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7eff6000d830 tx=0x7eff6000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:37.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.306+0000 7eff66a00640 1 -- 172.21.15.144:0/565512719 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6000b6c0 con 0x7eff70073120 2024-09-11T23:26:37.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.306+0000 7eff66a00640 1 -- 172.21.15.144:0/565512719 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff60019070 con 0x7eff70073120 2024-09-11T23:26:37.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.306+0000 7eff66a00640 1 -- 172.21.15.144:0/565512719 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6000ba80 con 0x7eff70073120 2024-09-11T23:26:37.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.306+0000 7eff75600640 1 -- 172.21.15.144:0/565512719 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff701e7770 con 0x7eff70073120 2024-09-11T23:26:37.307 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.306+0000 7eff75600640 1 -- 172.21.15.144:0/565512719 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff701e9550 con 0x7eff70073120 2024-09-11T23:26:37.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.307+0000 7eff75600640 1 -- 172.21.15.144:0/565512719 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff700cdcf0 con 0x7eff70073120 2024-09-11T23:26:37.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.308+0000 7eff66a00640 1 -- 172.21.15.144:0/565512719 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7eff6001e460 con 0x7eff70073120 2024-09-11T23:26:37.308 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.309+0000 7eff66a00640 1 --2- 172.21.15.144:0/565512719 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff5006c7c0 0x7eff5006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:37.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.309+0000 7eff66a00640 1 -- 172.21.15.144:0/565512719 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7eff60089ca0 con 0x7eff70073120 2024-09-11T23:26:37.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.309+0000 7eff6e000640 1 --2- 172.21.15.144:0/565512719 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff5006c7c0 0x7eff5006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:37.309 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.310+0000 7eff6e000640 1 --2- 172.21.15.144:0/565512719 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff5006c7c0 0x7eff5006ec80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7eff7015a580 tx=0x7eff5c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:37.312 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.313+0000 7eff66a00640 1 -- 172.21.15.144:0/565512719 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7eff70160c90 con 0x7eff70073120 2024-09-11T23:26:37.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.524+0000 7eff75600640 1 -- 172.21.15.144:0/565512719 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7eff7006d4b0 con 0x7eff70073120 2024-09-11T23:26:37.524 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.524+0000 7eff66a00640 1 -- 172.21.15.144:0/565512719 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v119) ==== 53+0+73 (secure 0 0 0) 0x7eff6005a250 con 0x7eff70073120 2024-09-11T23:26:37.524 INFO:teuthology.orchestra.run.smithi144.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-11T23:26:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.527+0000 7eff75600640 1 -- 172.21.15.144:0/565512719 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff5006c7c0 msgr2=0x7eff5006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.527+0000 7eff75600640 1 --2- 172.21.15.144:0/565512719 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff5006c7c0 0x7eff5006ec80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7eff7015a580 tx=0x7eff5c009040 comp rx=0 tx=0).stop 2024-09-11T23:26:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.527+0000 7eff75600640 1 -- 172.21.15.144:0/565512719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff70073120 msgr2=0x7eff70147e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.527+0000 7eff75600640 1 --2- 172.21.15.144:0/565512719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff70073120 0x7eff70147e70 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7eff6000d830 tx=0x7eff6000dcf0 comp rx=0 tx=0).stop 2024-09-11T23:26:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.527+0000 7eff75600640 1 -- 172.21.15.144:0/565512719 shutdown_connections 2024-09-11T23:26:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.527+0000 7eff75600640 1 --2- 172.21.15.144:0/565512719 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff5006c7c0 0x7eff5006ec80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.527+0000 7eff75600640 1 --2- 172.21.15.144:0/565512719 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff7015c180 0x7eff701f2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.527+0000 7eff75600640 1 --2- 172.21.15.144:0/565512719 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff700ce230 0x7eff70160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:37.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.527+0000 7eff75600640 1 --2- 172.21.15.144:0/565512719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff70073120 0x7eff70147e70 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:37.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.527+0000 7eff75600640 1 -- 172.21.15.144:0/565512719 >> 172.21.15.144:0/565512719 conn(0x7eff70062cc0 msgr2=0x7eff7006c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:37.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.527+0000 7eff75600640 1 -- 172.21.15.144:0/565512719 shutdown_connections 2024-09-11T23:26:37.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:37.527+0000 7eff75600640 1 -- 172.21.15.144:0/565512719 wait complete. 2024-09-11T23:26:37.543 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T23:26:37.543 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T23:26:37.543 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi165.front.sepia.ceph.com 2024-09-11T23:26:37.543 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-11T23:26:37.543 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-11T23:26:37.543 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T23:26:37.543 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-11T23:26:37.543 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T23:26:37.544 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:26:37.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:37.544 DEBUG:teuthology.orchestra.run.smithi165:> ip addr 2024-09-11T23:26:37.585 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T23:26:37.585 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T23:26:37.585 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T23:26:37.585 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:37.585 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-11T23:26:37.585 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:37.586 INFO:teuthology.orchestra.run.smithi165.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:26:37.586 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:94 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:26:37.586 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f0 2024-09-11T23:26:37.586 INFO:teuthology.orchestra.run.smithi165.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:26:37.586 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:95 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:26:37.586 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f1 2024-09-11T23:26:37.586 INFO:teuthology.orchestra.run.smithi165.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T23:26:37.586 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:62 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:26:37.586 INFO:teuthology.orchestra.run.smithi165.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T23:26:37.586 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:63 brd ff:ff:ff:ff:ff:ff 2024-09-11T23:26:37.586 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.21.15.165/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T23:26:37.586 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft 42168sec preferred_lft 42168sec 2024-09-11T23:26:37.586 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::ec4:7aff:fe88:7f63/64 scope link noprefixroute 2024-09-11T23:26:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:37.587 INFO:teuthology.orchestra.run.smithi165.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-11T23:26:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff 2024-09-11T23:26:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-11T23:26:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::c063:d7ff:fec8:c56c/64 scope link 2024-09-11T23:26:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:37.587 INFO:teuthology.orchestra.run.smithi165.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:26:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 56:78:e4:cd:07:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:26:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::5478:e4ff:fecd:76c/64 scope link 2024-09-11T23:26:37.587 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:37.587 INFO:teuthology.orchestra.run.smithi165.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-11T23:26:37.588 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether ba:fa:43:78:5f:29 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:26:37.588 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::b8fa:43ff:fe78:5f29/64 scope link 2024-09-11T23:26:37.588 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-11T23:26:37.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:37.589 DEBUG:teuthology.orchestra.run.smithi165:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T23:26:37.685 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-11T23:26:37.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:37.689 DEBUG:teuthology.orchestra.run.smithi165:> route 2024-09-11T23:26:37.727 INFO:teuthology.orchestra.run.smithi165.stdout:Kernel IP routing table 2024-09-11T23:26:37.727 INFO:teuthology.orchestra.run.smithi165.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T23:26:37.727 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T23:26:37.727 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T23:26:37.728 INFO:teuthology.orchestra.run.smithi165.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T23:26:37.728 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T23:26:37.728 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-11T23:26:37.728 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T23:26:37.728 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T23:26:37.728 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T23:26:37.729 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-11T23:26:37.847 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:26:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T23:26:37.918 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:26:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:26:37.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:37.926 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-11T23:26:37.962 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-11T23:26:37.962 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-11T23:26:37.963 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:26:37.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:37.963 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set brx.0 up 2024-09-11T23:26:38.060 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:26:38.060 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-11T23:26:38.097 INFO:teuthology.orchestra.run.smithi165.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-11T23:26:38.098 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T23:26:38.098 DEBUG:teuthology.orchestra.run.smithi165:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:26:38.174 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-11T23:26:38.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:38.174 DEBUG:teuthology.orchestra.run.smithi165:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:26:38.302 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:26:38.302 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:26:38.328 INFO:teuthology.orchestra.run.smithi165.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-11T23:26:38.328 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-11T23:26:38.329 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: resolved to: "172.21.15.144:3300,172.21.15.165:3300,172.21.15.165:3301" 2024-09-11T23:26:38.329 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: trying mount with new device syntax: 1@4b73e4b7-12f0-4e37-94bc-45e333efe84e.cephfs=/ 2024-09-11T23:26:38.329 INFO:teuthology.orchestra.run.smithi165.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.144:3300/172.21.15.165:3300/172.21.15.165:3301" will pass to kernel 2024-09-11T23:26:38.331 INFO:teuthology.orchestra.run.smithi165.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-11T23:26:38.331 INFO:teuthology.orchestra.run.smithi165.stdout: You just mounted a file system that supports labels which does not 2024-09-11T23:26:38.331 INFO:teuthology.orchestra.run.smithi165.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T23:26:38.331 INFO:teuthology.orchestra.run.smithi165.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T23:26:38.331 INFO:teuthology.orchestra.run.smithi165.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T23:26:38.334 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T23:26:38.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:38.334 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-11T23:26:38.390 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T23:26:38.468 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:26:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:26:38.471 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-11T23:26:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:26:38.479 INFO:teuthology.orchestra.run.smithi165.stdout:client8524 2024-09-11T23:26:38.480 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:26:38.480 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:38.515 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-11T23:26:38.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.684+0000 7f2e18a00640 1 Processor -- start 2024-09-11T23:26:38.684 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.684+0000 7f2e18a00640 1 -- start start 2024-09-11T23:26:38.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.685+0000 7f2e18a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2e1406f130 0x7f2e14072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:38.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.685+0000 7f2e18a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2e1415f9f0 0x7f2e140ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:38.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.686+0000 7f2e18a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e1415c970 con 0x7f2e1415b370 2024-09-11T23:26:38.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.686+0000 7f2e18a00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2e1415fef0 con 0x7f2e1415f9f0 2024-09-11T23:26:38.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.686+0000 7f2e18a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2e1415bbb0 con 0x7f2e1406f130 2024-09-11T23:26:38.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.686+0000 7f2e12800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2e1415f9f0 0x7f2e140ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:38.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.686+0000 7f2e12800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2e1415f9f0 0x7f2e140ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53506/0 (socket says 172.21.15.144:53506) 2024-09-11T23:26:38.686 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.686+0000 7f2e12800640 1 -- 172.21.15.144:0/3070893597 learned_addr learned my addr 172.21.15.144:0/3070893597 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:38.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.686+0000 7f2e11400640 1 --2- 172.21.15.144:0/3070893597 >> v2:172.21.15.165:3300/0 conn(0x7f2e1406f130 0x7f2e14072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:38.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.686+0000 7f2e12800640 1 -- 172.21.15.144:0/3070893597 >> v2:172.21.15.165:3300/0 conn(0x7f2e1406f130 msgr2=0x7f2e14072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:38.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.686+0000 7f2e12800640 1 --2- 172.21.15.144:0/3070893597 >> v2:172.21.15.165:3300/0 conn(0x7f2e1406f130 0x7f2e14072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:38.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.686+0000 7f2e12800640 1 -- 172.21.15.144:0/3070893597 >> v1:172.21.15.165:6789/0 conn(0x7f2e1415b370 legacy=0x7f2e1406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:38.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.686+0000 7f2e12800640 1 -- 172.21.15.144:0/3070893597 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1415be90 con 0x7f2e1415f9f0 2024-09-11T23:26:38.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.687+0000 7f2e12800640 1 --2- 172.21.15.144:0/3070893597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e1415f9f0 0x7f2e140ce490 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f2e140d0470 tx=0x7f2e0c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b4192d82f3f6ce server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:38.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.687+0000 7f2e10a00640 1 -- 172.21.15.144:0/3070893597 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c036070 con 0x7f2e1415f9f0 2024-09-11T23:26:38.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.688+0000 7f2e10a00640 1 -- 172.21.15.144:0/3070893597 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e0c031600 con 0x7f2e1415f9f0 2024-09-11T23:26:38.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.688+0000 7f2e10a00640 1 -- 172.21.15.144:0/3070893597 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c0319d0 con 0x7f2e1415f9f0 2024-09-11T23:26:38.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.688+0000 7f2e18a00640 1 -- 172.21.15.144:0/3070893597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e1415f9f0 msgr2=0x7f2e140ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:38.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.688+0000 7f2e18a00640 1 --2- 172.21.15.144:0/3070893597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e1415f9f0 0x7f2e140ce490 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f2e140d0470 tx=0x7f2e0c02a6a0 comp rx=0 tx=0).stop 2024-09-11T23:26:38.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.688+0000 7f2e18a00640 1 -- 172.21.15.144:0/3070893597 shutdown_connections 2024-09-11T23:26:38.688 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.688+0000 7f2e18a00640 1 --2- 172.21.15.144:0/3070893597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e1415f9f0 0x7f2e140ce490 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:38.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.688+0000 7f2e18a00640 1 --2- 172.21.15.144:0/3070893597 >> v2:172.21.15.165:3300/0 conn(0x7f2e1406f130 0x7f2e14072560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:38.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.688+0000 7f2e18a00640 1 -- 172.21.15.144:0/3070893597 >> 172.21.15.144:0/3070893597 conn(0x7f2e1406bba0 msgr2=0x7f2e1406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:38.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.688+0000 7f2e18a00640 1 -- 172.21.15.144:0/3070893597 shutdown_connections 2024-09-11T23:26:38.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.688+0000 7f2e18a00640 1 -- 172.21.15.144:0/3070893597 wait complete. 2024-09-11T23:26:38.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.690+0000 7f2e18a00640 1 Processor -- start 2024-09-11T23:26:38.689 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.690+0000 7f2e18a00640 1 -- start start 2024-09-11T23:26:38.691 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.691+0000 7f2e18a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e1406f130 0x7f2e1415e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:38.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.691+0000 7f2e18a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e1415b370 0x7f2e141f2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:38.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.691+0000 7f2e18a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e1415f9f0 0x7f2e141f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:38.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.691+0000 7f2e18a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2e140731b0 con 0x7f2e1415b370 2024-09-11T23:26:38.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.691+0000 7f2e18a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1415c450 con 0x7f2e1415f9f0 2024-09-11T23:26:38.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.691+0000 7f2e18a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2e1415b750 con 0x7f2e1406f130 2024-09-11T23:26:38.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.691+0000 7f2e11400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e1415b370 0x7f2e141f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:38.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.691+0000 7f2e11400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e1415b370 0x7f2e141f2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53508/0 (socket says 172.21.15.144:53508) 2024-09-11T23:26:38.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.691+0000 7f2e11400640 1 -- 172.21.15.144:0/2597113075 learned_addr learned my addr 172.21.15.144:0/2597113075 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:38.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.691+0000 7f2e12800640 1 --2- 172.21.15.144:0/2597113075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e1415f9f0 0x7f2e141f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:38.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.691+0000 7f2e11e00640 1 --2- 172.21.15.144:0/2597113075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e1406f130 0x7f2e1415e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:38.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.691+0000 7f2e11400640 1 -- 172.21.15.144:0/2597113075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e1406f130 msgr2=0x7f2e1415e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:38.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.691+0000 7f2e11400640 1 --2- 172.21.15.144:0/2597113075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e1406f130 0x7f2e1415e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:38.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.691+0000 7f2e11400640 1 -- 172.21.15.144:0/2597113075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e1415f9f0 msgr2=0x7f2e141f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:38.692 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.691+0000 7f2e11400640 1 --2- 172.21.15.144:0/2597113075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e1415f9f0 0x7f2e141f5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:38.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.691+0000 7f2e11400640 1 -- 172.21.15.144:0/2597113075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e14154950 con 0x7f2e1415b370 2024-09-11T23:26:38.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.691+0000 7f2e11e00640 1 --2- 172.21.15.144:0/2597113075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e1406f130 0x7f2e1415e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:38.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.692+0000 7f2e11400640 1 --2- 172.21.15.144:0/2597113075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e1415b370 0x7f2e141f2b30 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f2e0000e9b0 tx=0x7f2e0000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:38.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.692+0000 7f2e0a000640 1 -- 172.21.15.144:0/2597113075 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e00017070 con 0x7f2e1415b370 2024-09-11T23:26:38.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.692+0000 7f2e0a000640 1 -- 172.21.15.144:0/2597113075 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e0000c9a0 con 0x7f2e1415b370 2024-09-11T23:26:38.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.692+0000 7f2e0a000640 1 -- 172.21.15.144:0/2597113075 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0000cd90 con 0x7f2e1415b370 2024-09-11T23:26:38.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.692+0000 7f2e18a00640 1 -- 172.21.15.144:0/2597113075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e141f3150 con 0x7f2e1415b370 2024-09-11T23:26:38.693 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.692+0000 7f2e18a00640 1 -- 172.21.15.144:0/2597113075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e141f39f0 con 0x7f2e1415b370 2024-09-11T23:26:38.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.693+0000 7f2e18a00640 1 -- 172.21.15.144:0/2597113075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e14072560 con 0x7f2e1415b370 2024-09-11T23:26:38.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.694+0000 7f2e0a000640 1 -- 172.21.15.144:0/2597113075 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f2e0001a070 con 0x7f2e1415b370 2024-09-11T23:26:38.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.695+0000 7f2e0a000640 1 --2- 172.21.15.144:0/2597113075 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2df406c7c0 0x7f2df406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:38.694 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.695+0000 7f2e0a000640 1 -- 172.21.15.144:0/2597113075 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f2e00089680 con 0x7f2e1415b370 2024-09-11T23:26:38.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.695+0000 7f2e11e00640 1 --2- 172.21.15.144:0/2597113075 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2df406c7c0 0x7f2df406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:38.695 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.696+0000 7f2e11e00640 1 --2- 172.21.15.144:0/2597113075 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2df406c7c0 0x7f2df406ec80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2e04001680 tx=0x7f2e04009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:38.699 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.699+0000 7f2e0a000640 1 -- 172.21.15.144:0/2597113075 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e00059ba0 con 0x7f2e1415b370 2024-09-11T23:26:38.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:38.907+0000 7f2e18a00640 1 -- 172.21.15.144:0/2597113075 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f2e140ce5f0 con 0x7f2e1415b370 2024-09-11T23:26:39.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:39.836+0000 7f2e0a000640 1 -- 172.21.15.144:0/2597113075 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v120) ==== 136+0+0 (secure 0 0 0) 0x7f2e000594a0 con 0x7f2e1415b370 2024-09-11T23:26:39.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:39.839+0000 7f2e18a00640 1 -- 172.21.15.144:0/2597113075 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2df406c7c0 msgr2=0x7f2df406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:39.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:39.839+0000 7f2e18a00640 1 --2- 172.21.15.144:0/2597113075 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2df406c7c0 0x7f2df406ec80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2e04001680 tx=0x7f2e04009040 comp rx=0 tx=0).stop 2024-09-11T23:26:39.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:39.839+0000 7f2e18a00640 1 -- 172.21.15.144:0/2597113075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e1415b370 msgr2=0x7f2e141f2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:39.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:39.839+0000 7f2e18a00640 1 --2- 172.21.15.144:0/2597113075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e1415b370 0x7f2e141f2b30 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f2e0000e9b0 tx=0x7f2e0000ee70 comp rx=0 tx=0).stop 2024-09-11T23:26:39.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:39.839+0000 7f2e18a00640 1 -- 172.21.15.144:0/2597113075 shutdown_connections 2024-09-11T23:26:39.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:39.839+0000 7f2e18a00640 1 --2- 172.21.15.144:0/2597113075 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2df406c7c0 0x7f2df406ec80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:39.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:39.839+0000 7f2e18a00640 1 --2- 172.21.15.144:0/2597113075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e1415f9f0 0x7f2e141f5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:39.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:39.839+0000 7f2e18a00640 1 --2- 172.21.15.144:0/2597113075 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e1415b370 0x7f2e141f2b30 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:39.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:39.839+0000 7f2e18a00640 1 --2- 172.21.15.144:0/2597113075 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2e1406f130 0x7f2e1415e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:39.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:39.839+0000 7f2e18a00640 1 -- 172.21.15.144:0/2597113075 >> 172.21.15.144:0/2597113075 conn(0x7f2e1406bba0 msgr2=0x7f2e140b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:39.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:39.839+0000 7f2e18a00640 1 -- 172.21.15.144:0/2597113075 shutdown_connections 2024-09-11T23:26:39.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:39.839+0000 7f2e18a00640 1 -- 172.21.15.144:0/2597113075 wait complete. 2024-09-11T23:26:39.857 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-11T23:26:40.014 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.015+0000 7f3903200640 1 Processor -- start 2024-09-11T23:26:40.015 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.015+0000 7f3903200640 1 -- start start 2024-09-11T23:26:40.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.016+0000 7f3903200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38fc15a0a0 0x7f38fc073180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:40.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.016+0000 7f3903200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f38fc0736c0 0x7f38fc0ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:40.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.016+0000 7f3903200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38fc072100 con 0x7f38fc0ce9c0 2024-09-11T23:26:40.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.016+0000 7f3903200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f38fc0cee00 con 0x7f38fc0736c0 2024-09-11T23:26:40.016 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.016+0000 7f3903200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f38fc0723c0 con 0x7f38fc15a0a0 2024-09-11T23:26:40.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.017+0000 7f3901e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38fc15a0a0 0x7f38fc073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:40.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.017+0000 7f3902800640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f38fc0ce9c0 0x7f38fc0b1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:59176/0 (socket says 172.21.15.144:59176) 2024-09-11T23:26:40.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.017+0000 7f3902800640 1 -- 172.21.15.144:0/2255277442 learned_addr learned my addr 172.21.15.144:0/2255277442 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:40.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.017+0000 7f3901e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38fc15a0a0 0x7f38fc073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:44022/0 (socket says 172.21.15.144:44022) 2024-09-11T23:26:40.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.017+0000 7f3901400640 1 --2- 172.21.15.144:0/2255277442 >> v2:172.21.15.165:3300/0 conn(0x7f38fc0736c0 0x7f38fc0ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:40.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.017+0000 7f3901e00640 1 -- 172.21.15.144:0/2255277442 >> v2:172.21.15.165:3300/0 conn(0x7f38fc0736c0 msgr2=0x7f38fc0ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:40.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.017+0000 7f3901e00640 1 --2- 172.21.15.144:0/2255277442 >> v2:172.21.15.165:3300/0 conn(0x7f38fc0736c0 0x7f38fc0ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.017+0000 7f3901e00640 1 -- 172.21.15.144:0/2255277442 >> v1:172.21.15.165:6789/0 conn(0x7f38fc0ce9c0 legacy=0x7f38fc0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:40.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.017+0000 7f3901e00640 1 -- 172.21.15.144:0/2255277442 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38fc0726a0 con 0x7f38fc15a0a0 2024-09-11T23:26:40.017 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.017+0000 7f3900a00640 1 -- 172.21.15.144:0/2255277442 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 338904613 0 0) 0x7f38fc072100 con 0x7f38fc0ce9c0 2024-09-11T23:26:40.018 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.018+0000 7f3901e00640 1 --2- 172.21.15.144:0/2255277442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38fc15a0a0 0x7f38fc073180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0cef80 tx=0x7f38f002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cd5f2c43113ce11 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:40.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.018+0000 7f3900a00640 1 -- 172.21.15.144:0/2255277442 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f0037070 con 0x7f38fc15a0a0 2024-09-11T23:26:40.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.018+0000 7f3900a00640 1 -- 172.21.15.144:0/2255277442 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f0032440 con 0x7f38fc15a0a0 2024-09-11T23:26:40.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.018+0000 7f3900a00640 1 -- 172.21.15.144:0/2255277442 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f0032810 con 0x7f38fc15a0a0 2024-09-11T23:26:40.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.019+0000 7f3903200640 1 -- 172.21.15.144:0/2255277442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38fc15a0a0 msgr2=0x7f38fc073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:40.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.019+0000 7f3903200640 1 --2- 172.21.15.144:0/2255277442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38fc15a0a0 0x7f38fc073180 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0cef80 tx=0x7f38f002a180 comp rx=0 tx=0).stop 2024-09-11T23:26:40.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.019+0000 7f3903200640 1 -- 172.21.15.144:0/2255277442 shutdown_connections 2024-09-11T23:26:40.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.019+0000 7f3903200640 1 --2- 172.21.15.144:0/2255277442 >> v2:172.21.15.165:3300/0 conn(0x7f38fc0736c0 0x7f38fc0ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.019+0000 7f3903200640 1 --2- 172.21.15.144:0/2255277442 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38fc15a0a0 0x7f38fc073180 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.019+0000 7f3903200640 1 -- 172.21.15.144:0/2255277442 >> 172.21.15.144:0/2255277442 conn(0x7f38fc06e910 msgr2=0x7f38fc06bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:40.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.019+0000 7f3903200640 1 -- 172.21.15.144:0/2255277442 shutdown_connections 2024-09-11T23:26:40.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.019+0000 7f3903200640 1 -- 172.21.15.144:0/2255277442 wait complete. 2024-09-11T23:26:40.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.021+0000 7f3903200640 1 Processor -- start 2024-09-11T23:26:40.020 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.021+0000 7f3903200640 1 -- start start 2024-09-11T23:26:40.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.022+0000 7f3903200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38fc0ce9c0 0x7f38fc1537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:40.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.022+0000 7f3903200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38fc15a0a0 0x7f38fc1f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:40.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.022+0000 7f3903200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38fc1f4880 0x7f38fc158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:40.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.022+0000 7f3903200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc0b2650 con 0x7f38fc0ce9c0 2024-09-11T23:26:40.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.022+0000 7f3903200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc0b24d0 con 0x7f38fc15a0a0 2024-09-11T23:26:40.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.022+0000 7f3903200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f38fc0cf240 con 0x7f38fc1f4880 2024-09-11T23:26:40.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.022+0000 7f3901e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38fc0ce9c0 0x7f38fc1537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:40.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.022+0000 7f3901e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38fc0ce9c0 0x7f38fc1537b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53524/0 (socket says 172.21.15.144:53524) 2024-09-11T23:26:40.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.022+0000 7f3901e00640 1 -- 172.21.15.144:0/3485636233 learned_addr learned my addr 172.21.15.144:0/3485636233 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:40.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.022+0000 7f3901400640 1 --2- 172.21.15.144:0/3485636233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38fc15a0a0 0x7f38fc1f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:40.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.022+0000 7f3902800640 1 --2- 172.21.15.144:0/3485636233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38fc1f4880 0x7f38fc158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:40.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.022+0000 7f3901e00640 1 -- 172.21.15.144:0/3485636233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38fc1f4880 msgr2=0x7f38fc158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:40.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.022+0000 7f3901e00640 1 --2- 172.21.15.144:0/3485636233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38fc1f4880 0x7f38fc158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.022+0000 7f3901e00640 1 -- 172.21.15.144:0/3485636233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38fc15a0a0 msgr2=0x7f38fc1f4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:40.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.022+0000 7f3901e00640 1 --2- 172.21.15.144:0/3485636233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38fc15a0a0 0x7f38fc1f4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.022+0000 7f3901e00640 1 -- 172.21.15.144:0/3485636233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38fc154280 con 0x7f38fc0ce9c0 2024-09-11T23:26:40.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.022+0000 7f3901400640 1 --2- 172.21.15.144:0/3485636233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38fc15a0a0 0x7f38fc1f4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:40.023 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.023+0000 7f3901e00640 1 --2- 172.21.15.144:0/3485636233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38fc0ce9c0 0x7f38fc1537b0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f38f0035040 tx=0x7f38f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:40.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.023+0000 7f38f6000640 1 -- 172.21.15.144:0/3485636233 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f0037050 con 0x7f38fc0ce9c0 2024-09-11T23:26:40.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.023+0000 7f38f6000640 1 -- 172.21.15.144:0/3485636233 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f0038040 con 0x7f38fc0ce9c0 2024-09-11T23:26:40.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.023+0000 7f3903200640 1 -- 172.21.15.144:0/3485636233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38fc0b3e10 con 0x7f38fc0ce9c0 2024-09-11T23:26:40.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.023+0000 7f38f6000640 1 -- 172.21.15.144:0/3485636233 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f0004450 con 0x7f38fc0ce9c0 2024-09-11T23:26:40.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.023+0000 7f3903200640 1 -- 172.21.15.144:0/3485636233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38fc15c240 con 0x7f38fc0ce9c0 2024-09-11T23:26:40.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.024+0000 7f3903200640 1 -- 172.21.15.144:0/3485636233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38fc06c0d0 con 0x7f38fc0ce9c0 2024-09-11T23:26:40.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.025+0000 7f38f6000640 1 -- 172.21.15.144:0/3485636233 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f38f003c6d0 con 0x7f38fc0ce9c0 2024-09-11T23:26:40.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.026+0000 7f38f6000640 1 --2- 172.21.15.144:0/3485636233 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f38e006c7c0 0x7f38e006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:40.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.026+0000 7f38f6000640 1 -- 172.21.15.144:0/3485636233 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f38f00aa010 con 0x7f38fc0ce9c0 2024-09-11T23:26:40.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.026+0000 7f3901400640 1 --2- 172.21.15.144:0/3485636233 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f38e006c7c0 0x7f38e006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:40.026 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.027+0000 7f3901400640 1 --2- 172.21.15.144:0/3485636233 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f38e006c7c0 0x7f38e006ec80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f38fc154510 tx=0x7f38ec008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:40.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.030+0000 7f38f6000640 1 -- 172.21.15.144:0/3485636233 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f38fc06c0d0 con 0x7f38fc0ce9c0 2024-09-11T23:26:40.227 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.227+0000 7f3903200640 1 -- 172.21.15.144:0/3485636233 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f38fc0cf020 con 0x7f38e006c7c0 2024-09-11T23:26:40.229 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.229+0000 7f38f6000640 1 -- 172.21.15.144:0/3485636233 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f38fc0cf020 con 0x7f38e006c7c0 2024-09-11T23:26:40.229 INFO:teuthology.orchestra.run.smithi144.stdout:[ 2024-09-11T23:26:40.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-09-11T23:26:40.229 INFO:teuthology.orchestra.run.smithi144.stdout: "name": "cephfs" 2024-09-11T23:26:40.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-11T23:26:40.229 INFO:teuthology.orchestra.run.smithi144.stdout:] 2024-09-11T23:26:40.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.231+0000 7f3903200640 1 -- 172.21.15.144:0/3485636233 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f38e006c7c0 msgr2=0x7f38e006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:40.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.231+0000 7f3903200640 1 --2- 172.21.15.144:0/3485636233 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f38e006c7c0 0x7f38e006ec80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f38fc154510 tx=0x7f38ec008040 comp rx=0 tx=0).stop 2024-09-11T23:26:40.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.231+0000 7f3903200640 1 -- 172.21.15.144:0/3485636233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38fc0ce9c0 msgr2=0x7f38fc1537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:40.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.231+0000 7f3903200640 1 --2- 172.21.15.144:0/3485636233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38fc0ce9c0 0x7f38fc1537b0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f38f0035040 tx=0x7f38f00046c0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.231+0000 7f3903200640 1 -- 172.21.15.144:0/3485636233 shutdown_connections 2024-09-11T23:26:40.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.231+0000 7f3903200640 1 --2- 172.21.15.144:0/3485636233 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f38e006c7c0 0x7f38e006ec80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.231+0000 7f3903200640 1 --2- 172.21.15.144:0/3485636233 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f38fc1f4880 0x7f38fc158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.231+0000 7f3903200640 1 --2- 172.21.15.144:0/3485636233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38fc15a0a0 0x7f38fc1f4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.231+0000 7f3903200640 1 --2- 172.21.15.144:0/3485636233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f38fc0ce9c0 0x7f38fc1537b0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.231+0000 7f3903200640 1 -- 172.21.15.144:0/3485636233 >> 172.21.15.144:0/3485636233 conn(0x7f38fc06e910 msgr2=0x7f38fc0afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:40.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.231+0000 7f3903200640 1 -- 172.21.15.144:0/3485636233 shutdown_connections 2024-09-11T23:26:40.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.231+0000 7f3903200640 1 -- 172.21.15.144:0/3485636233 wait complete. 2024-09-11T23:26:40.247 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-11T23:26:40.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.404+0000 7f2a1a600640 1 Processor -- start 2024-09-11T23:26:40.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.404+0000 7f2a1a600640 1 -- start start 2024-09-11T23:26:40.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.405+0000 7f2a1a600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2a14158e50 0x7f2a140b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:40.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.405+0000 7f2a1a600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2a1415c370 0x7f2a1406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:40.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.405+0000 7f2a1a600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a1406ef60 0x7f2a1415ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:40.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.405+0000 7f2a1a600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2a1415c800 con 0x7f2a1415c370 2024-09-11T23:26:40.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.405+0000 7f2a1a600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2a140b43f0 con 0x7f2a14158e50 2024-09-11T23:26:40.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.405+0000 7f2a1a600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2a140b3630 con 0x7f2a1406ef60 2024-09-11T23:26:40.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.406+0000 7f2a12a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2a1415c370 0x7f2a1406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:40.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.406+0000 7f2a12a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2a1415c370 0x7f2a1406ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53540/0 (socket says 172.21.15.144:53540) 2024-09-11T23:26:40.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.406+0000 7f2a12a00640 1 -- 172.21.15.144:0/4031739449 learned_addr learned my addr 172.21.15.144:0/4031739449 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:40.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.406+0000 7f2a13e00640 1 --2- 172.21.15.144:0/4031739449 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a1406ef60 0x7f2a1415ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:40.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.406+0000 7f2a13400640 1 --2- 172.21.15.144:0/4031739449 >> v2:172.21.15.165:3300/0 conn(0x7f2a14158e50 0x7f2a140b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:40.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.406+0000 7f2a12a00640 1 -- 172.21.15.144:0/4031739449 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a1406ef60 msgr2=0x7f2a1415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:40.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.406+0000 7f2a12a00640 1 --2- 172.21.15.144:0/4031739449 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a1406ef60 0x7f2a1415ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.406+0000 7f2a12a00640 1 -- 172.21.15.144:0/4031739449 >> v2:172.21.15.165:3300/0 conn(0x7f2a14158e50 msgr2=0x7f2a140b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:40.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.406+0000 7f2a12a00640 1 --2- 172.21.15.144:0/4031739449 >> v2:172.21.15.165:3300/0 conn(0x7f2a14158e50 0x7f2a140b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.406+0000 7f2a12a00640 1 -- 172.21.15.144:0/4031739449 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a140b3910 con 0x7f2a1415c370 2024-09-11T23:26:40.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.407+0000 7f2a12a00640 1 --2- 172.21.15.144:0/4031739449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a1415c370 0x7f2a1406ea20 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f2a14069580 tx=0x7f2a0002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1823664e9796189a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:40.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.407+0000 7f2a12000640 1 -- 172.21.15.144:0/4031739449 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00004030 con 0x7f2a1415c370 2024-09-11T23:26:40.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.407+0000 7f2a12000640 1 -- 172.21.15.144:0/4031739449 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a000041d0 con 0x7f2a1415c370 2024-09-11T23:26:40.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.407+0000 7f2a12000640 1 -- 172.21.15.144:0/4031739449 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00003610 con 0x7f2a1415c370 2024-09-11T23:26:40.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.408+0000 7f2a1a600640 1 -- 172.21.15.144:0/4031739449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a1415c370 msgr2=0x7f2a1406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:40.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.408+0000 7f2a1a600640 1 --2- 172.21.15.144:0/4031739449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a1415c370 0x7f2a1406ea20 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f2a14069580 tx=0x7f2a0002a1c0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.408+0000 7f2a1a600640 1 -- 172.21.15.144:0/4031739449 shutdown_connections 2024-09-11T23:26:40.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.408+0000 7f2a1a600640 1 --2- 172.21.15.144:0/4031739449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a1415c370 0x7f2a1406ea20 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.408+0000 7f2a1a600640 1 --2- 172.21.15.144:0/4031739449 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a1406ef60 0x7f2a1415ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.408+0000 7f2a1a600640 1 --2- 172.21.15.144:0/4031739449 >> v2:172.21.15.165:3300/0 conn(0x7f2a14158e50 0x7f2a140b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.408+0000 7f2a1a600640 1 -- 172.21.15.144:0/4031739449 >> 172.21.15.144:0/4031739449 conn(0x7f2a1406bba0 msgr2=0x7f2a1406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:40.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.408+0000 7f2a1a600640 1 -- 172.21.15.144:0/4031739449 shutdown_connections 2024-09-11T23:26:40.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.408+0000 7f2a1a600640 1 -- 172.21.15.144:0/4031739449 wait complete. 2024-09-11T23:26:40.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.410+0000 7f2a1a600640 1 Processor -- start 2024-09-11T23:26:40.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.410+0000 7f2a1a600640 1 -- start start 2024-09-11T23:26:40.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.411+0000 7f2a1a600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a1406ef60 0x7f2a1415ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:40.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.411+0000 7f2a1a600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a14158e50 0x7f2a14150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:40.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.411+0000 7f2a1a600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a1415c370 0x7f2a141536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:40.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.411+0000 7f2a1a600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2a14159230 con 0x7f2a14158e50 2024-09-11T23:26:40.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.411+0000 7f2a1a600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2a140b3ed0 con 0x7f2a1415c370 2024-09-11T23:26:40.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.411+0000 7f2a1a600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2a1415f390 con 0x7f2a1406ef60 2024-09-11T23:26:40.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.411+0000 7f2a12a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a14158e50 0x7f2a14150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:40.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.411+0000 7f2a12a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a14158e50 0x7f2a14150b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53550/0 (socket says 172.21.15.144:53550) 2024-09-11T23:26:40.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.411+0000 7f2a12a00640 1 -- 172.21.15.144:0/2896851743 learned_addr learned my addr 172.21.15.144:0/2896851743 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:40.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.411+0000 7f2a13400640 1 --2- 172.21.15.144:0/2896851743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a1406ef60 0x7f2a1415ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:40.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.411+0000 7f2a13e00640 1 --2- 172.21.15.144:0/2896851743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a1415c370 0x7f2a141536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:40.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.412+0000 7f2a12a00640 1 -- 172.21.15.144:0/2896851743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a1406ef60 msgr2=0x7f2a1415ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:40.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.412+0000 7f2a12a00640 1 --2- 172.21.15.144:0/2896851743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a1406ef60 0x7f2a1415ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.412+0000 7f2a12a00640 1 -- 172.21.15.144:0/2896851743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a1415c370 msgr2=0x7f2a141536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:40.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.412+0000 7f2a12a00640 1 --2- 172.21.15.144:0/2896851743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a1415c370 0x7f2a141536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.412+0000 7f2a12a00640 1 -- 172.21.15.144:0/2896851743 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a14153c20 con 0x7f2a14158e50 2024-09-11T23:26:40.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.412+0000 7f2a12a00640 1 --2- 172.21.15.144:0/2896851743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a14158e50 0x7f2a14150b10 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f2a00034040 tx=0x7f2a000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:40.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.412+0000 7f2a0b400640 1 -- 172.21.15.144:0/2896851743 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00041020 con 0x7f2a14158e50 2024-09-11T23:26:40.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.412+0000 7f2a0b400640 1 -- 172.21.15.144:0/2896851743 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a00005e10 con 0x7f2a14158e50 2024-09-11T23:26:40.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.412+0000 7f2a1a600640 1 -- 172.21.15.144:0/2896851743 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a1415d420 con 0x7f2a14158e50 2024-09-11T23:26:40.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.412+0000 7f2a0b400640 1 -- 172.21.15.144:0/2896851743 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00004030 con 0x7f2a14158e50 2024-09-11T23:26:40.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.412+0000 7f2a1a600640 1 -- 172.21.15.144:0/2896851743 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a1415d9e0 con 0x7f2a14158e50 2024-09-11T23:26:40.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.413+0000 7f2a1a600640 1 -- 172.21.15.144:0/2896851743 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a1415ee50 con 0x7f2a14158e50 2024-09-11T23:26:40.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.414+0000 7f2a0b400640 1 -- 172.21.15.144:0/2896851743 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f2a00044020 con 0x7f2a14158e50 2024-09-11T23:26:40.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.416+0000 7f2a0b400640 1 --2- 172.21.15.144:0/2896851743 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f29f406c7c0 0x7f29f406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:40.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.416+0000 7f2a0b400640 1 -- 172.21.15.144:0/2896851743 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f2a000a9f30 con 0x7f2a14158e50 2024-09-11T23:26:40.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.416+0000 7f2a13400640 1 --2- 172.21.15.144:0/2896851743 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f29f406c7c0 0x7f29f406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:40.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.417+0000 7f2a13400640 1 --2- 172.21.15.144:0/2896851743 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f29f406c7c0 0x7f29f406ec80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2a04009b40 tx=0x7f2a04009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:40.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.420+0000 7f2a0b400640 1 -- 172.21.15.144:0/2896851743 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a0004b030 con 0x7f2a14158e50 2024-09-11T23:26:40.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.594+0000 7f2a1a600640 1 -- 172.21.15.144:0/2896851743 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2a141504c0 con 0x7f2a14158e50 2024-09-11T23:26:40.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.595+0000 7f2a0b400640 1 -- 172.21.15.144:0/2896851743 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7f2a14153c20 con 0x7f2a14158e50 2024-09-11T23:26:40.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.597+0000 7f2a1a600640 1 -- 172.21.15.144:0/2896851743 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f29f406c7c0 msgr2=0x7f29f406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:40.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.597+0000 7f2a1a600640 1 --2- 172.21.15.144:0/2896851743 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f29f406c7c0 0x7f29f406ec80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2a04009b40 tx=0x7f2a04009190 comp rx=0 tx=0).stop 2024-09-11T23:26:40.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.597+0000 7f2a1a600640 1 -- 172.21.15.144:0/2896851743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a14158e50 msgr2=0x7f2a14150b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:40.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.597+0000 7f2a1a600640 1 --2- 172.21.15.144:0/2896851743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a14158e50 0x7f2a14150b10 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f2a00034040 tx=0x7f2a000046c0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.597+0000 7f2a1a600640 1 -- 172.21.15.144:0/2896851743 shutdown_connections 2024-09-11T23:26:40.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.597+0000 7f2a1a600640 1 --2- 172.21.15.144:0/2896851743 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f29f406c7c0 0x7f29f406ec80 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.597+0000 7f2a1a600640 1 --2- 172.21.15.144:0/2896851743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a1415c370 0x7f2a141536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.597+0000 7f2a1a600640 1 --2- 172.21.15.144:0/2896851743 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a14158e50 0x7f2a14150b10 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.597+0000 7f2a1a600640 1 --2- 172.21.15.144:0/2896851743 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a1406ef60 0x7f2a1415ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:40.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.597+0000 7f2a1a600640 1 -- 172.21.15.144:0/2896851743 >> 172.21.15.144:0/2896851743 conn(0x7f2a1406bba0 msgr2=0x7f2a14072c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:40.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.597+0000 7f2a1a600640 1 -- 172.21.15.144:0/2896851743 shutdown_connections 2024-09-11T23:26:40.598 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:40.597+0000 7f2a1a600640 1 -- 172.21.15.144:0/2896851743 wait complete. 2024-09-11T23:26:40.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:40.614 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp60020/subvol60080) 2024-09-11T23:26:40.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:40.678 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-11T23:26:40.715 INFO:teuthology.orchestra.run.smithi144.stdout:cephfs_data 2024-09-11T23:26:40.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:40.715 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/subvol_grp60020/subvol60080) 2024-09-11T23:26:40.817 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:26:40.817 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/mnt.0/./volumes/subvol_grp60020/subvol60080/.meta 2024-09-11T23:26:40.878 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol60080 subvol_grp60020 2024-09-11T23:26:41.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.077+0000 7f8e86200640 1 Processor -- start 2024-09-11T23:26:41.077 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.077+0000 7f8e86200640 1 -- start start 2024-09-11T23:26:41.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.078+0000 7f8e86200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8e80147d70 0x7f8e80071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:41.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.078+0000 7f8e86200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e80148150 0x7f8e8006d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:41.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.078+0000 7f8e86200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e800710e0 con 0x7f8e80072090 2024-09-11T23:26:41.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.078+0000 7f8e86200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8e800b5700 con 0x7f8e80147d70 2024-09-11T23:26:41.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.078+0000 7f8e86200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8e80071350 con 0x7f8e80148150 2024-09-11T23:26:41.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.079+0000 7f8e7f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8e80147d70 0x7f8e80071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:41.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.079+0000 7f8e7f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8e80147d70 0x7f8e80071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53560/0 (socket says 172.21.15.144:53560) 2024-09-11T23:26:41.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.079+0000 7f8e7f400640 1 -- 172.21.15.144:0/3133606989 learned_addr learned my addr 172.21.15.144:0/3133606989 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:41.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.079+0000 7f8e7f400640 1 -- 172.21.15.144:0/3133606989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e80148150 msgr2=0x7f8e8006d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:41.079 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.079+0000 7f8e7f400640 1 --2- 172.21.15.144:0/3133606989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e80148150 0x7f8e8006d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:41.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.079+0000 7f8e7f400640 1 -- 172.21.15.144:0/3133606989 >> v1:172.21.15.165:6789/0 conn(0x7f8e80072090 legacy=0x7f8e800ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:41.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.079+0000 7f8e7f400640 1 -- 172.21.15.144:0/3133606989 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e80071630 con 0x7f8e80147d70 2024-09-11T23:26:41.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.080+0000 7f8e7f400640 1 --2- 172.21.15.144:0/3133606989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e80147d70 0x7f8e80071b50 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009870 tx=0x7f8e7002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4385174a1f64e53f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:41.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.080+0000 7f8e7ea00640 1 -- 172.21.15.144:0/3133606989 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e70037070 con 0x7f8e80147d70 2024-09-11T23:26:41.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.080+0000 7f8e7ea00640 1 -- 172.21.15.144:0/3133606989 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e70032440 con 0x7f8e80147d70 2024-09-11T23:26:41.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.080+0000 7f8e7ea00640 1 -- 172.21.15.144:0/3133606989 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e70032810 con 0x7f8e80147d70 2024-09-11T23:26:41.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.081+0000 7f8e86200640 1 -- 172.21.15.144:0/3133606989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e80147d70 msgr2=0x7f8e80071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:41.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.081+0000 7f8e86200640 1 --2- 172.21.15.144:0/3133606989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e80147d70 0x7f8e80071b50 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009870 tx=0x7f8e7002a180 comp rx=0 tx=0).stop 2024-09-11T23:26:41.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.081+0000 7f8e86200640 1 -- 172.21.15.144:0/3133606989 shutdown_connections 2024-09-11T23:26:41.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.081+0000 7f8e86200640 1 --2- 172.21.15.144:0/3133606989 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e80148150 0x7f8e8006d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:41.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.081+0000 7f8e86200640 1 --2- 172.21.15.144:0/3133606989 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e80147d70 0x7f8e80071b50 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:41.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.081+0000 7f8e86200640 1 -- 172.21.15.144:0/3133606989 >> 172.21.15.144:0/3133606989 conn(0x7f8e8006bba0 msgr2=0x7f8e8006bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:41.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.081+0000 7f8e86200640 1 -- 172.21.15.144:0/3133606989 shutdown_connections 2024-09-11T23:26:41.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.081+0000 7f8e86200640 1 -- 172.21.15.144:0/3133606989 wait complete. 2024-09-11T23:26:41.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.083+0000 7f8e86200640 1 Processor -- start 2024-09-11T23:26:41.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.083+0000 7f8e86200640 1 -- start start 2024-09-11T23:26:41.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.084+0000 7f8e86200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e80072090 0x7f8e801436e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:41.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.084+0000 7f8e86200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e80147d70 0x7f8e80161a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:41.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.084+0000 7f8e86200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e80148150 0x7f8e80161f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:41.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.084+0000 7f8e86200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8e800af170 con 0x7f8e80148150 2024-09-11T23:26:41.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.084+0000 7f8e86200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8e800aeff0 con 0x7f8e80072090 2024-09-11T23:26:41.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.084+0000 7f8e86200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8e8006d5c0 con 0x7f8e80147d70 2024-09-11T23:26:41.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.084+0000 7f8e7fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e80148150 0x7f8e80161f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:41.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.084+0000 7f8e7fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e80148150 0x7f8e80161f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53570/0 (socket says 172.21.15.144:53570) 2024-09-11T23:26:41.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.084+0000 7f8e7fe00640 1 -- 172.21.15.144:0/96083353 learned_addr learned my addr 172.21.15.144:0/96083353 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:41.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.084+0000 7f8e7f400640 1 --2- 172.21.15.144:0/96083353 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e80072090 0x7f8e801436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:41.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.084+0000 7f8e76a00640 1 --2- 172.21.15.144:0/96083353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e80147d70 0x7f8e80161a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:41.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.085+0000 7f8e7fe00640 1 -- 172.21.15.144:0/96083353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e80147d70 msgr2=0x7f8e80161a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:41.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.085+0000 7f8e7fe00640 1 --2- 172.21.15.144:0/96083353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e80147d70 0x7f8e80161a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:41.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.085+0000 7f8e7fe00640 1 -- 172.21.15.144:0/96083353 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e80072090 msgr2=0x7f8e801436e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:41.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.085+0000 7f8e7fe00640 1 --2- 172.21.15.144:0/96083353 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e80072090 0x7f8e801436e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:41.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.085+0000 7f8e7fe00640 1 -- 172.21.15.144:0/96083353 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8012da00 con 0x7f8e80148150 2024-09-11T23:26:41.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.085+0000 7f8e7fe00640 1 --2- 172.21.15.144:0/96083353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e80148150 0x7f8e80161f40 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f8e7800c780 tx=0x7f8e7800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:41.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.085+0000 7f8e77e00640 1 -- 172.21.15.144:0/96083353 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e78004b10 con 0x7f8e80148150 2024-09-11T23:26:41.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.085+0000 7f8e77e00640 1 -- 172.21.15.144:0/96083353 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e78004cb0 con 0x7f8e80148150 2024-09-11T23:26:41.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.085+0000 7f8e86200640 1 -- 172.21.15.144:0/96083353 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e80146a30 con 0x7f8e80148150 2024-09-11T23:26:41.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.085+0000 7f8e77e00640 1 -- 172.21.15.144:0/96083353 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e78004e60 con 0x7f8e80148150 2024-09-11T23:26:41.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.085+0000 7f8e86200640 1 -- 172.21.15.144:0/96083353 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e8012df80 con 0x7f8e80148150 2024-09-11T23:26:41.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.086+0000 7f8e86200640 1 -- 172.21.15.144:0/96083353 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e80071b50 con 0x7f8e80148150 2024-09-11T23:26:41.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.087+0000 7f8e77e00640 1 -- 172.21.15.144:0/96083353 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7f8e7800aa90 con 0x7f8e80148150 2024-09-11T23:26:41.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.089+0000 7f8e77e00640 1 --2- 172.21.15.144:0/96083353 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8e5c06c7c0 0x7f8e5c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:41.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.089+0000 7f8e77e00640 1 -- 172.21.15.144:0/96083353 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f8e78089670 con 0x7f8e80148150 2024-09-11T23:26:41.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.089+0000 7f8e7f400640 1 --2- 172.21.15.144:0/96083353 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8e5c06c7c0 0x7f8e5c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:41.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.090+0000 7f8e7f400640 1 --2- 172.21.15.144:0/96083353 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8e5c06c7c0 0x7f8e5c06ec80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8e70034000 tx=0x7f8e7002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:41.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.093+0000 7f8e77e00640 1 -- 172.21.15.144:0/96083353 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e78020070 con 0x7f8e80148150 2024-09-11T23:26:41.292 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.292+0000 7f8e86200640 1 -- 172.21.15.144:0/96083353 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol60080", "group_name": "subvol_grp60020", "target": ["mon-mgr", ""]}) -- 0x7f8e800b4fe0 con 0x7f8e5c06c7c0 2024-09-11T23:26:41.300 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:41.300+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:41.300 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:41.300+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:41.300 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:41.300+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:41.300 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:41.300+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:41.300 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:41.300+0000 7f30de200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:41.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.341+0000 7f8e77e00640 1 -- 172.21.15.144:0/96083353 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8e800b4fe0 con 0x7f8e5c06c7c0 2024-09-11T23:26:41.341 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/subvol_grp60020/subvol60080 2024-09-11T23:26:41.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.344+0000 7f8e86200640 1 -- 172.21.15.144:0/96083353 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8e5c06c7c0 msgr2=0x7f8e5c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:41.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.344+0000 7f8e86200640 1 --2- 172.21.15.144:0/96083353 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8e5c06c7c0 0x7f8e5c06ec80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8e70034000 tx=0x7f8e7002e000 comp rx=0 tx=0).stop 2024-09-11T23:26:41.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.344+0000 7f8e86200640 1 -- 172.21.15.144:0/96083353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e80148150 msgr2=0x7f8e80161f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:41.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.344+0000 7f8e86200640 1 --2- 172.21.15.144:0/96083353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e80148150 0x7f8e80161f40 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f8e7800c780 tx=0x7f8e7800cc40 comp rx=0 tx=0).stop 2024-09-11T23:26:41.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.344+0000 7f8e86200640 1 -- 172.21.15.144:0/96083353 shutdown_connections 2024-09-11T23:26:41.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.344+0000 7f8e86200640 1 --2- 172.21.15.144:0/96083353 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f8e5c06c7c0 0x7f8e5c06ec80 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:41.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.344+0000 7f8e86200640 1 --2- 172.21.15.144:0/96083353 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8e80148150 0x7f8e80161f40 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:41.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.344+0000 7f8e86200640 1 --2- 172.21.15.144:0/96083353 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8e80147d70 0x7f8e80161a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:41.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.344+0000 7f8e86200640 1 --2- 172.21.15.144:0/96083353 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e80072090 0x7f8e801436e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:41.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.344+0000 7f8e86200640 1 -- 172.21.15.144:0/96083353 >> 172.21.15.144:0/96083353 conn(0x7f8e8006bba0 msgr2=0x7f8e8006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:41.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.344+0000 7f8e86200640 1 -- 172.21.15.144:0/96083353 shutdown_connections 2024-09-11T23:26:41.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.344+0000 7f8e86200640 1 -- 172.21.15.144:0/96083353 wait complete. 2024-09-11T23:26:41.359 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol60080 subvol_grp60020 2024-09-11T23:26:41.517 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.517+0000 7fd1a7e00640 1 Processor -- start 2024-09-11T23:26:41.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.517+0000 7fd1a7e00640 1 -- start start 2024-09-11T23:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.519+0000 7fd1a7e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd1a80ce500 0x7fd1a80715c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.519+0000 7fd1a7e00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1a815b5b0 con 0x7fd1a80ce090 2024-09-11T23:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.519+0000 7fd1a7e00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1a80b4800 con 0x7fd1a815b1d0 2024-09-11T23:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.519+0000 7fd1a7e00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fd1a80b21b0 con 0x7fd1a80ce500 2024-09-11T23:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.519+0000 7fd1a7400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd1a80ce500 0x7fd1a80715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.519+0000 7fd1a7400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd1a80ce500 0x7fd1a80715c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53582/0 (socket says 172.21.15.144:53582) 2024-09-11T23:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.519+0000 7fd1a7400640 1 -- 172.21.15.144:0/2722285499 learned_addr learned my addr 172.21.15.144:0/2722285499 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:41.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.519+0000 7fd1a7400640 1 -- 172.21.15.144:0/2722285499 >> v1:172.21.15.165:6789/0 conn(0x7fd1a815b1d0 legacy=0x7fd1a80b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:41.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.519+0000 7fd1a7400640 1 -- 172.21.15.144:0/2722285499 >> v1:172.21.15.144:6789/0 conn(0x7fd1a80ce090 legacy=0x7fd1a8070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:41.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.519+0000 7fd1a7400640 1 -- 172.21.15.144:0/2722285499 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a80b4ae0 con 0x7fd1a80ce500 2024-09-11T23:26:41.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.520+0000 7fd1a7400640 1 --2- 172.21.15.144:0/2722285499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1a80ce500 0x7fd1a80715c0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009e50 tx=0x7fd1a002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4b13324e86c1bf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:41.520 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.521+0000 7fd1a6000640 1 -- 172.21.15.144:0/2722285499 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0036070 con 0x7fd1a80ce500 2024-09-11T23:26:41.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.521+0000 7fd1a6000640 1 -- 172.21.15.144:0/2722285499 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1a0031600 con 0x7fd1a80ce500 2024-09-11T23:26:41.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.521+0000 7fd1a6000640 1 -- 172.21.15.144:0/2722285499 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a00319d0 con 0x7fd1a80ce500 2024-09-11T23:26:41.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.521+0000 7fd1a7e00640 1 -- 172.21.15.144:0/2722285499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1a80ce500 msgr2=0x7fd1a80715c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:41.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.521+0000 7fd1a7e00640 1 --2- 172.21.15.144:0/2722285499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1a80ce500 0x7fd1a80715c0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009e50 tx=0x7fd1a002a730 comp rx=0 tx=0).stop 2024-09-11T23:26:41.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.521+0000 7fd1a7e00640 1 -- 172.21.15.144:0/2722285499 shutdown_connections 2024-09-11T23:26:41.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.521+0000 7fd1a7e00640 1 --2- 172.21.15.144:0/2722285499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1a80ce500 0x7fd1a80715c0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:41.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.521+0000 7fd1a7e00640 1 -- 172.21.15.144:0/2722285499 >> 172.21.15.144:0/2722285499 conn(0x7fd1a806bba0 msgr2=0x7fd1a806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:41.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.521+0000 7fd1a7e00640 1 -- 172.21.15.144:0/2722285499 shutdown_connections 2024-09-11T23:26:41.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.521+0000 7fd1a7e00640 1 -- 172.21.15.144:0/2722285499 wait complete. 2024-09-11T23:26:41.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.523+0000 7fd1a7e00640 1 Processor -- start 2024-09-11T23:26:41.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.523+0000 7fd1a7e00640 1 -- start start 2024-09-11T23:26:41.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.524+0000 7fd1a7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1a80ce090 0x7fd1a81e8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:41.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.524+0000 7fd1a7e00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1a80ce500 0x7fd1a80b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:41.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.524+0000 7fd1a7e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1a815b1d0 0x7fd1a81f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:41.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.524+0000 7fd1a7e00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a80b5380 con 0x7fd1a80ce090 2024-09-11T23:26:41.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.524+0000 7fd1a7e00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a80b50a0 con 0x7fd1a80ce500 2024-09-11T23:26:41.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.524+0000 7fd1a7e00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd1a80ce950 con 0x7fd1a815b1d0 2024-09-11T23:26:41.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.524+0000 7fd1a6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1a80ce090 0x7fd1a81e8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:41.525 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.524+0000 7fd1a6a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1a80ce090 0x7fd1a81e8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:53596/0 (socket says 172.21.15.144:53596) 2024-09-11T23:26:41.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.524+0000 7fd1a6a00640 1 -- 172.21.15.144:0/2244399313 learned_addr learned my addr 172.21.15.144:0/2244399313 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:41.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.524+0000 7fd19fe00640 1 --2- 172.21.15.144:0/2244399313 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1a80ce500 0x7fd1a80b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:41.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.524+0000 7fd1a7400640 1 --2- 172.21.15.144:0/2244399313 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1a815b1d0 0x7fd1a81f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:41.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.525+0000 7fd1a6a00640 1 -- 172.21.15.144:0/2244399313 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1a815b1d0 msgr2=0x7fd1a81f44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:41.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.525+0000 7fd1a6a00640 1 --2- 172.21.15.144:0/2244399313 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1a815b1d0 0x7fd1a81f44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:41.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.525+0000 7fd1a6a00640 1 -- 172.21.15.144:0/2244399313 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1a80ce500 msgr2=0x7fd1a80b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:41.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.525+0000 7fd1a6a00640 1 --2- 172.21.15.144:0/2244399313 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1a80ce500 0x7fd1a80b0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:41.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.525+0000 7fd1a6a00640 1 -- 172.21.15.144:0/2244399313 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a81f5030 con 0x7fd1a80ce090 2024-09-11T23:26:41.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.525+0000 7fd1a7400640 1 --2- 172.21.15.144:0/2244399313 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1a815b1d0 0x7fd1a81f44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:41.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.525+0000 7fd1a6a00640 1 --2- 172.21.15.144:0/2244399313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1a80ce090 0x7fd1a81e8370 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fd19800c3c0 tx=0x7fd19800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:41.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.525+0000 7fd19ea00640 1 -- 172.21.15.144:0/2244399313 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1980052d0 con 0x7fd1a80ce090 2024-09-11T23:26:41.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.525+0000 7fd19ea00640 1 -- 172.21.15.144:0/2244399313 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd198005490 con 0x7fd1a80ce090 2024-09-11T23:26:41.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.525+0000 7fd19ea00640 1 -- 172.21.15.144:0/2244399313 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd198007260 con 0x7fd1a80ce090 2024-09-11T23:26:41.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.525+0000 7fd1a7e00640 1 -- 172.21.15.144:0/2244399313 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1a81f5310 con 0x7fd1a80ce090 2024-09-11T23:26:41.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.525+0000 7fd1a7e00640 1 -- 172.21.15.144:0/2244399313 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1a80b0920 con 0x7fd1a80ce090 2024-09-11T23:26:41.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.526+0000 7fd1a7e00640 1 -- 172.21.15.144:0/2244399313 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1a80b4440 con 0x7fd1a80ce090 2024-09-11T23:26:41.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.527+0000 7fd19ea00640 1 -- 172.21.15.144:0/2244399313 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 27) ==== 91365+0+0 (secure 0 0 0) 0x7fd198007400 con 0x7fd1a80ce090 2024-09-11T23:26:41.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.528+0000 7fd19ea00640 1 --2- 172.21.15.144:0/2244399313 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd18406c7c0 0x7fd18406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:41.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.528+0000 7fd19ea00640 1 -- 172.21.15.144:0/2244399313 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7fd1980889f0 con 0x7fd1a80ce090 2024-09-11T23:26:41.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.529+0000 7fd19fe00640 1 --2- 172.21.15.144:0/2244399313 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd18406c7c0 0x7fd18406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:41.529 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.529+0000 7fd19fe00640 1 --2- 172.21.15.144:0/2244399313 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd18406c7c0 0x7fd18406ec80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd1a81e88b0 tx=0x7fd190009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:41.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.532+0000 7fd19ea00640 1 -- 172.21.15.144:0/2244399313 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd198058950 con 0x7fd1a80ce090 2024-09-11T23:26:41.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.729+0000 7fd1a7e00640 1 -- 172.21.15.144:0/2244399313 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol60080", "group_name": "subvol_grp60020", "target": ["mon-mgr", ""]}) -- 0x7fd1a80b26c0 con 0x7fd18406c7c0 2024-09-11T23:26:41.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.734+0000 7fd19ea00640 1 -- 172.21.15.144:0/2244399313 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd1a80b26c0 con 0x7fd18406c7c0 2024-09-11T23:26:41.734 INFO:teuthology.orchestra.run.smithi144.stdout:/volumes/subvol_grp60020/subvol60080 2024-09-11T23:26:41.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.737+0000 7fd1a7e00640 1 -- 172.21.15.144:0/2244399313 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd18406c7c0 msgr2=0x7fd18406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:41.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.737+0000 7fd1a7e00640 1 --2- 172.21.15.144:0/2244399313 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd18406c7c0 0x7fd18406ec80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd1a81e88b0 tx=0x7fd190009040 comp rx=0 tx=0).stop 2024-09-11T23:26:41.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.737+0000 7fd1a7e00640 1 -- 172.21.15.144:0/2244399313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1a80ce090 msgr2=0x7fd1a81e8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:41.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.737+0000 7fd1a7e00640 1 --2- 172.21.15.144:0/2244399313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1a80ce090 0x7fd1a81e8370 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fd19800c3c0 tx=0x7fd19800c880 comp rx=0 tx=0).stop 2024-09-11T23:26:41.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.737+0000 7fd1a7e00640 1 -- 172.21.15.144:0/2244399313 shutdown_connections 2024-09-11T23:26:41.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.737+0000 7fd1a7e00640 1 --2- 172.21.15.144:0/2244399313 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd18406c7c0 0x7fd18406ec80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:41.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.737+0000 7fd1a7e00640 1 --2- 172.21.15.144:0/2244399313 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd1a815b1d0 0x7fd1a81f44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:41.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.737+0000 7fd1a7e00640 1 --2- 172.21.15.144:0/2244399313 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1a80ce500 0x7fd1a80b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:41.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.737+0000 7fd1a7e00640 1 --2- 172.21.15.144:0/2244399313 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd1a80ce090 0x7fd1a81e8370 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:41.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.737+0000 7fd1a7e00640 1 -- 172.21.15.144:0/2244399313 >> 172.21.15.144:0/2244399313 conn(0x7fd1a806bba0 msgr2=0x7fd1a8072ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:41.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.737+0000 7fd1a7e00640 1 -- 172.21.15.144:0/2244399313 shutdown_connections 2024-09-11T23:26:41.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:41.737+0000 7fd1a7e00640 1 -- 172.21.15.144:0/2244399313 wait complete. 2024-09-11T23:26:41.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:41.753 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/e5cfd6a4a8fd7c5e7cb8f2b7654c7191.meta) 2024-09-11T23:26:44.941 INFO:teuthology.orchestra.run.smithi144.stdout:[GLOBAL] 2024-09-11T23:26:44.942 INFO:teuthology.orchestra.run.smithi144.stdout:version = 1 2024-09-11T23:26:44.942 INFO:teuthology.orchestra.run.smithi144.stdout:type = subvolume 2024-09-11T23:26:44.942 INFO:teuthology.orchestra.run.smithi144.stdout:path = /volumes/subvol_grp60020/subvol60080 2024-09-11T23:26:44.942 INFO:teuthology.orchestra.run.smithi144.stdout:state = complete 2024-09-11T23:26:44.942 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:44.946 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol60080 subvol_grp60020 2024-09-11T23:26:45.112 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.112+0000 7f6d20c00640 1 Processor -- start 2024-09-11T23:26:45.113 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.113+0000 7f6d20c00640 1 -- start start 2024-09-11T23:26:45.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.114+0000 7f6d20c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d1c06e500 0x7f6d1c167310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:45.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.114+0000 7f6d20c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d1c0b4240 con 0x7f6d1c0cf5d0 2024-09-11T23:26:45.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.114+0000 7f6d20c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d1c0b4520 con 0x7f6d1c145d90 2024-09-11T23:26:45.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.114+0000 7f6d20c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f6d1c06d080 con 0x7f6d1c06e500 2024-09-11T23:26:45.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.114+0000 7f6d1a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d1c06e500 0x7f6d1c167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:45.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.114+0000 7f6d1a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6d1c06e500 0x7f6d1c167310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34082/0 (socket says 172.21.15.144:34082) 2024-09-11T23:26:45.114 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.114+0000 7f6d1a800640 1 -- 172.21.15.144:0/150078288 learned_addr learned my addr 172.21.15.144:0/150078288 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:45.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.115+0000 7f6d1a800640 1 -- 172.21.15.144:0/150078288 >> v1:172.21.15.165:6789/0 conn(0x7f6d1c145d90 legacy=0x7f6d1c0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:45.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.115+0000 7f6d1a800640 1 -- 172.21.15.144:0/150078288 >> v1:172.21.15.144:6789/0 conn(0x7f6d1c0cf5d0 legacy=0x7f6d1c0cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:45.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.115+0000 7f6d1a800640 1 -- 172.21.15.144:0/150078288 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1c0b4800 con 0x7f6d1c06e500 2024-09-11T23:26:45.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.116+0000 7f6d1a800640 1 --2- 172.21.15.144:0/150078288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c06e500 0x7f6d1c167310 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f6d14009e50 tx=0x7f6d1402a7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a2e63688e5cba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:45.115 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.116+0000 7f6d18a00640 1 -- 172.21.15.144:0/150078288 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d14036070 con 0x7f6d1c06e500 2024-09-11T23:26:45.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.116+0000 7f6d18a00640 1 -- 172.21.15.144:0/150078288 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d14031600 con 0x7f6d1c06e500 2024-09-11T23:26:45.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.116+0000 7f6d18a00640 1 -- 172.21.15.144:0/150078288 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d140319d0 con 0x7f6d1c06e500 2024-09-11T23:26:45.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.116+0000 7f6d20c00640 1 -- 172.21.15.144:0/150078288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c06e500 msgr2=0x7f6d1c167310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:45.116 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.116+0000 7f6d20c00640 1 --2- 172.21.15.144:0/150078288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c06e500 0x7f6d1c167310 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f6d14009e50 tx=0x7f6d1402a7b0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.116+0000 7f6d20c00640 1 -- 172.21.15.144:0/150078288 shutdown_connections 2024-09-11T23:26:45.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.116+0000 7f6d20c00640 1 --2- 172.21.15.144:0/150078288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c06e500 0x7f6d1c167310 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.116+0000 7f6d20c00640 1 -- 172.21.15.144:0/150078288 >> 172.21.15.144:0/150078288 conn(0x7f6d1c06bba0 msgr2=0x7f6d1c06bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:45.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.116+0000 7f6d20c00640 1 -- 172.21.15.144:0/150078288 shutdown_connections 2024-09-11T23:26:45.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.117+0000 7f6d20c00640 1 -- 172.21.15.144:0/150078288 wait complete. 2024-09-11T23:26:45.117 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.118+0000 7f6d20c00640 1 Processor -- start 2024-09-11T23:26:45.118 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.118+0000 7f6d20c00640 1 -- start start 2024-09-11T23:26:45.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.119+0000 7f6d20c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d1c06e500 0x7f6d1c0b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:45.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.119+0000 7f6d20c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c0cf5d0 0x7f6d1c140e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:45.119 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.119+0000 7f6d20c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d1c145d90 0x7f6d1c1413a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:45.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.119+0000 7f6d20c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c0b5610 con 0x7f6d1c0cf5d0 2024-09-11T23:26:45.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.119+0000 7f6d20c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c0cd660 con 0x7f6d1c06e500 2024-09-11T23:26:45.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.119+0000 7f6d20c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f6d1c0b5790 con 0x7f6d1c145d90 2024-09-11T23:26:45.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.119+0000 7f6d19400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c0cf5d0 0x7f6d1c140e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:45.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.119+0000 7f6d19400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c0cf5d0 0x7f6d1c140e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34098/0 (socket says 172.21.15.144:34098) 2024-09-11T23:26:45.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.119+0000 7f6d19400640 1 -- 172.21.15.144:0/3393549186 learned_addr learned my addr 172.21.15.144:0/3393549186 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:45.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.119+0000 7f6d19e00640 1 --2- 172.21.15.144:0/3393549186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d1c06e500 0x7f6d1c0b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:45.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.120+0000 7f6d1a800640 1 --2- 172.21.15.144:0/3393549186 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d1c145d90 0x7f6d1c1413a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:45.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.120+0000 7f6d19400640 1 -- 172.21.15.144:0/3393549186 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d1c145d90 msgr2=0x7f6d1c1413a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:45.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.120+0000 7f6d19400640 1 --2- 172.21.15.144:0/3393549186 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d1c145d90 0x7f6d1c1413a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.120+0000 7f6d19400640 1 -- 172.21.15.144:0/3393549186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d1c06e500 msgr2=0x7f6d1c0b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:45.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.120+0000 7f6d19400640 1 --2- 172.21.15.144:0/3393549186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d1c06e500 0x7f6d1c0b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.120 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.120+0000 7f6d19400640 1 -- 172.21.15.144:0/3393549186 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1c15d110 con 0x7f6d1c0cf5d0 2024-09-11T23:26:45.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.120+0000 7f6d19400640 1 --2- 172.21.15.144:0/3393549186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c0cf5d0 0x7f6d1c140e60 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800c480 tx=0x7f6d0800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:45.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.120+0000 7f6d12000640 1 -- 172.21.15.144:0/3393549186 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d080052d0 con 0x7f6d1c0cf5d0 2024-09-11T23:26:45.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.120+0000 7f6d12000640 1 -- 172.21.15.144:0/3393549186 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d08005470 con 0x7f6d1c0cf5d0 2024-09-11T23:26:45.121 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.120+0000 7f6d20c00640 1 -- 172.21.15.144:0/3393549186 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d1c15d3f0 con 0x7f6d1c0cf5d0 2024-09-11T23:26:45.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.120+0000 7f6d12000640 1 -- 172.21.15.144:0/3393549186 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d08012870 con 0x7f6d1c0cf5d0 2024-09-11T23:26:45.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.120+0000 7f6d20c00640 1 -- 172.21.15.144:0/3393549186 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d1c15d9b0 con 0x7f6d1c0cf5d0 2024-09-11T23:26:45.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.121+0000 7f6d20c00640 1 -- 172.21.15.144:0/3393549186 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d1c15dbb0 con 0x7f6d1c0cf5d0 2024-09-11T23:26:45.122 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.122+0000 7f6d12000640 1 -- 172.21.15.144:0/3393549186 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 28) ==== 91416+0+0 (secure 0 0 0) 0x7f6d08012a10 con 0x7f6d1c0cf5d0 2024-09-11T23:26:45.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.124+0000 7f6d12000640 1 --2- 172.21.15.144:0/3393549186 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6cfc06c850 0x7f6cfc06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:45.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.124+0000 7f6d12000640 1 -- 172.21.15.144:0/3393549186 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f6d08089660 con 0x7f6d1c0cf5d0 2024-09-11T23:26:45.123 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.124+0000 7f6d19e00640 1 --2- 172.21.15.144:0/3393549186 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6cfc06c850 0x7f6cfc06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:45.124 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.125+0000 7f6d19e00640 1 --2- 172.21.15.144:0/3393549186 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6cfc06c850 0x7f6cfc06ed10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c001580 tx=0x7f6d0c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:45.127 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.128+0000 7f6d12000640 1 -- 172.21.15.144:0/3393549186 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d1c15dbb0 con 0x7f6d1c0cf5d0 2024-09-11T23:26:45.285 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:26:45.289 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:26:45.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.328+0000 7f6d20c00640 1 -- 172.21.15.144:0/3393549186 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol60080", "group_name": "subvol_grp60020", "target": ["mon-mgr", ""]}) -- 0x7f6d1c146170 con 0x7f6cfc06c850 2024-09-11T23:26:45.357 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.357+0000 7f6d12000640 1 -- 172.21.15.144:0/3393549186 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6d1c146170 con 0x7f6cfc06c850 2024-09-11T23:26:45.359 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.360+0000 7f6d20c00640 1 -- 172.21.15.144:0/3393549186 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6cfc06c850 msgr2=0x7f6cfc06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:45.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.360+0000 7f6d20c00640 1 --2- 172.21.15.144:0/3393549186 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6cfc06c850 0x7f6cfc06ed10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c001580 tx=0x7f6d0c009040 comp rx=0 tx=0).stop 2024-09-11T23:26:45.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.360+0000 7f6d20c00640 1 -- 172.21.15.144:0/3393549186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c0cf5d0 msgr2=0x7f6d1c140e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:45.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.360+0000 7f6d20c00640 1 --2- 172.21.15.144:0/3393549186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c0cf5d0 0x7f6d1c140e60 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800c480 tx=0x7f6d0800c940 comp rx=0 tx=0).stop 2024-09-11T23:26:45.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.360+0000 7f6d20c00640 1 -- 172.21.15.144:0/3393549186 shutdown_connections 2024-09-11T23:26:45.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.360+0000 7f6d20c00640 1 --2- 172.21.15.144:0/3393549186 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f6cfc06c850 0x7f6cfc06ed10 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.360+0000 7f6d20c00640 1 --2- 172.21.15.144:0/3393549186 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f6d1c145d90 0x7f6d1c1413a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.360+0000 7f6d20c00640 1 --2- 172.21.15.144:0/3393549186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d1c0cf5d0 0x7f6d1c140e60 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.360+0000 7f6d20c00640 1 --2- 172.21.15.144:0/3393549186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d1c06e500 0x7f6d1c0b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.360+0000 7f6d20c00640 1 -- 172.21.15.144:0/3393549186 >> 172.21.15.144:0/3393549186 conn(0x7f6d1c06bba0 msgr2=0x7f6d1c06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:45.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.360+0000 7f6d20c00640 1 -- 172.21.15.144:0/3393549186 shutdown_connections 2024-09-11T23:26:45.360 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.360+0000 7f6d20c00640 1 -- 172.21.15.144:0/3393549186 wait complete. 2024-09-11T23:26:45.363 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:45.364+0000 7f30e1400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:45.363 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:45.364+0000 7f30e1400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:45.363 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:45.364+0000 7f30e1400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:45.363 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:45.364+0000 7f30e1400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:45.363 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:45.364+0000 7f30e1400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:45.377 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-11T23:26:45.379 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:45.380+0000 7f30e0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:45.379 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:45.380+0000 7f30e0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:45.379 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:45.380+0000 7f30e0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:45.380 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:45.380+0000 7f30e0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:45.380 INFO:tasks.ceph.mgr.x.smithi165.stderr:2024-09-11T23:26:45.380+0000 7f30e0000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T23:26:45.495 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T23:26:45.503 INFO:teuthology.orchestra.run.smithi144.stdout:2 2024-09-11T23:26:45.503 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T23:26:45.512 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp60020 2024-09-11T23:26:45.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.670+0000 7fe880000640 1 Processor -- start 2024-09-11T23:26:45.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.670+0000 7fe880000640 1 -- start start 2024-09-11T23:26:45.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.672+0000 7fe880000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe87806f130 0x7fe8780b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:45.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.672+0000 7fe880000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe87815c370 0x7fe8780ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:45.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.672+0000 7fe880000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87815c820 con 0x7fe878158e50 2024-09-11T23:26:45.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.672+0000 7fe880000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe8780b43f0 con 0x7fe87815c370 2024-09-11T23:26:45.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.672+0000 7fe880000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8780b3630 con 0x7fe87806f130 2024-09-11T23:26:45.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.672+0000 7fe87d600640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fe878158e50 0x7fe87806ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43686/0 (socket says 172.21.15.144:43686) 2024-09-11T23:26:45.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.672+0000 7fe87d600640 1 -- 172.21.15.144:0/3571796079 learned_addr learned my addr 172.21.15.144:0/3571796079 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:45.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.672+0000 7fe87e000640 1 --2- 172.21.15.144:0/3571796079 >> v2:172.21.15.144:3300/0 conn(0x7fe87815c370 0x7fe8780ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:45.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.672+0000 7fe87cc00640 1 --2- 172.21.15.144:0/3571796079 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe87806f130 0x7fe8780b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:45.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.673+0000 7fe87e000640 1 -- 172.21.15.144:0/3571796079 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe87806f130 msgr2=0x7fe8780b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:45.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.673+0000 7fe87e000640 1 --2- 172.21.15.144:0/3571796079 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe87806f130 0x7fe8780b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.673+0000 7fe87e000640 1 -- 172.21.15.144:0/3571796079 >> v1:172.21.15.144:6789/0 conn(0x7fe878158e50 legacy=0x7fe87806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:45.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.673+0000 7fe87e000640 1 -- 172.21.15.144:0/3571796079 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8780b3910 con 0x7fe87815c370 2024-09-11T23:26:45.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.674+0000 7fe87e000640 1 --2- 172.21.15.144:0/3571796079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe87815c370 0x7fe8780ce200 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fe870009d90 tx=0x7fe87002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee199545eacbbe9a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:45.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.674+0000 7fe877e00640 1 -- 172.21.15.144:0/3571796079 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870007740 con 0x7fe87815c370 2024-09-11T23:26:45.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.675+0000 7fe877e00640 1 -- 172.21.15.144:0/3571796079 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8700078e0 con 0x7fe87815c370 2024-09-11T23:26:45.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.675+0000 7fe877e00640 1 -- 172.21.15.144:0/3571796079 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870007cb0 con 0x7fe87815c370 2024-09-11T23:26:45.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.675+0000 7fe880000640 1 -- 172.21.15.144:0/3571796079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe87815c370 msgr2=0x7fe8780ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:45.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.675+0000 7fe880000640 1 --2- 172.21.15.144:0/3571796079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe87815c370 0x7fe8780ce200 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fe870009d90 tx=0x7fe87002a660 comp rx=0 tx=0).stop 2024-09-11T23:26:45.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.675+0000 7fe880000640 1 -- 172.21.15.144:0/3571796079 shutdown_connections 2024-09-11T23:26:45.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.675+0000 7fe880000640 1 --2- 172.21.15.144:0/3571796079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe87815c370 0x7fe8780ce200 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.675+0000 7fe880000640 1 --2- 172.21.15.144:0/3571796079 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe87806f130 0x7fe8780b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.675 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.675+0000 7fe880000640 1 -- 172.21.15.144:0/3571796079 >> 172.21.15.144:0/3571796079 conn(0x7fe87806bba0 msgr2=0x7fe87806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:45.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.675+0000 7fe880000640 1 -- 172.21.15.144:0/3571796079 shutdown_connections 2024-09-11T23:26:45.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.676+0000 7fe880000640 1 -- 172.21.15.144:0/3571796079 wait complete. 2024-09-11T23:26:45.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.677+0000 7fe880000640 1 Processor -- start 2024-09-11T23:26:45.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.677+0000 7fe880000640 1 -- start start 2024-09-11T23:26:45.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.678+0000 7fe880000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe87806f130 0x7fe878142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:45.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.678+0000 7fe880000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe878158e50 0x7fe878159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:45.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.678+0000 7fe880000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe87815c370 0x7fe87815a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:45.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.678+0000 7fe880000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe878159230 con 0x7fe87806f130 2024-09-11T23:26:45.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.678+0000 7fe880000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe8780b3ed0 con 0x7fe87815c370 2024-09-11T23:26:45.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.678+0000 7fe880000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe8780ce740 con 0x7fe878158e50 2024-09-11T23:26:45.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.679+0000 7fe87d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe87806f130 0x7fe878142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.679+0000 7fe87d600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe87806f130 0x7fe878142bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34120/0 (socket says 172.21.15.144:34120) 2024-09-11T23:26:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.679+0000 7fe87d600640 1 -- 172.21.15.144:0/2239629549 learned_addr learned my addr 172.21.15.144:0/2239629549 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.679+0000 7fe87e000640 1 --2- 172.21.15.144:0/2239629549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe87815c370 0x7fe87815a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.679+0000 7fe87cc00640 1 --2- 172.21.15.144:0/2239629549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe878158e50 0x7fe878159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.679+0000 7fe87d600640 1 -- 172.21.15.144:0/2239629549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe878158e50 msgr2=0x7fe878159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.679+0000 7fe87d600640 1 --2- 172.21.15.144:0/2239629549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe878158e50 0x7fe878159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.679+0000 7fe87d600640 1 -- 172.21.15.144:0/2239629549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe87815c370 msgr2=0x7fe87815a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.679+0000 7fe87d600640 1 --2- 172.21.15.144:0/2239629549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe87815c370 0x7fe87815a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.679+0000 7fe87d600640 1 -- 172.21.15.144:0/2239629549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8781f02a0 con 0x7fe87806f130 2024-09-11T23:26:45.680 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.680+0000 7fe87d600640 1 --2- 172.21.15.144:0/2239629549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe87806f130 0x7fe878142bc0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00c400 tx=0x7fe86c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:45.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.680+0000 7fe875600640 1 -- 172.21.15.144:0/2239629549 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c017070 con 0x7fe87806f130 2024-09-11T23:26:45.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.680+0000 7fe875600640 1 -- 172.21.15.144:0/2239629549 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe86c005ce0 con 0x7fe87806f130 2024-09-11T23:26:45.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.680+0000 7fe880000640 1 -- 172.21.15.144:0/2239629549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe87815e1f0 con 0x7fe87806f130 2024-09-11T23:26:45.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.680+0000 7fe875600640 1 -- 172.21.15.144:0/2239629549 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c0072f0 con 0x7fe87806f130 2024-09-11T23:26:45.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.680+0000 7fe880000640 1 -- 172.21.15.144:0/2239629549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8781e51c0 con 0x7fe87806f130 2024-09-11T23:26:45.681 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.681+0000 7fe880000640 1 -- 172.21.15.144:0/2239629549 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8780ce200 con 0x7fe87806f130 2024-09-11T23:26:45.682 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.682+0000 7fe875600640 1 -- 172.21.15.144:0/2239629549 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 28) ==== 91416+0+0 (secure 0 0 0) 0x7fe86c01a070 con 0x7fe87806f130 2024-09-11T23:26:45.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.683+0000 7fe875600640 1 --2- 172.21.15.144:0/2239629549 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe85806c880 0x7fe85806ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:45.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.683+0000 7fe875600640 1 -- 172.21.15.144:0/2239629549 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7fe86c088cf0 con 0x7fe87806f130 2024-09-11T23:26:45.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.684+0000 7fe87cc00640 1 --2- 172.21.15.144:0/2239629549 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe85806c880 0x7fe85806ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:45.683 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.684+0000 7fe87cc00640 1 --2- 172.21.15.144:0/2239629549 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe85806c880 0x7fe85806ed40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe878156b00 tx=0x7fe86400b320 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:45.687 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.687+0000 7fe875600640 1 -- 172.21.15.144:0/2239629549 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe87815c820 con 0x7fe87806f130 2024-09-11T23:26:45.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.875+0000 7fe875600640 1 -- 172.21.15.144:0/2239629549 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7fe86c054f50 con 0x7fe87806f130 2024-09-11T23:26:45.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.890+0000 7fe880000640 1 -- 172.21.15.144:0/2239629549 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp60020", "target": ["mon-mgr", ""]}) -- 0x7fe8780cd280 con 0x7fe85806c880 2024-09-11T23:26:45.895 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.896+0000 7fe875600640 1 -- 172.21.15.144:0/2239629549 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe8780cd280 con 0x7fe85806c880 2024-09-11T23:26:45.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.898+0000 7fe880000640 1 -- 172.21.15.144:0/2239629549 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe85806c880 msgr2=0x7fe85806ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:45.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.898+0000 7fe880000640 1 --2- 172.21.15.144:0/2239629549 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe85806c880 0x7fe85806ed40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe878156b00 tx=0x7fe86400b320 comp rx=0 tx=0).stop 2024-09-11T23:26:45.898 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.898+0000 7fe880000640 1 -- 172.21.15.144:0/2239629549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe87806f130 msgr2=0x7fe878142bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:45.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.898+0000 7fe880000640 1 --2- 172.21.15.144:0/2239629549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe87806f130 0x7fe878142bc0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00c400 tx=0x7fe86c00c8c0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.898+0000 7fe880000640 1 -- 172.21.15.144:0/2239629549 shutdown_connections 2024-09-11T23:26:45.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.898+0000 7fe880000640 1 --2- 172.21.15.144:0/2239629549 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe85806c880 0x7fe85806ed40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.898+0000 7fe880000640 1 --2- 172.21.15.144:0/2239629549 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe87815c370 0x7fe87815a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.898+0000 7fe880000640 1 --2- 172.21.15.144:0/2239629549 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe878158e50 0x7fe878159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.898+0000 7fe880000640 1 --2- 172.21.15.144:0/2239629549 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe87806f130 0x7fe878142bc0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:45.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.898+0000 7fe880000640 1 -- 172.21.15.144:0/2239629549 >> 172.21.15.144:0/2239629549 conn(0x7fe87806bba0 msgr2=0x7fe878071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:45.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.898+0000 7fe880000640 1 -- 172.21.15.144:0/2239629549 shutdown_connections 2024-09-11T23:26:45.899 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:45.898+0000 7fe880000640 1 -- 172.21.15.144:0/2239629549 wait complete. 2024-09-11T23:26:45.914 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-11T23:26:45.915 DEBUG:teuthology.orchestra.run.smithi144:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:26:46.005 DEBUG:teuthology.orchestra.run.smithi165:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-11T23:26:46.097 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-11T23:26:46.097 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:26:46.098 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:26:46.098 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:46.134 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:26:46.134 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:46.210 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:26:46.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.405+0000 7f412a600640 1 Processor -- start 2024-09-11T23:26:46.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.405+0000 7f412a600640 1 -- start start 2024-09-11T23:26:46.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.406+0000 7f412a600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f412415e6a0 0x7f41240cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:46.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.406+0000 7f412a600640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f412415ea80 con 0x7f412406d610 2024-09-11T23:26:46.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.406+0000 7f412a600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41240d4180 con 0x7f41240d2230 2024-09-11T23:26:46.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.406+0000 7f412a600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f41240d35e0 con 0x7f412415e6a0 2024-09-11T23:26:46.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.406+0000 7f4129c00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f412406d610 0x7f41240b7670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43694/0 (socket says 172.21.15.144:43694) 2024-09-11T23:26:46.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.406+0000 7f4129c00640 1 -- 172.21.15.144:0/2795248078 learned_addr learned my addr 172.21.15.144:0/2795248078 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:46.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.406+0000 7f4129200640 1 --2- 172.21.15.144:0/2795248078 >> v2:172.21.15.165:3300/0 conn(0x7f412415e6a0 0x7f41240cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:46.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.407+0000 7f4123400640 1 -- 172.21.15.144:0/2795248078 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2621186902 0 0) 0x7f412415ea80 con 0x7f412406d610 2024-09-11T23:26:46.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.407+0000 7f4123400640 1 -- 172.21.15.144:0/2795248078 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f410c003520 con 0x7f412406d610 2024-09-11T23:26:46.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.407+0000 7f4123400640 1 -- 172.21.15.144:0/2795248078 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2903000104 0 0) 0x7f41240d4180 con 0x7f41240d2230 2024-09-11T23:26:46.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.407+0000 7f4123400640 1 -- 172.21.15.144:0/2795248078 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f412415ea80 con 0x7f41240d2230 2024-09-11T23:26:46.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.407+0000 7f4129200640 1 -- 172.21.15.144:0/2795248078 >> v1:172.21.15.165:6789/0 conn(0x7f41240d2230 legacy=0x7f41240d3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:46.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.407+0000 7f4129200640 1 -- 172.21.15.144:0/2795248078 >> v1:172.21.15.144:6789/0 conn(0x7f412406d610 legacy=0x7f41240b7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:46.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.407+0000 7f4129200640 1 -- 172.21.15.144:0/2795248078 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41240d29d0 con 0x7f412415e6a0 2024-09-11T23:26:46.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.408+0000 7f4129200640 1 --2- 172.21.15.144:0/2795248078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f412415e6a0 0x7f41240cf630 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f41180097a0 tx=0x7f411802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3286aa15842f0ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:46.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.408+0000 7f4123400640 1 -- 172.21.15.144:0/2795248078 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118037070 con 0x7f412415e6a0 2024-09-11T23:26:46.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.408+0000 7f4123400640 1 -- 172.21.15.144:0/2795248078 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4118032440 con 0x7f412415e6a0 2024-09-11T23:26:46.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.408+0000 7f4123400640 1 -- 172.21.15.144:0/2795248078 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118032810 con 0x7f412415e6a0 2024-09-11T23:26:46.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.409+0000 7f412a600640 1 -- 172.21.15.144:0/2795248078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f412415e6a0 msgr2=0x7f41240cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:46.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.409+0000 7f412a600640 1 --2- 172.21.15.144:0/2795248078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f412415e6a0 0x7f41240cf630 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f41180097a0 tx=0x7f411802a1a0 comp rx=0 tx=0).stop 2024-09-11T23:26:46.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.409+0000 7f412a600640 1 -- 172.21.15.144:0/2795248078 shutdown_connections 2024-09-11T23:26:46.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.409+0000 7f412a600640 1 --2- 172.21.15.144:0/2795248078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f412415e6a0 0x7f41240cf630 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:46.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.409+0000 7f412a600640 1 -- 172.21.15.144:0/2795248078 >> 172.21.15.144:0/2795248078 conn(0x7f41240d4540 msgr2=0x7f41240d4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:46.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.409+0000 7f412a600640 1 -- 172.21.15.144:0/2795248078 shutdown_connections 2024-09-11T23:26:46.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.409+0000 7f412a600640 1 -- 172.21.15.144:0/2795248078 wait complete. 2024-09-11T23:26:46.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.411+0000 7f412a600640 1 Processor -- start 2024-09-11T23:26:46.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.411+0000 7f412a600640 1 -- start start 2024-09-11T23:26:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.412+0000 7f412a600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f412406d610 0x7f41241f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.412+0000 7f412a600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41240d2230 0x7f4124162440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.412+0000 7f412a600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f412415e6a0 0x7f4124162980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.412+0000 7f412a600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f41240d3270 con 0x7f41240d2230 2024-09-11T23:26:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.412+0000 7f412a600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f41240d2f90 con 0x7f412406d610 2024-09-11T23:26:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.412+0000 7f412a600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f41240cfb70 con 0x7f412415e6a0 2024-09-11T23:26:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.412+0000 7f4123e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41240d2230 0x7f4124162440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.412+0000 7f4123e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41240d2230 0x7f4124162440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34126/0 (socket says 172.21.15.144:34126) 2024-09-11T23:26:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.412+0000 7f4123e00640 1 -- 172.21.15.144:0/650687800 learned_addr learned my addr 172.21.15.144:0/650687800 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.412+0000 7f4129200640 1 --2- 172.21.15.144:0/650687800 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f412406d610 0x7f41241f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.412+0000 7f4129c00640 1 --2- 172.21.15.144:0/650687800 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f412415e6a0 0x7f4124162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:46.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.412+0000 7f4123e00640 1 -- 172.21.15.144:0/650687800 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f412415e6a0 msgr2=0x7f4124162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:46.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.412+0000 7f4123e00640 1 --2- 172.21.15.144:0/650687800 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f412415e6a0 0x7f4124162980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:46.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.412+0000 7f4123e00640 1 -- 172.21.15.144:0/650687800 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f412406d610 msgr2=0x7f41241f5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:46.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.412+0000 7f4123e00640 1 --2- 172.21.15.144:0/650687800 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f412406d610 0x7f41241f5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:46.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.413+0000 7f4123e00640 1 -- 172.21.15.144:0/650687800 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41240b5050 con 0x7f41240d2230 2024-09-11T23:26:46.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.413+0000 7f4123e00640 1 --2- 172.21.15.144:0/650687800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41240d2230 0x7f4124162440 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f411000c530 tx=0x7f411000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:46.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.413+0000 7f4120c00640 1 -- 172.21.15.144:0/650687800 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41100052d0 con 0x7f41240d2230 2024-09-11T23:26:46.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.413+0000 7f4120c00640 1 -- 172.21.15.144:0/650687800 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4110005490 con 0x7f41240d2230 2024-09-11T23:26:46.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.413+0000 7f412a600640 1 -- 172.21.15.144:0/650687800 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41240b5330 con 0x7f41240d2230 2024-09-11T23:26:46.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.413+0000 7f4120c00640 1 -- 172.21.15.144:0/650687800 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110012870 con 0x7f41240d2230 2024-09-11T23:26:46.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.413+0000 7f412a600640 1 -- 172.21.15.144:0/650687800 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41241f6420 con 0x7f41240d2230 2024-09-11T23:26:46.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.414+0000 7f412a600640 1 -- 172.21.15.144:0/650687800 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41240cf630 con 0x7f41240d2230 2024-09-11T23:26:46.415 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.415+0000 7f4120c00640 1 -- 172.21.15.144:0/650687800 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f4110012a10 con 0x7f41240d2230 2024-09-11T23:26:46.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.416+0000 7f4120c00640 1 --2- 172.21.15.144:0/650687800 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f410406c970 0x7f410406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:46.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.416+0000 7f4120c00640 1 -- 172.21.15.144:0/650687800 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f41100895c0 con 0x7f41240d2230 2024-09-11T23:26:46.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.416+0000 7f4129200640 1 --2- 172.21.15.144:0/650687800 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f410406c970 0x7f410406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:46.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.417+0000 7f4129200640 1 --2- 172.21.15.144:0/650687800 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f410406c970 0x7f410406ee30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4118034000 tx=0x7f411802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:46.419 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.420+0000 7f4120c00640 1 -- 172.21.15.144:0/650687800 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41100590a0 con 0x7f41240d2230 2024-09-11T23:26:46.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.606+0000 7f412a600640 1 -- 172.21.15.144:0/650687800 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f41240d2680 con 0x7f41240d2230 2024-09-11T23:26:46.606 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.606+0000 7f4120c00640 1 -- 172.21.15.144:0/650687800 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v166) ==== 80+0+0 (secure 0 0 0) 0x7f411005d3a0 con 0x7f41240d2230 2024-09-11T23:26:46.606 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:26:46.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.608+0000 7f412a600640 1 -- 172.21.15.144:0/650687800 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f410406c970 msgr2=0x7f410406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:46.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.608+0000 7f412a600640 1 --2- 172.21.15.144:0/650687800 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f410406c970 0x7f410406ee30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4118034000 tx=0x7f411802e000 comp rx=0 tx=0).stop 2024-09-11T23:26:46.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.608+0000 7f412a600640 1 -- 172.21.15.144:0/650687800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41240d2230 msgr2=0x7f4124162440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:46.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.608+0000 7f412a600640 1 --2- 172.21.15.144:0/650687800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41240d2230 0x7f4124162440 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f411000c530 tx=0x7f411000c9f0 comp rx=0 tx=0).stop 2024-09-11T23:26:46.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.608+0000 7f412a600640 1 -- 172.21.15.144:0/650687800 shutdown_connections 2024-09-11T23:26:46.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.609+0000 7f412a600640 1 --2- 172.21.15.144:0/650687800 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f410406c970 0x7f410406ee30 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:46.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.609+0000 7f412a600640 1 --2- 172.21.15.144:0/650687800 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f412415e6a0 0x7f4124162980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:46.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.609+0000 7f412a600640 1 --2- 172.21.15.144:0/650687800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41240d2230 0x7f4124162440 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:46.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.609+0000 7f412a600640 1 --2- 172.21.15.144:0/650687800 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f412406d610 0x7f41241f5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:46.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.609+0000 7f412a600640 1 -- 172.21.15.144:0/650687800 >> 172.21.15.144:0/650687800 conn(0x7f41240d4540 msgr2=0x7f412415edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:46.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.609+0000 7f412a600640 1 -- 172.21.15.144:0/650687800 shutdown_connections 2024-09-11T23:26:46.609 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:46.609+0000 7f412a600640 1 -- 172.21.15.144:0/650687800 wait complete. 2024-09-11T23:26:46.625 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T23:26:46.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:46.625 DEBUG:teuthology.orchestra.run.smithi144:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T23:26:46.719 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:26:46.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:46.720 DEBUG:teuthology.orchestra.run.smithi144:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T23:26:46.765 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:26:46.765 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:26:46.765 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:46.801 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:26:46.801 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:46.878 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T23:26:47.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.033+0000 7fa200000640 1 Processor -- start 2024-09-11T23:26:47.033 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.033+0000 7fa200000640 1 -- start start 2024-09-11T23:26:47.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.035+0000 7fa200000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fa1f815c180 0x7fa1f80cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.035+0000 7fa200000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1f80ce230 0x7fa1f80cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.035+0000 7fa200000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1f80ce740 con 0x7fa1f80cf5b0 2024-09-11T23:26:47.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.035+0000 7fa200000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fa1f8072640 con 0x7fa1f815c180 2024-09-11T23:26:47.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.035+0000 7fa200000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f8072920 con 0x7fa1f80ce230 2024-09-11T23:26:47.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.035+0000 7fa1fe000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fa1f80cf5b0 0x7fa1f8073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43698/0 (socket says 172.21.15.144:43698) 2024-09-11T23:26:47.035 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.035+0000 7fa1fe000640 1 -- 172.21.15.144:0/3917360316 learned_addr learned my addr 172.21.15.144:0/3917360316 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:47.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.035+0000 7fa1fd600640 1 --2- 172.21.15.144:0/3917360316 >> v2:172.21.15.165:3300/0 conn(0x7fa1f815c180 0x7fa1f80cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.035+0000 7fa1fcc00640 1 --2- 172.21.15.144:0/3917360316 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1f80ce230 0x7fa1f80cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.035+0000 7fa1f7e00640 1 -- 172.21.15.144:0/3917360316 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 441882478 0 0) 0x7fa1f80ce740 con 0x7fa1f80cf5b0 2024-09-11T23:26:47.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.035+0000 7fa1f7e00640 1 -- 172.21.15.144:0/3917360316 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1e0003520 con 0x7fa1f80cf5b0 2024-09-11T23:26:47.036 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1f7e00640 1 -- 172.21.15.144:0/3917360316 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4062221542 0 0) 0x7fa1e0003520 con 0x7fa1f80cf5b0 2024-09-11T23:26:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1f7e00640 1 -- 172.21.15.144:0/3917360316 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1f80ce230 msgr2=0x7fa1f80cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1f7e00640 1 --2- 172.21.15.144:0/3917360316 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1f80ce230 0x7fa1f80cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1f7e00640 1 -- 172.21.15.144:0/3917360316 >> v2:172.21.15.165:3300/0 conn(0x7fa1f815c180 msgr2=0x7fa1f80cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1f7e00640 1 --2- 172.21.15.144:0/3917360316 >> v2:172.21.15.165:3300/0 conn(0x7fa1f815c180 0x7fa1f80cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1f7e00640 1 -- 172.21.15.144:0/3917360316 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f8072c00 con 0x7fa1f80cf5b0 2024-09-11T23:26:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1f7e00640 1 -- 172.21.15.144:0/3917360316 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fa1f00019f0 con 0x7fa1f80cf5b0 2024-09-11T23:26:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1f7e00640 1 -- 172.21.15.144:0/3917360316 >> v1:172.21.15.144:6789/0 conn(0x7fa1f80cf5b0 legacy=0x7fa1f8073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1f7e00640 1 --2- 172.21.15.144:0/3917360316 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1e00039b0 0x7fa1e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1f7e00640 1 --2- 172.21.15.144:0/3917360316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1e0004800 0x7fa1e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1f7e00640 1 --2- 172.21.15.144:0/3917360316 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1f80ce230 0x7fa1e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1f7e00640 1 -- 172.21.15.144:0/3917360316 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f8072640 con 0x7fa1e0004800 2024-09-11T23:26:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1f7e00640 1 -- 172.21.15.144:0/3917360316 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f8072920 con 0x7fa1e00039b0 2024-09-11T23:26:47.037 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1f7e00640 1 -- 172.21.15.144:0/3917360316 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e000fe50 con 0x7fa1f80ce230 2024-09-11T23:26:47.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1fcc00640 1 --2- 172.21.15.144:0/3917360316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1e0004800 0x7fa1e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1fd600640 1 --2- 172.21.15.144:0/3917360316 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1e00039b0 0x7fa1e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1fe000640 1 --2- 172.21.15.144:0/3917360316 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1f80ce230 0x7fa1e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1fcc00640 1 -- 172.21.15.144:0/3917360316 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1f80ce230 msgr2=0x7fa1e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:47.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1fcc00640 1 --2- 172.21.15.144:0/3917360316 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1f80ce230 0x7fa1e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1fcc00640 1 -- 172.21.15.144:0/3917360316 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1e00039b0 msgr2=0x7fa1e0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:47.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1fcc00640 1 --2- 172.21.15.144:0/3917360316 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1e00039b0 0x7fa1e0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.038 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.036+0000 7fa1fcc00640 1 -- 172.21.15.144:0/3917360316 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e0003520 con 0x7fa1e0004800 2024-09-11T23:26:47.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.037+0000 7fa1fcc00640 1 --2- 172.21.15.144:0/3917360316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1e0004800 0x7fa1e0004c80 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009a90 tx=0x7fa1e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289465e72b0b56b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:47.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.038+0000 7fa1f7e00640 1 -- 172.21.15.144:0/3917360316 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4036070 con 0x7fa1e0004800 2024-09-11T23:26:47.039 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.038+0000 7fa1f7e00640 1 -- 172.21.15.144:0/3917360316 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e4031400 con 0x7fa1e0004800 2024-09-11T23:26:47.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.038+0000 7fa1f7e00640 1 -- 172.21.15.144:0/3917360316 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4009690 con 0x7fa1e0004800 2024-09-11T23:26:47.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.038+0000 7fa200000640 1 -- 172.21.15.144:0/3917360316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1e0004800 msgr2=0x7fa1e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:47.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.038+0000 7fa200000640 1 --2- 172.21.15.144:0/3917360316 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1e0004800 0x7fa1e0004c80 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009a90 tx=0x7fa1e0005830 comp rx=0 tx=0).stop 2024-09-11T23:26:47.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.038+0000 7fa1fe000640 1 -- 172.21.15.144:0/3917360316 reap_dead start 2024-09-11T23:26:47.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.038+0000 7fa200000640 1 -- 172.21.15.144:0/3917360316 shutdown_connections 2024-09-11T23:26:47.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.038+0000 7fa200000640 1 -- 172.21.15.144:0/3917360316 >> 172.21.15.144:0/3917360316 conn(0x7fa1f8062cc0 msgr2=0x7fa1f806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:47.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.038+0000 7fa200000640 1 -- 172.21.15.144:0/3917360316 shutdown_connections 2024-09-11T23:26:47.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.038+0000 7fa200000640 1 -- 172.21.15.144:0/3917360316 wait complete. 2024-09-11T23:26:47.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.040+0000 7fa200000640 1 Processor -- start 2024-09-11T23:26:47.040 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.040+0000 7fa200000640 1 -- start start 2024-09-11T23:26:47.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.041+0000 7fa200000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1e0004800 0x7fa1f81517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.041+0000 7fa200000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f80b3340 0x7fa1f80b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.041+0000 7fa200000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1f80b3d00 0x7fa1f80b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.041+0000 7fa200000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f815c560 con 0x7fa1f80b3340 2024-09-11T23:26:47.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.041+0000 7fa200000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f80722f0 con 0x7fa1e0004800 2024-09-11T23:26:47.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.041+0000 7fa200000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f815c6e0 con 0x7fa1f80b3d00 2024-09-11T23:26:47.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.041+0000 7fa1fcc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f80b3340 0x7fa1f80b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.042 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.041+0000 7fa1fcc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f80b3340 0x7fa1f80b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34152/0 (socket says 172.21.15.144:34152) 2024-09-11T23:26:47.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.041+0000 7fa1fcc00640 1 -- 172.21.15.144:0/2510760485 learned_addr learned my addr 172.21.15.144:0/2510760485 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:47.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.041+0000 7fa1fd600640 1 --2- 172.21.15.144:0/2510760485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1e0004800 0x7fa1f81517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.041+0000 7fa1fe000640 1 --2- 172.21.15.144:0/2510760485 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1f80b3d00 0x7fa1f80b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.041+0000 7fa1fcc00640 1 -- 172.21.15.144:0/2510760485 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1f80b3d00 msgr2=0x7fa1f80b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:47.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.041+0000 7fa1fcc00640 1 --2- 172.21.15.144:0/2510760485 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1f80b3d00 0x7fa1f80b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.041+0000 7fa1fcc00640 1 -- 172.21.15.144:0/2510760485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1e0004800 msgr2=0x7fa1f81517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:47.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.041+0000 7fa1fcc00640 1 --2- 172.21.15.144:0/2510760485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1e0004800 0x7fa1f81517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.041+0000 7fa1fcc00640 1 -- 172.21.15.144:0/2510760485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f80b2800 con 0x7fa1f80b3340 2024-09-11T23:26:47.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.042+0000 7fa1fe000640 1 --2- 172.21.15.144:0/2510760485 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1f80b3d00 0x7fa1f80b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:47.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.042+0000 7fa1fcc00640 1 --2- 172.21.15.144:0/2510760485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f80b3340 0x7fa1f80b37c0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009bb0 tx=0x7fa1e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:47.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.042+0000 7fa1f5600640 1 -- 172.21.15.144:0/2510760485 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4040070 con 0x7fa1f80b3340 2024-09-11T23:26:47.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.042+0000 7fa1f5600640 1 -- 172.21.15.144:0/2510760485 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e403b460 con 0x7fa1f80b3340 2024-09-11T23:26:47.043 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.042+0000 7fa1f5600640 1 -- 172.21.15.144:0/2510760485 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4036040 con 0x7fa1f80b3340 2024-09-11T23:26:47.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.042+0000 7fa200000640 1 -- 172.21.15.144:0/2510760485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f8151d00 con 0x7fa1f80b3340 2024-09-11T23:26:47.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.042+0000 7fa200000640 1 -- 172.21.15.144:0/2510760485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f80b03e0 con 0x7fa1f80b3340 2024-09-11T23:26:47.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.043+0000 7fa200000640 1 -- 172.21.15.144:0/2510760485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1f80ce6a0 con 0x7fa1f80b3340 2024-09-11T23:26:47.044 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.044+0000 7fa1f5600640 1 -- 172.21.15.144:0/2510760485 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7fa1e4043070 con 0x7fa1f80b3340 2024-09-11T23:26:47.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.045+0000 7fa1f5600640 1 --2- 172.21.15.144:0/2510760485 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa1d806c9a0 0x7fa1d806ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.045+0000 7fa1f5600640 1 -- 172.21.15.144:0/2510760485 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7fa1e40aa110 con 0x7fa1f80b3340 2024-09-11T23:26:47.045 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.046+0000 7fa1fd600640 1 --2- 172.21.15.144:0/2510760485 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa1d806c9a0 0x7fa1d806ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.046 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.046+0000 7fa1fd600640 1 --2- 172.21.15.144:0/2510760485 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa1d806c9a0 0x7fa1d806ee60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa1f815dfc0 tx=0x7fa1ec008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:47.049 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.049+0000 7fa1f5600640 1 -- 172.21.15.144:0/2510760485 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa1e4079c70 con 0x7fa1f80b3340 2024-09-11T23:26:47.235 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.235+0000 7fa200000640 1 -- 172.21.15.144:0/2510760485 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa1f806d2d0 con 0x7fa1f80b3340 2024-09-11T23:26:47.236 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.236+0000 7fa1f5600640 1 -- 172.21.15.144:0/2510760485 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v166) ==== 80+0+0 (secure 0 0 0) 0x7fa1e407df70 con 0x7fa1f80b3340 2024-09-11T23:26:47.236 INFO:teuthology.orchestra.run.smithi144.stderr:listed 0 entries 2024-09-11T23:26:47.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.238+0000 7fa200000640 1 -- 172.21.15.144:0/2510760485 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa1d806c9a0 msgr2=0x7fa1d806ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:47.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.238+0000 7fa200000640 1 --2- 172.21.15.144:0/2510760485 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa1d806c9a0 0x7fa1d806ee60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa1f815dfc0 tx=0x7fa1ec008040 comp rx=0 tx=0).stop 2024-09-11T23:26:47.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.238+0000 7fa200000640 1 -- 172.21.15.144:0/2510760485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f80b3340 msgr2=0x7fa1f80b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:47.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.238+0000 7fa200000640 1 --2- 172.21.15.144:0/2510760485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f80b3340 0x7fa1f80b37c0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009bb0 tx=0x7fa1e4004730 comp rx=0 tx=0).stop 2024-09-11T23:26:47.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.238+0000 7fa200000640 1 -- 172.21.15.144:0/2510760485 shutdown_connections 2024-09-11T23:26:47.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.238+0000 7fa200000640 1 --2- 172.21.15.144:0/2510760485 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fa1d806c9a0 0x7fa1d806ee60 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.238+0000 7fa200000640 1 --2- 172.21.15.144:0/2510760485 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fa1f80b3d00 0x7fa1f80b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.238 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.238+0000 7fa200000640 1 --2- 172.21.15.144:0/2510760485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f80b3340 0x7fa1f80b37c0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.238+0000 7fa200000640 1 --2- 172.21.15.144:0/2510760485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa1e0004800 0x7fa1f81517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.238+0000 7fa200000640 1 -- 172.21.15.144:0/2510760485 >> 172.21.15.144:0/2510760485 conn(0x7fa1f8062cc0 msgr2=0x7fa1f8159960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:47.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.238+0000 7fa200000640 1 -- 172.21.15.144:0/2510760485 shutdown_connections 2024-09-11T23:26:47.239 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.238+0000 7fa200000640 1 -- 172.21.15.144:0/2510760485 wait complete. 2024-09-11T23:26:47.254 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-11T23:26:47.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:47.254 DEBUG:teuthology.orchestra.run.smithi165:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-11T23:26:47.316 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:26:47.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:47.317 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-11T23:26:47.352 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:26:47.353 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:26:47.353 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:47.389 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:26:47.389 INFO:tasks.cephfs.mount:Terminating background process 2024-09-11T23:26:47.389 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:26:47.389 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:47.428 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:26:47.429 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:26:47.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.583+0000 7effa9800640 1 Processor -- start 2024-09-11T23:26:47.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.583+0000 7effa9800640 1 -- start start 2024-09-11T23:26:47.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.585+0000 7effa9800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effa40d02a0 0x7effa40d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.585+0000 7effa9800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7effa415ca40 0x7effa415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.585+0000 7effa9800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa40d0bc0 con 0x7effa415ce80 2024-09-11T23:26:47.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.585+0000 7effa9800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7effa415d390 con 0x7effa415ca40 2024-09-11T23:26:47.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.585+0000 7effa9800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7effa415d670 con 0x7effa40d02a0 2024-09-11T23:26:47.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.585+0000 7eff9be00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7effa415ca40 0x7effa415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.585+0000 7effa2a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effa40d02a0 0x7effa40d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.585+0000 7eff9be00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7effa415ca40 0x7effa415e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:55462/0 (socket says 172.21.15.144:55462) 2024-09-11T23:26:47.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.585+0000 7eff9be00640 1 -- 172.21.15.144:0/3015111593 learned_addr learned my addr 172.21.15.144:0/3015111593 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:47.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.586+0000 7eff9be00640 1 -- 172.21.15.144:0/3015111593 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effa40d02a0 msgr2=0x7effa40d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:47.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.586+0000 7eff9be00640 1 --2- 172.21.15.144:0/3015111593 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effa40d02a0 0x7effa40d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.586+0000 7eff9be00640 1 -- 172.21.15.144:0/3015111593 >> v1:172.21.15.165:6789/0 conn(0x7effa415ce80 legacy=0x7effa41594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:47.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.586+0000 7eff9be00640 1 -- 172.21.15.144:0/3015111593 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa415d950 con 0x7effa415ca40 2024-09-11T23:26:47.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.586+0000 7effa2a00640 1 --2- 172.21.15.144:0/3015111593 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effa40d02a0 0x7effa40d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:26:47.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.586+0000 7effa2000640 1 -- 172.21.15.144:0/3015111593 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 251376777 0 0) 0x7effa40d0bc0 con 0x7effa415ce80 2024-09-11T23:26:47.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.587+0000 7eff9be00640 1 --2- 172.21.15.144:0/3015111593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effa415ca40 0x7effa415e430 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009870 tx=0x7eff8c02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d40b8d5134b0de0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:47.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.587+0000 7effa2000640 1 -- 172.21.15.144:0/3015111593 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c037070 con 0x7effa415ca40 2024-09-11T23:26:47.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.587+0000 7effa2000640 1 -- 172.21.15.144:0/3015111593 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff8c032440 con 0x7effa415ca40 2024-09-11T23:26:47.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.587+0000 7effa2000640 1 -- 172.21.15.144:0/3015111593 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c032810 con 0x7effa415ca40 2024-09-11T23:26:47.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.587+0000 7effa9800640 1 -- 172.21.15.144:0/3015111593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effa415ca40 msgr2=0x7effa415e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:47.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.587+0000 7effa9800640 1 --2- 172.21.15.144:0/3015111593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effa415ca40 0x7effa415e430 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7eff8c009870 tx=0x7eff8c02a1e0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.587+0000 7effa9800640 1 -- 172.21.15.144:0/3015111593 shutdown_connections 2024-09-11T23:26:47.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.587+0000 7effa9800640 1 --2- 172.21.15.144:0/3015111593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effa415ca40 0x7effa415e430 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.587+0000 7effa9800640 1 --2- 172.21.15.144:0/3015111593 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effa40d02a0 0x7effa40d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.587+0000 7effa9800640 1 -- 172.21.15.144:0/3015111593 >> 172.21.15.144:0/3015111593 conn(0x7effa4062cc0 msgr2=0x7effa406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:47.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.588+0000 7effa9800640 1 -- 172.21.15.144:0/3015111593 shutdown_connections 2024-09-11T23:26:47.588 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.588+0000 7effa9800640 1 -- 172.21.15.144:0/3015111593 wait complete. 2024-09-11T23:26:47.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.589+0000 7effa9800640 1 Processor -- start 2024-09-11T23:26:47.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.589+0000 7effa9800640 1 -- start start 2024-09-11T23:26:47.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.590+0000 7effa9800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effa40d02a0 0x7effa414c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.590+0000 7effa9800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effa415ca40 0x7effa4073650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.590+0000 7effa9800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effa415ce80 0x7effa40b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.590+0000 7effa9800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7effa4155b90 con 0x7effa415ca40 2024-09-11T23:26:47.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.590+0000 7effa9800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7effa415df10 con 0x7effa415ce80 2024-09-11T23:26:47.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.590+0000 7effa9800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7effa4155d10 con 0x7effa40d02a0 2024-09-11T23:26:47.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.591+0000 7eff9be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effa415ca40 0x7effa4073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.591+0000 7eff9be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effa415ca40 0x7effa4073650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34166/0 (socket says 172.21.15.144:34166) 2024-09-11T23:26:47.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.591+0000 7eff9be00640 1 -- 172.21.15.144:0/2896236171 learned_addr learned my addr 172.21.15.144:0/2896236171 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:47.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.591+0000 7effa2a00640 1 --2- 172.21.15.144:0/2896236171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effa40d02a0 0x7effa414c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.591+0000 7effa3400640 1 --2- 172.21.15.144:0/2896236171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effa415ce80 0x7effa40b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.591+0000 7eff9be00640 1 -- 172.21.15.144:0/2896236171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effa40d02a0 msgr2=0x7effa414c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:47.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.591+0000 7eff9be00640 1 --2- 172.21.15.144:0/2896236171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effa40d02a0 0x7effa414c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.591+0000 7eff9be00640 1 -- 172.21.15.144:0/2896236171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effa415ce80 msgr2=0x7effa40b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:47.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.591+0000 7eff9be00640 1 --2- 172.21.15.144:0/2896236171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effa415ce80 0x7effa40b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.591+0000 7eff9be00640 1 -- 172.21.15.144:0/2896236171 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa41577e0 con 0x7effa415ca40 2024-09-11T23:26:47.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.591+0000 7eff9be00640 1 --2- 172.21.15.144:0/2896236171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effa415ca40 0x7effa4073650 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7eff8c000c00 tx=0x7eff8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:47.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.592+0000 7eff9aa00640 1 -- 172.21.15.144:0/2896236171 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c037040 con 0x7effa415ca40 2024-09-11T23:26:47.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.592+0000 7eff9aa00640 1 -- 172.21.15.144:0/2896236171 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff8c042070 con 0x7effa415ca40 2024-09-11T23:26:47.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.592+0000 7eff9aa00640 1 -- 172.21.15.144:0/2896236171 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c030880 con 0x7effa415ca40 2024-09-11T23:26:47.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.592+0000 7effa9800640 1 -- 172.21.15.144:0/2896236171 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa4157ac0 con 0x7effa415ca40 2024-09-11T23:26:47.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.592+0000 7effa9800640 1 -- 172.21.15.144:0/2896236171 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa4158080 con 0x7effa415ca40 2024-09-11T23:26:47.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.593+0000 7effa9800640 1 -- 172.21.15.144:0/2896236171 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa40b4790 con 0x7effa415ca40 2024-09-11T23:26:47.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.594+0000 7eff9aa00640 1 -- 172.21.15.144:0/2896236171 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7eff8c030a20 con 0x7effa415ca40 2024-09-11T23:26:47.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.595+0000 7eff9aa00640 1 --2- 172.21.15.144:0/2896236171 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff8006c970 0x7eff8006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.595+0000 7eff9aa00640 1 -- 172.21.15.144:0/2896236171 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7eff8c0a9ee0 con 0x7effa415ca40 2024-09-11T23:26:47.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.595+0000 7effa2a00640 1 --2- 172.21.15.144:0/2896236171 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff8006c970 0x7eff8006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.596+0000 7effa2a00640 1 --2- 172.21.15.144:0/2896236171 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff8006c970 0x7eff8006ee30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7eff94009560 tx=0x7eff94009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:47.599 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.599+0000 7eff9aa00640 1 -- 172.21.15.144:0/2896236171 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7eff8c079c90 con 0x7effa415ca40 2024-09-11T23:26:47.810 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.810+0000 7effa9800640 1 -- 172.21.15.144:0/2896236171 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effa40d0a70 con 0x7effa415ca40 2024-09-11T23:26:47.811 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.811+0000 7eff9aa00640 1 -- 172.21.15.144:0/2896236171 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5242 (secure 0 0 0) 0x7eff8c07df90 con 0x7effa415ca40 2024-09-11T23:26:47.811 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:47.811 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":120,"btime":"2024-09-11T23:26:39:829063+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/4202069031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4202069031},{"type":"v1","addr":"172.21.15.144:6801","nonce":4202069031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":7331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1262024638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1262024638},{"type":"v1","addr":"172.21.15.144:6835","nonce":1262024638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8407,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2678086616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2678086616},{"type":"v1","addr":"172.21.15.165:6834","nonce":2678086616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:26:29.055590+0000","modified":"2024-09-11T23:26:32.086872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9015":{"gid":9015,"name":"b","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/862543799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":862543799},{"type":"v1","addr":"172.21.15.165:6835","nonce":862543799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9015,"qdb_cluster":[9015]},"id":13}]} 2024-09-11T23:26:47.811 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 120 2024-09-11T23:26:47.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.813+0000 7effa9800640 1 -- 172.21.15.144:0/2896236171 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff8006c970 msgr2=0x7eff8006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:47.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.813+0000 7effa9800640 1 --2- 172.21.15.144:0/2896236171 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff8006c970 0x7eff8006ee30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7eff94009560 tx=0x7eff94009190 comp rx=0 tx=0).stop 2024-09-11T23:26:47.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.813+0000 7effa9800640 1 -- 172.21.15.144:0/2896236171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effa415ca40 msgr2=0x7effa4073650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:47.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.813+0000 7effa9800640 1 --2- 172.21.15.144:0/2896236171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effa415ca40 0x7effa4073650 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7eff8c000c00 tx=0x7eff8c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.813 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.813+0000 7effa9800640 1 -- 172.21.15.144:0/2896236171 shutdown_connections 2024-09-11T23:26:47.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.813+0000 7effa9800640 1 --2- 172.21.15.144:0/2896236171 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff8006c970 0x7eff8006ee30 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.813+0000 7effa9800640 1 --2- 172.21.15.144:0/2896236171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effa415ce80 0x7effa40b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.813+0000 7effa9800640 1 --2- 172.21.15.144:0/2896236171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effa415ca40 0x7effa4073650 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.813+0000 7effa9800640 1 --2- 172.21.15.144:0/2896236171 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7effa40d02a0 0x7effa414c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.813+0000 7effa9800640 1 -- 172.21.15.144:0/2896236171 >> 172.21.15.144:0/2896236171 conn(0x7effa4062cc0 msgr2=0x7effa4154e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:47.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.813+0000 7effa9800640 1 -- 172.21.15.144:0/2896236171 shutdown_connections 2024-09-11T23:26:47.814 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.813+0000 7effa9800640 1 -- 172.21.15.144:0/2896236171 wait complete. 2024-09-11T23:26:47.830 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:26:47.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.983+0000 7f1d61200640 1 Processor -- start 2024-09-11T23:26:47.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.984+0000 7f1d61200640 1 -- start start 2024-09-11T23:26:47.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.985+0000 7f1d61200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d5c0d02a0 0x7f1d5c0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.985+0000 7f1d61200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1d5c15ca40 0x7f1d5c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.985+0000 7f1d61200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d5c0d0bc0 con 0x7f1d5c15ce80 2024-09-11T23:26:47.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.985+0000 7f1d61200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1d5c15d390 con 0x7f1d5c15ca40 2024-09-11T23:26:47.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.985+0000 7f1d61200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1d5c15d670 con 0x7f1d5c0d02a0 2024-09-11T23:26:47.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.985+0000 7f1d51400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1d5c15ca40 0x7f1d5c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.985+0000 7f1d59e00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d5c0d02a0 0x7f1d5c0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.985+0000 7f1d51400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1d5c15ca40 0x7f1d5c15e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:55484/0 (socket says 172.21.15.144:55484) 2024-09-11T23:26:47.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.985+0000 7f1d51400640 1 -- 172.21.15.144:0/480020405 learned_addr learned my addr 172.21.15.144:0/480020405 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:47.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.986+0000 7f1d59400640 1 -- 172.21.15.144:0/480020405 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 144843940 0 0) 0x7f1d5c0d0bc0 con 0x7f1d5c15ce80 2024-09-11T23:26:47.986 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.986+0000 7f1d59400640 1 -- 172.21.15.144:0/480020405 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d40003520 con 0x7f1d5c15ce80 2024-09-11T23:26:47.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.986+0000 7f1d51400640 1 -- 172.21.15.144:0/480020405 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d5c0d02a0 msgr2=0x7f1d5c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:47.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.986+0000 7f1d51400640 1 --2- 172.21.15.144:0/480020405 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d5c0d02a0 0x7f1d5c0d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.986+0000 7f1d51400640 1 -- 172.21.15.144:0/480020405 >> v1:172.21.15.165:6789/0 conn(0x7f1d5c15ce80 legacy=0x7f1d5c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:47.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.986+0000 7f1d51400640 1 -- 172.21.15.144:0/480020405 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5c15d950 con 0x7f1d5c15ca40 2024-09-11T23:26:47.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.986+0000 7f1d59e00640 1 --2- 172.21.15.144:0/480020405 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d5c0d02a0 0x7f1d5c0d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:26:47.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.987+0000 7f1d51400640 1 --2- 172.21.15.144:0/480020405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d5c15ca40 0x7f1d5c15e430 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1d44009870 tx=0x7f1d4402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=975e1eeaeb0997bd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:47.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.987+0000 7f1d59400640 1 -- 172.21.15.144:0/480020405 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44037070 con 0x7f1d5c15ca40 2024-09-11T23:26:47.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.987+0000 7f1d59400640 1 -- 172.21.15.144:0/480020405 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d44032440 con 0x7f1d5c15ca40 2024-09-11T23:26:47.987 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.987+0000 7f1d59400640 1 -- 172.21.15.144:0/480020405 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44032810 con 0x7f1d5c15ca40 2024-09-11T23:26:47.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.987+0000 7f1d61200640 1 -- 172.21.15.144:0/480020405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d5c15ca40 msgr2=0x7f1d5c15e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:47.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.987+0000 7f1d61200640 1 --2- 172.21.15.144:0/480020405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d5c15ca40 0x7f1d5c15e430 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1d44009870 tx=0x7f1d4402a1c0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.987+0000 7f1d61200640 1 -- 172.21.15.144:0/480020405 shutdown_connections 2024-09-11T23:26:47.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.987+0000 7f1d61200640 1 --2- 172.21.15.144:0/480020405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d5c15ca40 0x7f1d5c15e430 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.987+0000 7f1d61200640 1 --2- 172.21.15.144:0/480020405 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d5c0d02a0 0x7f1d5c0d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.987+0000 7f1d61200640 1 -- 172.21.15.144:0/480020405 >> 172.21.15.144:0/480020405 conn(0x7f1d5c062cc0 msgr2=0x7f1d5c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:47.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.988+0000 7f1d61200640 1 -- 172.21.15.144:0/480020405 shutdown_connections 2024-09-11T23:26:47.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.988+0000 7f1d61200640 1 -- 172.21.15.144:0/480020405 wait complete. 2024-09-11T23:26:47.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.989+0000 7f1d61200640 1 Processor -- start 2024-09-11T23:26:47.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.989+0000 7f1d61200640 1 -- start start 2024-09-11T23:26:47.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.990+0000 7f1d61200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d5c0d02a0 0x7f1d5c14cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.990 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.990+0000 7f1d61200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d5c15ca40 0x7f1d5c071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.990+0000 7f1d61200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d5c15ce80 0x7f1d5c1515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.990+0000 7f1d61200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c155b90 con 0x7f1d5c0d02a0 2024-09-11T23:26:47.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.990+0000 7f1d61200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c15df10 con 0x7f1d5c15ce80 2024-09-11T23:26:47.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.990+0000 7f1d61200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1d5c155d10 con 0x7f1d5c15ca40 2024-09-11T23:26:47.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.990+0000 7f1d59e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d5c0d02a0 0x7f1d5c14cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.990+0000 7f1d51400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d5c15ca40 0x7f1d5c071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.990+0000 7f1d59e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d5c0d02a0 0x7f1d5c14cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34180/0 (socket says 172.21.15.144:34180) 2024-09-11T23:26:47.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.991+0000 7f1d59e00640 1 -- 172.21.15.144:0/3201851055 learned_addr learned my addr 172.21.15.144:0/3201851055 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:47.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.991+0000 7f1d5a800640 1 --2- 172.21.15.144:0/3201851055 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d5c15ce80 0x7f1d5c1515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.991+0000 7f1d51400640 1 -- 172.21.15.144:0/3201851055 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d5c15ce80 msgr2=0x7f1d5c1515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:47.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.991+0000 7f1d51400640 1 --2- 172.21.15.144:0/3201851055 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d5c15ce80 0x7f1d5c1515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.991 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.991+0000 7f1d51400640 1 -- 172.21.15.144:0/3201851055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d5c0d02a0 msgr2=0x7f1d5c14cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:47.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.991+0000 7f1d51400640 1 --2- 172.21.15.144:0/3201851055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d5c0d02a0 0x7f1d5c14cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:47.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.991+0000 7f1d51400640 1 -- 172.21.15.144:0/3201851055 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5c071970 con 0x7f1d5c15ca40 2024-09-11T23:26:47.992 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.991+0000 7f1d59e00640 1 --2- 172.21.15.144:0/3201851055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d5c0d02a0 0x7f1d5c14cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:26:47.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.991+0000 7f1d51400640 1 --2- 172.21.15.144:0/3201851055 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d5c15ca40 0x7f1d5c071070 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1d44031000 tx=0x7f1d440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:47.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.992+0000 7f1d52a00640 1 -- 172.21.15.144:0/3201851055 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44041020 con 0x7f1d5c15ca40 2024-09-11T23:26:47.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.992+0000 7f1d52a00640 1 -- 172.21.15.144:0/3201851055 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4403d640 con 0x7f1d5c15ca40 2024-09-11T23:26:47.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.992+0000 7f1d52a00640 1 -- 172.21.15.144:0/3201851055 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44037040 con 0x7f1d5c15ca40 2024-09-11T23:26:47.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.992+0000 7f1d61200640 1 -- 172.21.15.144:0/3201851055 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d5c071c50 con 0x7f1d5c15ca40 2024-09-11T23:26:47.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.992+0000 7f1d61200640 1 -- 172.21.15.144:0/3201851055 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d5c072210 con 0x7f1d5c15ca40 2024-09-11T23:26:47.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.993+0000 7f1d61200640 1 -- 172.21.15.144:0/3201851055 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d5c14e5a0 con 0x7f1d5c15ca40 2024-09-11T23:26:47.993 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.994+0000 7f1d52a00640 1 -- 172.21.15.144:0/3201851055 <== mon.2 v2:172.21.15.165:3301/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f1d44044020 con 0x7f1d5c15ca40 2024-09-11T23:26:47.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.994+0000 7f1d52a00640 1 --2- 172.21.15.144:0/3201851055 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1d3806c970 0x7f1d3806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:47.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.994+0000 7f1d52a00640 1 -- 172.21.15.144:0/3201851055 <== mon.2 v2:172.21.15.165:3301/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f1d440a9d10 con 0x7f1d5c15ca40 2024-09-11T23:26:47.994 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.995+0000 7f1d59e00640 1 --2- 172.21.15.144:0/3201851055 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1d3806c970 0x7f1d3806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:47.995 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.995+0000 7f1d59e00640 1 --2- 172.21.15.144:0/3201851055 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1d3806c970 0x7f1d3806ee30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0095e0 tx=0x7f1d4c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:47.998 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:47.999+0000 7f1d52a00640 1 -- 172.21.15.144:0/3201851055 <== mon.2 v2:172.21.15.165:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1d5c14e5a0 con 0x7f1d5c15ca40 2024-09-11T23:26:48.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.205+0000 7f1d61200640 1 -- 172.21.15.144:0/3201851055 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d5c0b4790 con 0x7f1d5c15ca40 2024-09-11T23:26:48.205 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.206+0000 7f1d52a00640 1 -- 172.21.15.144:0/3201851055 <== mon.2 v2:172.21.15.165:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5242 (secure 0 0 0) 0x7f1d4404b030 con 0x7f1d5c15ca40 2024-09-11T23:26:48.206 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:48.206 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":120,"btime":"2024-09-11T23:26:39:829063+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/4202069031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4202069031},{"type":"v1","addr":"172.21.15.144:6801","nonce":4202069031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":7331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1262024638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1262024638},{"type":"v1","addr":"172.21.15.144:6835","nonce":1262024638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8407,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2678086616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2678086616},{"type":"v1","addr":"172.21.15.165:6834","nonce":2678086616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:26:29.055590+0000","modified":"2024-09-11T23:26:32.086872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9015":{"gid":9015,"name":"b","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/862543799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":862543799},{"type":"v1","addr":"172.21.15.165:6835","nonce":862543799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9015,"qdb_cluster":[9015]},"id":13}]} 2024-09-11T23:26:48.206 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 120 2024-09-11T23:26:48.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.208+0000 7f1d61200640 1 -- 172.21.15.144:0/3201851055 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1d3806c970 msgr2=0x7f1d3806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:48.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.208+0000 7f1d61200640 1 --2- 172.21.15.144:0/3201851055 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1d3806c970 0x7f1d3806ee30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0095e0 tx=0x7f1d4c009190 comp rx=0 tx=0).stop 2024-09-11T23:26:48.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.208+0000 7f1d61200640 1 -- 172.21.15.144:0/3201851055 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d5c15ca40 msgr2=0x7f1d5c071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:48.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.208+0000 7f1d61200640 1 --2- 172.21.15.144:0/3201851055 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d5c15ca40 0x7f1d5c071070 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1d44031000 tx=0x7f1d440046c0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.208+0000 7f1d61200640 1 -- 172.21.15.144:0/3201851055 shutdown_connections 2024-09-11T23:26:48.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.208+0000 7f1d61200640 1 --2- 172.21.15.144:0/3201851055 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1d3806c970 0x7f1d3806ee30 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.208+0000 7f1d61200640 1 --2- 172.21.15.144:0/3201851055 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d5c15ce80 0x7f1d5c1515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.208+0000 7f1d61200640 1 --2- 172.21.15.144:0/3201851055 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1d5c15ca40 0x7f1d5c071070 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.208+0000 7f1d61200640 1 --2- 172.21.15.144:0/3201851055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1d5c0d02a0 0x7f1d5c14cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.208+0000 7f1d61200640 1 -- 172.21.15.144:0/3201851055 >> 172.21.15.144:0/3201851055 conn(0x7f1d5c062cc0 msgr2=0x7f1d5c150e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:48.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.208+0000 7f1d61200640 1 -- 172.21.15.144:0/3201851055 shutdown_connections 2024-09-11T23:26:48.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.208+0000 7f1d61200640 1 -- 172.21.15.144:0/3201851055 wait complete. 2024-09-11T23:26:48.224 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:26:48.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.394+0000 7fd522a00640 1 Processor -- start 2024-09-11T23:26:48.394 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.394+0000 7fd522a00640 1 -- start start 2024-09-11T23:26:48.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.395+0000 7fd522a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fd51c15ceb0 0x7fd51c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:48.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.395+0000 7fd522a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd51c15d390 con 0x7fd51c0d02a0 2024-09-11T23:26:48.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.395+0000 7fd522a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd51c15d670 con 0x7fd51c15ca40 2024-09-11T23:26:48.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.395+0000 7fd522a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fd51c15d950 con 0x7fd51c15ceb0 2024-09-11T23:26:48.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.395+0000 7fd51be00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fd51c0d02a0 0x7fd51c0d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43708/0 (socket says 172.21.15.144:43708) 2024-09-11T23:26:48.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.395+0000 7fd51be00640 1 -- 172.21.15.144:0/2695620487 learned_addr learned my addr 172.21.15.144:0/2695620487 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:48.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.396+0000 7fd520a00640 1 --2- 172.21.15.144:0/2695620487 >> v2:172.21.15.165:3300/0 conn(0x7fd51c15ceb0 0x7fd51c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:48.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.396+0000 7fd51aa00640 1 -- 172.21.15.144:0/2695620487 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4015976179 0 0) 0x7fd51c15d390 con 0x7fd51c0d02a0 2024-09-11T23:26:48.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.396+0000 7fd51aa00640 1 -- 172.21.15.144:0/2695620487 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd500003520 con 0x7fd51c0d02a0 2024-09-11T23:26:48.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.396+0000 7fd51aa00640 1 -- 172.21.15.144:0/2695620487 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3783874186 0 0) 0x7fd51c15d670 con 0x7fd51c15ca40 2024-09-11T23:26:48.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.396+0000 7fd51aa00640 1 -- 172.21.15.144:0/2695620487 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd51c15d390 con 0x7fd51c15ca40 2024-09-11T23:26:48.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.396+0000 7fd520a00640 1 -- 172.21.15.144:0/2695620487 >> v1:172.21.15.165:6789/0 conn(0x7fd51c15ca40 legacy=0x7fd51c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:48.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.396+0000 7fd520a00640 1 -- 172.21.15.144:0/2695620487 >> v1:172.21.15.144:6789/0 conn(0x7fd51c0d02a0 legacy=0x7fd51c0d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:48.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.396+0000 7fd520a00640 1 -- 172.21.15.144:0/2695620487 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd51c15dc30 con 0x7fd51c15ceb0 2024-09-11T23:26:48.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.397+0000 7fd520a00640 1 --2- 172.21.15.144:0/2695620487 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd51c15ceb0 0x7fd51c1594c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd514009d90 tx=0x7fd51402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cc390cc03a1f6c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:48.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.397+0000 7fd51aa00640 1 -- 172.21.15.144:0/2695620487 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd514007740 con 0x7fd51c15ceb0 2024-09-11T23:26:48.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.397+0000 7fd51aa00640 1 -- 172.21.15.144:0/2695620487 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5140078e0 con 0x7fd51c15ceb0 2024-09-11T23:26:48.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.397+0000 7fd51aa00640 1 -- 172.21.15.144:0/2695620487 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd514007cb0 con 0x7fd51c15ceb0 2024-09-11T23:26:48.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.398+0000 7fd522a00640 1 -- 172.21.15.144:0/2695620487 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd51c15ceb0 msgr2=0x7fd51c1594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:48.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.398+0000 7fd522a00640 1 --2- 172.21.15.144:0/2695620487 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd51c15ceb0 0x7fd51c1594c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd514009d90 tx=0x7fd51402a660 comp rx=0 tx=0).stop 2024-09-11T23:26:48.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.398+0000 7fd522a00640 1 -- 172.21.15.144:0/2695620487 shutdown_connections 2024-09-11T23:26:48.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.398+0000 7fd522a00640 1 --2- 172.21.15.144:0/2695620487 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd51c15ceb0 0x7fd51c1594c0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.398+0000 7fd522a00640 1 -- 172.21.15.144:0/2695620487 >> 172.21.15.144:0/2695620487 conn(0x7fd51c062cc0 msgr2=0x7fd51c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:48.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.398+0000 7fd522a00640 1 -- 172.21.15.144:0/2695620487 shutdown_connections 2024-09-11T23:26:48.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.398+0000 7fd522a00640 1 -- 172.21.15.144:0/2695620487 wait complete. 2024-09-11T23:26:48.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.400+0000 7fd522a00640 1 Processor -- start 2024-09-11T23:26:48.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.400+0000 7fd522a00640 1 -- start start 2024-09-11T23:26:48.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.401+0000 7fd522a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd51c0d02a0 0x7fd51c157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:48.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.401+0000 7fd522a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd51c15ca40 0x7fd51c15a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:48.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.401+0000 7fd522a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd51c15ceb0 0x7fd51c072610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:48.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.401+0000 7fd522a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd51c155b90 con 0x7fd51c0d02a0 2024-09-11T23:26:48.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.401+0000 7fd522a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd51c15eb40 con 0x7fd51c15ceb0 2024-09-11T23:26:48.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.401+0000 7fd522a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fd51c155d10 con 0x7fd51c15ca40 2024-09-11T23:26:48.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.401+0000 7fd51be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd51c0d02a0 0x7fd51c157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:48.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.401+0000 7fd51be00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd51c0d02a0 0x7fd51c157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34192/0 (socket says 172.21.15.144:34192) 2024-09-11T23:26:48.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.401+0000 7fd51be00640 1 -- 172.21.15.144:0/608830589 learned_addr learned my addr 172.21.15.144:0/608830589 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:48.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.401+0000 7fd520a00640 1 --2- 172.21.15.144:0/608830589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd51c15ceb0 0x7fd51c072610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:48.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.401+0000 7fd51b400640 1 --2- 172.21.15.144:0/608830589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd51c15ca40 0x7fd51c15a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:48.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.401+0000 7fd51be00640 1 -- 172.21.15.144:0/608830589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd51c15ca40 msgr2=0x7fd51c15a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:48.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.401+0000 7fd51be00640 1 --2- 172.21.15.144:0/608830589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd51c15ca40 0x7fd51c15a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.401+0000 7fd51be00640 1 -- 172.21.15.144:0/608830589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd51c15ceb0 msgr2=0x7fd51c072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:48.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.401+0000 7fd51be00640 1 --2- 172.21.15.144:0/608830589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd51c15ceb0 0x7fd51c072610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.401+0000 7fd51be00640 1 -- 172.21.15.144:0/608830589 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd51c071570 con 0x7fd51c0d02a0 2024-09-11T23:26:48.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.402+0000 7fd51be00640 1 --2- 172.21.15.144:0/608830589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd51c0d02a0 0x7fd51c157830 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00c500 tx=0x7fd50c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:48.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.402+0000 7fd513e00640 1 -- 172.21.15.144:0/608830589 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c017070 con 0x7fd51c0d02a0 2024-09-11T23:26:48.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.402+0000 7fd513e00640 1 -- 172.21.15.144:0/608830589 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd50c005ce0 con 0x7fd51c0d02a0 2024-09-11T23:26:48.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.402+0000 7fd513e00640 1 -- 172.21.15.144:0/608830589 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50c0072f0 con 0x7fd51c0d02a0 2024-09-11T23:26:48.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.402+0000 7fd522a00640 1 -- 172.21.15.144:0/608830589 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd51c071850 con 0x7fd51c0d02a0 2024-09-11T23:26:48.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.402+0000 7fd522a00640 1 -- 172.21.15.144:0/608830589 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd51c071e10 con 0x7fd51c0d02a0 2024-09-11T23:26:48.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.403+0000 7fd522a00640 1 -- 172.21.15.144:0/608830589 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd51c072300 con 0x7fd51c0d02a0 2024-09-11T23:26:48.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.404+0000 7fd513e00640 1 -- 172.21.15.144:0/608830589 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7fd50c01a070 con 0x7fd51c0d02a0 2024-09-11T23:26:48.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.405+0000 7fd513e00640 1 --2- 172.21.15.144:0/608830589 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd4fc06c970 0x7fd4fc06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:48.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.405+0000 7fd513e00640 1 -- 172.21.15.144:0/608830589 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7fd50c088dd0 con 0x7fd51c0d02a0 2024-09-11T23:26:48.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.405+0000 7fd51b400640 1 --2- 172.21.15.144:0/608830589 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd4fc06c970 0x7fd4fc06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:48.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.406+0000 7fd51b400640 1 --2- 172.21.15.144:0/608830589 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd4fc06c970 0x7fd4fc06ee30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd51c159090 tx=0x7fd508009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:48.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.409+0000 7fd513e00640 1 -- 172.21.15.144:0/608830589 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd50c058930 con 0x7fd51c0d02a0 2024-09-11T23:26:48.585 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.586+0000 7fd522a00640 1 -- 172.21.15.144:0/608830589 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd51c0b4790 con 0x7fd51c0d02a0 2024-09-11T23:26:48.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.587+0000 7fd513e00640 1 -- 172.21.15.144:0/608830589 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) ==== 74+0+16767 (secure 0 0 0) 0x7fd50c05cc30 con 0x7fd51c0d02a0 2024-09-11T23:26:48.587 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:48.587 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":166,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:26:30.661485+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:26:26.828432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-11T23:26:28.054488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:26:48.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.589+0000 7fd522a00640 1 -- 172.21.15.144:0/608830589 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd4fc06c970 msgr2=0x7fd4fc06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:48.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.589+0000 7fd522a00640 1 --2- 172.21.15.144:0/608830589 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd4fc06c970 0x7fd4fc06ee30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd51c159090 tx=0x7fd508009040 comp rx=0 tx=0).stop 2024-09-11T23:26:48.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.589+0000 7fd522a00640 1 -- 172.21.15.144:0/608830589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd51c0d02a0 msgr2=0x7fd51c157830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:48.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.589+0000 7fd522a00640 1 --2- 172.21.15.144:0/608830589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd51c0d02a0 0x7fd51c157830 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00c500 tx=0x7fd50c00c9c0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.589+0000 7fd522a00640 1 -- 172.21.15.144:0/608830589 shutdown_connections 2024-09-11T23:26:48.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.589+0000 7fd522a00640 1 --2- 172.21.15.144:0/608830589 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fd4fc06c970 0x7fd4fc06ee30 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.589+0000 7fd522a00640 1 --2- 172.21.15.144:0/608830589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd51c15ceb0 0x7fd51c072610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.589+0000 7fd522a00640 1 --2- 172.21.15.144:0/608830589 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fd51c15ca40 0x7fd51c15a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.589+0000 7fd522a00640 1 --2- 172.21.15.144:0/608830589 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd51c0d02a0 0x7fd51c157830 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.589+0000 7fd522a00640 1 -- 172.21.15.144:0/608830589 >> 172.21.15.144:0/608830589 conn(0x7fd51c062cc0 msgr2=0x7fd51c153890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:48.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.589+0000 7fd522a00640 1 -- 172.21.15.144:0/608830589 shutdown_connections 2024-09-11T23:26:48.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.589+0000 7fd522a00640 1 -- 172.21.15.144:0/608830589 wait complete. 2024-09-11T23:26:48.606 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:26:48.606 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:26:48.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.760+0000 7f597ec00640 1 Processor -- start 2024-09-11T23:26:48.760 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.761+0000 7f597ec00640 1 -- start start 2024-09-11T23:26:48.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.762+0000 7f597ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f597815ca40 0x7f597815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:48.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.762+0000 7f597ec00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f597815ce80 0x7f59781594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:48.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.762+0000 7f597ec00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f597815d390 con 0x7f59780d02a0 2024-09-11T23:26:48.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.762+0000 7f597ec00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f597815d670 con 0x7f597815ce80 2024-09-11T23:26:48.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.762+0000 7f597ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f597815d950 con 0x7f597815ca40 2024-09-11T23:26:48.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.762+0000 7f597cc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f597815ce80 0x7f59781594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:48.762 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.762+0000 7f597cc00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f597815ce80 0x7f59781594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34198/0 (socket says 172.21.15.144:34198) 2024-09-11T23:26:48.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.762+0000 7f597cc00640 1 -- 172.21.15.144:0/128767452 learned_addr learned my addr 172.21.15.144:0/128767452 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:48.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.762+0000 7f5977400640 1 --2- 172.21.15.144:0/128767452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f597815ca40 0x7f597815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:48.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.762+0000 7f597cc00640 1 -- 172.21.15.144:0/128767452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f597815ca40 msgr2=0x7f597815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:48.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.762+0000 7f597cc00640 1 --2- 172.21.15.144:0/128767452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f597815ca40 0x7f597815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.763+0000 7f597cc00640 1 -- 172.21.15.144:0/128767452 >> v1:172.21.15.165:6789/0 conn(0x7f59780d02a0 legacy=0x7f59780d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:48.763 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.763+0000 7f597cc00640 1 -- 172.21.15.144:0/128767452 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597815dc30 con 0x7f597815ce80 2024-09-11T23:26:48.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.763+0000 7f597cc00640 1 --2- 172.21.15.144:0/128767452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f597815ce80 0x7f59781594c0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f5970009870 tx=0x7f597002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2831c6c919a64c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:48.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.764+0000 7f5976a00640 1 -- 172.21.15.144:0/128767452 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970037070 con 0x7f597815ce80 2024-09-11T23:26:48.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.764+0000 7f5976a00640 1 -- 172.21.15.144:0/128767452 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5970032440 con 0x7f597815ce80 2024-09-11T23:26:48.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.764+0000 7f5976a00640 1 -- 172.21.15.144:0/128767452 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970032810 con 0x7f597815ce80 2024-09-11T23:26:48.764 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.764+0000 7f597ec00640 1 -- 172.21.15.144:0/128767452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f597815ce80 msgr2=0x7f59781594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:48.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.764+0000 7f597ec00640 1 --2- 172.21.15.144:0/128767452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f597815ce80 0x7f59781594c0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f5970009870 tx=0x7f597002a1c0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.764+0000 7f597ec00640 1 -- 172.21.15.144:0/128767452 shutdown_connections 2024-09-11T23:26:48.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.764+0000 7f597ec00640 1 --2- 172.21.15.144:0/128767452 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f597815ce80 0x7f59781594c0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.764+0000 7f597ec00640 1 --2- 172.21.15.144:0/128767452 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f597815ca40 0x7f597815e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.764+0000 7f597ec00640 1 -- 172.21.15.144:0/128767452 >> 172.21.15.144:0/128767452 conn(0x7f5978062cc0 msgr2=0x7f597806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:48.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.764+0000 7f597ec00640 1 -- 172.21.15.144:0/128767452 shutdown_connections 2024-09-11T23:26:48.765 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.764+0000 7f597ec00640 1 -- 172.21.15.144:0/128767452 wait complete. 2024-09-11T23:26:48.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.766+0000 7f597ec00640 1 Processor -- start 2024-09-11T23:26:48.766 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.766+0000 7f597ec00640 1 -- start start 2024-09-11T23:26:48.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.767+0000 7f597ec00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59780d02a0 0x7f597814cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:48.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.767+0000 7f597ec00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f597815ca40 0x7f597814d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:48.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.767+0000 7f597ec00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f597815ce80 0x7f597814dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:48.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.767+0000 7f597ec00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5978155d10 con 0x7f597815ca40 2024-09-11T23:26:48.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.767+0000 7f597ec00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5978155b90 con 0x7f597815ce80 2024-09-11T23:26:48.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.767+0000 7f597ec00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f59780b4790 con 0x7f59780d02a0 2024-09-11T23:26:48.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.767+0000 7f5977400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f597815ca40 0x7f597814d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:48.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.767+0000 7f5977400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f597815ca40 0x7f597814d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34208/0 (socket says 172.21.15.144:34208) 2024-09-11T23:26:48.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.767+0000 7f5977400640 1 -- 172.21.15.144:0/3174451069 learned_addr learned my addr 172.21.15.144:0/3174451069 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:48.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.767+0000 7f597cc00640 1 --2- 172.21.15.144:0/3174451069 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f597815ce80 0x7f597814dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:48.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.767+0000 7f5977e00640 1 --2- 172.21.15.144:0/3174451069 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59780d02a0 0x7f597814cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:48.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.768+0000 7f5977400640 1 -- 172.21.15.144:0/3174451069 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59780d02a0 msgr2=0x7f597814cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:48.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.768+0000 7f5977400640 1 --2- 172.21.15.144:0/3174451069 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59780d02a0 0x7f597814cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.768+0000 7f5977400640 1 -- 172.21.15.144:0/3174451069 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f597815ce80 msgr2=0x7f597814dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:48.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.768+0000 7f5977400640 1 --2- 172.21.15.144:0/3174451069 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f597815ce80 0x7f597814dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.768+0000 7f5977400640 1 -- 172.21.15.144:0/3174451069 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5978158880 con 0x7f597815ca40 2024-09-11T23:26:48.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.768+0000 7f5977e00640 1 --2- 172.21.15.144:0/3174451069 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59780d02a0 0x7f597814cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:48.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.768+0000 7f5977400640 1 --2- 172.21.15.144:0/3174451069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f597815ca40 0x7f597814d690 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f596400e9b0 tx=0x7f596400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:48.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.768+0000 7f596fe00640 1 -- 172.21.15.144:0/3174451069 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964017070 con 0x7f597815ca40 2024-09-11T23:26:48.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.768+0000 7f596fe00640 1 -- 172.21.15.144:0/3174451069 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f596400c9a0 con 0x7f597815ca40 2024-09-11T23:26:48.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.768+0000 7f597ec00640 1 -- 172.21.15.144:0/3174451069 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59780b0960 con 0x7f597815ca40 2024-09-11T23:26:48.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.768+0000 7f596fe00640 1 -- 172.21.15.144:0/3174451069 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596400cd90 con 0x7f597815ca40 2024-09-11T23:26:48.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.768+0000 7f597ec00640 1 -- 172.21.15.144:0/3174451069 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59780b0f20 con 0x7f597815ca40 2024-09-11T23:26:48.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.769+0000 7f597ec00640 1 -- 172.21.15.144:0/3174451069 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59780d0680 con 0x7f597815ca40 2024-09-11T23:26:48.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.770+0000 7f596fe00640 1 -- 172.21.15.144:0/3174451069 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f596401a070 con 0x7f597815ca40 2024-09-11T23:26:48.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.771+0000 7f596fe00640 1 --2- 172.21.15.144:0/3174451069 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f595806c970 0x7f595806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:48.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.771+0000 7f596fe00640 1 -- 172.21.15.144:0/3174451069 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f5964089aa0 con 0x7f597815ca40 2024-09-11T23:26:48.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.771+0000 7f5977e00640 1 --2- 172.21.15.144:0/3174451069 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f595806c970 0x7f595806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:48.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.772+0000 7f5977e00640 1 --2- 172.21.15.144:0/3174451069 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f595806c970 0x7f595806ee30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5968001d60 tx=0x7f5968009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:48.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.776+0000 7f596fe00640 1 -- 172.21.15.144:0/3174451069 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5964059540 con 0x7f597815ca40 2024-09-11T23:26:48.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.985+0000 7f597ec00640 1 -- 172.21.15.144:0/3174451069 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59781548b0 con 0x7f597815ca40 2024-09-11T23:26:48.985 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.986+0000 7f596fe00640 1 -- 172.21.15.144:0/3174451069 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5242 (secure 0 0 0) 0x7f596405d840 con 0x7f597815ca40 2024-09-11T23:26:48.986 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:48.986 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":120,"btime":"2024-09-11T23:26:39:829063+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/4202069031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4202069031},{"type":"v1","addr":"172.21.15.144:6801","nonce":4202069031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":7331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1262024638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1262024638},{"type":"v1","addr":"172.21.15.144:6835","nonce":1262024638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8407,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2678086616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2678086616},{"type":"v1","addr":"172.21.15.165:6834","nonce":2678086616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:26:29.055590+0000","modified":"2024-09-11T23:26:32.086872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9015":{"gid":9015,"name":"b","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/862543799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":862543799},{"type":"v1","addr":"172.21.15.165:6835","nonce":862543799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9015,"qdb_cluster":[9015]},"id":13}]} 2024-09-11T23:26:48.986 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 120 2024-09-11T23:26:48.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.988+0000 7f597ec00640 1 -- 172.21.15.144:0/3174451069 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f595806c970 msgr2=0x7f595806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:48.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.988+0000 7f597ec00640 1 --2- 172.21.15.144:0/3174451069 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f595806c970 0x7f595806ee30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5968001d60 tx=0x7f5968009040 comp rx=0 tx=0).stop 2024-09-11T23:26:48.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.988+0000 7f597ec00640 1 -- 172.21.15.144:0/3174451069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f597815ca40 msgr2=0x7f597814d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:48.988 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.988+0000 7f597ec00640 1 --2- 172.21.15.144:0/3174451069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f597815ca40 0x7f597814d690 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f596400e9b0 tx=0x7f596400ee70 comp rx=0 tx=0).stop 2024-09-11T23:26:48.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.988+0000 7f597ec00640 1 -- 172.21.15.144:0/3174451069 shutdown_connections 2024-09-11T23:26:48.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.988+0000 7f597ec00640 1 --2- 172.21.15.144:0/3174451069 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f595806c970 0x7f595806ee30 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.988+0000 7f597ec00640 1 --2- 172.21.15.144:0/3174451069 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f597815ce80 0x7f597814dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.988+0000 7f597ec00640 1 --2- 172.21.15.144:0/3174451069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f597815ca40 0x7f597814d690 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.988+0000 7f597ec00640 1 --2- 172.21.15.144:0/3174451069 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f59780d02a0 0x7f597814cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:48.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.988+0000 7f597ec00640 1 -- 172.21.15.144:0/3174451069 >> 172.21.15.144:0/3174451069 conn(0x7f5978062cc0 msgr2=0x7f59780ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:48.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.988+0000 7f597ec00640 1 -- 172.21.15.144:0/3174451069 shutdown_connections 2024-09-11T23:26:48.989 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:48.988+0000 7f597ec00640 1 -- 172.21.15.144:0/3174451069 wait complete. 2024-09-11T23:26:49.005 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:26:49.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.158+0000 7f0109200640 1 Processor -- start 2024-09-11T23:26:49.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.159+0000 7f0109200640 1 -- start start 2024-09-11T23:26:49.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.160+0000 7f0109200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f01040cf070 0x7f01040cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.160+0000 7f0109200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0104073120 0x7f01040735b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.160+0000 7f0109200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01040ce740 con 0x7f010415c180 2024-09-11T23:26:49.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.160+0000 7f0109200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f0104072640 con 0x7f01040cf070 2024-09-11T23:26:49.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.160+0000 7f0109200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f0104072920 con 0x7f0104073120 2024-09-11T23:26:49.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.160+0000 7f00f9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f01040cf070 0x7f01040cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.160+0000 7f00f9400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f01040cf070 0x7f01040cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34220/0 (socket says 172.21.15.144:34220) 2024-09-11T23:26:49.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.160+0000 7f00f9400640 1 -- 172.21.15.144:0/3351537603 learned_addr learned my addr 172.21.15.144:0/3351537603 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:49.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.160+0000 7f0102800640 1 --2- 172.21.15.144:0/3351537603 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0104073120 0x7f01040735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.161+0000 7f00f9400640 1 -- 172.21.15.144:0/3351537603 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0104073120 msgr2=0x7f01040735b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:49.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.161+0000 7f00f9400640 1 --2- 172.21.15.144:0/3351537603 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0104073120 0x7f01040735b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.161+0000 7f00f9400640 1 -- 172.21.15.144:0/3351537603 >> v1:172.21.15.165:6789/0 conn(0x7f010415c180 legacy=0x7f01040cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:49.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.161+0000 7f00f9400640 1 -- 172.21.15.144:0/3351537603 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0104072c00 con 0x7f01040cf070 2024-09-11T23:26:49.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.162+0000 7f00f9400640 1 --2- 172.21.15.144:0/3351537603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01040cf070 0x7f01040cf4e0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009870 tx=0x7f00ec02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0622be278df667 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:49.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.162+0000 7f0101400640 1 -- 172.21.15.144:0/3351537603 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec037070 con 0x7f01040cf070 2024-09-11T23:26:49.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.162+0000 7f0101400640 1 -- 172.21.15.144:0/3351537603 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00ec032440 con 0x7f01040cf070 2024-09-11T23:26:49.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.162+0000 7f0101400640 1 -- 172.21.15.144:0/3351537603 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec032810 con 0x7f01040cf070 2024-09-11T23:26:49.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.162+0000 7f0109200640 1 -- 172.21.15.144:0/3351537603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01040cf070 msgr2=0x7f01040cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:49.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.162+0000 7f0109200640 1 --2- 172.21.15.144:0/3351537603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01040cf070 0x7f01040cf4e0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009870 tx=0x7f00ec02a1c0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.163+0000 7f0109200640 1 -- 172.21.15.144:0/3351537603 shutdown_connections 2024-09-11T23:26:49.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.163+0000 7f0109200640 1 --2- 172.21.15.144:0/3351537603 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f0104073120 0x7f01040735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.163+0000 7f0109200640 1 --2- 172.21.15.144:0/3351537603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01040cf070 0x7f01040cf4e0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.163+0000 7f0109200640 1 -- 172.21.15.144:0/3351537603 >> 172.21.15.144:0/3351537603 conn(0x7f0104062cc0 msgr2=0x7f010406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:49.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.163+0000 7f0109200640 1 -- 172.21.15.144:0/3351537603 shutdown_connections 2024-09-11T23:26:49.163 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.163+0000 7f0109200640 1 -- 172.21.15.144:0/3351537603 wait complete. 2024-09-11T23:26:49.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.164+0000 7f0109200640 1 Processor -- start 2024-09-11T23:26:49.164 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.164+0000 7f0109200640 1 -- start start 2024-09-11T23:26:49.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.165+0000 7f0109200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0104073120 0x7f0104154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.165+0000 7f0109200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01040cf070 0x7f01041f72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.165+0000 7f0109200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f010415c180 0x7f0104156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.166 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.165+0000 7f0109200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f01040722f0 con 0x7f0104073120 2024-09-11T23:26:49.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.165+0000 7f0109200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f01040ced00 con 0x7f01040cf070 2024-09-11T23:26:49.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.165+0000 7f0109200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f010415c560 con 0x7f010415c180 2024-09-11T23:26:49.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.165+0000 7f0101e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0104073120 0x7f0104154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.166+0000 7f0101e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0104073120 0x7f0104154a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34224/0 (socket says 172.21.15.144:34224) 2024-09-11T23:26:49.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.166+0000 7f0101e00640 1 -- 172.21.15.144:0/2210844148 learned_addr learned my addr 172.21.15.144:0/2210844148 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:49.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.166+0000 7f0101e00640 1 -- 172.21.15.144:0/2210844148 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f010415c180 msgr2=0x7f0104156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:49.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.166+0000 7f00f9400640 1 --2- 172.21.15.144:0/2210844148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01040cf070 0x7f01041f72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.166+0000 7f0102800640 1 --2- 172.21.15.144:0/2210844148 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f010415c180 0x7f0104156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.166+0000 7f0101e00640 1 --2- 172.21.15.144:0/2210844148 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f010415c180 0x7f0104156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.166+0000 7f0101e00640 1 -- 172.21.15.144:0/2210844148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01040cf070 msgr2=0x7f01041f72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:49.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.166+0000 7f0101e00640 1 --2- 172.21.15.144:0/2210844148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01040cf070 0x7f01041f72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.166+0000 7f0101e00640 1 -- 172.21.15.144:0/2210844148 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0104155010 con 0x7f0104073120 2024-09-11T23:26:49.167 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.166+0000 7f00f9400640 1 --2- 172.21.15.144:0/2210844148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01040cf070 0x7f01041f72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:49.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.166+0000 7f0102800640 1 --2- 172.21.15.144:0/2210844148 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f010415c180 0x7f0104156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:49.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.166+0000 7f0101e00640 1 --2- 172.21.15.144:0/2210844148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0104073120 0x7f0104154a30 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f00f400c460 tx=0x7f00f400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:49.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.166+0000 7f00faa00640 1 -- 172.21.15.144:0/2210844148 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f40052d0 con 0x7f0104073120 2024-09-11T23:26:49.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.167+0000 7f00faa00640 1 -- 172.21.15.144:0/2210844148 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f4012630 con 0x7f0104073120 2024-09-11T23:26:49.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.167+0000 7f0109200640 1 -- 172.21.15.144:0/2210844148 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01041552f0 con 0x7f0104073120 2024-09-11T23:26:49.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.167+0000 7f00faa00640 1 -- 172.21.15.144:0/2210844148 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f40054b0 con 0x7f0104073120 2024-09-11T23:26:49.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.167+0000 7f0109200640 1 -- 172.21.15.144:0/2210844148 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01041558b0 con 0x7f0104073120 2024-09-11T23:26:49.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.168+0000 7f0109200640 1 -- 172.21.15.144:0/2210844148 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01040cf4e0 con 0x7f0104073120 2024-09-11T23:26:49.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.169+0000 7f00faa00640 1 -- 172.21.15.144:0/2210844148 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f00f4012a20 con 0x7f0104073120 2024-09-11T23:26:49.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.169+0000 7f00faa00640 1 --2- 172.21.15.144:0/2210844148 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f00e006c9a0 0x7f00e006ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.170+0000 7f00faa00640 1 -- 172.21.15.144:0/2210844148 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f00f4089600 con 0x7f0104073120 2024-09-11T23:26:49.169 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.170+0000 7f00f9400640 1 --2- 172.21.15.144:0/2210844148 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f00e006c9a0 0x7f00e006ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.171+0000 7f00f9400640 1 --2- 172.21.15.144:0/2210844148 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f00e006c9a0 0x7f00e006ee60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f00ec034000 tx=0x7f00ec02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:49.173 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.174+0000 7f00faa00640 1 -- 172.21.15.144:0/2210844148 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f00f40597b0 con 0x7f0104073120 2024-09-11T23:26:49.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.380+0000 7f0109200640 1 -- 172.21.15.144:0/2210844148 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01041573b0 con 0x7f0104073120 2024-09-11T23:26:49.381 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.381+0000 7f00faa00640 1 -- 172.21.15.144:0/2210844148 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5242 (secure 0 0 0) 0x7f00f40590b0 con 0x7f0104073120 2024-09-11T23:26:49.382 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:49.382 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":120,"btime":"2024-09-11T23:26:39:829063+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/4202069031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4202069031},{"type":"v1","addr":"172.21.15.144:6801","nonce":4202069031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":7331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1262024638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1262024638},{"type":"v1","addr":"172.21.15.144:6835","nonce":1262024638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8407,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2678086616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2678086616},{"type":"v1","addr":"172.21.15.165:6834","nonce":2678086616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T23:26:29.055590+0000","modified":"2024-09-11T23:26:32.086872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9015},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9015":{"gid":9015,"name":"b","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.165:6835/862543799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":862543799},{"type":"v1","addr":"172.21.15.165:6835","nonce":862543799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9015,"qdb_cluster":[9015]},"id":13}]} 2024-09-11T23:26:49.382 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 120 2024-09-11T23:26:49.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.383+0000 7f0109200640 1 -- 172.21.15.144:0/2210844148 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f00e006c9a0 msgr2=0x7f00e006ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:49.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.383+0000 7f0109200640 1 --2- 172.21.15.144:0/2210844148 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f00e006c9a0 0x7f00e006ee60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f00ec034000 tx=0x7f00ec02e000 comp rx=0 tx=0).stop 2024-09-11T23:26:49.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.383+0000 7f0109200640 1 -- 172.21.15.144:0/2210844148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0104073120 msgr2=0x7f0104154a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:49.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.383+0000 7f0109200640 1 --2- 172.21.15.144:0/2210844148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0104073120 0x7f0104154a30 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f00f400c460 tx=0x7f00f400c920 comp rx=0 tx=0).stop 2024-09-11T23:26:49.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.383+0000 7f0109200640 1 -- 172.21.15.144:0/2210844148 shutdown_connections 2024-09-11T23:26:49.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.383+0000 7f0109200640 1 --2- 172.21.15.144:0/2210844148 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f00e006c9a0 0x7f00e006ee60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.383+0000 7f0109200640 1 --2- 172.21.15.144:0/2210844148 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f010415c180 0x7f0104156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.383+0000 7f0109200640 1 --2- 172.21.15.144:0/2210844148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01040cf070 0x7f01041f72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.383+0000 7f0109200640 1 --2- 172.21.15.144:0/2210844148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0104073120 0x7f0104154a30 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.383+0000 7f0109200640 1 -- 172.21.15.144:0/2210844148 >> 172.21.15.144:0/2210844148 conn(0x7f0104062cc0 msgr2=0x7f010406bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:49.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.384+0000 7f0109200640 1 -- 172.21.15.144:0/2210844148 shutdown_connections 2024-09-11T23:26:49.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.384+0000 7f0109200640 1 -- 172.21.15.144:0/2210844148 wait complete. 2024-09-11T23:26:49.400 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:26:49.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.554+0000 7f400da00640 1 Processor -- start 2024-09-11T23:26:49.554 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.554+0000 7f400da00640 1 -- start start 2024-09-11T23:26:49.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.556+0000 7f400da00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f40080cf070 0x7f40080cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.556+0000 7f400da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4008073120 0x7f4008073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.556+0000 7f400da00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40080ce740 con 0x7f400815c180 2024-09-11T23:26:49.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.556+0000 7f400da00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f4008072640 con 0x7f4008073120 2024-09-11T23:26:49.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.556+0000 7f400da00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4008072920 con 0x7f40080cf070 2024-09-11T23:26:49.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.556+0000 7f4006a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f400815c180 0x7f40080cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43722/0 (socket says 172.21.15.144:43722) 2024-09-11T23:26:49.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.556+0000 7f4006a00640 1 -- 172.21.15.144:0/1164468307 learned_addr learned my addr 172.21.15.144:0/1164468307 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:49.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.556+0000 7f4007400640 1 --2- 172.21.15.144:0/1164468307 >> v2:172.21.15.144:3300/0 conn(0x7f4008073120 0x7f4008073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.556 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.556+0000 7f4006000640 1 --2- 172.21.15.144:0/1164468307 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f40080cf070 0x7f40080cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.556+0000 7f4005600640 1 -- 172.21.15.144:0/1164468307 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3018584120 0 0) 0x7f40080ce740 con 0x7f400815c180 2024-09-11T23:26:49.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.556+0000 7f4005600640 1 -- 172.21.15.144:0/1164468307 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fec003520 con 0x7f400815c180 2024-09-11T23:26:49.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.556+0000 7f4007400640 1 -- 172.21.15.144:0/1164468307 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f40080cf070 msgr2=0x7f40080cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:49.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.556+0000 7f4007400640 1 --2- 172.21.15.144:0/1164468307 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f40080cf070 0x7f40080cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.556+0000 7f4007400640 1 -- 172.21.15.144:0/1164468307 >> v1:172.21.15.144:6789/0 conn(0x7f400815c180 legacy=0x7f40080cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:49.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.556+0000 7f4007400640 1 -- 172.21.15.144:0/1164468307 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4008072c00 con 0x7f4008073120 2024-09-11T23:26:49.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.557+0000 7f4007400640 1 --2- 172.21.15.144:0/1164468307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4008073120 0x7f4008073590 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f4000009d90 tx=0x7f400002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28216349af75fc35 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:49.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.558+0000 7f4005600640 1 -- 172.21.15.144:0/1164468307 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000031600 con 0x7f4008073120 2024-09-11T23:26:49.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.558+0000 7f4005600640 1 -- 172.21.15.144:0/1164468307 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40000317a0 con 0x7f4008073120 2024-09-11T23:26:49.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.558+0000 7f4005600640 1 -- 172.21.15.144:0/1164468307 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000031b70 con 0x7f4008073120 2024-09-11T23:26:49.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.558+0000 7f400da00640 1 -- 172.21.15.144:0/1164468307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4008073120 msgr2=0x7f4008073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:49.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.558+0000 7f400da00640 1 --2- 172.21.15.144:0/1164468307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4008073120 0x7f4008073590 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f4000009d90 tx=0x7f400002a5d0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.558+0000 7f400da00640 1 -- 172.21.15.144:0/1164468307 shutdown_connections 2024-09-11T23:26:49.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.558+0000 7f400da00640 1 --2- 172.21.15.144:0/1164468307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4008073120 0x7f4008073590 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.558+0000 7f400da00640 1 --2- 172.21.15.144:0/1164468307 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f40080cf070 0x7f40080cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.558+0000 7f400da00640 1 -- 172.21.15.144:0/1164468307 >> 172.21.15.144:0/1164468307 conn(0x7f4008062cc0 msgr2=0x7f400806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:49.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.558+0000 7f400da00640 1 -- 172.21.15.144:0/1164468307 shutdown_connections 2024-09-11T23:26:49.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.558+0000 7f400da00640 1 -- 172.21.15.144:0/1164468307 wait complete. 2024-09-11T23:26:49.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.560+0000 7f400da00640 1 Processor -- start 2024-09-11T23:26:49.559 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.560+0000 7f400da00640 1 -- start start 2024-09-11T23:26:49.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.561+0000 7f400da00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4008073120 0x7f40080aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.561+0000 7f400da00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40080cf070 0x7f400814b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.561+0000 7f400da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f400815c180 0x7f400814bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.561+0000 7f400da00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f40080722f0 con 0x7f400815c180 2024-09-11T23:26:49.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.561+0000 7f400da00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f40080ced00 con 0x7f40080cf070 2024-09-11T23:26:49.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.561+0000 7f400da00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f400815c560 con 0x7f4008073120 2024-09-11T23:26:49.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.561+0000 7f4007400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f400815c180 0x7f400814bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.562 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.561+0000 7f4007400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f400815c180 0x7f400814bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34242/0 (socket says 172.21.15.144:34242) 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.561+0000 7f4007400640 1 -- 172.21.15.144:0/3261197138 learned_addr learned my addr 172.21.15.144:0/3261197138 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.561+0000 7f4006a00640 1 --2- 172.21.15.144:0/3261197138 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4008073120 0x7f40080aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.561+0000 7f4006000640 1 --2- 172.21.15.144:0/3261197138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40080cf070 0x7f400814b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.562+0000 7f4007400640 1 -- 172.21.15.144:0/3261197138 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4008073120 msgr2=0x7f40080aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.562+0000 7f4007400640 1 --2- 172.21.15.144:0/3261197138 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4008073120 0x7f40080aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.562+0000 7f4007400640 1 -- 172.21.15.144:0/3261197138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40080cf070 msgr2=0x7f400814b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.562+0000 7f4007400640 1 --2- 172.21.15.144:0/3261197138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40080cf070 0x7f400814b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.562+0000 7f4007400640 1 -- 172.21.15.144:0/3261197138 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40080b5450 con 0x7f400815c180 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.562+0000 7f4007400640 1 --2- 172.21.15.144:0/3261197138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f400815c180 0x7f400814bee0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f4000009eb0 tx=0x7f4000004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.562+0000 7f3ffea00640 1 -- 172.21.15.144:0/3261197138 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000040070 con 0x7f400815c180 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.562+0000 7f3ffea00640 1 -- 172.21.15.144:0/3261197138 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f400003c830 con 0x7f400815c180 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.562+0000 7f400da00640 1 -- 172.21.15.144:0/3261197138 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f400815cdc0 con 0x7f400815c180 2024-09-11T23:26:49.563 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.562+0000 7f3ffea00640 1 -- 172.21.15.144:0/3261197138 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400003cbe0 con 0x7f400815c180 2024-09-11T23:26:49.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.563+0000 7f400da00640 1 -- 172.21.15.144:0/3261197138 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f400815f480 con 0x7f400815c180 2024-09-11T23:26:49.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.564+0000 7f400da00640 1 -- 172.21.15.144:0/3261197138 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f400815efd0 con 0x7f400815c180 2024-09-11T23:26:49.564 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.565+0000 7f3ffea00640 1 -- 172.21.15.144:0/3261197138 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f4000039040 con 0x7f400815c180 2024-09-11T23:26:49.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.565+0000 7f3ffea00640 1 --2- 172.21.15.144:0/3261197138 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3fe806c970 0x7f3fe806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.565+0000 7f3ffea00640 1 -- 172.21.15.144:0/3261197138 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f40000ab0d0 con 0x7f400815c180 2024-09-11T23:26:49.565 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.566+0000 7f4006a00640 1 --2- 172.21.15.144:0/3261197138 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3fe806c970 0x7f3fe806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.566 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.567+0000 7f4006a00640 1 --2- 172.21.15.144:0/3261197138 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3fe806c970 0x7f3fe806ee30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f40081546b0 tx=0x7f3ff8000bc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:49.569 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.570+0000 7f3ffea00640 1 -- 172.21.15.144:0/3261197138 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f40080b5450 con 0x7f400815c180 2024-09-11T23:26:49.747 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.747+0000 7f400da00640 1 -- 172.21.15.144:0/3261197138 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40080cf4b0 con 0x7f400815c180 2024-09-11T23:26:49.748 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.748+0000 7f3ffea00640 1 -- 172.21.15.144:0/3261197138 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) ==== 74+0+16767 (secure 0 0 0) 0x7f400007ad50 con 0x7f400815c180 2024-09-11T23:26:49.748 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:49.748 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":166,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:26:30.661485+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-11T23:26:26.828432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-11T23:26:28.054488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:26:49.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.750+0000 7f400da00640 1 -- 172.21.15.144:0/3261197138 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3fe806c970 msgr2=0x7f3fe806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:49.750 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.750+0000 7f400da00640 1 --2- 172.21.15.144:0/3261197138 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3fe806c970 0x7f3fe806ee30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f40081546b0 tx=0x7f3ff8000bc0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.750+0000 7f400da00640 1 -- 172.21.15.144:0/3261197138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f400815c180 msgr2=0x7f400814bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:49.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.750+0000 7f400da00640 1 --2- 172.21.15.144:0/3261197138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f400815c180 0x7f400814bee0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f4000009eb0 tx=0x7f4000004a40 comp rx=0 tx=0).stop 2024-09-11T23:26:49.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.751+0000 7f400da00640 1 -- 172.21.15.144:0/3261197138 shutdown_connections 2024-09-11T23:26:49.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.751+0000 7f400da00640 1 --2- 172.21.15.144:0/3261197138 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3fe806c970 0x7f3fe806ee30 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.751+0000 7f400da00640 1 --2- 172.21.15.144:0/3261197138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f400815c180 0x7f400814bee0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.751+0000 7f400da00640 1 --2- 172.21.15.144:0/3261197138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40080cf070 0x7f400814b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.751+0000 7f400da00640 1 --2- 172.21.15.144:0/3261197138 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4008073120 0x7f40080aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.751+0000 7f400da00640 1 -- 172.21.15.144:0/3261197138 >> 172.21.15.144:0/3261197138 conn(0x7f4008062cc0 msgr2=0x7f400815ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:49.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.751+0000 7f400da00640 1 -- 172.21.15.144:0/3261197138 shutdown_connections 2024-09-11T23:26:49.751 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.751+0000 7f400da00640 1 -- 172.21.15.144:0/3261197138 wait complete. 2024-09-11T23:26:49.766 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T23:26:49.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.921+0000 7fad47200640 1 Processor -- start 2024-09-11T23:26:49.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.921+0000 7fad47200640 1 -- start start 2024-09-11T23:26:49.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.923+0000 7fad47200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fad4015c180 0x7fad400cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.923+0000 7fad47200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad400ce230 0x7fad400cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.923+0000 7fad47200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad400cf5b0 0x7fad40073120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.923+0000 7fad47200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fad400ce740 con 0x7fad400ce230 2024-09-11T23:26:49.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.923+0000 7fad47200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fad40072640 con 0x7fad4015c180 2024-09-11T23:26:49.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.923+0000 7fad47200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fad40072920 con 0x7fad400cf5b0 2024-09-11T23:26:49.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.923+0000 7fad37400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad400ce230 0x7fad400cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.923+0000 7fad37400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fad400ce230 0x7fad400cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34244/0 (socket says 172.21.15.144:34244) 2024-09-11T23:26:49.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.923+0000 7fad37400640 1 -- 172.21.15.144:0/3147900381 learned_addr learned my addr 172.21.15.144:0/3147900381 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:49.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.923+0000 7fad3fe00640 1 --2- 172.21.15.144:0/3147900381 >> v2:172.21.15.165:3300/0 conn(0x7fad4015c180 0x7fad400cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.923+0000 7fad45200640 1 --2- 172.21.15.144:0/3147900381 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad400cf5b0 0x7fad40073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.923+0000 7fad37400640 1 -- 172.21.15.144:0/3147900381 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad400cf5b0 msgr2=0x7fad40073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:49.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.923+0000 7fad37400640 1 --2- 172.21.15.144:0/3147900381 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad400cf5b0 0x7fad40073120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.923+0000 7fad37400640 1 -- 172.21.15.144:0/3147900381 >> v2:172.21.15.165:3300/0 conn(0x7fad4015c180 msgr2=0x7fad400cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:49.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.923+0000 7fad37400640 1 --2- 172.21.15.144:0/3147900381 >> v2:172.21.15.165:3300/0 conn(0x7fad4015c180 0x7fad400cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.923+0000 7fad37400640 1 -- 172.21.15.144:0/3147900381 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad40072c00 con 0x7fad400ce230 2024-09-11T23:26:49.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.923+0000 7fad3fe00640 1 --2- 172.21.15.144:0/3147900381 >> v2:172.21.15.165:3300/0 conn(0x7fad4015c180 0x7fad400cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:49.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.923+0000 7fad45200640 1 --2- 172.21.15.144:0/3147900381 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad400cf5b0 0x7fad40073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:49.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.924+0000 7fad37400640 1 --2- 172.21.15.144:0/3147900381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad400ce230 0x7fad400cf070 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fad4006cc10 tx=0x7fad2802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15d8748e146dd59 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:49.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.925+0000 7fad3f400640 1 -- 172.21.15.144:0/3147900381 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad28037070 con 0x7fad400ce230 2024-09-11T23:26:49.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.925+0000 7fad3f400640 1 -- 172.21.15.144:0/3147900381 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad28032440 con 0x7fad400ce230 2024-09-11T23:26:49.925 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.925+0000 7fad3f400640 1 -- 172.21.15.144:0/3147900381 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad28032810 con 0x7fad400ce230 2024-09-11T23:26:49.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.925+0000 7fad47200640 1 -- 172.21.15.144:0/3147900381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad400ce230 msgr2=0x7fad400cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:49.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.925+0000 7fad47200640 1 --2- 172.21.15.144:0/3147900381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad400ce230 0x7fad400cf070 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fad4006cc10 tx=0x7fad2802a140 comp rx=0 tx=0).stop 2024-09-11T23:26:49.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.925+0000 7fad47200640 1 -- 172.21.15.144:0/3147900381 shutdown_connections 2024-09-11T23:26:49.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.925+0000 7fad47200640 1 --2- 172.21.15.144:0/3147900381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad400ce230 0x7fad400cf070 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.925+0000 7fad47200640 1 --2- 172.21.15.144:0/3147900381 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad400cf5b0 0x7fad40073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.925+0000 7fad47200640 1 --2- 172.21.15.144:0/3147900381 >> v2:172.21.15.165:3300/0 conn(0x7fad4015c180 0x7fad400cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.925+0000 7fad47200640 1 -- 172.21.15.144:0/3147900381 >> 172.21.15.144:0/3147900381 conn(0x7fad40062cc0 msgr2=0x7fad4006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:49.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.925+0000 7fad47200640 1 -- 172.21.15.144:0/3147900381 shutdown_connections 2024-09-11T23:26:49.926 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.925+0000 7fad47200640 1 -- 172.21.15.144:0/3147900381 wait complete. 2024-09-11T23:26:49.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.927+0000 7fad47200640 1 Processor -- start 2024-09-11T23:26:49.927 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.927+0000 7fad47200640 1 -- start start 2024-09-11T23:26:49.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.928+0000 7fad47200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad400ce230 0x7fad40160810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.928+0000 7fad47200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad400cf5b0 0x7fad40155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.928+0000 7fad47200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad4015c180 0x7fad40156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.928+0000 7fad47200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fad4015c560 con 0x7fad400ce230 2024-09-11T23:26:49.928 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.928+0000 7fad47200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fad400722f0 con 0x7fad4015c180 2024-09-11T23:26:49.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.928+0000 7fad47200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fad4015c6e0 con 0x7fad400cf5b0 2024-09-11T23:26:49.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.928+0000 7fad3fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad400ce230 0x7fad40160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.928+0000 7fad3fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad400ce230 0x7fad40160810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34258/0 (socket says 172.21.15.144:34258) 2024-09-11T23:26:49.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.928+0000 7fad3fe00640 1 -- 172.21.15.144:0/2865034381 learned_addr learned my addr 172.21.15.144:0/2865034381 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:49.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.928+0000 7fad37400640 1 --2- 172.21.15.144:0/2865034381 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad400cf5b0 0x7fad40155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.928+0000 7fad45200640 1 --2- 172.21.15.144:0/2865034381 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad4015c180 0x7fad40156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.929+0000 7fad3fe00640 1 -- 172.21.15.144:0/2865034381 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad400cf5b0 msgr2=0x7fad40155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:49.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.929+0000 7fad3fe00640 1 --2- 172.21.15.144:0/2865034381 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad400cf5b0 0x7fad40155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.929+0000 7fad3fe00640 1 -- 172.21.15.144:0/2865034381 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad4015c180 msgr2=0x7fad40156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:49.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.929+0000 7fad3fe00640 1 --2- 172.21.15.144:0/2865034381 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad4015c180 0x7fad40156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:49.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.929+0000 7fad3fe00640 1 -- 172.21.15.144:0/2865034381 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad40160d50 con 0x7fad400ce230 2024-09-11T23:26:49.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.929+0000 7fad45200640 1 --2- 172.21.15.144:0/2865034381 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad4015c180 0x7fad40156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:49.929 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.929+0000 7fad3fe00640 1 --2- 172.21.15.144:0/2865034381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad400ce230 0x7fad40160810 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fad3000e730 tx=0x7fad3000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:49.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.929+0000 7fad3cc00640 1 -- 172.21.15.144:0/2865034381 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3000f040 con 0x7fad400ce230 2024-09-11T23:26:49.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.929+0000 7fad3cc00640 1 -- 172.21.15.144:0/2865034381 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad30004230 con 0x7fad400ce230 2024-09-11T23:26:49.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.929+0000 7fad47200640 1 -- 172.21.15.144:0/2865034381 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad400b2e00 con 0x7fad400ce230 2024-09-11T23:26:49.930 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.929+0000 7fad3cc00640 1 -- 172.21.15.144:0/2865034381 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3000ee40 con 0x7fad400ce230 2024-09-11T23:26:49.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.929+0000 7fad47200640 1 -- 172.21.15.144:0/2865034381 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad4013f9c0 con 0x7fad400ce230 2024-09-11T23:26:49.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.930+0000 7fad47200640 1 -- 172.21.15.144:0/2865034381 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad400cf070 con 0x7fad400ce230 2024-09-11T23:26:49.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.931+0000 7fad3cc00640 1 -- 172.21.15.144:0/2865034381 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7fad3000c6d0 con 0x7fad400ce230 2024-09-11T23:26:49.931 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.932+0000 7fad3cc00640 1 --2- 172.21.15.144:0/2865034381 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fad1c06c970 0x7fad1c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:49.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.932+0000 7fad3cc00640 1 -- 172.21.15.144:0/2865034381 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7fad30089660 con 0x7fad400ce230 2024-09-11T23:26:49.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.933+0000 7fad37400640 1 --2- 172.21.15.144:0/2865034381 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fad1c06c970 0x7fad1c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:49.933 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.933+0000 7fad37400640 1 --2- 172.21.15.144:0/2865034381 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fad1c06c970 0x7fad1c06ee30 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fad28034000 tx=0x7fad2802e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:49.935 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:49.936+0000 7fad3cc00640 1 -- 172.21.15.144:0/2865034381 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad30017020 con 0x7fad400ce230 2024-09-11T23:26:50.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.145+0000 7fad47200640 1 -- 172.21.15.144:0/2865034381 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fad40158390 con 0x7fad400ce230 2024-09-11T23:26:50.145 INFO:tasks.ceph.mon.a.smithi144.stderr:2024-09-11T23:26:50.145+0000 7f86fcc00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T23:26:50.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.147+0000 7fad3cc00640 1 -- 172.21.15.144:0/2865034381 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v121) ==== 161+0+0 (secure 0 0 0) 0x7fad300591c0 con 0x7fad400ce230 2024-09-11T23:26:50.147 INFO:teuthology.orchestra.run.smithi144.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T23:26:50.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.150+0000 7fad47200640 1 -- 172.21.15.144:0/2865034381 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fad1c06c970 msgr2=0x7fad1c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:50.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.150+0000 7fad47200640 1 --2- 172.21.15.144:0/2865034381 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fad1c06c970 0x7fad1c06ee30 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fad28034000 tx=0x7fad2802e000 comp rx=0 tx=0).stop 2024-09-11T23:26:50.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.150+0000 7fad47200640 1 -- 172.21.15.144:0/2865034381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad400ce230 msgr2=0x7fad40160810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:50.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.150+0000 7fad47200640 1 --2- 172.21.15.144:0/2865034381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad400ce230 0x7fad40160810 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fad3000e730 tx=0x7fad3000ebf0 comp rx=0 tx=0).stop 2024-09-11T23:26:50.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.150+0000 7fad47200640 1 -- 172.21.15.144:0/2865034381 shutdown_connections 2024-09-11T23:26:50.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.150+0000 7fad47200640 1 --2- 172.21.15.144:0/2865034381 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fad1c06c970 0x7fad1c06ee30 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:50.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.150+0000 7fad47200640 1 --2- 172.21.15.144:0/2865034381 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad4015c180 0x7fad40156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:50.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.150+0000 7fad47200640 1 --2- 172.21.15.144:0/2865034381 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fad400cf5b0 0x7fad40155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:50.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.150+0000 7fad47200640 1 --2- 172.21.15.144:0/2865034381 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad400ce230 0x7fad40160810 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:50.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.150+0000 7fad47200640 1 -- 172.21.15.144:0/2865034381 >> 172.21.15.144:0/2865034381 conn(0x7fad40062cc0 msgr2=0x7fad4015a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:50.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.150+0000 7fad47200640 1 -- 172.21.15.144:0/2865034381 shutdown_connections 2024-09-11T23:26:50.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.151+0000 7fad47200640 1 -- 172.21.15.144:0/2865034381 wait complete. 2024-09-11T23:26:50.166 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T23:26:50.219 INFO:tasks.ceph.mds.b.smithi165.stdout:starting mds.b at 2024-09-11T23:26:50.322 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.323+0000 7f7770800640 1 Processor -- start 2024-09-11T23:26:50.323 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.323+0000 7f7770800640 1 -- start start 2024-09-11T23:26:50.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.324+0000 7f7770800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f77680b3430 0x7f77680cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:50.324 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.324+0000 7f7770800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f776806c2d0 0x7f77680b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:50.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.324+0000 7f7770800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77680b3d50 con 0x7f776806d8c0 2024-09-11T23:26:50.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.324+0000 7f7770800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f77680d22c0 con 0x7f77680b3430 2024-09-11T23:26:50.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.324+0000 7f7770800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f776815e9d0 con 0x7f776806c2d0 2024-09-11T23:26:50.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.324+0000 7f776de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f77680b3430 0x7f77680cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:50.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.324+0000 7f776de00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f77680b3430 0x7f77680cf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34262/0 (socket says 172.21.15.144:34262) 2024-09-11T23:26:50.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.324+0000 7f776de00640 1 -- 172.21.15.144:0/1829732076 learned_addr learned my addr 172.21.15.144:0/1829732076 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:50.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.324+0000 7f776d400640 1 --2- 172.21.15.144:0/1829732076 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f776806c2d0 0x7f77680b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:50.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.325+0000 7f776de00640 1 -- 172.21.15.144:0/1829732076 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f776806c2d0 msgr2=0x7f77680b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:50.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.325+0000 7f776de00640 1 --2- 172.21.15.144:0/1829732076 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f776806c2d0 0x7f77680b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:50.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.325+0000 7f776de00640 1 -- 172.21.15.144:0/1829732076 >> v1:172.21.15.165:6789/0 conn(0x7f776806d8c0 legacy=0x7f776806dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:50.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.325+0000 7f776de00640 1 -- 172.21.15.144:0/1829732076 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776806ca70 con 0x7f77680b3430 2024-09-11T23:26:50.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.326+0000 7f776de00640 1 --2- 172.21.15.144:0/1829732076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77680b3430 0x7f77680cf750 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f775c009870 tx=0x7f775c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb067026db432d4e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.326+0000 7f776ca00640 1 -- 172.21.15.144:0/1829732076 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c037070 con 0x7f77680b3430 2024-09-11T23:26:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.326+0000 7f776ca00640 1 -- 172.21.15.144:0/1829732076 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775c032440 con 0x7f77680b3430 2024-09-11T23:26:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.326+0000 7f776ca00640 1 -- 172.21.15.144:0/1829732076 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c032810 con 0x7f77680b3430 2024-09-11T23:26:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.326+0000 7f7770800640 1 -- 172.21.15.144:0/1829732076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77680b3430 msgr2=0x7f77680cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.326+0000 7f7770800640 1 --2- 172.21.15.144:0/1829732076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77680b3430 0x7f77680cf750 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f775c009870 tx=0x7f775c02a1c0 comp rx=0 tx=0).stop 2024-09-11T23:26:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.327+0000 7f7770800640 1 -- 172.21.15.144:0/1829732076 shutdown_connections 2024-09-11T23:26:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.327+0000 7f7770800640 1 --2- 172.21.15.144:0/1829732076 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f776806c2d0 0x7f77680b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.327+0000 7f7770800640 1 --2- 172.21.15.144:0/1829732076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f77680b3430 0x7f77680cf750 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.327+0000 7f7770800640 1 -- 172.21.15.144:0/1829732076 >> 172.21.15.144:0/1829732076 conn(0x7f77680d4b10 msgr2=0x7f77680d4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.327+0000 7f7770800640 1 -- 172.21.15.144:0/1829732076 shutdown_connections 2024-09-11T23:26:50.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.327+0000 7f7770800640 1 -- 172.21.15.144:0/1829732076 wait complete. 2024-09-11T23:26:50.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.328+0000 7f7770800640 1 Processor -- start 2024-09-11T23:26:50.328 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.328+0000 7f7770800640 1 -- start start 2024-09-11T23:26:50.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.329+0000 7f7770800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f776806c2d0 0x7f77681f43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:50.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.329+0000 7f7770800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f776806d8c0 0x7f77680c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:50.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.329+0000 7f7770800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77680b3430 0x7f77680cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:50.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.329+0000 7f7770800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f77680d27f0 con 0x7f776806c2d0 2024-09-11T23:26:50.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.329+0000 7f7770800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f77680d2510 con 0x7f77680b3430 2024-09-11T23:26:50.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.329+0000 7f7770800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f776806c710 con 0x7f776806d8c0 2024-09-11T23:26:50.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.329+0000 7f776de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f776806c2d0 0x7f77681f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:50.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.330+0000 7f776de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f776806c2d0 0x7f77681f43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34278/0 (socket says 172.21.15.144:34278) 2024-09-11T23:26:50.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.330+0000 7f776de00640 1 -- 172.21.15.144:0/2182099204 learned_addr learned my addr 172.21.15.144:0/2182099204 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:50.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.330+0000 7f776d400640 1 --2- 172.21.15.144:0/2182099204 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f776806d8c0 0x7f77680c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:50.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.330+0000 7f776e800640 1 --2- 172.21.15.144:0/2182099204 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77680b3430 0x7f77680cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:50.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.330+0000 7f776de00640 1 -- 172.21.15.144:0/2182099204 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f776806d8c0 msgr2=0x7f77680c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:50.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.330+0000 7f776de00640 1 --2- 172.21.15.144:0/2182099204 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f776806d8c0 0x7f77680c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:50.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.330+0000 7f776de00640 1 -- 172.21.15.144:0/2182099204 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77680b3430 msgr2=0x7f77680cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:50.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.330+0000 7f776de00640 1 --2- 172.21.15.144:0/2182099204 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77680b3430 0x7f77680cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:50.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.330+0000 7f776de00640 1 -- 172.21.15.144:0/2182099204 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776815a740 con 0x7f776806c2d0 2024-09-11T23:26:50.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.330+0000 7f776de00640 1 --2- 172.21.15.144:0/2182099204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f776806c2d0 0x7f77681f43e0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f775c000c00 tx=0x7f775c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:50.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.330+0000 7f7762000640 1 -- 172.21.15.144:0/2182099204 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c041020 con 0x7f776806c2d0 2024-09-11T23:26:50.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.331+0000 7f7762000640 1 -- 172.21.15.144:0/2182099204 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775c03d620 con 0x7f776806c2d0 2024-09-11T23:26:50.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.331+0000 7f7762000640 1 -- 172.21.15.144:0/2182099204 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c037040 con 0x7f776806c2d0 2024-09-11T23:26:50.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.331+0000 7f7770800640 1 -- 172.21.15.144:0/2182099204 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f776815aa20 con 0x7f776806c2d0 2024-09-11T23:26:50.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.331+0000 7f7770800640 1 -- 172.21.15.144:0/2182099204 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f776815afe0 con 0x7f776806c2d0 2024-09-11T23:26:50.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.332+0000 7f7770800640 1 -- 172.21.15.144:0/2182099204 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77680c8a40 con 0x7f776806c2d0 2024-09-11T23:26:50.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.333+0000 7f7762000640 1 -- 172.21.15.144:0/2182099204 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f775c044020 con 0x7f776806c2d0 2024-09-11T23:26:50.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.333+0000 7f7762000640 1 --2- 172.21.15.144:0/2182099204 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f774c06c970 0x7f774c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:50.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.334+0000 7f7762000640 1 -- 172.21.15.144:0/2182099204 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5795+0+0 (secure 0 0 0) 0x7f775c0a9e60 con 0x7f776806c2d0 2024-09-11T23:26:50.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.334+0000 7f776d400640 1 --2- 172.21.15.144:0/2182099204 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f774c06c970 0x7f774c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:50.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.335+0000 7f776d400640 1 --2- 172.21.15.144:0/2182099204 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f774c06c970 0x7f774c06ee30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f776815b8d0 tx=0x7f7758009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:50.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.338+0000 7f7762000640 1 -- 172.21.15.144:0/2182099204 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f775c04b030 con 0x7f776806c2d0 2024-09-11T23:26:50.547 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:50.547+0000 7f7770800640 1 -- 172.21.15.144:0/2182099204 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f77680b3810 con 0x7f776806c2d0 2024-09-11T23:26:51.153 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.153+0000 7f7762000640 1 -- 172.21.15.144:0/2182099204 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v122) ==== 104+0+0 (secure 0 0 0) 0x7f775c079b90 con 0x7f776806c2d0 2024-09-11T23:26:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.155+0000 7f7770800640 1 -- 172.21.15.144:0/2182099204 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f774c06c970 msgr2=0x7f774c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.155+0000 7f7770800640 1 --2- 172.21.15.144:0/2182099204 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f774c06c970 0x7f774c06ee30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f776815b8d0 tx=0x7f7758009190 comp rx=0 tx=0).stop 2024-09-11T23:26:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.155+0000 7f7770800640 1 -- 172.21.15.144:0/2182099204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f776806c2d0 msgr2=0x7f77681f43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.155+0000 7f7770800640 1 --2- 172.21.15.144:0/2182099204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f776806c2d0 0x7f77681f43e0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f775c000c00 tx=0x7f775c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:26:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.156+0000 7f7770800640 1 -- 172.21.15.144:0/2182099204 shutdown_connections 2024-09-11T23:26:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.156+0000 7f7770800640 1 --2- 172.21.15.144:0/2182099204 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f774c06c970 0x7f774c06ee30 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.156+0000 7f7770800640 1 --2- 172.21.15.144:0/2182099204 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77680b3430 0x7f77680cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.156+0000 7f7770800640 1 --2- 172.21.15.144:0/2182099204 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f776806d8c0 0x7f77680c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:51.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.156+0000 7f7770800640 1 --2- 172.21.15.144:0/2182099204 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f776806c2d0 0x7f77681f43e0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:51.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.156+0000 7f7770800640 1 -- 172.21.15.144:0/2182099204 >> 172.21.15.144:0/2182099204 conn(0x7f77680d4b10 msgr2=0x7f77680ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:51.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.156+0000 7f7770800640 1 -- 172.21.15.144:0/2182099204 shutdown_connections 2024-09-11T23:26:51.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.156+0000 7f7770800640 1 -- 172.21.15.144:0/2182099204 wait complete. 2024-09-11T23:26:51.172 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T23:26:51.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.330+0000 7fee8fe00640 1 Processor -- start 2024-09-11T23:26:51.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.330+0000 7fee8fe00640 1 -- start start 2024-09-11T23:26:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.331+0000 7fee8fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fee900d3160 0x7fee9006d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.331+0000 7fee8fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee9006db50 0x7fee900b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.331+0000 7fee8fe00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee900d38d0 con 0x7fee9015e6a0 2024-09-11T23:26:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.331+0000 7fee8fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fee900d3bb0 con 0x7fee900d3160 2024-09-11T23:26:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.331+0000 7fee8fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fee900d3e90 con 0x7fee9006db50 2024-09-11T23:26:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.331+0000 7fee8e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fee900d3160 0x7fee9006d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.331+0000 7fee8e000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fee900d3160 0x7fee9006d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34284/0 (socket says 172.21.15.144:34284) 2024-09-11T23:26:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.331+0000 7fee8e000640 1 -- 172.21.15.144:0/3694911035 learned_addr learned my addr 172.21.15.144:0/3694911035 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.332+0000 7fee8f400640 1 --2- 172.21.15.144:0/3694911035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee9006db50 0x7fee900b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.332+0000 7fee8e000640 1 -- 172.21.15.144:0/3694911035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee9006db50 msgr2=0x7fee900b7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:51.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.332+0000 7fee8e000640 1 --2- 172.21.15.144:0/3694911035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee9006db50 0x7fee900b7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:51.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.332+0000 7fee8e000640 1 -- 172.21.15.144:0/3694911035 >> v1:172.21.15.165:6789/0 conn(0x7fee9015e6a0 legacy=0x7fee900cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:51.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.332+0000 7fee8e000640 1 -- 172.21.15.144:0/3694911035 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee900d4170 con 0x7fee900d3160 2024-09-11T23:26:51.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.332+0000 7fee8f400640 1 --2- 172.21.15.144:0/3694911035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee9006db50 0x7fee900b7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:51.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.333+0000 7fee8e000640 1 --2- 172.21.15.144:0/3694911035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee900d3160 0x7fee9006d610 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009870 tx=0x7fee7c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcfb88a197a3d7fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:51.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.333+0000 7fee8d600640 1 -- 172.21.15.144:0/3694911035 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c037070 con 0x7fee900d3160 2024-09-11T23:26:51.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.333+0000 7fee8d600640 1 -- 172.21.15.144:0/3694911035 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee7c02ae50 con 0x7fee900d3160 2024-09-11T23:26:51.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.333+0000 7fee8d600640 1 -- 172.21.15.144:0/3694911035 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c032860 con 0x7fee900d3160 2024-09-11T23:26:51.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.334+0000 7fee8fe00640 1 -- 172.21.15.144:0/3694911035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee900d3160 msgr2=0x7fee9006d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:51.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.334+0000 7fee8fe00640 1 --2- 172.21.15.144:0/3694911035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee900d3160 0x7fee9006d610 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009870 tx=0x7fee7c02a300 comp rx=0 tx=0).stop 2024-09-11T23:26:51.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.334+0000 7fee8fe00640 1 -- 172.21.15.144:0/3694911035 shutdown_connections 2024-09-11T23:26:51.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.334+0000 7fee8fe00640 1 --2- 172.21.15.144:0/3694911035 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee9006db50 0x7fee900b7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:51.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.334+0000 7fee8fe00640 1 --2- 172.21.15.144:0/3694911035 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee900d3160 0x7fee9006d610 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:51.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.334+0000 7fee8fe00640 1 -- 172.21.15.144:0/3694911035 >> 172.21.15.144:0/3694911035 conn(0x7fee900d4700 msgr2=0x7fee900d4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:51.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.334+0000 7fee8fe00640 1 -- 172.21.15.144:0/3694911035 shutdown_connections 2024-09-11T23:26:51.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.334+0000 7fee8fe00640 1 -- 172.21.15.144:0/3694911035 wait complete. 2024-09-11T23:26:51.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.335+0000 7fee8fe00640 1 Processor -- start 2024-09-11T23:26:51.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.335+0000 7fee8fe00640 1 -- start start 2024-09-11T23:26:51.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.336+0000 7fee8fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee9006db50 0x7fee90161630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:51.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.336+0000 7fee8fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee900d3160 0x7fee9015b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:51.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.336+0000 7fee8fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee9015e6a0 0x7fee9015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:51.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.336+0000 7fee8fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fee900b80e0 con 0x7fee9006db50 2024-09-11T23:26:51.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.336+0000 7fee8fe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fee900d3580 con 0x7fee9015e6a0 2024-09-11T23:26:51.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.336+0000 7fee8fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fee900b8260 con 0x7fee900d3160 2024-09-11T23:26:51.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.337+0000 7fee8ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee9006db50 0x7fee90161630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:51.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.337+0000 7fee8ea00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee9006db50 0x7fee90161630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34286/0 (socket says 172.21.15.144:34286) 2024-09-11T23:26:51.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.337+0000 7fee8ea00640 1 -- 172.21.15.144:0/2181617530 learned_addr learned my addr 172.21.15.144:0/2181617530 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:51.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.337+0000 7fee8e000640 1 --2- 172.21.15.144:0/2181617530 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee900d3160 0x7fee9015b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:51.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.337+0000 7fee8f400640 1 --2- 172.21.15.144:0/2181617530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee9015e6a0 0x7fee9015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:51.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.337+0000 7fee8ea00640 1 -- 172.21.15.144:0/2181617530 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee900d3160 msgr2=0x7fee9015b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:51.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.337+0000 7fee8ea00640 1 --2- 172.21.15.144:0/2181617530 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee900d3160 0x7fee9015b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:51.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.337+0000 7fee8ea00640 1 -- 172.21.15.144:0/2181617530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee9015e6a0 msgr2=0x7fee9015ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:51.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.337+0000 7fee8ea00640 1 --2- 172.21.15.144:0/2181617530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee9015e6a0 0x7fee9015ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:51.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.337+0000 7fee8ea00640 1 -- 172.21.15.144:0/2181617530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee9015c060 con 0x7fee9006db50 2024-09-11T23:26:51.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.337+0000 7fee8e000640 1 --2- 172.21.15.144:0/2181617530 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee900d3160 0x7fee9015b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:51.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.337+0000 7fee8ea00640 1 --2- 172.21.15.144:0/2181617530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee9006db50 0x7fee90161630 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fee8000c400 tx=0x7fee8000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:51.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.337+0000 7fee87400640 1 -- 172.21.15.144:0/2181617530 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee80017070 con 0x7fee9006db50 2024-09-11T23:26:51.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.337+0000 7fee87400640 1 -- 172.21.15.144:0/2181617530 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee800052d0 con 0x7fee9006db50 2024-09-11T23:26:51.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.337+0000 7fee87400640 1 -- 172.21.15.144:0/2181617530 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee80003830 con 0x7fee9006db50 2024-09-11T23:26:51.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.338+0000 7fee8fe00640 1 -- 172.21.15.144:0/2181617530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee9015ec90 con 0x7fee9006db50 2024-09-11T23:26:51.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.338+0000 7fee8fe00640 1 -- 172.21.15.144:0/2181617530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee9015a880 con 0x7fee9006db50 2024-09-11T23:26:51.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.339+0000 7fee8fe00640 1 -- 172.21.15.144:0/2181617530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee900b6400 con 0x7fee9006db50 2024-09-11T23:26:51.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.340+0000 7fee87400640 1 -- 172.21.15.144:0/2181617530 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7fee8001a070 con 0x7fee9006db50 2024-09-11T23:26:51.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.340+0000 7fee87400640 1 --2- 172.21.15.144:0/2181617530 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fee7006c970 0x7fee7006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:51.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.341+0000 7fee87400640 1 -- 172.21.15.144:0/2181617530 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5795+0+0 (secure 0 0 0) 0x7fee80088db0 con 0x7fee9006db50 2024-09-11T23:26:51.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.341+0000 7fee8e000640 1 --2- 172.21.15.144:0/2181617530 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fee7006c970 0x7fee7006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:51.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.342+0000 7fee8e000640 1 --2- 172.21.15.144:0/2181617530 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fee7006c970 0x7fee7006ee30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fee7c034000 tx=0x7fee7c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:51.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.345+0000 7fee87400640 1 -- 172.21.15.144:0/2181617530 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee900b6400 con 0x7fee9006db50 2024-09-11T23:26:51.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:51.518+0000 7fee8fe00640 1 -- 172.21.15.144:0/2181617530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fee9015ea80 con 0x7fee9006db50 2024-09-11T23:26:52.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.155+0000 7fee87400640 1 -- 172.21.15.144:0/2181617530 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v168) ==== 181+0+0 (secure 0 0 0) 0x7fee80058f60 con 0x7fee9006db50 2024-09-11T23:26:52.155 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_metadata' removed 2024-09-11T23:26:52.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.158+0000 7fee8fe00640 1 -- 172.21.15.144:0/2181617530 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fee7006c970 msgr2=0x7fee7006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:52.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.158+0000 7fee8fe00640 1 --2- 172.21.15.144:0/2181617530 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fee7006c970 0x7fee7006ee30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fee7c034000 tx=0x7fee7c02e000 comp rx=0 tx=0).stop 2024-09-11T23:26:52.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.158+0000 7fee8fe00640 1 -- 172.21.15.144:0/2181617530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee9006db50 msgr2=0x7fee90161630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:52.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.158+0000 7fee8fe00640 1 --2- 172.21.15.144:0/2181617530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee9006db50 0x7fee90161630 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fee8000c400 tx=0x7fee8000c8c0 comp rx=0 tx=0).stop 2024-09-11T23:26:52.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.159+0000 7fee8fe00640 1 -- 172.21.15.144:0/2181617530 shutdown_connections 2024-09-11T23:26:52.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.159+0000 7fee8fe00640 1 --2- 172.21.15.144:0/2181617530 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fee7006c970 0x7fee7006ee30 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:52.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.159+0000 7fee8fe00640 1 --2- 172.21.15.144:0/2181617530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee9015e6a0 0x7fee9015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:52.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.159+0000 7fee8fe00640 1 --2- 172.21.15.144:0/2181617530 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fee900d3160 0x7fee9015b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:52.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.159+0000 7fee8fe00640 1 --2- 172.21.15.144:0/2181617530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee9006db50 0x7fee90161630 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:52.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.159+0000 7fee8fe00640 1 -- 172.21.15.144:0/2181617530 >> 172.21.15.144:0/2181617530 conn(0x7fee900d4700 msgr2=0x7fee900b3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:52.159 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.159+0000 7fee8fe00640 1 -- 172.21.15.144:0/2181617530 shutdown_connections 2024-09-11T23:26:52.160 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.159+0000 7fee8fe00640 1 -- 172.21.15.144:0/2181617530 wait complete. 2024-09-11T23:26:52.176 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T23:26:52.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.334+0000 7f2a61200640 1 Processor -- start 2024-09-11T23:26:52.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.334+0000 7f2a61200640 1 -- start start 2024-09-11T23:26:52.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.335+0000 7f2a61200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f2a5c161bd0 0x7f2a5c0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:52.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.335+0000 7f2a61200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2a5c0cff90 0x7f2a5c0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:52.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.335+0000 7f2a61200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a5c072040 con 0x7f2a5c0cdf90 2024-09-11T23:26:52.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.335+0000 7f2a61200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f2a5c072490 con 0x7f2a5c0cff90 2024-09-11T23:26:52.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.335+0000 7f2a61200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f2a5c072770 con 0x7f2a5c161bd0 2024-09-11T23:26:52.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.335+0000 7f2a5be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2a5c0cff90 0x7f2a5c0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:52.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.335+0000 7f2a5be00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2a5c0cff90 0x7f2a5c0b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34302/0 (socket says 172.21.15.144:34302) 2024-09-11T23:26:52.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.335+0000 7f2a5be00640 1 -- 172.21.15.144:0/2952236171 learned_addr learned my addr 172.21.15.144:0/2952236171 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:52.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.335+0000 7f2a5b400640 1 --2- 172.21.15.144:0/2952236171 >> v2:172.21.15.165:3300/0 conn(0x7f2a5c161bd0 0x7f2a5c0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:52.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.336+0000 7f2a5be00640 1 -- 172.21.15.144:0/2952236171 >> v2:172.21.15.165:3300/0 conn(0x7f2a5c161bd0 msgr2=0x7f2a5c0715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:52.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.336+0000 7f2a5be00640 1 --2- 172.21.15.144:0/2952236171 >> v2:172.21.15.165:3300/0 conn(0x7f2a5c161bd0 0x7f2a5c0715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:52.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.336+0000 7f2a5be00640 1 -- 172.21.15.144:0/2952236171 >> v1:172.21.15.165:6789/0 conn(0x7f2a5c0cdf90 legacy=0x7f2a5c0cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:52.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.336+0000 7f2a5be00640 1 -- 172.21.15.144:0/2952236171 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5c072a50 con 0x7f2a5c0cff90 2024-09-11T23:26:52.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.337+0000 7f2a5be00640 1 --2- 172.21.15.144:0/2952236171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a5c0cff90 0x7f2a5c0b4720 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0757a0 tx=0x7f2a5402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0115dde4810bf9c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:52.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.337+0000 7f2a5a000640 1 -- 172.21.15.144:0/2952236171 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a54036070 con 0x7f2a5c0cff90 2024-09-11T23:26:52.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.337+0000 7f2a5a000640 1 -- 172.21.15.144:0/2952236171 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a54031600 con 0x7f2a5c0cff90 2024-09-11T23:26:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.337+0000 7f2a5a000640 1 -- 172.21.15.144:0/2952236171 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a540319d0 con 0x7f2a5c0cff90 2024-09-11T23:26:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.337+0000 7f2a61200640 1 -- 172.21.15.144:0/2952236171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a5c0cff90 msgr2=0x7f2a5c0b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.337+0000 7f2a61200640 1 --2- 172.21.15.144:0/2952236171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a5c0cff90 0x7f2a5c0b4720 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0757a0 tx=0x7f2a5402a610 comp rx=0 tx=0).stop 2024-09-11T23:26:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.338+0000 7f2a61200640 1 -- 172.21.15.144:0/2952236171 shutdown_connections 2024-09-11T23:26:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.338+0000 7f2a61200640 1 --2- 172.21.15.144:0/2952236171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a5c0cff90 0x7f2a5c0b4720 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.338+0000 7f2a61200640 1 --2- 172.21.15.144:0/2952236171 >> v2:172.21.15.165:3300/0 conn(0x7f2a5c161bd0 0x7f2a5c0715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.338+0000 7f2a61200640 1 -- 172.21.15.144:0/2952236171 >> 172.21.15.144:0/2952236171 conn(0x7f2a5c0cd470 msgr2=0x7f2a5c0cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.338+0000 7f2a61200640 1 -- 172.21.15.144:0/2952236171 shutdown_connections 2024-09-11T23:26:52.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.338+0000 7f2a61200640 1 -- 172.21.15.144:0/2952236171 wait complete. 2024-09-11T23:26:52.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.339+0000 7f2a61200640 1 Processor -- start 2024-09-11T23:26:52.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.339+0000 7f2a61200640 1 -- start start 2024-09-11T23:26:52.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.340+0000 7f2a61200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a5c0cdf90 0x7f2a5c14c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:52.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.340+0000 7f2a61200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a5c0cff90 0x7f2a5c148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:52.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.340+0000 7f2a61200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a5c161bd0 0x7f2a5c14cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:52.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.340+0000 7f2a61200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c0b4de0 con 0x7f2a5c0cdf90 2024-09-11T23:26:52.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.340+0000 7f2a61200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c0b4c60 con 0x7f2a5c0cff90 2024-09-11T23:26:52.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.340+0000 7f2a61200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f2a5c0b4f60 con 0x7f2a5c161bd0 2024-09-11T23:26:52.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.340+0000 7f2a5b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a5c0cdf90 0x7f2a5c14c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:52.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.341+0000 7f2a5b400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a5c0cdf90 0x7f2a5c14c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34308/0 (socket says 172.21.15.144:34308) 2024-09-11T23:26:52.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.341+0000 7f2a5b400640 1 -- 172.21.15.144:0/203154232 learned_addr learned my addr 172.21.15.144:0/203154232 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:52.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.341+0000 7f2a5be00640 1 --2- 172.21.15.144:0/203154232 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a5c161bd0 0x7f2a5c14cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:52.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.341+0000 7f2a5aa00640 1 --2- 172.21.15.144:0/203154232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a5c0cff90 0x7f2a5c148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:52.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.341+0000 7f2a5b400640 1 -- 172.21.15.144:0/203154232 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a5c161bd0 msgr2=0x7f2a5c14cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:52.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.341+0000 7f2a5b400640 1 --2- 172.21.15.144:0/203154232 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a5c161bd0 0x7f2a5c14cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:52.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.341+0000 7f2a5b400640 1 -- 172.21.15.144:0/203154232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a5c0cff90 msgr2=0x7f2a5c148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:52.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.341+0000 7f2a5b400640 1 --2- 172.21.15.144:0/203154232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a5c0cff90 0x7f2a5c148d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:52.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.341+0000 7f2a5b400640 1 -- 172.21.15.144:0/203154232 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5c14c5c0 con 0x7f2a5c0cdf90 2024-09-11T23:26:52.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.341+0000 7f2a5be00640 1 --2- 172.21.15.144:0/203154232 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a5c161bd0 0x7f2a5c14cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:52.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.341+0000 7f2a5b400640 1 --2- 172.21.15.144:0/203154232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a5c0cdf90 0x7f2a5c14c080 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00e870 tx=0x7f2a4c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:52.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.341+0000 7f2a53400640 1 -- 172.21.15.144:0/203154232 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c017070 con 0x7f2a5c0cdf90 2024-09-11T23:26:52.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.341+0000 7f2a53400640 1 -- 172.21.15.144:0/203154232 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a4c00c940 con 0x7f2a5c0cdf90 2024-09-11T23:26:52.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.341+0000 7f2a53400640 1 -- 172.21.15.144:0/203154232 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c00cd30 con 0x7f2a5c0cdf90 2024-09-11T23:26:52.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.342+0000 7f2a61200640 1 -- 172.21.15.144:0/203154232 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a5c149ae0 con 0x7f2a5c0cdf90 2024-09-11T23:26:52.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.342+0000 7f2a61200640 1 -- 172.21.15.144:0/203154232 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a5c14a0a0 con 0x7f2a5c0cdf90 2024-09-11T23:26:52.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.343+0000 7f2a61200640 1 -- 172.21.15.144:0/203154232 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a5c0b4720 con 0x7f2a5c0cdf90 2024-09-11T23:26:52.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.344+0000 7f2a53400640 1 -- 172.21.15.144:0/203154232 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f2a4c01a070 con 0x7f2a5c0cdf90 2024-09-11T23:26:52.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.344+0000 7f2a53400640 1 --2- 172.21.15.144:0/203154232 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2a3c06c970 0x7f2a3c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:52.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.345+0000 7f2a53400640 1 -- 172.21.15.144:0/203154232 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5357+0+0 (secure 0 0 0) 0x7f2a4c089900 con 0x7f2a5c0cdf90 2024-09-11T23:26:52.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.345+0000 7f2a5aa00640 1 --2- 172.21.15.144:0/203154232 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2a3c06c970 0x7f2a3c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:52.345 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.346+0000 7f2a5aa00640 1 --2- 172.21.15.144:0/203154232 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2a3c06c970 0x7f2a3c06ee30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0b65c0 tx=0x7f2a48009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:52.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.349+0000 7f2a53400640 1 -- 172.21.15.144:0/203154232 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a5c14c5c0 con 0x7f2a5c0cdf90 2024-09-11T23:26:52.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:52.526+0000 7f2a61200640 1 -- 172.21.15.144:0/203154232 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2a5c149280 con 0x7f2a5c0cdf90 2024-09-11T23:26:53.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.156+0000 7f2a53400640 1 -- 172.21.15.144:0/203154232 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v169) ==== 169+0+0 (secure 0 0 0) 0x7f2a4c059ab0 con 0x7f2a5c0cdf90 2024-09-11T23:26:53.157 INFO:teuthology.orchestra.run.smithi144.stderr:pool 'cephfs_data' removed 2024-09-11T23:26:53.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.160+0000 7f2a61200640 1 -- 172.21.15.144:0/203154232 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2a3c06c970 msgr2=0x7f2a3c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:53.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.160+0000 7f2a61200640 1 --2- 172.21.15.144:0/203154232 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2a3c06c970 0x7f2a3c06ee30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0b65c0 tx=0x7f2a48009040 comp rx=0 tx=0).stop 2024-09-11T23:26:53.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.160+0000 7f2a61200640 1 -- 172.21.15.144:0/203154232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a5c0cdf90 msgr2=0x7f2a5c14c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:53.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.160+0000 7f2a61200640 1 --2- 172.21.15.144:0/203154232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a5c0cdf90 0x7f2a5c14c080 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00e870 tx=0x7f2a4c00ec70 comp rx=0 tx=0).stop 2024-09-11T23:26:53.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.160+0000 7f2a61200640 1 -- 172.21.15.144:0/203154232 shutdown_connections 2024-09-11T23:26:53.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.160+0000 7f2a61200640 1 --2- 172.21.15.144:0/203154232 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f2a3c06c970 0x7f2a3c06ee30 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.160+0000 7f2a61200640 1 --2- 172.21.15.144:0/203154232 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f2a5c161bd0 0x7f2a5c14cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.160+0000 7f2a61200640 1 --2- 172.21.15.144:0/203154232 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a5c0cff90 0x7f2a5c148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.160+0000 7f2a61200640 1 --2- 172.21.15.144:0/203154232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a5c0cdf90 0x7f2a5c14c080 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.160+0000 7f2a61200640 1 -- 172.21.15.144:0/203154232 >> 172.21.15.144:0/203154232 conn(0x7f2a5c0cd470 msgr2=0x7f2a5c0b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:53.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.161+0000 7f2a61200640 1 -- 172.21.15.144:0/203154232 shutdown_connections 2024-09-11T23:26:53.162 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.161+0000 7f2a61200640 1 -- 172.21.15.144:0/203154232 wait complete. 2024-09-11T23:26:53.181 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-11T23:26:53.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.337+0000 7fb743000640 1 Processor -- start 2024-09-11T23:26:53.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.337+0000 7fb743000640 1 -- start start 2024-09-11T23:26:53.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.338+0000 7fb743000640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb73c159dd0 0x7fb73c0cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:53.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.338+0000 7fb743000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb73c0cf260 0x7fb73c0cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:53.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.338+0000 7fb743000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb73c0cfd20 con 0x7fb73c06bba0 2024-09-11T23:26:53.339 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.338+0000 7fb743000640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fb73c0cd4e0 con 0x7fb73c159dd0 2024-09-11T23:26:53.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.338+0000 7fb743000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb73c0cd7c0 con 0x7fb73c0cf260 2024-09-11T23:26:53.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.339+0000 7fb741c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb73c159dd0 0x7fb73c0cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:53.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.339+0000 7fb741c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb73c159dd0 0x7fb73c0cdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34316/0 (socket says 172.21.15.144:34316) 2024-09-11T23:26:53.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.339+0000 7fb741c00640 1 -- 172.21.15.144:0/2355629742 learned_addr learned my addr 172.21.15.144:0/2355629742 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:53.340 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.339+0000 7fb742600640 1 --1- 172.21.15.144:0/2355629742 >> v1:172.21.15.144:6789/0 conn(0x7fb73c06bba0 0x7fb73c15d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:43736/0 (socket says 172.21.15.144:43736) 2024-09-11T23:26:53.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.339+0000 7fb741200640 1 --2- 172.21.15.144:0/2355629742 >> v2:172.21.15.165:3300/0 conn(0x7fb73c0cf260 0x7fb73c0cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:53.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.339+0000 7fb741c00640 1 -- 172.21.15.144:0/2355629742 >> v2:172.21.15.165:3300/0 conn(0x7fb73c0cf260 msgr2=0x7fb73c0cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:53.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.339+0000 7fb741c00640 1 --2- 172.21.15.144:0/2355629742 >> v2:172.21.15.165:3300/0 conn(0x7fb73c0cf260 0x7fb73c0cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.339+0000 7fb741c00640 1 -- 172.21.15.144:0/2355629742 >> v1:172.21.15.144:6789/0 conn(0x7fb73c06bba0 legacy=0x7fb73c15d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:53.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.339+0000 7fb741c00640 1 -- 172.21.15.144:0/2355629742 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb73c0cdaa0 con 0x7fb73c159dd0 2024-09-11T23:26:53.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.339+0000 7fb741200640 1 --2- 172.21.15.144:0/2355629742 >> v2:172.21.15.165:3300/0 conn(0x7fb73c0cf260 0x7fb73c0cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:53.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.340+0000 7fb741c00640 1 --2- 172.21.15.144:0/2355629742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb73c159dd0 0x7fb73c0cdfc0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0afd60 tx=0x7fb73002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2837c7482b1db68 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:53.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.340+0000 7fb73be00640 1 -- 172.21.15.144:0/2355629742 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb730037070 con 0x7fb73c159dd0 2024-09-11T23:26:53.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.341+0000 7fb73be00640 1 -- 172.21.15.144:0/2355629742 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb730032440 con 0x7fb73c159dd0 2024-09-11T23:26:53.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.341+0000 7fb73be00640 1 -- 172.21.15.144:0/2355629742 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb730032810 con 0x7fb73c159dd0 2024-09-11T23:26:53.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.341+0000 7fb743000640 1 -- 172.21.15.144:0/2355629742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb73c159dd0 msgr2=0x7fb73c0cdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:53.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.341+0000 7fb743000640 1 --2- 172.21.15.144:0/2355629742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb73c159dd0 0x7fb73c0cdfc0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0afd60 tx=0x7fb73002a270 comp rx=0 tx=0).stop 2024-09-11T23:26:53.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.341+0000 7fb743000640 1 -- 172.21.15.144:0/2355629742 shutdown_connections 2024-09-11T23:26:53.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.341+0000 7fb743000640 1 --2- 172.21.15.144:0/2355629742 >> v2:172.21.15.165:3300/0 conn(0x7fb73c0cf260 0x7fb73c0cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.341+0000 7fb743000640 1 --2- 172.21.15.144:0/2355629742 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb73c159dd0 0x7fb73c0cdfc0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.341+0000 7fb743000640 1 -- 172.21.15.144:0/2355629742 >> 172.21.15.144:0/2355629742 conn(0x7fb73c0d0300 msgr2=0x7fb73c0d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:53.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.341+0000 7fb743000640 1 -- 172.21.15.144:0/2355629742 shutdown_connections 2024-09-11T23:26:53.343 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.341+0000 7fb743000640 1 -- 172.21.15.144:0/2355629742 wait complete. 2024-09-11T23:26:53.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.343+0000 7fb743000640 1 Processor -- start 2024-09-11T23:26:53.344 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.343+0000 7fb743000640 1 -- start start 2024-09-11T23:26:53.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.344+0000 7fb743000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb73c06bba0 0x7fb73c14d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:53.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.344+0000 7fb743000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb73c0cf260 0x7fb73c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:53.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.344+0000 7fb743000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb73c159dd0 0x7fb73c0b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:53.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.344+0000 7fb743000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c06bfe0 con 0x7fb73c06bba0 2024-09-11T23:26:53.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.344+0000 7fb743000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c15d6d0 con 0x7fb73c0cf260 2024-09-11T23:26:53.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.344+0000 7fb743000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb73c06c160 con 0x7fb73c159dd0 2024-09-11T23:26:53.346 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.344+0000 7fb741c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb73c06bba0 0x7fb73c14d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:53.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.344+0000 7fb741c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb73c06bba0 0x7fb73c14d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34324/0 (socket says 172.21.15.144:34324) 2024-09-11T23:26:53.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.344+0000 7fb741c00640 1 -- 172.21.15.144:0/4052034809 learned_addr learned my addr 172.21.15.144:0/4052034809 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:53.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.344+0000 7fb741c00640 1 -- 172.21.15.144:0/4052034809 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb73c159dd0 msgr2=0x7fb73c0b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:53.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.344+0000 7fb741200640 1 --2- 172.21.15.144:0/4052034809 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb73c0cf260 0x7fb73c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:53.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.344+0000 7fb742600640 1 --2- 172.21.15.144:0/4052034809 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb73c159dd0 0x7fb73c0b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:53.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.345+0000 7fb741c00640 1 --2- 172.21.15.144:0/4052034809 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb73c159dd0 0x7fb73c0b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.345+0000 7fb741c00640 1 -- 172.21.15.144:0/4052034809 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb73c0cf260 msgr2=0x7fb73c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:53.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.345+0000 7fb741c00640 1 --2- 172.21.15.144:0/4052034809 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb73c0cf260 0x7fb73c0b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.345+0000 7fb741c00640 1 -- 172.21.15.144:0/4052034809 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb73c14dc70 con 0x7fb73c06bba0 2024-09-11T23:26:53.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.345+0000 7fb741200640 1 --2- 172.21.15.144:0/4052034809 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb73c0cf260 0x7fb73c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:53.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.345+0000 7fb742600640 1 --2- 172.21.15.144:0/4052034809 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb73c159dd0 0x7fb73c0b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:53.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.345+0000 7fb741c00640 1 --2- 172.21.15.144:0/4052034809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb73c06bba0 0x7fb73c14d730 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fb73002a2b0 tx=0x7fb7300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:53.347 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.345+0000 7fb739600640 1 -- 172.21.15.144:0/4052034809 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb730037040 con 0x7fb73c06bba0 2024-09-11T23:26:53.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.345+0000 7fb739600640 1 -- 172.21.15.144:0/4052034809 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb730042070 con 0x7fb73c06bba0 2024-09-11T23:26:53.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.345+0000 7fb739600640 1 -- 172.21.15.144:0/4052034809 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb730030bb0 con 0x7fb73c06bba0 2024-09-11T23:26:53.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.345+0000 7fb743000640 1 -- 172.21.15.144:0/4052034809 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb73c153b30 con 0x7fb73c06bba0 2024-09-11T23:26:53.348 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.345+0000 7fb743000640 1 -- 172.21.15.144:0/4052034809 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb73c1540f0 con 0x7fb73c06bba0 2024-09-11T23:26:53.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.346+0000 7fb743000640 1 -- 172.21.15.144:0/4052034809 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb73c0cedb0 con 0x7fb73c06bba0 2024-09-11T23:26:53.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.347+0000 7fb739600640 1 -- 172.21.15.144:0/4052034809 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7fb730047460 con 0x7fb73c06bba0 2024-09-11T23:26:53.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.348+0000 7fb739600640 1 --2- 172.21.15.144:0/4052034809 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb71c06c970 0x7fb71c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:53.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.348+0000 7fb739600640 1 -- 172.21.15.144:0/4052034809 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7fb7300aa4b0 con 0x7fb73c06bba0 2024-09-11T23:26:53.349 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.349+0000 7fb741200640 1 --2- 172.21.15.144:0/4052034809 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb71c06c970 0x7fb71c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:53.350 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.349+0000 7fb741200640 1 --2- 172.21.15.144:0/4052034809 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb71c06c970 0x7fb71c06ee30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb73c1fbf20 tx=0x7fb728008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:53.353 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.352+0000 7fb739600640 1 -- 172.21.15.144:0/4052034809 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb73c0cedb0 con 0x7fb73c06bba0 2024-09-11T23:26:53.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.526+0000 7fb743000640 1 -- 172.21.15.144:0/4052034809 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fb73c0cf6d0 con 0x7fb73c06bba0 2024-09-11T23:26:53.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.530+0000 7fb739600640 1 -- 172.21.15.144:0/4052034809 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7fb73c14dc70 con 0x7fb73c06bba0 2024-09-11T23:26:53.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.532+0000 7fb743000640 1 -- 172.21.15.144:0/4052034809 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb71c06c970 msgr2=0x7fb71c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:53.533 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.532+0000 7fb743000640 1 --2- 172.21.15.144:0/4052034809 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb71c06c970 0x7fb71c06ee30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb73c1fbf20 tx=0x7fb728008040 comp rx=0 tx=0).stop 2024-09-11T23:26:53.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.532+0000 7fb743000640 1 -- 172.21.15.144:0/4052034809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb73c06bba0 msgr2=0x7fb73c14d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:53.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.532+0000 7fb743000640 1 --2- 172.21.15.144:0/4052034809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb73c06bba0 0x7fb73c14d730 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fb73002a2b0 tx=0x7fb7300046c0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.532+0000 7fb743000640 1 -- 172.21.15.144:0/4052034809 shutdown_connections 2024-09-11T23:26:53.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.532+0000 7fb743000640 1 --2- 172.21.15.144:0/4052034809 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb71c06c970 0x7fb71c06ee30 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.532+0000 7fb743000640 1 --2- 172.21.15.144:0/4052034809 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb73c159dd0 0x7fb73c0b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.532+0000 7fb743000640 1 --2- 172.21.15.144:0/4052034809 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb73c0cf260 0x7fb73c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.532+0000 7fb743000640 1 --2- 172.21.15.144:0/4052034809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb73c06bba0 0x7fb73c14d730 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.532+0000 7fb743000640 1 -- 172.21.15.144:0/4052034809 >> 172.21.15.144:0/4052034809 conn(0x7fb73c0d0300 msgr2=0x7fb73c0cdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:53.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.532+0000 7fb743000640 1 -- 172.21.15.144:0/4052034809 shutdown_connections 2024-09-11T23:26:53.534 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.533+0000 7fb743000640 1 -- 172.21.15.144:0/4052034809 wait complete. 2024-09-11T23:26:53.549 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade' 2024-09-11T23:26:53.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.704+0000 7fcd08c00640 1 Processor -- start 2024-09-11T23:26:53.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.704+0000 7fcd08c00640 1 -- start start 2024-09-11T23:26:53.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.705+0000 7fcd08c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fcd0415e640 0x7fcd040d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:53.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.705+0000 7fcd08c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd040d3f60 0x7fcd040b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:53.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.705+0000 7fcd08c00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd0406bee0 con 0x7fcd040b6510 2024-09-11T23:26:53.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.705+0000 7fcd08c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fcd0415ea20 con 0x7fcd040d3f60 2024-09-11T23:26:53.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.705+0000 7fcd08c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fcd0406caf0 con 0x7fcd0415e640 2024-09-11T23:26:53.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.705+0000 7fcd02a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd040d3f60 0x7fcd040b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:53.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.705+0000 7fcd02a00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcd040d3f60 0x7fcd040b5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34334/0 (socket says 172.21.15.144:34334) 2024-09-11T23:26:53.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.705+0000 7fcd02a00640 1 -- 172.21.15.144:0/3815085143 learned_addr learned my addr 172.21.15.144:0/3815085143 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:53.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.706+0000 7fcd03400640 1 --2- 172.21.15.144:0/3815085143 >> v2:172.21.15.165:3300/0 conn(0x7fcd0415e640 0x7fcd040d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:53.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.706+0000 7fcd02a00640 1 -- 172.21.15.144:0/3815085143 >> v2:172.21.15.165:3300/0 conn(0x7fcd0415e640 msgr2=0x7fcd040d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:53.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.706+0000 7fcd02a00640 1 --2- 172.21.15.144:0/3815085143 >> v2:172.21.15.165:3300/0 conn(0x7fcd0415e640 0x7fcd040d3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.706+0000 7fcd02a00640 1 -- 172.21.15.144:0/3815085143 >> v1:172.21.15.165:6789/0 conn(0x7fcd040b6510 legacy=0x7fcd040d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:53.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.706+0000 7fcd02a00640 1 -- 172.21.15.144:0/3815085143 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0406c1c0 con 0x7fcd040d3f60 2024-09-11T23:26:53.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.707+0000 7fcd02a00640 1 --2- 172.21.15.144:0/3815085143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd040d3f60 0x7fcd040b5fd0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fcd040d2030 tx=0x7fccf002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbd1120186b5786 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:53.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.707+0000 7fcd02000640 1 -- 172.21.15.144:0/3815085143 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf0037070 con 0x7fcd040d3f60 2024-09-11T23:26:53.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.707+0000 7fcd02000640 1 -- 172.21.15.144:0/3815085143 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccf0032440 con 0x7fcd040d3f60 2024-09-11T23:26:53.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.707+0000 7fcd02000640 1 -- 172.21.15.144:0/3815085143 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf0032810 con 0x7fcd040d3f60 2024-09-11T23:26:53.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.707+0000 7fcd08c00640 1 -- 172.21.15.144:0/3815085143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd040d3f60 msgr2=0x7fcd040b5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:53.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.707+0000 7fcd08c00640 1 --2- 172.21.15.144:0/3815085143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd040d3f60 0x7fcd040b5fd0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fcd040d2030 tx=0x7fccf002a230 comp rx=0 tx=0).stop 2024-09-11T23:26:53.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.708+0000 7fcd08c00640 1 -- 172.21.15.144:0/3815085143 shutdown_connections 2024-09-11T23:26:53.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.708+0000 7fcd08c00640 1 --2- 172.21.15.144:0/3815085143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd040d3f60 0x7fcd040b5fd0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.708+0000 7fcd08c00640 1 --2- 172.21.15.144:0/3815085143 >> v2:172.21.15.165:3300/0 conn(0x7fcd0415e640 0x7fcd040d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.708+0000 7fcd08c00640 1 -- 172.21.15.144:0/3815085143 >> 172.21.15.144:0/3815085143 conn(0x7fcd040d0fd0 msgr2=0x7fcd040d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:53.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.708+0000 7fcd08c00640 1 -- 172.21.15.144:0/3815085143 shutdown_connections 2024-09-11T23:26:53.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.708+0000 7fcd08c00640 1 -- 172.21.15.144:0/3815085143 wait complete. 2024-09-11T23:26:53.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.709+0000 7fcd08c00640 1 Processor -- start 2024-09-11T23:26:53.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.709+0000 7fcd08c00640 1 -- start start 2024-09-11T23:26:53.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.710+0000 7fcd08c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd040b6510 0x7fcd0415ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:53.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.710+0000 7fcd08c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd040d3f60 0x7fcd041f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.710+0000 7fcd08c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd0415e640 0x7fcd04155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.710+0000 7fcd08c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcd040b8760 con 0x7fcd0415e640 2024-09-11T23:26:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.710+0000 7fcd08c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0406c780 con 0x7fcd040b6510 2024-09-11T23:26:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.710+0000 7fcd08c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fcd040b88e0 con 0x7fcd040d3f60 2024-09-11T23:26:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.710+0000 7fcd03e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd0415e640 0x7fcd04155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.710+0000 7fcd03e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd0415e640 0x7fcd04155d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:34338/0 (socket says 172.21.15.144:34338) 2024-09-11T23:26:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.710+0000 7fcd03e00640 1 -- 172.21.15.144:0/3410878904 learned_addr learned my addr 172.21.15.144:0/3410878904 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.711+0000 7fcd03400640 1 --2- 172.21.15.144:0/3410878904 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd040b6510 0x7fcd0415ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.711+0000 7fcd02a00640 1 --2- 172.21.15.144:0/3410878904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd040d3f60 0x7fcd041f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:53.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.711+0000 7fcd03e00640 1 -- 172.21.15.144:0/3410878904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd040d3f60 msgr2=0x7fcd041f52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.711+0000 7fcd03e00640 1 --2- 172.21.15.144:0/3410878904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd040d3f60 0x7fcd041f52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.711+0000 7fcd03e00640 1 -- 172.21.15.144:0/3410878904 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd040b6510 msgr2=0x7fcd0415ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.711+0000 7fcd03e00640 1 --2- 172.21.15.144:0/3410878904 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd040b6510 0x7fcd0415ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.711+0000 7fcd03e00640 1 -- 172.21.15.144:0/3410878904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd041562d0 con 0x7fcd0415e640 2024-09-11T23:26:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.711+0000 7fcd03e00640 1 --2- 172.21.15.144:0/3410878904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd0415e640 0x7fcd04155d90 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00c7b0 tx=0x7fccfc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.711+0000 7fccfb400640 1 -- 172.21.15.144:0/3410878904 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc004b60 con 0x7fcd0415e640 2024-09-11T23:26:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.711+0000 7fccfb400640 1 -- 172.21.15.144:0/3410878904 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccfc004d00 con 0x7fcd0415e640 2024-09-11T23:26:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.711+0000 7fccfb400640 1 -- 172.21.15.144:0/3410878904 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00aa90 con 0x7fcd0415e640 2024-09-11T23:26:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.711+0000 7fcd08c00640 1 -- 172.21.15.144:0/3410878904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd0415f2e0 con 0x7fcd0415e640 2024-09-11T23:26:53.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.712+0000 7fcd08c00640 1 -- 172.21.15.144:0/3410878904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd0415f8a0 con 0x7fcd0415e640 2024-09-11T23:26:53.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.713+0000 7fcd08c00640 1 -- 172.21.15.144:0/3410878904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd040b5fd0 con 0x7fcd0415e640 2024-09-11T23:26:53.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.714+0000 7fccfb400640 1 -- 172.21.15.144:0/3410878904 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7fccfc00ac30 con 0x7fcd0415e640 2024-09-11T23:26:53.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.714+0000 7fccfb400640 1 --2- 172.21.15.144:0/3410878904 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcce406c970 0x7fcce406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:53.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.715+0000 7fccfb400640 1 -- 172.21.15.144:0/3410878904 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7fccfc089af0 con 0x7fcd0415e640 2024-09-11T23:26:53.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.715+0000 7fcd03400640 1 --2- 172.21.15.144:0/3410878904 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcce406c970 0x7fcce406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:53.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.716+0000 7fcd03400640 1 --2- 172.21.15.144:0/3410878904 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcce406c970 0x7fcce406ee30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcd0415d470 tx=0x7fccf4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:53.719 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.719+0000 7fccfb400640 1 -- 172.21.15.144:0/3410878904 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fccfc020070 con 0x7fcd0415e640 2024-09-11T23:26:53.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:53.957+0000 7fcd08c00640 1 -- 172.21.15.144:0/3410878904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7fcd040b3e20 con 0x7fcd0415e640 2024-09-11T23:26:54.168 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:54.167+0000 7fccfb400640 1 -- 172.21.15.144:0/3410878904 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]}]=0 v495) ==== 163+0+0 (secure 0 0 0) 0x7fccfc0596b0 con 0x7fcd0415e640 2024-09-11T23:26:54.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:54.170+0000 7fcd08c00640 1 -- 172.21.15.144:0/3410878904 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcce406c970 msgr2=0x7fcce406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:54.170 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:54.170+0000 7fcd08c00640 1 --2- 172.21.15.144:0/3410878904 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcce406c970 0x7fcce406ee30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcd0415d470 tx=0x7fccf4008040 comp rx=0 tx=0).stop 2024-09-11T23:26:54.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:54.170+0000 7fcd08c00640 1 -- 172.21.15.144:0/3410878904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd0415e640 msgr2=0x7fcd04155d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:54.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:54.170+0000 7fcd08c00640 1 --2- 172.21.15.144:0/3410878904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd0415e640 0x7fcd04155d90 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00c7b0 tx=0x7fccfc00cc70 comp rx=0 tx=0).stop 2024-09-11T23:26:54.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:54.170+0000 7fcd08c00640 1 -- 172.21.15.144:0/3410878904 shutdown_connections 2024-09-11T23:26:54.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:54.170+0000 7fcd08c00640 1 --2- 172.21.15.144:0/3410878904 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fcce406c970 0x7fcce406ee30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:54.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:54.170+0000 7fcd08c00640 1 --2- 172.21.15.144:0/3410878904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcd0415e640 0x7fcd04155d90 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:54.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:54.170+0000 7fcd08c00640 1 --2- 172.21.15.144:0/3410878904 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fcd040d3f60 0x7fcd041f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:54.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:54.170+0000 7fcd08c00640 1 --2- 172.21.15.144:0/3410878904 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd040b6510 0x7fcd0415ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:54.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:54.170+0000 7fcd08c00640 1 -- 172.21.15.144:0/3410878904 >> 172.21.15.144:0/3410878904 conn(0x7fcd040d0fd0 msgr2=0x7fcd040b4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:54.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:54.170+0000 7fcd08c00640 1 -- 172.21.15.144:0/3410878904 shutdown_connections 2024-09-11T23:26:54.171 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:54.170+0000 7fcd08c00640 1 -- 172.21.15.144:0/3410878904 wait complete. 2024-09-11T23:26:54.186 INFO:tasks.cephfs_test_runner:Validate unparseable text .meta file on legacy subvol root doesn't break the system ... ok 2024-09-11T23:26:54.187 INFO:tasks.cephfs_test_runner: 2024-09-11T23:26:54.187 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-11T23:26:54.187 INFO:tasks.cephfs_test_runner:Ran 11 tests in 504.569s 2024-09-11T23:26:54.187 INFO:tasks.cephfs_test_runner: 2024-09-11T23:26:54.187 INFO:tasks.cephfs_test_runner:OK 2024-09-11T23:26:54.187 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-11T23:26:54.197 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-11T23:26:54.264 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-11T23:26:54.264 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:26:54.264 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:54.299 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:26:54.300 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-11T23:26:54.300 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:54.376 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-11T23:26:54.376 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:26:54.376 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:54.416 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:26:54.416 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-11T23:26:54.417 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T23:26:54.496 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-11T23:26:54.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:54.496 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-11T23:26:54.532 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T23:26:54.532 INFO:teuthology.orchestra.run.smithi144.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-11T23:26:54.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:54.532 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T23:26:54.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:54.629 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-11T23:26:54.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:54.893 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2024-09-11T23:26:55.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:55.230 DEBUG:teuthology.orchestra.run.smithi144:> ip netns list 2024-09-11T23:26:55.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:55.265 DEBUG:teuthology.orchestra.run.smithi144:> sudo ip link delete ceph-brx 2024-09-11T23:26:55.367 INFO:teuthology.orchestra.run.smithi144.stderr:Cannot find device "ceph-brx" 2024-09-11T23:26:55.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:26:55.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:55.371 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-11T23:26:55.410 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-11T23:26:55.410 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-11T23:26:55.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:55.411 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-11T23:26:55.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:55.512 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-11T23:26:55.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:55.750 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link delete ceph-brx 2024-09-11T23:26:56.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:56.056 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-11T23:26:56.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T23:26:56.091 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link delete ceph-brx 2024-09-11T23:26:56.193 INFO:teuthology.orchestra.run.smithi165.stderr:Cannot find device "ceph-brx" 2024-09-11T23:26:56.196 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:26:56.196 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-11T23:26:56.205 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T23:26:56.206 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:26:56.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.368+0000 7eff8ae00640 1 Processor -- start 2024-09-11T23:26:56.369 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.368+0000 7eff8ae00640 1 -- start start 2024-09-11T23:26:56.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.369+0000 7eff8ae00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7eff8406c2b0 0x7eff84169290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:56.370 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.369+0000 7eff8ae00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff840b0380 con 0x7eff84162ad0 2024-09-11T23:26:56.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.369+0000 7eff8ae00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff8415f0e0 con 0x7eff8415e3f0 2024-09-11T23:26:56.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.369+0000 7eff8ae00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7eff840b30d0 con 0x7eff8406c2b0 2024-09-11T23:26:56.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.370+0000 7eff88e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7eff8406c2b0 0x7eff84169290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:56.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.370+0000 7eff88e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7eff8406c2b0 0x7eff84169290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37080/0 (socket says 172.21.15.144:37080) 2024-09-11T23:26:56.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.370+0000 7eff88e00640 1 -- 172.21.15.144:0/3278812418 learned_addr learned my addr 172.21.15.144:0/3278812418 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:56.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.370+0000 7eff83400640 1 --1- 172.21.15.144:0/3278812418 >> v1:172.21.15.144:6789/0 conn(0x7eff84162ad0 0x7eff8406bba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55130/0 (socket says 172.21.15.144:55130) 2024-09-11T23:26:56.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.370+0000 7eff88e00640 1 -- 172.21.15.144:0/3278812418 >> v1:172.21.15.165:6789/0 conn(0x7eff8415e3f0 legacy=0x7eff8415e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:56.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.370+0000 7eff88e00640 1 -- 172.21.15.144:0/3278812418 >> v1:172.21.15.144:6789/0 conn(0x7eff84162ad0 legacy=0x7eff8406bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:56.371 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.370+0000 7eff88e00640 1 -- 172.21.15.144:0/3278812418 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff8415f3c0 con 0x7eff8406c2b0 2024-09-11T23:26:56.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.371+0000 7eff88e00640 1 --2- 172.21.15.144:0/3278812418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff8406c2b0 0x7eff84169290 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009e50 tx=0x7eff7c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c9758b7165c37a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:56.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.371+0000 7eff82a00640 1 -- 172.21.15.144:0/3278812418 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c036070 con 0x7eff8406c2b0 2024-09-11T23:26:56.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.371+0000 7eff82a00640 1 -- 172.21.15.144:0/3278812418 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c031600 con 0x7eff8406c2b0 2024-09-11T23:26:56.372 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.371+0000 7eff82a00640 1 -- 172.21.15.144:0/3278812418 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c0319d0 con 0x7eff8406c2b0 2024-09-11T23:26:56.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.372+0000 7eff8ae00640 1 -- 172.21.15.144:0/3278812418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff8406c2b0 msgr2=0x7eff84169290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:56.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.372+0000 7eff8ae00640 1 --2- 172.21.15.144:0/3278812418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff8406c2b0 0x7eff84169290 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009e50 tx=0x7eff7c02a730 comp rx=0 tx=0).stop 2024-09-11T23:26:56.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.372+0000 7eff8ae00640 1 -- 172.21.15.144:0/3278812418 shutdown_connections 2024-09-11T23:26:56.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.372+0000 7eff8ae00640 1 --2- 172.21.15.144:0/3278812418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff8406c2b0 0x7eff84169290 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.372+0000 7eff8ae00640 1 -- 172.21.15.144:0/3278812418 >> 172.21.15.144:0/3278812418 conn(0x7eff8406ce90 msgr2=0x7eff8406d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:56.373 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.372+0000 7eff8ae00640 1 -- 172.21.15.144:0/3278812418 shutdown_connections 2024-09-11T23:26:56.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.372+0000 7eff8ae00640 1 -- 172.21.15.144:0/3278812418 wait complete. 2024-09-11T23:26:56.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.374+0000 7eff8ae00640 1 Processor -- start 2024-09-11T23:26:56.374 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.374+0000 7eff8ae00640 1 -- start start 2024-09-11T23:26:56.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.375+0000 7eff8ae00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff8406c2b0 0x7eff84072230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:56.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.375+0000 7eff8ae00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff8415e3f0 0x7eff840ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:56.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.375+0000 7eff8ae00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff84162ad0 0x7eff840b6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:56.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.375+0000 7eff8ae00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7eff8415f980 con 0x7eff8406c2b0 2024-09-11T23:26:56.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.375+0000 7eff8ae00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7eff84162f40 con 0x7eff84162ad0 2024-09-11T23:26:56.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.375+0000 7eff8ae00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7eff840b1840 con 0x7eff8415e3f0 2024-09-11T23:26:56.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.375+0000 7eff83e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff8406c2b0 0x7eff84072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:56.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.375+0000 7eff83e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff8406c2b0 0x7eff84072230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37082/0 (socket says 172.21.15.144:37082) 2024-09-11T23:26:56.377 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.375+0000 7eff83e00640 1 -- 172.21.15.144:0/3167803363 learned_addr learned my addr 172.21.15.144:0/3167803363 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:56.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.375+0000 7eff83400640 1 --2- 172.21.15.144:0/3167803363 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff8415e3f0 0x7eff840ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:56.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.375+0000 7eff88e00640 1 --2- 172.21.15.144:0/3167803363 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff84162ad0 0x7eff840b6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:56.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.375+0000 7eff83e00640 1 -- 172.21.15.144:0/3167803363 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff8415e3f0 msgr2=0x7eff840ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:56.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.375+0000 7eff83e00640 1 --2- 172.21.15.144:0/3167803363 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff8415e3f0 0x7eff840ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.375+0000 7eff83e00640 1 -- 172.21.15.144:0/3167803363 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff84162ad0 msgr2=0x7eff840b6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:56.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.375+0000 7eff83e00640 1 --2- 172.21.15.144:0/3167803363 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff84162ad0 0x7eff840b6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.375+0000 7eff83e00640 1 -- 172.21.15.144:0/3167803363 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff840b5bf0 con 0x7eff8406c2b0 2024-09-11T23:26:56.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.376+0000 7eff83e00640 1 --2- 172.21.15.144:0/3167803363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff8406c2b0 0x7eff84072230 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7eff7400c400 tx=0x7eff7400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:56.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.376+0000 7eff7be00640 1 -- 172.21.15.144:0/3167803363 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff740052d0 con 0x7eff8406c2b0 2024-09-11T23:26:56.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.376+0000 7eff7be00640 1 -- 172.21.15.144:0/3167803363 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff74005490 con 0x7eff8406c2b0 2024-09-11T23:26:56.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.376+0000 7eff7be00640 1 -- 172.21.15.144:0/3167803363 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74007260 con 0x7eff8406c2b0 2024-09-11T23:26:56.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.376+0000 7eff8ae00640 1 -- 172.21.15.144:0/3167803363 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff840b5ed0 con 0x7eff8406c2b0 2024-09-11T23:26:56.378 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.376+0000 7eff8ae00640 1 -- 172.21.15.144:0/3167803363 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff840b6490 con 0x7eff8406c2b0 2024-09-11T23:26:56.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.377+0000 7eff8ae00640 1 -- 172.21.15.144:0/3167803363 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff8406bba0 con 0x7eff8406c2b0 2024-09-11T23:26:56.379 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.378+0000 7eff7be00640 1 -- 172.21.15.144:0/3167803363 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7eff74007400 con 0x7eff8406c2b0 2024-09-11T23:26:56.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.379+0000 7eff7be00640 1 --2- 172.21.15.144:0/3167803363 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff6406c970 0x7eff6406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:56.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.379+0000 7eff7be00640 1 -- 172.21.15.144:0/3167803363 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7eff74088e80 con 0x7eff8406c2b0 2024-09-11T23:26:56.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.379+0000 7eff83400640 1 --2- 172.21.15.144:0/3167803363 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff6406c970 0x7eff6406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:56.380 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.380+0000 7eff83400640 1 --2- 172.21.15.144:0/3167803363 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff6406c970 0x7eff6406ee30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7eff840b59e0 tx=0x7eff70000ed0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:56.384 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.383+0000 7eff7be00640 1 -- 172.21.15.144:0/3167803363 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7eff74058a40 con 0x7eff8406c2b0 2024-09-11T23:26:56.553 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.553+0000 7eff8ae00640 1 -- 172.21.15.144:0/3167803363 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff8415eb50 con 0x7eff6406c970 2024-09-11T23:26:56.555 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.555+0000 7eff7be00640 1 -- 172.21.15.144:0/3167803363 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13510 (secure 0 0 0) 0x7eff8415eb50 con 0x7eff6406c970 2024-09-11T23:26:56.555 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:56.555 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:26:56.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.556+0000 7eff8ae00640 1 -- 172.21.15.144:0/3167803363 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff6406c970 msgr2=0x7eff6406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:56.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.556+0000 7eff8ae00640 1 --2- 172.21.15.144:0/3167803363 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff6406c970 0x7eff6406ee30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7eff840b59e0 tx=0x7eff70000ed0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.556+0000 7eff8ae00640 1 -- 172.21.15.144:0/3167803363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff8406c2b0 msgr2=0x7eff84072230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:56.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.556+0000 7eff8ae00640 1 --2- 172.21.15.144:0/3167803363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff8406c2b0 0x7eff84072230 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7eff7400c400 tx=0x7eff7400c8c0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.557 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.556+0000 7eff8ae00640 1 -- 172.21.15.144:0/3167803363 shutdown_connections 2024-09-11T23:26:56.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.556+0000 7eff8ae00640 1 --2- 172.21.15.144:0/3167803363 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7eff6406c970 0x7eff6406ee30 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.556+0000 7eff8ae00640 1 --2- 172.21.15.144:0/3167803363 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff84162ad0 0x7eff840b6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.556+0000 7eff8ae00640 1 --2- 172.21.15.144:0/3167803363 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7eff8415e3f0 0x7eff840ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.556+0000 7eff8ae00640 1 --2- 172.21.15.144:0/3167803363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7eff8406c2b0 0x7eff84072230 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.556+0000 7eff8ae00640 1 -- 172.21.15.144:0/3167803363 >> 172.21.15.144:0/3167803363 conn(0x7eff8406ce90 msgr2=0x7eff8406e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:56.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.556+0000 7eff8ae00640 1 -- 172.21.15.144:0/3167803363 shutdown_connections 2024-09-11T23:26:56.558 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.556+0000 7eff8ae00640 1 -- 172.21.15.144:0/3167803363 wait complete. 2024-09-11T23:26:56.573 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":241,"stamp":"2024-09-11T23:26:54.780492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":271292,"kb_used_data":17652,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703428,"statfs":{"total":773094113280,"available":772816310272,"internally_reserved":0,"allocated":18075648,"data_stored":8673632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52218,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-69,"num_write_kb":-76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001795"},"pg_stats":[{"pgid":"1.0","version":"72'128","reported_seq":480,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-11T23:26:50.627047+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:26:50.627047+0000","last_peered":"2024-09-11T23:26:50.627047+0000","last_clean":"2024-09-11T23:26:50.627047+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:26:50.627047+0000","last_undegraded":"2024-09-11T23:26:50.627047+0000","last_fullsized":"2024-09-11T23:26:50.627047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476849,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33868,"kb_used_data":2684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337972,"statfs":{"total":96636764160,"available":96602083328,"internally_reserved":0,"allocated":2748416,"data_stored":1571763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476848,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2093056,"data_stored":921194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476847,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33240,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2101248,"data_stored":926972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476847,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33296,"kb_used_data":2112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338544,"statfs":{"total":96636764160,"available":96602669056,"internally_reserved":0,"allocated":2162688,"data_stored":975690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542256,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33232,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338608,"statfs":{"total":96636764160,"available":96602734592,"internally_reserved":0,"allocated":2097152,"data_stored":920491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542256,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33236,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338604,"statfs":{"total":96636764160,"available":96602730496,"internally_reserved":0,"allocated":2097152,"data_stored":926390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509552,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2093056,"data_stored":920365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509552,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37964,"kb_used_data":2620,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333876,"statfs":{"total":96636764160,"available":96597889024,"internally_reserved":0,"allocated":2682880,"data_stored":1510767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:26:56.573 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:26:56.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.726+0000 7fc4dc800640 1 Processor -- start 2024-09-11T23:26:56.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.726+0000 7fc4dc800640 1 -- start start 2024-09-11T23:26:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.727+0000 7fc4dc800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc4d415e7b0 0x7fc4d4071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.727+0000 7fc4dc800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc4d406ccb0 0x7fc4d406d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.727+0000 7fc4dc800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d4071880 con 0x7fc4d40b5600 2024-09-11T23:26:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.727+0000 7fc4dc800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d406e680 con 0x7fc4d406ccb0 2024-09-11T23:26:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.727+0000 7fc4dc800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d40741c0 con 0x7fc4d415e7b0 2024-09-11T23:26:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.728+0000 7fc4da800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc4d406ccb0 0x7fc4d406d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.728+0000 7fc4da800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc4d406ccb0 0x7fc4d406d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37084/0 (socket says 172.21.15.144:37084) 2024-09-11T23:26:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.728+0000 7fc4d9e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc4d415e7b0 0x7fc4d4071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.728+0000 7fc4da800640 1 -- 172.21.15.144:0/1057731814 learned_addr learned my addr 172.21.15.144:0/1057731814 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.728+0000 7fc4d9400640 1 --1- 172.21.15.144:0/1057731814 >> v1:172.21.15.144:6789/0 conn(0x7fc4d40b5600 0x7fc4d4073ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55142/0 (socket says 172.21.15.144:55142) 2024-09-11T23:26:56.729 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.728+0000 7fc4da800640 1 -- 172.21.15.144:0/1057731814 >> v2:172.21.15.165:3300/0 conn(0x7fc4d415e7b0 msgr2=0x7fc4d4071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:56.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.728+0000 7fc4da800640 1 --2- 172.21.15.144:0/1057731814 >> v2:172.21.15.165:3300/0 conn(0x7fc4d415e7b0 0x7fc4d4071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.728+0000 7fc4da800640 1 -- 172.21.15.144:0/1057731814 >> v1:172.21.15.144:6789/0 conn(0x7fc4d40b5600 legacy=0x7fc4d4073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:56.730 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.728+0000 7fc4da800640 1 -- 172.21.15.144:0/1057731814 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d406e8d0 con 0x7fc4d406ccb0 2024-09-11T23:26:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.729+0000 7fc4da800640 1 --2- 172.21.15.144:0/1057731814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4d406ccb0 0x7fc4d406d0d0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4050260 tx=0x7fc4d002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f351a1bb1e98b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.729+0000 7fc4d8a00640 1 -- 172.21.15.144:0/1057731814 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0036070 con 0x7fc4d406ccb0 2024-09-11T23:26:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.729+0000 7fc4d8a00640 1 -- 172.21.15.144:0/1057731814 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d0031600 con 0x7fc4d406ccb0 2024-09-11T23:26:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.729+0000 7fc4d8a00640 1 -- 172.21.15.144:0/1057731814 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00319d0 con 0x7fc4d406ccb0 2024-09-11T23:26:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.730+0000 7fc4dc800640 1 -- 172.21.15.144:0/1057731814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4d406ccb0 msgr2=0x7fc4d406d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.730+0000 7fc4dc800640 1 --2- 172.21.15.144:0/1057731814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4d406ccb0 0x7fc4d406d0d0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4050260 tx=0x7fc4d002a6a0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.730+0000 7fc4dc800640 1 -- 172.21.15.144:0/1057731814 shutdown_connections 2024-09-11T23:26:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.730+0000 7fc4dc800640 1 --2- 172.21.15.144:0/1057731814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4d406ccb0 0x7fc4d406d0d0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.731 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.730+0000 7fc4dc800640 1 --2- 172.21.15.144:0/1057731814 >> v2:172.21.15.165:3300/0 conn(0x7fc4d415e7b0 0x7fc4d4071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.730+0000 7fc4dc800640 1 -- 172.21.15.144:0/1057731814 >> 172.21.15.144:0/1057731814 conn(0x7fc4d40b4300 msgr2=0x7fc4d40b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:56.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.730+0000 7fc4dc800640 1 -- 172.21.15.144:0/1057731814 shutdown_connections 2024-09-11T23:26:56.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.730+0000 7fc4dc800640 1 -- 172.21.15.144:0/1057731814 wait complete. 2024-09-11T23:26:56.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.731+0000 7fc4dc800640 1 Processor -- start 2024-09-11T23:26:56.732 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.732+0000 7fc4dc800640 1 -- start start 2024-09-11T23:26:56.734 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.732+0000 7fc4dc800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4d406ccb0 0x7fc4d413e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:56.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.732+0000 7fc4dc800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4d40b5600 0x7fc4d4157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:56.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.732+0000 7fc4dc800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4d415e7b0 0x7fc4d415cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:56.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.732+0000 7fc4dc800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d4073590 con 0x7fc4d415e7b0 2024-09-11T23:26:56.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.732+0000 7fc4dc800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d40732b0 con 0x7fc4d406ccb0 2024-09-11T23:26:56.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.732+0000 7fc4dc800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc4d406d610 con 0x7fc4d40b5600 2024-09-11T23:26:56.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.733+0000 7fc4da800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4d415e7b0 0x7fc4d415cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:56.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.733+0000 7fc4da800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4d415e7b0 0x7fc4d415cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37098/0 (socket says 172.21.15.144:37098) 2024-09-11T23:26:56.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.733+0000 7fc4da800640 1 -- 172.21.15.144:0/720223812 learned_addr learned my addr 172.21.15.144:0/720223812 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:56.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.733+0000 7fc4d9e00640 1 --2- 172.21.15.144:0/720223812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4d406ccb0 0x7fc4d413e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:56.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.733+0000 7fc4d9400640 1 --2- 172.21.15.144:0/720223812 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4d40b5600 0x7fc4d4157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:56.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.733+0000 7fc4da800640 1 -- 172.21.15.144:0/720223812 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4d40b5600 msgr2=0x7fc4d4157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:56.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.733+0000 7fc4da800640 1 --2- 172.21.15.144:0/720223812 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4d40b5600 0x7fc4d4157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.733+0000 7fc4da800640 1 -- 172.21.15.144:0/720223812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4d406ccb0 msgr2=0x7fc4d413e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:56.735 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.733+0000 7fc4da800640 1 --2- 172.21.15.144:0/720223812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4d406ccb0 0x7fc4d413e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.733+0000 7fc4da800640 1 -- 172.21.15.144:0/720223812 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d413eea0 con 0x7fc4d415e7b0 2024-09-11T23:26:56.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.733+0000 7fc4d9e00640 1 --2- 172.21.15.144:0/720223812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4d406ccb0 0x7fc4d413e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:56.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.733+0000 7fc4d9400640 1 --2- 172.21.15.144:0/720223812 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4d40b5600 0x7fc4d4157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:56.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.734+0000 7fc4da800640 1 --2- 172.21.15.144:0/720223812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4d415e7b0 0x7fc4d415cc50 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fc4d002ac90 tx=0x7fc4d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:56.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.734+0000 7fc4ce000640 1 -- 172.21.15.144:0/720223812 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d003f020 con 0x7fc4d415e7b0 2024-09-11T23:26:56.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.734+0000 7fc4ce000640 1 -- 172.21.15.144:0/720223812 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4d0037040 con 0x7fc4d415e7b0 2024-09-11T23:26:56.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.734+0000 7fc4ce000640 1 -- 172.21.15.144:0/720223812 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0036070 con 0x7fc4d415e7b0 2024-09-11T23:26:56.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.734+0000 7fc4dc800640 1 -- 172.21.15.144:0/720223812 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d4154500 con 0x7fc4d415e7b0 2024-09-11T23:26:56.736 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.734+0000 7fc4dc800640 1 -- 172.21.15.144:0/720223812 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4d4154ac0 con 0x7fc4d415e7b0 2024-09-11T23:26:56.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.735+0000 7fc4dc800640 1 -- 172.21.15.144:0/720223812 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4d406d0d0 con 0x7fc4d415e7b0 2024-09-11T23:26:56.737 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.736+0000 7fc4ce000640 1 -- 172.21.15.144:0/720223812 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7fc4d0042020 con 0x7fc4d415e7b0 2024-09-11T23:26:56.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.737+0000 7fc4ce000640 1 --2- 172.21.15.144:0/720223812 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc4b806c970 0x7fc4b806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:56.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.737+0000 7fc4ce000640 1 -- 172.21.15.144:0/720223812 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7fc4d00a9ce0 con 0x7fc4d415e7b0 2024-09-11T23:26:56.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.737+0000 7fc4d9e00640 1 --2- 172.21.15.144:0/720223812 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc4b806c970 0x7fc4b806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:56.738 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.738+0000 7fc4d9e00640 1 --2- 172.21.15.144:0/720223812 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc4b806c970 0x7fc4b806ee30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009a20 tx=0x7fc4c8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:56.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.741+0000 7fc4ce000640 1 -- 172.21.15.144:0/720223812 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc4d0049030 con 0x7fc4d415e7b0 2024-09-11T23:26:56.912 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.911+0000 7fc4dc800640 1 -- 172.21.15.144:0/720223812 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc4d40b4e50 con 0x7fc4b806c970 2024-09-11T23:26:56.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.913+0000 7fc4ce000640 1 -- 172.21.15.144:0/720223812 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13506 (secure 0 0 0) 0x7fc4d40b4e50 con 0x7fc4b806c970 2024-09-11T23:26:56.913 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:56.914 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:26:56.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.915+0000 7fc4dc800640 1 -- 172.21.15.144:0/720223812 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc4b806c970 msgr2=0x7fc4b806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:56.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.915+0000 7fc4dc800640 1 --2- 172.21.15.144:0/720223812 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc4b806c970 0x7fc4b806ee30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009a20 tx=0x7fc4c8008040 comp rx=0 tx=0).stop 2024-09-11T23:26:56.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.915+0000 7fc4dc800640 1 -- 172.21.15.144:0/720223812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4d415e7b0 msgr2=0x7fc4d415cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:56.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.915+0000 7fc4dc800640 1 --2- 172.21.15.144:0/720223812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4d415e7b0 0x7fc4d415cc50 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fc4d002ac90 tx=0x7fc4d0004a40 comp rx=0 tx=0).stop 2024-09-11T23:26:56.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.915+0000 7fc4dc800640 1 -- 172.21.15.144:0/720223812 shutdown_connections 2024-09-11T23:26:56.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.915+0000 7fc4dc800640 1 --2- 172.21.15.144:0/720223812 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc4b806c970 0x7fc4b806ee30 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.915+0000 7fc4dc800640 1 --2- 172.21.15.144:0/720223812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4d415e7b0 0x7fc4d415cc50 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.916 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.915+0000 7fc4dc800640 1 --2- 172.21.15.144:0/720223812 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc4d40b5600 0x7fc4d4157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.915+0000 7fc4dc800640 1 --2- 172.21.15.144:0/720223812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4d406ccb0 0x7fc4d413e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:56.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.915+0000 7fc4dc800640 1 -- 172.21.15.144:0/720223812 >> 172.21.15.144:0/720223812 conn(0x7fc4d40b4300 msgr2=0x7fc4d40d2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:56.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.915+0000 7fc4dc800640 1 -- 172.21.15.144:0/720223812 shutdown_connections 2024-09-11T23:26:56.917 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:56.915+0000 7fc4dc800640 1 -- 172.21.15.144:0/720223812 wait complete. 2024-09-11T23:26:56.931 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-09-11T23:26:56.781010+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":271444,"kb_used_data":17768,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703276,"statfs":{"total":773094113280,"available":772816154624,"internally_reserved":0,"allocated":18194432,"data_stored":8673270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52218,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-69,"num_write_kb":-76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.629612"},"pg_stats":[{"pgid":"1.0","version":"72'128","reported_seq":484,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T23:26:53.162262+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:26:53.162262+0000","last_peered":"2024-09-11T23:26:53.162262+0000","last_clean":"2024-09-11T23:26:53.162262+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:26:53.162262+0000","last_undegraded":"2024-09-11T23:26:53.162262+0000","last_fullsized":"2024-09-11T23:26:53.162262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476850,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33848,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337992,"statfs":{"total":96636764160,"available":96602103808,"internally_reserved":0,"allocated":2723840,"data_stored":1528326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476849,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33268,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338572,"statfs":{"total":96636764160,"available":96602697728,"internally_reserved":0,"allocated":2129920,"data_stored":937958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33272,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2129920,"data_stored":937958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476848,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33252,"kb_used_data":2064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338588,"statfs":{"total":96636764160,"available":96602714112,"internally_reserved":0,"allocated":2113536,"data_stored":932393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33268,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338572,"statfs":{"total":96636764160,"available":96602697728,"internally_reserved":0,"allocated":2129920,"data_stored":937958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33272,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2129920,"data_stored":937958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509553,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33256,"kb_used_data":2064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338584,"statfs":{"total":96636764160,"available":96602710016,"internally_reserved":0,"allocated":2113536,"data_stored":932393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509553,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38008,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333832,"statfs":{"total":96636764160,"available":96597843968,"internally_reserved":0,"allocated":2723840,"data_stored":1528326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:26:56.932 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T23:26:56.932 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:26:57.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.084+0000 7f4cc1800640 1 Processor -- start 2024-09-11T23:26:57.085 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.084+0000 7f4cc1800640 1 -- start start 2024-09-11T23:26:57.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.085+0000 7f4cc1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4cbc151c50 0x7f4cbc0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:57.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.085+0000 7f4cc1800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f4cbc06c1f0 0x7f4cbc15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:57.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.085+0000 7f4cc1800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cbc0cd5f0 con 0x7f4cbc06be10 2024-09-11T23:26:57.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.085+0000 7f4cc1800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f4cbc0cd8d0 con 0x7f4cbc06c1f0 2024-09-11T23:26:57.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.085+0000 7f4cc1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4cbc0cdbb0 con 0x7f4cbc151c50 2024-09-11T23:26:57.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.086+0000 7f4cbaa00640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f4cbc06be10 0x7f4cbc151540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:49274/0 (socket says 172.21.15.144:49274) 2024-09-11T23:26:57.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.086+0000 7f4cbaa00640 1 -- 172.21.15.144:0/304805057 learned_addr learned my addr 172.21.15.144:0/304805057 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:57.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.086+0000 7f4cbb400640 1 --2- 172.21.15.144:0/304805057 >> v2:172.21.15.165:3300/0 conn(0x7f4cbc06c1f0 0x7f4cbc15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:57.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.086+0000 7f4cb3e00640 1 --2- 172.21.15.144:0/304805057 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4cbc151c50 0x7f4cbc0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:57.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.086+0000 7f4cbb400640 1 -- 172.21.15.144:0/304805057 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4cbc151c50 msgr2=0x7f4cbc0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:57.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.086+0000 7f4cbb400640 1 --2- 172.21.15.144:0/304805057 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4cbc151c50 0x7f4cbc0cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:57.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.086+0000 7f4cbb400640 1 -- 172.21.15.144:0/304805057 >> v1:172.21.15.165:6789/0 conn(0x7f4cbc06be10 legacy=0x7f4cbc151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:57.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.086+0000 7f4cba000640 1 -- 172.21.15.144:0/304805057 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2798635055 0 0) 0x7f4cbc0cd5f0 con 0x7f4cbc06be10 2024-09-11T23:26:57.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.086+0000 7f4cbb400640 1 -- 172.21.15.144:0/304805057 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cbc0cde90 con 0x7f4cbc06c1f0 2024-09-11T23:26:57.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.087+0000 7f4cbb400640 1 --2- 172.21.15.144:0/304805057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4cbc06c1f0 0x7f4cbc15baa0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009d90 tx=0x7f4cb402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d33dc8d5adb7f31 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:57.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.087+0000 7f4cba000640 1 -- 172.21.15.144:0/304805057 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4007740 con 0x7f4cbc06c1f0 2024-09-11T23:26:57.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.087+0000 7f4cba000640 1 -- 172.21.15.144:0/304805057 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb40078e0 con 0x7f4cbc06c1f0 2024-09-11T23:26:57.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.087+0000 7f4cba000640 1 -- 172.21.15.144:0/304805057 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4007cb0 con 0x7f4cbc06c1f0 2024-09-11T23:26:57.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.088+0000 7f4cc1800640 1 -- 172.21.15.144:0/304805057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4cbc06c1f0 msgr2=0x7f4cbc15baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:57.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.088+0000 7f4cc1800640 1 --2- 172.21.15.144:0/304805057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4cbc06c1f0 0x7f4cbc15baa0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009d90 tx=0x7f4cb402a660 comp rx=0 tx=0).stop 2024-09-11T23:26:57.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.088+0000 7f4cc1800640 1 -- 172.21.15.144:0/304805057 shutdown_connections 2024-09-11T23:26:57.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.088+0000 7f4cc1800640 1 --2- 172.21.15.144:0/304805057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4cbc06c1f0 0x7f4cbc15baa0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:57.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.088+0000 7f4cc1800640 1 --2- 172.21.15.144:0/304805057 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4cbc151c50 0x7f4cbc0cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:57.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.088+0000 7f4cc1800640 1 -- 172.21.15.144:0/304805057 >> 172.21.15.144:0/304805057 conn(0x7f4cbc062cc0 msgr2=0x7f4cbc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:57.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.088+0000 7f4cc1800640 1 -- 172.21.15.144:0/304805057 shutdown_connections 2024-09-11T23:26:57.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.088+0000 7f4cc1800640 1 -- 172.21.15.144:0/304805057 wait complete. 2024-09-11T23:26:57.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.090+0000 7f4cc1800640 1 Processor -- start 2024-09-11T23:26:57.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.090+0000 7f4cc1800640 1 -- start start 2024-09-11T23:26:57.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.091+0000 7f4cc1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4cbc06be10 0x7f4cbc148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:57.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.091+0000 7f4cc1800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4cbc06c1f0 0x7f4cbc0b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:57.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.091+0000 7f4cc1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cbc151c50 0x7f4cbc0b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:57.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.091+0000 7f4cc1800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc0d0310 con 0x7f4cbc151c50 2024-09-11T23:26:57.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.091+0000 7f4cc1800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc0ce690 con 0x7f4cbc06c1f0 2024-09-11T23:26:57.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.091+0000 7f4cc1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f4cbc0d0490 con 0x7f4cbc06be10 2024-09-11T23:26:57.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.091+0000 7f4cbb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cbc151c50 0x7f4cbc0b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:57.092 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.091+0000 7f4cbaa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4cbc06be10 0x7f4cbc148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:57.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.091+0000 7f4cbb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cbc151c50 0x7f4cbc0b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37108/0 (socket says 172.21.15.144:37108) 2024-09-11T23:26:57.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.091+0000 7f4cbb400640 1 -- 172.21.15.144:0/218215056 learned_addr learned my addr 172.21.15.144:0/218215056 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:57.093 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.091+0000 7f4cb3e00640 1 --2- 172.21.15.144:0/218215056 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4cbc06c1f0 0x7f4cbc0b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:57.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.092+0000 7f4cbb400640 1 -- 172.21.15.144:0/218215056 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4cbc06be10 msgr2=0x7f4cbc148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:57.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.092+0000 7f4cbb400640 1 --2- 172.21.15.144:0/218215056 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4cbc06be10 0x7f4cbc148040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:57.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.092+0000 7f4cbb400640 1 -- 172.21.15.144:0/218215056 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4cbc06c1f0 msgr2=0x7f4cbc0b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:57.094 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.092+0000 7f4cbb400640 1 --2- 172.21.15.144:0/218215056 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4cbc06c1f0 0x7f4cbc0b4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:57.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.092+0000 7f4cbb400640 1 -- 172.21.15.144:0/218215056 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cbc0722f0 con 0x7f4cbc151c50 2024-09-11T23:26:57.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.092+0000 7f4cbaa00640 1 --2- 172.21.15.144:0/218215056 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4cbc06be10 0x7f4cbc148040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:26:57.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.092+0000 7f4cbb400640 1 --2- 172.21.15.144:0/218215056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cbc151c50 0x7f4cbc0b48d0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f4cb402ac50 tx=0x7f4cb4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:57.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.092+0000 7f4cb2a00640 1 -- 172.21.15.144:0/218215056 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4040070 con 0x7f4cbc151c50 2024-09-11T23:26:57.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.092+0000 7f4cb2a00640 1 -- 172.21.15.144:0/218215056 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb4031b40 con 0x7f4cbc151c50 2024-09-11T23:26:57.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.092+0000 7f4cb2a00640 1 -- 172.21.15.144:0/218215056 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4045460 con 0x7f4cbc151c50 2024-09-11T23:26:57.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.092+0000 7f4cc1800640 1 -- 172.21.15.144:0/218215056 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cbc0725d0 con 0x7f4cbc151c50 2024-09-11T23:26:57.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.093+0000 7f4cc1800640 1 -- 172.21.15.144:0/218215056 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cbc072b90 con 0x7f4cbc151c50 2024-09-11T23:26:57.096 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.094+0000 7f4cc1800640 1 -- 172.21.15.144:0/218215056 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cbc152390 con 0x7f4cbc151c50 2024-09-11T23:26:57.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.094+0000 7f4cb2a00640 1 -- 172.21.15.144:0/218215056 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f4cb4039040 con 0x7f4cbc151c50 2024-09-11T23:26:57.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.095+0000 7f4cb2a00640 1 --2- 172.21.15.144:0/218215056 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c9806c9a0 0x7f4c9806ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:57.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.095+0000 7f4cb2a00640 1 -- 172.21.15.144:0/218215056 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7f4cb40ab110 con 0x7f4cbc151c50 2024-09-11T23:26:57.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.096+0000 7f4cbaa00640 1 --2- 172.21.15.144:0/218215056 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c9806c9a0 0x7f4c9806ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:57.097 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.096+0000 7f4cbaa00640 1 --2- 172.21.15.144:0/218215056 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c9806c9a0 0x7f4c9806ee60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4cac000f60 tx=0x7f4cac007240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:57.100 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.099+0000 7f4cb2a00640 1 -- 172.21.15.144:0/218215056 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4cb407ad90 con 0x7f4cbc151c50 2024-09-11T23:26:57.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.271+0000 7f4cc1800640 1 -- 172.21.15.144:0/218215056 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4cbc0d08f0 con 0x7f4c9806c9a0 2024-09-11T23:26:57.273 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.272+0000 7f4cb2a00640 1 -- 172.21.15.144:0/218215056 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13506 (secure 0 0 0) 0x7f4cbc0d08f0 con 0x7f4c9806c9a0 2024-09-11T23:26:57.273 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:57.273 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:26:57.275 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.274+0000 7f4cc1800640 1 -- 172.21.15.144:0/218215056 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c9806c9a0 msgr2=0x7f4c9806ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:57.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.274+0000 7f4cc1800640 1 --2- 172.21.15.144:0/218215056 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c9806c9a0 0x7f4c9806ee60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4cac000f60 tx=0x7f4cac007240 comp rx=0 tx=0).stop 2024-09-11T23:26:57.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.274+0000 7f4cc1800640 1 -- 172.21.15.144:0/218215056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cbc151c50 msgr2=0x7f4cbc0b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:57.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.274+0000 7f4cc1800640 1 --2- 172.21.15.144:0/218215056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cbc151c50 0x7f4cbc0b48d0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f4cb402ac50 tx=0x7f4cb4004a40 comp rx=0 tx=0).stop 2024-09-11T23:26:57.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.275+0000 7f4cc1800640 1 -- 172.21.15.144:0/218215056 shutdown_connections 2024-09-11T23:26:57.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.275+0000 7f4cc1800640 1 --2- 172.21.15.144:0/218215056 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f4c9806c9a0 0x7f4c9806ee60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:57.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.275+0000 7f4cc1800640 1 --2- 172.21.15.144:0/218215056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cbc151c50 0x7f4cbc0b48d0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:57.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.275+0000 7f4cc1800640 1 --2- 172.21.15.144:0/218215056 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4cbc06c1f0 0x7f4cbc0b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:57.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.275+0000 7f4cc1800640 1 --2- 172.21.15.144:0/218215056 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f4cbc06be10 0x7f4cbc148040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:57.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.275+0000 7f4cc1800640 1 -- 172.21.15.144:0/218215056 >> 172.21.15.144:0/218215056 conn(0x7f4cbc062cc0 msgr2=0x7f4cbc0ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:57.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.275+0000 7f4cc1800640 1 -- 172.21.15.144:0/218215056 shutdown_connections 2024-09-11T23:26:57.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.275+0000 7f4cc1800640 1 -- 172.21.15.144:0/218215056 wait complete. 2024-09-11T23:26:57.292 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-09-11T23:26:56.781010+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":271444,"kb_used_data":17768,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703276,"statfs":{"total":773094113280,"available":772816154624,"internally_reserved":0,"allocated":18194432,"data_stored":8673270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52218,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-69,"num_write_kb":-76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.629612"},"pg_stats":[{"pgid":"1.0","version":"72'128","reported_seq":484,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T23:26:53.162262+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:26:53.162262+0000","last_peered":"2024-09-11T23:26:53.162262+0000","last_clean":"2024-09-11T23:26:53.162262+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:26:53.162262+0000","last_undegraded":"2024-09-11T23:26:53.162262+0000","last_fullsized":"2024-09-11T23:26:53.162262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476850,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33848,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337992,"statfs":{"total":96636764160,"available":96602103808,"internally_reserved":0,"allocated":2723840,"data_stored":1528326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476849,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33268,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338572,"statfs":{"total":96636764160,"available":96602697728,"internally_reserved":0,"allocated":2129920,"data_stored":937958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476848,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33272,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2129920,"data_stored":937958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476848,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33252,"kb_used_data":2064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338588,"statfs":{"total":96636764160,"available":96602714112,"internally_reserved":0,"allocated":2113536,"data_stored":932393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33268,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338572,"statfs":{"total":96636764160,"available":96602697728,"internally_reserved":0,"allocated":2129920,"data_stored":937958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33272,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2129920,"data_stored":937958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509553,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33256,"kb_used_data":2064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338584,"statfs":{"total":96636764160,"available":96602710016,"internally_reserved":0,"allocated":2113536,"data_stored":932393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509553,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38008,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333832,"statfs":{"total":96636764160,"available":96597843968,"internally_reserved":0,"allocated":2723840,"data_stored":1528326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:26:57.292 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T23:26:57.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.444+0000 7f89edc00640 1 Processor -- start 2024-09-11T23:26:57.445 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.444+0000 7f89edc00640 1 -- start start 2024-09-11T23:26:57.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.445+0000 7f89edc00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f89e815e640 0x7f89e80d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:57.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.445+0000 7f89edc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e806bee0 con 0x7f89e80b66e0 2024-09-11T23:26:57.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.445+0000 7f89edc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e806c1c0 con 0x7f89e80d3f60 2024-09-11T23:26:57.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.445+0000 7f89edc00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f89e815ea20 con 0x7f89e815e640 2024-09-11T23:26:57.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.445+0000 7f89ed200640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f89e80b66e0 0x7f89e80b7750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55154/0 (socket says 172.21.15.144:55154) 2024-09-11T23:26:57.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.446+0000 7f89ed200640 1 -- 172.21.15.144:0/2632210308 learned_addr learned my addr 172.21.15.144:0/2632210308 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:57.446 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.446+0000 7f89e7e00640 1 --2- 172.21.15.144:0/2632210308 >> v2:172.21.15.165:3300/0 conn(0x7f89e815e640 0x7f89e80d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:57.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.446+0000 7f89e6a00640 1 -- 172.21.15.144:0/2632210308 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3816815235 0 0) 0x7f89e806bee0 con 0x7f89e80b66e0 2024-09-11T23:26:57.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.446+0000 7f89e6a00640 1 -- 172.21.15.144:0/2632210308 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89cc003520 con 0x7f89e80b66e0 2024-09-11T23:26:57.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.446+0000 7f89e7e00640 1 -- 172.21.15.144:0/2632210308 >> v1:172.21.15.165:6789/0 conn(0x7f89e80d3f60 legacy=0x7f89e80b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:57.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.446+0000 7f89e7e00640 1 -- 172.21.15.144:0/2632210308 >> v1:172.21.15.144:6789/0 conn(0x7f89e80b66e0 legacy=0x7f89e80b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:57.447 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.446+0000 7f89e7e00640 1 -- 172.21.15.144:0/2632210308 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e806c4a0 con 0x7f89e815e640 2024-09-11T23:26:57.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.447+0000 7f89e7e00640 1 --2- 172.21.15.144:0/2632210308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89e815e640 0x7f89e80d3a20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f89d80097a0 tx=0x7f89d802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46d46db92d8eb1ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:57.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.447+0000 7f89e6a00640 1 -- 172.21.15.144:0/2632210308 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8037070 con 0x7f89e815e640 2024-09-11T23:26:57.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.448+0000 7f89e6a00640 1 -- 172.21.15.144:0/2632210308 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d8032440 con 0x7f89e815e640 2024-09-11T23:26:57.448 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.448+0000 7f89e6a00640 1 -- 172.21.15.144:0/2632210308 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8032810 con 0x7f89e815e640 2024-09-11T23:26:57.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.448+0000 7f89edc00640 1 -- 172.21.15.144:0/2632210308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89e815e640 msgr2=0x7f89e80d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:57.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.448+0000 7f89edc00640 1 --2- 172.21.15.144:0/2632210308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89e815e640 0x7f89e80d3a20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f89d80097a0 tx=0x7f89d802a230 comp rx=0 tx=0).stop 2024-09-11T23:26:57.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.448+0000 7f89edc00640 1 -- 172.21.15.144:0/2632210308 shutdown_connections 2024-09-11T23:26:57.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.448+0000 7f89edc00640 1 --2- 172.21.15.144:0/2632210308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89e815e640 0x7f89e80d3a20 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:57.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.448+0000 7f89edc00640 1 -- 172.21.15.144:0/2632210308 >> 172.21.15.144:0/2632210308 conn(0x7f89e80d0fd0 msgr2=0x7f89e80d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:57.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.448+0000 7f89edc00640 1 -- 172.21.15.144:0/2632210308 shutdown_connections 2024-09-11T23:26:57.449 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.448+0000 7f89edc00640 1 -- 172.21.15.144:0/2632210308 wait complete. 2024-09-11T23:26:57.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.450+0000 7f89edc00640 1 Processor -- start 2024-09-11T23:26:57.450 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.450+0000 7f89edc00640 1 -- start start 2024-09-11T23:26:57.452 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.451+0000 7f89edc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89e80b66e0 0x7f89e8153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:57.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.451+0000 7f89edc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89e80d3f60 0x7f89e80b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:57.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.451+0000 7f89edc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89e815e640 0x7f89e80b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:57.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.451+0000 7f89edc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f89e80b7e60 con 0x7f89e80b66e0 2024-09-11T23:26:57.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.451+0000 7f89edc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f89e806caf0 con 0x7f89e80d3f60 2024-09-11T23:26:57.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.451+0000 7f89edc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f89e80b7fe0 con 0x7f89e815e640 2024-09-11T23:26:57.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.451+0000 7f89e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89e80b66e0 0x7f89e8153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:57.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.451+0000 7f89e7e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89e80b66e0 0x7f89e8153ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37114/0 (socket says 172.21.15.144:37114) 2024-09-11T23:26:57.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.451+0000 7f89e7e00640 1 -- 172.21.15.144:0/1132470821 learned_addr learned my addr 172.21.15.144:0/1132470821 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:57.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.451+0000 7f89ed200640 1 --2- 172.21.15.144:0/1132470821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89e815e640 0x7f89e80b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:57.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.451+0000 7f89e7400640 1 --2- 172.21.15.144:0/1132470821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89e80d3f60 0x7f89e80b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:57.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.451+0000 7f89e7e00640 1 -- 172.21.15.144:0/1132470821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89e815e640 msgr2=0x7f89e80b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:57.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.451+0000 7f89e7e00640 1 --2- 172.21.15.144:0/1132470821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89e815e640 0x7f89e80b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:57.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.451+0000 7f89e7e00640 1 -- 172.21.15.144:0/1132470821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89e80d3f60 msgr2=0x7f89e80b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:57.453 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.451+0000 7f89e7e00640 1 --2- 172.21.15.144:0/1132470821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89e80d3f60 0x7f89e80b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:57.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.451+0000 7f89e7e00640 1 -- 172.21.15.144:0/1132470821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e8154020 con 0x7f89e80b66e0 2024-09-11T23:26:57.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.451+0000 7f89e7400640 1 --2- 172.21.15.144:0/1132470821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89e80d3f60 0x7f89e80b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:26:57.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.452+0000 7f89e7e00640 1 --2- 172.21.15.144:0/1132470821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89e80b66e0 0x7f89e8153ae0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f89d80098c0 tx=0x7f89d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:57.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.452+0000 7f89dfe00640 1 -- 172.21.15.144:0/1132470821 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8037040 con 0x7f89e80b66e0 2024-09-11T23:26:57.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.452+0000 7f89dfe00640 1 -- 172.21.15.144:0/1132470821 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d8042070 con 0x7f89e80b66e0 2024-09-11T23:26:57.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.452+0000 7f89dfe00640 1 -- 172.21.15.144:0/1132470821 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8030940 con 0x7f89e80b66e0 2024-09-11T23:26:57.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.452+0000 7f89edc00640 1 -- 172.21.15.144:0/1132470821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e80b2070 con 0x7f89e80b66e0 2024-09-11T23:26:57.454 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.452+0000 7f89edc00640 1 -- 172.21.15.144:0/1132470821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e80b2630 con 0x7f89e80b66e0 2024-09-11T23:26:57.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.453+0000 7f89edc00640 1 -- 172.21.15.144:0/1132470821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e80d3a20 con 0x7f89e80b66e0 2024-09-11T23:26:57.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.454+0000 7f89dfe00640 1 -- 172.21.15.144:0/1132470821 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f89d8030ae0 con 0x7f89e80b66e0 2024-09-11T23:26:57.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.455+0000 7f89dfe00640 1 --2- 172.21.15.144:0/1132470821 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f89c806c970 0x7f89c806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:57.455 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.455+0000 7f89dfe00640 1 -- 172.21.15.144:0/1132470821 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7f89d80aa140 con 0x7f89e80b66e0 2024-09-11T23:26:57.456 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.455+0000 7f89e7400640 1 --2- 172.21.15.144:0/1132470821 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f89c806c970 0x7f89c806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:57.457 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.456+0000 7f89e7400640 1 --2- 172.21.15.144:0/1132470821 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f89c806c970 0x7f89c806ee30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f89e80ce5b0 tx=0x7f89d4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:57.459 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.459+0000 7f89dfe00640 1 -- 172.21.15.144:0/1132470821 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f89d8045360 con 0x7f89e80b66e0 2024-09-11T23:26:57.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.635+0000 7f89edc00640 1 -- 172.21.15.144:0/1132470821 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89e80b9940 con 0x7f89e80b66e0 2024-09-11T23:26:57.636 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.636+0000 7f89dfe00640 1 -- 172.21.15.144:0/1132470821 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) ==== 74+0+13066 (secure 0 0 0) 0x7f89d807a540 con 0x7f89e80b66e0 2024-09-11T23:26:57.637 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:26:57.637 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":169,"fsid":"4b73e4b7-12f0-4e37-94bc-45e333efe84e","created":"2024-09-11T23:17:33.653648+0000","modified":"2024-09-11T23:26:53.156210+0000","last_up_change":"2024-09-11T23:17:49.173257+0000","last_in_change":"2024-09-11T23:17:37.562735+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T23:17:47.307937+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8ee6a263-c32c-4b26-ba89-8abbe15e6dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6812","nonce":1102197794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6816","nonce":1102197794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6824","nonce":1102197794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1102197794},{"type":"v1","addr":"172.21.15.144:6820","nonce":1102197794}]},"public_addr":"172.21.15.144:6812/1102197794","cluster_addr":"172.21.15.144:6816/1102197794","heartbeat_back_addr":"172.21.15.144:6824/1102197794","heartbeat_front_addr":"172.21.15.144:6820/1102197794","state":["exists","up"]},{"osd":1,"uuid":"ab3cfc5f-5bcf-465f-8c3b-71d314f3c2a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6811","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6813","nonce":4178698740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6815","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6817","nonce":4178698740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6823","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6825","nonce":4178698740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6819","nonce":4178698740},{"type":"v1","addr":"172.21.15.144:6821","nonce":4178698740}]},"public_addr":"172.21.15.144:6813/4178698740","cluster_addr":"172.21.15.144:6817/4178698740","heartbeat_back_addr":"172.21.15.144:6825/4178698740","heartbeat_front_addr":"172.21.15.144:6821/4178698740","state":["exists","up"]},{"osd":2,"uuid":"da7e5e9f-a850-4798-b221-16429c61924f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6827","nonce":645991929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6829","nonce":645991929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6833","nonce":645991929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":645991929},{"type":"v1","addr":"172.21.15.144:6831","nonce":645991929}]},"public_addr":"172.21.15.144:6827/645991929","cluster_addr":"172.21.15.144:6829/645991929","heartbeat_back_addr":"172.21.15.144:6833/645991929","heartbeat_front_addr":"172.21.15.144:6831/645991929","state":["exists","up"]},{"osd":3,"uuid":"374b73e8-1a67-4cd5-a83f-a5a06d30802e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6803","nonce":186820848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6805","nonce":186820848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6809","nonce":186820848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":186820848},{"type":"v1","addr":"172.21.15.144:6807","nonce":186820848}]},"public_addr":"172.21.15.144:6803/186820848","cluster_addr":"172.21.15.144:6805/186820848","heartbeat_back_addr":"172.21.15.144:6809/186820848","heartbeat_front_addr":"172.21.15.144:6807/186820848","state":["exists","up"]},{"osd":4,"uuid":"e6adfbab-3889-4da6-9335-b1fc597ec34e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6809","nonce":46808092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6811","nonce":46808092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6815","nonce":46808092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":46808092},{"type":"v1","addr":"172.21.15.165:6813","nonce":46808092}]},"public_addr":"172.21.15.165:6809/46808092","cluster_addr":"172.21.15.165:6811/46808092","heartbeat_back_addr":"172.21.15.165:6815/46808092","heartbeat_front_addr":"172.21.15.165:6813/46808092","state":["exists","up"]},{"osd":5,"uuid":"9fa351a1-8871-457e-b9c9-337af10351b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6801","nonce":1377669667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6803","nonce":1377669667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6807","nonce":1377669667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":1377669667},{"type":"v1","addr":"172.21.15.165:6805","nonce":1377669667}]},"public_addr":"172.21.15.165:6801/1377669667","cluster_addr":"172.21.15.165:6803/1377669667","heartbeat_back_addr":"172.21.15.165:6807/1377669667","heartbeat_front_addr":"172.21.15.165:6805/1377669667","state":["exists","up"]},{"osd":6,"uuid":"bda573ee-1d46-4077-bae2-97534d4171c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6817","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6819","nonce":1277452042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6821","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6823","nonce":1277452042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6829","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6831","nonce":1277452042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6825","nonce":1277452042},{"type":"v1","addr":"172.21.15.165:6827","nonce":1277452042}]},"public_addr":"172.21.15.165:6819/1277452042","cluster_addr":"172.21.15.165:6823/1277452042","heartbeat_back_addr":"172.21.15.165:6831/1277452042","heartbeat_front_addr":"172.21.15.165:6827/1277452042","state":["exists","up"]},{"osd":7,"uuid":"47386322-40ca-4311-969e-cb6f51923511","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6818","nonce":2335029761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6822","nonce":2335029761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6830","nonce":2335029761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":2335029761},{"type":"v1","addr":"172.21.15.165:6826","nonce":2335029761}]},"public_addr":"172.21.15.165:6818/2335029761","cluster_addr":"172.21.15.165:6822/2335029761","heartbeat_back_addr":"172.21.15.165:6830/2335029761","heartbeat_front_addr":"172.21.15.165:6826/2335029761","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.044425+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.059773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.904338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:44.966411+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.631576+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.410326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.372648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T23:17:45.685688+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.165:6835/862543799":"2024-09-12T23:26:50.146214+0000","172.21.15.165:6833/862543799":"2024-09-12T23:26:50.146214+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T23:26:57.639 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.638+0000 7f89edc00640 1 -- 172.21.15.144:0/1132470821 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f89c806c970 msgr2=0x7f89c806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.638+0000 7f89edc00640 1 --2- 172.21.15.144:0/1132470821 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f89c806c970 0x7f89c806ee30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f89e80ce5b0 tx=0x7f89d4009040 comp rx=0 tx=0).stop 2024-09-11T23:26:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.638+0000 7f89edc00640 1 -- 172.21.15.144:0/1132470821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89e80b66e0 msgr2=0x7f89e8153ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.638+0000 7f89edc00640 1 --2- 172.21.15.144:0/1132470821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89e80b66e0 0x7f89e8153ae0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f89d80098c0 tx=0x7f89d80046c0 comp rx=0 tx=0).stop 2024-09-11T23:26:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.638+0000 7f89edc00640 1 -- 172.21.15.144:0/1132470821 shutdown_connections 2024-09-11T23:26:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.638+0000 7f89edc00640 1 --2- 172.21.15.144:0/1132470821 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f89c806c970 0x7f89c806ee30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.638+0000 7f89edc00640 1 --2- 172.21.15.144:0/1132470821 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f89e815e640 0x7f89e80b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.638+0000 7f89edc00640 1 --2- 172.21.15.144:0/1132470821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89e80d3f60 0x7f89e80b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.638+0000 7f89edc00640 1 --2- 172.21.15.144:0/1132470821 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89e80b66e0 0x7f89e8153ae0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.639+0000 7f89edc00640 1 -- 172.21.15.144:0/1132470821 >> 172.21.15.144:0/1132470821 conn(0x7f89e80d0fd0 msgr2=0x7f89e80b56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.639+0000 7f89edc00640 1 -- 172.21.15.144:0/1132470821 shutdown_connections 2024-09-11T23:26:57.640 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:57.639+0000 7f89edc00640 1 -- 172.21.15.144:0/1132470821 wait complete. 2024-09-11T23:26:58.657 INFO:tasks.ceph:Scrubbing osd.0 2024-09-11T23:26:58.657 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-11T23:26:58.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.822+0000 7ff517400640 1 Processor -- start 2024-09-11T23:26:58.823 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.822+0000 7ff517400640 1 -- start start 2024-09-11T23:26:58.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.823+0000 7ff517400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff51006f070 0x7ff51015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:58.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.823+0000 7ff517400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7ff510158a90 0x7ff510158f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:58.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.823+0000 7ff517400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff51015bb70 con 0x7ff51006ec90 2024-09-11T23:26:58.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.823+0000 7ff517400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7ff510159440 con 0x7ff51006f070 2024-09-11T23:26:58.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.824+0000 7ff517400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7ff51015be10 con 0x7ff510158a90 2024-09-11T23:26:58.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.824+0000 7ff50fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff51006f070 0x7ff51015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:58.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.824+0000 7ff514a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7ff51006ec90 0x7ff5100cca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55164/0 (socket says 172.21.15.144:55164) 2024-09-11T23:26:58.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.824+0000 7ff514a00640 1 -- 172.21.15.144:0/3972644866 learned_addr learned my addr 172.21.15.144:0/3972644866 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:58.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.824+0000 7ff515400640 1 --2- 172.21.15.144:0/3972644866 >> v2:172.21.15.165:3300/0 conn(0x7ff510158a90 0x7ff510158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:58.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.824+0000 7ff50fe00640 1 -- 172.21.15.144:0/3972644866 >> v2:172.21.15.165:3300/0 conn(0x7ff510158a90 msgr2=0x7ff510158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:58.825 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.824+0000 7ff50fe00640 1 --2- 172.21.15.144:0/3972644866 >> v2:172.21.15.165:3300/0 conn(0x7ff510158a90 0x7ff510158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:58.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.824+0000 7ff50f400640 1 -- 172.21.15.144:0/3972644866 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2235485836 0 0) 0x7ff51015bb70 con 0x7ff51006ec90 2024-09-11T23:26:58.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.824+0000 7ff50fe00640 1 -- 172.21.15.144:0/3972644866 >> v1:172.21.15.144:6789/0 conn(0x7ff51006ec90 legacy=0x7ff5100cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:58.826 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.824+0000 7ff50fe00640 1 -- 172.21.15.144:0/3972644866 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51015c0f0 con 0x7ff51006f070 2024-09-11T23:26:58.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.825+0000 7ff50fe00640 1 --2- 172.21.15.144:0/3972644866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff51006f070 0x7ff51015fab0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7ff5101595c0 tx=0x7ff4fc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8beb7057ec8ddc81 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:58.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.825+0000 7ff50f400640 1 -- 172.21.15.144:0/3972644866 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc037070 con 0x7ff51006f070 2024-09-11T23:26:58.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.825+0000 7ff50f400640 1 -- 172.21.15.144:0/3972644866 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4fc02ae50 con 0x7ff51006f070 2024-09-11T23:26:58.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.826+0000 7ff50f400640 1 -- 172.21.15.144:0/3972644866 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc032660 con 0x7ff51006f070 2024-09-11T23:26:58.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.826+0000 7ff517400640 1 -- 172.21.15.144:0/3972644866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff51006f070 msgr2=0x7ff51015fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:58.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.826+0000 7ff517400640 1 --2- 172.21.15.144:0/3972644866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff51006f070 0x7ff51015fab0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7ff5101595c0 tx=0x7ff4fc02a100 comp rx=0 tx=0).stop 2024-09-11T23:26:58.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.826+0000 7ff517400640 1 -- 172.21.15.144:0/3972644866 shutdown_connections 2024-09-11T23:26:58.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.826+0000 7ff517400640 1 --2- 172.21.15.144:0/3972644866 >> v2:172.21.15.165:3300/0 conn(0x7ff510158a90 0x7ff510158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:58.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.826+0000 7ff517400640 1 --2- 172.21.15.144:0/3972644866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff51006f070 0x7ff51015fab0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:58.827 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.826+0000 7ff517400640 1 -- 172.21.15.144:0/3972644866 >> 172.21.15.144:0/3972644866 conn(0x7ff51006bba0 msgr2=0x7ff51006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:58.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.826+0000 7ff517400640 1 -- 172.21.15.144:0/3972644866 shutdown_connections 2024-09-11T23:26:58.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.826+0000 7ff517400640 1 -- 172.21.15.144:0/3972644866 wait complete. 2024-09-11T23:26:58.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.828+0000 7ff517400640 1 Processor -- start 2024-09-11T23:26:58.828 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.828+0000 7ff517400640 1 -- start start 2024-09-11T23:26:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.829+0000 7ff517400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff51006ec90 0x7ff5101f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.829+0000 7ff517400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff51006f070 0x7ff5100b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.829+0000 7ff517400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff510158a90 0x7ff5101f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.829+0000 7ff517400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff5100ce600 con 0x7ff51006ec90 2024-09-11T23:26:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.829+0000 7ff517400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff51015c6b0 con 0x7ff51006f070 2024-09-11T23:26:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.829+0000 7ff517400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7ff5100ce780 con 0x7ff510158a90 2024-09-11T23:26:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.829+0000 7ff514a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff51006ec90 0x7ff5101f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.829+0000 7ff514a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff51006ec90 0x7ff5101f40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37132/0 (socket says 172.21.15.144:37132) 2024-09-11T23:26:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.829+0000 7ff514a00640 1 -- 172.21.15.144:0/1045714197 learned_addr learned my addr 172.21.15.144:0/1045714197 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.829+0000 7ff50fe00640 1 --2- 172.21.15.144:0/1045714197 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff51006f070 0x7ff5100b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.829+0000 7ff515400640 1 --2- 172.21.15.144:0/1045714197 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff510158a90 0x7ff5101f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:58.831 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.830+0000 7ff514a00640 1 -- 172.21.15.144:0/1045714197 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff510158a90 msgr2=0x7ff5101f6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.830+0000 7ff514a00640 1 --2- 172.21.15.144:0/1045714197 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff510158a90 0x7ff5101f6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.830+0000 7ff514a00640 1 -- 172.21.15.144:0/1045714197 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff51006f070 msgr2=0x7ff5100b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.830+0000 7ff514a00640 1 --2- 172.21.15.144:0/1045714197 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff51006f070 0x7ff5100b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.830+0000 7ff514a00640 1 -- 172.21.15.144:0/1045714197 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5101f49d0 con 0x7ff51006ec90 2024-09-11T23:26:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.830+0000 7ff515400640 1 --2- 172.21.15.144:0/1045714197 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7ff510158a90 0x7ff5101f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.830+0000 7ff514a00640 1 --2- 172.21.15.144:0/1045714197 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff51006ec90 0x7ff5101f40e0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7ff50000c4d0 tx=0x7ff50000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.830+0000 7ff50cc00640 1 -- 172.21.15.144:0/1045714197 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500018070 con 0x7ff51006ec90 2024-09-11T23:26:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.830+0000 7ff50cc00640 1 -- 172.21.15.144:0/1045714197 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff500007500 con 0x7ff51006ec90 2024-09-11T23:26:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.830+0000 7ff50cc00640 1 -- 172.21.15.144:0/1045714197 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500004a20 con 0x7ff51006ec90 2024-09-11T23:26:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.830+0000 7ff517400640 1 -- 172.21.15.144:0/1045714197 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5101f4cb0 con 0x7ff51006ec90 2024-09-11T23:26:58.832 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.830+0000 7ff517400640 1 -- 172.21.15.144:0/1045714197 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5101595c0 con 0x7ff51006ec90 2024-09-11T23:26:58.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.831+0000 7ff517400640 1 -- 172.21.15.144:0/1045714197 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff510158f00 con 0x7ff51006ec90 2024-09-11T23:26:58.833 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.832+0000 7ff50cc00640 1 -- 172.21.15.144:0/1045714197 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7ff500004bc0 con 0x7ff51006ec90 2024-09-11T23:26:58.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.833+0000 7ff50cc00640 1 --2- 172.21.15.144:0/1045714197 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff4f006c970 0x7ff4f006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:58.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.833+0000 7ff50cc00640 1 -- 172.21.15.144:0/1045714197 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7ff500088c50 con 0x7ff51006ec90 2024-09-11T23:26:58.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.833+0000 7ff50cc00640 1 --2- 172.21.15.144:0/1045714197 >> [v2:172.21.15.144:6810/1102197794,v1:172.21.15.144:6812/1102197794] conn(0x7ff4f0072830 0x7ff4f0074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:58.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.833+0000 7ff50cc00640 1 -- 172.21.15.144:0/1045714197 --> [v2:172.21.15.144:6810/1102197794,v1:172.21.15.144:6812/1102197794] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4f0075300 con 0x7ff4f0072830 2024-09-11T23:26:58.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.833+0000 7ff50cc00640 1 -- 172.21.15.144:0/1045714197 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7ff500092050 con 0x7ff51006ec90 2024-09-11T23:26:58.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.834+0000 7ff50fe00640 1 --2- 172.21.15.144:0/1045714197 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff4f006c970 0x7ff4f006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:58.834 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.834+0000 7ff515400640 1 --2- 172.21.15.144:0/1045714197 >> [v2:172.21.15.144:6810/1102197794,v1:172.21.15.144:6812/1102197794] conn(0x7ff4f0072830 0x7ff4f0074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:58.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.834+0000 7ff515400640 1 --2- 172.21.15.144:0/1045714197 >> [v2:172.21.15.144:6810/1102197794,v1:172.21.15.144:6812/1102197794] conn(0x7ff4f0072830 0x7ff4f0074c50 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:58.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.834+0000 7ff50fe00640 1 --2- 172.21.15.144:0/1045714197 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff4f006c970 0x7ff4f006ee30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc034000 tx=0x7ff4fc02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:58.835 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.835+0000 7ff50cc00640 1 -- 172.21.15.144:0/1045714197 <== osd.0 v2:172.21.15.144:6810/1102197794 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff4f0075300 con 0x7ff4f0072830 2024-09-11T23:26:58.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.848+0000 7ff517400640 1 -- 172.21.15.144:0/1045714197 --> [v2:172.21.15.144:6810/1102197794,v1:172.21.15.144:6812/1102197794] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff5100b2950 con 0x7ff4f0072830 2024-09-11T23:26:58.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.848+0000 7ff50cc00640 1 -- 172.21.15.144:0/1045714197 <== osd.0 v2:172.21.15.144:6810/1102197794 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff5100b2950 con 0x7ff4f0072830 2024-09-11T23:26:58.849 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:26:58.849 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T23:26:58.850 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:26:58.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.849+0000 7ff517400640 1 -- 172.21.15.144:0/1045714197 >> [v2:172.21.15.144:6810/1102197794,v1:172.21.15.144:6812/1102197794] conn(0x7ff4f0072830 msgr2=0x7ff4f0074c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:58.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.849+0000 7ff517400640 1 --2- 172.21.15.144:0/1045714197 >> [v2:172.21.15.144:6810/1102197794,v1:172.21.15.144:6812/1102197794] conn(0x7ff4f0072830 0x7ff4f0074c50 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:58.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.849+0000 7ff517400640 1 -- 172.21.15.144:0/1045714197 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff4f006c970 msgr2=0x7ff4f006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:58.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.849+0000 7ff517400640 1 --2- 172.21.15.144:0/1045714197 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7ff4f006c970 0x7ff4f006ee30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc034000 tx=0x7ff4fc02e000 comp rx=0 tx=0).stop 2024-09-11T23:26:58.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.849+0000 7ff517400640 1 -- 172.21.15.144:0/1045714197 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff51006ec90 msgr2=0x7ff5101f40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:58.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.849+0000 7ff517400640 1 --2- 172.21.15.144:0/1045714197 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff51006ec90 0x7ff5101f40e0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7ff50000c4d0 tx=0x7ff50000c990 comp rx=0 tx=0).stop 2024-09-11T23:26:58.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.849+0000 7ff515400640 1 -- 172.21.15.144:0/1045714197 reap_dead start 2024-09-11T23:26:58.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.849+0000 7ff517400640 1 -- 172.21.15.144:0/1045714197 shutdown_connections 2024-09-11T23:26:58.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.849+0000 7ff517400640 1 -- 172.21.15.144:0/1045714197 >> 172.21.15.144:0/1045714197 conn(0x7ff51006bba0 msgr2=0x7ff5100cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:58.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.849+0000 7ff517400640 1 -- 172.21.15.144:0/1045714197 shutdown_connections 2024-09-11T23:26:58.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:58.849+0000 7ff517400640 1 -- 172.21.15.144:0/1045714197 wait complete. 2024-09-11T23:26:58.865 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-11T23:26:59.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.019+0000 7fe4a5200640 1 Processor -- start 2024-09-11T23:26:59.019 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.019+0000 7fe4a5200640 1 -- start start 2024-09-11T23:26:59.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.020+0000 7fe4a5200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4a00d0a50 0x7fe4a01620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.020+0000 7fe4a5200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe4a015fd30 0x7fe4a00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.020+0000 7fe4a5200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4a01625f0 con 0x7fe4a00b4930 2024-09-11T23:26:59.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.020+0000 7fe4a5200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fe4a00b52d0 con 0x7fe4a015fd30 2024-09-11T23:26:59.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.020+0000 7fe4a5200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a0162870 con 0x7fe4a00d0a50 2024-09-11T23:26:59.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.020+0000 7fe49e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe4a015fd30 0x7fe4a00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.020+0000 7fe49e800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe4a015fd30 0x7fe4a00b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37134/0 (socket says 172.21.15.144:37134) 2024-09-11T23:26:59.021 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.020+0000 7fe49e800640 1 -- 172.21.15.144:0/1526308301 learned_addr learned my addr 172.21.15.144:0/1526308301 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:59.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.020+0000 7fe49de00640 1 --2- 172.21.15.144:0/1526308301 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4a00d0a50 0x7fe4a01620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.021+0000 7fe49e800640 1 -- 172.21.15.144:0/1526308301 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4a00d0a50 msgr2=0x7fe4a01620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:59.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.021+0000 7fe49e800640 1 --2- 172.21.15.144:0/1526308301 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4a00d0a50 0x7fe4a01620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.021+0000 7fe49e800640 1 -- 172.21.15.144:0/1526308301 >> v1:172.21.15.165:6789/0 conn(0x7fe4a00b4930 legacy=0x7fe4a015f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.021+0000 7fe49e800640 1 -- 172.21.15.144:0/1526308301 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a0162b50 con 0x7fe4a015fd30 2024-09-11T23:26:59.022 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.021+0000 7fe49de00640 1 --2- 172.21.15.144:0/1526308301 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4a00d0a50 0x7fe4a01620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:59.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.022+0000 7fe49e800640 1 --2- 172.21.15.144:0/1526308301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a015fd30 0x7fe4a00b4d90 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fe498009e50 tx=0x7fe49802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1dbe31eaecbaa11 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:59.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.022+0000 7fe49d400640 1 -- 172.21.15.144:0/1526308301 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe498036070 con 0x7fe4a015fd30 2024-09-11T23:26:59.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.022+0000 7fe49d400640 1 -- 172.21.15.144:0/1526308301 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe498031600 con 0x7fe4a015fd30 2024-09-11T23:26:59.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.022+0000 7fe49d400640 1 -- 172.21.15.144:0/1526308301 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4980319d0 con 0x7fe4a015fd30 2024-09-11T23:26:59.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.022+0000 7fe4a5200640 1 -- 172.21.15.144:0/1526308301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a015fd30 msgr2=0x7fe4a00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.022+0000 7fe4a5200640 1 --2- 172.21.15.144:0/1526308301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a015fd30 0x7fe4a00b4d90 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fe498009e50 tx=0x7fe49802a680 comp rx=0 tx=0).stop 2024-09-11T23:26:59.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.023+0000 7fe4a5200640 1 -- 172.21.15.144:0/1526308301 shutdown_connections 2024-09-11T23:26:59.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.023+0000 7fe4a5200640 1 --2- 172.21.15.144:0/1526308301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a015fd30 0x7fe4a00b4d90 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.024 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.023+0000 7fe4a5200640 1 --2- 172.21.15.144:0/1526308301 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4a00d0a50 0x7fe4a01620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.023+0000 7fe4a5200640 1 -- 172.21.15.144:0/1526308301 >> 172.21.15.144:0/1526308301 conn(0x7fe4a0062cc0 msgr2=0x7fe4a006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:59.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.023+0000 7fe4a5200640 1 -- 172.21.15.144:0/1526308301 shutdown_connections 2024-09-11T23:26:59.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.023+0000 7fe4a5200640 1 -- 172.21.15.144:0/1526308301 wait complete. 2024-09-11T23:26:59.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.024+0000 7fe4a5200640 1 Processor -- start 2024-09-11T23:26:59.025 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.024+0000 7fe4a5200640 1 -- start start 2024-09-11T23:26:59.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.025+0000 7fe4a5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a00b4930 0x7fe4a015d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.025+0000 7fe4a5200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4a015fd30 0x7fe4a00afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.025+0000 7fe4a5200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4a00b01b0 0x7fe4a0070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.025+0000 7fe4a5200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a00b3620 con 0x7fe4a00b4930 2024-09-11T23:26:59.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.025+0000 7fe4a5200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a00b3340 con 0x7fe4a00b01b0 2024-09-11T23:26:59.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.025+0000 7fe4a5200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a00b3b40 con 0x7fe4a015fd30 2024-09-11T23:26:59.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.026+0000 7fe49de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a00b4930 0x7fe4a015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.026+0000 7fe49de00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a00b4930 0x7fe4a015d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37142/0 (socket says 172.21.15.144:37142) 2024-09-11T23:26:59.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.026+0000 7fe49de00640 1 -- 172.21.15.144:0/1649336481 learned_addr learned my addr 172.21.15.144:0/1649336481 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:59.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.026+0000 7fe495400640 1 --2- 172.21.15.144:0/1649336481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4a015fd30 0x7fe4a00afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.026+0000 7fe49e800640 1 --2- 172.21.15.144:0/1649336481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4a00b01b0 0x7fe4a0070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.026+0000 7fe49de00640 1 -- 172.21.15.144:0/1649336481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4a015fd30 msgr2=0x7fe4a00afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.026+0000 7fe49de00640 1 --2- 172.21.15.144:0/1649336481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4a015fd30 0x7fe4a00afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.026+0000 7fe49de00640 1 -- 172.21.15.144:0/1649336481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4a00b01b0 msgr2=0x7fe4a0070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.026+0000 7fe49de00640 1 --2- 172.21.15.144:0/1649336481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4a00b01b0 0x7fe4a0070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.026+0000 7fe49de00640 1 -- 172.21.15.144:0/1649336481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a00727e0 con 0x7fe4a00b4930 2024-09-11T23:26:59.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.026+0000 7fe495400640 1 --2- 172.21.15.144:0/1649336481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4a015fd30 0x7fe4a00afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:59.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.026+0000 7fe49e800640 1 --2- 172.21.15.144:0/1649336481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4a00b01b0 0x7fe4a0070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:26:59.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.026+0000 7fe49de00640 1 --2- 172.21.15.144:0/1649336481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a00b4930 0x7fe4a015d910 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fe49000e7e0 tx=0x7fe49000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:59.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.026+0000 7fe496a00640 1 -- 172.21.15.144:0/1649336481 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49000f040 con 0x7fe4a00b4930 2024-09-11T23:26:59.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.026+0000 7fe496a00640 1 -- 172.21.15.144:0/1649336481 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe490004030 con 0x7fe4a00b4930 2024-09-11T23:26:59.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.026+0000 7fe4a5200640 1 -- 172.21.15.144:0/1649336481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a0072ac0 con 0x7fe4a00b4930 2024-09-11T23:26:59.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.026+0000 7fe496a00640 1 -- 172.21.15.144:0/1649336481 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe490004400 con 0x7fe4a00b4930 2024-09-11T23:26:59.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.027+0000 7fe4a5200640 1 -- 172.21.15.144:0/1649336481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a00b0640 con 0x7fe4a00b4930 2024-09-11T23:26:59.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.028+0000 7fe4a5200640 1 -- 172.21.15.144:0/1649336481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a01620b0 con 0x7fe4a00b4930 2024-09-11T23:26:59.029 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.029+0000 7fe496a00640 1 -- 172.21.15.144:0/1649336481 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7fe49000c6d0 con 0x7fe4a00b4930 2024-09-11T23:26:59.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.029+0000 7fe496a00640 1 --2- 172.21.15.144:0/1649336481 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe47c06c970 0x7fe47c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.029+0000 7fe496a00640 1 -- 172.21.15.144:0/1649336481 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7fe4900898c0 con 0x7fe4a00b4930 2024-09-11T23:26:59.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.030+0000 7fe495400640 1 --2- 172.21.15.144:0/1649336481 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe47c06c970 0x7fe47c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.031+0000 7fe495400640 1 --2- 172.21.15.144:0/1649336481 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe47c06c970 0x7fe47c06ee30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00743d0 tx=0x7fe488009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:59.034 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.034+0000 7fe496a00640 1 -- 172.21.15.144:0/1649336481 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe490017020 con 0x7fe4a00b4930 2024-09-11T23:26:59.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.208+0000 7fe4a5200640 1 -- 172.21.15.144:0/1649336481 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fe4a006d3b0 con 0x7fe47c06c970 2024-09-11T23:26:59.210 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.210+0000 7fe496a00640 1 -- 172.21.15.144:0/1649336481 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe4a006d3b0 con 0x7fe47c06c970 2024-09-11T23:26:59.210 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 0 to deep-scrub 2024-09-11T23:26:59.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.211+0000 7fe4a5200640 1 -- 172.21.15.144:0/1649336481 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe47c06c970 msgr2=0x7fe47c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.211+0000 7fe4a5200640 1 --2- 172.21.15.144:0/1649336481 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe47c06c970 0x7fe47c06ee30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00743d0 tx=0x7fe488009040 comp rx=0 tx=0).stop 2024-09-11T23:26:59.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.211+0000 7fe4a5200640 1 -- 172.21.15.144:0/1649336481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a00b4930 msgr2=0x7fe4a015d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.211+0000 7fe4a5200640 1 --2- 172.21.15.144:0/1649336481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a00b4930 0x7fe4a015d910 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fe49000e7e0 tx=0x7fe49000eca0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.211+0000 7fe4a5200640 1 -- 172.21.15.144:0/1649336481 shutdown_connections 2024-09-11T23:26:59.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.211+0000 7fe4a5200640 1 --2- 172.21.15.144:0/1649336481 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fe47c06c970 0x7fe47c06ee30 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.211+0000 7fe4a5200640 1 --2- 172.21.15.144:0/1649336481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4a00b01b0 0x7fe4a0070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.211+0000 7fe4a5200640 1 --2- 172.21.15.144:0/1649336481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fe4a015fd30 0x7fe4a00afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.211+0000 7fe4a5200640 1 --2- 172.21.15.144:0/1649336481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a00b4930 0x7fe4a015d910 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.211+0000 7fe4a5200640 1 -- 172.21.15.144:0/1649336481 >> 172.21.15.144:0/1649336481 conn(0x7fe4a0062cc0 msgr2=0x7fe4a015e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:59.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.211+0000 7fe4a5200640 1 -- 172.21.15.144:0/1649336481 shutdown_connections 2024-09-11T23:26:59.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.212+0000 7fe4a5200640 1 -- 172.21.15.144:0/1649336481 wait complete. 2024-09-11T23:26:59.228 INFO:tasks.ceph:Scrubbing osd.1 2024-09-11T23:26:59.228 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-11T23:26:59.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.384+0000 7fdc4dc00640 1 Processor -- start 2024-09-11T23:26:59.385 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.384+0000 7fdc4dc00640 1 -- start start 2024-09-11T23:26:59.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.386+0000 7fdc4dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc480cffe0 0x7fdc4806d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.386 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.386+0000 7fdc4dc00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc4815d880 con 0x7fdc480cd920 2024-09-11T23:26:59.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.386+0000 7fdc4dc00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc480b42c0 con 0x7fdc480cdd00 2024-09-11T23:26:59.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.386+0000 7fdc4dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdc480b45a0 con 0x7fdc480cffe0 2024-09-11T23:26:59.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.386+0000 7fdc46a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7fdc480cd920 0x7fdc480cf8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55166/0 (socket says 172.21.15.144:55166) 2024-09-11T23:26:59.387 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.386+0000 7fdc46a00640 1 -- 172.21.15.144:0/3050132517 learned_addr learned my addr 172.21.15.144:0/3050132517 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:26:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.386+0000 7fdc46000640 1 --2- 172.21.15.144:0/3050132517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc480cffe0 0x7fdc4806d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.386+0000 7fdc45600640 1 -- 172.21.15.144:0/3050132517 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2974583234 0 0) 0x7fdc4815d880 con 0x7fdc480cd920 2024-09-11T23:26:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.386+0000 7fdc45600640 1 -- 172.21.15.144:0/3050132517 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc2c003520 con 0x7fdc480cd920 2024-09-11T23:26:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.387+0000 7fdc45600640 1 -- 172.21.15.144:0/3050132517 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1909508115 0 0) 0x7fdc2c003520 con 0x7fdc480cd920 2024-09-11T23:26:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.387+0000 7fdc45600640 1 -- 172.21.15.144:0/3050132517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc480cffe0 msgr2=0x7fdc4806d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.387+0000 7fdc45600640 1 --2- 172.21.15.144:0/3050132517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc480cffe0 0x7fdc4806d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.387+0000 7fdc45600640 1 -- 172.21.15.144:0/3050132517 >> v1:172.21.15.165:6789/0 conn(0x7fdc480cdd00 legacy=0x7fdc4815cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.387+0000 7fdc45600640 1 -- 172.21.15.144:0/3050132517 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc480b4880 con 0x7fdc480cd920 2024-09-11T23:26:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.387+0000 7fdc45600640 1 -- 172.21.15.144:0/3050132517 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7fdc38001670 con 0x7fdc480cd920 2024-09-11T23:26:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.387+0000 7fdc45600640 1 -- 172.21.15.144:0/3050132517 >> v1:172.21.15.144:6789/0 conn(0x7fdc480cd920 legacy=0x7fdc480cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.389 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.387+0000 7fdc45600640 1 --2- 172.21.15.144:0/3050132517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc480cffe0 0x7fdc2c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.387+0000 7fdc45600640 1 --2- 172.21.15.144:0/3050132517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc2c003fb0 0x7fdc2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.387+0000 7fdc45600640 1 --2- 172.21.15.144:0/3050132517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc2c004d40 0x7fdc2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.387+0000 7fdc45600640 1 -- 172.21.15.144:0/3050132517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdc480b45a0 con 0x7fdc2c004d40 2024-09-11T23:26:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.387+0000 7fdc45600640 1 -- 172.21.15.144:0/3050132517 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c00bb00 con 0x7fdc2c003fb0 2024-09-11T23:26:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.387+0000 7fdc45600640 1 -- 172.21.15.144:0/3050132517 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdc2c00bd00 con 0x7fdc480cffe0 2024-09-11T23:26:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.387+0000 7fdc47400640 1 --2- 172.21.15.144:0/3050132517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc2c004d40 0x7fdc2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.387+0000 7fdc46a00640 1 --2- 172.21.15.144:0/3050132517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc480cffe0 0x7fdc2c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.387+0000 7fdc46000640 1 --2- 172.21.15.144:0/3050132517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc2c003fb0 0x7fdc2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.388+0000 7fdc47400640 1 -- 172.21.15.144:0/3050132517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc480cffe0 msgr2=0x7fdc2c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.388+0000 7fdc47400640 1 --2- 172.21.15.144:0/3050132517 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc480cffe0 0x7fdc2c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.388+0000 7fdc47400640 1 -- 172.21.15.144:0/3050132517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc2c003fb0 msgr2=0x7fdc2c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.388+0000 7fdc47400640 1 --2- 172.21.15.144:0/3050132517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc2c003fb0 0x7fdc2c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.390 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.388+0000 7fdc47400640 1 -- 172.21.15.144:0/3050132517 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc2c003520 con 0x7fdc2c004d40 2024-09-11T23:26:59.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.389+0000 7fdc47400640 1 --2- 172.21.15.144:0/3050132517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc2c004d40 0x7fdc2c0051c0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fdc40001e50 tx=0x7fdc2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64881fe1b7ab4b0c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:59.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.389+0000 7fdc45600640 1 -- 172.21.15.144:0/3050132517 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc40001a70 con 0x7fdc2c004d40 2024-09-11T23:26:59.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.389+0000 7fdc45600640 1 -- 172.21.15.144:0/3050132517 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc40003970 con 0x7fdc2c004d40 2024-09-11T23:26:59.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.389+0000 7fdc45600640 1 -- 172.21.15.144:0/3050132517 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc40003d60 con 0x7fdc2c004d40 2024-09-11T23:26:59.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.389+0000 7fdc4dc00640 1 -- 172.21.15.144:0/3050132517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc2c004d40 msgr2=0x7fdc2c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.389+0000 7fdc4dc00640 1 --2- 172.21.15.144:0/3050132517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc2c004d40 0x7fdc2c0051c0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fdc40001e50 tx=0x7fdc2c005830 comp rx=0 tx=0).stop 2024-09-11T23:26:59.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.389+0000 7fdc47400640 1 -- 172.21.15.144:0/3050132517 reap_dead start 2024-09-11T23:26:59.392 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.389+0000 7fdc4dc00640 1 -- 172.21.15.144:0/3050132517 shutdown_connections 2024-09-11T23:26:59.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.389+0000 7fdc4dc00640 1 -- 172.21.15.144:0/3050132517 >> 172.21.15.144:0/3050132517 conn(0x7fdc4806bba0 msgr2=0x7fdc4806bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:59.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.389+0000 7fdc4dc00640 1 -- 172.21.15.144:0/3050132517 shutdown_connections 2024-09-11T23:26:59.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.389+0000 7fdc4dc00640 1 -- 172.21.15.144:0/3050132517 wait complete. 2024-09-11T23:26:59.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.391+0000 7fdc4dc00640 1 Processor -- start 2024-09-11T23:26:59.393 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.391+0000 7fdc4dc00640 1 -- start start 2024-09-11T23:26:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.392+0000 7fdc4dc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc480b1c30 0x7fdc481526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.392+0000 7fdc4dc00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc480b2010 0x7fdc48152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.392+0000 7fdc4dc00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc480cbc00 0x7fdc480cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.392+0000 7fdc4dc00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4815d5c0 con 0x7fdc480b1c30 2024-09-11T23:26:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.392+0000 7fdc4dc00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4815d440 con 0x7fdc480b2010 2024-09-11T23:26:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.392+0000 7fdc4dc00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fdc4806d080 con 0x7fdc480cbc00 2024-09-11T23:26:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.392+0000 7fdc46a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc480b1c30 0x7fdc481526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.392+0000 7fdc46a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc480b1c30 0x7fdc481526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37154/0 (socket says 172.21.15.144:37154) 2024-09-11T23:26:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.392+0000 7fdc46a00640 1 -- 172.21.15.144:0/923223460 learned_addr learned my addr 172.21.15.144:0/923223460 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.393+0000 7fdc46000640 1 --2- 172.21.15.144:0/923223460 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc480b2010 0x7fdc48152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.393+0000 7fdc47400640 1 --2- 172.21.15.144:0/923223460 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc480cbc00 0x7fdc480cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.395 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.393+0000 7fdc46a00640 1 -- 172.21.15.144:0/923223460 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc480cbc00 msgr2=0x7fdc480cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.393+0000 7fdc46a00640 1 --2- 172.21.15.144:0/923223460 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fdc480cbc00 0x7fdc480cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.393+0000 7fdc46a00640 1 -- 172.21.15.144:0/923223460 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc480b2010 msgr2=0x7fdc48152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.393+0000 7fdc46a00640 1 --2- 172.21.15.144:0/923223460 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc480b2010 0x7fdc48152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.393+0000 7fdc46a00640 1 -- 172.21.15.144:0/923223460 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc480cc5c0 con 0x7fdc480b1c30 2024-09-11T23:26:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.393+0000 7fdc46a00640 1 --2- 172.21.15.144:0/923223460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc480b1c30 0x7fdc481526f0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fdc38007fd0 tx=0x7fdc38007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.393+0000 7fdc3ea00640 1 -- 172.21.15.144:0/923223460 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3800f9c0 con 0x7fdc480b1c30 2024-09-11T23:26:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.393+0000 7fdc3ea00640 1 -- 172.21.15.144:0/923223460 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc38018070 con 0x7fdc480b1c30 2024-09-11T23:26:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.393+0000 7fdc3ea00640 1 -- 172.21.15.144:0/923223460 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3800fde0 con 0x7fdc480b1c30 2024-09-11T23:26:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.393+0000 7fdc4dc00640 1 -- 172.21.15.144:0/923223460 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc480c5680 con 0x7fdc480b1c30 2024-09-11T23:26:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.393+0000 7fdc4dc00640 1 -- 172.21.15.144:0/923223460 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc480c5c40 con 0x7fdc480b1c30 2024-09-11T23:26:59.396 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.394+0000 7fdc4dc00640 1 -- 172.21.15.144:0/923223460 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdc480cf8d0 con 0x7fdc480b1c30 2024-09-11T23:26:59.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.395+0000 7fdc3ea00640 1 -- 172.21.15.144:0/923223460 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7fdc3801d460 con 0x7fdc480b1c30 2024-09-11T23:26:59.397 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.396+0000 7fdc3ea00640 1 --2- 172.21.15.144:0/923223460 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdc2806c970 0x7fdc2806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.396+0000 7fdc3ea00640 1 -- 172.21.15.144:0/923223460 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7fdc38089940 con 0x7fdc480b1c30 2024-09-11T23:26:59.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.397+0000 7fdc3ea00640 1 --2- 172.21.15.144:0/923223460 >> [v2:172.21.15.144:6811/4178698740,v1:172.21.15.144:6813/4178698740] conn(0x7fdc28072830 0x7fdc28074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.397+0000 7fdc3ea00640 1 -- 172.21.15.144:0/923223460 --> [v2:172.21.15.144:6811/4178698740,v1:172.21.15.144:6813/4178698740] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc3800ae50 con 0x7fdc28072830 2024-09-11T23:26:59.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.397+0000 7fdc3ea00640 1 -- 172.21.15.144:0/923223460 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7fdc3808e5d0 con 0x7fdc480b1c30 2024-09-11T23:26:59.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.397+0000 7fdc46000640 1 --2- 172.21.15.144:0/923223460 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdc2806c970 0x7fdc2806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.398 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.397+0000 7fdc47400640 1 --2- 172.21.15.144:0/923223460 >> [v2:172.21.15.144:6811/4178698740,v1:172.21.15.144:6813/4178698740] conn(0x7fdc28072830 0x7fdc28074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.397+0000 7fdc47400640 1 --2- 172.21.15.144:0/923223460 >> [v2:172.21.15.144:6811/4178698740,v1:172.21.15.144:6813/4178698740] conn(0x7fdc28072830 0x7fdc28074c50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:59.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.397+0000 7fdc46000640 1 --2- 172.21.15.144:0/923223460 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdc2806c970 0x7fdc2806ee30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fdc4815c3e0 tx=0x7fdc34008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:59.399 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.398+0000 7fdc3ea00640 1 -- 172.21.15.144:0/923223460 <== osd.1 v2:172.21.15.144:6811/4178698740 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc3800ae50 con 0x7fdc28072830 2024-09-11T23:26:59.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.411+0000 7fdc4dc00640 1 -- 172.21.15.144:0/923223460 --> [v2:172.21.15.144:6811/4178698740,v1:172.21.15.144:6813/4178698740] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdc480c6090 con 0x7fdc28072830 2024-09-11T23:26:59.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.412+0000 7fdc3ea00640 1 -- 172.21.15.144:0/923223460 <== osd.1 v2:172.21.15.144:6811/4178698740 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdc480c6090 con 0x7fdc28072830 2024-09-11T23:26:59.412 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:26:59.413 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T23:26:59.413 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:26:59.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.412+0000 7fdc4dc00640 1 -- 172.21.15.144:0/923223460 >> [v2:172.21.15.144:6811/4178698740,v1:172.21.15.144:6813/4178698740] conn(0x7fdc28072830 msgr2=0x7fdc28074c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.412+0000 7fdc4dc00640 1 --2- 172.21.15.144:0/923223460 >> [v2:172.21.15.144:6811/4178698740,v1:172.21.15.144:6813/4178698740] conn(0x7fdc28072830 0x7fdc28074c50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.412+0000 7fdc4dc00640 1 -- 172.21.15.144:0/923223460 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdc2806c970 msgr2=0x7fdc2806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.412+0000 7fdc4dc00640 1 --2- 172.21.15.144:0/923223460 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fdc2806c970 0x7fdc2806ee30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fdc4815c3e0 tx=0x7fdc34008040 comp rx=0 tx=0).stop 2024-09-11T23:26:59.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.412+0000 7fdc4dc00640 1 -- 172.21.15.144:0/923223460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc480b1c30 msgr2=0x7fdc481526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.412+0000 7fdc4dc00640 1 --2- 172.21.15.144:0/923223460 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc480b1c30 0x7fdc481526f0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fdc38007fd0 tx=0x7fdc38007720 comp rx=0 tx=0).stop 2024-09-11T23:26:59.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.412+0000 7fdc47400640 1 -- 172.21.15.144:0/923223460 reap_dead start 2024-09-11T23:26:59.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.412+0000 7fdc4dc00640 1 -- 172.21.15.144:0/923223460 shutdown_connections 2024-09-11T23:26:59.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.412+0000 7fdc4dc00640 1 -- 172.21.15.144:0/923223460 >> 172.21.15.144:0/923223460 conn(0x7fdc4806bba0 msgr2=0x7fdc4815f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:59.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.412+0000 7fdc4dc00640 1 -- 172.21.15.144:0/923223460 shutdown_connections 2024-09-11T23:26:59.414 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.412+0000 7fdc4dc00640 1 -- 172.21.15.144:0/923223460 wait complete. 2024-09-11T23:26:59.427 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-11T23:26:59.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.580+0000 7f840fa00640 1 Processor -- start 2024-09-11T23:26:59.581 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.581+0000 7f840fa00640 1 -- start start 2024-09-11T23:26:59.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.582+0000 7f840fa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84080cf070 0x7f84080cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.582+0000 7f840fa00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8408073120 0x7f8408073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.582+0000 7f840fa00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84080ce740 con 0x7f840815c180 2024-09-11T23:26:59.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.582+0000 7f840fa00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f8408072640 con 0x7f8408073120 2024-09-11T23:26:59.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.582+0000 7f840fa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f8408072920 con 0x7f84080cf070 2024-09-11T23:26:59.583 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.582+0000 7f840da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8408073120 0x7f8408073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.582+0000 7f840da00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8408073120 0x7f8408073590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37164/0 (socket says 172.21.15.144:37164) 2024-09-11T23:26:59.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.582+0000 7f840da00640 1 -- 172.21.15.144:0/1439333008 learned_addr learned my addr 172.21.15.144:0/1439333008 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:59.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.582+0000 7f83ffe00640 1 --2- 172.21.15.144:0/1439333008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84080cf070 0x7f84080cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.583+0000 7f840da00640 1 -- 172.21.15.144:0/1439333008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84080cf070 msgr2=0x7f84080cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:59.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.583+0000 7f840da00640 1 --2- 172.21.15.144:0/1439333008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84080cf070 0x7f84080cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.583+0000 7f840da00640 1 -- 172.21.15.144:0/1439333008 >> v1:172.21.15.165:6789/0 conn(0x7f840815c180 legacy=0x7f84080cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.583+0000 7f840da00640 1 -- 172.21.15.144:0/1439333008 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8408072c00 con 0x7f8408073120 2024-09-11T23:26:59.584 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.583+0000 7f8407e00640 1 -- 172.21.15.144:0/1439333008 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 823023012 0 0) 0x7f84080ce740 con 0x7f840815c180 2024-09-11T23:26:59.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.584+0000 7f840da00640 1 --2- 172.21.15.144:0/1439333008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8408073120 0x7f8408073590 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f8400009e50 tx=0x7f840002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ff20c8bf8ad72 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:59.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.584+0000 7f8407e00640 1 -- 172.21.15.144:0/1439333008 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8400036070 con 0x7f8408073120 2024-09-11T23:26:59.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.584+0000 7f8407e00640 1 -- 172.21.15.144:0/1439333008 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8400031600 con 0x7f8408073120 2024-09-11T23:26:59.586 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.584+0000 7f8407e00640 1 -- 172.21.15.144:0/1439333008 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84000319d0 con 0x7f8408073120 2024-09-11T23:26:59.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.584+0000 7f840fa00640 1 -- 172.21.15.144:0/1439333008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8408073120 msgr2=0x7f8408073590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.584+0000 7f840fa00640 1 --2- 172.21.15.144:0/1439333008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8408073120 0x7f8408073590 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f8400009e50 tx=0x7f840002a680 comp rx=0 tx=0).stop 2024-09-11T23:26:59.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.584+0000 7f840fa00640 1 -- 172.21.15.144:0/1439333008 shutdown_connections 2024-09-11T23:26:59.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.584+0000 7f840fa00640 1 --2- 172.21.15.144:0/1439333008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8408073120 0x7f8408073590 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.584+0000 7f840fa00640 1 --2- 172.21.15.144:0/1439333008 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f84080cf070 0x7f84080cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.584+0000 7f840fa00640 1 -- 172.21.15.144:0/1439333008 >> 172.21.15.144:0/1439333008 conn(0x7f8408062cc0 msgr2=0x7f840806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:59.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.585+0000 7f840fa00640 1 -- 172.21.15.144:0/1439333008 shutdown_connections 2024-09-11T23:26:59.587 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.585+0000 7f840fa00640 1 -- 172.21.15.144:0/1439333008 wait complete. 2024-09-11T23:26:59.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.586+0000 7f840fa00640 1 Processor -- start 2024-09-11T23:26:59.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.586+0000 7f840fa00640 1 -- start start 2024-09-11T23:26:59.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.587+0000 7f840fa00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8408073120 0x7f8408154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.587+0000 7f840fa00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84080cf070 0x7f840815e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.587+0000 7f840fa00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f840815c180 0x7f840815e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.587+0000 7f840fa00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f84080722f0 con 0x7f840815c180 2024-09-11T23:26:59.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.587+0000 7f840fa00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f84080ced00 con 0x7f84080cf070 2024-09-11T23:26:59.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.587+0000 7f840fa00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f840815c560 con 0x7f8408073120 2024-09-11T23:26:59.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.588+0000 7f840da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f840815c180 0x7f840815e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.588+0000 7f840da00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f840815c180 0x7f840815e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37166/0 (socket says 172.21.15.144:37166) 2024-09-11T23:26:59.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.588+0000 7f840da00640 1 -- 172.21.15.144:0/3746447787 learned_addr learned my addr 172.21.15.144:0/3746447787 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:59.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.588+0000 7f83ffe00640 1 --2- 172.21.15.144:0/3746447787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84080cf070 0x7f840815e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.588+0000 7f840d000640 1 --2- 172.21.15.144:0/3746447787 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8408073120 0x7f8408154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.588+0000 7f840da00640 1 -- 172.21.15.144:0/3746447787 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8408073120 msgr2=0x7f8408154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.588+0000 7f840da00640 1 --2- 172.21.15.144:0/3746447787 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8408073120 0x7f8408154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.588+0000 7f840da00640 1 -- 172.21.15.144:0/3746447787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84080cf070 msgr2=0x7f840815e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.588+0000 7f840da00640 1 --2- 172.21.15.144:0/3746447787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84080cf070 0x7f840815e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.591 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.588+0000 7f840da00640 1 -- 172.21.15.144:0/3746447787 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84080b2e00 con 0x7f840815c180 2024-09-11T23:26:59.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.588+0000 7f840da00640 1 --2- 172.21.15.144:0/3746447787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f840815c180 0x7f840815e7b0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f8400034040 tx=0x7f8400004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:59.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.589+0000 7f8405600640 1 -- 172.21.15.144:0/3746447787 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8400036050 con 0x7f840815c180 2024-09-11T23:26:59.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.589+0000 7f8405600640 1 -- 172.21.15.144:0/3746447787 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8400042070 con 0x7f840815c180 2024-09-11T23:26:59.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.589+0000 7f840fa00640 1 -- 172.21.15.144:0/3746447787 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f840815c920 con 0x7f840815c180 2024-09-11T23:26:59.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.589+0000 7f8405600640 1 -- 172.21.15.144:0/3746447787 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8400009510 con 0x7f840815c180 2024-09-11T23:26:59.592 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.589+0000 7f840fa00640 1 -- 172.21.15.144:0/3746447787 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f840815cee0 con 0x7f840815c180 2024-09-11T23:26:59.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.590+0000 7f840fa00640 1 -- 172.21.15.144:0/3746447787 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84080cf4b0 con 0x7f840815c180 2024-09-11T23:26:59.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.591+0000 7f8405600640 1 -- 172.21.15.144:0/3746447787 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f8400007bf0 con 0x7f840815c180 2024-09-11T23:26:59.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.592+0000 7f8405600640 1 --2- 172.21.15.144:0/3746447787 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f83e406c970 0x7f83e406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.592+0000 7f8405600640 1 -- 172.21.15.144:0/3746447787 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7f84000aa4f0 con 0x7f840815c180 2024-09-11T23:26:59.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.592+0000 7f840d000640 1 --2- 172.21.15.144:0/3746447787 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f83e406c970 0x7f83e406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.593+0000 7f840d000640 1 --2- 172.21.15.144:0/3746447787 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f83e406c970 0x7f83e406ee30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f83f8000f60 tx=0x7f83f8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:59.597 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.597+0000 7f8405600640 1 -- 172.21.15.144:0/3746447787 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f840007a2a0 con 0x7f840815c180 2024-09-11T23:26:59.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.771+0000 7f840fa00640 1 -- 172.21.15.144:0/3746447787 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f84080d06c0 con 0x7f83e406c970 2024-09-11T23:26:59.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.772+0000 7f8405600640 1 -- 172.21.15.144:0/3746447787 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f84080d06c0 con 0x7f83e406c970 2024-09-11T23:26:59.773 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 1 to deep-scrub 2024-09-11T23:26:59.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.774+0000 7f840fa00640 1 -- 172.21.15.144:0/3746447787 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f83e406c970 msgr2=0x7f83e406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.774+0000 7f840fa00640 1 --2- 172.21.15.144:0/3746447787 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f83e406c970 0x7f83e406ee30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f83f8000f60 tx=0x7f83f8009040 comp rx=0 tx=0).stop 2024-09-11T23:26:59.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.774+0000 7f840fa00640 1 -- 172.21.15.144:0/3746447787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f840815c180 msgr2=0x7f840815e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.774+0000 7f840fa00640 1 --2- 172.21.15.144:0/3746447787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f840815c180 0x7f840815e7b0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f8400034040 tx=0x7f8400004a40 comp rx=0 tx=0).stop 2024-09-11T23:26:59.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.774+0000 7f840fa00640 1 -- 172.21.15.144:0/3746447787 shutdown_connections 2024-09-11T23:26:59.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.774+0000 7f840fa00640 1 --2- 172.21.15.144:0/3746447787 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f83e406c970 0x7f83e406ee30 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.774+0000 7f840fa00640 1 --2- 172.21.15.144:0/3746447787 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f840815c180 0x7f840815e7b0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.774+0000 7f840fa00640 1 --2- 172.21.15.144:0/3746447787 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84080cf070 0x7f840815e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.774+0000 7f840fa00640 1 --2- 172.21.15.144:0/3746447787 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f8408073120 0x7f8408154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.774+0000 7f840fa00640 1 -- 172.21.15.144:0/3746447787 >> 172.21.15.144:0/3746447787 conn(0x7f8408062cc0 msgr2=0x7f8408158950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:59.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.774+0000 7f840fa00640 1 -- 172.21.15.144:0/3746447787 shutdown_connections 2024-09-11T23:26:59.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.774+0000 7f840fa00640 1 -- 172.21.15.144:0/3746447787 wait complete. 2024-09-11T23:26:59.790 INFO:tasks.ceph:Scrubbing osd.2 2024-09-11T23:26:59.790 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-11T23:26:59.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.949+0000 7fc3cb200640 1 Processor -- start 2024-09-11T23:26:59.950 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.949+0000 7fc3cb200640 1 -- start start 2024-09-11T23:26:59.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.950+0000 7fc3cb200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc3cc15e6a0 0x7fc3cc0d3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.950+0000 7fc3cb200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3cc06dd20 0x7fc3cc0b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.950+0000 7fc3cb200640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3cc0d38d0 con 0x7fc3cc0cf710 2024-09-11T23:26:59.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.950+0000 7fc3cb200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fc3cc0d36a0 con 0x7fc3cc15e6a0 2024-09-11T23:26:59.951 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.950+0000 7fc3cb200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc3cc0d3bb0 con 0x7fc3cc06dd20 2024-09-11T23:26:59.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.951+0000 7fc3ca800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3cc06dd20 0x7fc3cc0b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.951+0000 7fc3c9e00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fc3cc15e6a0 0x7fc3cc0d3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.952 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.951+0000 7fc3ca800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3cc06dd20 0x7fc3cc0b7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:52308/0 (socket says 172.21.15.144:52308) 2024-09-11T23:26:59.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.951+0000 7fc3ca800640 1 -- 172.21.15.144:0/1958841705 learned_addr learned my addr 172.21.15.144:0/1958841705 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:59.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.951+0000 7fc3ca800640 1 -- 172.21.15.144:0/1958841705 >> v2:172.21.15.165:3300/0 conn(0x7fc3cc15e6a0 msgr2=0x7fc3cc0d3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:26:59.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.951+0000 7fc3ca800640 1 --2- 172.21.15.144:0/1958841705 >> v2:172.21.15.165:3300/0 conn(0x7fc3cc15e6a0 0x7fc3cc0d3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.951+0000 7fc3ca800640 1 -- 172.21.15.144:0/1958841705 >> v1:172.21.15.165:6789/0 conn(0x7fc3cc0cf710 legacy=0x7fc3cc06d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.951+0000 7fc3ca800640 1 -- 172.21.15.144:0/1958841705 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3cc0d3e90 con 0x7fc3cc06dd20 2024-09-11T23:26:59.953 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.951+0000 7fc3c9e00640 1 --2- 172.21.15.144:0/1958841705 >> v2:172.21.15.165:3300/0 conn(0x7fc3cc15e6a0 0x7fc3cc0d3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:26:59.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.952+0000 7fc3ca800640 1 --2- 172.21.15.144:0/1958841705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3cc06dd20 0x7fc3cc0b7ba0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009e50 tx=0x7fc3c402a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dcfa557ffa285ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:59.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.952+0000 7fc3c8a00640 1 -- 172.21.15.144:0/1958841705 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4036070 con 0x7fc3cc06dd20 2024-09-11T23:26:59.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.952+0000 7fc3c8a00640 1 -- 172.21.15.144:0/1958841705 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3c4031600 con 0x7fc3cc06dd20 2024-09-11T23:26:59.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.952+0000 7fc3c8a00640 1 -- 172.21.15.144:0/1958841705 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c40319d0 con 0x7fc3cc06dd20 2024-09-11T23:26:59.954 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.953+0000 7fc3cb200640 1 -- 172.21.15.144:0/1958841705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3cc06dd20 msgr2=0x7fc3cc0b7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.953+0000 7fc3cb200640 1 --2- 172.21.15.144:0/1958841705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3cc06dd20 0x7fc3cc0b7ba0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009e50 tx=0x7fc3c402a7a0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.953+0000 7fc3cb200640 1 -- 172.21.15.144:0/1958841705 shutdown_connections 2024-09-11T23:26:59.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.953+0000 7fc3cb200640 1 --2- 172.21.15.144:0/1958841705 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3cc06dd20 0x7fc3cc0b7ba0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.953+0000 7fc3cb200640 1 --2- 172.21.15.144:0/1958841705 >> v2:172.21.15.165:3300/0 conn(0x7fc3cc15e6a0 0x7fc3cc0d3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.953+0000 7fc3cb200640 1 -- 172.21.15.144:0/1958841705 >> 172.21.15.144:0/1958841705 conn(0x7fc3cc0d4700 msgr2=0x7fc3cc0d4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:59.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.953+0000 7fc3cb200640 1 -- 172.21.15.144:0/1958841705 shutdown_connections 2024-09-11T23:26:59.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.953+0000 7fc3cb200640 1 -- 172.21.15.144:0/1958841705 wait complete. 2024-09-11T23:26:59.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.955+0000 7fc3cb200640 1 Processor -- start 2024-09-11T23:26:59.955 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.955+0000 7fc3cb200640 1 -- start start 2024-09-11T23:26:59.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.956+0000 7fc3cb200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3cc06dd20 0x7fc3cc1578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.956+0000 7fc3cb200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3cc0cf710 0x7fc3cc0ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.956+0000 7fc3cb200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3cc15e6a0 0x7fc3cc1581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.957 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.956+0000 7fc3cb200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc0cfb30 con 0x7fc3cc0cf710 2024-09-11T23:26:59.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.956+0000 7fc3cb200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc0b7650 con 0x7fc3cc15e6a0 2024-09-11T23:26:59.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.956+0000 7fc3cb200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fc3cc0cfcb0 con 0x7fc3cc06dd20 2024-09-11T23:26:59.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.956+0000 7fc3c9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3cc0cf710 0x7fc3cc0ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.956+0000 7fc3c9400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3cc0cf710 0x7fc3cc0ca630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37172/0 (socket says 172.21.15.144:37172) 2024-09-11T23:26:59.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.956+0000 7fc3c9400640 1 -- 172.21.15.144:0/2366443873 learned_addr learned my addr 172.21.15.144:0/2366443873 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:26:59.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.956+0000 7fc3c9e00640 1 --2- 172.21.15.144:0/2366443873 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3cc06dd20 0x7fc3cc1578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.956+0000 7fc3ca800640 1 --2- 172.21.15.144:0/2366443873 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3cc15e6a0 0x7fc3cc1581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.957+0000 7fc3c9400640 1 -- 172.21.15.144:0/2366443873 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3cc06dd20 msgr2=0x7fc3cc1578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.957+0000 7fc3c9400640 1 --2- 172.21.15.144:0/2366443873 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fc3cc06dd20 0x7fc3cc1578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.957+0000 7fc3c9400640 1 -- 172.21.15.144:0/2366443873 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3cc15e6a0 msgr2=0x7fc3cc1581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.957+0000 7fc3c9400640 1 --2- 172.21.15.144:0/2366443873 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3cc15e6a0 0x7fc3cc1581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.957+0000 7fc3c9400640 1 -- 172.21.15.144:0/2366443873 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3cc159f70 con 0x7fc3cc0cf710 2024-09-11T23:26:59.958 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.957+0000 7fc3c9400640 1 --2- 172.21.15.144:0/2366443873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3cc0cf710 0x7fc3cc0ca630 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800c400 tx=0x7fc3b800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:59.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.957+0000 7fc3c2000640 1 -- 172.21.15.144:0/2366443873 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b80052d0 con 0x7fc3cc0cf710 2024-09-11T23:26:59.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.957+0000 7fc3c2000640 1 -- 172.21.15.144:0/2366443873 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b8005490 con 0x7fc3cc0cf710 2024-09-11T23:26:59.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.957+0000 7fc3c2000640 1 -- 172.21.15.144:0/2366443873 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8007260 con 0x7fc3cc0cf710 2024-09-11T23:26:59.959 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.957+0000 7fc3cb200640 1 -- 172.21.15.144:0/2366443873 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3cc15a250 con 0x7fc3cc0cf710 2024-09-11T23:26:59.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.957+0000 7fc3cb200640 1 -- 172.21.15.144:0/2366443873 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3cc15a810 con 0x7fc3cc0cf710 2024-09-11T23:26:59.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.958+0000 7fc3cb200640 1 -- 172.21.15.144:0/2366443873 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc3cc15aa10 con 0x7fc3cc0cf710 2024-09-11T23:26:59.960 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.959+0000 7fc3c2000640 1 -- 172.21.15.144:0/2366443873 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7fc3b8007400 con 0x7fc3cc0cf710 2024-09-11T23:26:59.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.960+0000 7fc3c2000640 1 --2- 172.21.15.144:0/2366443873 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc3ac06c970 0x7fc3ac06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.961 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.960+0000 7fc3c2000640 1 -- 172.21.15.144:0/2366443873 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7fc3b8088ee0 con 0x7fc3cc0cf710 2024-09-11T23:26:59.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.960+0000 7fc3c2000640 1 --2- 172.21.15.144:0/2366443873 >> [v2:172.21.15.144:6826/645991929,v1:172.21.15.144:6827/645991929] conn(0x7fc3ac072830 0x7fc3ac074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:26:59.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.960+0000 7fc3c2000640 1 -- 172.21.15.144:0/2366443873 --> [v2:172.21.15.144:6826/645991929,v1:172.21.15.144:6827/645991929] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3b8009e50 con 0x7fc3ac072830 2024-09-11T23:26:59.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.960+0000 7fc3c2000640 1 -- 172.21.15.144:0/2366443873 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7fc3b8092050 con 0x7fc3cc0cf710 2024-09-11T23:26:59.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.960+0000 7fc3c9e00640 1 --2- 172.21.15.144:0/2366443873 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc3ac06c970 0x7fc3ac06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.961+0000 7fc3ca800640 1 --2- 172.21.15.144:0/2366443873 >> [v2:172.21.15.144:6826/645991929,v1:172.21.15.144:6827/645991929] conn(0x7fc3ac072830 0x7fc3ac074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:26:59.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.961+0000 7fc3c9e00640 1 --2- 172.21.15.144:0/2366443873 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc3ac06c970 0x7fc3ac06ee30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc1f7b10 tx=0x7fc3bc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:59.962 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.961+0000 7fc3ca800640 1 --2- 172.21.15.144:0/2366443873 >> [v2:172.21.15.144:6826/645991929,v1:172.21.15.144:6827/645991929] conn(0x7fc3ac072830 0x7fc3ac074c50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:26:59.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.962+0000 7fc3c2000640 1 -- 172.21.15.144:0/2366443873 <== osd.2 v2:172.21.15.144:6826/645991929 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc3b8009e50 con 0x7fc3ac072830 2024-09-11T23:26:59.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.975+0000 7fc3cb200640 1 -- 172.21.15.144:0/2366443873 --> [v2:172.21.15.144:6826/645991929,v1:172.21.15.144:6827/645991929] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc3cc0d3160 con 0x7fc3ac072830 2024-09-11T23:26:59.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.975+0000 7fc3c2000640 1 -- 172.21.15.144:0/2366443873 <== osd.2 v2:172.21.15.144:6826/645991929 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc3cc0d3160 con 0x7fc3ac072830 2024-09-11T23:26:59.976 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:26:59.976 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T23:26:59.976 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:26:59.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.976+0000 7fc3cb200640 1 -- 172.21.15.144:0/2366443873 >> [v2:172.21.15.144:6826/645991929,v1:172.21.15.144:6827/645991929] conn(0x7fc3ac072830 msgr2=0x7fc3ac074c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.976+0000 7fc3cb200640 1 --2- 172.21.15.144:0/2366443873 >> [v2:172.21.15.144:6826/645991929,v1:172.21.15.144:6827/645991929] conn(0x7fc3ac072830 0x7fc3ac074c50 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.976+0000 7fc3cb200640 1 -- 172.21.15.144:0/2366443873 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc3ac06c970 msgr2=0x7fc3ac06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.976+0000 7fc3cb200640 1 --2- 172.21.15.144:0/2366443873 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fc3ac06c970 0x7fc3ac06ee30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc1f7b10 tx=0x7fc3bc009190 comp rx=0 tx=0).stop 2024-09-11T23:26:59.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.976+0000 7fc3cb200640 1 -- 172.21.15.144:0/2366443873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3cc0cf710 msgr2=0x7fc3cc0ca630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:26:59.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.976+0000 7fc3cb200640 1 --2- 172.21.15.144:0/2366443873 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3cc0cf710 0x7fc3cc0ca630 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800c400 tx=0x7fc3b800c8c0 comp rx=0 tx=0).stop 2024-09-11T23:26:59.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.976+0000 7fc3ca800640 1 -- 172.21.15.144:0/2366443873 reap_dead start 2024-09-11T23:26:59.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.976+0000 7fc3cb200640 1 -- 172.21.15.144:0/2366443873 shutdown_connections 2024-09-11T23:26:59.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.976+0000 7fc3cb200640 1 -- 172.21.15.144:0/2366443873 >> 172.21.15.144:0/2366443873 conn(0x7fc3cc0d4700 msgr2=0x7fc3cc160160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:26:59.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.976+0000 7fc3cb200640 1 -- 172.21.15.144:0/2366443873 shutdown_connections 2024-09-11T23:26:59.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:26:59.976+0000 7fc3cb200640 1 -- 172.21.15.144:0/2366443873 wait complete. 2024-09-11T23:26:59.991 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-11T23:27:00.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.145+0000 7fb4f1800640 1 Processor -- start 2024-09-11T23:27:00.146 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.145+0000 7fb4f1800640 1 -- start start 2024-09-11T23:27:00.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.146+0000 7fb4f1800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb4ec15c180 0x7fb4ec0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:00.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.146+0000 7fb4f1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4ec073120 0x7fb4ec073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:00.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.146+0000 7fb4f1800640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4ec0ce740 con 0x7fb4ec0ce230 2024-09-11T23:27:00.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.146+0000 7fb4f1800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fb4ec072640 con 0x7fb4ec15c180 2024-09-11T23:27:00.147 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.146+0000 7fb4f1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb4ec072920 con 0x7fb4ec073120 2024-09-11T23:27:00.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.147+0000 7fb4eb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4ec073120 0x7fb4ec073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:00.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.147+0000 7fb4eaa00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fb4ec15c180 0x7fb4ec0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:00.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.147+0000 7fb4eb400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4ec073120 0x7fb4ec073570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:52320/0 (socket says 172.21.15.144:52320) 2024-09-11T23:27:00.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.147+0000 7fb4eb400640 1 -- 172.21.15.144:0/606544874 learned_addr learned my addr 172.21.15.144:0/606544874 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:00.148 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.147+0000 7fb4eb400640 1 -- 172.21.15.144:0/606544874 >> v2:172.21.15.165:3300/0 conn(0x7fb4ec15c180 msgr2=0x7fb4ec0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:00.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.147+0000 7fb4eb400640 1 --2- 172.21.15.144:0/606544874 >> v2:172.21.15.165:3300/0 conn(0x7fb4ec15c180 0x7fb4ec0cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.147+0000 7fb4eb400640 1 -- 172.21.15.144:0/606544874 >> v1:172.21.15.165:6789/0 conn(0x7fb4ec0ce230 legacy=0x7fb4ec0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:00.149 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.147+0000 7fb4eb400640 1 -- 172.21.15.144:0/606544874 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4ec072c00 con 0x7fb4ec073120 2024-09-11T23:27:00.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.148+0000 7fb4eb400640 1 --2- 172.21.15.144:0/606544874 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4ec073120 0x7fb4ec073570 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009e50 tx=0x7fb4e402a6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b04228214dab802c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:00.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.148+0000 7fb4e9600640 1 -- 172.21.15.144:0/606544874 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4036070 con 0x7fb4ec073120 2024-09-11T23:27:00.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.149+0000 7fb4e9600640 1 -- 172.21.15.144:0/606544874 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4e4031600 con 0x7fb4ec073120 2024-09-11T23:27:00.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.149+0000 7fb4e9600640 1 -- 172.21.15.144:0/606544874 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e40319d0 con 0x7fb4ec073120 2024-09-11T23:27:00.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.149+0000 7fb4f1800640 1 -- 172.21.15.144:0/606544874 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4ec073120 msgr2=0x7fb4ec073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:00.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.149+0000 7fb4f1800640 1 --2- 172.21.15.144:0/606544874 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4ec073120 0x7fb4ec073570 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009e50 tx=0x7fb4e402a6a0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.149+0000 7fb4f1800640 1 -- 172.21.15.144:0/606544874 shutdown_connections 2024-09-11T23:27:00.150 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.149+0000 7fb4f1800640 1 --2- 172.21.15.144:0/606544874 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4ec073120 0x7fb4ec073570 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.149+0000 7fb4f1800640 1 --2- 172.21.15.144:0/606544874 >> v2:172.21.15.165:3300/0 conn(0x7fb4ec15c180 0x7fb4ec0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.149+0000 7fb4f1800640 1 -- 172.21.15.144:0/606544874 >> 172.21.15.144:0/606544874 conn(0x7fb4ec062cc0 msgr2=0x7fb4ec06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:00.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.149+0000 7fb4f1800640 1 -- 172.21.15.144:0/606544874 shutdown_connections 2024-09-11T23:27:00.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.149+0000 7fb4f1800640 1 -- 172.21.15.144:0/606544874 wait complete. 2024-09-11T23:27:00.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.151+0000 7fb4f1800640 1 Processor -- start 2024-09-11T23:27:00.151 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.151+0000 7fb4f1800640 1 -- start start 2024-09-11T23:27:00.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.152+0000 7fb4f1800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4ec073120 0x7fb4ec0b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:00.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.152+0000 7fb4f1800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4ec0ce230 0x7fb4ec155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:00.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.152+0000 7fb4f1800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4ec15c180 0x7fb4ec15e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:00.154 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.152+0000 7fb4f1800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec0cf780 con 0x7fb4ec15c180 2024-09-11T23:27:00.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.152+0000 7fb4f1800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec0722f0 con 0x7fb4ec073120 2024-09-11T23:27:00.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.152+0000 7fb4f1800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fb4ec15c560 con 0x7fb4ec0ce230 2024-09-11T23:27:00.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.152+0000 7fb4eb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4ec15c180 0x7fb4ec15e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:00.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.152+0000 7fb4eb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4ec15c180 0x7fb4ec15e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37174/0 (socket says 172.21.15.144:37174) 2024-09-11T23:27:00.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.152+0000 7fb4eb400640 1 -- 172.21.15.144:0/834217106 learned_addr learned my addr 172.21.15.144:0/834217106 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:00.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.152+0000 7fb4eaa00640 1 --2- 172.21.15.144:0/834217106 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4ec073120 0x7fb4ec0b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:00.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.152+0000 7fb4ea000640 1 --2- 172.21.15.144:0/834217106 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4ec0ce230 0x7fb4ec155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:00.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.152+0000 7fb4eb400640 1 -- 172.21.15.144:0/834217106 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4ec0ce230 msgr2=0x7fb4ec155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:00.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.152+0000 7fb4eb400640 1 --2- 172.21.15.144:0/834217106 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4ec0ce230 0x7fb4ec155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.152+0000 7fb4eb400640 1 -- 172.21.15.144:0/834217106 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4ec073120 msgr2=0x7fb4ec0b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:00.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.152+0000 7fb4eb400640 1 --2- 172.21.15.144:0/834217106 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4ec073120 0x7fb4ec0b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.152+0000 7fb4eb400640 1 -- 172.21.15.144:0/834217106 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4ec0b1970 con 0x7fb4ec15c180 2024-09-11T23:27:00.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.153+0000 7fb4eb400640 1 --2- 172.21.15.144:0/834217106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4ec15c180 0x7fb4ec15e7b0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4034040 tx=0x7fb4e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:00.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.153+0000 7fb4e2a00640 1 -- 172.21.15.144:0/834217106 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4036050 con 0x7fb4ec15c180 2024-09-11T23:27:00.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.153+0000 7fb4e2a00640 1 -- 172.21.15.144:0/834217106 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4e4042070 con 0x7fb4ec15c180 2024-09-11T23:27:00.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.153+0000 7fb4f1800640 1 -- 172.21.15.144:0/834217106 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4ec0b0390 con 0x7fb4ec15c180 2024-09-11T23:27:00.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.153+0000 7fb4e2a00640 1 -- 172.21.15.144:0/834217106 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4009510 con 0x7fb4ec15c180 2024-09-11T23:27:00.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.153+0000 7fb4f1800640 1 -- 172.21.15.144:0/834217106 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4ec0b0950 con 0x7fb4ec15c180 2024-09-11T23:27:00.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.154+0000 7fb4f1800640 1 -- 172.21.15.144:0/834217106 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4ec0cdcf0 con 0x7fb4ec15c180 2024-09-11T23:27:00.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.155+0000 7fb4e2a00640 1 -- 172.21.15.144:0/834217106 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7fb4e4007bf0 con 0x7fb4ec15c180 2024-09-11T23:27:00.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.156+0000 7fb4e2a00640 1 --2- 172.21.15.144:0/834217106 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb4cc06c970 0x7fb4cc06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:00.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.157+0000 7fb4e2a00640 1 -- 172.21.15.144:0/834217106 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7fb4e40aa4a0 con 0x7fb4ec15c180 2024-09-11T23:27:00.157 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.157+0000 7fb4eaa00640 1 --2- 172.21.15.144:0/834217106 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb4cc06c970 0x7fb4cc06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:00.158 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.158+0000 7fb4eaa00640 1 --2- 172.21.15.144:0/834217106 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb4cc06c970 0x7fb4cc06ee30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009aa0 tx=0x7fb4dc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:00.161 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.161+0000 7fb4e2a00640 1 -- 172.21.15.144:0/834217106 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb4e40b2020 con 0x7fb4ec15c180 2024-09-11T23:27:00.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.337+0000 7fb4f1800640 1 -- 172.21.15.144:0/834217106 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fb4ec0d0700 con 0x7fb4cc06c970 2024-09-11T23:27:00.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.338+0000 7fb4e2a00640 1 -- 172.21.15.144:0/834217106 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb4ec0d0700 con 0x7fb4cc06c970 2024-09-11T23:27:00.338 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 2 to deep-scrub 2024-09-11T23:27:00.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.340+0000 7fb4f1800640 1 -- 172.21.15.144:0/834217106 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb4cc06c970 msgr2=0x7fb4cc06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:00.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.340+0000 7fb4f1800640 1 --2- 172.21.15.144:0/834217106 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb4cc06c970 0x7fb4cc06ee30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009aa0 tx=0x7fb4dc009190 comp rx=0 tx=0).stop 2024-09-11T23:27:00.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.340+0000 7fb4f1800640 1 -- 172.21.15.144:0/834217106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4ec15c180 msgr2=0x7fb4ec15e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:00.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.340+0000 7fb4f1800640 1 --2- 172.21.15.144:0/834217106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4ec15c180 0x7fb4ec15e7b0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4034040 tx=0x7fb4e4004a40 comp rx=0 tx=0).stop 2024-09-11T23:27:00.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.340+0000 7fb4f1800640 1 -- 172.21.15.144:0/834217106 shutdown_connections 2024-09-11T23:27:00.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.340+0000 7fb4f1800640 1 --2- 172.21.15.144:0/834217106 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fb4cc06c970 0x7fb4cc06ee30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.340+0000 7fb4f1800640 1 --2- 172.21.15.144:0/834217106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4ec15c180 0x7fb4ec15e7b0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.340+0000 7fb4f1800640 1 --2- 172.21.15.144:0/834217106 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fb4ec0ce230 0x7fb4ec155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.340+0000 7fb4f1800640 1 --2- 172.21.15.144:0/834217106 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4ec073120 0x7fb4ec0b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.340+0000 7fb4f1800640 1 -- 172.21.15.144:0/834217106 >> 172.21.15.144:0/834217106 conn(0x7fb4ec062cc0 msgr2=0x7fb4ec0cf900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:00.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.340+0000 7fb4f1800640 1 -- 172.21.15.144:0/834217106 shutdown_connections 2024-09-11T23:27:00.342 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.340+0000 7fb4f1800640 1 -- 172.21.15.144:0/834217106 wait complete. 2024-09-11T23:27:00.357 INFO:tasks.ceph:Scrubbing osd.3 2024-09-11T23:27:00.358 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-11T23:27:00.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.515+0000 7fec27200640 1 Processor -- start 2024-09-11T23:27:00.516 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.515+0000 7fec27200640 1 -- start start 2024-09-11T23:27:00.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.516+0000 7fec27200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fec2006ec90 0x7fec2015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:00.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.516+0000 7fec27200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec2006f070 0x7fec200cca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:00.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.516+0000 7fec27200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec2015bb70 con 0x7fec20158a90 2024-09-11T23:27:00.518 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.516+0000 7fec27200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fec2015be10 con 0x7fec2006f070 2024-09-11T23:27:00.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.516+0000 7fec27200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fec2015c0f0 con 0x7fec2006ec90 2024-09-11T23:27:00.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.517+0000 7fec1f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec2006f070 0x7fec200cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:00.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.517+0000 7fec1f400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fec2006f070 0x7fec200cca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37186/0 (socket says 172.21.15.144:37186) 2024-09-11T23:27:00.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.517+0000 7fec1f400640 1 -- 172.21.15.144:0/692544992 learned_addr learned my addr 172.21.15.144:0/692544992 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:00.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.517+0000 7fec25200640 1 --1- 172.21.15.144:0/692544992 >> v1:172.21.15.144:6789/0 conn(0x7fec20158a90 0x7fec20071040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55176/0 (socket says 172.21.15.144:55176) 2024-09-11T23:27:00.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.517+0000 7fec1fe00640 1 --2- 172.21.15.144:0/692544992 >> v2:172.21.15.165:3300/0 conn(0x7fec2006ec90 0x7fec2015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:00.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.517+0000 7fec1f400640 1 -- 172.21.15.144:0/692544992 >> v2:172.21.15.165:3300/0 conn(0x7fec2006ec90 msgr2=0x7fec2015fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:00.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.517+0000 7fec1f400640 1 --2- 172.21.15.144:0/692544992 >> v2:172.21.15.165:3300/0 conn(0x7fec2006ec90 0x7fec2015fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.517+0000 7fec1f400640 1 -- 172.21.15.144:0/692544992 >> v1:172.21.15.144:6789/0 conn(0x7fec20158a90 legacy=0x7fec20071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:00.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.517+0000 7fec1f400640 1 -- 172.21.15.144:0/692544992 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2015c3d0 con 0x7fec2006f070 2024-09-11T23:27:00.519 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.517+0000 7fec1ea00640 1 -- 172.21.15.144:0/692544992 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3374481866 0 0) 0x7fec2015bb70 con 0x7fec20158a90 2024-09-11T23:27:00.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.518+0000 7fec1f400640 1 --2- 172.21.15.144:0/692544992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2006f070 0x7fec200cca80 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fec2006c810 tx=0x7fec0c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b75921419d4acf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:00.521 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.518+0000 7fec1ea00640 1 -- 172.21.15.144:0/692544992 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c037070 con 0x7fec2006f070 2024-09-11T23:27:00.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.518+0000 7fec1ea00640 1 -- 172.21.15.144:0/692544992 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec0c032440 con 0x7fec2006f070 2024-09-11T23:27:00.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.518+0000 7fec1ea00640 1 -- 172.21.15.144:0/692544992 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c032810 con 0x7fec2006f070 2024-09-11T23:27:00.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.519+0000 7fec27200640 1 -- 172.21.15.144:0/692544992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2006f070 msgr2=0x7fec200cca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:00.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.519+0000 7fec27200640 1 --2- 172.21.15.144:0/692544992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2006f070 0x7fec200cca80 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fec2006c810 tx=0x7fec0c02a1e0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.519+0000 7fec27200640 1 -- 172.21.15.144:0/692544992 shutdown_connections 2024-09-11T23:27:00.522 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.519+0000 7fec27200640 1 --2- 172.21.15.144:0/692544992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2006f070 0x7fec200cca80 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.519+0000 7fec27200640 1 --2- 172.21.15.144:0/692544992 >> v2:172.21.15.165:3300/0 conn(0x7fec2006ec90 0x7fec2015fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.519+0000 7fec27200640 1 -- 172.21.15.144:0/692544992 >> 172.21.15.144:0/692544992 conn(0x7fec2006bba0 msgr2=0x7fec2006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:00.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.519+0000 7fec27200640 1 -- 172.21.15.144:0/692544992 shutdown_connections 2024-09-11T23:27:00.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.519+0000 7fec27200640 1 -- 172.21.15.144:0/692544992 wait complete. 2024-09-11T23:27:00.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.521+0000 7fec27200640 1 Processor -- start 2024-09-11T23:27:00.523 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.521+0000 7fec27200640 1 -- start start 2024-09-11T23:27:00.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.522+0000 7fec27200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2006ec90 0x7fec201f2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:00.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.522+0000 7fec27200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec2006f070 0x7fec201f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:00.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.522+0000 7fec27200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec20158a90 0x7fec200b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:00.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.522+0000 7fec27200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fec200cf610 con 0x7fec2006ec90 2024-09-11T23:27:00.526 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.522+0000 7fec27200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fec200ccfc0 con 0x7fec2006f070 2024-09-11T23:27:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.522+0000 7fec27200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fec200cf790 con 0x7fec20158a90 2024-09-11T23:27:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.522+0000 7fec1fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2006ec90 0x7fec201f2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.522+0000 7fec1fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2006ec90 0x7fec201f2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37192/0 (socket says 172.21.15.144:37192) 2024-09-11T23:27:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.522+0000 7fec1fe00640 1 -- 172.21.15.144:0/603624969 learned_addr learned my addr 172.21.15.144:0/603624969 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.522+0000 7fec1f400640 1 --2- 172.21.15.144:0/603624969 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec2006f070 0x7fec201f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.522+0000 7fec25200640 1 --2- 172.21.15.144:0/603624969 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec20158a90 0x7fec200b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.522+0000 7fec1fe00640 1 -- 172.21.15.144:0/603624969 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec20158a90 msgr2=0x7fec200b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.522+0000 7fec1fe00640 1 --2- 172.21.15.144:0/603624969 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fec20158a90 0x7fec200b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.527 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.522+0000 7fec1fe00640 1 -- 172.21.15.144:0/603624969 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec2006f070 msgr2=0x7fec201f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:00.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.522+0000 7fec1fe00640 1 --2- 172.21.15.144:0/603624969 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec2006f070 0x7fec201f4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.522+0000 7fec1fe00640 1 -- 172.21.15.144:0/603624969 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec201f2bf0 con 0x7fec2006ec90 2024-09-11T23:27:00.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.523+0000 7fec1fe00640 1 --2- 172.21.15.144:0/603624969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2006ec90 0x7fec201f2de0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fec1000e9b0 tx=0x7fec1000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:00.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.523+0000 7fec17e00640 1 -- 172.21.15.144:0/603624969 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec10017070 con 0x7fec2006ec90 2024-09-11T23:27:00.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.523+0000 7fec17e00640 1 -- 172.21.15.144:0/603624969 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec1000c9a0 con 0x7fec2006ec90 2024-09-11T23:27:00.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.523+0000 7fec17e00640 1 -- 172.21.15.144:0/603624969 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1000cd90 con 0x7fec2006ec90 2024-09-11T23:27:00.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.523+0000 7fec27200640 1 -- 172.21.15.144:0/603624969 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec201f2070 con 0x7fec2006ec90 2024-09-11T23:27:00.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.523+0000 7fec27200640 1 -- 172.21.15.144:0/603624969 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec201f2630 con 0x7fec2006ec90 2024-09-11T23:27:00.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.524+0000 7fec27200640 1 -- 172.21.15.144:0/603624969 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec200cca80 con 0x7fec2006ec90 2024-09-11T23:27:00.528 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.525+0000 7fec17e00640 1 -- 172.21.15.144:0/603624969 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7fec1001a070 con 0x7fec2006ec90 2024-09-11T23:27:00.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.526+0000 7fec17e00640 1 --2- 172.21.15.144:0/603624969 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fec0006c970 0x7fec0006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:00.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.526+0000 7fec17e00640 1 -- 172.21.15.144:0/603624969 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7fec10089e50 con 0x7fec2006ec90 2024-09-11T23:27:00.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.526+0000 7fec17e00640 1 --2- 172.21.15.144:0/603624969 >> [v2:172.21.15.144:6802/186820848,v1:172.21.15.144:6803/186820848] conn(0x7fec00072830 0x7fec00074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:00.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.526+0000 7fec17e00640 1 -- 172.21.15.144:0/603624969 --> [v2:172.21.15.144:6802/186820848,v1:172.21.15.144:6803/186820848] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec1001fe50 con 0x7fec00072830 2024-09-11T23:27:00.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.526+0000 7fec17e00640 1 -- 172.21.15.144:0/603624969 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7fec10093050 con 0x7fec2006ec90 2024-09-11T23:27:00.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.526+0000 7fec25200640 1 --2- 172.21.15.144:0/603624969 >> [v2:172.21.15.144:6802/186820848,v1:172.21.15.144:6803/186820848] conn(0x7fec00072830 0x7fec00074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:00.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.526+0000 7fec1f400640 1 --2- 172.21.15.144:0/603624969 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fec0006c970 0x7fec0006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:00.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.527+0000 7fec25200640 1 --2- 172.21.15.144:0/603624969 >> [v2:172.21.15.144:6802/186820848,v1:172.21.15.144:6803/186820848] conn(0x7fec00072830 0x7fec00074c50 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:00.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.527+0000 7fec1f400640 1 --2- 172.21.15.144:0/603624969 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fec0006c970 0x7fec0006ee30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fec0c034000 tx=0x7fec0c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:00.532 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.527+0000 7fec17e00640 1 -- 172.21.15.144:0/603624969 <== osd.3 v2:172.21.15.144:6802/186820848 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec1001fe50 con 0x7fec00072830 2024-09-11T23:27:00.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.540+0000 7fec27200640 1 -- 172.21.15.144:0/603624969 --> [v2:172.21.15.144:6802/186820848,v1:172.21.15.144:6803/186820848] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fec2015b470 con 0x7fec00072830 2024-09-11T23:27:00.541 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.541+0000 7fec17e00640 1 -- 172.21.15.144:0/603624969 <== osd.3 v2:172.21.15.144:6802/186820848 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fec2015b470 con 0x7fec00072830 2024-09-11T23:27:00.542 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:27:00.542 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T23:27:00.542 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:27:00.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.541+0000 7fec27200640 1 -- 172.21.15.144:0/603624969 >> [v2:172.21.15.144:6802/186820848,v1:172.21.15.144:6803/186820848] conn(0x7fec00072830 msgr2=0x7fec00074c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:00.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.541+0000 7fec27200640 1 --2- 172.21.15.144:0/603624969 >> [v2:172.21.15.144:6802/186820848,v1:172.21.15.144:6803/186820848] conn(0x7fec00072830 0x7fec00074c50 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.541+0000 7fec27200640 1 -- 172.21.15.144:0/603624969 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fec0006c970 msgr2=0x7fec0006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:00.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.541+0000 7fec27200640 1 --2- 172.21.15.144:0/603624969 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fec0006c970 0x7fec0006ee30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fec0c034000 tx=0x7fec0c02e000 comp rx=0 tx=0).stop 2024-09-11T23:27:00.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.541+0000 7fec27200640 1 -- 172.21.15.144:0/603624969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2006ec90 msgr2=0x7fec201f2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:00.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.541+0000 7fec27200640 1 --2- 172.21.15.144:0/603624969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec2006ec90 0x7fec201f2de0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fec1000e9b0 tx=0x7fec1000ee70 comp rx=0 tx=0).stop 2024-09-11T23:27:00.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.541+0000 7fec25200640 1 -- 172.21.15.144:0/603624969 reap_dead start 2024-09-11T23:27:00.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.541+0000 7fec27200640 1 -- 172.21.15.144:0/603624969 shutdown_connections 2024-09-11T23:27:00.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.541+0000 7fec27200640 1 -- 172.21.15.144:0/603624969 >> 172.21.15.144:0/603624969 conn(0x7fec2006bba0 msgr2=0x7fec200cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:00.543 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.541+0000 7fec27200640 1 -- 172.21.15.144:0/603624969 shutdown_connections 2024-09-11T23:27:00.544 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.542+0000 7fec27200640 1 -- 172.21.15.144:0/603624969 wait complete. 2024-09-11T23:27:00.557 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-11T23:27:00.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.711+0000 7f3e3fe00640 1 Processor -- start 2024-09-11T23:27:00.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.711+0000 7f3e3fe00640 1 -- start start 2024-09-11T23:27:00.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.712+0000 7f3e3fe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e4015e640 0x7f3e400d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:00.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.712+0000 7f3e3fe00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3e400d3f60 0x7f3e400b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:00.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.712+0000 7f3e3fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e400b6510 0x7f3e400d27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:00.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.712+0000 7f3e3fe00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3e4015ea20 con 0x7f3e4015e640 2024-09-11T23:27:00.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.713+0000 7f3e3fe00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3e4006caf0 con 0x7f3e400d3f60 2024-09-11T23:27:00.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.713+0000 7f3e3fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3e4006bee0 con 0x7f3e400b6510 2024-09-11T23:27:00.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.713+0000 7f3e3ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e4015e640 0x7f3e400d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:00.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.713+0000 7f3e3ea00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e4015e640 0x7f3e400d3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37206/0 (socket says 172.21.15.144:37206) 2024-09-11T23:27:00.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.713+0000 7f3e3ea00640 1 -- 172.21.15.144:0/2087179480 learned_addr learned my addr 172.21.15.144:0/2087179480 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:00.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.713+0000 7f3e3ea00640 1 -- 172.21.15.144:0/2087179480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e400b6510 msgr2=0x7f3e400d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:00.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.713+0000 7f3e3ea00640 1 --2- 172.21.15.144:0/2087179480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e400b6510 0x7f3e400d27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.713+0000 7f3e3ea00640 1 -- 172.21.15.144:0/2087179480 >> v2:172.21.15.165:3300/0 conn(0x7f3e400d3f60 msgr2=0x7f3e400b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:00.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.713+0000 7f3e3ea00640 1 --2- 172.21.15.144:0/2087179480 >> v2:172.21.15.165:3300/0 conn(0x7f3e400d3f60 0x7f3e400b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.713+0000 7f3e3ea00640 1 -- 172.21.15.144:0/2087179480 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4006c1c0 con 0x7f3e4015e640 2024-09-11T23:27:00.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.714+0000 7f3e3ea00640 1 --2- 172.21.15.144:0/2087179480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4015e640 0x7f3e400d3a20 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f3e400d0fa0 tx=0x7f3e3002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f7b4f3ef34edd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:00.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.714+0000 7f3e3e000640 1 -- 172.21.15.144:0/2087179480 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e30037070 con 0x7f3e4015e640 2024-09-11T23:27:00.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.715+0000 7f3e3e000640 1 -- 172.21.15.144:0/2087179480 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e30032440 con 0x7f3e4015e640 2024-09-11T23:27:00.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.715+0000 7f3e3e000640 1 -- 172.21.15.144:0/2087179480 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e30032810 con 0x7f3e4015e640 2024-09-11T23:27:00.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.715+0000 7f3e3fe00640 1 -- 172.21.15.144:0/2087179480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4015e640 msgr2=0x7f3e400d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:00.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.715+0000 7f3e3fe00640 1 --2- 172.21.15.144:0/2087179480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4015e640 0x7f3e400d3a20 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f3e400d0fa0 tx=0x7f3e3002a1e0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.715+0000 7f3e3fe00640 1 -- 172.21.15.144:0/2087179480 shutdown_connections 2024-09-11T23:27:00.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.715+0000 7f3e3fe00640 1 --2- 172.21.15.144:0/2087179480 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e400b6510 0x7f3e400d27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.715+0000 7f3e3fe00640 1 --2- 172.21.15.144:0/2087179480 >> v2:172.21.15.165:3300/0 conn(0x7f3e400d3f60 0x7f3e400b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.716 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.715+0000 7f3e3fe00640 1 --2- 172.21.15.144:0/2087179480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4015e640 0x7f3e400d3a20 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.715+0000 7f3e3fe00640 1 -- 172.21.15.144:0/2087179480 >> 172.21.15.144:0/2087179480 conn(0x7f3e400d0fd0 msgr2=0x7f3e400d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:00.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.715+0000 7f3e3fe00640 1 -- 172.21.15.144:0/2087179480 shutdown_connections 2024-09-11T23:27:00.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.715+0000 7f3e3fe00640 1 -- 172.21.15.144:0/2087179480 wait complete. 2024-09-11T23:27:00.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.717+0000 7f3e3fe00640 1 Processor -- start 2024-09-11T23:27:00.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.717+0000 7f3e3fe00640 1 -- start start 2024-09-11T23:27:00.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.718+0000 7f3e3fe00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e400b6510 0x7f3e401549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:00.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.718+0000 7f3e3fe00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e400d3f60 0x7f3e401e79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:00.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.718+0000 7f3e3fe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4015e640 0x7f3e401f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:00.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.718+0000 7f3e3fe00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3e400d2d00 con 0x7f3e4015e640 2024-09-11T23:27:00.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.718+0000 7f3e3fe00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4006c780 con 0x7f3e400b6510 2024-09-11T23:27:00.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.718+0000 7f3e3fe00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3e400d2e80 con 0x7f3e400d3f60 2024-09-11T23:27:00.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.718+0000 7f3e3f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4015e640 0x7f3e401f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:00.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.718+0000 7f3e3f400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4015e640 0x7f3e401f46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37214/0 (socket says 172.21.15.144:37214) 2024-09-11T23:27:00.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.718+0000 7f3e3f400640 1 -- 172.21.15.144:0/3172764126 learned_addr learned my addr 172.21.15.144:0/3172764126 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:00.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.718+0000 7f3e36000640 1 --2- 172.21.15.144:0/3172764126 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e400d3f60 0x7f3e401e79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:00.720 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.718+0000 7f3e3ea00640 1 --2- 172.21.15.144:0/3172764126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e400b6510 0x7f3e401549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:00.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.718+0000 7f3e3f400640 1 -- 172.21.15.144:0/3172764126 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e400d3f60 msgr2=0x7f3e401e79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:00.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.718+0000 7f3e3f400640 1 --2- 172.21.15.144:0/3172764126 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e400d3f60 0x7f3e401e79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.718+0000 7f3e3f400640 1 -- 172.21.15.144:0/3172764126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e400b6510 msgr2=0x7f3e401549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:00.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.718+0000 7f3e3f400640 1 --2- 172.21.15.144:0/3172764126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e400b6510 0x7f3e401549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.718+0000 7f3e3f400640 1 -- 172.21.15.144:0/3172764126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e401e8450 con 0x7f3e4015e640 2024-09-11T23:27:00.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.718+0000 7f3e3ea00640 1 --2- 172.21.15.144:0/3172764126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e400b6510 0x7f3e401549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:27:00.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.719+0000 7f3e3f400640 1 --2- 172.21.15.144:0/3172764126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4015e640 0x7f3e401f46d0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f3e3800b970 tx=0x7f3e3800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:00.721 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.719+0000 7f3e37400640 1 -- 172.21.15.144:0/3172764126 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e38019070 con 0x7f3e4015e640 2024-09-11T23:27:00.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.719+0000 7f3e37400640 1 -- 172.21.15.144:0/3172764126 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e3800cb60 con 0x7f3e4015e640 2024-09-11T23:27:00.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.719+0000 7f3e37400640 1 -- 172.21.15.144:0/3172764126 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e38014440 con 0x7f3e4015e640 2024-09-11T23:27:00.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.719+0000 7f3e3fe00640 1 -- 172.21.15.144:0/3172764126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e401e8730 con 0x7f3e4015e640 2024-09-11T23:27:00.722 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.719+0000 7f3e3fe00640 1 -- 172.21.15.144:0/3172764126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e401e8cf0 con 0x7f3e4015e640 2024-09-11T23:27:00.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.720+0000 7f3e3fe00640 1 -- 172.21.15.144:0/3172764126 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e400b5fd0 con 0x7f3e4015e640 2024-09-11T23:27:00.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.721+0000 7f3e37400640 1 -- 172.21.15.144:0/3172764126 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f3e3801c070 con 0x7f3e4015e640 2024-09-11T23:27:00.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.722+0000 7f3e37400640 1 --2- 172.21.15.144:0/3172764126 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e1c06c970 0x7f3e1c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:00.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.722+0000 7f3e37400640 1 -- 172.21.15.144:0/3172764126 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7f3e38089570 con 0x7f3e4015e640 2024-09-11T23:27:00.723 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.723+0000 7f3e3ea00640 1 --2- 172.21.15.144:0/3172764126 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e1c06c970 0x7f3e1c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:00.724 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.723+0000 7f3e3ea00640 1 --2- 172.21.15.144:0/3172764126 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e1c06c970 0x7f3e1c06ee30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3e30034000 tx=0x7f3e3002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:00.727 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.726+0000 7f3e37400640 1 -- 172.21.15.144:0/3172764126 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e38059970 con 0x7f3e4015e640 2024-09-11T23:27:00.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.902+0000 7f3e3fe00640 1 -- 172.21.15.144:0/3172764126 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f3e400b56d0 con 0x7f3e1c06c970 2024-09-11T23:27:00.903 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.903+0000 7f3e37400640 1 -- 172.21.15.144:0/3172764126 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3e400b56d0 con 0x7f3e1c06c970 2024-09-11T23:27:00.903 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 3 to deep-scrub 2024-09-11T23:27:00.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.905+0000 7f3e3fe00640 1 -- 172.21.15.144:0/3172764126 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e1c06c970 msgr2=0x7f3e1c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:00.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.905+0000 7f3e3fe00640 1 --2- 172.21.15.144:0/3172764126 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e1c06c970 0x7f3e1c06ee30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3e30034000 tx=0x7f3e3002e000 comp rx=0 tx=0).stop 2024-09-11T23:27:00.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.905+0000 7f3e3fe00640 1 -- 172.21.15.144:0/3172764126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4015e640 msgr2=0x7f3e401f46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:00.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.905+0000 7f3e3fe00640 1 --2- 172.21.15.144:0/3172764126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4015e640 0x7f3e401f46d0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f3e3800b970 tx=0x7f3e3800be30 comp rx=0 tx=0).stop 2024-09-11T23:27:00.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.905+0000 7f3e3fe00640 1 -- 172.21.15.144:0/3172764126 shutdown_connections 2024-09-11T23:27:00.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.905+0000 7f3e3fe00640 1 --2- 172.21.15.144:0/3172764126 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3e1c06c970 0x7f3e1c06ee30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.905+0000 7f3e3fe00640 1 --2- 172.21.15.144:0/3172764126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e4015e640 0x7f3e401f46d0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.905+0000 7f3e3fe00640 1 --2- 172.21.15.144:0/3172764126 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3e400d3f60 0x7f3e401e79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.905+0000 7f3e3fe00640 1 --2- 172.21.15.144:0/3172764126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e400b6510 0x7f3e401549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:00.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.905+0000 7f3e3fe00640 1 -- 172.21.15.144:0/3172764126 >> 172.21.15.144:0/3172764126 conn(0x7f3e400d0fd0 msgr2=0x7f3e400b95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:00.906 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.905+0000 7f3e3fe00640 1 -- 172.21.15.144:0/3172764126 shutdown_connections 2024-09-11T23:27:00.907 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:00.905+0000 7f3e3fe00640 1 -- 172.21.15.144:0/3172764126 wait complete. 2024-09-11T23:27:00.921 INFO:tasks.ceph:Scrubbing osd.4 2024-09-11T23:27:00.921 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-11T23:27:01.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.077+0000 7f26c8600640 1 Processor -- start 2024-09-11T23:27:01.078 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.078+0000 7f26c8600640 1 -- start start 2024-09-11T23:27:01.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.079+0000 7f26c8600640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f26c01472f0 0x7f26c00b5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.079+0000 7f26c8600640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f26c00aeff0 0x7f26c006d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.079+0000 7f26c8600640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26c00710e0 con 0x7f26c00b5840 2024-09-11T23:27:01.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.079+0000 7f26c8600640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f26c00713c0 con 0x7f26c01472f0 2024-09-11T23:27:01.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.079+0000 7f26c8600640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f26c00716a0 con 0x7f26c00aeff0 2024-09-11T23:27:01.080 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.079+0000 7f26c5c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f26c01472f0 0x7f26c00b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.079+0000 7f26c5c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f26c01472f0 0x7f26c00b5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37218/0 (socket says 172.21.15.144:37218) 2024-09-11T23:27:01.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.079+0000 7f26c5c00640 1 -- 172.21.15.144:0/1552856472 learned_addr learned my addr 172.21.15.144:0/1552856472 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:01.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.079+0000 7f26c6600640 1 --2- 172.21.15.144:0/1552856472 >> v2:172.21.15.165:3300/0 conn(0x7f26c00aeff0 0x7f26c006d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.079+0000 7f26c5c00640 1 -- 172.21.15.144:0/1552856472 >> v2:172.21.15.165:3300/0 conn(0x7f26c00aeff0 msgr2=0x7f26c006d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:01.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.080+0000 7f26c5c00640 1 --2- 172.21.15.144:0/1552856472 >> v2:172.21.15.165:3300/0 conn(0x7f26c00aeff0 0x7f26c006d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.080+0000 7f26c5c00640 1 -- 172.21.15.144:0/1552856472 >> v1:172.21.15.165:6789/0 conn(0x7f26c00b5840 legacy=0x7f26c00ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:01.081 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.080+0000 7f26c5c00640 1 -- 172.21.15.144:0/1552856472 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c0071980 con 0x7f26c01472f0 2024-09-11T23:27:01.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.080+0000 7f26c5c00640 1 --2- 172.21.15.144:0/1552856472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26c01472f0 0x7f26c00b5300 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f26c00b4050 tx=0x7f26b402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ada0e33584dd92d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:01.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.081+0000 7f26bfe00640 1 -- 172.21.15.144:0/1552856472 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4036070 con 0x7f26c01472f0 2024-09-11T23:27:01.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.081+0000 7f26bfe00640 1 -- 172.21.15.144:0/1552856472 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26b4031600 con 0x7f26c01472f0 2024-09-11T23:27:01.082 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.081+0000 7f26bfe00640 1 -- 172.21.15.144:0/1552856472 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b40319d0 con 0x7f26c01472f0 2024-09-11T23:27:01.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.081+0000 7f26c8600640 1 -- 172.21.15.144:0/1552856472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26c01472f0 msgr2=0x7f26c00b5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.081+0000 7f26c8600640 1 --2- 172.21.15.144:0/1552856472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26c01472f0 0x7f26c00b5300 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f26c00b4050 tx=0x7f26b402a660 comp rx=0 tx=0).stop 2024-09-11T23:27:01.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.081+0000 7f26c8600640 1 -- 172.21.15.144:0/1552856472 shutdown_connections 2024-09-11T23:27:01.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.081+0000 7f26c8600640 1 --2- 172.21.15.144:0/1552856472 >> v2:172.21.15.165:3300/0 conn(0x7f26c00aeff0 0x7f26c006d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.081+0000 7f26c8600640 1 --2- 172.21.15.144:0/1552856472 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26c01472f0 0x7f26c00b5300 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.081+0000 7f26c8600640 1 -- 172.21.15.144:0/1552856472 >> 172.21.15.144:0/1552856472 conn(0x7f26c006bba0 msgr2=0x7f26c006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:01.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.082+0000 7f26c8600640 1 -- 172.21.15.144:0/1552856472 shutdown_connections 2024-09-11T23:27:01.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.082+0000 7f26c8600640 1 -- 172.21.15.144:0/1552856472 wait complete. 2024-09-11T23:27:01.083 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.083+0000 7f26c8600640 1 Processor -- start 2024-09-11T23:27:01.084 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.083+0000 7f26c8600640 1 -- start start 2024-09-11T23:27:01.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.084+0000 7f26c8600640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26c00aeff0 0x7f26c0161550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.084+0000 7f26c8600640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26c00b5840 0x7f26c01e9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.084+0000 7f26c8600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26c01472f0 0x7f26c01e9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.084+0000 7f26c8600640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f26c00728c0 con 0x7f26c00b5840 2024-09-11T23:27:01.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.084+0000 7f26c8600640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f26c01476d0 con 0x7f26c01472f0 2024-09-11T23:27:01.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.084+0000 7f26c8600640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f26c0072a40 con 0x7f26c00aeff0 2024-09-11T23:27:01.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.084+0000 7f26c5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26c00b5840 0x7f26c01e9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.086 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.084+0000 7f26c5200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26c00b5840 0x7f26c01e9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37220/0 (socket says 172.21.15.144:37220) 2024-09-11T23:27:01.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.084+0000 7f26c5200640 1 -- 172.21.15.144:0/579236659 learned_addr learned my addr 172.21.15.144:0/579236659 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:01.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.084+0000 7f26c6600640 1 --2- 172.21.15.144:0/579236659 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26c01472f0 0x7f26c01e9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.084+0000 7f26c5c00640 1 --2- 172.21.15.144:0/579236659 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26c00aeff0 0x7f26c0161550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.085+0000 7f26c5200640 1 -- 172.21.15.144:0/579236659 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26c00aeff0 msgr2=0x7f26c0161550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.085+0000 7f26c5200640 1 --2- 172.21.15.144:0/579236659 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f26c00aeff0 0x7f26c0161550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.085+0000 7f26c5200640 1 -- 172.21.15.144:0/579236659 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26c01472f0 msgr2=0x7f26c01e9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.085+0000 7f26c5200640 1 --2- 172.21.15.144:0/579236659 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26c01472f0 0x7f26c01e9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.085+0000 7f26c5200640 1 -- 172.21.15.144:0/579236659 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c01e9070 con 0x7f26c00b5840 2024-09-11T23:27:01.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.085+0000 7f26c5200640 1 --2- 172.21.15.144:0/579236659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26c00b5840 0x7f26c01e9940 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00c430 tx=0x7f26ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:01.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.085+0000 7f26bd600640 1 -- 172.21.15.144:0/579236659 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac011790 con 0x7f26c00b5840 2024-09-11T23:27:01.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.085+0000 7f26bd600640 1 -- 172.21.15.144:0/579236659 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26ac017070 con 0x7f26c00b5840 2024-09-11T23:27:01.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.085+0000 7f26bd600640 1 -- 172.21.15.144:0/579236659 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac011bb0 con 0x7f26c00b5840 2024-09-11T23:27:01.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.085+0000 7f26c8600640 1 -- 172.21.15.144:0/579236659 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c01e9350 con 0x7f26c00b5840 2024-09-11T23:27:01.087 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.086+0000 7f26c8600640 1 -- 172.21.15.144:0/579236659 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c0161a90 con 0x7f26c00b5840 2024-09-11T23:27:01.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.086+0000 7f26c8600640 1 -- 172.21.15.144:0/579236659 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f26c01430a0 con 0x7f26c00b5840 2024-09-11T23:27:01.088 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.088+0000 7f26bd600640 1 -- 172.21.15.144:0/579236659 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f26ac01c460 con 0x7f26c00b5840 2024-09-11T23:27:01.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.088+0000 7f26bd600640 1 --2- 172.21.15.144:0/579236659 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f26a006c970 0x7f26a006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.088+0000 7f26bd600640 1 -- 172.21.15.144:0/579236659 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7f26ac089620 con 0x7f26c00b5840 2024-09-11T23:27:01.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.089+0000 7f26bd600640 1 --2- 172.21.15.144:0/579236659 >> [v2:172.21.15.165:6808/46808092,v1:172.21.15.165:6809/46808092] conn(0x7f26a0072830 0x7f26a0074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.089+0000 7f26bd600640 1 -- 172.21.15.144:0/579236659 --> [v2:172.21.15.165:6808/46808092,v1:172.21.15.165:6809/46808092] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f26ac00ae50 con 0x7f26a0072830 2024-09-11T23:27:01.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.089+0000 7f26bd600640 1 -- 172.21.15.144:0/579236659 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7f26ac090030 con 0x7f26c00b5840 2024-09-11T23:27:01.089 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.089+0000 7f26c5c00640 1 --2- 172.21.15.144:0/579236659 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f26a006c970 0x7f26a006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.089+0000 7f26c6600640 1 --2- 172.21.15.144:0/579236659 >> [v2:172.21.15.165:6808/46808092,v1:172.21.15.165:6809/46808092] conn(0x7f26a0072830 0x7f26a0074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.090+0000 7f26c6600640 1 --2- 172.21.15.144:0/579236659 >> [v2:172.21.15.165:6808/46808092,v1:172.21.15.165:6809/46808092] conn(0x7f26a0072830 0x7f26a0074c50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:01.090 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.090+0000 7f26c5c00640 1 --2- 172.21.15.144:0/579236659 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f26a006c970 0x7f26a006ee30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f26b4033000 tx=0x7f26b4009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:01.091 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.091+0000 7f26bd600640 1 -- 172.21.15.144:0/579236659 <== osd.4 v2:172.21.15.165:6808/46808092 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f26ac00ae50 con 0x7f26a0072830 2024-09-11T23:27:01.104 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.103+0000 7f26c8600640 1 -- 172.21.15.144:0/579236659 --> [v2:172.21.15.165:6808/46808092,v1:172.21.15.165:6809/46808092] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f26c00b40f0 con 0x7f26a0072830 2024-09-11T23:27:01.105 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.104+0000 7f26bd600640 1 -- 172.21.15.144:0/579236659 <== osd.4 v2:172.21.15.165:6808/46808092 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f26c00b40f0 con 0x7f26a0072830 2024-09-11T23:27:01.105 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:27:01.105 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T23:27:01.105 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:27:01.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.105+0000 7f26c8600640 1 -- 172.21.15.144:0/579236659 >> [v2:172.21.15.165:6808/46808092,v1:172.21.15.165:6809/46808092] conn(0x7f26a0072830 msgr2=0x7f26a0074c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.105+0000 7f26c8600640 1 --2- 172.21.15.144:0/579236659 >> [v2:172.21.15.165:6808/46808092,v1:172.21.15.165:6809/46808092] conn(0x7f26a0072830 0x7f26a0074c50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.105+0000 7f26c8600640 1 -- 172.21.15.144:0/579236659 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f26a006c970 msgr2=0x7f26a006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.105+0000 7f26c8600640 1 --2- 172.21.15.144:0/579236659 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f26a006c970 0x7f26a006ee30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f26b4033000 tx=0x7f26b4009000 comp rx=0 tx=0).stop 2024-09-11T23:27:01.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.105+0000 7f26c8600640 1 -- 172.21.15.144:0/579236659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26c00b5840 msgr2=0x7f26c01e9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.106 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.105+0000 7f26c8600640 1 --2- 172.21.15.144:0/579236659 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26c00b5840 0x7f26c01e9940 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00c430 tx=0x7f26ac00c8f0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.105+0000 7f26c6600640 1 -- 172.21.15.144:0/579236659 reap_dead start 2024-09-11T23:27:01.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.105+0000 7f26c8600640 1 -- 172.21.15.144:0/579236659 shutdown_connections 2024-09-11T23:27:01.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.105+0000 7f26c8600640 1 -- 172.21.15.144:0/579236659 >> 172.21.15.144:0/579236659 conn(0x7f26c006bba0 msgr2=0x7f26c0142990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:01.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.105+0000 7f26c8600640 1 -- 172.21.15.144:0/579236659 shutdown_connections 2024-09-11T23:27:01.107 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.105+0000 7f26c8600640 1 -- 172.21.15.144:0/579236659 wait complete. 2024-09-11T23:27:01.121 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-11T23:27:01.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.275+0000 7f70e2c00640 1 Processor -- start 2024-09-11T23:27:01.276 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.275+0000 7f70e2c00640 1 -- start start 2024-09-11T23:27:01.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.276+0000 7f70e2c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f70dc0b6d00 0x7f70dc071490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.277+0000 7f70e2c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f70dc0d1b00 0x7f70dc15f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.277+0000 7f70e2c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70dc0b70e0 0x7f70dc0d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.277+0000 7f70e2c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f70dc0b5720 con 0x7f70dc0d1b00 2024-09-11T23:27:01.278 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.277+0000 7f70e2c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f70dc071000 con 0x7f70dc0b6d00 2024-09-11T23:27:01.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.277+0000 7f70e2c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f70dc0d22a0 con 0x7f70dc0b70e0 2024-09-11T23:27:01.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.277+0000 7f70e0e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f70dc0d1b00 0x7f70dc15f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.277+0000 7f70e0e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f70dc0d1b00 0x7f70dc15f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37236/0 (socket says 172.21.15.144:37236) 2024-09-11T23:27:01.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.277+0000 7f70e0e00640 1 -- 172.21.15.144:0/780626185 learned_addr learned my addr 172.21.15.144:0/780626185 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:01.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.277+0000 7f70e1800640 1 --2- 172.21.15.144:0/780626185 >> v2:172.21.15.165:3300/0 conn(0x7f70dc0b6d00 0x7f70dc071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.277+0000 7f70e2200640 1 --2- 172.21.15.144:0/780626185 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70dc0b70e0 0x7f70dc0d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.277+0000 7f70e0e00640 1 -- 172.21.15.144:0/780626185 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70dc0b70e0 msgr2=0x7f70dc0d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:01.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.277+0000 7f70e0e00640 1 --2- 172.21.15.144:0/780626185 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70dc0b70e0 0x7f70dc0d0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.277+0000 7f70e0e00640 1 -- 172.21.15.144:0/780626185 >> v2:172.21.15.165:3300/0 conn(0x7f70dc0b6d00 msgr2=0x7f70dc071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:01.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.277+0000 7f70e0e00640 1 --2- 172.21.15.144:0/780626185 >> v2:172.21.15.165:3300/0 conn(0x7f70dc0b6d00 0x7f70dc071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.279 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.277+0000 7f70e0e00640 1 -- 172.21.15.144:0/780626185 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70dc15fb40 con 0x7f70dc0d1b00 2024-09-11T23:27:01.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.278+0000 7f70e0e00640 1 --2- 172.21.15.144:0/780626185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70dc0d1b00 0x7f70dc15f600 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f70dc063700 tx=0x7f70c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc42daff41a1a49 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:01.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.278+0000 7f70dbe00640 1 -- 172.21.15.144:0/780626185 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c8037070 con 0x7f70dc0d1b00 2024-09-11T23:27:01.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.279+0000 7f70dbe00640 1 -- 172.21.15.144:0/780626185 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c8032440 con 0x7f70dc0d1b00 2024-09-11T23:27:01.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.279+0000 7f70dbe00640 1 -- 172.21.15.144:0/780626185 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c8032810 con 0x7f70dc0d1b00 2024-09-11T23:27:01.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.279+0000 7f70e2c00640 1 -- 172.21.15.144:0/780626185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70dc0d1b00 msgr2=0x7f70dc15f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.279+0000 7f70e2c00640 1 --2- 172.21.15.144:0/780626185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70dc0d1b00 0x7f70dc15f600 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f70dc063700 tx=0x7f70c802a1e0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.279+0000 7f70e2c00640 1 -- 172.21.15.144:0/780626185 shutdown_connections 2024-09-11T23:27:01.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.279+0000 7f70e2c00640 1 --2- 172.21.15.144:0/780626185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70dc0d1b00 0x7f70dc15f600 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.279+0000 7f70e2c00640 1 --2- 172.21.15.144:0/780626185 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70dc0b70e0 0x7f70dc0d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.279+0000 7f70e2c00640 1 --2- 172.21.15.144:0/780626185 >> v2:172.21.15.165:3300/0 conn(0x7f70dc0b6d00 0x7f70dc071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.281 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.279+0000 7f70e2c00640 1 -- 172.21.15.144:0/780626185 >> 172.21.15.144:0/780626185 conn(0x7f70dc06f390 msgr2=0x7f70dc06f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:01.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.279+0000 7f70e2c00640 1 -- 172.21.15.144:0/780626185 shutdown_connections 2024-09-11T23:27:01.282 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.279+0000 7f70e2c00640 1 -- 172.21.15.144:0/780626185 wait complete. 2024-09-11T23:27:01.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.281+0000 7f70e2c00640 1 Processor -- start 2024-09-11T23:27:01.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.281+0000 7f70e2c00640 1 -- start start 2024-09-11T23:27:01.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.282+0000 7f70e2c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70dc0b6d00 0x7f70dc14def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.282+0000 7f70e2c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f70dc0b70e0 0x7f70dc0cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.284 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.282+0000 7f70e2c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70dc0d1b00 0x7f70dc157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.282+0000 7f70e2c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f70dc070c90 con 0x7f70dc0d1b00 2024-09-11T23:27:01.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.282+0000 7f70e2c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f70dc0709b0 con 0x7f70dc0b70e0 2024-09-11T23:27:01.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.282+0000 7f70e2c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f70dc0b7550 con 0x7f70dc0b6d00 2024-09-11T23:27:01.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.282+0000 7f70e2200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70dc0d1b00 0x7f70dc157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.282+0000 7f70e2200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70dc0d1b00 0x7f70dc157850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37246/0 (socket says 172.21.15.144:37246) 2024-09-11T23:27:01.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.282+0000 7f70e2200640 1 -- 172.21.15.144:0/3167004501 learned_addr learned my addr 172.21.15.144:0/3167004501 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:01.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.282+0000 7f70e1800640 1 --2- 172.21.15.144:0/3167004501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70dc0b6d00 0x7f70dc14def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.282+0000 7f70e0e00640 1 --2- 172.21.15.144:0/3167004501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f70dc0b70e0 0x7f70dc0cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.282+0000 7f70e2200640 1 -- 172.21.15.144:0/3167004501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70dc0b6d00 msgr2=0x7f70dc14def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.282+0000 7f70e2200640 1 --2- 172.21.15.144:0/3167004501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70dc0b6d00 0x7f70dc14def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.282+0000 7f70e2200640 1 -- 172.21.15.144:0/3167004501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f70dc0b70e0 msgr2=0x7f70dc0cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.285 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.282+0000 7f70e2200640 1 --2- 172.21.15.144:0/3167004501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f70dc0b70e0 0x7f70dc0cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.282+0000 7f70e2200640 1 -- 172.21.15.144:0/3167004501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70dc0cd9b0 con 0x7f70dc0d1b00 2024-09-11T23:27:01.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.283+0000 7f70e2200640 1 --2- 172.21.15.144:0/3167004501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70dc0d1b00 0x7f70dc157850 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f70d400d800 tx=0x7f70d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:01.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.283+0000 7f70d9600640 1 -- 172.21.15.144:0/3167004501 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d400b660 con 0x7f70dc0d1b00 2024-09-11T23:27:01.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.283+0000 7f70d9600640 1 -- 172.21.15.144:0/3167004501 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d4019070 con 0x7f70dc0d1b00 2024-09-11T23:27:01.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.283+0000 7f70d9600640 1 -- 172.21.15.144:0/3167004501 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d400ba60 con 0x7f70dc0d1b00 2024-09-11T23:27:01.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.283+0000 7f70e2c00640 1 -- 172.21.15.144:0/3167004501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70dc0cdc90 con 0x7f70dc0d1b00 2024-09-11T23:27:01.286 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.283+0000 7f70e2c00640 1 -- 172.21.15.144:0/3167004501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70dc1593b0 con 0x7f70dc0d1b00 2024-09-11T23:27:01.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.284+0000 7f70e2c00640 1 -- 172.21.15.144:0/3167004501 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70dc06d4d0 con 0x7f70dc0d1b00 2024-09-11T23:27:01.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.285+0000 7f70d9600640 1 -- 172.21.15.144:0/3167004501 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f70d400bc00 con 0x7f70dc0d1b00 2024-09-11T23:27:01.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.286+0000 7f70d9600640 1 --2- 172.21.15.144:0/3167004501 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f70bc06c970 0x7f70bc06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.286+0000 7f70d9600640 1 -- 172.21.15.144:0/3167004501 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7f70d4089b60 con 0x7f70dc0d1b00 2024-09-11T23:27:01.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.286+0000 7f70e1800640 1 --2- 172.21.15.144:0/3167004501 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f70bc06c970 0x7f70bc06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.287 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.287+0000 7f70e1800640 1 --2- 172.21.15.144:0/3167004501 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f70bc06c970 0x7f70bc06ee30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f70d0003aa0 tx=0x7f70d0009830 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:01.291 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.290+0000 7f70d9600640 1 -- 172.21.15.144:0/3167004501 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f70d4059850 con 0x7f70dc0d1b00 2024-09-11T23:27:01.464 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.463+0000 7f70e2c00640 1 -- 172.21.15.144:0/3167004501 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f70dc06d1f0 con 0x7f70bc06c970 2024-09-11T23:27:01.465 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.464+0000 7f70d9600640 1 -- 172.21.15.144:0/3167004501 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f70dc06d1f0 con 0x7f70bc06c970 2024-09-11T23:27:01.465 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 4 to deep-scrub 2024-09-11T23:27:01.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.467+0000 7f70e2c00640 1 -- 172.21.15.144:0/3167004501 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f70bc06c970 msgr2=0x7f70bc06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.467+0000 7f70e2c00640 1 --2- 172.21.15.144:0/3167004501 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f70bc06c970 0x7f70bc06ee30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f70d0003aa0 tx=0x7f70d0009830 comp rx=0 tx=0).stop 2024-09-11T23:27:01.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.467+0000 7f70e2c00640 1 -- 172.21.15.144:0/3167004501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70dc0d1b00 msgr2=0x7f70dc157850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.467+0000 7f70e2c00640 1 --2- 172.21.15.144:0/3167004501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70dc0d1b00 0x7f70dc157850 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f70d400d800 tx=0x7f70d400dcc0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.467+0000 7f70e2c00640 1 -- 172.21.15.144:0/3167004501 shutdown_connections 2024-09-11T23:27:01.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.467+0000 7f70e2c00640 1 --2- 172.21.15.144:0/3167004501 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f70bc06c970 0x7f70bc06ee30 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.467+0000 7f70e2c00640 1 --2- 172.21.15.144:0/3167004501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70dc0d1b00 0x7f70dc157850 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.467+0000 7f70e2c00640 1 --2- 172.21.15.144:0/3167004501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f70dc0b70e0 0x7f70dc0cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.467+0000 7f70e2c00640 1 --2- 172.21.15.144:0/3167004501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f70dc0b6d00 0x7f70dc14def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.467+0000 7f70e2c00640 1 -- 172.21.15.144:0/3167004501 >> 172.21.15.144:0/3167004501 conn(0x7f70dc06f390 msgr2=0x7f70dc0735d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:01.468 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.467+0000 7f70e2c00640 1 -- 172.21.15.144:0/3167004501 shutdown_connections 2024-09-11T23:27:01.469 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.467+0000 7f70e2c00640 1 -- 172.21.15.144:0/3167004501 wait complete. 2024-09-11T23:27:01.483 INFO:tasks.ceph:Scrubbing osd.5 2024-09-11T23:27:01.483 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-11T23:27:01.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.641+0000 7f3da5400640 1 Processor -- start 2024-09-11T23:27:01.642 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.641+0000 7f3da5400640 1 -- start start 2024-09-11T23:27:01.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.642+0000 7f3da5400640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f3da00cffe0 0x7f3da006d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.642+0000 7f3da5400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3da00cdd00 0x7f3da015cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.642+0000 7f3da5400640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da015d880 con 0x7f3da00cd920 2024-09-11T23:27:01.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.642+0000 7f3da5400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f3da00b42c0 con 0x7f3da00cdd00 2024-09-11T23:27:01.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.643+0000 7f3da5400640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f3da00b45a0 con 0x7f3da00cffe0 2024-09-11T23:27:01.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.643+0000 7f3d9f200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3da00cdd00 0x7f3da015cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.643+0000 7f3d9f200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3da00cdd00 0x7f3da015cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37258/0 (socket says 172.21.15.144:37258) 2024-09-11T23:27:01.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.643+0000 7f3d9f200640 1 -- 172.21.15.144:0/1394637872 learned_addr learned my addr 172.21.15.144:0/1394637872 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:01.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.643+0000 7f3d9de00640 1 --2- 172.21.15.144:0/1394637872 >> v2:172.21.15.165:3300/0 conn(0x7f3da00cffe0 0x7f3da006d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.643+0000 7f3d9f200640 1 -- 172.21.15.144:0/1394637872 >> v2:172.21.15.165:3300/0 conn(0x7f3da00cffe0 msgr2=0x7f3da006d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:01.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.643+0000 7f3d9f200640 1 --2- 172.21.15.144:0/1394637872 >> v2:172.21.15.165:3300/0 conn(0x7f3da00cffe0 0x7f3da006d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.644 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.643+0000 7f3d9f200640 1 -- 172.21.15.144:0/1394637872 >> v1:172.21.15.165:6789/0 conn(0x7f3da00cd920 legacy=0x7f3da00cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:01.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.643+0000 7f3d9f200640 1 -- 172.21.15.144:0/1394637872 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da00b4880 con 0x7f3da00cdd00 2024-09-11T23:27:01.645 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.643+0000 7f3d9de00640 1 --2- 172.21.15.144:0/1394637872 >> v2:172.21.15.165:3300/0 conn(0x7f3da00cffe0 0x7f3da006d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:27:01.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.644+0000 7f3d9f200640 1 --2- 172.21.15.144:0/1394637872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3da00cdd00 0x7f3da015cb20 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009870 tx=0x7f3d9802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06fcdd7d6aa1cac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:01.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.644+0000 7f3d9d400640 1 -- 172.21.15.144:0/1394637872 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d98037070 con 0x7f3da00cdd00 2024-09-11T23:27:01.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.645+0000 7f3d9d400640 1 -- 172.21.15.144:0/1394637872 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d98032440 con 0x7f3da00cdd00 2024-09-11T23:27:01.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.645+0000 7f3d9d400640 1 -- 172.21.15.144:0/1394637872 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d98032810 con 0x7f3da00cdd00 2024-09-11T23:27:01.646 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.645+0000 7f3da5400640 1 -- 172.21.15.144:0/1394637872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3da00cdd00 msgr2=0x7f3da015cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.645+0000 7f3da5400640 1 --2- 172.21.15.144:0/1394637872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3da00cdd00 0x7f3da015cb20 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009870 tx=0x7f3d9802a270 comp rx=0 tx=0).stop 2024-09-11T23:27:01.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.645+0000 7f3da5400640 1 -- 172.21.15.144:0/1394637872 shutdown_connections 2024-09-11T23:27:01.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.645+0000 7f3da5400640 1 --2- 172.21.15.144:0/1394637872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3da00cdd00 0x7f3da015cb20 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.645+0000 7f3da5400640 1 --2- 172.21.15.144:0/1394637872 >> v2:172.21.15.165:3300/0 conn(0x7f3da00cffe0 0x7f3da006d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.645+0000 7f3da5400640 1 -- 172.21.15.144:0/1394637872 >> 172.21.15.144:0/1394637872 conn(0x7f3da006bba0 msgr2=0x7f3da006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:01.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.645+0000 7f3da5400640 1 -- 172.21.15.144:0/1394637872 shutdown_connections 2024-09-11T23:27:01.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.645+0000 7f3da5400640 1 -- 172.21.15.144:0/1394637872 wait complete. 2024-09-11T23:27:01.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.647+0000 7f3da5400640 1 Processor -- start 2024-09-11T23:27:01.648 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.647+0000 7f3da5400640 1 -- start start 2024-09-11T23:27:01.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.648+0000 7f3da5400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3da00cd920 0x7f3da0156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.648+0000 7f3da5400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3da00cdd00 0x7f3da0153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.648+0000 7f3da5400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3da00cffe0 0x7f3da014dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.648+0000 7f3da5400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3da015d3f0 con 0x7f3da00cd920 2024-09-11T23:27:01.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.648+0000 7f3da5400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3da015d270 con 0x7f3da00cffe0 2024-09-11T23:27:01.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.648+0000 7f3da5400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f3da015d570 con 0x7f3da00cdd00 2024-09-11T23:27:01.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.648+0000 7f3d9e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3da00cd920 0x7f3da0156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.649 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.648+0000 7f3d9e800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3da00cd920 0x7f3da0156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37274/0 (socket says 172.21.15.144:37274) 2024-09-11T23:27:01.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.648+0000 7f3d9e800640 1 -- 172.21.15.144:0/229232853 learned_addr learned my addr 172.21.15.144:0/229232853 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:01.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.648+0000 7f3d9f200640 1 --2- 172.21.15.144:0/229232853 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3da00cffe0 0x7f3da014dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.648+0000 7f3d9de00640 1 --2- 172.21.15.144:0/229232853 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3da00cdd00 0x7f3da0153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.648+0000 7f3d9e800640 1 -- 172.21.15.144:0/229232853 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3da00cdd00 msgr2=0x7f3da0153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.648+0000 7f3d9e800640 1 --2- 172.21.15.144:0/229232853 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f3da00cdd00 0x7f3da0153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.648+0000 7f3d9e800640 1 -- 172.21.15.144:0/229232853 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3da00cffe0 msgr2=0x7f3da014dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.648+0000 7f3d9e800640 1 --2- 172.21.15.144:0/229232853 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3da00cffe0 0x7f3da014dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.648+0000 7f3d9e800640 1 -- 172.21.15.144:0/229232853 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da014cc10 con 0x7f3da00cd920 2024-09-11T23:27:01.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.649+0000 7f3d9e800640 1 --2- 172.21.15.144:0/229232853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3da00cd920 0x7f3da0156a30 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000c7c0 tx=0x7f3d9000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:01.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.649+0000 7f3d96a00640 1 -- 172.21.15.144:0/229232853 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90016020 con 0x7f3da00cd920 2024-09-11T23:27:01.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.649+0000 7f3d96a00640 1 -- 172.21.15.144:0/229232853 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d9000aa50 con 0x7f3da00cd920 2024-09-11T23:27:01.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.649+0000 7f3da5400640 1 -- 172.21.15.144:0/229232853 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da014d1f0 con 0x7f3da00cd920 2024-09-11T23:27:01.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.649+0000 7f3d96a00640 1 -- 172.21.15.144:0/229232853 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90012420 con 0x7f3da00cd920 2024-09-11T23:27:01.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.649+0000 7f3da5400640 1 -- 172.21.15.144:0/229232853 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da014d7b0 con 0x7f3da00cd920 2024-09-11T23:27:01.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.650+0000 7f3da5400640 1 -- 172.21.15.144:0/229232853 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3da0154ae0 con 0x7f3da00cd920 2024-09-11T23:27:01.652 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.651+0000 7f3d96a00640 1 -- 172.21.15.144:0/229232853 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f3d90019020 con 0x7f3da00cd920 2024-09-11T23:27:01.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.652+0000 7f3d96a00640 1 --2- 172.21.15.144:0/229232853 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3d8006c970 0x7f3d8006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.652+0000 7f3d96a00640 1 -- 172.21.15.144:0/229232853 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7f3d90089520 con 0x7f3da00cd920 2024-09-11T23:27:01.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.652+0000 7f3d96a00640 1 --2- 172.21.15.144:0/229232853 >> [v2:172.21.15.165:6800/1377669667,v1:172.21.15.165:6801/1377669667] conn(0x7f3d80072830 0x7f3d80074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.652+0000 7f3d96a00640 1 -- 172.21.15.144:0/229232853 --> [v2:172.21.15.165:6800/1377669667,v1:172.21.15.165:6801/1377669667] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d80075300 con 0x7f3d80072830 2024-09-11T23:27:01.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.652+0000 7f3d96a00640 1 -- 172.21.15.144:0/229232853 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7f3d900902a0 con 0x7f3da00cd920 2024-09-11T23:27:01.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.652+0000 7f3d9de00640 1 --2- 172.21.15.144:0/229232853 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3d8006c970 0x7f3d8006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.653 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.652+0000 7f3d9f200640 1 --2- 172.21.15.144:0/229232853 >> [v2:172.21.15.165:6800/1377669667,v1:172.21.15.165:6801/1377669667] conn(0x7f3d80072830 0x7f3d80074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.653+0000 7f3d9de00640 1 --2- 172.21.15.144:0/229232853 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3d8006c970 0x7f3d8006ee30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3da0151000 tx=0x7f3d8c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:01.654 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.653+0000 7f3d9f200640 1 --2- 172.21.15.144:0/229232853 >> [v2:172.21.15.165:6800/1377669667,v1:172.21.15.165:6801/1377669667] conn(0x7f3d80072830 0x7f3d80074c50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:01.656 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.654+0000 7f3d96a00640 1 -- 172.21.15.144:0/229232853 <== osd.5 v2:172.21.15.165:6800/1377669667 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d80075300 con 0x7f3d80072830 2024-09-11T23:27:01.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.667+0000 7f3da5400640 1 -- 172.21.15.144:0/229232853 --> [v2:172.21.15.165:6800/1377669667,v1:172.21.15.165:6801/1377669667] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3da0156f70 con 0x7f3d80072830 2024-09-11T23:27:01.669 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.668+0000 7f3d96a00640 1 -- 172.21.15.144:0/229232853 <== osd.5 v2:172.21.15.165:6800/1377669667 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3d980326e0 con 0x7f3d80072830 2024-09-11T23:27:01.669 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:27:01.670 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T23:27:01.670 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:27:01.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.668+0000 7f3da5400640 1 -- 172.21.15.144:0/229232853 >> [v2:172.21.15.165:6800/1377669667,v1:172.21.15.165:6801/1377669667] conn(0x7f3d80072830 msgr2=0x7f3d80074c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.668+0000 7f3da5400640 1 --2- 172.21.15.144:0/229232853 >> [v2:172.21.15.165:6800/1377669667,v1:172.21.15.165:6801/1377669667] conn(0x7f3d80072830 0x7f3d80074c50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.668+0000 7f3da5400640 1 -- 172.21.15.144:0/229232853 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3d8006c970 msgr2=0x7f3d8006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.668+0000 7f3da5400640 1 --2- 172.21.15.144:0/229232853 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f3d8006c970 0x7f3d8006ee30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3da0151000 tx=0x7f3d8c008040 comp rx=0 tx=0).stop 2024-09-11T23:27:01.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.668+0000 7f3da5400640 1 -- 172.21.15.144:0/229232853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3da00cd920 msgr2=0x7f3da0156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.668+0000 7f3da5400640 1 --2- 172.21.15.144:0/229232853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3da00cd920 0x7f3da0156a30 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000c7c0 tx=0x7f3d9000cc80 comp rx=0 tx=0).stop 2024-09-11T23:27:01.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.668+0000 7f3d9f200640 1 -- 172.21.15.144:0/229232853 reap_dead start 2024-09-11T23:27:01.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.669+0000 7f3da5400640 1 -- 172.21.15.144:0/229232853 shutdown_connections 2024-09-11T23:27:01.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.669+0000 7f3da5400640 1 -- 172.21.15.144:0/229232853 >> 172.21.15.144:0/229232853 conn(0x7f3da006bba0 msgr2=0x7f3da006dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:01.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.669+0000 7f3da5400640 1 -- 172.21.15.144:0/229232853 shutdown_connections 2024-09-11T23:27:01.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.669+0000 7f3da5400640 1 -- 172.21.15.144:0/229232853 wait complete. 2024-09-11T23:27:01.684 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-11T23:27:01.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.838+0000 7f1a78000640 1 Processor -- start 2024-09-11T23:27:01.839 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.838+0000 7f1a78000640 1 -- start start 2024-09-11T23:27:01.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.839+0000 7f1a78000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a7015ca40 0x7f1a7015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.839+0000 7f1a78000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1a7015ce80 0x7f1a701594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.839+0000 7f1a78000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a7015d390 con 0x7f1a700d02a0 2024-09-11T23:27:01.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.839+0000 7f1a78000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f1a7015d670 con 0x7f1a7015ce80 2024-09-11T23:27:01.840 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.839+0000 7f1a78000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1a7015d950 con 0x7f1a7015ca40 2024-09-11T23:27:01.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.839+0000 7f1a74c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a7015ca40 0x7f1a7015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.840+0000 7f1a76000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1a7015ce80 0x7f1a701594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.840+0000 7f1a75600640 1 --1- >> v1:172.21.15.165:6789/0 conn(0x7f1a700d02a0 0x7f1a700d0680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.165:6789/0 says I am v1:172.21.15.144:49358/0 (socket says 172.21.15.144:49358) 2024-09-11T23:27:01.841 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.840+0000 7f1a76000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f1a7015ce80 0x7f1a701594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.144:42796/0 (socket says 172.21.15.144:42796) 2024-09-11T23:27:01.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.840+0000 7f1a75600640 1 -- 172.21.15.144:0/658465903 learned_addr learned my addr 172.21.15.144:0/658465903 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:27:01.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.840+0000 7f1a74c00640 1 --2- 172.21.15.144:0/658465903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a7015ca40 0x7f1a7015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3301/0 says I am v2:172.21.15.144:52416/0 (socket says 172.21.15.144:52416) 2024-09-11T23:27:01.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.840+0000 7f1a74c00640 1 -- 172.21.15.144:0/658465903 >> v2:172.21.15.165:3300/0 conn(0x7f1a7015ce80 msgr2=0x7f1a701594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:01.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.840+0000 7f1a74c00640 1 --2- 172.21.15.144:0/658465903 >> v2:172.21.15.165:3300/0 conn(0x7f1a7015ce80 0x7f1a701594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.840+0000 7f1a74c00640 1 -- 172.21.15.144:0/658465903 >> v1:172.21.15.165:6789/0 conn(0x7f1a700d02a0 legacy=0x7f1a700d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.840+0000 7f1a74c00640 1 -- 172.21.15.144:0/658465903 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7015dc30 con 0x7f1a7015ca40 2024-09-11T23:27:01.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.840+0000 7f1a6fe00640 1 -- 172.21.15.144:0/658465903 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4251374444 0 0) 0x7f1a7015d390 con 0x7f1a700d02a0 2024-09-11T23:27:01.842 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.840+0000 7f1a76000640 1 --2- 172.21.15.144:0/658465903 >> v2:172.21.15.165:3300/0 conn(0x7f1a7015ce80 0x7f1a701594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:27:01.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.841+0000 7f1a74c00640 1 --2- 172.21.15.144:0/658465903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a7015ca40 0x7f1a7015e430 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c0097a0 tx=0x7f1a5c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18d1ba74ff0a1fee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:01.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.842+0000 7f1a6fe00640 1 -- 172.21.15.144:0/658465903 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c037070 con 0x7f1a7015ca40 2024-09-11T23:27:01.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.842+0000 7f1a6fe00640 1 -- 172.21.15.144:0/658465903 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5c02ae50 con 0x7f1a7015ca40 2024-09-11T23:27:01.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.842+0000 7f1a6fe00640 1 -- 172.21.15.144:0/658465903 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c032660 con 0x7f1a7015ca40 2024-09-11T23:27:01.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.842+0000 7f1a78000640 1 -- 172.21.15.144:0/658465903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a7015ca40 msgr2=0x7f1a7015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.842+0000 7f1a78000640 1 --2- 172.21.15.144:0/658465903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a7015ca40 0x7f1a7015e430 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c0097a0 tx=0x7f1a5c02a100 comp rx=0 tx=0).stop 2024-09-11T23:27:01.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.843+0000 7f1a78000640 1 -- 172.21.15.144:0/658465903 shutdown_connections 2024-09-11T23:27:01.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.843+0000 7f1a78000640 1 --2- 172.21.15.144:0/658465903 >> v2:172.21.15.165:3300/0 conn(0x7f1a7015ce80 0x7f1a701594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.843+0000 7f1a78000640 1 --2- 172.21.15.144:0/658465903 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a7015ca40 0x7f1a7015e430 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.843+0000 7f1a78000640 1 -- 172.21.15.144:0/658465903 >> 172.21.15.144:0/658465903 conn(0x7f1a70062cc0 msgr2=0x7f1a7006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:01.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.843+0000 7f1a78000640 1 -- 172.21.15.144:0/658465903 shutdown_connections 2024-09-11T23:27:01.844 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.843+0000 7f1a78000640 1 -- 172.21.15.144:0/658465903 wait complete. 2024-09-11T23:27:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.844+0000 7f1a78000640 1 Processor -- start 2024-09-11T23:27:01.845 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.844+0000 7f1a78000640 1 -- start start 2024-09-11T23:27:01.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.845+0000 7f1a78000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a700d02a0 0x7f1a7014c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.845+0000 7f1a78000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a7015ca40 0x7f1a701678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.845+0000 7f1a78000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a7015ce80 0x7f1a700ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.845+0000 7f1a78000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1a70155d10 con 0x7f1a7015ce80 2024-09-11T23:27:01.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.845+0000 7f1a78000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1a70155b90 con 0x7f1a7015ca40 2024-09-11T23:27:01.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.845+0000 7f1a78000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f1a700b4790 con 0x7f1a700d02a0 2024-09-11T23:27:01.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.846+0000 7f1a76000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a7015ce80 0x7f1a700ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.846+0000 7f1a76000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a7015ce80 0x7f1a700ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37278/0 (socket says 172.21.15.144:37278) 2024-09-11T23:27:01.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.846+0000 7f1a76000640 1 -- 172.21.15.144:0/2651509400 learned_addr learned my addr 172.21.15.144:0/2651509400 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:01.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.846+0000 7f1a74c00640 1 --2- 172.21.15.144:0/2651509400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a7015ca40 0x7f1a701678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.846+0000 7f1a75600640 1 --2- 172.21.15.144:0/2651509400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a700d02a0 0x7f1a7014c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.846+0000 7f1a76000640 1 -- 172.21.15.144:0/2651509400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a700d02a0 msgr2=0x7f1a7014c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.846+0000 7f1a76000640 1 --2- 172.21.15.144:0/2651509400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a700d02a0 0x7f1a7014c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.846+0000 7f1a76000640 1 -- 172.21.15.144:0/2651509400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a7015ca40 msgr2=0x7f1a701678d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:01.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.846+0000 7f1a76000640 1 --2- 172.21.15.144:0/2651509400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a7015ca40 0x7f1a701678d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:01.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.846+0000 7f1a76000640 1 -- 172.21.15.144:0/2651509400 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a70155f20 con 0x7f1a7015ce80 2024-09-11T23:27:01.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.846+0000 7f1a76000640 1 --2- 172.21.15.144:0/2651509400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a7015ce80 0x7f1a700ae8e0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800efc0 tx=0x7f1a68009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:01.848 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.846+0000 7f1a6d600640 1 -- 172.21.15.144:0/2651509400 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68018030 con 0x7f1a7015ce80 2024-09-11T23:27:01.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.846+0000 7f1a6d600640 1 -- 172.21.15.144:0/2651509400 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a6800cde0 con 0x7f1a7015ce80 2024-09-11T23:27:01.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.846+0000 7f1a78000640 1 -- 172.21.15.144:0/2651509400 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a70156200 con 0x7f1a7015ce80 2024-09-11T23:27:01.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.847+0000 7f1a6d600640 1 -- 172.21.15.144:0/2651509400 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68003bb0 con 0x7f1a7015ce80 2024-09-11T23:27:01.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.847+0000 7f1a78000640 1 -- 172.21.15.144:0/2651509400 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a701567c0 con 0x7f1a7015ce80 2024-09-11T23:27:01.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.848+0000 7f1a78000640 1 -- 172.21.15.144:0/2651509400 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a700d0680 con 0x7f1a7015ce80 2024-09-11T23:27:01.849 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.848+0000 7f1a6d600640 1 -- 172.21.15.144:0/2651509400 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f1a6801b070 con 0x7f1a7015ce80 2024-09-11T23:27:01.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.850+0000 7f1a6d600640 1 --2- 172.21.15.144:0/2651509400 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1a5006c9a0 0x7f1a5006ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:01.850 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.850+0000 7f1a6d600640 1 -- 172.21.15.144:0/2651509400 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7f1a6808a130 con 0x7f1a7015ce80 2024-09-11T23:27:01.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.850+0000 7f1a75600640 1 --2- 172.21.15.144:0/2651509400 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1a5006c9a0 0x7f1a5006ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:01.851 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.851+0000 7f1a75600640 1 --2- 172.21.15.144:0/2651509400 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1a5006c9a0 0x7f1a5006ee60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1a64007fd0 tx=0x7f1a64007de0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:01.855 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:01.854+0000 7f1a6d600640 1 -- 172.21.15.144:0/2651509400 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a68010040 con 0x7f1a7015ce80 2024-09-11T23:27:02.027 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.027+0000 7f1a78000640 1 -- 172.21.15.144:0/2651509400 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f1a700b1920 con 0x7f1a5006c9a0 2024-09-11T23:27:02.028 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.028+0000 7f1a6d600640 1 -- 172.21.15.144:0/2651509400 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1a700b1920 con 0x7f1a5006c9a0 2024-09-11T23:27:02.028 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 5 to deep-scrub 2024-09-11T23:27:02.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.030+0000 7f1a78000640 1 -- 172.21.15.144:0/2651509400 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1a5006c9a0 msgr2=0x7f1a5006ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.030 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.030+0000 7f1a78000640 1 --2- 172.21.15.144:0/2651509400 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1a5006c9a0 0x7f1a5006ee60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1a64007fd0 tx=0x7f1a64007de0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.030+0000 7f1a78000640 1 -- 172.21.15.144:0/2651509400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a7015ce80 msgr2=0x7f1a700ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.030+0000 7f1a78000640 1 --2- 172.21.15.144:0/2651509400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a7015ce80 0x7f1a700ae8e0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800efc0 tx=0x7f1a68009f90 comp rx=0 tx=0).stop 2024-09-11T23:27:02.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.030+0000 7f1a78000640 1 -- 172.21.15.144:0/2651509400 shutdown_connections 2024-09-11T23:27:02.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.030+0000 7f1a78000640 1 --2- 172.21.15.144:0/2651509400 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f1a5006c9a0 0x7f1a5006ee60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.030+0000 7f1a78000640 1 --2- 172.21.15.144:0/2651509400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a7015ce80 0x7f1a700ae8e0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.030+0000 7f1a78000640 1 --2- 172.21.15.144:0/2651509400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1a7015ca40 0x7f1a701678d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.030+0000 7f1a78000640 1 --2- 172.21.15.144:0/2651509400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f1a700d02a0 0x7f1a7014c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.030+0000 7f1a78000640 1 -- 172.21.15.144:0/2651509400 >> 172.21.15.144:0/2651509400 conn(0x7f1a70062cc0 msgr2=0x7f1a70154290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:02.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.030+0000 7f1a78000640 1 -- 172.21.15.144:0/2651509400 shutdown_connections 2024-09-11T23:27:02.031 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.030+0000 7f1a78000640 1 -- 172.21.15.144:0/2651509400 wait complete. 2024-09-11T23:27:02.046 INFO:tasks.ceph:Scrubbing osd.6 2024-09-11T23:27:02.046 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-11T23:27:02.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.203+0000 7f74b1c00640 1 Processor -- start 2024-09-11T23:27:02.204 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.203+0000 7f74b1c00640 1 -- start start 2024-09-11T23:27:02.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.204+0000 7f74b1c00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f74ac15e6e0 0x7f74ac0d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.205+0000 7f74b1c00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f74ac0cf3d0 0x7f74ac0d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.205+0000 7f74b1c00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74ac15eac0 con 0x7f74ac0d3290 2024-09-11T23:27:02.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.205+0000 7f74b1c00640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f74ac0cf910 con 0x7f74ac15e6e0 2024-09-11T23:27:02.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.205+0000 7f74b1c00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f74ac0d24d0 con 0x7f74ac0cf3d0 2024-09-11T23:27:02.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.205+0000 7f74abe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f74ac15e6e0 0x7f74ac0d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.205+0000 7f74a3400640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f74ac0d3290 0x7f74ac0cecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55190/0 (socket says 172.21.15.144:55190) 2024-09-11T23:27:02.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.205+0000 7f74abe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f74ac15e6e0 0x7f74ac0d0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37282/0 (socket says 172.21.15.144:37282) 2024-09-11T23:27:02.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.205+0000 7f74a3400640 1 -- 172.21.15.144:0/1327419124 learned_addr learned my addr 172.21.15.144:0/1327419124 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:27:02.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.205+0000 7f74b1200640 1 --2- 172.21.15.144:0/1327419124 >> v2:172.21.15.165:3300/0 conn(0x7f74ac0cf3d0 0x7f74ac0d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.205+0000 7f74abe00640 1 -- 172.21.15.144:0/1327419124 >> v2:172.21.15.165:3300/0 conn(0x7f74ac0cf3d0 msgr2=0x7f74ac0d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:02.206 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.205+0000 7f74abe00640 1 --2- 172.21.15.144:0/1327419124 >> v2:172.21.15.165:3300/0 conn(0x7f74ac0cf3d0 0x7f74ac0d13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.205+0000 7f74abe00640 1 -- 172.21.15.144:0/1327419124 >> v1:172.21.15.144:6789/0 conn(0x7f74ac0d3290 legacy=0x7f74ac0cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.205+0000 7f74ab400640 1 -- 172.21.15.144:0/1327419124 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3186840279 0 0) 0x7f74ac15eac0 con 0x7f74ac0d3290 2024-09-11T23:27:02.207 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.205+0000 7f74abe00640 1 -- 172.21.15.144:0/1327419124 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74ac0d27b0 con 0x7f74ac15e6e0 2024-09-11T23:27:02.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.206+0000 7f74abe00640 1 --2- 172.21.15.144:0/1327419124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74ac15e6e0 0x7f74ac0d0e70 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f749c0097a0 tx=0x7f749c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d1180eb5c26689 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:02.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.207+0000 7f74ab400640 1 -- 172.21.15.144:0/1327419124 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c037070 con 0x7f74ac15e6e0 2024-09-11T23:27:02.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.207+0000 7f74ab400640 1 -- 172.21.15.144:0/1327419124 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f749c032440 con 0x7f74ac15e6e0 2024-09-11T23:27:02.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.207+0000 7f74ab400640 1 -- 172.21.15.144:0/1327419124 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c032810 con 0x7f74ac15e6e0 2024-09-11T23:27:02.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.207+0000 7f74b1c00640 1 -- 172.21.15.144:0/1327419124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74ac15e6e0 msgr2=0x7f74ac0d0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.207+0000 7f74b1c00640 1 --2- 172.21.15.144:0/1327419124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74ac15e6e0 0x7f74ac0d0e70 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f749c0097a0 tx=0x7f749c02a270 comp rx=0 tx=0).stop 2024-09-11T23:27:02.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.207+0000 7f74b1c00640 1 -- 172.21.15.144:0/1327419124 shutdown_connections 2024-09-11T23:27:02.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.207+0000 7f74b1c00640 1 --2- 172.21.15.144:0/1327419124 >> v2:172.21.15.165:3300/0 conn(0x7f74ac0cf3d0 0x7f74ac0d13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.208 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.207+0000 7f74b1c00640 1 --2- 172.21.15.144:0/1327419124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74ac15e6e0 0x7f74ac0d0e70 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.207+0000 7f74b1c00640 1 -- 172.21.15.144:0/1327419124 >> 172.21.15.144:0/1327419124 conn(0x7f74ac0b5f70 msgr2=0x7f74ac0b6380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:02.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.207+0000 7f74b1c00640 1 -- 172.21.15.144:0/1327419124 shutdown_connections 2024-09-11T23:27:02.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.207+0000 7f74b1c00640 1 -- 172.21.15.144:0/1327419124 wait complete. 2024-09-11T23:27:02.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.209+0000 7f74b1c00640 1 Processor -- start 2024-09-11T23:27:02.209 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.209+0000 7f74b1c00640 1 -- start start 2024-09-11T23:27:02.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.210+0000 7f74b1c00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74ac0cf3d0 0x7f74ac0abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.210+0000 7f74b1c00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74ac0d3290 0x7f74ac1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.210+0000 7f74b1c00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74ac15e6e0 0x7f74ac0b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.210+0000 7f74b1c00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f74ac0b74f0 con 0x7f74ac0d3290 2024-09-11T23:27:02.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.210+0000 7f74b1c00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f74ac0d2d70 con 0x7f74ac15e6e0 2024-09-11T23:27:02.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.210+0000 7f74b1c00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f74ac0b7670 con 0x7f74ac0cf3d0 2024-09-11T23:27:02.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.210+0000 7f74a3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74ac0d3290 0x7f74ac1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.210+0000 7f74a3400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74ac0d3290 0x7f74ac1529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37296/0 (socket says 172.21.15.144:37296) 2024-09-11T23:27:02.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.210+0000 7f74a3400640 1 -- 172.21.15.144:0/1215927188 learned_addr learned my addr 172.21.15.144:0/1215927188 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:02.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.210+0000 7f74b1200640 1 --2- 172.21.15.144:0/1215927188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74ac15e6e0 0x7f74ac0b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.211 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.210+0000 7f74abe00640 1 --2- 172.21.15.144:0/1215927188 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74ac0cf3d0 0x7f74ac0abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.211+0000 7f74a3400640 1 -- 172.21.15.144:0/1215927188 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74ac0cf3d0 msgr2=0x7f74ac0abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.211+0000 7f74a3400640 1 --2- 172.21.15.144:0/1215927188 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f74ac0cf3d0 0x7f74ac0abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.212 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.211+0000 7f74a3400640 1 -- 172.21.15.144:0/1215927188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74ac15e6e0 msgr2=0x7f74ac0b8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.211+0000 7f74a3400640 1 --2- 172.21.15.144:0/1215927188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74ac15e6e0 0x7f74ac0b8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.211+0000 7f74a3400640 1 -- 172.21.15.144:0/1215927188 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74ac0ce730 con 0x7f74ac0d3290 2024-09-11T23:27:02.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.211+0000 7f74a3400640 1 --2- 172.21.15.144:0/1215927188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74ac0d3290 0x7f74ac1529e0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f749400c4d0 tx=0x7f749400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:02.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.211+0000 7f74a8c00640 1 -- 172.21.15.144:0/1215927188 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7494018070 con 0x7f74ac0d3290 2024-09-11T23:27:02.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.211+0000 7f74a8c00640 1 -- 172.21.15.144:0/1215927188 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7494007500 con 0x7f74ac0d3290 2024-09-11T23:27:02.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.211+0000 7f74b1c00640 1 -- 172.21.15.144:0/1215927188 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74ac0ab200 con 0x7f74ac0d3290 2024-09-11T23:27:02.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.211+0000 7f74a8c00640 1 -- 172.21.15.144:0/1215927188 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7494004a20 con 0x7f74ac0d3290 2024-09-11T23:27:02.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.211+0000 7f74b1c00640 1 -- 172.21.15.144:0/1215927188 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74ac0ac220 con 0x7f74ac0d3290 2024-09-11T23:27:02.213 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.212+0000 7f74b1c00640 1 -- 172.21.15.144:0/1215927188 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f74ac0cecc0 con 0x7f74ac0d3290 2024-09-11T23:27:02.214 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.213+0000 7f74a8c00640 1 -- 172.21.15.144:0/1215927188 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f749401b070 con 0x7f74ac0d3290 2024-09-11T23:27:02.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.214+0000 7f74a8c00640 1 --2- 172.21.15.144:0/1215927188 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f748806c970 0x7f748806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.214+0000 7f74a8c00640 1 -- 172.21.15.144:0/1215927188 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7f7494088d20 con 0x7f74ac0d3290 2024-09-11T23:27:02.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.214+0000 7f74a8c00640 1 --2- 172.21.15.144:0/1215927188 >> [v2:172.21.15.165:6817/1277452042,v1:172.21.15.165:6819/1277452042] conn(0x7f7488072830 0x7f7488074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.214+0000 7f74a8c00640 1 -- 172.21.15.144:0/1215927188 --> [v2:172.21.15.165:6817/1277452042,v1:172.21.15.165:6819/1277452042] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7488075300 con 0x7f7488072830 2024-09-11T23:27:02.215 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.214+0000 7f74a8c00640 1 -- 172.21.15.144:0/1215927188 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7f7494092050 con 0x7f74ac0d3290 2024-09-11T23:27:02.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.215+0000 7f74abe00640 1 --2- 172.21.15.144:0/1215927188 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f748806c970 0x7f748806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.215+0000 7f74b1200640 1 --2- 172.21.15.144:0/1215927188 >> [v2:172.21.15.165:6817/1277452042,v1:172.21.15.165:6819/1277452042] conn(0x7f7488072830 0x7f7488074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.215+0000 7f74b1200640 1 --2- 172.21.15.144:0/1215927188 >> [v2:172.21.15.165:6817/1277452042,v1:172.21.15.165:6819/1277452042] conn(0x7f7488072830 0x7f7488074c50 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:02.216 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.215+0000 7f74abe00640 1 --2- 172.21.15.144:0/1215927188 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f748806c970 0x7f748806ee30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f749c034000 tx=0x7f749c02e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:02.217 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.217+0000 7f74a8c00640 1 -- 172.21.15.144:0/1215927188 <== osd.6 v2:172.21.15.165:6817/1277452042 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7488075300 con 0x7f7488072830 2024-09-11T23:27:02.230 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.230+0000 7f74b1c00640 1 -- 172.21.15.144:0/1215927188 --> [v2:172.21.15.165:6817/1277452042,v1:172.21.15.165:6819/1277452042] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f74ac15df00 con 0x7f7488072830 2024-09-11T23:27:02.231 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.230+0000 7f74a8c00640 1 -- 172.21.15.144:0/1215927188 <== osd.6 v2:172.21.15.165:6817/1277452042 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f74ac15df00 con 0x7f7488072830 2024-09-11T23:27:02.231 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:27:02.231 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T23:27:02.231 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:27:02.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.231+0000 7f74b1c00640 1 -- 172.21.15.144:0/1215927188 >> [v2:172.21.15.165:6817/1277452042,v1:172.21.15.165:6819/1277452042] conn(0x7f7488072830 msgr2=0x7f7488074c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.231+0000 7f74b1c00640 1 --2- 172.21.15.144:0/1215927188 >> [v2:172.21.15.165:6817/1277452042,v1:172.21.15.165:6819/1277452042] conn(0x7f7488072830 0x7f7488074c50 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.231+0000 7f74b1c00640 1 -- 172.21.15.144:0/1215927188 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f748806c970 msgr2=0x7f748806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.232 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.231+0000 7f74b1c00640 1 --2- 172.21.15.144:0/1215927188 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f748806c970 0x7f748806ee30 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f749c034000 tx=0x7f749c02e000 comp rx=0 tx=0).stop 2024-09-11T23:27:02.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.231+0000 7f74b1c00640 1 -- 172.21.15.144:0/1215927188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74ac0d3290 msgr2=0x7f74ac1529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.231+0000 7f74b1c00640 1 --2- 172.21.15.144:0/1215927188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74ac0d3290 0x7f74ac1529e0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f749400c4d0 tx=0x7f749400c990 comp rx=0 tx=0).stop 2024-09-11T23:27:02.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.231+0000 7f74b1200640 1 -- 172.21.15.144:0/1215927188 reap_dead start 2024-09-11T23:27:02.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.231+0000 7f74b1c00640 1 -- 172.21.15.144:0/1215927188 shutdown_connections 2024-09-11T23:27:02.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.231+0000 7f74b1c00640 1 -- 172.21.15.144:0/1215927188 >> 172.21.15.144:0/1215927188 conn(0x7f74ac0b5f70 msgr2=0x7f74ac0b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:02.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.231+0000 7f74b1c00640 1 -- 172.21.15.144:0/1215927188 shutdown_connections 2024-09-11T23:27:02.233 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.231+0000 7f74b1c00640 1 -- 172.21.15.144:0/1215927188 wait complete. 2024-09-11T23:27:02.246 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-11T23:27:02.401 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.401+0000 7f919b200640 1 Processor -- start 2024-09-11T23:27:02.402 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.401+0000 7f919b200640 1 -- start start 2024-09-11T23:27:02.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.402+0000 7f919b200640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f919415e640 0x7f91940d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.402+0000 7f919b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91940d3f60 0x7f91940b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.402+0000 7f919b200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f91940b6510 0x7f91940d27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.402+0000 7f919b200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f919415ea20 con 0x7f91940b6510 2024-09-11T23:27:02.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.402+0000 7f919b200640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f919406caf0 con 0x7f919415e640 2024-09-11T23:27:02.403 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.402+0000 7f919b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f919406bee0 con 0x7f91940d3f60 2024-09-11T23:27:02.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.402+0000 7f919a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f91940b6510 0x7f91940d27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.402+0000 7f919a800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f91940b6510 0x7f91940d27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37300/0 (socket says 172.21.15.144:37300) 2024-09-11T23:27:02.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.402+0000 7f919a800640 1 -- 172.21.15.144:0/1219035020 learned_addr learned my addr 172.21.15.144:0/1219035020 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:02.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.403+0000 7f9199e00640 1 --2- 172.21.15.144:0/1219035020 >> v2:172.21.15.165:3300/0 conn(0x7f919415e640 0x7f91940d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.403+0000 7f9199400640 1 --2- 172.21.15.144:0/1219035020 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91940d3f60 0x7f91940b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.403+0000 7f919a800640 1 -- 172.21.15.144:0/1219035020 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91940d3f60 msgr2=0x7f91940b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:02.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.403+0000 7f919a800640 1 --2- 172.21.15.144:0/1219035020 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91940d3f60 0x7f91940b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.403+0000 7f919a800640 1 -- 172.21.15.144:0/1219035020 >> v2:172.21.15.165:3300/0 conn(0x7f919415e640 msgr2=0x7f91940d3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:02.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.403+0000 7f919a800640 1 --2- 172.21.15.144:0/1219035020 >> v2:172.21.15.165:3300/0 conn(0x7f919415e640 0x7f91940d3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.404 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.403+0000 7f919a800640 1 -- 172.21.15.144:0/1219035020 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919406c1c0 con 0x7f91940b6510 2024-09-11T23:27:02.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.404+0000 7f919a800640 1 --2- 172.21.15.144:0/1219035020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91940b6510 0x7f91940d27c0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f91940d2030 tx=0x7f919002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ec3e52830b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:02.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.404+0000 7f9198a00640 1 -- 172.21.15.144:0/1219035020 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9190036070 con 0x7f91940b6510 2024-09-11T23:27:02.405 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.404+0000 7f9198a00640 1 -- 172.21.15.144:0/1219035020 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9190031600 con 0x7f91940b6510 2024-09-11T23:27:02.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.404+0000 7f9198a00640 1 -- 172.21.15.144:0/1219035020 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91900319d0 con 0x7f91940b6510 2024-09-11T23:27:02.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.404+0000 7f919b200640 1 -- 172.21.15.144:0/1219035020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91940b6510 msgr2=0x7f91940d27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.404+0000 7f919b200640 1 --2- 172.21.15.144:0/1219035020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91940b6510 0x7f91940d27c0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f91940d2030 tx=0x7f919002a6a0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.404+0000 7f919b200640 1 -- 172.21.15.144:0/1219035020 shutdown_connections 2024-09-11T23:27:02.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.404+0000 7f919b200640 1 --2- 172.21.15.144:0/1219035020 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91940b6510 0x7f91940d27c0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.404+0000 7f919b200640 1 --2- 172.21.15.144:0/1219035020 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91940d3f60 0x7f91940b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.404+0000 7f919b200640 1 --2- 172.21.15.144:0/1219035020 >> v2:172.21.15.165:3300/0 conn(0x7f919415e640 0x7f91940d3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.404+0000 7f919b200640 1 -- 172.21.15.144:0/1219035020 >> 172.21.15.144:0/1219035020 conn(0x7f91940d0fd0 msgr2=0x7f91940d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:02.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.405+0000 7f919b200640 1 -- 172.21.15.144:0/1219035020 shutdown_connections 2024-09-11T23:27:02.406 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.405+0000 7f919b200640 1 -- 172.21.15.144:0/1219035020 wait complete. 2024-09-11T23:27:02.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.406+0000 7f919b200640 1 Processor -- start 2024-09-11T23:27:02.407 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.406+0000 7f919b200640 1 -- start start 2024-09-11T23:27:02.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.407+0000 7f919b200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91940b6510 0x7f91940ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.407+0000 7f919b200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91940d3f60 0x7f9194160d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.407+0000 7f919b200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f919415e640 0x7f91941612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.407+0000 7f919b200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f91940d2d00 con 0x7f91940b6510 2024-09-11T23:27:02.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.407+0000 7f919b200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f919406c780 con 0x7f919415e640 2024-09-11T23:27:02.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.407+0000 7f919b200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f91940d2e80 con 0x7f91940d3f60 2024-09-11T23:27:02.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.407+0000 7f9199e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91940b6510 0x7f91940ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.407+0000 7f919a800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f919415e640 0x7f91941612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.408 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.407+0000 7f9199400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91940d3f60 0x7f9194160d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.407+0000 7f9199e00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91940b6510 0x7f91940ca470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37304/0 (socket says 172.21.15.144:37304) 2024-09-11T23:27:02.409 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.407+0000 7f9199e00640 1 -- 172.21.15.144:0/3838225030 learned_addr learned my addr 172.21.15.144:0/3838225030 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:02.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.408+0000 7f9199e00640 1 -- 172.21.15.144:0/3838225030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91940d3f60 msgr2=0x7f9194160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.408+0000 7f9199e00640 1 --2- 172.21.15.144:0/3838225030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91940d3f60 0x7f9194160d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.408+0000 7f9199e00640 1 -- 172.21.15.144:0/3838225030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f919415e640 msgr2=0x7f91941612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.408+0000 7f9199e00640 1 --2- 172.21.15.144:0/3838225030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f919415e640 0x7f91941612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.408+0000 7f9199e00640 1 -- 172.21.15.144:0/3838225030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919415aff0 con 0x7f91940b6510 2024-09-11T23:27:02.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.408+0000 7f9199e00640 1 --2- 172.21.15.144:0/3838225030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91940b6510 0x7f91940ca470 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f918800d5f0 tx=0x7f918800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:02.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.408+0000 7f918e000640 1 -- 172.21.15.144:0/3838225030 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91880125f0 con 0x7f91940b6510 2024-09-11T23:27:02.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.408+0000 7f918e000640 1 -- 172.21.15.144:0/3838225030 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9188019070 con 0x7f91940b6510 2024-09-11T23:27:02.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.408+0000 7f918e000640 1 -- 172.21.15.144:0/3838225030 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91880129d0 con 0x7f91940b6510 2024-09-11T23:27:02.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.408+0000 7f919b200640 1 -- 172.21.15.144:0/3838225030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91940cb7a0 con 0x7f91940b6510 2024-09-11T23:27:02.410 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.409+0000 7f919b200640 1 -- 172.21.15.144:0/3838225030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91940ca9b0 con 0x7f91940b6510 2024-09-11T23:27:02.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.410+0000 7f919b200640 1 -- 172.21.15.144:0/3838225030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91940d32b0 con 0x7f91940b6510 2024-09-11T23:27:02.411 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.410+0000 7f918e000640 1 -- 172.21.15.144:0/3838225030 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f9188012b70 con 0x7f91940b6510 2024-09-11T23:27:02.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.411+0000 7f918e000640 1 --2- 172.21.15.144:0/3838225030 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f917806c970 0x7f917806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.411+0000 7f918e000640 1 -- 172.21.15.144:0/3838225030 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7f9188089a70 con 0x7f91940b6510 2024-09-11T23:27:02.412 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.412+0000 7f9199400640 1 --2- 172.21.15.144:0/3838225030 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f917806c970 0x7f917806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.413 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.412+0000 7f9199400640 1 --2- 172.21.15.144:0/3838225030 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f917806c970 0x7f917806ee30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f91941f76e0 tx=0x7f9184008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:02.416 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.415+0000 7f918e000640 1 -- 172.21.15.144:0/3838225030 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f91880597e0 con 0x7f91940b6510 2024-09-11T23:27:02.589 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.588+0000 7f919b200640 1 -- 172.21.15.144:0/3838225030 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f919415d8f0 con 0x7f917806c970 2024-09-11T23:27:02.590 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.589+0000 7f918e000640 1 -- 172.21.15.144:0/3838225030 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f919415d8f0 con 0x7f917806c970 2024-09-11T23:27:02.590 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 6 to deep-scrub 2024-09-11T23:27:02.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.591+0000 7f919b200640 1 -- 172.21.15.144:0/3838225030 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f917806c970 msgr2=0x7f917806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.591+0000 7f919b200640 1 --2- 172.21.15.144:0/3838225030 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f917806c970 0x7f917806ee30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f91941f76e0 tx=0x7f9184008040 comp rx=0 tx=0).stop 2024-09-11T23:27:02.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.591+0000 7f919b200640 1 -- 172.21.15.144:0/3838225030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91940b6510 msgr2=0x7f91940ca470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.591+0000 7f919b200640 1 --2- 172.21.15.144:0/3838225030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91940b6510 0x7f91940ca470 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f918800d5f0 tx=0x7f918800dab0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.593 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.591+0000 7f919b200640 1 -- 172.21.15.144:0/3838225030 shutdown_connections 2024-09-11T23:27:02.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.591+0000 7f919b200640 1 --2- 172.21.15.144:0/3838225030 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f917806c970 0x7f917806ee30 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.591+0000 7f919b200640 1 --2- 172.21.15.144:0/3838225030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f919415e640 0x7f91941612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.591+0000 7f919b200640 1 --2- 172.21.15.144:0/3838225030 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f91940d3f60 0x7f9194160d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.594 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.591+0000 7f919b200640 1 --2- 172.21.15.144:0/3838225030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f91940b6510 0x7f91940ca470 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.591+0000 7f919b200640 1 -- 172.21.15.144:0/3838225030 >> 172.21.15.144:0/3838225030 conn(0x7f91940d0fd0 msgr2=0x7f91940b8070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:02.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.592+0000 7f919b200640 1 -- 172.21.15.144:0/3838225030 shutdown_connections 2024-09-11T23:27:02.595 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.592+0000 7f919b200640 1 -- 172.21.15.144:0/3838225030 wait complete. 2024-09-11T23:27:02.608 INFO:tasks.ceph:Scrubbing osd.7 2024-09-11T23:27:02.609 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-11T23:27:02.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.767+0000 7f5247a00640 1 Processor -- start 2024-09-11T23:27:02.768 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.767+0000 7f5247a00640 1 -- start start 2024-09-11T23:27:02.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.768+0000 7f5247a00640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f52401591a0 0x7f524015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.768+0000 7f5247a00640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f524015bb70 con 0x7f524006ec90 2024-09-11T23:27:02.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.768+0000 7f5247a00640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f524015be10 con 0x7f524006f070 2024-09-11T23:27:02.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.768+0000 7f5247a00640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f524015c0f0 con 0x7f52401591a0 2024-09-11T23:27:02.769 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.769+0000 7f5245000640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f524006ec90 0x7f52400cca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55194/0 (socket says 172.21.15.144:55194) 2024-09-11T23:27:02.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.769+0000 7f5245000640 1 -- 172.21.15.144:0/4217529144 learned_addr learned my addr 172.21.15.144:0/4217529144 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:27:02.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.769+0000 7f5245a00640 1 --2- 172.21.15.144:0/4217529144 >> v2:172.21.15.165:3300/0 conn(0x7f52401591a0 0x7f524015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.769+0000 7f523f400640 1 -- 172.21.15.144:0/4217529144 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3827353432 0 0) 0x7f524015bb70 con 0x7f524006ec90 2024-09-11T23:27:02.770 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.769+0000 7f523f400640 1 -- 172.21.15.144:0/4217529144 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5224003520 con 0x7f524006ec90 2024-09-11T23:27:02.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.769+0000 7f5245a00640 1 -- 172.21.15.144:0/4217529144 >> v1:172.21.15.165:6789/0 conn(0x7f524006f070 legacy=0x7f5240158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.769+0000 7f523f400640 1 -- 172.21.15.144:0/4217529144 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1263436028 0 0) 0x7f524015be10 con 0x7f524006f070 2024-09-11T23:27:02.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.769+0000 7f5245a00640 1 -- 172.21.15.144:0/4217529144 >> v1:172.21.15.144:6789/0 conn(0x7f524006ec90 legacy=0x7f52400cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.771 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.769+0000 7f5245a00640 1 -- 172.21.15.144:0/4217529144 --> v2:172.21.15.165:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524015c3d0 con 0x7f52401591a0 2024-09-11T23:27:02.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.770+0000 7f5245a00640 1 --2- 172.21.15.144:0/4217529144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f52401591a0 0x7f524015fab0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5238009d90 tx=0x7f523802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26f3046e1d843d0c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:02.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.771+0000 7f523f400640 1 -- 172.21.15.144:0/4217529144 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5238007740 con 0x7f52401591a0 2024-09-11T23:27:02.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.771+0000 7f523f400640 1 -- 172.21.15.144:0/4217529144 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52380078e0 con 0x7f52401591a0 2024-09-11T23:27:02.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.771+0000 7f523f400640 1 -- 172.21.15.144:0/4217529144 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5238007c90 con 0x7f52401591a0 2024-09-11T23:27:02.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.771+0000 7f5247a00640 1 -- 172.21.15.144:0/4217529144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f52401591a0 msgr2=0x7f524015fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.771+0000 7f5247a00640 1 --2- 172.21.15.144:0/4217529144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f52401591a0 0x7f524015fab0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5238009d90 tx=0x7f523802a660 comp rx=0 tx=0).stop 2024-09-11T23:27:02.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.771+0000 7f5247a00640 1 -- 172.21.15.144:0/4217529144 shutdown_connections 2024-09-11T23:27:02.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.771+0000 7f5247a00640 1 --2- 172.21.15.144:0/4217529144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f52401591a0 0x7f524015fab0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.772 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.771+0000 7f5247a00640 1 -- 172.21.15.144:0/4217529144 >> 172.21.15.144:0/4217529144 conn(0x7f524006bba0 msgr2=0x7f524006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:02.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.771+0000 7f5247a00640 1 -- 172.21.15.144:0/4217529144 shutdown_connections 2024-09-11T23:27:02.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.771+0000 7f5247a00640 1 -- 172.21.15.144:0/4217529144 wait complete. 2024-09-11T23:27:02.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.773+0000 7f5247a00640 1 Processor -- start 2024-09-11T23:27:02.773 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.773+0000 7f5247a00640 1 -- start start 2024-09-11T23:27:02.774 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.774+0000 7f5247a00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f524006ec90 0x7f5240150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.774+0000 7f5247a00640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f524006f070 0x7f524014f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.774+0000 7f5247a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52401591a0 0x7f524014fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.774+0000 7f5247a00640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f52400cf790 con 0x7f52401591a0 2024-09-11T23:27:02.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.774+0000 7f5247a00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f52400cf610 con 0x7f524006ec90 2024-09-11T23:27:02.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.774+0000 7f5247a00640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f52400cf910 con 0x7f524006f070 2024-09-11T23:27:02.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.774+0000 7f5245a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52401591a0 0x7f524014fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.774+0000 7f5245a00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52401591a0 0x7f524014fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37306/0 (socket says 172.21.15.144:37306) 2024-09-11T23:27:02.775 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.774+0000 7f5245a00640 1 -- 172.21.15.144:0/775207206 learned_addr learned my addr 172.21.15.144:0/775207206 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:02.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.774+0000 7f5245a00640 1 -- 172.21.15.144:0/775207206 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f524006f070 msgr2=0x7f524014f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.774+0000 7f5245a00640 1 --2- 172.21.15.144:0/775207206 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f524006f070 0x7f524014f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.774+0000 7f5245a00640 1 -- 172.21.15.144:0/775207206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f524006ec90 msgr2=0x7f5240150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.774+0000 7f5245a00640 1 --2- 172.21.15.144:0/775207206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f524006ec90 0x7f5240150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.774+0000 7f5245a00640 1 -- 172.21.15.144:0/775207206 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52401503e0 con 0x7f52401591a0 2024-09-11T23:27:02.776 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.775+0000 7f5245a00640 1 --2- 172.21.15.144:0/775207206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52401591a0 0x7f524014fda0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f5238009eb0 tx=0x7f5238004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:02.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.775+0000 7f523cc00640 1 -- 172.21.15.144:0/775207206 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5238009450 con 0x7f52401591a0 2024-09-11T23:27:02.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.775+0000 7f523cc00640 1 -- 172.21.15.144:0/775207206 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5238004240 con 0x7f52401591a0 2024-09-11T23:27:02.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.775+0000 7f523cc00640 1 -- 172.21.15.144:0/775207206 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5238004630 con 0x7f52401591a0 2024-09-11T23:27:02.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.775+0000 7f5247a00640 1 -- 172.21.15.144:0/775207206 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52400b19c0 con 0x7f52401591a0 2024-09-11T23:27:02.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.775+0000 7f5247a00640 1 -- 172.21.15.144:0/775207206 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52400b1f80 con 0x7f52401591a0 2024-09-11T23:27:02.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.776+0000 7f5247a00640 1 -- 172.21.15.144:0/775207206 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f52401506c0 con 0x7f52401591a0 2024-09-11T23:27:02.777 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.777+0000 7f523cc00640 1 -- 172.21.15.144:0/775207206 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f523803b410 con 0x7f52401591a0 2024-09-11T23:27:02.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.778+0000 7f523cc00640 1 --2- 172.21.15.144:0/775207206 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f522006c970 0x7f522006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.778+0000 7f523cc00640 1 -- 172.21.15.144:0/775207206 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7f52380ab0e0 con 0x7f52401591a0 2024-09-11T23:27:02.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.778+0000 7f523cc00640 1 --2- 172.21.15.144:0/775207206 >> [v2:172.21.15.165:6816/2335029761,v1:172.21.15.165:6818/2335029761] conn(0x7f5220072830 0x7f5220074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.778+0000 7f523cc00640 1 -- 172.21.15.144:0/775207206 --> [v2:172.21.15.165:6816/2335029761,v1:172.21.15.165:6818/2335029761] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5220075300 con 0x7f5220072830 2024-09-11T23:27:02.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.778+0000 7f523cc00640 1 -- 172.21.15.144:0/775207206 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=169) ==== 24+0+0 (secure 0 0 0) 0x7f52380b22a0 con 0x7f52401591a0 2024-09-11T23:27:02.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.778+0000 7f5245000640 1 --2- 172.21.15.144:0/775207206 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f522006c970 0x7f522006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.779 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.779+0000 7f523fe00640 1 --2- 172.21.15.144:0/775207206 >> [v2:172.21.15.165:6816/2335029761,v1:172.21.15.165:6818/2335029761] conn(0x7f5220072830 0x7f5220074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.779+0000 7f5245000640 1 --2- 172.21.15.144:0/775207206 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f522006c970 0x7f522006ee30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5230000f60 tx=0x7f52300078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:02.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.779+0000 7f523fe00640 1 --2- 172.21.15.144:0/775207206 >> [v2:172.21.15.165:6816/2335029761,v1:172.21.15.165:6818/2335029761] conn(0x7f5220072830 0x7f5220074c50 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:02.780 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.780+0000 7f523cc00640 1 -- 172.21.15.144:0/775207206 <== osd.7 v2:172.21.15.165:6816/2335029761 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5220075300 con 0x7f5220072830 2024-09-11T23:27:02.793 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.793+0000 7f5247a00640 1 -- 172.21.15.144:0/775207206 --> [v2:172.21.15.165:6816/2335029761,v1:172.21.15.165:6818/2335029761] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f524015fab0 con 0x7f5220072830 2024-09-11T23:27:02.794 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.793+0000 7f523cc00640 1 -- 172.21.15.144:0/775207206 <== osd.7 v2:172.21.15.165:6816/2335029761 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f524015fab0 con 0x7f5220072830 2024-09-11T23:27:02.794 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-11T23:27:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T23:27:02.794 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-11T23:27:02.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.794+0000 7f5247a00640 1 -- 172.21.15.144:0/775207206 >> [v2:172.21.15.165:6816/2335029761,v1:172.21.15.165:6818/2335029761] conn(0x7f5220072830 msgr2=0x7f5220074c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.794+0000 7f5247a00640 1 --2- 172.21.15.144:0/775207206 >> [v2:172.21.15.165:6816/2335029761,v1:172.21.15.165:6818/2335029761] conn(0x7f5220072830 0x7f5220074c50 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.794+0000 7f5247a00640 1 -- 172.21.15.144:0/775207206 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f522006c970 msgr2=0x7f522006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.794+0000 7f5247a00640 1 --2- 172.21.15.144:0/775207206 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f522006c970 0x7f522006ee30 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5230000f60 tx=0x7f52300078f0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.794+0000 7f5247a00640 1 -- 172.21.15.144:0/775207206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52401591a0 msgr2=0x7f524014fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.795 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.794+0000 7f5247a00640 1 --2- 172.21.15.144:0/775207206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52401591a0 0x7f524014fda0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f5238009eb0 tx=0x7f5238004a40 comp rx=0 tx=0).stop 2024-09-11T23:27:02.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.794+0000 7f5245a00640 1 -- 172.21.15.144:0/775207206 reap_dead start 2024-09-11T23:27:02.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.794+0000 7f5247a00640 1 -- 172.21.15.144:0/775207206 shutdown_connections 2024-09-11T23:27:02.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.794+0000 7f5247a00640 1 -- 172.21.15.144:0/775207206 >> 172.21.15.144:0/775207206 conn(0x7f524006bba0 msgr2=0x7f524006e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:02.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.794+0000 7f5247a00640 1 -- 172.21.15.144:0/775207206 shutdown_connections 2024-09-11T23:27:02.796 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.794+0000 7f5247a00640 1 -- 172.21.15.144:0/775207206 wait complete. 2024-09-11T23:27:02.809 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-11T23:27:02.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.962+0000 7fac08800640 1 Processor -- start 2024-09-11T23:27:02.963 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.962+0000 7fac08800640 1 -- start start 2024-09-11T23:27:02.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.963+0000 7fac08800640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fac0015c180 0x7fac000cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.963+0000 7fac08800640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7fac000ce230 0x7fac000cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.963+0000 7fac08800640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac000ce740 con 0x7fac000cf5b0 2024-09-11T23:27:02.965 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.963+0000 7fac08800640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7fac00072640 con 0x7fac0015c180 2024-09-11T23:27:02.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.963+0000 7fac08800640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7fac00072920 con 0x7fac000ce230 2024-09-11T23:27:02.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.964+0000 7fac05e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fac0015c180 0x7fac000cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.964+0000 7fac05e00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fac0015c180 0x7fac000cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37314/0 (socket says 172.21.15.144:37314) 2024-09-11T23:27:02.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.964+0000 7fac05e00640 1 -- 172.21.15.144:0/2658127275 learned_addr learned my addr 172.21.15.144:0/2658127275 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:02.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.964+0000 7fac05400640 1 --2- 172.21.15.144:0/2658127275 >> v2:172.21.15.165:3300/0 conn(0x7fac000ce230 0x7fac000cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.964+0000 7fac05e00640 1 -- 172.21.15.144:0/2658127275 >> v2:172.21.15.165:3300/0 conn(0x7fac000ce230 msgr2=0x7fac000cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:02.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.964+0000 7fac05e00640 1 --2- 172.21.15.144:0/2658127275 >> v2:172.21.15.165:3300/0 conn(0x7fac000ce230 0x7fac000cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.966 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.964+0000 7fac05e00640 1 -- 172.21.15.144:0/2658127275 >> v1:172.21.15.144:6789/0 conn(0x7fac000cf5b0 legacy=0x7fac00073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.967 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.964+0000 7fac05e00640 1 -- 172.21.15.144:0/2658127275 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac00072c00 con 0x7fac0015c180 2024-09-11T23:27:02.968 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.965+0000 7fac05e00640 1 --2- 172.21.15.144:0/2658127275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac0015c180 0x7fac000cdcf0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fac00071d60 tx=0x7fabf402a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f501ad10b16adc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:02.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.965+0000 7fac04a00640 1 -- 172.21.15.144:0/2658127275 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf4037070 con 0x7fac0015c180 2024-09-11T23:27:02.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.965+0000 7fac04a00640 1 -- 172.21.15.144:0/2658127275 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabf4032440 con 0x7fac0015c180 2024-09-11T23:27:02.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.965+0000 7fac04a00640 1 -- 172.21.15.144:0/2658127275 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf4032810 con 0x7fac0015c180 2024-09-11T23:27:02.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.966+0000 7fac08800640 1 -- 172.21.15.144:0/2658127275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac0015c180 msgr2=0x7fac000cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.966+0000 7fac08800640 1 --2- 172.21.15.144:0/2658127275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac0015c180 0x7fac000cdcf0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fac00071d60 tx=0x7fabf402a1f0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.969 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.966+0000 7fac08800640 1 -- 172.21.15.144:0/2658127275 shutdown_connections 2024-09-11T23:27:02.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.966+0000 7fac08800640 1 --2- 172.21.15.144:0/2658127275 >> v2:172.21.15.165:3300/0 conn(0x7fac000ce230 0x7fac000cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.966+0000 7fac08800640 1 --2- 172.21.15.144:0/2658127275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac0015c180 0x7fac000cdcf0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.966+0000 7fac08800640 1 -- 172.21.15.144:0/2658127275 >> 172.21.15.144:0/2658127275 conn(0x7fac00062cc0 msgr2=0x7fac0006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:02.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.966+0000 7fac08800640 1 -- 172.21.15.144:0/2658127275 shutdown_connections 2024-09-11T23:27:02.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.966+0000 7fac08800640 1 -- 172.21.15.144:0/2658127275 wait complete. 2024-09-11T23:27:02.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.968+0000 7fac08800640 1 Processor -- start 2024-09-11T23:27:02.970 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.968+0000 7fac08800640 1 -- start start 2024-09-11T23:27:02.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.969+0000 7fac08800640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac000ce230 0x7fac001f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.973 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.969+0000 7fac08800640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac000cf5b0 0x7fac001f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.969+0000 7fac08800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac0015c180 0x7fac00156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.969+0000 7fac08800640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fac0015c560 con 0x7fac0015c180 2024-09-11T23:27:02.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.969+0000 7fac08800640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fac000722f0 con 0x7fac000cf5b0 2024-09-11T23:27:02.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.969+0000 7fac08800640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7fac0015c6e0 con 0x7fac000ce230 2024-09-11T23:27:02.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.969+0000 7fac06800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac0015c180 0x7fac00156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.969+0000 7fac06800640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac0015c180 0x7fac00156140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37326/0 (socket says 172.21.15.144:37326) 2024-09-11T23:27:02.974 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.969+0000 7fac06800640 1 -- 172.21.15.144:0/1659024400 learned_addr learned my addr 172.21.15.144:0/1659024400 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:02.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.969+0000 7fac05e00640 1 --2- 172.21.15.144:0/1659024400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac000ce230 0x7fac001f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.969+0000 7fac05400640 1 --2- 172.21.15.144:0/1659024400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac000cf5b0 0x7fac001f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.969+0000 7fac06800640 1 -- 172.21.15.144:0/1659024400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac000ce230 msgr2=0x7fac001f6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.969+0000 7fac06800640 1 --2- 172.21.15.144:0/1659024400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac000ce230 0x7fac001f6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.969+0000 7fac06800640 1 -- 172.21.15.144:0/1659024400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac000cf5b0 msgr2=0x7fac001f51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:02.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.969+0000 7fac06800640 1 --2- 172.21.15.144:0/1659024400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac000cf5b0 0x7fac001f51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:02.975 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.969+0000 7fac06800640 1 -- 172.21.15.144:0/1659024400 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac001f4bc0 con 0x7fac0015c180 2024-09-11T23:27:02.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.970+0000 7fac06800640 1 --2- 172.21.15.144:0/1659024400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac0015c180 0x7fac00156140 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fabfc00c7a0 tx=0x7fabfc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:02.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.970+0000 7fabfa000640 1 -- 172.21.15.144:0/1659024400 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc003b70 con 0x7fac0015c180 2024-09-11T23:27:02.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.970+0000 7fabfa000640 1 -- 172.21.15.144:0/1659024400 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabfc003d30 con 0x7fac0015c180 2024-09-11T23:27:02.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.970+0000 7fac08800640 1 -- 172.21.15.144:0/1659024400 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac001f4ea0 con 0x7fac0015c180 2024-09-11T23:27:02.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.970+0000 7fabfa000640 1 -- 172.21.15.144:0/1659024400 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc00aa90 con 0x7fac0015c180 2024-09-11T23:27:02.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.970+0000 7fac08800640 1 -- 172.21.15.144:0/1659024400 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac001518b0 con 0x7fac0015c180 2024-09-11T23:27:02.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.971+0000 7fac08800640 1 -- 172.21.15.144:0/1659024400 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac000cf070 con 0x7fac0015c180 2024-09-11T23:27:02.976 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.972+0000 7fabfa000640 1 -- 172.21.15.144:0/1659024400 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7fabfc00ac30 con 0x7fac0015c180 2024-09-11T23:27:02.977 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.973+0000 7fabfa000640 1 --2- 172.21.15.144:0/1659024400 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fabe406c970 0x7fabe406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:02.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.973+0000 7fabfa000640 1 -- 172.21.15.144:0/1659024400 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7fabfc0899e0 con 0x7fac0015c180 2024-09-11T23:27:02.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.974+0000 7fac05e00640 1 --2- 172.21.15.144:0/1659024400 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fabe406c970 0x7fabe406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:02.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.974+0000 7fac05e00640 1 --2- 172.21.15.144:0/1659024400 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fabe406c970 0x7fabe406ee30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fabf4034000 tx=0x7fabf402e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:02.978 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:02.977+0000 7fabfa000640 1 -- 172.21.15.144:0/1659024400 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fabfc059b90 con 0x7fac0015c180 2024-09-11T23:27:03.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.151+0000 7fac08800640 1 -- 172.21.15.144:0/1659024400 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fac00157cf0 con 0x7fabe406c970 2024-09-11T23:27:03.152 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.153+0000 7fabfa000640 1 -- 172.21.15.144:0/1659024400 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fac00157cf0 con 0x7fabe406c970 2024-09-11T23:27:03.153 INFO:teuthology.orchestra.run.smithi144.stderr:instructed osd(s) 7 to deep-scrub 2024-09-11T23:27:03.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.154+0000 7fac08800640 1 -- 172.21.15.144:0/1659024400 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fabe406c970 msgr2=0x7fabe406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:03.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.154+0000 7fac08800640 1 --2- 172.21.15.144:0/1659024400 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fabe406c970 0x7fabe406ee30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fabf4034000 tx=0x7fabf402e000 comp rx=0 tx=0).stop 2024-09-11T23:27:03.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.154+0000 7fac08800640 1 -- 172.21.15.144:0/1659024400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac0015c180 msgr2=0x7fac00156140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:03.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.154+0000 7fac08800640 1 --2- 172.21.15.144:0/1659024400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac0015c180 0x7fac00156140 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fabfc00c7a0 tx=0x7fabfc00cc60 comp rx=0 tx=0).stop 2024-09-11T23:27:03.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.154+0000 7fac08800640 1 -- 172.21.15.144:0/1659024400 shutdown_connections 2024-09-11T23:27:03.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.154+0000 7fac08800640 1 --2- 172.21.15.144:0/1659024400 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7fabe406c970 0x7fabe406ee30 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.154+0000 7fac08800640 1 --2- 172.21.15.144:0/1659024400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fac0015c180 0x7fac00156140 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.154+0000 7fac08800640 1 --2- 172.21.15.144:0/1659024400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac000cf5b0 0x7fac001f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.155 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.154+0000 7fac08800640 1 --2- 172.21.15.144:0/1659024400 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7fac000ce230 0x7fac001f6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.154+0000 7fac08800640 1 -- 172.21.15.144:0/1659024400 >> 172.21.15.144:0/1659024400 conn(0x7fac00062cc0 msgr2=0x7fac000b2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:03.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.154+0000 7fac08800640 1 -- 172.21.15.144:0/1659024400 shutdown_connections 2024-09-11T23:27:03.156 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.154+0000 7fac08800640 1 -- 172.21.15.144:0/1659024400 wait complete. 2024-09-11T23:27:03.171 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:27:03.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.324+0000 7f04e0000640 1 Processor -- start 2024-09-11T23:27:03.325 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.324+0000 7f04e0000640 1 -- start start 2024-09-11T23:27:03.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.326+0000 7f04e0000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04d815c180 0x7f04d80cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:03.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.326+0000 7f04e0000640 1 --2- >> v2:172.21.15.165:3300/0 conn(0x7f04d8073120 0x7f04d80735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:03.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.326+0000 7f04e0000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04d80ce740 con 0x7f04d80ce230 2024-09-11T23:27:03.326 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.326+0000 7f04e0000640 1 -- --> v2:172.21.15.165:3300/0 -- mon_getmap magic: 0 -- 0x7f04d8072640 con 0x7f04d8073120 2024-09-11T23:27:03.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.326+0000 7f04e0000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f04d8072920 con 0x7f04d815c180 2024-09-11T23:27:03.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.326+0000 7f04dcc00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f04d80ce230 0x7f04d80cf070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:55206/0 (socket says 172.21.15.144:55206) 2024-09-11T23:27:03.327 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.326+0000 7f04dcc00640 1 -- 172.21.15.144:0/3706344481 learned_addr learned my addr 172.21.15.144:0/3706344481 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:27:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.326+0000 7f04de000640 1 --2- 172.21.15.144:0/3706344481 >> v2:172.21.15.165:3300/0 conn(0x7f04d8073120 0x7f04d80735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.326+0000 7f04dd600640 1 --2- 172.21.15.144:0/3706344481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04d815c180 0x7f04d80cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.326+0000 7f04d7e00640 1 -- 172.21.15.144:0/3706344481 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4174536024 0 0) 0x7f04d80ce740 con 0x7f04d80ce230 2024-09-11T23:27:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.326+0000 7f04d7e00640 1 -- 172.21.15.144:0/3706344481 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04c0003520 con 0x7f04d80ce230 2024-09-11T23:27:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.327+0000 7f04d7e00640 1 -- 172.21.15.144:0/3706344481 <== mon.0 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2342955127 0 0) 0x7f04c0003520 con 0x7f04d80ce230 2024-09-11T23:27:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.327+0000 7f04d7e00640 1 -- 172.21.15.144:0/3706344481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04d815c180 msgr2=0x7f04d80cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.327+0000 7f04d7e00640 1 --2- 172.21.15.144:0/3706344481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04d815c180 0x7f04d80cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.327+0000 7f04d7e00640 1 -- 172.21.15.144:0/3706344481 >> v2:172.21.15.165:3300/0 conn(0x7f04d8073120 msgr2=0x7f04d80735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.327+0000 7f04d7e00640 1 --2- 172.21.15.144:0/3706344481 >> v2:172.21.15.165:3300/0 conn(0x7f04d8073120 0x7f04d80735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.327+0000 7f04d7e00640 1 -- 172.21.15.144:0/3706344481 --> v1:172.21.15.144:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d8072c00 con 0x7f04d80ce230 2024-09-11T23:27:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.327+0000 7f04d7e00640 1 -- 172.21.15.144:0/3706344481 <== mon.0 v1:172.21.15.144:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 303500041 0 0) 0x7f04c4001670 con 0x7f04d80ce230 2024-09-11T23:27:03.329 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.327+0000 7f04d7e00640 1 -- 172.21.15.144:0/3706344481 >> v1:172.21.15.144:6789/0 conn(0x7f04d80ce230 legacy=0x7f04d80cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:03.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.327+0000 7f04d7e00640 1 --2- 172.21.15.144:0/3706344481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04d815c180 0x7f04c00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:03.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.327+0000 7f04d7e00640 1 --2- 172.21.15.144:0/3706344481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04c0003f30 0x7f04c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:03.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.327+0000 7f04d7e00640 1 --2- 172.21.15.144:0/3706344481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04c0004d40 0x7f04c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:03.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.327+0000 7f04d7e00640 1 -- 172.21.15.144:0/3706344481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f04d8072640 con 0x7f04c0004d40 2024-09-11T23:27:03.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.327+0000 7f04d7e00640 1 -- 172.21.15.144:0/3706344481 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f04d8072920 con 0x7f04c0003f30 2024-09-11T23:27:03.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.327+0000 7f04d7e00640 1 -- 172.21.15.144:0/3706344481 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f04c000ba10 con 0x7f04d815c180 2024-09-11T23:27:03.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.327+0000 7f04de000640 1 --2- 172.21.15.144:0/3706344481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04c0004d40 0x7f04c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:03.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.327+0000 7f04dd600640 1 --2- 172.21.15.144:0/3706344481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04d815c180 0x7f04c00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:03.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.327+0000 7f04dcc00640 1 --2- 172.21.15.144:0/3706344481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04c0003f30 0x7f04c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:03.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.328+0000 7f04de000640 1 -- 172.21.15.144:0/3706344481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04d815c180 msgr2=0x7f04c00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:03.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.328+0000 7f04de000640 1 --2- 172.21.15.144:0/3706344481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04d815c180 0x7f04c00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.328+0000 7f04de000640 1 -- 172.21.15.144:0/3706344481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04c0003f30 msgr2=0x7f04c0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:03.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.328+0000 7f04de000640 1 --2- 172.21.15.144:0/3706344481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04c0003f30 0x7f04c0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.330 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.328+0000 7f04de000640 1 -- 172.21.15.144:0/3706344481 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c0003520 con 0x7f04c0004d40 2024-09-11T23:27:03.331 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.328+0000 7f04dd600640 1 --2- 172.21.15.144:0/3706344481 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04d815c180 0x7f04c00039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T23:27:03.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.329+0000 7f04de000640 1 --2- 172.21.15.144:0/3706344481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04c0004d40 0x7f04c00051c0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f04d000e170 tx=0x7f04c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfa41c946018f82 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:03.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.329+0000 7f04d7e00640 1 -- 172.21.15.144:0/3706344481 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d0034020 con 0x7f04c0004d40 2024-09-11T23:27:03.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.329+0000 7f04d7e00640 1 -- 172.21.15.144:0/3706344481 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d0030430 con 0x7f04c0004d40 2024-09-11T23:27:03.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.329+0000 7f04d7e00640 1 -- 172.21.15.144:0/3706344481 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d0009c10 con 0x7f04c0004d40 2024-09-11T23:27:03.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.329+0000 7f04e0000640 1 -- 172.21.15.144:0/3706344481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04c0004d40 msgr2=0x7f04c00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:03.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.329+0000 7f04e0000640 1 --2- 172.21.15.144:0/3706344481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04c0004d40 0x7f04c00051c0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f04d000e170 tx=0x7f04c0005830 comp rx=0 tx=0).stop 2024-09-11T23:27:03.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.329+0000 7f04de000640 1 -- 172.21.15.144:0/3706344481 reap_dead start 2024-09-11T23:27:03.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.330+0000 7f04e0000640 1 -- 172.21.15.144:0/3706344481 shutdown_connections 2024-09-11T23:27:03.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.330+0000 7f04e0000640 1 -- 172.21.15.144:0/3706344481 >> 172.21.15.144:0/3706344481 conn(0x7f04d8062cc0 msgr2=0x7f04d806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:03.332 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.330+0000 7f04e0000640 1 -- 172.21.15.144:0/3706344481 shutdown_connections 2024-09-11T23:27:03.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.330+0000 7f04e0000640 1 -- 172.21.15.144:0/3706344481 wait complete. 2024-09-11T23:27:03.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.331+0000 7f04e0000640 1 Processor -- start 2024-09-11T23:27:03.333 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.331+0000 7f04e0000640 1 -- start start 2024-09-11T23:27:03.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.332+0000 7f04e0000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04c0004d40 0x7f04d8150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:03.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.332+0000 7f04e0000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04d814c380 0x7f04d813a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:03.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.332+0000 7f04e0000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04d814c7c0 0x7f04d813ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:03.334 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.332+0000 7f04e0000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f04d80cf780 con 0x7f04d814c380 2024-09-11T23:27:03.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.332+0000 7f04e0000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f04d80722f0 con 0x7f04c0004d40 2024-09-11T23:27:03.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.332+0000 7f04e0000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f04d815c560 con 0x7f04d814c7c0 2024-09-11T23:27:03.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.332+0000 7f04dcc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04d814c380 0x7f04d813a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:03.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.332+0000 7f04dd600640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04c0004d40 0x7f04d8150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:03.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.332+0000 7f04dcc00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04d814c380 0x7f04d813a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:37344/0 (socket says 172.21.15.144:37344) 2024-09-11T23:27:03.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.333+0000 7f04dcc00640 1 -- 172.21.15.144:0/1952365784 learned_addr learned my addr 172.21.15.144:0/1952365784 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:03.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.333+0000 7f04de000640 1 --2- 172.21.15.144:0/1952365784 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04d814c7c0 0x7f04d813ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:03.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.333+0000 7f04dcc00640 1 -- 172.21.15.144:0/1952365784 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04d814c7c0 msgr2=0x7f04d813ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:03.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.333+0000 7f04dcc00640 1 --2- 172.21.15.144:0/1952365784 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04d814c7c0 0x7f04d813ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.333+0000 7f04dcc00640 1 -- 172.21.15.144:0/1952365784 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04c0004d40 msgr2=0x7f04d8150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:03.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.333+0000 7f04dcc00640 1 --2- 172.21.15.144:0/1952365784 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04c0004d40 0x7f04d8150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.333+0000 7f04dcc00640 1 -- 172.21.15.144:0/1952365784 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d8151020 con 0x7f04d814c380 2024-09-11T23:27:03.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.333+0000 7f04dcc00640 1 --2- 172.21.15.144:0/1952365784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04d814c380 0x7f04d813a700 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f04c4007370 tx=0x7f04c4007770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:03.335 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.333+0000 7f04d5600640 1 -- 172.21.15.144:0/1952365784 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c40016e0 con 0x7f04d814c380 2024-09-11T23:27:03.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.333+0000 7f04d5600640 1 -- 172.21.15.144:0/1952365784 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c4018070 con 0x7f04d814c380 2024-09-11T23:27:03.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.333+0000 7f04e0000640 1 -- 172.21.15.144:0/1952365784 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d81512f0 con 0x7f04d814c380 2024-09-11T23:27:03.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.333+0000 7f04d5600640 1 -- 172.21.15.144:0/1952365784 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c400fb80 con 0x7f04d814c380 2024-09-11T23:27:03.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.334+0000 7f04e0000640 1 -- 172.21.15.144:0/1952365784 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d81518b0 con 0x7f04d814c380 2024-09-11T23:27:03.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.334+0000 7f04e0000640 1 -- 172.21.15.144:0/1952365784 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04d8158790 con 0x7f04d814c380 2024-09-11T23:27:03.336 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.336+0000 7f04d5600640 1 -- 172.21.15.144:0/1952365784 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f04c400fd20 con 0x7f04d814c380 2024-09-11T23:27:03.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.336+0000 7f04d5600640 1 --2- 172.21.15.144:0/1952365784 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f04b806cb40 0x7f04b806f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:03.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.336+0000 7f04d5600640 1 -- 172.21.15.144:0/1952365784 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7f04c4089790 con 0x7f04d814c380 2024-09-11T23:27:03.337 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.337+0000 7f04dd600640 1 --2- 172.21.15.144:0/1952365784 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f04b806cb40 0x7f04b806f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:03.338 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.338+0000 7f04dd600640 1 --2- 172.21.15.144:0/1952365784 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f04b806cb40 0x7f04b806f000 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009d60 tx=0x7f04cc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:03.341 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.341+0000 7f04d5600640 1 -- 172.21.15.144:0/1952365784 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f04d8158790 con 0x7f04d814c380 2024-09-11T23:27:03.511 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.510+0000 7f04e0000640 1 -- 172.21.15.144:0/1952365784 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f04d80cdcf0 con 0x7f04b806cb40 2024-09-11T23:27:03.512 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.511+0000 7f04d5600640 1 -- 172.21.15.144:0/1952365784 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13374 (secure 0 0 0) 0x7f04d80cdcf0 con 0x7f04b806cb40 2024-09-11T23:27:03.513 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:27:03.513 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:27:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.514+0000 7f04e0000640 1 -- 172.21.15.144:0/1952365784 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f04b806cb40 msgr2=0x7f04b806f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.514+0000 7f04e0000640 1 --2- 172.21.15.144:0/1952365784 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f04b806cb40 0x7f04b806f000 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009d60 tx=0x7f04cc009190 comp rx=0 tx=0).stop 2024-09-11T23:27:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.514+0000 7f04e0000640 1 -- 172.21.15.144:0/1952365784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04d814c380 msgr2=0x7f04d813a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.514+0000 7f04e0000640 1 --2- 172.21.15.144:0/1952365784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04d814c380 0x7f04d813a700 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f04c4007370 tx=0x7f04c4007770 comp rx=0 tx=0).stop 2024-09-11T23:27:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.514+0000 7f04e0000640 1 -- 172.21.15.144:0/1952365784 shutdown_connections 2024-09-11T23:27:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.514+0000 7f04e0000640 1 --2- 172.21.15.144:0/1952365784 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f04b806cb40 0x7f04b806f000 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.514+0000 7f04e0000640 1 --2- 172.21.15.144:0/1952365784 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f04d814c7c0 0x7f04d813ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.514+0000 7f04e0000640 1 --2- 172.21.15.144:0/1952365784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04d814c380 0x7f04d813a700 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.514+0000 7f04e0000640 1 --2- 172.21.15.144:0/1952365784 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04c0004d40 0x7f04d8150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.514+0000 7f04e0000640 1 -- 172.21.15.144:0/1952365784 >> 172.21.15.144:0/1952365784 conn(0x7f04d8062cc0 msgr2=0x7f04d80710c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.514+0000 7f04e0000640 1 -- 172.21.15.144:0/1952365784 shutdown_connections 2024-09-11T23:27:03.515 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:03.514+0000 7f04e0000640 1 -- 172.21.15.144:0/1952365784 wait complete. 2024-09-11T23:27:03.530 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-09-11T23:27:02.782357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":271472,"kb_used_data":17800,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703248,"statfs":{"total":773094113280,"available":772816125952,"internally_reserved":0,"allocated":18227200,"data_stored":8684400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-4,"num_write_kb":-2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002434"},"pg_stats":[{"pgid":"1.0","version":"72'128","reported_seq":484,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T23:26:53.162262+0000","last_change":"2024-09-11T23:17:50.379163+0000","last_active":"2024-09-11T23:26:53.162262+0000","last_peered":"2024-09-11T23:26:53.162262+0000","last_clean":"2024-09-11T23:26:53.162262+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:26:53.162262+0000","last_undegraded":"2024-09-11T23:26:53.162262+0000","last_fullsized":"2024-09-11T23:26:53.162262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T23:17:48.159581+0000","last_clean_scrub_stamp":"2024-09-11T23:17:48.159581+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:14.686121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33848,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337992,"statfs":{"total":96636764160,"available":96602103808,"internally_reserved":0,"allocated":2723840,"data_stored":1528326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33268,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338572,"statfs":{"total":96636764160,"available":96602697728,"internally_reserved":0,"allocated":2129920,"data_stored":937958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476849,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33272,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2129920,"data_stored":937958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476849,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33268,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338572,"statfs":{"total":96636764160,"available":96602697728,"internally_reserved":0,"allocated":2129920,"data_stored":937958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33268,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338572,"statfs":{"total":96636764160,"available":96602697728,"internally_reserved":0,"allocated":2129920,"data_stored":937958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33272,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2129920,"data_stored":937958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509554,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33268,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338572,"statfs":{"total":96636764160,"available":96602697728,"internally_reserved":0,"allocated":2129920,"data_stored":937958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509554,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38008,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333832,"statfs":{"total":96636764160,"available":96597843968,"internally_reserved":0,"allocated":2723840,"data_stored":1528326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:27:03.534 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T23:17:48.159581+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=23, tm_min=17, tm_sec=48, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=23, tm_min=26, tm_sec=57, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T23:27:03.534 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T23:27:15.391 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:27:15.396 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:27:23.536 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T23:27:23.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.702+0000 7f9bb6200640 1 Processor -- start 2024-09-11T23:27:23.702 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.702+0000 7f9bb6200640 1 -- start start 2024-09-11T23:27:23.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.703+0000 7f9bb6200640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9bb00b4510 0x7f9bb00b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:23.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.703+0000 7f9bb6200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9bb00b3ea0 0x7f9bb015b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:23.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.703+0000 7f9bb6200640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bb00b31d0 con 0x7f9bb015b150 2024-09-11T23:27:23.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.703+0000 7f9bb6200640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f9bb015c0a0 con 0x7f9bb00b4510 2024-09-11T23:27:23.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.703+0000 7f9bb6200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9bb015c380 con 0x7f9bb00b3ea0 2024-09-11T23:27:23.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.704+0000 7f9bafe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9bb00b4510 0x7f9bb00b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:23.704 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.704+0000 7f9bafe00640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9bb00b4510 0x7f9bb00b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:39996/0 (socket says 172.21.15.144:39996) 2024-09-11T23:27:23.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.704+0000 7f9bafe00640 1 -- 172.21.15.144:0/1869834224 learned_addr learned my addr 172.21.15.144:0/1869834224 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:23.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.704+0000 7f9bb5800640 1 --2- 172.21.15.144:0/1869834224 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9bb00b3ea0 0x7f9bb015b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:23.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.704+0000 7f9bafe00640 1 -- 172.21.15.144:0/1869834224 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9bb00b3ea0 msgr2=0x7f9bb015b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:23.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.704+0000 7f9bafe00640 1 --2- 172.21.15.144:0/1869834224 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9bb00b3ea0 0x7f9bb015b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:23.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.704+0000 7f9bafe00640 1 -- 172.21.15.144:0/1869834224 >> v1:172.21.15.144:6789/0 conn(0x7f9bb015b150 legacy=0x7f9bb00ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:23.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.704+0000 7f9bafe00640 1 -- 172.21.15.144:0/1869834224 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb00b3440 con 0x7f9bb00b4510 2024-09-11T23:27:23.705 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.704+0000 7f9baf400640 1 -- 172.21.15.144:0/1869834224 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1498880224 0 0) 0x7f9bb00b31d0 con 0x7f9bb015b150 2024-09-11T23:27:23.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.705+0000 7f9bafe00640 1 --2- 172.21.15.144:0/1869834224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bb00b4510 0x7f9bb00b3960 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0098a0 tx=0x7f9b9c02a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46eb5f5571d39e8f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:23.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.705+0000 7f9baf400640 1 -- 172.21.15.144:0/1869834224 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c037070 con 0x7f9bb00b4510 2024-09-11T23:27:23.706 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.705+0000 7f9baf400640 1 -- 172.21.15.144:0/1869834224 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b9c032440 con 0x7f9bb00b4510 2024-09-11T23:27:23.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.705+0000 7f9baf400640 1 -- 172.21.15.144:0/1869834224 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c032810 con 0x7f9bb00b4510 2024-09-11T23:27:23.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.706+0000 7f9bb6200640 1 -- 172.21.15.144:0/1869834224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bb00b4510 msgr2=0x7f9bb00b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:23.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.706+0000 7f9bb6200640 1 --2- 172.21.15.144:0/1869834224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bb00b4510 0x7f9bb00b3960 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0098a0 tx=0x7f9b9c02a290 comp rx=0 tx=0).stop 2024-09-11T23:27:23.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.706+0000 7f9bb6200640 1 -- 172.21.15.144:0/1869834224 shutdown_connections 2024-09-11T23:27:23.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.706+0000 7f9bb6200640 1 --2- 172.21.15.144:0/1869834224 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9bb00b3ea0 0x7f9bb015b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:23.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.706+0000 7f9bb6200640 1 --2- 172.21.15.144:0/1869834224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bb00b4510 0x7f9bb00b3960 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:23.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.706+0000 7f9bb6200640 1 -- 172.21.15.144:0/1869834224 >> 172.21.15.144:0/1869834224 conn(0x7f9bb006e910 msgr2=0x7f9bb006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:23.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.706+0000 7f9bb6200640 1 -- 172.21.15.144:0/1869834224 shutdown_connections 2024-09-11T23:27:23.707 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.706+0000 7f9bb6200640 1 -- 172.21.15.144:0/1869834224 wait complete. 2024-09-11T23:27:23.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.708+0000 7f9bb6200640 1 Processor -- start 2024-09-11T23:27:23.708 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.708+0000 7f9bb6200640 1 -- start start 2024-09-11T23:27:23.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.709+0000 7f9bb6200640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bb00b3ea0 0x7f9bb0072ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:23.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.709+0000 7f9bb6200640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bb00b4510 0x7f9bb01f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:23.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.709+0000 7f9bb6200640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9bb015b150 0x7f9bb00b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:23.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.709+0000 7f9bb6200640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb00cd200 con 0x7f9bb00b4510 2024-09-11T23:27:23.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.709+0000 7f9bb6200640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb015ba70 con 0x7f9bb00b3ea0 2024-09-11T23:27:23.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.709+0000 7f9bb6200640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9bb01f3ee0 con 0x7f9bb015b150 2024-09-11T23:27:23.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.709+0000 7f9bafe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bb00b4510 0x7f9bb01f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:23.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.709+0000 7f9bafe00640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bb00b4510 0x7f9bb01f6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40012/0 (socket says 172.21.15.144:40012) 2024-09-11T23:27:23.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.709+0000 7f9bafe00640 1 -- 172.21.15.144:0/770307227 learned_addr learned my addr 172.21.15.144:0/770307227 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:23.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.709+0000 7f9bb4e00640 1 --2- 172.21.15.144:0/770307227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bb00b3ea0 0x7f9bb0072ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:23.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.709+0000 7f9bafe00640 1 -- 172.21.15.144:0/770307227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9bb015b150 msgr2=0x7f9bb00b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:23.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.709+0000 7f9bb5800640 1 --2- 172.21.15.144:0/770307227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9bb015b150 0x7f9bb00b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:23.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.709+0000 7f9bafe00640 1 --2- 172.21.15.144:0/770307227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9bb015b150 0x7f9bb00b0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:23.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.709+0000 7f9bafe00640 1 -- 172.21.15.144:0/770307227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bb00b3ea0 msgr2=0x7f9bb0072ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:23.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.709+0000 7f9bafe00640 1 --2- 172.21.15.144:0/770307227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bb00b3ea0 0x7f9bb0072ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:23.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.709+0000 7f9bafe00640 1 -- 172.21.15.144:0/770307227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb0073430 con 0x7f9bb00b4510 2024-09-11T23:27:23.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.709+0000 7f9bb4e00640 1 --2- 172.21.15.144:0/770307227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bb00b3ea0 0x7f9bb0072ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:27:23.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.709+0000 7f9bb5800640 1 --2- 172.21.15.144:0/770307227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9bb015b150 0x7f9bb00b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T23:27:23.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.710+0000 7f9bafe00640 1 --2- 172.21.15.144:0/770307227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bb00b4510 0x7f9bb01f6bb0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0099c0 tx=0x7f9b9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:23.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.710+0000 7f9bacc00640 1 -- 172.21.15.144:0/770307227 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c041020 con 0x7f9bb00b4510 2024-09-11T23:27:23.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.710+0000 7f9bacc00640 1 -- 172.21.15.144:0/770307227 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b9c0306c0 con 0x7f9bb00b4510 2024-09-11T23:27:23.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.710+0000 7f9bacc00640 1 -- 172.21.15.144:0/770307227 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c037040 con 0x7f9bb00b4510 2024-09-11T23:27:23.714 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.710+0000 7f9bb6200640 1 -- 172.21.15.144:0/770307227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bb01f4160 con 0x7f9bb00b4510 2024-09-11T23:27:23.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.710+0000 7f9bb6200640 1 -- 172.21.15.144:0/770307227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bb01f4720 con 0x7f9bb00b4510 2024-09-11T23:27:23.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.711+0000 7f9bb6200640 1 -- 172.21.15.144:0/770307227 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bb00af730 con 0x7f9bb00b4510 2024-09-11T23:27:23.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.712+0000 7f9bacc00640 1 -- 172.21.15.144:0/770307227 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f9b9c044020 con 0x7f9bb00b4510 2024-09-11T23:27:23.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.713+0000 7f9bacc00640 1 --2- 172.21.15.144:0/770307227 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9b9006c970 0x7f9b9006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:23.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.713+0000 7f9bacc00640 1 -- 172.21.15.144:0/770307227 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7f9b9c0a9ec0 con 0x7f9bb00b4510 2024-09-11T23:27:23.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.713+0000 7f9bb4e00640 1 --2- 172.21.15.144:0/770307227 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9b9006c970 0x7f9b9006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:23.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.714+0000 7f9bb4e00640 1 --2- 172.21.15.144:0/770307227 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9b9006c970 0x7f9b9006ee30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4000f60 tx=0x7f9ba4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:23.717 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.718+0000 7f9bacc00640 1 -- 172.21.15.144:0/770307227 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9bb00af730 con 0x7f9bb00b4510 2024-09-11T23:27:23.889 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.889+0000 7f9bb6200640 1 -- 172.21.15.144:0/770307227 --> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9bb01f4de0 con 0x7f9b9006c970 2024-09-11T23:27:23.890 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.890+0000 7f9bacc00640 1 -- 172.21.15.144:0/770307227 <== mgr.4113 v2:172.21.15.165:6836/1939941590 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13379 (secure 0 0 0) 0x7f9bb01f4de0 con 0x7f9b9006c970 2024-09-11T23:27:23.890 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:27:23.891 INFO:teuthology.orchestra.run.smithi144.stderr:dumped all 2024-09-11T23:27:23.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.893+0000 7f9bb6200640 1 -- 172.21.15.144:0/770307227 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9b9006c970 msgr2=0x7f9b9006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:23.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.893+0000 7f9bb6200640 1 --2- 172.21.15.144:0/770307227 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9b9006c970 0x7f9b9006ee30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4000f60 tx=0x7f9ba4009040 comp rx=0 tx=0).stop 2024-09-11T23:27:23.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.893+0000 7f9bb6200640 1 -- 172.21.15.144:0/770307227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bb00b4510 msgr2=0x7f9bb01f6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:23.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.893+0000 7f9bb6200640 1 --2- 172.21.15.144:0/770307227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bb00b4510 0x7f9bb01f6bb0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0099c0 tx=0x7f9b9c0046c0 comp rx=0 tx=0).stop 2024-09-11T23:27:23.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.893+0000 7f9bb6200640 1 -- 172.21.15.144:0/770307227 shutdown_connections 2024-09-11T23:27:23.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.893+0000 7f9bb6200640 1 --2- 172.21.15.144:0/770307227 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9b9006c970 0x7f9b9006ee30 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:23.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.893+0000 7f9bb6200640 1 --2- 172.21.15.144:0/770307227 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9bb015b150 0x7f9bb00b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:23.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.893+0000 7f9bb6200640 1 --2- 172.21.15.144:0/770307227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bb00b4510 0x7f9bb01f6bb0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:23.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.893+0000 7f9bb6200640 1 --2- 172.21.15.144:0/770307227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bb00b3ea0 0x7f9bb0072ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:23.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.893+0000 7f9bb6200640 1 -- 172.21.15.144:0/770307227 >> 172.21.15.144:0/770307227 conn(0x7f9bb006e910 msgr2=0x7f9bb00ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:23.893 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.893+0000 7f9bb6200640 1 -- 172.21.15.144:0/770307227 shutdown_connections 2024-09-11T23:27:23.894 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:23.893+0000 7f9bb6200640 1 -- 172.21.15.144:0/770307227 wait complete. 2024-09-11T23:27:23.908 INFO:teuthology.orchestra.run.smithi144.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-09-11T23:27:22.786563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":271464,"kb_used_data":17800,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703256,"statfs":{"total":773094113280,"available":772816134144,"internally_reserved":0,"allocated":18227200,"data_stored":8684400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002683"},"pg_stats":[{"pgid":"1.0","version":"169'130","reported_seq":495,"reported_epoch":169,"state":"active+clean","last_fresh":"2024-09-11T23:27:03.869555+0000","last_change":"2024-09-11T23:27:03.869599+0000","last_active":"2024-09-11T23:27:03.869555+0000","last_peered":"2024-09-11T23:27:03.869555+0000","last_clean":"2024-09-11T23:27:03.869555+0000","last_became_active":"2024-09-11T23:17:50.378040+0000","last_became_peered":"2024-09-11T23:17:50.378040+0000","last_unstale":"2024-09-11T23:27:03.869555+0000","last_undegraded":"2024-09-11T23:27:03.869555+0000","last_fullsized":"2024-09-11T23:27:03.869555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"169'130","last_scrub_stamp":"2024-09-11T23:27:03.869453+0000","last_deep_scrub":"169'130","last_deep_scrub_stamp":"2024-09-11T23:27:03.869453+0000","last_clean_scrub_stamp":"2024-09-11T23:27:03.869453+0000","objects_scrubbed":2,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:21.701783+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33844,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337996,"statfs":{"total":96636764160,"available":96602107904,"internally_reserved":0,"allocated":2723840,"data_stored":1528326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33268,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338572,"statfs":{"total":96636764160,"available":96602697728,"internally_reserved":0,"allocated":2129920,"data_stored":937958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33272,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2129920,"data_stored":937958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33268,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338572,"statfs":{"total":96636764160,"available":96602697728,"internally_reserved":0,"allocated":2129920,"data_stored":937958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33268,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338572,"statfs":{"total":96636764160,"available":96602697728,"internally_reserved":0,"allocated":2129920,"data_stored":937958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33272,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2129920,"data_stored":937958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33268,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338572,"statfs":{"total":96636764160,"available":96602697728,"internally_reserved":0,"allocated":2129920,"data_stored":937958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509558,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38004,"kb_used_data":2660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333836,"statfs":{"total":96636764160,"available":96597848064,"internally_reserved":0,"allocated":2723840,"data_stored":1528326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T23:27:23.909 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-11T23:27:24.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.057+0000 7f96a8400640 1 Processor -- start 2024-09-11T23:27:24.057 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.057+0000 7f96a8400640 1 -- start start 2024-09-11T23:27:24.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.058+0000 7f96a8400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96a0143d40 0x7f96a00b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:24.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.059+0000 7f96a8400640 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f96a00b4000 0x7f96a00ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:24.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.059+0000 7f96a8400640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a01443d0 con 0x7f96a015ed50 2024-09-11T23:27:24.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.059+0000 7f96a8400640 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 -- 0x7f96a0144190 con 0x7f96a00b4000 2024-09-11T23:27:24.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.059+0000 7f96a8400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f96a01446b0 con 0x7f96a0143d40 2024-09-11T23:27:24.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.059+0000 7f96a5a00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f96a015ed50 0x7f96a0071080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:34794/0 (socket says 172.21.15.144:34794) 2024-09-11T23:27:24.059 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.059+0000 7f96a5a00640 1 -- 172.21.15.144:0/331186501 learned_addr learned my addr 172.21.15.144:0/331186501 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:27:24.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.059+0000 7f96a6400640 1 --2- 172.21.15.144:0/331186501 >> v2:172.21.15.144:3300/0 conn(0x7f96a00b4000 0x7f96a00ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:24.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.059+0000 7f96a5000640 1 --2- 172.21.15.144:0/331186501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96a0143d40 0x7f96a00b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:24.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.059+0000 7f969fe00640 1 -- 172.21.15.144:0/331186501 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2942862061 0 0) 0x7f96a01443d0 con 0x7f96a015ed50 2024-09-11T23:27:24.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.059+0000 7f969fe00640 1 -- 172.21.15.144:0/331186501 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9688003520 con 0x7f96a015ed50 2024-09-11T23:27:24.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.059+0000 7f96a6400640 1 -- 172.21.15.144:0/331186501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96a0143d40 msgr2=0x7f96a00b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T23:27:24.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.059+0000 7f96a6400640 1 --2- 172.21.15.144:0/331186501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96a0143d40 0x7f96a00b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.059+0000 7f96a6400640 1 -- 172.21.15.144:0/331186501 >> v1:172.21.15.144:6789/0 conn(0x7f96a015ed50 legacy=0x7f96a0071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:24.060 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.059+0000 7f96a6400640 1 -- 172.21.15.144:0/331186501 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a0144990 con 0x7f96a00b4000 2024-09-11T23:27:24.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.060+0000 7f96a6400640 1 --2- 172.21.15.144:0/331186501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a00b4000 0x7f96a00ae8e0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f9698009d90 tx=0x7f969802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a4948a0d98fb93 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:24.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.061+0000 7f969fe00640 1 -- 172.21.15.144:0/331186501 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9698031600 con 0x7f96a00b4000 2024-09-11T23:27:24.061 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.061+0000 7f969fe00640 1 -- 172.21.15.144:0/331186501 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96980317a0 con 0x7f96a00b4000 2024-09-11T23:27:24.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.061+0000 7f969fe00640 1 -- 172.21.15.144:0/331186501 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9698031b70 con 0x7f96a00b4000 2024-09-11T23:27:24.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.061+0000 7f96a8400640 1 -- 172.21.15.144:0/331186501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a00b4000 msgr2=0x7f96a00ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:24.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.061+0000 7f96a8400640 1 --2- 172.21.15.144:0/331186501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a00b4000 0x7f96a00ae8e0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f9698009d90 tx=0x7f969802a5d0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.061+0000 7f96a8400640 1 -- 172.21.15.144:0/331186501 shutdown_connections 2024-09-11T23:27:24.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.061+0000 7f96a8400640 1 --2- 172.21.15.144:0/331186501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a00b4000 0x7f96a00ae8e0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.061+0000 7f96a8400640 1 --2- 172.21.15.144:0/331186501 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96a0143d40 0x7f96a00b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.061+0000 7f96a8400640 1 -- 172.21.15.144:0/331186501 >> 172.21.15.144:0/331186501 conn(0x7f96a006bba0 msgr2=0x7f96a006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:24.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.061+0000 7f96a8400640 1 -- 172.21.15.144:0/331186501 shutdown_connections 2024-09-11T23:27:24.062 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.061+0000 7f96a8400640 1 -- 172.21.15.144:0/331186501 wait complete. 2024-09-11T23:27:24.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.063+0000 7f96a8400640 1 Processor -- start 2024-09-11T23:27:24.063 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.063+0000 7f96a8400640 1 -- start start 2024-09-11T23:27:24.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.064+0000 7f96a8400640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96a00b4000 0x7f96a0158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:24.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.064+0000 7f96a8400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a0143d40 0x7f96a015e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:24.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.064+0000 7f96a8400640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96a015ed50 0x7f96a01f7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:24.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.064+0000 7f96a8400640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f96a0071790 con 0x7f96a0143d40 2024-09-11T23:27:24.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.064+0000 7f96a8400640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f96a00aee20 con 0x7f96a00b4000 2024-09-11T23:27:24.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.064+0000 7f96a8400640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f96a015e570 con 0x7f96a015ed50 2024-09-11T23:27:24.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.064+0000 7f96a5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a0143d40 0x7f96a015e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:24.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.064+0000 7f96a5000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a0143d40 0x7f96a015e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40030/0 (socket says 172.21.15.144:40030) 2024-09-11T23:27:24.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.064+0000 7f96a5000640 1 -- 172.21.15.144:0/560748282 learned_addr learned my addr 172.21.15.144:0/560748282 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:24.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.064+0000 7f96a6400640 1 --2- 172.21.15.144:0/560748282 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96a015ed50 0x7f96a01f7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:24.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.064+0000 7f96a5a00640 1 --2- 172.21.15.144:0/560748282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96a00b4000 0x7f96a0158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:24.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.064+0000 7f96a5000640 1 -- 172.21.15.144:0/560748282 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96a015ed50 msgr2=0x7f96a01f7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:24.065 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.064+0000 7f96a5000640 1 --2- 172.21.15.144:0/560748282 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96a015ed50 0x7f96a01f7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.064+0000 7f96a5000640 1 -- 172.21.15.144:0/560748282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96a00b4000 msgr2=0x7f96a0158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:24.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.064+0000 7f96a5000640 1 --2- 172.21.15.144:0/560748282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96a00b4000 0x7f96a0158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.064+0000 7f96a5000640 1 -- 172.21.15.144:0/560748282 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a01589c0 con 0x7f96a0143d40 2024-09-11T23:27:24.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.065+0000 7f96a5000640 1 --2- 172.21.15.144:0/560748282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a0143d40 0x7f96a015e030 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f968c00d830 tx=0x7f968c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:24.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.065+0000 7f969d600640 1 -- 172.21.15.144:0/560748282 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c00b6c0 con 0x7f96a0143d40 2024-09-11T23:27:24.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.065+0000 7f969d600640 1 -- 172.21.15.144:0/560748282 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f968c019070 con 0x7f96a0143d40 2024-09-11T23:27:24.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.065+0000 7f96a8400640 1 -- 172.21.15.144:0/560748282 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a0158ca0 con 0x7f96a0143d40 2024-09-11T23:27:24.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.065+0000 7f969d600640 1 -- 172.21.15.144:0/560748282 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c00baa0 con 0x7f96a0143d40 2024-09-11T23:27:24.066 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.065+0000 7f96a8400640 1 -- 172.21.15.144:0/560748282 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a01f7520 con 0x7f96a0143d40 2024-09-11T23:27:24.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.066+0000 7f96a8400640 1 -- 172.21.15.144:0/560748282 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a00ae8e0 con 0x7f96a0143d40 2024-09-11T23:27:24.067 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.067+0000 7f969d600640 1 -- 172.21.15.144:0/560748282 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f968c01e460 con 0x7f96a0143d40 2024-09-11T23:27:24.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.068+0000 7f969d600640 1 --2- 172.21.15.144:0/560748282 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f968006c970 0x7f968006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:24.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.068+0000 7f969d600640 1 -- 172.21.15.144:0/560748282 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7f968c089ee0 con 0x7f96a0143d40 2024-09-11T23:27:24.068 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.069+0000 7f96a5a00640 1 --2- 172.21.15.144:0/560748282 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f968006c970 0x7f968006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:24.069 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.070+0000 7f96a5a00640 1 --2- 172.21.15.144:0/560748282 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f968006c970 0x7f968006ee30 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9694005880 tx=0x7f9694009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:24.072 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.073+0000 7f969d600640 1 -- 172.21.15.144:0/560748282 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f968c05a2e0 con 0x7f96a0143d40 2024-09-11T23:27:24.248 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.248+0000 7f96a8400640 1 -- 172.21.15.144:0/560748282 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f96a00725a0 con 0x7f96a0143d40 2024-09-11T23:27:24.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.251+0000 7f969d600640 1 -- 172.21.15.144:0/560748282 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v32)=0 v32) ==== 123+0+0 (secure 0 0 0) 0x7f968c059be0 con 0x7f96a0143d40 2024-09-11T23:27:24.251 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.252+0000 7f969d600640 1 -- 172.21.15.144:0/560748282 <== mon.0 v2:172.21.15.144:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f968c05df90 con 0x7f96a0143d40 2024-09-11T23:27:24.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.254+0000 7f96a8400640 1 -- 172.21.15.144:0/560748282 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f968006c970 msgr2=0x7f968006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:24.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.254+0000 7f96a8400640 1 --2- 172.21.15.144:0/560748282 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f968006c970 0x7f968006ee30 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9694005880 tx=0x7f9694009040 comp rx=0 tx=0).stop 2024-09-11T23:27:24.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.254+0000 7f96a8400640 1 -- 172.21.15.144:0/560748282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a0143d40 msgr2=0x7f96a015e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:24.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.254+0000 7f96a8400640 1 --2- 172.21.15.144:0/560748282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a0143d40 0x7f96a015e030 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f968c00d830 tx=0x7f968c00dcf0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.255+0000 7f96a8400640 1 -- 172.21.15.144:0/560748282 shutdown_connections 2024-09-11T23:27:24.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.255+0000 7f96a8400640 1 --2- 172.21.15.144:0/560748282 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f968006c970 0x7f968006ee30 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.255+0000 7f96a8400640 1 --2- 172.21.15.144:0/560748282 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f96a015ed50 0x7f96a01f7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.255+0000 7f96a8400640 1 --2- 172.21.15.144:0/560748282 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96a0143d40 0x7f96a015e030 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.255+0000 7f96a8400640 1 --2- 172.21.15.144:0/560748282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96a00b4000 0x7f96a0158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.255+0000 7f96a8400640 1 -- 172.21.15.144:0/560748282 >> 172.21.15.144:0/560748282 conn(0x7f96a006bba0 msgr2=0x7f96a0071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:24.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.255+0000 7f96a8400640 1 -- 172.21.15.144:0/560748282 shutdown_connections 2024-09-11T23:27:24.255 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.255+0000 7f96a8400640 1 -- 172.21.15.144:0/560748282 wait complete. 2024-09-11T23:27:24.269 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T23:27:24.270 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T23:27:24.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.423+0000 7f9cd2000640 1 Processor -- start 2024-09-11T23:27:24.423 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.423+0000 7f9cd2000640 1 -- start start 2024-09-11T23:27:24.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.424+0000 7f9cd2000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ccc0d02a0 0x7f9ccc0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:24.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.424+0000 7f9cd2000640 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ccc0d0bc0 con 0x7f9ccc15ca40 2024-09-11T23:27:24.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.425+0000 7f9cd2000640 1 -- --> v1:172.21.15.165:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ccc15d390 con 0x7f9ccc15ce80 2024-09-11T23:27:24.424 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.425+0000 7f9cd2000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9ccc15d670 con 0x7f9ccc0d02a0 2024-09-11T23:27:24.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.425+0000 7f9ccaa00640 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9ccc15ca40 0x7f9ccc15e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:49198/0 (socket says 172.21.15.144:49198) 2024-09-11T23:27:24.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.425+0000 7f9ccaa00640 1 -- 172.21.15.144:0/845443161 learned_addr learned my addr 172.21.15.144:0/845443161 (peer_addr_for_me v1:172.21.15.144:0/0) 2024-09-11T23:27:24.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.425+0000 7f9ccb400640 1 --2- 172.21.15.144:0/845443161 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ccc0d02a0 0x7f9ccc0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:24.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.425+0000 7f9cca000640 1 -- 172.21.15.144:0/845443161 <== mon.0 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3806744420 0 0) 0x7f9ccc0d0bc0 con 0x7f9ccc15ca40 2024-09-11T23:27:24.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.425+0000 7f9cca000640 1 -- 172.21.15.144:0/845443161 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cb0003520 con 0x7f9ccc15ca40 2024-09-11T23:27:24.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.425+0000 7f9cca000640 1 -- 172.21.15.144:0/845443161 <== mon.1 v1:172.21.15.165:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1247305678 0 0) 0x7f9ccc15d390 con 0x7f9ccc15ce80 2024-09-11T23:27:24.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.425+0000 7f9cca000640 1 -- 172.21.15.144:0/845443161 --> v1:172.21.15.165:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ccc0d0bc0 con 0x7f9ccc15ce80 2024-09-11T23:27:24.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.425+0000 7f9ccb400640 1 -- 172.21.15.144:0/845443161 >> v1:172.21.15.165:6789/0 conn(0x7f9ccc15ce80 legacy=0x7f9ccc1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:24.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.425+0000 7f9ccb400640 1 -- 172.21.15.144:0/845443161 >> v1:172.21.15.144:6789/0 conn(0x7f9ccc15ca40 legacy=0x7f9ccc15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:24.426 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.425+0000 7f9ccb400640 1 -- 172.21.15.144:0/845443161 --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ccc15d950 con 0x7f9ccc0d02a0 2024-09-11T23:27:24.427 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.427+0000 7f9ccb400640 1 --2- 172.21.15.144:0/845443161 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ccc0d02a0 0x7f9ccc0d0680 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc0097d0 tx=0x7f9cbc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bafc9037cad1252e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:24.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.427+0000 7f9cca000640 1 -- 172.21.15.144:0/845443161 <== mon.2 v2:172.21.15.165:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc037070 con 0x7f9ccc0d02a0 2024-09-11T23:27:24.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.427+0000 7f9cca000640 1 -- 172.21.15.144:0/845443161 <== mon.2 v2:172.21.15.165:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9cbc032440 con 0x7f9ccc0d02a0 2024-09-11T23:27:24.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.427+0000 7f9cca000640 1 -- 172.21.15.144:0/845443161 <== mon.2 v2:172.21.15.165:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc0327f0 con 0x7f9ccc0d02a0 2024-09-11T23:27:24.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.427+0000 7f9cd2000640 1 -- 172.21.15.144:0/845443161 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ccc0d02a0 msgr2=0x7f9ccc0d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:24.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.427+0000 7f9cd2000640 1 --2- 172.21.15.144:0/845443161 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ccc0d02a0 0x7f9ccc0d0680 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc0097d0 tx=0x7f9cbc02a180 comp rx=0 tx=0).stop 2024-09-11T23:27:24.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.428+0000 7f9cd2000640 1 -- 172.21.15.144:0/845443161 shutdown_connections 2024-09-11T23:27:24.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.428+0000 7f9cd2000640 1 --2- 172.21.15.144:0/845443161 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ccc0d02a0 0x7f9ccc0d0680 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.428+0000 7f9cd2000640 1 -- 172.21.15.144:0/845443161 >> 172.21.15.144:0/845443161 conn(0x7f9ccc062cc0 msgr2=0x7f9ccc06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:24.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.428+0000 7f9cd2000640 1 -- 172.21.15.144:0/845443161 shutdown_connections 2024-09-11T23:27:24.428 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.428+0000 7f9cd2000640 1 -- 172.21.15.144:0/845443161 wait complete. 2024-09-11T23:27:24.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.429+0000 7f9cd2000640 1 Processor -- start 2024-09-11T23:27:24.429 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.429+0000 7f9cd2000640 1 -- start start 2024-09-11T23:27:24.430 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.430+0000 7f9cd2000640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ccc0d02a0 0x7f9ccc15b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:24.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.430+0000 7f9cd2000640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ccc15ca40 0x7f9ccc072c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:24.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.430+0000 7f9cd2000640 1 --2- >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ccc15ce80 0x7f9ccc153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:24.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.430+0000 7f9cd2000640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc15eb40 con 0x7f9ccc0d02a0 2024-09-11T23:27:24.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.430+0000 7f9cd2000640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9ccc15df10 con 0x7f9ccc15ca40 2024-09-11T23:27:24.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.430+0000 7f9cd2000640 1 -- --> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] -- mon_getmap magic: 0 -- 0x7f9ccc155b90 con 0x7f9ccc15ce80 2024-09-11T23:27:24.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.430+0000 7f9ccb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ccc0d02a0 0x7f9ccc15b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:24.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.430+0000 7f9ccb400640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ccc0d02a0 0x7f9ccc15b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:40440/0 (socket says 172.21.15.144:40440) 2024-09-11T23:27:24.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.430+0000 7f9ccb400640 1 -- 172.21.15.144:0/3717106331 learned_addr learned my addr 172.21.15.144:0/3717106331 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-11T23:27:24.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.431+0000 7f9ccaa00640 1 --2- 172.21.15.144:0/3717106331 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ccc15ca40 0x7f9ccc072c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:24.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.431+0000 7f9ccbe00640 1 --2- 172.21.15.144:0/3717106331 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ccc15ce80 0x7f9ccc153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:24.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.431+0000 7f9ccb400640 1 -- 172.21.15.144:0/3717106331 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ccc15ce80 msgr2=0x7f9ccc153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:24.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.431+0000 7f9ccb400640 1 --2- 172.21.15.144:0/3717106331 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ccc15ce80 0x7f9ccc153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.431 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.431+0000 7f9ccb400640 1 -- 172.21.15.144:0/3717106331 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ccc15ca40 msgr2=0x7f9ccc072c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:24.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.431+0000 7f9ccb400640 1 --2- 172.21.15.144:0/3717106331 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ccc15ca40 0x7f9ccc072c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.431+0000 7f9ccb400640 1 -- 172.21.15.144:0/3717106331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ccc154380 con 0x7f9ccc0d02a0 2024-09-11T23:27:24.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.431+0000 7f9ccaa00640 1 --2- 172.21.15.144:0/3717106331 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ccc15ca40 0x7f9ccc072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T23:27:24.432 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.431+0000 7f9ccb400640 1 --2- 172.21.15.144:0/3717106331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ccc0d02a0 0x7f9ccc15b5b0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc02a1c0 tx=0x7f9cbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:24.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.431+0000 7f9cc3400640 1 -- 172.21.15.144:0/3717106331 <== mon.0 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc037040 con 0x7f9ccc0d02a0 2024-09-11T23:27:24.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.431+0000 7f9cc3400640 1 -- 172.21.15.144:0/3717106331 <== mon.0 v2:172.21.15.144:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9cbc003c90 con 0x7f9ccc0d02a0 2024-09-11T23:27:24.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.431+0000 7f9cd2000640 1 -- 172.21.15.144:0/3717106331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ccc073330 con 0x7f9ccc0d02a0 2024-09-11T23:27:24.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.431+0000 7f9cc3400640 1 -- 172.21.15.144:0/3717106331 <== mon.0 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc0325f0 con 0x7f9ccc0d02a0 2024-09-11T23:27:24.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.432+0000 7f9cd2000640 1 -- 172.21.15.144:0/3717106331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ccc0738f0 con 0x7f9ccc0d02a0 2024-09-11T23:27:24.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.433+0000 7f9cd2000640 1 -- 172.21.15.144:0/3717106331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ccc0b4790 con 0x7f9ccc0d02a0 2024-09-11T23:27:24.433 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.434+0000 7f9cc3400640 1 -- 172.21.15.144:0/3717106331 <== mon.0 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 29) ==== 91518+0+0 (secure 0 0 0) 0x7f9cbc044020 con 0x7f9ccc0d02a0 2024-09-11T23:27:24.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.434+0000 7f9cc3400640 1 --2- 172.21.15.144:0/3717106331 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9cac06c970 0x7f9cac06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T23:27:24.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.435+0000 7f9cc3400640 1 -- 172.21.15.144:0/3717106331 <== mon.0 v2:172.21.15.144:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 4943+0+0 (secure 0 0 0) 0x7f9cbc0a97e0 con 0x7f9ccc0d02a0 2024-09-11T23:27:24.434 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.435+0000 7f9ccaa00640 1 --2- 172.21.15.144:0/3717106331 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9cac06c970 0x7f9cac06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T23:27:24.435 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.436+0000 7f9ccaa00640 1 --2- 172.21.15.144:0/3717106331 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9cac06c970 0x7f9cac06ee30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0b1640 tx=0x7f9cb8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T23:27:24.438 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.438+0000 7f9cc3400640 1 -- 172.21.15.144:0/3717106331 <== mon.0 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9cbc04b020 con 0x7f9ccc0d02a0 2024-09-11T23:27:24.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.647+0000 7f9cd2000640 1 -- 172.21.15.144:0/3717106331 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ccc15a960 con 0x7f9ccc0d02a0 2024-09-11T23:27:24.647 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.648+0000 7f9cc3400640 1 -- 172.21.15.144:0/3717106331 <== mon.0 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 122 v122) ==== 95+0+3928 (secure 0 0 0) 0x7f9cbc079bb0 con 0x7f9ccc0d02a0 2024-09-11T23:27:24.648 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-11T23:27:24.648 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":122,"btime":"2024-09-11T23:26:51:148694+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6801/4202069031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":4202069031},{"type":"v1","addr":"172.21.15.144:6801","nonce":4202069031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":7331,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/1262024638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":1262024638},{"type":"v1","addr":"172.21.15.144:6835","nonce":1262024638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8407,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6834/2678086616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":2678086616},{"type":"v1","addr":"172.21.15.165:6834","nonce":2678086616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":8647,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/1571549408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6833","nonce":1571549408},{"type":"v1","addr":"172.21.15.165:6835","nonce":1571549408}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":122}],"filesystems":[]} 2024-09-11T23:27:24.648 INFO:teuthology.orchestra.run.smithi144.stderr:dumped fsmap epoch 122 2024-09-11T23:27:24.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.650+0000 7f9cd2000640 1 -- 172.21.15.144:0/3717106331 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9cac06c970 msgr2=0x7f9cac06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:24.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.650+0000 7f9cd2000640 1 --2- 172.21.15.144:0/3717106331 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9cac06c970 0x7f9cac06ee30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0b1640 tx=0x7f9cb8009040 comp rx=0 tx=0).stop 2024-09-11T23:27:24.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.650+0000 7f9cd2000640 1 -- 172.21.15.144:0/3717106331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ccc0d02a0 msgr2=0x7f9ccc15b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T23:27:24.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.650+0000 7f9cd2000640 1 --2- 172.21.15.144:0/3717106331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ccc0d02a0 0x7f9ccc15b5b0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc02a1c0 tx=0x7f9cbc0046c0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.650+0000 7f9cd2000640 1 -- 172.21.15.144:0/3717106331 shutdown_connections 2024-09-11T23:27:24.650 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.650+0000 7f9cd2000640 1 --2- 172.21.15.144:0/3717106331 >> [v2:172.21.15.165:6836/1939941590,v1:172.21.15.165:6837/1939941590] conn(0x7f9cac06c970 0x7f9cac06ee30 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.650+0000 7f9cd2000640 1 --2- 172.21.15.144:0/3717106331 >> [v2:172.21.15.165:3301/0,v1:172.21.15.165:6790/0] conn(0x7f9ccc15ce80 0x7f9ccc153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.650+0000 7f9cd2000640 1 --2- 172.21.15.144:0/3717106331 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ccc15ca40 0x7f9ccc072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.650+0000 7f9cd2000640 1 --2- 172.21.15.144:0/3717106331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ccc0d02a0 0x7f9ccc15b5b0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T23:27:24.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.650+0000 7f9cd2000640 1 -- 172.21.15.144:0/3717106331 >> 172.21.15.144:0/3717106331 conn(0x7f9ccc062cc0 msgr2=0x7f9ccc154b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T23:27:24.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.650+0000 7f9cd2000640 1 -- 172.21.15.144:0/3717106331 shutdown_connections 2024-09-11T23:27:24.651 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-11T23:27:24.650+0000 7f9cd2000640 1 -- 172.21.15.144:0/3717106331 wait complete. 2024-09-11T23:27:24.665 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-11T23:27:24.665 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-11T23:27:24.665 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T23:27:24.666 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:27:24.680 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T23:27:24.680 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T23:27:24.680 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:27:24.734 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T23:27:24.734 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T23:27:24.734 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:27:24.751 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T23:27:24.751 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T23:27:24.751 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:27:24.808 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T23:27:24.808 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-11T23:27:24.809 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-11T23:27:24.809 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:27:24.854 INFO:tasks.ceph.osd.0:Stopped 2024-09-11T23:27:24.854 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-11T23:27:24.854 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:27:24.901 INFO:tasks.ceph.osd.1:Stopped 2024-09-11T23:27:24.902 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-11T23:27:24.902 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:27:24.951 INFO:tasks.ceph.osd.2:Stopped 2024-09-11T23:27:24.952 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-11T23:27:24.952 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:27:24.998 INFO:tasks.ceph.osd.3:Stopped 2024-09-11T23:27:24.999 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-11T23:27:24.999 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:27:25.051 INFO:tasks.ceph.osd.4:Stopped 2024-09-11T23:27:25.051 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-11T23:27:25.051 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:27:25.111 INFO:tasks.ceph.osd.5:Stopped 2024-09-11T23:27:25.111 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-11T23:27:25.111 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:27:25.169 INFO:tasks.ceph.osd.6:Stopped 2024-09-11T23:27:25.170 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-11T23:27:25.170 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:27:25.219 INFO:tasks.ceph.osd.7:Stopped 2024-09-11T23:27:25.219 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-11T23:27:25.219 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-11T23:27:25.219 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:27:25.286 INFO:tasks.ceph.mgr.y:Stopped 2024-09-11T23:27:25.287 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-11T23:27:25.287 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:27:25.356 INFO:tasks.ceph.mgr.x:Stopped 2024-09-11T23:27:25.357 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-11T23:27:25.357 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T23:27:25.357 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:27:25.379 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T23:27:25.379 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-11T23:27:25.379 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:27:25.397 INFO:tasks.ceph.mon.b:Stopped 2024-09-11T23:27:25.397 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-11T23:27:25.398 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T23:27:25.458 INFO:tasks.ceph.mon.c:Stopped 2024-09-11T23:27:25.458 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-11T23:27:25.458 DEBUG:teuthology.orchestra.run.smithi144:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-09-11T23:27:25.540 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:27:25.540 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-11T23:27:25.823 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:27:25.823 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-11T23:27:25.983 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:27:25.983 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-11T23:27:26.082 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:27:26.082 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-11T23:27:26.220 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:27:26.221 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-11T23:27:26.456 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:27:26.456 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-11T23:27:26.567 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:27:26.567 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-11T23:27:26.668 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:27:26.669 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-11T23:27:26.797 INFO:tasks.ceph:Archiving mon data... 2024-09-11T23:27:26.798 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901467/data/mon.a.tgz 2024-09-11T23:27:26.798 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2024-09-11T23:27:26.833 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.idru2uMUBZ 2024-09-11T23:27:26.834 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.idru2uMUBZ 2024-09-11T23:27:27.111 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.idru2uMUBZ 2024-09-11T23:27:27.209 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.idru2uMUBZ is 1MB 2024-09-11T23:27:27.310 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.idru2uMUBZ 2024-09-11T23:27:27.346 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901467/data/mon.b.tgz 2024-09-11T23:27:27.346 DEBUG:teuthology.orchestra.run.smithi165:> mktemp 2024-09-11T23:27:27.384 INFO:teuthology.orchestra.run.smithi165.stdout:/tmp/tmp.Lr9qudCbAX 2024-09-11T23:27:27.385 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Lr9qudCbAX 2024-09-11T23:27:27.680 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0666 /tmp/tmp.Lr9qudCbAX 2024-09-11T23:27:27.774 DEBUG:teuthology.orchestra.remote:smithi165:/tmp/tmp.Lr9qudCbAX is 1MB 2024-09-11T23:27:27.878 DEBUG:teuthology.orchestra.run.smithi165:> rm -fr /tmp/tmp.Lr9qudCbAX 2024-09-11T23:27:27.914 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901467/data/mon.c.tgz 2024-09-11T23:27:27.914 DEBUG:teuthology.orchestra.run.smithi165:> mktemp 2024-09-11T23:27:27.989 INFO:teuthology.orchestra.run.smithi165.stdout:/tmp/tmp.m4fTTb72Ll 2024-09-11T23:27:27.989 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.m4fTTb72Ll 2024-09-11T23:27:28.267 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0666 /tmp/tmp.m4fTTb72Ll 2024-09-11T23:27:28.361 DEBUG:teuthology.orchestra.remote:smithi165:/tmp/tmp.m4fTTb72Ll is 1MB 2024-09-11T23:27:28.464 DEBUG:teuthology.orchestra.run.smithi165:> rm -fr /tmp/tmp.m4fTTb72Ll 2024-09-11T23:27:28.500 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-11T23:27:28.500 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T23:27:28.504 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T23:27:28.633 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T23:27:28.669 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T23:27:28.670 INFO:tasks.ceph:Archiving crash dumps... 2024-09-11T23:27:28.671 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901467/remote/smithi144/crash 2024-09-11T23:27:28.672 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T23:27:28.729 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901467/remote/smithi165/crash 2024-09-11T23:27:28.730 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T23:27:28.784 INFO:tasks.ceph:Shutting down logrotate 2024-09-11T23:27:28.784 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:27:28.789 DEBUG:teuthology.orchestra.run.smithi165:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T23:27:28.902 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-11T23:27:28.957 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-11T23:27:29.012 INFO:tasks.ceph:Compressing logs... 2024-09-11T23:27:29.013 DEBUG:teuthology.orchestra.run.smithi144:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T23:27:29.017 DEBUG:teuthology.orchestra.run.smithi165:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T23:27:29.067 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-11T23:27:29.068 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65255.log 2024-09-11T23:27:29.068 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67208.log 2024-09-11T23:27:29.069 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.65255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53630.log 2024-09-11T23:27:29.069 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65255.log.gz 2024-09-11T23:27:29.071 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70059.log 2024-09-11T23:27:29.071 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67208.log.gz 2024-09-11T23:27:29.073 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36316.log 2024-09-11T23:27:29.073 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-11T23:27:29.074 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36316.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-11T23:27:29.074 INFO:teuthology.orchestra.run.smithi165.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36316.log.gz 2024-09-11T23:27:29.074 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41719.log 2024-09-11T23:27:29.074 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68759.log 2024-09-11T23:27:29.075 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53630.log.gz 2024-09-11T23:27:29.075 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.70059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56032.log 2024-09-11T23:27:29.075 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70059.log.gz 2024-09-11T23:27:29.075 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.68759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51915.log 2024-09-11T23:27:29.075 INFO:teuthology.orchestra.run.smithi144.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68759.log.gz 2024-09-11T23:27:29.075 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75568.log 2024-09-11T23:27:29.075 INFO:teuthology.orchestra.run.smithi144.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.56032.log.gz 2024-09-11T23:27:29.075 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51915.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51915.log.gz 2024-09-11T23:27:29.075 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67845.log 2024-09-11T23:27:29.078 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54200.log 2024-09-11T23:27:29.078 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75568.log.gz 2024-09-11T23:27:29.079 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40638.log 2024-09-11T23:27:29.079 INFO:teuthology.orchestra.run.smithi144.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67845.log.gz 2024-09-11T23:27:29.079 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70269.log 2024-09-11T23:27:29.079 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54200.log.gz 2024-09-11T23:27:29.079 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40638.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40638.log.gz 2024-09-11T23:27:29.079 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45127.log 2024-09-11T23:27:29.079 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36185.log 2024-09-11T23:27:29.080 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.1.41719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41719.log.gz 2024-09-11T23:27:29.080 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-11T23:27:29.080 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36185.log: gzip 87.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.36185.log.gz --verbose 2024-09-11T23:27:29.080 INFO:teuthology.orchestra.run.smithi165.stderr: -- /var/log/ceph/ceph-client.1.43208.log 2024-09-11T23:27:29.080 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T23:27:29.080 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.1.43208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43208.log.gz 2024-09-11T23:27:29.080 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44849.log 2024-09-11T23:27:29.080 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36236.log 2024-09-11T23:27:29.082 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.1.44849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44849.log.gz 2024-09-11T23:27:29.082 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-11T23:27:29.083 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45925.log 2024-09-11T23:27:29.083 INFO:teuthology.orchestra.run.smithi165.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36236.log.gz 2024-09-11T23:27:29.084 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.70269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59131.log 2024-09-11T23:27:29.084 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.70269.log.gz 2024-09-11T23:27:29.084 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57006.log 2024-09-11T23:27:29.084 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45127.log.gz 2024-09-11T23:27:29.085 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73291.log 2024-09-11T23:27:29.085 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59131.log.gz 2024-09-11T23:27:29.085 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57006.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57006.log.gz 2024-09-11T23:27:29.085 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46070.log 2024-09-11T23:27:29.085 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70101.log 2024-09-11T23:27:29.085 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.73291.log.gz 2024-09-11T23:27:29.085 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60078.log 2024-09-11T23:27:29.085 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46070.log.gz 2024-09-11T23:27:29.085 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.70101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50530.log 2024-09-11T23:27:29.085 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.70101.log.gz 2024-09-11T23:27:29.089 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47996.log 2024-09-11T23:27:29.089 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.1.45925.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46461.log 2024-09-11T23:27:29.089 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.1.45925.log.gz 2024-09-11T23:27:29.092 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.1.47996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47996.log.gz 2024-09-11T23:27:29.092 INFO:teuthology.orchestra.run.smithi165.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T23:27:29.092 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-11T23:27:29.092 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.1.46461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.46461.log.gz 2024-09-11T23:27:29.092 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-11T23:27:29.092 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T23:27:29.092 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60078.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60078.log.gz 2024-09-11T23:27:29.092 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54507.log 2024-09-11T23:27:29.093 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66405.log 2024-09-11T23:27:29.093 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50530.log.gz 2024-09-11T23:27:29.093 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77273.log 2024-09-11T23:27:29.093 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54507.log.gz 2024-09-11T23:27:29.093 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.66405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58761.log 2024-09-11T23:27:29.093 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66405.log.gz 2024-09-11T23:27:29.093 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77273.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.77273.log.gz 2024-09-11T23:27:29.093 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54889.log 2024-09-11T23:27:29.098 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36145.log 2024-09-11T23:27:29.098 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.36145.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-11T23:27:29.099 INFO:teuthology.orchestra.run.smithi165.stderr: 88.3%gzip -5 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T23:27:29.099 INFO:teuthology.orchestra.run.smithi165.stderr: --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-11T23:27:29.099 INFO:teuthology.orchestra.run.smithi165.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36145.log.gz 2024-09-11T23:27:29.099 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46952.log 2024-09-11T23:27:29.099 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.1.46952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.46952.log.gz 2024-09-11T23:27:29.101 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57567.log 2024-09-11T23:27:29.101 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58761.log.gz 2024-09-11T23:27:29.101 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54549.log 2024-09-11T23:27:29.101 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54889.log.gz 2024-09-11T23:27:29.101 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61542.log 2024-09-11T23:27:29.101 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57567.log.gz 2024-09-11T23:27:29.101 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54549.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54549.log.gz 2024-09-11T23:27:29.101 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45818.log 2024-09-11T23:27:29.102 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55353.log 2024-09-11T23:27:29.102 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61542.log.gz 2024-09-11T23:27:29.102 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66447.log 2024-09-11T23:27:29.102 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45818.log.gz 2024-09-11T23:27:29.102 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.55353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55353.log.gz 2024-09-11T23:27:29.102 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69624.log 2024-09-11T23:27:29.102 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.66447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72960.log 2024-09-11T23:27:29.102 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66447.log.gz 2024-09-11T23:27:29.102 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51053.log 2024-09-11T23:27:29.102 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69624.log.gz 2024-09-11T23:27:29.102 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47430.log 2024-09-11T23:27:29.102 INFO:teuthology.orchestra.run.smithi144.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72960.log.gz 2024-09-11T23:27:29.102 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67984.log 2024-09-11T23:27:29.102 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51053.log.gz 2024-09-11T23:27:29.103 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40170.log 2024-09-11T23:27:29.103 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47430.log.gz 2024-09-11T23:27:29.103 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76562.log 2024-09-11T23:27:29.103 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67984.log.gz 2024-09-11T23:27:29.103 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64957.log 2024-09-11T23:27:29.103 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40170.log.gz 2024-09-11T23:27:29.104 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36065.log 2024-09-11T23:27:29.104 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43740.log 2024-09-11T23:27:29.106 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68282.log 2024-09-11T23:27:29.106 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.76562.log.gz 2024-09-11T23:27:29.106 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64957.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64957.log.gz 2024-09-11T23:27:29.106 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57903.log 2024-09-11T23:27:29.106 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.68282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47118.log 2024-09-11T23:27:29.106 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68282.log.gz 2024-09-11T23:27:29.106 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58588.log 2024-09-11T23:27:29.107 INFO:teuthology.orchestra.run.smithi144.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57903.log.gz 2024-09-11T23:27:29.107 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47118.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47118.log.gz 2024-09-11T23:27:29.107 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45381.log 2024-09-11T23:27:29.107 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45425.log 2024-09-11T23:27:29.107 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58588.log.gz 2024-09-11T23:27:29.108 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45381.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.45381.log.gz 2024-09-11T23:27:29.108 INFO:teuthology.orchestra.run.smithi144.stderr: --verbose -- /var/log/ceph/ceph-client.admin.79209.log 2024-09-11T23:27:29.108 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75923.log 2024-09-11T23:27:29.108 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45425.log.gz 2024-09-11T23:27:29.111 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.79209.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.79209.log.gz --verbose 2024-09-11T23:27:29.111 INFO:teuthology.orchestra.run.smithi144.stderr: -- /var/log/ceph/ceph-client.admin.68026.log 2024-09-11T23:27:29.111 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70001.log 2024-09-11T23:27:29.111 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.75923.log.gz 2024-09-11T23:27:29.111 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.68026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45339.log 2024-09-11T23:27:29.111 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68026.log.gz 2024-09-11T23:27:29.112 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.1.43740.log: /var/log/ceph/ceph-client.admin.36065.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36065.log.gz 2024-09-11T23:27:29.112 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.1.43740.log.gz 2024-09-11T23:27:29.112 INFO:teuthology.orchestra.run.smithi165.stderr: -- /var/log/ceph/ceph-mon.b.log 2024-09-11T23:27:29.112 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42729.log 2024-09-11T23:27:29.113 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.70001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41525.log 2024-09-11T23:27:29.114 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70001.log.gz 2024-09-11T23:27:29.114 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45339.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45339.log.gz -5 2024-09-11T23:27:29.114 INFO:teuthology.orchestra.run.smithi144.stderr: --verbose -- /var/log/ceph/ceph-client.admin.60032.log 2024-09-11T23:27:29.114 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57969.log 2024-09-11T23:27:29.114 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41525.log.gz 2024-09-11T23:27:29.115 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60032.log: gzip -5 87.7% --verbose -- replaced with /var/log/ceph/ceph-client.admin.60032.log.gz -- 2024-09-11T23:27:29.115 INFO:teuthology.orchestra.run.smithi144.stderr: /var/log/ceph/ceph-client.admin.66199.log 2024-09-11T23:27:29.116 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-mon.b.log: gzip/var/log/ceph/ceph-client.1.42729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42729.log.gz 2024-09-11T23:27:29.116 INFO:teuthology.orchestra.run.smithi165.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36105.log 2024-09-11T23:27:29.116 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57969.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57969.log.gz 2024-09-11T23:27:29.116 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71420.log 2024-09-11T23:27:29.117 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.66199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73715.log 2024-09-11T23:27:29.117 INFO:teuthology.orchestra.run.smithi144.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.66199.log.gz 2024-09-11T23:27:29.117 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.71420.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71420.log.gz 2024-09-11T23:27:29.117 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.78915.log 2024-09-11T23:27:29.118 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73715.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73715.log.gz 2024-09-11T23:27:29.118 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59643.log 2024-09-11T23:27:29.119 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64433.log 2024-09-11T23:27:29.119 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78915.log.gz 2024-09-11T23:27:29.120 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47467.log 2024-09-11T23:27:29.120 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66895.log 2024-09-11T23:27:29.120 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59643.log.gz 2024-09-11T23:27:29.121 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75839.log 2024-09-11T23:27:29.121 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64433.log.gz 2024-09-11T23:27:29.121 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36105.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36105.log.gz 2024-09-11T23:27:29.122 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.66895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47659.log 2024-09-11T23:27:29.122 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66895.log.gz 2024-09-11T23:27:29.123 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46112.log 2024-09-11T23:27:29.123 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.75839.log.gz 2024-09-11T23:27:29.123 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47659.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47659.log.gz 2024-09-11T23:27:29.123 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47328.log 2024-09-11T23:27:29.124 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.1.47467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47467.log.gz 2024-09-11T23:27:29.125 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48563.log 2024-09-11T23:27:29.125 INFO:teuthology.orchestra.run.smithi144.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.46112.log.gz 2024-09-11T23:27:29.125 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47328.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47328.log.gz -5 2024-09-11T23:27:29.125 INFO:teuthology.orchestra.run.smithi144.stderr: --verbose -- /var/log/ceph/ceph-client.admin.59426.log 2024-09-11T23:27:29.126 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45382.log 2024-09-11T23:27:29.126 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48563.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48563.log.gz 2024-09-11T23:27:29.126 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47880.log 2024-09-11T23:27:29.127 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78831.log 2024-09-11T23:27:29.127 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59426.log.gz 2024-09-11T23:27:29.128 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56579.log 2024-09-11T23:27:29.128 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47880.log.gz 2024-09-11T23:27:29.129 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78831.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.78831.log.gz --verbose 2024-09-11T23:27:29.129 INFO:teuthology.orchestra.run.smithi144.stderr: -- /var/log/ceph/ceph-client.admin.57735.log 2024-09-11T23:27:29.130 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42134.log 2024-09-11T23:27:29.130 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.1.45382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45382.log.gz 2024-09-11T23:27:29.131 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57525.log 2024-09-11T23:27:29.131 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56579.log.gz 2024-09-11T23:27:29.131 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55868.log 2024-09-11T23:27:29.131 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57735.log.gz 2024-09-11T23:27:29.132 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75282.log 2024-09-11T23:27:29.132 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57525.log.gz 2024-09-11T23:27:29.133 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55868.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55868.log.gz 2024-09-11T23:27:29.133 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64650.log 2024-09-11T23:27:29.134 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70582.log 2024-09-11T23:27:29.134 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.75282.log.gz 2024-09-11T23:27:29.134 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44237.log 2024-09-11T23:27:29.135 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45025.log 2024-09-11T23:27:29.135 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64650.log.gz 2024-09-11T23:27:29.136 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.3.42134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42134.log.gz 2024-09-11T23:27:29.136 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.70582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60765.log 2024-09-11T23:27:29.136 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.70582.log.gz 2024-09-11T23:27:29.136 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73943.log 2024-09-11T23:27:29.137 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45025.log.gz 2024-09-11T23:27:29.137 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74195.log 2024-09-11T23:27:29.137 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60765.log.gz 2024-09-11T23:27:29.138 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73943.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73943.log.gz 2024-09-11T23:27:29.138 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50758.log 2024-09-11T23:27:29.140 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.1.44237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44237.log.gz 2024-09-11T23:27:29.140 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57216.log 2024-09-11T23:27:29.140 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74195.log.gz 2024-09-11T23:27:29.140 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78094.log 2024-09-11T23:27:29.140 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50758.log.gz 2024-09-11T23:27:29.141 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53182.log 2024-09-11T23:27:29.141 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57216.log.gz 2024-09-11T23:27:29.143 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36276.log 2024-09-11T23:27:29.143 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78094.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78094.log.gzgzip 2024-09-11T23:27:29.144 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.77231.log 2024-09-11T23:27:29.144 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53182.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53182.log.gz 2024-09-11T23:27:29.144 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55015.log 2024-09-11T23:27:29.145 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36356.log 2024-09-11T23:27:29.145 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60204.log 2024-09-11T23:27:29.145 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.77231.log.gz 2024-09-11T23:27:29.145 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78957.log 2024-09-11T23:27:29.145 INFO:teuthology.orchestra.run.smithi144.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55015.log.gz 2024-09-11T23:27:29.146 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36276.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36276.log.gz 2024-09-11T23:27:29.147 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60204.log: gzip -5 87.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.60204.log.gz 2024-09-11T23:27:29.147 INFO:teuthology.orchestra.run.smithi144.stderr: /var/log/ceph/ceph-client.admin.40852.log 2024-09-11T23:27:29.147 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78957.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-11T23:27:29.147 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.78957.log.gz 2024-09-11T23:27:29.148 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.36356.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36356.log.gz 2024-09-11T23:27:29.148 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50115.log 2024-09-11T23:27:29.149 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40852.log.gz 2024-09-11T23:27:29.149 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77152.log 2024-09-11T23:27:29.149 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54847.log 2024-09-11T23:27:29.150 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50115.log.gz 2024-09-11T23:27:29.150 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.77152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.77152.log.gz 2024-09-11T23:27:29.150 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59948.log 2024-09-11T23:27:29.151 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40726.log 2024-09-11T23:27:29.151 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54847.log.gz 2024-09-11T23:27:29.152 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68843.log 2024-09-11T23:27:29.153 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59948.log.gz 2024-09-11T23:27:29.153 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50614.log 2024-09-11T23:27:29.153 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40726.log.gz 2024-09-11T23:27:29.154 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.68843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59258.log 2024-09-11T23:27:29.154 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68843.log.gz 2024-09-11T23:27:29.155 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70624.log 2024-09-11T23:27:29.155 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50614.log.gz 2024-09-11T23:27:29.156 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64265.log 2024-09-11T23:27:29.156 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59258.log.gz 2024-09-11T23:27:29.157 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.70624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43825.log 2024-09-11T23:27:29.157 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70624.log.gz 2024-09-11T23:27:29.158 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46686.log 2024-09-11T23:27:29.158 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64265.log.gz 2024-09-11T23:27:29.159 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58157.log 2024-09-11T23:27:29.159 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43825.log.gz 2024-09-11T23:27:29.160 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46686.log: gzip 89.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.46686.log.gz --verbose 2024-09-11T23:27:29.160 INFO:teuthology.orchestra.run.smithi144.stderr: -- /var/log/ceph/ceph-client.admin.66283.log 2024-09-11T23:27:29.160 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.58157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58157.log.gz 2024-09-11T23:27:29.161 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78346.log 2024-09-11T23:27:29.161 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.66283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68885.log 2024-09-11T23:27:29.162 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66283.log.gz 2024-09-11T23:27:29.162 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48521.log 2024-09-11T23:27:29.163 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78346.log.gz 2024-09-11T23:27:29.163 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.68885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68114.log 88.9% 2024-09-11T23:27:29.163 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68885.log.gz 2024-09-11T23:27:29.164 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64773.log 2024-09-11T23:27:29.165 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48521.log.gz 2024-09-11T23:27:29.165 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.68114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48437.log 2024-09-11T23:27:29.165 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68114.log.gz 2024-09-11T23:27:29.166 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42508.log 2024-09-11T23:27:29.166 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64773.log.gz 2024-09-11T23:27:29.167 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44089.log 2024-09-11T23:27:29.167 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48437.log.gz 2024-09-11T23:27:29.168 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67418.log 2024-09-11T23:27:29.168 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42508.log.gz 2024-09-11T23:27:29.169 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50572.log 2024-09-11T23:27:29.169 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44089.log.gz 2024-09-11T23:27:29.170 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50801.log 2024-09-11T23:27:29.170 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67418.log.gz 2024-09-11T23:27:29.171 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50572.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50572.log.gz 2024-09-11T23:27:29.171 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40936.log 2024-09-11T23:27:29.172 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70498.log 2024-09-11T23:27:29.172 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50801.log.gz 2024-09-11T23:27:29.173 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49106.log 2024-09-11T23:27:29.173 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40936.log.gz 2024-09-11T23:27:29.174 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.70498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60644.log 2024-09-11T23:27:29.174 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.70498.log.gz 2024-09-11T23:27:29.175 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68408.log 2024-09-11T23:27:29.175 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49106.log.gz 2024-09-11T23:27:29.175 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.60644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60644.log.gz 2024-09-11T23:27:29.175 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40768.log 2024-09-11T23:27:29.176 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.68408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53069.log 2024-09-11T23:27:29.177 INFO:teuthology.orchestra.run.smithi144.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.68408.log.gz 2024-09-11T23:27:29.177 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40768.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40768.log.gz 2024-09-11T23:27:29.178 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69542.log 2024-09-11T23:27:29.178 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75797.log 2024-09-11T23:27:29.178 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53069.log.gz 2024-09-11T23:27:29.179 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52542.log 2024-09-11T23:27:29.179 INFO:teuthology.orchestra.run.smithi144.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.69542.log.gz 2024-09-11T23:27:29.180 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75797.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.75797.log.gz 2024-09-11T23:27:29.180 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.71093.log 2024-09-11T23:27:29.181 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55990.log 2024-09-11T23:27:29.181 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52542.log.gz 2024-09-11T23:27:29.182 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.71093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46571.log 2024-09-11T23:27:29.182 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71093.log.gz 2024-09-11T23:27:29.183 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76182.log 2024-09-11T23:27:29.183 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55990.log.gz 2024-09-11T23:27:29.184 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46571.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46571.log.gz 2024-09-11T23:27:29.184 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56831.log 2024-09-11T23:27:29.185 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73105.log 2024-09-11T23:27:29.185 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.76182.log.gz 2024-09-11T23:27:29.186 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48265.log 2024-09-11T23:27:29.186 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56831.log.gz 2024-09-11T23:27:29.187 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41536.log 2024-09-11T23:27:29.187 INFO:teuthology.orchestra.run.smithi144.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73105.log.gz 2024-09-11T23:27:29.188 INFO:teuthology.orchestra.run.smithi165.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-11T23:27:29.188 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48265.log: gzip -5 --verbose 88.4% -- -- replaced with /var/log/ceph/ceph-client.admin.48265.log.gz /var/log/ceph/ceph-client.admin.54679.log 2024-09-11T23:27:29.188 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-11T23:27:29.189 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46366.log 2024-09-11T23:27:29.189 INFO:teuthology.orchestra.run.smithi144.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41536.log.gz 2024-09-11T23:27:29.190 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54679.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54679.log.gzgzip 2024-09-11T23:27:29.190 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41104.log 2024-09-11T23:27:29.191 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.46366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46366.log.gz 2024-09-11T23:27:29.191 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53486.log 2024-09-11T23:27:29.192 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69829.log 87.7% 2024-09-11T23:27:29.192 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41104.log.gz 2024-09-11T23:27:29.193 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43921.log 2024-09-11T23:27:29.193 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53486.log.gz 2024-09-11T23:27:29.193 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69829.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.69829.log.gz 2024-09-11T23:27:29.194 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52961.log 2024-09-11T23:27:29.194 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56171.log 2024-09-11T23:27:29.195 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43921.log.gz 2024-09-11T23:27:29.195 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69296.log 2024-09-11T23:27:29.195 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52961.log.gz 2024-09-11T23:27:29.196 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56392.log 2024-09-11T23:27:29.196 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56171.log.gz 2024-09-11T23:27:29.197 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57651.log 85.8% 2024-09-11T23:27:29.197 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69296.log.gz 2024-09-11T23:27:29.198 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64137.log 2024-09-11T23:27:29.198 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56392.log.gz 2024-09-11T23:27:29.199 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49222.log 2024-09-11T23:27:29.199 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57651.log.gz 2024-09-11T23:27:29.200 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60390.log 2024-09-11T23:27:29.200 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64137.log.gz 2024-09-11T23:27:29.201 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58422.log 2024-09-11T23:27:29.201 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49222.log.gz 2024-09-11T23:27:29.201 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40472.log 2024-09-11T23:27:29.202 INFO:teuthology.orchestra.run.smithi144.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.60390.log.gz 2024-09-11T23:27:29.202 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58422.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.58422.log.gz 2024-09-11T23:27:29.203 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.75881.log 2024-09-11T23:27:29.203 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52644.log 2024-09-11T23:27:29.204 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40472.log.gz 2024-09-11T23:27:29.204 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41522.log 2024-09-11T23:27:29.204 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.75881.log.gz 2024-09-11T23:27:29.205 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75965.log 2024-09-11T23:27:29.205 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52644.log.gz 2024-09-11T23:27:29.206 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46529.log 2024-09-11T23:27:29.206 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41522.log.gz 2024-09-11T23:27:29.207 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42200.log 2024-09-11T23:27:29.207 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.75965.log.gz 2024-09-11T23:27:29.208 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69214.log 2024-09-11T23:27:29.208 INFO:teuthology.orchestra.run.smithi144.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46529.log.gz 2024-09-11T23:27:29.209 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41230.log 2024-09-11T23:27:29.209 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42200.log.gz 2024-09-11T23:27:29.210 INFO:teuthology.orchestra.run.smithi165.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-11T23:27:29.210 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50969.log 2024-09-11T23:27:29.210 INFO:teuthology.orchestra.run.smithi144.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.69214.log.gz 2024-09-11T23:27:29.211 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64730.log 2024-09-11T23:27:29.211 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41230.log.gz 2024-09-11T23:27:29.212 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50969.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50969.log.gz 2024-09-11T23:27:29.212 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47286.log 2024-09-11T23:27:29.212 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65447.log 2024-09-11T23:27:29.213 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64730.log.gz 2024-09-11T23:27:29.213 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40810.log 2024-09-11T23:27:29.213 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47286.log.gz 2024-09-11T23:27:29.214 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.65447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58236.log 2024-09-11T23:27:29.214 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65447.log.gz 2024-09-11T23:27:29.215 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40810.log: gzip -5 --verbose 88.8% -- -- replaced with /var/log/ceph/ceph-client.admin.40810.log.gz /var/log/ceph/ceph-client.admin.58819.log 2024-09-11T23:27:29.215 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-11T23:27:29.216 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77968.log 2024-09-11T23:27:29.216 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58236.log.gz 2024-09-11T23:27:29.217 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59342.log 2024-09-11T23:27:29.217 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58819.log.gz 2024-09-11T23:27:29.218 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54637.log 2024-09-11T23:27:29.218 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.77968.log.gz 2024-09-11T23:27:29.219 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50446.log 2024-09-11T23:27:29.219 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59342.log.gz 2024-09-11T23:27:29.220 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45650.log 2024-09-11T23:27:29.220 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54637.log.gz 2024-09-11T23:27:29.221 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51999.log 2024-09-11T23:27:29.221 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50446.log.gz 2024-09-11T23:27:29.221 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49991.log 2024-09-11T23:27:29.221 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45650.log.gz 2024-09-11T23:27:29.222 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51999.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51999.log.gzgzip 2024-09-11T23:27:29.222 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57483.log 2024-09-11T23:27:29.223 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67165.log 2024-09-11T23:27:29.223 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49991.log.gz 2024-09-11T23:27:29.224 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45860.log 2024-09-11T23:27:29.224 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57483.log.gz 2024-09-11T23:27:29.225 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52919.log 2024-09-11T23:27:29.225 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67165.log.gz 2024-09-11T23:27:29.226 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54973.log 2024-09-11T23:27:29.226 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45860.log.gz 2024-09-11T23:27:29.227 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55752.log 2024-09-11T23:27:29.227 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52919.log.gz 2024-09-11T23:27:29.228 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47575.log 2024-09-11T23:27:29.228 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54973.log.gz 2024-09-11T23:27:29.229 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55752.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55752.log.gz 2024-09-11T23:27:29.229 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74654.log 2024-09-11T23:27:29.230 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70143.log 2024-09-11T23:27:29.230 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47575.log.gz 2024-09-11T23:27:29.231 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41869.log 2024-09-11T23:27:29.231 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74654.log.gz 2024-09-11T23:27:29.232 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.70143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51480.log 2024-09-11T23:27:29.232 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.70143.log.gz 2024-09-11T23:27:29.232 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41869.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41869.log.gz 2024-09-11T23:27:29.233 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73231.log 2024-09-11T23:27:29.233 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65041.log 2024-09-11T23:27:29.234 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51480.log.gz 2024-09-11T23:27:29.234 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70803.log 2024-09-11T23:27:29.234 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73231.log.gz 2024-09-11T23:27:29.235 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.65041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56434.log 2024-09-11T23:27:29.235 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65041.log.gz 2024-09-11T23:27:29.236 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.70803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67105.log 2024-09-11T23:27:29.236 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70803.log.gz 2024-09-11T23:27:29.237 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54412.log 2024-09-11T23:27:29.237 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56434.log.gz 2024-09-11T23:27:29.238 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67105.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67105.log.gz 2024-09-11T23:27:29.238 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52421.log 2024-09-11T23:27:29.239 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71048.log 2024-09-11T23:27:29.239 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54412.log.gz 2024-09-11T23:27:29.240 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.52421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52421.log.gz 2024-09-11T23:27:29.240 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61688.log 2024-09-11T23:27:29.241 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.71048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67503.log 2024-09-11T23:27:29.241 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71048.log.gz 2024-09-11T23:27:29.242 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61688.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61688.log.gz -5 2024-09-11T23:27:29.242 INFO:teuthology.orchestra.run.smithi144.stderr: --verbose -- /var/log/ceph/ceph-client.admin.70414.log 2024-09-11T23:27:29.243 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72253.log 2024-09-11T23:27:29.243 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67503.log.gz 2024-09-11T23:27:29.244 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.70414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53402.log 2024-09-11T23:27:29.244 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.70414.log.gz 2024-09-11T23:27:29.245 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41272.log 2024-09-11T23:27:29.245 INFO:teuthology.orchestra.run.smithi144.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72253.log.gz 2024-09-11T23:27:29.246 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53402.log: gzip -5 --verbose 88.2% -- -- replaced with /var/log/ceph/ceph-client.admin.53402.log.gz /var/log/ceph/ceph-client.admin.79377.log 2024-09-11T23:27:29.246 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-11T23:27:29.247 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59029.log 2024-09-11T23:27:29.247 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41272.log.gz 2024-09-11T23:27:29.248 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.79377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74533.log 2024-09-11T23:27:29.248 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.79377.log.gz 2024-09-11T23:27:29.248 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75526.log 2024-09-11T23:27:29.249 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59029.log.gz 2024-09-11T23:27:29.249 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.74533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.74533.log.gz 2024-09-11T23:27:29.250 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76304.log 2024-09-11T23:27:29.251 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57861.log 2024-09-11T23:27:29.251 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75526.log.gz 2024-09-11T23:27:29.251 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56747.log 2024-09-11T23:27:29.252 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.76304.log.gz 2024-09-11T23:27:29.252 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73760.log 2024-09-11T23:27:29.253 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57861.log.gz 2024-09-11T23:27:29.253 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78873.log 2024-09-11T23:27:29.254 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56747.log.gz 2024-09-11T23:27:29.254 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72211.log 2024-09-11T23:27:29.255 INFO:teuthology.orchestra.run.smithi144.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73760.log.gz 2024-09-11T23:27:29.255 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57441.log 2024-09-11T23:27:29.255 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78873.log.gz 2024-09-11T23:27:29.256 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72211.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72211.log.gz 2024-09-11T23:27:29.256 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53883.log 2024-09-11T23:27:29.257 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45944.log 2024-09-11T23:27:29.257 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57441.log.gz 2024-09-11T23:27:29.258 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68366.log 2024-09-11T23:27:29.258 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53883.log.gz 2024-09-11T23:27:29.259 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49520.log 2024-09-11T23:27:29.259 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45944.log.gz 2024-09-11T23:27:29.260 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.68366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79335.log 2024-09-11T23:27:29.260 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68366.log.gz 2024-09-11T23:27:29.261 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49520.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.49520.log.gz 2024-09-11T23:27:29.261 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53757.log 2024-09-11T23:27:29.262 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.79335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68324.log 2024-09-11T23:27:29.262 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.79335.log.gz 2024-09-11T23:27:29.263 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49300.log 2024-09-11T23:27:29.263 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53757.log.gz 2024-09-11T23:27:29.264 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.68324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58861.log 2024-09-11T23:27:29.264 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68324.log.gz 2024-09-11T23:27:29.265 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49300.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49300.log.gz -5 2024-09-11T23:27:29.265 INFO:teuthology.orchestra.run.smithi144.stderr: --verbose -- /var/log/ceph/ceph-client.admin.65129.log 2024-09-11T23:27:29.266 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75610.log 2024-09-11T23:27:29.266 INFO:teuthology.orchestra.run.smithi144.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58861.log.gz 2024-09-11T23:27:29.267 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.65129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65339.log 2024-09-11T23:27:29.267 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65129.log.gz 2024-09-11T23:27:29.268 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68680.log 2024-09-11T23:27:29.268 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.75610.log.gz 2024-09-11T23:27:29.269 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.65339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78999.log 2024-09-11T23:27:29.269 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65339.log.gz 2024-09-11T23:27:29.270 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.68680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.68680.log.gz 2024-09-11T23:27:29.270 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75048.log 2024-09-11T23:27:29.271 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76478.log 2024-09-11T23:27:29.271 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.78999.log.gz 2024-09-11T23:27:29.271 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57609.log 2024-09-11T23:27:29.272 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75048.log.gz 2024-09-11T23:27:29.272 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69050.log 2024-09-11T23:27:29.272 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.76478.log.gz 2024-09-11T23:27:29.273 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51705.log 2024-09-11T23:27:29.273 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57609.log.gz 2024-09-11T23:27:29.274 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69050.log: gzip -5 --verbose -- 86.6% /var/log/ceph/ceph-client.admin.42208.log -- replaced with /var/log/ceph/ceph-client.admin.69050.log.gz 2024-09-11T23:27:29.274 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-11T23:27:29.275 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66979.log 2024-09-11T23:27:29.275 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51705.log.gz 2024-09-11T23:27:29.276 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49582.log 2024-09-11T23:27:29.276 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42208.log.gz 2024-09-11T23:27:29.277 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.66979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42550.log 2024-09-11T23:27:29.277 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66979.log.gz 2024-09-11T23:27:29.278 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67334.log 2024-09-11T23:27:29.278 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49582.log.gz 2024-09-11T23:27:29.279 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40596.log 2024-09-11T23:27:29.279 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42550.log.gz 2024-09-11T23:27:29.280 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57087.log 2024-09-11T23:27:29.280 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67334.log.gz 2024-09-11T23:27:29.281 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67250.log 2024-09-11T23:27:29.281 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40596.log.gz 2024-09-11T23:27:29.281 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41874.log 2024-09-11T23:27:29.282 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57087.log.gz 2024-09-11T23:27:29.282 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68068.log 2024-09-11T23:27:29.282 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67250.log.gz 2024-09-11T23:27:29.283 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74027.log 2024-09-11T23:27:29.283 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41874.log.gz 2024-09-11T23:27:29.284 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.68068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56663.log 2024-09-11T23:27:29.284 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68068.log.gz 2024-09-11T23:27:29.285 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74027.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74027.log.gz 2024-09-11T23:27:29.285 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43879.log 2024-09-11T23:27:29.286 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69460.log 2024-09-11T23:27:29.286 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56663.log.gz 2024-09-11T23:27:29.287 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43879.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43879.log.gz -5 2024-09-11T23:27:29.287 INFO:teuthology.orchestra.run.smithi144.stderr: --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T23:27:29.288 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69419.log 2024-09-11T23:27:29.288 INFO:teuthology.orchestra.run.smithi144.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.69460.log.gz 2024-09-11T23:27:29.289 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53715.log 2024-09-11T23:27:29.290 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69419.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69419.log.gz 2024-09-11T23:27:29.290 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44445.log 2024-09-11T23:27:29.291 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50927.log 2024-09-11T23:27:29.292 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53715.log.gz 2024-09-11T23:27:29.292 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65213.log 2024-09-11T23:27:29.292 INFO:teuthology.orchestra.run.smithi144.stderr: 89.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T23:27:29.293 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44445.log.gz 2024-09-11T23:27:29.293 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72708.log 2024-09-11T23:27:29.293 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50927.log.gz 2024-09-11T23:27:29.294 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.65213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69091.log 2024-09-11T23:27:29.294 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65213.log.gz 2024-09-11T23:27:29.295 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66937.log 2024-09-11T23:27:29.295 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72708.log.gz 2024-09-11T23:27:29.296 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63490.log 2024-09-11T23:27:29.296 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69091.log.gz 2024-09-11T23:27:29.297 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.66937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67598.log 88.8% 2024-09-11T23:27:29.297 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66937.log.gz 2024-09-11T23:27:29.298 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77315.log 2024-09-11T23:27:29.298 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63490.log.gz 2024-09-11T23:27:29.299 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63993.log 2024-09-11T23:27:29.299 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67598.log.gz 2024-09-11T23:27:29.300 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77315.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77315.log.gz 2024-09-11T23:27:29.300 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67063.log 2024-09-11T23:27:29.301 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63345.log 2024-09-11T23:27:29.301 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63993.log.gz 2024-09-11T23:27:29.302 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67063.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67063.log.gz 2024-09-11T23:27:29.302 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73897.log 2024-09-11T23:27:29.303 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54368.log 2024-09-11T23:27:29.303 INFO:teuthology.orchestra.run.smithi144.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63345.log.gz 2024-09-11T23:27:29.304 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73897.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73897.log.gz 2024-09-11T23:27:29.304 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75091.log 2024-09-11T23:27:29.305 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41528.log 2024-09-11T23:27:29.305 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54368.log.gz 2024-09-11T23:27:29.306 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48126.log 2024-09-11T23:27:29.306 INFO:teuthology.orchestra.run.smithi144.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.75091.log.gz 2024-09-11T23:27:29.307 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77653.log 2024-09-11T23:27:29.307 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41528.log.gz 2024-09-11T23:27:29.308 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54242.log 2024-09-11T23:27:29.308 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48126.log.gz 2024-09-11T23:27:29.309 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63825.log 2024-09-11T23:27:29.309 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77653.log.gz 2024-09-11T23:27:29.310 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35949.log 2024-09-11T23:27:29.310 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54242.log.gz 2024-09-11T23:27:29.310 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71188.log 88.3% 2024-09-11T23:27:29.311 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63825.log.gz 2024-09-11T23:27:29.312 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72375.log 2024-09-11T23:27:29.312 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35949.log.gz 2024-09-11T23:27:29.312 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.71188.log: gzip -5 --verbose 88.2% -- -- replaced with /var/log/ceph/ceph-client.admin.71188.log.gz /var/log/ceph/ceph-client.admin.53967.log 2024-09-11T23:27:29.313 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-11T23:27:29.313 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59766.log 2024-09-11T23:27:29.314 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.72375.log.gz 2024-09-11T23:27:29.314 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53967.log: gzip -5 --verbose 87.7% -- -- replaced with /var/log/ceph/ceph-client.admin.53967.log.gz /var/log/ceph/ceph-client.admin.48395.log 2024-09-11T23:27:29.314 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-11T23:27:29.315 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69255.log 2024-09-11T23:27:29.315 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59766.log.gz 2024-09-11T23:27:29.316 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48395.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48395.log.gz 2024-09-11T23:27:29.316 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48943.log 2024-09-11T23:27:29.317 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64077.log 2024-09-11T23:27:29.317 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69255.log.gz 2024-09-11T23:27:29.318 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.48943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48943.log.gz 2024-09-11T23:27:29.318 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76646.log 2024-09-11T23:27:29.319 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71546.log 2024-09-11T23:27:29.319 INFO:teuthology.orchestra.run.smithi144.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64077.log.gz 2024-09-11T23:27:29.320 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48479.log 2024-09-11T23:27:29.320 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.76646.log.gz 2024-09-11T23:27:29.321 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.71546.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71546.log.gz 2024-09-11T23:27:29.321 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48084.log 2024-09-11T23:27:29.322 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40554.log 2024-09-11T23:27:29.322 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48479.log.gz 2024-09-11T23:27:29.322 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60807.log 2024-09-11T23:27:29.323 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48084.log.gz 2024-09-11T23:27:29.323 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55930.log 2024-09-11T23:27:29.323 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40554.log.gz 2024-09-11T23:27:29.324 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53673.log 2024-09-11T23:27:29.324 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60807.log.gz 2024-09-11T23:27:29.325 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75755.log 2024-09-11T23:27:29.325 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55930.log.gz 2024-09-11T23:27:29.326 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65635.log 2024-09-11T23:27:29.326 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53673.log.gz 2024-09-11T23:27:29.327 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41538.log 2024-09-11T23:27:29.327 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.75755.log.gz 2024-09-11T23:27:29.328 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.65635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65635.log.gz 2024-09-11T23:27:29.328 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41859.log 2024-09-11T23:27:29.329 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61236.log 2024-09-11T23:27:29.329 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41538.log.gz 2024-09-11T23:27:29.329 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79041.log 2024-09-11T23:27:29.330 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41859.log.gz 2024-09-11T23:27:29.330 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78262.log 2024-09-11T23:27:29.331 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61236.log.gz 2024-09-11T23:27:29.331 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.79041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50251.log 2024-09-11T23:27:29.331 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.79041.log.gz 2024-09-11T23:27:29.332 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78262.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.78262.log.gz 2024-09-11T23:27:29.332 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79293.log 2024-09-11T23:27:29.333 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51873.log 2024-09-11T23:27:29.334 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50251.log.gz 2024-09-11T23:27:29.334 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.79293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75340.log 2024-09-11T23:27:29.334 INFO:teuthology.orchestra.run.smithi144.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.79293.log.gz 2024-09-11T23:27:29.335 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48307.log 2024-09-11T23:27:29.335 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51873.log.gz 2024-09-11T23:27:29.336 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75340.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.61067.log -- replaced with /var/log/ceph/ceph-client.admin.75340.log.gz 2024-09-11T23:27:29.336 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-11T23:27:29.337 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65171.log 2024-09-11T23:27:29.337 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48307.log.gz 2024-09-11T23:27:29.338 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64475.log 2024-09-11T23:27:29.338 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61067.log.gz 2024-09-11T23:27:29.339 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.65171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69173.log 2024-09-11T23:27:29.339 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65171.log.gz 2024-09-11T23:27:29.340 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77884.log 88.8% 2024-09-11T23:27:29.340 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64475.log.gz 2024-09-11T23:27:29.341 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45469.log 2024-09-11T23:27:29.341 INFO:teuthology.orchestra.run.smithi144.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.69173.log.gz 2024-09-11T23:27:29.341 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77884.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.77884.log.gz 2024-09-11T23:27:29.342 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73550.log 2024-09-11T23:27:29.342 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55814.log 2024-09-11T23:27:29.343 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45469.log.gz 2024-09-11T23:27:29.343 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57129.log 2024-09-11T23:27:29.343 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73550.log.gz 2024-09-11T23:27:29.344 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57777.log 2024-09-11T23:27:29.344 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55814.log.gz 2024-09-11T23:27:29.345 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59808.log 2024-09-11T23:27:29.345 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57129.log.gz 2024-09-11T23:27:29.346 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58548.log 2024-09-11T23:27:29.346 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57777.log.gz 2024-09-11T23:27:29.347 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56705.log 2024-09-11T23:27:29.347 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59808.log.gz 2024-09-11T23:27:29.348 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50885.log 2024-09-11T23:27:29.348 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58548.log.gz 2024-09-11T23:27:29.349 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56705.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56705.log.gz 2024-09-11T23:27:29.349 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59853.log 2024-09-11T23:27:29.350 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48605.log 2024-09-11T23:27:29.350 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50885.log.gz 2024-09-11T23:27:29.351 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45734.log 2024-09-11T23:27:29.351 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59853.log.gz 2024-09-11T23:27:29.351 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52233.log 2024-09-11T23:27:29.352 INFO:teuthology.orchestra.run.smithi144.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48605.log.gz 2024-09-11T23:27:29.352 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41531.log 88.3% 2024-09-11T23:27:29.352 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45734.log.gz 2024-09-11T23:27:29.353 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54721.log 2024-09-11T23:27:29.353 INFO:teuthology.orchestra.run.smithi144.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52233.log.gz 2024-09-11T23:27:29.354 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66241.log 2024-09-11T23:27:29.354 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41531.log.gz 2024-09-11T23:27:29.355 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59468.log 2024-09-11T23:27:29.355 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54721.log.gz 2024-09-11T23:27:29.356 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.66241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58462.log 2024-09-11T23:27:29.356 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66241.log.gz 2024-09-11T23:27:29.357 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59468.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59468.log.gz 2024-09-11T23:27:29.357 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59216.log 2024-09-11T23:27:29.358 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69501.log 2024-09-11T23:27:29.358 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58462.log.gz 2024-09-11T23:27:29.359 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59216.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59216.log.gz 2024-09-11T23:27:29.359 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61194.log 2024-09-11T23:27:29.360 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57260.log 2024-09-11T23:27:29.360 INFO:teuthology.orchestra.run.smithi144.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.69501.log.gz 2024-09-11T23:27:29.361 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61194.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61194.log.gz 2024-09-11T23:27:29.361 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53925.log 2024-09-11T23:27:29.362 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68240.log 2024-09-11T23:27:29.362 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57260.log.gz 2024-09-11T23:27:29.363 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53925.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53925.log.gz 2024-09-11T23:27:29.363 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46028.log 2024-09-11T23:27:29.364 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.68240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60983.log 2024-09-11T23:27:29.365 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68240.log.gz 2024-09-11T23:27:29.365 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46028.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.46028.log.gz 2024-09-11T23:27:29.365 INFO:teuthology.orchestra.run.smithi144.stderr: --verbose -- /var/log/ceph/ceph-client.admin.69009.log 2024-09-11T23:27:29.366 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35682.log 2024-09-11T23:27:29.367 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60983.log.gz 2024-09-11T23:27:29.367 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69009.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.69009.log.gz 2024-09-11T23:27:29.367 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45604.log 2024-09-11T23:27:29.368 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.35682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47701.log 2024-09-11T23:27:29.369 INFO:teuthology.orchestra.run.smithi144.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.35682.log.gz 2024-09-11T23:27:29.369 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45604.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45604.log.gz 2024-09-11T23:27:29.369 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73804.log 2024-09-11T23:27:29.370 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41188.log 2024-09-11T23:27:29.371 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47701.log.gz 2024-09-11T23:27:29.371 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73804.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73804.log.gz 2024-09-11T23:27:29.371 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73985.log 2024-09-11T23:27:29.372 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48689.log 2024-09-11T23:27:29.372 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41188.log.gz 2024-09-11T23:27:29.373 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51659.log 2024-09-11T23:27:29.373 INFO:teuthology.orchestra.run.smithi144.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73985.log.gz 2024-09-11T23:27:29.374 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56213.log 2024-09-11T23:27:29.375 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.48689.log.gz 2024-09-11T23:27:29.375 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44697.log 2024-09-11T23:27:29.375 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51659.log.gz 2024-09-11T23:27:29.376 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57693.log 2024-09-11T23:27:29.376 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56213.log.gz 2024-09-11T23:27:29.377 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74612.log 2024-09-11T23:27:29.377 INFO:teuthology.orchestra.run.smithi144.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44697.log.gz 2024-09-11T23:27:29.378 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79125.log 2024-09-11T23:27:29.378 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57693.log.gz 2024-09-11T23:27:29.379 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74612.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-11T23:27:29.379 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.74612.log.gz 2024-09-11T23:27:29.380 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.79125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54326.log 2024-09-11T23:27:29.380 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.79125.log.gz 2024-09-11T23:27:29.380 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44047.log 2024-09-11T23:27:29.381 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54326.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54326.log.gz 2024-09-11T23:27:29.382 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73147.log 2024-09-11T23:27:29.383 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51351.log 2024-09-11T23:27:29.383 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73147.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44047.log.gz 2024-09-11T23:27:29.384 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79083.log 2024-09-11T23:27:29.384 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73147.log.gz 2024-09-11T23:27:29.385 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51351.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51351.log.gz 2024-09-11T23:27:29.385 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54062.log 2024-09-11T23:27:29.386 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.79083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53570.log 2024-09-11T23:27:29.386 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.79083.log.gz 2024-09-11T23:27:29.387 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54062.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54062.log.gz 2024-09-11T23:27:29.388 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75204.log 2024-09-11T23:27:29.389 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44655.log 2024-09-11T23:27:29.389 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53570.log.gz 2024-09-11T23:27:29.390 INFO:teuthology.orchestra.run.smithi165.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-11T23:27:29.390 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51095.log 2024-09-11T23:27:29.390 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.75204.log.gz 2024-09-11T23:27:29.391 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76856.log 2024-09-11T23:27:29.391 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44655.log.gz 2024-09-11T23:27:29.392 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61584.log 2024-09-11T23:27:29.393 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76856.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51095.log.gz 2024-09-11T23:27:29.393 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59384.log 2024-09-11T23:27:29.393 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.76856.log.gz 2024-09-11T23:27:29.394 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57819.log 2024-09-11T23:27:29.395 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61584.log.gz 2024-09-11T23:27:29.395 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59384.log: gzip -5 --verbose -- 88.0% /var/log/ceph/ceph-client.admin.61806.log -- replaced with /var/log/ceph/ceph-client.admin.59384.log.gz 2024-09-11T23:27:29.396 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-11T23:27:29.396 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67933.log 2024-09-11T23:27:29.397 INFO:teuthology.orchestra.run.smithi144.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.57819.log.gz/var/log/ceph/ceph-client.admin.61806.log: 2024-09-11T23:27:29.398 INFO:teuthology.orchestra.run.smithi144.stderr:gzip 88.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.61806.log.gz --verbose 2024-09-11T23:27:29.398 INFO:teuthology.orchestra.run.smithi144.stderr: -- /var/log/ceph/ceph-client.admin.47202.log 2024-09-11T23:27:29.399 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67933.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67933.log.gz 2024-09-11T23:27:29.399 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61626.log 2024-09-11T23:27:29.400 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71588.log 2024-09-11T23:27:29.400 INFO:teuthology.orchestra.run.smithi144.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47202.log.gz 2024-09-11T23:27:29.401 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75442.log 2024-09-11T23:27:29.401 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61626.log.gz 2024-09-11T23:27:29.402 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.71588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49911.log 2024-09-11T23:27:29.402 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.71588.log.gz 2024-09-11T23:27:29.403 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65381.log 2024-09-11T23:27:29.404 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.75442.log.gz 2024-09-11T23:27:29.404 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69923.log 2024-09-11T23:27:29.404 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49911.log.gz 2024-09-11T23:27:29.405 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.65381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70185.log 2024-09-11T23:27:29.406 INFO:teuthology.orchestra.run.smithi144.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.65381.log.gz 2024-09-11T23:27:29.406 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78747.log 2024-09-11T23:27:29.407 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69923.log.gz 2024-09-11T23:27:29.408 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.70185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78304.log 2024-09-11T23:27:29.408 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.70185.log.gz 2024-09-11T23:27:29.409 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78747.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.78747.log.gz 2024-09-11T23:27:29.409 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52741.log 2024-09-11T23:27:29.410 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74279.log 2024-09-11T23:27:29.410 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.78304.log.gz 2024-09-11T23:27:29.411 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41533.log 2024-09-11T23:27:29.411 INFO:teuthology.orchestra.run.smithi144.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52741.log.gz 2024-09-11T23:27:29.412 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41356.log 2024-09-11T23:27:29.413 INFO:teuthology.orchestra.run.smithi144.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.74279.log.gz 2024-09-11T23:27:29.413 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57353.log 2024-09-11T23:27:29.414 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41533.log.gz 2024-09-11T23:27:29.414 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60162.log 2024-09-11T23:27:29.415 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41356.log.gz 2024-09-11T23:27:29.416 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60456.log 2024-09-11T23:27:29.416 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57353.log.gz 2024-09-11T23:27:29.417 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60162.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60162.log.gz 2024-09-11T23:27:29.417 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48755.log 2024-09-11T23:27:29.418 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52125.log 2024-09-11T23:27:29.418 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60456.log.gz 2024-09-11T23:27:29.419 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69706.log 2024-09-11T23:27:29.419 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48755.log.gz 2024-09-11T23:27:29.420 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52125.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52125.log.gz 2024-09-11T23:27:29.420 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78136.log 2024-09-11T23:27:29.421 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52858.log 2024-09-11T23:27:29.421 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78136.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.69706.log.gz 2024-09-11T23:27:29.422 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55474.log 2024-09-11T23:27:29.422 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.78136.log.gz 2024-09-11T23:27:29.423 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52858.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52858.log.gz 2024-09-11T23:27:29.423 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46803.log 2024-09-11T23:27:29.424 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42104.log 2024-09-11T23:27:29.425 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6%/var/log/ceph/ceph-client.admin.46803.log: -- replaced with /var/log/ceph/ceph-client.admin.55474.log.gz 2024-09-11T23:27:29.425 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66852.log 2024-09-11T23:27:29.426 INFO:teuthology.orchestra.run.smithi144.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46803.log.gz 2024-09-11T23:27:29.427 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42104.log: gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.69747.log -- replaced with /var/log/ceph/ceph-client.admin.42104.log.gz 2024-09-11T23:27:29.427 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-11T23:27:29.427 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.66852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76688.log 2024-09-11T23:27:29.428 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69747.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66852.log.gz 2024-09-11T23:27:29.429 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- 87.1% /var/log/ceph/ceph-client.admin.78789.log -- replaced with /var/log/ceph/ceph-client.admin.69747.log.gz 2024-09-11T23:27:29.429 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-11T23:27:29.430 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76688.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76688.log.gz 2024-09-11T23:27:29.430 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47617.log 2024-09-11T23:27:29.431 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58903.log 2024-09-11T23:27:29.432 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47617.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.78789.log.gz 2024-09-11T23:27:29.432 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47960.log 2024-09-11T23:27:29.432 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47617.log.gz 2024-09-11T23:27:29.433 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58903.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58903.log.gz 2024-09-11T23:27:29.434 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77575.log 2024-09-11T23:27:29.434 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76964.log 2024-09-11T23:27:29.435 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77575.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47960.log.gz 2024-09-11T23:27:29.436 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77514.log 2024-09-11T23:27:29.436 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.77575.log.gz 2024-09-11T23:27:29.437 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44368.log 2024-09-11T23:27:29.437 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76964.log.gz 2024-09-11T23:27:29.438 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79251.log 2024-09-11T23:27:29.438 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.77514.log.gz 2024-09-11T23:27:29.439 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73189.log 2024-09-11T23:27:29.439 INFO:teuthology.orchestra.run.smithi144.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44368.log.gz 2024-09-11T23:27:29.440 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.79251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41146.log 2024-09-11T23:27:29.440 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.79251.log.gz 2024-09-11T23:27:29.441 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73189.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73189.log.gz 2024-09-11T23:27:29.441 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47160.log 2024-09-11T23:27:29.442 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44739.log 2024-09-11T23:27:29.443 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47160.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41146.log.gz 2024-09-11T23:27:29.444 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47785.log 2024-09-11T23:27:29.444 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47160.log.gz 2024-09-11T23:27:29.445 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75484.log 2024-09-11T23:27:29.445 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44739.log.gz 2024-09-11T23:27:29.446 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42202.log 2024-09-11T23:27:29.446 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75484.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47785.log.gz 2024-09-11T23:27:29.447 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.75484.log.gz 2024-09-11T23:27:29.447 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.77926.log 2024-09-11T23:27:29.448 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42202.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42202.log.gz 2024-09-11T23:27:29.448 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76814.log 2024-09-11T23:27:29.449 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56350.log 2024-09-11T23:27:29.449 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.77926.log.gz 2024-09-11T23:27:29.450 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76814.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.76814.log.gz 2024-09-11T23:27:29.450 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45692.log 2024-09-11T23:27:29.451 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56350.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56350.log.gz 2024-09-11T23:27:29.451 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71504.log 2024-09-11T23:27:29.452 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64906.log 2024-09-11T23:27:29.453 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.71504.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45692.log.gz 2024-09-11T23:27:29.453 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-11T23:27:29.454 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71504.log.gz 2024-09-11T23:27:29.454 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63575.log 2024-09-11T23:27:29.455 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64906.log.gz 2024-09-11T23:27:29.456 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67021.log 2024-09-11T23:27:29.457 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69583.log 2024-09-11T23:27:29.457 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63575.log.gz 2024-09-11T23:27:29.458 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60849.log 2024-09-11T23:27:29.458 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67021.log.gz 2024-09-11T23:27:29.459 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58338.log 2024-09-11T23:27:29.459 INFO:teuthology.orchestra.run.smithi144.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.69583.log.gz 2024-09-11T23:27:29.461 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51524.log 2024-09-11T23:27:29.461 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60849.log.gz 2024-09-11T23:27:29.462 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59897.log 2024-09-11T23:27:29.462 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58338.log.gz 2024-09-11T23:27:29.463 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68801.log 2024-09-11T23:27:29.463 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51524.log.gz 2024-09-11T23:27:29.464 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75713.log 2024-09-11T23:27:29.464 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59897.log.gz 2024-09-11T23:27:29.465 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.68801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64181.log 2024-09-11T23:27:29.466 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68801.log.gz 2024-09-11T23:27:29.467 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71696.log 2024-09-11T23:27:29.467 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.75713.log.gz 2024-09-11T23:27:29.468 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58278.log 2024-09-11T23:27:29.468 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64181.log.gz 2024-09-11T23:27:29.469 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.71696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41537.log 2024-09-11T23:27:29.469 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71696.log.gz 2024-09-11T23:27:29.470 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45213.log 2024-09-11T23:27:29.470 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58278.log.gz 2024-09-11T23:27:29.471 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41857.log 2024-09-11T23:27:29.472 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41537.log.gz 2024-09-11T23:27:29.473 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72834.log 2024-09-11T23:27:29.473 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45213.log.gz 2024-09-11T23:27:29.474 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46445.log 2024-09-11T23:27:29.474 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41857.log.gz 2024-09-11T23:27:29.475 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51190.log 2024-09-11T23:27:29.475 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.72834.log.gz 2024-09-11T23:27:29.476 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76898.log 2024-09-11T23:27:29.476 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46445.log.gz 2024-09-11T23:27:29.477 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64862.log 2024-09-11T23:27:29.478 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51190.log.gz 2024-09-11T23:27:29.479 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66794.log 2024-09-11T23:27:29.479 INFO:teuthology.orchestra.run.smithi144.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.76898.log.gz 2024-09-11T23:27:29.480 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45776.log 2024-09-11T23:27:29.480 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64862.log.gz 2024-09-11T23:27:29.481 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.66794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46887.log 2024-09-11T23:27:29.481 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66794.log.gz 2024-09-11T23:27:29.482 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70666.log 2024-09-11T23:27:29.482 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45776.log.gz 2024-09-11T23:27:29.484 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56621.log 2024-09-11T23:27:29.484 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46887.log.gz 2024-09-11T23:27:29.485 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.70666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64999.log 2024-09-11T23:27:29.485 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70666.log.gz 2024-09-11T23:27:29.486 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67678.log 2024-09-11T23:27:29.486 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56621.log.gz 2024-09-11T23:27:29.487 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70883.log 2024-09-11T23:27:29.487 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64999.log.gz 2024-09-11T23:27:29.488 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60288.log 2024-09-11T23:27:29.489 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67678.log.gz 2024-09-11T23:27:29.489 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.70883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58683.log 2024-09-11T23:27:29.490 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70883.log.gz 2024-09-11T23:27:29.491 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70456.log 2024-09-11T23:27:29.491 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60288.log.gz 2024-09-11T23:27:29.492 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69788.log 2024-09-11T23:27:29.492 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58683.log.gz 2024-09-11T23:27:29.493 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.70456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76604.log 2024-09-11T23:27:29.493 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70456.log.gz 2024-09-11T23:27:29.494 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76772.log 2024-09-11T23:27:29.494 INFO:teuthology.orchestra.run.smithi144.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.69788.log.gz 2024-09-11T23:27:29.495 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51789.log 2024-09-11T23:27:29.496 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.76604.log.gz 2024-09-11T23:27:29.497 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44005.log 2024-09-11T23:27:29.497 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76772.log.gz 2024-09-11T23:27:29.498 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66558.log 2024-09-11T23:27:29.498 INFO:teuthology.orchestra.run.smithi144.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51789.log.gz 2024-09-11T23:27:29.499 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73673.log 2024-09-11T23:27:29.499 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44005.log.gz 2024-09-11T23:27:29.500 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.66558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59563.log 2024-09-11T23:27:29.501 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66558.log.gz 2024-09-11T23:27:29.502 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73063.log 2024-09-11T23:27:29.502 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73673.log.gz 2024-09-11T23:27:29.503 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59563.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-11T23:27:29.503 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59563.log.gz 2024-09-11T23:27:29.504 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68968.log 2024-09-11T23:27:29.504 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73063.log.gz 2024-09-11T23:27:29.505 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43649.log 2024-09-11T23:27:29.506 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.68968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45520.log 2024-09-11T23:27:29.506 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68968.log.gz 2024-09-11T23:27:29.507 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.2.43649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43649.log.gz 2024-09-11T23:27:29.508 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58945.log 2024-09-11T23:27:29.509 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49342.log 2024-09-11T23:27:29.509 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45520.log.gz 2024-09-11T23:27:29.510 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53003.log 2024-09-11T23:27:29.510 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58945.log.gz 2024-09-11T23:27:29.512 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49342.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49342.log.gz 2024-09-11T23:27:29.512 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76102.log 2024-09-11T23:27:29.513 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53003.log.gz 2024-09-11T23:27:29.513 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55099.log 2024-09-11T23:27:29.515 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74153.log 2024-09-11T23:27:29.515 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.76102.log.gz 2024-09-11T23:27:29.516 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53528.log 2024-09-11T23:27:29.517 INFO:teuthology.orchestra.run.smithi144.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.55099.log.gz 2024-09-11T23:27:29.517 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76262.log 2024-09-11T23:27:29.517 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.74153.log.gz 2024-09-11T23:27:29.519 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72792.log 2024-09-11T23:27:29.519 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53528.log.gz 2024-09-11T23:27:29.520 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42466.log 2024-09-11T23:27:29.520 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.76262.log.gz 2024-09-11T23:27:29.522 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72792.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72792.log.gz 2024-09-11T23:27:29.522 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42466.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42466.log.gz 2024-09-11T23:27:29.523 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40894.log 2024-09-11T23:27:29.524 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57311.log 2024-09-11T23:27:29.525 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42206.log 2024-09-11T23:27:29.525 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40894.log.gz 2024-09-11T23:27:29.527 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57311.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57311.log.gz 2024-09-11T23:27:29.527 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45171.log 2024-09-11T23:27:29.528 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42206.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42206.log.gz 2024-09-11T23:27:29.528 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74069.log 2024-09-11T23:27:29.530 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48353.log 2024-09-11T23:27:29.530 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45171.log.gz 2024-09-11T23:27:29.531 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74069.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.74069.log.gz 2024-09-11T23:27:29.531 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51011.log 2024-09-11T23:27:29.532 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70371.log 2024-09-11T23:27:29.533 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48353.log.gz 2024-09-11T23:27:29.534 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5/var/log/ceph/ceph-client.admin.51011.log: --verbose -- /var/log/ceph/ceph-client.admin.64349.log 2024-09-11T23:27:29.534 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51011.log.gz 2024-09-11T23:27:29.535 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.70371.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.70371.log.gz 2024-09-11T23:27:29.535 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49662.log 2024-09-11T23:27:29.537 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69132.log 2024-09-11T23:27:29.537 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64349.log.gz 2024-09-11T23:27:29.538 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72750.log 2024-09-11T23:27:29.538 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49662.log.gz 2024-09-11T23:27:29.539 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69132.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.69132.log.gz 2024-09-11T23:27:29.540 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55165.log 2024-09-11T23:27:29.540 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.72750.log.gz 2024-09-11T23:27:29.541 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74968.log 2024-09-11T23:27:29.542 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68198.log 2024-09-11T23:27:29.542 INFO:teuthology.orchestra.run.smithi144.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.55165.log.gz 2024-09-11T23:27:29.543 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74968.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.74968.log.gz 2024-09-11T23:27:29.544 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51831.log 2024-09-11T23:27:29.545 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.68198.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48647.log 2024-09-11T23:27:29.545 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68198.log.gz 2024-09-11T23:27:29.546 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50177.log 2024-09-11T23:27:29.546 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51831.log.gz 2024-09-11T23:27:29.547 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48647.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48647.log.gz 2024-09-11T23:27:29.548 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55516.log 2024-09-11T23:27:29.548 INFO:teuthology.orchestra.run.smithi165.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-11T23:27:29.549 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50177.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50177.log.gz 2024-09-11T23:27:29.549 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63303.log 2024-09-11T23:27:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55516.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55516.log.gz 2024-09-11T23:27:29.551 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54763.log 2024-09-11T23:27:29.552 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63303.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50843.log 2024-09-11T23:27:29.553 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63303.log.gz 2024-09-11T23:27:29.554 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70540.log 2024-09-11T23:27:29.554 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54763.log.gz 2024-09-11T23:27:29.555 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50843.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50843.log.gz 2024-09-11T23:27:29.555 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49404.log 2024-09-11T23:27:29.556 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.70540.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70540.log.gz 2024-09-11T23:27:29.557 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-11T23:27:29.558 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42634.log 2024-09-11T23:27:29.558 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49404.log.gz 2024-09-11T23:27:29.559 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78705.log 2024-09-11T23:27:29.560 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42634.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42634.log.gz 2024-09-11T23:27:29.561 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.78705.log: /var/log/ceph/ceph-client.admin.49458.log 2024-09-11T23:27:29.562 INFO:teuthology.orchestra.run.smithi144.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.78705.log.gz 2024-09-11T23:27:29.563 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51393.log 2024-09-11T23:27:29.564 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49458.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49458.log.gz 2024-09-11T23:27:29.565 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55432.log 2024-09-11T23:27:29.565 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51393.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51393.log.gz 2024-09-11T23:27:29.566 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72417.log 2024-09-11T23:27:29.567 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55432.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55432.log.gz 2024-09-11T23:27:29.568 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72047.log/var/log/ceph/ceph-client.admin.72417.log: 2024-09-11T23:27:29.569 INFO:teuthology.orchestra.run.smithi144.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.72417.log.gz 2024-09-11T23:27:29.570 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49724.log 2024-09-11T23:27:29.571 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72047.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72047.log.gz 2024-09-11T23:27:29.572 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75400.log 2024-09-11T23:27:29.572 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49724.log.gz 2024-09-11T23:27:29.574 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49022.log 2024-09-11T23:27:29.575 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75400.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.75400.log.gz 2024-09-11T23:27:29.576 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61152.log 2024-09-11T23:27:29.576 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49022.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49022.log.gz 2024-09-11T23:27:29.577 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49148.log 2024-09-11T23:27:29.578 INFO:teuthology.orchestra.run.smithi165.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-11T23:27:29.578 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61152.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61152.log.gz 2024-09-11T23:27:29.579 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49148.log: -- /var/log/ceph/ceph-client.admin.68474.log 2024-09-11T23:27:29.580 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49148.log.gz 2024-09-11T23:27:29.581 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58380.log 2024-09-11T23:27:29.582 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.68474.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68474.log.gz 2024-09-11T23:27:29.583 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64816.log 2024-09-11T23:27:29.583 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58380.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58380.log.gz 2024-09-11T23:27:29.584 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78621.log 2024-09-11T23:27:29.585 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64816.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64816.log.gz 2024-09-11T23:27:29.586 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.78621.log: /var/log/ceph/ceph-client.admin.74738.log 2024-09-11T23:27:29.587 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78621.log.gz 2024-09-11T23:27:29.588 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51575.log 2024-09-11T23:27:29.589 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74738.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.74738.log.gz 2024-09-11T23:27:29.590 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T23:27:29.591 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51575.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51575.log.gz 2024-09-11T23:27:29.591 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41872.log 2024-09-11T23:27:29.593 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.41872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60246.log 2024-09-11T23:27:29.595 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63387.log 2024-09-11T23:27:29.595 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41872.log.gz 2024-09-11T23:27:29.596 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60246.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60246.log.gz 2024-09-11T23:27:29.597 INFO:teuthology.orchestra.run.smithi144.stderr: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T23:27:29.598 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70227.log 2024-09-11T23:27:29.600 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63387.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63387.log.gz 2024-09-11T23:27:29.600 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5/var/log/ceph/ceph-client.admin.70227.log: --verbose -- /var/log/ceph/ceph-client.admin.44571.log 2024-09-11T23:27:29.600 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70227.log.gz 2024-09-11T23:27:29.601 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55057.log 2024-09-11T23:27:29.603 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44571.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44571.log.gz 2024-09-11T23:27:29.603 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68156.log 2024-09-11T23:27:29.604 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55057.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55057.log.gz 2024-09-11T23:27:29.605 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71884.log 2024-09-11T23:27:29.606 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.68156.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68156.log.gz 2024-09-11T23:27:29.607 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59174.log 2024-09-11T23:27:29.607 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.71884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.71884.log.gz 2024-09-11T23:27:29.608 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51270.log 2024-09-11T23:27:29.610 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59174.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59174.log.gz 2024-09-11T23:27:29.610 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50656.log 2024-09-11T23:27:29.611 INFO:teuthology.orchestra.run.smithi144.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51270.log.gz 2024-09-11T23:27:29.612 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51435.log 2024-09-11T23:27:29.613 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50656.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50656.log.gz 2024-09-11T23:27:29.614 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78579.log 2024-09-11T23:27:29.614 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51435.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51435.log.gz 2024-09-11T23:27:29.615 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73020.log 2024-09-11T23:27:29.616 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78579.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78579.log.gz 2024-09-11T23:27:29.617 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41062.log 2024-09-11T23:27:29.618 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73020.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73020.log.gz 2024-09-11T23:27:29.618 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58508.log 2024-09-11T23:27:29.620 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41062.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41062.log.gz 2024-09-11T23:27:29.621 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58508.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58508.log.gz 2024-09-11T23:27:29.622 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72089.log 2024-09-11T23:27:29.622 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49786.log 2024-09-11T23:27:29.624 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72089.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.72089.log.gz 2024-09-11T23:27:29.625 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49786.log: -- /var/log/ceph/ceph-client.admin.63767.log 2024-09-11T23:27:29.625 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49786.log.gz 2024-09-11T23:27:29.627 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63767.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63767.log.gz 2024-09-11T23:27:29.627 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53318.log 2024-09-11T23:27:29.629 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64035.log 2024-09-11T23:27:29.630 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53318.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53318.log.gz 2024-09-11T23:27:29.631 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73631.log 2024-09-11T23:27:29.632 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64035.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64035.log.gz 2024-09-11T23:27:29.632 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42592.log 2024-09-11T23:27:29.633 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73631.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73631.log.gz 2024-09-11T23:27:29.635 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42592.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42592.log.gz 2024-09-11T23:27:29.635 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54456.log 2024-09-11T23:27:29.637 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47515.log 2024-09-11T23:27:29.638 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54456.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54456.log.gz 2024-09-11T23:27:29.639 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63909.log 2024-09-11T23:27:29.639 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47515.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47515.log.gz 2024-09-11T23:27:29.640 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45902.log 2024-09-11T23:27:29.647 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63909.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63909.log.gz 2024-09-11T23:27:29.647 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42856.log/var/log/ceph/ceph-client.admin.45902.log: 2024-09-11T23:27:29.647 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45902.log.gz 2024-09-11T23:27:29.647 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52041.log 2024-09-11T23:27:29.647 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42856.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42856.log.gz 2024-09-11T23:27:29.648 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.52041.log: /var/log/ceph/ceph-client.admin.78220.log 2024-09-11T23:27:29.648 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52041.log.gz 2024-09-11T23:27:29.648 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41860.log 2024-09-11T23:27:29.649 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78220.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.78220.log.gz 2024-09-11T23:27:29.649 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40376.log 2024-09-11T23:27:29.650 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41860.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41860.log.gz 2024-09-11T23:27:29.651 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65858.log 2024-09-11T23:27:29.652 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40376.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40376.log.gz 2024-09-11T23:27:29.653 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53360.log/var/log/ceph/ceph-client.admin.65858.log: 2024-09-11T23:27:29.656 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65858.log.gz 2024-09-11T23:27:29.656 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45297.log 2024-09-11T23:27:29.656 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53360.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53360.log.gz 2024-09-11T23:27:29.656 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.45297.log: /var/log/ceph/ceph-client.admin.78537.log 2024-09-11T23:27:29.657 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45297.log.gz 2024-09-11T23:27:29.658 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77357.log 2024-09-11T23:27:29.660 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78537.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78537.log.gz 2024-09-11T23:27:29.660 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63429.log 2024-09-11T23:27:29.660 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77357.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.77357.log.gz 2024-09-11T23:27:29.661 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53444.log 2024-09-11T23:27:29.662 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63429.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63429.log.gz 2024-09-11T23:27:29.663 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64570.log/var/log/ceph/ceph-client.admin.53444.log: 2024-09-11T23:27:29.664 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53444.log.gz 2024-09-11T23:27:29.665 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48170.log 2024-09-11T23:27:29.666 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64570.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64570.log.gz 2024-09-11T23:27:29.667 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41314.log 2024-09-11T23:27:29.667 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48170.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48170.log.gz 2024-09-11T23:27:29.668 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63689.log 2024-09-11T23:27:29.670 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41314.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41314.log.gz 2024-09-11T23:27:29.671 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45255.log 2024-09-11T23:27:29.671 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63689.log.gz 2024-09-11T23:27:29.672 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61110.log 2024-09-11T23:27:29.673 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45255.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45255.log.gz 2024-09-11T23:27:29.674 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72314.log 2024-09-11T23:27:29.675 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61110.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61110.log.gz 2024-09-11T23:27:29.676 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74345.log 2024-09-11T23:27:29.677 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72314.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72314.log.gz 2024-09-11T23:27:29.678 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63867.log 2024-09-11T23:27:29.678 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74345.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.74345.log.gz 2024-09-11T23:27:29.679 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45067.log 2024-09-11T23:27:29.681 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63867.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63867.log.gz 2024-09-11T23:27:29.681 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47370.log 2024-09-11T23:27:29.682 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45067.log.gz 2024-09-11T23:27:29.683 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54805.log 2024-09-11T23:27:29.684 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47370.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47370.log.gz 2024-09-11T23:27:29.685 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54805.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54805.log.gz 2024-09-11T23:27:29.686 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79167.log 2024-09-11T23:27:29.687 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66325.log 2024-09-11T23:27:29.688 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.79167.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.79167.log.gz 2024-09-11T23:27:29.689 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59990.log 2024-09-11T23:27:29.690 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.66325.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66325.log.gz 2024-09-11T23:27:29.691 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78178.log 2024-09-11T23:27:29.691 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59990.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59990.log.gz 2024-09-11T23:27:29.692 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60723.log 2024-09-11T23:27:29.693 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78178.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.78178.log.gz 2024-09-11T23:27:29.694 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45986.log 2024-09-11T23:27:29.695 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60723.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60723.log.gz 2024-09-11T23:27:29.696 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43783.log 2024-09-11T23:27:29.697 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.45986.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45986.log.gz 2024-09-11T23:27:29.697 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73375.log 2024-09-11T23:27:29.699 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43783.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43783.log.gz 2024-09-11T23:27:29.700 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73375.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.73375.log.gz 2024-09-11T23:27:29.700 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64223.log 2024-09-11T23:27:29.702 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74237.log 2024-09-11T23:27:29.703 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64223.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64223.log.gz 2024-09-11T23:27:29.704 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56537.log 2024-09-11T23:27:29.705 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74237.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74237.log.gz 2024-09-11T23:27:29.705 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59300.log 2024-09-11T23:27:29.707 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56537.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56537.log.gz 2024-09-11T23:27:29.707 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47473.log/var/log/ceph/ceph-client.admin.59300.log: 2024-09-11T23:27:29.708 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59300.log.gz 2024-09-11T23:27:29.709 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61730.log 2024-09-11T23:27:29.710 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47473.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47473.log.gz 2024-09-11T23:27:29.711 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44487.log 2024-09-11T23:27:29.712 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61730.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61730.log.gz 2024-09-11T23:27:29.713 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76392.log 2024-09-11T23:27:29.714 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44487.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44487.log.gz 2024-09-11T23:27:29.716 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5/var/log/ceph/ceph-client.admin.76392.log: --verbose -- /var/log/ceph/ceph-client.admin.44200.log 2024-09-11T23:27:29.716 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.76392.log.gz 2024-09-11T23:27:29.716 INFO:teuthology.orchestra.run.smithi144.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-11T23:27:29.716 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44865.log 2024-09-11T23:27:29.717 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73855.log 2024-09-11T23:27:29.718 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44200.log.gz 2024-09-11T23:27:29.719 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43345.log 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44865.log.gz 2024-09-11T23:27:29.719 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-11T23:27:29.720 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73855.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65087.log 2024-09-11T23:27:29.720 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73855.log.gz 2024-09-11T23:27:29.721 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76007.log 2024-09-11T23:27:29.721 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43345.log.gz 2024-09-11T23:27:29.723 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.65087.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65087.log.gz 2024-09-11T23:27:29.723 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49849.log 2024-09-11T23:27:29.724 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76007.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.76007.log.gz 2024-09-11T23:27:29.724 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74111.log 2024-09-11T23:27:29.726 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36048.log 2024-09-11T23:27:29.726 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49849.log.gz 2024-09-11T23:27:29.727 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74111.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.74111.log.gz 2024-09-11T23:27:29.728 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63140.log 2024-09-11T23:27:29.728 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.36048.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36048.log.gz 2024-09-11T23:27:29.729 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71336.log 2024-09-11T23:27:29.730 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41866.log 2024-09-11T23:27:29.730 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63140.log.gz 2024-09-11T23:27:29.731 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.71336.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71336.log.gz 2024-09-11T23:27:29.732 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46982.log 2024-09-11T23:27:29.733 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57395.log 2024-09-11T23:27:29.733 INFO:teuthology.orchestra.run.smithi144.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41866.log.gz 2024-09-11T23:27:29.734 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71248.log 2024-09-11T23:27:29.734 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46982.log.gz 2024-09-11T23:27:29.735 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60330.log 2024-09-11T23:27:29.735 INFO:teuthology.orchestra.run.smithi144.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.57395.log.gz 2024-09-11T23:27:29.737 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.71248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63182.log 2024-09-11T23:27:29.737 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.71248.log.gz 2024-09-11T23:27:29.738 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60330.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60330.log.gz 2024-09-11T23:27:29.738 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43192.log 2024-09-11T23:27:29.740 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63182.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63182.log.gz 2024-09-11T23:27:29.740 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72918.log 2024-09-11T23:27:29.740 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.0.43192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43192.log.gz 2024-09-11T23:27:29.741 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68927.log 2024-09-11T23:27:29.742 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55632.log 2024-09-11T23:27:29.742 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.72918.log.gz 2024-09-11T23:27:29.743 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.68927.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68927.log.gz 2024-09-11T23:27:29.744 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72572.log 2024-09-11T23:27:29.744 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55632.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55632.log.gz 2024-09-11T23:27:29.745 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71290.log 2024-09-11T23:27:29.746 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72876.log 2024-09-11T23:27:29.746 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72572.log.gz 2024-09-11T23:27:29.748 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.71290.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71290.log.gz 2024-09-11T23:27:29.748 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42718.log 2024-09-11T23:27:29.749 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72876.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72876.log.gz 2024-09-11T23:27:29.749 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46742.log 2024-09-11T23:27:29.751 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52602.log 2024-09-11T23:27:29.751 INFO:teuthology.orchestra.run.smithi144.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.42718.log.gz 2024-09-11T23:27:29.752 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46742.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46742.log.gz 2024-09-11T23:27:29.752 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29578.log 2024-09-11T23:27:29.753 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74696.log 2024-09-11T23:27:29.754 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52602.log.gz 2024-09-11T23:27:29.754 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph.tmp-client.admin.29578.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29578.log.gz 2024-09-11T23:27:29.756 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74696.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.74696.log.gz 2024-09-11T23:27:29.756 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63224.log 2024-09-11T23:27:29.757 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53799.log 2024-09-11T23:27:29.759 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50488.log 2024-09-11T23:27:29.759 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63224.log.gz 2024-09-11T23:27:29.760 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53799.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53799.log.gz 2024-09-11T23:27:29.760 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52083.log 2024-09-11T23:27:29.762 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66716.log 2024-09-11T23:27:29.762 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50488.log.gz 2024-09-11T23:27:29.763 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44529.log 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52083.log.gz 2024-09-11T23:27:29.763 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-11T23:27:29.764 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.66716.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66716.log.gz 2024-09-11T23:27:29.764 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67760.log 2024-09-11T23:27:29.766 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44781.log 2024-09-11T23:27:29.766 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44529.log.gz 2024-09-11T23:27:29.767 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67760.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67760.log.gz 2024-09-11T23:27:29.768 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50315.log 2024-09-11T23:27:29.768 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44781.log.gz 2024-09-11T23:27:29.768 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78052.log 2024-09-11T23:27:29.770 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56266.log 2024-09-11T23:27:29.770 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50315.log.gz 2024-09-11T23:27:29.771 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60120.log 2024-09-11T23:27:29.771 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.78052.log.gz 2024-09-11T23:27:29.772 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56266.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56266.log.gz 2024-09-11T23:27:29.773 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47060.log 2024-09-11T23:27:29.774 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.60120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64391.log 2024-09-11T23:27:29.774 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60120.log.gz 2024-09-11T23:27:29.775 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74926.log 2024-09-11T23:27:29.775 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47060.log.gz 2024-09-11T23:27:29.777 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72477.log 2024-09-11T23:27:29.777 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64391.log.gz 2024-09-11T23:27:29.778 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.74926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71378.log 2024-09-11T23:27:29.779 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.74926.log.gz 2024-09-11T23:27:29.779 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72477.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72477.log.gz 2024-09-11T23:27:29.780 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47244.log 2024-09-11T23:27:29.781 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.71378.log: gzip 89.2% -5 --verbose -- /var/log/ceph/ceph-client.admin.42210.log 2024-09-11T23:27:29.781 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71378.log.gz 2024-09-11T23:27:29.782 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63951.log 2024-09-11T23:27:29.782 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47244.log.gz 2024-09-11T23:27:29.783 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42210.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42210.log.gz 2024-09-11T23:27:29.784 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44823.log 2024-09-11T23:27:29.784 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63951.log.gz 2024-09-11T23:27:29.785 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54931.log 2024-09-11T23:27:29.786 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76520.log 2024-09-11T23:27:29.786 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44823.log.gz 2024-09-11T23:27:29.788 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54931.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54931.log.gz 2024-09-11T23:27:29.788 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66157.log 2024-09-11T23:27:29.789 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76520.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.76520.log.gz 2024-09-11T23:27:29.790 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70311.log 2024-09-11T23:27:29.791 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.66157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67802.log 2024-09-11T23:27:29.791 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66157.log.gz 2024-09-11T23:27:29.792 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.70311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54591.log 2024-09-11T23:27:29.792 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70311.log.gz 2024-09-11T23:27:29.793 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67802.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67802.log.gz 2024-09-11T23:27:29.793 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47743.log 2024-09-11T23:27:29.795 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.54591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76730.log 2024-09-11T23:27:29.795 INFO:teuthology.orchestra.run.smithi144.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54591.log.gz 2024-09-11T23:27:29.796 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.47743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56789.log 2024-09-11T23:27:29.796 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47743.log.gz 2024-09-11T23:27:29.797 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49064.log 2024-09-11T23:27:29.797 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.76730.log.gz 2024-09-11T23:27:29.799 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78663.log 2024-09-11T23:27:29.799 INFO:teuthology.orchestra.run.smithi144.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56789.log.gz 2024-09-11T23:27:29.800 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.49064.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49064.log.gz 2024-09-11T23:27:29.801 INFO:teuthology.orchestra.run.smithi144.stderr:gzip/var/log/ceph/ceph-client.admin.78663.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.79450.log 2024-09-11T23:27:29.801 INFO:teuthology.orchestra.run.smithi144.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78663.log.gz 2024-09-11T23:27:29.802 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79490.log 2024-09-11T23:27:29.803 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.79450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71137.log 2024-09-11T23:27:29.804 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.79450.log.gz 2024-09-11T23:27:29.805 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.79490.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.79490.log.gz 2024-09-11T23:27:29.805 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44613.log 2024-09-11T23:27:29.806 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.71137.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71137.log.gz 2024-09-11T23:27:29.806 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73470.log 2024-09-11T23:27:29.808 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41020.log 2024-09-11T23:27:29.808 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44613.log.gz 2024-09-11T23:27:29.809 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73470.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.73470.log.gz 2024-09-11T23:27:29.810 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5/var/log/ceph/ceph-client.admin.41020.log: --verbose -- /var/log/ceph/ceph-client.admin.73333.log 2024-09-11T23:27:29.810 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41020.log.gz 2024-09-11T23:27:29.811 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57171.log 2024-09-11T23:27:29.812 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.73333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69665.log 2024-09-11T23:27:29.812 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73333.log.gz 2024-09-11T23:27:29.814 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.57171.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57171.log.gz 2024-09-11T23:27:29.815 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.69665.log: -- /var/log/ceph/ceph-client.admin.63532.log 2024-09-11T23:27:29.815 INFO:teuthology.orchestra.run.smithi144.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.69665.log.gz 2024-09-11T23:27:29.816 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77472.log 2024-09-11T23:27:29.817 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.63532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70964.log 2024-09-11T23:27:29.817 INFO:teuthology.orchestra.run.smithi144.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63532.log.gz 2024-09-11T23:27:29.819 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77472.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77472.log.gz 2024-09-11T23:27:29.820 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5/var/log/ceph/ceph-client.admin.70964.log: --verbose -- /var/log/ceph/ceph-client.admin.67376.log 2024-09-11T23:27:29.820 INFO:teuthology.orchestra.run.smithi144.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.70964.log.gz 2024-09-11T23:27:29.820 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55558.log 2024-09-11T23:27:29.822 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56308.log 2024-09-11T23:27:29.822 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67376.log.gz 2024-09-11T23:27:29.823 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55558.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55558.log.gz 2024-09-11T23:27:29.824 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44945.log 2024-09-11T23:27:29.825 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56308.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56308.log.gz 2024-09-11T23:27:29.825 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59724.log 2024-09-11T23:27:29.826 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42424.log 2024-09-11T23:27:29.826 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44945.log.gz 2024-09-11T23:27:29.828 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.59724.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59724.log.gz 2024-09-11T23:27:29.829 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66602.log 2024-09-11T23:27:29.829 INFO:teuthology.orchestra.run.smithi144.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42424.log.gz 2024-09-11T23:27:29.830 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40682.log 2024-09-11T23:27:29.831 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.66602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55710.log 2024-09-11T23:27:29.831 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.66602.log.gz 2024-09-11T23:27:29.833 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40682.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40682.log.gz 2024-09-11T23:27:29.833 INFO:teuthology.orchestra.run.smithi144.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58987.log 2024-09-11T23:27:29.833 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.55710.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55710.log.gz 2024-09-11T23:27:29.834 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50698.log 2024-09-11T23:27:29.835 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.58987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40978.log 2024-09-11T23:27:29.835 INFO:teuthology.orchestra.run.smithi144.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58987.log.gz 2024-09-11T23:27:29.836 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69337.log 2024-09-11T23:27:29.836 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50698.log.gz 2024-09-11T23:27:29.838 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.40978.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40978.log.gz 2024-09-11T23:27:29.838 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52167.log 2024-09-11T23:27:29.839 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.69337.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.69337.log.gz 2024-09-11T23:27:29.839 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48214.log 2024-09-11T23:27:29.840 INFO:teuthology.orchestra.run.smithi165.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-11T23:27:29.840 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53841.log 2024-09-11T23:27:29.841 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48214.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52167.log.gz 2024-09-11T23:27:29.842 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48214.log.gz 2024-09-11T23:27:29.842 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52816.log 2024-09-11T23:27:29.843 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53841.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53841.log.gz 2024-09-11T23:27:29.844 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71963.log 2024-09-11T23:27:29.844 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52816.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52816.log.gz 2024-09-11T23:27:29.845 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65756.log 2024-09-11T23:27:29.846 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.71963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67889.log 2024-09-11T23:27:29.846 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71963.log.gz 2024-09-11T23:27:29.847 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.65756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71630.log 2024-09-11T23:27:29.848 INFO:teuthology.orchestra.run.smithi144.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65756.log.gz 2024-09-11T23:27:29.849 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67889.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67889.log.gz 2024-09-11T23:27:29.849 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70708.log 2024-09-11T23:27:29.850 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.71630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46487.log 2024-09-11T23:27:29.851 INFO:teuthology.orchestra.run.smithi144.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.71630.log.gz 2024-09-11T23:27:29.852 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.70708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43963.log 2024-09-11T23:27:29.852 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.70708.log.gz 2024-09-11T23:27:29.853 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46487.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46487.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65297.log 2024-09-11T23:27:29.853 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-11T23:27:29.854 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.43963.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43963.log.gz 2024-09-11T23:27:29.855 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.65297.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65297.log.gz 2024-09-11T23:27:29.856 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-11T23:27:29.857 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44278.log 2024-09-11T23:27:29.859 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52500.log 2024-09-11T23:27:29.860 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.44278.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44278.log.gz 2024-09-11T23:27:29.860 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69378.log 2024-09-11T23:27:29.862 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.52500.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.52500.log.gz 2024-09-11T23:27:29.862 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.69378.log: /var/log/ceph/ceph-client.admin.67292.log 2024-09-11T23:27:29.863 INFO:teuthology.orchestra.run.smithi144.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.69378.log.gz 2024-09-11T23:27:29.865 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50053.log 2024-09-11T23:27:29.865 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67292.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67292.log.gz 2024-09-11T23:27:29.866 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59071.log 2024-09-11T23:27:29.868 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.50053.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50053.log.gz 2024-09-11T23:27:29.869 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5/var/log/ceph/ceph-client.admin.59071.log: --verbose -- /var/log/ceph/ceph-client.admin.61025.log 2024-09-11T23:27:29.869 INFO:teuthology.orchestra.run.smithi144.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59071.log.gz 2024-09-11T23:27:29.869 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53260.log 2024-09-11T23:27:29.870 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.61025.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61025.log.gz 2024-09-11T23:27:29.871 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76346.log 2024-09-11T23:27:29.872 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.53260.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53260.log.gz 2024-09-11T23:27:29.873 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-11T23:27:29.874 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76346.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.76346.log.gz 2024-09-11T23:27:29.875 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45562.log 2024-09-11T23:27:29.878 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.45562.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45562.log.gz 2024-09-11T23:27:29.878 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71006.log 2024-09-11T23:27:29.880 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.71006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72169.log 2024-09-11T23:27:29.882 INFO:teuthology.orchestra.run.smithi144.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71006.log.gz 2024-09-11T23:27:29.884 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42209.log 2024-09-11T23:27:29.886 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46178.log 2024-09-11T23:27:29.886 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42209.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42209.log.gz 2024-09-11T23:27:29.886 INFO:teuthology.orchestra.run.smithi144.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72169.log.gz 2024-09-11T23:27:29.888 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.46178.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46178.log.gz 2024-09-11T23:27:29.889 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42201.log 2024-09-11T23:27:29.892 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51747.log 2024-09-11T23:27:29.892 INFO:teuthology.orchestra.run.smithi165.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-11T23:27:29.893 INFO:teuthology.orchestra.run.smithi144.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42201.log.gz 2024-09-11T23:27:29.894 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77826.log 2024-09-11T23:27:29.896 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51747.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51747.log.gz 2024-09-11T23:27:29.898 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56926.log 2024-09-11T23:27:29.898 INFO:teuthology.orchestra.run.smithi165.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-11T23:27:29.901 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56926.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72005.log 2024-09-11T23:27:29.902 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.77826.log.gz 2024-09-11T23:27:29.903 INFO:teuthology.orchestra.run.smithi144.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56926.log.gz 2024-09-11T23:27:29.904 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65816.log 2024-09-11T23:27:29.906 INFO:teuthology.orchestra.run.smithi165.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-11T23:27:29.906 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72005.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72005.log.gz 2024-09-11T23:27:29.907 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54284.log 2024-09-11T23:27:29.909 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.65816.log: 88.0%/var/log/ceph/ceph-client.admin.54284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77748.log 2024-09-11T23:27:29.910 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-09-11T23:27:29.910 INFO:teuthology.orchestra.run.smithi165.stderr:real 0m0.860s 2024-09-11T23:27:29.910 INFO:teuthology.orchestra.run.smithi165.stderr:user 0m4.228s 2024-09-11T23:27:29.911 INFO:teuthology.orchestra.run.smithi165.stderr:sys 0m0.455s 2024-09-11T23:27:29.911 INFO:teuthology.orchestra.run.smithi144.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54284.log.gz 2024-09-11T23:27:29.912 INFO:teuthology.orchestra.run.smithi144.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65816.log.gz 2024-09-11T23:27:29.914 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.77748.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.77748.log.gz 2024-09-11T23:27:29.914 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64307.log 2024-09-11T23:27:29.917 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.64307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56494.log 2024-09-11T23:27:29.919 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.56494.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64307.log.gz 2024-09-11T23:27:29.920 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51957.log 2024-09-11T23:27:29.921 INFO:teuthology.orchestra.run.smithi144.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56494.log.gz 2024-09-11T23:27:29.923 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65714.log 2024-09-11T23:27:29.926 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.65714.log: /var/log/ceph/ceph-client.admin.51957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66490.log 2024-09-11T23:27:29.926 INFO:teuthology.orchestra.run.smithi144.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-11T23:27:29.927 INFO:teuthology.orchestra.run.smithi144.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65714.log.gz 2024-09-11T23:27:29.928 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51617.log 2024-09-11T23:27:29.928 INFO:teuthology.orchestra.run.smithi144.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51957.log.gz 2024-09-11T23:27:29.930 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78010.log 2024-09-11T23:27:29.930 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.66490.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.66490.log.gz 2024-09-11T23:27:29.931 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.51617.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51617.log.gz 2024-09-11T23:27:29.932 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.78010.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.78010.log.gz 2024-09-11T23:27:29.933 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42676.log 2024-09-11T23:27:29.934 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76436.log 2024-09-11T23:27:29.936 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.42676.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42676.log.gz 2024-09-11T23:27:29.936 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.76436.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.76436.log.gz 2024-09-11T23:27:29.937 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41871.log 2024-09-11T23:27:29.939 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72650.log 2024-09-11T23:27:29.940 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.41871.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41871.log.gz 2024-09-11T23:27:29.941 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.72650.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72650.log.gz 2024-09-11T23:27:29.941 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67460.log 2024-09-11T23:27:29.943 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75670.log 2024-09-11T23:27:29.944 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.67460.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67460.log.gz 2024-09-11T23:27:29.945 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.75670.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.75670.log.gz 2024-09-11T23:27:29.946 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71462.log 2024-09-11T23:27:29.947 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79532.log 2024-09-11T23:27:29.949 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.71462.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71462.log.gz 2024-09-11T23:27:29.950 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.79532.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.79532.log.gz 2024-09-11T23:27:29.950 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48042.log 2024-09-11T23:27:29.953 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/ceph-client.admin.48042.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48042.log.gz 2024-09-11T23:27:29.994 INFO:teuthology.orchestra.run.smithi144.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-11T23:27:30.176 INFO:teuthology.orchestra.run.smithi144.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-11T23:27:30.302 INFO:teuthology.orchestra.run.smithi144.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-11T23:27:30.307 INFO:teuthology.orchestra.run.smithi144.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-11T23:27:30.452 INFO:teuthology.orchestra.run.smithi144.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-11T23:27:30.578 INFO:teuthology.orchestra.run.smithi144.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-11T23:27:30.581 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-11T23:27:30.581 INFO:teuthology.orchestra.run.smithi144.stderr:real 0m1.536s 2024-09-11T23:27:30.581 INFO:teuthology.orchestra.run.smithi144.stderr:user 0m5.365s 2024-09-11T23:27:30.581 INFO:teuthology.orchestra.run.smithi144.stderr:sys 0m2.112s 2024-09-11T23:27:30.582 INFO:tasks.ceph:Archiving logs... 2024-09-11T23:27:30.582 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901467/remote/smithi144/log 2024-09-11T23:27:30.583 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T23:27:31.811 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901467/remote/smithi165/log 2024-09-11T23:27:31.812 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T23:27:32.406 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T23:27:32.416 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T23:27:32.416 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T23:27:32.421 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T23:27:32.540 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T23:27:32.549 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T23:27:32.549 DEBUG:teuthology.orchestra.run.smithi144:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:27:32.553 DEBUG:teuthology.orchestra.run.smithi165:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:27:32.582 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:27:32.587 INFO:teuthology.orchestra.run.smithi165.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:27:32.589 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:27:32.589 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2024-09-11T23:27:32.590 INFO:teuthology.orchestra.run.smithi144.stdout:^* hv01.front.sepia.ceph.com 3 6 377 43 +2159us[+2196us] +/- 66ms 2024-09-11T23:27:32.590 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 42 -1033us[-1033us] +/- 70ms 2024-09-11T23:27:32.590 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 -1328us[-1292us] +/- 69ms 2024-09-11T23:27:32.590 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:27:32.594 INFO:teuthology.orchestra.run.smithi165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:27:32.594 INFO:teuthology.orchestra.run.smithi165.stdout:=============================================================================== 2024-09-11T23:27:32.594 INFO:teuthology.orchestra.run.smithi165.stdout:^* hv01.front.sepia.ceph.com 3 6 377 41 +2194us[+2173us] +/- 66ms 2024-09-11T23:27:32.594 INFO:teuthology.orchestra.run.smithi165.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 43 -992us[-1014us] +/- 70ms 2024-09-11T23:27:32.594 INFO:teuthology.orchestra.run.smithi165.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 -1316us[-1337us] +/- 69ms 2024-09-11T23:27:32.594 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:27:32.595 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T23:27:32.604 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T23:27:32.604 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T23:27:32.613 DEBUG:teuthology.orchestra.run.smithi144:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T23:27:32.773 DEBUG:teuthology.orchestra.run.smithi165:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T23:27:32.892 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:27:32.954 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:27:32.955 DEBUG:teuthology.orchestra.run.smithi165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T23:27:33.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:27:33.016 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T23:27:33.026 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T23:27:33.037 INFO:teuthology.task.internal:Duration was 1050.241855 seconds 2024-09-11T23:27:33.038 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T23:27:33.047 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T23:27:33.047 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T23:27:33.051 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T23:27:33.134 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:27:33.138 INFO:teuthology.orchestra.run.smithi165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:27:33.531 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T23:27:33.532 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi144.front.sepia.ceph.com 2024-09-11T23:27:33.532 DEBUG:teuthology.orchestra.run.smithi144:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T23:27:33.581 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi165.front.sepia.ceph.com 2024-09-11T23:27:33.581 DEBUG:teuthology.orchestra.run.smithi165:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T23:27:33.655 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T23:27:33.655 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T23:27:33.659 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T23:27:33.718 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T23:27:33.718 DEBUG:teuthology.orchestra.run.smithi144:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T23:27:33.723 DEBUG:teuthology.orchestra.run.smithi165:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T23:27:33.891 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T23:27:33.901 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T23:27:33.901 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T23:27:33.957 DEBUG:teuthology.orchestra.run.smithi165:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T23:27:34.013 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T23:27:34.023 DEBUG:teuthology.orchestra.run.smithi144:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:27:34.027 DEBUG:teuthology.orchestra.run.smithi165:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:27:34.094 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = core 2024-09-11T23:27:34.098 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = core 2024-09-11T23:27:34.128 DEBUG:teuthology.orchestra.run.smithi144:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:27:34.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:27:34.162 DEBUG:teuthology.orchestra.run.smithi165:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T23:27:34.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:27:34.196 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T23:27:34.206 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T23:27:34.207 DEBUG:teuthology.misc:Transferring archived files from smithi144:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901467/remote/smithi144 2024-09-11T23:27:34.207 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T23:27:34.274 DEBUG:teuthology.misc:Transferring archived files from smithi165:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901467/remote/smithi165 2024-09-11T23:27:34.275 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T23:27:34.338 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T23:27:34.339 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T23:27:34.343 DEBUG:teuthology.orchestra.run.smithi165:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T23:27:34.378 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T23:27:34.391 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T23:27:34.391 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T23:27:34.400 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T23:27:34.400 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T23:27:34.419 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T23:27:34.450 INFO:teuthology.orchestra.run.smithi144.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 23:27 /home/ubuntu/cephtest 2024-09-11T23:27:34.454 INFO:teuthology.orchestra.run.smithi165.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 23:27 /home/ubuntu/cephtest 2024-09-11T23:27:34.456 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T23:27:34.467 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T23:27:34.551 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/misc}} duration: 1050.2418551445007 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-11T23:27:34.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T23:27:34.650 INFO:teuthology.run:pass